2024-02-10T07:53:18.711 INFO:root:teuthology version: 0.0.1.dev256+gd9fdb22 2024-02-10T07:53:18.711 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --description rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} --name yuriw-2024-02-09_21:34:44-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-02-09_21:34:44-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7555285 -- /home/teuthworker/archive/yuriw-2024-02-09_21:34:44-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7555285/orig.config.yaml 2024-02-10T07:53:18.744 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-10T07:53:18.822 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2024-02-09_21:34:44-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7555285 branch: wip-yuri10-testing-2024-02-08-0854-pacific description: rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} email: null first_in_suite: false job_id: '7555285' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: yuriw-2024-02-09_21:34:44-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 8.stream overrides: admin_socket: branch: wip-yuri10-testing-2024-02-08-0854-pacific ceph: conf: client.0: debug ms: 1 debug objecter: 20 debug rados: 20 global: ms bind msgr1: false ms bind msgr2: true ms type: async mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon min osdmap epochs: 50 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 paxos service trim min: 10 osd: debug ms: 1 debug osd: 20 osd debug reject backfill probability: 0.3 osd delete sleep: 1 osd max backfills: 3 osd scrub max interval: 120 osd scrub min interval: 60 osd shutdown pgref assert: true osd snap trim sleep: 2 flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - but it is still running - objects unfound and apparently lost - \(MON_DOWN\) - \(OSDMAP_FLAGS\) sha1: 0e714d9a4bd2a821113e6318adb87bd06cf81ec1 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} cephadm: cephadm_mode: root install: ceph: flavor: default sha1: 0e714d9a4bd2a821113e6318adb87bd06cf81ec1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 workunit: branch: wip-tracker-64343-pacific sha1: 57bd6abdec7bb457ae7999d9c96682e9ac678e27 owner: scheduled_yuriw@teuthology priority: 71 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - ceph.rgw.foo.a - node-exporter.a - alertmanager.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - grafana.a - node-exporter.b - ceph.iscsi.iscsi.a seed: 964 sha1: 0e714d9a4bd2a821113e6318adb87bd06cf81ec1 sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-tracker-64343-pacific suite_path: /home/teuthworker/src/github.com_ljflores_ceph_57bd6abdec7bb457ae7999d9c96682e9ac678e27/qa suite_relpath: qa suite_repo: https://github.com/ljflores/ceph.git suite_sha1: 57bd6abdec7bb457ae7999d9c96682e9ac678e27 targets: smithi018.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG0mpVhkOzZP8a+rj+nXH7NQTem/uhOG3iCF3DIPrgMp6R7ajxBsiZIiRB+Pl0cJiMePbB3LxLMzNHk9iBvwTJc= smithi071.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHzE/Bcn5hiz3L/ibUXoqMrkKgs5yEHgRM0LMkZEPP/anf9S+RP+41bDkAUQU7FODYSTZbmUDx/dSR+u6O4MM6A= tasks: - pexec: all: - sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup - sudo dnf -y module reset container-tools - sudo dnf -y module install container-tools --allowerasing --nobest - sudo cp /etc/containers/registries.conf.backup /etc/containers/registries.conf - install: null - cephadm: conf: mgr: debug mgr: 20 debug ms: 1 - thrashosds: chance_pgnum_grow: 1 chance_pgnum_shrink: 1 chance_pgpnum_fix: 1 timeout: 1200 - full_sequential: - radosbench: clients: - client.0 time: 90 - radosbench: clients: - client.0 time: 90 - radosbench: clients: - client.0 time: 90 - radosbench: clients: - client.0 time: 90 - radosbench: clients: - client.0 time: 90 teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: d9fdb2209e15b39d9f061fd85399f352ce0f0894 timestamp: 2024-02-09_21:34:44 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-02-10T07:53:18.823 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ljflores_ceph_57bd6abdec7bb457ae7999d9c96682e9ac678e27/qa; will attempt to use it 2024-02-10T07:53:18.823 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ljflores_ceph_57bd6abdec7bb457ae7999d9c96682e9ac678e27/qa/tasks 2024-02-10T07:53:18.823 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-02-10T07:53:18.825 INFO:teuthology.task.internal:Checking packages... 2024-02-10T07:53:18.848 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '0e714d9a4bd2a821113e6318adb87bd06cf81ec1' 2024-02-10T07:53:18.848 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-10T07:53:18.848 INFO:teuthology.packaging:ref: None 2024-02-10T07:53:18.848 INFO:teuthology.packaging:tag: None 2024-02-10T07:53:18.849 INFO:teuthology.packaging:branch: wip-yuri10-testing-2024-02-08-0854-pacific 2024-02-10T07:53:18.849 INFO:teuthology.packaging:sha1: 0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-10T07:53:18.849 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri10-testing-2024-02-08-0854-pacific 2024-02-10T07:53:19.010 INFO:teuthology.task.internal:Found packages for ceph version 16.2.14-521.g0e714d9a 2024-02-10T07:53:19.011 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-02-10T07:53:19.018 INFO:teuthology.task.internal:no buildpackages task found 2024-02-10T07:53:19.018 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-02-10T07:53:19.024 INFO:teuthology.task.internal:Saving configuration 2024-02-10T07:53:19.037 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-02-10T07:53:19.043 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-10T07:53:19.067 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi018.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-02-09_21:34:44-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7555285', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-10 07:48:02.094098', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG0mpVhkOzZP8a+rj+nXH7NQTem/uhOG3iCF3DIPrgMp6R7ajxBsiZIiRB+Pl0cJiMePbB3LxLMzNHk9iBvwTJc='} 2024-02-10T07:53:19.088 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi071.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-02-09_21:34:44-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7555285', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-10 07:48:02.092554', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHzE/Bcn5hiz3L/ibUXoqMrkKgs5yEHgRM0LMkZEPP/anf9S+RP+41bDkAUQU7FODYSTZbmUDx/dSR+u6O4MM6A='} 2024-02-10T07:53:19.088 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-02-10T07:53:19.094 INFO:teuthology.task.internal:roles: ubuntu@smithi018.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'ceph.rgw.foo.a', 'node-exporter.a', 'alertmanager.a'] 2024-02-10T07:53:19.094 INFO:teuthology.task.internal:roles: ubuntu@smithi071.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b', 'ceph.iscsi.iscsi.a'] 2024-02-10T07:53:19.094 INFO:teuthology.run_tasks:Running task console_log... 2024-02-10T07:53:19.166 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7feb8dd5df70>, signals=[15]) 2024-02-10T07:53:19.167 INFO:teuthology.run_tasks:Running task internal.connect... 2024-02-10T07:53:19.173 INFO:teuthology.task.internal:Opening connections... 2024-02-10T07:53:19.173 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi018.front.sepia.ceph.com 2024-02-10T07:53:19.175 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T07:53:19.261 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi071.front.sepia.ceph.com 2024-02-10T07:53:19.262 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T07:53:19.334 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-02-10T07:53:19.340 DEBUG:teuthology.orchestra.run.smithi018:> uname -m 2024-02-10T07:53:19.363 INFO:teuthology.orchestra.run.smithi018.stdout:x86_64 2024-02-10T07:53:19.363 DEBUG:teuthology.orchestra.run.smithi018:> cat /etc/os-release 2024-02-10T07:53:19.426 INFO:teuthology.orchestra.run.smithi018.stdout:NAME="CentOS Stream" 2024-02-10T07:53:19.426 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION="8" 2024-02-10T07:53:19.426 INFO:teuthology.orchestra.run.smithi018.stdout:ID="centos" 2024-02-10T07:53:19.426 INFO:teuthology.orchestra.run.smithi018.stdout:ID_LIKE="rhel fedora" 2024-02-10T07:53:19.426 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION_ID="8" 2024-02-10T07:53:19.426 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM_ID="platform:el8" 2024-02-10T07:53:19.426 INFO:teuthology.orchestra.run.smithi018.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-10T07:53:19.426 INFO:teuthology.orchestra.run.smithi018.stdout:ANSI_COLOR="0;31" 2024-02-10T07:53:19.426 INFO:teuthology.orchestra.run.smithi018.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-10T07:53:19.426 INFO:teuthology.orchestra.run.smithi018.stdout:HOME_URL="https://centos.org/" 2024-02-10T07:53:19.426 INFO:teuthology.orchestra.run.smithi018.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-10T07:53:19.426 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-10T07:53:19.426 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-10T07:53:19.427 INFO:teuthology.lock.ops:Updating smithi018.front.sepia.ceph.com on lock server 2024-02-10T07:53:19.449 DEBUG:teuthology.orchestra.run.smithi071:> uname -m 2024-02-10T07:53:19.472 INFO:teuthology.orchestra.run.smithi071.stdout:x86_64 2024-02-10T07:53:19.472 DEBUG:teuthology.orchestra.run.smithi071:> cat /etc/os-release 2024-02-10T07:53:19.533 INFO:teuthology.orchestra.run.smithi071.stdout:NAME="CentOS Stream" 2024-02-10T07:53:19.534 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION="8" 2024-02-10T07:53:19.534 INFO:teuthology.orchestra.run.smithi071.stdout:ID="centos" 2024-02-10T07:53:19.534 INFO:teuthology.orchestra.run.smithi071.stdout:ID_LIKE="rhel fedora" 2024-02-10T07:53:19.534 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION_ID="8" 2024-02-10T07:53:19.534 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM_ID="platform:el8" 2024-02-10T07:53:19.534 INFO:teuthology.orchestra.run.smithi071.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-10T07:53:19.534 INFO:teuthology.orchestra.run.smithi071.stdout:ANSI_COLOR="0;31" 2024-02-10T07:53:19.534 INFO:teuthology.orchestra.run.smithi071.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-10T07:53:19.534 INFO:teuthology.orchestra.run.smithi071.stdout:HOME_URL="https://centos.org/" 2024-02-10T07:53:19.534 INFO:teuthology.orchestra.run.smithi071.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-10T07:53:19.535 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-10T07:53:19.535 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-10T07:53:19.535 INFO:teuthology.lock.ops:Updating smithi071.front.sepia.ceph.com on lock server 2024-02-10T07:53:19.557 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-02-10T07:53:19.566 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-02-10T07:53:19.571 INFO:teuthology.task.internal:Checking for old test directory... 2024-02-10T07:53:19.571 DEBUG:teuthology.orchestra.run.smithi018:> test '!' -e /home/ubuntu/cephtest 2024-02-10T07:53:19.574 DEBUG:teuthology.orchestra.run.smithi071:> test '!' -e /home/ubuntu/cephtest 2024-02-10T07:53:19.594 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-02-10T07:53:19.600 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-02-10T07:53:19.601 DEBUG:teuthology.orchestra.run.smithi018:> test -z $(ls -A /var/lib/ceph) 2024-02-10T07:53:19.635 DEBUG:teuthology.orchestra.run.smithi071:> test -z $(ls -A /var/lib/ceph) 2024-02-10T07:53:19.670 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-02-10T07:53:19.725 INFO:teuthology.run_tasks:Running task kernel... 2024-02-10T07:53:19.740 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-02-10T07:53:19.740 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-02-10T07:53:19.740 DEBUG:teuthology.orchestra.run.smithi018:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-10T07:53:19.741 DEBUG:teuthology.orchestra.run.smithi071:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-10T07:53:19.759 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-10T07:53:19.760 DEBUG:teuthology.orchestra.run.smithi071:> uname -r 2024-02-10T07:53:19.761 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-10T07:53:19.761 DEBUG:teuthology.orchestra.run.smithi018:> uname -r 2024-02-10T07:53:19.820 INFO:teuthology.orchestra.run.smithi071.stdout:4.18.0-489.el8.x86_64 2024-02-10T07:53:19.820 INFO:teuthology.task.kernel:Running kernel on smithi071: 4.18.0-489.el8.x86_64 2024-02-10T07:53:19.820 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum install -y kernel 2024-02-10T07:53:19.824 INFO:teuthology.orchestra.run.smithi018.stdout:4.18.0-489.el8.x86_64 2024-02-10T07:53:19.824 INFO:teuthology.task.kernel:Running kernel on smithi018: 4.18.0-489.el8.x86_64 2024-02-10T07:53:19.824 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum install -y kernel 2024-02-10T07:53:28.976 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 8 - AppStream 4.0 MB/s | 27 MB 00:06 2024-02-10T07:53:31.637 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 8 - AppStream 2.9 MB/s | 27 MB 00:09 2024-02-10T07:56:46.884 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 8 - BaseOS 55 kB/s | 10 MB 03:10 2024-02-10T07:56:48.868 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 8 - Extras 59 kB/s | 18 kB 00:00 2024-02-10T07:56:49.327 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 8 - Extras common packages 20 kB/s | 6.9 kB 00:00 2024-02-10T07:56:49.562 INFO:teuthology.orchestra.run.smithi018.stdout:Copr repo for python3-asyncssh owned by ceph 25 kB/s | 3.5 kB 00:00 2024-02-10T07:56:51.498 INFO:teuthology.orchestra.run.smithi018.stdout:Extra Packages for Enterprise Linux 8.8 MB/s | 16 MB 00:01 2024-02-10T07:56:55.146 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 8 - BaseOS 52 kB/s | 10 MB 03:21 2024-02-10T07:56:55.470 INFO:teuthology.orchestra.run.smithi018.stdout:lab-extras 509 kB/s | 24 kB 00:00 2024-02-10T07:56:56.930 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 8 - Extras 96 kB/s | 18 kB 00:00 2024-02-10T07:56:57.347 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 8 - Extras common packages 23 kB/s | 6.9 kB 00:00 2024-02-10T07:56:57.649 INFO:teuthology.orchestra.run.smithi071.stdout:Copr repo for python3-asyncssh owned by ceph 16 kB/s | 3.5 kB 00:00 2024-02-10T07:56:58.450 INFO:teuthology.orchestra.run.smithi018.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2024-02-10T07:56:58.451 INFO:teuthology.orchestra.run.smithi018.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2024-02-10T07:56:58.573 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-02-10T07:56:58.573 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-02-10T07:56:58.574 INFO:teuthology.orchestra.run.smithi018.stdout: Package Architecture Version Repository Size 2024-02-10T07:56:58.574 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-02-10T07:56:58.574 INFO:teuthology.orchestra.run.smithi018.stdout:Installing: 2024-02-10T07:56:58.574 INFO:teuthology.orchestra.run.smithi018.stdout: kernel x86_64 4.18.0-536.el8 baseos 10 M 2024-02-10T07:56:58.574 INFO:teuthology.orchestra.run.smithi018.stdout:Installing dependencies: 2024-02-10T07:56:58.574 INFO:teuthology.orchestra.run.smithi018.stdout: kernel-core x86_64 4.18.0-536.el8 baseos 44 M 2024-02-10T07:56:58.574 INFO:teuthology.orchestra.run.smithi018.stdout: kernel-modules x86_64 4.18.0-536.el8 baseos 36 M 2024-02-10T07:56:58.574 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T07:56:58.574 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction Summary 2024-02-10T07:56:58.574 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-02-10T07:56:58.574 INFO:teuthology.orchestra.run.smithi018.stdout:Install 3 Packages 2024-02-10T07:56:58.574 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T07:56:58.575 INFO:teuthology.orchestra.run.smithi018.stdout:Total download size: 90 M 2024-02-10T07:56:58.575 INFO:teuthology.orchestra.run.smithi018.stdout:Installed size: 96 M 2024-02-10T07:56:58.575 INFO:teuthology.orchestra.run.smithi018.stdout:Downloading Packages: 2024-02-10T07:56:58.969 INFO:teuthology.orchestra.run.smithi071.stdout:Extra Packages for Enterprise Linux 13 MB/s | 16 MB 00:01 2024-02-10T07:57:02.330 INFO:teuthology.orchestra.run.smithi018.stdout:(1/3): kernel-4.18.0-536.el8.x86_64.rpm 2.8 MB/s | 10 MB 00:03 2024-02-10T07:57:02.725 INFO:teuthology.orchestra.run.smithi071.stdout:lab-extras 410 kB/s | 24 kB 00:00 2024-02-10T07:57:05.656 INFO:teuthology.orchestra.run.smithi071.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2024-02-10T07:57:05.656 INFO:teuthology.orchestra.run.smithi071.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2024-02-10T07:57:05.752 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-02-10T07:57:05.753 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-02-10T07:57:05.753 INFO:teuthology.orchestra.run.smithi071.stdout: Package Architecture Version Repository Size 2024-02-10T07:57:05.753 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-02-10T07:57:05.754 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-02-10T07:57:05.754 INFO:teuthology.orchestra.run.smithi071.stdout: kernel x86_64 4.18.0-536.el8 baseos 10 M 2024-02-10T07:57:05.754 INFO:teuthology.orchestra.run.smithi071.stdout:Installing dependencies: 2024-02-10T07:57:05.754 INFO:teuthology.orchestra.run.smithi071.stdout: kernel-core x86_64 4.18.0-536.el8 baseos 44 M 2024-02-10T07:57:05.754 INFO:teuthology.orchestra.run.smithi071.stdout: kernel-modules x86_64 4.18.0-536.el8 baseos 36 M 2024-02-10T07:57:05.754 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-02-10T07:57:05.754 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-02-10T07:57:05.754 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-02-10T07:57:05.754 INFO:teuthology.orchestra.run.smithi071.stdout:Install 3 Packages 2024-02-10T07:57:05.754 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-02-10T07:57:05.755 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 90 M 2024-02-10T07:57:05.755 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 96 M 2024-02-10T07:57:05.755 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-02-10T07:57:09.651 INFO:teuthology.orchestra.run.smithi071.stdout:(1/3): kernel-4.18.0-536.el8.x86_64.rpm 2.7 MB/s | 10 MB 00:03 2024-02-10T07:57:13.086 INFO:teuthology.orchestra.run.smithi018.stdout:(2/3): kernel-modules-4.18.0-536.el8.x86_64.rpm 2.5 MB/s | 36 MB 00:14 2024-02-10T07:57:16.061 INFO:teuthology.orchestra.run.smithi018.stdout:(3/3): kernel-core-4.18.0-536.el8.x86_64.rpm 2.5 MB/s | 44 MB 00:17 2024-02-10T07:57:16.061 INFO:teuthology.orchestra.run.smithi018.stdout:-------------------------------------------------------------------------------- 2024-02-10T07:57:16.062 INFO:teuthology.orchestra.run.smithi018.stdout:Total 5.2 MB/s | 90 MB 00:17 2024-02-10T07:57:16.775 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction check 2024-02-10T07:57:17.213 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction check succeeded. 2024-02-10T07:57:17.214 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction test 2024-02-10T07:57:18.515 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction test succeeded. 2024-02-10T07:57:18.538 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction 2024-02-10T07:57:19.715 INFO:teuthology.orchestra.run.smithi071.stdout:(2/3): kernel-modules-4.18.0-536.el8.x86_64.rpm 2.6 MB/s | 36 MB 00:13 2024-02-10T07:57:21.618 INFO:teuthology.orchestra.run.smithi018.stdout: Preparing : 1/1 2024-02-10T07:57:22.108 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : kernel-core-4.18.0-536.el8.x86_64 1/3 2024-02-10T07:57:25.974 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: kernel-core-4.18.0-536.el8.x86_64 1/3 2024-02-10T07:57:26.374 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : kernel-modules-4.18.0-536.el8.x86_64 2/3 2024-02-10T07:57:30.054 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: kernel-modules-4.18.0-536.el8.x86_64 2/3 2024-02-10T07:57:30.341 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : kernel-4.18.0-536.el8.x86_64 3/3 2024-02-10T07:57:31.139 INFO:teuthology.orchestra.run.smithi071.stdout:(3/3): kernel-core-4.18.0-536.el8.x86_64.rpm 1.7 MB/s | 44 MB 00:25 2024-02-10T07:57:31.139 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-02-10T07:57:31.139 INFO:teuthology.orchestra.run.smithi071.stdout:Total 3.6 MB/s | 90 MB 00:25 2024-02-10T07:57:31.823 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-02-10T07:57:32.222 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-02-10T07:57:32.223 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-02-10T07:57:33.475 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-02-10T07:57:33.506 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-02-10T07:57:36.415 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-02-10T07:57:36.992 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : kernel-core-4.18.0-536.el8.x86_64 1/3 2024-02-10T07:57:40.527 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: kernel-core-4.18.0-536.el8.x86_64 1/3 2024-02-10T07:57:40.916 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : kernel-modules-4.18.0-536.el8.x86_64 2/3 2024-02-10T07:57:44.344 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: kernel-modules-4.18.0-536.el8.x86_64 2/3 2024-02-10T07:57:44.605 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : kernel-4.18.0-536.el8.x86_64 3/3 2024-02-10T07:57:53.785 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: kernel-core-4.18.0-536.el8.x86_64 3/3 2024-02-10T07:57:53.810 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: kernel-modules-4.18.0-536.el8.x86_64 3/3 2024-02-10T07:57:54.560 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: kernel-4.18.0-536.el8.x86_64 3/3 2024-02-10T07:57:54.560 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : kernel-4.18.0-536.el8.x86_64 1/3 2024-02-10T07:57:54.560 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : kernel-core-4.18.0-536.el8.x86_64 2/3 2024-02-10T07:57:55.053 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : kernel-modules-4.18.0-536.el8.x86_64 3/3 2024-02-10T07:57:55.053 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T07:57:55.053 INFO:teuthology.orchestra.run.smithi018.stdout:Installed: 2024-02-10T07:57:55.053 INFO:teuthology.orchestra.run.smithi018.stdout: kernel-4.18.0-536.el8.x86_64 kernel-core-4.18.0-536.el8.x86_64 2024-02-10T07:57:55.053 INFO:teuthology.orchestra.run.smithi018.stdout: kernel-modules-4.18.0-536.el8.x86_64 2024-02-10T07:57:55.053 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T07:57:55.053 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-02-10T07:57:55.197 DEBUG:teuthology.orchestra.run.smithi018:> rpm -q kernel | sort -rV | head -n 1 2024-02-10T07:57:55.421 INFO:teuthology.orchestra.run.smithi018.stdout:kernel-4.18.0-536.el8.x86_64 2024-02-10T07:57:55.421 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-536.el8.x86_64 2024-02-10T07:57:55.422 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-536.el8.x86_64 2024-02-10T07:57:55.422 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-02-10T07:57:55.422 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-02-10T07:57:55.422 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-02-10T07:57:55.422 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi018.front.sepia.ceph.com, path=None, version=distro) 2024-02-10T07:57:55.422 DEBUG:teuthology.orchestra.run.smithi018:> rpm -q kernel | sort -rV | head -n 1 2024-02-10T07:57:55.641 INFO:teuthology.orchestra.run.smithi018.stdout:kernel-4.18.0-536.el8.x86_64 2024-02-10T07:57:55.642 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-536.el8.x86_64 2024-02-10T07:57:55.642 DEBUG:teuthology.orchestra.run.smithi018:> sudo rpm -qi grub2-tools 2024-02-10T07:57:55.676 INFO:teuthology.orchestra.run.smithi018.stdout:Name : grub2-tools 2024-02-10T07:57:55.677 INFO:teuthology.orchestra.run.smithi018.stdout:Epoch : 1 2024-02-10T07:57:55.677 INFO:teuthology.orchestra.run.smithi018.stdout:Version : 2.02 2024-02-10T07:57:55.677 INFO:teuthology.orchestra.run.smithi018.stdout:Release : 129.el8 2024-02-10T07:57:55.677 INFO:teuthology.orchestra.run.smithi018.stdout:Architecture: x86_64 2024-02-10T07:57:55.677 INFO:teuthology.orchestra.run.smithi018.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2024-02-10T07:57:55.677 INFO:teuthology.orchestra.run.smithi018.stdout:Group : System Environment/Base 2024-02-10T07:57:55.677 INFO:teuthology.orchestra.run.smithi018.stdout:Size : 9265586 2024-02-10T07:57:55.677 INFO:teuthology.orchestra.run.smithi018.stdout:License : GPLv3+ 2024-02-10T07:57:55.677 INFO:teuthology.orchestra.run.smithi018.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2024-02-10T07:57:55.677 INFO:teuthology.orchestra.run.smithi018.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2024-02-10T07:57:55.677 INFO:teuthology.orchestra.run.smithi018.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2024-02-10T07:57:55.677 INFO:teuthology.orchestra.run.smithi018.stdout:Build Host : kbuilder.bsys.centos.org 2024-02-10T07:57:55.677 INFO:teuthology.orchestra.run.smithi018.stdout:Relocations : (not relocatable) 2024-02-10T07:57:55.677 INFO:teuthology.orchestra.run.smithi018.stdout:Packager : CentOS BuildSystem 2024-02-10T07:57:55.678 INFO:teuthology.orchestra.run.smithi018.stdout:Vendor : CentOS 2024-02-10T07:57:55.678 INFO:teuthology.orchestra.run.smithi018.stdout:URL : http://www.gnu.org/software/grub/ 2024-02-10T07:57:55.678 INFO:teuthology.orchestra.run.smithi018.stdout:Summary : Support tools for GRUB. 2024-02-10T07:57:55.678 INFO:teuthology.orchestra.run.smithi018.stdout:Description : 2024-02-10T07:57:55.678 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T07:57:55.678 INFO:teuthology.orchestra.run.smithi018.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-02-10T07:57:55.678 INFO:teuthology.orchestra.run.smithi018.stdout:customizable bootloader with modular architecture. It supports a rich 2024-02-10T07:57:55.678 INFO:teuthology.orchestra.run.smithi018.stdout:variety of kernel formats, file systems, computer architectures and 2024-02-10T07:57:55.678 INFO:teuthology.orchestra.run.smithi018.stdout:hardware devices. 2024-02-10T07:57:55.678 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T07:57:55.678 INFO:teuthology.orchestra.run.smithi018.stdout:This subpackage provides tools for support of all platforms. 2024-02-10T07:57:55.679 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-02-10T07:57:55.679 INFO:teuthology.task.kernel:Updating grub on smithi018 to boot 4.18.0-536.el8.x86_64 2024-02-10T07:57:55.679 DEBUG:teuthology.orchestra.run.smithi018:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-02-10T07:57:56.902 INFO:teuthology.orchestra.run.smithi018.stderr:Generating grub configuration file ... 2024-02-10T07:57:59.032 INFO:teuthology.orchestra.run.smithi018.stderr:done 2024-02-10T07:57:59.035 DEBUG:teuthology.orchestra.run.smithi018:> mktemp 2024-02-10T07:57:59.071 INFO:teuthology.orchestra.run.smithi018.stdout:/tmp/tmp.VZK5PWQwrQ 2024-02-10T07:57:59.071 DEBUG:teuthology.orchestra.run.smithi018:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.VZK5PWQwrQ 2024-02-10T07:57:59.143 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 0666 /tmp/tmp.VZK5PWQwrQ 2024-02-10T07:57:59.300 DEBUG:teuthology.orchestra.remote:smithi018:/tmp/tmp.VZK5PWQwrQ is 6KB 2024-02-10T07:57:59.324 DEBUG:teuthology.orchestra.run.smithi018:> rm -fr /tmp/tmp.VZK5PWQwrQ 2024-02-10T07:57:59.342 DEBUG:teuthology.orchestra.run.smithi018:> sudo /bin/ls /boot/loader/entries || true 2024-02-10T07:57:59.413 INFO:teuthology.orchestra.run.smithi018.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2024-02-10T07:57:59.413 INFO:teuthology.orchestra.run.smithi018.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2024-02-10T07:57:59.413 INFO:teuthology.orchestra.run.smithi018.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2024-02-10T07:57:59.413 INFO:teuthology.orchestra.run.smithi018.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-536.el8.x86_64.conf 2024-02-10T07:57:59.414 DEBUG:teuthology.orchestra.run.smithi018:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-536.el8.x86_64 2024-02-10T07:57:59.573 DEBUG:teuthology.orchestra.run.smithi018:> sudo shutdown -r now 2024-02-10T07:58:06.461 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: kernel-core-4.18.0-536.el8.x86_64 3/3 2024-02-10T07:58:06.484 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: kernel-modules-4.18.0-536.el8.x86_64 3/3 2024-02-10T07:58:07.175 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: kernel-4.18.0-536.el8.x86_64 3/3 2024-02-10T07:58:07.176 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : kernel-4.18.0-536.el8.x86_64 1/3 2024-02-10T07:58:07.176 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : kernel-core-4.18.0-536.el8.x86_64 2/3 2024-02-10T07:58:07.680 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : kernel-modules-4.18.0-536.el8.x86_64 3/3 2024-02-10T07:58:07.681 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-02-10T07:58:07.681 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-02-10T07:58:07.681 INFO:teuthology.orchestra.run.smithi071.stdout: kernel-4.18.0-536.el8.x86_64 kernel-core-4.18.0-536.el8.x86_64 2024-02-10T07:58:07.681 INFO:teuthology.orchestra.run.smithi071.stdout: kernel-modules-4.18.0-536.el8.x86_64 2024-02-10T07:58:07.681 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-02-10T07:58:07.681 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-02-10T07:58:07.844 DEBUG:teuthology.orchestra.run.smithi071:> rpm -q kernel | sort -rV | head -n 1 2024-02-10T07:58:08.064 INFO:teuthology.orchestra.run.smithi071.stdout:kernel-4.18.0-536.el8.x86_64 2024-02-10T07:58:08.064 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-536.el8.x86_64 2024-02-10T07:58:08.064 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-536.el8.x86_64 2024-02-10T07:58:08.064 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-02-10T07:58:08.064 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-02-10T07:58:08.064 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-02-10T07:58:08.064 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi071.front.sepia.ceph.com, path=None, version=distro) 2024-02-10T07:58:08.064 DEBUG:teuthology.orchestra.run.smithi071:> rpm -q kernel | sort -rV | head -n 1 2024-02-10T07:58:08.274 INFO:teuthology.orchestra.run.smithi071.stdout:kernel-4.18.0-536.el8.x86_64 2024-02-10T07:58:08.275 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-536.el8.x86_64 2024-02-10T07:58:08.275 DEBUG:teuthology.orchestra.run.smithi071:> sudo rpm -qi grub2-tools 2024-02-10T07:58:08.308 INFO:teuthology.orchestra.run.smithi071.stdout:Name : grub2-tools 2024-02-10T07:58:08.308 INFO:teuthology.orchestra.run.smithi071.stdout:Epoch : 1 2024-02-10T07:58:08.308 INFO:teuthology.orchestra.run.smithi071.stdout:Version : 2.02 2024-02-10T07:58:08.308 INFO:teuthology.orchestra.run.smithi071.stdout:Release : 129.el8 2024-02-10T07:58:08.308 INFO:teuthology.orchestra.run.smithi071.stdout:Architecture: x86_64 2024-02-10T07:58:08.308 INFO:teuthology.orchestra.run.smithi071.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2024-02-10T07:58:08.308 INFO:teuthology.orchestra.run.smithi071.stdout:Group : System Environment/Base 2024-02-10T07:58:08.308 INFO:teuthology.orchestra.run.smithi071.stdout:Size : 9265586 2024-02-10T07:58:08.309 INFO:teuthology.orchestra.run.smithi071.stdout:License : GPLv3+ 2024-02-10T07:58:08.309 INFO:teuthology.orchestra.run.smithi071.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2024-02-10T07:58:08.309 INFO:teuthology.orchestra.run.smithi071.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2024-02-10T07:58:08.309 INFO:teuthology.orchestra.run.smithi071.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2024-02-10T07:58:08.309 INFO:teuthology.orchestra.run.smithi071.stdout:Build Host : kbuilder.bsys.centos.org 2024-02-10T07:58:08.309 INFO:teuthology.orchestra.run.smithi071.stdout:Relocations : (not relocatable) 2024-02-10T07:58:08.309 INFO:teuthology.orchestra.run.smithi071.stdout:Packager : CentOS BuildSystem 2024-02-10T07:58:08.309 INFO:teuthology.orchestra.run.smithi071.stdout:Vendor : CentOS 2024-02-10T07:58:08.309 INFO:teuthology.orchestra.run.smithi071.stdout:URL : http://www.gnu.org/software/grub/ 2024-02-10T07:58:08.309 INFO:teuthology.orchestra.run.smithi071.stdout:Summary : Support tools for GRUB. 2024-02-10T07:58:08.309 INFO:teuthology.orchestra.run.smithi071.stdout:Description : 2024-02-10T07:58:08.309 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-02-10T07:58:08.309 INFO:teuthology.orchestra.run.smithi071.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-02-10T07:58:08.310 INFO:teuthology.orchestra.run.smithi071.stdout:customizable bootloader with modular architecture. It supports a rich 2024-02-10T07:58:08.310 INFO:teuthology.orchestra.run.smithi071.stdout:variety of kernel formats, file systems, computer architectures and 2024-02-10T07:58:08.310 INFO:teuthology.orchestra.run.smithi071.stdout:hardware devices. 2024-02-10T07:58:08.310 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-02-10T07:58:08.310 INFO:teuthology.orchestra.run.smithi071.stdout:This subpackage provides tools for support of all platforms. 2024-02-10T07:58:08.311 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-02-10T07:58:08.311 INFO:teuthology.task.kernel:Updating grub on smithi071 to boot 4.18.0-536.el8.x86_64 2024-02-10T07:58:08.311 DEBUG:teuthology.orchestra.run.smithi071:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-02-10T07:58:09.690 INFO:teuthology.orchestra.run.smithi071.stderr:Generating grub configuration file ... 2024-02-10T07:58:11.718 INFO:teuthology.orchestra.run.smithi071.stderr:done 2024-02-10T07:58:11.720 DEBUG:teuthology.orchestra.run.smithi071:> mktemp 2024-02-10T07:58:11.751 INFO:teuthology.orchestra.run.smithi071.stdout:/tmp/tmp.wxPjfLmdUw 2024-02-10T07:58:11.751 DEBUG:teuthology.orchestra.run.smithi071:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.wxPjfLmdUw 2024-02-10T07:58:11.824 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 0666 /tmp/tmp.wxPjfLmdUw 2024-02-10T07:58:11.964 DEBUG:teuthology.orchestra.remote:smithi071:/tmp/tmp.wxPjfLmdUw is 6KB 2024-02-10T07:58:12.011 DEBUG:teuthology.orchestra.run.smithi071:> rm -fr /tmp/tmp.wxPjfLmdUw 2024-02-10T07:58:12.029 DEBUG:teuthology.orchestra.run.smithi071:> sudo /bin/ls /boot/loader/entries || true 2024-02-10T07:58:12.093 INFO:teuthology.orchestra.run.smithi071.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2024-02-10T07:58:12.093 INFO:teuthology.orchestra.run.smithi071.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2024-02-10T07:58:12.093 INFO:teuthology.orchestra.run.smithi071.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2024-02-10T07:58:12.093 INFO:teuthology.orchestra.run.smithi071.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-536.el8.x86_64.conf 2024-02-10T07:58:12.095 DEBUG:teuthology.orchestra.run.smithi071:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-536.el8.x86_64 2024-02-10T07:58:12.263 DEBUG:teuthology.orchestra.run.smithi071:> sudo shutdown -r now 2024-02-10T07:58:29.592 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-02-10T07:58:29.592 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-02-10T07:58:29.593 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T07:58:42.278 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-02-10T07:58:42.278 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-02-10T07:58:42.279 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T07:58:48.124 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.18 2024-02-10T07:58:57.132 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-02-10T07:58:57.133 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T07:59:00.672 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.71 2024-02-10T07:59:09.680 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-02-10T07:59:09.681 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T07:59:12.732 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.71 2024-02-10T07:59:24.741 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-02-10T07:59:24.742 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T07:59:43.168 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.71 2024-02-10T07:59:57.148 DEBUG:teuthology.orchestra.remote:timed out 2024-02-10T07:59:58.170 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-02-10T07:59:58.171 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T07:59:58.713 DEBUG:teuthology.orchestra.run.smithi071:> true 2024-02-10T08:00:00.139 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-02-10T08:00:00.139 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "4.18.0-536.el8.x86_64"... 2024-02-10T08:00:00.139 DEBUG:teuthology.orchestra.run.smithi071:> uname -r 2024-02-10T08:00:00.308 INFO:teuthology.orchestra.run.smithi071.stdout:4.18.0-536.el8.x86_64 2024-02-10T08:00:00.308 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-536.el8.x86_64 vs 4.18.0-536.el8.x86_64 2024-02-10T08:00:00.308 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-10T08:00:00.308 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-02-10T08:00:01.309 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-02-10T08:00:01.309 DEBUG:teuthology.orchestra.run.smithi071:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-02-10T08:00:01.375 INFO:teuthology.orchestra.run.smithi071.stdout:ttyS1 2024-02-10T08:00:01.394 DEBUG:teuthology.parallel:result is None 2024-02-10T08:00:09.149 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-02-10T08:00:09.149 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T08:00:09.534 DEBUG:teuthology.orchestra.run.smithi018:> true 2024-02-10T08:00:09.870 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-02-10T08:00:09.870 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "4.18.0-536.el8.x86_64"... 2024-02-10T08:00:09.870 DEBUG:teuthology.orchestra.run.smithi018:> uname -r 2024-02-10T08:00:09.891 INFO:teuthology.orchestra.run.smithi018.stdout:4.18.0-536.el8.x86_64 2024-02-10T08:00:09.891 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-536.el8.x86_64 vs 4.18.0-536.el8.x86_64 2024-02-10T08:00:09.891 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-10T08:00:09.891 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-02-10T08:00:10.892 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-02-10T08:00:10.892 DEBUG:teuthology.orchestra.run.smithi018:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-02-10T08:00:10.994 INFO:teuthology.orchestra.run.smithi018.stdout:ttyS1 2024-02-10T08:00:11.007 DEBUG:teuthology.parallel:result is None 2024-02-10T08:00:11.007 INFO:teuthology.run_tasks:Running task internal.base... 2024-02-10T08:00:11.020 INFO:teuthology.task.internal:Creating test directory... 2024-02-10T08:00:11.020 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-10T08:00:11.022 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-10T08:00:11.044 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-02-10T08:00:11.052 INFO:teuthology.run_tasks:Running task internal.archive... 2024-02-10T08:00:11.060 INFO:teuthology.task.internal:Creating archive directory... 2024-02-10T08:00:11.060 DEBUG:teuthology.orchestra.run.smithi018:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-10T08:00:11.084 DEBUG:teuthology.orchestra.run.smithi071:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-10T08:00:11.129 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-02-10T08:00:11.136 INFO:teuthology.task.internal:Enabling coredump saving... 2024-02-10T08:00:11.136 DEBUG:teuthology.orchestra.run.smithi018:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-10T08:00:11.155 DEBUG:teuthology.orchestra.run.smithi071:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-10T08:00:11.198 INFO:teuthology.orchestra.run.smithi018.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-10T08:00:11.205 INFO:teuthology.orchestra.run.smithi071.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-10T08:00:11.209 INFO:teuthology.orchestra.run.smithi018.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-10T08:00:11.216 INFO:teuthology.orchestra.run.smithi071.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-10T08:00:11.218 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-02-10T08:00:11.224 INFO:teuthology.task.internal:Configuring sudo... 2024-02-10T08:00:11.225 DEBUG:teuthology.orchestra.run.smithi018:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-10T08:00:11.227 DEBUG:teuthology.orchestra.run.smithi071:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-10T08:00:11.287 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-02-10T08:00:11.296 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-02-10T08:00:11.296 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-10T08:00:11.299 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-10T08:00:11.346 DEBUG:teuthology.orchestra.run.smithi018:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-10T08:00:11.403 DEBUG:teuthology.orchestra.run.smithi018:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-10T08:00:11.454 DEBUG:teuthology.orchestra.run.smithi018:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-10T08:00:11.539 DEBUG:teuthology.orchestra.run.smithi018:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-10T08:00:11.583 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-02-10T08:00:11.583 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-10T08:00:11.652 DEBUG:teuthology.orchestra.run.smithi071:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-10T08:00:11.699 DEBUG:teuthology.orchestra.run.smithi071:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-10T08:00:11.757 DEBUG:teuthology.orchestra.run.smithi071:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-10T08:00:11.842 DEBUG:teuthology.orchestra.run.smithi071:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-10T08:00:11.887 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-02-10T08:00:11.888 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-10T08:00:11.955 DEBUG:teuthology.orchestra.run.smithi018:> sudo service rsyslog restart 2024-02-10T08:00:11.958 DEBUG:teuthology.orchestra.run.smithi071:> sudo service rsyslog restart 2024-02-10T08:00:12.011 INFO:teuthology.orchestra.run.smithi018.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-10T08:00:12.055 INFO:teuthology.orchestra.run.smithi071.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-10T08:00:12.417 INFO:teuthology.run_tasks:Running task internal.timer... 2024-02-10T08:00:12.425 INFO:teuthology.task.internal:Starting timer... 2024-02-10T08:00:12.425 INFO:teuthology.run_tasks:Running task pcp... 2024-02-10T08:00:12.437 INFO:teuthology.run_tasks:Running task selinux... 2024-02-10T08:00:12.446 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-02-10T08:00:12.446 DEBUG:teuthology.orchestra.run.smithi018:> sudo service auditd rotate 2024-02-10T08:00:12.561 INFO:teuthology.orchestra.run.smithi018.stdout:Rotating logs: 2024-02-10T08:00:12.563 DEBUG:teuthology.orchestra.run.smithi071:> sudo service auditd rotate 2024-02-10T08:00:12.627 INFO:teuthology.orchestra.run.smithi071.stdout:Rotating logs: 2024-02-10T08:00:12.629 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-02-10T08:00:12.629 DEBUG:teuthology.orchestra.run.smithi018:> /usr/sbin/getenforce 2024-02-10T08:00:12.653 INFO:teuthology.orchestra.run.smithi018.stdout:Permissive 2024-02-10T08:00:12.653 DEBUG:teuthology.orchestra.run.smithi071:> /usr/sbin/getenforce 2024-02-10T08:00:12.672 INFO:teuthology.orchestra.run.smithi071.stdout:Permissive 2024-02-10T08:00:12.672 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi018.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi071.front.sepia.ceph.com': 'permissive'} 2024-02-10T08:00:12.672 DEBUG:teuthology.orchestra.run.smithi018:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-10T08:00:12.723 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-10T08:00:12.724 DEBUG:teuthology.orchestra.run.smithi071:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-10T08:00:12.751 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-10T08:00:12.751 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-02-10T08:00:12.752 DEBUG:teuthology.orchestra.run.smithi018:> sudo /usr/sbin/setenforce permissive 2024-02-10T08:00:12.794 DEBUG:teuthology.orchestra.run.smithi071:> sudo /usr/sbin/setenforce permissive 2024-02-10T08:00:12.820 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-02-10T08:00:12.832 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-02-10T08:00:12.846 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-02-10T08:00:12.847 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi018.front.sepia.ceph.com,smithi071.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-02-10T08:06:21.250 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi018.front.sepia.ceph.com'), Remote(name='ubuntu@smithi071.front.sepia.ceph.com')] 2024-02-10T08:06:21.251 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-02-10T08:06:21.253 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T08:06:21.332 DEBUG:teuthology.orchestra.run.smithi018:> true 2024-02-10T08:06:21.406 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-02-10T08:06:21.406 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-02-10T08:06:21.407 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T08:06:21.482 DEBUG:teuthology.orchestra.run.smithi071:> true 2024-02-10T08:06:21.551 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-02-10T08:06:21.552 INFO:teuthology.run_tasks:Running task clock... 2024-02-10T08:06:21.564 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-02-10T08:06:21.564 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-10T08:06:21.564 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-10T08:06:21.567 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-10T08:06:21.567 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-10T08:06:21.603 INFO:teuthology.orchestra.run.smithi018.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-02-10T08:06:21.619 INFO:teuthology.orchestra.run.smithi018.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-02-10T08:06:21.624 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-02-10T08:06:21.638 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-02-10T08:06:21.695 INFO:teuthology.orchestra.run.smithi018.stderr:sudo: ntpd: command not found 2024-02-10T08:06:21.699 INFO:teuthology.orchestra.run.smithi071.stderr:sudo: ntpd: command not found 2024-02-10T08:06:21.707 INFO:teuthology.orchestra.run.smithi018.stdout:506 Cannot talk to daemon 2024-02-10T08:06:21.710 INFO:teuthology.orchestra.run.smithi071.stdout:506 Cannot talk to daemon 2024-02-10T08:06:21.722 INFO:teuthology.orchestra.run.smithi018.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-02-10T08:06:21.724 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-02-10T08:06:21.736 INFO:teuthology.orchestra.run.smithi018.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-02-10T08:06:21.737 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-02-10T08:06:21.803 INFO:teuthology.orchestra.run.smithi018.stderr:bash: ntpq: command not found 2024-02-10T08:06:21.806 INFO:teuthology.orchestra.run.smithi018.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-10T08:06:21.807 INFO:teuthology.orchestra.run.smithi018.stdout:=============================================================================== 2024-02-10T08:06:21.807 INFO:teuthology.orchestra.run.smithi018.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-10T08:06:21.807 INFO:teuthology.orchestra.run.smithi018.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-10T08:06:21.807 INFO:teuthology.orchestra.run.smithi018.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-10T08:06:21.807 INFO:teuthology.orchestra.run.smithi018.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-10T08:06:21.813 INFO:teuthology.orchestra.run.smithi071.stderr:bash: ntpq: command not found 2024-02-10T08:06:21.816 INFO:teuthology.orchestra.run.smithi071.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-10T08:06:21.817 INFO:teuthology.orchestra.run.smithi071.stdout:=============================================================================== 2024-02-10T08:06:21.817 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-10T08:06:21.817 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-10T08:06:21.817 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-10T08:06:21.817 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-10T08:06:21.818 INFO:teuthology.run_tasks:Running task pexec... 2024-02-10T08:06:21.827 INFO:teuthology.task.pexec:Executing custom commands... 2024-02-10T08:06:21.827 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi018.front.sepia.ceph.com 2024-02-10T08:06:21.828 DEBUG:teuthology.orchestra.run.smithi018:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-02-10T08:06:21.828 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi071.front.sepia.ceph.com 2024-02-10T08:06:21.828 DEBUG:teuthology.orchestra.run.smithi071:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-02-10T08:06:22.638 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:42 ago on Sat 10 Feb 2024 08:04:40 AM UTC. 2024-02-10T08:06:22.666 INFO:teuthology.orchestra.run.smithi018.stdout:Last metadata expiration check: 0:01:30 ago on Sat 10 Feb 2024 08:04:52 AM UTC. 2024-02-10T08:06:24.616 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-02-10T08:06:24.617 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-02-10T08:06:24.617 INFO:teuthology.orchestra.run.smithi071.stdout: Package Architecture Version Repository Size 2024-02-10T08:06:24.617 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-02-10T08:06:24.617 INFO:teuthology.orchestra.run.smithi071.stdout:Resetting modules: 2024-02-10T08:06:24.617 INFO:teuthology.orchestra.run.smithi071.stdout: container-tools 2024-02-10T08:06:24.617 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-02-10T08:06:24.617 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-02-10T08:06:24.617 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-02-10T08:06:24.617 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-02-10T08:06:24.789 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-02-10T08:06:24.790 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-02-10T08:06:24.790 INFO:teuthology.orchestra.run.smithi018.stdout: Package Architecture Version Repository Size 2024-02-10T08:06:24.790 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-02-10T08:06:24.790 INFO:teuthology.orchestra.run.smithi018.stdout:Resetting modules: 2024-02-10T08:06:24.790 INFO:teuthology.orchestra.run.smithi018.stdout: container-tools 2024-02-10T08:06:24.790 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:06:24.791 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction Summary 2024-02-10T08:06:24.791 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-02-10T08:06:24.791 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:06:24.868 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-02-10T08:06:25.051 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-02-10T08:06:25.697 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:45 ago on Sat 10 Feb 2024 08:04:40 AM UTC. 2024-02-10T08:06:25.961 INFO:teuthology.orchestra.run.smithi018.stdout:Last metadata expiration check: 0:01:33 ago on Sat 10 Feb 2024 08:04:52 AM UTC. 2024-02-10T08:06:27.680 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-02-10T08:06:27.714 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-02-10T08:06:27.714 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2024-02-10T08:06:27.714 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-02-10T08:06:27.714 INFO:teuthology.orchestra.run.smithi071.stdout:Installing group/module packages: 2024-02-10T08:06:27.714 INFO:teuthology.orchestra.run.smithi071.stdout: aardvark-dns x86_64 2:1.9.0-1.module_el8+804+f131391c appstream 1.0 M 2024-02-10T08:06:27.714 INFO:teuthology.orchestra.run.smithi071.stdout: buildah x86_64 1:1.34.0-1.module_el8+804+f131391c appstream 9.7 M 2024-02-10T08:06:27.715 INFO:teuthology.orchestra.run.smithi071.stdout: cockpit-podman noarch 82-1.module_el8+804+f131391c appstream 759 k 2024-02-10T08:06:27.715 INFO:teuthology.orchestra.run.smithi071.stdout: crun x86_64 1.12-1.module_el8+804+f131391c appstream 248 k 2024-02-10T08:06:27.715 INFO:teuthology.orchestra.run.smithi071.stdout: netavark x86_64 2:1.9.0-1.module_el8+804+f131391c appstream 4.0 M 2024-02-10T08:06:27.715 INFO:teuthology.orchestra.run.smithi071.stdout: python3-podman noarch 4.8.2-1.module_el8+804+f131391c appstream 179 k 2024-02-10T08:06:27.715 INFO:teuthology.orchestra.run.smithi071.stdout: skopeo x86_64 2:1.14.0-2.module_el8+804+f131391c appstream 8.8 M 2024-02-10T08:06:27.715 INFO:teuthology.orchestra.run.smithi071.stdout: toolbox x86_64 0.0.99.4-8.module_el8+804+f131391c appstream 2.5 M 2024-02-10T08:06:27.715 INFO:teuthology.orchestra.run.smithi071.stdout: udica noarch 0.2.6-20.module_el8+804+f131391c appstream 53 k 2024-02-10T08:06:27.715 INFO:teuthology.orchestra.run.smithi071.stdout:Installing dependencies: 2024-02-10T08:06:27.715 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 appstream 25 k 2024-02-10T08:06:27.715 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyxdg noarch 0.25-16.el8 appstream 94 k 2024-02-10T08:06:27.715 INFO:teuthology.orchestra.run.smithi071.stdout: yajl x86_64 2.1.0-12.el8 appstream 41 k 2024-02-10T08:06:27.715 INFO:teuthology.orchestra.run.smithi071.stdout:Installing weak dependencies: 2024-02-10T08:06:27.715 INFO:teuthology.orchestra.run.smithi071.stdout: criu-libs x86_64 3.15-3.module_el8.7.0+1216+b022c01d appstream 38 k 2024-02-10T08:06:27.715 INFO:teuthology.orchestra.run.smithi071.stdout:Installing module profiles: 2024-02-10T08:06:27.716 INFO:teuthology.orchestra.run.smithi071.stdout: container-tools/common 2024-02-10T08:06:27.716 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-02-10T08:06:27.716 INFO:teuthology.orchestra.run.smithi071.stdout:Enabling module streams: 2024-02-10T08:06:27.716 INFO:teuthology.orchestra.run.smithi071.stdout: container-tools rhel8 2024-02-10T08:06:27.716 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-02-10T08:06:27.716 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-02-10T08:06:27.716 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-02-10T08:06:27.716 INFO:teuthology.orchestra.run.smithi071.stdout:Install 13 Packages 2024-02-10T08:06:27.716 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-02-10T08:06:27.717 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 27 M 2024-02-10T08:06:27.717 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 91 M 2024-02-10T08:06:27.717 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-02-10T08:06:28.080 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-02-10T08:06:28.118 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-02-10T08:06:28.118 INFO:teuthology.orchestra.run.smithi018.stdout: Package Arch Version Repository Size 2024-02-10T08:06:28.119 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-02-10T08:06:28.119 INFO:teuthology.orchestra.run.smithi018.stdout:Installing group/module packages: 2024-02-10T08:06:28.119 INFO:teuthology.orchestra.run.smithi018.stdout: aardvark-dns x86_64 2:1.9.0-1.module_el8+804+f131391c appstream 1.0 M 2024-02-10T08:06:28.119 INFO:teuthology.orchestra.run.smithi018.stdout: buildah x86_64 1:1.34.0-1.module_el8+804+f131391c appstream 9.7 M 2024-02-10T08:06:28.119 INFO:teuthology.orchestra.run.smithi018.stdout: cockpit-podman noarch 82-1.module_el8+804+f131391c appstream 759 k 2024-02-10T08:06:28.119 INFO:teuthology.orchestra.run.smithi018.stdout: crun x86_64 1.12-1.module_el8+804+f131391c appstream 248 k 2024-02-10T08:06:28.119 INFO:teuthology.orchestra.run.smithi018.stdout: netavark x86_64 2:1.9.0-1.module_el8+804+f131391c appstream 4.0 M 2024-02-10T08:06:28.119 INFO:teuthology.orchestra.run.smithi018.stdout: python3-podman noarch 4.8.2-1.module_el8+804+f131391c appstream 179 k 2024-02-10T08:06:28.119 INFO:teuthology.orchestra.run.smithi018.stdout: skopeo x86_64 2:1.14.0-2.module_el8+804+f131391c appstream 8.8 M 2024-02-10T08:06:28.119 INFO:teuthology.orchestra.run.smithi018.stdout: toolbox x86_64 0.0.99.4-8.module_el8+804+f131391c appstream 2.5 M 2024-02-10T08:06:28.119 INFO:teuthology.orchestra.run.smithi018.stdout: udica noarch 0.2.6-20.module_el8+804+f131391c appstream 53 k 2024-02-10T08:06:28.119 INFO:teuthology.orchestra.run.smithi018.stdout:Installing dependencies: 2024-02-10T08:06:28.119 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 appstream 25 k 2024-02-10T08:06:28.120 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyxdg noarch 0.25-16.el8 appstream 94 k 2024-02-10T08:06:28.120 INFO:teuthology.orchestra.run.smithi018.stdout: yajl x86_64 2.1.0-12.el8 appstream 41 k 2024-02-10T08:06:28.120 INFO:teuthology.orchestra.run.smithi018.stdout:Installing weak dependencies: 2024-02-10T08:06:28.120 INFO:teuthology.orchestra.run.smithi018.stdout: criu-libs x86_64 3.15-3.module_el8.7.0+1216+b022c01d appstream 38 k 2024-02-10T08:06:28.120 INFO:teuthology.orchestra.run.smithi018.stdout:Installing module profiles: 2024-02-10T08:06:28.120 INFO:teuthology.orchestra.run.smithi018.stdout: container-tools/common 2024-02-10T08:06:28.120 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:06:28.120 INFO:teuthology.orchestra.run.smithi018.stdout:Enabling module streams: 2024-02-10T08:06:28.120 INFO:teuthology.orchestra.run.smithi018.stdout: container-tools rhel8 2024-02-10T08:06:28.120 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:06:28.120 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction Summary 2024-02-10T08:06:28.120 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-02-10T08:06:28.120 INFO:teuthology.orchestra.run.smithi018.stdout:Install 13 Packages 2024-02-10T08:06:28.121 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:06:28.121 INFO:teuthology.orchestra.run.smithi018.stdout:Total download size: 27 M 2024-02-10T08:06:28.121 INFO:teuthology.orchestra.run.smithi018.stdout:Installed size: 91 M 2024-02-10T08:06:28.121 INFO:teuthology.orchestra.run.smithi018.stdout:Downloading Packages: 2024-02-10T08:06:28.490 INFO:teuthology.orchestra.run.smithi071.stdout:(1/13): cockpit-podman-82-1.module_el8+804+f131 1.3 MB/s | 759 kB 00:00 2024-02-10T08:06:28.532 INFO:teuthology.orchestra.run.smithi071.stdout:(2/13): aardvark-dns-1.9.0-1.module_el8+804+f13 1.6 MB/s | 1.0 MB 00:00 2024-02-10T08:06:28.665 INFO:teuthology.orchestra.run.smithi071.stdout:(3/13): criu-libs-3.15-3.module_el8.7.0+1216+b0 216 kB/s | 38 kB 00:00 2024-02-10T08:06:28.690 INFO:teuthology.orchestra.run.smithi071.stdout:(4/13): crun-1.12-1.module_el8+804+f131391c.x86 1.5 MB/s | 248 kB 00:00 2024-02-10T08:06:28.816 INFO:teuthology.orchestra.run.smithi071.stdout:(5/13): python3-podman-4.8.2-1.module_el8+804+f 1.4 MB/s | 179 kB 00:00 2024-02-10T08:06:28.822 INFO:teuthology.orchestra.run.smithi018.stdout:(1/13): cockpit-podman-82-1.module_el8+804+f131 1.1 MB/s | 759 kB 00:00 2024-02-10T08:06:28.942 INFO:teuthology.orchestra.run.smithi071.stdout:(6/13): python3-pytoml-0.1.14-5.git7dea353.el8. 198 kB/s | 25 kB 00:00 2024-02-10T08:06:28.946 INFO:teuthology.orchestra.run.smithi018.stdout:(2/13): criu-libs-3.15-3.module_el8.7.0+1216+b0 303 kB/s | 38 kB 00:00 2024-02-10T08:06:29.041 INFO:teuthology.orchestra.run.smithi071.stdout:(7/13): python3-pyxdg-0.25-16.el8.noarch.rpm 939 kB/s | 94 kB 00:00 2024-02-10T08:06:29.046 INFO:teuthology.orchestra.run.smithi018.stdout:(3/13): crun-1.12-1.module_el8+804+f131391c.x86 2.4 MB/s | 248 kB 00:00 2024-02-10T08:06:29.834 INFO:teuthology.orchestra.run.smithi071.stdout:(8/13): netavark-1.9.0-1.module_el8+804+f131391 3.4 MB/s | 4.0 MB 00:01 2024-02-10T08:06:29.955 INFO:teuthology.orchestra.run.smithi018.stdout:(4/13): aardvark-dns-1.9.0-1.module_el8+804+f13 575 kB/s | 1.0 MB 00:01 2024-02-10T08:06:30.142 INFO:teuthology.orchestra.run.smithi071.stdout:(9/13): buildah-1.34.0-1.module_el8+804+f131391 4.3 MB/s | 9.7 MB 00:02 2024-02-10T08:06:30.238 INFO:teuthology.orchestra.run.smithi018.stdout:(5/13): python3-podman-4.8.2-1.module_el8+804+f 634 kB/s | 179 kB 00:00 2024-02-10T08:06:30.292 INFO:teuthology.orchestra.run.smithi071.stdout:(10/13): udica-0.2.6-20.module_el8+804+f131391c 351 kB/s | 53 kB 00:00 2024-02-10T08:06:30.409 INFO:teuthology.orchestra.run.smithi071.stdout:(11/13): toolbox-0.0.99.4-8.module_el8+804+f131 4.4 MB/s | 2.5 MB 00:00 2024-02-10T08:06:30.431 INFO:teuthology.orchestra.run.smithi018.stdout:(6/13): netavark-1.9.0-1.module_el8+804+f131391 2.9 MB/s | 4.0 MB 00:01 2024-02-10T08:06:30.434 INFO:teuthology.orchestra.run.smithi071.stdout:(12/13): yajl-2.1.0-12.el8.x86_64.rpm 289 kB/s | 41 kB 00:00 2024-02-10T08:06:30.455 INFO:teuthology.orchestra.run.smithi018.stdout:(7/13): python3-pytoml-0.1.14-5.git7dea353.el8. 114 kB/s | 25 kB 00:00 2024-02-10T08:06:30.523 INFO:teuthology.orchestra.run.smithi018.stdout:(8/13): python3-pyxdg-0.25-16.el8.noarch.rpm 1.0 MB/s | 94 kB 00:00 2024-02-10T08:06:30.973 INFO:teuthology.orchestra.run.smithi018.stdout:(9/13): toolbox-0.0.99.4-8.module_el8+804+f1313 5.6 MB/s | 2.5 MB 00:00 2024-02-10T08:06:31.065 INFO:teuthology.orchestra.run.smithi018.stdout:(10/13): udica-0.2.6-20.module_el8+804+f131391c 572 kB/s | 53 kB 00:00 2024-02-10T08:06:31.173 INFO:teuthology.orchestra.run.smithi018.stdout:(11/13): yajl-2.1.0-12.el8.x86_64.rpm 377 kB/s | 41 kB 00:00 2024-02-10T08:06:31.635 INFO:teuthology.orchestra.run.smithi071.stdout:(13/13): skopeo-1.14.0-2.module_el8+804+f131391 3.4 MB/s | 8.8 MB 00:02 2024-02-10T08:06:31.635 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-02-10T08:06:31.635 INFO:teuthology.orchestra.run.smithi071.stdout:Total 7.0 MB/s | 27 MB 00:03 2024-02-10T08:06:31.905 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-02-10T08:06:31.926 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-02-10T08:06:31.926 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-02-10T08:06:32.188 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-02-10T08:06:32.191 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-02-10T08:06:32.858 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-02-10T08:06:33.074 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : yajl-2.1.0-12.el8.x86_64 1/13 2024-02-10T08:06:33.270 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 2/13 2024-02-10T08:06:33.463 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/13 2024-02-10T08:06:33.680 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 4/13 2024-02-10T08:06:34.211 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : aardvark-dns-2:1.9.0-1.module_el8+804+f131391c.x86 5/13 2024-02-10T08:06:35.251 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : netavark-2:1.9.0-1.module_el8+804+f131391c.x86_64 6/13 2024-02-10T08:06:35.306 INFO:teuthology.orchestra.run.smithi018.stdout:(12/13): buildah-1.34.0-1.module_el8+804+f13139 1.4 MB/s | 9.7 MB 00:07 2024-02-10T08:06:35.407 INFO:teuthology.orchestra.run.smithi018.stdout:(13/13): skopeo-1.14.0-2.module_el8+804+f131391 1.8 MB/s | 8.8 MB 00:04 2024-02-10T08:06:35.407 INFO:teuthology.orchestra.run.smithi018.stdout:-------------------------------------------------------------------------------- 2024-02-10T08:06:35.407 INFO:teuthology.orchestra.run.smithi018.stdout:Total 3.8 MB/s | 27 MB 00:07 2024-02-10T08:06:35.484 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : buildah-1:1.34.0-1.module_el8+804+f131391c.x86_64 7/13 2024-02-10T08:06:35.680 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : crun-1.12-1.module_el8+804+f131391c.x86_64 8/13 2024-02-10T08:06:35.689 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction check 2024-02-10T08:06:35.712 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction check succeeded. 2024-02-10T08:06:35.712 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction test 2024-02-10T08:06:35.915 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-podman-4.8.2-1.module_el8+804+f131391c.noa 9/13 2024-02-10T08:06:35.990 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction test succeeded. 2024-02-10T08:06:35.993 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction 2024-02-10T08:06:36.340 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : udica-0.2.6-20.module_el8+804+f131391c.noarch 10/13 2024-02-10T08:06:36.722 INFO:teuthology.orchestra.run.smithi018.stdout: Preparing : 1/1 2024-02-10T08:06:36.952 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : yajl-2.1.0-12.el8.x86_64 1/13 2024-02-10T08:06:37.105 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 2/13 2024-02-10T08:06:37.255 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : toolbox-0.0.99.4-8.module_el8+804+f131391c.x86_64 11/13 2024-02-10T08:06:37.302 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/13 2024-02-10T08:06:37.483 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : skopeo-2:1.14.0-2.module_el8+804+f131391c.x86_64 12/13 2024-02-10T08:06:37.539 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 4/13 2024-02-10T08:06:37.660 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : cockpit-podman-82-1.module_el8+804+f131391c.noarch 13/13 2024-02-10T08:06:38.075 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: cockpit-podman-82-1.module_el8+804+f131391c.noarch 13/13 2024-02-10T08:06:38.075 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : aardvark-dns-2:1.9.0-1.module_el8+804+f131391c.x86 1/13 2024-02-10T08:06:38.075 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : buildah-1:1.34.0-1.module_el8+804+f131391c.x86_64 2/13 2024-02-10T08:06:38.075 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : cockpit-podman-82-1.module_el8+804+f131391c.noarch 3/13 2024-02-10T08:06:38.076 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 4/13 2024-02-10T08:06:38.076 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : crun-1.12-1.module_el8+804+f131391c.x86_64 5/13 2024-02-10T08:06:38.076 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : netavark-2:1.9.0-1.module_el8+804+f131391c.x86_64 6/13 2024-02-10T08:06:38.076 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-podman-4.8.2-1.module_el8+804+f131391c.noa 7/13 2024-02-10T08:06:38.076 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 8/13 2024-02-10T08:06:38.076 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 9/13 2024-02-10T08:06:38.076 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : skopeo-2:1.14.0-2.module_el8+804+f131391c.x86_64 10/13 2024-02-10T08:06:38.076 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : toolbox-0.0.99.4-8.module_el8+804+f131391c.x86_64 11/13 2024-02-10T08:06:38.076 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : udica-0.2.6-20.module_el8+804+f131391c.noarch 12/13 2024-02-10T08:06:38.111 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : aardvark-dns-2:1.9.0-1.module_el8+804+f131391c.x86 5/13 2024-02-10T08:06:38.599 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 13/13 2024-02-10T08:06:38.599 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-02-10T08:06:38.600 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-02-10T08:06:38.600 INFO:teuthology.orchestra.run.smithi071.stdout: aardvark-dns-2:1.9.0-1.module_el8+804+f131391c.x86_64 2024-02-10T08:06:38.600 INFO:teuthology.orchestra.run.smithi071.stdout: buildah-1:1.34.0-1.module_el8+804+f131391c.x86_64 2024-02-10T08:06:38.600 INFO:teuthology.orchestra.run.smithi071.stdout: cockpit-podman-82-1.module_el8+804+f131391c.noarch 2024-02-10T08:06:38.600 INFO:teuthology.orchestra.run.smithi071.stdout: criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_64 2024-02-10T08:06:38.600 INFO:teuthology.orchestra.run.smithi071.stdout: crun-1.12-1.module_el8+804+f131391c.x86_64 2024-02-10T08:06:38.600 INFO:teuthology.orchestra.run.smithi071.stdout: netavark-2:1.9.0-1.module_el8+804+f131391c.x86_64 2024-02-10T08:06:38.600 INFO:teuthology.orchestra.run.smithi071.stdout: python3-podman-4.8.2-1.module_el8+804+f131391c.noarch 2024-02-10T08:06:38.600 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2024-02-10T08:06:38.600 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyxdg-0.25-16.el8.noarch 2024-02-10T08:06:38.600 INFO:teuthology.orchestra.run.smithi071.stdout: skopeo-2:1.14.0-2.module_el8+804+f131391c.x86_64 2024-02-10T08:06:38.600 INFO:teuthology.orchestra.run.smithi071.stdout: toolbox-0.0.99.4-8.module_el8+804+f131391c.x86_64 2024-02-10T08:06:38.600 INFO:teuthology.orchestra.run.smithi071.stdout: udica-0.2.6-20.module_el8+804+f131391c.noarch 2024-02-10T08:06:38.601 INFO:teuthology.orchestra.run.smithi071.stdout: yajl-2.1.0-12.el8.x86_64 2024-02-10T08:06:38.601 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-02-10T08:06:38.601 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-02-10T08:06:38.895 DEBUG:teuthology.parallel:result is None 2024-02-10T08:06:39.196 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : netavark-2:1.9.0-1.module_el8+804+f131391c.x86_64 6/13 2024-02-10T08:06:39.412 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : buildah-1:1.34.0-1.module_el8+804+f131391c.x86_64 7/13 2024-02-10T08:06:39.653 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : crun-1.12-1.module_el8+804+f131391c.x86_64 8/13 2024-02-10T08:06:39.909 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-podman-4.8.2-1.module_el8+804+f131391c.noa 9/13 2024-02-10T08:06:40.340 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : udica-0.2.6-20.module_el8+804+f131391c.noarch 10/13 2024-02-10T08:06:41.631 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : toolbox-0.0.99.4-8.module_el8+804+f131391c.x86_64 11/13 2024-02-10T08:06:41.864 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : skopeo-2:1.14.0-2.module_el8+804+f131391c.x86_64 12/13 2024-02-10T08:06:42.036 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : cockpit-podman-82-1.module_el8+804+f131391c.noarch 13/13 2024-02-10T08:06:42.480 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: cockpit-podman-82-1.module_el8+804+f131391c.noarch 13/13 2024-02-10T08:06:42.480 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : aardvark-dns-2:1.9.0-1.module_el8+804+f131391c.x86 1/13 2024-02-10T08:06:42.480 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : buildah-1:1.34.0-1.module_el8+804+f131391c.x86_64 2/13 2024-02-10T08:06:42.480 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : cockpit-podman-82-1.module_el8+804+f131391c.noarch 3/13 2024-02-10T08:06:42.480 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 4/13 2024-02-10T08:06:42.480 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : crun-1.12-1.module_el8+804+f131391c.x86_64 5/13 2024-02-10T08:06:42.480 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : netavark-2:1.9.0-1.module_el8+804+f131391c.x86_64 6/13 2024-02-10T08:06:42.480 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-podman-4.8.2-1.module_el8+804+f131391c.noa 7/13 2024-02-10T08:06:42.480 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 8/13 2024-02-10T08:06:42.480 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 9/13 2024-02-10T08:06:42.480 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : skopeo-2:1.14.0-2.module_el8+804+f131391c.x86_64 10/13 2024-02-10T08:06:42.481 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : toolbox-0.0.99.4-8.module_el8+804+f131391c.x86_64 11/13 2024-02-10T08:06:42.481 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : udica-0.2.6-20.module_el8+804+f131391c.noarch 12/13 2024-02-10T08:06:43.074 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 13/13 2024-02-10T08:06:43.074 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:06:43.074 INFO:teuthology.orchestra.run.smithi018.stdout:Installed: 2024-02-10T08:06:43.074 INFO:teuthology.orchestra.run.smithi018.stdout: aardvark-dns-2:1.9.0-1.module_el8+804+f131391c.x86_64 2024-02-10T08:06:43.074 INFO:teuthology.orchestra.run.smithi018.stdout: buildah-1:1.34.0-1.module_el8+804+f131391c.x86_64 2024-02-10T08:06:43.074 INFO:teuthology.orchestra.run.smithi018.stdout: cockpit-podman-82-1.module_el8+804+f131391c.noarch 2024-02-10T08:06:43.074 INFO:teuthology.orchestra.run.smithi018.stdout: criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_64 2024-02-10T08:06:43.074 INFO:teuthology.orchestra.run.smithi018.stdout: crun-1.12-1.module_el8+804+f131391c.x86_64 2024-02-10T08:06:43.074 INFO:teuthology.orchestra.run.smithi018.stdout: netavark-2:1.9.0-1.module_el8+804+f131391c.x86_64 2024-02-10T08:06:43.074 INFO:teuthology.orchestra.run.smithi018.stdout: python3-podman-4.8.2-1.module_el8+804+f131391c.noarch 2024-02-10T08:06:43.074 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2024-02-10T08:06:43.074 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyxdg-0.25-16.el8.noarch 2024-02-10T08:06:43.075 INFO:teuthology.orchestra.run.smithi018.stdout: skopeo-2:1.14.0-2.module_el8+804+f131391c.x86_64 2024-02-10T08:06:43.075 INFO:teuthology.orchestra.run.smithi018.stdout: toolbox-0.0.99.4-8.module_el8+804+f131391c.x86_64 2024-02-10T08:06:43.075 INFO:teuthology.orchestra.run.smithi018.stdout: udica-0.2.6-20.module_el8+804+f131391c.noarch 2024-02-10T08:06:43.075 INFO:teuthology.orchestra.run.smithi018.stdout: yajl-2.1.0-12.el8.x86_64 2024-02-10T08:06:43.075 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:06:43.075 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-02-10T08:06:43.341 DEBUG:teuthology.parallel:result is None 2024-02-10T08:06:43.341 INFO:teuthology.run_tasks:Running task install... 2024-02-10T08:06:43.350 DEBUG:teuthology.task.install:project ceph 2024-02-10T08:06:43.350 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '0e714d9a4bd2a821113e6318adb87bd06cf81ec1'}} 2024-02-10T08:06:43.350 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '0e714d9a4bd2a821113e6318adb87bd06cf81ec1'} 2024-02-10T08:06:43.351 INFO:teuthology.task.install:Using flavor: default 2024-02-10T08:06:43.356 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-02-10T08:06:43.356 INFO:teuthology.task.install:extra packages: [] 2024-02-10T08:06:43.356 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '0e714d9a4bd2a821113e6318adb87bd06cf81ec1', 'tag': None, 'wait_for_package': False} 2024-02-10T08:06:43.357 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-10T08:06:43.359 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '0e714d9a4bd2a821113e6318adb87bd06cf81ec1', 'tag': None, 'wait_for_package': False} 2024-02-10T08:06:43.359 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-10T08:06:43.517 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/centos/8/flavors/default/ 2024-02-10T08:06:43.517 INFO:teuthology.task.install.rpm:Package version is 16.2.14-521.g0e714d9a 2024-02-10T08:06:43.538 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/centos/8/flavors/default/ 2024-02-10T08:06:43.538 INFO:teuthology.task.install.rpm:Package version is 16.2.14-521.g0e714d9a 2024-02-10T08:06:43.684 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-02-10T08:06:43.684 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-02-10T08:06:43.684 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-02-10T08:06:43.687 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-02-10T08:06:43.687 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-02-10T08:06:43.687 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-02-10T08:06:43.716 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-02-10T08:06:43.716 DEBUG:teuthology.orchestra.run.smithi018:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-02-10T08:06:43.721 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-02-10T08:06:43.721 DEBUG:teuthology.orchestra.run.smithi071:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-02-10T08:06:43.786 DEBUG:teuthology.orchestra.run.smithi018:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-02-10T08:06:43.791 DEBUG:teuthology.orchestra.run.smithi071:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-02-10T08:06:43.864 DEBUG:teuthology.orchestra.run.smithi018:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-02-10T08:06:43.873 DEBUG:teuthology.orchestra.run.smithi071:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-02-10T08:06:43.931 INFO:teuthology.orchestra.run.smithi018.stdout:check_obsoletes = 1 2024-02-10T08:06:43.933 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum clean all 2024-02-10T08:06:43.942 INFO:teuthology.orchestra.run.smithi071.stdout:check_obsoletes = 1 2024-02-10T08:06:43.944 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum clean all 2024-02-10T08:06:44.212 INFO:teuthology.orchestra.run.smithi071.stdout:76 files removed 2024-02-10T08:06:44.217 INFO:teuthology.orchestra.run.smithi018.stdout:76 files removed 2024-02-10T08:06:44.239 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-radosgw 2024-02-10T08:06:44.246 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install ceph-radosgw 2024-02-10T08:06:44.950 INFO:teuthology.orchestra.run.smithi071.stdout:ceph packages for x86_64 246 kB/s | 76 kB 00:00 2024-02-10T08:06:44.965 INFO:teuthology.orchestra.run.smithi018.stdout:ceph packages for x86_64 263 kB/s | 76 kB 00:00 2024-02-10T08:06:45.235 INFO:teuthology.orchestra.run.smithi071.stdout:ceph noarch packages 62 kB/s | 15 kB 00:00 2024-02-10T08:06:45.266 INFO:teuthology.orchestra.run.smithi018.stdout:ceph noarch packages 59 kB/s | 15 kB 00:00 2024-02-10T08:06:45.535 INFO:teuthology.orchestra.run.smithi071.stdout:ceph source packages 5.3 kB/s | 1.4 kB 00:00 2024-02-10T08:06:45.579 INFO:teuthology.orchestra.run.smithi018.stdout:ceph source packages 5.1 kB/s | 1.4 kB 00:00 2024-02-10T08:06:51.724 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 8 - AppStream 4.4 MB/s | 27 MB 00:06 2024-02-10T08:06:52.418 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 8 - AppStream 3.9 MB/s | 27 MB 00:06 2024-02-10T08:06:59.650 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 8 - BaseOS 3.6 MB/s | 10 MB 00:02 2024-02-10T08:07:00.059 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 8 - BaseOS 3.6 MB/s | 10 MB 00:02 2024-02-10T08:07:01.566 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 8 - Extras 115 kB/s | 18 kB 00:00 2024-02-10T08:07:01.809 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 8 - Extras 112 kB/s | 18 kB 00:00 2024-02-10T08:07:01.892 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 8 - Extras common packages 33 kB/s | 6.9 kB 00:00 2024-02-10T08:07:02.268 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 8 - Extras common packages 20 kB/s | 6.9 kB 00:00 2024-02-10T08:07:03.801 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 8 - PowerTools 2.6 MB/s | 4.8 MB 00:01 2024-02-10T08:07:04.636 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 8 - PowerTools 2.1 MB/s | 4.8 MB 00:02 2024-02-10T08:07:04.903 INFO:teuthology.orchestra.run.smithi018.stdout:Copr repo for python3-asyncssh owned by ceph 22 kB/s | 3.5 kB 00:00 2024-02-10T08:07:05.671 INFO:teuthology.orchestra.run.smithi071.stdout:Copr repo for python3-asyncssh owned by ceph 24 kB/s | 3.5 kB 00:00 2024-02-10T08:07:05.829 INFO:teuthology.orchestra.run.smithi018.stdout:Extra Packages for Enterprise Linux 20 MB/s | 16 MB 00:00 2024-02-10T08:07:06.663 INFO:teuthology.orchestra.run.smithi071.stdout:Extra Packages for Enterprise Linux 18 MB/s | 16 MB 00:00 2024-02-10T08:07:09.803 INFO:teuthology.orchestra.run.smithi018.stdout:lab-extras 547 kB/s | 24 kB 00:00 2024-02-10T08:07:10.405 INFO:teuthology.orchestra.run.smithi071.stdout:lab-extras 362 kB/s | 24 kB 00:00 2024-02-10T08:07:13.752 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-02-10T08:07:13.755 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-02-10T08:07:13.755 INFO:teuthology.orchestra.run.smithi018.stdout: Package Arch Version Repository Size 2024-02-10T08:07:13.755 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-02-10T08:07:13.755 INFO:teuthology.orchestra.run.smithi018.stdout:Installing: 2024-02-10T08:07:13.756 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-radosgw x86_64 2:16.2.14-521.g0e714d9a.el8 ceph 12 M 2024-02-10T08:07:13.756 INFO:teuthology.orchestra.run.smithi018.stdout:Upgrading: 2024-02-10T08:07:13.756 INFO:teuthology.orchestra.run.smithi018.stdout: librados2 x86_64 2:16.2.14-521.g0e714d9a.el8 ceph 3.7 M 2024-02-10T08:07:13.756 INFO:teuthology.orchestra.run.smithi018.stdout: librbd1 x86_64 2:16.2.14-521.g0e714d9a.el8 ceph 4.2 M 2024-02-10T08:07:13.756 INFO:teuthology.orchestra.run.smithi018.stdout:Installing dependencies: 2024-02-10T08:07:13.756 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-base x86_64 2:16.2.14-521.g0e714d9a.el8 ceph 6.1 M 2024-02-10T08:07:13.756 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-common x86_64 2:16.2.14-521.g0e714d9a.el8 ceph 24 M 2024-02-10T08:07:13.756 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-selinux x86_64 2:16.2.14-521.g0e714d9a.el8 ceph 26 k 2024-02-10T08:07:13.756 INFO:teuthology.orchestra.run.smithi018.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-02-10T08:07:13.756 INFO:teuthology.orchestra.run.smithi018.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2024-02-10T08:07:13.756 INFO:teuthology.orchestra.run.smithi018.stdout: libcephfs2 x86_64 2:16.2.14-521.g0e714d9a.el8 ceph 825 k 2024-02-10T08:07:13.756 INFO:teuthology.orchestra.run.smithi018.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-02-10T08:07:13.756 INFO:teuthology.orchestra.run.smithi018.stdout: librabbitmq x86_64 0.9.0-5.el8 baseos 47 k 2024-02-10T08:07:13.757 INFO:teuthology.orchestra.run.smithi018.stdout: libradosstriper1 x86_64 2:16.2.14-521.g0e714d9a.el8 ceph 494 k 2024-02-10T08:07:13.757 INFO:teuthology.orchestra.run.smithi018.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2024-02-10T08:07:13.757 INFO:teuthology.orchestra.run.smithi018.stdout: librgw2 x86_64 2:16.2.14-521.g0e714d9a.el8 ceph 3.8 M 2024-02-10T08:07:13.757 INFO:teuthology.orchestra.run.smithi018.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-02-10T08:07:13.757 INFO:teuthology.orchestra.run.smithi018.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2024-02-10T08:07:13.757 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ceph-argparse x86_64 2:16.2.14-521.g0e714d9a.el8 ceph 45 k 2024-02-10T08:07:13.757 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ceph-common x86_64 2:16.2.14-521.g0e714d9a.el8 ceph 99 k 2024-02-10T08:07:13.757 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cephfs x86_64 2:16.2.14-521.g0e714d9a.el8 ceph 215 k 2024-02-10T08:07:13.757 INFO:teuthology.orchestra.run.smithi018.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2024-02-10T08:07:13.757 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rados x86_64 2:16.2.14-521.g0e714d9a.el8 ceph 389 k 2024-02-10T08:07:13.757 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rbd x86_64 2:16.2.14-521.g0e714d9a.el8 ceph 369 k 2024-02-10T08:07:13.758 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rgw x86_64 2:16.2.14-521.g0e714d9a.el8 ceph 114 k 2024-02-10T08:07:13.758 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:07:13.758 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction Summary 2024-02-10T08:07:13.758 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-02-10T08:07:13.758 INFO:teuthology.orchestra.run.smithi018.stdout:Install 21 Packages 2024-02-10T08:07:13.758 INFO:teuthology.orchestra.run.smithi018.stdout:Upgrade 2 Packages 2024-02-10T08:07:13.758 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:07:13.758 INFO:teuthology.orchestra.run.smithi018.stdout:Total download size: 58 M 2024-02-10T08:07:13.758 INFO:teuthology.orchestra.run.smithi018.stdout:Downloading Packages: 2024-02-10T08:07:13.908 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-02-10T08:07:13.910 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-02-10T08:07:13.910 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2024-02-10T08:07:13.911 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-02-10T08:07:13.911 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-02-10T08:07:13.911 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-radosgw x86_64 2:16.2.14-521.g0e714d9a.el8 ceph 12 M 2024-02-10T08:07:13.911 INFO:teuthology.orchestra.run.smithi071.stdout:Upgrading: 2024-02-10T08:07:13.911 INFO:teuthology.orchestra.run.smithi071.stdout: librados2 x86_64 2:16.2.14-521.g0e714d9a.el8 ceph 3.7 M 2024-02-10T08:07:13.911 INFO:teuthology.orchestra.run.smithi071.stdout: librbd1 x86_64 2:16.2.14-521.g0e714d9a.el8 ceph 4.2 M 2024-02-10T08:07:13.911 INFO:teuthology.orchestra.run.smithi071.stdout:Installing dependencies: 2024-02-10T08:07:13.911 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-base x86_64 2:16.2.14-521.g0e714d9a.el8 ceph 6.1 M 2024-02-10T08:07:13.911 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-common x86_64 2:16.2.14-521.g0e714d9a.el8 ceph 24 M 2024-02-10T08:07:13.911 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-selinux x86_64 2:16.2.14-521.g0e714d9a.el8 ceph 26 k 2024-02-10T08:07:13.911 INFO:teuthology.orchestra.run.smithi071.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-02-10T08:07:13.911 INFO:teuthology.orchestra.run.smithi071.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2024-02-10T08:07:13.911 INFO:teuthology.orchestra.run.smithi071.stdout: libcephfs2 x86_64 2:16.2.14-521.g0e714d9a.el8 ceph 825 k 2024-02-10T08:07:13.911 INFO:teuthology.orchestra.run.smithi071.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-02-10T08:07:13.912 INFO:teuthology.orchestra.run.smithi071.stdout: librabbitmq x86_64 0.9.0-5.el8 baseos 47 k 2024-02-10T08:07:13.912 INFO:teuthology.orchestra.run.smithi071.stdout: libradosstriper1 x86_64 2:16.2.14-521.g0e714d9a.el8 ceph 494 k 2024-02-10T08:07:13.912 INFO:teuthology.orchestra.run.smithi071.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2024-02-10T08:07:13.912 INFO:teuthology.orchestra.run.smithi071.stdout: librgw2 x86_64 2:16.2.14-521.g0e714d9a.el8 ceph 3.8 M 2024-02-10T08:07:13.912 INFO:teuthology.orchestra.run.smithi071.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-02-10T08:07:13.912 INFO:teuthology.orchestra.run.smithi071.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2024-02-10T08:07:13.912 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ceph-argparse x86_64 2:16.2.14-521.g0e714d9a.el8 ceph 45 k 2024-02-10T08:07:13.912 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ceph-common x86_64 2:16.2.14-521.g0e714d9a.el8 ceph 99 k 2024-02-10T08:07:13.912 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cephfs x86_64 2:16.2.14-521.g0e714d9a.el8 ceph 215 k 2024-02-10T08:07:13.912 INFO:teuthology.orchestra.run.smithi071.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2024-02-10T08:07:13.912 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rados x86_64 2:16.2.14-521.g0e714d9a.el8 ceph 389 k 2024-02-10T08:07:13.912 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rbd x86_64 2:16.2.14-521.g0e714d9a.el8 ceph 369 k 2024-02-10T08:07:13.912 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rgw x86_64 2:16.2.14-521.g0e714d9a.el8 ceph 114 k 2024-02-10T08:07:13.912 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-02-10T08:07:13.913 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-02-10T08:07:13.913 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-02-10T08:07:13.913 INFO:teuthology.orchestra.run.smithi071.stdout:Install 21 Packages 2024-02-10T08:07:13.913 INFO:teuthology.orchestra.run.smithi071.stdout:Upgrade 2 Packages 2024-02-10T08:07:13.913 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-02-10T08:07:13.913 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 58 M 2024-02-10T08:07:13.913 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-02-10T08:07:15.381 INFO:teuthology.orchestra.run.smithi071.stdout:(1/23): ceph-base-16.2.14-521.g0e714d9a.el8.x86 4.5 MB/s | 6.1 MB 00:01 2024-02-10T08:07:15.465 INFO:teuthology.orchestra.run.smithi071.stdout:(2/23): ceph-selinux-16.2.14-521.g0e714d9a.el8. 308 kB/s | 26 kB 00:00 2024-02-10T08:07:15.723 INFO:teuthology.orchestra.run.smithi071.stdout:(3/23): libcephfs2-16.2.14-521.g0e714d9a.el8.x8 3.1 MB/s | 825 kB 00:00 2024-02-10T08:07:15.930 INFO:teuthology.orchestra.run.smithi071.stdout:(4/23): libradosstriper1-16.2.14-521.g0e714d9a. 2.3 MB/s | 494 kB 00:00 2024-02-10T08:07:15.947 INFO:teuthology.orchestra.run.smithi018.stdout:(1/23): ceph-base-16.2.14-521.g0e714d9a.el8.x86 3.2 MB/s | 6.1 MB 00:01 2024-02-10T08:07:16.047 INFO:teuthology.orchestra.run.smithi018.stdout:(2/23): ceph-selinux-16.2.14-521.g0e714d9a.el8. 257 kB/s | 26 kB 00:00 2024-02-10T08:07:16.322 INFO:teuthology.orchestra.run.smithi018.stdout:(3/23): libcephfs2-16.2.14-521.g0e714d9a.el8.x8 2.9 MB/s | 825 kB 00:00 2024-02-10T08:07:16.514 INFO:teuthology.orchestra.run.smithi018.stdout:(4/23): libradosstriper1-16.2.14-521.g0e714d9a. 2.5 MB/s | 494 kB 00:00 2024-02-10T08:07:16.807 INFO:teuthology.orchestra.run.smithi071.stdout:(5/23): librgw2-16.2.14-521.g0e714d9a.el8.x86_6 4.3 MB/s | 3.8 MB 00:00 2024-02-10T08:07:16.891 INFO:teuthology.orchestra.run.smithi071.stdout:(6/23): python3-ceph-argparse-16.2.14-521.g0e71 540 kB/s | 45 kB 00:00 2024-02-10T08:07:17.008 INFO:teuthology.orchestra.run.smithi071.stdout:(7/23): ceph-radosgw-16.2.14-521.g0e714d9a.el8. 3.9 MB/s | 12 MB 00:02 2024-02-10T08:07:17.033 INFO:teuthology.orchestra.run.smithi071.stdout:(8/23): python3-ceph-common-16.2.14-521.g0e714d 696 kB/s | 99 kB 00:00 2024-02-10T08:07:17.047 INFO:teuthology.orchestra.run.smithi018.stdout:(5/23): ceph-radosgw-16.2.14-521.g0e714d9a.el8. 3.8 MB/s | 12 MB 00:03 2024-02-10T08:07:17.075 INFO:teuthology.orchestra.run.smithi071.stdout:(9/23): python3-cephfs-16.2.14-521.g0e714d9a.el 3.2 MB/s | 215 kB 00:00 2024-02-10T08:07:17.140 INFO:teuthology.orchestra.run.smithi018.stdout:(6/23): python3-ceph-argparse-16.2.14-521.g0e71 491 kB/s | 45 kB 00:00 2024-02-10T08:07:17.159 INFO:teuthology.orchestra.run.smithi071.stdout:(10/23): python3-rados-16.2.14-521.g0e714d9a.el 3.0 MB/s | 389 kB 00:00 2024-02-10T08:07:17.209 INFO:teuthology.orchestra.run.smithi071.stdout:(11/23): python3-rbd-16.2.14-521.g0e714d9a.el8. 2.7 MB/s | 369 kB 00:00 2024-02-10T08:07:17.234 INFO:teuthology.orchestra.run.smithi071.stdout:(12/23): python3-rgw-16.2.14-521.g0e714d9a.el8. 1.5 MB/s | 114 kB 00:00 2024-02-10T08:07:17.390 INFO:teuthology.orchestra.run.smithi018.stdout:(7/23): ceph-common-16.2.14-521.g0e714d9a.el8.x 7.2 MB/s | 24 MB 00:03 2024-02-10T08:07:17.415 INFO:teuthology.orchestra.run.smithi018.stdout:(8/23): python3-ceph-common-16.2.14-521.g0e714d 359 kB/s | 99 kB 00:00 2024-02-10T08:07:17.440 INFO:teuthology.orchestra.run.smithi018.stdout:(9/23): python3-cephfs-16.2.14-521.g0e714d9a.el 4.2 MB/s | 215 kB 00:00 2024-02-10T08:07:17.507 INFO:teuthology.orchestra.run.smithi018.stdout:(10/23): librgw2-16.2.14-521.g0e714d9a.el8.x86_ 3.8 MB/s | 3.8 MB 00:00 2024-02-10T08:07:17.574 INFO:teuthology.orchestra.run.smithi018.stdout:(11/23): python3-rbd-16.2.14-521.g0e714d9a.el8. 2.7 MB/s | 369 kB 00:00 2024-02-10T08:07:17.600 INFO:teuthology.orchestra.run.smithi018.stdout:(12/23): python3-rados-16.2.14-521.g0e714d9a.el 2.1 MB/s | 389 kB 00:00 2024-02-10T08:07:17.617 INFO:teuthology.orchestra.run.smithi018.stdout:(13/23): python3-rgw-16.2.14-521.g0e714d9a.el8. 1.0 MB/s | 114 kB 00:00 2024-02-10T08:07:17.942 INFO:teuthology.orchestra.run.smithi018.stdout:(14/23): python3-prettytable-0.7.2-14.el8.noarc 135 kB/s | 44 kB 00:00 2024-02-10T08:07:18.026 INFO:teuthology.orchestra.run.smithi018.stdout:(15/23): librabbitmq-0.9.0-5.el8.x86_64.rpm 565 kB/s | 47 kB 00:00 2024-02-10T08:07:18.051 INFO:teuthology.orchestra.run.smithi018.stdout:(16/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 576 kB/s | 259 kB 00:00 2024-02-10T08:07:18.059 INFO:teuthology.orchestra.run.smithi071.stdout:(13/23): ceph-common-16.2.14-521.g0e714d9a.el8. 6.0 MB/s | 24 MB 00:04 2024-02-10T08:07:18.085 INFO:teuthology.orchestra.run.smithi071.stdout:(14/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 305 kB/s | 259 kB 00:00 2024-02-10T08:07:18.152 INFO:teuthology.orchestra.run.smithi071.stdout:(15/23): librabbitmq-0.9.0-5.el8.x86_64.rpm 707 kB/s | 47 kB 00:00 2024-02-10T08:07:18.177 INFO:teuthology.orchestra.run.smithi018.stdout:(17/23): gperftools-libs-2.7-9.el8.x86_64.rpm 2.0 MB/s | 306 kB 00:00 2024-02-10T08:07:18.202 INFO:teuthology.orchestra.run.smithi071.stdout:(16/23): librdkafka-1.6.1-1.el8.x86_64.rpm 682 kB/s | 677 kB 00:00 2024-02-10T08:07:18.202 INFO:teuthology.orchestra.run.smithi018.stdout:(18/23): leveldb-1.22-1.el8.x86_64.rpm 1.2 MB/s | 181 kB 00:00 2024-02-10T08:07:18.227 INFO:teuthology.orchestra.run.smithi018.stdout:(19/23): librdkafka-1.6.1-1.el8.x86_64.rpm 1.0 MB/s | 677 kB 00:00 2024-02-10T08:07:18.252 INFO:teuthology.orchestra.run.smithi018.stdout:(20/23): liboath-2.6.2-3.el8.x86_64.rpm 780 kB/s | 59 kB 00:00 2024-02-10T08:07:18.294 INFO:teuthology.orchestra.run.smithi018.stdout:(21/23): libunwind-1.3.1-3.el8.x86_64.rpm 815 kB/s | 75 kB 00:00 2024-02-10T08:07:18.377 INFO:teuthology.orchestra.run.smithi071.stdout:(17/23): python3-prettytable-0.7.2-14.el8.noarc 138 kB/s | 44 kB 00:00 2024-02-10T08:07:18.427 INFO:teuthology.orchestra.run.smithi071.stdout:(18/23): gperftools-libs-2.7-9.el8.x86_64.rpm 1.1 MB/s | 306 kB 00:00 2024-02-10T08:07:18.453 INFO:teuthology.orchestra.run.smithi071.stdout:(19/23): leveldb-1.22-1.el8.x86_64.rpm 722 kB/s | 181 kB 00:00 2024-02-10T08:07:18.511 INFO:teuthology.orchestra.run.smithi071.stdout:(20/23): libunwind-1.3.1-3.el8.x86_64.rpm 899 kB/s | 75 kB 00:00 2024-02-10T08:07:18.587 INFO:teuthology.orchestra.run.smithi071.stdout:(21/23): liboath-2.6.2-3.el8.x86_64.rpm 281 kB/s | 59 kB 00:00 2024-02-10T08:07:18.594 INFO:teuthology.orchestra.run.smithi018.stdout:(22/23): librbd1-16.2.14-521.g0e714d9a.el8.x86_ 12 MB/s | 4.2 MB 00:00 2024-02-10T08:07:18.736 INFO:teuthology.orchestra.run.smithi018.stdout:(23/23): librados2-16.2.14-521.g0e714d9a.el8.x8 7.4 MB/s | 3.7 MB 00:00 2024-02-10T08:07:18.740 INFO:teuthology.orchestra.run.smithi018.stdout:-------------------------------------------------------------------------------- 2024-02-10T08:07:18.740 INFO:teuthology.orchestra.run.smithi018.stdout:Total 12 MB/s | 58 MB 00:04 2024-02-10T08:07:18.784 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction check 2024-02-10T08:07:18.836 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction check succeeded. 2024-02-10T08:07:18.836 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction test 2024-02-10T08:07:18.929 INFO:teuthology.orchestra.run.smithi071.stdout:(22/23): librados2-16.2.14-521.g0e714d9a.el8.x8 7.9 MB/s | 3.7 MB 00:00 2024-02-10T08:07:19.087 INFO:teuthology.orchestra.run.smithi071.stdout:(23/23): librbd1-16.2.14-521.g0e714d9a.el8.x86_ 7.3 MB/s | 4.2 MB 00:00 2024-02-10T08:07:19.089 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-02-10T08:07:19.089 INFO:teuthology.orchestra.run.smithi071.stdout:Total 11 MB/s | 58 MB 00:05 2024-02-10T08:07:19.131 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-02-10T08:07:19.179 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-02-10T08:07:19.179 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-02-10T08:07:19.228 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction test succeeded. 2024-02-10T08:07:19.231 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction 2024-02-10T08:07:19.538 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-02-10T08:07:19.541 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-02-10T08:07:20.292 INFO:teuthology.orchestra.run.smithi018.stdout: Preparing : 1/1 2024-02-10T08:07:20.526 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/25 2024-02-10T08:07:20.542 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-02-10T08:07:20.697 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/25 2024-02-10T08:07:20.750 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/25 2024-02-10T08:07:20.960 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/25 2024-02-10T08:07:21.127 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/25 2024-02-10T08:07:21.330 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : librados2-2:16.2.14-521.g0e714d9a.el8.x86_64 3/25 2024-02-10T08:07:21.337 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/25 2024-02-10T08:07:21.412 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: librados2-2:16.2.14-521.g0e714d9a.el8.x86_64 3/25 2024-02-10T08:07:21.502 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : librados2-2:16.2.14-521.g0e714d9a.el8.x86_64 3/25 2024-02-10T08:07:21.595 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librados2-2:16.2.14-521.g0e714d9a.el8.x86_64 3/25 2024-02-10T08:07:21.686 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-rados-2:16.2.14-521.g0e714d9a.el8.x86_64 4/25 2024-02-10T08:07:21.812 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-rados-2:16.2.14-521.g0e714d9a.el8.x86_64 4/25 2024-02-10T08:07:21.855 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libcephfs2-2:16.2.14-521.g0e714d9a.el8.x86_64 5/25 2024-02-10T08:07:22.026 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libcephfs2-2:16.2.14-521.g0e714d9a.el8.x86_64 5/25 2024-02-10T08:07:22.324 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: libcephfs2-2:16.2.14-521.g0e714d9a.el8.x86_64 5/25 2024-02-10T08:07:22.441 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libcephfs2-2:16.2.14-521.g0e714d9a.el8.x86_64 5/25 2024-02-10T08:07:22.497 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : librbd1-2:16.2.14-521.g0e714d9a.el8.x86_64 6/25 2024-02-10T08:07:22.560 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: librbd1-2:16.2.14-521.g0e714d9a.el8.x86_64 6/25 2024-02-10T08:07:22.601 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : librbd1-2:16.2.14-521.g0e714d9a.el8.x86_64 6/25 2024-02-10T08:07:22.666 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librbd1-2:16.2.14-521.g0e714d9a.el8.x86_64 6/25 2024-02-10T08:07:22.827 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : librabbitmq-0.9.0-5.el8.x86_64 7/25 2024-02-10T08:07:22.860 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : librabbitmq-0.9.0-5.el8.x86_64 7/25 2024-02-10T08:07:23.313 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 8/25 2024-02-10T08:07:23.324 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 8/25 2024-02-10T08:07:23.459 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : librgw2-2:16.2.14-521.g0e714d9a.el8.x86_64 9/25 2024-02-10T08:07:23.488 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : librgw2-2:16.2.14-521.g0e714d9a.el8.x86_64 9/25 2024-02-10T08:07:23.531 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librgw2-2:16.2.14-521.g0e714d9a.el8.x86_64 9/25 2024-02-10T08:07:23.550 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: librgw2-2:16.2.14-521.g0e714d9a.el8.x86_64 9/25 2024-02-10T08:07:23.715 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : leveldb-1.22-1.el8.x86_64 10/25 2024-02-10T08:07:23.736 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : leveldb-1.22-1.el8.x86_64 10/25 2024-02-10T08:07:23.848 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-ceph-argparse-2:16.2.14-521.g0e714d9a.el8. 11/25 2024-02-10T08:07:23.929 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-ceph-argparse-2:16.2.14-521.g0e714d9a.el8. 11/25 2024-02-10T08:07:24.010 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cephfs-2:16.2.14-521.g0e714d9a.el8.x86_64 12/25 2024-02-10T08:07:24.119 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cephfs-2:16.2.14-521.g0e714d9a.el8.x86_64 12/25 2024-02-10T08:07:24.219 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-rgw-2:16.2.14-521.g0e714d9a.el8.x86_64 13/25 2024-02-10T08:07:24.342 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-rgw-2:16.2.14-521.g0e714d9a.el8.x86_64 13/25 2024-02-10T08:07:24.484 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-rbd-2:16.2.14-521.g0e714d9a.el8.x86_64 14/25 2024-02-10T08:07:24.558 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-rbd-2:16.2.14-521.g0e714d9a.el8.x86_64 14/25 2024-02-10T08:07:24.634 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libradosstriper1-2:16.2.14-521.g0e714d9a.el8.x86_6 15/25 2024-02-10T08:07:24.704 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libradosstriper1-2:16.2.14-521.g0e714d9a.el8.x86_6 15/25 2024-02-10T08:07:24.713 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libradosstriper1-2:16.2.14-521.g0e714d9a.el8.x86_6 15/25 2024-02-10T08:07:24.789 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: libradosstriper1-2:16.2.14-521.g0e714d9a.el8.x86_6 15/25 2024-02-10T08:07:24.927 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 16/25 2024-02-10T08:07:25.018 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 16/25 2024-02-10T08:07:25.109 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 17/25 2024-02-10T08:07:25.189 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 17/25 2024-02-10T08:07:25.295 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 18/25 2024-02-10T08:07:25.398 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 18/25 2024-02-10T08:07:25.484 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-ceph-common-2:16.2.14-521.g0e714d9a.el8.x8 19/25 2024-02-10T08:07:25.597 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-ceph-common-2:16.2.14-521.g0e714d9a.el8.x8 19/25 2024-02-10T08:07:27.988 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-common-2:16.2.14-521.g0e714d9a.el8.x86_64 20/25 2024-02-10T08:07:28.200 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-common-2:16.2.14-521.g0e714d9a.el8.x86_64 20/25 2024-02-10T08:07:28.285 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-common-2:16.2.14-521.g0e714d9a.el8.x86_64 20/25 2024-02-10T08:07:28.529 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-common-2:16.2.14-521.g0e714d9a.el8.x86_64 20/25 2024-02-10T08:07:28.898 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-common-2:16.2.14-521.g0e714d9a.el8.x86_64 20/25 2024-02-10T08:07:29.169 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-base-2:16.2.14-521.g0e714d9a.el8.x86_64 21/25 2024-02-10T08:07:29.267 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-common-2:16.2.14-521.g0e714d9a.el8.x86_64 20/25 2024-02-10T08:07:29.272 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-base-2:16.2.14-521.g0e714d9a.el8.x86_64 21/25 2024-02-10T08:07:29.425 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-selinux-2:16.2.14-521.g0e714d9a.el8.x86_64 22/25 2024-02-10T08:07:29.566 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-base-2:16.2.14-521.g0e714d9a.el8.x86_64 21/25 2024-02-10T08:07:29.659 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-base-2:16.2.14-521.g0e714d9a.el8.x86_64 21/25 2024-02-10T08:07:29.804 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-selinux-2:16.2.14-521.g0e714d9a.el8.x86_64 22/25 2024-02-10T08:07:49.209 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-selinux-2:16.2.14-521.g0e714d9a.el8.x86_64 22/25 2024-02-10T08:07:49.209 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /sys 2024-02-10T08:07:49.209 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /proc 2024-02-10T08:07:49.209 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /dev 2024-02-10T08:07:49.209 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /run 2024-02-10T08:07:49.209 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /mnt 2024-02-10T08:07:49.210 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /var/tmp 2024-02-10T08:07:49.210 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /home 2024-02-10T08:07:49.210 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /tmp 2024-02-10T08:07:49.210 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /dev 2024-02-10T08:07:49.210 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-02-10T08:07:49.826 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-selinux-2:16.2.14-521.g0e714d9a.el8.x86_64 22/25 2024-02-10T08:07:49.826 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /sys 2024-02-10T08:07:49.826 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /proc 2024-02-10T08:07:49.826 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /dev 2024-02-10T08:07:49.826 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /run 2024-02-10T08:07:49.826 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /mnt 2024-02-10T08:07:49.826 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /var/tmp 2024-02-10T08:07:49.827 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /home 2024-02-10T08:07:49.827 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /tmp 2024-02-10T08:07:49.827 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /dev 2024-02-10T08:07:49.827 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:07:50.389 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-radosgw-2:16.2.14-521.g0e714d9a.el8.x86_64 23/25 2024-02-10T08:07:50.449 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-radosgw-2:16.2.14-521.g0e714d9a.el8.x86_64 23/25 2024-02-10T08:07:50.449 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2024-02-10T08:07:50.689 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2024-02-10T08:07:50.689 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2024-02-10T08:07:51.079 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-radosgw-2:16.2.14-521.g0e714d9a.el8.x86_64 23/25 2024-02-10T08:07:51.161 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-radosgw-2:16.2.14-521.g0e714d9a.el8.x86_64 23/25 2024-02-10T08:07:51.162 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2024-02-10T08:07:51.360 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2024-02-10T08:07:51.360 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-base-2:16.2.14-521.g0e714d9a.el8.x86_64 1/25 2024-02-10T08:07:51.360 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-common-2:16.2.14-521.g0e714d9a.el8.x86_64 2/25 2024-02-10T08:07:51.360 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-radosgw-2:16.2.14-521.g0e714d9a.el8.x86_64 3/25 2024-02-10T08:07:51.360 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-selinux-2:16.2.14-521.g0e714d9a.el8.x86_64 4/25 2024-02-10T08:07:51.360 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libcephfs2-2:16.2.14-521.g0e714d9a.el8.x86_64 5/25 2024-02-10T08:07:51.360 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libradosstriper1-2:16.2.14-521.g0e714d9a.el8.x86_6 6/25 2024-02-10T08:07:51.360 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librgw2-2:16.2.14-521.g0e714d9a.el8.x86_64 7/25 2024-02-10T08:07:51.361 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-ceph-argparse-2:16.2.14-521.g0e714d9a.el8. 8/25 2024-02-10T08:07:51.361 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-ceph-common-2:16.2.14-521.g0e714d9a.el8.x8 9/25 2024-02-10T08:07:51.361 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cephfs-2:16.2.14-521.g0e714d9a.el8.x86_64 10/25 2024-02-10T08:07:51.361 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-rados-2:16.2.14-521.g0e714d9a.el8.x86_64 11/25 2024-02-10T08:07:51.361 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-rbd-2:16.2.14-521.g0e714d9a.el8.x86_64 12/25 2024-02-10T08:07:51.361 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-rgw-2:16.2.14-521.g0e714d9a.el8.x86_64 13/25 2024-02-10T08:07:51.361 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 14/25 2024-02-10T08:07:51.361 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/25 2024-02-10T08:07:51.361 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/25 2024-02-10T08:07:51.361 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librabbitmq-0.9.0-5.el8.x86_64 17/25 2024-02-10T08:07:51.361 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 18/25 2024-02-10T08:07:51.361 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : leveldb-1.22-1.el8.x86_64 19/25 2024-02-10T08:07:51.361 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 20/25 2024-02-10T08:07:51.361 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 21/25 2024-02-10T08:07:51.361 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librados2-2:16.2.14-521.g0e714d9a.el8.x86_64 22/25 2024-02-10T08:07:51.362 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2024-02-10T08:07:51.362 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librbd1-2:16.2.14-521.g0e714d9a.el8.x86_64 24/25 2024-02-10T08:07:51.386 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2024-02-10T08:07:51.386 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2024-02-10T08:07:52.129 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2024-02-10T08:07:52.129 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-base-2:16.2.14-521.g0e714d9a.el8.x86_64 1/25 2024-02-10T08:07:52.129 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-common-2:16.2.14-521.g0e714d9a.el8.x86_64 2/25 2024-02-10T08:07:52.129 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-radosgw-2:16.2.14-521.g0e714d9a.el8.x86_64 3/25 2024-02-10T08:07:52.129 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-selinux-2:16.2.14-521.g0e714d9a.el8.x86_64 4/25 2024-02-10T08:07:52.129 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libcephfs2-2:16.2.14-521.g0e714d9a.el8.x86_64 5/25 2024-02-10T08:07:52.129 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libradosstriper1-2:16.2.14-521.g0e714d9a.el8.x86_6 6/25 2024-02-10T08:07:52.130 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librgw2-2:16.2.14-521.g0e714d9a.el8.x86_64 7/25 2024-02-10T08:07:52.130 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-ceph-argparse-2:16.2.14-521.g0e714d9a.el8. 8/25 2024-02-10T08:07:52.130 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-ceph-common-2:16.2.14-521.g0e714d9a.el8.x8 9/25 2024-02-10T08:07:52.130 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cephfs-2:16.2.14-521.g0e714d9a.el8.x86_64 10/25 2024-02-10T08:07:52.130 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-rados-2:16.2.14-521.g0e714d9a.el8.x86_64 11/25 2024-02-10T08:07:52.130 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-rbd-2:16.2.14-521.g0e714d9a.el8.x86_64 12/25 2024-02-10T08:07:52.130 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-rgw-2:16.2.14-521.g0e714d9a.el8.x86_64 13/25 2024-02-10T08:07:52.130 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 14/25 2024-02-10T08:07:52.130 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/25 2024-02-10T08:07:52.130 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/25 2024-02-10T08:07:52.130 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librabbitmq-0.9.0-5.el8.x86_64 17/25 2024-02-10T08:07:52.130 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 18/25 2024-02-10T08:07:52.130 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : leveldb-1.22-1.el8.x86_64 19/25 2024-02-10T08:07:52.130 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 20/25 2024-02-10T08:07:52.131 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 21/25 2024-02-10T08:07:52.131 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librados2-2:16.2.14-521.g0e714d9a.el8.x86_64 22/25 2024-02-10T08:07:52.131 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2024-02-10T08:07:52.131 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librbd1-2:16.2.14-521.g0e714d9a.el8.x86_64 24/25 2024-02-10T08:07:52.284 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2024-02-10T08:07:52.284 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-02-10T08:07:52.285 INFO:teuthology.orchestra.run.smithi071.stdout:Upgraded: 2024-02-10T08:07:52.285 INFO:teuthology.orchestra.run.smithi071.stdout: librados2-2:16.2.14-521.g0e714d9a.el8.x86_64 2024-02-10T08:07:52.285 INFO:teuthology.orchestra.run.smithi071.stdout: librbd1-2:16.2.14-521.g0e714d9a.el8.x86_64 2024-02-10T08:07:52.285 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-02-10T08:07:52.285 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-base-2:16.2.14-521.g0e714d9a.el8.x86_64 2024-02-10T08:07:52.285 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-common-2:16.2.14-521.g0e714d9a.el8.x86_64 2024-02-10T08:07:52.285 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-radosgw-2:16.2.14-521.g0e714d9a.el8.x86_64 2024-02-10T08:07:52.285 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-selinux-2:16.2.14-521.g0e714d9a.el8.x86_64 2024-02-10T08:07:52.285 INFO:teuthology.orchestra.run.smithi071.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-02-10T08:07:52.285 INFO:teuthology.orchestra.run.smithi071.stdout: leveldb-1.22-1.el8.x86_64 2024-02-10T08:07:52.285 INFO:teuthology.orchestra.run.smithi071.stdout: libcephfs2-2:16.2.14-521.g0e714d9a.el8.x86_64 2024-02-10T08:07:52.285 INFO:teuthology.orchestra.run.smithi071.stdout: liboath-2.6.2-3.el8.x86_64 2024-02-10T08:07:52.285 INFO:teuthology.orchestra.run.smithi071.stdout: librabbitmq-0.9.0-5.el8.x86_64 2024-02-10T08:07:52.285 INFO:teuthology.orchestra.run.smithi071.stdout: libradosstriper1-2:16.2.14-521.g0e714d9a.el8.x86_64 2024-02-10T08:07:52.285 INFO:teuthology.orchestra.run.smithi071.stdout: librdkafka-1.6.1-1.el8.x86_64 2024-02-10T08:07:52.285 INFO:teuthology.orchestra.run.smithi071.stdout: librgw2-2:16.2.14-521.g0e714d9a.el8.x86_64 2024-02-10T08:07:52.286 INFO:teuthology.orchestra.run.smithi071.stdout: libunwind-1.3.1-3.el8.x86_64 2024-02-10T08:07:52.286 INFO:teuthology.orchestra.run.smithi071.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-02-10T08:07:52.286 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ceph-argparse-2:16.2.14-521.g0e714d9a.el8.x86_64 2024-02-10T08:07:52.286 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ceph-common-2:16.2.14-521.g0e714d9a.el8.x86_64 2024-02-10T08:07:52.286 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cephfs-2:16.2.14-521.g0e714d9a.el8.x86_64 2024-02-10T08:07:52.286 INFO:teuthology.orchestra.run.smithi071.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-02-10T08:07:52.286 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rados-2:16.2.14-521.g0e714d9a.el8.x86_64 2024-02-10T08:07:52.286 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rbd-2:16.2.14-521.g0e714d9a.el8.x86_64 2024-02-10T08:07:52.286 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rgw-2:16.2.14-521.g0e714d9a.el8.x86_64 2024-02-10T08:07:52.286 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-02-10T08:07:52.286 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-02-10T08:07:52.542 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-test 2024-02-10T08:07:53.159 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2024-02-10T08:07:53.160 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:07:53.160 INFO:teuthology.orchestra.run.smithi018.stdout:Upgraded: 2024-02-10T08:07:53.160 INFO:teuthology.orchestra.run.smithi018.stdout: librados2-2:16.2.14-521.g0e714d9a.el8.x86_64 2024-02-10T08:07:53.160 INFO:teuthology.orchestra.run.smithi018.stdout: librbd1-2:16.2.14-521.g0e714d9a.el8.x86_64 2024-02-10T08:07:53.160 INFO:teuthology.orchestra.run.smithi018.stdout:Installed: 2024-02-10T08:07:53.160 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-base-2:16.2.14-521.g0e714d9a.el8.x86_64 2024-02-10T08:07:53.160 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-common-2:16.2.14-521.g0e714d9a.el8.x86_64 2024-02-10T08:07:53.160 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-radosgw-2:16.2.14-521.g0e714d9a.el8.x86_64 2024-02-10T08:07:53.160 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-selinux-2:16.2.14-521.g0e714d9a.el8.x86_64 2024-02-10T08:07:53.160 INFO:teuthology.orchestra.run.smithi018.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-02-10T08:07:53.160 INFO:teuthology.orchestra.run.smithi018.stdout: leveldb-1.22-1.el8.x86_64 2024-02-10T08:07:53.160 INFO:teuthology.orchestra.run.smithi018.stdout: libcephfs2-2:16.2.14-521.g0e714d9a.el8.x86_64 2024-02-10T08:07:53.160 INFO:teuthology.orchestra.run.smithi018.stdout: liboath-2.6.2-3.el8.x86_64 2024-02-10T08:07:53.161 INFO:teuthology.orchestra.run.smithi018.stdout: librabbitmq-0.9.0-5.el8.x86_64 2024-02-10T08:07:53.161 INFO:teuthology.orchestra.run.smithi018.stdout: libradosstriper1-2:16.2.14-521.g0e714d9a.el8.x86_64 2024-02-10T08:07:53.161 INFO:teuthology.orchestra.run.smithi018.stdout: librdkafka-1.6.1-1.el8.x86_64 2024-02-10T08:07:53.161 INFO:teuthology.orchestra.run.smithi018.stdout: librgw2-2:16.2.14-521.g0e714d9a.el8.x86_64 2024-02-10T08:07:53.161 INFO:teuthology.orchestra.run.smithi018.stdout: libunwind-1.3.1-3.el8.x86_64 2024-02-10T08:07:53.161 INFO:teuthology.orchestra.run.smithi018.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-02-10T08:07:53.161 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ceph-argparse-2:16.2.14-521.g0e714d9a.el8.x86_64 2024-02-10T08:07:53.161 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ceph-common-2:16.2.14-521.g0e714d9a.el8.x86_64 2024-02-10T08:07:53.161 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cephfs-2:16.2.14-521.g0e714d9a.el8.x86_64 2024-02-10T08:07:53.161 INFO:teuthology.orchestra.run.smithi018.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-02-10T08:07:53.161 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rados-2:16.2.14-521.g0e714d9a.el8.x86_64 2024-02-10T08:07:53.161 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rbd-2:16.2.14-521.g0e714d9a.el8.x86_64 2024-02-10T08:07:53.161 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rgw-2:16.2.14-521.g0e714d9a.el8.x86_64 2024-02-10T08:07:53.161 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:07:53.162 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-02-10T08:07:53.293 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:00:43 ago on Sat 10 Feb 2024 08:07:10 AM UTC. 2024-02-10T08:07:53.442 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install ceph-test 2024-02-10T08:07:54.225 INFO:teuthology.orchestra.run.smithi018.stdout:Last metadata expiration check: 0:00:45 ago on Sat 10 Feb 2024 08:07:09 AM UTC. 2024-02-10T08:07:54.746 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-02-10T08:07:54.746 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-02-10T08:07:54.747 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2024-02-10T08:07:54.747 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-02-10T08:07:54.747 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-02-10T08:07:54.747 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-test x86_64 2:16.2.14-521.g0e714d9a.el8 ceph 52 M 2024-02-10T08:07:54.747 INFO:teuthology.orchestra.run.smithi071.stdout:Installing dependencies: 2024-02-10T08:07:54.747 INFO:teuthology.orchestra.run.smithi071.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2024-02-10T08:07:54.747 INFO:teuthology.orchestra.run.smithi071.stdout: libcephsqlite x86_64 2:16.2.14-521.g0e714d9a.el8 ceph 174 k 2024-02-10T08:07:54.747 INFO:teuthology.orchestra.run.smithi071.stdout: oniguruma x86_64 6.8.2-3.el8 appstream 188 k 2024-02-10T08:07:54.747 INFO:teuthology.orchestra.run.smithi071.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2024-02-10T08:07:54.747 INFO:teuthology.orchestra.run.smithi071.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2024-02-10T08:07:54.747 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-02-10T08:07:54.748 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-02-10T08:07:54.748 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-02-10T08:07:54.748 INFO:teuthology.orchestra.run.smithi071.stdout:Install 6 Packages 2024-02-10T08:07:54.748 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-02-10T08:07:54.748 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 53 M 2024-02-10T08:07:54.748 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 197 M 2024-02-10T08:07:54.749 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-02-10T08:07:55.008 INFO:teuthology.orchestra.run.smithi071.stdout:(1/6): libcephsqlite-16.2.14-521.g0e714d9a.el8. 799 kB/s | 174 kB 00:00 2024-02-10T08:07:55.184 INFO:teuthology.orchestra.run.smithi071.stdout:(2/6): jq-1.6-8.el8.x86_64.rpm 517 kB/s | 203 kB 00:00 2024-02-10T08:07:55.417 INFO:teuthology.orchestra.run.smithi071.stdout:(3/6): socat-1.7.4.1-1.el8.x86_64.rpm 1.4 MB/s | 323 kB 00:00 2024-02-10T08:07:55.535 INFO:teuthology.orchestra.run.smithi071.stdout:(4/6): oniguruma-6.8.2-3.el8.x86_64.rpm 358 kB/s | 188 kB 00:00 2024-02-10T08:07:55.559 INFO:teuthology.orchestra.run.smithi071.stdout:(5/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 497 kB/s | 71 kB 00:00 2024-02-10T08:07:55.842 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-02-10T08:07:55.843 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-02-10T08:07:55.843 INFO:teuthology.orchestra.run.smithi018.stdout: Package Arch Version Repository Size 2024-02-10T08:07:55.843 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-02-10T08:07:55.843 INFO:teuthology.orchestra.run.smithi018.stdout:Installing: 2024-02-10T08:07:55.843 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-test x86_64 2:16.2.14-521.g0e714d9a.el8 ceph 52 M 2024-02-10T08:07:55.843 INFO:teuthology.orchestra.run.smithi018.stdout:Installing dependencies: 2024-02-10T08:07:55.843 INFO:teuthology.orchestra.run.smithi018.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2024-02-10T08:07:55.844 INFO:teuthology.orchestra.run.smithi018.stdout: libcephsqlite x86_64 2:16.2.14-521.g0e714d9a.el8 ceph 174 k 2024-02-10T08:07:55.844 INFO:teuthology.orchestra.run.smithi018.stdout: oniguruma x86_64 6.8.2-3.el8 appstream 188 k 2024-02-10T08:07:55.844 INFO:teuthology.orchestra.run.smithi018.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2024-02-10T08:07:55.848 INFO:teuthology.orchestra.run.smithi018.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2024-02-10T08:07:55.848 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:07:55.848 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction Summary 2024-02-10T08:07:55.848 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-02-10T08:07:55.849 INFO:teuthology.orchestra.run.smithi018.stdout:Install 6 Packages 2024-02-10T08:07:55.849 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:07:55.850 INFO:teuthology.orchestra.run.smithi018.stdout:Total download size: 53 M 2024-02-10T08:07:55.851 INFO:teuthology.orchestra.run.smithi018.stdout:Installed size: 197 M 2024-02-10T08:07:55.851 INFO:teuthology.orchestra.run.smithi018.stdout:Downloading Packages: 2024-02-10T08:07:56.426 INFO:teuthology.orchestra.run.smithi018.stdout:(1/6): jq-1.6-8.el8.x86_64.rpm 532 kB/s | 203 kB 00:00 2024-02-10T08:07:56.527 INFO:teuthology.orchestra.run.smithi018.stdout:(2/6): libcephsqlite-16.2.14-521.g0e714d9a.el8. 360 kB/s | 174 kB 00:00 2024-02-10T08:07:56.602 INFO:teuthology.orchestra.run.smithi018.stdout:(3/6): oniguruma-6.8.2-3.el8.x86_64.rpm 1.0 MB/s | 188 kB 00:00 2024-02-10T08:07:56.711 INFO:teuthology.orchestra.run.smithi018.stdout:(4/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 652 kB/s | 71 kB 00:00 2024-02-10T08:07:56.986 INFO:teuthology.orchestra.run.smithi018.stdout:(5/6): socat-1.7.4.1-1.el8.x86_64.rpm 704 kB/s | 323 kB 00:00 2024-02-10T08:07:57.560 INFO:teuthology.orchestra.run.smithi071.stdout:(6/6): ceph-test-16.2.14-521.g0e714d9a.el8.x86_ 19 MB/s | 52 MB 00:02 2024-02-10T08:07:57.562 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-02-10T08:07:57.562 INFO:teuthology.orchestra.run.smithi071.stdout:Total 19 MB/s | 53 MB 00:02 2024-02-10T08:07:57.605 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-02-10T08:07:57.625 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-02-10T08:07:57.625 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-02-10T08:07:57.911 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-02-10T08:07:57.914 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-02-10T08:07:58.381 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-02-10T08:07:58.606 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/6 2024-02-10T08:07:58.805 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/6 2024-02-10T08:07:58.935 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : oniguruma-6.8.2-3.el8.x86_64 3/6 2024-02-10T08:07:59.014 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: oniguruma-6.8.2-3.el8.x86_64 3/6 2024-02-10T08:07:59.208 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : jq-1.6-8.el8.x86_64 4/6 2024-02-10T08:07:59.360 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libcephsqlite-2:16.2.14-521.g0e714d9a.el8.x86_64 5/6 2024-02-10T08:08:03.975 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libcephsqlite-2:16.2.14-521.g0e714d9a.el8.x86_64 5/6 2024-02-10T08:08:04.199 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-test-2:16.2.14-521.g0e714d9a.el8.x86_64 6/6 2024-02-10T08:08:04.483 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-test-2:16.2.14-521.g0e714d9a.el8.x86_64 6/6 2024-02-10T08:08:04.483 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-test-2:16.2.14-521.g0e714d9a.el8.x86_64 1/6 2024-02-10T08:08:04.483 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libcephsqlite-2:16.2.14-521.g0e714d9a.el8.x86_64 2/6 2024-02-10T08:08:04.483 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : jq-1.6-8.el8.x86_64 3/6 2024-02-10T08:08:04.483 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : oniguruma-6.8.2-3.el8.x86_64 4/6 2024-02-10T08:08:04.483 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 5/6 2024-02-10T08:08:04.909 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 6/6 2024-02-10T08:08:04.909 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-02-10T08:08:04.909 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-02-10T08:08:04.909 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-test-2:16.2.14-521.g0e714d9a.el8.x86_64 2024-02-10T08:08:04.909 INFO:teuthology.orchestra.run.smithi071.stdout: jq-1.6-8.el8.x86_64 2024-02-10T08:08:04.909 INFO:teuthology.orchestra.run.smithi071.stdout: libcephsqlite-2:16.2.14-521.g0e714d9a.el8.x86_64 2024-02-10T08:08:04.909 INFO:teuthology.orchestra.run.smithi071.stdout: oniguruma-6.8.2-3.el8.x86_64 2024-02-10T08:08:04.909 INFO:teuthology.orchestra.run.smithi071.stdout: socat-1.7.4.1-1.el8.x86_64 2024-02-10T08:08:04.909 INFO:teuthology.orchestra.run.smithi071.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-02-10T08:08:04.910 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-02-10T08:08:04.910 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-02-10T08:08:05.035 INFO:teuthology.orchestra.run.smithi018.stdout:(6/6): ceph-test-16.2.14-521.g0e714d9a.el8.x86_ 5.8 MB/s | 52 MB 00:08 2024-02-10T08:08:05.036 INFO:teuthology.orchestra.run.smithi018.stdout:-------------------------------------------------------------------------------- 2024-02-10T08:08:05.037 INFO:teuthology.orchestra.run.smithi018.stdout:Total 5.8 MB/s | 53 MB 00:09 2024-02-10T08:08:05.080 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction check 2024-02-10T08:08:05.102 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction check succeeded. 2024-02-10T08:08:05.102 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction test 2024-02-10T08:08:05.119 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph 2024-02-10T08:08:05.409 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction test succeeded. 2024-02-10T08:08:05.412 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction 2024-02-10T08:08:05.881 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:00:55 ago on Sat 10 Feb 2024 08:07:10 AM UTC. 2024-02-10T08:08:06.032 INFO:teuthology.orchestra.run.smithi018.stdout: Preparing : 1/1 2024-02-10T08:08:06.265 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/6 2024-02-10T08:08:06.435 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/6 2024-02-10T08:08:06.572 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : oniguruma-6.8.2-3.el8.x86_64 3/6 2024-02-10T08:08:06.657 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: oniguruma-6.8.2-3.el8.x86_64 3/6 2024-02-10T08:08:06.830 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : jq-1.6-8.el8.x86_64 4/6 2024-02-10T08:08:07.014 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libcephsqlite-2:16.2.14-521.g0e714d9a.el8.x86_64 5/6 2024-02-10T08:08:07.373 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-02-10T08:08:07.376 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-02-10T08:08:07.376 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2024-02-10T08:08:07.377 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-02-10T08:08:07.377 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-02-10T08:08:07.377 INFO:teuthology.orchestra.run.smithi071.stdout: ceph x86_64 2:16.2.14-521.g0e714d9a.el8 ceph 6.4 k 2024-02-10T08:08:07.377 INFO:teuthology.orchestra.run.smithi071.stdout:Installing dependencies: 2024-02-10T08:08:07.377 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mds x86_64 2:16.2.14-521.g0e714d9a.el8 ceph 2.4 M 2024-02-10T08:08:07.377 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr x86_64 2:16.2.14-521.g0e714d9a.el8 ceph 1.6 M 2024-02-10T08:08:07.377 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-modules-core noarch 2:16.2.14-521.g0e714d9a.el8 ceph-noarch 245 k 2024-02-10T08:08:07.377 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mon x86_64 2:16.2.14-521.g0e714d9a.el8 ceph 5.2 M 2024-02-10T08:08:07.377 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-osd x86_64 2:16.2.14-521.g0e714d9a.el8 ceph 19 M 2024-02-10T08:08:07.377 INFO:teuthology.orchestra.run.smithi071.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-02-10T08:08:07.377 INFO:teuthology.orchestra.run.smithi071.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-02-10T08:08:07.377 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2024-02-10T08:08:07.377 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-02-10T08:08:07.377 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-02-10T08:08:07.378 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cryptography x86_64 3.2.1-7.el8 baseos 641 k 2024-02-10T08:08:07.378 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-02-10T08:08:07.378 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-02-10T08:08:07.378 INFO:teuthology.orchestra.run.smithi071.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-02-10T08:08:07.378 INFO:teuthology.orchestra.run.smithi071.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2024-02-10T08:08:07.378 INFO:teuthology.orchestra.run.smithi071.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2024-02-10T08:08:07.378 INFO:teuthology.orchestra.run.smithi071.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-02-10T08:08:07.378 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-02-10T08:08:07.378 INFO:teuthology.orchestra.run.smithi071.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-02-10T08:08:07.378 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2024-02-10T08:08:07.378 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2024-02-10T08:08:07.378 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2024-02-10T08:08:07.378 INFO:teuthology.orchestra.run.smithi071.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-02-10T08:08:07.378 INFO:teuthology.orchestra.run.smithi071.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-02-10T08:08:07.379 INFO:teuthology.orchestra.run.smithi071.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-02-10T08:08:07.379 INFO:teuthology.orchestra.run.smithi071.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-02-10T08:08:07.379 INFO:teuthology.orchestra.run.smithi071.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-02-10T08:08:07.379 INFO:teuthology.orchestra.run.smithi071.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-02-10T08:08:07.379 INFO:teuthology.orchestra.run.smithi071.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-02-10T08:08:07.379 INFO:teuthology.orchestra.run.smithi071.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2024-02-10T08:08:07.379 INFO:teuthology.orchestra.run.smithi071.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-02-10T08:08:07.379 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-02-10T08:08:07.379 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-02-10T08:08:07.379 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-02-10T08:08:07.379 INFO:teuthology.orchestra.run.smithi071.stdout:Install 32 Packages 2024-02-10T08:08:07.379 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-02-10T08:08:07.380 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 32 M 2024-02-10T08:08:07.380 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 104 M 2024-02-10T08:08:07.380 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-02-10T08:08:07.777 INFO:teuthology.orchestra.run.smithi071.stdout:(1/32): ceph-16.2.14-521.g0e714d9a.el8.x86_64.r 44 kB/s | 6.4 kB 00:00 2024-02-10T08:08:08.019 INFO:teuthology.orchestra.run.smithi071.stdout:(2/32): ceph-mds-16.2.14-521.g0e714d9a.el8.x86_ 6.3 MB/s | 2.4 MB 00:00 2024-02-10T08:08:08.052 INFO:teuthology.orchestra.run.smithi071.stdout:(3/32): ceph-mgr-16.2.14-521.g0e714d9a.el8.x86_ 3.9 MB/s | 1.6 MB 00:00 2024-02-10T08:08:08.153 INFO:teuthology.orchestra.run.smithi071.stdout:(4/32): ceph-mgr-modules-core-16.2.14-521.g0e71 2.4 MB/s | 245 kB 00:00 2024-02-10T08:08:08.695 INFO:teuthology.orchestra.run.smithi071.stdout:(5/32): python3-mako-1.0.6-14.el8.noarch.rpm 290 kB/s | 157 kB 00:00 2024-02-10T08:08:08.962 INFO:teuthology.orchestra.run.smithi071.stdout:(6/32): ceph-osd-16.2.14-521.g0e714d9a.el8.x86_ 20 MB/s | 19 MB 00:00 2024-02-10T08:08:08.987 INFO:teuthology.orchestra.run.smithi071.stdout:(7/32): python3-markupsafe-0.23-19.el8.x86_64.r 133 kB/s | 39 kB 00:00 2024-02-10T08:08:09.087 INFO:teuthology.orchestra.run.smithi071.stdout:(8/32): python3-pytz-2017.2-11.el8.noarch.rpm 570 kB/s | 57 kB 00:00 2024-02-10T08:08:09.171 INFO:teuthology.orchestra.run.smithi071.stdout:(9/32): ceph-mon-16.2.14-521.g0e714d9a.el8.x86_ 3.7 MB/s | 5.2 MB 00:01 2024-02-10T08:08:09.404 INFO:teuthology.orchestra.run.smithi071.stdout:(10/32): python3-pyOpenSSL-19.0.0-1.el8.noarch. 234 kB/s | 103 kB 00:00 2024-02-10T08:08:09.429 INFO:teuthology.orchestra.run.smithi071.stdout:(11/32): python3-werkzeug-0.12.2-4.el8.noarch.r 1.3 MB/s | 457 kB 00:00 2024-02-10T08:08:09.522 INFO:teuthology.orchestra.run.smithi071.stdout:(12/32): python3-cffi-1.11.5-6.el8.x86_64.rpm 709 kB/s | 249 kB 00:00 2024-02-10T08:08:09.714 INFO:teuthology.orchestra.run.smithi071.stdout:(13/32): python3-cryptography-3.2.1-7.el8.x86_6 2.0 MB/s | 641 kB 00:00 2024-02-10T08:08:09.864 INFO:teuthology.orchestra.run.smithi071.stdout:(14/32): python3-pycparser-2.14-14.el8.noarch.r 251 kB/s | 109 kB 00:00 2024-02-10T08:08:09.897 INFO:teuthology.orchestra.run.smithi071.stdout:(15/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 116 kB/s | 44 kB 00:00 2024-02-10T08:08:10.173 INFO:teuthology.orchestra.run.smithi071.stdout:(16/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 404 kB/s | 185 kB 00:00 2024-02-10T08:08:10.298 INFO:teuthology.orchestra.run.smithi071.stdout:(17/32): python3-cherrypy-18.4.0-1.el8.noarch.r 961 kB/s | 384 kB 00:00 2024-02-10T08:08:10.323 INFO:teuthology.orchestra.run.smithi071.stdout:(18/32): python3-jaraco-6.2-6.el8.noarch.rpm 74 kB/s | 11 kB 00:00 2024-02-10T08:08:10.432 INFO:teuthology.orchestra.run.smithi071.stdout:(19/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 304 kB/s | 173 kB 00:00 2024-02-10T08:08:10.457 INFO:teuthology.orchestra.run.smithi071.stdout:(20/32): python3-jaraco-functools-2.0-4.el8.noa 110 kB/s | 18 kB 00:00 2024-02-10T08:08:10.482 INFO:teuthology.orchestra.run.smithi071.stdout:(21/32): python3-logutils-0.3.5-11.el8.noarch.r 306 kB/s | 49 kB 00:00 2024-02-10T08:08:10.549 INFO:teuthology.orchestra.run.smithi071.stdout:(22/32): python3-more-itertools-7.2.0-3.el8.noa 501 kB/s | 59 kB 00:00 2024-02-10T08:08:10.599 INFO:teuthology.orchestra.run.smithi071.stdout:(23/32): python3-portend-2.6-1.el8.noarch.rpm 133 kB/s | 16 kB 00:00 2024-02-10T08:08:10.625 INFO:teuthology.orchestra.run.smithi071.stdout:(24/32): python3-pecan-1.3.2-9.el8.noarch.rpm 1.6 MB/s | 283 kB 00:00 2024-02-10T08:08:10.675 INFO:teuthology.orchestra.run.smithi071.stdout:(25/32): python3-simplegeneric-0.8.1-17.el8.noa 149 kB/s | 19 kB 00:00 2024-02-10T08:08:10.725 INFO:teuthology.orchestra.run.smithi071.stdout:(26/32): python3-singledispatch-3.4.0.3-18.el8. 190 kB/s | 24 kB 00:00 2024-02-10T08:08:10.751 INFO:teuthology.orchestra.run.smithi071.stdout:(27/32): python3-tempora-1.14.1-5.el8.noarch.rp 233 kB/s | 29 kB 00:00 2024-02-10T08:08:10.793 INFO:teuthology.orchestra.run.smithi071.stdout:(28/32): python3-trustme-0.6.0-4.el8.noarch.rpm 235 kB/s | 27 kB 00:00 2024-02-10T08:08:10.926 INFO:teuthology.orchestra.run.smithi071.stdout:(29/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 1.4 MB/s | 251 kB 00:00 2024-02-10T08:08:10.951 INFO:teuthology.orchestra.run.smithi071.stdout:(30/32): python3-webtest-2.0.33-1.el8.noarch.rp 539 kB/s | 85 kB 00:00 2024-02-10T08:08:10.985 INFO:teuthology.orchestra.run.smithi071.stdout:(31/32): python3-waitress-1.4.3-1.el8.noarch.rp 985 kB/s | 255 kB 00:00 2024-02-10T08:08:11.052 INFO:teuthology.orchestra.run.smithi071.stdout:(32/32): python3-zc-lockfile-2.0-2.el8.noarch.r 183 kB/s | 23 kB 00:00 2024-02-10T08:08:11.053 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-02-10T08:08:11.053 INFO:teuthology.orchestra.run.smithi071.stdout:Total 8.7 MB/s | 32 MB 00:03 2024-02-10T08:08:11.133 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-02-10T08:08:11.172 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-02-10T08:08:11.172 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-02-10T08:08:11.494 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-02-10T08:08:11.497 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-02-10T08:08:11.891 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: libcephsqlite-2:16.2.14-521.g0e714d9a.el8.x86_64 5/6 2024-02-10T08:08:12.112 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-test-2:16.2.14-521.g0e714d9a.el8.x86_64 6/6 2024-02-10T08:08:12.446 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-test-2:16.2.14-521.g0e714d9a.el8.x86_64 6/6 2024-02-10T08:08:12.446 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-test-2:16.2.14-521.g0e714d9a.el8.x86_64 1/6 2024-02-10T08:08:12.446 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libcephsqlite-2:16.2.14-521.g0e714d9a.el8.x86_64 2/6 2024-02-10T08:08:12.446 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : jq-1.6-8.el8.x86_64 3/6 2024-02-10T08:08:12.446 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : oniguruma-6.8.2-3.el8.x86_64 4/6 2024-02-10T08:08:12.447 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 5/6 2024-02-10T08:08:12.610 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-02-10T08:08:12.854 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2024-02-10T08:08:12.899 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 6/6 2024-02-10T08:08:12.899 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:08:12.899 INFO:teuthology.orchestra.run.smithi018.stdout:Installed: 2024-02-10T08:08:12.899 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-test-2:16.2.14-521.g0e714d9a.el8.x86_64 2024-02-10T08:08:12.899 INFO:teuthology.orchestra.run.smithi018.stdout: jq-1.6-8.el8.x86_64 2024-02-10T08:08:12.899 INFO:teuthology.orchestra.run.smithi018.stdout: libcephsqlite-2:16.2.14-521.g0e714d9a.el8.x86_64 2024-02-10T08:08:12.900 INFO:teuthology.orchestra.run.smithi018.stdout: oniguruma-6.8.2-3.el8.x86_64 2024-02-10T08:08:12.900 INFO:teuthology.orchestra.run.smithi018.stdout: socat-1.7.4.1-1.el8.x86_64 2024-02-10T08:08:12.900 INFO:teuthology.orchestra.run.smithi018.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-02-10T08:08:12.900 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:08:12.900 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-02-10T08:08:13.081 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2024-02-10T08:08:13.171 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install ceph 2024-02-10T08:08:13.356 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2024-02-10T08:08:13.563 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 4/32 2024-02-10T08:08:13.744 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2024-02-10T08:08:13.932 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2024-02-10T08:08:13.971 INFO:teuthology.orchestra.run.smithi018.stdout:Last metadata expiration check: 0:01:04 ago on Sat 10 Feb 2024 08:07:09 AM UTC. 2024-02-10T08:08:14.134 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2024-02-10T08:08:14.320 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2024-02-10T08:08:14.519 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2024-02-10T08:08:14.765 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2024-02-10T08:08:15.010 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2024-02-10T08:08:15.252 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2024-02-10T08:08:15.593 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-02-10T08:08:15.596 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-02-10T08:08:15.596 INFO:teuthology.orchestra.run.smithi018.stdout: Package Arch Version Repository Size 2024-02-10T08:08:15.596 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-02-10T08:08:15.597 INFO:teuthology.orchestra.run.smithi018.stdout:Installing: 2024-02-10T08:08:15.597 INFO:teuthology.orchestra.run.smithi018.stdout: ceph x86_64 2:16.2.14-521.g0e714d9a.el8 ceph 6.4 k 2024-02-10T08:08:15.597 INFO:teuthology.orchestra.run.smithi018.stdout:Installing dependencies: 2024-02-10T08:08:15.597 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mds x86_64 2:16.2.14-521.g0e714d9a.el8 ceph 2.4 M 2024-02-10T08:08:15.597 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr x86_64 2:16.2.14-521.g0e714d9a.el8 ceph 1.6 M 2024-02-10T08:08:15.597 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-modules-core noarch 2:16.2.14-521.g0e714d9a.el8 ceph-noarch 245 k 2024-02-10T08:08:15.597 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mon x86_64 2:16.2.14-521.g0e714d9a.el8 ceph 5.2 M 2024-02-10T08:08:15.597 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-osd x86_64 2:16.2.14-521.g0e714d9a.el8 ceph 19 M 2024-02-10T08:08:15.597 INFO:teuthology.orchestra.run.smithi018.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-02-10T08:08:15.597 INFO:teuthology.orchestra.run.smithi018.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-02-10T08:08:15.597 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2024-02-10T08:08:15.597 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-02-10T08:08:15.597 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-02-10T08:08:15.598 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cryptography x86_64 3.2.1-7.el8 baseos 641 k 2024-02-10T08:08:15.598 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-02-10T08:08:15.598 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-02-10T08:08:15.598 INFO:teuthology.orchestra.run.smithi018.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-02-10T08:08:15.598 INFO:teuthology.orchestra.run.smithi018.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2024-02-10T08:08:15.598 INFO:teuthology.orchestra.run.smithi018.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2024-02-10T08:08:15.598 INFO:teuthology.orchestra.run.smithi018.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-02-10T08:08:15.598 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-02-10T08:08:15.598 INFO:teuthology.orchestra.run.smithi018.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-02-10T08:08:15.598 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2024-02-10T08:08:15.598 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2024-02-10T08:08:15.598 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2024-02-10T08:08:15.598 INFO:teuthology.orchestra.run.smithi018.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-02-10T08:08:15.598 INFO:teuthology.orchestra.run.smithi018.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-02-10T08:08:15.598 INFO:teuthology.orchestra.run.smithi018.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-02-10T08:08:15.599 INFO:teuthology.orchestra.run.smithi018.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-02-10T08:08:15.599 INFO:teuthology.orchestra.run.smithi018.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-02-10T08:08:15.599 INFO:teuthology.orchestra.run.smithi018.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-02-10T08:08:15.599 INFO:teuthology.orchestra.run.smithi018.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-02-10T08:08:15.599 INFO:teuthology.orchestra.run.smithi018.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2024-02-10T08:08:15.599 INFO:teuthology.orchestra.run.smithi018.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-02-10T08:08:15.599 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:08:15.599 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction Summary 2024-02-10T08:08:15.599 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-02-10T08:08:15.599 INFO:teuthology.orchestra.run.smithi018.stdout:Install 32 Packages 2024-02-10T08:08:15.599 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:08:15.600 INFO:teuthology.orchestra.run.smithi018.stdout:Total download size: 32 M 2024-02-10T08:08:15.600 INFO:teuthology.orchestra.run.smithi018.stdout:Installed size: 104 M 2024-02-10T08:08:15.600 INFO:teuthology.orchestra.run.smithi018.stdout:Downloading Packages: 2024-02-10T08:08:15.636 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 13/32 2024-02-10T08:08:15.901 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cryptography-3.2.1-7.el8.x86_64 14/32 2024-02-10T08:08:16.089 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2024-02-10T08:08:16.137 INFO:teuthology.orchestra.run.smithi018.stdout:(1/32): ceph-16.2.14-521.g0e714d9a.el8.x86_64.r 41 kB/s | 6.4 kB 00:00 2024-02-10T08:08:16.379 INFO:teuthology.orchestra.run.smithi018.stdout:(2/32): ceph-mgr-16.2.14-521.g0e714d9a.el8.x86_ 4.1 MB/s | 1.6 MB 00:00 2024-02-10T08:08:16.389 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2024-02-10T08:08:16.429 INFO:teuthology.orchestra.run.smithi018.stdout:(3/32): ceph-mds-16.2.14-521.g0e714d9a.el8.x86_ 5.5 MB/s | 2.4 MB 00:00 2024-02-10T08:08:16.521 INFO:teuthology.orchestra.run.smithi018.stdout:(4/32): ceph-mgr-modules-core-16.2.14-521.g0e71 2.6 MB/s | 245 kB 00:00 2024-02-10T08:08:16.599 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2024-02-10T08:08:16.896 INFO:teuthology.orchestra.run.smithi018.stdout:(5/32): python3-mako-1.0.6-14.el8.noarch.rpm 419 kB/s | 157 kB 00:00 2024-02-10T08:08:16.897 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2024-02-10T08:08:16.997 INFO:teuthology.orchestra.run.smithi018.stdout:(6/32): python3-markupsafe-0.23-19.el8.x86_64.r 388 kB/s | 39 kB 00:00 2024-02-10T08:08:17.136 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2024-02-10T08:08:17.138 INFO:teuthology.orchestra.run.smithi018.stdout:(7/32): python3-pyOpenSSL-19.0.0-1.el8.noarch.r 732 kB/s | 103 kB 00:00 2024-02-10T08:08:17.222 INFO:teuthology.orchestra.run.smithi018.stdout:(8/32): python3-pytz-2017.2-11.el8.noarch.rpm 683 kB/s | 57 kB 00:00 2024-02-10T08:08:17.298 INFO:teuthology.orchestra.run.smithi018.stdout:(9/32): ceph-mon-16.2.14-521.g0e714d9a.el8.x86_ 4.5 MB/s | 5.2 MB 00:01 2024-02-10T08:08:17.308 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 20/32 2024-02-10T08:08:17.515 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2024-02-10T08:08:17.548 INFO:teuthology.orchestra.run.smithi018.stdout:(10/32): ceph-osd-16.2.14-521.g0e714d9a.el8.x86 16 MB/s | 19 MB 00:01 2024-02-10T08:08:17.581 INFO:teuthology.orchestra.run.smithi018.stdout:(11/32): python3-werkzeug-0.12.2-4.el8.noarch.r 1.2 MB/s | 457 kB 00:00 2024-02-10T08:08:17.607 INFO:teuthology.orchestra.run.smithi018.stdout:(12/32): python3-cffi-1.11.5-6.el8.x86_64.rpm 805 kB/s | 249 kB 00:00 2024-02-10T08:08:17.752 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2024-02-10T08:08:17.781 INFO:teuthology.orchestra.run.smithi018.stdout:(13/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 261 kB/s | 44 kB 00:00 2024-02-10T08:08:17.849 INFO:teuthology.orchestra.run.smithi018.stdout:(14/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 2.4 MB/s | 185 kB 00:00 2024-02-10T08:08:17.925 INFO:teuthology.orchestra.run.smithi018.stdout:(15/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 2.2 MB/s | 173 kB 00:00 2024-02-10T08:08:17.990 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2024-02-10T08:08:18.191 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2024-02-10T08:08:18.366 INFO:teuthology.orchestra.run.smithi018.stdout:(16/32): python3-pycparser-2.14-14.el8.noarch.r 139 kB/s | 109 kB 00:00 2024-02-10T08:08:18.466 INFO:teuthology.orchestra.run.smithi018.stdout:(17/32): python3-jaraco-6.2-6.el8.noarch.rpm 111 kB/s | 11 kB 00:00 2024-02-10T08:08:18.499 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 25/32 2024-02-10T08:08:18.508 INFO:teuthology.orchestra.run.smithi018.stdout:(18/32): python3-jaraco-functools-2.0-4.el8.noa 421 kB/s | 18 kB 00:00 2024-02-10T08:08:18.600 INFO:teuthology.orchestra.run.smithi018.stdout:(19/32): python3-logutils-0.3.5-11.el8.noarch.r 533 kB/s | 49 kB 00:00 2024-02-10T08:08:18.642 INFO:teuthology.orchestra.run.smithi018.stdout:(20/32): python3-more-itertools-7.2.0-3.el8.noa 1.4 MB/s | 59 kB 00:00 2024-02-10T08:08:18.743 INFO:teuthology.orchestra.run.smithi018.stdout:(21/32): python3-pecan-1.3.2-9.el8.noarch.rpm 2.8 MB/s | 283 kB 00:00 2024-02-10T08:08:18.785 INFO:teuthology.orchestra.run.smithi018.stdout:(22/32): python3-portend-2.6-1.el8.noarch.rpm 374 kB/s | 16 kB 00:00 2024-02-10T08:08:18.808 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2024-02-10T08:08:18.826 INFO:teuthology.orchestra.run.smithi018.stdout:(23/32): python3-simplegeneric-0.8.1-17.el8.noa 452 kB/s | 19 kB 00:00 2024-02-10T08:08:18.868 INFO:teuthology.orchestra.run.smithi018.stdout:(24/32): python3-singledispatch-3.4.0.3-18.el8. 572 kB/s | 24 kB 00:00 2024-02-10T08:08:18.911 INFO:teuthology.orchestra.run.smithi018.stdout:(25/32): python3-tempora-1.14.1-5.el8.noarch.rp 704 kB/s | 29 kB 00:00 2024-02-10T08:08:18.980 INFO:teuthology.orchestra.run.smithi018.stdout:(26/32): python3-trustme-0.6.0-4.el8.noarch.rpm 396 kB/s | 27 kB 00:00 2024-02-10T08:08:19.036 INFO:teuthology.orchestra.run.smithi018.stdout:(27/32): python3-cryptography-3.2.1-7.el8.x86_6 431 kB/s | 641 kB 00:01 2024-02-10T08:08:19.078 INFO:teuthology.orchestra.run.smithi018.stdout:(28/32): python3-waitress-1.4.3-1.el8.noarch.rp 2.6 MB/s | 255 kB 00:00 2024-02-10T08:08:19.137 INFO:teuthology.orchestra.run.smithi018.stdout:(29/32): python3-cherrypy-18.4.0-1.el8.noarch.r 317 kB/s | 384 kB 00:01 2024-02-10T08:08:19.162 INFO:teuthology.orchestra.run.smithi018.stdout:(30/32): python3-webtest-2.0.33-1.el8.noarch.rp 1.1 MB/s | 85 kB 00:00 2024-02-10T08:08:19.180 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-modules-core-2:16.2.14-521.g0e714d9a.el8. 27/32 2024-02-10T08:08:19.187 INFO:teuthology.orchestra.run.smithi018.stdout:(31/32): python3-zc-lockfile-2.0-2.el8.noarch.r 461 kB/s | 23 kB 00:00 2024-02-10T08:08:19.246 INFO:teuthology.orchestra.run.smithi018.stdout:(32/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 1.2 MB/s | 251 kB 00:00 2024-02-10T08:08:19.249 INFO:teuthology.orchestra.run.smithi018.stdout:-------------------------------------------------------------------------------- 2024-02-10T08:08:19.250 INFO:teuthology.orchestra.run.smithi018.stdout:Total 8.7 MB/s | 32 MB 00:03 2024-02-10T08:08:19.335 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction check 2024-02-10T08:08:19.358 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-2:16.2.14-521.g0e714d9a.el8.x86_64 28/32 2024-02-10T08:08:19.378 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction check succeeded. 2024-02-10T08:08:19.378 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction test 2024-02-10T08:08:19.699 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction test succeeded. 2024-02-10T08:08:19.702 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction 2024-02-10T08:08:20.874 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-2:16.2.14-521.g0e714d9a.el8.x86_64 28/32 2024-02-10T08:08:21.039 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-osd-2:16.2.14-521.g0e714d9a.el8.x86_64 29/32 2024-02-10T08:08:21.483 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-osd-2:16.2.14-521.g0e714d9a.el8.x86_64 29/32 2024-02-10T08:08:21.559 INFO:teuthology.orchestra.run.smithi018.stdout: Preparing : 1/1 2024-02-10T08:08:21.630 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mon-2:16.2.14-521.g0e714d9a.el8.x86_64 30/32 2024-02-10T08:08:21.788 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2024-02-10T08:08:21.847 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mon-2:16.2.14-521.g0e714d9a.el8.x86_64 30/32 2024-02-10T08:08:22.020 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2024-02-10T08:08:22.047 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mds-2:16.2.14-521.g0e714d9a.el8.x86_64 31/32 2024-02-10T08:08:22.064 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mds-2:16.2.14-521.g0e714d9a.el8.x86_64 31/32 2024-02-10T08:08:22.196 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-2:16.2.14-521.g0e714d9a.el8.x86_64 32/32 2024-02-10T08:08:22.309 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2024-02-10T08:08:22.598 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-2:16.2.14-521.g0e714d9a.el8.x86_64 32/32 2024-02-10T08:08:22.598 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-2:16.2.14-521.g0e714d9a.el8.x86_64 1/32 2024-02-10T08:08:22.598 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mds-2:16.2.14-521.g0e714d9a.el8.x86_64 2/32 2024-02-10T08:08:22.598 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-2:16.2.14-521.g0e714d9a.el8.x86_64 3/32 2024-02-10T08:08:22.598 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mon-2:16.2.14-521.g0e714d9a.el8.x86_64 4/32 2024-02-10T08:08:22.598 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-osd-2:16.2.14-521.g0e714d9a.el8.x86_64 5/32 2024-02-10T08:08:22.598 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-modules-core-2:16.2.14-521.g0e714d9a.el8. 6/32 2024-02-10T08:08:22.598 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 7/32 2024-02-10T08:08:22.598 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2024-02-10T08:08:22.598 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2024-02-10T08:08:22.598 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 10/32 2024-02-10T08:08:22.598 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2024-02-10T08:08:22.599 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 12/32 2024-02-10T08:08:22.599 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cryptography-3.2.1-7.el8.x86_64 13/32 2024-02-10T08:08:22.599 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2024-02-10T08:08:22.599 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2024-02-10T08:08:22.599 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2024-02-10T08:08:22.599 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2024-02-10T08:08:22.599 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2024-02-10T08:08:22.599 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2024-02-10T08:08:22.599 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2024-02-10T08:08:22.599 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2024-02-10T08:08:22.599 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2024-02-10T08:08:22.599 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2024-02-10T08:08:22.599 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2024-02-10T08:08:22.599 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2024-02-10T08:08:22.600 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2024-02-10T08:08:22.600 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2024-02-10T08:08:22.600 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2024-02-10T08:08:22.600 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 29/32 2024-02-10T08:08:22.600 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2024-02-10T08:08:22.600 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2024-02-10T08:08:22.670 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 4/32 2024-02-10T08:08:22.859 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2024-02-10T08:08:23.057 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2024-02-10T08:08:23.198 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2024-02-10T08:08:23.360 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2024-02-10T08:08:23.468 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2024-02-10T08:08:23.468 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-02-10T08:08:23.468 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-02-10T08:08:23.468 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-2:16.2.14-521.g0e714d9a.el8.x86_64 2024-02-10T08:08:23.468 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mds-2:16.2.14-521.g0e714d9a.el8.x86_64 2024-02-10T08:08:23.468 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-2:16.2.14-521.g0e714d9a.el8.x86_64 2024-02-10T08:08:23.468 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-modules-core-2:16.2.14-521.g0e714d9a.el8.noarch 2024-02-10T08:08:23.469 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mon-2:16.2.14-521.g0e714d9a.el8.x86_64 2024-02-10T08:08:23.469 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-osd-2:16.2.14-521.g0e714d9a.el8.x86_64 2024-02-10T08:08:23.469 INFO:teuthology.orchestra.run.smithi071.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-02-10T08:08:23.469 INFO:teuthology.orchestra.run.smithi071.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-02-10T08:08:23.469 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-02-10T08:08:23.469 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-02-10T08:08:23.469 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-02-10T08:08:23.469 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cryptography-3.2.1-7.el8.x86_64 2024-02-10T08:08:23.469 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-6.2-6.el8.noarch 2024-02-10T08:08:23.469 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-02-10T08:08:23.469 INFO:teuthology.orchestra.run.smithi071.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-02-10T08:08:23.469 INFO:teuthology.orchestra.run.smithi071.stdout: python3-mako-1.0.6-14.el8.noarch 2024-02-10T08:08:23.469 INFO:teuthology.orchestra.run.smithi071.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-02-10T08:08:23.469 INFO:teuthology.orchestra.run.smithi071.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-02-10T08:08:23.469 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-02-10T08:08:23.470 INFO:teuthology.orchestra.run.smithi071.stdout: python3-portend-2.6-1.el8.noarch 2024-02-10T08:08:23.470 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-02-10T08:08:23.470 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pycparser-2.14-14.el8.noarch 2024-02-10T08:08:23.470 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pytz-2017.2-11.el8.noarch 2024-02-10T08:08:23.470 INFO:teuthology.orchestra.run.smithi071.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-02-10T08:08:23.470 INFO:teuthology.orchestra.run.smithi071.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-02-10T08:08:23.470 INFO:teuthology.orchestra.run.smithi071.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-02-10T08:08:23.470 INFO:teuthology.orchestra.run.smithi071.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-02-10T08:08:23.470 INFO:teuthology.orchestra.run.smithi071.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-02-10T08:08:23.470 INFO:teuthology.orchestra.run.smithi071.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-02-10T08:08:23.470 INFO:teuthology.orchestra.run.smithi071.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-02-10T08:08:23.470 INFO:teuthology.orchestra.run.smithi071.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-02-10T08:08:23.470 INFO:teuthology.orchestra.run.smithi071.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-02-10T08:08:23.470 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-02-10T08:08:23.471 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-02-10T08:08:23.629 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2024-02-10T08:08:23.726 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-base 2024-02-10T08:08:23.874 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2024-02-10T08:08:24.079 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2024-02-10T08:08:24.337 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2024-02-10T08:08:24.482 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:14 ago on Sat 10 Feb 2024 08:07:10 AM UTC. 2024-02-10T08:08:24.749 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 13/32 2024-02-10T08:08:25.015 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cryptography-3.2.1-7.el8.x86_64 14/32 2024-02-10T08:08:25.161 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2024-02-10T08:08:25.416 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2024-02-10T08:08:25.756 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2024-02-10T08:08:25.928 INFO:teuthology.orchestra.run.smithi071.stdout:Package ceph-base-2:16.2.14-521.g0e714d9a.el8.x86_64 is already installed. 2024-02-10T08:08:25.974 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-02-10T08:08:25.975 INFO:teuthology.orchestra.run.smithi071.stdout:Nothing to do. 2024-02-10T08:08:25.975 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-02-10T08:08:26.056 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2024-02-10T08:08:26.081 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install cephadm 2024-02-10T08:08:26.328 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2024-02-10T08:08:26.507 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 20/32 2024-02-10T08:08:26.712 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2024-02-10T08:08:26.825 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:16 ago on Sat 10 Feb 2024 08:07:10 AM UTC. 2024-02-10T08:08:26.972 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2024-02-10T08:08:27.179 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2024-02-10T08:08:27.412 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2024-02-10T08:08:27.755 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 25/32 2024-02-10T08:08:28.149 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2024-02-10T08:08:28.290 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-02-10T08:08:28.291 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-02-10T08:08:28.291 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2024-02-10T08:08:28.291 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-02-10T08:08:28.291 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-02-10T08:08:28.291 INFO:teuthology.orchestra.run.smithi071.stdout: cephadm noarch 2:16.2.14-521.g0e714d9a.el8 ceph-noarch 85 k 2024-02-10T08:08:28.291 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-02-10T08:08:28.291 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-02-10T08:08:28.291 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-02-10T08:08:28.292 INFO:teuthology.orchestra.run.smithi071.stdout:Install 1 Package 2024-02-10T08:08:28.292 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-02-10T08:08:28.292 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 85 k 2024-02-10T08:08:28.292 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 352 k 2024-02-10T08:08:28.292 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-02-10T08:08:28.515 INFO:teuthology.orchestra.run.smithi071.stdout:cephadm-16.2.14-521.g0e714d9a.el8.noarch.rpm 382 kB/s | 85 kB 00:00 2024-02-10T08:08:28.516 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-02-10T08:08:28.516 INFO:teuthology.orchestra.run.smithi071.stdout:Total 380 kB/s | 85 kB 00:00 2024-02-10T08:08:28.516 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-02-10T08:08:28.523 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-02-10T08:08:28.523 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-02-10T08:08:28.525 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-02-10T08:08:28.528 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-02-10T08:08:28.552 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mgr-modules-core-2:16.2.14-521.g0e714d9a.el8. 27/32 2024-02-10T08:08:28.572 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-02-10T08:08:28.772 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mgr-2:16.2.14-521.g0e714d9a.el8.x86_64 28/32 2024-02-10T08:08:28.990 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: cephadm-2:16.2.14-521.g0e714d9a.el8.noarch 1/1 2024-02-10T08:08:29.210 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : cephadm-2:16.2.14-521.g0e714d9a.el8.noarch 1/1 2024-02-10T08:08:29.441 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: cephadm-2:16.2.14-521.g0e714d9a.el8.noarch 1/1 2024-02-10T08:08:30.023 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : cephadm-2:16.2.14-521.g0e714d9a.el8.noarch 1/1 2024-02-10T08:08:30.023 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-02-10T08:08:30.023 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-02-10T08:08:30.024 INFO:teuthology.orchestra.run.smithi071.stdout: cephadm-2:16.2.14-521.g0e714d9a.el8.noarch 2024-02-10T08:08:30.024 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-02-10T08:08:30.024 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-02-10T08:08:30.254 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-immutable-object-cache 2024-02-10T08:08:30.404 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mgr-2:16.2.14-521.g0e714d9a.el8.x86_64 28/32 2024-02-10T08:08:30.610 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-osd-2:16.2.14-521.g0e714d9a.el8.x86_64 29/32 2024-02-10T08:08:31.021 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:21 ago on Sat 10 Feb 2024 08:07:10 AM UTC. 2024-02-10T08:08:31.081 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-osd-2:16.2.14-521.g0e714d9a.el8.x86_64 29/32 2024-02-10T08:08:31.252 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mon-2:16.2.14-521.g0e714d9a.el8.x86_64 30/32 2024-02-10T08:08:31.481 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mon-2:16.2.14-521.g0e714d9a.el8.x86_64 30/32 2024-02-10T08:08:31.652 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mds-2:16.2.14-521.g0e714d9a.el8.x86_64 31/32 2024-02-10T08:08:31.671 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mds-2:16.2.14-521.g0e714d9a.el8.x86_64 31/32 2024-02-10T08:08:31.802 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-2:16.2.14-521.g0e714d9a.el8.x86_64 32/32 2024-02-10T08:08:32.237 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-2:16.2.14-521.g0e714d9a.el8.x86_64 32/32 2024-02-10T08:08:32.237 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-2:16.2.14-521.g0e714d9a.el8.x86_64 1/32 2024-02-10T08:08:32.237 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mds-2:16.2.14-521.g0e714d9a.el8.x86_64 2/32 2024-02-10T08:08:32.237 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mgr-2:16.2.14-521.g0e714d9a.el8.x86_64 3/32 2024-02-10T08:08:32.237 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mon-2:16.2.14-521.g0e714d9a.el8.x86_64 4/32 2024-02-10T08:08:32.237 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-osd-2:16.2.14-521.g0e714d9a.el8.x86_64 5/32 2024-02-10T08:08:32.237 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mgr-modules-core-2:16.2.14-521.g0e714d9a.el8. 6/32 2024-02-10T08:08:32.237 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 7/32 2024-02-10T08:08:32.237 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2024-02-10T08:08:32.237 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2024-02-10T08:08:32.238 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 10/32 2024-02-10T08:08:32.238 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2024-02-10T08:08:32.238 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 12/32 2024-02-10T08:08:32.238 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cryptography-3.2.1-7.el8.x86_64 13/32 2024-02-10T08:08:32.238 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2024-02-10T08:08:32.238 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2024-02-10T08:08:32.238 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2024-02-10T08:08:32.238 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2024-02-10T08:08:32.238 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2024-02-10T08:08:32.238 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2024-02-10T08:08:32.238 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2024-02-10T08:08:32.238 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2024-02-10T08:08:32.238 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2024-02-10T08:08:32.239 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2024-02-10T08:08:32.239 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2024-02-10T08:08:32.239 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2024-02-10T08:08:32.239 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2024-02-10T08:08:32.239 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2024-02-10T08:08:32.239 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2024-02-10T08:08:32.239 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 29/32 2024-02-10T08:08:32.239 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2024-02-10T08:08:32.239 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2024-02-10T08:08:32.535 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-02-10T08:08:32.535 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-02-10T08:08:32.535 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repo Size 2024-02-10T08:08:32.535 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-02-10T08:08:32.535 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-02-10T08:08:32.536 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-immutable-object-cache x86_64 2:16.2.14-521.g0e714d9a.el8 ceph 161 k 2024-02-10T08:08:32.536 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-02-10T08:08:32.536 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-02-10T08:08:32.536 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-02-10T08:08:32.536 INFO:teuthology.orchestra.run.smithi071.stdout:Install 1 Package 2024-02-10T08:08:32.536 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-02-10T08:08:32.536 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 161 k 2024-02-10T08:08:32.537 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 470 k 2024-02-10T08:08:32.537 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-02-10T08:08:32.745 INFO:teuthology.orchestra.run.smithi071.stdout:ceph-immutable-object-cache-16.2.14-521.g0e714d 774 kB/s | 161 kB 00:00 2024-02-10T08:08:32.746 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-02-10T08:08:32.746 INFO:teuthology.orchestra.run.smithi071.stdout:Total 769 kB/s | 161 kB 00:00 2024-02-10T08:08:32.746 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-02-10T08:08:32.756 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-02-10T08:08:32.756 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-02-10T08:08:32.803 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-02-10T08:08:32.806 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-02-10T08:08:32.939 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-02-10T08:08:33.127 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-immutable-object-cache-2:16.2.14-521.g0e714d9a. 1/1 2024-02-10T08:08:33.186 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2024-02-10T08:08:33.186 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:08:33.186 INFO:teuthology.orchestra.run.smithi018.stdout:Installed: 2024-02-10T08:08:33.186 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-2:16.2.14-521.g0e714d9a.el8.x86_64 2024-02-10T08:08:33.186 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mds-2:16.2.14-521.g0e714d9a.el8.x86_64 2024-02-10T08:08:33.186 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-2:16.2.14-521.g0e714d9a.el8.x86_64 2024-02-10T08:08:33.186 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-modules-core-2:16.2.14-521.g0e714d9a.el8.noarch 2024-02-10T08:08:33.186 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mon-2:16.2.14-521.g0e714d9a.el8.x86_64 2024-02-10T08:08:33.186 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-osd-2:16.2.14-521.g0e714d9a.el8.x86_64 2024-02-10T08:08:33.186 INFO:teuthology.orchestra.run.smithi018.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-02-10T08:08:33.187 INFO:teuthology.orchestra.run.smithi018.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-02-10T08:08:33.187 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-02-10T08:08:33.187 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-02-10T08:08:33.187 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-02-10T08:08:33.187 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cryptography-3.2.1-7.el8.x86_64 2024-02-10T08:08:33.187 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-6.2-6.el8.noarch 2024-02-10T08:08:33.187 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-02-10T08:08:33.187 INFO:teuthology.orchestra.run.smithi018.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-02-10T08:08:33.187 INFO:teuthology.orchestra.run.smithi018.stdout: python3-mako-1.0.6-14.el8.noarch 2024-02-10T08:08:33.187 INFO:teuthology.orchestra.run.smithi018.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-02-10T08:08:33.187 INFO:teuthology.orchestra.run.smithi018.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-02-10T08:08:33.187 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-02-10T08:08:33.187 INFO:teuthology.orchestra.run.smithi018.stdout: python3-portend-2.6-1.el8.noarch 2024-02-10T08:08:33.187 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-02-10T08:08:33.188 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pycparser-2.14-14.el8.noarch 2024-02-10T08:08:33.188 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pytz-2017.2-11.el8.noarch 2024-02-10T08:08:33.188 INFO:teuthology.orchestra.run.smithi018.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-02-10T08:08:33.188 INFO:teuthology.orchestra.run.smithi018.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-02-10T08:08:33.188 INFO:teuthology.orchestra.run.smithi018.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-02-10T08:08:33.188 INFO:teuthology.orchestra.run.smithi018.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-02-10T08:08:33.188 INFO:teuthology.orchestra.run.smithi018.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-02-10T08:08:33.188 INFO:teuthology.orchestra.run.smithi018.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-02-10T08:08:33.188 INFO:teuthology.orchestra.run.smithi018.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-02-10T08:08:33.188 INFO:teuthology.orchestra.run.smithi018.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-02-10T08:08:33.188 INFO:teuthology.orchestra.run.smithi018.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-02-10T08:08:33.188 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:08:33.188 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-02-10T08:08:33.476 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install ceph-base 2024-02-10T08:08:33.525 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.2.14-521.g0e714d9a. 1/1 2024-02-10T08:08:33.893 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-immutable-object-cache-2:16.2.14-521.g0e714d9a. 1/1 2024-02-10T08:08:33.893 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-02-10T08:08:33.893 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-02-10T08:08:33.893 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-immutable-object-cache-2:16.2.14-521.g0e714d9a.el8.x86_64 2024-02-10T08:08:33.893 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-02-10T08:08:33.893 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-02-10T08:08:34.166 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-mgr 2024-02-10T08:08:34.267 INFO:teuthology.orchestra.run.smithi018.stdout:Last metadata expiration check: 0:01:25 ago on Sat 10 Feb 2024 08:07:09 AM UTC. 2024-02-10T08:08:34.924 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:24 ago on Sat 10 Feb 2024 08:07:10 AM UTC. 2024-02-10T08:08:35.838 INFO:teuthology.orchestra.run.smithi018.stdout:Package ceph-base-2:16.2.14-521.g0e714d9a.el8.x86_64 is already installed. 2024-02-10T08:08:35.888 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-02-10T08:08:35.890 INFO:teuthology.orchestra.run.smithi018.stdout:Nothing to do. 2024-02-10T08:08:35.890 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-02-10T08:08:35.999 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install cephadm 2024-02-10T08:08:36.374 INFO:teuthology.orchestra.run.smithi071.stdout:Package ceph-mgr-2:16.2.14-521.g0e714d9a.el8.x86_64 is already installed. 2024-02-10T08:08:36.421 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-02-10T08:08:36.423 INFO:teuthology.orchestra.run.smithi071.stdout:Nothing to do. 2024-02-10T08:08:36.423 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-02-10T08:08:36.785 INFO:teuthology.orchestra.run.smithi018.stdout:Last metadata expiration check: 0:01:27 ago on Sat 10 Feb 2024 08:07:09 AM UTC. 2024-02-10T08:08:36.870 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-mgr-dashboard 2024-02-10T08:08:37.621 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:27 ago on Sat 10 Feb 2024 08:07:10 AM UTC. 2024-02-10T08:08:38.406 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-02-10T08:08:38.407 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-02-10T08:08:38.407 INFO:teuthology.orchestra.run.smithi018.stdout: Package Arch Version Repository Size 2024-02-10T08:08:38.407 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-02-10T08:08:38.407 INFO:teuthology.orchestra.run.smithi018.stdout:Installing: 2024-02-10T08:08:38.407 INFO:teuthology.orchestra.run.smithi018.stdout: cephadm noarch 2:16.2.14-521.g0e714d9a.el8 ceph-noarch 85 k 2024-02-10T08:08:38.407 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:08:38.407 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction Summary 2024-02-10T08:08:38.407 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-02-10T08:08:38.407 INFO:teuthology.orchestra.run.smithi018.stdout:Install 1 Package 2024-02-10T08:08:38.407 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:08:38.408 INFO:teuthology.orchestra.run.smithi018.stdout:Total download size: 85 k 2024-02-10T08:08:38.408 INFO:teuthology.orchestra.run.smithi018.stdout:Installed size: 352 k 2024-02-10T08:08:38.408 INFO:teuthology.orchestra.run.smithi018.stdout:Downloading Packages: 2024-02-10T08:08:38.595 INFO:teuthology.orchestra.run.smithi018.stdout:cephadm-16.2.14-521.g0e714d9a.el8.noarch.rpm 458 kB/s | 85 kB 00:00 2024-02-10T08:08:38.595 INFO:teuthology.orchestra.run.smithi018.stdout:-------------------------------------------------------------------------------- 2024-02-10T08:08:38.595 INFO:teuthology.orchestra.run.smithi018.stdout:Total 455 kB/s | 85 kB 00:00 2024-02-10T08:08:38.596 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction check 2024-02-10T08:08:38.603 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction check succeeded. 2024-02-10T08:08:38.603 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction test 2024-02-10T08:08:38.605 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction test succeeded. 2024-02-10T08:08:38.608 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction 2024-02-10T08:08:38.654 INFO:teuthology.orchestra.run.smithi018.stdout: Preparing : 1/1 2024-02-10T08:08:39.118 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-02-10T08:08:39.119 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-02-10T08:08:39.119 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2024-02-10T08:08:39.119 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-02-10T08:08:39.119 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-02-10T08:08:39.119 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-dashboard noarch 2:16.2.14-521.g0e714d9a.el8 ceph-noarch 3.1 M 2024-02-10T08:08:39.119 INFO:teuthology.orchestra.run.smithi071.stdout:Installing dependencies: 2024-02-10T08:08:39.119 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-grafana-dashboards noarch 2:16.2.14-521.g0e714d9a.el8 ceph-noarch 24 k 2024-02-10T08:08:39.120 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-prometheus-alerts noarch 2:16.2.14-521.g0e714d9a.el8 ceph-noarch 15 k 2024-02-10T08:08:39.120 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2024-02-10T08:08:39.120 INFO:teuthology.orchestra.run.smithi071.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-02-10T08:08:39.120 INFO:teuthology.orchestra.run.smithi071.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-02-10T08:08:39.120 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-02-10T08:08:39.120 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-02-10T08:08:39.120 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-02-10T08:08:39.120 INFO:teuthology.orchestra.run.smithi071.stdout:Install 6 Packages 2024-02-10T08:08:39.120 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-02-10T08:08:39.121 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 3.4 M 2024-02-10T08:08:39.121 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 22 M 2024-02-10T08:08:39.121 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-02-10T08:08:39.218 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: cephadm-2:16.2.14-521.g0e714d9a.el8.noarch 1/1 2024-02-10T08:08:39.425 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : cephadm-2:16.2.14-521.g0e714d9a.el8.noarch 1/1 2024-02-10T08:08:39.658 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: cephadm-2:16.2.14-521.g0e714d9a.el8.noarch 1/1 2024-02-10T08:08:39.698 INFO:teuthology.orchestra.run.smithi071.stdout:(1/6): ceph-grafana-dashboards-16.2.14-521.g0e7 101 kB/s | 24 kB 00:00 2024-02-10T08:08:39.715 INFO:teuthology.orchestra.run.smithi071.stdout:(2/6): ceph-prometheus-alerts-16.2.14-521.g0e71 58 kB/s | 15 kB 00:00 2024-02-10T08:08:39.807 INFO:teuthology.orchestra.run.smithi071.stdout:(3/6): python3-jwt-1.6.1-2.el8.noarch.rpm 392 kB/s | 43 kB 00:00 2024-02-10T08:08:39.849 INFO:teuthology.orchestra.run.smithi071.stdout:(4/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 252 kB/s | 34 kB 00:00 2024-02-10T08:08:40.016 INFO:teuthology.orchestra.run.smithi071.stdout:(5/6): python3-routes-2.4.1-12.el8.noarch.rpm 944 kB/s | 196 kB 00:00 2024-02-10T08:08:40.059 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : cephadm-2:16.2.14-521.g0e714d9a.el8.noarch 1/1 2024-02-10T08:08:40.059 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:08:40.059 INFO:teuthology.orchestra.run.smithi018.stdout:Installed: 2024-02-10T08:08:40.059 INFO:teuthology.orchestra.run.smithi018.stdout: cephadm-2:16.2.14-521.g0e714d9a.el8.noarch 2024-02-10T08:08:40.059 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:08:40.060 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-02-10T08:08:40.272 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install ceph-immutable-object-cache 2024-02-10T08:08:40.433 INFO:teuthology.orchestra.run.smithi071.stdout:(6/6): ceph-mgr-dashboard-16.2.14-521.g0e714d9a 3.2 MB/s | 3.1 MB 00:00 2024-02-10T08:08:40.436 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-02-10T08:08:40.437 INFO:teuthology.orchestra.run.smithi071.stdout:Total 2.6 MB/s | 3.4 MB 00:01 2024-02-10T08:08:40.447 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-02-10T08:08:40.458 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-02-10T08:08:40.458 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-02-10T08:08:40.616 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-02-10T08:08:40.619 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-02-10T08:08:40.889 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-02-10T08:08:41.057 INFO:teuthology.orchestra.run.smithi018.stdout:Last metadata expiration check: 0:01:32 ago on Sat 10 Feb 2024 08:07:09 AM UTC. 2024-02-10T08:08:41.115 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2024-02-10T08:08:41.395 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2024-02-10T08:08:41.903 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2024-02-10T08:08:42.032 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-prometheus-alerts-2:16.2.14-521.g0e714d9a.el8.n 4/6 2024-02-10T08:08:42.670 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-02-10T08:08:42.670 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-02-10T08:08:42.670 INFO:teuthology.orchestra.run.smithi018.stdout: Package Arch Version Repo Size 2024-02-10T08:08:42.670 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-02-10T08:08:42.670 INFO:teuthology.orchestra.run.smithi018.stdout:Installing: 2024-02-10T08:08:42.671 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-immutable-object-cache x86_64 2:16.2.14-521.g0e714d9a.el8 ceph 161 k 2024-02-10T08:08:42.671 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:08:42.671 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction Summary 2024-02-10T08:08:42.671 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-02-10T08:08:42.671 INFO:teuthology.orchestra.run.smithi018.stdout:Install 1 Package 2024-02-10T08:08:42.671 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:08:42.671 INFO:teuthology.orchestra.run.smithi018.stdout:Total download size: 161 k 2024-02-10T08:08:42.672 INFO:teuthology.orchestra.run.smithi018.stdout:Installed size: 470 k 2024-02-10T08:08:42.672 INFO:teuthology.orchestra.run.smithi018.stdout:Downloading Packages: 2024-02-10T08:08:43.054 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-grafana-dashboards-2:16.2.14-521.g0e714d9a.el8. 5/6 2024-02-10T08:08:43.166 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-immutable-object-cache-16.2.14-521.g0e714d 326 kB/s | 161 kB 00:00 2024-02-10T08:08:43.167 INFO:teuthology.orchestra.run.smithi018.stdout:-------------------------------------------------------------------------------- 2024-02-10T08:08:43.167 INFO:teuthology.orchestra.run.smithi018.stdout:Total 325 kB/s | 161 kB 00:00 2024-02-10T08:08:43.167 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction check 2024-02-10T08:08:43.180 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction check succeeded. 2024-02-10T08:08:43.180 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction test 2024-02-10T08:08:43.233 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction test succeeded. 2024-02-10T08:08:43.236 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction 2024-02-10T08:08:43.319 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-dashboard-2:16.2.14-521.g0e714d9a.el8.noarc 6/6 2024-02-10T08:08:43.373 INFO:teuthology.orchestra.run.smithi018.stdout: Preparing : 1/1 2024-02-10T08:08:43.592 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-immutable-object-cache-2:16.2.14-521.g0e714d9a. 1/1 2024-02-10T08:08:43.608 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.14-521.g0e714d9a.el8.noarc 6/6 2024-02-10T08:08:43.608 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-grafana-dashboards-2:16.2.14-521.g0e714d9a.el8. 1/6 2024-02-10T08:08:43.608 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-dashboard-2:16.2.14-521.g0e714d9a.el8.noarc 2/6 2024-02-10T08:08:43.608 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-prometheus-alerts-2:16.2.14-521.g0e714d9a.el8.n 3/6 2024-02-10T08:08:43.608 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2024-02-10T08:08:43.608 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2024-02-10T08:08:44.002 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2024-02-10T08:08:44.002 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-02-10T08:08:44.003 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-02-10T08:08:44.003 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-grafana-dashboards-2:16.2.14-521.g0e714d9a.el8.noarch 2024-02-10T08:08:44.003 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-dashboard-2:16.2.14-521.g0e714d9a.el8.noarch 2024-02-10T08:08:44.003 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-prometheus-alerts-2:16.2.14-521.g0e714d9a.el8.noarch 2024-02-10T08:08:44.003 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-02-10T08:08:44.003 INFO:teuthology.orchestra.run.smithi071.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-02-10T08:08:44.003 INFO:teuthology.orchestra.run.smithi071.stdout: python3-routes-2.4.1-12.el8.noarch 2024-02-10T08:08:44.003 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-02-10T08:08:44.003 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-02-10T08:08:44.013 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.2.14-521.g0e714d9a. 1/1 2024-02-10T08:08:44.125 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-mgr-diskprediction-local 2024-02-10T08:08:44.391 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-immutable-object-cache-2:16.2.14-521.g0e714d9a. 1/1 2024-02-10T08:08:44.391 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:08:44.391 INFO:teuthology.orchestra.run.smithi018.stdout:Installed: 2024-02-10T08:08:44.391 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-immutable-object-cache-2:16.2.14-521.g0e714d9a.el8.x86_64 2024-02-10T08:08:44.391 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:08:44.391 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-02-10T08:08:44.585 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install ceph-mgr 2024-02-10T08:08:44.870 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:34 ago on Sat 10 Feb 2024 08:07:10 AM UTC. 2024-02-10T08:08:45.370 INFO:teuthology.orchestra.run.smithi018.stdout:Last metadata expiration check: 0:01:36 ago on Sat 10 Feb 2024 08:07:09 AM UTC. 2024-02-10T08:08:46.384 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-02-10T08:08:46.385 INFO:teuthology.orchestra.run.smithi071.stdout:============================================================================================ 2024-02-10T08:08:46.386 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2024-02-10T08:08:46.386 INFO:teuthology.orchestra.run.smithi071.stdout:============================================================================================ 2024-02-10T08:08:46.386 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-02-10T08:08:46.386 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.14-521.g0e714d9a.el8 ceph-noarch 8.6 M 2024-02-10T08:08:46.386 INFO:teuthology.orchestra.run.smithi071.stdout:Installing dependencies: 2024-02-10T08:08:46.386 INFO:teuthology.orchestra.run.smithi071.stdout: libgfortran x86_64 8.5.0-21.el8 baseos 645 k 2024-02-10T08:08:46.386 INFO:teuthology.orchestra.run.smithi071.stdout: libquadmath x86_64 8.5.0-21.el8 baseos 172 k 2024-02-10T08:08:46.386 INFO:teuthology.orchestra.run.smithi071.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2024-02-10T08:08:46.386 INFO:teuthology.orchestra.run.smithi071.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2024-02-10T08:08:46.386 INFO:teuthology.orchestra.run.smithi071.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2024-02-10T08:08:46.386 INFO:teuthology.orchestra.run.smithi071.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2024-02-10T08:08:46.386 INFO:teuthology.orchestra.run.smithi071.stdout: python3-scipy x86_64 1.0.0-21.module_el8+762+77bd8591 appstream 14 M 2024-02-10T08:08:46.386 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-02-10T08:08:46.386 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-02-10T08:08:46.387 INFO:teuthology.orchestra.run.smithi071.stdout:============================================================================================ 2024-02-10T08:08:46.387 INFO:teuthology.orchestra.run.smithi071.stdout:Install 8 Packages 2024-02-10T08:08:46.387 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-02-10T08:08:46.387 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 37 M 2024-02-10T08:08:46.387 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 210 M 2024-02-10T08:08:46.387 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-02-10T08:08:46.942 INFO:teuthology.orchestra.run.smithi018.stdout:Package ceph-mgr-2:16.2.14-521.g0e714d9a.el8.x86_64 is already installed. 2024-02-10T08:08:46.992 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-02-10T08:08:46.993 INFO:teuthology.orchestra.run.smithi018.stdout:Nothing to do. 2024-02-10T08:08:46.993 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-02-10T08:08:47.098 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install ceph-mgr-dashboard 2024-02-10T08:08:47.829 INFO:teuthology.orchestra.run.smithi071.stdout:(1/8): ceph-mgr-diskprediction-local-16.2.14-52 8.1 MB/s | 8.6 MB 00:01 2024-02-10T08:08:47.881 INFO:teuthology.orchestra.run.smithi018.stdout:Last metadata expiration check: 0:01:38 ago on Sat 10 Feb 2024 08:07:09 AM UTC. 2024-02-10T08:08:49.494 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-02-10T08:08:49.496 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-02-10T08:08:49.496 INFO:teuthology.orchestra.run.smithi018.stdout: Package Arch Version Repository Size 2024-02-10T08:08:49.496 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-02-10T08:08:49.496 INFO:teuthology.orchestra.run.smithi018.stdout:Installing: 2024-02-10T08:08:49.496 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-dashboard noarch 2:16.2.14-521.g0e714d9a.el8 ceph-noarch 3.1 M 2024-02-10T08:08:49.496 INFO:teuthology.orchestra.run.smithi018.stdout:Installing dependencies: 2024-02-10T08:08:49.496 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-grafana-dashboards noarch 2:16.2.14-521.g0e714d9a.el8 ceph-noarch 24 k 2024-02-10T08:08:49.496 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-prometheus-alerts noarch 2:16.2.14-521.g0e714d9a.el8 ceph-noarch 15 k 2024-02-10T08:08:49.496 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2024-02-10T08:08:49.496 INFO:teuthology.orchestra.run.smithi018.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-02-10T08:08:49.496 INFO:teuthology.orchestra.run.smithi018.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-02-10T08:08:49.496 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:08:49.496 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction Summary 2024-02-10T08:08:49.496 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-02-10T08:08:49.497 INFO:teuthology.orchestra.run.smithi018.stdout:Install 6 Packages 2024-02-10T08:08:49.497 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:08:49.497 INFO:teuthology.orchestra.run.smithi018.stdout:Total download size: 3.4 M 2024-02-10T08:08:49.497 INFO:teuthology.orchestra.run.smithi018.stdout:Installed size: 22 M 2024-02-10T08:08:49.497 INFO:teuthology.orchestra.run.smithi018.stdout:Downloading Packages: 2024-02-10T08:08:49.894 INFO:teuthology.orchestra.run.smithi018.stdout:(1/6): ceph-grafana-dashboards-16.2.14-521.g0e7 158 kB/s | 24 kB 00:00 2024-02-10T08:08:49.911 INFO:teuthology.orchestra.run.smithi018.stdout:(2/6): ceph-prometheus-alerts-16.2.14-521.g0e71 87 kB/s | 15 kB 00:00 2024-02-10T08:08:49.997 INFO:teuthology.orchestra.run.smithi018.stdout:(3/6): python3-jwt-1.6.1-2.el8.noarch.rpm 417 kB/s | 43 kB 00:00 2024-02-10T08:08:50.312 INFO:teuthology.orchestra.run.smithi018.stdout:(4/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 84 kB/s | 34 kB 00:00 2024-02-10T08:08:50.403 INFO:teuthology.orchestra.run.smithi018.stdout:(5/6): ceph-mgr-dashboard-16.2.14-521.g0e714d9a 4.7 MB/s | 3.1 MB 00:00 2024-02-10T08:08:50.579 INFO:teuthology.orchestra.run.smithi018.stdout:(6/6): python3-routes-2.4.1-12.el8.noarch.rpm 341 kB/s | 196 kB 00:00 2024-02-10T08:08:50.582 INFO:teuthology.orchestra.run.smithi018.stdout:-------------------------------------------------------------------------------- 2024-02-10T08:08:50.583 INFO:teuthology.orchestra.run.smithi018.stdout:Total 3.2 MB/s | 3.4 MB 00:01 2024-02-10T08:08:50.595 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction check 2024-02-10T08:08:50.606 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction check succeeded. 2024-02-10T08:08:50.607 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction test 2024-02-10T08:08:50.783 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction test succeeded. 2024-02-10T08:08:50.786 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction 2024-02-10T08:08:51.079 INFO:teuthology.orchestra.run.smithi018.stdout: Preparing : 1/1 2024-02-10T08:08:51.290 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2024-02-10T08:08:51.542 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2024-02-10T08:08:51.637 INFO:teuthology.orchestra.run.smithi071.stdout:(2/8): openblas-0.3.15-4.el8.x86_64.rpm 994 kB/s | 4.7 MB 00:04 2024-02-10T08:08:51.734 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2024-02-10T08:08:51.754 INFO:teuthology.orchestra.run.smithi071.stdout:(3/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 974 kB/s | 3.7 MB 00:03 2024-02-10T08:08:51.779 INFO:teuthology.orchestra.run.smithi071.stdout:(4/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 1.6 MB/s | 225 kB 00:00 2024-02-10T08:08:51.847 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-prometheus-alerts-2:16.2.14-521.g0e714d9a.el8.n 4/6 2024-02-10T08:08:52.607 INFO:teuthology.orchestra.run.smithi071.stdout:(5/8): libgfortran-8.5.0-21.el8.x86_64.rpm 780 kB/s | 645 kB 00:00 2024-02-10T08:08:52.981 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-grafana-dashboards-2:16.2.14-521.g0e714d9a.el8. 5/6 2024-02-10T08:08:53.035 INFO:teuthology.orchestra.run.smithi071.stdout:(6/8): libquadmath-8.5.0-21.el8.x86_64.rpm 403 kB/s | 172 kB 00:00 2024-02-10T08:08:53.115 INFO:teuthology.orchestra.run.smithi071.stdout:(7/8): openblas-threads-0.3.15-4.el8.x86_64.rpm 783 kB/s | 4.9 MB 00:06 2024-02-10T08:08:53.328 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mgr-dashboard-2:16.2.14-521.g0e714d9a.el8.noarc 6/6 2024-02-10T08:08:53.891 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.14-521.g0e714d9a.el8.noarc 6/6 2024-02-10T08:08:53.891 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-grafana-dashboards-2:16.2.14-521.g0e714d9a.el8. 1/6 2024-02-10T08:08:53.891 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mgr-dashboard-2:16.2.14-521.g0e714d9a.el8.noarc 2/6 2024-02-10T08:08:53.891 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-prometheus-alerts-2:16.2.14-521.g0e714d9a.el8.n 3/6 2024-02-10T08:08:53.891 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2024-02-10T08:08:53.891 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2024-02-10T08:08:54.291 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2024-02-10T08:08:54.291 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:08:54.291 INFO:teuthology.orchestra.run.smithi018.stdout:Installed: 2024-02-10T08:08:54.291 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-grafana-dashboards-2:16.2.14-521.g0e714d9a.el8.noarch 2024-02-10T08:08:54.291 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-dashboard-2:16.2.14-521.g0e714d9a.el8.noarch 2024-02-10T08:08:54.291 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-prometheus-alerts-2:16.2.14-521.g0e714d9a.el8.noarch 2024-02-10T08:08:54.291 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-02-10T08:08:54.292 INFO:teuthology.orchestra.run.smithi018.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-02-10T08:08:54.292 INFO:teuthology.orchestra.run.smithi018.stdout: python3-routes-2.4.1-12.el8.noarch 2024-02-10T08:08:54.292 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:08:54.292 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-02-10T08:08:54.412 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install ceph-mgr-diskprediction-local 2024-02-10T08:08:55.203 INFO:teuthology.orchestra.run.smithi018.stdout:Last metadata expiration check: 0:01:46 ago on Sat 10 Feb 2024 08:07:09 AM UTC. 2024-02-10T08:08:56.548 INFO:teuthology.orchestra.run.smithi071.stdout:(8/8): python3-scipy-1.0.0-21.module_el8+762+77 3.0 MB/s | 14 MB 00:04 2024-02-10T08:08:56.548 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-02-10T08:08:56.549 INFO:teuthology.orchestra.run.smithi071.stdout:Total 3.6 MB/s | 37 MB 00:10 2024-02-10T08:08:56.782 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-02-10T08:08:56.800 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-02-10T08:08:56.800 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-02-10T08:08:56.821 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-02-10T08:08:56.823 INFO:teuthology.orchestra.run.smithi018.stdout:============================================================================================ 2024-02-10T08:08:56.823 INFO:teuthology.orchestra.run.smithi018.stdout: Package Arch Version Repository Size 2024-02-10T08:08:56.823 INFO:teuthology.orchestra.run.smithi018.stdout:============================================================================================ 2024-02-10T08:08:56.823 INFO:teuthology.orchestra.run.smithi018.stdout:Installing: 2024-02-10T08:08:56.823 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.14-521.g0e714d9a.el8 ceph-noarch 8.6 M 2024-02-10T08:08:56.823 INFO:teuthology.orchestra.run.smithi018.stdout:Installing dependencies: 2024-02-10T08:08:56.823 INFO:teuthology.orchestra.run.smithi018.stdout: libgfortran x86_64 8.5.0-21.el8 baseos 645 k 2024-02-10T08:08:56.823 INFO:teuthology.orchestra.run.smithi018.stdout: libquadmath x86_64 8.5.0-21.el8 baseos 172 k 2024-02-10T08:08:56.823 INFO:teuthology.orchestra.run.smithi018.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2024-02-10T08:08:56.823 INFO:teuthology.orchestra.run.smithi018.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2024-02-10T08:08:56.823 INFO:teuthology.orchestra.run.smithi018.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2024-02-10T08:08:56.824 INFO:teuthology.orchestra.run.smithi018.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2024-02-10T08:08:56.824 INFO:teuthology.orchestra.run.smithi018.stdout: python3-scipy x86_64 1.0.0-21.module_el8+762+77bd8591 appstream 14 M 2024-02-10T08:08:56.824 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:08:56.824 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction Summary 2024-02-10T08:08:56.824 INFO:teuthology.orchestra.run.smithi018.stdout:============================================================================================ 2024-02-10T08:08:56.824 INFO:teuthology.orchestra.run.smithi018.stdout:Install 8 Packages 2024-02-10T08:08:56.824 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:08:56.825 INFO:teuthology.orchestra.run.smithi018.stdout:Total download size: 37 M 2024-02-10T08:08:56.825 INFO:teuthology.orchestra.run.smithi018.stdout:Installed size: 210 M 2024-02-10T08:08:56.825 INFO:teuthology.orchestra.run.smithi018.stdout:Downloading Packages: 2024-02-10T08:08:57.139 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-02-10T08:08:57.142 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-02-10T08:08:57.703 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-02-10T08:08:57.792 INFO:teuthology.orchestra.run.smithi018.stdout:(1/8): ceph-mgr-diskprediction-local-16.2.14-52 12 MB/s | 8.6 MB 00:00 2024-02-10T08:08:57.839 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libquadmath-8.5.0-21.el8.x86_64 1/8 2024-02-10T08:08:57.969 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libquadmath-8.5.0-21.el8.x86_64 1/8 2024-02-10T08:08:58.105 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libgfortran-8.5.0-21.el8.x86_64 2/8 2024-02-10T08:08:58.701 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libgfortran-8.5.0-21.el8.x86_64 2/8 2024-02-10T08:08:58.864 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : openblas-0.3.15-4.el8.x86_64 3/8 2024-02-10T08:08:59.277 INFO:teuthology.orchestra.run.smithi018.stdout:(2/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 2.5 MB/s | 3.7 MB 00:01 2024-02-10T08:08:59.378 INFO:teuthology.orchestra.run.smithi018.stdout:(3/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 2.2 MB/s | 225 kB 00:00 2024-02-10T08:08:59.478 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 3/8 2024-02-10T08:08:59.660 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 4/8 2024-02-10T08:09:00.353 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 4/8 2024-02-10T08:09:00.691 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2024-02-10T08:09:00.736 INFO:teuthology.orchestra.run.smithi018.stdout:(4/8): openblas-threads-0.3.15-4.el8.x86_64.rpm 1.3 MB/s | 4.9 MB 00:03 2024-02-10T08:09:00.979 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2024-02-10T08:09:01.045 INFO:teuthology.orchestra.run.smithi018.stdout:(5/8): libgfortran-8.5.0-21.el8.x86_64.rpm 2.0 MB/s | 645 kB 00:00 2024-02-10T08:09:01.137 INFO:teuthology.orchestra.run.smithi018.stdout:(6/8): libquadmath-8.5.0-21.el8.x86_64.rpm 1.8 MB/s | 172 kB 00:00 2024-02-10T08:09:01.254 INFO:teuthology.orchestra.run.smithi018.stdout:(7/8): openblas-0.3.15-4.el8.x86_64.rpm 1.1 MB/s | 4.7 MB 00:04 2024-02-10T08:09:02.154 INFO:teuthology.orchestra.run.smithi018.stdout:(8/8): python3-scipy-1.0.0-21.module_el8+762+77 5.1 MB/s | 14 MB 00:02 2024-02-10T08:09:02.155 INFO:teuthology.orchestra.run.smithi018.stdout:-------------------------------------------------------------------------------- 2024-02-10T08:09:02.155 INFO:teuthology.orchestra.run.smithi018.stdout:Total 7.0 MB/s | 37 MB 00:05 2024-02-10T08:09:02.397 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction check 2024-02-10T08:09:02.417 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction check succeeded. 2024-02-10T08:09:02.417 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction test 2024-02-10T08:09:02.723 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2024-02-10T08:09:02.769 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction test succeeded. 2024-02-10T08:09:02.772 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction 2024-02-10T08:09:03.387 INFO:teuthology.orchestra.run.smithi018.stdout: Preparing : 1/1 2024-02-10T08:09:03.513 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libquadmath-8.5.0-21.el8.x86_64 1/8 2024-02-10T08:09:03.645 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: libquadmath-8.5.0-21.el8.x86_64 1/8 2024-02-10T08:09:03.796 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libgfortran-8.5.0-21.el8.x86_64 2/8 2024-02-10T08:09:04.001 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_6 7/8 2024-02-10T08:09:04.163 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.14-521.g0e714d9 8/8 2024-02-10T08:09:04.426 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: libgfortran-8.5.0-21.el8.x86_64 2/8 2024-02-10T08:09:04.460 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.14-521.g0e714d9 8/8 2024-02-10T08:09:04.460 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.14-521.g0e714d9 1/8 2024-02-10T08:09:04.460 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 2/8 2024-02-10T08:09:04.460 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 3/8 2024-02-10T08:09:04.460 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 4/8 2024-02-10T08:09:04.461 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 5/8 2024-02-10T08:09:04.461 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_6 6/8 2024-02-10T08:09:04.461 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libgfortran-8.5.0-21.el8.x86_64 7/8 2024-02-10T08:09:04.762 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : openblas-0.3.15-4.el8.x86_64 3/8 2024-02-10T08:09:04.847 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libquadmath-8.5.0-21.el8.x86_64 8/8 2024-02-10T08:09:04.847 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-02-10T08:09:04.847 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-02-10T08:09:04.848 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-diskprediction-local-2:16.2.14-521.g0e714d9a.el8.noarch 2024-02-10T08:09:04.848 INFO:teuthology.orchestra.run.smithi071.stdout: libgfortran-8.5.0-21.el8.x86_64 2024-02-10T08:09:04.848 INFO:teuthology.orchestra.run.smithi071.stdout: libquadmath-8.5.0-21.el8.x86_64 2024-02-10T08:09:04.848 INFO:teuthology.orchestra.run.smithi071.stdout: openblas-0.3.15-4.el8.x86_64 2024-02-10T08:09:04.848 INFO:teuthology.orchestra.run.smithi071.stdout: openblas-threads-0.3.15-4.el8.x86_64 2024-02-10T08:09:04.848 INFO:teuthology.orchestra.run.smithi071.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-02-10T08:09:04.848 INFO:teuthology.orchestra.run.smithi071.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-02-10T08:09:04.848 INFO:teuthology.orchestra.run.smithi071.stdout: python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_64 2024-02-10T08:09:04.848 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-02-10T08:09:04.848 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-02-10T08:09:04.971 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-mgr-rook 2024-02-10T08:09:05.450 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 3/8 2024-02-10T08:09:05.649 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 4/8 2024-02-10T08:09:05.716 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:55 ago on Sat 10 Feb 2024 08:07:10 AM UTC. 2024-02-10T08:09:06.387 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 4/8 2024-02-10T08:09:06.712 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2024-02-10T08:09:06.937 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2024-02-10T08:09:07.213 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-02-10T08:09:07.215 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-02-10T08:09:07.215 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2024-02-10T08:09:07.215 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-02-10T08:09:07.215 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-02-10T08:09:07.215 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-rook noarch 2:16.2.14-521.g0e714d9a.el8 ceph-noarch 27 k 2024-02-10T08:09:07.215 INFO:teuthology.orchestra.run.smithi071.stdout:Installing dependencies: 2024-02-10T08:09:07.215 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-02-10T08:09:07.215 INFO:teuthology.orchestra.run.smithi071.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-02-10T08:09:07.215 INFO:teuthology.orchestra.run.smithi071.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-02-10T08:09:07.216 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2024-02-10T08:09:07.216 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2024-02-10T08:09:07.216 INFO:teuthology.orchestra.run.smithi071.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-02-10T08:09:07.216 INFO:teuthology.orchestra.run.smithi071.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2024-02-10T08:09:07.216 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2024-02-10T08:09:07.216 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2024-02-10T08:09:07.216 INFO:teuthology.orchestra.run.smithi071.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2024-02-10T08:09:07.216 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-02-10T08:09:07.216 INFO:teuthology.orchestra.run.smithi071.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-02-10T08:09:07.216 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-02-10T08:09:07.216 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-02-10T08:09:07.217 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-02-10T08:09:07.217 INFO:teuthology.orchestra.run.smithi071.stdout:Install 13 Packages 2024-02-10T08:09:07.217 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-02-10T08:09:07.217 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 1.9 M 2024-02-10T08:09:07.217 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 24 M 2024-02-10T08:09:07.217 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-02-10T08:09:08.813 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2024-02-10T08:09:10.202 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_6 7/8 2024-02-10T08:09:10.387 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.14-521.g0e714d9 8/8 2024-02-10T08:09:10.754 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.14-521.g0e714d9 8/8 2024-02-10T08:09:10.754 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.14-521.g0e714d9 1/8 2024-02-10T08:09:10.755 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 2/8 2024-02-10T08:09:10.755 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 3/8 2024-02-10T08:09:10.755 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 4/8 2024-02-10T08:09:10.755 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 5/8 2024-02-10T08:09:10.755 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_6 6/8 2024-02-10T08:09:10.755 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libgfortran-8.5.0-21.el8.x86_64 7/8 2024-02-10T08:09:11.186 INFO:teuthology.orchestra.run.smithi071.stdout:(1/13): ceph-mgr-rook-16.2.14-521.g0e714d9a.el8 160 kB/s | 27 kB 00:00 2024-02-10T08:09:11.204 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libquadmath-8.5.0-21.el8.x86_64 8/8 2024-02-10T08:09:11.204 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:09:11.204 INFO:teuthology.orchestra.run.smithi018.stdout:Installed: 2024-02-10T08:09:11.204 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-diskprediction-local-2:16.2.14-521.g0e714d9a.el8.noarch 2024-02-10T08:09:11.204 INFO:teuthology.orchestra.run.smithi018.stdout: libgfortran-8.5.0-21.el8.x86_64 2024-02-10T08:09:11.204 INFO:teuthology.orchestra.run.smithi018.stdout: libquadmath-8.5.0-21.el8.x86_64 2024-02-10T08:09:11.204 INFO:teuthology.orchestra.run.smithi018.stdout: openblas-0.3.15-4.el8.x86_64 2024-02-10T08:09:11.204 INFO:teuthology.orchestra.run.smithi018.stdout: openblas-threads-0.3.15-4.el8.x86_64 2024-02-10T08:09:11.204 INFO:teuthology.orchestra.run.smithi018.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-02-10T08:09:11.204 INFO:teuthology.orchestra.run.smithi018.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-02-10T08:09:11.205 INFO:teuthology.orchestra.run.smithi018.stdout: python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_64 2024-02-10T08:09:11.205 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:09:11.205 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-02-10T08:09:11.338 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install ceph-mgr-rook 2024-02-10T08:09:11.427 INFO:teuthology.orchestra.run.smithi071.stdout:(2/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 64 kB/s | 27 kB 00:00 2024-02-10T08:09:11.453 INFO:teuthology.orchestra.run.smithi071.stdout:(3/13): python3-jsonpointer-1.10-11.el8.noarch. 46 kB/s | 20 kB 00:00 2024-02-10T08:09:11.553 INFO:teuthology.orchestra.run.smithi071.stdout:(4/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 344 kB/s | 126 kB 00:00 2024-02-10T08:09:11.578 INFO:teuthology.orchestra.run.smithi071.stdout:(5/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 1.2 MB/s | 155 kB 00:00 2024-02-10T08:09:11.620 INFO:teuthology.orchestra.run.smithi071.stdout:(6/13): python3-requests-oauthlib-1.0.0-1.el8.n 638 kB/s | 43 kB 00:00 2024-02-10T08:09:11.662 INFO:teuthology.orchestra.run.smithi071.stdout:(7/13): python3-pyasn1-modules-0.3.7-6.el8.noar 469 kB/s | 110 kB 00:00 2024-02-10T08:09:11.713 INFO:teuthology.orchestra.run.smithi071.stdout:(8/13): python3-cachetools-3.1.1-4.el8.noarch.r 246 kB/s | 33 kB 00:00 2024-02-10T08:09:11.738 INFO:teuthology.orchestra.run.smithi071.stdout:(9/13): python3-certifi-2018.10.15-7.el8.noarch 139 kB/s | 16 kB 00:00 2024-02-10T08:09:11.821 INFO:teuthology.orchestra.run.smithi071.stdout:(10/13): python3-google-auth-1.1.1-10.el8.noarc 512 kB/s | 81 kB 00:00 2024-02-10T08:09:11.847 INFO:teuthology.orchestra.run.smithi071.stdout:(11/13): python3-rsa-4.9-2.el8.noarch.rpm 592 kB/s | 64 kB 00:00 2024-02-10T08:09:11.891 INFO:teuthology.orchestra.run.smithi071.stdout:(12/13): python3-websocket-client-0.56.0-5.el8. 915 kB/s | 61 kB 00:00 2024-02-10T08:09:11.939 INFO:teuthology.orchestra.run.smithi071.stdout:(13/13): python3-kubernetes-11.0.0-6.el8.noarch 5.2 MB/s | 1.2 MB 00:00 2024-02-10T08:09:11.940 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-02-10T08:09:11.940 INFO:teuthology.orchestra.run.smithi071.stdout:Total 414 kB/s | 1.9 MB 00:04 2024-02-10T08:09:11.997 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-02-10T08:09:12.013 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-02-10T08:09:12.014 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-02-10T08:09:12.101 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-02-10T08:09:12.104 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-02-10T08:09:12.122 INFO:teuthology.orchestra.run.smithi018.stdout:Last metadata expiration check: 0:02:03 ago on Sat 10 Feb 2024 08:07:09 AM UTC. 2024-02-10T08:09:12.657 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-02-10T08:09:12.896 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2024-02-10T08:09:13.127 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2024-02-10T08:09:13.354 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-rsa-4.9-2.el8.noarch 3/13 2024-02-10T08:09:13.575 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2024-02-10T08:09:13.757 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-02-10T08:09:13.759 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-02-10T08:09:13.759 INFO:teuthology.orchestra.run.smithi018.stdout: Package Arch Version Repository Size 2024-02-10T08:09:13.759 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-02-10T08:09:13.759 INFO:teuthology.orchestra.run.smithi018.stdout:Installing: 2024-02-10T08:09:13.759 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-rook noarch 2:16.2.14-521.g0e714d9a.el8 ceph-noarch 27 k 2024-02-10T08:09:13.759 INFO:teuthology.orchestra.run.smithi018.stdout:Installing dependencies: 2024-02-10T08:09:13.759 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-02-10T08:09:13.759 INFO:teuthology.orchestra.run.smithi018.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-02-10T08:09:13.759 INFO:teuthology.orchestra.run.smithi018.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-02-10T08:09:13.760 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2024-02-10T08:09:13.760 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2024-02-10T08:09:13.760 INFO:teuthology.orchestra.run.smithi018.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-02-10T08:09:13.760 INFO:teuthology.orchestra.run.smithi018.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2024-02-10T08:09:13.760 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2024-02-10T08:09:13.760 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2024-02-10T08:09:13.760 INFO:teuthology.orchestra.run.smithi018.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2024-02-10T08:09:13.760 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-02-10T08:09:13.760 INFO:teuthology.orchestra.run.smithi018.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-02-10T08:09:13.760 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:09:13.760 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction Summary 2024-02-10T08:09:13.760 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-02-10T08:09:13.760 INFO:teuthology.orchestra.run.smithi018.stdout:Install 13 Packages 2024-02-10T08:09:13.760 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:09:13.761 INFO:teuthology.orchestra.run.smithi018.stdout:Total download size: 1.9 M 2024-02-10T08:09:13.761 INFO:teuthology.orchestra.run.smithi018.stdout:Installed size: 24 M 2024-02-10T08:09:13.761 INFO:teuthology.orchestra.run.smithi018.stdout:Downloading Packages: 2024-02-10T08:09:14.395 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2024-02-10T08:09:14.494 INFO:teuthology.orchestra.run.smithi018.stdout:(1/13): ceph-mgr-rook-16.2.14-521.g0e714d9a.el8 115 kB/s | 27 kB 00:00 2024-02-10T08:09:14.527 INFO:teuthology.orchestra.run.smithi018.stdout:(2/13): python3-jsonpointer-1.10-11.el8.noarch. 73 kB/s | 20 kB 00:00 2024-02-10T08:09:14.552 INFO:teuthology.orchestra.run.smithi018.stdout:(3/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 89 kB/s | 27 kB 00:00 2024-02-10T08:09:14.659 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2024-02-10T08:09:14.811 INFO:teuthology.orchestra.run.smithi018.stdout:(4/13): python3-pyasn1-modules-0.3.7-6.el8.noar 388 kB/s | 110 kB 00:00 2024-02-10T08:09:14.837 INFO:teuthology.orchestra.run.smithi018.stdout:(5/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 546 kB/s | 155 kB 00:00 2024-02-10T08:09:14.937 INFO:teuthology.orchestra.run.smithi018.stdout:(6/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 285 kB/s | 126 kB 00:00 2024-02-10T08:09:14.944 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2024-02-10T08:09:15.190 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2024-02-10T08:09:15.304 INFO:teuthology.orchestra.run.smithi018.stdout:(7/13): python3-cachetools-3.1.1-4.el8.noarch.r 71 kB/s | 33 kB 00:00 2024-02-10T08:09:15.421 INFO:teuthology.orchestra.run.smithi018.stdout:(8/13): python3-certifi-2018.10.15-7.el8.noarch 34 kB/s | 16 kB 00:00 2024-02-10T08:09:15.521 INFO:teuthology.orchestra.run.smithi018.stdout:(9/13): python3-google-auth-1.1.1-10.el8.noarch 374 kB/s | 81 kB 00:00 2024-02-10T08:09:15.546 INFO:teuthology.orchestra.run.smithi018.stdout:(10/13): python3-requests-oauthlib-1.0.0-1.el8. 58 kB/s | 43 kB 00:00 2024-02-10T08:09:15.772 INFO:teuthology.orchestra.run.smithi018.stdout:(11/13): python3-rsa-4.9-2.el8.noarch.rpm 256 kB/s | 64 kB 00:00 2024-02-10T08:09:16.197 INFO:teuthology.orchestra.run.smithi018.stdout:(12/13): python3-websocket-client-0.56.0-5.el8. 94 kB/s | 61 kB 00:00 2024-02-10T08:09:16.235 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2024-02-10T08:09:16.500 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2024-02-10T08:09:16.733 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2024-02-10T08:09:16.934 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2024-02-10T08:09:17.101 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-rook-2:16.2.14-521.g0e714d9a.el8.noarch 13/13 2024-02-10T08:09:17.389 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.14-521.g0e714d9a.el8.noarch 13/13 2024-02-10T08:09:17.389 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-rook-2:16.2.14-521.g0e714d9a.el8.noarch 1/13 2024-02-10T08:09:17.389 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2024-02-10T08:09:17.389 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2024-02-10T08:09:17.389 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2024-02-10T08:09:17.389 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2024-02-10T08:09:17.389 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2024-02-10T08:09:17.389 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2024-02-10T08:09:17.389 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2024-02-10T08:09:17.390 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2024-02-10T08:09:17.390 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2024-02-10T08:09:17.390 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2024-02-10T08:09:17.390 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 12/13 2024-02-10T08:09:17.647 INFO:teuthology.orchestra.run.smithi018.stdout:(13/13): python3-kubernetes-11.0.0-6.el8.noarch 536 kB/s | 1.2 MB 00:02 2024-02-10T08:09:17.650 INFO:teuthology.orchestra.run.smithi018.stdout:-------------------------------------------------------------------------------- 2024-02-10T08:09:17.651 INFO:teuthology.orchestra.run.smithi018.stdout:Total 503 kB/s | 1.9 MB 00:03 2024-02-10T08:09:17.710 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction check 2024-02-10T08:09:17.727 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction check succeeded. 2024-02-10T08:09:17.727 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction test 2024-02-10T08:09:17.823 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction test succeeded. 2024-02-10T08:09:17.826 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction 2024-02-10T08:09:17.872 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2024-02-10T08:09:17.872 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-02-10T08:09:17.872 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-02-10T08:09:17.872 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-rook-2:16.2.14-521.g0e714d9a.el8.noarch 2024-02-10T08:09:17.872 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-02-10T08:09:17.872 INFO:teuthology.orchestra.run.smithi071.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-02-10T08:09:17.872 INFO:teuthology.orchestra.run.smithi071.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-02-10T08:09:17.872 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-02-10T08:09:17.873 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-02-10T08:09:17.873 INFO:teuthology.orchestra.run.smithi071.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-02-10T08:09:17.873 INFO:teuthology.orchestra.run.smithi071.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-02-10T08:09:17.873 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-02-10T08:09:17.873 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-02-10T08:09:17.873 INFO:teuthology.orchestra.run.smithi071.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-02-10T08:09:17.873 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rsa-4.9-2.el8.noarch 2024-02-10T08:09:17.873 INFO:teuthology.orchestra.run.smithi071.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-02-10T08:09:17.873 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-02-10T08:09:17.873 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-02-10T08:09:17.985 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-mgr-cephadm 2024-02-10T08:09:18.443 INFO:teuthology.orchestra.run.smithi018.stdout: Preparing : 1/1 2024-02-10T08:09:18.665 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2024-02-10T08:09:18.733 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:02:08 ago on Sat 10 Feb 2024 08:07:10 AM UTC. 2024-02-10T08:09:18.887 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2024-02-10T08:09:19.089 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-rsa-4.9-2.el8.noarch 3/13 2024-02-10T08:09:19.317 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2024-02-10T08:09:19.543 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2024-02-10T08:09:19.803 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2024-02-10T08:09:20.124 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2024-02-10T08:09:20.219 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-02-10T08:09:20.220 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-02-10T08:09:20.220 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2024-02-10T08:09:20.220 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-02-10T08:09:20.220 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-02-10T08:09:20.220 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-cephadm noarch 2:16.2.14-521.g0e714d9a.el8 ceph-noarch 116 k 2024-02-10T08:09:20.220 INFO:teuthology.orchestra.run.smithi071.stdout:Installing dependencies: 2024-02-10T08:09:20.220 INFO:teuthology.orchestra.run.smithi071.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2024-02-10T08:09:20.221 INFO:teuthology.orchestra.run.smithi071.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2024-02-10T08:09:20.221 INFO:teuthology.orchestra.run.smithi071.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2024-02-10T08:09:20.221 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2024-02-10T08:09:20.221 INFO:teuthology.orchestra.run.smithi071.stdout: python3-remoto noarch 1.2.1-1.el8 epel 49 k 2024-02-10T08:09:20.221 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-02-10T08:09:20.221 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-02-10T08:09:20.221 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-02-10T08:09:20.221 INFO:teuthology.orchestra.run.smithi071.stdout:Install 6 Packages 2024-02-10T08:09:20.221 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-02-10T08:09:20.222 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 5.8 M 2024-02-10T08:09:20.222 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 24 M 2024-02-10T08:09:20.222 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-02-10T08:09:20.392 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2024-02-10T08:09:21.081 INFO:teuthology.orchestra.run.smithi071.stdout:(1/6): ceph-mgr-cephadm-16.2.14-521.g0e714d9a.e 365 kB/s | 116 kB 00:00 2024-02-10T08:09:21.239 INFO:teuthology.orchestra.run.smithi071.stdout:(2/6): python3-apipkg-1.5-6.el8.noarch.rpm 134 kB/s | 21 kB 00:00 2024-02-10T08:09:21.365 INFO:teuthology.orchestra.run.smithi071.stdout:(3/6): python3-execnet-1.7.1-1.el8.noarch.rpm 2.8 MB/s | 355 kB 00:00 2024-02-10T08:09:21.440 INFO:teuthology.orchestra.run.smithi071.stdout:(4/6): python3-remoto-1.2.1-1.el8.noarch.rpm 650 kB/s | 49 kB 00:00 2024-02-10T08:09:21.479 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2024-02-10T08:09:21.734 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2024-02-10T08:09:21.976 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2024-02-10T08:09:22.168 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2024-02-10T08:09:22.351 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mgr-rook-2:16.2.14-521.g0e714d9a.el8.noarch 13/13 2024-02-10T08:09:22.557 INFO:teuthology.orchestra.run.smithi071.stdout:(5/6): python3-jinja2-2.10.1-3.el8.noarch.rpm 300 kB/s | 538 kB 00:01 2024-02-10T08:09:22.674 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.14-521.g0e714d9a.el8.noarch 13/13 2024-02-10T08:09:22.674 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mgr-rook-2:16.2.14-521.g0e714d9a.el8.noarch 1/13 2024-02-10T08:09:22.674 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2024-02-10T08:09:22.674 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2024-02-10T08:09:22.674 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2024-02-10T08:09:22.674 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2024-02-10T08:09:22.674 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2024-02-10T08:09:22.674 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2024-02-10T08:09:22.675 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2024-02-10T08:09:22.675 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2024-02-10T08:09:22.675 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2024-02-10T08:09:22.675 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2024-02-10T08:09:22.675 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 12/13 2024-02-10T08:09:23.159 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2024-02-10T08:09:23.159 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:09:23.160 INFO:teuthology.orchestra.run.smithi018.stdout:Installed: 2024-02-10T08:09:23.160 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-rook-2:16.2.14-521.g0e714d9a.el8.noarch 2024-02-10T08:09:23.160 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-02-10T08:09:23.160 INFO:teuthology.orchestra.run.smithi018.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-02-10T08:09:23.160 INFO:teuthology.orchestra.run.smithi018.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-02-10T08:09:23.160 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-02-10T08:09:23.160 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-02-10T08:09:23.160 INFO:teuthology.orchestra.run.smithi018.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-02-10T08:09:23.160 INFO:teuthology.orchestra.run.smithi018.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-02-10T08:09:23.160 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-02-10T08:09:23.160 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-02-10T08:09:23.160 INFO:teuthology.orchestra.run.smithi018.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-02-10T08:09:23.160 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rsa-4.9-2.el8.noarch 2024-02-10T08:09:23.161 INFO:teuthology.orchestra.run.smithi018.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-02-10T08:09:23.161 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:09:23.161 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-02-10T08:09:23.272 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install ceph-mgr-cephadm 2024-02-10T08:09:23.457 INFO:teuthology.orchestra.run.smithi071.stdout:(6/6): python3-babel-2.5.1-7.el8.noarch.rpm 1.8 MB/s | 4.8 MB 00:02 2024-02-10T08:09:23.459 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-02-10T08:09:23.459 INFO:teuthology.orchestra.run.smithi071.stdout:Total 1.8 MB/s | 5.8 MB 00:03 2024-02-10T08:09:23.512 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-02-10T08:09:23.522 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-02-10T08:09:23.522 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-02-10T08:09:23.627 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-02-10T08:09:23.630 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-02-10T08:09:23.898 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-02-10T08:09:24.066 INFO:teuthology.orchestra.run.smithi018.stdout:Last metadata expiration check: 0:02:15 ago on Sat 10 Feb 2024 08:07:09 AM UTC. 2024-02-10T08:09:24.133 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 1/6 2024-02-10T08:09:24.419 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 2/6 2024-02-10T08:09:25.353 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-remoto-1.2.1-1.el8.noarch 3/6 2024-02-10T08:09:25.696 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 4/6 2024-02-10T08:09:25.696 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-02-10T08:09:25.698 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-02-10T08:09:25.698 INFO:teuthology.orchestra.run.smithi018.stdout: Package Arch Version Repository Size 2024-02-10T08:09:25.698 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-02-10T08:09:25.698 INFO:teuthology.orchestra.run.smithi018.stdout:Installing: 2024-02-10T08:09:25.698 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-cephadm noarch 2:16.2.14-521.g0e714d9a.el8 ceph-noarch 116 k 2024-02-10T08:09:25.698 INFO:teuthology.orchestra.run.smithi018.stdout:Installing dependencies: 2024-02-10T08:09:25.698 INFO:teuthology.orchestra.run.smithi018.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2024-02-10T08:09:25.698 INFO:teuthology.orchestra.run.smithi018.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2024-02-10T08:09:25.698 INFO:teuthology.orchestra.run.smithi018.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2024-02-10T08:09:25.698 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2024-02-10T08:09:25.698 INFO:teuthology.orchestra.run.smithi018.stdout: python3-remoto noarch 1.2.1-1.el8 epel 49 k 2024-02-10T08:09:25.698 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:09:25.698 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction Summary 2024-02-10T08:09:25.699 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-02-10T08:09:25.699 INFO:teuthology.orchestra.run.smithi018.stdout:Install 6 Packages 2024-02-10T08:09:25.699 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:09:25.699 INFO:teuthology.orchestra.run.smithi018.stdout:Total download size: 5.8 M 2024-02-10T08:09:25.699 INFO:teuthology.orchestra.run.smithi018.stdout:Installed size: 24 M 2024-02-10T08:09:25.699 INFO:teuthology.orchestra.run.smithi018.stdout:Downloading Packages: 2024-02-10T08:09:25.940 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 5/6 2024-02-10T08:09:26.033 INFO:teuthology.orchestra.run.smithi018.stdout:(1/6): ceph-mgr-cephadm-16.2.14-521.g0e714d9a.e 499 kB/s | 116 kB 00:00 2024-02-10T08:09:26.115 INFO:teuthology.orchestra.run.smithi018.stdout:(2/6): python3-apipkg-1.5-6.el8.noarch.rpm 259 kB/s | 21 kB 00:00 2024-02-10T08:09:26.133 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-cephadm-2:16.2.14-521.g0e714d9a.el8.noarch 6/6 2024-02-10T08:09:26.265 INFO:teuthology.orchestra.run.smithi018.stdout:(3/6): python3-execnet-1.7.1-1.el8.noarch.rpm 2.3 MB/s | 355 kB 00:00 2024-02-10T08:09:26.307 INFO:teuthology.orchestra.run.smithi018.stdout:(4/6): python3-remoto-1.2.1-1.el8.noarch.rpm 1.1 MB/s | 49 kB 00:00 2024-02-10T08:09:26.420 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.2.14-521.g0e714d9a.el8.noarch 6/6 2024-02-10T08:09:26.421 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-cephadm-2:16.2.14-521.g0e714d9a.el8.noarch 1/6 2024-02-10T08:09:26.421 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 2/6 2024-02-10T08:09:26.421 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 3/6 2024-02-10T08:09:26.421 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 4/6 2024-02-10T08:09:26.421 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 5/6 2024-02-10T08:09:26.683 INFO:teuthology.orchestra.run.smithi018.stdout:(5/6): python3-jinja2-2.10.1-3.el8.noarch.rpm 610 kB/s | 538 kB 00:00 2024-02-10T08:09:26.802 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-remoto-1.2.1-1.el8.noarch 6/6 2024-02-10T08:09:26.803 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-02-10T08:09:26.803 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-02-10T08:09:26.803 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-cephadm-2:16.2.14-521.g0e714d9a.el8.noarch 2024-02-10T08:09:26.803 INFO:teuthology.orchestra.run.smithi071.stdout: python3-apipkg-1.5-6.el8.noarch 2024-02-10T08:09:26.803 INFO:teuthology.orchestra.run.smithi071.stdout: python3-babel-2.5.1-7.el8.noarch 2024-02-10T08:09:26.803 INFO:teuthology.orchestra.run.smithi071.stdout: python3-execnet-1.7.1-1.el8.noarch 2024-02-10T08:09:26.803 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jinja2-2.10.1-3.el8.noarch 2024-02-10T08:09:26.803 INFO:teuthology.orchestra.run.smithi071.stdout: python3-remoto-1.2.1-1.el8.noarch 2024-02-10T08:09:26.803 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-02-10T08:09:26.803 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-02-10T08:09:26.943 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-fuse 2024-02-10T08:09:27.699 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:02:17 ago on Sat 10 Feb 2024 08:07:10 AM UTC. 2024-02-10T08:09:29.205 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-02-10T08:09:29.205 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-02-10T08:09:29.205 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2024-02-10T08:09:29.205 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-02-10T08:09:29.206 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-02-10T08:09:29.206 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-fuse x86_64 2:16.2.14-521.g0e714d9a.el8 ceph 911 k 2024-02-10T08:09:29.206 INFO:teuthology.orchestra.run.smithi071.stdout:Installing dependencies: 2024-02-10T08:09:29.206 INFO:teuthology.orchestra.run.smithi071.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2024-02-10T08:09:29.206 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-02-10T08:09:29.206 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-02-10T08:09:29.206 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-02-10T08:09:29.206 INFO:teuthology.orchestra.run.smithi071.stdout:Install 2 Packages 2024-02-10T08:09:29.206 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-02-10T08:09:29.207 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 994 k 2024-02-10T08:09:29.207 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 2.8 M 2024-02-10T08:09:29.207 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-02-10T08:09:29.357 INFO:teuthology.orchestra.run.smithi071.stdout:(1/2): fuse-2.9.7-17.el8.x86_64.rpm 774 kB/s | 83 kB 00:00 2024-02-10T08:09:29.557 INFO:teuthology.orchestra.run.smithi071.stdout:(2/2): ceph-fuse-16.2.14-521.g0e714d9a.el8.x86_ 2.9 MB/s | 911 kB 00:00 2024-02-10T08:09:29.557 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-02-10T08:09:29.558 INFO:teuthology.orchestra.run.smithi071.stdout:Total 2.8 MB/s | 994 kB 00:00 2024-02-10T08:09:29.567 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-02-10T08:09:29.588 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-02-10T08:09:29.588 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-02-10T08:09:29.673 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-02-10T08:09:29.676 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-02-10T08:09:29.854 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-02-10T08:09:30.615 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : fuse-2.9.7-17.el8.x86_64 1/2 2024-02-10T08:09:30.641 INFO:teuthology.orchestra.run.smithi018.stdout:(6/6): python3-babel-2.5.1-7.el8.noarch.rpm 1.0 MB/s | 4.8 MB 00:04 2024-02-10T08:09:30.642 INFO:teuthology.orchestra.run.smithi018.stdout:-------------------------------------------------------------------------------- 2024-02-10T08:09:30.642 INFO:teuthology.orchestra.run.smithi018.stdout:Total 1.2 MB/s | 5.8 MB 00:04 2024-02-10T08:09:30.697 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction check 2024-02-10T08:09:30.708 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction check succeeded. 2024-02-10T08:09:30.708 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction test 2024-02-10T08:09:30.932 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction test succeeded. 2024-02-10T08:09:30.934 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction 2024-02-10T08:09:31.356 INFO:teuthology.orchestra.run.smithi018.stdout: Preparing : 1/1 2024-02-10T08:09:31.482 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-fuse-2:16.2.14-521.g0e714d9a.el8.x86_64 2/2 2024-02-10T08:09:31.654 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 1/6 2024-02-10T08:09:31.883 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-fuse-2:16.2.14-521.g0e714d9a.el8.x86_64 2/2 2024-02-10T08:09:31.883 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-fuse-2:16.2.14-521.g0e714d9a.el8.x86_64 1/2 2024-02-10T08:09:32.089 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 2/6 2024-02-10T08:09:32.258 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 2/2 2024-02-10T08:09:32.258 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-02-10T08:09:32.258 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-02-10T08:09:32.258 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-fuse-2:16.2.14-521.g0e714d9a.el8.x86_64 fuse-2.9.7-17.el8.x86_64 2024-02-10T08:09:32.258 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-02-10T08:09:32.258 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-02-10T08:09:32.521 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install librados-devel 2024-02-10T08:09:33.051 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-remoto-1.2.1-1.el8.noarch 3/6 2024-02-10T08:09:33.282 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:02:23 ago on Sat 10 Feb 2024 08:07:10 AM UTC. 2024-02-10T08:09:33.394 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 4/6 2024-02-10T08:09:33.659 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 5/6 2024-02-10T08:09:33.874 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mgr-cephadm-2:16.2.14-521.g0e714d9a.el8.noarch 6/6 2024-02-10T08:09:34.182 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.2.14-521.g0e714d9a.el8.noarch 6/6 2024-02-10T08:09:34.182 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mgr-cephadm-2:16.2.14-521.g0e714d9a.el8.noarch 1/6 2024-02-10T08:09:34.182 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 2/6 2024-02-10T08:09:34.182 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 3/6 2024-02-10T08:09:34.183 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 4/6 2024-02-10T08:09:34.183 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 5/6 2024-02-10T08:09:34.590 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-remoto-1.2.1-1.el8.noarch 6/6 2024-02-10T08:09:34.591 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:09:34.591 INFO:teuthology.orchestra.run.smithi018.stdout:Installed: 2024-02-10T08:09:34.591 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-cephadm-2:16.2.14-521.g0e714d9a.el8.noarch 2024-02-10T08:09:34.591 INFO:teuthology.orchestra.run.smithi018.stdout: python3-apipkg-1.5-6.el8.noarch 2024-02-10T08:09:34.591 INFO:teuthology.orchestra.run.smithi018.stdout: python3-babel-2.5.1-7.el8.noarch 2024-02-10T08:09:34.591 INFO:teuthology.orchestra.run.smithi018.stdout: python3-execnet-1.7.1-1.el8.noarch 2024-02-10T08:09:34.591 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jinja2-2.10.1-3.el8.noarch 2024-02-10T08:09:34.591 INFO:teuthology.orchestra.run.smithi018.stdout: python3-remoto-1.2.1-1.el8.noarch 2024-02-10T08:09:34.591 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:09:34.591 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-02-10T08:09:34.733 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install ceph-fuse 2024-02-10T08:09:34.794 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-02-10T08:09:34.795 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-02-10T08:09:34.795 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repo Size 2024-02-10T08:09:34.795 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-02-10T08:09:34.795 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-02-10T08:09:34.795 INFO:teuthology.orchestra.run.smithi071.stdout: librados-devel x86_64 2:16.2.14-521.g0e714d9a.el8 ceph 131 k 2024-02-10T08:09:34.795 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-02-10T08:09:34.795 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-02-10T08:09:34.795 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-02-10T08:09:34.795 INFO:teuthology.orchestra.run.smithi071.stdout:Install 1 Package 2024-02-10T08:09:34.795 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-02-10T08:09:34.796 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 131 k 2024-02-10T08:09:34.796 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 432 k 2024-02-10T08:09:34.796 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-02-10T08:09:35.029 INFO:teuthology.orchestra.run.smithi071.stdout:librados-devel-16.2.14-521.g0e714d9a.el8.x86_64 563 kB/s | 131 kB 00:00 2024-02-10T08:09:35.030 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-02-10T08:09:35.030 INFO:teuthology.orchestra.run.smithi071.stdout:Total 559 kB/s | 131 kB 00:00 2024-02-10T08:09:35.030 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-02-10T08:09:35.036 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-02-10T08:09:35.036 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-02-10T08:09:35.088 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-02-10T08:09:35.091 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-02-10T08:09:35.214 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-02-10T08:09:35.430 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : librados-devel-2:16.2.14-521.g0e714d9a.el8.x86_64 1/1 2024-02-10T08:09:35.523 INFO:teuthology.orchestra.run.smithi018.stdout:Last metadata expiration check: 0:02:26 ago on Sat 10 Feb 2024 08:07:09 AM UTC. 2024-02-10T08:09:35.720 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librados-devel-2:16.2.14-521.g0e714d9a.el8.x86_64 1/1 2024-02-10T08:09:36.069 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librados-devel-2:16.2.14-521.g0e714d9a.el8.x86_64 1/1 2024-02-10T08:09:36.069 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-02-10T08:09:36.069 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-02-10T08:09:36.069 INFO:teuthology.orchestra.run.smithi071.stdout: librados-devel-2:16.2.14-521.g0e714d9a.el8.x86_64 2024-02-10T08:09:36.069 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-02-10T08:09:36.069 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-02-10T08:09:36.274 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install libcephfs2 2024-02-10T08:09:37.030 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:02:27 ago on Sat 10 Feb 2024 08:07:10 AM UTC. 2024-02-10T08:09:37.158 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-02-10T08:09:37.159 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-02-10T08:09:37.159 INFO:teuthology.orchestra.run.smithi018.stdout: Package Arch Version Repository Size 2024-02-10T08:09:37.159 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-02-10T08:09:37.159 INFO:teuthology.orchestra.run.smithi018.stdout:Installing: 2024-02-10T08:09:37.159 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-fuse x86_64 2:16.2.14-521.g0e714d9a.el8 ceph 911 k 2024-02-10T08:09:37.159 INFO:teuthology.orchestra.run.smithi018.stdout:Installing dependencies: 2024-02-10T08:09:37.159 INFO:teuthology.orchestra.run.smithi018.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2024-02-10T08:09:37.159 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:09:37.159 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction Summary 2024-02-10T08:09:37.160 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-02-10T08:09:37.160 INFO:teuthology.orchestra.run.smithi018.stdout:Install 2 Packages 2024-02-10T08:09:37.160 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:09:37.161 INFO:teuthology.orchestra.run.smithi018.stdout:Total download size: 994 k 2024-02-10T08:09:37.161 INFO:teuthology.orchestra.run.smithi018.stdout:Installed size: 2.8 M 2024-02-10T08:09:37.161 INFO:teuthology.orchestra.run.smithi018.stdout:Downloading Packages: 2024-02-10T08:09:37.284 INFO:teuthology.orchestra.run.smithi018.stdout:(1/2): fuse-2.9.7-17.el8.x86_64.rpm 1.0 MB/s | 83 kB 00:00 2024-02-10T08:09:37.526 INFO:teuthology.orchestra.run.smithi018.stdout:(2/2): ceph-fuse-16.2.14-521.g0e714d9a.el8.x86_ 2.7 MB/s | 911 kB 00:00 2024-02-10T08:09:37.526 INFO:teuthology.orchestra.run.smithi018.stdout:-------------------------------------------------------------------------------- 2024-02-10T08:09:37.526 INFO:teuthology.orchestra.run.smithi018.stdout:Total 2.6 MB/s | 994 kB 00:00 2024-02-10T08:09:37.536 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction check 2024-02-10T08:09:37.559 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction check succeeded. 2024-02-10T08:09:37.559 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction test 2024-02-10T08:09:37.652 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction test succeeded. 2024-02-10T08:09:37.655 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction 2024-02-10T08:09:37.842 INFO:teuthology.orchestra.run.smithi018.stdout: Preparing : 1/1 2024-02-10T08:09:38.127 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : fuse-2.9.7-17.el8.x86_64 1/2 2024-02-10T08:09:38.307 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-fuse-2:16.2.14-521.g0e714d9a.el8.x86_64 2/2 2024-02-10T08:09:38.484 INFO:teuthology.orchestra.run.smithi071.stdout:Package libcephfs2-2:16.2.14-521.g0e714d9a.el8.x86_64 is already installed. 2024-02-10T08:09:38.530 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-02-10T08:09:38.531 INFO:teuthology.orchestra.run.smithi071.stdout:Nothing to do. 2024-02-10T08:09:38.531 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-02-10T08:09:38.639 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install libcephfs-devel 2024-02-10T08:09:38.732 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-fuse-2:16.2.14-521.g0e714d9a.el8.x86_64 2/2 2024-02-10T08:09:38.732 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-fuse-2:16.2.14-521.g0e714d9a.el8.x86_64 1/2 2024-02-10T08:09:39.175 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 2/2 2024-02-10T08:09:39.175 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:09:39.175 INFO:teuthology.orchestra.run.smithi018.stdout:Installed: 2024-02-10T08:09:39.175 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-fuse-2:16.2.14-521.g0e714d9a.el8.x86_64 fuse-2.9.7-17.el8.x86_64 2024-02-10T08:09:39.176 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:09:39.176 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-02-10T08:09:39.386 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:02:29 ago on Sat 10 Feb 2024 08:07:10 AM UTC. 2024-02-10T08:09:39.393 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install librados-devel 2024-02-10T08:09:40.185 INFO:teuthology.orchestra.run.smithi018.stdout:Last metadata expiration check: 0:02:31 ago on Sat 10 Feb 2024 08:07:09 AM UTC. 2024-02-10T08:09:40.901 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-02-10T08:09:40.902 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-02-10T08:09:40.902 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repo Size 2024-02-10T08:09:40.902 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-02-10T08:09:40.902 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-02-10T08:09:40.902 INFO:teuthology.orchestra.run.smithi071.stdout: libcephfs-devel x86_64 2:16.2.14-521.g0e714d9a.el8 ceph 25 k 2024-02-10T08:09:40.902 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-02-10T08:09:40.902 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-02-10T08:09:40.902 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-02-10T08:09:40.903 INFO:teuthology.orchestra.run.smithi071.stdout:Install 1 Package 2024-02-10T08:09:40.903 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-02-10T08:09:40.903 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 25 k 2024-02-10T08:09:40.903 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 107 k 2024-02-10T08:09:40.903 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-02-10T08:09:41.067 INFO:teuthology.orchestra.run.smithi071.stdout:libcephfs-devel-16.2.14-521.g0e714d9a.el8.x86_6 156 kB/s | 25 kB 00:00 2024-02-10T08:09:41.068 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-02-10T08:09:41.068 INFO:teuthology.orchestra.run.smithi071.stdout:Total 155 kB/s | 25 kB 00:00 2024-02-10T08:09:41.068 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-02-10T08:09:41.071 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-02-10T08:09:41.072 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-02-10T08:09:41.074 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-02-10T08:09:41.077 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-02-10T08:09:41.127 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-02-10T08:09:41.303 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libcephfs-devel-2:16.2.14-521.g0e714d9a.el8.x86_64 1/1 2024-02-10T08:09:41.564 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libcephfs-devel-2:16.2.14-521.g0e714d9a.el8.x86_64 1/1 2024-02-10T08:09:41.816 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-02-10T08:09:41.816 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-02-10T08:09:41.816 INFO:teuthology.orchestra.run.smithi018.stdout: Package Arch Version Repo Size 2024-02-10T08:09:41.816 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-02-10T08:09:41.816 INFO:teuthology.orchestra.run.smithi018.stdout:Installing: 2024-02-10T08:09:41.816 INFO:teuthology.orchestra.run.smithi018.stdout: librados-devel x86_64 2:16.2.14-521.g0e714d9a.el8 ceph 131 k 2024-02-10T08:09:41.817 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:09:41.817 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction Summary 2024-02-10T08:09:41.817 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-02-10T08:09:41.817 INFO:teuthology.orchestra.run.smithi018.stdout:Install 1 Package 2024-02-10T08:09:41.817 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:09:41.817 INFO:teuthology.orchestra.run.smithi018.stdout:Total download size: 131 k 2024-02-10T08:09:41.817 INFO:teuthology.orchestra.run.smithi018.stdout:Installed size: 432 k 2024-02-10T08:09:41.817 INFO:teuthology.orchestra.run.smithi018.stdout:Downloading Packages: 2024-02-10T08:09:41.894 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libcephfs-devel-2:16.2.14-521.g0e714d9a.el8.x86_64 1/1 2024-02-10T08:09:41.895 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-02-10T08:09:41.895 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-02-10T08:09:41.895 INFO:teuthology.orchestra.run.smithi071.stdout: libcephfs-devel-2:16.2.14-521.g0e714d9a.el8.x86_64 2024-02-10T08:09:41.895 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-02-10T08:09:41.895 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-02-10T08:09:42.012 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install librados2 2024-02-10T08:09:42.542 INFO:teuthology.orchestra.run.smithi018.stdout:librados-devel-16.2.14-521.g0e714d9a.el8.x86_64 181 kB/s | 131 kB 00:00 2024-02-10T08:09:42.543 INFO:teuthology.orchestra.run.smithi018.stdout:-------------------------------------------------------------------------------- 2024-02-10T08:09:42.543 INFO:teuthology.orchestra.run.smithi018.stdout:Total 180 kB/s | 131 kB 00:00 2024-02-10T08:09:42.544 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction check 2024-02-10T08:09:42.551 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction check succeeded. 2024-02-10T08:09:42.551 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction test 2024-02-10T08:09:42.613 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction test succeeded. 2024-02-10T08:09:42.619 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction 2024-02-10T08:09:42.738 INFO:teuthology.orchestra.run.smithi018.stdout: Preparing : 1/1 2024-02-10T08:09:42.764 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:02:32 ago on Sat 10 Feb 2024 08:07:10 AM UTC. 2024-02-10T08:09:42.964 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : librados-devel-2:16.2.14-521.g0e714d9a.el8.x86_64 1/1 2024-02-10T08:09:43.250 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: librados-devel-2:16.2.14-521.g0e714d9a.el8.x86_64 1/1 2024-02-10T08:09:43.710 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librados-devel-2:16.2.14-521.g0e714d9a.el8.x86_64 1/1 2024-02-10T08:09:43.710 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:09:43.710 INFO:teuthology.orchestra.run.smithi018.stdout:Installed: 2024-02-10T08:09:43.710 INFO:teuthology.orchestra.run.smithi018.stdout: librados-devel-2:16.2.14-521.g0e714d9a.el8.x86_64 2024-02-10T08:09:43.710 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:09:43.710 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-02-10T08:09:43.909 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install libcephfs2 2024-02-10T08:09:44.221 INFO:teuthology.orchestra.run.smithi071.stdout:Package librados2-2:16.2.14-521.g0e714d9a.el8.x86_64 is already installed. 2024-02-10T08:09:44.267 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-02-10T08:09:44.268 INFO:teuthology.orchestra.run.smithi071.stdout:Nothing to do. 2024-02-10T08:09:44.268 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-02-10T08:09:44.370 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install librbd1 2024-02-10T08:09:44.703 INFO:teuthology.orchestra.run.smithi018.stdout:Last metadata expiration check: 0:02:35 ago on Sat 10 Feb 2024 08:07:09 AM UTC. 2024-02-10T08:09:45.118 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:02:35 ago on Sat 10 Feb 2024 08:07:10 AM UTC. 2024-02-10T08:09:46.306 INFO:teuthology.orchestra.run.smithi018.stdout:Package libcephfs2-2:16.2.14-521.g0e714d9a.el8.x86_64 is already installed. 2024-02-10T08:09:46.356 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-02-10T08:09:46.357 INFO:teuthology.orchestra.run.smithi018.stdout:Nothing to do. 2024-02-10T08:09:46.357 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-02-10T08:09:46.468 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install libcephfs-devel 2024-02-10T08:09:46.579 INFO:teuthology.orchestra.run.smithi071.stdout:Package librbd1-2:16.2.14-521.g0e714d9a.el8.x86_64 is already installed. 2024-02-10T08:09:46.625 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-02-10T08:09:46.626 INFO:teuthology.orchestra.run.smithi071.stdout:Nothing to do. 2024-02-10T08:09:46.626 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-02-10T08:09:46.737 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install python3-rados 2024-02-10T08:09:47.252 INFO:teuthology.orchestra.run.smithi018.stdout:Last metadata expiration check: 0:02:38 ago on Sat 10 Feb 2024 08:07:09 AM UTC. 2024-02-10T08:09:47.483 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:02:37 ago on Sat 10 Feb 2024 08:07:10 AM UTC. 2024-02-10T08:09:48.869 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-02-10T08:09:48.870 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-02-10T08:09:48.870 INFO:teuthology.orchestra.run.smithi018.stdout: Package Arch Version Repo Size 2024-02-10T08:09:48.870 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-02-10T08:09:48.870 INFO:teuthology.orchestra.run.smithi018.stdout:Installing: 2024-02-10T08:09:48.870 INFO:teuthology.orchestra.run.smithi018.stdout: libcephfs-devel x86_64 2:16.2.14-521.g0e714d9a.el8 ceph 25 k 2024-02-10T08:09:48.870 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:09:48.871 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction Summary 2024-02-10T08:09:48.871 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-02-10T08:09:48.871 INFO:teuthology.orchestra.run.smithi018.stdout:Install 1 Package 2024-02-10T08:09:48.871 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:09:48.871 INFO:teuthology.orchestra.run.smithi018.stdout:Total download size: 25 k 2024-02-10T08:09:48.871 INFO:teuthology.orchestra.run.smithi018.stdout:Installed size: 107 k 2024-02-10T08:09:48.871 INFO:teuthology.orchestra.run.smithi018.stdout:Downloading Packages: 2024-02-10T08:09:48.952 INFO:teuthology.orchestra.run.smithi071.stdout:Package python3-rados-2:16.2.14-521.g0e714d9a.el8.x86_64 is already installed. 2024-02-10T08:09:48.997 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-02-10T08:09:48.999 INFO:teuthology.orchestra.run.smithi071.stdout:Nothing to do. 2024-02-10T08:09:48.999 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-02-10T08:09:49.020 INFO:teuthology.orchestra.run.smithi018.stdout:libcephfs-devel-16.2.14-521.g0e714d9a.el8.x86_6 170 kB/s | 25 kB 00:00 2024-02-10T08:09:49.021 INFO:teuthology.orchestra.run.smithi018.stdout:-------------------------------------------------------------------------------- 2024-02-10T08:09:49.021 INFO:teuthology.orchestra.run.smithi018.stdout:Total 169 kB/s | 25 kB 00:00 2024-02-10T08:09:49.021 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction check 2024-02-10T08:09:49.025 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction check succeeded. 2024-02-10T08:09:49.025 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction test 2024-02-10T08:09:49.028 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction test succeeded. 2024-02-10T08:09:49.031 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction 2024-02-10T08:09:49.078 INFO:teuthology.orchestra.run.smithi018.stdout: Preparing : 1/1 2024-02-10T08:09:49.102 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install python3-rgw 2024-02-10T08:09:49.246 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libcephfs-devel-2:16.2.14-521.g0e714d9a.el8.x86_64 1/1 2024-02-10T08:09:49.552 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: libcephfs-devel-2:16.2.14-521.g0e714d9a.el8.x86_64 1/1 2024-02-10T08:09:49.849 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:02:39 ago on Sat 10 Feb 2024 08:07:10 AM UTC. 2024-02-10T08:09:49.904 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libcephfs-devel-2:16.2.14-521.g0e714d9a.el8.x86_64 1/1 2024-02-10T08:09:49.904 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:09:49.904 INFO:teuthology.orchestra.run.smithi018.stdout:Installed: 2024-02-10T08:09:49.904 INFO:teuthology.orchestra.run.smithi018.stdout: libcephfs-devel-2:16.2.14-521.g0e714d9a.el8.x86_64 2024-02-10T08:09:49.904 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:09:49.904 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-02-10T08:09:50.022 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install librados2 2024-02-10T08:09:50.807 INFO:teuthology.orchestra.run.smithi018.stdout:Last metadata expiration check: 0:02:41 ago on Sat 10 Feb 2024 08:07:09 AM UTC. 2024-02-10T08:09:51.308 INFO:teuthology.orchestra.run.smithi071.stdout:Package python3-rgw-2:16.2.14-521.g0e714d9a.el8.x86_64 is already installed. 2024-02-10T08:09:51.355 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-02-10T08:09:51.356 INFO:teuthology.orchestra.run.smithi071.stdout:Nothing to do. 2024-02-10T08:09:51.356 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-02-10T08:09:51.471 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install python3-cephfs 2024-02-10T08:09:52.217 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:02:42 ago on Sat 10 Feb 2024 08:07:10 AM UTC. 2024-02-10T08:09:52.376 INFO:teuthology.orchestra.run.smithi018.stdout:Package librados2-2:16.2.14-521.g0e714d9a.el8.x86_64 is already installed. 2024-02-10T08:09:52.427 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-02-10T08:09:52.428 INFO:teuthology.orchestra.run.smithi018.stdout:Nothing to do. 2024-02-10T08:09:52.428 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-02-10T08:09:52.529 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install librbd1 2024-02-10T08:09:53.321 INFO:teuthology.orchestra.run.smithi018.stdout:Last metadata expiration check: 0:02:44 ago on Sat 10 Feb 2024 08:07:09 AM UTC. 2024-02-10T08:09:53.675 INFO:teuthology.orchestra.run.smithi071.stdout:Package python3-cephfs-2:16.2.14-521.g0e714d9a.el8.x86_64 is already installed. 2024-02-10T08:09:53.721 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-02-10T08:09:53.722 INFO:teuthology.orchestra.run.smithi071.stdout:Nothing to do. 2024-02-10T08:09:53.722 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-02-10T08:09:53.832 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install python3-rbd 2024-02-10T08:09:54.585 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:02:44 ago on Sat 10 Feb 2024 08:07:10 AM UTC. 2024-02-10T08:09:54.884 INFO:teuthology.orchestra.run.smithi018.stdout:Package librbd1-2:16.2.14-521.g0e714d9a.el8.x86_64 is already installed. 2024-02-10T08:09:54.934 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-02-10T08:09:54.935 INFO:teuthology.orchestra.run.smithi018.stdout:Nothing to do. 2024-02-10T08:09:54.935 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-02-10T08:09:55.060 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install python3-rados 2024-02-10T08:09:55.846 INFO:teuthology.orchestra.run.smithi018.stdout:Last metadata expiration check: 0:02:46 ago on Sat 10 Feb 2024 08:07:09 AM UTC. 2024-02-10T08:09:56.052 INFO:teuthology.orchestra.run.smithi071.stdout:Package python3-rbd-2:16.2.14-521.g0e714d9a.el8.x86_64 is already installed. 2024-02-10T08:09:56.098 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-02-10T08:09:56.099 INFO:teuthology.orchestra.run.smithi071.stdout:Nothing to do. 2024-02-10T08:09:56.099 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-02-10T08:09:56.204 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install rbd-fuse 2024-02-10T08:09:56.966 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:02:46 ago on Sat 10 Feb 2024 08:07:10 AM UTC. 2024-02-10T08:09:57.426 INFO:teuthology.orchestra.run.smithi018.stdout:Package python3-rados-2:16.2.14-521.g0e714d9a.el8.x86_64 is already installed. 2024-02-10T08:09:57.475 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-02-10T08:09:57.477 INFO:teuthology.orchestra.run.smithi018.stdout:Nothing to do. 2024-02-10T08:09:57.477 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-02-10T08:09:57.580 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install python3-rgw 2024-02-10T08:09:58.363 INFO:teuthology.orchestra.run.smithi018.stdout:Last metadata expiration check: 0:02:49 ago on Sat 10 Feb 2024 08:07:09 AM UTC. 2024-02-10T08:09:58.480 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-02-10T08:09:58.480 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-02-10T08:09:58.480 INFO:teuthology.orchestra.run.smithi071.stdout: Package Architecture Version Repository Size 2024-02-10T08:09:58.481 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-02-10T08:09:58.481 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-02-10T08:09:58.481 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-fuse x86_64 2:16.2.14-521.g0e714d9a.el8 ceph 88 k 2024-02-10T08:09:58.481 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-02-10T08:09:58.481 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-02-10T08:09:58.481 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-02-10T08:09:58.481 INFO:teuthology.orchestra.run.smithi071.stdout:Install 1 Package 2024-02-10T08:09:58.481 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-02-10T08:09:58.482 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 88 k 2024-02-10T08:09:58.482 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 240 k 2024-02-10T08:09:58.482 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-02-10T08:09:58.687 INFO:teuthology.orchestra.run.smithi071.stdout:rbd-fuse-16.2.14-521.g0e714d9a.el8.x86_64.rpm 430 kB/s | 88 kB 00:00 2024-02-10T08:09:58.688 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-02-10T08:09:58.688 INFO:teuthology.orchestra.run.smithi071.stdout:Total 427 kB/s | 88 kB 00:00 2024-02-10T08:09:58.688 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-02-10T08:09:58.698 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-02-10T08:09:58.698 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-02-10T08:09:58.749 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-02-10T08:09:58.751 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-02-10T08:09:59.051 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-02-10T08:09:59.216 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : rbd-fuse-2:16.2.14-521.g0e714d9a.el8.x86_64 1/1 2024-02-10T08:09:59.514 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: rbd-fuse-2:16.2.14-521.g0e714d9a.el8.x86_64 1/1 2024-02-10T08:09:59.880 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : rbd-fuse-2:16.2.14-521.g0e714d9a.el8.x86_64 1/1 2024-02-10T08:09:59.880 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-02-10T08:09:59.881 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-02-10T08:09:59.881 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-fuse-2:16.2.14-521.g0e714d9a.el8.x86_64 2024-02-10T08:09:59.881 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-02-10T08:09:59.881 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-02-10T08:09:59.945 INFO:teuthology.orchestra.run.smithi018.stdout:Package python3-rgw-2:16.2.14-521.g0e714d9a.el8.x86_64 is already installed. 2024-02-10T08:09:59.995 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-02-10T08:09:59.996 INFO:teuthology.orchestra.run.smithi018.stdout:Nothing to do. 2024-02-10T08:09:59.996 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-02-10T08:10:00.097 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install rbd-mirror 2024-02-10T08:10:00.104 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install python3-cephfs 2024-02-10T08:10:00.857 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:02:50 ago on Sat 10 Feb 2024 08:07:10 AM UTC. 2024-02-10T08:10:00.895 INFO:teuthology.orchestra.run.smithi018.stdout:Last metadata expiration check: 0:02:51 ago on Sat 10 Feb 2024 08:07:09 AM UTC. 2024-02-10T08:10:02.361 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-02-10T08:10:02.362 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-02-10T08:10:02.362 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repo Size 2024-02-10T08:10:02.362 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-02-10T08:10:02.362 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-02-10T08:10:02.362 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-mirror x86_64 2:16.2.14-521.g0e714d9a.el8 ceph 3.7 M 2024-02-10T08:10:02.362 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-02-10T08:10:02.362 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-02-10T08:10:02.362 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-02-10T08:10:02.362 INFO:teuthology.orchestra.run.smithi071.stdout:Install 1 Package 2024-02-10T08:10:02.362 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-02-10T08:10:02.362 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 3.7 M 2024-02-10T08:10:02.362 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 15 M 2024-02-10T08:10:02.363 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-02-10T08:10:02.463 INFO:teuthology.orchestra.run.smithi018.stdout:Package python3-cephfs-2:16.2.14-521.g0e714d9a.el8.x86_64 is already installed. 2024-02-10T08:10:02.513 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-02-10T08:10:02.514 INFO:teuthology.orchestra.run.smithi018.stdout:Nothing to do. 2024-02-10T08:10:02.514 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-02-10T08:10:02.623 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install python3-rbd 2024-02-10T08:10:02.758 INFO:teuthology.orchestra.run.smithi071.stdout:rbd-mirror-16.2.14-521.g0e714d9a.el8.x86_64.rpm 9.3 MB/s | 3.7 MB 00:00 2024-02-10T08:10:02.758 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-02-10T08:10:02.759 INFO:teuthology.orchestra.run.smithi071.stdout:Total 9.3 MB/s | 3.7 MB 00:00 2024-02-10T08:10:02.759 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-02-10T08:10:02.770 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-02-10T08:10:02.771 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-02-10T08:10:02.834 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-02-10T08:10:02.837 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-02-10T08:10:03.315 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-02-10T08:10:03.406 INFO:teuthology.orchestra.run.smithi018.stdout:Last metadata expiration check: 0:02:54 ago on Sat 10 Feb 2024 08:07:09 AM UTC. 2024-02-10T08:10:03.508 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : rbd-mirror-2:16.2.14-521.g0e714d9a.el8.x86_64 1/1 2024-02-10T08:10:03.914 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: rbd-mirror-2:16.2.14-521.g0e714d9a.el8.x86_64 1/1 2024-02-10T08:10:04.275 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : rbd-mirror-2:16.2.14-521.g0e714d9a.el8.x86_64 1/1 2024-02-10T08:10:04.275 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-02-10T08:10:04.275 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-02-10T08:10:04.275 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-mirror-2:16.2.14-521.g0e714d9a.el8.x86_64 2024-02-10T08:10:04.276 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-02-10T08:10:04.276 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-02-10T08:10:04.604 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install rbd-nbd 2024-02-10T08:10:04.977 INFO:teuthology.orchestra.run.smithi018.stdout:Package python3-rbd-2:16.2.14-521.g0e714d9a.el8.x86_64 is already installed. 2024-02-10T08:10:05.026 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-02-10T08:10:05.027 INFO:teuthology.orchestra.run.smithi018.stdout:Nothing to do. 2024-02-10T08:10:05.028 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-02-10T08:10:05.139 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install rbd-fuse 2024-02-10T08:10:05.374 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:02:55 ago on Sat 10 Feb 2024 08:07:10 AM UTC. 2024-02-10T08:10:05.928 INFO:teuthology.orchestra.run.smithi018.stdout:Last metadata expiration check: 0:02:56 ago on Sat 10 Feb 2024 08:07:09 AM UTC. 2024-02-10T08:10:06.883 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-02-10T08:10:06.884 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-02-10T08:10:06.884 INFO:teuthology.orchestra.run.smithi071.stdout: Package Architecture Version Repository Size 2024-02-10T08:10:06.884 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-02-10T08:10:06.884 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-02-10T08:10:06.884 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-nbd x86_64 2:16.2.14-521.g0e714d9a.el8 ceph 175 k 2024-02-10T08:10:06.884 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-02-10T08:10:06.884 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-02-10T08:10:06.884 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-02-10T08:10:06.885 INFO:teuthology.orchestra.run.smithi071.stdout:Install 1 Package 2024-02-10T08:10:06.885 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-02-10T08:10:06.885 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 175 k 2024-02-10T08:10:06.885 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 523 k 2024-02-10T08:10:06.885 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-02-10T08:10:07.185 INFO:teuthology.orchestra.run.smithi071.stdout:rbd-nbd-16.2.14-521.g0e714d9a.el8.x86_64.rpm 584 kB/s | 175 kB 00:00 2024-02-10T08:10:07.186 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-02-10T08:10:07.186 INFO:teuthology.orchestra.run.smithi071.stdout:Total 581 kB/s | 175 kB 00:00 2024-02-10T08:10:07.186 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-02-10T08:10:07.197 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-02-10T08:10:07.197 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-02-10T08:10:07.246 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-02-10T08:10:07.249 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-02-10T08:10:07.375 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-02-10T08:10:07.548 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : rbd-nbd-2:16.2.14-521.g0e714d9a.el8.x86_64 1/1 2024-02-10T08:10:07.573 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-02-10T08:10:07.573 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-02-10T08:10:07.574 INFO:teuthology.orchestra.run.smithi018.stdout: Package Architecture Version Repository Size 2024-02-10T08:10:07.574 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-02-10T08:10:07.574 INFO:teuthology.orchestra.run.smithi018.stdout:Installing: 2024-02-10T08:10:07.574 INFO:teuthology.orchestra.run.smithi018.stdout: rbd-fuse x86_64 2:16.2.14-521.g0e714d9a.el8 ceph 88 k 2024-02-10T08:10:07.574 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:10:07.574 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction Summary 2024-02-10T08:10:07.574 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-02-10T08:10:07.574 INFO:teuthology.orchestra.run.smithi018.stdout:Install 1 Package 2024-02-10T08:10:07.574 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:10:07.575 INFO:teuthology.orchestra.run.smithi018.stdout:Total download size: 88 k 2024-02-10T08:10:07.575 INFO:teuthology.orchestra.run.smithi018.stdout:Installed size: 240 k 2024-02-10T08:10:07.575 INFO:teuthology.orchestra.run.smithi018.stdout:Downloading Packages: 2024-02-10T08:10:07.826 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: rbd-nbd-2:16.2.14-521.g0e714d9a.el8.x86_64 1/1 2024-02-10T08:10:07.852 INFO:teuthology.orchestra.run.smithi018.stdout:rbd-fuse-16.2.14-521.g0e714d9a.el8.x86_64.rpm 319 kB/s | 88 kB 00:00 2024-02-10T08:10:07.852 INFO:teuthology.orchestra.run.smithi018.stdout:-------------------------------------------------------------------------------- 2024-02-10T08:10:07.853 INFO:teuthology.orchestra.run.smithi018.stdout:Total 318 kB/s | 88 kB 00:00 2024-02-10T08:10:07.853 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction check 2024-02-10T08:10:07.863 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction check succeeded. 2024-02-10T08:10:07.863 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction test 2024-02-10T08:10:07.918 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction test succeeded. 2024-02-10T08:10:07.921 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction 2024-02-10T08:10:08.031 INFO:teuthology.orchestra.run.smithi018.stdout: Preparing : 1/1 2024-02-10T08:10:08.176 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : rbd-nbd-2:16.2.14-521.g0e714d9a.el8.x86_64 1/1 2024-02-10T08:10:08.176 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-02-10T08:10:08.176 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-02-10T08:10:08.176 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-nbd-2:16.2.14-521.g0e714d9a.el8.x86_64 2024-02-10T08:10:08.176 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-02-10T08:10:08.176 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-02-10T08:10:08.251 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : rbd-fuse-2:16.2.14-521.g0e714d9a.el8.x86_64 1/1 2024-02-10T08:10:08.404 DEBUG:teuthology.parallel:result is None 2024-02-10T08:10:08.554 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: rbd-fuse-2:16.2.14-521.g0e714d9a.el8.x86_64 1/1 2024-02-10T08:10:09.020 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : rbd-fuse-2:16.2.14-521.g0e714d9a.el8.x86_64 1/1 2024-02-10T08:10:09.020 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:10:09.020 INFO:teuthology.orchestra.run.smithi018.stdout:Installed: 2024-02-10T08:10:09.020 INFO:teuthology.orchestra.run.smithi018.stdout: rbd-fuse-2:16.2.14-521.g0e714d9a.el8.x86_64 2024-02-10T08:10:09.020 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:10:09.020 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-02-10T08:10:09.243 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install rbd-mirror 2024-02-10T08:10:10.037 INFO:teuthology.orchestra.run.smithi018.stdout:Last metadata expiration check: 0:03:01 ago on Sat 10 Feb 2024 08:07:09 AM UTC. 2024-02-10T08:10:11.675 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-02-10T08:10:11.676 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-02-10T08:10:11.676 INFO:teuthology.orchestra.run.smithi018.stdout: Package Arch Version Repo Size 2024-02-10T08:10:11.677 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-02-10T08:10:11.677 INFO:teuthology.orchestra.run.smithi018.stdout:Installing: 2024-02-10T08:10:11.677 INFO:teuthology.orchestra.run.smithi018.stdout: rbd-mirror x86_64 2:16.2.14-521.g0e714d9a.el8 ceph 3.7 M 2024-02-10T08:10:11.677 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:10:11.677 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction Summary 2024-02-10T08:10:11.677 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-02-10T08:10:11.677 INFO:teuthology.orchestra.run.smithi018.stdout:Install 1 Package 2024-02-10T08:10:11.677 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:10:11.677 INFO:teuthology.orchestra.run.smithi018.stdout:Total download size: 3.7 M 2024-02-10T08:10:11.678 INFO:teuthology.orchestra.run.smithi018.stdout:Installed size: 15 M 2024-02-10T08:10:11.678 INFO:teuthology.orchestra.run.smithi018.stdout:Downloading Packages: 2024-02-10T08:10:12.071 INFO:teuthology.orchestra.run.smithi018.stdout:rbd-mirror-16.2.14-521.g0e714d9a.el8.x86_64.rpm 9.3 MB/s | 3.7 MB 00:00 2024-02-10T08:10:12.072 INFO:teuthology.orchestra.run.smithi018.stdout:-------------------------------------------------------------------------------- 2024-02-10T08:10:12.072 INFO:teuthology.orchestra.run.smithi018.stdout:Total 9.3 MB/s | 3.7 MB 00:00 2024-02-10T08:10:12.072 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction check 2024-02-10T08:10:12.085 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction check succeeded. 2024-02-10T08:10:12.085 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction test 2024-02-10T08:10:12.152 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction test succeeded. 2024-02-10T08:10:12.155 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction 2024-02-10T08:10:12.624 INFO:teuthology.orchestra.run.smithi018.stdout: Preparing : 1/1 2024-02-10T08:10:12.835 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : rbd-mirror-2:16.2.14-521.g0e714d9a.el8.x86_64 1/1 2024-02-10T08:10:13.267 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: rbd-mirror-2:16.2.14-521.g0e714d9a.el8.x86_64 1/1 2024-02-10T08:10:13.677 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : rbd-mirror-2:16.2.14-521.g0e714d9a.el8.x86_64 1/1 2024-02-10T08:10:13.677 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:10:13.677 INFO:teuthology.orchestra.run.smithi018.stdout:Installed: 2024-02-10T08:10:13.677 INFO:teuthology.orchestra.run.smithi018.stdout: rbd-mirror-2:16.2.14-521.g0e714d9a.el8.x86_64 2024-02-10T08:10:13.678 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:10:13.678 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-02-10T08:10:13.864 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install rbd-nbd 2024-02-10T08:10:14.656 INFO:teuthology.orchestra.run.smithi018.stdout:Last metadata expiration check: 0:03:05 ago on Sat 10 Feb 2024 08:07:09 AM UTC. 2024-02-10T08:10:16.274 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-02-10T08:10:16.274 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-02-10T08:10:16.274 INFO:teuthology.orchestra.run.smithi018.stdout: Package Architecture Version Repository Size 2024-02-10T08:10:16.274 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-02-10T08:10:16.274 INFO:teuthology.orchestra.run.smithi018.stdout:Installing: 2024-02-10T08:10:16.274 INFO:teuthology.orchestra.run.smithi018.stdout: rbd-nbd x86_64 2:16.2.14-521.g0e714d9a.el8 ceph 175 k 2024-02-10T08:10:16.274 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:10:16.275 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction Summary 2024-02-10T08:10:16.275 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-02-10T08:10:16.275 INFO:teuthology.orchestra.run.smithi018.stdout:Install 1 Package 2024-02-10T08:10:16.275 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:10:16.275 INFO:teuthology.orchestra.run.smithi018.stdout:Total download size: 175 k 2024-02-10T08:10:16.275 INFO:teuthology.orchestra.run.smithi018.stdout:Installed size: 523 k 2024-02-10T08:10:16.275 INFO:teuthology.orchestra.run.smithi018.stdout:Downloading Packages: 2024-02-10T08:10:16.501 INFO:teuthology.orchestra.run.smithi018.stdout:rbd-nbd-16.2.14-521.g0e714d9a.el8.x86_64.rpm 782 kB/s | 175 kB 00:00 2024-02-10T08:10:16.501 INFO:teuthology.orchestra.run.smithi018.stdout:-------------------------------------------------------------------------------- 2024-02-10T08:10:16.501 INFO:teuthology.orchestra.run.smithi018.stdout:Total 777 kB/s | 175 kB 00:00 2024-02-10T08:10:16.502 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction check 2024-02-10T08:10:16.512 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction check succeeded. 2024-02-10T08:10:16.513 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction test 2024-02-10T08:10:16.566 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction test succeeded. 2024-02-10T08:10:16.569 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction 2024-02-10T08:10:16.687 INFO:teuthology.orchestra.run.smithi018.stdout: Preparing : 1/1 2024-02-10T08:10:16.933 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : rbd-nbd-2:16.2.14-521.g0e714d9a.el8.x86_64 1/1 2024-02-10T08:10:17.236 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: rbd-nbd-2:16.2.14-521.g0e714d9a.el8.x86_64 1/1 2024-02-10T08:10:17.637 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : rbd-nbd-2:16.2.14-521.g0e714d9a.el8.x86_64 1/1 2024-02-10T08:10:17.637 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:10:17.637 INFO:teuthology.orchestra.run.smithi018.stdout:Installed: 2024-02-10T08:10:17.637 INFO:teuthology.orchestra.run.smithi018.stdout: rbd-nbd-2:16.2.14-521.g0e714d9a.el8.x86_64 2024-02-10T08:10:17.637 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:10:17.637 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-02-10T08:10:17.859 DEBUG:teuthology.parallel:result is None 2024-02-10T08:10:17.859 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-10T08:10:18.010 DEBUG:teuthology.orchestra.run.smithi018:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-02-10T08:10:18.033 INFO:teuthology.orchestra.run.smithi018.stdout:16.2.14-521.g0e714d9a.el8 2024-02-10T08:10:18.034 INFO:teuthology.packaging:The installed version of ceph is 16.2.14-521.g0e714d9a.el8 2024-02-10T08:10:18.034 INFO:teuthology.task.install:The correct ceph version 16.2.14-521.g0e714d9a is installed. 2024-02-10T08:10:18.036 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-10T08:10:18.189 DEBUG:teuthology.orchestra.run.smithi071:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-02-10T08:10:18.216 INFO:teuthology.orchestra.run.smithi071.stdout:16.2.14-521.g0e714d9a.el8 2024-02-10T08:10:18.216 INFO:teuthology.packaging:The installed version of ceph is 16.2.14-521.g0e714d9a.el8 2024-02-10T08:10:18.217 INFO:teuthology.task.install:The correct ceph version 16.2.14-521.g0e714d9a is installed. 2024-02-10T08:10:18.218 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-02-10T08:10:18.219 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-02-10T08:10:18.219 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-10T08:10:18.247 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-02-10T08:10:18.247 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-10T08:10:18.290 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-02-10T08:10:18.290 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-02-10T08:10:18.290 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/usr/bin/daemon-helper 2024-02-10T08:10:18.321 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-10T08:10:18.389 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-02-10T08:10:18.389 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/usr/bin/daemon-helper 2024-02-10T08:10:18.421 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-10T08:10:18.491 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-02-10T08:10:18.491 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-02-10T08:10:18.491 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-10T08:10:18.519 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-10T08:10:18.587 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-02-10T08:10:18.587 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-10T08:10:18.617 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-10T08:10:18.686 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-02-10T08:10:18.686 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-02-10T08:10:18.686 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/usr/bin/stdin-killer 2024-02-10T08:10:18.713 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-10T08:10:18.781 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-02-10T08:10:18.782 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/usr/bin/stdin-killer 2024-02-10T08:10:18.810 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-10T08:10:18.880 INFO:teuthology.run_tasks:Running task cephadm... 2024-02-10T08:10:18.951 INFO:tasks.cephadm:Config: {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'client.0': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'ms bind msgr1': False, 'ms bind msgr2': True, 'ms type': 'async'}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10}, 'osd': {'debug ms': 1, 'debug osd': 20, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd max backfills': 3, 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'but it is still running', 'objects unfound and apparently lost', '\\(MON_DOWN\\)', '\\(OSDMAP_FLAGS\\)'], 'sha1': '0e714d9a4bd2a821113e6318adb87bd06cf81ec1', 'cephadm_mode': 'root'} 2024-02-10T08:10:18.951 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-10T08:10:18.952 INFO:tasks.cephadm:Cluster fsid is d46257c8-c7eb-11ee-95b8-87774f69a715 2024-02-10T08:10:18.952 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-02-10T08:10:18.952 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.18', 'mon.c': '[v2:172.21.15.18:3301,v1:172.21.15.18:6790]', 'mon.b': '172.21.15.71'} 2024-02-10T08:10:18.952 INFO:tasks.cephadm:First mon is mon.a on smithi018 2024-02-10T08:10:18.952 INFO:tasks.cephadm:First mgr is y 2024-02-10T08:10:18.952 INFO:tasks.cephadm:Normalizing hostnames... 2024-02-10T08:10:18.952 DEBUG:teuthology.orchestra.run.smithi018:> sudo hostname $(hostname -s) 2024-02-10T08:10:18.980 DEBUG:teuthology.orchestra.run.smithi071:> sudo hostname $(hostname -s) 2024-02-10T08:10:19.009 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph-ci.git ref 0e714d9a4bd2a821113e6318adb87bd06cf81ec1)... 2024-02-10T08:10:19.009 DEBUG:teuthology.orchestra.run.smithi018:> curl --silent https://raw.githubusercontent.com/ceph/ceph-ci/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-02-10T08:10:19.165 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-rw-r--. 1 ubuntu ubuntu 355729 Feb 10 08:10 /home/ubuntu/cephtest/cephadm 2024-02-10T08:10:19.165 DEBUG:teuthology.orchestra.run.smithi071:> curl --silent https://raw.githubusercontent.com/ceph/ceph-ci/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-02-10T08:10:19.303 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-rw-r--. 1 ubuntu ubuntu 355729 Feb 10 08:10 /home/ubuntu/cephtest/cephadm 2024-02-10T08:10:19.303 DEBUG:teuthology.orchestra.run.smithi018:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-02-10T08:10:19.323 DEBUG:teuthology.orchestra.run.smithi071:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-02-10T08:10:19.354 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /etc/ceph 2024-02-10T08:10:19.390 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /etc/ceph 2024-02-10T08:10:19.419 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 777 /etc/ceph 2024-02-10T08:10:19.456 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 777 /etc/ceph 2024-02-10T08:10:19.486 INFO:tasks.cephadm:Writing seed config... 2024-02-10T08:10:19.487 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-02-10T08:10:19.487 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-02-10T08:10:19.487 INFO:tasks.cephadm: override: [client.0] debug ms = 1 2024-02-10T08:10:19.487 INFO:tasks.cephadm: override: [client.0] debug objecter = 20 2024-02-10T08:10:19.487 INFO:tasks.cephadm: override: [client.0] debug rados = 20 2024-02-10T08:10:19.487 INFO:tasks.cephadm: override: [global] ms bind msgr1 = False 2024-02-10T08:10:19.487 INFO:tasks.cephadm: override: [global] ms bind msgr2 = True 2024-02-10T08:10:19.488 INFO:tasks.cephadm: override: [global] ms type = async 2024-02-10T08:10:19.488 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-02-10T08:10:19.488 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-02-10T08:10:19.488 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-02-10T08:10:19.488 INFO:tasks.cephadm: override: [mon] mon min osdmap epochs = 50 2024-02-10T08:10:19.488 INFO:tasks.cephadm: override: [mon] mon osdmap full prune interval = 2 2024-02-10T08:10:19.488 INFO:tasks.cephadm: override: [mon] mon osdmap full prune min = 15 2024-02-10T08:10:19.488 INFO:tasks.cephadm: override: [mon] mon osdmap full prune txsize = 2 2024-02-10T08:10:19.488 INFO:tasks.cephadm: override: [mon] paxos service trim min = 10 2024-02-10T08:10:19.488 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-02-10T08:10:19.488 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-02-10T08:10:19.488 INFO:tasks.cephadm: override: [osd] osd debug reject backfill probability = 0.3 2024-02-10T08:10:19.488 INFO:tasks.cephadm: override: [osd] osd delete sleep = 1 2024-02-10T08:10:19.488 INFO:tasks.cephadm: override: [osd] osd max backfills = 3 2024-02-10T08:10:19.488 INFO:tasks.cephadm: override: [osd] osd scrub max interval = 120 2024-02-10T08:10:19.488 INFO:tasks.cephadm: override: [osd] osd scrub min interval = 60 2024-02-10T08:10:19.489 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-02-10T08:10:19.489 INFO:tasks.cephadm: override: [osd] osd snap trim sleep = 2 2024-02-10T08:10:19.489 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-02-10T08:10:19.489 DEBUG:teuthology.orchestra.run.smithi018:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-02-10T08:10:19.514 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = d46257c8-c7eb-11ee-95b8-87774f69a715 ms bind msgr1 = False ms bind msgr2 = True ms type = async [osd] osd scrub load threshold = 5.0 osd scrub max interval = 120 osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true debug ms = 1 debug osd = 20 osd debug reject backfill probability = 0.3 osd delete sleep = 1 osd max backfills = 3 osd scrub min interval = 60 osd snap trim sleep = 2 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon min osdmap epochs = 50 mon osdmap full prune interval = 2 mon osdmap full prune min = 15 mon osdmap full prune txsize = 2 paxos service trim min = 10 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client.0] debug ms = 1 debug objecter = 20 debug rados = 20 2024-02-10T08:10:19.515 DEBUG:teuthology.orchestra.run.smithi018:mon.a> sudo journalctl -f -n 0 -u ceph-d46257c8-c7eb-11ee-95b8-87774f69a715@mon.a.service 2024-02-10T08:10:19.557 DEBUG:teuthology.orchestra.run.smithi018:mgr.y> sudo journalctl -f -n 0 -u ceph-d46257c8-c7eb-11ee-95b8-87774f69a715@mgr.y.service 2024-02-10T08:10:19.584 INFO:journalctl@ceph.mon.a.smithi018.stdout:-- Logs begin at Sat 2024-02-10 07:59:20 UTC. -- 2024-02-10T08:10:19.585 INFO:tasks.cephadm:Bootstrapping... 2024-02-10T08:10:19.585 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -v bootstrap --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.18 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-02-10T08:10:19.611 INFO:journalctl@ceph.mgr.y.smithi018.stdout:-- Logs begin at Sat 2024-02-10 07:59:20 UTC. -- 2024-02-10T08:10:19.852 INFO:teuthology.orchestra.run.smithi018.stderr:-------------------------------------------------------------------------------- 2024-02-10T08:10:19.853 INFO:teuthology.orchestra.run.smithi018.stderr:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1', '-v', 'bootstrap', '--fsid', 'd46257c8-c7eb-11ee-95b8-87774f69a715', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'y', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.18', '--skip-admin-label'] 2024-02-10T08:10:20.817 INFO:teuthology.orchestra.run.smithi018.stderr:/bin/podman: 4.8.3 2024-02-10T08:10:20.826 INFO:teuthology.orchestra.run.smithi018.stderr:Verifying podman|docker is present... 2024-02-10T08:10:20.850 INFO:teuthology.orchestra.run.smithi018.stderr:/bin/podman: 4.8.3 2024-02-10T08:10:20.868 INFO:teuthology.orchestra.run.smithi018.stderr:Verifying lvm2 is present... 2024-02-10T08:10:20.868 INFO:teuthology.orchestra.run.smithi018.stderr:Verifying time synchronization is in place... 2024-02-10T08:10:20.876 INFO:teuthology.orchestra.run.smithi018.stderr:systemctl: Failed to get unit file state for chrony.service: No such file or directory 2024-02-10T08:10:20.883 INFO:teuthology.orchestra.run.smithi018.stderr:systemctl: inactive 2024-02-10T08:10:20.890 INFO:teuthology.orchestra.run.smithi018.stderr:systemctl: enabled 2024-02-10T08:10:20.897 INFO:teuthology.orchestra.run.smithi018.stderr:systemctl: active 2024-02-10T08:10:20.897 INFO:teuthology.orchestra.run.smithi018.stderr:Unit chronyd.service is enabled and running 2024-02-10T08:10:20.898 INFO:teuthology.orchestra.run.smithi018.stderr:Repeating the final host check... 2024-02-10T08:10:20.919 INFO:teuthology.orchestra.run.smithi018.stderr:/bin/podman: 4.8.3 2024-02-10T08:10:20.930 INFO:teuthology.orchestra.run.smithi018.stderr:podman (/bin/podman) version 4.8.3 is present 2024-02-10T08:10:20.930 INFO:teuthology.orchestra.run.smithi018.stderr:systemctl is present 2024-02-10T08:10:20.930 INFO:teuthology.orchestra.run.smithi018.stderr:lvcreate is present 2024-02-10T08:10:20.935 INFO:teuthology.orchestra.run.smithi018.stderr:systemctl: Failed to get unit file state for chrony.service: No such file or directory 2024-02-10T08:10:20.941 INFO:teuthology.orchestra.run.smithi018.stderr:systemctl: inactive 2024-02-10T08:10:20.948 INFO:teuthology.orchestra.run.smithi018.stderr:systemctl: enabled 2024-02-10T08:10:20.954 INFO:teuthology.orchestra.run.smithi018.stderr:systemctl: active 2024-02-10T08:10:20.954 INFO:teuthology.orchestra.run.smithi018.stderr:Unit chronyd.service is enabled and running 2024-02-10T08:10:20.955 INFO:teuthology.orchestra.run.smithi018.stderr:Host looks OK 2024-02-10T08:10:20.955 INFO:teuthology.orchestra.run.smithi018.stderr:Cluster fsid: d46257c8-c7eb-11ee-95b8-87774f69a715 2024-02-10T08:10:20.955 INFO:teuthology.orchestra.run.smithi018.stderr:Acquiring lock 139723029084648 on /run/cephadm/d46257c8-c7eb-11ee-95b8-87774f69a715.lock 2024-02-10T08:10:20.955 INFO:teuthology.orchestra.run.smithi018.stderr:Lock 139723029084648 acquired on /run/cephadm/d46257c8-c7eb-11ee-95b8-87774f69a715.lock 2024-02-10T08:10:20.955 INFO:teuthology.orchestra.run.smithi018.stderr:Verifying IP 172.21.15.18 port 3300 ... 2024-02-10T08:10:20.956 INFO:teuthology.orchestra.run.smithi018.stderr:Verifying IP 172.21.15.18 port 6789 ... 2024-02-10T08:10:20.956 INFO:teuthology.orchestra.run.smithi018.stderr:Base mon IP(s) is [172.21.15.18:3300, 172.21.15.18:6789], mon addrv is [v2:172.21.15.18:3300,v1:172.21.15.18:6789] 2024-02-10T08:10:20.959 INFO:teuthology.orchestra.run.smithi018.stderr:/sbin/ip: default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.18 metric 100 2024-02-10T08:10:20.959 INFO:teuthology.orchestra.run.smithi018.stderr:/sbin/ip: 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.18 metric 100 2024-02-10T08:10:20.962 INFO:teuthology.orchestra.run.smithi018.stderr:/sbin/ip: ::1 dev lo proto kernel metric 256 pref medium 2024-02-10T08:10:20.962 INFO:teuthology.orchestra.run.smithi018.stderr:/sbin/ip: fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-02-10T08:10:20.962 INFO:teuthology.orchestra.run.smithi018.stderr:/sbin/ip: default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1792sec hoplimit 64 pref medium 2024-02-10T08:10:20.965 INFO:teuthology.orchestra.run.smithi018.stderr:/sbin/ip: 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-02-10T08:10:20.965 INFO:teuthology.orchestra.run.smithi018.stderr:/sbin/ip: inet6 ::1/128 scope host 2024-02-10T08:10:20.965 INFO:teuthology.orchestra.run.smithi018.stderr:/sbin/ip: valid_lft forever preferred_lft forever 2024-02-10T08:10:20.965 INFO:teuthology.orchestra.run.smithi018.stderr:/sbin/ip: 4: ens1f0: mtu 1500 state UP qlen 1000 2024-02-10T08:10:20.965 INFO:teuthology.orchestra.run.smithi018.stderr:/sbin/ip: inet6 fe80::ec4:7aff:febd:1362/64 scope link 2024-02-10T08:10:20.965 INFO:teuthology.orchestra.run.smithi018.stderr:/sbin/ip: valid_lft forever preferred_lft forever 2024-02-10T08:10:20.966 INFO:teuthology.orchestra.run.smithi018.stderr:Mon IP `172.21.15.18` is in CIDR network `172.21.0.0/20` 2024-02-10T08:10:20.967 INFO:teuthology.orchestra.run.smithi018.stderr:Mon IP `172.21.15.18` is in CIDR network `172.21.0.0/20` 2024-02-10T08:10:20.967 INFO:teuthology.orchestra.run.smithi018.stderr:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-02-10T08:10:20.967 INFO:teuthology.orchestra.run.smithi018.stderr:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-02-10T08:10:20.968 INFO:teuthology.orchestra.run.smithi018.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1... 2024-02-10T08:10:21.062 INFO:teuthology.orchestra.run.smithi018.stderr:/bin/podman: Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1... 2024-02-10T08:10:22.021 INFO:teuthology.orchestra.run.smithi018.stderr:/bin/podman: Getting image source signatures 2024-02-10T08:10:22.031 INFO:teuthology.orchestra.run.smithi018.stderr:/bin/podman: Copying blob sha256:955bfa9dba4a4380f93be7209d227ce2b057a09dc4ade787f31ef12d8b977cea 2024-02-10T08:10:22.031 INFO:teuthology.orchestra.run.smithi018.stderr:/bin/podman: Copying blob sha256:58df4e03ba066accf3a7e07426bab5f1c867e27a139801c642bdafb42b9a2d9a 2024-02-10T08:10:47.521 INFO:teuthology.orchestra.run.smithi018.stderr:/bin/podman: Copying config sha256:1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5 2024-02-10T08:10:47.687 INFO:teuthology.orchestra.run.smithi018.stderr:/bin/podman: Writing manifest to image destination 2024-02-10T08:10:47.950 INFO:teuthology.orchestra.run.smithi018.stderr:/bin/podman: 1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5 2024-02-10T08:10:48.608 INFO:teuthology.orchestra.run.smithi018.stderr:ceph: ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable) 2024-02-10T08:10:49.288 INFO:teuthology.orchestra.run.smithi018.stderr:Ceph version: ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable) 2024-02-10T08:10:49.288 INFO:teuthology.orchestra.run.smithi018.stderr:Extracting ceph user uid/gid from container image... 2024-02-10T08:10:49.883 INFO:teuthology.orchestra.run.smithi018.stderr:stat: 167 167 2024-02-10T08:10:50.504 INFO:teuthology.orchestra.run.smithi018.stderr:Creating initial keys... 2024-02-10T08:10:51.139 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-authtool: AQCLL8dl03CFARAAazfvwbk0OktKcs2/V2m9BQ== 2024-02-10T08:10:52.311 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-authtool: AQCML8dl3/lvDBAADtVCs3xENMXNP9DqRpb2nA== 2024-02-10T08:10:53.417 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-authtool: AQCNL8dlxUAlExAALh2rpTWKrFAuy8ZGbMpjAQ== 2024-02-10T08:10:54.015 INFO:teuthology.orchestra.run.smithi018.stderr:Creating initial monmap... 2024-02-10T08:10:54.573 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: monmap file /tmp/monmap 2024-02-10T08:10:54.573 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: set fsid to d46257c8-c7eb-11ee-95b8-87774f69a715 2024-02-10T08:10:54.573 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-02-10T08:10:55.072 INFO:teuthology.orchestra.run.smithi018.stderr:monmaptool for a [v2:172.21.15.18:3300,v1:172.21.15.18:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-02-10T08:10:55.072 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/monmaptool: set fsid to d46257c8-c7eb-11ee-95b8-87774f69a715 2024-02-10T08:10:55.073 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-02-10T08:10:55.073 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-02-10T08:10:55.073 INFO:teuthology.orchestra.run.smithi018.stderr:Creating mon... 2024-02-10T08:10:55.808 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.552+0000 7fe07689e880 0 set uid:gid to 167:167 (ceph:ceph) 2024-02-10T08:10:55.808 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.552+0000 7fe07689e880 1 imported monmap: 2024-02-10T08:10:55.808 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: epoch 0 2024-02-10T08:10:55.808 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: fsid d46257c8-c7eb-11ee-95b8-87774f69a715 2024-02-10T08:10:55.809 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: last_changed 2024-02-10T08:10:54.474384+0000 2024-02-10T08:10:55.809 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: created 2024-02-10T08:10:54.474384+0000 2024-02-10T08:10:55.809 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: min_mon_release 0 (unknown) 2024-02-10T08:10:55.809 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: election_strategy: 1 2024-02-10T08:10:55.809 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: 0: [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] mon.a 2024-02-10T08:10:55.809 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: 2024-02-10T08:10:55.809 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.552+0000 7fe07689e880 0 /usr/bin/ceph-mon: set fsid to d46257c8-c7eb-11ee-95b8-87774f69a715 2024-02-10T08:10:55.809 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: RocksDB version: 6.8.1 2024-02-10T08:10:55.809 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: 2024-02-10T08:10:55.809 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-02-10T08:10:55.809 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: Compile date Feb 8 2024 2024-02-10T08:10:55.809 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: DB SUMMARY 2024-02-10T08:10:55.809 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: 2024-02-10T08:10:55.810 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 0, files: 2024-02-10T08:10:55.810 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: 2024-02-10T08:10:55.810 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 2024-02-10T08:10:55.810 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: 2024-02-10T08:10:55.810 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: Options.error_if_exists: 0 2024-02-10T08:10:55.810 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: Options.create_if_missing: 1 2024-02-10T08:10:55.810 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: Options.paranoid_checks: 1 2024-02-10T08:10:55.810 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: Options.env: 0x55c2e4c88080 2024-02-10T08:10:55.810 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: Options.fs: Posix File System 2024-02-10T08:10:55.810 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: Options.info_log: 0x55c2e674fa80 2024-02-10T08:10:55.810 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: Options.max_file_opening_threads: 16 2024-02-10T08:10:55.810 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: Options.statistics: (nil) 2024-02-10T08:10:55.810 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: Options.use_fsync: 0 2024-02-10T08:10:55.810 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: Options.max_log_file_size: 0 2024-02-10T08:10:55.811 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-10T08:10:55.811 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: Options.log_file_time_to_roll: 0 2024-02-10T08:10:55.811 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: Options.keep_log_file_num: 1000 2024-02-10T08:10:55.811 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: Options.recycle_log_file_num: 0 2024-02-10T08:10:55.811 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: Options.allow_fallocate: 1 2024-02-10T08:10:55.811 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: Options.allow_mmap_reads: 0 2024-02-10T08:10:55.811 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: Options.allow_mmap_writes: 0 2024-02-10T08:10:55.811 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: Options.use_direct_reads: 0 2024-02-10T08:10:55.811 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-10T08:10:55.811 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: Options.create_missing_column_families: 0 2024-02-10T08:10:55.811 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: Options.db_log_dir: 2024-02-10T08:10:55.811 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2024-02-10T08:10:55.811 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: Options.table_cache_numshardbits: 6 2024-02-10T08:10:55.811 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: Options.max_subcompactions: 1 2024-02-10T08:10:55.811 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: Options.max_background_flushes: -1 2024-02-10T08:10:55.812 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-02-10T08:10:55.812 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-02-10T08:10:55.812 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-10T08:10:55.812 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-10T08:10:55.812 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-02-10T08:10:55.812 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: Options.advise_random_on_open: 1 2024-02-10T08:10:55.812 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: Options.db_write_buffer_size: 0 2024-02-10T08:10:55.812 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: Options.write_buffer_manager: 0x55c2e6755950 2024-02-10T08:10:55.812 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-10T08:10:55.812 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-02-10T08:10:55.812 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-10T08:10:55.812 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: Options.use_adaptive_mutex: 0 2024-02-10T08:10:55.812 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: Options.rate_limiter: (nil) 2024-02-10T08:10:55.812 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-10T08:10:55.812 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: Options.wal_recovery_mode: 2 2024-02-10T08:10:55.813 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: Options.enable_thread_tracking: 0 2024-02-10T08:10:55.813 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: Options.enable_pipelined_write: 0 2024-02-10T08:10:55.813 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: Options.unordered_write: 0 2024-02-10T08:10:55.813 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-10T08:10:55.813 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-10T08:10:55.813 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-10T08:10:55.813 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-10T08:10:55.813 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: Options.row_cache: None 2024-02-10T08:10:55.813 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: Options.wal_filter: None 2024-02-10T08:10:55.813 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-10T08:10:55.813 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: Options.allow_ingest_behind: 0 2024-02-10T08:10:55.813 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: Options.preserve_deletes: 0 2024-02-10T08:10:55.813 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: Options.two_write_queues: 0 2024-02-10T08:10:55.813 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: Options.manual_wal_flush: 0 2024-02-10T08:10:55.813 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: Options.atomic_flush: 0 2024-02-10T08:10:55.814 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-10T08:10:55.814 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: Options.persist_stats_to_disk: 0 2024-02-10T08:10:55.814 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-02-10T08:10:55.814 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: Options.log_readahead_size: 0 2024-02-10T08:10:55.814 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: Options.sst_file_checksum_func: Unknown 2024-02-10T08:10:55.814 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: Options.max_background_jobs: 2 2024-02-10T08:10:55.814 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: Options.max_background_compactions: -1 2024-02-10T08:10:55.814 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-10T08:10:55.814 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-10T08:10:55.814 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: Options.delayed_write_rate : 16777216 2024-02-10T08:10:55.814 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: Options.max_total_wal_size: 0 2024-02-10T08:10:55.814 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-10T08:10:55.814 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: Options.stats_dump_period_sec: 600 2024-02-10T08:10:55.814 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: Options.stats_persist_period_sec: 600 2024-02-10T08:10:55.815 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-10T08:10:55.815 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: Options.max_open_files: -1 2024-02-10T08:10:55.815 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: Options.bytes_per_sync: 0 2024-02-10T08:10:55.815 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-02-10T08:10:55.815 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-02-10T08:10:55.815 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: Options.compaction_readahead_size: 0 2024-02-10T08:10:55.815 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: Compression algorithms supported: 2024-02-10T08:10:55.815 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-10T08:10:55.815 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: kZSTD supported: 0 2024-02-10T08:10:55.815 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: kXpressCompression supported: 0 2024-02-10T08:10:55.815 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: kLZ4HCCompression supported: 1 2024-02-10T08:10:55.815 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: kLZ4Compression supported: 1 2024-02-10T08:10:55.815 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: kBZip2Compression supported: 0 2024-02-10T08:10:55.816 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: kZlibCompression supported: 1 2024-02-10T08:10:55.816 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: kSnappyCompression supported: 1 2024-02-10T08:10:55.816 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.553+0000 7fe07689e880 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-02-10T08:10:55.816 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.554+0000 7fe07689e880 4 rocksdb: [db_impl/db_impl_open.cc:273] Creating manifest 1 2024-02-10T08:10:55.816 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: 2024-02-10T08:10:55.816 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.554+0000 7fe07689e880 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 2024-02-10T08:10:55.816 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: 2024-02-10T08:10:55.816 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.554+0000 7fe07689e880 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2024-02-10T08:10:55.816 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: 2024-02-10T08:10:55.816 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.554+0000 7fe07689e880 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-10T08:10:55.816 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.554+0000 7fe07689e880 4 rocksdb: Options.merge_operator: 2024-02-10T08:10:55.816 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.554+0000 7fe07689e880 4 rocksdb: Options.compaction_filter: None 2024-02-10T08:10:55.816 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.554+0000 7fe07689e880 4 rocksdb: Options.compaction_filter_factory: None 2024-02-10T08:10:55.817 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.554+0000 7fe07689e880 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-02-10T08:10:55.817 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.554+0000 7fe07689e880 4 rocksdb: Options.table_factory: BlockBasedTable 2024-02-10T08:10:55.817 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.554+0000 7fe07689e880 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55c2e6665d30) 2024-02-10T08:10:55.817 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: cache_index_and_filter_blocks: 1 2024-02-10T08:10:55.817 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-10T08:10:55.817 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-10T08:10:55.817 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: pin_top_level_index_and_filter: 1 2024-02-10T08:10:55.817 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: index_type: 0 2024-02-10T08:10:55.817 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: data_block_index_type: 0 2024-02-10T08:10:55.817 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: index_shortening: 1 2024-02-10T08:10:55.817 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: data_block_hash_table_util_ratio: 0.750000 2024-02-10T08:10:55.817 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: hash_index_allow_collision: 1 2024-02-10T08:10:55.817 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: checksum: 1 2024-02-10T08:10:55.817 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: no_block_cache: 0 2024-02-10T08:10:55.817 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: block_cache: 0x55c2e669ad10 2024-02-10T08:10:55.817 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: block_cache_name: BinnedLRUCache 2024-02-10T08:10:55.818 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: block_cache_options: 2024-02-10T08:10:55.818 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: capacity : 536870912 2024-02-10T08:10:55.818 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: num_shard_bits : 4 2024-02-10T08:10:55.818 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: strict_capacity_limit : 0 2024-02-10T08:10:55.818 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: high_pri_pool_ratio: 0.000 2024-02-10T08:10:55.818 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: block_cache_compressed: (nil) 2024-02-10T08:10:55.818 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: persistent_cache: (nil) 2024-02-10T08:10:55.818 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: block_size: 4096 2024-02-10T08:10:55.818 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: block_size_deviation: 10 2024-02-10T08:10:55.818 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: block_restart_interval: 16 2024-02-10T08:10:55.818 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: index_block_restart_interval: 1 2024-02-10T08:10:55.818 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: metadata_block_size: 4096 2024-02-10T08:10:55.818 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: partition_filters: 0 2024-02-10T08:10:55.818 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: use_delta_encoding: 1 2024-02-10T08:10:55.818 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: filter_policy: rocksdb.BuiltinBloomFilter 2024-02-10T08:10:55.819 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: whole_key_filtering: 1 2024-02-10T08:10:55.819 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: verify_compression: 0 2024-02-10T08:10:55.819 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: read_amp_bytes_per_bit: 0 2024-02-10T08:10:55.819 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: format_version: 2 2024-02-10T08:10:55.819 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: enable_index_compression: 1 2024-02-10T08:10:55.819 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: block_align: 0 2024-02-10T08:10:55.819 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: 2024-02-10T08:10:55.819 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.554+0000 7fe07689e880 4 rocksdb: Options.write_buffer_size: 33554432 2024-02-10T08:10:55.819 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.554+0000 7fe07689e880 4 rocksdb: Options.max_write_buffer_number: 2 2024-02-10T08:10:55.819 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.554+0000 7fe07689e880 4 rocksdb: Options.compression: NoCompression 2024-02-10T08:10:55.819 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.554+0000 7fe07689e880 4 rocksdb: Options.bottommost_compression: Disabled 2024-02-10T08:10:55.819 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.554+0000 7fe07689e880 4 rocksdb: Options.prefix_extractor: nullptr 2024-02-10T08:10:55.819 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.554+0000 7fe07689e880 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-10T08:10:55.819 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.554+0000 7fe07689e880 4 rocksdb: Options.num_levels: 7 2024-02-10T08:10:55.819 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.554+0000 7fe07689e880 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-10T08:10:55.820 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.554+0000 7fe07689e880 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-10T08:10:55.820 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.554+0000 7fe07689e880 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-10T08:10:55.820 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.554+0000 7fe07689e880 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-10T08:10:55.820 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.554+0000 7fe07689e880 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-10T08:10:55.820 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.554+0000 7fe07689e880 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-10T08:10:55.820 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.554+0000 7fe07689e880 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-10T08:10:55.820 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.554+0000 7fe07689e880 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-10T08:10:55.820 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.554+0000 7fe07689e880 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-10T08:10:55.820 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.554+0000 7fe07689e880 4 rocksdb: Options.compression_opts.window_bits: -14 2024-02-10T08:10:55.820 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.554+0000 7fe07689e880 4 rocksdb: Options.compression_opts.level: 32767 2024-02-10T08:10:55.820 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.554+0000 7fe07689e880 4 rocksdb: Options.compression_opts.strategy: 0 2024-02-10T08:10:55.820 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.554+0000 7fe07689e880 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-10T08:10:55.820 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.554+0000 7fe07689e880 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-10T08:10:55.821 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.554+0000 7fe07689e880 4 rocksdb: Options.compression_opts.enabled: false 2024-02-10T08:10:55.821 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.554+0000 7fe07689e880 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-10T08:10:55.821 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.554+0000 7fe07689e880 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-10T08:10:55.821 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.554+0000 7fe07689e880 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-10T08:10:55.821 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.554+0000 7fe07689e880 4 rocksdb: Options.target_file_size_base: 67108864 2024-02-10T08:10:55.821 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.554+0000 7fe07689e880 4 rocksdb: Options.target_file_size_multiplier: 1 2024-02-10T08:10:55.821 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.554+0000 7fe07689e880 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-10T08:10:55.821 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.554+0000 7fe07689e880 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-10T08:10:55.821 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.554+0000 7fe07689e880 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-10T08:10:55.821 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.554+0000 7fe07689e880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-10T08:10:55.821 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.554+0000 7fe07689e880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-10T08:10:55.821 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.554+0000 7fe07689e880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-10T08:10:55.821 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.554+0000 7fe07689e880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-10T08:10:55.821 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.554+0000 7fe07689e880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-10T08:10:55.822 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.554+0000 7fe07689e880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-10T08:10:55.822 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.554+0000 7fe07689e880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-10T08:10:55.822 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.554+0000 7fe07689e880 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-10T08:10:55.822 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.554+0000 7fe07689e880 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-10T08:10:55.822 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.554+0000 7fe07689e880 4 rocksdb: Options.arena_block_size: 4194304 2024-02-10T08:10:55.822 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.554+0000 7fe07689e880 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-10T08:10:55.822 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.554+0000 7fe07689e880 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-10T08:10:55.822 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.554+0000 7fe07689e880 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-02-10T08:10:55.822 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.554+0000 7fe07689e880 4 rocksdb: Options.disable_auto_compactions: 0 2024-02-10T08:10:55.822 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.554+0000 7fe07689e880 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-10T08:10:55.822 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.554+0000 7fe07689e880 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-10T08:10:55.822 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.554+0000 7fe07689e880 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-10T08:10:55.822 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.554+0000 7fe07689e880 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-10T08:10:55.822 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.554+0000 7fe07689e880 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-10T08:10:55.822 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.554+0000 7fe07689e880 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-10T08:10:55.823 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.554+0000 7fe07689e880 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-10T08:10:55.823 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.554+0000 7fe07689e880 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-10T08:10:55.823 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.554+0000 7fe07689e880 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-10T08:10:55.823 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.554+0000 7fe07689e880 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-10T08:10:55.823 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.554+0000 7fe07689e880 4 rocksdb: Options.table_properties_collectors: 2024-02-10T08:10:55.823 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.554+0000 7fe07689e880 4 rocksdb: Options.inplace_update_support: 0 2024-02-10T08:10:55.823 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.554+0000 7fe07689e880 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-02-10T08:10:55.823 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.554+0000 7fe07689e880 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-10T08:10:55.823 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.554+0000 7fe07689e880 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-10T08:10:55.823 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.554+0000 7fe07689e880 4 rocksdb: Options.memtable_huge_page_size: 0 2024-02-10T08:10:55.823 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.554+0000 7fe07689e880 4 rocksdb: Options.bloom_locality: 0 2024-02-10T08:10:55.823 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.554+0000 7fe07689e880 4 rocksdb: Options.max_successive_merges: 0 2024-02-10T08:10:55.823 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.554+0000 7fe07689e880 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-02-10T08:10:55.823 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.554+0000 7fe07689e880 4 rocksdb: Options.paranoid_file_checks: 0 2024-02-10T08:10:55.823 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.554+0000 7fe07689e880 4 rocksdb: Options.force_consistency_checks: 0 2024-02-10T08:10:55.824 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.554+0000 7fe07689e880 4 rocksdb: Options.report_bg_io_stats: 0 2024-02-10T08:10:55.824 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.554+0000 7fe07689e880 4 rocksdb: Options.ttl: 2592000 2024-02-10T08:10:55.824 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.554+0000 7fe07689e880 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-02-10T08:10:55.824 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.555+0000 7fe07689e880 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-02-10T08:10:55.824 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: 2024-02-10T08:10:55.824 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.555+0000 7fe07689e880 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 0 2024-02-10T08:10:55.824 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: 2024-02-10T08:10:55.824 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.555+0000 7fe07689e880 4 rocksdb: DB pointer 0x55c2e6763800 2024-02-10T08:10:55.824 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.555+0000 7fe05f710700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2024-02-10T08:10:55.824 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.555+0000 7fe05f710700 4 rocksdb: [db_impl/db_impl.cc:851] 2024-02-10T08:10:55.824 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: ** DB Stats ** 2024-02-10T08:10:55.824 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: Uptime(secs): 0.0 total, 0.0 interval 2024-02-10T08:10:55.824 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-10T08:10:55.824 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-10T08:10:55.825 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-10T08:10:55.825 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-10T08:10:55.825 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-02-10T08:10:55.825 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-10T08:10:55.825 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: 2024-02-10T08:10:55.825 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2024-02-10T08:10:55.825 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-10T08:10:55.825 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-10T08:10:55.825 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-10T08:10:55.825 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-10T08:10:55.825 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: 2024-02-10T08:10:55.825 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2024-02-10T08:10:55.825 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-10T08:10:55.825 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-10T08:10:55.825 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: Uptime(secs): 0.0 total, 0.0 interval 2024-02-10T08:10:55.826 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: Flush(GB): cumulative 0.000, interval 0.000 2024-02-10T08:10:55.826 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-10T08:10:55.826 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: AddFile(Total Files): cumulative 0, interval 0 2024-02-10T08:10:55.826 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: AddFile(L0 Files): cumulative 0, interval 0 2024-02-10T08:10:55.826 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: AddFile(Keys): cumulative 0, interval 0 2024-02-10T08:10:55.826 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-10T08:10:55.826 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-10T08:10:55.826 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-10T08:10:55.826 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: 2024-02-10T08:10:55.826 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: ** File Read Latency Histogram By Level [default] ** 2024-02-10T08:10:55.826 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: 2024-02-10T08:10:55.826 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2024-02-10T08:10:55.826 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-10T08:10:55.826 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-10T08:10:55.826 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-10T08:10:55.827 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-10T08:10:55.827 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: 2024-02-10T08:10:55.827 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2024-02-10T08:10:55.827 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-10T08:10:55.827 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-10T08:10:55.827 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: Uptime(secs): 0.0 total, 0.0 interval 2024-02-10T08:10:55.827 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: Flush(GB): cumulative 0.000, interval 0.000 2024-02-10T08:10:55.827 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-10T08:10:55.827 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: AddFile(Total Files): cumulative 0, interval 0 2024-02-10T08:10:55.827 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: AddFile(L0 Files): cumulative 0, interval 0 2024-02-10T08:10:55.827 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: AddFile(Keys): cumulative 0, interval 0 2024-02-10T08:10:55.827 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-10T08:10:55.827 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-10T08:10:55.827 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-10T08:10:55.827 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: 2024-02-10T08:10:55.827 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: ** File Read Latency Histogram By Level [default] ** 2024-02-10T08:10:55.828 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: 2024-02-10T08:10:55.828 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.557+0000 7fe07689e880 4 rocksdb: [db_impl/db_impl.cc:397] Shutdown: canceling all background work 2024-02-10T08:10:55.828 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.557+0000 7fe07689e880 4 rocksdb: [db_impl/db_impl.cc:573] Shutdown complete 2024-02-10T08:10:55.828 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph-mon: debug 2024-02-10T08:10:55.557+0000 7fe07689e880 0 /usr/bin/ceph-mon: created monfs at /var/lib/ceph/mon/ceph-a for mon.a 2024-02-10T08:10:56.360 INFO:teuthology.orchestra.run.smithi018.stderr:create mon.a on 2024-02-10T08:10:56.374 INFO:teuthology.orchestra.run.smithi018.stderr:systemctl: Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2024-02-10T08:10:56.471 INFO:teuthology.orchestra.run.smithi018.stderr:systemctl: Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-02-10T08:10:56.570 INFO:teuthology.orchestra.run.smithi018.stderr:systemctl: Created symlink /etc/systemd/system/multi-user.target.wants/ceph-d46257c8-c7eb-11ee-95b8-87774f69a715.target → /etc/systemd/system/ceph-d46257c8-c7eb-11ee-95b8-87774f69a715.target. 2024-02-10T08:10:56.570 INFO:teuthology.orchestra.run.smithi018.stderr:systemctl: Created symlink /etc/systemd/system/ceph.target.wants/ceph-d46257c8-c7eb-11ee-95b8-87774f69a715.target → /etc/systemd/system/ceph-d46257c8-c7eb-11ee-95b8-87774f69a715.target. 2024-02-10T08:10:56.787 INFO:teuthology.orchestra.run.smithi018.stderr:systemctl: Failed to reset failed state of unit ceph-d46257c8-c7eb-11ee-95b8-87774f69a715@mon.a.service: Unit ceph-d46257c8-c7eb-11ee-95b8-87774f69a715@mon.a.service not loaded. 2024-02-10T08:10:56.794 INFO:teuthology.orchestra.run.smithi018.stderr:systemctl: Created symlink /etc/systemd/system/ceph-d46257c8-c7eb-11ee-95b8-87774f69a715.target.wants/ceph-d46257c8-c7eb-11ee-95b8-87774f69a715@mon.a.service → /etc/systemd/system/ceph-d46257c8-c7eb-11ee-95b8-87774f69a715@.service. 2024-02-10T08:10:57.507 INFO:teuthology.orchestra.run.smithi018.stderr:systemctl: disabled 2024-02-10T08:10:57.514 INFO:teuthology.orchestra.run.smithi018.stderr:systemctl: inactive 2024-02-10T08:10:57.515 INFO:teuthology.orchestra.run.smithi018.stderr:firewalld.service is not enabled 2024-02-10T08:10:57.515 INFO:teuthology.orchestra.run.smithi018.stderr:Not possible to enable service . firewalld.service is not available 2024-02-10T08:10:57.515 INFO:teuthology.orchestra.run.smithi018.stderr:Waiting for mon to start... 2024-02-10T08:10:57.515 INFO:teuthology.orchestra.run.smithi018.stderr:Waiting for mon... 2024-02-10T08:10:57.724 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:10:57 smithi018 bash[39005]: 33866c61c6aa5eab02c3fd68ad967d47d761dbbde65c24a96c670dcc08361138 2024-02-10T08:10:57.725 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:10:57 smithi018 systemd[1]: Started Ceph mon.a for d46257c8-c7eb-11ee-95b8-87774f69a715. 2024-02-10T08:10:58.081 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: cluster: 2024-02-10T08:10:58.083 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: id: d46257c8-c7eb-11ee-95b8-87774f69a715 2024-02-10T08:10:58.083 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: health: HEALTH_OK 2024-02-10T08:10:58.083 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: 2024-02-10T08:10:58.083 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: services: 2024-02-10T08:10:58.083 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: mon: 1 daemons, quorum a (age 0.65676s) 2024-02-10T08:10:58.083 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: mgr: no daemons active 2024-02-10T08:10:58.083 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: osd: 0 osds: 0 up, 0 in 2024-02-10T08:10:58.084 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: 2024-02-10T08:10:58.084 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: data: 2024-02-10T08:10:58.084 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: pools: 0 pools, 0 pgs 2024-02-10T08:10:58.084 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: objects: 0 objects, 0 B 2024-02-10T08:10:58.084 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: usage: 0 B used, 0 B / 0 B avail 2024-02-10T08:10:58.084 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: pgs: 2024-02-10T08:10:58.084 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: 2024-02-10T08:10:58.838 INFO:teuthology.orchestra.run.smithi018.stderr:mon is available 2024-02-10T08:10:58.838 INFO:teuthology.orchestra.run.smithi018.stderr:Assimilating anything we can from ceph.conf... 2024-02-10T08:10:58.841 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:10:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39019]: cluster 2024-02-10T08:10:57.424416+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2024-02-10T08:10:58.841 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:10:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39019]: cluster 2024-02-10T08:10:57.424532+0000 mon.a (mon.0) 3 : cluster [DBG] monmap e1: 1 mons at {a=[v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0]} removed_ranks: {} 2024-02-10T08:10:58.841 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:10:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39019]: cluster 2024-02-10T08:10:57.426272+0000 mon.a (mon.0) 4 : cluster [DBG] fsmap 2024-02-10T08:10:58.841 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:10:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39019]: cluster 2024-02-10T08:10:57.427921+0000 mon.a (mon.0) 5 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2024-02-10T08:10:58.841 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:10:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39019]: cluster 2024-02-10T08:10:57.428283+0000 mon.a (mon.0) 6 : cluster [DBG] mgrmap e1: no daemons active 2024-02-10T08:10:58.841 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:10:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39019]: audit 2024-02-10T08:10:58.081141+0000 mon.a (mon.0) 7 : audit [DBG] from='client.? 172.21.15.18:0/4025393576' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-02-10T08:10:59.542 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: 2024-02-10T08:10:59.542 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: [global] 2024-02-10T08:10:59.542 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: fsid = d46257c8-c7eb-11ee-95b8-87774f69a715 2024-02-10T08:10:59.542 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: log_to_journald = false 2024-02-10T08:10:59.542 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: mon_host = [v2:172.21.15.18:3300,v1:172.21.15.18:6789] 2024-02-10T08:10:59.543 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: mon_osd_allow_pg_remap = true 2024-02-10T08:10:59.543 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: mon_osd_allow_primary_affinity = true 2024-02-10T08:10:59.543 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: mon_warn_on_no_sortbitwise = false 2024-02-10T08:10:59.543 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: osd_crush_chooseleaf_type = 0 2024-02-10T08:10:59.543 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: 2024-02-10T08:10:59.543 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: [mgr] 2024-02-10T08:10:59.544 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: mgr/telemetry/nag = false 2024-02-10T08:10:59.544 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: 2024-02-10T08:10:59.544 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: [osd] 2024-02-10T08:10:59.544 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: osd_map_max_advance = 10 2024-02-10T08:10:59.544 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: osd_sloppy_crc = true 2024-02-10T08:10:59.824 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:10:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39019]: audit 2024-02-10T08:10:59.535423+0000 mon.a (mon.0) 8 : audit [INF] from='client.? 172.21.15.18:0/2812107285' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-02-10T08:10:59.824 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:10:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39019]: audit 2024-02-10T08:10:59.538344+0000 mon.a (mon.0) 9 : audit [INF] from='client.? 172.21.15.18:0/2812107285' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-02-10T08:11:00.071 INFO:teuthology.orchestra.run.smithi018.stderr:Generating new minimal ceph.conf... 2024-02-10T08:11:00.974 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39019]: audit 2024-02-10T08:11:00.669059+0000 mon.a (mon.0) 10 : audit [DBG] from='client.? 172.21.15.18:0/1744254805' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:11:01.185 INFO:teuthology.orchestra.run.smithi018.stderr:Restarting the monitor... 2024-02-10T08:11:01.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:01 smithi018 systemd[1]: Stopping Ceph mon.a for d46257c8-c7eb-11ee-95b8-87774f69a715... 2024-02-10T08:11:01.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:01 smithi018 bash[39344]: Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon.a" found: no such container 2024-02-10T08:11:01.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39019]: debug 2024-02-10T08:11:01.449+0000 7f94fc42d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-02-10T08:11:01.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39019]: debug 2024-02-10T08:11:01.449+0000 7f94fc42d700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-02-10T08:11:03.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:03 smithi018 bash[39384]: ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a 2024-02-10T08:11:04.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 systemd[1]: ceph-d46257c8-c7eb-11ee-95b8-87774f69a715@mon.a.service: Succeeded. 2024-02-10T08:11:04.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 systemd[1]: Stopped Ceph mon.a for d46257c8-c7eb-11ee-95b8-87774f69a715. 2024-02-10T08:11:04.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 systemd[1]: Starting Ceph mon.a for d46257c8-c7eb-11ee-95b8-87774f69a715... 2024-02-10T08:11:04.931 INFO:teuthology.orchestra.run.smithi018.stderr:Setting public_network to 172.21.0.0/20 in mon config section 2024-02-10T08:11:05.139 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.862+0000 7f973aaf7880 0 set uid:gid to 167:167 (ceph:ceph) 2024-02-10T08:11:05.139 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.862+0000 7f973aaf7880 0 ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable), process ceph-mon, pid 7 2024-02-10T08:11:05.139 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.862+0000 7f973aaf7880 0 pidfile_write: ignore empty --pid-file 2024-02-10T08:11:05.139 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.866+0000 7f973aaf7880 0 load: jerasure load: lrc load: isa 2024-02-10T08:11:05.139 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: RocksDB version: 6.8.1 2024-02-10T08:11:05.140 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: 2024-02-10T08:11:05.140 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-02-10T08:11:05.140 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: Compile date Feb 8 2024 2024-02-10T08:11:05.140 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: DB SUMMARY 2024-02-10T08:11:05.140 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: 2024-02-10T08:11:05.140 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: CURRENT file: CURRENT 2024-02-10T08:11:05.140 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: 2024-02-10T08:11:05.140 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: IDENTITY file: IDENTITY 2024-02-10T08:11:05.140 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: 2024-02-10T08:11:05.140 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 131 Bytes 2024-02-10T08:11:05.140 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: 2024-02-10T08:11:05.140 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000004.sst 2024-02-10T08:11:05.140 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: 2024-02-10T08:11:05.141 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000006.log size: 93737 ; 2024-02-10T08:11:05.141 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: 2024-02-10T08:11:05.141 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: Options.error_if_exists: 0 2024-02-10T08:11:05.141 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: Options.create_if_missing: 0 2024-02-10T08:11:05.141 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: Options.paranoid_checks: 1 2024-02-10T08:11:05.141 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: Options.env: 0x563a01879080 2024-02-10T08:11:05.141 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: Options.fs: Posix File System 2024-02-10T08:11:05.141 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: Options.info_log: 0x563a034aa260 2024-02-10T08:11:05.141 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: Options.max_file_opening_threads: 16 2024-02-10T08:11:05.141 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: Options.statistics: (nil) 2024-02-10T08:11:05.141 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: Options.use_fsync: 0 2024-02-10T08:11:05.141 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: Options.max_log_file_size: 0 2024-02-10T08:11:05.141 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-10T08:11:05.142 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: Options.log_file_time_to_roll: 0 2024-02-10T08:11:05.142 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: Options.keep_log_file_num: 1000 2024-02-10T08:11:05.142 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: Options.recycle_log_file_num: 0 2024-02-10T08:11:05.142 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: Options.allow_fallocate: 1 2024-02-10T08:11:05.142 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: Options.allow_mmap_reads: 0 2024-02-10T08:11:05.142 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: Options.allow_mmap_writes: 0 2024-02-10T08:11:05.142 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: Options.use_direct_reads: 0 2024-02-10T08:11:05.142 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-10T08:11:05.142 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: Options.create_missing_column_families: 0 2024-02-10T08:11:05.142 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: Options.db_log_dir: 2024-02-10T08:11:05.142 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2024-02-10T08:11:05.142 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: Options.table_cache_numshardbits: 6 2024-02-10T08:11:05.142 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: Options.max_subcompactions: 1 2024-02-10T08:11:05.143 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: Options.max_background_flushes: -1 2024-02-10T08:11:05.143 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-02-10T08:11:05.145 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-02-10T08:11:05.145 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-10T08:11:05.145 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-10T08:11:05.145 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-02-10T08:11:05.145 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: Options.advise_random_on_open: 1 2024-02-10T08:11:05.145 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: Options.db_write_buffer_size: 0 2024-02-10T08:11:05.145 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: Options.write_buffer_manager: 0x563a0419c3f0 2024-02-10T08:11:05.145 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-10T08:11:05.145 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-02-10T08:11:05.145 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-10T08:11:05.145 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: Options.use_adaptive_mutex: 0 2024-02-10T08:11:05.145 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: Options.rate_limiter: (nil) 2024-02-10T08:11:05.146 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-10T08:11:05.146 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: Options.wal_recovery_mode: 2 2024-02-10T08:11:05.146 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: Options.enable_thread_tracking: 0 2024-02-10T08:11:05.146 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: Options.enable_pipelined_write: 0 2024-02-10T08:11:05.146 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: Options.unordered_write: 0 2024-02-10T08:11:05.146 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-10T08:11:05.146 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-10T08:11:05.146 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-10T08:11:05.146 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-10T08:11:05.146 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: Options.row_cache: None 2024-02-10T08:11:05.146 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: Options.wal_filter: None 2024-02-10T08:11:05.146 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-10T08:11:05.146 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: Options.allow_ingest_behind: 0 2024-02-10T08:11:05.147 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: Options.preserve_deletes: 0 2024-02-10T08:11:05.147 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: Options.two_write_queues: 0 2024-02-10T08:11:05.147 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: Options.manual_wal_flush: 0 2024-02-10T08:11:05.147 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: Options.atomic_flush: 0 2024-02-10T08:11:05.147 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-10T08:11:05.147 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: Options.persist_stats_to_disk: 0 2024-02-10T08:11:05.147 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-02-10T08:11:05.147 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: Options.log_readahead_size: 0 2024-02-10T08:11:05.147 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: Options.sst_file_checksum_func: Unknown 2024-02-10T08:11:05.147 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: Options.max_background_jobs: 2 2024-02-10T08:11:05.147 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: Options.max_background_compactions: -1 2024-02-10T08:11:05.147 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-10T08:11:05.147 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-10T08:11:05.147 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: Options.delayed_write_rate : 16777216 2024-02-10T08:11:05.148 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: Options.max_total_wal_size: 0 2024-02-10T08:11:05.148 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-10T08:11:05.148 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: Options.stats_dump_period_sec: 600 2024-02-10T08:11:05.148 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: Options.stats_persist_period_sec: 600 2024-02-10T08:11:05.148 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-10T08:11:05.148 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: Options.max_open_files: -1 2024-02-10T08:11:05.148 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: Options.bytes_per_sync: 0 2024-02-10T08:11:05.148 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-02-10T08:11:05.148 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-02-10T08:11:05.148 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: Options.compaction_readahead_size: 0 2024-02-10T08:11:05.148 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: Compression algorithms supported: 2024-02-10T08:11:05.148 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-10T08:11:05.148 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: kZSTD supported: 0 2024-02-10T08:11:05.148 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: kXpressCompression supported: 0 2024-02-10T08:11:05.149 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: kLZ4HCCompression supported: 1 2024-02-10T08:11:05.149 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: kLZ4Compression supported: 1 2024-02-10T08:11:05.149 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: kBZip2Compression supported: 0 2024-02-10T08:11:05.149 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: kZlibCompression supported: 1 2024-02-10T08:11:05.149 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: kSnappyCompression supported: 1 2024-02-10T08:11:05.149 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-02-10T08:11:05.149 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.867+0000 7f973aaf7880 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000005 2024-02-10T08:11:05.149 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: 2024-02-10T08:11:05.149 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.868+0000 7f973aaf7880 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2024-02-10T08:11:05.149 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: 2024-02-10T08:11:05.149 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.868+0000 7f973aaf7880 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-10T08:11:05.149 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.868+0000 7f973aaf7880 4 rocksdb: Options.merge_operator: 2024-02-10T08:11:05.149 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.868+0000 7f973aaf7880 4 rocksdb: Options.compaction_filter: None 2024-02-10T08:11:05.149 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.868+0000 7f973aaf7880 4 rocksdb: Options.compaction_filter_factory: None 2024-02-10T08:11:05.150 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.868+0000 7f973aaf7880 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-02-10T08:11:05.150 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.868+0000 7f973aaf7880 4 rocksdb: Options.table_factory: BlockBasedTable 2024-02-10T08:11:05.150 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.868+0000 7f973aaf7880 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x563a0344fd28) 2024-02-10T08:11:05.150 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cache_index_and_filter_blocks: 1 2024-02-10T08:11:05.150 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-10T08:11:05.150 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-10T08:11:05.150 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: pin_top_level_index_and_filter: 1 2024-02-10T08:11:05.150 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: index_type: 0 2024-02-10T08:11:05.150 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: data_block_index_type: 0 2024-02-10T08:11:05.150 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: index_shortening: 1 2024-02-10T08:11:05.150 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: data_block_hash_table_util_ratio: 0.750000 2024-02-10T08:11:05.150 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: hash_index_allow_collision: 1 2024-02-10T08:11:05.150 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: checksum: 1 2024-02-10T08:11:05.150 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: no_block_cache: 0 2024-02-10T08:11:05.151 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: block_cache: 0x563a03484f10 2024-02-10T08:11:05.151 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: block_cache_name: BinnedLRUCache 2024-02-10T08:11:05.151 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: block_cache_options: 2024-02-10T08:11:05.151 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: capacity : 536870912 2024-02-10T08:11:05.151 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: num_shard_bits : 4 2024-02-10T08:11:05.151 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: strict_capacity_limit : 0 2024-02-10T08:11:05.151 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: high_pri_pool_ratio: 0.000 2024-02-10T08:11:05.151 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: block_cache_compressed: (nil) 2024-02-10T08:11:05.151 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: persistent_cache: (nil) 2024-02-10T08:11:05.151 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: block_size: 4096 2024-02-10T08:11:05.151 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: block_size_deviation: 10 2024-02-10T08:11:05.151 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: block_restart_interval: 16 2024-02-10T08:11:05.151 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: index_block_restart_interval: 1 2024-02-10T08:11:05.151 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: metadata_block_size: 4096 2024-02-10T08:11:05.151 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: partition_filters: 0 2024-02-10T08:11:05.152 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: use_delta_encoding: 1 2024-02-10T08:11:05.152 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: filter_policy: rocksdb.BuiltinBloomFilter 2024-02-10T08:11:05.152 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: whole_key_filtering: 1 2024-02-10T08:11:05.152 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: verify_compression: 0 2024-02-10T08:11:05.152 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: read_amp_bytes_per_bit: 0 2024-02-10T08:11:05.152 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: format_version: 2 2024-02-10T08:11:05.152 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: enable_index_compression: 1 2024-02-10T08:11:05.152 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: block_align: 0 2024-02-10T08:11:05.152 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: 2024-02-10T08:11:05.152 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.868+0000 7f973aaf7880 4 rocksdb: Options.write_buffer_size: 33554432 2024-02-10T08:11:05.152 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.868+0000 7f973aaf7880 4 rocksdb: Options.max_write_buffer_number: 2 2024-02-10T08:11:05.152 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.868+0000 7f973aaf7880 4 rocksdb: Options.compression: NoCompression 2024-02-10T08:11:05.152 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.868+0000 7f973aaf7880 4 rocksdb: Options.bottommost_compression: Disabled 2024-02-10T08:11:05.153 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.868+0000 7f973aaf7880 4 rocksdb: Options.prefix_extractor: nullptr 2024-02-10T08:11:05.153 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.868+0000 7f973aaf7880 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-10T08:11:05.153 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.868+0000 7f973aaf7880 4 rocksdb: Options.num_levels: 7 2024-02-10T08:11:05.153 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.868+0000 7f973aaf7880 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-10T08:11:05.153 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.868+0000 7f973aaf7880 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-10T08:11:05.153 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.868+0000 7f973aaf7880 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-10T08:11:05.153 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.868+0000 7f973aaf7880 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-10T08:11:05.153 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.868+0000 7f973aaf7880 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-10T08:11:05.153 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.868+0000 7f973aaf7880 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-10T08:11:05.153 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.868+0000 7f973aaf7880 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-10T08:11:05.153 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.868+0000 7f973aaf7880 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-10T08:11:05.153 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.868+0000 7f973aaf7880 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-10T08:11:05.153 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.868+0000 7f973aaf7880 4 rocksdb: Options.compression_opts.window_bits: -14 2024-02-10T08:11:05.153 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.868+0000 7f973aaf7880 4 rocksdb: Options.compression_opts.level: 32767 2024-02-10T08:11:05.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.868+0000 7f973aaf7880 4 rocksdb: Options.compression_opts.strategy: 0 2024-02-10T08:11:05.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.868+0000 7f973aaf7880 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-10T08:11:05.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.868+0000 7f973aaf7880 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-10T08:11:05.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.868+0000 7f973aaf7880 4 rocksdb: Options.compression_opts.enabled: false 2024-02-10T08:11:05.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.868+0000 7f973aaf7880 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-10T08:11:05.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.868+0000 7f973aaf7880 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-10T08:11:05.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.868+0000 7f973aaf7880 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-10T08:11:05.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.868+0000 7f973aaf7880 4 rocksdb: Options.target_file_size_base: 67108864 2024-02-10T08:11:05.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.868+0000 7f973aaf7880 4 rocksdb: Options.target_file_size_multiplier: 1 2024-02-10T08:11:05.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.868+0000 7f973aaf7880 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-10T08:11:05.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.868+0000 7f973aaf7880 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-10T08:11:05.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.868+0000 7f973aaf7880 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-10T08:11:05.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.868+0000 7f973aaf7880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-10T08:11:05.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.868+0000 7f973aaf7880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-10T08:11:05.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.868+0000 7f973aaf7880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-10T08:11:05.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.868+0000 7f973aaf7880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-10T08:11:05.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.868+0000 7f973aaf7880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-10T08:11:05.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.868+0000 7f973aaf7880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-10T08:11:05.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.868+0000 7f973aaf7880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-10T08:11:05.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.868+0000 7f973aaf7880 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-10T08:11:05.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.868+0000 7f973aaf7880 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-10T08:11:05.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.868+0000 7f973aaf7880 4 rocksdb: Options.arena_block_size: 4194304 2024-02-10T08:11:05.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.868+0000 7f973aaf7880 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-10T08:11:05.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.868+0000 7f973aaf7880 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-10T08:11:05.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.868+0000 7f973aaf7880 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-02-10T08:11:05.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.868+0000 7f973aaf7880 4 rocksdb: Options.disable_auto_compactions: 0 2024-02-10T08:11:05.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.868+0000 7f973aaf7880 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-10T08:11:05.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.868+0000 7f973aaf7880 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-10T08:11:05.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.868+0000 7f973aaf7880 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-10T08:11:05.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.868+0000 7f973aaf7880 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-10T08:11:05.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.868+0000 7f973aaf7880 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-10T08:11:05.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.868+0000 7f973aaf7880 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-10T08:11:05.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.868+0000 7f973aaf7880 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-10T08:11:05.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.868+0000 7f973aaf7880 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-10T08:11:05.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.868+0000 7f973aaf7880 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-10T08:11:05.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.868+0000 7f973aaf7880 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-10T08:11:05.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.868+0000 7f973aaf7880 4 rocksdb: Options.table_properties_collectors: 2024-02-10T08:11:05.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.868+0000 7f973aaf7880 4 rocksdb: Options.inplace_update_support: 0 2024-02-10T08:11:05.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.868+0000 7f973aaf7880 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-02-10T08:11:05.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.868+0000 7f973aaf7880 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-10T08:11:05.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.868+0000 7f973aaf7880 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-10T08:11:05.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.868+0000 7f973aaf7880 4 rocksdb: Options.memtable_huge_page_size: 0 2024-02-10T08:11:05.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.868+0000 7f973aaf7880 4 rocksdb: Options.bloom_locality: 0 2024-02-10T08:11:05.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.868+0000 7f973aaf7880 4 rocksdb: Options.max_successive_merges: 0 2024-02-10T08:11:05.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.868+0000 7f973aaf7880 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-02-10T08:11:05.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.868+0000 7f973aaf7880 4 rocksdb: Options.paranoid_file_checks: 0 2024-02-10T08:11:05.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.868+0000 7f973aaf7880 4 rocksdb: Options.force_consistency_checks: 0 2024-02-10T08:11:05.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.868+0000 7f973aaf7880 4 rocksdb: Options.report_bg_io_stats: 0 2024-02-10T08:11:05.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.868+0000 7f973aaf7880 4 rocksdb: Options.ttl: 2592000 2024-02-10T08:11:05.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.868+0000 7f973aaf7880 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-02-10T08:11:05.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.868+0000 7f973aaf7880 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 5, log_number is 4,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-02-10T08:11:05.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: 2024-02-10T08:11:05.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.868+0000 7f973aaf7880 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 4 2024-02-10T08:11:05.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: 2024-02-10T08:11:05.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.868+0000 7f973aaf7880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1707552664869959, "job": 1, "event": "recovery_started", "log_files": [6]} 2024-02-10T08:11:05.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.868+0000 7f973aaf7880 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #6 mode 2 2024-02-10T08:11:05.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.869+0000 7f973aaf7880 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-02-10T08:11:05.158 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.869+0000 7f973aaf7880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1707552664870933, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 7, "file_size": 89659, "table_properties": {"data_size": 87785, "index_size": 351, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 709, "raw_key_size": 11380, "raw_average_key_size": 49, "raw_value_size": 81510, "raw_average_value_size": 351, "num_data_blocks": 11, "num_entries": 232, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1707552664, "oldest_key_time": 3, "file_creation_time": 0}} 2024-02-10T08:11:05.158 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.869+0000 7f973aaf7880 4 rocksdb: [version_set.cc:3826] Creating manifest 8 2024-02-10T08:11:05.158 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: 2024-02-10T08:11:05.158 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.870+0000 7f973aaf7880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1707552664871394, "job": 1, "event": "recovery_finished"} 2024-02-10T08:11:05.158 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.871+0000 7f973aaf7880 4 rocksdb: DB pointer 0x563a0354d800 2024-02-10T08:11:05.158 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.871+0000 7f97218e8700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2024-02-10T08:11:05.158 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.871+0000 7f97218e8700 4 rocksdb: [db_impl/db_impl.cc:851] 2024-02-10T08:11:05.158 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: ** DB Stats ** 2024-02-10T08:11:05.158 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-10T08:11:05.158 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-10T08:11:05.158 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-10T08:11:05.158 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-10T08:11:05.158 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-10T08:11:05.158 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-02-10T08:11:05.159 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-10T08:11:05.159 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: 2024-02-10T08:11:05.159 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: ** Compaction Stats [default] ** 2024-02-10T08:11:05.159 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-10T08:11:05.159 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-10T08:11:05.159 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: L0 2/0 89.21 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 138.6 0.00 0.00 1 0.001 0 0 2024-02-10T08:11:05.159 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: Sum 2/0 89.21 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 138.6 0.00 0.00 1 0.001 0 0 2024-02-10T08:11:05.159 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 138.6 0.00 0.00 1 0.001 0 0 2024-02-10T08:11:05.159 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: 2024-02-10T08:11:05.159 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: ** Compaction Stats [default] ** 2024-02-10T08:11:05.159 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-10T08:11:05.159 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-10T08:11:05.159 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 138.6 0.00 0.00 1 0.001 0 0 2024-02-10T08:11:05.159 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-10T08:11:05.159 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: Flush(GB): cumulative 0.000, interval 0.000 2024-02-10T08:11:05.159 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-10T08:11:05.160 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: AddFile(Total Files): cumulative 0, interval 0 2024-02-10T08:11:05.160 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: AddFile(L0 Files): cumulative 0, interval 0 2024-02-10T08:11:05.160 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: AddFile(Keys): cumulative 0, interval 0 2024-02-10T08:11:05.160 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: Cumulative compaction: 0.00 GB write, 26.63 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-10T08:11:05.160 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: Interval compaction: 0.00 GB write, 26.63 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-10T08:11:05.160 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-10T08:11:05.160 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: 2024-02-10T08:11:05.160 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: ** File Read Latency Histogram By Level [default] ** 2024-02-10T08:11:05.160 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: 2024-02-10T08:11:05.160 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: ** Compaction Stats [default] ** 2024-02-10T08:11:05.160 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-10T08:11:05.160 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-10T08:11:05.160 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: L0 2/0 89.21 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 138.6 0.00 0.00 1 0.001 0 0 2024-02-10T08:11:05.161 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: Sum 2/0 89.21 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 138.6 0.00 0.00 1 0.001 0 0 2024-02-10T08:11:05.161 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-10T08:11:05.161 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: 2024-02-10T08:11:05.161 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: ** Compaction Stats [default] ** 2024-02-10T08:11:05.161 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-10T08:11:05.161 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-10T08:11:05.161 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 138.6 0.00 0.00 1 0.001 0 0 2024-02-10T08:11:05.161 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-10T08:11:05.161 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: Flush(GB): cumulative 0.000, interval 0.000 2024-02-10T08:11:05.161 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-10T08:11:05.161 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: AddFile(Total Files): cumulative 0, interval 0 2024-02-10T08:11:05.161 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: AddFile(L0 Files): cumulative 0, interval 0 2024-02-10T08:11:05.161 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: AddFile(Keys): cumulative 0, interval 0 2024-02-10T08:11:05.161 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: Cumulative compaction: 0.00 GB write, 26.20 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-10T08:11:05.162 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-10T08:11:05.162 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-10T08:11:05.162 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: 2024-02-10T08:11:05.162 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: ** File Read Latency Histogram By Level [default] ** 2024-02-10T08:11:05.162 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: 2024-02-10T08:11:05.162 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.871+0000 7f973aaf7880 0 starting mon.a rank 0 at public addrs [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] at bind addrs [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid d46257c8-c7eb-11ee-95b8-87774f69a715 2024-02-10T08:11:05.162 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.872+0000 7f973aaf7880 1 mon.a@-1(???) e1 preinit fsid d46257c8-c7eb-11ee-95b8-87774f69a715 2024-02-10T08:11:05.162 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.873+0000 7f973aaf7880 0 mon.a@-1(???).mds e1 new map 2024-02-10T08:11:05.162 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.873+0000 7f973aaf7880 0 mon.a@-1(???).mds e1 print_map 2024-02-10T08:11:05.162 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: e1 2024-02-10T08:11:05.162 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: enable_multiple, ever_enabled_multiple: 1,1 2024-02-10T08:11:05.162 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-10T08:11:05.162 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: legacy client fscid: -1 2024-02-10T08:11:05.162 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: 2024-02-10T08:11:05.162 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: No filesystems configured 2024-02-10T08:11:05.163 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: 2024-02-10T08:11:05.163 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.873+0000 7f973aaf7880 0 mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-02-10T08:11:05.163 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.873+0000 7f973aaf7880 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-02-10T08:11:05.163 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.873+0000 7f973aaf7880 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-02-10T08:11:05.163 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.873+0000 7f973aaf7880 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-02-10T08:11:05.163 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:11:00.669059+0000 mon.a (mon.0) 10 : audit [DBG] from='client.? 172.21.15.18:0/1744254805' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:11:05.163 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:11:04.873+0000 7f973aaf7880 1 mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-02-10T08:11:05.163 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 bash[39507]: 38ffb7af39e27563fddcb6b571cd585c1cb038ad0a3d83553394507a988cc97e 2024-02-10T08:11:05.163 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 systemd[1]: Started Ceph mon.a for d46257c8-c7eb-11ee-95b8-87774f69a715. 2024-02-10T08:11:05.163 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:11:04.889721+0000 mon.a (mon.0) 1 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2024-02-10T08:11:05.163 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:11:04.889764+0000 mon.a (mon.0) 2 : cluster [DBG] monmap e1: 1 mons at {a=[v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0]} removed_ranks: {} 2024-02-10T08:11:05.163 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:11:04.890158+0000 mon.a (mon.0) 3 : cluster [DBG] fsmap 2024-02-10T08:11:05.163 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:11:04.890187+0000 mon.a (mon.0) 4 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2024-02-10T08:11:05.163 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:11:04.890488+0000 mon.a (mon.0) 5 : cluster [DBG] mgrmap e1: no daemons active 2024-02-10T08:11:06.227 INFO:teuthology.orchestra.run.smithi018.stderr:Wrote config to /etc/ceph/ceph.conf 2024-02-10T08:11:06.227 INFO:teuthology.orchestra.run.smithi018.stderr:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-02-10T08:11:06.227 INFO:teuthology.orchestra.run.smithi018.stderr:Creating mgr... 2024-02-10T08:11:06.228 INFO:teuthology.orchestra.run.smithi018.stderr:Verifying port 9283 ... 2024-02-10T08:11:06.370 INFO:teuthology.orchestra.run.smithi018.stderr:systemctl: Failed to reset failed state of unit ceph-d46257c8-c7eb-11ee-95b8-87774f69a715@mgr.y.service: Unit ceph-d46257c8-c7eb-11ee-95b8-87774f69a715@mgr.y.service not loaded. 2024-02-10T08:11:06.377 INFO:teuthology.orchestra.run.smithi018.stderr:systemctl: Created symlink /etc/systemd/system/ceph-d46257c8-c7eb-11ee-95b8-87774f69a715.target.wants/ceph-d46257c8-c7eb-11ee-95b8-87774f69a715@mgr.y.service → /etc/systemd/system/ceph-d46257c8-c7eb-11ee-95b8-87774f69a715@.service. 2024-02-10T08:11:06.542 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:06 smithi018 systemd[1]: Starting Ceph mgr.y for d46257c8-c7eb-11ee-95b8-87774f69a715... 2024-02-10T08:11:06.903 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:11:05.542867+0000 mon.a (mon.0) 6 : audit [INF] from='client.? 172.21.15.18:0/1268351238' entity='client.admin' 2024-02-10T08:11:07.123 INFO:teuthology.orchestra.run.smithi018.stderr:systemctl: disabled 2024-02-10T08:11:07.138 INFO:teuthology.orchestra.run.smithi018.stderr:systemctl: inactive 2024-02-10T08:11:07.139 INFO:teuthology.orchestra.run.smithi018.stderr:firewalld.service is not enabled 2024-02-10T08:11:07.139 INFO:teuthology.orchestra.run.smithi018.stderr:Not possible to enable service . firewalld.service is not available 2024-02-10T08:11:07.141 INFO:teuthology.orchestra.run.smithi018.stderr:systemctl: disabled 2024-02-10T08:11:07.157 INFO:teuthology.orchestra.run.smithi018.stderr:systemctl: inactive 2024-02-10T08:11:07.158 INFO:teuthology.orchestra.run.smithi018.stderr:firewalld.service is not enabled 2024-02-10T08:11:07.158 INFO:teuthology.orchestra.run.smithi018.stderr:Not possible to open ports <[9283]>. firewalld.service is not available 2024-02-10T08:11:07.158 INFO:teuthology.orchestra.run.smithi018.stderr:Waiting for mgr to start... 2024-02-10T08:11:07.158 INFO:teuthology.orchestra.run.smithi018.stderr:Waiting for mgr... 2024-02-10T08:11:07.417 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:07 smithi018 bash[39781]: 68085ff50df6bff70ce275d93fa44cc2158c6f305485491d832469cd4609b530 2024-02-10T08:11:07.417 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:07 smithi018 systemd[1]: Started Ceph mgr.y for d46257c8-c7eb-11ee-95b8-87774f69a715. 2024-02-10T08:11:07.417 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:11:07.209+0000 7fea5c97b680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-10T08:11:07.418 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:11:07.293+0000 7fea5c97b680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-10T08:11:07.904 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:11:07.681+0000 7fea5c97b680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-10T08:11:07.905 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: 2024-02-10T08:11:07.910 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: { 2024-02-10T08:11:07.910 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "fsid": "d46257c8-c7eb-11ee-95b8-87774f69a715", 2024-02-10T08:11:07.910 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "health": { 2024-02-10T08:11:07.910 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2024-02-10T08:11:07.910 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "checks": {}, 2024-02-10T08:11:07.911 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "mutes": [] 2024-02-10T08:11:07.911 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: }, 2024-02-10T08:11:07.911 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "election_epoch": 5, 2024-02-10T08:11:07.911 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "quorum": [ 2024-02-10T08:11:07.911 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: 0 2024-02-10T08:11:07.911 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: ], 2024-02-10T08:11:07.911 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "quorum_names": [ 2024-02-10T08:11:07.911 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "a" 2024-02-10T08:11:07.911 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: ], 2024-02-10T08:11:07.911 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "quorum_age": 3, 2024-02-10T08:11:07.911 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "monmap": { 2024-02-10T08:11:07.911 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-10T08:11:07.911 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "min_mon_release_name": "pacific", 2024-02-10T08:11:07.912 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "num_mons": 1 2024-02-10T08:11:07.912 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: }, 2024-02-10T08:11:07.912 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "osdmap": { 2024-02-10T08:11:07.912 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-10T08:11:07.912 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "num_osds": 0, 2024-02-10T08:11:07.912 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "num_up_osds": 0, 2024-02-10T08:11:07.912 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "osd_up_since": 0, 2024-02-10T08:11:07.912 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "num_in_osds": 0, 2024-02-10T08:11:07.912 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "osd_in_since": 0, 2024-02-10T08:11:07.912 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2024-02-10T08:11:07.912 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: }, 2024-02-10T08:11:07.912 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "pgmap": { 2024-02-10T08:11:07.913 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "pgs_by_state": [], 2024-02-10T08:11:07.913 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "num_pgs": 0, 2024-02-10T08:11:07.913 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "num_pools": 0, 2024-02-10T08:11:07.913 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "num_objects": 0, 2024-02-10T08:11:07.913 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "data_bytes": 0, 2024-02-10T08:11:07.913 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "bytes_used": 0, 2024-02-10T08:11:07.913 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "bytes_avail": 0, 2024-02-10T08:11:07.913 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "bytes_total": 0 2024-02-10T08:11:07.913 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: }, 2024-02-10T08:11:07.913 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "fsmap": { 2024-02-10T08:11:07.913 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-10T08:11:07.913 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "by_rank": [], 2024-02-10T08:11:07.916 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "up:standby": 0 2024-02-10T08:11:07.916 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: }, 2024-02-10T08:11:07.916 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "mgrmap": { 2024-02-10T08:11:07.916 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "available": false, 2024-02-10T08:11:07.916 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "num_standbys": 0, 2024-02-10T08:11:07.916 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "modules": [ 2024-02-10T08:11:07.916 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "iostat", 2024-02-10T08:11:07.916 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "nfs", 2024-02-10T08:11:07.916 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "restful" 2024-02-10T08:11:07.916 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: ], 2024-02-10T08:11:07.917 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "services": {} 2024-02-10T08:11:07.917 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: }, 2024-02-10T08:11:07.917 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "servicemap": { 2024-02-10T08:11:07.917 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-10T08:11:07.917 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "modified": "2024-02-10T08:10:57.425537+0000", 2024-02-10T08:11:07.917 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "services": {} 2024-02-10T08:11:07.917 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: }, 2024-02-10T08:11:07.917 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "progress_events": {} 2024-02-10T08:11:07.917 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: } 2024-02-10T08:11:08.233 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:11:07.898429+0000 mon.a (mon.0) 7 : audit [DBG] from='client.? 172.21.15.18:0/2957008583' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-10T08:11:08.528 INFO:teuthology.orchestra.run.smithi018.stderr:mgr not available, waiting (1/15)... 2024-02-10T08:11:08.803 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:11:08.501+0000 7fea5c97b680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-10T08:11:08.803 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:11:08.584+0000 7fea5c97b680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-10T08:11:08.803 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:11:08.802+0000 7fea5c97b680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-10T08:11:10.099 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:11:09.791+0000 7fea5c97b680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-10T08:11:10.099 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:11:09.925+0000 7fea5c97b680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-10T08:11:10.099 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:11:10.006+0000 7fea5c97b680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-10T08:11:10.099 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:11:10.098+0000 7fea5c97b680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-10T08:11:10.404 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:11:10.299+0000 7fea5c97b680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-10T08:11:10.904 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:11:10.597+0000 7fea5c97b680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-10T08:11:10.904 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:11:10.699+0000 7fea5c97b680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-10T08:11:11.330 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: 2024-02-10T08:11:11.330 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: { 2024-02-10T08:11:11.330 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "fsid": "d46257c8-c7eb-11ee-95b8-87774f69a715", 2024-02-10T08:11:11.330 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "health": { 2024-02-10T08:11:11.330 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2024-02-10T08:11:11.331 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "checks": {}, 2024-02-10T08:11:11.331 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "mutes": [] 2024-02-10T08:11:11.331 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: }, 2024-02-10T08:11:11.331 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "election_epoch": 5, 2024-02-10T08:11:11.331 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "quorum": [ 2024-02-10T08:11:11.331 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: 0 2024-02-10T08:11:11.331 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: ], 2024-02-10T08:11:11.331 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "quorum_names": [ 2024-02-10T08:11:11.331 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "a" 2024-02-10T08:11:11.331 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: ], 2024-02-10T08:11:11.331 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "quorum_age": 6, 2024-02-10T08:11:11.331 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "monmap": { 2024-02-10T08:11:11.331 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-10T08:11:11.331 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "min_mon_release_name": "pacific", 2024-02-10T08:11:11.331 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "num_mons": 1 2024-02-10T08:11:11.332 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: }, 2024-02-10T08:11:11.332 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "osdmap": { 2024-02-10T08:11:11.332 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-10T08:11:11.332 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "num_osds": 0, 2024-02-10T08:11:11.332 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "num_up_osds": 0, 2024-02-10T08:11:11.332 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "osd_up_since": 0, 2024-02-10T08:11:11.332 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "num_in_osds": 0, 2024-02-10T08:11:11.332 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "osd_in_since": 0, 2024-02-10T08:11:11.332 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2024-02-10T08:11:11.332 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: }, 2024-02-10T08:11:11.332 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "pgmap": { 2024-02-10T08:11:11.332 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "pgs_by_state": [], 2024-02-10T08:11:11.332 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "num_pgs": 0, 2024-02-10T08:11:11.332 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "num_pools": 0, 2024-02-10T08:11:11.332 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "num_objects": 0, 2024-02-10T08:11:11.333 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "data_bytes": 0, 2024-02-10T08:11:11.333 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "bytes_used": 0, 2024-02-10T08:11:11.333 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "bytes_avail": 0, 2024-02-10T08:11:11.333 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "bytes_total": 0 2024-02-10T08:11:11.333 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: }, 2024-02-10T08:11:11.333 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "fsmap": { 2024-02-10T08:11:11.333 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-10T08:11:11.333 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "by_rank": [], 2024-02-10T08:11:11.333 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "up:standby": 0 2024-02-10T08:11:11.333 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: }, 2024-02-10T08:11:11.333 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "mgrmap": { 2024-02-10T08:11:11.333 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "available": false, 2024-02-10T08:11:11.333 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "num_standbys": 0, 2024-02-10T08:11:11.333 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "modules": [ 2024-02-10T08:11:11.333 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "iostat", 2024-02-10T08:11:11.334 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "nfs", 2024-02-10T08:11:11.334 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "restful" 2024-02-10T08:11:11.334 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: ], 2024-02-10T08:11:11.334 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "services": {} 2024-02-10T08:11:11.334 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: }, 2024-02-10T08:11:11.334 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "servicemap": { 2024-02-10T08:11:11.334 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-10T08:11:11.334 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "modified": "2024-02-10T08:10:57.425537+0000", 2024-02-10T08:11:11.334 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "services": {} 2024-02-10T08:11:11.334 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: }, 2024-02-10T08:11:11.334 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "progress_events": {} 2024-02-10T08:11:11.334 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: } 2024-02-10T08:11:11.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:11:11.323707+0000 mon.a (mon.0) 8 : audit [DBG] from='client.? 172.21.15.18:0/3810722752' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-10T08:11:11.654 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:11:11.473+0000 7fea5c97b680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-10T08:11:11.654 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:11:11.557+0000 7fea5c97b680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-10T08:11:11.992 INFO:teuthology.orchestra.run.smithi018.stderr:mgr not available, waiting (2/15)... 2024-02-10T08:11:11.995 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:11:11.653+0000 7fea5c97b680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-10T08:11:11.996 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:11:11.832+0000 7fea5c97b680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-10T08:11:12.377 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:11:12.101+0000 7fea5c97b680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-10T08:11:12.378 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:11:12.238+0000 7fea5c97b680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-10T08:11:12.641 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:11:12.376+0000 7fea5c97b680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-10T08:11:12.642 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:11:12.554+0000 7fea5c97b680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-10T08:11:12.904 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:11:12.640+0000 7fea5c97b680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-10T08:11:12.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:11:12.655124+0000 mon.a (mon.0) 9 : cluster [INF] Activating manager daemon y 2024-02-10T08:11:12.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:11:12.657957+0000 mon.a (mon.0) 10 : cluster [DBG] mgrmap e2: y(active, starting, since 0.00293566s) 2024-02-10T08:11:12.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:11:12.659074+0000 mon.a (mon.0) 11 : audit [DBG] from='mgr.14100 172.21.15.18:0/1917200538' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-10T08:11:12.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:11:12.659265+0000 mon.a (mon.0) 12 : audit [DBG] from='mgr.14100 172.21.15.18:0/1917200538' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-10T08:11:12.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:11:12.659441+0000 mon.a (mon.0) 13 : audit [DBG] from='mgr.14100 172.21.15.18:0/1917200538' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-10T08:11:12.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:11:12.659586+0000 mon.a (mon.0) 14 : audit [DBG] from='mgr.14100 172.21.15.18:0/1917200538' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-10T08:11:12.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:11:12.659725+0000 mon.a (mon.0) 15 : audit [DBG] from='mgr.14100 172.21.15.18:0/1917200538' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-10T08:11:12.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:11:12.673710+0000 mon.a (mon.0) 16 : cluster [INF] Manager daemon y is now available 2024-02-10T08:11:12.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:11:12.682717+0000 mon.a (mon.0) 17 : audit [INF] from='mgr.14100 172.21.15.18:0/1917200538' entity='mgr.y' 2024-02-10T08:11:12.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:11:12.688194+0000 mon.a (mon.0) 18 : audit [INF] from='mgr.14100 172.21.15.18:0/1917200538' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-10T08:11:12.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:11:12.691738+0000 mon.a (mon.0) 19 : audit [INF] from='mgr.14100 172.21.15.18:0/1917200538' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-10T08:11:12.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:11:12.693805+0000 mon.a (mon.0) 20 : audit [INF] from='mgr.14100 172.21.15.18:0/1917200538' entity='mgr.y' 2024-02-10T08:11:12.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:11:12.695661+0000 mon.a (mon.0) 21 : audit [INF] from='mgr.14100 172.21.15.18:0/1917200538' entity='mgr.y' 2024-02-10T08:11:14.799 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: 2024-02-10T08:11:14.799 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: { 2024-02-10T08:11:14.799 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "fsid": "d46257c8-c7eb-11ee-95b8-87774f69a715", 2024-02-10T08:11:14.799 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "health": { 2024-02-10T08:11:14.800 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2024-02-10T08:11:14.800 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "checks": {}, 2024-02-10T08:11:14.800 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "mutes": [] 2024-02-10T08:11:14.800 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: }, 2024-02-10T08:11:14.800 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "election_epoch": 5, 2024-02-10T08:11:14.800 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "quorum": [ 2024-02-10T08:11:14.800 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: 0 2024-02-10T08:11:14.800 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: ], 2024-02-10T08:11:14.800 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "quorum_names": [ 2024-02-10T08:11:14.800 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "a" 2024-02-10T08:11:14.800 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: ], 2024-02-10T08:11:14.800 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "quorum_age": 9, 2024-02-10T08:11:14.800 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "monmap": { 2024-02-10T08:11:14.800 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-10T08:11:14.800 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "min_mon_release_name": "pacific", 2024-02-10T08:11:14.801 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "num_mons": 1 2024-02-10T08:11:14.801 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: }, 2024-02-10T08:11:14.801 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "osdmap": { 2024-02-10T08:11:14.801 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-10T08:11:14.801 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "num_osds": 0, 2024-02-10T08:11:14.801 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "num_up_osds": 0, 2024-02-10T08:11:14.801 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "osd_up_since": 0, 2024-02-10T08:11:14.804 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "num_in_osds": 0, 2024-02-10T08:11:14.805 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "osd_in_since": 0, 2024-02-10T08:11:14.805 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2024-02-10T08:11:14.805 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: }, 2024-02-10T08:11:14.805 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "pgmap": { 2024-02-10T08:11:14.805 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "pgs_by_state": [], 2024-02-10T08:11:14.805 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "num_pgs": 0, 2024-02-10T08:11:14.805 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "num_pools": 0, 2024-02-10T08:11:14.805 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "num_objects": 0, 2024-02-10T08:11:14.805 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "data_bytes": 0, 2024-02-10T08:11:14.805 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "bytes_used": 0, 2024-02-10T08:11:14.805 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "bytes_avail": 0, 2024-02-10T08:11:14.805 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "bytes_total": 0 2024-02-10T08:11:14.805 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: }, 2024-02-10T08:11:14.805 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "fsmap": { 2024-02-10T08:11:14.805 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-10T08:11:14.806 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "by_rank": [], 2024-02-10T08:11:14.806 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "up:standby": 0 2024-02-10T08:11:14.806 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: }, 2024-02-10T08:11:14.806 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "mgrmap": { 2024-02-10T08:11:14.806 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "available": true, 2024-02-10T08:11:14.806 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "num_standbys": 0, 2024-02-10T08:11:14.806 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "modules": [ 2024-02-10T08:11:14.806 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "iostat", 2024-02-10T08:11:14.806 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "nfs", 2024-02-10T08:11:14.806 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "restful" 2024-02-10T08:11:14.806 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: ], 2024-02-10T08:11:14.806 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "services": {} 2024-02-10T08:11:14.806 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: }, 2024-02-10T08:11:14.806 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "servicemap": { 2024-02-10T08:11:14.806 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-10T08:11:14.807 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "modified": "2024-02-10T08:10:57.425537+0000", 2024-02-10T08:11:14.807 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "services": {} 2024-02-10T08:11:14.807 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: }, 2024-02-10T08:11:14.807 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "progress_events": {} 2024-02-10T08:11:14.807 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: } 2024-02-10T08:11:15.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:11:13.661554+0000 mon.a (mon.0) 22 : cluster [DBG] mgrmap e3: y(active, since 1.00653s) 2024-02-10T08:11:15.947 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:11:14.796345+0000 mon.a (mon.0) 23 : audit [DBG] from='client.? 172.21.15.18:0/625491993' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-10T08:11:17.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:11:15.661515+0000 mon.a (mon.0) 24 : cluster [DBG] mgrmap e4: y(active, since 3s) 2024-02-10T08:11:17.190 INFO:teuthology.orchestra.run.smithi018.stderr:mgr is available 2024-02-10T08:11:21.091 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: 2024-02-10T08:11:21.091 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: [global] 2024-02-10T08:11:21.091 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: fsid = d46257c8-c7eb-11ee-95b8-87774f69a715 2024-02-10T08:11:21.091 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: log_to_journald = false 2024-02-10T08:11:21.091 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: mon_osd_allow_pg_remap = true 2024-02-10T08:11:21.091 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: mon_osd_allow_primary_affinity = true 2024-02-10T08:11:21.091 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: mon_warn_on_no_sortbitwise = false 2024-02-10T08:11:21.092 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: osd_crush_chooseleaf_type = 0 2024-02-10T08:11:21.092 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: 2024-02-10T08:11:21.092 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: [mgr] 2024-02-10T08:11:21.092 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: mgr/telemetry/nag = false 2024-02-10T08:11:21.092 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: 2024-02-10T08:11:21.092 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: [osd] 2024-02-10T08:11:21.092 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: osd_map_max_advance = 10 2024-02-10T08:11:21.092 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: osd_sloppy_crc = true 2024-02-10T08:11:21.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:11:20.747520+0000 mon.a (mon.0) 25 : audit [INF] from='client.? 172.21.15.18:0/842953565' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-02-10T08:11:24.510 INFO:teuthology.orchestra.run.smithi018.stderr:Enabling cephadm module... 2024-02-10T08:11:26.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:11:25.311239+0000 mon.a (mon.0) 26 : audit [INF] from='client.? 172.21.15.18:0/1837361242' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-02-10T08:11:26.135 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ignoring --setuser ceph since I am not root 2024-02-10T08:11:26.136 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ignoring --setgroup ceph since I am not root 2024-02-10T08:11:26.136 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:11:26.050+0000 7f8753edd680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-10T08:11:26.136 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:11:26.134+0000 7f8753edd680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-10T08:11:26.784 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:11:26.512+0000 7f8753edd680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-10T08:11:27.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:11:25.885120+0000 mon.a (mon.0) 27 : audit [INF] from='client.? 172.21.15.18:0/1837361242' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-02-10T08:11:27.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:11:25.885177+0000 mon.a (mon.0) 28 : cluster [DBG] mgrmap e5: y(active, since 13s) 2024-02-10T08:11:27.373 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: { 2024-02-10T08:11:27.374 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "epoch": 5, 2024-02-10T08:11:27.374 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "available": true, 2024-02-10T08:11:27.374 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "active_name": "y", 2024-02-10T08:11:27.374 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "num_standby": 0 2024-02-10T08:11:27.374 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: } 2024-02-10T08:11:27.619 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:11:27.311+0000 7f8753edd680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-10T08:11:27.619 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:11:27.397+0000 7f8753edd680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-10T08:11:27.883 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:11:27.617+0000 7f8753edd680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-10T08:11:28.030 INFO:teuthology.orchestra.run.smithi018.stderr:Waiting for the mgr to restart... 2024-02-10T08:11:28.030 INFO:teuthology.orchestra.run.smithi018.stderr:Waiting for mgr epoch 5... 2024-02-10T08:11:28.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:11:27.372856+0000 mon.a (mon.0) 29 : audit [DBG] from='client.? 172.21.15.18:0/1015930268' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-02-10T08:11:28.904 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:11:28.611+0000 7f8753edd680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-10T08:11:28.904 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:11:28.744+0000 7f8753edd680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-10T08:11:28.904 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:11:28.827+0000 7f8753edd680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-10T08:11:29.404 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:11:28.919+0000 7f8753edd680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-10T08:11:29.404 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:11:29.120+0000 7f8753edd680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-10T08:11:29.904 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:11:29.411+0000 7f8753edd680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-10T08:11:29.904 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:11:29.513+0000 7f8753edd680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-10T08:11:30.628 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:11:30.268+0000 7f8753edd680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-10T08:11:30.628 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:11:30.352+0000 7f8753edd680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-10T08:11:30.628 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:11:30.447+0000 7f8753edd680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-10T08:11:30.894 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:11:30.627+0000 7f8753edd680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-10T08:11:31.154 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:11:30.893+0000 7f8753edd680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-10T08:11:31.154 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:11:31.028+0000 7f8753edd680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-10T08:11:31.433 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:11:31.167+0000 7f8753edd680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-10T08:11:31.433 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:11:31.345+0000 7f8753edd680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-10T08:11:31.904 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:11:31.432+0000 7f8753edd680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-10T08:11:31.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:11:31.445882+0000 mon.a (mon.0) 30 : cluster [INF] Active manager daemon y restarted 2024-02-10T08:11:31.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:11:31.446105+0000 mon.a (mon.0) 31 : cluster [INF] Activating manager daemon y 2024-02-10T08:11:31.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:11:31.449098+0000 mon.a (mon.0) 32 : cluster [DBG] osdmap e2: 0 total, 0 up, 0 in 2024-02-10T08:11:31.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:11:31.449220+0000 mon.a (mon.0) 33 : cluster [DBG] mgrmap e6: y(active, starting, since 0.00320277s) 2024-02-10T08:11:31.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:11:31.450157+0000 mon.a (mon.0) 34 : audit [DBG] from='mgr.14116 172.21.15.18:0/1164067700' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-10T08:11:31.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:11:31.450798+0000 mon.a (mon.0) 35 : audit [DBG] from='mgr.14116 172.21.15.18:0/1164067700' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-10T08:11:31.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:11:31.451461+0000 mon.a (mon.0) 36 : audit [DBG] from='mgr.14116 172.21.15.18:0/1164067700' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-10T08:11:31.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:11:31.451695+0000 mon.a (mon.0) 37 : audit [DBG] from='mgr.14116 172.21.15.18:0/1164067700' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-10T08:11:31.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:11:31.451924+0000 mon.a (mon.0) 38 : audit [DBG] from='mgr.14116 172.21.15.18:0/1164067700' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-10T08:11:31.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:11:31.465735+0000 mon.a (mon.0) 39 : cluster [INF] Manager daemon y is now available 2024-02-10T08:11:31.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:11:31.477858+0000 mon.a (mon.0) 40 : audit [INF] from='mgr.14116 172.21.15.18:0/1164067700' entity='mgr.y' 2024-02-10T08:11:32.458 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: { 2024-02-10T08:11:32.459 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "mgrmap_epoch": 7, 2024-02-10T08:11:32.459 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "initialized": true 2024-02-10T08:11:32.459 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: } 2024-02-10T08:11:32.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cephadm 2024-02-10T08:11:31.475341+0000 mgr.y (mgr.14116) 1 : cephadm [INF] Found migration_current of "None". Setting to last migration. 2024-02-10T08:11:32.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:11:31.568885+0000 mon.a (mon.0) 41 : audit [INF] from='mgr.14116 172.21.15.18:0/1164067700' entity='mgr.y' 2024-02-10T08:11:32.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:11:31.569887+0000 mon.a (mon.0) 42 : audit [DBG] from='mgr.14116 172.21.15.18:0/1164067700' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:11:32.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:11:31.571304+0000 mon.a (mon.0) 43 : audit [DBG] from='mgr.14116 172.21.15.18:0/1164067700' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:11:32.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:11:31.573726+0000 mon.a (mon.0) 44 : audit [DBG] from='mgr.14116 172.21.15.18:0/1164067700' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:11:32.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:11:31.587040+0000 mon.a (mon.0) 45 : audit [INF] from='mgr.14116 172.21.15.18:0/1164067700' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-10T08:11:32.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:11:31.589514+0000 mon.a (mon.0) 46 : audit [INF] from='mgr.14116 172.21.15.18:0/1164067700' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-10T08:11:32.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:11:32.451912+0000 mon.a (mon.0) 47 : cluster [DBG] mgrmap e7: y(active, since 1.00587s) 2024-02-10T08:11:33.113 INFO:teuthology.orchestra.run.smithi018.stderr:mgr epoch 5 is available 2024-02-10T08:11:33.113 INFO:teuthology.orchestra.run.smithi018.stderr:Setting orchestrator backend to cephadm... 2024-02-10T08:11:33.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:11:32.450895+0000 mgr.y (mgr.14116) 2 : audit [DBG] from='client.14120 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-02-10T08:11:33.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:11:32.457771+0000 mgr.y (mgr.14116) 3 : audit [DBG] from='client.14120 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-02-10T08:11:34.730 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:11:33.572050+0000 mon.a (mon.0) 48 : cluster [DBG] mgrmap e8: y(active, since 2s) 2024-02-10T08:11:34.730 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:11:33.877056+0000 mgr.y (mgr.14116) 4 : audit [DBG] from='client.14126 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:11:34.730 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:11:33.881070+0000 mon.a (mon.0) 49 : audit [INF] from='mgr.14116 172.21.15.18:0/1164067700' entity='mgr.y' 2024-02-10T08:11:34.730 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:11:33.896920+0000 mon.a (mon.0) 50 : audit [DBG] from='mgr.14116 172.21.15.18:0/1164067700' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:11:35.221 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: value unchanged 2024-02-10T08:11:35.836 INFO:teuthology.orchestra.run.smithi018.stderr:Generating ssh key... 2024-02-10T08:11:36.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:11:35.220836+0000 mgr.y (mgr.14116) 5 : audit [DBG] from='client.14128 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:11:37.128 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: Generating public/private rsa key pair. 2024-02-10T08:11:37.128 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: Your identification has been saved in /tmp/tmpwztd317a/key. 2024-02-10T08:11:37.128 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: Your public key has been saved in /tmp/tmpwztd317a/key.pub. 2024-02-10T08:11:37.128 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: The key fingerprint is: 2024-02-10T08:11:37.128 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: SHA256:IyBpg15peT32tAWRygYgY1WtcgZ6f78ia+MMeywyHuQ ceph-d46257c8-c7eb-11ee-95b8-87774f69a715 2024-02-10T08:11:37.128 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: The key's randomart image is: 2024-02-10T08:11:37.128 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: +---[RSA 3072]----+ 2024-02-10T08:11:37.128 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: | +.oo.. oo | 2024-02-10T08:11:37.129 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: |..ooo... .. | 2024-02-10T08:11:37.129 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: |. *=o.++.. . | 2024-02-10T08:11:37.129 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: |.oo=.=.++ o | 2024-02-10T08:11:37.129 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: | o. = o So | 2024-02-10T08:11:37.129 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: |o . o . | 2024-02-10T08:11:37.129 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: | E .. . . | 2024-02-10T08:11:37.129 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: | o..+* . . | 2024-02-10T08:11:37.129 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: |..o.=++ ... | 2024-02-10T08:11:37.129 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: +----[SHA256]-----+ 2024-02-10T08:11:38.123 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3jlcBxjwkoGbLavQMEmaqQNl0VBEAXMJB6CwebSnterKCrzvOz8jFdVNKkwVyg6zvBmEYbc3LGDXRlQb59Cm6KH2/ZF0y1TEUaPQGa3X1R5EI6U1/XDQy0Vjw4V/aA7AxFyQqxuZhrBARlvrz8oHAdmNJJZMTEDOKBZLSd3QMShYxfeQZVCEiUfMtcVJOHRGFK6qwRMqYxq4+Zyt7a9wsdHK5i38Cd8oegR/QceliMPREVy8XjtY2Mkeqero+5CE55kUHAc6M4J6q/+uGHresZYQcHQRWklH4HZIRalu9+biK9b0nJNlkHVu2uhYN3wdfPPrKTiGj7HfClrQG3jpilLEXkwgvCC3yS9xu8GpDf9hPmo1h0JtP+udv8dz8qZwToUvrDQQiegYtfmqFrER17+WLUUNupOUePJxlcyOPaYqrYMNo3RAuqLK2q7b/jDW0zzEnrc0FaV22n89GQ5I245j2yshODi+0JNI/DA8QnSPXttQ8Uhl+zIS/b7ewI5E= ceph-d46257c8-c7eb-11ee-95b8-87774f69a715 2024-02-10T08:11:38.147 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:11:36.564933+0000 mgr.y (mgr.14116) 6 : audit [DBG] from='client.14130 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:11:38.147 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cephadm 2024-02-10T08:11:36.565160+0000 mgr.y (mgr.14116) 7 : cephadm [INF] Generating ssh key... 2024-02-10T08:11:38.148 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:11:36.793018+0000 mon.a (mon.0) 51 : audit [INF] from='mgr.14116 172.21.15.18:0/1164067700' entity='mgr.y' 2024-02-10T08:11:38.148 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:11:36.794858+0000 mon.a (mon.0) 52 : audit [INF] from='mgr.14116 172.21.15.18:0/1164067700' entity='mgr.y' 2024-02-10T08:11:38.716 INFO:teuthology.orchestra.run.smithi018.stderr:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-02-10T08:11:38.716 INFO:teuthology.orchestra.run.smithi018.stderr:Adding key to root@localhost authorized_keys... 2024-02-10T08:11:38.716 INFO:teuthology.orchestra.run.smithi018.stderr:Adding host smithi018... 2024-02-10T08:11:39.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:11:38.122421+0000 mgr.y (mgr.14116) 8 : audit [DBG] from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:11:39.904 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: [79B blob data] 2024-02-10T08:11:40.062 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: Added host 'smithi018' with addr '172.21.15.18' 2024-02-10T08:11:40.594 INFO:teuthology.orchestra.run.smithi018.stderr:Deploying unmanaged mon service... 2024-02-10T08:11:41.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:11:39.422939+0000 mgr.y (mgr.14116) 9 : audit [DBG] from='client.14134 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi018", "addr": "172.21.15.18", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:11:41.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:11:40.060637+0000 mon.a (mon.0) 53 : audit [INF] from='mgr.14116 172.21.15.18:0/1164067700' entity='mgr.y' 2024-02-10T08:11:41.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:11:40.077525+0000 mon.a (mon.0) 54 : audit [DBG] from='mgr.14116 172.21.15.18:0/1164067700' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:11:41.509 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: Scheduled mon update... 2024-02-10T08:11:42.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cephadm 2024-02-10T08:11:40.060972+0000 mgr.y (mgr.14116) 10 : cephadm [INF] Added host smithi018 2024-02-10T08:11:42.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:11:41.508621+0000 mon.a (mon.0) 55 : audit [INF] from='mgr.14116 172.21.15.18:0/1164067700' entity='mgr.y' 2024-02-10T08:11:43.037 INFO:teuthology.orchestra.run.smithi018.stderr:Deploying unmanaged mgr service... 2024-02-10T08:11:43.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:11:41.504253+0000 mgr.y (mgr.14116) 11 : audit [DBG] from='client.14136 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:11:43.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cephadm 2024-02-10T08:11:41.506125+0000 mgr.y (mgr.14116) 12 : cephadm [INF] Saving service mon spec with placement count:5 2024-02-10T08:11:43.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:11:42.642434+0000 mon.a (mon.0) 56 : audit [INF] from='mgr.14116 172.21.15.18:0/1164067700' entity='mgr.y' 2024-02-10T08:11:43.818 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: Scheduled mgr update... 2024-02-10T08:11:44.398 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:11:43.115260+0000 mon.a (mon.0) 57 : audit [INF] from='mgr.14116 172.21.15.18:0/1164067700' entity='mgr.y' 2024-02-10T08:11:44.398 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:11:43.814621+0000 mgr.y (mgr.14116) 13 : audit [DBG] from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:11:44.399 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cephadm 2024-02-10T08:11:43.815504+0000 mgr.y (mgr.14116) 14 : cephadm [INF] Saving service mgr spec with placement count:2 2024-02-10T08:11:44.399 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:11:43.817888+0000 mon.a (mon.0) 58 : audit [INF] from='mgr.14116 172.21.15.18:0/1164067700' entity='mgr.y' 2024-02-10T08:11:46.794 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:11:45.702541+0000 mon.a (mon.0) 59 : audit [INF] from='mgr.14116 172.21.15.18:0/1164067700' entity='mgr.y' 2024-02-10T08:11:46.794 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:11:45.876234+0000 mon.a (mon.0) 60 : audit [INF] from='client.? 172.21.15.18:0/3451011940' entity='client.admin' 2024-02-10T08:11:48.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:11:47.428568+0000 mon.a (mon.0) 61 : audit [INF] from='client.? 172.21.15.18:0/3425391368' entity='client.admin' 2024-02-10T08:11:48.655 INFO:teuthology.orchestra.run.smithi018.stderr:Enabling the dashboard module... 2024-02-10T08:11:49.808 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:11:49.467874+0000 mon.a (mon.0) 62 : audit [INF] from='client.? 172.21.15.18:0/2674032739' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-02-10T08:11:49.808 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ignoring --setuser ceph since I am not root 2024-02-10T08:11:49.808 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ignoring --setgroup ceph since I am not root 2024-02-10T08:11:49.808 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:11:49.679+0000 7f0a34981680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-10T08:11:49.809 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:11:49.764+0000 7f0a34981680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-10T08:11:50.404 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:11:50.144+0000 7f0a34981680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-10T08:11:50.782 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:11:49.521025+0000 mon.a (mon.0) 63 : audit [INF] from='client.? 172.21.15.18:0/2674032739' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-02-10T08:11:50.782 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:11:49.521082+0000 mon.a (mon.0) 64 : cluster [DBG] mgrmap e9: y(active, since 18s) 2024-02-10T08:11:51.053 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:11:50.941+0000 7f0a34981680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-10T08:11:51.053 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:11:51.025+0000 7f0a34981680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-10T08:11:51.404 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:11:51.249+0000 7f0a34981680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-10T08:11:51.634 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: { 2024-02-10T08:11:51.634 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "epoch": 9, 2024-02-10T08:11:51.634 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "available": true, 2024-02-10T08:11:51.634 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "active_name": "y", 2024-02-10T08:11:51.634 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "num_standby": 0 2024-02-10T08:11:51.634 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: } 2024-02-10T08:11:52.019 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:11:51.633251+0000 mon.a (mon.0) 65 : audit [DBG] from='client.? 172.21.15.18:0/25550439' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-02-10T08:11:52.352 INFO:teuthology.orchestra.run.smithi018.stderr:Waiting for the mgr to restart... 2024-02-10T08:11:52.352 INFO:teuthology.orchestra.run.smithi018.stderr:Waiting for mgr epoch 9... 2024-02-10T08:11:52.355 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:11:52.244+0000 7f0a34981680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-10T08:11:52.619 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:11:52.381+0000 7f0a34981680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-10T08:11:52.619 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:11:52.466+0000 7f0a34981680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-10T08:11:52.619 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:11:52.562+0000 7f0a34981680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-10T08:11:53.066 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:11:52.766+0000 7f0a34981680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-10T08:11:53.404 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:11:53.064+0000 7f0a34981680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-10T08:11:53.404 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:11:53.167+0000 7f0a34981680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-10T08:11:54.281 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:11:53.921+0000 7f0a34981680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-10T08:11:54.281 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:11:54.005+0000 7f0a34981680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-10T08:11:54.281 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:11:54.100+0000 7f0a34981680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-10T08:11:54.544 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:11:54.280+0000 7f0a34981680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-10T08:11:54.825 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:11:54.548+0000 7f0a34981680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-10T08:11:54.825 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:11:54.685+0000 7f0a34981680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-10T08:11:55.092 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:11:54.823+0000 7f0a34981680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-10T08:11:55.092 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:11:55.003+0000 7f0a34981680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-10T08:11:55.404 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:11:55.090+0000 7f0a34981680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-10T08:11:55.404 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:11:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: [79B blob data] 2024-02-10T08:11:56.119 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: { 2024-02-10T08:11:56.119 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "mgrmap_epoch": 11, 2024-02-10T08:11:56.119 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: "initialized": true 2024-02-10T08:11:56.119 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: } 2024-02-10T08:11:56.142 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:11:55.105107+0000 mon.a (mon.0) 66 : cluster [INF] Active manager daemon y restarted 2024-02-10T08:11:56.142 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:11:55.105325+0000 mon.a (mon.0) 67 : cluster [INF] Activating manager daemon y 2024-02-10T08:11:56.142 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:11:55.108394+0000 mon.a (mon.0) 68 : cluster [DBG] osdmap e3: 0 total, 0 up, 0 in 2024-02-10T08:11:56.142 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:11:55.108501+0000 mon.a (mon.0) 69 : cluster [DBG] mgrmap e10: y(active, starting, since 0.00326516s) 2024-02-10T08:11:56.142 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:11:55.109310+0000 mon.a (mon.0) 70 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-10T08:11:56.143 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:11:55.110114+0000 mon.a (mon.0) 71 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-10T08:11:56.143 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:11:55.110719+0000 mon.a (mon.0) 72 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-10T08:11:56.143 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:11:55.110846+0000 mon.a (mon.0) 73 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-10T08:11:56.143 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:11:55.110973+0000 mon.a (mon.0) 74 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-10T08:11:56.143 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:11:55.124685+0000 mon.a (mon.0) 75 : cluster [INF] Manager daemon y is now available 2024-02-10T08:11:56.143 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:11:55.222576+0000 mon.a (mon.0) 76 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:11:56.143 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:11:55.223974+0000 mon.a (mon.0) 77 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:11:56.143 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:11:55.249503+0000 mon.a (mon.0) 78 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-10T08:11:56.143 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:11:55.253173+0000 mon.a (mon.0) 79 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-10T08:11:57.336 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:11:56.109831+0000 mgr.y (mgr.14146) 1 : audit [DBG] from='client.14150 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-02-10T08:11:57.337 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:11:56.110117+0000 mon.a (mon.0) 80 : cluster [DBG] mgrmap e11: y(active, since 1.00488s) 2024-02-10T08:11:57.337 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:11:56.118355+0000 mgr.y (mgr.14146) 2 : audit [DBG] from='client.14150 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-02-10T08:11:57.337 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:11:56.523198+0000 mon.a (mon.0) 81 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:11:57.976 INFO:teuthology.orchestra.run.smithi018.stderr:mgr epoch 9 is available 2024-02-10T08:11:57.977 INFO:teuthology.orchestra.run.smithi018.stderr:Generating a dashboard self-signed certificate... 2024-02-10T08:11:59.064 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: Self-signed certificate created 2024-02-10T08:11:59.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:11:58.110999+0000 mon.a (mon.0) 82 : cluster [DBG] mgrmap e12: y(active, since 3s) 2024-02-10T08:11:59.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:11:59.061917+0000 mon.a (mon.0) 83 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:11:59.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:11:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:11:59.063739+0000 mon.a (mon.0) 84 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:11:59.811 INFO:teuthology.orchestra.run.smithi018.stderr:Creating initial admin user... 2024-02-10T08:12:00.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:12:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:11:58.978129+0000 mgr.y (mgr.14146) 3 : audit [DBG] from='client.14156 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:12:00.864 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: {"username": "admin", "password": "$2b$12$BFQZHipLSTKObjFMdtsMzOFk.ZZ/Bh4xkE4e.jEZQ9TgMAXnkTOyK", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1707552720, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-02-10T08:12:01.585 INFO:teuthology.orchestra.run.smithi018.stderr:Fetching dashboard port number... 2024-02-10T08:12:02.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:12:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:12:00.618835+0000 mgr.y (mgr.14146) 4 : audit [DBG] from='client.14158 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:12:02.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:12:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:12:00.863398+0000 mon.a (mon.0) 85 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:12:02.383 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: 8443 2024-02-10T08:12:03.044 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:12:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:12:01.865969+0000 mon.a (mon.0) 86 : cluster [DBG] mgrmap e13: y(active, since 6s) 2024-02-10T08:12:03.045 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:12:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:12:02.383205+0000 mon.a (mon.0) 87 : audit [DBG] from='client.? 172.21.15.18:0/3635654736' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-02-10T08:12:03.051 INFO:teuthology.orchestra.run.smithi018.stderr:systemctl: disabled 2024-02-10T08:12:03.060 INFO:teuthology.orchestra.run.smithi018.stderr:systemctl: inactive 2024-02-10T08:12:03.060 INFO:teuthology.orchestra.run.smithi018.stderr:firewalld.service is not enabled 2024-02-10T08:12:03.060 INFO:teuthology.orchestra.run.smithi018.stderr:Not possible to open ports <[8443]>. firewalld.service is not available 2024-02-10T08:12:03.062 INFO:teuthology.orchestra.run.smithi018.stderr:Ceph Dashboard is now available at: 2024-02-10T08:12:03.063 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-02-10T08:12:03.063 INFO:teuthology.orchestra.run.smithi018.stderr: URL: https://smithi018.front.sepia.ceph.com:8443/ 2024-02-10T08:12:03.063 INFO:teuthology.orchestra.run.smithi018.stderr: User: admin 2024-02-10T08:12:03.063 INFO:teuthology.orchestra.run.smithi018.stderr: Password: r6iea45fn6 2024-02-10T08:12:03.063 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-02-10T08:12:03.063 INFO:teuthology.orchestra.run.smithi018.stderr:Enabling autotune for osd_memory_target 2024-02-10T08:12:05.435 INFO:teuthology.orchestra.run.smithi018.stderr:/usr/bin/ceph: set mgr/dashboard/cluster/status 2024-02-10T08:12:06.142 INFO:teuthology.orchestra.run.smithi018.stderr:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-02-10T08:12:06.143 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-02-10T08:12:06.143 INFO:teuthology.orchestra.run.smithi018.stderr: sudo /home/ubuntu/cephtest/cephadm shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-02-10T08:12:06.143 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-02-10T08:12:06.143 INFO:teuthology.orchestra.run.smithi018.stderr:Or, if you are only running a single cluster on this host: 2024-02-10T08:12:06.143 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-02-10T08:12:06.143 INFO:teuthology.orchestra.run.smithi018.stderr: sudo /home/ubuntu/cephtest/cephadm shell 2024-02-10T08:12:06.143 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-02-10T08:12:06.143 INFO:teuthology.orchestra.run.smithi018.stderr:Please consider enabling telemetry to help improve Ceph: 2024-02-10T08:12:06.143 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-02-10T08:12:06.143 INFO:teuthology.orchestra.run.smithi018.stderr: ceph telemetry on 2024-02-10T08:12:06.143 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-02-10T08:12:06.143 INFO:teuthology.orchestra.run.smithi018.stderr:For more information see: 2024-02-10T08:12:06.143 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-02-10T08:12:06.144 INFO:teuthology.orchestra.run.smithi018.stderr: https://docs.ceph.com/en/pacific/mgr/telemetry/ 2024-02-10T08:12:06.144 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-02-10T08:12:06.144 INFO:teuthology.orchestra.run.smithi018.stderr:Bootstrap complete. 2024-02-10T08:12:06.188 INFO:tasks.cephadm:Fetching config... 2024-02-10T08:12:06.188 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-02-10T08:12:06.189 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-02-10T08:12:06.209 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-02-10T08:12:06.210 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-02-10T08:12:06.210 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-02-10T08:12:06.270 INFO:tasks.cephadm:Fetching mon keyring... 2024-02-10T08:12:06.271 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-02-10T08:12:06.271 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/keyring of=/dev/stdout 2024-02-10T08:12:06.342 INFO:tasks.cephadm:Fetching pub ssh key... 2024-02-10T08:12:06.342 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-02-10T08:12:06.343 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-02-10T08:12:06.404 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-02-10T08:12:06.404 DEBUG:teuthology.orchestra.run.smithi018:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3jlcBxjwkoGbLavQMEmaqQNl0VBEAXMJB6CwebSnterKCrzvOz8jFdVNKkwVyg6zvBmEYbc3LGDXRlQb59Cm6KH2/ZF0y1TEUaPQGa3X1R5EI6U1/XDQy0Vjw4V/aA7AxFyQqxuZhrBARlvrz8oHAdmNJJZMTEDOKBZLSd3QMShYxfeQZVCEiUfMtcVJOHRGFK6qwRMqYxq4+Zyt7a9wsdHK5i38Cd8oegR/QceliMPREVy8XjtY2Mkeqero+5CE55kUHAc6M4J6q/+uGHresZYQcHQRWklH4HZIRalu9+biK9b0nJNlkHVu2uhYN3wdfPPrKTiGj7HfClrQG3jpilLEXkwgvCC3yS9xu8GpDf9hPmo1h0JtP+udv8dz8qZwToUvrDQQiegYtfmqFrER17+WLUUNupOUePJxlcyOPaYqrYMNo3RAuqLK2q7b/jDW0zzEnrc0FaV22n89GQ5I245j2yshODi+0JNI/DA8QnSPXttQ8Uhl+zIS/b7ewI5E= ceph-d46257c8-c7eb-11ee-95b8-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-02-10T08:12:06.485 INFO:teuthology.orchestra.run.smithi018.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3jlcBxjwkoGbLavQMEmaqQNl0VBEAXMJB6CwebSnterKCrzvOz8jFdVNKkwVyg6zvBmEYbc3LGDXRlQb59Cm6KH2/ZF0y1TEUaPQGa3X1R5EI6U1/XDQy0Vjw4V/aA7AxFyQqxuZhrBARlvrz8oHAdmNJJZMTEDOKBZLSd3QMShYxfeQZVCEiUfMtcVJOHRGFK6qwRMqYxq4+Zyt7a9wsdHK5i38Cd8oegR/QceliMPREVy8XjtY2Mkeqero+5CE55kUHAc6M4J6q/+uGHresZYQcHQRWklH4HZIRalu9+biK9b0nJNlkHVu2uhYN3wdfPPrKTiGj7HfClrQG3jpilLEXkwgvCC3yS9xu8GpDf9hPmo1h0JtP+udv8dz8qZwToUvrDQQiegYtfmqFrER17+WLUUNupOUePJxlcyOPaYqrYMNo3RAuqLK2q7b/jDW0zzEnrc0FaV22n89GQ5I245j2yshODi+0JNI/DA8QnSPXttQ8Uhl+zIS/b7ewI5E= ceph-d46257c8-c7eb-11ee-95b8-87774f69a715 2024-02-10T08:12:06.498 DEBUG:teuthology.orchestra.run.smithi071:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3jlcBxjwkoGbLavQMEmaqQNl0VBEAXMJB6CwebSnterKCrzvOz8jFdVNKkwVyg6zvBmEYbc3LGDXRlQb59Cm6KH2/ZF0y1TEUaPQGa3X1R5EI6U1/XDQy0Vjw4V/aA7AxFyQqxuZhrBARlvrz8oHAdmNJJZMTEDOKBZLSd3QMShYxfeQZVCEiUfMtcVJOHRGFK6qwRMqYxq4+Zyt7a9wsdHK5i38Cd8oegR/QceliMPREVy8XjtY2Mkeqero+5CE55kUHAc6M4J6q/+uGHresZYQcHQRWklH4HZIRalu9+biK9b0nJNlkHVu2uhYN3wdfPPrKTiGj7HfClrQG3jpilLEXkwgvCC3yS9xu8GpDf9hPmo1h0JtP+udv8dz8qZwToUvrDQQiegYtfmqFrER17+WLUUNupOUePJxlcyOPaYqrYMNo3RAuqLK2q7b/jDW0zzEnrc0FaV22n89GQ5I245j2yshODi+0JNI/DA8QnSPXttQ8Uhl+zIS/b7ewI5E= ceph-d46257c8-c7eb-11ee-95b8-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-02-10T08:12:06.542 INFO:teuthology.orchestra.run.smithi071.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3jlcBxjwkoGbLavQMEmaqQNl0VBEAXMJB6CwebSnterKCrzvOz8jFdVNKkwVyg6zvBmEYbc3LGDXRlQb59Cm6KH2/ZF0y1TEUaPQGa3X1R5EI6U1/XDQy0Vjw4V/aA7AxFyQqxuZhrBARlvrz8oHAdmNJJZMTEDOKBZLSd3QMShYxfeQZVCEiUfMtcVJOHRGFK6qwRMqYxq4+Zyt7a9wsdHK5i38Cd8oegR/QceliMPREVy8XjtY2Mkeqero+5CE55kUHAc6M4J6q/+uGHresZYQcHQRWklH4HZIRalu9+biK9b0nJNlkHVu2uhYN3wdfPPrKTiGj7HfClrQG3jpilLEXkwgvCC3yS9xu8GpDf9hPmo1h0JtP+udv8dz8qZwToUvrDQQiegYtfmqFrER17+WLUUNupOUePJxlcyOPaYqrYMNo3RAuqLK2q7b/jDW0zzEnrc0FaV22n89GQ5I245j2yshODi+0JNI/DA8QnSPXttQ8Uhl+zIS/b7ewI5E= ceph-d46257c8-c7eb-11ee-95b8-87774f69a715 2024-02-10T08:12:06.554 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-02-10T08:12:06.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:12:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:12:05.430971+0000 mon.a (mon.0) 88 : audit [INF] from='client.? 172.21.15.18:0/3912887155' entity='client.admin' 2024-02-10T08:12:10.091 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:12:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:12:08.958719+0000 mon.a (mon.0) 89 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:12:10.091 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:12:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:12:09.446082+0000 mon.a (mon.0) 90 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi018", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:12:10.091 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:12:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:12:09.450167+0000 mon.a (mon.0) 91 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:12:10.091 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:12:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:12:09.451461+0000 mon.a (mon.0) 92 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:12:10.091 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:12:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:12:09.455160+0000 mon.a (mon.0) 93 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:12:10.092 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:12:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:12:09.697646+0000 mon.a (mon.0) 94 : audit [INF] from='client.? 172.21.15.18:0/3554822433' entity='client.admin' 2024-02-10T08:12:10.092 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:12:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:12:09.719839+0000 mon.a (mon.0) 95 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:12:10.092 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:12:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:12:09.724501+0000 mon.a (mon.0) 96 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:12:10.449 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-02-10T08:12:10.449 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-02-10T08:12:13.715 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi071 2024-02-10T08:12:13.715 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-02-10T08:12:13.716 DEBUG:teuthology.orchestra.run.smithi071:> dd of=/etc/ceph/ceph.conf 2024-02-10T08:12:13.737 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-02-10T08:12:13.738 DEBUG:teuthology.orchestra.run.smithi071:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-02-10T08:12:13.798 INFO:tasks.cephadm:Adding host smithi071 to orchestrator... 2024-02-10T08:12:13.799 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph orch host add smithi071 2024-02-10T08:12:14.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:12:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:12:13.066584+0000 mon.a (mon.0) 97 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:12:14.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:12:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:12:13.095636+0000 mon.a (mon.0) 98 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:12:14.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:12:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:12:13.097137+0000 mon.a (mon.0) 99 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:12:14.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:12:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:12:13.097728+0000 mon.a (mon.0) 100 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:12:14.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:12:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cephadm 2024-02-10T08:12:13.098686+0000 mgr.y (mgr.14146) 6 : cephadm [INF] Updating smithi018:/etc/ceph/ceph.conf 2024-02-10T08:12:14.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:12:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cephadm 2024-02-10T08:12:13.130937+0000 mgr.y (mgr.14146) 7 : cephadm [INF] Updating smithi018:/etc/ceph/ceph.client.admin.keyring 2024-02-10T08:12:14.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:12:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:12:13.220802+0000 mon.a (mon.0) 101 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:12:14.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:12:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:12:13.222848+0000 mon.a (mon.0) 102 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:12:16.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:12:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:12:15.112094+0000 mgr.y (mgr.14146) 8 : cluster [DBG] pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:12:18.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:12:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:12:17.112511+0000 mgr.y (mgr.14146) 9 : cluster [DBG] pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:12:20.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:12:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:12:19.112799+0000 mgr.y (mgr.14146) 10 : cluster [DBG] pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:12:22.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:12:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:12:21.113101+0000 mgr.y (mgr.14146) 11 : cluster [DBG] pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:12:24.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:12:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:12:23.113385+0000 mgr.y (mgr.14146) 12 : cluster [DBG] pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:12:26.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:12:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:12:25.113709+0000 mgr.y (mgr.14146) 13 : cluster [DBG] pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:12:28.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:12:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:12:27.114115+0000 mgr.y (mgr.14146) 14 : cluster [DBG] pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:12:30.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:12:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:12:29.114491+0000 mgr.y (mgr.14146) 15 : cluster [DBG] pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:12:32.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:12:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:12:31.114896+0000 mgr.y (mgr.14146) 16 : cluster [DBG] pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:12:34.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:12:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:12:33.115282+0000 mgr.y (mgr.14146) 17 : cluster [DBG] pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:12:36.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:12:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:12:35.115565+0000 mgr.y (mgr.14146) 18 : cluster [DBG] pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:12:38.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:12:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:12:37.115904+0000 mgr.y (mgr.14146) 19 : cluster [DBG] pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:12:40.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:12:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:12:39.116257+0000 mgr.y (mgr.14146) 20 : cluster [DBG] pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:12:42.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:12:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:12:41.116534+0000 mgr.y (mgr.14146) 21 : cluster [DBG] pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:12:43.654 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:12:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: [89B blob data] 2024-02-10T08:12:43.827 INFO:teuthology.orchestra.run.smithi071.stdout:Added host 'smithi071' with addr '172.21.15.71' 2024-02-10T08:12:44.171 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:12:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: [79B blob data] 2024-02-10T08:12:44.480 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph orch host ls --format=json 2024-02-10T08:12:44.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:12:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:12:43.116860+0000 mgr.y (mgr.14146) 22 : cluster [DBG] pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:12:44.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:12:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:12:43.186615+0000 mgr.y (mgr.14146) 23 : audit [DBG] from='client.14170 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi071", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:12:44.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:12:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:12:43.825386+0000 mon.a (mon.0) 103 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:12:44.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:12:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:12:43.869609+0000 mon.a (mon.0) 104 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:12:45.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:12:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cephadm 2024-02-10T08:12:43.825803+0000 mgr.y (mgr.14146) 24 : cephadm [INF] Added host smithi071 2024-02-10T08:12:45.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:12:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:12:44.547422+0000 mon.a (mon.0) 105 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:12:46.362 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-02-10T08:12:46.362 INFO:teuthology.orchestra.run.smithi071.stdout:[{"addr": "172.21.15.18", "hostname": "smithi018", "labels": [], "status": ""}, {"addr": "172.21.15.71", "hostname": "smithi071", "labels": [], "status": ""}] 2024-02-10T08:12:46.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:12:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:12:45.117155+0000 mgr.y (mgr.14146) 25 : cluster [DBG] pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:12:46.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:12:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:12:45.731105+0000 mon.a (mon.0) 106 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:12:47.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:12:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:12:46.361310+0000 mgr.y (mgr.14146) 26 : audit [DBG] from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-10T08:12:48.272 INFO:tasks.cephadm:Setting crush tunables to default 2024-02-10T08:12:48.272 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd crush tunables default 2024-02-10T08:12:48.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:12:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:12:47.117450+0000 mgr.y (mgr.14146) 27 : cluster [DBG] pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:12:50.010 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:12:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:12:48.972465+0000 mon.a (mon.0) 107 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:12:50.011 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:12:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:12:49.117799+0000 mgr.y (mgr.14146) 28 : cluster [DBG] pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:12:50.011 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:12:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:12:49.819584+0000 mon.a (mon.0) 108 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:12:50.011 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:12:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:12:49.820216+0000 mon.a (mon.0) 109 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi071", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:12:50.011 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:12:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:12:49.821053+0000 mon.a (mon.0) 110 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:12:50.011 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:12:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:12:49.821723+0000 mon.a (mon.0) 111 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:12:50.011 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:12:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:12:49.877217+0000 mon.a (mon.0) 112 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:12:50.011 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:12:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:12:49.879477+0000 mon.a (mon.0) 113 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:12:50.981 INFO:teuthology.orchestra.run.smithi018.stderr:adjusted tunables profile to default 2024-02-10T08:12:51.375 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:12:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cephadm 2024-02-10T08:12:49.822807+0000 mgr.y (mgr.14146) 29 : cephadm [INF] Updating smithi071:/etc/ceph/ceph.conf 2024-02-10T08:12:51.375 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:12:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cephadm 2024-02-10T08:12:49.850111+0000 mgr.y (mgr.14146) 30 : cephadm [INF] Updating smithi071:/etc/ceph/ceph.client.admin.keyring 2024-02-10T08:12:51.375 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:12:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:12:50.481904+0000 mon.a (mon.0) 114 : audit [INF] from='client.? 172.21.15.18:0/3235722711' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-02-10T08:12:51.731 INFO:tasks.cephadm:Adding mon.a on smithi018 2024-02-10T08:12:51.731 INFO:tasks.cephadm:Adding mon.c on smithi018 2024-02-10T08:12:51.731 INFO:tasks.cephadm:Adding mon.b on smithi071 2024-02-10T08:12:51.731 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph orch apply mon '3;smithi018:172.21.15.18=a;smithi018:[v2:172.21.15.18:3301,v1:172.21.15.18:6790]=c;smithi071:172.21.15.71=b' 2024-02-10T08:12:52.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:12:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:12:50.977961+0000 mon.a (mon.0) 115 : audit [INF] from='client.? 172.21.15.18:0/3235722711' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-02-10T08:12:52.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:12:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:12:50.978007+0000 mon.a (mon.0) 116 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-02-10T08:12:52.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:12:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:12:51.118183+0000 mgr.y (mgr.14146) 31 : cluster [DBG] pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:12:53.771 INFO:teuthology.orchestra.run.smithi071.stdout:Scheduled mon update... 2024-02-10T08:12:54.379 DEBUG:teuthology.orchestra.run.smithi018:mon.c> sudo journalctl -f -n 0 -u ceph-d46257c8-c7eb-11ee-95b8-87774f69a715@mon.c.service 2024-02-10T08:12:54.382 DEBUG:teuthology.orchestra.run.smithi071:mon.b> sudo journalctl -f -n 0 -u ceph-d46257c8-c7eb-11ee-95b8-87774f69a715@mon.b.service 2024-02-10T08:12:54.385 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-02-10T08:12:54.385 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph mon dump -f json 2024-02-10T08:12:54.413 INFO:journalctl@ceph.mon.b.smithi071.stdout:-- Logs begin at Sat 2024-02-10 07:59:38 UTC. -- 2024-02-10T08:12:54.419 INFO:journalctl@ceph.mon.c.smithi018.stdout:-- Logs begin at Sat 2024-02-10 07:59:20 UTC. -- 2024-02-10T08:12:54.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:12:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:12:53.118545+0000 mgr.y (mgr.14146) 32 : cluster [DBG] pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:12:54.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:12:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:12:53.770468+0000 mon.a (mon.0) 117 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:12:54.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:12:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:12:53.802613+0000 mon.a (mon.0) 118 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:12:54.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:12:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:12:53.804402+0000 mon.a (mon.0) 119 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:12:54.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:12:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:12:53.805244+0000 mon.a (mon.0) 120 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:12:54.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:12:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:12:53.808745+0000 mon.a (mon.0) 121 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:12:54.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:12:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:12:53.810784+0000 mon.a (mon.0) 122 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-10T08:12:54.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:12:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:12:53.811594+0000 mon.a (mon.0) 123 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:12:55.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:12:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:12:53.765693+0000 mgr.y (mgr.14146) 33 : audit [DBG] from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi018:172.21.15.18=a;smithi018:[v2:172.21.15.18:3301,v1:172.21.15.18:6790]=c;smithi071:172.21.15.71=b", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:12:55.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:12:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cephadm 2024-02-10T08:12:53.767988+0000 mgr.y (mgr.14146) 34 : cephadm [INF] Saving service mon spec with placement smithi018:172.21.15.18=a;smithi018:[v2:172.21.15.18:3301,v1:172.21.15.18:6790]=c;smithi071:172.21.15.71=b;count:3 2024-02-10T08:12:55.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:12:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cephadm 2024-02-10T08:12:53.812317+0000 mgr.y (mgr.14146) 35 : cephadm [INF] Deploying daemon mon.b on smithi071 2024-02-10T08:12:56.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:12:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:12:55.118927+0000 mgr.y (mgr.14146) 36 : cluster [DBG] pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:12:57.380 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-02-10T08:12:57.380 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":1,"fsid":"d46257c8-c7eb-11ee-95b8-87774f69a715","modified":"2024-02-10T08:10:54.474384Z","created":"2024-02-10T08:10:54.474384Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:3300","nonce":0},{"type":"v1","addr":"172.21.15.18:6789","nonce":0}]},"addr":"172.21.15.18:6789/0","public_addr":"172.21.15.18:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-10T08:12:57.381 INFO:teuthology.orchestra.run.smithi071.stderr:dumped monmap epoch 1 2024-02-10T08:12:58.461 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:12:58 smithi071 systemd[1]: Starting Ceph mon.b for d46257c8-c7eb-11ee-95b8-87774f69a715... 2024-02-10T08:12:58.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:12:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:12:57.119335+0000 mgr.y (mgr.14146) 37 : cluster [DBG] pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:12:58.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:12:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:12:57.281159+0000 mon.a (mon.0) 124 : audit [DBG] from='client.? 172.21.15.71:0/4063282275' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-10T08:12:59.422 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-02-10T08:12:59.422 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph mon dump -f json 2024-02-10T08:13:00.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:12:59.119740+0000 mgr.y (mgr.14146) 38 : cluster [DBG] pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:13:01.524 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.351+0000 7f9b6d9ca880 0 set uid:gid to 167:167 (ceph:ceph) 2024-02-10T08:13:01.524 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.351+0000 7f9b6d9ca880 0 ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable), process ceph-mon, pid 7 2024-02-10T08:13:01.524 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.351+0000 7f9b6d9ca880 0 pidfile_write: ignore empty --pid-file 2024-02-10T08:13:01.524 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.356+0000 7f9b6d9ca880 0 load: jerasure load: lrc load: isa 2024-02-10T08:13:01.524 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.356+0000 7f9b6d9ca880 4 rocksdb: RocksDB version: 6.8.1 2024-02-10T08:13:01.524 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: 2024-02-10T08:13:01.524 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.356+0000 7f9b6d9ca880 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-02-10T08:13:01.524 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.356+0000 7f9b6d9ca880 4 rocksdb: Compile date Feb 8 2024 2024-02-10T08:13:01.524 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.356+0000 7f9b6d9ca880 4 rocksdb: DB SUMMARY 2024-02-10T08:13:01.525 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: 2024-02-10T08:13:01.525 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: CURRENT file: CURRENT 2024-02-10T08:13:01.525 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: 2024-02-10T08:13:01.525 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: IDENTITY file: IDENTITY 2024-02-10T08:13:01.525 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: 2024-02-10T08:13:01.525 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: MANIFEST file: MANIFEST-000001 size: 13 Bytes 2024-02-10T08:13:01.525 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: 2024-02-10T08:13:01.525 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-02-10T08:13:01.525 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: 2024-02-10T08:13:01.525 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000003.log size: 511 ; 2024-02-10T08:13:01.525 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: 2024-02-10T08:13:01.525 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.error_if_exists: 0 2024-02-10T08:13:01.525 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.create_if_missing: 0 2024-02-10T08:13:01.525 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.paranoid_checks: 1 2024-02-10T08:13:01.526 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.env: 0x55c8e5f4a080 2024-02-10T08:13:01.526 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.fs: Posix File System 2024-02-10T08:13:01.526 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.info_log: 0x55c8e862a260 2024-02-10T08:13:01.526 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.max_file_opening_threads: 16 2024-02-10T08:13:01.526 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.statistics: (nil) 2024-02-10T08:13:01.526 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.use_fsync: 0 2024-02-10T08:13:01.526 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.max_log_file_size: 0 2024-02-10T08:13:01.526 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-10T08:13:01.526 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.log_file_time_to_roll: 0 2024-02-10T08:13:01.526 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.keep_log_file_num: 1000 2024-02-10T08:13:01.526 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.recycle_log_file_num: 0 2024-02-10T08:13:01.526 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.allow_fallocate: 1 2024-02-10T08:13:01.526 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.allow_mmap_reads: 0 2024-02-10T08:13:01.527 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.allow_mmap_writes: 0 2024-02-10T08:13:01.527 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.use_direct_reads: 0 2024-02-10T08:13:01.527 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-10T08:13:01.527 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.create_missing_column_families: 0 2024-02-10T08:13:01.527 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.db_log_dir: 2024-02-10T08:13:01.527 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-b/store.db 2024-02-10T08:13:01.527 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.table_cache_numshardbits: 6 2024-02-10T08:13:01.527 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.max_subcompactions: 1 2024-02-10T08:13:01.527 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.max_background_flushes: -1 2024-02-10T08:13:01.527 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-02-10T08:13:01.527 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-02-10T08:13:01.527 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-10T08:13:01.527 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-10T08:13:01.527 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-02-10T08:13:01.528 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.advise_random_on_open: 1 2024-02-10T08:13:01.528 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.db_write_buffer_size: 0 2024-02-10T08:13:01.528 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.write_buffer_manager: 0x55c8e931c3f0 2024-02-10T08:13:01.528 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-10T08:13:01.528 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-02-10T08:13:01.528 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-10T08:13:01.528 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.use_adaptive_mutex: 0 2024-02-10T08:13:01.528 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.rate_limiter: (nil) 2024-02-10T08:13:01.528 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-10T08:13:01.528 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.wal_recovery_mode: 2 2024-02-10T08:13:01.528 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.enable_thread_tracking: 0 2024-02-10T08:13:01.528 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.enable_pipelined_write: 0 2024-02-10T08:13:01.528 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.unordered_write: 0 2024-02-10T08:13:01.528 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-10T08:13:01.529 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-10T08:13:01.529 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-10T08:13:01.529 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-10T08:13:01.529 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.row_cache: None 2024-02-10T08:13:01.529 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.wal_filter: None 2024-02-10T08:13:01.529 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-10T08:13:01.529 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.allow_ingest_behind: 0 2024-02-10T08:13:01.529 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.preserve_deletes: 0 2024-02-10T08:13:01.529 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.two_write_queues: 0 2024-02-10T08:13:01.529 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.manual_wal_flush: 0 2024-02-10T08:13:01.529 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.atomic_flush: 0 2024-02-10T08:13:01.529 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-10T08:13:01.529 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.persist_stats_to_disk: 0 2024-02-10T08:13:01.529 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-02-10T08:13:01.529 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.log_readahead_size: 0 2024-02-10T08:13:01.530 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.sst_file_checksum_func: Unknown 2024-02-10T08:13:01.530 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.max_background_jobs: 2 2024-02-10T08:13:01.530 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.max_background_compactions: -1 2024-02-10T08:13:01.530 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-10T08:13:01.530 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-10T08:13:01.530 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.delayed_write_rate : 16777216 2024-02-10T08:13:01.530 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.max_total_wal_size: 0 2024-02-10T08:13:01.530 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-10T08:13:01.530 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.stats_dump_period_sec: 600 2024-02-10T08:13:01.530 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.stats_persist_period_sec: 600 2024-02-10T08:13:01.530 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-10T08:13:01.530 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.max_open_files: -1 2024-02-10T08:13:01.530 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.bytes_per_sync: 0 2024-02-10T08:13:01.530 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-02-10T08:13:01.530 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-02-10T08:13:01.531 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.compaction_readahead_size: 0 2024-02-10T08:13:01.531 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Compression algorithms supported: 2024-02-10T08:13:01.531 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-10T08:13:01.531 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: kZSTD supported: 0 2024-02-10T08:13:01.531 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: kXpressCompression supported: 0 2024-02-10T08:13:01.531 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: kLZ4HCCompression supported: 1 2024-02-10T08:13:01.531 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: kLZ4Compression supported: 1 2024-02-10T08:13:01.531 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: kBZip2Compression supported: 0 2024-02-10T08:13:01.531 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: kZlibCompression supported: 1 2024-02-10T08:13:01.531 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: kSnappyCompression supported: 1 2024-02-10T08:13:01.531 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-02-10T08:13:01.531 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000001 2024-02-10T08:13:01.531 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: 2024-02-10T08:13:01.531 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2024-02-10T08:13:01.531 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: 2024-02-10T08:13:01.532 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-10T08:13:01.532 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.merge_operator: 2024-02-10T08:13:01.532 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.compaction_filter: None 2024-02-10T08:13:01.532 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.compaction_filter_factory: None 2024-02-10T08:13:01.532 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-02-10T08:13:01.532 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.table_factory: BlockBasedTable 2024-02-10T08:13:01.532 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55c8e85cfd28) 2024-02-10T08:13:01.532 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cache_index_and_filter_blocks: 1 2024-02-10T08:13:01.532 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-10T08:13:01.532 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-10T08:13:01.532 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: pin_top_level_index_and_filter: 1 2024-02-10T08:13:01.532 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: index_type: 0 2024-02-10T08:13:01.532 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: data_block_index_type: 0 2024-02-10T08:13:01.532 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: index_shortening: 1 2024-02-10T08:13:01.532 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: data_block_hash_table_util_ratio: 0.750000 2024-02-10T08:13:01.533 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: hash_index_allow_collision: 1 2024-02-10T08:13:01.533 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: checksum: 1 2024-02-10T08:13:01.533 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: no_block_cache: 0 2024-02-10T08:13:01.533 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: block_cache: 0x55c8e8604f10 2024-02-10T08:13:01.533 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: block_cache_name: BinnedLRUCache 2024-02-10T08:13:01.533 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: block_cache_options: 2024-02-10T08:13:01.533 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: capacity : 536870912 2024-02-10T08:13:01.533 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: num_shard_bits : 4 2024-02-10T08:13:01.533 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: strict_capacity_limit : 0 2024-02-10T08:13:01.533 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: high_pri_pool_ratio: 0.000 2024-02-10T08:13:01.533 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: block_cache_compressed: (nil) 2024-02-10T08:13:01.533 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: persistent_cache: (nil) 2024-02-10T08:13:01.533 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: block_size: 4096 2024-02-10T08:13:01.533 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: block_size_deviation: 10 2024-02-10T08:13:01.535 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: block_restart_interval: 16 2024-02-10T08:13:01.535 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: index_block_restart_interval: 1 2024-02-10T08:13:01.535 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: metadata_block_size: 4096 2024-02-10T08:13:01.535 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: partition_filters: 0 2024-02-10T08:13:01.535 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: use_delta_encoding: 1 2024-02-10T08:13:01.535 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: filter_policy: rocksdb.BuiltinBloomFilter 2024-02-10T08:13:01.535 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: whole_key_filtering: 1 2024-02-10T08:13:01.536 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: verify_compression: 0 2024-02-10T08:13:01.536 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: read_amp_bytes_per_bit: 0 2024-02-10T08:13:01.536 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: format_version: 2 2024-02-10T08:13:01.536 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: enable_index_compression: 1 2024-02-10T08:13:01.536 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: block_align: 0 2024-02-10T08:13:01.536 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: 2024-02-10T08:13:01.536 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.write_buffer_size: 33554432 2024-02-10T08:13:01.536 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.max_write_buffer_number: 2 2024-02-10T08:13:01.536 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.compression: NoCompression 2024-02-10T08:13:01.536 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.bottommost_compression: Disabled 2024-02-10T08:13:01.536 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.prefix_extractor: nullptr 2024-02-10T08:13:01.536 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-10T08:13:01.536 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.num_levels: 7 2024-02-10T08:13:01.536 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-10T08:13:01.537 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-10T08:13:01.537 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-10T08:13:01.537 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-10T08:13:01.537 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-10T08:13:01.537 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-10T08:13:01.537 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-10T08:13:01.537 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-10T08:13:01.537 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-10T08:13:01.537 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.compression_opts.window_bits: -14 2024-02-10T08:13:01.537 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.compression_opts.level: 32767 2024-02-10T08:13:01.537 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.compression_opts.strategy: 0 2024-02-10T08:13:01.537 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-10T08:13:01.537 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-10T08:13:01.537 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.compression_opts.enabled: false 2024-02-10T08:13:01.538 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-10T08:13:01.538 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-10T08:13:01.538 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-10T08:13:01.538 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.target_file_size_base: 67108864 2024-02-10T08:13:01.538 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.target_file_size_multiplier: 1 2024-02-10T08:13:01.538 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-10T08:13:01.538 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-10T08:13:01.538 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-10T08:13:01.538 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-10T08:13:01.538 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-10T08:13:01.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-10T08:13:01.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-10T08:13:01.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-10T08:13:01.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-10T08:13:01.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-10T08:13:01.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-10T08:13:01.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-10T08:13:01.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.arena_block_size: 4194304 2024-02-10T08:13:01.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-10T08:13:01.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-10T08:13:01.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-02-10T08:13:01.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.disable_auto_compactions: 0 2024-02-10T08:13:01.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-10T08:13:01.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-10T08:13:01.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-10T08:13:01.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-10T08:13:01.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-10T08:13:01.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-10T08:13:01.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-10T08:13:01.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-10T08:13:01.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-10T08:13:01.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-10T08:13:01.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.table_properties_collectors: 2024-02-10T08:13:01.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.inplace_update_support: 0 2024-02-10T08:13:01.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-02-10T08:13:01.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-10T08:13:01.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-10T08:13:01.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.memtable_huge_page_size: 0 2024-02-10T08:13:01.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.bloom_locality: 0 2024-02-10T08:13:01.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.max_successive_merges: 0 2024-02-10T08:13:01.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-02-10T08:13:01.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.paranoid_file_checks: 0 2024-02-10T08:13:01.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.force_consistency_checks: 0 2024-02-10T08:13:01.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.report_bg_io_stats: 0 2024-02-10T08:13:01.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.ttl: 2592000 2024-02-10T08:13:01.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.357+0000 7f9b6d9ca880 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-02-10T08:13:01.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.358+0000 7f9b6d9ca880 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-02-10T08:13:01.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: 2024-02-10T08:13:01.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.358+0000 7f9b6d9ca880 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 0 2024-02-10T08:13:01.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: 2024-02-10T08:13:01.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.358+0000 7f9b6d9ca880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1707552781359375, "job": 1, "event": "recovery_started", "log_files": [3]} 2024-02-10T08:13:01.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.358+0000 7f9b6d9ca880 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #3 mode 2 2024-02-10T08:13:01.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.358+0000 7f9b6d9ca880 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-02-10T08:13:01.542 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.358+0000 7f9b6d9ca880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1707552781360032, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 4, "file_size": 1437, "table_properties": {"data_size": 523, "index_size": 40, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1707552781, "oldest_key_time": 3, "file_creation_time": 0}} 2024-02-10T08:13:01.542 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.358+0000 7f9b6d9ca880 4 rocksdb: [version_set.cc:3826] Creating manifest 5 2024-02-10T08:13:01.542 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: 2024-02-10T08:13:01.543 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.361+0000 7f9b6d9ca880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1707552781362726, "job": 1, "event": "recovery_finished"} 2024-02-10T08:13:01.543 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.362+0000 7f9b6d9ca880 4 rocksdb: DB pointer 0x55c8e86cd800 2024-02-10T08:13:01.543 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.362+0000 7f9b547bb700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2024-02-10T08:13:01.543 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.362+0000 7f9b547bb700 4 rocksdb: [db_impl/db_impl.cc:851] 2024-02-10T08:13:01.543 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: ** DB Stats ** 2024-02-10T08:13:01.543 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-10T08:13:01.543 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-10T08:13:01.543 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-10T08:13:01.543 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-10T08:13:01.543 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-10T08:13:01.543 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-02-10T08:13:01.543 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-10T08:13:01.543 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: 2024-02-10T08:13:01.543 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: ** Compaction Stats [default] ** 2024-02-10T08:13:01.544 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-10T08:13:01.544 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-10T08:13:01.544 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: L0 1/0 1.40 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.3 0.00 0.00 1 0.001 0 0 2024-02-10T08:13:01.544 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: Sum 1/0 1.40 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.3 0.00 0.00 1 0.001 0 0 2024-02-10T08:13:01.544 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.3 0.00 0.00 1 0.001 0 0 2024-02-10T08:13:01.544 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: 2024-02-10T08:13:01.544 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: ** Compaction Stats [default] ** 2024-02-10T08:13:01.544 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-10T08:13:01.544 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-10T08:13:01.544 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.3 0.00 0.00 1 0.001 0 0 2024-02-10T08:13:01.544 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-10T08:13:01.544 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: Flush(GB): cumulative 0.000, interval 0.000 2024-02-10T08:13:01.544 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-10T08:13:01.544 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: AddFile(Total Files): cumulative 0, interval 0 2024-02-10T08:13:01.545 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: AddFile(L0 Files): cumulative 0, interval 0 2024-02-10T08:13:01.545 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: AddFile(Keys): cumulative 0, interval 0 2024-02-10T08:13:01.545 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: Cumulative compaction: 0.00 GB write, 0.26 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-10T08:13:01.545 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: Interval compaction: 0.00 GB write, 0.26 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-10T08:13:01.545 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-10T08:13:01.545 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: 2024-02-10T08:13:01.545 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: ** File Read Latency Histogram By Level [default] ** 2024-02-10T08:13:01.545 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: 2024-02-10T08:13:01.545 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: ** Compaction Stats [default] ** 2024-02-10T08:13:01.545 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-10T08:13:01.545 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-10T08:13:01.545 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: L0 1/0 1.40 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.3 0.00 0.00 1 0.001 0 0 2024-02-10T08:13:01.545 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: Sum 1/0 1.40 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.3 0.00 0.00 1 0.001 0 0 2024-02-10T08:13:01.545 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-10T08:13:01.545 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: 2024-02-10T08:13:01.546 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: ** Compaction Stats [default] ** 2024-02-10T08:13:01.546 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-10T08:13:01.546 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-10T08:13:01.546 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.3 0.00 0.00 1 0.001 0 0 2024-02-10T08:13:01.546 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-10T08:13:01.546 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: Flush(GB): cumulative 0.000, interval 0.000 2024-02-10T08:13:01.546 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-10T08:13:01.546 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: AddFile(Total Files): cumulative 0, interval 0 2024-02-10T08:13:01.546 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: AddFile(L0 Files): cumulative 0, interval 0 2024-02-10T08:13:01.546 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: AddFile(Keys): cumulative 0, interval 0 2024-02-10T08:13:01.546 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: Cumulative compaction: 0.00 GB write, 0.25 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-10T08:13:01.546 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-10T08:13:01.546 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-10T08:13:01.546 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: 2024-02-10T08:13:01.546 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: ** File Read Latency Histogram By Level [default] ** 2024-02-10T08:13:01.547 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: 2024-02-10T08:13:01.547 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.362+0000 7f9b6d9ca880 0 mon.b does not exist in monmap, will attempt to join an existing cluster 2024-02-10T08:13:01.547 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.363+0000 7f9b6d9ca880 0 using public_addr v2:172.21.15.71:0/0 -> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-02-10T08:13:01.547 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.363+0000 7f9b6d9ca880 0 starting mon.b rank -1 at public addrs [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] at bind addrs [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid d46257c8-c7eb-11ee-95b8-87774f69a715 2024-02-10T08:13:01.547 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.365+0000 7f9b6d9ca880 1 mon.b@-1(???) e0 preinit fsid d46257c8-c7eb-11ee-95b8-87774f69a715 2024-02-10T08:13:01.547 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.387+0000 7f9b56fc0700 0 mon.b@-1(synchronizing).mds e1 new map 2024-02-10T08:13:01.547 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.387+0000 7f9b56fc0700 0 mon.b@-1(synchronizing).mds e1 print_map 2024-02-10T08:13:01.547 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: e1 2024-02-10T08:13:01.547 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: enable_multiple, ever_enabled_multiple: 1,1 2024-02-10T08:13:01.547 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-10T08:13:01.547 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: legacy client fscid: -1 2024-02-10T08:13:01.547 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: 2024-02-10T08:13:01.547 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: No filesystems configured 2024-02-10T08:13:01.547 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: 2024-02-10T08:13:01.547 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.387+0000 7f9b56fc0700 1 mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-02-10T08:13:01.548 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.387+0000 7f9b527b7700 4 rocksdb: [db_impl/db_impl_write.cc:1668] [default] New memtable created with log file: #9. Immutable memtables: 0. 2024-02-10T08:13:01.548 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: 2024-02-10T08:13:01.548 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.387+0000 7f9b5c7cb700 4 rocksdb: (Original Log Time 2024/02/10-08:13:01.388486) [db_impl/db_impl_compaction_flush.cc:2198] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots available 1, flush slots scheduled 1, compaction slots scheduled 0 2024-02-10T08:13:01.548 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.387+0000 7f9b5c7cb700 4 rocksdb: [flush_job.cc:321] [default] [JOB 3] Flushing memtable with next log file: 9 2024-02-10T08:13:01.548 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: 2024-02-10T08:13:01.548 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.387+0000 7f9b5c7cb700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1707552781388648, "job": 3, "event": "flush_started", "num_memtables": 1, "num_entries": 1072, "num_deletes": 13, "total_data_size": 3856060, "memory_usage": 3876056, "flush_reason": "Manual Compaction"} 2024-02-10T08:13:01.548 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.387+0000 7f9b5c7cb700 4 rocksdb: [flush_job.cc:350] [default] [JOB 3] Level-0 flush table #10: started 2024-02-10T08:13:01.548 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.387+0000 7f9b56fc0700 1 mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-02-10T08:13:01.548 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.387+0000 7f9b56fc0700 1 mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-02-10T08:13:01.548 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.387+0000 7f9b56fc0700 1 mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-02-10T08:13:01.548 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.387+0000 7f9b56fc0700 1 mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-02-10T08:13:01.548 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.387+0000 7f9b56fc0700 1 mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-02-10T08:13:01.549 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.387+0000 7f9b56fc0700 0 mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-02-10T08:13:01.549 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.387+0000 7f9b56fc0700 0 mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-02-10T08:13:01.550 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.387+0000 7f9b56fc0700 0 mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-02-10T08:13:01.550 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.387+0000 7f9b56fc0700 0 mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-02-10T08:13:01.550 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:12:59.119740+0000 mgr.y (mgr.14146) 38 : cluster [DBG] pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:13:01.550 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:13:01.388+0000 7f9b56fc0700 1 mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-02-10T08:13:01.550 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 bash[40773]: c5f6cdc6dac3a8ba4ffdfe51b153f2b9e79b114f2276c004a369f29df5b457a0 2024-02-10T08:13:01.550 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:01 smithi071 systemd[1]: Started Ceph mon.b for d46257c8-c7eb-11ee-95b8-87774f69a715. 2024-02-10T08:13:06.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:13:01.120163+0000 mgr.y (mgr.14146) 39 : cluster [DBG] pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:13:06.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:01.395694+0000 mon.a (mon.0) 126 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-10T08:13:06.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:01.395885+0000 mon.a (mon.0) 127 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-10T08:13:06.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:13:01.396048+0000 mon.a (mon.0) 128 : cluster [INF] mon.a calling monitor election 2024-02-10T08:13:06.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:02.393214+0000 mon.a (mon.0) 129 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-10T08:13:06.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:13:03.120520+0000 mgr.y (mgr.14146) 40 : cluster [DBG] pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:13:06.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:03.393027+0000 mon.a (mon.0) 130 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-10T08:13:06.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:13:03.394214+0000 mon.b (mon.1) 1 : cluster [INF] mon.b calling monitor election 2024-02-10T08:13:06.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:04.393169+0000 mon.a (mon.0) 131 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-10T08:13:06.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:13:05.120782+0000 mgr.y (mgr.14146) 41 : cluster [DBG] pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:13:06.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:05.393083+0000 mon.a (mon.0) 132 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-10T08:13:06.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:06.393314+0000 mon.a (mon.0) 133 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-10T08:13:06.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:13:06.422183+0000 mon.a (mon.0) 134 : cluster [INF] mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-02-10T08:13:06.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:13:06.425092+0000 mon.a (mon.0) 135 : cluster [DBG] monmap e2: 2 mons at {a=[v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0],b=[v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0]} removed_ranks: {} 2024-02-10T08:13:06.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:13:06.437495+0000 mon.a (mon.0) 136 : cluster [DBG] fsmap 2024-02-10T08:13:06.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:13:06.437537+0000 mon.a (mon.0) 137 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-02-10T08:13:06.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:13:06.437759+0000 mon.a (mon.0) 138 : cluster [DBG] mgrmap e13: y(active, since 71s) 2024-02-10T08:13:06.791 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:13:06.440661+0000 mon.a (mon.0) 139 : cluster [INF] overall HEALTH_OK 2024-02-10T08:13:06.791 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:06.442621+0000 mon.a (mon.0) 140 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:13:06.791 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:06.443635+0000 mon.a (mon.0) 141 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-10T08:13:06.791 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:06.444434+0000 mon.a (mon.0) 142 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:13:06.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:13:01.120163+0000 mgr.y (mgr.14146) 39 : cluster [DBG] pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:13:06.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:01.395694+0000 mon.a (mon.0) 126 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-10T08:13:06.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:01.395885+0000 mon.a (mon.0) 127 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-10T08:13:06.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:13:01.396048+0000 mon.a (mon.0) 128 : cluster [INF] mon.a calling monitor election 2024-02-10T08:13:06.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:02.393214+0000 mon.a (mon.0) 129 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-10T08:13:06.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:13:03.120520+0000 mgr.y (mgr.14146) 40 : cluster [DBG] pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:13:06.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:03.393027+0000 mon.a (mon.0) 130 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-10T08:13:06.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:13:03.394214+0000 mon.b (mon.1) 1 : cluster [INF] mon.b calling monitor election 2024-02-10T08:13:06.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:04.393169+0000 mon.a (mon.0) 131 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-10T08:13:06.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:13:05.120782+0000 mgr.y (mgr.14146) 41 : cluster [DBG] pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:13:06.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:05.393083+0000 mon.a (mon.0) 132 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-10T08:13:06.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:06.393314+0000 mon.a (mon.0) 133 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-10T08:13:06.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:13:06.422183+0000 mon.a (mon.0) 134 : cluster [INF] mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-02-10T08:13:06.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:13:06.425092+0000 mon.a (mon.0) 135 : cluster [DBG] monmap e2: 2 mons at {a=[v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0],b=[v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0]} removed_ranks: {} 2024-02-10T08:13:06.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:13:06.437495+0000 mon.a (mon.0) 136 : cluster [DBG] fsmap 2024-02-10T08:13:06.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:13:06.437537+0000 mon.a (mon.0) 137 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-02-10T08:13:06.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:13:06.437759+0000 mon.a (mon.0) 138 : cluster [DBG] mgrmap e13: y(active, since 71s) 2024-02-10T08:13:06.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:13:06.440661+0000 mon.a (mon.0) 139 : cluster [INF] overall HEALTH_OK 2024-02-10T08:13:06.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:06.442621+0000 mon.a (mon.0) 140 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:13:06.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:06.443635+0000 mon.a (mon.0) 141 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-10T08:13:06.906 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:06.444434+0000 mon.a (mon.0) 142 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:13:07.171 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-02-10T08:13:07.171 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":2,"fsid":"d46257c8-c7eb-11ee-95b8-87774f69a715","modified":"2024-02-10T08:13:01.393178Z","created":"2024-02-10T08:10:54.474384Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:3300","nonce":0},{"type":"v1","addr":"172.21.15.18:6789","nonce":0}]},"addr":"172.21.15.18:6789/0","public_addr":"172.21.15.18:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-02-10T08:13:07.173 INFO:teuthology.orchestra.run.smithi071.stderr:dumped monmap epoch 2 2024-02-10T08:13:07.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cephadm 2024-02-10T08:13:06.445182+0000 mgr.y (mgr.14146) 42 : cephadm [INF] Deploying daemon mon.c on smithi018 2024-02-10T08:13:07.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:07.170705+0000 mon.a (mon.0) 143 : audit [DBG] from='client.? 172.21.15.71:0/2765996173' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-10T08:13:07.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:07.393758+0000 mon.a (mon.0) 144 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-10T08:13:07.803 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cephadm 2024-02-10T08:13:06.445182+0000 mgr.y (mgr.14146) 42 : cephadm [INF] Deploying daemon mon.c on smithi018 2024-02-10T08:13:07.804 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:07.170705+0000 mon.a (mon.0) 143 : audit [DBG] from='client.? 172.21.15.71:0/2765996173' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-10T08:13:07.804 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:07.393758+0000 mon.a (mon.0) 144 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-10T08:13:08.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:13:07.121051+0000 mgr.y (mgr.14146) 43 : cluster [DBG] pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:13:08.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:13:07.121051+0000 mgr.y (mgr.14146) 43 : cluster [DBG] pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:13:09.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 systemd[1]: Starting Ceph mon.c for d46257c8-c7eb-11ee-95b8-87774f69a715... 2024-02-10T08:13:10.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.678+0000 7fd287ed7880 0 set uid:gid to 167:167 (ceph:ceph) 2024-02-10T08:13:10.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.678+0000 7fd287ed7880 0 ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable), process ceph-mon, pid 7 2024-02-10T08:13:10.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.678+0000 7fd287ed7880 0 pidfile_write: ignore empty --pid-file 2024-02-10T08:13:10.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.682+0000 7fd287ed7880 0 load: jerasure load: lrc load: isa 2024-02-10T08:13:10.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: RocksDB version: 6.8.1 2024-02-10T08:13:10.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: 2024-02-10T08:13:10.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-02-10T08:13:10.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Compile date Feb 8 2024 2024-02-10T08:13:10.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: DB SUMMARY 2024-02-10T08:13:10.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: 2024-02-10T08:13:10.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: CURRENT file: CURRENT 2024-02-10T08:13:10.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: 2024-02-10T08:13:10.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: IDENTITY file: IDENTITY 2024-02-10T08:13:10.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: 2024-02-10T08:13:10.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: MANIFEST file: MANIFEST-000001 size: 13 Bytes 2024-02-10T08:13:10.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: 2024-02-10T08:13:10.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-02-10T08:13:10.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: 2024-02-10T08:13:10.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000003.log size: 636 ; 2024-02-10T08:13:10.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: 2024-02-10T08:13:10.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.error_if_exists: 0 2024-02-10T08:13:10.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.create_if_missing: 0 2024-02-10T08:13:10.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.paranoid_checks: 1 2024-02-10T08:13:10.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.env: 0x55c08587e080 2024-02-10T08:13:10.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.fs: Posix File System 2024-02-10T08:13:10.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.info_log: 0x55c086f9a260 2024-02-10T08:13:10.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.max_file_opening_threads: 16 2024-02-10T08:13:10.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.statistics: (nil) 2024-02-10T08:13:10.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.use_fsync: 0 2024-02-10T08:13:10.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.max_log_file_size: 0 2024-02-10T08:13:10.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-10T08:13:10.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.log_file_time_to_roll: 0 2024-02-10T08:13:10.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.keep_log_file_num: 1000 2024-02-10T08:13:10.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.recycle_log_file_num: 0 2024-02-10T08:13:10.158 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.allow_fallocate: 1 2024-02-10T08:13:10.158 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.allow_mmap_reads: 0 2024-02-10T08:13:10.158 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.allow_mmap_writes: 0 2024-02-10T08:13:10.158 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.use_direct_reads: 0 2024-02-10T08:13:10.158 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-10T08:13:10.158 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.create_missing_column_families: 0 2024-02-10T08:13:10.158 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.db_log_dir: 2024-02-10T08:13:10.158 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-c/store.db 2024-02-10T08:13:10.158 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.table_cache_numshardbits: 6 2024-02-10T08:13:10.158 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.max_subcompactions: 1 2024-02-10T08:13:10.158 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.max_background_flushes: -1 2024-02-10T08:13:10.158 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-02-10T08:13:10.158 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-02-10T08:13:10.158 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-10T08:13:10.158 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-10T08:13:10.159 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-02-10T08:13:10.159 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.advise_random_on_open: 1 2024-02-10T08:13:10.159 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.db_write_buffer_size: 0 2024-02-10T08:13:10.159 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.write_buffer_manager: 0x55c087c8c3c0 2024-02-10T08:13:10.159 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-10T08:13:10.159 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-02-10T08:13:10.159 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-10T08:13:10.159 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.use_adaptive_mutex: 0 2024-02-10T08:13:10.159 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.rate_limiter: (nil) 2024-02-10T08:13:10.159 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-10T08:13:10.159 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.wal_recovery_mode: 2 2024-02-10T08:13:10.159 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.enable_thread_tracking: 0 2024-02-10T08:13:10.159 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.enable_pipelined_write: 0 2024-02-10T08:13:10.159 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.unordered_write: 0 2024-02-10T08:13:10.160 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-10T08:13:10.160 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-10T08:13:10.160 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-10T08:13:10.160 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-10T08:13:10.162 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.row_cache: None 2024-02-10T08:13:10.162 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.wal_filter: None 2024-02-10T08:13:10.162 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-10T08:13:10.162 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.allow_ingest_behind: 0 2024-02-10T08:13:10.162 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.preserve_deletes: 0 2024-02-10T08:13:10.162 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.two_write_queues: 0 2024-02-10T08:13:10.162 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.manual_wal_flush: 0 2024-02-10T08:13:10.162 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.atomic_flush: 0 2024-02-10T08:13:10.162 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-10T08:13:10.162 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.persist_stats_to_disk: 0 2024-02-10T08:13:10.162 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-02-10T08:13:10.162 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.log_readahead_size: 0 2024-02-10T08:13:10.163 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.sst_file_checksum_func: Unknown 2024-02-10T08:13:10.163 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.max_background_jobs: 2 2024-02-10T08:13:10.163 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.max_background_compactions: -1 2024-02-10T08:13:10.163 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-10T08:13:10.163 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-10T08:13:10.163 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.delayed_write_rate : 16777216 2024-02-10T08:13:10.163 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.max_total_wal_size: 0 2024-02-10T08:13:10.163 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-10T08:13:10.163 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.stats_dump_period_sec: 600 2024-02-10T08:13:10.163 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.stats_persist_period_sec: 600 2024-02-10T08:13:10.163 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-10T08:13:10.163 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.max_open_files: -1 2024-02-10T08:13:10.163 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.bytes_per_sync: 0 2024-02-10T08:13:10.163 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-02-10T08:13:10.164 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-02-10T08:13:10.164 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.compaction_readahead_size: 0 2024-02-10T08:13:10.164 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Compression algorithms supported: 2024-02-10T08:13:10.164 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-10T08:13:10.164 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: kZSTD supported: 0 2024-02-10T08:13:10.164 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: kXpressCompression supported: 0 2024-02-10T08:13:10.164 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: kLZ4HCCompression supported: 1 2024-02-10T08:13:10.164 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: kLZ4Compression supported: 1 2024-02-10T08:13:10.164 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: kBZip2Compression supported: 0 2024-02-10T08:13:10.164 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: kZlibCompression supported: 1 2024-02-10T08:13:10.164 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: kSnappyCompression supported: 1 2024-02-10T08:13:10.164 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-02-10T08:13:10.164 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000001 2024-02-10T08:13:10.164 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: 2024-02-10T08:13:10.165 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2024-02-10T08:13:10.165 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: 2024-02-10T08:13:10.165 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-10T08:13:10.165 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.merge_operator: 2024-02-10T08:13:10.165 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.compaction_filter: None 2024-02-10T08:13:10.165 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.compaction_filter_factory: None 2024-02-10T08:13:10.165 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-02-10T08:13:10.165 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.table_factory: BlockBasedTable 2024-02-10T08:13:10.165 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55c086f3fd28) 2024-02-10T08:13:10.165 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cache_index_and_filter_blocks: 1 2024-02-10T08:13:10.165 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-10T08:13:10.165 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-10T08:13:10.166 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: pin_top_level_index_and_filter: 1 2024-02-10T08:13:10.166 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: index_type: 0 2024-02-10T08:13:10.166 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: data_block_index_type: 0 2024-02-10T08:13:10.166 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: index_shortening: 1 2024-02-10T08:13:10.166 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: data_block_hash_table_util_ratio: 0.750000 2024-02-10T08:13:10.166 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: hash_index_allow_collision: 1 2024-02-10T08:13:10.166 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: checksum: 1 2024-02-10T08:13:10.166 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: no_block_cache: 0 2024-02-10T08:13:10.166 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: block_cache: 0x55c086f74f10 2024-02-10T08:13:10.166 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: block_cache_name: BinnedLRUCache 2024-02-10T08:13:10.166 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: block_cache_options: 2024-02-10T08:13:10.166 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: capacity : 536870912 2024-02-10T08:13:10.166 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: num_shard_bits : 4 2024-02-10T08:13:10.166 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: strict_capacity_limit : 0 2024-02-10T08:13:10.166 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: high_pri_pool_ratio: 0.000 2024-02-10T08:13:10.167 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: block_cache_compressed: (nil) 2024-02-10T08:13:10.167 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: persistent_cache: (nil) 2024-02-10T08:13:10.167 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: block_size: 4096 2024-02-10T08:13:10.167 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: block_size_deviation: 10 2024-02-10T08:13:10.167 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: block_restart_interval: 16 2024-02-10T08:13:10.167 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: index_block_restart_interval: 1 2024-02-10T08:13:10.167 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: metadata_block_size: 4096 2024-02-10T08:13:10.167 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: partition_filters: 0 2024-02-10T08:13:10.167 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: use_delta_encoding: 1 2024-02-10T08:13:10.167 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: filter_policy: rocksdb.BuiltinBloomFilter 2024-02-10T08:13:10.167 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: whole_key_filtering: 1 2024-02-10T08:13:10.168 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: verify_compression: 0 2024-02-10T08:13:10.168 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: read_amp_bytes_per_bit: 0 2024-02-10T08:13:10.168 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: format_version: 2 2024-02-10T08:13:10.168 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: enable_index_compression: 1 2024-02-10T08:13:10.168 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: block_align: 0 2024-02-10T08:13:10.168 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: 2024-02-10T08:13:10.168 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.write_buffer_size: 33554432 2024-02-10T08:13:10.168 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.max_write_buffer_number: 2 2024-02-10T08:13:10.168 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.compression: NoCompression 2024-02-10T08:13:10.168 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.bottommost_compression: Disabled 2024-02-10T08:13:10.168 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.prefix_extractor: nullptr 2024-02-10T08:13:10.168 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-10T08:13:10.168 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.num_levels: 7 2024-02-10T08:13:10.168 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-10T08:13:10.169 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-10T08:13:10.169 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-10T08:13:10.169 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-10T08:13:10.169 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-10T08:13:10.169 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-10T08:13:10.169 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-10T08:13:10.169 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-10T08:13:10.169 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-10T08:13:10.169 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.compression_opts.window_bits: -14 2024-02-10T08:13:10.169 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.compression_opts.level: 32767 2024-02-10T08:13:10.169 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.compression_opts.strategy: 0 2024-02-10T08:13:10.169 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-10T08:13:10.169 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-10T08:13:10.169 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.compression_opts.enabled: false 2024-02-10T08:13:10.170 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-10T08:13:10.170 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-10T08:13:10.170 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-10T08:13:10.170 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.target_file_size_base: 67108864 2024-02-10T08:13:10.170 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.target_file_size_multiplier: 1 2024-02-10T08:13:10.170 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-10T08:13:10.170 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-10T08:13:10.170 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-10T08:13:10.170 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-10T08:13:10.170 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-10T08:13:10.170 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-10T08:13:10.170 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-10T08:13:10.171 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-10T08:13:10.171 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-10T08:13:10.171 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-10T08:13:10.171 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-10T08:13:10.171 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-10T08:13:10.171 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.arena_block_size: 4194304 2024-02-10T08:13:10.171 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-10T08:13:10.171 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-10T08:13:10.171 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-02-10T08:13:10.171 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.disable_auto_compactions: 0 2024-02-10T08:13:10.171 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-10T08:13:10.171 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-10T08:13:10.171 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-10T08:13:10.171 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-10T08:13:10.171 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-10T08:13:10.172 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-10T08:13:10.172 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-10T08:13:10.172 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-10T08:13:10.172 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-10T08:13:10.172 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-10T08:13:10.172 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.table_properties_collectors: 2024-02-10T08:13:10.172 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.inplace_update_support: 0 2024-02-10T08:13:10.172 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-02-10T08:13:10.172 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-10T08:13:10.172 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-10T08:13:10.172 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.memtable_huge_page_size: 0 2024-02-10T08:13:10.172 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.bloom_locality: 0 2024-02-10T08:13:10.173 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.max_successive_merges: 0 2024-02-10T08:13:10.173 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-02-10T08:13:10.173 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.paranoid_file_checks: 0 2024-02-10T08:13:10.173 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.force_consistency_checks: 0 2024-02-10T08:13:10.173 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.report_bg_io_stats: 0 2024-02-10T08:13:10.173 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.ttl: 2592000 2024-02-10T08:13:10.173 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.683+0000 7fd287ed7880 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-02-10T08:13:10.173 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.684+0000 7fd287ed7880 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-02-10T08:13:10.173 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: 2024-02-10T08:13:10.173 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.684+0000 7fd287ed7880 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 0 2024-02-10T08:13:10.173 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: 2024-02-10T08:13:10.173 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.684+0000 7fd287ed7880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1707552789685150, "job": 1, "event": "recovery_started", "log_files": [3]} 2024-02-10T08:13:10.173 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.684+0000 7fd287ed7880 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #3 mode 2 2024-02-10T08:13:10.174 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.684+0000 7fd287ed7880 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-02-10T08:13:10.174 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.684+0000 7fd287ed7880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1707552789685561, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 4, "file_size": 1562, "table_properties": {"data_size": 648, "index_size": 40, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1707552789, "oldest_key_time": 3, "file_creation_time": 0}} 2024-02-10T08:13:10.174 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.684+0000 7fd287ed7880 4 rocksdb: [version_set.cc:3826] Creating manifest 5 2024-02-10T08:13:10.174 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: 2024-02-10T08:13:10.174 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.684+0000 7fd287ed7880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1707552789685986, "job": 1, "event": "recovery_finished"} 2024-02-10T08:13:10.174 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.685+0000 7fd287ed7880 4 rocksdb: DB pointer 0x55c08703d800 2024-02-10T08:13:10.174 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.685+0000 7fd26ecc8700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2024-02-10T08:13:10.174 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.685+0000 7fd26ecc8700 4 rocksdb: [db_impl/db_impl.cc:851] 2024-02-10T08:13:10.174 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: ** DB Stats ** 2024-02-10T08:13:10.174 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-10T08:13:10.174 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-10T08:13:10.174 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-10T08:13:10.174 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-10T08:13:10.175 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-10T08:13:10.175 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-02-10T08:13:10.175 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-10T08:13:10.175 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: 2024-02-10T08:13:10.175 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: ** Compaction Stats [default] ** 2024-02-10T08:13:10.175 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-10T08:13:10.175 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-10T08:13:10.175 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: L0 1/0 1.53 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 2024-02-10T08:13:10.175 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: Sum 1/0 1.53 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 2024-02-10T08:13:10.175 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 2024-02-10T08:13:10.175 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: 2024-02-10T08:13:10.175 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: ** Compaction Stats [default] ** 2024-02-10T08:13:10.175 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-10T08:13:10.175 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-10T08:13:10.176 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.0 0.00 0.00 1 0.000 0 0 2024-02-10T08:13:10.176 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-10T08:13:10.176 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: Flush(GB): cumulative 0.000, interval 0.000 2024-02-10T08:13:10.176 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-10T08:13:10.176 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: AddFile(Total Files): cumulative 0, interval 0 2024-02-10T08:13:10.176 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: AddFile(L0 Files): cumulative 0, interval 0 2024-02-10T08:13:10.176 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: AddFile(Keys): cumulative 0, interval 0 2024-02-10T08:13:10.176 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: Cumulative compaction: 0.00 GB write, 0.66 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-10T08:13:10.176 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: Interval compaction: 0.00 GB write, 0.66 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-10T08:13:10.176 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-10T08:13:10.176 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: 2024-02-10T08:13:10.177 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: ** File Read Latency Histogram By Level [default] ** 2024-02-10T08:13:10.177 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: 2024-02-10T08:13:10.177 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: ** Compaction Stats [default] ** 2024-02-10T08:13:10.177 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-10T08:13:10.177 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-10T08:13:10.177 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: L0 1/0 1.53 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 2024-02-10T08:13:10.177 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: Sum 1/0 1.53 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 2024-02-10T08:13:10.177 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-10T08:13:10.177 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: 2024-02-10T08:13:10.177 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: ** Compaction Stats [default] ** 2024-02-10T08:13:10.177 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-10T08:13:10.177 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-10T08:13:10.177 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.0 0.00 0.00 1 0.000 0 0 2024-02-10T08:13:10.177 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-10T08:13:10.178 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: Flush(GB): cumulative 0.000, interval 0.000 2024-02-10T08:13:10.178 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-10T08:13:10.178 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: AddFile(Total Files): cumulative 0, interval 0 2024-02-10T08:13:10.178 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: AddFile(L0 Files): cumulative 0, interval 0 2024-02-10T08:13:10.178 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: AddFile(Keys): cumulative 0, interval 0 2024-02-10T08:13:10.178 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: Cumulative compaction: 0.00 GB write, 0.65 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-10T08:13:10.178 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-10T08:13:10.178 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-10T08:13:10.178 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: 2024-02-10T08:13:10.178 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: ** File Read Latency Histogram By Level [default] ** 2024-02-10T08:13:10.178 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: 2024-02-10T08:13:10.178 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.685+0000 7fd287ed7880 0 mon.c does not exist in monmap, will attempt to join an existing cluster 2024-02-10T08:13:10.178 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.686+0000 7fd287ed7880 0 using public_addrv [v2:172.21.15.18:3301/0,v1:172.21.15.18:6790/0] 2024-02-10T08:13:10.178 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.686+0000 7fd287ed7880 0 starting mon.c rank -1 at public addrs [v2:172.21.15.18:3301/0,v1:172.21.15.18:6790/0] at bind addrs [v2:172.21.15.18:3301/0,v1:172.21.15.18:6790/0] mon_data /var/lib/ceph/mon/ceph-c fsid d46257c8-c7eb-11ee-95b8-87774f69a715 2024-02-10T08:13:10.178 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.687+0000 7fd287ed7880 1 mon.c@-1(???) e0 preinit fsid d46257c8-c7eb-11ee-95b8-87774f69a715 2024-02-10T08:13:10.179 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.703+0000 7fd26ccc4700 4 rocksdb: [db_impl/db_impl_write.cc:1668] [default] New memtable created with log file: #9. Immutable memtables: 0. 2024-02-10T08:13:10.179 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: 2024-02-10T08:13:10.179 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.704+0000 7fd276cd8700 4 rocksdb: (Original Log Time 2024/02/10-08:13:09.705019) [db_impl/db_impl_compaction_flush.cc:2198] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots available 1, flush slots scheduled 1, compaction slots scheduled 0 2024-02-10T08:13:10.179 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.704+0000 7fd276cd8700 4 rocksdb: [flush_job.cc:321] [default] [JOB 3] Flushing memtable with next log file: 9 2024-02-10T08:13:10.179 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: 2024-02-10T08:13:10.179 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.704+0000 7fd276cd8700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1707552789705078, "job": 3, "event": "flush_started", "num_memtables": 1, "num_entries": 1111, "num_deletes": 10, "total_data_size": 4022733, "memory_usage": 4043800, "flush_reason": "Manual Compaction"} 2024-02-10T08:13:10.179 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.704+0000 7fd276cd8700 4 rocksdb: [flush_job.cc:350] [default] [JOB 3] Level-0 flush table #10: started 2024-02-10T08:13:10.179 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.704+0000 7fd2714cd700 0 mon.c@-1(synchronizing).mds e1 new map 2024-02-10T08:13:10.179 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.704+0000 7fd2714cd700 0 mon.c@-1(synchronizing).mds e1 print_map 2024-02-10T08:13:10.179 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: e1 2024-02-10T08:13:10.179 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: enable_multiple, ever_enabled_multiple: 1,1 2024-02-10T08:13:10.179 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-10T08:13:10.179 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: legacy client fscid: -1 2024-02-10T08:13:10.179 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: 2024-02-10T08:13:10.180 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: No filesystems configured 2024-02-10T08:13:10.180 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: 2024-02-10T08:13:10.180 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.704+0000 7fd2714cd700 1 mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-02-10T08:13:10.180 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.704+0000 7fd2714cd700 1 mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-02-10T08:13:10.180 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.704+0000 7fd2714cd700 1 mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-02-10T08:13:10.180 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.704+0000 7fd2714cd700 1 mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-02-10T08:13:10.180 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.704+0000 7fd2714cd700 1 mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-02-10T08:13:10.180 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.704+0000 7fd2714cd700 1 mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-02-10T08:13:10.180 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.704+0000 7fd2714cd700 0 mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-02-10T08:13:10.180 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.704+0000 7fd2714cd700 0 mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-02-10T08:13:10.180 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.704+0000 7fd2714cd700 0 mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-02-10T08:13:10.180 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.704+0000 7fd2714cd700 0 mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-02-10T08:13:10.180 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:13:07.121051+0000 mgr.y (mgr.14146) 43 : cluster [DBG] pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:13:10.180 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:13:09.705+0000 7fd2714cd700 1 mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-02-10T08:13:10.181 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 bash[46217]: 3db5b32badacb698815762d16892ec46345703a3bcebc91f38fd145170ed3c4f 2024-02-10T08:13:10.181 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:09 smithi018 systemd[1]: Started Ceph mon.c for d46257c8-c7eb-11ee-95b8-87774f69a715. 2024-02-10T08:13:12.097 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-02-10T08:13:12.097 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph mon dump -f json 2024-02-10T08:13:15.118 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:09.712423+0000 mon.a (mon.0) 146 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-10T08:13:15.118 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:13:09.712606+0000 mon.a (mon.0) 147 : cluster [INF] mon.a calling monitor election 2024-02-10T08:13:15.118 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:13:09.713957+0000 mon.b (mon.1) 2 : cluster [INF] mon.b calling monitor election 2024-02-10T08:13:15.118 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:09.724826+0000 mon.a (mon.0) 148 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-10T08:13:15.118 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:09.724940+0000 mon.a (mon.0) 149 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-10T08:13:15.119 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:10.709530+0000 mon.a (mon.0) 150 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-10T08:13:15.119 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:13:11.121618+0000 mgr.y (mgr.14146) 45 : cluster [DBG] pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:13:15.119 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:11.709495+0000 mon.a (mon.0) 151 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-10T08:13:15.119 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:13:11.710970+0000 mon.c (mon.2) 1 : cluster [INF] mon.c calling monitor election 2024-02-10T08:13:15.119 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:12.709624+0000 mon.a (mon.0) 152 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-10T08:13:15.119 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:13:13.121941+0000 mgr.y (mgr.14146) 46 : cluster [DBG] pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:13:15.119 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:13.710006+0000 mon.a (mon.0) 153 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-10T08:13:15.119 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:14.709980+0000 mon.a (mon.0) 154 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-10T08:13:15.119 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:13:14.738047+0000 mon.a (mon.0) 155 : cluster [INF] mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-02-10T08:13:15.119 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:13:14.741114+0000 mon.a (mon.0) 156 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0],b=[v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0],c=[v2:172.21.15.18:3301/0,v1:172.21.15.18:6790/0]} removed_ranks: {} 2024-02-10T08:13:15.119 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:13:14.753473+0000 mon.a (mon.0) 157 : cluster [DBG] fsmap 2024-02-10T08:13:15.119 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:13:14.753517+0000 mon.a (mon.0) 158 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-02-10T08:13:15.119 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:13:14.753742+0000 mon.a (mon.0) 159 : cluster [DBG] mgrmap e13: y(active, since 79s) 2024-02-10T08:13:15.119 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:13:14.757250+0000 mon.a (mon.0) 160 : cluster [INF] overall HEALTH_OK 2024-02-10T08:13:15.119 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:14.760414+0000 mon.a (mon.0) 161 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:13:15.120 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:14.761774+0000 mon.a (mon.0) 162 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:13:15.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:09.712423+0000 mon.a (mon.0) 146 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-10T08:13:15.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:13:09.712606+0000 mon.a (mon.0) 147 : cluster [INF] mon.a calling monitor election 2024-02-10T08:13:15.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:13:09.713957+0000 mon.b (mon.1) 2 : cluster [INF] mon.b calling monitor election 2024-02-10T08:13:15.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:09.724826+0000 mon.a (mon.0) 148 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-10T08:13:15.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:09.724940+0000 mon.a (mon.0) 149 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-10T08:13:15.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:10.709530+0000 mon.a (mon.0) 150 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-10T08:13:15.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:13:11.121618+0000 mgr.y (mgr.14146) 45 : cluster [DBG] pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:13:15.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:11.709495+0000 mon.a (mon.0) 151 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-10T08:13:15.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:13:11.710970+0000 mon.c (mon.2) 1 : cluster [INF] mon.c calling monitor election 2024-02-10T08:13:15.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:12.709624+0000 mon.a (mon.0) 152 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-10T08:13:15.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:13:13.121941+0000 mgr.y (mgr.14146) 46 : cluster [DBG] pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:13:15.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:13.710006+0000 mon.a (mon.0) 153 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-10T08:13:15.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:14.709980+0000 mon.a (mon.0) 154 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-10T08:13:15.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:13:14.738047+0000 mon.a (mon.0) 155 : cluster [INF] mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-02-10T08:13:15.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:13:14.741114+0000 mon.a (mon.0) 156 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0],b=[v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0],c=[v2:172.21.15.18:3301/0,v1:172.21.15.18:6790/0]} removed_ranks: {} 2024-02-10T08:13:15.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:13:14.753473+0000 mon.a (mon.0) 157 : cluster [DBG] fsmap 2024-02-10T08:13:15.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:13:14.753517+0000 mon.a (mon.0) 158 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-02-10T08:13:15.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:09.712423+0000 mon.a (mon.0) 146 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-10T08:13:15.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:13:09.712606+0000 mon.a (mon.0) 147 : cluster [INF] mon.a calling monitor election 2024-02-10T08:13:15.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:13:09.713957+0000 mon.b (mon.1) 2 : cluster [INF] mon.b calling monitor election 2024-02-10T08:13:15.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:09.724826+0000 mon.a (mon.0) 148 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-10T08:13:15.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:09.724940+0000 mon.a (mon.0) 149 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-10T08:13:15.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:10.709530+0000 mon.a (mon.0) 150 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-10T08:13:15.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:13:11.121618+0000 mgr.y (mgr.14146) 45 : cluster [DBG] pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:13:15.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:11.709495+0000 mon.a (mon.0) 151 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-10T08:13:15.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:13:11.710970+0000 mon.c (mon.2) 1 : cluster [INF] mon.c calling monitor election 2024-02-10T08:13:15.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:12.709624+0000 mon.a (mon.0) 152 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-10T08:13:15.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:13:13.121941+0000 mgr.y (mgr.14146) 46 : cluster [DBG] pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:13:15.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:13.710006+0000 mon.a (mon.0) 153 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-10T08:13:15.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:14.709980+0000 mon.a (mon.0) 154 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-10T08:13:15.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:13:14.738047+0000 mon.a (mon.0) 155 : cluster [INF] mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-02-10T08:13:15.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:13:14.741114+0000 mon.a (mon.0) 156 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0],b=[v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0],c=[v2:172.21.15.18:3301/0,v1:172.21.15.18:6790/0]} removed_ranks: {} 2024-02-10T08:13:15.158 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:13:14.753473+0000 mon.a (mon.0) 157 : cluster [DBG] fsmap 2024-02-10T08:13:15.158 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:13:14.753517+0000 mon.a (mon.0) 158 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-02-10T08:13:15.158 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:13:14.753742+0000 mon.a (mon.0) 159 : cluster [DBG] mgrmap e13: y(active, since 79s) 2024-02-10T08:13:15.158 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:13:14.757250+0000 mon.a (mon.0) 160 : cluster [INF] overall HEALTH_OK 2024-02-10T08:13:15.158 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:14.760414+0000 mon.a (mon.0) 161 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:13:15.158 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:14.761774+0000 mon.a (mon.0) 162 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:13:15.158 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:13:14.753742+0000 mon.a (mon.0) 159 : cluster [DBG] mgrmap e13: y(active, since 79s) 2024-02-10T08:13:15.159 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:13:14.757250+0000 mon.a (mon.0) 160 : cluster [INF] overall HEALTH_OK 2024-02-10T08:13:15.159 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:14.760414+0000 mon.a (mon.0) 161 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:13:15.159 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:14.761774+0000 mon.a (mon.0) 162 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:13:16.287 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:13:15.122160+0000 mgr.y (mgr.14146) 47 : cluster [DBG] pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:13:16.287 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:15.256051+0000 mon.a (mon.0) 163 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:13:16.287 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:15.710239+0000 mon.a (mon.0) 164 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-10T08:13:16.287 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:15.846087+0000 mon.a (mon.0) 165 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:13:16.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:13:15.122160+0000 mgr.y (mgr.14146) 47 : cluster [DBG] pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:13:16.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:15.256051+0000 mon.a (mon.0) 163 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:13:16.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:15.710239+0000 mon.a (mon.0) 164 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-10T08:13:16.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:15.846087+0000 mon.a (mon.0) 165 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:13:16.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:13:15.122160+0000 mgr.y (mgr.14146) 47 : cluster [DBG] pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:13:16.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:15.256051+0000 mon.a (mon.0) 163 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:13:16.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:15.710239+0000 mon.a (mon.0) 164 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-10T08:13:16.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:15.846087+0000 mon.a (mon.0) 165 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:13:16.682 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-02-10T08:13:16.682 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":3,"fsid":"d46257c8-c7eb-11ee-95b8-87774f69a715","modified":"2024-02-10T08:13:09.709967Z","created":"2024-02-10T08:10:54.474384Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:3300","nonce":0},{"type":"v1","addr":"172.21.15.18:6789","nonce":0}]},"addr":"172.21.15.18:6789/0","public_addr":"172.21.15.18:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:3301","nonce":0},{"type":"v1","addr":"172.21.15.18:6790","nonce":0}]},"addr":"172.21.15.18:6790/0","public_addr":"172.21.15.18:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-02-10T08:13:16.684 INFO:teuthology.orchestra.run.smithi071.stderr:dumped monmap epoch 3 2024-02-10T08:13:17.658 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:16.682722+0000 mon.b (mon.1) 3 : audit [DBG] from='client.? 172.21.15.71:0/1381604117' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-10T08:13:17.658 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:16.682722+0000 mon.b (mon.1) 3 : audit [DBG] from='client.? 172.21.15.71:0/1381604117' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-10T08:13:17.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:16.682722+0000 mon.b (mon.1) 3 : audit [DBG] from='client.? 172.21.15.71:0/1381604117' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-10T08:13:17.850 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-02-10T08:13:17.851 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph config generate-minimal-conf 2024-02-10T08:13:18.552 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:13:17.122503+0000 mgr.y (mgr.14146) 48 : cluster [DBG] pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:13:18.552 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:17.424110+0000 mon.a (mon.0) 166 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:13:18.553 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:17.424885+0000 mon.a (mon.0) 167 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:13:18.553 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:17.425695+0000 mon.a (mon.0) 168 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:13:18.553 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cephadm 2024-02-10T08:13:17.426759+0000 mgr.y (mgr.14146) 49 : cephadm [INF] Updating smithi018:/etc/ceph/ceph.conf 2024-02-10T08:13:18.553 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cephadm 2024-02-10T08:13:17.427106+0000 mgr.y (mgr.14146) 50 : cephadm [INF] Updating smithi071:/etc/ceph/ceph.conf 2024-02-10T08:13:18.553 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:17.443700+0000 mon.a (mon.0) 169 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:13:18.553 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:17.457187+0000 mon.a (mon.0) 170 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:13:18.553 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:17.460627+0000 mon.a (mon.0) 171 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:13:18.553 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cephadm 2024-02-10T08:13:17.462120+0000 mgr.y (mgr.14146) 51 : cephadm [INF] Reconfiguring mon.a (unknown last config time)... 2024-02-10T08:13:18.553 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:17.462435+0000 mon.a (mon.0) 172 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-10T08:13:18.553 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:17.463211+0000 mon.a (mon.0) 173 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-10T08:13:18.554 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:17.464002+0000 mon.a (mon.0) 174 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:13:18.554 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cephadm 2024-02-10T08:13:17.464703+0000 mgr.y (mgr.14146) 52 : cephadm [INF] Reconfiguring daemon mon.a on smithi018 2024-02-10T08:13:18.554 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:13:17.122503+0000 mgr.y (mgr.14146) 48 : cluster [DBG] pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:13:18.554 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:17.424110+0000 mon.a (mon.0) 166 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:13:18.554 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:17.424885+0000 mon.a (mon.0) 167 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:13:18.554 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:17.425695+0000 mon.a (mon.0) 168 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:13:18.554 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cephadm 2024-02-10T08:13:17.426759+0000 mgr.y (mgr.14146) 49 : cephadm [INF] Updating smithi018:/etc/ceph/ceph.conf 2024-02-10T08:13:18.554 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cephadm 2024-02-10T08:13:17.427106+0000 mgr.y (mgr.14146) 50 : cephadm [INF] Updating smithi071:/etc/ceph/ceph.conf 2024-02-10T08:13:18.555 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:17.443700+0000 mon.a (mon.0) 169 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:13:18.555 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:17.457187+0000 mon.a (mon.0) 170 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:13:18.555 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:17.460627+0000 mon.a (mon.0) 171 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:13:18.555 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cephadm 2024-02-10T08:13:17.462120+0000 mgr.y (mgr.14146) 51 : cephadm [INF] Reconfiguring mon.a (unknown last config time)... 2024-02-10T08:13:18.555 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:17.462435+0000 mon.a (mon.0) 172 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-10T08:13:18.555 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:17.463211+0000 mon.a (mon.0) 173 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-10T08:13:18.555 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:17.464002+0000 mon.a (mon.0) 174 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:13:18.555 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cephadm 2024-02-10T08:13:17.464703+0000 mgr.y (mgr.14146) 52 : cephadm [INF] Reconfiguring daemon mon.a on smithi018 2024-02-10T08:13:18.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:13:17.122503+0000 mgr.y (mgr.14146) 48 : cluster [DBG] pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:13:18.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:17.424110+0000 mon.a (mon.0) 166 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:13:18.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:17.424885+0000 mon.a (mon.0) 167 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:13:18.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:17.425695+0000 mon.a (mon.0) 168 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:13:18.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cephadm 2024-02-10T08:13:17.426759+0000 mgr.y (mgr.14146) 49 : cephadm [INF] Updating smithi018:/etc/ceph/ceph.conf 2024-02-10T08:13:18.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cephadm 2024-02-10T08:13:17.427106+0000 mgr.y (mgr.14146) 50 : cephadm [INF] Updating smithi071:/etc/ceph/ceph.conf 2024-02-10T08:13:18.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:17.443700+0000 mon.a (mon.0) 169 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:13:18.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:17.457187+0000 mon.a (mon.0) 170 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:13:18.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:17.460627+0000 mon.a (mon.0) 171 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:13:18.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cephadm 2024-02-10T08:13:17.462120+0000 mgr.y (mgr.14146) 51 : cephadm [INF] Reconfiguring mon.a (unknown last config time)... 2024-02-10T08:13:18.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:17.462435+0000 mon.a (mon.0) 172 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-10T08:13:18.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:17.463211+0000 mon.a (mon.0) 173 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-10T08:13:18.791 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:17.464002+0000 mon.a (mon.0) 174 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:13:18.791 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cephadm 2024-02-10T08:13:17.464703+0000 mgr.y (mgr.14146) 52 : cephadm [INF] Reconfiguring daemon mon.a on smithi018 2024-02-10T08:13:20.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:18.910663+0000 mon.a (mon.0) 175 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:13:20.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cephadm 2024-02-10T08:13:18.911319+0000 mgr.y (mgr.14146) 53 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2024-02-10T08:13:20.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:18.911624+0000 mon.a (mon.0) 176 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-10T08:13:20.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:18.912433+0000 mon.a (mon.0) 177 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-10T08:13:20.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:18.913188+0000 mon.a (mon.0) 178 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:13:20.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cephadm 2024-02-10T08:13:18.913834+0000 mgr.y (mgr.14146) 54 : cephadm [INF] Reconfiguring daemon mon.c on smithi018 2024-02-10T08:13:20.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:13:19.122780+0000 mgr.y (mgr.14146) 55 : cluster [DBG] pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:13:20.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:18.910663+0000 mon.a (mon.0) 175 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:13:20.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cephadm 2024-02-10T08:13:18.911319+0000 mgr.y (mgr.14146) 53 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2024-02-10T08:13:20.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:18.911624+0000 mon.a (mon.0) 176 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-10T08:13:20.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:18.912433+0000 mon.a (mon.0) 177 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-10T08:13:20.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:18.913188+0000 mon.a (mon.0) 178 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:13:20.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cephadm 2024-02-10T08:13:18.913834+0000 mgr.y (mgr.14146) 54 : cephadm [INF] Reconfiguring daemon mon.c on smithi018 2024-02-10T08:13:20.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:13:19.122780+0000 mgr.y (mgr.14146) 55 : cluster [DBG] pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:13:20.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:18.910663+0000 mon.a (mon.0) 175 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:13:20.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cephadm 2024-02-10T08:13:18.911319+0000 mgr.y (mgr.14146) 53 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2024-02-10T08:13:20.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:18.911624+0000 mon.a (mon.0) 176 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-10T08:13:20.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:18.912433+0000 mon.a (mon.0) 177 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-10T08:13:20.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:18.913188+0000 mon.a (mon.0) 178 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:13:20.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cephadm 2024-02-10T08:13:18.913834+0000 mgr.y (mgr.14146) 54 : cephadm [INF] Reconfiguring daemon mon.c on smithi018 2024-02-10T08:13:20.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:13:19.122780+0000 mgr.y (mgr.14146) 55 : cluster [DBG] pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:13:21.632 INFO:teuthology.orchestra.run.smithi018.stdout:# minimal ceph.conf for d46257c8-c7eb-11ee-95b8-87774f69a715 2024-02-10T08:13:21.633 INFO:teuthology.orchestra.run.smithi018.stdout:[global] 2024-02-10T08:13:21.633 INFO:teuthology.orchestra.run.smithi018.stdout: fsid = d46257c8-c7eb-11ee-95b8-87774f69a715 2024-02-10T08:13:21.633 INFO:teuthology.orchestra.run.smithi018.stdout: mon_host = [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] [v2:172.21.15.18:3301/0,v1:172.21.15.18:6790/0] 2024-02-10T08:13:21.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:20.585981+0000 mon.a (mon.0) 179 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:13:21.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cephadm 2024-02-10T08:13:20.586532+0000 mgr.y (mgr.14146) 56 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2024-02-10T08:13:21.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:20.586801+0000 mon.a (mon.0) 180 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-10T08:13:21.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:20.587461+0000 mon.a (mon.0) 181 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-10T08:13:21.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:20.588080+0000 mon.a (mon.0) 182 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:13:21.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cephadm 2024-02-10T08:13:20.588651+0000 mgr.y (mgr.14146) 57 : cephadm [INF] Reconfiguring daemon mon.b on smithi071 2024-02-10T08:13:21.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:13:21.123184+0000 mgr.y (mgr.14146) 58 : cluster [DBG] pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:13:21.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:20.585981+0000 mon.a (mon.0) 179 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:13:21.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cephadm 2024-02-10T08:13:20.586532+0000 mgr.y (mgr.14146) 56 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2024-02-10T08:13:21.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:20.586801+0000 mon.a (mon.0) 180 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-10T08:13:21.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:20.587461+0000 mon.a (mon.0) 181 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-10T08:13:21.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:20.588080+0000 mon.a (mon.0) 182 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:13:21.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cephadm 2024-02-10T08:13:20.588651+0000 mgr.y (mgr.14146) 57 : cephadm [INF] Reconfiguring daemon mon.b on smithi071 2024-02-10T08:13:21.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:13:21.123184+0000 mgr.y (mgr.14146) 58 : cluster [DBG] pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:13:21.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:20.585981+0000 mon.a (mon.0) 179 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:13:21.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cephadm 2024-02-10T08:13:20.586532+0000 mgr.y (mgr.14146) 56 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2024-02-10T08:13:21.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:20.586801+0000 mon.a (mon.0) 180 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-10T08:13:21.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:20.587461+0000 mon.a (mon.0) 181 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-10T08:13:21.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:20.588080+0000 mon.a (mon.0) 182 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:13:21.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cephadm 2024-02-10T08:13:20.588651+0000 mgr.y (mgr.14146) 57 : cephadm [INF] Reconfiguring daemon mon.b on smithi071 2024-02-10T08:13:21.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:13:21.123184+0000 mgr.y (mgr.14146) 58 : cluster [DBG] pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:13:22.352 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-02-10T08:13:22.352 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-02-10T08:13:22.352 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/etc/ceph/ceph.conf 2024-02-10T08:13:22.387 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-02-10T08:13:22.387 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-02-10T08:13:22.459 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-02-10T08:13:22.459 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/ceph/ceph.conf 2024-02-10T08:13:22.491 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-02-10T08:13:22.491 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-02-10T08:13:22.559 INFO:tasks.cephadm:Adding mgr.y on smithi018 2024-02-10T08:13:22.559 INFO:tasks.cephadm:Adding mgr.x on smithi071 2024-02-10T08:13:22.560 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph orch apply mgr '2;smithi018=y;smithi071=x' 2024-02-10T08:13:22.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:21.632154+0000 mon.a (mon.0) 183 : audit [DBG] from='client.? 172.21.15.18:0/988910470' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:13:22.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:21.859517+0000 mon.a (mon.0) 184 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:13:22.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:21.860272+0000 mon.a (mon.0) 185 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:13:22.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:21.861534+0000 mon.a (mon.0) 186 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:13:22.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:21.862118+0000 mon.a (mon.0) 187 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:13:22.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:21.865502+0000 mon.a (mon.0) 188 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:13:22.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:21.632154+0000 mon.a (mon.0) 183 : audit [DBG] from='client.? 172.21.15.18:0/988910470' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:13:22.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:21.859517+0000 mon.a (mon.0) 184 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:13:22.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:21.860272+0000 mon.a (mon.0) 185 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:13:22.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:21.861534+0000 mon.a (mon.0) 186 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:13:22.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:21.862118+0000 mon.a (mon.0) 187 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:13:22.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:21.865502+0000 mon.a (mon.0) 188 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:13:22.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:21.632154+0000 mon.a (mon.0) 183 : audit [DBG] from='client.? 172.21.15.18:0/988910470' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:13:22.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:21.859517+0000 mon.a (mon.0) 184 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:13:22.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:21.860272+0000 mon.a (mon.0) 185 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:13:22.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:21.861534+0000 mon.a (mon.0) 186 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:13:22.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:21.862118+0000 mon.a (mon.0) 187 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:13:22.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:21.865502+0000 mon.a (mon.0) 188 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:13:23.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:13:23.123581+0000 mgr.y (mgr.14146) 59 : cluster [DBG] pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:13:23.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:13:23.123581+0000 mgr.y (mgr.14146) 59 : cluster [DBG] pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:13:23.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:13:23.123581+0000 mgr.y (mgr.14146) 59 : cluster [DBG] pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:13:24.473 INFO:teuthology.orchestra.run.smithi071.stdout:Scheduled mgr update... 2024-02-10T08:13:25.110 DEBUG:teuthology.orchestra.run.smithi071:mgr.x> sudo journalctl -f -n 0 -u ceph-d46257c8-c7eb-11ee-95b8-87774f69a715@mgr.x.service 2024-02-10T08:13:25.112 INFO:tasks.cephadm:Deploying OSDs... 2024-02-10T08:13:25.113 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-02-10T08:13:25.113 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/scratch_devs of=/dev/stdout 2024-02-10T08:13:25.136 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-10T08:13:25.136 DEBUG:teuthology.orchestra.run.smithi018:> stat /dev/vg_nvme/lv_1 2024-02-10T08:13:25.141 INFO:journalctl@ceph.mgr.x.smithi071.stdout:-- Logs begin at Sat 2024-02-10 07:59:38 UTC. -- 2024-02-10T08:13:25.197 INFO:teuthology.orchestra.run.smithi018.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-10T08:13:25.197 INFO:teuthology.orchestra.run.smithi018.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-10T08:13:25.197 INFO:teuthology.orchestra.run.smithi018.stdout:Device: 6h/6d Inode: 170163 Links: 1 2024-02-10T08:13:25.197 INFO:teuthology.orchestra.run.smithi018.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-10T08:13:25.197 INFO:teuthology.orchestra.run.smithi018.stdout:Context: system_u:object_r:device_t:s0 2024-02-10T08:13:25.197 INFO:teuthology.orchestra.run.smithi018.stdout:Access: 2024-02-10 08:13:09.091460330 +0000 2024-02-10T08:13:25.198 INFO:teuthology.orchestra.run.smithi018.stdout:Modify: 2024-02-10 08:05:43.658994019 +0000 2024-02-10T08:13:25.198 INFO:teuthology.orchestra.run.smithi018.stdout:Change: 2024-02-10 08:05:43.658994019 +0000 2024-02-10T08:13:25.198 INFO:teuthology.orchestra.run.smithi018.stdout: Birth: - 2024-02-10T08:13:25.198 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-10T08:13:25.270 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records in 2024-02-10T08:13:25.270 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records out 2024-02-10T08:13:25.270 INFO:teuthology.orchestra.run.smithi018.stderr:512 bytes copied, 0.000105219 s, 4.9 MB/s 2024-02-10T08:13:25.271 DEBUG:teuthology.orchestra.run.smithi018:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-10T08:13:25.333 DEBUG:teuthology.orchestra.run.smithi018:> stat /dev/vg_nvme/lv_2 2024-02-10T08:13:25.395 INFO:teuthology.orchestra.run.smithi018.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-10T08:13:25.395 INFO:teuthology.orchestra.run.smithi018.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-10T08:13:25.396 INFO:teuthology.orchestra.run.smithi018.stdout:Device: 6h/6d Inode: 166408 Links: 1 2024-02-10T08:13:25.396 INFO:teuthology.orchestra.run.smithi018.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-10T08:13:25.396 INFO:teuthology.orchestra.run.smithi018.stdout:Context: system_u:object_r:device_t:s0 2024-02-10T08:13:25.396 INFO:teuthology.orchestra.run.smithi018.stdout:Access: 2024-02-10 08:13:09.091460330 +0000 2024-02-10T08:13:25.396 INFO:teuthology.orchestra.run.smithi018.stdout:Modify: 2024-02-10 08:05:43.990990090 +0000 2024-02-10T08:13:25.396 INFO:teuthology.orchestra.run.smithi018.stdout:Change: 2024-02-10 08:05:43.990990090 +0000 2024-02-10T08:13:25.396 INFO:teuthology.orchestra.run.smithi018.stdout: Birth: - 2024-02-10T08:13:25.396 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-10T08:13:25.468 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records in 2024-02-10T08:13:25.468 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records out 2024-02-10T08:13:25.468 INFO:teuthology.orchestra.run.smithi018.stderr:512 bytes copied, 0.00011041 s, 4.6 MB/s 2024-02-10T08:13:25.469 DEBUG:teuthology.orchestra.run.smithi018:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-10T08:13:25.532 DEBUG:teuthology.orchestra.run.smithi018:> stat /dev/vg_nvme/lv_3 2024-02-10T08:13:25.594 INFO:teuthology.orchestra.run.smithi018.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-10T08:13:25.594 INFO:teuthology.orchestra.run.smithi018.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-10T08:13:25.594 INFO:teuthology.orchestra.run.smithi018.stdout:Device: 6h/6d Inode: 161791 Links: 1 2024-02-10T08:13:25.594 INFO:teuthology.orchestra.run.smithi018.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-10T08:13:25.594 INFO:teuthology.orchestra.run.smithi018.stdout:Context: system_u:object_r:device_t:s0 2024-02-10T08:13:25.594 INFO:teuthology.orchestra.run.smithi018.stdout:Access: 2024-02-10 08:13:09.091460330 +0000 2024-02-10T08:13:25.594 INFO:teuthology.orchestra.run.smithi018.stdout:Modify: 2024-02-10 08:05:44.336985996 +0000 2024-02-10T08:13:25.594 INFO:teuthology.orchestra.run.smithi018.stdout:Change: 2024-02-10 08:05:44.336985996 +0000 2024-02-10T08:13:25.594 INFO:teuthology.orchestra.run.smithi018.stdout: Birth: - 2024-02-10T08:13:25.595 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-10T08:13:25.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:24.467844+0000 mgr.y (mgr.14146) 60 : audit [DBG] from='client.24112 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi018=y;smithi071=x", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:13:25.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cephadm 2024-02-10T08:13:24.469237+0000 mgr.y (mgr.14146) 61 : cephadm [INF] Saving service mgr spec with placement smithi018=y;smithi071=x;count:2 2024-02-10T08:13:25.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:24.472675+0000 mon.a (mon.0) 189 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:13:25.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:24.487522+0000 mon.a (mon.0) 190 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:13:25.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:24.489228+0000 mon.a (mon.0) 191 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:13:25.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:24.490058+0000 mon.a (mon.0) 192 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:13:25.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:24.494470+0000 mon.a (mon.0) 193 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:13:25.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:24.495871+0000 mon.a (mon.0) 194 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-10T08:13:25.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:24.499895+0000 mon.a (mon.0) 195 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-02-10T08:13:25.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:24.500722+0000 mon.a (mon.0) 196 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-10T08:13:25.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:24.501601+0000 mon.a (mon.0) 197 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:13:25.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cephadm 2024-02-10T08:13:24.502284+0000 mgr.y (mgr.14146) 62 : cephadm [INF] Deploying daemon mgr.x on smithi071 2024-02-10T08:13:25.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:24.467844+0000 mgr.y (mgr.14146) 60 : audit [DBG] from='client.24112 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi018=y;smithi071=x", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:13:25.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cephadm 2024-02-10T08:13:24.469237+0000 mgr.y (mgr.14146) 61 : cephadm [INF] Saving service mgr spec with placement smithi018=y;smithi071=x;count:2 2024-02-10T08:13:25.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:24.472675+0000 mon.a (mon.0) 189 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:13:25.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:24.487522+0000 mon.a (mon.0) 190 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:13:25.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:24.489228+0000 mon.a (mon.0) 191 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:13:25.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:24.490058+0000 mon.a (mon.0) 192 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:13:25.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:24.494470+0000 mon.a (mon.0) 193 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:13:25.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:24.495871+0000 mon.a (mon.0) 194 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-10T08:13:25.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:24.499895+0000 mon.a (mon.0) 195 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-02-10T08:13:25.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:24.500722+0000 mon.a (mon.0) 196 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-10T08:13:25.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:24.501601+0000 mon.a (mon.0) 197 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:13:25.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cephadm 2024-02-10T08:13:24.502284+0000 mgr.y (mgr.14146) 62 : cephadm [INF] Deploying daemon mgr.x on smithi071 2024-02-10T08:13:25.664 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records in 2024-02-10T08:13:25.664 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records out 2024-02-10T08:13:25.664 INFO:teuthology.orchestra.run.smithi018.stderr:512 bytes copied, 9.3857e-05 s, 5.5 MB/s 2024-02-10T08:13:25.665 DEBUG:teuthology.orchestra.run.smithi018:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-10T08:13:25.729 DEBUG:teuthology.orchestra.run.smithi018:> stat /dev/vg_nvme/lv_4 2024-02-10T08:13:25.789 INFO:teuthology.orchestra.run.smithi018.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-10T08:13:25.789 INFO:teuthology.orchestra.run.smithi018.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-10T08:13:25.789 INFO:teuthology.orchestra.run.smithi018.stdout:Device: 6h/6d Inode: 168514 Links: 1 2024-02-10T08:13:25.789 INFO:teuthology.orchestra.run.smithi018.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-10T08:13:25.789 INFO:teuthology.orchestra.run.smithi018.stdout:Context: system_u:object_r:device_t:s0 2024-02-10T08:13:25.790 INFO:teuthology.orchestra.run.smithi018.stdout:Access: 2024-02-10 08:13:09.091460330 +0000 2024-02-10T08:13:25.790 INFO:teuthology.orchestra.run.smithi018.stdout:Modify: 2024-02-10 08:05:44.713981535 +0000 2024-02-10T08:13:25.790 INFO:teuthology.orchestra.run.smithi018.stdout:Change: 2024-02-10 08:05:44.713981535 +0000 2024-02-10T08:13:25.790 INFO:teuthology.orchestra.run.smithi018.stdout: Birth: - 2024-02-10T08:13:25.790 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-10T08:13:25.791 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:24.467844+0000 mgr.y (mgr.14146) 60 : audit [DBG] from='client.24112 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi018=y;smithi071=x", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:13:25.791 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cephadm 2024-02-10T08:13:24.469237+0000 mgr.y (mgr.14146) 61 : cephadm [INF] Saving service mgr spec with placement smithi018=y;smithi071=x;count:2 2024-02-10T08:13:25.791 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:24.472675+0000 mon.a (mon.0) 189 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:13:25.791 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:24.487522+0000 mon.a (mon.0) 190 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:13:25.791 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:24.489228+0000 mon.a (mon.0) 191 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:13:25.791 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:24.490058+0000 mon.a (mon.0) 192 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:13:25.791 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:24.494470+0000 mon.a (mon.0) 193 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:13:25.791 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:24.495871+0000 mon.a (mon.0) 194 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-10T08:13:25.791 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:24.499895+0000 mon.a (mon.0) 195 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-02-10T08:13:25.791 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:24.500722+0000 mon.a (mon.0) 196 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-10T08:13:25.791 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:24.501601+0000 mon.a (mon.0) 197 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:13:25.791 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cephadm 2024-02-10T08:13:24.502284+0000 mgr.y (mgr.14146) 62 : cephadm [INF] Deploying daemon mgr.x on smithi071 2024-02-10T08:13:25.858 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records in 2024-02-10T08:13:25.859 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records out 2024-02-10T08:13:25.859 INFO:teuthology.orchestra.run.smithi018.stderr:512 bytes copied, 0.00011071 s, 4.6 MB/s 2024-02-10T08:13:25.860 DEBUG:teuthology.orchestra.run.smithi018:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-10T08:13:25.920 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-02-10T08:13:25.921 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/scratch_devs of=/dev/stdout 2024-02-10T08:13:25.939 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-10T08:13:25.939 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_1 2024-02-10T08:13:25.996 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-10T08:13:25.997 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-10T08:13:25.997 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 6h/6d Inode: 170209 Links: 1 2024-02-10T08:13:25.997 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-10T08:13:25.997 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2024-02-10T08:13:25.997 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2024-02-10 08:12:58.375510226 +0000 2024-02-10T08:13:25.997 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2024-02-10 08:05:31.358945045 +0000 2024-02-10T08:13:25.997 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2024-02-10 08:05:31.358945045 +0000 2024-02-10T08:13:25.997 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: - 2024-02-10T08:13:25.997 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-10T08:13:26.063 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2024-02-10T08:13:26.064 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2024-02-10T08:13:26.064 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.000254976 s, 2.0 MB/s 2024-02-10T08:13:26.065 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-10T08:13:26.123 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_2 2024-02-10T08:13:26.181 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-10T08:13:26.181 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-10T08:13:26.182 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 6h/6d Inode: 170259 Links: 1 2024-02-10T08:13:26.182 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-10T08:13:26.182 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2024-02-10T08:13:26.182 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2024-02-10 08:12:58.375510226 +0000 2024-02-10T08:13:26.182 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2024-02-10 08:05:31.712938572 +0000 2024-02-10T08:13:26.182 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2024-02-10 08:05:31.712938572 +0000 2024-02-10T08:13:26.182 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: - 2024-02-10T08:13:26.182 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-10T08:13:26.247 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2024-02-10T08:13:26.247 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2024-02-10T08:13:26.247 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.0002142 s, 2.4 MB/s 2024-02-10T08:13:26.248 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-10T08:13:26.307 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_3 2024-02-10T08:13:26.374 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-10T08:13:26.375 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-10T08:13:26.375 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 6h/6d Inode: 167298 Links: 1 2024-02-10T08:13:26.375 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-10T08:13:26.375 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2024-02-10T08:13:26.375 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2024-02-10 08:12:58.375510226 +0000 2024-02-10T08:13:26.375 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2024-02-10 08:05:32.046932466 +0000 2024-02-10T08:13:26.375 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2024-02-10 08:05:32.046932466 +0000 2024-02-10T08:13:26.375 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: - 2024-02-10T08:13:26.375 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-10T08:13:26.444 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2024-02-10T08:13:26.444 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2024-02-10T08:13:26.444 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.000182857 s, 2.8 MB/s 2024-02-10T08:13:26.445 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-10T08:13:26.505 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_4 2024-02-10T08:13:26.563 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-10T08:13:26.563 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-10T08:13:26.564 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 6h/6d Inode: 169392 Links: 1 2024-02-10T08:13:26.564 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-10T08:13:26.564 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2024-02-10T08:13:26.564 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2024-02-10 08:13:26.512995887 +0000 2024-02-10T08:13:26.564 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2024-02-10 08:05:32.370926542 +0000 2024-02-10T08:13:26.564 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2024-02-10 08:05:32.370926542 +0000 2024-02-10T08:13:26.564 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: - 2024-02-10T08:13:26.564 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-10T08:13:26.631 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:13:25.123884+0000 mgr.y (mgr.14146) 63 : cluster [DBG] pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:13:26.631 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:13:26 smithi071 systemd[1]: Starting Ceph mgr.x for d46257c8-c7eb-11ee-95b8-87774f69a715... 2024-02-10T08:13:26.633 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2024-02-10T08:13:26.634 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2024-02-10T08:13:26.634 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.000238083 s, 2.2 MB/s 2024-02-10T08:13:26.635 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-10T08:13:26.695 INFO:tasks.cephadm:Deploying osd.0 on smithi018 with /dev/vg_nvme/lv_4... 2024-02-10T08:13:26.695 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-02-10T08:13:26.726 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:13:25.123884+0000 mgr.y (mgr.14146) 63 : cluster [DBG] pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:13:26.726 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:13:25.123884+0000 mgr.y (mgr.14146) 63 : cluster [DBG] pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:13:27.268 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:13:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: debug 2024-02-10T08:13:27.139+0000 7f067aacb700 1 -- 172.21.15.71:0/3063361134 <== mon.1 v2:172.21.15.71:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x558bb82a24e0 con 0x558bb8276c00 2024-02-10T08:13:27.268 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:13:27 smithi071 bash[42216]: e4517126b5945a685ff73ef63e0133acf126a4146246ec5bf74bd6afe5c9e64f 2024-02-10T08:13:27.268 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:13:27 smithi071 systemd[1]: Started Ceph mgr.x for d46257c8-c7eb-11ee-95b8-87774f69a715. 2024-02-10T08:13:27.268 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:13:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: debug 2024-02-10T08:13:27.266+0000 7f068b0c7680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-10T08:13:27.539 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:13:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: debug 2024-02-10T08:13:27.351+0000 7f068b0c7680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-10T08:13:28.039 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:13:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: debug 2024-02-10T08:13:27.752+0000 7f068b0c7680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-10T08:13:28.384 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:13:27.124166+0000 mgr.y (mgr.14146) 64 : cluster [DBG] pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:13:28.384 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:27.240400+0000 mon.a (mon.0) 198 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:13:28.384 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:27.242093+0000 mon.a (mon.0) 199 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:13:28.385 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:13:27.124166+0000 mgr.y (mgr.14146) 64 : cluster [DBG] pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:13:28.385 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:27.240400+0000 mon.a (mon.0) 198 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:13:28.385 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:27.242093+0000 mon.a (mon.0) 199 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:13:28.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:13:27.124166+0000 mgr.y (mgr.14146) 64 : cluster [DBG] pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:13:28.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:27.240400+0000 mon.a (mon.0) 198 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:13:28.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:27.242093+0000 mon.a (mon.0) 199 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:13:28.789 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:13:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: debug 2024-02-10T08:13:28.516+0000 7f068b0c7680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-10T08:13:28.789 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:13:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: debug 2024-02-10T08:13:28.599+0000 7f068b0c7680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-10T08:13:28.965 INFO:teuthology.orchestra.run.smithi018.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-02-10T08:13:28.965 INFO:teuthology.orchestra.run.smithi018.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-02-10T08:13:28.965 INFO:teuthology.orchestra.run.smithi018.stderr: stderr: 10+0 records in 2024-02-10T08:13:28.965 INFO:teuthology.orchestra.run.smithi018.stderr:10+0 records out 2024-02-10T08:13:28.965 INFO:teuthology.orchestra.run.smithi018.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00814352 s, 1.3 GB/s 2024-02-10T08:13:28.966 INFO:teuthology.orchestra.run.smithi018.stderr:--> Zapping successful for: 2024-02-10T08:13:29.278 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:13:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: debug 2024-02-10T08:13:28.805+0000 7f068b0c7680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-10T08:13:29.514 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:28.278730+0000 mon.a (mon.0) 200 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:13:29.514 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:28.279440+0000 mon.a (mon.0) 201 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:13:29.515 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:28.280191+0000 mon.a (mon.0) 202 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:13:29.515 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:28.284692+0000 mon.a (mon.0) 203 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:13:29.515 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cephadm 2024-02-10T08:13:28.286220+0000 mgr.y (mgr.14146) 65 : cephadm [INF] Reconfiguring mgr.y (unknown last config time)... 2024-02-10T08:13:29.515 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:28.286505+0000 mon.a (mon.0) 204 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-10T08:13:29.515 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:28.287280+0000 mon.a (mon.0) 205 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-10T08:13:29.515 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:28.287857+0000 mon.a (mon.0) 206 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:13:29.516 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cephadm 2024-02-10T08:13:28.288422+0000 mgr.y (mgr.14146) 66 : cephadm [INF] Reconfiguring daemon mgr.y on smithi018 2024-02-10T08:13:29.516 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:28.278730+0000 mon.a (mon.0) 200 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:13:29.516 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:28.279440+0000 mon.a (mon.0) 201 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:13:29.516 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:28.280191+0000 mon.a (mon.0) 202 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:13:29.517 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:28.284692+0000 mon.a (mon.0) 203 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:13:29.517 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cephadm 2024-02-10T08:13:28.286220+0000 mgr.y (mgr.14146) 65 : cephadm [INF] Reconfiguring mgr.y (unknown last config time)... 2024-02-10T08:13:29.517 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:28.286505+0000 mon.a (mon.0) 204 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-10T08:13:29.517 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:28.287280+0000 mon.a (mon.0) 205 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-10T08:13:29.517 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:28.287857+0000 mon.a (mon.0) 206 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:13:29.517 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cephadm 2024-02-10T08:13:28.288422+0000 mgr.y (mgr.14146) 66 : cephadm [INF] Reconfiguring daemon mgr.y on smithi018 2024-02-10T08:13:29.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:28.278730+0000 mon.a (mon.0) 200 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:13:29.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:28.279440+0000 mon.a (mon.0) 201 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:13:29.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:28.280191+0000 mon.a (mon.0) 202 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:13:29.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:28.284692+0000 mon.a (mon.0) 203 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:13:29.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cephadm 2024-02-10T08:13:28.286220+0000 mgr.y (mgr.14146) 65 : cephadm [INF] Reconfiguring mgr.y (unknown last config time)... 2024-02-10T08:13:29.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:28.286505+0000 mon.a (mon.0) 204 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-10T08:13:29.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:28.287280+0000 mon.a (mon.0) 205 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-10T08:13:29.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:28.287857+0000 mon.a (mon.0) 206 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:13:29.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cephadm 2024-02-10T08:13:28.288422+0000 mgr.y (mgr.14146) 66 : cephadm [INF] Reconfiguring daemon mgr.y on smithi018 2024-02-10T08:13:29.839 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph orch daemon add osd smithi018:vg_nvme/lv_4 2024-02-10T08:13:30.032 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:13:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: debug 2024-02-10T08:13:29.737+0000 7f068b0c7680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-10T08:13:30.033 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:13:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: debug 2024-02-10T08:13:29.864+0000 7f068b0c7680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-10T08:13:30.033 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:13:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: debug 2024-02-10T08:13:29.942+0000 7f068b0c7680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-10T08:13:30.033 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:13:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: debug 2024-02-10T08:13:30.031+0000 7f068b0c7680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-10T08:13:30.284 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:13:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: debug 2024-02-10T08:13:30.224+0000 7f068b0c7680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-10T08:13:30.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:13:29.124463+0000 mgr.y (mgr.14146) 67 : cluster [DBG] pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:13:30.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:30.260414+0000 mon.a (mon.0) 207 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:13:30.539 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:13:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: debug 2024-02-10T08:13:30.499+0000 7f068b0c7680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-10T08:13:30.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:13:29.124463+0000 mgr.y (mgr.14146) 67 : cluster [DBG] pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:13:30.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:30.260414+0000 mon.a (mon.0) 207 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:13:30.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:13:29.124463+0000 mgr.y (mgr.14146) 67 : cluster [DBG] pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:13:30.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:30.260414+0000 mon.a (mon.0) 207 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:13:31.039 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:13:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: debug 2024-02-10T08:13:30.598+0000 7f068b0c7680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-10T08:13:31.591 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:13:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: debug 2024-02-10T08:13:31.309+0000 7f068b0c7680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-10T08:13:31.591 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:13:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: debug 2024-02-10T08:13:31.389+0000 7f068b0c7680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-10T08:13:31.591 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:13:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: debug 2024-02-10T08:13:31.479+0000 7f068b0c7680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-10T08:13:31.723 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:30.591229+0000 mon.a (mon.0) 208 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:13:31.723 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:30.592102+0000 mon.a (mon.0) 209 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:13:31.723 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:30.593334+0000 mon.a (mon.0) 210 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:13:31.724 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:30.593900+0000 mon.a (mon.0) 211 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:13:31.724 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:30.596993+0000 mon.a (mon.0) 212 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:13:31.724 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:13:31.124805+0000 mgr.y (mgr.14146) 68 : cluster [DBG] pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:13:31.724 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:30.591229+0000 mon.a (mon.0) 208 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:13:31.724 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:30.592102+0000 mon.a (mon.0) 209 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:13:31.724 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:30.593334+0000 mon.a (mon.0) 210 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:13:31.724 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:30.593900+0000 mon.a (mon.0) 211 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:13:31.725 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:30.596993+0000 mon.a (mon.0) 212 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:13:31.725 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:13:31.124805+0000 mgr.y (mgr.14146) 68 : cluster [DBG] pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:13:31.906 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:13:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: debug 2024-02-10T08:13:31.651+0000 7f068b0c7680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-10T08:13:31.906 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:30.591229+0000 mon.a (mon.0) 208 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:13:31.906 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:30.592102+0000 mon.a (mon.0) 209 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:13:31.906 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:30.593334+0000 mon.a (mon.0) 210 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:13:31.906 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:30.593900+0000 mon.a (mon.0) 211 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:13:31.906 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:30.596993+0000 mon.a (mon.0) 212 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:13:31.906 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:13:31.124805+0000 mgr.y (mgr.14146) 68 : cluster [DBG] pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:13:32.165 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:13:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: debug 2024-02-10T08:13:31.904+0000 7f068b0c7680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-10T08:13:32.165 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:13:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: debug 2024-02-10T08:13:32.033+0000 7f068b0c7680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-10T08:13:32.165 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:13:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: debug 2024-02-10T08:13:32.164+0000 7f068b0c7680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-10T08:13:32.417 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:13:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: debug 2024-02-10T08:13:32.332+0000 7f068b0c7680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-10T08:13:32.789 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:13:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: debug 2024-02-10T08:13:32.415+0000 7f068b0c7680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-10T08:13:32.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:32.417178+0000 mgr.y (mgr.14146) 69 : audit [DBG] from='client.14211 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:13:32.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:32.419335+0000 mon.a (mon.0) 213 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-10T08:13:32.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:32.421101+0000 mon.a (mon.0) 214 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-10T08:13:32.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:32.421607+0000 mon.a (mon.0) 215 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:13:32.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:13:32.430569+0000 mon.a (mon.0) 216 : cluster [DBG] Standby manager daemon x started 2024-02-10T08:13:32.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:32.431666+0000 mon.b (mon.1) 4 : audit [DBG] from='mgr.? 172.21.15.71:0/2409864117' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-02-10T08:13:32.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:32.431942+0000 mon.b (mon.1) 5 : audit [DBG] from='mgr.? 172.21.15.71:0/2409864117' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-10T08:13:32.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:32.432847+0000 mon.b (mon.1) 6 : audit [DBG] from='mgr.? 172.21.15.71:0/2409864117' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-02-10T08:13:32.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:32.433057+0000 mon.b (mon.1) 7 : audit [DBG] from='mgr.? 172.21.15.71:0/2409864117' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-10T08:13:32.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:32.417178+0000 mgr.y (mgr.14146) 69 : audit [DBG] from='client.14211 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:13:32.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:32.419335+0000 mon.a (mon.0) 213 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-10T08:13:32.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:32.421101+0000 mon.a (mon.0) 214 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-10T08:13:32.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:32.421607+0000 mon.a (mon.0) 215 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:13:32.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:13:32.430569+0000 mon.a (mon.0) 216 : cluster [DBG] Standby manager daemon x started 2024-02-10T08:13:32.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:32.431666+0000 mon.b (mon.1) 4 : audit [DBG] from='mgr.? 172.21.15.71:0/2409864117' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-02-10T08:13:32.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:32.431942+0000 mon.b (mon.1) 5 : audit [DBG] from='mgr.? 172.21.15.71:0/2409864117' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-10T08:13:32.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:32.432847+0000 mon.b (mon.1) 6 : audit [DBG] from='mgr.? 172.21.15.71:0/2409864117' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-02-10T08:13:32.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:32.433057+0000 mon.b (mon.1) 7 : audit [DBG] from='mgr.? 172.21.15.71:0/2409864117' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-10T08:13:32.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:32.417178+0000 mgr.y (mgr.14146) 69 : audit [DBG] from='client.14211 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:13:32.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:32.419335+0000 mon.a (mon.0) 213 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-10T08:13:32.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:32.421101+0000 mon.a (mon.0) 214 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-10T08:13:32.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:32.421607+0000 mon.a (mon.0) 215 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:13:32.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:13:32.430569+0000 mon.a (mon.0) 216 : cluster [DBG] Standby manager daemon x started 2024-02-10T08:13:32.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:32.431666+0000 mon.b (mon.1) 4 : audit [DBG] from='mgr.? 172.21.15.71:0/2409864117' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-02-10T08:13:32.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:32.431942+0000 mon.b (mon.1) 5 : audit [DBG] from='mgr.? 172.21.15.71:0/2409864117' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-10T08:13:32.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:32.432847+0000 mon.b (mon.1) 6 : audit [DBG] from='mgr.? 172.21.15.71:0/2409864117' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-02-10T08:13:32.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:32.433057+0000 mon.b (mon.1) 7 : audit [DBG] from='mgr.? 172.21.15.71:0/2409864117' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-10T08:13:33.824 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:13:32.603088+0000 mon.a (mon.0) 217 : cluster [DBG] mgrmap e14: y(active, since 97s), standbys: x 2024-02-10T08:13:33.824 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:32.603421+0000 mon.a (mon.0) 218 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-10T08:13:33.824 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:13:33.125190+0000 mgr.y (mgr.14146) 70 : cluster [DBG] pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:13:33.824 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:13:32.603088+0000 mon.a (mon.0) 217 : cluster [DBG] mgrmap e14: y(active, since 97s), standbys: x 2024-02-10T08:13:33.825 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:32.603421+0000 mon.a (mon.0) 218 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-10T08:13:33.825 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:13:33.125190+0000 mgr.y (mgr.14146) 70 : cluster [DBG] pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:13:34.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:13:32.603088+0000 mon.a (mon.0) 217 : cluster [DBG] mgrmap e14: y(active, since 97s), standbys: x 2024-02-10T08:13:34.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:32.603421+0000 mon.a (mon.0) 218 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-10T08:13:34.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:13:33.125190+0000 mgr.y (mgr.14146) 70 : cluster [DBG] pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:13:35.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:34.874708+0000 mon.a (mon.0) 219 : audit [INF] from='client.? 172.21.15.18:0/4018999276' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f9043fee-a3ed-4e16-921d-bb86756d0c48"}]: dispatch 2024-02-10T08:13:35.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:34.878166+0000 mon.a (mon.0) 220 : audit [INF] from='client.? 172.21.15.18:0/4018999276' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f9043fee-a3ed-4e16-921d-bb86756d0c48"}]': finished 2024-02-10T08:13:35.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:13:34.878232+0000 mon.a (mon.0) 221 : cluster [DBG] osdmap e5: 1 total, 0 up, 1 in 2024-02-10T08:13:35.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:34.878353+0000 mon.a (mon.0) 222 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-10T08:13:35.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:34.874708+0000 mon.a (mon.0) 219 : audit [INF] from='client.? 172.21.15.18:0/4018999276' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f9043fee-a3ed-4e16-921d-bb86756d0c48"}]: dispatch 2024-02-10T08:13:35.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:34.878166+0000 mon.a (mon.0) 220 : audit [INF] from='client.? 172.21.15.18:0/4018999276' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f9043fee-a3ed-4e16-921d-bb86756d0c48"}]': finished 2024-02-10T08:13:35.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:13:34.878232+0000 mon.a (mon.0) 221 : cluster [DBG] osdmap e5: 1 total, 0 up, 1 in 2024-02-10T08:13:35.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:34.878353+0000 mon.a (mon.0) 222 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-10T08:13:35.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:34.874708+0000 mon.a (mon.0) 219 : audit [INF] from='client.? 172.21.15.18:0/4018999276' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f9043fee-a3ed-4e16-921d-bb86756d0c48"}]: dispatch 2024-02-10T08:13:35.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:34.878166+0000 mon.a (mon.0) 220 : audit [INF] from='client.? 172.21.15.18:0/4018999276' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f9043fee-a3ed-4e16-921d-bb86756d0c48"}]': finished 2024-02-10T08:13:35.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:13:34.878232+0000 mon.a (mon.0) 221 : cluster [DBG] osdmap e5: 1 total, 0 up, 1 in 2024-02-10T08:13:35.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:34.878353+0000 mon.a (mon.0) 222 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-10T08:13:36.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:13:35.125401+0000 mgr.y (mgr.14146) 71 : cluster [DBG] pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:13:36.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:35.489461+0000 mon.c (mon.2) 2 : audit [DBG] from='client.? 172.21.15.18:0/1169751759' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-10T08:13:36.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:13:35.125401+0000 mgr.y (mgr.14146) 71 : cluster [DBG] pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:13:36.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:35.489461+0000 mon.c (mon.2) 2 : audit [DBG] from='client.? 172.21.15.18:0/1169751759' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-10T08:13:36.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:13:35.125401+0000 mgr.y (mgr.14146) 71 : cluster [DBG] pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:13:36.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:35.489461+0000 mon.c (mon.2) 2 : audit [DBG] from='client.? 172.21.15.18:0/1169751759' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-10T08:13:38.316 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:13:37.125653+0000 mgr.y (mgr.14146) 72 : cluster [DBG] pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:13:38.316 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:13:37.125653+0000 mgr.y (mgr.14146) 72 : cluster [DBG] pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:13:38.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:13:37.125653+0000 mgr.y (mgr.14146) 72 : cluster [DBG] pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:13:40.306 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:13:39.126015+0000 mgr.y (mgr.14146) 73 : cluster [DBG] pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:13:40.306 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:13:39.126015+0000 mgr.y (mgr.14146) 73 : cluster [DBG] pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:13:40.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:13:39.126015+0000 mgr.y (mgr.14146) 73 : cluster [DBG] pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:13:42.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:13:41.126353+0000 mgr.y (mgr.14146) 74 : cluster [DBG] pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:13:42.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:41.441458+0000 mon.a (mon.0) 223 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-10T08:13:42.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:41.442095+0000 mon.a (mon.0) 224 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:13:42.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cephadm 2024-02-10T08:13:41.442648+0000 mgr.y (mgr.14146) 75 : cephadm [INF] Deploying daemon osd.0 on smithi018 2024-02-10T08:13:42.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:13:41.126353+0000 mgr.y (mgr.14146) 74 : cluster [DBG] pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:13:42.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:41.441458+0000 mon.a (mon.0) 223 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-10T08:13:42.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:41.442095+0000 mon.a (mon.0) 224 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:13:42.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cephadm 2024-02-10T08:13:41.442648+0000 mgr.y (mgr.14146) 75 : cephadm [INF] Deploying daemon osd.0 on smithi018 2024-02-10T08:13:42.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:13:41.126353+0000 mgr.y (mgr.14146) 74 : cluster [DBG] pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:13:42.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:41.441458+0000 mon.a (mon.0) 223 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-10T08:13:42.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:41.442095+0000 mon.a (mon.0) 224 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:13:42.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cephadm 2024-02-10T08:13:41.442648+0000 mgr.y (mgr.14146) 75 : cephadm [INF] Deploying daemon osd.0 on smithi018 2024-02-10T08:13:44.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:13:43.126713+0000 mgr.y (mgr.14146) 76 : cluster [DBG] pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:13:44.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:13:43.126713+0000 mgr.y (mgr.14146) 76 : cluster [DBG] pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:13:44.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:44 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:13:43.126713+0000 mgr.y (mgr.14146) 76 : cluster [DBG] pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:13:46.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:13:45.126943+0000 mgr.y (mgr.14146) 77 : cluster [DBG] pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:13:46.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:13:45.126943+0000 mgr.y (mgr.14146) 77 : cluster [DBG] pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:13:46.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:13:45.126943+0000 mgr.y (mgr.14146) 77 : cluster [DBG] pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:13:47.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:46.586742+0000 mon.a (mon.0) 225 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:13:47.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:46.593804+0000 mon.a (mon.0) 226 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:13:47.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:13:47.127181+0000 mgr.y (mgr.14146) 78 : cluster [DBG] pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:13:47.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:46.586742+0000 mon.a (mon.0) 225 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:13:47.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:46.593804+0000 mon.a (mon.0) 226 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:13:47.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:13:47.127181+0000 mgr.y (mgr.14146) 78 : cluster [DBG] pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:13:48.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:46.586742+0000 mon.a (mon.0) 225 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:13:48.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:46.593804+0000 mon.a (mon.0) 226 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:13:48.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:13:47.127181+0000 mgr.y (mgr.14146) 78 : cluster [DBG] pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:13:50.028 INFO:teuthology.orchestra.run.smithi018.stdout:Created osd(s) 0 on host 'smithi018' 2024-02-10T08:13:50.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:13:49.127403+0000 mgr.y (mgr.14146) 79 : cluster [DBG] pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:13:50.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:49.256922+0000 mon.a (mon.0) 227 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:13:50.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:49.257584+0000 mon.a (mon.0) 228 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:13:50.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:49.258237+0000 mon.a (mon.0) 229 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:13:50.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:49.261966+0000 mon.a (mon.0) 230 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:13:50.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:49.667060+0000 mon.c (mon.2) 3 : audit [INF] from='osd.0 v2:172.21.15.18:6801/276034406' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-10T08:13:50.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:49.667438+0000 mon.a (mon.0) 231 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-10T08:13:50.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:50.027620+0000 mon.a (mon.0) 232 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:13:50.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:50.028727+0000 mon.a (mon.0) 233 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:13:50.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:13:49.127403+0000 mgr.y (mgr.14146) 79 : cluster [DBG] pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:13:50.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:49.256922+0000 mon.a (mon.0) 227 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:13:50.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:49.257584+0000 mon.a (mon.0) 228 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:13:50.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:49.258237+0000 mon.a (mon.0) 229 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:13:50.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:49.261966+0000 mon.a (mon.0) 230 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:13:50.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:49.667060+0000 mon.c (mon.2) 3 : audit [INF] from='osd.0 v2:172.21.15.18:6801/276034406' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-10T08:13:50.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:49.667438+0000 mon.a (mon.0) 231 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-10T08:13:50.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:50.027620+0000 mon.a (mon.0) 232 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:13:50.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:50.028727+0000 mon.a (mon.0) 233 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:13:50.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:13:49.127403+0000 mgr.y (mgr.14146) 79 : cluster [DBG] pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:13:50.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:49.256922+0000 mon.a (mon.0) 227 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:13:50.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:49.257584+0000 mon.a (mon.0) 228 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:13:50.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:49.258237+0000 mon.a (mon.0) 229 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:13:50.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:49.261966+0000 mon.a (mon.0) 230 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:13:50.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:49.667060+0000 mon.c (mon.2) 3 : audit [INF] from='osd.0 v2:172.21.15.18:6801/276034406' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-10T08:13:50.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:49.667438+0000 mon.a (mon.0) 231 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-10T08:13:50.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:50.027620+0000 mon.a (mon.0) 232 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:13:50.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:50.028727+0000 mon.a (mon.0) 233 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:13:50.785 DEBUG:teuthology.orchestra.run.smithi018:osd.0> sudo journalctl -f -n 0 -u ceph-d46257c8-c7eb-11ee-95b8-87774f69a715@osd.0.service 2024-02-10T08:13:50.788 INFO:tasks.cephadm:Deploying osd.1 on smithi018 with /dev/vg_nvme/lv_3... 2024-02-10T08:13:50.788 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-02-10T08:13:50.820 INFO:journalctl@ceph.osd.0.smithi018.stdout:-- Logs begin at Sat 2024-02-10 07:59:20 UTC. -- 2024-02-10T08:13:51.281 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:50.263353+0000 mon.a (mon.0) 234 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-10T08:13:51.281 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:13:50.263459+0000 mon.a (mon.0) 235 : cluster [DBG] osdmap e6: 1 total, 0 up, 1 in 2024-02-10T08:13:51.281 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:50.263578+0000 mon.a (mon.0) 236 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-10T08:13:51.281 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:50.264457+0000 mon.c (mon.2) 4 : audit [INF] from='osd.0 v2:172.21.15.18:6801/276034406' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-02-10T08:13:51.281 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:50.264795+0000 mon.a (mon.0) 237 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-02-10T08:13:51.282 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:50.263353+0000 mon.a (mon.0) 234 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-10T08:13:51.282 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:13:50.263459+0000 mon.a (mon.0) 235 : cluster [DBG] osdmap e6: 1 total, 0 up, 1 in 2024-02-10T08:13:51.282 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:50.263578+0000 mon.a (mon.0) 236 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-10T08:13:51.282 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:50.264457+0000 mon.c (mon.2) 4 : audit [INF] from='osd.0 v2:172.21.15.18:6801/276034406' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-02-10T08:13:51.282 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:50.264795+0000 mon.a (mon.0) 237 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-02-10T08:13:51.282 INFO:journalctl@ceph.osd.0.smithi018.stdout:Feb 10 08:13:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-0[49689]: debug 2024-02-10T08:13:51.269+0000 7fb842b2a700 -1 osd.0 0 waiting for initial osdmap 2024-02-10T08:13:51.282 INFO:journalctl@ceph.osd.0.smithi018.stdout:Feb 10 08:13:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-0[49689]: debug 2024-02-10T08:13:51.271+0000 7fb83d2a2700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-10T08:13:51.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:51 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:50.263353+0000 mon.a (mon.0) 234 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-10T08:13:51.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:51 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:13:50.263459+0000 mon.a (mon.0) 235 : cluster [DBG] osdmap e6: 1 total, 0 up, 1 in 2024-02-10T08:13:51.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:51 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:50.263578+0000 mon.a (mon.0) 236 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-10T08:13:51.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:51 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:50.264457+0000 mon.c (mon.2) 4 : audit [INF] from='osd.0 v2:172.21.15.18:6801/276034406' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-02-10T08:13:51.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:51 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:50.264795+0000 mon.a (mon.0) 237 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-02-10T08:13:52.273 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:13:51.127599+0000 mgr.y (mgr.14146) 80 : cluster [DBG] pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:13:52.273 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:51.264448+0000 mon.a (mon.0) 238 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-02-10T08:13:52.273 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:13:51.264527+0000 mon.a (mon.0) 239 : cluster [DBG] osdmap e7: 1 total, 0 up, 1 in 2024-02-10T08:13:52.273 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:51.264906+0000 mon.a (mon.0) 240 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-10T08:13:52.273 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:51.270692+0000 mon.a (mon.0) 241 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-10T08:13:52.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:52 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:13:51.127599+0000 mgr.y (mgr.14146) 80 : cluster [DBG] pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:13:52.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:52 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:51.264448+0000 mon.a (mon.0) 238 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-02-10T08:13:52.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:52 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:13:51.264527+0000 mon.a (mon.0) 239 : cluster [DBG] osdmap e7: 1 total, 0 up, 1 in 2024-02-10T08:13:52.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:52 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:51.264906+0000 mon.a (mon.0) 240 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-10T08:13:52.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:52 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:51.270692+0000 mon.a (mon.0) 241 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-10T08:13:52.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:13:51.127599+0000 mgr.y (mgr.14146) 80 : cluster [DBG] pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:13:52.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:51.264448+0000 mon.a (mon.0) 238 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-02-10T08:13:52.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:13:51.264527+0000 mon.a (mon.0) 239 : cluster [DBG] osdmap e7: 1 total, 0 up, 1 in 2024-02-10T08:13:52.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:51.264906+0000 mon.a (mon.0) 240 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-10T08:13:52.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:51.270692+0000 mon.a (mon.0) 241 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-10T08:13:53.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:13:50.645244+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:13:53.387 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:13:50.645308+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:13:53.387 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:13:52.269461+0000 mon.a (mon.0) 242 : cluster [INF] osd.0 v2:172.21.15.18:6801/276034406 boot 2024-02-10T08:13:53.387 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:13:52.269510+0000 mon.a (mon.0) 243 : cluster [DBG] osdmap e8: 1 total, 1 up, 1 in 2024-02-10T08:13:53.387 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:52.269927+0000 mon.a (mon.0) 244 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-10T08:13:53.387 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:13:50.645244+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:13:53.387 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:13:50.645308+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:13:53.387 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:13:52.269461+0000 mon.a (mon.0) 242 : cluster [INF] osd.0 v2:172.21.15.18:6801/276034406 boot 2024-02-10T08:13:53.387 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:13:52.269510+0000 mon.a (mon.0) 243 : cluster [DBG] osdmap e8: 1 total, 1 up, 1 in 2024-02-10T08:13:53.387 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:52.269927+0000 mon.a (mon.0) 244 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-10T08:13:53.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:53 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:13:50.645244+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:13:53.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:53 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:13:50.645308+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:13:53.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:53 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:13:52.269461+0000 mon.a (mon.0) 242 : cluster [INF] osd.0 v2:172.21.15.18:6801/276034406 boot 2024-02-10T08:13:53.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:53 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:13:52.269510+0000 mon.a (mon.0) 243 : cluster [DBG] osdmap e8: 1 total, 1 up, 1 in 2024-02-10T08:13:53.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:53 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:52.269927+0000 mon.a (mon.0) 244 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-10T08:13:54.377 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:13:53.127962+0000 mgr.y (mgr.14146) 81 : cluster [DBG] pgmap v57: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-10T08:13:54.377 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:13:53.278613+0000 mon.a (mon.0) 245 : cluster [DBG] osdmap e9: 1 total, 1 up, 1 in 2024-02-10T08:13:54.377 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:13:53.127962+0000 mgr.y (mgr.14146) 81 : cluster [DBG] pgmap v57: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-10T08:13:54.378 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:13:53.278613+0000 mon.a (mon.0) 245 : cluster [DBG] osdmap e9: 1 total, 1 up, 1 in 2024-02-10T08:13:54.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:54 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:13:53.127962+0000 mgr.y (mgr.14146) 81 : cluster [DBG] pgmap v57: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-10T08:13:54.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:54 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:13:53.278613+0000 mon.a (mon.0) 245 : cluster [DBG] osdmap e9: 1 total, 1 up, 1 in 2024-02-10T08:13:54.969 INFO:teuthology.orchestra.run.smithi018.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-02-10T08:13:54.969 INFO:teuthology.orchestra.run.smithi018.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-02-10T08:13:54.969 INFO:teuthology.orchestra.run.smithi018.stderr: stderr: 10+0 records in 2024-02-10T08:13:54.969 INFO:teuthology.orchestra.run.smithi018.stderr:10+0 records out 2024-02-10T08:13:54.969 INFO:teuthology.orchestra.run.smithi018.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00823046 s, 1.3 GB/s 2024-02-10T08:13:54.969 INFO:teuthology.orchestra.run.smithi018.stderr:--> Zapping successful for: 2024-02-10T08:13:55.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cephadm 2024-02-10T08:13:54.422500+0000 mgr.y (mgr.14146) 82 : cephadm [INF] Detected new or changed devices on smithi018 2024-02-10T08:13:55.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:54.427382+0000 mon.a (mon.0) 246 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:13:55.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:54.428197+0000 mon.a (mon.0) 247 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:13:55.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cephadm 2024-02-10T08:13:54.428670+0000 mgr.y (mgr.14146) 83 : cephadm [INF] Adjusting osd_memory_target on smithi018 to 16102M 2024-02-10T08:13:55.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:54.433048+0000 mon.a (mon.0) 248 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:13:55.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:54.433822+0000 mon.a (mon.0) 249 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:13:55.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:54.434422+0000 mon.a (mon.0) 250 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:13:55.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:54.438160+0000 mon.a (mon.0) 251 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:13:55.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cephadm 2024-02-10T08:13:54.422500+0000 mgr.y (mgr.14146) 82 : cephadm [INF] Detected new or changed devices on smithi018 2024-02-10T08:13:55.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:54.427382+0000 mon.a (mon.0) 246 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:13:55.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:54.428197+0000 mon.a (mon.0) 247 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:13:55.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cephadm 2024-02-10T08:13:54.428670+0000 mgr.y (mgr.14146) 83 : cephadm [INF] Adjusting osd_memory_target on smithi018 to 16102M 2024-02-10T08:13:55.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:54.433048+0000 mon.a (mon.0) 248 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:13:55.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:54.433822+0000 mon.a (mon.0) 249 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:13:55.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:54.434422+0000 mon.a (mon.0) 250 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:13:55.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:54.438160+0000 mon.a (mon.0) 251 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:13:55.726 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph orch daemon add osd smithi018:vg_nvme/lv_3 2024-02-10T08:13:55.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cephadm 2024-02-10T08:13:54.422500+0000 mgr.y (mgr.14146) 82 : cephadm [INF] Detected new or changed devices on smithi018 2024-02-10T08:13:55.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:54.427382+0000 mon.a (mon.0) 246 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:13:55.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:54.428197+0000 mon.a (mon.0) 247 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:13:55.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cephadm 2024-02-10T08:13:54.428670+0000 mgr.y (mgr.14146) 83 : cephadm [INF] Adjusting osd_memory_target on smithi018 to 16102M 2024-02-10T08:13:55.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:54.433048+0000 mon.a (mon.0) 248 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:13:55.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:54.433822+0000 mon.a (mon.0) 249 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:13:55.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:54.434422+0000 mon.a (mon.0) 250 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:13:55.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:54.438160+0000 mon.a (mon.0) 251 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:13:56.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:13:55.128145+0000 mgr.y (mgr.14146) 84 : cluster [DBG] pgmap v59: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-10T08:13:56.811 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:13:55.128145+0000 mgr.y (mgr.14146) 84 : cluster [DBG] pgmap v59: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-10T08:13:56.812 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:13:55.128145+0000 mgr.y (mgr.14146) 84 : cluster [DBG] pgmap v59: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-10T08:13:58.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:13:57.128527+0000 mgr.y (mgr.14146) 85 : cluster [DBG] pgmap v60: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-10T08:13:58.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:57.782340+0000 mon.a (mon.0) 252 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-10T08:13:58.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:57.784203+0000 mon.a (mon.0) 253 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-10T08:13:58.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:57.784833+0000 mon.a (mon.0) 254 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:13:58.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:13:57.128527+0000 mgr.y (mgr.14146) 85 : cluster [DBG] pgmap v60: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-10T08:13:58.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:57.782340+0000 mon.a (mon.0) 252 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-10T08:13:58.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:57.784203+0000 mon.a (mon.0) 253 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-10T08:13:58.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:57.784833+0000 mon.a (mon.0) 254 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:13:58.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:13:57.128527+0000 mgr.y (mgr.14146) 85 : cluster [DBG] pgmap v60: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-10T08:13:58.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:57.782340+0000 mon.a (mon.0) 252 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-10T08:13:58.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:57.784203+0000 mon.a (mon.0) 253 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-10T08:13:58.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:57.784833+0000 mon.a (mon.0) 254 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:13:59.527 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:13:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:13:57.780414+0000 mgr.y (mgr.14146) 86 : audit [DBG] from='client.24152 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:13:59.528 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:13:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:13:57.780414+0000 mgr.y (mgr.14146) 86 : audit [DBG] from='client.24152 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:13:59.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:13:59 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:13:57.780414+0000 mgr.y (mgr.14146) 86 : audit [DBG] from='client.24152 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:14:00.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:13:59.128955+0000 mgr.y (mgr.14146) 87 : cluster [DBG] pgmap v61: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-10T08:14:00.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:00.330788+0000 mon.c (mon.2) 5 : audit [INF] from='client.? 172.21.15.18:0/3252694685' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ff958272-ce6b-4162-959a-6da9729e537b"}]: dispatch 2024-02-10T08:14:00.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:00.331147+0000 mon.a (mon.0) 255 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ff958272-ce6b-4162-959a-6da9729e537b"}]: dispatch 2024-02-10T08:14:00.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:00.334841+0000 mon.a (mon.0) 256 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ff958272-ce6b-4162-959a-6da9729e537b"}]': finished 2024-02-10T08:14:00.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:14:00.334912+0000 mon.a (mon.0) 257 : cluster [DBG] osdmap e10: 2 total, 1 up, 2 in 2024-02-10T08:14:00.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:00.335018+0000 mon.a (mon.0) 258 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-10T08:14:00.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:13:59.128955+0000 mgr.y (mgr.14146) 87 : cluster [DBG] pgmap v61: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-10T08:14:00.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:00.330788+0000 mon.c (mon.2) 5 : audit [INF] from='client.? 172.21.15.18:0/3252694685' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ff958272-ce6b-4162-959a-6da9729e537b"}]: dispatch 2024-02-10T08:14:00.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:00.331147+0000 mon.a (mon.0) 255 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ff958272-ce6b-4162-959a-6da9729e537b"}]: dispatch 2024-02-10T08:14:00.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:00.334841+0000 mon.a (mon.0) 256 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ff958272-ce6b-4162-959a-6da9729e537b"}]': finished 2024-02-10T08:14:00.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:14:00.334912+0000 mon.a (mon.0) 257 : cluster [DBG] osdmap e10: 2 total, 1 up, 2 in 2024-02-10T08:14:00.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:00.335018+0000 mon.a (mon.0) 258 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-10T08:14:00.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:13:59.128955+0000 mgr.y (mgr.14146) 87 : cluster [DBG] pgmap v61: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-10T08:14:00.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:00.330788+0000 mon.c (mon.2) 5 : audit [INF] from='client.? 172.21.15.18:0/3252694685' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ff958272-ce6b-4162-959a-6da9729e537b"}]: dispatch 2024-02-10T08:14:00.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:00.331147+0000 mon.a (mon.0) 255 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ff958272-ce6b-4162-959a-6da9729e537b"}]: dispatch 2024-02-10T08:14:00.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:00.334841+0000 mon.a (mon.0) 256 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ff958272-ce6b-4162-959a-6da9729e537b"}]': finished 2024-02-10T08:14:00.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:14:00.334912+0000 mon.a (mon.0) 257 : cluster [DBG] osdmap e10: 2 total, 1 up, 2 in 2024-02-10T08:14:00.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:00.335018+0000 mon.a (mon.0) 258 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-10T08:14:01.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:00.955322+0000 mon.c (mon.2) 6 : audit [DBG] from='client.? 172.21.15.18:0/1843888680' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-10T08:14:01.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:00.955322+0000 mon.c (mon.2) 6 : audit [DBG] from='client.? 172.21.15.18:0/1843888680' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-10T08:14:01.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:00.955322+0000 mon.c (mon.2) 6 : audit [DBG] from='client.? 172.21.15.18:0/1843888680' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-10T08:14:02.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:14:01.129243+0000 mgr.y (mgr.14146) 88 : cluster [DBG] pgmap v63: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-10T08:14:02.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:14:01.129243+0000 mgr.y (mgr.14146) 88 : cluster [DBG] pgmap v63: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-10T08:14:02.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:14:01.129243+0000 mgr.y (mgr.14146) 88 : cluster [DBG] pgmap v63: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-10T08:14:04.751 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:14:03.129529+0000 mgr.y (mgr.14146) 89 : cluster [DBG] pgmap v64: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-10T08:14:04.751 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:14:03.129529+0000 mgr.y (mgr.14146) 89 : cluster [DBG] pgmap v64: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-10T08:14:04.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:14:03.129529+0000 mgr.y (mgr.14146) 89 : cluster [DBG] pgmap v64: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-10T08:14:06.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:14:05.130006+0000 mgr.y (mgr.14146) 90 : cluster [DBG] pgmap v65: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-10T08:14:06.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:14:05.130006+0000 mgr.y (mgr.14146) 90 : cluster [DBG] pgmap v65: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-10T08:14:06.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:14:05.130006+0000 mgr.y (mgr.14146) 90 : cluster [DBG] pgmap v65: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-10T08:14:07.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:06.748643+0000 mon.a (mon.0) 259 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-10T08:14:07.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:06.749393+0000 mon.a (mon.0) 260 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:14:07.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:06.748643+0000 mon.a (mon.0) 259 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-10T08:14:07.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:06.749393+0000 mon.a (mon.0) 260 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:14:07.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:06.748643+0000 mon.a (mon.0) 259 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-10T08:14:07.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:06.749393+0000 mon.a (mon.0) 260 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:14:08.250 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cephadm 2024-02-10T08:14:06.749985+0000 mgr.y (mgr.14146) 91 : cephadm [INF] Deploying daemon osd.1 on smithi018 2024-02-10T08:14:08.250 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:14:07.130326+0000 mgr.y (mgr.14146) 92 : cluster [DBG] pgmap v66: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-10T08:14:08.251 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cephadm 2024-02-10T08:14:06.749985+0000 mgr.y (mgr.14146) 91 : cephadm [INF] Deploying daemon osd.1 on smithi018 2024-02-10T08:14:08.251 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:14:07.130326+0000 mgr.y (mgr.14146) 92 : cluster [DBG] pgmap v66: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-10T08:14:08.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cephadm 2024-02-10T08:14:06.749985+0000 mgr.y (mgr.14146) 91 : cephadm [INF] Deploying daemon osd.1 on smithi018 2024-02-10T08:14:08.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:14:07.130326+0000 mgr.y (mgr.14146) 92 : cluster [DBG] pgmap v66: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-10T08:14:10.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:14:09.130600+0000 mgr.y (mgr.14146) 93 : cluster [DBG] pgmap v67: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-10T08:14:10.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:14:09.130600+0000 mgr.y (mgr.14146) 93 : cluster [DBG] pgmap v67: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-10T08:14:10.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:14:09.130600+0000 mgr.y (mgr.14146) 93 : cluster [DBG] pgmap v67: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-10T08:14:12.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:14:11.130919+0000 mgr.y (mgr.14146) 94 : cluster [DBG] pgmap v68: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-10T08:14:12.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:12.146999+0000 mon.a (mon.0) 261 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:14:12.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:14:11.130919+0000 mgr.y (mgr.14146) 94 : cluster [DBG] pgmap v68: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-10T08:14:12.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:12.146999+0000 mon.a (mon.0) 261 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:14:12.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:14:11.130919+0000 mgr.y (mgr.14146) 94 : cluster [DBG] pgmap v68: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-10T08:14:12.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:12.146999+0000 mon.a (mon.0) 261 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:14:13.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:12.190692+0000 mon.a (mon.0) 262 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:14:13.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:12.190692+0000 mon.a (mon.0) 262 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:14:13.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:12.190692+0000 mon.a (mon.0) 262 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:14:14.393 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:14:13.131186+0000 mgr.y (mgr.14146) 95 : cluster [DBG] pgmap v69: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-10T08:14:14.393 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:14:13.131186+0000 mgr.y (mgr.14146) 95 : cluster [DBG] pgmap v69: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-10T08:14:14.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:14:13.131186+0000 mgr.y (mgr.14146) 95 : cluster [DBG] pgmap v69: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-10T08:14:15.633 INFO:teuthology.orchestra.run.smithi018.stdout:Created osd(s) 1 on host 'smithi018' 2024-02-10T08:14:15.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:14.784936+0000 mon.a (mon.0) 263 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:14:15.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:14.785759+0000 mon.a (mon.0) 264 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:14:15.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:14.786527+0000 mon.a (mon.0) 265 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:14:15.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:14.790775+0000 mon.a (mon.0) 266 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:14:15.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:14:15.131429+0000 mgr.y (mgr.14146) 96 : cluster [DBG] pgmap v70: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-10T08:14:15.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:15.244605+0000 mon.a (mon.0) 267 : audit [INF] from='osd.1 v2:172.21.15.18:6805/1941014296' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-10T08:14:15.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:15.631994+0000 mon.a (mon.0) 268 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:14:15.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:15.658060+0000 mon.a (mon.0) 269 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:14:15.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:14.784936+0000 mon.a (mon.0) 263 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:14:15.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:14.785759+0000 mon.a (mon.0) 264 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:14:15.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:14.786527+0000 mon.a (mon.0) 265 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:14:15.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:14.790775+0000 mon.a (mon.0) 266 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:14:15.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:14:15.131429+0000 mgr.y (mgr.14146) 96 : cluster [DBG] pgmap v70: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-10T08:14:15.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:15.244605+0000 mon.a (mon.0) 267 : audit [INF] from='osd.1 v2:172.21.15.18:6805/1941014296' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-10T08:14:15.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:15.631994+0000 mon.a (mon.0) 268 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:14:15.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:15.658060+0000 mon.a (mon.0) 269 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:14:16.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:14.784936+0000 mon.a (mon.0) 263 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:14:16.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:14.785759+0000 mon.a (mon.0) 264 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:14:16.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:14.786527+0000 mon.a (mon.0) 265 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:14:16.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:14.790775+0000 mon.a (mon.0) 266 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:14:16.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:14:15.131429+0000 mgr.y (mgr.14146) 96 : cluster [DBG] pgmap v70: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-10T08:14:16.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:15.244605+0000 mon.a (mon.0) 267 : audit [INF] from='osd.1 v2:172.21.15.18:6805/1941014296' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-10T08:14:16.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:15.631994+0000 mon.a (mon.0) 268 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:14:16.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:15.658060+0000 mon.a (mon.0) 269 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:14:16.396 DEBUG:teuthology.orchestra.run.smithi018:osd.1> sudo journalctl -f -n 0 -u ceph-d46257c8-c7eb-11ee-95b8-87774f69a715@osd.1.service 2024-02-10T08:14:16.398 INFO:tasks.cephadm:Deploying osd.2 on smithi018 with /dev/vg_nvme/lv_2... 2024-02-10T08:14:16.398 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-02-10T08:14:16.432 INFO:journalctl@ceph.osd.1.smithi018.stdout:-- Logs begin at Sat 2024-02-10 07:59:20 UTC. -- 2024-02-10T08:14:17.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:15.919967+0000 mon.a (mon.0) 270 : audit [INF] from='osd.1 v2:172.21.15.18:6805/1941014296' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-10T08:14:17.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:14:15.920047+0000 mon.a (mon.0) 271 : cluster [DBG] osdmap e11: 2 total, 1 up, 2 in 2024-02-10T08:14:17.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:15.920182+0000 mon.a (mon.0) 272 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-10T08:14:17.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:15.920525+0000 mon.a (mon.0) 273 : audit [INF] from='osd.1 v2:172.21.15.18:6805/1941014296' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-02-10T08:14:17.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:15.919967+0000 mon.a (mon.0) 270 : audit [INF] from='osd.1 v2:172.21.15.18:6805/1941014296' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-10T08:14:17.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:14:15.920047+0000 mon.a (mon.0) 271 : cluster [DBG] osdmap e11: 2 total, 1 up, 2 in 2024-02-10T08:14:17.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:15.920182+0000 mon.a (mon.0) 272 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-10T08:14:17.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:15.920525+0000 mon.a (mon.0) 273 : audit [INF] from='osd.1 v2:172.21.15.18:6805/1941014296' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-02-10T08:14:17.405 INFO:journalctl@ceph.osd.1.smithi018.stdout:Feb 10 08:14:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-1[54297]: debug 2024-02-10T08:14:16.927+0000 7f701af40700 -1 osd.1 0 waiting for initial osdmap 2024-02-10T08:14:17.405 INFO:journalctl@ceph.osd.1.smithi018.stdout:Feb 10 08:14:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-1[54297]: debug 2024-02-10T08:14:16.930+0000 7f70136b4700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-10T08:14:17.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:15.919967+0000 mon.a (mon.0) 270 : audit [INF] from='osd.1 v2:172.21.15.18:6805/1941014296' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-10T08:14:17.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:14:15.920047+0000 mon.a (mon.0) 271 : cluster [DBG] osdmap e11: 2 total, 1 up, 2 in 2024-02-10T08:14:17.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:15.920182+0000 mon.a (mon.0) 272 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-10T08:14:17.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:15.920525+0000 mon.a (mon.0) 273 : audit [INF] from='osd.1 v2:172.21.15.18:6805/1941014296' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-02-10T08:14:18.133 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:16.925765+0000 mon.a (mon.0) 274 : audit [INF] from='osd.1 v2:172.21.15.18:6805/1941014296' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-02-10T08:14:18.134 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:14:16.925841+0000 mon.a (mon.0) 275 : cluster [DBG] osdmap e12: 2 total, 1 up, 2 in 2024-02-10T08:14:18.134 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:16.925985+0000 mon.a (mon.0) 276 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-10T08:14:18.134 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:16.929015+0000 mon.a (mon.0) 277 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-10T08:14:18.134 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:14:17.131731+0000 mgr.y (mgr.14146) 97 : cluster [DBG] pgmap v73: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-10T08:14:18.134 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:16.925765+0000 mon.a (mon.0) 274 : audit [INF] from='osd.1 v2:172.21.15.18:6805/1941014296' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-02-10T08:14:18.134 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:14:16.925841+0000 mon.a (mon.0) 275 : cluster [DBG] osdmap e12: 2 total, 1 up, 2 in 2024-02-10T08:14:18.134 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:16.925985+0000 mon.a (mon.0) 276 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-10T08:14:18.134 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:16.929015+0000 mon.a (mon.0) 277 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-10T08:14:18.134 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:14:17.131731+0000 mgr.y (mgr.14146) 97 : cluster [DBG] pgmap v73: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-10T08:14:18.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:16.925765+0000 mon.a (mon.0) 274 : audit [INF] from='osd.1 v2:172.21.15.18:6805/1941014296' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-02-10T08:14:18.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:14:16.925841+0000 mon.a (mon.0) 275 : cluster [DBG] osdmap e12: 2 total, 1 up, 2 in 2024-02-10T08:14:18.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:16.925985+0000 mon.a (mon.0) 276 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-10T08:14:18.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:16.929015+0000 mon.a (mon.0) 277 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-10T08:14:18.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:14:17.131731+0000 mgr.y (mgr.14146) 97 : cluster [DBG] pgmap v73: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-10T08:14:19.098 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:14:16.259354+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:14:19.098 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:14:16.259401+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:14:19.098 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:14:17.928012+0000 mon.a (mon.0) 278 : cluster [INF] osd.1 v2:172.21.15.18:6805/1941014296 boot 2024-02-10T08:14:19.099 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:14:17.928074+0000 mon.a (mon.0) 279 : cluster [DBG] osdmap e13: 2 total, 2 up, 2 in 2024-02-10T08:14:19.099 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:17.928720+0000 mon.a (mon.0) 280 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-10T08:14:19.099 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:14:16.259354+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:14:19.099 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:14:16.259401+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:14:19.099 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:14:17.928012+0000 mon.a (mon.0) 278 : cluster [INF] osd.1 v2:172.21.15.18:6805/1941014296 boot 2024-02-10T08:14:19.099 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:14:17.928074+0000 mon.a (mon.0) 279 : cluster [DBG] osdmap e13: 2 total, 2 up, 2 in 2024-02-10T08:14:19.099 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:17.928720+0000 mon.a (mon.0) 280 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-10T08:14:19.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:14:16.259354+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:14:19.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:14:16.259401+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:14:19.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:14:17.928012+0000 mon.a (mon.0) 278 : cluster [INF] osd.1 v2:172.21.15.18:6805/1941014296 boot 2024-02-10T08:14:19.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:14:17.928074+0000 mon.a (mon.0) 279 : cluster [DBG] osdmap e13: 2 total, 2 up, 2 in 2024-02-10T08:14:19.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:17.928720+0000 mon.a (mon.0) 280 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-10T08:14:19.686 INFO:teuthology.orchestra.run.smithi018.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-02-10T08:14:19.686 INFO:teuthology.orchestra.run.smithi018.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-02-10T08:14:19.686 INFO:teuthology.orchestra.run.smithi018.stderr: stderr: 10+0 records in 2024-02-10T08:14:19.686 INFO:teuthology.orchestra.run.smithi018.stderr:10+0 records out 2024-02-10T08:14:19.686 INFO:teuthology.orchestra.run.smithi018.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00847832 s, 1.2 GB/s 2024-02-10T08:14:19.687 INFO:teuthology.orchestra.run.smithi018.stderr:--> Zapping successful for: 2024-02-10T08:14:20.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:14:18.933169+0000 mon.a (mon.0) 281 : cluster [DBG] osdmap e14: 2 total, 2 up, 2 in 2024-02-10T08:14:20.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:14:19.131998+0000 mgr.y (mgr.14146) 98 : cluster [DBG] pgmap v76: 0 pgs: ; 0 B data, 580 MiB used, 178 GiB / 179 GiB avail 2024-02-10T08:14:20.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:14:18.933169+0000 mon.a (mon.0) 281 : cluster [DBG] osdmap e14: 2 total, 2 up, 2 in 2024-02-10T08:14:20.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:14:19.131998+0000 mgr.y (mgr.14146) 98 : cluster [DBG] pgmap v76: 0 pgs: ; 0 B data, 580 MiB used, 178 GiB / 179 GiB avail 2024-02-10T08:14:20.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:14:18.933169+0000 mon.a (mon.0) 281 : cluster [DBG] osdmap e14: 2 total, 2 up, 2 in 2024-02-10T08:14:20.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:14:19.131998+0000 mgr.y (mgr.14146) 98 : cluster [DBG] pgmap v76: 0 pgs: ; 0 B data, 580 MiB used, 178 GiB / 179 GiB avail 2024-02-10T08:14:21.177 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph orch daemon add osd smithi018:vg_nvme/lv_2 2024-02-10T08:14:21.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cephadm 2024-02-10T08:14:20.872334+0000 mgr.y (mgr.14146) 99 : cephadm [INF] Detected new or changed devices on smithi018 2024-02-10T08:14:21.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:20.876805+0000 mon.a (mon.0) 282 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:14:21.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:14:21.132311+0000 mgr.y (mgr.14146) 100 : cluster [DBG] pgmap v77: 0 pgs: ; 0 B data, 580 MiB used, 178 GiB / 179 GiB avail 2024-02-10T08:14:21.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:21.289208+0000 mon.a (mon.0) 283 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:14:21.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:21.289937+0000 mon.a (mon.0) 284 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:14:21.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cephadm 2024-02-10T08:14:21.290413+0000 mgr.y (mgr.14146) 101 : cephadm [INF] Adjusting osd_memory_target on smithi018 to 8051M 2024-02-10T08:14:21.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:21.294223+0000 mon.a (mon.0) 285 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:14:21.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:21.295100+0000 mon.a (mon.0) 286 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:14:21.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:21.295702+0000 mon.a (mon.0) 287 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:14:21.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:21.299654+0000 mon.a (mon.0) 288 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:14:21.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cephadm 2024-02-10T08:14:20.872334+0000 mgr.y (mgr.14146) 99 : cephadm [INF] Detected new or changed devices on smithi018 2024-02-10T08:14:21.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:20.876805+0000 mon.a (mon.0) 282 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:14:21.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:14:21.132311+0000 mgr.y (mgr.14146) 100 : cluster [DBG] pgmap v77: 0 pgs: ; 0 B data, 580 MiB used, 178 GiB / 179 GiB avail 2024-02-10T08:14:21.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:21.289208+0000 mon.a (mon.0) 283 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:14:21.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:21.289937+0000 mon.a (mon.0) 284 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:14:21.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cephadm 2024-02-10T08:14:21.290413+0000 mgr.y (mgr.14146) 101 : cephadm [INF] Adjusting osd_memory_target on smithi018 to 8051M 2024-02-10T08:14:21.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:21.294223+0000 mon.a (mon.0) 285 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:14:21.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:21.295100+0000 mon.a (mon.0) 286 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:14:21.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:21.295702+0000 mon.a (mon.0) 287 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:14:21.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:21.299654+0000 mon.a (mon.0) 288 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:14:22.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cephadm 2024-02-10T08:14:20.872334+0000 mgr.y (mgr.14146) 99 : cephadm [INF] Detected new or changed devices on smithi018 2024-02-10T08:14:22.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:20.876805+0000 mon.a (mon.0) 282 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:14:22.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:14:21.132311+0000 mgr.y (mgr.14146) 100 : cluster [DBG] pgmap v77: 0 pgs: ; 0 B data, 580 MiB used, 178 GiB / 179 GiB avail 2024-02-10T08:14:22.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:21.289208+0000 mon.a (mon.0) 283 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:14:22.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:21.289937+0000 mon.a (mon.0) 284 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:14:22.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cephadm 2024-02-10T08:14:21.290413+0000 mgr.y (mgr.14146) 101 : cephadm [INF] Adjusting osd_memory_target on smithi018 to 8051M 2024-02-10T08:14:22.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:21.294223+0000 mon.a (mon.0) 285 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:14:22.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:21.295100+0000 mon.a (mon.0) 286 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:14:22.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:21.295702+0000 mon.a (mon.0) 287 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:14:22.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:21.299654+0000 mon.a (mon.0) 288 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:14:24.485 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:14:23.132577+0000 mgr.y (mgr.14146) 102 : cluster [DBG] pgmap v78: 0 pgs: ; 0 B data, 580 MiB used, 178 GiB / 179 GiB avail 2024-02-10T08:14:24.486 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:23.302991+0000 mgr.y (mgr.14146) 103 : audit [DBG] from='client.14265 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:14:24.486 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:23.304958+0000 mon.a (mon.0) 289 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-10T08:14:24.486 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:23.306765+0000 mon.a (mon.0) 290 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-10T08:14:24.486 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:23.307306+0000 mon.a (mon.0) 291 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:14:24.486 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:14:23.132577+0000 mgr.y (mgr.14146) 102 : cluster [DBG] pgmap v78: 0 pgs: ; 0 B data, 580 MiB used, 178 GiB / 179 GiB avail 2024-02-10T08:14:24.486 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:23.302991+0000 mgr.y (mgr.14146) 103 : audit [DBG] from='client.14265 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:14:24.486 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:23.304958+0000 mon.a (mon.0) 289 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-10T08:14:24.486 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:23.306765+0000 mon.a (mon.0) 290 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-10T08:14:24.486 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:23.307306+0000 mon.a (mon.0) 291 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:14:24.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:14:23.132577+0000 mgr.y (mgr.14146) 102 : cluster [DBG] pgmap v78: 0 pgs: ; 0 B data, 580 MiB used, 178 GiB / 179 GiB avail 2024-02-10T08:14:24.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:23.302991+0000 mgr.y (mgr.14146) 103 : audit [DBG] from='client.14265 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:14:24.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:23.304958+0000 mon.a (mon.0) 289 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-10T08:14:24.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:23.306765+0000 mon.a (mon.0) 290 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-10T08:14:24.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:23.307306+0000 mon.a (mon.0) 291 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:14:26.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:14:25.132991+0000 mgr.y (mgr.14146) 104 : cluster [DBG] pgmap v79: 0 pgs: ; 0 B data, 580 MiB used, 178 GiB / 179 GiB avail 2024-02-10T08:14:26.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:25.817413+0000 mon.c (mon.2) 7 : audit [INF] from='client.? 172.21.15.18:0/3867468953' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "29bb47e2-5c81-4ae8-bb9f-d1b02ea01d3f"}]: dispatch 2024-02-10T08:14:26.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:25.817736+0000 mon.a (mon.0) 292 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "29bb47e2-5c81-4ae8-bb9f-d1b02ea01d3f"}]: dispatch 2024-02-10T08:14:26.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:25.821522+0000 mon.a (mon.0) 293 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "29bb47e2-5c81-4ae8-bb9f-d1b02ea01d3f"}]': finished 2024-02-10T08:14:26.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:14:25.821599+0000 mon.a (mon.0) 294 : cluster [DBG] osdmap e15: 3 total, 2 up, 3 in 2024-02-10T08:14:26.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:25.821704+0000 mon.a (mon.0) 295 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-10T08:14:26.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:14:25.132991+0000 mgr.y (mgr.14146) 104 : cluster [DBG] pgmap v79: 0 pgs: ; 0 B data, 580 MiB used, 178 GiB / 179 GiB avail 2024-02-10T08:14:26.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:25.817413+0000 mon.c (mon.2) 7 : audit [INF] from='client.? 172.21.15.18:0/3867468953' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "29bb47e2-5c81-4ae8-bb9f-d1b02ea01d3f"}]: dispatch 2024-02-10T08:14:26.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:25.817736+0000 mon.a (mon.0) 292 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "29bb47e2-5c81-4ae8-bb9f-d1b02ea01d3f"}]: dispatch 2024-02-10T08:14:26.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:25.821522+0000 mon.a (mon.0) 293 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "29bb47e2-5c81-4ae8-bb9f-d1b02ea01d3f"}]': finished 2024-02-10T08:14:26.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:14:25.821599+0000 mon.a (mon.0) 294 : cluster [DBG] osdmap e15: 3 total, 2 up, 3 in 2024-02-10T08:14:26.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:25.821704+0000 mon.a (mon.0) 295 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-10T08:14:26.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:14:25.132991+0000 mgr.y (mgr.14146) 104 : cluster [DBG] pgmap v79: 0 pgs: ; 0 B data, 580 MiB used, 178 GiB / 179 GiB avail 2024-02-10T08:14:26.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:25.817413+0000 mon.c (mon.2) 7 : audit [INF] from='client.? 172.21.15.18:0/3867468953' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "29bb47e2-5c81-4ae8-bb9f-d1b02ea01d3f"}]: dispatch 2024-02-10T08:14:26.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:25.817736+0000 mon.a (mon.0) 292 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "29bb47e2-5c81-4ae8-bb9f-d1b02ea01d3f"}]: dispatch 2024-02-10T08:14:26.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:25.821522+0000 mon.a (mon.0) 293 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "29bb47e2-5c81-4ae8-bb9f-d1b02ea01d3f"}]': finished 2024-02-10T08:14:26.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:14:25.821599+0000 mon.a (mon.0) 294 : cluster [DBG] osdmap e15: 3 total, 2 up, 3 in 2024-02-10T08:14:26.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:25.821704+0000 mon.a (mon.0) 295 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-10T08:14:27.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:26.468448+0000 mon.c (mon.2) 8 : audit [DBG] from='client.? 172.21.15.18:0/3238967102' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-10T08:14:27.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:26.468448+0000 mon.c (mon.2) 8 : audit [DBG] from='client.? 172.21.15.18:0/3238967102' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-10T08:14:27.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:26.468448+0000 mon.c (mon.2) 8 : audit [DBG] from='client.? 172.21.15.18:0/3238967102' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-10T08:14:28.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:14:27.133331+0000 mgr.y (mgr.14146) 105 : cluster [DBG] pgmap v81: 0 pgs: ; 0 B data, 580 MiB used, 178 GiB / 179 GiB avail 2024-02-10T08:14:28.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:14:27.133331+0000 mgr.y (mgr.14146) 105 : cluster [DBG] pgmap v81: 0 pgs: ; 0 B data, 580 MiB used, 178 GiB / 179 GiB avail 2024-02-10T08:14:28.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:14:27.133331+0000 mgr.y (mgr.14146) 105 : cluster [DBG] pgmap v81: 0 pgs: ; 0 B data, 580 MiB used, 178 GiB / 179 GiB avail 2024-02-10T08:14:30.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:14:29.133636+0000 mgr.y (mgr.14146) 106 : cluster [DBG] pgmap v82: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-10T08:14:30.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:14:29.133636+0000 mgr.y (mgr.14146) 106 : cluster [DBG] pgmap v82: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-10T08:14:30.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:14:29.133636+0000 mgr.y (mgr.14146) 106 : cluster [DBG] pgmap v82: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-10T08:14:32.322 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:14:31.134008+0000 mgr.y (mgr.14146) 107 : cluster [DBG] pgmap v83: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-10T08:14:32.322 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:14:31.134008+0000 mgr.y (mgr.14146) 107 : cluster [DBG] pgmap v83: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-10T08:14:32.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:14:31.134008+0000 mgr.y (mgr.14146) 107 : cluster [DBG] pgmap v83: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-10T08:14:33.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:32.344476+0000 mon.a (mon.0) 296 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-10T08:14:33.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:32.345197+0000 mon.a (mon.0) 297 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:14:33.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cephadm 2024-02-10T08:14:32.345777+0000 mgr.y (mgr.14146) 108 : cephadm [INF] Deploying daemon osd.2 on smithi018 2024-02-10T08:14:33.597 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:32.344476+0000 mon.a (mon.0) 296 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-10T08:14:33.597 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:32.345197+0000 mon.a (mon.0) 297 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:14:33.597 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cephadm 2024-02-10T08:14:32.345777+0000 mgr.y (mgr.14146) 108 : cephadm [INF] Deploying daemon osd.2 on smithi018 2024-02-10T08:14:33.597 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:32.344476+0000 mon.a (mon.0) 296 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-10T08:14:33.597 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:32.345197+0000 mon.a (mon.0) 297 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:14:33.597 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cephadm 2024-02-10T08:14:32.345777+0000 mgr.y (mgr.14146) 108 : cephadm [INF] Deploying daemon osd.2 on smithi018 2024-02-10T08:14:34.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:14:33.134377+0000 mgr.y (mgr.14146) 109 : cluster [DBG] pgmap v84: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-10T08:14:34.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:14:33.134377+0000 mgr.y (mgr.14146) 109 : cluster [DBG] pgmap v84: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-10T08:14:34.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:14:33.134377+0000 mgr.y (mgr.14146) 109 : cluster [DBG] pgmap v84: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-10T08:14:36.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:14:35.134661+0000 mgr.y (mgr.14146) 110 : cluster [DBG] pgmap v85: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-10T08:14:36.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:14:35.134661+0000 mgr.y (mgr.14146) 110 : cluster [DBG] pgmap v85: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-10T08:14:36.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:14:35.134661+0000 mgr.y (mgr.14146) 110 : cluster [DBG] pgmap v85: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-10T08:14:38.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:14:37.135085+0000 mgr.y (mgr.14146) 111 : cluster [DBG] pgmap v86: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-10T08:14:38.906 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:37.567817+0000 mon.a (mon.0) 298 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:14:38.906 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:37.596973+0000 mon.a (mon.0) 299 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:14:38.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:14:37.135085+0000 mgr.y (mgr.14146) 111 : cluster [DBG] pgmap v86: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-10T08:14:38.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:37.567817+0000 mon.a (mon.0) 298 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:14:38.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:37.596973+0000 mon.a (mon.0) 299 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:14:39.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:14:37.135085+0000 mgr.y (mgr.14146) 111 : cluster [DBG] pgmap v86: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-10T08:14:39.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:37.567817+0000 mon.a (mon.0) 298 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:14:39.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:37.596973+0000 mon.a (mon.0) 299 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:14:40.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:14:39.135357+0000 mgr.y (mgr.14146) 112 : cluster [DBG] pgmap v87: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-10T08:14:40.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:40.170189+0000 mon.a (mon.0) 300 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:14:40.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:40.170933+0000 mon.a (mon.0) 301 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:14:40.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:40.171622+0000 mon.a (mon.0) 302 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:14:40.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:40.176310+0000 mon.a (mon.0) 303 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:14:40.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:14:39.135357+0000 mgr.y (mgr.14146) 112 : cluster [DBG] pgmap v87: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-10T08:14:40.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:40.170189+0000 mon.a (mon.0) 300 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:14:40.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:40.170933+0000 mon.a (mon.0) 301 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:14:40.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:40.171622+0000 mon.a (mon.0) 302 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:14:40.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:40.176310+0000 mon.a (mon.0) 303 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:14:41.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:14:39.135357+0000 mgr.y (mgr.14146) 112 : cluster [DBG] pgmap v87: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-10T08:14:41.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:40.170189+0000 mon.a (mon.0) 300 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:14:41.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:40.170933+0000 mon.a (mon.0) 301 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:14:41.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:40.171622+0000 mon.a (mon.0) 302 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:14:41.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:40.176310+0000 mon.a (mon.0) 303 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:14:41.275 INFO:teuthology.orchestra.run.smithi018.stdout:Created osd(s) 2 on host 'smithi018' 2024-02-10T08:14:41.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:40.672501+0000 mon.c (mon.2) 9 : audit [INF] from='osd.2 v2:172.21.15.18:6809/3122474567' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-10T08:14:41.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:40.672859+0000 mon.a (mon.0) 304 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-10T08:14:41.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:41.274150+0000 mon.a (mon.0) 305 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:14:41.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:41.294025+0000 mon.a (mon.0) 306 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:14:41.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:40.672501+0000 mon.c (mon.2) 9 : audit [INF] from='osd.2 v2:172.21.15.18:6809/3122474567' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-10T08:14:41.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:40.672859+0000 mon.a (mon.0) 304 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-10T08:14:41.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:41.274150+0000 mon.a (mon.0) 305 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:14:41.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:41.294025+0000 mon.a (mon.0) 306 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:14:42.006 DEBUG:teuthology.orchestra.run.smithi018:osd.2> sudo journalctl -f -n 0 -u ceph-d46257c8-c7eb-11ee-95b8-87774f69a715@osd.2.service 2024-02-10T08:14:42.009 INFO:tasks.cephadm:Deploying osd.3 on smithi018 with /dev/vg_nvme/lv_1... 2024-02-10T08:14:42.009 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-02-10T08:14:42.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:41 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:40.672501+0000 mon.c (mon.2) 9 : audit [INF] from='osd.2 v2:172.21.15.18:6809/3122474567' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-10T08:14:42.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:41 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:40.672859+0000 mon.a (mon.0) 304 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-10T08:14:42.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:41 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:41.274150+0000 mon.a (mon.0) 305 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:14:42.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:41 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:41.294025+0000 mon.a (mon.0) 306 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:14:42.043 INFO:journalctl@ceph.osd.2.smithi018.stdout:-- Logs begin at Sat 2024-02-10 07:59:20 UTC. -- 2024-02-10T08:14:42.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:14:41.135631+0000 mgr.y (mgr.14146) 113 : cluster [DBG] pgmap v88: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-10T08:14:42.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:41.577119+0000 mon.a (mon.0) 307 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-10T08:14:42.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:14:41.577210+0000 mon.a (mon.0) 308 : cluster [DBG] osdmap e16: 3 total, 2 up, 3 in 2024-02-10T08:14:42.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:41.577345+0000 mon.a (mon.0) 309 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-10T08:14:42.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:41.577819+0000 mon.c (mon.2) 10 : audit [INF] from='osd.2 v2:172.21.15.18:6809/3122474567' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-02-10T08:14:42.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:41.578130+0000 mon.a (mon.0) 310 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-02-10T08:14:42.905 INFO:journalctl@ceph.osd.2.smithi018.stdout:Feb 10 08:14:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-2[58841]: debug 2024-02-10T08:14:42.581+0000 7fcf93238700 -1 osd.2 0 waiting for initial osdmap 2024-02-10T08:14:42.905 INFO:journalctl@ceph.osd.2.smithi018.stdout:Feb 10 08:14:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-2[58841]: debug 2024-02-10T08:14:42.584+0000 7fcf8e1b1700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-10T08:14:42.906 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:14:41.135631+0000 mgr.y (mgr.14146) 113 : cluster [DBG] pgmap v88: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-10T08:14:42.906 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:41.577119+0000 mon.a (mon.0) 307 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-10T08:14:42.906 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:14:41.577210+0000 mon.a (mon.0) 308 : cluster [DBG] osdmap e16: 3 total, 2 up, 3 in 2024-02-10T08:14:42.906 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:41.577345+0000 mon.a (mon.0) 309 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-10T08:14:42.906 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:41.577819+0000 mon.c (mon.2) 10 : audit [INF] from='osd.2 v2:172.21.15.18:6809/3122474567' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-02-10T08:14:42.906 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:41.578130+0000 mon.a (mon.0) 310 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-02-10T08:14:43.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:14:41.135631+0000 mgr.y (mgr.14146) 113 : cluster [DBG] pgmap v88: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-10T08:14:43.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:41.577119+0000 mon.a (mon.0) 307 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-10T08:14:43.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:14:41.577210+0000 mon.a (mon.0) 308 : cluster [DBG] osdmap e16: 3 total, 2 up, 3 in 2024-02-10T08:14:43.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:41.577345+0000 mon.a (mon.0) 309 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-10T08:14:43.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:41.577819+0000 mon.c (mon.2) 10 : audit [INF] from='osd.2 v2:172.21.15.18:6809/3122474567' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-02-10T08:14:43.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:41.578130+0000 mon.a (mon.0) 310 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-02-10T08:14:43.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:42.578225+0000 mon.a (mon.0) 311 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-02-10T08:14:43.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:14:42.578276+0000 mon.a (mon.0) 312 : cluster [DBG] osdmap e17: 3 total, 2 up, 3 in 2024-02-10T08:14:43.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:42.578537+0000 mon.a (mon.0) 313 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-10T08:14:43.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:42.582117+0000 mon.a (mon.0) 314 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-10T08:14:43.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:42.578225+0000 mon.a (mon.0) 311 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-02-10T08:14:43.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:14:42.578276+0000 mon.a (mon.0) 312 : cluster [DBG] osdmap e17: 3 total, 2 up, 3 in 2024-02-10T08:14:43.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:42.578537+0000 mon.a (mon.0) 313 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-10T08:14:43.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:42.582117+0000 mon.a (mon.0) 314 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-10T08:14:44.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:43 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:42.578225+0000 mon.a (mon.0) 311 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-02-10T08:14:44.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:43 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:14:42.578276+0000 mon.a (mon.0) 312 : cluster [DBG] osdmap e17: 3 total, 2 up, 3 in 2024-02-10T08:14:44.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:43 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:42.578537+0000 mon.a (mon.0) 313 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-10T08:14:44.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:43 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:42.582117+0000 mon.a (mon.0) 314 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-10T08:14:44.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:14:41.643208+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:14:44.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:14:41.643265+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:14:44.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:14:43.136054+0000 mgr.y (mgr.14146) 114 : cluster [DBG] pgmap v91: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-10T08:14:44.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:43.583294+0000 mon.a (mon.0) 315 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-10T08:14:44.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:14:43.587891+0000 mon.a (mon.0) 316 : cluster [INF] osd.2 v2:172.21.15.18:6809/3122474567 boot 2024-02-10T08:14:44.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:14:43.587948+0000 mon.a (mon.0) 317 : cluster [DBG] osdmap e18: 3 total, 3 up, 3 in 2024-02-10T08:14:44.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:43.588416+0000 mon.a (mon.0) 318 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-10T08:14:44.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:43.589100+0000 mon.a (mon.0) 319 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-10T08:14:44.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:14:41.643208+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:14:44.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:14:41.643265+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:14:44.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:14:43.136054+0000 mgr.y (mgr.14146) 114 : cluster [DBG] pgmap v91: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-10T08:14:44.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:43.583294+0000 mon.a (mon.0) 315 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-10T08:14:44.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:14:43.587891+0000 mon.a (mon.0) 316 : cluster [INF] osd.2 v2:172.21.15.18:6809/3122474567 boot 2024-02-10T08:14:44.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:14:43.587948+0000 mon.a (mon.0) 317 : cluster [DBG] osdmap e18: 3 total, 3 up, 3 in 2024-02-10T08:14:44.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:43.588416+0000 mon.a (mon.0) 318 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-10T08:14:44.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:43.589100+0000 mon.a (mon.0) 319 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-10T08:14:45.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:44 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:14:41.643208+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:14:45.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:44 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:14:41.643265+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:14:45.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:44 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:14:43.136054+0000 mgr.y (mgr.14146) 114 : cluster [DBG] pgmap v91: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-10T08:14:45.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:44 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:43.583294+0000 mon.a (mon.0) 315 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-10T08:14:45.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:44 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:14:43.587891+0000 mon.a (mon.0) 316 : cluster [INF] osd.2 v2:172.21.15.18:6809/3122474567 boot 2024-02-10T08:14:45.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:44 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:14:43.587948+0000 mon.a (mon.0) 317 : cluster [DBG] osdmap e18: 3 total, 3 up, 3 in 2024-02-10T08:14:45.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:44 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:43.588416+0000 mon.a (mon.0) 318 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-10T08:14:45.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:44 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:43.589100+0000 mon.a (mon.0) 319 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-10T08:14:45.731 INFO:teuthology.orchestra.run.smithi018.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-02-10T08:14:45.731 INFO:teuthology.orchestra.run.smithi018.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-02-10T08:14:45.731 INFO:teuthology.orchestra.run.smithi018.stderr: stderr: 10+0 records in 2024-02-10T08:14:45.731 INFO:teuthology.orchestra.run.smithi018.stderr:10+0 records out 2024-02-10T08:14:45.731 INFO:teuthology.orchestra.run.smithi018.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00812576 s, 1.3 GB/s 2024-02-10T08:14:45.731 INFO:teuthology.orchestra.run.smithi018.stderr:--> Zapping successful for: 2024-02-10T08:14:45.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:44.591997+0000 mon.a (mon.0) 320 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-02-10T08:14:45.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:14:44.592076+0000 mon.a (mon.0) 321 : cluster [DBG] osdmap e19: 3 total, 3 up, 3 in 2024-02-10T08:14:45.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:44.592760+0000 mon.a (mon.0) 322 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-10T08:14:45.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:14:45.136338+0000 mgr.y (mgr.14146) 115 : cluster [DBG] pgmap v94: 1 pgs: 1 unknown; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-10T08:14:45.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:44.591997+0000 mon.a (mon.0) 320 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-02-10T08:14:45.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:14:44.592076+0000 mon.a (mon.0) 321 : cluster [DBG] osdmap e19: 3 total, 3 up, 3 in 2024-02-10T08:14:45.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:44.592760+0000 mon.a (mon.0) 322 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-10T08:14:45.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:14:45.136338+0000 mgr.y (mgr.14146) 115 : cluster [DBG] pgmap v94: 1 pgs: 1 unknown; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-10T08:14:46.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:44.591997+0000 mon.a (mon.0) 320 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-02-10T08:14:46.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:14:44.592076+0000 mon.a (mon.0) 321 : cluster [DBG] osdmap e19: 3 total, 3 up, 3 in 2024-02-10T08:14:46.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:44.592760+0000 mon.a (mon.0) 322 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-10T08:14:46.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:14:45.136338+0000 mgr.y (mgr.14146) 115 : cluster [DBG] pgmap v94: 1 pgs: 1 unknown; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-10T08:14:46.753 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:45.593245+0000 mon.a (mon.0) 323 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-02-10T08:14:46.753 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:14:45.593330+0000 mon.a (mon.0) 324 : cluster [DBG] osdmap e20: 3 total, 3 up, 3 in 2024-02-10T08:14:46.753 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cephadm 2024-02-10T08:14:46.351375+0000 mgr.y (mgr.14146) 116 : cephadm [INF] Detected new or changed devices on smithi018 2024-02-10T08:14:46.753 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:46.356850+0000 mon.a (mon.0) 325 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:14:46.753 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:46.357744+0000 mon.a (mon.0) 326 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:14:46.753 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:46.358337+0000 mon.a (mon.0) 327 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:14:46.754 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:46.358861+0000 mon.a (mon.0) 328 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:14:46.754 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cephadm 2024-02-10T08:14:46.359271+0000 mgr.y (mgr.14146) 117 : cephadm [INF] Adjusting osd_memory_target on smithi018 to 5367M 2024-02-10T08:14:46.754 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:46.363852+0000 mon.a (mon.0) 329 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:14:46.754 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:46.364689+0000 mon.a (mon.0) 330 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:14:46.754 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:46.365287+0000 mon.a (mon.0) 331 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:14:46.754 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:46.369086+0000 mon.a (mon.0) 332 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:14:46.754 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:45.593245+0000 mon.a (mon.0) 323 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-02-10T08:14:46.754 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:14:45.593330+0000 mon.a (mon.0) 324 : cluster [DBG] osdmap e20: 3 total, 3 up, 3 in 2024-02-10T08:14:46.754 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cephadm 2024-02-10T08:14:46.351375+0000 mgr.y (mgr.14146) 116 : cephadm [INF] Detected new or changed devices on smithi018 2024-02-10T08:14:46.754 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:46.356850+0000 mon.a (mon.0) 325 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:14:46.754 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:46.357744+0000 mon.a (mon.0) 326 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:14:46.754 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:46.358337+0000 mon.a (mon.0) 327 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:14:46.755 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:46.358861+0000 mon.a (mon.0) 328 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:14:46.755 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cephadm 2024-02-10T08:14:46.359271+0000 mgr.y (mgr.14146) 117 : cephadm [INF] Adjusting osd_memory_target on smithi018 to 5367M 2024-02-10T08:14:46.755 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:46.363852+0000 mon.a (mon.0) 329 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:14:46.755 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:46.364689+0000 mon.a (mon.0) 330 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:14:46.755 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:46.365287+0000 mon.a (mon.0) 331 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:14:46.755 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:46.369086+0000 mon.a (mon.0) 332 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:14:46.775 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph orch daemon add osd smithi018:vg_nvme/lv_1 2024-02-10T08:14:47.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:45.593245+0000 mon.a (mon.0) 323 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-02-10T08:14:47.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:14:45.593330+0000 mon.a (mon.0) 324 : cluster [DBG] osdmap e20: 3 total, 3 up, 3 in 2024-02-10T08:14:47.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cephadm 2024-02-10T08:14:46.351375+0000 mgr.y (mgr.14146) 116 : cephadm [INF] Detected new or changed devices on smithi018 2024-02-10T08:14:47.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:46.356850+0000 mon.a (mon.0) 325 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:14:47.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:46.357744+0000 mon.a (mon.0) 326 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:14:47.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:46.358337+0000 mon.a (mon.0) 327 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:14:47.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:46.358861+0000 mon.a (mon.0) 328 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:14:47.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cephadm 2024-02-10T08:14:46.359271+0000 mgr.y (mgr.14146) 117 : cephadm [INF] Adjusting osd_memory_target on smithi018 to 5367M 2024-02-10T08:14:47.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:46.363852+0000 mon.a (mon.0) 329 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:14:47.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:46.364689+0000 mon.a (mon.0) 330 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:14:47.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:46.365287+0000 mon.a (mon.0) 331 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:14:47.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:46.369086+0000 mon.a (mon.0) 332 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:14:47.862 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:14:46.604342+0000 mon.a (mon.0) 333 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2024-02-10T08:14:47.862 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:14:47.136698+0000 mgr.y (mgr.14146) 118 : cluster [DBG] pgmap v97: 1 pgs: 1 unknown; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-10T08:14:47.862 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:14:46.604342+0000 mon.a (mon.0) 333 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2024-02-10T08:14:47.862 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:14:47.136698+0000 mgr.y (mgr.14146) 118 : cluster [DBG] pgmap v97: 1 pgs: 1 unknown; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-10T08:14:48.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:14:46.604342+0000 mon.a (mon.0) 333 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2024-02-10T08:14:48.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:14:47.136698+0000 mgr.y (mgr.14146) 118 : cluster [DBG] pgmap v97: 1 pgs: 1 unknown; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-10T08:14:49.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:48.879095+0000 mon.a (mon.0) 334 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-10T08:14:49.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:48.881005+0000 mon.a (mon.0) 335 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-10T08:14:49.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:48.881532+0000 mon.a (mon.0) 336 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:14:49.342 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:48.879095+0000 mon.a (mon.0) 334 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-10T08:14:49.343 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:48.881005+0000 mon.a (mon.0) 335 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-10T08:14:49.343 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:48.881532+0000 mon.a (mon.0) 336 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:14:49.343 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:48.879095+0000 mon.a (mon.0) 334 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-10T08:14:49.343 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:48.881005+0000 mon.a (mon.0) 335 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-10T08:14:49.343 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:48.881532+0000 mon.a (mon.0) 336 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:14:50.229 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:48.877053+0000 mgr.y (mgr.14146) 119 : audit [DBG] from='client.24206 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:14:50.229 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:14:49.137017+0000 mgr.y (mgr.14146) 120 : cluster [DBG] pgmap v98: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-10T08:14:50.229 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:48.877053+0000 mgr.y (mgr.14146) 119 : audit [DBG] from='client.24206 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:14:50.229 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:14:49.137017+0000 mgr.y (mgr.14146) 120 : cluster [DBG] pgmap v98: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-10T08:14:50.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:49 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:48.877053+0000 mgr.y (mgr.14146) 119 : audit [DBG] from='client.24206 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:14:50.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:49 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:14:49.137017+0000 mgr.y (mgr.14146) 120 : cluster [DBG] pgmap v98: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-10T08:14:52.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:52 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:14:51.137265+0000 mgr.y (mgr.14146) 121 : cluster [DBG] pgmap v99: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-10T08:14:52.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:52 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:51.321386+0000 mon.c (mon.2) 11 : audit [INF] from='client.? 172.21.15.18:0/576038072' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "87ad37de-5f49-4e5b-9683-3bb9c3e33907"}]: dispatch 2024-02-10T08:14:52.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:52 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:51.321713+0000 mon.a (mon.0) 337 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "87ad37de-5f49-4e5b-9683-3bb9c3e33907"}]: dispatch 2024-02-10T08:14:52.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:52 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:51.325420+0000 mon.a (mon.0) 338 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "87ad37de-5f49-4e5b-9683-3bb9c3e33907"}]': finished 2024-02-10T08:14:52.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:52 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:14:51.325488+0000 mon.a (mon.0) 339 : cluster [DBG] osdmap e22: 4 total, 3 up, 4 in 2024-02-10T08:14:52.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:52 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:51.325624+0000 mon.a (mon.0) 340 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-10T08:14:52.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:52 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:51.953247+0000 mon.a (mon.0) 341 : audit [DBG] from='client.? 172.21.15.18:0/2307023828' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-10T08:14:52.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:14:51.137265+0000 mgr.y (mgr.14146) 121 : cluster [DBG] pgmap v99: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-10T08:14:52.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:51.321386+0000 mon.c (mon.2) 11 : audit [INF] from='client.? 172.21.15.18:0/576038072' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "87ad37de-5f49-4e5b-9683-3bb9c3e33907"}]: dispatch 2024-02-10T08:14:52.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:51.321713+0000 mon.a (mon.0) 337 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "87ad37de-5f49-4e5b-9683-3bb9c3e33907"}]: dispatch 2024-02-10T08:14:52.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:51.325420+0000 mon.a (mon.0) 338 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "87ad37de-5f49-4e5b-9683-3bb9c3e33907"}]': finished 2024-02-10T08:14:52.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:14:51.325488+0000 mon.a (mon.0) 339 : cluster [DBG] osdmap e22: 4 total, 3 up, 4 in 2024-02-10T08:14:52.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:51.325624+0000 mon.a (mon.0) 340 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-10T08:14:52.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:51.953247+0000 mon.a (mon.0) 341 : audit [DBG] from='client.? 172.21.15.18:0/2307023828' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-10T08:14:52.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:14:51.137265+0000 mgr.y (mgr.14146) 121 : cluster [DBG] pgmap v99: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-10T08:14:52.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:51.321386+0000 mon.c (mon.2) 11 : audit [INF] from='client.? 172.21.15.18:0/576038072' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "87ad37de-5f49-4e5b-9683-3bb9c3e33907"}]: dispatch 2024-02-10T08:14:52.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:51.321713+0000 mon.a (mon.0) 337 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "87ad37de-5f49-4e5b-9683-3bb9c3e33907"}]: dispatch 2024-02-10T08:14:52.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:51.325420+0000 mon.a (mon.0) 338 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "87ad37de-5f49-4e5b-9683-3bb9c3e33907"}]': finished 2024-02-10T08:14:52.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:14:51.325488+0000 mon.a (mon.0) 339 : cluster [DBG] osdmap e22: 4 total, 3 up, 4 in 2024-02-10T08:14:52.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:51.325624+0000 mon.a (mon.0) 340 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-10T08:14:52.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:51.953247+0000 mon.a (mon.0) 341 : audit [DBG] from='client.? 172.21.15.18:0/2307023828' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-10T08:14:54.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:54 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:14:53.137561+0000 mgr.y (mgr.14146) 122 : cluster [DBG] pgmap v101: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-10T08:14:54.598 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:14:53.137561+0000 mgr.y (mgr.14146) 122 : cluster [DBG] pgmap v101: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-10T08:14:54.598 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:14:53.137561+0000 mgr.y (mgr.14146) 122 : cluster [DBG] pgmap v101: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-10T08:14:56.137 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:14:55.137798+0000 mgr.y (mgr.14146) 123 : cluster [DBG] pgmap v102: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-10T08:14:56.137 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:14:55.137798+0000 mgr.y (mgr.14146) 123 : cluster [DBG] pgmap v102: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-10T08:14:56.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:14:55.137798+0000 mgr.y (mgr.14146) 123 : cluster [DBG] pgmap v102: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-10T08:14:58.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:14:57.138199+0000 mgr.y (mgr.14146) 124 : cluster [DBG] pgmap v103: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-10T08:14:58.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:57.820334+0000 mon.a (mon.0) 342 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-10T08:14:58.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:14:57.821013+0000 mon.a (mon.0) 343 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:14:58.548 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:14:57.138199+0000 mgr.y (mgr.14146) 124 : cluster [DBG] pgmap v103: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-10T08:14:58.548 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:57.820334+0000 mon.a (mon.0) 342 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-10T08:14:58.548 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:14:57.821013+0000 mon.a (mon.0) 343 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:14:58.548 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:14:57.138199+0000 mgr.y (mgr.14146) 124 : cluster [DBG] pgmap v103: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-10T08:14:58.548 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:57.820334+0000 mon.a (mon.0) 342 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-10T08:14:58.548 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:14:57.821013+0000 mon.a (mon.0) 343 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:14:59.366 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:14:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cephadm 2024-02-10T08:14:57.821566+0000 mgr.y (mgr.14146) 125 : cephadm [INF] Deploying daemon osd.3 on smithi018 2024-02-10T08:14:59.366 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:14:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cephadm 2024-02-10T08:14:57.821566+0000 mgr.y (mgr.14146) 125 : cephadm [INF] Deploying daemon osd.3 on smithi018 2024-02-10T08:14:59.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:14:59 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cephadm 2024-02-10T08:14:57.821566+0000 mgr.y (mgr.14146) 125 : cephadm [INF] Deploying daemon osd.3 on smithi018 2024-02-10T08:15:00.358 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:14:59.138485+0000 mgr.y (mgr.14146) 126 : cluster [DBG] pgmap v104: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-10T08:15:00.358 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:14:59.138485+0000 mgr.y (mgr.14146) 126 : cluster [DBG] pgmap v104: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-10T08:15:00.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:14:59.138485+0000 mgr.y (mgr.14146) 126 : cluster [DBG] pgmap v104: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-10T08:15:02.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:15:01.138763+0000 mgr.y (mgr.14146) 127 : cluster [DBG] pgmap v105: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-10T08:15:02.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:15:01.138763+0000 mgr.y (mgr.14146) 127 : cluster [DBG] pgmap v105: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-10T08:15:02.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:15:01.138763+0000 mgr.y (mgr.14146) 127 : cluster [DBG] pgmap v105: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-10T08:15:04.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:15:03.139065+0000 mgr.y (mgr.14146) 128 : cluster [DBG] pgmap v106: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-10T08:15:04.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:03.156902+0000 mon.a (mon.0) 344 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:15:04.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:03.169696+0000 mon.a (mon.0) 345 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:15:04.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:15:03.139065+0000 mgr.y (mgr.14146) 128 : cluster [DBG] pgmap v106: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-10T08:15:04.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:03.156902+0000 mon.a (mon.0) 344 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:15:04.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:03.169696+0000 mon.a (mon.0) 345 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:15:04.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:15:03.139065+0000 mgr.y (mgr.14146) 128 : cluster [DBG] pgmap v106: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-10T08:15:04.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:03.156902+0000 mon.a (mon.0) 344 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:15:04.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:03.169696+0000 mon.a (mon.0) 345 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:15:06.233 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:15:05.139342+0000 mgr.y (mgr.14146) 129 : cluster [DBG] pgmap v107: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-10T08:15:06.233 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:15:05.139342+0000 mgr.y (mgr.14146) 129 : cluster [DBG] pgmap v107: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-10T08:15:06.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:15:05.139342+0000 mgr.y (mgr.14146) 129 : cluster [DBG] pgmap v107: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-10T08:15:06.836 INFO:teuthology.orchestra.run.smithi018.stdout:Created osd(s) 3 on host 'smithi018' 2024-02-10T08:15:07.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:06.019881+0000 mon.a (mon.0) 346 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:15:07.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:06.020820+0000 mon.a (mon.0) 347 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:15:07.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:06.021567+0000 mon.a (mon.0) 348 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:15:07.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:06.025884+0000 mon.a (mon.0) 349 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:15:07.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:06.235766+0000 mon.a (mon.0) 350 : audit [INF] from='osd.3 v2:172.21.15.18:6813/3484706437' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-10T08:15:07.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:06.834842+0000 mon.a (mon.0) 351 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:15:07.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:06.843928+0000 mon.a (mon.0) 352 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:15:07.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:06.019881+0000 mon.a (mon.0) 346 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:15:07.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:06.020820+0000 mon.a (mon.0) 347 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:15:07.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:06.021567+0000 mon.a (mon.0) 348 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:15:07.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:06.025884+0000 mon.a (mon.0) 349 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:15:07.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:06.235766+0000 mon.a (mon.0) 350 : audit [INF] from='osd.3 v2:172.21.15.18:6813/3484706437' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-10T08:15:07.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:06.834842+0000 mon.a (mon.0) 351 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:15:07.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:06.843928+0000 mon.a (mon.0) 352 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:15:07.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:06.019881+0000 mon.a (mon.0) 346 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:15:07.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:06.020820+0000 mon.a (mon.0) 347 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:15:07.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:06.021567+0000 mon.a (mon.0) 348 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:15:07.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:06.025884+0000 mon.a (mon.0) 349 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:15:07.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:06.235766+0000 mon.a (mon.0) 350 : audit [INF] from='osd.3 v2:172.21.15.18:6813/3484706437' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-10T08:15:07.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:06.834842+0000 mon.a (mon.0) 351 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:15:07.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:06.843928+0000 mon.a (mon.0) 352 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:15:07.640 DEBUG:teuthology.orchestra.run.smithi018:osd.3> sudo journalctl -f -n 0 -u ceph-d46257c8-c7eb-11ee-95b8-87774f69a715@osd.3.service 2024-02-10T08:15:07.642 INFO:tasks.cephadm:Deploying osd.4 on smithi071 with /dev/vg_nvme/lv_4... 2024-02-10T08:15:07.642 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-02-10T08:15:07.676 INFO:journalctl@ceph.osd.3.smithi018.stdout:-- Logs begin at Sat 2024-02-10 07:59:20 UTC. -- 2024-02-10T08:15:08.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:07.027540+0000 mon.a (mon.0) 353 : audit [INF] from='osd.3 v2:172.21.15.18:6813/3484706437' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-10T08:15:08.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:15:07.027593+0000 mon.a (mon.0) 354 : cluster [DBG] osdmap e23: 4 total, 3 up, 4 in 2024-02-10T08:15:08.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:07.027736+0000 mon.a (mon.0) 355 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-10T08:15:08.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:07.028103+0000 mon.a (mon.0) 356 : audit [INF] from='osd.3 v2:172.21.15.18:6813/3484706437' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-02-10T08:15:08.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:15:07.139599+0000 mgr.y (mgr.14146) 130 : cluster [DBG] pgmap v109: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-10T08:15:08.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:07.027540+0000 mon.a (mon.0) 353 : audit [INF] from='osd.3 v2:172.21.15.18:6813/3484706437' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-10T08:15:08.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:15:07.027593+0000 mon.a (mon.0) 354 : cluster [DBG] osdmap e23: 4 total, 3 up, 4 in 2024-02-10T08:15:08.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:07.027736+0000 mon.a (mon.0) 355 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-10T08:15:08.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:07.028103+0000 mon.a (mon.0) 356 : audit [INF] from='osd.3 v2:172.21.15.18:6813/3484706437' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-02-10T08:15:08.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:15:07.139599+0000 mgr.y (mgr.14146) 130 : cluster [DBG] pgmap v109: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-10T08:15:08.157 INFO:journalctl@ceph.osd.3.smithi018.stdout:Feb 10 08:15:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-3[63466]: debug 2024-02-10T08:15:08.032+0000 7f2fd59f8700 -1 osd.3 0 waiting for initial osdmap 2024-02-10T08:15:08.157 INFO:journalctl@ceph.osd.3.smithi018.stdout:Feb 10 08:15:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-3[63466]: debug 2024-02-10T08:15:08.036+0000 7f2fd0170700 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-10T08:15:08.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:07.027540+0000 mon.a (mon.0) 353 : audit [INF] from='osd.3 v2:172.21.15.18:6813/3484706437' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-10T08:15:08.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:15:07.027593+0000 mon.a (mon.0) 354 : cluster [DBG] osdmap e23: 4 total, 3 up, 4 in 2024-02-10T08:15:08.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:07.027736+0000 mon.a (mon.0) 355 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-10T08:15:08.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:07.028103+0000 mon.a (mon.0) 356 : audit [INF] from='osd.3 v2:172.21.15.18:6813/3484706437' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-02-10T08:15:08.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:15:07.139599+0000 mgr.y (mgr.14146) 130 : cluster [DBG] pgmap v109: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-10T08:15:09.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:08.028977+0000 mon.a (mon.0) 357 : audit [INF] from='osd.3 v2:172.21.15.18:6813/3484706437' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-02-10T08:15:09.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:15:08.029032+0000 mon.a (mon.0) 358 : cluster [DBG] osdmap e24: 4 total, 3 up, 4 in 2024-02-10T08:15:09.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:08.029464+0000 mon.a (mon.0) 359 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-10T08:15:09.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:08.034018+0000 mon.a (mon.0) 360 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-10T08:15:09.195 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:15:08.161226+0000 osd.0 (osd.0) 3 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:15:09.195 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:15:08.161298+0000 osd.0 (osd.0) 4 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:15:09.195 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:08.028977+0000 mon.a (mon.0) 357 : audit [INF] from='osd.3 v2:172.21.15.18:6813/3484706437' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-02-10T08:15:09.195 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:15:08.029032+0000 mon.a (mon.0) 358 : cluster [DBG] osdmap e24: 4 total, 3 up, 4 in 2024-02-10T08:15:09.195 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:08.029464+0000 mon.a (mon.0) 359 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-10T08:15:09.195 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:08.034018+0000 mon.a (mon.0) 360 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-10T08:15:09.195 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:15:08.161226+0000 osd.0 (osd.0) 3 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:15:09.195 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:15:08.161298+0000 osd.0 (osd.0) 4 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:15:09.260 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:08.028977+0000 mon.a (mon.0) 357 : audit [INF] from='osd.3 v2:172.21.15.18:6813/3484706437' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-02-10T08:15:09.260 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:15:08.029032+0000 mon.a (mon.0) 358 : cluster [DBG] osdmap e24: 4 total, 3 up, 4 in 2024-02-10T08:15:09.260 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:08.029464+0000 mon.a (mon.0) 359 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-10T08:15:09.261 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:08.034018+0000 mon.a (mon.0) 360 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-10T08:15:09.261 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:15:08.161226+0000 osd.0 (osd.0) 3 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:15:09.261 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:15:08.161298+0000 osd.0 (osd.0) 4 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:15:09.789 INFO:teuthology.orchestra.run.smithi071.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-02-10T08:15:09.789 INFO:teuthology.orchestra.run.smithi071.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-02-10T08:15:09.790 INFO:teuthology.orchestra.run.smithi071.stderr: stderr: 10+0 records in 2024-02-10T08:15:09.790 INFO:teuthology.orchestra.run.smithi071.stderr:10+0 records out 2024-02-10T08:15:09.790 INFO:teuthology.orchestra.run.smithi071.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0110609 s, 948 MB/s 2024-02-10T08:15:09.790 INFO:teuthology.orchestra.run.smithi071.stderr:--> Zapping successful for: 2024-02-10T08:15:10.164 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:15:07.277384+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:15:10.164 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:15:07.277466+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:15:10.164 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:15:09.034693+0000 mon.a (mon.0) 361 : cluster [INF] osd.3 v2:172.21.15.18:6813/3484706437 boot 2024-02-10T08:15:10.164 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:15:09.034722+0000 mon.a (mon.0) 362 : cluster [DBG] osdmap e25: 4 total, 4 up, 4 in 2024-02-10T08:15:10.164 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:09.035269+0000 mon.a (mon.0) 363 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-10T08:15:10.164 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:15:09.140002+0000 mgr.y (mgr.14146) 131 : cluster [DBG] pgmap v112: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-10T08:15:10.303 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:15:07.277384+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:15:10.303 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:15:07.277466+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:15:10.303 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:15:09.034693+0000 mon.a (mon.0) 361 : cluster [INF] osd.3 v2:172.21.15.18:6813/3484706437 boot 2024-02-10T08:15:10.303 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:15:09.034722+0000 mon.a (mon.0) 362 : cluster [DBG] osdmap e25: 4 total, 4 up, 4 in 2024-02-10T08:15:10.304 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:09.035269+0000 mon.a (mon.0) 363 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-10T08:15:10.304 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:15:09.140002+0000 mgr.y (mgr.14146) 131 : cluster [DBG] pgmap v112: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-10T08:15:10.304 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:15:07.277384+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:15:10.304 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:15:07.277466+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:15:10.304 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:15:09.034693+0000 mon.a (mon.0) 361 : cluster [INF] osd.3 v2:172.21.15.18:6813/3484706437 boot 2024-02-10T08:15:10.304 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:15:09.034722+0000 mon.a (mon.0) 362 : cluster [DBG] osdmap e25: 4 total, 4 up, 4 in 2024-02-10T08:15:10.304 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:09.035269+0000 mon.a (mon.0) 363 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-10T08:15:10.304 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:15:09.140002+0000 mgr.y (mgr.14146) 131 : cluster [DBG] pgmap v112: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-10T08:15:10.421 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph orch daemon add osd smithi071:vg_nvme/lv_4 2024-02-10T08:15:11.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:15:10.042361+0000 mon.a (mon.0) 364 : cluster [DBG] osdmap e26: 4 total, 4 up, 4 in 2024-02-10T08:15:11.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:10.900914+0000 mon.a (mon.0) 365 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:15:11.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:10.901866+0000 mon.a (mon.0) 366 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:15:11.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:10.902445+0000 mon.a (mon.0) 367 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:15:11.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:10.903001+0000 mon.a (mon.0) 368 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:15:11.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:10.903548+0000 mon.a (mon.0) 369 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:15:11.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:10.907686+0000 mon.a (mon.0) 370 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:15:11.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:10.909061+0000 mon.a (mon.0) 371 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:15:11.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:10.909608+0000 mon.a (mon.0) 372 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:15:11.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:10.913268+0000 mon.a (mon.0) 373 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:15:11.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:15:10.042361+0000 mon.a (mon.0) 364 : cluster [DBG] osdmap e26: 4 total, 4 up, 4 in 2024-02-10T08:15:11.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:10.900914+0000 mon.a (mon.0) 365 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:15:11.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:10.901866+0000 mon.a (mon.0) 366 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:15:11.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:10.902445+0000 mon.a (mon.0) 367 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:15:11.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:10.903001+0000 mon.a (mon.0) 368 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:15:11.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:10.903548+0000 mon.a (mon.0) 369 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:15:11.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:10.907686+0000 mon.a (mon.0) 370 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:15:11.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:10.909061+0000 mon.a (mon.0) 371 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:15:11.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:10.909608+0000 mon.a (mon.0) 372 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:15:11.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:10.913268+0000 mon.a (mon.0) 373 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:15:11.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:15:10.042361+0000 mon.a (mon.0) 364 : cluster [DBG] osdmap e26: 4 total, 4 up, 4 in 2024-02-10T08:15:11.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:10.900914+0000 mon.a (mon.0) 365 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:15:11.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:10.901866+0000 mon.a (mon.0) 366 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:15:11.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:10.902445+0000 mon.a (mon.0) 367 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:15:11.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:10.903001+0000 mon.a (mon.0) 368 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:15:11.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:10.903548+0000 mon.a (mon.0) 369 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:15:11.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:10.907686+0000 mon.a (mon.0) 370 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:15:11.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:10.909061+0000 mon.a (mon.0) 371 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:15:11.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:10.909608+0000 mon.a (mon.0) 372 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:15:11.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:10.913268+0000 mon.a (mon.0) 373 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:15:12.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cephadm 2024-02-10T08:15:10.896343+0000 mgr.y (mgr.14146) 132 : cephadm [INF] Detected new or changed devices on smithi018 2024-02-10T08:15:12.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cephadm 2024-02-10T08:15:10.903945+0000 mgr.y (mgr.14146) 133 : cephadm [INF] Adjusting osd_memory_target on smithi018 to 4025M 2024-02-10T08:15:12.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:15:11.140302+0000 mgr.y (mgr.14146) 134 : cluster [DBG] pgmap v114: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-10T08:15:12.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cephadm 2024-02-10T08:15:10.896343+0000 mgr.y (mgr.14146) 132 : cephadm [INF] Detected new or changed devices on smithi018 2024-02-10T08:15:12.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cephadm 2024-02-10T08:15:10.903945+0000 mgr.y (mgr.14146) 133 : cephadm [INF] Adjusting osd_memory_target on smithi018 to 4025M 2024-02-10T08:15:12.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:15:11.140302+0000 mgr.y (mgr.14146) 134 : cluster [DBG] pgmap v114: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-10T08:15:12.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cephadm 2024-02-10T08:15:10.896343+0000 mgr.y (mgr.14146) 132 : cephadm [INF] Detected new or changed devices on smithi018 2024-02-10T08:15:12.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cephadm 2024-02-10T08:15:10.903945+0000 mgr.y (mgr.14146) 133 : cephadm [INF] Adjusting osd_memory_target on smithi018 to 4025M 2024-02-10T08:15:12.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:15:11.140302+0000 mgr.y (mgr.14146) 134 : cluster [DBG] pgmap v114: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-10T08:15:13.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:12.418274+0000 mgr.y (mgr.14146) 135 : audit [DBG] from='client.24196 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:15:13.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:12.420865+0000 mon.a (mon.0) 374 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-10T08:15:13.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:12.423248+0000 mon.a (mon.0) 375 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-10T08:15:13.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:12.424068+0000 mon.a (mon.0) 376 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:15:13.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:12.418274+0000 mgr.y (mgr.14146) 135 : audit [DBG] from='client.24196 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:15:13.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:12.420865+0000 mon.a (mon.0) 374 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-10T08:15:13.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:12.423248+0000 mon.a (mon.0) 375 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-10T08:15:13.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:12.424068+0000 mon.a (mon.0) 376 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:15:13.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:12.418274+0000 mgr.y (mgr.14146) 135 : audit [DBG] from='client.24196 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:15:13.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:12.420865+0000 mon.a (mon.0) 374 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-10T08:15:13.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:12.423248+0000 mon.a (mon.0) 375 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-10T08:15:13.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:12.424068+0000 mon.a (mon.0) 376 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:15:14.130 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:15:13.140825+0000 mgr.y (mgr.14146) 136 : cluster [DBG] pgmap v115: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-10T08:15:14.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:15:13.140825+0000 mgr.y (mgr.14146) 136 : cluster [DBG] pgmap v115: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-10T08:15:14.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:15:13.140825+0000 mgr.y (mgr.14146) 136 : cluster [DBG] pgmap v115: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-10T08:15:15.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:14.838926+0000 mon.b (mon.1) 8 : audit [INF] from='client.? 172.21.15.71:0/2110209165' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f5708f20-f98d-4d12-b8ae-71a5049a14cc"}]: dispatch 2024-02-10T08:15:15.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:14.839442+0000 mon.a (mon.0) 377 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f5708f20-f98d-4d12-b8ae-71a5049a14cc"}]: dispatch 2024-02-10T08:15:15.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:14.844289+0000 mon.a (mon.0) 378 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f5708f20-f98d-4d12-b8ae-71a5049a14cc"}]': finished 2024-02-10T08:15:15.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:15:14.844350+0000 mon.a (mon.0) 379 : cluster [DBG] osdmap e27: 5 total, 4 up, 5 in 2024-02-10T08:15:15.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:14.844539+0000 mon.a (mon.0) 380 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-10T08:15:15.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:14.838926+0000 mon.b (mon.1) 8 : audit [INF] from='client.? 172.21.15.71:0/2110209165' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f5708f20-f98d-4d12-b8ae-71a5049a14cc"}]: dispatch 2024-02-10T08:15:15.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:14.839442+0000 mon.a (mon.0) 377 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f5708f20-f98d-4d12-b8ae-71a5049a14cc"}]: dispatch 2024-02-10T08:15:15.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:14.844289+0000 mon.a (mon.0) 378 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f5708f20-f98d-4d12-b8ae-71a5049a14cc"}]': finished 2024-02-10T08:15:15.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:15:14.844350+0000 mon.a (mon.0) 379 : cluster [DBG] osdmap e27: 5 total, 4 up, 5 in 2024-02-10T08:15:15.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:14.844539+0000 mon.a (mon.0) 380 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-10T08:15:15.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:14.838926+0000 mon.b (mon.1) 8 : audit [INF] from='client.? 172.21.15.71:0/2110209165' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f5708f20-f98d-4d12-b8ae-71a5049a14cc"}]: dispatch 2024-02-10T08:15:15.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:14.839442+0000 mon.a (mon.0) 377 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f5708f20-f98d-4d12-b8ae-71a5049a14cc"}]: dispatch 2024-02-10T08:15:15.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:14.844289+0000 mon.a (mon.0) 378 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f5708f20-f98d-4d12-b8ae-71a5049a14cc"}]': finished 2024-02-10T08:15:15.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:15:14.844350+0000 mon.a (mon.0) 379 : cluster [DBG] osdmap e27: 5 total, 4 up, 5 in 2024-02-10T08:15:15.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:14.844539+0000 mon.a (mon.0) 380 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-10T08:15:16.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:15:15.141193+0000 mgr.y (mgr.14146) 137 : cluster [DBG] pgmap v117: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-10T08:15:16.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:15.449074+0000 mon.b (mon.1) 9 : audit [DBG] from='client.? 172.21.15.71:0/648674679' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-10T08:15:16.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:15:15.141193+0000 mgr.y (mgr.14146) 137 : cluster [DBG] pgmap v117: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-10T08:15:16.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:15.449074+0000 mon.b (mon.1) 9 : audit [DBG] from='client.? 172.21.15.71:0/648674679' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-10T08:15:16.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:15:15.141193+0000 mgr.y (mgr.14146) 137 : cluster [DBG] pgmap v117: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-10T08:15:16.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:15.449074+0000 mon.b (mon.1) 9 : audit [DBG] from='client.? 172.21.15.71:0/648674679' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-10T08:15:18.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:15:17.141625+0000 mgr.y (mgr.14146) 138 : cluster [DBG] pgmap v118: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-10T08:15:18.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:15:17.141625+0000 mgr.y (mgr.14146) 138 : cluster [DBG] pgmap v118: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-10T08:15:18.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:15:17.141625+0000 mgr.y (mgr.14146) 138 : cluster [DBG] pgmap v118: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-10T08:15:20.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:15:19.142131+0000 mgr.y (mgr.14146) 139 : cluster [DBG] pgmap v119: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-10T08:15:20.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:15:19.142131+0000 mgr.y (mgr.14146) 139 : cluster [DBG] pgmap v119: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-10T08:15:20.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:15:19.142131+0000 mgr.y (mgr.14146) 139 : cluster [DBG] pgmap v119: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-10T08:15:21.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:21.084190+0000 mon.a (mon.0) 381 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-10T08:15:21.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:21.085063+0000 mon.a (mon.0) 382 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:15:21.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:21.084190+0000 mon.a (mon.0) 381 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-10T08:15:21.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:21.085063+0000 mon.a (mon.0) 382 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:15:21.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:21.084190+0000 mon.a (mon.0) 381 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-10T08:15:21.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:21.085063+0000 mon.a (mon.0) 382 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:15:22.396 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cephadm 2024-02-10T08:15:21.085793+0000 mgr.y (mgr.14146) 140 : cephadm [INF] Deploying daemon osd.4 on smithi071 2024-02-10T08:15:22.397 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:15:21.142549+0000 mgr.y (mgr.14146) 141 : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-10T08:15:22.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cephadm 2024-02-10T08:15:21.085793+0000 mgr.y (mgr.14146) 140 : cephadm [INF] Deploying daemon osd.4 on smithi071 2024-02-10T08:15:22.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:15:21.142549+0000 mgr.y (mgr.14146) 141 : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-10T08:15:22.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cephadm 2024-02-10T08:15:21.085793+0000 mgr.y (mgr.14146) 140 : cephadm [INF] Deploying daemon osd.4 on smithi071 2024-02-10T08:15:22.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:15:21.142549+0000 mgr.y (mgr.14146) 141 : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-10T08:15:24.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:15:23.142997+0000 mgr.y (mgr.14146) 142 : cluster [DBG] pgmap v121: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-10T08:15:24.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:15:23.142997+0000 mgr.y (mgr.14146) 142 : cluster [DBG] pgmap v121: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-10T08:15:24.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:15:23.142997+0000 mgr.y (mgr.14146) 142 : cluster [DBG] pgmap v121: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-10T08:15:25.959 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:15:25.143411+0000 mgr.y (mgr.14146) 143 : cluster [DBG] pgmap v122: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-10T08:15:26.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:15:25.143411+0000 mgr.y (mgr.14146) 143 : cluster [DBG] pgmap v122: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-10T08:15:26.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:15:25.143411+0000 mgr.y (mgr.14146) 143 : cluster [DBG] pgmap v122: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-10T08:15:27.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:26.002611+0000 mon.a (mon.0) 383 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:15:27.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:26.016977+0000 mon.a (mon.0) 384 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:15:27.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:26.002611+0000 mon.a (mon.0) 383 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:15:27.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:26.016977+0000 mon.a (mon.0) 384 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:15:27.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:26.002611+0000 mon.a (mon.0) 383 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:15:27.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:26.016977+0000 mon.a (mon.0) 384 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:15:28.281 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:15:27.143873+0000 mgr.y (mgr.14146) 144 : cluster [DBG] pgmap v123: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-10T08:15:28.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:15:27.143873+0000 mgr.y (mgr.14146) 144 : cluster [DBG] pgmap v123: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-10T08:15:28.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:15:27.143873+0000 mgr.y (mgr.14146) 144 : cluster [DBG] pgmap v123: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-10T08:15:29.340 INFO:teuthology.orchestra.run.smithi071.stdout:Created osd(s) 4 on host 'smithi071' 2024-02-10T08:15:29.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:28.317338+0000 mon.a (mon.0) 385 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:15:29.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:28.318165+0000 mon.a (mon.0) 386 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:15:29.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:28.319090+0000 mon.a (mon.0) 387 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:15:29.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:28.324463+0000 mon.a (mon.0) 388 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:15:29.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:15:28.352506+0000 osd.1 (osd.1) 3 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:15:29.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:15:28.352585+0000 osd.1 (osd.1) 4 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:15:29.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:29.095334+0000 mon.b (mon.1) 10 : audit [INF] from='osd.4 v2:172.21.15.71:6800/1598114798' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-10T08:15:29.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:29.095747+0000 mon.a (mon.0) 389 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-10T08:15:29.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:28.317338+0000 mon.a (mon.0) 385 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:15:29.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:28.318165+0000 mon.a (mon.0) 386 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:15:29.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:28.319090+0000 mon.a (mon.0) 387 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:15:29.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:28.324463+0000 mon.a (mon.0) 388 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:15:29.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:15:28.352506+0000 osd.1 (osd.1) 3 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:15:29.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:15:28.352585+0000 osd.1 (osd.1) 4 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:15:29.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:29.095334+0000 mon.b (mon.1) 10 : audit [INF] from='osd.4 v2:172.21.15.71:6800/1598114798' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-10T08:15:29.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:29.095747+0000 mon.a (mon.0) 389 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-10T08:15:29.686 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:28.317338+0000 mon.a (mon.0) 385 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:15:29.686 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:28.318165+0000 mon.a (mon.0) 386 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:15:29.686 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:28.319090+0000 mon.a (mon.0) 387 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:15:29.686 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:28.324463+0000 mon.a (mon.0) 388 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:15:29.686 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:15:28.352506+0000 osd.1 (osd.1) 3 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:15:29.686 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:15:28.352585+0000 osd.1 (osd.1) 4 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:15:29.686 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:29.095334+0000 mon.b (mon.1) 10 : audit [INF] from='osd.4 v2:172.21.15.71:6800/1598114798' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-10T08:15:29.686 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:29.095747+0000 mon.a (mon.0) 389 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-10T08:15:29.982 DEBUG:teuthology.orchestra.run.smithi071:osd.4> sudo journalctl -f -n 0 -u ceph-d46257c8-c7eb-11ee-95b8-87774f69a715@osd.4.service 2024-02-10T08:15:29.984 INFO:tasks.cephadm:Deploying osd.5 on smithi071 with /dev/vg_nvme/lv_3... 2024-02-10T08:15:29.984 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-02-10T08:15:30.015 INFO:journalctl@ceph.osd.4.smithi071.stdout:-- Logs begin at Sat 2024-02-10 07:59:38 UTC. -- 2024-02-10T08:15:30.501 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:15:29.144394+0000 mgr.y (mgr.14146) 145 : cluster [DBG] pgmap v124: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-10T08:15:30.501 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:29.330132+0000 mon.a (mon.0) 390 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-10T08:15:30.501 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:15:29.330238+0000 mon.a (mon.0) 391 : cluster [DBG] osdmap e28: 5 total, 4 up, 5 in 2024-02-10T08:15:30.501 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:29.330397+0000 mon.a (mon.0) 392 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-10T08:15:30.502 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:29.332644+0000 mon.b (mon.1) 11 : audit [INF] from='osd.4 v2:172.21.15.71:6800/1598114798' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-02-10T08:15:30.502 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:29.333239+0000 mon.a (mon.0) 393 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-02-10T08:15:30.502 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:29.339023+0000 mon.a (mon.0) 394 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:15:30.502 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:29.343349+0000 mon.a (mon.0) 395 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:15:30.502 INFO:journalctl@ceph.osd.4.smithi071.stdout:Feb 10 08:15:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-4[44981]: debug 2024-02-10T08:15:30.337+0000 7fd9ba71f700 -1 osd.4 0 waiting for initial osdmap 2024-02-10T08:15:30.502 INFO:journalctl@ceph.osd.4.smithi071.stdout:Feb 10 08:15:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-4[44981]: debug 2024-02-10T08:15:30.342+0000 7fd9b5698700 -1 osd.4 29 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-10T08:15:30.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:15:29.144394+0000 mgr.y (mgr.14146) 145 : cluster [DBG] pgmap v124: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-10T08:15:30.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:29.330132+0000 mon.a (mon.0) 390 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-10T08:15:30.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:15:29.330238+0000 mon.a (mon.0) 391 : cluster [DBG] osdmap e28: 5 total, 4 up, 5 in 2024-02-10T08:15:30.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:29.330397+0000 mon.a (mon.0) 392 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-10T08:15:30.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:29.332644+0000 mon.b (mon.1) 11 : audit [INF] from='osd.4 v2:172.21.15.71:6800/1598114798' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-02-10T08:15:30.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:29.333239+0000 mon.a (mon.0) 393 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-02-10T08:15:30.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:29.339023+0000 mon.a (mon.0) 394 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:15:30.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:29.343349+0000 mon.a (mon.0) 395 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:15:30.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:15:29.144394+0000 mgr.y (mgr.14146) 145 : cluster [DBG] pgmap v124: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-10T08:15:30.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:29.330132+0000 mon.a (mon.0) 390 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-10T08:15:30.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:15:29.330238+0000 mon.a (mon.0) 391 : cluster [DBG] osdmap e28: 5 total, 4 up, 5 in 2024-02-10T08:15:30.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:29.330397+0000 mon.a (mon.0) 392 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-10T08:15:30.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:29.332644+0000 mon.b (mon.1) 11 : audit [INF] from='osd.4 v2:172.21.15.71:6800/1598114798' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-02-10T08:15:30.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:29.333239+0000 mon.a (mon.0) 393 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-02-10T08:15:30.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:29.339023+0000 mon.a (mon.0) 394 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:15:30.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:29.343349+0000 mon.a (mon.0) 395 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:15:31.653 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:30.332694+0000 mon.a (mon.0) 396 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-02-10T08:15:31.653 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:15:30.332779+0000 mon.a (mon.0) 397 : cluster [DBG] osdmap e29: 5 total, 4 up, 5 in 2024-02-10T08:15:31.653 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:30.333282+0000 mon.a (mon.0) 398 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-10T08:15:31.653 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:30.337189+0000 mon.a (mon.0) 399 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-10T08:15:31.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:30.332694+0000 mon.a (mon.0) 396 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-02-10T08:15:31.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:15:30.332779+0000 mon.a (mon.0) 397 : cluster [DBG] osdmap e29: 5 total, 4 up, 5 in 2024-02-10T08:15:31.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:30.333282+0000 mon.a (mon.0) 398 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-10T08:15:31.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:30.337189+0000 mon.a (mon.0) 399 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-10T08:15:31.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:30.332694+0000 mon.a (mon.0) 396 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-02-10T08:15:31.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:15:30.332779+0000 mon.a (mon.0) 397 : cluster [DBG] osdmap e29: 5 total, 4 up, 5 in 2024-02-10T08:15:31.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:30.333282+0000 mon.a (mon.0) 398 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-10T08:15:31.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:30.337189+0000 mon.a (mon.0) 399 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-10T08:15:32.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:15:30.130243+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:15:32.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:15:30.130290+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:15:32.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:15:31.144906+0000 mgr.y (mgr.14146) 146 : cluster [DBG] pgmap v127: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-10T08:15:32.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:15:31.334145+0000 mon.a (mon.0) 400 : cluster [INF] osd.4 v2:172.21.15.71:6800/1598114798 boot 2024-02-10T08:15:32.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:15:31.334201+0000 mon.a (mon.0) 401 : cluster [DBG] osdmap e30: 5 total, 5 up, 5 in 2024-02-10T08:15:32.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:31.334389+0000 mon.a (mon.0) 402 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-10T08:15:32.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:15:32.334955+0000 mon.a (mon.0) 403 : cluster [DBG] osdmap e31: 5 total, 5 up, 5 in 2024-02-10T08:15:32.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:15:30.130243+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:15:32.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:15:30.130290+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:15:32.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:15:31.144906+0000 mgr.y (mgr.14146) 146 : cluster [DBG] pgmap v127: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-10T08:15:32.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:15:31.334145+0000 mon.a (mon.0) 400 : cluster [INF] osd.4 v2:172.21.15.71:6800/1598114798 boot 2024-02-10T08:15:32.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:15:31.334201+0000 mon.a (mon.0) 401 : cluster [DBG] osdmap e30: 5 total, 5 up, 5 in 2024-02-10T08:15:32.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:31.334389+0000 mon.a (mon.0) 402 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-10T08:15:32.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:15:32.334955+0000 mon.a (mon.0) 403 : cluster [DBG] osdmap e31: 5 total, 5 up, 5 in 2024-02-10T08:15:32.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:15:30.130243+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:15:32.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:15:30.130290+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:15:32.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:15:31.144906+0000 mgr.y (mgr.14146) 146 : cluster [DBG] pgmap v127: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-10T08:15:32.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:15:31.334145+0000 mon.a (mon.0) 400 : cluster [INF] osd.4 v2:172.21.15.71:6800/1598114798 boot 2024-02-10T08:15:32.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:15:31.334201+0000 mon.a (mon.0) 401 : cluster [DBG] osdmap e30: 5 total, 5 up, 5 in 2024-02-10T08:15:32.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:31.334389+0000 mon.a (mon.0) 402 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-10T08:15:32.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:15:32.334955+0000 mon.a (mon.0) 403 : cluster [DBG] osdmap e31: 5 total, 5 up, 5 in 2024-02-10T08:15:32.894 INFO:teuthology.orchestra.run.smithi071.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-02-10T08:15:32.894 INFO:teuthology.orchestra.run.smithi071.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-02-10T08:15:32.894 INFO:teuthology.orchestra.run.smithi071.stderr: stderr: 10+0 records in 2024-02-10T08:15:32.894 INFO:teuthology.orchestra.run.smithi071.stderr:10+0 records out 2024-02-10T08:15:32.895 INFO:teuthology.orchestra.run.smithi071.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0134262 s, 781 MB/s 2024-02-10T08:15:32.895 INFO:teuthology.orchestra.run.smithi071.stderr:--> Zapping successful for: 2024-02-10T08:15:33.742 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph orch daemon add osd smithi071:vg_nvme/lv_3 2024-02-10T08:15:34.605 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:15:33.145222+0000 mgr.y (mgr.14146) 147 : cluster [DBG] pgmap v130: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-10T08:15:34.605 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:15:33.336344+0000 mon.a (mon.0) 404 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2024-02-10T08:15:34.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:15:33.145222+0000 mgr.y (mgr.14146) 147 : cluster [DBG] pgmap v130: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-10T08:15:34.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:15:33.336344+0000 mon.a (mon.0) 404 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2024-02-10T08:15:34.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:15:33.145222+0000 mgr.y (mgr.14146) 147 : cluster [DBG] pgmap v130: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-10T08:15:34.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:15:33.336344+0000 mon.a (mon.0) 404 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2024-02-10T08:15:35.732 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cephadm 2024-02-10T08:15:34.622291+0000 mgr.y (mgr.14146) 148 : cephadm [INF] Detected new or changed devices on smithi071 2024-02-10T08:15:35.732 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:34.627004+0000 mon.a (mon.0) 405 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:15:35.733 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:34.627974+0000 mon.a (mon.0) 406 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:15:35.733 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cephadm 2024-02-10T08:15:34.628628+0000 mgr.y (mgr.14146) 149 : cephadm [INF] Adjusting osd_memory_target on smithi071 to 17122M 2024-02-10T08:15:35.733 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:34.632460+0000 mon.a (mon.0) 407 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:15:35.733 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:34.633597+0000 mon.a (mon.0) 408 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:15:35.733 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:34.634457+0000 mon.a (mon.0) 409 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:15:35.733 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:34.639188+0000 mon.a (mon.0) 410 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:15:35.733 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:15:35.145537+0000 mgr.y (mgr.14146) 150 : cluster [DBG] pgmap v132: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-10T08:15:35.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cephadm 2024-02-10T08:15:34.622291+0000 mgr.y (mgr.14146) 148 : cephadm [INF] Detected new or changed devices on smithi071 2024-02-10T08:15:35.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:34.627004+0000 mon.a (mon.0) 405 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:15:35.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:34.627974+0000 mon.a (mon.0) 406 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:15:35.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cephadm 2024-02-10T08:15:34.628628+0000 mgr.y (mgr.14146) 149 : cephadm [INF] Adjusting osd_memory_target on smithi071 to 17122M 2024-02-10T08:15:35.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:34.632460+0000 mon.a (mon.0) 407 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:15:35.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:34.633597+0000 mon.a (mon.0) 408 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:15:35.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:34.634457+0000 mon.a (mon.0) 409 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:15:35.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:34.639188+0000 mon.a (mon.0) 410 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:15:35.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:15:35.145537+0000 mgr.y (mgr.14146) 150 : cluster [DBG] pgmap v132: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-10T08:15:35.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cephadm 2024-02-10T08:15:34.622291+0000 mgr.y (mgr.14146) 148 : cephadm [INF] Detected new or changed devices on smithi071 2024-02-10T08:15:35.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:34.627004+0000 mon.a (mon.0) 405 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:15:35.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:34.627974+0000 mon.a (mon.0) 406 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:15:35.906 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cephadm 2024-02-10T08:15:34.628628+0000 mgr.y (mgr.14146) 149 : cephadm [INF] Adjusting osd_memory_target on smithi071 to 17122M 2024-02-10T08:15:35.906 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:34.632460+0000 mon.a (mon.0) 407 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:15:35.906 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:34.633597+0000 mon.a (mon.0) 408 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:15:35.906 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:34.634457+0000 mon.a (mon.0) 409 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:15:35.906 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:34.639188+0000 mon.a (mon.0) 410 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:15:35.906 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:15:35.145537+0000 mgr.y (mgr.14146) 150 : cluster [DBG] pgmap v132: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-10T08:15:37.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:36.168104+0000 mgr.y (mgr.14146) 151 : audit [DBG] from='client.24223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:15:37.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:36.170451+0000 mon.a (mon.0) 411 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-10T08:15:37.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:36.172815+0000 mon.a (mon.0) 412 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-10T08:15:37.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:36.173584+0000 mon.a (mon.0) 413 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:15:37.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:36.168104+0000 mgr.y (mgr.14146) 151 : audit [DBG] from='client.24223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:15:37.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:36.170451+0000 mon.a (mon.0) 411 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-10T08:15:37.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:36.172815+0000 mon.a (mon.0) 412 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-10T08:15:37.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:36.173584+0000 mon.a (mon.0) 413 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:15:37.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:36.168104+0000 mgr.y (mgr.14146) 151 : audit [DBG] from='client.24223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:15:37.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:36.170451+0000 mon.a (mon.0) 411 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-10T08:15:37.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:36.172815+0000 mon.a (mon.0) 412 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-10T08:15:37.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:36.173584+0000 mon.a (mon.0) 413 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:15:38.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:15:37.145883+0000 mgr.y (mgr.14146) 152 : cluster [DBG] pgmap v133: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-10T08:15:38.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:15:37.145883+0000 mgr.y (mgr.14146) 152 : cluster [DBG] pgmap v133: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-10T08:15:38.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:15:37.145883+0000 mgr.y (mgr.14146) 152 : cluster [DBG] pgmap v133: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-10T08:15:39.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:38.611534+0000 mon.b (mon.1) 12 : audit [INF] from='client.? 172.21.15.71:0/379711134' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e36a71dd-5088-4bff-965e-7dc8708ef7e3"}]: dispatch 2024-02-10T08:15:39.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:38.612108+0000 mon.a (mon.0) 414 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e36a71dd-5088-4bff-965e-7dc8708ef7e3"}]: dispatch 2024-02-10T08:15:39.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:38.616678+0000 mon.a (mon.0) 415 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e36a71dd-5088-4bff-965e-7dc8708ef7e3"}]': finished 2024-02-10T08:15:39.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:15:38.616763+0000 mon.a (mon.0) 416 : cluster [DBG] osdmap e33: 6 total, 5 up, 6 in 2024-02-10T08:15:39.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:38.616912+0000 mon.a (mon.0) 417 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-10T08:15:39.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:38.611534+0000 mon.b (mon.1) 12 : audit [INF] from='client.? 172.21.15.71:0/379711134' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e36a71dd-5088-4bff-965e-7dc8708ef7e3"}]: dispatch 2024-02-10T08:15:39.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:38.612108+0000 mon.a (mon.0) 414 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e36a71dd-5088-4bff-965e-7dc8708ef7e3"}]: dispatch 2024-02-10T08:15:39.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:38.616678+0000 mon.a (mon.0) 415 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e36a71dd-5088-4bff-965e-7dc8708ef7e3"}]': finished 2024-02-10T08:15:39.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:15:38.616763+0000 mon.a (mon.0) 416 : cluster [DBG] osdmap e33: 6 total, 5 up, 6 in 2024-02-10T08:15:39.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:38.616912+0000 mon.a (mon.0) 417 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-10T08:15:39.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:38.611534+0000 mon.b (mon.1) 12 : audit [INF] from='client.? 172.21.15.71:0/379711134' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e36a71dd-5088-4bff-965e-7dc8708ef7e3"}]: dispatch 2024-02-10T08:15:39.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:38.612108+0000 mon.a (mon.0) 414 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e36a71dd-5088-4bff-965e-7dc8708ef7e3"}]: dispatch 2024-02-10T08:15:39.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:38.616678+0000 mon.a (mon.0) 415 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e36a71dd-5088-4bff-965e-7dc8708ef7e3"}]': finished 2024-02-10T08:15:39.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:15:38.616763+0000 mon.a (mon.0) 416 : cluster [DBG] osdmap e33: 6 total, 5 up, 6 in 2024-02-10T08:15:39.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:38.616912+0000 mon.a (mon.0) 417 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-10T08:15:40.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:15:39.146273+0000 mgr.y (mgr.14146) 153 : cluster [DBG] pgmap v135: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-10T08:15:40.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:39.209227+0000 mon.b (mon.1) 13 : audit [DBG] from='client.? 172.21.15.71:0/2508931056' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-10T08:15:40.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:15:39.146273+0000 mgr.y (mgr.14146) 153 : cluster [DBG] pgmap v135: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-10T08:15:40.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:39.209227+0000 mon.b (mon.1) 13 : audit [DBG] from='client.? 172.21.15.71:0/2508931056' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-10T08:15:40.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:15:39.146273+0000 mgr.y (mgr.14146) 153 : cluster [DBG] pgmap v135: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-10T08:15:40.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:39.209227+0000 mon.b (mon.1) 13 : audit [DBG] from='client.? 172.21.15.71:0/2508931056' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-10T08:15:42.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:15:41.146694+0000 mgr.y (mgr.14146) 154 : cluster [DBG] pgmap v136: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-10T08:15:42.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:15:41.146694+0000 mgr.y (mgr.14146) 154 : cluster [DBG] pgmap v136: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-10T08:15:42.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:15:41.146694+0000 mgr.y (mgr.14146) 154 : cluster [DBG] pgmap v136: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-10T08:15:44.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:44 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:15:42.732274+0000 osd.2 (osd.2) 3 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:15:44.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:44 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:15:42.732393+0000 osd.2 (osd.2) 4 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:15:44.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:44 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:15:43.147094+0000 mgr.y (mgr.14146) 155 : cluster [DBG] pgmap v137: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-10T08:15:44.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:44 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:15:43.207555+0000 mon.a (mon.0) 418 : cluster [DBG] osdmap e34: 6 total, 5 up, 6 in 2024-02-10T08:15:44.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:44 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:43.207720+0000 mon.a (mon.0) 419 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-10T08:15:44.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:15:42.732274+0000 osd.2 (osd.2) 3 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:15:44.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:15:42.732393+0000 osd.2 (osd.2) 4 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:15:44.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:15:43.147094+0000 mgr.y (mgr.14146) 155 : cluster [DBG] pgmap v137: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-10T08:15:44.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:15:43.207555+0000 mon.a (mon.0) 418 : cluster [DBG] osdmap e34: 6 total, 5 up, 6 in 2024-02-10T08:15:44.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:43.207720+0000 mon.a (mon.0) 419 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-10T08:15:44.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:15:42.732274+0000 osd.2 (osd.2) 3 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:15:44.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:15:42.732393+0000 osd.2 (osd.2) 4 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:15:44.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:15:43.147094+0000 mgr.y (mgr.14146) 155 : cluster [DBG] pgmap v137: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-10T08:15:44.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:15:43.207555+0000 mon.a (mon.0) 418 : cluster [DBG] osdmap e34: 6 total, 5 up, 6 in 2024-02-10T08:15:44.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:43.207720+0000 mon.a (mon.0) 419 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-10T08:15:46.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:44.937643+0000 mon.a (mon.0) 420 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-10T08:15:46.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:44.938587+0000 mon.a (mon.0) 421 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:15:46.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cephadm 2024-02-10T08:15:44.939345+0000 mgr.y (mgr.14146) 156 : cephadm [INF] Deploying daemon osd.5 on smithi071 2024-02-10T08:15:46.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:15:45.147597+0000 mgr.y (mgr.14146) 157 : cluster [DBG] pgmap v139: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-10T08:15:46.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:44.937643+0000 mon.a (mon.0) 420 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-10T08:15:46.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:44.938587+0000 mon.a (mon.0) 421 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:15:46.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cephadm 2024-02-10T08:15:44.939345+0000 mgr.y (mgr.14146) 156 : cephadm [INF] Deploying daemon osd.5 on smithi071 2024-02-10T08:15:46.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:15:45.147597+0000 mgr.y (mgr.14146) 157 : cluster [DBG] pgmap v139: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-10T08:15:46.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:44.937643+0000 mon.a (mon.0) 420 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-10T08:15:46.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:44.938587+0000 mon.a (mon.0) 421 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:15:46.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cephadm 2024-02-10T08:15:44.939345+0000 mgr.y (mgr.14146) 156 : cephadm [INF] Deploying daemon osd.5 on smithi071 2024-02-10T08:15:46.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:15:45.147597+0000 mgr.y (mgr.14146) 157 : cluster [DBG] pgmap v139: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-10T08:15:48.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:15:47.148005+0000 mgr.y (mgr.14146) 158 : cluster [DBG] pgmap v140: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-10T08:15:48.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:15:47.148005+0000 mgr.y (mgr.14146) 158 : cluster [DBG] pgmap v140: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-10T08:15:48.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:15:47.148005+0000 mgr.y (mgr.14146) 158 : cluster [DBG] pgmap v140: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-10T08:15:50.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:15:49.148401+0000 mgr.y (mgr.14146) 159 : cluster [DBG] pgmap v141: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-10T08:15:50.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:50.078661+0000 mon.a (mon.0) 422 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:15:50.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:50.095775+0000 mon.a (mon.0) 423 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:15:50.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:15:49.148401+0000 mgr.y (mgr.14146) 159 : cluster [DBG] pgmap v141: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-10T08:15:50.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:50.078661+0000 mon.a (mon.0) 422 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:15:50.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:50.095775+0000 mon.a (mon.0) 423 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:15:50.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:15:49.148401+0000 mgr.y (mgr.14146) 159 : cluster [DBG] pgmap v141: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-10T08:15:50.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:50.078661+0000 mon.a (mon.0) 422 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:15:50.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:50.095775+0000 mon.a (mon.0) 423 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:15:52.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:52 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:15:51.148840+0000 mgr.y (mgr.14146) 160 : cluster [DBG] pgmap v142: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-10T08:15:52.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:15:51.148840+0000 mgr.y (mgr.14146) 160 : cluster [DBG] pgmap v142: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-10T08:15:52.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:15:51.148840+0000 mgr.y (mgr.14146) 160 : cluster [DBG] pgmap v142: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-10T08:15:53.416 INFO:teuthology.orchestra.run.smithi071.stdout:Created osd(s) 5 on host 'smithi071' 2024-02-10T08:15:53.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:52.364264+0000 mon.a (mon.0) 424 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:15:53.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:52.370161+0000 mon.a (mon.0) 425 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:15:53.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:52.371046+0000 mon.a (mon.0) 426 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:15:53.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:52.375608+0000 mon.a (mon.0) 427 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:15:53.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:53.223219+0000 mon.b (mon.1) 14 : audit [INF] from='osd.5 v2:172.21.15.71:6804/1932648316' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-10T08:15:53.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:53.223515+0000 mon.a (mon.0) 428 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-10T08:15:53.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:52.364264+0000 mon.a (mon.0) 424 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:15:53.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:52.370161+0000 mon.a (mon.0) 425 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:15:53.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:52.371046+0000 mon.a (mon.0) 426 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:15:53.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:52.375608+0000 mon.a (mon.0) 427 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:15:53.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:53.223219+0000 mon.b (mon.1) 14 : audit [INF] from='osd.5 v2:172.21.15.71:6804/1932648316' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-10T08:15:53.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:53.223515+0000 mon.a (mon.0) 428 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-10T08:15:53.746 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:53 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:52.364264+0000 mon.a (mon.0) 424 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:15:53.747 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:53 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:52.370161+0000 mon.a (mon.0) 425 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:15:53.747 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:53 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:52.371046+0000 mon.a (mon.0) 426 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:15:53.747 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:53 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:52.375608+0000 mon.a (mon.0) 427 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:15:53.747 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:53 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:53.223219+0000 mon.b (mon.1) 14 : audit [INF] from='osd.5 v2:172.21.15.71:6804/1932648316' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-10T08:15:53.747 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:53 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:53.223515+0000 mon.a (mon.0) 428 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-10T08:15:54.071 DEBUG:teuthology.orchestra.run.smithi071:osd.5> sudo journalctl -f -n 0 -u ceph-d46257c8-c7eb-11ee-95b8-87774f69a715@osd.5.service 2024-02-10T08:15:54.073 INFO:tasks.cephadm:Deploying osd.6 on smithi071 with /dev/vg_nvme/lv_2... 2024-02-10T08:15:54.073 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-02-10T08:15:54.102 INFO:journalctl@ceph.osd.5.smithi071.stdout:-- Logs begin at Sat 2024-02-10 07:59:38 UTC. -- 2024-02-10T08:15:54.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:15:53.149313+0000 mgr.y (mgr.14146) 161 : cluster [DBG] pgmap v143: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-10T08:15:54.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:53.379622+0000 mon.a (mon.0) 429 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-10T08:15:54.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:15:53.379745+0000 mon.a (mon.0) 430 : cluster [DBG] osdmap e35: 6 total, 5 up, 6 in 2024-02-10T08:15:54.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:53.379910+0000 mon.a (mon.0) 431 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-10T08:15:54.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:53.380341+0000 mon.b (mon.1) 15 : audit [INF] from='osd.5 v2:172.21.15.71:6804/1932648316' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-02-10T08:15:54.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:53.380678+0000 mon.a (mon.0) 432 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-02-10T08:15:54.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:53.415650+0000 mon.a (mon.0) 433 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:15:54.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:53.444313+0000 mon.a (mon.0) 434 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:15:54.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:15:53.941788+0000 osd.1 (osd.1) 5 : cluster [DBG] 1.0 scrub starts 2024-02-10T08:15:54.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:15:53.944924+0000 osd.1 (osd.1) 6 : cluster [DBG] 1.0 scrub ok 2024-02-10T08:15:54.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:15:53.149313+0000 mgr.y (mgr.14146) 161 : cluster [DBG] pgmap v143: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-10T08:15:54.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:53.379622+0000 mon.a (mon.0) 429 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-10T08:15:54.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:15:53.379745+0000 mon.a (mon.0) 430 : cluster [DBG] osdmap e35: 6 total, 5 up, 6 in 2024-02-10T08:15:54.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:53.379910+0000 mon.a (mon.0) 431 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-10T08:15:54.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:53.380341+0000 mon.b (mon.1) 15 : audit [INF] from='osd.5 v2:172.21.15.71:6804/1932648316' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-02-10T08:15:54.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:53.380678+0000 mon.a (mon.0) 432 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-02-10T08:15:54.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:53.415650+0000 mon.a (mon.0) 433 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:15:54.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:53.444313+0000 mon.a (mon.0) 434 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:15:54.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:15:53.941788+0000 osd.1 (osd.1) 5 : cluster [DBG] 1.0 scrub starts 2024-02-10T08:15:54.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:15:53.944924+0000 osd.1 (osd.1) 6 : cluster [DBG] 1.0 scrub ok 2024-02-10T08:15:54.662 INFO:journalctl@ceph.osd.5.smithi071.stdout:Feb 10 08:15:54 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-5[49534]: debug 2024-02-10T08:15:54.387+0000 7fc0865fa700 -1 osd.5 0 waiting for initial osdmap 2024-02-10T08:15:54.662 INFO:journalctl@ceph.osd.5.smithi071.stdout:Feb 10 08:15:54 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-5[49534]: debug 2024-02-10T08:15:54.393+0000 7fc07ed6e700 -1 osd.5 36 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-10T08:15:54.663 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:54 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:15:53.149313+0000 mgr.y (mgr.14146) 161 : cluster [DBG] pgmap v143: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-10T08:15:54.663 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:54 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:53.379622+0000 mon.a (mon.0) 429 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-10T08:15:54.663 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:54 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:15:53.379745+0000 mon.a (mon.0) 430 : cluster [DBG] osdmap e35: 6 total, 5 up, 6 in 2024-02-10T08:15:54.663 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:54 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:53.379910+0000 mon.a (mon.0) 431 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-10T08:15:54.663 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:54 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:53.380341+0000 mon.b (mon.1) 15 : audit [INF] from='osd.5 v2:172.21.15.71:6804/1932648316' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-02-10T08:15:54.663 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:54 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:53.380678+0000 mon.a (mon.0) 432 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-02-10T08:15:54.663 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:54 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:53.415650+0000 mon.a (mon.0) 433 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:15:54.663 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:54 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:53.444313+0000 mon.a (mon.0) 434 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:15:54.663 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:54 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:15:53.941788+0000 osd.1 (osd.1) 5 : cluster [DBG] 1.0 scrub starts 2024-02-10T08:15:54.663 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:54 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:15:53.944924+0000 osd.1 (osd.1) 6 : cluster [DBG] 1.0 scrub ok 2024-02-10T08:15:55.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:54.382055+0000 mon.a (mon.0) 435 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-02-10T08:15:55.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:15:54.382221+0000 mon.a (mon.0) 436 : cluster [DBG] osdmap e36: 6 total, 5 up, 6 in 2024-02-10T08:15:55.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:54.383073+0000 mon.a (mon.0) 437 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-10T08:15:55.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:54.387831+0000 mon.a (mon.0) 438 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-10T08:15:55.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:15:54.930787+0000 mon.a (mon.0) 439 : cluster [INF] osd.5 v2:172.21.15.71:6804/1932648316 boot 2024-02-10T08:15:55.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:15:54.930828+0000 mon.a (mon.0) 440 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2024-02-10T08:15:55.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:54.931231+0000 mon.a (mon.0) 441 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-10T08:15:55.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:54.382055+0000 mon.a (mon.0) 435 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-02-10T08:15:55.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:15:54.382221+0000 mon.a (mon.0) 436 : cluster [DBG] osdmap e36: 6 total, 5 up, 6 in 2024-02-10T08:15:55.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:54.383073+0000 mon.a (mon.0) 437 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-10T08:15:55.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:54.387831+0000 mon.a (mon.0) 438 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-10T08:15:55.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:15:54.930787+0000 mon.a (mon.0) 439 : cluster [INF] osd.5 v2:172.21.15.71:6804/1932648316 boot 2024-02-10T08:15:55.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:15:54.930828+0000 mon.a (mon.0) 440 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2024-02-10T08:15:55.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:54.931231+0000 mon.a (mon.0) 441 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-10T08:15:55.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:54.382055+0000 mon.a (mon.0) 435 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-02-10T08:15:55.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:15:54.382221+0000 mon.a (mon.0) 436 : cluster [DBG] osdmap e36: 6 total, 5 up, 6 in 2024-02-10T08:15:55.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:54.383073+0000 mon.a (mon.0) 437 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-10T08:15:55.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:54.387831+0000 mon.a (mon.0) 438 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-10T08:15:55.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:15:54.930787+0000 mon.a (mon.0) 439 : cluster [INF] osd.5 v2:172.21.15.71:6804/1932648316 boot 2024-02-10T08:15:55.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:15:54.930828+0000 mon.a (mon.0) 440 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2024-02-10T08:15:55.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:54.931231+0000 mon.a (mon.0) 441 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-10T08:15:56.624 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:15:54.253318+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:15:56.624 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:15:54.253371+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:15:56.624 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:15:55.149663+0000 mgr.y (mgr.14146) 162 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-10T08:15:56.624 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:15:55.940308+0000 mon.a (mon.0) 442 : cluster [DBG] osdmap e38: 6 total, 6 up, 6 in 2024-02-10T08:15:56.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:15:54.253318+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:15:56.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:15:54.253371+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:15:56.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:15:55.149663+0000 mgr.y (mgr.14146) 162 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-10T08:15:56.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:15:55.940308+0000 mon.a (mon.0) 442 : cluster [DBG] osdmap e38: 6 total, 6 up, 6 in 2024-02-10T08:15:56.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:15:54.253318+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:15:56.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:15:54.253371+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:15:56.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:15:55.149663+0000 mgr.y (mgr.14146) 162 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-10T08:15:56.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:15:55.940308+0000 mon.a (mon.0) 442 : cluster [DBG] osdmap e38: 6 total, 6 up, 6 in 2024-02-10T08:15:57.550 INFO:teuthology.orchestra.run.smithi071.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-02-10T08:15:57.551 INFO:teuthology.orchestra.run.smithi071.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-02-10T08:15:57.551 INFO:teuthology.orchestra.run.smithi071.stderr: stderr: 10+0 records in 2024-02-10T08:15:57.551 INFO:teuthology.orchestra.run.smithi071.stderr:10+0 records out 2024-02-10T08:15:57.551 INFO:teuthology.orchestra.run.smithi071.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0111455 s, 941 MB/s 2024-02-10T08:15:57.551 INFO:teuthology.orchestra.run.smithi071.stderr:--> Zapping successful for: 2024-02-10T08:15:58.278 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:15:56.942200+0000 mon.a (mon.0) 443 : cluster [DBG] osdmap e39: 6 total, 6 up, 6 in 2024-02-10T08:15:58.278 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:15:57.150178+0000 mgr.y (mgr.14146) 163 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-10T08:15:58.298 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph orch daemon add osd smithi071:vg_nvme/lv_2 2024-02-10T08:15:58.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:15:56.942200+0000 mon.a (mon.0) 443 : cluster [DBG] osdmap e39: 6 total, 6 up, 6 in 2024-02-10T08:15:58.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:15:57.150178+0000 mgr.y (mgr.14146) 163 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-10T08:15:58.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:15:56.942200+0000 mon.a (mon.0) 443 : cluster [DBG] osdmap e39: 6 total, 6 up, 6 in 2024-02-10T08:15:58.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:15:57.150178+0000 mgr.y (mgr.14146) 163 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-10T08:16:00.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:59 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cephadm 2024-02-10T08:15:58.977763+0000 mgr.y (mgr.14146) 164 : cephadm [INF] Detected new or changed devices on smithi071 2024-02-10T08:16:00.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:59 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:58.982779+0000 mon.a (mon.0) 444 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:16:00.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:59 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:58.983838+0000 mon.a (mon.0) 445 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:16:00.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:59 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:58.984680+0000 mon.a (mon.0) 446 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:16:00.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:59 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cephadm 2024-02-10T08:15:58.985251+0000 mgr.y (mgr.14146) 165 : cephadm [INF] Adjusting osd_memory_target on smithi071 to 8561M 2024-02-10T08:16:00.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:59 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:58.989305+0000 mon.a (mon.0) 447 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:16:00.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:59 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:58.990300+0000 mon.a (mon.0) 448 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:16:00.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:59 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:58.991141+0000 mon.a (mon.0) 449 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:16:00.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:59 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:15:58.995502+0000 mon.a (mon.0) 450 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:16:00.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:15:59 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:15:59.150500+0000 mgr.y (mgr.14146) 166 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-10T08:16:00.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cephadm 2024-02-10T08:15:58.977763+0000 mgr.y (mgr.14146) 164 : cephadm [INF] Detected new or changed devices on smithi071 2024-02-10T08:16:00.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:58.982779+0000 mon.a (mon.0) 444 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:16:00.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:58.983838+0000 mon.a (mon.0) 445 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:16:00.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:58.984680+0000 mon.a (mon.0) 446 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:16:00.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cephadm 2024-02-10T08:15:58.985251+0000 mgr.y (mgr.14146) 165 : cephadm [INF] Adjusting osd_memory_target on smithi071 to 8561M 2024-02-10T08:16:00.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:58.989305+0000 mon.a (mon.0) 447 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:16:00.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:58.990300+0000 mon.a (mon.0) 448 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:16:00.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:58.991141+0000 mon.a (mon.0) 449 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:16:00.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:15:58.995502+0000 mon.a (mon.0) 450 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:16:00.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:15:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:15:59.150500+0000 mgr.y (mgr.14146) 166 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-10T08:16:00.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cephadm 2024-02-10T08:15:58.977763+0000 mgr.y (mgr.14146) 164 : cephadm [INF] Detected new or changed devices on smithi071 2024-02-10T08:16:00.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:58.982779+0000 mon.a (mon.0) 444 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:16:00.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:58.983838+0000 mon.a (mon.0) 445 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:16:00.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:58.984680+0000 mon.a (mon.0) 446 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:16:00.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cephadm 2024-02-10T08:15:58.985251+0000 mgr.y (mgr.14146) 165 : cephadm [INF] Adjusting osd_memory_target on smithi071 to 8561M 2024-02-10T08:16:00.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:58.989305+0000 mon.a (mon.0) 447 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:16:00.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:58.990300+0000 mon.a (mon.0) 448 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:16:00.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:58.991141+0000 mon.a (mon.0) 449 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:16:00.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:15:58.995502+0000 mon.a (mon.0) 450 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:16:00.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:15:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:15:59.150500+0000 mgr.y (mgr.14146) 166 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-10T08:16:01.215 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:00.498656+0000 mgr.y (mgr.14146) 167 : audit [DBG] from='client.24250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:16:01.215 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:00.501006+0000 mon.a (mon.0) 451 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-10T08:16:01.215 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:00.503395+0000 mon.a (mon.0) 452 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-10T08:16:01.215 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:00.504155+0000 mon.a (mon.0) 453 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:16:01.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:00.498656+0000 mgr.y (mgr.14146) 167 : audit [DBG] from='client.24250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:16:01.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:00.501006+0000 mon.a (mon.0) 451 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-10T08:16:01.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:00.503395+0000 mon.a (mon.0) 452 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-10T08:16:01.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:00.504155+0000 mon.a (mon.0) 453 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:16:01.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:00.498656+0000 mgr.y (mgr.14146) 167 : audit [DBG] from='client.24250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:16:01.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:00.501006+0000 mon.a (mon.0) 451 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-10T08:16:01.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:00.503395+0000 mon.a (mon.0) 452 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-10T08:16:01.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:00.504155+0000 mon.a (mon.0) 453 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:16:02.147 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:16:01.150999+0000 mgr.y (mgr.14146) 168 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-10T08:16:02.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:16:01.150999+0000 mgr.y (mgr.14146) 168 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-10T08:16:02.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:16:01.150999+0000 mgr.y (mgr.14146) 168 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-10T08:16:03.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:02.876800+0000 mon.b (mon.1) 16 : audit [INF] from='client.? 172.21.15.71:0/2897896102' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "210a8790-78b6-4efa-a969-17efb17e9c0b"}]: dispatch 2024-02-10T08:16:03.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:02.877370+0000 mon.a (mon.0) 454 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "210a8790-78b6-4efa-a969-17efb17e9c0b"}]: dispatch 2024-02-10T08:16:03.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:02.881882+0000 mon.a (mon.0) 455 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "210a8790-78b6-4efa-a969-17efb17e9c0b"}]': finished 2024-02-10T08:16:03.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:16:02.881986+0000 mon.a (mon.0) 456 : cluster [DBG] osdmap e40: 7 total, 6 up, 7 in 2024-02-10T08:16:03.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:02.882160+0000 mon.a (mon.0) 457 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-10T08:16:03.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:02.876800+0000 mon.b (mon.1) 16 : audit [INF] from='client.? 172.21.15.71:0/2897896102' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "210a8790-78b6-4efa-a969-17efb17e9c0b"}]: dispatch 2024-02-10T08:16:03.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:02.877370+0000 mon.a (mon.0) 454 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "210a8790-78b6-4efa-a969-17efb17e9c0b"}]: dispatch 2024-02-10T08:16:03.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:02.881882+0000 mon.a (mon.0) 455 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "210a8790-78b6-4efa-a969-17efb17e9c0b"}]': finished 2024-02-10T08:16:03.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:16:02.881986+0000 mon.a (mon.0) 456 : cluster [DBG] osdmap e40: 7 total, 6 up, 7 in 2024-02-10T08:16:03.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:02.882160+0000 mon.a (mon.0) 457 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-10T08:16:03.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:02.876800+0000 mon.b (mon.1) 16 : audit [INF] from='client.? 172.21.15.71:0/2897896102' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "210a8790-78b6-4efa-a969-17efb17e9c0b"}]: dispatch 2024-02-10T08:16:03.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:02.877370+0000 mon.a (mon.0) 454 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "210a8790-78b6-4efa-a969-17efb17e9c0b"}]: dispatch 2024-02-10T08:16:03.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:02.881882+0000 mon.a (mon.0) 455 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "210a8790-78b6-4efa-a969-17efb17e9c0b"}]': finished 2024-02-10T08:16:03.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:16:02.881986+0000 mon.a (mon.0) 456 : cluster [DBG] osdmap e40: 7 total, 6 up, 7 in 2024-02-10T08:16:03.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:02.882160+0000 mon.a (mon.0) 457 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-10T08:16:04.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:16:03.151301+0000 mgr.y (mgr.14146) 169 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-10T08:16:04.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:03.490904+0000 mon.b (mon.1) 17 : audit [DBG] from='client.? 172.21.15.71:0/43215433' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-10T08:16:04.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:16:03.151301+0000 mgr.y (mgr.14146) 169 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-10T08:16:04.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:03.490904+0000 mon.b (mon.1) 17 : audit [DBG] from='client.? 172.21.15.71:0/43215433' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-10T08:16:04.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:16:03.151301+0000 mgr.y (mgr.14146) 169 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-10T08:16:04.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:03.490904+0000 mon.b (mon.1) 17 : audit [DBG] from='client.? 172.21.15.71:0/43215433' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-10T08:16:06.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:16:05.151603+0000 mgr.y (mgr.14146) 170 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-10T08:16:06.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:16:05.151603+0000 mgr.y (mgr.14146) 170 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-10T08:16:06.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:16:05.151603+0000 mgr.y (mgr.14146) 170 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-10T08:16:08.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:16:07.151928+0000 mgr.y (mgr.14146) 171 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-10T08:16:08.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:16:07.151928+0000 mgr.y (mgr.14146) 171 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-10T08:16:08.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:16:07.151928+0000 mgr.y (mgr.14146) 171 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-10T08:16:09.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:09.174060+0000 mon.a (mon.0) 458 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-02-10T08:16:09.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:09.174968+0000 mon.a (mon.0) 459 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:16:09.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:09.174060+0000 mon.a (mon.0) 458 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-02-10T08:16:09.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:09.174968+0000 mon.a (mon.0) 459 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:16:09.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:09.174060+0000 mon.a (mon.0) 458 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-02-10T08:16:09.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:09.174968+0000 mon.a (mon.0) 459 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:16:10.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:16:09.152403+0000 mgr.y (mgr.14146) 172 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-10T08:16:10.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cephadm 2024-02-10T08:16:09.175694+0000 mgr.y (mgr.14146) 173 : cephadm [INF] Deploying daemon osd.6 on smithi071 2024-02-10T08:16:10.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:16:09.152403+0000 mgr.y (mgr.14146) 172 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-10T08:16:10.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cephadm 2024-02-10T08:16:09.175694+0000 mgr.y (mgr.14146) 173 : cephadm [INF] Deploying daemon osd.6 on smithi071 2024-02-10T08:16:10.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:16:09.152403+0000 mgr.y (mgr.14146) 172 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-10T08:16:10.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cephadm 2024-02-10T08:16:09.175694+0000 mgr.y (mgr.14146) 173 : cephadm [INF] Deploying daemon osd.6 on smithi071 2024-02-10T08:16:12.422 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:16:11.152726+0000 mgr.y (mgr.14146) 174 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-10T08:16:12.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:16:11.152726+0000 mgr.y (mgr.14146) 174 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-10T08:16:12.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:16:11.152726+0000 mgr.y (mgr.14146) 174 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-10T08:16:14.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:16:13.153181+0000 mgr.y (mgr.14146) 175 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-10T08:16:14.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:14.194341+0000 mon.a (mon.0) 460 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:16:14.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:14.201480+0000 mon.a (mon.0) 461 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:16:14.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:16:13.153181+0000 mgr.y (mgr.14146) 175 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-10T08:16:14.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:14.194341+0000 mon.a (mon.0) 460 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:16:14.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:14.201480+0000 mon.a (mon.0) 461 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:16:14.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:16:13.153181+0000 mgr.y (mgr.14146) 175 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-10T08:16:14.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:14.194341+0000 mon.a (mon.0) 460 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:16:14.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:14.201480+0000 mon.a (mon.0) 461 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:16:16.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:16:15.153514+0000 mgr.y (mgr.14146) 176 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-10T08:16:16.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:16:15.153514+0000 mgr.y (mgr.14146) 176 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-10T08:16:16.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:16:15.153514+0000 mgr.y (mgr.14146) 176 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-10T08:16:17.712 INFO:teuthology.orchestra.run.smithi071.stdout:Created osd(s) 6 on host 'smithi071' 2024-02-10T08:16:18.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:16.671396+0000 mon.a (mon.0) 462 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:16:18.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:16.967717+0000 mon.a (mon.0) 463 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:16:18.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:16.968659+0000 mon.a (mon.0) 464 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:16:18.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:16.974663+0000 mon.a (mon.0) 465 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:16:18.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:16:17.154004+0000 mgr.y (mgr.14146) 177 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-10T08:16:18.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:17.299266+0000 mon.b (mon.1) 18 : audit [INF] from='osd.6 v2:172.21.15.71:6808/3724399458' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-02-10T08:16:18.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:17.299684+0000 mon.a (mon.0) 466 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-02-10T08:16:18.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:16.671396+0000 mon.a (mon.0) 462 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:16:18.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:16.967717+0000 mon.a (mon.0) 463 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:16:18.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:16.968659+0000 mon.a (mon.0) 464 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:16:18.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:16.974663+0000 mon.a (mon.0) 465 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:16:18.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:16:17.154004+0000 mgr.y (mgr.14146) 177 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-10T08:16:18.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:17.299266+0000 mon.b (mon.1) 18 : audit [INF] from='osd.6 v2:172.21.15.71:6808/3724399458' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-02-10T08:16:18.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:17.299684+0000 mon.a (mon.0) 466 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-02-10T08:16:18.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:16.671396+0000 mon.a (mon.0) 462 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:16:18.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:16.967717+0000 mon.a (mon.0) 463 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:16:18.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:16.968659+0000 mon.a (mon.0) 464 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:16:18.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:16.974663+0000 mon.a (mon.0) 465 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:16:18.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:16:17.154004+0000 mgr.y (mgr.14146) 177 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-10T08:16:18.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:17.299266+0000 mon.b (mon.1) 18 : audit [INF] from='osd.6 v2:172.21.15.71:6808/3724399458' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-02-10T08:16:18.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:17.299684+0000 mon.a (mon.0) 466 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-02-10T08:16:18.397 DEBUG:teuthology.orchestra.run.smithi071:osd.6> sudo journalctl -f -n 0 -u ceph-d46257c8-c7eb-11ee-95b8-87774f69a715@osd.6.service 2024-02-10T08:16:18.399 INFO:tasks.cephadm:Deploying osd.7 on smithi071 with /dev/vg_nvme/lv_1... 2024-02-10T08:16:18.400 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-02-10T08:16:18.430 INFO:journalctl@ceph.osd.6.smithi071.stdout:-- Logs begin at Sat 2024-02-10 07:59:38 UTC. -- 2024-02-10T08:16:18.925 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:17.711394+0000 mon.a (mon.0) 467 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:16:18.926 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:17.742781+0000 mon.a (mon.0) 468 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:16:18.926 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:17.978180+0000 mon.a (mon.0) 469 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-02-10T08:16:18.926 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:16:17.978304+0000 mon.a (mon.0) 470 : cluster [DBG] osdmap e41: 7 total, 6 up, 7 in 2024-02-10T08:16:18.926 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:17.978494+0000 mon.a (mon.0) 471 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-10T08:16:18.926 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:17.979000+0000 mon.b (mon.1) 19 : audit [INF] from='osd.6 v2:172.21.15.71:6808/3724399458' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-02-10T08:16:18.926 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:17.979355+0000 mon.a (mon.0) 472 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-02-10T08:16:19.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:17.711394+0000 mon.a (mon.0) 467 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:16:19.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:17.742781+0000 mon.a (mon.0) 468 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:16:19.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:17.978180+0000 mon.a (mon.0) 469 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-02-10T08:16:19.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:16:17.978304+0000 mon.a (mon.0) 470 : cluster [DBG] osdmap e41: 7 total, 6 up, 7 in 2024-02-10T08:16:19.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:17.978494+0000 mon.a (mon.0) 471 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-10T08:16:19.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:17.979000+0000 mon.b (mon.1) 19 : audit [INF] from='osd.6 v2:172.21.15.71:6808/3724399458' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-02-10T08:16:19.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:17.979355+0000 mon.a (mon.0) 472 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-02-10T08:16:19.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:17.711394+0000 mon.a (mon.0) 467 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:16:19.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:17.742781+0000 mon.a (mon.0) 468 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:16:19.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:17.978180+0000 mon.a (mon.0) 469 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-02-10T08:16:19.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:16:17.978304+0000 mon.a (mon.0) 470 : cluster [DBG] osdmap e41: 7 total, 6 up, 7 in 2024-02-10T08:16:19.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:17.978494+0000 mon.a (mon.0) 471 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-10T08:16:19.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:17.979000+0000 mon.b (mon.1) 19 : audit [INF] from='osd.6 v2:172.21.15.71:6808/3724399458' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-02-10T08:16:19.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:17.979355+0000 mon.a (mon.0) 472 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-02-10T08:16:19.289 INFO:journalctl@ceph.osd.6.smithi071.stdout:Feb 10 08:16:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-6[53993]: debug 2024-02-10T08:16:18.981+0000 7fd5c522e700 -1 osd.6 0 waiting for initial osdmap 2024-02-10T08:16:19.289 INFO:journalctl@ceph.osd.6.smithi071.stdout:Feb 10 08:16:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-6[53993]: debug 2024-02-10T08:16:18.987+0000 7fd5bf9a6700 -1 osd.6 42 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-10T08:16:20.277 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:18.980239+0000 mon.a (mon.0) 473 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-02-10T08:16:20.277 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:16:18.980356+0000 mon.a (mon.0) 474 : cluster [DBG] osdmap e42: 7 total, 6 up, 7 in 2024-02-10T08:16:20.277 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:18.980554+0000 mon.a (mon.0) 475 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-10T08:16:20.277 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:18.983215+0000 mon.a (mon.0) 476 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-10T08:16:20.277 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:16:19.154563+0000 mgr.y (mgr.14146) 178 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-10T08:16:20.277 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:16:19.936272+0000 mon.a (mon.0) 477 : cluster [INF] osd.6 v2:172.21.15.71:6808/3724399458 boot 2024-02-10T08:16:20.277 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:16:19.936334+0000 mon.a (mon.0) 478 : cluster [DBG] osdmap e43: 7 total, 7 up, 7 in 2024-02-10T08:16:20.277 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:19.936715+0000 mon.a (mon.0) 479 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-10T08:16:20.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:18.980239+0000 mon.a (mon.0) 473 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-02-10T08:16:20.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:16:18.980356+0000 mon.a (mon.0) 474 : cluster [DBG] osdmap e42: 7 total, 6 up, 7 in 2024-02-10T08:16:20.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:18.980554+0000 mon.a (mon.0) 475 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-10T08:16:20.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:18.983215+0000 mon.a (mon.0) 476 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-10T08:16:20.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:16:19.154563+0000 mgr.y (mgr.14146) 178 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-10T08:16:20.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:16:19.936272+0000 mon.a (mon.0) 477 : cluster [INF] osd.6 v2:172.21.15.71:6808/3724399458 boot 2024-02-10T08:16:20.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:16:19.936334+0000 mon.a (mon.0) 478 : cluster [DBG] osdmap e43: 7 total, 7 up, 7 in 2024-02-10T08:16:20.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:19.936715+0000 mon.a (mon.0) 479 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-10T08:16:20.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:18.980239+0000 mon.a (mon.0) 473 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-02-10T08:16:20.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:16:18.980356+0000 mon.a (mon.0) 474 : cluster [DBG] osdmap e42: 7 total, 6 up, 7 in 2024-02-10T08:16:20.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:18.980554+0000 mon.a (mon.0) 475 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-10T08:16:20.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:18.983215+0000 mon.a (mon.0) 476 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-10T08:16:20.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:16:19.154563+0000 mgr.y (mgr.14146) 178 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-10T08:16:20.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:16:19.936272+0000 mon.a (mon.0) 477 : cluster [INF] osd.6 v2:172.21.15.71:6808/3724399458 boot 2024-02-10T08:16:20.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:16:19.936334+0000 mon.a (mon.0) 478 : cluster [DBG] osdmap e43: 7 total, 7 up, 7 in 2024-02-10T08:16:20.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:19.936715+0000 mon.a (mon.0) 479 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-10T08:16:21.098 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:16:18.347297+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:16:21.098 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:16:18.347339+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:16:21.098 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:16:20.941707+0000 mon.a (mon.0) 480 : cluster [DBG] osdmap e44: 7 total, 7 up, 7 in 2024-02-10T08:16:21.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:16:18.347297+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:16:21.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:16:18.347339+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:16:21.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:16:20.941707+0000 mon.a (mon.0) 480 : cluster [DBG] osdmap e44: 7 total, 7 up, 7 in 2024-02-10T08:16:21.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:16:18.347297+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:16:21.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:16:18.347339+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:16:21.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:16:20.941707+0000 mon.a (mon.0) 480 : cluster [DBG] osdmap e44: 7 total, 7 up, 7 in 2024-02-10T08:16:21.686 INFO:teuthology.orchestra.run.smithi071.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-02-10T08:16:21.686 INFO:teuthology.orchestra.run.smithi071.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-02-10T08:16:21.686 INFO:teuthology.orchestra.run.smithi071.stderr: stderr: 10+0 records in 2024-02-10T08:16:21.686 INFO:teuthology.orchestra.run.smithi071.stderr:10+0 records out 2024-02-10T08:16:21.686 INFO:teuthology.orchestra.run.smithi071.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0115536 s, 908 MB/s 2024-02-10T08:16:21.686 INFO:teuthology.orchestra.run.smithi071.stderr:--> Zapping successful for: 2024-02-10T08:16:22.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:16:21.154950+0000 mgr.y (mgr.14146) 179 : cluster [DBG] pgmap v167: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-10T08:16:22.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:16:21.942876+0000 mon.a (mon.0) 481 : cluster [DBG] osdmap e45: 7 total, 7 up, 7 in 2024-02-10T08:16:22.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:16:21.154950+0000 mgr.y (mgr.14146) 179 : cluster [DBG] pgmap v167: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-10T08:16:22.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:16:21.942876+0000 mon.a (mon.0) 481 : cluster [DBG] osdmap e45: 7 total, 7 up, 7 in 2024-02-10T08:16:22.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:16:21.154950+0000 mgr.y (mgr.14146) 179 : cluster [DBG] pgmap v167: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-10T08:16:22.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:16:21.942876+0000 mon.a (mon.0) 481 : cluster [DBG] osdmap e45: 7 total, 7 up, 7 in 2024-02-10T08:16:23.125 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph orch daemon add osd smithi071:vg_nvme/lv_1 2024-02-10T08:16:24.497 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:16:23.155317+0000 mgr.y (mgr.14146) 180 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-10T08:16:24.497 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cephadm 2024-02-10T08:16:23.164639+0000 mgr.y (mgr.14146) 181 : cephadm [INF] Detected new or changed devices on smithi071 2024-02-10T08:16:24.497 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:23.169966+0000 mon.a (mon.0) 482 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:16:24.497 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:23.170967+0000 mon.a (mon.0) 483 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:16:24.498 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:23.171867+0000 mon.a (mon.0) 484 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:16:24.498 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:23.172670+0000 mon.a (mon.0) 485 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:16:24.498 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cephadm 2024-02-10T08:16:23.173284+0000 mgr.y (mgr.14146) 182 : cephadm [INF] Adjusting osd_memory_target on smithi071 to 5707M 2024-02-10T08:16:24.498 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:23.177326+0000 mon.a (mon.0) 486 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:16:24.498 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:23.178234+0000 mon.a (mon.0) 487 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:16:24.498 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:23.178994+0000 mon.a (mon.0) 488 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:16:24.498 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:23.183437+0000 mon.a (mon.0) 489 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:16:24.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:16:23.155317+0000 mgr.y (mgr.14146) 180 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-10T08:16:24.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cephadm 2024-02-10T08:16:23.164639+0000 mgr.y (mgr.14146) 181 : cephadm [INF] Detected new or changed devices on smithi071 2024-02-10T08:16:24.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:23.169966+0000 mon.a (mon.0) 482 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:16:24.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:23.170967+0000 mon.a (mon.0) 483 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:16:24.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:23.171867+0000 mon.a (mon.0) 484 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:16:24.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:23.172670+0000 mon.a (mon.0) 485 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:16:24.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cephadm 2024-02-10T08:16:23.173284+0000 mgr.y (mgr.14146) 182 : cephadm [INF] Adjusting osd_memory_target on smithi071 to 5707M 2024-02-10T08:16:24.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:23.177326+0000 mon.a (mon.0) 486 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:16:24.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:23.178234+0000 mon.a (mon.0) 487 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:16:24.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:23.178994+0000 mon.a (mon.0) 488 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:16:24.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:23.183437+0000 mon.a (mon.0) 489 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:16:24.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:16:23.155317+0000 mgr.y (mgr.14146) 180 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-10T08:16:24.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cephadm 2024-02-10T08:16:23.164639+0000 mgr.y (mgr.14146) 181 : cephadm [INF] Detected new or changed devices on smithi071 2024-02-10T08:16:24.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:23.169966+0000 mon.a (mon.0) 482 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:16:24.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:23.170967+0000 mon.a (mon.0) 483 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:16:24.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:23.171867+0000 mon.a (mon.0) 484 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:16:24.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:23.172670+0000 mon.a (mon.0) 485 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:16:24.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cephadm 2024-02-10T08:16:23.173284+0000 mgr.y (mgr.14146) 182 : cephadm [INF] Adjusting osd_memory_target on smithi071 to 5707M 2024-02-10T08:16:24.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:23.177326+0000 mon.a (mon.0) 486 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:16:24.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:23.178234+0000 mon.a (mon.0) 487 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:16:24.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:23.178994+0000 mon.a (mon.0) 488 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:16:24.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:23.183437+0000 mon.a (mon.0) 489 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:16:26.226 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:25.150723+0000 mgr.y (mgr.14146) 183 : audit [DBG] from='client.24277 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:16:26.226 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:25.153062+0000 mon.a (mon.0) 490 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-10T08:16:26.226 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:25.155450+0000 mon.a (mon.0) 491 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-10T08:16:26.226 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:16:25.155597+0000 mgr.y (mgr.14146) 184 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-10T08:16:26.226 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:25.156408+0000 mon.a (mon.0) 492 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:16:26.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:25.150723+0000 mgr.y (mgr.14146) 183 : audit [DBG] from='client.24277 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:16:26.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:25.153062+0000 mon.a (mon.0) 490 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-10T08:16:26.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:25.155450+0000 mon.a (mon.0) 491 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-10T08:16:26.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:16:25.155597+0000 mgr.y (mgr.14146) 184 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-10T08:16:26.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:25.156408+0000 mon.a (mon.0) 492 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:16:26.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:25.150723+0000 mgr.y (mgr.14146) 183 : audit [DBG] from='client.24277 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:16:26.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:25.153062+0000 mon.a (mon.0) 490 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-10T08:16:26.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:25.155450+0000 mon.a (mon.0) 491 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-10T08:16:26.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:16:25.155597+0000 mgr.y (mgr.14146) 184 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-10T08:16:26.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:25.156408+0000 mon.a (mon.0) 492 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:16:28.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:16:27.156100+0000 mgr.y (mgr.14146) 185 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-10T08:16:28.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:27.585450+0000 mon.b (mon.1) 20 : audit [INF] from='client.? 172.21.15.71:0/2108626687' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9778a0e9-2ff3-4700-bf2a-675edaba630b"}]: dispatch 2024-02-10T08:16:28.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:27.586060+0000 mon.a (mon.0) 493 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9778a0e9-2ff3-4700-bf2a-675edaba630b"}]: dispatch 2024-02-10T08:16:28.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:27.591133+0000 mon.a (mon.0) 494 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9778a0e9-2ff3-4700-bf2a-675edaba630b"}]': finished 2024-02-10T08:16:28.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:16:27.591239+0000 mon.a (mon.0) 495 : cluster [DBG] osdmap e46: 8 total, 7 up, 8 in 2024-02-10T08:16:28.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:27.591404+0000 mon.a (mon.0) 496 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-10T08:16:28.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:28.171735+0000 mon.b (mon.1) 21 : audit [DBG] from='client.? 172.21.15.71:0/4043048163' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-10T08:16:28.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:16:27.156100+0000 mgr.y (mgr.14146) 185 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-10T08:16:28.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:27.585450+0000 mon.b (mon.1) 20 : audit [INF] from='client.? 172.21.15.71:0/2108626687' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9778a0e9-2ff3-4700-bf2a-675edaba630b"}]: dispatch 2024-02-10T08:16:28.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:27.586060+0000 mon.a (mon.0) 493 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9778a0e9-2ff3-4700-bf2a-675edaba630b"}]: dispatch 2024-02-10T08:16:28.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:27.591133+0000 mon.a (mon.0) 494 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9778a0e9-2ff3-4700-bf2a-675edaba630b"}]': finished 2024-02-10T08:16:28.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:16:27.591239+0000 mon.a (mon.0) 495 : cluster [DBG] osdmap e46: 8 total, 7 up, 8 in 2024-02-10T08:16:28.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:27.591404+0000 mon.a (mon.0) 496 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-10T08:16:28.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:28.171735+0000 mon.b (mon.1) 21 : audit [DBG] from='client.? 172.21.15.71:0/4043048163' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-10T08:16:28.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:16:27.156100+0000 mgr.y (mgr.14146) 185 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-10T08:16:28.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:27.585450+0000 mon.b (mon.1) 20 : audit [INF] from='client.? 172.21.15.71:0/2108626687' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9778a0e9-2ff3-4700-bf2a-675edaba630b"}]: dispatch 2024-02-10T08:16:28.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:27.586060+0000 mon.a (mon.0) 493 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9778a0e9-2ff3-4700-bf2a-675edaba630b"}]: dispatch 2024-02-10T08:16:28.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:27.591133+0000 mon.a (mon.0) 494 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9778a0e9-2ff3-4700-bf2a-675edaba630b"}]': finished 2024-02-10T08:16:28.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:16:27.591239+0000 mon.a (mon.0) 495 : cluster [DBG] osdmap e46: 8 total, 7 up, 8 in 2024-02-10T08:16:28.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:27.591404+0000 mon.a (mon.0) 496 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-10T08:16:28.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:28.171735+0000 mon.b (mon.1) 21 : audit [DBG] from='client.? 172.21.15.71:0/4043048163' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-10T08:16:30.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:16:29.156505+0000 mgr.y (mgr.14146) 186 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-10T08:16:30.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:16:29.156505+0000 mgr.y (mgr.14146) 186 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-10T08:16:30.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:16:29.156505+0000 mgr.y (mgr.14146) 186 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-10T08:16:32.398 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:16:31.156922+0000 mgr.y (mgr.14146) 187 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-10T08:16:32.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:16:31.156922+0000 mgr.y (mgr.14146) 187 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-10T08:16:32.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:16:31.156922+0000 mgr.y (mgr.14146) 187 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-10T08:16:34.512 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:16:33.157316+0000 mgr.y (mgr.14146) 188 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-10T08:16:34.513 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:33.757502+0000 mon.a (mon.0) 497 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-02-10T08:16:34.513 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:33.758332+0000 mon.a (mon.0) 498 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:16:34.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:16:33.157316+0000 mgr.y (mgr.14146) 188 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-10T08:16:34.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:33.757502+0000 mon.a (mon.0) 497 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-02-10T08:16:34.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:33.758332+0000 mon.a (mon.0) 498 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:16:34.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:16:33.157316+0000 mgr.y (mgr.14146) 188 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-10T08:16:34.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:33.757502+0000 mon.a (mon.0) 497 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-02-10T08:16:34.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:33.758332+0000 mon.a (mon.0) 498 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:16:35.401 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cephadm 2024-02-10T08:16:33.759107+0000 mgr.y (mgr.14146) 189 : cephadm [INF] Deploying daemon osd.7 on smithi071 2024-02-10T08:16:35.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cephadm 2024-02-10T08:16:33.759107+0000 mgr.y (mgr.14146) 189 : cephadm [INF] Deploying daemon osd.7 on smithi071 2024-02-10T08:16:35.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cephadm 2024-02-10T08:16:33.759107+0000 mgr.y (mgr.14146) 189 : cephadm [INF] Deploying daemon osd.7 on smithi071 2024-02-10T08:16:36.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:16:35.157796+0000 mgr.y (mgr.14146) 190 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-10T08:16:36.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:16:35.157796+0000 mgr.y (mgr.14146) 190 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-10T08:16:36.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:16:35.157796+0000 mgr.y (mgr.14146) 190 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-10T08:16:37.531 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:16:36.011187+0000 osd.0 (osd.0) 5 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:16:37.532 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:16:36.011274+0000 osd.0 (osd.0) 6 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:16:37.532 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:16:36.947121+0000 mon.a (mon.0) 499 : cluster [DBG] osdmap e47: 8 total, 7 up, 8 in 2024-02-10T08:16:37.532 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:36.947322+0000 mon.a (mon.0) 500 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-10T08:16:37.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:16:36.011187+0000 osd.0 (osd.0) 5 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:16:37.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:16:36.011274+0000 osd.0 (osd.0) 6 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:16:37.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:16:36.947121+0000 mon.a (mon.0) 499 : cluster [DBG] osdmap e47: 8 total, 7 up, 8 in 2024-02-10T08:16:37.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:36.947322+0000 mon.a (mon.0) 500 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-10T08:16:37.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:16:36.011187+0000 osd.0 (osd.0) 5 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:16:37.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:16:36.011274+0000 osd.0 (osd.0) 6 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:16:37.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:16:36.947121+0000 mon.a (mon.0) 499 : cluster [DBG] osdmap e47: 8 total, 7 up, 8 in 2024-02-10T08:16:37.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:36.947322+0000 mon.a (mon.0) 500 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-10T08:16:38.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:16:36.484439+0000 osd.3 (osd.3) 3 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:16:38.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:16:36.484503+0000 osd.3 (osd.3) 4 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:16:38.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:16:37.158192+0000 mgr.y (mgr.14146) 191 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-10T08:16:38.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:16:36.484439+0000 osd.3 (osd.3) 3 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:16:38.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:16:36.484503+0000 osd.3 (osd.3) 4 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:16:38.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:16:37.158192+0000 mgr.y (mgr.14146) 191 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-10T08:16:38.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:16:36.484439+0000 osd.3 (osd.3) 3 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:16:38.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:16:36.484503+0000 osd.3 (osd.3) 4 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:16:38.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:16:37.158192+0000 mgr.y (mgr.14146) 191 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-10T08:16:40.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:38.878393+0000 mon.a (mon.0) 501 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:16:40.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:38.890838+0000 mon.a (mon.0) 502 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:16:40.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:16:39.158465+0000 mgr.y (mgr.14146) 192 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-10T08:16:40.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:38.878393+0000 mon.a (mon.0) 501 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:16:40.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:38.890838+0000 mon.a (mon.0) 502 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:16:40.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:16:39.158465+0000 mgr.y (mgr.14146) 192 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-10T08:16:40.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:38.878393+0000 mon.a (mon.0) 501 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:16:40.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:38.890838+0000 mon.a (mon.0) 502 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:16:40.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:16:39.158465+0000 mgr.y (mgr.14146) 192 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-10T08:16:42.308 INFO:teuthology.orchestra.run.smithi071.stdout:Created osd(s) 7 on host 'smithi071' 2024-02-10T08:16:42.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:16:41.158963+0000 mgr.y (mgr.14146) 193 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-10T08:16:42.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:41.485070+0000 mon.a (mon.0) 503 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:16:42.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:41.486079+0000 mon.a (mon.0) 504 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:16:42.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:41.486992+0000 mon.a (mon.0) 505 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:16:42.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:41.491577+0000 mon.a (mon.0) 506 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:16:42.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:41.996128+0000 mon.b (mon.1) 22 : audit [INF] from='osd.7 v2:172.21.15.71:6812/163573852' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-10T08:16:42.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:41.996500+0000 mon.a (mon.0) 507 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-10T08:16:42.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:42.306980+0000 mon.a (mon.0) 508 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:16:42.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:42.309747+0000 mon.a (mon.0) 509 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:16:42.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:16:41.158963+0000 mgr.y (mgr.14146) 193 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-10T08:16:42.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:41.485070+0000 mon.a (mon.0) 503 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:16:42.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:41.486079+0000 mon.a (mon.0) 504 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:16:42.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:41.486992+0000 mon.a (mon.0) 505 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:16:42.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:41.491577+0000 mon.a (mon.0) 506 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:16:42.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:41.996128+0000 mon.b (mon.1) 22 : audit [INF] from='osd.7 v2:172.21.15.71:6812/163573852' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-10T08:16:42.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:41.996500+0000 mon.a (mon.0) 507 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-10T08:16:42.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:42.306980+0000 mon.a (mon.0) 508 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:16:42.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:42.309747+0000 mon.a (mon.0) 509 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:16:42.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:16:41.158963+0000 mgr.y (mgr.14146) 193 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-10T08:16:42.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:41.485070+0000 mon.a (mon.0) 503 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:16:42.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:41.486079+0000 mon.a (mon.0) 504 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:16:42.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:41.486992+0000 mon.a (mon.0) 505 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:16:42.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:41.491577+0000 mon.a (mon.0) 506 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:16:42.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:41.996128+0000 mon.b (mon.1) 22 : audit [INF] from='osd.7 v2:172.21.15.71:6812/163573852' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-10T08:16:42.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:41.996500+0000 mon.a (mon.0) 507 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-10T08:16:42.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:42.306980+0000 mon.a (mon.0) 508 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:16:42.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:42.309747+0000 mon.a (mon.0) 509 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:16:43.173 DEBUG:teuthology.orchestra.run.smithi071:osd.7> sudo journalctl -f -n 0 -u ceph-d46257c8-c7eb-11ee-95b8-87774f69a715@osd.7.service 2024-02-10T08:16:43.175 INFO:tasks.cephadm:Waiting for 8 OSDs to come up... 2024-02-10T08:16:43.175 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd stat -f json 2024-02-10T08:16:43.206 INFO:journalctl@ceph.osd.7.smithi071.stdout:-- Logs begin at Sat 2024-02-10 07:59:38 UTC. -- 2024-02-10T08:16:43.497 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:42.493513+0000 mon.a (mon.0) 510 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-02-10T08:16:43.497 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:16:42.493616+0000 mon.a (mon.0) 511 : cluster [DBG] osdmap e48: 8 total, 7 up, 8 in 2024-02-10T08:16:43.498 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:42.493791+0000 mon.a (mon.0) 512 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-10T08:16:43.498 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:42.494185+0000 mon.b (mon.1) 23 : audit [INF] from='osd.7 v2:172.21.15.71:6812/163573852' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-02-10T08:16:43.498 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:42.494476+0000 mon.a (mon.0) 513 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-02-10T08:16:43.789 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:16:43 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[58460]: debug 2024-02-10T08:16:43.498+0000 7f8aa4cfc700 -1 osd.7 0 waiting for initial osdmap 2024-02-10T08:16:43.789 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:16:43 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[58460]: debug 2024-02-10T08:16:43.504+0000 7f8a9f474700 -1 osd.7 49 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-10T08:16:43.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:43 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:42.493513+0000 mon.a (mon.0) 510 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-02-10T08:16:43.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:43 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:16:42.493616+0000 mon.a (mon.0) 511 : cluster [DBG] osdmap e48: 8 total, 7 up, 8 in 2024-02-10T08:16:43.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:43 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:42.493791+0000 mon.a (mon.0) 512 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-10T08:16:43.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:43 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:42.494185+0000 mon.b (mon.1) 23 : audit [INF] from='osd.7 v2:172.21.15.71:6812/163573852' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-02-10T08:16:43.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:43 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:42.494476+0000 mon.a (mon.0) 513 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-02-10T08:16:43.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:42.493513+0000 mon.a (mon.0) 510 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-02-10T08:16:43.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:16:42.493616+0000 mon.a (mon.0) 511 : cluster [DBG] osdmap e48: 8 total, 7 up, 8 in 2024-02-10T08:16:43.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:42.493791+0000 mon.a (mon.0) 512 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-10T08:16:43.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:42.494185+0000 mon.b (mon.1) 23 : audit [INF] from='osd.7 v2:172.21.15.71:6812/163573852' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-02-10T08:16:43.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:42.494476+0000 mon.a (mon.0) 513 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-02-10T08:16:44.694 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:44 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:16:43.159385+0000 mgr.y (mgr.14146) 194 : cluster [DBG] pgmap v182: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-10T08:16:44.694 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:44 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:43.494961+0000 mon.a (mon.0) 514 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-02-10T08:16:44.694 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:44 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:16:43.495107+0000 mon.a (mon.0) 515 : cluster [DBG] osdmap e49: 8 total, 7 up, 8 in 2024-02-10T08:16:44.694 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:44 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:43.495426+0000 mon.a (mon.0) 516 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-10T08:16:44.694 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:44 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:43.499527+0000 mon.a (mon.0) 517 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-10T08:16:44.867 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:16:43.159385+0000 mgr.y (mgr.14146) 194 : cluster [DBG] pgmap v182: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-10T08:16:44.867 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:43.494961+0000 mon.a (mon.0) 514 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-02-10T08:16:44.867 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:16:43.495107+0000 mon.a (mon.0) 515 : cluster [DBG] osdmap e49: 8 total, 7 up, 8 in 2024-02-10T08:16:44.867 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:43.495426+0000 mon.a (mon.0) 516 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-10T08:16:44.867 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:43.499527+0000 mon.a (mon.0) 517 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-10T08:16:44.867 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:16:43.159385+0000 mgr.y (mgr.14146) 194 : cluster [DBG] pgmap v182: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-10T08:16:44.868 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:43.494961+0000 mon.a (mon.0) 514 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-02-10T08:16:44.868 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:16:43.495107+0000 mon.a (mon.0) 515 : cluster [DBG] osdmap e49: 8 total, 7 up, 8 in 2024-02-10T08:16:44.868 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:43.495426+0000 mon.a (mon.0) 516 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-10T08:16:44.868 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:43.499527+0000 mon.a (mon.0) 517 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-10T08:16:45.569 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:16:45.730 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:16:43.005161+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:16:45.731 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:16:43.005223+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:16:45.731 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:16:44.497095+0000 mon.a (mon.0) 518 : cluster [INF] osd.7 v2:172.21.15.71:6812/163573852 boot 2024-02-10T08:16:45.731 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:16:44.497150+0000 mon.a (mon.0) 519 : cluster [DBG] osdmap e50: 8 total, 8 up, 8 in 2024-02-10T08:16:45.731 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:44.497391+0000 mon.a (mon.0) 520 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-10T08:16:45.731 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:16:44.941464+0000 mon.a (mon.0) 521 : cluster [DBG] osdmap e51: 8 total, 8 up, 8 in 2024-02-10T08:16:45.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:16:43.005161+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:16:45.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:16:43.005223+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:16:45.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:16:44.497095+0000 mon.a (mon.0) 518 : cluster [INF] osd.7 v2:172.21.15.71:6812/163573852 boot 2024-02-10T08:16:45.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:16:44.497150+0000 mon.a (mon.0) 519 : cluster [DBG] osdmap e50: 8 total, 8 up, 8 in 2024-02-10T08:16:45.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:44.497391+0000 mon.a (mon.0) 520 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-10T08:16:45.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:16:44.941464+0000 mon.a (mon.0) 521 : cluster [DBG] osdmap e51: 8 total, 8 up, 8 in 2024-02-10T08:16:45.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:16:43.005161+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:16:45.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:16:43.005223+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:16:45.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:16:44.497095+0000 mon.a (mon.0) 518 : cluster [INF] osd.7 v2:172.21.15.71:6812/163573852 boot 2024-02-10T08:16:45.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:16:44.497150+0000 mon.a (mon.0) 519 : cluster [DBG] osdmap e50: 8 total, 8 up, 8 in 2024-02-10T08:16:45.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:44.497391+0000 mon.a (mon.0) 520 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-10T08:16:45.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:16:44.941464+0000 mon.a (mon.0) 521 : cluster [DBG] osdmap e51: 8 total, 8 up, 8 in 2024-02-10T08:16:46.389 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":51,"num_osds":8,"num_up_osds":8,"osd_up_since":1707553004,"num_in_osds":8,"osd_in_since":1707552987,"num_remapped_pgs":0} 2024-02-10T08:16:46.390 INFO:tasks.cephadm:Adding ceph.rgw.foo.a on smithi018 2024-02-10T08:16:46.390 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph orch apply rgw foo.a --placement '1;smithi018=foo.a' 2024-02-10T08:16:46.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:16:45.159870+0000 mgr.y (mgr.14146) 195 : cluster [DBG] pgmap v186: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T08:16:46.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:45.568898+0000 mon.c (mon.2) 12 : audit [DBG] from='client.? 172.21.15.18:0/4087734368' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-10T08:16:46.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:16:45.942473+0000 mon.a (mon.0) 522 : cluster [DBG] osdmap e52: 8 total, 8 up, 8 in 2024-02-10T08:16:46.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:46.259054+0000 mon.a (mon.0) 523 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:16:46.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:46.260722+0000 mon.a (mon.0) 524 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:16:46.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:46.261509+0000 mon.a (mon.0) 525 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:16:46.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:46.262270+0000 mon.a (mon.0) 526 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:16:46.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:46.262951+0000 mon.a (mon.0) 527 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:16:46.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:46.267597+0000 mon.a (mon.0) 528 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:16:46.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:46.268454+0000 mon.a (mon.0) 529 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:16:46.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:46.269177+0000 mon.a (mon.0) 530 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:16:46.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:46.273185+0000 mon.a (mon.0) 531 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:16:46.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:16:45.159870+0000 mgr.y (mgr.14146) 195 : cluster [DBG] pgmap v186: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T08:16:46.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:45.568898+0000 mon.c (mon.2) 12 : audit [DBG] from='client.? 172.21.15.18:0/4087734368' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-10T08:16:46.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:16:45.942473+0000 mon.a (mon.0) 522 : cluster [DBG] osdmap e52: 8 total, 8 up, 8 in 2024-02-10T08:16:46.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:46.259054+0000 mon.a (mon.0) 523 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:16:46.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:46.260722+0000 mon.a (mon.0) 524 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:16:46.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:46.261509+0000 mon.a (mon.0) 525 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:16:46.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:46.262270+0000 mon.a (mon.0) 526 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:16:46.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:46.262951+0000 mon.a (mon.0) 527 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:16:46.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:46.267597+0000 mon.a (mon.0) 528 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:16:46.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:46.268454+0000 mon.a (mon.0) 529 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:16:46.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:46.269177+0000 mon.a (mon.0) 530 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:16:46.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:46.273185+0000 mon.a (mon.0) 531 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:16:46.784 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:16:45.159870+0000 mgr.y (mgr.14146) 195 : cluster [DBG] pgmap v186: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T08:16:46.784 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:45.568898+0000 mon.c (mon.2) 12 : audit [DBG] from='client.? 172.21.15.18:0/4087734368' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-10T08:16:46.784 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:16:45.942473+0000 mon.a (mon.0) 522 : cluster [DBG] osdmap e52: 8 total, 8 up, 8 in 2024-02-10T08:16:46.784 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:46.259054+0000 mon.a (mon.0) 523 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:16:46.784 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:46.260722+0000 mon.a (mon.0) 524 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:16:46.784 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:46.261509+0000 mon.a (mon.0) 525 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:16:46.784 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:46.262270+0000 mon.a (mon.0) 526 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:16:46.784 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:46.262951+0000 mon.a (mon.0) 527 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:16:46.784 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:46.267597+0000 mon.a (mon.0) 528 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:16:46.785 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:46.268454+0000 mon.a (mon.0) 529 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:16:46.785 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:46.269177+0000 mon.a (mon.0) 530 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:16:46.785 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:46.273185+0000 mon.a (mon.0) 531 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:16:47.752 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cephadm 2024-02-10T08:16:46.254287+0000 mgr.y (mgr.14146) 196 : cephadm [INF] Detected new or changed devices on smithi071 2024-02-10T08:16:47.752 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cephadm 2024-02-10T08:16:46.263518+0000 mgr.y (mgr.14146) 197 : cephadm [INF] Adjusting osd_memory_target on smithi071 to 4280M 2024-02-10T08:16:47.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cephadm 2024-02-10T08:16:46.254287+0000 mgr.y (mgr.14146) 196 : cephadm [INF] Detected new or changed devices on smithi071 2024-02-10T08:16:47.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cephadm 2024-02-10T08:16:46.263518+0000 mgr.y (mgr.14146) 197 : cephadm [INF] Adjusting osd_memory_target on smithi071 to 4280M 2024-02-10T08:16:47.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cephadm 2024-02-10T08:16:46.254287+0000 mgr.y (mgr.14146) 196 : cephadm [INF] Detected new or changed devices on smithi071 2024-02-10T08:16:47.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cephadm 2024-02-10T08:16:46.263518+0000 mgr.y (mgr.14146) 197 : cephadm [INF] Adjusting osd_memory_target on smithi071 to 4280M 2024-02-10T08:16:48.391 INFO:teuthology.orchestra.run.smithi071.stdout:Scheduled rgw.foo.a update... 2024-02-10T08:16:48.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:16:47.160340+0000 mgr.y (mgr.14146) 198 : cluster [DBG] pgmap v188: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T08:16:48.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:48.390418+0000 mon.a (mon.0) 532 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:16:48.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:48.394425+0000 mon.a (mon.0) 533 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:16:48.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:48.396187+0000 mon.a (mon.0) 534 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:16:48.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:48.397048+0000 mon.a (mon.0) 535 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:16:48.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:48.401745+0000 mon.a (mon.0) 536 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:16:48.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:48.407592+0000 mon.a (mon.0) 537 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:16:48.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:48.408227+0000 mon.a (mon.0) 538 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-10T08:16:48.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:48.411126+0000 mon.a (mon.0) 539 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-02-10T08:16:48.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:48.415050+0000 mon.a (mon.0) 540 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:16:48.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:48.415881+0000 mon.a (mon.0) 541 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:16:48.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:16:47.160340+0000 mgr.y (mgr.14146) 198 : cluster [DBG] pgmap v188: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T08:16:48.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:48.390418+0000 mon.a (mon.0) 532 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:16:48.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:48.394425+0000 mon.a (mon.0) 533 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:16:48.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:48.396187+0000 mon.a (mon.0) 534 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:16:48.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:48.397048+0000 mon.a (mon.0) 535 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:16:48.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:48.401745+0000 mon.a (mon.0) 536 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:16:48.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:48.407592+0000 mon.a (mon.0) 537 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:16:48.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:48.408227+0000 mon.a (mon.0) 538 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-10T08:16:48.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:48.411126+0000 mon.a (mon.0) 539 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-02-10T08:16:48.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:48.415050+0000 mon.a (mon.0) 540 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:16:48.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:48.415881+0000 mon.a (mon.0) 541 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:16:48.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:16:47.160340+0000 mgr.y (mgr.14146) 198 : cluster [DBG] pgmap v188: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T08:16:48.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:48.390418+0000 mon.a (mon.0) 532 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:16:48.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:48.394425+0000 mon.a (mon.0) 533 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:16:48.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:48.396187+0000 mon.a (mon.0) 534 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:16:48.906 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:48.397048+0000 mon.a (mon.0) 535 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:16:48.906 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:48.401745+0000 mon.a (mon.0) 536 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:16:48.906 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:48.407592+0000 mon.a (mon.0) 537 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:16:48.906 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:48.408227+0000 mon.a (mon.0) 538 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-10T08:16:48.906 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:48.411126+0000 mon.a (mon.0) 539 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-02-10T08:16:48.906 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:48.415050+0000 mon.a (mon.0) 540 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:16:48.906 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:48.415881+0000 mon.a (mon.0) 541 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:16:49.229 DEBUG:teuthology.orchestra.run.smithi018:rgw.foo.a> sudo journalctl -f -n 0 -u ceph-d46257c8-c7eb-11ee-95b8-87774f69a715@rgw.foo.a.service 2024-02-10T08:16:49.232 INFO:tasks.cephadm:Adding ceph.iscsi.iscsi.a on smithi071 2024-02-10T08:16:49.232 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd pool create iscsi 3 3 replicated 2024-02-10T08:16:49.262 INFO:journalctl@ceph.rgw.foo.a.smithi018.stdout:-- Logs begin at Sat 2024-02-10 07:59:20 UTC. -- 2024-02-10T08:16:49.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:49 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:48.384993+0000 mgr.y (mgr.14146) 199 : audit [DBG] from='client.24310 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;smithi018=foo.a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:16:49.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:49 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cephadm 2024-02-10T08:16:48.386559+0000 mgr.y (mgr.14146) 200 : cephadm [INF] Saving service rgw.foo.a spec with placement smithi018=foo.a;count:1 2024-02-10T08:16:49.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:49 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cephadm 2024-02-10T08:16:48.404315+0000 mgr.y (mgr.14146) 201 : cephadm [INF] Saving service rgw.foo.a spec with placement smithi018=foo.a;count:1 2024-02-10T08:16:49.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:49 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cephadm 2024-02-10T08:16:48.416587+0000 mgr.y (mgr.14146) 202 : cephadm [INF] Deploying daemon rgw.foo.a on smithi018 2024-02-10T08:16:49.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:49 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:16:48.779717+0000 osd.1 (osd.1) 7 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:16:49.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:49 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:16:48.779792+0000 osd.1 (osd.1) 8 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:16:49.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:48.384993+0000 mgr.y (mgr.14146) 199 : audit [DBG] from='client.24310 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;smithi018=foo.a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:16:49.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cephadm 2024-02-10T08:16:48.386559+0000 mgr.y (mgr.14146) 200 : cephadm [INF] Saving service rgw.foo.a spec with placement smithi018=foo.a;count:1 2024-02-10T08:16:49.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cephadm 2024-02-10T08:16:48.404315+0000 mgr.y (mgr.14146) 201 : cephadm [INF] Saving service rgw.foo.a spec with placement smithi018=foo.a;count:1 2024-02-10T08:16:49.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cephadm 2024-02-10T08:16:48.416587+0000 mgr.y (mgr.14146) 202 : cephadm [INF] Deploying daemon rgw.foo.a on smithi018 2024-02-10T08:16:49.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:16:48.779717+0000 osd.1 (osd.1) 7 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:16:49.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:16:48.779792+0000 osd.1 (osd.1) 8 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:16:49.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:48.384993+0000 mgr.y (mgr.14146) 199 : audit [DBG] from='client.24310 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;smithi018=foo.a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:16:49.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cephadm 2024-02-10T08:16:48.386559+0000 mgr.y (mgr.14146) 200 : cephadm [INF] Saving service rgw.foo.a spec with placement smithi018=foo.a;count:1 2024-02-10T08:16:49.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cephadm 2024-02-10T08:16:48.404315+0000 mgr.y (mgr.14146) 201 : cephadm [INF] Saving service rgw.foo.a spec with placement smithi018=foo.a;count:1 2024-02-10T08:16:49.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cephadm 2024-02-10T08:16:48.416587+0000 mgr.y (mgr.14146) 202 : cephadm [INF] Deploying daemon rgw.foo.a on smithi018 2024-02-10T08:16:49.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:16:48.779717+0000 osd.1 (osd.1) 7 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:16:49.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:16:48.779792+0000 osd.1 (osd.1) 8 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:16:50.624 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:16:49.160654+0000 mgr.y (mgr.14146) 203 : cluster [DBG] pgmap v189: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T08:16:50.624 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:16:49.514355+0000 mon.a (mon.0) 542 : cluster [DBG] osdmap e53: 8 total, 8 up, 8 in 2024-02-10T08:16:50.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:16:49.160654+0000 mgr.y (mgr.14146) 203 : cluster [DBG] pgmap v189: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T08:16:50.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:16:49.514355+0000 mon.a (mon.0) 542 : cluster [DBG] osdmap e53: 8 total, 8 up, 8 in 2024-02-10T08:16:50.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:16:49.160654+0000 mgr.y (mgr.14146) 203 : cluster [DBG] pgmap v189: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T08:16:50.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:16:49.514355+0000 mon.a (mon.0) 542 : cluster [DBG] osdmap e53: 8 total, 8 up, 8 in 2024-02-10T08:16:50.655 INFO:journalctl@ceph.rgw.foo.a.smithi018.stdout:Feb 10 08:16:50 smithi018 systemd[1]: Starting Ceph rgw.foo.a for d46257c8-c7eb-11ee-95b8-87774f69a715... 2024-02-10T08:16:51.404 INFO:journalctl@ceph.rgw.foo.a.smithi018.stdout:Feb 10 08:16:50 smithi018 bash[66225]: 17e3a1a40cf957ff6e5fd029f05c3dffdcc3e2bbf333147ce1b5ae95ff2c8931 2024-02-10T08:16:51.404 INFO:journalctl@ceph.rgw.foo.a.smithi018.stdout:Feb 10 08:16:50 smithi018 systemd[1]: Started Ceph rgw.foo.a for d46257c8-c7eb-11ee-95b8-87774f69a715. 2024-02-10T08:16:51.779 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'iscsi' created 2024-02-10T08:16:52.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:51 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:16:50.868141+0000 osd.4 (osd.4) 3 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:16:52.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:51 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:16:50.868243+0000 osd.4 (osd.4) 4 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:16:52.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:51 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:51.309924+0000 mon.b (mon.1) 24 : audit [INF] from='client.? 172.21.15.71:0/2764342401' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-02-10T08:16:52.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:16:50.868141+0000 osd.4 (osd.4) 3 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:16:52.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:16:50.868243+0000 osd.4 (osd.4) 4 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:16:52.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:51.309924+0000 mon.b (mon.1) 24 : audit [INF] from='client.? 172.21.15.71:0/2764342401' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-02-10T08:16:52.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:16:50.868141+0000 osd.4 (osd.4) 3 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:16:52.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:16:50.868243+0000 osd.4 (osd.4) 4 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:16:52.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:51.309924+0000 mon.b (mon.1) 24 : audit [INF] from='client.? 172.21.15.71:0/2764342401' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-02-10T08:16:52.472 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd pool application enable iscsi rbd 2024-02-10T08:16:52.771 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:52 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:16:51.160953+0000 mgr.y (mgr.14146) 204 : cluster [DBG] pgmap v191: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T08:16:53.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:52 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:51.336134+0000 mon.a (mon.0) 543 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-02-10T08:16:53.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:52 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:51.767285+0000 mon.a (mon.0) 544 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:16:53.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:52 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:51.768610+0000 mon.a (mon.0) 545 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:16:53.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:52 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:51.774190+0000 mon.a (mon.0) 546 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2024-02-10T08:16:53.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:52 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:16:51.774279+0000 mon.a (mon.0) 547 : cluster [DBG] osdmap e54: 8 total, 8 up, 8 in 2024-02-10T08:16:53.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:52 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:51.775101+0000 mon.c (mon.2) 13 : audit [INF] from='client.? 172.21.15.18:0/871408063' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-02-10T08:16:53.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:52 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:51.776627+0000 mon.a (mon.0) 548 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-02-10T08:16:53.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:16:51.160953+0000 mgr.y (mgr.14146) 204 : cluster [DBG] pgmap v191: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T08:16:53.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:51.336134+0000 mon.a (mon.0) 543 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-02-10T08:16:53.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:51.767285+0000 mon.a (mon.0) 544 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:16:53.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:51.768610+0000 mon.a (mon.0) 545 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:16:53.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:51.774190+0000 mon.a (mon.0) 546 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2024-02-10T08:16:53.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:16:51.774279+0000 mon.a (mon.0) 547 : cluster [DBG] osdmap e54: 8 total, 8 up, 8 in 2024-02-10T08:16:53.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:51.775101+0000 mon.c (mon.2) 13 : audit [INF] from='client.? 172.21.15.18:0/871408063' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-02-10T08:16:53.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:51.776627+0000 mon.a (mon.0) 548 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-02-10T08:16:53.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:16:51.160953+0000 mgr.y (mgr.14146) 204 : cluster [DBG] pgmap v191: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T08:16:53.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:51.336134+0000 mon.a (mon.0) 543 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-02-10T08:16:53.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:51.767285+0000 mon.a (mon.0) 544 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:16:53.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:51.768610+0000 mon.a (mon.0) 545 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:16:53.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:51.774190+0000 mon.a (mon.0) 546 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2024-02-10T08:16:53.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:16:51.774279+0000 mon.a (mon.0) 547 : cluster [DBG] osdmap e54: 8 total, 8 up, 8 in 2024-02-10T08:16:53.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:51.775101+0000 mon.c (mon.2) 13 : audit [INF] from='client.? 172.21.15.18:0/871408063' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-02-10T08:16:53.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:51.776627+0000 mon.a (mon.0) 548 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-02-10T08:16:53.948 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:53 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:52.777045+0000 mon.a (mon.0) 549 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-02-10T08:16:53.948 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:53 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:16:52.777199+0000 mon.a (mon.0) 550 : cluster [DBG] osdmap e55: 8 total, 8 up, 8 in 2024-02-10T08:16:53.948 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:53 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:53.262577+0000 mon.a (mon.0) 551 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:16:53.948 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:53 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:53.263360+0000 mon.a (mon.0) 552 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:16:53.948 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:53 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:53.263981+0000 mon.a (mon.0) 553 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:16:54.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:52.777045+0000 mon.a (mon.0) 549 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-02-10T08:16:54.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:16:52.777199+0000 mon.a (mon.0) 550 : cluster [DBG] osdmap e55: 8 total, 8 up, 8 in 2024-02-10T08:16:54.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:53.262577+0000 mon.a (mon.0) 551 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:16:54.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:53.263360+0000 mon.a (mon.0) 552 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:16:54.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:53.263981+0000 mon.a (mon.0) 553 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:16:54.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:52.777045+0000 mon.a (mon.0) 549 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-02-10T08:16:54.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:16:52.777199+0000 mon.a (mon.0) 550 : cluster [DBG] osdmap e55: 8 total, 8 up, 8 in 2024-02-10T08:16:54.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:53.262577+0000 mon.a (mon.0) 551 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:16:54.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:53.263360+0000 mon.a (mon.0) 552 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:16:54.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:53.263981+0000 mon.a (mon.0) 553 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:16:54.844 INFO:teuthology.orchestra.run.smithi071.stderr:enabled application 'rbd' on pool 'iscsi' 2024-02-10T08:16:55.149 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:54 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:16:53.161240+0000 mgr.y (mgr.14146) 205 : cluster [DBG] pgmap v194: 36 pgs: 3 creating+peering, 1 active+clean, 32 unknown; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T08:16:55.149 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:54 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cephadm 2024-02-10T08:16:53.268109+0000 mgr.y (mgr.14146) 206 : cephadm [INF] Checking dashboard <-> RGW credentials 2024-02-10T08:16:55.149 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:54 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:16:53.836131+0000 mon.a (mon.0) 554 : cluster [DBG] osdmap e56: 8 total, 8 up, 8 in 2024-02-10T08:16:55.150 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:54 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:53.837877+0000 mon.c (mon.2) 14 : audit [INF] from='client.? 172.21.15.18:0/871408063' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-02-10T08:16:55.150 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:54 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:53.838641+0000 mon.a (mon.0) 555 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-02-10T08:16:55.150 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:54 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:53.841524+0000 mon.a (mon.0) 556 : audit [INF] from='client.? 172.21.15.18:0/3759066403' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-02-10T08:16:55.150 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:54 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:54.608849+0000 mon.b (mon.1) 25 : audit [INF] from='client.? 172.21.15.71:0/2008828033' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]: dispatch 2024-02-10T08:16:55.150 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:54 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:54.609318+0000 mon.a (mon.0) 557 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]: dispatch 2024-02-10T08:16:55.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:16:53.161240+0000 mgr.y (mgr.14146) 205 : cluster [DBG] pgmap v194: 36 pgs: 3 creating+peering, 1 active+clean, 32 unknown; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T08:16:55.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cephadm 2024-02-10T08:16:53.268109+0000 mgr.y (mgr.14146) 206 : cephadm [INF] Checking dashboard <-> RGW credentials 2024-02-10T08:16:55.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:16:53.836131+0000 mon.a (mon.0) 554 : cluster [DBG] osdmap e56: 8 total, 8 up, 8 in 2024-02-10T08:16:55.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:53.837877+0000 mon.c (mon.2) 14 : audit [INF] from='client.? 172.21.15.18:0/871408063' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-02-10T08:16:55.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:53.838641+0000 mon.a (mon.0) 555 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-02-10T08:16:55.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:53.841524+0000 mon.a (mon.0) 556 : audit [INF] from='client.? 172.21.15.18:0/3759066403' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-02-10T08:16:55.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:54.608849+0000 mon.b (mon.1) 25 : audit [INF] from='client.? 172.21.15.71:0/2008828033' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]: dispatch 2024-02-10T08:16:55.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:54.609318+0000 mon.a (mon.0) 557 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]: dispatch 2024-02-10T08:16:55.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:16:53.161240+0000 mgr.y (mgr.14146) 205 : cluster [DBG] pgmap v194: 36 pgs: 3 creating+peering, 1 active+clean, 32 unknown; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T08:16:55.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cephadm 2024-02-10T08:16:53.268109+0000 mgr.y (mgr.14146) 206 : cephadm [INF] Checking dashboard <-> RGW credentials 2024-02-10T08:16:55.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:16:53.836131+0000 mon.a (mon.0) 554 : cluster [DBG] osdmap e56: 8 total, 8 up, 8 in 2024-02-10T08:16:55.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:53.837877+0000 mon.c (mon.2) 14 : audit [INF] from='client.? 172.21.15.18:0/871408063' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-02-10T08:16:55.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:53.838641+0000 mon.a (mon.0) 555 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-02-10T08:16:55.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:53.841524+0000 mon.a (mon.0) 556 : audit [INF] from='client.? 172.21.15.18:0/3759066403' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-02-10T08:16:55.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:54.608849+0000 mon.b (mon.1) 25 : audit [INF] from='client.? 172.21.15.71:0/2008828033' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]: dispatch 2024-02-10T08:16:55.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:54.609318+0000 mon.a (mon.0) 557 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]: dispatch 2024-02-10T08:16:55.483 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph orch apply iscsi iscsi user password --placement '1;smithi071=iscsi.a' 2024-02-10T08:16:56.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:54.837973+0000 mon.a (mon.0) 558 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-02-10T08:16:56.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:54.838156+0000 mon.a (mon.0) 559 : audit [INF] from='client.? 172.21.15.18:0/3759066403' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-02-10T08:16:56.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:54.838233+0000 mon.a (mon.0) 560 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]': finished 2024-02-10T08:16:56.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:16:54.838309+0000 mon.a (mon.0) 561 : cluster [DBG] osdmap e57: 8 total, 8 up, 8 in 2024-02-10T08:16:56.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:16:55.161568+0000 mgr.y (mgr.14146) 207 : cluster [DBG] pgmap v197: 68 pgs: 31 active+clean, 6 creating+activating, 9 creating+peering, 22 unknown; 1.2 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T08:16:56.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:55.728271+0000 mon.a (mon.0) 562 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:16:56.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:54.837973+0000 mon.a (mon.0) 558 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-02-10T08:16:56.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:54.838156+0000 mon.a (mon.0) 559 : audit [INF] from='client.? 172.21.15.18:0/3759066403' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-02-10T08:16:56.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:54.838233+0000 mon.a (mon.0) 560 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]': finished 2024-02-10T08:16:56.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:16:54.838309+0000 mon.a (mon.0) 561 : cluster [DBG] osdmap e57: 8 total, 8 up, 8 in 2024-02-10T08:16:56.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:16:55.161568+0000 mgr.y (mgr.14146) 207 : cluster [DBG] pgmap v197: 68 pgs: 31 active+clean, 6 creating+activating, 9 creating+peering, 22 unknown; 1.2 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T08:16:56.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:55.728271+0000 mon.a (mon.0) 562 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:16:56.228 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:54.837973+0000 mon.a (mon.0) 558 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-02-10T08:16:56.229 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:54.838156+0000 mon.a (mon.0) 559 : audit [INF] from='client.? 172.21.15.18:0/3759066403' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-02-10T08:16:56.229 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:54.838233+0000 mon.a (mon.0) 560 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]': finished 2024-02-10T08:16:56.229 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:16:54.838309+0000 mon.a (mon.0) 561 : cluster [DBG] osdmap e57: 8 total, 8 up, 8 in 2024-02-10T08:16:56.229 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:16:55.161568+0000 mgr.y (mgr.14146) 207 : cluster [DBG] pgmap v197: 68 pgs: 31 active+clean, 6 creating+activating, 9 creating+peering, 22 unknown; 1.2 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T08:16:56.229 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:55.728271+0000 mon.a (mon.0) 562 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:16:57.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:16:55.847953+0000 mon.a (mon.0) 563 : cluster [DBG] osdmap e58: 8 total, 8 up, 8 in 2024-02-10T08:16:57.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:55.850400+0000 mon.a (mon.0) 564 : audit [INF] from='client.? 172.21.15.18:0/3759066403' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-02-10T08:16:57.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:55.850670+0000 mon.c (mon.2) 15 : audit [INF] from='client.? 172.21.15.18:0/871408063' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-02-10T08:16:57.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:55.852899+0000 mon.a (mon.0) 565 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-02-10T08:16:57.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:16:55.847953+0000 mon.a (mon.0) 563 : cluster [DBG] osdmap e58: 8 total, 8 up, 8 in 2024-02-10T08:16:57.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:55.850400+0000 mon.a (mon.0) 564 : audit [INF] from='client.? 172.21.15.18:0/3759066403' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-02-10T08:16:57.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:55.850670+0000 mon.c (mon.2) 15 : audit [INF] from='client.? 172.21.15.18:0/871408063' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-02-10T08:16:57.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:55.852899+0000 mon.a (mon.0) 565 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-02-10T08:16:57.187 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:16:55.847953+0000 mon.a (mon.0) 563 : cluster [DBG] osdmap e58: 8 total, 8 up, 8 in 2024-02-10T08:16:57.187 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:55.850400+0000 mon.a (mon.0) 564 : audit [INF] from='client.? 172.21.15.18:0/3759066403' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-02-10T08:16:57.187 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:55.850670+0000 mon.c (mon.2) 15 : audit [INF] from='client.? 172.21.15.18:0/871408063' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-02-10T08:16:57.187 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:55.852899+0000 mon.a (mon.0) 565 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-02-10T08:16:57.789 INFO:teuthology.orchestra.run.smithi071.stdout:Scheduled iscsi.iscsi update... 2024-02-10T08:16:58.147 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:56.849628+0000 mon.a (mon.0) 566 : audit [INF] from='client.? 172.21.15.18:0/3759066403' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-02-10T08:16:58.147 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:56.849797+0000 mon.a (mon.0) 567 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-02-10T08:16:58.147 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:16:56.849927+0000 mon.a (mon.0) 568 : cluster [DBG] osdmap e59: 8 total, 8 up, 8 in 2024-02-10T08:16:58.147 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:16:57.161939+0000 mgr.y (mgr.14146) 208 : cluster [DBG] pgmap v200: 100 pgs: 48 active+clean, 6 creating+activating, 13 creating+peering, 33 unknown; 1.3 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 2.6 KiB/s rd, 880 B/s wr, 3 op/s 2024-02-10T08:16:58.147 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:57.587744+0000 mgr.y (mgr.14146) 209 : audit [DBG] from='client.24373 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "iscsi", "api_user": "user", "api_password": "password", "placement": "1;smithi071=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:16:58.147 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cephadm 2024-02-10T08:16:57.589611+0000 mgr.y (mgr.14146) 210 : cephadm [INF] Saving service iscsi.iscsi spec with placement smithi071=iscsi.a;count:1 2024-02-10T08:16:58.148 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:57.788788+0000 mon.a (mon.0) 569 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:16:58.148 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:16:57.849754+0000 mon.a (mon.0) 570 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2024-02-10T08:16:58.148 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:57.852025+0000 mon.b (mon.1) 26 : audit [INF] from='client.? 172.21.15.18:0/2139535642' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-02-10T08:16:58.148 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:57.852814+0000 mon.a (mon.0) 571 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-02-10T08:16:58.148 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:57.852897+0000 mon.b (mon.1) 27 : audit [INF] from='client.? 172.21.15.18:0/638369174' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-02-10T08:16:58.148 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:57.854265+0000 mon.a (mon.0) 572 : audit [INF] from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-02-10T08:16:58.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:56.849628+0000 mon.a (mon.0) 566 : audit [INF] from='client.? 172.21.15.18:0/3759066403' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-02-10T08:16:58.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:56.849797+0000 mon.a (mon.0) 567 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-02-10T08:16:58.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:16:56.849927+0000 mon.a (mon.0) 568 : cluster [DBG] osdmap e59: 8 total, 8 up, 8 in 2024-02-10T08:16:58.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:16:57.161939+0000 mgr.y (mgr.14146) 208 : cluster [DBG] pgmap v200: 100 pgs: 48 active+clean, 6 creating+activating, 13 creating+peering, 33 unknown; 1.3 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 2.6 KiB/s rd, 880 B/s wr, 3 op/s 2024-02-10T08:16:58.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:57.587744+0000 mgr.y (mgr.14146) 209 : audit [DBG] from='client.24373 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "iscsi", "api_user": "user", "api_password": "password", "placement": "1;smithi071=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:16:58.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cephadm 2024-02-10T08:16:57.589611+0000 mgr.y (mgr.14146) 210 : cephadm [INF] Saving service iscsi.iscsi spec with placement smithi071=iscsi.a;count:1 2024-02-10T08:16:58.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:57.788788+0000 mon.a (mon.0) 569 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:16:58.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:16:57.849754+0000 mon.a (mon.0) 570 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2024-02-10T08:16:58.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:57.852025+0000 mon.b (mon.1) 26 : audit [INF] from='client.? 172.21.15.18:0/2139535642' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-02-10T08:16:58.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:57.852814+0000 mon.a (mon.0) 571 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-02-10T08:16:58.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:57.852897+0000 mon.b (mon.1) 27 : audit [INF] from='client.? 172.21.15.18:0/638369174' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-02-10T08:16:58.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:57.854265+0000 mon.a (mon.0) 572 : audit [INF] from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-02-10T08:16:58.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:56.849628+0000 mon.a (mon.0) 566 : audit [INF] from='client.? 172.21.15.18:0/3759066403' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-02-10T08:16:58.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:56.849797+0000 mon.a (mon.0) 567 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-02-10T08:16:58.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:16:56.849927+0000 mon.a (mon.0) 568 : cluster [DBG] osdmap e59: 8 total, 8 up, 8 in 2024-02-10T08:16:58.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:16:57.161939+0000 mgr.y (mgr.14146) 208 : cluster [DBG] pgmap v200: 100 pgs: 48 active+clean, 6 creating+activating, 13 creating+peering, 33 unknown; 1.3 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 2.6 KiB/s rd, 880 B/s wr, 3 op/s 2024-02-10T08:16:58.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:57.587744+0000 mgr.y (mgr.14146) 209 : audit [DBG] from='client.24373 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "iscsi", "api_user": "user", "api_password": "password", "placement": "1;smithi071=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:16:58.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cephadm 2024-02-10T08:16:57.589611+0000 mgr.y (mgr.14146) 210 : cephadm [INF] Saving service iscsi.iscsi spec with placement smithi071=iscsi.a;count:1 2024-02-10T08:16:58.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:57.788788+0000 mon.a (mon.0) 569 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:16:58.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:16:57.849754+0000 mon.a (mon.0) 570 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2024-02-10T08:16:58.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:57.852025+0000 mon.b (mon.1) 26 : audit [INF] from='client.? 172.21.15.18:0/2139535642' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-02-10T08:16:58.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:57.852814+0000 mon.a (mon.0) 571 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-02-10T08:16:58.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:57.852897+0000 mon.b (mon.1) 27 : audit [INF] from='client.? 172.21.15.18:0/638369174' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-02-10T08:16:58.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:57.854265+0000 mon.a (mon.0) 572 : audit [INF] from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-02-10T08:16:58.515 DEBUG:teuthology.orchestra.run.smithi071:iscsi.iscsi.a> sudo journalctl -f -n 0 -u ceph-d46257c8-c7eb-11ee-95b8-87774f69a715@iscsi.iscsi.a.service 2024-02-10T08:16:58.518 INFO:tasks.cephadm:Adding prometheus.a on smithi071 2024-02-10T08:16:58.518 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph orch apply prometheus '1;smithi071=a' 2024-02-10T08:16:58.548 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:-- Logs begin at Sat 2024-02-10 07:59:38 UTC. -- 2024-02-10T08:17:00.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:59 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:16:58.286894+0000 osd.5 (osd.5) 3 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:17:00.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:59 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:16:58.286938+0000 osd.5 (osd.5) 4 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:17:00.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:59 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:58.852273+0000 mon.a (mon.0) 573 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-02-10T08:17:00.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:59 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:58.852428+0000 mon.a (mon.0) 574 : audit [INF] from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-02-10T08:17:00.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:59 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:16:58.852553+0000 mon.a (mon.0) 575 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2024-02-10T08:17:00.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:59 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:58.856219+0000 mon.b (mon.1) 28 : audit [INF] from='client.? 172.21.15.18:0/2139535642' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-02-10T08:17:00.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:59 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:58.860266+0000 mon.a (mon.0) 576 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-02-10T08:17:00.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:59 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:58.862852+0000 mon.b (mon.1) 29 : audit [INF] from='client.? 172.21.15.18:0/638369174' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-02-10T08:17:00.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:59 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:58.863863+0000 mon.a (mon.0) 577 : audit [INF] from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-02-10T08:17:00.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:16:59 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:16:59.162552+0000 mgr.y (mgr.14146) 211 : cluster [DBG] pgmap v203: 132 pgs: 71 active+clean, 6 creating+activating, 5 creating+peering, 50 unknown; 1.3 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 2.2 KiB/s rd, 767 B/s wr, 3 op/s 2024-02-10T08:17:00.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:16:58.286894+0000 osd.5 (osd.5) 3 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:17:00.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:16:58.286938+0000 osd.5 (osd.5) 4 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:17:00.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:58.852273+0000 mon.a (mon.0) 573 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-02-10T08:17:00.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:58.852428+0000 mon.a (mon.0) 574 : audit [INF] from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-02-10T08:17:00.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:16:58.852553+0000 mon.a (mon.0) 575 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2024-02-10T08:17:00.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:58.856219+0000 mon.b (mon.1) 28 : audit [INF] from='client.? 172.21.15.18:0/2139535642' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-02-10T08:17:00.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:58.860266+0000 mon.a (mon.0) 576 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-02-10T08:17:00.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:58.862852+0000 mon.b (mon.1) 29 : audit [INF] from='client.? 172.21.15.18:0/638369174' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-02-10T08:17:00.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:58.863863+0000 mon.a (mon.0) 577 : audit [INF] from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-02-10T08:17:00.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:16:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:16:59.162552+0000 mgr.y (mgr.14146) 211 : cluster [DBG] pgmap v203: 132 pgs: 71 active+clean, 6 creating+activating, 5 creating+peering, 50 unknown; 1.3 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 2.2 KiB/s rd, 767 B/s wr, 3 op/s 2024-02-10T08:17:00.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:16:58.286894+0000 osd.5 (osd.5) 3 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:17:00.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:16:58.286938+0000 osd.5 (osd.5) 4 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:17:00.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:58.852273+0000 mon.a (mon.0) 573 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-02-10T08:17:00.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:58.852428+0000 mon.a (mon.0) 574 : audit [INF] from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-02-10T08:17:00.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:16:58.852553+0000 mon.a (mon.0) 575 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2024-02-10T08:17:00.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:58.856219+0000 mon.b (mon.1) 28 : audit [INF] from='client.? 172.21.15.18:0/2139535642' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-02-10T08:17:00.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:58.860266+0000 mon.a (mon.0) 576 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-02-10T08:17:00.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:58.862852+0000 mon.b (mon.1) 29 : audit [INF] from='client.? 172.21.15.18:0/638369174' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-02-10T08:17:00.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:58.863863+0000 mon.a (mon.0) 577 : audit [INF] from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-02-10T08:17:00.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:16:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:16:59.162552+0000 mgr.y (mgr.14146) 211 : cluster [DBG] pgmap v203: 132 pgs: 71 active+clean, 6 creating+activating, 5 creating+peering, 50 unknown; 1.3 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 2.2 KiB/s rd, 767 B/s wr, 3 op/s 2024-02-10T08:17:00.721 INFO:teuthology.orchestra.run.smithi071.stdout:Scheduled prometheus update... 2024-02-10T08:17:01.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:59.857438+0000 mon.a (mon.0) 578 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-02-10T08:17:01.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:16:59.857556+0000 mon.a (mon.0) 579 : audit [INF] from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-02-10T08:17:01.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:16:59.857641+0000 mon.a (mon.0) 580 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2024-02-10T08:17:01.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:00.018499+0000 mon.a (mon.0) 581 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:17:01.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:00.025004+0000 mon.a (mon.0) 582 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:17:01.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:00.030409+0000 mon.a (mon.0) 583 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:17:01.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cephadm 2024-02-10T08:17:00.034383+0000 mgr.y (mgr.14146) 212 : cephadm [INF] Checking pool "iscsi" exists for service iscsi.iscsi 2024-02-10T08:17:01.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:00.043029+0000 mon.a (mon.0) 584 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-02-10T08:17:01.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:00.046664+0000 mon.a (mon.0) 585 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2024-02-10T08:17:01.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:00.055007+0000 mon.a (mon.0) 586 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:17:01.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cephadm 2024-02-10T08:17:00.055859+0000 mgr.y (mgr.14146) 213 : cephadm [INF] Deploying daemon iscsi.iscsi.a on smithi071 2024-02-10T08:17:01.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:00.720313+0000 mon.a (mon.0) 587 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:17:01.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:59.857438+0000 mon.a (mon.0) 578 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-02-10T08:17:01.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:16:59.857556+0000 mon.a (mon.0) 579 : audit [INF] from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-02-10T08:17:01.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:16:59.857641+0000 mon.a (mon.0) 580 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2024-02-10T08:17:01.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:00.018499+0000 mon.a (mon.0) 581 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:17:01.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:00.025004+0000 mon.a (mon.0) 582 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:17:01.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:00.030409+0000 mon.a (mon.0) 583 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:17:01.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cephadm 2024-02-10T08:17:00.034383+0000 mgr.y (mgr.14146) 212 : cephadm [INF] Checking pool "iscsi" exists for service iscsi.iscsi 2024-02-10T08:17:01.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:00.043029+0000 mon.a (mon.0) 584 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-02-10T08:17:01.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:00.046664+0000 mon.a (mon.0) 585 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2024-02-10T08:17:01.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:00.055007+0000 mon.a (mon.0) 586 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:17:01.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cephadm 2024-02-10T08:17:00.055859+0000 mgr.y (mgr.14146) 213 : cephadm [INF] Deploying daemon iscsi.iscsi.a on smithi071 2024-02-10T08:17:01.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:00.720313+0000 mon.a (mon.0) 587 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:17:01.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:59.857438+0000 mon.a (mon.0) 578 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-02-10T08:17:01.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:16:59.857556+0000 mon.a (mon.0) 579 : audit [INF] from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-02-10T08:17:01.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:16:59.857641+0000 mon.a (mon.0) 580 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2024-02-10T08:17:01.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:00.018499+0000 mon.a (mon.0) 581 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:17:01.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:00.025004+0000 mon.a (mon.0) 582 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:17:01.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:00.030409+0000 mon.a (mon.0) 583 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:17:01.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cephadm 2024-02-10T08:17:00.034383+0000 mgr.y (mgr.14146) 212 : cephadm [INF] Checking pool "iscsi" exists for service iscsi.iscsi 2024-02-10T08:17:01.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:00.043029+0000 mon.a (mon.0) 584 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-02-10T08:17:01.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:00.046664+0000 mon.a (mon.0) 585 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2024-02-10T08:17:01.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:00.055007+0000 mon.a (mon.0) 586 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:17:01.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cephadm 2024-02-10T08:17:00.055859+0000 mgr.y (mgr.14146) 213 : cephadm [INF] Deploying daemon iscsi.iscsi.a on smithi071 2024-02-10T08:17:01.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:00.720313+0000 mon.a (mon.0) 587 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:17:01.389 DEBUG:teuthology.orchestra.run.smithi071:prometheus.a> sudo journalctl -f -n 0 -u ceph-d46257c8-c7eb-11ee-95b8-87774f69a715@prometheus.a.service 2024-02-10T08:17:01.391 INFO:tasks.cephadm:Adding node-exporter.a on smithi018 2024-02-10T08:17:01.391 INFO:tasks.cephadm:Adding node-exporter.b on smithi071 2024-02-10T08:17:01.391 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph orch apply node-exporter '2;smithi018=a;smithi071=b' 2024-02-10T08:17:01.420 INFO:journalctl@ceph.prometheus.a.smithi071.stdout:-- Logs begin at Sat 2024-02-10 07:59:38 UTC. -- 2024-02-10T08:17:02.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:00.714785+0000 mgr.y (mgr.14146) 214 : audit [DBG] from='client.24400 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi071=a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:17:02.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cephadm 2024-02-10T08:17:00.716320+0000 mgr.y (mgr.14146) 215 : cephadm [INF] Saving service prometheus spec with placement smithi071=a;count:1 2024-02-10T08:17:02.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:01.163325+0000 mgr.y (mgr.14146) 216 : cluster [DBG] pgmap v205: 132 pgs: 118 active+clean, 4 creating+peering, 10 unknown; 2.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 20 KiB/s rd, 2.8 KiB/s wr, 51 op/s 2024-02-10T08:17:02.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:01.726877+0000 mon.a (mon.0) 588 : cluster [DBG] mgrmap e15: y(active, since 5m), standbys: x 2024-02-10T08:17:02.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:00.714785+0000 mgr.y (mgr.14146) 214 : audit [DBG] from='client.24400 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi071=a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:17:02.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cephadm 2024-02-10T08:17:00.716320+0000 mgr.y (mgr.14146) 215 : cephadm [INF] Saving service prometheus spec with placement smithi071=a;count:1 2024-02-10T08:17:02.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:01.163325+0000 mgr.y (mgr.14146) 216 : cluster [DBG] pgmap v205: 132 pgs: 118 active+clean, 4 creating+peering, 10 unknown; 2.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 20 KiB/s rd, 2.8 KiB/s wr, 51 op/s 2024-02-10T08:17:02.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:01.726877+0000 mon.a (mon.0) 588 : cluster [DBG] mgrmap e15: y(active, since 5m), standbys: x 2024-02-10T08:17:02.187 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:00.714785+0000 mgr.y (mgr.14146) 214 : audit [DBG] from='client.24400 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi071=a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:17:02.187 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cephadm 2024-02-10T08:17:00.716320+0000 mgr.y (mgr.14146) 215 : cephadm [INF] Saving service prometheus spec with placement smithi071=a;count:1 2024-02-10T08:17:02.187 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:01.163325+0000 mgr.y (mgr.14146) 216 : cluster [DBG] pgmap v205: 132 pgs: 118 active+clean, 4 creating+peering, 10 unknown; 2.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 20 KiB/s rd, 2.8 KiB/s wr, 51 op/s 2024-02-10T08:17:02.187 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:01.726877+0000 mon.a (mon.0) 588 : cluster [DBG] mgrmap e15: y(active, since 5m), standbys: x 2024-02-10T08:17:03.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:01.886252+0000 osd.2 (osd.2) 5 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:17:03.020 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:01.886338+0000 osd.2 (osd.2) 6 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:17:03.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:01.886252+0000 osd.2 (osd.2) 5 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:17:03.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:01.886338+0000 osd.2 (osd.2) 6 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:17:03.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:01.886252+0000 osd.2 (osd.2) 5 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:17:03.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:01.886338+0000 osd.2 (osd.2) 6 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:17:04.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:02.866776+0000 mon.a (mon.0) 589 : cluster [DBG] osdmap e63: 8 total, 8 up, 8 in 2024-02-10T08:17:04.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:03.163733+0000 mgr.y (mgr.14146) 217 : cluster [DBG] pgmap v207: 132 pgs: 132 active+clean; 4.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 52 KiB/s rd, 4.9 KiB/s wr, 128 op/s 2024-02-10T08:17:04.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:02.866776+0000 mon.a (mon.0) 589 : cluster [DBG] osdmap e63: 8 total, 8 up, 8 in 2024-02-10T08:17:04.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:03.163733+0000 mgr.y (mgr.14146) 217 : cluster [DBG] pgmap v207: 132 pgs: 132 active+clean; 4.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 52 KiB/s rd, 4.9 KiB/s wr, 128 op/s 2024-02-10T08:17:04.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:02.866776+0000 mon.a (mon.0) 589 : cluster [DBG] osdmap e63: 8 total, 8 up, 8 in 2024-02-10T08:17:04.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:03.163733+0000 mgr.y (mgr.14146) 217 : cluster [DBG] pgmap v207: 132 pgs: 132 active+clean; 4.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 52 KiB/s rd, 4.9 KiB/s wr, 128 op/s 2024-02-10T08:17:04.218 INFO:teuthology.orchestra.run.smithi071.stdout:Scheduled node-exporter update... 2024-02-10T08:17:04.789 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:17:04 smithi071 bash[62078]: log file path now is '/var/log/tcmu-runner.log' 2024-02-10T08:17:05.198 DEBUG:teuthology.orchestra.run.smithi018:node-exporter.a> sudo journalctl -f -n 0 -u ceph-d46257c8-c7eb-11ee-95b8-87774f69a715@node-exporter.a.service 2024-02-10T08:17:05.202 DEBUG:teuthology.orchestra.run.smithi071:node-exporter.b> sudo journalctl -f -n 0 -u ceph-d46257c8-c7eb-11ee-95b8-87774f69a715@node-exporter.b.service 2024-02-10T08:17:05.205 INFO:tasks.cephadm:Adding alertmanager.a on smithi018 2024-02-10T08:17:05.206 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph orch apply alertmanager '1;smithi018=a' 2024-02-10T08:17:05.235 INFO:journalctl@ceph.node-exporter.b.smithi071.stdout:-- Logs begin at Sat 2024-02-10 07:59:38 UTC. -- 2024-02-10T08:17:05.240 INFO:journalctl@ceph.node-exporter.a.smithi018.stdout:-- Logs begin at Sat 2024-02-10 07:59:20 UTC. -- 2024-02-10T08:17:05.416 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:04.153270+0000 mgr.y (mgr.14146) 218 : audit [DBG] from='client.24406 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi018=a;smithi071=b", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:17:05.416 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cephadm 2024-02-10T08:17:04.154793+0000 mgr.y (mgr.14146) 219 : cephadm [INF] Saving service node-exporter spec with placement smithi018=a;smithi071=b;count:2 2024-02-10T08:17:05.416 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:04.158727+0000 mon.a (mon.0) 590 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:17:05.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:04.153270+0000 mgr.y (mgr.14146) 218 : audit [DBG] from='client.24406 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi018=a;smithi071=b", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:17:05.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cephadm 2024-02-10T08:17:04.154793+0000 mgr.y (mgr.14146) 219 : cephadm [INF] Saving service node-exporter spec with placement smithi018=a;smithi071=b;count:2 2024-02-10T08:17:05.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:04.158727+0000 mon.a (mon.0) 590 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:17:05.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:04.153270+0000 mgr.y (mgr.14146) 218 : audit [DBG] from='client.24406 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi018=a;smithi071=b", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:17:05.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cephadm 2024-02-10T08:17:04.154793+0000 mgr.y (mgr.14146) 219 : cephadm [INF] Saving service node-exporter spec with placement smithi018=a;smithi071=b;count:2 2024-02-10T08:17:05.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:04.158727+0000 mon.a (mon.0) 590 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:17:05.789 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:17:05 smithi071 bash[62224]: 087f8d42628756e9d1d426333c36f6d9a47778834989186b93b0b98db21647e7 2024-02-10T08:17:05.789 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:17:05 smithi071 systemd[1]: Started Ceph iscsi.iscsi.a for d46257c8-c7eb-11ee-95b8-87774f69a715. 2024-02-10T08:17:06.109 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:17:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug Started the configuration object watcher 2024-02-10T08:17:06.110 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:17:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug Checking for config object changes every 1s 2024-02-10T08:17:06.110 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:17:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug Processing osd blocklist entries for this node 2024-02-10T08:17:06.110 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:17:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug Reading the configuration object to update local LIO configuration 2024-02-10T08:17:06.110 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:17:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug Configuration does not have an entry for this host(smithi071.front.sepia.ceph.com) - nothing to define to LIO 2024-02-10T08:17:06.539 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:17:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug * Running on http://[::]:5000/ (Press CTRL+C to quit) 2024-02-10T08:17:06.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:05.164411+0000 mgr.y (mgr.14146) 220 : cluster [DBG] pgmap v208: 132 pgs: 132 active+clean; 5.3 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 73 KiB/s rd, 5.7 KiB/s wr, 178 op/s 2024-02-10T08:17:06.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:05.722312+0000 mon.a (mon.0) 591 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:17:06.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:05.723795+0000 mon.a (mon.0) 592 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:17:06.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:05.738581+0000 mon.a (mon.0) 593 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:17:06.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:06.096604+0000 mon.b (mon.1) 30 : audit [DBG] from='client.? 172.21.15.71:0/3400119123' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-02-10T08:17:06.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:05.164411+0000 mgr.y (mgr.14146) 220 : cluster [DBG] pgmap v208: 132 pgs: 132 active+clean; 5.3 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 73 KiB/s rd, 5.7 KiB/s wr, 178 op/s 2024-02-10T08:17:06.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:05.722312+0000 mon.a (mon.0) 591 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:17:06.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:05.723795+0000 mon.a (mon.0) 592 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:17:06.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:05.738581+0000 mon.a (mon.0) 593 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:17:06.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:06.096604+0000 mon.b (mon.1) 30 : audit [DBG] from='client.? 172.21.15.71:0/3400119123' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-02-10T08:17:06.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:05.164411+0000 mgr.y (mgr.14146) 220 : cluster [DBG] pgmap v208: 132 pgs: 132 active+clean; 5.3 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 73 KiB/s rd, 5.7 KiB/s wr, 178 op/s 2024-02-10T08:17:06.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:05.722312+0000 mon.a (mon.0) 591 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:17:06.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:05.723795+0000 mon.a (mon.0) 592 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:17:06.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:05.738581+0000 mon.a (mon.0) 593 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:17:06.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:06.096604+0000 mon.b (mon.1) 30 : audit [DBG] from='client.? 172.21.15.71:0/3400119123' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-02-10T08:17:07.764 INFO:teuthology.orchestra.run.smithi071.stdout:Scheduled alertmanager update... 2024-02-10T08:17:08.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:07.165011+0000 mgr.y (mgr.14146) 221 : cluster [DBG] pgmap v209: 132 pgs: 132 active+clean; 5.3 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 58 KiB/s rd, 4.4 KiB/s wr, 140 op/s 2024-02-10T08:17:08.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:07.763206+0000 mon.a (mon.0) 594 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:17:08.581 DEBUG:teuthology.orchestra.run.smithi018:alertmanager.a> sudo journalctl -f -n 0 -u ceph-d46257c8-c7eb-11ee-95b8-87774f69a715@alertmanager.a.service 2024-02-10T08:17:08.585 INFO:tasks.cephadm:Adding grafana.a on smithi071 2024-02-10T08:17:08.585 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph orch apply grafana '1;smithi071=a' 2024-02-10T08:17:08.613 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:07.165011+0000 mgr.y (mgr.14146) 221 : cluster [DBG] pgmap v209: 132 pgs: 132 active+clean; 5.3 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 58 KiB/s rd, 4.4 KiB/s wr, 140 op/s 2024-02-10T08:17:08.614 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:07.763206+0000 mon.a (mon.0) 594 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:17:08.614 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:07.165011+0000 mgr.y (mgr.14146) 221 : cluster [DBG] pgmap v209: 132 pgs: 132 active+clean; 5.3 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 58 KiB/s rd, 4.4 KiB/s wr, 140 op/s 2024-02-10T08:17:08.614 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:07.763206+0000 mon.a (mon.0) 594 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:17:08.619 INFO:journalctl@ceph.alertmanager.a.smithi018.stdout:-- Logs begin at Sat 2024-02-10 07:59:20 UTC. -- 2024-02-10T08:17:09.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:07.758204+0000 mgr.y (mgr.14146) 222 : audit [DBG] from='client.24436 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi018=a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:17:09.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cephadm 2024-02-10T08:17:07.759667+0000 mgr.y (mgr.14146) 223 : cephadm [INF] Saving service alertmanager spec with placement smithi018=a;count:1 2024-02-10T08:17:09.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:07.758204+0000 mgr.y (mgr.14146) 222 : audit [DBG] from='client.24436 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi018=a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:17:09.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cephadm 2024-02-10T08:17:07.759667+0000 mgr.y (mgr.14146) 223 : cephadm [INF] Saving service alertmanager spec with placement smithi018=a;count:1 2024-02-10T08:17:09.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:07.758204+0000 mgr.y (mgr.14146) 222 : audit [DBG] from='client.24436 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi018=a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:17:09.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cephadm 2024-02-10T08:17:07.759667+0000 mgr.y (mgr.14146) 223 : cephadm [INF] Saving service alertmanager spec with placement smithi018=a;count:1 2024-02-10T08:17:10.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:09.165626+0000 mgr.y (mgr.14146) 224 : cluster [DBG] pgmap v210: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 50 KiB/s rd, 3.9 KiB/s wr, 121 op/s 2024-02-10T08:17:10.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:09.533187+0000 osd.7 (osd.7) 3 : cluster [DBG] 1.0 scrub starts 2024-02-10T08:17:10.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:09.536157+0000 osd.7 (osd.7) 4 : cluster [DBG] 1.0 scrub ok 2024-02-10T08:17:10.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:09.857486+0000 mon.a (mon.0) 595 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:17:10.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:09.858503+0000 mon.a (mon.0) 596 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:17:10.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:09.859408+0000 mon.a (mon.0) 597 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:17:10.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:09.864992+0000 mon.a (mon.0) 598 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:17:10.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:09.870240+0000 mon.a (mon.0) 599 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-02-10T08:17:10.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:09.165626+0000 mgr.y (mgr.14146) 224 : cluster [DBG] pgmap v210: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 50 KiB/s rd, 3.9 KiB/s wr, 121 op/s 2024-02-10T08:17:10.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:09.533187+0000 osd.7 (osd.7) 3 : cluster [DBG] 1.0 scrub starts 2024-02-10T08:17:10.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:09.536157+0000 osd.7 (osd.7) 4 : cluster [DBG] 1.0 scrub ok 2024-02-10T08:17:10.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:09.857486+0000 mon.a (mon.0) 595 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:17:10.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:09.858503+0000 mon.a (mon.0) 596 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:17:10.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:09.859408+0000 mon.a (mon.0) 597 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:17:10.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:09.864992+0000 mon.a (mon.0) 598 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:17:10.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:09.870240+0000 mon.a (mon.0) 599 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-02-10T08:17:10.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:09.165626+0000 mgr.y (mgr.14146) 224 : cluster [DBG] pgmap v210: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 50 KiB/s rd, 3.9 KiB/s wr, 121 op/s 2024-02-10T08:17:10.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:09.533187+0000 osd.7 (osd.7) 3 : cluster [DBG] 1.0 scrub starts 2024-02-10T08:17:10.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:09.536157+0000 osd.7 (osd.7) 4 : cluster [DBG] 1.0 scrub ok 2024-02-10T08:17:10.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:09.857486+0000 mon.a (mon.0) 595 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:17:10.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:09.858503+0000 mon.a (mon.0) 596 : audit [DBG] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:17:10.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:09.859408+0000 mon.a (mon.0) 597 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:17:10.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:09.864992+0000 mon.a (mon.0) 598 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:17:10.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:09.870240+0000 mon.a (mon.0) 599 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-02-10T08:17:11.117 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:17:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ignoring --setuser ceph since I am not root 2024-02-10T08:17:11.117 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:17:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ignoring --setgroup ceph since I am not root 2024-02-10T08:17:11.117 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:17:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: debug 2024-02-10T08:17:10.908+0000 7f26c88f4700 1 -- 172.21.15.71:0/3735813778 <== mon.1 v2:172.21.15.71:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5634426f04e0 con 0x5634426c6c00 2024-02-10T08:17:11.117 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:17:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: debug 2024-02-10T08:17:11.028+0000 7f26d8ad2680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-10T08:17:11.154 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:17:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ignoring --setuser ceph since I am not root 2024-02-10T08:17:11.154 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:17:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ignoring --setgroup ceph since I am not root 2024-02-10T08:17:11.154 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:17:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:17:10.908+0000 7f5335115700 1 -- 172.21.15.18:0/1841155643 <== mon.2 v2:172.21.15.18:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5621415b24e0 con 0x562141589000 2024-02-10T08:17:11.154 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:17:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:17:11.035+0000 7f53452f3680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-10T08:17:11.154 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:17:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:17:11.120+0000 7f53452f3680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-10T08:17:11.491 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:17:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: debug 2024-02-10T08:17:11.115+0000 7f26d8ad2680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-10T08:17:11.745 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:17:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: debug 2024-02-10T08:17:11.490+0000 7f26d8ad2680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-10T08:17:11.904 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:17:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:17:11.500+0000 7f53452f3680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-10T08:17:11.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:10.746573+0000 mon.a (mon.0) 600 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:17:11.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:10.870360+0000 mon.a (mon.0) 601 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-02-10T08:17:11.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:10.870430+0000 mon.a (mon.0) 602 : cluster [DBG] mgrmap e16: y(active, since 5m), standbys: x 2024-02-10T08:17:11.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:10.746573+0000 mon.a (mon.0) 600 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:17:11.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:10.870360+0000 mon.a (mon.0) 601 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-02-10T08:17:11.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:10.870430+0000 mon.a (mon.0) 602 : cluster [DBG] mgrmap e16: y(active, since 5m), standbys: x 2024-02-10T08:17:12.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:10.746573+0000 mon.a (mon.0) 600 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' 2024-02-10T08:17:12.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:10.870360+0000 mon.a (mon.0) 601 : audit [INF] from='mgr.14146 172.21.15.18:0/295295375' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-02-10T08:17:12.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:10.870430+0000 mon.a (mon.0) 602 : cluster [DBG] mgrmap e16: y(active, since 5m), standbys: x 2024-02-10T08:17:12.520 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:17:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: debug 2024-02-10T08:17:12.226+0000 7f26d8ad2680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-10T08:17:12.520 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:17:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: debug 2024-02-10T08:17:12.310+0000 7f26d8ad2680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-10T08:17:12.593 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:17:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:17:12.290+0000 7f53452f3680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-10T08:17:12.593 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:17:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:17:12.372+0000 7f53452f3680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-10T08:17:12.789 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:17:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: debug 2024-02-10T08:17:12.519+0000 7f26d8ad2680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-10T08:17:13.749 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:17:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: debug 2024-02-10T08:17:13.451+0000 7f26d8ad2680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-10T08:17:13.749 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:17:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: debug 2024-02-10T08:17:13.578+0000 7f26d8ad2680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-10T08:17:13.749 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:17:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: debug 2024-02-10T08:17:13.657+0000 7f26d8ad2680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-10T08:17:13.885 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:17:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:17:12.592+0000 7f53452f3680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-10T08:17:13.885 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:17:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:17:13.573+0000 7f53452f3680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-10T08:17:13.885 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:17:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:17:13.707+0000 7f53452f3680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-10T08:17:13.885 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:17:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:17:13.790+0000 7f53452f3680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-10T08:17:14.039 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:17:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: debug 2024-02-10T08:17:13.747+0000 7f26d8ad2680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-10T08:17:14.039 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:17:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: debug 2024-02-10T08:17:13.940+0000 7f26d8ad2680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-10T08:17:14.154 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:17:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:17:13.884+0000 7f53452f3680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-10T08:17:14.154 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:17:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:17:14.086+0000 7f53452f3680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-10T08:17:14.539 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:17:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: debug 2024-02-10T08:17:14.217+0000 7f26d8ad2680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-10T08:17:14.539 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:17:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: debug 2024-02-10T08:17:14.314+0000 7f26d8ad2680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-10T08:17:14.654 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:17:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:17:14.380+0000 7f53452f3680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-10T08:17:14.654 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:17:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:17:14.483+0000 7f53452f3680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-10T08:17:15.289 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:17:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: debug 2024-02-10T08:17:15.030+0000 7f26d8ad2680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-10T08:17:15.289 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:17:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: debug 2024-02-10T08:17:15.111+0000 7f26d8ad2680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-10T08:17:15.290 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:17:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: debug 2024-02-10T08:17:15.201+0000 7f26d8ad2680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-10T08:17:15.607 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:17:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:17:15.243+0000 7f53452f3680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-10T08:17:15.607 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:17:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:17:15.328+0000 7f53452f3680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-10T08:17:15.607 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:17:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:17:15.423+0000 7f53452f3680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-10T08:17:15.628 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:17:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: debug 2024-02-10T08:17:15.373+0000 7f26d8ad2680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-10T08:17:15.874 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:17:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:17:15.605+0000 7f53452f3680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-10T08:17:15.890 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:17:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: debug 2024-02-10T08:17:15.627+0000 7f26d8ad2680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-10T08:17:15.891 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:17:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: debug 2024-02-10T08:17:15.757+0000 7f26d8ad2680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-10T08:17:16.143 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:17:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: debug 2024-02-10T08:17:15.889+0000 7f26d8ad2680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-10T08:17:16.144 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:17:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: debug 2024-02-10T08:17:16.059+0000 7f26d8ad2680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-10T08:17:16.152 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:17:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:17:15.873+0000 7f53452f3680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-10T08:17:16.152 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:17:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:17:16.011+0000 7f53452f3680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-10T08:17:16.404 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:17:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:17:16.151+0000 7f53452f3680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-10T08:17:16.404 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:17:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:17:16.332+0000 7f53452f3680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-10T08:17:16.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:16.156591+0000 mon.a (mon.0) 603 : cluster [DBG] Standby manager daemon x restarted 2024-02-10T08:17:16.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:16.156678+0000 mon.a (mon.0) 604 : cluster [DBG] Standby manager daemon x started 2024-02-10T08:17:16.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:16.158139+0000 mon.b (mon.1) 31 : audit [DBG] from='mgr.? 172.21.15.71:0/3930498771' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-02-10T08:17:16.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:16.158867+0000 mon.b (mon.1) 32 : audit [DBG] from='mgr.? 172.21.15.71:0/3930498771' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-10T08:17:16.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:16.161512+0000 mon.b (mon.1) 33 : audit [DBG] from='mgr.? 172.21.15.71:0/3930498771' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-02-10T08:17:16.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:16.161791+0000 mon.b (mon.1) 34 : audit [DBG] from='mgr.? 172.21.15.71:0/3930498771' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-10T08:17:16.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:16.156591+0000 mon.a (mon.0) 603 : cluster [DBG] Standby manager daemon x restarted 2024-02-10T08:17:16.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:16.156678+0000 mon.a (mon.0) 604 : cluster [DBG] Standby manager daemon x started 2024-02-10T08:17:16.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:16.158139+0000 mon.b (mon.1) 31 : audit [DBG] from='mgr.? 172.21.15.71:0/3930498771' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-02-10T08:17:16.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:16.158867+0000 mon.b (mon.1) 32 : audit [DBG] from='mgr.? 172.21.15.71:0/3930498771' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-10T08:17:16.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:16.161512+0000 mon.b (mon.1) 33 : audit [DBG] from='mgr.? 172.21.15.71:0/3930498771' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-02-10T08:17:16.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:16.161791+0000 mon.b (mon.1) 34 : audit [DBG] from='mgr.? 172.21.15.71:0/3930498771' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-10T08:17:16.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:16.156591+0000 mon.a (mon.0) 603 : cluster [DBG] Standby manager daemon x restarted 2024-02-10T08:17:16.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:16.156678+0000 mon.a (mon.0) 604 : cluster [DBG] Standby manager daemon x started 2024-02-10T08:17:16.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:16.158139+0000 mon.b (mon.1) 31 : audit [DBG] from='mgr.? 172.21.15.71:0/3930498771' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-02-10T08:17:16.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:16.158867+0000 mon.b (mon.1) 32 : audit [DBG] from='mgr.? 172.21.15.71:0/3930498771' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-10T08:17:16.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:16.161512+0000 mon.b (mon.1) 33 : audit [DBG] from='mgr.? 172.21.15.71:0/3930498771' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-02-10T08:17:16.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:16.161791+0000 mon.b (mon.1) 34 : audit [DBG] from='mgr.? 172.21.15.71:0/3930498771' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-10T08:17:16.540 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:17:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: debug 2024-02-10T08:17:16.142+0000 7f26d8ad2680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-10T08:17:16.540 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:17:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: [10/Feb/2024:08:17:16] ENGINE Bus STARTING 2024-02-10T08:17:16.540 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:17:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: CherryPy Checker: 2024-02-10T08:17:16.540 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:17:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: The Application mounted at '' has an empty config. 2024-02-10T08:17:16.540 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:17:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: 2024-02-10T08:17:16.540 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:17:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: [10/Feb/2024:08:17:16] ENGINE Serving on http://:::9283 2024-02-10T08:17:16.540 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:17:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: [10/Feb/2024:08:17:16] ENGINE Bus STARTED 2024-02-10T08:17:16.753 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:17:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:17:16.420+0000 7f53452f3680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-10T08:17:16.753 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:17:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: [10/Feb/2024:08:17:16] ENGINE Bus STARTING 2024-02-10T08:17:16.753 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:17:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: [79B blob data] 2024-02-10T08:17:16.753 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:17:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: [79B blob data] 2024-02-10T08:17:17.154 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:17:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: CherryPy Checker: 2024-02-10T08:17:17.154 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:17:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: The Application mounted at '' has an empty config. 2024-02-10T08:17:17.154 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:17:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: 2024-02-10T08:17:17.154 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:17:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: [10/Feb/2024:08:17:16] ENGINE Serving on http://:::9283 2024-02-10T08:17:17.154 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:17:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: [10/Feb/2024:08:17:16] ENGINE Bus STARTED 2024-02-10T08:17:17.453 INFO:teuthology.orchestra.run.smithi071.stdout:Scheduled grafana update... 2024-02-10T08:17:17.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:16.304908+0000 mon.a (mon.0) 605 : cluster [DBG] mgrmap e17: y(active, since 5m), standbys: x 2024-02-10T08:17:17.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:16.433928+0000 mon.a (mon.0) 606 : cluster [INF] Active manager daemon y restarted 2024-02-10T08:17:17.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:16.434244+0000 mon.a (mon.0) 607 : cluster [INF] Activating manager daemon y 2024-02-10T08:17:17.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:16.440571+0000 mon.a (mon.0) 608 : cluster [DBG] osdmap e64: 8 total, 8 up, 8 in 2024-02-10T08:17:17.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:16.442171+0000 mon.a (mon.0) 609 : cluster [DBG] mgrmap e18: y(active, starting, since 0.00803084s), standbys: x 2024-02-10T08:17:17.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:16.443229+0000 mon.a (mon.0) 610 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-10T08:17:17.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:16.443359+0000 mon.a (mon.0) 611 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-10T08:17:17.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:16.443553+0000 mon.a (mon.0) 612 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-10T08:17:17.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:16.444529+0000 mon.a (mon.0) 613 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-10T08:17:17.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:16.444703+0000 mon.a (mon.0) 614 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-10T08:17:17.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:16.444929+0000 mon.a (mon.0) 615 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-10T08:17:17.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:16.445150+0000 mon.a (mon.0) 616 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-10T08:17:17.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:16.445363+0000 mon.a (mon.0) 617 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-10T08:17:17.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:16.445564+0000 mon.a (mon.0) 618 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-10T08:17:17.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:16.445777+0000 mon.a (mon.0) 619 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-10T08:17:17.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:16.446089+0000 mon.a (mon.0) 620 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-10T08:17:17.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:16.304908+0000 mon.a (mon.0) 605 : cluster [DBG] mgrmap e17: y(active, since 5m), standbys: x 2024-02-10T08:17:17.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:16.433928+0000 mon.a (mon.0) 606 : cluster [INF] Active manager daemon y restarted 2024-02-10T08:17:17.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:16.434244+0000 mon.a (mon.0) 607 : cluster [INF] Activating manager daemon y 2024-02-10T08:17:17.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:16.440571+0000 mon.a (mon.0) 608 : cluster [DBG] osdmap e64: 8 total, 8 up, 8 in 2024-02-10T08:17:17.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:16.442171+0000 mon.a (mon.0) 609 : cluster [DBG] mgrmap e18: y(active, starting, since 0.00803084s), standbys: x 2024-02-10T08:17:17.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:16.443229+0000 mon.a (mon.0) 610 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-10T08:17:17.657 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:16.443359+0000 mon.a (mon.0) 611 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-10T08:17:17.657 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:16.443553+0000 mon.a (mon.0) 612 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-10T08:17:17.657 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:16.444529+0000 mon.a (mon.0) 613 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-10T08:17:17.657 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:16.444703+0000 mon.a (mon.0) 614 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-10T08:17:17.657 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:16.444929+0000 mon.a (mon.0) 615 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-10T08:17:17.657 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:16.445150+0000 mon.a (mon.0) 616 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-10T08:17:17.657 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:16.445363+0000 mon.a (mon.0) 617 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-10T08:17:17.657 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:16.445564+0000 mon.a (mon.0) 618 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-10T08:17:17.657 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:16.445777+0000 mon.a (mon.0) 619 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-10T08:17:17.657 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:16.446089+0000 mon.a (mon.0) 620 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-10T08:17:17.657 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:16.446297+0000 mon.a (mon.0) 621 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-10T08:17:17.658 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:16.446566+0000 mon.a (mon.0) 622 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-10T08:17:17.658 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:16.446802+0000 mon.a (mon.0) 623 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-10T08:17:17.658 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:16.446974+0000 mon.a (mon.0) 624 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-10T08:17:17.658 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:16.447389+0000 mon.a (mon.0) 625 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-10T08:17:17.658 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:16.449922+0000 mon.a (mon.0) 626 : cluster [INF] Manager daemon y is now available 2024-02-10T08:17:17.658 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:16.551559+0000 mon.a (mon.0) 627 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:17:17.658 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:16.552959+0000 mon.a (mon.0) 628 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:17:17.658 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:16.588386+0000 mon.a (mon.0) 629 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:17:17.658 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:16.599781+0000 mon.a (mon.0) 630 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-10T08:17:17.658 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:16.617301+0000 mon.a (mon.0) 631 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-10T08:17:17.658 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:16.446297+0000 mon.a (mon.0) 621 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-10T08:17:17.658 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:16.446566+0000 mon.a (mon.0) 622 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-10T08:17:17.659 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:16.446802+0000 mon.a (mon.0) 623 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-10T08:17:17.659 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:16.446974+0000 mon.a (mon.0) 624 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-10T08:17:17.659 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:16.447389+0000 mon.a (mon.0) 625 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-10T08:17:17.659 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:16.449922+0000 mon.a (mon.0) 626 : cluster [INF] Manager daemon y is now available 2024-02-10T08:17:17.659 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:16.551559+0000 mon.a (mon.0) 627 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:17:17.659 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:16.552959+0000 mon.a (mon.0) 628 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:17:17.659 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:16.588386+0000 mon.a (mon.0) 629 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:17:17.659 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:16.599781+0000 mon.a (mon.0) 630 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-10T08:17:17.659 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:16.617301+0000 mon.a (mon.0) 631 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-10T08:17:17.789 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:17:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:17:17.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:16.304908+0000 mon.a (mon.0) 605 : cluster [DBG] mgrmap e17: y(active, since 5m), standbys: x 2024-02-10T08:17:17.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:16.433928+0000 mon.a (mon.0) 606 : cluster [INF] Active manager daemon y restarted 2024-02-10T08:17:17.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:16.434244+0000 mon.a (mon.0) 607 : cluster [INF] Activating manager daemon y 2024-02-10T08:17:17.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:16.440571+0000 mon.a (mon.0) 608 : cluster [DBG] osdmap e64: 8 total, 8 up, 8 in 2024-02-10T08:17:17.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:16.442171+0000 mon.a (mon.0) 609 : cluster [DBG] mgrmap e18: y(active, starting, since 0.00803084s), standbys: x 2024-02-10T08:17:17.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:16.443229+0000 mon.a (mon.0) 610 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-10T08:17:17.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:16.443359+0000 mon.a (mon.0) 611 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-10T08:17:17.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:16.443553+0000 mon.a (mon.0) 612 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-10T08:17:17.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:16.444529+0000 mon.a (mon.0) 613 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-10T08:17:17.791 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:16.444703+0000 mon.a (mon.0) 614 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-10T08:17:17.791 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:16.444929+0000 mon.a (mon.0) 615 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-10T08:17:17.791 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:16.445150+0000 mon.a (mon.0) 616 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-10T08:17:17.791 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:16.445363+0000 mon.a (mon.0) 617 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-10T08:17:17.791 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:16.445564+0000 mon.a (mon.0) 618 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-10T08:17:17.791 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:16.445777+0000 mon.a (mon.0) 619 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-10T08:17:17.791 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:16.446089+0000 mon.a (mon.0) 620 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-10T08:17:17.791 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:16.446297+0000 mon.a (mon.0) 621 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-10T08:17:17.791 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:16.446566+0000 mon.a (mon.0) 622 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-10T08:17:17.791 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:16.446802+0000 mon.a (mon.0) 623 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-10T08:17:17.791 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:16.446974+0000 mon.a (mon.0) 624 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-10T08:17:17.791 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:16.447389+0000 mon.a (mon.0) 625 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-10T08:17:17.791 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:16.449922+0000 mon.a (mon.0) 626 : cluster [INF] Manager daemon y is now available 2024-02-10T08:17:17.791 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:16.551559+0000 mon.a (mon.0) 627 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:17:17.791 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:16.552959+0000 mon.a (mon.0) 628 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:17:17.792 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:16.588386+0000 mon.a (mon.0) 629 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:17:17.792 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:16.599781+0000 mon.a (mon.0) 630 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-10T08:17:17.792 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:16.617301+0000 mon.a (mon.0) 631 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-10T08:17:18.442 DEBUG:teuthology.orchestra.run.smithi071:grafana.a> sudo journalctl -f -n 0 -u ceph-d46257c8-c7eb-11ee-95b8-87774f69a715@grafana.a.service 2024-02-10T08:17:18.444 INFO:tasks.cephadm:Setting up client nodes... 2024-02-10T08:17:18.445 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-02-10T08:17:18.476 INFO:journalctl@ceph.grafana.a.smithi071.stdout:-- Logs begin at Sat 2024-02-10 07:59:38 UTC. -- 2024-02-10T08:17:18.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:17.443739+0000 mon.a (mon.0) 632 : cluster [DBG] mgrmap e19: y(active, since 1.00959s), standbys: x 2024-02-10T08:17:18.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cephadm 2024-02-10T08:17:17.449800+0000 mgr.y (mgr.14505) 4 : cephadm [INF] Saving service grafana spec with placement smithi071=a;count:1 2024-02-10T08:17:18.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:17.453063+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:17:18.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:18.089937+0000 mon.a (mon.0) 634 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:17:18.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:18.370576+0000 mon.a (mon.0) 635 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:17:18.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:18.371284+0000 mon.a (mon.0) 636 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:17:18.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:18.371845+0000 mon.a (mon.0) 637 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:17:18.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:18.372411+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:17:18.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:18.376661+0000 mon.a (mon.0) 639 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:17:18.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:17.443739+0000 mon.a (mon.0) 632 : cluster [DBG] mgrmap e19: y(active, since 1.00959s), standbys: x 2024-02-10T08:17:18.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cephadm 2024-02-10T08:17:17.449800+0000 mgr.y (mgr.14505) 4 : cephadm [INF] Saving service grafana spec with placement smithi071=a;count:1 2024-02-10T08:17:18.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:17.453063+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:17:18.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:18.089937+0000 mon.a (mon.0) 634 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:17:18.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:18.370576+0000 mon.a (mon.0) 635 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:17:18.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:18.371284+0000 mon.a (mon.0) 636 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:17:18.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:18.371845+0000 mon.a (mon.0) 637 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:17:18.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:18.372411+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:17:18.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:18.376661+0000 mon.a (mon.0) 639 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:17:18.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:17.443739+0000 mon.a (mon.0) 632 : cluster [DBG] mgrmap e19: y(active, since 1.00959s), standbys: x 2024-02-10T08:17:18.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cephadm 2024-02-10T08:17:17.449800+0000 mgr.y (mgr.14505) 4 : cephadm [INF] Saving service grafana spec with placement smithi071=a;count:1 2024-02-10T08:17:18.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:17.453063+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:17:18.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:18.089937+0000 mon.a (mon.0) 634 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:17:18.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:18.370576+0000 mon.a (mon.0) 635 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:17:18.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:18.371284+0000 mon.a (mon.0) 636 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:17:18.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:18.371845+0000 mon.a (mon.0) 637 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:17:18.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:18.372411+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:17:18.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:18.376661+0000 mon.a (mon.0) 639 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:17:19.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cephadm 2024-02-10T08:17:18.372873+0000 mgr.y (mgr.14505) 5 : cephadm [INF] Adjusting osd_memory_target on smithi018 to 3769M 2024-02-10T08:17:19.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:18.445889+0000 mgr.y (mgr.14505) 6 : cluster [DBG] pgmap v4: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T08:17:19.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:19.416951+0000 mon.a (mon.0) 640 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:17:19.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cephadm 2024-02-10T08:17:18.372873+0000 mgr.y (mgr.14505) 5 : cephadm [INF] Adjusting osd_memory_target on smithi018 to 3769M 2024-02-10T08:17:19.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:18.445889+0000 mgr.y (mgr.14505) 6 : cluster [DBG] pgmap v4: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T08:17:19.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:19.416951+0000 mon.a (mon.0) 640 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:17:19.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cephadm 2024-02-10T08:17:18.372873+0000 mgr.y (mgr.14505) 5 : cephadm [INF] Adjusting osd_memory_target on smithi018 to 3769M 2024-02-10T08:17:19.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:18.445889+0000 mgr.y (mgr.14505) 6 : cluster [DBG] pgmap v4: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T08:17:19.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:19.416951+0000 mon.a (mon.0) 640 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:17:20.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:19.451945+0000 mon.a (mon.0) 641 : cluster [DBG] mgrmap e20: y(active, since 3s), standbys: x 2024-02-10T08:17:20.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:19.698407+0000 mon.a (mon.0) 642 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:17:20.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:19.699251+0000 mon.a (mon.0) 643 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:17:20.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:19.699916+0000 mon.a (mon.0) 644 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:17:20.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:19.700574+0000 mon.a (mon.0) 645 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:17:20.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cephadm 2024-02-10T08:17:19.701075+0000 mgr.y (mgr.14505) 7 : cephadm [INF] Adjusting osd_memory_target on smithi071 to 4024M 2024-02-10T08:17:20.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:19.705279+0000 mon.a (mon.0) 646 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:17:20.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:19.706190+0000 mon.a (mon.0) 647 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:17:20.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:19.706880+0000 mon.a (mon.0) 648 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:17:20.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cephadm 2024-02-10T08:17:19.708013+0000 mgr.y (mgr.14505) 8 : cephadm [INF] Updating smithi018:/etc/ceph/ceph.conf 2024-02-10T08:17:20.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cephadm 2024-02-10T08:17:19.708297+0000 mgr.y (mgr.14505) 9 : cephadm [INF] Updating smithi071:/etc/ceph/ceph.conf 2024-02-10T08:17:20.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cephadm 2024-02-10T08:17:19.722201+0000 mgr.y (mgr.14505) 10 : cephadm [INF] Updating smithi071:/etc/ceph/ceph.client.admin.keyring 2024-02-10T08:17:20.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:19.751700+0000 mon.a (mon.0) 649 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:17:20.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cephadm 2024-02-10T08:17:19.784142+0000 mgr.y (mgr.14505) 11 : cephadm [INF] Updating smithi018:/etc/ceph/ceph.client.admin.keyring 2024-02-10T08:17:20.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:19.828743+0000 mon.a (mon.0) 650 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:17:20.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:19.832618+0000 mon.a (mon.0) 651 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:17:20.791 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cephadm 2024-02-10T08:17:19.843241+0000 mgr.y (mgr.14505) 12 : cephadm [INF] Deploying daemon alertmanager.a on smithi018 2024-02-10T08:17:20.828 INFO:teuthology.orchestra.run.smithi018.stdout:[client.0] 2024-02-10T08:17:20.828 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQAQMcdlyycpMRAAPAph3EZTJUnzu+g8RdeWow== 2024-02-10T08:17:20.855 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:19.451945+0000 mon.a (mon.0) 641 : cluster [DBG] mgrmap e20: y(active, since 3s), standbys: x 2024-02-10T08:17:20.855 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:19.698407+0000 mon.a (mon.0) 642 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:17:20.855 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:19.699251+0000 mon.a (mon.0) 643 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:17:20.855 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:19.699916+0000 mon.a (mon.0) 644 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:17:20.855 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:19.700574+0000 mon.a (mon.0) 645 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:17:20.855 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cephadm 2024-02-10T08:17:19.701075+0000 mgr.y (mgr.14505) 7 : cephadm [INF] Adjusting osd_memory_target on smithi071 to 4024M 2024-02-10T08:17:20.856 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:19.705279+0000 mon.a (mon.0) 646 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:17:20.856 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:19.706190+0000 mon.a (mon.0) 647 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:17:20.856 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:19.706880+0000 mon.a (mon.0) 648 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:17:20.856 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cephadm 2024-02-10T08:17:19.708013+0000 mgr.y (mgr.14505) 8 : cephadm [INF] Updating smithi018:/etc/ceph/ceph.conf 2024-02-10T08:17:20.856 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cephadm 2024-02-10T08:17:19.708297+0000 mgr.y (mgr.14505) 9 : cephadm [INF] Updating smithi071:/etc/ceph/ceph.conf 2024-02-10T08:17:20.856 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cephadm 2024-02-10T08:17:19.722201+0000 mgr.y (mgr.14505) 10 : cephadm [INF] Updating smithi071:/etc/ceph/ceph.client.admin.keyring 2024-02-10T08:17:20.856 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:19.751700+0000 mon.a (mon.0) 649 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:17:20.856 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cephadm 2024-02-10T08:17:19.784142+0000 mgr.y (mgr.14505) 11 : cephadm [INF] Updating smithi018:/etc/ceph/ceph.client.admin.keyring 2024-02-10T08:17:20.856 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:19.828743+0000 mon.a (mon.0) 650 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:17:20.856 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:19.832618+0000 mon.a (mon.0) 651 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:17:20.856 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cephadm 2024-02-10T08:17:19.843241+0000 mgr.y (mgr.14505) 12 : cephadm [INF] Deploying daemon alertmanager.a on smithi018 2024-02-10T08:17:20.857 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:19.451945+0000 mon.a (mon.0) 641 : cluster [DBG] mgrmap e20: y(active, since 3s), standbys: x 2024-02-10T08:17:20.857 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:19.698407+0000 mon.a (mon.0) 642 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:17:20.857 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:19.699251+0000 mon.a (mon.0) 643 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:17:20.857 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:19.699916+0000 mon.a (mon.0) 644 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:17:20.857 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:19.700574+0000 mon.a (mon.0) 645 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:17:20.857 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cephadm 2024-02-10T08:17:19.701075+0000 mgr.y (mgr.14505) 7 : cephadm [INF] Adjusting osd_memory_target on smithi071 to 4024M 2024-02-10T08:17:20.857 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:19.705279+0000 mon.a (mon.0) 646 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:17:20.857 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:19.706190+0000 mon.a (mon.0) 647 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:17:20.857 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:19.706880+0000 mon.a (mon.0) 648 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:17:20.857 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cephadm 2024-02-10T08:17:19.708013+0000 mgr.y (mgr.14505) 8 : cephadm [INF] Updating smithi018:/etc/ceph/ceph.conf 2024-02-10T08:17:20.857 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cephadm 2024-02-10T08:17:19.708297+0000 mgr.y (mgr.14505) 9 : cephadm [INF] Updating smithi071:/etc/ceph/ceph.conf 2024-02-10T08:17:20.857 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cephadm 2024-02-10T08:17:19.722201+0000 mgr.y (mgr.14505) 10 : cephadm [INF] Updating smithi071:/etc/ceph/ceph.client.admin.keyring 2024-02-10T08:17:20.857 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:19.751700+0000 mon.a (mon.0) 649 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:17:20.857 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cephadm 2024-02-10T08:17:19.784142+0000 mgr.y (mgr.14505) 11 : cephadm [INF] Updating smithi018:/etc/ceph/ceph.client.admin.keyring 2024-02-10T08:17:20.858 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:19.828743+0000 mon.a (mon.0) 650 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:17:20.858 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:19.832618+0000 mon.a (mon.0) 651 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:17:20.858 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cephadm 2024-02-10T08:17:19.843241+0000 mgr.y (mgr.14505) 12 : cephadm [INF] Deploying daemon alertmanager.a on smithi018 2024-02-10T08:17:21.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:20.446220+0000 mgr.y (mgr.14505) 13 : cluster [DBG] pgmap v5: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T08:17:21.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:20.824622+0000 mon.a (mon.0) 652 : audit [INF] from='client.? 172.21.15.18:0/162170144' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-10T08:17:21.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:20.827899+0000 mon.a (mon.0) 653 : audit [INF] from='client.? 172.21.15.18:0/162170144' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-10T08:17:21.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:20.446220+0000 mgr.y (mgr.14505) 13 : cluster [DBG] pgmap v5: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T08:17:21.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:20.824622+0000 mon.a (mon.0) 652 : audit [INF] from='client.? 172.21.15.18:0/162170144' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-10T08:17:21.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:20.827899+0000 mon.a (mon.0) 653 : audit [INF] from='client.? 172.21.15.18:0/162170144' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-10T08:17:21.726 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-02-10T08:17:21.726 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-02-10T08:17:21.726 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-02-10T08:17:21.772 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-02-10T08:17:21.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:20.446220+0000 mgr.y (mgr.14505) 13 : cluster [DBG] pgmap v5: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T08:17:21.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:20.824622+0000 mon.a (mon.0) 652 : audit [INF] from='client.? 172.21.15.18:0/162170144' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-10T08:17:21.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:20.827899+0000 mon.a (mon.0) 653 : audit [INF] from='client.? 172.21.15.18:0/162170144' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-10T08:17:23.461 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:22.309125+0000 osd.6 (osd.6) 3 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:17:23.461 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:22.309177+0000 osd.6 (osd.6) 4 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:17:23.461 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:22.446645+0000 mgr.y (mgr.14505) 14 : cluster [DBG] pgmap v6: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T08:17:23.461 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:22.456519+0000 mon.a (mon.0) 654 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2024-02-10T08:17:23.461 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:22.461113+0000 mon.a (mon.0) 655 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-10T08:17:23.462 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:22.461885+0000 mon.a (mon.0) 656 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-10T08:17:23.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:22.309125+0000 osd.6 (osd.6) 3 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:17:23.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:22.309177+0000 osd.6 (osd.6) 4 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:17:23.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:22.446645+0000 mgr.y (mgr.14505) 14 : cluster [DBG] pgmap v6: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T08:17:23.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:22.456519+0000 mon.a (mon.0) 654 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2024-02-10T08:17:23.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:22.461113+0000 mon.a (mon.0) 655 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-10T08:17:23.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:22.461885+0000 mon.a (mon.0) 656 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-10T08:17:23.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:22.309125+0000 osd.6 (osd.6) 3 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:17:23.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:22.309177+0000 osd.6 (osd.6) 4 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:17:23.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:22.446645+0000 mgr.y (mgr.14505) 14 : cluster [DBG] pgmap v6: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T08:17:23.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:22.456519+0000 mon.a (mon.0) 654 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2024-02-10T08:17:23.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:22.461113+0000 mon.a (mon.0) 655 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-10T08:17:23.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:22.461885+0000 mon.a (mon.0) 656 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-10T08:17:23.930 INFO:teuthology.orchestra.run.smithi071.stdout:[client.1] 2024-02-10T08:17:23.930 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQATMcdlJHxDNxAAdEiSHzOFbNmBB8FAqHJHrA== 2024-02-10T08:17:24.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:23.457604+0000 mon.a (mon.0) 657 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-02-10T08:17:24.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:23.457675+0000 mon.a (mon.0) 658 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2024-02-10T08:17:24.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:23.926371+0000 mon.b (mon.1) 35 : audit [INF] from='client.? 172.21.15.71:0/869826054' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-10T08:17:24.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:23.926990+0000 mon.a (mon.0) 659 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-10T08:17:24.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:23.930299+0000 mon.a (mon.0) 660 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-10T08:17:24.619 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-02-10T08:17:24.620 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-02-10T08:17:24.620 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-02-10T08:17:24.700 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd dump --format=json 2024-02-10T08:17:24.729 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:23.457604+0000 mon.a (mon.0) 657 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-02-10T08:17:24.729 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:23.457675+0000 mon.a (mon.0) 658 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2024-02-10T08:17:24.729 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:23.926371+0000 mon.b (mon.1) 35 : audit [INF] from='client.? 172.21.15.71:0/869826054' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-10T08:17:24.730 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:23.926990+0000 mon.a (mon.0) 659 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-10T08:17:24.730 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:23.930299+0000 mon.a (mon.0) 660 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-10T08:17:24.730 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:23.457604+0000 mon.a (mon.0) 657 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-02-10T08:17:24.730 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:23.457675+0000 mon.a (mon.0) 658 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2024-02-10T08:17:24.731 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:23.926371+0000 mon.b (mon.1) 35 : audit [INF] from='client.? 172.21.15.71:0/869826054' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-10T08:17:24.731 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:23.926990+0000 mon.a (mon.0) 659 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-10T08:17:24.731 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:23.930299+0000 mon.a (mon.0) 660 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-10T08:17:25.512 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:24.447114+0000 mgr.y (mgr.14505) 15 : cluster [DBG] pgmap v9: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 731 B/s rd, 0 op/s 2024-02-10T08:17:25.513 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:25.299836+0000 mon.a (mon.0) 661 : cluster [DBG] osdmap e67: 8 total, 8 up, 8 in 2024-02-10T08:17:25.513 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:24.447114+0000 mgr.y (mgr.14505) 15 : cluster [DBG] pgmap v9: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 731 B/s rd, 0 op/s 2024-02-10T08:17:25.513 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:25.299836+0000 mon.a (mon.0) 661 : cluster [DBG] osdmap e67: 8 total, 8 up, 8 in 2024-02-10T08:17:25.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:24.447114+0000 mgr.y (mgr.14505) 15 : cluster [DBG] pgmap v9: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 731 B/s rd, 0 op/s 2024-02-10T08:17:25.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:25.299836+0000 mon.a (mon.0) 661 : cluster [DBG] osdmap e67: 8 total, 8 up, 8 in 2024-02-10T08:17:26.307 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:17:27.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:26.447493+0000 mgr.y (mgr.14505) 16 : cluster [DBG] pgmap v11: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:17:27.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:26.447493+0000 mgr.y (mgr.14505) 16 : cluster [DBG] pgmap v11: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:17:27.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:26.447493+0000 mgr.y (mgr.14505) 16 : cluster [DBG] pgmap v11: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:17:27.789 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:17:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:17:28.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:27.452736+0000 mgr.y (mgr.14505) 17 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:17:28.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:27.452736+0000 mgr.y (mgr.14505) 17 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:17:28.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:27.452736+0000 mgr.y (mgr.14505) 17 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:17:29.712 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:17:29.712 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":67,"fsid":"d46257c8-c7eb-11ee-95b8-87774f69a715","created":"2024-02-10T08:10:57.425061+0000","modified":"2024-02-10T08:17:25.296103+0000","last_up_change":"2024-02-10T08:16:44.491982+0000","last_in_change":"2024-02-10T08:16:27.586635+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-02-10T08:14:44.034966+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":".rgw.root","create_time":"2024-02-10T08:16:51.334631+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":3,"pool_name":"iscsi","create_time":"2024-02-10T08:16:51.762963+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":3,"pg_placement_num":3,"pg_placement_num_target":3,"pg_num_target":3,"pg_num_pending":3,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":4,"pool_name":"default.rgw.log","create_time":"2024-02-10T08:16:53.258098+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":5,"pool_name":"default.rgw.control","create_time":"2024-02-10T08:16:55.289300+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":6,"pool_name":"default.rgw.meta","create_time":"2024-02-10T08:16:57.354868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}}}],"osds":[{"osd":0,"uuid":"f9043fee-a3ed-4e16-921d-bb86756d0c48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6801","nonce":276034406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":276034406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":276034406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6803","nonce":276034406}]},"public_addr":"172.21.15.18:6801/276034406","cluster_addr":"172.21.15.18:6802/276034406","heartbeat_back_addr":"172.21.15.18:6804/276034406","heartbeat_front_addr":"172.21.15.18:6803/276034406","state":["exists","up"]},{"osd":1,"uuid":"ff958272-ce6b-4162-959a-6da9729e537b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6805","nonce":1941014296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1941014296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1941014296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6807","nonce":1941014296}]},"public_addr":"172.21.15.18:6805/1941014296","cluster_addr":"172.21.15.18:6806/1941014296","heartbeat_back_addr":"172.21.15.18:6808/1941014296","heartbeat_front_addr":"172.21.15.18:6807/1941014296","state":["exists","up"]},{"osd":2,"uuid":"29bb47e2-5c81-4ae8-bb9f-d1b02ea01d3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6809","nonce":3122474567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":3122474567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":3122474567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6811","nonce":3122474567}]},"public_addr":"172.21.15.18:6809/3122474567","cluster_addr":"172.21.15.18:6810/3122474567","heartbeat_back_addr":"172.21.15.18:6812/3122474567","heartbeat_front_addr":"172.21.15.18:6811/3122474567","state":["exists","up"]},{"osd":3,"uuid":"87ad37de-5f49-4e5b-9683-3bb9c3e33907","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6813","nonce":3484706437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":3484706437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3484706437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6815","nonce":3484706437}]},"public_addr":"172.21.15.18:6813/3484706437","cluster_addr":"172.21.15.18:6814/3484706437","heartbeat_back_addr":"172.21.15.18:6816/3484706437","heartbeat_front_addr":"172.21.15.18:6815/3484706437","state":["exists","up"]},{"osd":4,"uuid":"f5708f20-f98d-4d12-b8ae-71a5049a14cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":1598114798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6801","nonce":1598114798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6803","nonce":1598114798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":1598114798}]},"public_addr":"172.21.15.71:6800/1598114798","cluster_addr":"172.21.15.71:6801/1598114798","heartbeat_back_addr":"172.21.15.71:6803/1598114798","heartbeat_front_addr":"172.21.15.71:6802/1598114798","state":["exists","up"]},{"osd":5,"uuid":"e36a71dd-5088-4bff-965e-7dc8708ef7e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":1932648316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6805","nonce":1932648316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6807","nonce":1932648316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":1932648316}]},"public_addr":"172.21.15.71:6804/1932648316","cluster_addr":"172.21.15.71:6805/1932648316","heartbeat_back_addr":"172.21.15.71:6807/1932648316","heartbeat_front_addr":"172.21.15.71:6806/1932648316","state":["exists","up"]},{"osd":6,"uuid":"210a8790-78b6-4efa-a969-17efb17e9c0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":3724399458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6809","nonce":3724399458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6811","nonce":3724399458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":3724399458}]},"public_addr":"172.21.15.71:6808/3724399458","cluster_addr":"172.21.15.71:6809/3724399458","heartbeat_back_addr":"172.21.15.71:6811/3724399458","heartbeat_front_addr":"172.21.15.71:6810/3724399458","state":["exists","up"]},{"osd":7,"uuid":"9778a0e9-2ff3-4700-bf2a-675edaba630b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":163573852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6813","nonce":163573852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6815","nonce":163573852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":163573852}]},"public_addr":"172.21.15.71:6812/163573852","cluster_addr":"172.21.15.71:6813/163573852","heartbeat_back_addr":"172.21.15.71:6815/163573852","heartbeat_front_addr":"172.21.15.71:6814/163573852","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-10T08:16:36.011280+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-10T08:16:48.779796+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-10T08:17:01.886366+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-10T08:16:36.484506+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-10T08:16:50.868246+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-10T08:16:58.286940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-10T08:17:22.309179+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-10T08:16:43.005227+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:6800/542054629":"2024-02-11T08:17:16.433947+0000","172.21.15.18:0/491217791":"2024-02-11T08:17:16.433947+0000","172.21.15.18:0/781076548":"2024-02-11T08:17:16.433947+0000","172.21.15.18:0/957318754":"2024-02-11T08:17:16.433947+0000","172.21.15.18:0/2662732452":"2024-02-11T08:11:55.105124+0000","172.21.15.18:0/1407788916":"2024-02-11T08:11:55.105124+0000","172.21.15.18:6800/3798687064":"2024-02-11T08:11:55.105124+0000","172.21.15.18:6800/3570839557":"2024-02-11T08:11:31.445897+0000","172.21.15.18:0/541168116":"2024-02-11T08:11:31.445897+0000","172.21.15.18:0/806236095":"2024-02-11T08:11:31.445897+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-10T08:17:29.732 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:28.448045+0000 mgr.y (mgr.14505) 18 : cluster [DBG] pgmap v12: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-02-10T08:17:29.733 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:28.448045+0000 mgr.y (mgr.14505) 18 : cluster [DBG] pgmap v12: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-02-10T08:17:29.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:28.448045+0000 mgr.y (mgr.14505) 18 : cluster [DBG] pgmap v12: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-02-10T08:17:30.324 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-02-10T08:14:44.034966+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': '.rgw.root', 'create_time': '2024-02-10T08:16:51.334631+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 3, 'pool_name': 'iscsi', 'create_time': '2024-02-10T08:16:51.762963+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 3, 'pg_placement_num': 3, 'pg_placement_num_target': 3, 'pg_num_target': 3, 'pg_num_pending': 3, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '57', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 4, 'pool_name': 'default.rgw.log', 'create_time': '2024-02-10T08:16:53.258098+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '58', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 5, 'pool_name': 'default.rgw.control', 'create_time': '2024-02-10T08:16:55.289300+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 6, 'pool_name': 'default.rgw.meta', 'create_time': '2024-02-10T08:16:57.354868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4}, 'application_metadata': {'rgw': {}}}] 2024-02-10T08:17:30.325 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd pool get device_health_metrics pg_num 2024-02-10T08:17:30.568 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:29.710796+0000 mon.a (mon.0) 662 : audit [DBG] from='client.? 172.21.15.18:0/1508559764' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-10T08:17:30.568 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:30.302287+0000 mon.a (mon.0) 663 : cluster [DBG] osdmap e68: 8 total, 8 up, 8 in 2024-02-10T08:17:30.569 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:29.710796+0000 mon.a (mon.0) 662 : audit [DBG] from='client.? 172.21.15.18:0/1508559764' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-10T08:17:30.569 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:30.302287+0000 mon.a (mon.0) 663 : cluster [DBG] osdmap e68: 8 total, 8 up, 8 in 2024-02-10T08:17:30.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:29.710796+0000 mon.a (mon.0) 662 : audit [DBG] from='client.? 172.21.15.18:0/1508559764' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-10T08:17:30.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:30.302287+0000 mon.a (mon.0) 663 : cluster [DBG] osdmap e68: 8 total, 8 up, 8 in 2024-02-10T08:17:30.894 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:17:31.130 INFO:journalctl@ceph.alertmanager.a.smithi018.stdout:Feb 10 08:17:30 smithi018 bash[68659]: 8b3342ba20dc5537060b10348e5c2313705500fb7f57b9fc594fe8d322a10ef3 2024-02-10T08:17:31.131 INFO:journalctl@ceph.alertmanager.a.smithi018.stdout:Feb 10 08:17:30 smithi018 systemd[1]: Started Ceph alertmanager.a for d46257c8-c7eb-11ee-95b8-87774f69a715. 2024-02-10T08:17:31.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:30.448542+0000 mgr.y (mgr.14505) 19 : cluster [DBG] pgmap v14: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 732 B/s rd, 0 op/s 2024-02-10T08:17:31.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:30.925797+0000 mon.a (mon.0) 664 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:17:31.876 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:30.448542+0000 mgr.y (mgr.14505) 19 : cluster [DBG] pgmap v14: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 732 B/s rd, 0 op/s 2024-02-10T08:17:31.876 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:30.925797+0000 mon.a (mon.0) 664 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:17:31.876 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:30.448542+0000 mgr.y (mgr.14505) 19 : cluster [DBG] pgmap v14: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 732 B/s rd, 0 op/s 2024-02-10T08:17:31.876 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:30.925797+0000 mon.a (mon.0) 664 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:17:31.877 INFO:journalctl@ceph.node-exporter.a.smithi018.stdout:Feb 10 08:17:31 smithi018 systemd[1]: Starting Ceph node-exporter.a for d46257c8-c7eb-11ee-95b8-87774f69a715... 2024-02-10T08:17:32.154 INFO:journalctl@ceph.node-exporter.a.smithi018.stdout:Feb 10 08:17:31 smithi018 bash[69070]: Trying to pull quay.io/prometheus/node-exporter:v1.3.1... 2024-02-10T08:17:32.523 INFO:journalctl@ceph.node-exporter.a.smithi018.stdout:Feb 10 08:17:32 smithi018 bash[69070]: Getting image source signatures 2024-02-10T08:17:32.523 INFO:journalctl@ceph.node-exporter.a.smithi018.stdout:Feb 10 08:17:32 smithi018 bash[69070]: Copying blob sha256:b5db1e299295edf3005515ab7879c1df64a33c185d3a7a23aa4dcaa17d26f7b3 2024-02-10T08:17:32.524 INFO:journalctl@ceph.node-exporter.a.smithi018.stdout:Feb 10 08:17:32 smithi018 bash[69070]: Copying blob sha256:b45d31ee2d7f9f452678a85b0c837c29e12089f31ee8dbac6c8c24dfa4054a30 2024-02-10T08:17:32.524 INFO:journalctl@ceph.node-exporter.a.smithi018.stdout:Feb 10 08:17:32 smithi018 bash[69070]: Copying blob sha256:aa2a8d90b84cb2a9c422e7005cd166a008ccf22ef5d7d4f07128478585ce35ea 2024-02-10T08:17:32.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cephadm 2024-02-10T08:17:30.929250+0000 mgr.y (mgr.14505) 20 : cephadm [INF] Deploying daemon node-exporter.a on smithi018 2024-02-10T08:17:32.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:31.594584+0000 mon.a (mon.0) 665 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:17:32.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cephadm 2024-02-10T08:17:30.929250+0000 mgr.y (mgr.14505) 20 : cephadm [INF] Deploying daemon node-exporter.a on smithi018 2024-02-10T08:17:32.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:31.594584+0000 mon.a (mon.0) 665 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:17:32.905 INFO:journalctl@ceph.alertmanager.a.smithi018.stdout:Feb 10 08:17:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-alertmanager-a[68766]: level=info ts=2024-02-10T08:17:32.738Z caller=cluster.go:696 component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.00035495s 2024-02-10T08:17:32.985 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-02-10T08:17:33.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cephadm 2024-02-10T08:17:30.929250+0000 mgr.y (mgr.14505) 20 : cephadm [INF] Deploying daemon node-exporter.a on smithi018 2024-02-10T08:17:33.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:31.594584+0000 mon.a (mon.0) 665 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:17:33.727 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:32.449207+0000 mgr.y (mgr.14505) 21 : cluster [DBG] pgmap v15: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:17:33.727 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:32.985450+0000 mon.c (mon.2) 16 : audit [DBG] from='client.? 172.21.15.18:0/3969637082' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2024-02-10T08:17:33.728 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:32.449207+0000 mgr.y (mgr.14505) 21 : cluster [DBG] pgmap v15: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:17:33.728 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:32.985450+0000 mon.c (mon.2) 16 : audit [DBG] from='client.? 172.21.15.18:0/3969637082' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2024-02-10T08:17:33.728 INFO:journalctl@ceph.node-exporter.a.smithi018.stdout:Feb 10 08:17:33 smithi018 bash[69070]: Copying config sha256:1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26 2024-02-10T08:17:33.728 INFO:journalctl@ceph.node-exporter.a.smithi018.stdout:Feb 10 08:17:33 smithi018 bash[69070]: Writing manifest to image destination 2024-02-10T08:17:34.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:32.449207+0000 mgr.y (mgr.14505) 21 : cluster [DBG] pgmap v15: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:17:34.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:32.985450+0000 mon.c (mon.2) 16 : audit [DBG] from='client.? 172.21.15.18:0/3969637082' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2024-02-10T08:17:34.147 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd pool get .rgw.root pg_num 2024-02-10T08:17:34.742 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:17:34.904 INFO:journalctl@ceph.node-exporter.a.smithi018.stdout:Feb 10 08:17:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-a[69225]: ts=2024-02-10T08:17:34.632Z caller=node_exporter.go:182 level=info msg="Starting node_exporter" version="(version=1.3.1, branch=HEAD, revision=a2321e7b940ddcff26873612bccdf7cd4c42b6b6)" 2024-02-10T08:17:34.905 INFO:journalctl@ceph.node-exporter.a.smithi018.stdout:Feb 10 08:17:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-a[69225]: ts=2024-02-10T08:17:34.632Z caller=node_exporter.go:183 level=info msg="Build context" build_context="(go=go1.17.3, user=root@243aafa5525c, date=20211205-11:09:49)" 2024-02-10T08:17:34.905 INFO:journalctl@ceph.node-exporter.a.smithi018.stdout:Feb 10 08:17:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-a[69225]: ts=2024-02-10T08:17:34.632Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+)($|/) 2024-02-10T08:17:34.905 INFO:journalctl@ceph.node-exporter.a.smithi018.stdout:Feb 10 08:17:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-a[69225]: ts=2024-02-10T08:17:34.632Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-02-10T08:17:34.905 INFO:journalctl@ceph.node-exporter.a.smithi018.stdout:Feb 10 08:17:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-a[69225]: ts=2024-02-10T08:17:34.633Z caller=node_exporter.go:108 level=info msg="Enabled collectors" 2024-02-10T08:17:34.905 INFO:journalctl@ceph.node-exporter.a.smithi018.stdout:Feb 10 08:17:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-a[69225]: ts=2024-02-10T08:17:34.633Z caller=node_exporter.go:115 level=info collector=arp 2024-02-10T08:17:34.905 INFO:journalctl@ceph.node-exporter.a.smithi018.stdout:Feb 10 08:17:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-a[69225]: ts=2024-02-10T08:17:34.633Z caller=node_exporter.go:115 level=info collector=bcache 2024-02-10T08:17:34.905 INFO:journalctl@ceph.node-exporter.a.smithi018.stdout:Feb 10 08:17:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-a[69225]: ts=2024-02-10T08:17:34.633Z caller=node_exporter.go:115 level=info collector=bonding 2024-02-10T08:17:34.905 INFO:journalctl@ceph.node-exporter.a.smithi018.stdout:Feb 10 08:17:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-a[69225]: ts=2024-02-10T08:17:34.633Z caller=node_exporter.go:115 level=info collector=btrfs 2024-02-10T08:17:34.905 INFO:journalctl@ceph.node-exporter.a.smithi018.stdout:Feb 10 08:17:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-a[69225]: ts=2024-02-10T08:17:34.633Z caller=node_exporter.go:115 level=info collector=conntrack 2024-02-10T08:17:34.905 INFO:journalctl@ceph.node-exporter.a.smithi018.stdout:Feb 10 08:17:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-a[69225]: ts=2024-02-10T08:17:34.633Z caller=node_exporter.go:115 level=info collector=cpu 2024-02-10T08:17:34.905 INFO:journalctl@ceph.node-exporter.a.smithi018.stdout:Feb 10 08:17:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-a[69225]: ts=2024-02-10T08:17:34.633Z caller=node_exporter.go:115 level=info collector=cpufreq 2024-02-10T08:17:34.905 INFO:journalctl@ceph.node-exporter.a.smithi018.stdout:Feb 10 08:17:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-a[69225]: ts=2024-02-10T08:17:34.633Z caller=node_exporter.go:115 level=info collector=diskstats 2024-02-10T08:17:34.906 INFO:journalctl@ceph.node-exporter.a.smithi018.stdout:Feb 10 08:17:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-a[69225]: ts=2024-02-10T08:17:34.633Z caller=node_exporter.go:115 level=info collector=dmi 2024-02-10T08:17:34.906 INFO:journalctl@ceph.node-exporter.a.smithi018.stdout:Feb 10 08:17:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-a[69225]: ts=2024-02-10T08:17:34.633Z caller=node_exporter.go:115 level=info collector=edac 2024-02-10T08:17:34.906 INFO:journalctl@ceph.node-exporter.a.smithi018.stdout:Feb 10 08:17:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-a[69225]: ts=2024-02-10T08:17:34.633Z caller=node_exporter.go:115 level=info collector=entropy 2024-02-10T08:17:34.906 INFO:journalctl@ceph.node-exporter.a.smithi018.stdout:Feb 10 08:17:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-a[69225]: ts=2024-02-10T08:17:34.633Z caller=node_exporter.go:115 level=info collector=fibrechannel 2024-02-10T08:17:34.906 INFO:journalctl@ceph.node-exporter.a.smithi018.stdout:Feb 10 08:17:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-a[69225]: ts=2024-02-10T08:17:34.633Z caller=node_exporter.go:115 level=info collector=filefd 2024-02-10T08:17:34.906 INFO:journalctl@ceph.node-exporter.a.smithi018.stdout:Feb 10 08:17:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-a[69225]: ts=2024-02-10T08:17:34.633Z caller=node_exporter.go:115 level=info collector=filesystem 2024-02-10T08:17:34.906 INFO:journalctl@ceph.node-exporter.a.smithi018.stdout:Feb 10 08:17:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-a[69225]: ts=2024-02-10T08:17:34.633Z caller=node_exporter.go:115 level=info collector=hwmon 2024-02-10T08:17:34.906 INFO:journalctl@ceph.node-exporter.a.smithi018.stdout:Feb 10 08:17:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-a[69225]: ts=2024-02-10T08:17:34.633Z caller=node_exporter.go:115 level=info collector=infiniband 2024-02-10T08:17:34.906 INFO:journalctl@ceph.node-exporter.a.smithi018.stdout:Feb 10 08:17:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-a[69225]: ts=2024-02-10T08:17:34.633Z caller=node_exporter.go:115 level=info collector=ipvs 2024-02-10T08:17:34.906 INFO:journalctl@ceph.node-exporter.a.smithi018.stdout:Feb 10 08:17:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-a[69225]: ts=2024-02-10T08:17:34.633Z caller=node_exporter.go:115 level=info collector=loadavg 2024-02-10T08:17:34.906 INFO:journalctl@ceph.node-exporter.a.smithi018.stdout:Feb 10 08:17:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-a[69225]: ts=2024-02-10T08:17:34.633Z caller=node_exporter.go:115 level=info collector=mdadm 2024-02-10T08:17:34.906 INFO:journalctl@ceph.node-exporter.a.smithi018.stdout:Feb 10 08:17:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-a[69225]: ts=2024-02-10T08:17:34.633Z caller=node_exporter.go:115 level=info collector=meminfo 2024-02-10T08:17:34.906 INFO:journalctl@ceph.node-exporter.a.smithi018.stdout:Feb 10 08:17:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-a[69225]: ts=2024-02-10T08:17:34.633Z caller=node_exporter.go:115 level=info collector=netclass 2024-02-10T08:17:34.907 INFO:journalctl@ceph.node-exporter.a.smithi018.stdout:Feb 10 08:17:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-a[69225]: ts=2024-02-10T08:17:34.633Z caller=node_exporter.go:115 level=info collector=netdev 2024-02-10T08:17:34.907 INFO:journalctl@ceph.node-exporter.a.smithi018.stdout:Feb 10 08:17:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-a[69225]: ts=2024-02-10T08:17:34.633Z caller=node_exporter.go:115 level=info collector=netstat 2024-02-10T08:17:34.907 INFO:journalctl@ceph.node-exporter.a.smithi018.stdout:Feb 10 08:17:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-a[69225]: ts=2024-02-10T08:17:34.633Z caller=node_exporter.go:115 level=info collector=nfs 2024-02-10T08:17:34.907 INFO:journalctl@ceph.node-exporter.a.smithi018.stdout:Feb 10 08:17:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-a[69225]: ts=2024-02-10T08:17:34.633Z caller=node_exporter.go:115 level=info collector=nfsd 2024-02-10T08:17:34.907 INFO:journalctl@ceph.node-exporter.a.smithi018.stdout:Feb 10 08:17:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-a[69225]: ts=2024-02-10T08:17:34.633Z caller=node_exporter.go:115 level=info collector=nvme 2024-02-10T08:17:34.907 INFO:journalctl@ceph.node-exporter.a.smithi018.stdout:Feb 10 08:17:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-a[69225]: ts=2024-02-10T08:17:34.633Z caller=node_exporter.go:115 level=info collector=os 2024-02-10T08:17:34.907 INFO:journalctl@ceph.node-exporter.a.smithi018.stdout:Feb 10 08:17:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-a[69225]: ts=2024-02-10T08:17:34.633Z caller=node_exporter.go:115 level=info collector=powersupplyclass 2024-02-10T08:17:34.907 INFO:journalctl@ceph.node-exporter.a.smithi018.stdout:Feb 10 08:17:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-a[69225]: ts=2024-02-10T08:17:34.633Z caller=node_exporter.go:115 level=info collector=pressure 2024-02-10T08:17:34.907 INFO:journalctl@ceph.node-exporter.a.smithi018.stdout:Feb 10 08:17:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-a[69225]: ts=2024-02-10T08:17:34.633Z caller=node_exporter.go:115 level=info collector=rapl 2024-02-10T08:17:34.907 INFO:journalctl@ceph.node-exporter.a.smithi018.stdout:Feb 10 08:17:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-a[69225]: ts=2024-02-10T08:17:34.633Z caller=node_exporter.go:115 level=info collector=schedstat 2024-02-10T08:17:34.907 INFO:journalctl@ceph.node-exporter.a.smithi018.stdout:Feb 10 08:17:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-a[69225]: ts=2024-02-10T08:17:34.633Z caller=node_exporter.go:115 level=info collector=sockstat 2024-02-10T08:17:34.907 INFO:journalctl@ceph.node-exporter.a.smithi018.stdout:Feb 10 08:17:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-a[69225]: ts=2024-02-10T08:17:34.633Z caller=node_exporter.go:115 level=info collector=softnet 2024-02-10T08:17:34.907 INFO:journalctl@ceph.node-exporter.a.smithi018.stdout:Feb 10 08:17:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-a[69225]: ts=2024-02-10T08:17:34.633Z caller=node_exporter.go:115 level=info collector=stat 2024-02-10T08:17:34.908 INFO:journalctl@ceph.node-exporter.a.smithi018.stdout:Feb 10 08:17:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-a[69225]: ts=2024-02-10T08:17:34.633Z caller=node_exporter.go:115 level=info collector=tapestats 2024-02-10T08:17:34.908 INFO:journalctl@ceph.node-exporter.a.smithi018.stdout:Feb 10 08:17:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-a[69225]: ts=2024-02-10T08:17:34.633Z caller=node_exporter.go:115 level=info collector=textfile 2024-02-10T08:17:34.908 INFO:journalctl@ceph.node-exporter.a.smithi018.stdout:Feb 10 08:17:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-a[69225]: ts=2024-02-10T08:17:34.633Z caller=node_exporter.go:115 level=info collector=thermal_zone 2024-02-10T08:17:34.908 INFO:journalctl@ceph.node-exporter.a.smithi018.stdout:Feb 10 08:17:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-a[69225]: ts=2024-02-10T08:17:34.633Z caller=node_exporter.go:115 level=info collector=time 2024-02-10T08:17:34.908 INFO:journalctl@ceph.node-exporter.a.smithi018.stdout:Feb 10 08:17:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-a[69225]: ts=2024-02-10T08:17:34.633Z caller=node_exporter.go:115 level=info collector=udp_queues 2024-02-10T08:17:34.908 INFO:journalctl@ceph.node-exporter.a.smithi018.stdout:Feb 10 08:17:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-a[69225]: ts=2024-02-10T08:17:34.633Z caller=node_exporter.go:115 level=info collector=uname 2024-02-10T08:17:34.908 INFO:journalctl@ceph.node-exporter.a.smithi018.stdout:Feb 10 08:17:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-a[69225]: ts=2024-02-10T08:17:34.633Z caller=node_exporter.go:115 level=info collector=vmstat 2024-02-10T08:17:34.908 INFO:journalctl@ceph.node-exporter.a.smithi018.stdout:Feb 10 08:17:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-a[69225]: ts=2024-02-10T08:17:34.633Z caller=node_exporter.go:115 level=info collector=xfs 2024-02-10T08:17:34.908 INFO:journalctl@ceph.node-exporter.a.smithi018.stdout:Feb 10 08:17:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-a[69225]: ts=2024-02-10T08:17:34.633Z caller=node_exporter.go:115 level=info collector=zfs 2024-02-10T08:17:34.908 INFO:journalctl@ceph.node-exporter.a.smithi018.stdout:Feb 10 08:17:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-a[69225]: ts=2024-02-10T08:17:34.633Z caller=node_exporter.go:199 level=info msg="Listening on" address=:9100 2024-02-10T08:17:34.908 INFO:journalctl@ceph.node-exporter.a.smithi018.stdout:Feb 10 08:17:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-a[69225]: ts=2024-02-10T08:17:34.634Z caller=tls_config.go:195 level=info msg="TLS is disabled." http2=false 2024-02-10T08:17:34.908 INFO:journalctl@ceph.node-exporter.a.smithi018.stdout:Feb 10 08:17:34 smithi018 bash[69070]: c36c43d9eb875bf1d0c5bc8f58deb1fe225ad6491d9d3386340fcb49e3df5af1 2024-02-10T08:17:34.908 INFO:journalctl@ceph.node-exporter.a.smithi018.stdout:Feb 10 08:17:34 smithi018 systemd[1]: Started Ceph node-exporter.a for d46257c8-c7eb-11ee-95b8-87774f69a715. 2024-02-10T08:17:35.289 INFO:journalctl@ceph.node-exporter.b.smithi071.stdout:Feb 10 08:17:35 smithi071 systemd[1]: Starting Ceph node-exporter.b for d46257c8-c7eb-11ee-95b8-87774f69a715... 2024-02-10T08:17:35.773 INFO:journalctl@ceph.node-exporter.b.smithi071.stdout:Feb 10 08:17:35 smithi071 bash[63855]: Trying to pull quay.io/prometheus/node-exporter:v1.3.1... 2024-02-10T08:17:35.774 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:34.449679+0000 mgr.y (mgr.14505) 22 : cluster [DBG] pgmap v16: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-02-10T08:17:35.774 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:34.772915+0000 mon.a (mon.0) 666 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:17:35.774 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cephadm 2024-02-10T08:17:34.773802+0000 mgr.y (mgr.14505) 23 : cephadm [INF] Deploying daemon node-exporter.b on smithi071 2024-02-10T08:17:35.774 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:35.303010+0000 mon.a (mon.0) 667 : cluster [DBG] osdmap e69: 8 total, 8 up, 8 in 2024-02-10T08:17:36.039 INFO:journalctl@ceph.node-exporter.b.smithi071.stdout:Feb 10 08:17:35 smithi071 bash[63855]: Getting image source signatures 2024-02-10T08:17:36.039 INFO:journalctl@ceph.node-exporter.b.smithi071.stdout:Feb 10 08:17:35 smithi071 bash[63855]: Copying blob sha256:b5db1e299295edf3005515ab7879c1df64a33c185d3a7a23aa4dcaa17d26f7b3 2024-02-10T08:17:36.039 INFO:journalctl@ceph.node-exporter.b.smithi071.stdout:Feb 10 08:17:35 smithi071 bash[63855]: Copying blob sha256:aa2a8d90b84cb2a9c422e7005cd166a008ccf22ef5d7d4f07128478585ce35ea 2024-02-10T08:17:36.039 INFO:journalctl@ceph.node-exporter.b.smithi071.stdout:Feb 10 08:17:35 smithi071 bash[63855]: Copying blob sha256:b45d31ee2d7f9f452678a85b0c837c29e12089f31ee8dbac6c8c24dfa4054a30 2024-02-10T08:17:36.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:34.449679+0000 mgr.y (mgr.14505) 22 : cluster [DBG] pgmap v16: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-02-10T08:17:36.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:34.772915+0000 mon.a (mon.0) 666 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:17:36.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cephadm 2024-02-10T08:17:34.773802+0000 mgr.y (mgr.14505) 23 : cephadm [INF] Deploying daemon node-exporter.b on smithi071 2024-02-10T08:17:36.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:35.303010+0000 mon.a (mon.0) 667 : cluster [DBG] osdmap e69: 8 total, 8 up, 8 in 2024-02-10T08:17:36.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:34.449679+0000 mgr.y (mgr.14505) 22 : cluster [DBG] pgmap v16: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-02-10T08:17:36.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:34.772915+0000 mon.a (mon.0) 666 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:17:36.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cephadm 2024-02-10T08:17:34.773802+0000 mgr.y (mgr.14505) 23 : cephadm [INF] Deploying daemon node-exporter.b on smithi071 2024-02-10T08:17:36.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:35.303010+0000 mon.a (mon.0) 667 : cluster [DBG] osdmap e69: 8 total, 8 up, 8 in 2024-02-10T08:17:37.076 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-02-10T08:17:37.289 INFO:journalctl@ceph.node-exporter.b.smithi071.stdout:Feb 10 08:17:37 smithi071 bash[63855]: Copying config sha256:1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26 2024-02-10T08:17:37.289 INFO:journalctl@ceph.node-exporter.b.smithi071.stdout:Feb 10 08:17:37 smithi071 bash[63855]: Writing manifest to image destination 2024-02-10T08:17:37.702 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd pool get iscsi pg_num 2024-02-10T08:17:37.775 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:17:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:17:37.982 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:17:38.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:36.450260+0000 mgr.y (mgr.14505) 24 : cluster [DBG] pgmap v18: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-10T08:17:38.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:37.075775+0000 mon.c (mon.2) 17 : audit [DBG] from='client.? 172.21.15.18:0/3014560438' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".rgw.root", "var": "pg_num"}]: dispatch 2024-02-10T08:17:38.040 INFO:journalctl@ceph.node-exporter.b.smithi071.stdout:Feb 10 08:17:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-b[63905]: ts=2024-02-10T08:17:37.888Z caller=node_exporter.go:182 level=info msg="Starting node_exporter" version="(version=1.3.1, branch=HEAD, revision=a2321e7b940ddcff26873612bccdf7cd4c42b6b6)" 2024-02-10T08:17:38.040 INFO:journalctl@ceph.node-exporter.b.smithi071.stdout:Feb 10 08:17:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-b[63905]: ts=2024-02-10T08:17:37.888Z caller=node_exporter.go:183 level=info msg="Build context" build_context="(go=go1.17.3, user=root@243aafa5525c, date=20211205-11:09:49)" 2024-02-10T08:17:38.040 INFO:journalctl@ceph.node-exporter.b.smithi071.stdout:Feb 10 08:17:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-b[63905]: ts=2024-02-10T08:17:37.888Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+)($|/) 2024-02-10T08:17:38.040 INFO:journalctl@ceph.node-exporter.b.smithi071.stdout:Feb 10 08:17:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-b[63905]: ts=2024-02-10T08:17:37.889Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-02-10T08:17:38.040 INFO:journalctl@ceph.node-exporter.b.smithi071.stdout:Feb 10 08:17:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-b[63905]: ts=2024-02-10T08:17:37.889Z caller=node_exporter.go:108 level=info msg="Enabled collectors" 2024-02-10T08:17:38.040 INFO:journalctl@ceph.node-exporter.b.smithi071.stdout:Feb 10 08:17:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-b[63905]: ts=2024-02-10T08:17:37.889Z caller=node_exporter.go:115 level=info collector=arp 2024-02-10T08:17:38.040 INFO:journalctl@ceph.node-exporter.b.smithi071.stdout:Feb 10 08:17:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-b[63905]: ts=2024-02-10T08:17:37.889Z caller=node_exporter.go:115 level=info collector=bcache 2024-02-10T08:17:38.040 INFO:journalctl@ceph.node-exporter.b.smithi071.stdout:Feb 10 08:17:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-b[63905]: ts=2024-02-10T08:17:37.889Z caller=node_exporter.go:115 level=info collector=bonding 2024-02-10T08:17:38.040 INFO:journalctl@ceph.node-exporter.b.smithi071.stdout:Feb 10 08:17:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-b[63905]: ts=2024-02-10T08:17:37.889Z caller=node_exporter.go:115 level=info collector=btrfs 2024-02-10T08:17:38.040 INFO:journalctl@ceph.node-exporter.b.smithi071.stdout:Feb 10 08:17:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-b[63905]: ts=2024-02-10T08:17:37.889Z caller=node_exporter.go:115 level=info collector=conntrack 2024-02-10T08:17:38.040 INFO:journalctl@ceph.node-exporter.b.smithi071.stdout:Feb 10 08:17:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-b[63905]: ts=2024-02-10T08:17:37.889Z caller=node_exporter.go:115 level=info collector=cpu 2024-02-10T08:17:38.041 INFO:journalctl@ceph.node-exporter.b.smithi071.stdout:Feb 10 08:17:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-b[63905]: ts=2024-02-10T08:17:37.889Z caller=node_exporter.go:115 level=info collector=cpufreq 2024-02-10T08:17:38.041 INFO:journalctl@ceph.node-exporter.b.smithi071.stdout:Feb 10 08:17:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-b[63905]: ts=2024-02-10T08:17:37.889Z caller=node_exporter.go:115 level=info collector=diskstats 2024-02-10T08:17:38.041 INFO:journalctl@ceph.node-exporter.b.smithi071.stdout:Feb 10 08:17:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-b[63905]: ts=2024-02-10T08:17:37.889Z caller=node_exporter.go:115 level=info collector=dmi 2024-02-10T08:17:38.041 INFO:journalctl@ceph.node-exporter.b.smithi071.stdout:Feb 10 08:17:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-b[63905]: ts=2024-02-10T08:17:37.889Z caller=node_exporter.go:115 level=info collector=edac 2024-02-10T08:17:38.041 INFO:journalctl@ceph.node-exporter.b.smithi071.stdout:Feb 10 08:17:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-b[63905]: ts=2024-02-10T08:17:37.889Z caller=node_exporter.go:115 level=info collector=entropy 2024-02-10T08:17:38.041 INFO:journalctl@ceph.node-exporter.b.smithi071.stdout:Feb 10 08:17:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-b[63905]: ts=2024-02-10T08:17:37.889Z caller=node_exporter.go:115 level=info collector=fibrechannel 2024-02-10T08:17:38.041 INFO:journalctl@ceph.node-exporter.b.smithi071.stdout:Feb 10 08:17:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-b[63905]: ts=2024-02-10T08:17:37.889Z caller=node_exporter.go:115 level=info collector=filefd 2024-02-10T08:17:38.041 INFO:journalctl@ceph.node-exporter.b.smithi071.stdout:Feb 10 08:17:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-b[63905]: ts=2024-02-10T08:17:37.889Z caller=node_exporter.go:115 level=info collector=filesystem 2024-02-10T08:17:38.041 INFO:journalctl@ceph.node-exporter.b.smithi071.stdout:Feb 10 08:17:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-b[63905]: ts=2024-02-10T08:17:37.889Z caller=node_exporter.go:115 level=info collector=hwmon 2024-02-10T08:17:38.041 INFO:journalctl@ceph.node-exporter.b.smithi071.stdout:Feb 10 08:17:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-b[63905]: ts=2024-02-10T08:17:37.889Z caller=node_exporter.go:115 level=info collector=infiniband 2024-02-10T08:17:38.041 INFO:journalctl@ceph.node-exporter.b.smithi071.stdout:Feb 10 08:17:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-b[63905]: ts=2024-02-10T08:17:37.889Z caller=node_exporter.go:115 level=info collector=ipvs 2024-02-10T08:17:38.041 INFO:journalctl@ceph.node-exporter.b.smithi071.stdout:Feb 10 08:17:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-b[63905]: ts=2024-02-10T08:17:37.889Z caller=node_exporter.go:115 level=info collector=loadavg 2024-02-10T08:17:38.041 INFO:journalctl@ceph.node-exporter.b.smithi071.stdout:Feb 10 08:17:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-b[63905]: ts=2024-02-10T08:17:37.889Z caller=node_exporter.go:115 level=info collector=mdadm 2024-02-10T08:17:38.041 INFO:journalctl@ceph.node-exporter.b.smithi071.stdout:Feb 10 08:17:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-b[63905]: ts=2024-02-10T08:17:37.889Z caller=node_exporter.go:115 level=info collector=meminfo 2024-02-10T08:17:38.042 INFO:journalctl@ceph.node-exporter.b.smithi071.stdout:Feb 10 08:17:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-b[63905]: ts=2024-02-10T08:17:37.889Z caller=node_exporter.go:115 level=info collector=netclass 2024-02-10T08:17:38.042 INFO:journalctl@ceph.node-exporter.b.smithi071.stdout:Feb 10 08:17:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-b[63905]: ts=2024-02-10T08:17:37.889Z caller=node_exporter.go:115 level=info collector=netdev 2024-02-10T08:17:38.042 INFO:journalctl@ceph.node-exporter.b.smithi071.stdout:Feb 10 08:17:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-b[63905]: ts=2024-02-10T08:17:37.889Z caller=node_exporter.go:115 level=info collector=netstat 2024-02-10T08:17:38.042 INFO:journalctl@ceph.node-exporter.b.smithi071.stdout:Feb 10 08:17:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-b[63905]: ts=2024-02-10T08:17:37.889Z caller=node_exporter.go:115 level=info collector=nfs 2024-02-10T08:17:38.042 INFO:journalctl@ceph.node-exporter.b.smithi071.stdout:Feb 10 08:17:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-b[63905]: ts=2024-02-10T08:17:37.889Z caller=node_exporter.go:115 level=info collector=nfsd 2024-02-10T08:17:38.042 INFO:journalctl@ceph.node-exporter.b.smithi071.stdout:Feb 10 08:17:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-b[63905]: ts=2024-02-10T08:17:37.889Z caller=node_exporter.go:115 level=info collector=nvme 2024-02-10T08:17:38.042 INFO:journalctl@ceph.node-exporter.b.smithi071.stdout:Feb 10 08:17:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-b[63905]: ts=2024-02-10T08:17:37.889Z caller=node_exporter.go:115 level=info collector=os 2024-02-10T08:17:38.042 INFO:journalctl@ceph.node-exporter.b.smithi071.stdout:Feb 10 08:17:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-b[63905]: ts=2024-02-10T08:17:37.889Z caller=node_exporter.go:115 level=info collector=powersupplyclass 2024-02-10T08:17:38.042 INFO:journalctl@ceph.node-exporter.b.smithi071.stdout:Feb 10 08:17:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-b[63905]: ts=2024-02-10T08:17:37.889Z caller=node_exporter.go:115 level=info collector=pressure 2024-02-10T08:17:38.042 INFO:journalctl@ceph.node-exporter.b.smithi071.stdout:Feb 10 08:17:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-b[63905]: ts=2024-02-10T08:17:37.889Z caller=node_exporter.go:115 level=info collector=rapl 2024-02-10T08:17:38.042 INFO:journalctl@ceph.node-exporter.b.smithi071.stdout:Feb 10 08:17:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-b[63905]: ts=2024-02-10T08:17:37.889Z caller=node_exporter.go:115 level=info collector=schedstat 2024-02-10T08:17:38.042 INFO:journalctl@ceph.node-exporter.b.smithi071.stdout:Feb 10 08:17:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-b[63905]: ts=2024-02-10T08:17:37.889Z caller=node_exporter.go:115 level=info collector=sockstat 2024-02-10T08:17:38.042 INFO:journalctl@ceph.node-exporter.b.smithi071.stdout:Feb 10 08:17:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-b[63905]: ts=2024-02-10T08:17:37.889Z caller=node_exporter.go:115 level=info collector=softnet 2024-02-10T08:17:38.042 INFO:journalctl@ceph.node-exporter.b.smithi071.stdout:Feb 10 08:17:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-b[63905]: ts=2024-02-10T08:17:37.889Z caller=node_exporter.go:115 level=info collector=stat 2024-02-10T08:17:38.042 INFO:journalctl@ceph.node-exporter.b.smithi071.stdout:Feb 10 08:17:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-b[63905]: ts=2024-02-10T08:17:37.889Z caller=node_exporter.go:115 level=info collector=tapestats 2024-02-10T08:17:38.043 INFO:journalctl@ceph.node-exporter.b.smithi071.stdout:Feb 10 08:17:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-b[63905]: ts=2024-02-10T08:17:37.889Z caller=node_exporter.go:115 level=info collector=textfile 2024-02-10T08:17:38.043 INFO:journalctl@ceph.node-exporter.b.smithi071.stdout:Feb 10 08:17:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-b[63905]: ts=2024-02-10T08:17:37.889Z caller=node_exporter.go:115 level=info collector=thermal_zone 2024-02-10T08:17:38.043 INFO:journalctl@ceph.node-exporter.b.smithi071.stdout:Feb 10 08:17:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-b[63905]: ts=2024-02-10T08:17:37.889Z caller=node_exporter.go:115 level=info collector=time 2024-02-10T08:17:38.043 INFO:journalctl@ceph.node-exporter.b.smithi071.stdout:Feb 10 08:17:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-b[63905]: ts=2024-02-10T08:17:37.889Z caller=node_exporter.go:115 level=info collector=udp_queues 2024-02-10T08:17:38.043 INFO:journalctl@ceph.node-exporter.b.smithi071.stdout:Feb 10 08:17:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-b[63905]: ts=2024-02-10T08:17:37.889Z caller=node_exporter.go:115 level=info collector=uname 2024-02-10T08:17:38.043 INFO:journalctl@ceph.node-exporter.b.smithi071.stdout:Feb 10 08:17:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-b[63905]: ts=2024-02-10T08:17:37.889Z caller=node_exporter.go:115 level=info collector=vmstat 2024-02-10T08:17:38.043 INFO:journalctl@ceph.node-exporter.b.smithi071.stdout:Feb 10 08:17:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-b[63905]: ts=2024-02-10T08:17:37.889Z caller=node_exporter.go:115 level=info collector=xfs 2024-02-10T08:17:38.043 INFO:journalctl@ceph.node-exporter.b.smithi071.stdout:Feb 10 08:17:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-b[63905]: ts=2024-02-10T08:17:37.889Z caller=node_exporter.go:115 level=info collector=zfs 2024-02-10T08:17:38.043 INFO:journalctl@ceph.node-exporter.b.smithi071.stdout:Feb 10 08:17:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-b[63905]: ts=2024-02-10T08:17:37.889Z caller=node_exporter.go:199 level=info msg="Listening on" address=:9100 2024-02-10T08:17:38.043 INFO:journalctl@ceph.node-exporter.b.smithi071.stdout:Feb 10 08:17:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-b[63905]: ts=2024-02-10T08:17:37.889Z caller=tls_config.go:195 level=info msg="TLS is disabled." http2=false 2024-02-10T08:17:38.043 INFO:journalctl@ceph.node-exporter.b.smithi071.stdout:Feb 10 08:17:37 smithi071 bash[63855]: 2018e931e60eeafc34ba78cb49d0025baa8c9516677171f0f8114edab1eb28fa 2024-02-10T08:17:38.043 INFO:journalctl@ceph.node-exporter.b.smithi071.stdout:Feb 10 08:17:37 smithi071 systemd[1]: Started Ceph node-exporter.b for d46257c8-c7eb-11ee-95b8-87774f69a715. 2024-02-10T08:17:38.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:36.450260+0000 mgr.y (mgr.14505) 24 : cluster [DBG] pgmap v18: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-10T08:17:38.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:37.075775+0000 mon.c (mon.2) 17 : audit [DBG] from='client.? 172.21.15.18:0/3014560438' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".rgw.root", "var": "pg_num"}]: dispatch 2024-02-10T08:17:38.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:36.450260+0000 mgr.y (mgr.14505) 24 : cluster [DBG] pgmap v18: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-10T08:17:38.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:37.075775+0000 mon.c (mon.2) 17 : audit [DBG] from='client.? 172.21.15.18:0/3014560438' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".rgw.root", "var": "pg_num"}]: dispatch 2024-02-10T08:17:39.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:37.461899+0000 mgr.y (mgr.14505) 25 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:17:39.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:38.027779+0000 mon.a (mon.0) 668 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:17:39.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:37.461899+0000 mgr.y (mgr.14505) 25 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:17:39.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:38.027779+0000 mon.a (mon.0) 668 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:17:39.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:37.461899+0000 mgr.y (mgr.14505) 25 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:17:39.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:38.027779+0000 mon.a (mon.0) 668 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:17:39.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cephadm 2024-02-10T08:17:38.037783+0000 mgr.y (mgr.14505) 26 : cephadm [INF] Deploying daemon prometheus.a on smithi071 2024-02-10T08:17:39.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:38.451149+0000 mgr.y (mgr.14505) 27 : cluster [DBG] pgmap v19: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:17:39.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cephadm 2024-02-10T08:17:38.037783+0000 mgr.y (mgr.14505) 26 : cephadm [INF] Deploying daemon prometheus.a on smithi071 2024-02-10T08:17:39.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:38.451149+0000 mgr.y (mgr.14505) 27 : cluster [DBG] pgmap v19: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:17:40.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cephadm 2024-02-10T08:17:38.037783+0000 mgr.y (mgr.14505) 26 : cephadm [INF] Deploying daemon prometheus.a on smithi071 2024-02-10T08:17:40.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:38.451149+0000 mgr.y (mgr.14505) 27 : cluster [DBG] pgmap v19: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:17:40.045 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 3 2024-02-10T08:17:41.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:40.045607+0000 mon.c (mon.2) 18 : audit [DBG] from='client.? 172.21.15.18:0/3617550039' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "iscsi", "var": "pg_num"}]: dispatch 2024-02-10T08:17:41.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:40.304052+0000 mon.a (mon.0) 669 : cluster [DBG] osdmap e70: 8 total, 8 up, 8 in 2024-02-10T08:17:41.047 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:40.045607+0000 mon.c (mon.2) 18 : audit [DBG] from='client.? 172.21.15.18:0/3617550039' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "iscsi", "var": "pg_num"}]: dispatch 2024-02-10T08:17:41.047 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:40.304052+0000 mon.a (mon.0) 669 : cluster [DBG] osdmap e70: 8 total, 8 up, 8 in 2024-02-10T08:17:41.048 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:40.045607+0000 mon.c (mon.2) 18 : audit [DBG] from='client.? 172.21.15.18:0/3617550039' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "iscsi", "var": "pg_num"}]: dispatch 2024-02-10T08:17:41.048 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:40.304052+0000 mon.a (mon.0) 669 : cluster [DBG] osdmap e70: 8 total, 8 up, 8 in 2024-02-10T08:17:41.048 INFO:journalctl@ceph.alertmanager.a.smithi018.stdout:Feb 10 08:17:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-alertmanager-a[68766]: level=info ts=2024-02-10T08:17:40.739Z caller=cluster.go:688 component=cluster msg="gossip settled; proceeding" elapsed=10.001433833s 2024-02-10T08:17:41.071 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd pool get default.rgw.log pg_num 2024-02-10T08:17:41.353 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:17:41.899 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:40.451659+0000 mgr.y (mgr.14505) 28 : cluster [DBG] pgmap v21: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-10T08:17:41.899 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:41.607560+0000 mon.a (mon.0) 670 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:17:41.899 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:40.451659+0000 mgr.y (mgr.14505) 28 : cluster [DBG] pgmap v21: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-10T08:17:41.899 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:41.607560+0000 mon.a (mon.0) 670 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:17:42.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:41 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:40.451659+0000 mgr.y (mgr.14505) 28 : cluster [DBG] pgmap v21: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-10T08:17:42.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:41 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:41.607560+0000 mon.a (mon.0) 670 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:17:43.333 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-02-10T08:17:43.980 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:42.452211+0000 mgr.y (mgr.14505) 29 : cluster [DBG] pgmap v22: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:17:43.980 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:43.333349+0000 mon.a (mon.0) 671 : audit [DBG] from='client.? 172.21.15.18:0/1811312901' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "default.rgw.log", "var": "pg_num"}]: dispatch 2024-02-10T08:17:43.980 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:42.452211+0000 mgr.y (mgr.14505) 29 : cluster [DBG] pgmap v22: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:17:43.980 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:43.333349+0000 mon.a (mon.0) 671 : audit [DBG] from='client.? 172.21.15.18:0/1811312901' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "default.rgw.log", "var": "pg_num"}]: dispatch 2024-02-10T08:17:44.001 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd pool get default.rgw.control pg_num 2024-02-10T08:17:44.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:43 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:42.452211+0000 mgr.y (mgr.14505) 29 : cluster [DBG] pgmap v22: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:17:44.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:43 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:43.333349+0000 mon.a (mon.0) 671 : audit [DBG] from='client.? 172.21.15.18:0/1811312901' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "default.rgw.log", "var": "pg_num"}]: dispatch 2024-02-10T08:17:44.278 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:17:44.843 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:43.797193+0000 osd.3 (osd.3) 5 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:17:44.843 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:43.797262+0000 osd.3 (osd.3) 6 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:17:44.843 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:43.797193+0000 osd.3 (osd.3) 5 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:17:44.843 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:43.797262+0000 osd.3 (osd.3) 6 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:17:45.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:44 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:43.797193+0000 osd.3 (osd.3) 5 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:17:45.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:44 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:43.797262+0000 osd.3 (osd.3) 6 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:17:45.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:44.452532+0000 mgr.y (mgr.14505) 30 : cluster [DBG] pgmap v23: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-02-10T08:17:45.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:44.794579+0000 mon.a (mon.0) 672 : cluster [DBG] osdmap e71: 8 total, 8 up, 8 in 2024-02-10T08:17:45.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:45.305914+0000 mon.a (mon.0) 673 : cluster [DBG] osdmap e72: 8 total, 8 up, 8 in 2024-02-10T08:17:45.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:44.452532+0000 mgr.y (mgr.14505) 30 : cluster [DBG] pgmap v23: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-02-10T08:17:45.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:44.794579+0000 mon.a (mon.0) 672 : cluster [DBG] osdmap e71: 8 total, 8 up, 8 in 2024-02-10T08:17:45.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:45.305914+0000 mon.a (mon.0) 673 : cluster [DBG] osdmap e72: 8 total, 8 up, 8 in 2024-02-10T08:17:46.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:44.452532+0000 mgr.y (mgr.14505) 30 : cluster [DBG] pgmap v23: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-02-10T08:17:46.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:44.794579+0000 mon.a (mon.0) 672 : cluster [DBG] osdmap e71: 8 total, 8 up, 8 in 2024-02-10T08:17:46.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:45.305914+0000 mon.a (mon.0) 673 : cluster [DBG] osdmap e72: 8 total, 8 up, 8 in 2024-02-10T08:17:46.346 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-02-10T08:17:47.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:46.346130+0000 mon.a (mon.0) 674 : audit [DBG] from='client.? 172.21.15.18:0/179056521' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "default.rgw.control", "var": "pg_num"}]: dispatch 2024-02-10T08:17:47.059 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:46.346130+0000 mon.a (mon.0) 674 : audit [DBG] from='client.? 172.21.15.18:0/179056521' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "default.rgw.control", "var": "pg_num"}]: dispatch 2024-02-10T08:17:47.060 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:46.346130+0000 mon.a (mon.0) 674 : audit [DBG] from='client.? 172.21.15.18:0/179056521' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "default.rgw.control", "var": "pg_num"}]: dispatch 2024-02-10T08:17:47.080 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd pool get default.rgw.meta pg_num 2024-02-10T08:17:47.355 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:17:47.703 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:17:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:17:47.840 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:46.452937+0000 mgr.y (mgr.14505) 31 : cluster [DBG] pgmap v26: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 832 B/s rd, 0 op/s 2024-02-10T08:17:47.841 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:46.452937+0000 mgr.y (mgr.14505) 31 : cluster [DBG] pgmap v26: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 832 B/s rd, 0 op/s 2024-02-10T08:17:48.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:46.452937+0000 mgr.y (mgr.14505) 31 : cluster [DBG] pgmap v26: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 832 B/s rd, 0 op/s 2024-02-10T08:17:48.377 INFO:journalctl@ceph.prometheus.a.smithi071.stdout:Feb 10 08:17:48 smithi071 systemd[1]: Starting Ceph prometheus.a for d46257c8-c7eb-11ee-95b8-87774f69a715... 2024-02-10T08:17:48.974 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:47.469962+0000 mgr.y (mgr.14505) 32 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:17:48.974 INFO:journalctl@ceph.prometheus.a.smithi071.stdout:Feb 10 08:17:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-prometheus-a[64383]: ts=2024-02-10T08:17:48.952Z caller=main.go:512 level=info msg="Starting Prometheus" version="(version=2.33.4, branch=HEAD, revision=83032011a5d3e6102624fe58241a374a7201fee8)" 2024-02-10T08:17:48.974 INFO:journalctl@ceph.prometheus.a.smithi071.stdout:Feb 10 08:17:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-prometheus-a[64383]: ts=2024-02-10T08:17:48.952Z caller=main.go:517 level=info build_context="(go=go1.17.7, user=root@d13bf69e7be8, date=20220222-16:51:28)" 2024-02-10T08:17:48.975 INFO:journalctl@ceph.prometheus.a.smithi071.stdout:Feb 10 08:17:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-prometheus-a[64383]: ts=2024-02-10T08:17:48.952Z caller=main.go:518 level=info host_details="(Linux 4.18.0-536.el8.x86_64 #1 SMP Thu Jan 18 15:15:29 UTC 2024 x86_64 smithi071 (none))" 2024-02-10T08:17:48.975 INFO:journalctl@ceph.prometheus.a.smithi071.stdout:Feb 10 08:17:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-prometheus-a[64383]: ts=2024-02-10T08:17:48.952Z caller=main.go:519 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-02-10T08:17:48.975 INFO:journalctl@ceph.prometheus.a.smithi071.stdout:Feb 10 08:17:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-prometheus-a[64383]: ts=2024-02-10T08:17:48.952Z caller=main.go:520 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-02-10T08:17:48.975 INFO:journalctl@ceph.prometheus.a.smithi071.stdout:Feb 10 08:17:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-prometheus-a[64383]: ts=2024-02-10T08:17:48.954Z caller=web.go:570 level=info component=web msg="Start listening for connections" address=:9095 2024-02-10T08:17:48.975 INFO:journalctl@ceph.prometheus.a.smithi071.stdout:Feb 10 08:17:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-prometheus-a[64383]: ts=2024-02-10T08:17:48.954Z caller=main.go:923 level=info msg="Starting TSDB ..." 2024-02-10T08:17:48.975 INFO:journalctl@ceph.prometheus.a.smithi071.stdout:Feb 10 08:17:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-prometheus-a[64383]: ts=2024-02-10T08:17:48.955Z caller=tls_config.go:195 level=info component=web msg="TLS is disabled." http2=false 2024-02-10T08:17:48.975 INFO:journalctl@ceph.prometheus.a.smithi071.stdout:Feb 10 08:17:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-prometheus-a[64383]: ts=2024-02-10T08:17:48.956Z caller=head.go:493 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-02-10T08:17:48.975 INFO:journalctl@ceph.prometheus.a.smithi071.stdout:Feb 10 08:17:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-prometheus-a[64383]: ts=2024-02-10T08:17:48.956Z caller=head.go:527 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=2.359µs 2024-02-10T08:17:48.975 INFO:journalctl@ceph.prometheus.a.smithi071.stdout:Feb 10 08:17:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-prometheus-a[64383]: ts=2024-02-10T08:17:48.956Z caller=head.go:533 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-02-10T08:17:48.975 INFO:journalctl@ceph.prometheus.a.smithi071.stdout:Feb 10 08:17:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-prometheus-a[64383]: ts=2024-02-10T08:17:48.956Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=0 2024-02-10T08:17:48.975 INFO:journalctl@ceph.prometheus.a.smithi071.stdout:Feb 10 08:17:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-prometheus-a[64383]: ts=2024-02-10T08:17:48.956Z caller=head.go:610 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=43.254µs wal_replay_duration=111.96µs total_replay_duration=176.497µs 2024-02-10T08:17:48.975 INFO:journalctl@ceph.prometheus.a.smithi071.stdout:Feb 10 08:17:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-prometheus-a[64383]: ts=2024-02-10T08:17:48.957Z caller=main.go:944 level=info fs_type=XFS_SUPER_MAGIC 2024-02-10T08:17:48.975 INFO:journalctl@ceph.prometheus.a.smithi071.stdout:Feb 10 08:17:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-prometheus-a[64383]: ts=2024-02-10T08:17:48.957Z caller=main.go:947 level=info msg="TSDB started" 2024-02-10T08:17:48.976 INFO:journalctl@ceph.prometheus.a.smithi071.stdout:Feb 10 08:17:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-prometheus-a[64383]: ts=2024-02-10T08:17:48.957Z caller=main.go:1128 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-02-10T08:17:48.976 INFO:journalctl@ceph.prometheus.a.smithi071.stdout:Feb 10 08:17:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-prometheus-a[64383]: ts=2024-02-10T08:17:48.974Z caller=main.go:1165 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=16.495711ms db_storage=690ns remote_storage=1.101µs web_handler=180ns query_engine=828ns scrape=572.21µs scrape_sd=20.654µs notify=18.917µs notify_sd=6.585µs rules=15.670011ms 2024-02-10T08:17:48.976 INFO:journalctl@ceph.prometheus.a.smithi071.stdout:Feb 10 08:17:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-prometheus-a[64383]: ts=2024-02-10T08:17:48.974Z caller=main.go:896 level=info msg="Server is ready to receive web requests." 2024-02-10T08:17:49.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:47.469962+0000 mgr.y (mgr.14505) 32 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:17:49.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:47.469962+0000 mgr.y (mgr.14505) 32 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:17:49.263 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-02-10T08:17:49.289 INFO:journalctl@ceph.prometheus.a.smithi071.stdout:Feb 10 08:17:49 smithi071 bash[64368]: b98c801c8c2b3fe55fb232552f72db2d90d1d053744589f6bd68fbae9552ece5 2024-02-10T08:17:49.289 INFO:journalctl@ceph.prometheus.a.smithi071.stdout:Feb 10 08:17:49 smithi071 systemd[1]: Started Ceph prometheus.a for d46257c8-c7eb-11ee-95b8-87774f69a715. 2024-02-10T08:17:49.654 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:17:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: [10/Feb/2024:08:17:49] ENGINE Bus STOPPING 2024-02-10T08:17:49.654 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:17:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: [10/Feb/2024:08:17:49] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-02-10T08:17:49.654 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:17:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: [10/Feb/2024:08:17:49] ENGINE Bus STOPPED 2024-02-10T08:17:49.654 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:17:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: [10/Feb/2024:08:17:49] ENGINE Bus STARTING 2024-02-10T08:17:49.654 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:17:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: [10/Feb/2024:08:17:49] ENGINE Serving on http://:::9283 2024-02-10T08:17:49.654 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:17:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: [10/Feb/2024:08:17:49] ENGINE Bus STARTED 2024-02-10T08:17:50.100 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:48.453653+0000 mgr.y (mgr.14505) 33 : cluster [DBG] pgmap v27: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:17:50.100 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:49.085425+0000 mon.a (mon.0) 675 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:17:50.100 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:49.173446+0000 mon.a (mon.0) 676 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:17:50.100 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:49.177014+0000 mon.a (mon.0) 677 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:17:50.100 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:49.179373+0000 mon.a (mon.0) 678 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-10T08:17:50.100 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:49.183534+0000 mon.a (mon.0) 679 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:17:50.100 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:49.263089+0000 mon.a (mon.0) 680 : audit [DBG] from='client.? 172.21.15.18:0/776618787' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "default.rgw.meta", "var": "pg_num"}]: dispatch 2024-02-10T08:17:50.101 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:48.453653+0000 mgr.y (mgr.14505) 33 : cluster [DBG] pgmap v27: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:17:50.101 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:49.085425+0000 mon.a (mon.0) 675 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:17:50.101 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:49.173446+0000 mon.a (mon.0) 676 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:17:50.101 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:49.177014+0000 mon.a (mon.0) 677 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:17:50.101 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:49.179373+0000 mon.a (mon.0) 678 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-10T08:17:50.101 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:49.183534+0000 mon.a (mon.0) 679 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:17:50.101 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:49.263089+0000 mon.a (mon.0) 680 : audit [DBG] from='client.? 172.21.15.18:0/776618787' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "default.rgw.meta", "var": "pg_num"}]: dispatch 2024-02-10T08:17:50.125 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-02-10T08:17:50.125 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-02-10T08:17:50.125 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph mgr dump --format=json 2024-02-10T08:17:50.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:49 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:48.453653+0000 mgr.y (mgr.14505) 33 : cluster [DBG] pgmap v27: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:17:50.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:49 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:49.085425+0000 mon.a (mon.0) 675 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:17:50.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:49 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:49.173446+0000 mon.a (mon.0) 676 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:17:50.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:49 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:49.177014+0000 mon.a (mon.0) 677 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:17:50.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:49 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:49.179373+0000 mon.a (mon.0) 678 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-10T08:17:50.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:49 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:49.183534+0000 mon.a (mon.0) 679 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:17:50.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:49 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:49.263089+0000 mon.a (mon.0) 680 : audit [DBG] from='client.? 172.21.15.18:0/776618787' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "default.rgw.meta", "var": "pg_num"}]: dispatch 2024-02-10T08:17:50.409 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:17:50.968 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:49.179751+0000 mgr.y (mgr.14505) 34 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-10T08:17:50.969 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cephadm 2024-02-10T08:17:49.192693+0000 mgr.y (mgr.14505) 35 : cephadm [INF] Deploying daemon grafana.a on smithi071 2024-02-10T08:17:50.969 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:49.179751+0000 mgr.y (mgr.14505) 34 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-10T08:17:50.969 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cephadm 2024-02-10T08:17:49.192693+0000 mgr.y (mgr.14505) 35 : cephadm [INF] Deploying daemon grafana.a on smithi071 2024-02-10T08:17:51.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:49.179751+0000 mgr.y (mgr.14505) 34 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-10T08:17:51.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cephadm 2024-02-10T08:17:49.192693+0000 mgr.y (mgr.14505) 35 : cephadm [INF] Deploying daemon grafana.a on smithi071 2024-02-10T08:17:52.124 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:50.253814+0000 osd.7 (osd.7) 5 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:17:52.124 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:50.253868+0000 osd.7 (osd.7) 6 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:17:52.125 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:50.454160+0000 mgr.y (mgr.14505) 36 : cluster [DBG] pgmap v28: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-10T08:17:52.125 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:50.814351+0000 mon.a (mon.0) 681 : cluster [DBG] osdmap e73: 8 total, 8 up, 8 in 2024-02-10T08:17:52.125 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:51.623969+0000 mon.a (mon.0) 682 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:17:52.125 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:50.253814+0000 osd.7 (osd.7) 5 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:17:52.125 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:50.253868+0000 osd.7 (osd.7) 6 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:17:52.125 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:50.454160+0000 mgr.y (mgr.14505) 36 : cluster [DBG] pgmap v28: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-10T08:17:52.125 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:50.814351+0000 mon.a (mon.0) 681 : cluster [DBG] osdmap e73: 8 total, 8 up, 8 in 2024-02-10T08:17:52.125 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:51.623969+0000 mon.a (mon.0) 682 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:17:52.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:51 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:50.253814+0000 osd.7 (osd.7) 5 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:17:52.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:51 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:50.253868+0000 osd.7 (osd.7) 6 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:17:52.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:51 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:50.454160+0000 mgr.y (mgr.14505) 36 : cluster [DBG] pgmap v28: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-10T08:17:52.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:51 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:50.814351+0000 mon.a (mon.0) 681 : cluster [DBG] osdmap e73: 8 total, 8 up, 8 in 2024-02-10T08:17:52.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:51 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:51.623969+0000 mon.a (mon.0) 682 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:17:52.605 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:17:52.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:52.599447+0000 mon.a (mon.0) 683 : audit [DBG] from='client.? 172.21.15.18:0/612301347' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-02-10T08:17:52.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:52.599447+0000 mon.a (mon.0) 683 : audit [DBG] from='client.? 172.21.15.18:0/612301347' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-02-10T08:17:53.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:52 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:52.599447+0000 mon.a (mon.0) 683 : audit [DBG] from='client.? 172.21.15.18:0/612301347' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-02-10T08:17:53.335 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":20,"active_gid":14505,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":870554997}]},"active_addr":"172.21.15.18:6800/870554997","active_change":"2024-02-10T08:17:16.434130+0000","active_mgr_features":4540138314316775423,"available":true,"standbys":[{"gid":24448,"name":"x","mgr_features":4540138314316775423,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.18:8443/","prometheus":"http://172.21.15.18:9283/"},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":64,"active_clients":[{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.18:0","nonce":1649392185}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.18:0","nonce":2999968160}]}]} 2024-02-10T08:17:53.339 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-02-10T08:17:53.339 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-02-10T08:17:53.339 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd dump --format=json 2024-02-10T08:17:53.617 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:17:54.127 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:52.454824+0000 mgr.y (mgr.14505) 37 : cluster [DBG] pgmap v30: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-02-10T08:17:54.127 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:52.454824+0000 mgr.y (mgr.14505) 37 : cluster [DBG] pgmap v30: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-02-10T08:17:54.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:53 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:52.454824+0000 mgr.y (mgr.14505) 37 : cluster [DBG] pgmap v30: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-02-10T08:17:55.149 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:53.925352+0000 osd.3 (osd.3) 7 : cluster [DBG] 2.1e scrub starts 2024-02-10T08:17:55.149 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:53.926116+0000 osd.3 (osd.3) 8 : cluster [DBG] 2.1e scrub ok 2024-02-10T08:17:55.149 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:53.925352+0000 osd.3 (osd.3) 7 : cluster [DBG] 2.1e scrub starts 2024-02-10T08:17:55.149 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:53.926116+0000 osd.3 (osd.3) 8 : cluster [DBG] 2.1e scrub ok 2024-02-10T08:17:55.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:54 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:53.925352+0000 osd.3 (osd.3) 7 : cluster [DBG] 2.1e scrub starts 2024-02-10T08:17:55.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:54 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:53.926116+0000 osd.3 (osd.3) 8 : cluster [DBG] 2.1e scrub ok 2024-02-10T08:17:55.586 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:17:55.586 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":74,"fsid":"d46257c8-c7eb-11ee-95b8-87774f69a715","created":"2024-02-10T08:10:57.425061+0000","modified":"2024-02-10T08:17:55.303839+0000","last_up_change":"2024-02-10T08:16:44.491982+0000","last_in_change":"2024-02-10T08:16:27.586635+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-02-10T08:14:44.034966+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":".rgw.root","create_time":"2024-02-10T08:16:51.334631+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":3,"pool_name":"iscsi","create_time":"2024-02-10T08:16:51.762963+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":3,"pg_placement_num":3,"pg_placement_num_target":3,"pg_num_target":3,"pg_num_pending":3,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":4,"pool_name":"default.rgw.log","create_time":"2024-02-10T08:16:53.258098+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":5,"pool_name":"default.rgw.control","create_time":"2024-02-10T08:16:55.289300+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":6,"pool_name":"default.rgw.meta","create_time":"2024-02-10T08:16:57.354868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}}}],"osds":[{"osd":0,"uuid":"f9043fee-a3ed-4e16-921d-bb86756d0c48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6801","nonce":276034406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":276034406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":276034406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6803","nonce":276034406}]},"public_addr":"172.21.15.18:6801/276034406","cluster_addr":"172.21.15.18:6802/276034406","heartbeat_back_addr":"172.21.15.18:6804/276034406","heartbeat_front_addr":"172.21.15.18:6803/276034406","state":["exists","up"]},{"osd":1,"uuid":"ff958272-ce6b-4162-959a-6da9729e537b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6805","nonce":1941014296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1941014296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1941014296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6807","nonce":1941014296}]},"public_addr":"172.21.15.18:6805/1941014296","cluster_addr":"172.21.15.18:6806/1941014296","heartbeat_back_addr":"172.21.15.18:6808/1941014296","heartbeat_front_addr":"172.21.15.18:6807/1941014296","state":["exists","up"]},{"osd":2,"uuid":"29bb47e2-5c81-4ae8-bb9f-d1b02ea01d3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6809","nonce":3122474567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":3122474567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":3122474567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6811","nonce":3122474567}]},"public_addr":"172.21.15.18:6809/3122474567","cluster_addr":"172.21.15.18:6810/3122474567","heartbeat_back_addr":"172.21.15.18:6812/3122474567","heartbeat_front_addr":"172.21.15.18:6811/3122474567","state":["exists","up"]},{"osd":3,"uuid":"87ad37de-5f49-4e5b-9683-3bb9c3e33907","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6813","nonce":3484706437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":3484706437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3484706437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6815","nonce":3484706437}]},"public_addr":"172.21.15.18:6813/3484706437","cluster_addr":"172.21.15.18:6814/3484706437","heartbeat_back_addr":"172.21.15.18:6816/3484706437","heartbeat_front_addr":"172.21.15.18:6815/3484706437","state":["exists","up"]},{"osd":4,"uuid":"f5708f20-f98d-4d12-b8ae-71a5049a14cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":1598114798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6801","nonce":1598114798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6803","nonce":1598114798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":1598114798}]},"public_addr":"172.21.15.71:6800/1598114798","cluster_addr":"172.21.15.71:6801/1598114798","heartbeat_back_addr":"172.21.15.71:6803/1598114798","heartbeat_front_addr":"172.21.15.71:6802/1598114798","state":["exists","up"]},{"osd":5,"uuid":"e36a71dd-5088-4bff-965e-7dc8708ef7e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":1932648316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6805","nonce":1932648316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6807","nonce":1932648316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":1932648316}]},"public_addr":"172.21.15.71:6804/1932648316","cluster_addr":"172.21.15.71:6805/1932648316","heartbeat_back_addr":"172.21.15.71:6807/1932648316","heartbeat_front_addr":"172.21.15.71:6806/1932648316","state":["exists","up"]},{"osd":6,"uuid":"210a8790-78b6-4efa-a969-17efb17e9c0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":3724399458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6809","nonce":3724399458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6811","nonce":3724399458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":3724399458}]},"public_addr":"172.21.15.71:6808/3724399458","cluster_addr":"172.21.15.71:6809/3724399458","heartbeat_back_addr":"172.21.15.71:6811/3724399458","heartbeat_front_addr":"172.21.15.71:6810/3724399458","state":["exists","up"]},{"osd":7,"uuid":"9778a0e9-2ff3-4700-bf2a-675edaba630b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":163573852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6813","nonce":163573852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6815","nonce":163573852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":163573852}]},"public_addr":"172.21.15.71:6812/163573852","cluster_addr":"172.21.15.71:6813/163573852","heartbeat_back_addr":"172.21.15.71:6815/163573852","heartbeat_front_addr":"172.21.15.71:6814/163573852","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-10T08:16:36.011280+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-10T08:16:48.779796+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-10T08:17:01.886366+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-10T08:17:43.797265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-10T08:16:50.868246+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-10T08:16:58.286940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-10T08:17:22.309179+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-10T08:17:50.253870+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:6800/542054629":"2024-02-11T08:17:16.433947+0000","172.21.15.18:0/491217791":"2024-02-11T08:17:16.433947+0000","172.21.15.18:0/781076548":"2024-02-11T08:17:16.433947+0000","172.21.15.18:0/957318754":"2024-02-11T08:17:16.433947+0000","172.21.15.18:0/2662732452":"2024-02-11T08:11:55.105124+0000","172.21.15.18:0/1407788916":"2024-02-11T08:11:55.105124+0000","172.21.15.18:6800/3798687064":"2024-02-11T08:11:55.105124+0000","172.21.15.18:6800/3570839557":"2024-02-11T08:11:31.445897+0000","172.21.15.18:0/541168116":"2024-02-11T08:11:31.445897+0000","172.21.15.18:0/806236095":"2024-02-11T08:11:31.445897+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-10T08:17:55.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:54.455183+0000 mgr.y (mgr.14505) 38 : cluster [DBG] pgmap v31: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-02-10T08:17:55.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:55.308262+0000 mon.a (mon.0) 684 : cluster [DBG] osdmap e74: 8 total, 8 up, 8 in 2024-02-10T08:17:55.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:55.584708+0000 mon.a (mon.0) 685 : audit [DBG] from='client.? 172.21.15.18:0/2382865204' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-10T08:17:55.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:54.455183+0000 mgr.y (mgr.14505) 38 : cluster [DBG] pgmap v31: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-02-10T08:17:55.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:55.308262+0000 mon.a (mon.0) 684 : cluster [DBG] osdmap e74: 8 total, 8 up, 8 in 2024-02-10T08:17:55.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:55.584708+0000 mon.a (mon.0) 685 : audit [DBG] from='client.? 172.21.15.18:0/2382865204' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-10T08:17:56.206 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-02-10T08:17:56.206 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd dump --format=json 2024-02-10T08:17:56.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:54.455183+0000 mgr.y (mgr.14505) 38 : cluster [DBG] pgmap v31: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-02-10T08:17:56.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:55.308262+0000 mon.a (mon.0) 684 : cluster [DBG] osdmap e74: 8 total, 8 up, 8 in 2024-02-10T08:17:56.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:55.584708+0000 mon.a (mon.0) 685 : audit [DBG] from='client.? 172.21.15.18:0/2382865204' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-10T08:17:56.483 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:17:56.789 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:17:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:17:56] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:17:57.404 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:17:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:17:57] "GET /metrics HTTP/1.1" 200 172095 "" "Prometheus/2.33.4" 2024-02-10T08:17:57.789 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:17:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:17:58.128 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:56.455607+0000 mgr.y (mgr.14505) 39 : cluster [DBG] pgmap v33: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-10T08:17:58.128 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:56.771438+0000 osd.7 (osd.7) 7 : cluster [DBG] 2.8 scrub starts 2024-02-10T08:17:58.128 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:56.774317+0000 osd.7 (osd.7) 8 : cluster [DBG] 2.8 scrub ok 2024-02-10T08:17:58.128 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:56.785509+0000 osd.2 (osd.2) 7 : cluster [DBG] 2.c scrub starts 2024-02-10T08:17:58.128 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:56.786320+0000 osd.2 (osd.2) 8 : cluster [DBG] 2.c scrub ok 2024-02-10T08:17:58.128 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:56.982077+0000 osd.1 (osd.1) 9 : cluster [DBG] 4.4 scrub starts 2024-02-10T08:17:58.128 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:56.985852+0000 osd.1 (osd.1) 10 : cluster [DBG] 4.4 scrub ok 2024-02-10T08:17:58.128 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:57.017683+0000 osd.3 (osd.3) 9 : cluster [DBG] 4.14 scrub starts 2024-02-10T08:17:58.129 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:57.019258+0000 osd.3 (osd.3) 10 : cluster [DBG] 4.14 scrub ok 2024-02-10T08:17:58.129 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:57.191706+0000 osd.6 (osd.6) 5 : cluster [DBG] 2.1a scrub starts 2024-02-10T08:17:58.129 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:57.192572+0000 osd.6 (osd.6) 6 : cluster [DBG] 2.1a scrub ok 2024-02-10T08:17:58.129 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:57.631945+0000 osd.0 (osd.0) 7 : cluster [DBG] 4.1e deep-scrub starts 2024-02-10T08:17:58.129 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:57.637341+0000 osd.0 (osd.0) 8 : cluster [DBG] 4.1e deep-scrub ok 2024-02-10T08:17:58.129 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:56.455607+0000 mgr.y (mgr.14505) 39 : cluster [DBG] pgmap v33: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-10T08:17:58.129 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:56.771438+0000 osd.7 (osd.7) 7 : cluster [DBG] 2.8 scrub starts 2024-02-10T08:17:58.129 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:56.774317+0000 osd.7 (osd.7) 8 : cluster [DBG] 2.8 scrub ok 2024-02-10T08:17:58.129 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:56.785509+0000 osd.2 (osd.2) 7 : cluster [DBG] 2.c scrub starts 2024-02-10T08:17:58.129 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:56.786320+0000 osd.2 (osd.2) 8 : cluster [DBG] 2.c scrub ok 2024-02-10T08:17:58.129 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:56.982077+0000 osd.1 (osd.1) 9 : cluster [DBG] 4.4 scrub starts 2024-02-10T08:17:58.129 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:56.985852+0000 osd.1 (osd.1) 10 : cluster [DBG] 4.4 scrub ok 2024-02-10T08:17:58.130 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:57.017683+0000 osd.3 (osd.3) 9 : cluster [DBG] 4.14 scrub starts 2024-02-10T08:17:58.130 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:57.019258+0000 osd.3 (osd.3) 10 : cluster [DBG] 4.14 scrub ok 2024-02-10T08:17:58.130 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:57.191706+0000 osd.6 (osd.6) 5 : cluster [DBG] 2.1a scrub starts 2024-02-10T08:17:58.130 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:57.192572+0000 osd.6 (osd.6) 6 : cluster [DBG] 2.1a scrub ok 2024-02-10T08:17:58.130 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:57.631945+0000 osd.0 (osd.0) 7 : cluster [DBG] 4.1e deep-scrub starts 2024-02-10T08:17:58.130 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:57.637341+0000 osd.0 (osd.0) 8 : cluster [DBG] 4.1e deep-scrub ok 2024-02-10T08:17:58.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:56.455607+0000 mgr.y (mgr.14505) 39 : cluster [DBG] pgmap v33: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-10T08:17:58.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:56.771438+0000 osd.7 (osd.7) 7 : cluster [DBG] 2.8 scrub starts 2024-02-10T08:17:58.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:56.774317+0000 osd.7 (osd.7) 8 : cluster [DBG] 2.8 scrub ok 2024-02-10T08:17:58.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:56.785509+0000 osd.2 (osd.2) 7 : cluster [DBG] 2.c scrub starts 2024-02-10T08:17:58.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:56.786320+0000 osd.2 (osd.2) 8 : cluster [DBG] 2.c scrub ok 2024-02-10T08:17:58.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:56.982077+0000 osd.1 (osd.1) 9 : cluster [DBG] 4.4 scrub starts 2024-02-10T08:17:58.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:56.985852+0000 osd.1 (osd.1) 10 : cluster [DBG] 4.4 scrub ok 2024-02-10T08:17:58.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:57.017683+0000 osd.3 (osd.3) 9 : cluster [DBG] 4.14 scrub starts 2024-02-10T08:17:58.269 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:57.019258+0000 osd.3 (osd.3) 10 : cluster [DBG] 4.14 scrub ok 2024-02-10T08:17:58.269 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:57.191706+0000 osd.6 (osd.6) 5 : cluster [DBG] 2.1a scrub starts 2024-02-10T08:17:58.269 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:57.192572+0000 osd.6 (osd.6) 6 : cluster [DBG] 2.1a scrub ok 2024-02-10T08:17:58.269 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:57.631945+0000 osd.0 (osd.0) 7 : cluster [DBG] 4.1e deep-scrub starts 2024-02-10T08:17:58.269 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:57.637341+0000 osd.0 (osd.0) 8 : cluster [DBG] 4.1e deep-scrub ok 2024-02-10T08:17:58.831 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:57.480641+0000 mgr.y (mgr.14505) 40 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:17:58.832 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:58.223175+0000 osd.6 (osd.6) 7 : cluster [DBG] 2.14 scrub starts 2024-02-10T08:17:58.832 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:58.226106+0000 osd.6 (osd.6) 8 : cluster [DBG] 2.14 scrub ok 2024-02-10T08:17:58.832 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:58.588986+0000 osd.0 (osd.0) 9 : cluster [DBG] 2.13 scrub starts 2024-02-10T08:17:58.832 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:58.589936+0000 osd.0 (osd.0) 10 : cluster [DBG] 2.13 scrub ok 2024-02-10T08:17:58.907 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:17:58.907 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":74,"fsid":"d46257c8-c7eb-11ee-95b8-87774f69a715","created":"2024-02-10T08:10:57.425061+0000","modified":"2024-02-10T08:17:55.303839+0000","last_up_change":"2024-02-10T08:16:44.491982+0000","last_in_change":"2024-02-10T08:16:27.586635+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-02-10T08:14:44.034966+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":".rgw.root","create_time":"2024-02-10T08:16:51.334631+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":3,"pool_name":"iscsi","create_time":"2024-02-10T08:16:51.762963+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":3,"pg_placement_num":3,"pg_placement_num_target":3,"pg_num_target":3,"pg_num_pending":3,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":4,"pool_name":"default.rgw.log","create_time":"2024-02-10T08:16:53.258098+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":5,"pool_name":"default.rgw.control","create_time":"2024-02-10T08:16:55.289300+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":6,"pool_name":"default.rgw.meta","create_time":"2024-02-10T08:16:57.354868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}}}],"osds":[{"osd":0,"uuid":"f9043fee-a3ed-4e16-921d-bb86756d0c48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6801","nonce":276034406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":276034406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":276034406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6803","nonce":276034406}]},"public_addr":"172.21.15.18:6801/276034406","cluster_addr":"172.21.15.18:6802/276034406","heartbeat_back_addr":"172.21.15.18:6804/276034406","heartbeat_front_addr":"172.21.15.18:6803/276034406","state":["exists","up"]},{"osd":1,"uuid":"ff958272-ce6b-4162-959a-6da9729e537b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6805","nonce":1941014296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1941014296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1941014296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6807","nonce":1941014296}]},"public_addr":"172.21.15.18:6805/1941014296","cluster_addr":"172.21.15.18:6806/1941014296","heartbeat_back_addr":"172.21.15.18:6808/1941014296","heartbeat_front_addr":"172.21.15.18:6807/1941014296","state":["exists","up"]},{"osd":2,"uuid":"29bb47e2-5c81-4ae8-bb9f-d1b02ea01d3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6809","nonce":3122474567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":3122474567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":3122474567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6811","nonce":3122474567}]},"public_addr":"172.21.15.18:6809/3122474567","cluster_addr":"172.21.15.18:6810/3122474567","heartbeat_back_addr":"172.21.15.18:6812/3122474567","heartbeat_front_addr":"172.21.15.18:6811/3122474567","state":["exists","up"]},{"osd":3,"uuid":"87ad37de-5f49-4e5b-9683-3bb9c3e33907","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6813","nonce":3484706437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":3484706437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3484706437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6815","nonce":3484706437}]},"public_addr":"172.21.15.18:6813/3484706437","cluster_addr":"172.21.15.18:6814/3484706437","heartbeat_back_addr":"172.21.15.18:6816/3484706437","heartbeat_front_addr":"172.21.15.18:6815/3484706437","state":["exists","up"]},{"osd":4,"uuid":"f5708f20-f98d-4d12-b8ae-71a5049a14cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":1598114798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6801","nonce":1598114798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6803","nonce":1598114798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":1598114798}]},"public_addr":"172.21.15.71:6800/1598114798","cluster_addr":"172.21.15.71:6801/1598114798","heartbeat_back_addr":"172.21.15.71:6803/1598114798","heartbeat_front_addr":"172.21.15.71:6802/1598114798","state":["exists","up"]},{"osd":5,"uuid":"e36a71dd-5088-4bff-965e-7dc8708ef7e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":1932648316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6805","nonce":1932648316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6807","nonce":1932648316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":1932648316}]},"public_addr":"172.21.15.71:6804/1932648316","cluster_addr":"172.21.15.71:6805/1932648316","heartbeat_back_addr":"172.21.15.71:6807/1932648316","heartbeat_front_addr":"172.21.15.71:6806/1932648316","state":["exists","up"]},{"osd":6,"uuid":"210a8790-78b6-4efa-a969-17efb17e9c0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":3724399458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6809","nonce":3724399458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6811","nonce":3724399458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":3724399458}]},"public_addr":"172.21.15.71:6808/3724399458","cluster_addr":"172.21.15.71:6809/3724399458","heartbeat_back_addr":"172.21.15.71:6811/3724399458","heartbeat_front_addr":"172.21.15.71:6810/3724399458","state":["exists","up"]},{"osd":7,"uuid":"9778a0e9-2ff3-4700-bf2a-675edaba630b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":163573852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6813","nonce":163573852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6815","nonce":163573852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":163573852}]},"public_addr":"172.21.15.71:6812/163573852","cluster_addr":"172.21.15.71:6813/163573852","heartbeat_back_addr":"172.21.15.71:6815/163573852","heartbeat_front_addr":"172.21.15.71:6814/163573852","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-10T08:16:36.011280+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-10T08:16:48.779796+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-10T08:17:01.886366+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-10T08:17:43.797265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-10T08:16:50.868246+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-10T08:16:58.286940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-10T08:17:22.309179+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-10T08:17:50.253870+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:6800/542054629":"2024-02-11T08:17:16.433947+0000","172.21.15.18:0/491217791":"2024-02-11T08:17:16.433947+0000","172.21.15.18:0/781076548":"2024-02-11T08:17:16.433947+0000","172.21.15.18:0/957318754":"2024-02-11T08:17:16.433947+0000","172.21.15.18:0/2662732452":"2024-02-11T08:11:55.105124+0000","172.21.15.18:0/1407788916":"2024-02-11T08:11:55.105124+0000","172.21.15.18:6800/3798687064":"2024-02-11T08:11:55.105124+0000","172.21.15.18:6800/3570839557":"2024-02-11T08:11:31.445897+0000","172.21.15.18:0/541168116":"2024-02-11T08:11:31.445897+0000","172.21.15.18:0/806236095":"2024-02-11T08:11:31.445897+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-10T08:17:59.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:57.480641+0000 mgr.y (mgr.14505) 40 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:17:59.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:58.223175+0000 osd.6 (osd.6) 7 : cluster [DBG] 2.14 scrub starts 2024-02-10T08:17:59.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:58.226106+0000 osd.6 (osd.6) 8 : cluster [DBG] 2.14 scrub ok 2024-02-10T08:17:59.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:58.588986+0000 osd.0 (osd.0) 9 : cluster [DBG] 2.13 scrub starts 2024-02-10T08:17:59.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:58.589936+0000 osd.0 (osd.0) 10 : cluster [DBG] 2.13 scrub ok 2024-02-10T08:17:59.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:57.480641+0000 mgr.y (mgr.14505) 40 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:17:59.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:58.223175+0000 osd.6 (osd.6) 7 : cluster [DBG] 2.14 scrub starts 2024-02-10T08:17:59.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:58.226106+0000 osd.6 (osd.6) 8 : cluster [DBG] 2.14 scrub ok 2024-02-10T08:17:59.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:58.588986+0000 osd.0 (osd.0) 9 : cluster [DBG] 2.13 scrub starts 2024-02-10T08:17:59.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:58.589936+0000 osd.0 (osd.0) 10 : cluster [DBG] 2.13 scrub ok 2024-02-10T08:17:59.651 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph tell osd.0 flush_pg_stats 2024-02-10T08:17:59.854 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:59 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:58.456220+0000 mgr.y (mgr.14505) 41 : cluster [DBG] pgmap v34: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:17:59.855 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:17:59 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:17:58.906387+0000 mon.a (mon.0) 686 : audit [DBG] from='client.? 172.21.15.18:0/2930867174' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-10T08:17:59.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:58.456220+0000 mgr.y (mgr.14505) 41 : cluster [DBG] pgmap v34: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:17:59.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:17:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:17:58.906387+0000 mon.a (mon.0) 686 : audit [DBG] from='client.? 172.21.15.18:0/2930867174' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-10T08:17:59.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:58.456220+0000 mgr.y (mgr.14505) 41 : cluster [DBG] pgmap v34: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:17:59.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:17:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:17:58.906387+0000 mon.a (mon.0) 686 : audit [DBG] from='client.? 172.21.15.18:0/2930867174' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-10T08:17:59.954 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:18:00.857 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:59.771855+0000 osd.7 (osd.7) 9 : cluster [DBG] 5.1a scrub starts 2024-02-10T08:18:00.857 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:59.772761+0000 osd.7 (osd.7) 10 : cluster [DBG] 5.1a scrub ok 2024-02-10T08:18:00.857 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:59.809275+0000 osd.2 (osd.2) 9 : cluster [DBG] 5.8 scrub starts 2024-02-10T08:18:00.857 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:59.810247+0000 osd.2 (osd.2) 10 : cluster [DBG] 5.8 scrub ok 2024-02-10T08:18:00.858 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:59.855025+0000 osd.4 (osd.4) 5 : cluster [DBG] 6.e scrub starts 2024-02-10T08:18:00.858 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:59.857973+0000 osd.4 (osd.4) 6 : cluster [DBG] 6.e scrub ok 2024-02-10T08:18:00.858 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:59.952533+0000 osd.3 (osd.3) 11 : cluster [DBG] 6.11 scrub starts 2024-02-10T08:18:00.858 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:17:59.955463+0000 osd.3 (osd.3) 12 : cluster [DBG] 6.11 scrub ok 2024-02-10T08:18:00.858 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:00 smithi071 systemd[1]: Starting Ceph grafana.a for d46257c8-c7eb-11ee-95b8-87774f69a715... 2024-02-10T08:18:01.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:59.771855+0000 osd.7 (osd.7) 9 : cluster [DBG] 5.1a scrub starts 2024-02-10T08:18:01.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:59.772761+0000 osd.7 (osd.7) 10 : cluster [DBG] 5.1a scrub ok 2024-02-10T08:18:01.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:59.809275+0000 osd.2 (osd.2) 9 : cluster [DBG] 5.8 scrub starts 2024-02-10T08:18:01.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:59.810247+0000 osd.2 (osd.2) 10 : cluster [DBG] 5.8 scrub ok 2024-02-10T08:18:01.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:59.855025+0000 osd.4 (osd.4) 5 : cluster [DBG] 6.e scrub starts 2024-02-10T08:18:01.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:59.857973+0000 osd.4 (osd.4) 6 : cluster [DBG] 6.e scrub ok 2024-02-10T08:18:01.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:59.952533+0000 osd.3 (osd.3) 11 : cluster [DBG] 6.11 scrub starts 2024-02-10T08:18:01.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:17:59.955463+0000 osd.3 (osd.3) 12 : cluster [DBG] 6.11 scrub ok 2024-02-10T08:18:01.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:59.771855+0000 osd.7 (osd.7) 9 : cluster [DBG] 5.1a scrub starts 2024-02-10T08:18:01.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:59.772761+0000 osd.7 (osd.7) 10 : cluster [DBG] 5.1a scrub ok 2024-02-10T08:18:01.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:59.809275+0000 osd.2 (osd.2) 9 : cluster [DBG] 5.8 scrub starts 2024-02-10T08:18:01.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:59.810247+0000 osd.2 (osd.2) 10 : cluster [DBG] 5.8 scrub ok 2024-02-10T08:18:01.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:59.855025+0000 osd.4 (osd.4) 5 : cluster [DBG] 6.e scrub starts 2024-02-10T08:18:01.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:59.857973+0000 osd.4 (osd.4) 6 : cluster [DBG] 6.e scrub ok 2024-02-10T08:18:01.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:59.952533+0000 osd.3 (osd.3) 11 : cluster [DBG] 6.11 scrub starts 2024-02-10T08:18:01.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:17:59.955463+0000 osd.3 (osd.3) 12 : cluster [DBG] 6.11 scrub ok 2024-02-10T08:18:01.430 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="The state of unified alerting is still not defined. The decision will be made during as we run the database migrations" logger=settings 2024-02-10T08:18:01.430 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=warn msg="falling back to legacy setting of 'min_interval_seconds'; please use the configuration option in the `unified_alerting` section if Grafana 8 alerts are enabled." logger=settings 2024-02-10T08:18:01.430 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Config loaded from" logger=settings file=/usr/share/grafana/conf/defaults.ini 2024-02-10T08:18:01.430 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Config loaded from" logger=settings file=/etc/grafana/grafana.ini 2024-02-10T08:18:01.430 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_DATA=/var/lib/grafana" 2024-02-10T08:18:01.430 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_LOGS=/var/log/grafana" 2024-02-10T08:18:01.430 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_PLUGINS=/var/lib/grafana/plugins" 2024-02-10T08:18:01.430 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_PROVISIONING=/etc/grafana/provisioning" 2024-02-10T08:18:01.430 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Path Home" logger=settings path=/usr/share/grafana 2024-02-10T08:18:01.430 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Path Data" logger=settings path=/var/lib/grafana 2024-02-10T08:18:01.430 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Path Logs" logger=settings path=/var/log/grafana 2024-02-10T08:18:01.431 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Path Plugins" logger=settings path=/var/lib/grafana/plugins 2024-02-10T08:18:01.431 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Path Provisioning" logger=settings path=/etc/grafana/provisioning 2024-02-10T08:18:01.431 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="App mode production" logger=settings 2024-02-10T08:18:01.431 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Connecting to DB" logger=sqlstore dbtype=sqlite3 2024-02-10T08:18:01.431 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=warn msg="SQLite database file has broader permissions than it should" logger=sqlstore path=/var/lib/grafana/grafana.db mode=-rw-r--r-- expected=-rw-r----- 2024-02-10T08:18:01.431 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Starting DB migrations" logger=migrator 2024-02-10T08:18:01.431 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create migration_log table" 2024-02-10T08:18:01.431 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create user table" 2024-02-10T08:18:01.431 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user.login" 2024-02-10T08:18:01.431 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user.email" 2024-02-10T08:18:01.431 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_user_login - v1" 2024-02-10T08:18:01.431 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_user_email - v1" 2024-02-10T08:18:01.431 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table user to user_v1 - v1" 2024-02-10T08:18:01.431 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create user table v2" 2024-02-10T08:18:01.432 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_user_login - v2" 2024-02-10T08:18:01.432 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_user_email - v2" 2024-02-10T08:18:01.432 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="copy data_source v1 to v2" 2024-02-10T08:18:01.432 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table user_v1" 2024-02-10T08:18:01.432 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Add column help_flags1 to user table" 2024-02-10T08:18:01.432 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Update user table charset" 2024-02-10T08:18:01.432 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Add last_seen_at column to user" 2024-02-10T08:18:01.432 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Add missing user data" 2024-02-10T08:18:01.432 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Add is_disabled column to user" 2024-02-10T08:18:01.432 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Add index user.login/user.email" 2024-02-10T08:18:01.432 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Add is_service_account column to user" 2024-02-10T08:18:01.432 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create temp user table v1-7" 2024-02-10T08:18:01.680 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_email - v1-7" 2024-02-10T08:18:01.681 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_org_id - v1-7" 2024-02-10T08:18:01.681 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_code - v1-7" 2024-02-10T08:18:01.681 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_status - v1-7" 2024-02-10T08:18:01.681 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Update temp_user table charset" 2024-02-10T08:18:01.681 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_temp_user_email - v1" 2024-02-10T08:18:01.681 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_temp_user_org_id - v1" 2024-02-10T08:18:01.681 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_temp_user_code - v1" 2024-02-10T08:18:01.681 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_temp_user_status - v1" 2024-02-10T08:18:01.681 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table temp_user to temp_user_tmp_qwerty - v1" 2024-02-10T08:18:01.681 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create temp_user v2" 2024-02-10T08:18:01.681 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_email - v2" 2024-02-10T08:18:01.681 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_org_id - v2" 2024-02-10T08:18:01.681 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_code - v2" 2024-02-10T08:18:01.682 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_status - v2" 2024-02-10T08:18:01.682 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="copy temp_user v1 to v2" 2024-02-10T08:18:01.682 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="drop temp_user_tmp_qwerty" 2024-02-10T08:18:01.682 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Set created for temp users that will otherwise prematurely expire" 2024-02-10T08:18:01.682 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create star table" 2024-02-10T08:18:01.682 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index star.user_id_dashboard_id" 2024-02-10T08:18:01.682 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create org table v1" 2024-02-10T08:18:01.682 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_org_name - v1" 2024-02-10T08:18:01.682 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create org_user table v1" 2024-02-10T08:18:01.682 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_org_user_org_id - v1" 2024-02-10T08:18:01.682 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_org_user_org_id_user_id - v1" 2024-02-10T08:18:01.682 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_org_user_user_id - v1" 2024-02-10T08:18:01.682 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Update org table charset" 2024-02-10T08:18:01.682 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Update org_user table charset" 2024-02-10T08:18:01.683 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Migrate all Read Only Viewers to Viewers" 2024-02-10T08:18:01.683 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard table" 2024-02-10T08:18:01.683 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard.account_id" 2024-02-10T08:18:01.683 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_account_id_slug" 2024-02-10T08:18:01.683 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_tag table" 2024-02-10T08:18:01.683 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_tag.dasboard_id_term" 2024-02-10T08:18:01.683 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_dashboard_tag_dashboard_id_term - v1" 2024-02-10T08:18:01.683 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table dashboard to dashboard_v1 - v1" 2024-02-10T08:18:01.683 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard v2" 2024-02-10T08:18:01.683 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_org_id - v2" 2024-02-10T08:18:01.683 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_org_id_slug - v2" 2024-02-10T08:18:01.683 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="copy dashboard v1 to v2" 2024-02-10T08:18:01.683 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="drop table dashboard_v1" 2024-02-10T08:18:01.683 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard.data to mediumtext v1" 2024-02-10T08:18:01.683 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Add column updated_by in dashboard - v2" 2024-02-10T08:18:01.684 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Add column created_by in dashboard - v2" 2024-02-10T08:18:01.684 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Add column gnetId in dashboard" 2024-02-10T08:18:01.684 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for gnetId in dashboard" 2024-02-10T08:18:01.684 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Add column plugin_id in dashboard" 2024-02-10T08:18:01.684 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for plugin_id in dashboard" 2024-02-10T08:18:01.684 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for dashboard_id in dashboard_tag" 2024-02-10T08:18:01.684 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard table charset" 2024-02-10T08:18:01.684 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard_tag table charset" 2024-02-10T08:18:01.684 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Add column folder_id in dashboard" 2024-02-10T08:18:01.684 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Add column isFolder in dashboard" 2024-02-10T08:18:01.684 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Add column has_acl in dashboard" 2024-02-10T08:18:01.685 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Add column uid in dashboard" 2024-02-10T08:18:01.685 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Update uid column values in dashboard" 2024-02-10T08:18:01.685 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index dashboard_org_id_uid" 2024-02-10T08:18:01.685 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Remove unique index org_id_slug" 2024-02-10T08:18:01.685 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard title length" 2024-02-10T08:18:01.685 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index for dashboard_org_id_title_folder_id" 2024-02-10T08:18:01.685 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_provisioning" 2024-02-10T08:18:01.685 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table dashboard_provisioning to dashboard_provisioning_tmp_qwerty - v1" 2024-02-10T08:18:01.685 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_provisioning v2" 2024-02-10T08:18:01.685 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_provisioning_dashboard_id - v2" 2024-02-10T08:18:01.685 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_provisioning_dashboard_id_name - v2" 2024-02-10T08:18:01.685 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="copy dashboard_provisioning v1 to v2" 2024-02-10T08:18:01.686 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="drop dashboard_provisioning_tmp_qwerty" 2024-02-10T08:18:01.686 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 bash[64747]: 7a744ce03e4c63eae3f8143575a9837f42d817f2bb44e5a0333275b08b4aec10 2024-02-10T08:18:01.686 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Add check_sum column" 2024-02-10T08:18:01.686 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 systemd[1]: Started Ceph grafana.a for d46257c8-c7eb-11ee-95b8-87774f69a715. 2024-02-10T08:18:01.686 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for dashboard_title" 2024-02-10T08:18:01.686 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="delete tags for deleted dashboards" 2024-02-10T08:18:01.686 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="delete stars for deleted dashboards" 2024-02-10T08:18:01.686 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for dashboard_is_folder" 2024-02-10T08:18:01.686 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create data_source table" 2024-02-10T08:18:01.686 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add index data_source.account_id" 2024-02-10T08:18:01.686 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index data_source.account_id_name" 2024-02-10T08:18:01.686 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_data_source_account_id - v1" 2024-02-10T08:18:01.686 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_data_source_account_id_name - v1" 2024-02-10T08:18:01.686 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table data_source to data_source_v1 - v1" 2024-02-10T08:18:01.686 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create data_source table v2" 2024-02-10T08:18:01.687 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_data_source_org_id - v2" 2024-02-10T08:18:01.687 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_data_source_org_id_name - v2" 2024-02-10T08:18:01.687 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="copy data_source v1 to v2" 2024-02-10T08:18:01.687 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table data_source_v1 #2" 2024-02-10T08:18:01.687 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Add column with_credentials" 2024-02-10T08:18:01.687 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Add secure json data column" 2024-02-10T08:18:01.687 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Update data_source table charset" 2024-02-10T08:18:01.688 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Update initial version to 1" 2024-02-10T08:18:01.688 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Add read_only data column" 2024-02-10T08:18:01.688 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Migrate logging ds to loki ds" 2024-02-10T08:18:01.688 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Update json_data with nulls" 2024-02-10T08:18:01.688 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Add uid column" 2024-02-10T08:18:01.688 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Update uid value" 2024-02-10T08:18:01.688 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index datasource_org_id_uid" 2024-02-10T08:18:01.688 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index datasource_org_id_is_default" 2024-02-10T08:18:01.688 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create api_key table" 2024-02-10T08:18:01.688 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.account_id" 2024-02-10T08:18:01.688 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.key" 2024-02-10T08:18:01.688 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.account_id_name" 2024-02-10T08:18:01.688 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_api_key_account_id - v1" 2024-02-10T08:18:01.689 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_api_key_key - v1" 2024-02-10T08:18:01.689 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_api_key_account_id_name - v1" 2024-02-10T08:18:01.689 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table api_key to api_key_v1 - v1" 2024-02-10T08:18:01.689 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create api_key table v2" 2024-02-10T08:18:01.689 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_api_key_org_id - v2" 2024-02-10T08:18:01.689 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_api_key_key - v2" 2024-02-10T08:18:01.689 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_api_key_org_id_name - v2" 2024-02-10T08:18:01.689 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="copy api_key v1 to v2" 2024-02-10T08:18:01.689 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table api_key_v1" 2024-02-10T08:18:01.689 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Update api_key table charset" 2024-02-10T08:18:01.689 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Add expires to api_key table" 2024-02-10T08:18:01.689 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Add service account foreign key" 2024-02-10T08:18:01.689 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_snapshot table v4" 2024-02-10T08:18:01.689 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="drop table dashboard_snapshot_v4 #1" 2024-02-10T08:18:01.690 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_snapshot table v5 #2" 2024-02-10T08:18:01.690 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_snapshot_key - v5" 2024-02-10T08:18:01.690 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_snapshot_delete_key - v5" 2024-02-10T08:18:01.690 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_snapshot_user_id - v5" 2024-02-10T08:18:01.690 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard_snapshot to mediumtext v2" 2024-02-10T08:18:01.690 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard_snapshot table charset" 2024-02-10T08:18:01.690 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Add column external_delete_url to dashboard_snapshots table" 2024-02-10T08:18:01.690 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Add encrypted dashboard json column" 2024-02-10T08:18:01.690 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Change dashboard_encrypted column to MEDIUMBLOB" 2024-02-10T08:18:01.690 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create quota table v1" 2024-02-10T08:18:01.690 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_quota_org_id_user_id_target - v1" 2024-02-10T08:18:01.690 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Update quota table charset" 2024-02-10T08:18:01.690 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create plugin_setting table" 2024-02-10T08:18:01.690 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_plugin_setting_org_id_plugin_id - v1" 2024-02-10T08:18:01.691 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Add column plugin_version to plugin_settings" 2024-02-10T08:18:01.691 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Update plugin_setting table charset" 2024-02-10T08:18:01.691 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create session table" 2024-02-10T08:18:01.691 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table playlist table" 2024-02-10T08:18:01.691 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table playlist_item table" 2024-02-10T08:18:01.691 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create playlist table v2" 2024-02-10T08:18:01.691 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create playlist item table v2" 2024-02-10T08:18:01.691 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Update playlist table charset" 2024-02-10T08:18:01.691 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Update playlist_item table charset" 2024-02-10T08:18:01.691 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="drop preferences table v2" 2024-02-10T08:18:01.691 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="drop preferences table v3" 2024-02-10T08:18:01.691 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create preferences table v3" 2024-02-10T08:18:01.691 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Update preferences table charset" 2024-02-10T08:18:01.691 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Add column team_id in preferences" 2024-02-10T08:18:01.691 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Update team_id column values in preferences" 2024-02-10T08:18:01.692 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Add column week_start in preferences" 2024-02-10T08:18:01.692 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create alert table v1" 2024-02-10T08:18:01.692 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert org_id & id " 2024-02-10T08:18:01.692 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert state" 2024-02-10T08:18:01.692 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert dashboard_id" 2024-02-10T08:18:01.692 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Create alert_rule_tag table v1" 2024-02-10T08:18:01.692 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index alert_rule_tag.alert_id_tag_id" 2024-02-10T08:18:01.692 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_alert_rule_tag_alert_id_tag_id - v1" 2024-02-10T08:18:01.692 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table alert_rule_tag to alert_rule_tag_v1 - v1" 2024-02-10T08:18:01.692 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Create alert_rule_tag table v2" 2024-02-10T08:18:01.693 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_alert_rule_tag_alert_id_tag_id - Add unique index alert_rule_tag.alert_id_tag_id V2" 2024-02-10T08:18:01.693 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="copy alert_rule_tag v1 to v2" 2024-02-10T08:18:01.693 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="drop table alert_rule_tag_v1" 2024-02-10T08:18:01.693 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_notification table v1" 2024-02-10T08:18:01.930 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:00.456561+0000 mgr.y (mgr.14505) 42 : cluster [DBG] pgmap v35: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-02-10T08:18:01.930 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:00.738340+0000 osd.7 (osd.7) 11 : cluster [DBG] 2.b scrub starts 2024-02-10T08:18:01.930 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:00.739225+0000 osd.7 (osd.7) 12 : cluster [DBG] 2.b scrub ok 2024-02-10T08:18:01.930 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:00.798484+0000 osd.2 (osd.2) 11 : cluster [DBG] 5.d scrub starts 2024-02-10T08:18:01.930 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:00.799987+0000 osd.2 (osd.2) 12 : cluster [DBG] 5.d scrub ok 2024-02-10T08:18:01.930 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:18:01.580124+0000 mon.a (mon.0) 687 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:18:01.930 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:18:01.581317+0000 mon.a (mon.0) 688 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:18:01.930 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:18:01.630681+0000 mon.a (mon.0) 689 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:18:01.930 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:01.695142+0000 osd.0 (osd.0) 11 : cluster [DBG] 6.0 scrub starts 2024-02-10T08:18:01.932 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Add column is_default" 2024-02-10T08:18:01.932 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Add column frequency" 2024-02-10T08:18:01.932 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Add column send_reminder" 2024-02-10T08:18:01.932 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Add column disable_resolve_message" 2024-02-10T08:18:01.932 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert_notification org_id & name" 2024-02-10T08:18:01.932 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert table charset" 2024-02-10T08:18:01.932 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert_notification table charset" 2024-02-10T08:18:01.932 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create notification_journal table v1" 2024-02-10T08:18:01.933 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add index notification_journal org_id & alert_id & notifier_id" 2024-02-10T08:18:01.933 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="drop alert_notification_journal" 2024-02-10T08:18:01.933 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_notification_state table v1" 2024-02-10T08:18:01.933 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert_notification_state org_id & alert_id & notifier_id" 2024-02-10T08:18:01.933 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Add for to alert table" 2024-02-10T08:18:01.933 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Add column uid in alert_notification" 2024-02-10T08:18:01.933 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Update uid column values in alert_notification" 2024-02-10T08:18:01.933 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index alert_notification_org_id_uid" 2024-02-10T08:18:01.933 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Remove unique index org_id_name" 2024-02-10T08:18:01.933 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Add column secure_settings in alert_notification" 2024-02-10T08:18:01.933 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="alter alert.settings to mediumtext" 2024-02-10T08:18:01.933 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Add non-unique index alert_notification_state_alert_id" 2024-02-10T08:18:01.933 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Add non-unique index alert_rule_tag_alert_id" 2024-02-10T08:18:01.933 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old annotation table v4" 2024-02-10T08:18:01.934 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create annotation table v5" 2024-02-10T08:18:01.934 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 0 v3" 2024-02-10T08:18:01.934 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 1 v3" 2024-02-10T08:18:01.934 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 2 v3" 2024-02-10T08:18:01.934 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 3 v3" 2024-02-10T08:18:01.934 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 4 v3" 2024-02-10T08:18:01.934 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Update annotation table charset" 2024-02-10T08:18:01.934 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Add column region_id to annotation table" 2024-02-10T08:18:01.934 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Drop category_id index" 2024-02-10T08:18:01.934 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Add column tags to annotation table" 2024-02-10T08:18:01.934 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Create annotation_tag table v2" 2024-02-10T08:18:01.934 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index annotation_tag.annotation_id_tag_id" 2024-02-10T08:18:01.934 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_annotation_tag_annotation_id_tag_id - v2" 2024-02-10T08:18:01.934 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table annotation_tag to annotation_tag_v2 - v2" 2024-02-10T08:18:01.934 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Create annotation_tag table v3" 2024-02-10T08:18:01.935 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_annotation_tag_annotation_id_tag_id - Add unique index annotation_tag.annotation_id_tag_id V3" 2024-02-10T08:18:01.935 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="copy annotation_tag v2 to v3" 2024-02-10T08:18:01.935 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="drop table annotation_tag_v2" 2024-02-10T08:18:01.935 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert annotations and set TEXT to empty" 2024-02-10T08:18:01.935 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Add created time to annotation table" 2024-02-10T08:18:01.935 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Add updated time to annotation table" 2024-02-10T08:18:01.935 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for created in annotation table" 2024-02-10T08:18:01.935 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for updated in annotation table" 2024-02-10T08:18:01.935 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Convert existing annotations from seconds to milliseconds" 2024-02-10T08:18:01.935 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Add epoch_end column" 2024-02-10T08:18:01.935 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for epoch_end" 2024-02-10T08:18:01.935 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Make epoch_end the same as epoch" 2024-02-10T08:18:01.935 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Move region to single row" 2024-02-10T08:18:01.935 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_epoch from annotation table" 2024-02-10T08:18:01.935 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_dashboard_id_panel_id_epoch from annotation table" 2024-02-10T08:18:01.936 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for org_id_dashboard_id_epoch_end_epoch on annotation table" 2024-02-10T08:18:01.936 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for org_id_epoch_end_epoch on annotation table" 2024-02-10T08:18:01.936 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_epoch_epoch_end from annotation table" 2024-02-10T08:18:01.936 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for alert_id on annotation table" 2024-02-10T08:18:01.936 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create test_data table" 2024-02-10T08:18:01.936 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_version table v1" 2024-02-10T08:18:01.936 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_version.dashboard_id" 2024-02-10T08:18:01.936 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_version.dashboard_id and dashboard_version.version" 2024-02-10T08:18:01.936 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Set dashboard version to 1 where 0" 2024-02-10T08:18:01.936 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="save existing dashboard data in dashboard_version table v1" 2024-02-10T08:18:01.936 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard_version.data to mediumtext v1" 2024-02-10T08:18:01.936 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create team table" 2024-02-10T08:18:01.936 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add index team.org_id" 2024-02-10T08:18:01.936 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index team_org_id_name" 2024-02-10T08:18:01.937 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create team member table" 2024-02-10T08:18:01.937 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add index team_member.org_id" 2024-02-10T08:18:01.937 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index team_member_org_id_team_id_user_id" 2024-02-10T08:18:01.937 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add index team_member.team_id" 2024-02-10T08:18:01.937 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Add column email to team table" 2024-02-10T08:18:01.937 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Add column external to team_member table" 2024-02-10T08:18:01.937 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Add column permission to team_member table" 2024-02-10T08:18:01.937 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard acl table" 2024-02-10T08:18:01.937 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_acl_dashboard_id" 2024-02-10T08:18:01.937 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_acl_dashboard_id_user_id" 2024-02-10T08:18:01.937 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_acl_dashboard_id_team_id" 2024-02-10T08:18:01.937 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_acl_user_id" 2024-02-10T08:18:01.937 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_acl_team_id" 2024-02-10T08:18:01.937 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_acl_org_id_role" 2024-02-10T08:18:01.937 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_permission" 2024-02-10T08:18:01.938 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="save default acl rules in dashboard_acl table" 2024-02-10T08:18:01.938 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="delete acl rules for deleted dashboards and folders" 2024-02-10T08:18:01.938 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create tag table" 2024-02-10T08:18:01.938 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add index tag.key_value" 2024-02-10T08:18:01.938 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create login attempt table" 2024-02-10T08:18:01.938 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add index login_attempt.username" 2024-02-10T08:18:01.938 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_login_attempt_username - v1" 2024-02-10T08:18:01.938 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table login_attempt to login_attempt_tmp_qwerty - v1" 2024-02-10T08:18:01.938 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create login_attempt v2" 2024-02-10T08:18:01.938 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_login_attempt_username - v2" 2024-02-10T08:18:01.938 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="copy login_attempt v1 to v2" 2024-02-10T08:18:01.938 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="drop login_attempt_tmp_qwerty" 2024-02-10T08:18:01.938 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create user auth table" 2024-02-10T08:18:01.938 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_user_auth_auth_module_auth_id - v1" 2024-02-10T08:18:01.938 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="alter user_auth.auth_id to length 190" 2024-02-10T08:18:01.939 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth access token to user_auth" 2024-02-10T08:18:01.939 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth refresh token to user_auth" 2024-02-10T08:18:01.939 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth token type to user_auth" 2024-02-10T08:18:01.939 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth expiry to user_auth" 2024-02-10T08:18:01.939 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Add index to user_id column in user_auth" 2024-02-10T08:18:01.939 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create server_lock table" 2024-02-10T08:18:01.939 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add index server_lock.operation_uid" 2024-02-10T08:18:01.939 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create user auth token table" 2024-02-10T08:18:01.939 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user_auth_token.auth_token" 2024-02-10T08:18:01.939 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user_auth_token.prev_auth_token" 2024-02-10T08:18:01.939 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add index user_auth_token.user_id" 2024-02-10T08:18:01.939 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Add revoked_at to the user auth token" 2024-02-10T08:18:01.939 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create cache_data table" 2024-02-10T08:18:01.939 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index cache_data.cache_key" 2024-02-10T08:18:01.939 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create short_url table v1" 2024-02-10T08:18:01.940 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add index short_url.org_id-uid" 2024-02-10T08:18:01.940 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="delete alert_definition table" 2024-02-10T08:18:01.940 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="recreate alert_definition table" 2024-02-10T08:18:01.940 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_definition on org_id and title columns" 2024-02-10T08:18:01.940 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_definition on org_id and uid columns" 2024-02-10T08:18:01.940 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="alter alert_definition table data column to mediumtext in mysql" 2024-02-10T08:18:01.940 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="drop index in alert_definition on org_id and title columns" 2024-02-10T08:18:01.940 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="drop index in alert_definition on org_id and uid columns" 2024-02-10T08:18:01.940 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index in alert_definition on org_id and title columns" 2024-02-10T08:18:01.940 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index in alert_definition on org_id and uid columns" 2024-02-10T08:18:01.940 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Add column paused in alert_definition" 2024-02-10T08:18:01.940 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="drop alert_definition table" 2024-02-10T08:18:01.940 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="delete alert_definition_version table" 2024-02-10T08:18:01.940 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="recreate alert_definition_version table" 2024-02-10T08:18:01.941 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_definition_version table on alert_definition_id and version columns" 2024-02-10T08:18:01.941 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_definition_version table on alert_definition_uid and version columns" 2024-02-10T08:18:01.941 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="alter alert_definition_version table data column to mediumtext in mysql" 2024-02-10T08:18:01.941 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="drop alert_definition_version table" 2024-02-10T08:18:01.941 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_instance table" 2024-02-10T08:18:01.941 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_instance table on def_org_id, def_uid and current_state columns" 2024-02-10T08:18:01.941 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_instance table on def_org_id, current_state columns" 2024-02-10T08:18:01.941 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add column current_state_end to alert_instance" 2024-02-10T08:18:01.941 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="remove index def_org_id, def_uid, current_state on alert_instance" 2024-02-10T08:18:01.941 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="remove index def_org_id, current_state on alert_instance" 2024-02-10T08:18:01.941 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="rename def_org_id to rule_org_id in alert_instance" 2024-02-10T08:18:01.941 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="rename def_uid to rule_uid in alert_instance" 2024-02-10T08:18:01.941 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add index rule_org_id, rule_uid, current_state on alert_instance" 2024-02-10T08:18:01.941 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add index rule_org_id, current_state on alert_instance" 2024-02-10T08:18:01.941 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_rule table" 2024-02-10T08:18:01.942 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_rule on org_id and title columns" 2024-02-10T08:18:01.942 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_rule on org_id and uid columns" 2024-02-10T08:18:01.942 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_rule on org_id, namespace_uid, group_uid columns" 2024-02-10T08:18:01.942 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="alter alert_rule table data column to mediumtext in mysql" 2024-02-10T08:18:01.942 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add column for to alert_rule" 2024-02-10T08:18:01.942 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add column annotations to alert_rule" 2024-02-10T08:18:01.942 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add column labels to alert_rule" 2024-02-10T08:18:01.942 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="remove unique index from alert_rule on org_id, title columns" 2024-02-10T08:18:01.942 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_rule on org_id, namespase_uid and title columns" 2024-02-10T08:18:01.942 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add dashboard_uid column to alert_rule" 2024-02-10T08:18:01.942 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add panel_id column to alert_rule" 2024-02-10T08:18:01.942 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_rule on org_id, dashboard_uid and panel_id columns" 2024-02-10T08:18:01.942 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_rule_version table" 2024-02-10T08:18:01.942 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_rule_version table on rule_org_id, rule_uid and version columns" 2024-02-10T08:18:01.942 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_rule_version table on rule_org_id, rule_namespace_uid and rule_group columns" 2024-02-10T08:18:01.943 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="alter alert_rule_version table data column to mediumtext in mysql" 2024-02-10T08:18:01.943 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add column for to alert_rule_version" 2024-02-10T08:18:01.943 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add column annotations to alert_rule_version" 2024-02-10T08:18:01.943 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add column labels to alert_rule_version" 2024-02-10T08:18:01.943 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id=create_alert_configuration_table 2024-02-10T08:18:01.943 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Add column default in alert_configuration" 2024-02-10T08:18:01.943 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="alert alert_configuration alertmanager_configuration column from TEXT to MEDIUMTEXT if mysql" 2024-02-10T08:18:01.943 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add column org_id in alert_configuration" 2024-02-10T08:18:01.943 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_configuration table on org_id column" 2024-02-10T08:18:01.943 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id=create_ngalert_configuration_table 2024-02-10T08:18:01.943 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add index in ngalert_configuration on org_id column" 2024-02-10T08:18:01.943 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="clear migration entry \"remove unified alerting data\"" 2024-02-10T08:18:01.943 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="move dashboard alerts to unified alerting" 2024-02-10T08:18:01.943 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create library_element table v1" 2024-02-10T08:18:01.944 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add index library_element org_id-folder_id-name-kind" 2024-02-10T08:18:01.944 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create library_element_connection table v1" 2024-02-10T08:18:01.944 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add index library_element_connection element_id-kind-connection_id" 2024-02-10T08:18:01.944 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index library_element org_id_uid" 2024-02-10T08:18:01.944 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="clone move dashboard alerts to unified alerting" 2024-02-10T08:18:01.944 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create data_keys table" 2024-02-10T08:18:01.944 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create kv_store table v1" 2024-02-10T08:18:01.944 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add index kv_store.org_id-namespace-key" 2024-02-10T08:18:01.944 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="update dashboard_uid and panel_id from existing annotations" 2024-02-10T08:18:01.944 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create permission table" 2024-02-10T08:18:01.944 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index permission.role_id" 2024-02-10T08:18:01.944 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index role_id_action_scope" 2024-02-10T08:18:01.944 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create role table" 2024-02-10T08:18:01.944 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add column display_name" 2024-02-10T08:18:01.945 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add column group_name" 2024-02-10T08:18:01.945 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add index role.org_id" 2024-02-10T08:18:01.945 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index role_org_id_name" 2024-02-10T08:18:01.945 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add index role_org_id_uid" 2024-02-10T08:18:01.945 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create team role table" 2024-02-10T08:18:01.945 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add index team_role.org_id" 2024-02-10T08:18:01.945 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index team_role_org_id_team_id_role_id" 2024-02-10T08:18:01.945 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add index team_role.team_id" 2024-02-10T08:18:01.945 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create user role table" 2024-02-10T08:18:01.945 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add index user_role.org_id" 2024-02-10T08:18:01.945 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user_role_org_id_user_id_role_id" 2024-02-10T08:18:01.945 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add index user_role.user_id" 2024-02-10T08:18:01.945 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create builtin role table" 2024-02-10T08:18:01.945 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add index builtin_role.role_id" 2024-02-10T08:18:01.945 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add index builtin_role.name" 2024-02-10T08:18:01.946 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Add column org_id to builtin_role table" 2024-02-10T08:18:01.946 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add index builtin_role.org_id" 2024-02-10T08:18:01.946 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index builtin_role_org_id_role_id_role" 2024-02-10T08:18:01.946 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="Remove unique index role_org_id_uid" 2024-02-10T08:18:02.117 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:00.456561+0000 mgr.y (mgr.14505) 42 : cluster [DBG] pgmap v35: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-02-10T08:18:02.117 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:00.738340+0000 osd.7 (osd.7) 11 : cluster [DBG] 2.b scrub starts 2024-02-10T08:18:02.118 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:00.739225+0000 osd.7 (osd.7) 12 : cluster [DBG] 2.b scrub ok 2024-02-10T08:18:02.118 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:00.798484+0000 osd.2 (osd.2) 11 : cluster [DBG] 5.d scrub starts 2024-02-10T08:18:02.118 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:00.799987+0000 osd.2 (osd.2) 12 : cluster [DBG] 5.d scrub ok 2024-02-10T08:18:02.118 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:18:01.580124+0000 mon.a (mon.0) 687 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:18:02.118 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:18:01.581317+0000 mon.a (mon.0) 688 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:18:02.118 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:18:01.630681+0000 mon.a (mon.0) 689 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:18:02.118 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:01.695142+0000 osd.0 (osd.0) 11 : cluster [DBG] 6.0 scrub starts 2024-02-10T08:18:02.118 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:00.456561+0000 mgr.y (mgr.14505) 42 : cluster [DBG] pgmap v35: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-02-10T08:18:02.118 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:00.738340+0000 osd.7 (osd.7) 11 : cluster [DBG] 2.b scrub starts 2024-02-10T08:18:02.118 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:00.739225+0000 osd.7 (osd.7) 12 : cluster [DBG] 2.b scrub ok 2024-02-10T08:18:02.118 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:00.798484+0000 osd.2 (osd.2) 11 : cluster [DBG] 5.d scrub starts 2024-02-10T08:18:02.118 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:00.799987+0000 osd.2 (osd.2) 12 : cluster [DBG] 5.d scrub ok 2024-02-10T08:18:02.119 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:18:01.580124+0000 mon.a (mon.0) 687 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:18:02.119 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:18:01.581317+0000 mon.a (mon.0) 688 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:18:02.119 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:18:01.630681+0000 mon.a (mon.0) 689 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:18:02.119 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:01.695142+0000 osd.0 (osd.0) 11 : cluster [DBG] 6.0 scrub starts 2024-02-10T08:18:02.271 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index role.uid" 2024-02-10T08:18:02.271 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="create seed assignment table" 2024-02-10T08:18:02.271 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index builtin_role_role_name" 2024-02-10T08:18:02.271 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="migrations completed" logger=migrator performed=381 skipped=0 duration=520.552715ms 2024-02-10T08:18:02.272 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Created default organization" logger=sqlstore 2024-02-10T08:18:02.272 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Initialising plugins" logger=plugin.manager 2024-02-10T08:18:02.272 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Plugin registered" logger=plugin.manager pluginId=input 2024-02-10T08:18:02.272 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Plugin registered" logger=plugin.manager pluginId=grafana-piechart-panel 2024-02-10T08:18:02.272 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Plugin registered" logger=plugin.manager pluginId=vonage-status-panel 2024-02-10T08:18:02.272 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:01+0000 lvl=info msg="Live Push Gateway initialization" logger=live.push_http 2024-02-10T08:18:02.272 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:02+0000 lvl=warn msg="[Deprecated] the datasource provisioning config is outdated. please upgrade" logger=provisioning.datasources filename=/etc/grafana/provisioning/datasources/ceph-dashboard.yml 2024-02-10T08:18:02.272 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:02+0000 lvl=info msg="inserting datasource from configuration " logger=provisioning.datasources name=Dashboard1 uid=P43CA22E17D0F9596 2024-02-10T08:18:02.272 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:02+0000 lvl=info msg="warming cache for startup" logger=ngalert 2024-02-10T08:18:02.272 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:02+0000 lvl=info msg="starting MultiOrg Alertmanager" logger=ngalert.multiorg.alertmanager 2024-02-10T08:18:02.272 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:18:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:18:02+0000 lvl=info msg="HTTP Server Listen" logger=http.server address=[::]:3000 protocol=https subUrl= socket= 2024-02-10T08:18:02.588 INFO:teuthology.orchestra.run.smithi018.stdout:34359738418 2024-02-10T08:18:02.588 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph tell osd.1 flush_pg_stats 2024-02-10T08:18:02.839 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:01.698086+0000 osd.0 (osd.0) 12 : cluster [DBG] 6.0 scrub ok 2024-02-10T08:18:02.839 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:01.780862+0000 osd.7 (osd.7) 13 : cluster [DBG] 5.10 scrub starts 2024-02-10T08:18:02.839 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:01.783745+0000 osd.7 (osd.7) 14 : cluster [DBG] 5.10 scrub ok 2024-02-10T08:18:03.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:01.698086+0000 osd.0 (osd.0) 12 : cluster [DBG] 6.0 scrub ok 2024-02-10T08:18:03.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:01.780862+0000 osd.7 (osd.7) 13 : cluster [DBG] 5.10 scrub starts 2024-02-10T08:18:03.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:01.783745+0000 osd.7 (osd.7) 14 : cluster [DBG] 5.10 scrub ok 2024-02-10T08:18:03.230 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:01.698086+0000 osd.0 (osd.0) 12 : cluster [DBG] 6.0 scrub ok 2024-02-10T08:18:03.230 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:01.780862+0000 osd.7 (osd.7) 13 : cluster [DBG] 5.10 scrub starts 2024-02-10T08:18:03.230 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:01.783745+0000 osd.7 (osd.7) 14 : cluster [DBG] 5.10 scrub ok 2024-02-10T08:18:03.417 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:18:03.986 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:02.457340+0000 mgr.y (mgr.14505) 43 : cluster [DBG] pgmap v36: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-10T08:18:03.986 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:02.739155+0000 osd.2 (osd.2) 13 : cluster [DBG] 2.e scrub starts 2024-02-10T08:18:03.986 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:02.740124+0000 osd.2 (osd.2) 14 : cluster [DBG] 2.e scrub ok 2024-02-10T08:18:03.986 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:02.933021+0000 osd.4 (osd.4) 7 : cluster [DBG] 4.d scrub starts 2024-02-10T08:18:03.986 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:02.936551+0000 osd.4 (osd.4) 8 : cluster [DBG] 4.d scrub ok 2024-02-10T08:18:03.986 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:02.945396+0000 osd.3 (osd.3) 13 : cluster [DBG] 4.1d deep-scrub starts 2024-02-10T08:18:03.986 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:02.949291+0000 osd.3 (osd.3) 14 : cluster [DBG] 4.1d deep-scrub ok 2024-02-10T08:18:03.986 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:03.046973+0000 osd.1 (osd.1) 11 : cluster [DBG] 4.12 scrub starts 2024-02-10T08:18:03.987 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:03.050471+0000 osd.1 (osd.1) 12 : cluster [DBG] 4.12 scrub ok 2024-02-10T08:18:03.987 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:03.693614+0000 osd.2 (osd.2) 15 : cluster [DBG] 2.10 scrub starts 2024-02-10T08:18:03.987 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:03.695195+0000 osd.2 (osd.2) 16 : cluster [DBG] 2.10 scrub ok 2024-02-10T08:18:03.987 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:02.457340+0000 mgr.y (mgr.14505) 43 : cluster [DBG] pgmap v36: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-10T08:18:03.987 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:02.739155+0000 osd.2 (osd.2) 13 : cluster [DBG] 2.e scrub starts 2024-02-10T08:18:03.987 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:02.740124+0000 osd.2 (osd.2) 14 : cluster [DBG] 2.e scrub ok 2024-02-10T08:18:03.987 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:02.933021+0000 osd.4 (osd.4) 7 : cluster [DBG] 4.d scrub starts 2024-02-10T08:18:03.987 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:02.936551+0000 osd.4 (osd.4) 8 : cluster [DBG] 4.d scrub ok 2024-02-10T08:18:03.987 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:02.945396+0000 osd.3 (osd.3) 13 : cluster [DBG] 4.1d deep-scrub starts 2024-02-10T08:18:03.987 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:02.949291+0000 osd.3 (osd.3) 14 : cluster [DBG] 4.1d deep-scrub ok 2024-02-10T08:18:03.987 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:03.046973+0000 osd.1 (osd.1) 11 : cluster [DBG] 4.12 scrub starts 2024-02-10T08:18:03.988 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:03.050471+0000 osd.1 (osd.1) 12 : cluster [DBG] 4.12 scrub ok 2024-02-10T08:18:03.988 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:03.693614+0000 osd.2 (osd.2) 15 : cluster [DBG] 2.10 scrub starts 2024-02-10T08:18:03.988 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:03.695195+0000 osd.2 (osd.2) 16 : cluster [DBG] 2.10 scrub ok 2024-02-10T08:18:04.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:02.457340+0000 mgr.y (mgr.14505) 43 : cluster [DBG] pgmap v36: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-10T08:18:04.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:02.739155+0000 osd.2 (osd.2) 13 : cluster [DBG] 2.e scrub starts 2024-02-10T08:18:04.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:02.740124+0000 osd.2 (osd.2) 14 : cluster [DBG] 2.e scrub ok 2024-02-10T08:18:04.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:02.933021+0000 osd.4 (osd.4) 7 : cluster [DBG] 4.d scrub starts 2024-02-10T08:18:04.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:02.936551+0000 osd.4 (osd.4) 8 : cluster [DBG] 4.d scrub ok 2024-02-10T08:18:04.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:02.945396+0000 osd.3 (osd.3) 13 : cluster [DBG] 4.1d deep-scrub starts 2024-02-10T08:18:04.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:02.949291+0000 osd.3 (osd.3) 14 : cluster [DBG] 4.1d deep-scrub ok 2024-02-10T08:18:04.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:03.046973+0000 osd.1 (osd.1) 11 : cluster [DBG] 4.12 scrub starts 2024-02-10T08:18:04.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:03.050471+0000 osd.1 (osd.1) 12 : cluster [DBG] 4.12 scrub ok 2024-02-10T08:18:04.293 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:03.693614+0000 osd.2 (osd.2) 15 : cluster [DBG] 2.10 scrub starts 2024-02-10T08:18:04.293 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:03.695195+0000 osd.2 (osd.2) 16 : cluster [DBG] 2.10 scrub ok 2024-02-10T08:18:04.982 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:03.912849+0000 osd.4 (osd.4) 9 : cluster [DBG] 2.f scrub starts 2024-02-10T08:18:04.983 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:03.916317+0000 osd.4 (osd.4) 10 : cluster [DBG] 2.f scrub ok 2024-02-10T08:18:04.983 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:04.038929+0000 osd.1 (osd.1) 13 : cluster [DBG] 3.0 scrub starts 2024-02-10T08:18:04.983 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:04.042397+0000 osd.1 (osd.1) 14 : cluster [DBG] 3.0 scrub ok 2024-02-10T08:18:04.983 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:03.912849+0000 osd.4 (osd.4) 9 : cluster [DBG] 2.f scrub starts 2024-02-10T08:18:04.983 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:03.916317+0000 osd.4 (osd.4) 10 : cluster [DBG] 2.f scrub ok 2024-02-10T08:18:04.983 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:04.038929+0000 osd.1 (osd.1) 13 : cluster [DBG] 3.0 scrub starts 2024-02-10T08:18:04.984 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:04.042397+0000 osd.1 (osd.1) 14 : cluster [DBG] 3.0 scrub ok 2024-02-10T08:18:05.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:03.912849+0000 osd.4 (osd.4) 9 : cluster [DBG] 2.f scrub starts 2024-02-10T08:18:05.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:03.916317+0000 osd.4 (osd.4) 10 : cluster [DBG] 2.f scrub ok 2024-02-10T08:18:05.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:04.038929+0000 osd.1 (osd.1) 13 : cluster [DBG] 3.0 scrub starts 2024-02-10T08:18:05.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:04.042397+0000 osd.1 (osd.1) 14 : cluster [DBG] 3.0 scrub ok 2024-02-10T08:18:05.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:04.457788+0000 mgr.y (mgr.14505) 44 : cluster [DBG] pgmap v37: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-10T08:18:05.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:04.765240+0000 osd.0 (osd.0) 13 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:18:05.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:04.765315+0000 osd.0 (osd.0) 14 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:18:05.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:04.765898+0000 osd.7 (osd.7) 15 : cluster [DBG] 5.4 deep-scrub starts 2024-02-10T08:18:05.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:04.766773+0000 osd.7 (osd.7) 16 : cluster [DBG] 5.4 deep-scrub ok 2024-02-10T08:18:05.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:04.846149+0000 mon.a (mon.0) 690 : cluster [DBG] osdmap e75: 8 total, 8 up, 8 in 2024-02-10T08:18:05.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:04.881426+0000 osd.4 (osd.4) 11 : cluster [DBG] 6.2 scrub starts 2024-02-10T08:18:05.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:04.882385+0000 osd.4 (osd.4) 12 : cluster [DBG] 6.2 scrub ok 2024-02-10T08:18:05.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:05.310915+0000 mon.a (mon.0) 691 : cluster [DBG] osdmap e76: 8 total, 8 up, 8 in 2024-02-10T08:18:05.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:05.659980+0000 osd.0 (osd.0) 15 : cluster [DBG] 6.16 deep-scrub starts 2024-02-10T08:18:05.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:05.662940+0000 osd.0 (osd.0) 16 : cluster [DBG] 6.16 deep-scrub ok 2024-02-10T08:18:05.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:04.457788+0000 mgr.y (mgr.14505) 44 : cluster [DBG] pgmap v37: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-10T08:18:05.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:04.765240+0000 osd.0 (osd.0) 13 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:18:05.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:04.765315+0000 osd.0 (osd.0) 14 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:18:05.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:04.765898+0000 osd.7 (osd.7) 15 : cluster [DBG] 5.4 deep-scrub starts 2024-02-10T08:18:05.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:04.766773+0000 osd.7 (osd.7) 16 : cluster [DBG] 5.4 deep-scrub ok 2024-02-10T08:18:05.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:04.846149+0000 mon.a (mon.0) 690 : cluster [DBG] osdmap e75: 8 total, 8 up, 8 in 2024-02-10T08:18:05.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:04.881426+0000 osd.4 (osd.4) 11 : cluster [DBG] 6.2 scrub starts 2024-02-10T08:18:05.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:04.882385+0000 osd.4 (osd.4) 12 : cluster [DBG] 6.2 scrub ok 2024-02-10T08:18:05.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:05.310915+0000 mon.a (mon.0) 691 : cluster [DBG] osdmap e76: 8 total, 8 up, 8 in 2024-02-10T08:18:05.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:05.659980+0000 osd.0 (osd.0) 15 : cluster [DBG] 6.16 deep-scrub starts 2024-02-10T08:18:05.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:05.662940+0000 osd.0 (osd.0) 16 : cluster [DBG] 6.16 deep-scrub ok 2024-02-10T08:18:06.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:04.457788+0000 mgr.y (mgr.14505) 44 : cluster [DBG] pgmap v37: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-10T08:18:06.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:04.765240+0000 osd.0 (osd.0) 13 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:18:06.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:04.765315+0000 osd.0 (osd.0) 14 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:18:06.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:04.765898+0000 osd.7 (osd.7) 15 : cluster [DBG] 5.4 deep-scrub starts 2024-02-10T08:18:06.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:04.766773+0000 osd.7 (osd.7) 16 : cluster [DBG] 5.4 deep-scrub ok 2024-02-10T08:18:06.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:04.846149+0000 mon.a (mon.0) 690 : cluster [DBG] osdmap e75: 8 total, 8 up, 8 in 2024-02-10T08:18:06.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:04.881426+0000 osd.4 (osd.4) 11 : cluster [DBG] 6.2 scrub starts 2024-02-10T08:18:06.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:04.882385+0000 osd.4 (osd.4) 12 : cluster [DBG] 6.2 scrub ok 2024-02-10T08:18:06.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:05.310915+0000 mon.a (mon.0) 691 : cluster [DBG] osdmap e76: 8 total, 8 up, 8 in 2024-02-10T08:18:06.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:05.659980+0000 osd.0 (osd.0) 15 : cluster [DBG] 6.16 deep-scrub starts 2024-02-10T08:18:06.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:05.662940+0000 osd.0 (osd.0) 16 : cluster [DBG] 6.16 deep-scrub ok 2024-02-10T08:18:06.789 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:18:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:18:06] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:18:07.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:05.343873+0000 osd.5 (osd.5) 5 : cluster [DBG] 2.16 scrub starts 2024-02-10T08:18:07.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:05.347001+0000 osd.5 (osd.5) 6 : cluster [DBG] 2.16 scrub ok 2024-02-10T08:18:07.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:06.012100+0000 osd.1 (osd.1) 15 : cluster [DBG] 2.d scrub starts 2024-02-10T08:18:07.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:06.014984+0000 osd.1 (osd.1) 16 : cluster [DBG] 2.d scrub ok 2024-02-10T08:18:07.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:18:06.100522+0000 mon.a (mon.0) 692 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:18:07.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:06.458112+0000 mgr.y (mgr.14505) 45 : cluster [DBG] pgmap v40: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-10T08:18:07.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:18:06.937703+0000 mon.a (mon.0) 693 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:18:07.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:18:06.938586+0000 mon.a (mon.0) 694 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:18:07.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:18:06.939323+0000 mon.a (mon.0) 695 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:18:07.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:18:06.943667+0000 mon.a (mon.0) 696 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:18:07.405 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:18:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:18:07] "GET /metrics HTTP/1.1" 200 172091 "" "Prometheus/2.33.4" 2024-02-10T08:18:07.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:05.343873+0000 osd.5 (osd.5) 5 : cluster [DBG] 2.16 scrub starts 2024-02-10T08:18:07.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:05.347001+0000 osd.5 (osd.5) 6 : cluster [DBG] 2.16 scrub ok 2024-02-10T08:18:07.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:06.012100+0000 osd.1 (osd.1) 15 : cluster [DBG] 2.d scrub starts 2024-02-10T08:18:07.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:06.014984+0000 osd.1 (osd.1) 16 : cluster [DBG] 2.d scrub ok 2024-02-10T08:18:07.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:18:06.100522+0000 mon.a (mon.0) 692 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:18:07.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:06.458112+0000 mgr.y (mgr.14505) 45 : cluster [DBG] pgmap v40: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-10T08:18:07.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:18:06.937703+0000 mon.a (mon.0) 693 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:18:07.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:18:06.938586+0000 mon.a (mon.0) 694 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:18:07.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:18:06.939323+0000 mon.a (mon.0) 695 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:18:07.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:18:06.943667+0000 mon.a (mon.0) 696 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:18:07.492 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:05.343873+0000 osd.5 (osd.5) 5 : cluster [DBG] 2.16 scrub starts 2024-02-10T08:18:07.492 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:05.347001+0000 osd.5 (osd.5) 6 : cluster [DBG] 2.16 scrub ok 2024-02-10T08:18:07.493 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:06.012100+0000 osd.1 (osd.1) 15 : cluster [DBG] 2.d scrub starts 2024-02-10T08:18:07.493 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:06.014984+0000 osd.1 (osd.1) 16 : cluster [DBG] 2.d scrub ok 2024-02-10T08:18:07.493 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:18:06.100522+0000 mon.a (mon.0) 692 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:18:07.493 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:06.458112+0000 mgr.y (mgr.14505) 45 : cluster [DBG] pgmap v40: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-10T08:18:07.493 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:18:06.937703+0000 mon.a (mon.0) 693 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:18:07.493 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:18:06.938586+0000 mon.a (mon.0) 694 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:18:07.493 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:18:06.939323+0000 mon.a (mon.0) 695 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:18:07.494 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:18:06.943667+0000 mon.a (mon.0) 696 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:18:07.789 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:18:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:18:07.856 INFO:teuthology.orchestra.run.smithi018.stdout:55834574894 2024-02-10T08:18:07.857 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph tell osd.2 flush_pg_stats 2024-02-10T08:18:08.105 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cephadm 2024-02-10T08:18:06.947959+0000 mgr.y (mgr.14505) 46 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2024-02-10T08:18:08.106 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cephadm 2024-02-10T08:18:06.950793+0000 mgr.y (mgr.14505) 47 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi018 2024-02-10T08:18:08.106 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:07.005322+0000 osd.3 (osd.3) 15 : cluster [DBG] 3.2 scrub starts 2024-02-10T08:18:08.106 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:07.008395+0000 osd.3 (osd.3) 16 : cluster [DBG] 3.2 scrub ok 2024-02-10T08:18:08.106 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:18:07.491552+0000 mgr.y (mgr.14505) 48 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:18:08.106 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:07.738618+0000 osd.7 (osd.7) 17 : cluster [DBG] 6.8 scrub starts 2024-02-10T08:18:08.107 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:07.741637+0000 osd.7 (osd.7) 18 : cluster [DBG] 6.8 scrub ok 2024-02-10T08:18:08.359 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cephadm 2024-02-10T08:18:06.947959+0000 mgr.y (mgr.14505) 46 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2024-02-10T08:18:08.359 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cephadm 2024-02-10T08:18:06.950793+0000 mgr.y (mgr.14505) 47 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi018 2024-02-10T08:18:08.359 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:07.005322+0000 osd.3 (osd.3) 15 : cluster [DBG] 3.2 scrub starts 2024-02-10T08:18:08.359 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:07.008395+0000 osd.3 (osd.3) 16 : cluster [DBG] 3.2 scrub ok 2024-02-10T08:18:08.360 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:18:07.491552+0000 mgr.y (mgr.14505) 48 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:18:08.360 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:07.738618+0000 osd.7 (osd.7) 17 : cluster [DBG] 6.8 scrub starts 2024-02-10T08:18:08.360 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:07.741637+0000 osd.7 (osd.7) 18 : cluster [DBG] 6.8 scrub ok 2024-02-10T08:18:08.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cephadm 2024-02-10T08:18:06.947959+0000 mgr.y (mgr.14505) 46 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2024-02-10T08:18:08.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cephadm 2024-02-10T08:18:06.950793+0000 mgr.y (mgr.14505) 47 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi018 2024-02-10T08:18:08.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:07.005322+0000 osd.3 (osd.3) 15 : cluster [DBG] 3.2 scrub starts 2024-02-10T08:18:08.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:07.008395+0000 osd.3 (osd.3) 16 : cluster [DBG] 3.2 scrub ok 2024-02-10T08:18:08.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:18:07.491552+0000 mgr.y (mgr.14505) 48 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:18:08.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:07.738618+0000 osd.7 (osd.7) 17 : cluster [DBG] 6.8 scrub starts 2024-02-10T08:18:08.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:07.741637+0000 osd.7 (osd.7) 18 : cluster [DBG] 6.8 scrub ok 2024-02-10T08:18:08.954 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:18:09.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:07.903995+0000 osd.4 (osd.4) 13 : cluster [DBG] 4.e deep-scrub starts 2024-02-10T08:18:09.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:07.909767+0000 osd.4 (osd.4) 14 : cluster [DBG] 4.e deep-scrub ok 2024-02-10T08:18:09.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:08.047795+0000 osd.3 (osd.3) 17 : cluster [DBG] 4.19 scrub starts 2024-02-10T08:18:09.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:08.051307+0000 osd.3 (osd.3) 18 : cluster [DBG] 4.19 scrub ok 2024-02-10T08:18:09.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:08.232132+0000 osd.6 (osd.6) 9 : cluster [DBG] 2.11 scrub starts 2024-02-10T08:18:09.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:08.233091+0000 osd.6 (osd.6) 10 : cluster [DBG] 2.11 scrub ok 2024-02-10T08:18:09.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:08.458686+0000 mgr.y (mgr.14505) 49 : cluster [DBG] pgmap v41: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:18:09.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:08.675990+0000 osd.0 (osd.0) 17 : cluster [DBG] 6.9 deep-scrub starts 2024-02-10T08:18:09.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:08.680029+0000 osd.0 (osd.0) 18 : cluster [DBG] 6.9 deep-scrub ok 2024-02-10T08:18:09.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:07.903995+0000 osd.4 (osd.4) 13 : cluster [DBG] 4.e deep-scrub starts 2024-02-10T08:18:09.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:07.909767+0000 osd.4 (osd.4) 14 : cluster [DBG] 4.e deep-scrub ok 2024-02-10T08:18:09.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:08.047795+0000 osd.3 (osd.3) 17 : cluster [DBG] 4.19 scrub starts 2024-02-10T08:18:09.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:08.051307+0000 osd.3 (osd.3) 18 : cluster [DBG] 4.19 scrub ok 2024-02-10T08:18:09.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:08.232132+0000 osd.6 (osd.6) 9 : cluster [DBG] 2.11 scrub starts 2024-02-10T08:18:09.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:08.233091+0000 osd.6 (osd.6) 10 : cluster [DBG] 2.11 scrub ok 2024-02-10T08:18:09.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:08.458686+0000 mgr.y (mgr.14505) 49 : cluster [DBG] pgmap v41: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:18:09.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:08.675990+0000 osd.0 (osd.0) 17 : cluster [DBG] 6.9 deep-scrub starts 2024-02-10T08:18:09.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:08.680029+0000 osd.0 (osd.0) 18 : cluster [DBG] 6.9 deep-scrub ok 2024-02-10T08:18:09.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:07.903995+0000 osd.4 (osd.4) 13 : cluster [DBG] 4.e deep-scrub starts 2024-02-10T08:18:09.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:07.909767+0000 osd.4 (osd.4) 14 : cluster [DBG] 4.e deep-scrub ok 2024-02-10T08:18:09.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:08.047795+0000 osd.3 (osd.3) 17 : cluster [DBG] 4.19 scrub starts 2024-02-10T08:18:09.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:08.051307+0000 osd.3 (osd.3) 18 : cluster [DBG] 4.19 scrub ok 2024-02-10T08:18:09.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:08.232132+0000 osd.6 (osd.6) 9 : cluster [DBG] 2.11 scrub starts 2024-02-10T08:18:09.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:08.233091+0000 osd.6 (osd.6) 10 : cluster [DBG] 2.11 scrub ok 2024-02-10T08:18:09.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:08.458686+0000 mgr.y (mgr.14505) 49 : cluster [DBG] pgmap v41: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:18:09.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:08.675990+0000 osd.0 (osd.0) 17 : cluster [DBG] 6.9 deep-scrub starts 2024-02-10T08:18:09.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:08.680029+0000 osd.0 (osd.0) 18 : cluster [DBG] 6.9 deep-scrub ok 2024-02-10T08:18:10.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:08.319912+0000 osd.5 (osd.5) 7 : cluster [DBG] 6.a scrub starts 2024-02-10T08:18:10.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:08.322825+0000 osd.5 (osd.5) 8 : cluster [DBG] 6.a scrub ok 2024-02-10T08:18:10.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:08.918276+0000 osd.4 (osd.4) 15 : cluster [DBG] 4.c scrub starts 2024-02-10T08:18:10.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:08.920223+0000 osd.4 (osd.4) 16 : cluster [DBG] 4.c scrub ok 2024-02-10T08:18:10.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:09.637751+0000 osd.0 (osd.0) 19 : cluster [DBG] 4.16 scrub starts 2024-02-10T08:18:10.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:09.641373+0000 osd.0 (osd.0) 20 : cluster [DBG] 4.16 scrub ok 2024-02-10T08:18:10.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:08.319912+0000 osd.5 (osd.5) 7 : cluster [DBG] 6.a scrub starts 2024-02-10T08:18:10.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:08.322825+0000 osd.5 (osd.5) 8 : cluster [DBG] 6.a scrub ok 2024-02-10T08:18:10.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:08.918276+0000 osd.4 (osd.4) 15 : cluster [DBG] 4.c scrub starts 2024-02-10T08:18:10.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:08.920223+0000 osd.4 (osd.4) 16 : cluster [DBG] 4.c scrub ok 2024-02-10T08:18:10.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:09.637751+0000 osd.0 (osd.0) 19 : cluster [DBG] 4.16 scrub starts 2024-02-10T08:18:10.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:09.641373+0000 osd.0 (osd.0) 20 : cluster [DBG] 4.16 scrub ok 2024-02-10T08:18:10.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:08.319912+0000 osd.5 (osd.5) 7 : cluster [DBG] 6.a scrub starts 2024-02-10T08:18:10.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:08.322825+0000 osd.5 (osd.5) 8 : cluster [DBG] 6.a scrub ok 2024-02-10T08:18:10.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:08.918276+0000 osd.4 (osd.4) 15 : cluster [DBG] 4.c scrub starts 2024-02-10T08:18:10.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:08.920223+0000 osd.4 (osd.4) 16 : cluster [DBG] 4.c scrub ok 2024-02-10T08:18:10.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:09.637751+0000 osd.0 (osd.0) 19 : cluster [DBG] 4.16 scrub starts 2024-02-10T08:18:10.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:09.641373+0000 osd.0 (osd.0) 20 : cluster [DBG] 4.16 scrub ok 2024-02-10T08:18:11.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:09.321779+0000 osd.5 (osd.5) 9 : cluster [DBG] 5.1b scrub starts 2024-02-10T08:18:11.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:09.324852+0000 osd.5 (osd.5) 10 : cluster [DBG] 5.1b scrub ok 2024-02-10T08:18:11.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:09.940683+0000 osd.4 (osd.4) 17 : cluster [DBG] 5.18 scrub starts 2024-02-10T08:18:11.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:09.941891+0000 osd.4 (osd.4) 18 : cluster [DBG] 5.18 scrub ok 2024-02-10T08:18:11.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:10.459132+0000 mgr.y (mgr.14505) 50 : cluster [DBG] pgmap v42: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-10T08:18:11.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:09.321779+0000 osd.5 (osd.5) 9 : cluster [DBG] 5.1b scrub starts 2024-02-10T08:18:11.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:09.324852+0000 osd.5 (osd.5) 10 : cluster [DBG] 5.1b scrub ok 2024-02-10T08:18:11.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:09.940683+0000 osd.4 (osd.4) 17 : cluster [DBG] 5.18 scrub starts 2024-02-10T08:18:11.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:09.941891+0000 osd.4 (osd.4) 18 : cluster [DBG] 5.18 scrub ok 2024-02-10T08:18:11.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:10.459132+0000 mgr.y (mgr.14505) 50 : cluster [DBG] pgmap v42: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-10T08:18:11.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:09.321779+0000 osd.5 (osd.5) 9 : cluster [DBG] 5.1b scrub starts 2024-02-10T08:18:11.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:09.324852+0000 osd.5 (osd.5) 10 : cluster [DBG] 5.1b scrub ok 2024-02-10T08:18:11.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:09.940683+0000 osd.4 (osd.4) 17 : cluster [DBG] 5.18 scrub starts 2024-02-10T08:18:11.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:09.941891+0000 osd.4 (osd.4) 18 : cluster [DBG] 5.18 scrub ok 2024-02-10T08:18:11.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:10.459132+0000 mgr.y (mgr.14505) 50 : cluster [DBG] pgmap v42: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-10T08:18:11.904 INFO:journalctl@ceph.alertmanager.a.smithi018.stdout:Feb 10 08:18:11 smithi018 systemd[1]: Stopping Ceph alertmanager.a for d46257c8-c7eb-11ee-95b8-87774f69a715... 2024-02-10T08:18:12.388 INFO:journalctl@ceph.alertmanager.a.smithi018.stdout:Feb 10 08:18:12 smithi018 bash[72134]: Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-alertmanager.a" found: no such container 2024-02-10T08:18:12.389 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:10.245672+0000 osd.5 (osd.5) 11 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:18:12.389 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:10.245726+0000 osd.5 (osd.5) 12 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:18:12.389 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:10.715770+0000 osd.2 (osd.2) 17 : cluster [DBG] 6.14 scrub starts 2024-02-10T08:18:12.389 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:10.716757+0000 osd.2 (osd.2) 18 : cluster [DBG] 6.14 scrub ok 2024-02-10T08:18:12.389 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:10.978468+0000 osd.4 (osd.4) 19 : cluster [DBG] 4.1 scrub starts 2024-02-10T08:18:12.389 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:10.980415+0000 osd.4 (osd.4) 20 : cluster [DBG] 4.1 scrub ok 2024-02-10T08:18:12.389 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:11.109755+0000 osd.1 (osd.1) 17 : cluster [DBG] 2.a scrub starts 2024-02-10T08:18:12.389 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:11.112869+0000 osd.1 (osd.1) 18 : cluster [DBG] 2.a scrub ok 2024-02-10T08:18:12.389 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:11.128242+0000 mon.a (mon.0) 697 : cluster [DBG] osdmap e77: 8 total, 8 up, 8 in 2024-02-10T08:18:12.389 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:11.224564+0000 osd.6 (osd.6) 11 : cluster [DBG] 2.7 scrub starts 2024-02-10T08:18:12.389 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:11.227671+0000 osd.6 (osd.6) 12 : cluster [DBG] 2.7 scrub ok 2024-02-10T08:18:12.389 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:11.679710+0000 osd.2 (osd.2) 19 : cluster [DBG] 2.1 deep-scrub starts 2024-02-10T08:18:12.390 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:11.681162+0000 osd.2 (osd.2) 20 : cluster [DBG] 2.1 deep-scrub ok 2024-02-10T08:18:12.390 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:11.747644+0000 osd.7 (osd.7) 19 : cluster [DBG] 6.5 deep-scrub starts 2024-02-10T08:18:12.390 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:11.750532+0000 osd.7 (osd.7) 20 : cluster [DBG] 6.5 deep-scrub ok 2024-02-10T08:18:12.390 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:11.965315+0000 osd.4 (osd.4) 21 : cluster [DBG] 4.1b scrub starts 2024-02-10T08:18:12.390 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:11.967500+0000 osd.4 (osd.4) 22 : cluster [DBG] 4.1b scrub ok 2024-02-10T08:18:12.390 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:10.245672+0000 osd.5 (osd.5) 11 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:18:12.390 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:10.245726+0000 osd.5 (osd.5) 12 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:18:12.390 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:10.715770+0000 osd.2 (osd.2) 17 : cluster [DBG] 6.14 scrub starts 2024-02-10T08:18:12.390 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:10.716757+0000 osd.2 (osd.2) 18 : cluster [DBG] 6.14 scrub ok 2024-02-10T08:18:12.390 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:10.978468+0000 osd.4 (osd.4) 19 : cluster [DBG] 4.1 scrub starts 2024-02-10T08:18:12.390 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:10.980415+0000 osd.4 (osd.4) 20 : cluster [DBG] 4.1 scrub ok 2024-02-10T08:18:12.391 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:11.109755+0000 osd.1 (osd.1) 17 : cluster [DBG] 2.a scrub starts 2024-02-10T08:18:12.391 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:11.112869+0000 osd.1 (osd.1) 18 : cluster [DBG] 2.a scrub ok 2024-02-10T08:18:12.391 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:11.128242+0000 mon.a (mon.0) 697 : cluster [DBG] osdmap e77: 8 total, 8 up, 8 in 2024-02-10T08:18:12.391 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:11.224564+0000 osd.6 (osd.6) 11 : cluster [DBG] 2.7 scrub starts 2024-02-10T08:18:12.391 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:11.227671+0000 osd.6 (osd.6) 12 : cluster [DBG] 2.7 scrub ok 2024-02-10T08:18:12.391 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:11.679710+0000 osd.2 (osd.2) 19 : cluster [DBG] 2.1 deep-scrub starts 2024-02-10T08:18:12.391 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:11.681162+0000 osd.2 (osd.2) 20 : cluster [DBG] 2.1 deep-scrub ok 2024-02-10T08:18:12.391 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:11.747644+0000 osd.7 (osd.7) 19 : cluster [DBG] 6.5 deep-scrub starts 2024-02-10T08:18:12.391 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:11.750532+0000 osd.7 (osd.7) 20 : cluster [DBG] 6.5 deep-scrub ok 2024-02-10T08:18:12.391 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:11.965315+0000 osd.4 (osd.4) 21 : cluster [DBG] 4.1b scrub starts 2024-02-10T08:18:12.391 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:11.967500+0000 osd.4 (osd.4) 22 : cluster [DBG] 4.1b scrub ok 2024-02-10T08:18:12.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:10.245672+0000 osd.5 (osd.5) 11 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:18:12.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:10.245726+0000 osd.5 (osd.5) 12 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:18:12.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:10.715770+0000 osd.2 (osd.2) 17 : cluster [DBG] 6.14 scrub starts 2024-02-10T08:18:12.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:10.716757+0000 osd.2 (osd.2) 18 : cluster [DBG] 6.14 scrub ok 2024-02-10T08:18:12.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:10.978468+0000 osd.4 (osd.4) 19 : cluster [DBG] 4.1 scrub starts 2024-02-10T08:18:12.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:10.980415+0000 osd.4 (osd.4) 20 : cluster [DBG] 4.1 scrub ok 2024-02-10T08:18:12.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:11.109755+0000 osd.1 (osd.1) 17 : cluster [DBG] 2.a scrub starts 2024-02-10T08:18:12.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:11.112869+0000 osd.1 (osd.1) 18 : cluster [DBG] 2.a scrub ok 2024-02-10T08:18:12.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:11.128242+0000 mon.a (mon.0) 697 : cluster [DBG] osdmap e77: 8 total, 8 up, 8 in 2024-02-10T08:18:12.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:11.224564+0000 osd.6 (osd.6) 11 : cluster [DBG] 2.7 scrub starts 2024-02-10T08:18:12.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:11.227671+0000 osd.6 (osd.6) 12 : cluster [DBG] 2.7 scrub ok 2024-02-10T08:18:12.542 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:11.679710+0000 osd.2 (osd.2) 19 : cluster [DBG] 2.1 deep-scrub starts 2024-02-10T08:18:12.542 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:11.681162+0000 osd.2 (osd.2) 20 : cluster [DBG] 2.1 deep-scrub ok 2024-02-10T08:18:12.542 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:11.747644+0000 osd.7 (osd.7) 19 : cluster [DBG] 6.5 deep-scrub starts 2024-02-10T08:18:12.542 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:11.750532+0000 osd.7 (osd.7) 20 : cluster [DBG] 6.5 deep-scrub ok 2024-02-10T08:18:12.542 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:11.965315+0000 osd.4 (osd.4) 21 : cluster [DBG] 4.1b scrub starts 2024-02-10T08:18:12.543 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:11.967500+0000 osd.4 (osd.4) 22 : cluster [DBG] 4.1b scrub ok 2024-02-10T08:18:13.132 INFO:journalctl@ceph.alertmanager.a.smithi018.stdout:Feb 10 08:18:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-alertmanager-a[68766]: level=info ts=2024-02-10T08:18:12.850Z caller=main.go:557 msg="Received SIGTERM, exiting gracefully..." 2024-02-10T08:18:13.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:12.066322+0000 osd.1 (osd.1) 19 : cluster [DBG] 2.6 scrub starts 2024-02-10T08:18:13.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:12.069314+0000 osd.1 (osd.1) 20 : cluster [DBG] 2.6 scrub ok 2024-02-10T08:18:13.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:12.259778+0000 osd.6 (osd.6) 13 : cluster [DBG] 2.17 scrub starts 2024-02-10T08:18:13.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:12.262702+0000 osd.6 (osd.6) 14 : cluster [DBG] 2.17 scrub ok 2024-02-10T08:18:13.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:12.459660+0000 mgr.y (mgr.14505) 51 : cluster [DBG] pgmap v44: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-02-10T08:18:13.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:12.777084+0000 osd.7 (osd.7) 21 : cluster [DBG] 6.12 scrub starts 2024-02-10T08:18:13.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:12.778015+0000 osd.7 (osd.7) 22 : cluster [DBG] 6.12 scrub ok 2024-02-10T08:18:13.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:12.996287+0000 osd.4 (osd.4) 23 : cluster [DBG] 4.18 scrub starts 2024-02-10T08:18:13.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:12.998158+0000 osd.4 (osd.4) 24 : cluster [DBG] 4.18 scrub ok 2024-02-10T08:18:13.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:12.066322+0000 osd.1 (osd.1) 19 : cluster [DBG] 2.6 scrub starts 2024-02-10T08:18:13.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:12.069314+0000 osd.1 (osd.1) 20 : cluster [DBG] 2.6 scrub ok 2024-02-10T08:18:13.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:12.259778+0000 osd.6 (osd.6) 13 : cluster [DBG] 2.17 scrub starts 2024-02-10T08:18:13.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:12.262702+0000 osd.6 (osd.6) 14 : cluster [DBG] 2.17 scrub ok 2024-02-10T08:18:13.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:12.459660+0000 mgr.y (mgr.14505) 51 : cluster [DBG] pgmap v44: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-02-10T08:18:13.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:12.777084+0000 osd.7 (osd.7) 21 : cluster [DBG] 6.12 scrub starts 2024-02-10T08:18:13.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:12.778015+0000 osd.7 (osd.7) 22 : cluster [DBG] 6.12 scrub ok 2024-02-10T08:18:13.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:12.996287+0000 osd.4 (osd.4) 23 : cluster [DBG] 4.18 scrub starts 2024-02-10T08:18:13.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:12.998158+0000 osd.4 (osd.4) 24 : cluster [DBG] 4.18 scrub ok 2024-02-10T08:18:13.506 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:12.066322+0000 osd.1 (osd.1) 19 : cluster [DBG] 2.6 scrub starts 2024-02-10T08:18:13.506 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:12.069314+0000 osd.1 (osd.1) 20 : cluster [DBG] 2.6 scrub ok 2024-02-10T08:18:13.506 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:12.259778+0000 osd.6 (osd.6) 13 : cluster [DBG] 2.17 scrub starts 2024-02-10T08:18:13.506 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:12.262702+0000 osd.6 (osd.6) 14 : cluster [DBG] 2.17 scrub ok 2024-02-10T08:18:13.506 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:12.459660+0000 mgr.y (mgr.14505) 51 : cluster [DBG] pgmap v44: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-02-10T08:18:13.506 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:12.777084+0000 osd.7 (osd.7) 21 : cluster [DBG] 6.12 scrub starts 2024-02-10T08:18:13.506 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:12.778015+0000 osd.7 (osd.7) 22 : cluster [DBG] 6.12 scrub ok 2024-02-10T08:18:13.506 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:12.996287+0000 osd.4 (osd.4) 23 : cluster [DBG] 4.18 scrub starts 2024-02-10T08:18:13.507 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:12.998158+0000 osd.4 (osd.4) 24 : cluster [DBG] 4.18 scrub ok 2024-02-10T08:18:13.680 INFO:teuthology.orchestra.run.smithi018.stdout:77309411372 2024-02-10T08:18:13.681 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph tell osd.3 flush_pg_stats 2024-02-10T08:18:13.789 INFO:journalctl@ceph.prometheus.a.smithi071.stdout:Feb 10 08:18:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-prometheus-a[64383]: ts=2024-02-10T08:18:13.506Z caller=notifier.go:526 level=error component=notifier alertmanager=http://smithi018.front.sepia.ceph.com:9093/api/v2/alerts count=4 msg="Error sending alert" err="Post \"http://smithi018.front.sepia.ceph.com:9093/api/v2/alerts\": dial tcp 172.21.15.18:9093: connect: connection refused" 2024-02-10T08:18:14.218 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:18:14.404 INFO:journalctl@ceph.alertmanager.a.smithi018.stdout:Feb 10 08:18:14 smithi018 bash[72248]: ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-alertmanager-a 2024-02-10T08:18:14.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:13.054172+0000 osd.1 (osd.1) 21 : cluster [DBG] 6.1 scrub starts 2024-02-10T08:18:14.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:13.057261+0000 osd.1 (osd.1) 22 : cluster [DBG] 6.1 scrub ok 2024-02-10T08:18:14.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:13.101191+0000 osd.1 (osd.1) 23 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:18:14.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:13.101250+0000 osd.1 (osd.1) 24 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:18:14.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:13.134625+0000 mon.a (mon.0) 698 : cluster [DBG] osdmap e78: 8 total, 8 up, 8 in 2024-02-10T08:18:14.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:13.446736+0000 osd.2 (osd.2) 21 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:18:14.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:13.446817+0000 osd.2 (osd.2) 22 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:18:14.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:13.817684+0000 osd.7 (osd.7) 23 : cluster [DBG] 6.1c scrub starts 2024-02-10T08:18:14.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:13.819400+0000 osd.7 (osd.7) 24 : cluster [DBG] 6.1c scrub ok 2024-02-10T08:18:14.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:13.054172+0000 osd.1 (osd.1) 21 : cluster [DBG] 6.1 scrub starts 2024-02-10T08:18:14.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:13.057261+0000 osd.1 (osd.1) 22 : cluster [DBG] 6.1 scrub ok 2024-02-10T08:18:14.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:13.101191+0000 osd.1 (osd.1) 23 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:18:14.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:13.101250+0000 osd.1 (osd.1) 24 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:18:14.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:13.134625+0000 mon.a (mon.0) 698 : cluster [DBG] osdmap e78: 8 total, 8 up, 8 in 2024-02-10T08:18:14.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:13.446736+0000 osd.2 (osd.2) 21 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:18:14.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:13.446817+0000 osd.2 (osd.2) 22 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:18:14.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:13.817684+0000 osd.7 (osd.7) 23 : cluster [DBG] 6.1c scrub starts 2024-02-10T08:18:14.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:13.819400+0000 osd.7 (osd.7) 24 : cluster [DBG] 6.1c scrub ok 2024-02-10T08:18:14.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:13.054172+0000 osd.1 (osd.1) 21 : cluster [DBG] 6.1 scrub starts 2024-02-10T08:18:14.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:13.057261+0000 osd.1 (osd.1) 22 : cluster [DBG] 6.1 scrub ok 2024-02-10T08:18:14.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:13.101191+0000 osd.1 (osd.1) 23 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:18:14.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:13.101250+0000 osd.1 (osd.1) 24 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:18:14.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:13.134625+0000 mon.a (mon.0) 698 : cluster [DBG] osdmap e78: 8 total, 8 up, 8 in 2024-02-10T08:18:14.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:13.446736+0000 osd.2 (osd.2) 21 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:18:14.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:13.446817+0000 osd.2 (osd.2) 22 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:18:14.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:13.817684+0000 osd.7 (osd.7) 23 : cluster [DBG] 6.1c scrub starts 2024-02-10T08:18:14.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:13.819400+0000 osd.7 (osd.7) 24 : cluster [DBG] 6.1c scrub ok 2024-02-10T08:18:15.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:13.738380+0000 osd.2 (osd.2) 23 : cluster [DBG] 4.1c scrub starts 2024-02-10T08:18:15.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:13.740183+0000 osd.2 (osd.2) 24 : cluster [DBG] 4.1c scrub ok 2024-02-10T08:18:15.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:14.055255+0000 osd.3 (osd.3) 19 : cluster [DBG] 2.1b scrub starts 2024-02-10T08:18:15.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:14.058493+0000 osd.3 (osd.3) 20 : cluster [DBG] 2.1b scrub ok 2024-02-10T08:18:15.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:14.139210+0000 mon.a (mon.0) 699 : cluster [DBG] osdmap e79: 8 total, 8 up, 8 in 2024-02-10T08:18:15.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:14.460055+0000 mgr.y (mgr.14505) 52 : cluster [DBG] pgmap v47: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:18:15.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:14.771135+0000 osd.4 (osd.4) 25 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:18:15.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:14.771226+0000 osd.4 (osd.4) 26 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:18:15.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:14.855001+0000 osd.7 (osd.7) 25 : cluster [DBG] 2.0 scrub starts 2024-02-10T08:18:15.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:14.857918+0000 osd.7 (osd.7) 26 : cluster [DBG] 2.0 scrub ok 2024-02-10T08:18:15.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:15.010857+0000 osd.4 (osd.4) 27 : cluster [DBG] 4.1a scrub starts 2024-02-10T08:18:15.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:15.012649+0000 osd.4 (osd.4) 28 : cluster [DBG] 4.1a scrub ok 2024-02-10T08:18:15.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:13.738380+0000 osd.2 (osd.2) 23 : cluster [DBG] 4.1c scrub starts 2024-02-10T08:18:15.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:13.740183+0000 osd.2 (osd.2) 24 : cluster [DBG] 4.1c scrub ok 2024-02-10T08:18:15.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:14.055255+0000 osd.3 (osd.3) 19 : cluster [DBG] 2.1b scrub starts 2024-02-10T08:18:15.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:14.058493+0000 osd.3 (osd.3) 20 : cluster [DBG] 2.1b scrub ok 2024-02-10T08:18:15.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:14.139210+0000 mon.a (mon.0) 699 : cluster [DBG] osdmap e79: 8 total, 8 up, 8 in 2024-02-10T08:18:15.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:14.460055+0000 mgr.y (mgr.14505) 52 : cluster [DBG] pgmap v47: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:18:15.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:14.771135+0000 osd.4 (osd.4) 25 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:18:15.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:14.771226+0000 osd.4 (osd.4) 26 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:18:15.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:14.855001+0000 osd.7 (osd.7) 25 : cluster [DBG] 2.0 scrub starts 2024-02-10T08:18:15.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:14.857918+0000 osd.7 (osd.7) 26 : cluster [DBG] 2.0 scrub ok 2024-02-10T08:18:15.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:15.010857+0000 osd.4 (osd.4) 27 : cluster [DBG] 4.1a scrub starts 2024-02-10T08:18:15.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:15.012649+0000 osd.4 (osd.4) 28 : cluster [DBG] 4.1a scrub ok 2024-02-10T08:18:15.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:13.738380+0000 osd.2 (osd.2) 23 : cluster [DBG] 4.1c scrub starts 2024-02-10T08:18:15.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:13.740183+0000 osd.2 (osd.2) 24 : cluster [DBG] 4.1c scrub ok 2024-02-10T08:18:15.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:14.055255+0000 osd.3 (osd.3) 19 : cluster [DBG] 2.1b scrub starts 2024-02-10T08:18:15.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:14.058493+0000 osd.3 (osd.3) 20 : cluster [DBG] 2.1b scrub ok 2024-02-10T08:18:15.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:14.139210+0000 mon.a (mon.0) 699 : cluster [DBG] osdmap e79: 8 total, 8 up, 8 in 2024-02-10T08:18:15.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:14.460055+0000 mgr.y (mgr.14505) 52 : cluster [DBG] pgmap v47: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:18:15.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:14.771135+0000 osd.4 (osd.4) 25 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:18:15.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:14.771226+0000 osd.4 (osd.4) 26 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:18:15.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:14.855001+0000 osd.7 (osd.7) 25 : cluster [DBG] 2.0 scrub starts 2024-02-10T08:18:15.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:14.857918+0000 osd.7 (osd.7) 26 : cluster [DBG] 2.0 scrub ok 2024-02-10T08:18:15.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:15.010857+0000 osd.4 (osd.4) 27 : cluster [DBG] 4.1a scrub starts 2024-02-10T08:18:15.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:15.012649+0000 osd.4 (osd.4) 28 : cluster [DBG] 4.1a scrub ok 2024-02-10T08:18:16.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:14.703516+0000 osd.0 (osd.0) 21 : cluster [DBG] 4.b scrub starts 2024-02-10T08:18:16.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:14.705217+0000 osd.0 (osd.0) 22 : cluster [DBG] 4.b scrub ok 2024-02-10T08:18:16.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:15.145188+0000 mon.a (mon.0) 700 : cluster [DBG] osdmap e80: 8 total, 8 up, 8 in 2024-02-10T08:18:16.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:15.688584+0000 osd.0 (osd.0) 23 : cluster [DBG] 6.18 scrub starts 2024-02-10T08:18:16.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:15.691548+0000 osd.0 (osd.0) 24 : cluster [DBG] 6.18 scrub ok 2024-02-10T08:18:16.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:15.892896+0000 osd.7 (osd.7) 27 : cluster [DBG] 6.3 scrub starts 2024-02-10T08:18:16.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:15.893854+0000 osd.7 (osd.7) 28 : cluster [DBG] 6.3 scrub ok 2024-02-10T08:18:16.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:15.978891+0000 osd.4 (osd.4) 29 : cluster [DBG] 5.1 scrub starts 2024-02-10T08:18:16.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:15.979969+0000 osd.4 (osd.4) 30 : cluster [DBG] 5.1 scrub ok 2024-02-10T08:18:16.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:14.703516+0000 osd.0 (osd.0) 21 : cluster [DBG] 4.b scrub starts 2024-02-10T08:18:16.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:14.705217+0000 osd.0 (osd.0) 22 : cluster [DBG] 4.b scrub ok 2024-02-10T08:18:16.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:15.145188+0000 mon.a (mon.0) 700 : cluster [DBG] osdmap e80: 8 total, 8 up, 8 in 2024-02-10T08:18:16.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:15.688584+0000 osd.0 (osd.0) 23 : cluster [DBG] 6.18 scrub starts 2024-02-10T08:18:16.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:15.691548+0000 osd.0 (osd.0) 24 : cluster [DBG] 6.18 scrub ok 2024-02-10T08:18:16.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:15.892896+0000 osd.7 (osd.7) 27 : cluster [DBG] 6.3 scrub starts 2024-02-10T08:18:16.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:15.893854+0000 osd.7 (osd.7) 28 : cluster [DBG] 6.3 scrub ok 2024-02-10T08:18:16.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:15.978891+0000 osd.4 (osd.4) 29 : cluster [DBG] 5.1 scrub starts 2024-02-10T08:18:16.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:15.979969+0000 osd.4 (osd.4) 30 : cluster [DBG] 5.1 scrub ok 2024-02-10T08:18:16.156 INFO:journalctl@ceph.alertmanager.a.smithi018.stdout:Feb 10 08:18:15 smithi018 systemd[1]: ceph-d46257c8-c7eb-11ee-95b8-87774f69a715@alertmanager.a.service: Succeeded. 2024-02-10T08:18:16.156 INFO:journalctl@ceph.alertmanager.a.smithi018.stdout:Feb 10 08:18:15 smithi018 systemd[1]: Stopped Ceph alertmanager.a for d46257c8-c7eb-11ee-95b8-87774f69a715. 2024-02-10T08:18:16.156 INFO:journalctl@ceph.alertmanager.a.smithi018.stdout:Feb 10 08:18:15 smithi018 systemd[1]: Starting Ceph alertmanager.a for d46257c8-c7eb-11ee-95b8-87774f69a715... 2024-02-10T08:18:16.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:14.703516+0000 osd.0 (osd.0) 21 : cluster [DBG] 4.b scrub starts 2024-02-10T08:18:16.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:14.705217+0000 osd.0 (osd.0) 22 : cluster [DBG] 4.b scrub ok 2024-02-10T08:18:16.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:15.145188+0000 mon.a (mon.0) 700 : cluster [DBG] osdmap e80: 8 total, 8 up, 8 in 2024-02-10T08:18:16.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:15.688584+0000 osd.0 (osd.0) 23 : cluster [DBG] 6.18 scrub starts 2024-02-10T08:18:16.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:15.691548+0000 osd.0 (osd.0) 24 : cluster [DBG] 6.18 scrub ok 2024-02-10T08:18:16.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:15.892896+0000 osd.7 (osd.7) 27 : cluster [DBG] 6.3 scrub starts 2024-02-10T08:18:16.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:15.893854+0000 osd.7 (osd.7) 28 : cluster [DBG] 6.3 scrub ok 2024-02-10T08:18:16.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:15.978891+0000 osd.4 (osd.4) 29 : cluster [DBG] 5.1 scrub starts 2024-02-10T08:18:16.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:15.979969+0000 osd.4 (osd.4) 30 : cluster [DBG] 5.1 scrub ok 2024-02-10T08:18:16.789 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:18:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:18:16] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:18:17.404 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:18:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:18:17] "GET /metrics HTTP/1.1" 200 172096 "" "Prometheus/2.33.4" 2024-02-10T08:18:17.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:16.288341+0000 osd.6 (osd.6) 15 : cluster [DBG] 4.a scrub starts 2024-02-10T08:18:17.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:16.290607+0000 osd.6 (osd.6) 16 : cluster [DBG] 4.a scrub ok 2024-02-10T08:18:17.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:18:16.454328+0000 mon.a (mon.0) 701 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2024-02-10T08:18:17.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:18:16.454562+0000 mon.a (mon.0) 702 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2024-02-10T08:18:17.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:18:16.454717+0000 mon.a (mon.0) 703 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2024-02-10T08:18:17.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:18:16.454866+0000 mon.a (mon.0) 704 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2024-02-10T08:18:17.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:16.460438+0000 mgr.y (mgr.14505) 53 : cluster [DBG] pgmap v49: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 959 B/s rd, 0 op/s 2024-02-10T08:18:17.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:16.909349+0000 osd.7 (osd.7) 29 : cluster [DBG] 2.5 scrub starts 2024-02-10T08:18:17.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:16.912327+0000 osd.7 (osd.7) 30 : cluster [DBG] 2.5 scrub ok 2024-02-10T08:18:17.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:17.027327+0000 osd.4 (osd.4) 31 : cluster [DBG] 4.13 scrub starts 2024-02-10T08:18:17.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:17.029511+0000 osd.4 (osd.4) 32 : cluster [DBG] 4.13 scrub ok 2024-02-10T08:18:17.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:16.288341+0000 osd.6 (osd.6) 15 : cluster [DBG] 4.a scrub starts 2024-02-10T08:18:17.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:16.290607+0000 osd.6 (osd.6) 16 : cluster [DBG] 4.a scrub ok 2024-02-10T08:18:17.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:18:16.454328+0000 mon.a (mon.0) 701 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2024-02-10T08:18:17.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:18:16.454562+0000 mon.a (mon.0) 702 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2024-02-10T08:18:17.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:18:16.454717+0000 mon.a (mon.0) 703 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2024-02-10T08:18:17.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:18:16.454866+0000 mon.a (mon.0) 704 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2024-02-10T08:18:17.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:16.460438+0000 mgr.y (mgr.14505) 53 : cluster [DBG] pgmap v49: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 959 B/s rd, 0 op/s 2024-02-10T08:18:17.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:16.909349+0000 osd.7 (osd.7) 29 : cluster [DBG] 2.5 scrub starts 2024-02-10T08:18:17.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:16.912327+0000 osd.7 (osd.7) 30 : cluster [DBG] 2.5 scrub ok 2024-02-10T08:18:17.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:17.027327+0000 osd.4 (osd.4) 31 : cluster [DBG] 4.13 scrub starts 2024-02-10T08:18:17.407 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:17.029511+0000 osd.4 (osd.4) 32 : cluster [DBG] 4.13 scrub ok 2024-02-10T08:18:17.503 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:16.288341+0000 osd.6 (osd.6) 15 : cluster [DBG] 4.a scrub starts 2024-02-10T08:18:17.504 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:16.290607+0000 osd.6 (osd.6) 16 : cluster [DBG] 4.a scrub ok 2024-02-10T08:18:17.504 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:18:16.454328+0000 mon.a (mon.0) 701 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2024-02-10T08:18:17.504 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:18:16.454562+0000 mon.a (mon.0) 702 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2024-02-10T08:18:17.504 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:18:16.454717+0000 mon.a (mon.0) 703 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2024-02-10T08:18:17.504 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:18:16.454866+0000 mon.a (mon.0) 704 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2024-02-10T08:18:17.504 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:16.460438+0000 mgr.y (mgr.14505) 53 : cluster [DBG] pgmap v49: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 959 B/s rd, 0 op/s 2024-02-10T08:18:17.504 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:16.909349+0000 osd.7 (osd.7) 29 : cluster [DBG] 2.5 scrub starts 2024-02-10T08:18:17.504 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:16.912327+0000 osd.7 (osd.7) 30 : cluster [DBG] 2.5 scrub ok 2024-02-10T08:18:17.504 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:17.027327+0000 osd.4 (osd.4) 31 : cluster [DBG] 4.13 scrub starts 2024-02-10T08:18:17.504 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:17.029511+0000 osd.4 (osd.4) 32 : cluster [DBG] 4.13 scrub ok 2024-02-10T08:18:17.757 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:18:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: [10/Feb/2024:08:18:17] ENGINE Bus STOPPING 2024-02-10T08:18:17.757 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:18:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: [10/Feb/2024:08:18:17] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-02-10T08:18:17.757 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:18:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: [10/Feb/2024:08:18:17] ENGINE Bus STOPPED 2024-02-10T08:18:17.757 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:18:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: [10/Feb/2024:08:18:17] ENGINE Bus STARTING 2024-02-10T08:18:17.758 INFO:journalctl@ceph.alertmanager.a.smithi018.stdout:Feb 10 08:18:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-alertmanager-a[72620]: level=info ts=2024-02-10T08:18:17.495Z caller=main.go:225 msg="Starting Alertmanager" version="(version=0.23.0, branch=HEAD, revision=61046b17771a57cfd4c4a51be370ab930a4d7d54)" 2024-02-10T08:18:17.758 INFO:journalctl@ceph.alertmanager.a.smithi018.stdout:Feb 10 08:18:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-alertmanager-a[72620]: level=info ts=2024-02-10T08:18:17.495Z caller=main.go:226 build_context="(go=go1.16.7, user=root@e21a959be8d2, date=20210825-10:48:55)" 2024-02-10T08:18:17.758 INFO:journalctl@ceph.alertmanager.a.smithi018.stdout:Feb 10 08:18:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-alertmanager-a[72620]: level=info ts=2024-02-10T08:18:17.496Z caller=cluster.go:184 component=cluster msg="setting advertise address explicitly" addr=172.21.15.18 port=9094 2024-02-10T08:18:17.758 INFO:journalctl@ceph.alertmanager.a.smithi018.stdout:Feb 10 08:18:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-alertmanager-a[72620]: level=info ts=2024-02-10T08:18:17.498Z caller=cluster.go:671 component=cluster msg="Waiting for gossip to settle..." interval=2s 2024-02-10T08:18:17.758 INFO:journalctl@ceph.alertmanager.a.smithi018.stdout:Feb 10 08:18:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-alertmanager-a[72620]: level=info ts=2024-02-10T08:18:17.523Z caller=coordinator.go:113 component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2024-02-10T08:18:17.758 INFO:journalctl@ceph.alertmanager.a.smithi018.stdout:Feb 10 08:18:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-alertmanager-a[72620]: level=info ts=2024-02-10T08:18:17.523Z caller=coordinator.go:126 component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2024-02-10T08:18:17.758 INFO:journalctl@ceph.alertmanager.a.smithi018.stdout:Feb 10 08:18:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-alertmanager-a[72620]: level=info ts=2024-02-10T08:18:17.525Z caller=main.go:518 msg=Listening address=:9093 2024-02-10T08:18:17.758 INFO:journalctl@ceph.alertmanager.a.smithi018.stdout:Feb 10 08:18:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-alertmanager-a[72620]: level=info ts=2024-02-10T08:18:17.525Z caller=tls_config.go:191 msg="TLS is disabled." http2=false 2024-02-10T08:18:17.758 INFO:journalctl@ceph.alertmanager.a.smithi018.stdout:Feb 10 08:18:17 smithi018 bash[72594]: 5eecad1fc3e171a867a423efd03d80876eee150d2002e5eeacafda745bfe099d 2024-02-10T08:18:17.758 INFO:journalctl@ceph.alertmanager.a.smithi018.stdout:Feb 10 08:18:17 smithi018 systemd[1]: Started Ceph alertmanager.a for d46257c8-c7eb-11ee-95b8-87774f69a715. 2024-02-10T08:18:17.789 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:18:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:18:17.966 INFO:teuthology.orchestra.run.smithi018.stdout:107374182439 2024-02-10T08:18:17.967 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph tell osd.4 flush_pg_stats 2024-02-10T08:18:18.149 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:18:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: [10/Feb/2024:08:18:17] ENGINE Serving on http://:::9283 2024-02-10T08:18:18.150 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:18:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: [10/Feb/2024:08:18:17] ENGINE Bus STARTED 2024-02-10T08:18:18.150 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:18:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: [10/Feb/2024:08:18:17] ENGINE Bus STOPPING 2024-02-10T08:18:18.150 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:18:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: [10/Feb/2024:08:18:17] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-02-10T08:18:18.150 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:18:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: [10/Feb/2024:08:18:17] ENGINE Bus STOPPED 2024-02-10T08:18:18.150 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:18:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: [10/Feb/2024:08:18:17] ENGINE Bus STARTING 2024-02-10T08:18:18.150 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:18:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: [10/Feb/2024:08:18:17] ENGINE Serving on http://:::9283 2024-02-10T08:18:18.150 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:18:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: [10/Feb/2024:08:18:17] ENGINE Bus STARTED 2024-02-10T08:18:18.150 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:18:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: [10/Feb/2024:08:18:17] ENGINE Bus STOPPING 2024-02-10T08:18:18.150 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:18:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: [10/Feb/2024:08:18:17] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-02-10T08:18:18.150 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:18:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: [10/Feb/2024:08:18:17] ENGINE Bus STOPPED 2024-02-10T08:18:18.150 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:18:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: [10/Feb/2024:08:18:17] ENGINE Bus STARTING 2024-02-10T08:18:18.150 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:18:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: [10/Feb/2024:08:18:17] ENGINE Serving on http://:::9283 2024-02-10T08:18:18.150 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:18:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: [10/Feb/2024:08:18:17] ENGINE Bus STARTED 2024-02-10T08:18:18.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:18:17.150901+0000 mon.a (mon.0) 705 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]': finished 2024-02-10T08:18:18.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:18:17.150969+0000 mon.a (mon.0) 706 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]': finished 2024-02-10T08:18:18.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:18:17.151044+0000 mon.a (mon.0) 707 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]': finished 2024-02-10T08:18:18.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:18:17.151106+0000 mon.a (mon.0) 708 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]': finished 2024-02-10T08:18:18.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:17.151161+0000 mon.a (mon.0) 709 : cluster [DBG] osdmap e81: 8 total, 8 up, 8 in 2024-02-10T08:18:18.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:17.298872+0000 osd.6 (osd.6) 17 : cluster [DBG] 5.2 scrub starts 2024-02-10T08:18:18.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:17.299807+0000 osd.6 (osd.6) 18 : cluster [DBG] 5.2 scrub ok 2024-02-10T08:18:18.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:18:17.502765+0000 mgr.y (mgr.14505) 54 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:18:18.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:18:17.624192+0000 mon.a (mon.0) 710 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:18:18.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:18:17.627564+0000 mon.a (mon.0) 711 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-10T08:18:18.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:18:17.627949+0000 mgr.y (mgr.14505) 55 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-10T08:18:18.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:18:17.628676+0000 mon.a (mon.0) 712 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi018.front.sepia.ceph.com:9093"}]: dispatch 2024-02-10T08:18:18.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:18:17.628967+0000 mgr.y (mgr.14505) 56 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi018.front.sepia.ceph.com:9093"}]: dispatch 2024-02-10T08:18:18.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:18:17.632865+0000 mon.a (mon.0) 713 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:18:18.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:18:17.637418+0000 mon.a (mon.0) 714 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-10T08:18:18.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:18:17.150901+0000 mon.a (mon.0) 705 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]': finished 2024-02-10T08:18:18.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:18:17.150969+0000 mon.a (mon.0) 706 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]': finished 2024-02-10T08:18:18.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:18:17.151044+0000 mon.a (mon.0) 707 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]': finished 2024-02-10T08:18:18.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:18:17.151106+0000 mon.a (mon.0) 708 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]': finished 2024-02-10T08:18:18.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:17.151161+0000 mon.a (mon.0) 709 : cluster [DBG] osdmap e81: 8 total, 8 up, 8 in 2024-02-10T08:18:18.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:17.298872+0000 osd.6 (osd.6) 17 : cluster [DBG] 5.2 scrub starts 2024-02-10T08:18:18.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:17.299807+0000 osd.6 (osd.6) 18 : cluster [DBG] 5.2 scrub ok 2024-02-10T08:18:18.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:18:17.502765+0000 mgr.y (mgr.14505) 54 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:18:18.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:18:17.624192+0000 mon.a (mon.0) 710 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:18:18.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:18:17.627564+0000 mon.a (mon.0) 711 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-10T08:18:18.407 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:18:17.627949+0000 mgr.y (mgr.14505) 55 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-10T08:18:18.407 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:18:17.628676+0000 mon.a (mon.0) 712 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi018.front.sepia.ceph.com:9093"}]: dispatch 2024-02-10T08:18:18.407 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:18:17.628967+0000 mgr.y (mgr.14505) 56 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi018.front.sepia.ceph.com:9093"}]: dispatch 2024-02-10T08:18:18.407 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:18:17.632865+0000 mon.a (mon.0) 713 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:18:18.407 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:18:17.637418+0000 mon.a (mon.0) 714 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-10T08:18:18.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:18:17.637807+0000 mgr.y (mgr.14505) 57 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-10T08:18:18.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:18:17.641520+0000 mon.a (mon.0) 715 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi071.front.sepia.ceph.com:9095"}]: dispatch 2024-02-10T08:18:18.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:18:17.641847+0000 mgr.y (mgr.14505) 58 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi071.front.sepia.ceph.com:9095"}]: dispatch 2024-02-10T08:18:18.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:18:17.645884+0000 mon.a (mon.0) 716 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:18:18.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:18:17.649925+0000 mon.a (mon.0) 717 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-10T08:18:18.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:18:17.650286+0000 mgr.y (mgr.14505) 59 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-10T08:18:18.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:18:17.653629+0000 mon.a (mon.0) 718 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi071.front.sepia.ceph.com:3000"}]: dispatch 2024-02-10T08:18:18.408 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:18:17.653964+0000 mgr.y (mgr.14505) 60 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi071.front.sepia.ceph.com:3000"}]: dispatch 2024-02-10T08:18:18.408 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:18:17.658361+0000 mon.a (mon.0) 719 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:18:18.408 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:18:17.660149+0000 mon.a (mon.0) 720 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:18:18.408 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:18:17.637807+0000 mgr.y (mgr.14505) 57 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-10T08:18:18.408 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:18:17.641520+0000 mon.a (mon.0) 715 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi071.front.sepia.ceph.com:9095"}]: dispatch 2024-02-10T08:18:18.408 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:18:17.641847+0000 mgr.y (mgr.14505) 58 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi071.front.sepia.ceph.com:9095"}]: dispatch 2024-02-10T08:18:18.408 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:18:17.645884+0000 mon.a (mon.0) 716 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:18:18.408 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:18:17.649925+0000 mon.a (mon.0) 717 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-10T08:18:18.408 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:18:17.650286+0000 mgr.y (mgr.14505) 59 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-10T08:18:18.408 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:18:17.653629+0000 mon.a (mon.0) 718 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi071.front.sepia.ceph.com:3000"}]: dispatch 2024-02-10T08:18:18.408 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:18:17.653964+0000 mgr.y (mgr.14505) 60 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi071.front.sepia.ceph.com:3000"}]: dispatch 2024-02-10T08:18:18.409 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:18:17.658361+0000 mon.a (mon.0) 719 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:18:18.409 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:18:17.660149+0000 mon.a (mon.0) 720 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:18:18.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:18:17.150901+0000 mon.a (mon.0) 705 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]': finished 2024-02-10T08:18:18.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:18:17.150969+0000 mon.a (mon.0) 706 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]': finished 2024-02-10T08:18:18.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:18:17.151044+0000 mon.a (mon.0) 707 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]': finished 2024-02-10T08:18:18.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:18:17.151106+0000 mon.a (mon.0) 708 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]': finished 2024-02-10T08:18:18.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:17.151161+0000 mon.a (mon.0) 709 : cluster [DBG] osdmap e81: 8 total, 8 up, 8 in 2024-02-10T08:18:18.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:17.298872+0000 osd.6 (osd.6) 17 : cluster [DBG] 5.2 scrub starts 2024-02-10T08:18:18.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:17.299807+0000 osd.6 (osd.6) 18 : cluster [DBG] 5.2 scrub ok 2024-02-10T08:18:18.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:18:17.502765+0000 mgr.y (mgr.14505) 54 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:18:18.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:18:17.624192+0000 mon.a (mon.0) 710 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:18:18.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:18:17.627564+0000 mon.a (mon.0) 711 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-10T08:18:18.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:18:17.627949+0000 mgr.y (mgr.14505) 55 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-10T08:18:18.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:18:17.628676+0000 mon.a (mon.0) 712 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi018.front.sepia.ceph.com:9093"}]: dispatch 2024-02-10T08:18:18.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:18:17.628967+0000 mgr.y (mgr.14505) 56 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi018.front.sepia.ceph.com:9093"}]: dispatch 2024-02-10T08:18:18.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:18:17.632865+0000 mon.a (mon.0) 713 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:18:18.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:18:17.637418+0000 mon.a (mon.0) 714 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-10T08:18:18.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:18:17.637807+0000 mgr.y (mgr.14505) 57 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-10T08:18:18.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:18:17.641520+0000 mon.a (mon.0) 715 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi071.front.sepia.ceph.com:9095"}]: dispatch 2024-02-10T08:18:18.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:18:17.641847+0000 mgr.y (mgr.14505) 58 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi071.front.sepia.ceph.com:9095"}]: dispatch 2024-02-10T08:18:18.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:18:17.645884+0000 mon.a (mon.0) 716 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:18:18.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:18:17.649925+0000 mon.a (mon.0) 717 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-10T08:18:18.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:18:17.650286+0000 mgr.y (mgr.14505) 59 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-10T08:18:18.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:18:17.653629+0000 mon.a (mon.0) 718 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi071.front.sepia.ceph.com:3000"}]: dispatch 2024-02-10T08:18:18.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:18:17.653964+0000 mgr.y (mgr.14505) 60 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi071.front.sepia.ceph.com:3000"}]: dispatch 2024-02-10T08:18:18.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:18:17.658361+0000 mon.a (mon.0) 719 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:18:18.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:18:17.660149+0000 mon.a (mon.0) 720 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:18:18.851 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:18:19.365 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:17.708813+0000 osd.2 (osd.2) 25 : cluster [DBG] 6.f scrub starts 2024-02-10T08:18:19.365 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:17.709692+0000 osd.2 (osd.2) 26 : cluster [DBG] 6.f scrub ok 2024-02-10T08:18:19.365 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:18.157283+0000 mon.a (mon.0) 721 : cluster [DBG] osdmap e82: 8 total, 8 up, 8 in 2024-02-10T08:18:19.365 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:18.460804+0000 mgr.y (mgr.14505) 61 : cluster [DBG] pgmap v52: 132 pgs: 4 peering, 128 active+clean; 5.6 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T08:18:19.365 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:19.057515+0000 osd.4 (osd.4) 33 : cluster [DBG] 6.1a scrub starts 2024-02-10T08:18:19.365 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:19.058313+0000 osd.4 (osd.4) 34 : cluster [DBG] 6.1a scrub ok 2024-02-10T08:18:19.366 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:17.708813+0000 osd.2 (osd.2) 25 : cluster [DBG] 6.f scrub starts 2024-02-10T08:18:19.366 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:17.709692+0000 osd.2 (osd.2) 26 : cluster [DBG] 6.f scrub ok 2024-02-10T08:18:19.366 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:18.157283+0000 mon.a (mon.0) 721 : cluster [DBG] osdmap e82: 8 total, 8 up, 8 in 2024-02-10T08:18:19.366 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:18.460804+0000 mgr.y (mgr.14505) 61 : cluster [DBG] pgmap v52: 132 pgs: 4 peering, 128 active+clean; 5.6 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T08:18:19.366 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:19.057515+0000 osd.4 (osd.4) 33 : cluster [DBG] 6.1a scrub starts 2024-02-10T08:18:19.366 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:19.058313+0000 osd.4 (osd.4) 34 : cluster [DBG] 6.1a scrub ok 2024-02-10T08:18:19.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:17.708813+0000 osd.2 (osd.2) 25 : cluster [DBG] 6.f scrub starts 2024-02-10T08:18:19.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:17.709692+0000 osd.2 (osd.2) 26 : cluster [DBG] 6.f scrub ok 2024-02-10T08:18:19.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:18.157283+0000 mon.a (mon.0) 721 : cluster [DBG] osdmap e82: 8 total, 8 up, 8 in 2024-02-10T08:18:19.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:18.460804+0000 mgr.y (mgr.14505) 61 : cluster [DBG] pgmap v52: 132 pgs: 4 peering, 128 active+clean; 5.6 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T08:18:19.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:19.057515+0000 osd.4 (osd.4) 33 : cluster [DBG] 6.1a scrub starts 2024-02-10T08:18:19.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:19.058313+0000 osd.4 (osd.4) 34 : cluster [DBG] 6.1a scrub ok 2024-02-10T08:18:19.654 INFO:journalctl@ceph.alertmanager.a.smithi018.stdout:Feb 10 08:18:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-alertmanager-a[72620]: level=info ts=2024-02-10T08:18:19.498Z caller=cluster.go:696 component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000613742s 2024-02-10T08:18:20.607 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:19.387348+0000 osd.5 (osd.5) 13 : cluster [DBG] 2.3 scrub starts 2024-02-10T08:18:20.607 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:19.390234+0000 osd.5 (osd.5) 14 : cluster [DBG] 2.3 scrub ok 2024-02-10T08:18:20.607 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:19.387348+0000 osd.5 (osd.5) 13 : cluster [DBG] 2.3 scrub starts 2024-02-10T08:18:20.607 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:19.390234+0000 osd.5 (osd.5) 14 : cluster [DBG] 2.3 scrub ok 2024-02-10T08:18:20.772 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:19.387348+0000 osd.5 (osd.5) 13 : cluster [DBG] 2.3 scrub starts 2024-02-10T08:18:20.772 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:19.390234+0000 osd.5 (osd.5) 14 : cluster [DBG] 2.3 scrub ok 2024-02-10T08:18:21.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:19.718138+0000 osd.2 (osd.2) 27 : cluster [DBG] 4.f scrub starts 2024-02-10T08:18:21.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:19.720159+0000 osd.2 (osd.2) 28 : cluster [DBG] 4.f scrub ok 2024-02-10T08:18:21.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:20.461156+0000 mgr.y (mgr.14505) 62 : cluster [DBG] pgmap v53: 132 pgs: 4 peering, 128 active+clean; 5.6 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T08:18:21.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:20.694978+0000 osd.2 (osd.2) 29 : cluster [DBG] 5.b scrub starts 2024-02-10T08:18:21.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:20.695795+0000 osd.2 (osd.2) 30 : cluster [DBG] 5.b scrub ok 2024-02-10T08:18:21.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:21.012252+0000 osd.4 (osd.4) 35 : cluster [DBG] 4.9 deep-scrub starts 2024-02-10T08:18:21.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:21.015863+0000 osd.4 (osd.4) 36 : cluster [DBG] 4.9 deep-scrub ok 2024-02-10T08:18:21.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:21.131767+0000 osd.1 (osd.1) 25 : cluster [DBG] 2.15 scrub starts 2024-02-10T08:18:21.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:21.134822+0000 osd.1 (osd.1) 26 : cluster [DBG] 2.15 scrub ok 2024-02-10T08:18:21.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:19.718138+0000 osd.2 (osd.2) 27 : cluster [DBG] 4.f scrub starts 2024-02-10T08:18:21.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:19.720159+0000 osd.2 (osd.2) 28 : cluster [DBG] 4.f scrub ok 2024-02-10T08:18:21.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:20.461156+0000 mgr.y (mgr.14505) 62 : cluster [DBG] pgmap v53: 132 pgs: 4 peering, 128 active+clean; 5.6 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T08:18:21.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:20.694978+0000 osd.2 (osd.2) 29 : cluster [DBG] 5.b scrub starts 2024-02-10T08:18:21.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:20.695795+0000 osd.2 (osd.2) 30 : cluster [DBG] 5.b scrub ok 2024-02-10T08:18:21.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:21.012252+0000 osd.4 (osd.4) 35 : cluster [DBG] 4.9 deep-scrub starts 2024-02-10T08:18:21.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:21.015863+0000 osd.4 (osd.4) 36 : cluster [DBG] 4.9 deep-scrub ok 2024-02-10T08:18:21.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:21.131767+0000 osd.1 (osd.1) 25 : cluster [DBG] 2.15 scrub starts 2024-02-10T08:18:21.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:21.134822+0000 osd.1 (osd.1) 26 : cluster [DBG] 2.15 scrub ok 2024-02-10T08:18:21.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:19.718138+0000 osd.2 (osd.2) 27 : cluster [DBG] 4.f scrub starts 2024-02-10T08:18:21.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:19.720159+0000 osd.2 (osd.2) 28 : cluster [DBG] 4.f scrub ok 2024-02-10T08:18:21.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:20.461156+0000 mgr.y (mgr.14505) 62 : cluster [DBG] pgmap v53: 132 pgs: 4 peering, 128 active+clean; 5.6 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T08:18:21.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:20.694978+0000 osd.2 (osd.2) 29 : cluster [DBG] 5.b scrub starts 2024-02-10T08:18:21.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:20.695795+0000 osd.2 (osd.2) 30 : cluster [DBG] 5.b scrub ok 2024-02-10T08:18:21.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:21.012252+0000 osd.4 (osd.4) 35 : cluster [DBG] 4.9 deep-scrub starts 2024-02-10T08:18:21.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:21.015863+0000 osd.4 (osd.4) 36 : cluster [DBG] 4.9 deep-scrub ok 2024-02-10T08:18:21.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:21.131767+0000 osd.1 (osd.1) 25 : cluster [DBG] 2.15 scrub starts 2024-02-10T08:18:21.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:21.134822+0000 osd.1 (osd.1) 26 : cluster [DBG] 2.15 scrub ok 2024-02-10T08:18:21.799 INFO:teuthology.orchestra.run.smithi018.stdout:128849018914 2024-02-10T08:18:21.799 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph tell osd.5 flush_pg_stats 2024-02-10T08:18:22.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:20.733334+0000 osd.0 (osd.0) 25 : cluster [DBG] 3.1 deep-scrub starts 2024-02-10T08:18:22.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:20.736220+0000 osd.0 (osd.0) 26 : cluster [DBG] 3.1 deep-scrub ok 2024-02-10T08:18:22.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:18:21.973534+0000 mon.a (mon.0) 722 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:18:22.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:22.000004+0000 osd.4 (osd.4) 37 : cluster [DBG] 5.1c scrub starts 2024-02-10T08:18:22.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:22.000808+0000 osd.4 (osd.4) 38 : cluster [DBG] 5.1c scrub ok 2024-02-10T08:18:22.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:22.073460+0000 osd.3 (osd.3) 21 : cluster [DBG] 5.17 scrub starts 2024-02-10T08:18:22.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:22.074264+0000 osd.3 (osd.3) 22 : cluster [DBG] 5.17 scrub ok 2024-02-10T08:18:22.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:22.102128+0000 osd.1 (osd.1) 27 : cluster [DBG] 6.1d deep-scrub starts 2024-02-10T08:18:22.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:22.104984+0000 osd.1 (osd.1) 28 : cluster [DBG] 6.1d deep-scrub ok 2024-02-10T08:18:22.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:20.733334+0000 osd.0 (osd.0) 25 : cluster [DBG] 3.1 deep-scrub starts 2024-02-10T08:18:22.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:20.736220+0000 osd.0 (osd.0) 26 : cluster [DBG] 3.1 deep-scrub ok 2024-02-10T08:18:22.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:18:21.973534+0000 mon.a (mon.0) 722 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:18:22.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:22.000004+0000 osd.4 (osd.4) 37 : cluster [DBG] 5.1c scrub starts 2024-02-10T08:18:22.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:22.000808+0000 osd.4 (osd.4) 38 : cluster [DBG] 5.1c scrub ok 2024-02-10T08:18:22.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:22.073460+0000 osd.3 (osd.3) 21 : cluster [DBG] 5.17 scrub starts 2024-02-10T08:18:22.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:22.074264+0000 osd.3 (osd.3) 22 : cluster [DBG] 5.17 scrub ok 2024-02-10T08:18:22.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:22.102128+0000 osd.1 (osd.1) 27 : cluster [DBG] 6.1d deep-scrub starts 2024-02-10T08:18:22.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:22.104984+0000 osd.1 (osd.1) 28 : cluster [DBG] 6.1d deep-scrub ok 2024-02-10T08:18:22.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:20.733334+0000 osd.0 (osd.0) 25 : cluster [DBG] 3.1 deep-scrub starts 2024-02-10T08:18:22.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:20.736220+0000 osd.0 (osd.0) 26 : cluster [DBG] 3.1 deep-scrub ok 2024-02-10T08:18:22.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:18:21.973534+0000 mon.a (mon.0) 722 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:18:22.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:22.000004+0000 osd.4 (osd.4) 37 : cluster [DBG] 5.1c scrub starts 2024-02-10T08:18:22.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:22.000808+0000 osd.4 (osd.4) 38 : cluster [DBG] 5.1c scrub ok 2024-02-10T08:18:22.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:22.073460+0000 osd.3 (osd.3) 21 : cluster [DBG] 5.17 scrub starts 2024-02-10T08:18:22.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:22.074264+0000 osd.3 (osd.3) 22 : cluster [DBG] 5.17 scrub ok 2024-02-10T08:18:22.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:22.102128+0000 osd.1 (osd.1) 27 : cluster [DBG] 6.1d deep-scrub starts 2024-02-10T08:18:22.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:22.104984+0000 osd.1 (osd.1) 28 : cluster [DBG] 6.1d deep-scrub ok 2024-02-10T08:18:23.143 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:18:23.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:21.768966+0000 osd.0 (osd.0) 27 : cluster [DBG] 5.1e scrub starts 2024-02-10T08:18:23.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:21.771955+0000 osd.0 (osd.0) 28 : cluster [DBG] 5.1e scrub ok 2024-02-10T08:18:23.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:22.369434+0000 osd.6 (osd.6) 19 : cluster [DBG] 4.1f scrub starts 2024-02-10T08:18:23.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:22.372954+0000 osd.6 (osd.6) 20 : cluster [DBG] 4.1f scrub ok 2024-02-10T08:18:23.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:22.461805+0000 mgr.y (mgr.14505) 63 : cluster [DBG] pgmap v54: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s; 45 B/s, 2 objects/s recovering 2024-02-10T08:18:23.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:22.941696+0000 osd.7 (osd.7) 31 : cluster [DBG] 6.15 scrub starts 2024-02-10T08:18:23.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:22.944588+0000 osd.7 (osd.7) 32 : cluster [DBG] 6.15 scrub ok 2024-02-10T08:18:23.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:22.952664+0000 osd.4 (osd.4) 39 : cluster [DBG] 6.17 scrub starts 2024-02-10T08:18:23.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:22.955805+0000 osd.4 (osd.4) 40 : cluster [DBG] 6.17 scrub ok 2024-02-10T08:18:23.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:23.119803+0000 osd.3 (osd.3) 23 : cluster [DBG] 5.14 scrub starts 2024-02-10T08:18:23.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:23.120904+0000 osd.3 (osd.3) 24 : cluster [DBG] 5.14 scrub ok 2024-02-10T08:18:23.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:18:23.142871+0000 mon.a (mon.0) 723 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:18:23.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:21.768966+0000 osd.0 (osd.0) 27 : cluster [DBG] 5.1e scrub starts 2024-02-10T08:18:23.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:21.771955+0000 osd.0 (osd.0) 28 : cluster [DBG] 5.1e scrub ok 2024-02-10T08:18:23.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:22.369434+0000 osd.6 (osd.6) 19 : cluster [DBG] 4.1f scrub starts 2024-02-10T08:18:23.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:22.372954+0000 osd.6 (osd.6) 20 : cluster [DBG] 4.1f scrub ok 2024-02-10T08:18:23.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:22.461805+0000 mgr.y (mgr.14505) 63 : cluster [DBG] pgmap v54: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s; 45 B/s, 2 objects/s recovering 2024-02-10T08:18:23.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:22.941696+0000 osd.7 (osd.7) 31 : cluster [DBG] 6.15 scrub starts 2024-02-10T08:18:23.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:22.944588+0000 osd.7 (osd.7) 32 : cluster [DBG] 6.15 scrub ok 2024-02-10T08:18:23.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:22.952664+0000 osd.4 (osd.4) 39 : cluster [DBG] 6.17 scrub starts 2024-02-10T08:18:23.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:22.955805+0000 osd.4 (osd.4) 40 : cluster [DBG] 6.17 scrub ok 2024-02-10T08:18:23.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:23.119803+0000 osd.3 (osd.3) 23 : cluster [DBG] 5.14 scrub starts 2024-02-10T08:18:23.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:23.120904+0000 osd.3 (osd.3) 24 : cluster [DBG] 5.14 scrub ok 2024-02-10T08:18:23.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:18:23.142871+0000 mon.a (mon.0) 723 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:18:23.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:21.768966+0000 osd.0 (osd.0) 27 : cluster [DBG] 5.1e scrub starts 2024-02-10T08:18:23.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:21.771955+0000 osd.0 (osd.0) 28 : cluster [DBG] 5.1e scrub ok 2024-02-10T08:18:23.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:22.369434+0000 osd.6 (osd.6) 19 : cluster [DBG] 4.1f scrub starts 2024-02-10T08:18:23.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:22.372954+0000 osd.6 (osd.6) 20 : cluster [DBG] 4.1f scrub ok 2024-02-10T08:18:23.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:22.461805+0000 mgr.y (mgr.14505) 63 : cluster [DBG] pgmap v54: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s; 45 B/s, 2 objects/s recovering 2024-02-10T08:18:23.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:22.941696+0000 osd.7 (osd.7) 31 : cluster [DBG] 6.15 scrub starts 2024-02-10T08:18:23.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:22.944588+0000 osd.7 (osd.7) 32 : cluster [DBG] 6.15 scrub ok 2024-02-10T08:18:23.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:22.952664+0000 osd.4 (osd.4) 39 : cluster [DBG] 6.17 scrub starts 2024-02-10T08:18:23.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:22.955805+0000 osd.4 (osd.4) 40 : cluster [DBG] 6.17 scrub ok 2024-02-10T08:18:23.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:23.119803+0000 osd.3 (osd.3) 23 : cluster [DBG] 5.14 scrub starts 2024-02-10T08:18:23.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:23.120904+0000 osd.3 (osd.3) 24 : cluster [DBG] 5.14 scrub ok 2024-02-10T08:18:23.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:18:23.142871+0000 mon.a (mon.0) 723 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:18:24.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:23.415888+0000 osd.5 (osd.5) 15 : cluster [DBG] 5.15 scrub starts 2024-02-10T08:18:24.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:23.419348+0000 osd.5 (osd.5) 16 : cluster [DBG] 5.15 scrub ok 2024-02-10T08:18:24.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:18:23.461251+0000 mon.a (mon.0) 724 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:18:24.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:18:23.461920+0000 mon.a (mon.0) 725 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:18:24.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:18:23.466055+0000 mon.a (mon.0) 726 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:18:24.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:18:23.470047+0000 mon.a (mon.0) 727 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:18:24.582 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:23.415888+0000 osd.5 (osd.5) 15 : cluster [DBG] 5.15 scrub starts 2024-02-10T08:18:24.582 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:23.419348+0000 osd.5 (osd.5) 16 : cluster [DBG] 5.15 scrub ok 2024-02-10T08:18:24.582 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:18:23.461251+0000 mon.a (mon.0) 724 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:18:24.582 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:18:23.461920+0000 mon.a (mon.0) 725 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:18:24.582 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:18:23.466055+0000 mon.a (mon.0) 726 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:18:24.582 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:18:23.470047+0000 mon.a (mon.0) 727 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:18:24.582 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:23.415888+0000 osd.5 (osd.5) 15 : cluster [DBG] 5.15 scrub starts 2024-02-10T08:18:24.582 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:23.419348+0000 osd.5 (osd.5) 16 : cluster [DBG] 5.15 scrub ok 2024-02-10T08:18:24.583 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:18:23.461251+0000 mon.a (mon.0) 724 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:18:24.583 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:18:23.461920+0000 mon.a (mon.0) 725 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:18:24.583 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:18:23.466055+0000 mon.a (mon.0) 726 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:18:24.583 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:18:23.470047+0000 mon.a (mon.0) 727 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:18:25.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:24.462388+0000 mgr.y (mgr.14505) 64 : cluster [DBG] pgmap v55: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 41 B/s, 2 objects/s recovering 2024-02-10T08:18:25.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:24.979955+0000 osd.7 (osd.7) 33 : cluster [DBG] 1.0 scrub starts 2024-02-10T08:18:25.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:24.982928+0000 osd.7 (osd.7) 34 : cluster [DBG] 1.0 scrub ok 2024-02-10T08:18:25.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:25.166085+0000 osd.3 (osd.3) 25 : cluster [DBG] 4.11 scrub starts 2024-02-10T08:18:25.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:25.169559+0000 osd.3 (osd.3) 26 : cluster [DBG] 4.11 scrub ok 2024-02-10T08:18:25.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:24.462388+0000 mgr.y (mgr.14505) 64 : cluster [DBG] pgmap v55: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 41 B/s, 2 objects/s recovering 2024-02-10T08:18:25.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:24.979955+0000 osd.7 (osd.7) 33 : cluster [DBG] 1.0 scrub starts 2024-02-10T08:18:25.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:24.982928+0000 osd.7 (osd.7) 34 : cluster [DBG] 1.0 scrub ok 2024-02-10T08:18:25.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:25.166085+0000 osd.3 (osd.3) 25 : cluster [DBG] 4.11 scrub starts 2024-02-10T08:18:25.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:25.169559+0000 osd.3 (osd.3) 26 : cluster [DBG] 4.11 scrub ok 2024-02-10T08:18:25.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:24.462388+0000 mgr.y (mgr.14505) 64 : cluster [DBG] pgmap v55: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 41 B/s, 2 objects/s recovering 2024-02-10T08:18:25.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:24.979955+0000 osd.7 (osd.7) 33 : cluster [DBG] 1.0 scrub starts 2024-02-10T08:18:25.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:24.982928+0000 osd.7 (osd.7) 34 : cluster [DBG] 1.0 scrub ok 2024-02-10T08:18:25.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:25.166085+0000 osd.3 (osd.3) 25 : cluster [DBG] 4.11 scrub starts 2024-02-10T08:18:25.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:25.169559+0000 osd.3 (osd.3) 26 : cluster [DBG] 4.11 scrub ok 2024-02-10T08:18:26.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:25.439219+0000 osd.5 (osd.5) 17 : cluster [DBG] 5.f scrub starts 2024-02-10T08:18:26.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:25.442091+0000 osd.5 (osd.5) 18 : cluster [DBG] 5.f scrub ok 2024-02-10T08:18:26.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:26.185577+0000 osd.1 (osd.1) 29 : cluster [DBG] 4.2 scrub starts 2024-02-10T08:18:26.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:26.189122+0000 osd.1 (osd.1) 30 : cluster [DBG] 4.2 scrub ok 2024-02-10T08:18:26.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:25.439219+0000 osd.5 (osd.5) 17 : cluster [DBG] 5.f scrub starts 2024-02-10T08:18:26.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:25.442091+0000 osd.5 (osd.5) 18 : cluster [DBG] 5.f scrub ok 2024-02-10T08:18:26.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:26.185577+0000 osd.1 (osd.1) 29 : cluster [DBG] 4.2 scrub starts 2024-02-10T08:18:26.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:26.189122+0000 osd.1 (osd.1) 30 : cluster [DBG] 4.2 scrub ok 2024-02-10T08:18:26.504 INFO:teuthology.orchestra.run.smithi018.stdout:158913789984 2024-02-10T08:18:26.505 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph tell osd.6 flush_pg_stats 2024-02-10T08:18:26.623 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:18:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:18:26] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:18:26.624 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:25.439219+0000 osd.5 (osd.5) 17 : cluster [DBG] 5.f scrub starts 2024-02-10T08:18:26.624 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:25.442091+0000 osd.5 (osd.5) 18 : cluster [DBG] 5.f scrub ok 2024-02-10T08:18:26.624 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:26.185577+0000 osd.1 (osd.1) 29 : cluster [DBG] 4.2 scrub starts 2024-02-10T08:18:26.624 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:26.189122+0000 osd.1 (osd.1) 30 : cluster [DBG] 4.2 scrub ok 2024-02-10T08:18:26.827 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:18:27.353 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:18:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:18:27] "GET /metrics HTTP/1.1" 200 172096 "" "Prometheus/2.33.4" 2024-02-10T08:18:27.353 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:26.463066+0000 mgr.y (mgr.14505) 65 : cluster [DBG] pgmap v56: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 35 B/s, 2 objects/s recovering 2024-02-10T08:18:27.354 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:26.949610+0000 osd.4 (osd.4) 41 : cluster [DBG] 6.1e scrub starts 2024-02-10T08:18:27.354 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:26.952493+0000 osd.4 (osd.4) 42 : cluster [DBG] 6.1e scrub ok 2024-02-10T08:18:27.654 INFO:journalctl@ceph.alertmanager.a.smithi018.stdout:Feb 10 08:18:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-alertmanager-a[72620]: level=info ts=2024-02-10T08:18:27.499Z caller=cluster.go:688 component=cluster msg="gossip settled; proceeding" elapsed=10.0015733s 2024-02-10T08:18:27.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:26.463066+0000 mgr.y (mgr.14505) 65 : cluster [DBG] pgmap v56: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 35 B/s, 2 objects/s recovering 2024-02-10T08:18:27.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:26.949610+0000 osd.4 (osd.4) 41 : cluster [DBG] 6.1e scrub starts 2024-02-10T08:18:27.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:26.952493+0000 osd.4 (osd.4) 42 : cluster [DBG] 6.1e scrub ok 2024-02-10T08:18:27.789 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:18:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:18:27.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:26.463066+0000 mgr.y (mgr.14505) 65 : cluster [DBG] pgmap v56: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 35 B/s, 2 objects/s recovering 2024-02-10T08:18:27.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:26.949610+0000 osd.4 (osd.4) 41 : cluster [DBG] 6.1e scrub starts 2024-02-10T08:18:27.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:26.952493+0000 osd.4 (osd.4) 42 : cluster [DBG] 6.1e scrub ok 2024-02-10T08:18:28.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:26.753244+0000 osd.0 (osd.0) 29 : cluster [DBG] 4.3 scrub starts 2024-02-10T08:18:28.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:26.755312+0000 osd.0 (osd.0) 30 : cluster [DBG] 4.3 scrub ok 2024-02-10T08:18:28.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:18:27.504801+0000 mgr.y (mgr.14505) 66 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:18:28.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:27.610324+0000 osd.2 (osd.2) 31 : cluster [DBG] 5.a scrub starts 2024-02-10T08:18:28.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:27.611090+0000 osd.2 (osd.2) 32 : cluster [DBG] 5.a scrub ok 2024-02-10T08:18:28.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:18:27.855339+0000 mon.a (mon.0) 728 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:18:28.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:28.177566+0000 osd.3 (osd.3) 27 : cluster [DBG] 6.13 scrub starts 2024-02-10T08:18:28.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:28.180627+0000 osd.3 (osd.3) 28 : cluster [DBG] 6.13 scrub ok 2024-02-10T08:18:28.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:26.753244+0000 osd.0 (osd.0) 29 : cluster [DBG] 4.3 scrub starts 2024-02-10T08:18:28.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:26.755312+0000 osd.0 (osd.0) 30 : cluster [DBG] 4.3 scrub ok 2024-02-10T08:18:28.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:18:27.504801+0000 mgr.y (mgr.14505) 66 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:18:28.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:27.610324+0000 osd.2 (osd.2) 31 : cluster [DBG] 5.a scrub starts 2024-02-10T08:18:28.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:27.611090+0000 osd.2 (osd.2) 32 : cluster [DBG] 5.a scrub ok 2024-02-10T08:18:28.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:18:27.855339+0000 mon.a (mon.0) 728 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:18:28.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:28.177566+0000 osd.3 (osd.3) 27 : cluster [DBG] 6.13 scrub starts 2024-02-10T08:18:28.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:28.180627+0000 osd.3 (osd.3) 28 : cluster [DBG] 6.13 scrub ok 2024-02-10T08:18:28.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:26.753244+0000 osd.0 (osd.0) 29 : cluster [DBG] 4.3 scrub starts 2024-02-10T08:18:28.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:26.755312+0000 osd.0 (osd.0) 30 : cluster [DBG] 4.3 scrub ok 2024-02-10T08:18:28.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:18:27.504801+0000 mgr.y (mgr.14505) 66 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:18:28.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:27.610324+0000 osd.2 (osd.2) 31 : cluster [DBG] 5.a scrub starts 2024-02-10T08:18:28.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:27.611090+0000 osd.2 (osd.2) 32 : cluster [DBG] 5.a scrub ok 2024-02-10T08:18:28.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:18:27.855339+0000 mon.a (mon.0) 728 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:18:28.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:28.177566+0000 osd.3 (osd.3) 27 : cluster [DBG] 6.13 scrub starts 2024-02-10T08:18:28.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:28.180627+0000 osd.3 (osd.3) 28 : cluster [DBG] 6.13 scrub ok 2024-02-10T08:18:29.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:28.027701+0000 osd.7 (osd.7) 35 : cluster [DBG] 2.1c deep-scrub starts 2024-02-10T08:18:29.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:28.028552+0000 osd.7 (osd.7) 36 : cluster [DBG] 2.1c deep-scrub ok 2024-02-10T08:18:29.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:28.463708+0000 mgr.y (mgr.14505) 67 : cluster [DBG] pgmap v57: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 2.6 KiB/s rd, 99 B/s wr, 5 op/s; 32 B/s, 1 objects/s recovering 2024-02-10T08:18:29.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:28.602312+0000 osd.2 (osd.2) 33 : cluster [DBG] 5.6 scrub starts 2024-02-10T08:18:29.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:28.603507+0000 osd.2 (osd.2) 34 : cluster [DBG] 5.6 scrub ok 2024-02-10T08:18:29.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:28.987940+0000 osd.4 (osd.4) 43 : cluster [DBG] 5.e scrub starts 2024-02-10T08:18:29.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:28.991441+0000 osd.4 (osd.4) 44 : cluster [DBG] 5.e scrub ok 2024-02-10T08:18:29.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:29.158182+0000 osd.1 (osd.1) 31 : cluster [DBG] 2.9 scrub starts 2024-02-10T08:18:29.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:29.161166+0000 osd.1 (osd.1) 32 : cluster [DBG] 2.9 scrub ok 2024-02-10T08:18:29.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:28.027701+0000 osd.7 (osd.7) 35 : cluster [DBG] 2.1c deep-scrub starts 2024-02-10T08:18:29.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:28.028552+0000 osd.7 (osd.7) 36 : cluster [DBG] 2.1c deep-scrub ok 2024-02-10T08:18:29.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:28.463708+0000 mgr.y (mgr.14505) 67 : cluster [DBG] pgmap v57: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 2.6 KiB/s rd, 99 B/s wr, 5 op/s; 32 B/s, 1 objects/s recovering 2024-02-10T08:18:29.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:28.602312+0000 osd.2 (osd.2) 33 : cluster [DBG] 5.6 scrub starts 2024-02-10T08:18:29.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:28.603507+0000 osd.2 (osd.2) 34 : cluster [DBG] 5.6 scrub ok 2024-02-10T08:18:29.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:28.987940+0000 osd.4 (osd.4) 43 : cluster [DBG] 5.e scrub starts 2024-02-10T08:18:29.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:28.991441+0000 osd.4 (osd.4) 44 : cluster [DBG] 5.e scrub ok 2024-02-10T08:18:29.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:29.158182+0000 osd.1 (osd.1) 31 : cluster [DBG] 2.9 scrub starts 2024-02-10T08:18:29.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:29.161166+0000 osd.1 (osd.1) 32 : cluster [DBG] 2.9 scrub ok 2024-02-10T08:18:29.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:28.027701+0000 osd.7 (osd.7) 35 : cluster [DBG] 2.1c deep-scrub starts 2024-02-10T08:18:29.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:28.028552+0000 osd.7 (osd.7) 36 : cluster [DBG] 2.1c deep-scrub ok 2024-02-10T08:18:29.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:28.463708+0000 mgr.y (mgr.14505) 67 : cluster [DBG] pgmap v57: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 2.6 KiB/s rd, 99 B/s wr, 5 op/s; 32 B/s, 1 objects/s recovering 2024-02-10T08:18:29.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:28.602312+0000 osd.2 (osd.2) 33 : cluster [DBG] 5.6 scrub starts 2024-02-10T08:18:29.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:28.603507+0000 osd.2 (osd.2) 34 : cluster [DBG] 5.6 scrub ok 2024-02-10T08:18:29.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:28.987940+0000 osd.4 (osd.4) 43 : cluster [DBG] 5.e scrub starts 2024-02-10T08:18:29.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:28.991441+0000 osd.4 (osd.4) 44 : cluster [DBG] 5.e scrub ok 2024-02-10T08:18:29.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:29.158182+0000 osd.1 (osd.1) 31 : cluster [DBG] 2.9 scrub starts 2024-02-10T08:18:29.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:29.161166+0000 osd.1 (osd.1) 32 : cluster [DBG] 2.9 scrub ok 2024-02-10T08:18:30.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:29.051576+0000 osd.7 (osd.7) 37 : cluster [DBG] 5.9 scrub starts 2024-02-10T08:18:30.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:29.052896+0000 osd.7 (osd.7) 38 : cluster [DBG] 5.9 scrub ok 2024-02-10T08:18:30.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:30.086585+0000 osd.3 (osd.3) 29 : cluster [DBG] 5.0 scrub starts 2024-02-10T08:18:30.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:30.090061+0000 osd.3 (osd.3) 30 : cluster [DBG] 5.0 scrub ok 2024-02-10T08:18:30.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:30.154273+0000 osd.1 (osd.1) 33 : cluster [DBG] 5.12 scrub starts 2024-02-10T08:18:30.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:30.157261+0000 osd.1 (osd.1) 34 : cluster [DBG] 5.12 scrub ok 2024-02-10T08:18:30.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:18:30.275858+0000 mon.a (mon.0) 729 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:18:30.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:18:30.276783+0000 mon.a (mon.0) 730 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:18:30.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:18:30.277594+0000 mon.a (mon.0) 731 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:18:30.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:18:30.281930+0000 mon.a (mon.0) 732 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:18:30.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:29.051576+0000 osd.7 (osd.7) 37 : cluster [DBG] 5.9 scrub starts 2024-02-10T08:18:30.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:29.052896+0000 osd.7 (osd.7) 38 : cluster [DBG] 5.9 scrub ok 2024-02-10T08:18:30.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:30.086585+0000 osd.3 (osd.3) 29 : cluster [DBG] 5.0 scrub starts 2024-02-10T08:18:30.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:30.090061+0000 osd.3 (osd.3) 30 : cluster [DBG] 5.0 scrub ok 2024-02-10T08:18:30.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:30.154273+0000 osd.1 (osd.1) 33 : cluster [DBG] 5.12 scrub starts 2024-02-10T08:18:30.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:30.157261+0000 osd.1 (osd.1) 34 : cluster [DBG] 5.12 scrub ok 2024-02-10T08:18:30.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:18:30.275858+0000 mon.a (mon.0) 729 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:18:30.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:18:30.276783+0000 mon.a (mon.0) 730 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:18:30.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:18:30.277594+0000 mon.a (mon.0) 731 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:18:30.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:18:30.281930+0000 mon.a (mon.0) 732 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:18:30.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:29.051576+0000 osd.7 (osd.7) 37 : cluster [DBG] 5.9 scrub starts 2024-02-10T08:18:30.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:29.052896+0000 osd.7 (osd.7) 38 : cluster [DBG] 5.9 scrub ok 2024-02-10T08:18:30.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:30.086585+0000 osd.3 (osd.3) 29 : cluster [DBG] 5.0 scrub starts 2024-02-10T08:18:30.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:30.090061+0000 osd.3 (osd.3) 30 : cluster [DBG] 5.0 scrub ok 2024-02-10T08:18:30.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:30.154273+0000 osd.1 (osd.1) 33 : cluster [DBG] 5.12 scrub starts 2024-02-10T08:18:30.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:30.157261+0000 osd.1 (osd.1) 34 : cluster [DBG] 5.12 scrub ok 2024-02-10T08:18:30.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:18:30.275858+0000 mon.a (mon.0) 729 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:18:30.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:18:30.276783+0000 mon.a (mon.0) 730 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:18:30.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:18:30.277594+0000 mon.a (mon.0) 731 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:18:30.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:18:30.281930+0000 mon.a (mon.0) 732 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:18:30.948 INFO:teuthology.orchestra.run.smithi018.stdout:184683593756 2024-02-10T08:18:30.948 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph tell osd.7 flush_pg_stats 2024-02-10T08:18:31.230 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:18:31.366 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:30.419877+0000 osd.5 (osd.5) 19 : cluster [DBG] 2.18 deep-scrub starts 2024-02-10T08:18:31.366 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:30.422796+0000 osd.5 (osd.5) 20 : cluster [DBG] 2.18 deep-scrub ok 2024-02-10T08:18:31.367 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:30.464131+0000 mgr.y (mgr.14505) 68 : cluster [DBG] pgmap v58: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 2.2 KiB/s rd, 85 B/s wr, 4 op/s; 27 B/s, 1 objects/s recovering 2024-02-10T08:18:31.367 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:31.133823+0000 osd.1 (osd.1) 35 : cluster [DBG] 5.19 scrub starts 2024-02-10T08:18:31.367 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:31.136792+0000 osd.1 (osd.1) 36 : cluster [DBG] 5.19 scrub ok 2024-02-10T08:18:31.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:30.419877+0000 osd.5 (osd.5) 19 : cluster [DBG] 2.18 deep-scrub starts 2024-02-10T08:18:31.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:30.422796+0000 osd.5 (osd.5) 20 : cluster [DBG] 2.18 deep-scrub ok 2024-02-10T08:18:31.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:30.464131+0000 mgr.y (mgr.14505) 68 : cluster [DBG] pgmap v58: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 2.2 KiB/s rd, 85 B/s wr, 4 op/s; 27 B/s, 1 objects/s recovering 2024-02-10T08:18:31.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:31.133823+0000 osd.1 (osd.1) 35 : cluster [DBG] 5.19 scrub starts 2024-02-10T08:18:31.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:31.136792+0000 osd.1 (osd.1) 36 : cluster [DBG] 5.19 scrub ok 2024-02-10T08:18:31.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:30.419877+0000 osd.5 (osd.5) 19 : cluster [DBG] 2.18 deep-scrub starts 2024-02-10T08:18:31.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:30.422796+0000 osd.5 (osd.5) 20 : cluster [DBG] 2.18 deep-scrub ok 2024-02-10T08:18:31.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:30.464131+0000 mgr.y (mgr.14505) 68 : cluster [DBG] pgmap v58: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 2.2 KiB/s rd, 85 B/s wr, 4 op/s; 27 B/s, 1 objects/s recovering 2024-02-10T08:18:31.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:31.133823+0000 osd.1 (osd.1) 35 : cluster [DBG] 5.19 scrub starts 2024-02-10T08:18:31.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:31.136792+0000 osd.1 (osd.1) 36 : cluster [DBG] 5.19 scrub ok 2024-02-10T08:18:32.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:32.024780+0000 osd.3 (osd.3) 31 : cluster [DBG] 6.b scrub starts 2024-02-10T08:18:32.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:32.027698+0000 osd.3 (osd.3) 32 : cluster [DBG] 6.b scrub ok 2024-02-10T08:18:32.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:32.024780+0000 osd.3 (osd.3) 31 : cluster [DBG] 6.b scrub starts 2024-02-10T08:18:32.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:32.027698+0000 osd.3 (osd.3) 32 : cluster [DBG] 6.b scrub ok 2024-02-10T08:18:32.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:32.024780+0000 osd.3 (osd.3) 31 : cluster [DBG] 6.b scrub starts 2024-02-10T08:18:32.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:32.027698+0000 osd.3 (osd.3) 32 : cluster [DBG] 6.b scrub ok 2024-02-10T08:18:33.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:32.464980+0000 mgr.y (mgr.14505) 69 : cluster [DBG] pgmap v59: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 2.7 KiB/s rd, 85 B/s wr, 4 op/s; 27 B/s, 1 objects/s recovering 2024-02-10T08:18:33.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:32.464980+0000 mgr.y (mgr.14505) 69 : cluster [DBG] pgmap v59: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 2.7 KiB/s rd, 85 B/s wr, 4 op/s; 27 B/s, 1 objects/s recovering 2024-02-10T08:18:33.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:32.464980+0000 mgr.y (mgr.14505) 69 : cluster [DBG] pgmap v59: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 2.7 KiB/s rd, 85 B/s wr, 4 op/s; 27 B/s, 1 objects/s recovering 2024-02-10T08:18:34.272 INFO:teuthology.orchestra.run.smithi018.stdout:214748364824 2024-02-10T08:18:34.273 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd last-stat-seq osd.0 2024-02-10T08:18:34.557 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:18:34.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:33.092305+0000 osd.7 (osd.7) 39 : cluster [DBG] 2.1d scrub starts 2024-02-10T08:18:34.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:33.095753+0000 osd.7 (osd.7) 40 : cluster [DBG] 2.1d scrub ok 2024-02-10T08:18:34.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:33.349442+0000 osd.5 (osd.5) 21 : cluster [DBG] 6.d scrub starts 2024-02-10T08:18:34.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:33.352442+0000 osd.5 (osd.5) 22 : cluster [DBG] 6.d scrub ok 2024-02-10T08:18:34.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:33.412750+0000 osd.6 (osd.6) 21 : cluster [DBG] 4.5 scrub starts 2024-02-10T08:18:34.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:33.416359+0000 osd.6 (osd.6) 22 : cluster [DBG] 4.5 scrub ok 2024-02-10T08:18:34.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:33.092305+0000 osd.7 (osd.7) 39 : cluster [DBG] 2.1d scrub starts 2024-02-10T08:18:34.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:33.095753+0000 osd.7 (osd.7) 40 : cluster [DBG] 2.1d scrub ok 2024-02-10T08:18:34.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:33.349442+0000 osd.5 (osd.5) 21 : cluster [DBG] 6.d scrub starts 2024-02-10T08:18:34.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:33.352442+0000 osd.5 (osd.5) 22 : cluster [DBG] 6.d scrub ok 2024-02-10T08:18:34.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:33.412750+0000 osd.6 (osd.6) 21 : cluster [DBG] 4.5 scrub starts 2024-02-10T08:18:34.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:33.416359+0000 osd.6 (osd.6) 22 : cluster [DBG] 4.5 scrub ok 2024-02-10T08:18:34.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:33.092305+0000 osd.7 (osd.7) 39 : cluster [DBG] 2.1d scrub starts 2024-02-10T08:18:34.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:33.095753+0000 osd.7 (osd.7) 40 : cluster [DBG] 2.1d scrub ok 2024-02-10T08:18:34.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:33.349442+0000 osd.5 (osd.5) 21 : cluster [DBG] 6.d scrub starts 2024-02-10T08:18:34.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:33.352442+0000 osd.5 (osd.5) 22 : cluster [DBG] 6.d scrub ok 2024-02-10T08:18:34.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:33.412750+0000 osd.6 (osd.6) 21 : cluster [DBG] 4.5 scrub starts 2024-02-10T08:18:34.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:33.416359+0000 osd.6 (osd.6) 22 : cluster [DBG] 4.5 scrub ok 2024-02-10T08:18:35.377 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:34.324098+0000 osd.5 (osd.5) 23 : cluster [DBG] 2.12 scrub starts 2024-02-10T08:18:35.377 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:34.326983+0000 osd.5 (osd.5) 24 : cluster [DBG] 2.12 scrub ok 2024-02-10T08:18:35.377 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:34.380399+0000 osd.6 (osd.6) 23 : cluster [DBG] 5.11 scrub starts 2024-02-10T08:18:35.377 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:34.381325+0000 osd.6 (osd.6) 24 : cluster [DBG] 5.11 scrub ok 2024-02-10T08:18:35.377 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:34.465419+0000 mgr.y (mgr.14505) 70 : cluster [DBG] pgmap v60: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:18:35.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:34.324098+0000 osd.5 (osd.5) 23 : cluster [DBG] 2.12 scrub starts 2024-02-10T08:18:35.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:34.326983+0000 osd.5 (osd.5) 24 : cluster [DBG] 2.12 scrub ok 2024-02-10T08:18:35.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:34.380399+0000 osd.6 (osd.6) 23 : cluster [DBG] 5.11 scrub starts 2024-02-10T08:18:35.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:34.381325+0000 osd.6 (osd.6) 24 : cluster [DBG] 5.11 scrub ok 2024-02-10T08:18:35.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:34.465419+0000 mgr.y (mgr.14505) 70 : cluster [DBG] pgmap v60: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:18:35.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:34.324098+0000 osd.5 (osd.5) 23 : cluster [DBG] 2.12 scrub starts 2024-02-10T08:18:35.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:34.326983+0000 osd.5 (osd.5) 24 : cluster [DBG] 2.12 scrub ok 2024-02-10T08:18:35.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:34.380399+0000 osd.6 (osd.6) 23 : cluster [DBG] 5.11 scrub starts 2024-02-10T08:18:35.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:34.381325+0000 osd.6 (osd.6) 24 : cluster [DBG] 5.11 scrub ok 2024-02-10T08:18:35.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:34.465419+0000 mgr.y (mgr.14505) 70 : cluster [DBG] pgmap v60: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:18:36.518 INFO:teuthology.orchestra.run.smithi018.stdout:34359738425 2024-02-10T08:18:36.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:34.716960+0000 osd.0 (osd.0) 31 : cluster [DBG] 4.6 scrub starts 2024-02-10T08:18:36.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:34.720408+0000 osd.0 (osd.0) 32 : cluster [DBG] 4.6 scrub ok 2024-02-10T08:18:36.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:34.716960+0000 osd.0 (osd.0) 31 : cluster [DBG] 4.6 scrub starts 2024-02-10T08:18:36.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:34.720408+0000 osd.0 (osd.0) 32 : cluster [DBG] 4.6 scrub ok 2024-02-10T08:18:36.789 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:18:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:18:36] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:18:36.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:34.716960+0000 osd.0 (osd.0) 31 : cluster [DBG] 4.6 scrub starts 2024-02-10T08:18:36.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:34.720408+0000 osd.0 (osd.0) 32 : cluster [DBG] 4.6 scrub ok 2024-02-10T08:18:37.381 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:18:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:18:37] "GET /metrics HTTP/1.1" 200 172107 "" "Prometheus/2.33.4" 2024-02-10T08:18:37.511 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738418 got 34359738425 for osd.0 2024-02-10T08:18:37.511 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd last-stat-seq osd.1 2024-02-10T08:18:37.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:35.725226+0000 osd.0 (osd.0) 33 : cluster [DBG] 5.3 scrub starts 2024-02-10T08:18:37.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:35.727092+0000 osd.0 (osd.0) 34 : cluster [DBG] 5.3 scrub ok 2024-02-10T08:18:37.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:36.308415+0000 osd.1 (osd.1) 37 : cluster [DBG] 2.4 scrub starts 2024-02-10T08:18:37.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:36.311437+0000 osd.1 (osd.1) 38 : cluster [DBG] 2.4 scrub ok 2024-02-10T08:18:37.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:36.319082+0000 osd.6 (osd.6) 25 : cluster [DBG] 5.1f deep-scrub starts 2024-02-10T08:18:37.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:36.323211+0000 osd.6 (osd.6) 26 : cluster [DBG] 5.1f deep-scrub ok 2024-02-10T08:18:37.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:36.465717+0000 mgr.y (mgr.14505) 71 : cluster [DBG] pgmap v61: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:18:37.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:18:36.517996+0000 mon.a (mon.0) 733 : audit [DBG] from='client.? 172.21.15.18:0/465184024' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-02-10T08:18:37.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:37.270599+0000 osd.1 (osd.1) 39 : cluster [DBG] 5.c scrub starts 2024-02-10T08:18:37.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:37.273473+0000 osd.1 (osd.1) 40 : cluster [DBG] 5.c scrub ok 2024-02-10T08:18:37.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:35.725226+0000 osd.0 (osd.0) 33 : cluster [DBG] 5.3 scrub starts 2024-02-10T08:18:37.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:35.727092+0000 osd.0 (osd.0) 34 : cluster [DBG] 5.3 scrub ok 2024-02-10T08:18:37.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:36.308415+0000 osd.1 (osd.1) 37 : cluster [DBG] 2.4 scrub starts 2024-02-10T08:18:37.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:36.311437+0000 osd.1 (osd.1) 38 : cluster [DBG] 2.4 scrub ok 2024-02-10T08:18:37.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:36.319082+0000 osd.6 (osd.6) 25 : cluster [DBG] 5.1f deep-scrub starts 2024-02-10T08:18:37.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:36.323211+0000 osd.6 (osd.6) 26 : cluster [DBG] 5.1f deep-scrub ok 2024-02-10T08:18:37.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:36.465717+0000 mgr.y (mgr.14505) 71 : cluster [DBG] pgmap v61: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:18:37.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:18:36.517996+0000 mon.a (mon.0) 733 : audit [DBG] from='client.? 172.21.15.18:0/465184024' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-02-10T08:18:37.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:37.270599+0000 osd.1 (osd.1) 39 : cluster [DBG] 5.c scrub starts 2024-02-10T08:18:37.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:37.273473+0000 osd.1 (osd.1) 40 : cluster [DBG] 5.c scrub ok 2024-02-10T08:18:37.789 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:18:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:18:37.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:35.725226+0000 osd.0 (osd.0) 33 : cluster [DBG] 5.3 scrub starts 2024-02-10T08:18:37.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:35.727092+0000 osd.0 (osd.0) 34 : cluster [DBG] 5.3 scrub ok 2024-02-10T08:18:37.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:36.308415+0000 osd.1 (osd.1) 37 : cluster [DBG] 2.4 scrub starts 2024-02-10T08:18:37.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:36.311437+0000 osd.1 (osd.1) 38 : cluster [DBG] 2.4 scrub ok 2024-02-10T08:18:37.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:36.319082+0000 osd.6 (osd.6) 25 : cluster [DBG] 5.1f deep-scrub starts 2024-02-10T08:18:37.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:36.323211+0000 osd.6 (osd.6) 26 : cluster [DBG] 5.1f deep-scrub ok 2024-02-10T08:18:37.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:36.465717+0000 mgr.y (mgr.14505) 71 : cluster [DBG] pgmap v61: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:18:37.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:18:36.517996+0000 mon.a (mon.0) 733 : audit [DBG] from='client.? 172.21.15.18:0/465184024' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-02-10T08:18:37.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:37.270599+0000 osd.1 (osd.1) 39 : cluster [DBG] 5.c scrub starts 2024-02-10T08:18:37.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:37.273473+0000 osd.1 (osd.1) 40 : cluster [DBG] 5.c scrub ok 2024-02-10T08:18:37.791 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:18:38.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:18:37.515586+0000 mgr.y (mgr.14505) 72 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:18:38.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:38.071874+0000 osd.3 (osd.3) 33 : cluster [DBG] 2.19 scrub starts 2024-02-10T08:18:38.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:38.074878+0000 osd.3 (osd.3) 34 : cluster [DBG] 2.19 scrub ok 2024-02-10T08:18:38.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:38.227294+0000 osd.1 (osd.1) 41 : cluster [DBG] 5.1d scrub starts 2024-02-10T08:18:38.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:38.230206+0000 osd.1 (osd.1) 42 : cluster [DBG] 5.1d scrub ok 2024-02-10T08:18:38.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:18:37.515586+0000 mgr.y (mgr.14505) 72 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:18:38.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:38.071874+0000 osd.3 (osd.3) 33 : cluster [DBG] 2.19 scrub starts 2024-02-10T08:18:38.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:38.074878+0000 osd.3 (osd.3) 34 : cluster [DBG] 2.19 scrub ok 2024-02-10T08:18:38.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:38.227294+0000 osd.1 (osd.1) 41 : cluster [DBG] 5.1d scrub starts 2024-02-10T08:18:38.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:38.230206+0000 osd.1 (osd.1) 42 : cluster [DBG] 5.1d scrub ok 2024-02-10T08:18:38.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:18:37.515586+0000 mgr.y (mgr.14505) 72 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:18:38.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:38.071874+0000 osd.3 (osd.3) 33 : cluster [DBG] 2.19 scrub starts 2024-02-10T08:18:38.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:38.074878+0000 osd.3 (osd.3) 34 : cluster [DBG] 2.19 scrub ok 2024-02-10T08:18:38.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:38.227294+0000 osd.1 (osd.1) 41 : cluster [DBG] 5.1d scrub starts 2024-02-10T08:18:38.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:38.230206+0000 osd.1 (osd.1) 42 : cluster [DBG] 5.1d scrub ok 2024-02-10T08:18:39.506 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:38.466431+0000 mgr.y (mgr.14505) 73 : cluster [DBG] pgmap v62: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:18:39.506 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:39.237005+0000 osd.1 (osd.1) 43 : cluster [DBG] 4.7 scrub starts 2024-02-10T08:18:39.506 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:39.240937+0000 osd.1 (osd.1) 44 : cluster [DBG] 4.7 scrub ok 2024-02-10T08:18:39.506 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:38.466431+0000 mgr.y (mgr.14505) 73 : cluster [DBG] pgmap v62: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:18:39.507 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:39.237005+0000 osd.1 (osd.1) 43 : cluster [DBG] 4.7 scrub starts 2024-02-10T08:18:39.507 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:39.240937+0000 osd.1 (osd.1) 44 : cluster [DBG] 4.7 scrub ok 2024-02-10T08:18:39.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:38.466431+0000 mgr.y (mgr.14505) 73 : cluster [DBG] pgmap v62: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:18:39.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:39.237005+0000 osd.1 (osd.1) 43 : cluster [DBG] 4.7 scrub starts 2024-02-10T08:18:39.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:39.240937+0000 osd.1 (osd.1) 44 : cluster [DBG] 4.7 scrub ok 2024-02-10T08:18:39.926 INFO:teuthology.orchestra.run.smithi018.stdout:55834574901 2024-02-10T08:18:40.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:18:39.925523+0000 mon.a (mon.0) 734 : audit [DBG] from='client.? 172.21.15.18:0/2121512440' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-02-10T08:18:40.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:18:39.925523+0000 mon.a (mon.0) 734 : audit [DBG] from='client.? 172.21.15.18:0/2121512440' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-02-10T08:18:40.751 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574894 got 55834574901 for osd.1 2024-02-10T08:18:40.751 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd last-stat-seq osd.2 2024-02-10T08:18:40.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:18:39.925523+0000 mon.a (mon.0) 734 : audit [DBG] from='client.? 172.21.15.18:0/2121512440' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-02-10T08:18:41.034 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:18:41.589 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:40.354866+0000 osd.5 (osd.5) 25 : cluster [DBG] 2.2 scrub starts 2024-02-10T08:18:41.589 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:40.357754+0000 osd.5 (osd.5) 26 : cluster [DBG] 2.2 scrub ok 2024-02-10T08:18:41.589 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:40.466957+0000 mgr.y (mgr.14505) 74 : cluster [DBG] pgmap v63: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:18:41.589 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:41.073407+0000 osd.3 (osd.3) 35 : cluster [DBG] 4.0 scrub starts 2024-02-10T08:18:41.589 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:41.077075+0000 osd.3 (osd.3) 36 : cluster [DBG] 4.0 scrub ok 2024-02-10T08:18:41.589 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:41.252272+0000 osd.1 (osd.1) 45 : cluster [DBG] 6.4 scrub starts 2024-02-10T08:18:41.589 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:41.255192+0000 osd.1 (osd.1) 46 : cluster [DBG] 6.4 scrub ok 2024-02-10T08:18:41.589 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:40.354866+0000 osd.5 (osd.5) 25 : cluster [DBG] 2.2 scrub starts 2024-02-10T08:18:41.590 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:40.357754+0000 osd.5 (osd.5) 26 : cluster [DBG] 2.2 scrub ok 2024-02-10T08:18:41.590 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:40.466957+0000 mgr.y (mgr.14505) 74 : cluster [DBG] pgmap v63: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:18:41.590 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:41.073407+0000 osd.3 (osd.3) 35 : cluster [DBG] 4.0 scrub starts 2024-02-10T08:18:41.590 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:41.077075+0000 osd.3 (osd.3) 36 : cluster [DBG] 4.0 scrub ok 2024-02-10T08:18:41.590 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:41.252272+0000 osd.1 (osd.1) 45 : cluster [DBG] 6.4 scrub starts 2024-02-10T08:18:41.590 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:41.255192+0000 osd.1 (osd.1) 46 : cluster [DBG] 6.4 scrub ok 2024-02-10T08:18:41.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:41 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:40.354866+0000 osd.5 (osd.5) 25 : cluster [DBG] 2.2 scrub starts 2024-02-10T08:18:41.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:41 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:40.357754+0000 osd.5 (osd.5) 26 : cluster [DBG] 2.2 scrub ok 2024-02-10T08:18:41.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:41 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:40.466957+0000 mgr.y (mgr.14505) 74 : cluster [DBG] pgmap v63: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:18:41.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:41 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:41.073407+0000 osd.3 (osd.3) 35 : cluster [DBG] 4.0 scrub starts 2024-02-10T08:18:41.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:41 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:41.077075+0000 osd.3 (osd.3) 36 : cluster [DBG] 4.0 scrub ok 2024-02-10T08:18:41.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:41 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:41.252272+0000 osd.1 (osd.1) 45 : cluster [DBG] 6.4 scrub starts 2024-02-10T08:18:41.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:41 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:41.255192+0000 osd.1 (osd.1) 46 : cluster [DBG] 6.4 scrub ok 2024-02-10T08:18:42.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:41.357278+0000 osd.5 (osd.5) 27 : cluster [DBG] 5.7 deep-scrub starts 2024-02-10T08:18:42.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:41.360237+0000 osd.5 (osd.5) 28 : cluster [DBG] 5.7 deep-scrub ok 2024-02-10T08:18:42.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:42.098641+0000 osd.3 (osd.3) 37 : cluster [DBG] 4.17 scrub starts 2024-02-10T08:18:42.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:42.100544+0000 osd.3 (osd.3) 38 : cluster [DBG] 4.17 scrub ok 2024-02-10T08:18:42.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:41.357278+0000 osd.5 (osd.5) 27 : cluster [DBG] 5.7 deep-scrub starts 2024-02-10T08:18:42.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:41.360237+0000 osd.5 (osd.5) 28 : cluster [DBG] 5.7 deep-scrub ok 2024-02-10T08:18:42.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:42.098641+0000 osd.3 (osd.3) 37 : cluster [DBG] 4.17 scrub starts 2024-02-10T08:18:42.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:42.100544+0000 osd.3 (osd.3) 38 : cluster [DBG] 4.17 scrub ok 2024-02-10T08:18:42.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:41.357278+0000 osd.5 (osd.5) 27 : cluster [DBG] 5.7 deep-scrub starts 2024-02-10T08:18:42.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:41.360237+0000 osd.5 (osd.5) 28 : cluster [DBG] 5.7 deep-scrub ok 2024-02-10T08:18:42.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:42.098641+0000 osd.3 (osd.3) 37 : cluster [DBG] 4.17 scrub starts 2024-02-10T08:18:42.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:42.100544+0000 osd.3 (osd.3) 38 : cluster [DBG] 4.17 scrub ok 2024-02-10T08:18:43.143 INFO:teuthology.orchestra.run.smithi018.stdout:77309411377 2024-02-10T08:18:43.506 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:42.467772+0000 mgr.y (mgr.14505) 75 : cluster [DBG] pgmap v64: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:18:43.506 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:18:43.142812+0000 mon.c (mon.2) 19 : audit [DBG] from='client.? 172.21.15.18:0/1249167489' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-02-10T08:18:43.506 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:42.467772+0000 mgr.y (mgr.14505) 75 : cluster [DBG] pgmap v64: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:18:43.506 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:18:43.142812+0000 mon.c (mon.2) 19 : audit [DBG] from='client.? 172.21.15.18:0/1249167489' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-02-10T08:18:43.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:43 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:42.467772+0000 mgr.y (mgr.14505) 75 : cluster [DBG] pgmap v64: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:18:43.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:43 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:18:43.142812+0000 mon.c (mon.2) 19 : audit [DBG] from='client.? 172.21.15.18:0/1249167489' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-02-10T08:18:44.196 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411372 got 77309411377 for osd.2 2024-02-10T08:18:44.196 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd last-stat-seq osd.3 2024-02-10T08:18:44.478 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:18:45.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:43.741904+0000 osd.0 (osd.0) 35 : cluster [DBG] 2.1f scrub starts 2024-02-10T08:18:45.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:43.744897+0000 osd.0 (osd.0) 36 : cluster [DBG] 2.1f scrub ok 2024-02-10T08:18:45.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:44.468121+0000 mgr.y (mgr.14505) 76 : cluster [DBG] pgmap v65: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:18:45.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:43.741904+0000 osd.0 (osd.0) 35 : cluster [DBG] 2.1f scrub starts 2024-02-10T08:18:45.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:43.744897+0000 osd.0 (osd.0) 36 : cluster [DBG] 2.1f scrub ok 2024-02-10T08:18:45.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:44.468121+0000 mgr.y (mgr.14505) 76 : cluster [DBG] pgmap v65: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:18:45.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:43.741904+0000 osd.0 (osd.0) 35 : cluster [DBG] 2.1f scrub starts 2024-02-10T08:18:45.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:43.744897+0000 osd.0 (osd.0) 36 : cluster [DBG] 2.1f scrub ok 2024-02-10T08:18:45.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:44.468121+0000 mgr.y (mgr.14505) 76 : cluster [DBG] pgmap v65: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:18:46.527 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:45.377038+0000 osd.5 (osd.5) 29 : cluster [DBG] 6.7 scrub starts 2024-02-10T08:18:46.528 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:45.379927+0000 osd.5 (osd.5) 30 : cluster [DBG] 6.7 scrub ok 2024-02-10T08:18:46.683 INFO:teuthology.orchestra.run.smithi018.stdout:107374182445 2024-02-10T08:18:46.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:45.377038+0000 osd.5 (osd.5) 29 : cluster [DBG] 6.7 scrub starts 2024-02-10T08:18:46.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:45.379927+0000 osd.5 (osd.5) 30 : cluster [DBG] 6.7 scrub ok 2024-02-10T08:18:46.789 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:18:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:18:46] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:18:46.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:45.377038+0000 osd.5 (osd.5) 29 : cluster [DBG] 6.7 scrub starts 2024-02-10T08:18:46.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:45.379927+0000 osd.5 (osd.5) 30 : cluster [DBG] 6.7 scrub ok 2024-02-10T08:18:47.404 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:18:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:18:47] "GET /metrics HTTP/1.1" 200 172109 "" "Prometheus/2.33.4" 2024-02-10T08:18:47.491 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182439 got 107374182445 for osd.3 2024-02-10T08:18:47.491 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd last-stat-seq osd.4 2024-02-10T08:18:47.769 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:18:47.789 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:18:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:18:47.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:46.468479+0000 mgr.y (mgr.14505) 77 : cluster [DBG] pgmap v66: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:18:47.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:18:46.682852+0000 mon.a (mon.0) 735 : audit [DBG] from='client.? 172.21.15.18:0/1163652558' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-02-10T08:18:47.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:47.115775+0000 osd.3 (osd.3) 39 : cluster [DBG] 6.6 scrub starts 2024-02-10T08:18:47.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:47.116723+0000 osd.3 (osd.3) 40 : cluster [DBG] 6.6 scrub ok 2024-02-10T08:18:47.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:46.468479+0000 mgr.y (mgr.14505) 77 : cluster [DBG] pgmap v66: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:18:47.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:18:46.682852+0000 mon.a (mon.0) 735 : audit [DBG] from='client.? 172.21.15.18:0/1163652558' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-02-10T08:18:47.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:47.115775+0000 osd.3 (osd.3) 39 : cluster [DBG] 6.6 scrub starts 2024-02-10T08:18:47.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:47.116723+0000 osd.3 (osd.3) 40 : cluster [DBG] 6.6 scrub ok 2024-02-10T08:18:47.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:46.468479+0000 mgr.y (mgr.14505) 77 : cluster [DBG] pgmap v66: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:18:47.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:18:46.682852+0000 mon.a (mon.0) 735 : audit [DBG] from='client.? 172.21.15.18:0/1163652558' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-02-10T08:18:47.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:47.115775+0000 osd.3 (osd.3) 39 : cluster [DBG] 6.6 scrub starts 2024-02-10T08:18:47.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:47.116723+0000 osd.3 (osd.3) 40 : cluster [DBG] 6.6 scrub ok 2024-02-10T08:18:48.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:47.348570+0000 osd.5 (osd.5) 31 : cluster [DBG] 4.8 scrub starts 2024-02-10T08:18:48.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:47.352147+0000 osd.5 (osd.5) 32 : cluster [DBG] 4.8 scrub ok 2024-02-10T08:18:48.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:18:47.526475+0000 mgr.y (mgr.14505) 78 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:18:48.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:47.348570+0000 osd.5 (osd.5) 31 : cluster [DBG] 4.8 scrub starts 2024-02-10T08:18:48.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:47.352147+0000 osd.5 (osd.5) 32 : cluster [DBG] 4.8 scrub ok 2024-02-10T08:18:48.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:18:47.526475+0000 mgr.y (mgr.14505) 78 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:18:48.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:47.348570+0000 osd.5 (osd.5) 31 : cluster [DBG] 4.8 scrub starts 2024-02-10T08:18:48.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:47.352147+0000 osd.5 (osd.5) 32 : cluster [DBG] 4.8 scrub ok 2024-02-10T08:18:48.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:18:47.526475+0000 mgr.y (mgr.14505) 78 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:18:49.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:49 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:48.367345+0000 osd.5 (osd.5) 33 : cluster [DBG] 4.15 scrub starts 2024-02-10T08:18:49.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:49 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:48.370828+0000 osd.5 (osd.5) 34 : cluster [DBG] 4.15 scrub ok 2024-02-10T08:18:49.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:49 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:48.469050+0000 mgr.y (mgr.14505) 79 : cluster [DBG] pgmap v67: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:18:49.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:48.367345+0000 osd.5 (osd.5) 33 : cluster [DBG] 4.15 scrub starts 2024-02-10T08:18:49.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:48.370828+0000 osd.5 (osd.5) 34 : cluster [DBG] 4.15 scrub ok 2024-02-10T08:18:49.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:48.469050+0000 mgr.y (mgr.14505) 79 : cluster [DBG] pgmap v67: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:18:49.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:48.367345+0000 osd.5 (osd.5) 33 : cluster [DBG] 4.15 scrub starts 2024-02-10T08:18:49.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:48.370828+0000 osd.5 (osd.5) 34 : cluster [DBG] 4.15 scrub ok 2024-02-10T08:18:49.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:48.469050+0000 mgr.y (mgr.14505) 79 : cluster [DBG] pgmap v67: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:18:49.966 INFO:teuthology.orchestra.run.smithi018.stdout:128849018920 2024-02-10T08:18:50.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:49.366487+0000 osd.5 (osd.5) 35 : cluster [DBG] 5.16 scrub starts 2024-02-10T08:18:50.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:49.369496+0000 osd.5 (osd.5) 36 : cluster [DBG] 5.16 scrub ok 2024-02-10T08:18:50.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:18:49.966153+0000 mon.a (mon.0) 736 : audit [DBG] from='client.? 172.21.15.18:0/3373267538' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-02-10T08:18:50.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:50.131226+0000 osd.3 (osd.3) 41 : cluster [DBG] 4.10 scrub starts 2024-02-10T08:18:50.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:50.134686+0000 osd.3 (osd.3) 42 : cluster [DBG] 4.10 scrub ok 2024-02-10T08:18:50.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:49.366487+0000 osd.5 (osd.5) 35 : cluster [DBG] 5.16 scrub starts 2024-02-10T08:18:50.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:49.369496+0000 osd.5 (osd.5) 36 : cluster [DBG] 5.16 scrub ok 2024-02-10T08:18:50.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:18:49.966153+0000 mon.a (mon.0) 736 : audit [DBG] from='client.? 172.21.15.18:0/3373267538' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-02-10T08:18:50.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:50.131226+0000 osd.3 (osd.3) 41 : cluster [DBG] 4.10 scrub starts 2024-02-10T08:18:50.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:50.134686+0000 osd.3 (osd.3) 42 : cluster [DBG] 4.10 scrub ok 2024-02-10T08:18:50.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:49.366487+0000 osd.5 (osd.5) 35 : cluster [DBG] 5.16 scrub starts 2024-02-10T08:18:50.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:49.369496+0000 osd.5 (osd.5) 36 : cluster [DBG] 5.16 scrub ok 2024-02-10T08:18:50.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:18:49.966153+0000 mon.a (mon.0) 736 : audit [DBG] from='client.? 172.21.15.18:0/3373267538' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-02-10T08:18:50.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:50.131226+0000 osd.3 (osd.3) 41 : cluster [DBG] 4.10 scrub starts 2024-02-10T08:18:50.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:50.134686+0000 osd.3 (osd.3) 42 : cluster [DBG] 4.10 scrub ok 2024-02-10T08:18:50.832 INFO:tasks.cephadm.ceph_manager.ceph:need seq 128849018914 got 128849018920 for osd.4 2024-02-10T08:18:50.849 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd last-stat-seq osd.5 2024-02-10T08:18:51.131 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:18:51.619 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:50.469571+0000 mgr.y (mgr.14505) 80 : cluster [DBG] pgmap v68: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:18:51.620 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:50.469571+0000 mgr.y (mgr.14505) 80 : cluster [DBG] pgmap v68: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:18:51.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:51 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:50.469571+0000 mgr.y (mgr.14505) 80 : cluster [DBG] pgmap v68: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:18:52.751 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:51.367510+0000 osd.5 (osd.5) 37 : cluster [DBG] 6.19 scrub starts 2024-02-10T08:18:52.751 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:51.370521+0000 osd.5 (osd.5) 38 : cluster [DBG] 6.19 scrub ok 2024-02-10T08:18:52.751 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:51.532235+0000 osd.0 (osd.0) 37 : cluster [DBG] 5.5 scrub starts 2024-02-10T08:18:52.751 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:51.533122+0000 osd.0 (osd.0) 38 : cluster [DBG] 5.5 scrub ok 2024-02-10T08:18:52.751 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:51.707408+0000 osd.3 (osd.3) 43 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:18:52.751 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:51.707484+0000 osd.3 (osd.3) 44 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:18:52.751 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:52.044310+0000 osd.3 (osd.3) 45 : cluster [DBG] 6.1f scrub starts 2024-02-10T08:18:52.751 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:52.045176+0000 osd.3 (osd.3) 46 : cluster [DBG] 6.1f scrub ok 2024-02-10T08:18:52.752 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:51.367510+0000 osd.5 (osd.5) 37 : cluster [DBG] 6.19 scrub starts 2024-02-10T08:18:52.752 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:51.370521+0000 osd.5 (osd.5) 38 : cluster [DBG] 6.19 scrub ok 2024-02-10T08:18:52.752 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:51.532235+0000 osd.0 (osd.0) 37 : cluster [DBG] 5.5 scrub starts 2024-02-10T08:18:52.752 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:51.533122+0000 osd.0 (osd.0) 38 : cluster [DBG] 5.5 scrub ok 2024-02-10T08:18:52.752 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:51.707408+0000 osd.3 (osd.3) 43 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:18:52.752 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:51.707484+0000 osd.3 (osd.3) 44 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:18:52.752 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:52.044310+0000 osd.3 (osd.3) 45 : cluster [DBG] 6.1f scrub starts 2024-02-10T08:18:52.752 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:52.045176+0000 osd.3 (osd.3) 46 : cluster [DBG] 6.1f scrub ok 2024-02-10T08:18:53.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:52 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:51.367510+0000 osd.5 (osd.5) 37 : cluster [DBG] 6.19 scrub starts 2024-02-10T08:18:53.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:52 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:51.370521+0000 osd.5 (osd.5) 38 : cluster [DBG] 6.19 scrub ok 2024-02-10T08:18:53.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:52 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:51.532235+0000 osd.0 (osd.0) 37 : cluster [DBG] 5.5 scrub starts 2024-02-10T08:18:53.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:52 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:51.533122+0000 osd.0 (osd.0) 38 : cluster [DBG] 5.5 scrub ok 2024-02-10T08:18:53.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:52 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:51.707408+0000 osd.3 (osd.3) 43 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:18:53.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:52 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:51.707484+0000 osd.3 (osd.3) 44 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:18:53.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:52 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:52.044310+0000 osd.3 (osd.3) 45 : cluster [DBG] 6.1f scrub starts 2024-02-10T08:18:53.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:52 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:52.045176+0000 osd.3 (osd.3) 46 : cluster [DBG] 6.1f scrub ok 2024-02-10T08:18:53.181 INFO:teuthology.orchestra.run.smithi018.stdout:158913789990 2024-02-10T08:18:53.907 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:52.470220+0000 mgr.y (mgr.14505) 81 : cluster [DBG] pgmap v69: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:18:53.907 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:52.543913+0000 mon.a (mon.0) 737 : cluster [DBG] osdmap e83: 8 total, 8 up, 8 in 2024-02-10T08:18:53.908 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:52.609829+0000 osd.6 (osd.6) 27 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:18:53.908 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:52.609911+0000 osd.6 (osd.6) 28 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:18:53.908 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:18:53.180725+0000 mon.a (mon.0) 738 : audit [DBG] from='client.? 172.21.15.18:0/2719147056' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-02-10T08:18:53.908 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:52.470220+0000 mgr.y (mgr.14505) 81 : cluster [DBG] pgmap v69: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:18:53.908 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:52.543913+0000 mon.a (mon.0) 737 : cluster [DBG] osdmap e83: 8 total, 8 up, 8 in 2024-02-10T08:18:53.909 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:52.609829+0000 osd.6 (osd.6) 27 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:18:53.909 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:52.609911+0000 osd.6 (osd.6) 28 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:18:53.909 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:18:53.180725+0000 mon.a (mon.0) 738 : audit [DBG] from='client.? 172.21.15.18:0/2719147056' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-02-10T08:18:54.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:53 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:52.470220+0000 mgr.y (mgr.14505) 81 : cluster [DBG] pgmap v69: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:18:54.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:53 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:52.543913+0000 mon.a (mon.0) 737 : cluster [DBG] osdmap e83: 8 total, 8 up, 8 in 2024-02-10T08:18:54.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:53 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:52.609829+0000 osd.6 (osd.6) 27 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:18:54.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:53 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:52.609911+0000 osd.6 (osd.6) 28 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:18:54.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:53 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:18:53.180725+0000 mon.a (mon.0) 738 : audit [DBG] from='client.? 172.21.15.18:0/2719147056' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-02-10T08:18:54.055 INFO:tasks.cephadm.ceph_manager.ceph:need seq 158913789984 got 158913789990 for osd.5 2024-02-10T08:18:54.055 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd last-stat-seq osd.6 2024-02-10T08:18:54.333 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:18:54.891 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:53.544221+0000 mon.a (mon.0) 739 : cluster [DBG] osdmap e84: 8 total, 8 up, 8 in 2024-02-10T08:18:54.891 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:53.544221+0000 mon.a (mon.0) 739 : cluster [DBG] osdmap e84: 8 total, 8 up, 8 in 2024-02-10T08:18:55.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:54 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:53.544221+0000 mon.a (mon.0) 739 : cluster [DBG] osdmap e84: 8 total, 8 up, 8 in 2024-02-10T08:18:55.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:54.470592+0000 mgr.y (mgr.14505) 82 : cluster [DBG] pgmap v72: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:18:55.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:54.585796+0000 osd.0 (osd.0) 39 : cluster [DBG] 6.10 scrub starts 2024-02-10T08:18:55.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:54.588770+0000 osd.0 (osd.0) 40 : cluster [DBG] 6.10 scrub ok 2024-02-10T08:18:55.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:55.039089+0000 osd.3 (osd.3) 47 : cluster [DBG] 5.13 scrub starts 2024-02-10T08:18:55.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:55.041974+0000 osd.3 (osd.3) 48 : cluster [DBG] 5.13 scrub ok 2024-02-10T08:18:55.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:54.470592+0000 mgr.y (mgr.14505) 82 : cluster [DBG] pgmap v72: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:18:55.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:54.585796+0000 osd.0 (osd.0) 39 : cluster [DBG] 6.10 scrub starts 2024-02-10T08:18:55.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:54.588770+0000 osd.0 (osd.0) 40 : cluster [DBG] 6.10 scrub ok 2024-02-10T08:18:55.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:55.039089+0000 osd.3 (osd.3) 47 : cluster [DBG] 5.13 scrub starts 2024-02-10T08:18:55.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:55.041974+0000 osd.3 (osd.3) 48 : cluster [DBG] 5.13 scrub ok 2024-02-10T08:18:56.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:54.470592+0000 mgr.y (mgr.14505) 82 : cluster [DBG] pgmap v72: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:18:56.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:54.585796+0000 osd.0 (osd.0) 39 : cluster [DBG] 6.10 scrub starts 2024-02-10T08:18:56.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:54.588770+0000 osd.0 (osd.0) 40 : cluster [DBG] 6.10 scrub ok 2024-02-10T08:18:56.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:55.039089+0000 osd.3 (osd.3) 47 : cluster [DBG] 5.13 scrub starts 2024-02-10T08:18:56.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:55.041974+0000 osd.3 (osd.3) 48 : cluster [DBG] 5.13 scrub ok 2024-02-10T08:18:56.505 INFO:teuthology.orchestra.run.smithi018.stdout:184683593761 2024-02-10T08:18:56.789 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:18:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:18:56] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:18:56.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:56.052749+0000 osd.3 (osd.3) 49 : cluster [DBG] 6.c scrub starts 2024-02-10T08:18:56.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:56.053806+0000 osd.3 (osd.3) 50 : cluster [DBG] 6.c scrub ok 2024-02-10T08:18:56.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:18:56.504852+0000 mon.c (mon.2) 20 : audit [DBG] from='client.? 172.21.15.18:0/12877223' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-02-10T08:18:56.889 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:56.052749+0000 osd.3 (osd.3) 49 : cluster [DBG] 6.c scrub starts 2024-02-10T08:18:56.889 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:56.053806+0000 osd.3 (osd.3) 50 : cluster [DBG] 6.c scrub ok 2024-02-10T08:18:56.889 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:18:56.504852+0000 mon.c (mon.2) 20 : audit [DBG] from='client.? 172.21.15.18:0/12877223' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-02-10T08:18:56.889 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:56.052749+0000 osd.3 (osd.3) 49 : cluster [DBG] 6.c scrub starts 2024-02-10T08:18:56.890 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:56.053806+0000 osd.3 (osd.3) 50 : cluster [DBG] 6.c scrub ok 2024-02-10T08:18:56.890 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:18:56.504852+0000 mon.c (mon.2) 20 : audit [DBG] from='client.? 172.21.15.18:0/12877223' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-02-10T08:18:57.330 INFO:tasks.cephadm.ceph_manager.ceph:need seq 184683593756 got 184683593761 for osd.6 2024-02-10T08:18:57.330 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd last-stat-seq osd.7 2024-02-10T08:18:57.404 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:18:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:18:57] "GET /metrics HTTP/1.1" 200 172109 "" "Prometheus/2.33.4" 2024-02-10T08:18:57.612 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:18:57.789 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:18:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:18:57.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:56.470889+0000 mgr.y (mgr.14505) 83 : cluster [DBG] pgmap v73: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-10T08:18:57.864 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:56.470889+0000 mgr.y (mgr.14505) 83 : cluster [DBG] pgmap v73: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-10T08:18:57.865 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:56.470889+0000 mgr.y (mgr.14505) 83 : cluster [DBG] pgmap v73: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-10T08:18:58.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:18:57.537224+0000 mgr.y (mgr.14505) 84 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:18:58.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:18:57.537224+0000 mgr.y (mgr.14505) 84 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:18:59.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:18:57.537224+0000 mgr.y (mgr.14505) 84 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:18:59.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:18:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:18:58.471602+0000 mgr.y (mgr.14505) 85 : cluster [DBG] pgmap v74: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:18:59.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:18:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:18:58.471602+0000 mgr.y (mgr.14505) 85 : cluster [DBG] pgmap v74: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:18:59.781 INFO:teuthology.orchestra.run.smithi018.stdout:214748364829 2024-02-10T08:19:00.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:18:59 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:18:58.471602+0000 mgr.y (mgr.14505) 85 : cluster [DBG] pgmap v74: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:19:00.453 INFO:tasks.cephadm.ceph_manager.ceph:need seq 214748364824 got 214748364829 for osd.7 2024-02-10T08:19:00.453 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-02-10T08:19:00.453 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph pg dump --format=json 2024-02-10T08:19:00.730 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:19:00.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:18:59.780981+0000 mon.a (mon.0) 740 : audit [DBG] from='client.? 172.21.15.18:0/3974118094' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-02-10T08:19:00.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:18:59.780981+0000 mon.a (mon.0) 740 : audit [DBG] from='client.? 172.21.15.18:0/3974118094' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-02-10T08:19:01.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:18:59.780981+0000 mon.a (mon.0) 740 : audit [DBG] from='client.? 172.21.15.18:0/3974118094' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-02-10T08:19:01.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:00.449427+0000 osd.1 (osd.1) 47 : cluster [DBG] 4.4 scrub starts 2024-02-10T08:19:01.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:00.452882+0000 osd.1 (osd.1) 48 : cluster [DBG] 4.4 scrub ok 2024-02-10T08:19:01.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:00.472002+0000 mgr.y (mgr.14505) 86 : cluster [DBG] pgmap v75: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-10T08:19:01.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:01.072617+0000 osd.3 (osd.3) 51 : cluster [DBG] 6.1b scrub starts 2024-02-10T08:19:01.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:01.075882+0000 osd.3 (osd.3) 52 : cluster [DBG] 6.1b scrub ok 2024-02-10T08:19:01.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:00.449427+0000 osd.1 (osd.1) 47 : cluster [DBG] 4.4 scrub starts 2024-02-10T08:19:01.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:00.452882+0000 osd.1 (osd.1) 48 : cluster [DBG] 4.4 scrub ok 2024-02-10T08:19:01.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:00.472002+0000 mgr.y (mgr.14505) 86 : cluster [DBG] pgmap v75: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-10T08:19:01.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:01.072617+0000 osd.3 (osd.3) 51 : cluster [DBG] 6.1b scrub starts 2024-02-10T08:19:01.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:01.075882+0000 osd.3 (osd.3) 52 : cluster [DBG] 6.1b scrub ok 2024-02-10T08:19:02.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:00.449427+0000 osd.1 (osd.1) 47 : cluster [DBG] 4.4 scrub starts 2024-02-10T08:19:02.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:00.452882+0000 osd.1 (osd.1) 48 : cluster [DBG] 4.4 scrub ok 2024-02-10T08:19:02.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:00.472002+0000 mgr.y (mgr.14505) 86 : cluster [DBG] pgmap v75: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-10T08:19:02.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:01.072617+0000 osd.3 (osd.3) 51 : cluster [DBG] 6.1b scrub starts 2024-02-10T08:19:02.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:01.075882+0000 osd.3 (osd.3) 52 : cluster [DBG] 6.1b scrub ok 2024-02-10T08:19:02.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:02.027082+0000 osd.3 (osd.3) 53 : cluster [DBG] 6.11 scrub starts 2024-02-10T08:19:02.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:02.030082+0000 osd.3 (osd.3) 54 : cluster [DBG] 6.11 scrub ok 2024-02-10T08:19:02.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:02.027082+0000 osd.3 (osd.3) 53 : cluster [DBG] 6.11 scrub starts 2024-02-10T08:19:02.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:02.030082+0000 osd.3 (osd.3) 54 : cluster [DBG] 6.11 scrub ok 2024-02-10T08:19:02.919 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:19:02.922 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-02-10T08:19:03.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:02.027082+0000 osd.3 (osd.3) 53 : cluster [DBG] 6.11 scrub starts 2024-02-10T08:19:03.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:02.030082+0000 osd.3 (osd.3) 54 : cluster [DBG] 6.11 scrub ok 2024-02-10T08:19:03.738 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":76,"stamp":"2024-02-10T08:19:02.472157+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":5796,"num_objects":192,"num_object_clones":0,"num_object_copies":576,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":192,"num_whiteouts":0,"num_read":842,"num_read_kb":594,"num_write":428,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":488,"ondisk_log_size":488,"up":396,"acting":396,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":396,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":2381820,"kb_used_data":5052,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":747579396,"statfs":{"total":767960285184,"available":765521301504,"internally_reserved":0,"allocated":5173248,"data_stored":2370178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.931432"},"pg_stats":[{"pgid":"6.1b","version":"0'0","reported_seq":37,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:19:01.075963+0000","last_change":"2024-02-10T08:19:01.075963+0000","last_active":"2024-02-10T08:19:01.075963+0000","last_peered":"2024-02-10T08:19:01.075963+0000","last_clean":"2024-02-10T08:19:01.075963+0000","last_became_active":"2024-02-10T08:16:58.892091+0000","last_became_peered":"2024-02-10T08:16:58.892091+0000","last_unstale":"2024-02-10T08:19:01.075963+0000","last_undegraded":"2024-02-10T08:19:01.075963+0000","last_fullsized":"2024-02-10T08:19:01.075963+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:01.075886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:19:01.075886+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.819576+0000","last_change":"2024-02-10T08:18:09.941981+0000","last_active":"2024-02-10T08:18:52.819576+0000","last_peered":"2024-02-10T08:18:52.819576+0000","last_clean":"2024-02-10T08:18:52.819576+0000","last_became_active":"2024-02-10T08:16:56.858480+0000","last_became_peered":"2024-02-10T08:16:56.858480+0000","last_unstale":"2024-02-10T08:18:52.819576+0000","last_undegraded":"2024-02-10T08:18:52.819576+0000","last_fullsized":"2024-02-10T08:18:52.819576+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:09.941898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:09.941898+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":42,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.806395+0000","last_change":"2024-02-10T08:18:43.744973+0000","last_active":"2024-02-10T08:18:52.806395+0000","last_peered":"2024-02-10T08:18:52.806395+0000","last_clean":"2024-02-10T08:18:52.806395+0000","last_became_active":"2024-02-10T08:16:52.788363+0000","last_became_peered":"2024-02-10T08:16:52.788363+0000","last_unstale":"2024-02-10T08:18:52.806395+0000","last_undegraded":"2024-02-10T08:18:52.806395+0000","last_fullsized":"2024-02-10T08:18:52.806395+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:43.744900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:43.744900+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"62'15","reported_seq":66,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.542393+0000","last_change":"2024-02-10T08:18:08.051424+0000","last_active":"2024-02-10T08:18:52.542393+0000","last_peered":"2024-02-10T08:18:52.542393+0000","last_clean":"2024-02-10T08:18:52.542393+0000","last_became_active":"2024-02-10T08:16:54.849232+0000","last_became_peered":"2024-02-10T08:16:54.849232+0000","last_unstale":"2024-02-10T08:18:52.542393+0000","last_undegraded":"2024-02-10T08:18:52.542393+0000","last_fullsized":"2024-02-10T08:18:52.542393+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'15","last_scrub_stamp":"2024-02-10T08:18:08.051315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:08.051315+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.821154+0000","last_change":"2024-02-10T08:18:19.058387+0000","last_active":"2024-02-10T08:18:52.821154+0000","last_peered":"2024-02-10T08:18:52.821154+0000","last_clean":"2024-02-10T08:18:52.821154+0000","last_became_active":"2024-02-10T08:16:58.860693+0000","last_became_peered":"2024-02-10T08:16:58.860693+0000","last_unstale":"2024-02-10T08:18:52.821154+0000","last_undegraded":"2024-02-10T08:18:52.821154+0000","last_fullsized":"2024-02-10T08:18:52.821154+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:19.058317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:19.058317+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.819154+0000","last_change":"2024-02-10T08:18:31.136877+0000","last_active":"2024-02-10T08:18:52.819154+0000","last_peered":"2024-02-10T08:18:52.819154+0000","last_clean":"2024-02-10T08:18:52.819154+0000","last_became_active":"2024-02-10T08:16:56.863353+0000","last_became_peered":"2024-02-10T08:16:56.863353+0000","last_unstale":"2024-02-10T08:18:52.819154+0000","last_undegraded":"2024-02-10T08:18:52.819154+0000","last_fullsized":"2024-02-10T08:18:52.819154+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:31.136797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:31.136797+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":43,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.544773+0000","last_change":"2024-02-10T08:17:53.926192+0000","last_active":"2024-02-10T08:18:52.544773+0000","last_peered":"2024-02-10T08:18:52.544773+0000","last_clean":"2024-02-10T08:18:52.544773+0000","last_became_active":"2024-02-10T08:16:52.787183+0000","last_became_peered":"2024-02-10T08:16:52.787183+0000","last_unstale":"2024-02-10T08:18:52.544773+0000","last_undegraded":"2024-02-10T08:18:52.544773+0000","last_fullsized":"2024-02-10T08:18:52.544773+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:17:53.926120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:17:53.926120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"62'9","reported_seq":57,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.819862+0000","last_change":"2024-02-10T08:18:12.998301+0000","last_active":"2024-02-10T08:18:52.819862+0000","last_peered":"2024-02-10T08:18:52.819862+0000","last_clean":"2024-02-10T08:18:52.819862+0000","last_became_active":"2024-02-10T08:16:54.852200+0000","last_became_peered":"2024-02-10T08:16:54.852200+0000","last_unstale":"2024-02-10T08:18:52.819862+0000","last_undegraded":"2024-02-10T08:18:52.819862+0000","last_fullsized":"2024-02-10T08:18:52.819862+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'9","last_scrub_stamp":"2024-02-10T08:18:12.998167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:12.998167+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.821025+0000","last_change":"2024-02-10T08:18:51.370619+0000","last_active":"2024-02-10T08:18:52.821025+0000","last_peered":"2024-02-10T08:18:52.821025+0000","last_clean":"2024-02-10T08:18:52.821025+0000","last_became_active":"2024-02-10T08:16:58.867430+0000","last_became_peered":"2024-02-10T08:16:58.867430+0000","last_unstale":"2024-02-10T08:18:52.821025+0000","last_undegraded":"2024-02-10T08:18:52.821025+0000","last_fullsized":"2024-02-10T08:18:52.821025+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:51.370527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:51.370527+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.821961+0000","last_change":"2024-02-10T08:17:59.772854+0000","last_active":"2024-02-10T08:18:52.821961+0000","last_peered":"2024-02-10T08:18:52.821961+0000","last_clean":"2024-02-10T08:18:52.821961+0000","last_became_active":"2024-02-10T08:16:56.865529+0000","last_became_peered":"2024-02-10T08:16:56.865529+0000","last_unstale":"2024-02-10T08:18:52.821961+0000","last_undegraded":"2024-02-10T08:18:52.821961+0000","last_fullsized":"2024-02-10T08:18:52.821961+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:17:59.772766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:17:59.772766+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"55'1","reported_seq":49,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.822347+0000","last_change":"2024-02-10T08:18:33.095861+0000","last_active":"2024-02-10T08:18:52.822347+0000","last_peered":"2024-02-10T08:18:52.822347+0000","last_clean":"2024-02-10T08:18:52.822347+0000","last_became_active":"2024-02-10T08:16:52.790462+0000","last_became_peered":"2024-02-10T08:16:52.790462+0000","last_unstale":"2024-02-10T08:18:52.822347+0000","last_undegraded":"2024-02-10T08:18:52.822347+0000","last_fullsized":"2024-02-10T08:18:52.822347+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'1","last_scrub_stamp":"2024-02-10T08:18:33.095757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:33.095757+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"62'5","reported_seq":51,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.820627+0000","last_change":"2024-02-10T08:18:11.967605+0000","last_active":"2024-02-10T08:18:52.820627+0000","last_peered":"2024-02-10T08:18:52.820627+0000","last_clean":"2024-02-10T08:18:52.820627+0000","last_became_active":"2024-02-10T08:16:54.849450+0000","last_became_peered":"2024-02-10T08:16:54.849450+0000","last_unstale":"2024-02-10T08:18:52.820627+0000","last_undegraded":"2024-02-10T08:18:52.820627+0000","last_fullsized":"2024-02-10T08:18:52.820627+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'5","last_scrub_stamp":"2024-02-10T08:18:11.967507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:11.967507+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.805778+0000","last_change":"2024-02-10T08:18:15.691621+0000","last_active":"2024-02-10T08:18:52.805778+0000","last_peered":"2024-02-10T08:18:52.805778+0000","last_clean":"2024-02-10T08:18:52.805778+0000","last_became_active":"2024-02-10T08:16:58.860591+0000","last_became_peered":"2024-02-10T08:16:58.860591+0000","last_unstale":"2024-02-10T08:18:52.805778+0000","last_undegraded":"2024-02-10T08:18:52.805778+0000","last_fullsized":"2024-02-10T08:18:52.805778+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:15.691552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:15.691552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.820734+0000","last_change":"2024-02-10T08:18:09.324937+0000","last_active":"2024-02-10T08:18:52.820734+0000","last_peered":"2024-02-10T08:18:52.820734+0000","last_clean":"2024-02-10T08:18:52.820734+0000","last_became_active":"2024-02-10T08:16:56.864532+0000","last_became_peered":"2024-02-10T08:16:56.864532+0000","last_unstale":"2024-02-10T08:18:52.820734+0000","last_undegraded":"2024-02-10T08:18:52.820734+0000","last_fullsized":"2024-02-10T08:18:52.820734+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:09.324856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:09.324856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":42,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.822054+0000","last_change":"2024-02-10T08:18:28.028628+0000","last_active":"2024-02-10T08:18:52.822054+0000","last_peered":"2024-02-10T08:18:52.822054+0000","last_clean":"2024-02-10T08:18:52.822054+0000","last_became_active":"2024-02-10T08:16:52.787865+0000","last_became_peered":"2024-02-10T08:16:52.787865+0000","last_unstale":"2024-02-10T08:18:52.822054+0000","last_undegraded":"2024-02-10T08:18:52.822054+0000","last_fullsized":"2024-02-10T08:18:52.822054+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:28.028556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:28.028556+0000","last_clean_scrub_stamp":"2024-02-10T08:18:28.028556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"62'9","reported_seq":57,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.821248+0000","last_change":"2024-02-10T08:18:15.012767+0000","last_active":"2024-02-10T08:18:52.821248+0000","last_peered":"2024-02-10T08:18:52.821248+0000","last_clean":"2024-02-10T08:18:52.821248+0000","last_became_active":"2024-02-10T08:16:54.847486+0000","last_became_peered":"2024-02-10T08:16:54.847486+0000","last_unstale":"2024-02-10T08:18:52.821248+0000","last_undegraded":"2024-02-10T08:18:52.821248+0000","last_fullsized":"2024-02-10T08:18:52.821248+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'9","last_scrub_stamp":"2024-02-10T08:18:15.012657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:15.012657+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.544665+0000","last_change":"2024-02-10T08:18:52.045246+0000","last_active":"2024-02-10T08:18:52.544665+0000","last_peered":"2024-02-10T08:18:52.544665+0000","last_clean":"2024-02-10T08:18:52.544665+0000","last_became_active":"2024-02-10T08:16:58.891365+0000","last_became_peered":"2024-02-10T08:16:58.891365+0000","last_unstale":"2024-02-10T08:18:52.544665+0000","last_undegraded":"2024-02-10T08:18:52.544665+0000","last_fullsized":"2024-02-10T08:18:52.544665+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:52.045180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:52.045180+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.820021+0000","last_change":"2024-02-10T08:18:22.000876+0000","last_active":"2024-02-10T08:18:52.820021+0000","last_peered":"2024-02-10T08:18:52.820021+0000","last_clean":"2024-02-10T08:18:52.820021+0000","last_became_active":"2024-02-10T08:16:56.867217+0000","last_became_peered":"2024-02-10T08:16:56.867217+0000","last_unstale":"2024-02-10T08:18:52.820021+0000","last_undegraded":"2024-02-10T08:18:52.820021+0000","last_fullsized":"2024-02-10T08:18:52.820021+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:22.000811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:22.000811+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":43,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.542432+0000","last_change":"2024-02-10T08:18:14.058600+0000","last_active":"2024-02-10T08:18:52.542432+0000","last_peered":"2024-02-10T08:18:52.542432+0000","last_clean":"2024-02-10T08:18:52.542432+0000","last_became_active":"2024-02-10T08:16:52.785404+0000","last_became_peered":"2024-02-10T08:16:52.785404+0000","last_unstale":"2024-02-10T08:18:52.542432+0000","last_undegraded":"2024-02-10T08:18:52.542432+0000","last_fullsized":"2024-02-10T08:18:52.542432+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:14.058501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:14.058501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"74'17","reported_seq":69,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.544431+0000","last_change":"2024-02-10T08:18:02.949370+0000","last_active":"2024-02-10T08:18:52.544431+0000","last_peered":"2024-02-10T08:18:52.544431+0000","last_clean":"2024-02-10T08:18:52.544431+0000","last_became_active":"2024-02-10T08:16:54.848784+0000","last_became_peered":"2024-02-10T08:16:54.848784+0000","last_unstale":"2024-02-10T08:18:52.544431+0000","last_undegraded":"2024-02-10T08:18:52.544431+0000","last_fullsized":"2024-02-10T08:18:52.544431+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'17","last_scrub_stamp":"2024-02-10T08:18:02.949298+0000","last_deep_scrub":"74'17","last_deep_scrub_stamp":"2024-02-10T08:18:02.949298+0000","last_clean_scrub_stamp":"2024-02-10T08:18:02.949298+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.820435+0000","last_change":"2024-02-10T08:18:26.952584+0000","last_active":"2024-02-10T08:18:52.820435+0000","last_peered":"2024-02-10T08:18:52.820435+0000","last_clean":"2024-02-10T08:18:52.820435+0000","last_became_active":"2024-02-10T08:16:58.893364+0000","last_became_peered":"2024-02-10T08:16:58.893364+0000","last_unstale":"2024-02-10T08:18:52.820435+0000","last_undegraded":"2024-02-10T08:18:52.820435+0000","last_fullsized":"2024-02-10T08:18:52.820435+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:26.952496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:26.952496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.819638+0000","last_change":"2024-02-10T08:18:38.230334+0000","last_active":"2024-02-10T08:18:52.819638+0000","last_peered":"2024-02-10T08:18:52.819638+0000","last_clean":"2024-02-10T08:18:52.819638+0000","last_became_active":"2024-02-10T08:16:56.859752+0000","last_became_peered":"2024-02-10T08:16:56.859752+0000","last_unstale":"2024-02-10T08:18:52.819638+0000","last_undegraded":"2024-02-10T08:18:52.819638+0000","last_fullsized":"2024-02-10T08:18:52.819638+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:38.230210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:38.230210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":42,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.542826+0000","last_change":"2024-02-10T08:17:57.192687+0000","last_active":"2024-02-10T08:18:52.542826+0000","last_peered":"2024-02-10T08:18:52.542826+0000","last_clean":"2024-02-10T08:18:52.542826+0000","last_became_active":"2024-02-10T08:16:52.783261+0000","last_became_peered":"2024-02-10T08:16:52.783261+0000","last_unstale":"2024-02-10T08:18:52.542826+0000","last_undegraded":"2024-02-10T08:18:52.542826+0000","last_fullsized":"2024-02-10T08:18:52.542826+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:17:57.192581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:17:57.192581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1c","version":"62'15","reported_seq":66,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.545773+0000","last_change":"2024-02-10T08:18:13.740262+0000","last_active":"2024-02-10T08:18:52.545773+0000","last_peered":"2024-02-10T08:18:52.545773+0000","last_clean":"2024-02-10T08:18:52.545773+0000","last_became_active":"2024-02-10T08:16:54.849361+0000","last_became_peered":"2024-02-10T08:16:54.849361+0000","last_unstale":"2024-02-10T08:18:52.545773+0000","last_undegraded":"2024-02-10T08:18:52.545773+0000","last_fullsized":"2024-02-10T08:18:52.545773+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'15","last_scrub_stamp":"2024-02-10T08:18:13.740187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:13.740187+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.819411+0000","last_change":"2024-02-10T08:18:22.105101+0000","last_active":"2024-02-10T08:18:52.819411+0000","last_peered":"2024-02-10T08:18:52.819411+0000","last_clean":"2024-02-10T08:18:52.819411+0000","last_became_active":"2024-02-10T08:16:58.862893+0000","last_became_peered":"2024-02-10T08:16:58.862893+0000","last_unstale":"2024-02-10T08:18:52.819411+0000","last_undegraded":"2024-02-10T08:18:52.819411+0000","last_fullsized":"2024-02-10T08:18:52.819411+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:22.104988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:22.104988+0000","last_clean_scrub_stamp":"2024-02-10T08:18:22.104988+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.806445+0000","last_change":"2024-02-10T08:18:21.772134+0000","last_active":"2024-02-10T08:18:52.806445+0000","last_peered":"2024-02-10T08:18:52.806445+0000","last_clean":"2024-02-10T08:18:52.806445+0000","last_became_active":"2024-02-10T08:16:56.863348+0000","last_became_peered":"2024-02-10T08:16:56.863348+0000","last_unstale":"2024-02-10T08:18:52.806445+0000","last_undegraded":"2024-02-10T08:18:52.806445+0000","last_fullsized":"2024-02-10T08:18:52.806445+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:21.771969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:21.771969+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":43,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.542020+0000","last_change":"2024-02-10T08:18:38.075002+0000","last_active":"2024-02-10T08:18:52.542020+0000","last_peered":"2024-02-10T08:18:52.542020+0000","last_clean":"2024-02-10T08:18:52.542020+0000","last_became_active":"2024-02-10T08:16:52.785743+0000","last_became_peered":"2024-02-10T08:16:52.785743+0000","last_unstale":"2024-02-10T08:18:52.542020+0000","last_undegraded":"2024-02-10T08:18:52.542020+0000","last_fullsized":"2024-02-10T08:18:52.542020+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:38.074885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:38.074885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"62'11","reported_seq":59,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.543195+0000","last_change":"2024-02-10T08:18:22.373044+0000","last_active":"2024-02-10T08:18:52.543195+0000","last_peered":"2024-02-10T08:18:52.543195+0000","last_clean":"2024-02-10T08:18:52.543195+0000","last_became_active":"2024-02-10T08:16:54.852665+0000","last_became_peered":"2024-02-10T08:16:54.852665+0000","last_unstale":"2024-02-10T08:18:52.543195+0000","last_undegraded":"2024-02-10T08:18:52.543195+0000","last_fullsized":"2024-02-10T08:18:52.543195+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'11","last_scrub_stamp":"2024-02-10T08:18:22.372958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:22.372958+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"62'1","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.822446+0000","last_change":"2024-02-10T08:18:13.819515+0000","last_active":"2024-02-10T08:18:52.822446+0000","last_peered":"2024-02-10T08:18:52.822446+0000","last_clean":"2024-02-10T08:18:52.822446+0000","last_became_active":"2024-02-10T08:16:58.859047+0000","last_became_peered":"2024-02-10T08:16:58.859047+0000","last_unstale":"2024-02-10T08:18:52.822446+0000","last_undegraded":"2024-02-10T08:18:52.822446+0000","last_fullsized":"2024-02-10T08:18:52.822446+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'1","last_scrub_stamp":"2024-02-10T08:18:13.819405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:13.819405+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"82'9","reported_seq":79,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:55.921852+0000","last_change":"2024-02-10T08:18:36.323299+0000","last_active":"2024-02-10T08:18:55.921852+0000","last_peered":"2024-02-10T08:18:55.921852+0000","last_clean":"2024-02-10T08:18:55.921852+0000","last_became_active":"2024-02-10T08:16:56.854294+0000","last_became_peered":"2024-02-10T08:16:56.854294+0000","last_unstale":"2024-02-10T08:18:55.921852+0000","last_undegraded":"2024-02-10T08:18:55.921852+0000","last_fullsized":"2024-02-10T08:18:55.921852+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'9","last_scrub_stamp":"2024-02-10T08:18:36.323217+0000","last_deep_scrub":"82'9","last_deep_scrub_stamp":"2024-02-10T08:18:36.323217+0000","last_clean_scrub_stamp":"2024-02-10T08:18:36.323217+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":42,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.819520+0000","last_change":"2024-02-10T08:18:30.422885+0000","last_active":"2024-02-10T08:18:52.819520+0000","last_peered":"2024-02-10T08:18:52.819520+0000","last_clean":"2024-02-10T08:18:52.819520+0000","last_became_active":"2024-02-10T08:16:52.788543+0000","last_became_peered":"2024-02-10T08:16:52.788543+0000","last_unstale":"2024-02-10T08:18:52.819520+0000","last_undegraded":"2024-02-10T08:18:52.819520+0000","last_fullsized":"2024-02-10T08:18:52.819520+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:30.422800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:30.422800+0000","last_clean_scrub_stamp":"2024-02-10T08:18:30.422800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"74'15","reported_seq":60,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.806401+0000","last_change":"2024-02-10T08:17:57.637408+0000","last_active":"2024-02-10T08:18:52.806401+0000","last_peered":"2024-02-10T08:18:52.806401+0000","last_clean":"2024-02-10T08:18:52.806401+0000","last_became_active":"2024-02-10T08:16:55.204738+0000","last_became_peered":"2024-02-10T08:16:55.204738+0000","last_unstale":"2024-02-10T08:18:52.806401+0000","last_undegraded":"2024-02-10T08:18:52.806401+0000","last_fullsized":"2024-02-10T08:18:52.806401+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'15","last_scrub_stamp":"2024-02-10T08:17:57.637346+0000","last_deep_scrub":"74'15","last_deep_scrub_stamp":"2024-02-10T08:17:57.637346+0000","last_clean_scrub_stamp":"2024-02-10T08:17:57.637346+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.542662+0000","last_change":"2024-02-10T08:18:28.180766+0000","last_active":"2024-02-10T08:18:52.542662+0000","last_peered":"2024-02-10T08:18:52.542662+0000","last_clean":"2024-02-10T08:18:52.542662+0000","last_became_active":"2024-02-10T08:16:58.892622+0000","last_became_peered":"2024-02-10T08:16:58.892622+0000","last_unstale":"2024-02-10T08:18:52.542662+0000","last_undegraded":"2024-02-10T08:18:52.542662+0000","last_fullsized":"2024-02-10T08:18:52.542662+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:28.180637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:28.180637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.821002+0000","last_change":"2024-02-10T08:18:01.783832+0000","last_active":"2024-02-10T08:18:52.821002+0000","last_peered":"2024-02-10T08:18:52.821002+0000","last_clean":"2024-02-10T08:18:52.821002+0000","last_became_active":"2024-02-10T08:16:56.860207+0000","last_became_peered":"2024-02-10T08:16:56.860207+0000","last_unstale":"2024-02-10T08:18:52.821002+0000","last_undegraded":"2024-02-10T08:18:52.821002+0000","last_fullsized":"2024-02-10T08:18:52.821002+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:01.783750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:01.783750+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":42,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.543429+0000","last_change":"2024-02-10T08:18:12.262783+0000","last_active":"2024-02-10T08:18:52.543429+0000","last_peered":"2024-02-10T08:18:52.543429+0000","last_clean":"2024-02-10T08:18:52.543429+0000","last_became_active":"2024-02-10T08:16:52.788629+0000","last_became_peered":"2024-02-10T08:16:52.788629+0000","last_unstale":"2024-02-10T08:18:52.543429+0000","last_undegraded":"2024-02-10T08:18:52.543429+0000","last_fullsized":"2024-02-10T08:18:52.543429+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:12.262707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:12.262707+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"62'11","reported_seq":60,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.542333+0000","last_change":"2024-02-10T08:18:25.169653+0000","last_active":"2024-02-10T08:18:52.542333+0000","last_peered":"2024-02-10T08:18:52.542333+0000","last_clean":"2024-02-10T08:18:52.542333+0000","last_became_active":"2024-02-10T08:16:55.204751+0000","last_became_peered":"2024-02-10T08:16:55.204751+0000","last_unstale":"2024-02-10T08:18:52.542333+0000","last_undegraded":"2024-02-10T08:18:52.542333+0000","last_fullsized":"2024-02-10T08:18:52.542333+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'11","last_scrub_stamp":"2024-02-10T08:18:25.169566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:25.169566+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.821850+0000","last_change":"2024-02-10T08:18:12.778101+0000","last_active":"2024-02-10T08:18:52.821850+0000","last_peered":"2024-02-10T08:18:52.821850+0000","last_clean":"2024-02-10T08:18:52.821850+0000","last_became_active":"2024-02-10T08:16:58.859979+0000","last_became_peered":"2024-02-10T08:16:58.859979+0000","last_unstale":"2024-02-10T08:18:52.821850+0000","last_undegraded":"2024-02-10T08:18:52.821850+0000","last_fullsized":"2024-02-10T08:18:52.821850+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:12.778021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:12.778021+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.542510+0000","last_change":"2024-02-10T08:18:34.381405+0000","last_active":"2024-02-10T08:18:52.542510+0000","last_peered":"2024-02-10T08:18:52.542510+0000","last_clean":"2024-02-10T08:18:52.542510+0000","last_became_active":"2024-02-10T08:16:56.859540+0000","last_became_peered":"2024-02-10T08:16:56.859540+0000","last_unstale":"2024-02-10T08:18:52.542510+0000","last_undegraded":"2024-02-10T08:18:52.542510+0000","last_fullsized":"2024-02-10T08:18:52.542510+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:34.381329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:34.381329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":42,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.820536+0000","last_change":"2024-02-10T08:18:05.347110+0000","last_active":"2024-02-10T08:18:52.820536+0000","last_peered":"2024-02-10T08:18:52.820536+0000","last_clean":"2024-02-10T08:18:52.820536+0000","last_became_active":"2024-02-10T08:16:52.788704+0000","last_became_peered":"2024-02-10T08:16:52.788704+0000","last_unstale":"2024-02-10T08:18:52.820536+0000","last_undegraded":"2024-02-10T08:18:52.820536+0000","last_fullsized":"2024-02-10T08:18:52.820536+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:05.347009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:05.347009+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"62'4","reported_seq":47,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.541991+0000","last_change":"2024-02-10T08:18:50.134758+0000","last_active":"2024-02-10T08:18:52.541991+0000","last_peered":"2024-02-10T08:18:52.541991+0000","last_clean":"2024-02-10T08:18:52.541991+0000","last_became_active":"2024-02-10T08:16:54.852959+0000","last_became_peered":"2024-02-10T08:16:54.852959+0000","last_unstale":"2024-02-10T08:18:52.541991+0000","last_undegraded":"2024-02-10T08:18:52.541991+0000","last_fullsized":"2024-02-10T08:18:52.541991+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'4","last_scrub_stamp":"2024-02-10T08:18:50.134690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:50.134690+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:19:02.030164+0000","last_change":"2024-02-10T08:19:02.030164+0000","last_active":"2024-02-10T08:19:02.030164+0000","last_peered":"2024-02-10T08:19:02.030164+0000","last_clean":"2024-02-10T08:19:02.030164+0000","last_became_active":"2024-02-10T08:16:58.864301+0000","last_became_peered":"2024-02-10T08:16:58.864301+0000","last_unstale":"2024-02-10T08:19:02.030164+0000","last_undegraded":"2024-02-10T08:19:02.030164+0000","last_fullsized":"2024-02-10T08:19:02.030164+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:02.030086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:19:02.030086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.819463+0000","last_change":"2024-02-10T08:18:30.157336+0000","last_active":"2024-02-10T08:18:52.819463+0000","last_peered":"2024-02-10T08:18:52.819463+0000","last_clean":"2024-02-10T08:18:52.819463+0000","last_became_active":"2024-02-10T08:16:56.860953+0000","last_became_peered":"2024-02-10T08:16:56.860953+0000","last_unstale":"2024-02-10T08:18:52.819463+0000","last_undegraded":"2024-02-10T08:18:52.819463+0000","last_fullsized":"2024-02-10T08:18:52.819463+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:30.157268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:30.157268+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":43,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.819560+0000","last_change":"2024-02-10T08:18:21.134912+0000","last_active":"2024-02-10T08:18:52.819560+0000","last_peered":"2024-02-10T08:18:52.819560+0000","last_clean":"2024-02-10T08:18:52.819560+0000","last_became_active":"2024-02-10T08:16:52.786400+0000","last_became_peered":"2024-02-10T08:16:52.786400+0000","last_unstale":"2024-02-10T08:18:52.819560+0000","last_undegraded":"2024-02-10T08:18:52.819560+0000","last_fullsized":"2024-02-10T08:18:52.819560+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:21.134826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:21.134826+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"62'11","reported_seq":81,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.820174+0000","last_change":"2024-02-10T08:18:18.168451+0000","last_active":"2024-02-10T08:18:52.820174+0000","last_peered":"2024-02-10T08:18:52.820174+0000","last_clean":"2024-02-10T08:18:52.820174+0000","last_became_active":"2024-02-10T08:18:18.162983+0000","last_became_peered":"2024-02-10T08:18:18.162983+0000","last_unstale":"2024-02-10T08:18:52.820174+0000","last_undegraded":"2024-02-10T08:18:52.820174+0000","last_fullsized":"2024-02-10T08:18:52.820174+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'11","last_scrub_stamp":"2024-02-10T08:18:17.029517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:17.029517+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":36,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:54.588850+0000","last_change":"2024-02-10T08:18:54.588850+0000","last_active":"2024-02-10T08:18:54.588850+0000","last_peered":"2024-02-10T08:18:54.588850+0000","last_clean":"2024-02-10T08:18:54.588850+0000","last_became_active":"2024-02-10T08:16:58.861031+0000","last_became_peered":"2024-02-10T08:16:58.861031+0000","last_unstale":"2024-02-10T08:18:54.588850+0000","last_undegraded":"2024-02-10T08:18:54.588850+0000","last_fullsized":"2024-02-10T08:18:54.588850+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:54.588775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:54.588775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:55.042056+0000","last_change":"2024-02-10T08:18:55.042056+0000","last_active":"2024-02-10T08:18:55.042056+0000","last_peered":"2024-02-10T08:18:55.042056+0000","last_clean":"2024-02-10T08:18:55.042056+0000","last_became_active":"2024-02-10T08:16:56.862136+0000","last_became_peered":"2024-02-10T08:16:56.862136+0000","last_unstale":"2024-02-10T08:18:55.042056+0000","last_undegraded":"2024-02-10T08:18:55.042056+0000","last_fullsized":"2024-02-10T08:18:55.042056+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:55.041978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:55.041978+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":42,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.543056+0000","last_change":"2024-02-10T08:17:58.226189+0000","last_active":"2024-02-10T08:18:52.543056+0000","last_peered":"2024-02-10T08:18:52.543056+0000","last_clean":"2024-02-10T08:18:52.543056+0000","last_became_active":"2024-02-10T08:16:52.786213+0000","last_became_peered":"2024-02-10T08:16:52.786213+0000","last_unstale":"2024-02-10T08:18:52.543056+0000","last_undegraded":"2024-02-10T08:18:52.543056+0000","last_fullsized":"2024-02-10T08:18:52.543056+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:17:58.226110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:17:58.226110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"62'9","reported_seq":57,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.819370+0000","last_change":"2024-02-10T08:18:03.050657+0000","last_active":"2024-02-10T08:18:52.819370+0000","last_peered":"2024-02-10T08:18:52.819370+0000","last_clean":"2024-02-10T08:18:52.819370+0000","last_became_active":"2024-02-10T08:16:54.851971+0000","last_became_peered":"2024-02-10T08:16:54.851971+0000","last_unstale":"2024-02-10T08:18:52.819370+0000","last_undegraded":"2024-02-10T08:18:52.819370+0000","last_fullsized":"2024-02-10T08:18:52.819370+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'9","last_scrub_stamp":"2024-02-10T08:18:03.050481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:03.050481+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.822546+0000","last_change":"2024-02-10T08:18:22.955891+0000","last_active":"2024-02-10T08:18:52.822546+0000","last_peered":"2024-02-10T08:18:52.822546+0000","last_clean":"2024-02-10T08:18:52.822546+0000","last_became_active":"2024-02-10T08:16:58.858961+0000","last_became_peered":"2024-02-10T08:16:58.858961+0000","last_unstale":"2024-02-10T08:18:52.822546+0000","last_undegraded":"2024-02-10T08:18:52.822546+0000","last_fullsized":"2024-02-10T08:18:52.822546+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:22.955823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:22.955823+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"62'8","reported_seq":73,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:55.921642+0000","last_change":"2024-02-10T08:18:23.120983+0000","last_active":"2024-02-10T08:18:55.921642+0000","last_peered":"2024-02-10T08:18:55.921642+0000","last_clean":"2024-02-10T08:18:55.921642+0000","last_became_active":"2024-02-10T08:16:56.854151+0000","last_became_peered":"2024-02-10T08:16:56.854151+0000","last_unstale":"2024-02-10T08:18:55.921642+0000","last_undegraded":"2024-02-10T08:18:55.921642+0000","last_fullsized":"2024-02-10T08:18:55.921642+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'8","last_scrub_stamp":"2024-02-10T08:18:23.120909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:23.120909+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":42,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.805398+0000","last_change":"2024-02-10T08:17:58.590022+0000","last_active":"2024-02-10T08:18:52.805398+0000","last_peered":"2024-02-10T08:18:52.805398+0000","last_clean":"2024-02-10T08:18:52.805398+0000","last_became_active":"2024-02-10T08:16:52.786492+0000","last_became_peered":"2024-02-10T08:16:52.786492+0000","last_unstale":"2024-02-10T08:18:52.805398+0000","last_undegraded":"2024-02-10T08:18:52.805398+0000","last_fullsized":"2024-02-10T08:18:52.805398+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:17:58.589941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:17:58.589941+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"62'9","reported_seq":56,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.819913+0000","last_change":"2024-02-10T08:18:48.370939+0000","last_active":"2024-02-10T08:18:52.819913+0000","last_peered":"2024-02-10T08:18:52.819913+0000","last_clean":"2024-02-10T08:18:52.819913+0000","last_became_active":"2024-02-10T08:16:55.204734+0000","last_became_peered":"2024-02-10T08:16:55.204734+0000","last_unstale":"2024-02-10T08:18:52.819913+0000","last_undegraded":"2024-02-10T08:18:52.819913+0000","last_fullsized":"2024-02-10T08:18:52.819913+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'9","last_scrub_stamp":"2024-02-10T08:18:48.370832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:48.370832+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.806266+0000","last_change":"2024-02-10T08:18:05.663042+0000","last_active":"2024-02-10T08:18:52.806266+0000","last_peered":"2024-02-10T08:18:52.806266+0000","last_clean":"2024-02-10T08:18:52.806266+0000","last_became_active":"2024-02-10T08:16:58.869673+0000","last_became_peered":"2024-02-10T08:16:58.869673+0000","last_unstale":"2024-02-10T08:18:52.806266+0000","last_undegraded":"2024-02-10T08:18:52.806266+0000","last_fullsized":"2024-02-10T08:18:52.806266+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:05.662947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:05.662947+0000","last_clean_scrub_stamp":"2024-02-10T08:18:05.662947+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"62'8","reported_seq":72,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:55.921839+0000","last_change":"2024-02-10T08:18:23.419433+0000","last_active":"2024-02-10T08:18:55.921839+0000","last_peered":"2024-02-10T08:18:55.921839+0000","last_clean":"2024-02-10T08:18:55.921839+0000","last_became_active":"2024-02-10T08:16:56.864587+0000","last_became_peered":"2024-02-10T08:16:56.864587+0000","last_unstale":"2024-02-10T08:18:55.921839+0000","last_undegraded":"2024-02-10T08:18:55.921839+0000","last_fullsized":"2024-02-10T08:18:55.921839+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'8","last_scrub_stamp":"2024-02-10T08:18:23.419353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:23.419353+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":42,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.819274+0000","last_change":"2024-02-10T08:18:34.327085+0000","last_active":"2024-02-10T08:18:52.819274+0000","last_peered":"2024-02-10T08:18:52.819274+0000","last_clean":"2024-02-10T08:18:52.819274+0000","last_became_active":"2024-02-10T08:16:52.789834+0000","last_became_peered":"2024-02-10T08:16:52.789834+0000","last_unstale":"2024-02-10T08:18:52.819274+0000","last_undegraded":"2024-02-10T08:18:52.819274+0000","last_fullsized":"2024-02-10T08:18:52.819274+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:34.326987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:34.326987+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"62'10","reported_seq":56,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.544257+0000","last_change":"2024-02-10T08:17:57.019329+0000","last_active":"2024-02-10T08:18:52.544257+0000","last_peered":"2024-02-10T08:18:52.544257+0000","last_clean":"2024-02-10T08:18:52.544257+0000","last_became_active":"2024-02-10T08:16:55.204789+0000","last_became_peered":"2024-02-10T08:16:55.204789+0000","last_unstale":"2024-02-10T08:18:52.544257+0000","last_undegraded":"2024-02-10T08:18:52.544257+0000","last_fullsized":"2024-02-10T08:18:52.544257+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'10","last_scrub_stamp":"2024-02-10T08:17:57.019263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:17:57.019263+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.822502+0000","last_change":"2024-02-10T08:18:22.944672+0000","last_active":"2024-02-10T08:18:52.822502+0000","last_peered":"2024-02-10T08:18:52.822502+0000","last_clean":"2024-02-10T08:18:52.822502+0000","last_became_active":"2024-02-10T08:16:58.893128+0000","last_became_peered":"2024-02-10T08:16:58.893128+0000","last_unstale":"2024-02-10T08:18:52.822502+0000","last_undegraded":"2024-02-10T08:18:52.822502+0000","last_fullsized":"2024-02-10T08:18:52.822502+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:22.944593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:22.944593+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.820854+0000","last_change":"2024-02-10T08:18:49.369603+0000","last_active":"2024-02-10T08:18:52.820854+0000","last_peered":"2024-02-10T08:18:52.820854+0000","last_clean":"2024-02-10T08:18:52.820854+0000","last_became_active":"2024-02-10T08:16:56.863948+0000","last_became_peered":"2024-02-10T08:16:56.863948+0000","last_unstale":"2024-02-10T08:18:52.820854+0000","last_undegraded":"2024-02-10T08:18:52.820854+0000","last_fullsized":"2024-02-10T08:18:52.820854+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:49.369500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:49.369500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":42,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.542536+0000","last_change":"2024-02-10T08:18:08.233178+0000","last_active":"2024-02-10T08:18:52.542536+0000","last_peered":"2024-02-10T08:18:52.542536+0000","last_clean":"2024-02-10T08:18:52.542536+0000","last_became_active":"2024-02-10T08:16:52.782434+0000","last_became_peered":"2024-02-10T08:16:52.782434+0000","last_unstale":"2024-02-10T08:18:52.542536+0000","last_undegraded":"2024-02-10T08:18:52.542536+0000","last_fullsized":"2024-02-10T08:18:52.542536+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:08.233096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:08.233096+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"62'6","reported_seq":50,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.544576+0000","last_change":"2024-02-10T08:18:42.100646+0000","last_active":"2024-02-10T08:18:52.544576+0000","last_peered":"2024-02-10T08:18:52.544576+0000","last_clean":"2024-02-10T08:18:52.544576+0000","last_became_active":"2024-02-10T08:16:55.203401+0000","last_became_peered":"2024-02-10T08:16:55.203401+0000","last_unstale":"2024-02-10T08:18:52.544576+0000","last_undegraded":"2024-02-10T08:18:52.544576+0000","last_fullsized":"2024-02-10T08:18:52.544576+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'6","last_scrub_stamp":"2024-02-10T08:18:42.100550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:42.100550+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.545487+0000","last_change":"2024-02-10T08:18:10.716849+0000","last_active":"2024-02-10T08:18:52.545487+0000","last_peered":"2024-02-10T08:18:52.545487+0000","last_clean":"2024-02-10T08:18:52.545487+0000","last_became_active":"2024-02-10T08:16:58.857790+0000","last_became_peered":"2024-02-10T08:16:58.857790+0000","last_unstale":"2024-02-10T08:18:52.545487+0000","last_undegraded":"2024-02-10T08:18:52.545487+0000","last_fullsized":"2024-02-10T08:18:52.545487+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:10.716763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:10.716763+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.544740+0000","last_change":"2024-02-10T08:18:22.074334+0000","last_active":"2024-02-10T08:18:52.544740+0000","last_peered":"2024-02-10T08:18:52.544740+0000","last_clean":"2024-02-10T08:18:52.544740+0000","last_became_active":"2024-02-10T08:16:56.860904+0000","last_became_peered":"2024-02-10T08:16:56.860904+0000","last_unstale":"2024-02-10T08:18:52.544740+0000","last_undegraded":"2024-02-10T08:18:52.544740+0000","last_fullsized":"2024-02-10T08:18:52.544740+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:22.074268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:22.074268+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"55'1","reported_seq":49,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.544297+0000","last_change":"2024-02-10T08:18:03.695320+0000","last_active":"2024-02-10T08:18:52.544297+0000","last_peered":"2024-02-10T08:18:52.544297+0000","last_clean":"2024-02-10T08:18:52.544297+0000","last_became_active":"2024-02-10T08:16:52.782734+0000","last_became_peered":"2024-02-10T08:16:52.782734+0000","last_unstale":"2024-02-10T08:18:52.544297+0000","last_undegraded":"2024-02-10T08:18:52.544297+0000","last_fullsized":"2024-02-10T08:18:52.544297+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'1","last_scrub_stamp":"2024-02-10T08:18:03.695203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:03.695203+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"62'9","reported_seq":56,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.806370+0000","last_change":"2024-02-10T08:18:09.641466+0000","last_active":"2024-02-10T08:18:52.806370+0000","last_peered":"2024-02-10T08:18:52.806370+0000","last_clean":"2024-02-10T08:18:52.806370+0000","last_became_active":"2024-02-10T08:16:55.204727+0000","last_became_peered":"2024-02-10T08:16:55.204727+0000","last_unstale":"2024-02-10T08:18:52.806370+0000","last_undegraded":"2024-02-10T08:18:52.806370+0000","last_fullsized":"2024-02-10T08:18:52.806370+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'9","last_scrub_stamp":"2024-02-10T08:18:09.641378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:09.641378+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.542587+0000","last_change":"2024-02-10T08:18:32.027821+0000","last_active":"2024-02-10T08:18:52.542587+0000","last_peered":"2024-02-10T08:18:52.542587+0000","last_clean":"2024-02-10T08:18:52.542587+0000","last_became_active":"2024-02-10T08:16:58.868848+0000","last_became_peered":"2024-02-10T08:16:58.868848+0000","last_unstale":"2024-02-10T08:18:52.542587+0000","last_undegraded":"2024-02-10T08:18:52.542587+0000","last_fullsized":"2024-02-10T08:18:52.542587+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:32.027720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:32.027720+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"55'2","reported_seq":56,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.822372+0000","last_change":"2024-02-10T08:18:03.916402+0000","last_active":"2024-02-10T08:18:52.822372+0000","last_peered":"2024-02-10T08:18:52.822372+0000","last_clean":"2024-02-10T08:18:52.822372+0000","last_became_active":"2024-02-10T08:16:52.789545+0000","last_became_peered":"2024-02-10T08:16:52.789545+0000","last_unstale":"2024-02-10T08:18:52.822372+0000","last_undegraded":"2024-02-10T08:18:52.822372+0000","last_fullsized":"2024-02-10T08:18:52.822372+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'2","last_scrub_stamp":"2024-02-10T08:18:03.916322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:03.916322+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"82'17","reported_seq":69,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.819731+0000","last_change":"2024-02-10T08:18:21.015975+0000","last_active":"2024-02-10T08:18:52.819731+0000","last_peered":"2024-02-10T08:18:52.819731+0000","last_clean":"2024-02-10T08:18:52.819731+0000","last_became_active":"2024-02-10T08:16:54.848324+0000","last_became_peered":"2024-02-10T08:16:54.848324+0000","last_unstale":"2024-02-10T08:18:52.819731+0000","last_undegraded":"2024-02-10T08:18:52.819731+0000","last_fullsized":"2024-02-10T08:18:52.819731+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'17","last_scrub_stamp":"2024-02-10T08:18:21.015873+0000","last_deep_scrub":"82'17","last_deep_scrub_stamp":"2024-02-10T08:18:21.015873+0000","last_clean_scrub_stamp":"2024-02-10T08:18:21.015873+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.545068+0000","last_change":"2024-02-10T08:17:59.810321+0000","last_active":"2024-02-10T08:18:52.545068+0000","last_peered":"2024-02-10T08:18:52.545068+0000","last_clean":"2024-02-10T08:18:52.545068+0000","last_became_active":"2024-02-10T08:16:56.860850+0000","last_became_peered":"2024-02-10T08:16:56.860850+0000","last_unstale":"2024-02-10T08:18:52.545068+0000","last_undegraded":"2024-02-10T08:18:52.545068+0000","last_fullsized":"2024-02-10T08:18:52.545068+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:17:59.810251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:17:59.810251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.805544+0000","last_change":"2024-02-10T08:18:01.698201+0000","last_active":"2024-02-10T08:18:52.805544+0000","last_peered":"2024-02-10T08:18:52.805544+0000","last_clean":"2024-02-10T08:18:52.805544+0000","last_became_active":"2024-02-10T08:16:58.864957+0000","last_became_peered":"2024-02-10T08:16:58.864957+0000","last_unstale":"2024-02-10T08:18:52.805544+0000","last_undegraded":"2024-02-10T08:18:52.805544+0000","last_fullsized":"2024-02-10T08:18:52.805544+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:01.698093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:01.698093+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":43,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.819485+0000","last_change":"2024-02-10T08:18:36.311616+0000","last_active":"2024-02-10T08:18:52.819485+0000","last_peered":"2024-02-10T08:18:52.819485+0000","last_clean":"2024-02-10T08:18:52.819485+0000","last_became_active":"2024-02-10T08:16:52.789354+0000","last_became_peered":"2024-02-10T08:16:52.789354+0000","last_unstale":"2024-02-10T08:18:52.819485+0000","last_undegraded":"2024-02-10T08:18:52.819485+0000","last_fullsized":"2024-02-10T08:18:52.819485+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:36.311445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:36.311445+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"62'10","reported_seq":56,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.819418+0000","last_change":"2024-02-10T08:18:26.189282+0000","last_active":"2024-02-10T08:18:52.819418+0000","last_peered":"2024-02-10T08:18:52.819418+0000","last_clean":"2024-02-10T08:18:52.819418+0000","last_became_active":"2024-02-10T08:16:54.851420+0000","last_became_peered":"2024-02-10T08:16:54.851420+0000","last_unstale":"2024-02-10T08:18:52.819418+0000","last_undegraded":"2024-02-10T08:18:52.819418+0000","last_fullsized":"2024-02-10T08:18:52.819418+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'10","last_scrub_stamp":"2024-02-10T08:18:26.189127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:26.189127+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"62'8","reported_seq":72,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:55.921523+0000","last_change":"2024-02-10T08:18:35.727254+0000","last_active":"2024-02-10T08:18:55.921523+0000","last_peered":"2024-02-10T08:18:55.921523+0000","last_clean":"2024-02-10T08:18:55.921523+0000","last_became_active":"2024-02-10T08:16:56.862677+0000","last_became_peered":"2024-02-10T08:16:56.862677+0000","last_unstale":"2024-02-10T08:18:55.921523+0000","last_undegraded":"2024-02-10T08:18:55.921523+0000","last_fullsized":"2024-02-10T08:18:55.921523+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'8","last_scrub_stamp":"2024-02-10T08:18:35.727104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:35.727104+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.544859+0000","last_change":"2024-02-10T08:18:47.116797+0000","last_active":"2024-02-10T08:18:52.544859+0000","last_peered":"2024-02-10T08:18:52.544859+0000","last_clean":"2024-02-10T08:18:52.544859+0000","last_became_active":"2024-02-10T08:16:58.868746+0000","last_became_peered":"2024-02-10T08:16:58.868746+0000","last_unstale":"2024-02-10T08:18:52.544859+0000","last_undegraded":"2024-02-10T08:18:52.544859+0000","last_fullsized":"2024-02-10T08:18:52.544859+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:47.116727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:47.116727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":42,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.819148+0000","last_change":"2024-02-10T08:18:40.357832+0000","last_active":"2024-02-10T08:18:52.819148+0000","last_peered":"2024-02-10T08:18:52.819148+0000","last_clean":"2024-02-10T08:18:52.819148+0000","last_became_active":"2024-02-10T08:16:52.791027+0000","last_became_peered":"2024-02-10T08:16:52.791027+0000","last_unstale":"2024-02-10T08:18:52.819148+0000","last_undegraded":"2024-02-10T08:18:52.819148+0000","last_fullsized":"2024-02-10T08:18:52.819148+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:40.357758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:40.357758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"62'28","reported_seq":120,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:19:00.452998+0000","last_change":"2024-02-10T08:19:00.452971+0000","last_active":"2024-02-10T08:19:00.452998+0000","last_peered":"2024-02-10T08:19:00.452998+0000","last_clean":"2024-02-10T08:19:00.452998+0000","last_became_active":"2024-02-10T08:16:54.856000+0000","last_became_peered":"2024-02-10T08:16:54.856000+0000","last_unstale":"2024-02-10T08:19:00.452998+0000","last_undegraded":"2024-02-10T08:19:00.452998+0000","last_fullsized":"2024-02-10T08:19:00.452998+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'28","last_scrub_stamp":"2024-02-10T08:19:00.452887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:19:00.452887+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":48,"num_read_kb":33,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.806317+0000","last_change":"2024-02-10T08:18:51.533191+0000","last_active":"2024-02-10T08:18:52.806317+0000","last_peered":"2024-02-10T08:18:52.806317+0000","last_clean":"2024-02-10T08:18:52.806317+0000","last_became_active":"2024-02-10T08:16:56.864887+0000","last_became_peered":"2024-02-10T08:16:56.864887+0000","last_unstale":"2024-02-10T08:18:52.806317+0000","last_undegraded":"2024-02-10T08:18:52.806317+0000","last_fullsized":"2024-02-10T08:18:52.806317+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:51.533128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:51.533128+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.822656+0000","last_change":"2024-02-10T08:18:11.750615+0000","last_active":"2024-02-10T08:18:52.822656+0000","last_peered":"2024-02-10T08:18:52.822656+0000","last_clean":"2024-02-10T08:18:52.822656+0000","last_became_active":"2024-02-10T08:16:58.891249+0000","last_became_peered":"2024-02-10T08:16:58.891249+0000","last_unstale":"2024-02-10T08:18:52.822656+0000","last_undegraded":"2024-02-10T08:18:52.822656+0000","last_fullsized":"2024-02-10T08:18:52.822656+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:11.750537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:11.750537+0000","last_clean_scrub_stamp":"2024-02-10T08:18:11.750537+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"63'5","reported_seq":168,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:19:00.987063+0000","last_change":"2024-02-10T08:18:04.042479+0000","last_active":"2024-02-10T08:19:00.987063+0000","last_peered":"2024-02-10T08:19:00.987063+0000","last_clean":"2024-02-10T08:19:00.987063+0000","last_became_active":"2024-02-10T08:16:52.780989+0000","last_became_peered":"2024-02-10T08:16:52.780989+0000","last_unstale":"2024-02-10T08:19:00.987063+0000","last_undegraded":"2024-02-10T08:19:00.987063+0000","last_fullsized":"2024-02-10T08:19:00.987063+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'5","last_scrub_stamp":"2024-02-10T08:18:04.042403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:04.042403+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":122,"num_read_kb":117,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":43,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.544499+0000","last_change":"2024-02-10T08:18:11.681290+0000","last_active":"2024-02-10T08:18:52.544499+0000","last_peered":"2024-02-10T08:18:52.544499+0000","last_clean":"2024-02-10T08:18:52.544499+0000","last_became_active":"2024-02-10T08:16:52.787737+0000","last_became_peered":"2024-02-10T08:16:52.787737+0000","last_unstale":"2024-02-10T08:18:52.544499+0000","last_undegraded":"2024-02-10T08:18:52.544499+0000","last_fullsized":"2024-02-10T08:18:52.544499+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:11.681169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:11.681169+0000","last_clean_scrub_stamp":"2024-02-10T08:18:11.681169+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"62'13","reported_seq":68,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.819754+0000","last_change":"2024-02-10T08:18:39.241207+0000","last_active":"2024-02-10T08:18:52.819754+0000","last_peered":"2024-02-10T08:18:52.819754+0000","last_clean":"2024-02-10T08:18:52.819754+0000","last_became_active":"2024-02-10T08:16:54.850812+0000","last_became_peered":"2024-02-10T08:16:54.850812+0000","last_unstale":"2024-02-10T08:18:52.819754+0000","last_undegraded":"2024-02-10T08:18:52.819754+0000","last_fullsized":"2024-02-10T08:18:52.819754+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'13","last_scrub_stamp":"2024-02-10T08:18:39.240947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:39.240947+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.545290+0000","last_change":"2024-02-10T08:18:28.603605+0000","last_active":"2024-02-10T08:18:52.545290+0000","last_peered":"2024-02-10T08:18:52.545290+0000","last_clean":"2024-02-10T08:18:52.545290+0000","last_became_active":"2024-02-10T08:16:56.857856+0000","last_became_peered":"2024-02-10T08:16:56.857856+0000","last_unstale":"2024-02-10T08:18:52.545290+0000","last_undegraded":"2024-02-10T08:18:52.545290+0000","last_fullsized":"2024-02-10T08:18:52.545290+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:28.603511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:28.603511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.821308+0000","last_change":"2024-02-10T08:18:45.380034+0000","last_active":"2024-02-10T08:18:52.821308+0000","last_peered":"2024-02-10T08:18:52.821308+0000","last_clean":"2024-02-10T08:18:52.821308+0000","last_became_active":"2024-02-10T08:16:58.867978+0000","last_became_peered":"2024-02-10T08:16:58.867978+0000","last_unstale":"2024-02-10T08:18:52.821308+0000","last_undegraded":"2024-02-10T08:18:52.821308+0000","last_fullsized":"2024-02-10T08:18:52.821308+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:45.379932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:45.379932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":43,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.542137+0000","last_change":"2024-02-10T08:18:07.008482+0000","last_active":"2024-02-10T08:18:52.542137+0000","last_peered":"2024-02-10T08:18:52.542137+0000","last_clean":"2024-02-10T08:18:52.542137+0000","last_became_active":"2024-02-10T08:16:52.788195+0000","last_became_peered":"2024-02-10T08:16:52.788195+0000","last_unstale":"2024-02-10T08:18:52.542137+0000","last_undegraded":"2024-02-10T08:18:52.542137+0000","last_fullsized":"2024-02-10T08:18:52.542137+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:07.008399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:07.008399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":42,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.819003+0000","last_change":"2024-02-10T08:18:19.390305+0000","last_active":"2024-02-10T08:18:52.819003+0000","last_peered":"2024-02-10T08:18:52.819003+0000","last_clean":"2024-02-10T08:18:52.819003+0000","last_became_active":"2024-02-10T08:16:52.788767+0000","last_became_peered":"2024-02-10T08:16:52.788767+0000","last_unstale":"2024-02-10T08:18:52.819003+0000","last_undegraded":"2024-02-10T08:18:52.819003+0000","last_fullsized":"2024-02-10T08:18:52.819003+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:19.390239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:19.390239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":51,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.820770+0000","last_change":"2024-02-10T08:18:24.982997+0000","last_active":"2024-02-10T08:18:52.820770+0000","last_peered":"2024-02-10T08:18:52.820770+0000","last_clean":"2024-02-10T08:18:52.820770+0000","last_became_active":"2024-02-10T08:16:46.402267+0000","last_became_peered":"2024-02-10T08:16:46.402267+0000","last_unstale":"2024-02-10T08:18:52.820770+0000","last_undegraded":"2024-02-10T08:18:52.820770+0000","last_fullsized":"2024-02-10T08:18:52.820770+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:24.982932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:14:44.584370+0000","last_clean_scrub_stamp":"2024-02-10T08:18:24.982932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"62'14","reported_seq":62,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.543126+0000","last_change":"2024-02-10T08:18:33.416443+0000","last_active":"2024-02-10T08:18:52.543126+0000","last_peered":"2024-02-10T08:18:52.543126+0000","last_clean":"2024-02-10T08:18:52.543126+0000","last_became_active":"2024-02-10T08:16:55.204616+0000","last_became_peered":"2024-02-10T08:16:55.204616+0000","last_unstale":"2024-02-10T08:18:52.543126+0000","last_undegraded":"2024-02-10T08:18:52.543126+0000","last_fullsized":"2024-02-10T08:18:52.543126+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'14","last_scrub_stamp":"2024-02-10T08:18:33.416365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:33.416365+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":15,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.822277+0000","last_change":"2024-02-10T08:18:04.766868+0000","last_active":"2024-02-10T08:18:52.822277+0000","last_peered":"2024-02-10T08:18:52.822277+0000","last_clean":"2024-02-10T08:18:52.822277+0000","last_became_active":"2024-02-10T08:16:56.867159+0000","last_became_peered":"2024-02-10T08:16:56.867159+0000","last_unstale":"2024-02-10T08:18:52.822277+0000","last_undegraded":"2024-02-10T08:18:52.822277+0000","last_fullsized":"2024-02-10T08:18:52.822277+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:04.766780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:04.766780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:04.766780+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.819294+0000","last_change":"2024-02-10T08:18:41.255265+0000","last_active":"2024-02-10T08:18:52.819294+0000","last_peered":"2024-02-10T08:18:52.819294+0000","last_clean":"2024-02-10T08:18:52.819294+0000","last_became_active":"2024-02-10T08:16:58.867593+0000","last_became_peered":"2024-02-10T08:16:58.867593+0000","last_unstale":"2024-02-10T08:18:52.819294+0000","last_undegraded":"2024-02-10T08:18:52.819294+0000","last_fullsized":"2024-02-10T08:18:52.819294+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:41.255196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:41.255196+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":44,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.805400+0000","last_change":"2024-02-10T08:18:20.736287+0000","last_active":"2024-02-10T08:18:52.805400+0000","last_peered":"2024-02-10T08:18:52.805400+0000","last_clean":"2024-02-10T08:18:52.805400+0000","last_became_active":"2024-02-10T08:16:52.782840+0000","last_became_peered":"2024-02-10T08:16:52.782840+0000","last_unstale":"2024-02-10T08:18:52.805400+0000","last_undegraded":"2024-02-10T08:18:52.805400+0000","last_fullsized":"2024-02-10T08:18:52.805400+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:20.736224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:20.736224+0000","last_clean_scrub_stamp":"2024-02-10T08:18:20.736224+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":42,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.820720+0000","last_change":"2024-02-10T08:18:14.858038+0000","last_active":"2024-02-10T08:18:52.820720+0000","last_peered":"2024-02-10T08:18:52.820720+0000","last_clean":"2024-02-10T08:18:52.820720+0000","last_became_active":"2024-02-10T08:16:52.787180+0000","last_became_peered":"2024-02-10T08:16:52.787180+0000","last_unstale":"2024-02-10T08:18:52.820720+0000","last_undegraded":"2024-02-10T08:18:52.820720+0000","last_fullsized":"2024-02-10T08:18:52.820720+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:14.857925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:14.857925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"62'12","reported_seq":58,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.806278+0000","last_change":"2024-02-10T08:18:34.720492+0000","last_active":"2024-02-10T08:18:52.806278+0000","last_peered":"2024-02-10T08:18:52.806278+0000","last_clean":"2024-02-10T08:18:52.806278+0000","last_became_active":"2024-02-10T08:16:54.853330+0000","last_became_peered":"2024-02-10T08:16:54.853330+0000","last_unstale":"2024-02-10T08:18:52.806278+0000","last_undegraded":"2024-02-10T08:18:52.806278+0000","last_fullsized":"2024-02-10T08:18:52.806278+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'12","last_scrub_stamp":"2024-02-10T08:18:34.720419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:34.720419+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.821229+0000","last_change":"2024-02-10T08:18:41.360314+0000","last_active":"2024-02-10T08:18:52.821229+0000","last_peered":"2024-02-10T08:18:52.821229+0000","last_clean":"2024-02-10T08:18:52.821229+0000","last_became_active":"2024-02-10T08:16:56.864030+0000","last_became_peered":"2024-02-10T08:16:56.864030+0000","last_unstale":"2024-02-10T08:18:52.821229+0000","last_undegraded":"2024-02-10T08:18:52.821229+0000","last_fullsized":"2024-02-10T08:18:52.821229+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:41.360241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:41.360241+0000","last_clean_scrub_stamp":"2024-02-10T08:18:41.360241+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.819098+0000","last_change":"2024-02-10T08:18:13.057393+0000","last_active":"2024-02-10T08:18:52.819098+0000","last_peered":"2024-02-10T08:18:52.819098+0000","last_clean":"2024-02-10T08:18:52.819098+0000","last_became_active":"2024-02-10T08:16:58.891287+0000","last_became_peered":"2024-02-10T08:16:58.891287+0000","last_unstale":"2024-02-10T08:18:52.819098+0000","last_undegraded":"2024-02-10T08:18:52.819098+0000","last_fullsized":"2024-02-10T08:18:52.819098+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:13.057266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:13.057266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.545177+0000","last_change":"2024-02-10T08:18:18.163873+0000","last_active":"2024-02-10T08:18:52.545177+0000","last_peered":"2024-02-10T08:18:52.545177+0000","last_clean":"2024-02-10T08:18:52.545177+0000","last_became_active":"2024-02-10T08:18:18.163475+0000","last_became_peered":"2024-02-10T08:18:18.163475+0000","last_unstale":"2024-02-10T08:18:52.545177+0000","last_undegraded":"2024-02-10T08:18:52.545177+0000","last_fullsized":"2024-02-10T08:18:52.545177+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:16.912336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:16.912336+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4],"acting":[2,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"62'19","reported_seq":76,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.806058+0000","last_change":"2024-02-10T08:18:26.755417+0000","last_active":"2024-02-10T08:18:52.806058+0000","last_peered":"2024-02-10T08:18:52.806058+0000","last_clean":"2024-02-10T08:18:52.806058+0000","last_became_active":"2024-02-10T08:16:55.203453+0000","last_became_peered":"2024-02-10T08:16:55.203453+0000","last_unstale":"2024-02-10T08:18:52.806058+0000","last_undegraded":"2024-02-10T08:18:52.806058+0000","last_fullsized":"2024-02-10T08:18:52.806058+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'19","last_scrub_stamp":"2024-02-10T08:18:26.755321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:26.755321+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.542937+0000","last_change":"2024-02-10T08:18:17.299894+0000","last_active":"2024-02-10T08:18:52.542937+0000","last_peered":"2024-02-10T08:18:52.542937+0000","last_clean":"2024-02-10T08:18:52.542937+0000","last_became_active":"2024-02-10T08:16:56.861172+0000","last_became_peered":"2024-02-10T08:16:56.861172+0000","last_unstale":"2024-02-10T08:18:52.542937+0000","last_undegraded":"2024-02-10T08:18:52.542937+0000","last_fullsized":"2024-02-10T08:18:52.542937+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:17.299814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:17.299814+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.821419+0000","last_change":"2024-02-10T08:18:04.882451+0000","last_active":"2024-02-10T08:18:52.821419+0000","last_peered":"2024-02-10T08:18:52.821419+0000","last_clean":"2024-02-10T08:18:52.821419+0000","last_became_active":"2024-02-10T08:16:58.863795+0000","last_became_peered":"2024-02-10T08:16:58.863795+0000","last_unstale":"2024-02-10T08:18:52.821419+0000","last_undegraded":"2024-02-10T08:18:52.821419+0000","last_fullsized":"2024-02-10T08:18:52.821419+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:04.882389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:04.882389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":43,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.818942+0000","last_change":"2024-02-10T08:18:12.069405+0000","last_active":"2024-02-10T08:18:52.818942+0000","last_peered":"2024-02-10T08:18:52.818942+0000","last_clean":"2024-02-10T08:18:52.818942+0000","last_became_active":"2024-02-10T08:16:52.781197+0000","last_became_peered":"2024-02-10T08:16:52.781197+0000","last_unstale":"2024-02-10T08:18:52.818942+0000","last_undegraded":"2024-02-10T08:18:52.818942+0000","last_fullsized":"2024-02-10T08:18:52.818942+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:12.069322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:12.069322+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"62'18","reported_seq":73,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.541883+0000","last_change":"2024-02-10T08:18:41.077152+0000","last_active":"2024-02-10T08:18:52.541883+0000","last_peered":"2024-02-10T08:18:52.541883+0000","last_clean":"2024-02-10T08:18:52.541883+0000","last_became_active":"2024-02-10T08:16:55.204981+0000","last_became_peered":"2024-02-10T08:16:55.204981+0000","last_unstale":"2024-02-10T08:18:52.541883+0000","last_undegraded":"2024-02-10T08:18:52.541883+0000","last_fullsized":"2024-02-10T08:18:52.541883+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'18","last_scrub_stamp":"2024-02-10T08:18:41.077080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:41.077080+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.819889+0000","last_change":"2024-02-10T08:18:15.980065+0000","last_active":"2024-02-10T08:18:52.819889+0000","last_peered":"2024-02-10T08:18:52.819889+0000","last_clean":"2024-02-10T08:18:52.819889+0000","last_became_active":"2024-02-10T08:16:56.858362+0000","last_became_peered":"2024-02-10T08:16:56.858362+0000","last_unstale":"2024-02-10T08:18:52.819889+0000","last_undegraded":"2024-02-10T08:18:52.819889+0000","last_fullsized":"2024-02-10T08:18:52.819889+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:15.979973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:15.979973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.819985+0000","last_change":"2024-02-10T08:18:15.893937+0000","last_active":"2024-02-10T08:18:52.819985+0000","last_peered":"2024-02-10T08:18:52.819985+0000","last_clean":"2024-02-10T08:18:52.819985+0000","last_became_active":"2024-02-10T08:16:58.893253+0000","last_became_peered":"2024-02-10T08:16:58.893253+0000","last_unstale":"2024-02-10T08:18:52.819985+0000","last_undegraded":"2024-02-10T08:18:52.819985+0000","last_fullsized":"2024-02-10T08:18:52.819985+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:15.893858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:15.893858+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":42,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.543360+0000","last_change":"2024-02-10T08:18:11.227796+0000","last_active":"2024-02-10T08:18:52.543360+0000","last_peered":"2024-02-10T08:18:52.543360+0000","last_clean":"2024-02-10T08:18:52.543360+0000","last_became_active":"2024-02-10T08:16:52.789020+0000","last_became_peered":"2024-02-10T08:16:52.789020+0000","last_unstale":"2024-02-10T08:18:52.543360+0000","last_undegraded":"2024-02-10T08:18:52.543360+0000","last_fullsized":"2024-02-10T08:18:52.543360+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:11.227682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:11.227682+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"62'14","reported_seq":62,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.819634+0000","last_change":"2024-02-10T08:18:10.980504+0000","last_active":"2024-02-10T08:18:52.819634+0000","last_peered":"2024-02-10T08:18:52.819634+0000","last_clean":"2024-02-10T08:18:52.819634+0000","last_became_active":"2024-02-10T08:16:54.844168+0000","last_became_peered":"2024-02-10T08:16:54.844168+0000","last_unstale":"2024-02-10T08:18:52.819634+0000","last_undegraded":"2024-02-10T08:18:52.819634+0000","last_fullsized":"2024-02-10T08:18:52.819634+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'14","last_scrub_stamp":"2024-02-10T08:18:10.980421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:10.980421+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"62'8","reported_seq":73,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:55.921681+0000","last_change":"2024-02-10T08:18:30.090145+0000","last_active":"2024-02-10T08:18:55.921681+0000","last_peered":"2024-02-10T08:18:55.921681+0000","last_clean":"2024-02-10T08:18:55.921681+0000","last_became_active":"2024-02-10T08:16:56.857343+0000","last_became_peered":"2024-02-10T08:16:56.857343+0000","last_unstale":"2024-02-10T08:18:55.921681+0000","last_undegraded":"2024-02-10T08:18:55.921681+0000","last_fullsized":"2024-02-10T08:18:55.921681+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'8","last_scrub_stamp":"2024-02-10T08:18:30.090065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:30.090065+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":37,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:56.053946+0000","last_change":"2024-02-10T08:18:56.053946+0000","last_active":"2024-02-10T08:18:56.053946+0000","last_peered":"2024-02-10T08:18:56.053946+0000","last_clean":"2024-02-10T08:18:56.053946+0000","last_became_active":"2024-02-10T08:16:58.891261+0000","last_became_peered":"2024-02-10T08:16:58.891261+0000","last_unstale":"2024-02-10T08:18:56.053946+0000","last_undegraded":"2024-02-10T08:18:56.053946+0000","last_fullsized":"2024-02-10T08:18:56.053946+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:56.053817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:56.053817+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.821202+0000","last_change":"2024-02-10T08:18:25.442160+0000","last_active":"2024-02-10T08:18:52.821202+0000","last_peered":"2024-02-10T08:18:52.821202+0000","last_clean":"2024-02-10T08:18:52.821202+0000","last_became_active":"2024-02-10T08:16:56.860674+0000","last_became_peered":"2024-02-10T08:16:56.860674+0000","last_unstale":"2024-02-10T08:18:52.821202+0000","last_undegraded":"2024-02-10T08:18:52.821202+0000","last_fullsized":"2024-02-10T08:18:52.821202+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:25.442097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:25.442097+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":42,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.820815+0000","last_change":"2024-02-10T08:17:56.774386+0000","last_active":"2024-02-10T08:18:52.820815+0000","last_peered":"2024-02-10T08:18:52.820815+0000","last_clean":"2024-02-10T08:18:52.820815+0000","last_became_active":"2024-02-10T08:16:52.786822+0000","last_became_peered":"2024-02-10T08:16:52.786822+0000","last_unstale":"2024-02-10T08:18:52.820815+0000","last_undegraded":"2024-02-10T08:18:52.820815+0000","last_fullsized":"2024-02-10T08:18:52.820815+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:17:56.774322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:17:56.774322+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"76'16","reported_seq":65,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.820527+0000","last_change":"2024-02-10T08:18:07.909854+0000","last_active":"2024-02-10T08:18:52.820527+0000","last_peered":"2024-02-10T08:18:52.820527+0000","last_clean":"2024-02-10T08:18:52.820527+0000","last_became_active":"2024-02-10T08:16:54.849465+0000","last_became_peered":"2024-02-10T08:16:54.849465+0000","last_unstale":"2024-02-10T08:18:52.820527+0000","last_undegraded":"2024-02-10T08:18:52.820527+0000","last_fullsized":"2024-02-10T08:18:52.820527+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'16","last_scrub_stamp":"2024-02-10T08:18:07.909782+0000","last_deep_scrub":"76'16","last_deep_scrub_stamp":"2024-02-10T08:18:07.909782+0000","last_clean_scrub_stamp":"2024-02-10T08:18:07.909782+0000","log_size":16,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.820207+0000","last_change":"2024-02-10T08:18:33.352565+0000","last_active":"2024-02-10T08:18:52.820207+0000","last_peered":"2024-02-10T08:18:52.820207+0000","last_clean":"2024-02-10T08:18:52.820207+0000","last_became_active":"2024-02-10T08:16:58.859956+0000","last_became_peered":"2024-02-10T08:16:58.859956+0000","last_unstale":"2024-02-10T08:18:52.820207+0000","last_undegraded":"2024-02-10T08:18:52.820207+0000","last_fullsized":"2024-02-10T08:18:52.820207+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:33.352450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:33.352450+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"62'8","reported_seq":73,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:55.921839+0000","last_change":"2024-02-10T08:18:28.991525+0000","last_active":"2024-02-10T08:18:55.921839+0000","last_peered":"2024-02-10T08:18:55.921839+0000","last_clean":"2024-02-10T08:18:55.921839+0000","last_became_active":"2024-02-10T08:16:56.862305+0000","last_became_peered":"2024-02-10T08:16:56.862305+0000","last_unstale":"2024-02-10T08:18:55.921839+0000","last_undegraded":"2024-02-10T08:18:55.921839+0000","last_fullsized":"2024-02-10T08:18:55.921839+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'8","last_scrub_stamp":"2024-02-10T08:18:28.991446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:28.991446+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":43,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.818872+0000","last_change":"2024-02-10T08:18:29.161304+0000","last_active":"2024-02-10T08:18:52.818872+0000","last_peered":"2024-02-10T08:18:52.818872+0000","last_clean":"2024-02-10T08:18:52.818872+0000","last_became_active":"2024-02-10T08:16:52.783634+0000","last_became_peered":"2024-02-10T08:16:52.783634+0000","last_unstale":"2024-02-10T08:18:52.818872+0000","last_undegraded":"2024-02-10T08:18:52.818872+0000","last_fullsized":"2024-02-10T08:18:52.818872+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:29.161170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:29.161170+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"62'15","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.545449+0000","last_change":"2024-02-10T08:18:19.720237+0000","last_active":"2024-02-10T08:18:52.545449+0000","last_peered":"2024-02-10T08:18:52.545449+0000","last_clean":"2024-02-10T08:18:52.545449+0000","last_became_active":"2024-02-10T08:18:18.163631+0000","last_became_peered":"2024-02-10T08:18:18.163631+0000","last_unstale":"2024-02-10T08:18:52.545449+0000","last_undegraded":"2024-02-10T08:18:52.545449+0000","last_fullsized":"2024-02-10T08:18:52.545449+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'15","last_scrub_stamp":"2024-02-10T08:18:19.720164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:19.720164+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.820201+0000","last_change":"2024-02-10T08:17:59.858063+0000","last_active":"2024-02-10T08:18:52.820201+0000","last_peered":"2024-02-10T08:18:52.820201+0000","last_clean":"2024-02-10T08:18:52.820201+0000","last_became_active":"2024-02-10T08:16:58.856794+0000","last_became_peered":"2024-02-10T08:16:58.856794+0000","last_unstale":"2024-02-10T08:18:52.820201+0000","last_undegraded":"2024-02-10T08:18:52.820201+0000","last_fullsized":"2024-02-10T08:18:52.820201+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:17:59.857977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:17:59.857977+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"62'8","reported_seq":73,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:55.921508+0000","last_change":"2024-02-10T08:18:00.800075+0000","last_active":"2024-02-10T08:18:55.921508+0000","last_peered":"2024-02-10T08:18:55.921508+0000","last_clean":"2024-02-10T08:18:55.921508+0000","last_became_active":"2024-02-10T08:16:56.858101+0000","last_became_peered":"2024-02-10T08:16:56.858101+0000","last_unstale":"2024-02-10T08:18:55.921508+0000","last_undegraded":"2024-02-10T08:18:55.921508+0000","last_fullsized":"2024-02-10T08:18:55.921508+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'8","last_scrub_stamp":"2024-02-10T08:18:00.799992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:00.799992+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":43,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.818901+0000","last_change":"2024-02-10T08:18:11.113062+0000","last_active":"2024-02-10T08:18:52.818901+0000","last_peered":"2024-02-10T08:18:52.818901+0000","last_clean":"2024-02-10T08:18:52.818901+0000","last_became_active":"2024-02-10T08:16:52.785545+0000","last_became_peered":"2024-02-10T08:16:52.785545+0000","last_unstale":"2024-02-10T08:18:52.818901+0000","last_undegraded":"2024-02-10T08:18:52.818901+0000","last_fullsized":"2024-02-10T08:18:52.818901+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:11.112885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:11.112885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"62'10","reported_seq":56,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.819933+0000","last_change":"2024-02-10T08:18:08.920316+0000","last_active":"2024-02-10T08:18:52.819933+0000","last_peered":"2024-02-10T08:18:52.819933+0000","last_clean":"2024-02-10T08:18:52.819933+0000","last_became_active":"2024-02-10T08:16:54.842930+0000","last_became_peered":"2024-02-10T08:16:54.842930+0000","last_unstale":"2024-02-10T08:18:52.819933+0000","last_undegraded":"2024-02-10T08:18:52.819933+0000","last_fullsized":"2024-02-10T08:18:52.819933+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'10","last_scrub_stamp":"2024-02-10T08:18:08.920229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:08.920229+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.545583+0000","last_change":"2024-02-10T08:18:17.709766+0000","last_active":"2024-02-10T08:18:52.545583+0000","last_peered":"2024-02-10T08:18:52.545583+0000","last_clean":"2024-02-10T08:18:52.545583+0000","last_became_active":"2024-02-10T08:16:58.868078+0000","last_became_peered":"2024-02-10T08:16:58.868078+0000","last_unstale":"2024-02-10T08:18:52.545583+0000","last_undegraded":"2024-02-10T08:18:52.545583+0000","last_fullsized":"2024-02-10T08:18:52.545583+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:17.709697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:17.709697+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.819377+0000","last_change":"2024-02-10T08:18:37.273604+0000","last_active":"2024-02-10T08:18:52.819377+0000","last_peered":"2024-02-10T08:18:52.819377+0000","last_clean":"2024-02-10T08:18:52.819377+0000","last_became_active":"2024-02-10T08:16:56.859770+0000","last_became_peered":"2024-02-10T08:16:56.859770+0000","last_unstale":"2024-02-10T08:18:52.819377+0000","last_undegraded":"2024-02-10T08:18:52.819377+0000","last_fullsized":"2024-02-10T08:18:52.819377+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:37.273476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:37.273476+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":42,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.819611+0000","last_change":"2024-02-10T08:18:00.739337+0000","last_active":"2024-02-10T08:18:52.819611+0000","last_peered":"2024-02-10T08:18:52.819611+0000","last_clean":"2024-02-10T08:18:52.819611+0000","last_became_active":"2024-02-10T08:16:52.782395+0000","last_became_peered":"2024-02-10T08:16:52.782395+0000","last_unstale":"2024-02-10T08:18:52.819611+0000","last_undegraded":"2024-02-10T08:18:52.819611+0000","last_fullsized":"2024-02-10T08:18:52.819611+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:00.739233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:00.739233+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"62'17","reported_seq":96,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.820309+0000","last_change":"2024-02-10T08:18:18.892421+0000","last_active":"2024-02-10T08:18:52.820309+0000","last_peered":"2024-02-10T08:18:52.820309+0000","last_clean":"2024-02-10T08:18:52.820309+0000","last_became_active":"2024-02-10T08:18:18.203596+0000","last_became_peered":"2024-02-10T08:18:18.203596+0000","last_unstale":"2024-02-10T08:18:52.820309+0000","last_undegraded":"2024-02-10T08:18:52.820309+0000","last_fullsized":"2024-02-10T08:18:52.820309+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'17","last_scrub_stamp":"2024-02-10T08:18:02.936554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:02.936554+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.820659+0000","last_change":"2024-02-10T08:18:07.741720+0000","last_active":"2024-02-10T08:18:52.820659+0000","last_peered":"2024-02-10T08:18:52.820659+0000","last_clean":"2024-02-10T08:18:52.820659+0000","last_became_active":"2024-02-10T08:16:58.866831+0000","last_became_peered":"2024-02-10T08:16:58.866831+0000","last_unstale":"2024-02-10T08:18:52.820659+0000","last_undegraded":"2024-02-10T08:18:52.820659+0000","last_fullsized":"2024-02-10T08:18:52.820659+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:07.741643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:07.741643+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.545154+0000","last_change":"2024-02-10T08:18:20.695868+0000","last_active":"2024-02-10T08:18:52.545154+0000","last_peered":"2024-02-10T08:18:52.545154+0000","last_clean":"2024-02-10T08:18:52.545154+0000","last_became_active":"2024-02-10T08:16:56.864026+0000","last_became_peered":"2024-02-10T08:16:56.864026+0000","last_unstale":"2024-02-10T08:18:52.545154+0000","last_undegraded":"2024-02-10T08:18:52.545154+0000","last_fullsized":"2024-02-10T08:18:52.545154+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:20.695800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:20.695800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":43,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.545719+0000","last_change":"2024-02-10T08:17:56.786385+0000","last_active":"2024-02-10T08:18:52.545719+0000","last_peered":"2024-02-10T08:18:52.545719+0000","last_clean":"2024-02-10T08:18:52.545719+0000","last_became_active":"2024-02-10T08:16:52.789100+0000","last_became_peered":"2024-02-10T08:16:52.789100+0000","last_unstale":"2024-02-10T08:18:52.545719+0000","last_undegraded":"2024-02-10T08:18:52.545719+0000","last_fullsized":"2024-02-10T08:18:52.545719+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:17:56.786325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:17:56.786325+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"62'19","reported_seq":71,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.542841+0000","last_change":"2024-02-10T08:18:16.290699+0000","last_active":"2024-02-10T08:18:52.542841+0000","last_peered":"2024-02-10T08:18:52.542841+0000","last_clean":"2024-02-10T08:18:52.542841+0000","last_became_active":"2024-02-10T08:16:55.203415+0000","last_became_peered":"2024-02-10T08:16:55.203415+0000","last_unstale":"2024-02-10T08:18:52.542841+0000","last_undegraded":"2024-02-10T08:18:52.542841+0000","last_fullsized":"2024-02-10T08:18:52.542841+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'19","last_scrub_stamp":"2024-02-10T08:18:16.290612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:16.290612+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"76'2","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.805595+0000","last_change":"2024-02-10T08:18:08.680107+0000","last_active":"2024-02-10T08:18:52.805595+0000","last_peered":"2024-02-10T08:18:52.805595+0000","last_clean":"2024-02-10T08:18:52.805595+0000","last_became_active":"2024-02-10T08:16:58.860294+0000","last_became_peered":"2024-02-10T08:16:58.860294+0000","last_unstale":"2024-02-10T08:18:52.805595+0000","last_undegraded":"2024-02-10T08:18:52.805595+0000","last_fullsized":"2024-02-10T08:18:52.805595+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'2","last_scrub_stamp":"2024-02-10T08:18:08.680038+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2024-02-10T08:18:08.680038+0000","last_clean_scrub_stamp":"2024-02-10T08:18:08.680038+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.544855+0000","last_change":"2024-02-10T08:18:27.611164+0000","last_active":"2024-02-10T08:18:52.544855+0000","last_peered":"2024-02-10T08:18:52.544855+0000","last_clean":"2024-02-10T08:18:52.544855+0000","last_became_active":"2024-02-10T08:16:56.855513+0000","last_became_peered":"2024-02-10T08:16:56.855513+0000","last_unstale":"2024-02-10T08:18:52.544855+0000","last_undegraded":"2024-02-10T08:18:52.544855+0000","last_fullsized":"2024-02-10T08:18:52.544855+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:27.611094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:27.611094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":43,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.818944+0000","last_change":"2024-02-10T08:18:06.015064+0000","last_active":"2024-02-10T08:18:52.818944+0000","last_peered":"2024-02-10T08:18:52.818944+0000","last_clean":"2024-02-10T08:18:52.818944+0000","last_became_active":"2024-02-10T08:16:52.783675+0000","last_became_peered":"2024-02-10T08:16:52.783675+0000","last_unstale":"2024-02-10T08:18:52.818944+0000","last_undegraded":"2024-02-10T08:18:52.818944+0000","last_fullsized":"2024-02-10T08:18:52.818944+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:06.014988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:06.014988+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"62'9","reported_seq":56,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.806134+0000","last_change":"2024-02-10T08:18:14.705343+0000","last_active":"2024-02-10T08:18:52.806134+0000","last_peered":"2024-02-10T08:18:52.806134+0000","last_clean":"2024-02-10T08:18:52.806134+0000","last_became_active":"2024-02-10T08:16:54.852935+0000","last_became_peered":"2024-02-10T08:16:54.852935+0000","last_unstale":"2024-02-10T08:18:52.806134+0000","last_undegraded":"2024-02-10T08:18:52.806134+0000","last_fullsized":"2024-02-10T08:18:52.806134+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'9","last_scrub_stamp":"2024-02-10T08:18:14.705229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:14.705229+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.819695+0000","last_change":"2024-02-10T08:18:08.322927+0000","last_active":"2024-02-10T08:18:52.819695+0000","last_peered":"2024-02-10T08:18:52.819695+0000","last_clean":"2024-02-10T08:18:52.819695+0000","last_became_active":"2024-02-10T08:16:58.891260+0000","last_became_peered":"2024-02-10T08:16:58.891260+0000","last_unstale":"2024-02-10T08:18:52.819695+0000","last_undegraded":"2024-02-10T08:18:52.819695+0000","last_fullsized":"2024-02-10T08:18:52.819695+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:08.322832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:08.322832+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":43,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.545353+0000","last_change":"2024-02-10T08:18:02.740193+0000","last_active":"2024-02-10T08:18:52.545353+0000","last_peered":"2024-02-10T08:18:52.545353+0000","last_clean":"2024-02-10T08:18:52.545353+0000","last_became_active":"2024-02-10T08:16:52.785754+0000","last_became_peered":"2024-02-10T08:16:52.785754+0000","last_unstale":"2024-02-10T08:18:52.545353+0000","last_undegraded":"2024-02-10T08:18:52.545353+0000","last_fullsized":"2024-02-10T08:18:52.545353+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:02.740127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:02.740127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"62'15","reported_seq":65,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.819609+0000","last_change":"2024-02-10T08:18:47.352251+0000","last_active":"2024-02-10T08:18:52.819609+0000","last_peered":"2024-02-10T08:18:52.819609+0000","last_clean":"2024-02-10T08:18:52.819609+0000","last_became_active":"2024-02-10T08:16:55.204597+0000","last_became_peered":"2024-02-10T08:16:55.204597+0000","last_unstale":"2024-02-10T08:18:52.819609+0000","last_undegraded":"2024-02-10T08:18:52.819609+0000","last_fullsized":"2024-02-10T08:18:52.819609+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'15","last_scrub_stamp":"2024-02-10T08:18:47.352151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:47.352151+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"62'8","reported_seq":72,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:55.921856+0000","last_change":"2024-02-10T08:18:29.053030+0000","last_active":"2024-02-10T08:18:55.921856+0000","last_peered":"2024-02-10T08:18:55.921856+0000","last_clean":"2024-02-10T08:18:55.921856+0000","last_became_active":"2024-02-10T08:16:56.860308+0000","last_became_peered":"2024-02-10T08:16:56.860308+0000","last_unstale":"2024-02-10T08:18:55.921856+0000","last_undegraded":"2024-02-10T08:18:55.921856+0000","last_fullsized":"2024-02-10T08:18:55.921856+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'8","last_scrub_stamp":"2024-02-10T08:18:29.052907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:29.052907+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":65,"ondisk_log_size":65,"up":96,"acting":96,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":698,"num_read_kb":455,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":411,"ondisk_log_size":411,"up":96,"acting":96,"num_store_stats":8},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":122,"num_read_kb":117,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":9,"acting":9,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":50,"seq":214748364830,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297728,"kb_used_data":632,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447424,"statfs":{"total":95995035648,"available":95690162176,"internally_reserved":0,"allocated":647168,"data_stored":296586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:18:45 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.48999999999999999,"15min":0.49199999999999999},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.5},{"interface":"front","average":{"1min":0.497,"5min":0.48999999999999999,"15min":0.48899999999999999},"min":{"1min":0.36699999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.625}]},{"osd":1,"last update":"Sat Feb 10 08:18:45 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.502,"15min":0.505},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.68000000000000005,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.50700000000000001,"15min":0.51500000000000001},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.61899999999999999,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.67300000000000004}]},{"osd":2,"last update":"Sat Feb 10 08:18:45 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.66400000000000003,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.52400000000000002,"15min":0.52700000000000002},"min":{"1min":0.38200000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.66000000000000003}]},{"osd":3,"last update":"Sat Feb 10 08:18:45 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.51300000000000001,"15min":0.51700000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.621,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.503,"5min":0.51600000000000001,"15min":0.51800000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.53000000000000003}]},{"osd":4,"last update":"Sat Feb 10 08:18:45 2024","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.40300000000000002,"15min":0.40100000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.56599999999999995,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.433,"15min":0.42999999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.58999999999999997,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.44700000000000001}]},{"osd":5,"last update":"Sat Feb 10 08:18:45 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.42199999999999999,"15min":0.41499999999999998},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.46000000000000002,"15min":0.45800000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.65800000000000003,"5min":0.753,"15min":0.753},"last":0.43099999999999999}]},{"osd":6,"last update":"Sat Feb 10 08:18:45 2024","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.45300000000000001,"15min":0.443},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.47499999999999998,"15min":0.46899999999999997},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.38300000000000001}]}]},{"osd":6,"up_from":43,"seq":184683593763,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297712,"kb_used_data":616,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447440,"statfs":{"total":95995035648,"available":95690178560,"internally_reserved":0,"allocated":630784,"data_stored":296546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:18:23 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.53800000000000003,"15min":0.54000000000000004},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.55300000000000005,"15min":0.55500000000000005},"min":{"1min":0.39300000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.78400000000000003,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.53500000000000003}]},{"osd":1,"last update":"Sat Feb 10 08:18:23 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.54700000000000004,"15min":0.55100000000000005},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.629},{"interface":"front","average":{"1min":0.496,"5min":0.55700000000000005,"15min":0.56699999999999995},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.76400000000000001,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.54400000000000004}]},{"osd":2,"last update":"Sat Feb 10 08:18:23 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.57299999999999995,"15min":0.57899999999999996},"min":{"1min":0.40999999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.57699999999999996,"15min":0.57999999999999996},"min":{"1min":0.39900000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.622}]},{"osd":3,"last update":"Sat Feb 10 08:18:23 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.56299999999999994,"15min":0.56599999999999995},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.86199999999999999,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.55600000000000005,"15min":0.55800000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.66400000000000003}]},{"osd":4,"last update":"Sat Feb 10 08:18:23 2024","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.27900000000000003,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.73399999999999999,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.46200000000000002,"15min":0.46300000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.69599999999999995,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.45100000000000001}]},{"osd":5,"last update":"Sat Feb 10 08:18:23 2024","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.45600000000000002,"15min":0.45200000000000001},"min":{"1min":0.31,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.70999999999999996,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.432},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.45700000000000002,"15min":0.45300000000000001},"min":{"1min":0.317,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.41499999999999998}]},{"osd":7,"last update":"Sat Feb 10 08:18:52 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.375,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.69899999999999995,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.497},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.57899999999999996,"15min":0.57599999999999996},"min":{"1min":0.41699999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.55500000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574906,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297744,"kb_used_data":648,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447408,"statfs":{"total":95995035648,"available":95690145792,"internally_reserved":0,"allocated":663552,"data_stored":296375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:18:23 2024","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.35699999999999998,"15min":0.318},"min":{"1min":0.23999999999999999,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.60499999999999998,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.373,"15min":0.33200000000000002},"min":{"1min":0.24099999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.64900000000000002,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.26900000000000002}]},{"osd":2,"last update":"Sat Feb 10 08:18:54 2024","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.38600000000000001,"15min":0.36599999999999999},"min":{"1min":0.26400000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.55300000000000005,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.38900000000000001,"15min":0.371},"min":{"1min":0.252,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.58399999999999996,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.42699999999999999}]},{"osd":3,"last update":"Sat Feb 10 08:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.45900000000000002,"15min":0.46100000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.69099999999999995,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.438,"15min":0.439},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.69399999999999995,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.36699999999999999}]},{"osd":4,"last update":"Sat Feb 10 08:18:37 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.58599999999999997,"15min":0.59099999999999997},"min":{"1min":0.39200000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.83899999999999997,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.57199999999999995,"15min":0.58199999999999996},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.85099999999999998,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.52200000000000002}]},{"osd":5,"last update":"Sat Feb 10 08:18:59 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.57199999999999995,"15min":0.57399999999999995},"min":{"1min":0.39700000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.82399999999999995,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.60699999999999998,"15min":0.61299999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.90100000000000002,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.50800000000000001}]},{"osd":6,"last update":"Sat Feb 10 08:18:23 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.61299999999999999,"15min":0.61599999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.55600000000000005}]},{"osd":7,"last update":"Sat Feb 10 08:18:49 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.57099999999999995,"15min":0.56499999999999995},"min":{"1min":0.42799999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.59499999999999997,"15min":0.58899999999999997},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.59599999999999997}]}]},{"osd":0,"up_from":8,"seq":34359738431,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297736,"kb_used_data":640,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447416,"statfs":{"total":95995035648,"available":95690153984,"internally_reserved":0,"allocated":655360,"data_stored":296906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 10 08:18:23 2024","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35399999999999998,"15min":0.33500000000000002},"min":{"1min":0.217,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.52400000000000002,"5min":0.54400000000000004,"15min":0.54400000000000004},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.374,"5min":0.36599999999999999,"15min":0.33600000000000002},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.27400000000000002}]},{"osd":2,"last update":"Sat Feb 10 08:18:50 2024","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.253,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.42299999999999999,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.375},{"interface":"front","average":{"1min":0.375,"5min":0.39800000000000002,"15min":0.39200000000000002},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.47499999999999998,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.35699999999999998}]},{"osd":3,"last update":"Sat Feb 10 08:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.434,"15min":0.442},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.442,"15min":0.44800000000000001},"min":{"1min":0.30299999999999999,"5min":0.246,"15min":0.246},"max":{"1min":0.55900000000000005,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.33100000000000002}]},{"osd":4,"last update":"Sat Feb 10 08:18:35 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.59399999999999997,"15min":0.59199999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.59399999999999997,"15min":0.60399999999999998},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.57099999999999995}]},{"osd":5,"last update":"Sat Feb 10 08:18:00 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.58999999999999997,"15min":0.59399999999999997},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57999999999999996,"15min":0.58199999999999996},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.52800000000000002}]},{"osd":6,"last update":"Sat Feb 10 08:18:23 2024","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.64100000000000001,"15min":0.64700000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.56499999999999995}]},{"osd":7,"last update":"Sat Feb 10 08:18:47 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59799999999999998,"15min":0.59899999999999998},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.80800000000000005,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.80200000000000005,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.47999999999999998}]}]},{"osd":2,"up_from":18,"seq":77309411382,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297720,"kb_used_data":624,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447432,"statfs":{"total":95995035648,"available":95690170368,"internally_reserved":0,"allocated":638976,"data_stored":296082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:18:48 2024","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.35799999999999998,"15min":0.34899999999999998},"min":{"1min":0.255,"5min":0.224,"15min":0.224},"max":{"1min":0.49399999999999999,"5min":0.628,"15min":0.628},"last":0.307},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38,"15min":0.36599999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.75,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.49099999999999999}]},{"osd":1,"last update":"Sat Feb 10 08:18:48 2024","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.375,"15min":0.36799999999999999},"min":{"1min":0.27100000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.51100000000000001,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.39500000000000002,"15min":0.38200000000000001},"min":{"1min":0.26000000000000001,"5min":0.25,"15min":0.25},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.42299999999999999}]},{"osd":3,"last update":"Sat Feb 10 08:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.45800000000000002,"15min":0.46000000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.73999999999999999,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.44800000000000001,"15min":0.45000000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.58699999999999997,"5min":0.749,"15min":0.749},"last":0.47899999999999998}]},{"osd":4,"last update":"Sat Feb 10 08:18:35 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.58499999999999996,"15min":0.58099999999999996},"min":{"1min":0.496,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.86299999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.57399999999999995,"15min":0.57699999999999996},"min":{"1min":0.39800000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.73399999999999999}]},{"osd":5,"last update":"Sat Feb 10 08:18:00 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.56299999999999994,"15min":0.56899999999999995},"min":{"1min":0.41999999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.71199999999999997,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.56200000000000006,"15min":0.56599999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.80000000000000004,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.68200000000000005}]},{"osd":6,"last update":"Sat Feb 10 08:18:22 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.58099999999999996,"15min":0.58499999999999996},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.71699999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.60099999999999998,"15min":0.60699999999999998},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.73599999999999999,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.65300000000000002}]},{"osd":7,"last update":"Sat Feb 10 08:18:48 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.60399999999999998,"15min":0.60799999999999998},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.80800000000000005,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.85399999999999998,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.66700000000000004}]}]},{"osd":3,"up_from":25,"seq":107374182449,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297740,"kb_used_data":644,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447412,"statfs":{"total":95995035648,"available":95690149888,"internally_reserved":0,"allocated":659456,"data_stored":296148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:18:10 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.38900000000000001,"15min":0.374},"min":{"1min":0.254,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.25},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.42399999999999999,"15min":0.42299999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.33100000000000002}]},{"osd":1,"last update":"Sat Feb 10 08:18:10 2024","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.439,"15min":0.443},"min":{"1min":0.315,"5min":0.312,"15min":0.312},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.45600000000000002,"15min":0.46300000000000002},"min":{"1min":0.28499999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.61099999999999999,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.35499999999999998}]},{"osd":2,"last update":"Sat Feb 10 08:18:10 2024","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.45500000000000002,"15min":0.45700000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.45900000000000002,"15min":0.45500000000000002},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.66600000000000004,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.38100000000000001}]},{"osd":4,"last update":"Sat Feb 10 08:18:36 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54700000000000004,"15min":0.54500000000000004},"min":{"1min":0.38800000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.56899999999999995,"15min":0.57299999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.83099999999999996,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.71799999999999997}]},{"osd":5,"last update":"Sat Feb 10 08:18:03 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.59699999999999998,"15min":0.59899999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.59799999999999998,"15min":0.59999999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.68200000000000005}]},{"osd":6,"last update":"Sat Feb 10 08:18:23 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.57299999999999995,"15min":0.57099999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.58699999999999997,"15min":0.58299999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.622}]},{"osd":7,"last update":"Sat Feb 10 08:18:46 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.57899999999999996,"15min":0.57699999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.57399999999999995,"15min":0.56999999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.67100000000000004}]}]},{"osd":4,"up_from":30,"seq":128849018923,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297728,"kb_used_data":632,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447424,"statfs":{"total":95995035648,"available":95690162176,"internally_reserved":0,"allocated":647168,"data_stored":295816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:18:34 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.51300000000000001,"15min":0.52400000000000002},"min":{"1min":0.26100000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.65600000000000003,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.503,"5min":0.52200000000000002,"15min":0.53000000000000003},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.64500000000000002,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.59999999999999998}]},{"osd":1,"last update":"Sat Feb 10 08:18:34 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.50900000000000001,"15min":0.52400000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.629,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.503,"15min":0.51600000000000001},"min":{"1min":0.35199999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.56000000000000005,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.52300000000000002}]},{"osd":2,"last update":"Sat Feb 10 08:18:34 2024","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.499,"15min":0.505},"min":{"1min":0.32300000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.61699999999999999,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.52900000000000003,"15min":0.53900000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.61199999999999999,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.51300000000000001}]},{"osd":3,"last update":"Sat Feb 10 08:18:34 2024","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.52700000000000002,"15min":0.53700000000000003},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.66900000000000004,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.44},{"interface":"front","average":{"1min":0.497,"5min":0.52200000000000002,"15min":0.53100000000000003},"min":{"1min":0.39500000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.67800000000000005,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.53800000000000003}]},{"osd":5,"last update":"Sat Feb 10 08:19:00 2024","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.38600000000000001,"15min":0.372},"min":{"1min":0.27100000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.627,"5min":0.627,"15min":0.627},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.39400000000000002,"15min":0.377},"min":{"1min":0.28999999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.67500000000000004}]},{"osd":6,"last update":"Sat Feb 10 08:18:20 2024","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"min":{"1min":0.30199999999999999,"5min":0.248,"15min":0.248},"max":{"1min":0.64800000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.46600000000000003,"15min":0.46400000000000002},"min":{"1min":0.32000000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.56200000000000006}]},{"osd":7,"last update":"Sat Feb 10 08:18:46 2024","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.33300000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.45200000000000001,"15min":0.45000000000000001},"min":{"1min":0.313,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.49399999999999999}]}]},{"osd":5,"up_from":37,"seq":158913789992,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297712,"kb_used_data":616,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447440,"statfs":{"total":95995035648,"available":95690178560,"internally_reserved":0,"allocated":630784,"data_stored":295719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:18:57 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.56399999999999995,"15min":0.58399999999999996},"min":{"1min":0.38400000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.70099999999999996,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.378},{"interface":"front","average":{"1min":0.502,"5min":0.51200000000000001,"15min":0.52100000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.72399999999999998,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.43099999999999999}]},{"osd":1,"last update":"Sat Feb 10 08:18:57 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.54300000000000004,"15min":0.56000000000000005},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.52700000000000002,"15min":0.54600000000000004},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.68200000000000005,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.47099999999999997}]},{"osd":2,"last update":"Sat Feb 10 08:18:57 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.55200000000000005,"15min":0.56999999999999995},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.70899999999999996,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.56699999999999995,"15min":0.59099999999999997},"min":{"1min":0.40500000000000003,"5min":0.372,"15min":0.372},"max":{"1min":0.70299999999999996,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.502}]},{"osd":3,"last update":"Sat Feb 10 08:18:57 2024","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.56200000000000006,"15min":0.58499999999999996},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.66700000000000004,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.378,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.66000000000000003,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":0.59499999999999997}]},{"osd":4,"last update":"Sat Feb 10 08:18:57 2024","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.371,"15min":0.36099999999999999},"min":{"1min":0.26400000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.65400000000000003,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.433,"5min":0.38300000000000001,"15min":0.36899999999999999},"min":{"1min":0.30399999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.68700000000000006,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.48399999999999999}]},{"osd":6,"last update":"Sat Feb 10 08:18:24 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.38500000000000001,"15min":0.375},"min":{"1min":0.33300000000000002,"5min":0.254,"15min":0.254},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.436,"15min":0.42499999999999999},"min":{"1min":0.34999999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.57699999999999996}]},{"osd":7,"last update":"Sat Feb 10 08:18:49 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.439,"15min":0.436},"min":{"1min":0.318,"5min":0.31,"15min":0.31},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.432,"15min":0.42499999999999999},"min":{"1min":0.29099999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.67100000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":2008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-10T08:19:03.746 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph pg dump --format=json 2024-02-10T08:19:03.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:02.472802+0000 mgr.y (mgr.14505) 87 : cluster [DBG] pgmap v76: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-02-10T08:19:03.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:19:02.900594+0000 mgr.y (mgr.14505) 88 : audit [DBG] from='client.24599 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-10T08:19:03.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:02.472802+0000 mgr.y (mgr.14505) 87 : cluster [DBG] pgmap v76: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-02-10T08:19:03.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:19:02.900594+0000 mgr.y (mgr.14505) 88 : audit [DBG] from='client.24599 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-10T08:19:04.033 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:19:04.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:02.472802+0000 mgr.y (mgr.14505) 87 : cluster [DBG] pgmap v76: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-02-10T08:19:04.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:19:02.900594+0000 mgr.y (mgr.14505) 88 : audit [DBG] from='client.24599 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-10T08:19:05.815 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:04.473184+0000 mgr.y (mgr.14505) 89 : cluster [DBG] pgmap v77: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 936 B/s rd, 0 op/s 2024-02-10T08:19:05.815 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:04.473184+0000 mgr.y (mgr.14505) 89 : cluster [DBG] pgmap v77: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 936 B/s rd, 0 op/s 2024-02-10T08:19:06.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:04.473184+0000 mgr.y (mgr.14505) 89 : cluster [DBG] pgmap v77: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 936 B/s rd, 0 op/s 2024-02-10T08:19:06.262 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:19:06.264 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-02-10T08:19:06.789 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:19:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:19:06] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:19:07.187 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":77,"stamp":"2024-02-10T08:19:04.473013+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":5796,"num_objects":192,"num_object_clones":0,"num_object_copies":576,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":192,"num_whiteouts":0,"num_read":842,"num_read_kb":594,"num_write":428,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":488,"ondisk_log_size":488,"up":396,"acting":396,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":396,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":2381820,"kb_used_data":5052,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":747579396,"statfs":{"total":767960285184,"available":765521301504,"internally_reserved":0,"allocated":5173248,"data_stored":2370178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.931158"},"pg_stats":[{"pgid":"6.1b","version":"0'0","reported_seq":37,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:19:01.075963+0000","last_change":"2024-02-10T08:19:01.075963+0000","last_active":"2024-02-10T08:19:01.075963+0000","last_peered":"2024-02-10T08:19:01.075963+0000","last_clean":"2024-02-10T08:19:01.075963+0000","last_became_active":"2024-02-10T08:16:58.892091+0000","last_became_peered":"2024-02-10T08:16:58.892091+0000","last_unstale":"2024-02-10T08:19:01.075963+0000","last_undegraded":"2024-02-10T08:19:01.075963+0000","last_fullsized":"2024-02-10T08:19:01.075963+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:01.075886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:19:01.075886+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.819576+0000","last_change":"2024-02-10T08:18:09.941981+0000","last_active":"2024-02-10T08:18:52.819576+0000","last_peered":"2024-02-10T08:18:52.819576+0000","last_clean":"2024-02-10T08:18:52.819576+0000","last_became_active":"2024-02-10T08:16:56.858480+0000","last_became_peered":"2024-02-10T08:16:56.858480+0000","last_unstale":"2024-02-10T08:18:52.819576+0000","last_undegraded":"2024-02-10T08:18:52.819576+0000","last_fullsized":"2024-02-10T08:18:52.819576+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:09.941898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:09.941898+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":42,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.806395+0000","last_change":"2024-02-10T08:18:43.744973+0000","last_active":"2024-02-10T08:18:52.806395+0000","last_peered":"2024-02-10T08:18:52.806395+0000","last_clean":"2024-02-10T08:18:52.806395+0000","last_became_active":"2024-02-10T08:16:52.788363+0000","last_became_peered":"2024-02-10T08:16:52.788363+0000","last_unstale":"2024-02-10T08:18:52.806395+0000","last_undegraded":"2024-02-10T08:18:52.806395+0000","last_fullsized":"2024-02-10T08:18:52.806395+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:43.744900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:43.744900+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"62'15","reported_seq":66,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.542393+0000","last_change":"2024-02-10T08:18:08.051424+0000","last_active":"2024-02-10T08:18:52.542393+0000","last_peered":"2024-02-10T08:18:52.542393+0000","last_clean":"2024-02-10T08:18:52.542393+0000","last_became_active":"2024-02-10T08:16:54.849232+0000","last_became_peered":"2024-02-10T08:16:54.849232+0000","last_unstale":"2024-02-10T08:18:52.542393+0000","last_undegraded":"2024-02-10T08:18:52.542393+0000","last_fullsized":"2024-02-10T08:18:52.542393+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'15","last_scrub_stamp":"2024-02-10T08:18:08.051315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:08.051315+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.821154+0000","last_change":"2024-02-10T08:18:19.058387+0000","last_active":"2024-02-10T08:18:52.821154+0000","last_peered":"2024-02-10T08:18:52.821154+0000","last_clean":"2024-02-10T08:18:52.821154+0000","last_became_active":"2024-02-10T08:16:58.860693+0000","last_became_peered":"2024-02-10T08:16:58.860693+0000","last_unstale":"2024-02-10T08:18:52.821154+0000","last_undegraded":"2024-02-10T08:18:52.821154+0000","last_fullsized":"2024-02-10T08:18:52.821154+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:19.058317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:19.058317+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.819154+0000","last_change":"2024-02-10T08:18:31.136877+0000","last_active":"2024-02-10T08:18:52.819154+0000","last_peered":"2024-02-10T08:18:52.819154+0000","last_clean":"2024-02-10T08:18:52.819154+0000","last_became_active":"2024-02-10T08:16:56.863353+0000","last_became_peered":"2024-02-10T08:16:56.863353+0000","last_unstale":"2024-02-10T08:18:52.819154+0000","last_undegraded":"2024-02-10T08:18:52.819154+0000","last_fullsized":"2024-02-10T08:18:52.819154+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:31.136797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:31.136797+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":43,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.544773+0000","last_change":"2024-02-10T08:17:53.926192+0000","last_active":"2024-02-10T08:18:52.544773+0000","last_peered":"2024-02-10T08:18:52.544773+0000","last_clean":"2024-02-10T08:18:52.544773+0000","last_became_active":"2024-02-10T08:16:52.787183+0000","last_became_peered":"2024-02-10T08:16:52.787183+0000","last_unstale":"2024-02-10T08:18:52.544773+0000","last_undegraded":"2024-02-10T08:18:52.544773+0000","last_fullsized":"2024-02-10T08:18:52.544773+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:17:53.926120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:17:53.926120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"62'9","reported_seq":57,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.819862+0000","last_change":"2024-02-10T08:18:12.998301+0000","last_active":"2024-02-10T08:18:52.819862+0000","last_peered":"2024-02-10T08:18:52.819862+0000","last_clean":"2024-02-10T08:18:52.819862+0000","last_became_active":"2024-02-10T08:16:54.852200+0000","last_became_peered":"2024-02-10T08:16:54.852200+0000","last_unstale":"2024-02-10T08:18:52.819862+0000","last_undegraded":"2024-02-10T08:18:52.819862+0000","last_fullsized":"2024-02-10T08:18:52.819862+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'9","last_scrub_stamp":"2024-02-10T08:18:12.998167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:12.998167+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.821025+0000","last_change":"2024-02-10T08:18:51.370619+0000","last_active":"2024-02-10T08:18:52.821025+0000","last_peered":"2024-02-10T08:18:52.821025+0000","last_clean":"2024-02-10T08:18:52.821025+0000","last_became_active":"2024-02-10T08:16:58.867430+0000","last_became_peered":"2024-02-10T08:16:58.867430+0000","last_unstale":"2024-02-10T08:18:52.821025+0000","last_undegraded":"2024-02-10T08:18:52.821025+0000","last_fullsized":"2024-02-10T08:18:52.821025+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:51.370527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:51.370527+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.821961+0000","last_change":"2024-02-10T08:17:59.772854+0000","last_active":"2024-02-10T08:18:52.821961+0000","last_peered":"2024-02-10T08:18:52.821961+0000","last_clean":"2024-02-10T08:18:52.821961+0000","last_became_active":"2024-02-10T08:16:56.865529+0000","last_became_peered":"2024-02-10T08:16:56.865529+0000","last_unstale":"2024-02-10T08:18:52.821961+0000","last_undegraded":"2024-02-10T08:18:52.821961+0000","last_fullsized":"2024-02-10T08:18:52.821961+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:17:59.772766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:17:59.772766+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"55'1","reported_seq":49,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.822347+0000","last_change":"2024-02-10T08:18:33.095861+0000","last_active":"2024-02-10T08:18:52.822347+0000","last_peered":"2024-02-10T08:18:52.822347+0000","last_clean":"2024-02-10T08:18:52.822347+0000","last_became_active":"2024-02-10T08:16:52.790462+0000","last_became_peered":"2024-02-10T08:16:52.790462+0000","last_unstale":"2024-02-10T08:18:52.822347+0000","last_undegraded":"2024-02-10T08:18:52.822347+0000","last_fullsized":"2024-02-10T08:18:52.822347+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'1","last_scrub_stamp":"2024-02-10T08:18:33.095757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:33.095757+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"62'5","reported_seq":51,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.820627+0000","last_change":"2024-02-10T08:18:11.967605+0000","last_active":"2024-02-10T08:18:52.820627+0000","last_peered":"2024-02-10T08:18:52.820627+0000","last_clean":"2024-02-10T08:18:52.820627+0000","last_became_active":"2024-02-10T08:16:54.849450+0000","last_became_peered":"2024-02-10T08:16:54.849450+0000","last_unstale":"2024-02-10T08:18:52.820627+0000","last_undegraded":"2024-02-10T08:18:52.820627+0000","last_fullsized":"2024-02-10T08:18:52.820627+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'5","last_scrub_stamp":"2024-02-10T08:18:11.967507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:11.967507+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.805778+0000","last_change":"2024-02-10T08:18:15.691621+0000","last_active":"2024-02-10T08:18:52.805778+0000","last_peered":"2024-02-10T08:18:52.805778+0000","last_clean":"2024-02-10T08:18:52.805778+0000","last_became_active":"2024-02-10T08:16:58.860591+0000","last_became_peered":"2024-02-10T08:16:58.860591+0000","last_unstale":"2024-02-10T08:18:52.805778+0000","last_undegraded":"2024-02-10T08:18:52.805778+0000","last_fullsized":"2024-02-10T08:18:52.805778+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:15.691552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:15.691552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.820734+0000","last_change":"2024-02-10T08:18:09.324937+0000","last_active":"2024-02-10T08:18:52.820734+0000","last_peered":"2024-02-10T08:18:52.820734+0000","last_clean":"2024-02-10T08:18:52.820734+0000","last_became_active":"2024-02-10T08:16:56.864532+0000","last_became_peered":"2024-02-10T08:16:56.864532+0000","last_unstale":"2024-02-10T08:18:52.820734+0000","last_undegraded":"2024-02-10T08:18:52.820734+0000","last_fullsized":"2024-02-10T08:18:52.820734+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:09.324856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:09.324856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":42,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.822054+0000","last_change":"2024-02-10T08:18:28.028628+0000","last_active":"2024-02-10T08:18:52.822054+0000","last_peered":"2024-02-10T08:18:52.822054+0000","last_clean":"2024-02-10T08:18:52.822054+0000","last_became_active":"2024-02-10T08:16:52.787865+0000","last_became_peered":"2024-02-10T08:16:52.787865+0000","last_unstale":"2024-02-10T08:18:52.822054+0000","last_undegraded":"2024-02-10T08:18:52.822054+0000","last_fullsized":"2024-02-10T08:18:52.822054+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:28.028556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:28.028556+0000","last_clean_scrub_stamp":"2024-02-10T08:18:28.028556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"62'9","reported_seq":57,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.821248+0000","last_change":"2024-02-10T08:18:15.012767+0000","last_active":"2024-02-10T08:18:52.821248+0000","last_peered":"2024-02-10T08:18:52.821248+0000","last_clean":"2024-02-10T08:18:52.821248+0000","last_became_active":"2024-02-10T08:16:54.847486+0000","last_became_peered":"2024-02-10T08:16:54.847486+0000","last_unstale":"2024-02-10T08:18:52.821248+0000","last_undegraded":"2024-02-10T08:18:52.821248+0000","last_fullsized":"2024-02-10T08:18:52.821248+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'9","last_scrub_stamp":"2024-02-10T08:18:15.012657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:15.012657+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.544665+0000","last_change":"2024-02-10T08:18:52.045246+0000","last_active":"2024-02-10T08:18:52.544665+0000","last_peered":"2024-02-10T08:18:52.544665+0000","last_clean":"2024-02-10T08:18:52.544665+0000","last_became_active":"2024-02-10T08:16:58.891365+0000","last_became_peered":"2024-02-10T08:16:58.891365+0000","last_unstale":"2024-02-10T08:18:52.544665+0000","last_undegraded":"2024-02-10T08:18:52.544665+0000","last_fullsized":"2024-02-10T08:18:52.544665+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:52.045180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:52.045180+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.820021+0000","last_change":"2024-02-10T08:18:22.000876+0000","last_active":"2024-02-10T08:18:52.820021+0000","last_peered":"2024-02-10T08:18:52.820021+0000","last_clean":"2024-02-10T08:18:52.820021+0000","last_became_active":"2024-02-10T08:16:56.867217+0000","last_became_peered":"2024-02-10T08:16:56.867217+0000","last_unstale":"2024-02-10T08:18:52.820021+0000","last_undegraded":"2024-02-10T08:18:52.820021+0000","last_fullsized":"2024-02-10T08:18:52.820021+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:22.000811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:22.000811+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":43,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.542432+0000","last_change":"2024-02-10T08:18:14.058600+0000","last_active":"2024-02-10T08:18:52.542432+0000","last_peered":"2024-02-10T08:18:52.542432+0000","last_clean":"2024-02-10T08:18:52.542432+0000","last_became_active":"2024-02-10T08:16:52.785404+0000","last_became_peered":"2024-02-10T08:16:52.785404+0000","last_unstale":"2024-02-10T08:18:52.542432+0000","last_undegraded":"2024-02-10T08:18:52.542432+0000","last_fullsized":"2024-02-10T08:18:52.542432+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:14.058501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:14.058501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"74'17","reported_seq":69,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.544431+0000","last_change":"2024-02-10T08:18:02.949370+0000","last_active":"2024-02-10T08:18:52.544431+0000","last_peered":"2024-02-10T08:18:52.544431+0000","last_clean":"2024-02-10T08:18:52.544431+0000","last_became_active":"2024-02-10T08:16:54.848784+0000","last_became_peered":"2024-02-10T08:16:54.848784+0000","last_unstale":"2024-02-10T08:18:52.544431+0000","last_undegraded":"2024-02-10T08:18:52.544431+0000","last_fullsized":"2024-02-10T08:18:52.544431+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'17","last_scrub_stamp":"2024-02-10T08:18:02.949298+0000","last_deep_scrub":"74'17","last_deep_scrub_stamp":"2024-02-10T08:18:02.949298+0000","last_clean_scrub_stamp":"2024-02-10T08:18:02.949298+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.820435+0000","last_change":"2024-02-10T08:18:26.952584+0000","last_active":"2024-02-10T08:18:52.820435+0000","last_peered":"2024-02-10T08:18:52.820435+0000","last_clean":"2024-02-10T08:18:52.820435+0000","last_became_active":"2024-02-10T08:16:58.893364+0000","last_became_peered":"2024-02-10T08:16:58.893364+0000","last_unstale":"2024-02-10T08:18:52.820435+0000","last_undegraded":"2024-02-10T08:18:52.820435+0000","last_fullsized":"2024-02-10T08:18:52.820435+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:26.952496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:26.952496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.819638+0000","last_change":"2024-02-10T08:18:38.230334+0000","last_active":"2024-02-10T08:18:52.819638+0000","last_peered":"2024-02-10T08:18:52.819638+0000","last_clean":"2024-02-10T08:18:52.819638+0000","last_became_active":"2024-02-10T08:16:56.859752+0000","last_became_peered":"2024-02-10T08:16:56.859752+0000","last_unstale":"2024-02-10T08:18:52.819638+0000","last_undegraded":"2024-02-10T08:18:52.819638+0000","last_fullsized":"2024-02-10T08:18:52.819638+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:38.230210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:38.230210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":42,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.542826+0000","last_change":"2024-02-10T08:17:57.192687+0000","last_active":"2024-02-10T08:18:52.542826+0000","last_peered":"2024-02-10T08:18:52.542826+0000","last_clean":"2024-02-10T08:18:52.542826+0000","last_became_active":"2024-02-10T08:16:52.783261+0000","last_became_peered":"2024-02-10T08:16:52.783261+0000","last_unstale":"2024-02-10T08:18:52.542826+0000","last_undegraded":"2024-02-10T08:18:52.542826+0000","last_fullsized":"2024-02-10T08:18:52.542826+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:17:57.192581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:17:57.192581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1c","version":"62'15","reported_seq":66,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.545773+0000","last_change":"2024-02-10T08:18:13.740262+0000","last_active":"2024-02-10T08:18:52.545773+0000","last_peered":"2024-02-10T08:18:52.545773+0000","last_clean":"2024-02-10T08:18:52.545773+0000","last_became_active":"2024-02-10T08:16:54.849361+0000","last_became_peered":"2024-02-10T08:16:54.849361+0000","last_unstale":"2024-02-10T08:18:52.545773+0000","last_undegraded":"2024-02-10T08:18:52.545773+0000","last_fullsized":"2024-02-10T08:18:52.545773+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'15","last_scrub_stamp":"2024-02-10T08:18:13.740187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:13.740187+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.819411+0000","last_change":"2024-02-10T08:18:22.105101+0000","last_active":"2024-02-10T08:18:52.819411+0000","last_peered":"2024-02-10T08:18:52.819411+0000","last_clean":"2024-02-10T08:18:52.819411+0000","last_became_active":"2024-02-10T08:16:58.862893+0000","last_became_peered":"2024-02-10T08:16:58.862893+0000","last_unstale":"2024-02-10T08:18:52.819411+0000","last_undegraded":"2024-02-10T08:18:52.819411+0000","last_fullsized":"2024-02-10T08:18:52.819411+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:22.104988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:22.104988+0000","last_clean_scrub_stamp":"2024-02-10T08:18:22.104988+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.806445+0000","last_change":"2024-02-10T08:18:21.772134+0000","last_active":"2024-02-10T08:18:52.806445+0000","last_peered":"2024-02-10T08:18:52.806445+0000","last_clean":"2024-02-10T08:18:52.806445+0000","last_became_active":"2024-02-10T08:16:56.863348+0000","last_became_peered":"2024-02-10T08:16:56.863348+0000","last_unstale":"2024-02-10T08:18:52.806445+0000","last_undegraded":"2024-02-10T08:18:52.806445+0000","last_fullsized":"2024-02-10T08:18:52.806445+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:21.771969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:21.771969+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":43,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.542020+0000","last_change":"2024-02-10T08:18:38.075002+0000","last_active":"2024-02-10T08:18:52.542020+0000","last_peered":"2024-02-10T08:18:52.542020+0000","last_clean":"2024-02-10T08:18:52.542020+0000","last_became_active":"2024-02-10T08:16:52.785743+0000","last_became_peered":"2024-02-10T08:16:52.785743+0000","last_unstale":"2024-02-10T08:18:52.542020+0000","last_undegraded":"2024-02-10T08:18:52.542020+0000","last_fullsized":"2024-02-10T08:18:52.542020+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:38.074885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:38.074885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"62'11","reported_seq":59,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.543195+0000","last_change":"2024-02-10T08:18:22.373044+0000","last_active":"2024-02-10T08:18:52.543195+0000","last_peered":"2024-02-10T08:18:52.543195+0000","last_clean":"2024-02-10T08:18:52.543195+0000","last_became_active":"2024-02-10T08:16:54.852665+0000","last_became_peered":"2024-02-10T08:16:54.852665+0000","last_unstale":"2024-02-10T08:18:52.543195+0000","last_undegraded":"2024-02-10T08:18:52.543195+0000","last_fullsized":"2024-02-10T08:18:52.543195+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'11","last_scrub_stamp":"2024-02-10T08:18:22.372958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:22.372958+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"62'1","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.822446+0000","last_change":"2024-02-10T08:18:13.819515+0000","last_active":"2024-02-10T08:18:52.822446+0000","last_peered":"2024-02-10T08:18:52.822446+0000","last_clean":"2024-02-10T08:18:52.822446+0000","last_became_active":"2024-02-10T08:16:58.859047+0000","last_became_peered":"2024-02-10T08:16:58.859047+0000","last_unstale":"2024-02-10T08:18:52.822446+0000","last_undegraded":"2024-02-10T08:18:52.822446+0000","last_fullsized":"2024-02-10T08:18:52.822446+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'1","last_scrub_stamp":"2024-02-10T08:18:13.819405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:13.819405+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"82'9","reported_seq":79,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:55.921852+0000","last_change":"2024-02-10T08:18:36.323299+0000","last_active":"2024-02-10T08:18:55.921852+0000","last_peered":"2024-02-10T08:18:55.921852+0000","last_clean":"2024-02-10T08:18:55.921852+0000","last_became_active":"2024-02-10T08:16:56.854294+0000","last_became_peered":"2024-02-10T08:16:56.854294+0000","last_unstale":"2024-02-10T08:18:55.921852+0000","last_undegraded":"2024-02-10T08:18:55.921852+0000","last_fullsized":"2024-02-10T08:18:55.921852+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'9","last_scrub_stamp":"2024-02-10T08:18:36.323217+0000","last_deep_scrub":"82'9","last_deep_scrub_stamp":"2024-02-10T08:18:36.323217+0000","last_clean_scrub_stamp":"2024-02-10T08:18:36.323217+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":42,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.819520+0000","last_change":"2024-02-10T08:18:30.422885+0000","last_active":"2024-02-10T08:18:52.819520+0000","last_peered":"2024-02-10T08:18:52.819520+0000","last_clean":"2024-02-10T08:18:52.819520+0000","last_became_active":"2024-02-10T08:16:52.788543+0000","last_became_peered":"2024-02-10T08:16:52.788543+0000","last_unstale":"2024-02-10T08:18:52.819520+0000","last_undegraded":"2024-02-10T08:18:52.819520+0000","last_fullsized":"2024-02-10T08:18:52.819520+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:30.422800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:30.422800+0000","last_clean_scrub_stamp":"2024-02-10T08:18:30.422800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"74'15","reported_seq":60,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.806401+0000","last_change":"2024-02-10T08:17:57.637408+0000","last_active":"2024-02-10T08:18:52.806401+0000","last_peered":"2024-02-10T08:18:52.806401+0000","last_clean":"2024-02-10T08:18:52.806401+0000","last_became_active":"2024-02-10T08:16:55.204738+0000","last_became_peered":"2024-02-10T08:16:55.204738+0000","last_unstale":"2024-02-10T08:18:52.806401+0000","last_undegraded":"2024-02-10T08:18:52.806401+0000","last_fullsized":"2024-02-10T08:18:52.806401+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'15","last_scrub_stamp":"2024-02-10T08:17:57.637346+0000","last_deep_scrub":"74'15","last_deep_scrub_stamp":"2024-02-10T08:17:57.637346+0000","last_clean_scrub_stamp":"2024-02-10T08:17:57.637346+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.542662+0000","last_change":"2024-02-10T08:18:28.180766+0000","last_active":"2024-02-10T08:18:52.542662+0000","last_peered":"2024-02-10T08:18:52.542662+0000","last_clean":"2024-02-10T08:18:52.542662+0000","last_became_active":"2024-02-10T08:16:58.892622+0000","last_became_peered":"2024-02-10T08:16:58.892622+0000","last_unstale":"2024-02-10T08:18:52.542662+0000","last_undegraded":"2024-02-10T08:18:52.542662+0000","last_fullsized":"2024-02-10T08:18:52.542662+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:28.180637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:28.180637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.821002+0000","last_change":"2024-02-10T08:18:01.783832+0000","last_active":"2024-02-10T08:18:52.821002+0000","last_peered":"2024-02-10T08:18:52.821002+0000","last_clean":"2024-02-10T08:18:52.821002+0000","last_became_active":"2024-02-10T08:16:56.860207+0000","last_became_peered":"2024-02-10T08:16:56.860207+0000","last_unstale":"2024-02-10T08:18:52.821002+0000","last_undegraded":"2024-02-10T08:18:52.821002+0000","last_fullsized":"2024-02-10T08:18:52.821002+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:01.783750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:01.783750+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":42,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.543429+0000","last_change":"2024-02-10T08:18:12.262783+0000","last_active":"2024-02-10T08:18:52.543429+0000","last_peered":"2024-02-10T08:18:52.543429+0000","last_clean":"2024-02-10T08:18:52.543429+0000","last_became_active":"2024-02-10T08:16:52.788629+0000","last_became_peered":"2024-02-10T08:16:52.788629+0000","last_unstale":"2024-02-10T08:18:52.543429+0000","last_undegraded":"2024-02-10T08:18:52.543429+0000","last_fullsized":"2024-02-10T08:18:52.543429+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:12.262707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:12.262707+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"62'11","reported_seq":60,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.542333+0000","last_change":"2024-02-10T08:18:25.169653+0000","last_active":"2024-02-10T08:18:52.542333+0000","last_peered":"2024-02-10T08:18:52.542333+0000","last_clean":"2024-02-10T08:18:52.542333+0000","last_became_active":"2024-02-10T08:16:55.204751+0000","last_became_peered":"2024-02-10T08:16:55.204751+0000","last_unstale":"2024-02-10T08:18:52.542333+0000","last_undegraded":"2024-02-10T08:18:52.542333+0000","last_fullsized":"2024-02-10T08:18:52.542333+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'11","last_scrub_stamp":"2024-02-10T08:18:25.169566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:25.169566+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.821850+0000","last_change":"2024-02-10T08:18:12.778101+0000","last_active":"2024-02-10T08:18:52.821850+0000","last_peered":"2024-02-10T08:18:52.821850+0000","last_clean":"2024-02-10T08:18:52.821850+0000","last_became_active":"2024-02-10T08:16:58.859979+0000","last_became_peered":"2024-02-10T08:16:58.859979+0000","last_unstale":"2024-02-10T08:18:52.821850+0000","last_undegraded":"2024-02-10T08:18:52.821850+0000","last_fullsized":"2024-02-10T08:18:52.821850+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:12.778021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:12.778021+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.542510+0000","last_change":"2024-02-10T08:18:34.381405+0000","last_active":"2024-02-10T08:18:52.542510+0000","last_peered":"2024-02-10T08:18:52.542510+0000","last_clean":"2024-02-10T08:18:52.542510+0000","last_became_active":"2024-02-10T08:16:56.859540+0000","last_became_peered":"2024-02-10T08:16:56.859540+0000","last_unstale":"2024-02-10T08:18:52.542510+0000","last_undegraded":"2024-02-10T08:18:52.542510+0000","last_fullsized":"2024-02-10T08:18:52.542510+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:34.381329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:34.381329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":42,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.820536+0000","last_change":"2024-02-10T08:18:05.347110+0000","last_active":"2024-02-10T08:18:52.820536+0000","last_peered":"2024-02-10T08:18:52.820536+0000","last_clean":"2024-02-10T08:18:52.820536+0000","last_became_active":"2024-02-10T08:16:52.788704+0000","last_became_peered":"2024-02-10T08:16:52.788704+0000","last_unstale":"2024-02-10T08:18:52.820536+0000","last_undegraded":"2024-02-10T08:18:52.820536+0000","last_fullsized":"2024-02-10T08:18:52.820536+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:05.347009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:05.347009+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"62'4","reported_seq":47,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.541991+0000","last_change":"2024-02-10T08:18:50.134758+0000","last_active":"2024-02-10T08:18:52.541991+0000","last_peered":"2024-02-10T08:18:52.541991+0000","last_clean":"2024-02-10T08:18:52.541991+0000","last_became_active":"2024-02-10T08:16:54.852959+0000","last_became_peered":"2024-02-10T08:16:54.852959+0000","last_unstale":"2024-02-10T08:18:52.541991+0000","last_undegraded":"2024-02-10T08:18:52.541991+0000","last_fullsized":"2024-02-10T08:18:52.541991+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'4","last_scrub_stamp":"2024-02-10T08:18:50.134690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:50.134690+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:19:02.030164+0000","last_change":"2024-02-10T08:19:02.030164+0000","last_active":"2024-02-10T08:19:02.030164+0000","last_peered":"2024-02-10T08:19:02.030164+0000","last_clean":"2024-02-10T08:19:02.030164+0000","last_became_active":"2024-02-10T08:16:58.864301+0000","last_became_peered":"2024-02-10T08:16:58.864301+0000","last_unstale":"2024-02-10T08:19:02.030164+0000","last_undegraded":"2024-02-10T08:19:02.030164+0000","last_fullsized":"2024-02-10T08:19:02.030164+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:02.030086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:19:02.030086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.819463+0000","last_change":"2024-02-10T08:18:30.157336+0000","last_active":"2024-02-10T08:18:52.819463+0000","last_peered":"2024-02-10T08:18:52.819463+0000","last_clean":"2024-02-10T08:18:52.819463+0000","last_became_active":"2024-02-10T08:16:56.860953+0000","last_became_peered":"2024-02-10T08:16:56.860953+0000","last_unstale":"2024-02-10T08:18:52.819463+0000","last_undegraded":"2024-02-10T08:18:52.819463+0000","last_fullsized":"2024-02-10T08:18:52.819463+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:30.157268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:30.157268+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":43,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.819560+0000","last_change":"2024-02-10T08:18:21.134912+0000","last_active":"2024-02-10T08:18:52.819560+0000","last_peered":"2024-02-10T08:18:52.819560+0000","last_clean":"2024-02-10T08:18:52.819560+0000","last_became_active":"2024-02-10T08:16:52.786400+0000","last_became_peered":"2024-02-10T08:16:52.786400+0000","last_unstale":"2024-02-10T08:18:52.819560+0000","last_undegraded":"2024-02-10T08:18:52.819560+0000","last_fullsized":"2024-02-10T08:18:52.819560+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:21.134826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:21.134826+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"62'11","reported_seq":81,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.820174+0000","last_change":"2024-02-10T08:18:18.168451+0000","last_active":"2024-02-10T08:18:52.820174+0000","last_peered":"2024-02-10T08:18:52.820174+0000","last_clean":"2024-02-10T08:18:52.820174+0000","last_became_active":"2024-02-10T08:18:18.162983+0000","last_became_peered":"2024-02-10T08:18:18.162983+0000","last_unstale":"2024-02-10T08:18:52.820174+0000","last_undegraded":"2024-02-10T08:18:52.820174+0000","last_fullsized":"2024-02-10T08:18:52.820174+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'11","last_scrub_stamp":"2024-02-10T08:18:17.029517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:17.029517+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":36,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:54.588850+0000","last_change":"2024-02-10T08:18:54.588850+0000","last_active":"2024-02-10T08:18:54.588850+0000","last_peered":"2024-02-10T08:18:54.588850+0000","last_clean":"2024-02-10T08:18:54.588850+0000","last_became_active":"2024-02-10T08:16:58.861031+0000","last_became_peered":"2024-02-10T08:16:58.861031+0000","last_unstale":"2024-02-10T08:18:54.588850+0000","last_undegraded":"2024-02-10T08:18:54.588850+0000","last_fullsized":"2024-02-10T08:18:54.588850+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:54.588775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:54.588775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:55.042056+0000","last_change":"2024-02-10T08:18:55.042056+0000","last_active":"2024-02-10T08:18:55.042056+0000","last_peered":"2024-02-10T08:18:55.042056+0000","last_clean":"2024-02-10T08:18:55.042056+0000","last_became_active":"2024-02-10T08:16:56.862136+0000","last_became_peered":"2024-02-10T08:16:56.862136+0000","last_unstale":"2024-02-10T08:18:55.042056+0000","last_undegraded":"2024-02-10T08:18:55.042056+0000","last_fullsized":"2024-02-10T08:18:55.042056+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:55.041978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:55.041978+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":42,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.543056+0000","last_change":"2024-02-10T08:17:58.226189+0000","last_active":"2024-02-10T08:18:52.543056+0000","last_peered":"2024-02-10T08:18:52.543056+0000","last_clean":"2024-02-10T08:18:52.543056+0000","last_became_active":"2024-02-10T08:16:52.786213+0000","last_became_peered":"2024-02-10T08:16:52.786213+0000","last_unstale":"2024-02-10T08:18:52.543056+0000","last_undegraded":"2024-02-10T08:18:52.543056+0000","last_fullsized":"2024-02-10T08:18:52.543056+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:17:58.226110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:17:58.226110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"62'9","reported_seq":57,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.819370+0000","last_change":"2024-02-10T08:18:03.050657+0000","last_active":"2024-02-10T08:18:52.819370+0000","last_peered":"2024-02-10T08:18:52.819370+0000","last_clean":"2024-02-10T08:18:52.819370+0000","last_became_active":"2024-02-10T08:16:54.851971+0000","last_became_peered":"2024-02-10T08:16:54.851971+0000","last_unstale":"2024-02-10T08:18:52.819370+0000","last_undegraded":"2024-02-10T08:18:52.819370+0000","last_fullsized":"2024-02-10T08:18:52.819370+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'9","last_scrub_stamp":"2024-02-10T08:18:03.050481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:03.050481+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.822546+0000","last_change":"2024-02-10T08:18:22.955891+0000","last_active":"2024-02-10T08:18:52.822546+0000","last_peered":"2024-02-10T08:18:52.822546+0000","last_clean":"2024-02-10T08:18:52.822546+0000","last_became_active":"2024-02-10T08:16:58.858961+0000","last_became_peered":"2024-02-10T08:16:58.858961+0000","last_unstale":"2024-02-10T08:18:52.822546+0000","last_undegraded":"2024-02-10T08:18:52.822546+0000","last_fullsized":"2024-02-10T08:18:52.822546+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:22.955823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:22.955823+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"62'8","reported_seq":73,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:55.921642+0000","last_change":"2024-02-10T08:18:23.120983+0000","last_active":"2024-02-10T08:18:55.921642+0000","last_peered":"2024-02-10T08:18:55.921642+0000","last_clean":"2024-02-10T08:18:55.921642+0000","last_became_active":"2024-02-10T08:16:56.854151+0000","last_became_peered":"2024-02-10T08:16:56.854151+0000","last_unstale":"2024-02-10T08:18:55.921642+0000","last_undegraded":"2024-02-10T08:18:55.921642+0000","last_fullsized":"2024-02-10T08:18:55.921642+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'8","last_scrub_stamp":"2024-02-10T08:18:23.120909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:23.120909+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":42,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.805398+0000","last_change":"2024-02-10T08:17:58.590022+0000","last_active":"2024-02-10T08:18:52.805398+0000","last_peered":"2024-02-10T08:18:52.805398+0000","last_clean":"2024-02-10T08:18:52.805398+0000","last_became_active":"2024-02-10T08:16:52.786492+0000","last_became_peered":"2024-02-10T08:16:52.786492+0000","last_unstale":"2024-02-10T08:18:52.805398+0000","last_undegraded":"2024-02-10T08:18:52.805398+0000","last_fullsized":"2024-02-10T08:18:52.805398+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:17:58.589941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:17:58.589941+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"62'9","reported_seq":56,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.819913+0000","last_change":"2024-02-10T08:18:48.370939+0000","last_active":"2024-02-10T08:18:52.819913+0000","last_peered":"2024-02-10T08:18:52.819913+0000","last_clean":"2024-02-10T08:18:52.819913+0000","last_became_active":"2024-02-10T08:16:55.204734+0000","last_became_peered":"2024-02-10T08:16:55.204734+0000","last_unstale":"2024-02-10T08:18:52.819913+0000","last_undegraded":"2024-02-10T08:18:52.819913+0000","last_fullsized":"2024-02-10T08:18:52.819913+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'9","last_scrub_stamp":"2024-02-10T08:18:48.370832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:48.370832+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.806266+0000","last_change":"2024-02-10T08:18:05.663042+0000","last_active":"2024-02-10T08:18:52.806266+0000","last_peered":"2024-02-10T08:18:52.806266+0000","last_clean":"2024-02-10T08:18:52.806266+0000","last_became_active":"2024-02-10T08:16:58.869673+0000","last_became_peered":"2024-02-10T08:16:58.869673+0000","last_unstale":"2024-02-10T08:18:52.806266+0000","last_undegraded":"2024-02-10T08:18:52.806266+0000","last_fullsized":"2024-02-10T08:18:52.806266+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:05.662947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:05.662947+0000","last_clean_scrub_stamp":"2024-02-10T08:18:05.662947+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"62'8","reported_seq":72,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:55.921839+0000","last_change":"2024-02-10T08:18:23.419433+0000","last_active":"2024-02-10T08:18:55.921839+0000","last_peered":"2024-02-10T08:18:55.921839+0000","last_clean":"2024-02-10T08:18:55.921839+0000","last_became_active":"2024-02-10T08:16:56.864587+0000","last_became_peered":"2024-02-10T08:16:56.864587+0000","last_unstale":"2024-02-10T08:18:55.921839+0000","last_undegraded":"2024-02-10T08:18:55.921839+0000","last_fullsized":"2024-02-10T08:18:55.921839+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'8","last_scrub_stamp":"2024-02-10T08:18:23.419353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:23.419353+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":42,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.819274+0000","last_change":"2024-02-10T08:18:34.327085+0000","last_active":"2024-02-10T08:18:52.819274+0000","last_peered":"2024-02-10T08:18:52.819274+0000","last_clean":"2024-02-10T08:18:52.819274+0000","last_became_active":"2024-02-10T08:16:52.789834+0000","last_became_peered":"2024-02-10T08:16:52.789834+0000","last_unstale":"2024-02-10T08:18:52.819274+0000","last_undegraded":"2024-02-10T08:18:52.819274+0000","last_fullsized":"2024-02-10T08:18:52.819274+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:34.326987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:34.326987+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"62'10","reported_seq":56,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.544257+0000","last_change":"2024-02-10T08:17:57.019329+0000","last_active":"2024-02-10T08:18:52.544257+0000","last_peered":"2024-02-10T08:18:52.544257+0000","last_clean":"2024-02-10T08:18:52.544257+0000","last_became_active":"2024-02-10T08:16:55.204789+0000","last_became_peered":"2024-02-10T08:16:55.204789+0000","last_unstale":"2024-02-10T08:18:52.544257+0000","last_undegraded":"2024-02-10T08:18:52.544257+0000","last_fullsized":"2024-02-10T08:18:52.544257+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'10","last_scrub_stamp":"2024-02-10T08:17:57.019263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:17:57.019263+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.822502+0000","last_change":"2024-02-10T08:18:22.944672+0000","last_active":"2024-02-10T08:18:52.822502+0000","last_peered":"2024-02-10T08:18:52.822502+0000","last_clean":"2024-02-10T08:18:52.822502+0000","last_became_active":"2024-02-10T08:16:58.893128+0000","last_became_peered":"2024-02-10T08:16:58.893128+0000","last_unstale":"2024-02-10T08:18:52.822502+0000","last_undegraded":"2024-02-10T08:18:52.822502+0000","last_fullsized":"2024-02-10T08:18:52.822502+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:22.944593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:22.944593+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.820854+0000","last_change":"2024-02-10T08:18:49.369603+0000","last_active":"2024-02-10T08:18:52.820854+0000","last_peered":"2024-02-10T08:18:52.820854+0000","last_clean":"2024-02-10T08:18:52.820854+0000","last_became_active":"2024-02-10T08:16:56.863948+0000","last_became_peered":"2024-02-10T08:16:56.863948+0000","last_unstale":"2024-02-10T08:18:52.820854+0000","last_undegraded":"2024-02-10T08:18:52.820854+0000","last_fullsized":"2024-02-10T08:18:52.820854+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:49.369500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:49.369500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":42,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.542536+0000","last_change":"2024-02-10T08:18:08.233178+0000","last_active":"2024-02-10T08:18:52.542536+0000","last_peered":"2024-02-10T08:18:52.542536+0000","last_clean":"2024-02-10T08:18:52.542536+0000","last_became_active":"2024-02-10T08:16:52.782434+0000","last_became_peered":"2024-02-10T08:16:52.782434+0000","last_unstale":"2024-02-10T08:18:52.542536+0000","last_undegraded":"2024-02-10T08:18:52.542536+0000","last_fullsized":"2024-02-10T08:18:52.542536+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:08.233096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:08.233096+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"62'6","reported_seq":50,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.544576+0000","last_change":"2024-02-10T08:18:42.100646+0000","last_active":"2024-02-10T08:18:52.544576+0000","last_peered":"2024-02-10T08:18:52.544576+0000","last_clean":"2024-02-10T08:18:52.544576+0000","last_became_active":"2024-02-10T08:16:55.203401+0000","last_became_peered":"2024-02-10T08:16:55.203401+0000","last_unstale":"2024-02-10T08:18:52.544576+0000","last_undegraded":"2024-02-10T08:18:52.544576+0000","last_fullsized":"2024-02-10T08:18:52.544576+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'6","last_scrub_stamp":"2024-02-10T08:18:42.100550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:42.100550+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.545487+0000","last_change":"2024-02-10T08:18:10.716849+0000","last_active":"2024-02-10T08:18:52.545487+0000","last_peered":"2024-02-10T08:18:52.545487+0000","last_clean":"2024-02-10T08:18:52.545487+0000","last_became_active":"2024-02-10T08:16:58.857790+0000","last_became_peered":"2024-02-10T08:16:58.857790+0000","last_unstale":"2024-02-10T08:18:52.545487+0000","last_undegraded":"2024-02-10T08:18:52.545487+0000","last_fullsized":"2024-02-10T08:18:52.545487+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:10.716763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:10.716763+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.544740+0000","last_change":"2024-02-10T08:18:22.074334+0000","last_active":"2024-02-10T08:18:52.544740+0000","last_peered":"2024-02-10T08:18:52.544740+0000","last_clean":"2024-02-10T08:18:52.544740+0000","last_became_active":"2024-02-10T08:16:56.860904+0000","last_became_peered":"2024-02-10T08:16:56.860904+0000","last_unstale":"2024-02-10T08:18:52.544740+0000","last_undegraded":"2024-02-10T08:18:52.544740+0000","last_fullsized":"2024-02-10T08:18:52.544740+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:22.074268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:22.074268+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"55'1","reported_seq":49,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.544297+0000","last_change":"2024-02-10T08:18:03.695320+0000","last_active":"2024-02-10T08:18:52.544297+0000","last_peered":"2024-02-10T08:18:52.544297+0000","last_clean":"2024-02-10T08:18:52.544297+0000","last_became_active":"2024-02-10T08:16:52.782734+0000","last_became_peered":"2024-02-10T08:16:52.782734+0000","last_unstale":"2024-02-10T08:18:52.544297+0000","last_undegraded":"2024-02-10T08:18:52.544297+0000","last_fullsized":"2024-02-10T08:18:52.544297+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'1","last_scrub_stamp":"2024-02-10T08:18:03.695203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:03.695203+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"62'9","reported_seq":56,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.806370+0000","last_change":"2024-02-10T08:18:09.641466+0000","last_active":"2024-02-10T08:18:52.806370+0000","last_peered":"2024-02-10T08:18:52.806370+0000","last_clean":"2024-02-10T08:18:52.806370+0000","last_became_active":"2024-02-10T08:16:55.204727+0000","last_became_peered":"2024-02-10T08:16:55.204727+0000","last_unstale":"2024-02-10T08:18:52.806370+0000","last_undegraded":"2024-02-10T08:18:52.806370+0000","last_fullsized":"2024-02-10T08:18:52.806370+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'9","last_scrub_stamp":"2024-02-10T08:18:09.641378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:09.641378+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.542587+0000","last_change":"2024-02-10T08:18:32.027821+0000","last_active":"2024-02-10T08:18:52.542587+0000","last_peered":"2024-02-10T08:18:52.542587+0000","last_clean":"2024-02-10T08:18:52.542587+0000","last_became_active":"2024-02-10T08:16:58.868848+0000","last_became_peered":"2024-02-10T08:16:58.868848+0000","last_unstale":"2024-02-10T08:18:52.542587+0000","last_undegraded":"2024-02-10T08:18:52.542587+0000","last_fullsized":"2024-02-10T08:18:52.542587+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:32.027720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:32.027720+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"55'2","reported_seq":56,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.822372+0000","last_change":"2024-02-10T08:18:03.916402+0000","last_active":"2024-02-10T08:18:52.822372+0000","last_peered":"2024-02-10T08:18:52.822372+0000","last_clean":"2024-02-10T08:18:52.822372+0000","last_became_active":"2024-02-10T08:16:52.789545+0000","last_became_peered":"2024-02-10T08:16:52.789545+0000","last_unstale":"2024-02-10T08:18:52.822372+0000","last_undegraded":"2024-02-10T08:18:52.822372+0000","last_fullsized":"2024-02-10T08:18:52.822372+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'2","last_scrub_stamp":"2024-02-10T08:18:03.916322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:03.916322+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"82'17","reported_seq":69,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.819731+0000","last_change":"2024-02-10T08:18:21.015975+0000","last_active":"2024-02-10T08:18:52.819731+0000","last_peered":"2024-02-10T08:18:52.819731+0000","last_clean":"2024-02-10T08:18:52.819731+0000","last_became_active":"2024-02-10T08:16:54.848324+0000","last_became_peered":"2024-02-10T08:16:54.848324+0000","last_unstale":"2024-02-10T08:18:52.819731+0000","last_undegraded":"2024-02-10T08:18:52.819731+0000","last_fullsized":"2024-02-10T08:18:52.819731+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'17","last_scrub_stamp":"2024-02-10T08:18:21.015873+0000","last_deep_scrub":"82'17","last_deep_scrub_stamp":"2024-02-10T08:18:21.015873+0000","last_clean_scrub_stamp":"2024-02-10T08:18:21.015873+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.545068+0000","last_change":"2024-02-10T08:17:59.810321+0000","last_active":"2024-02-10T08:18:52.545068+0000","last_peered":"2024-02-10T08:18:52.545068+0000","last_clean":"2024-02-10T08:18:52.545068+0000","last_became_active":"2024-02-10T08:16:56.860850+0000","last_became_peered":"2024-02-10T08:16:56.860850+0000","last_unstale":"2024-02-10T08:18:52.545068+0000","last_undegraded":"2024-02-10T08:18:52.545068+0000","last_fullsized":"2024-02-10T08:18:52.545068+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:17:59.810251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:17:59.810251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.805544+0000","last_change":"2024-02-10T08:18:01.698201+0000","last_active":"2024-02-10T08:18:52.805544+0000","last_peered":"2024-02-10T08:18:52.805544+0000","last_clean":"2024-02-10T08:18:52.805544+0000","last_became_active":"2024-02-10T08:16:58.864957+0000","last_became_peered":"2024-02-10T08:16:58.864957+0000","last_unstale":"2024-02-10T08:18:52.805544+0000","last_undegraded":"2024-02-10T08:18:52.805544+0000","last_fullsized":"2024-02-10T08:18:52.805544+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:01.698093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:01.698093+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":43,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.819485+0000","last_change":"2024-02-10T08:18:36.311616+0000","last_active":"2024-02-10T08:18:52.819485+0000","last_peered":"2024-02-10T08:18:52.819485+0000","last_clean":"2024-02-10T08:18:52.819485+0000","last_became_active":"2024-02-10T08:16:52.789354+0000","last_became_peered":"2024-02-10T08:16:52.789354+0000","last_unstale":"2024-02-10T08:18:52.819485+0000","last_undegraded":"2024-02-10T08:18:52.819485+0000","last_fullsized":"2024-02-10T08:18:52.819485+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:36.311445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:36.311445+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"62'10","reported_seq":56,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.819418+0000","last_change":"2024-02-10T08:18:26.189282+0000","last_active":"2024-02-10T08:18:52.819418+0000","last_peered":"2024-02-10T08:18:52.819418+0000","last_clean":"2024-02-10T08:18:52.819418+0000","last_became_active":"2024-02-10T08:16:54.851420+0000","last_became_peered":"2024-02-10T08:16:54.851420+0000","last_unstale":"2024-02-10T08:18:52.819418+0000","last_undegraded":"2024-02-10T08:18:52.819418+0000","last_fullsized":"2024-02-10T08:18:52.819418+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'10","last_scrub_stamp":"2024-02-10T08:18:26.189127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:26.189127+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"62'8","reported_seq":72,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:55.921523+0000","last_change":"2024-02-10T08:18:35.727254+0000","last_active":"2024-02-10T08:18:55.921523+0000","last_peered":"2024-02-10T08:18:55.921523+0000","last_clean":"2024-02-10T08:18:55.921523+0000","last_became_active":"2024-02-10T08:16:56.862677+0000","last_became_peered":"2024-02-10T08:16:56.862677+0000","last_unstale":"2024-02-10T08:18:55.921523+0000","last_undegraded":"2024-02-10T08:18:55.921523+0000","last_fullsized":"2024-02-10T08:18:55.921523+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'8","last_scrub_stamp":"2024-02-10T08:18:35.727104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:35.727104+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.544859+0000","last_change":"2024-02-10T08:18:47.116797+0000","last_active":"2024-02-10T08:18:52.544859+0000","last_peered":"2024-02-10T08:18:52.544859+0000","last_clean":"2024-02-10T08:18:52.544859+0000","last_became_active":"2024-02-10T08:16:58.868746+0000","last_became_peered":"2024-02-10T08:16:58.868746+0000","last_unstale":"2024-02-10T08:18:52.544859+0000","last_undegraded":"2024-02-10T08:18:52.544859+0000","last_fullsized":"2024-02-10T08:18:52.544859+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:47.116727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:47.116727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":42,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.819148+0000","last_change":"2024-02-10T08:18:40.357832+0000","last_active":"2024-02-10T08:18:52.819148+0000","last_peered":"2024-02-10T08:18:52.819148+0000","last_clean":"2024-02-10T08:18:52.819148+0000","last_became_active":"2024-02-10T08:16:52.791027+0000","last_became_peered":"2024-02-10T08:16:52.791027+0000","last_unstale":"2024-02-10T08:18:52.819148+0000","last_undegraded":"2024-02-10T08:18:52.819148+0000","last_fullsized":"2024-02-10T08:18:52.819148+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:40.357758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:40.357758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"62'28","reported_seq":120,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:19:00.452998+0000","last_change":"2024-02-10T08:19:00.452971+0000","last_active":"2024-02-10T08:19:00.452998+0000","last_peered":"2024-02-10T08:19:00.452998+0000","last_clean":"2024-02-10T08:19:00.452998+0000","last_became_active":"2024-02-10T08:16:54.856000+0000","last_became_peered":"2024-02-10T08:16:54.856000+0000","last_unstale":"2024-02-10T08:19:00.452998+0000","last_undegraded":"2024-02-10T08:19:00.452998+0000","last_fullsized":"2024-02-10T08:19:00.452998+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'28","last_scrub_stamp":"2024-02-10T08:19:00.452887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:19:00.452887+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":48,"num_read_kb":33,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.806317+0000","last_change":"2024-02-10T08:18:51.533191+0000","last_active":"2024-02-10T08:18:52.806317+0000","last_peered":"2024-02-10T08:18:52.806317+0000","last_clean":"2024-02-10T08:18:52.806317+0000","last_became_active":"2024-02-10T08:16:56.864887+0000","last_became_peered":"2024-02-10T08:16:56.864887+0000","last_unstale":"2024-02-10T08:18:52.806317+0000","last_undegraded":"2024-02-10T08:18:52.806317+0000","last_fullsized":"2024-02-10T08:18:52.806317+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:51.533128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:51.533128+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.822656+0000","last_change":"2024-02-10T08:18:11.750615+0000","last_active":"2024-02-10T08:18:52.822656+0000","last_peered":"2024-02-10T08:18:52.822656+0000","last_clean":"2024-02-10T08:18:52.822656+0000","last_became_active":"2024-02-10T08:16:58.891249+0000","last_became_peered":"2024-02-10T08:16:58.891249+0000","last_unstale":"2024-02-10T08:18:52.822656+0000","last_undegraded":"2024-02-10T08:18:52.822656+0000","last_fullsized":"2024-02-10T08:18:52.822656+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:11.750537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:11.750537+0000","last_clean_scrub_stamp":"2024-02-10T08:18:11.750537+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"63'5","reported_seq":168,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:19:00.987063+0000","last_change":"2024-02-10T08:18:04.042479+0000","last_active":"2024-02-10T08:19:00.987063+0000","last_peered":"2024-02-10T08:19:00.987063+0000","last_clean":"2024-02-10T08:19:00.987063+0000","last_became_active":"2024-02-10T08:16:52.780989+0000","last_became_peered":"2024-02-10T08:16:52.780989+0000","last_unstale":"2024-02-10T08:19:00.987063+0000","last_undegraded":"2024-02-10T08:19:00.987063+0000","last_fullsized":"2024-02-10T08:19:00.987063+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'5","last_scrub_stamp":"2024-02-10T08:18:04.042403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:04.042403+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":122,"num_read_kb":117,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":43,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.544499+0000","last_change":"2024-02-10T08:18:11.681290+0000","last_active":"2024-02-10T08:18:52.544499+0000","last_peered":"2024-02-10T08:18:52.544499+0000","last_clean":"2024-02-10T08:18:52.544499+0000","last_became_active":"2024-02-10T08:16:52.787737+0000","last_became_peered":"2024-02-10T08:16:52.787737+0000","last_unstale":"2024-02-10T08:18:52.544499+0000","last_undegraded":"2024-02-10T08:18:52.544499+0000","last_fullsized":"2024-02-10T08:18:52.544499+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:11.681169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:11.681169+0000","last_clean_scrub_stamp":"2024-02-10T08:18:11.681169+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"62'13","reported_seq":68,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.819754+0000","last_change":"2024-02-10T08:18:39.241207+0000","last_active":"2024-02-10T08:18:52.819754+0000","last_peered":"2024-02-10T08:18:52.819754+0000","last_clean":"2024-02-10T08:18:52.819754+0000","last_became_active":"2024-02-10T08:16:54.850812+0000","last_became_peered":"2024-02-10T08:16:54.850812+0000","last_unstale":"2024-02-10T08:18:52.819754+0000","last_undegraded":"2024-02-10T08:18:52.819754+0000","last_fullsized":"2024-02-10T08:18:52.819754+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'13","last_scrub_stamp":"2024-02-10T08:18:39.240947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:39.240947+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.545290+0000","last_change":"2024-02-10T08:18:28.603605+0000","last_active":"2024-02-10T08:18:52.545290+0000","last_peered":"2024-02-10T08:18:52.545290+0000","last_clean":"2024-02-10T08:18:52.545290+0000","last_became_active":"2024-02-10T08:16:56.857856+0000","last_became_peered":"2024-02-10T08:16:56.857856+0000","last_unstale":"2024-02-10T08:18:52.545290+0000","last_undegraded":"2024-02-10T08:18:52.545290+0000","last_fullsized":"2024-02-10T08:18:52.545290+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:28.603511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:28.603511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.821308+0000","last_change":"2024-02-10T08:18:45.380034+0000","last_active":"2024-02-10T08:18:52.821308+0000","last_peered":"2024-02-10T08:18:52.821308+0000","last_clean":"2024-02-10T08:18:52.821308+0000","last_became_active":"2024-02-10T08:16:58.867978+0000","last_became_peered":"2024-02-10T08:16:58.867978+0000","last_unstale":"2024-02-10T08:18:52.821308+0000","last_undegraded":"2024-02-10T08:18:52.821308+0000","last_fullsized":"2024-02-10T08:18:52.821308+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:45.379932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:45.379932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":43,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.542137+0000","last_change":"2024-02-10T08:18:07.008482+0000","last_active":"2024-02-10T08:18:52.542137+0000","last_peered":"2024-02-10T08:18:52.542137+0000","last_clean":"2024-02-10T08:18:52.542137+0000","last_became_active":"2024-02-10T08:16:52.788195+0000","last_became_peered":"2024-02-10T08:16:52.788195+0000","last_unstale":"2024-02-10T08:18:52.542137+0000","last_undegraded":"2024-02-10T08:18:52.542137+0000","last_fullsized":"2024-02-10T08:18:52.542137+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:07.008399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:07.008399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":42,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.819003+0000","last_change":"2024-02-10T08:18:19.390305+0000","last_active":"2024-02-10T08:18:52.819003+0000","last_peered":"2024-02-10T08:18:52.819003+0000","last_clean":"2024-02-10T08:18:52.819003+0000","last_became_active":"2024-02-10T08:16:52.788767+0000","last_became_peered":"2024-02-10T08:16:52.788767+0000","last_unstale":"2024-02-10T08:18:52.819003+0000","last_undegraded":"2024-02-10T08:18:52.819003+0000","last_fullsized":"2024-02-10T08:18:52.819003+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:19.390239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:19.390239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":51,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.820770+0000","last_change":"2024-02-10T08:18:24.982997+0000","last_active":"2024-02-10T08:18:52.820770+0000","last_peered":"2024-02-10T08:18:52.820770+0000","last_clean":"2024-02-10T08:18:52.820770+0000","last_became_active":"2024-02-10T08:16:46.402267+0000","last_became_peered":"2024-02-10T08:16:46.402267+0000","last_unstale":"2024-02-10T08:18:52.820770+0000","last_undegraded":"2024-02-10T08:18:52.820770+0000","last_fullsized":"2024-02-10T08:18:52.820770+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:24.982932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:14:44.584370+0000","last_clean_scrub_stamp":"2024-02-10T08:18:24.982932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"62'14","reported_seq":62,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.543126+0000","last_change":"2024-02-10T08:18:33.416443+0000","last_active":"2024-02-10T08:18:52.543126+0000","last_peered":"2024-02-10T08:18:52.543126+0000","last_clean":"2024-02-10T08:18:52.543126+0000","last_became_active":"2024-02-10T08:16:55.204616+0000","last_became_peered":"2024-02-10T08:16:55.204616+0000","last_unstale":"2024-02-10T08:18:52.543126+0000","last_undegraded":"2024-02-10T08:18:52.543126+0000","last_fullsized":"2024-02-10T08:18:52.543126+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'14","last_scrub_stamp":"2024-02-10T08:18:33.416365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:33.416365+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":15,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.822277+0000","last_change":"2024-02-10T08:18:04.766868+0000","last_active":"2024-02-10T08:18:52.822277+0000","last_peered":"2024-02-10T08:18:52.822277+0000","last_clean":"2024-02-10T08:18:52.822277+0000","last_became_active":"2024-02-10T08:16:56.867159+0000","last_became_peered":"2024-02-10T08:16:56.867159+0000","last_unstale":"2024-02-10T08:18:52.822277+0000","last_undegraded":"2024-02-10T08:18:52.822277+0000","last_fullsized":"2024-02-10T08:18:52.822277+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:04.766780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:04.766780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:04.766780+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.819294+0000","last_change":"2024-02-10T08:18:41.255265+0000","last_active":"2024-02-10T08:18:52.819294+0000","last_peered":"2024-02-10T08:18:52.819294+0000","last_clean":"2024-02-10T08:18:52.819294+0000","last_became_active":"2024-02-10T08:16:58.867593+0000","last_became_peered":"2024-02-10T08:16:58.867593+0000","last_unstale":"2024-02-10T08:18:52.819294+0000","last_undegraded":"2024-02-10T08:18:52.819294+0000","last_fullsized":"2024-02-10T08:18:52.819294+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:41.255196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:41.255196+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":44,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.805400+0000","last_change":"2024-02-10T08:18:20.736287+0000","last_active":"2024-02-10T08:18:52.805400+0000","last_peered":"2024-02-10T08:18:52.805400+0000","last_clean":"2024-02-10T08:18:52.805400+0000","last_became_active":"2024-02-10T08:16:52.782840+0000","last_became_peered":"2024-02-10T08:16:52.782840+0000","last_unstale":"2024-02-10T08:18:52.805400+0000","last_undegraded":"2024-02-10T08:18:52.805400+0000","last_fullsized":"2024-02-10T08:18:52.805400+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:20.736224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:20.736224+0000","last_clean_scrub_stamp":"2024-02-10T08:18:20.736224+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":42,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.820720+0000","last_change":"2024-02-10T08:18:14.858038+0000","last_active":"2024-02-10T08:18:52.820720+0000","last_peered":"2024-02-10T08:18:52.820720+0000","last_clean":"2024-02-10T08:18:52.820720+0000","last_became_active":"2024-02-10T08:16:52.787180+0000","last_became_peered":"2024-02-10T08:16:52.787180+0000","last_unstale":"2024-02-10T08:18:52.820720+0000","last_undegraded":"2024-02-10T08:18:52.820720+0000","last_fullsized":"2024-02-10T08:18:52.820720+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:14.857925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:14.857925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"62'12","reported_seq":58,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.806278+0000","last_change":"2024-02-10T08:18:34.720492+0000","last_active":"2024-02-10T08:18:52.806278+0000","last_peered":"2024-02-10T08:18:52.806278+0000","last_clean":"2024-02-10T08:18:52.806278+0000","last_became_active":"2024-02-10T08:16:54.853330+0000","last_became_peered":"2024-02-10T08:16:54.853330+0000","last_unstale":"2024-02-10T08:18:52.806278+0000","last_undegraded":"2024-02-10T08:18:52.806278+0000","last_fullsized":"2024-02-10T08:18:52.806278+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'12","last_scrub_stamp":"2024-02-10T08:18:34.720419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:34.720419+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.821229+0000","last_change":"2024-02-10T08:18:41.360314+0000","last_active":"2024-02-10T08:18:52.821229+0000","last_peered":"2024-02-10T08:18:52.821229+0000","last_clean":"2024-02-10T08:18:52.821229+0000","last_became_active":"2024-02-10T08:16:56.864030+0000","last_became_peered":"2024-02-10T08:16:56.864030+0000","last_unstale":"2024-02-10T08:18:52.821229+0000","last_undegraded":"2024-02-10T08:18:52.821229+0000","last_fullsized":"2024-02-10T08:18:52.821229+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:41.360241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:41.360241+0000","last_clean_scrub_stamp":"2024-02-10T08:18:41.360241+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.819098+0000","last_change":"2024-02-10T08:18:13.057393+0000","last_active":"2024-02-10T08:18:52.819098+0000","last_peered":"2024-02-10T08:18:52.819098+0000","last_clean":"2024-02-10T08:18:52.819098+0000","last_became_active":"2024-02-10T08:16:58.891287+0000","last_became_peered":"2024-02-10T08:16:58.891287+0000","last_unstale":"2024-02-10T08:18:52.819098+0000","last_undegraded":"2024-02-10T08:18:52.819098+0000","last_fullsized":"2024-02-10T08:18:52.819098+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:13.057266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:13.057266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.545177+0000","last_change":"2024-02-10T08:18:18.163873+0000","last_active":"2024-02-10T08:18:52.545177+0000","last_peered":"2024-02-10T08:18:52.545177+0000","last_clean":"2024-02-10T08:18:52.545177+0000","last_became_active":"2024-02-10T08:18:18.163475+0000","last_became_peered":"2024-02-10T08:18:18.163475+0000","last_unstale":"2024-02-10T08:18:52.545177+0000","last_undegraded":"2024-02-10T08:18:52.545177+0000","last_fullsized":"2024-02-10T08:18:52.545177+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:16.912336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:16.912336+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4],"acting":[2,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"62'19","reported_seq":76,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.806058+0000","last_change":"2024-02-10T08:18:26.755417+0000","last_active":"2024-02-10T08:18:52.806058+0000","last_peered":"2024-02-10T08:18:52.806058+0000","last_clean":"2024-02-10T08:18:52.806058+0000","last_became_active":"2024-02-10T08:16:55.203453+0000","last_became_peered":"2024-02-10T08:16:55.203453+0000","last_unstale":"2024-02-10T08:18:52.806058+0000","last_undegraded":"2024-02-10T08:18:52.806058+0000","last_fullsized":"2024-02-10T08:18:52.806058+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'19","last_scrub_stamp":"2024-02-10T08:18:26.755321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:26.755321+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.542937+0000","last_change":"2024-02-10T08:18:17.299894+0000","last_active":"2024-02-10T08:18:52.542937+0000","last_peered":"2024-02-10T08:18:52.542937+0000","last_clean":"2024-02-10T08:18:52.542937+0000","last_became_active":"2024-02-10T08:16:56.861172+0000","last_became_peered":"2024-02-10T08:16:56.861172+0000","last_unstale":"2024-02-10T08:18:52.542937+0000","last_undegraded":"2024-02-10T08:18:52.542937+0000","last_fullsized":"2024-02-10T08:18:52.542937+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:17.299814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:17.299814+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.821419+0000","last_change":"2024-02-10T08:18:04.882451+0000","last_active":"2024-02-10T08:18:52.821419+0000","last_peered":"2024-02-10T08:18:52.821419+0000","last_clean":"2024-02-10T08:18:52.821419+0000","last_became_active":"2024-02-10T08:16:58.863795+0000","last_became_peered":"2024-02-10T08:16:58.863795+0000","last_unstale":"2024-02-10T08:18:52.821419+0000","last_undegraded":"2024-02-10T08:18:52.821419+0000","last_fullsized":"2024-02-10T08:18:52.821419+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:04.882389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:04.882389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":43,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.818942+0000","last_change":"2024-02-10T08:18:12.069405+0000","last_active":"2024-02-10T08:18:52.818942+0000","last_peered":"2024-02-10T08:18:52.818942+0000","last_clean":"2024-02-10T08:18:52.818942+0000","last_became_active":"2024-02-10T08:16:52.781197+0000","last_became_peered":"2024-02-10T08:16:52.781197+0000","last_unstale":"2024-02-10T08:18:52.818942+0000","last_undegraded":"2024-02-10T08:18:52.818942+0000","last_fullsized":"2024-02-10T08:18:52.818942+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:12.069322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:12.069322+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"62'18","reported_seq":73,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.541883+0000","last_change":"2024-02-10T08:18:41.077152+0000","last_active":"2024-02-10T08:18:52.541883+0000","last_peered":"2024-02-10T08:18:52.541883+0000","last_clean":"2024-02-10T08:18:52.541883+0000","last_became_active":"2024-02-10T08:16:55.204981+0000","last_became_peered":"2024-02-10T08:16:55.204981+0000","last_unstale":"2024-02-10T08:18:52.541883+0000","last_undegraded":"2024-02-10T08:18:52.541883+0000","last_fullsized":"2024-02-10T08:18:52.541883+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'18","last_scrub_stamp":"2024-02-10T08:18:41.077080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:41.077080+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.819889+0000","last_change":"2024-02-10T08:18:15.980065+0000","last_active":"2024-02-10T08:18:52.819889+0000","last_peered":"2024-02-10T08:18:52.819889+0000","last_clean":"2024-02-10T08:18:52.819889+0000","last_became_active":"2024-02-10T08:16:56.858362+0000","last_became_peered":"2024-02-10T08:16:56.858362+0000","last_unstale":"2024-02-10T08:18:52.819889+0000","last_undegraded":"2024-02-10T08:18:52.819889+0000","last_fullsized":"2024-02-10T08:18:52.819889+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:15.979973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:15.979973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.819985+0000","last_change":"2024-02-10T08:18:15.893937+0000","last_active":"2024-02-10T08:18:52.819985+0000","last_peered":"2024-02-10T08:18:52.819985+0000","last_clean":"2024-02-10T08:18:52.819985+0000","last_became_active":"2024-02-10T08:16:58.893253+0000","last_became_peered":"2024-02-10T08:16:58.893253+0000","last_unstale":"2024-02-10T08:18:52.819985+0000","last_undegraded":"2024-02-10T08:18:52.819985+0000","last_fullsized":"2024-02-10T08:18:52.819985+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:15.893858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:15.893858+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":42,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.543360+0000","last_change":"2024-02-10T08:18:11.227796+0000","last_active":"2024-02-10T08:18:52.543360+0000","last_peered":"2024-02-10T08:18:52.543360+0000","last_clean":"2024-02-10T08:18:52.543360+0000","last_became_active":"2024-02-10T08:16:52.789020+0000","last_became_peered":"2024-02-10T08:16:52.789020+0000","last_unstale":"2024-02-10T08:18:52.543360+0000","last_undegraded":"2024-02-10T08:18:52.543360+0000","last_fullsized":"2024-02-10T08:18:52.543360+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:11.227682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:11.227682+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"62'14","reported_seq":62,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.819634+0000","last_change":"2024-02-10T08:18:10.980504+0000","last_active":"2024-02-10T08:18:52.819634+0000","last_peered":"2024-02-10T08:18:52.819634+0000","last_clean":"2024-02-10T08:18:52.819634+0000","last_became_active":"2024-02-10T08:16:54.844168+0000","last_became_peered":"2024-02-10T08:16:54.844168+0000","last_unstale":"2024-02-10T08:18:52.819634+0000","last_undegraded":"2024-02-10T08:18:52.819634+0000","last_fullsized":"2024-02-10T08:18:52.819634+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'14","last_scrub_stamp":"2024-02-10T08:18:10.980421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:10.980421+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"62'8","reported_seq":73,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:55.921681+0000","last_change":"2024-02-10T08:18:30.090145+0000","last_active":"2024-02-10T08:18:55.921681+0000","last_peered":"2024-02-10T08:18:55.921681+0000","last_clean":"2024-02-10T08:18:55.921681+0000","last_became_active":"2024-02-10T08:16:56.857343+0000","last_became_peered":"2024-02-10T08:16:56.857343+0000","last_unstale":"2024-02-10T08:18:55.921681+0000","last_undegraded":"2024-02-10T08:18:55.921681+0000","last_fullsized":"2024-02-10T08:18:55.921681+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'8","last_scrub_stamp":"2024-02-10T08:18:30.090065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:30.090065+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":37,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:56.053946+0000","last_change":"2024-02-10T08:18:56.053946+0000","last_active":"2024-02-10T08:18:56.053946+0000","last_peered":"2024-02-10T08:18:56.053946+0000","last_clean":"2024-02-10T08:18:56.053946+0000","last_became_active":"2024-02-10T08:16:58.891261+0000","last_became_peered":"2024-02-10T08:16:58.891261+0000","last_unstale":"2024-02-10T08:18:56.053946+0000","last_undegraded":"2024-02-10T08:18:56.053946+0000","last_fullsized":"2024-02-10T08:18:56.053946+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:56.053817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:56.053817+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.821202+0000","last_change":"2024-02-10T08:18:25.442160+0000","last_active":"2024-02-10T08:18:52.821202+0000","last_peered":"2024-02-10T08:18:52.821202+0000","last_clean":"2024-02-10T08:18:52.821202+0000","last_became_active":"2024-02-10T08:16:56.860674+0000","last_became_peered":"2024-02-10T08:16:56.860674+0000","last_unstale":"2024-02-10T08:18:52.821202+0000","last_undegraded":"2024-02-10T08:18:52.821202+0000","last_fullsized":"2024-02-10T08:18:52.821202+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:25.442097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:25.442097+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":42,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.820815+0000","last_change":"2024-02-10T08:17:56.774386+0000","last_active":"2024-02-10T08:18:52.820815+0000","last_peered":"2024-02-10T08:18:52.820815+0000","last_clean":"2024-02-10T08:18:52.820815+0000","last_became_active":"2024-02-10T08:16:52.786822+0000","last_became_peered":"2024-02-10T08:16:52.786822+0000","last_unstale":"2024-02-10T08:18:52.820815+0000","last_undegraded":"2024-02-10T08:18:52.820815+0000","last_fullsized":"2024-02-10T08:18:52.820815+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:17:56.774322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:17:56.774322+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"76'16","reported_seq":65,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.820527+0000","last_change":"2024-02-10T08:18:07.909854+0000","last_active":"2024-02-10T08:18:52.820527+0000","last_peered":"2024-02-10T08:18:52.820527+0000","last_clean":"2024-02-10T08:18:52.820527+0000","last_became_active":"2024-02-10T08:16:54.849465+0000","last_became_peered":"2024-02-10T08:16:54.849465+0000","last_unstale":"2024-02-10T08:18:52.820527+0000","last_undegraded":"2024-02-10T08:18:52.820527+0000","last_fullsized":"2024-02-10T08:18:52.820527+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'16","last_scrub_stamp":"2024-02-10T08:18:07.909782+0000","last_deep_scrub":"76'16","last_deep_scrub_stamp":"2024-02-10T08:18:07.909782+0000","last_clean_scrub_stamp":"2024-02-10T08:18:07.909782+0000","log_size":16,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.820207+0000","last_change":"2024-02-10T08:18:33.352565+0000","last_active":"2024-02-10T08:18:52.820207+0000","last_peered":"2024-02-10T08:18:52.820207+0000","last_clean":"2024-02-10T08:18:52.820207+0000","last_became_active":"2024-02-10T08:16:58.859956+0000","last_became_peered":"2024-02-10T08:16:58.859956+0000","last_unstale":"2024-02-10T08:18:52.820207+0000","last_undegraded":"2024-02-10T08:18:52.820207+0000","last_fullsized":"2024-02-10T08:18:52.820207+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:33.352450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:33.352450+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"62'8","reported_seq":73,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:55.921839+0000","last_change":"2024-02-10T08:18:28.991525+0000","last_active":"2024-02-10T08:18:55.921839+0000","last_peered":"2024-02-10T08:18:55.921839+0000","last_clean":"2024-02-10T08:18:55.921839+0000","last_became_active":"2024-02-10T08:16:56.862305+0000","last_became_peered":"2024-02-10T08:16:56.862305+0000","last_unstale":"2024-02-10T08:18:55.921839+0000","last_undegraded":"2024-02-10T08:18:55.921839+0000","last_fullsized":"2024-02-10T08:18:55.921839+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'8","last_scrub_stamp":"2024-02-10T08:18:28.991446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:28.991446+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":43,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.818872+0000","last_change":"2024-02-10T08:18:29.161304+0000","last_active":"2024-02-10T08:18:52.818872+0000","last_peered":"2024-02-10T08:18:52.818872+0000","last_clean":"2024-02-10T08:18:52.818872+0000","last_became_active":"2024-02-10T08:16:52.783634+0000","last_became_peered":"2024-02-10T08:16:52.783634+0000","last_unstale":"2024-02-10T08:18:52.818872+0000","last_undegraded":"2024-02-10T08:18:52.818872+0000","last_fullsized":"2024-02-10T08:18:52.818872+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:29.161170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:29.161170+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"62'15","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.545449+0000","last_change":"2024-02-10T08:18:19.720237+0000","last_active":"2024-02-10T08:18:52.545449+0000","last_peered":"2024-02-10T08:18:52.545449+0000","last_clean":"2024-02-10T08:18:52.545449+0000","last_became_active":"2024-02-10T08:18:18.163631+0000","last_became_peered":"2024-02-10T08:18:18.163631+0000","last_unstale":"2024-02-10T08:18:52.545449+0000","last_undegraded":"2024-02-10T08:18:52.545449+0000","last_fullsized":"2024-02-10T08:18:52.545449+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'15","last_scrub_stamp":"2024-02-10T08:18:19.720164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:19.720164+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.820201+0000","last_change":"2024-02-10T08:17:59.858063+0000","last_active":"2024-02-10T08:18:52.820201+0000","last_peered":"2024-02-10T08:18:52.820201+0000","last_clean":"2024-02-10T08:18:52.820201+0000","last_became_active":"2024-02-10T08:16:58.856794+0000","last_became_peered":"2024-02-10T08:16:58.856794+0000","last_unstale":"2024-02-10T08:18:52.820201+0000","last_undegraded":"2024-02-10T08:18:52.820201+0000","last_fullsized":"2024-02-10T08:18:52.820201+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:17:59.857977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:17:59.857977+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"62'8","reported_seq":73,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:55.921508+0000","last_change":"2024-02-10T08:18:00.800075+0000","last_active":"2024-02-10T08:18:55.921508+0000","last_peered":"2024-02-10T08:18:55.921508+0000","last_clean":"2024-02-10T08:18:55.921508+0000","last_became_active":"2024-02-10T08:16:56.858101+0000","last_became_peered":"2024-02-10T08:16:56.858101+0000","last_unstale":"2024-02-10T08:18:55.921508+0000","last_undegraded":"2024-02-10T08:18:55.921508+0000","last_fullsized":"2024-02-10T08:18:55.921508+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'8","last_scrub_stamp":"2024-02-10T08:18:00.799992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:00.799992+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":43,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.818901+0000","last_change":"2024-02-10T08:18:11.113062+0000","last_active":"2024-02-10T08:18:52.818901+0000","last_peered":"2024-02-10T08:18:52.818901+0000","last_clean":"2024-02-10T08:18:52.818901+0000","last_became_active":"2024-02-10T08:16:52.785545+0000","last_became_peered":"2024-02-10T08:16:52.785545+0000","last_unstale":"2024-02-10T08:18:52.818901+0000","last_undegraded":"2024-02-10T08:18:52.818901+0000","last_fullsized":"2024-02-10T08:18:52.818901+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:11.112885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:11.112885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"62'10","reported_seq":56,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.819933+0000","last_change":"2024-02-10T08:18:08.920316+0000","last_active":"2024-02-10T08:18:52.819933+0000","last_peered":"2024-02-10T08:18:52.819933+0000","last_clean":"2024-02-10T08:18:52.819933+0000","last_became_active":"2024-02-10T08:16:54.842930+0000","last_became_peered":"2024-02-10T08:16:54.842930+0000","last_unstale":"2024-02-10T08:18:52.819933+0000","last_undegraded":"2024-02-10T08:18:52.819933+0000","last_fullsized":"2024-02-10T08:18:52.819933+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'10","last_scrub_stamp":"2024-02-10T08:18:08.920229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:08.920229+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.545583+0000","last_change":"2024-02-10T08:18:17.709766+0000","last_active":"2024-02-10T08:18:52.545583+0000","last_peered":"2024-02-10T08:18:52.545583+0000","last_clean":"2024-02-10T08:18:52.545583+0000","last_became_active":"2024-02-10T08:16:58.868078+0000","last_became_peered":"2024-02-10T08:16:58.868078+0000","last_unstale":"2024-02-10T08:18:52.545583+0000","last_undegraded":"2024-02-10T08:18:52.545583+0000","last_fullsized":"2024-02-10T08:18:52.545583+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:17.709697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:17.709697+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.819377+0000","last_change":"2024-02-10T08:18:37.273604+0000","last_active":"2024-02-10T08:18:52.819377+0000","last_peered":"2024-02-10T08:18:52.819377+0000","last_clean":"2024-02-10T08:18:52.819377+0000","last_became_active":"2024-02-10T08:16:56.859770+0000","last_became_peered":"2024-02-10T08:16:56.859770+0000","last_unstale":"2024-02-10T08:18:52.819377+0000","last_undegraded":"2024-02-10T08:18:52.819377+0000","last_fullsized":"2024-02-10T08:18:52.819377+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:37.273476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:37.273476+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":42,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.819611+0000","last_change":"2024-02-10T08:18:00.739337+0000","last_active":"2024-02-10T08:18:52.819611+0000","last_peered":"2024-02-10T08:18:52.819611+0000","last_clean":"2024-02-10T08:18:52.819611+0000","last_became_active":"2024-02-10T08:16:52.782395+0000","last_became_peered":"2024-02-10T08:16:52.782395+0000","last_unstale":"2024-02-10T08:18:52.819611+0000","last_undegraded":"2024-02-10T08:18:52.819611+0000","last_fullsized":"2024-02-10T08:18:52.819611+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:00.739233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:00.739233+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"62'17","reported_seq":96,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.820309+0000","last_change":"2024-02-10T08:18:18.892421+0000","last_active":"2024-02-10T08:18:52.820309+0000","last_peered":"2024-02-10T08:18:52.820309+0000","last_clean":"2024-02-10T08:18:52.820309+0000","last_became_active":"2024-02-10T08:18:18.203596+0000","last_became_peered":"2024-02-10T08:18:18.203596+0000","last_unstale":"2024-02-10T08:18:52.820309+0000","last_undegraded":"2024-02-10T08:18:52.820309+0000","last_fullsized":"2024-02-10T08:18:52.820309+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'17","last_scrub_stamp":"2024-02-10T08:18:02.936554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:02.936554+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.820659+0000","last_change":"2024-02-10T08:18:07.741720+0000","last_active":"2024-02-10T08:18:52.820659+0000","last_peered":"2024-02-10T08:18:52.820659+0000","last_clean":"2024-02-10T08:18:52.820659+0000","last_became_active":"2024-02-10T08:16:58.866831+0000","last_became_peered":"2024-02-10T08:16:58.866831+0000","last_unstale":"2024-02-10T08:18:52.820659+0000","last_undegraded":"2024-02-10T08:18:52.820659+0000","last_fullsized":"2024-02-10T08:18:52.820659+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:07.741643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:07.741643+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.545154+0000","last_change":"2024-02-10T08:18:20.695868+0000","last_active":"2024-02-10T08:18:52.545154+0000","last_peered":"2024-02-10T08:18:52.545154+0000","last_clean":"2024-02-10T08:18:52.545154+0000","last_became_active":"2024-02-10T08:16:56.864026+0000","last_became_peered":"2024-02-10T08:16:56.864026+0000","last_unstale":"2024-02-10T08:18:52.545154+0000","last_undegraded":"2024-02-10T08:18:52.545154+0000","last_fullsized":"2024-02-10T08:18:52.545154+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:20.695800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:20.695800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":43,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.545719+0000","last_change":"2024-02-10T08:17:56.786385+0000","last_active":"2024-02-10T08:18:52.545719+0000","last_peered":"2024-02-10T08:18:52.545719+0000","last_clean":"2024-02-10T08:18:52.545719+0000","last_became_active":"2024-02-10T08:16:52.789100+0000","last_became_peered":"2024-02-10T08:16:52.789100+0000","last_unstale":"2024-02-10T08:18:52.545719+0000","last_undegraded":"2024-02-10T08:18:52.545719+0000","last_fullsized":"2024-02-10T08:18:52.545719+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:17:56.786325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:17:56.786325+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"62'19","reported_seq":71,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.542841+0000","last_change":"2024-02-10T08:18:16.290699+0000","last_active":"2024-02-10T08:18:52.542841+0000","last_peered":"2024-02-10T08:18:52.542841+0000","last_clean":"2024-02-10T08:18:52.542841+0000","last_became_active":"2024-02-10T08:16:55.203415+0000","last_became_peered":"2024-02-10T08:16:55.203415+0000","last_unstale":"2024-02-10T08:18:52.542841+0000","last_undegraded":"2024-02-10T08:18:52.542841+0000","last_fullsized":"2024-02-10T08:18:52.542841+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'19","last_scrub_stamp":"2024-02-10T08:18:16.290612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:16.290612+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"76'2","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.805595+0000","last_change":"2024-02-10T08:18:08.680107+0000","last_active":"2024-02-10T08:18:52.805595+0000","last_peered":"2024-02-10T08:18:52.805595+0000","last_clean":"2024-02-10T08:18:52.805595+0000","last_became_active":"2024-02-10T08:16:58.860294+0000","last_became_peered":"2024-02-10T08:16:58.860294+0000","last_unstale":"2024-02-10T08:18:52.805595+0000","last_undegraded":"2024-02-10T08:18:52.805595+0000","last_fullsized":"2024-02-10T08:18:52.805595+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'2","last_scrub_stamp":"2024-02-10T08:18:08.680038+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2024-02-10T08:18:08.680038+0000","last_clean_scrub_stamp":"2024-02-10T08:18:08.680038+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.544855+0000","last_change":"2024-02-10T08:18:27.611164+0000","last_active":"2024-02-10T08:18:52.544855+0000","last_peered":"2024-02-10T08:18:52.544855+0000","last_clean":"2024-02-10T08:18:52.544855+0000","last_became_active":"2024-02-10T08:16:56.855513+0000","last_became_peered":"2024-02-10T08:16:56.855513+0000","last_unstale":"2024-02-10T08:18:52.544855+0000","last_undegraded":"2024-02-10T08:18:52.544855+0000","last_fullsized":"2024-02-10T08:18:52.544855+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:27.611094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:27.611094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":43,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.818944+0000","last_change":"2024-02-10T08:18:06.015064+0000","last_active":"2024-02-10T08:18:52.818944+0000","last_peered":"2024-02-10T08:18:52.818944+0000","last_clean":"2024-02-10T08:18:52.818944+0000","last_became_active":"2024-02-10T08:16:52.783675+0000","last_became_peered":"2024-02-10T08:16:52.783675+0000","last_unstale":"2024-02-10T08:18:52.818944+0000","last_undegraded":"2024-02-10T08:18:52.818944+0000","last_fullsized":"2024-02-10T08:18:52.818944+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:06.014988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:06.014988+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"62'9","reported_seq":56,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.806134+0000","last_change":"2024-02-10T08:18:14.705343+0000","last_active":"2024-02-10T08:18:52.806134+0000","last_peered":"2024-02-10T08:18:52.806134+0000","last_clean":"2024-02-10T08:18:52.806134+0000","last_became_active":"2024-02-10T08:16:54.852935+0000","last_became_peered":"2024-02-10T08:16:54.852935+0000","last_unstale":"2024-02-10T08:18:52.806134+0000","last_undegraded":"2024-02-10T08:18:52.806134+0000","last_fullsized":"2024-02-10T08:18:52.806134+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'9","last_scrub_stamp":"2024-02-10T08:18:14.705229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:14.705229+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.819695+0000","last_change":"2024-02-10T08:18:08.322927+0000","last_active":"2024-02-10T08:18:52.819695+0000","last_peered":"2024-02-10T08:18:52.819695+0000","last_clean":"2024-02-10T08:18:52.819695+0000","last_became_active":"2024-02-10T08:16:58.891260+0000","last_became_peered":"2024-02-10T08:16:58.891260+0000","last_unstale":"2024-02-10T08:18:52.819695+0000","last_undegraded":"2024-02-10T08:18:52.819695+0000","last_fullsized":"2024-02-10T08:18:52.819695+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:08.322832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:08.322832+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":43,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.545353+0000","last_change":"2024-02-10T08:18:02.740193+0000","last_active":"2024-02-10T08:18:52.545353+0000","last_peered":"2024-02-10T08:18:52.545353+0000","last_clean":"2024-02-10T08:18:52.545353+0000","last_became_active":"2024-02-10T08:16:52.785754+0000","last_became_peered":"2024-02-10T08:16:52.785754+0000","last_unstale":"2024-02-10T08:18:52.545353+0000","last_undegraded":"2024-02-10T08:18:52.545353+0000","last_fullsized":"2024-02-10T08:18:52.545353+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:02.740127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:02.740127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"62'15","reported_seq":65,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-02-10T08:18:52.819609+0000","last_change":"2024-02-10T08:18:47.352251+0000","last_active":"2024-02-10T08:18:52.819609+0000","last_peered":"2024-02-10T08:18:52.819609+0000","last_clean":"2024-02-10T08:18:52.819609+0000","last_became_active":"2024-02-10T08:16:55.204597+0000","last_became_peered":"2024-02-10T08:16:55.204597+0000","last_unstale":"2024-02-10T08:18:52.819609+0000","last_undegraded":"2024-02-10T08:18:52.819609+0000","last_fullsized":"2024-02-10T08:18:52.819609+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'15","last_scrub_stamp":"2024-02-10T08:18:47.352151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:47.352151+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"62'8","reported_seq":72,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:55.921856+0000","last_change":"2024-02-10T08:18:29.053030+0000","last_active":"2024-02-10T08:18:55.921856+0000","last_peered":"2024-02-10T08:18:55.921856+0000","last_clean":"2024-02-10T08:18:55.921856+0000","last_became_active":"2024-02-10T08:16:56.860308+0000","last_became_peered":"2024-02-10T08:16:56.860308+0000","last_unstale":"2024-02-10T08:18:55.921856+0000","last_undegraded":"2024-02-10T08:18:55.921856+0000","last_fullsized":"2024-02-10T08:18:55.921856+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'8","last_scrub_stamp":"2024-02-10T08:18:29.052907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:29.052907+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":65,"ondisk_log_size":65,"up":96,"acting":96,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":698,"num_read_kb":455,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":411,"ondisk_log_size":411,"up":96,"acting":96,"num_store_stats":8},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":122,"num_read_kb":117,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":9,"acting":9,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":50,"seq":214748364830,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297728,"kb_used_data":632,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447424,"statfs":{"total":95995035648,"available":95690162176,"internally_reserved":0,"allocated":647168,"data_stored":296586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:18:45 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.48999999999999999,"15min":0.49199999999999999},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.5},{"interface":"front","average":{"1min":0.497,"5min":0.48999999999999999,"15min":0.48899999999999999},"min":{"1min":0.36699999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.625}]},{"osd":1,"last update":"Sat Feb 10 08:18:45 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.502,"15min":0.505},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.68000000000000005,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.50700000000000001,"15min":0.51500000000000001},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.61899999999999999,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.67300000000000004}]},{"osd":2,"last update":"Sat Feb 10 08:18:45 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.66400000000000003,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.52400000000000002,"15min":0.52700000000000002},"min":{"1min":0.38200000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.66000000000000003}]},{"osd":3,"last update":"Sat Feb 10 08:18:45 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.51300000000000001,"15min":0.51700000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.621,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.503,"5min":0.51600000000000001,"15min":0.51800000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.53000000000000003}]},{"osd":4,"last update":"Sat Feb 10 08:18:45 2024","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.40300000000000002,"15min":0.40100000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.56599999999999995,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.433,"15min":0.42999999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.58999999999999997,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.44700000000000001}]},{"osd":5,"last update":"Sat Feb 10 08:18:45 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.42199999999999999,"15min":0.41499999999999998},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.46000000000000002,"15min":0.45800000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.65800000000000003,"5min":0.753,"15min":0.753},"last":0.43099999999999999}]},{"osd":6,"last update":"Sat Feb 10 08:18:45 2024","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.45300000000000001,"15min":0.443},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.47499999999999998,"15min":0.46899999999999997},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.38300000000000001}]}]},{"osd":6,"up_from":43,"seq":184683593763,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297712,"kb_used_data":616,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447440,"statfs":{"total":95995035648,"available":95690178560,"internally_reserved":0,"allocated":630784,"data_stored":296546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:18:23 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.53800000000000003,"15min":0.54000000000000004},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.55300000000000005,"15min":0.55500000000000005},"min":{"1min":0.39300000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.78400000000000003,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.53500000000000003}]},{"osd":1,"last update":"Sat Feb 10 08:18:23 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.54700000000000004,"15min":0.55100000000000005},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.629},{"interface":"front","average":{"1min":0.496,"5min":0.55700000000000005,"15min":0.56699999999999995},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.76400000000000001,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.54400000000000004}]},{"osd":2,"last update":"Sat Feb 10 08:18:23 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.57299999999999995,"15min":0.57899999999999996},"min":{"1min":0.40999999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.57699999999999996,"15min":0.57999999999999996},"min":{"1min":0.39900000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.622}]},{"osd":3,"last update":"Sat Feb 10 08:18:23 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.56299999999999994,"15min":0.56599999999999995},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.86199999999999999,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.55600000000000005,"15min":0.55800000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.66400000000000003}]},{"osd":4,"last update":"Sat Feb 10 08:18:23 2024","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.27900000000000003,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.73399999999999999,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.46200000000000002,"15min":0.46300000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.69599999999999995,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.45100000000000001}]},{"osd":5,"last update":"Sat Feb 10 08:18:23 2024","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.45600000000000002,"15min":0.45200000000000001},"min":{"1min":0.31,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.70999999999999996,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.432},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.45700000000000002,"15min":0.45300000000000001},"min":{"1min":0.317,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.41499999999999998}]},{"osd":7,"last update":"Sat Feb 10 08:18:52 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.375,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.69899999999999995,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.497},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.57899999999999996,"15min":0.57599999999999996},"min":{"1min":0.41699999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.55500000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574906,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297744,"kb_used_data":648,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447408,"statfs":{"total":95995035648,"available":95690145792,"internally_reserved":0,"allocated":663552,"data_stored":296375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:18:23 2024","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.35699999999999998,"15min":0.318},"min":{"1min":0.23999999999999999,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.60499999999999998,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.373,"15min":0.33200000000000002},"min":{"1min":0.24099999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.64900000000000002,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.26900000000000002}]},{"osd":2,"last update":"Sat Feb 10 08:18:54 2024","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.38600000000000001,"15min":0.36599999999999999},"min":{"1min":0.26400000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.55300000000000005,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.38900000000000001,"15min":0.371},"min":{"1min":0.252,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.58399999999999996,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.42699999999999999}]},{"osd":3,"last update":"Sat Feb 10 08:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.45900000000000002,"15min":0.46100000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.69099999999999995,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.438,"15min":0.439},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.69399999999999995,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.36699999999999999}]},{"osd":4,"last update":"Sat Feb 10 08:18:37 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.58599999999999997,"15min":0.59099999999999997},"min":{"1min":0.39200000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.83899999999999997,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.57199999999999995,"15min":0.58199999999999996},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.85099999999999998,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.52200000000000002}]},{"osd":5,"last update":"Sat Feb 10 08:18:59 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.57199999999999995,"15min":0.57399999999999995},"min":{"1min":0.39700000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.82399999999999995,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.60699999999999998,"15min":0.61299999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.90100000000000002,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.50800000000000001}]},{"osd":6,"last update":"Sat Feb 10 08:18:23 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.61299999999999999,"15min":0.61599999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.55600000000000005}]},{"osd":7,"last update":"Sat Feb 10 08:18:49 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.57099999999999995,"15min":0.56499999999999995},"min":{"1min":0.42799999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.59499999999999997,"15min":0.58899999999999997},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.59599999999999997}]}]},{"osd":0,"up_from":8,"seq":34359738431,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297736,"kb_used_data":640,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447416,"statfs":{"total":95995035648,"available":95690153984,"internally_reserved":0,"allocated":655360,"data_stored":296906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 10 08:18:23 2024","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35399999999999998,"15min":0.33500000000000002},"min":{"1min":0.217,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.52400000000000002,"5min":0.54400000000000004,"15min":0.54400000000000004},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.374,"5min":0.36599999999999999,"15min":0.33600000000000002},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.27400000000000002}]},{"osd":2,"last update":"Sat Feb 10 08:18:50 2024","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.253,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.42299999999999999,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.375},{"interface":"front","average":{"1min":0.375,"5min":0.39800000000000002,"15min":0.39200000000000002},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.47499999999999998,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.35699999999999998}]},{"osd":3,"last update":"Sat Feb 10 08:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.434,"15min":0.442},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.442,"15min":0.44800000000000001},"min":{"1min":0.30299999999999999,"5min":0.246,"15min":0.246},"max":{"1min":0.55900000000000005,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.33100000000000002}]},{"osd":4,"last update":"Sat Feb 10 08:18:35 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.59399999999999997,"15min":0.59199999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.59399999999999997,"15min":0.60399999999999998},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.57099999999999995}]},{"osd":5,"last update":"Sat Feb 10 08:18:00 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.58999999999999997,"15min":0.59399999999999997},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57999999999999996,"15min":0.58199999999999996},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.52800000000000002}]},{"osd":6,"last update":"Sat Feb 10 08:18:23 2024","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.64100000000000001,"15min":0.64700000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.56499999999999995}]},{"osd":7,"last update":"Sat Feb 10 08:18:47 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59799999999999998,"15min":0.59899999999999998},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.80800000000000005,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.80200000000000005,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.47999999999999998}]}]},{"osd":2,"up_from":18,"seq":77309411382,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297720,"kb_used_data":624,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447432,"statfs":{"total":95995035648,"available":95690170368,"internally_reserved":0,"allocated":638976,"data_stored":296082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:18:48 2024","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.35799999999999998,"15min":0.34899999999999998},"min":{"1min":0.255,"5min":0.224,"15min":0.224},"max":{"1min":0.49399999999999999,"5min":0.628,"15min":0.628},"last":0.307},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38,"15min":0.36599999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.75,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.49099999999999999}]},{"osd":1,"last update":"Sat Feb 10 08:18:48 2024","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.375,"15min":0.36799999999999999},"min":{"1min":0.27100000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.51100000000000001,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.39500000000000002,"15min":0.38200000000000001},"min":{"1min":0.26000000000000001,"5min":0.25,"15min":0.25},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.42299999999999999}]},{"osd":3,"last update":"Sat Feb 10 08:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.45800000000000002,"15min":0.46000000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.73999999999999999,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.44800000000000001,"15min":0.45000000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.58699999999999997,"5min":0.749,"15min":0.749},"last":0.47899999999999998}]},{"osd":4,"last update":"Sat Feb 10 08:18:35 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.58499999999999996,"15min":0.58099999999999996},"min":{"1min":0.496,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.86299999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.57399999999999995,"15min":0.57699999999999996},"min":{"1min":0.39800000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.73399999999999999}]},{"osd":5,"last update":"Sat Feb 10 08:18:00 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.56299999999999994,"15min":0.56899999999999995},"min":{"1min":0.41999999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.71199999999999997,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.56200000000000006,"15min":0.56599999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.80000000000000004,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.68200000000000005}]},{"osd":6,"last update":"Sat Feb 10 08:18:22 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.58099999999999996,"15min":0.58499999999999996},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.71699999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.60099999999999998,"15min":0.60699999999999998},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.73599999999999999,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.65300000000000002}]},{"osd":7,"last update":"Sat Feb 10 08:18:48 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.60399999999999998,"15min":0.60799999999999998},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.80800000000000005,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.85399999999999998,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.66700000000000004}]}]},{"osd":3,"up_from":25,"seq":107374182449,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297740,"kb_used_data":644,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447412,"statfs":{"total":95995035648,"available":95690149888,"internally_reserved":0,"allocated":659456,"data_stored":296148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:18:10 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.38900000000000001,"15min":0.374},"min":{"1min":0.254,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.25},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.42399999999999999,"15min":0.42299999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.33100000000000002}]},{"osd":1,"last update":"Sat Feb 10 08:18:10 2024","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.439,"15min":0.443},"min":{"1min":0.315,"5min":0.312,"15min":0.312},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.45600000000000002,"15min":0.46300000000000002},"min":{"1min":0.28499999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.61099999999999999,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.35499999999999998}]},{"osd":2,"last update":"Sat Feb 10 08:18:10 2024","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.45500000000000002,"15min":0.45700000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.45900000000000002,"15min":0.45500000000000002},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.66600000000000004,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.38100000000000001}]},{"osd":4,"last update":"Sat Feb 10 08:18:36 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54700000000000004,"15min":0.54500000000000004},"min":{"1min":0.38800000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.56899999999999995,"15min":0.57299999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.83099999999999996,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.71799999999999997}]},{"osd":5,"last update":"Sat Feb 10 08:18:03 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.59699999999999998,"15min":0.59899999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.59799999999999998,"15min":0.59999999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.68200000000000005}]},{"osd":6,"last update":"Sat Feb 10 08:18:23 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.57299999999999995,"15min":0.57099999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.58699999999999997,"15min":0.58299999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.622}]},{"osd":7,"last update":"Sat Feb 10 08:18:46 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.57899999999999996,"15min":0.57699999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.57399999999999995,"15min":0.56999999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.67100000000000004}]}]},{"osd":4,"up_from":30,"seq":128849018923,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297728,"kb_used_data":632,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447424,"statfs":{"total":95995035648,"available":95690162176,"internally_reserved":0,"allocated":647168,"data_stored":295816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:18:34 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.51300000000000001,"15min":0.52400000000000002},"min":{"1min":0.26100000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.65600000000000003,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.503,"5min":0.52200000000000002,"15min":0.53000000000000003},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.64500000000000002,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.59999999999999998}]},{"osd":1,"last update":"Sat Feb 10 08:18:34 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.50900000000000001,"15min":0.52400000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.629,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.503,"15min":0.51600000000000001},"min":{"1min":0.35199999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.56000000000000005,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.52300000000000002}]},{"osd":2,"last update":"Sat Feb 10 08:18:34 2024","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.499,"15min":0.505},"min":{"1min":0.32300000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.61699999999999999,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.52900000000000003,"15min":0.53900000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.61199999999999999,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.51300000000000001}]},{"osd":3,"last update":"Sat Feb 10 08:18:34 2024","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.52700000000000002,"15min":0.53700000000000003},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.66900000000000004,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.44},{"interface":"front","average":{"1min":0.497,"5min":0.52200000000000002,"15min":0.53100000000000003},"min":{"1min":0.39500000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.67800000000000005,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.53800000000000003}]},{"osd":5,"last update":"Sat Feb 10 08:19:00 2024","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.38600000000000001,"15min":0.372},"min":{"1min":0.27100000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.627,"5min":0.627,"15min":0.627},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.39400000000000002,"15min":0.377},"min":{"1min":0.28999999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.67500000000000004}]},{"osd":6,"last update":"Sat Feb 10 08:18:20 2024","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"min":{"1min":0.30199999999999999,"5min":0.248,"15min":0.248},"max":{"1min":0.64800000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.46600000000000003,"15min":0.46400000000000002},"min":{"1min":0.32000000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.56200000000000006}]},{"osd":7,"last update":"Sat Feb 10 08:18:46 2024","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.33300000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.45200000000000001,"15min":0.45000000000000001},"min":{"1min":0.313,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.49399999999999999}]}]},{"osd":5,"up_from":37,"seq":158913789992,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297712,"kb_used_data":616,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447440,"statfs":{"total":95995035648,"available":95690178560,"internally_reserved":0,"allocated":630784,"data_stored":295719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:18:57 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.56399999999999995,"15min":0.58399999999999996},"min":{"1min":0.38400000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.70099999999999996,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.378},{"interface":"front","average":{"1min":0.502,"5min":0.51200000000000001,"15min":0.52100000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.72399999999999998,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.43099999999999999}]},{"osd":1,"last update":"Sat Feb 10 08:18:57 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.54300000000000004,"15min":0.56000000000000005},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.52700000000000002,"15min":0.54600000000000004},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.68200000000000005,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.47099999999999997}]},{"osd":2,"last update":"Sat Feb 10 08:18:57 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.55200000000000005,"15min":0.56999999999999995},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.70899999999999996,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.56699999999999995,"15min":0.59099999999999997},"min":{"1min":0.40500000000000003,"5min":0.372,"15min":0.372},"max":{"1min":0.70299999999999996,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.502}]},{"osd":3,"last update":"Sat Feb 10 08:18:57 2024","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.56200000000000006,"15min":0.58499999999999996},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.66700000000000004,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.378,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.66000000000000003,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":0.59499999999999997}]},{"osd":4,"last update":"Sat Feb 10 08:18:57 2024","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.371,"15min":0.36099999999999999},"min":{"1min":0.26400000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.65400000000000003,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.433,"5min":0.38300000000000001,"15min":0.36899999999999999},"min":{"1min":0.30399999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.68700000000000006,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.48399999999999999}]},{"osd":6,"last update":"Sat Feb 10 08:18:24 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.38500000000000001,"15min":0.375},"min":{"1min":0.33300000000000002,"5min":0.254,"15min":0.254},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.436,"15min":0.42499999999999999},"min":{"1min":0.34999999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.57699999999999996}]},{"osd":7,"last update":"Sat Feb 10 08:18:49 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.439,"15min":0.436},"min":{"1min":0.318,"5min":0.31,"15min":0.31},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.432,"15min":0.42499999999999999},"min":{"1min":0.29099999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.67100000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":2008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-10T08:19:07.193 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-02-10T08:19:07.193 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-02-10T08:19:07.193 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-02-10T08:19:07.193 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph health --format=json 2024-02-10T08:19:07.404 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:19:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:19:07] "GET /metrics HTTP/1.1" 200 172127 "" "Prometheus/2.33.4" 2024-02-10T08:19:07.474 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:19:07.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:05.813412+0000 osd.2 (osd.2) 35 : cluster [DBG] 2.e scrub starts 2024-02-10T08:19:07.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:05.814496+0000 osd.2 (osd.2) 36 : cluster [DBG] 2.e scrub ok 2024-02-10T08:19:07.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:19:06.247235+0000 mgr.y (mgr.14505) 90 : audit [DBG] from='client.14694 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-10T08:19:07.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:06.354089+0000 osd.7 (osd.7) 41 : cluster [DBG] 5.10 scrub starts 2024-02-10T08:19:07.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:06.357039+0000 osd.7 (osd.7) 42 : cluster [DBG] 5.10 scrub ok 2024-02-10T08:19:07.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:06.473495+0000 mgr.y (mgr.14505) 91 : cluster [DBG] pgmap v78: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:19:07.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:05.813412+0000 osd.2 (osd.2) 35 : cluster [DBG] 2.e scrub starts 2024-02-10T08:19:07.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:05.814496+0000 osd.2 (osd.2) 36 : cluster [DBG] 2.e scrub ok 2024-02-10T08:19:07.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:19:06.247235+0000 mgr.y (mgr.14505) 90 : audit [DBG] from='client.14694 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-10T08:19:07.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:06.354089+0000 osd.7 (osd.7) 41 : cluster [DBG] 5.10 scrub starts 2024-02-10T08:19:07.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:06.357039+0000 osd.7 (osd.7) 42 : cluster [DBG] 5.10 scrub ok 2024-02-10T08:19:07.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:06.473495+0000 mgr.y (mgr.14505) 91 : cluster [DBG] pgmap v78: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:19:08.039 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:19:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:19:08.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:05.813412+0000 osd.2 (osd.2) 35 : cluster [DBG] 2.e scrub starts 2024-02-10T08:19:08.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:05.814496+0000 osd.2 (osd.2) 36 : cluster [DBG] 2.e scrub ok 2024-02-10T08:19:08.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:19:06.247235+0000 mgr.y (mgr.14505) 90 : audit [DBG] from='client.14694 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-10T08:19:08.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:06.354089+0000 osd.7 (osd.7) 41 : cluster [DBG] 5.10 scrub starts 2024-02-10T08:19:08.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:06.357039+0000 osd.7 (osd.7) 42 : cluster [DBG] 5.10 scrub ok 2024-02-10T08:19:08.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:06.473495+0000 mgr.y (mgr.14505) 91 : cluster [DBG] pgmap v78: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:19:08.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:19:07.546184+0000 mgr.y (mgr.14505) 92 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:19:08.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:19:07.546184+0000 mgr.y (mgr.14505) 92 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:19:09.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:19:07.546184+0000 mgr.y (mgr.14505) 92 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:19:09.549 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:19:09.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:08.474168+0000 mgr.y (mgr.14505) 93 : cluster [DBG] pgmap v79: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:19:09.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:08.547410+0000 osd.0 (osd.0) 41 : cluster [DBG] 2.13 scrub starts 2024-02-10T08:19:09.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:08.548454+0000 osd.0 (osd.0) 42 : cluster [DBG] 2.13 scrub ok 2024-02-10T08:19:09.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:09.005520+0000 osd.3 (osd.3) 55 : cluster [DBG] 4.14 scrub starts 2024-02-10T08:19:09.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:09.007372+0000 osd.3 (osd.3) 56 : cluster [DBG] 4.14 scrub ok 2024-02-10T08:19:09.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:19:09.548841+0000 mon.c (mon.2) 21 : audit [DBG] from='client.? 172.21.15.18:0/18403225' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-02-10T08:19:09.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:08.474168+0000 mgr.y (mgr.14505) 93 : cluster [DBG] pgmap v79: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:19:09.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:08.547410+0000 osd.0 (osd.0) 41 : cluster [DBG] 2.13 scrub starts 2024-02-10T08:19:09.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:08.548454+0000 osd.0 (osd.0) 42 : cluster [DBG] 2.13 scrub ok 2024-02-10T08:19:09.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:09.005520+0000 osd.3 (osd.3) 55 : cluster [DBG] 4.14 scrub starts 2024-02-10T08:19:09.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:09.007372+0000 osd.3 (osd.3) 56 : cluster [DBG] 4.14 scrub ok 2024-02-10T08:19:09.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:19:09.548841+0000 mon.c (mon.2) 21 : audit [DBG] from='client.? 172.21.15.18:0/18403225' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-02-10T08:19:10.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:08.474168+0000 mgr.y (mgr.14505) 93 : cluster [DBG] pgmap v79: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:19:10.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:08.547410+0000 osd.0 (osd.0) 41 : cluster [DBG] 2.13 scrub starts 2024-02-10T08:19:10.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:08.548454+0000 osd.0 (osd.0) 42 : cluster [DBG] 2.13 scrub ok 2024-02-10T08:19:10.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:09.005520+0000 osd.3 (osd.3) 55 : cluster [DBG] 4.14 scrub starts 2024-02-10T08:19:10.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:09.007372+0000 osd.3 (osd.3) 56 : cluster [DBG] 4.14 scrub ok 2024-02-10T08:19:10.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:19:09.548841+0000 mon.c (mon.2) 21 : audit [DBG] from='client.? 172.21.15.18:0/18403225' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-02-10T08:19:10.464 INFO:teuthology.orchestra.run.smithi018.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-02-10T08:19:10.465 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-02-10T08:19:10.465 INFO:tasks.cephadm:Setup complete, yielding 2024-02-10T08:19:10.465 INFO:teuthology.run_tasks:Running task thrashosds... 2024-02-10T08:19:10.479 INFO:tasks.thrashosds:config is {'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-02-10T08:19:10.480 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'wip-yuri10-testing-2024-02-08-0854-pacific'}, 'ceph': {'conf': {'client.0': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'ms bind msgr1': False, 'ms bind msgr2': True, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10}, 'osd': {'debug ms': 1, 'debug osd': 20, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd max backfills': 3, 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'but it is still running', 'objects unfound and apparently lost', '\\(MON_DOWN\\)', '\\(OSDMAP_FLAGS\\)'], 'sha1': '0e714d9a4bd2a821113e6318adb87bd06cf81ec1'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'cephadm': {'cephadm_mode': 'root'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '0e714d9a4bd2a821113e6318adb87bd06cf81ec1'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'workunit': {'branch': 'wip-tracker-64343-pacific', 'sha1': '57bd6abdec7bb457ae7999d9c96682e9ac678e27'}} 2024-02-10T08:19:10.480 INFO:tasks.thrashosds:config is {'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-02-10T08:19:10.480 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-02-10T08:19:10.768 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:19:10.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:09.231112+0000 osd.7 (osd.7) 43 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:19:10.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:09.231222+0000 osd.7 (osd.7) 44 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:19:10.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:09.591176+0000 mon.a (mon.0) 741 : cluster [DBG] osdmap e85: 8 total, 8 up, 8 in 2024-02-10T08:19:10.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:09.231112+0000 osd.7 (osd.7) 43 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:19:10.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:09.231222+0000 osd.7 (osd.7) 44 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:19:10.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:09.591176+0000 mon.a (mon.0) 741 : cluster [DBG] osdmap e85: 8 total, 8 up, 8 in 2024-02-10T08:19:11.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:09.231112+0000 osd.7 (osd.7) 43 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:19:11.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:09.231222+0000 osd.7 (osd.7) 44 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:19:11.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:09.591176+0000 mon.a (mon.0) 741 : cluster [DBG] osdmap e85: 8 total, 8 up, 8 in 2024-02-10T08:19:11.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:09.891051+0000 osd.2 (osd.2) 37 : cluster [DBG] 2.c scrub starts 2024-02-10T08:19:11.906 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:09.892329+0000 osd.2 (osd.2) 38 : cluster [DBG] 2.c scrub ok 2024-02-10T08:19:11.906 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:10.369796+0000 osd.6 (osd.6) 29 : cluster [DBG] 2.1a deep-scrub starts 2024-02-10T08:19:11.906 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:10.370741+0000 osd.6 (osd.6) 30 : cluster [DBG] 2.1a deep-scrub ok 2024-02-10T08:19:11.906 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:10.474543+0000 mgr.y (mgr.14505) 94 : cluster [DBG] pgmap v81: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-10T08:19:11.907 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:09.891051+0000 osd.2 (osd.2) 37 : cluster [DBG] 2.c scrub starts 2024-02-10T08:19:11.907 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:09.892329+0000 osd.2 (osd.2) 38 : cluster [DBG] 2.c scrub ok 2024-02-10T08:19:11.907 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:10.369796+0000 osd.6 (osd.6) 29 : cluster [DBG] 2.1a deep-scrub starts 2024-02-10T08:19:11.907 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:10.370741+0000 osd.6 (osd.6) 30 : cluster [DBG] 2.1a deep-scrub ok 2024-02-10T08:19:11.907 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:10.474543+0000 mgr.y (mgr.14505) 94 : cluster [DBG] pgmap v81: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-10T08:19:12.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:09.891051+0000 osd.2 (osd.2) 37 : cluster [DBG] 2.c scrub starts 2024-02-10T08:19:12.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:09.892329+0000 osd.2 (osd.2) 38 : cluster [DBG] 2.c scrub ok 2024-02-10T08:19:12.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:10.369796+0000 osd.6 (osd.6) 29 : cluster [DBG] 2.1a deep-scrub starts 2024-02-10T08:19:12.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:10.370741+0000 osd.6 (osd.6) 30 : cluster [DBG] 2.1a deep-scrub ok 2024-02-10T08:19:12.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:10.474543+0000 mgr.y (mgr.14505) 94 : cluster [DBG] pgmap v81: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-10T08:19:13.129 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:19:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: [10/Feb/2024:08:19:12] ENGINE Bus STOPPING 2024-02-10T08:19:13.129 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:19:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: [10/Feb/2024:08:19:12] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-02-10T08:19:13.130 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:19:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: [10/Feb/2024:08:19:12] ENGINE Bus STOPPED 2024-02-10T08:19:13.130 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:19:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: [10/Feb/2024:08:19:12] ENGINE Bus STARTING 2024-02-10T08:19:13.130 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:19:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: [10/Feb/2024:08:19:12] ENGINE Serving on http://:::9283 2024-02-10T08:19:13.130 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:19:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: [10/Feb/2024:08:19:12] ENGINE Bus STARTED 2024-02-10T08:19:13.569 INFO:tasks.thrashosds:Beginning thrashosds... 2024-02-10T08:19:13.569 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-02-10T08:19:13.569 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph pg dump --format=json 2024-02-10T08:19:13.856 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:19:13.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:12.462980+0000 osd.1 (osd.1) 49 : cluster [DBG] 3.0 scrub starts 2024-02-10T08:19:13.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:12.466445+0000 osd.1 (osd.1) 50 : cluster [DBG] 3.0 scrub ok 2024-02-10T08:19:13.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:12.475144+0000 mgr.y (mgr.14505) 95 : cluster [DBG] pgmap v82: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-10T08:19:13.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:19:12.743996+0000 mon.a (mon.0) 742 : audit [INF] from='client.? 172.21.15.18:0/3870497917' entity='client.admin' 2024-02-10T08:19:13.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:19:12.789929+0000 mon.a (mon.0) 743 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:19:13.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:19:12.791595+0000 mon.a (mon.0) 744 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:19:13.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:19:12.792278+0000 mon.a (mon.0) 745 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:19:13.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:19:12.796690+0000 mon.a (mon.0) 746 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:19:13.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:13.535469+0000 osd.0 (osd.0) 43 : cluster [DBG] 6.0 scrub starts 2024-02-10T08:19:13.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:13.538478+0000 osd.0 (osd.0) 44 : cluster [DBG] 6.0 scrub ok 2024-02-10T08:19:13.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:12.462980+0000 osd.1 (osd.1) 49 : cluster [DBG] 3.0 scrub starts 2024-02-10T08:19:13.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:12.466445+0000 osd.1 (osd.1) 50 : cluster [DBG] 3.0 scrub ok 2024-02-10T08:19:13.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:12.475144+0000 mgr.y (mgr.14505) 95 : cluster [DBG] pgmap v82: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-10T08:19:13.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:19:12.743996+0000 mon.a (mon.0) 742 : audit [INF] from='client.? 172.21.15.18:0/3870497917' entity='client.admin' 2024-02-10T08:19:13.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:19:12.789929+0000 mon.a (mon.0) 743 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:19:13.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:19:12.791595+0000 mon.a (mon.0) 744 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:19:13.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:19:12.792278+0000 mon.a (mon.0) 745 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:19:13.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:19:12.796690+0000 mon.a (mon.0) 746 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:19:13.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:13.535469+0000 osd.0 (osd.0) 43 : cluster [DBG] 6.0 scrub starts 2024-02-10T08:19:13.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:13.538478+0000 osd.0 (osd.0) 44 : cluster [DBG] 6.0 scrub ok 2024-02-10T08:19:14.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:12.462980+0000 osd.1 (osd.1) 49 : cluster [DBG] 3.0 scrub starts 2024-02-10T08:19:14.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:12.466445+0000 osd.1 (osd.1) 50 : cluster [DBG] 3.0 scrub ok 2024-02-10T08:19:14.041 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:12.475144+0000 mgr.y (mgr.14505) 95 : cluster [DBG] pgmap v82: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-10T08:19:14.041 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:19:12.743996+0000 mon.a (mon.0) 742 : audit [INF] from='client.? 172.21.15.18:0/3870497917' entity='client.admin' 2024-02-10T08:19:14.041 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:19:12.789929+0000 mon.a (mon.0) 743 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:19:14.041 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:19:12.791595+0000 mon.a (mon.0) 744 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:19:14.041 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:19:12.792278+0000 mon.a (mon.0) 745 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:19:14.041 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:19:12.796690+0000 mon.a (mon.0) 746 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:19:14.042 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:13.535469+0000 osd.0 (osd.0) 43 : cluster [DBG] 6.0 scrub starts 2024-02-10T08:19:14.042 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:13.538478+0000 osd.0 (osd.0) 44 : cluster [DBG] 6.0 scrub ok 2024-02-10T08:19:15.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:13.277970+0000 osd.5 (osd.5) 39 : cluster [DBG] 2.16 scrub starts 2024-02-10T08:19:15.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:13.281238+0000 osd.5 (osd.5) 40 : cluster [DBG] 2.16 scrub ok 2024-02-10T08:19:15.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:13.899362+0000 osd.2 (osd.2) 39 : cluster [DBG] 2.1 scrub starts 2024-02-10T08:19:15.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:13.900260+0000 osd.2 (osd.2) 40 : cluster [DBG] 2.1 scrub ok 2024-02-10T08:19:15.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:14.497230+0000 osd.0 (osd.0) 45 : cluster [DBG] 4.16 scrub starts 2024-02-10T08:19:15.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:14.500762+0000 osd.0 (osd.0) 46 : cluster [DBG] 4.16 scrub ok 2024-02-10T08:19:15.062 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:13.277970+0000 osd.5 (osd.5) 39 : cluster [DBG] 2.16 scrub starts 2024-02-10T08:19:15.062 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:13.281238+0000 osd.5 (osd.5) 40 : cluster [DBG] 2.16 scrub ok 2024-02-10T08:19:15.062 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:13.899362+0000 osd.2 (osd.2) 39 : cluster [DBG] 2.1 scrub starts 2024-02-10T08:19:15.062 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:13.900260+0000 osd.2 (osd.2) 40 : cluster [DBG] 2.1 scrub ok 2024-02-10T08:19:15.062 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:14.497230+0000 osd.0 (osd.0) 45 : cluster [DBG] 4.16 scrub starts 2024-02-10T08:19:15.062 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:14.500762+0000 osd.0 (osd.0) 46 : cluster [DBG] 4.16 scrub ok 2024-02-10T08:19:15.062 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:13.277970+0000 osd.5 (osd.5) 39 : cluster [DBG] 2.16 scrub starts 2024-02-10T08:19:15.062 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:13.281238+0000 osd.5 (osd.5) 40 : cluster [DBG] 2.16 scrub ok 2024-02-10T08:19:15.063 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:13.899362+0000 osd.2 (osd.2) 39 : cluster [DBG] 2.1 scrub starts 2024-02-10T08:19:15.063 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:13.900260+0000 osd.2 (osd.2) 40 : cluster [DBG] 2.1 scrub ok 2024-02-10T08:19:15.063 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:14.497230+0000 osd.0 (osd.0) 45 : cluster [DBG] 4.16 scrub starts 2024-02-10T08:19:15.063 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:14.500762+0000 osd.0 (osd.0) 46 : cluster [DBG] 4.16 scrub ok 2024-02-10T08:19:16.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:14.475448+0000 mgr.y (mgr.14505) 96 : cluster [DBG] pgmap v83: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-10T08:19:16.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:14.475471+0000 osd.1 (osd.1) 51 : cluster [DBG] 4.12 scrub starts 2024-02-10T08:19:16.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:14.478957+0000 osd.1 (osd.1) 52 : cluster [DBG] 4.12 scrub ok 2024-02-10T08:19:16.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:15.489168+0000 osd.0 (osd.0) 47 : cluster [DBG] 4.1e scrub starts 2024-02-10T08:19:16.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:15.492816+0000 osd.0 (osd.0) 48 : cluster [DBG] 4.1e scrub ok 2024-02-10T08:19:16.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:14.475448+0000 mgr.y (mgr.14505) 96 : cluster [DBG] pgmap v83: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-10T08:19:16.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:14.475471+0000 osd.1 (osd.1) 51 : cluster [DBG] 4.12 scrub starts 2024-02-10T08:19:16.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:14.478957+0000 osd.1 (osd.1) 52 : cluster [DBG] 4.12 scrub ok 2024-02-10T08:19:16.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:15.489168+0000 osd.0 (osd.0) 47 : cluster [DBG] 4.1e scrub starts 2024-02-10T08:19:16.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:15.492816+0000 osd.0 (osd.0) 48 : cluster [DBG] 4.1e scrub ok 2024-02-10T08:19:16.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:14.475448+0000 mgr.y (mgr.14505) 96 : cluster [DBG] pgmap v83: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-10T08:19:16.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:14.475471+0000 osd.1 (osd.1) 51 : cluster [DBG] 4.12 scrub starts 2024-02-10T08:19:16.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:14.478957+0000 osd.1 (osd.1) 52 : cluster [DBG] 4.12 scrub ok 2024-02-10T08:19:16.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:15.489168+0000 osd.0 (osd.0) 47 : cluster [DBG] 4.1e scrub starts 2024-02-10T08:19:16.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:15.492816+0000 osd.0 (osd.0) 48 : cluster [DBG] 4.1e scrub ok 2024-02-10T08:19:16.190 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:19:16.192 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-02-10T08:19:16.789 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:19:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:19:16] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:19:16.879 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":83,"stamp":"2024-02-10T08:19:14.475289+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":5796,"num_objects":192,"num_object_clones":0,"num_object_copies":576,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":192,"num_whiteouts":0,"num_read":852,"num_read_kb":604,"num_write":428,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":488,"ondisk_log_size":488,"up":396,"acting":396,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":396,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":2381916,"kb_used_data":5148,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":747579300,"statfs":{"total":767960285184,"available":765521203200,"internally_reserved":0,"allocated":5271552,"data_stored":2421490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002275"},"pg_stats":[{"pgid":"6.1b","version":"0'0","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:19:01.075994+0000","last_change":"2024-02-10T08:19:01.075963+0000","last_active":"2024-02-10T08:19:01.075994+0000","last_peered":"2024-02-10T08:19:01.075994+0000","last_clean":"2024-02-10T08:19:01.075994+0000","last_became_active":"2024-02-10T08:16:58.892091+0000","last_became_peered":"2024-02-10T08:16:58.892091+0000","last_unstale":"2024-02-10T08:19:01.075994+0000","last_undegraded":"2024-02-10T08:19:01.075994+0000","last_fullsized":"2024-02-10T08:19:01.075994+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:01.075886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:19:01.075886+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.545894+0000","last_change":"2024-02-10T08:18:09.941981+0000","last_active":"2024-02-10T08:18:53.545894+0000","last_peered":"2024-02-10T08:18:53.545894+0000","last_clean":"2024-02-10T08:18:53.545894+0000","last_became_active":"2024-02-10T08:16:56.858480+0000","last_became_peered":"2024-02-10T08:16:56.858480+0000","last_unstale":"2024-02-10T08:18:53.545894+0000","last_undegraded":"2024-02-10T08:18:53.545894+0000","last_fullsized":"2024-02-10T08:18:53.545894+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:09.941898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:09.941898+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.806892+0000","last_change":"2024-02-10T08:18:43.744973+0000","last_active":"2024-02-10T08:18:53.806892+0000","last_peered":"2024-02-10T08:18:53.806892+0000","last_clean":"2024-02-10T08:18:53.806892+0000","last_became_active":"2024-02-10T08:16:52.788363+0000","last_became_peered":"2024-02-10T08:16:52.788363+0000","last_unstale":"2024-02-10T08:18:53.806892+0000","last_undegraded":"2024-02-10T08:18:53.806892+0000","last_fullsized":"2024-02-10T08:18:53.806892+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:43.744900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:43.744900+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"62'15","reported_seq":67,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.806890+0000","last_change":"2024-02-10T08:18:08.051424+0000","last_active":"2024-02-10T08:18:53.806890+0000","last_peered":"2024-02-10T08:18:53.806890+0000","last_clean":"2024-02-10T08:18:53.806890+0000","last_became_active":"2024-02-10T08:16:54.849232+0000","last_became_peered":"2024-02-10T08:16:54.849232+0000","last_unstale":"2024-02-10T08:18:53.806890+0000","last_undegraded":"2024-02-10T08:18:53.806890+0000","last_fullsized":"2024-02-10T08:18:53.806890+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'15","last_scrub_stamp":"2024-02-10T08:18:08.051315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:08.051315+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.546147+0000","last_change":"2024-02-10T08:18:19.058387+0000","last_active":"2024-02-10T08:18:53.546147+0000","last_peered":"2024-02-10T08:18:53.546147+0000","last_clean":"2024-02-10T08:18:53.546147+0000","last_became_active":"2024-02-10T08:16:58.860693+0000","last_became_peered":"2024-02-10T08:16:58.860693+0000","last_unstale":"2024-02-10T08:18:53.546147+0000","last_undegraded":"2024-02-10T08:18:53.546147+0000","last_fullsized":"2024-02-10T08:18:53.546147+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:19.058317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:19.058317+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.544400+0000","last_change":"2024-02-10T08:18:31.136877+0000","last_active":"2024-02-10T08:18:53.544400+0000","last_peered":"2024-02-10T08:18:53.544400+0000","last_clean":"2024-02-10T08:18:53.544400+0000","last_became_active":"2024-02-10T08:16:56.863353+0000","last_became_peered":"2024-02-10T08:16:56.863353+0000","last_unstale":"2024-02-10T08:18:53.544400+0000","last_undegraded":"2024-02-10T08:18:53.544400+0000","last_fullsized":"2024-02-10T08:18:53.544400+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:31.136797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:31.136797+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.806388+0000","last_change":"2024-02-10T08:17:53.926192+0000","last_active":"2024-02-10T08:18:53.806388+0000","last_peered":"2024-02-10T08:18:53.806388+0000","last_clean":"2024-02-10T08:18:53.806388+0000","last_became_active":"2024-02-10T08:16:52.787183+0000","last_became_peered":"2024-02-10T08:16:52.787183+0000","last_unstale":"2024-02-10T08:18:53.806388+0000","last_undegraded":"2024-02-10T08:18:53.806388+0000","last_fullsized":"2024-02-10T08:18:53.806388+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:17:53.926120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:17:53.926120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"62'9","reported_seq":58,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.546024+0000","last_change":"2024-02-10T08:18:12.998301+0000","last_active":"2024-02-10T08:18:53.546024+0000","last_peered":"2024-02-10T08:18:53.546024+0000","last_clean":"2024-02-10T08:18:53.546024+0000","last_became_active":"2024-02-10T08:16:54.852200+0000","last_became_peered":"2024-02-10T08:16:54.852200+0000","last_unstale":"2024-02-10T08:18:53.546024+0000","last_undegraded":"2024-02-10T08:18:53.546024+0000","last_fullsized":"2024-02-10T08:18:53.546024+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'9","last_scrub_stamp":"2024-02-10T08:18:12.998167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:12.998167+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":37,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.805853+0000","last_change":"2024-02-10T08:18:51.370619+0000","last_active":"2024-02-10T08:18:53.805853+0000","last_peered":"2024-02-10T08:18:53.805853+0000","last_clean":"2024-02-10T08:18:53.805853+0000","last_became_active":"2024-02-10T08:16:58.867430+0000","last_became_peered":"2024-02-10T08:16:58.867430+0000","last_unstale":"2024-02-10T08:18:53.805853+0000","last_undegraded":"2024-02-10T08:18:53.805853+0000","last_fullsized":"2024-02-10T08:18:53.805853+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:51.370527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:51.370527+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.807000+0000","last_change":"2024-02-10T08:17:59.772854+0000","last_active":"2024-02-10T08:18:53.807000+0000","last_peered":"2024-02-10T08:18:53.807000+0000","last_clean":"2024-02-10T08:18:53.807000+0000","last_became_active":"2024-02-10T08:16:56.865529+0000","last_became_peered":"2024-02-10T08:16:56.865529+0000","last_unstale":"2024-02-10T08:18:53.807000+0000","last_undegraded":"2024-02-10T08:18:53.807000+0000","last_fullsized":"2024-02-10T08:18:53.807000+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:17:59.772766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:17:59.772766+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"55'1","reported_seq":50,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.807497+0000","last_change":"2024-02-10T08:18:33.095861+0000","last_active":"2024-02-10T08:18:53.807497+0000","last_peered":"2024-02-10T08:18:53.807497+0000","last_clean":"2024-02-10T08:18:53.807497+0000","last_became_active":"2024-02-10T08:16:52.790462+0000","last_became_peered":"2024-02-10T08:16:52.790462+0000","last_unstale":"2024-02-10T08:18:53.807497+0000","last_undegraded":"2024-02-10T08:18:53.807497+0000","last_fullsized":"2024-02-10T08:18:53.807497+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'1","last_scrub_stamp":"2024-02-10T08:18:33.095757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:33.095757+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"62'5","reported_seq":52,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.546426+0000","last_change":"2024-02-10T08:18:11.967605+0000","last_active":"2024-02-10T08:18:53.546426+0000","last_peered":"2024-02-10T08:18:53.546426+0000","last_clean":"2024-02-10T08:18:53.546426+0000","last_became_active":"2024-02-10T08:16:54.849450+0000","last_became_peered":"2024-02-10T08:16:54.849450+0000","last_unstale":"2024-02-10T08:18:53.546426+0000","last_undegraded":"2024-02-10T08:18:53.546426+0000","last_fullsized":"2024-02-10T08:18:53.546426+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'5","last_scrub_stamp":"2024-02-10T08:18:11.967507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:11.967507+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":37,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.805602+0000","last_change":"2024-02-10T08:18:15.691621+0000","last_active":"2024-02-10T08:18:53.805602+0000","last_peered":"2024-02-10T08:18:53.805602+0000","last_clean":"2024-02-10T08:18:53.805602+0000","last_became_active":"2024-02-10T08:16:58.860591+0000","last_became_peered":"2024-02-10T08:16:58.860591+0000","last_unstale":"2024-02-10T08:18:53.805602+0000","last_undegraded":"2024-02-10T08:18:53.805602+0000","last_fullsized":"2024-02-10T08:18:53.805602+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:15.691552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:15.691552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.806497+0000","last_change":"2024-02-10T08:18:09.324937+0000","last_active":"2024-02-10T08:18:53.806497+0000","last_peered":"2024-02-10T08:18:53.806497+0000","last_clean":"2024-02-10T08:18:53.806497+0000","last_became_active":"2024-02-10T08:16:56.864532+0000","last_became_peered":"2024-02-10T08:16:56.864532+0000","last_unstale":"2024-02-10T08:18:53.806497+0000","last_undegraded":"2024-02-10T08:18:53.806497+0000","last_fullsized":"2024-02-10T08:18:53.806497+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:09.324856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:09.324856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.807330+0000","last_change":"2024-02-10T08:18:28.028628+0000","last_active":"2024-02-10T08:18:53.807330+0000","last_peered":"2024-02-10T08:18:53.807330+0000","last_clean":"2024-02-10T08:18:53.807330+0000","last_became_active":"2024-02-10T08:16:52.787865+0000","last_became_peered":"2024-02-10T08:16:52.787865+0000","last_unstale":"2024-02-10T08:18:53.807330+0000","last_undegraded":"2024-02-10T08:18:53.807330+0000","last_fullsized":"2024-02-10T08:18:53.807330+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:28.028556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:28.028556+0000","last_clean_scrub_stamp":"2024-02-10T08:18:28.028556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"62'9","reported_seq":58,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.546188+0000","last_change":"2024-02-10T08:18:15.012767+0000","last_active":"2024-02-10T08:18:53.546188+0000","last_peered":"2024-02-10T08:18:53.546188+0000","last_clean":"2024-02-10T08:18:53.546188+0000","last_became_active":"2024-02-10T08:16:54.847486+0000","last_became_peered":"2024-02-10T08:16:54.847486+0000","last_unstale":"2024-02-10T08:18:53.546188+0000","last_undegraded":"2024-02-10T08:18:53.546188+0000","last_fullsized":"2024-02-10T08:18:53.546188+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'9","last_scrub_stamp":"2024-02-10T08:18:15.012657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:15.012657+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.806062+0000","last_change":"2024-02-10T08:18:52.045246+0000","last_active":"2024-02-10T08:18:53.806062+0000","last_peered":"2024-02-10T08:18:53.806062+0000","last_clean":"2024-02-10T08:18:53.806062+0000","last_became_active":"2024-02-10T08:16:58.891365+0000","last_became_peered":"2024-02-10T08:16:58.891365+0000","last_unstale":"2024-02-10T08:18:53.806062+0000","last_undegraded":"2024-02-10T08:18:53.806062+0000","last_fullsized":"2024-02-10T08:18:53.806062+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:52.045180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:52.045180+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.546539+0000","last_change":"2024-02-10T08:18:22.000876+0000","last_active":"2024-02-10T08:18:53.546539+0000","last_peered":"2024-02-10T08:18:53.546539+0000","last_clean":"2024-02-10T08:18:53.546539+0000","last_became_active":"2024-02-10T08:16:56.867217+0000","last_became_peered":"2024-02-10T08:16:56.867217+0000","last_unstale":"2024-02-10T08:18:53.546539+0000","last_undegraded":"2024-02-10T08:18:53.546539+0000","last_fullsized":"2024-02-10T08:18:53.546539+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:22.000811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:22.000811+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.806021+0000","last_change":"2024-02-10T08:18:14.058600+0000","last_active":"2024-02-10T08:18:53.806021+0000","last_peered":"2024-02-10T08:18:53.806021+0000","last_clean":"2024-02-10T08:18:53.806021+0000","last_became_active":"2024-02-10T08:16:52.785404+0000","last_became_peered":"2024-02-10T08:16:52.785404+0000","last_unstale":"2024-02-10T08:18:53.806021+0000","last_undegraded":"2024-02-10T08:18:53.806021+0000","last_fullsized":"2024-02-10T08:18:53.806021+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:14.058501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:14.058501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"74'17","reported_seq":70,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.806122+0000","last_change":"2024-02-10T08:18:02.949370+0000","last_active":"2024-02-10T08:18:53.806122+0000","last_peered":"2024-02-10T08:18:53.806122+0000","last_clean":"2024-02-10T08:18:53.806122+0000","last_became_active":"2024-02-10T08:16:54.848784+0000","last_became_peered":"2024-02-10T08:16:54.848784+0000","last_unstale":"2024-02-10T08:18:53.806122+0000","last_undegraded":"2024-02-10T08:18:53.806122+0000","last_fullsized":"2024-02-10T08:18:53.806122+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'17","last_scrub_stamp":"2024-02-10T08:18:02.949298+0000","last_deep_scrub":"74'17","last_deep_scrub_stamp":"2024-02-10T08:18:02.949298+0000","last_clean_scrub_stamp":"2024-02-10T08:18:02.949298+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.546917+0000","last_change":"2024-02-10T08:18:26.952584+0000","last_active":"2024-02-10T08:18:53.546917+0000","last_peered":"2024-02-10T08:18:53.546917+0000","last_clean":"2024-02-10T08:18:53.546917+0000","last_became_active":"2024-02-10T08:16:58.893364+0000","last_became_peered":"2024-02-10T08:16:58.893364+0000","last_unstale":"2024-02-10T08:18:53.546917+0000","last_undegraded":"2024-02-10T08:18:53.546917+0000","last_fullsized":"2024-02-10T08:18:53.546917+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:26.952496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:26.952496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.544170+0000","last_change":"2024-02-10T08:18:38.230334+0000","last_active":"2024-02-10T08:18:53.544170+0000","last_peered":"2024-02-10T08:18:53.544170+0000","last_clean":"2024-02-10T08:18:53.544170+0000","last_became_active":"2024-02-10T08:16:56.859752+0000","last_became_peered":"2024-02-10T08:16:56.859752+0000","last_unstale":"2024-02-10T08:18:53.544170+0000","last_undegraded":"2024-02-10T08:18:53.544170+0000","last_fullsized":"2024-02-10T08:18:53.544170+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:38.230210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:38.230210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":48,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:10.370825+0000","last_change":"2024-02-10T08:19:10.370825+0000","last_active":"2024-02-10T08:19:10.370825+0000","last_peered":"2024-02-10T08:19:10.370825+0000","last_clean":"2024-02-10T08:19:10.370825+0000","last_became_active":"2024-02-10T08:16:52.783261+0000","last_became_peered":"2024-02-10T08:16:52.783261+0000","last_unstale":"2024-02-10T08:19:10.370825+0000","last_undegraded":"2024-02-10T08:19:10.370825+0000","last_fullsized":"2024-02-10T08:19:10.370825+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:10.370746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:10.370746+0000","last_clean_scrub_stamp":"2024-02-10T08:19:10.370746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1c","version":"62'15","reported_seq":67,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.544495+0000","last_change":"2024-02-10T08:18:13.740262+0000","last_active":"2024-02-10T08:18:53.544495+0000","last_peered":"2024-02-10T08:18:53.544495+0000","last_clean":"2024-02-10T08:18:53.544495+0000","last_became_active":"2024-02-10T08:16:54.849361+0000","last_became_peered":"2024-02-10T08:16:54.849361+0000","last_unstale":"2024-02-10T08:18:53.544495+0000","last_undegraded":"2024-02-10T08:18:53.544495+0000","last_fullsized":"2024-02-10T08:18:53.544495+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'15","last_scrub_stamp":"2024-02-10T08:18:13.740187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:13.740187+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.543753+0000","last_change":"2024-02-10T08:18:22.105101+0000","last_active":"2024-02-10T08:18:53.543753+0000","last_peered":"2024-02-10T08:18:53.543753+0000","last_clean":"2024-02-10T08:18:53.543753+0000","last_became_active":"2024-02-10T08:16:58.862893+0000","last_became_peered":"2024-02-10T08:16:58.862893+0000","last_unstale":"2024-02-10T08:18:53.543753+0000","last_undegraded":"2024-02-10T08:18:53.543753+0000","last_fullsized":"2024-02-10T08:18:53.543753+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:22.104988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:22.104988+0000","last_clean_scrub_stamp":"2024-02-10T08:18:22.104988+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.806786+0000","last_change":"2024-02-10T08:18:21.772134+0000","last_active":"2024-02-10T08:18:53.806786+0000","last_peered":"2024-02-10T08:18:53.806786+0000","last_clean":"2024-02-10T08:18:53.806786+0000","last_became_active":"2024-02-10T08:16:56.863348+0000","last_became_peered":"2024-02-10T08:16:56.863348+0000","last_unstale":"2024-02-10T08:18:53.806786+0000","last_undegraded":"2024-02-10T08:18:53.806786+0000","last_fullsized":"2024-02-10T08:18:53.806786+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:21.771969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:21.771969+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.806706+0000","last_change":"2024-02-10T08:18:38.075002+0000","last_active":"2024-02-10T08:18:53.806706+0000","last_peered":"2024-02-10T08:18:53.806706+0000","last_clean":"2024-02-10T08:18:53.806706+0000","last_became_active":"2024-02-10T08:16:52.785743+0000","last_became_peered":"2024-02-10T08:16:52.785743+0000","last_unstale":"2024-02-10T08:18:53.806706+0000","last_undegraded":"2024-02-10T08:18:53.806706+0000","last_fullsized":"2024-02-10T08:18:53.806706+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:38.074885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:38.074885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"62'11","reported_seq":60,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.808148+0000","last_change":"2024-02-10T08:18:22.373044+0000","last_active":"2024-02-10T08:18:53.808148+0000","last_peered":"2024-02-10T08:18:53.808148+0000","last_clean":"2024-02-10T08:18:53.808148+0000","last_became_active":"2024-02-10T08:16:54.852665+0000","last_became_peered":"2024-02-10T08:16:54.852665+0000","last_unstale":"2024-02-10T08:18:53.808148+0000","last_undegraded":"2024-02-10T08:18:53.808148+0000","last_fullsized":"2024-02-10T08:18:53.808148+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'11","last_scrub_stamp":"2024-02-10T08:18:22.372958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:22.372958+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"62'1","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.807707+0000","last_change":"2024-02-10T08:18:13.819515+0000","last_active":"2024-02-10T08:18:53.807707+0000","last_peered":"2024-02-10T08:18:53.807707+0000","last_clean":"2024-02-10T08:18:53.807707+0000","last_became_active":"2024-02-10T08:16:58.859047+0000","last_became_peered":"2024-02-10T08:16:58.859047+0000","last_unstale":"2024-02-10T08:18:53.807707+0000","last_undegraded":"2024-02-10T08:18:53.807707+0000","last_fullsized":"2024-02-10T08:18:53.807707+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'1","last_scrub_stamp":"2024-02-10T08:18:13.819405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:13.819405+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"82'9","reported_seq":82,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.725790+0000","last_change":"2024-02-10T08:18:36.323299+0000","last_active":"2024-02-10T08:19:09.725790+0000","last_peered":"2024-02-10T08:19:09.725790+0000","last_clean":"2024-02-10T08:19:09.725790+0000","last_became_active":"2024-02-10T08:16:56.854294+0000","last_became_peered":"2024-02-10T08:16:56.854294+0000","last_unstale":"2024-02-10T08:19:09.725790+0000","last_undegraded":"2024-02-10T08:19:09.725790+0000","last_fullsized":"2024-02-10T08:19:09.725790+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'9","last_scrub_stamp":"2024-02-10T08:18:36.323217+0000","last_deep_scrub":"82'9","last_deep_scrub_stamp":"2024-02-10T08:18:36.323217+0000","last_clean_scrub_stamp":"2024-02-10T08:18:36.323217+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.805657+0000","last_change":"2024-02-10T08:18:30.422885+0000","last_active":"2024-02-10T08:18:53.805657+0000","last_peered":"2024-02-10T08:18:53.805657+0000","last_clean":"2024-02-10T08:18:53.805657+0000","last_became_active":"2024-02-10T08:16:52.788543+0000","last_became_peered":"2024-02-10T08:16:52.788543+0000","last_unstale":"2024-02-10T08:18:53.805657+0000","last_undegraded":"2024-02-10T08:18:53.805657+0000","last_fullsized":"2024-02-10T08:18:53.805657+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:30.422800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:30.422800+0000","last_clean_scrub_stamp":"2024-02-10T08:18:30.422800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"74'15","reported_seq":61,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.806790+0000","last_change":"2024-02-10T08:17:57.637408+0000","last_active":"2024-02-10T08:18:53.806790+0000","last_peered":"2024-02-10T08:18:53.806790+0000","last_clean":"2024-02-10T08:18:53.806790+0000","last_became_active":"2024-02-10T08:16:55.204738+0000","last_became_peered":"2024-02-10T08:16:55.204738+0000","last_unstale":"2024-02-10T08:18:53.806790+0000","last_undegraded":"2024-02-10T08:18:53.806790+0000","last_fullsized":"2024-02-10T08:18:53.806790+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'15","last_scrub_stamp":"2024-02-10T08:17:57.637346+0000","last_deep_scrub":"74'15","last_deep_scrub_stamp":"2024-02-10T08:17:57.637346+0000","last_clean_scrub_stamp":"2024-02-10T08:17:57.637346+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.806209+0000","last_change":"2024-02-10T08:18:28.180766+0000","last_active":"2024-02-10T08:18:53.806209+0000","last_peered":"2024-02-10T08:18:53.806209+0000","last_clean":"2024-02-10T08:18:53.806209+0000","last_became_active":"2024-02-10T08:16:58.892622+0000","last_became_peered":"2024-02-10T08:16:58.892622+0000","last_unstale":"2024-02-10T08:18:53.806209+0000","last_undegraded":"2024-02-10T08:18:53.806209+0000","last_fullsized":"2024-02-10T08:18:53.806209+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:28.180637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:28.180637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:19:06.357204+0000","last_change":"2024-02-10T08:19:06.357158+0000","last_active":"2024-02-10T08:19:06.357204+0000","last_peered":"2024-02-10T08:19:06.357204+0000","last_clean":"2024-02-10T08:19:06.357204+0000","last_became_active":"2024-02-10T08:16:56.860207+0000","last_became_peered":"2024-02-10T08:16:56.860207+0000","last_unstale":"2024-02-10T08:19:06.357204+0000","last_undegraded":"2024-02-10T08:19:06.357204+0000","last_fullsized":"2024-02-10T08:19:06.357204+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:06.357048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:19:06.357048+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.808281+0000","last_change":"2024-02-10T08:18:12.262783+0000","last_active":"2024-02-10T08:18:53.808281+0000","last_peered":"2024-02-10T08:18:53.808281+0000","last_clean":"2024-02-10T08:18:53.808281+0000","last_became_active":"2024-02-10T08:16:52.788629+0000","last_became_peered":"2024-02-10T08:16:52.788629+0000","last_unstale":"2024-02-10T08:18:53.808281+0000","last_undegraded":"2024-02-10T08:18:53.808281+0000","last_fullsized":"2024-02-10T08:18:53.808281+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:12.262707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:12.262707+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"62'11","reported_seq":61,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.806844+0000","last_change":"2024-02-10T08:18:25.169653+0000","last_active":"2024-02-10T08:18:53.806844+0000","last_peered":"2024-02-10T08:18:53.806844+0000","last_clean":"2024-02-10T08:18:53.806844+0000","last_became_active":"2024-02-10T08:16:55.204751+0000","last_became_peered":"2024-02-10T08:16:55.204751+0000","last_unstale":"2024-02-10T08:18:53.806844+0000","last_undegraded":"2024-02-10T08:18:53.806844+0000","last_fullsized":"2024-02-10T08:18:53.806844+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'11","last_scrub_stamp":"2024-02-10T08:18:25.169566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:25.169566+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":37,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.806806+0000","last_change":"2024-02-10T08:18:12.778101+0000","last_active":"2024-02-10T08:18:53.806806+0000","last_peered":"2024-02-10T08:18:53.806806+0000","last_clean":"2024-02-10T08:18:53.806806+0000","last_became_active":"2024-02-10T08:16:58.859979+0000","last_became_peered":"2024-02-10T08:16:58.859979+0000","last_unstale":"2024-02-10T08:18:53.806806+0000","last_undegraded":"2024-02-10T08:18:53.806806+0000","last_fullsized":"2024-02-10T08:18:53.806806+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:12.778021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:12.778021+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.806864+0000","last_change":"2024-02-10T08:18:34.381405+0000","last_active":"2024-02-10T08:18:53.806864+0000","last_peered":"2024-02-10T08:18:53.806864+0000","last_clean":"2024-02-10T08:18:53.806864+0000","last_became_active":"2024-02-10T08:16:56.859540+0000","last_became_peered":"2024-02-10T08:16:56.859540+0000","last_unstale":"2024-02-10T08:18:53.806864+0000","last_undegraded":"2024-02-10T08:18:53.806864+0000","last_fullsized":"2024-02-10T08:18:53.806864+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:34.381329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:34.381329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.807305+0000","last_change":"2024-02-10T08:18:05.347110+0000","last_active":"2024-02-10T08:18:53.807305+0000","last_peered":"2024-02-10T08:18:53.807305+0000","last_clean":"2024-02-10T08:18:53.807305+0000","last_became_active":"2024-02-10T08:16:52.788704+0000","last_became_peered":"2024-02-10T08:16:52.788704+0000","last_unstale":"2024-02-10T08:18:53.807305+0000","last_undegraded":"2024-02-10T08:18:53.807305+0000","last_fullsized":"2024-02-10T08:18:53.807305+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:05.347009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:05.347009+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"62'4","reported_seq":48,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.805505+0000","last_change":"2024-02-10T08:18:50.134758+0000","last_active":"2024-02-10T08:18:53.805505+0000","last_peered":"2024-02-10T08:18:53.805505+0000","last_clean":"2024-02-10T08:18:53.805505+0000","last_became_active":"2024-02-10T08:16:54.852959+0000","last_became_peered":"2024-02-10T08:16:54.852959+0000","last_unstale":"2024-02-10T08:18:53.805505+0000","last_undegraded":"2024-02-10T08:18:53.805505+0000","last_fullsized":"2024-02-10T08:18:53.805505+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'4","last_scrub_stamp":"2024-02-10T08:18:50.134690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:50.134690+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:19:02.030194+0000","last_change":"2024-02-10T08:19:02.030164+0000","last_active":"2024-02-10T08:19:02.030194+0000","last_peered":"2024-02-10T08:19:02.030194+0000","last_clean":"2024-02-10T08:19:02.030194+0000","last_became_active":"2024-02-10T08:16:58.864301+0000","last_became_peered":"2024-02-10T08:16:58.864301+0000","last_unstale":"2024-02-10T08:19:02.030194+0000","last_undegraded":"2024-02-10T08:19:02.030194+0000","last_fullsized":"2024-02-10T08:19:02.030194+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:02.030086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:19:02.030086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.545083+0000","last_change":"2024-02-10T08:18:30.157336+0000","last_active":"2024-02-10T08:18:53.545083+0000","last_peered":"2024-02-10T08:18:53.545083+0000","last_clean":"2024-02-10T08:18:53.545083+0000","last_became_active":"2024-02-10T08:16:56.860953+0000","last_became_peered":"2024-02-10T08:16:56.860953+0000","last_unstale":"2024-02-10T08:18:53.545083+0000","last_undegraded":"2024-02-10T08:18:53.545083+0000","last_fullsized":"2024-02-10T08:18:53.545083+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:30.157268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:30.157268+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.543943+0000","last_change":"2024-02-10T08:18:21.134912+0000","last_active":"2024-02-10T08:18:53.543943+0000","last_peered":"2024-02-10T08:18:53.543943+0000","last_clean":"2024-02-10T08:18:53.543943+0000","last_became_active":"2024-02-10T08:16:52.786400+0000","last_became_peered":"2024-02-10T08:16:52.786400+0000","last_unstale":"2024-02-10T08:18:53.543943+0000","last_undegraded":"2024-02-10T08:18:53.543943+0000","last_fullsized":"2024-02-10T08:18:53.543943+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:21.134826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:21.134826+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"62'11","reported_seq":82,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.546324+0000","last_change":"2024-02-10T08:18:18.168451+0000","last_active":"2024-02-10T08:18:53.546324+0000","last_peered":"2024-02-10T08:18:53.546324+0000","last_clean":"2024-02-10T08:18:53.546324+0000","last_became_active":"2024-02-10T08:18:18.162983+0000","last_became_peered":"2024-02-10T08:18:18.162983+0000","last_unstale":"2024-02-10T08:18:53.546324+0000","last_undegraded":"2024-02-10T08:18:53.546324+0000","last_fullsized":"2024-02-10T08:18:53.546324+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'11","last_scrub_stamp":"2024-02-10T08:18:17.029517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:17.029517+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":37,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:54.588873+0000","last_change":"2024-02-10T08:18:54.588850+0000","last_active":"2024-02-10T08:18:54.588873+0000","last_peered":"2024-02-10T08:18:54.588873+0000","last_clean":"2024-02-10T08:18:54.588873+0000","last_became_active":"2024-02-10T08:16:58.861031+0000","last_became_peered":"2024-02-10T08:16:58.861031+0000","last_unstale":"2024-02-10T08:18:54.588873+0000","last_undegraded":"2024-02-10T08:18:54.588873+0000","last_fullsized":"2024-02-10T08:18:54.588873+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:54.588775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:54.588775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:55.042090+0000","last_change":"2024-02-10T08:18:55.042056+0000","last_active":"2024-02-10T08:18:55.042090+0000","last_peered":"2024-02-10T08:18:55.042090+0000","last_clean":"2024-02-10T08:18:55.042090+0000","last_became_active":"2024-02-10T08:16:56.862136+0000","last_became_peered":"2024-02-10T08:16:56.862136+0000","last_unstale":"2024-02-10T08:18:55.042090+0000","last_undegraded":"2024-02-10T08:18:55.042090+0000","last_fullsized":"2024-02-10T08:18:55.042090+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:55.041978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:55.041978+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.805994+0000","last_change":"2024-02-10T08:17:58.226189+0000","last_active":"2024-02-10T08:18:53.805994+0000","last_peered":"2024-02-10T08:18:53.805994+0000","last_clean":"2024-02-10T08:18:53.805994+0000","last_became_active":"2024-02-10T08:16:52.786213+0000","last_became_peered":"2024-02-10T08:16:52.786213+0000","last_unstale":"2024-02-10T08:18:53.805994+0000","last_undegraded":"2024-02-10T08:18:53.805994+0000","last_fullsized":"2024-02-10T08:18:53.805994+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:17:58.226110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:17:58.226110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"62'9","reported_seq":58,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.544920+0000","last_change":"2024-02-10T08:18:03.050657+0000","last_active":"2024-02-10T08:18:53.544920+0000","last_peered":"2024-02-10T08:18:53.544920+0000","last_clean":"2024-02-10T08:18:53.544920+0000","last_became_active":"2024-02-10T08:16:54.851971+0000","last_became_peered":"2024-02-10T08:16:54.851971+0000","last_unstale":"2024-02-10T08:18:53.544920+0000","last_undegraded":"2024-02-10T08:18:53.544920+0000","last_fullsized":"2024-02-10T08:18:53.544920+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'9","last_scrub_stamp":"2024-02-10T08:18:03.050481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:03.050481+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.547028+0000","last_change":"2024-02-10T08:18:22.955891+0000","last_active":"2024-02-10T08:18:53.547028+0000","last_peered":"2024-02-10T08:18:53.547028+0000","last_clean":"2024-02-10T08:18:53.547028+0000","last_became_active":"2024-02-10T08:16:58.858961+0000","last_became_peered":"2024-02-10T08:16:58.858961+0000","last_unstale":"2024-02-10T08:18:53.547028+0000","last_undegraded":"2024-02-10T08:18:53.547028+0000","last_fullsized":"2024-02-10T08:18:53.547028+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:22.955823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:22.955823+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"62'8","reported_seq":76,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.591671+0000","last_change":"2024-02-10T08:18:23.120983+0000","last_active":"2024-02-10T08:19:09.591671+0000","last_peered":"2024-02-10T08:19:09.591671+0000","last_clean":"2024-02-10T08:19:09.591671+0000","last_became_active":"2024-02-10T08:16:56.854151+0000","last_became_peered":"2024-02-10T08:16:56.854151+0000","last_unstale":"2024-02-10T08:19:09.591671+0000","last_undegraded":"2024-02-10T08:19:09.591671+0000","last_fullsized":"2024-02-10T08:19:09.591671+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'8","last_scrub_stamp":"2024-02-10T08:18:23.120909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:23.120909+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":48,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:19:08.548559+0000","last_change":"2024-02-10T08:19:08.548533+0000","last_active":"2024-02-10T08:19:08.548559+0000","last_peered":"2024-02-10T08:19:08.548559+0000","last_clean":"2024-02-10T08:19:08.548559+0000","last_became_active":"2024-02-10T08:16:52.786492+0000","last_became_peered":"2024-02-10T08:16:52.786492+0000","last_unstale":"2024-02-10T08:19:08.548559+0000","last_undegraded":"2024-02-10T08:19:08.548559+0000","last_fullsized":"2024-02-10T08:19:08.548559+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:08.548458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:19:08.548458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"62'9","reported_seq":57,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.806484+0000","last_change":"2024-02-10T08:18:48.370939+0000","last_active":"2024-02-10T08:18:53.806484+0000","last_peered":"2024-02-10T08:18:53.806484+0000","last_clean":"2024-02-10T08:18:53.806484+0000","last_became_active":"2024-02-10T08:16:55.204734+0000","last_became_peered":"2024-02-10T08:16:55.204734+0000","last_unstale":"2024-02-10T08:18:53.806484+0000","last_undegraded":"2024-02-10T08:18:53.806484+0000","last_fullsized":"2024-02-10T08:18:53.806484+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'9","last_scrub_stamp":"2024-02-10T08:18:48.370832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:48.370832+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":37,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.806604+0000","last_change":"2024-02-10T08:18:05.663042+0000","last_active":"2024-02-10T08:18:53.806604+0000","last_peered":"2024-02-10T08:18:53.806604+0000","last_clean":"2024-02-10T08:18:53.806604+0000","last_became_active":"2024-02-10T08:16:58.869673+0000","last_became_peered":"2024-02-10T08:16:58.869673+0000","last_unstale":"2024-02-10T08:18:53.806604+0000","last_undegraded":"2024-02-10T08:18:53.806604+0000","last_fullsized":"2024-02-10T08:18:53.806604+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:05.662947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:05.662947+0000","last_clean_scrub_stamp":"2024-02-10T08:18:05.662947+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"62'8","reported_seq":75,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.724059+0000","last_change":"2024-02-10T08:18:23.419433+0000","last_active":"2024-02-10T08:19:09.724059+0000","last_peered":"2024-02-10T08:19:09.724059+0000","last_clean":"2024-02-10T08:19:09.724059+0000","last_became_active":"2024-02-10T08:16:56.864587+0000","last_became_peered":"2024-02-10T08:16:56.864587+0000","last_unstale":"2024-02-10T08:19:09.724059+0000","last_undegraded":"2024-02-10T08:19:09.724059+0000","last_fullsized":"2024-02-10T08:19:09.724059+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'8","last_scrub_stamp":"2024-02-10T08:18:23.419353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:23.419353+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.806692+0000","last_change":"2024-02-10T08:18:34.327085+0000","last_active":"2024-02-10T08:18:53.806692+0000","last_peered":"2024-02-10T08:18:53.806692+0000","last_clean":"2024-02-10T08:18:53.806692+0000","last_became_active":"2024-02-10T08:16:52.789834+0000","last_became_peered":"2024-02-10T08:16:52.789834+0000","last_unstale":"2024-02-10T08:18:53.806692+0000","last_undegraded":"2024-02-10T08:18:53.806692+0000","last_fullsized":"2024-02-10T08:18:53.806692+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:34.326987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:34.326987+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"62'10","reported_seq":62,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.007487+0000","last_change":"2024-02-10T08:19:09.007459+0000","last_active":"2024-02-10T08:19:09.007487+0000","last_peered":"2024-02-10T08:19:09.007487+0000","last_clean":"2024-02-10T08:19:09.007487+0000","last_became_active":"2024-02-10T08:16:55.204789+0000","last_became_peered":"2024-02-10T08:16:55.204789+0000","last_unstale":"2024-02-10T08:19:09.007487+0000","last_undegraded":"2024-02-10T08:19:09.007487+0000","last_fullsized":"2024-02-10T08:19:09.007487+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'10","last_scrub_stamp":"2024-02-10T08:19:09.007376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:19:09.007376+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":37,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.807358+0000","last_change":"2024-02-10T08:18:22.944672+0000","last_active":"2024-02-10T08:18:53.807358+0000","last_peered":"2024-02-10T08:18:53.807358+0000","last_clean":"2024-02-10T08:18:53.807358+0000","last_became_active":"2024-02-10T08:16:58.893128+0000","last_became_peered":"2024-02-10T08:16:58.893128+0000","last_unstale":"2024-02-10T08:18:53.807358+0000","last_undegraded":"2024-02-10T08:18:53.807358+0000","last_fullsized":"2024-02-10T08:18:53.807358+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:22.944593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:22.944593+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.806860+0000","last_change":"2024-02-10T08:18:49.369603+0000","last_active":"2024-02-10T08:18:53.806860+0000","last_peered":"2024-02-10T08:18:53.806860+0000","last_clean":"2024-02-10T08:18:53.806860+0000","last_became_active":"2024-02-10T08:16:56.863948+0000","last_became_peered":"2024-02-10T08:16:56.863948+0000","last_unstale":"2024-02-10T08:18:53.806860+0000","last_undegraded":"2024-02-10T08:18:53.806860+0000","last_fullsized":"2024-02-10T08:18:53.806860+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:49.369500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:49.369500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.806963+0000","last_change":"2024-02-10T08:18:08.233178+0000","last_active":"2024-02-10T08:18:53.806963+0000","last_peered":"2024-02-10T08:18:53.806963+0000","last_clean":"2024-02-10T08:18:53.806963+0000","last_became_active":"2024-02-10T08:16:52.782434+0000","last_became_peered":"2024-02-10T08:16:52.782434+0000","last_unstale":"2024-02-10T08:18:53.806963+0000","last_undegraded":"2024-02-10T08:18:53.806963+0000","last_fullsized":"2024-02-10T08:18:53.806963+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:08.233096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:08.233096+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"62'6","reported_seq":51,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.805949+0000","last_change":"2024-02-10T08:18:42.100646+0000","last_active":"2024-02-10T08:18:53.805949+0000","last_peered":"2024-02-10T08:18:53.805949+0000","last_clean":"2024-02-10T08:18:53.805949+0000","last_became_active":"2024-02-10T08:16:55.203401+0000","last_became_peered":"2024-02-10T08:16:55.203401+0000","last_unstale":"2024-02-10T08:18:53.805949+0000","last_undegraded":"2024-02-10T08:18:53.805949+0000","last_fullsized":"2024-02-10T08:18:53.805949+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'6","last_scrub_stamp":"2024-02-10T08:18:42.100550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:42.100550+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.544183+0000","last_change":"2024-02-10T08:18:10.716849+0000","last_active":"2024-02-10T08:18:53.544183+0000","last_peered":"2024-02-10T08:18:53.544183+0000","last_clean":"2024-02-10T08:18:53.544183+0000","last_became_active":"2024-02-10T08:16:58.857790+0000","last_became_peered":"2024-02-10T08:16:58.857790+0000","last_unstale":"2024-02-10T08:18:53.544183+0000","last_undegraded":"2024-02-10T08:18:53.544183+0000","last_fullsized":"2024-02-10T08:18:53.544183+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:10.716763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:10.716763+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.806060+0000","last_change":"2024-02-10T08:18:22.074334+0000","last_active":"2024-02-10T08:18:53.806060+0000","last_peered":"2024-02-10T08:18:53.806060+0000","last_clean":"2024-02-10T08:18:53.806060+0000","last_became_active":"2024-02-10T08:16:56.860904+0000","last_became_peered":"2024-02-10T08:16:56.860904+0000","last_unstale":"2024-02-10T08:18:53.806060+0000","last_undegraded":"2024-02-10T08:18:53.806060+0000","last_fullsized":"2024-02-10T08:18:53.806060+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:22.074268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:22.074268+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"55'1","reported_seq":50,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.543021+0000","last_change":"2024-02-10T08:18:03.695320+0000","last_active":"2024-02-10T08:18:53.543021+0000","last_peered":"2024-02-10T08:18:53.543021+0000","last_clean":"2024-02-10T08:18:53.543021+0000","last_became_active":"2024-02-10T08:16:52.782734+0000","last_became_peered":"2024-02-10T08:16:52.782734+0000","last_unstale":"2024-02-10T08:18:53.543021+0000","last_undegraded":"2024-02-10T08:18:53.543021+0000","last_fullsized":"2024-02-10T08:18:53.543021+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'1","last_scrub_stamp":"2024-02-10T08:18:03.695203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:03.695203+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"62'9","reported_seq":57,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.806706+0000","last_change":"2024-02-10T08:18:09.641466+0000","last_active":"2024-02-10T08:18:53.806706+0000","last_peered":"2024-02-10T08:18:53.806706+0000","last_clean":"2024-02-10T08:18:53.806706+0000","last_became_active":"2024-02-10T08:16:55.204727+0000","last_became_peered":"2024-02-10T08:16:55.204727+0000","last_unstale":"2024-02-10T08:18:53.806706+0000","last_undegraded":"2024-02-10T08:18:53.806706+0000","last_fullsized":"2024-02-10T08:18:53.806706+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'9","last_scrub_stamp":"2024-02-10T08:18:09.641378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:09.641378+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.806207+0000","last_change":"2024-02-10T08:18:32.027821+0000","last_active":"2024-02-10T08:18:53.806207+0000","last_peered":"2024-02-10T08:18:53.806207+0000","last_clean":"2024-02-10T08:18:53.806207+0000","last_became_active":"2024-02-10T08:16:58.868848+0000","last_became_peered":"2024-02-10T08:16:58.868848+0000","last_unstale":"2024-02-10T08:18:53.806207+0000","last_undegraded":"2024-02-10T08:18:53.806207+0000","last_fullsized":"2024-02-10T08:18:53.806207+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:32.027720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:32.027720+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"55'2","reported_seq":57,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.546864+0000","last_change":"2024-02-10T08:18:03.916402+0000","last_active":"2024-02-10T08:18:53.546864+0000","last_peered":"2024-02-10T08:18:53.546864+0000","last_clean":"2024-02-10T08:18:53.546864+0000","last_became_active":"2024-02-10T08:16:52.789545+0000","last_became_peered":"2024-02-10T08:16:52.789545+0000","last_unstale":"2024-02-10T08:18:53.546864+0000","last_undegraded":"2024-02-10T08:18:53.546864+0000","last_fullsized":"2024-02-10T08:18:53.546864+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'2","last_scrub_stamp":"2024-02-10T08:18:03.916322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:03.916322+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"82'17","reported_seq":70,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.546135+0000","last_change":"2024-02-10T08:18:21.015975+0000","last_active":"2024-02-10T08:18:53.546135+0000","last_peered":"2024-02-10T08:18:53.546135+0000","last_clean":"2024-02-10T08:18:53.546135+0000","last_became_active":"2024-02-10T08:16:54.848324+0000","last_became_peered":"2024-02-10T08:16:54.848324+0000","last_unstale":"2024-02-10T08:18:53.546135+0000","last_undegraded":"2024-02-10T08:18:53.546135+0000","last_fullsized":"2024-02-10T08:18:53.546135+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'17","last_scrub_stamp":"2024-02-10T08:18:21.015873+0000","last_deep_scrub":"82'17","last_deep_scrub_stamp":"2024-02-10T08:18:21.015873+0000","last_clean_scrub_stamp":"2024-02-10T08:18:21.015873+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.542933+0000","last_change":"2024-02-10T08:17:59.810321+0000","last_active":"2024-02-10T08:18:53.542933+0000","last_peered":"2024-02-10T08:18:53.542933+0000","last_clean":"2024-02-10T08:18:53.542933+0000","last_became_active":"2024-02-10T08:16:56.860850+0000","last_became_peered":"2024-02-10T08:16:56.860850+0000","last_unstale":"2024-02-10T08:18:53.542933+0000","last_undegraded":"2024-02-10T08:18:53.542933+0000","last_fullsized":"2024-02-10T08:18:53.542933+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:17:59.810251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:17:59.810251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":37,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.805313+0000","last_change":"2024-02-10T08:18:01.698201+0000","last_active":"2024-02-10T08:18:53.805313+0000","last_peered":"2024-02-10T08:18:53.805313+0000","last_clean":"2024-02-10T08:18:53.805313+0000","last_became_active":"2024-02-10T08:16:58.864957+0000","last_became_peered":"2024-02-10T08:16:58.864957+0000","last_unstale":"2024-02-10T08:18:53.805313+0000","last_undegraded":"2024-02-10T08:18:53.805313+0000","last_fullsized":"2024-02-10T08:18:53.805313+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:01.698093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:01.698093+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.544425+0000","last_change":"2024-02-10T08:18:36.311616+0000","last_active":"2024-02-10T08:18:53.544425+0000","last_peered":"2024-02-10T08:18:53.544425+0000","last_clean":"2024-02-10T08:18:53.544425+0000","last_became_active":"2024-02-10T08:16:52.789354+0000","last_became_peered":"2024-02-10T08:16:52.789354+0000","last_unstale":"2024-02-10T08:18:53.544425+0000","last_undegraded":"2024-02-10T08:18:53.544425+0000","last_fullsized":"2024-02-10T08:18:53.544425+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:36.311445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:36.311445+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"62'10","reported_seq":57,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.545002+0000","last_change":"2024-02-10T08:18:26.189282+0000","last_active":"2024-02-10T08:18:53.545002+0000","last_peered":"2024-02-10T08:18:53.545002+0000","last_clean":"2024-02-10T08:18:53.545002+0000","last_became_active":"2024-02-10T08:16:54.851420+0000","last_became_peered":"2024-02-10T08:16:54.851420+0000","last_unstale":"2024-02-10T08:18:53.545002+0000","last_undegraded":"2024-02-10T08:18:53.545002+0000","last_fullsized":"2024-02-10T08:18:53.545002+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'10","last_scrub_stamp":"2024-02-10T08:18:26.189127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:26.189127+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"62'8","reported_seq":75,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.592358+0000","last_change":"2024-02-10T08:18:35.727254+0000","last_active":"2024-02-10T08:19:09.592358+0000","last_peered":"2024-02-10T08:19:09.592358+0000","last_clean":"2024-02-10T08:19:09.592358+0000","last_became_active":"2024-02-10T08:16:56.862677+0000","last_became_peered":"2024-02-10T08:16:56.862677+0000","last_unstale":"2024-02-10T08:19:09.592358+0000","last_undegraded":"2024-02-10T08:19:09.592358+0000","last_fullsized":"2024-02-10T08:19:09.592358+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'8","last_scrub_stamp":"2024-02-10T08:18:35.727104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:35.727104+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.806466+0000","last_change":"2024-02-10T08:18:47.116797+0000","last_active":"2024-02-10T08:18:53.806466+0000","last_peered":"2024-02-10T08:18:53.806466+0000","last_clean":"2024-02-10T08:18:53.806466+0000","last_became_active":"2024-02-10T08:16:58.868746+0000","last_became_peered":"2024-02-10T08:16:58.868746+0000","last_unstale":"2024-02-10T08:18:53.806466+0000","last_undegraded":"2024-02-10T08:18:53.806466+0000","last_fullsized":"2024-02-10T08:18:53.806466+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:47.116727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:47.116727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.806814+0000","last_change":"2024-02-10T08:18:40.357832+0000","last_active":"2024-02-10T08:18:53.806814+0000","last_peered":"2024-02-10T08:18:53.806814+0000","last_clean":"2024-02-10T08:18:53.806814+0000","last_became_active":"2024-02-10T08:16:52.791027+0000","last_became_peered":"2024-02-10T08:16:52.791027+0000","last_unstale":"2024-02-10T08:18:53.806814+0000","last_undegraded":"2024-02-10T08:18:53.806814+0000","last_fullsized":"2024-02-10T08:18:53.806814+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:40.357758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:40.357758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"62'28","reported_seq":123,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.723743+0000","last_change":"2024-02-10T08:19:00.452971+0000","last_active":"2024-02-10T08:19:09.723743+0000","last_peered":"2024-02-10T08:19:09.723743+0000","last_clean":"2024-02-10T08:19:09.723743+0000","last_became_active":"2024-02-10T08:16:54.856000+0000","last_became_peered":"2024-02-10T08:16:54.856000+0000","last_unstale":"2024-02-10T08:19:09.723743+0000","last_undegraded":"2024-02-10T08:19:09.723743+0000","last_fullsized":"2024-02-10T08:19:09.723743+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'28","last_scrub_stamp":"2024-02-10T08:19:00.452887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:19:00.452887+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":48,"num_read_kb":33,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.806598+0000","last_change":"2024-02-10T08:18:51.533191+0000","last_active":"2024-02-10T08:18:53.806598+0000","last_peered":"2024-02-10T08:18:53.806598+0000","last_clean":"2024-02-10T08:18:53.806598+0000","last_became_active":"2024-02-10T08:16:56.864887+0000","last_became_peered":"2024-02-10T08:16:56.864887+0000","last_unstale":"2024-02-10T08:18:53.806598+0000","last_undegraded":"2024-02-10T08:18:53.806598+0000","last_fullsized":"2024-02-10T08:18:53.806598+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:51.533128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:51.533128+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":37,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.807581+0000","last_change":"2024-02-10T08:18:11.750615+0000","last_active":"2024-02-10T08:18:53.807581+0000","last_peered":"2024-02-10T08:18:53.807581+0000","last_clean":"2024-02-10T08:18:53.807581+0000","last_became_active":"2024-02-10T08:16:58.891249+0000","last_became_peered":"2024-02-10T08:16:58.891249+0000","last_unstale":"2024-02-10T08:18:53.807581+0000","last_undegraded":"2024-02-10T08:18:53.807581+0000","last_fullsized":"2024-02-10T08:18:53.807581+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:11.750537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:11.750537+0000","last_clean_scrub_stamp":"2024-02-10T08:18:11.750537+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"63'5","reported_seq":179,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:11.002836+0000","last_change":"2024-02-10T08:18:04.042479+0000","last_active":"2024-02-10T08:19:11.002836+0000","last_peered":"2024-02-10T08:19:11.002836+0000","last_clean":"2024-02-10T08:19:11.002836+0000","last_became_active":"2024-02-10T08:16:52.780989+0000","last_became_peered":"2024-02-10T08:16:52.780989+0000","last_unstale":"2024-02-10T08:19:11.002836+0000","last_undegraded":"2024-02-10T08:19:11.002836+0000","last_fullsized":"2024-02-10T08:19:11.002836+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'5","last_scrub_stamp":"2024-02-10T08:18:04.042403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:04.042403+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":132,"num_read_kb":127,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.543235+0000","last_change":"2024-02-10T08:18:11.681290+0000","last_active":"2024-02-10T08:18:53.543235+0000","last_peered":"2024-02-10T08:18:53.543235+0000","last_clean":"2024-02-10T08:18:53.543235+0000","last_became_active":"2024-02-10T08:16:52.787737+0000","last_became_peered":"2024-02-10T08:16:52.787737+0000","last_unstale":"2024-02-10T08:18:53.543235+0000","last_undegraded":"2024-02-10T08:18:53.543235+0000","last_fullsized":"2024-02-10T08:18:53.543235+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:11.681169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:11.681169+0000","last_clean_scrub_stamp":"2024-02-10T08:18:11.681169+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"62'13","reported_seq":69,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.543549+0000","last_change":"2024-02-10T08:18:39.241207+0000","last_active":"2024-02-10T08:18:53.543549+0000","last_peered":"2024-02-10T08:18:53.543549+0000","last_clean":"2024-02-10T08:18:53.543549+0000","last_became_active":"2024-02-10T08:16:54.850812+0000","last_became_peered":"2024-02-10T08:16:54.850812+0000","last_unstale":"2024-02-10T08:18:53.543549+0000","last_undegraded":"2024-02-10T08:18:53.543549+0000","last_fullsized":"2024-02-10T08:18:53.543549+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'13","last_scrub_stamp":"2024-02-10T08:18:39.240947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:39.240947+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.543529+0000","last_change":"2024-02-10T08:18:28.603605+0000","last_active":"2024-02-10T08:18:53.543529+0000","last_peered":"2024-02-10T08:18:53.543529+0000","last_clean":"2024-02-10T08:18:53.543529+0000","last_became_active":"2024-02-10T08:16:56.857856+0000","last_became_peered":"2024-02-10T08:16:56.857856+0000","last_unstale":"2024-02-10T08:18:53.543529+0000","last_undegraded":"2024-02-10T08:18:53.543529+0000","last_fullsized":"2024-02-10T08:18:53.543529+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:28.603511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:28.603511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":37,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.807825+0000","last_change":"2024-02-10T08:18:45.380034+0000","last_active":"2024-02-10T08:18:53.807825+0000","last_peered":"2024-02-10T08:18:53.807825+0000","last_clean":"2024-02-10T08:18:53.807825+0000","last_became_active":"2024-02-10T08:16:58.867978+0000","last_became_peered":"2024-02-10T08:16:58.867978+0000","last_unstale":"2024-02-10T08:18:53.807825+0000","last_undegraded":"2024-02-10T08:18:53.807825+0000","last_fullsized":"2024-02-10T08:18:53.807825+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:45.379932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:45.379932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.805660+0000","last_change":"2024-02-10T08:18:07.008482+0000","last_active":"2024-02-10T08:18:53.805660+0000","last_peered":"2024-02-10T08:18:53.805660+0000","last_clean":"2024-02-10T08:18:53.805660+0000","last_became_active":"2024-02-10T08:16:52.788195+0000","last_became_peered":"2024-02-10T08:16:52.788195+0000","last_unstale":"2024-02-10T08:18:53.805660+0000","last_undegraded":"2024-02-10T08:18:53.805660+0000","last_fullsized":"2024-02-10T08:18:53.805660+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:07.008399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:07.008399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.806425+0000","last_change":"2024-02-10T08:18:19.390305+0000","last_active":"2024-02-10T08:18:53.806425+0000","last_peered":"2024-02-10T08:18:53.806425+0000","last_clean":"2024-02-10T08:18:53.806425+0000","last_became_active":"2024-02-10T08:16:52.788767+0000","last_became_peered":"2024-02-10T08:16:52.788767+0000","last_unstale":"2024-02-10T08:18:53.806425+0000","last_undegraded":"2024-02-10T08:18:53.806425+0000","last_fullsized":"2024-02-10T08:18:53.806425+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:19.390239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:19.390239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":52,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.805799+0000","last_change":"2024-02-10T08:18:24.982997+0000","last_active":"2024-02-10T08:18:53.805799+0000","last_peered":"2024-02-10T08:18:53.805799+0000","last_clean":"2024-02-10T08:18:53.805799+0000","last_became_active":"2024-02-10T08:16:46.402267+0000","last_became_peered":"2024-02-10T08:16:46.402267+0000","last_unstale":"2024-02-10T08:18:53.805799+0000","last_undegraded":"2024-02-10T08:18:53.805799+0000","last_fullsized":"2024-02-10T08:18:53.805799+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:24.982932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:14:44.584370+0000","last_clean_scrub_stamp":"2024-02-10T08:18:24.982932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"62'14","reported_seq":63,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.808210+0000","last_change":"2024-02-10T08:18:33.416443+0000","last_active":"2024-02-10T08:18:53.808210+0000","last_peered":"2024-02-10T08:18:53.808210+0000","last_clean":"2024-02-10T08:18:53.808210+0000","last_became_active":"2024-02-10T08:16:55.204616+0000","last_became_peered":"2024-02-10T08:16:55.204616+0000","last_unstale":"2024-02-10T08:18:53.808210+0000","last_undegraded":"2024-02-10T08:18:53.808210+0000","last_fullsized":"2024-02-10T08:18:53.808210+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'14","last_scrub_stamp":"2024-02-10T08:18:33.416365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:33.416365+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":15,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.807621+0000","last_change":"2024-02-10T08:18:04.766868+0000","last_active":"2024-02-10T08:18:53.807621+0000","last_peered":"2024-02-10T08:18:53.807621+0000","last_clean":"2024-02-10T08:18:53.807621+0000","last_became_active":"2024-02-10T08:16:56.867159+0000","last_became_peered":"2024-02-10T08:16:56.867159+0000","last_unstale":"2024-02-10T08:18:53.807621+0000","last_undegraded":"2024-02-10T08:18:53.807621+0000","last_fullsized":"2024-02-10T08:18:53.807621+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:04.766780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:04.766780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:04.766780+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.544133+0000","last_change":"2024-02-10T08:18:41.255265+0000","last_active":"2024-02-10T08:18:53.544133+0000","last_peered":"2024-02-10T08:18:53.544133+0000","last_clean":"2024-02-10T08:18:53.544133+0000","last_became_active":"2024-02-10T08:16:58.867593+0000","last_became_peered":"2024-02-10T08:16:58.867593+0000","last_unstale":"2024-02-10T08:18:53.544133+0000","last_undegraded":"2024-02-10T08:18:53.544133+0000","last_fullsized":"2024-02-10T08:18:53.544133+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:41.255196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:41.255196+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":45,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.805860+0000","last_change":"2024-02-10T08:18:20.736287+0000","last_active":"2024-02-10T08:18:53.805860+0000","last_peered":"2024-02-10T08:18:53.805860+0000","last_clean":"2024-02-10T08:18:53.805860+0000","last_became_active":"2024-02-10T08:16:52.782840+0000","last_became_peered":"2024-02-10T08:16:52.782840+0000","last_unstale":"2024-02-10T08:18:53.805860+0000","last_undegraded":"2024-02-10T08:18:53.805860+0000","last_fullsized":"2024-02-10T08:18:53.805860+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:20.736224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:20.736224+0000","last_clean_scrub_stamp":"2024-02-10T08:18:20.736224+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.806199+0000","last_change":"2024-02-10T08:18:14.858038+0000","last_active":"2024-02-10T08:18:53.806199+0000","last_peered":"2024-02-10T08:18:53.806199+0000","last_clean":"2024-02-10T08:18:53.806199+0000","last_became_active":"2024-02-10T08:16:52.787180+0000","last_became_peered":"2024-02-10T08:16:52.787180+0000","last_unstale":"2024-02-10T08:18:53.806199+0000","last_undegraded":"2024-02-10T08:18:53.806199+0000","last_fullsized":"2024-02-10T08:18:53.806199+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:14.857925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:14.857925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"62'12","reported_seq":59,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.806668+0000","last_change":"2024-02-10T08:18:34.720492+0000","last_active":"2024-02-10T08:18:53.806668+0000","last_peered":"2024-02-10T08:18:53.806668+0000","last_clean":"2024-02-10T08:18:53.806668+0000","last_became_active":"2024-02-10T08:16:54.853330+0000","last_became_peered":"2024-02-10T08:16:54.853330+0000","last_unstale":"2024-02-10T08:18:53.806668+0000","last_undegraded":"2024-02-10T08:18:53.806668+0000","last_fullsized":"2024-02-10T08:18:53.806668+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'12","last_scrub_stamp":"2024-02-10T08:18:34.720419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:34.720419+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.807779+0000","last_change":"2024-02-10T08:18:41.360314+0000","last_active":"2024-02-10T08:18:53.807779+0000","last_peered":"2024-02-10T08:18:53.807779+0000","last_clean":"2024-02-10T08:18:53.807779+0000","last_became_active":"2024-02-10T08:16:56.864030+0000","last_became_peered":"2024-02-10T08:16:56.864030+0000","last_unstale":"2024-02-10T08:18:53.807779+0000","last_undegraded":"2024-02-10T08:18:53.807779+0000","last_fullsized":"2024-02-10T08:18:53.807779+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:41.360241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:41.360241+0000","last_clean_scrub_stamp":"2024-02-10T08:18:41.360241+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.544323+0000","last_change":"2024-02-10T08:18:13.057393+0000","last_active":"2024-02-10T08:18:53.544323+0000","last_peered":"2024-02-10T08:18:53.544323+0000","last_clean":"2024-02-10T08:18:53.544323+0000","last_became_active":"2024-02-10T08:16:58.891287+0000","last_became_peered":"2024-02-10T08:16:58.891287+0000","last_unstale":"2024-02-10T08:18:53.544323+0000","last_undegraded":"2024-02-10T08:18:53.544323+0000","last_fullsized":"2024-02-10T08:18:53.544323+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:13.057266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:13.057266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.543444+0000","last_change":"2024-02-10T08:18:18.163873+0000","last_active":"2024-02-10T08:18:53.543444+0000","last_peered":"2024-02-10T08:18:53.543444+0000","last_clean":"2024-02-10T08:18:53.543444+0000","last_became_active":"2024-02-10T08:18:18.163475+0000","last_became_peered":"2024-02-10T08:18:18.163475+0000","last_unstale":"2024-02-10T08:18:53.543444+0000","last_undegraded":"2024-02-10T08:18:53.543444+0000","last_fullsized":"2024-02-10T08:18:53.543444+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:16.912336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:16.912336+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4],"acting":[2,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"62'19","reported_seq":77,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.806077+0000","last_change":"2024-02-10T08:18:26.755417+0000","last_active":"2024-02-10T08:18:53.806077+0000","last_peered":"2024-02-10T08:18:53.806077+0000","last_clean":"2024-02-10T08:18:53.806077+0000","last_became_active":"2024-02-10T08:16:55.203453+0000","last_became_peered":"2024-02-10T08:16:55.203453+0000","last_unstale":"2024-02-10T08:18:53.806077+0000","last_undegraded":"2024-02-10T08:18:53.806077+0000","last_fullsized":"2024-02-10T08:18:53.806077+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'19","last_scrub_stamp":"2024-02-10T08:18:26.755321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:26.755321+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.806241+0000","last_change":"2024-02-10T08:18:17.299894+0000","last_active":"2024-02-10T08:18:53.806241+0000","last_peered":"2024-02-10T08:18:53.806241+0000","last_clean":"2024-02-10T08:18:53.806241+0000","last_became_active":"2024-02-10T08:16:56.861172+0000","last_became_peered":"2024-02-10T08:16:56.861172+0000","last_unstale":"2024-02-10T08:18:53.806241+0000","last_undegraded":"2024-02-10T08:18:53.806241+0000","last_fullsized":"2024-02-10T08:18:53.806241+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:17.299814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:17.299814+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.546498+0000","last_change":"2024-02-10T08:18:04.882451+0000","last_active":"2024-02-10T08:18:53.546498+0000","last_peered":"2024-02-10T08:18:53.546498+0000","last_clean":"2024-02-10T08:18:53.546498+0000","last_became_active":"2024-02-10T08:16:58.863795+0000","last_became_peered":"2024-02-10T08:16:58.863795+0000","last_unstale":"2024-02-10T08:18:53.546498+0000","last_undegraded":"2024-02-10T08:18:53.546498+0000","last_fullsized":"2024-02-10T08:18:53.546498+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:04.882389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:04.882389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.543295+0000","last_change":"2024-02-10T08:18:12.069405+0000","last_active":"2024-02-10T08:18:53.543295+0000","last_peered":"2024-02-10T08:18:53.543295+0000","last_clean":"2024-02-10T08:18:53.543295+0000","last_became_active":"2024-02-10T08:16:52.781197+0000","last_became_peered":"2024-02-10T08:16:52.781197+0000","last_unstale":"2024-02-10T08:18:53.543295+0000","last_undegraded":"2024-02-10T08:18:53.543295+0000","last_fullsized":"2024-02-10T08:18:53.543295+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:12.069322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:12.069322+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"62'18","reported_seq":74,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.805406+0000","last_change":"2024-02-10T08:18:41.077152+0000","last_active":"2024-02-10T08:18:53.805406+0000","last_peered":"2024-02-10T08:18:53.805406+0000","last_clean":"2024-02-10T08:18:53.805406+0000","last_became_active":"2024-02-10T08:16:55.204981+0000","last_became_peered":"2024-02-10T08:16:55.204981+0000","last_unstale":"2024-02-10T08:18:53.805406+0000","last_undegraded":"2024-02-10T08:18:53.805406+0000","last_fullsized":"2024-02-10T08:18:53.805406+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'18","last_scrub_stamp":"2024-02-10T08:18:41.077080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:41.077080+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.546287+0000","last_change":"2024-02-10T08:18:15.980065+0000","last_active":"2024-02-10T08:18:53.546287+0000","last_peered":"2024-02-10T08:18:53.546287+0000","last_clean":"2024-02-10T08:18:53.546287+0000","last_became_active":"2024-02-10T08:16:56.858362+0000","last_became_peered":"2024-02-10T08:16:56.858362+0000","last_unstale":"2024-02-10T08:18:53.546287+0000","last_undegraded":"2024-02-10T08:18:53.546287+0000","last_fullsized":"2024-02-10T08:18:53.546287+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:15.979973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:15.979973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":37,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.807317+0000","last_change":"2024-02-10T08:18:15.893937+0000","last_active":"2024-02-10T08:18:53.807317+0000","last_peered":"2024-02-10T08:18:53.807317+0000","last_clean":"2024-02-10T08:18:53.807317+0000","last_became_active":"2024-02-10T08:16:58.893253+0000","last_became_peered":"2024-02-10T08:16:58.893253+0000","last_unstale":"2024-02-10T08:18:53.807317+0000","last_undegraded":"2024-02-10T08:18:53.807317+0000","last_fullsized":"2024-02-10T08:18:53.807317+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:15.893858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:15.893858+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.808270+0000","last_change":"2024-02-10T08:18:11.227796+0000","last_active":"2024-02-10T08:18:53.808270+0000","last_peered":"2024-02-10T08:18:53.808270+0000","last_clean":"2024-02-10T08:18:53.808270+0000","last_became_active":"2024-02-10T08:16:52.789020+0000","last_became_peered":"2024-02-10T08:16:52.789020+0000","last_unstale":"2024-02-10T08:18:53.808270+0000","last_undegraded":"2024-02-10T08:18:53.808270+0000","last_fullsized":"2024-02-10T08:18:53.808270+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:11.227682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:11.227682+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"62'14","reported_seq":63,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.546095+0000","last_change":"2024-02-10T08:18:10.980504+0000","last_active":"2024-02-10T08:18:53.546095+0000","last_peered":"2024-02-10T08:18:53.546095+0000","last_clean":"2024-02-10T08:18:53.546095+0000","last_became_active":"2024-02-10T08:16:54.844168+0000","last_became_peered":"2024-02-10T08:16:54.844168+0000","last_unstale":"2024-02-10T08:18:53.546095+0000","last_undegraded":"2024-02-10T08:18:53.546095+0000","last_fullsized":"2024-02-10T08:18:53.546095+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'14","last_scrub_stamp":"2024-02-10T08:18:10.980421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:10.980421+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"62'8","reported_seq":76,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.590191+0000","last_change":"2024-02-10T08:18:30.090145+0000","last_active":"2024-02-10T08:19:09.590191+0000","last_peered":"2024-02-10T08:19:09.590191+0000","last_clean":"2024-02-10T08:19:09.590191+0000","last_became_active":"2024-02-10T08:16:56.857343+0000","last_became_peered":"2024-02-10T08:16:56.857343+0000","last_unstale":"2024-02-10T08:19:09.590191+0000","last_undegraded":"2024-02-10T08:19:09.590191+0000","last_fullsized":"2024-02-10T08:19:09.590191+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'8","last_scrub_stamp":"2024-02-10T08:18:30.090065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:30.090065+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:56.053990+0000","last_change":"2024-02-10T08:18:56.053946+0000","last_active":"2024-02-10T08:18:56.053990+0000","last_peered":"2024-02-10T08:18:56.053990+0000","last_clean":"2024-02-10T08:18:56.053990+0000","last_became_active":"2024-02-10T08:16:58.891261+0000","last_became_peered":"2024-02-10T08:16:58.891261+0000","last_unstale":"2024-02-10T08:18:56.053990+0000","last_undegraded":"2024-02-10T08:18:56.053990+0000","last_fullsized":"2024-02-10T08:18:56.053990+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:56.053817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:56.053817+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.807763+0000","last_change":"2024-02-10T08:18:25.442160+0000","last_active":"2024-02-10T08:18:53.807763+0000","last_peered":"2024-02-10T08:18:53.807763+0000","last_clean":"2024-02-10T08:18:53.807763+0000","last_became_active":"2024-02-10T08:16:56.860674+0000","last_became_peered":"2024-02-10T08:16:56.860674+0000","last_unstale":"2024-02-10T08:18:53.807763+0000","last_undegraded":"2024-02-10T08:18:53.807763+0000","last_fullsized":"2024-02-10T08:18:53.807763+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:25.442097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:25.442097+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.805874+0000","last_change":"2024-02-10T08:17:56.774386+0000","last_active":"2024-02-10T08:18:53.805874+0000","last_peered":"2024-02-10T08:18:53.805874+0000","last_clean":"2024-02-10T08:18:53.805874+0000","last_became_active":"2024-02-10T08:16:52.786822+0000","last_became_peered":"2024-02-10T08:16:52.786822+0000","last_unstale":"2024-02-10T08:18:53.805874+0000","last_undegraded":"2024-02-10T08:18:53.805874+0000","last_fullsized":"2024-02-10T08:18:53.805874+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:17:56.774322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:17:56.774322+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"76'16","reported_seq":66,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.546924+0000","last_change":"2024-02-10T08:18:07.909854+0000","last_active":"2024-02-10T08:18:53.546924+0000","last_peered":"2024-02-10T08:18:53.546924+0000","last_clean":"2024-02-10T08:18:53.546924+0000","last_became_active":"2024-02-10T08:16:54.849465+0000","last_became_peered":"2024-02-10T08:16:54.849465+0000","last_unstale":"2024-02-10T08:18:53.546924+0000","last_undegraded":"2024-02-10T08:18:53.546924+0000","last_fullsized":"2024-02-10T08:18:53.546924+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'16","last_scrub_stamp":"2024-02-10T08:18:07.909782+0000","last_deep_scrub":"76'16","last_deep_scrub_stamp":"2024-02-10T08:18:07.909782+0000","last_clean_scrub_stamp":"2024-02-10T08:18:07.909782+0000","log_size":16,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":37,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.807346+0000","last_change":"2024-02-10T08:18:33.352565+0000","last_active":"2024-02-10T08:18:53.807346+0000","last_peered":"2024-02-10T08:18:53.807346+0000","last_clean":"2024-02-10T08:18:53.807346+0000","last_became_active":"2024-02-10T08:16:58.859956+0000","last_became_peered":"2024-02-10T08:16:58.859956+0000","last_unstale":"2024-02-10T08:18:53.807346+0000","last_undegraded":"2024-02-10T08:18:53.807346+0000","last_fullsized":"2024-02-10T08:18:53.807346+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:33.352450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:33.352450+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"62'8","reported_seq":76,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.591552+0000","last_change":"2024-02-10T08:18:28.991525+0000","last_active":"2024-02-10T08:19:09.591552+0000","last_peered":"2024-02-10T08:19:09.591552+0000","last_clean":"2024-02-10T08:19:09.591552+0000","last_became_active":"2024-02-10T08:16:56.862305+0000","last_became_peered":"2024-02-10T08:16:56.862305+0000","last_unstale":"2024-02-10T08:19:09.591552+0000","last_undegraded":"2024-02-10T08:19:09.591552+0000","last_fullsized":"2024-02-10T08:19:09.591552+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'8","last_scrub_stamp":"2024-02-10T08:18:28.991446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:28.991446+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.544537+0000","last_change":"2024-02-10T08:18:29.161304+0000","last_active":"2024-02-10T08:18:53.544537+0000","last_peered":"2024-02-10T08:18:53.544537+0000","last_clean":"2024-02-10T08:18:53.544537+0000","last_became_active":"2024-02-10T08:16:52.783634+0000","last_became_peered":"2024-02-10T08:16:52.783634+0000","last_unstale":"2024-02-10T08:18:53.544537+0000","last_undegraded":"2024-02-10T08:18:53.544537+0000","last_fullsized":"2024-02-10T08:18:53.544537+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:29.161170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:29.161170+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"62'15","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.543487+0000","last_change":"2024-02-10T08:18:19.720237+0000","last_active":"2024-02-10T08:18:53.543487+0000","last_peered":"2024-02-10T08:18:53.543487+0000","last_clean":"2024-02-10T08:18:53.543487+0000","last_became_active":"2024-02-10T08:18:18.163631+0000","last_became_peered":"2024-02-10T08:18:18.163631+0000","last_unstale":"2024-02-10T08:18:53.543487+0000","last_undegraded":"2024-02-10T08:18:53.543487+0000","last_fullsized":"2024-02-10T08:18:53.543487+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'15","last_scrub_stamp":"2024-02-10T08:18:19.720164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:19.720164+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.546725+0000","last_change":"2024-02-10T08:17:59.858063+0000","last_active":"2024-02-10T08:18:53.546725+0000","last_peered":"2024-02-10T08:18:53.546725+0000","last_clean":"2024-02-10T08:18:53.546725+0000","last_became_active":"2024-02-10T08:16:58.856794+0000","last_became_peered":"2024-02-10T08:16:58.856794+0000","last_unstale":"2024-02-10T08:18:53.546725+0000","last_undegraded":"2024-02-10T08:18:53.546725+0000","last_fullsized":"2024-02-10T08:18:53.546725+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:17:59.857977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:17:59.857977+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"62'8","reported_seq":76,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.724166+0000","last_change":"2024-02-10T08:18:00.800075+0000","last_active":"2024-02-10T08:19:09.724166+0000","last_peered":"2024-02-10T08:19:09.724166+0000","last_clean":"2024-02-10T08:19:09.724166+0000","last_became_active":"2024-02-10T08:16:56.858101+0000","last_became_peered":"2024-02-10T08:16:56.858101+0000","last_unstale":"2024-02-10T08:19:09.724166+0000","last_undegraded":"2024-02-10T08:19:09.724166+0000","last_fullsized":"2024-02-10T08:19:09.724166+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'8","last_scrub_stamp":"2024-02-10T08:18:00.799992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:00.799992+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.544837+0000","last_change":"2024-02-10T08:18:11.113062+0000","last_active":"2024-02-10T08:18:53.544837+0000","last_peered":"2024-02-10T08:18:53.544837+0000","last_clean":"2024-02-10T08:18:53.544837+0000","last_became_active":"2024-02-10T08:16:52.785545+0000","last_became_peered":"2024-02-10T08:16:52.785545+0000","last_unstale":"2024-02-10T08:18:53.544837+0000","last_undegraded":"2024-02-10T08:18:53.544837+0000","last_fullsized":"2024-02-10T08:18:53.544837+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:11.112885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:11.112885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"62'10","reported_seq":57,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.546473+0000","last_change":"2024-02-10T08:18:08.920316+0000","last_active":"2024-02-10T08:18:53.546473+0000","last_peered":"2024-02-10T08:18:53.546473+0000","last_clean":"2024-02-10T08:18:53.546473+0000","last_became_active":"2024-02-10T08:16:54.842930+0000","last_became_peered":"2024-02-10T08:16:54.842930+0000","last_unstale":"2024-02-10T08:18:53.546473+0000","last_undegraded":"2024-02-10T08:18:53.546473+0000","last_fullsized":"2024-02-10T08:18:53.546473+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'10","last_scrub_stamp":"2024-02-10T08:18:08.920229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:08.920229+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.543608+0000","last_change":"2024-02-10T08:18:17.709766+0000","last_active":"2024-02-10T08:18:53.543608+0000","last_peered":"2024-02-10T08:18:53.543608+0000","last_clean":"2024-02-10T08:18:53.543608+0000","last_became_active":"2024-02-10T08:16:58.868078+0000","last_became_peered":"2024-02-10T08:16:58.868078+0000","last_unstale":"2024-02-10T08:18:53.543608+0000","last_undegraded":"2024-02-10T08:18:53.543608+0000","last_fullsized":"2024-02-10T08:18:53.543608+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:17.709697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:17.709697+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.544220+0000","last_change":"2024-02-10T08:18:37.273604+0000","last_active":"2024-02-10T08:18:53.544220+0000","last_peered":"2024-02-10T08:18:53.544220+0000","last_clean":"2024-02-10T08:18:53.544220+0000","last_became_active":"2024-02-10T08:16:56.859770+0000","last_became_peered":"2024-02-10T08:16:56.859770+0000","last_unstale":"2024-02-10T08:18:53.544220+0000","last_undegraded":"2024-02-10T08:18:53.544220+0000","last_fullsized":"2024-02-10T08:18:53.544220+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:37.273476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:37.273476+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.806960+0000","last_change":"2024-02-10T08:18:00.739337+0000","last_active":"2024-02-10T08:18:53.806960+0000","last_peered":"2024-02-10T08:18:53.806960+0000","last_clean":"2024-02-10T08:18:53.806960+0000","last_became_active":"2024-02-10T08:16:52.782395+0000","last_became_peered":"2024-02-10T08:16:52.782395+0000","last_unstale":"2024-02-10T08:18:53.806960+0000","last_undegraded":"2024-02-10T08:18:53.806960+0000","last_fullsized":"2024-02-10T08:18:53.806960+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:00.739233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:00.739233+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"62'17","reported_seq":97,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.546708+0000","last_change":"2024-02-10T08:18:18.892421+0000","last_active":"2024-02-10T08:18:53.546708+0000","last_peered":"2024-02-10T08:18:53.546708+0000","last_clean":"2024-02-10T08:18:53.546708+0000","last_became_active":"2024-02-10T08:18:18.203596+0000","last_became_peered":"2024-02-10T08:18:18.203596+0000","last_unstale":"2024-02-10T08:18:53.546708+0000","last_undegraded":"2024-02-10T08:18:53.546708+0000","last_fullsized":"2024-02-10T08:18:53.546708+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'17","last_scrub_stamp":"2024-02-10T08:18:02.936554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:02.936554+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":37,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.805718+0000","last_change":"2024-02-10T08:18:07.741720+0000","last_active":"2024-02-10T08:18:53.805718+0000","last_peered":"2024-02-10T08:18:53.805718+0000","last_clean":"2024-02-10T08:18:53.805718+0000","last_became_active":"2024-02-10T08:16:58.866831+0000","last_became_peered":"2024-02-10T08:16:58.866831+0000","last_unstale":"2024-02-10T08:18:53.805718+0000","last_undegraded":"2024-02-10T08:18:53.805718+0000","last_fullsized":"2024-02-10T08:18:53.805718+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:07.741643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:07.741643+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.543401+0000","last_change":"2024-02-10T08:18:20.695868+0000","last_active":"2024-02-10T08:18:53.543401+0000","last_peered":"2024-02-10T08:18:53.543401+0000","last_clean":"2024-02-10T08:18:53.543401+0000","last_became_active":"2024-02-10T08:16:56.864026+0000","last_became_peered":"2024-02-10T08:16:56.864026+0000","last_unstale":"2024-02-10T08:18:53.543401+0000","last_undegraded":"2024-02-10T08:18:53.543401+0000","last_fullsized":"2024-02-10T08:18:53.543401+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:20.695800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:20.695800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":49,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.892412+0000","last_change":"2024-02-10T08:19:09.892412+0000","last_active":"2024-02-10T08:19:09.892412+0000","last_peered":"2024-02-10T08:19:09.892412+0000","last_clean":"2024-02-10T08:19:09.892412+0000","last_became_active":"2024-02-10T08:16:52.789100+0000","last_became_peered":"2024-02-10T08:16:52.789100+0000","last_unstale":"2024-02-10T08:19:09.892412+0000","last_undegraded":"2024-02-10T08:19:09.892412+0000","last_fullsized":"2024-02-10T08:19:09.892412+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:09.892334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:19:09.892334+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"62'19","reported_seq":72,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.806106+0000","last_change":"2024-02-10T08:18:16.290699+0000","last_active":"2024-02-10T08:18:53.806106+0000","last_peered":"2024-02-10T08:18:53.806106+0000","last_clean":"2024-02-10T08:18:53.806106+0000","last_became_active":"2024-02-10T08:16:55.203415+0000","last_became_peered":"2024-02-10T08:16:55.203415+0000","last_unstale":"2024-02-10T08:18:53.806106+0000","last_undegraded":"2024-02-10T08:18:53.806106+0000","last_fullsized":"2024-02-10T08:18:53.806106+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'19","last_scrub_stamp":"2024-02-10T08:18:16.290612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:16.290612+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"76'2","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.805530+0000","last_change":"2024-02-10T08:18:08.680107+0000","last_active":"2024-02-10T08:18:53.805530+0000","last_peered":"2024-02-10T08:18:53.805530+0000","last_clean":"2024-02-10T08:18:53.805530+0000","last_became_active":"2024-02-10T08:16:58.860294+0000","last_became_peered":"2024-02-10T08:16:58.860294+0000","last_unstale":"2024-02-10T08:18:53.805530+0000","last_undegraded":"2024-02-10T08:18:53.805530+0000","last_fullsized":"2024-02-10T08:18:53.805530+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'2","last_scrub_stamp":"2024-02-10T08:18:08.680038+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2024-02-10T08:18:08.680038+0000","last_clean_scrub_stamp":"2024-02-10T08:18:08.680038+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.543178+0000","last_change":"2024-02-10T08:18:27.611164+0000","last_active":"2024-02-10T08:18:53.543178+0000","last_peered":"2024-02-10T08:18:53.543178+0000","last_clean":"2024-02-10T08:18:53.543178+0000","last_became_active":"2024-02-10T08:16:56.855513+0000","last_became_peered":"2024-02-10T08:16:56.855513+0000","last_unstale":"2024-02-10T08:18:53.543178+0000","last_undegraded":"2024-02-10T08:18:53.543178+0000","last_fullsized":"2024-02-10T08:18:53.543178+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:27.611094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:27.611094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.544017+0000","last_change":"2024-02-10T08:18:06.015064+0000","last_active":"2024-02-10T08:18:53.544017+0000","last_peered":"2024-02-10T08:18:53.544017+0000","last_clean":"2024-02-10T08:18:53.544017+0000","last_became_active":"2024-02-10T08:16:52.783675+0000","last_became_peered":"2024-02-10T08:16:52.783675+0000","last_unstale":"2024-02-10T08:18:53.544017+0000","last_undegraded":"2024-02-10T08:18:53.544017+0000","last_fullsized":"2024-02-10T08:18:53.544017+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:06.014988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:06.014988+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"62'9","reported_seq":57,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.806285+0000","last_change":"2024-02-10T08:18:14.705343+0000","last_active":"2024-02-10T08:18:53.806285+0000","last_peered":"2024-02-10T08:18:53.806285+0000","last_clean":"2024-02-10T08:18:53.806285+0000","last_became_active":"2024-02-10T08:16:54.852935+0000","last_became_peered":"2024-02-10T08:16:54.852935+0000","last_unstale":"2024-02-10T08:18:53.806285+0000","last_undegraded":"2024-02-10T08:18:53.806285+0000","last_fullsized":"2024-02-10T08:18:53.806285+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'9","last_scrub_stamp":"2024-02-10T08:18:14.705229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:14.705229+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":37,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.806695+0000","last_change":"2024-02-10T08:18:08.322927+0000","last_active":"2024-02-10T08:18:53.806695+0000","last_peered":"2024-02-10T08:18:53.806695+0000","last_clean":"2024-02-10T08:18:53.806695+0000","last_became_active":"2024-02-10T08:16:58.891260+0000","last_became_peered":"2024-02-10T08:16:58.891260+0000","last_unstale":"2024-02-10T08:18:53.806695+0000","last_undegraded":"2024-02-10T08:18:53.806695+0000","last_fullsized":"2024-02-10T08:18:53.806695+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:08.322832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:08.322832+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":49,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:19:05.814638+0000","last_change":"2024-02-10T08:19:05.814587+0000","last_active":"2024-02-10T08:19:05.814638+0000","last_peered":"2024-02-10T08:19:05.814638+0000","last_clean":"2024-02-10T08:19:05.814638+0000","last_became_active":"2024-02-10T08:16:52.785754+0000","last_became_peered":"2024-02-10T08:16:52.785754+0000","last_unstale":"2024-02-10T08:19:05.814638+0000","last_undegraded":"2024-02-10T08:19:05.814638+0000","last_fullsized":"2024-02-10T08:19:05.814638+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:05.814500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:19:05.814500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"62'15","reported_seq":66,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.805750+0000","last_change":"2024-02-10T08:18:47.352251+0000","last_active":"2024-02-10T08:18:53.805750+0000","last_peered":"2024-02-10T08:18:53.805750+0000","last_clean":"2024-02-10T08:18:53.805750+0000","last_became_active":"2024-02-10T08:16:55.204597+0000","last_became_peered":"2024-02-10T08:16:55.204597+0000","last_unstale":"2024-02-10T08:18:53.805750+0000","last_undegraded":"2024-02-10T08:18:53.805750+0000","last_fullsized":"2024-02-10T08:18:53.805750+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'15","last_scrub_stamp":"2024-02-10T08:18:47.352151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:47.352151+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"62'8","reported_seq":75,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.723847+0000","last_change":"2024-02-10T08:18:29.053030+0000","last_active":"2024-02-10T08:19:09.723847+0000","last_peered":"2024-02-10T08:19:09.723847+0000","last_clean":"2024-02-10T08:19:09.723847+0000","last_became_active":"2024-02-10T08:16:56.860308+0000","last_became_peered":"2024-02-10T08:16:56.860308+0000","last_unstale":"2024-02-10T08:19:09.723847+0000","last_undegraded":"2024-02-10T08:19:09.723847+0000","last_fullsized":"2024-02-10T08:19:09.723847+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'8","last_scrub_stamp":"2024-02-10T08:18:29.052907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:29.052907+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":65,"ondisk_log_size":65,"up":96,"acting":96,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":698,"num_read_kb":455,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":411,"ondisk_log_size":411,"up":96,"acting":96,"num_store_stats":8},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":132,"num_read_kb":127,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":9,"acting":9,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":50,"seq":214748364832,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297740,"kb_used_data":644,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447412,"statfs":{"total":95995035648,"available":95690149888,"internally_reserved":0,"allocated":659456,"data_stored":303000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:18:45 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.48999999999999999,"15min":0.49199999999999999},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.497,"5min":0.48999999999999999,"15min":0.48899999999999999},"min":{"1min":0.36699999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.498}]},{"osd":1,"last update":"Sat Feb 10 08:18:45 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.502,"15min":0.505},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.68000000000000005,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.50700000000000001,"15min":0.51500000000000001},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.61899999999999999,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.42699999999999999}]},{"osd":2,"last update":"Sat Feb 10 08:18:45 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.66400000000000003,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.52400000000000002,"15min":0.52700000000000002},"min":{"1min":0.38200000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.61199999999999999}]},{"osd":3,"last update":"Sat Feb 10 08:18:45 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.51300000000000001,"15min":0.51700000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.621,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.503,"5min":0.51600000000000001,"15min":0.51800000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.48599999999999999}]},{"osd":4,"last update":"Sat Feb 10 08:18:45 2024","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.40300000000000002,"15min":0.40100000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.56599999999999995,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.433,"15min":0.42999999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.58999999999999997,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.625}]},{"osd":5,"last update":"Sat Feb 10 08:18:45 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.42199999999999999,"15min":0.41499999999999998},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.46000000000000002,"15min":0.45800000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.65800000000000003,"5min":0.753,"15min":0.753},"last":0.53800000000000003}]},{"osd":6,"last update":"Sat Feb 10 08:18:45 2024","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.45300000000000001,"15min":0.443},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.47499999999999998,"15min":0.46899999999999997},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.55300000000000005}]}]},{"osd":6,"up_from":43,"seq":184683593765,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297724,"kb_used_data":628,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447428,"statfs":{"total":95995035648,"available":95690166272,"internally_reserved":0,"allocated":643072,"data_stored":302960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:18:23 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.53800000000000003,"15min":0.54000000000000004},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.55300000000000005,"15min":0.55500000000000005},"min":{"1min":0.39300000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.78400000000000003,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.55700000000000005}]},{"osd":1,"last update":"Sat Feb 10 08:18:23 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.54700000000000004,"15min":0.55100000000000005},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.496,"5min":0.55700000000000005,"15min":0.56699999999999995},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.76400000000000001,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.46999999999999997}]},{"osd":2,"last update":"Sat Feb 10 08:18:23 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.57299999999999995,"15min":0.57899999999999996},"min":{"1min":0.40999999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.57699999999999996,"15min":0.57999999999999996},"min":{"1min":0.39900000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.45200000000000001}]},{"osd":3,"last update":"Sat Feb 10 08:18:23 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.56299999999999994,"15min":0.56599999999999995},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.86199999999999999,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.55600000000000005,"15min":0.55800000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.54700000000000004}]},{"osd":4,"last update":"Sat Feb 10 08:18:23 2024","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.27900000000000003,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.73399999999999999,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.499},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.46200000000000002,"15min":0.46300000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.69599999999999995,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.68100000000000005}]},{"osd":5,"last update":"Sat Feb 10 08:18:23 2024","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.45600000000000002,"15min":0.45200000000000001},"min":{"1min":0.31,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.70999999999999996,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.45700000000000002,"15min":0.45300000000000001},"min":{"1min":0.317,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.71799999999999997}]},{"osd":7,"last update":"Sat Feb 10 08:18:52 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.375,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.69899999999999995,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.57899999999999996,"15min":0.57599999999999996},"min":{"1min":0.41699999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.73599999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574908,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297756,"kb_used_data":660,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447396,"statfs":{"total":95995035648,"available":95690133504,"internally_reserved":0,"allocated":675840,"data_stored":302789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:18:23 2024","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.35699999999999998,"15min":0.318},"min":{"1min":0.23999999999999999,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.60499999999999998,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.373,"15min":0.33200000000000002},"min":{"1min":0.24099999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.64900000000000002,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.30599999999999999}]},{"osd":2,"last update":"Sat Feb 10 08:18:54 2024","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.38600000000000001,"15min":0.36599999999999999},"min":{"1min":0.26400000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.55300000000000005,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.38900000000000001,"15min":0.371},"min":{"1min":0.252,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.58399999999999996,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.28499999999999998}]},{"osd":3,"last update":"Sat Feb 10 08:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.45900000000000002,"15min":0.46100000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.69099999999999995,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.438,"15min":0.439},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.69399999999999995,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.29499999999999998}]},{"osd":4,"last update":"Sat Feb 10 08:18:37 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.58599999999999997,"15min":0.59099999999999997},"min":{"1min":0.39200000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.83899999999999997,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.57199999999999995,"15min":0.58199999999999996},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.85099999999999998,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.47799999999999998}]},{"osd":5,"last update":"Sat Feb 10 08:18:59 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.57199999999999995,"15min":0.57399999999999995},"min":{"1min":0.39700000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.82399999999999995,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.60699999999999998,"15min":0.61299999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.90100000000000002,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.56000000000000005}]},{"osd":6,"last update":"Sat Feb 10 08:18:23 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.61299999999999999,"15min":0.61599999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.56599999999999995}]},{"osd":7,"last update":"Sat Feb 10 08:18:49 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.57099999999999995,"15min":0.56499999999999995},"min":{"1min":0.42799999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.59499999999999997,"15min":0.58899999999999997},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.58399999999999996}]}]},{"osd":0,"up_from":8,"seq":34359738433,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297748,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447404,"statfs":{"total":95995035648,"available":95690141696,"internally_reserved":0,"allocated":667648,"data_stored":303320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 10 08:18:23 2024","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35399999999999998,"15min":0.33500000000000002},"min":{"1min":0.217,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.52400000000000002,"5min":0.54400000000000004,"15min":0.54400000000000004},"last":0.496},{"interface":"front","average":{"1min":0.374,"5min":0.36599999999999999,"15min":0.33600000000000002},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.51800000000000002}]},{"osd":2,"last update":"Sat Feb 10 08:18:50 2024","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.253,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.42299999999999999,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.375,"5min":0.39800000000000002,"15min":0.39200000000000002},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.47499999999999998,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.55800000000000005}]},{"osd":3,"last update":"Sat Feb 10 08:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.434,"15min":0.442},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.373},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.442,"15min":0.44800000000000001},"min":{"1min":0.30299999999999999,"5min":0.246,"15min":0.246},"max":{"1min":0.55900000000000005,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.45700000000000002}]},{"osd":4,"last update":"Sat Feb 10 08:18:35 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.59399999999999997,"15min":0.59199999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.59399999999999997,"15min":0.60399999999999998},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.624}]},{"osd":5,"last update":"Sat Feb 10 08:19:03 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.58299999999999996,"15min":0.59199999999999997},"min":{"1min":0.36899999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.70499999999999996,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.57599999999999996,"15min":0.58099999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.77200000000000002,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.60199999999999998}]},{"osd":6,"last update":"Sat Feb 10 08:18:23 2024","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.748},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.64100000000000001,"15min":0.64700000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.67500000000000004}]},{"osd":7,"last update":"Sat Feb 10 08:18:47 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59799999999999998,"15min":0.59899999999999998},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.80800000000000005,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.80200000000000005,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.78200000000000003}]}]},{"osd":2,"up_from":18,"seq":77309411384,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297732,"kb_used_data":636,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447420,"statfs":{"total":95995035648,"available":95690158080,"internally_reserved":0,"allocated":651264,"data_stored":302496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:18:48 2024","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.35799999999999998,"15min":0.34899999999999998},"min":{"1min":0.255,"5min":0.224,"15min":0.224},"max":{"1min":0.49399999999999999,"5min":0.628,"15min":0.628},"last":0.307},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38,"15min":0.36599999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.75,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.29399999999999998}]},{"osd":1,"last update":"Sat Feb 10 08:18:48 2024","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.375,"15min":0.36799999999999999},"min":{"1min":0.27100000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.51100000000000001,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.39500000000000002,"15min":0.38200000000000001},"min":{"1min":0.26000000000000001,"5min":0.25,"15min":0.25},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.34999999999999998}]},{"osd":3,"last update":"Sat Feb 10 08:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.45800000000000002,"15min":0.46000000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.73999999999999999,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.44800000000000001,"15min":0.45000000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.58699999999999997,"5min":0.749,"15min":0.749},"last":0.42399999999999999}]},{"osd":4,"last update":"Sat Feb 10 08:18:35 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.58499999999999996,"15min":0.58099999999999996},"min":{"1min":0.496,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.86299999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.57399999999999995,"15min":0.57699999999999996},"min":{"1min":0.39800000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.48499999999999999}]},{"osd":5,"last update":"Sat Feb 10 08:19:04 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56599999999999995,"15min":0.56999999999999995},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.81399999999999995,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.56999999999999995,"15min":0.56799999999999995},"min":{"1min":0.46400000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.437}]},{"osd":6,"last update":"Sat Feb 10 08:18:22 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.58099999999999996,"15min":0.58499999999999996},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.71699999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.60099999999999998,"15min":0.60699999999999998},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.73599999999999999,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.499}]},{"osd":7,"last update":"Sat Feb 10 08:18:48 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.60399999999999998,"15min":0.60799999999999998},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.80800000000000005,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.85399999999999998,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.54000000000000004}]}]},{"osd":3,"up_from":25,"seq":107374182451,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297752,"kb_used_data":656,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447400,"statfs":{"total":95995035648,"available":95690137600,"internally_reserved":0,"allocated":671744,"data_stored":302562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:18:10 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.38900000000000001,"15min":0.374},"min":{"1min":0.254,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.42399999999999999,"15min":0.42299999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.32200000000000001}]},{"osd":1,"last update":"Sat Feb 10 08:18:10 2024","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.439,"15min":0.443},"min":{"1min":0.315,"5min":0.312,"15min":0.312},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.45600000000000002,"15min":0.46300000000000002},"min":{"1min":0.28499999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.61099999999999999,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.29299999999999998}]},{"osd":2,"last update":"Sat Feb 10 08:18:10 2024","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.45500000000000002,"15min":0.45700000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.45900000000000002,"15min":0.45500000000000002},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.66600000000000004,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.36699999999999999}]},{"osd":4,"last update":"Sat Feb 10 08:18:36 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54700000000000004,"15min":0.54500000000000004},"min":{"1min":0.38800000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.56899999999999995,"15min":0.57299999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.83099999999999996,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.63800000000000001}]},{"osd":5,"last update":"Sat Feb 10 08:19:03 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.58799999999999997,"15min":0.59599999999999997},"min":{"1min":0.41099999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.65400000000000003,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.59199999999999997,"15min":0.59799999999999998},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.73899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.68200000000000005}]},{"osd":6,"last update":"Sat Feb 10 08:18:23 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.57299999999999995,"15min":0.57099999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.58699999999999997,"15min":0.58299999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.65100000000000002}]},{"osd":7,"last update":"Sat Feb 10 08:18:46 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.57899999999999996,"15min":0.57699999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.57399999999999995,"15min":0.56999999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.66900000000000004}]}]},{"osd":4,"up_from":30,"seq":128849018925,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297740,"kb_used_data":644,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447412,"statfs":{"total":95995035648,"available":95690149888,"internally_reserved":0,"allocated":659456,"data_stored":302230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:18:34 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.51300000000000001,"15min":0.52400000000000002},"min":{"1min":0.26100000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.65600000000000003,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.503,"5min":0.52200000000000002,"15min":0.53000000000000003},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.64500000000000002,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.60899999999999999}]},{"osd":1,"last update":"Sat Feb 10 08:18:34 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.50900000000000001,"15min":0.52400000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.629,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.503,"15min":0.51600000000000001},"min":{"1min":0.35199999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.56000000000000005,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.55700000000000005}]},{"osd":2,"last update":"Sat Feb 10 08:18:34 2024","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.499,"15min":0.505},"min":{"1min":0.32300000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.61699999999999999,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.497},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.52900000000000003,"15min":0.53900000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.61199999999999999,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.53800000000000003}]},{"osd":3,"last update":"Sat Feb 10 08:18:34 2024","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.52700000000000002,"15min":0.53700000000000003},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.66900000000000004,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.497,"5min":0.52200000000000002,"15min":0.53100000000000003},"min":{"1min":0.39500000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.67800000000000005,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.57099999999999995}]},{"osd":5,"last update":"Sat Feb 10 08:19:00 2024","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.38600000000000001,"15min":0.372},"min":{"1min":0.27100000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.627,"5min":0.627,"15min":0.627},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.39400000000000002,"15min":0.377},"min":{"1min":0.28999999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.66800000000000004}]},{"osd":6,"last update":"Sat Feb 10 08:18:20 2024","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"min":{"1min":0.30199999999999999,"5min":0.248,"15min":0.248},"max":{"1min":0.64800000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.46600000000000003,"15min":0.46400000000000002},"min":{"1min":0.32000000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.75900000000000001}]},{"osd":7,"last update":"Sat Feb 10 08:18:46 2024","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.33300000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.45200000000000001,"15min":0.45000000000000001},"min":{"1min":0.313,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.629}]}]},{"osd":5,"up_from":37,"seq":158913789994,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297724,"kb_used_data":628,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447428,"statfs":{"total":95995035648,"available":95690166272,"internally_reserved":0,"allocated":643072,"data_stored":302133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:18:57 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.56399999999999995,"15min":0.58399999999999996},"min":{"1min":0.38400000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.70099999999999996,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.502,"5min":0.51200000000000001,"15min":0.52100000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.72399999999999998,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.79700000000000004}]},{"osd":1,"last update":"Sat Feb 10 08:18:57 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.54300000000000004,"15min":0.56000000000000005},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.629},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.52700000000000002,"15min":0.54600000000000004},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.68200000000000005,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.71899999999999997}]},{"osd":2,"last update":"Sat Feb 10 08:18:57 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.55200000000000005,"15min":0.56999999999999995},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.70899999999999996,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.56699999999999995,"15min":0.59099999999999997},"min":{"1min":0.40500000000000003,"5min":0.372,"15min":0.372},"max":{"1min":0.70299999999999996,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.69599999999999995}]},{"osd":3,"last update":"Sat Feb 10 08:18:57 2024","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.56200000000000006,"15min":0.58499999999999996},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.66700000000000004,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.378,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.66000000000000003,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":0.76100000000000001}]},{"osd":4,"last update":"Sat Feb 10 08:18:57 2024","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.371,"15min":0.36099999999999999},"min":{"1min":0.26400000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.65400000000000003,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.433,"5min":0.38300000000000001,"15min":0.36899999999999999},"min":{"1min":0.30399999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.68700000000000006,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.66200000000000003}]},{"osd":6,"last update":"Sat Feb 10 08:18:24 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.38500000000000001,"15min":0.375},"min":{"1min":0.33300000000000002,"5min":0.254,"15min":0.254},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.5,"5min":0.436,"15min":0.42499999999999999},"min":{"1min":0.34999999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.81699999999999995}]},{"osd":7,"last update":"Sat Feb 10 08:18:49 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.439,"15min":0.436},"min":{"1min":0.318,"5min":0.31,"15min":0.31},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.745},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.432,"15min":0.42499999999999999},"min":{"1min":0.29099999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.73599999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":2008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-10T08:19:16.885 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph pg dump --format=json 2024-02-10T08:19:17.163 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:19:17.456 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:19:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:19:17] "GET /metrics HTTP/1.1" 200 172125 "" "Prometheus/2.33.4" 2024-02-10T08:19:18.039 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:19:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:19:18.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:19:16.175436+0000 mgr.y (mgr.14505) 97 : audit [DBG] from='client.14712 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-10T08:19:18.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:16.194905+0000 osd.4 (osd.4) 45 : cluster [DBG] 4.c scrub starts 2024-02-10T08:19:18.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:16.196828+0000 osd.4 (osd.4) 46 : cluster [DBG] 4.c scrub ok 2024-02-10T08:19:18.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:16.475755+0000 mgr.y (mgr.14505) 98 : cluster [DBG] pgmap v84: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-10T08:19:18.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:16.551882+0000 osd.5 (osd.5) 41 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:19:18.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:16.551927+0000 osd.5 (osd.5) 42 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:19:18.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:16.755726+0000 mon.a (mon.0) 747 : cluster [DBG] osdmap e86: 8 total, 8 up, 8 in 2024-02-10T08:19:18.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:17.537194+0000 osd.0 (osd.0) 49 : cluster [DBG] 6.16 scrub starts 2024-02-10T08:19:18.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:17.540096+0000 osd.0 (osd.0) 50 : cluster [DBG] 6.16 scrub ok 2024-02-10T08:19:18.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:19:16.175436+0000 mgr.y (mgr.14505) 97 : audit [DBG] from='client.14712 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-10T08:19:18.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:16.194905+0000 osd.4 (osd.4) 45 : cluster [DBG] 4.c scrub starts 2024-02-10T08:19:18.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:16.196828+0000 osd.4 (osd.4) 46 : cluster [DBG] 4.c scrub ok 2024-02-10T08:19:18.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:16.475755+0000 mgr.y (mgr.14505) 98 : cluster [DBG] pgmap v84: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-10T08:19:18.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:16.551882+0000 osd.5 (osd.5) 41 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:19:18.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:16.551927+0000 osd.5 (osd.5) 42 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:19:18.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:16.755726+0000 mon.a (mon.0) 747 : cluster [DBG] osdmap e86: 8 total, 8 up, 8 in 2024-02-10T08:19:18.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:17.537194+0000 osd.0 (osd.0) 49 : cluster [DBG] 6.16 scrub starts 2024-02-10T08:19:18.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:17.540096+0000 osd.0 (osd.0) 50 : cluster [DBG] 6.16 scrub ok 2024-02-10T08:19:18.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:19:16.175436+0000 mgr.y (mgr.14505) 97 : audit [DBG] from='client.14712 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-10T08:19:18.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:16.194905+0000 osd.4 (osd.4) 45 : cluster [DBG] 4.c scrub starts 2024-02-10T08:19:18.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:16.196828+0000 osd.4 (osd.4) 46 : cluster [DBG] 4.c scrub ok 2024-02-10T08:19:18.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:16.475755+0000 mgr.y (mgr.14505) 98 : cluster [DBG] pgmap v84: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-10T08:19:18.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:16.551882+0000 osd.5 (osd.5) 41 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:19:18.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:16.551927+0000 osd.5 (osd.5) 42 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:19:18.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:16.755726+0000 mon.a (mon.0) 747 : cluster [DBG] osdmap e86: 8 total, 8 up, 8 in 2024-02-10T08:19:18.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:17.537194+0000 osd.0 (osd.0) 49 : cluster [DBG] 6.16 scrub starts 2024-02-10T08:19:18.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:17.540096+0000 osd.0 (osd.0) 50 : cluster [DBG] 6.16 scrub ok 2024-02-10T08:19:18.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:19:17.549122+0000 mgr.y (mgr.14505) 99 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:19:18.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:19:17.549122+0000 mgr.y (mgr.14505) 99 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:19:19.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:19:17.549122+0000 mgr.y (mgr.14505) 99 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:19:19.400 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:19:19.403 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-02-10T08:19:20.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:18.476444+0000 mgr.y (mgr.14505) 100 : cluster [DBG] pgmap v86: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-02-10T08:19:20.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:19.681142+0000 osd.2 (osd.2) 41 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:19:20.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:19.681225+0000 osd.2 (osd.2) 42 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:19:20.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:18.476444+0000 mgr.y (mgr.14505) 100 : cluster [DBG] pgmap v86: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-02-10T08:19:20.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:19.681142+0000 osd.2 (osd.2) 41 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:19:20.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:19.681225+0000 osd.2 (osd.2) 42 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:19:20.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:18.476444+0000 mgr.y (mgr.14505) 100 : cluster [DBG] pgmap v86: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-02-10T08:19:20.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:19.681142+0000 osd.2 (osd.2) 41 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:19:20.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:19.681225+0000 osd.2 (osd.2) 42 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:19:20.258 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":86,"stamp":"2024-02-10T08:19:18.475954+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":5796,"num_objects":192,"num_object_clones":0,"num_object_copies":576,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":192,"num_whiteouts":0,"num_read":857,"num_read_kb":609,"num_write":428,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":488,"ondisk_log_size":488,"up":396,"acting":396,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":396,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":2381964,"kb_used_data":5196,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":747579252,"statfs":{"total":767960285184,"available":765521154048,"internally_reserved":0,"allocated":5320704,"data_stored":2447146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.886936"},"pg_stats":[{"pgid":"6.1b","version":"0'0","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.590993+0000","last_change":"2024-02-10T08:19:01.075963+0000","last_active":"2024-02-10T08:19:09.590993+0000","last_peered":"2024-02-10T08:19:09.590993+0000","last_clean":"2024-02-10T08:19:09.590993+0000","last_became_active":"2024-02-10T08:16:58.892091+0000","last_became_peered":"2024-02-10T08:16:58.892091+0000","last_unstale":"2024-02-10T08:19:09.590993+0000","last_undegraded":"2024-02-10T08:19:09.590993+0000","last_fullsized":"2024-02-10T08:19:09.590993+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:01.075886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:19:01.075886+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.590712+0000","last_change":"2024-02-10T08:18:09.941981+0000","last_active":"2024-02-10T08:19:09.590712+0000","last_peered":"2024-02-10T08:19:09.590712+0000","last_clean":"2024-02-10T08:19:09.590712+0000","last_became_active":"2024-02-10T08:16:56.858480+0000","last_became_peered":"2024-02-10T08:16:56.858480+0000","last_unstale":"2024-02-10T08:19:09.590712+0000","last_undegraded":"2024-02-10T08:19:09.590712+0000","last_fullsized":"2024-02-10T08:19:09.590712+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:09.941898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:09.941898+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.806892+0000","last_change":"2024-02-10T08:18:43.744973+0000","last_active":"2024-02-10T08:18:53.806892+0000","last_peered":"2024-02-10T08:18:53.806892+0000","last_clean":"2024-02-10T08:18:53.806892+0000","last_became_active":"2024-02-10T08:16:52.788363+0000","last_became_peered":"2024-02-10T08:16:52.788363+0000","last_unstale":"2024-02-10T08:18:53.806892+0000","last_undegraded":"2024-02-10T08:18:53.806892+0000","last_fullsized":"2024-02-10T08:18:53.806892+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:43.744900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:43.744900+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"62'15","reported_seq":68,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.590898+0000","last_change":"2024-02-10T08:18:08.051424+0000","last_active":"2024-02-10T08:19:09.590898+0000","last_peered":"2024-02-10T08:19:09.590898+0000","last_clean":"2024-02-10T08:19:09.590898+0000","last_became_active":"2024-02-10T08:16:54.849232+0000","last_became_peered":"2024-02-10T08:16:54.849232+0000","last_unstale":"2024-02-10T08:19:09.590898+0000","last_undegraded":"2024-02-10T08:19:09.590898+0000","last_fullsized":"2024-02-10T08:19:09.590898+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'15","last_scrub_stamp":"2024-02-10T08:18:08.051315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:08.051315+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.590886+0000","last_change":"2024-02-10T08:18:19.058387+0000","last_active":"2024-02-10T08:19:09.590886+0000","last_peered":"2024-02-10T08:19:09.590886+0000","last_clean":"2024-02-10T08:19:09.590886+0000","last_became_active":"2024-02-10T08:16:58.860693+0000","last_became_peered":"2024-02-10T08:16:58.860693+0000","last_unstale":"2024-02-10T08:19:09.590886+0000","last_undegraded":"2024-02-10T08:19:09.590886+0000","last_fullsized":"2024-02-10T08:19:09.590886+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:19.058317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:19.058317+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.544400+0000","last_change":"2024-02-10T08:18:31.136877+0000","last_active":"2024-02-10T08:18:53.544400+0000","last_peered":"2024-02-10T08:18:53.544400+0000","last_clean":"2024-02-10T08:18:53.544400+0000","last_became_active":"2024-02-10T08:16:56.863353+0000","last_became_peered":"2024-02-10T08:16:56.863353+0000","last_unstale":"2024-02-10T08:18:53.544400+0000","last_undegraded":"2024-02-10T08:18:53.544400+0000","last_fullsized":"2024-02-10T08:18:53.544400+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:31.136797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:31.136797+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.591196+0000","last_change":"2024-02-10T08:17:53.926192+0000","last_active":"2024-02-10T08:19:09.591196+0000","last_peered":"2024-02-10T08:19:09.591196+0000","last_clean":"2024-02-10T08:19:09.591196+0000","last_became_active":"2024-02-10T08:16:52.787183+0000","last_became_peered":"2024-02-10T08:16:52.787183+0000","last_unstale":"2024-02-10T08:19:09.591196+0000","last_undegraded":"2024-02-10T08:19:09.591196+0000","last_fullsized":"2024-02-10T08:19:09.591196+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:17:53.926120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:17:53.926120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"62'9","reported_seq":59,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.590944+0000","last_change":"2024-02-10T08:18:12.998301+0000","last_active":"2024-02-10T08:19:09.590944+0000","last_peered":"2024-02-10T08:19:09.590944+0000","last_clean":"2024-02-10T08:19:09.590944+0000","last_became_active":"2024-02-10T08:16:54.852200+0000","last_became_peered":"2024-02-10T08:16:54.852200+0000","last_unstale":"2024-02-10T08:19:09.590944+0000","last_undegraded":"2024-02-10T08:19:09.590944+0000","last_fullsized":"2024-02-10T08:19:09.590944+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'9","last_scrub_stamp":"2024-02-10T08:18:12.998167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:12.998167+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":38,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.722861+0000","last_change":"2024-02-10T08:18:51.370619+0000","last_active":"2024-02-10T08:19:09.722861+0000","last_peered":"2024-02-10T08:19:09.722861+0000","last_clean":"2024-02-10T08:19:09.722861+0000","last_became_active":"2024-02-10T08:16:58.867430+0000","last_became_peered":"2024-02-10T08:16:58.867430+0000","last_unstale":"2024-02-10T08:19:09.722861+0000","last_undegraded":"2024-02-10T08:19:09.722861+0000","last_fullsized":"2024-02-10T08:19:09.722861+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:51.370527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:51.370527+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.724238+0000","last_change":"2024-02-10T08:17:59.772854+0000","last_active":"2024-02-10T08:19:09.724238+0000","last_peered":"2024-02-10T08:19:09.724238+0000","last_clean":"2024-02-10T08:19:09.724238+0000","last_became_active":"2024-02-10T08:16:56.865529+0000","last_became_peered":"2024-02-10T08:16:56.865529+0000","last_unstale":"2024-02-10T08:19:09.724238+0000","last_undegraded":"2024-02-10T08:19:09.724238+0000","last_fullsized":"2024-02-10T08:19:09.724238+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:17:59.772766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:17:59.772766+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"55'1","reported_seq":51,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.723431+0000","last_change":"2024-02-10T08:18:33.095861+0000","last_active":"2024-02-10T08:19:09.723431+0000","last_peered":"2024-02-10T08:19:09.723431+0000","last_clean":"2024-02-10T08:19:09.723431+0000","last_became_active":"2024-02-10T08:16:52.790462+0000","last_became_peered":"2024-02-10T08:16:52.790462+0000","last_unstale":"2024-02-10T08:19:09.723431+0000","last_undegraded":"2024-02-10T08:19:09.723431+0000","last_fullsized":"2024-02-10T08:19:09.723431+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'1","last_scrub_stamp":"2024-02-10T08:18:33.095757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:33.095757+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"62'5","reported_seq":53,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.591196+0000","last_change":"2024-02-10T08:18:11.967605+0000","last_active":"2024-02-10T08:19:09.591196+0000","last_peered":"2024-02-10T08:19:09.591196+0000","last_clean":"2024-02-10T08:19:09.591196+0000","last_became_active":"2024-02-10T08:16:54.849450+0000","last_became_peered":"2024-02-10T08:16:54.849450+0000","last_unstale":"2024-02-10T08:19:09.591196+0000","last_undegraded":"2024-02-10T08:19:09.591196+0000","last_fullsized":"2024-02-10T08:19:09.591196+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'5","last_scrub_stamp":"2024-02-10T08:18:11.967507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:11.967507+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":37,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.805602+0000","last_change":"2024-02-10T08:18:15.691621+0000","last_active":"2024-02-10T08:18:53.805602+0000","last_peered":"2024-02-10T08:18:53.805602+0000","last_clean":"2024-02-10T08:18:53.805602+0000","last_became_active":"2024-02-10T08:16:58.860591+0000","last_became_peered":"2024-02-10T08:16:58.860591+0000","last_unstale":"2024-02-10T08:18:53.805602+0000","last_undegraded":"2024-02-10T08:18:53.805602+0000","last_fullsized":"2024-02-10T08:18:53.805602+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:15.691552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:15.691552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.724947+0000","last_change":"2024-02-10T08:18:09.324937+0000","last_active":"2024-02-10T08:19:09.724947+0000","last_peered":"2024-02-10T08:19:09.724947+0000","last_clean":"2024-02-10T08:19:09.724947+0000","last_became_active":"2024-02-10T08:16:56.864532+0000","last_became_peered":"2024-02-10T08:16:56.864532+0000","last_unstale":"2024-02-10T08:19:09.724947+0000","last_undegraded":"2024-02-10T08:19:09.724947+0000","last_fullsized":"2024-02-10T08:19:09.724947+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:09.324856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:09.324856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.723621+0000","last_change":"2024-02-10T08:18:28.028628+0000","last_active":"2024-02-10T08:19:09.723621+0000","last_peered":"2024-02-10T08:19:09.723621+0000","last_clean":"2024-02-10T08:19:09.723621+0000","last_became_active":"2024-02-10T08:16:52.787865+0000","last_became_peered":"2024-02-10T08:16:52.787865+0000","last_unstale":"2024-02-10T08:19:09.723621+0000","last_undegraded":"2024-02-10T08:19:09.723621+0000","last_fullsized":"2024-02-10T08:19:09.723621+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:28.028556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:28.028556+0000","last_clean_scrub_stamp":"2024-02-10T08:18:28.028556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"62'9","reported_seq":59,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.590999+0000","last_change":"2024-02-10T08:18:15.012767+0000","last_active":"2024-02-10T08:19:09.590999+0000","last_peered":"2024-02-10T08:19:09.590999+0000","last_clean":"2024-02-10T08:19:09.590999+0000","last_became_active":"2024-02-10T08:16:54.847486+0000","last_became_peered":"2024-02-10T08:16:54.847486+0000","last_unstale":"2024-02-10T08:19:09.590999+0000","last_undegraded":"2024-02-10T08:19:09.590999+0000","last_fullsized":"2024-02-10T08:19:09.590999+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'9","last_scrub_stamp":"2024-02-10T08:18:15.012657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:15.012657+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.591512+0000","last_change":"2024-02-10T08:18:52.045246+0000","last_active":"2024-02-10T08:19:09.591512+0000","last_peered":"2024-02-10T08:19:09.591512+0000","last_clean":"2024-02-10T08:19:09.591512+0000","last_became_active":"2024-02-10T08:16:58.891365+0000","last_became_peered":"2024-02-10T08:16:58.891365+0000","last_unstale":"2024-02-10T08:19:09.591512+0000","last_undegraded":"2024-02-10T08:19:09.591512+0000","last_fullsized":"2024-02-10T08:19:09.591512+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:52.045180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:52.045180+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.591388+0000","last_change":"2024-02-10T08:18:22.000876+0000","last_active":"2024-02-10T08:19:09.591388+0000","last_peered":"2024-02-10T08:19:09.591388+0000","last_clean":"2024-02-10T08:19:09.591388+0000","last_became_active":"2024-02-10T08:16:56.867217+0000","last_became_peered":"2024-02-10T08:16:56.867217+0000","last_unstale":"2024-02-10T08:19:09.591388+0000","last_undegraded":"2024-02-10T08:19:09.591388+0000","last_fullsized":"2024-02-10T08:19:09.591388+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:22.000811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:22.000811+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.591201+0000","last_change":"2024-02-10T08:18:14.058600+0000","last_active":"2024-02-10T08:19:09.591201+0000","last_peered":"2024-02-10T08:19:09.591201+0000","last_clean":"2024-02-10T08:19:09.591201+0000","last_became_active":"2024-02-10T08:16:52.785404+0000","last_became_peered":"2024-02-10T08:16:52.785404+0000","last_unstale":"2024-02-10T08:19:09.591201+0000","last_undegraded":"2024-02-10T08:19:09.591201+0000","last_fullsized":"2024-02-10T08:19:09.591201+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:14.058501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:14.058501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"74'17","reported_seq":71,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.591194+0000","last_change":"2024-02-10T08:18:02.949370+0000","last_active":"2024-02-10T08:19:09.591194+0000","last_peered":"2024-02-10T08:19:09.591194+0000","last_clean":"2024-02-10T08:19:09.591194+0000","last_became_active":"2024-02-10T08:16:54.848784+0000","last_became_peered":"2024-02-10T08:16:54.848784+0000","last_unstale":"2024-02-10T08:19:09.591194+0000","last_undegraded":"2024-02-10T08:19:09.591194+0000","last_fullsized":"2024-02-10T08:19:09.591194+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'17","last_scrub_stamp":"2024-02-10T08:18:02.949298+0000","last_deep_scrub":"74'17","last_deep_scrub_stamp":"2024-02-10T08:18:02.949298+0000","last_clean_scrub_stamp":"2024-02-10T08:18:02.949298+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.591674+0000","last_change":"2024-02-10T08:18:26.952584+0000","last_active":"2024-02-10T08:19:09.591674+0000","last_peered":"2024-02-10T08:19:09.591674+0000","last_clean":"2024-02-10T08:19:09.591674+0000","last_became_active":"2024-02-10T08:16:58.893364+0000","last_became_peered":"2024-02-10T08:16:58.893364+0000","last_unstale":"2024-02-10T08:19:09.591674+0000","last_undegraded":"2024-02-10T08:19:09.591674+0000","last_fullsized":"2024-02-10T08:19:09.591674+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:26.952496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:26.952496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.544170+0000","last_change":"2024-02-10T08:18:38.230334+0000","last_active":"2024-02-10T08:18:53.544170+0000","last_peered":"2024-02-10T08:18:53.544170+0000","last_clean":"2024-02-10T08:18:53.544170+0000","last_became_active":"2024-02-10T08:16:56.859752+0000","last_became_peered":"2024-02-10T08:16:56.859752+0000","last_unstale":"2024-02-10T08:18:53.544170+0000","last_undegraded":"2024-02-10T08:18:53.544170+0000","last_fullsized":"2024-02-10T08:18:53.544170+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:38.230210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:38.230210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":49,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:10.370852+0000","last_change":"2024-02-10T08:19:10.370825+0000","last_active":"2024-02-10T08:19:10.370852+0000","last_peered":"2024-02-10T08:19:10.370852+0000","last_clean":"2024-02-10T08:19:10.370852+0000","last_became_active":"2024-02-10T08:16:52.783261+0000","last_became_peered":"2024-02-10T08:16:52.783261+0000","last_unstale":"2024-02-10T08:19:10.370852+0000","last_undegraded":"2024-02-10T08:19:10.370852+0000","last_fullsized":"2024-02-10T08:19:10.370852+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:10.370746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:10.370746+0000","last_clean_scrub_stamp":"2024-02-10T08:19:10.370746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1c","version":"62'15","reported_seq":68,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.724073+0000","last_change":"2024-02-10T08:18:13.740262+0000","last_active":"2024-02-10T08:19:09.724073+0000","last_peered":"2024-02-10T08:19:09.724073+0000","last_clean":"2024-02-10T08:19:09.724073+0000","last_became_active":"2024-02-10T08:16:54.849361+0000","last_became_peered":"2024-02-10T08:16:54.849361+0000","last_unstale":"2024-02-10T08:19:09.724073+0000","last_undegraded":"2024-02-10T08:19:09.724073+0000","last_fullsized":"2024-02-10T08:19:09.724073+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'15","last_scrub_stamp":"2024-02-10T08:18:13.740187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:13.740187+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.543753+0000","last_change":"2024-02-10T08:18:22.105101+0000","last_active":"2024-02-10T08:18:53.543753+0000","last_peered":"2024-02-10T08:18:53.543753+0000","last_clean":"2024-02-10T08:18:53.543753+0000","last_became_active":"2024-02-10T08:16:58.862893+0000","last_became_peered":"2024-02-10T08:16:58.862893+0000","last_unstale":"2024-02-10T08:18:53.543753+0000","last_undegraded":"2024-02-10T08:18:53.543753+0000","last_fullsized":"2024-02-10T08:18:53.543753+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:22.104988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:22.104988+0000","last_clean_scrub_stamp":"2024-02-10T08:18:22.104988+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.806786+0000","last_change":"2024-02-10T08:18:21.772134+0000","last_active":"2024-02-10T08:18:53.806786+0000","last_peered":"2024-02-10T08:18:53.806786+0000","last_clean":"2024-02-10T08:18:53.806786+0000","last_became_active":"2024-02-10T08:16:56.863348+0000","last_became_peered":"2024-02-10T08:16:56.863348+0000","last_unstale":"2024-02-10T08:18:53.806786+0000","last_undegraded":"2024-02-10T08:18:53.806786+0000","last_fullsized":"2024-02-10T08:18:53.806786+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:21.771969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:21.771969+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.590713+0000","last_change":"2024-02-10T08:18:38.075002+0000","last_active":"2024-02-10T08:19:09.590713+0000","last_peered":"2024-02-10T08:19:09.590713+0000","last_clean":"2024-02-10T08:19:09.590713+0000","last_became_active":"2024-02-10T08:16:52.785743+0000","last_became_peered":"2024-02-10T08:16:52.785743+0000","last_unstale":"2024-02-10T08:19:09.590713+0000","last_undegraded":"2024-02-10T08:19:09.590713+0000","last_fullsized":"2024-02-10T08:19:09.590713+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:38.074885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:38.074885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"62'11","reported_seq":61,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.725758+0000","last_change":"2024-02-10T08:18:22.373044+0000","last_active":"2024-02-10T08:19:09.725758+0000","last_peered":"2024-02-10T08:19:09.725758+0000","last_clean":"2024-02-10T08:19:09.725758+0000","last_became_active":"2024-02-10T08:16:54.852665+0000","last_became_peered":"2024-02-10T08:16:54.852665+0000","last_unstale":"2024-02-10T08:19:09.725758+0000","last_undegraded":"2024-02-10T08:19:09.725758+0000","last_fullsized":"2024-02-10T08:19:09.725758+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'11","last_scrub_stamp":"2024-02-10T08:18:22.372958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:22.372958+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"62'1","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.723929+0000","last_change":"2024-02-10T08:18:13.819515+0000","last_active":"2024-02-10T08:19:09.723929+0000","last_peered":"2024-02-10T08:19:09.723929+0000","last_clean":"2024-02-10T08:19:09.723929+0000","last_became_active":"2024-02-10T08:16:58.859047+0000","last_became_peered":"2024-02-10T08:16:58.859047+0000","last_unstale":"2024-02-10T08:19:09.723929+0000","last_undegraded":"2024-02-10T08:19:09.723929+0000","last_fullsized":"2024-02-10T08:19:09.723929+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'1","last_scrub_stamp":"2024-02-10T08:18:13.819405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:13.819405+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"82'9","reported_seq":84,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:15.925603+0000","last_change":"2024-02-10T08:18:36.323299+0000","last_active":"2024-02-10T08:19:15.925603+0000","last_peered":"2024-02-10T08:19:15.925603+0000","last_clean":"2024-02-10T08:19:15.925603+0000","last_became_active":"2024-02-10T08:16:56.854294+0000","last_became_peered":"2024-02-10T08:16:56.854294+0000","last_unstale":"2024-02-10T08:19:15.925603+0000","last_undegraded":"2024-02-10T08:19:15.925603+0000","last_fullsized":"2024-02-10T08:19:15.925603+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'9","last_scrub_stamp":"2024-02-10T08:18:36.323217+0000","last_deep_scrub":"82'9","last_deep_scrub_stamp":"2024-02-10T08:18:36.323217+0000","last_clean_scrub_stamp":"2024-02-10T08:18:36.323217+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.722845+0000","last_change":"2024-02-10T08:18:30.422885+0000","last_active":"2024-02-10T08:19:09.722845+0000","last_peered":"2024-02-10T08:19:09.722845+0000","last_clean":"2024-02-10T08:19:09.722845+0000","last_became_active":"2024-02-10T08:16:52.788543+0000","last_became_peered":"2024-02-10T08:16:52.788543+0000","last_unstale":"2024-02-10T08:19:09.722845+0000","last_undegraded":"2024-02-10T08:19:09.722845+0000","last_fullsized":"2024-02-10T08:19:09.722845+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:30.422800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:30.422800+0000","last_clean_scrub_stamp":"2024-02-10T08:18:30.422800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"74'15","reported_seq":66,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:15.492916+0000","last_change":"2024-02-10T08:19:15.492916+0000","last_active":"2024-02-10T08:19:15.492916+0000","last_peered":"2024-02-10T08:19:15.492916+0000","last_clean":"2024-02-10T08:19:15.492916+0000","last_became_active":"2024-02-10T08:16:55.204738+0000","last_became_peered":"2024-02-10T08:16:55.204738+0000","last_unstale":"2024-02-10T08:19:15.492916+0000","last_undegraded":"2024-02-10T08:19:15.492916+0000","last_fullsized":"2024-02-10T08:19:15.492916+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'15","last_scrub_stamp":"2024-02-10T08:19:15.492821+0000","last_deep_scrub":"74'15","last_deep_scrub_stamp":"2024-02-10T08:17:57.637346+0000","last_clean_scrub_stamp":"2024-02-10T08:19:15.492821+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.591450+0000","last_change":"2024-02-10T08:18:28.180766+0000","last_active":"2024-02-10T08:19:09.591450+0000","last_peered":"2024-02-10T08:19:09.591450+0000","last_clean":"2024-02-10T08:19:09.591450+0000","last_became_active":"2024-02-10T08:16:58.892622+0000","last_became_peered":"2024-02-10T08:16:58.892622+0000","last_unstale":"2024-02-10T08:19:09.591450+0000","last_undegraded":"2024-02-10T08:19:09.591450+0000","last_fullsized":"2024-02-10T08:19:09.591450+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:28.180637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:28.180637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.724611+0000","last_change":"2024-02-10T08:19:06.357158+0000","last_active":"2024-02-10T08:19:09.724611+0000","last_peered":"2024-02-10T08:19:09.724611+0000","last_clean":"2024-02-10T08:19:09.724611+0000","last_became_active":"2024-02-10T08:16:56.860207+0000","last_became_peered":"2024-02-10T08:16:56.860207+0000","last_unstale":"2024-02-10T08:19:09.724611+0000","last_undegraded":"2024-02-10T08:19:09.724611+0000","last_fullsized":"2024-02-10T08:19:09.724611+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:06.357048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:19:06.357048+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.725844+0000","last_change":"2024-02-10T08:18:12.262783+0000","last_active":"2024-02-10T08:19:09.725844+0000","last_peered":"2024-02-10T08:19:09.725844+0000","last_clean":"2024-02-10T08:19:09.725844+0000","last_became_active":"2024-02-10T08:16:52.788629+0000","last_became_peered":"2024-02-10T08:16:52.788629+0000","last_unstale":"2024-02-10T08:19:09.725844+0000","last_undegraded":"2024-02-10T08:19:09.725844+0000","last_fullsized":"2024-02-10T08:19:09.725844+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:12.262707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:12.262707+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"62'11","reported_seq":62,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.590862+0000","last_change":"2024-02-10T08:18:25.169653+0000","last_active":"2024-02-10T08:19:09.590862+0000","last_peered":"2024-02-10T08:19:09.590862+0000","last_clean":"2024-02-10T08:19:09.590862+0000","last_became_active":"2024-02-10T08:16:55.204751+0000","last_became_peered":"2024-02-10T08:16:55.204751+0000","last_unstale":"2024-02-10T08:19:09.590862+0000","last_undegraded":"2024-02-10T08:19:09.590862+0000","last_fullsized":"2024-02-10T08:19:09.590862+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'11","last_scrub_stamp":"2024-02-10T08:18:25.169566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:25.169566+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":38,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.724026+0000","last_change":"2024-02-10T08:18:12.778101+0000","last_active":"2024-02-10T08:19:09.724026+0000","last_peered":"2024-02-10T08:19:09.724026+0000","last_clean":"2024-02-10T08:19:09.724026+0000","last_became_active":"2024-02-10T08:16:58.859979+0000","last_became_peered":"2024-02-10T08:16:58.859979+0000","last_unstale":"2024-02-10T08:19:09.724026+0000","last_undegraded":"2024-02-10T08:19:09.724026+0000","last_fullsized":"2024-02-10T08:19:09.724026+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:12.778021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:12.778021+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.725138+0000","last_change":"2024-02-10T08:18:34.381405+0000","last_active":"2024-02-10T08:19:09.725138+0000","last_peered":"2024-02-10T08:19:09.725138+0000","last_clean":"2024-02-10T08:19:09.725138+0000","last_became_active":"2024-02-10T08:16:56.859540+0000","last_became_peered":"2024-02-10T08:16:56.859540+0000","last_unstale":"2024-02-10T08:19:09.725138+0000","last_undegraded":"2024-02-10T08:19:09.725138+0000","last_fullsized":"2024-02-10T08:19:09.725138+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:34.381329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:34.381329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":49,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:13.281365+0000","last_change":"2024-02-10T08:19:13.281333+0000","last_active":"2024-02-10T08:19:13.281365+0000","last_peered":"2024-02-10T08:19:13.281365+0000","last_clean":"2024-02-10T08:19:13.281365+0000","last_became_active":"2024-02-10T08:16:52.788704+0000","last_became_peered":"2024-02-10T08:16:52.788704+0000","last_unstale":"2024-02-10T08:19:13.281365+0000","last_undegraded":"2024-02-10T08:19:13.281365+0000","last_fullsized":"2024-02-10T08:19:13.281365+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:13.281242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:19:13.281242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"62'4","reported_seq":49,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.590427+0000","last_change":"2024-02-10T08:18:50.134758+0000","last_active":"2024-02-10T08:19:09.590427+0000","last_peered":"2024-02-10T08:19:09.590427+0000","last_clean":"2024-02-10T08:19:09.590427+0000","last_became_active":"2024-02-10T08:16:54.852959+0000","last_became_peered":"2024-02-10T08:16:54.852959+0000","last_unstale":"2024-02-10T08:19:09.590427+0000","last_undegraded":"2024-02-10T08:19:09.590427+0000","last_fullsized":"2024-02-10T08:19:09.590427+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'4","last_scrub_stamp":"2024-02-10T08:18:50.134690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:50.134690+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.590168+0000","last_change":"2024-02-10T08:19:02.030164+0000","last_active":"2024-02-10T08:19:09.590168+0000","last_peered":"2024-02-10T08:19:09.590168+0000","last_clean":"2024-02-10T08:19:09.590168+0000","last_became_active":"2024-02-10T08:16:58.864301+0000","last_became_peered":"2024-02-10T08:16:58.864301+0000","last_unstale":"2024-02-10T08:19:09.590168+0000","last_undegraded":"2024-02-10T08:19:09.590168+0000","last_fullsized":"2024-02-10T08:19:09.590168+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:02.030086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:19:02.030086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.545083+0000","last_change":"2024-02-10T08:18:30.157336+0000","last_active":"2024-02-10T08:18:53.545083+0000","last_peered":"2024-02-10T08:18:53.545083+0000","last_clean":"2024-02-10T08:18:53.545083+0000","last_became_active":"2024-02-10T08:16:56.860953+0000","last_became_peered":"2024-02-10T08:16:56.860953+0000","last_unstale":"2024-02-10T08:18:53.545083+0000","last_undegraded":"2024-02-10T08:18:53.545083+0000","last_fullsized":"2024-02-10T08:18:53.545083+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:30.157268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:30.157268+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.543943+0000","last_change":"2024-02-10T08:18:21.134912+0000","last_active":"2024-02-10T08:18:53.543943+0000","last_peered":"2024-02-10T08:18:53.543943+0000","last_clean":"2024-02-10T08:18:53.543943+0000","last_became_active":"2024-02-10T08:16:52.786400+0000","last_became_peered":"2024-02-10T08:16:52.786400+0000","last_unstale":"2024-02-10T08:18:53.543943+0000","last_undegraded":"2024-02-10T08:18:53.543943+0000","last_fullsized":"2024-02-10T08:18:53.543943+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:21.134826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:21.134826+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"62'11","reported_seq":83,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.590993+0000","last_change":"2024-02-10T08:18:18.168451+0000","last_active":"2024-02-10T08:19:09.590993+0000","last_peered":"2024-02-10T08:19:09.590993+0000","last_clean":"2024-02-10T08:19:09.590993+0000","last_became_active":"2024-02-10T08:18:18.162983+0000","last_became_peered":"2024-02-10T08:18:18.162983+0000","last_unstale":"2024-02-10T08:19:09.590993+0000","last_undegraded":"2024-02-10T08:19:09.590993+0000","last_fullsized":"2024-02-10T08:19:09.590993+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'11","last_scrub_stamp":"2024-02-10T08:18:17.029517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:17.029517+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":37,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:54.588873+0000","last_change":"2024-02-10T08:18:54.588850+0000","last_active":"2024-02-10T08:18:54.588873+0000","last_peered":"2024-02-10T08:18:54.588873+0000","last_clean":"2024-02-10T08:18:54.588873+0000","last_became_active":"2024-02-10T08:16:58.861031+0000","last_became_peered":"2024-02-10T08:16:58.861031+0000","last_unstale":"2024-02-10T08:18:54.588873+0000","last_undegraded":"2024-02-10T08:18:54.588873+0000","last_fullsized":"2024-02-10T08:18:54.588873+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:54.588775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:54.588775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.591282+0000","last_change":"2024-02-10T08:18:55.042056+0000","last_active":"2024-02-10T08:19:09.591282+0000","last_peered":"2024-02-10T08:19:09.591282+0000","last_clean":"2024-02-10T08:19:09.591282+0000","last_became_active":"2024-02-10T08:16:56.862136+0000","last_became_peered":"2024-02-10T08:16:56.862136+0000","last_unstale":"2024-02-10T08:19:09.591282+0000","last_undegraded":"2024-02-10T08:19:09.591282+0000","last_fullsized":"2024-02-10T08:19:09.591282+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:55.041978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:55.041978+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.725465+0000","last_change":"2024-02-10T08:17:58.226189+0000","last_active":"2024-02-10T08:19:09.725465+0000","last_peered":"2024-02-10T08:19:09.725465+0000","last_clean":"2024-02-10T08:19:09.725465+0000","last_became_active":"2024-02-10T08:16:52.786213+0000","last_became_peered":"2024-02-10T08:16:52.786213+0000","last_unstale":"2024-02-10T08:19:09.725465+0000","last_undegraded":"2024-02-10T08:19:09.725465+0000","last_fullsized":"2024-02-10T08:19:09.725465+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:17:58.226110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:17:58.226110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"62'9","reported_seq":63,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:14.479081+0000","last_change":"2024-02-10T08:19:14.479081+0000","last_active":"2024-02-10T08:19:14.479081+0000","last_peered":"2024-02-10T08:19:14.479081+0000","last_clean":"2024-02-10T08:19:14.479081+0000","last_became_active":"2024-02-10T08:16:54.851971+0000","last_became_peered":"2024-02-10T08:16:54.851971+0000","last_unstale":"2024-02-10T08:19:14.479081+0000","last_undegraded":"2024-02-10T08:19:14.479081+0000","last_fullsized":"2024-02-10T08:19:14.479081+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'9","last_scrub_stamp":"2024-02-10T08:19:14.478966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:19:14.478966+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.591822+0000","last_change":"2024-02-10T08:18:22.955891+0000","last_active":"2024-02-10T08:19:09.591822+0000","last_peered":"2024-02-10T08:19:09.591822+0000","last_clean":"2024-02-10T08:19:09.591822+0000","last_became_active":"2024-02-10T08:16:58.858961+0000","last_became_peered":"2024-02-10T08:16:58.858961+0000","last_unstale":"2024-02-10T08:19:09.591822+0000","last_undegraded":"2024-02-10T08:19:09.591822+0000","last_fullsized":"2024-02-10T08:19:09.591822+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:22.955823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:22.955823+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"62'8","reported_seq":78,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:15.925581+0000","last_change":"2024-02-10T08:18:23.120983+0000","last_active":"2024-02-10T08:19:15.925581+0000","last_peered":"2024-02-10T08:19:15.925581+0000","last_clean":"2024-02-10T08:19:15.925581+0000","last_became_active":"2024-02-10T08:16:56.854151+0000","last_became_peered":"2024-02-10T08:16:56.854151+0000","last_unstale":"2024-02-10T08:19:15.925581+0000","last_undegraded":"2024-02-10T08:19:15.925581+0000","last_fullsized":"2024-02-10T08:19:15.925581+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'8","last_scrub_stamp":"2024-02-10T08:18:23.120909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:23.120909+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":48,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:19:08.548559+0000","last_change":"2024-02-10T08:19:08.548533+0000","last_active":"2024-02-10T08:19:08.548559+0000","last_peered":"2024-02-10T08:19:08.548559+0000","last_clean":"2024-02-10T08:19:08.548559+0000","last_became_active":"2024-02-10T08:16:52.786492+0000","last_became_peered":"2024-02-10T08:16:52.786492+0000","last_unstale":"2024-02-10T08:19:08.548559+0000","last_undegraded":"2024-02-10T08:19:08.548559+0000","last_fullsized":"2024-02-10T08:19:08.548559+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:08.548458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:19:08.548458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"62'9","reported_seq":58,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.723893+0000","last_change":"2024-02-10T08:18:48.370939+0000","last_active":"2024-02-10T08:19:09.723893+0000","last_peered":"2024-02-10T08:19:09.723893+0000","last_clean":"2024-02-10T08:19:09.723893+0000","last_became_active":"2024-02-10T08:16:55.204734+0000","last_became_peered":"2024-02-10T08:16:55.204734+0000","last_unstale":"2024-02-10T08:19:09.723893+0000","last_undegraded":"2024-02-10T08:19:09.723893+0000","last_fullsized":"2024-02-10T08:19:09.723893+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'9","last_scrub_stamp":"2024-02-10T08:18:48.370832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:48.370832+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":37,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.806604+0000","last_change":"2024-02-10T08:18:05.663042+0000","last_active":"2024-02-10T08:18:53.806604+0000","last_peered":"2024-02-10T08:18:53.806604+0000","last_clean":"2024-02-10T08:18:53.806604+0000","last_became_active":"2024-02-10T08:16:58.869673+0000","last_became_peered":"2024-02-10T08:16:58.869673+0000","last_unstale":"2024-02-10T08:18:53.806604+0000","last_undegraded":"2024-02-10T08:18:53.806604+0000","last_fullsized":"2024-02-10T08:18:53.806604+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:05.662947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:05.662947+0000","last_clean_scrub_stamp":"2024-02-10T08:18:05.662947+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"62'8","reported_seq":77,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:15.925603+0000","last_change":"2024-02-10T08:18:23.419433+0000","last_active":"2024-02-10T08:19:15.925603+0000","last_peered":"2024-02-10T08:19:15.925603+0000","last_clean":"2024-02-10T08:19:15.925603+0000","last_became_active":"2024-02-10T08:16:56.864587+0000","last_became_peered":"2024-02-10T08:16:56.864587+0000","last_unstale":"2024-02-10T08:19:15.925603+0000","last_undegraded":"2024-02-10T08:19:15.925603+0000","last_fullsized":"2024-02-10T08:19:15.925603+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'8","last_scrub_stamp":"2024-02-10T08:18:23.419353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:23.419353+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.723020+0000","last_change":"2024-02-10T08:18:34.327085+0000","last_active":"2024-02-10T08:19:09.723020+0000","last_peered":"2024-02-10T08:19:09.723020+0000","last_clean":"2024-02-10T08:19:09.723020+0000","last_became_active":"2024-02-10T08:16:52.789834+0000","last_became_peered":"2024-02-10T08:16:52.789834+0000","last_unstale":"2024-02-10T08:19:09.723020+0000","last_undegraded":"2024-02-10T08:19:09.723020+0000","last_fullsized":"2024-02-10T08:19:09.723020+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:34.326987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:34.326987+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"62'10","reported_seq":63,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.591589+0000","last_change":"2024-02-10T08:19:09.007459+0000","last_active":"2024-02-10T08:19:09.591589+0000","last_peered":"2024-02-10T08:19:09.591589+0000","last_clean":"2024-02-10T08:19:09.591589+0000","last_became_active":"2024-02-10T08:16:55.204789+0000","last_became_peered":"2024-02-10T08:16:55.204789+0000","last_unstale":"2024-02-10T08:19:09.591589+0000","last_undegraded":"2024-02-10T08:19:09.591589+0000","last_fullsized":"2024-02-10T08:19:09.591589+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'10","last_scrub_stamp":"2024-02-10T08:19:09.007376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:19:09.007376+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":38,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.723306+0000","last_change":"2024-02-10T08:18:22.944672+0000","last_active":"2024-02-10T08:19:09.723306+0000","last_peered":"2024-02-10T08:19:09.723306+0000","last_clean":"2024-02-10T08:19:09.723306+0000","last_became_active":"2024-02-10T08:16:58.893128+0000","last_became_peered":"2024-02-10T08:16:58.893128+0000","last_unstale":"2024-02-10T08:19:09.723306+0000","last_undegraded":"2024-02-10T08:19:09.723306+0000","last_fullsized":"2024-02-10T08:19:09.723306+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:22.944593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:22.944593+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.724611+0000","last_change":"2024-02-10T08:18:49.369603+0000","last_active":"2024-02-10T08:19:09.724611+0000","last_peered":"2024-02-10T08:19:09.724611+0000","last_clean":"2024-02-10T08:19:09.724611+0000","last_became_active":"2024-02-10T08:16:56.863948+0000","last_became_peered":"2024-02-10T08:16:56.863948+0000","last_unstale":"2024-02-10T08:19:09.724611+0000","last_undegraded":"2024-02-10T08:19:09.724611+0000","last_fullsized":"2024-02-10T08:19:09.724611+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:49.369500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:49.369500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.725193+0000","last_change":"2024-02-10T08:18:08.233178+0000","last_active":"2024-02-10T08:19:09.725193+0000","last_peered":"2024-02-10T08:19:09.725193+0000","last_clean":"2024-02-10T08:19:09.725193+0000","last_became_active":"2024-02-10T08:16:52.782434+0000","last_became_peered":"2024-02-10T08:16:52.782434+0000","last_unstale":"2024-02-10T08:19:09.725193+0000","last_undegraded":"2024-02-10T08:19:09.725193+0000","last_fullsized":"2024-02-10T08:19:09.725193+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:08.233096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:08.233096+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"62'6","reported_seq":52,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.591429+0000","last_change":"2024-02-10T08:18:42.100646+0000","last_active":"2024-02-10T08:19:09.591429+0000","last_peered":"2024-02-10T08:19:09.591429+0000","last_clean":"2024-02-10T08:19:09.591429+0000","last_became_active":"2024-02-10T08:16:55.203401+0000","last_became_peered":"2024-02-10T08:16:55.203401+0000","last_unstale":"2024-02-10T08:19:09.591429+0000","last_undegraded":"2024-02-10T08:19:09.591429+0000","last_fullsized":"2024-02-10T08:19:09.591429+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'6","last_scrub_stamp":"2024-02-10T08:18:42.100550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:42.100550+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.723816+0000","last_change":"2024-02-10T08:18:10.716849+0000","last_active":"2024-02-10T08:19:09.723816+0000","last_peered":"2024-02-10T08:19:09.723816+0000","last_clean":"2024-02-10T08:19:09.723816+0000","last_became_active":"2024-02-10T08:16:58.857790+0000","last_became_peered":"2024-02-10T08:16:58.857790+0000","last_unstale":"2024-02-10T08:19:09.723816+0000","last_undegraded":"2024-02-10T08:19:09.723816+0000","last_fullsized":"2024-02-10T08:19:09.723816+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:10.716763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:10.716763+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.591521+0000","last_change":"2024-02-10T08:18:22.074334+0000","last_active":"2024-02-10T08:19:09.591521+0000","last_peered":"2024-02-10T08:19:09.591521+0000","last_clean":"2024-02-10T08:19:09.591521+0000","last_became_active":"2024-02-10T08:16:56.860904+0000","last_became_peered":"2024-02-10T08:16:56.860904+0000","last_unstale":"2024-02-10T08:19:09.591521+0000","last_undegraded":"2024-02-10T08:19:09.591521+0000","last_fullsized":"2024-02-10T08:19:09.591521+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:22.074268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:22.074268+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"55'1","reported_seq":51,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.723016+0000","last_change":"2024-02-10T08:18:03.695320+0000","last_active":"2024-02-10T08:19:09.723016+0000","last_peered":"2024-02-10T08:19:09.723016+0000","last_clean":"2024-02-10T08:19:09.723016+0000","last_became_active":"2024-02-10T08:16:52.782734+0000","last_became_peered":"2024-02-10T08:16:52.782734+0000","last_unstale":"2024-02-10T08:19:09.723016+0000","last_undegraded":"2024-02-10T08:19:09.723016+0000","last_fullsized":"2024-02-10T08:19:09.723016+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'1","last_scrub_stamp":"2024-02-10T08:18:03.695203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:03.695203+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"62'9","reported_seq":62,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:14.500843+0000","last_change":"2024-02-10T08:19:14.500843+0000","last_active":"2024-02-10T08:19:14.500843+0000","last_peered":"2024-02-10T08:19:14.500843+0000","last_clean":"2024-02-10T08:19:14.500843+0000","last_became_active":"2024-02-10T08:16:55.204727+0000","last_became_peered":"2024-02-10T08:16:55.204727+0000","last_unstale":"2024-02-10T08:19:14.500843+0000","last_undegraded":"2024-02-10T08:19:14.500843+0000","last_fullsized":"2024-02-10T08:19:14.500843+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'9","last_scrub_stamp":"2024-02-10T08:19:14.500766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:19:14.500766+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.591372+0000","last_change":"2024-02-10T08:18:32.027821+0000","last_active":"2024-02-10T08:19:09.591372+0000","last_peered":"2024-02-10T08:19:09.591372+0000","last_clean":"2024-02-10T08:19:09.591372+0000","last_became_active":"2024-02-10T08:16:58.868848+0000","last_became_peered":"2024-02-10T08:16:58.868848+0000","last_unstale":"2024-02-10T08:19:09.591372+0000","last_undegraded":"2024-02-10T08:19:09.591372+0000","last_fullsized":"2024-02-10T08:19:09.591372+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:32.027720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:32.027720+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"55'2","reported_seq":58,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.591694+0000","last_change":"2024-02-10T08:18:03.916402+0000","last_active":"2024-02-10T08:19:09.591694+0000","last_peered":"2024-02-10T08:19:09.591694+0000","last_clean":"2024-02-10T08:19:09.591694+0000","last_became_active":"2024-02-10T08:16:52.789545+0000","last_became_peered":"2024-02-10T08:16:52.789545+0000","last_unstale":"2024-02-10T08:19:09.591694+0000","last_undegraded":"2024-02-10T08:19:09.591694+0000","last_fullsized":"2024-02-10T08:19:09.591694+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'2","last_scrub_stamp":"2024-02-10T08:18:03.916322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:03.916322+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"82'17","reported_seq":71,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.590935+0000","last_change":"2024-02-10T08:18:21.015975+0000","last_active":"2024-02-10T08:19:09.590935+0000","last_peered":"2024-02-10T08:19:09.590935+0000","last_clean":"2024-02-10T08:19:09.590935+0000","last_became_active":"2024-02-10T08:16:54.848324+0000","last_became_peered":"2024-02-10T08:16:54.848324+0000","last_unstale":"2024-02-10T08:19:09.590935+0000","last_undegraded":"2024-02-10T08:19:09.590935+0000","last_fullsized":"2024-02-10T08:19:09.590935+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'17","last_scrub_stamp":"2024-02-10T08:18:21.015873+0000","last_deep_scrub":"82'17","last_deep_scrub_stamp":"2024-02-10T08:18:21.015873+0000","last_clean_scrub_stamp":"2024-02-10T08:18:21.015873+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.722959+0000","last_change":"2024-02-10T08:17:59.810321+0000","last_active":"2024-02-10T08:19:09.722959+0000","last_peered":"2024-02-10T08:19:09.722959+0000","last_clean":"2024-02-10T08:19:09.722959+0000","last_became_active":"2024-02-10T08:16:56.860850+0000","last_became_peered":"2024-02-10T08:16:56.860850+0000","last_unstale":"2024-02-10T08:19:09.722959+0000","last_undegraded":"2024-02-10T08:19:09.722959+0000","last_fullsized":"2024-02-10T08:19:09.722959+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:17:59.810251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:17:59.810251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:13.538609+0000","last_change":"2024-02-10T08:19:13.538609+0000","last_active":"2024-02-10T08:19:13.538609+0000","last_peered":"2024-02-10T08:19:13.538609+0000","last_clean":"2024-02-10T08:19:13.538609+0000","last_became_active":"2024-02-10T08:16:58.864957+0000","last_became_peered":"2024-02-10T08:16:58.864957+0000","last_unstale":"2024-02-10T08:19:13.538609+0000","last_undegraded":"2024-02-10T08:19:13.538609+0000","last_fullsized":"2024-02-10T08:19:13.538609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:13.538485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:19:13.538485+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.544425+0000","last_change":"2024-02-10T08:18:36.311616+0000","last_active":"2024-02-10T08:18:53.544425+0000","last_peered":"2024-02-10T08:18:53.544425+0000","last_clean":"2024-02-10T08:18:53.544425+0000","last_became_active":"2024-02-10T08:16:52.789354+0000","last_became_peered":"2024-02-10T08:16:52.789354+0000","last_unstale":"2024-02-10T08:18:53.544425+0000","last_undegraded":"2024-02-10T08:18:53.544425+0000","last_fullsized":"2024-02-10T08:18:53.544425+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:36.311445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:36.311445+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"62'10","reported_seq":57,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.545002+0000","last_change":"2024-02-10T08:18:26.189282+0000","last_active":"2024-02-10T08:18:53.545002+0000","last_peered":"2024-02-10T08:18:53.545002+0000","last_clean":"2024-02-10T08:18:53.545002+0000","last_became_active":"2024-02-10T08:16:54.851420+0000","last_became_peered":"2024-02-10T08:16:54.851420+0000","last_unstale":"2024-02-10T08:18:53.545002+0000","last_undegraded":"2024-02-10T08:18:53.545002+0000","last_fullsized":"2024-02-10T08:18:53.545002+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'10","last_scrub_stamp":"2024-02-10T08:18:26.189127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:26.189127+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"62'8","reported_seq":76,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:10.924522+0000","last_change":"2024-02-10T08:18:35.727254+0000","last_active":"2024-02-10T08:19:10.924522+0000","last_peered":"2024-02-10T08:19:10.924522+0000","last_clean":"2024-02-10T08:19:10.924522+0000","last_became_active":"2024-02-10T08:16:56.862677+0000","last_became_peered":"2024-02-10T08:16:56.862677+0000","last_unstale":"2024-02-10T08:19:10.924522+0000","last_undegraded":"2024-02-10T08:19:10.924522+0000","last_fullsized":"2024-02-10T08:19:10.924522+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'8","last_scrub_stamp":"2024-02-10T08:18:35.727104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:35.727104+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.591281+0000","last_change":"2024-02-10T08:18:47.116797+0000","last_active":"2024-02-10T08:19:09.591281+0000","last_peered":"2024-02-10T08:19:09.591281+0000","last_clean":"2024-02-10T08:19:09.591281+0000","last_became_active":"2024-02-10T08:16:58.868746+0000","last_became_peered":"2024-02-10T08:16:58.868746+0000","last_unstale":"2024-02-10T08:19:09.591281+0000","last_undegraded":"2024-02-10T08:19:09.591281+0000","last_fullsized":"2024-02-10T08:19:09.591281+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:47.116727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:47.116727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.723191+0000","last_change":"2024-02-10T08:18:40.357832+0000","last_active":"2024-02-10T08:19:09.723191+0000","last_peered":"2024-02-10T08:19:09.723191+0000","last_clean":"2024-02-10T08:19:09.723191+0000","last_became_active":"2024-02-10T08:16:52.791027+0000","last_became_peered":"2024-02-10T08:16:52.791027+0000","last_unstale":"2024-02-10T08:19:09.723191+0000","last_undegraded":"2024-02-10T08:19:09.723191+0000","last_fullsized":"2024-02-10T08:19:09.723191+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:40.357758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:40.357758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"62'28","reported_seq":124,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:10.924509+0000","last_change":"2024-02-10T08:19:00.452971+0000","last_active":"2024-02-10T08:19:10.924509+0000","last_peered":"2024-02-10T08:19:10.924509+0000","last_clean":"2024-02-10T08:19:10.924509+0000","last_became_active":"2024-02-10T08:16:54.856000+0000","last_became_peered":"2024-02-10T08:16:54.856000+0000","last_unstale":"2024-02-10T08:19:10.924509+0000","last_undegraded":"2024-02-10T08:19:10.924509+0000","last_fullsized":"2024-02-10T08:19:10.924509+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'28","last_scrub_stamp":"2024-02-10T08:19:00.452887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:19:00.452887+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":48,"num_read_kb":33,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.806598+0000","last_change":"2024-02-10T08:18:51.533191+0000","last_active":"2024-02-10T08:18:53.806598+0000","last_peered":"2024-02-10T08:18:53.806598+0000","last_clean":"2024-02-10T08:18:53.806598+0000","last_became_active":"2024-02-10T08:16:56.864887+0000","last_became_peered":"2024-02-10T08:16:56.864887+0000","last_unstale":"2024-02-10T08:18:53.806598+0000","last_undegraded":"2024-02-10T08:18:53.806598+0000","last_fullsized":"2024-02-10T08:18:53.806598+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:51.533128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:51.533128+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":38,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.723645+0000","last_change":"2024-02-10T08:18:11.750615+0000","last_active":"2024-02-10T08:19:09.723645+0000","last_peered":"2024-02-10T08:19:09.723645+0000","last_clean":"2024-02-10T08:19:09.723645+0000","last_became_active":"2024-02-10T08:16:58.891249+0000","last_became_peered":"2024-02-10T08:16:58.891249+0000","last_unstale":"2024-02-10T08:19:09.723645+0000","last_undegraded":"2024-02-10T08:19:09.723645+0000","last_fullsized":"2024-02-10T08:19:09.723645+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:11.750537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:11.750537+0000","last_clean_scrub_stamp":"2024-02-10T08:18:11.750537+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"63'5","reported_seq":189,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:16.012005+0000","last_change":"2024-02-10T08:19:12.466527+0000","last_active":"2024-02-10T08:19:16.012005+0000","last_peered":"2024-02-10T08:19:16.012005+0000","last_clean":"2024-02-10T08:19:16.012005+0000","last_became_active":"2024-02-10T08:16:52.780989+0000","last_became_peered":"2024-02-10T08:16:52.780989+0000","last_unstale":"2024-02-10T08:19:16.012005+0000","last_undegraded":"2024-02-10T08:19:16.012005+0000","last_fullsized":"2024-02-10T08:19:16.012005+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'5","last_scrub_stamp":"2024-02-10T08:19:12.466451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:19:12.466451+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":137,"num_read_kb":132,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":50,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:13.900350+0000","last_change":"2024-02-10T08:19:13.900328+0000","last_active":"2024-02-10T08:19:13.900350+0000","last_peered":"2024-02-10T08:19:13.900350+0000","last_clean":"2024-02-10T08:19:13.900350+0000","last_became_active":"2024-02-10T08:16:52.787737+0000","last_became_peered":"2024-02-10T08:16:52.787737+0000","last_unstale":"2024-02-10T08:19:13.900350+0000","last_undegraded":"2024-02-10T08:19:13.900350+0000","last_fullsized":"2024-02-10T08:19:13.900350+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:13.900264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:11.681169+0000","last_clean_scrub_stamp":"2024-02-10T08:19:13.900264+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"62'13","reported_seq":69,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.543549+0000","last_change":"2024-02-10T08:18:39.241207+0000","last_active":"2024-02-10T08:18:53.543549+0000","last_peered":"2024-02-10T08:18:53.543549+0000","last_clean":"2024-02-10T08:18:53.543549+0000","last_became_active":"2024-02-10T08:16:54.850812+0000","last_became_peered":"2024-02-10T08:16:54.850812+0000","last_unstale":"2024-02-10T08:18:53.543549+0000","last_undegraded":"2024-02-10T08:18:53.543549+0000","last_fullsized":"2024-02-10T08:18:53.543549+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'13","last_scrub_stamp":"2024-02-10T08:18:39.240947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:39.240947+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.724052+0000","last_change":"2024-02-10T08:18:28.603605+0000","last_active":"2024-02-10T08:19:09.724052+0000","last_peered":"2024-02-10T08:19:09.724052+0000","last_clean":"2024-02-10T08:19:09.724052+0000","last_became_active":"2024-02-10T08:16:56.857856+0000","last_became_peered":"2024-02-10T08:16:56.857856+0000","last_unstale":"2024-02-10T08:19:09.724052+0000","last_undegraded":"2024-02-10T08:19:09.724052+0000","last_fullsized":"2024-02-10T08:19:09.724052+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:28.603511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:28.603511+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":38,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.725088+0000","last_change":"2024-02-10T08:18:45.380034+0000","last_active":"2024-02-10T08:19:09.725088+0000","last_peered":"2024-02-10T08:19:09.725088+0000","last_clean":"2024-02-10T08:19:09.725088+0000","last_became_active":"2024-02-10T08:16:58.867978+0000","last_became_peered":"2024-02-10T08:16:58.867978+0000","last_unstale":"2024-02-10T08:19:09.725088+0000","last_undegraded":"2024-02-10T08:19:09.725088+0000","last_fullsized":"2024-02-10T08:19:09.725088+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:45.379932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:45.379932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.591159+0000","last_change":"2024-02-10T08:18:07.008482+0000","last_active":"2024-02-10T08:19:09.591159+0000","last_peered":"2024-02-10T08:19:09.591159+0000","last_clean":"2024-02-10T08:19:09.591159+0000","last_became_active":"2024-02-10T08:16:52.788195+0000","last_became_peered":"2024-02-10T08:16:52.788195+0000","last_unstale":"2024-02-10T08:19:09.591159+0000","last_undegraded":"2024-02-10T08:19:09.591159+0000","last_fullsized":"2024-02-10T08:19:09.591159+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:07.008399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:07.008399+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.724782+0000","last_change":"2024-02-10T08:18:19.390305+0000","last_active":"2024-02-10T08:19:09.724782+0000","last_peered":"2024-02-10T08:19:09.724782+0000","last_clean":"2024-02-10T08:19:09.724782+0000","last_became_active":"2024-02-10T08:16:52.788767+0000","last_became_peered":"2024-02-10T08:16:52.788767+0000","last_unstale":"2024-02-10T08:19:09.724782+0000","last_undegraded":"2024-02-10T08:19:09.724782+0000","last_fullsized":"2024-02-10T08:19:09.724782+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:19.390239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:19.390239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":53,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.723307+0000","last_change":"2024-02-10T08:18:24.982997+0000","last_active":"2024-02-10T08:19:09.723307+0000","last_peered":"2024-02-10T08:19:09.723307+0000","last_clean":"2024-02-10T08:19:09.723307+0000","last_became_active":"2024-02-10T08:16:46.402267+0000","last_became_peered":"2024-02-10T08:16:46.402267+0000","last_unstale":"2024-02-10T08:19:09.723307+0000","last_undegraded":"2024-02-10T08:19:09.723307+0000","last_fullsized":"2024-02-10T08:19:09.723307+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:24.982932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:14:44.584370+0000","last_clean_scrub_stamp":"2024-02-10T08:18:24.982932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"62'14","reported_seq":64,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.725711+0000","last_change":"2024-02-10T08:18:33.416443+0000","last_active":"2024-02-10T08:19:09.725711+0000","last_peered":"2024-02-10T08:19:09.725711+0000","last_clean":"2024-02-10T08:19:09.725711+0000","last_became_active":"2024-02-10T08:16:55.204616+0000","last_became_peered":"2024-02-10T08:16:55.204616+0000","last_unstale":"2024-02-10T08:19:09.725711+0000","last_undegraded":"2024-02-10T08:19:09.725711+0000","last_fullsized":"2024-02-10T08:19:09.725711+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'14","last_scrub_stamp":"2024-02-10T08:18:33.416365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:33.416365+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":15,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.723781+0000","last_change":"2024-02-10T08:18:04.766868+0000","last_active":"2024-02-10T08:19:09.723781+0000","last_peered":"2024-02-10T08:19:09.723781+0000","last_clean":"2024-02-10T08:19:09.723781+0000","last_became_active":"2024-02-10T08:16:56.867159+0000","last_became_peered":"2024-02-10T08:16:56.867159+0000","last_unstale":"2024-02-10T08:19:09.723781+0000","last_undegraded":"2024-02-10T08:19:09.723781+0000","last_fullsized":"2024-02-10T08:19:09.723781+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:04.766780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:04.766780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:04.766780+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.544133+0000","last_change":"2024-02-10T08:18:41.255265+0000","last_active":"2024-02-10T08:18:53.544133+0000","last_peered":"2024-02-10T08:18:53.544133+0000","last_clean":"2024-02-10T08:18:53.544133+0000","last_became_active":"2024-02-10T08:16:58.867593+0000","last_became_peered":"2024-02-10T08:16:58.867593+0000","last_unstale":"2024-02-10T08:18:53.544133+0000","last_undegraded":"2024-02-10T08:18:53.544133+0000","last_fullsized":"2024-02-10T08:18:53.544133+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:41.255196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:41.255196+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":45,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.805860+0000","last_change":"2024-02-10T08:18:20.736287+0000","last_active":"2024-02-10T08:18:53.805860+0000","last_peered":"2024-02-10T08:18:53.805860+0000","last_clean":"2024-02-10T08:18:53.805860+0000","last_became_active":"2024-02-10T08:16:52.782840+0000","last_became_peered":"2024-02-10T08:16:52.782840+0000","last_unstale":"2024-02-10T08:18:53.805860+0000","last_undegraded":"2024-02-10T08:18:53.805860+0000","last_fullsized":"2024-02-10T08:18:53.805860+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:20.736224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:20.736224+0000","last_clean_scrub_stamp":"2024-02-10T08:18:20.736224+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.723221+0000","last_change":"2024-02-10T08:18:14.858038+0000","last_active":"2024-02-10T08:19:09.723221+0000","last_peered":"2024-02-10T08:19:09.723221+0000","last_clean":"2024-02-10T08:19:09.723221+0000","last_became_active":"2024-02-10T08:16:52.787180+0000","last_became_peered":"2024-02-10T08:16:52.787180+0000","last_unstale":"2024-02-10T08:19:09.723221+0000","last_undegraded":"2024-02-10T08:19:09.723221+0000","last_fullsized":"2024-02-10T08:19:09.723221+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:14.857925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:14.857925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"62'12","reported_seq":59,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.806668+0000","last_change":"2024-02-10T08:18:34.720492+0000","last_active":"2024-02-10T08:18:53.806668+0000","last_peered":"2024-02-10T08:18:53.806668+0000","last_clean":"2024-02-10T08:18:53.806668+0000","last_became_active":"2024-02-10T08:16:54.853330+0000","last_became_peered":"2024-02-10T08:16:54.853330+0000","last_unstale":"2024-02-10T08:18:53.806668+0000","last_undegraded":"2024-02-10T08:18:53.806668+0000","last_fullsized":"2024-02-10T08:18:53.806668+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'12","last_scrub_stamp":"2024-02-10T08:18:34.720419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:34.720419+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.725071+0000","last_change":"2024-02-10T08:18:41.360314+0000","last_active":"2024-02-10T08:19:09.725071+0000","last_peered":"2024-02-10T08:19:09.725071+0000","last_clean":"2024-02-10T08:19:09.725071+0000","last_became_active":"2024-02-10T08:16:56.864030+0000","last_became_peered":"2024-02-10T08:16:56.864030+0000","last_unstale":"2024-02-10T08:19:09.725071+0000","last_undegraded":"2024-02-10T08:19:09.725071+0000","last_fullsized":"2024-02-10T08:19:09.725071+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:41.360241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:41.360241+0000","last_clean_scrub_stamp":"2024-02-10T08:18:41.360241+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.544323+0000","last_change":"2024-02-10T08:18:13.057393+0000","last_active":"2024-02-10T08:18:53.544323+0000","last_peered":"2024-02-10T08:18:53.544323+0000","last_clean":"2024-02-10T08:18:53.544323+0000","last_became_active":"2024-02-10T08:16:58.891287+0000","last_became_peered":"2024-02-10T08:16:58.891287+0000","last_unstale":"2024-02-10T08:18:53.544323+0000","last_undegraded":"2024-02-10T08:18:53.544323+0000","last_fullsized":"2024-02-10T08:18:53.544323+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:13.057266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:13.057266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.723730+0000","last_change":"2024-02-10T08:18:18.163873+0000","last_active":"2024-02-10T08:19:09.723730+0000","last_peered":"2024-02-10T08:19:09.723730+0000","last_clean":"2024-02-10T08:19:09.723730+0000","last_became_active":"2024-02-10T08:18:18.163475+0000","last_became_peered":"2024-02-10T08:18:18.163475+0000","last_unstale":"2024-02-10T08:19:09.723730+0000","last_undegraded":"2024-02-10T08:19:09.723730+0000","last_fullsized":"2024-02-10T08:19:09.723730+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:16.912336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:16.912336+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4],"acting":[2,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"62'19","reported_seq":77,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.806077+0000","last_change":"2024-02-10T08:18:26.755417+0000","last_active":"2024-02-10T08:18:53.806077+0000","last_peered":"2024-02-10T08:18:53.806077+0000","last_clean":"2024-02-10T08:18:53.806077+0000","last_became_active":"2024-02-10T08:16:55.203453+0000","last_became_peered":"2024-02-10T08:16:55.203453+0000","last_unstale":"2024-02-10T08:18:53.806077+0000","last_undegraded":"2024-02-10T08:18:53.806077+0000","last_fullsized":"2024-02-10T08:18:53.806077+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'19","last_scrub_stamp":"2024-02-10T08:18:26.755321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:26.755321+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.725574+0000","last_change":"2024-02-10T08:18:17.299894+0000","last_active":"2024-02-10T08:19:09.725574+0000","last_peered":"2024-02-10T08:19:09.725574+0000","last_clean":"2024-02-10T08:19:09.725574+0000","last_became_active":"2024-02-10T08:16:56.861172+0000","last_became_peered":"2024-02-10T08:16:56.861172+0000","last_unstale":"2024-02-10T08:19:09.725574+0000","last_undegraded":"2024-02-10T08:19:09.725574+0000","last_fullsized":"2024-02-10T08:19:09.725574+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:17.299814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:17.299814+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.591203+0000","last_change":"2024-02-10T08:18:04.882451+0000","last_active":"2024-02-10T08:19:09.591203+0000","last_peered":"2024-02-10T08:19:09.591203+0000","last_clean":"2024-02-10T08:19:09.591203+0000","last_became_active":"2024-02-10T08:16:58.863795+0000","last_became_peered":"2024-02-10T08:16:58.863795+0000","last_unstale":"2024-02-10T08:19:09.591203+0000","last_undegraded":"2024-02-10T08:19:09.591203+0000","last_fullsized":"2024-02-10T08:19:09.591203+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:04.882389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:04.882389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.543295+0000","last_change":"2024-02-10T08:18:12.069405+0000","last_active":"2024-02-10T08:18:53.543295+0000","last_peered":"2024-02-10T08:18:53.543295+0000","last_clean":"2024-02-10T08:18:53.543295+0000","last_became_active":"2024-02-10T08:16:52.781197+0000","last_became_peered":"2024-02-10T08:16:52.781197+0000","last_unstale":"2024-02-10T08:18:53.543295+0000","last_undegraded":"2024-02-10T08:18:53.543295+0000","last_fullsized":"2024-02-10T08:18:53.543295+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:12.069322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:12.069322+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"62'18","reported_seq":75,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.590280+0000","last_change":"2024-02-10T08:18:41.077152+0000","last_active":"2024-02-10T08:19:09.590280+0000","last_peered":"2024-02-10T08:19:09.590280+0000","last_clean":"2024-02-10T08:19:09.590280+0000","last_became_active":"2024-02-10T08:16:55.204981+0000","last_became_peered":"2024-02-10T08:16:55.204981+0000","last_unstale":"2024-02-10T08:19:09.590280+0000","last_undegraded":"2024-02-10T08:19:09.590280+0000","last_fullsized":"2024-02-10T08:19:09.590280+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'18","last_scrub_stamp":"2024-02-10T08:18:41.077080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:41.077080+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.591061+0000","last_change":"2024-02-10T08:18:15.980065+0000","last_active":"2024-02-10T08:19:09.591061+0000","last_peered":"2024-02-10T08:19:09.591061+0000","last_clean":"2024-02-10T08:19:09.591061+0000","last_became_active":"2024-02-10T08:16:56.858362+0000","last_became_peered":"2024-02-10T08:16:56.858362+0000","last_unstale":"2024-02-10T08:19:09.591061+0000","last_undegraded":"2024-02-10T08:19:09.591061+0000","last_fullsized":"2024-02-10T08:19:09.591061+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:15.979973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:15.979973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":38,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.723560+0000","last_change":"2024-02-10T08:18:15.893937+0000","last_active":"2024-02-10T08:19:09.723560+0000","last_peered":"2024-02-10T08:19:09.723560+0000","last_clean":"2024-02-10T08:19:09.723560+0000","last_became_active":"2024-02-10T08:16:58.893253+0000","last_became_peered":"2024-02-10T08:16:58.893253+0000","last_unstale":"2024-02-10T08:19:09.723560+0000","last_undegraded":"2024-02-10T08:19:09.723560+0000","last_fullsized":"2024-02-10T08:19:09.723560+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:15.893858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:15.893858+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.725818+0000","last_change":"2024-02-10T08:18:11.227796+0000","last_active":"2024-02-10T08:19:09.725818+0000","last_peered":"2024-02-10T08:19:09.725818+0000","last_clean":"2024-02-10T08:19:09.725818+0000","last_became_active":"2024-02-10T08:16:52.789020+0000","last_became_peered":"2024-02-10T08:16:52.789020+0000","last_unstale":"2024-02-10T08:19:09.725818+0000","last_undegraded":"2024-02-10T08:19:09.725818+0000","last_fullsized":"2024-02-10T08:19:09.725818+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:11.227682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:11.227682+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"62'14","reported_seq":64,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.590891+0000","last_change":"2024-02-10T08:18:10.980504+0000","last_active":"2024-02-10T08:19:09.590891+0000","last_peered":"2024-02-10T08:19:09.590891+0000","last_clean":"2024-02-10T08:19:09.590891+0000","last_became_active":"2024-02-10T08:16:54.844168+0000","last_became_peered":"2024-02-10T08:16:54.844168+0000","last_unstale":"2024-02-10T08:19:09.590891+0000","last_undegraded":"2024-02-10T08:19:09.590891+0000","last_fullsized":"2024-02-10T08:19:09.590891+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'14","last_scrub_stamp":"2024-02-10T08:18:10.980421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:10.980421+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"62'8","reported_seq":78,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:15.925818+0000","last_change":"2024-02-10T08:18:30.090145+0000","last_active":"2024-02-10T08:19:15.925818+0000","last_peered":"2024-02-10T08:19:15.925818+0000","last_clean":"2024-02-10T08:19:15.925818+0000","last_became_active":"2024-02-10T08:16:56.857343+0000","last_became_peered":"2024-02-10T08:16:56.857343+0000","last_unstale":"2024-02-10T08:19:15.925818+0000","last_undegraded":"2024-02-10T08:19:15.925818+0000","last_fullsized":"2024-02-10T08:19:15.925818+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'8","last_scrub_stamp":"2024-02-10T08:18:30.090065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:30.090065+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.591584+0000","last_change":"2024-02-10T08:18:56.053946+0000","last_active":"2024-02-10T08:19:09.591584+0000","last_peered":"2024-02-10T08:19:09.591584+0000","last_clean":"2024-02-10T08:19:09.591584+0000","last_became_active":"2024-02-10T08:16:58.891261+0000","last_became_peered":"2024-02-10T08:16:58.891261+0000","last_unstale":"2024-02-10T08:19:09.591584+0000","last_undegraded":"2024-02-10T08:19:09.591584+0000","last_fullsized":"2024-02-10T08:19:09.591584+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:56.053817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:56.053817+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.724989+0000","last_change":"2024-02-10T08:18:25.442160+0000","last_active":"2024-02-10T08:19:09.724989+0000","last_peered":"2024-02-10T08:19:09.724989+0000","last_clean":"2024-02-10T08:19:09.724989+0000","last_became_active":"2024-02-10T08:16:56.860674+0000","last_became_peered":"2024-02-10T08:16:56.860674+0000","last_unstale":"2024-02-10T08:19:09.724989+0000","last_undegraded":"2024-02-10T08:19:09.724989+0000","last_fullsized":"2024-02-10T08:19:09.724989+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:25.442097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:25.442097+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.723395+0000","last_change":"2024-02-10T08:17:56.774386+0000","last_active":"2024-02-10T08:19:09.723395+0000","last_peered":"2024-02-10T08:19:09.723395+0000","last_clean":"2024-02-10T08:19:09.723395+0000","last_became_active":"2024-02-10T08:16:52.786822+0000","last_became_peered":"2024-02-10T08:16:52.786822+0000","last_unstale":"2024-02-10T08:19:09.723395+0000","last_undegraded":"2024-02-10T08:19:09.723395+0000","last_fullsized":"2024-02-10T08:19:09.723395+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:17:56.774322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:17:56.774322+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"76'16","reported_seq":67,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.591697+0000","last_change":"2024-02-10T08:18:07.909854+0000","last_active":"2024-02-10T08:19:09.591697+0000","last_peered":"2024-02-10T08:19:09.591697+0000","last_clean":"2024-02-10T08:19:09.591697+0000","last_became_active":"2024-02-10T08:16:54.849465+0000","last_became_peered":"2024-02-10T08:16:54.849465+0000","last_unstale":"2024-02-10T08:19:09.591697+0000","last_undegraded":"2024-02-10T08:19:09.591697+0000","last_fullsized":"2024-02-10T08:19:09.591697+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'16","last_scrub_stamp":"2024-02-10T08:18:07.909782+0000","last_deep_scrub":"76'16","last_deep_scrub_stamp":"2024-02-10T08:18:07.909782+0000","last_clean_scrub_stamp":"2024-02-10T08:18:07.909782+0000","log_size":16,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":38,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.724251+0000","last_change":"2024-02-10T08:18:33.352565+0000","last_active":"2024-02-10T08:19:09.724251+0000","last_peered":"2024-02-10T08:19:09.724251+0000","last_clean":"2024-02-10T08:19:09.724251+0000","last_became_active":"2024-02-10T08:16:58.859956+0000","last_became_peered":"2024-02-10T08:16:58.859956+0000","last_unstale":"2024-02-10T08:19:09.724251+0000","last_undegraded":"2024-02-10T08:19:09.724251+0000","last_fullsized":"2024-02-10T08:19:09.724251+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:33.352450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:33.352450+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"62'8","reported_seq":78,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:15.925630+0000","last_change":"2024-02-10T08:18:28.991525+0000","last_active":"2024-02-10T08:19:15.925630+0000","last_peered":"2024-02-10T08:19:15.925630+0000","last_clean":"2024-02-10T08:19:15.925630+0000","last_became_active":"2024-02-10T08:16:56.862305+0000","last_became_peered":"2024-02-10T08:16:56.862305+0000","last_unstale":"2024-02-10T08:19:15.925630+0000","last_undegraded":"2024-02-10T08:19:15.925630+0000","last_fullsized":"2024-02-10T08:19:15.925630+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'8","last_scrub_stamp":"2024-02-10T08:18:28.991446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:28.991446+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.544537+0000","last_change":"2024-02-10T08:18:29.161304+0000","last_active":"2024-02-10T08:18:53.544537+0000","last_peered":"2024-02-10T08:18:53.544537+0000","last_clean":"2024-02-10T08:18:53.544537+0000","last_became_active":"2024-02-10T08:16:52.783634+0000","last_became_peered":"2024-02-10T08:16:52.783634+0000","last_unstale":"2024-02-10T08:18:53.544537+0000","last_undegraded":"2024-02-10T08:18:53.544537+0000","last_fullsized":"2024-02-10T08:18:53.544537+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:29.161170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:29.161170+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"62'15","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.723755+0000","last_change":"2024-02-10T08:18:19.720237+0000","last_active":"2024-02-10T08:19:09.723755+0000","last_peered":"2024-02-10T08:19:09.723755+0000","last_clean":"2024-02-10T08:19:09.723755+0000","last_became_active":"2024-02-10T08:18:18.163631+0000","last_became_peered":"2024-02-10T08:18:18.163631+0000","last_unstale":"2024-02-10T08:19:09.723755+0000","last_undegraded":"2024-02-10T08:19:09.723755+0000","last_fullsized":"2024-02-10T08:19:09.723755+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'15","last_scrub_stamp":"2024-02-10T08:18:19.720164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:19.720164+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.591502+0000","last_change":"2024-02-10T08:17:59.858063+0000","last_active":"2024-02-10T08:19:09.591502+0000","last_peered":"2024-02-10T08:19:09.591502+0000","last_clean":"2024-02-10T08:19:09.591502+0000","last_became_active":"2024-02-10T08:16:58.856794+0000","last_became_peered":"2024-02-10T08:16:58.856794+0000","last_unstale":"2024-02-10T08:19:09.591502+0000","last_undegraded":"2024-02-10T08:19:09.591502+0000","last_fullsized":"2024-02-10T08:19:09.591502+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:17:59.857977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:17:59.857977+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"62'8","reported_seq":78,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:15.925525+0000","last_change":"2024-02-10T08:18:00.800075+0000","last_active":"2024-02-10T08:19:15.925525+0000","last_peered":"2024-02-10T08:19:15.925525+0000","last_clean":"2024-02-10T08:19:15.925525+0000","last_became_active":"2024-02-10T08:16:56.858101+0000","last_became_peered":"2024-02-10T08:16:56.858101+0000","last_unstale":"2024-02-10T08:19:15.925525+0000","last_undegraded":"2024-02-10T08:19:15.925525+0000","last_fullsized":"2024-02-10T08:19:15.925525+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'8","last_scrub_stamp":"2024-02-10T08:18:00.799992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:00.799992+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.544837+0000","last_change":"2024-02-10T08:18:11.113062+0000","last_active":"2024-02-10T08:18:53.544837+0000","last_peered":"2024-02-10T08:18:53.544837+0000","last_clean":"2024-02-10T08:18:53.544837+0000","last_became_active":"2024-02-10T08:16:52.785545+0000","last_became_peered":"2024-02-10T08:16:52.785545+0000","last_unstale":"2024-02-10T08:18:53.544837+0000","last_undegraded":"2024-02-10T08:18:53.544837+0000","last_fullsized":"2024-02-10T08:18:53.544837+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:11.112885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:11.112885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"62'10","reported_seq":63,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:16.196954+0000","last_change":"2024-02-10T08:19:16.196922+0000","last_active":"2024-02-10T08:19:16.196954+0000","last_peered":"2024-02-10T08:19:16.196954+0000","last_clean":"2024-02-10T08:19:16.196954+0000","last_became_active":"2024-02-10T08:16:54.842930+0000","last_became_peered":"2024-02-10T08:16:54.842930+0000","last_unstale":"2024-02-10T08:19:16.196954+0000","last_undegraded":"2024-02-10T08:19:16.196954+0000","last_fullsized":"2024-02-10T08:19:16.196954+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'10","last_scrub_stamp":"2024-02-10T08:19:16.196834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:19:16.196834+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.723897+0000","last_change":"2024-02-10T08:18:17.709766+0000","last_active":"2024-02-10T08:19:09.723897+0000","last_peered":"2024-02-10T08:19:09.723897+0000","last_clean":"2024-02-10T08:19:09.723897+0000","last_became_active":"2024-02-10T08:16:58.868078+0000","last_became_peered":"2024-02-10T08:16:58.868078+0000","last_unstale":"2024-02-10T08:19:09.723897+0000","last_undegraded":"2024-02-10T08:19:09.723897+0000","last_fullsized":"2024-02-10T08:19:09.723897+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:17.709697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:17.709697+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.544220+0000","last_change":"2024-02-10T08:18:37.273604+0000","last_active":"2024-02-10T08:18:53.544220+0000","last_peered":"2024-02-10T08:18:53.544220+0000","last_clean":"2024-02-10T08:18:53.544220+0000","last_became_active":"2024-02-10T08:16:56.859770+0000","last_became_peered":"2024-02-10T08:16:56.859770+0000","last_unstale":"2024-02-10T08:18:53.544220+0000","last_undegraded":"2024-02-10T08:18:53.544220+0000","last_fullsized":"2024-02-10T08:18:53.544220+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:37.273476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:37.273476+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.723131+0000","last_change":"2024-02-10T08:18:00.739337+0000","last_active":"2024-02-10T08:19:09.723131+0000","last_peered":"2024-02-10T08:19:09.723131+0000","last_clean":"2024-02-10T08:19:09.723131+0000","last_became_active":"2024-02-10T08:16:52.782395+0000","last_became_peered":"2024-02-10T08:16:52.782395+0000","last_unstale":"2024-02-10T08:19:09.723131+0000","last_undegraded":"2024-02-10T08:19:09.723131+0000","last_fullsized":"2024-02-10T08:19:09.723131+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:00.739233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:00.739233+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"62'17","reported_seq":98,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.591616+0000","last_change":"2024-02-10T08:18:18.892421+0000","last_active":"2024-02-10T08:19:09.591616+0000","last_peered":"2024-02-10T08:19:09.591616+0000","last_clean":"2024-02-10T08:19:09.591616+0000","last_became_active":"2024-02-10T08:18:18.203596+0000","last_became_peered":"2024-02-10T08:18:18.203596+0000","last_unstale":"2024-02-10T08:19:09.591616+0000","last_undegraded":"2024-02-10T08:19:09.591616+0000","last_fullsized":"2024-02-10T08:19:09.591616+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'17","last_scrub_stamp":"2024-02-10T08:18:02.936554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:02.936554+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":38,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.723119+0000","last_change":"2024-02-10T08:18:07.741720+0000","last_active":"2024-02-10T08:19:09.723119+0000","last_peered":"2024-02-10T08:19:09.723119+0000","last_clean":"2024-02-10T08:19:09.723119+0000","last_became_active":"2024-02-10T08:16:58.866831+0000","last_became_peered":"2024-02-10T08:16:58.866831+0000","last_unstale":"2024-02-10T08:19:09.723119+0000","last_undegraded":"2024-02-10T08:19:09.723119+0000","last_fullsized":"2024-02-10T08:19:09.723119+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:07.741643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:07.741643+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.723630+0000","last_change":"2024-02-10T08:18:20.695868+0000","last_active":"2024-02-10T08:19:09.723630+0000","last_peered":"2024-02-10T08:19:09.723630+0000","last_clean":"2024-02-10T08:19:09.723630+0000","last_became_active":"2024-02-10T08:16:56.864026+0000","last_became_peered":"2024-02-10T08:16:56.864026+0000","last_unstale":"2024-02-10T08:19:09.723630+0000","last_undegraded":"2024-02-10T08:19:09.723630+0000","last_fullsized":"2024-02-10T08:19:09.723630+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:20.695800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:20.695800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":50,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.892438+0000","last_change":"2024-02-10T08:19:09.892412+0000","last_active":"2024-02-10T08:19:09.892438+0000","last_peered":"2024-02-10T08:19:09.892438+0000","last_clean":"2024-02-10T08:19:09.892438+0000","last_became_active":"2024-02-10T08:16:52.789100+0000","last_became_peered":"2024-02-10T08:16:52.789100+0000","last_unstale":"2024-02-10T08:19:09.892438+0000","last_undegraded":"2024-02-10T08:19:09.892438+0000","last_fullsized":"2024-02-10T08:19:09.892438+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:09.892334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:19:09.892334+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"62'19","reported_seq":73,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.725460+0000","last_change":"2024-02-10T08:18:16.290699+0000","last_active":"2024-02-10T08:19:09.725460+0000","last_peered":"2024-02-10T08:19:09.725460+0000","last_clean":"2024-02-10T08:19:09.725460+0000","last_became_active":"2024-02-10T08:16:55.203415+0000","last_became_peered":"2024-02-10T08:16:55.203415+0000","last_unstale":"2024-02-10T08:19:09.725460+0000","last_undegraded":"2024-02-10T08:19:09.725460+0000","last_fullsized":"2024-02-10T08:19:09.725460+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'19","last_scrub_stamp":"2024-02-10T08:18:16.290612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:16.290612+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"76'2","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.805530+0000","last_change":"2024-02-10T08:18:08.680107+0000","last_active":"2024-02-10T08:18:53.805530+0000","last_peered":"2024-02-10T08:18:53.805530+0000","last_clean":"2024-02-10T08:18:53.805530+0000","last_became_active":"2024-02-10T08:16:58.860294+0000","last_became_peered":"2024-02-10T08:16:58.860294+0000","last_unstale":"2024-02-10T08:18:53.805530+0000","last_undegraded":"2024-02-10T08:18:53.805530+0000","last_fullsized":"2024-02-10T08:18:53.805530+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'2","last_scrub_stamp":"2024-02-10T08:18:08.680038+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2024-02-10T08:18:08.680038+0000","last_clean_scrub_stamp":"2024-02-10T08:18:08.680038+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.723404+0000","last_change":"2024-02-10T08:18:27.611164+0000","last_active":"2024-02-10T08:19:09.723404+0000","last_peered":"2024-02-10T08:19:09.723404+0000","last_clean":"2024-02-10T08:19:09.723404+0000","last_became_active":"2024-02-10T08:16:56.855513+0000","last_became_peered":"2024-02-10T08:16:56.855513+0000","last_unstale":"2024-02-10T08:19:09.723404+0000","last_undegraded":"2024-02-10T08:19:09.723404+0000","last_fullsized":"2024-02-10T08:19:09.723404+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:27.611094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:27.611094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.544017+0000","last_change":"2024-02-10T08:18:06.015064+0000","last_active":"2024-02-10T08:18:53.544017+0000","last_peered":"2024-02-10T08:18:53.544017+0000","last_clean":"2024-02-10T08:18:53.544017+0000","last_became_active":"2024-02-10T08:16:52.783675+0000","last_became_peered":"2024-02-10T08:16:52.783675+0000","last_unstale":"2024-02-10T08:18:53.544017+0000","last_undegraded":"2024-02-10T08:18:53.544017+0000","last_fullsized":"2024-02-10T08:18:53.544017+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:06.014988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:06.014988+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"62'9","reported_seq":57,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-02-10T08:18:53.806285+0000","last_change":"2024-02-10T08:18:14.705343+0000","last_active":"2024-02-10T08:18:53.806285+0000","last_peered":"2024-02-10T08:18:53.806285+0000","last_clean":"2024-02-10T08:18:53.806285+0000","last_became_active":"2024-02-10T08:16:54.852935+0000","last_became_peered":"2024-02-10T08:16:54.852935+0000","last_unstale":"2024-02-10T08:18:53.806285+0000","last_undegraded":"2024-02-10T08:18:53.806285+0000","last_fullsized":"2024-02-10T08:18:53.806285+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'9","last_scrub_stamp":"2024-02-10T08:18:14.705229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:14.705229+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":38,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.722994+0000","last_change":"2024-02-10T08:18:08.322927+0000","last_active":"2024-02-10T08:19:09.722994+0000","last_peered":"2024-02-10T08:19:09.722994+0000","last_clean":"2024-02-10T08:19:09.722994+0000","last_became_active":"2024-02-10T08:16:58.891260+0000","last_became_peered":"2024-02-10T08:16:58.891260+0000","last_unstale":"2024-02-10T08:19:09.722994+0000","last_undegraded":"2024-02-10T08:19:09.722994+0000","last_fullsized":"2024-02-10T08:19:09.722994+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:08.322832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:08.322832+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":50,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.724149+0000","last_change":"2024-02-10T08:19:05.814587+0000","last_active":"2024-02-10T08:19:09.724149+0000","last_peered":"2024-02-10T08:19:09.724149+0000","last_clean":"2024-02-10T08:19:09.724149+0000","last_became_active":"2024-02-10T08:16:52.785754+0000","last_became_peered":"2024-02-10T08:16:52.785754+0000","last_unstale":"2024-02-10T08:19:09.724149+0000","last_undegraded":"2024-02-10T08:19:09.724149+0000","last_fullsized":"2024-02-10T08:19:09.724149+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:05.814500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:19:05.814500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"62'15","reported_seq":67,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:09.722905+0000","last_change":"2024-02-10T08:18:47.352251+0000","last_active":"2024-02-10T08:19:09.722905+0000","last_peered":"2024-02-10T08:19:09.722905+0000","last_clean":"2024-02-10T08:19:09.722905+0000","last_became_active":"2024-02-10T08:16:55.204597+0000","last_became_peered":"2024-02-10T08:16:55.204597+0000","last_unstale":"2024-02-10T08:19:09.722905+0000","last_undegraded":"2024-02-10T08:19:09.722905+0000","last_fullsized":"2024-02-10T08:19:09.722905+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'15","last_scrub_stamp":"2024-02-10T08:18:47.352151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:47.352151+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"62'8","reported_seq":77,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-10T08:19:15.925608+0000","last_change":"2024-02-10T08:18:29.053030+0000","last_active":"2024-02-10T08:19:15.925608+0000","last_peered":"2024-02-10T08:19:15.925608+0000","last_clean":"2024-02-10T08:19:15.925608+0000","last_became_active":"2024-02-10T08:16:56.860308+0000","last_became_peered":"2024-02-10T08:16:56.860308+0000","last_unstale":"2024-02-10T08:19:15.925608+0000","last_undegraded":"2024-02-10T08:19:15.925608+0000","last_fullsized":"2024-02-10T08:19:15.925608+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'8","last_scrub_stamp":"2024-02-10T08:18:29.052907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:29.052907+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":65,"ondisk_log_size":65,"up":96,"acting":96,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":698,"num_read_kb":455,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":411,"ondisk_log_size":411,"up":96,"acting":96,"num_store_stats":8},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":137,"num_read_kb":132,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":9,"acting":9,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":50,"seq":214748364833,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297740,"kb_used_data":644,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447412,"statfs":{"total":95995035648,"available":95690149888,"internally_reserved":0,"allocated":659456,"data_stored":303000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:18:45 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.48999999999999999,"15min":0.49199999999999999},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.497,"5min":0.48999999999999999,"15min":0.48899999999999999},"min":{"1min":0.36699999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.78200000000000003}]},{"osd":1,"last update":"Sat Feb 10 08:18:45 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.502,"15min":0.505},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.68000000000000005,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.50700000000000001,"15min":0.51500000000000001},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.61899999999999999,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.66100000000000003}]},{"osd":2,"last update":"Sat Feb 10 08:18:45 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.66400000000000003,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.52400000000000002,"15min":0.52700000000000002},"min":{"1min":0.38200000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.71799999999999997}]},{"osd":3,"last update":"Sat Feb 10 08:18:45 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.51300000000000001,"15min":0.51700000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.621,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.503,"5min":0.51600000000000001,"15min":0.51800000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.80600000000000005}]},{"osd":4,"last update":"Sat Feb 10 08:18:45 2024","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.40300000000000002,"15min":0.40100000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.56599999999999995,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.433,"15min":0.42999999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.58999999999999997,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.625}]},{"osd":5,"last update":"Sat Feb 10 08:18:45 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.42199999999999999,"15min":0.41499999999999998},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.46000000000000002,"15min":0.45800000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.65800000000000003,"5min":0.753,"15min":0.753},"last":0.73999999999999999}]},{"osd":6,"last update":"Sat Feb 10 08:18:45 2024","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.45300000000000001,"15min":0.443},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.47499999999999998,"15min":0.46899999999999997},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.79900000000000004}]}]},{"osd":6,"up_from":43,"seq":184683593766,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297736,"kb_used_data":640,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447416,"statfs":{"total":95995035648,"available":95690153984,"internally_reserved":0,"allocated":655360,"data_stored":309374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:18:23 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.53800000000000003,"15min":0.54000000000000004},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.55300000000000005,"15min":0.55500000000000005},"min":{"1min":0.39300000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.78400000000000003,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.65200000000000002}]},{"osd":1,"last update":"Sat Feb 10 08:18:23 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.54700000000000004,"15min":0.55100000000000005},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.496,"5min":0.55700000000000005,"15min":0.56699999999999995},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.76400000000000001,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.41499999999999998}]},{"osd":2,"last update":"Sat Feb 10 08:18:23 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.57299999999999995,"15min":0.57899999999999996},"min":{"1min":0.40999999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.57699999999999996,"15min":0.57999999999999996},"min":{"1min":0.39900000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.73099999999999998}]},{"osd":3,"last update":"Sat Feb 10 08:18:23 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.56299999999999994,"15min":0.56599999999999995},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.86199999999999999,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.55600000000000005,"15min":0.55800000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.54700000000000004}]},{"osd":4,"last update":"Sat Feb 10 08:18:23 2024","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.27900000000000003,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.73399999999999999,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.751},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.46200000000000002,"15min":0.46300000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.69599999999999995,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.71899999999999997}]},{"osd":5,"last update":"Sat Feb 10 08:18:23 2024","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.45600000000000002,"15min":0.45200000000000001},"min":{"1min":0.31,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.70999999999999996,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.45700000000000002,"15min":0.45300000000000001},"min":{"1min":0.317,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.86799999999999999}]},{"osd":7,"last update":"Sat Feb 10 08:18:52 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.375,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.69899999999999995,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.57899999999999996,"15min":0.57599999999999996},"min":{"1min":0.41699999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.67200000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574909,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297756,"kb_used_data":660,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447396,"statfs":{"total":95995035648,"available":95690133504,"internally_reserved":0,"allocated":675840,"data_stored":302789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:18:23 2024","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.35699999999999998,"15min":0.318},"min":{"1min":0.23999999999999999,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.60499999999999998,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.373,"15min":0.33200000000000002},"min":{"1min":0.24099999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.64900000000000002,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.46000000000000002}]},{"osd":2,"last update":"Sat Feb 10 08:18:54 2024","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.38600000000000001,"15min":0.36599999999999999},"min":{"1min":0.26400000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.55300000000000005,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.38900000000000001,"15min":0.371},"min":{"1min":0.252,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.58399999999999996,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.48199999999999998}]},{"osd":3,"last update":"Sat Feb 10 08:19:14 2024","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.44700000000000001,"15min":0.45700000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.56899999999999995,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.377,"5min":0.42499999999999999,"15min":0.435},"min":{"1min":0.29099999999999998,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.55600000000000005,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.55600000000000005}]},{"osd":4,"last update":"Sat Feb 10 08:18:37 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.58599999999999997,"15min":0.59099999999999997},"min":{"1min":0.39200000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.83899999999999997,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.57199999999999995,"15min":0.58199999999999996},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.85099999999999998,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.65400000000000003}]},{"osd":5,"last update":"Sat Feb 10 08:18:59 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.57199999999999995,"15min":0.57399999999999995},"min":{"1min":0.39700000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.82399999999999995,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.60699999999999998,"15min":0.61299999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.90100000000000002,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.64100000000000001}]},{"osd":6,"last update":"Sat Feb 10 08:18:23 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.61299999999999999,"15min":0.61599999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.68500000000000005}]},{"osd":7,"last update":"Sat Feb 10 08:18:49 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.57099999999999995,"15min":0.56499999999999995},"min":{"1min":0.42799999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.63,"5min":0.59499999999999997,"15min":0.58899999999999997},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.70499999999999996}]}]},{"osd":0,"up_from":8,"seq":34359738434,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297748,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447404,"statfs":{"total":95995035648,"available":95690141696,"internally_reserved":0,"allocated":667648,"data_stored":303320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 10 08:18:23 2024","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35399999999999998,"15min":0.33500000000000002},"min":{"1min":0.217,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.52400000000000002,"5min":0.54400000000000004,"15min":0.54400000000000004},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.374,"5min":0.36599999999999999,"15min":0.33600000000000002},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.52600000000000002}]},{"osd":2,"last update":"Sat Feb 10 08:18:50 2024","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.253,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.42299999999999999,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.375,"5min":0.39800000000000002,"15min":0.39200000000000002},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.47499999999999998,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.55600000000000005}]},{"osd":3,"last update":"Sat Feb 10 08:19:14 2024","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.42199999999999999,"15min":0.438},"min":{"1min":0.316,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.432,"15min":0.44500000000000001},"min":{"1min":0.29899999999999999,"5min":0.246,"15min":0.246},"max":{"1min":0.52900000000000003,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.42299999999999999}]},{"osd":4,"last update":"Sat Feb 10 08:18:35 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.59399999999999997,"15min":0.59199999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.59399999999999997,"15min":0.60399999999999998},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.877}]},{"osd":5,"last update":"Sat Feb 10 08:19:03 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.58299999999999996,"15min":0.59199999999999997},"min":{"1min":0.36899999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.70499999999999996,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.57599999999999996,"15min":0.58099999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.77200000000000002,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.67900000000000005}]},{"osd":6,"last update":"Sat Feb 10 08:18:23 2024","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.64100000000000001,"15min":0.64700000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.81699999999999995}]},{"osd":7,"last update":"Sat Feb 10 08:18:47 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59799999999999998,"15min":0.59899999999999998},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.80800000000000005,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.80200000000000005,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.70899999999999996}]}]},{"osd":2,"up_from":18,"seq":77309411385,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297744,"kb_used_data":648,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447408,"statfs":{"total":95995035648,"available":95690145792,"internally_reserved":0,"allocated":663552,"data_stored":308910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:18:48 2024","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.35799999999999998,"15min":0.34899999999999998},"min":{"1min":0.255,"5min":0.224,"15min":0.224},"max":{"1min":0.49399999999999999,"5min":0.628,"15min":0.628},"last":0.379},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38,"15min":0.36599999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.75,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.42399999999999999}]},{"osd":1,"last update":"Sat Feb 10 08:18:48 2024","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.375,"15min":0.36799999999999999},"min":{"1min":0.27100000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.51100000000000001,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.39500000000000002,"15min":0.38200000000000001},"min":{"1min":0.26000000000000001,"5min":0.25,"15min":0.25},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.45600000000000002}]},{"osd":3,"last update":"Sat Feb 10 08:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.44700000000000001,"15min":0.45600000000000002},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.60499999999999998,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.437,"15min":0.44700000000000001},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.59799999999999998,"5min":0.749,"15min":0.749},"last":0.48399999999999999}]},{"osd":4,"last update":"Sat Feb 10 08:18:35 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.58499999999999996,"15min":0.58099999999999996},"min":{"1min":0.496,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.86299999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.57399999999999995,"15min":0.57699999999999996},"min":{"1min":0.39800000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.50600000000000001}]},{"osd":5,"last update":"Sat Feb 10 08:19:04 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56599999999999995,"15min":0.56999999999999995},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.81399999999999995,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.56999999999999995,"15min":0.56799999999999995},"min":{"1min":0.46400000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.72599999999999998}]},{"osd":6,"last update":"Sat Feb 10 08:18:22 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.58099999999999996,"15min":0.58499999999999996},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.71699999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.60099999999999998,"15min":0.60699999999999998},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.73599999999999999,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.75800000000000001}]},{"osd":7,"last update":"Sat Feb 10 08:18:48 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.60399999999999998,"15min":0.60799999999999998},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.80800000000000005,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.85399999999999998,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.623}]}]},{"osd":3,"up_from":25,"seq":107374182452,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297764,"kb_used_data":668,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447388,"statfs":{"total":95995035648,"available":95690125312,"internally_reserved":0,"allocated":684032,"data_stored":308976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:19:14 2024","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.38100000000000001,"15min":0.371},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.434,"5min":0.755,"15min":0.755},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.40600000000000003,"15min":0.41699999999999998},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.44600000000000001,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.314}]},{"osd":1,"last update":"Sat Feb 10 08:19:14 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.42099999999999999,"15min":0.437},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.48299999999999998,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.434,"15min":0.45600000000000002},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.54900000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.439}]},{"osd":2,"last update":"Sat Feb 10 08:19:14 2024","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.438,"15min":0.45100000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.499,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.44500000000000001,"15min":0.45000000000000001},"min":{"1min":0.27300000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.48099999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.46000000000000002}]},{"osd":4,"last update":"Sat Feb 10 08:18:36 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54700000000000004,"15min":0.54500000000000004},"min":{"1min":0.38800000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.432},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.56899999999999995,"15min":0.57299999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.83099999999999996,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.48899999999999999}]},{"osd":5,"last update":"Sat Feb 10 08:19:03 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.58799999999999997,"15min":0.59599999999999997},"min":{"1min":0.41099999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.65400000000000003,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.59199999999999997,"15min":0.59799999999999998},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.73899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.53100000000000003}]},{"osd":6,"last update":"Sat Feb 10 08:18:23 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.57299999999999995,"15min":0.57099999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.58699999999999997,"15min":0.58299999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.57199999999999995}]},{"osd":7,"last update":"Sat Feb 10 08:18:46 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.57899999999999996,"15min":0.57699999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.57399999999999995,"15min":0.56999999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.55100000000000005}]}]},{"osd":4,"up_from":30,"seq":128849018926,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297752,"kb_used_data":656,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447400,"statfs":{"total":95995035648,"available":95690137600,"internally_reserved":0,"allocated":671744,"data_stored":308644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:18:34 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.51300000000000001,"15min":0.52400000000000002},"min":{"1min":0.26100000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.65600000000000003,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.503,"5min":0.52200000000000002,"15min":0.53000000000000003},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.64500000000000002,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.48699999999999999}]},{"osd":1,"last update":"Sat Feb 10 08:18:34 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.50900000000000001,"15min":0.52400000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.629,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.434},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.503,"15min":0.51600000000000001},"min":{"1min":0.35199999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.56000000000000005,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.42299999999999999}]},{"osd":2,"last update":"Sat Feb 10 08:18:34 2024","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.499,"15min":0.505},"min":{"1min":0.32300000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.61699999999999999,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.52900000000000003,"15min":0.53900000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.61199999999999999,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.45000000000000001}]},{"osd":3,"last update":"Sat Feb 10 08:18:34 2024","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.52700000000000002,"15min":0.53700000000000003},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.66900000000000004,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.497,"5min":0.52200000000000002,"15min":0.53100000000000003},"min":{"1min":0.39500000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.67800000000000005,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.38600000000000001}]},{"osd":5,"last update":"Sat Feb 10 08:19:00 2024","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.38600000000000001,"15min":0.372},"min":{"1min":0.27100000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.627,"5min":0.627,"15min":0.627},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.39400000000000002,"15min":0.377},"min":{"1min":0.28999999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.40400000000000003}]},{"osd":6,"last update":"Sat Feb 10 08:18:20 2024","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"min":{"1min":0.30199999999999999,"5min":0.248,"15min":0.248},"max":{"1min":0.64800000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.504},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.46600000000000003,"15min":0.46400000000000002},"min":{"1min":0.32000000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.59799999999999998}]},{"osd":7,"last update":"Sat Feb 10 08:18:46 2024","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.33300000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.45200000000000001,"15min":0.45000000000000001},"min":{"1min":0.313,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.53500000000000003}]}]},{"osd":5,"up_from":37,"seq":158913789995,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297724,"kb_used_data":628,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447428,"statfs":{"total":95995035648,"available":95690166272,"internally_reserved":0,"allocated":643072,"data_stored":302133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:18:57 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.56399999999999995,"15min":0.58399999999999996},"min":{"1min":0.38400000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.70099999999999996,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.502,"5min":0.51200000000000001,"15min":0.52100000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.72399999999999998,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.55500000000000005}]},{"osd":1,"last update":"Sat Feb 10 08:18:57 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.54300000000000004,"15min":0.56000000000000005},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.496},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.52700000000000002,"15min":0.54600000000000004},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.68200000000000005,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.59699999999999998}]},{"osd":2,"last update":"Sat Feb 10 08:18:57 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.55200000000000005,"15min":0.56999999999999995},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.70899999999999996,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.56699999999999995,"15min":0.59099999999999997},"min":{"1min":0.40500000000000003,"5min":0.372,"15min":0.372},"max":{"1min":0.70299999999999996,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.57499999999999996}]},{"osd":3,"last update":"Sat Feb 10 08:18:57 2024","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.56200000000000006,"15min":0.58499999999999996},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.66700000000000004,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.378,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.66000000000000003,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":0.63700000000000001}]},{"osd":4,"last update":"Sat Feb 10 08:18:57 2024","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.371,"15min":0.36099999999999999},"min":{"1min":0.26400000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.65400000000000003,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.433,"5min":0.38300000000000001,"15min":0.36899999999999999},"min":{"1min":0.30399999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.68700000000000006,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.53000000000000003}]},{"osd":6,"last update":"Sat Feb 10 08:18:24 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.38500000000000001,"15min":0.375},"min":{"1min":0.33300000000000002,"5min":0.254,"15min":0.254},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.63},{"interface":"front","average":{"1min":0.5,"5min":0.436,"15min":0.42499999999999999},"min":{"1min":0.34999999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.68100000000000005}]},{"osd":7,"last update":"Sat Feb 10 08:18:49 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.439,"15min":0.436},"min":{"1min":0.318,"5min":0.31,"15min":0.31},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.432,"15min":0.42499999999999999},"min":{"1min":0.29099999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.60599999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":2008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-10T08:19:20.264 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-02-10T08:19:20.264 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd dump 2024-02-10T08:19:20.553 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:19:21.037 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:19.290591+0000 osd.7 (osd.7) 45 : cluster [DBG] 5.1a scrub starts 2024-02-10T08:19:21.037 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:19.291491+0000 osd.7 (osd.7) 46 : cluster [DBG] 5.1a scrub ok 2024-02-10T08:19:21.037 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:19:19.386375+0000 mgr.y (mgr.14505) 101 : audit [DBG] from='client.24629 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-10T08:19:21.037 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:19.408605+0000 osd.6 (osd.6) 31 : cluster [DBG] 2.14 scrub starts 2024-02-10T08:19:21.037 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:19.411508+0000 osd.6 (osd.6) 32 : cluster [DBG] 2.14 scrub ok 2024-02-10T08:19:21.037 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:19.764301+0000 mon.a (mon.0) 748 : cluster [DBG] osdmap e87: 8 total, 8 up, 8 in 2024-02-10T08:19:21.038 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:19.290591+0000 osd.7 (osd.7) 45 : cluster [DBG] 5.1a scrub starts 2024-02-10T08:19:21.038 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:19.291491+0000 osd.7 (osd.7) 46 : cluster [DBG] 5.1a scrub ok 2024-02-10T08:19:21.038 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:19:19.386375+0000 mgr.y (mgr.14505) 101 : audit [DBG] from='client.24629 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-10T08:19:21.038 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:19.408605+0000 osd.6 (osd.6) 31 : cluster [DBG] 2.14 scrub starts 2024-02-10T08:19:21.038 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:19.411508+0000 osd.6 (osd.6) 32 : cluster [DBG] 2.14 scrub ok 2024-02-10T08:19:21.038 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:19.764301+0000 mon.a (mon.0) 748 : cluster [DBG] osdmap e87: 8 total, 8 up, 8 in 2024-02-10T08:19:21.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:19.290591+0000 osd.7 (osd.7) 45 : cluster [DBG] 5.1a scrub starts 2024-02-10T08:19:21.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:19.291491+0000 osd.7 (osd.7) 46 : cluster [DBG] 5.1a scrub ok 2024-02-10T08:19:21.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:19:19.386375+0000 mgr.y (mgr.14505) 101 : audit [DBG] from='client.24629 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-10T08:19:21.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:19.408605+0000 osd.6 (osd.6) 31 : cluster [DBG] 2.14 scrub starts 2024-02-10T08:19:21.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:19.411508+0000 osd.6 (osd.6) 32 : cluster [DBG] 2.14 scrub ok 2024-02-10T08:19:21.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:19.764301+0000 mon.a (mon.0) 748 : cluster [DBG] osdmap e87: 8 total, 8 up, 8 in 2024-02-10T08:19:21.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:20.389359+0000 osd.5 (osd.5) 43 : cluster [DBG] 6.a deep-scrub starts 2024-02-10T08:19:21.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:20.392245+0000 osd.5 (osd.5) 44 : cluster [DBG] 6.a deep-scrub ok 2024-02-10T08:19:21.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:20.476799+0000 mgr.y (mgr.14505) 102 : cluster [DBG] pgmap v88: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-10T08:19:21.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:20.812017+0000 osd.2 (osd.2) 43 : cluster [DBG] 4.1c scrub starts 2024-02-10T08:19:21.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:20.813901+0000 osd.2 (osd.2) 44 : cluster [DBG] 4.1c scrub ok 2024-02-10T08:19:21.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:20.389359+0000 osd.5 (osd.5) 43 : cluster [DBG] 6.a deep-scrub starts 2024-02-10T08:19:21.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:20.392245+0000 osd.5 (osd.5) 44 : cluster [DBG] 6.a deep-scrub ok 2024-02-10T08:19:21.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:20.476799+0000 mgr.y (mgr.14505) 102 : cluster [DBG] pgmap v88: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-10T08:19:21.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:20.812017+0000 osd.2 (osd.2) 43 : cluster [DBG] 4.1c scrub starts 2024-02-10T08:19:21.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:20.813901+0000 osd.2 (osd.2) 44 : cluster [DBG] 4.1c scrub ok 2024-02-10T08:19:22.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:20.389359+0000 osd.5 (osd.5) 43 : cluster [DBG] 6.a deep-scrub starts 2024-02-10T08:19:22.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:20.392245+0000 osd.5 (osd.5) 44 : cluster [DBG] 6.a deep-scrub ok 2024-02-10T08:19:22.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:20.476799+0000 mgr.y (mgr.14505) 102 : cluster [DBG] pgmap v88: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-10T08:19:22.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:20.812017+0000 osd.2 (osd.2) 43 : cluster [DBG] 4.1c scrub starts 2024-02-10T08:19:22.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:20.813901+0000 osd.2 (osd.2) 44 : cluster [DBG] 4.1c scrub ok 2024-02-10T08:19:22.725 INFO:teuthology.orchestra.run.smithi018.stdout:epoch 87 2024-02-10T08:19:22.725 INFO:teuthology.orchestra.run.smithi018.stdout:fsid d46257c8-c7eb-11ee-95b8-87774f69a715 2024-02-10T08:19:22.726 INFO:teuthology.orchestra.run.smithi018.stdout:created 2024-02-10T08:10:57.425061+0000 2024-02-10T08:19:22.726 INFO:teuthology.orchestra.run.smithi018.stdout:modified 2024-02-10T08:19:19.759708+0000 2024-02-10T08:19:22.726 INFO:teuthology.orchestra.run.smithi018.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-02-10T08:19:22.726 INFO:teuthology.orchestra.run.smithi018.stdout:crush_version 18 2024-02-10T08:19:22.726 INFO:teuthology.orchestra.run.smithi018.stdout:full_ratio 0.95 2024-02-10T08:19:22.726 INFO:teuthology.orchestra.run.smithi018.stdout:backfillfull_ratio 0.9 2024-02-10T08:19:22.726 INFO:teuthology.orchestra.run.smithi018.stdout:nearfull_ratio 0.85 2024-02-10T08:19:22.726 INFO:teuthology.orchestra.run.smithi018.stdout:require_min_compat_client luminous 2024-02-10T08:19:22.726 INFO:teuthology.orchestra.run.smithi018.stdout:min_compat_client luminous 2024-02-10T08:19:22.726 INFO:teuthology.orchestra.run.smithi018.stdout:require_osd_release pacific 2024-02-10T08:19:22.726 INFO:teuthology.orchestra.run.smithi018.stdout:stretch_mode_enabled false 2024-02-10T08:19:22.726 INFO:teuthology.orchestra.run.smithi018.stdout:pool 1 'device_health_metrics' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 66 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr_devicehealth 2024-02-10T08:19:22.726 INFO:teuthology.orchestra.run.smithi018.stdout:pool 2 '.rgw.root' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 56 flags hashpspool stripe_width 0 application rgw 2024-02-10T08:19:22.726 INFO:teuthology.orchestra.run.smithi018.stdout:pool 3 'iscsi' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 3 pgp_num 3 autoscale_mode off last_change 57 flags hashpspool stripe_width 0 application rbd 2024-02-10T08:19:22.727 INFO:teuthology.orchestra.run.smithi018.stdout:pool 4 'default.rgw.log' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 58 flags hashpspool stripe_width 0 application rgw 2024-02-10T08:19:22.727 INFO:teuthology.orchestra.run.smithi018.stdout:pool 5 'default.rgw.control' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 60 flags hashpspool stripe_width 0 application rgw 2024-02-10T08:19:22.727 INFO:teuthology.orchestra.run.smithi018.stdout:pool 6 'default.rgw.meta' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 62 flags hashpspool stripe_width 0 pg_autoscale_bias 4 application rgw 2024-02-10T08:19:22.727 INFO:teuthology.orchestra.run.smithi018.stdout:max_osd 8 2024-02-10T08:19:22.727 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0 up in weight 1 up_from 8 up_thru 60 down_at 0 last_clean_interval [0,0) v2:172.21.15.18:6801/276034406 v2:172.21.15.18:6802/276034406 exists,up f9043fee-a3ed-4e16-921d-bb86756d0c48 2024-02-10T08:19:22.727 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1 up in weight 1 up_from 13 up_thru 60 down_at 0 last_clean_interval [0,0) v2:172.21.15.18:6805/1941014296 v2:172.21.15.18:6806/1941014296 exists,up ff958272-ce6b-4162-959a-6da9729e537b 2024-02-10T08:19:22.727 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2 up in weight 1 up_from 18 up_thru 81 down_at 0 last_clean_interval [0,0) v2:172.21.15.18:6809/3122474567 v2:172.21.15.18:6810/3122474567 exists,up 29bb47e2-5c81-4ae8-bb9f-d1b02ea01d3f 2024-02-10T08:19:22.727 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3 up in weight 1 up_from 25 up_thru 60 down_at 0 last_clean_interval [0,0) v2:172.21.15.18:6813/3484706437 v2:172.21.15.18:6814/3484706437 exists,up 87ad37de-5f49-4e5b-9683-3bb9c3e33907 2024-02-10T08:19:22.727 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4 up in weight 1 up_from 30 up_thru 81 down_at 0 last_clean_interval [0,0) v2:172.21.15.71:6800/1598114798 v2:172.21.15.71:6801/1598114798 exists,up f5708f20-f98d-4d12-b8ae-71a5049a14cc 2024-02-10T08:19:22.727 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5 up in weight 1 up_from 37 up_thru 60 down_at 0 last_clean_interval [0,0) v2:172.21.15.71:6804/1932648316 v2:172.21.15.71:6805/1932648316 exists,up e36a71dd-5088-4bff-965e-7dc8708ef7e3 2024-02-10T08:19:22.727 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6 up in weight 1 up_from 43 up_thru 58 down_at 0 last_clean_interval [0,0) v2:172.21.15.71:6808/3724399458 v2:172.21.15.71:6809/3724399458 exists,up 210a8790-78b6-4efa-a969-17efb17e9c0b 2024-02-10T08:19:22.727 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7 up in weight 1 up_from 50 up_thru 60 down_at 0 last_clean_interval [0,0) v2:172.21.15.71:6812/163573852 v2:172.21.15.71:6813/163573852 exists,up 9778a0e9-2ff3-4700-bf2a-675edaba630b 2024-02-10T08:19:22.727 INFO:teuthology.orchestra.run.smithi018.stdout:pg_upmap_items 2.5 [7,2] 2024-02-10T08:19:22.728 INFO:teuthology.orchestra.run.smithi018.stdout:pg_upmap_items 4.d [1,5] 2024-02-10T08:19:22.728 INFO:teuthology.orchestra.run.smithi018.stdout:pg_upmap_items 4.f [1,2] 2024-02-10T08:19:22.728 INFO:teuthology.orchestra.run.smithi018.stdout:pg_upmap_items 4.13 [1,2] 2024-02-10T08:19:22.728 INFO:teuthology.orchestra.run.smithi018.stdout:blocklist 172.21.15.18:6800/542054629 expires 2024-02-11T08:17:16.433947+0000 2024-02-10T08:19:22.728 INFO:teuthology.orchestra.run.smithi018.stdout:blocklist 172.21.15.18:0/491217791 expires 2024-02-11T08:17:16.433947+0000 2024-02-10T08:19:22.728 INFO:teuthology.orchestra.run.smithi018.stdout:blocklist 172.21.15.18:0/781076548 expires 2024-02-11T08:17:16.433947+0000 2024-02-10T08:19:22.728 INFO:teuthology.orchestra.run.smithi018.stdout:blocklist 172.21.15.18:0/957318754 expires 2024-02-11T08:17:16.433947+0000 2024-02-10T08:19:22.728 INFO:teuthology.orchestra.run.smithi018.stdout:blocklist 172.21.15.18:0/2662732452 expires 2024-02-11T08:11:55.105124+0000 2024-02-10T08:19:22.728 INFO:teuthology.orchestra.run.smithi018.stdout:blocklist 172.21.15.18:0/1407788916 expires 2024-02-11T08:11:55.105124+0000 2024-02-10T08:19:22.728 INFO:teuthology.orchestra.run.smithi018.stdout:blocklist 172.21.15.18:6800/3798687064 expires 2024-02-11T08:11:55.105124+0000 2024-02-10T08:19:22.728 INFO:teuthology.orchestra.run.smithi018.stdout:blocklist 172.21.15.18:6800/3570839557 expires 2024-02-11T08:11:31.445897+0000 2024-02-10T08:19:22.728 INFO:teuthology.orchestra.run.smithi018.stdout:blocklist 172.21.15.18:0/541168116 expires 2024-02-11T08:11:31.445897+0000 2024-02-10T08:19:22.728 INFO:teuthology.orchestra.run.smithi018.stdout:blocklist 172.21.15.18:0/806236095 expires 2024-02-11T08:11:31.445897+0000 2024-02-10T08:19:23.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:21.520114+0000 osd.1 (osd.1) 53 : cluster [DBG] 2.d deep-scrub starts 2024-02-10T08:19:23.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:21.523092+0000 osd.1 (osd.1) 54 : cluster [DBG] 2.d deep-scrub ok 2024-02-10T08:19:23.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:19:22.725340+0000 mon.a (mon.0) 749 : audit [DBG] from='client.? 172.21.15.18:0/2775521404' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-02-10T08:19:23.068 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:21.520114+0000 osd.1 (osd.1) 53 : cluster [DBG] 2.d deep-scrub starts 2024-02-10T08:19:23.069 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:21.523092+0000 osd.1 (osd.1) 54 : cluster [DBG] 2.d deep-scrub ok 2024-02-10T08:19:23.069 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:19:22.725340+0000 mon.a (mon.0) 749 : audit [DBG] from='client.? 172.21.15.18:0/2775521404' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-02-10T08:19:23.069 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:21.520114+0000 osd.1 (osd.1) 53 : cluster [DBG] 2.d deep-scrub starts 2024-02-10T08:19:23.069 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:21.523092+0000 osd.1 (osd.1) 54 : cluster [DBG] 2.d deep-scrub ok 2024-02-10T08:19:23.069 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:19:22.725340+0000 mon.a (mon.0) 749 : audit [DBG] from='client.? 172.21.15.18:0/2775521404' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-02-10T08:19:23.431 INFO:tasks.cephadm.ceph_manager.ceph:['osd.0 up in weight 1 up_from 8 up_thru 60 down_at 0 last_clean_interval [0,0) v2:172.21.15.18:6801/276034406 v2:172.21.15.18:6802/276034406 exists,up f9043fee-a3ed-4e16-921d-bb86756d0c48', 'osd.1 up in weight 1 up_from 13 up_thru 60 down_at 0 last_clean_interval [0,0) v2:172.21.15.18:6805/1941014296 v2:172.21.15.18:6806/1941014296 exists,up ff958272-ce6b-4162-959a-6da9729e537b', 'osd.2 up in weight 1 up_from 18 up_thru 81 down_at 0 last_clean_interval [0,0) v2:172.21.15.18:6809/3122474567 v2:172.21.15.18:6810/3122474567 exists,up 29bb47e2-5c81-4ae8-bb9f-d1b02ea01d3f', 'osd.3 up in weight 1 up_from 25 up_thru 60 down_at 0 last_clean_interval [0,0) v2:172.21.15.18:6813/3484706437 v2:172.21.15.18:6814/3484706437 exists,up 87ad37de-5f49-4e5b-9683-3bb9c3e33907', 'osd.4 up in weight 1 up_from 30 up_thru 81 down_at 0 last_clean_interval [0,0) v2:172.21.15.71:6800/1598114798 v2:172.21.15.71:6801/1598114798 exists,up f5708f20-f98d-4d12-b8ae-71a5049a14cc', 'osd.5 up in weight 1 up_from 37 up_thru 60 down_at 0 last_clean_interval [0,0) v2:172.21.15.71:6804/1932648316 v2:172.21.15.71:6805/1932648316 exists,up e36a71dd-5088-4bff-965e-7dc8708ef7e3', 'osd.6 up in weight 1 up_from 43 up_thru 58 down_at 0 last_clean_interval [0,0) v2:172.21.15.71:6808/3724399458 v2:172.21.15.71:6809/3724399458 exists,up 210a8790-78b6-4efa-a969-17efb17e9c0b', 'osd.7 up in weight 1 up_from 50 up_thru 60 down_at 0 last_clean_interval [0,0) v2:172.21.15.71:6812/163573852 v2:172.21.15.71:6813/163573852 exists,up 9778a0e9-2ff3-4700-bf2a-675edaba630b'] 2024-02-10T08:19:23.431 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon mon.a config show 2024-02-10T08:19:23.722 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:19:23.776 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:22.215313+0000 osd.4 (osd.4) 47 : cluster [DBG] 6.2 scrub starts 2024-02-10T08:19:23.776 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:22.216307+0000 osd.4 (osd.4) 48 : cluster [DBG] 6.2 scrub ok 2024-02-10T08:19:23.776 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:22.227144+0000 osd.7 (osd.7) 47 : cluster [DBG] 2.b scrub starts 2024-02-10T08:19:23.776 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:22.228060+0000 osd.7 (osd.7) 48 : cluster [DBG] 2.b scrub ok 2024-02-10T08:19:23.776 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:22.463529+0000 osd.6 (osd.6) 33 : cluster [DBG] 2.17 scrub starts 2024-02-10T08:19:23.776 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:22.466447+0000 osd.6 (osd.6) 34 : cluster [DBG] 2.17 scrub ok 2024-02-10T08:19:24.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:22.215313+0000 osd.4 (osd.4) 47 : cluster [DBG] 6.2 scrub starts 2024-02-10T08:19:24.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:22.216307+0000 osd.4 (osd.4) 48 : cluster [DBG] 6.2 scrub ok 2024-02-10T08:19:24.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:22.227144+0000 osd.7 (osd.7) 47 : cluster [DBG] 2.b scrub starts 2024-02-10T08:19:24.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:22.228060+0000 osd.7 (osd.7) 48 : cluster [DBG] 2.b scrub ok 2024-02-10T08:19:24.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:22.463529+0000 osd.6 (osd.6) 33 : cluster [DBG] 2.17 scrub starts 2024-02-10T08:19:24.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:22.466447+0000 osd.6 (osd.6) 34 : cluster [DBG] 2.17 scrub ok 2024-02-10T08:19:24.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:22.477625+0000 mgr.y (mgr.14505) 103 : cluster [DBG] pgmap v89: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:19:24.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:22.477625+0000 mgr.y (mgr.14505) 103 : cluster [DBG] pgmap v89: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:19:24.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:22.215313+0000 osd.4 (osd.4) 47 : cluster [DBG] 6.2 scrub starts 2024-02-10T08:19:24.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:22.216307+0000 osd.4 (osd.4) 48 : cluster [DBG] 6.2 scrub ok 2024-02-10T08:19:24.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:22.227144+0000 osd.7 (osd.7) 47 : cluster [DBG] 2.b scrub starts 2024-02-10T08:19:24.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:22.228060+0000 osd.7 (osd.7) 48 : cluster [DBG] 2.b scrub ok 2024-02-10T08:19:24.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:22.463529+0000 osd.6 (osd.6) 33 : cluster [DBG] 2.17 scrub starts 2024-02-10T08:19:24.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:22.466447+0000 osd.6 (osd.6) 34 : cluster [DBG] 2.17 scrub ok 2024-02-10T08:19:24.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:22.477625+0000 mgr.y (mgr.14505) 103 : cluster [DBG] pgmap v89: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:19:25.691 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-02-10T08:19:25.691 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mon.a", 2024-02-10T08:19:25.692 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster": "ceph", 2024-02-10T08:19:25.692 INFO:teuthology.orchestra.run.smithi018.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-02-10T08:19:25.692 INFO:teuthology.orchestra.run.smithi018.stdout: "admin_socket_mode": "", 2024-02-10T08:19:25.692 INFO:teuthology.orchestra.run.smithi018.stdout: "auth_allow_insecure_global_id_reclaim": "false", 2024-02-10T08:19:25.692 INFO:teuthology.orchestra.run.smithi018.stdout: "auth_client_required": "cephx, none", 2024-02-10T08:19:25.692 INFO:teuthology.orchestra.run.smithi018.stdout: "auth_cluster_required": "cephx", 2024-02-10T08:19:25.692 INFO:teuthology.orchestra.run.smithi018.stdout: "auth_debug": "true", 2024-02-10T08:19:25.692 INFO:teuthology.orchestra.run.smithi018.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-02-10T08:19:25.692 INFO:teuthology.orchestra.run.smithi018.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-02-10T08:19:25.692 INFO:teuthology.orchestra.run.smithi018.stdout: "auth_service_required": "cephx", 2024-02-10T08:19:25.692 INFO:teuthology.orchestra.run.smithi018.stdout: "auth_service_ticket_ttl": "240.000000", 2024-02-10T08:19:25.692 INFO:teuthology.orchestra.run.smithi018.stdout: "auth_supported": "", 2024-02-10T08:19:25.692 INFO:teuthology.orchestra.run.smithi018.stdout: "bdev_aio": "true", 2024-02-10T08:19:25.693 INFO:teuthology.orchestra.run.smithi018.stdout: "bdev_aio_max_queue_depth": "1024", 2024-02-10T08:19:25.693 INFO:teuthology.orchestra.run.smithi018.stdout: "bdev_aio_poll_ms": "250", 2024-02-10T08:19:25.693 INFO:teuthology.orchestra.run.smithi018.stdout: "bdev_aio_reap_max": "16", 2024-02-10T08:19:25.693 INFO:teuthology.orchestra.run.smithi018.stdout: "bdev_async_discard": "false", 2024-02-10T08:19:25.693 INFO:teuthology.orchestra.run.smithi018.stdout: "bdev_block_size": "4096", 2024-02-10T08:19:25.693 INFO:teuthology.orchestra.run.smithi018.stdout: "bdev_debug_aio": "false", 2024-02-10T08:19:25.693 INFO:teuthology.orchestra.run.smithi018.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-02-10T08:19:25.693 INFO:teuthology.orchestra.run.smithi018.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-02-10T08:19:25.693 INFO:teuthology.orchestra.run.smithi018.stdout: "bdev_debug_inflight_ios": "false", 2024-02-10T08:19:25.693 INFO:teuthology.orchestra.run.smithi018.stdout: "bdev_enable_discard": "false", 2024-02-10T08:19:25.693 INFO:teuthology.orchestra.run.smithi018.stdout: "bdev_flock_retry": "3", 2024-02-10T08:19:25.693 INFO:teuthology.orchestra.run.smithi018.stdout: "bdev_flock_retry_interval": "0.100000", 2024-02-10T08:19:25.693 INFO:teuthology.orchestra.run.smithi018.stdout: "bdev_inject_crash": "0", 2024-02-10T08:19:25.693 INFO:teuthology.orchestra.run.smithi018.stdout: "bdev_inject_crash_flush_delay": "2", 2024-02-10T08:19:25.693 INFO:teuthology.orchestra.run.smithi018.stdout: "bdev_ioring": "false", 2024-02-10T08:19:25.694 INFO:teuthology.orchestra.run.smithi018.stdout: "bdev_ioring_hipri": "false", 2024-02-10T08:19:25.694 INFO:teuthology.orchestra.run.smithi018.stdout: "bdev_ioring_sqthread_poll": "false", 2024-02-10T08:19:25.694 INFO:teuthology.orchestra.run.smithi018.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-02-10T08:19:25.694 INFO:teuthology.orchestra.run.smithi018.stdout: "bdev_type": "", 2024-02-10T08:19:25.694 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_alloc_size": "1048576", 2024-02-10T08:19:25.694 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_allocator": "hybrid", 2024-02-10T08:19:25.694 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_buffered_io": "true", 2024-02-10T08:19:25.694 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_check_for_zeros": "false", 2024-02-10T08:19:25.694 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_check_volume_selector_often": "false", 2024-02-10T08:19:25.694 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-02-10T08:19:25.694 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_compact_log_sync": "false", 2024-02-10T08:19:25.694 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-02-10T08:19:25.694 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-02-10T08:19:25.694 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_log_compact_min_size": "16777216", 2024-02-10T08:19:25.694 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_log_replay_check_allocations": "true", 2024-02-10T08:19:25.695 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_max_log_runway": "4194304", 2024-02-10T08:19:25.695 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_max_prefetch": "1048576", 2024-02-10T08:19:25.695 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_min_flush_size": "524288", 2024-02-10T08:19:25.695 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_min_log_runway": "1048576", 2024-02-10T08:19:25.695 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_replay_recovery": "false", 2024-02-10T08:19:25.695 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-02-10T08:19:25.695 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_shared_alloc_size": "65536", 2024-02-10T08:19:25.695 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_sync_write": "false", 2024-02-10T08:19:25.695 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-02-10T08:19:25.695 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-02-10T08:19:25.695 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-02-10T08:19:25.695 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_allocator": "hybrid", 2024-02-10T08:19:25.695 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-02-10T08:19:25.695 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-02-10T08:19:25.695 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-02-10T08:19:25.696 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-02-10T08:19:25.696 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-02-10T08:19:25.696 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-02-10T08:19:25.696 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_blobid_prealloc": "10240", 2024-02-10T08:19:25.696 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_block_create": "true", 2024-02-10T08:19:25.696 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_block_db_create": "false", 2024-02-10T08:19:25.696 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_block_db_path": "", 2024-02-10T08:19:25.696 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_block_db_size": "0", 2024-02-10T08:19:25.697 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_block_path": "", 2024-02-10T08:19:25.697 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_block_preallocate_file": "false", 2024-02-10T08:19:25.697 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_block_size": "107374182400", 2024-02-10T08:19:25.697 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_block_wal_create": "false", 2024-02-10T08:19:25.697 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_block_wal_path": "", 2024-02-10T08:19:25.697 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_block_wal_size": "100663296", 2024-02-10T08:19:25.697 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_bluefs": "true", 2024-02-10T08:19:25.697 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-02-10T08:19:25.697 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_bluefs_env_mirror": "false", 2024-02-10T08:19:25.697 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_autotune": "true", 2024-02-10T08:19:25.697 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-02-10T08:19:25.697 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-02-10T08:19:25.698 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-02-10T08:19:25.698 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-02-10T08:19:25.698 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_size": "0", 2024-02-10T08:19:25.698 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-02-10T08:19:25.698 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-02-10T08:19:25.698 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-02-10T08:19:25.698 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-02-10T08:19:25.698 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_type": "2q", 2024-02-10T08:19:25.698 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_clone_cow": "true", 2024-02-10T08:19:25.698 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_compression_algorithm": "snappy", 2024-02-10T08:19:25.698 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_compression_max_blob_size": "0", 2024-02-10T08:19:25.698 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-02-10T08:19:25.698 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-02-10T08:19:25.698 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_compression_min_blob_size": "0", 2024-02-10T08:19:25.699 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-02-10T08:19:25.699 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_compression_min_blob_size_ssd": "8192", 2024-02-10T08:19:25.699 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_compression_mode": "none", 2024-02-10T08:19:25.699 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-02-10T08:19:25.699 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_csum_type": "crc32c", 2024-02-10T08:19:25.700 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_debug_enforce_settings": "default", 2024-02-10T08:19:25.700 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_debug_freelist": "false", 2024-02-10T08:19:25.700 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_debug_fsck_abort": "false", 2024-02-10T08:19:25.700 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_debug_inject_bug21040": "false", 2024-02-10T08:19:25.700 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-02-10T08:19:25.700 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_debug_inject_read_err": "false", 2024-02-10T08:19:25.700 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_debug_legacy_omap": "false", 2024-02-10T08:19:25.701 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-02-10T08:19:25.701 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-02-10T08:19:25.701 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-02-10T08:19:25.701 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-02-10T08:19:25.701 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_debug_prefill": "0.000000", 2024-02-10T08:19:25.701 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-02-10T08:19:25.701 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-02-10T08:19:25.701 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-02-10T08:19:25.701 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_debug_small_allocations": "0", 2024-02-10T08:19:25.701 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-02-10T08:19:25.701 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_default_buffered_read": "true", 2024-02-10T08:19:25.701 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_default_buffered_write": "false", 2024-02-10T08:19:25.701 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_deferred_batch_ops": "0", 2024-02-10T08:19:25.702 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-02-10T08:19:25.702 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-02-10T08:19:25.702 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-02-10T08:19:25.702 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-02-10T08:19:25.702 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-02-10T08:19:25.702 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-02-10T08:19:25.702 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-02-10T08:19:25.702 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-02-10T08:19:25.702 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-02-10T08:19:25.702 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-02-10T08:19:25.702 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-02-10T08:19:25.702 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_on_mkfs": "true", 2024-02-10T08:19:25.702 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-02-10T08:19:25.702 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_on_mount": "false", 2024-02-10T08:19:25.702 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-02-10T08:19:25.703 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_on_umount": "false", 2024-02-10T08:19:25.703 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-02-10T08:19:25.703 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-02-10T08:19:25.703 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-02-10T08:19:25.703 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-02-10T08:19:25.703 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-02-10T08:19:25.703 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-02-10T08:19:25.703 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-02-10T08:19:25.703 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-02-10T08:19:25.703 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_ignore_data_csum": "false", 2024-02-10T08:19:25.703 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-02-10T08:19:25.703 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_kvbackend": "rocksdb", 2024-02-10T08:19:25.703 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-02-10T08:19:25.703 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-02-10T08:19:25.703 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_log_op_age": "5.000000", 2024-02-10T08:19:25.704 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_max_alloc_size": "0", 2024-02-10T08:19:25.704 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_max_blob_size": "0", 2024-02-10T08:19:25.704 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-02-10T08:19:25.704 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-02-10T08:19:25.704 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_max_defer_interval": "3.000000", 2024-02-10T08:19:25.704 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_max_deferred_txc": "32", 2024-02-10T08:19:25.704 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_min_alloc_size": "0", 2024-02-10T08:19:25.704 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-02-10T08:19:25.704 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-02-10T08:19:25.704 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_nid_prealloc": "1024", 2024-02-10T08:19:25.704 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_prefer_deferred_size": "0", 2024-02-10T08:19:25.704 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-02-10T08:19:25.704 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-02-10T08:19:25.704 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_retry_disk_reads": "3", 2024-02-10T08:19:25.704 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_rocksdb_cf": "true", 2024-02-10T08:19:25.705 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L P", 2024-02-10T08:19:25.705 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_rocksdb_options": "compression=kNoCompression,max_write_buffer_number=4,min_write_buffer_number_to_merge=1,recycle_log_file_num=4,write_buffer_size=268435456,writable_file_max_buffer_size=0,compaction_readahead_size=2097152,max_background_compactions=2,max_total_wal_size=1073741824", 2024-02-10T08:19:25.705 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_rocksdb_options_annex": "", 2024-02-10T08:19:25.705 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_spdk_coremask": "0x1", 2024-02-10T08:19:25.705 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_spdk_io_sleep": "5", 2024-02-10T08:19:25.705 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_spdk_max_io_completion": "0", 2024-02-10T08:19:25.705 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_spdk_mem": "512", 2024-02-10T08:19:25.705 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_sync_submit_transaction": "false", 2024-02-10T08:19:25.705 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_throttle_bytes": "67108864", 2024-02-10T08:19:25.705 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_throttle_cost_per_io": "0", 2024-02-10T08:19:25.705 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-02-10T08:19:25.705 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-02-10T08:19:25.705 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-02-10T08:19:25.705 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-02-10T08:19:25.706 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_tracing": "false", 2024-02-10T08:19:25.706 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-02-10T08:19:25.706 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_volume_selection_reserved": "0", 2024-02-10T08:19:25.706 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-02-10T08:19:25.706 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-02-10T08:19:25.706 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-02-10T08:19:25.706 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-02-10T08:19:25.706 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-02-10T08:19:25.706 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-02-10T08:19:25.706 INFO:teuthology.orchestra.run.smithi018.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-02-10T08:19:25.706 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs_mirror_action_update_interval": "2", 2024-02-10T08:19:25.706 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-02-10T08:19:25.706 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-02-10T08:19:25.706 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-02-10T08:19:25.707 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-02-10T08:19:25.707 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs_mirror_mount_timeout": "10", 2024-02-10T08:19:25.707 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-02-10T08:19:25.707 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-02-10T08:19:25.707 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-02-10T08:19:25.707 INFO:teuthology.orchestra.run.smithi018.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-02-10T08:19:25.707 INFO:teuthology.orchestra.run.smithi018.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-02-10T08:19:25.707 INFO:teuthology.orchestra.run.smithi018.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-02-10T08:19:25.707 INFO:teuthology.orchestra.run.smithi018.stdout: "cephx_cluster_require_signatures": "false", 2024-02-10T08:19:25.707 INFO:teuthology.orchestra.run.smithi018.stdout: "cephx_cluster_require_version": "2", 2024-02-10T08:19:25.707 INFO:teuthology.orchestra.run.smithi018.stdout: "cephx_require_signatures": "false", 2024-02-10T08:19:25.707 INFO:teuthology.orchestra.run.smithi018.stdout: "cephx_require_version": "2", 2024-02-10T08:19:25.707 INFO:teuthology.orchestra.run.smithi018.stdout: "cephx_service_require_signatures": "false", 2024-02-10T08:19:25.707 INFO:teuthology.orchestra.run.smithi018.stdout: "cephx_service_require_version": "2", 2024-02-10T08:19:25.708 INFO:teuthology.orchestra.run.smithi018.stdout: "cephx_sign_messages": "true", 2024-02-10T08:19:25.708 INFO:teuthology.orchestra.run.smithi018.stdout: "chdir": "", 2024-02-10T08:19:25.708 INFO:teuthology.orchestra.run.smithi018.stdout: "client_acl_type": "", 2024-02-10T08:19:25.708 INFO:teuthology.orchestra.run.smithi018.stdout: "client_asio_thread_count": "2", 2024-02-10T08:19:25.708 INFO:teuthology.orchestra.run.smithi018.stdout: "client_cache_mid": "0.750000", 2024-02-10T08:19:25.708 INFO:teuthology.orchestra.run.smithi018.stdout: "client_cache_size": "16384", 2024-02-10T08:19:25.708 INFO:teuthology.orchestra.run.smithi018.stdout: "client_caps_release_delay": "5", 2024-02-10T08:19:25.708 INFO:teuthology.orchestra.run.smithi018.stdout: "client_check_pool_perm": "true", 2024-02-10T08:19:25.708 INFO:teuthology.orchestra.run.smithi018.stdout: "client_collect_and_send_global_metrics": "false", 2024-02-10T08:19:25.708 INFO:teuthology.orchestra.run.smithi018.stdout: "client_debug_force_sync_read": "false", 2024-02-10T08:19:25.708 INFO:teuthology.orchestra.run.smithi018.stdout: "client_debug_getattr_caps": "false", 2024-02-10T08:19:25.708 INFO:teuthology.orchestra.run.smithi018.stdout: "client_debug_inject_tick_delay": "0", 2024-02-10T08:19:25.708 INFO:teuthology.orchestra.run.smithi018.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-02-10T08:19:25.708 INFO:teuthology.orchestra.run.smithi018.stdout: "client_die_on_failed_remount": "false", 2024-02-10T08:19:25.709 INFO:teuthology.orchestra.run.smithi018.stdout: "client_dirsize_rbytes": "true", 2024-02-10T08:19:25.709 INFO:teuthology.orchestra.run.smithi018.stdout: "client_force_lazyio": "false", 2024-02-10T08:19:25.709 INFO:teuthology.orchestra.run.smithi018.stdout: "client_fs": "", 2024-02-10T08:19:25.709 INFO:teuthology.orchestra.run.smithi018.stdout: "client_inject_fixed_oldest_tid": "false", 2024-02-10T08:19:25.709 INFO:teuthology.orchestra.run.smithi018.stdout: "client_inject_release_failure": "false", 2024-02-10T08:19:25.709 INFO:teuthology.orchestra.run.smithi018.stdout: "client_max_inline_size": "4096", 2024-02-10T08:19:25.709 INFO:teuthology.orchestra.run.smithi018.stdout: "client_max_retries_on_remount_failure": "5", 2024-02-10T08:19:25.709 INFO:teuthology.orchestra.run.smithi018.stdout: "client_mds_namespace": "", 2024-02-10T08:19:25.709 INFO:teuthology.orchestra.run.smithi018.stdout: "client_metadata": "", 2024-02-10T08:19:25.709 INFO:teuthology.orchestra.run.smithi018.stdout: "client_mount_gid": "-1", 2024-02-10T08:19:25.709 INFO:teuthology.orchestra.run.smithi018.stdout: "client_mount_timeout": "300", 2024-02-10T08:19:25.709 INFO:teuthology.orchestra.run.smithi018.stdout: "client_mount_uid": "-1", 2024-02-10T08:19:25.709 INFO:teuthology.orchestra.run.smithi018.stdout: "client_mountpoint": "/", 2024-02-10T08:19:25.709 INFO:teuthology.orchestra.run.smithi018.stdout: "client_notify_timeout": "10", 2024-02-10T08:19:25.710 INFO:teuthology.orchestra.run.smithi018.stdout: "client_oc": "true", 2024-02-10T08:19:25.710 INFO:teuthology.orchestra.run.smithi018.stdout: "client_oc_max_dirty": "104857600", 2024-02-10T08:19:25.710 INFO:teuthology.orchestra.run.smithi018.stdout: "client_oc_max_dirty_age": "5.000000", 2024-02-10T08:19:25.710 INFO:teuthology.orchestra.run.smithi018.stdout: "client_oc_max_objects": "1000", 2024-02-10T08:19:25.710 INFO:teuthology.orchestra.run.smithi018.stdout: "client_oc_size": "209715200", 2024-02-10T08:19:25.710 INFO:teuthology.orchestra.run.smithi018.stdout: "client_oc_target_dirty": "8388608", 2024-02-10T08:19:25.710 INFO:teuthology.orchestra.run.smithi018.stdout: "client_permissions": "true", 2024-02-10T08:19:25.710 INFO:teuthology.orchestra.run.smithi018.stdout: "client_quota": "true", 2024-02-10T08:19:25.710 INFO:teuthology.orchestra.run.smithi018.stdout: "client_quota_df": "true", 2024-02-10T08:19:25.710 INFO:teuthology.orchestra.run.smithi018.stdout: "client_readahead_max_bytes": "0", 2024-02-10T08:19:25.710 INFO:teuthology.orchestra.run.smithi018.stdout: "client_readahead_max_periods": "4", 2024-02-10T08:19:25.710 INFO:teuthology.orchestra.run.smithi018.stdout: "client_readahead_min": "131072", 2024-02-10T08:19:25.710 INFO:teuthology.orchestra.run.smithi018.stdout: "client_reconnect_stale": "false", 2024-02-10T08:19:25.710 INFO:teuthology.orchestra.run.smithi018.stdout: "client_shutdown_timeout": "30", 2024-02-10T08:19:25.711 INFO:teuthology.orchestra.run.smithi018.stdout: "client_snapdir": ".snap", 2024-02-10T08:19:25.711 INFO:teuthology.orchestra.run.smithi018.stdout: "client_tick_interval": "1", 2024-02-10T08:19:25.711 INFO:teuthology.orchestra.run.smithi018.stdout: "client_trace": "", 2024-02-10T08:19:25.711 INFO:teuthology.orchestra.run.smithi018.stdout: "client_try_dentry_invalidate": "false", 2024-02-10T08:19:25.711 INFO:teuthology.orchestra.run.smithi018.stdout: "client_use_faked_inos": "false", 2024-02-10T08:19:25.711 INFO:teuthology.orchestra.run.smithi018.stdout: "client_use_random_mds": "false", 2024-02-10T08:19:25.711 INFO:teuthology.orchestra.run.smithi018.stdout: "clog_to_graylog": "false", 2024-02-10T08:19:25.711 INFO:teuthology.orchestra.run.smithi018.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-02-10T08:19:25.711 INFO:teuthology.orchestra.run.smithi018.stdout: "clog_to_graylog_port": "12201", 2024-02-10T08:19:25.711 INFO:teuthology.orchestra.run.smithi018.stdout: "clog_to_monitors": "default=true", 2024-02-10T08:19:25.711 INFO:teuthology.orchestra.run.smithi018.stdout: "clog_to_syslog": "false", 2024-02-10T08:19:25.711 INFO:teuthology.orchestra.run.smithi018.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-02-10T08:19:25.711 INFO:teuthology.orchestra.run.smithi018.stdout: "clog_to_syslog_level": "info", 2024-02-10T08:19:25.711 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "-", 2024-02-10T08:19:25.711 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_network": "", 2024-02-10T08:19:25.712 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_network_interface": "", 2024-02-10T08:19:25.712 INFO:teuthology.orchestra.run.smithi018.stdout: "compressor_zlib_isal": "false", 2024-02-10T08:19:25.712 INFO:teuthology.orchestra.run.smithi018.stdout: "compressor_zlib_level": "5", 2024-02-10T08:19:25.712 INFO:teuthology.orchestra.run.smithi018.stdout: "compressor_zlib_winsize": "-15", 2024-02-10T08:19:25.712 INFO:teuthology.orchestra.run.smithi018.stdout: "compressor_zstd_level": "1", 2024-02-10T08:19:25.712 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc", 2024-02-10T08:19:25.712 INFO:teuthology.orchestra.run.smithi018.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-02-10T08:19:25.712 INFO:teuthology.orchestra.run.smithi018.stdout: "crimson_osd_obc_lru_size": "10", 2024-02-10T08:19:25.712 INFO:teuthology.orchestra.run.smithi018.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-02-10T08:19:25.712 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_location": "", 2024-02-10T08:19:25.712 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_location_hook": "", 2024-02-10T08:19:25.712 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_location_hook_timeout": "10", 2024-02-10T08:19:25.712 INFO:teuthology.orchestra.run.smithi018.stdout: "daemonize": "false", 2024-02-10T08:19:25.713 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_allow_any_pool_priority": "false", 2024-02-10T08:19:25.713 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_asok": "1/5", 2024-02-10T08:19:25.713 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_asok_assert_abort": "false", 2024-02-10T08:19:25.713 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_asserts_on_shutdown": "true", 2024-02-10T08:19:25.713 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_auth": "1/5", 2024-02-10T08:19:25.713 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_bdev": "1/3", 2024-02-10T08:19:25.713 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_bluefs": "1/5", 2024-02-10T08:19:25.713 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_bluestore": "1/5", 2024-02-10T08:19:25.713 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_buffer": "0/1", 2024-02-10T08:19:25.713 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_cephfs_mirror": "0/5", 2024-02-10T08:19:25.713 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_cephsqlite": "0/5", 2024-02-10T08:19:25.714 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_civetweb": "1/10", 2024-02-10T08:19:25.714 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_client": "0/5", 2024-02-10T08:19:25.714 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_compressor": "1/5", 2024-02-10T08:19:25.714 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_context": "0/1", 2024-02-10T08:19:25.714 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_crush": "1/1", 2024-02-10T08:19:25.714 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_crypto": "1/5", 2024-02-10T08:19:25.714 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_deliberately_leak_memory": "false", 2024-02-10T08:19:25.714 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_disable_randomized_ping": "false", 2024-02-10T08:19:25.714 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_dpdk": "1/5", 2024-02-10T08:19:25.714 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_eventtrace": "1/5", 2024-02-10T08:19:25.714 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_filer": "0/1", 2024-02-10T08:19:25.714 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_filestore": "1/3", 2024-02-10T08:19:25.714 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_finisher": "1/1", 2024-02-10T08:19:25.714 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_fuse": "1/5", 2024-02-10T08:19:25.715 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_heartbeat_testing_span": "0", 2024-02-10T08:19:25.715 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_heartbeatmap": "1/5", 2024-02-10T08:19:25.715 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_immutable_obj_cache": "0/5", 2024-02-10T08:19:25.715 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_javaclient": "1/5", 2024-02-10T08:19:25.715 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_journal": "1/3", 2024-02-10T08:19:25.715 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_journaler": "0/5", 2024-02-10T08:19:25.715 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_kstore": "1/5", 2024-02-10T08:19:25.715 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_leveldb": "4/5", 2024-02-10T08:19:25.715 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_lockdep": "0/1", 2024-02-10T08:19:25.715 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_mds": "1/5", 2024-02-10T08:19:25.715 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_mds_balancer": "1/5", 2024-02-10T08:19:25.715 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_mds_locker": "1/5", 2024-02-10T08:19:25.716 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_mds_log": "1/5", 2024-02-10T08:19:25.716 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_mds_log_expire": "1/5", 2024-02-10T08:19:25.716 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_mds_migrator": "1/5", 2024-02-10T08:19:25.716 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_memdb": "4/5", 2024-02-10T08:19:25.716 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_mgr": "2/5", 2024-02-10T08:19:25.716 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_mgrc": "1/5", 2024-02-10T08:19:25.716 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_mon": "20/20", 2024-02-10T08:19:25.716 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_monc": "0/10", 2024-02-10T08:19:25.716 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_ms": "1/1", 2024-02-10T08:19:25.716 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_none": "0/5", 2024-02-10T08:19:25.716 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_objclass": "0/5", 2024-02-10T08:19:25.716 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_objectcacher": "0/5", 2024-02-10T08:19:25.717 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_objecter": "0/1", 2024-02-10T08:19:25.717 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_optracker": "0/5", 2024-02-10T08:19:25.717 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_osd": "1/5", 2024-02-10T08:19:25.717 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_paxos": "20/20", 2024-02-10T08:19:25.717 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_perfcounter": "1/5", 2024-02-10T08:19:25.717 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_prioritycache": "1/5", 2024-02-10T08:19:25.717 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_rados": "0/5", 2024-02-10T08:19:25.717 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_rbd": "0/5", 2024-02-10T08:19:25.717 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_rbd_mirror": "0/5", 2024-02-10T08:19:25.717 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_rbd_pwl": "0/5", 2024-02-10T08:19:25.717 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_rbd_replay": "0/5", 2024-02-10T08:19:25.717 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_refs": "0/0", 2024-02-10T08:19:25.717 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_reserver": "1/1", 2024-02-10T08:19:25.717 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_rgw": "1/5", 2024-02-10T08:19:25.717 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_rgw_sync": "1/5", 2024-02-10T08:19:25.717 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_rocksdb": "4/5", 2024-02-10T08:19:25.718 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_striper": "0/1", 2024-02-10T08:19:25.718 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_test": "0/5", 2024-02-10T08:19:25.718 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_throttle": "1/1", 2024-02-10T08:19:25.718 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_timer": "0/1", 2024-02-10T08:19:25.718 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_tp": "0/5", 2024-02-10T08:19:25.718 INFO:teuthology.orchestra.run.smithi018.stdout: "defer_client_eviction_on_laggy_osds": "true", 2024-02-10T08:19:25.718 INFO:teuthology.orchestra.run.smithi018.stdout: "device_failure_prediction_mode": "none", 2024-02-10T08:19:25.718 INFO:teuthology.orchestra.run.smithi018.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-02-10T08:19:25.718 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_dir": "/usr/lib64/ceph/erasure-code", 2024-02-10T08:19:25.718 INFO:teuthology.orchestra.run.smithi018.stdout: "err_to_graylog": "false", 2024-02-10T08:19:25.718 INFO:teuthology.orchestra.run.smithi018.stdout: "err_to_stderr": "true", 2024-02-10T08:19:25.718 INFO:teuthology.orchestra.run.smithi018.stdout: "err_to_syslog": "false", 2024-02-10T08:19:25.718 INFO:teuthology.orchestra.run.smithi018.stdout: "event_tracing": "false", 2024-02-10T08:19:25.718 INFO:teuthology.orchestra.run.smithi018.stdout: "fake_statfs_for_testing": "0", 2024-02-10T08:19:25.719 INFO:teuthology.orchestra.run.smithi018.stdout: "fatal_signal_handlers": "true", 2024-02-10T08:19:25.719 INFO:teuthology.orchestra.run.smithi018.stdout: "filer_max_purge_ops": "10", 2024-02-10T08:19:25.719 INFO:teuthology.orchestra.run.smithi018.stdout: "filer_max_truncate_ops": "128", 2024-02-10T08:19:25.719 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_apply_finisher_threads": "1", 2024-02-10T08:19:25.719 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_blackhole": "false", 2024-02-10T08:19:25.719 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_btrfs_clone_range": "true", 2024-02-10T08:19:25.719 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_btrfs_snap": "true", 2024-02-10T08:19:25.719 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_caller_concurrency": "10", 2024-02-10T08:19:25.719 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_collect_device_partition_information": "true", 2024-02-10T08:19:25.719 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_commit_timeout": "600.000000", 2024-02-10T08:19:25.719 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_debug_inject_read_err": "false", 2024-02-10T08:19:25.719 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_debug_omap_check": "false", 2024-02-10T08:19:25.719 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_debug_random_read_err": "0.000000", 2024-02-10T08:19:25.719 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_debug_verify_split": "false", 2024-02-10T08:19:25.719 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_dump_file": "", 2024-02-10T08:19:25.720 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-02-10T08:19:25.720 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-02-10T08:19:25.720 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_fadvise": "true", 2024-02-10T08:19:25.720 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_fail_eio": "true", 2024-02-10T08:19:25.720 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_fd_cache_shards": "16", 2024-02-10T08:19:25.720 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_fd_cache_size": "128", 2024-02-10T08:19:25.720 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_fiemap": "false", 2024-02-10T08:19:25.720 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_fiemap_threshold": "4096", 2024-02-10T08:19:25.720 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-02-10T08:19:25.720 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_index_retry_probability": "0.000000", 2024-02-10T08:19:25.720 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_inject_stall": "0", 2024-02-10T08:19:25.720 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_journal_parallel": "false", 2024-02-10T08:19:25.720 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_journal_trailing": "false", 2024-02-10T08:19:25.721 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_journal_writeahead": "false", 2024-02-10T08:19:25.721 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_kill_at": "0", 2024-02-10T08:19:25.721 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-02-10T08:19:25.721 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_max_inline_xattr_size": "0", 2024-02-10T08:19:25.721 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-02-10T08:19:25.721 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-02-10T08:19:25.721 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-02-10T08:19:25.721 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_max_inline_xattrs": "0", 2024-02-10T08:19:25.721 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-02-10T08:19:25.721 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_max_inline_xattrs_other": "2", 2024-02-10T08:19:25.721 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-02-10T08:19:25.721 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_max_sync_interval": "5.000000", 2024-02-10T08:19:25.721 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_max_xattr_value_size": "0", 2024-02-10T08:19:25.721 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-02-10T08:19:25.722 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-02-10T08:19:25.722 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-02-10T08:19:25.722 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_merge_threshold": "-10", 2024-02-10T08:19:25.722 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_min_sync_interval": "0.010000", 2024-02-10T08:19:25.722 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_odsync_write": "false", 2024-02-10T08:19:25.722 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_omap_backend": "rocksdb", 2024-02-10T08:19:25.722 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_omap_backend_path": "", 2024-02-10T08:19:25.722 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_omap_header_cache_size": "1024", 2024-02-10T08:19:25.722 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_ondisk_finisher_threads": "1", 2024-02-10T08:19:25.722 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-02-10T08:19:25.722 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_op_thread_timeout": "60", 2024-02-10T08:19:25.722 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_op_threads": "2", 2024-02-10T08:19:25.722 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_punch_hole": "false", 2024-02-10T08:19:25.722 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-02-10T08:19:25.722 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-02-10T08:19:25.723 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-02-10T08:19:25.723 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-02-10T08:19:25.723 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-02-10T08:19:25.723 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_queue_max_bytes": "104857600", 2024-02-10T08:19:25.723 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-02-10T08:19:25.723 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-02-10T08:19:25.723 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-02-10T08:19:25.723 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_queue_max_ops": "50", 2024-02-10T08:19:25.723 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-02-10T08:19:25.723 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_seek_data_hole": "false", 2024-02-10T08:19:25.723 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_sloppy_crc": "false", 2024-02-10T08:19:25.723 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-02-10T08:19:25.723 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_splice": "false", 2024-02-10T08:19:25.723 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_split_multiple": "2", 2024-02-10T08:19:25.724 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_split_rand_factor": "20", 2024-02-10T08:19:25.724 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_update_to": "1000", 2024-02-10T08:19:25.724 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-02-10T08:19:25.724 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-02-10T08:19:25.724 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-02-10T08:19:25.724 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-02-10T08:19:25.724 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-02-10T08:19:25.724 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-02-10T08:19:25.724 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_wbthrottle_enable": "true", 2024-02-10T08:19:25.724 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-02-10T08:19:25.724 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-02-10T08:19:25.724 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-02-10T08:19:25.724 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-02-10T08:19:25.724 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-02-10T08:19:25.725 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-02-10T08:19:25.725 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_xfs_extsize": "false", 2024-02-10T08:19:25.726 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_zfs_snap": "false", 2024-02-10T08:19:25.726 INFO:teuthology.orchestra.run.smithi018.stdout: "fio_dir": "/tmp/fio", 2024-02-10T08:19:25.726 INFO:teuthology.orchestra.run.smithi018.stdout: "fsid": "d46257c8-c7eb-11ee-95b8-87774f69a715", 2024-02-10T08:19:25.726 INFO:teuthology.orchestra.run.smithi018.stdout: "fuse_allow_other": "true", 2024-02-10T08:19:25.726 INFO:teuthology.orchestra.run.smithi018.stdout: "fuse_atomic_o_trunc": "true", 2024-02-10T08:19:25.727 INFO:teuthology.orchestra.run.smithi018.stdout: "fuse_big_writes": "true", 2024-02-10T08:19:25.727 INFO:teuthology.orchestra.run.smithi018.stdout: "fuse_debug": "false", 2024-02-10T08:19:25.727 INFO:teuthology.orchestra.run.smithi018.stdout: "fuse_default_permissions": "false", 2024-02-10T08:19:25.727 INFO:teuthology.orchestra.run.smithi018.stdout: "fuse_disable_pagecache": "false", 2024-02-10T08:19:25.727 INFO:teuthology.orchestra.run.smithi018.stdout: "fuse_max_write": "0", 2024-02-10T08:19:25.727 INFO:teuthology.orchestra.run.smithi018.stdout: "fuse_multithreaded": "true", 2024-02-10T08:19:25.727 INFO:teuthology.orchestra.run.smithi018.stdout: "fuse_require_active_mds": "true", 2024-02-10T08:19:25.727 INFO:teuthology.orchestra.run.smithi018.stdout: "fuse_set_user_groups": "true", 2024-02-10T08:19:25.727 INFO:teuthology.orchestra.run.smithi018.stdout: "fuse_splice_move": "true", 2024-02-10T08:19:25.727 INFO:teuthology.orchestra.run.smithi018.stdout: "fuse_splice_read": "true", 2024-02-10T08:19:25.727 INFO:teuthology.orchestra.run.smithi018.stdout: "fuse_splice_write": "true", 2024-02-10T08:19:25.728 INFO:teuthology.orchestra.run.smithi018.stdout: "fuse_syncfs_on_mksnap": "true", 2024-02-10T08:19:25.728 INFO:teuthology.orchestra.run.smithi018.stdout: "fuse_use_invalidate_cb": "true", 2024-02-10T08:19:25.728 INFO:teuthology.orchestra.run.smithi018.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-02-10T08:19:25.728 INFO:teuthology.orchestra.run.smithi018.stdout: "gss_target_name": "ceph", 2024-02-10T08:19:25.728 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_file": "", 2024-02-10T08:19:25.728 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_inject_failure": "0", 2024-02-10T08:19:25.728 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_interval": "5", 2024-02-10T08:19:25.728 INFO:teuthology.orchestra.run.smithi018.stdout: "host": "", 2024-02-10T08:19:25.728 INFO:teuthology.orchestra.run.smithi018.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-02-10T08:19:25.728 INFO:teuthology.orchestra.run.smithi018.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-02-10T08:19:25.728 INFO:teuthology.orchestra.run.smithi018.stdout: "immutable_object_cache_max_size": "1073741824", 2024-02-10T08:19:25.729 INFO:teuthology.orchestra.run.smithi018.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-02-10T08:19:25.729 INFO:teuthology.orchestra.run.smithi018.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-02-10T08:19:25.729 INFO:teuthology.orchestra.run.smithi018.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-02-10T08:19:25.729 INFO:teuthology.orchestra.run.smithi018.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-02-10T08:19:25.729 INFO:teuthology.orchestra.run.smithi018.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-02-10T08:19:25.729 INFO:teuthology.orchestra.run.smithi018.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-02-10T08:19:25.729 INFO:teuthology.orchestra.run.smithi018.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-02-10T08:19:25.729 INFO:teuthology.orchestra.run.smithi018.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-02-10T08:19:25.729 INFO:teuthology.orchestra.run.smithi018.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-02-10T08:19:25.729 INFO:teuthology.orchestra.run.smithi018.stdout: "immutable_object_cache_watermark": "0.900000", 2024-02-10T08:19:25.729 INFO:teuthology.orchestra.run.smithi018.stdout: "inject_early_sigterm": "false", 2024-02-10T08:19:25.729 INFO:teuthology.orchestra.run.smithi018.stdout: "journal_aio": "true", 2024-02-10T08:19:25.729 INFO:teuthology.orchestra.run.smithi018.stdout: "journal_align_min_size": "65536", 2024-02-10T08:19:25.729 INFO:teuthology.orchestra.run.smithi018.stdout: "journal_block_align": "true", 2024-02-10T08:19:25.729 INFO:teuthology.orchestra.run.smithi018.stdout: "journal_block_size": "4096", 2024-02-10T08:19:25.730 INFO:teuthology.orchestra.run.smithi018.stdout: "journal_dio": "true", 2024-02-10T08:19:25.730 INFO:teuthology.orchestra.run.smithi018.stdout: "journal_discard": "false", 2024-02-10T08:19:25.730 INFO:teuthology.orchestra.run.smithi018.stdout: "journal_force_aio": "false", 2024-02-10T08:19:25.730 INFO:teuthology.orchestra.run.smithi018.stdout: "journal_ignore_corruption": "false", 2024-02-10T08:19:25.730 INFO:teuthology.orchestra.run.smithi018.stdout: "journal_max_write_bytes": "10485760", 2024-02-10T08:19:25.730 INFO:teuthology.orchestra.run.smithi018.stdout: "journal_max_write_entries": "100", 2024-02-10T08:19:25.730 INFO:teuthology.orchestra.run.smithi018.stdout: "journal_replay_from": "0", 2024-02-10T08:19:25.730 INFO:teuthology.orchestra.run.smithi018.stdout: "journal_throttle_high_multiple": "0.000000", 2024-02-10T08:19:25.730 INFO:teuthology.orchestra.run.smithi018.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-02-10T08:19:25.730 INFO:teuthology.orchestra.run.smithi018.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-02-10T08:19:25.730 INFO:teuthology.orchestra.run.smithi018.stdout: "journal_throttle_max_multiple": "0.000000", 2024-02-10T08:19:25.730 INFO:teuthology.orchestra.run.smithi018.stdout: "journal_write_header_frequency": "0", 2024-02-10T08:19:25.730 INFO:teuthology.orchestra.run.smithi018.stdout: "journal_zero_on_create": "false", 2024-02-10T08:19:25.730 INFO:teuthology.orchestra.run.smithi018.stdout: "journaler_prefetch_periods": "10", 2024-02-10T08:19:25.731 INFO:teuthology.orchestra.run.smithi018.stdout: "journaler_prezero_periods": "5", 2024-02-10T08:19:25.731 INFO:teuthology.orchestra.run.smithi018.stdout: "journaler_write_head_interval": "15", 2024-02-10T08:19:25.731 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "", 2024-02-10T08:19:25.731 INFO:teuthology.orchestra.run.smithi018.stdout: "keyfile": "", 2024-02-10T08:19:25.731 INFO:teuthology.orchestra.run.smithi018.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-02-10T08:19:25.731 INFO:teuthology.orchestra.run.smithi018.stdout: "kstore_backend": "rocksdb", 2024-02-10T08:19:25.731 INFO:teuthology.orchestra.run.smithi018.stdout: "kstore_default_stripe_size": "65536", 2024-02-10T08:19:25.731 INFO:teuthology.orchestra.run.smithi018.stdout: "kstore_fsck_on_mount": "false", 2024-02-10T08:19:25.731 INFO:teuthology.orchestra.run.smithi018.stdout: "kstore_fsck_on_mount_deep": "true", 2024-02-10T08:19:25.731 INFO:teuthology.orchestra.run.smithi018.stdout: "kstore_max_bytes": "67108864", 2024-02-10T08:19:25.731 INFO:teuthology.orchestra.run.smithi018.stdout: "kstore_max_ops": "512", 2024-02-10T08:19:25.731 INFO:teuthology.orchestra.run.smithi018.stdout: "kstore_nid_prealloc": "1024", 2024-02-10T08:19:25.731 INFO:teuthology.orchestra.run.smithi018.stdout: "kstore_onode_map_size": "1024", 2024-02-10T08:19:25.731 INFO:teuthology.orchestra.run.smithi018.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-02-10T08:19:25.732 INFO:teuthology.orchestra.run.smithi018.stdout: "kstore_sync_submit_transaction": "false", 2024-02-10T08:19:25.732 INFO:teuthology.orchestra.run.smithi018.stdout: "kstore_sync_transaction": "false", 2024-02-10T08:19:25.732 INFO:teuthology.orchestra.run.smithi018.stdout: "leveldb_block_size": "65536", 2024-02-10T08:19:25.732 INFO:teuthology.orchestra.run.smithi018.stdout: "leveldb_bloom_size": "0", 2024-02-10T08:19:25.732 INFO:teuthology.orchestra.run.smithi018.stdout: "leveldb_cache_size": "536870912", 2024-02-10T08:19:25.732 INFO:teuthology.orchestra.run.smithi018.stdout: "leveldb_compact_on_mount": "false", 2024-02-10T08:19:25.732 INFO:teuthology.orchestra.run.smithi018.stdout: "leveldb_compression": "false", 2024-02-10T08:19:25.732 INFO:teuthology.orchestra.run.smithi018.stdout: "leveldb_log": "", 2024-02-10T08:19:25.732 INFO:teuthology.orchestra.run.smithi018.stdout: "leveldb_log_to_ceph_log": "true", 2024-02-10T08:19:25.732 INFO:teuthology.orchestra.run.smithi018.stdout: "leveldb_max_open_files": "0", 2024-02-10T08:19:25.732 INFO:teuthology.orchestra.run.smithi018.stdout: "leveldb_paranoid": "false", 2024-02-10T08:19:25.732 INFO:teuthology.orchestra.run.smithi018.stdout: "leveldb_write_buffer_size": "33554432", 2024-02-10T08:19:25.732 INFO:teuthology.orchestra.run.smithi018.stdout: "librados_thread_count": "2", 2024-02-10T08:19:25.732 INFO:teuthology.orchestra.run.smithi018.stdout: "lockdep": "false", 2024-02-10T08:19:25.733 INFO:teuthology.orchestra.run.smithi018.stdout: "lockdep_force_backtrace": "false", 2024-02-10T08:19:25.733 INFO:teuthology.orchestra.run.smithi018.stdout: "log_coarse_timestamps": "true", 2024-02-10T08:19:25.733 INFO:teuthology.orchestra.run.smithi018.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-02-10T08:19:25.734 INFO:teuthology.orchestra.run.smithi018.stdout: "log_flush_on_exit": "false", 2024-02-10T08:19:25.734 INFO:teuthology.orchestra.run.smithi018.stdout: "log_graylog_host": "127.0.0.1", 2024-02-10T08:19:25.734 INFO:teuthology.orchestra.run.smithi018.stdout: "log_graylog_port": "12201", 2024-02-10T08:19:25.734 INFO:teuthology.orchestra.run.smithi018.stdout: "log_max_new": "1000", 2024-02-10T08:19:25.734 INFO:teuthology.orchestra.run.smithi018.stdout: "log_max_recent": "10000", 2024-02-10T08:19:25.734 INFO:teuthology.orchestra.run.smithi018.stdout: "log_stderr_prefix": "debug ", 2024-02-10T08:19:25.734 INFO:teuthology.orchestra.run.smithi018.stdout: "log_stop_at_utilization": "0.970000", 2024-02-10T08:19:25.734 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": "true", 2024-02-10T08:19:25.734 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_graylog": "false", 2024-02-10T08:19:25.734 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_stderr": "false", 2024-02-10T08:19:25.735 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_syslog": "false", 2024-02-10T08:19:25.735 INFO:teuthology.orchestra.run.smithi018.stdout: "max_rotating_auth_attempts": "10", 2024-02-10T08:19:25.735 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-02-10T08:19:25.735 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_action_on_write_error": "1", 2024-02-10T08:19:25.735 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_alternate_name_max": "8192", 2024-02-10T08:19:25.735 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_asio_thread_count": "2", 2024-02-10T08:19:25.735 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_bal_export_pin": "true", 2024-02-10T08:19:25.735 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_bal_fragment_dirs": "true", 2024-02-10T08:19:25.735 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-02-10T08:19:25.735 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_bal_fragment_interval": "5", 2024-02-10T08:19:25.735 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_bal_fragment_size_max": "100000", 2024-02-10T08:19:25.735 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_bal_idle_threshold": "0.000000", 2024-02-10T08:19:25.735 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_bal_interval": "10", 2024-02-10T08:19:25.736 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_bal_max": "-1", 2024-02-10T08:19:25.736 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_bal_max_until": "-1", 2024-02-10T08:19:25.736 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_bal_merge_size": "50", 2024-02-10T08:19:25.736 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_bal_midchunk": "0.300000", 2024-02-10T08:19:25.736 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_bal_min_rebalance": "0.100000", 2024-02-10T08:19:25.736 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_bal_min_start": "0.200000", 2024-02-10T08:19:25.736 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_bal_minchunk": "0.001000", 2024-02-10T08:19:25.736 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_bal_mode": "0", 2024-02-10T08:19:25.736 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_bal_need_max": "1.200000", 2024-02-10T08:19:25.736 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_bal_need_min": "0.800000", 2024-02-10T08:19:25.736 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-02-10T08:19:25.736 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_bal_sample_interval": "3.000000", 2024-02-10T08:19:25.736 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_bal_split_bits": "3", 2024-02-10T08:19:25.736 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_bal_split_rd": "25000.000000", 2024-02-10T08:19:25.736 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_bal_split_size": "10000", 2024-02-10T08:19:25.737 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_bal_split_wr": "10000.000000", 2024-02-10T08:19:25.737 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_bal_target_decay": "10.000000", 2024-02-10T08:19:25.737 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-02-10T08:19:25.737 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_beacon_grace": "15.000000", 2024-02-10T08:19:25.737 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_beacon_interval": "4.000000", 2024-02-10T08:19:25.737 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_beacon_mon_down_grace": "60", 2024-02-10T08:19:25.737 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_cache_memory_limit": "4294967296", 2024-02-10T08:19:25.737 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_cache_mid": "0.700000", 2024-02-10T08:19:25.737 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_cache_release_free_interval": "10", 2024-02-10T08:19:25.738 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_cache_reservation": "0.050000", 2024-02-10T08:19:25.738 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-02-10T08:19:25.738 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_cache_trim_interval": "1", 2024-02-10T08:19:25.738 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_cache_trim_threshold": "262144", 2024-02-10T08:19:25.738 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-02-10T08:19:25.738 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-02-10T08:19:25.738 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_client_delegate_inos_pct": "50", 2024-02-10T08:19:25.738 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_client_prealloc_inos": "1000", 2024-02-10T08:19:25.738 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-02-10T08:19:25.738 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_connect_bootstrapping": "false", 2024-02-10T08:19:25.738 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_damage_table_max_entries": "10000", 2024-02-10T08:19:25.738 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-02-10T08:19:25.738 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_debug_auth_pins": "false", 2024-02-10T08:19:25.738 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_debug_frag": "false", 2024-02-10T08:19:25.739 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_debug_scatterstat": "false", 2024-02-10T08:19:25.739 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_debug_subtrees": "false", 2024-02-10T08:19:25.739 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_decay_halflife": "5.000000", 2024-02-10T08:19:25.739 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_default_dir_hash": "2", 2024-02-10T08:19:25.739 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_defer_session_stale": "true", 2024-02-10T08:19:25.739 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_deny_all_reconnect": "false", 2024-02-10T08:19:25.739 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_dir_keys_per_op": "16384", 2024-02-10T08:19:25.739 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_dir_max_commit_size": "10", 2024-02-10T08:19:25.739 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_dir_max_entries": "0", 2024-02-10T08:19:25.739 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_dirstat_min_interval": "1.000000", 2024-02-10T08:19:25.739 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_dump_cache_after_rejoin": "false", 2024-02-10T08:19:25.739 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_dump_cache_on_map": "false", 2024-02-10T08:19:25.739 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_dump_cache_threshold_file": "0", 2024-02-10T08:19:25.739 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-02-10T08:19:25.740 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_early_reply": "true", 2024-02-10T08:19:25.740 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_enable_op_tracker": "true", 2024-02-10T08:19:25.740 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_enforce_unique_name": "true", 2024-02-10T08:19:25.740 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_export_ephemeral_distributed": "true", 2024-02-10T08:19:25.740 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-02-10T08:19:25.740 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_export_ephemeral_random": "true", 2024-02-10T08:19:25.740 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-02-10T08:19:25.740 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_forward_all_requests_to_auth": "false", 2024-02-10T08:19:25.740 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-02-10T08:19:25.740 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-02-10T08:19:25.740 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-02-10T08:19:25.740 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_health_cache_threshold": "1.500000", 2024-02-10T08:19:25.740 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_health_summarize_threshold": "10", 2024-02-10T08:19:25.740 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_heartbeat_grace": "15.000000", 2024-02-10T08:19:25.741 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_heartbeat_reset_grace": "1000", 2024-02-10T08:19:25.741 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_inject_health_dummy": "false", 2024-02-10T08:19:25.741 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-02-10T08:19:25.741 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_inject_migrator_session_race": "false", 2024-02-10T08:19:25.741 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-02-10T08:19:25.741 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-02-10T08:19:25.741 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-02-10T08:19:25.741 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_join_fs": "", 2024-02-10T08:19:25.741 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_journal_format": "1", 2024-02-10T08:19:25.741 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_kill_create_at": "0", 2024-02-10T08:19:25.741 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_kill_export_at": "0", 2024-02-10T08:19:25.741 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_kill_import_at": "0", 2024-02-10T08:19:25.741 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_kill_journal_at": "0", 2024-02-10T08:19:25.741 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_kill_journal_expire_at": "0", 2024-02-10T08:19:25.742 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_kill_journal_replay_at": "0", 2024-02-10T08:19:25.742 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_kill_link_at": "0", 2024-02-10T08:19:25.742 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_kill_mdstable_at": "0", 2024-02-10T08:19:25.742 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_kill_openc_at": "0", 2024-02-10T08:19:25.742 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_kill_rename_at": "0", 2024-02-10T08:19:25.742 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_kill_skip_replaying_inotable": "false", 2024-02-10T08:19:25.742 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_log_events_per_segment": "1024", 2024-02-10T08:19:25.742 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_log_max_events": "-1", 2024-02-10T08:19:25.742 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_log_max_segments": "128", 2024-02-10T08:19:25.742 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_log_pause": "false", 2024-02-10T08:19:25.742 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_log_segment_size": "0", 2024-02-10T08:19:25.742 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_log_skip_corrupt_events": "false", 2024-02-10T08:19:25.742 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_log_warn_factor": "2.000000", 2024-02-10T08:19:25.742 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_max_caps_per_client": "1048576", 2024-02-10T08:19:25.742 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_max_completed_flushes": "100000", 2024-02-10T08:19:25.743 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_max_completed_requests": "100000", 2024-02-10T08:19:25.743 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_max_export_size": "20971520", 2024-02-10T08:19:25.743 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_max_file_recover": "32", 2024-02-10T08:19:25.743 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_max_purge_files": "64", 2024-02-10T08:19:25.743 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_max_purge_ops": "8192", 2024-02-10T08:19:25.743 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-02-10T08:19:25.743 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-02-10T08:19:25.743 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_max_snaps_per_dir": "100", 2024-02-10T08:19:25.743 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_max_xattr_pairs_size": "65536", 2024-02-10T08:19:25.744 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_metrics_update_interval": "2", 2024-02-10T08:19:25.744 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_min_caps_per_client": "100", 2024-02-10T08:19:25.744 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_min_caps_working_set": "10000", 2024-02-10T08:19:25.744 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-02-10T08:19:25.744 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_numa_node": "-1", 2024-02-10T08:19:25.744 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-02-10T08:19:25.744 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_op_complaint_time": "30.000000", 2024-02-10T08:19:25.744 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_op_history_duration": "600", 2024-02-10T08:19:25.744 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_op_history_size": "20", 2024-02-10T08:19:25.744 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_op_log_threshold": "5", 2024-02-10T08:19:25.744 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_ping_grace": "15", 2024-02-10T08:19:25.744 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_ping_interval": "5", 2024-02-10T08:19:25.744 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-02-10T08:19:25.744 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-02-10T08:19:25.745 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_recall_max_caps": "30000", 2024-02-10T08:19:25.745 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-02-10T08:19:25.745 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_recall_max_decay_threshold": "131072", 2024-02-10T08:19:25.745 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-02-10T08:19:25.745 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_recall_warning_threshold": "262144", 2024-02-10T08:19:25.745 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_reconnect_timeout": "45.000000", 2024-02-10T08:19:25.745 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_replay_interval": "1.000000", 2024-02-10T08:19:25.745 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-02-10T08:19:25.745 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-02-10T08:19:25.746 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_root_ino_gid": "0", 2024-02-10T08:19:25.746 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_root_ino_uid": "0", 2024-02-10T08:19:25.746 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-02-10T08:19:25.746 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_session_blocklist_on_evict": "true", 2024-02-10T08:19:25.746 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_session_blocklist_on_timeout": "true", 2024-02-10T08:19:25.746 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-02-10T08:19:25.746 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-02-10T08:19:25.746 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-02-10T08:19:25.746 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-02-10T08:19:25.746 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-02-10T08:19:25.746 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_session_metadata_threshold": "16777216", 2024-02-10T08:19:25.746 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-02-10T08:19:25.746 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_shutdown_check": "0", 2024-02-10T08:19:25.746 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_skip_ino": "0", 2024-02-10T08:19:25.747 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_sleep_rank_change": "0.000000", 2024-02-10T08:19:25.747 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_snap_max_uid": "4294967294", 2024-02-10T08:19:25.747 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_snap_min_uid": "0", 2024-02-10T08:19:25.747 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_snap_rstat": "false", 2024-02-10T08:19:25.747 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_standby_replay_damaged": "false", 2024-02-10T08:19:25.747 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_task_status_update_interval": "2.000000", 2024-02-10T08:19:25.747 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_thrash_exports": "0", 2024-02-10T08:19:25.747 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_thrash_fragments": "0", 2024-02-10T08:19:25.747 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_tick_interval": "5.000000", 2024-02-10T08:19:25.747 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_valgrind_exit": "false", 2024-02-10T08:19:25.747 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_verify_backtrace": "1", 2024-02-10T08:19:25.747 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_verify_scatter": "false", 2024-02-10T08:19:25.747 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_wipe_ino_prealloc": "false", 2024-02-10T08:19:25.747 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_wipe_sessions": "false", 2024-02-10T08:19:25.747 INFO:teuthology.orchestra.run.smithi018.stdout: "mempool_debug": "false", 2024-02-10T08:19:25.748 INFO:teuthology.orchestra.run.smithi018.stdout: "memstore_debug_omit_block_device_write": "false", 2024-02-10T08:19:25.748 INFO:teuthology.orchestra.run.smithi018.stdout: "memstore_device_bytes": "1073741824", 2024-02-10T08:19:25.748 INFO:teuthology.orchestra.run.smithi018.stdout: "memstore_page_set": "false", 2024-02-10T08:19:25.748 INFO:teuthology.orchestra.run.smithi018.stdout: "memstore_page_size": "65536", 2024-02-10T08:19:25.748 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_client_bytes": "134217728", 2024-02-10T08:19:25.748 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_client_messages": "512", 2024-02-10T08:19:25.748 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-02-10T08:19:25.748 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_connect_retry_interval": "1.000000", 2024-02-10T08:19:25.748 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-02-10T08:19:25.748 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-02-10T08:19:25.748 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_disabled_modules": "", 2024-02-10T08:19:25.748 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-02-10T08:19:25.748 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_max_pg_num_change": "128", 2024-02-10T08:19:25.748 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_mds_bytes": "134217728", 2024-02-10T08:19:25.749 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_mds_messages": "128", 2024-02-10T08:19:25.749 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-02-10T08:19:25.749 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_mon_bytes": "134217728", 2024-02-10T08:19:25.749 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_mon_messages": "128", 2024-02-10T08:19:25.749 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_osd_bytes": "536870912", 2024-02-10T08:19:25.749 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_osd_messages": "8192", 2024-02-10T08:19:25.749 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_service_beacon_grace": "60.000000", 2024-02-10T08:19:25.749 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_standby_modules": "true", 2024-02-10T08:19:25.749 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_stats_period": "5", 2024-02-10T08:19:25.749 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_stats_threshold": "5", 2024-02-10T08:19:25.749 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_tick_period": "2", 2024-02-10T08:19:25.749 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-02-10T08:19:25.749 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_accept_timeout_factor": "2.000000", 2024-02-10T08:19:25.749 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_allow_pool_delete": "true", 2024-02-10T08:19:25.749 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_allow_pool_size_one": "false", 2024-02-10T08:19:25.749 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_auth_validate_all_caps": "true", 2024-02-10T08:19:25.750 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-02-10T08:19:25.750 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-02-10T08:19:25.750 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_client_bytes": "104857600", 2024-02-10T08:19:25.750 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_client_directed_command_retry": "2", 2024-02-10T08:19:25.750 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_client_hunt_interval": "3.000000", 2024-02-10T08:19:25.750 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-02-10T08:19:25.750 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-02-10T08:19:25.750 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-02-10T08:19:25.750 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_client_hunt_parallel": "3", 2024-02-10T08:19:25.750 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_client_log_interval": "1.000000", 2024-02-10T08:19:25.750 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-02-10T08:19:25.750 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_client_ping_interval": "10.000000", 2024-02-10T08:19:25.750 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_client_ping_timeout": "30.000000", 2024-02-10T08:19:25.750 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_clock_drift_allowed": "1.000000", 2024-02-10T08:19:25.750 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-02-10T08:19:25.751 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-02-10T08:19:25.751 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_cluster_log_file_level": "debug", 2024-02-10T08:19:25.751 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_cluster_log_to_file": "true", 2024-02-10T08:19:25.751 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_cluster_log_to_graylog": "false", 2024-02-10T08:19:25.751 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-02-10T08:19:25.751 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-02-10T08:19:25.751 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_cluster_log_to_stderr": "true", 2024-02-10T08:19:25.751 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-02-10T08:19:25.751 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-02-10T08:19:25.751 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_cluster_log_to_syslog_level": "info", 2024-02-10T08:19:25.751 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_compact_on_bootstrap": "false", 2024-02-10T08:19:25.751 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_compact_on_start": "false", 2024-02-10T08:19:25.751 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_compact_on_trim": "true", 2024-02-10T08:19:25.751 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_con_tracker_persist_interval": "10", 2024-02-10T08:19:25.751 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_con_tracker_score_halflife": "43200", 2024-02-10T08:19:25.752 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_config_key_max_entry_size": "65536", 2024-02-10T08:19:25.752 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_cpu_threads": "4", 2024-02-10T08:19:25.752 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_crush_min_required_version": "hammer", 2024-02-10T08:19:25.752 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_daemon_bytes": "419430400", 2024-02-10T08:19:25.752 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-02-10T08:19:25.752 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_data_avail_crit": "5", 2024-02-10T08:19:25.752 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_data_avail_warn": "5", 2024-02-10T08:19:25.752 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_data_size_warn": "16106127360", 2024-02-10T08:19:25.752 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_debug_block_osdmap_trim": "false", 2024-02-10T08:19:25.752 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-02-10T08:19:25.752 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_debug_dump_json": "false", 2024-02-10T08:19:25.752 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-02-10T08:19:25.752 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_debug_dump_transactions": "false", 2024-02-10T08:19:25.752 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_debug_extra_checks": "false", 2024-02-10T08:19:25.752 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-02-10T08:19:25.753 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-02-10T08:19:25.753 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_debug_no_require_octopus": "false", 2024-02-10T08:19:25.753 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_debug_no_require_pacific": "false", 2024-02-10T08:19:25.753 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-02-10T08:19:25.753 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_delta_reset_interval": "10.000000", 2024-02-10T08:19:25.753 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_dns_srv_name": "ceph-mon", 2024-02-10T08:19:25.753 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_down_mkfs_grace": "60", 2024-02-10T08:19:25.753 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_election_default_strategy": "1", 2024-02-10T08:19:25.753 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_election_timeout": "5.000000", 2024-02-10T08:19:25.753 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-02-10T08:19:25.753 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_elector_ping_divisor": "2", 2024-02-10T08:19:25.753 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_elector_ping_timeout": "2.000000", 2024-02-10T08:19:25.753 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_enable_op_tracker": "true", 2024-02-10T08:19:25.754 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_fake_pool_delete": "false", 2024-02-10T08:19:25.754 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_force_quorum_join": "false", 2024-02-10T08:19:25.754 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_globalid_prealloc": "10000", 2024-02-10T08:19:25.754 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_health_detail_to_clog": "true", 2024-02-10T08:19:25.754 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_health_log_update_period": "5", 2024-02-10T08:19:25.754 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_health_max_detail": "50", 2024-02-10T08:19:25.754 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_health_to_clog": "true", 2024-02-10T08:19:25.754 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_health_to_clog_interval": "600", 2024-02-10T08:19:25.754 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-02-10T08:19:25.754 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_host": "[v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0]", 2024-02-10T08:19:25.754 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_host_override": "", 2024-02-10T08:19:25.754 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_initial_members": "", 2024-02-10T08:19:25.754 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-02-10T08:19:25.754 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-02-10T08:19:25.755 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-02-10T08:19:25.755 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-02-10T08:19:25.755 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_keyvaluedb": "rocksdb", 2024-02-10T08:19:25.755 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_lease": "5.000000", 2024-02-10T08:19:25.755 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-02-10T08:19:25.755 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-02-10T08:19:25.755 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_log_max_summary": "50", 2024-02-10T08:19:25.755 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_max_log_entries_per_event": "4096", 2024-02-10T08:19:25.755 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_max_log_epochs": "500", 2024-02-10T08:19:25.755 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_max_mdsmap_epochs": "500", 2024-02-10T08:19:25.755 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_max_mgrmap_epochs": "500", 2024-02-10T08:19:25.755 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_max_osd": "10000", 2024-02-10T08:19:25.755 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_max_pg_per_osd": "10000", 2024-02-10T08:19:25.755 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_max_pool_pg_num": "65536", 2024-02-10T08:19:25.755 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-02-10T08:19:25.756 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-02-10T08:19:25.756 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_mds_force_trim_to": "0", 2024-02-10T08:19:25.756 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_mds_skip_sanity": "false", 2024-02-10T08:19:25.756 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_memory_autotune": "true", 2024-02-10T08:19:25.756 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_memory_target": "2147483648", 2024-02-10T08:19:25.756 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_mgr_beacon_grace": "30", 2024-02-10T08:19:25.756 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-02-10T08:19:25.756 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_mgr_digest_period": "5", 2024-02-10T08:19:25.756 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_mgr_inactive_grace": "60", 2024-02-10T08:19:25.756 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_mgr_mkfs_grace": "240", 2024-02-10T08:19:25.756 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-02-10T08:19:25.756 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_min_osdmap_epochs": "50", 2024-02-10T08:19:25.756 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_op_complaint_time": "30", 2024-02-10T08:19:25.756 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_op_history_duration": "600", 2024-02-10T08:19:25.757 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_op_history_size": "20", 2024-02-10T08:19:25.757 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_op_history_slow_op_size": "20", 2024-02-10T08:19:25.757 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_op_history_slow_op_threshold": "10", 2024-02-10T08:19:25.757 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_op_log_threshold": "5", 2024-02-10T08:19:25.757 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-02-10T08:19:25.757 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-02-10T08:19:25.757 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-02-10T08:19:25.757 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_auto_mark_in": "false", 2024-02-10T08:19:25.757 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_auto_mark_new_in": "true", 2024-02-10T08:19:25.757 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-02-10T08:19:25.757 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-02-10T08:19:25.757 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_cache_size": "500", 2024-02-10T08:19:25.757 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_cache_size_min": "134217728", 2024-02-10T08:19:25.757 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_crush_smoke_test": "true", 2024-02-10T08:19:25.758 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_destroyed_out_interval": "600", 2024-02-10T08:19:25.758 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_down_out_interval": "600", 2024-02-10T08:19:25.758 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-02-10T08:19:25.758 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-02-10T08:19:25.758 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_force_trim_to": "0", 2024-02-10T08:19:25.758 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_full_ratio": "0.950000", 2024-02-10T08:19:25.758 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-02-10T08:19:25.758 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_laggy_halflife": "3600", 2024-02-10T08:19:25.758 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_laggy_max_interval": "300", 2024-02-10T08:19:25.758 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_laggy_weight": "0.300000", 2024-02-10T08:19:25.758 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-02-10T08:19:25.758 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_max_creating_pgs": "1024", 2024-02-10T08:19:25.758 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_max_initial_pgs": "1024", 2024-02-10T08:19:25.758 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_min_down_reporters": "2", 2024-02-10T08:19:25.758 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-02-10T08:19:25.759 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-02-10T08:19:25.759 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-02-10T08:19:25.759 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_prime_pg_temp": "true", 2024-02-10T08:19:25.759 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-02-10T08:19:25.759 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-02-10T08:19:25.759 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_report_timeout": "900", 2024-02-10T08:19:25.759 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-02-10T08:19:25.759 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-02-10T08:19:25.759 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_warn_num_repaired": "10", 2024-02-10T08:19:25.759 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_warn_op_age": "32.000000", 2024-02-10T08:19:25.759 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-02-10T08:19:25.759 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osdmap_full_prune_interval": "2", 2024-02-10T08:19:25.759 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osdmap_full_prune_min": "15", 2024-02-10T08:19:25.759 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osdmap_full_prune_txsize": "2", 2024-02-10T08:19:25.759 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-02-10T08:19:25.760 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_pg_stuck_threshold": "60", 2024-02-10T08:19:25.760 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-02-10T08:19:25.760 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_pg_warn_min_objects": "10000", 2024-02-10T08:19:25.760 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_pg_warn_min_per_osd": "0", 2024-02-10T08:19:25.760 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-02-10T08:19:25.760 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_pool_quota_crit_threshold": "0", 2024-02-10T08:19:25.760 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_pool_quota_warn_threshold": "0", 2024-02-10T08:19:25.760 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_probe_timeout": "2.000000", 2024-02-10T08:19:25.760 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_reweight_max_change": "0.050000", 2024-02-10T08:19:25.760 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_reweight_max_osds": "4", 2024-02-10T08:19:25.760 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-02-10T08:19:25.761 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-02-10T08:19:25.761 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-02-10T08:19:25.761 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-02-10T08:19:25.761 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-02-10T08:19:25.761 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_scrub_interval": "86400", 2024-02-10T08:19:25.761 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_scrub_max_keys": "100", 2024-02-10T08:19:25.761 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_scrub_timeout": "300", 2024-02-10T08:19:25.761 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_session_timeout": "300", 2024-02-10T08:19:25.761 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_smart_report_timeout": "5", 2024-02-10T08:19:25.761 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_stat_smooth_intervals": "6", 2024-02-10T08:19:25.761 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-02-10T08:19:25.761 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_stretch_pool_min_size": "2", 2024-02-10T08:19:25.761 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_stretch_pool_size": "4", 2024-02-10T08:19:25.761 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-02-10T08:19:25.762 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_subscribe_interval": "86400.000000", 2024-02-10T08:19:25.762 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_sync_debug": "false", 2024-02-10T08:19:25.762 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_sync_max_payload_keys": "2000", 2024-02-10T08:19:25.762 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_sync_max_payload_size": "1048576", 2024-02-10T08:19:25.762 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_sync_provider_kill_at": "0", 2024-02-10T08:19:25.762 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_sync_requester_kill_at": "0", 2024-02-10T08:19:25.762 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_sync_timeout": "60.000000", 2024-02-10T08:19:25.762 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_target_pg_per_osd": "100", 2024-02-10T08:19:25.762 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_tick_interval": "5", 2024-02-10T08:19:25.762 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_timecheck_interval": "300.000000", 2024-02-10T08:19:25.762 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-02-10T08:19:25.762 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_warn_older_version_delay": "604800", 2024-02-10T08:19:25.762 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-02-10T08:19:25.762 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-02-10T08:19:25.762 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-02-10T08:19:25.763 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-02-10T08:19:25.763 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-02-10T08:19:25.763 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-02-10T08:19:25.763 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_warn_on_misplaced": "false", 2024-02-10T08:19:25.763 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-02-10T08:19:25.763 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_warn_on_older_version": "true", 2024-02-10T08:19:25.763 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-02-10T08:19:25.763 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_warn_on_pool_no_app": "true", 2024-02-10T08:19:25.763 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_warn_on_pool_no_redundancy": "true", 2024-02-10T08:19:25.763 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-02-10T08:19:25.763 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-02-10T08:19:25.763 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-02-10T08:19:25.763 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_warn_on_too_few_osds": "false", 2024-02-10T08:19:25.763 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-02-10T08:19:25.763 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-02-10T08:19:25.764 INFO:teuthology.orchestra.run.smithi018.stdout: "monmap": "", 2024-02-10T08:19:25.764 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_async_max_op_threads": "5", 2024-02-10T08:19:25.764 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_async_op_threads": "3", 2024-02-10T08:19:25.764 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_async_rdma_buffer_size": "131072", 2024-02-10T08:19:25.764 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_async_rdma_cm": "false", 2024-02-10T08:19:25.764 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_async_rdma_device_name": "", 2024-02-10T08:19:25.764 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_async_rdma_dscp": "96", 2024-02-10T08:19:25.764 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-02-10T08:19:25.764 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_async_rdma_gid_idx": "0", 2024-02-10T08:19:25.764 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_async_rdma_local_gid": "", 2024-02-10T08:19:25.764 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_async_rdma_polling_us": "1000", 2024-02-10T08:19:25.764 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_async_rdma_port_num": "1", 2024-02-10T08:19:25.764 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-02-10T08:19:25.764 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-02-10T08:19:25.764 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_async_rdma_roce_ver": "1", 2024-02-10T08:19:25.765 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_async_rdma_send_buffers": "1024", 2024-02-10T08:19:25.765 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_async_rdma_sl": "3", 2024-02-10T08:19:25.765 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_async_rdma_support_srq": "true", 2024-02-10T08:19:25.765 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_async_rdma_type": "ib", 2024-02-10T08:19:25.765 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_async_reap_threshold": "5", 2024-02-10T08:19:25.765 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_bind_before_connect": "false", 2024-02-10T08:19:25.765 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_bind_ipv4": "true", 2024-02-10T08:19:25.765 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_bind_ipv6": "false", 2024-02-10T08:19:25.765 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_bind_msgr1": "false", 2024-02-10T08:19:25.765 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_bind_msgr2": "true", 2024-02-10T08:19:25.765 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_bind_port_max": "7300", 2024-02-10T08:19:25.765 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_bind_port_min": "6800", 2024-02-10T08:19:25.765 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_bind_prefer_ipv4": "false", 2024-02-10T08:19:25.765 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_bind_retry_count": "3", 2024-02-10T08:19:25.765 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_bind_retry_delay": "5", 2024-02-10T08:19:25.765 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_blackhole_client": "false", 2024-02-10T08:19:25.766 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_blackhole_mds": "false", 2024-02-10T08:19:25.766 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_blackhole_mgr": "false", 2024-02-10T08:19:25.766 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_blackhole_mon": "false", 2024-02-10T08:19:25.766 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_blackhole_osd": "false", 2024-02-10T08:19:25.766 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_client_mode": "crc secure", 2024-02-10T08:19:25.766 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_cluster_mode": "crc secure", 2024-02-10T08:19:25.766 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_cluster_type": "", 2024-02-10T08:19:25.766 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_connection_idle_timeout": "900", 2024-02-10T08:19:25.766 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_connection_ready_timeout": "10", 2024-02-10T08:19:25.766 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_crc_data": "true", 2024-02-10T08:19:25.766 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_crc_header": "true", 2024-02-10T08:19:25.766 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_die_on_bad_msg": "false", 2024-02-10T08:19:25.766 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_die_on_bug": "true", 2024-02-10T08:19:25.767 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_die_on_old_message": "true", 2024-02-10T08:19:25.767 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_die_on_skipped_message": "false", 2024-02-10T08:19:25.767 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_die_on_unhandled_msg": "false", 2024-02-10T08:19:25.767 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-02-10T08:19:25.767 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_dpdk_coremask": "0xF", 2024-02-10T08:19:25.767 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-02-10T08:19:25.767 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-02-10T08:19:25.767 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-02-10T08:19:25.767 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_dpdk_hugepages": "", 2024-02-10T08:19:25.767 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_dpdk_hw_flow_control": "true", 2024-02-10T08:19:25.767 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-02-10T08:19:25.767 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_dpdk_lro": "true", 2024-02-10T08:19:25.767 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_dpdk_memory_channel": "4", 2024-02-10T08:19:25.767 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-02-10T08:19:25.768 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_dpdk_pmd": "", 2024-02-10T08:19:25.768 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_dpdk_port_id": "0", 2024-02-10T08:19:25.768 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-02-10T08:19:25.768 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_dump_corrupt_message_level": "1", 2024-02-10T08:19:25.768 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_dump_on_send": "false", 2024-02-10T08:19:25.768 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_initial_backoff": "0.200000", 2024-02-10T08:19:25.768 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_inject_delay_max": "1.000000", 2024-02-10T08:19:25.768 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_inject_delay_probability": "0.000000", 2024-02-10T08:19:25.768 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_inject_delay_type": "", 2024-02-10T08:19:25.768 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_inject_internal_delays": "0.000000", 2024-02-10T08:19:25.768 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_inject_socket_failures": "0", 2024-02-10T08:19:25.768 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_learn_addr_from_peer": "true", 2024-02-10T08:19:25.768 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_max_accept_failures": "4", 2024-02-10T08:19:25.768 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_max_backoff": "15.000000", 2024-02-10T08:19:25.768 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_mon_client_mode": "secure crc", 2024-02-10T08:19:25.769 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_mon_cluster_mode": "secure crc", 2024-02-10T08:19:25.769 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_mon_service_mode": "secure crc", 2024-02-10T08:19:25.769 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-02-10T08:19:25.769 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_pq_min_cost": "65536", 2024-02-10T08:19:25.769 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_public_type": "", 2024-02-10T08:19:25.769 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_service_mode": "crc secure", 2024-02-10T08:19:25.769 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_tcp_listen_backlog": "512", 2024-02-10T08:19:25.769 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_tcp_nodelay": "true", 2024-02-10T08:19:25.769 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-02-10T08:19:25.769 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_tcp_rcvbuf": "0", 2024-02-10T08:19:25.769 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_type": "async+posix", 2024-02-10T08:19:25.769 INFO:teuthology.orchestra.run.smithi018.stdout: "no_config_file": "false", 2024-02-10T08:19:25.769 INFO:teuthology.orchestra.run.smithi018.stdout: "objecter_completion_locks_per_session": "32", 2024-02-10T08:19:25.769 INFO:teuthology.orchestra.run.smithi018.stdout: "objecter_debug_inject_relock_delay": "false", 2024-02-10T08:19:25.769 INFO:teuthology.orchestra.run.smithi018.stdout: "objecter_inflight_op_bytes": "104857600", 2024-02-10T08:19:25.770 INFO:teuthology.orchestra.run.smithi018.stdout: "objecter_inflight_ops": "1024", 2024-02-10T08:19:25.770 INFO:teuthology.orchestra.run.smithi018.stdout: "objecter_inject_no_watch_ping": "false", 2024-02-10T08:19:25.770 INFO:teuthology.orchestra.run.smithi018.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-02-10T08:19:25.770 INFO:teuthology.orchestra.run.smithi018.stdout: "objecter_tick_interval": "5.000000", 2024-02-10T08:19:25.770 INFO:teuthology.orchestra.run.smithi018.stdout: "objecter_timeout": "10.000000", 2024-02-10T08:19:25.770 INFO:teuthology.orchestra.run.smithi018.stdout: "objectstore_blackhole": "false", 2024-02-10T08:19:25.770 INFO:teuthology.orchestra.run.smithi018.stdout: "openssl_engine_opts": "", 2024-02-10T08:19:25.770 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_agent_delay_time": "5.000000", 2024-02-10T08:19:25.770 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_agent_hist_halflife": "1000", 2024-02-10T08:19:25.770 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_agent_max_low_ops": "2", 2024-02-10T08:19:25.770 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_agent_max_ops": "4", 2024-02-10T08:19:25.770 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-02-10T08:19:25.770 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_agent_quantize_effort": "0.100000", 2024-02-10T08:19:25.770 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_agent_slop": "0.020000", 2024-02-10T08:19:25.770 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-02-10T08:19:25.771 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_allow_recovery_below_min_size": "true", 2024-02-10T08:19:25.771 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_asio_thread_count": "2", 2024-02-10T08:19:25.771 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_async_recovery_min_cost": "100", 2024-02-10T08:19:25.771 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_auto_mark_unfound_lost": "false", 2024-02-10T08:19:25.771 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_backfill_retry_interval": "30.000000", 2024-02-10T08:19:25.771 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_backfill_scan_max": "512", 2024-02-10T08:19:25.771 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_backfill_scan_min": "64", 2024-02-10T08:19:25.771 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_backoff_on_degraded": "false", 2024-02-10T08:19:25.771 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_backoff_on_peering": "false", 2024-02-10T08:19:25.771 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_backoff_on_unfound": "true", 2024-02-10T08:19:25.771 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_beacon_report_interval": "300", 2024-02-10T08:19:25.771 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_bench_duration": "30", 2024-02-10T08:19:25.771 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-02-10T08:19:25.771 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_bench_max_block_size": "67108864", 2024-02-10T08:19:25.771 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_bench_small_size_max_iops": "100", 2024-02-10T08:19:25.772 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_blkin_trace_all": "false", 2024-02-10T08:19:25.772 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-02-10T08:19:25.772 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-02-10T08:19:25.772 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_check_for_log_corruption": "false", 2024-02-10T08:19:25.772 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-02-10T08:19:25.772 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-02-10T08:19:25.772 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_class_dir": "/usr/lib64/rados-classes", 2024-02-10T08:19:25.772 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-02-10T08:19:25.772 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_class_update_on_start": "true", 2024-02-10T08:19:25.772 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_client_message_cap": "256", 2024-02-10T08:19:25.772 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_client_message_size_cap": "524288000", 2024-02-10T08:19:25.772 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_client_op_priority": "63", 2024-02-10T08:19:25.772 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_client_watch_timeout": "30", 2024-02-10T08:19:25.772 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_command_max_records": "256", 2024-02-10T08:19:25.773 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_command_thread_suicide_timeout": "900", 2024-02-10T08:19:25.773 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_command_thread_timeout": "600", 2024-02-10T08:19:25.773 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_compact_on_start": "false", 2024-02-10T08:19:25.773 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-02-10T08:19:25.773 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_crush_chooseleaf_type": "1", 2024-02-10T08:19:25.773 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_crush_initial_weight": "-1.000000", 2024-02-10T08:19:25.773 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_crush_update_on_start": "true", 2024-02-10T08:19:25.773 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_crush_update_weight_set": "true", 2024-02-10T08:19:25.773 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-02-10T08:19:25.773 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-02-10T08:19:25.773 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-02-10T08:19:25.773 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_debug_drop_ping_duration": "0", 2024-02-10T08:19:25.773 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-02-10T08:19:25.773 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_debug_feed_pullee": "-1", 2024-02-10T08:19:25.773 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-02-10T08:19:25.773 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-02-10T08:19:25.774 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-02-10T08:19:25.774 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_debug_misdirected_ops": "false", 2024-02-10T08:19:25.774 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_debug_no_acting_change": "false", 2024-02-10T08:19:25.774 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_debug_no_purge_strays": "false", 2024-02-10T08:19:25.774 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_debug_op_order": "false", 2024-02-10T08:19:25.774 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_debug_pg_log_writeout": "false", 2024-02-10T08:19:25.774 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_debug_pretend_recovery_active": "false", 2024-02-10T08:19:25.774 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-02-10T08:19:25.774 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-02-10T08:19:25.774 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_debug_shutdown": "false", 2024-02-10T08:19:25.774 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-02-10T08:19:25.774 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-02-10T08:19:25.774 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_debug_verify_cached_snaps": "false", 2024-02-10T08:19:25.774 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_debug_verify_missing_on_start": "false", 2024-02-10T08:19:25.774 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_debug_verify_snaps": "false", 2024-02-10T08:19:25.775 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-02-10T08:19:25.775 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-02-10T08:19:25.775 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_deep_scrub_keys": "1024", 2024-02-10T08:19:25.775 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-02-10T08:19:25.775 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-02-10T08:19:25.775 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-02-10T08:19:25.775 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_deep_scrub_stride": "524288", 2024-02-10T08:19:25.775 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-02-10T08:19:25.775 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_default_data_pool_replay_window": "45", 2024-02-10T08:19:25.775 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_default_notify_timeout": "30", 2024-02-10T08:19:25.775 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_delete_sleep": "0.000000", 2024-02-10T08:19:25.775 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-02-10T08:19:25.775 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-02-10T08:19:25.775 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-02-10T08:19:25.775 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_discard_disconnected_ops": "true", 2024-02-10T08:19:25.776 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_enable_op_tracker": "true", 2024-02-10T08:19:25.776 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_erasure_code_plugins": "jerasure lrc isa", 2024-02-10T08:19:25.776 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-02-10T08:19:25.776 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-02-10T08:19:25.776 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_fast_info": "true", 2024-02-10T08:19:25.776 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_fast_shutdown": "true", 2024-02-10T08:19:25.776 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-02-10T08:19:25.776 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-02-10T08:19:25.776 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-02-10T08:19:25.776 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-02-10T08:19:25.776 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_function_tracing": "false", 2024-02-10T08:19:25.776 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_heartbeat_grace": "20", 2024-02-10T08:19:25.776 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_heartbeat_interval": "6", 2024-02-10T08:19:25.776 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-02-10T08:19:25.777 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_heartbeat_min_peers": "10", 2024-02-10T08:19:25.777 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_heartbeat_min_size": "2000", 2024-02-10T08:19:25.777 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_heartbeat_stale": "600", 2024-02-10T08:19:25.777 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-02-10T08:19:25.777 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_hit_set_max_size": "100000", 2024-02-10T08:19:25.777 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_hit_set_min_size": "1000", 2024-02-10T08:19:25.777 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-02-10T08:19:25.777 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-02-10T08:19:25.777 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-02-10T08:19:25.777 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-02-10T08:19:25.777 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-02-10T08:19:25.777 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_journal_flush_on_shutdown": "true", 2024-02-10T08:19:25.777 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_journal_size": "5120", 2024-02-10T08:19:25.777 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_kill_backfill_at": "0", 2024-02-10T08:19:25.777 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_loop_before_reset_tphandle": "64", 2024-02-10T08:19:25.778 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_map_cache_size": "50", 2024-02-10T08:19:25.778 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_map_dedup": "true", 2024-02-10T08:19:25.778 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_map_message_max": "40", 2024-02-10T08:19:25.778 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_map_message_max_bytes": "10485760", 2024-02-10T08:19:25.778 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_map_share_max_epochs": "40", 2024-02-10T08:19:25.778 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_max_attr_name_len": "100", 2024-02-10T08:19:25.778 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_max_attr_size": "0", 2024-02-10T08:19:25.778 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_max_backfills": "1", 2024-02-10T08:19:25.778 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_max_markdown_count": "5", 2024-02-10T08:19:25.778 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_max_markdown_period": "600", 2024-02-10T08:19:25.778 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_max_object_name_len": "2048", 2024-02-10T08:19:25.778 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_max_object_namespace_len": "256", 2024-02-10T08:19:25.778 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_max_object_size": "134217728", 2024-02-10T08:19:25.778 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-02-10T08:19:25.778 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_max_omap_entries_per_request": "1024", 2024-02-10T08:19:25.778 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_max_pg_blocked_by": "16", 2024-02-10T08:19:25.779 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_max_pg_log_entries": "10000", 2024-02-10T08:19:25.779 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-02-10T08:19:25.779 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_max_pgls": "1024", 2024-02-10T08:19:25.779 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_max_push_cost": "8388608", 2024-02-10T08:19:25.779 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_max_push_objects": "10", 2024-02-10T08:19:25.779 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_max_scrubs": "1", 2024-02-10T08:19:25.779 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-02-10T08:19:25.779 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_max_trimming_pgs": "2", 2024-02-10T08:19:25.779 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_max_write_op_reply_len": "64", 2024-02-10T08:19:25.779 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_max_write_size": "90", 2024-02-10T08:19:25.779 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mclock_cost_per_byte_usec": "0.000000", 2024-02-10T08:19:25.779 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mclock_cost_per_byte_usec_hdd": "5.200000", 2024-02-10T08:19:25.779 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mclock_cost_per_byte_usec_ssd": "0.011000", 2024-02-10T08:19:25.779 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mclock_cost_per_io_usec": "0.000000", 2024-02-10T08:19:25.779 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mclock_cost_per_io_usec_hdd": "25000.000000", 2024-02-10T08:19:25.780 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mclock_cost_per_io_usec_ssd": "50.000000", 2024-02-10T08:19:25.780 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-02-10T08:19:25.780 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-02-10T08:19:25.780 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-02-10T08:19:25.780 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mclock_profile": "high_client_ops", 2024-02-10T08:19:25.780 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-02-10T08:19:25.780 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mclock_scheduler_background_best_effort_lim": "999999", 2024-02-10T08:19:25.780 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mclock_scheduler_background_best_effort_res": "1", 2024-02-10T08:19:25.780 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-02-10T08:19:25.780 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mclock_scheduler_background_recovery_lim": "999999", 2024-02-10T08:19:25.780 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mclock_scheduler_background_recovery_res": "1", 2024-02-10T08:19:25.780 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-02-10T08:19:25.780 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mclock_scheduler_client_lim": "999999", 2024-02-10T08:19:25.780 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mclock_scheduler_client_res": "1", 2024-02-10T08:19:25.781 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-02-10T08:19:25.781 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mclock_skip_benchmark": "false", 2024-02-10T08:19:25.781 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_memory_base": "805306368", 2024-02-10T08:19:25.781 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_memory_cache_min": "134217728", 2024-02-10T08:19:25.781 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-02-10T08:19:25.781 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-02-10T08:19:25.781 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_memory_target": "4294967296", 2024-02-10T08:19:25.781 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_memory_target_autotune": "false", 2024-02-10T08:19:25.781 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-02-10T08:19:25.781 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_min_pg_log_entries": "250", 2024-02-10T08:19:25.781 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_min_recovery_priority": "0", 2024-02-10T08:19:25.781 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mon_heartbeat_interval": "30", 2024-02-10T08:19:25.781 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-02-10T08:19:25.781 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mon_report_interval": "5", 2024-02-10T08:19:25.781 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mon_report_max_in_flight": "2", 2024-02-10T08:19:25.782 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-02-10T08:19:25.782 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_num_cache_shards": "32", 2024-02-10T08:19:25.782 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_num_op_tracker_shard": "32", 2024-02-10T08:19:25.782 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_numa_auto_affinity": "true", 2024-02-10T08:19:25.782 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_numa_node": "-1", 2024-02-10T08:19:25.782 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_numa_prefer_iface": "true", 2024-02-10T08:19:25.782 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-02-10T08:19:25.782 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_objecter_finishers": "1", 2024-02-10T08:19:25.782 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_objectstore": "bluestore", 2024-02-10T08:19:25.782 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_objectstore_fuse": "false", 2024-02-10T08:19:25.782 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_objectstore_tracing": "false", 2024-02-10T08:19:25.782 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_op_complaint_time": "30.000000", 2024-02-10T08:19:25.782 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_op_history_duration": "600", 2024-02-10T08:19:25.782 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_op_history_size": "20", 2024-02-10T08:19:25.782 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_op_history_slow_op_size": "20", 2024-02-10T08:19:25.783 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-02-10T08:19:25.783 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_op_log_threshold": "5", 2024-02-10T08:19:25.783 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_op_num_shards": "0", 2024-02-10T08:19:25.783 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_op_num_shards_hdd": "5", 2024-02-10T08:19:25.783 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_op_num_shards_ssd": "8", 2024-02-10T08:19:25.783 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_op_num_threads_per_shard": "0", 2024-02-10T08:19:25.783 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-02-10T08:19:25.783 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-02-10T08:19:25.783 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-02-10T08:19:25.783 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_op_pq_min_cost": "65536", 2024-02-10T08:19:25.783 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_op_queue": "wpq", 2024-02-10T08:19:25.783 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_op_queue_cut_off": "high", 2024-02-10T08:19:25.783 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_op_thread_suicide_timeout": "150", 2024-02-10T08:19:25.783 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_op_thread_timeout": "15", 2024-02-10T08:19:25.783 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_open_classes_on_start": "true", 2024-02-10T08:19:25.784 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_os_flags": "0", 2024-02-10T08:19:25.784 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_peering_op_priority": "255", 2024-02-10T08:19:25.784 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pg_delete_cost": "1048576", 2024-02-10T08:19:25.784 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pg_delete_priority": "5", 2024-02-10T08:19:25.784 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-02-10T08:19:25.784 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-02-10T08:19:25.784 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pg_log_dups_tracked": "3000", 2024-02-10T08:19:25.784 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pg_log_trim_max": "10000", 2024-02-10T08:19:25.784 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pg_log_trim_min": "100", 2024-02-10T08:19:25.784 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-02-10T08:19:25.784 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pg_object_context_cache_count": "64", 2024-02-10T08:19:25.784 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pg_stat_report_interval_max": "500", 2024-02-10T08:19:25.784 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-02-10T08:19:25.784 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-02-10T08:19:25.785 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-02-10T08:19:25.785 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-02-10T08:19:25.785 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-02-10T08:19:25.785 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-02-10T08:19:25.785 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pool_default_crush_rule": "-1", 2024-02-10T08:19:25.785 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pool_default_ec_fast_read": "false", 2024-02-10T08:19:25.785 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd", 2024-02-10T08:19:25.785 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pool_default_flag_bulk": "false", 2024-02-10T08:19:25.785 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-02-10T08:19:25.785 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pool_default_flag_nodelete": "false", 2024-02-10T08:19:25.785 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-02-10T08:19:25.785 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-02-10T08:19:25.785 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pool_default_flags": "0", 2024-02-10T08:19:25.785 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-02-10T08:19:25.785 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pool_default_min_size": "0", 2024-02-10T08:19:25.786 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-02-10T08:19:25.786 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pool_default_pg_num": "32", 2024-02-10T08:19:25.786 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pool_default_pgp_num": "0", 2024-02-10T08:19:25.786 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-02-10T08:19:25.786 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pool_default_size": "3", 2024-02-10T08:19:25.786 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pool_default_type": "replicated", 2024-02-10T08:19:25.786 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-02-10T08:19:25.786 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pool_use_gmt_hitset": "true", 2024-02-10T08:19:25.786 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_push_per_object_cost": "1000", 2024-02-10T08:19:25.786 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_read_ec_check_for_errors": "false", 2024-02-10T08:19:25.786 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_recover_clone_overlap": "true", 2024-02-10T08:19:25.786 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_recover_clone_overlap_limit": "10", 2024-02-10T08:19:25.786 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_recovery_cost": "20971520", 2024-02-10T08:19:25.786 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_recovery_delay_start": "0.000000", 2024-02-10T08:19:25.786 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_recovery_max_active": "0", 2024-02-10T08:19:25.787 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_recovery_max_active_hdd": "3", 2024-02-10T08:19:25.787 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_recovery_max_active_ssd": "10", 2024-02-10T08:19:25.787 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_recovery_max_chunk": "8388608", 2024-02-10T08:19:25.787 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-02-10T08:19:25.787 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_recovery_max_single_start": "1", 2024-02-10T08:19:25.787 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_recovery_op_priority": "3", 2024-02-10T08:19:25.787 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_recovery_op_warn_multiple": "16", 2024-02-10T08:19:25.787 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_recovery_priority": "5", 2024-02-10T08:19:25.787 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_recovery_retry_interval": "30.000000", 2024-02-10T08:19:25.787 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_recovery_sleep": "0.000000", 2024-02-10T08:19:25.787 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-02-10T08:19:25.787 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-02-10T08:19:25.787 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-02-10T08:19:25.787 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_repair_during_recovery": "false", 2024-02-10T08:19:25.788 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_requested_scrub_priority": "120", 2024-02-10T08:19:25.788 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-02-10T08:19:25.788 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_rollback_to_cluster_snap": "", 2024-02-10T08:19:25.788 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_scrub_auto_repair": "false", 2024-02-10T08:19:25.788 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-02-10T08:19:25.788 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-02-10T08:19:25.788 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_scrub_begin_hour": "0", 2024-02-10T08:19:25.788 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_scrub_begin_week_day": "0", 2024-02-10T08:19:25.788 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_scrub_chunk_max": "25", 2024-02-10T08:19:25.788 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_scrub_chunk_min": "5", 2024-02-10T08:19:25.788 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_scrub_cost": "52428800", 2024-02-10T08:19:25.788 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_scrub_during_recovery": "false", 2024-02-10T08:19:25.788 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_scrub_end_hour": "0", 2024-02-10T08:19:25.788 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_scrub_end_week_day": "0", 2024-02-10T08:19:25.789 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-02-10T08:19:25.789 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-02-10T08:19:25.789 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_scrub_invalid_stats": "true", 2024-02-10T08:19:25.789 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_scrub_load_threshold": "0.500000", 2024-02-10T08:19:25.789 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_scrub_max_interval": "604800.000000", 2024-02-10T08:19:25.789 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_scrub_max_preemptions": "5", 2024-02-10T08:19:25.789 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_scrub_min_interval": "86400.000000", 2024-02-10T08:19:25.789 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_scrub_priority": "5", 2024-02-10T08:19:25.789 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_scrub_sleep": "0.000000", 2024-02-10T08:19:25.789 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_shutdown_pgref_assert": "false", 2024-02-10T08:19:25.789 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_skip_data_digest": "false", 2024-02-10T08:19:25.789 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_smart_report_timeout": "5", 2024-02-10T08:19:25.789 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_snap_trim_cost": "1048576", 2024-02-10T08:19:25.789 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_snap_trim_priority": "5", 2024-02-10T08:19:25.789 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_snap_trim_sleep": "0.000000", 2024-02-10T08:19:25.790 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-02-10T08:19:25.790 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-02-10T08:19:25.790 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-02-10T08:19:25.790 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-02-10T08:19:25.790 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_target_transaction_size": "30", 2024-02-10T08:19:25.790 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-02-10T08:19:25.790 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-02-10T08:19:25.790 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-02-10T08:19:25.790 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-02-10T08:19:25.790 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-02-10T08:19:25.790 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-02-10T08:19:25.790 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-02-10T08:19:25.790 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_tier_default_cache_mode": "writeback", 2024-02-10T08:19:25.790 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-02-10T08:19:25.790 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-02-10T08:19:25.791 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_tracing": "false", 2024-02-10T08:19:25.791 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_use_stale_snap": "false", 2024-02-10T08:19:25.791 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-02-10T08:19:25.791 INFO:teuthology.orchestra.run.smithi018.stdout: "osdc_blkin_trace_all": "false", 2024-02-10T08:19:25.791 INFO:teuthology.orchestra.run.smithi018.stdout: "paxos_kill_at": "0", 2024-02-10T08:19:25.791 INFO:teuthology.orchestra.run.smithi018.stdout: "paxos_max_join_drift": "10", 2024-02-10T08:19:25.791 INFO:teuthology.orchestra.run.smithi018.stdout: "paxos_min": "500", 2024-02-10T08:19:25.791 INFO:teuthology.orchestra.run.smithi018.stdout: "paxos_min_wait": "0.050000", 2024-02-10T08:19:25.791 INFO:teuthology.orchestra.run.smithi018.stdout: "paxos_propose_interval": "1.000000", 2024-02-10T08:19:25.791 INFO:teuthology.orchestra.run.smithi018.stdout: "paxos_service_trim_max": "500", 2024-02-10T08:19:25.791 INFO:teuthology.orchestra.run.smithi018.stdout: "paxos_service_trim_max_multiplier": "20", 2024-02-10T08:19:25.791 INFO:teuthology.orchestra.run.smithi018.stdout: "paxos_service_trim_min": "10", 2024-02-10T08:19:25.791 INFO:teuthology.orchestra.run.smithi018.stdout: "paxos_stash_full_interval": "25", 2024-02-10T08:19:25.791 INFO:teuthology.orchestra.run.smithi018.stdout: "paxos_trim_max": "500", 2024-02-10T08:19:25.791 INFO:teuthology.orchestra.run.smithi018.stdout: "paxos_trim_min": "250", 2024-02-10T08:19:25.791 INFO:teuthology.orchestra.run.smithi018.stdout: "perf": "true", 2024-02-10T08:19:25.792 INFO:teuthology.orchestra.run.smithi018.stdout: "pid_file": "", 2024-02-10T08:19:25.792 INFO:teuthology.orchestra.run.smithi018.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-02-10T08:19:25.792 INFO:teuthology.orchestra.run.smithi018.stdout: "plugin_dir": "/usr/lib64/ceph", 2024-02-10T08:19:25.792 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "-", 2024-02-10T08:19:25.792 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrv": "", 2024-02-10T08:19:25.792 INFO:teuthology.orchestra.run.smithi018.stdout: "public_bind_addr": "-", 2024-02-10T08:19:25.792 INFO:teuthology.orchestra.run.smithi018.stdout: "public_network": "", 2024-02-10T08:19:25.792 INFO:teuthology.orchestra.run.smithi018.stdout: "public_network_interface": "", 2024-02-10T08:19:25.792 INFO:teuthology.orchestra.run.smithi018.stdout: "qat_compressor_enabled": "false", 2024-02-10T08:19:25.792 INFO:teuthology.orchestra.run.smithi018.stdout: "rados_mon_op_timeout": "0", 2024-02-10T08:19:25.792 INFO:teuthology.orchestra.run.smithi018.stdout: "rados_osd_op_timeout": "0", 2024-02-10T08:19:25.792 INFO:teuthology.orchestra.run.smithi018.stdout: "rados_tracing": "false", 2024-02-10T08:19:25.792 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_atime_update_interval": "60", 2024-02-10T08:19:25.792 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-02-10T08:19:25.792 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_balance_parent_reads": "false", 2024-02-10T08:19:25.793 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_balance_snap_reads": "false", 2024-02-10T08:19:25.793 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_blkin_trace_all": "false", 2024-02-10T08:19:25.793 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_blocklist_expire_seconds": "0", 2024-02-10T08:19:25.793 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_blocklist_on_break_lock": "true", 2024-02-10T08:19:25.793 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_cache": "true", 2024-02-10T08:19:25.793 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_cache_block_writes_upfront": "false", 2024-02-10T08:19:25.793 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_cache_max_dirty": "25165824", 2024-02-10T08:19:25.793 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-02-10T08:19:25.793 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_cache_max_dirty_object": "0", 2024-02-10T08:19:25.793 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_cache_policy": "writearound", 2024-02-10T08:19:25.793 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_cache_size": "33554432", 2024-02-10T08:19:25.793 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_cache_target_dirty": "16777216", 2024-02-10T08:19:25.793 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-02-10T08:19:25.793 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_clone_copy_on_read": "false", 2024-02-10T08:19:25.794 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_compression_hint": "none", 2024-02-10T08:19:25.794 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_concurrent_management_ops": "10", 2024-02-10T08:19:25.794 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-02-10T08:19:25.794 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_default_clone_format": "auto", 2024-02-10T08:19:25.794 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_default_data_pool": "", 2024-02-10T08:19:25.794 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_default_features": "61", 2024-02-10T08:19:25.794 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_default_format": "2", 2024-02-10T08:19:25.794 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_default_map_options": "", 2024-02-10T08:19:25.794 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_default_order": "22", 2024-02-10T08:19:25.794 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_default_pool": "rbd", 2024-02-10T08:19:25.794 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-02-10T08:19:25.794 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_default_stripe_count": "0", 2024-02-10T08:19:25.794 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_default_stripe_unit": "0", 2024-02-10T08:19:25.794 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_disable_zero_copy_writes": "true", 2024-02-10T08:19:25.794 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_discard_granularity_bytes": "65536", 2024-02-10T08:19:25.795 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-02-10T08:19:25.795 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_enable_alloc_hint": "true", 2024-02-10T08:19:25.795 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-02-10T08:19:25.795 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_io_scheduler": "simple", 2024-02-10T08:19:25.795 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-02-10T08:19:25.795 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_journal_commit_age": "5.000000", 2024-02-10T08:19:25.795 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-02-10T08:19:25.795 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-02-10T08:19:25.795 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-02-10T08:19:25.795 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-02-10T08:19:25.795 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_journal_object_flush_interval": "0", 2024-02-10T08:19:25.795 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-02-10T08:19:25.795 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-02-10T08:19:25.795 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_journal_order": "24", 2024-02-10T08:19:25.795 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_journal_pool": "", 2024-02-10T08:19:25.796 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_journal_splay_width": "4", 2024-02-10T08:19:25.796 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_localize_parent_reads": "false", 2024-02-10T08:19:25.796 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_localize_snap_reads": "false", 2024-02-10T08:19:25.796 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-02-10T08:19:25.796 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-02-10T08:19:25.796 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-02-10T08:19:25.796 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-02-10T08:19:25.796 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-02-10T08:19:25.796 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-02-10T08:19:25.796 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirror_image_policy_type": "simple", 2024-02-10T08:19:25.796 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-02-10T08:19:25.796 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-02-10T08:19:25.796 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-02-10T08:19:25.796 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-02-10T08:19:25.797 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-02-10T08:19:25.797 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-02-10T08:19:25.797 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-02-10T08:19:25.797 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirror_memory_autotune": "true", 2024-02-10T08:19:25.797 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirror_memory_base": "805306368", 2024-02-10T08:19:25.797 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-02-10T08:19:25.797 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-02-10T08:19:25.797 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-02-10T08:19:25.797 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-02-10T08:19:25.797 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirror_memory_target": "4294967296", 2024-02-10T08:19:25.797 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-02-10T08:19:25.797 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-02-10T08:19:25.798 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-02-10T08:19:25.798 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirroring_delete_delay": "0", 2024-02-10T08:19:25.798 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-02-10T08:19:25.798 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirroring_replay_delay": "0", 2024-02-10T08:19:25.798 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-02-10T08:19:25.798 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-02-10T08:19:25.798 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_move_to_trash_on_remove": "false", 2024-02-10T08:19:25.798 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-02-10T08:19:25.798 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mtime_update_interval": "60", 2024-02-10T08:19:25.798 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_non_blocking_aio": "true", 2024-02-10T08:19:25.798 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_op_thread_timeout": "60", 2024-02-10T08:19:25.798 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_op_threads": "1", 2024-02-10T08:19:25.798 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_parent_cache_enabled": "false", 2024-02-10T08:19:25.798 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_persistent_cache_mode": "disabled", 2024-02-10T08:19:25.799 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_persistent_cache_path": "/tmp", 2024-02-10T08:19:25.799 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_persistent_cache_size": "1073741824", 2024-02-10T08:19:25.799 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_plugins": "", 2024-02-10T08:19:25.799 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_qos_bps_burst": "0", 2024-02-10T08:19:25.799 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-02-10T08:19:25.799 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_qos_bps_limit": "0", 2024-02-10T08:19:25.799 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_qos_iops_burst": "0", 2024-02-10T08:19:25.799 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-02-10T08:19:25.799 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_qos_iops_limit": "0", 2024-02-10T08:19:25.799 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_qos_read_bps_burst": "0", 2024-02-10T08:19:25.799 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-02-10T08:19:25.800 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_qos_read_bps_limit": "0", 2024-02-10T08:19:25.800 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_qos_read_iops_burst": "0", 2024-02-10T08:19:25.800 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-02-10T08:19:25.800 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_qos_read_iops_limit": "0", 2024-02-10T08:19:25.800 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_qos_schedule_tick_min": "50", 2024-02-10T08:19:25.800 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_qos_write_bps_burst": "0", 2024-02-10T08:19:25.800 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-02-10T08:19:25.800 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_qos_write_bps_limit": "0", 2024-02-10T08:19:25.800 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_qos_write_iops_burst": "0", 2024-02-10T08:19:25.800 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-02-10T08:19:25.800 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_qos_write_iops_limit": "0", 2024-02-10T08:19:25.800 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_quiesce_notification_attempts": "10", 2024-02-10T08:19:25.800 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_read_from_replica_policy": "default", 2024-02-10T08:19:25.800 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-02-10T08:19:25.801 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_readahead_max_bytes": "524288", 2024-02-10T08:19:25.801 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_readahead_trigger_requests": "10", 2024-02-10T08:19:25.801 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_request_timed_out_seconds": "30", 2024-02-10T08:19:25.801 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_skip_partial_discard": "true", 2024-02-10T08:19:25.801 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-02-10T08:19:25.801 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_tracing": "false", 2024-02-10T08:19:25.801 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_validate_names": "true", 2024-02-10T08:19:25.801 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_validate_pool": "true", 2024-02-10T08:19:25.801 INFO:teuthology.orchestra.run.smithi018.stdout: "restapi_base_url": "", 2024-02-10T08:19:25.801 INFO:teuthology.orchestra.run.smithi018.stdout: "restapi_log_level": "", 2024-02-10T08:19:25.801 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_acl_grants_max_num": "100", 2024-02-10T08:19:25.801 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_admin_entry": "admin", 2024-02-10T08:19:25.801 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_barbican_url": "", 2024-02-10T08:19:25.801 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-02-10T08:19:25.801 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-02-10T08:19:25.802 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_bucket_index_max_aio": "128", 2024-02-10T08:19:25.802 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-02-10T08:19:25.802 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_bucket_quota_ttl": "600", 2024-02-10T08:19:25.802 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_cache_enabled": "true", 2024-02-10T08:19:25.802 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_cache_expiry_interval": "900", 2024-02-10T08:19:25.802 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_cache_lru_size": "10000", 2024-02-10T08:19:25.802 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_content_length_compat": "false", 2024-02-10T08:19:25.802 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_copy_obj_progress": "true", 2024-02-10T08:19:25.802 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-02-10T08:19:25.802 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_cors_rules_max_num": "100", 2024-02-10T08:19:25.802 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_cross_domain_policy": "", 2024-02-10T08:19:25.802 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_default_encryption_key": "", 2024-02-10T08:19:25.802 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_kmip_addr": "", 2024-02-10T08:19:25.802 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_kmip_ca_path": "", 2024-02-10T08:19:25.802 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_kmip_client_cert": "", 2024-02-10T08:19:25.802 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_kmip_client_key": "", 2024-02-10T08:19:25.803 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-02-10T08:19:25.803 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_kmip_password": "", 2024-02-10T08:19:25.803 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-02-10T08:19:25.803 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_kmip_username": "", 2024-02-10T08:19:25.803 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_require_ssl": "true", 2024-02-10T08:19:25.803 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-02-10T08:19:25.803 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-02-10T08:19:25.803 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_suppress_logs": "true", 2024-02-10T08:19:25.803 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_vault_addr": "", 2024-02-10T08:19:25.803 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_vault_auth": "token", 2024-02-10T08:19:25.803 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_vault_namespace": "", 2024-02-10T08:19:25.803 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_vault_prefix": "", 2024-02-10T08:19:25.803 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-02-10T08:19:25.803 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-02-10T08:19:25.803 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-02-10T08:19:25.804 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-02-10T08:19:25.804 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_vault_token_file": "", 2024-02-10T08:19:25.804 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-02-10T08:19:25.804 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_curl_buffersize": "524288", 2024-02-10T08:19:25.804 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_curl_low_speed_limit": "1024", 2024-02-10T08:19:25.804 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_curl_low_speed_time": "300", 2024-02-10T08:19:25.804 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-02-10T08:19:25.804 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-02-10T08:19:25.804 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_data_log_changes_size": "1000", 2024-02-10T08:19:25.804 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_data_log_num_shards": "128", 2024-02-10T08:19:25.804 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-02-10T08:19:25.804 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_data_log_window": "30", 2024-02-10T08:19:25.804 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_data_notify_interval_msec": "200", 2024-02-10T08:19:25.804 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-02-10T08:19:25.804 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-02-10T08:19:25.805 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_default_data_log_backing": "fifo", 2024-02-10T08:19:25.805 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-02-10T08:19:25.805 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_default_region_info_oid": "default.region", 2024-02-10T08:19:25.805 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-02-10T08:19:25.805 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-02-10T08:19:25.805 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_defer_to_bucket_acls": "", 2024-02-10T08:19:25.805 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-02-10T08:19:25.805 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-02-10T08:19:25.805 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-02-10T08:19:25.805 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-02-10T08:19:25.805 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-02-10T08:19:25.805 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-02-10T08:19:25.805 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-02-10T08:19:25.805 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-02-10T08:19:25.805 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_dmclock_data_res": "500.000000", 2024-02-10T08:19:25.806 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-02-10T08:19:25.806 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-02-10T08:19:25.806 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-02-10T08:19:25.806 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-02-10T08:19:25.806 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_dns_name": "", 2024-02-10T08:19:25.806 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_dns_s3website_name": "", 2024-02-10T08:19:25.806 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_dynamic_resharding": "true", 2024-02-10T08:19:25.806 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-02-10T08:19:25.806 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_enable_gc_threads": "true", 2024-02-10T08:19:25.806 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_enable_lc_threads": "true", 2024-02-10T08:19:25.806 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_enable_ops_log": "false", 2024-02-10T08:19:25.806 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_enable_quota_threads": "true", 2024-02-10T08:19:25.806 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_enable_static_website": "false", 2024-02-10T08:19:25.806 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_enable_usage_log": "false", 2024-02-10T08:19:25.806 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_enforce_swift_acls": "true", 2024-02-10T08:19:25.807 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_exit_timeout_secs": "120", 2024-02-10T08:19:25.807 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_expose_bucket": "false", 2024-02-10T08:19:25.807 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_extended_http_attrs": "", 2024-02-10T08:19:25.807 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_fcgi_socket_backlog": "1024", 2024-02-10T08:19:25.807 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-02-10T08:19:25.807 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_frontends": "beast port=7480", 2024-02-10T08:19:25.807 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_gc_max_concurrent_io": "10", 2024-02-10T08:19:25.807 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_gc_max_deferred": "50", 2024-02-10T08:19:25.807 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-02-10T08:19:25.807 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_gc_max_objs": "32", 2024-02-10T08:19:25.807 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_gc_max_queue_size": "134213632", 2024-02-10T08:19:25.807 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_gc_max_trim_chunk": "16", 2024-02-10T08:19:25.807 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_gc_obj_min_wait": "7200", 2024-02-10T08:19:25.807 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_gc_processor_max_time": "3600", 2024-02-10T08:19:25.807 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_gc_processor_period": "3600", 2024-02-10T08:19:25.808 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-02-10T08:19:25.808 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_get_obj_window_size": "16777216", 2024-02-10T08:19:25.808 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_healthcheck_disabling_path": "", 2024-02-10T08:19:25.808 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_host": "", 2024-02-10T08:19:25.808 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_ignore_get_invalid_range": "false", 2024-02-10T08:19:25.808 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_init_timeout": "300", 2024-02-10T08:19:25.808 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-02-10T08:19:25.808 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-02-10T08:19:25.808 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-02-10T08:19:25.808 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_keystone_admin_domain": "", 2024-02-10T08:19:25.808 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_keystone_admin_password": "", 2024-02-10T08:19:25.809 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_keystone_admin_password_path": "", 2024-02-10T08:19:25.809 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_keystone_admin_project": "", 2024-02-10T08:19:25.809 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_keystone_admin_tenant": "", 2024-02-10T08:19:25.809 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_keystone_admin_token": "", 2024-02-10T08:19:25.809 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_keystone_admin_token_path": "", 2024-02-10T08:19:25.809 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_keystone_admin_user": "", 2024-02-10T08:19:25.809 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_keystone_api_version": "2", 2024-02-10T08:19:25.809 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_keystone_barbican_domain": "", 2024-02-10T08:19:25.809 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_keystone_barbican_password": "", 2024-02-10T08:19:25.809 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_keystone_barbican_project": "", 2024-02-10T08:19:25.809 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_keystone_barbican_tenant": "", 2024-02-10T08:19:25.809 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_keystone_barbican_user": "", 2024-02-10T08:19:25.809 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_keystone_implicit_tenants": "false", 2024-02-10T08:19:25.809 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_keystone_token_cache_size": "10000", 2024-02-10T08:19:25.809 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_keystone_url": "", 2024-02-10T08:19:25.810 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_keystone_verify_ssl": "true", 2024-02-10T08:19:25.810 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_lc_debug_interval": "-1", 2024-02-10T08:19:25.810 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_lc_lock_max_time": "90", 2024-02-10T08:19:25.810 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_lc_max_objs": "32", 2024-02-10T08:19:25.810 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_lc_max_rules": "1000", 2024-02-10T08:19:25.810 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_lc_max_worker": "3", 2024-02-10T08:19:25.810 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_lc_max_wp_worker": "3", 2024-02-10T08:19:25.810 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_lc_thread_delay": "0", 2024-02-10T08:19:25.810 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-02-10T08:19:25.810 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_ldap_dnattr": "uid", 2024-02-10T08:19:25.810 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-02-10T08:19:25.810 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_ldap_searchfilter": "", 2024-02-10T08:19:25.810 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-02-10T08:19:25.810 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_ldap_uri": "ldaps://", 2024-02-10T08:19:25.811 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-02-10T08:19:25.811 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-02-10T08:19:25.811 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-02-10T08:19:25.811 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_log_http_headers": "", 2024-02-10T08:19:25.811 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_log_nonexistent_bucket": "false", 2024-02-10T08:19:25.811 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-02-10T08:19:25.811 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_log_object_name_utc": "false", 2024-02-10T08:19:25.811 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_luarocks_location": "/tmp/luarocks", 2024-02-10T08:19:25.811 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_max_attr_name_len": "0", 2024-02-10T08:19:25.811 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_max_attr_size": "0", 2024-02-10T08:19:25.811 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_max_attrs_num_in_req": "0", 2024-02-10T08:19:25.811 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_max_chunk_size": "4194304", 2024-02-10T08:19:25.811 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_max_concurrent_requests": "1024", 2024-02-10T08:19:25.811 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_max_dynamic_shards": "1999", 2024-02-10T08:19:25.811 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_max_listing_results": "1000", 2024-02-10T08:19:25.812 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_max_notify_retries": "10", 2024-02-10T08:19:25.812 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_max_objs_per_shard": "100000", 2024-02-10T08:19:25.812 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_max_put_param_size": "1048576", 2024-02-10T08:19:25.812 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_max_put_size": "5368709120", 2024-02-10T08:19:25.812 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_max_slo_entries": "1000", 2024-02-10T08:19:25.812 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_md_log_max_shards": "64", 2024-02-10T08:19:25.812 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_md_notify_interval_msec": "200", 2024-02-10T08:19:25.812 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-02-10T08:19:25.812 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_mp_lock_max_time": "600", 2024-02-10T08:19:25.812 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-02-10T08:19:25.812 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_multipart_min_part_size": "5242880", 2024-02-10T08:19:25.812 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-02-10T08:19:25.812 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-02-10T08:19:25.812 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_nfs_fhcache_size": "2017", 2024-02-10T08:19:25.812 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-02-10T08:19:25.813 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_nfs_lru_lanes": "5", 2024-02-10T08:19:25.813 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_nfs_max_gc": "300", 2024-02-10T08:19:25.813 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-02-10T08:19:25.813 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_nfs_run_gc_threads": "false", 2024-02-10T08:19:25.813 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_nfs_run_lc_threads": "false", 2024-02-10T08:19:25.813 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_nfs_run_quota_threads": "false", 2024-02-10T08:19:25.813 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_nfs_run_sync_thread": "false", 2024-02-10T08:19:25.813 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-02-10T08:19:25.813 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-02-10T08:19:25.813 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_num_async_rados_threads": "32", 2024-02-10T08:19:25.813 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_num_control_oids": "8", 2024-02-10T08:19:25.813 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_num_rados_handles": "1", 2024-02-10T08:19:25.813 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_numa_node": "-1", 2024-02-10T08:19:25.813 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_obj_stripe_size": "4194304", 2024-02-10T08:19:25.813 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-02-10T08:19:25.814 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_objexp_chunk_size": "100", 2024-02-10T08:19:25.814 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_objexp_gc_interval": "600", 2024-02-10T08:19:25.814 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_objexp_hints_num_shards": "127", 2024-02-10T08:19:25.814 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-02-10T08:19:25.814 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-02-10T08:19:25.814 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_op_thread_timeout": "600", 2024-02-10T08:19:25.814 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_op_tracing": "false", 2024-02-10T08:19:25.814 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_opa_token": "", 2024-02-10T08:19:25.814 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_opa_url": "", 2024-02-10T08:19:25.814 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_opa_verify_ssl": "true", 2024-02-10T08:19:25.814 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-02-10T08:19:25.814 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_ops_log_file_path": "", 2024-02-10T08:19:25.814 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_ops_log_rados": "true", 2024-02-10T08:19:25.814 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_ops_log_socket_path": "", 2024-02-10T08:19:25.814 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-02-10T08:19:25.815 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-02-10T08:19:25.815 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_period_push_interval": "2.000000", 2024-02-10T08:19:25.815 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_period_push_interval_max": "30.000000", 2024-02-10T08:19:25.815 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_period_root_pool": ".rgw.root", 2024-02-10T08:19:25.815 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_port": "", 2024-02-10T08:19:25.815 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_print_continue": "true", 2024-02-10T08:19:25.815 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_print_prohibited_content_length": "false", 2024-02-10T08:19:25.815 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-02-10T08:19:25.815 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-02-10T08:19:25.815 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-02-10T08:19:25.815 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-02-10T08:19:25.815 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_rados_tracing": "false", 2024-02-10T08:19:25.815 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_realm": "", 2024-02-10T08:19:25.815 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-02-10T08:19:25.815 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_region": "", 2024-02-10T08:19:25.816 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_region_root_pool": ".rgw.root", 2024-02-10T08:19:25.816 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_relaxed_region_enforcement": "false", 2024-02-10T08:19:25.816 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-02-10T08:19:25.816 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-02-10T08:19:25.816 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_request_uri": "", 2024-02-10T08:19:25.816 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_reshard_batch_size": "64", 2024-02-10T08:19:25.816 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-02-10T08:19:25.816 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_reshard_max_aio": "128", 2024-02-10T08:19:25.816 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_reshard_num_logs": "16", 2024-02-10T08:19:25.816 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_reshard_thread_interval": "600", 2024-02-10T08:19:25.816 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_resolve_cname": "false", 2024-02-10T08:19:25.816 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_rest_getusage_op_compat": "false", 2024-02-10T08:19:25.816 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_run_sync_thread": "true", 2024-02-10T08:19:25.816 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-02-10T08:19:25.817 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_s3_auth_use_keystone": "false", 2024-02-10T08:19:25.817 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_s3_auth_use_ldap": "false", 2024-02-10T08:19:25.817 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_s3_auth_use_rados": "true", 2024-02-10T08:19:25.817 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_s3_auth_use_sts": "false", 2024-02-10T08:19:25.817 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_s3_success_create_obj_status": "0", 2024-02-10T08:19:25.817 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-02-10T08:19:25.817 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_scheduler_type": "throttler", 2024-02-10T08:19:25.817 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_script_uri": "", 2024-02-10T08:19:25.817 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_service_provider_name": "", 2024-02-10T08:19:25.817 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-02-10T08:19:25.817 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_socket_path": "", 2024-02-10T08:19:25.817 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_sts_client_id": "", 2024-02-10T08:19:25.817 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_sts_client_secret": "", 2024-02-10T08:19:25.817 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_sts_entry": "sts", 2024-02-10T08:19:25.817 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_sts_key": "sts", 2024-02-10T08:19:25.817 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_sts_max_session_duration": "43200", 2024-02-10T08:19:25.818 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_sts_min_session_duration": "900", 2024-02-10T08:19:25.818 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_sts_token_introspection_url": "", 2024-02-10T08:19:25.818 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_swift_account_in_url": "false", 2024-02-10T08:19:25.818 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_swift_auth_entry": "auth", 2024-02-10T08:19:25.818 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_swift_auth_url": "", 2024-02-10T08:19:25.818 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_swift_custom_header": "", 2024-02-10T08:19:25.818 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_swift_enforce_content_length": "false", 2024-02-10T08:19:25.818 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_swift_need_stats": "true", 2024-02-10T08:19:25.818 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_swift_tenant_name": "", 2024-02-10T08:19:25.818 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_swift_token_expiration": "86400", 2024-02-10T08:19:25.818 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_swift_url": "", 2024-02-10T08:19:25.818 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_swift_url_prefix": "swift", 2024-02-10T08:19:25.818 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_swift_versioning_enabled": "false", 2024-02-10T08:19:25.818 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-02-10T08:19:25.818 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_sync_lease_period": "120", 2024-02-10T08:19:25.819 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-02-10T08:19:25.819 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_sync_log_trim_interval": "1200", 2024-02-10T08:19:25.819 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-02-10T08:19:25.819 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-02-10T08:19:25.819 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-02-10T08:19:25.819 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_sync_obj_etag_verify": "false", 2024-02-10T08:19:25.819 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_sync_trace_history_size": "4096", 2024-02-10T08:19:25.819 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-02-10T08:19:25.819 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-02-10T08:19:25.819 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_thread_pool_size": "512", 2024-02-10T08:19:25.819 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_torrent_comment": "", 2024-02-10T08:19:25.819 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_torrent_createby": "", 2024-02-10T08:19:25.819 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_torrent_encoding": "", 2024-02-10T08:19:25.819 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_torrent_flag": "false", 2024-02-10T08:19:25.819 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_torrent_origin": "", 2024-02-10T08:19:25.820 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_torrent_sha_unit": "524288", 2024-02-10T08:19:25.820 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_torrent_tracker": "", 2024-02-10T08:19:25.820 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_trust_forwarded_https": "false", 2024-02-10T08:19:25.820 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-02-10T08:19:25.820 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_usage_log_tick_interval": "30", 2024-02-10T08:19:25.820 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_usage_max_shards": "32", 2024-02-10T08:19:25.820 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_usage_max_user_shards": "1", 2024-02-10T08:19:25.820 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_use_opa_authz": "false", 2024-02-10T08:19:25.820 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-02-10T08:19:25.820 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_user_default_quota_max_size": "-1", 2024-02-10T08:19:25.820 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_user_max_buckets": "1000", 2024-02-10T08:19:25.820 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-02-10T08:19:25.820 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-02-10T08:19:25.820 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_user_quota_sync_interval": "86400", 2024-02-10T08:19:25.820 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-02-10T08:19:25.821 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_user_unique_email": "true", 2024-02-10T08:19:25.821 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_verify_ssl": "true", 2024-02-10T08:19:25.821 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_website_routing_rules_max_num": "50", 2024-02-10T08:19:25.821 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_zone": "", 2024-02-10T08:19:25.821 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-02-10T08:19:25.821 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_zonegroup": "", 2024-02-10T08:19:25.821 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-02-10T08:19:25.821 INFO:teuthology.orchestra.run.smithi018.stdout: "rocksdb_block_size": "4096", 2024-02-10T08:19:25.821 INFO:teuthology.orchestra.run.smithi018.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-02-10T08:19:25.821 INFO:teuthology.orchestra.run.smithi018.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-02-10T08:19:25.821 INFO:teuthology.orchestra.run.smithi018.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-02-10T08:19:25.821 INFO:teuthology.orchestra.run.smithi018.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-02-10T08:19:25.821 INFO:teuthology.orchestra.run.smithi018.stdout: "rocksdb_cache_shard_bits": "4", 2024-02-10T08:19:25.821 INFO:teuthology.orchestra.run.smithi018.stdout: "rocksdb_cache_size": "536870912", 2024-02-10T08:19:25.821 INFO:teuthology.orchestra.run.smithi018.stdout: "rocksdb_cache_type": "binned_lru", 2024-02-10T08:19:25.822 INFO:teuthology.orchestra.run.smithi018.stdout: "rocksdb_cf_compact_on_deletion": "false", 2024-02-10T08:19:25.822 INFO:teuthology.orchestra.run.smithi018.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-02-10T08:19:25.822 INFO:teuthology.orchestra.run.smithi018.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-02-10T08:19:25.822 INFO:teuthology.orchestra.run.smithi018.stdout: "rocksdb_collect_compaction_stats": "false", 2024-02-10T08:19:25.822 INFO:teuthology.orchestra.run.smithi018.stdout: "rocksdb_collect_extended_stats": "false", 2024-02-10T08:19:25.822 INFO:teuthology.orchestra.run.smithi018.stdout: "rocksdb_collect_memory_stats": "false", 2024-02-10T08:19:25.822 INFO:teuthology.orchestra.run.smithi018.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-02-10T08:19:25.822 INFO:teuthology.orchestra.run.smithi018.stdout: "rocksdb_index_type": "binary_search", 2024-02-10T08:19:25.822 INFO:teuthology.orchestra.run.smithi018.stdout: "rocksdb_log_to_ceph_log": "true", 2024-02-10T08:19:25.822 INFO:teuthology.orchestra.run.smithi018.stdout: "rocksdb_metadata_block_size": "4096", 2024-02-10T08:19:25.822 INFO:teuthology.orchestra.run.smithi018.stdout: "rocksdb_partition_filters": "false", 2024-02-10T08:19:25.822 INFO:teuthology.orchestra.run.smithi018.stdout: "rocksdb_perf": "false", 2024-02-10T08:19:25.822 INFO:teuthology.orchestra.run.smithi018.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-02-10T08:19:25.822 INFO:teuthology.orchestra.run.smithi018.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-02-10T08:19:25.822 INFO:teuthology.orchestra.run.smithi018.stdout: "rotating_keys_renewal_timeout": "10", 2024-02-10T08:19:25.822 INFO:teuthology.orchestra.run.smithi018.stdout: "run_dir": "/var/run/ceph", 2024-02-10T08:19:25.823 INFO:teuthology.orchestra.run.smithi018.stdout: "setgroup": "ceph", 2024-02-10T08:19:25.823 INFO:teuthology.orchestra.run.smithi018.stdout: "setuser": "ceph", 2024-02-10T08:19:25.823 INFO:teuthology.orchestra.run.smithi018.stdout: "setuser_match_path": "", 2024-02-10T08:19:25.823 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_misplaced_ratio": "0.050000", 2024-02-10T08:19:25.823 INFO:teuthology.orchestra.run.smithi018.stdout: "thp": "false", 2024-02-10T08:19:25.823 INFO:teuthology.orchestra.run.smithi018.stdout: "threadpool_default_timeout": "60", 2024-02-10T08:19:25.823 INFO:teuthology.orchestra.run.smithi018.stdout: "threadpool_empty_queue_max_wait": "2", 2024-02-10T08:19:25.823 INFO:teuthology.orchestra.run.smithi018.stdout: "throttler_perf_counter": "true" 2024-02-10T08:19:25.823 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-02-10T08:19:26.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:24.191493+0000 osd.4 (osd.4) 49 : cluster [DBG] 4.e scrub starts 2024-02-10T08:19:26.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:24.195131+0000 osd.4 (osd.4) 50 : cluster [DBG] 4.e scrub ok 2024-02-10T08:19:26.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:24.197015+0000 osd.7 (osd.7) 49 : cluster [DBG] 6.8 scrub starts 2024-02-10T08:19:26.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:24.199916+0000 osd.7 (osd.7) 50 : cluster [DBG] 6.8 scrub ok 2024-02-10T08:19:26.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:24.478129+0000 mgr.y (mgr.14505) 104 : cluster [DBG] pgmap v90: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:19:26.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:24.857958+0000 osd.2 (osd.2) 45 : cluster [DBG] 5.d scrub starts 2024-02-10T08:19:26.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:24.859653+0000 osd.2 (osd.2) 46 : cluster [DBG] 5.d scrub ok 2024-02-10T08:19:26.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:24.191493+0000 osd.4 (osd.4) 49 : cluster [DBG] 4.e scrub starts 2024-02-10T08:19:26.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:24.195131+0000 osd.4 (osd.4) 50 : cluster [DBG] 4.e scrub ok 2024-02-10T08:19:26.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:24.197015+0000 osd.7 (osd.7) 49 : cluster [DBG] 6.8 scrub starts 2024-02-10T08:19:26.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:24.199916+0000 osd.7 (osd.7) 50 : cluster [DBG] 6.8 scrub ok 2024-02-10T08:19:26.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:24.478129+0000 mgr.y (mgr.14505) 104 : cluster [DBG] pgmap v90: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:19:26.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:24.857958+0000 osd.2 (osd.2) 45 : cluster [DBG] 5.d scrub starts 2024-02-10T08:19:26.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:24.859653+0000 osd.2 (osd.2) 46 : cluster [DBG] 5.d scrub ok 2024-02-10T08:19:26.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:24.191493+0000 osd.4 (osd.4) 49 : cluster [DBG] 4.e scrub starts 2024-02-10T08:19:26.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:24.195131+0000 osd.4 (osd.4) 50 : cluster [DBG] 4.e scrub ok 2024-02-10T08:19:26.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:24.197015+0000 osd.7 (osd.7) 49 : cluster [DBG] 6.8 scrub starts 2024-02-10T08:19:26.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:24.199916+0000 osd.7 (osd.7) 50 : cluster [DBG] 6.8 scrub ok 2024-02-10T08:19:26.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:24.478129+0000 mgr.y (mgr.14505) 104 : cluster [DBG] pgmap v90: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:19:26.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:24.857958+0000 osd.2 (osd.2) 45 : cluster [DBG] 5.d scrub starts 2024-02-10T08:19:26.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:24.859653+0000 osd.2 (osd.2) 46 : cluster [DBG] 5.d scrub ok 2024-02-10T08:19:26.504 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-02-10T08:19:26.782 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:19:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:19:26] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:19:26.790 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:19:27.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:25.565397+0000 osd.1 (osd.1) 55 : cluster [DBG] 6.1 scrub starts 2024-02-10T08:19:27.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:25.568335+0000 osd.1 (osd.1) 56 : cluster [DBG] 6.1 scrub ok 2024-02-10T08:19:27.062 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:25.565397+0000 osd.1 (osd.1) 55 : cluster [DBG] 6.1 scrub starts 2024-02-10T08:19:27.062 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:25.568335+0000 osd.1 (osd.1) 56 : cluster [DBG] 6.1 scrub ok 2024-02-10T08:19:27.063 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:25.565397+0000 osd.1 (osd.1) 55 : cluster [DBG] 6.1 scrub starts 2024-02-10T08:19:27.063 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:25.568335+0000 osd.1 (osd.1) 56 : cluster [DBG] 6.1 scrub ok 2024-02-10T08:19:27.340 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:19:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:19:27] "GET /metrics HTTP/1.1" 200 172125 "" "Prometheus/2.33.4" 2024-02-10T08:19:28.039 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:19:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:19:28.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:26.241527+0000 osd.4 (osd.4) 51 : cluster [DBG] 4.d scrub starts 2024-02-10T08:19:28.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:26.245085+0000 osd.4 (osd.4) 52 : cluster [DBG] 4.d scrub ok 2024-02-10T08:19:28.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:26.478563+0000 mgr.y (mgr.14505) 105 : cluster [DBG] pgmap v91: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-02-10T08:19:28.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:26.898859+0000 osd.2 (osd.2) 47 : cluster [DBG] 5.8 scrub starts 2024-02-10T08:19:28.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:26.899651+0000 osd.2 (osd.2) 48 : cluster [DBG] 5.8 scrub ok 2024-02-10T08:19:28.105 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:26.241527+0000 osd.4 (osd.4) 51 : cluster [DBG] 4.d scrub starts 2024-02-10T08:19:28.105 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:26.245085+0000 osd.4 (osd.4) 52 : cluster [DBG] 4.d scrub ok 2024-02-10T08:19:28.105 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:26.478563+0000 mgr.y (mgr.14505) 105 : cluster [DBG] pgmap v91: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-02-10T08:19:28.106 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:26.898859+0000 osd.2 (osd.2) 47 : cluster [DBG] 5.8 scrub starts 2024-02-10T08:19:28.106 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:26.899651+0000 osd.2 (osd.2) 48 : cluster [DBG] 5.8 scrub ok 2024-02-10T08:19:28.106 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:26.241527+0000 osd.4 (osd.4) 51 : cluster [DBG] 4.d scrub starts 2024-02-10T08:19:28.106 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:26.245085+0000 osd.4 (osd.4) 52 : cluster [DBG] 4.d scrub ok 2024-02-10T08:19:28.106 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:26.478563+0000 mgr.y (mgr.14505) 105 : cluster [DBG] pgmap v91: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-02-10T08:19:28.106 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:26.898859+0000 osd.2 (osd.2) 47 : cluster [DBG] 5.8 scrub starts 2024-02-10T08:19:28.106 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:26.899651+0000 osd.2 (osd.2) 48 : cluster [DBG] 5.8 scrub ok 2024-02-10T08:19:28.684 INFO:teuthology.orchestra.run.smithi018.stdout:mon.a: {} 2024-02-10T08:19:28.694 INFO:teuthology.orchestra.run.smithi018.stdout:mon.b: {} 2024-02-10T08:19:28.703 INFO:teuthology.orchestra.run.smithi018.stdout:mon.c: {} 2024-02-10T08:19:28.704 INFO:teuthology.orchestra.run.smithi018.stderr:mon.a: mon_osd_down_out_interval = '0' (not observed, change may require restart) 2024-02-10T08:19:28.704 INFO:teuthology.orchestra.run.smithi018.stderr:mon.b: mon_osd_down_out_interval = '0' (not observed, change may require restart) 2024-02-10T08:19:28.704 INFO:teuthology.orchestra.run.smithi018.stderr:mon.c: mon_osd_down_out_interval = '0' (not observed, change may require restart) 2024-02-10T08:19:29.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:27.275382+0000 osd.7 (osd.7) 51 : cluster [DBG] 6.12 deep-scrub starts 2024-02-10T08:19:29.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:27.276480+0000 osd.7 (osd.7) 52 : cluster [DBG] 6.12 deep-scrub ok 2024-02-10T08:19:29.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:27.286335+0000 osd.5 (osd.5) 45 : cluster [DBG] 5.1b scrub starts 2024-02-10T08:19:29.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:27.289236+0000 osd.5 (osd.5) 46 : cluster [DBG] 5.1b scrub ok 2024-02-10T08:19:29.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:19:27.559962+0000 mgr.y (mgr.14505) 106 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:19:29.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:28.175099+0000 osd.3 (osd.3) 57 : cluster [DBG] 2.1e scrub starts 2024-02-10T08:19:29.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:28.176339+0000 osd.3 (osd.3) 58 : cluster [DBG] 2.1e scrub ok 2024-02-10T08:19:29.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:28.454664+0000 osd.0 (osd.0) 51 : cluster [DBG] 6.9 scrub starts 2024-02-10T08:19:29.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:28.458123+0000 osd.0 (osd.0) 52 : cluster [DBG] 6.9 scrub ok 2024-02-10T08:19:29.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:19:28.674070+0000 mon.c (mon.2) 22 : audit [DBG] from='client.? 172.21.15.18:0/2894249537' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-10T08:19:29.114 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:27.275382+0000 osd.7 (osd.7) 51 : cluster [DBG] 6.12 deep-scrub starts 2024-02-10T08:19:29.114 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:27.276480+0000 osd.7 (osd.7) 52 : cluster [DBG] 6.12 deep-scrub ok 2024-02-10T08:19:29.114 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:27.286335+0000 osd.5 (osd.5) 45 : cluster [DBG] 5.1b scrub starts 2024-02-10T08:19:29.115 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:27.289236+0000 osd.5 (osd.5) 46 : cluster [DBG] 5.1b scrub ok 2024-02-10T08:19:29.115 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:19:27.559962+0000 mgr.y (mgr.14505) 106 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:19:29.115 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:28.175099+0000 osd.3 (osd.3) 57 : cluster [DBG] 2.1e scrub starts 2024-02-10T08:19:29.115 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:28.176339+0000 osd.3 (osd.3) 58 : cluster [DBG] 2.1e scrub ok 2024-02-10T08:19:29.115 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:28.454664+0000 osd.0 (osd.0) 51 : cluster [DBG] 6.9 scrub starts 2024-02-10T08:19:29.115 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:28.458123+0000 osd.0 (osd.0) 52 : cluster [DBG] 6.9 scrub ok 2024-02-10T08:19:29.115 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:19:28.674070+0000 mon.c (mon.2) 22 : audit [DBG] from='client.? 172.21.15.18:0/2894249537' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-10T08:19:29.115 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:27.275382+0000 osd.7 (osd.7) 51 : cluster [DBG] 6.12 deep-scrub starts 2024-02-10T08:19:29.115 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:27.276480+0000 osd.7 (osd.7) 52 : cluster [DBG] 6.12 deep-scrub ok 2024-02-10T08:19:29.115 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:27.286335+0000 osd.5 (osd.5) 45 : cluster [DBG] 5.1b scrub starts 2024-02-10T08:19:29.115 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:27.289236+0000 osd.5 (osd.5) 46 : cluster [DBG] 5.1b scrub ok 2024-02-10T08:19:29.115 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:19:27.559962+0000 mgr.y (mgr.14505) 106 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:19:29.116 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:28.175099+0000 osd.3 (osd.3) 57 : cluster [DBG] 2.1e scrub starts 2024-02-10T08:19:29.116 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:28.176339+0000 osd.3 (osd.3) 58 : cluster [DBG] 2.1e scrub ok 2024-02-10T08:19:29.116 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:28.454664+0000 osd.0 (osd.0) 51 : cluster [DBG] 6.9 scrub starts 2024-02-10T08:19:29.116 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:28.458123+0000 osd.0 (osd.0) 52 : cluster [DBG] 6.9 scrub ok 2024-02-10T08:19:29.116 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:19:28.674070+0000 mon.c (mon.2) 22 : audit [DBG] from='client.? 172.21.15.18:0/2894249537' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-10T08:19:29.527 INFO:teuthology.run_tasks:Running task full_sequential... 2024-02-10T08:19:29.537 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2024-02-10T08:19:29.566 INFO:tasks.radosbench:Beginning radosbench... 2024-02-10T08:19:29.566 INFO:tasks.cephadm.ceph_manager.ceph:creating pool_name unique_pool_0 2024-02-10T08:19:29.566 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd pool create unique_pool_0 16 2024-02-10T08:19:29.567 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-02-10T08:19:29.567 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-02-10T08:19:29.567 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-10T08:19:29.567 INFO:tasks.thrashosds.thrasher:Killing osd 4, live_osds are [0, 1, 2, 3, 4, 5, 6, 7] 2024-02-10T08:19:29.567 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-02-10T08:19:29.568 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ceph-d46257c8-c7eb-11ee-95b8-87774f69a715@osd.4 2024-02-10T08:19:29.568 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-02-10T08:19:29.568 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:19:29.569 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-02-10T08:19:29.569 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-10T08:19:29.569 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-02-10T08:19:29.569 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.0 dump_ops_in_flight 2024-02-10T08:19:29.570 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-02-10T08:19:29.570 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd set noscrub 2024-02-10T08:19:29.610 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:19:29.635 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:19:29.638 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:19:29.639 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:19:29.739 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:19:29.769 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:19:29.798 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:28.479280+0000 mgr.y (mgr.14505) 107 : cluster [DBG] pgmap v92: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-10T08:19:29.892 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:19:29.893 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:19:29.895 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:28.479280+0000 mgr.y (mgr.14505) 107 : cluster [DBG] pgmap v92: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-10T08:19:29.895 INFO:journalctl@ceph.osd.4.smithi071.stdout:Feb 10 08:19:29 smithi071 systemd[1]: Stopping Ceph osd.4 for d46257c8-c7eb-11ee-95b8-87774f69a715... 2024-02-10T08:19:29.895 INFO:journalctl@ceph.osd.4.smithi071.stdout:Feb 10 08:19:29 smithi071 bash[66503]: Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:19:29.896 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:19:29.896 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:19:29.942 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:19:29.950 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:19:29.951 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:19:29.997 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:19:30.024 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:19:30.043 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:19:30.045 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:19:30.045 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:19:30.146 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:19:30.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:28.479280+0000 mgr.y (mgr.14505) 107 : cluster [DBG] pgmap v92: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-10T08:19:30.171 INFO:journalctl@ceph.osd.4.smithi071.stdout:Feb 10 08:19:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-4[44981]: debug 2024-02-10T08:19:29.894+0000 7fd9bb721700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-10T08:19:30.171 INFO:journalctl@ceph.osd.4.smithi071.stdout:Feb 10 08:19:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-4[44981]: debug 2024-02-10T08:19:29.894+0000 7fd9bb721700 -1 osd.4 87 *** Got signal Terminated *** 2024-02-10T08:19:30.171 INFO:journalctl@ceph.osd.4.smithi071.stdout:Feb 10 08:19:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-4[44981]: debug 2024-02-10T08:19:29.894+0000 7fd9bb721700 -1 osd.4 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-10T08:19:30.175 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:19:30.191 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:19:30.194 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:19:30.194 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:19:30.295 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:19:30.321 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:19:30.338 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:19:30.341 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:19:30.341 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:19:30.443 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:19:30.476 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:19:30.804 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:19:30.812 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:19:30.812 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:19:30.913 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:19:30.943 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:19:30.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:29.204978+0000 osd.7 (osd.7) 53 : cluster [DBG] 6.1c deep-scrub starts 2024-02-10T08:19:30.961 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:29.207525+0000 osd.7 (osd.7) 54 : cluster [DBG] 6.1c deep-scrub ok 2024-02-10T08:19:30.961 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:29.249765+0000 osd.4 (osd.4) 53 : cluster [DBG] 4.1b scrub starts 2024-02-10T08:19:30.961 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:29.251628+0000 osd.4 (osd.4) 54 : cluster [DBG] 4.1b scrub ok 2024-02-10T08:19:30.961 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:29.493399+0000 osd.6 (osd.6) 35 : cluster [DBG] 4.1f scrub starts 2024-02-10T08:19:30.961 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:29.497081+0000 osd.6 (osd.6) 36 : cluster [DBG] 4.1f scrub ok 2024-02-10T08:19:30.961 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:29.899244+0000 mon.a (mon.0) 750 : cluster [INF] osd.4 marked itself down and dead 2024-02-10T08:19:30.961 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:29.204978+0000 osd.7 (osd.7) 53 : cluster [DBG] 6.1c deep-scrub starts 2024-02-10T08:19:30.961 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:29.207525+0000 osd.7 (osd.7) 54 : cluster [DBG] 6.1c deep-scrub ok 2024-02-10T08:19:30.961 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:29.249765+0000 osd.4 (osd.4) 53 : cluster [DBG] 4.1b scrub starts 2024-02-10T08:19:30.961 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:29.251628+0000 osd.4 (osd.4) 54 : cluster [DBG] 4.1b scrub ok 2024-02-10T08:19:30.961 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:29.493399+0000 osd.6 (osd.6) 35 : cluster [DBG] 4.1f scrub starts 2024-02-10T08:19:30.962 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:29.497081+0000 osd.6 (osd.6) 36 : cluster [DBG] 4.1f scrub ok 2024-02-10T08:19:30.962 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:29.899244+0000 mon.a (mon.0) 750 : cluster [INF] osd.4 marked itself down and dead 2024-02-10T08:19:31.139 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:29.204978+0000 osd.7 (osd.7) 53 : cluster [DBG] 6.1c deep-scrub starts 2024-02-10T08:19:31.139 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:29.207525+0000 osd.7 (osd.7) 54 : cluster [DBG] 6.1c deep-scrub ok 2024-02-10T08:19:31.139 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:29.249765+0000 osd.4 (osd.4) 53 : cluster [DBG] 4.1b scrub starts 2024-02-10T08:19:31.139 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:29.251628+0000 osd.4 (osd.4) 54 : cluster [DBG] 4.1b scrub ok 2024-02-10T08:19:31.139 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:29.493399+0000 osd.6 (osd.6) 35 : cluster [DBG] 4.1f scrub starts 2024-02-10T08:19:31.139 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:29.497081+0000 osd.6 (osd.6) 36 : cluster [DBG] 4.1f scrub ok 2024-02-10T08:19:31.139 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:29.899244+0000 mon.a (mon.0) 750 : cluster [INF] osd.4 marked itself down and dead 2024-02-10T08:19:31.141 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:19:31.158 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:19:31.159 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:19:31.259 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:19:31.289 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:19:31.539 INFO:journalctl@ceph.osd.4.smithi071.stdout:Feb 10 08:19:31 smithi071 bash[66559]: ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-4 2024-02-10T08:19:31.738 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:19:31.742 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:19:31.742 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:19:31.843 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:19:31.870 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:19:31.909 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:19:31.917 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:19:31.918 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:19:32.019 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:19:32.047 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:30.479610+0000 mgr.y (mgr.14505) 108 : cluster [DBG] pgmap v93: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 955 B/s rd, 0 op/s 2024-02-10T08:19:32.047 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:30.734209+0000 osd.0 (osd.0) 53 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:19:32.047 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:30.734290+0000 osd.0 (osd.0) 54 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:19:32.048 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:30.793075+0000 mon.a (mon.0) 751 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-10T08:19:32.048 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:30.800258+0000 mon.a (mon.0) 752 : cluster [DBG] osdmap e88: 8 total, 7 up, 8 in 2024-02-10T08:19:32.048 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:30.941756+0000 osd.2 (osd.2) 49 : cluster [DBG] 5.b scrub starts 2024-02-10T08:19:32.048 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:30.942643+0000 osd.2 (osd.2) 50 : cluster [DBG] 5.b scrub ok 2024-02-10T08:19:32.048 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:31.145649+0000 osd.3 (osd.3) 59 : cluster [DBG] 3.2 scrub starts 2024-02-10T08:19:32.048 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:31.148532+0000 osd.3 (osd.3) 60 : cluster [DBG] 3.2 scrub ok 2024-02-10T08:19:32.048 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:19:31.597397+0000 mon.a (mon.0) 753 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:19:32.050 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:19:32.071 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:19:32.073 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:19:32.073 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:19:32.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:30.479610+0000 mgr.y (mgr.14505) 108 : cluster [DBG] pgmap v93: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 955 B/s rd, 0 op/s 2024-02-10T08:19:32.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:30.734209+0000 osd.0 (osd.0) 53 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:19:32.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:30.734290+0000 osd.0 (osd.0) 54 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:19:32.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:30.793075+0000 mon.a (mon.0) 751 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-10T08:19:32.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:30.800258+0000 mon.a (mon.0) 752 : cluster [DBG] osdmap e88: 8 total, 7 up, 8 in 2024-02-10T08:19:32.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:30.941756+0000 osd.2 (osd.2) 49 : cluster [DBG] 5.b scrub starts 2024-02-10T08:19:32.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:30.942643+0000 osd.2 (osd.2) 50 : cluster [DBG] 5.b scrub ok 2024-02-10T08:19:32.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:31.145649+0000 osd.3 (osd.3) 59 : cluster [DBG] 3.2 scrub starts 2024-02-10T08:19:32.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:31.148532+0000 osd.3 (osd.3) 60 : cluster [DBG] 3.2 scrub ok 2024-02-10T08:19:32.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:19:31.597397+0000 mon.a (mon.0) 753 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:19:32.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:30.479610+0000 mgr.y (mgr.14505) 108 : cluster [DBG] pgmap v93: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 955 B/s rd, 0 op/s 2024-02-10T08:19:32.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:30.734209+0000 osd.0 (osd.0) 53 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:19:32.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:30.734290+0000 osd.0 (osd.0) 54 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:19:32.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:30.793075+0000 mon.a (mon.0) 751 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-10T08:19:32.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:30.800258+0000 mon.a (mon.0) 752 : cluster [DBG] osdmap e88: 8 total, 7 up, 8 in 2024-02-10T08:19:32.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:30.941756+0000 osd.2 (osd.2) 49 : cluster [DBG] 5.b scrub starts 2024-02-10T08:19:32.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:30.942643+0000 osd.2 (osd.2) 50 : cluster [DBG] 5.b scrub ok 2024-02-10T08:19:32.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:31.145649+0000 osd.3 (osd.3) 59 : cluster [DBG] 3.2 scrub starts 2024-02-10T08:19:32.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:31.148532+0000 osd.3 (osd.3) 60 : cluster [DBG] 3.2 scrub ok 2024-02-10T08:19:32.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:19:31.597397+0000 mon.a (mon.0) 753 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:19:32.174 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:19:32.201 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:19:32.299 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:19:32.302 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:19:32.302 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:19:32.403 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:19:32.430 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:19:32.450 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:19:32.452 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:19:32.453 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:19:32.554 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:19:32.583 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:19:32.731 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:19:32.733 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:19:32.734 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:19:32.835 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:19:32.867 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:19:32.872 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:31.558636+0000 osd.1 (osd.1) 57 : cluster [DBG] 2.a scrub starts 2024-02-10T08:19:32.872 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:31.561528+0000 osd.1 (osd.1) 58 : cluster [DBG] 2.a scrub ok 2024-02-10T08:19:32.872 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:31.715322+0000 osd.1 (osd.1) 59 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:19:32.872 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:31.715377+0000 osd.1 (osd.1) 60 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:19:32.873 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:31.801137+0000 mon.a (mon.0) 754 : cluster [DBG] osdmap e89: 8 total, 7 up, 8 in 2024-02-10T08:19:32.873 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:32.163364+0000 osd.3 (osd.3) 61 : cluster [DBG] 4.11 scrub starts 2024-02-10T08:19:32.873 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:32.166824+0000 osd.3 (osd.3) 62 : cluster [DBG] 4.11 scrub ok 2024-02-10T08:19:32.896 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:19:32.901 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:19:32.902 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:19:33.002 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:19:33.031 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:19:33.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:31.558636+0000 osd.1 (osd.1) 57 : cluster [DBG] 2.a scrub starts 2024-02-10T08:19:33.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:31.561528+0000 osd.1 (osd.1) 58 : cluster [DBG] 2.a scrub ok 2024-02-10T08:19:33.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:31.715322+0000 osd.1 (osd.1) 59 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:19:33.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:31.715377+0000 osd.1 (osd.1) 60 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:19:33.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:31.801137+0000 mon.a (mon.0) 754 : cluster [DBG] osdmap e89: 8 total, 7 up, 8 in 2024-02-10T08:19:33.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:32.163364+0000 osd.3 (osd.3) 61 : cluster [DBG] 4.11 scrub starts 2024-02-10T08:19:33.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:32.166824+0000 osd.3 (osd.3) 62 : cluster [DBG] 4.11 scrub ok 2024-02-10T08:19:33.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:31.558636+0000 osd.1 (osd.1) 57 : cluster [DBG] 2.a scrub starts 2024-02-10T08:19:33.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:31.561528+0000 osd.1 (osd.1) 58 : cluster [DBG] 2.a scrub ok 2024-02-10T08:19:33.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:31.715322+0000 osd.1 (osd.1) 59 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:19:33.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:31.715377+0000 osd.1 (osd.1) 60 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:19:33.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:31.801137+0000 mon.a (mon.0) 754 : cluster [DBG] osdmap e89: 8 total, 7 up, 8 in 2024-02-10T08:19:33.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:32.163364+0000 osd.3 (osd.3) 61 : cluster [DBG] 4.11 scrub starts 2024-02-10T08:19:33.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:32.166824+0000 osd.3 (osd.3) 62 : cluster [DBG] 4.11 scrub ok 2024-02-10T08:19:33.164 DEBUG:teuthology.orchestra.run.smithi071:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d46257c8-c7eb-11ee-95b8-87774f69a715@osd.4.service' 2024-02-10T08:19:33.218 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-10T08:19:33.218 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-02-10T08:19:33.218 INFO:tasks.thrashosds.thrasher:Testing ceph-objectstore-tool on down osd.4 2024-02-10T08:19:33.218 INFO:tasks.thrashosds.thrasher:remote for osd 4 is ubuntu@smithi071.front.sepia.ceph.com 2024-02-10T08:19:33.219 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -n osd.4 --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph-objectstore-tool --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-4 --journal-path /var/lib/ceph/osd/ceph-4/journal --op list-pgs 2024-02-10T08:19:33.422 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/osd.4/config 2024-02-10T08:19:33.481 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:19:33.484 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:19:33.484 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:19:33.585 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:19:33.611 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:19:33.683 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:19:33.686 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:19:33.686 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:19:33.791 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:19:33.826 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:19:33.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:32.480293+0000 mgr.y (mgr.14505) 109 : cluster [DBG] pgmap v96: 132 pgs: 19 active+undersized+degraded, 33 active+undersized, 80 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 79/576 objects degraded (13.715%) 2024-02-10T08:19:33.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:32.798766+0000 mon.a (mon.0) 755 : cluster [WRN] Health check failed: Degraded data redundancy: 79/576 objects degraded (13.715%), 19 pgs degraded (PG_DEGRADED) 2024-02-10T08:19:33.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:32.480293+0000 mgr.y (mgr.14505) 109 : cluster [DBG] pgmap v96: 132 pgs: 19 active+undersized+degraded, 33 active+undersized, 80 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 79/576 objects degraded (13.715%) 2024-02-10T08:19:33.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:32.798766+0000 mon.a (mon.0) 755 : cluster [WRN] Health check failed: Degraded data redundancy: 79/576 objects degraded (13.715%), 19 pgs degraded (PG_DEGRADED) 2024-02-10T08:19:33.977 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:32.480293+0000 mgr.y (mgr.14505) 109 : cluster [DBG] pgmap v96: 132 pgs: 19 active+undersized+degraded, 33 active+undersized, 80 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 79/576 objects degraded (13.715%) 2024-02-10T08:19:33.977 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:32.798766+0000 mon.a (mon.0) 755 : cluster [WRN] Health check failed: Degraded data redundancy: 79/576 objects degraded (13.715%), 19 pgs degraded (PG_DEGRADED) 2024-02-10T08:19:34.380 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:19:34.397 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:19:34.398 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:19:34.499 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:19:34.529 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:19:34.777 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:19:34.781 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:19:34.781 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:19:34.818 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is set 2024-02-10T08:19:34.882 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:19:34.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:33.295476+0000 osd.5 (osd.5) 47 : cluster [DBG] 5.15 deep-scrub starts 2024-02-10T08:19:34.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:33.299667+0000 osd.5 (osd.5) 48 : cluster [DBG] 5.15 deep-scrub ok 2024-02-10T08:19:34.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:19:34.467752+0000 mon.a (mon.0) 756 : audit [INF] from='client.? 172.21.15.18:0/2951687051' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:19:34.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:33.295476+0000 osd.5 (osd.5) 47 : cluster [DBG] 5.15 deep-scrub starts 2024-02-10T08:19:34.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:33.299667+0000 osd.5 (osd.5) 48 : cluster [DBG] 5.15 deep-scrub ok 2024-02-10T08:19:34.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:19:34.467752+0000 mon.a (mon.0) 756 : audit [INF] from='client.? 172.21.15.18:0/2951687051' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:19:34.910 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:19:34.963 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:19:34.963 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:19:34.975 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:19:34.993 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:19:35.009 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:19:35.011 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:19:35.012 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:33.295476+0000 osd.5 (osd.5) 47 : cluster [DBG] 5.15 deep-scrub starts 2024-02-10T08:19:35.012 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:33.299667+0000 osd.5 (osd.5) 48 : cluster [DBG] 5.15 deep-scrub ok 2024-02-10T08:19:35.012 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:19:34.467752+0000 mon.a (mon.0) 756 : audit [INF] from='client.? 172.21.15.18:0/2951687051' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:19:35.013 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:19:35.013 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:19:35.030 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:19:35.048 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:19:35.048 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-10T08:19:35.049 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-10T08:19:35.049 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-10T08:19:35.049 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-10T08:19:35.049 INFO:teuthology.orchestra.run.smithi018.stderr:Error ENXIO: problem getting command descriptions from osd.4 2024-02-10T08:19:35.049 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-10T08:19:35.049 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-10T08:19:35.050 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-10T08:19:35.114 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:19:35.145 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:19:35.599 INFO:teuthology.orchestra.run.smithi071.stdout:6.e 2024-02-10T08:19:35.599 INFO:teuthology.orchestra.run.smithi071.stdout:6.7 2024-02-10T08:19:35.599 INFO:teuthology.orchestra.run.smithi071.stdout:6.6 2024-02-10T08:19:35.599 INFO:teuthology.orchestra.run.smithi071.stdout:6.1e 2024-02-10T08:19:35.599 INFO:teuthology.orchestra.run.smithi071.stdout:6.1d 2024-02-10T08:19:35.599 INFO:teuthology.orchestra.run.smithi071.stdout:6.15 2024-02-10T08:19:35.599 INFO:teuthology.orchestra.run.smithi071.stdout:6.12 2024-02-10T08:19:35.599 INFO:teuthology.orchestra.run.smithi071.stdout:5.f 2024-02-10T08:19:35.600 INFO:teuthology.orchestra.run.smithi071.stdout:5.e 2024-02-10T08:19:35.600 INFO:teuthology.orchestra.run.smithi071.stdout:4.1b 2024-02-10T08:19:35.600 INFO:teuthology.orchestra.run.smithi071.stdout:4.13 2024-02-10T08:19:35.600 INFO:teuthology.orchestra.run.smithi071.stdout:2.b 2024-02-10T08:19:35.600 INFO:teuthology.orchestra.run.smithi071.stdout:4.e 2024-02-10T08:19:35.600 INFO:teuthology.orchestra.run.smithi071.stdout:3.1 2024-02-10T08:19:35.600 INFO:teuthology.orchestra.run.smithi071.stdout:5.a 2024-02-10T08:19:35.600 INFO:teuthology.orchestra.run.smithi071.stdout:2.6 2024-02-10T08:19:35.600 INFO:teuthology.orchestra.run.smithi071.stdout:2.13 2024-02-10T08:19:35.600 INFO:teuthology.orchestra.run.smithi071.stdout:6.17 2024-02-10T08:19:35.600 INFO:teuthology.orchestra.run.smithi071.stdout:5.1f 2024-02-10T08:19:35.600 INFO:teuthology.orchestra.run.smithi071.stdout:4.5 2024-02-10T08:19:35.600 INFO:teuthology.orchestra.run.smithi071.stdout:2.f 2024-02-10T08:19:35.600 INFO:teuthology.orchestra.run.smithi071.stdout:5.c 2024-02-10T08:19:35.600 INFO:teuthology.orchestra.run.smithi071.stdout:2.d 2024-02-10T08:19:35.601 INFO:teuthology.orchestra.run.smithi071.stdout:2.1f 2024-02-10T08:19:35.601 INFO:teuthology.orchestra.run.smithi071.stdout:6.1a 2024-02-10T08:19:35.601 INFO:teuthology.orchestra.run.smithi071.stdout:2.18 2024-02-10T08:19:35.601 INFO:teuthology.orchestra.run.smithi071.stdout:4.1a 2024-02-10T08:19:35.601 INFO:teuthology.orchestra.run.smithi071.stdout:4.2 2024-02-10T08:19:35.601 INFO:teuthology.orchestra.run.smithi071.stdout:6.14 2024-02-10T08:19:35.601 INFO:teuthology.orchestra.run.smithi071.stdout:4.18 2024-02-10T08:19:35.601 INFO:teuthology.orchestra.run.smithi071.stdout:2.5 2024-02-10T08:19:35.601 INFO:teuthology.orchestra.run.smithi071.stdout:4.1d 2024-02-10T08:19:35.601 INFO:teuthology.orchestra.run.smithi071.stdout:4.9 2024-02-10T08:19:35.601 INFO:teuthology.orchestra.run.smithi071.stdout:4.1 2024-02-10T08:19:35.601 INFO:teuthology.orchestra.run.smithi071.stdout:2.11 2024-02-10T08:19:35.601 INFO:teuthology.orchestra.run.smithi071.stdout:4.b 2024-02-10T08:19:35.601 INFO:teuthology.orchestra.run.smithi071.stdout:5.1a 2024-02-10T08:19:35.601 INFO:teuthology.orchestra.run.smithi071.stdout:6.f 2024-02-10T08:19:35.602 INFO:teuthology.orchestra.run.smithi071.stdout:6.2 2024-02-10T08:19:35.602 INFO:teuthology.orchestra.run.smithi071.stdout:5.1d 2024-02-10T08:19:35.602 INFO:teuthology.orchestra.run.smithi071.stdout:4.d 2024-02-10T08:19:35.602 INFO:teuthology.orchestra.run.smithi071.stdout:4.f 2024-02-10T08:19:35.602 INFO:teuthology.orchestra.run.smithi071.stdout:2.1a 2024-02-10T08:19:35.602 INFO:teuthology.orchestra.run.smithi071.stdout:5.0 2024-02-10T08:19:35.602 INFO:teuthology.orchestra.run.smithi071.stdout:4.c 2024-02-10T08:19:35.602 INFO:teuthology.orchestra.run.smithi071.stdout:5.10 2024-02-10T08:19:35.602 INFO:teuthology.orchestra.run.smithi071.stdout:5.11 2024-02-10T08:19:35.602 INFO:teuthology.orchestra.run.smithi071.stdout:5.18 2024-02-10T08:19:35.602 INFO:teuthology.orchestra.run.smithi071.stdout:5.1 2024-02-10T08:19:35.602 INFO:teuthology.orchestra.run.smithi071.stdout:5.1c 2024-02-10T08:19:35.602 INFO:teuthology.orchestra.run.smithi071.stdout:5.5 2024-02-10T08:19:35.602 INFO:teuthology.orchestra.run.smithi071.stdout:5.9 2024-02-10T08:19:35.812 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:34.225421+0000 osd.7 (osd.7) 55 : cluster [DBG] 5.4 scrub starts 2024-02-10T08:19:35.812 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:34.225421+0000 osd.7 (osd.7) 55 : cluster [DBG] 5.4 scrub starts 2024-02-10T08:19:35.812 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:34.226258+0000 osd.7 (osd.7) 56 : cluster [DBG] 5.4 scrub ok 2024-02-10T08:19:35.812 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:34.280973+0000 osd.5 (osd.5) 49 : cluster [DBG] 2.3 scrub starts 2024-02-10T08:19:35.812 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:34.283896+0000 osd.5 (osd.5) 50 : cluster [DBG] 2.3 scrub ok 2024-02-10T08:19:35.813 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:34.480791+0000 mgr.y (mgr.14505) 110 : cluster [DBG] pgmap v97: 132 pgs: 19 active+undersized+degraded, 33 active+undersized, 80 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 79/576 objects degraded (13.715%) 2024-02-10T08:19:35.813 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:34.805341+0000 mon.a (mon.0) 757 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:19:35.813 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:19:34.812538+0000 mon.a (mon.0) 758 : audit [INF] from='client.? 172.21.15.18:0/2951687051' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-10T08:19:35.813 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:34.812582+0000 mon.a (mon.0) 759 : cluster [DBG] osdmap e90: 8 total, 7 up, 8 in 2024-02-10T08:19:35.813 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:19:34.922129+0000 mon.c (mon.2) 23 : audit [DBG] from='client.? 172.21.15.18:0/2467145012' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:19:36.068 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:34.226258+0000 osd.7 (osd.7) 56 : cluster [DBG] 5.4 scrub ok 2024-02-10T08:19:36.068 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:34.280973+0000 osd.5 (osd.5) 49 : cluster [DBG] 2.3 scrub starts 2024-02-10T08:19:36.068 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:34.283896+0000 osd.5 (osd.5) 50 : cluster [DBG] 2.3 scrub ok 2024-02-10T08:19:36.068 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:34.480791+0000 mgr.y (mgr.14505) 110 : cluster [DBG] pgmap v97: 132 pgs: 19 active+undersized+degraded, 33 active+undersized, 80 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 79/576 objects degraded (13.715%) 2024-02-10T08:19:36.068 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:34.805341+0000 mon.a (mon.0) 757 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:19:36.068 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:19:34.812538+0000 mon.a (mon.0) 758 : audit [INF] from='client.? 172.21.15.18:0/2951687051' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-10T08:19:36.068 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:34.812582+0000 mon.a (mon.0) 759 : cluster [DBG] osdmap e90: 8 total, 7 up, 8 in 2024-02-10T08:19:36.069 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:19:34.922129+0000 mon.c (mon.2) 23 : audit [DBG] from='client.? 172.21.15.18:0/2467145012' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:19:36.131 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:34.225421+0000 osd.7 (osd.7) 55 : cluster [DBG] 5.4 scrub starts 2024-02-10T08:19:36.131 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:34.226258+0000 osd.7 (osd.7) 56 : cluster [DBG] 5.4 scrub ok 2024-02-10T08:19:36.131 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:34.280973+0000 osd.5 (osd.5) 49 : cluster [DBG] 2.3 scrub starts 2024-02-10T08:19:36.131 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:34.283896+0000 osd.5 (osd.5) 50 : cluster [DBG] 2.3 scrub ok 2024-02-10T08:19:36.131 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:34.480791+0000 mgr.y (mgr.14505) 110 : cluster [DBG] pgmap v97: 132 pgs: 19 active+undersized+degraded, 33 active+undersized, 80 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 79/576 objects degraded (13.715%) 2024-02-10T08:19:36.131 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:34.805341+0000 mon.a (mon.0) 757 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:19:36.132 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:19:34.812538+0000 mon.a (mon.0) 758 : audit [INF] from='client.? 172.21.15.18:0/2951687051' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-10T08:19:36.132 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:34.812582+0000 mon.a (mon.0) 759 : cluster [DBG] osdmap e90: 8 total, 7 up, 8 in 2024-02-10T08:19:36.132 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:19:34.922129+0000 mon.c (mon.2) 23 : audit [DBG] from='client.? 172.21.15.18:0/2467145012' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:19:36.548 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:19:36.551 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:19:36.552 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:19:36.569 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-02-10T08:19:36.570 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-02-10T08:19:36.653 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:19:36.685 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:19:36.789 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:19:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:19:36] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:19:36.825 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -n osd.4 --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph-objectstore-tool --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-4 --journal-path /var/lib/ceph/osd/ceph-4/journal --op export --pgid 2.d --file /var/log/ceph/exp.2.d.4 2024-02-10T08:19:36.885 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:19:36.888 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:19:36.888 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:19:36.989 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:19:37.016 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:19:37.039 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/osd.4/config 2024-02-10T08:19:37.039 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:19:37.041 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:19:37.042 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:19:37.142 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:19:37.169 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:19:37.293 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:19:37.295 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:19:37.296 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:19:37.397 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:19:37.404 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:19:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:19:37] "GET /metrics HTTP/1.1" 200 172205 "" "Prometheus/2.33.4" 2024-02-10T08:19:37.425 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:19:37.789 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:19:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:19:38.089 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd set nodeep-scrub 2024-02-10T08:19:38.117 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:36.481459+0000 mgr.y (mgr.14505) 111 : cluster [DBG] pgmap v99: 132 pgs: 19 active+undersized+degraded, 33 active+undersized, 80 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 79/576 objects degraded (13.715%) 2024-02-10T08:19:38.118 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:36.481459+0000 mgr.y (mgr.14505) 111 : cluster [DBG] pgmap v99: 132 pgs: 19 active+undersized+degraded, 33 active+undersized, 80 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 79/576 objects degraded (13.715%) 2024-02-10T08:19:38.216 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:36.481459+0000 mgr.y (mgr.14505) 111 : cluster [DBG] pgmap v99: 132 pgs: 19 active+undersized+degraded, 33 active+undersized, 80 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 79/576 objects degraded (13.715%) 2024-02-10T08:19:38.273 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:19:38.275 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:19:38.276 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:19:38.295 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-02-10T08:19:38.295 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:19:38.379 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:19:38.407 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:19:38.505 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:19:38.507 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:19:38.507 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:19:38.557 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:19:38.571 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-10T08:19:38.608 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:19:38.637 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:19:38.791 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:19:38.793 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:19:38.793 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:19:38.842 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'unique_pool_0' created 2024-02-10T08:19:38.894 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:19:38.922 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:19:38.942 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:19:38.948 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:19:38.948 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:19:39.049 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:19:39.075 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:19:37.570838+0000 mgr.y (mgr.14505) 112 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:19:39.076 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:19:37.937274+0000 mon.a (mon.0) 760 : audit [INF] from='client.? 172.21.15.18:0/337015963' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16}]: dispatch 2024-02-10T08:19:39.076 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:19:37.570838+0000 mgr.y (mgr.14505) 112 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:19:39.076 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:19:37.937274+0000 mon.a (mon.0) 760 : audit [INF] from='client.? 172.21.15.18:0/337015963' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16}]: dispatch 2024-02-10T08:19:39.077 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:19:39.078 INFO:teuthology.orchestra.run.smithi071.stderr:Exporting 2.d info 2.d( empty local-lis/les=54/55 n=0 ec=54/54 lis/c=54/54 les/c/f=55/55/0 sis=54) 2024-02-10T08:19:39.078 INFO:teuthology.orchestra.run.smithi071.stderr:Export successful 2024-02-10T08:19:39.200 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:19:39.203 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:19:39.203 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:19:39.214 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.0 dump_blocked_ops 2024-02-10T08:19:39.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:19:37.570838+0000 mgr.y (mgr.14505) 112 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:19:39.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:19:37.937274+0000 mon.a (mon.0) 760 : audit [INF] from='client.? 172.21.15.18:0/337015963' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16}]: dispatch 2024-02-10T08:19:39.305 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:19:39.332 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:19:39.487 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:19:39.489 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:19:39.489 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:19:39.535 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:19:39.591 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:19:39.618 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:19:39.741 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:19:39.744 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:19:39.745 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:19:39.845 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:19:39.873 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:38.482260+0000 mgr.y (mgr.14505) 113 : cluster [DBG] pgmap v100: 132 pgs: 19 active+undersized+degraded, 33 active+undersized, 80 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 79/576 objects degraded (13.715%) 2024-02-10T08:19:39.873 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:19:38.821435+0000 mon.a (mon.0) 761 : audit [INF] from='client.? 172.21.15.18:0/337015963' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16}]': finished 2024-02-10T08:19:39.873 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:38.821505+0000 mon.a (mon.0) 762 : cluster [DBG] osdmap e91: 8 total, 7 up, 8 in 2024-02-10T08:19:39.875 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:19:39.879 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:38.482260+0000 mgr.y (mgr.14505) 113 : cluster [DBG] pgmap v100: 132 pgs: 19 active+undersized+degraded, 33 active+undersized, 80 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 79/576 objects degraded (13.715%) 2024-02-10T08:19:39.879 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:19:38.821435+0000 mon.a (mon.0) 761 : audit [INF] from='client.? 172.21.15.18:0/337015963' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16}]': finished 2024-02-10T08:19:39.879 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:38.821505+0000 mon.a (mon.0) 762 : cluster [DBG] osdmap e91: 8 total, 7 up, 8 in 2024-02-10T08:19:39.880 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:38.482260+0000 mgr.y (mgr.14505) 113 : cluster [DBG] pgmap v100: 132 pgs: 19 active+undersized+degraded, 33 active+undersized, 80 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 79/576 objects degraded (13.715%) 2024-02-10T08:19:39.880 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:19:38.821435+0000 mon.a (mon.0) 761 : audit [INF] from='client.? 172.21.15.18:0/337015963' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16}]': finished 2024-02-10T08:19:39.880 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:38.821505+0000 mon.a (mon.0) 762 : cluster [DBG] osdmap e91: 8 total, 7 up, 8 in 2024-02-10T08:19:39.998 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:19:40.004 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:19:40.004 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:19:40.105 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:19:40.136 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:19:40.291 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -n osd.4 --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph-objectstore-tool --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-4 --journal-path /var/lib/ceph/osd/ceph-4/journal --force --op remove --pgid 2.d 2024-02-10T08:19:40.496 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/osd.4/config 2024-02-10T08:19:40.571 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd pool application enable unique_pool_0 rados --yes-i-really-mean-it || true 2024-02-10T08:19:40.836 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:39.821397+0000 mon.a (mon.0) 763 : cluster [DBG] osdmap e92: 8 total, 7 up, 8 in 2024-02-10T08:19:40.837 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:40.822732+0000 mon.a (mon.0) 764 : cluster [DBG] osdmap e93: 8 total, 7 up, 8 in 2024-02-10T08:19:41.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:39.821397+0000 mon.a (mon.0) 763 : cluster [DBG] osdmap e92: 8 total, 7 up, 8 in 2024-02-10T08:19:41.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:40.822732+0000 mon.a (mon.0) 764 : cluster [DBG] osdmap e93: 8 total, 7 up, 8 in 2024-02-10T08:19:41.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:39.821397+0000 mon.a (mon.0) 763 : cluster [DBG] osdmap e92: 8 total, 7 up, 8 in 2024-02-10T08:19:41.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:40.822732+0000 mon.a (mon.0) 764 : cluster [DBG] osdmap e93: 8 total, 7 up, 8 in 2024-02-10T08:19:41.290 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:19:41.292 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:19:41.293 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:19:41.393 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:19:41.422 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:19:41.870 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:19:41.873 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:19:41.874 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:19:41.974 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:19:42.005 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:19:42.111 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:41 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:40.482928+0000 mgr.y (mgr.14505) 114 : cluster [DBG] pgmap v103: 148 pgs: 16 unknown, 19 active+undersized+degraded, 33 active+undersized, 80 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 79/576 objects degraded (13.715%) 2024-02-10T08:19:42.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:40.482928+0000 mgr.y (mgr.14505) 114 : cluster [DBG] pgmap v103: 148 pgs: 16 unknown, 19 active+undersized+degraded, 33 active+undersized, 80 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 79/576 objects degraded (13.715%) 2024-02-10T08:19:42.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:40.482928+0000 mgr.y (mgr.14505) 114 : cluster [DBG] pgmap v103: 148 pgs: 16 unknown, 19 active+undersized+degraded, 33 active+undersized, 80 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 79/576 objects degraded (13.715%) 2024-02-10T08:19:42.363 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:19:42.367 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:19:42.368 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:19:42.402 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:19:42.411 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:19:42.469 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:19:42.498 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:19:42.516 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:19:42.518 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:19:42.519 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:19:42.620 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:19:42.651 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:19:42.676 INFO:teuthology.orchestra.run.smithi071.stdout: marking collection for removal 2024-02-10T08:19:42.676 INFO:teuthology.orchestra.run.smithi071.stdout:setting '_remove' omap key 2024-02-10T08:19:42.676 INFO:teuthology.orchestra.run.smithi071.stdout:finish_remove_pgs 2.d_head removing 2.d 2024-02-10T08:19:42.676 INFO:teuthology.orchestra.run.smithi071.stdout:Remove successful 2024-02-10T08:19:43.201 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:19:43.203 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:19:43.204 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:19:43.305 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:19:43.337 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:19:43.435 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:19:43.437 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:19:43.438 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:19:43.539 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:19:43.567 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:19:43.619 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:19:43.625 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:19:43.625 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:19:43.726 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:19:43.758 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:19:43.964 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -n osd.4 --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph-objectstore-tool --data-path /var/lib/ceph/osd/ceph-4 --journal-path /var/lib/ceph/osd/ceph-4/journal '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --op import --file /var/log/ceph/exp.2.d.4 2024-02-10T08:19:44.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:42.483724+0000 mgr.y (mgr.14505) 115 : cluster [DBG] pgmap v105: 148 pgs: 19 active+undersized+degraded, 38 active+undersized, 91 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s; 79/576 objects degraded (13.715%) 2024-02-10T08:19:44.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:42.483724+0000 mgr.y (mgr.14505) 115 : cluster [DBG] pgmap v105: 148 pgs: 19 active+undersized+degraded, 38 active+undersized, 91 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s; 79/576 objects degraded (13.715%) 2024-02-10T08:19:44.163 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/osd.4/config 2024-02-10T08:19:44.208 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:19:44.210 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:19:44.211 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:19:44.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:43 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:42.483724+0000 mgr.y (mgr.14505) 115 : cluster [DBG] pgmap v105: 148 pgs: 19 active+undersized+degraded, 38 active+undersized, 91 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s; 79/576 objects degraded (13.715%) 2024-02-10T08:19:44.311 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:19:44.338 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:19:44.410 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:19:44.413 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:19:44.413 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:19:44.514 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:19:44.546 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:19:46.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:44.484371+0000 mgr.y (mgr.14505) 116 : cluster [DBG] pgmap v106: 148 pgs: 19 active+undersized+degraded, 38 active+undersized, 91 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 79/576 objects degraded (13.715%) 2024-02-10T08:19:46.104 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:44.484371+0000 mgr.y (mgr.14505) 116 : cluster [DBG] pgmap v106: 148 pgs: 19 active+undersized+degraded, 38 active+undersized, 91 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 79/576 objects degraded (13.715%) 2024-02-10T08:19:46.104 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:44.484371+0000 mgr.y (mgr.14505) 116 : cluster [DBG] pgmap v106: 148 pgs: 19 active+undersized+degraded, 38 active+undersized, 91 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 79/576 objects degraded (13.715%) 2024-02-10T08:19:46.310 INFO:teuthology.orchestra.run.smithi071.stdout:get_pg_num_history pg_num_history pg_num_history(e87 pg_nums {1={19=1},2={54=32},3={54=3},4={56=32},5={58=32},6={60=32}} deleted_pools ) 2024-02-10T08:19:46.310 INFO:teuthology.orchestra.run.smithi071.stdout:Importing pgid 2.d 2024-02-10T08:19:46.310 INFO:teuthology.orchestra.run.smithi071.stdout:write_pg epoch 87 info 2.d( empty local-lis/les=54/55 n=0 ec=54/54 lis/c=54/54 les/c/f=55/55/0 sis=54) 2024-02-10T08:19:46.310 INFO:teuthology.orchestra.run.smithi071.stdout:Import successful 2024-02-10T08:19:46.497 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:19:46.501 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:19:46.501 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:19:46.602 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:19:46.634 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:19:46.654 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:19:46.656 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:19:46.656 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:19:46.757 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:19:46.782 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:19:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:19:46] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:19:46.784 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:19:46.802 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:19:46.805 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:19:46.805 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:19:46.906 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:19:46.945 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:19:47.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:19:46.096925+0000 mon.c (mon.2) 24 : audit [INF] from='client.? 172.21.15.18:0/3693304461' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:19:47.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:19:46.097244+0000 mon.a (mon.0) 765 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:19:47.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:19:46.598924+0000 mon.a (mon.0) 766 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:19:47.066 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:19:46.096925+0000 mon.c (mon.2) 24 : audit [INF] from='client.? 172.21.15.18:0/3693304461' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:19:47.067 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:19:46.097244+0000 mon.a (mon.0) 765 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:19:47.067 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:19:46.598924+0000 mon.a (mon.0) 766 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:19:47.067 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:19:46.096925+0000 mon.c (mon.2) 24 : audit [INF] from='client.? 172.21.15.18:0/3693304461' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:19:47.067 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:19:46.097244+0000 mon.a (mon.0) 765 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:19:47.067 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:19:46.598924+0000 mon.a (mon.0) 766 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:19:47.199 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:19:47.202 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:19:47.202 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:19:47.303 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:19:47.325 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is set 2024-02-10T08:19:47.329 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:19:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:19:47] "GET /metrics HTTP/1.1" 200 174746 "" "Prometheus/2.33.4" 2024-02-10T08:19:47.331 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:19:47.538 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f /var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/exp.2.d.4 2024-02-10T08:19:47.736 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-02-10T08:19:47.736 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:19:47.789 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:19:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:19:47.856 INFO:teuthology.orchestra.run.smithi018.stderr:enabled application 'rados' on pool 'unique_pool_0' 2024-02-10T08:19:47.881 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:46.485208+0000 mgr.y (mgr.14505) 117 : cluster [DBG] pgmap v107: 148 pgs: 19 active+undersized+degraded, 38 active+undersized, 91 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 667 B/s rd, 0 op/s; 79/576 objects degraded (13.715%) 2024-02-10T08:19:47.881 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:46.840891+0000 mon.a (mon.0) 767 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:19:47.881 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:19:46.847427+0000 mon.a (mon.0) 768 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-10T08:19:47.881 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:46.847488+0000 mon.a (mon.0) 769 : cluster [DBG] osdmap e94: 8 total, 7 up, 8 in 2024-02-10T08:19:47.881 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:19:47.298538+0000 mon.a (mon.0) 770 : audit [INF] from='client.? 172.21.15.18:0/147670906' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-02-10T08:19:47.881 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:46.485208+0000 mgr.y (mgr.14505) 117 : cluster [DBG] pgmap v107: 148 pgs: 19 active+undersized+degraded, 38 active+undersized, 91 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 667 B/s rd, 0 op/s; 79/576 objects degraded (13.715%) 2024-02-10T08:19:47.881 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:46.840891+0000 mon.a (mon.0) 767 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:19:47.881 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:19:46.847427+0000 mon.a (mon.0) 768 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-10T08:19:47.881 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:46.847488+0000 mon.a (mon.0) 769 : cluster [DBG] osdmap e94: 8 total, 7 up, 8 in 2024-02-10T08:19:47.882 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:19:47.298538+0000 mon.a (mon.0) 770 : audit [INF] from='client.? 172.21.15.18:0/147670906' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-02-10T08:19:47.995 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:19:47.995 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:19:48.001 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:19:48.019 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:19:48.037 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:19:48.055 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:19:48.072 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:19:48.072 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-10T08:19:48.073 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-10T08:19:48.073 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-10T08:19:48.073 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-10T08:19:48.073 INFO:teuthology.orchestra.run.smithi018.stderr:Error ENXIO: problem getting command descriptions from osd.4 2024-02-10T08:19:48.073 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-10T08:19:48.073 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-10T08:19:48.073 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-10T08:19:48.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:46.485208+0000 mgr.y (mgr.14505) 117 : cluster [DBG] pgmap v107: 148 pgs: 19 active+undersized+degraded, 38 active+undersized, 91 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 667 B/s rd, 0 op/s; 79/576 objects degraded (13.715%) 2024-02-10T08:19:48.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:46.840891+0000 mon.a (mon.0) 767 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:19:48.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:19:46.847427+0000 mon.a (mon.0) 768 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-10T08:19:48.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:46.847488+0000 mon.a (mon.0) 769 : cluster [DBG] osdmap e94: 8 total, 7 up, 8 in 2024-02-10T08:19:48.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:19:47.298538+0000 mon.a (mon.0) 770 : audit [INF] from='client.? 172.21.15.18:0/147670906' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-02-10T08:19:49.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:19:47.581699+0000 mgr.y (mgr.14505) 118 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:19:49.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:19:47.851066+0000 mon.a (mon.0) 771 : audit [INF] from='client.? 172.21.15.18:0/147670906' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}]': finished 2024-02-10T08:19:49.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:47.851136+0000 mon.a (mon.0) 772 : cluster [DBG] osdmap e95: 8 total, 7 up, 8 in 2024-02-10T08:19:49.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:19:47.945774+0000 mon.a (mon.0) 773 : audit [DBG] from='client.? 172.21.15.18:0/3107941268' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:19:49.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:19:47.581699+0000 mgr.y (mgr.14505) 118 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:19:49.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:19:47.851066+0000 mon.a (mon.0) 771 : audit [INF] from='client.? 172.21.15.18:0/147670906' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}]': finished 2024-02-10T08:19:49.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:47.851136+0000 mon.a (mon.0) 772 : cluster [DBG] osdmap e95: 8 total, 7 up, 8 in 2024-02-10T08:19:49.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:19:47.945774+0000 mon.a (mon.0) 773 : audit [DBG] from='client.? 172.21.15.18:0/3107941268' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:19:49.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:19:47.581699+0000 mgr.y (mgr.14505) 118 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:19:49.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:19:47.851066+0000 mon.a (mon.0) 771 : audit [INF] from='client.? 172.21.15.18:0/147670906' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}]': finished 2024-02-10T08:19:49.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:47.851136+0000 mon.a (mon.0) 772 : cluster [DBG] osdmap e95: 8 total, 7 up, 8 in 2024-02-10T08:19:49.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:19:47.945774+0000 mon.a (mon.0) 773 : audit [DBG] from='client.? 172.21.15.18:0/3107941268' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:19:49.482 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:19:49.485 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:19:49.486 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:19:49.586 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:19:49.617 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:19:49.717 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:19:49.720 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:19:49.721 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:19:49.821 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:19:49.850 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:19:49.994 DEBUG:teuthology.orchestra.run.smithi018:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 65536 --object-size 65536 -p unique_pool_0 bench 90 write' 2024-02-10T08:19:49.997 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2024-02-10T08:19:49.997 INFO:teuthology.orchestra.run:waiting for 3000 2024-02-10T08:19:50.120 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:48.485721+0000 mgr.y (mgr.14505) 119 : cluster [DBG] pgmap v110: 148 pgs: 19 active+undersized+degraded, 38 active+undersized, 91 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s; 79/576 objects degraded (13.715%) 2024-02-10T08:19:50.120 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:48.485721+0000 mgr.y (mgr.14505) 119 : cluster [DBG] pgmap v110: 148 pgs: 19 active+undersized+degraded, 38 active+undersized, 91 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s; 79/576 objects degraded (13.715%) 2024-02-10T08:19:50.139 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.0 dump_historic_ops 2024-02-10T08:19:50.194 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:hints = 1 2024-02-10T08:19:50.194 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Maintaining 16 concurrent writes of 65536 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2024-02-10T08:19:50.194 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Object prefix: benchmark_data_smithi018_80623 2024-02-10T08:19:50.194 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-02-10T08:19:50.195 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 0 0 0 0 0 0 - 0 2024-02-10T08:19:50.201 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:19:50.209 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:19:50.209 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:19:50.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:49 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:48.485721+0000 mgr.y (mgr.14505) 119 : cluster [DBG] pgmap v110: 148 pgs: 19 active+undersized+degraded, 38 active+undersized, 91 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s; 79/576 objects degraded (13.715%) 2024-02-10T08:19:50.310 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:19:50.375 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:19:50.735 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:19:50.740 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:19:50.741 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:19:50.768 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-02-10T08:19:50.769 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-02-10T08:19:50.843 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:19:50.866 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:19:50.873 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:19:50.897 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:19:50.899 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:19:50.900 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:19:51.000 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:19:51.034 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:19:51.056 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:19:51.060 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:19:51.060 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:19:51.161 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:19:51.195 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 1 16 2940 2924 182.739 182.75 0.0118678 0.00546024 2024-02-10T08:19:51.211 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:19:51.240 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:19:51.244 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:19:51.244 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:19:51.346 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:19:51.396 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:19:51.426 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:19:51.431 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:19:51.431 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:19:51.446 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:50.486532+0000 mgr.y (mgr.14505) 120 : cluster [DBG] pgmap v111: 148 pgs: 19 active+undersized+degraded, 38 active+undersized, 91 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 79/576 objects degraded (13.715%) 2024-02-10T08:19:51.447 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:50.486532+0000 mgr.y (mgr.14505) 120 : cluster [DBG] pgmap v111: 148 pgs: 19 active+undersized+degraded, 38 active+undersized, 91 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 79/576 objects degraded (13.715%) 2024-02-10T08:19:51.470 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd unset noscrub 2024-02-10T08:19:51.532 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:19:51.565 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:19:51.586 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:19:51.590 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:19:51.590 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:19:51.691 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:19:51.749 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:19:51.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:51 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:50.486532+0000 mgr.y (mgr.14505) 120 : cluster [DBG] pgmap v111: 148 pgs: 19 active+undersized+degraded, 38 active+undersized, 91 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 79/576 objects degraded (13.715%) 2024-02-10T08:19:51.803 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:19:51.807 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:19:51.807 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:19:51.908 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:19:51.958 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:19:52.005 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:19:52.014 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:19:52.015 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:19:52.115 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:19:52.148 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:19:52.173 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:19:52.175 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:19:52.176 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:19:52.196 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 2 16 5640 5624 175.668 168.75 0.0048913 0.00568206 2024-02-10T08:19:52.276 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:19:52.328 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:19:52.359 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:19:52.364 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:19:52.365 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:19:52.466 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:19:52.498 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:19:52.522 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:19:52.524 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:19:52.527 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:19:52.567 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [4] live_osds: [0, 1, 2, 3, 5, 6, 7] 2024-02-10T08:19:52.567 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-10T08:19:52.568 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-02-10T08:19:52.568 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd dump -f json-pretty 2024-02-10T08:19:52.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:52.541449+0000 mon.a (mon.0) 774 : cluster [WRN] Health check update: Degraded data redundancy: 2111/19605 objects degraded (10.768%), 24 pgs degraded (PG_DEGRADED) 2024-02-10T08:19:52.628 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:19:52.699 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:19:52.741 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:19:52.745 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:19:52.746 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:19:52.769 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-10T08:19:52.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:52 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:52.541449+0000 mon.a (mon.0) 774 : cluster [WRN] Health check update: Degraded data redundancy: 2111/19605 objects degraded (10.768%), 24 pgs degraded (PG_DEGRADED) 2024-02-10T08:19:52.847 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:19:52.898 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:52.541449+0000 mon.a (mon.0) 774 : cluster [WRN] Health check update: Degraded data redundancy: 2111/19605 objects degraded (10.768%), 24 pgs degraded (PG_DEGRADED) 2024-02-10T08:19:52.901 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:19:52.954 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:19:52.958 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:19:52.959 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:19:53.059 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:19:53.080 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:19:53.088 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:19:53.109 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:19:53.111 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:19:53.111 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:19:53.177 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-02-10T08:19:53.177 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-02-10T08:19:53.177 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-02-10T08:19:53.177 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-02-10T08:19:53.177 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.178 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:496 7.6 7:6e5e126b:::benchmark_data_smithi018_80623_object495:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e95)", 2024-02-10T08:19:53.178 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:19:50.370973+0000", 2024-02-10T08:19:53.178 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 2.8004964719999998, 2024-02-10T08:19:53.178 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015684287000000002, 2024-02-10T08:19:53.178 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:19:53.178 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:19:53.178 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:19:53.178 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:19:53.178 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:19:53.178 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 496 2024-02-10T08:19:53.178 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.178 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:19:53.178 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.178 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:19:53.178 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:50.370973+0000", 2024-02-10T08:19:53.179 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:19:53.179 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.179 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.179 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:19:53.179 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:50.370973+0000", 2024-02-10T08:19:53.179 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:19:53.179 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.179 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.179 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:19:53.179 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:50.370972+0000", 2024-02-10T08:19:53.179 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5822000000000001e-05 2024-02-10T08:19:53.179 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.179 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.179 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:19:53.179 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:50.370998+0000", 2024-02-10T08:19:53.180 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1856e-05 2024-02-10T08:19:53.180 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.180 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.180 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:19:53.180 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:50.371010+0000", 2024-02-10T08:19:53.180 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7009999999999999e-06 2024-02-10T08:19:53.180 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.180 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.180 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:19:53.180 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:50.371016+0000", 2024-02-10T08:19:53.180 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010614 2024-02-10T08:19:53.180 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.180 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.180 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:19:53.181 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:50.371122+0000", 2024-02-10T08:19:53.181 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011925 2024-02-10T08:19:53.181 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.181 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.181 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:19:53.181 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:50.371242+0000", 2024-02-10T08:19:53.181 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000151512 2024-02-10T08:19:53.181 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.181 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.181 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,7", 2024-02-10T08:19:53.181 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:50.371393+0000", 2024-02-10T08:19:53.181 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0012662039999999999 2024-02-10T08:19:53.181 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.181 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.181 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:19:53.182 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:50.372659+0000", 2024-02-10T08:19:53.182 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00043943900000000002 2024-02-10T08:19:53.182 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.182 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.182 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:19:53.182 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:50.373099+0000", 2024-02-10T08:19:53.182 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013468183999999999 2024-02-10T08:19:53.182 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.182 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.182 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:19:53.182 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:50.386567+0000", 2024-02-10T08:19:53.182 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4128000000000001e-05 2024-02-10T08:19:53.182 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.182 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.182 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:19:53.183 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:50.386621+0000", 2024-02-10T08:19:53.183 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6538999999999997e-05 2024-02-10T08:19:53.183 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.183 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.183 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:19:53.183 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:50.386658+0000", 2024-02-10T08:19:53.183 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015684287000000002 2024-02-10T08:19:53.183 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:19:53.183 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:19:53.183 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:19:53.184 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.184 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.184 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:509 7.6 7:6fba034f:::benchmark_data_smithi018_80623_object508:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e95)", 2024-02-10T08:19:53.184 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:19:50.375528+0000", 2024-02-10T08:19:53.184 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 2.795941708, 2024-02-10T08:19:53.184 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.016133232000000001, 2024-02-10T08:19:53.184 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:19:53.184 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:19:53.184 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:19:53.184 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:19:53.184 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:19:53.184 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 509 2024-02-10T08:19:53.184 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.184 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:19:53.184 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.185 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:19:53.185 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:50.375528+0000", 2024-02-10T08:19:53.185 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:19:53.185 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.185 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.185 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:19:53.185 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:50.375528+0000", 2024-02-10T08:19:53.185 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999981 2024-02-10T08:19:53.185 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.185 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.185 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:19:53.185 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:50.375526+0000", 2024-02-10T08:19:53.185 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2329999999999997e-05 2024-02-10T08:19:53.185 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.185 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.186 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:19:53.186 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:50.375559+0000", 2024-02-10T08:19:53.186 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.083e-05 2024-02-10T08:19:53.186 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.186 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.186 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:19:53.186 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:50.375569+0000", 2024-02-10T08:19:53.186 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5169999999999999e-06 2024-02-10T08:19:53.186 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.186 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.186 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:19:53.186 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:50.375578+0000", 2024-02-10T08:19:53.186 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0617e-05 2024-02-10T08:19:53.186 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.186 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.187 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:19:53.187 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:50.375629+0000", 2024-02-10T08:19:53.187 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013155099999999999 2024-02-10T08:19:53.187 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.187 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.187 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:19:53.187 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:50.375760+0000", 2024-02-10T08:19:53.187 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015669800000000001 2024-02-10T08:19:53.187 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.187 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.187 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,7", 2024-02-10T08:19:53.187 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:50.375917+0000", 2024-02-10T08:19:53.187 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00084580799999999998 2024-02-10T08:19:53.187 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.187 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.188 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:19:53.188 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:50.376763+0000", 2024-02-10T08:19:53.188 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001209578 2024-02-10T08:19:53.188 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.188 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.188 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:19:53.188 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:50.377972+0000", 2024-02-10T08:19:53.188 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013573231 2024-02-10T08:19:53.188 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.188 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.188 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:19:53.188 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:50.391545+0000", 2024-02-10T08:19:53.188 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0944000000000003e-05 2024-02-10T08:19:53.189 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.189 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.189 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:19:53.189 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:50.391626+0000", 2024-02-10T08:19:53.189 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5046000000000003e-05 2024-02-10T08:19:53.189 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.189 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.189 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:19:53.189 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:50.391661+0000", 2024-02-10T08:19:53.189 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.016133232000000001 2024-02-10T08:19:53.189 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:19:53.189 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:19:53.190 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:19:53.190 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.190 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.190 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:3751 7.4 7:23f464fd:::benchmark_data_smithi018_80623_object3750:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e95)", 2024-02-10T08:19:53.190 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:19:51.495746+0000", 2024-02-10T08:19:53.190 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 1.6757242460000001, 2024-02-10T08:19:53.190 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015837015999999999, 2024-02-10T08:19:53.190 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:19:53.190 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:19:53.190 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:19:53.190 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:19:53.190 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:19:53.191 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 3751 2024-02-10T08:19:53.191 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.191 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:19:53.191 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.191 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:19:53.191 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:51.495746+0000", 2024-02-10T08:19:53.191 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:19:53.191 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.191 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.191 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:19:53.191 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:51.495746+0000", 2024-02-10T08:19:53.191 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:19:53.191 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.192 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.192 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:19:53.192 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:51.495745+0000", 2024-02-10T08:19:53.192 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2982000000000001e-05 2024-02-10T08:19:53.192 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.192 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.192 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:19:53.192 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:51.495768+0000", 2024-02-10T08:19:53.192 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8709999999999999e-06 2024-02-10T08:19:53.192 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.192 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.192 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:19:53.192 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:51.495775+0000", 2024-02-10T08:19:53.192 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6670000000000004e-06 2024-02-10T08:19:53.192 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.193 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.193 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:19:53.193 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:51.495780+0000", 2024-02-10T08:19:53.193 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0024505540000000002 2024-02-10T08:19:53.193 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.193 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.193 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:19:53.193 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:51.498230+0000", 2024-02-10T08:19:53.193 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00029906300000000002 2024-02-10T08:19:53.193 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.193 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.193 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:19:53.193 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:51.498529+0000", 2024-02-10T08:19:53.193 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015989699999999999 2024-02-10T08:19:53.193 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.194 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.194 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-02-10T08:19:53.194 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:51.498689+0000", 2024-02-10T08:19:53.194 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00046136099999999998 2024-02-10T08:19:53.194 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.194 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.194 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:19:53.194 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:51.499150+0000", 2024-02-10T08:19:53.194 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.012349690999999999 2024-02-10T08:19:53.194 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.194 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.194 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:19:53.194 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:51.511500+0000", 2024-02-10T08:19:53.194 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1721999999999999e-05 2024-02-10T08:19:53.194 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.195 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.195 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:19:53.195 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:51.511532+0000", 2024-02-10T08:19:53.195 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0878000000000003e-05 2024-02-10T08:19:53.195 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.195 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.195 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:19:53.195 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:51.511583+0000", 2024-02-10T08:19:53.195 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015837015999999999 2024-02-10T08:19:53.195 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:19:53.195 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:19:53.195 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:19:53.195 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.195 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.195 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:4593 7.f 7:f632ba3b:::benchmark_data_smithi018_80623_object4592:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e95)", 2024-02-10T08:19:53.196 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:19:51.829785+0000", 2024-02-10T08:19:53.196 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 1.341684809, 2024-02-10T08:19:53.196 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.016421873999999999, 2024-02-10T08:19:53.196 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:19:53.196 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:19:53.196 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:19:53.196 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:19:53.196 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:19:53.196 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 4593 2024-02-10T08:19:53.196 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.196 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:19:53.196 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.196 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:19:53.196 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:51.829785+0000", 2024-02-10T08:19:53.197 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:19:53.197 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.197 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.197 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:19:53.197 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:51.829785+0000", 2024-02-10T08:19:53.197 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999981 2024-02-10T08:19:53.197 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.197 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.197 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:19:53.197 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:51.829783+0000", 2024-02-10T08:19:53.197 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.4697000000000001e-05 2024-02-10T08:19:53.197 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.197 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.197 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:19:53.197 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:51.829808+0000", 2024-02-10T08:19:53.198 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4259999999999992e-06 2024-02-10T08:19:53.198 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.198 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.198 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:19:53.198 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:51.829817+0000", 2024-02-10T08:19:53.198 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2960000000000004e-06 2024-02-10T08:19:53.198 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.198 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.198 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:19:53.198 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:51.829824+0000", 2024-02-10T08:19:53.198 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5964000000000003e-05 2024-02-10T08:19:53.198 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.198 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.198 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:19:53.198 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:51.829860+0000", 2024-02-10T08:19:53.199 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000109949 2024-02-10T08:19:53.199 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.199 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.199 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:19:53.199 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:51.829970+0000", 2024-02-10T08:19:53.199 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000167665 2024-02-10T08:19:53.199 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.199 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.199 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,7", 2024-02-10T08:19:53.199 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:51.830137+0000", 2024-02-10T08:19:53.199 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0012457810000000001 2024-02-10T08:19:53.199 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.199 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.199 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:19:53.199 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:51.831383+0000", 2024-02-10T08:19:53.200 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001080772 2024-02-10T08:19:53.200 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.200 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.200 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:19:53.200 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:51.832464+0000", 2024-02-10T08:19:53.200 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013639047 2024-02-10T08:19:53.200 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.200 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.200 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:19:53.200 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:51.846103+0000", 2024-02-10T08:19:53.200 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.245e-05 2024-02-10T08:19:53.200 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.200 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.200 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:19:53.200 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:51.846165+0000", 2024-02-10T08:19:53.201 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1671000000000001e-05 2024-02-10T08:19:53.201 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.201 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.201 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:19:53.201 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:51.846207+0000", 2024-02-10T08:19:53.201 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.016421873999999999 2024-02-10T08:19:53.201 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:19:53.201 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:19:53.201 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:19:53.201 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.201 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.201 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:4597 7.6 7:6121dbd1:::benchmark_data_smithi018_80623_object4596:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e95)", 2024-02-10T08:19:53.201 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:19:51.829917+0000", 2024-02-10T08:19:53.201 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 1.341553215, 2024-02-10T08:19:53.201 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.017185038999999999, 2024-02-10T08:19:53.201 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:19:53.202 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:19:53.202 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:19:53.202 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:19:53.202 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:19:53.202 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 4597 2024-02-10T08:19:53.202 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.202 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:19:53.202 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.202 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:19:53.202 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:51.829917+0000", 2024-02-10T08:19:53.202 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:19:53.202 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.202 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.202 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:19:53.202 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:51.829917+0000", 2024-02-10T08:19:53.203 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:19:53.203 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.203 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.203 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:19:53.203 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:51.829916+0000", 2024-02-10T08:19:53.203 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2328e-05 2024-02-10T08:19:53.203 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.203 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.203 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:19:53.203 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:51.829938+0000", 2024-02-10T08:19:53.203 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.02e-06 2024-02-10T08:19:53.203 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.203 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.203 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:19:53.203 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:51.829944+0000", 2024-02-10T08:19:53.204 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5020000000000003e-06 2024-02-10T08:19:53.204 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.204 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.204 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:19:53.204 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:51.829949+0000", 2024-02-10T08:19:53.204 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7405000000000007e-05 2024-02-10T08:19:53.204 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.204 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.204 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:19:53.204 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:51.830046+0000", 2024-02-10T08:19:53.204 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012488399999999999 2024-02-10T08:19:53.204 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.204 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.204 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:19:53.205 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:51.830171+0000", 2024-02-10T08:19:53.205 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014864300000000001 2024-02-10T08:19:53.205 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.205 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.205 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,7", 2024-02-10T08:19:53.205 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:51.830320+0000", 2024-02-10T08:19:53.205 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0026108429999999998 2024-02-10T08:19:53.205 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.205 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.205 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:19:53.205 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:51.832931+0000", 2024-02-10T08:19:53.205 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00059938600000000004 2024-02-10T08:19:53.205 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.205 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.205 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:19:53.206 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:51.833530+0000", 2024-02-10T08:19:53.206 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013462488 2024-02-10T08:19:53.206 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.206 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.206 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:19:53.206 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:51.846993+0000", 2024-02-10T08:19:53.206 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1017999999999998e-05 2024-02-10T08:19:53.206 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.206 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.206 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:19:53.206 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:51.847054+0000", 2024-02-10T08:19:53.206 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8084000000000002e-05 2024-02-10T08:19:53.206 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.206 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.206 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:19:53.207 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:51.847102+0000", 2024-02-10T08:19:53.207 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.017185038999999999 2024-02-10T08:19:53.207 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:19:53.207 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:19:53.207 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:19:53.207 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.207 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.207 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:4600 7.6 7:6abdfd9d:::benchmark_data_smithi018_80623_object4599:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e95)", 2024-02-10T08:19:53.207 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:19:51.831509+0000", 2024-02-10T08:19:53.207 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 1.339960762, 2024-02-10T08:19:53.207 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015741853, 2024-02-10T08:19:53.207 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:19:53.207 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:19:53.207 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:19:53.207 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:19:53.208 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:19:53.208 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 4600 2024-02-10T08:19:53.208 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.208 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:19:53.208 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.208 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:19:53.208 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:51.831509+0000", 2024-02-10T08:19:53.208 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:19:53.208 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.208 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.208 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:19:53.208 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:51.831509+0000", 2024-02-10T08:19:53.208 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:19:53.208 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.209 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.209 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:19:53.209 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:51.831508+0000", 2024-02-10T08:19:53.209 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0098e-05 2024-02-10T08:19:53.209 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.209 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.209 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:19:53.209 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:51.831558+0000", 2024-02-10T08:19:53.209 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9940000000000006e-06 2024-02-10T08:19:53.209 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.209 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.209 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:19:53.209 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:51.831567+0000", 2024-02-10T08:19:53.209 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7640000000000002e-06 2024-02-10T08:19:53.209 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.210 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.210 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:19:53.210 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:51.831573+0000", 2024-02-10T08:19:53.210 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014025299999999999 2024-02-10T08:19:53.210 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.210 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.210 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:19:53.210 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:51.831713+0000", 2024-02-10T08:19:53.210 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014970000000000001 2024-02-10T08:19:53.210 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.210 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.210 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:19:53.210 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:51.831863+0000", 2024-02-10T08:19:53.210 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000150605 2024-02-10T08:19:53.210 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.211 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.211 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,7", 2024-02-10T08:19:53.211 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:51.832013+0000", 2024-02-10T08:19:53.211 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0011679590000000001 2024-02-10T08:19:53.211 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.211 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.211 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:19:53.211 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:51.833181+0000", 2024-02-10T08:19:53.211 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00035396400000000001 2024-02-10T08:19:53.211 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.211 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.211 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:19:53.211 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:51.833535+0000", 2024-02-10T08:19:53.211 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013626351 2024-02-10T08:19:53.211 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.212 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.212 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:19:53.212 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:51.847162+0000", 2024-02-10T08:19:53.212 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0974999999999999e-05 2024-02-10T08:19:53.212 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.212 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.212 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:19:53.212 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:51.847212+0000", 2024-02-10T08:19:53.212 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8510999999999998e-05 2024-02-10T08:19:53.212 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.212 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.212 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:19:53.212 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:51.847251+0000", 2024-02-10T08:19:53.212 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015741853 2024-02-10T08:19:53.213 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:19:53.213 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:19:53.213 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:19:53.213 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.213 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.213 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:6059 7.9 7:91c92fcb:::benchmark_data_smithi018_80623_object6058:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e95)", 2024-02-10T08:19:53.213 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:19:52.343972+0000", 2024-02-10T08:19:53.213 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.82749765099999995, 2024-02-10T08:19:53.213 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.016255654000000001, 2024-02-10T08:19:53.213 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:19:53.213 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:19:53.214 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:19:53.214 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:19:53.214 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:19:53.214 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 6059 2024-02-10T08:19:53.214 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.214 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:19:53.214 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.214 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:19:53.214 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:52.343972+0000", 2024-02-10T08:19:53.214 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:19:53.214 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.214 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.214 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:19:53.214 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:52.343972+0000", 2024-02-10T08:19:53.214 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:19:53.215 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.215 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.215 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:19:53.215 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:52.343971+0000", 2024-02-10T08:19:53.215 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3399000000000001e-05 2024-02-10T08:19:53.215 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.215 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.215 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:19:53.215 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:52.343994+0000", 2024-02-10T08:19:53.215 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7389999999999994e-06 2024-02-10T08:19:53.215 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.215 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.215 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:19:53.215 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:52.344004+0000", 2024-02-10T08:19:53.215 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9989999999999997e-06 2024-02-10T08:19:53.215 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.216 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.216 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:19:53.216 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:52.344010+0000", 2024-02-10T08:19:53.216 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0571e-05 2024-02-10T08:19:53.216 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.216 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.216 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:19:53.216 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:52.344070+0000", 2024-02-10T08:19:53.216 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4772999999999995e-05 2024-02-10T08:19:53.216 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.216 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.216 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:19:53.216 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:52.344165+0000", 2024-02-10T08:19:53.216 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0001451 2024-02-10T08:19:53.217 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.217 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.217 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-02-10T08:19:53.217 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:52.344310+0000", 2024-02-10T08:19:53.217 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0060495380000000001 2024-02-10T08:19:53.217 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.217 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.217 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:19:53.217 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:52.350360+0000", 2024-02-10T08:19:53.217 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0097413870000000007 2024-02-10T08:19:53.217 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.217 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.217 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:19:53.217 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:52.360101+0000", 2024-02-10T08:19:53.217 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7793999999999997e-05 2024-02-10T08:19:53.218 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.218 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.218 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:19:53.218 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:52.360149+0000", 2024-02-10T08:19:53.218 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8984000000000001e-05 2024-02-10T08:19:53.218 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.218 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.218 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:19:53.218 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:52.360228+0000", 2024-02-10T08:19:53.218 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.016255654000000001 2024-02-10T08:19:53.218 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:19:53.218 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:19:53.218 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:19:53.218 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.218 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.219 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:7063 7.f 7:f723ec0c:::benchmark_data_smithi018_80623_object7062:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e95)", 2024-02-10T08:19:53.219 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:19:52.731804+0000", 2024-02-10T08:19:53.219 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.43966575699999999, 2024-02-10T08:19:53.219 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.017736933999999999, 2024-02-10T08:19:53.219 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:19:53.219 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:19:53.219 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:19:53.219 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:19:53.219 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:19:53.219 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 7063 2024-02-10T08:19:53.219 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.219 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:19:53.219 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.219 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:19:53.219 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:52.731804+0000", 2024-02-10T08:19:53.220 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:19:53.220 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.220 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.220 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:19:53.220 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:52.731804+0000", 2024-02-10T08:19:53.220 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999981 2024-02-10T08:19:53.220 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.220 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.220 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:19:53.220 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:52.731802+0000", 2024-02-10T08:19:53.220 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.4765000000000001e-05 2024-02-10T08:19:53.220 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.220 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.220 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:19:53.220 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:52.731827+0000", 2024-02-10T08:19:53.221 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7439e-05 2024-02-10T08:19:53.221 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.221 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.221 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:19:53.221 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:52.731845+0000", 2024-02-10T08:19:53.221 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.542e-06 2024-02-10T08:19:53.221 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.221 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.221 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:19:53.221 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:52.731852+0000", 2024-02-10T08:19:53.221 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9861000000000003e-05 2024-02-10T08:19:53.221 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.221 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.221 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:19:53.221 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:52.731902+0000", 2024-02-10T08:19:53.222 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000182783 2024-02-10T08:19:53.222 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.222 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.222 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:19:53.222 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:52.732085+0000", 2024-02-10T08:19:53.222 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017183000000000001 2024-02-10T08:19:53.222 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.222 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.222 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,7", 2024-02-10T08:19:53.222 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:52.732257+0000", 2024-02-10T08:19:53.222 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001081811 2024-02-10T08:19:53.222 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.222 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.222 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:19:53.222 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:52.733338+0000", 2024-02-10T08:19:53.223 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0046849029999999998 2024-02-10T08:19:53.223 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.223 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.223 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:19:53.223 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:52.738023+0000", 2024-02-10T08:19:53.223 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011400906000000001 2024-02-10T08:19:53.223 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.223 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.223 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:19:53.223 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:52.749424+0000", 2024-02-10T08:19:53.223 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5079999999999994e-05 2024-02-10T08:19:53.223 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.223 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.223 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:19:53.223 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:52.749489+0000", 2024-02-10T08:19:53.224 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1847e-05 2024-02-10T08:19:53.224 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.224 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.224 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:19:53.224 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:52.749541+0000", 2024-02-10T08:19:53.224 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.017736933999999999 2024-02-10T08:19:53.224 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:19:53.224 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:19:53.224 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:19:53.224 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.224 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.224 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:7070 7.6 7:6cbecbcc:::benchmark_data_smithi018_80623_object7069:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e95)", 2024-02-10T08:19:53.224 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:19:52.738436+0000", 2024-02-10T08:19:53.224 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.433034064, 2024-02-10T08:19:53.224 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015402512, 2024-02-10T08:19:53.225 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:19:53.225 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:19:53.225 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:19:53.225 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:19:53.225 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:19:53.225 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 7070 2024-02-10T08:19:53.225 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.225 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:19:53.225 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.225 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:19:53.225 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:52.738436+0000", 2024-02-10T08:19:53.225 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:19:53.225 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.225 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.225 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:19:53.226 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:52.738436+0000", 2024-02-10T08:19:53.226 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:19:53.226 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.226 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.226 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:19:53.226 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:52.738434+0000", 2024-02-10T08:19:53.226 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1379999999999999e-05 2024-02-10T08:19:53.226 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.226 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.226 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:19:53.226 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:52.738456+0000", 2024-02-10T08:19:53.226 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1629e-05 2024-02-10T08:19:53.226 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.226 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.226 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:19:53.227 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:52.738467+0000", 2024-02-10T08:19:53.227 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0080000000000002e-06 2024-02-10T08:19:53.227 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.227 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.227 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:19:53.227 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:52.738472+0000", 2024-02-10T08:19:53.227 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0034632180000000001 2024-02-10T08:19:53.227 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.227 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.227 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:19:53.227 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:52.741936+0000", 2024-02-10T08:19:53.227 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2707000000000006e-05 2024-02-10T08:19:53.227 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.227 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.227 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:19:53.228 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:52.742018+0000", 2024-02-10T08:19:53.228 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016011700000000001 2024-02-10T08:19:53.228 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.228 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.228 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,7", 2024-02-10T08:19:53.228 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:52.742178+0000", 2024-02-10T08:19:53.228 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00123985 2024-02-10T08:19:53.228 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.228 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.228 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:19:53.228 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:52.743418+0000", 2024-02-10T08:19:53.228 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0034587989999999998 2024-02-10T08:19:53.228 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.228 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.228 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:19:53.229 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:52.746877+0000", 2024-02-10T08:19:53.229 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0068691510000000004 2024-02-10T08:19:53.229 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.229 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.229 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:19:53.229 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:52.753746+0000", 2024-02-10T08:19:53.229 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9629000000000002e-05 2024-02-10T08:19:53.229 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.229 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.229 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:19:53.229 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:52.753796+0000", 2024-02-10T08:19:53.229 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2472999999999998e-05 2024-02-10T08:19:53.229 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.229 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.230 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:19:53.230 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:52.753838+0000", 2024-02-10T08:19:53.230 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015402512 2024-02-10T08:19:53.230 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:19:53.230 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:19:53.230 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:19:53.230 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.230 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.230 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:7077 7.f 7:f2a85ec5:::benchmark_data_smithi018_80623_object7076:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e95)", 2024-02-10T08:19:53.230 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:19:52.738713+0000", 2024-02-10T08:19:53.230 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.43275725999999998, 2024-02-10T08:19:53.230 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015241136000000001, 2024-02-10T08:19:53.230 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:19:53.230 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:19:53.230 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:19:53.231 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:19:53.231 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:19:53.231 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 7077 2024-02-10T08:19:53.231 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.231 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:19:53.231 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.231 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:19:53.231 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:52.738713+0000", 2024-02-10T08:19:53.231 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:19:53.231 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.231 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.231 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:19:53.231 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:52.738713+0000", 2024-02-10T08:19:53.231 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:19:53.231 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.232 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.232 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:19:53.232 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:52.738712+0000", 2024-02-10T08:19:53.232 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0304000000000001e-05 2024-02-10T08:19:53.232 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.232 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.232 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:19:53.232 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:52.738732+0000", 2024-02-10T08:19:53.232 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3299999999999999e-06 2024-02-10T08:19:53.232 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.232 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.232 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:19:53.232 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:52.738740+0000", 2024-02-10T08:19:53.232 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9009999999999996e-06 2024-02-10T08:19:53.232 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.233 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.233 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:19:53.233 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:52.738744+0000", 2024-02-10T08:19:53.233 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1488000000000001e-05 2024-02-10T08:19:53.233 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.233 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.233 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:19:53.233 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:52.738776+0000", 2024-02-10T08:19:53.233 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3207000000000005e-05 2024-02-10T08:19:53.233 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.233 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.233 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:19:53.233 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:52.738859+0000", 2024-02-10T08:19:53.233 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6191000000000001e-05 2024-02-10T08:19:53.233 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.234 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.234 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,7", 2024-02-10T08:19:53.234 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:52.738955+0000", 2024-02-10T08:19:53.234 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001350204 2024-02-10T08:19:53.234 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.234 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.234 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:19:53.234 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:52.740305+0000", 2024-02-10T08:19:53.234 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00118067 2024-02-10T08:19:53.234 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.234 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.234 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:19:53.234 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:52.741486+0000", 2024-02-10T08:19:53.234 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.012391610000000001 2024-02-10T08:19:53.234 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.235 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.235 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:19:53.235 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:52.753878+0000", 2024-02-10T08:19:53.235 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2015000000000003e-05 2024-02-10T08:19:53.235 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.235 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.235 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:19:53.235 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:52.753930+0000", 2024-02-10T08:19:53.235 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3995e-05 2024-02-10T08:19:53.235 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.235 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.235 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:19:53.235 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:52.753954+0000", 2024-02-10T08:19:53.235 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015241136000000001 2024-02-10T08:19:53.235 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:19:53.236 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:19:53.236 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:19:53.236 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.236 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.236 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:7488 7.f 7:ff94468c:::benchmark_data_smithi018_80623_object7487:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e95)", 2024-02-10T08:19:53.236 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:19:52.961199+0000", 2024-02-10T08:19:53.236 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.21027121500000001, 2024-02-10T08:19:53.236 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.016481373000000001, 2024-02-10T08:19:53.236 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:19:53.236 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:19:53.236 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:19:53.236 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:19:53.236 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:19:53.236 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 7488 2024-02-10T08:19:53.236 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.237 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:19:53.237 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.237 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:19:53.237 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:52.961199+0000", 2024-02-10T08:19:53.237 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:19:53.237 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.237 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.237 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:19:53.237 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:52.961199+0000", 2024-02-10T08:19:53.237 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:19:53.237 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.237 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.237 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:19:53.237 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:52.961197+0000", 2024-02-10T08:19:53.237 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.6287000000000001e-05 2024-02-10T08:19:53.238 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.238 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.238 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:19:53.238 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:52.961223+0000", 2024-02-10T08:19:53.238 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6682000000000001e-05 2024-02-10T08:19:53.238 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.238 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.238 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:19:53.238 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:52.961240+0000", 2024-02-10T08:19:53.238 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.571e-06 2024-02-10T08:19:53.238 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.238 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.238 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:19:53.238 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:52.961248+0000", 2024-02-10T08:19:53.238 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015216900000000001 2024-02-10T08:19:53.239 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.239 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.239 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:19:53.239 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:52.961400+0000", 2024-02-10T08:19:53.239 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012330899999999999 2024-02-10T08:19:53.239 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.239 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.239 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:19:53.239 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:52.961523+0000", 2024-02-10T08:19:53.239 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000181757 2024-02-10T08:19:53.239 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.239 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.239 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,7", 2024-02-10T08:19:53.239 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:52.961705+0000", 2024-02-10T08:19:53.239 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0045067129999999999 2024-02-10T08:19:53.239 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.240 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.240 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:19:53.240 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:52.966212+0000", 2024-02-10T08:19:53.240 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0014230919999999999 2024-02-10T08:19:53.240 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.240 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.240 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:19:53.240 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:52.967635+0000", 2024-02-10T08:19:53.240 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0099679629999999998 2024-02-10T08:19:53.240 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.240 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.240 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:19:53.240 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:52.977603+0000", 2024-02-10T08:19:53.240 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2713999999999998e-05 2024-02-10T08:19:53.240 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.241 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.241 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:19:53.241 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:52.977645+0000", 2024-02-10T08:19:53.241 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4715999999999998e-05 2024-02-10T08:19:53.241 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.241 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.241 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:19:53.241 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:52.977680+0000", 2024-02-10T08:19:53.241 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.016481373000000001 2024-02-10T08:19:53.241 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:19:53.241 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:19:53.241 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:19:53.241 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.241 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.241 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:7655 7.f 7:f7fd09b9:::benchmark_data_smithi018_80623_object7654:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e95)", 2024-02-10T08:19:53.242 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:19:53.038643+0000", 2024-02-10T08:19:53.242 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.132826415, 2024-02-10T08:19:53.242 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.016561339000000001, 2024-02-10T08:19:53.242 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:19:53.242 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:19:53.242 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:19:53.242 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:19:53.242 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:19:53.242 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 7655 2024-02-10T08:19:53.242 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.242 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:19:53.242 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.242 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:19:53.242 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.038643+0000", 2024-02-10T08:19:53.243 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:19:53.243 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.243 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.243 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:19:53.243 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.038643+0000", 2024-02-10T08:19:53.243 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:19:53.243 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.243 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.243 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:19:53.243 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.038642+0000", 2024-02-10T08:19:53.243 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3204000000000002e-05 2024-02-10T08:19:53.243 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.243 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.244 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:19:53.244 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.038685+0000", 2024-02-10T08:19:53.244 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0002e-05 2024-02-10T08:19:53.244 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.244 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.244 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:19:53.244 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.038695+0000", 2024-02-10T08:19:53.244 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0419999999999999e-06 2024-02-10T08:19:53.244 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.244 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.244 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:19:53.244 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.038701+0000", 2024-02-10T08:19:53.244 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001800823 2024-02-10T08:19:53.244 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.245 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.245 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:19:53.245 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.040502+0000", 2024-02-10T08:19:53.245 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000103349 2024-02-10T08:19:53.245 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.245 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.245 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:19:53.245 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.040605+0000", 2024-02-10T08:19:53.245 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013648499999999999 2024-02-10T08:19:53.245 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.245 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.245 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,7", 2024-02-10T08:19:53.245 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.040742+0000", 2024-02-10T08:19:53.245 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000917533 2024-02-10T08:19:53.245 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.246 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.246 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:19:53.246 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.041659+0000", 2024-02-10T08:19:53.246 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0019957349999999998 2024-02-10T08:19:53.246 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.246 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.246 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:19:53.246 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.043655+0000", 2024-02-10T08:19:53.246 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011461364 2024-02-10T08:19:53.246 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.246 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.246 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:19:53.246 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.055116+0000", 2024-02-10T08:19:53.246 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2237000000000001e-05 2024-02-10T08:19:53.246 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.247 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.247 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:19:53.247 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.055169+0000", 2024-02-10T08:19:53.247 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6168999999999999e-05 2024-02-10T08:19:53.247 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.247 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.247 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:19:53.247 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.055205+0000", 2024-02-10T08:19:53.247 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.016561339000000001 2024-02-10T08:19:53.247 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:19:53.247 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:19:53.247 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:19:53.247 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.247 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.247 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:7730 7.4 7:295d970c:::benchmark_data_smithi018_80623_object7729:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e95)", 2024-02-10T08:19:53.248 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:19:53.074741+0000", 2024-02-10T08:19:53.248 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.096729255, 2024-02-10T08:19:53.248 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.014633610999999999, 2024-02-10T08:19:53.248 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:19:53.248 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:19:53.248 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:19:53.248 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:19:53.248 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:19:53.248 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 7730 2024-02-10T08:19:53.248 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.248 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:19:53.248 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.248 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:19:53.248 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.074741+0000", 2024-02-10T08:19:53.248 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:19:53.249 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.249 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.249 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:19:53.249 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.074741+0000", 2024-02-10T08:19:53.249 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:19:53.249 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.249 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.249 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:19:53.249 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.074740+0000", 2024-02-10T08:19:53.249 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0095999999999999e-05 2024-02-10T08:19:53.249 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.249 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.249 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:19:53.249 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.074760+0000", 2024-02-10T08:19:53.249 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3270000000000001e-06 2024-02-10T08:19:53.250 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.250 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.250 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:19:53.250 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.074768+0000", 2024-02-10T08:19:53.250 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7699999999999998e-06 2024-02-10T08:19:53.250 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.250 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.250 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:19:53.250 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.074774+0000", 2024-02-10T08:19:53.250 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001809354 2024-02-10T08:19:53.250 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.250 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.250 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:19:53.250 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.076583+0000", 2024-02-10T08:19:53.250 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013556399999999999 2024-02-10T08:19:53.250 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.251 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.251 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:19:53.251 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.076719+0000", 2024-02-10T08:19:53.251 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016182800000000001 2024-02-10T08:19:53.251 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.251 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.251 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-02-10T08:19:53.251 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.076881+0000", 2024-02-10T08:19:53.251 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0027981490000000002 2024-02-10T08:19:53.251 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.251 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.251 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:19:53.251 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.079679+0000", 2024-02-10T08:19:53.251 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.009544538 2024-02-10T08:19:53.251 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.252 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.252 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:19:53.252 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.089223+0000", 2024-02-10T08:19:53.252 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8692e-05 2024-02-10T08:19:53.252 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.252 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.252 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:19:53.252 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.089282+0000", 2024-02-10T08:19:53.252 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2258999999999999e-05 2024-02-10T08:19:53.252 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.252 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.252 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:19:53.252 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.089374+0000", 2024-02-10T08:19:53.252 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.014633610999999999 2024-02-10T08:19:53.252 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:19:53.253 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:19:53.253 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:19:53.253 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.253 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.253 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:7794 7.f 7:f088881e:::benchmark_data_smithi018_80623_object7793:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e95)", 2024-02-10T08:19:53.253 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:19:53.108468+0000", 2024-02-10T08:19:53.253 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.063002336000000006, 2024-02-10T08:19:53.253 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.01558325, 2024-02-10T08:19:53.253 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:19:53.253 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:19:53.253 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:19:53.253 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:19:53.253 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:19:53.253 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 7794 2024-02-10T08:19:53.253 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.253 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:19:53.254 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.254 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:19:53.254 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.108468+0000", 2024-02-10T08:19:53.254 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:19:53.254 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.254 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.254 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:19:53.254 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.108468+0000", 2024-02-10T08:19:53.254 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999981 2024-02-10T08:19:53.254 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.254 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.254 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:19:53.254 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.108466+0000", 2024-02-10T08:19:53.254 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8206000000000001e-05 2024-02-10T08:19:53.255 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.255 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.255 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:19:53.255 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.108494+0000", 2024-02-10T08:19:53.255 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1119e-05 2024-02-10T08:19:53.255 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.255 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.255 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:19:53.255 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.108505+0000", 2024-02-10T08:19:53.255 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0750000000000003e-06 2024-02-10T08:19:53.255 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.255 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.255 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:19:53.255 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.108511+0000", 2024-02-10T08:19:53.255 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0061894489999999996 2024-02-10T08:19:53.256 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.256 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.256 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:19:53.256 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.114701+0000", 2024-02-10T08:19:53.256 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000113588 2024-02-10T08:19:53.256 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.256 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.256 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:19:53.256 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.114814+0000", 2024-02-10T08:19:53.256 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000145241 2024-02-10T08:19:53.257 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.257 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.257 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,7", 2024-02-10T08:19:53.257 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.114959+0000", 2024-02-10T08:19:53.257 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00098958300000000004 2024-02-10T08:19:53.257 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.257 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.257 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:19:53.257 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.115949+0000", 2024-02-10T08:19:53.257 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0033347559999999999 2024-02-10T08:19:53.258 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.258 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.258 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:19:53.258 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.119284+0000", 2024-02-10T08:19:53.258 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0046971160000000003 2024-02-10T08:19:53.258 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.258 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.258 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:19:53.258 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.123981+0000", 2024-02-10T08:19:53.258 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3135e-05 2024-02-10T08:19:53.258 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.258 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.258 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:19:53.258 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.124014+0000", 2024-02-10T08:19:53.258 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6735e-05 2024-02-10T08:19:53.259 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.259 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.259 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:19:53.259 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.124051+0000", 2024-02-10T08:19:53.259 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.01558325 2024-02-10T08:19:53.259 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:19:53.259 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:19:53.259 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:19:53.259 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.259 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.259 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:7802 7.6 7:672bba45:::benchmark_data_smithi018_80623_object7801:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e95)", 2024-02-10T08:19:53.259 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:19:53.113281+0000", 2024-02-10T08:19:53.259 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.058189087, 2024-02-10T08:19:53.259 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.017561533000000001, 2024-02-10T08:19:53.259 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:19:53.260 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:19:53.260 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:19:53.260 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:19:53.260 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:19:53.260 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 7802 2024-02-10T08:19:53.260 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.260 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:19:53.260 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.260 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:19:53.260 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.113281+0000", 2024-02-10T08:19:53.260 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:19:53.260 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.260 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.260 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:19:53.260 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.113281+0000", 2024-02-10T08:19:53.261 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999981 2024-02-10T08:19:53.261 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.261 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.261 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:19:53.261 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.113279+0000", 2024-02-10T08:19:53.261 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1591000000000003e-05 2024-02-10T08:19:53.261 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.261 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.261 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:19:53.261 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.113311+0000", 2024-02-10T08:19:53.261 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2164e-05 2024-02-10T08:19:53.261 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.261 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.261 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:19:53.261 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.113333+0000", 2024-02-10T08:19:53.262 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4949999999999997e-06 2024-02-10T08:19:53.262 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.262 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.262 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:19:53.262 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.113342+0000", 2024-02-10T08:19:53.262 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00054051900000000005 2024-02-10T08:19:53.262 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.262 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.262 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:19:53.262 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.113883+0000", 2024-02-10T08:19:53.262 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000102025 2024-02-10T08:19:53.262 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.262 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.262 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:19:53.262 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.113985+0000", 2024-02-10T08:19:53.263 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014105199999999999 2024-02-10T08:19:53.263 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.263 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.263 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,7", 2024-02-10T08:19:53.263 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.114126+0000", 2024-02-10T08:19:53.263 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001052826 2024-02-10T08:19:53.263 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.263 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.263 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:19:53.263 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.115179+0000", 2024-02-10T08:19:53.263 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4215999999999994e-05 2024-02-10T08:19:53.263 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.263 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.263 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:19:53.263 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.115273+0000", 2024-02-10T08:19:53.264 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015477167 2024-02-10T08:19:53.264 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.264 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.264 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:19:53.264 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.130750+0000", 2024-02-10T08:19:53.264 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9181000000000002e-05 2024-02-10T08:19:53.264 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.264 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.264 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:19:53.264 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.130799+0000", 2024-02-10T08:19:53.264 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3185000000000001e-05 2024-02-10T08:19:53.264 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.264 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.264 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:19:53.264 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.130842+0000", 2024-02-10T08:19:53.265 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.017561533000000001 2024-02-10T08:19:53.265 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:19:53.265 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:19:53.265 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:19:53.265 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.265 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.265 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:7812 7.f 7:fbc35dc5:::benchmark_data_smithi018_80623_object7811:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e95)", 2024-02-10T08:19:53.265 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:19:53.130935+0000", 2024-02-10T08:19:53.265 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.040534971000000003, 2024-02-10T08:19:53.265 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015315708000000001, 2024-02-10T08:19:53.265 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:19:53.265 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:19:53.265 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:19:53.265 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:19:53.265 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:19:53.266 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 7812 2024-02-10T08:19:53.266 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.266 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:19:53.266 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.266 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:19:53.266 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.130935+0000", 2024-02-10T08:19:53.266 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:19:53.266 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.266 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.266 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:19:53.266 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.130935+0000", 2024-02-10T08:19:53.266 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:19:53.266 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.266 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.266 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:19:53.267 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.130934+0000", 2024-02-10T08:19:53.267 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2872000000000001e-05 2024-02-10T08:19:53.267 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.267 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.267 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:19:53.267 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.130957+0000", 2024-02-10T08:19:53.267 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6520000000000006e-06 2024-02-10T08:19:53.267 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.267 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.267 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:19:53.267 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.130965+0000", 2024-02-10T08:19:53.267 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5750000000000002e-06 2024-02-10T08:19:53.267 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.267 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.267 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:19:53.268 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.130969+0000", 2024-02-10T08:19:53.268 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001121681 2024-02-10T08:19:53.268 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.268 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.268 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:19:53.268 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.132091+0000", 2024-02-10T08:19:53.268 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012517600000000001 2024-02-10T08:19:53.268 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.268 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.268 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:19:53.268 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.132216+0000", 2024-02-10T08:19:53.268 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014901500000000001 2024-02-10T08:19:53.268 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.268 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.269 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,7", 2024-02-10T08:19:53.269 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.132365+0000", 2024-02-10T08:19:53.269 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0029853129999999999 2024-02-10T08:19:53.269 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.269 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.269 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:19:53.269 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.135351+0000", 2024-02-10T08:19:53.269 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0014094279999999999 2024-02-10T08:19:53.269 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.269 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.269 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:19:53.269 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.136760+0000", 2024-02-10T08:19:53.269 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0094022510000000004 2024-02-10T08:19:53.269 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.269 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.270 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:19:53.270 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.146162+0000", 2024-02-10T08:19:53.270 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7409e-05 2024-02-10T08:19:53.270 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.270 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.270 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:19:53.270 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.146210+0000", 2024-02-10T08:19:53.270 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0930000000000003e-05 2024-02-10T08:19:53.270 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.270 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.270 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:19:53.270 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.146251+0000", 2024-02-10T08:19:53.270 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015315708000000001 2024-02-10T08:19:53.270 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:19:53.270 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:19:53.271 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:19:53.271 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.271 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.271 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:7818 7.f 7:faef59af:::benchmark_data_smithi018_80623_object7817:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e95)", 2024-02-10T08:19:53.271 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:19:53.144006+0000", 2024-02-10T08:19:53.271 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.027464002000000001, 2024-02-10T08:19:53.271 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015738868, 2024-02-10T08:19:53.271 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:19:53.271 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:19:53.271 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:19:53.271 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:19:53.271 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:19:53.271 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 7818 2024-02-10T08:19:53.271 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.272 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:19:53.272 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.272 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:19:53.272 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.144006+0000", 2024-02-10T08:19:53.272 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:19:53.272 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.272 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.272 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:19:53.272 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.144006+0000", 2024-02-10T08:19:53.272 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999981 2024-02-10T08:19:53.272 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.272 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.272 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:19:53.272 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.144004+0000", 2024-02-10T08:19:53.272 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3309999999999997e-05 2024-02-10T08:19:53.273 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.273 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.273 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:19:53.273 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.144047+0000", 2024-02-10T08:19:53.273 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.6440000000000001e-05 2024-02-10T08:19:53.273 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.273 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.273 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:19:53.273 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.144074+0000", 2024-02-10T08:19:53.273 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2190000000000004e-06 2024-02-10T08:19:53.273 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.273 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.273 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:19:53.273 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.144082+0000", 2024-02-10T08:19:53.273 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00046941399999999997 2024-02-10T08:19:53.274 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.274 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.274 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:19:53.274 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.144552+0000", 2024-02-10T08:19:53.274 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016334100000000001 2024-02-10T08:19:53.274 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.274 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.274 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:19:53.274 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.144715+0000", 2024-02-10T08:19:53.274 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017834599999999999 2024-02-10T08:19:53.274 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.274 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.274 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,7", 2024-02-10T08:19:53.274 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.144893+0000", 2024-02-10T08:19:53.274 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001403414 2024-02-10T08:19:53.275 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.275 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.275 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:19:53.275 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.146297+0000", 2024-02-10T08:19:53.275 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0024254440000000001 2024-02-10T08:19:53.275 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.275 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.275 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:19:53.275 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.148722+0000", 2024-02-10T08:19:53.275 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.010930051 2024-02-10T08:19:53.275 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.275 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.275 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:19:53.275 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.159652+0000", 2024-02-10T08:19:53.275 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1598000000000003e-05 2024-02-10T08:19:53.276 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.276 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.276 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:19:53.276 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.159704+0000", 2024-02-10T08:19:53.276 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1038999999999998e-05 2024-02-10T08:19:53.276 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.276 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.276 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:19:53.276 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.159745+0000", 2024-02-10T08:19:53.276 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015738868 2024-02-10T08:19:53.276 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:19:53.276 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:19:53.276 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:19:53.276 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.277 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.277 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:7820 7.f 7:f780cdd9:::benchmark_data_smithi018_80623_object7819:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e95)", 2024-02-10T08:19:53.277 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:19:53.144100+0000", 2024-02-10T08:19:53.277 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.027370121000000001, 2024-02-10T08:19:53.277 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015773213000000001, 2024-02-10T08:19:53.277 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:19:53.277 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:19:53.277 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:19:53.277 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:19:53.277 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:19:53.277 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 7820 2024-02-10T08:19:53.277 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.277 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:19:53.277 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.277 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:19:53.277 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.144100+0000", 2024-02-10T08:19:53.278 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:19:53.278 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.278 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.278 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:19:53.278 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.144100+0000", 2024-02-10T08:19:53.278 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:19:53.278 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.278 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.278 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:19:53.278 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.144099+0000", 2024-02-10T08:19:53.278 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.4261999999999999e-05 2024-02-10T08:19:53.278 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.278 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.278 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:19:53.278 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.144123+0000", 2024-02-10T08:19:53.279 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.827e-06 2024-02-10T08:19:53.279 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.279 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.279 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:19:53.279 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.144130+0000", 2024-02-10T08:19:53.279 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5390000000000001e-06 2024-02-10T08:19:53.279 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.279 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.279 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:19:53.279 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.144135+0000", 2024-02-10T08:19:53.279 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001272659 2024-02-10T08:19:53.279 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.279 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.279 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:19:53.279 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.145407+0000", 2024-02-10T08:19:53.279 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000154449 2024-02-10T08:19:53.280 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.280 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.280 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:19:53.280 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.145562+0000", 2024-02-10T08:19:53.280 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015699600000000001 2024-02-10T08:19:53.280 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.280 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.280 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,7", 2024-02-10T08:19:53.280 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.145719+0000", 2024-02-10T08:19:53.280 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0030116019999999999 2024-02-10T08:19:53.280 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.280 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.280 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:19:53.280 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.148730+0000", 2024-02-10T08:19:53.281 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011043399999999999 2024-02-10T08:19:53.281 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.281 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.281 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:19:53.281 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.148841+0000", 2024-02-10T08:19:53.281 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.010939666000000001 2024-02-10T08:19:53.281 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.281 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.281 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:19:53.281 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.159781+0000", 2024-02-10T08:19:53.281 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5469e-05 2024-02-10T08:19:53.281 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.281 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.281 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:19:53.281 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.159836+0000", 2024-02-10T08:19:53.282 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6961000000000001e-05 2024-02-10T08:19:53.282 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.282 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.282 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:19:53.282 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.159873+0000", 2024-02-10T08:19:53.282 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015773213000000001 2024-02-10T08:19:53.282 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:19:53.282 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:19:53.282 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:19:53.282 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.282 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.282 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:7822 7.6 7:66f09461:::benchmark_data_smithi018_80623_object7821:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e95)", 2024-02-10T08:19:53.282 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:19:53.144140+0000", 2024-02-10T08:19:53.282 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.027330113, 2024-02-10T08:19:53.282 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.019231211000000002, 2024-02-10T08:19:53.283 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:19:53.283 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:19:53.283 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:19:53.283 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:19:53.283 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:19:53.283 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 7822 2024-02-10T08:19:53.283 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.283 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:19:53.283 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.283 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:19:53.283 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.144140+0000", 2024-02-10T08:19:53.283 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:19:53.284 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.284 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.284 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:19:53.284 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.144140+0000", 2024-02-10T08:19:53.284 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:19:53.284 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.284 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.284 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:19:53.284 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.144139+0000", 2024-02-10T08:19:53.284 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2538e-05 2024-02-10T08:19:53.284 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.284 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.284 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:19:53.285 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.144162+0000", 2024-02-10T08:19:53.285 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8320000000000002e-06 2024-02-10T08:19:53.285 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.285 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.285 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:19:53.285 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.144168+0000", 2024-02-10T08:19:53.285 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0369999999999996e-06 2024-02-10T08:19:53.285 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.285 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.285 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:19:53.285 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.144172+0000", 2024-02-10T08:19:53.285 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0030674360000000002 2024-02-10T08:19:53.285 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.285 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.285 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:19:53.286 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.147239+0000", 2024-02-10T08:19:53.286 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012683799999999999 2024-02-10T08:19:53.286 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.286 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.286 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:19:53.286 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.147366+0000", 2024-02-10T08:19:53.286 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000158632 2024-02-10T08:19:53.286 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.286 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.286 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,7", 2024-02-10T08:19:53.286 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.147525+0000", 2024-02-10T08:19:53.286 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00085184200000000001 2024-02-10T08:19:53.286 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.286 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.286 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:19:53.287 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.148376+0000", 2024-02-10T08:19:53.287 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0030331239999999999 2024-02-10T08:19:53.287 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.287 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.287 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:19:53.287 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.151410+0000", 2024-02-10T08:19:53.287 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011860897 2024-02-10T08:19:53.287 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.287 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.287 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:19:53.287 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.163270+0000", 2024-02-10T08:19:53.287 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7571000000000002e-05 2024-02-10T08:19:53.287 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.287 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.287 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:19:53.287 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.163328+0000", 2024-02-10T08:19:53.288 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2979999999999998e-05 2024-02-10T08:19:53.288 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.288 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.288 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:19:53.288 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.163371+0000", 2024-02-10T08:19:53.288 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.019231211000000002 2024-02-10T08:19:53.288 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:19:53.288 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:19:53.288 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:19:53.288 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.288 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.288 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:7831 7.6 7:689b131e:::benchmark_data_smithi018_80623_object7830:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e95)", 2024-02-10T08:19:53.288 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:19:53.149004+0000", 2024-02-10T08:19:53.288 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.022465553999999999, 2024-02-10T08:19:53.289 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.014594500999999999, 2024-02-10T08:19:53.289 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:19:53.289 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:19:53.289 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:19:53.289 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:19:53.289 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:19:53.289 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 7831 2024-02-10T08:19:53.289 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.289 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:19:53.289 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.289 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:19:53.290 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.149004+0000", 2024-02-10T08:19:53.290 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:19:53.290 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.290 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.290 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:19:53.290 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.149004+0000", 2024-02-10T08:19:53.290 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:19:53.290 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.290 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.290 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:19:53.290 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.149004+0000", 2024-02-10T08:19:53.290 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2719999999999999e-05 2024-02-10T08:19:53.290 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.290 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.290 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:19:53.291 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.149026+0000", 2024-02-10T08:19:53.291 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2356000000000001e-05 2024-02-10T08:19:53.291 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.291 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.291 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:19:53.291 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.149049+0000", 2024-02-10T08:19:53.291 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7899999999999999e-06 2024-02-10T08:19:53.291 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.291 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.291 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:19:53.291 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.149053+0000", 2024-02-10T08:19:53.291 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0013747690000000001 2024-02-10T08:19:53.291 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.291 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.291 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:19:53.292 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.150428+0000", 2024-02-10T08:19:53.292 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013139599999999999 2024-02-10T08:19:53.292 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.292 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.292 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:19:53.292 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.150560+0000", 2024-02-10T08:19:53.292 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000158787 2024-02-10T08:19:53.292 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.292 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.292 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,7", 2024-02-10T08:19:53.292 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.150718+0000", 2024-02-10T08:19:53.292 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0020785650000000001 2024-02-10T08:19:53.292 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.292 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.292 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:19:53.293 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.152797+0000", 2024-02-10T08:19:53.293 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7054999999999998e-05 2024-02-10T08:19:53.293 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.293 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.293 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:19:53.293 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.152814+0000", 2024-02-10T08:19:53.293 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.010708109 2024-02-10T08:19:53.293 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.293 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.293 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:19:53.293 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.163522+0000", 2024-02-10T08:19:53.293 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9585999999999997e-05 2024-02-10T08:19:53.293 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.293 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.293 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:19:53.294 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.163562+0000", 2024-02-10T08:19:53.294 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7156000000000001e-05 2024-02-10T08:19:53.294 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:19:53.294 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:19:53.294 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:19:53.294 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:53.163599+0000", 2024-02-10T08:19:53.294 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.014594500999999999 2024-02-10T08:19:53.294 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:19:53.294 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:19:53.294 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:19:53.294 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:19:53.294 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:19:53.294 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-02-10T08:19:53.295 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:19:53.295 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 3 15 7924 7909 164.686 142.812 0.00855719 0.00605916 2024-02-10T08:19:53.340 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:19:53.709 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:19:53.713 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:19:53.713 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:19:53.814 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:19:53.845 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:19:53.868 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:19:53.869 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:53 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:52.489069+0000 mgr.y (mgr.14505) 121 : cluster [DBG] pgmap v112: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 396 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 50 MiB/s wr, 793 op/s; 2111/19605 objects degraded (10.768%) 2024-02-10T08:19:53.870 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:19:53.871 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:19:53.888 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:52.489069+0000 mgr.y (mgr.14505) 121 : cluster [DBG] pgmap v112: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 396 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 50 MiB/s wr, 793 op/s; 2111/19605 objects degraded (10.768%) 2024-02-10T08:19:53.888 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:52.489069+0000 mgr.y (mgr.14505) 121 : cluster [DBG] pgmap v112: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 396 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 50 MiB/s wr, 793 op/s; 2111/19605 objects degraded (10.768%) 2024-02-10T08:19:53.972 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:19:54.030 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:19:54.196 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 4 16 10598 10582 165.277 167.062 0.00269159 0.00604196 2024-02-10T08:19:54.365 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.1 dump_ops_in_flight 2024-02-10T08:19:54.899 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:19:54.908 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:19:54.909 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:19:54.942 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:19:54.943 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:19:55.009 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:19:55.041 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:19:55.065 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:19:55.068 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:19:55.069 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:19:55.169 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:19:55.197 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 5 16 12910 12894 161.115 144.5 0.0053698 0.00619875 2024-02-10T08:19:55.203 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:19:55.228 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:19:55.231 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:19:55.232 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:19:55.333 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:19:55.382 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:19:55.416 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:19:55.417 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:19:55.417 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:19:55.518 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:19:55.548 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:19:55.570 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:19:55.573 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:19:55.574 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:19:55.647 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:54.491757+0000 mgr.y (mgr.14505) 122 : cluster [DBG] pgmap v113: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 396 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 50 MiB/s wr, 793 op/s; 2111/19605 objects degraded (10.768%) 2024-02-10T08:19:55.648 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:54.491757+0000 mgr.y (mgr.14505) 122 : cluster [DBG] pgmap v113: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 396 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 50 MiB/s wr, 793 op/s; 2111/19605 objects degraded (10.768%) 2024-02-10T08:19:55.675 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:19:55.707 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:19:55.730 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:19:55.732 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:19:55.733 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:19:55.834 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:19:55.889 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:19:56.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:54.491757+0000 mgr.y (mgr.14505) 122 : cluster [DBG] pgmap v113: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 396 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 50 MiB/s wr, 793 op/s; 2111/19605 objects degraded (10.768%) 2024-02-10T08:19:56.109 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:19:56.114 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:19:56.114 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:19:56.197 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 6 16 15271 15255 158.841 147.562 0.00372709 0.00628873 2024-02-10T08:19:56.216 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:19:56.248 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:19:56.274 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:19:56.276 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:19:56.276 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:19:56.377 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:19:56.435 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:19:56.518 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:19:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:19:56] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:19:56.542 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:19:56.554 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:19:56.554 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:19:56.655 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:19:56.713 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:19:57.197 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 7 16 17613 17597 157.059 146.375 0.00765636 0.00636029 2024-02-10T08:19:57.404 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:19:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:19:57] "GET /metrics HTTP/1.1" 200 174746 "" "Prometheus/2.33.4" 2024-02-10T08:19:57.583 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:19:57.587 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:19:57.588 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:19:57.689 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:19:57.722 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:19:57.747 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:19:57.750 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:19:57.751 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:19:57.852 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:19:57.901 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:56.492346+0000 mgr.y (mgr.14505) 123 : cluster [DBG] pgmap v114: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 396 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 1.0 KiB/s rd, 41 MiB/s wr, 658 op/s; 2111/19605 objects degraded (10.768%) 2024-02-10T08:19:57.902 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:56.492346+0000 mgr.y (mgr.14505) 123 : cluster [DBG] pgmap v114: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 396 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 1.0 KiB/s rd, 41 MiB/s wr, 658 op/s; 2111/19605 objects degraded (10.768%) 2024-02-10T08:19:57.907 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:19:57.933 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:19:57.937 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:19:57.937 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:19:57.975 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:19:58.038 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:19:58.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:56.492346+0000 mgr.y (mgr.14505) 123 : cluster [DBG] pgmap v114: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 396 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 1.0 KiB/s rd, 41 MiB/s wr, 658 op/s; 2111/19605 objects degraded (10.768%) 2024-02-10T08:19:58.039 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:19:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:19:58.088 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:19:58.198 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 8 16 19849 19833 154.889 139.75 0.00274603 0.00644789 2024-02-10T08:19:58.251 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:19:58.256 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:19:58.256 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:19:58.357 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:19:58.413 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:19:58.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:19:57.592529+0000 mgr.y (mgr.14505) 124 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:19:58.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:19:57.592529+0000 mgr.y (mgr.14505) 124 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:19:59.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:19:57.592529+0000 mgr.y (mgr.14505) 124 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:19:59.198 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 9 16 21765 21749 150.984 119.75 0.0120562 0.00661666 2024-02-10T08:19:59.711 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is unset 2024-02-10T08:20:00.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:59 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:58.493471+0000 mgr.y (mgr.14505) 125 : cluster [DBG] pgmap v115: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 1.1 GiB data, 5.1 GiB used, 710 GiB / 715 GiB avail; 962 B/s rd, 107 MiB/s wr, 1.71k op/s; 5714/55254 objects degraded (10.341%) 2024-02-10T08:20:00.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:59 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:58.629486+0000 mon.a (mon.0) 775 : cluster [WRN] Health check update: Degraded data redundancy: 5714/55254 objects degraded (10.341%), 24 pgs degraded (PG_DEGRADED) 2024-02-10T08:20:00.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:59 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:19:59.077986+0000 mon.c (mon.2) 25 : audit [INF] from='client.? 172.21.15.18:0/390503895' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:20:00.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:19:59 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:19:59.078422+0000 mon.a (mon.0) 776 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:20:00.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:58.493471+0000 mgr.y (mgr.14505) 125 : cluster [DBG] pgmap v115: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 1.1 GiB data, 5.1 GiB used, 710 GiB / 715 GiB avail; 962 B/s rd, 107 MiB/s wr, 1.71k op/s; 5714/55254 objects degraded (10.341%) 2024-02-10T08:20:00.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:58.629486+0000 mon.a (mon.0) 775 : cluster [WRN] Health check update: Degraded data redundancy: 5714/55254 objects degraded (10.341%), 24 pgs degraded (PG_DEGRADED) 2024-02-10T08:20:00.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:19:59.077986+0000 mon.c (mon.2) 25 : audit [INF] from='client.? 172.21.15.18:0/390503895' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:20:00.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:19:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:19:59.078422+0000 mon.a (mon.0) 776 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:20:00.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:58.493471+0000 mgr.y (mgr.14505) 125 : cluster [DBG] pgmap v115: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 1.1 GiB data, 5.1 GiB used, 710 GiB / 715 GiB avail; 962 B/s rd, 107 MiB/s wr, 1.71k op/s; 5714/55254 objects degraded (10.341%) 2024-02-10T08:20:00.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:58.629486+0000 mon.a (mon.0) 775 : cluster [WRN] Health check update: Degraded data redundancy: 5714/55254 objects degraded (10.341%), 24 pgs degraded (PG_DEGRADED) 2024-02-10T08:20:00.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:19:59.077986+0000 mon.c (mon.2) 25 : audit [INF] from='client.? 172.21.15.18:0/390503895' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:20:00.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:19:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:19:59.078422+0000 mon.a (mon.0) 776 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:20:00.198 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 10 16 23676 23660 147.829 119.438 0.00485182 0.00675795 2024-02-10T08:20:00.279 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:20:00.285 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:00.285 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:20:00.386 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:20:00.447 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:00.876 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:59.648434+0000 mon.a (mon.0) 777 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:20:00.877 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:19:59.667316+0000 mon.a (mon.0) 778 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-10T08:20:00.877 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:59.667380+0000 mon.a (mon.0) 779 : cluster [DBG] osdmap e96: 8 total, 7 up, 8 in 2024-02-10T08:20:00.877 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:00.000116+0000 mon.a (mon.0) 780 : cluster [WRN] Health detail: HEALTH_WARN nodeep-scrub flag(s) set; 1 osds down; Degraded data redundancy: 5714/55254 objects degraded (10.341%), 24 pgs degraded 2024-02-10T08:20:00.877 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:00.000150+0000 mon.a (mon.0) 781 : cluster [WRN] [WRN] OSDMAP_FLAGS: nodeep-scrub flag(s) set 2024-02-10T08:20:00.877 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:00.000162+0000 mon.a (mon.0) 782 : cluster [WRN] [WRN] OSD_DOWN: 1 osds down 2024-02-10T08:20:00.877 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:00.000173+0000 mon.a (mon.0) 783 : cluster [WRN] osd.4 (root=default,host=smithi071) is down 2024-02-10T08:20:00.877 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:00.000184+0000 mon.a (mon.0) 784 : cluster [WRN] [WRN] PG_DEGRADED: Degraded data redundancy: 5714/55254 objects degraded (10.341%), 24 pgs degraded 2024-02-10T08:20:00.877 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:00.000196+0000 mon.a (mon.0) 785 : cluster [WRN] pg 2.f is active+undersized+degraded, acting [0,7] 2024-02-10T08:20:00.877 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:00.000217+0000 mon.a (mon.0) 786 : cluster [WRN] pg 4.1 is active+undersized+degraded, acting [5,6] 2024-02-10T08:20:00.877 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:00.000228+0000 mon.a (mon.0) 787 : cluster [WRN] pg 4.2 is active+undersized+degraded, acting [1,5] 2024-02-10T08:20:00.877 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:00.000238+0000 mon.a (mon.0) 788 : cluster [WRN] pg 4.5 is active+undersized+degraded, acting [6,7] 2024-02-10T08:20:00.877 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:00.000248+0000 mon.a (mon.0) 789 : cluster [WRN] pg 4.9 is active+undersized+degraded, acting [1,3] 2024-02-10T08:20:00.877 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:00.000259+0000 mon.a (mon.0) 790 : cluster [WRN] pg 4.b is active+undersized+degraded, acting [0,1] 2024-02-10T08:20:00.877 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:00.000269+0000 mon.a (mon.0) 791 : cluster [WRN] pg 4.c is active+undersized+degraded, acting [3,6] 2024-02-10T08:20:00.878 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:00.000279+0000 mon.a (mon.0) 792 : cluster [WRN] pg 4.d is active+undersized+degraded, acting [2,5] 2024-02-10T08:20:00.878 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:00.000291+0000 mon.a (mon.0) 793 : cluster [WRN] pg 4.e is active+undersized+degraded, acting [6,1] 2024-02-10T08:20:00.878 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:00.000302+0000 mon.a (mon.0) 794 : cluster [WRN] pg 4.f is active+undersized+degraded, acting [2,3] 2024-02-10T08:20:00.878 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:00.000312+0000 mon.a (mon.0) 795 : cluster [WRN] pg 4.13 is active+undersized+degraded, acting [6,2] 2024-02-10T08:20:00.878 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:00.000322+0000 mon.a (mon.0) 796 : cluster [WRN] pg 4.18 is active+undersized+degraded, acting [6,1] 2024-02-10T08:20:00.878 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:00.000333+0000 mon.a (mon.0) 797 : cluster [WRN] pg 4.1a is active+undersized+degraded, acting [3,0] 2024-02-10T08:20:00.878 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:00.000344+0000 mon.a (mon.0) 798 : cluster [WRN] pg 4.1b is active+undersized+degraded, acting [3,1] 2024-02-10T08:20:00.878 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:00.000355+0000 mon.a (mon.0) 799 : cluster [WRN] pg 4.1d is active+undersized+degraded, acting [3,1] 2024-02-10T08:20:00.878 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:00.000365+0000 mon.a (mon.0) 800 : cluster [WRN] pg 5.0 is active+undersized+degraded, acting [3,1] 2024-02-10T08:20:00.878 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:00.000376+0000 mon.a (mon.0) 801 : cluster [WRN] pg 5.9 is active+undersized+degraded, acting [7,6] 2024-02-10T08:20:00.878 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:00.000386+0000 mon.a (mon.0) 802 : cluster [WRN] pg 5.e is active+undersized+degraded, acting [5,0] 2024-02-10T08:20:00.878 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:00.000396+0000 mon.a (mon.0) 803 : cluster [WRN] pg 5.1f is active+undersized+degraded, acting [6,7] 2024-02-10T08:20:00.878 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:00.000412+0000 mon.a (mon.0) 804 : cluster [WRN] pg 7.1 is active+undersized+degraded, acting [3,6] 2024-02-10T08:20:00.878 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:00.000423+0000 mon.a (mon.0) 805 : cluster [WRN] pg 7.3 is active+undersized+degraded, acting [3,2] 2024-02-10T08:20:00.878 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:00.000434+0000 mon.a (mon.0) 806 : cluster [WRN] pg 7.4 is active+undersized+degraded, acting [0,1] 2024-02-10T08:20:00.879 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:00.000444+0000 mon.a (mon.0) 807 : cluster [WRN] pg 7.8 is active+undersized+degraded, acting [2,7] 2024-02-10T08:20:00.879 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:00.000455+0000 mon.a (mon.0) 808 : cluster [WRN] pg 7.9 is active+undersized+degraded, acting [0,1] 2024-02-10T08:20:00.879 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:59.648434+0000 mon.a (mon.0) 777 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:20:00.879 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:19:59.667316+0000 mon.a (mon.0) 778 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-10T08:20:00.879 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:59.667380+0000 mon.a (mon.0) 779 : cluster [DBG] osdmap e96: 8 total, 7 up, 8 in 2024-02-10T08:20:00.879 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:00.000116+0000 mon.a (mon.0) 780 : cluster [WRN] Health detail: HEALTH_WARN nodeep-scrub flag(s) set; 1 osds down; Degraded data redundancy: 5714/55254 objects degraded (10.341%), 24 pgs degraded 2024-02-10T08:20:00.879 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:00.000150+0000 mon.a (mon.0) 781 : cluster [WRN] [WRN] OSDMAP_FLAGS: nodeep-scrub flag(s) set 2024-02-10T08:20:00.879 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:00.000162+0000 mon.a (mon.0) 782 : cluster [WRN] [WRN] OSD_DOWN: 1 osds down 2024-02-10T08:20:00.879 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:00.000173+0000 mon.a (mon.0) 783 : cluster [WRN] osd.4 (root=default,host=smithi071) is down 2024-02-10T08:20:00.879 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:00.000184+0000 mon.a (mon.0) 784 : cluster [WRN] [WRN] PG_DEGRADED: Degraded data redundancy: 5714/55254 objects degraded (10.341%), 24 pgs degraded 2024-02-10T08:20:00.880 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:00.000196+0000 mon.a (mon.0) 785 : cluster [WRN] pg 2.f is active+undersized+degraded, acting [0,7] 2024-02-10T08:20:00.880 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:00.000217+0000 mon.a (mon.0) 786 : cluster [WRN] pg 4.1 is active+undersized+degraded, acting [5,6] 2024-02-10T08:20:00.880 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:00.000228+0000 mon.a (mon.0) 787 : cluster [WRN] pg 4.2 is active+undersized+degraded, acting [1,5] 2024-02-10T08:20:00.880 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:00.000238+0000 mon.a (mon.0) 788 : cluster [WRN] pg 4.5 is active+undersized+degraded, acting [6,7] 2024-02-10T08:20:00.880 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:00.000248+0000 mon.a (mon.0) 789 : cluster [WRN] pg 4.9 is active+undersized+degraded, acting [1,3] 2024-02-10T08:20:00.880 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:00.000259+0000 mon.a (mon.0) 790 : cluster [WRN] pg 4.b is active+undersized+degraded, acting [0,1] 2024-02-10T08:20:00.880 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:00.000269+0000 mon.a (mon.0) 791 : cluster [WRN] pg 4.c is active+undersized+degraded, acting [3,6] 2024-02-10T08:20:00.880 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:00.000279+0000 mon.a (mon.0) 792 : cluster [WRN] pg 4.d is active+undersized+degraded, acting [2,5] 2024-02-10T08:20:00.880 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:00.000291+0000 mon.a (mon.0) 793 : cluster [WRN] pg 4.e is active+undersized+degraded, acting [6,1] 2024-02-10T08:20:00.880 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:00.000302+0000 mon.a (mon.0) 794 : cluster [WRN] pg 4.f is active+undersized+degraded, acting [2,3] 2024-02-10T08:20:00.880 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:00.000312+0000 mon.a (mon.0) 795 : cluster [WRN] pg 4.13 is active+undersized+degraded, acting [6,2] 2024-02-10T08:20:00.880 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:00.000322+0000 mon.a (mon.0) 796 : cluster [WRN] pg 4.18 is active+undersized+degraded, acting [6,1] 2024-02-10T08:20:00.880 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:00.000333+0000 mon.a (mon.0) 797 : cluster [WRN] pg 4.1a is active+undersized+degraded, acting [3,0] 2024-02-10T08:20:00.880 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:00.000344+0000 mon.a (mon.0) 798 : cluster [WRN] pg 4.1b is active+undersized+degraded, acting [3,1] 2024-02-10T08:20:00.881 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:00.000355+0000 mon.a (mon.0) 799 : cluster [WRN] pg 4.1d is active+undersized+degraded, acting [3,1] 2024-02-10T08:20:00.881 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:00.000365+0000 mon.a (mon.0) 800 : cluster [WRN] pg 5.0 is active+undersized+degraded, acting [3,1] 2024-02-10T08:20:00.881 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:00.000376+0000 mon.a (mon.0) 801 : cluster [WRN] pg 5.9 is active+undersized+degraded, acting [7,6] 2024-02-10T08:20:00.881 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:00.000386+0000 mon.a (mon.0) 802 : cluster [WRN] pg 5.e is active+undersized+degraded, acting [5,0] 2024-02-10T08:20:00.881 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:00.000396+0000 mon.a (mon.0) 803 : cluster [WRN] pg 5.1f is active+undersized+degraded, acting [6,7] 2024-02-10T08:20:00.881 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:00.000412+0000 mon.a (mon.0) 804 : cluster [WRN] pg 7.1 is active+undersized+degraded, acting [3,6] 2024-02-10T08:20:00.881 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:00.000423+0000 mon.a (mon.0) 805 : cluster [WRN] pg 7.3 is active+undersized+degraded, acting [3,2] 2024-02-10T08:20:00.881 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:00.000434+0000 mon.a (mon.0) 806 : cluster [WRN] pg 7.4 is active+undersized+degraded, acting [0,1] 2024-02-10T08:20:00.881 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:00.000444+0000 mon.a (mon.0) 807 : cluster [WRN] pg 7.8 is active+undersized+degraded, acting [2,7] 2024-02-10T08:20:00.881 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:00.000455+0000 mon.a (mon.0) 808 : cluster [WRN] pg 7.9 is active+undersized+degraded, acting [0,1] 2024-02-10T08:20:00.939 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-02-10T08:20:00.940 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-02-10T08:20:00.940 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:00.940 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:24861 7.b 7:d64c8e80:::benchmark_data_smithi018_80623_object24860:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected e96)", 2024-02-10T08:20:00.940 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:00.846811+0000", 2024-02-10T08:20:00.940 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.0021644680000000001, 2024-02-10T08:20:00.940 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0021884109999999999, 2024-02-10T08:20:00.940 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:20:00.940 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "waiting for sub ops", 2024-02-10T08:20:00.940 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:20:00.940 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:20:00.940 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:20:00.940 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 24861 2024-02-10T08:20:00.941 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:00.941 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:20:00.941 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:00.941 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:20:00.941 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:00.846811+0000", 2024-02-10T08:20:00.941 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:20:00.941 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:00.941 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:00.941 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:20:00.941 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:00.846811+0000", 2024-02-10T08:20:00.941 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:20:00.942 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:00.942 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:00.942 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:20:00.942 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:00.846809+0000", 2024-02-10T08:20:00.942 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3655e-05 2024-02-10T08:20:00.942 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:00.942 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:00.942 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:20:00.942 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:00.846833+0000", 2024-02-10T08:20:00.942 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5758000000000001e-05 2024-02-10T08:20:00.942 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:00.942 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:00.942 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:20:00.942 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:00.846849+0000", 2024-02-10T08:20:00.942 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1289999999999998e-06 2024-02-10T08:20:00.943 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:00.943 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:00.943 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:20:00.943 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:00.846856+0000", 2024-02-10T08:20:00.943 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8665999999999994e-05 2024-02-10T08:20:00.943 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:00.943 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:00.943 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:20:00.943 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:00.846945+0000", 2024-02-10T08:20:00.943 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013077 2024-02-10T08:20:00.943 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:00.943 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:00.943 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:20:00.943 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:00.847075+0000", 2024-02-10T08:20:00.944 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000154909 2024-02-10T08:20:00.944 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:00.944 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:00.944 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 5,6", 2024-02-10T08:20:00.944 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:00.847230+0000", 2024-02-10T08:20:00.944 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0012747349999999999 2024-02-10T08:20:00.944 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:00.944 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:00.944 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:20:00.944 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:00.848505+0000", 2024-02-10T08:20:00.944 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6876000000000001e-05 2024-02-10T08:20:00.944 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:00.944 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:00.944 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:20:00.944 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:00.848582+0000", 2024-02-10T08:20:00.945 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001770923 2024-02-10T08:20:00.945 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:00.945 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:00.945 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:00.945 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:00.945 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:00.945 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.14784.0:24862 7.0 e96/91 7:0fc168b1:::benchmark_data_smithi018_80623_object24861:head v 96'1574, mlcod=96'1571)", 2024-02-10T08:20:00.945 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:00.846972+0000", 2024-02-10T08:20:00.945 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.002003538, 2024-02-10T08:20:00.945 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0021186270000000001, 2024-02-10T08:20:00.945 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:20:00.945 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-02-10T08:20:00.945 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:20:00.945 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:00.946 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:20:00.946 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:00.846972+0000", 2024-02-10T08:20:00.946 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:20:00.946 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:00.946 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:00.946 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:20:00.946 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:00.846972+0000", 2024-02-10T08:20:00.946 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:20:00.946 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:00.946 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:00.946 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:20:00.946 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:00.846971+0000", 2024-02-10T08:20:00.946 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00035308600000000001 2024-02-10T08:20:00.946 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:00.946 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:00.947 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:20:00.947 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:00.847324+0000", 2024-02-10T08:20:00.947 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2439999999999999e-06 2024-02-10T08:20:00.947 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:00.947 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:00.947 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:20:00.947 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:00.847333+0000", 2024-02-10T08:20:00.947 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.178e-06 2024-02-10T08:20:00.947 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:00.947 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:00.947 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:20:00.947 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:00.847340+0000", 2024-02-10T08:20:00.947 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7891000000000004e-05 2024-02-10T08:20:00.947 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:00.947 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:00.948 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:20:00.948 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:00.847418+0000", 2024-02-10T08:20:00.948 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9437999999999999e-05 2024-02-10T08:20:00.948 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:00.948 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:00.948 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:20:00.948 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:00.847437+0000", 2024-02-10T08:20:00.948 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000464981 2024-02-10T08:20:00.948 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:00.948 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:00.948 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:00.948 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:00.948 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:00.948 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.14784.0:24857 7.9 e96/91 7:92cbda9f:::benchmark_data_smithi018_80623_object24856:head v 96'1574, mlcod=96'1572)", 2024-02-10T08:20:00.949 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:00.847836+0000", 2024-02-10T08:20:00.949 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.0011392640000000001, 2024-02-10T08:20:00.949 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0012925269999999999, 2024-02-10T08:20:00.949 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:20:00.949 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-02-10T08:20:00.949 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:20:00.949 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:00.949 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:20:00.949 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:00.847836+0000", 2024-02-10T08:20:00.949 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:20:00.949 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:00.949 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:00.949 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:20:00.949 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:00.847836+0000", 2024-02-10T08:20:00.949 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:20:00.949 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:00.950 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:00.950 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:20:00.950 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:00.847835+0000", 2024-02-10T08:20:00.950 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3992999999999999e-05 2024-02-10T08:20:00.950 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:00.950 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:00.950 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:20:00.950 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:00.847859+0000", 2024-02-10T08:20:00.950 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5589999999999994e-06 2024-02-10T08:20:00.950 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:00.950 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:00.950 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:20:00.950 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:00.847869+0000", 2024-02-10T08:20:00.950 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8220000000000003e-06 2024-02-10T08:20:00.950 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:00.951 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:00.951 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:20:00.951 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:00.847875+0000", 2024-02-10T08:20:00.951 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9994999999999997e-05 2024-02-10T08:20:00.951 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:00.951 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:00.951 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:20:00.951 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:00.847935+0000", 2024-02-10T08:20:00.951 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9298000000000001e-05 2024-02-10T08:20:00.951 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:00.951 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:00.951 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:20:00.951 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:00.847954+0000", 2024-02-10T08:20:00.951 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000117929 2024-02-10T08:20:00.951 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:00.952 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:00.952 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:00.952 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:00.952 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-02-10T08:20:00.952 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 3 2024-02-10T08:20:00.952 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-02-10T08:20:01.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:59.648434+0000 mon.a (mon.0) 777 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:20:01.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:19:59.667316+0000 mon.a (mon.0) 778 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-10T08:20:01.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:59.667380+0000 mon.a (mon.0) 779 : cluster [DBG] osdmap e96: 8 total, 7 up, 8 in 2024-02-10T08:20:01.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:00.000116+0000 mon.a (mon.0) 780 : cluster [WRN] Health detail: HEALTH_WARN nodeep-scrub flag(s) set; 1 osds down; Degraded data redundancy: 5714/55254 objects degraded (10.341%), 24 pgs degraded 2024-02-10T08:20:01.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:00.000150+0000 mon.a (mon.0) 781 : cluster [WRN] [WRN] OSDMAP_FLAGS: nodeep-scrub flag(s) set 2024-02-10T08:20:01.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:00.000162+0000 mon.a (mon.0) 782 : cluster [WRN] [WRN] OSD_DOWN: 1 osds down 2024-02-10T08:20:01.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:00.000173+0000 mon.a (mon.0) 783 : cluster [WRN] osd.4 (root=default,host=smithi071) is down 2024-02-10T08:20:01.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:00.000184+0000 mon.a (mon.0) 784 : cluster [WRN] [WRN] PG_DEGRADED: Degraded data redundancy: 5714/55254 objects degraded (10.341%), 24 pgs degraded 2024-02-10T08:20:01.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:00.000196+0000 mon.a (mon.0) 785 : cluster [WRN] pg 2.f is active+undersized+degraded, acting [0,7] 2024-02-10T08:20:01.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:00.000217+0000 mon.a (mon.0) 786 : cluster [WRN] pg 4.1 is active+undersized+degraded, acting [5,6] 2024-02-10T08:20:01.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:00.000228+0000 mon.a (mon.0) 787 : cluster [WRN] pg 4.2 is active+undersized+degraded, acting [1,5] 2024-02-10T08:20:01.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:00.000238+0000 mon.a (mon.0) 788 : cluster [WRN] pg 4.5 is active+undersized+degraded, acting [6,7] 2024-02-10T08:20:01.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:00.000248+0000 mon.a (mon.0) 789 : cluster [WRN] pg 4.9 is active+undersized+degraded, acting [1,3] 2024-02-10T08:20:01.041 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:00.000259+0000 mon.a (mon.0) 790 : cluster [WRN] pg 4.b is active+undersized+degraded, acting [0,1] 2024-02-10T08:20:01.041 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:00.000269+0000 mon.a (mon.0) 791 : cluster [WRN] pg 4.c is active+undersized+degraded, acting [3,6] 2024-02-10T08:20:01.041 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:00.000279+0000 mon.a (mon.0) 792 : cluster [WRN] pg 4.d is active+undersized+degraded, acting [2,5] 2024-02-10T08:20:01.041 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:00.000291+0000 mon.a (mon.0) 793 : cluster [WRN] pg 4.e is active+undersized+degraded, acting [6,1] 2024-02-10T08:20:01.041 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:00.000302+0000 mon.a (mon.0) 794 : cluster [WRN] pg 4.f is active+undersized+degraded, acting [2,3] 2024-02-10T08:20:01.041 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:00.000312+0000 mon.a (mon.0) 795 : cluster [WRN] pg 4.13 is active+undersized+degraded, acting [6,2] 2024-02-10T08:20:01.041 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:00.000322+0000 mon.a (mon.0) 796 : cluster [WRN] pg 4.18 is active+undersized+degraded, acting [6,1] 2024-02-10T08:20:01.041 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:00.000333+0000 mon.a (mon.0) 797 : cluster [WRN] pg 4.1a is active+undersized+degraded, acting [3,0] 2024-02-10T08:20:01.041 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:00.000344+0000 mon.a (mon.0) 798 : cluster [WRN] pg 4.1b is active+undersized+degraded, acting [3,1] 2024-02-10T08:20:01.041 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:00.000355+0000 mon.a (mon.0) 799 : cluster [WRN] pg 4.1d is active+undersized+degraded, acting [3,1] 2024-02-10T08:20:01.041 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:00.000365+0000 mon.a (mon.0) 800 : cluster [WRN] pg 5.0 is active+undersized+degraded, acting [3,1] 2024-02-10T08:20:01.041 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:00.000376+0000 mon.a (mon.0) 801 : cluster [WRN] pg 5.9 is active+undersized+degraded, acting [7,6] 2024-02-10T08:20:01.041 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:00.000386+0000 mon.a (mon.0) 802 : cluster [WRN] pg 5.e is active+undersized+degraded, acting [5,0] 2024-02-10T08:20:01.041 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:00.000396+0000 mon.a (mon.0) 803 : cluster [WRN] pg 5.1f is active+undersized+degraded, acting [6,7] 2024-02-10T08:20:01.041 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:00.000412+0000 mon.a (mon.0) 804 : cluster [WRN] pg 7.1 is active+undersized+degraded, acting [3,6] 2024-02-10T08:20:01.041 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:00.000423+0000 mon.a (mon.0) 805 : cluster [WRN] pg 7.3 is active+undersized+degraded, acting [3,2] 2024-02-10T08:20:01.042 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:00.000434+0000 mon.a (mon.0) 806 : cluster [WRN] pg 7.4 is active+undersized+degraded, acting [0,1] 2024-02-10T08:20:01.042 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:00.000444+0000 mon.a (mon.0) 807 : cluster [WRN] pg 7.8 is active+undersized+degraded, acting [2,7] 2024-02-10T08:20:01.042 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:00.000455+0000 mon.a (mon.0) 808 : cluster [WRN] pg 7.9 is active+undersized+degraded, acting [0,1] 2024-02-10T08:20:01.198 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 11 16 25568 25552 145.14 118.25 0.00894388 0.00688415 2024-02-10T08:20:01.412 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:20:01.418 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:01.419 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:20:01.519 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:20:01.567 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:01.907 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:59.840646+0000 osd.2 (osd.2) 51 : cluster [DBG] 2.10 scrub starts 2024-02-10T08:20:01.907 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:19:59.845343+0000 osd.2 (osd.2) 52 : cluster [DBG] 2.10 scrub ok 2024-02-10T08:20:01.907 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:00.494063+0000 mgr.y (mgr.14505) 126 : cluster [DBG] pgmap v117: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 1.1 GiB data, 5.1 GiB used, 710 GiB / 715 GiB avail; 1023 B/s rd, 114 MiB/s wr, 1.82k op/s; 5714/55254 objects degraded (10.341%) 2024-02-10T08:20:01.907 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:59.840646+0000 osd.2 (osd.2) 51 : cluster [DBG] 2.10 scrub starts 2024-02-10T08:20:01.908 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:19:59.845343+0000 osd.2 (osd.2) 52 : cluster [DBG] 2.10 scrub ok 2024-02-10T08:20:01.908 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:00.494063+0000 mgr.y (mgr.14505) 126 : cluster [DBG] pgmap v117: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 1.1 GiB data, 5.1 GiB used, 710 GiB / 715 GiB avail; 1023 B/s rd, 114 MiB/s wr, 1.82k op/s; 5714/55254 objects degraded (10.341%) 2024-02-10T08:20:02.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:59.840646+0000 osd.2 (osd.2) 51 : cluster [DBG] 2.10 scrub starts 2024-02-10T08:20:02.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:19:59.845343+0000 osd.2 (osd.2) 52 : cluster [DBG] 2.10 scrub ok 2024-02-10T08:20:02.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:00.494063+0000 mgr.y (mgr.14505) 126 : cluster [DBG] pgmap v117: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 1.1 GiB data, 5.1 GiB used, 710 GiB / 715 GiB avail; 1023 B/s rd, 114 MiB/s wr, 1.82k op/s; 5714/55254 objects degraded (10.341%) 2024-02-10T08:20:02.199 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 12 16 27450 27434 142.838 117.625 0.00676583 0.00699483 2024-02-10T08:20:03.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:00.825302+0000 osd.0 (osd.0) 55 : cluster [DBG] 6.18 scrub starts 2024-02-10T08:20:03.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:00.830862+0000 osd.0 (osd.0) 56 : cluster [DBG] 6.18 scrub ok 2024-02-10T08:20:03.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:00.882840+0000 osd.2 (osd.2) 53 : cluster [DBG] 5.6 scrub starts 2024-02-10T08:20:03.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:00.886225+0000 osd.2 (osd.2) 54 : cluster [DBG] 5.6 scrub ok 2024-02-10T08:20:03.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:01.259903+0000 osd.7 (osd.7) 57 : cluster [DBG] 2.8 scrub starts 2024-02-10T08:20:03.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:01.263654+0000 osd.7 (osd.7) 58 : cluster [DBG] 2.8 scrub ok 2024-02-10T08:20:03.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:01.349535+0000 osd.6 (osd.6) 37 : cluster [DBG] 4.a scrub starts 2024-02-10T08:20:03.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:01.351569+0000 osd.6 (osd.6) 38 : cluster [DBG] 4.a scrub ok 2024-02-10T08:20:03.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:00.825302+0000 osd.0 (osd.0) 55 : cluster [DBG] 6.18 scrub starts 2024-02-10T08:20:03.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:00.830862+0000 osd.0 (osd.0) 56 : cluster [DBG] 6.18 scrub ok 2024-02-10T08:20:03.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:00.882840+0000 osd.2 (osd.2) 53 : cluster [DBG] 5.6 scrub starts 2024-02-10T08:20:03.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:00.886225+0000 osd.2 (osd.2) 54 : cluster [DBG] 5.6 scrub ok 2024-02-10T08:20:03.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:01.259903+0000 osd.7 (osd.7) 57 : cluster [DBG] 2.8 scrub starts 2024-02-10T08:20:03.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:01.263654+0000 osd.7 (osd.7) 58 : cluster [DBG] 2.8 scrub ok 2024-02-10T08:20:03.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:01.349535+0000 osd.6 (osd.6) 37 : cluster [DBG] 4.a scrub starts 2024-02-10T08:20:03.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:01.351569+0000 osd.6 (osd.6) 38 : cluster [DBG] 4.a scrub ok 2024-02-10T08:20:03.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:00.825302+0000 osd.0 (osd.0) 55 : cluster [DBG] 6.18 scrub starts 2024-02-10T08:20:03.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:00.830862+0000 osd.0 (osd.0) 56 : cluster [DBG] 6.18 scrub ok 2024-02-10T08:20:03.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:00.882840+0000 osd.2 (osd.2) 53 : cluster [DBG] 5.6 scrub starts 2024-02-10T08:20:03.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:00.886225+0000 osd.2 (osd.2) 54 : cluster [DBG] 5.6 scrub ok 2024-02-10T08:20:03.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:01.259903+0000 osd.7 (osd.7) 57 : cluster [DBG] 2.8 scrub starts 2024-02-10T08:20:03.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:01.263654+0000 osd.7 (osd.7) 58 : cluster [DBG] 2.8 scrub ok 2024-02-10T08:20:03.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:01.349535+0000 osd.6 (osd.6) 37 : cluster [DBG] 4.a scrub starts 2024-02-10T08:20:03.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:01.351569+0000 osd.6 (osd.6) 38 : cluster [DBG] 4.a scrub ok 2024-02-10T08:20:03.199 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 13 16 29280 29264 140.64 114.375 0.00424165 0.00710522 2024-02-10T08:20:04.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:01.816547+0000 osd.0 (osd.0) 57 : cluster [DBG] 4.3 scrub starts 2024-02-10T08:20:04.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:01.822732+0000 osd.0 (osd.0) 58 : cluster [DBG] 4.3 scrub ok 2024-02-10T08:20:04.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:02.243588+0000 osd.7 (osd.7) 59 : cluster [DBG] 2.1c scrub starts 2024-02-10T08:20:04.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:02.245589+0000 osd.7 (osd.7) 60 : cluster [DBG] 2.1c scrub ok 2024-02-10T08:20:04.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:02.494837+0000 mgr.y (mgr.14505) 127 : cluster [DBG] pgmap v118: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 1.7 GiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 1023 B/s rd, 135 MiB/s wr, 2.16k op/s; 8765/84477 objects degraded (10.376%) 2024-02-10T08:20:04.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:03.245395+0000 osd.5 (osd.5) 51 : cluster [DBG] 6.d scrub starts 2024-02-10T08:20:04.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:03.250579+0000 osd.5 (osd.5) 52 : cluster [DBG] 6.d scrub ok 2024-02-10T08:20:04.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:01.816547+0000 osd.0 (osd.0) 57 : cluster [DBG] 4.3 scrub starts 2024-02-10T08:20:04.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:01.822732+0000 osd.0 (osd.0) 58 : cluster [DBG] 4.3 scrub ok 2024-02-10T08:20:04.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:02.243588+0000 osd.7 (osd.7) 59 : cluster [DBG] 2.1c scrub starts 2024-02-10T08:20:04.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:02.245589+0000 osd.7 (osd.7) 60 : cluster [DBG] 2.1c scrub ok 2024-02-10T08:20:04.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:02.494837+0000 mgr.y (mgr.14505) 127 : cluster [DBG] pgmap v118: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 1.7 GiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 1023 B/s rd, 135 MiB/s wr, 2.16k op/s; 8765/84477 objects degraded (10.376%) 2024-02-10T08:20:04.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:03.245395+0000 osd.5 (osd.5) 51 : cluster [DBG] 6.d scrub starts 2024-02-10T08:20:04.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:03.250579+0000 osd.5 (osd.5) 52 : cluster [DBG] 6.d scrub ok 2024-02-10T08:20:04.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:01.816547+0000 osd.0 (osd.0) 57 : cluster [DBG] 4.3 scrub starts 2024-02-10T08:20:04.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:01.822732+0000 osd.0 (osd.0) 58 : cluster [DBG] 4.3 scrub ok 2024-02-10T08:20:04.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:02.243588+0000 osd.7 (osd.7) 59 : cluster [DBG] 2.1c scrub starts 2024-02-10T08:20:04.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:02.245589+0000 osd.7 (osd.7) 60 : cluster [DBG] 2.1c scrub ok 2024-02-10T08:20:04.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:02.494837+0000 mgr.y (mgr.14505) 127 : cluster [DBG] pgmap v118: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 1.7 GiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 1023 B/s rd, 135 MiB/s wr, 2.16k op/s; 8765/84477 objects degraded (10.376%) 2024-02-10T08:20:04.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:03.245395+0000 osd.5 (osd.5) 51 : cluster [DBG] 6.d scrub starts 2024-02-10T08:20:04.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:03.250579+0000 osd.5 (osd.5) 52 : cluster [DBG] 6.d scrub ok 2024-02-10T08:20:04.202 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 14 16 30863 30847 137.644 98.9375 0.00790001 0.0072593 2024-02-10T08:20:05.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:02.836184+0000 osd.0 (osd.0) 59 : cluster [DBG] 5.1e scrub starts 2024-02-10T08:20:05.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:02.843230+0000 osd.0 (osd.0) 60 : cluster [DBG] 5.1e scrub ok 2024-02-10T08:20:05.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:03.325017+0000 osd.3 (osd.3) 63 : cluster [DBG] 4.19 scrub starts 2024-02-10T08:20:05.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:03.330501+0000 osd.3 (osd.3) 64 : cluster [DBG] 4.19 scrub ok 2024-02-10T08:20:05.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:03.389570+0000 osd.6 (osd.6) 39 : cluster [DBG] 2.7 scrub starts 2024-02-10T08:20:05.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:03.392558+0000 osd.6 (osd.6) 40 : cluster [DBG] 2.7 scrub ok 2024-02-10T08:20:05.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:03.778031+0000 osd.1 (osd.1) 61 : cluster [DBG] 2.15 scrub starts 2024-02-10T08:20:05.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:03.782128+0000 osd.1 (osd.1) 62 : cluster [DBG] 2.15 scrub ok 2024-02-10T08:20:05.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:02.836184+0000 osd.0 (osd.0) 59 : cluster [DBG] 5.1e scrub starts 2024-02-10T08:20:05.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:02.843230+0000 osd.0 (osd.0) 60 : cluster [DBG] 5.1e scrub ok 2024-02-10T08:20:05.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:03.325017+0000 osd.3 (osd.3) 63 : cluster [DBG] 4.19 scrub starts 2024-02-10T08:20:05.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:03.330501+0000 osd.3 (osd.3) 64 : cluster [DBG] 4.19 scrub ok 2024-02-10T08:20:05.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:03.389570+0000 osd.6 (osd.6) 39 : cluster [DBG] 2.7 scrub starts 2024-02-10T08:20:05.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:03.392558+0000 osd.6 (osd.6) 40 : cluster [DBG] 2.7 scrub ok 2024-02-10T08:20:05.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:03.778031+0000 osd.1 (osd.1) 61 : cluster [DBG] 2.15 scrub starts 2024-02-10T08:20:05.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:03.782128+0000 osd.1 (osd.1) 62 : cluster [DBG] 2.15 scrub ok 2024-02-10T08:20:05.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:02.836184+0000 osd.0 (osd.0) 59 : cluster [DBG] 5.1e scrub starts 2024-02-10T08:20:05.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:02.843230+0000 osd.0 (osd.0) 60 : cluster [DBG] 5.1e scrub ok 2024-02-10T08:20:05.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:03.325017+0000 osd.3 (osd.3) 63 : cluster [DBG] 4.19 scrub starts 2024-02-10T08:20:05.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:03.330501+0000 osd.3 (osd.3) 64 : cluster [DBG] 4.19 scrub ok 2024-02-10T08:20:05.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:03.389570+0000 osd.6 (osd.6) 39 : cluster [DBG] 2.7 scrub starts 2024-02-10T08:20:05.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:03.392558+0000 osd.6 (osd.6) 40 : cluster [DBG] 2.7 scrub ok 2024-02-10T08:20:05.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:03.778031+0000 osd.1 (osd.1) 61 : cluster [DBG] 2.15 scrub starts 2024-02-10T08:20:05.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:03.782128+0000 osd.1 (osd.1) 62 : cluster [DBG] 2.15 scrub ok 2024-02-10T08:20:05.202 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 15 16 32735 32719 136.262 117 0.00999855 0.00733412 2024-02-10T08:20:06.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:04.279197+0000 osd.5 (osd.5) 53 : cluster [DBG] 2.12 scrub starts 2024-02-10T08:20:06.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:04.285236+0000 osd.5 (osd.5) 54 : cluster [DBG] 2.12 scrub ok 2024-02-10T08:20:06.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:04.338559+0000 osd.3 (osd.3) 65 : cluster [DBG] 2.1b scrub starts 2024-02-10T08:20:06.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:04.345236+0000 osd.3 (osd.3) 66 : cluster [DBG] 2.1b scrub ok 2024-02-10T08:20:06.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:04.496747+0000 mgr.y (mgr.14505) 128 : cluster [DBG] pgmap v119: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 1.7 GiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 1023 B/s rd, 135 MiB/s wr, 2.16k op/s; 8765/84477 objects degraded (10.376%) 2024-02-10T08:20:06.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:04.738840+0000 osd.1 (osd.1) 63 : cluster [DBG] 2.9 scrub starts 2024-02-10T08:20:06.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:04.745354+0000 osd.1 (osd.1) 64 : cluster [DBG] 2.9 scrub ok 2024-02-10T08:20:06.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:05.336700+0000 mon.a (mon.0) 809 : cluster [WRN] Health check update: Degraded data redundancy: 8765/84477 objects degraded (10.376%), 24 pgs degraded (PG_DEGRADED) 2024-02-10T08:20:06.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:04.279197+0000 osd.5 (osd.5) 53 : cluster [DBG] 2.12 scrub starts 2024-02-10T08:20:06.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:04.285236+0000 osd.5 (osd.5) 54 : cluster [DBG] 2.12 scrub ok 2024-02-10T08:20:06.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:04.338559+0000 osd.3 (osd.3) 65 : cluster [DBG] 2.1b scrub starts 2024-02-10T08:20:06.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:04.345236+0000 osd.3 (osd.3) 66 : cluster [DBG] 2.1b scrub ok 2024-02-10T08:20:06.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:04.496747+0000 mgr.y (mgr.14505) 128 : cluster [DBG] pgmap v119: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 1.7 GiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 1023 B/s rd, 135 MiB/s wr, 2.16k op/s; 8765/84477 objects degraded (10.376%) 2024-02-10T08:20:06.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:04.738840+0000 osd.1 (osd.1) 63 : cluster [DBG] 2.9 scrub starts 2024-02-10T08:20:06.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:04.745354+0000 osd.1 (osd.1) 64 : cluster [DBG] 2.9 scrub ok 2024-02-10T08:20:06.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:05.336700+0000 mon.a (mon.0) 809 : cluster [WRN] Health check update: Degraded data redundancy: 8765/84477 objects degraded (10.376%), 24 pgs degraded (PG_DEGRADED) 2024-02-10T08:20:06.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:04.279197+0000 osd.5 (osd.5) 53 : cluster [DBG] 2.12 scrub starts 2024-02-10T08:20:06.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:04.285236+0000 osd.5 (osd.5) 54 : cluster [DBG] 2.12 scrub ok 2024-02-10T08:20:06.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:04.338559+0000 osd.3 (osd.3) 65 : cluster [DBG] 2.1b scrub starts 2024-02-10T08:20:06.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:04.345236+0000 osd.3 (osd.3) 66 : cluster [DBG] 2.1b scrub ok 2024-02-10T08:20:06.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:04.496747+0000 mgr.y (mgr.14505) 128 : cluster [DBG] pgmap v119: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 1.7 GiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 1023 B/s rd, 135 MiB/s wr, 2.16k op/s; 8765/84477 objects degraded (10.376%) 2024-02-10T08:20:06.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:04.738840+0000 osd.1 (osd.1) 63 : cluster [DBG] 2.9 scrub starts 2024-02-10T08:20:06.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:04.745354+0000 osd.1 (osd.1) 64 : cluster [DBG] 2.9 scrub ok 2024-02-10T08:20:06.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:05.336700+0000 mon.a (mon.0) 809 : cluster [WRN] Health check update: Degraded data redundancy: 8765/84477 objects degraded (10.376%), 24 pgs degraded (PG_DEGRADED) 2024-02-10T08:20:06.202 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 16 16 34482 34466 134.57 109.188 0.00394264 0.00742394 2024-02-10T08:20:06.789 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:20:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:20:06] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:20:06.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:04.868312+0000 osd.0 (osd.0) 61 : cluster [DBG] 4.6 scrub starts 2024-02-10T08:20:06.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:04.883285+0000 osd.0 (osd.0) 62 : cluster [DBG] 4.6 scrub ok 2024-02-10T08:20:06.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:05.310533+0000 osd.5 (osd.5) 55 : cluster [DBG] 4.8 scrub starts 2024-02-10T08:20:06.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:05.314217+0000 osd.5 (osd.5) 56 : cluster [DBG] 4.8 scrub ok 2024-02-10T08:20:06.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:20:06.648580+0000 mon.b (mon.1) 36 : audit [DBG] from='client.? 172.21.15.18:0/3597079680' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2024-02-10T08:20:07.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:04.868312+0000 osd.0 (osd.0) 61 : cluster [DBG] 4.6 scrub starts 2024-02-10T08:20:07.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:04.883285+0000 osd.0 (osd.0) 62 : cluster [DBG] 4.6 scrub ok 2024-02-10T08:20:07.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:05.310533+0000 osd.5 (osd.5) 55 : cluster [DBG] 4.8 scrub starts 2024-02-10T08:20:07.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:05.314217+0000 osd.5 (osd.5) 56 : cluster [DBG] 4.8 scrub ok 2024-02-10T08:20:07.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:20:06.648580+0000 mon.b (mon.1) 36 : audit [DBG] from='client.? 172.21.15.18:0/3597079680' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2024-02-10T08:20:07.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:04.868312+0000 osd.0 (osd.0) 61 : cluster [DBG] 4.6 scrub starts 2024-02-10T08:20:07.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:04.883285+0000 osd.0 (osd.0) 62 : cluster [DBG] 4.6 scrub ok 2024-02-10T08:20:07.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:05.310533+0000 osd.5 (osd.5) 55 : cluster [DBG] 4.8 scrub starts 2024-02-10T08:20:07.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:05.314217+0000 osd.5 (osd.5) 56 : cluster [DBG] 4.8 scrub ok 2024-02-10T08:20:07.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:20:06.648580+0000 mon.b (mon.1) 36 : audit [DBG] from='client.? 172.21.15.18:0/3597079680' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2024-02-10T08:20:07.202 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 17 16 35866 35850 131.742 86.5 0.00746946 0.00758555 2024-02-10T08:20:07.655 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:20:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:20:07] "GET /metrics HTTP/1.1" 200 175247 "" "Prometheus/2.33.4" 2024-02-10T08:20:08.039 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:20:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:20:08.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:06.248084+0000 osd.7 (osd.7) 61 : cluster [DBG] 1.0 scrub starts 2024-02-10T08:20:08.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:06.252445+0000 osd.7 (osd.7) 62 : cluster [DBG] 1.0 scrub ok 2024-02-10T08:20:08.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:06.500507+0000 mgr.y (mgr.14505) 129 : cluster [DBG] pgmap v120: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 1.7 GiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 1023 B/s rd, 135 MiB/s wr, 2.16k op/s; 8765/84477 objects degraded (10.376%) 2024-02-10T08:20:08.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:06.522315+0000 osd.6 (osd.6) 41 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:20:08.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:06.522359+0000 osd.6 (osd.6) 42 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:20:08.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:06.706950+0000 mon.a (mon.0) 810 : cluster [DBG] osdmap e97: 8 total, 7 up, 8 in 2024-02-10T08:20:08.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:06.807335+0000 osd.1 (osd.1) 65 : cluster [DBG] 5.19 scrub starts 2024-02-10T08:20:08.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:06.810515+0000 osd.1 (osd.1) 66 : cluster [DBG] 5.19 scrub ok 2024-02-10T08:20:08.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:06.248084+0000 osd.7 (osd.7) 61 : cluster [DBG] 1.0 scrub starts 2024-02-10T08:20:08.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:06.252445+0000 osd.7 (osd.7) 62 : cluster [DBG] 1.0 scrub ok 2024-02-10T08:20:08.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:06.500507+0000 mgr.y (mgr.14505) 129 : cluster [DBG] pgmap v120: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 1.7 GiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 1023 B/s rd, 135 MiB/s wr, 2.16k op/s; 8765/84477 objects degraded (10.376%) 2024-02-10T08:20:08.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:06.522315+0000 osd.6 (osd.6) 41 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:20:08.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:06.522359+0000 osd.6 (osd.6) 42 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:20:08.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:06.706950+0000 mon.a (mon.0) 810 : cluster [DBG] osdmap e97: 8 total, 7 up, 8 in 2024-02-10T08:20:08.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:06.807335+0000 osd.1 (osd.1) 65 : cluster [DBG] 5.19 scrub starts 2024-02-10T08:20:08.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:06.810515+0000 osd.1 (osd.1) 66 : cluster [DBG] 5.19 scrub ok 2024-02-10T08:20:08.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:06.248084+0000 osd.7 (osd.7) 61 : cluster [DBG] 1.0 scrub starts 2024-02-10T08:20:08.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:06.252445+0000 osd.7 (osd.7) 62 : cluster [DBG] 1.0 scrub ok 2024-02-10T08:20:08.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:06.500507+0000 mgr.y (mgr.14505) 129 : cluster [DBG] pgmap v120: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 1.7 GiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 1023 B/s rd, 135 MiB/s wr, 2.16k op/s; 8765/84477 objects degraded (10.376%) 2024-02-10T08:20:08.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:06.522315+0000 osd.6 (osd.6) 41 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:20:08.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:06.522359+0000 osd.6 (osd.6) 42 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:20:08.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:06.706950+0000 mon.a (mon.0) 810 : cluster [DBG] osdmap e97: 8 total, 7 up, 8 in 2024-02-10T08:20:08.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:06.807335+0000 osd.1 (osd.1) 65 : cluster [DBG] 5.19 scrub starts 2024-02-10T08:20:08.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:06.810515+0000 osd.1 (osd.1) 66 : cluster [DBG] 5.19 scrub ok 2024-02-10T08:20:08.202 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 18 16 37327 37311 129.496 91.3125 0.00358033 0.00768776 2024-02-10T08:20:09.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:06.904867+0000 osd.0 (osd.0) 63 : cluster [DBG] 6.10 scrub starts 2024-02-10T08:20:09.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:06.911801+0000 osd.0 (osd.0) 64 : cluster [DBG] 6.10 scrub ok 2024-02-10T08:20:09.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:07.296748+0000 osd.5 (osd.5) 57 : cluster [DBG] 2.2 scrub starts 2024-02-10T08:20:09.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:07.299637+0000 osd.5 (osd.5) 58 : cluster [DBG] 2.2 scrub ok 2024-02-10T08:20:09.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:07.348782+0000 osd.6 (osd.6) 43 : cluster [DBG] 5.2 scrub starts 2024-02-10T08:20:09.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:07.350249+0000 osd.6 (osd.6) 44 : cluster [DBG] 5.2 scrub ok 2024-02-10T08:20:09.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:07.350949+0000 osd.3 (osd.3) 67 : cluster [DBG] 5.17 scrub starts 2024-02-10T08:20:09.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:07.352738+0000 osd.3 (osd.3) 68 : cluster [DBG] 5.17 scrub ok 2024-02-10T08:20:09.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:20:07.602507+0000 mgr.y (mgr.14505) 130 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:20:09.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:07.752050+0000 osd.1 (osd.1) 67 : cluster [DBG] 5.12 scrub starts 2024-02-10T08:20:09.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:07.754893+0000 osd.1 (osd.1) 68 : cluster [DBG] 5.12 scrub ok 2024-02-10T08:20:09.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:06.904867+0000 osd.0 (osd.0) 63 : cluster [DBG] 6.10 scrub starts 2024-02-10T08:20:09.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:06.911801+0000 osd.0 (osd.0) 64 : cluster [DBG] 6.10 scrub ok 2024-02-10T08:20:09.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:07.296748+0000 osd.5 (osd.5) 57 : cluster [DBG] 2.2 scrub starts 2024-02-10T08:20:09.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:07.299637+0000 osd.5 (osd.5) 58 : cluster [DBG] 2.2 scrub ok 2024-02-10T08:20:09.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:07.348782+0000 osd.6 (osd.6) 43 : cluster [DBG] 5.2 scrub starts 2024-02-10T08:20:09.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:07.350249+0000 osd.6 (osd.6) 44 : cluster [DBG] 5.2 scrub ok 2024-02-10T08:20:09.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:07.350949+0000 osd.3 (osd.3) 67 : cluster [DBG] 5.17 scrub starts 2024-02-10T08:20:09.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:07.352738+0000 osd.3 (osd.3) 68 : cluster [DBG] 5.17 scrub ok 2024-02-10T08:20:09.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:20:07.602507+0000 mgr.y (mgr.14505) 130 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:20:09.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:07.752050+0000 osd.1 (osd.1) 67 : cluster [DBG] 5.12 scrub starts 2024-02-10T08:20:09.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:07.754893+0000 osd.1 (osd.1) 68 : cluster [DBG] 5.12 scrub ok 2024-02-10T08:20:09.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:06.904867+0000 osd.0 (osd.0) 63 : cluster [DBG] 6.10 scrub starts 2024-02-10T08:20:09.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:06.911801+0000 osd.0 (osd.0) 64 : cluster [DBG] 6.10 scrub ok 2024-02-10T08:20:09.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:07.296748+0000 osd.5 (osd.5) 57 : cluster [DBG] 2.2 scrub starts 2024-02-10T08:20:09.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:07.299637+0000 osd.5 (osd.5) 58 : cluster [DBG] 2.2 scrub ok 2024-02-10T08:20:09.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:07.348782+0000 osd.6 (osd.6) 43 : cluster [DBG] 5.2 scrub starts 2024-02-10T08:20:09.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:07.350249+0000 osd.6 (osd.6) 44 : cluster [DBG] 5.2 scrub ok 2024-02-10T08:20:09.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:07.350949+0000 osd.3 (osd.3) 67 : cluster [DBG] 5.17 scrub starts 2024-02-10T08:20:09.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:07.352738+0000 osd.3 (osd.3) 68 : cluster [DBG] 5.17 scrub ok 2024-02-10T08:20:09.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:20:07.602507+0000 mgr.y (mgr.14505) 130 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:20:09.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:07.752050+0000 osd.1 (osd.1) 67 : cluster [DBG] 5.12 scrub starts 2024-02-10T08:20:09.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:07.754893+0000 osd.1 (osd.1) 68 : cluster [DBG] 5.12 scrub ok 2024-02-10T08:20:09.204 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 19 15 38847 38832 127.673 95.0625 0.0104235 0.00782713 2024-02-10T08:20:10.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:08.313336+0000 osd.7 (osd.7) 63 : cluster [DBG] 6.5 scrub starts 2024-02-10T08:20:10.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:08.313336+0000 osd.5 (osd.5) 59 : cluster [DBG] 5.7 scrub starts 2024-02-10T08:20:10.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:08.316677+0000 osd.7 (osd.7) 64 : cluster [DBG] 6.5 scrub ok 2024-02-10T08:20:10.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:08.318564+0000 osd.5 (osd.5) 60 : cluster [DBG] 5.7 scrub ok 2024-02-10T08:20:10.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:08.357835+0000 osd.3 (osd.3) 69 : cluster [DBG] 4.17 scrub starts 2024-02-10T08:20:10.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:08.360873+0000 osd.3 (osd.3) 70 : cluster [DBG] 4.17 scrub ok 2024-02-10T08:20:10.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:08.501256+0000 mgr.y (mgr.14505) 131 : cluster [DBG] pgmap v122: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 2.2 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 1.1 KiB/s rd, 127 MiB/s wr, 2.04k op/s; 11378/109248 objects degraded (10.415%) 2024-02-10T08:20:10.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:08.741668+0000 osd.1 (osd.1) 69 : cluster [DBG] 2.4 scrub starts 2024-02-10T08:20:10.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:08.744561+0000 osd.1 (osd.1) 70 : cluster [DBG] 2.4 scrub ok 2024-02-10T08:20:10.040 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:08.313336+0000 osd.7 (osd.7) 63 : cluster [DBG] 6.5 scrub starts 2024-02-10T08:20:10.040 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:08.313336+0000 osd.5 (osd.5) 59 : cluster [DBG] 5.7 scrub starts 2024-02-10T08:20:10.040 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:08.316677+0000 osd.7 (osd.7) 64 : cluster [DBG] 6.5 scrub ok 2024-02-10T08:20:10.040 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:08.318564+0000 osd.5 (osd.5) 60 : cluster [DBG] 5.7 scrub ok 2024-02-10T08:20:10.041 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:08.357835+0000 osd.3 (osd.3) 69 : cluster [DBG] 4.17 scrub starts 2024-02-10T08:20:10.041 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:08.360873+0000 osd.3 (osd.3) 70 : cluster [DBG] 4.17 scrub ok 2024-02-10T08:20:10.041 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:08.501256+0000 mgr.y (mgr.14505) 131 : cluster [DBG] pgmap v122: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 2.2 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 1.1 KiB/s rd, 127 MiB/s wr, 2.04k op/s; 11378/109248 objects degraded (10.415%) 2024-02-10T08:20:10.041 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:08.741668+0000 osd.1 (osd.1) 69 : cluster [DBG] 2.4 scrub starts 2024-02-10T08:20:10.041 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:08.744561+0000 osd.1 (osd.1) 70 : cluster [DBG] 2.4 scrub ok 2024-02-10T08:20:10.041 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:08.313336+0000 osd.7 (osd.7) 63 : cluster [DBG] 6.5 scrub starts 2024-02-10T08:20:10.041 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:08.313336+0000 osd.5 (osd.5) 59 : cluster [DBG] 5.7 scrub starts 2024-02-10T08:20:10.041 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:08.316677+0000 osd.7 (osd.7) 64 : cluster [DBG] 6.5 scrub ok 2024-02-10T08:20:10.041 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:08.318564+0000 osd.5 (osd.5) 60 : cluster [DBG] 5.7 scrub ok 2024-02-10T08:20:10.041 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:08.357835+0000 osd.3 (osd.3) 69 : cluster [DBG] 4.17 scrub starts 2024-02-10T08:20:10.041 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:08.360873+0000 osd.3 (osd.3) 70 : cluster [DBG] 4.17 scrub ok 2024-02-10T08:20:10.041 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:08.501256+0000 mgr.y (mgr.14505) 131 : cluster [DBG] pgmap v122: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 2.2 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 1.1 KiB/s rd, 127 MiB/s wr, 2.04k op/s; 11378/109248 objects degraded (10.415%) 2024-02-10T08:20:10.042 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:08.741668+0000 osd.1 (osd.1) 69 : cluster [DBG] 2.4 scrub starts 2024-02-10T08:20:10.042 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:08.744561+0000 osd.1 (osd.1) 70 : cluster [DBG] 2.4 scrub ok 2024-02-10T08:20:10.072 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.1 dump_blocked_ops 2024-02-10T08:20:10.204 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:2024-02-10T08:20:10.204779+0000 min lat: 0.0013002 max lat: 0.107766 avg lat: 0.00790559 2024-02-10T08:20:10.204 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-02-10T08:20:10.204 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 20 16 40483 40467 126.399 102.188 0.0142398 0.00790559 2024-02-10T08:20:10.208 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:20:10.208 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-02-10T08:20:10.208 INFO:teuthology.orchestra.run.smithi018.stdout: "epoch": 96, 2024-02-10T08:20:10.208 INFO:teuthology.orchestra.run.smithi018.stdout: "fsid": "d46257c8-c7eb-11ee-95b8-87774f69a715", 2024-02-10T08:20:10.208 INFO:teuthology.orchestra.run.smithi018.stdout: "created": "2024-02-10T08:10:57.425061+0000", 2024-02-10T08:20:10.208 INFO:teuthology.orchestra.run.smithi018.stdout: "modified": "2024-02-10T08:19:59.648274+0000", 2024-02-10T08:20:10.208 INFO:teuthology.orchestra.run.smithi018.stdout: "last_up_change": "2024-02-10T08:19:30.792613+0000", 2024-02-10T08:20:10.208 INFO:teuthology.orchestra.run.smithi018.stdout: "last_in_change": "2024-02-10T08:16:27.586635+0000", 2024-02-10T08:20:10.208 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-02-10T08:20:10.208 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_num": 5804032, 2024-02-10T08:20:10.209 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_set": [ 2024-02-10T08:20:10.209 INFO:teuthology.orchestra.run.smithi018.stdout: "nodeep-scrub", 2024-02-10T08:20:10.209 INFO:teuthology.orchestra.run.smithi018.stdout: "pglog_hardlimit", 2024-02-10T08:20:10.209 INFO:teuthology.orchestra.run.smithi018.stdout: "purged_snapdirs", 2024-02-10T08:20:10.209 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_deletes", 2024-02-10T08:20:10.209 INFO:teuthology.orchestra.run.smithi018.stdout: "sortbitwise" 2024-02-10T08:20:10.209 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-02-10T08:20:10.209 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_version": 18, 2024-02-10T08:20:10.209 INFO:teuthology.orchestra.run.smithi018.stdout: "full_ratio": 0.94999998807907104, 2024-02-10T08:20:10.209 INFO:teuthology.orchestra.run.smithi018.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-02-10T08:20:10.209 INFO:teuthology.orchestra.run.smithi018.stdout: "nearfull_ratio": 0.85000002384185791, 2024-02-10T08:20:10.209 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_snapshot": "", 2024-02-10T08:20:10.209 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_max": 7, 2024-02-10T08:20:10.209 INFO:teuthology.orchestra.run.smithi018.stdout: "max_osd": 8, 2024-02-10T08:20:10.209 INFO:teuthology.orchestra.run.smithi018.stdout: "require_min_compat_client": "luminous", 2024-02-10T08:20:10.210 INFO:teuthology.orchestra.run.smithi018.stdout: "min_compat_client": "luminous", 2024-02-10T08:20:10.210 INFO:teuthology.orchestra.run.smithi018.stdout: "require_osd_release": "pacific", 2024-02-10T08:20:10.210 INFO:teuthology.orchestra.run.smithi018.stdout: "pools": [ 2024-02-10T08:20:10.210 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:10.210 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 1, 2024-02-10T08:20:10.210 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "device_health_metrics", 2024-02-10T08:20:10.210 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-02-10T08:14:44.034966+0000", 2024-02-10T08:20:10.210 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-02-10T08:20:10.210 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-02-10T08:20:10.210 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-02-10T08:20:10.210 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 3, 2024-02-10T08:20:10.210 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 2, 2024-02-10T08:20:10.210 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-02-10T08:20:10.210 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-02-10T08:20:10.210 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-02-10T08:20:10.211 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-02-10T08:20:10.211 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-10T08:20:10.211 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-02-10T08:20:10.211 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-02-10T08:20:10.211 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 1, 2024-02-10T08:20:10.211 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 1, 2024-02-10T08:20:10.211 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 1, 2024-02-10T08:20:10.211 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 1, 2024-02-10T08:20:10.211 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 1, 2024-02-10T08:20:10.211 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-02-10T08:20:10.211 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-02-10T08:20:10.211 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-02-10T08:20:10.211 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-02-10T08:20:10.211 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-02-10T08:20:10.211 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-02-10T08:20:10.212 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-02-10T08:20:10.212 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:10.212 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "66", 2024-02-10T08:20:10.212 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-02-10T08:20:10.212 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-10T08:20:10.212 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-02-10T08:20:10.212 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-02-10T08:20:10.212 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-02-10T08:20:10.212 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-02-10T08:20:10.212 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-02-10T08:20:10.212 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-02-10T08:20:10.213 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-02-10T08:20:10.213 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-02-10T08:20:10.213 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-02-10T08:20:10.213 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-02-10T08:20:10.213 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-02-10T08:20:10.213 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-02-10T08:20:10.213 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-02-10T08:20:10.213 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-02-10T08:20:10.213 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-02-10T08:20:10.213 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-02-10T08:20:10.213 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-10T08:20:10.213 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-10T08:20:10.213 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-10T08:20:10.213 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-02-10T08:20:10.213 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-02-10T08:20:10.214 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-02-10T08:20:10.214 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-02-10T08:20:10.214 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-02-10T08:20:10.214 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:10.214 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-02-10T08:20:10.214 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-02-10T08:20:10.214 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-02-10T08:20:10.214 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-02-10T08:20:10.214 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-02-10T08:20:10.214 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-02-10T08:20:10.214 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-02-10T08:20:10.214 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-02-10T08:20:10.214 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-02-10T08:20:10.214 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-02-10T08:20:10.214 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-02-10T08:20:10.214 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-02-10T08:20:10.215 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_max": 32, 2024-02-10T08:20:10.215 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 1 2024-02-10T08:20:10.215 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:10.215 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-02-10T08:20:10.215 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_devicehealth": {} 2024-02-10T08:20:10.215 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:10.215 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:10.215 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:10.215 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 2, 2024-02-10T08:20:10.215 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": ".rgw.root", 2024-02-10T08:20:10.215 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-02-10T08:16:51.334631+0000", 2024-02-10T08:20:10.215 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-02-10T08:20:10.215 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-02-10T08:20:10.216 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-02-10T08:20:10.216 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 3, 2024-02-10T08:20:10.216 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 2, 2024-02-10T08:20:10.216 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-02-10T08:20:10.216 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-02-10T08:20:10.216 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-02-10T08:20:10.216 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-02-10T08:20:10.216 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-10T08:20:10.216 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-02-10T08:20:10.216 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-02-10T08:20:10.216 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 32, 2024-02-10T08:20:10.216 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 32, 2024-02-10T08:20:10.216 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 32, 2024-02-10T08:20:10.216 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 32, 2024-02-10T08:20:10.217 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 32, 2024-02-10T08:20:10.217 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-02-10T08:20:10.217 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-02-10T08:20:10.217 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-02-10T08:20:10.217 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-02-10T08:20:10.217 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-02-10T08:20:10.217 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-02-10T08:20:10.217 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-02-10T08:20:10.217 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:10.217 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "56", 2024-02-10T08:20:10.217 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-02-10T08:20:10.217 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-10T08:20:10.217 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-02-10T08:20:10.217 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-02-10T08:20:10.218 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-02-10T08:20:10.218 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-02-10T08:20:10.218 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-02-10T08:20:10.218 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-02-10T08:20:10.218 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-02-10T08:20:10.218 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-02-10T08:20:10.218 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-02-10T08:20:10.218 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-02-10T08:20:10.218 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-02-10T08:20:10.218 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-02-10T08:20:10.218 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-02-10T08:20:10.218 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-02-10T08:20:10.218 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-02-10T08:20:10.218 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-02-10T08:20:10.218 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-10T08:20:10.219 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-10T08:20:10.219 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-10T08:20:10.219 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-02-10T08:20:10.219 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-02-10T08:20:10.219 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-02-10T08:20:10.219 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-02-10T08:20:10.219 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-02-10T08:20:10.219 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:10.219 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-02-10T08:20:10.219 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-02-10T08:20:10.219 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-02-10T08:20:10.219 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-02-10T08:20:10.219 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-02-10T08:20:10.219 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-02-10T08:20:10.219 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-02-10T08:20:10.220 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-02-10T08:20:10.220 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-02-10T08:20:10.220 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-02-10T08:20:10.220 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-02-10T08:20:10.220 INFO:teuthology.orchestra.run.smithi018.stdout: "options": {}, 2024-02-10T08:20:10.220 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-02-10T08:20:10.220 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw": {} 2024-02-10T08:20:10.220 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:10.220 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:10.220 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:10.220 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 3, 2024-02-10T08:20:10.220 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "iscsi", 2024-02-10T08:20:10.220 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-02-10T08:16:51.762963+0000", 2024-02-10T08:20:10.220 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-02-10T08:20:10.221 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-02-10T08:20:10.221 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-02-10T08:20:10.221 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 3, 2024-02-10T08:20:10.221 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 2, 2024-02-10T08:20:10.221 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-02-10T08:20:10.221 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-02-10T08:20:10.221 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-02-10T08:20:10.221 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-02-10T08:20:10.221 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-10T08:20:10.221 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-02-10T08:20:10.221 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-02-10T08:20:10.221 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 3, 2024-02-10T08:20:10.221 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 3, 2024-02-10T08:20:10.221 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 3, 2024-02-10T08:20:10.221 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 3, 2024-02-10T08:20:10.222 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 3, 2024-02-10T08:20:10.222 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-02-10T08:20:10.222 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-02-10T08:20:10.222 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-02-10T08:20:10.222 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-02-10T08:20:10.222 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-02-10T08:20:10.222 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-02-10T08:20:10.222 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-02-10T08:20:10.222 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:10.222 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "57", 2024-02-10T08:20:10.222 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-02-10T08:20:10.222 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-10T08:20:10.222 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-02-10T08:20:10.222 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-02-10T08:20:10.222 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-02-10T08:20:10.223 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-02-10T08:20:10.223 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-02-10T08:20:10.223 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-02-10T08:20:10.223 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-02-10T08:20:10.223 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-02-10T08:20:10.223 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-02-10T08:20:10.223 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-02-10T08:20:10.223 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-02-10T08:20:10.223 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-02-10T08:20:10.223 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-02-10T08:20:10.223 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-02-10T08:20:10.223 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-02-10T08:20:10.223 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-02-10T08:20:10.223 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-10T08:20:10.223 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-10T08:20:10.224 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-10T08:20:10.224 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-02-10T08:20:10.224 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-02-10T08:20:10.224 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-02-10T08:20:10.224 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-02-10T08:20:10.224 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-02-10T08:20:10.224 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:10.224 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-02-10T08:20:10.224 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-02-10T08:20:10.224 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-02-10T08:20:10.224 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-02-10T08:20:10.224 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-02-10T08:20:10.224 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-02-10T08:20:10.225 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-02-10T08:20:10.225 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-02-10T08:20:10.225 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-02-10T08:20:10.225 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-02-10T08:20:10.225 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-02-10T08:20:10.225 INFO:teuthology.orchestra.run.smithi018.stdout: "options": {}, 2024-02-10T08:20:10.225 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-02-10T08:20:10.225 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd": {} 2024-02-10T08:20:10.225 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:10.225 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:10.225 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:10.225 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 4, 2024-02-10T08:20:10.225 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "default.rgw.log", 2024-02-10T08:20:10.225 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-02-10T08:16:53.258098+0000", 2024-02-10T08:20:10.225 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-02-10T08:20:10.226 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-02-10T08:20:10.226 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-02-10T08:20:10.226 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 3, 2024-02-10T08:20:10.226 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 2, 2024-02-10T08:20:10.226 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-02-10T08:20:10.226 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-02-10T08:20:10.226 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-02-10T08:20:10.226 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-02-10T08:20:10.226 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-10T08:20:10.226 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-02-10T08:20:10.226 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-02-10T08:20:10.226 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 32, 2024-02-10T08:20:10.226 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 32, 2024-02-10T08:20:10.226 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 32, 2024-02-10T08:20:10.226 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 32, 2024-02-10T08:20:10.226 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 32, 2024-02-10T08:20:10.227 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-02-10T08:20:10.227 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-02-10T08:20:10.227 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-02-10T08:20:10.227 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-02-10T08:20:10.227 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-02-10T08:20:10.227 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-02-10T08:20:10.227 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-02-10T08:20:10.227 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:10.227 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "58", 2024-02-10T08:20:10.227 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-02-10T08:20:10.227 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-10T08:20:10.227 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-02-10T08:20:10.227 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-02-10T08:20:10.227 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-02-10T08:20:10.227 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-02-10T08:20:10.227 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-02-10T08:20:10.228 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-02-10T08:20:10.228 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-02-10T08:20:10.228 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-02-10T08:20:10.228 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-02-10T08:20:10.228 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-02-10T08:20:10.228 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-02-10T08:20:10.228 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-02-10T08:20:10.228 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-02-10T08:20:10.228 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-02-10T08:20:10.228 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-02-10T08:20:10.228 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-02-10T08:20:10.228 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-10T08:20:10.228 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-10T08:20:10.228 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-10T08:20:10.229 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-02-10T08:20:10.229 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-02-10T08:20:10.229 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-02-10T08:20:10.229 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-02-10T08:20:10.229 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-02-10T08:20:10.229 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:10.229 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-02-10T08:20:10.229 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-02-10T08:20:10.229 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-02-10T08:20:10.229 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-02-10T08:20:10.229 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-02-10T08:20:10.229 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-02-10T08:20:10.229 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-02-10T08:20:10.229 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-02-10T08:20:10.229 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-02-10T08:20:10.229 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-02-10T08:20:10.230 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-02-10T08:20:10.230 INFO:teuthology.orchestra.run.smithi018.stdout: "options": {}, 2024-02-10T08:20:10.230 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-02-10T08:20:10.230 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw": {} 2024-02-10T08:20:10.230 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:10.230 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:10.230 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:10.230 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 5, 2024-02-10T08:20:10.230 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "default.rgw.control", 2024-02-10T08:20:10.230 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-02-10T08:16:55.289300+0000", 2024-02-10T08:20:10.230 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-02-10T08:20:10.230 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-02-10T08:20:10.230 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-02-10T08:20:10.230 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 3, 2024-02-10T08:20:10.230 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 2, 2024-02-10T08:20:10.231 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-02-10T08:20:10.231 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-02-10T08:20:10.231 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-02-10T08:20:10.231 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-02-10T08:20:10.231 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-10T08:20:10.231 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-02-10T08:20:10.231 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-02-10T08:20:10.231 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 32, 2024-02-10T08:20:10.231 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 32, 2024-02-10T08:20:10.231 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 32, 2024-02-10T08:20:10.231 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 32, 2024-02-10T08:20:10.231 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 32, 2024-02-10T08:20:10.231 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-02-10T08:20:10.231 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-02-10T08:20:10.231 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-02-10T08:20:10.231 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-02-10T08:20:10.232 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-02-10T08:20:10.232 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-02-10T08:20:10.232 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-02-10T08:20:10.232 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:10.232 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "60", 2024-02-10T08:20:10.232 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-02-10T08:20:10.232 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-10T08:20:10.232 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-02-10T08:20:10.232 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-02-10T08:20:10.232 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-02-10T08:20:10.232 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-02-10T08:20:10.232 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-02-10T08:20:10.232 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-02-10T08:20:10.233 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-02-10T08:20:10.233 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-02-10T08:20:10.233 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-02-10T08:20:10.233 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-02-10T08:20:10.233 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-02-10T08:20:10.233 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-02-10T08:20:10.233 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-02-10T08:20:10.233 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-02-10T08:20:10.233 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-02-10T08:20:10.233 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-02-10T08:20:10.233 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-10T08:20:10.233 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-10T08:20:10.233 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-10T08:20:10.233 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-02-10T08:20:10.233 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-02-10T08:20:10.234 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-02-10T08:20:10.234 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-02-10T08:20:10.234 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-02-10T08:20:10.234 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:10.234 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-02-10T08:20:10.234 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-02-10T08:20:10.234 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-02-10T08:20:10.234 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-02-10T08:20:10.234 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-02-10T08:20:10.234 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-02-10T08:20:10.234 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-02-10T08:20:10.234 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-02-10T08:20:10.234 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-02-10T08:20:10.234 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-02-10T08:20:10.235 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-02-10T08:20:10.235 INFO:teuthology.orchestra.run.smithi018.stdout: "options": {}, 2024-02-10T08:20:10.235 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-02-10T08:20:10.235 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw": {} 2024-02-10T08:20:10.235 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:10.235 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:10.235 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:10.235 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 6, 2024-02-10T08:20:10.235 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "default.rgw.meta", 2024-02-10T08:20:10.235 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-02-10T08:16:57.354868+0000", 2024-02-10T08:20:10.235 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-02-10T08:20:10.235 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-02-10T08:20:10.235 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-02-10T08:20:10.235 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 3, 2024-02-10T08:20:10.236 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 2, 2024-02-10T08:20:10.236 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-02-10T08:20:10.236 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-02-10T08:20:10.236 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-02-10T08:20:10.236 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-02-10T08:20:10.236 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-10T08:20:10.236 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-02-10T08:20:10.236 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-02-10T08:20:10.236 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 32, 2024-02-10T08:20:10.236 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 32, 2024-02-10T08:20:10.236 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 32, 2024-02-10T08:20:10.236 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 32, 2024-02-10T08:20:10.236 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 32, 2024-02-10T08:20:10.236 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-02-10T08:20:10.237 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-02-10T08:20:10.237 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-02-10T08:20:10.237 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-02-10T08:20:10.237 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-02-10T08:20:10.237 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-02-10T08:20:10.237 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-02-10T08:20:10.237 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:10.237 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "62", 2024-02-10T08:20:10.237 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-02-10T08:20:10.237 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-10T08:20:10.237 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-02-10T08:20:10.237 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-02-10T08:20:10.237 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-02-10T08:20:10.237 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-02-10T08:20:10.237 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-02-10T08:20:10.238 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-02-10T08:20:10.238 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-02-10T08:20:10.238 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-02-10T08:20:10.238 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-02-10T08:20:10.238 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-02-10T08:20:10.238 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-02-10T08:20:10.238 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-02-10T08:20:10.238 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-02-10T08:20:10.238 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-02-10T08:20:10.238 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-02-10T08:20:10.238 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-02-10T08:20:10.238 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-10T08:20:10.238 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-10T08:20:10.238 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-10T08:20:10.239 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-02-10T08:20:10.239 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-02-10T08:20:10.239 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-02-10T08:20:10.239 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-02-10T08:20:10.239 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-02-10T08:20:10.239 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:10.239 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-02-10T08:20:10.239 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-02-10T08:20:10.239 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-02-10T08:20:10.239 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-02-10T08:20:10.239 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-02-10T08:20:10.239 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-02-10T08:20:10.239 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-02-10T08:20:10.239 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-02-10T08:20:10.239 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-02-10T08:20:10.240 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-02-10T08:20:10.240 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-02-10T08:20:10.240 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-02-10T08:20:10.240 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_bias": 4 2024-02-10T08:20:10.240 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:10.240 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-02-10T08:20:10.240 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw": {} 2024-02-10T08:20:10.240 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:10.240 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:10.240 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:10.240 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 7, 2024-02-10T08:20:10.240 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "unique_pool_0", 2024-02-10T08:20:10.240 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-02-10T08:19:38.373573+0000", 2024-02-10T08:20:10.240 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-02-10T08:20:10.240 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-02-10T08:20:10.241 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-02-10T08:20:10.241 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 3, 2024-02-10T08:20:10.241 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 2, 2024-02-10T08:20:10.241 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-02-10T08:20:10.241 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-02-10T08:20:10.241 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-02-10T08:20:10.241 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-02-10T08:20:10.241 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-10T08:20:10.241 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-02-10T08:20:10.241 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-02-10T08:20:10.241 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 16, 2024-02-10T08:20:10.241 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 16, 2024-02-10T08:20:10.241 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 16, 2024-02-10T08:20:10.241 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 16, 2024-02-10T08:20:10.241 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 16, 2024-02-10T08:20:10.242 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-02-10T08:20:10.242 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-02-10T08:20:10.242 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-02-10T08:20:10.242 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-02-10T08:20:10.242 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-02-10T08:20:10.242 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-02-10T08:20:10.242 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-02-10T08:20:10.242 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:10.242 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "95", 2024-02-10T08:20:10.242 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-02-10T08:20:10.242 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-10T08:20:10.242 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-02-10T08:20:10.242 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-02-10T08:20:10.242 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-02-10T08:20:10.243 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-02-10T08:20:10.243 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-02-10T08:20:10.243 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-02-10T08:20:10.243 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-02-10T08:20:10.243 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-02-10T08:20:10.243 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-02-10T08:20:10.243 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-02-10T08:20:10.243 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-02-10T08:20:10.243 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-02-10T08:20:10.243 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-02-10T08:20:10.243 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-02-10T08:20:10.243 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-02-10T08:20:10.243 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-02-10T08:20:10.243 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-10T08:20:10.243 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-10T08:20:10.244 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-10T08:20:10.244 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-02-10T08:20:10.244 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-02-10T08:20:10.244 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-02-10T08:20:10.244 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-02-10T08:20:10.244 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-02-10T08:20:10.244 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:10.244 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-02-10T08:20:10.244 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-02-10T08:20:10.244 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-02-10T08:20:10.244 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-02-10T08:20:10.244 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-02-10T08:20:10.244 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-02-10T08:20:10.244 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-02-10T08:20:10.245 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-02-10T08:20:10.245 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-02-10T08:20:10.245 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-02-10T08:20:10.245 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-02-10T08:20:10.245 INFO:teuthology.orchestra.run.smithi018.stdout: "options": {}, 2024-02-10T08:20:10.245 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-02-10T08:20:10.245 INFO:teuthology.orchestra.run.smithi018.stdout: "rados": {} 2024-02-10T08:20:10.245 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:10.245 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:10.245 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-02-10T08:20:10.245 INFO:teuthology.orchestra.run.smithi018.stdout: "osds": [ 2024-02-10T08:20:10.245 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:10.245 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-02-10T08:20:10.245 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "f9043fee-a3ed-4e16-921d-bb86756d0c48", 2024-02-10T08:20:10.245 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-02-10T08:20:10.246 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-02-10T08:20:10.246 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-02-10T08:20:10.246 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-02-10T08:20:10.246 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-02-10T08:20:10.246 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-02-10T08:20:10.246 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 8, 2024-02-10T08:20:10.246 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 91, 2024-02-10T08:20:10.246 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-02-10T08:20:10.246 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-02-10T08:20:10.246 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-02-10T08:20:10.246 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:20:10.246 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:10.246 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:20:10.246 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6801", 2024-02-10T08:20:10.246 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 276034406 2024-02-10T08:20:10.247 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:10.247 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:10.247 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:10.247 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-02-10T08:20:10.247 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:20:10.247 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:10.247 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:20:10.247 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6802", 2024-02-10T08:20:10.247 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 276034406 2024-02-10T08:20:10.247 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:10.247 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:10.247 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:10.247 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-02-10T08:20:10.247 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:20:10.247 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:10.247 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:20:10.248 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6804", 2024-02-10T08:20:10.248 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 276034406 2024-02-10T08:20:10.248 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:10.248 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:10.248 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:10.248 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-02-10T08:20:10.248 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:20:10.248 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:10.248 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:20:10.248 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6803", 2024-02-10T08:20:10.248 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 276034406 2024-02-10T08:20:10.248 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:10.248 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:10.248 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:10.249 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6801/276034406", 2024-02-10T08:20:10.249 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6802/276034406", 2024-02-10T08:20:10.249 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6804/276034406", 2024-02-10T08:20:10.249 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6803/276034406", 2024-02-10T08:20:10.249 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-02-10T08:20:10.249 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-02-10T08:20:10.249 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-02-10T08:20:10.249 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:10.249 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:10.249 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:10.249 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-02-10T08:20:10.249 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "ff958272-ce6b-4162-959a-6da9729e537b", 2024-02-10T08:20:10.249 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-02-10T08:20:10.249 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-02-10T08:20:10.249 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-02-10T08:20:10.250 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-02-10T08:20:10.250 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-02-10T08:20:10.250 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-02-10T08:20:10.250 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-02-10T08:20:10.250 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 91, 2024-02-10T08:20:10.250 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-02-10T08:20:10.250 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-02-10T08:20:10.250 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-02-10T08:20:10.250 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:20:10.250 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:10.250 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:20:10.250 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6805", 2024-02-10T08:20:10.250 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1941014296 2024-02-10T08:20:10.250 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:10.250 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:10.251 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:10.251 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-02-10T08:20:10.251 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:20:10.251 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:10.251 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:20:10.251 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6806", 2024-02-10T08:20:10.251 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1941014296 2024-02-10T08:20:10.251 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:10.251 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:10.251 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:10.251 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-02-10T08:20:10.251 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:20:10.251 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:10.251 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:20:10.252 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6808", 2024-02-10T08:20:10.252 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1941014296 2024-02-10T08:20:10.252 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:10.252 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:10.252 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:10.252 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-02-10T08:20:10.252 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:20:10.252 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:10.252 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:20:10.252 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6807", 2024-02-10T08:20:10.252 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1941014296 2024-02-10T08:20:10.252 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:10.252 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:10.252 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:10.252 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6805/1941014296", 2024-02-10T08:20:10.253 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6806/1941014296", 2024-02-10T08:20:10.253 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6808/1941014296", 2024-02-10T08:20:10.253 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6807/1941014296", 2024-02-10T08:20:10.253 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-02-10T08:20:10.253 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-02-10T08:20:10.253 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-02-10T08:20:10.253 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:10.253 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:10.253 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:10.253 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-02-10T08:20:10.253 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "29bb47e2-5c81-4ae8-bb9f-d1b02ea01d3f", 2024-02-10T08:20:10.253 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-02-10T08:20:10.253 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-02-10T08:20:10.253 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-02-10T08:20:10.254 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-02-10T08:20:10.254 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-02-10T08:20:10.254 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-02-10T08:20:10.254 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 18, 2024-02-10T08:20:10.254 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 91, 2024-02-10T08:20:10.254 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-02-10T08:20:10.254 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-02-10T08:20:10.254 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-02-10T08:20:10.254 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:20:10.254 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:10.254 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:20:10.255 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6809", 2024-02-10T08:20:10.255 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3122474567 2024-02-10T08:20:10.255 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:10.255 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:10.255 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:10.255 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-02-10T08:20:10.255 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:20:10.255 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:10.255 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:20:10.255 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6810", 2024-02-10T08:20:10.255 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3122474567 2024-02-10T08:20:10.255 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:10.256 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:10.256 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:10.256 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-02-10T08:20:10.256 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:20:10.256 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:10.256 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:20:10.256 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6812", 2024-02-10T08:20:10.256 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3122474567 2024-02-10T08:20:10.256 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:10.256 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:10.256 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:10.256 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-02-10T08:20:10.256 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:20:10.256 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:10.256 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:20:10.257 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6811", 2024-02-10T08:20:10.257 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3122474567 2024-02-10T08:20:10.257 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:10.257 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:10.257 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:10.257 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6809/3122474567", 2024-02-10T08:20:10.257 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6810/3122474567", 2024-02-10T08:20:10.257 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6812/3122474567", 2024-02-10T08:20:10.257 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6811/3122474567", 2024-02-10T08:20:10.257 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-02-10T08:20:10.257 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-02-10T08:20:10.257 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-02-10T08:20:10.257 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:10.257 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:10.257 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:10.257 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-02-10T08:20:10.258 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "87ad37de-5f49-4e5b-9683-3bb9c3e33907", 2024-02-10T08:20:10.258 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-02-10T08:20:10.258 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-02-10T08:20:10.258 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-02-10T08:20:10.258 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-02-10T08:20:10.258 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-02-10T08:20:10.258 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-02-10T08:20:10.258 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 25, 2024-02-10T08:20:10.258 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 91, 2024-02-10T08:20:10.258 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-02-10T08:20:10.258 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-02-10T08:20:10.258 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-02-10T08:20:10.258 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:20:10.258 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:10.258 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:20:10.258 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6813", 2024-02-10T08:20:10.259 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3484706437 2024-02-10T08:20:10.259 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:10.259 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:10.259 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:10.259 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-02-10T08:20:10.259 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:20:10.259 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:10.259 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:20:10.259 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6814", 2024-02-10T08:20:10.259 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3484706437 2024-02-10T08:20:10.259 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:10.259 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:10.259 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:10.259 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-02-10T08:20:10.259 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:20:10.260 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:10.260 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:20:10.260 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6816", 2024-02-10T08:20:10.260 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3484706437 2024-02-10T08:20:10.260 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:10.260 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:10.260 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:10.260 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-02-10T08:20:10.260 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:20:10.260 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:10.260 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:20:10.260 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6815", 2024-02-10T08:20:10.260 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3484706437 2024-02-10T08:20:10.260 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:10.261 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:10.261 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:10.261 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6813/3484706437", 2024-02-10T08:20:10.261 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6814/3484706437", 2024-02-10T08:20:10.261 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6816/3484706437", 2024-02-10T08:20:10.261 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6815/3484706437", 2024-02-10T08:20:10.261 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-02-10T08:20:10.261 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-02-10T08:20:10.261 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-02-10T08:20:10.261 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:10.261 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:10.261 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:10.261 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-02-10T08:20:10.261 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "f5708f20-f98d-4d12-b8ae-71a5049a14cc", 2024-02-10T08:20:10.261 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 0, 2024-02-10T08:20:10.262 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-02-10T08:20:10.262 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-02-10T08:20:10.262 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-02-10T08:20:10.262 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-02-10T08:20:10.262 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-02-10T08:20:10.262 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 30, 2024-02-10T08:20:10.262 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 81, 2024-02-10T08:20:10.262 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 88, 2024-02-10T08:20:10.262 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-02-10T08:20:10.262 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-02-10T08:20:10.262 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:20:10.262 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:10.262 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:20:10.262 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6800", 2024-02-10T08:20:10.263 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1598114798 2024-02-10T08:20:10.263 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:10.263 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:10.263 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:10.263 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-02-10T08:20:10.263 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:20:10.263 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:10.263 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:20:10.263 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6801", 2024-02-10T08:20:10.263 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1598114798 2024-02-10T08:20:10.263 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:10.263 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:10.263 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:10.263 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-02-10T08:20:10.263 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:20:10.263 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:10.263 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:20:10.264 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6803", 2024-02-10T08:20:10.264 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1598114798 2024-02-10T08:20:10.264 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:10.264 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:10.264 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:10.264 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-02-10T08:20:10.264 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:20:10.264 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:10.264 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:20:10.264 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6802", 2024-02-10T08:20:10.264 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1598114798 2024-02-10T08:20:10.265 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:10.265 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:10.265 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:10.265 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.71:6800/1598114798", 2024-02-10T08:20:10.265 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.71:6801/1598114798", 2024-02-10T08:20:10.265 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.71:6803/1598114798", 2024-02-10T08:20:10.265 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.71:6802/1598114798", 2024-02-10T08:20:10.265 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-02-10T08:20:10.265 INFO:teuthology.orchestra.run.smithi018.stdout: "exists" 2024-02-10T08:20:10.265 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:10.265 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:10.265 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:10.265 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-02-10T08:20:10.265 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "e36a71dd-5088-4bff-965e-7dc8708ef7e3", 2024-02-10T08:20:10.266 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-02-10T08:20:10.266 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-02-10T08:20:10.266 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-02-10T08:20:10.266 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-02-10T08:20:10.266 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-02-10T08:20:10.266 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-02-10T08:20:10.266 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 37, 2024-02-10T08:20:10.266 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 91, 2024-02-10T08:20:10.266 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-02-10T08:20:10.266 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-02-10T08:20:10.266 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-02-10T08:20:10.266 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:20:10.266 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:10.266 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:20:10.266 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6804", 2024-02-10T08:20:10.267 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1932648316 2024-02-10T08:20:10.267 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:10.267 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:10.267 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:10.267 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-02-10T08:20:10.267 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:20:10.267 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:10.267 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:20:10.267 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6805", 2024-02-10T08:20:10.267 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1932648316 2024-02-10T08:20:10.267 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:10.267 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:10.267 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:10.267 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-02-10T08:20:10.267 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:20:10.268 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:10.268 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:20:10.268 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6807", 2024-02-10T08:20:10.268 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1932648316 2024-02-10T08:20:10.268 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:10.268 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:10.268 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:10.268 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-02-10T08:20:10.268 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:20:10.268 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:10.268 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:20:10.268 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6806", 2024-02-10T08:20:10.268 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1932648316 2024-02-10T08:20:10.268 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:10.269 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:10.269 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:10.269 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.71:6804/1932648316", 2024-02-10T08:20:10.269 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.71:6805/1932648316", 2024-02-10T08:20:10.269 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.71:6807/1932648316", 2024-02-10T08:20:10.269 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.71:6806/1932648316", 2024-02-10T08:20:10.269 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-02-10T08:20:10.269 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-02-10T08:20:10.269 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-02-10T08:20:10.269 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:10.269 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:10.269 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:10.269 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-02-10T08:20:10.269 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "210a8790-78b6-4efa-a969-17efb17e9c0b", 2024-02-10T08:20:10.270 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-02-10T08:20:10.270 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-02-10T08:20:10.270 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-02-10T08:20:10.270 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-02-10T08:20:10.270 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-02-10T08:20:10.270 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-02-10T08:20:10.270 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 43, 2024-02-10T08:20:10.270 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 91, 2024-02-10T08:20:10.270 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-02-10T08:20:10.270 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-02-10T08:20:10.270 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-02-10T08:20:10.270 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:20:10.270 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:10.270 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:20:10.271 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6808", 2024-02-10T08:20:10.271 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3724399458 2024-02-10T08:20:10.271 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:10.271 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:10.271 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:10.271 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-02-10T08:20:10.271 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:20:10.271 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:10.271 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:20:10.271 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6809", 2024-02-10T08:20:10.271 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3724399458 2024-02-10T08:20:10.271 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:10.271 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:10.271 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:10.271 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-02-10T08:20:10.271 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:20:10.272 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:10.272 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:20:10.272 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6811", 2024-02-10T08:20:10.272 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3724399458 2024-02-10T08:20:10.272 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:10.272 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:10.272 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:10.272 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-02-10T08:20:10.272 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:20:10.272 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:10.272 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:20:10.272 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6810", 2024-02-10T08:20:10.272 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3724399458 2024-02-10T08:20:10.273 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:10.273 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:10.273 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:10.273 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.71:6808/3724399458", 2024-02-10T08:20:10.273 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.71:6809/3724399458", 2024-02-10T08:20:10.273 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.71:6811/3724399458", 2024-02-10T08:20:10.273 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.71:6810/3724399458", 2024-02-10T08:20:10.273 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-02-10T08:20:10.273 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-02-10T08:20:10.273 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-02-10T08:20:10.273 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:10.273 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:10.273 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:10.273 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-02-10T08:20:10.273 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "9778a0e9-2ff3-4700-bf2a-675edaba630b", 2024-02-10T08:20:10.274 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-02-10T08:20:10.274 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-02-10T08:20:10.274 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-02-10T08:20:10.274 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-02-10T08:20:10.274 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-02-10T08:20:10.274 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-02-10T08:20:10.274 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 50, 2024-02-10T08:20:10.274 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 91, 2024-02-10T08:20:10.274 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-02-10T08:20:10.274 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-02-10T08:20:10.274 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-02-10T08:20:10.274 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:20:10.274 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:10.274 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:20:10.274 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6812", 2024-02-10T08:20:10.275 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 163573852 2024-02-10T08:20:10.275 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:10.275 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:10.275 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:10.275 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-02-10T08:20:10.275 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:20:10.275 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:10.275 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:20:10.275 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6813", 2024-02-10T08:20:10.275 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 163573852 2024-02-10T08:20:10.275 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:10.275 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:10.275 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:10.275 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-02-10T08:20:10.276 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:20:10.276 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:10.276 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:20:10.276 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6815", 2024-02-10T08:20:10.276 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 163573852 2024-02-10T08:20:10.276 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:10.276 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:10.276 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:10.276 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-02-10T08:20:10.276 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:20:10.276 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:10.276 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:20:10.276 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6814", 2024-02-10T08:20:10.277 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 163573852 2024-02-10T08:20:10.277 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:10.277 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:10.277 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:10.277 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.71:6812/163573852", 2024-02-10T08:20:10.277 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.71:6813/163573852", 2024-02-10T08:20:10.277 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.71:6815/163573852", 2024-02-10T08:20:10.277 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.71:6814/163573852", 2024-02-10T08:20:10.277 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-02-10T08:20:10.277 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-02-10T08:20:10.277 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-02-10T08:20:10.277 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:10.277 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:10.277 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-02-10T08:20:10.278 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_xinfo": [ 2024-02-10T08:20:10.278 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:10.278 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-02-10T08:20:10.278 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-02-10T08:20:10.278 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-02-10T08:20:10.278 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-02-10T08:20:10.278 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540138314316775423, 2024-02-10T08:20:10.278 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-02-10T08:20:10.278 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-02-10T08:19:30.734295+0000", 2024-02-10T08:20:10.278 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-02-10T08:20:10.278 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:10.278 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:10.278 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-02-10T08:20:10.278 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-02-10T08:20:10.278 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-02-10T08:20:10.279 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-02-10T08:20:10.279 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540138314316775423, 2024-02-10T08:20:10.279 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-02-10T08:20:10.279 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-02-10T08:19:31.715379+0000", 2024-02-10T08:20:10.279 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-02-10T08:20:10.279 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:10.279 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:10.279 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-02-10T08:20:10.279 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-02-10T08:20:10.279 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-02-10T08:20:10.279 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-02-10T08:20:10.279 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540138314316775423, 2024-02-10T08:20:10.279 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-02-10T08:20:10.279 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-02-10T08:19:19.681229+0000", 2024-02-10T08:20:10.280 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-02-10T08:20:10.280 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:10.280 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:10.280 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-02-10T08:20:10.280 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-02-10T08:20:10.280 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-02-10T08:20:10.280 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-02-10T08:20:10.280 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540138314316775423, 2024-02-10T08:20:10.280 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-02-10T08:20:10.280 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-02-10T08:18:51.707488+0000", 2024-02-10T08:20:10.280 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-02-10T08:20:10.280 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:10.280 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:10.280 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-02-10T08:20:10.281 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-02-10T08:20:10.281 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-02-10T08:20:10.281 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-02-10T08:20:10.281 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540138314316775423, 2024-02-10T08:20:10.281 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-02-10T08:20:10.281 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-02-10T08:18:14.771231+0000", 2024-02-10T08:20:10.281 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 87 2024-02-10T08:20:10.281 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:10.281 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:10.281 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-02-10T08:20:10.281 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-02-10T08:20:10.281 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-02-10T08:20:10.281 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-02-10T08:20:10.281 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540138314316775423, 2024-02-10T08:20:10.281 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-02-10T08:20:10.281 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-02-10T08:19:16.551930+0000", 2024-02-10T08:20:10.282 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-02-10T08:20:10.282 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:10.282 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:10.282 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-02-10T08:20:10.282 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-02-10T08:20:10.282 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-02-10T08:20:10.282 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-02-10T08:20:10.282 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540138314316775423, 2024-02-10T08:20:10.282 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-02-10T08:20:10.282 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-02-10T08:18:52.609915+0000", 2024-02-10T08:20:10.282 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-02-10T08:20:10.282 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:10.282 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:10.282 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-02-10T08:20:10.282 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-02-10T08:20:10.283 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-02-10T08:20:10.283 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-02-10T08:20:10.283 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540138314316775423, 2024-02-10T08:20:10.283 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-02-10T08:20:10.283 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-02-10T08:19:09.231231+0000", 2024-02-10T08:20:10.283 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-02-10T08:20:10.283 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:10.283 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-02-10T08:20:10.283 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap": [], 2024-02-10T08:20:10.283 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_items": [ 2024-02-10T08:20:10.283 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:10.283 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "2.5", 2024-02-10T08:20:10.283 INFO:teuthology.orchestra.run.smithi018.stdout: "mappings": [ 2024-02-10T08:20:10.283 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:10.283 INFO:teuthology.orchestra.run.smithi018.stdout: "from": 7, 2024-02-10T08:20:10.283 INFO:teuthology.orchestra.run.smithi018.stdout: "to": 2 2024-02-10T08:20:10.284 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:10.284 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:10.284 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:10.284 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:10.284 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "4.d", 2024-02-10T08:20:10.284 INFO:teuthology.orchestra.run.smithi018.stdout: "mappings": [ 2024-02-10T08:20:10.284 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:10.284 INFO:teuthology.orchestra.run.smithi018.stdout: "from": 1, 2024-02-10T08:20:10.284 INFO:teuthology.orchestra.run.smithi018.stdout: "to": 5 2024-02-10T08:20:10.284 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:10.284 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:10.284 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:10.284 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:10.284 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "4.f", 2024-02-10T08:20:10.285 INFO:teuthology.orchestra.run.smithi018.stdout: "mappings": [ 2024-02-10T08:20:10.285 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:10.285 INFO:teuthology.orchestra.run.smithi018.stdout: "from": 1, 2024-02-10T08:20:10.285 INFO:teuthology.orchestra.run.smithi018.stdout: "to": 2 2024-02-10T08:20:10.285 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:10.285 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:10.285 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:10.285 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:10.285 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "4.13", 2024-02-10T08:20:10.285 INFO:teuthology.orchestra.run.smithi018.stdout: "mappings": [ 2024-02-10T08:20:10.285 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:10.285 INFO:teuthology.orchestra.run.smithi018.stdout: "from": 1, 2024-02-10T08:20:10.285 INFO:teuthology.orchestra.run.smithi018.stdout: "to": 2 2024-02-10T08:20:10.285 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:10.285 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:10.286 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:10.286 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-02-10T08:20:10.286 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_temp": [], 2024-02-10T08:20:10.286 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_temp": [], 2024-02-10T08:20:10.286 INFO:teuthology.orchestra.run.smithi018.stdout: "blocklist": { 2024-02-10T08:20:10.286 INFO:teuthology.orchestra.run.smithi018.stdout: "172.21.15.18:6800/542054629": "2024-02-11T08:17:16.433947+0000", 2024-02-10T08:20:10.286 INFO:teuthology.orchestra.run.smithi018.stdout: "172.21.15.18:0/491217791": "2024-02-11T08:17:16.433947+0000", 2024-02-10T08:20:10.286 INFO:teuthology.orchestra.run.smithi018.stdout: "172.21.15.18:0/781076548": "2024-02-11T08:17:16.433947+0000", 2024-02-10T08:20:10.286 INFO:teuthology.orchestra.run.smithi018.stdout: "172.21.15.18:0/957318754": "2024-02-11T08:17:16.433947+0000", 2024-02-10T08:20:10.286 INFO:teuthology.orchestra.run.smithi018.stdout: "172.21.15.18:0/2662732452": "2024-02-11T08:11:55.105124+0000", 2024-02-10T08:20:10.286 INFO:teuthology.orchestra.run.smithi018.stdout: "172.21.15.18:0/1407788916": "2024-02-11T08:11:55.105124+0000", 2024-02-10T08:20:10.286 INFO:teuthology.orchestra.run.smithi018.stdout: "172.21.15.18:6800/3798687064": "2024-02-11T08:11:55.105124+0000", 2024-02-10T08:20:10.286 INFO:teuthology.orchestra.run.smithi018.stdout: "172.21.15.18:6800/3570839557": "2024-02-11T08:11:31.445897+0000", 2024-02-10T08:20:10.286 INFO:teuthology.orchestra.run.smithi018.stdout: "172.21.15.18:0/541168116": "2024-02-11T08:11:31.445897+0000", 2024-02-10T08:20:10.286 INFO:teuthology.orchestra.run.smithi018.stdout: "172.21.15.18:0/806236095": "2024-02-11T08:11:31.445897+0000" 2024-02-10T08:20:10.286 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:10.287 INFO:teuthology.orchestra.run.smithi018.stdout: "range_blocklist": {}, 2024-02-10T08:20:10.287 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profiles": { 2024-02-10T08:20:10.287 INFO:teuthology.orchestra.run.smithi018.stdout: "default": { 2024-02-10T08:20:10.287 INFO:teuthology.orchestra.run.smithi018.stdout: "crush-failure-domain": "osd", 2024-02-10T08:20:10.287 INFO:teuthology.orchestra.run.smithi018.stdout: "k": "2", 2024-02-10T08:20:10.287 INFO:teuthology.orchestra.run.smithi018.stdout: "m": "1", 2024-02-10T08:20:10.287 INFO:teuthology.orchestra.run.smithi018.stdout: "plugin": "jerasure", 2024-02-10T08:20:10.287 INFO:teuthology.orchestra.run.smithi018.stdout: "ruleset-failure-domain": "osd", 2024-02-10T08:20:10.287 INFO:teuthology.orchestra.run.smithi018.stdout: "technique": "reed_sol_van" 2024-02-10T08:20:10.287 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:10.287 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:10.287 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps_queue": [], 2024-02-10T08:20:10.287 INFO:teuthology.orchestra.run.smithi018.stdout: "new_removed_snaps": [], 2024-02-10T08:20:10.287 INFO:teuthology.orchestra.run.smithi018.stdout: "new_purged_snaps": [], 2024-02-10T08:20:10.287 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_node_flags": {}, 2024-02-10T08:20:10.288 INFO:teuthology.orchestra.run.smithi018.stdout: "device_class_flags": {}, 2024-02-10T08:20:10.288 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode": { 2024-02-10T08:20:10.288 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_enabled": false, 2024-02-10T08:20:10.288 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_bucket_count": 0, 2024-02-10T08:20:10.288 INFO:teuthology.orchestra.run.smithi018.stdout: "degraded_stretch_mode": 0, 2024-02-10T08:20:10.288 INFO:teuthology.orchestra.run.smithi018.stdout: "recovering_stretch_mode": 0, 2024-02-10T08:20:10.288 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_bucket": 0 2024-02-10T08:20:10.288 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:10.288 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-02-10T08:20:10.479 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:20:10.483 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:10.483 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:20:10.584 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:20:10.634 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:10.672 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:20:10.675 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:10.675 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:20:10.777 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:20:10.876 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:08.838211+0000 osd.0 (osd.0) 65 : cluster [DBG] 5.3 scrub starts 2024-02-10T08:20:10.876 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:08.839869+0000 osd.0 (osd.0) 66 : cluster [DBG] 5.3 scrub ok 2024-02-10T08:20:10.876 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:09.277896+0000 osd.5 (osd.5) 61 : cluster [DBG] 6.19 scrub starts 2024-02-10T08:20:10.876 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:09.280819+0000 osd.5 (osd.5) 62 : cluster [DBG] 6.19 scrub ok 2024-02-10T08:20:10.876 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:09.767163+0000 osd.3 (osd.3) 71 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:20:10.876 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:09.767214+0000 osd.3 (osd.3) 72 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:20:10.877 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:09.776154+0000 osd.1 (osd.1) 71 : cluster [DBG] 6.4 scrub starts 2024-02-10T08:20:10.877 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:09.785088+0000 osd.1 (osd.1) 72 : cluster [DBG] 6.4 scrub ok 2024-02-10T08:20:10.877 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:10.342380+0000 mon.a (mon.0) 811 : cluster [WRN] Health check update: Degraded data redundancy: 11378/109248 objects degraded (10.415%), 24 pgs degraded (PG_DEGRADED) 2024-02-10T08:20:10.877 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:08.838211+0000 osd.0 (osd.0) 65 : cluster [DBG] 5.3 scrub starts 2024-02-10T08:20:10.877 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:08.839869+0000 osd.0 (osd.0) 66 : cluster [DBG] 5.3 scrub ok 2024-02-10T08:20:10.877 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:09.277896+0000 osd.5 (osd.5) 61 : cluster [DBG] 6.19 scrub starts 2024-02-10T08:20:10.877 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:09.280819+0000 osd.5 (osd.5) 62 : cluster [DBG] 6.19 scrub ok 2024-02-10T08:20:10.877 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:09.767163+0000 osd.3 (osd.3) 71 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:20:10.877 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:09.767214+0000 osd.3 (osd.3) 72 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:20:10.877 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:09.776154+0000 osd.1 (osd.1) 71 : cluster [DBG] 6.4 scrub starts 2024-02-10T08:20:10.877 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:09.785088+0000 osd.1 (osd.1) 72 : cluster [DBG] 6.4 scrub ok 2024-02-10T08:20:10.877 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:10.342380+0000 mon.a (mon.0) 811 : cluster [WRN] Health check update: Degraded data redundancy: 11378/109248 objects degraded (10.415%), 24 pgs degraded (PG_DEGRADED) 2024-02-10T08:20:10.885 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:11.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:08.838211+0000 osd.0 (osd.0) 65 : cluster [DBG] 5.3 scrub starts 2024-02-10T08:20:11.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:08.839869+0000 osd.0 (osd.0) 66 : cluster [DBG] 5.3 scrub ok 2024-02-10T08:20:11.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:09.277896+0000 osd.5 (osd.5) 61 : cluster [DBG] 6.19 scrub starts 2024-02-10T08:20:11.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:09.280819+0000 osd.5 (osd.5) 62 : cluster [DBG] 6.19 scrub ok 2024-02-10T08:20:11.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:09.767163+0000 osd.3 (osd.3) 71 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:20:11.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:09.767214+0000 osd.3 (osd.3) 72 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:20:11.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:09.776154+0000 osd.1 (osd.1) 71 : cluster [DBG] 6.4 scrub starts 2024-02-10T08:20:11.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:09.785088+0000 osd.1 (osd.1) 72 : cluster [DBG] 6.4 scrub ok 2024-02-10T08:20:11.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:10.342380+0000 mon.a (mon.0) 811 : cluster [WRN] Health check update: Degraded data redundancy: 11378/109248 objects degraded (10.415%), 24 pgs degraded (PG_DEGRADED) 2024-02-10T08:20:11.204 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 21 16 41834 41818 124.4 84.4375 0.00674583 0.00803188 2024-02-10T08:20:11.236 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:20:11.241 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:11.242 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:20:11.343 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:20:11.380 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:11.403 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:20:11.406 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:11.406 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:20:11.507 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:20:11.540 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:11.561 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:20:11.564 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:11.565 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:20:11.665 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:20:11.698 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:11.727 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:20:11.729 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:11.730 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:20:11.830 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:20:11.894 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:10.273987+0000 osd.5 (osd.5) 63 : cluster [DBG] 5.16 scrub starts 2024-02-10T08:20:11.894 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:10.278674+0000 osd.5 (osd.5) 64 : cluster [DBG] 5.16 scrub ok 2024-02-10T08:20:11.894 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:10.346758+0000 osd.3 (osd.3) 73 : cluster [DBG] 5.14 scrub starts 2024-02-10T08:20:11.894 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:10.351911+0000 osd.3 (osd.3) 74 : cluster [DBG] 5.14 scrub ok 2024-02-10T08:20:11.894 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:10.502982+0000 mgr.y (mgr.14505) 132 : cluster [DBG] pgmap v123: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 2.2 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 1023 B/s rd, 112 MiB/s wr, 1.80k op/s; 11378/109248 objects degraded (10.415%) 2024-02-10T08:20:11.894 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:10.738322+0000 mon.a (mon.0) 812 : cluster [DBG] osdmap e98: 8 total, 7 up, 8 in 2024-02-10T08:20:11.895 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:10.273987+0000 osd.5 (osd.5) 63 : cluster [DBG] 5.16 scrub starts 2024-02-10T08:20:11.895 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:10.278674+0000 osd.5 (osd.5) 64 : cluster [DBG] 5.16 scrub ok 2024-02-10T08:20:11.895 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:10.346758+0000 osd.3 (osd.3) 73 : cluster [DBG] 5.14 scrub starts 2024-02-10T08:20:11.895 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:10.351911+0000 osd.3 (osd.3) 74 : cluster [DBG] 5.14 scrub ok 2024-02-10T08:20:11.895 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:10.502982+0000 mgr.y (mgr.14505) 132 : cluster [DBG] pgmap v123: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 2.2 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 1023 B/s rd, 112 MiB/s wr, 1.80k op/s; 11378/109248 objects degraded (10.415%) 2024-02-10T08:20:11.895 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:10.738322+0000 mon.a (mon.0) 812 : cluster [DBG] osdmap e98: 8 total, 7 up, 8 in 2024-02-10T08:20:11.897 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:12.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:10.273987+0000 osd.5 (osd.5) 63 : cluster [DBG] 5.16 scrub starts 2024-02-10T08:20:12.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:10.278674+0000 osd.5 (osd.5) 64 : cluster [DBG] 5.16 scrub ok 2024-02-10T08:20:12.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:10.346758+0000 osd.3 (osd.3) 73 : cluster [DBG] 5.14 scrub starts 2024-02-10T08:20:12.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:10.351911+0000 osd.3 (osd.3) 74 : cluster [DBG] 5.14 scrub ok 2024-02-10T08:20:12.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:10.502982+0000 mgr.y (mgr.14505) 132 : cluster [DBG] pgmap v123: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 2.2 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 1023 B/s rd, 112 MiB/s wr, 1.80k op/s; 11378/109248 objects degraded (10.415%) 2024-02-10T08:20:12.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:10.738322+0000 mon.a (mon.0) 812 : cluster [DBG] osdmap e98: 8 total, 7 up, 8 in 2024-02-10T08:20:12.161 INFO:tasks.thrashosds.thrasher:j is {'epoch': 96, 'fsid': 'd46257c8-c7eb-11ee-95b8-87774f69a715', 'created': '2024-02-10T08:10:57.425061+0000', 'modified': '2024-02-10T08:19:59.648274+0000', 'last_up_change': '2024-02-10T08:19:30.792613+0000', 'last_in_change': '2024-02-10T08:16:27.586635+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 18, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 7, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'pacific', 'pools': [{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-02-10T08:14:44.034966+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': '.rgw.root', 'create_time': '2024-02-10T08:16:51.334631+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 3, 'pool_name': 'iscsi', 'create_time': '2024-02-10T08:16:51.762963+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 3, 'pg_placement_num': 3, 'pg_placement_num_target': 3, 'pg_num_target': 3, 'pg_num_pending': 3, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '57', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 4, 'pool_name': 'default.rgw.log', 'create_time': '2024-02-10T08:16:53.258098+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '58', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 5, 'pool_name': 'default.rgw.control', 'create_time': '2024-02-10T08:16:55.289300+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 6, 'pool_name': 'default.rgw.meta', 'create_time': '2024-02-10T08:16:57.354868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4}, 'application_metadata': {'rgw': {}}}, {'pool': 7, 'pool_name': 'unique_pool_0', 'create_time': '2024-02-10T08:19:38.373573+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '95', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}], 'osds': [{'osd': 0, 'uuid': 'f9043fee-a3ed-4e16-921d-bb86756d0c48', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 91, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6801', 'nonce': 276034406}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6802', 'nonce': 276034406}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6804', 'nonce': 276034406}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6803', 'nonce': 276034406}]}, 'public_addr': '172.21.15.18:6801/276034406', 'cluster_addr': '172.21.15.18:6802/276034406', 'heartbeat_back_addr': '172.21.15.18:6804/276034406', 'heartbeat_front_addr': '172.21.15.18:6803/276034406', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'ff958272-ce6b-4162-959a-6da9729e537b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 91, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6805', 'nonce': 1941014296}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6806', 'nonce': 1941014296}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6808', 'nonce': 1941014296}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6807', 'nonce': 1941014296}]}, 'public_addr': '172.21.15.18:6805/1941014296', 'cluster_addr': '172.21.15.18:6806/1941014296', 'heartbeat_back_addr': '172.21.15.18:6808/1941014296', 'heartbeat_front_addr': '172.21.15.18:6807/1941014296', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '29bb47e2-5c81-4ae8-bb9f-d1b02ea01d3f', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 18, 'up_thru': 91, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6809', 'nonce': 3122474567}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6810', 'nonce': 3122474567}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6812', 'nonce': 3122474567}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6811', 'nonce': 3122474567}]}, 'public_addr': '172.21.15.18:6809/3122474567', 'cluster_addr': '172.21.15.18:6810/3122474567', 'heartbeat_back_addr': '172.21.15.18:6812/3122474567', 'heartbeat_front_addr': '172.21.15.18:6811/3122474567', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '87ad37de-5f49-4e5b-9683-3bb9c3e33907', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 25, 'up_thru': 91, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6813', 'nonce': 3484706437}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6814', 'nonce': 3484706437}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6816', 'nonce': 3484706437}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6815', 'nonce': 3484706437}]}, 'public_addr': '172.21.15.18:6813/3484706437', 'cluster_addr': '172.21.15.18:6814/3484706437', 'heartbeat_back_addr': '172.21.15.18:6816/3484706437', 'heartbeat_front_addr': '172.21.15.18:6815/3484706437', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': 'f5708f20-f98d-4d12-b8ae-71a5049a14cc', 'up': 0, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 30, 'up_thru': 81, 'down_at': 88, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6800', 'nonce': 1598114798}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6801', 'nonce': 1598114798}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6803', 'nonce': 1598114798}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6802', 'nonce': 1598114798}]}, 'public_addr': '172.21.15.71:6800/1598114798', 'cluster_addr': '172.21.15.71:6801/1598114798', 'heartbeat_back_addr': '172.21.15.71:6803/1598114798', 'heartbeat_front_addr': '172.21.15.71:6802/1598114798', 'state': ['exists']}, {'osd': 5, 'uuid': 'e36a71dd-5088-4bff-965e-7dc8708ef7e3', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 37, 'up_thru': 91, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6804', 'nonce': 1932648316}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6805', 'nonce': 1932648316}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6807', 'nonce': 1932648316}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6806', 'nonce': 1932648316}]}, 'public_addr': '172.21.15.71:6804/1932648316', 'cluster_addr': '172.21.15.71:6805/1932648316', 'heartbeat_back_addr': '172.21.15.71:6807/1932648316', 'heartbeat_front_addr': '172.21.15.71:6806/1932648316', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '210a8790-78b6-4efa-a969-17efb17e9c0b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 43, 'up_thru': 91, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6808', 'nonce': 3724399458}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6809', 'nonce': 3724399458}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6811', 'nonce': 3724399458}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6810', 'nonce': 3724399458}]}, 'public_addr': '172.21.15.71:6808/3724399458', 'cluster_addr': '172.21.15.71:6809/3724399458', 'heartbeat_back_addr': '172.21.15.71:6811/3724399458', 'heartbeat_front_addr': '172.21.15.71:6810/3724399458', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '9778a0e9-2ff3-4700-bf2a-675edaba630b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 50, 'up_thru': 91, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6812', 'nonce': 163573852}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6813', 'nonce': 163573852}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6815', 'nonce': 163573852}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6814', 'nonce': 163573852}]}, 'public_addr': '172.21.15.71:6812/163573852', 'cluster_addr': '172.21.15.71:6813/163573852', 'heartbeat_back_addr': '172.21.15.71:6815/163573852', 'heartbeat_front_addr': '172.21.15.71:6814/163573852', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-10T08:19:30.734295+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-10T08:19:31.715379+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-10T08:19:19.681229+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-10T08:18:51.707488+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-10T08:18:14.771231+0000', 'dead_epoch': 87}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-10T08:19:16.551930+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-10T08:18:52.609915+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-10T08:19:09.231231+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [{'pgid': '2.5', 'mappings': [{'from': 7, 'to': 2}]}, {'pgid': '4.d', 'mappings': [{'from': 1, 'to': 5}]}, {'pgid': '4.f', 'mappings': [{'from': 1, 'to': 2}]}, {'pgid': '4.13', 'mappings': [{'from': 1, 'to': 2}]}], 'pg_temp': [], 'primary_temp': [], 'blocklist': {'172.21.15.18:6800/542054629': '2024-02-11T08:17:16.433947+0000', '172.21.15.18:0/491217791': '2024-02-11T08:17:16.433947+0000', '172.21.15.18:0/781076548': '2024-02-11T08:17:16.433947+0000', '172.21.15.18:0/957318754': '2024-02-11T08:17:16.433947+0000', '172.21.15.18:0/2662732452': '2024-02-11T08:11:55.105124+0000', '172.21.15.18:0/1407788916': '2024-02-11T08:11:55.105124+0000', '172.21.15.18:6800/3798687064': '2024-02-11T08:11:55.105124+0000', '172.21.15.18:6800/3570839557': '2024-02-11T08:11:31.445897+0000', '172.21.15.18:0/541168116': '2024-02-11T08:11:31.445897+0000', '172.21.15.18:0/806236095': '2024-02-11T08:11:31.445897+0000'}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'ruleset-failure-domain': 'osd', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-02-10T08:20:12.162 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph pg dump --format=json 2024-02-10T08:20:12.205 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 22 16 43180 43164 122.564 84.125 0.0111955 0.00815359 2024-02-10T08:20:12.269 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:20:12.272 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:12.273 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:20:12.373 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:20:12.402 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:12.424 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:20:12.426 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:12.426 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:20:12.501 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:20:12.526 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:20:12.527 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:20:12.568 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:20:12.600 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:12.602 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:20:12.655 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:20:12.677 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd unset nodeep-scrub 2024-02-10T08:20:12.691 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:20:12.732 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:20:12.766 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:20:12.767 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-10T08:20:12.767 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-10T08:20:12.767 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-10T08:20:12.767 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-10T08:20:12.767 INFO:teuthology.orchestra.run.smithi018.stderr:Error ENXIO: problem getting command descriptions from osd.4 2024-02-10T08:20:12.767 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-10T08:20:12.767 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-10T08:20:12.767 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-10T08:20:12.906 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:11.228398+0000 osd.7 (osd.7) 65 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:20:12.907 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:11.228445+0000 osd.7 (osd.7) 66 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:20:12.907 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:11.312423+0000 osd.5 (osd.5) 65 : cluster [DBG] 4.15 scrub starts 2024-02-10T08:20:12.907 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:11.315896+0000 osd.5 (osd.5) 66 : cluster [DBG] 4.15 scrub ok 2024-02-10T08:20:12.907 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:11.743994+0000 mon.a (mon.0) 813 : cluster [DBG] osdmap e99: 8 total, 7 up, 8 in 2024-02-10T08:20:12.907 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:20:12.468642+0000 mon.a (mon.0) 814 : audit [DBG] from='client.? 172.21.15.18:0/1380105165' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:20:12.907 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:11.228398+0000 osd.7 (osd.7) 65 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:20:12.907 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:11.228445+0000 osd.7 (osd.7) 66 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:20:12.908 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:11.312423+0000 osd.5 (osd.5) 65 : cluster [DBG] 4.15 scrub starts 2024-02-10T08:20:12.908 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:11.315896+0000 osd.5 (osd.5) 66 : cluster [DBG] 4.15 scrub ok 2024-02-10T08:20:12.908 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:11.743994+0000 mon.a (mon.0) 813 : cluster [DBG] osdmap e99: 8 total, 7 up, 8 in 2024-02-10T08:20:12.908 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:20:12.468642+0000 mon.a (mon.0) 814 : audit [DBG] from='client.? 172.21.15.18:0/1380105165' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:20:13.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:11.228398+0000 osd.7 (osd.7) 65 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:20:13.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:11.228445+0000 osd.7 (osd.7) 66 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:20:13.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:11.312423+0000 osd.5 (osd.5) 65 : cluster [DBG] 4.15 scrub starts 2024-02-10T08:20:13.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:11.315896+0000 osd.5 (osd.5) 66 : cluster [DBG] 4.15 scrub ok 2024-02-10T08:20:13.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:11.743994+0000 mon.a (mon.0) 813 : cluster [DBG] osdmap e99: 8 total, 7 up, 8 in 2024-02-10T08:20:13.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:20:12.468642+0000 mon.a (mon.0) 814 : audit [DBG] from='client.? 172.21.15.18:0/1380105165' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:20:13.206 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 23 16 44339 44323 120.385 72.4375 0.00404969 0.00830116 2024-02-10T08:20:13.773 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:20:13.780 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:13.781 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:20:13.796 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-02-10T08:20:13.796 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-02-10T08:20:13.882 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:20:13.934 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:14.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:12.373649+0000 osd.7 (osd.7) 67 : cluster [DBG] 2.0 scrub starts 2024-02-10T08:20:14.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:12.387477+0000 osd.7 (osd.7) 68 : cluster [DBG] 2.0 scrub ok 2024-02-10T08:20:14.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:12.505565+0000 mgr.y (mgr.14505) 133 : cluster [DBG] pgmap v126: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 2.7 GiB data, 9.4 GiB used, 706 GiB / 715 GiB avail; 1.7 KiB/s rd, 162 MiB/s wr, 2.59k op/s; 13654/131040 objects degraded (10.420%) 2024-02-10T08:20:14.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:20:12.801854+0000 mon.a (mon.0) 815 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:20:14.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:20:13.416502+0000 mon.a (mon.0) 816 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:20:14.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:20:13.424504+0000 mon.a (mon.0) 817 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:20:14.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:20:13.433557+0000 mon.a (mon.0) 818 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:20:14.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:12.373649+0000 osd.7 (osd.7) 67 : cluster [DBG] 2.0 scrub starts 2024-02-10T08:20:14.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:12.387477+0000 osd.7 (osd.7) 68 : cluster [DBG] 2.0 scrub ok 2024-02-10T08:20:14.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:12.505565+0000 mgr.y (mgr.14505) 133 : cluster [DBG] pgmap v126: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 2.7 GiB data, 9.4 GiB used, 706 GiB / 715 GiB avail; 1.7 KiB/s rd, 162 MiB/s wr, 2.59k op/s; 13654/131040 objects degraded (10.420%) 2024-02-10T08:20:14.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:20:12.801854+0000 mon.a (mon.0) 815 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:20:14.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:20:13.416502+0000 mon.a (mon.0) 816 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:20:14.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:20:13.424504+0000 mon.a (mon.0) 817 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:20:14.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:20:13.433557+0000 mon.a (mon.0) 818 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:20:14.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:12.373649+0000 osd.7 (osd.7) 67 : cluster [DBG] 2.0 scrub starts 2024-02-10T08:20:14.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:12.387477+0000 osd.7 (osd.7) 68 : cluster [DBG] 2.0 scrub ok 2024-02-10T08:20:14.158 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:12.505565+0000 mgr.y (mgr.14505) 133 : cluster [DBG] pgmap v126: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 2.7 GiB data, 9.4 GiB used, 706 GiB / 715 GiB avail; 1.7 KiB/s rd, 162 MiB/s wr, 2.59k op/s; 13654/131040 objects degraded (10.420%) 2024-02-10T08:20:14.158 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:20:12.801854+0000 mon.a (mon.0) 815 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:20:14.158 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:20:13.416502+0000 mon.a (mon.0) 816 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:20:14.158 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:20:13.424504+0000 mon.a (mon.0) 817 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:20:14.158 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:20:13.433557+0000 mon.a (mon.0) 818 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:20:14.207 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 24 16 45788 45772 119.135 90.5625 0.0162538 0.00838942 2024-02-10T08:20:14.699 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:20:14.704 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:14.704 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:20:14.805 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:20:14.852 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:14.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:13.717773+0000 osd.1 (osd.1) 73 : cluster [DBG] 4.7 scrub starts 2024-02-10T08:20:14.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:13.727555+0000 osd.1 (osd.1) 74 : cluster [DBG] 4.7 scrub ok 2024-02-10T08:20:14.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:14.233505+0000 osd.3 (osd.3) 75 : cluster [DBG] 2.19 scrub starts 2024-02-10T08:20:14.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:14.238984+0000 osd.3 (osd.3) 76 : cluster [DBG] 2.19 scrub ok 2024-02-10T08:20:14.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:13.717773+0000 osd.1 (osd.1) 73 : cluster [DBG] 4.7 scrub starts 2024-02-10T08:20:14.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:13.727555+0000 osd.1 (osd.1) 74 : cluster [DBG] 4.7 scrub ok 2024-02-10T08:20:14.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:14.233505+0000 osd.3 (osd.3) 75 : cluster [DBG] 2.19 scrub starts 2024-02-10T08:20:14.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:14.238984+0000 osd.3 (osd.3) 76 : cluster [DBG] 2.19 scrub ok 2024-02-10T08:20:14.995 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:20:15.000 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:15.001 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:20:15.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:13.717773+0000 osd.1 (osd.1) 73 : cluster [DBG] 4.7 scrub starts 2024-02-10T08:20:15.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:13.727555+0000 osd.1 (osd.1) 74 : cluster [DBG] 4.7 scrub ok 2024-02-10T08:20:15.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:14.233505+0000 osd.3 (osd.3) 75 : cluster [DBG] 2.19 scrub starts 2024-02-10T08:20:15.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:14.238984+0000 osd.3 (osd.3) 76 : cluster [DBG] 2.19 scrub ok 2024-02-10T08:20:15.101 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:20:15.165 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:15.206 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:20:15.209 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:15.210 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:20:15.210 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 25 16 47160 47144 117.796 85.75 0.0085197 0.00848451 2024-02-10T08:20:15.311 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:20:15.359 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:20:15.359 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:20:15.361 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:15.419 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-02-10T08:20:15.419 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:20:15.649 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:20:15.658 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:15.659 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:20:15.759 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:20:15.789 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:15.797 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-10T08:20:15.810 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:20:15.812 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:15.813 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:20:15.913 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:20:15.977 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:14.509332+0000 mgr.y (mgr.14505) 134 : cluster [DBG] pgmap v127: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 2.7 GiB data, 9.4 GiB used, 706 GiB / 715 GiB avail; 1.3 KiB/s rd, 124 MiB/s wr, 1.99k op/s; 13654/131040 objects degraded (10.420%) 2024-02-10T08:20:15.978 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:15.195513+0000 osd.3 (osd.3) 77 : cluster [DBG] 6.13 scrub starts 2024-02-10T08:20:15.978 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:15.204471+0000 osd.3 (osd.3) 78 : cluster [DBG] 6.13 scrub ok 2024-02-10T08:20:15.978 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:15.350960+0000 mon.a (mon.0) 819 : cluster [WRN] Health check update: Degraded data redundancy: 13654/131040 objects degraded (10.420%), 24 pgs degraded (PG_DEGRADED) 2024-02-10T08:20:15.978 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:14.509332+0000 mgr.y (mgr.14505) 134 : cluster [DBG] pgmap v127: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 2.7 GiB data, 9.4 GiB used, 706 GiB / 715 GiB avail; 1.3 KiB/s rd, 124 MiB/s wr, 1.99k op/s; 13654/131040 objects degraded (10.420%) 2024-02-10T08:20:15.978 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:15.195513+0000 osd.3 (osd.3) 77 : cluster [DBG] 6.13 scrub starts 2024-02-10T08:20:15.978 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:15.204471+0000 osd.3 (osd.3) 78 : cluster [DBG] 6.13 scrub ok 2024-02-10T08:20:15.978 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:15.350960+0000 mon.a (mon.0) 819 : cluster [WRN] Health check update: Degraded data redundancy: 13654/131040 objects degraded (10.420%), 24 pgs degraded (PG_DEGRADED) 2024-02-10T08:20:15.979 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:16.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:14.509332+0000 mgr.y (mgr.14505) 134 : cluster [DBG] pgmap v127: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 2.7 GiB data, 9.4 GiB used, 706 GiB / 715 GiB avail; 1.3 KiB/s rd, 124 MiB/s wr, 1.99k op/s; 13654/131040 objects degraded (10.420%) 2024-02-10T08:20:16.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:15.195513+0000 osd.3 (osd.3) 77 : cluster [DBG] 6.13 scrub starts 2024-02-10T08:20:16.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:15.204471+0000 osd.3 (osd.3) 78 : cluster [DBG] 6.13 scrub ok 2024-02-10T08:20:16.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:15.350960+0000 mon.a (mon.0) 819 : cluster [WRN] Health check update: Degraded data redundancy: 13654/131040 objects degraded (10.420%), 24 pgs degraded (PG_DEGRADED) 2024-02-10T08:20:16.182 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:20:16.188 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:16.189 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:20:16.212 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 26 16 48393 48377 116.215 77.0625 0.0195255 0.00859812 2024-02-10T08:20:16.290 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:20:16.356 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:16.482 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:20:16.488 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:16.488 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:20:16.589 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:20:16.650 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:16.789 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:20:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:20:16] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:20:17.214 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 27 16 49741 49725 115.028 84.25 0.00963837 0.00868818 2024-02-10T08:20:17.228 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:20:17.235 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:17.235 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:20:17.336 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:20:17.394 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:17.425 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.1 dump_historic_ops 2024-02-10T08:20:17.427 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:20:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:20:17] "GET /metrics HTTP/1.1" 200 175351 "" "Prometheus/2.33.4" 2024-02-10T08:20:17.791 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:16.509857+0000 mgr.y (mgr.14505) 135 : cluster [DBG] pgmap v128: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 2.7 GiB data, 9.4 GiB used, 706 GiB / 715 GiB avail; 639 B/s rd, 57 MiB/s wr, 907 op/s; 13654/131040 objects degraded (10.420%) 2024-02-10T08:20:17.792 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:16.663846+0000 osd.1 (osd.1) 75 : cluster [DBG] 4.4 scrub starts 2024-02-10T08:20:17.792 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:16.678139+0000 osd.1 (osd.1) 76 : cluster [DBG] 4.4 scrub ok 2024-02-10T08:20:17.967 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:20:17.971 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:17.972 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:20:18.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:16.509857+0000 mgr.y (mgr.14505) 135 : cluster [DBG] pgmap v128: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 2.7 GiB data, 9.4 GiB used, 706 GiB / 715 GiB avail; 639 B/s rd, 57 MiB/s wr, 907 op/s; 13654/131040 objects degraded (10.420%) 2024-02-10T08:20:18.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:16.663846+0000 osd.1 (osd.1) 75 : cluster [DBG] 4.4 scrub starts 2024-02-10T08:20:18.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:16.678139+0000 osd.1 (osd.1) 76 : cluster [DBG] 4.4 scrub ok 2024-02-10T08:20:18.040 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:20:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:20:18.073 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:20:18.101 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:18.124 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:20:18.127 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:18.127 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:20:18.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:16.509857+0000 mgr.y (mgr.14505) 135 : cluster [DBG] pgmap v128: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 2.7 GiB data, 9.4 GiB used, 706 GiB / 715 GiB avail; 639 B/s rd, 57 MiB/s wr, 907 op/s; 13654/131040 objects degraded (10.420%) 2024-02-10T08:20:18.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:16.663846+0000 osd.1 (osd.1) 75 : cluster [DBG] 4.4 scrub starts 2024-02-10T08:20:18.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:16.678139+0000 osd.1 (osd.1) 76 : cluster [DBG] 4.4 scrub ok 2024-02-10T08:20:18.215 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 28 16 51018 51002 113.766 79.8125 0.0116711 0.00878534 2024-02-10T08:20:18.228 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:20:18.257 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:18.278 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:20:18.280 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:18.281 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:20:18.381 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:20:18.449 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:19.038 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:20:19.050 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-02-10T08:20:19.080 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:20:17.615155+0000 mgr.y (mgr.14505) 136 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:20:19.081 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:18.124581+0000 osd.3 (osd.3) 79 : cluster [DBG] 6.b scrub starts 2024-02-10T08:20:19.081 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:18.128468+0000 osd.3 (osd.3) 80 : cluster [DBG] 6.b scrub ok 2024-02-10T08:20:19.081 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:20:17.615155+0000 mgr.y (mgr.14505) 136 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:20:19.081 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:18.124581+0000 osd.3 (osd.3) 79 : cluster [DBG] 6.b scrub starts 2024-02-10T08:20:19.081 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:18.128468+0000 osd.3 (osd.3) 80 : cluster [DBG] 6.b scrub ok 2024-02-10T08:20:19.214 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 29 16 52244 52228 112.485 76.625 0.00896285 0.00888513 2024-02-10T08:20:19.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:20:17.615155+0000 mgr.y (mgr.14505) 136 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:20:19.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:18.124581+0000 osd.3 (osd.3) 79 : cluster [DBG] 6.b scrub starts 2024-02-10T08:20:19.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:18.128468+0000 osd.3 (osd.3) 80 : cluster [DBG] 6.b scrub ok 2024-02-10T08:20:19.689 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:20:19.714 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:20:19.719 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:19.720 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:20:19.821 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:20:19.886 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:20.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:18.510754+0000 mgr.y (mgr.14505) 137 : cluster [DBG] pgmap v129: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 3.1 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 1.2 KiB/s rd, 108 MiB/s wr, 1.73k op/s; 15705/150741 objects degraded (10.419%) 2024-02-10T08:20:20.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:18.933221+0000 osd.0 (osd.0) 67 : cluster [DBG] 6.0 scrub starts 2024-02-10T08:20:20.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:18.940935+0000 osd.0 (osd.0) 68 : cluster [DBG] 6.0 scrub ok 2024-02-10T08:20:20.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:18.510754+0000 mgr.y (mgr.14505) 137 : cluster [DBG] pgmap v129: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 3.1 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 1.2 KiB/s rd, 108 MiB/s wr, 1.73k op/s; 15705/150741 objects degraded (10.419%) 2024-02-10T08:20:20.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:18.933221+0000 osd.0 (osd.0) 67 : cluster [DBG] 6.0 scrub starts 2024-02-10T08:20:20.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:18.940935+0000 osd.0 (osd.0) 68 : cluster [DBG] 6.0 scrub ok 2024-02-10T08:20:20.218 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 30 16 53569 53553 111.493 82.8125 0.0149323 0.00896447 2024-02-10T08:20:20.252 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":129,"stamp":"2024-02-10T08:20:18.510185+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3280410276,"num_objects":50247,"num_object_clones":0,"num_object_copies":150741,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":15705,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50247,"num_whiteouts":0,"num_read":899,"num_read_kb":651,"num_write":50483,"num_write_kb":3203561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":50549,"ondisk_log_size":50549,"up":387,"acting":387,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":439,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":10947876,"kb_used_data":8521060,"kb_used_omap":0,"kb_used_meta":2426752,"kb_avail":739013340,"statfs":{"total":767960285184,"available":756749660160,"internally_reserved":0,"allocated":8725565440,"data_stored":8722466223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2484994048},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":906428416,"num_objects":13831,"num_object_clones":0,"num_object_copies":41493,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":4327,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13831,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":13831,"num_write_kb":885184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.007590"},"pg_stats":[{"pgid":"6.1b","version":"0'0","reported_seq":52,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-02-10T08:20:10.749598+0000","last_change":"2024-02-10T08:19:01.075963+0000","last_active":"2024-02-10T08:20:10.749598+0000","last_peered":"2024-02-10T08:20:10.749598+0000","last_clean":"2024-02-10T08:20:10.749598+0000","last_became_active":"2024-02-10T08:16:58.892091+0000","last_became_peered":"2024-02-10T08:16:58.892091+0000","last_unstale":"2024-02-10T08:20:10.749598+0000","last_undegraded":"2024-02-10T08:20:10.749598+0000","last_fullsized":"2024-02-10T08:20:10.749598+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:01.075886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:19:01.075886+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":19,"reported_epoch":98,"state":"active+undersized","last_fresh":"2024-02-10T08:20:10.748103+0000","last_change":"2024-02-10T08:19:31.811309+0000","last_active":"2024-02-10T08:20:10.748103+0000","last_peered":"2024-02-10T08:20:10.748103+0000","last_clean":"2024-02-10T08:16:55.840727+0000","last_became_active":"2024-02-10T08:19:31.811309+0000","last_became_peered":"2024-02-10T08:19:31.811309+0000","last_unstale":"2024-02-10T08:20:10.748103+0000","last_undegraded":"2024-02-10T08:20:10.748103+0000","last_fullsized":"2024-02-10T08:19:31.803853+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:09.941898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:09.941898+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":["6","1"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":63,"reported_epoch":98,"state":"active+undersized","last_fresh":"2024-02-10T08:20:10.748046+0000","last_change":"2024-02-10T08:19:31.813409+0000","last_active":"2024-02-10T08:20:10.748046+0000","last_peered":"2024-02-10T08:20:10.748046+0000","last_clean":"2024-02-10T08:19:20.316341+0000","last_became_active":"2024-02-10T08:19:31.813409+0000","last_became_peered":"2024-02-10T08:19:31.813409+0000","last_unstale":"2024-02-10T08:20:10.748046+0000","last_undegraded":"2024-02-10T08:20:10.748046+0000","last_fullsized":"2024-02-10T08:19:31.809709+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:43.744900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:43.744900+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":["0","7"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"62'15","reported_seq":86,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-02-10T08:20:10.759721+0000","last_change":"2024-02-10T08:20:03.330608+0000","last_active":"2024-02-10T08:20:10.759721+0000","last_peered":"2024-02-10T08:20:10.759721+0000","last_clean":"2024-02-10T08:20:10.759721+0000","last_became_active":"2024-02-10T08:16:54.849232+0000","last_became_peered":"2024-02-10T08:16:54.849232+0000","last_unstale":"2024-02-10T08:20:10.759721+0000","last_undegraded":"2024-02-10T08:20:10.759721+0000","last_fullsized":"2024-02-10T08:20:10.759721+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'15","last_scrub_stamp":"2024-02-10T08:20:03.330508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:20:03.330508+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":19,"reported_epoch":98,"state":"active+undersized","last_fresh":"2024-02-10T08:20:10.772308+0000","last_change":"2024-02-10T08:19:31.808951+0000","last_active":"2024-02-10T08:20:10.772308+0000","last_peered":"2024-02-10T08:20:10.772308+0000","last_clean":"2024-02-10T08:16:57.845780+0000","last_became_active":"2024-02-10T08:19:31.808951+0000","last_became_peered":"2024-02-10T08:19:31.808951+0000","last_unstale":"2024-02-10T08:20:10.772308+0000","last_undegraded":"2024-02-10T08:20:10.772308+0000","last_fullsized":"2024-02-10T08:19:31.800881+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:19.058317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:19.058317+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":["5","1"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":59,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-02-10T08:20:10.760613+0000","last_change":"2024-02-10T08:20:06.810606+0000","last_active":"2024-02-10T08:20:10.760613+0000","last_peered":"2024-02-10T08:20:10.760613+0000","last_clean":"2024-02-10T08:20:10.760613+0000","last_became_active":"2024-02-10T08:16:56.863353+0000","last_became_peered":"2024-02-10T08:16:56.863353+0000","last_unstale":"2024-02-10T08:20:10.760613+0000","last_undegraded":"2024-02-10T08:20:10.760613+0000","last_fullsized":"2024-02-10T08:20:10.760613+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:06.810521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:20:06.810521+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":63,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-02-10T08:20:10.753268+0000","last_change":"2024-02-10T08:19:28.176418+0000","last_active":"2024-02-10T08:20:10.753268+0000","last_peered":"2024-02-10T08:20:10.753268+0000","last_clean":"2024-02-10T08:20:10.753268+0000","last_became_active":"2024-02-10T08:16:52.787183+0000","last_became_peered":"2024-02-10T08:16:52.787183+0000","last_unstale":"2024-02-10T08:20:10.753268+0000","last_undegraded":"2024-02-10T08:20:10.753268+0000","last_fullsized":"2024-02-10T08:20:10.753268+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:28.176344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:19:28.176344+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"62'9","reported_seq":47,"reported_epoch":98,"state":"active+undersized+degraded","last_fresh":"2024-02-10T08:20:10.747932+0000","last_change":"2024-02-10T08:19:31.811313+0000","last_active":"2024-02-10T08:20:10.747932+0000","last_peered":"2024-02-10T08:20:10.747932+0000","last_clean":"2024-02-10T08:17:00.017920+0000","last_became_active":"2024-02-10T08:19:31.811313+0000","last_became_peered":"2024-02-10T08:19:31.811313+0000","last_unstale":"2024-02-10T08:20:10.747932+0000","last_undegraded":"2024-02-10T08:19:31.803513+0000","last_fullsized":"2024-02-10T08:19:31.803399+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'9","last_scrub_stamp":"2024-02-10T08:18:12.998167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:12.998167+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":4,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":["6","1"],"object_location_counts":[{"shards":"1,6","objects":4}],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":56,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-02-10T08:20:10.772178+0000","last_change":"2024-02-10T08:20:09.280914+0000","last_active":"2024-02-10T08:20:10.772178+0000","last_peered":"2024-02-10T08:20:10.772178+0000","last_clean":"2024-02-10T08:20:10.772178+0000","last_became_active":"2024-02-10T08:16:58.867430+0000","last_became_peered":"2024-02-10T08:16:58.867430+0000","last_unstale":"2024-02-10T08:20:10.772178+0000","last_undegraded":"2024-02-10T08:20:10.772178+0000","last_fullsized":"2024-02-10T08:20:10.772178+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:09.280825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:20:09.280825+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":64,"reported_epoch":98,"state":"active+undersized","last_fresh":"2024-02-10T08:20:10.737757+0000","last_change":"2024-02-10T08:19:31.815659+0000","last_active":"2024-02-10T08:20:10.737757+0000","last_peered":"2024-02-10T08:20:10.737757+0000","last_clean":"2024-02-10T08:19:19.814876+0000","last_became_active":"2024-02-10T08:19:31.815659+0000","last_became_peered":"2024-02-10T08:19:31.815659+0000","last_unstale":"2024-02-10T08:20:10.737757+0000","last_undegraded":"2024-02-10T08:20:10.737757+0000","last_fullsized":"2024-02-10T08:19:31.803467+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:19.291495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:19:19.291495+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":["7","1"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"55'1","reported_seq":64,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-02-10T08:20:10.738211+0000","last_change":"2024-02-10T08:18:33.095861+0000","last_active":"2024-02-10T08:20:10.738211+0000","last_peered":"2024-02-10T08:20:10.738211+0000","last_clean":"2024-02-10T08:20:10.738211+0000","last_became_active":"2024-02-10T08:16:52.790462+0000","last_became_peered":"2024-02-10T08:16:52.790462+0000","last_unstale":"2024-02-10T08:20:10.738211+0000","last_undegraded":"2024-02-10T08:20:10.738211+0000","last_fullsized":"2024-02-10T08:20:10.738211+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'1","last_scrub_stamp":"2024-02-10T08:18:33.095757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:33.095757+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"62'5","reported_seq":41,"reported_epoch":98,"state":"active+undersized+degraded","last_fresh":"2024-02-10T08:20:10.749768+0000","last_change":"2024-02-10T08:19:31.806113+0000","last_active":"2024-02-10T08:20:10.749768+0000","last_peered":"2024-02-10T08:20:10.749768+0000","last_clean":"2024-02-10T08:17:00.109001+0000","last_became_active":"2024-02-10T08:19:31.806113+0000","last_became_peered":"2024-02-10T08:19:31.806113+0000","last_unstale":"2024-02-10T08:20:10.749768+0000","last_undegraded":"2024-02-10T08:19:31.800364+0000","last_fullsized":"2024-02-10T08:19:31.800270+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'5","last_scrub_stamp":"2024-02-10T08:19:29.251633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:19:29.251633+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":6,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[{"shards":"1,3","objects":2}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":56,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-02-10T08:20:10.746544+0000","last_change":"2024-02-10T08:20:00.830960+0000","last_active":"2024-02-10T08:20:10.746544+0000","last_peered":"2024-02-10T08:20:10.746544+0000","last_clean":"2024-02-10T08:20:10.746544+0000","last_became_active":"2024-02-10T08:16:58.860591+0000","last_became_peered":"2024-02-10T08:16:58.860591+0000","last_unstale":"2024-02-10T08:20:10.746544+0000","last_undegraded":"2024-02-10T08:20:10.746544+0000","last_fullsized":"2024-02-10T08:20:10.746544+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:00.830869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:20:00.830869+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":58,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-02-10T08:20:10.772392+0000","last_change":"2024-02-10T08:19:27.289317+0000","last_active":"2024-02-10T08:20:10.772392+0000","last_peered":"2024-02-10T08:20:10.772392+0000","last_clean":"2024-02-10T08:20:10.772392+0000","last_became_active":"2024-02-10T08:16:56.864532+0000","last_became_peered":"2024-02-10T08:16:56.864532+0000","last_unstale":"2024-02-10T08:20:10.772392+0000","last_undegraded":"2024-02-10T08:20:10.772392+0000","last_fullsized":"2024-02-10T08:20:10.772392+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:27.289240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:19:27.289240+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":62,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-02-10T08:20:10.738018+0000","last_change":"2024-02-10T08:20:02.245653+0000","last_active":"2024-02-10T08:20:10.738018+0000","last_peered":"2024-02-10T08:20:10.738018+0000","last_clean":"2024-02-10T08:20:10.738018+0000","last_became_active":"2024-02-10T08:16:52.787865+0000","last_became_peered":"2024-02-10T08:16:52.787865+0000","last_unstale":"2024-02-10T08:20:10.738018+0000","last_undegraded":"2024-02-10T08:20:10.738018+0000","last_fullsized":"2024-02-10T08:20:10.738018+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:02.245593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:28.028556+0000","last_clean_scrub_stamp":"2024-02-10T08:20:02.245593+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"62'9","reported_seq":47,"reported_epoch":98,"state":"active+undersized+degraded","last_fresh":"2024-02-10T08:20:10.753234+0000","last_change":"2024-02-10T08:19:31.812784+0000","last_active":"2024-02-10T08:20:10.753234+0000","last_peered":"2024-02-10T08:20:10.753234+0000","last_clean":"2024-02-10T08:17:00.130903+0000","last_became_active":"2024-02-10T08:19:31.812784+0000","last_became_peered":"2024-02-10T08:19:31.812784+0000","last_unstale":"2024-02-10T08:20:10.753234+0000","last_undegraded":"2024-02-10T08:19:31.800999+0000","last_fullsized":"2024-02-10T08:19:31.800900+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'9","last_scrub_stamp":"2024-02-10T08:18:15.012657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:15.012657+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":4,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":["3","0"],"object_location_counts":[{"shards":"0,3","objects":4}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":52,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-02-10T08:20:10.764199+0000","last_change":"2024-02-10T08:18:52.045246+0000","last_active":"2024-02-10T08:20:10.764199+0000","last_peered":"2024-02-10T08:20:10.764199+0000","last_clean":"2024-02-10T08:20:10.764199+0000","last_became_active":"2024-02-10T08:16:58.891365+0000","last_became_peered":"2024-02-10T08:16:58.891365+0000","last_unstale":"2024-02-10T08:20:10.764199+0000","last_undegraded":"2024-02-10T08:20:10.764199+0000","last_fullsized":"2024-02-10T08:20:10.764199+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:52.045180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:52.045180+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":19,"reported_epoch":98,"state":"active+undersized","last_fresh":"2024-02-10T08:20:10.761443+0000","last_change":"2024-02-10T08:19:31.805487+0000","last_active":"2024-02-10T08:20:10.761443+0000","last_peered":"2024-02-10T08:20:10.761443+0000","last_clean":"2024-02-10T08:16:55.840727+0000","last_became_active":"2024-02-10T08:19:31.805487+0000","last_became_peered":"2024-02-10T08:19:31.805487+0000","last_unstale":"2024-02-10T08:20:10.761443+0000","last_undegraded":"2024-02-10T08:20:10.761443+0000","last_fullsized":"2024-02-10T08:19:31.800553+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:22.000811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:22.000811+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":63,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-02-10T08:20:10.749920+0000","last_change":"2024-02-10T08:20:04.345319+0000","last_active":"2024-02-10T08:20:10.749920+0000","last_peered":"2024-02-10T08:20:10.749920+0000","last_clean":"2024-02-10T08:20:10.749920+0000","last_became_active":"2024-02-10T08:16:52.785404+0000","last_became_peered":"2024-02-10T08:16:52.785404+0000","last_unstale":"2024-02-10T08:20:10.749920+0000","last_undegraded":"2024-02-10T08:20:10.749920+0000","last_fullsized":"2024-02-10T08:20:10.749920+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:04.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:20:04.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"74'17","reported_seq":90,"reported_epoch":98,"state":"active+undersized+degraded","last_fresh":"2024-02-10T08:20:10.749989+0000","last_change":"2024-02-10T08:19:31.811274+0000","last_active":"2024-02-10T08:20:10.749989+0000","last_peered":"2024-02-10T08:20:10.749989+0000","last_clean":"2024-02-10T08:19:19.763204+0000","last_became_active":"2024-02-10T08:19:31.811274+0000","last_became_peered":"2024-02-10T08:19:31.811274+0000","last_unstale":"2024-02-10T08:20:10.749989+0000","last_undegraded":"2024-02-10T08:19:31.800999+0000","last_fullsized":"2024-02-10T08:19:31.800878+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'17","last_scrub_stamp":"2024-02-10T08:18:02.949298+0000","last_deep_scrub":"74'17","last_deep_scrub_stamp":"2024-02-10T08:18:02.949298+0000","last_clean_scrub_stamp":"2024-02-10T08:18:02.949298+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":5,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[{"shards":"1,3","objects":5}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":19,"reported_epoch":98,"state":"active+undersized","last_fresh":"2024-02-10T08:20:10.748409+0000","last_change":"2024-02-10T08:19:31.806483+0000","last_active":"2024-02-10T08:20:10.748409+0000","last_peered":"2024-02-10T08:20:10.748409+0000","last_clean":"2024-02-10T08:16:57.845780+0000","last_became_active":"2024-02-10T08:19:31.806483+0000","last_became_peered":"2024-02-10T08:19:31.806483+0000","last_unstale":"2024-02-10T08:20:10.748409+0000","last_undegraded":"2024-02-10T08:20:10.748409+0000","last_fullsized":"2024-02-10T08:19:31.802776+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:26.952496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:26.952496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":["6","5"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":60,"reported_epoch":98,"state":"active+undersized","last_fresh":"2024-02-10T08:20:10.761115+0000","last_change":"2024-02-10T08:19:31.814813+0000","last_active":"2024-02-10T08:20:10.761115+0000","last_peered":"2024-02-10T08:20:10.761115+0000","last_clean":"2024-02-10T08:19:20.316466+0000","last_became_active":"2024-02-10T08:19:31.814813+0000","last_became_peered":"2024-02-10T08:19:31.814813+0000","last_unstale":"2024-02-10T08:20:10.761115+0000","last_undegraded":"2024-02-10T08:20:10.761115+0000","last_fullsized":"2024-02-10T08:19:31.807013+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:38.230210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:38.230210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":68,"reported_epoch":98,"state":"active+undersized","last_fresh":"2024-02-10T08:20:10.748146+0000","last_change":"2024-02-10T08:19:31.810567+0000","last_active":"2024-02-10T08:20:10.748146+0000","last_peered":"2024-02-10T08:20:10.748146+0000","last_clean":"2024-02-10T08:19:20.223539+0000","last_became_active":"2024-02-10T08:19:31.810567+0000","last_became_peered":"2024-02-10T08:19:31.810567+0000","last_unstale":"2024-02-10T08:20:10.748146+0000","last_undegraded":"2024-02-10T08:20:10.748146+0000","last_fullsized":"2024-02-10T08:19:31.804905+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:10.370746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:10.370746+0000","last_clean_scrub_stamp":"2024-02-10T08:19:10.370746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":["6","7"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1c","version":"62'15","reported_seq":86,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-02-10T08:20:10.748976+0000","last_change":"2024-02-10T08:19:20.814029+0000","last_active":"2024-02-10T08:20:10.748976+0000","last_peered":"2024-02-10T08:20:10.748976+0000","last_clean":"2024-02-10T08:20:10.748976+0000","last_became_active":"2024-02-10T08:16:54.849361+0000","last_became_peered":"2024-02-10T08:16:54.849361+0000","last_unstale":"2024-02-10T08:20:10.748976+0000","last_undegraded":"2024-02-10T08:20:10.748976+0000","last_fullsized":"2024-02-10T08:20:10.748976+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'15","last_scrub_stamp":"2024-02-10T08:19:20.813910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:19:20.813910+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":58,"reported_epoch":98,"state":"active+undersized","last_fresh":"2024-02-10T08:20:10.760615+0000","last_change":"2024-02-10T08:19:31.809166+0000","last_active":"2024-02-10T08:20:10.760615+0000","last_peered":"2024-02-10T08:20:10.760615+0000","last_clean":"2024-02-10T08:19:20.316102+0000","last_became_active":"2024-02-10T08:19:31.809166+0000","last_became_peered":"2024-02-10T08:19:31.809166+0000","last_unstale":"2024-02-10T08:20:10.760615+0000","last_undegraded":"2024-02-10T08:20:10.760615+0000","last_fullsized":"2024-02-10T08:19:31.806497+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:22.104988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:22.104988+0000","last_clean_scrub_stamp":"2024-02-10T08:18:22.104988+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":["1","5"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":58,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-02-10T08:20:10.747703+0000","last_change":"2024-02-10T08:20:02.843334+0000","last_active":"2024-02-10T08:20:10.747703+0000","last_peered":"2024-02-10T08:20:10.747703+0000","last_clean":"2024-02-10T08:20:10.747703+0000","last_became_active":"2024-02-10T08:16:56.863348+0000","last_became_peered":"2024-02-10T08:16:56.863348+0000","last_unstale":"2024-02-10T08:20:10.747703+0000","last_undegraded":"2024-02-10T08:20:10.747703+0000","last_fullsized":"2024-02-10T08:20:10.747703+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:02.843237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:20:02.843237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":63,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-02-10T08:20:14.239093+0000","last_change":"2024-02-10T08:20:14.239093+0000","last_active":"2024-02-10T08:20:14.239093+0000","last_peered":"2024-02-10T08:20:14.239093+0000","last_clean":"2024-02-10T08:20:14.239093+0000","last_became_active":"2024-02-10T08:16:52.785743+0000","last_became_peered":"2024-02-10T08:16:52.785743+0000","last_unstale":"2024-02-10T08:20:14.239093+0000","last_undegraded":"2024-02-10T08:20:14.239093+0000","last_fullsized":"2024-02-10T08:20:14.239093+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:14.238991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:20:14.238991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"62'11","reported_seq":79,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-02-10T08:20:10.748623+0000","last_change":"2024-02-10T08:19:29.497168+0000","last_active":"2024-02-10T08:20:10.748623+0000","last_peered":"2024-02-10T08:20:10.748623+0000","last_clean":"2024-02-10T08:20:10.748623+0000","last_became_active":"2024-02-10T08:16:54.852665+0000","last_became_peered":"2024-02-10T08:16:54.852665+0000","last_unstale":"2024-02-10T08:20:10.748623+0000","last_undegraded":"2024-02-10T08:20:10.748623+0000","last_fullsized":"2024-02-10T08:20:10.748623+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'11","last_scrub_stamp":"2024-02-10T08:19:29.497086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:19:29.497086+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"87'2","reported_seq":58,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-02-10T08:20:10.738292+0000","last_change":"2024-02-10T08:19:29.207609+0000","last_active":"2024-02-10T08:20:10.738292+0000","last_peered":"2024-02-10T08:20:10.738292+0000","last_clean":"2024-02-10T08:20:10.738292+0000","last_became_active":"2024-02-10T08:16:58.859047+0000","last_became_peered":"2024-02-10T08:16:58.859047+0000","last_unstale":"2024-02-10T08:20:10.738292+0000","last_undegraded":"2024-02-10T08:20:10.738292+0000","last_fullsized":"2024-02-10T08:20:10.738292+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'2","last_scrub_stamp":"2024-02-10T08:19:29.207531+0000","last_deep_scrub":"87'2","last_deep_scrub_stamp":"2024-02-10T08:19:29.207531+0000","last_clean_scrub_stamp":"2024-02-10T08:19:29.207531+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"89'10","reported_seq":116,"reported_epoch":99,"state":"active+undersized+degraded","last_fresh":"2024-02-10T08:20:11.743487+0000","last_change":"2024-02-10T08:19:31.813517+0000","last_active":"2024-02-10T08:20:11.743487+0000","last_peered":"2024-02-10T08:20:11.743487+0000","last_clean":"2024-02-10T08:19:25.927602+0000","last_became_active":"2024-02-10T08:19:31.813517+0000","last_became_peered":"2024-02-10T08:19:31.813517+0000","last_unstale":"2024-02-10T08:20:11.743487+0000","last_undegraded":"2024-02-10T08:19:31.805066+0000","last_fullsized":"2024-02-10T08:19:31.804974+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'9","last_scrub_stamp":"2024-02-10T08:18:36.323217+0000","last_deep_scrub":"82'9","last_deep_scrub_stamp":"2024-02-10T08:18:36.323217+0000","last_clean_scrub_stamp":"2024-02-10T08:18:36.323217+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":["6","7"],"object_location_counts":[{"shards":"6,7","objects":1}],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":63,"reported_epoch":98,"state":"active+undersized","last_fresh":"2024-02-10T08:20:10.772494+0000","last_change":"2024-02-10T08:19:31.809382+0000","last_active":"2024-02-10T08:20:10.772494+0000","last_peered":"2024-02-10T08:20:10.772494+0000","last_clean":"2024-02-10T08:19:20.314854+0000","last_became_active":"2024-02-10T08:19:31.809382+0000","last_became_peered":"2024-02-10T08:19:31.809382+0000","last_unstale":"2024-02-10T08:20:10.772494+0000","last_undegraded":"2024-02-10T08:20:10.772494+0000","last_fullsized":"2024-02-10T08:19:31.800771+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:30.422800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:30.422800+0000","last_clean_scrub_stamp":"2024-02-10T08:18:30.422800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":["5","7"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"74'15","reported_seq":80,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-02-10T08:20:10.747631+0000","last_change":"2024-02-10T08:19:15.492916+0000","last_active":"2024-02-10T08:20:10.747631+0000","last_peered":"2024-02-10T08:20:10.747631+0000","last_clean":"2024-02-10T08:20:10.747631+0000","last_became_active":"2024-02-10T08:16:55.204738+0000","last_became_peered":"2024-02-10T08:16:55.204738+0000","last_unstale":"2024-02-10T08:20:10.747631+0000","last_undegraded":"2024-02-10T08:20:10.747631+0000","last_fullsized":"2024-02-10T08:20:10.747631+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'15","last_scrub_stamp":"2024-02-10T08:19:15.492821+0000","last_deep_scrub":"74'15","last_deep_scrub_stamp":"2024-02-10T08:17:57.637346+0000","last_clean_scrub_stamp":"2024-02-10T08:19:15.492821+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":57,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-02-10T08:20:15.204543+0000","last_change":"2024-02-10T08:20:15.204543+0000","last_active":"2024-02-10T08:20:15.204543+0000","last_peered":"2024-02-10T08:20:15.204543+0000","last_clean":"2024-02-10T08:20:15.204543+0000","last_became_active":"2024-02-10T08:16:58.892622+0000","last_became_peered":"2024-02-10T08:16:58.892622+0000","last_unstale":"2024-02-10T08:20:15.204543+0000","last_undegraded":"2024-02-10T08:20:15.204543+0000","last_fullsized":"2024-02-10T08:20:15.204543+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:15.204475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:20:15.204475+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":64,"reported_epoch":98,"state":"active+undersized","last_fresh":"2024-02-10T08:20:10.737574+0000","last_change":"2024-02-10T08:19:31.808533+0000","last_active":"2024-02-10T08:20:10.737574+0000","last_peered":"2024-02-10T08:20:10.737574+0000","last_clean":"2024-02-10T08:19:19.814861+0000","last_became_active":"2024-02-10T08:19:31.808533+0000","last_became_peered":"2024-02-10T08:19:31.808533+0000","last_unstale":"2024-02-10T08:20:10.737574+0000","last_undegraded":"2024-02-10T08:20:10.737574+0000","last_fullsized":"2024-02-10T08:19:31.804401+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:06.357048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:19:06.357048+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":["7","6"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":62,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-02-10T08:20:10.748484+0000","last_change":"2024-02-10T08:19:22.466525+0000","last_active":"2024-02-10T08:20:10.748484+0000","last_peered":"2024-02-10T08:20:10.748484+0000","last_clean":"2024-02-10T08:20:10.748484+0000","last_became_active":"2024-02-10T08:16:52.788629+0000","last_became_peered":"2024-02-10T08:16:52.788629+0000","last_unstale":"2024-02-10T08:20:10.748484+0000","last_undegraded":"2024-02-10T08:20:10.748484+0000","last_fullsized":"2024-02-10T08:20:10.748484+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:22.466453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:19:22.466453+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"62'11","reported_seq":80,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-02-10T08:20:10.759642+0000","last_change":"2024-02-10T08:19:32.166896+0000","last_active":"2024-02-10T08:20:10.759642+0000","last_peered":"2024-02-10T08:20:10.759642+0000","last_clean":"2024-02-10T08:20:10.759642+0000","last_became_active":"2024-02-10T08:16:55.204751+0000","last_became_peered":"2024-02-10T08:16:55.204751+0000","last_unstale":"2024-02-10T08:20:10.759642+0000","last_undegraded":"2024-02-10T08:20:10.759642+0000","last_fullsized":"2024-02-10T08:20:10.759642+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'11","last_scrub_stamp":"2024-02-10T08:19:32.166830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:19:32.166830+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":62,"reported_epoch":98,"state":"active+undersized","last_fresh":"2024-02-10T08:20:10.737467+0000","last_change":"2024-02-10T08:19:31.807610+0000","last_active":"2024-02-10T08:20:10.737467+0000","last_peered":"2024-02-10T08:20:10.737467+0000","last_clean":"2024-02-10T08:19:27.276644+0000","last_became_active":"2024-02-10T08:19:31.807610+0000","last_became_peered":"2024-02-10T08:19:31.807610+0000","last_unstale":"2024-02-10T08:20:10.737467+0000","last_undegraded":"2024-02-10T08:20:10.737467+0000","last_fullsized":"2024-02-10T08:19:31.803079+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:27.276490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:27.276490+0000","last_clean_scrub_stamp":"2024-02-10T08:19:27.276490+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":["7","2"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":59,"reported_epoch":98,"state":"active+undersized","last_fresh":"2024-02-10T08:20:10.748015+0000","last_change":"2024-02-10T08:19:31.810130+0000","last_active":"2024-02-10T08:20:10.748015+0000","last_peered":"2024-02-10T08:20:10.748015+0000","last_clean":"2024-02-10T08:19:20.223418+0000","last_became_active":"2024-02-10T08:19:31.810130+0000","last_became_peered":"2024-02-10T08:19:31.810130+0000","last_unstale":"2024-02-10T08:20:10.748015+0000","last_undegraded":"2024-02-10T08:20:10.748015+0000","last_fullsized":"2024-02-10T08:19:31.803377+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:34.381329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:34.381329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":["6","7"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":62,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-02-10T08:20:10.773780+0000","last_change":"2024-02-10T08:19:13.281333+0000","last_active":"2024-02-10T08:20:10.773780+0000","last_peered":"2024-02-10T08:20:10.773780+0000","last_clean":"2024-02-10T08:20:10.773780+0000","last_became_active":"2024-02-10T08:16:52.788704+0000","last_became_peered":"2024-02-10T08:16:52.788704+0000","last_unstale":"2024-02-10T08:20:10.773780+0000","last_undegraded":"2024-02-10T08:20:10.773780+0000","last_fullsized":"2024-02-10T08:20:10.773780+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:13.281242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:19:13.281242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"62'4","reported_seq":62,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-02-10T08:20:10.749498+0000","last_change":"2024-02-10T08:18:50.134758+0000","last_active":"2024-02-10T08:20:10.749498+0000","last_peered":"2024-02-10T08:20:10.749498+0000","last_clean":"2024-02-10T08:20:10.749498+0000","last_became_active":"2024-02-10T08:16:54.852959+0000","last_became_peered":"2024-02-10T08:16:54.852959+0000","last_unstale":"2024-02-10T08:20:10.749498+0000","last_undegraded":"2024-02-10T08:20:10.749498+0000","last_fullsized":"2024-02-10T08:20:10.749498+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'4","last_scrub_stamp":"2024-02-10T08:18:50.134690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:50.134690+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":57,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-02-10T08:20:10.749823+0000","last_change":"2024-02-10T08:19:02.030164+0000","last_active":"2024-02-10T08:20:10.749823+0000","last_peered":"2024-02-10T08:20:10.749823+0000","last_clean":"2024-02-10T08:20:10.749823+0000","last_became_active":"2024-02-10T08:16:58.864301+0000","last_became_peered":"2024-02-10T08:16:58.864301+0000","last_unstale":"2024-02-10T08:20:10.749823+0000","last_undegraded":"2024-02-10T08:20:10.749823+0000","last_fullsized":"2024-02-10T08:20:10.749823+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:02.030086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:19:02.030086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":59,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-02-10T08:20:10.764932+0000","last_change":"2024-02-10T08:20:07.754989+0000","last_active":"2024-02-10T08:20:10.764932+0000","last_peered":"2024-02-10T08:20:10.764932+0000","last_clean":"2024-02-10T08:20:10.764932+0000","last_became_active":"2024-02-10T08:16:56.860953+0000","last_became_peered":"2024-02-10T08:16:56.860953+0000","last_unstale":"2024-02-10T08:20:10.764932+0000","last_undegraded":"2024-02-10T08:20:10.764932+0000","last_fullsized":"2024-02-10T08:20:10.764932+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:07.754900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:20:07.754900+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":65,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-02-10T08:20:10.760844+0000","last_change":"2024-02-10T08:20:03.782239+0000","last_active":"2024-02-10T08:20:10.760844+0000","last_peered":"2024-02-10T08:20:10.760844+0000","last_clean":"2024-02-10T08:20:10.760844+0000","last_became_active":"2024-02-10T08:16:52.786400+0000","last_became_peered":"2024-02-10T08:16:52.786400+0000","last_unstale":"2024-02-10T08:20:10.760844+0000","last_undegraded":"2024-02-10T08:20:10.760844+0000","last_fullsized":"2024-02-10T08:20:10.760844+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:03.782136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:20:03.782136+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"62'11","reported_seq":50,"reported_epoch":98,"state":"active+undersized+degraded","last_fresh":"2024-02-10T08:20:10.748287+0000","last_change":"2024-02-10T08:19:31.813450+0000","last_active":"2024-02-10T08:20:10.748287+0000","last_peered":"2024-02-10T08:20:10.748287+0000","last_clean":"2024-02-10T08:17:00.191693+0000","last_became_active":"2024-02-10T08:19:31.813450+0000","last_became_peered":"2024-02-10T08:19:31.813450+0000","last_unstale":"2024-02-10T08:20:10.748287+0000","last_undegraded":"2024-02-10T08:19:31.804331+0000","last_fullsized":"2024-02-10T08:19:31.804217+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'11","last_scrub_stamp":"2024-02-10T08:18:17.029517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:17.029517+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":5,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":["6","2"],"object_location_counts":[{"shards":"2,6","objects":5}],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":56,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-02-10T08:20:10.746115+0000","last_change":"2024-02-10T08:20:06.911888+0000","last_active":"2024-02-10T08:20:10.746115+0000","last_peered":"2024-02-10T08:20:10.746115+0000","last_clean":"2024-02-10T08:20:10.746115+0000","last_became_active":"2024-02-10T08:16:58.861031+0000","last_became_peered":"2024-02-10T08:16:58.861031+0000","last_unstale":"2024-02-10T08:20:10.746115+0000","last_undegraded":"2024-02-10T08:20:10.746115+0000","last_fullsized":"2024-02-10T08:20:10.746115+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:06.911805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:20:06.911805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":54,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-02-10T08:20:10.750001+0000","last_change":"2024-02-10T08:18:55.042056+0000","last_active":"2024-02-10T08:20:10.750001+0000","last_peered":"2024-02-10T08:20:10.750001+0000","last_clean":"2024-02-10T08:20:10.750001+0000","last_became_active":"2024-02-10T08:16:56.862136+0000","last_became_peered":"2024-02-10T08:16:56.862136+0000","last_unstale":"2024-02-10T08:20:10.750001+0000","last_undegraded":"2024-02-10T08:20:10.750001+0000","last_fullsized":"2024-02-10T08:20:10.750001+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:55.041978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:55.041978+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":62,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-02-10T08:20:10.748229+0000","last_change":"2024-02-10T08:19:19.411587+0000","last_active":"2024-02-10T08:20:10.748229+0000","last_peered":"2024-02-10T08:20:10.748229+0000","last_clean":"2024-02-10T08:20:10.748229+0000","last_became_active":"2024-02-10T08:16:52.786213+0000","last_became_peered":"2024-02-10T08:16:52.786213+0000","last_unstale":"2024-02-10T08:20:10.748229+0000","last_undegraded":"2024-02-10T08:20:10.748229+0000","last_fullsized":"2024-02-10T08:20:10.748229+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:19.411512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:19:19.411512+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"62'9","reported_seq":77,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-02-10T08:20:10.764715+0000","last_change":"2024-02-10T08:19:14.479081+0000","last_active":"2024-02-10T08:20:10.764715+0000","last_peered":"2024-02-10T08:20:10.764715+0000","last_clean":"2024-02-10T08:20:10.764715+0000","last_became_active":"2024-02-10T08:16:54.851971+0000","last_became_peered":"2024-02-10T08:16:54.851971+0000","last_unstale":"2024-02-10T08:20:10.764715+0000","last_undegraded":"2024-02-10T08:20:10.764715+0000","last_fullsized":"2024-02-10T08:20:10.764715+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'9","last_scrub_stamp":"2024-02-10T08:19:14.478966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:19:14.478966+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":19,"reported_epoch":98,"state":"active+undersized","last_fresh":"2024-02-10T08:20:10.749375+0000","last_change":"2024-02-10T08:19:31.807555+0000","last_active":"2024-02-10T08:20:10.749375+0000","last_peered":"2024-02-10T08:20:10.749375+0000","last_clean":"2024-02-10T08:16:57.845780+0000","last_became_active":"2024-02-10T08:19:31.807555+0000","last_became_peered":"2024-02-10T08:19:31.807555+0000","last_unstale":"2024-02-10T08:20:10.749375+0000","last_undegraded":"2024-02-10T08:20:10.749375+0000","last_fullsized":"2024-02-10T08:19:31.802860+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:22.955823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:22.955823+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":["2","5"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"62'8","reported_seq":108,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-02-10T08:20:11.761628+0000","last_change":"2024-02-10T08:20:10.352015+0000","last_active":"2024-02-10T08:20:11.761628+0000","last_peered":"2024-02-10T08:20:11.761628+0000","last_clean":"2024-02-10T08:20:11.761628+0000","last_became_active":"2024-02-10T08:16:56.854151+0000","last_became_peered":"2024-02-10T08:16:56.854151+0000","last_unstale":"2024-02-10T08:20:11.761628+0000","last_undegraded":"2024-02-10T08:20:11.761628+0000","last_fullsized":"2024-02-10T08:20:11.761628+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'8","last_scrub_stamp":"2024-02-10T08:20:10.351918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:20:10.351918+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":68,"reported_epoch":98,"state":"active+undersized","last_fresh":"2024-02-10T08:20:10.746841+0000","last_change":"2024-02-10T08:19:31.817590+0000","last_active":"2024-02-10T08:20:10.746841+0000","last_peered":"2024-02-10T08:20:10.746841+0000","last_clean":"2024-02-10T08:19:20.315504+0000","last_became_active":"2024-02-10T08:19:31.817590+0000","last_became_peered":"2024-02-10T08:19:31.817590+0000","last_unstale":"2024-02-10T08:20:10.746841+0000","last_undegraded":"2024-02-10T08:20:10.746841+0000","last_fullsized":"2024-02-10T08:19:31.808709+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:08.548458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:19:08.548458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":["0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"62'9","reported_seq":76,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-02-10T08:20:11.316023+0000","last_change":"2024-02-10T08:20:11.315987+0000","last_active":"2024-02-10T08:20:11.316023+0000","last_peered":"2024-02-10T08:20:11.316023+0000","last_clean":"2024-02-10T08:20:11.316023+0000","last_became_active":"2024-02-10T08:16:55.204734+0000","last_became_peered":"2024-02-10T08:16:55.204734+0000","last_unstale":"2024-02-10T08:20:11.316023+0000","last_undegraded":"2024-02-10T08:20:11.316023+0000","last_fullsized":"2024-02-10T08:20:11.316023+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'9","last_scrub_stamp":"2024-02-10T08:20:11.315903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:20:11.315903+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":56,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-02-10T08:20:10.747132+0000","last_change":"2024-02-10T08:19:17.540177+0000","last_active":"2024-02-10T08:20:10.747132+0000","last_peered":"2024-02-10T08:20:10.747132+0000","last_clean":"2024-02-10T08:20:10.747132+0000","last_became_active":"2024-02-10T08:16:58.869673+0000","last_became_peered":"2024-02-10T08:16:58.869673+0000","last_unstale":"2024-02-10T08:20:10.747132+0000","last_undegraded":"2024-02-10T08:20:10.747132+0000","last_fullsized":"2024-02-10T08:20:10.747132+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:17.540101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:05.662947+0000","last_clean_scrub_stamp":"2024-02-10T08:19:17.540101+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"89'9","reported_seq":108,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-02-10T08:20:11.748649+0000","last_change":"2024-02-10T08:19:33.299741+0000","last_active":"2024-02-10T08:20:11.748649+0000","last_peered":"2024-02-10T08:20:11.748649+0000","last_clean":"2024-02-10T08:20:11.748649+0000","last_became_active":"2024-02-10T08:16:56.864587+0000","last_became_peered":"2024-02-10T08:16:56.864587+0000","last_unstale":"2024-02-10T08:20:11.748649+0000","last_undegraded":"2024-02-10T08:20:11.748649+0000","last_fullsized":"2024-02-10T08:20:11.748649+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'9","last_scrub_stamp":"2024-02-10T08:19:33.299671+0000","last_deep_scrub":"89'9","last_deep_scrub_stamp":"2024-02-10T08:19:33.299671+0000","last_clean_scrub_stamp":"2024-02-10T08:19:33.299671+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":62,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-02-10T08:20:10.772420+0000","last_change":"2024-02-10T08:20:04.285337+0000","last_active":"2024-02-10T08:20:10.772420+0000","last_peered":"2024-02-10T08:20:10.772420+0000","last_clean":"2024-02-10T08:20:10.772420+0000","last_became_active":"2024-02-10T08:16:52.789834+0000","last_became_peered":"2024-02-10T08:16:52.789834+0000","last_unstale":"2024-02-10T08:20:10.772420+0000","last_undegraded":"2024-02-10T08:20:10.772420+0000","last_fullsized":"2024-02-10T08:20:10.772420+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:04.285243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:20:04.285243+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"62'10","reported_seq":76,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-02-10T08:20:10.761123+0000","last_change":"2024-02-10T08:19:09.007459+0000","last_active":"2024-02-10T08:20:10.761123+0000","last_peered":"2024-02-10T08:20:10.761123+0000","last_clean":"2024-02-10T08:20:10.761123+0000","last_became_active":"2024-02-10T08:16:55.204789+0000","last_became_peered":"2024-02-10T08:16:55.204789+0000","last_unstale":"2024-02-10T08:20:10.761123+0000","last_undegraded":"2024-02-10T08:20:10.761123+0000","last_fullsized":"2024-02-10T08:20:10.761123+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'10","last_scrub_stamp":"2024-02-10T08:19:09.007376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:19:09.007376+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":57,"reported_epoch":98,"state":"active+undersized","last_fresh":"2024-02-10T08:20:10.738085+0000","last_change":"2024-02-10T08:19:31.809296+0000","last_active":"2024-02-10T08:20:10.738085+0000","last_peered":"2024-02-10T08:20:10.738085+0000","last_clean":"2024-02-10T08:19:19.815120+0000","last_became_active":"2024-02-10T08:19:31.809296+0000","last_became_peered":"2024-02-10T08:19:31.809296+0000","last_unstale":"2024-02-10T08:20:10.738085+0000","last_undegraded":"2024-02-10T08:20:10.738085+0000","last_fullsized":"2024-02-10T08:19:31.803991+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:22.944593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:22.944593+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":["7","6"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":58,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-02-10T08:20:10.773707+0000","last_change":"2024-02-10T08:20:10.278739+0000","last_active":"2024-02-10T08:20:10.773707+0000","last_peered":"2024-02-10T08:20:10.773707+0000","last_clean":"2024-02-10T08:20:10.773707+0000","last_became_active":"2024-02-10T08:16:56.863948+0000","last_became_peered":"2024-02-10T08:16:56.863948+0000","last_unstale":"2024-02-10T08:20:10.773707+0000","last_undegraded":"2024-02-10T08:20:10.773707+0000","last_fullsized":"2024-02-10T08:20:10.773707+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:10.278678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:20:10.278678+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":63,"reported_epoch":98,"state":"active+undersized","last_fresh":"2024-02-10T08:20:10.748057+0000","last_change":"2024-02-10T08:19:31.811160+0000","last_active":"2024-02-10T08:20:10.748057+0000","last_peered":"2024-02-10T08:20:10.748057+0000","last_clean":"2024-02-10T08:19:20.223459+0000","last_became_active":"2024-02-10T08:19:31.811160+0000","last_became_peered":"2024-02-10T08:19:31.811160+0000","last_unstale":"2024-02-10T08:20:10.748057+0000","last_undegraded":"2024-02-10T08:20:10.748057+0000","last_fullsized":"2024-02-10T08:19:31.803658+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:08.233096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:08.233096+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":["6","1"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"62'6","reported_seq":70,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-02-10T08:20:10.753675+0000","last_change":"2024-02-10T08:20:08.360978+0000","last_active":"2024-02-10T08:20:10.753675+0000","last_peered":"2024-02-10T08:20:10.753675+0000","last_clean":"2024-02-10T08:20:10.753675+0000","last_became_active":"2024-02-10T08:16:55.203401+0000","last_became_peered":"2024-02-10T08:16:55.203401+0000","last_unstale":"2024-02-10T08:20:10.753675+0000","last_undegraded":"2024-02-10T08:20:10.753675+0000","last_fullsized":"2024-02-10T08:20:10.753675+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'6","last_scrub_stamp":"2024-02-10T08:20:08.360881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:20:08.360881+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":58,"reported_epoch":98,"state":"active+undersized","last_fresh":"2024-02-10T08:20:10.748606+0000","last_change":"2024-02-10T08:19:31.808222+0000","last_active":"2024-02-10T08:20:10.748606+0000","last_peered":"2024-02-10T08:20:10.748606+0000","last_clean":"2024-02-10T08:19:19.763774+0000","last_became_active":"2024-02-10T08:19:31.808222+0000","last_became_peered":"2024-02-10T08:19:31.808222+0000","last_unstale":"2024-02-10T08:20:10.748606+0000","last_undegraded":"2024-02-10T08:20:10.748606+0000","last_fullsized":"2024-02-10T08:19:31.803668+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:10.716763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:10.716763+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":["2","7"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":59,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-02-10T08:20:10.753796+0000","last_change":"2024-02-10T08:20:07.352836+0000","last_active":"2024-02-10T08:20:10.753796+0000","last_peered":"2024-02-10T08:20:10.753796+0000","last_clean":"2024-02-10T08:20:10.753796+0000","last_became_active":"2024-02-10T08:16:56.860904+0000","last_became_peered":"2024-02-10T08:16:56.860904+0000","last_unstale":"2024-02-10T08:20:10.753796+0000","last_undegraded":"2024-02-10T08:20:10.753796+0000","last_fullsized":"2024-02-10T08:20:10.753796+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:07.352745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:20:07.352745+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"55'1","reported_seq":69,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-02-10T08:20:10.748742+0000","last_change":"2024-02-10T08:19:59.845452+0000","last_active":"2024-02-10T08:20:10.748742+0000","last_peered":"2024-02-10T08:20:10.748742+0000","last_clean":"2024-02-10T08:20:10.748742+0000","last_became_active":"2024-02-10T08:16:52.782734+0000","last_became_peered":"2024-02-10T08:16:52.782734+0000","last_unstale":"2024-02-10T08:20:10.748742+0000","last_undegraded":"2024-02-10T08:20:10.748742+0000","last_fullsized":"2024-02-10T08:20:10.748742+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'1","last_scrub_stamp":"2024-02-10T08:19:59.845351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:19:59.845351+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"62'9","reported_seq":76,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-02-10T08:20:10.747383+0000","last_change":"2024-02-10T08:19:14.500843+0000","last_active":"2024-02-10T08:20:10.747383+0000","last_peered":"2024-02-10T08:20:10.747383+0000","last_clean":"2024-02-10T08:20:10.747383+0000","last_became_active":"2024-02-10T08:16:55.204727+0000","last_became_peered":"2024-02-10T08:16:55.204727+0000","last_unstale":"2024-02-10T08:20:10.747383+0000","last_undegraded":"2024-02-10T08:20:10.747383+0000","last_fullsized":"2024-02-10T08:20:10.747383+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'9","last_scrub_stamp":"2024-02-10T08:19:14.500766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:19:14.500766+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.a","version":"99'3013","reported_seq":3029,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-02-10T08:20:17.449361+0000","last_change":"2024-02-10T08:19:39.843283+0000","last_active":"2024-02-10T08:20:17.449361+0000","last_peered":"2024-02-10T08:20:17.449361+0000","last_clean":"2024-02-10T08:20:17.449361+0000","last_became_active":"2024-02-10T08:19:39.842909+0000","last_became_peered":"2024-02-10T08:19:39.842909+0000","last_unstale":"2024-02-10T08:20:17.449361+0000","last_undegraded":"2024-02-10T08:20:17.449361+0000","last_fullsized":"2024-02-10T08:20:17.449361+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_clean_scrub_stamp":"2024-02-10T08:19:38.813165+0000","log_size":3013,"ondisk_log_size":3013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":197459968,"num_objects":3013,"num_object_clones":0,"num_object_copies":9039,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3013,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3013,"num_write_kb":192832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":52,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-02-10T08:20:10.750091+0000","last_change":"2024-02-10T08:18:32.027821+0000","last_active":"2024-02-10T08:20:10.750091+0000","last_peered":"2024-02-10T08:20:10.750091+0000","last_clean":"2024-02-10T08:20:10.750091+0000","last_became_active":"2024-02-10T08:16:58.868848+0000","last_became_peered":"2024-02-10T08:16:58.868848+0000","last_unstale":"2024-02-10T08:20:10.750091+0000","last_undegraded":"2024-02-10T08:20:10.750091+0000","last_fullsized":"2024-02-10T08:20:10.750091+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:32.027720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:32.027720+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"55'2","reported_seq":28,"reported_epoch":98,"state":"active+undersized+degraded","last_fresh":"2024-02-10T08:20:10.748183+0000","last_change":"2024-02-10T08:19:31.813506+0000","last_active":"2024-02-10T08:20:10.748183+0000","last_peered":"2024-02-10T08:20:10.748183+0000","last_clean":"2024-02-10T08:16:52.815078+0000","last_became_active":"2024-02-10T08:19:31.813506+0000","last_became_peered":"2024-02-10T08:19:31.813506+0000","last_unstale":"2024-02-10T08:20:10.748183+0000","last_undegraded":"2024-02-10T08:19:31.810215+0000","last_fullsized":"2024-02-10T08:19:31.810079+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'2","last_scrub_stamp":"2024-02-10T08:18:03.916322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:03.916322+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":["0","7"],"object_location_counts":[{"shards":"0,7","objects":2}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"82'17","reported_seq":77,"reported_epoch":98,"state":"active+undersized+degraded","last_fresh":"2024-02-10T08:20:10.760403+0000","last_change":"2024-02-10T08:19:31.816953+0000","last_active":"2024-02-10T08:20:10.760403+0000","last_peered":"2024-02-10T08:20:10.760403+0000","last_clean":"2024-02-10T08:18:21.012257+0000","last_became_active":"2024-02-10T08:19:31.816953+0000","last_became_peered":"2024-02-10T08:19:31.816953+0000","last_unstale":"2024-02-10T08:20:10.760403+0000","last_undegraded":"2024-02-10T08:19:31.805112+0000","last_fullsized":"2024-02-10T08:19:31.804977+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'17","last_scrub_stamp":"2024-02-10T08:18:21.015873+0000","last_deep_scrub":"82'17","last_deep_scrub_stamp":"2024-02-10T08:18:21.015873+0000","last_clean_scrub_stamp":"2024-02-10T08:18:21.015873+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":5,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[{"shards":"1,3","objects":5}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":59,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-02-10T08:20:10.748654+0000","last_change":"2024-02-10T08:19:26.899727+0000","last_active":"2024-02-10T08:20:10.748654+0000","last_peered":"2024-02-10T08:20:10.748654+0000","last_clean":"2024-02-10T08:20:10.748654+0000","last_became_active":"2024-02-10T08:16:56.860850+0000","last_became_peered":"2024-02-10T08:16:56.860850+0000","last_unstale":"2024-02-10T08:20:10.748654+0000","last_undegraded":"2024-02-10T08:20:10.748654+0000","last_fullsized":"2024-02-10T08:20:10.748654+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:26.899655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:19:26.899655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1","version":"99'3170","reported_seq":3183,"reported_epoch":99,"state":"active+undersized+degraded","last_fresh":"2024-02-10T08:20:17.465693+0000","last_change":"2024-02-10T08:19:50.215754+0000","last_active":"2024-02-10T08:20:17.465693+0000","last_peered":"2024-02-10T08:20:17.465693+0000","last_clean":"2024-02-10T08:19:38.813165+0000","last_became_active":"2024-02-10T08:19:39.829713+0000","last_became_peered":"2024-02-10T08:19:39.829713+0000","last_unstale":"2024-02-10T08:20:17.465693+0000","last_undegraded":"2024-02-10T08:19:50.206224+0000","last_fullsized":"2024-02-10T08:19:39.827668+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_clean_scrub_stamp":"2024-02-10T08:19:38.813165+0000","log_size":3170,"ondisk_log_size":3170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":207749120,"num_objects":3170,"num_object_clones":0,"num_object_copies":9510,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3170,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3170,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3170,"num_write_kb":202880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":["3","6"],"object_location_counts":[{"shards":"3,6","objects":3170}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":56,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-02-10T08:20:10.746230+0000","last_change":"2024-02-10T08:19:13.538609+0000","last_active":"2024-02-10T08:20:10.746230+0000","last_peered":"2024-02-10T08:20:10.746230+0000","last_clean":"2024-02-10T08:20:10.746230+0000","last_became_active":"2024-02-10T08:16:58.864957+0000","last_became_peered":"2024-02-10T08:16:58.864957+0000","last_unstale":"2024-02-10T08:20:10.746230+0000","last_undegraded":"2024-02-10T08:20:10.746230+0000","last_fullsized":"2024-02-10T08:20:10.746230+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:13.538485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:19:13.538485+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":63,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-02-10T08:20:10.770565+0000","last_change":"2024-02-10T08:20:08.744631+0000","last_active":"2024-02-10T08:20:10.770565+0000","last_peered":"2024-02-10T08:20:10.770565+0000","last_clean":"2024-02-10T08:20:10.770565+0000","last_became_active":"2024-02-10T08:16:52.789354+0000","last_became_peered":"2024-02-10T08:16:52.789354+0000","last_unstale":"2024-02-10T08:20:10.770565+0000","last_undegraded":"2024-02-10T08:20:10.770565+0000","last_fullsized":"2024-02-10T08:20:10.770565+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:08.744567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:20:08.744567+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"62'10","reported_seq":77,"reported_epoch":98,"state":"active+undersized+degraded","last_fresh":"2024-02-10T08:20:10.764807+0000","last_change":"2024-02-10T08:19:31.814823+0000","last_active":"2024-02-10T08:20:10.764807+0000","last_peered":"2024-02-10T08:20:10.764807+0000","last_clean":"2024-02-10T08:19:20.315750+0000","last_became_active":"2024-02-10T08:19:31.814823+0000","last_became_peered":"2024-02-10T08:19:31.814823+0000","last_unstale":"2024-02-10T08:20:10.764807+0000","last_undegraded":"2024-02-10T08:19:31.805603+0000","last_fullsized":"2024-02-10T08:19:31.805486+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'10","last_scrub_stamp":"2024-02-10T08:18:26.189127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:26.189127+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":5,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":["1","5"],"object_location_counts":[{"shards":"1,5","objects":5}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"62'8","reported_seq":107,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-02-10T08:20:11.754456+0000","last_change":"2024-02-10T08:20:08.840019+0000","last_active":"2024-02-10T08:20:11.754456+0000","last_peered":"2024-02-10T08:20:11.754456+0000","last_clean":"2024-02-10T08:20:11.754456+0000","last_became_active":"2024-02-10T08:16:56.862677+0000","last_became_peered":"2024-02-10T08:16:56.862677+0000","last_unstale":"2024-02-10T08:20:11.754456+0000","last_undegraded":"2024-02-10T08:20:11.754456+0000","last_fullsized":"2024-02-10T08:20:11.754456+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'8","last_scrub_stamp":"2024-02-10T08:20:08.839890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:20:08.839890+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.7","version":"99'3194","reported_seq":3210,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-02-10T08:20:17.445344+0000","last_change":"2024-02-10T08:19:39.830249+0000","last_active":"2024-02-10T08:20:17.445344+0000","last_peered":"2024-02-10T08:20:17.445344+0000","last_clean":"2024-02-10T08:20:17.445344+0000","last_became_active":"2024-02-10T08:19:39.829937+0000","last_became_peered":"2024-02-10T08:19:39.829937+0000","last_unstale":"2024-02-10T08:20:17.445344+0000","last_undegraded":"2024-02-10T08:20:17.445344+0000","last_fullsized":"2024-02-10T08:20:17.445344+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_clean_scrub_stamp":"2024-02-10T08:19:38.813165+0000","log_size":3194,"ondisk_log_size":3194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":209321984,"num_objects":3194,"num_object_clones":0,"num_object_copies":9582,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3194,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3194,"num_write_kb":204416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,3],"acting":[6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":58,"reported_epoch":98,"state":"active+undersized","last_fresh":"2024-02-10T08:20:10.753365+0000","last_change":"2024-02-10T08:19:31.812541+0000","last_active":"2024-02-10T08:20:10.753365+0000","last_peered":"2024-02-10T08:20:10.753365+0000","last_clean":"2024-02-10T08:19:19.764452+0000","last_became_active":"2024-02-10T08:19:31.812541+0000","last_became_peered":"2024-02-10T08:19:31.812541+0000","last_unstale":"2024-02-10T08:20:10.753365+0000","last_undegraded":"2024-02-10T08:20:10.753365+0000","last_fullsized":"2024-02-10T08:19:31.801443+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:47.116727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:47.116727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":["3","7"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":62,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-02-10T08:20:10.772426+0000","last_change":"2024-02-10T08:20:07.299708+0000","last_active":"2024-02-10T08:20:10.772426+0000","last_peered":"2024-02-10T08:20:10.772426+0000","last_clean":"2024-02-10T08:20:10.772426+0000","last_became_active":"2024-02-10T08:16:52.791027+0000","last_became_peered":"2024-02-10T08:16:52.791027+0000","last_unstale":"2024-02-10T08:20:10.772426+0000","last_undegraded":"2024-02-10T08:20:10.772426+0000","last_fullsized":"2024-02-10T08:20:10.772426+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:07.299640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:20:07.299640+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"62'28","reported_seq":155,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-02-10T08:20:16.678248+0000","last_change":"2024-02-10T08:20:16.678248+0000","last_active":"2024-02-10T08:20:16.678248+0000","last_peered":"2024-02-10T08:20:16.678248+0000","last_clean":"2024-02-10T08:20:16.678248+0000","last_became_active":"2024-02-10T08:16:54.856000+0000","last_became_peered":"2024-02-10T08:16:54.856000+0000","last_unstale":"2024-02-10T08:20:16.678248+0000","last_undegraded":"2024-02-10T08:20:16.678248+0000","last_fullsized":"2024-02-10T08:20:16.678248+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'28","last_scrub_stamp":"2024-02-10T08:20:16.678147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:20:16.678147+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":48,"num_read_kb":33,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":59,"reported_epoch":98,"state":"active+undersized","last_fresh":"2024-02-10T08:20:10.747095+0000","last_change":"2024-02-10T08:19:31.815751+0000","last_active":"2024-02-10T08:20:10.747095+0000","last_peered":"2024-02-10T08:20:10.747095+0000","last_clean":"2024-02-10T08:19:20.315818+0000","last_became_active":"2024-02-10T08:19:31.815751+0000","last_became_peered":"2024-02-10T08:19:31.815751+0000","last_unstale":"2024-02-10T08:20:10.747095+0000","last_undegraded":"2024-02-10T08:20:10.747095+0000","last_fullsized":"2024-02-10T08:19:31.809028+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:51.533128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:51.533128+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"99'3136","reported_seq":3149,"reported_epoch":99,"state":"active+undersized+degraded","last_fresh":"2024-02-10T08:20:17.443779+0000","last_change":"2024-02-10T08:19:50.204621+0000","last_active":"2024-02-10T08:20:17.443779+0000","last_peered":"2024-02-10T08:20:17.443779+0000","last_clean":"2024-02-10T08:19:38.813165+0000","last_became_active":"2024-02-10T08:19:39.824710+0000","last_became_peered":"2024-02-10T08:19:39.824710+0000","last_unstale":"2024-02-10T08:20:17.443779+0000","last_undegraded":"2024-02-10T08:19:50.201260+0000","last_fullsized":"2024-02-10T08:19:39.819612+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_clean_scrub_stamp":"2024-02-10T08:19:38.813165+0000","log_size":3136,"ondisk_log_size":3136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":205520896,"num_objects":3136,"num_object_clones":0,"num_object_copies":9408,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3136,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3136,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3136,"num_write_kb":200704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0,1","objects":3136}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":56,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-02-10T08:20:10.738361+0000","last_change":"2024-02-10T08:20:08.316774+0000","last_active":"2024-02-10T08:20:10.738361+0000","last_peered":"2024-02-10T08:20:10.738361+0000","last_clean":"2024-02-10T08:20:10.738361+0000","last_became_active":"2024-02-10T08:16:58.891249+0000","last_became_peered":"2024-02-10T08:16:58.891249+0000","last_unstale":"2024-02-10T08:20:10.738361+0000","last_undegraded":"2024-02-10T08:20:10.738361+0000","last_fullsized":"2024-02-10T08:20:10.738361+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:08.316685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:11.750537+0000","last_clean_scrub_stamp":"2024-02-10T08:20:08.316685+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"63'5","reported_seq":263,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-02-10T08:20:16.121502+0000","last_change":"2024-02-10T08:19:12.466527+0000","last_active":"2024-02-10T08:20:16.121502+0000","last_peered":"2024-02-10T08:20:16.121502+0000","last_clean":"2024-02-10T08:20:16.121502+0000","last_became_active":"2024-02-10T08:16:52.780989+0000","last_became_peered":"2024-02-10T08:16:52.780989+0000","last_unstale":"2024-02-10T08:20:16.121502+0000","last_undegraded":"2024-02-10T08:20:16.121502+0000","last_fullsized":"2024-02-10T08:20:16.121502+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'5","last_scrub_stamp":"2024-02-10T08:19:12.466451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:19:12.466451+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":197,"num_read_kb":192,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":63,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-02-10T08:20:10.748613+0000","last_change":"2024-02-10T08:19:13.900328+0000","last_active":"2024-02-10T08:20:10.748613+0000","last_peered":"2024-02-10T08:20:10.748613+0000","last_clean":"2024-02-10T08:20:10.748613+0000","last_became_active":"2024-02-10T08:16:52.787737+0000","last_became_peered":"2024-02-10T08:16:52.787737+0000","last_unstale":"2024-02-10T08:20:10.748613+0000","last_undegraded":"2024-02-10T08:20:10.748613+0000","last_fullsized":"2024-02-10T08:20:10.748613+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:13.900264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:11.681169+0000","last_clean_scrub_stamp":"2024-02-10T08:19:13.900264+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"62'13","reported_seq":88,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-02-10T08:20:13.727663+0000","last_change":"2024-02-10T08:20:13.727663+0000","last_active":"2024-02-10T08:20:13.727663+0000","last_peered":"2024-02-10T08:20:13.727663+0000","last_clean":"2024-02-10T08:20:13.727663+0000","last_became_active":"2024-02-10T08:16:54.850812+0000","last_became_peered":"2024-02-10T08:16:54.850812+0000","last_unstale":"2024-02-10T08:20:13.727663+0000","last_undegraded":"2024-02-10T08:20:13.727663+0000","last_fullsized":"2024-02-10T08:20:13.727663+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'13","last_scrub_stamp":"2024-02-10T08:20:13.727564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:20:13.727564+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":59,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-02-10T08:20:10.752114+0000","last_change":"2024-02-10T08:20:00.886336+0000","last_active":"2024-02-10T08:20:10.752114+0000","last_peered":"2024-02-10T08:20:10.752114+0000","last_clean":"2024-02-10T08:20:10.752114+0000","last_became_active":"2024-02-10T08:16:56.857856+0000","last_became_peered":"2024-02-10T08:16:56.857856+0000","last_unstale":"2024-02-10T08:20:10.752114+0000","last_undegraded":"2024-02-10T08:20:10.752114+0000","last_fullsized":"2024-02-10T08:20:10.752114+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:00.886232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:20:00.886232+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"99'3086","reported_seq":3102,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-02-10T08:20:17.426391+0000","last_change":"2024-02-10T08:19:39.831855+0000","last_active":"2024-02-10T08:20:17.426391+0000","last_peered":"2024-02-10T08:20:17.426391+0000","last_clean":"2024-02-10T08:20:17.426391+0000","last_became_active":"2024-02-10T08:19:39.831585+0000","last_became_peered":"2024-02-10T08:19:39.831585+0000","last_unstale":"2024-02-10T08:20:17.426391+0000","last_undegraded":"2024-02-10T08:20:17.426391+0000","last_fullsized":"2024-02-10T08:20:17.426391+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_clean_scrub_stamp":"2024-02-10T08:19:38.813165+0000","log_size":3086,"ondisk_log_size":3086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":202244096,"num_objects":3086,"num_object_clones":0,"num_object_copies":9258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3086,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3086,"num_write_kb":197504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":57,"reported_epoch":98,"state":"active+undersized","last_fresh":"2024-02-10T08:20:10.773294+0000","last_change":"2024-02-10T08:19:31.806315+0000","last_active":"2024-02-10T08:20:10.773294+0000","last_peered":"2024-02-10T08:20:10.773294+0000","last_clean":"2024-02-10T08:19:20.315775+0000","last_became_active":"2024-02-10T08:19:31.806315+0000","last_became_peered":"2024-02-10T08:19:31.806315+0000","last_unstale":"2024-02-10T08:20:10.773294+0000","last_undegraded":"2024-02-10T08:20:10.773294+0000","last_fullsized":"2024-02-10T08:19:31.802270+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:45.379932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:45.379932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":["5","3"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":63,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-02-10T08:20:10.753133+0000","last_change":"2024-02-10T08:19:31.148600+0000","last_active":"2024-02-10T08:20:10.753133+0000","last_peered":"2024-02-10T08:20:10.753133+0000","last_clean":"2024-02-10T08:20:10.753133+0000","last_became_active":"2024-02-10T08:16:52.788195+0000","last_became_peered":"2024-02-10T08:16:52.788195+0000","last_unstale":"2024-02-10T08:20:10.753133+0000","last_undegraded":"2024-02-10T08:20:10.753133+0000","last_fullsized":"2024-02-10T08:20:10.753133+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:31.148535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:19:31.148535+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":62,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-02-10T08:20:10.772473+0000","last_change":"2024-02-10T08:19:34.283969+0000","last_active":"2024-02-10T08:20:10.772473+0000","last_peered":"2024-02-10T08:20:10.772473+0000","last_clean":"2024-02-10T08:20:10.772473+0000","last_became_active":"2024-02-10T08:16:52.788767+0000","last_became_peered":"2024-02-10T08:16:52.788767+0000","last_unstale":"2024-02-10T08:20:10.772473+0000","last_undegraded":"2024-02-10T08:20:10.772473+0000","last_fullsized":"2024-02-10T08:20:10.772473+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:34.283900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:19:34.283900+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":73,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-02-10T08:20:10.737423+0000","last_change":"2024-02-10T08:20:06.252519+0000","last_active":"2024-02-10T08:20:10.737423+0000","last_peered":"2024-02-10T08:20:10.737423+0000","last_clean":"2024-02-10T08:20:10.737423+0000","last_became_active":"2024-02-10T08:16:46.402267+0000","last_became_peered":"2024-02-10T08:16:46.402267+0000","last_unstale":"2024-02-10T08:20:10.737423+0000","last_undegraded":"2024-02-10T08:20:10.737423+0000","last_fullsized":"2024-02-10T08:20:10.737423+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:06.252449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:14:44.584370+0000","last_clean_scrub_stamp":"2024-02-10T08:20:06.252449+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"62'14","reported_seq":83,"reported_epoch":98,"state":"active+undersized+degraded","last_fresh":"2024-02-10T08:20:10.748494+0000","last_change":"2024-02-10T08:19:31.810456+0000","last_active":"2024-02-10T08:20:10.748494+0000","last_peered":"2024-02-10T08:20:10.748494+0000","last_clean":"2024-02-10T08:19:20.223879+0000","last_became_active":"2024-02-10T08:19:31.810456+0000","last_became_peered":"2024-02-10T08:19:31.810456+0000","last_unstale":"2024-02-10T08:20:10.748494+0000","last_undegraded":"2024-02-10T08:19:31.803707+0000","last_fullsized":"2024-02-10T08:19:31.803590+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'14","last_scrub_stamp":"2024-02-10T08:18:33.416365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:33.416365+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":7,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":15,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":["6","7"],"object_location_counts":[{"shards":"6,7","objects":7}],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":58,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-02-10T08:20:10.738241+0000","last_change":"2024-02-10T08:19:34.226328+0000","last_active":"2024-02-10T08:20:10.738241+0000","last_peered":"2024-02-10T08:20:10.738241+0000","last_clean":"2024-02-10T08:20:10.738241+0000","last_became_active":"2024-02-10T08:16:56.867159+0000","last_became_peered":"2024-02-10T08:16:56.867159+0000","last_unstale":"2024-02-10T08:20:10.738241+0000","last_undegraded":"2024-02-10T08:20:10.738241+0000","last_fullsized":"2024-02-10T08:20:10.738241+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:34.226262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:04.766780+0000","last_clean_scrub_stamp":"2024-02-10T08:19:34.226262+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"99'3131","reported_seq":3147,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-02-10T08:20:17.445301+0000","last_change":"2024-02-10T08:19:39.841394+0000","last_active":"2024-02-10T08:20:17.445301+0000","last_peered":"2024-02-10T08:20:17.445301+0000","last_clean":"2024-02-10T08:20:17.445301+0000","last_became_active":"2024-02-10T08:19:39.841073+0000","last_became_peered":"2024-02-10T08:19:39.841073+0000","last_unstale":"2024-02-10T08:20:17.445301+0000","last_undegraded":"2024-02-10T08:20:17.445301+0000","last_fullsized":"2024-02-10T08:20:17.445301+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_clean_scrub_stamp":"2024-02-10T08:19:38.813165+0000","log_size":3131,"ondisk_log_size":3131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":205193216,"num_objects":3131,"num_object_clones":0,"num_object_copies":9393,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3131,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3131,"num_write_kb":200384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,0],"acting":[7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":57,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-02-10T08:20:10.770897+0000","last_change":"2024-02-10T08:20:09.785179+0000","last_active":"2024-02-10T08:20:10.770897+0000","last_peered":"2024-02-10T08:20:10.770897+0000","last_clean":"2024-02-10T08:20:10.770897+0000","last_became_active":"2024-02-10T08:16:58.867593+0000","last_became_peered":"2024-02-10T08:16:58.867593+0000","last_unstale":"2024-02-10T08:20:10.770897+0000","last_undegraded":"2024-02-10T08:20:10.770897+0000","last_fullsized":"2024-02-10T08:20:10.770897+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:09.785096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:20:09.785096+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":65,"reported_epoch":98,"state":"active+undersized","last_fresh":"2024-02-10T08:20:10.746463+0000","last_change":"2024-02-10T08:19:31.817270+0000","last_active":"2024-02-10T08:20:10.746463+0000","last_peered":"2024-02-10T08:20:10.746463+0000","last_clean":"2024-02-10T08:19:20.315215+0000","last_became_active":"2024-02-10T08:19:31.817270+0000","last_became_peered":"2024-02-10T08:19:31.817270+0000","last_unstale":"2024-02-10T08:20:10.746463+0000","last_undegraded":"2024-02-10T08:20:10.746463+0000","last_fullsized":"2024-02-10T08:19:31.808861+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:20.736224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:20.736224+0000","last_clean_scrub_stamp":"2024-02-10T08:18:20.736224+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":["0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":62,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-02-10T08:20:12.387549+0000","last_change":"2024-02-10T08:20:12.387549+0000","last_active":"2024-02-10T08:20:12.387549+0000","last_peered":"2024-02-10T08:20:12.387549+0000","last_clean":"2024-02-10T08:20:12.387549+0000","last_became_active":"2024-02-10T08:16:52.787180+0000","last_became_peered":"2024-02-10T08:16:52.787180+0000","last_unstale":"2024-02-10T08:20:12.387549+0000","last_undegraded":"2024-02-10T08:20:12.387549+0000","last_fullsized":"2024-02-10T08:20:12.387549+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:12.387482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:20:12.387482+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"62'12","reported_seq":78,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-02-10T08:20:10.747216+0000","last_change":"2024-02-10T08:20:04.883379+0000","last_active":"2024-02-10T08:20:10.747216+0000","last_peered":"2024-02-10T08:20:10.747216+0000","last_clean":"2024-02-10T08:20:10.747216+0000","last_became_active":"2024-02-10T08:16:54.853330+0000","last_became_peered":"2024-02-10T08:16:54.853330+0000","last_unstale":"2024-02-10T08:20:10.747216+0000","last_undegraded":"2024-02-10T08:20:10.747216+0000","last_fullsized":"2024-02-10T08:20:10.747216+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'12","last_scrub_stamp":"2024-02-10T08:20:04.883293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:20:04.883293+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":58,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-02-10T08:20:10.773202+0000","last_change":"2024-02-10T08:20:08.318643+0000","last_active":"2024-02-10T08:20:10.773202+0000","last_peered":"2024-02-10T08:20:10.773202+0000","last_clean":"2024-02-10T08:20:10.773202+0000","last_became_active":"2024-02-10T08:16:56.864030+0000","last_became_peered":"2024-02-10T08:16:56.864030+0000","last_unstale":"2024-02-10T08:20:10.773202+0000","last_undegraded":"2024-02-10T08:20:10.773202+0000","last_fullsized":"2024-02-10T08:20:10.773202+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:08.318570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:41.360241+0000","last_clean_scrub_stamp":"2024-02-10T08:20:08.318570+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.0","version":"99'3101","reported_seq":3117,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-02-10T08:20:17.438892+0000","last_change":"2024-02-10T08:19:39.828087+0000","last_active":"2024-02-10T08:20:17.438892+0000","last_peered":"2024-02-10T08:20:17.438892+0000","last_clean":"2024-02-10T08:20:17.438892+0000","last_became_active":"2024-02-10T08:19:39.827835+0000","last_became_peered":"2024-02-10T08:19:39.827835+0000","last_unstale":"2024-02-10T08:20:17.438892+0000","last_undegraded":"2024-02-10T08:20:17.438892+0000","last_fullsized":"2024-02-10T08:20:17.438892+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_clean_scrub_stamp":"2024-02-10T08:19:38.813165+0000","log_size":3101,"ondisk_log_size":3101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":203227136,"num_objects":3101,"num_object_clones":0,"num_object_copies":9303,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3101,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3101,"num_write_kb":198464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":57,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-02-10T08:20:10.760688+0000","last_change":"2024-02-10T08:19:25.568522+0000","last_active":"2024-02-10T08:20:10.760688+0000","last_peered":"2024-02-10T08:20:10.760688+0000","last_clean":"2024-02-10T08:20:10.760688+0000","last_became_active":"2024-02-10T08:16:58.891287+0000","last_became_peered":"2024-02-10T08:16:58.891287+0000","last_unstale":"2024-02-10T08:20:10.760688+0000","last_undegraded":"2024-02-10T08:20:10.760688+0000","last_fullsized":"2024-02-10T08:20:10.760688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:25.568342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:19:25.568342+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":33,"reported_epoch":98,"state":"active+undersized","last_fresh":"2024-02-10T08:20:10.749837+0000","last_change":"2024-02-10T08:19:31.815175+0000","last_active":"2024-02-10T08:20:10.749837+0000","last_peered":"2024-02-10T08:20:10.749837+0000","last_clean":"2024-02-10T08:19:19.764062+0000","last_became_active":"2024-02-10T08:19:31.815175+0000","last_became_peered":"2024-02-10T08:19:31.815175+0000","last_unstale":"2024-02-10T08:20:10.749837+0000","last_undegraded":"2024-02-10T08:20:10.749837+0000","last_fullsized":"2024-02-10T08:19:31.804698+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:16.912336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:16.912336+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"62'19","reported_seq":96,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-02-10T08:20:10.746441+0000","last_change":"2024-02-10T08:20:01.822882+0000","last_active":"2024-02-10T08:20:10.746441+0000","last_peered":"2024-02-10T08:20:10.746441+0000","last_clean":"2024-02-10T08:20:10.746441+0000","last_became_active":"2024-02-10T08:16:55.203453+0000","last_became_peered":"2024-02-10T08:16:55.203453+0000","last_unstale":"2024-02-10T08:20:10.746441+0000","last_undegraded":"2024-02-10T08:20:10.746441+0000","last_fullsized":"2024-02-10T08:20:10.746441+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'19","last_scrub_stamp":"2024-02-10T08:20:01.822753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:20:01.822753+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":58,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-02-10T08:20:10.748216+0000","last_change":"2024-02-10T08:20:07.350344+0000","last_active":"2024-02-10T08:20:10.748216+0000","last_peered":"2024-02-10T08:20:10.748216+0000","last_clean":"2024-02-10T08:20:10.748216+0000","last_became_active":"2024-02-10T08:16:56.861172+0000","last_became_peered":"2024-02-10T08:16:56.861172+0000","last_unstale":"2024-02-10T08:20:10.748216+0000","last_undegraded":"2024-02-10T08:20:10.748216+0000","last_fullsized":"2024-02-10T08:20:10.748216+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:07.350256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:20:07.350256+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.3","version":"99'3085","reported_seq":3098,"reported_epoch":99,"state":"active+undersized+degraded","last_fresh":"2024-02-10T08:20:17.456235+0000","last_change":"2024-02-10T08:19:50.208013+0000","last_active":"2024-02-10T08:20:17.456235+0000","last_peered":"2024-02-10T08:20:17.456235+0000","last_clean":"2024-02-10T08:19:38.813165+0000","last_became_active":"2024-02-10T08:19:39.842983+0000","last_became_peered":"2024-02-10T08:19:39.842983+0000","last_unstale":"2024-02-10T08:20:17.456235+0000","last_undegraded":"2024-02-10T08:19:50.200713+0000","last_fullsized":"2024-02-10T08:19:39.827174+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_clean_scrub_stamp":"2024-02-10T08:19:38.813165+0000","log_size":3085,"ondisk_log_size":3085,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":202178560,"num_objects":3085,"num_object_clones":0,"num_object_copies":9255,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3085,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3085,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3085,"num_write_kb":197440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[{"shards":"2,3","objects":3085}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":19,"reported_epoch":98,"state":"active+undersized","last_fresh":"2024-02-10T08:20:10.749463+0000","last_change":"2024-02-10T08:19:31.806692+0000","last_active":"2024-02-10T08:20:10.749463+0000","last_peered":"2024-02-10T08:20:10.749463+0000","last_clean":"2024-02-10T08:16:57.845780+0000","last_became_active":"2024-02-10T08:19:31.806692+0000","last_became_peered":"2024-02-10T08:19:31.806692+0000","last_unstale":"2024-02-10T08:20:10.749463+0000","last_undegraded":"2024-02-10T08:20:10.749463+0000","last_fullsized":"2024-02-10T08:19:31.799923+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:22.216312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:19:22.216312+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":64,"reported_epoch":98,"state":"active+undersized","last_fresh":"2024-02-10T08:20:10.759958+0000","last_change":"2024-02-10T08:19:31.816734+0000","last_active":"2024-02-10T08:20:10.759958+0000","last_peered":"2024-02-10T08:20:10.759958+0000","last_clean":"2024-02-10T08:19:20.315647+0000","last_became_active":"2024-02-10T08:19:31.816734+0000","last_became_peered":"2024-02-10T08:19:31.816734+0000","last_unstale":"2024-02-10T08:20:10.759958+0000","last_undegraded":"2024-02-10T08:20:10.759958+0000","last_fullsized":"2024-02-10T08:19:31.807446+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:12.069322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:12.069322+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":["1","6"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"62'18","reported_seq":88,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-02-10T08:20:10.749336+0000","last_change":"2024-02-10T08:18:41.077152+0000","last_active":"2024-02-10T08:20:10.749336+0000","last_peered":"2024-02-10T08:20:10.749336+0000","last_clean":"2024-02-10T08:20:10.749336+0000","last_became_active":"2024-02-10T08:16:55.204981+0000","last_became_peered":"2024-02-10T08:16:55.204981+0000","last_unstale":"2024-02-10T08:20:10.749336+0000","last_undegraded":"2024-02-10T08:20:10.749336+0000","last_fullsized":"2024-02-10T08:20:10.749336+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'18","last_scrub_stamp":"2024-02-10T08:18:41.077080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:41.077080+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":19,"reported_epoch":98,"state":"active+undersized","last_fresh":"2024-02-10T08:20:10.759516+0000","last_change":"2024-02-10T08:19:31.812540+0000","last_active":"2024-02-10T08:20:10.759516+0000","last_peered":"2024-02-10T08:20:10.759516+0000","last_clean":"2024-02-10T08:16:55.840727+0000","last_became_active":"2024-02-10T08:19:31.812540+0000","last_became_peered":"2024-02-10T08:19:31.812540+0000","last_unstale":"2024-02-10T08:20:10.759516+0000","last_undegraded":"2024-02-10T08:20:10.759516+0000","last_fullsized":"2024-02-10T08:19:31.802800+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:15.979973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:15.979973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":["3","7"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2","version":"99'3146","reported_seq":3162,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-02-10T08:20:17.446556+0000","last_change":"2024-02-10T08:19:39.844259+0000","last_active":"2024-02-10T08:20:17.446556+0000","last_peered":"2024-02-10T08:20:17.446556+0000","last_clean":"2024-02-10T08:20:17.446556+0000","last_became_active":"2024-02-10T08:19:39.843993+0000","last_became_peered":"2024-02-10T08:19:39.843993+0000","last_unstale":"2024-02-10T08:20:17.446556+0000","last_undegraded":"2024-02-10T08:20:17.446556+0000","last_fullsized":"2024-02-10T08:20:17.446556+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_clean_scrub_stamp":"2024-02-10T08:19:38.813165+0000","log_size":3146,"ondisk_log_size":3146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":206176256,"num_objects":3146,"num_object_clones":0,"num_object_copies":9438,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3146,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3146,"num_write_kb":201344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":51,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-02-10T08:20:10.738136+0000","last_change":"2024-02-10T08:18:15.893937+0000","last_active":"2024-02-10T08:20:10.738136+0000","last_peered":"2024-02-10T08:20:10.738136+0000","last_clean":"2024-02-10T08:20:10.738136+0000","last_became_active":"2024-02-10T08:16:58.893253+0000","last_became_peered":"2024-02-10T08:16:58.893253+0000","last_unstale":"2024-02-10T08:20:10.738136+0000","last_undegraded":"2024-02-10T08:20:10.738136+0000","last_fullsized":"2024-02-10T08:20:10.738136+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:15.893858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:15.893858+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":62,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-02-10T08:20:10.748546+0000","last_change":"2024-02-10T08:20:03.392639+0000","last_active":"2024-02-10T08:20:10.748546+0000","last_peered":"2024-02-10T08:20:10.748546+0000","last_clean":"2024-02-10T08:20:10.748546+0000","last_became_active":"2024-02-10T08:16:52.789020+0000","last_became_peered":"2024-02-10T08:16:52.789020+0000","last_unstale":"2024-02-10T08:20:10.748546+0000","last_undegraded":"2024-02-10T08:20:10.748546+0000","last_fullsized":"2024-02-10T08:20:10.748546+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:03.392561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:20:03.392561+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"62'14","reported_seq":52,"reported_epoch":98,"state":"active+undersized+degraded","last_fresh":"2024-02-10T08:20:10.772537+0000","last_change":"2024-02-10T08:19:31.806246+0000","last_active":"2024-02-10T08:20:10.772537+0000","last_peered":"2024-02-10T08:20:10.772537+0000","last_clean":"2024-02-10T08:17:00.217241+0000","last_became_active":"2024-02-10T08:19:31.806246+0000","last_became_peered":"2024-02-10T08:19:31.806246+0000","last_unstale":"2024-02-10T08:20:10.772537+0000","last_undegraded":"2024-02-10T08:19:31.801028+0000","last_fullsized":"2024-02-10T08:19:31.800896+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'14","last_scrub_stamp":"2024-02-10T08:18:10.980421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:10.980421+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":7,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":["5","6"],"object_location_counts":[{"shards":"5,6","objects":7}],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.0","version":"89'9","reported_seq":110,"reported_epoch":99,"state":"active+undersized+degraded","last_fresh":"2024-02-10T08:20:11.751465+0000","last_change":"2024-02-10T08:19:31.805513+0000","last_active":"2024-02-10T08:20:11.751465+0000","last_peered":"2024-02-10T08:20:11.751465+0000","last_clean":"2024-02-10T08:19:25.927456+0000","last_became_active":"2024-02-10T08:19:31.805513+0000","last_became_peered":"2024-02-10T08:19:31.805513+0000","last_unstale":"2024-02-10T08:20:11.751465+0000","last_undegraded":"2024-02-10T08:19:31.799988+0000","last_fullsized":"2024-02-10T08:19:31.799838+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'8","last_scrub_stamp":"2024-02-10T08:18:30.090065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:30.090065+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[{"shards":"1,3","objects":1}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"99'3173","reported_seq":3189,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-02-10T08:20:17.459422+0000","last_change":"2024-02-10T08:19:39.826713+0000","last_active":"2024-02-10T08:20:17.459422+0000","last_peered":"2024-02-10T08:20:17.459422+0000","last_clean":"2024-02-10T08:20:17.459422+0000","last_became_active":"2024-02-10T08:19:39.826451+0000","last_became_peered":"2024-02-10T08:19:39.826451+0000","last_unstale":"2024-02-10T08:20:17.459422+0000","last_undegraded":"2024-02-10T08:20:17.459422+0000","last_fullsized":"2024-02-10T08:20:17.459422+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_clean_scrub_stamp":"2024-02-10T08:19:38.813165+0000","log_size":3173,"ondisk_log_size":3173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":207945728,"num_objects":3173,"num_object_clones":0,"num_object_copies":9519,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3173,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3173,"num_write_kb":203072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,0],"acting":[6,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":52,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-02-10T08:20:10.761043+0000","last_change":"2024-02-10T08:18:56.053946+0000","last_active":"2024-02-10T08:20:10.761043+0000","last_peered":"2024-02-10T08:20:10.761043+0000","last_clean":"2024-02-10T08:20:10.761043+0000","last_became_active":"2024-02-10T08:16:58.891261+0000","last_became_peered":"2024-02-10T08:16:58.891261+0000","last_unstale":"2024-02-10T08:20:10.761043+0000","last_undegraded":"2024-02-10T08:20:10.761043+0000","last_fullsized":"2024-02-10T08:20:10.761043+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:56.053817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:56.053817+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":59,"reported_epoch":98,"state":"active+undersized","last_fresh":"2024-02-10T08:20:10.773206+0000","last_change":"2024-02-10T08:19:31.806641+0000","last_active":"2024-02-10T08:20:10.773206+0000","last_peered":"2024-02-10T08:20:10.773206+0000","last_clean":"2024-02-10T08:19:20.315713+0000","last_became_active":"2024-02-10T08:19:31.806641+0000","last_became_peered":"2024-02-10T08:19:31.806641+0000","last_unstale":"2024-02-10T08:20:10.773206+0000","last_undegraded":"2024-02-10T08:20:10.773206+0000","last_fullsized":"2024-02-10T08:19:31.801929+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:25.442097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:25.442097+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":["5","6"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":62,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-02-10T08:20:10.737452+0000","last_change":"2024-02-10T08:20:01.263757+0000","last_active":"2024-02-10T08:20:10.737452+0000","last_peered":"2024-02-10T08:20:10.737452+0000","last_clean":"2024-02-10T08:20:10.737452+0000","last_became_active":"2024-02-10T08:16:52.786822+0000","last_became_peered":"2024-02-10T08:16:52.786822+0000","last_unstale":"2024-02-10T08:20:10.737452+0000","last_undegraded":"2024-02-10T08:20:10.737452+0000","last_fullsized":"2024-02-10T08:20:10.737452+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:01.263661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:20:01.263661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"76'16","reported_seq":67,"reported_epoch":98,"state":"active+undersized+degraded","last_fresh":"2024-02-10T08:20:10.748415+0000","last_change":"2024-02-10T08:19:31.811276+0000","last_active":"2024-02-10T08:20:10.748415+0000","last_peered":"2024-02-10T08:20:10.748415+0000","last_clean":"2024-02-10T08:18:07.904000+0000","last_became_active":"2024-02-10T08:19:31.811276+0000","last_became_peered":"2024-02-10T08:19:31.811276+0000","last_unstale":"2024-02-10T08:20:10.748415+0000","last_undegraded":"2024-02-10T08:19:31.804286+0000","last_fullsized":"2024-02-10T08:19:31.804169+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'16","last_scrub_stamp":"2024-02-10T08:19:24.195140+0000","last_deep_scrub":"76'16","last_deep_scrub_stamp":"2024-02-10T08:18:07.909782+0000","last_clean_scrub_stamp":"2024-02-10T08:19:24.195140+0000","log_size":16,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":5,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":["6","1"],"object_location_counts":[{"shards":"1,6","objects":5}],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.c","version":"99'3222","reported_seq":3238,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-02-10T08:20:17.414541+0000","last_change":"2024-02-10T08:19:39.830160+0000","last_active":"2024-02-10T08:20:17.414541+0000","last_peered":"2024-02-10T08:20:17.414541+0000","last_clean":"2024-02-10T08:20:17.414541+0000","last_became_active":"2024-02-10T08:19:39.829875+0000","last_became_peered":"2024-02-10T08:19:39.829875+0000","last_unstale":"2024-02-10T08:20:17.414541+0000","last_undegraded":"2024-02-10T08:20:17.414541+0000","last_fullsized":"2024-02-10T08:20:17.414541+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_clean_scrub_stamp":"2024-02-10T08:19:38.813165+0000","log_size":3222,"ondisk_log_size":3222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":211156992,"num_objects":3222,"num_object_clones":0,"num_object_copies":9666,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3222,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3222,"num_write_kb":206208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":56,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-02-10T08:20:10.772832+0000","last_change":"2024-02-10T08:20:03.250648+0000","last_active":"2024-02-10T08:20:10.772832+0000","last_peered":"2024-02-10T08:20:10.772832+0000","last_clean":"2024-02-10T08:20:10.772832+0000","last_became_active":"2024-02-10T08:16:58.859956+0000","last_became_peered":"2024-02-10T08:16:58.859956+0000","last_unstale":"2024-02-10T08:20:10.772832+0000","last_undegraded":"2024-02-10T08:20:10.772832+0000","last_fullsized":"2024-02-10T08:20:10.772832+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:03.250587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:20:03.250587+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"89'9","reported_seq":49,"reported_epoch":99,"state":"active+undersized+degraded","last_fresh":"2024-02-10T08:20:11.748855+0000","last_change":"2024-02-10T08:19:31.813607+0000","last_active":"2024-02-10T08:20:11.748855+0000","last_peered":"2024-02-10T08:20:11.748855+0000","last_clean":"2024-02-10T08:16:59.974619+0000","last_became_active":"2024-02-10T08:19:31.813607+0000","last_became_peered":"2024-02-10T08:19:31.813607+0000","last_unstale":"2024-02-10T08:20:11.748855+0000","last_undegraded":"2024-02-10T08:19:31.801530+0000","last_fullsized":"2024-02-10T08:19:31.801324+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'8","last_scrub_stamp":"2024-02-10T08:18:28.991446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:28.991446+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":["5","0"],"object_location_counts":[{"shards":"0,5","objects":1}],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":63,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-02-10T08:20:10.760538+0000","last_change":"2024-02-10T08:20:04.745454+0000","last_active":"2024-02-10T08:20:10.760538+0000","last_peered":"2024-02-10T08:20:10.760538+0000","last_clean":"2024-02-10T08:20:10.760538+0000","last_became_active":"2024-02-10T08:16:52.783634+0000","last_became_peered":"2024-02-10T08:16:52.783634+0000","last_unstale":"2024-02-10T08:20:10.760538+0000","last_undegraded":"2024-02-10T08:20:10.760538+0000","last_fullsized":"2024-02-10T08:20:10.760538+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:04.745360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:20:04.745360+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"62'15","reported_seq":54,"reported_epoch":98,"state":"active+undersized+degraded","last_fresh":"2024-02-10T08:20:10.749233+0000","last_change":"2024-02-10T08:19:31.812053+0000","last_active":"2024-02-10T08:20:10.749233+0000","last_peered":"2024-02-10T08:20:10.749233+0000","last_clean":"2024-02-10T08:19:19.763425+0000","last_became_active":"2024-02-10T08:19:31.812053+0000","last_became_peered":"2024-02-10T08:19:31.812053+0000","last_unstale":"2024-02-10T08:20:10.749233+0000","last_undegraded":"2024-02-10T08:19:31.804195+0000","last_fullsized":"2024-02-10T08:19:31.804129+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'15","last_scrub_stamp":"2024-02-10T08:18:19.720164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:19.720164+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":7,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":["2","3"],"object_location_counts":[{"shards":"2,3","objects":7}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"99'3107","reported_seq":3123,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-02-10T08:20:17.443946+0000","last_change":"2024-02-10T08:19:39.833126+0000","last_active":"2024-02-10T08:20:17.443946+0000","last_peered":"2024-02-10T08:20:17.443946+0000","last_clean":"2024-02-10T08:20:17.443946+0000","last_became_active":"2024-02-10T08:19:39.832691+0000","last_became_peered":"2024-02-10T08:19:39.832691+0000","last_unstale":"2024-02-10T08:20:17.443946+0000","last_undegraded":"2024-02-10T08:20:17.443946+0000","last_fullsized":"2024-02-10T08:20:17.443946+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_clean_scrub_stamp":"2024-02-10T08:19:38.813165+0000","log_size":3107,"ondisk_log_size":3107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":203620352,"num_objects":3107,"num_object_clones":0,"num_object_copies":9321,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3107,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3107,"num_write_kb":198848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":19,"reported_epoch":98,"state":"active+undersized","last_fresh":"2024-02-10T08:20:10.759634+0000","last_change":"2024-02-10T08:19:31.809140+0000","last_active":"2024-02-10T08:20:10.759634+0000","last_peered":"2024-02-10T08:20:10.759634+0000","last_clean":"2024-02-10T08:16:57.845780+0000","last_became_active":"2024-02-10T08:19:31.809140+0000","last_became_peered":"2024-02-10T08:19:31.809140+0000","last_unstale":"2024-02-10T08:20:10.759634+0000","last_undegraded":"2024-02-10T08:20:10.759634+0000","last_fullsized":"2024-02-10T08:19:31.805141+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:17:59.857977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:17:59.857977+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"62'8","reported_seq":108,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-02-10T08:20:11.754767+0000","last_change":"2024-02-10T08:19:24.859730+0000","last_active":"2024-02-10T08:20:11.754767+0000","last_peered":"2024-02-10T08:20:11.754767+0000","last_clean":"2024-02-10T08:20:11.754767+0000","last_became_active":"2024-02-10T08:16:56.858101+0000","last_became_peered":"2024-02-10T08:16:56.858101+0000","last_unstale":"2024-02-10T08:20:11.754767+0000","last_undegraded":"2024-02-10T08:20:11.754767+0000","last_fullsized":"2024-02-10T08:20:11.754767+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'8","last_scrub_stamp":"2024-02-10T08:19:24.859657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:19:24.859657+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":63,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-02-10T08:20:10.764583+0000","last_change":"2024-02-10T08:19:31.561674+0000","last_active":"2024-02-10T08:20:10.764583+0000","last_peered":"2024-02-10T08:20:10.764583+0000","last_clean":"2024-02-10T08:20:10.764583+0000","last_became_active":"2024-02-10T08:16:52.785545+0000","last_became_peered":"2024-02-10T08:16:52.785545+0000","last_unstale":"2024-02-10T08:20:10.764583+0000","last_undegraded":"2024-02-10T08:20:10.764583+0000","last_fullsized":"2024-02-10T08:20:10.764583+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:31.561534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:19:31.561534+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"62'10","reported_seq":46,"reported_epoch":98,"state":"active+undersized+degraded","last_fresh":"2024-02-10T08:20:10.761573+0000","last_change":"2024-02-10T08:19:31.812782+0000","last_active":"2024-02-10T08:20:10.761573+0000","last_peered":"2024-02-10T08:20:10.761573+0000","last_clean":"2024-02-10T08:17:00.170472+0000","last_became_active":"2024-02-10T08:19:31.812782+0000","last_became_peered":"2024-02-10T08:19:31.812782+0000","last_unstale":"2024-02-10T08:20:10.761573+0000","last_undegraded":"2024-02-10T08:19:31.800710+0000","last_fullsized":"2024-02-10T08:19:31.800594+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'10","last_scrub_stamp":"2024-02-10T08:19:16.196834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:19:16.196834+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":5,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":["3","6"],"object_location_counts":[{"shards":"3,6","objects":5}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"99'3113","reported_seq":3129,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-02-10T08:20:17.424487+0000","last_change":"2024-02-10T08:19:39.847131+0000","last_active":"2024-02-10T08:20:17.424487+0000","last_peered":"2024-02-10T08:20:17.424487+0000","last_clean":"2024-02-10T08:20:17.424487+0000","last_became_active":"2024-02-10T08:19:39.846850+0000","last_became_peered":"2024-02-10T08:19:39.846850+0000","last_unstale":"2024-02-10T08:20:17.424487+0000","last_undegraded":"2024-02-10T08:20:17.424487+0000","last_fullsized":"2024-02-10T08:20:17.424487+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_clean_scrub_stamp":"2024-02-10T08:19:38.813165+0000","log_size":3113,"ondisk_log_size":3113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":204013568,"num_objects":3113,"num_object_clones":0,"num_object_copies":9339,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3113,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3113,"num_write_kb":199232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":58,"reported_epoch":98,"state":"active+undersized","last_fresh":"2024-02-10T08:20:10.749506+0000","last_change":"2024-02-10T08:19:31.812424+0000","last_active":"2024-02-10T08:20:10.749506+0000","last_peered":"2024-02-10T08:20:10.749506+0000","last_clean":"2024-02-10T08:19:19.763551+0000","last_became_active":"2024-02-10T08:19:31.812424+0000","last_became_peered":"2024-02-10T08:19:31.812424+0000","last_unstale":"2024-02-10T08:20:10.749506+0000","last_undegraded":"2024-02-10T08:20:10.749506+0000","last_fullsized":"2024-02-10T08:19:31.804330+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:17.709697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:17.709697+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":["2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":60,"reported_epoch":98,"state":"active+undersized","last_fresh":"2024-02-10T08:20:10.770774+0000","last_change":"2024-02-10T08:19:31.809891+0000","last_active":"2024-02-10T08:20:10.770774+0000","last_peered":"2024-02-10T08:20:10.770774+0000","last_clean":"2024-02-10T08:19:20.316023+0000","last_became_active":"2024-02-10T08:19:31.809891+0000","last_became_peered":"2024-02-10T08:19:31.809891+0000","last_unstale":"2024-02-10T08:20:10.770774+0000","last_undegraded":"2024-02-10T08:20:10.770774+0000","last_fullsized":"2024-02-10T08:19:31.805631+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:37.273476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:37.273476+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":68,"reported_epoch":98,"state":"active+undersized","last_fresh":"2024-02-10T08:20:10.737879+0000","last_change":"2024-02-10T08:19:31.808617+0000","last_active":"2024-02-10T08:20:10.737879+0000","last_peered":"2024-02-10T08:20:10.737879+0000","last_clean":"2024-02-10T08:19:22.228173+0000","last_became_active":"2024-02-10T08:19:31.808617+0000","last_became_peered":"2024-02-10T08:19:31.808617+0000","last_unstale":"2024-02-10T08:20:10.737879+0000","last_undegraded":"2024-02-10T08:20:10.737879+0000","last_fullsized":"2024-02-10T08:19:31.803045+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:22.228064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:19:22.228064+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":["7","5"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"62'17","reported_seq":59,"reported_epoch":98,"state":"active+undersized+degraded","last_fresh":"2024-02-10T08:20:10.750114+0000","last_change":"2024-02-10T08:19:31.807387+0000","last_active":"2024-02-10T08:20:10.750114+0000","last_peered":"2024-02-10T08:20:10.750114+0000","last_clean":"2024-02-10T08:17:00.210340+0000","last_became_active":"2024-02-10T08:19:31.807387+0000","last_became_peered":"2024-02-10T08:19:31.807387+0000","last_unstale":"2024-02-10T08:20:10.750114+0000","last_undegraded":"2024-02-10T08:19:31.802925+0000","last_fullsized":"2024-02-10T08:19:31.802798+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'17","last_scrub_stamp":"2024-02-10T08:19:26.245091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:19:26.245091+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":8,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":28,"num_read_kb":18,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":["2","5"],"object_location_counts":[{"shards":"2,5","objects":8}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.9","version":"99'3151","reported_seq":3164,"reported_epoch":99,"state":"active+undersized+degraded","last_fresh":"2024-02-10T08:20:17.438898+0000","last_change":"2024-02-10T08:19:50.204617+0000","last_active":"2024-02-10T08:20:17.438898+0000","last_peered":"2024-02-10T08:20:17.438898+0000","last_clean":"2024-02-10T08:19:38.813165+0000","last_became_active":"2024-02-10T08:19:39.822674+0000","last_became_peered":"2024-02-10T08:19:39.822674+0000","last_unstale":"2024-02-10T08:20:17.438898+0000","last_undegraded":"2024-02-10T08:19:50.200771+0000","last_fullsized":"2024-02-10T08:19:39.819592+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_clean_scrub_stamp":"2024-02-10T08:19:38.813165+0000","log_size":3151,"ondisk_log_size":3151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":206503936,"num_objects":3151,"num_object_clones":0,"num_object_copies":9453,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3151,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3151,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3151,"num_write_kb":201664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0,1","objects":3151}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":56,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-02-10T08:20:10.737339+0000","last_change":"2024-02-10T08:19:24.200005+0000","last_active":"2024-02-10T08:20:10.737339+0000","last_peered":"2024-02-10T08:20:10.737339+0000","last_clean":"2024-02-10T08:20:10.737339+0000","last_became_active":"2024-02-10T08:16:58.866831+0000","last_became_peered":"2024-02-10T08:16:58.866831+0000","last_unstale":"2024-02-10T08:20:10.737339+0000","last_undegraded":"2024-02-10T08:20:10.737339+0000","last_fullsized":"2024-02-10T08:20:10.737339+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:24.199920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:19:24.199920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":59,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-02-10T08:20:10.751696+0000","last_change":"2024-02-10T08:19:30.942724+0000","last_active":"2024-02-10T08:20:10.751696+0000","last_peered":"2024-02-10T08:20:10.751696+0000","last_clean":"2024-02-10T08:20:10.751696+0000","last_became_active":"2024-02-10T08:16:56.864026+0000","last_became_peered":"2024-02-10T08:16:56.864026+0000","last_unstale":"2024-02-10T08:20:10.751696+0000","last_undegraded":"2024-02-10T08:20:10.751696+0000","last_fullsized":"2024-02-10T08:20:10.751696+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:30.942646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:19:30.942646+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":63,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-02-10T08:20:10.748896+0000","last_change":"2024-02-10T08:19:09.892412+0000","last_active":"2024-02-10T08:20:10.748896+0000","last_peered":"2024-02-10T08:20:10.748896+0000","last_clean":"2024-02-10T08:20:10.748896+0000","last_became_active":"2024-02-10T08:16:52.789100+0000","last_became_peered":"2024-02-10T08:16:52.789100+0000","last_unstale":"2024-02-10T08:20:10.748896+0000","last_undegraded":"2024-02-10T08:20:10.748896+0000","last_fullsized":"2024-02-10T08:20:10.748896+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:09.892334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:19:09.892334+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"62'19","reported_seq":91,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-02-10T08:20:10.748112+0000","last_change":"2024-02-10T08:20:01.351638+0000","last_active":"2024-02-10T08:20:10.748112+0000","last_peered":"2024-02-10T08:20:10.748112+0000","last_clean":"2024-02-10T08:20:10.748112+0000","last_became_active":"2024-02-10T08:16:55.203415+0000","last_became_peered":"2024-02-10T08:16:55.203415+0000","last_unstale":"2024-02-10T08:20:10.748112+0000","last_undegraded":"2024-02-10T08:20:10.748112+0000","last_fullsized":"2024-02-10T08:20:10.748112+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'19","last_scrub_stamp":"2024-02-10T08:20:01.351573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:20:01.351573+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.8","version":"99'3084","reported_seq":3097,"reported_epoch":99,"state":"active+undersized+degraded","last_fresh":"2024-02-10T08:20:17.459673+0000","last_change":"2024-02-10T08:19:50.205481+0000","last_active":"2024-02-10T08:20:17.459673+0000","last_peered":"2024-02-10T08:20:17.459673+0000","last_clean":"2024-02-10T08:19:38.813165+0000","last_became_active":"2024-02-10T08:19:39.841045+0000","last_became_peered":"2024-02-10T08:19:39.841045+0000","last_unstale":"2024-02-10T08:20:17.459673+0000","last_undegraded":"2024-02-10T08:19:50.204062+0000","last_fullsized":"2024-02-10T08:19:39.833747+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_clean_scrub_stamp":"2024-02-10T08:19:38.813165+0000","log_size":3084,"ondisk_log_size":3084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":202113024,"num_objects":3084,"num_object_clones":0,"num_object_copies":9252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3084,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3084,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3084,"num_write_kb":197376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":["2","7"],"object_location_counts":[{"shards":"2,7","objects":3084}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"76'2","reported_seq":58,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-02-10T08:20:10.746677+0000","last_change":"2024-02-10T08:19:28.458200+0000","last_active":"2024-02-10T08:20:10.746677+0000","last_peered":"2024-02-10T08:20:10.746677+0000","last_clean":"2024-02-10T08:20:10.746677+0000","last_became_active":"2024-02-10T08:16:58.860294+0000","last_became_peered":"2024-02-10T08:16:58.860294+0000","last_unstale":"2024-02-10T08:20:10.746677+0000","last_undegraded":"2024-02-10T08:20:10.746677+0000","last_fullsized":"2024-02-10T08:20:10.746677+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'2","last_scrub_stamp":"2024-02-10T08:19:28.458129+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2024-02-10T08:18:08.680038+0000","last_clean_scrub_stamp":"2024-02-10T08:19:28.458129+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":60,"reported_epoch":98,"state":"active+undersized","last_fresh":"2024-02-10T08:20:10.748719+0000","last_change":"2024-02-10T08:19:31.811571+0000","last_active":"2024-02-10T08:20:10.748719+0000","last_peered":"2024-02-10T08:20:10.748719+0000","last_clean":"2024-02-10T08:19:19.763447+0000","last_became_active":"2024-02-10T08:19:31.811571+0000","last_became_peered":"2024-02-10T08:19:31.811571+0000","last_unstale":"2024-02-10T08:20:10.748719+0000","last_undegraded":"2024-02-10T08:20:10.748719+0000","last_fullsized":"2024-02-10T08:19:31.802256+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:27.611094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:27.611094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":["2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":69,"reported_epoch":98,"state":"active+undersized","last_fresh":"2024-02-10T08:20:10.760923+0000","last_change":"2024-02-10T08:19:31.816876+0000","last_active":"2024-02-10T08:20:10.760923+0000","last_peered":"2024-02-10T08:20:10.760923+0000","last_clean":"2024-02-10T08:19:21.523190+0000","last_became_active":"2024-02-10T08:19:31.816876+0000","last_became_peered":"2024-02-10T08:19:31.816876+0000","last_unstale":"2024-02-10T08:20:10.760923+0000","last_undegraded":"2024-02-10T08:20:10.760923+0000","last_fullsized":"2024-02-10T08:19:31.806174+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:21.523096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:21.523096+0000","last_clean_scrub_stamp":"2024-02-10T08:19:21.523096+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"62'9","reported_seq":77,"reported_epoch":98,"state":"active+undersized+degraded","last_fresh":"2024-02-10T08:20:10.746818+0000","last_change":"2024-02-10T08:19:31.815655+0000","last_active":"2024-02-10T08:20:10.746818+0000","last_peered":"2024-02-10T08:20:10.746818+0000","last_clean":"2024-02-10T08:19:20.315590+0000","last_became_active":"2024-02-10T08:19:31.815655+0000","last_became_peered":"2024-02-10T08:19:31.815655+0000","last_unstale":"2024-02-10T08:20:10.746818+0000","last_undegraded":"2024-02-10T08:19:31.809167+0000","last_fullsized":"2024-02-10T08:19:31.809050+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'9","last_scrub_stamp":"2024-02-10T08:18:14.705229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:14.705229+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":4,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0,1","objects":4}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"99'3143","reported_seq":3159,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-02-10T08:20:17.440363+0000","last_change":"2024-02-10T08:19:39.829202+0000","last_active":"2024-02-10T08:20:17.440363+0000","last_peered":"2024-02-10T08:20:17.440363+0000","last_clean":"2024-02-10T08:20:17.440363+0000","last_became_active":"2024-02-10T08:19:39.828947+0000","last_became_peered":"2024-02-10T08:19:39.828947+0000","last_unstale":"2024-02-10T08:20:17.440363+0000","last_undegraded":"2024-02-10T08:20:17.440363+0000","last_fullsized":"2024-02-10T08:20:17.440363+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_clean_scrub_stamp":"2024-02-10T08:19:38.813165+0000","log_size":3143,"ondisk_log_size":3143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":205979648,"num_objects":3143,"num_object_clones":0,"num_object_copies":9429,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3143,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3143,"num_write_kb":201152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[1,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":56,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-02-10T08:20:10.772331+0000","last_change":"2024-02-10T08:19:20.392327+0000","last_active":"2024-02-10T08:20:10.772331+0000","last_peered":"2024-02-10T08:20:10.772331+0000","last_clean":"2024-02-10T08:20:10.772331+0000","last_became_active":"2024-02-10T08:16:58.891260+0000","last_became_peered":"2024-02-10T08:16:58.891260+0000","last_unstale":"2024-02-10T08:20:10.772331+0000","last_undegraded":"2024-02-10T08:20:10.772331+0000","last_fullsized":"2024-02-10T08:20:10.772331+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:20.392249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:20.392249+0000","last_clean_scrub_stamp":"2024-02-10T08:19:20.392249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":63,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-02-10T08:20:10.751952+0000","last_change":"2024-02-10T08:19:05.814587+0000","last_active":"2024-02-10T08:20:10.751952+0000","last_peered":"2024-02-10T08:20:10.751952+0000","last_clean":"2024-02-10T08:20:10.751952+0000","last_became_active":"2024-02-10T08:16:52.785754+0000","last_became_peered":"2024-02-10T08:16:52.785754+0000","last_unstale":"2024-02-10T08:20:10.751952+0000","last_undegraded":"2024-02-10T08:20:10.751952+0000","last_fullsized":"2024-02-10T08:20:10.751952+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:05.814500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:19:05.814500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"62'15","reported_seq":85,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-02-10T08:20:10.772697+0000","last_change":"2024-02-10T08:20:05.314332+0000","last_active":"2024-02-10T08:20:10.772697+0000","last_peered":"2024-02-10T08:20:10.772697+0000","last_clean":"2024-02-10T08:20:10.772697+0000","last_became_active":"2024-02-10T08:16:55.204597+0000","last_became_peered":"2024-02-10T08:16:55.204597+0000","last_unstale":"2024-02-10T08:20:10.772697+0000","last_undegraded":"2024-02-10T08:20:10.772697+0000","last_fullsized":"2024-02-10T08:20:10.772697+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'15","last_scrub_stamp":"2024-02-10T08:20:05.314225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:20:05.314225+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"89'9","reported_seq":109,"reported_epoch":99,"state":"active+undersized+degraded","last_fresh":"2024-02-10T08:20:11.753632+0000","last_change":"2024-02-10T08:19:31.808702+0000","last_active":"2024-02-10T08:20:11.753632+0000","last_peered":"2024-02-10T08:20:11.753632+0000","last_clean":"2024-02-10T08:19:25.927609+0000","last_became_active":"2024-02-10T08:19:31.808702+0000","last_became_peered":"2024-02-10T08:19:31.808702+0000","last_unstale":"2024-02-10T08:20:11.753632+0000","last_undegraded":"2024-02-10T08:19:31.803640+0000","last_fullsized":"2024-02-10T08:19:31.803529+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'8","last_scrub_stamp":"2024-02-10T08:18:29.052907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:29.052907+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":["7","6"],"object_location_counts":[{"shards":"6,7","objects":1}],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":3280404480,"num_objects":50055,"num_object_clones":0,"num_object_copies":150165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":15626,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50055,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50055,"num_write_kb":3203520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8818851840,"data_stored":8818851840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":50055,"ondisk_log_size":50055,"up":43,"acting":43,"num_store_stats":7},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":86,"acting":86,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":3},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":197,"num_read_kb":192,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":8,"acting":8,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":73,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":691,"num_read_kb":448,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":411,"ondisk_log_size":411,"up":82,"acting":82,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":4,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":70,"ondisk_log_size":70,"up":81,"acting":81,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":84,"acting":84,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":50,"seq":214748364845,"num_pgs":61,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1306276,"kb_used_data":996764,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":92438876,"statfs":{"total":95995035648,"available":94657409024,"internally_reserved":0,"allocated":1020686336,"data_stored":1020297045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,2,3,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:19:50 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.498,"15min":0.495},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.51400000000000001,"15min":0.497},"min":{"1min":0.39700000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.36099999999999999}]},{"osd":1,"last update":"Sat Feb 10 08:19:50 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.51800000000000002,"15min":0.51000000000000001},"min":{"1min":0.29899999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.51800000000000002,"15min":0.51900000000000002},"min":{"1min":0.35199999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.27300000000000002}]},{"osd":2,"last update":"Sat Feb 10 08:19:50 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.503,"15min":0.49299999999999999},"min":{"1min":0.34799999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":3.1909999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.53600000000000003,"15min":0.53100000000000003},"min":{"1min":0.36199999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.72999999999999998,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.66100000000000003}]},{"osd":3,"last update":"Sat Feb 10 08:19:50 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.52700000000000002,"15min":0.52100000000000002},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":1.3879999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.53400000000000003,"15min":0.52400000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.76000000000000001}]},{"osd":4,"last update":"Sat Feb 10 08:18:45 2024","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.40300000000000002,"15min":0.40100000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.56599999999999995,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.433,"15min":0.42999999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.58999999999999997,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.52400000000000002}]},{"osd":5,"last update":"Sat Feb 10 08:19:50 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.44,"15min":0.42099999999999999},"min":{"1min":0.28000000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.627},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.47199999999999998,"15min":0.46200000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.30199999999999999}]},{"osd":6,"last update":"Sat Feb 10 08:19:50 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.47499999999999998,"15min":0.45100000000000001},"min":{"1min":0.32600000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.49199999999999999,"15min":0.47499999999999998},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.86599999999999999}]}]},{"osd":6,"up_from":43,"seq":184683593778,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1323988,"kb_used_data":1014476,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":92421164,"statfs":{"total":95995035648,"available":94639271936,"internally_reserved":0,"allocated":1038823424,"data_stored":1038450477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,2,3,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:19:27 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.53400000000000003,"15min":0.53800000000000003},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.79200000000000004,"5min":0.878,"15min":0.878},"last":0.23200000000000001},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.54700000000000004,"15min":0.55300000000000005},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.67500000000000004,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":4.1200000000000001}]},{"osd":1,"last update":"Sat Feb 10 08:19:27 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.54700000000000004,"15min":0.55100000000000005},"min":{"1min":0.36099999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.74399999999999999,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.54800000000000004,"15min":0.56399999999999995},"min":{"1min":0.34799999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.83999999999999997,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":1.1519999999999999}]},{"osd":2,"last update":"Sat Feb 10 08:19:27 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57099999999999995,"15min":0.57799999999999996},"min":{"1min":0.40600000000000003,"5min":0.378,"15min":0.378},"max":{"1min":0.81699999999999995,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":5.3490000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.57299999999999995,"15min":0.57899999999999996},"min":{"1min":0.33900000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.752,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":5.3630000000000004}]},{"osd":3,"last update":"Sat Feb 10 08:19:27 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56299999999999994,"15min":0.56599999999999995},"min":{"1min":0.38800000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.82899999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":1.4730000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55600000000000005,"15min":0.55800000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.80500000000000005,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":1.6040000000000001}]},{"osd":4,"last update":"Sat Feb 10 08:19:27 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.45500000000000002,"15min":0.44900000000000001},"min":{"1min":0.29699999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.751,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.47799999999999998,"15min":0.46800000000000003},"min":{"1min":0.33500000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.71899999999999997,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.53100000000000003}]},{"osd":5,"last update":"Sat Feb 10 08:19:27 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.47299999999999998,"15min":0.45700000000000002},"min":{"1min":0.432,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.71099999999999997,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.48399999999999999,"15min":0.46200000000000002},"min":{"1min":0.41499999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.41099999999999998}]},{"osd":7,"last update":"Sat Feb 10 08:19:53 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.52100000000000002,"15min":0.52900000000000003},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.71399999999999997,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.501,"5min":0.56399999999999995,"15min":0.57099999999999995},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.73599999999999999,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.436}]}]},{"osd":1,"up_from":13,"seq":55834574921,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1485368,"kb_used_data":1179952,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":92259784,"statfs":{"total":95995035648,"available":94474018816,"internally_reserved":0,"allocated":1208270848,"data_stored":1207861181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:19:24 2024","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.375,"15min":0.32400000000000001},"min":{"1min":0.25,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.223},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.38400000000000001,"15min":0.33600000000000002},"min":{"1min":0.24399999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.52700000000000002,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":5.6749999999999998}]},{"osd":2,"last update":"Sat Feb 10 08:19:54 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.504,"15min":0.40500000000000003},"min":{"1min":0.29299999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":8.2520000000000007,"5min":8.2520000000000007,"15min":8.2520000000000007},"last":2.4249999999999998},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.48499999999999999,"15min":0.40300000000000002},"min":{"1min":0.28499999999999998,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":8.4440000000000008,"5min":8.4440000000000008,"15min":8.4440000000000008},"last":0.56599999999999995}]},{"osd":3,"last update":"Sat Feb 10 08:20:15 2024","interfaces":[{"interface":"back","average":{"1min":1.673,"5min":0.68899999999999995,"15min":0.53700000000000003},"min":{"1min":0.33200000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":9.2319999999999993,"5min":9.2319999999999993,"15min":9.2319999999999993},"last":5.0439999999999996},{"interface":"front","average":{"1min":1.105,"5min":0.55800000000000005,"15min":0.47899999999999998},"min":{"1min":0.23899999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":8.1709999999999994,"5min":8.1709999999999994,"15min":8.1709999999999994},"last":0.48099999999999998}]},{"osd":4,"last update":"Sat Feb 10 08:18:37 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.58599999999999997,"15min":0.59099999999999997},"min":{"1min":0.39200000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.83899999999999997,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.57199999999999995,"15min":0.58199999999999996},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.85099999999999998,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.46899999999999997}]},{"osd":5,"last update":"Sat Feb 10 08:20:03 2024","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.65100000000000002,"15min":0.60099999999999998},"min":{"1min":0.41499999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":8.2240000000000002,"5min":8.2240000000000002,"15min":8.2240000000000002},"last":0.54200000000000004},{"interface":"front","average":{"1min":1.048,"5min":0.69299999999999995,"15min":0.64200000000000002},"min":{"1min":0.39400000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":8.3770000000000007,"5min":8.3770000000000007,"15min":8.3770000000000007},"last":0.38900000000000001}]},{"osd":6,"last update":"Sat Feb 10 08:19:24 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59799999999999998,"15min":0.59599999999999997},"min":{"1min":0.443,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.85199999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.61599999999999999,"15min":0.61699999999999999},"min":{"1min":0.48299999999999998,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.92100000000000004,"5min":0.996,"15min":0.996},"last":0.40100000000000002}]},{"osd":7,"last update":"Sat Feb 10 08:19:50 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.57199999999999995,"15min":0.56499999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.80400000000000005,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.58999999999999997,"15min":0.58799999999999997},"min":{"1min":0.45400000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.70499999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.438}]}]},{"osd":0,"up_from":8,"seq":34359738446,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1880812,"kb_used_data":1583588,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":91864340,"statfs":{"total":95995035648,"available":94069084160,"internally_reserved":0,"allocated":1621594112,"data_stored":1621196949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 10 08:19:27 2024","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.36799999999999999,"15min":0.34000000000000002},"min":{"1min":0.252,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":3.331},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.379,"15min":0.34100000000000003},"min":{"1min":0.252,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":1.877}]},{"osd":2,"last update":"Sat Feb 10 08:19:52 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.39800000000000002,"15min":0.39000000000000001},"min":{"1min":0.28000000000000003,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":3.6560000000000001},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.41099999999999998,"15min":0.39700000000000002},"min":{"1min":0.31,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":3.407}]},{"osd":3,"last update":"Sat Feb 10 08:20:14 2024","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":0.59899999999999998,"15min":0.497},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":4.8380000000000001,"5min":4.8380000000000001,"15min":4.8380000000000001},"last":4.2370000000000001},{"interface":"front","average":{"1min":1.363,"5min":0.61499999999999999,"15min":0.50600000000000001},"min":{"1min":0.317,"5min":0.246,"15min":0.246},"max":{"1min":6.0910000000000002,"5min":6.0910000000000002,"15min":6.0910000000000002},"last":3.5190000000000001}]},{"osd":4,"last update":"Sat Feb 10 08:18:35 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.59399999999999997,"15min":0.59199999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.59399999999999997,"15min":0.60399999999999998},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.56299999999999994}]},{"osd":5,"last update":"Sat Feb 10 08:20:04 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.59399999999999997,"15min":0.59599999999999997},"min":{"1min":0.46500000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":3.2850000000000001},{"interface":"front","average":{"1min":0.499,"5min":0.55900000000000005,"15min":0.57499999999999996},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.74199999999999999,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":1.903}]},{"osd":6,"last update":"Sat Feb 10 08:19:27 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.60399999999999998,"15min":0.59899999999999998},"min":{"1min":0.40500000000000003,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":3.359},{"interface":"front","average":{"1min":0.626,"5min":0.63600000000000001,"15min":0.64500000000000002},"min":{"1min":0.46000000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":1.921}]},{"osd":7,"last update":"Sat Feb 10 08:19:49 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.434,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":3.387},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.41899999999999998,"5min":0.38,"15min":0.38},"max":{"1min":0.81599999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":1.9390000000000001}]}]},{"osd":2,"up_from":18,"seq":77309411397,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1476448,"kb_used_data":1171032,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":92268704,"statfs":{"total":95995035648,"available":94483152896,"internally_reserved":0,"allocated":1199136768,"data_stored":1198751384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:19:48 2024","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.35299999999999998,"15min":0.34699999999999998},"min":{"1min":0.249,"5min":0.224,"15min":0.224},"max":{"1min":0.495,"5min":0.628,"15min":0.628},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.377,"15min":0.36499999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.49099999999999999,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":3.327}]},{"osd":1,"last update":"Sat Feb 10 08:19:48 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.38700000000000001,"15min":0.372},"min":{"1min":0.27000000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":2.0139999999999998,"5min":2.0139999999999998,"15min":2.0139999999999998},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.39700000000000002,"15min":0.38300000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.53700000000000003,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":1.0169999999999999}]},{"osd":3,"last update":"Sat Feb 10 08:20:16 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.53000000000000003,"15min":0.48399999999999999},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":3.4129999999999998,"5min":3.4129999999999998,"15min":3.4129999999999998},"last":2.6040000000000001},{"interface":"front","average":{"1min":1.0089999999999999,"5min":0.54900000000000004,"15min":0.48399999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":5.5039999999999996,"5min":5.5039999999999996,"15min":5.5039999999999996},"last":1.048}]},{"osd":4,"last update":"Sat Feb 10 08:18:35 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.58499999999999996,"15min":0.58099999999999996},"min":{"1min":0.496,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.86299999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.57399999999999995,"15min":0.57699999999999996},"min":{"1min":0.39800000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.53700000000000003}]},{"osd":5,"last update":"Sat Feb 10 08:20:05 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.56999999999999995,"15min":0.57099999999999995},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":3.2679999999999998},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.60499999999999998,"15min":0.57999999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":2.786,"5min":2.786,"15min":2.786},"last":0.36699999999999999}]},{"osd":6,"last update":"Sat Feb 10 08:19:27 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.58399999999999996,"15min":0.58599999999999997},"min":{"1min":0.39900000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.77100000000000002,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":3.302},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.59999999999999998,"15min":0.60599999999999998},"min":{"1min":0.45300000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.40100000000000002}]},{"osd":7,"last update":"Sat Feb 10 08:19:48 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.61199999999999999,"15min":0.61099999999999999},"min":{"1min":0.40799999999999997,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":2.1549999999999998,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":0.437},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.60099999999999998,"15min":0.60699999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.76000000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.42199999999999999}]}]},{"osd":3,"up_from":25,"seq":107374182464,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2091312,"kb_used_data":1785896,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":91653840,"statfs":{"total":95995035648,"available":93853532160,"internally_reserved":0,"allocated":1828757504,"data_stored":1828355487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:20:14 2024","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":0.50800000000000001,"15min":0.41399999999999998},"min":{"1min":0.20499999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":5.7400000000000002,"5min":5.7400000000000002,"15min":5.7400000000000002},"last":1.6910000000000001},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.48299999999999998,"15min":0.443},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":2.7519999999999998,"5min":2.7519999999999998,"15min":2.7519999999999998},"last":2.8479999999999999}]},{"osd":1,"last update":"Sat Feb 10 08:20:14 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.47299999999999998,"15min":0.45400000000000001},"min":{"1min":0.23300000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":4.1980000000000004,"5min":4.1980000000000004,"15min":4.1980000000000004},"last":1.365},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.495,"15min":0.47599999999999998},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":3.8140000000000001,"5min":3.8140000000000001,"15min":3.8140000000000001},"last":2.8260000000000001}]},{"osd":2,"last update":"Sat Feb 10 08:20:14 2024","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":0.56200000000000006,"15min":0.49199999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":4.1669999999999998,"5min":4.1669999999999998,"15min":4.1669999999999998},"last":4.0590000000000002},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.54500000000000004,"15min":0.48299999999999998},"min":{"1min":0.28699999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":3.504,"5min":3.504,"15min":3.504},"last":2.085}]},{"osd":4,"last update":"Sat Feb 10 08:18:36 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54700000000000004,"15min":0.54500000000000004},"min":{"1min":0.38800000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.435},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.56899999999999995,"15min":0.57299999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.83099999999999996,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.39300000000000002}]},{"osd":5,"last update":"Sat Feb 10 08:20:05 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.59599999999999997,"15min":0.59799999999999998},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":2.0190000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59099999999999997,"15min":0.59699999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":1.3959999999999999}]},{"osd":6,"last update":"Sat Feb 10 08:19:24 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.78800000000000003,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":1.417},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59099999999999997,"15min":0.58499999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.77100000000000002,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":2.0670000000000002}]},{"osd":7,"last update":"Sat Feb 10 08:19:49 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.58199999999999996,"15min":0.57799999999999996},"min":{"1min":0.46800000000000003,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.72499999999999998,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":2.0459999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.58199999999999996,"15min":0.57299999999999995},"min":{"1min":0.47699999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.75700000000000001,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":2.7970000000000002}]}]},{"osd":4,"up_from":30,"seq":128849018928,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297764,"kb_used_data":668,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447388,"statfs":{"total":95995035648,"available":95690125312,"internally_reserved":0,"allocated":684032,"data_stored":315058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:18:34 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.51300000000000001,"15min":0.52400000000000002},"min":{"1min":0.26100000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.65600000000000003,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.503,"5min":0.52200000000000002,"15min":0.53000000000000003},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.64500000000000002,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.621}]},{"osd":1,"last update":"Sat Feb 10 08:18:34 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.50900000000000001,"15min":0.52400000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.629,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.503,"15min":0.51600000000000001},"min":{"1min":0.35199999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.56000000000000005,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.56000000000000005}]},{"osd":2,"last update":"Sat Feb 10 08:18:34 2024","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.499,"15min":0.505},"min":{"1min":0.32300000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.61699999999999999,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.52900000000000003,"15min":0.53900000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.61199999999999999,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.64900000000000002}]},{"osd":3,"last update":"Sat Feb 10 08:18:34 2024","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.52700000000000002,"15min":0.53700000000000003},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.66900000000000004,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.497,"5min":0.52200000000000002,"15min":0.53100000000000003},"min":{"1min":0.39500000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.67800000000000005,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.52600000000000002}]},{"osd":5,"last update":"Sat Feb 10 08:19:00 2024","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.38600000000000001,"15min":0.372},"min":{"1min":0.27100000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.627,"5min":0.627,"15min":0.627},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.39400000000000002,"15min":0.377},"min":{"1min":0.28999999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.372}]},{"osd":6,"last update":"Sat Feb 10 08:19:22 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.432,"15min":0.42199999999999999},"min":{"1min":0.32000000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.64900000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.48999999999999999,"15min":0.47199999999999998},"min":{"1min":0.41499999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.46800000000000003}]},{"osd":7,"last update":"Sat Feb 10 08:18:46 2024","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.33300000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.45200000000000001,"15min":0.45000000000000001},"min":{"1min":0.313,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.40000000000000002}]}]},{"osd":5,"up_from":37,"seq":158913790007,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1085908,"kb_used_data":788684,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":92659244,"statfs":{"total":95995035648,"available":94883065856,"internally_reserved":0,"allocated":807612416,"data_stored":807238642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,2,3,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:19:58 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55400000000000005,"15min":0.58099999999999996},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.792,"5min":1.792,"15min":1.792},"last":0.22800000000000001},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.52000000000000002},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":3.544}]},{"osd":1,"last update":"Sat Feb 10 08:19:58 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.52600000000000002,"15min":0.55400000000000005},"min":{"1min":0.26200000000000001,"5min":0.252,"15min":0.252},"max":{"1min":0.66900000000000004,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.52000000000000002,"15min":0.54400000000000004},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.379}]},{"osd":2,"last update":"Sat Feb 10 08:19:58 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.55700000000000005,"15min":0.57099999999999995},"min":{"1min":0.34100000000000003,"5min":0.314,"15min":0.314},"max":{"1min":2.1160000000000001,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.56399999999999995,"15min":0.58999999999999997},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.708,"5min":1.708,"15min":1.708},"last":1.3180000000000001}]},{"osd":3,"last update":"Sat Feb 10 08:19:58 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55200000000000005,"15min":0.58199999999999996},"min":{"1min":0.36099999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.56000000000000005,"15min":0.56399999999999995},"min":{"1min":0.34000000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.76100000000000001,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":4.2590000000000003}]},{"osd":4,"last update":"Sat Feb 10 08:18:57 2024","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.371,"15min":0.36099999999999999},"min":{"1min":0.26400000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.65400000000000003,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.433,"5min":0.38300000000000001,"15min":0.36899999999999999},"min":{"1min":0.30399999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.68700000000000006,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.51500000000000001}]},{"osd":6,"last update":"Sat Feb 10 08:19:25 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.41499999999999998,"15min":0.38500000000000001},"min":{"1min":0.29399999999999998,"5min":0.254,"15min":0.254},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.46500000000000002,"15min":0.435},"min":{"1min":0.38,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.41999999999999998}]},{"osd":7,"last update":"Sat Feb 10 08:19:49 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.45000000000000001,"15min":0.44},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.499,"5min":0.44700000000000001,"15min":0.42999999999999999},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.73599999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.435}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":2008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1644691456,"data_stored":1644691456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1235681280,"data_stored":1235681280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1217265664,"data_stored":1217265664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1843724288,"data_stored":1843724288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":810811392,"data_stored":810811392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1042219008,"data_stored":1042219008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1024458752,"data_stored":1024458752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-10T08:20:20.259 INFO:tasks.thrashosds.thrasher:Setting 4.7 to [1, 7, 6, 4, 0, 5] 2024-02-10T08:20:20.260 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '4.7', '1', '7', '6', '4', '0', '5'] 2024-02-10T08:20:20.260 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd pg-upmap-items 4.7 1 7 6 4 0 5 2024-02-10T08:20:20.260 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:20:20.264 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:20.265 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:20:20.273 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:20:20.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:18.510754+0000 mgr.y (mgr.14505) 137 : cluster [DBG] pgmap v129: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 3.1 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 1.2 KiB/s rd, 108 MiB/s wr, 1.73k op/s; 15705/150741 objects degraded (10.419%) 2024-02-10T08:20:20.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:18.933221+0000 osd.0 (osd.0) 67 : cluster [DBG] 6.0 scrub starts 2024-02-10T08:20:20.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:18.940935+0000 osd.0 (osd.0) 68 : cluster [DBG] 6.0 scrub ok 2024-02-10T08:20:20.366 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:20:20.396 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:20.416 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:20:20.419 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:20.419 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:20:20.520 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:20:20.600 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:21.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:20:19.008144+0000 mgr.y (mgr.14505) 138 : audit [DBG] from='client.24673 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-10T08:20:21.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:20.363882+0000 mon.a (mon.0) 820 : cluster [WRN] Health check update: Degraded data redundancy: 15705/150741 objects degraded (10.419%), 24 pgs degraded (PG_DEGRADED) 2024-02-10T08:20:21.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:20:19.008144+0000 mgr.y (mgr.14505) 138 : audit [DBG] from='client.24673 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-10T08:20:21.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:20.363882+0000 mon.a (mon.0) 820 : cluster [WRN] Health check update: Degraded data redundancy: 15705/150741 objects degraded (10.419%), 24 pgs degraded (PG_DEGRADED) 2024-02-10T08:20:21.167 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:20:21.171 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:21.172 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:20:21.215 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 31 16 54670 54654 110.117 68.8125 0.00691633 0.00907745 2024-02-10T08:20:21.273 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:20:21.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:20:19.008144+0000 mgr.y (mgr.14505) 138 : audit [DBG] from='client.24673 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-10T08:20:21.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:20.363882+0000 mon.a (mon.0) 820 : cluster [WRN] Health check update: Degraded data redundancy: 15705/150741 objects degraded (10.419%), 24 pgs degraded (PG_DEGRADED) 2024-02-10T08:20:21.362 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:21.736 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:20:21.740 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:21.740 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:20:21.841 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:20:21.872 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:21.894 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:20:21.896 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:21.897 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:20:21.998 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:20:22.052 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:20.294720+0000 osd.7 (osd.7) 69 : cluster [DBG] 2.1d scrub starts 2024-02-10T08:20:22.052 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:20.303726+0000 osd.7 (osd.7) 70 : cluster [DBG] 2.1d scrub ok 2024-02-10T08:20:22.052 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:20.511512+0000 mgr.y (mgr.14505) 139 : cluster [DBG] pgmap v130: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 3.1 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 1.0 KiB/s rd, 88 MiB/s wr, 1.42k op/s; 15705/150741 objects degraded (10.419%) 2024-02-10T08:20:22.052 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:20:21.413941+0000 mon.b (mon.1) 37 : audit [INF] from='client.? 172.21.15.18:0/1165449300' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:20:22.052 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:20:21.414401+0000 mon.a (mon.0) 821 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:20:22.052 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:20.294720+0000 osd.7 (osd.7) 69 : cluster [DBG] 2.1d scrub starts 2024-02-10T08:20:22.052 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:20.303726+0000 osd.7 (osd.7) 70 : cluster [DBG] 2.1d scrub ok 2024-02-10T08:20:22.053 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:20.511512+0000 mgr.y (mgr.14505) 139 : cluster [DBG] pgmap v130: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 3.1 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 1.0 KiB/s rd, 88 MiB/s wr, 1.42k op/s; 15705/150741 objects degraded (10.419%) 2024-02-10T08:20:22.053 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:20:21.413941+0000 mon.b (mon.1) 37 : audit [INF] from='client.? 172.21.15.18:0/1165449300' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:20:22.053 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:20:21.414401+0000 mon.a (mon.0) 821 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:20:22.055 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:22.215 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 32 16 55887 55871 109.053 76.0625 0.00928109 0.00916365 2024-02-10T08:20:22.272 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:20:22.276 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:22.277 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:20:22.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:20.294720+0000 osd.7 (osd.7) 69 : cluster [DBG] 2.1d scrub starts 2024-02-10T08:20:22.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:20.303726+0000 osd.7 (osd.7) 70 : cluster [DBG] 2.1d scrub ok 2024-02-10T08:20:22.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:20.511512+0000 mgr.y (mgr.14505) 139 : cluster [DBG] pgmap v130: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 3.1 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 1.0 KiB/s rd, 88 MiB/s wr, 1.42k op/s; 15705/150741 objects degraded (10.419%) 2024-02-10T08:20:22.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:20:21.413941+0000 mon.b (mon.1) 37 : audit [INF] from='client.? 172.21.15.18:0/1165449300' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:20:22.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:20:21.414401+0000 mon.a (mon.0) 821 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:20:22.378 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:20:22.406 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:22.431 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:20:22.433 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:22.433 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:20:22.450 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is unset 2024-02-10T08:20:22.534 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:20:22.628 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:22.756 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:20:22.763 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:22.763 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:20:22.864 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:20:22.938 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:22.998 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:20:23.001 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:23.002 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:20:23.102 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:20:23.135 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:21.975999+0000 osd.2 (osd.2) 55 : cluster [DBG] 2.c scrub starts 2024-02-10T08:20:23.135 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:21.977059+0000 osd.2 (osd.2) 56 : cluster [DBG] 2.c scrub ok 2024-02-10T08:20:23.135 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:22.401270+0000 mon.a (mon.0) 822 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-10T08:20:23.135 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:20:22.408950+0000 mon.a (mon.0) 823 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-10T08:20:23.135 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:22.409025+0000 mon.a (mon.0) 824 : cluster [DBG] osdmap e100: 8 total, 7 up, 8 in 2024-02-10T08:20:23.137 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:23.159 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:21.975999+0000 osd.2 (osd.2) 55 : cluster [DBG] 2.c scrub starts 2024-02-10T08:20:23.159 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:21.977059+0000 osd.2 (osd.2) 56 : cluster [DBG] 2.c scrub ok 2024-02-10T08:20:23.159 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:22.401270+0000 mon.a (mon.0) 822 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-10T08:20:23.159 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:20:22.408950+0000 mon.a (mon.0) 823 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-10T08:20:23.159 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:22.409025+0000 mon.a (mon.0) 824 : cluster [DBG] osdmap e100: 8 total, 7 up, 8 in 2024-02-10T08:20:23.160 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:21.975999+0000 osd.2 (osd.2) 55 : cluster [DBG] 2.c scrub starts 2024-02-10T08:20:23.160 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:21.977059+0000 osd.2 (osd.2) 56 : cluster [DBG] 2.c scrub ok 2024-02-10T08:20:23.160 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:22.401270+0000 mon.a (mon.0) 822 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-10T08:20:23.160 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:20:22.408950+0000 mon.a (mon.0) 823 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-10T08:20:23.160 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:22.409025+0000 mon.a (mon.0) 824 : cluster [DBG] osdmap e100: 8 total, 7 up, 8 in 2024-02-10T08:20:23.161 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:20:23.163 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:23.164 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:20:23.215 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 33 16 57010 56994 107.876 70.1875 0.0114949 0.00926432 2024-02-10T08:20:23.265 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:20:23.337 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:23.411 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:20:23.417 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:23.418 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:20:23.519 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:20:23.580 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:23.819 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:20:23.827 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:23.828 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:20:23.928 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:20:23.958 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:23.978 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:20:23.981 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:23.982 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:20:24.083 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:20:24.110 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:22.271539+0000 osd.7 (osd.7) 71 : cluster [DBG] 6.3 scrub starts 2024-02-10T08:20:24.110 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:22.272982+0000 osd.7 (osd.7) 72 : cluster [DBG] 6.3 scrub ok 2024-02-10T08:20:24.110 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:22.512353+0000 mgr.y (mgr.14505) 140 : cluster [DBG] pgmap v132: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 3.4 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 1023 B/s rd, 79 MiB/s wr, 1.27k op/s; 17598/169017 objects degraded (10.412%) 2024-02-10T08:20:24.111 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:24.112 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:22.271539+0000 osd.7 (osd.7) 71 : cluster [DBG] 6.3 scrub starts 2024-02-10T08:20:24.112 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:22.272982+0000 osd.7 (osd.7) 72 : cluster [DBG] 6.3 scrub ok 2024-02-10T08:20:24.113 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:22.512353+0000 mgr.y (mgr.14505) 140 : cluster [DBG] pgmap v132: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 3.4 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 1023 B/s rd, 79 MiB/s wr, 1.27k op/s; 17598/169017 objects degraded (10.412%) 2024-02-10T08:20:24.113 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:22.271539+0000 osd.7 (osd.7) 71 : cluster [DBG] 6.3 scrub starts 2024-02-10T08:20:24.113 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:22.272982+0000 osd.7 (osd.7) 72 : cluster [DBG] 6.3 scrub ok 2024-02-10T08:20:24.113 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:22.512353+0000 mgr.y (mgr.14505) 140 : cluster [DBG] pgmap v132: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 3.4 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 1023 B/s rd, 79 MiB/s wr, 1.27k op/s; 17598/169017 objects degraded (10.412%) 2024-02-10T08:20:24.133 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:20:24.136 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:24.136 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:20:24.215 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 34 16 58272 58256 107.023 78.875 0.0166952 0.00933809 2024-02-10T08:20:24.237 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:20:24.267 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:24.297 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:20:24.299 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:24.299 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:20:24.400 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:20:24.463 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:24.591 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:20:24.625 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:20:24.682 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-02-10T08:20:24.683 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-02-10T08:20:24.683 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-02-10T08:20:24.683 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-02-10T08:20:24.683 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.683 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:26627 7.b 7:d0116264:::benchmark_data_smithi018_80623_object26626:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e96)", 2024-02-10T08:20:24.683 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:01.759528+0000", 2024-02-10T08:20:24.683 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 22.905673880999998, 2024-02-10T08:20:24.683 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.053139354999999999, 2024-02-10T08:20:24.683 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:20:24.683 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:20:24.683 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:20:24.683 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:20:24.683 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:20:24.684 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 26627 2024-02-10T08:20:24.684 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.684 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:20:24.684 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.684 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:20:24.684 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:01.759528+0000", 2024-02-10T08:20:24.684 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:20:24.684 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.684 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.684 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:20:24.684 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:01.759528+0000", 2024-02-10T08:20:24.684 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999938 2024-02-10T08:20:24.684 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.684 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.685 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:20:24.685 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:01.759522+0000", 2024-02-10T08:20:24.685 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.741e-05 2024-02-10T08:20:24.685 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.685 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.685 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:20:24.685 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:01.759549+0000", 2024-02-10T08:20:24.685 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9450000000000005e-06 2024-02-10T08:20:24.685 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.685 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.685 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:20:24.685 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:01.759559+0000", 2024-02-10T08:20:24.685 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4640000000000003e-06 2024-02-10T08:20:24.685 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.686 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.686 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:20:24.686 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:01.759565+0000", 2024-02-10T08:20:24.686 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6266000000000001e-05 2024-02-10T08:20:24.686 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.686 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.686 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:20:24.686 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:01.759602+0000", 2024-02-10T08:20:24.686 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7028999999999998e-05 2024-02-10T08:20:24.686 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.686 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.686 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:20:24.686 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:01.759669+0000", 2024-02-10T08:20:24.686 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5729000000000005e-05 2024-02-10T08:20:24.686 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.687 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.687 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 5,6", 2024-02-10T08:20:24.687 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:01.759754+0000", 2024-02-10T08:20:24.687 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00057464199999999999 2024-02-10T08:20:24.687 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.687 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.687 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:20:24.687 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:01.760329+0000", 2024-02-10T08:20:24.687 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00044032400000000002 2024-02-10T08:20:24.687 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.687 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.687 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:20:24.687 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:01.760769+0000", 2024-02-10T08:20:24.687 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.051796406000000003 2024-02-10T08:20:24.688 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.688 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.688 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:20:24.688 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:01.812566+0000", 2024-02-10T08:20:24.688 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7447000000000001e-05 2024-02-10T08:20:24.688 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.688 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.688 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:20:24.688 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:01.812623+0000", 2024-02-10T08:20:24.688 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3708000000000002e-05 2024-02-10T08:20:24.688 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.688 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.688 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:20:24.688 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:01.812667+0000", 2024-02-10T08:20:24.688 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.053139354999999999 2024-02-10T08:20:24.689 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:24.689 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:24.689 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:24.689 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.689 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.689 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop_reply(client.14784.0:26627 7.b e96/91 ondisk, result = 0)", 2024-02-10T08:20:24.689 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:01.760723+0000", 2024-02-10T08:20:24.689 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 22.904478917999999, 2024-02-10T08:20:24.689 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.051951965000000003, 2024-02-10T08:20:24.689 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:20:24.689 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-02-10T08:20:24.689 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:20:24.689 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.689 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:20:24.689 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:01.760723+0000", 2024-02-10T08:20:24.690 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:20:24.690 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.690 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.690 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:20:24.690 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:01.760723+0000", 2024-02-10T08:20:24.690 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:20:24.690 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.690 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.690 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:20:24.690 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:01.760722+0000", 2024-02-10T08:20:24.690 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4449999999999998e-06 2024-02-10T08:20:24.690 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.690 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.690 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:20:24.690 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:01.760726+0000", 2024-02-10T08:20:24.691 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.567e-06 2024-02-10T08:20:24.691 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.691 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.691 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:20:24.691 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:01.760733+0000", 2024-02-10T08:20:24.691 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0400000000000003e-06 2024-02-10T08:20:24.691 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.691 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.691 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:20:24.691 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:01.760737+0000", 2024-02-10T08:20:24.691 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.051812713000000003 2024-02-10T08:20:24.691 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.691 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.691 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:20:24.691 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:01.812550+0000", 2024-02-10T08:20:24.692 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6500000000000002e-06 2024-02-10T08:20:24.692 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.692 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.692 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:20:24.692 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:01.812558+0000", 2024-02-10T08:20:24.692 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000116307 2024-02-10T08:20:24.692 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.692 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.692 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:20:24.692 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:01.812674+0000", 2024-02-10T08:20:24.692 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.051951965000000003 2024-02-10T08:20:24.692 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:24.692 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:24.692 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:24.692 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.693 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.693 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:36319 7.b 7:defb3894:::benchmark_data_smithi018_80623_object36318:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e97)", 2024-02-10T08:20:24.693 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:07.510745+0000", 2024-02-10T08:20:24.693 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 17.154456218, 2024-02-10T08:20:24.693 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.046505262999999998, 2024-02-10T08:20:24.693 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:20:24.693 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:20:24.693 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:20:24.693 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:20:24.693 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:20:24.693 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 36319 2024-02-10T08:20:24.693 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.693 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:20:24.693 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.693 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:20:24.694 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:07.510745+0000", 2024-02-10T08:20:24.694 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:20:24.694 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.694 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.694 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:20:24.694 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:07.510745+0000", 2024-02-10T08:20:24.694 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:20:24.694 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.694 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.694 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:20:24.694 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:07.510744+0000", 2024-02-10T08:20:24.694 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1339e-05 2024-02-10T08:20:24.694 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.694 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.694 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:20:24.695 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:07.510765+0000", 2024-02-10T08:20:24.695 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0552e-05 2024-02-10T08:20:24.695 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.695 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.695 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:20:24.695 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:07.510776+0000", 2024-02-10T08:20:24.695 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9560000000000002e-06 2024-02-10T08:20:24.695 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.695 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.695 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:20:24.695 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:07.510782+0000", 2024-02-10T08:20:24.695 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000321324 2024-02-10T08:20:24.695 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.695 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.695 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:20:24.696 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:07.511103+0000", 2024-02-10T08:20:24.696 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000118095 2024-02-10T08:20:24.696 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.696 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.696 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:20:24.696 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:07.511221+0000", 2024-02-10T08:20:24.696 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000145625 2024-02-10T08:20:24.696 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.696 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.696 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 5,6", 2024-02-10T08:20:24.696 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:07.511367+0000", 2024-02-10T08:20:24.696 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001169706 2024-02-10T08:20:24.696 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.696 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.697 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:20:24.697 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:07.512536+0000", 2024-02-10T08:20:24.697 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0024601670000000001 2024-02-10T08:20:24.697 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.697 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.697 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:20:24.697 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:07.514997+0000", 2024-02-10T08:20:24.697 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5675999999999998e-05 2024-02-10T08:20:24.697 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.697 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.697 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:20:24.697 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:07.515072+0000", 2024-02-10T08:20:24.697 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3844999999999998e-05 2024-02-10T08:20:24.697 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.697 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.698 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:20:24.698 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:07.515116+0000", 2024-02-10T08:20:24.698 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.042134427000000002 2024-02-10T08:20:24.698 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.698 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.698 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:20:24.698 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:07.557250+0000", 2024-02-10T08:20:24.698 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.046505262999999998 2024-02-10T08:20:24.698 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:24.698 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:24.698 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:24.698 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.698 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.698 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:36327 7.b 7:d3f56fc7:::benchmark_data_smithi018_80623_object36326:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e97)", 2024-02-10T08:20:24.698 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:07.512986+0000", 2024-02-10T08:20:24.699 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 17.152215502000001, 2024-02-10T08:20:24.699 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.044713461000000003, 2024-02-10T08:20:24.699 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:20:24.699 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:20:24.699 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:20:24.699 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:20:24.699 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:20:24.699 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 36327 2024-02-10T08:20:24.699 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.699 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:20:24.699 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.699 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:20:24.699 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:07.512986+0000", 2024-02-10T08:20:24.699 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:20:24.700 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.700 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.700 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:20:24.700 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:07.512986+0000", 2024-02-10T08:20:24.700 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:20:24.700 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.700 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.700 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:20:24.700 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:07.512985+0000", 2024-02-10T08:20:24.700 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7370000000000001e-05 2024-02-10T08:20:24.700 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.700 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.700 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:20:24.700 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:07.513012+0000", 2024-02-10T08:20:24.701 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0224000000000001e-05 2024-02-10T08:20:24.701 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.701 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.701 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:20:24.701 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:07.513022+0000", 2024-02-10T08:20:24.701 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.691e-06 2024-02-10T08:20:24.701 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.701 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.701 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:20:24.701 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:07.513029+0000", 2024-02-10T08:20:24.701 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8214999999999998e-05 2024-02-10T08:20:24.701 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.701 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.701 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:20:24.702 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:07.513077+0000", 2024-02-10T08:20:24.702 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7150000000000005e-05 2024-02-10T08:20:24.702 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.702 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.702 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:20:24.702 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:07.513154+0000", 2024-02-10T08:20:24.702 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000102141 2024-02-10T08:20:24.702 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.702 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.702 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 5,6", 2024-02-10T08:20:24.702 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:07.513256+0000", 2024-02-10T08:20:24.702 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00098141799999999996 2024-02-10T08:20:24.702 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.702 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.702 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:20:24.703 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:07.514238+0000", 2024-02-10T08:20:24.703 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00078858200000000002 2024-02-10T08:20:24.703 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.703 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.703 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:20:24.703 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:07.515026+0000", 2024-02-10T08:20:24.703 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.042589410000000001 2024-02-10T08:20:24.703 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.703 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.703 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:20:24.703 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:07.557616+0000", 2024-02-10T08:20:24.703 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9972000000000002e-05 2024-02-10T08:20:24.703 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.703 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.703 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:20:24.704 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:07.557666+0000", 2024-02-10T08:20:24.704 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3592e-05 2024-02-10T08:20:24.704 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.704 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.704 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:20:24.704 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:07.557699+0000", 2024-02-10T08:20:24.704 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.044713461000000003 2024-02-10T08:20:24.704 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:24.704 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:24.704 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:24.704 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.704 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.704 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.14784.0:36325 7.d e97/91 7:bcc202c1:::benchmark_data_smithi018_80623_object36324:head v 97'2318, mlcod=97'2316)", 2024-02-10T08:20:24.704 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:07.513740+0000", 2024-02-10T08:20:24.705 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 17.151461289, 2024-02-10T08:20:24.705 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.043517538000000001, 2024-02-10T08:20:24.705 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:20:24.705 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:20:24.705 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:20:24.705 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.705 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:20:24.705 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:07.513740+0000", 2024-02-10T08:20:24.705 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:20:24.705 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.706 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.706 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:20:24.706 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:07.513740+0000", 2024-02-10T08:20:24.706 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:20:24.706 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.706 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.706 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:20:24.706 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:07.513739+0000", 2024-02-10T08:20:24.706 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3128999999999998e-05 2024-02-10T08:20:24.706 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.706 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.706 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:20:24.706 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:07.513802+0000", 2024-02-10T08:20:24.706 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.187e-05 2024-02-10T08:20:24.707 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.707 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.707 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:20:24.707 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:07.513814+0000", 2024-02-10T08:20:24.707 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4319999999999998e-06 2024-02-10T08:20:24.707 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.707 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.707 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:20:24.707 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:07.513820+0000", 2024-02-10T08:20:24.707 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4242999999999997e-05 2024-02-10T08:20:24.707 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.707 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.707 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:20:24.708 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:07.513854+0000", 2024-02-10T08:20:24.708 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2604e-05 2024-02-10T08:20:24.709 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.709 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.709 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:20:24.709 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:07.513867+0000", 2024-02-10T08:20:24.709 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001272846 2024-02-10T08:20:24.709 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.709 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.709 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:20:24.709 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:07.515139+0000", 2024-02-10T08:20:24.709 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.042118188000000001 2024-02-10T08:20:24.709 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.709 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.709 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:20:24.710 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:07.557258+0000", 2024-02-10T08:20:24.710 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.043517538000000001 2024-02-10T08:20:24.710 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:24.710 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:24.710 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:24.710 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.710 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.710 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop_reply(client.14784.0:36319 7.b e97/91 ondisk, result = 0)", 2024-02-10T08:20:24.710 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:07.515001+0000", 2024-02-10T08:20:24.710 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 17.150200572999999, 2024-02-10T08:20:24.710 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.042255833, 2024-02-10T08:20:24.710 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:20:24.710 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-02-10T08:20:24.710 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:20:24.711 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.711 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:20:24.711 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:07.515001+0000", 2024-02-10T08:20:24.711 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:20:24.711 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.711 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.711 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:20:24.711 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:07.515001+0000", 2024-02-10T08:20:24.712 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:20:24.712 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.712 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.712 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:20:24.712 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:07.515000+0000", 2024-02-10T08:20:24.713 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9570000000000001e-06 2024-02-10T08:20:24.713 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.713 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.713 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:20:24.713 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:07.515005+0000", 2024-02-10T08:20:24.713 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3629999999999996e-06 2024-02-10T08:20:24.713 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.713 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.713 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:20:24.713 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:07.515012+0000", 2024-02-10T08:20:24.713 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1479999999999999e-06 2024-02-10T08:20:24.713 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.713 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.713 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:20:24.713 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:07.515017+0000", 2024-02-10T08:20:24.714 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2880999999999998e-05 2024-02-10T08:20:24.714 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.714 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.714 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:20:24.714 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:07.515059+0000", 2024-02-10T08:20:24.714 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5309999999999998e-06 2024-02-10T08:20:24.714 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.714 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.714 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:20:24.714 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:07.515066+0000", 2024-02-10T08:20:24.714 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.042190711999999998 2024-02-10T08:20:24.714 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.714 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.714 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:20:24.714 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:07.557257+0000", 2024-02-10T08:20:24.715 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.042255833 2024-02-10T08:20:24.715 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:24.715 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:24.715 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:24.715 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.715 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.715 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop_reply(client.14784.0:36327 7.b e97/91 ondisk, result = 0)", 2024-02-10T08:20:24.715 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:07.515972+0000", 2024-02-10T08:20:24.715 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 17.149229106, 2024-02-10T08:20:24.715 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.041731284, 2024-02-10T08:20:24.715 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:20:24.715 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-02-10T08:20:24.715 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:20:24.715 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.715 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:20:24.716 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:07.515972+0000", 2024-02-10T08:20:24.716 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:20:24.716 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.716 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.716 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:20:24.716 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:07.515972+0000", 2024-02-10T08:20:24.716 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:20:24.716 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.716 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.716 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:20:24.716 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:07.515972+0000", 2024-02-10T08:20:24.716 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2190000000000003e-06 2024-02-10T08:20:24.716 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.716 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.716 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:20:24.717 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:07.515977+0000", 2024-02-10T08:20:24.717 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.041557693 2024-02-10T08:20:24.717 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.717 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.717 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:20:24.717 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:07.557535+0000", 2024-02-10T08:20:24.717 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8929999999999994e-06 2024-02-10T08:20:24.717 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.717 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.717 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:20:24.717 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:07.557543+0000", 2024-02-10T08:20:24.717 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8718000000000003e-05 2024-02-10T08:20:24.717 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.717 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.717 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:20:24.718 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:07.557602+0000", 2024-02-10T08:20:24.718 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9360000000000002e-06 2024-02-10T08:20:24.718 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.718 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.718 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:20:24.718 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:07.557609+0000", 2024-02-10T08:20:24.718 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4493999999999993e-05 2024-02-10T08:20:24.718 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.718 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.718 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:20:24.718 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:07.557704+0000", 2024-02-10T08:20:24.718 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.041731284 2024-02-10T08:20:24.718 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:24.718 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:24.719 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:24.719 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.719 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.719 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.14784.0:41250 7.2 e98/91 7:4a027faf:::benchmark_data_smithi018_80623_object41249:head v 98'2589, mlcod=97'2587)", 2024-02-10T08:20:24.719 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:10.787114+0000", 2024-02-10T08:20:24.719 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 13.878087656, 2024-02-10T08:20:24.719 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.021605664, 2024-02-10T08:20:24.719 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:20:24.719 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:20:24.719 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:20:24.719 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.719 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:20:24.719 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:10.787114+0000", 2024-02-10T08:20:24.719 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:20:24.720 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.720 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.720 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:20:24.720 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:10.787114+0000", 2024-02-10T08:20:24.720 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:20:24.720 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.720 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.720 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:20:24.720 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:10.787113+0000", 2024-02-10T08:20:24.720 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.6083000000000001e-05 2024-02-10T08:20:24.720 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.720 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.720 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:20:24.720 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:10.787139+0000", 2024-02-10T08:20:24.721 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1277000000000001e-05 2024-02-10T08:20:24.721 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.721 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.721 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:20:24.721 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:10.787151+0000", 2024-02-10T08:20:24.721 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2010000000000002e-06 2024-02-10T08:20:24.721 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.721 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.721 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:20:24.721 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:10.787158+0000", 2024-02-10T08:20:24.721 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9808999999999997e-05 2024-02-10T08:20:24.721 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.721 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.721 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:20:24.721 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:10.787208+0000", 2024-02-10T08:20:24.722 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2850999999999999e-05 2024-02-10T08:20:24.722 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.722 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.722 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:20:24.722 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:10.787231+0000", 2024-02-10T08:20:24.722 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.021454712000000001 2024-02-10T08:20:24.722 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.722 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.722 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:20:24.722 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:10.808685+0000", 2024-02-10T08:20:24.722 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4090000000000001e-05 2024-02-10T08:20:24.722 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.722 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.722 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:20:24.722 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:10.808719+0000", 2024-02-10T08:20:24.722 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.021605664 2024-02-10T08:20:24.723 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:24.723 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:24.723 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:24.723 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.723 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.723 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.14784.0:41256 7.2 e98/91 7:45169b6a:::benchmark_data_smithi018_80623_object41255:head v 98'2590, mlcod=97'2587)", 2024-02-10T08:20:24.723 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:10.787171+0000", 2024-02-10T08:20:24.723 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 13.878030015, 2024-02-10T08:20:24.723 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.021565933999999998, 2024-02-10T08:20:24.723 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:20:24.723 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:20:24.723 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:20:24.723 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.723 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:20:24.724 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:10.787171+0000", 2024-02-10T08:20:24.724 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:20:24.724 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.724 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.724 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:20:24.724 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:10.787171+0000", 2024-02-10T08:20:24.724 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:20:24.724 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.724 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.724 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:20:24.724 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:10.787171+0000", 2024-02-10T08:20:24.724 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1608e-05 2024-02-10T08:20:24.724 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.724 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.725 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:20:24.725 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:10.787193+0000", 2024-02-10T08:20:24.725 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6749999999999999e-06 2024-02-10T08:20:24.725 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.725 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.725 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:20:24.725 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:10.787198+0000", 2024-02-10T08:20:24.725 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1529999999999999e-06 2024-02-10T08:20:24.725 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.725 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.725 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:20:24.725 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:10.787202+0000", 2024-02-10T08:20:24.725 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001322822 2024-02-10T08:20:24.726 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.726 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.726 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:20:24.726 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:10.788525+0000", 2024-02-10T08:20:24.726 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7495999999999999e-05 2024-02-10T08:20:24.726 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.726 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.726 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:20:24.726 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:10.788553+0000", 2024-02-10T08:20:24.726 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.020169640999999999 2024-02-10T08:20:24.726 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.726 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.726 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:20:24.726 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:10.808722+0000", 2024-02-10T08:20:24.726 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4956999999999999e-05 2024-02-10T08:20:24.727 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.727 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.727 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:20:24.727 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:10.808737+0000", 2024-02-10T08:20:24.727 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.021565933999999998 2024-02-10T08:20:24.727 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:24.727 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:24.727 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:24.727 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.727 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.727 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.14784.0:41260 7.2 e98/91 7:40d55899:::benchmark_data_smithi018_80623_object41259:head v 98'2591, mlcod=97'2587)", 2024-02-10T08:20:24.727 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:10.787207+0000", 2024-02-10T08:20:24.727 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 13.877994635, 2024-02-10T08:20:24.727 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.021546465000000001, 2024-02-10T08:20:24.728 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:20:24.728 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:20:24.728 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:20:24.728 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.728 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:20:24.728 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:10.787207+0000", 2024-02-10T08:20:24.728 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:20:24.728 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.728 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.728 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:20:24.728 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:10.787207+0000", 2024-02-10T08:20:24.728 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:20:24.728 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.728 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.728 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:20:24.729 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:10.787206+0000", 2024-02-10T08:20:24.729 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0616999999999999e-05 2024-02-10T08:20:24.729 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.729 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.729 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:20:24.729 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:10.787227+0000", 2024-02-10T08:20:24.729 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2120000000000002e-06 2024-02-10T08:20:24.729 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.729 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.729 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:20:24.729 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:10.787232+0000", 2024-02-10T08:20:24.729 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8589999999999998e-06 2024-02-10T08:20:24.729 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.729 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.729 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:20:24.730 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:10.787236+0000", 2024-02-10T08:20:24.730 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0022357179999999998 2024-02-10T08:20:24.730 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.730 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.730 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:20:24.730 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:10.789472+0000", 2024-02-10T08:20:24.730 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8916e-05 2024-02-10T08:20:24.730 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.730 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.730 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:20:24.730 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:10.789491+0000", 2024-02-10T08:20:24.730 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.019248917000000001 2024-02-10T08:20:24.730 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.730 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.730 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:20:24.730 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:10.808740+0000", 2024-02-10T08:20:24.731 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3521e-05 2024-02-10T08:20:24.731 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.731 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.731 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:20:24.731 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:10.808753+0000", 2024-02-10T08:20:24.731 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.021546465000000001 2024-02-10T08:20:24.731 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:24.731 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:24.731 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:24.731 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.731 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.731 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.14784.0:41259 7.d e98/91 7:b6c89dbb:::benchmark_data_smithi018_80623_object41258:head v 98'2637, mlcod=97'2634)", 2024-02-10T08:20:24.731 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:10.787248+0000", 2024-02-10T08:20:24.731 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 13.877953647, 2024-02-10T08:20:24.731 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.030744337, 2024-02-10T08:20:24.731 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:20:24.732 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:20:24.732 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:20:24.732 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.732 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:20:24.732 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:10.787248+0000", 2024-02-10T08:20:24.732 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:20:24.732 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.732 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.732 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:20:24.732 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:10.787248+0000", 2024-02-10T08:20:24.732 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:20:24.732 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.732 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.732 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:20:24.732 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:10.787247+0000", 2024-02-10T08:20:24.733 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0077999999999999e-05 2024-02-10T08:20:24.733 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.733 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.733 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:20:24.733 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:10.787277+0000", 2024-02-10T08:20:24.733 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8793000000000001e-05 2024-02-10T08:20:24.733 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.733 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.733 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:20:24.733 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:10.787296+0000", 2024-02-10T08:20:24.733 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.092e-06 2024-02-10T08:20:24.733 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.733 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.733 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:20:24.733 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:10.787300+0000", 2024-02-10T08:20:24.734 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.024131393000000001 2024-02-10T08:20:24.734 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.734 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.734 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:20:24.734 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:10.811432+0000", 2024-02-10T08:20:24.734 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1931000000000001e-05 2024-02-10T08:20:24.734 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.734 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.734 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:20:24.734 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:10.811454+0000", 2024-02-10T08:20:24.734 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0064789210000000003 2024-02-10T08:20:24.734 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.734 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.734 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:20:24.734 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:10.817932+0000", 2024-02-10T08:20:24.734 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9655999999999999e-05 2024-02-10T08:20:24.735 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.735 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.735 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:20:24.735 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:10.817992+0000", 2024-02-10T08:20:24.735 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.030744337 2024-02-10T08:20:24.735 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:24.735 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:24.735 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:24.735 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.735 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.735 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.14784.0:41261 7.9 e98/91 7:9ecbc163:::benchmark_data_smithi018_80623_object41260:head v 98'2566, mlcod=97'2564)", 2024-02-10T08:20:24.735 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:10.788064+0000", 2024-02-10T08:20:24.735 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 13.877137052, 2024-02-10T08:20:24.735 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.02068505, 2024-02-10T08:20:24.735 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:20:24.736 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:20:24.736 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:20:24.736 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.736 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:20:24.736 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:10.788064+0000", 2024-02-10T08:20:24.736 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:20:24.736 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.736 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.736 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:20:24.736 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:10.788064+0000", 2024-02-10T08:20:24.736 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:20:24.736 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.736 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.736 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:20:24.737 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:10.788064+0000", 2024-02-10T08:20:24.737 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.4545999999999998e-05 2024-02-10T08:20:24.737 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.737 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.737 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:20:24.737 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:10.788088+0000", 2024-02-10T08:20:24.737 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5024e-05 2024-02-10T08:20:24.737 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.737 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.737 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:20:24.737 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:10.788103+0000", 2024-02-10T08:20:24.737 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3049999999999998e-06 2024-02-10T08:20:24.737 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.737 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.737 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:20:24.738 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:10.788109+0000", 2024-02-10T08:20:24.738 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0030544230000000001 2024-02-10T08:20:24.738 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.738 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.738 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:20:24.738 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:10.791164+0000", 2024-02-10T08:20:24.738 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1318000000000002e-05 2024-02-10T08:20:24.738 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.738 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.738 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:20:24.738 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:10.791185+0000", 2024-02-10T08:20:24.738 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.017526541 2024-02-10T08:20:24.738 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.738 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.739 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:20:24.739 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:10.808712+0000", 2024-02-10T08:20:24.739 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7740000000000001e-05 2024-02-10T08:20:24.739 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.739 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.739 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:20:24.739 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:10.808749+0000", 2024-02-10T08:20:24.739 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.02068505 2024-02-10T08:20:24.739 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:24.739 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:24.739 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:24.739 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.739 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.739 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.14784.0:41262 7.0 e98/91 7:051abc20:::benchmark_data_smithi018_80623_object41261:head v 98'2553, mlcod=97'2551)", 2024-02-10T08:20:24.739 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:10.791373+0000", 2024-02-10T08:20:24.740 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 13.873828499, 2024-02-10T08:20:24.740 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.020040308999999999, 2024-02-10T08:20:24.740 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:20:24.740 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:20:24.740 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:20:24.740 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.740 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:20:24.740 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:10.791373+0000", 2024-02-10T08:20:24.740 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:20:24.740 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.740 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.740 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:20:24.740 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:10.791373+0000", 2024-02-10T08:20:24.740 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:20:24.741 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.741 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.741 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:20:24.741 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:10.791373+0000", 2024-02-10T08:20:24.741 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7617999999999999e-05 2024-02-10T08:20:24.741 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.741 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.741 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:20:24.741 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:10.791400+0000", 2024-02-10T08:20:24.741 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8100000000000004e-06 2024-02-10T08:20:24.741 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.741 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.741 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:20:24.741 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:10.791409+0000", 2024-02-10T08:20:24.742 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5650000000000001e-06 2024-02-10T08:20:24.742 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.742 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.742 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:20:24.742 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:10.791415+0000", 2024-02-10T08:20:24.742 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1223000000000006e-05 2024-02-10T08:20:24.742 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.742 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.742 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:20:24.742 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:10.791486+0000", 2024-02-10T08:20:24.742 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9684999999999999e-05 2024-02-10T08:20:24.742 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.742 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.742 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:20:24.742 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:10.791506+0000", 2024-02-10T08:20:24.742 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.019872312999999999 2024-02-10T08:20:24.743 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.743 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.743 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:20:24.743 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:10.811378+0000", 2024-02-10T08:20:24.743 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5364000000000002e-05 2024-02-10T08:20:24.743 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.743 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.743 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:20:24.743 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:10.811413+0000", 2024-02-10T08:20:24.743 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.020040308999999999 2024-02-10T08:20:24.743 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:24.743 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:24.743 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:24.743 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.743 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.744 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.14784.0:42629 7.4 e99/91 7:26ce868e:::benchmark_data_smithi018_80623_object42628:head v 99'2664, mlcod=98'2662)", 2024-02-10T08:20:24.744 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:11.791087+0000", 2024-02-10T08:20:24.744 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 12.874114519999999, 2024-02-10T08:20:24.744 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.026059866000000001, 2024-02-10T08:20:24.744 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:20:24.744 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:20:24.744 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:20:24.744 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.744 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:20:24.744 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:11.791087+0000", 2024-02-10T08:20:24.744 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:20:24.744 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.744 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.744 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:20:24.744 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:11.791087+0000", 2024-02-10T08:20:24.745 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:20:24.745 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.745 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.745 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:20:24.745 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:11.791086+0000", 2024-02-10T08:20:24.745 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3581e-05 2024-02-10T08:20:24.745 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.745 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.745 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:20:24.745 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:11.791109+0000", 2024-02-10T08:20:24.745 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0256e-05 2024-02-10T08:20:24.745 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.745 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.745 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:20:24.745 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:11.791120+0000", 2024-02-10T08:20:24.746 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8560000000000001e-06 2024-02-10T08:20:24.746 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.746 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.746 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:20:24.746 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:11.791127+0000", 2024-02-10T08:20:24.746 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0015793300000000001 2024-02-10T08:20:24.746 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.746 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.746 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:20:24.746 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:11.792706+0000", 2024-02-10T08:20:24.746 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0831000000000001e-05 2024-02-10T08:20:24.746 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.746 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.746 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:20:24.746 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:11.792727+0000", 2024-02-10T08:20:24.746 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.024396726000000001 2024-02-10T08:20:24.747 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.747 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.747 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:20:24.747 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:11.817123+0000", 2024-02-10T08:20:24.747 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3278999999999999e-05 2024-02-10T08:20:24.747 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.747 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.747 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:20:24.747 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:11.817147+0000", 2024-02-10T08:20:24.747 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.026059866000000001 2024-02-10T08:20:24.747 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:24.747 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:24.747 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:24.747 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.747 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.747 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.14784.0:42633 7.9 e99/91 7:9f05f6c1:::benchmark_data_smithi018_80623_object42632:head v 99'2656, mlcod=98'2654)", 2024-02-10T08:20:24.748 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:11.794316+0000", 2024-02-10T08:20:24.748 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 12.870885263, 2024-02-10T08:20:24.748 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.023198090000000001, 2024-02-10T08:20:24.748 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:20:24.748 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:20:24.748 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:20:24.748 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.748 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:20:24.748 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:11.794316+0000", 2024-02-10T08:20:24.748 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:20:24.748 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.748 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.748 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:20:24.748 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:11.794316+0000", 2024-02-10T08:20:24.748 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:20:24.749 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.749 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.749 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:20:24.749 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:11.794316+0000", 2024-02-10T08:20:24.749 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3550999999999999e-05 2024-02-10T08:20:24.749 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.749 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.749 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:20:24.749 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:11.794339+0000", 2024-02-10T08:20:24.749 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6520000000000001e-06 2024-02-10T08:20:24.749 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.749 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.749 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:20:24.749 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:11.794349+0000", 2024-02-10T08:20:24.749 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9050000000000002e-06 2024-02-10T08:20:24.750 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.750 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.750 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:20:24.750 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:11.794355+0000", 2024-02-10T08:20:24.750 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.003527578 2024-02-10T08:20:24.750 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.750 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.750 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:20:24.750 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:11.797882+0000", 2024-02-10T08:20:24.750 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0941000000000002e-05 2024-02-10T08:20:24.750 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.750 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.750 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:20:24.750 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:11.797903+0000", 2024-02-10T08:20:24.750 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.019582177999999999 2024-02-10T08:20:24.751 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.751 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.751 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:20:24.751 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:11.817485+0000", 2024-02-10T08:20:24.751 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.889e-05 2024-02-10T08:20:24.751 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.751 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.751 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:20:24.751 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:11.817514+0000", 2024-02-10T08:20:24.751 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.023198090000000001 2024-02-10T08:20:24.751 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:24.751 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:24.751 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:24.751 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.751 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.752 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.14784.0:42625 7.2 e99/91 7:442aafb4:::benchmark_data_smithi018_80623_object42624:head v 99'2690, mlcod=99'2688)", 2024-02-10T08:20:24.752 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:11.799408+0000", 2024-02-10T08:20:24.752 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 12.865793209, 2024-02-10T08:20:24.752 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.028182445, 2024-02-10T08:20:24.752 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:20:24.752 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:20:24.752 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:20:24.752 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.752 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:20:24.752 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:11.799408+0000", 2024-02-10T08:20:24.752 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:20:24.752 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.752 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.752 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:20:24.752 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:11.799408+0000", 2024-02-10T08:20:24.753 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:20:24.753 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.753 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.753 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:20:24.753 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:11.799407+0000", 2024-02-10T08:20:24.753 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.4922e-05 2024-02-10T08:20:24.753 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.753 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.753 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:20:24.753 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:11.799432+0000", 2024-02-10T08:20:24.753 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.064e-05 2024-02-10T08:20:24.753 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.753 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.753 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:20:24.753 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:11.799443+0000", 2024-02-10T08:20:24.754 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5030000000000002e-06 2024-02-10T08:20:24.754 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.754 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.754 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:20:24.754 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:11.799449+0000", 2024-02-10T08:20:24.754 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9487999999999999e-05 2024-02-10T08:20:24.754 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.754 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.754 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:20:24.754 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:11.799489+0000", 2024-02-10T08:20:24.754 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0177e-05 2024-02-10T08:20:24.754 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.754 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.754 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:20:24.754 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:11.799509+0000", 2024-02-10T08:20:24.755 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.028061787000000001 2024-02-10T08:20:24.755 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.755 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.755 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:20:24.755 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:11.827571+0000", 2024-02-10T08:20:24.755 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9792e-05 2024-02-10T08:20:24.755 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.755 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.755 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:20:24.755 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:11.827591+0000", 2024-02-10T08:20:24.755 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.028182445 2024-02-10T08:20:24.755 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:24.755 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:24.755 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:24.755 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.755 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.756 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.14784.0:42636 7.2 e99/91 7:45e5caa8:::benchmark_data_smithi018_80623_object42635:head v 99'2691, mlcod=99'2688)", 2024-02-10T08:20:24.756 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:11.799461+0000", 2024-02-10T08:20:24.756 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 12.865739939000001, 2024-02-10T08:20:24.756 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.028145674999999998, 2024-02-10T08:20:24.756 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:20:24.756 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:20:24.756 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:20:24.756 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.756 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:20:24.756 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:11.799461+0000", 2024-02-10T08:20:24.756 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:20:24.756 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.756 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.756 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:20:24.756 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:11.799461+0000", 2024-02-10T08:20:24.757 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:20:24.757 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.757 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.757 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:20:24.757 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:11.799461+0000", 2024-02-10T08:20:24.757 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1032000000000001e-05 2024-02-10T08:20:24.757 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.757 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.757 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:20:24.757 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:11.799482+0000", 2024-02-10T08:20:24.757 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8270000000000003e-06 2024-02-10T08:20:24.757 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.757 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.757 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:20:24.757 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:11.799488+0000", 2024-02-10T08:20:24.757 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2629999999999997e-06 2024-02-10T08:20:24.758 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.758 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.758 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:20:24.758 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:11.799492+0000", 2024-02-10T08:20:24.758 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0097418139999999997 2024-02-10T08:20:24.758 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.758 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.758 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:20:24.758 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:11.809234+0000", 2024-02-10T08:20:24.758 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9477999999999999e-05 2024-02-10T08:20:24.758 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.758 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.758 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:20:24.758 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:11.809253+0000", 2024-02-10T08:20:24.758 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.018339457999999999 2024-02-10T08:20:24.759 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.759 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.759 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:20:24.759 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:11.827593+0000", 2024-02-10T08:20:24.759 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4204e-05 2024-02-10T08:20:24.759 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.759 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.759 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:20:24.759 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:11.827607+0000", 2024-02-10T08:20:24.759 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.028145674999999998 2024-02-10T08:20:24.759 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:24.759 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:24.759 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:24.759 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.759 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.759 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:42641 7.b 7:d7de0539:::benchmark_data_smithi018_80623_object42640:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e99)", 2024-02-10T08:20:24.760 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:11.809190+0000", 2024-02-10T08:20:24.760 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 12.856011131000001, 2024-02-10T08:20:24.760 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.027279332999999999, 2024-02-10T08:20:24.760 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:20:24.760 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:20:24.760 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:20:24.760 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:20:24.760 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:20:24.760 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 42641 2024-02-10T08:20:24.760 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.760 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:20:24.760 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.760 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:20:24.760 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:11.809190+0000", 2024-02-10T08:20:24.760 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:20:24.761 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.761 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.761 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:20:24.761 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:11.809190+0000", 2024-02-10T08:20:24.761 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:20:24.761 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.761 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.761 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:20:24.761 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:11.809189+0000", 2024-02-10T08:20:24.761 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5558000000000001e-05 2024-02-10T08:20:24.761 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.761 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.761 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:20:24.761 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:11.809224+0000", 2024-02-10T08:20:24.761 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1873e-05 2024-02-10T08:20:24.762 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.762 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.762 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:20:24.762 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:11.809236+0000", 2024-02-10T08:20:24.762 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8170000000000001e-06 2024-02-10T08:20:24.762 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.762 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.762 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:20:24.762 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:11.809243+0000", 2024-02-10T08:20:24.762 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8182e-05 2024-02-10T08:20:24.762 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.762 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.762 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:20:24.762 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:11.809291+0000", 2024-02-10T08:20:24.762 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000118552 2024-02-10T08:20:24.763 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.763 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.763 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:20:24.763 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:11.809410+0000", 2024-02-10T08:20:24.763 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014664499999999999 2024-02-10T08:20:24.763 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.763 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.763 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 5,6", 2024-02-10T08:20:24.763 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:11.809556+0000", 2024-02-10T08:20:24.763 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.016766433000000001 2024-02-10T08:20:24.763 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.763 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.763 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:20:24.763 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:11.826323+0000", 2024-02-10T08:20:24.763 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0014517829999999999 2024-02-10T08:20:24.764 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.764 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.764 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:20:24.764 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:11.827775+0000", 2024-02-10T08:20:24.767 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.008603566 2024-02-10T08:20:24.767 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.767 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.767 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:20:24.767 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:11.836378+0000", 2024-02-10T08:20:24.767 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3584000000000001e-05 2024-02-10T08:20:24.767 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.767 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.767 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:20:24.767 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:11.836432+0000", 2024-02-10T08:20:24.768 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7939999999999999e-05 2024-02-10T08:20:24.768 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.768 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.768 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:20:24.768 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:11.836470+0000", 2024-02-10T08:20:24.768 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.027279332999999999 2024-02-10T08:20:24.768 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:24.768 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:24.768 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:24.768 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.768 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.768 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.14784.0:42635 7.9 e99/91 7:9d091a7b:::benchmark_data_smithi018_80623_object42634:head v 99'2657, mlcod=99'2655)", 2024-02-10T08:20:24.768 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:11.822645+0000", 2024-02-10T08:20:24.768 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 12.842556160999999, 2024-02-10T08:20:24.768 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.021423365, 2024-02-10T08:20:24.769 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:20:24.769 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:20:24.769 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:20:24.769 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.769 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:20:24.769 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:11.822645+0000", 2024-02-10T08:20:24.769 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:20:24.769 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.769 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.769 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:20:24.769 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:11.822645+0000", 2024-02-10T08:20:24.769 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:20:24.769 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.769 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.769 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:20:24.770 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:11.822645+0000", 2024-02-10T08:20:24.770 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0653999999999999e-05 2024-02-10T08:20:24.770 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.770 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.770 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:20:24.770 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:11.822666+0000", 2024-02-10T08:20:24.770 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1120000000000001e-06 2024-02-10T08:20:24.770 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.770 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.770 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:20:24.770 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:11.822672+0000", 2024-02-10T08:20:24.770 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.48e-06 2024-02-10T08:20:24.770 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.770 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.770 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:20:24.771 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:11.822677+0000", 2024-02-10T08:20:24.771 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015349905 2024-02-10T08:20:24.771 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.771 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.771 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:20:24.771 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:11.838027+0000", 2024-02-10T08:20:24.771 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7257999999999999e-05 2024-02-10T08:20:24.771 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.771 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.771 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:20:24.771 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:11.838054+0000", 2024-02-10T08:20:24.771 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.005963772 2024-02-10T08:20:24.771 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.771 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.771 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:20:24.772 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:11.844018+0000", 2024-02-10T08:20:24.772 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0521e-05 2024-02-10T08:20:24.772 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.772 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.772 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:20:24.772 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:11.844069+0000", 2024-02-10T08:20:24.772 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.021423365 2024-02-10T08:20:24.772 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:24.772 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:24.772 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:24.772 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.772 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.772 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.14784.0:42642 7.9 e99/91 7:9de0241c:::benchmark_data_smithi018_80623_object42641:head v 99'2658, mlcod=99'2655)", 2024-02-10T08:20:24.772 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:11.824328+0000", 2024-02-10T08:20:24.772 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 12.84087368, 2024-02-10T08:20:24.773 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.019758802999999998, 2024-02-10T08:20:24.773 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:20:24.773 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:20:24.773 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:20:24.773 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.773 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:20:24.773 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:11.824328+0000", 2024-02-10T08:20:24.773 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:20:24.773 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.773 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.773 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:20:24.773 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:11.824328+0000", 2024-02-10T08:20:24.773 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:20:24.773 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.773 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.774 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:20:24.774 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:11.824327+0000", 2024-02-10T08:20:24.774 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1821e-05 2024-02-10T08:20:24.774 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.774 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.774 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:20:24.774 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:11.824349+0000", 2024-02-10T08:20:24.774 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3097e-05 2024-02-10T08:20:24.774 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.774 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.774 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:20:24.774 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:11.824362+0000", 2024-02-10T08:20:24.774 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.981e-06 2024-02-10T08:20:24.774 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.774 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.774 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:20:24.775 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:11.824368+0000", 2024-02-10T08:20:24.775 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015028233 2024-02-10T08:20:24.775 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.775 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.775 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:20:24.775 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:11.839396+0000", 2024-02-10T08:20:24.775 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9276e-05 2024-02-10T08:20:24.775 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.775 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.775 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:20:24.775 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:11.839415+0000", 2024-02-10T08:20:24.775 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.004656416 2024-02-10T08:20:24.775 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.775 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.775 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:20:24.776 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:11.844072+0000", 2024-02-10T08:20:24.776 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.468e-05 2024-02-10T08:20:24.776 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:24.776 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:24.776 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:20:24.776 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:11.844087+0000", 2024-02-10T08:20:24.776 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.019758802999999998 2024-02-10T08:20:24.776 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:24.776 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:24.776 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:24.776 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:24.776 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:24.776 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-02-10T08:20:24.777 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:20:24.777 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:24.778 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:20:24.778 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:20:24.778 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:20:24.779 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:20:24.795 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:20:24.831 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:20:24.831 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-10T08:20:24.831 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-10T08:20:24.831 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-10T08:20:24.831 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-10T08:20:24.831 INFO:teuthology.orchestra.run.smithi018.stderr:Error ENXIO: problem getting command descriptions from osd.4 2024-02-10T08:20:24.831 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-10T08:20:24.832 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-10T08:20:24.832 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-10T08:20:24.879 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:20:24.908 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:24.930 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:20:24.934 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:24.934 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:20:25.035 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:20:25.105 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:24.222154+0000 osd.5 (osd.5) 67 : cluster [DBG] 2.16 scrub starts 2024-02-10T08:20:25.105 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:24.226056+0000 osd.5 (osd.5) 68 : cluster [DBG] 2.16 scrub ok 2024-02-10T08:20:25.105 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:20:24.526052+0000 mon.a (mon.0) 825 : audit [DBG] from='client.? 172.21.15.18:0/1125766614' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:20:25.105 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:24.222154+0000 osd.5 (osd.5) 67 : cluster [DBG] 2.16 scrub starts 2024-02-10T08:20:25.105 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:24.226056+0000 osd.5 (osd.5) 68 : cluster [DBG] 2.16 scrub ok 2024-02-10T08:20:25.105 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:20:24.526052+0000 mon.a (mon.0) 825 : audit [DBG] from='client.? 172.21.15.18:0/1125766614' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:20:25.109 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:25.217 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 35 16 59376 59360 105.932 69 0.0069116 0.0094348 2024-02-10T08:20:25.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:24.222154+0000 osd.5 (osd.5) 67 : cluster [DBG] 2.16 scrub starts 2024-02-10T08:20:25.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:24.226056+0000 osd.5 (osd.5) 68 : cluster [DBG] 2.16 scrub ok 2024-02-10T08:20:25.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:20:24.526052+0000 mon.a (mon.0) 825 : audit [DBG] from='client.? 172.21.15.18:0/1125766614' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:20:25.563 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:20:26.062 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:24.514856+0000 mgr.y (mgr.14505) 141 : cluster [DBG] pgmap v133: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 3.4 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 1023 B/s rd, 79 MiB/s wr, 1.27k op/s; 17598/169017 objects degraded (10.412%) 2024-02-10T08:20:26.063 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:24.961245+0000 osd.2 (osd.2) 57 : cluster [DBG] 2.e scrub starts 2024-02-10T08:20:26.063 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:24.969321+0000 osd.2 (osd.2) 58 : cluster [DBG] 2.e scrub ok 2024-02-10T08:20:26.063 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:25.365484+0000 mon.a (mon.0) 826 : cluster [WRN] Health check update: Degraded data redundancy: 17598/169017 objects degraded (10.412%), 24 pgs degraded (PG_DEGRADED) 2024-02-10T08:20:26.067 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:24.514856+0000 mgr.y (mgr.14505) 141 : cluster [DBG] pgmap v133: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 3.4 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 1023 B/s rd, 79 MiB/s wr, 1.27k op/s; 17598/169017 objects degraded (10.412%) 2024-02-10T08:20:26.067 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:24.961245+0000 osd.2 (osd.2) 57 : cluster [DBG] 2.e scrub starts 2024-02-10T08:20:26.067 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:24.969321+0000 osd.2 (osd.2) 58 : cluster [DBG] 2.e scrub ok 2024-02-10T08:20:26.068 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:25.365484+0000 mon.a (mon.0) 826 : cluster [WRN] Health check update: Degraded data redundancy: 17598/169017 objects degraded (10.412%), 24 pgs degraded (PG_DEGRADED) 2024-02-10T08:20:26.081 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:20:26.085 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:26.086 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:20:26.091 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.2 dump_ops_in_flight 2024-02-10T08:20:26.186 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:20:26.216 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:24.514856+0000 mgr.y (mgr.14505) 141 : cluster [DBG] pgmap v133: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 3.4 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 1023 B/s rd, 79 MiB/s wr, 1.27k op/s; 17598/169017 objects degraded (10.412%) 2024-02-10T08:20:26.216 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:24.961245+0000 osd.2 (osd.2) 57 : cluster [DBG] 2.e scrub starts 2024-02-10T08:20:26.216 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:24.969321+0000 osd.2 (osd.2) 58 : cluster [DBG] 2.e scrub ok 2024-02-10T08:20:26.216 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:25.365484+0000 mon.a (mon.0) 826 : cluster [WRN] Health check update: Degraded data redundancy: 17598/169017 objects degraded (10.412%), 24 pgs degraded (PG_DEGRADED) 2024-02-10T08:20:26.218 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:26.219 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 36 16 60631 60615 105.162 78.4375 0.016051 0.00950353 2024-02-10T08:20:26.239 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:20:26.242 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:26.242 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:20:26.343 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:20:26.414 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:26.518 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:20:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:20:26] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:20:26.587 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:20:26.596 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:26.597 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:20:26.624 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-02-10T08:20:26.625 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-02-10T08:20:26.697 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:20:26.727 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:26.748 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:20:26.751 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:26.751 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:20:26.852 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:20:26.881 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:26.903 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:20:26.906 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:26.906 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:20:27.007 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:20:27.036 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:27.059 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:20:27.062 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:27.063 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:20:27.112 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd set noscrub 2024-02-10T08:20:27.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:26.021557+0000 osd.0 (osd.0) 69 : cluster [DBG] 6.16 scrub starts 2024-02-10T08:20:27.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:26.027314+0000 osd.0 (osd.0) 70 : cluster [DBG] 6.16 scrub ok 2024-02-10T08:20:27.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:26.021557+0000 osd.0 (osd.0) 69 : cluster [DBG] 6.16 scrub starts 2024-02-10T08:20:27.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:26.027314+0000 osd.0 (osd.0) 70 : cluster [DBG] 6.16 scrub ok 2024-02-10T08:20:27.156 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:20:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:20:27] "GET /metrics HTTP/1.1" 200 175351 "" "Prometheus/2.33.4" 2024-02-10T08:20:27.164 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:20:27.223 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 37 16 61723 61707 104.162 68.25 0.0261174 0.0095951 2024-02-10T08:20:27.248 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:27.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:26.021557+0000 osd.0 (osd.0) 69 : cluster [DBG] 6.16 scrub starts 2024-02-10T08:20:27.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:26.027314+0000 osd.0 (osd.0) 70 : cluster [DBG] 6.16 scrub ok 2024-02-10T08:20:27.902 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:20:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:20:27.903 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:26.517289+0000 mgr.y (mgr.14505) 142 : cluster [DBG] pgmap v134: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 3.4 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 1023 B/s rd, 79 MiB/s wr, 1.26k op/s; 17598/169017 objects degraded (10.412%) 2024-02-10T08:20:28.068 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:26.517289+0000 mgr.y (mgr.14505) 142 : cluster [DBG] pgmap v134: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 3.4 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 1023 B/s rd, 79 MiB/s wr, 1.26k op/s; 17598/169017 objects degraded (10.412%) 2024-02-10T08:20:28.070 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:26.517289+0000 mgr.y (mgr.14505) 142 : cluster [DBG] pgmap v134: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 3.4 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 1023 B/s rd, 79 MiB/s wr, 1.26k op/s; 17598/169017 objects degraded (10.412%) 2024-02-10T08:20:28.122 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:20:28.154 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:28.155 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:20:28.155 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:20:28.223 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 38 16 62829 62813 103.236 69.125 0.0172877 0.00968169 2024-02-10T08:20:28.256 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:20:28.328 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:28.471 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:20:28.476 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:28.477 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:20:28.577 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:20:28.626 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-10T08:20:28.643 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:28.821 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:20:28.832 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:28.833 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:20:28.934 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:20:29.072 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:29.222 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 39 16 63789 63773 102.127 60 0.0191895 0.00978649 2024-02-10T08:20:29.264 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:20:29.271 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:29.271 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:20:29.272 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:20:29.273 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:27.589525+0000 osd.1 (osd.1) 77 : cluster [DBG] 4.12 scrub starts 2024-02-10T08:20:29.273 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:27.597538+0000 osd.1 (osd.1) 78 : cluster [DBG] 4.12 scrub ok 2024-02-10T08:20:29.273 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:20:27.625545+0000 mgr.y (mgr.14505) 143 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:20:29.273 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:28.220711+0000 osd.5 (osd.5) 69 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:20:29.273 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:28.220749+0000 osd.5 (osd.5) 70 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:20:29.273 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:27.589525+0000 osd.1 (osd.1) 77 : cluster [DBG] 4.12 scrub starts 2024-02-10T08:20:29.273 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:27.597538+0000 osd.1 (osd.1) 78 : cluster [DBG] 4.12 scrub ok 2024-02-10T08:20:29.273 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:20:27.625545+0000 mgr.y (mgr.14505) 143 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:20:29.273 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:28.220711+0000 osd.5 (osd.5) 69 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:20:29.274 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:28.220749+0000 osd.5 (osd.5) 70 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:20:29.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:27.589525+0000 osd.1 (osd.1) 77 : cluster [DBG] 4.12 scrub starts 2024-02-10T08:20:29.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:27.597538+0000 osd.1 (osd.1) 78 : cluster [DBG] 4.12 scrub ok 2024-02-10T08:20:29.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:20:27.625545+0000 mgr.y (mgr.14505) 143 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:20:29.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:28.220711+0000 osd.5 (osd.5) 69 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:20:29.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:28.220749+0000 osd.5 (osd.5) 70 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:20:29.373 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:20:29.429 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:29.976 INFO:teuthology.orchestra.run.smithi018.stderr:set 4.7 pg_upmap_items mapping to [1->7,6->4,0->5] 2024-02-10T08:20:30.212 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:28.519884+0000 mgr.y (mgr.14505) 144 : cluster [DBG] pgmap v135: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 3.8 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 1023 B/s rd, 74 MiB/s wr, 1.19k op/s; 19439/186447 objects degraded (10.426%) 2024-02-10T08:20:30.212 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:28.944109+0000 mon.a (mon.0) 827 : cluster [DBG] osdmap e101: 8 total, 7 up, 8 in 2024-02-10T08:20:30.212 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:20:29.547810+0000 mon.b (mon.1) 38 : audit [INF] from='client.? 172.21.15.18:0/3091250582' entity='client.admin' cmd=[{"prefix": "osd pg-upmap-items", "pgid": "4.7", "id": [1, 7, 6, 4, 0, 5]}]: dispatch 2024-02-10T08:20:30.212 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:20:29.549008+0000 mon.a (mon.0) 828 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pg-upmap-items", "pgid": "4.7", "id": [1, 7, 6, 4, 0, 5]}]: dispatch 2024-02-10T08:20:30.212 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:28.519884+0000 mgr.y (mgr.14505) 144 : cluster [DBG] pgmap v135: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 3.8 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 1023 B/s rd, 74 MiB/s wr, 1.19k op/s; 19439/186447 objects degraded (10.426%) 2024-02-10T08:20:30.212 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:28.944109+0000 mon.a (mon.0) 827 : cluster [DBG] osdmap e101: 8 total, 7 up, 8 in 2024-02-10T08:20:30.213 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:20:29.547810+0000 mon.b (mon.1) 38 : audit [INF] from='client.? 172.21.15.18:0/3091250582' entity='client.admin' cmd=[{"prefix": "osd pg-upmap-items", "pgid": "4.7", "id": [1, 7, 6, 4, 0, 5]}]: dispatch 2024-02-10T08:20:30.213 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:20:29.549008+0000 mon.a (mon.0) 828 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pg-upmap-items", "pgid": "4.7", "id": [1, 7, 6, 4, 0, 5]}]: dispatch 2024-02-10T08:20:30.223 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:2024-02-10T08:20:30.223129+0000 min lat: 0.0013002 max lat: 0.107766 avg lat: 0.00988304 2024-02-10T08:20:30.223 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-02-10T08:20:30.223 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 40 16 64785 64769 101.131 62.25 0.00496421 0.00988304 2024-02-10T08:20:30.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:28.519884+0000 mgr.y (mgr.14505) 144 : cluster [DBG] pgmap v135: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 3.8 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 1023 B/s rd, 74 MiB/s wr, 1.19k op/s; 19439/186447 objects degraded (10.426%) 2024-02-10T08:20:30.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:28.944109+0000 mon.a (mon.0) 827 : cluster [DBG] osdmap e101: 8 total, 7 up, 8 in 2024-02-10T08:20:30.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:20:29.547810+0000 mon.b (mon.1) 38 : audit [INF] from='client.? 172.21.15.18:0/3091250582' entity='client.admin' cmd=[{"prefix": "osd pg-upmap-items", "pgid": "4.7", "id": [1, 7, 6, 4, 0, 5]}]: dispatch 2024-02-10T08:20:30.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:20:29.549008+0000 mon.a (mon.0) 828 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pg-upmap-items", "pgid": "4.7", "id": [1, 7, 6, 4, 0, 5]}]: dispatch 2024-02-10T08:20:31.001 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:20:29.945699+0000 mon.a (mon.0) 829 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pg-upmap-items", "pgid": "4.7", "id": [1, 7, 6, 4, 0, 5]}]': finished 2024-02-10T08:20:31.001 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:29.945759+0000 mon.a (mon.0) 830 : cluster [DBG] osdmap e102: 8 total, 7 up, 8 in 2024-02-10T08:20:31.001 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:30.224291+0000 osd.3 (osd.3) 81 : cluster [DBG] 6.c deep-scrub starts 2024-02-10T08:20:31.001 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:30.227368+0000 osd.3 (osd.3) 82 : cluster [DBG] 6.c deep-scrub ok 2024-02-10T08:20:31.001 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:30.366905+0000 mon.a (mon.0) 831 : cluster [WRN] Health check update: Degraded data redundancy: 19439/186447 objects degraded (10.426%), 24 pgs degraded (PG_DEGRADED) 2024-02-10T08:20:31.001 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:30.520461+0000 mgr.y (mgr.14505) 145 : cluster [DBG] pgmap v138: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 3.8 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 639 B/s rd, 45 MiB/s wr, 726 op/s; 19439/186447 objects degraded (10.426%) 2024-02-10T08:20:31.002 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:20:29.945699+0000 mon.a (mon.0) 829 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pg-upmap-items", "pgid": "4.7", "id": [1, 7, 6, 4, 0, 5]}]': finished 2024-02-10T08:20:31.225 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 41 16 65902 65886 100.363 69.8125 0.0112367 0.00995913 2024-02-10T08:20:31.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:20:29.945699+0000 mon.a (mon.0) 829 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pg-upmap-items", "pgid": "4.7", "id": [1, 7, 6, 4, 0, 5]}]': finished 2024-02-10T08:20:31.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:29.945759+0000 mon.a (mon.0) 830 : cluster [DBG] osdmap e102: 8 total, 7 up, 8 in 2024-02-10T08:20:31.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:30.224291+0000 osd.3 (osd.3) 81 : cluster [DBG] 6.c deep-scrub starts 2024-02-10T08:20:31.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:30.227368+0000 osd.3 (osd.3) 82 : cluster [DBG] 6.c deep-scrub ok 2024-02-10T08:20:31.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:30.366905+0000 mon.a (mon.0) 831 : cluster [WRN] Health check update: Degraded data redundancy: 19439/186447 objects degraded (10.426%), 24 pgs degraded (PG_DEGRADED) 2024-02-10T08:20:31.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:30.520461+0000 mgr.y (mgr.14505) 145 : cluster [DBG] pgmap v138: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 3.8 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 639 B/s rd, 45 MiB/s wr, 726 op/s; 19439/186447 objects degraded (10.426%) 2024-02-10T08:20:31.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:29.945759+0000 mon.a (mon.0) 830 : cluster [DBG] osdmap e102: 8 total, 7 up, 8 in 2024-02-10T08:20:31.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:30.224291+0000 osd.3 (osd.3) 81 : cluster [DBG] 6.c deep-scrub starts 2024-02-10T08:20:31.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:30.227368+0000 osd.3 (osd.3) 82 : cluster [DBG] 6.c deep-scrub ok 2024-02-10T08:20:31.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:30.366905+0000 mon.a (mon.0) 831 : cluster [WRN] Health check update: Degraded data redundancy: 19439/186447 objects degraded (10.426%), 24 pgs degraded (PG_DEGRADED) 2024-02-10T08:20:31.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:30.520461+0000 mgr.y (mgr.14505) 145 : cluster [DBG] pgmap v138: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 3.8 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 639 B/s rd, 45 MiB/s wr, 726 op/s; 19439/186447 objects degraded (10.426%) 2024-02-10T08:20:32.126 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:20:32.132 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:32.133 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:20:32.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:30.927710+0000 osd.2 (osd.2) 59 : cluster [DBG] 4.1c scrub starts 2024-02-10T08:20:32.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:30.939518+0000 osd.2 (osd.2) 60 : cluster [DBG] 4.1c scrub ok 2024-02-10T08:20:32.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:31.001894+0000 mon.a (mon.0) 832 : cluster [DBG] osdmap e103: 8 total, 7 up, 8 in 2024-02-10T08:20:32.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:20:31.616729+0000 mon.a (mon.0) 833 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:20:32.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:30.927710+0000 osd.2 (osd.2) 59 : cluster [DBG] 4.1c scrub starts 2024-02-10T08:20:32.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:30.939518+0000 osd.2 (osd.2) 60 : cluster [DBG] 4.1c scrub ok 2024-02-10T08:20:32.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:31.001894+0000 mon.a (mon.0) 832 : cluster [DBG] osdmap e103: 8 total, 7 up, 8 in 2024-02-10T08:20:32.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:20:31.616729+0000 mon.a (mon.0) 833 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:20:32.227 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 42 16 67066 67050 99.7056 72.75 0.0195459 0.0100243 2024-02-10T08:20:32.233 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:20:32.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:30.927710+0000 osd.2 (osd.2) 59 : cluster [DBG] 4.1c scrub starts 2024-02-10T08:20:32.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:30.939518+0000 osd.2 (osd.2) 60 : cluster [DBG] 4.1c scrub ok 2024-02-10T08:20:32.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:31.001894+0000 mon.a (mon.0) 832 : cluster [DBG] osdmap e103: 8 total, 7 up, 8 in 2024-02-10T08:20:32.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:20:31.616729+0000 mon.a (mon.0) 833 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:20:32.300 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:33.127 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:31.775221+0000 osd.2 (osd.2) 61 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:20:33.127 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:31.775280+0000 osd.2 (osd.2) 62 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:20:33.128 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:32.119902+0000 osd.5 (osd.5) 71 : cluster [DBG] 5.1b scrub starts 2024-02-10T08:20:33.128 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:32.126003+0000 osd.5 (osd.5) 72 : cluster [DBG] 5.1b scrub ok 2024-02-10T08:20:33.128 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:32.145471+0000 osd.6 (osd.6) 45 : cluster [DBG] 2.14 scrub starts 2024-02-10T08:20:33.128 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:32.148371+0000 osd.6 (osd.6) 46 : cluster [DBG] 2.14 scrub ok 2024-02-10T08:20:33.128 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:32.521719+0000 mgr.y (mgr.14505) 146 : cluster [DBG] pgmap v140: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 4.1 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 1.5 KiB/s rd, 116 MiB/s wr, 1.86k op/s; 21103/202569 objects degraded (10.418%); 54 B/s, 0 objects/s recovering 2024-02-10T08:20:33.128 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:32.623351+0000 mon.a (mon.0) 834 : cluster [DBG] osdmap e104: 8 total, 7 up, 8 in 2024-02-10T08:20:33.128 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:31.775221+0000 osd.2 (osd.2) 61 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:20:33.128 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:31.775280+0000 osd.2 (osd.2) 62 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:20:33.128 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:32.119902+0000 osd.5 (osd.5) 71 : cluster [DBG] 5.1b scrub starts 2024-02-10T08:20:33.129 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:32.126003+0000 osd.5 (osd.5) 72 : cluster [DBG] 5.1b scrub ok 2024-02-10T08:20:33.129 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:32.145471+0000 osd.6 (osd.6) 45 : cluster [DBG] 2.14 scrub starts 2024-02-10T08:20:33.129 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:32.148371+0000 osd.6 (osd.6) 46 : cluster [DBG] 2.14 scrub ok 2024-02-10T08:20:33.129 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:32.521719+0000 mgr.y (mgr.14505) 146 : cluster [DBG] pgmap v140: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 4.1 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 1.5 KiB/s rd, 116 MiB/s wr, 1.86k op/s; 21103/202569 objects degraded (10.418%); 54 B/s, 0 objects/s recovering 2024-02-10T08:20:33.129 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:32.623351+0000 mon.a (mon.0) 834 : cluster [DBG] osdmap e104: 8 total, 7 up, 8 in 2024-02-10T08:20:33.225 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 43 16 68101 68085 98.8916 64.6875 0.00456968 0.010108 2024-02-10T08:20:33.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:31.775221+0000 osd.2 (osd.2) 61 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:20:33.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:31.775280+0000 osd.2 (osd.2) 62 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:20:33.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:32.119902+0000 osd.5 (osd.5) 71 : cluster [DBG] 5.1b scrub starts 2024-02-10T08:20:33.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:32.126003+0000 osd.5 (osd.5) 72 : cluster [DBG] 5.1b scrub ok 2024-02-10T08:20:33.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:32.145471+0000 osd.6 (osd.6) 45 : cluster [DBG] 2.14 scrub starts 2024-02-10T08:20:33.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:32.148371+0000 osd.6 (osd.6) 46 : cluster [DBG] 2.14 scrub ok 2024-02-10T08:20:33.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:32.521719+0000 mgr.y (mgr.14505) 146 : cluster [DBG] pgmap v140: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 4.1 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 1.5 KiB/s rd, 116 MiB/s wr, 1.86k op/s; 21103/202569 objects degraded (10.418%); 54 B/s, 0 objects/s recovering 2024-02-10T08:20:33.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:32.623351+0000 mon.a (mon.0) 834 : cluster [DBG] osdmap e104: 8 total, 7 up, 8 in 2024-02-10T08:20:33.500 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:20:33.507 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:33.508 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:20:33.609 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:20:33.663 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:33.705 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:20:33.708 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:33.709 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:20:33.811 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:20:33.840 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:33.861 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:20:33.865 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:33.865 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:20:33.966 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:20:33.989 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:20:34.048 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:34.080 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is set 2024-02-10T08:20:34.091 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-02-10T08:20:34.091 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-02-10T08:20:34.091 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:34.092 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:68912 7.e 7:7925277d:::benchmark_data_smithi018_80623_object68911:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected e104)", 2024-02-10T08:20:34.092 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:34.053297+0000", 2024-02-10T08:20:34.092 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.015448046, 2024-02-10T08:20:34.092 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015499074999999999, 2024-02-10T08:20:34.092 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:20:34.092 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "waiting for sub ops", 2024-02-10T08:20:34.092 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:20:34.092 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:20:34.092 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:20:34.092 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 68912 2024-02-10T08:20:34.092 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:34.092 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:20:34.092 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:34.092 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:20:34.093 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:34.053297+0000", 2024-02-10T08:20:34.093 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:20:34.093 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:34.093 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:34.093 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:20:34.093 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:34.053297+0000", 2024-02-10T08:20:34.093 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999981 2024-02-10T08:20:34.093 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:34.093 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:34.093 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:20:34.093 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:34.053295+0000", 2024-02-10T08:20:34.093 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.942e-05 2024-02-10T08:20:34.093 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:34.093 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:34.093 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:20:34.094 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:34.053324+0000", 2024-02-10T08:20:34.094 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2897999999999999e-05 2024-02-10T08:20:34.094 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:34.094 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:34.094 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:20:34.094 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:34.053337+0000", 2024-02-10T08:20:34.094 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7789999999999998e-06 2024-02-10T08:20:34.094 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:34.094 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:34.094 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:20:34.094 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:34.053344+0000", 2024-02-10T08:20:34.094 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0159000000000004e-05 2024-02-10T08:20:34.094 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:34.094 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:34.095 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:20:34.095 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:34.053414+0000", 2024-02-10T08:20:34.095 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000148808 2024-02-10T08:20:34.095 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:34.095 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:34.095 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:20:34.095 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:34.053563+0000", 2024-02-10T08:20:34.095 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016182100000000001 2024-02-10T08:20:34.095 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:34.095 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:34.095 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0,5", 2024-02-10T08:20:34.095 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:34.053725+0000", 2024-02-10T08:20:34.095 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0052603909999999997 2024-02-10T08:20:34.095 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:34.096 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:34.096 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:20:34.096 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:34.058985+0000", 2024-02-10T08:20:34.096 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0056883869999999996 2024-02-10T08:20:34.096 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:34.096 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:34.096 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:34.096 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:34.096 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:34.096 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:68918 7.e 7:75a951df:::benchmark_data_smithi018_80623_object68917:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected e104)", 2024-02-10T08:20:34.096 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:34.056219+0000", 2024-02-10T08:20:34.096 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.012525339, 2024-02-10T08:20:34.096 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.012675705000000001, 2024-02-10T08:20:34.096 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:20:34.097 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "waiting for sub ops", 2024-02-10T08:20:34.097 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:20:34.097 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:20:34.097 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:20:34.097 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 68918 2024-02-10T08:20:34.097 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:34.097 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:20:34.097 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:34.097 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:20:34.097 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:34.056219+0000", 2024-02-10T08:20:34.097 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:20:34.097 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:34.097 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:34.097 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:20:34.097 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:34.056219+0000", 2024-02-10T08:20:34.098 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999981 2024-02-10T08:20:34.098 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:34.098 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:34.098 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:20:34.098 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:34.056218+0000", 2024-02-10T08:20:34.098 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7583e-05 2024-02-10T08:20:34.098 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:34.098 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:34.098 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:20:34.098 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:34.056245+0000", 2024-02-10T08:20:34.098 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1986e-05 2024-02-10T08:20:34.099 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:34.099 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:34.099 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:20:34.099 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:34.056257+0000", 2024-02-10T08:20:34.099 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1049999999999997e-06 2024-02-10T08:20:34.099 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:34.100 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:34.100 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:20:34.100 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:34.056264+0000", 2024-02-10T08:20:34.100 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8907999999999998e-05 2024-02-10T08:20:34.100 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:34.100 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:34.100 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:20:34.101 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:34.056333+0000", 2024-02-10T08:20:34.101 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000131626 2024-02-10T08:20:34.101 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:34.101 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:34.101 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:20:34.101 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:34.056465+0000", 2024-02-10T08:20:34.101 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000156813 2024-02-10T08:20:34.101 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:34.101 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:34.101 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0,5", 2024-02-10T08:20:34.101 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:34.056622+0000", 2024-02-10T08:20:34.101 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0025549779999999998 2024-02-10T08:20:34.101 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:34.101 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:34.101 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:20:34.102 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:34.059177+0000", 2024-02-10T08:20:34.102 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0029572679999999999 2024-02-10T08:20:34.102 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:34.102 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:34.102 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:34.102 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:34.102 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-02-10T08:20:34.102 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 2 2024-02-10T08:20:34.102 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-02-10T08:20:34.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:33.192260+0000 osd.3 (osd.3) 83 : cluster [DBG] 5.13 scrub starts 2024-02-10T08:20:34.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:33.201363+0000 osd.3 (osd.3) 84 : cluster [DBG] 5.13 scrub ok 2024-02-10T08:20:34.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:20:33.860851+0000 mon.b (mon.1) 39 : audit [INF] from='client.? 172.21.15.18:0/325822189' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:20:34.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:20:33.863719+0000 mon.a (mon.0) 835 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:20:34.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:33.192260+0000 osd.3 (osd.3) 83 : cluster [DBG] 5.13 scrub starts 2024-02-10T08:20:34.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:33.201363+0000 osd.3 (osd.3) 84 : cluster [DBG] 5.13 scrub ok 2024-02-10T08:20:34.158 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:20:33.860851+0000 mon.b (mon.1) 39 : audit [INF] from='client.? 172.21.15.18:0/325822189' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:20:34.158 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:20:33.863719+0000 mon.a (mon.0) 835 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:20:34.225 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 44 16 69022 69006 97.9527 57.5625 0.0160303 0.0102046 2024-02-10T08:20:34.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:33.192260+0000 osd.3 (osd.3) 83 : cluster [DBG] 5.13 scrub starts 2024-02-10T08:20:34.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:33.201363+0000 osd.3 (osd.3) 84 : cluster [DBG] 5.13 scrub ok 2024-02-10T08:20:34.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:20:33.860851+0000 mon.b (mon.1) 39 : audit [INF] from='client.? 172.21.15.18:0/325822189' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:20:34.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:20:33.863719+0000 mon.a (mon.0) 835 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:20:34.860 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:20:34.873 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:34.874 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:20:34.975 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:20:35.041 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:34.020930+0000 mon.a (mon.0) 836 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:20:35.041 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:20:34.066783+0000 mon.a (mon.0) 837 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-10T08:20:35.041 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:34.066849+0000 mon.a (mon.0) 838 : cluster [DBG] osdmap e105: 8 total, 7 up, 8 in 2024-02-10T08:20:35.041 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:34.522510+0000 mgr.y (mgr.14505) 147 : cluster [DBG] pgmap v143: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 4.1 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 895 B/s rd, 73 MiB/s wr, 1.18k op/s; 21103/202569 objects degraded (10.418%); 72 B/s, 1 objects/s recovering 2024-02-10T08:20:35.046 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:35.165 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:20:35.168 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:35.169 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:20:35.225 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 45 16 70111 70095 97.2888 68.0625 0.0158026 0.0102739 2024-02-10T08:20:35.269 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:20:35.321 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:34.020930+0000 mon.a (mon.0) 836 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:20:35.321 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:20:34.066783+0000 mon.a (mon.0) 837 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-10T08:20:35.321 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:34.066849+0000 mon.a (mon.0) 838 : cluster [DBG] osdmap e105: 8 total, 7 up, 8 in 2024-02-10T08:20:35.321 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:34.522510+0000 mgr.y (mgr.14505) 147 : cluster [DBG] pgmap v143: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 4.1 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 895 B/s rd, 73 MiB/s wr, 1.18k op/s; 21103/202569 objects degraded (10.418%); 72 B/s, 1 objects/s recovering 2024-02-10T08:20:35.327 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:35.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:34.020930+0000 mon.a (mon.0) 836 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:20:35.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:20:34.066783+0000 mon.a (mon.0) 837 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-10T08:20:35.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:34.066849+0000 mon.a (mon.0) 838 : cluster [DBG] osdmap e105: 8 total, 7 up, 8 in 2024-02-10T08:20:35.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:34.522510+0000 mgr.y (mgr.14505) 147 : cluster [DBG] pgmap v143: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 4.1 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 895 B/s rd, 73 MiB/s wr, 1.18k op/s; 21103/202569 objects degraded (10.418%); 72 B/s, 1 objects/s recovering 2024-02-10T08:20:36.226 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 46 16 71159 71143 96.5958 65.5 0.0102548 0.0103472 2024-02-10T08:20:36.300 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:20:36.302 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.2 dump_blocked_ops 2024-02-10T08:20:36.307 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:36.307 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:20:36.358 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:35.368931+0000 mon.a (mon.0) 839 : cluster [WRN] Health check update: Degraded data redundancy: 21103/202569 objects degraded (10.418%), 24 pgs degraded, 52 pgs undersized (PG_DEGRADED) 2024-02-10T08:20:36.358 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:35.384211+0000 mon.a (mon.0) 840 : cluster [DBG] osdmap e106: 8 total, 7 up, 8 in 2024-02-10T08:20:36.363 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:35.368931+0000 mon.a (mon.0) 839 : cluster [WRN] Health check update: Degraded data redundancy: 21103/202569 objects degraded (10.418%), 24 pgs degraded, 52 pgs undersized (PG_DEGRADED) 2024-02-10T08:20:36.364 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:35.384211+0000 mon.a (mon.0) 840 : cluster [DBG] osdmap e106: 8 total, 7 up, 8 in 2024-02-10T08:20:36.408 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:20:36.492 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:36.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:35.368931+0000 mon.a (mon.0) 839 : cluster [WRN] Health check update: Degraded data redundancy: 21103/202569 objects degraded (10.418%), 24 pgs degraded, 52 pgs undersized (PG_DEGRADED) 2024-02-10T08:20:36.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:35.384211+0000 mon.a (mon.0) 840 : cluster [DBG] osdmap e106: 8 total, 7 up, 8 in 2024-02-10T08:20:36.789 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:20:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:20:36] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:20:37.226 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 47 16 72155 72139 95.8653 62.25 0.0183947 0.0104265 2024-02-10T08:20:37.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:36.523667+0000 mgr.y (mgr.14505) 148 : cluster [DBG] pgmap v145: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 4.1 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 742 B/s rd, 61 MiB/s wr, 974 op/s; 21103/202569 objects degraded (10.418%); 59 B/s, 0 objects/s recovering 2024-02-10T08:20:37.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:36.523667+0000 mgr.y (mgr.14505) 148 : cluster [DBG] pgmap v145: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 4.1 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 742 B/s rd, 61 MiB/s wr, 974 op/s; 21103/202569 objects degraded (10.418%); 59 B/s, 0 objects/s recovering 2024-02-10T08:20:37.406 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:20:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:20:37] "GET /metrics HTTP/1.1" 200 175406 "" "Prometheus/2.33.4" 2024-02-10T08:20:37.478 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:20:37.489 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:37.489 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:20:37.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:36.523667+0000 mgr.y (mgr.14505) 148 : cluster [DBG] pgmap v145: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 4.1 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 742 B/s rd, 61 MiB/s wr, 974 op/s; 21103/202569 objects degraded (10.418%); 59 B/s, 0 objects/s recovering 2024-02-10T08:20:37.590 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:20:37.639 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:37.866 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [4] live_osds: [0, 1, 2, 3, 5, 6, 7] 2024-02-10T08:20:37.867 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-10T08:20:37.867 INFO:tasks.thrashosds.thrasher:Reviving osd 4 2024-02-10T08:20:37.867 INFO:tasks.cephadm.osd.4:Restarting osd.4 (starting--it wasn't running)... 2024-02-10T08:20:37.867 DEBUG:teuthology.orchestra.run.smithi071:osd.4> sudo journalctl -f -n 0 -u ceph-d46257c8-c7eb-11ee-95b8-87774f69a715@osd.4.service 2024-02-10T08:20:37.870 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl start ceph-d46257c8-c7eb-11ee-95b8-87774f69a715@osd.4 2024-02-10T08:20:37.892 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:20:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:20:37.899 INFO:journalctl@ceph.osd.4.smithi071.stdout:-- Logs begin at Sat 2024-02-10 07:59:38 UTC. -- 2024-02-10T08:20:38.226 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 48 16 73112 73096 95.1145 59.8125 0.00829523 0.0105014 2024-02-10T08:20:38.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:20:37.635488+0000 mgr.y (mgr.14505) 149 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:20:38.292 INFO:journalctl@ceph.osd.4.smithi071.stdout:Feb 10 08:20:37 smithi071 systemd[1]: Starting Ceph osd.4 for d46257c8-c7eb-11ee-95b8-87774f69a715... 2024-02-10T08:20:38.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:20:37.635488+0000 mgr.y (mgr.14505) 149 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:20:38.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:20:37.635488+0000 mgr.y (mgr.14505) 149 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:20:39.226 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 49 16 74188 74172 94.546 67.25 0.00981678 0.0105723 2024-02-10T08:20:39.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:38.524878+0000 mgr.y (mgr.14505) 150 : cluster [DBG] pgmap v146: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 4.4 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 852 B/s rd, 53 MiB/s wr, 845 op/s; 22623/217773 objects degraded (10.388%) 2024-02-10T08:20:39.290 INFO:journalctl@ceph.osd.4.smithi071.stdout:Feb 10 08:20:38 smithi071 bash[71073]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-02-10T08:20:39.290 INFO:journalctl@ceph.osd.4.smithi071.stdout:Feb 10 08:20:38 smithi071 bash[71073]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-02-10T08:20:39.290 INFO:journalctl@ceph.osd.4.smithi071.stdout:Feb 10 08:20:38 smithi071 bash[71073]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-4 --no-mon-config 2024-02-10T08:20:39.290 INFO:journalctl@ceph.osd.4.smithi071.stdout:Feb 10 08:20:38 smithi071 bash[71073]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-4/block 2024-02-10T08:20:39.290 INFO:journalctl@ceph.osd.4.smithi071.stdout:Feb 10 08:20:38 smithi071 bash[71073]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-4/block 2024-02-10T08:20:39.290 INFO:journalctl@ceph.osd.4.smithi071.stdout:Feb 10 08:20:38 smithi071 bash[71073]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-02-10T08:20:39.290 INFO:journalctl@ceph.osd.4.smithi071.stdout:Feb 10 08:20:38 smithi071 bash[71073]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-02-10T08:20:39.290 INFO:journalctl@ceph.osd.4.smithi071.stdout:Feb 10 08:20:38 smithi071 bash[71073]: --> ceph-volume lvm activate successful for osd ID: 4 2024-02-10T08:20:39.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:38.524878+0000 mgr.y (mgr.14505) 150 : cluster [DBG] pgmap v146: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 4.4 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 852 B/s rd, 53 MiB/s wr, 845 op/s; 22623/217773 objects degraded (10.388%) 2024-02-10T08:20:39.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:38.524878+0000 mgr.y (mgr.14505) 150 : cluster [DBG] pgmap v146: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 4.4 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 852 B/s rd, 53 MiB/s wr, 845 op/s; 22623/217773 objects degraded (10.388%) 2024-02-10T08:20:40.228 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 50 16 75300 75284 94.0453 69.5 0.00985054 0.0106284 2024-02-10T08:20:40.445 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.4 dump_ops_in_flight 2024-02-10T08:20:40.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:40.370533+0000 mon.a (mon.0) 841 : cluster [WRN] Health check update: Degraded data redundancy: 22623/217773 objects degraded (10.388%), 24 pgs degraded, 52 pgs undersized (PG_DEGRADED) 2024-02-10T08:20:40.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:40.377271+0000 mon.a (mon.0) 842 : cluster [DBG] osdmap e107: 8 total, 7 up, 8 in 2024-02-10T08:20:40.790 INFO:journalctl@ceph.osd.4.smithi071.stdout:Feb 10 08:20:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-4[71322]: debug 2024-02-10T08:20:40.354+0000 7fc2c104e700 1 -- 172.21.15.71:0/3738196070 <== mon.1 v2:172.21.15.71:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x555a668a6680 con 0x555a6686d000 2024-02-10T08:20:40.790 INFO:journalctl@ceph.osd.4.smithi071.stdout:Feb 10 08:20:40 smithi071 bash[71308]: 7a88f98f477275cec5d0612cbeb9e090b14fe487e850be947d76f047913aefbf 2024-02-10T08:20:40.790 INFO:journalctl@ceph.osd.4.smithi071.stdout:Feb 10 08:20:40 smithi071 systemd[1]: Started Ceph osd.4 for d46257c8-c7eb-11ee-95b8-87774f69a715. 2024-02-10T08:20:40.831 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:20:40.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:40.370533+0000 mon.a (mon.0) 841 : cluster [WRN] Health check update: Degraded data redundancy: 22623/217773 objects degraded (10.388%), 24 pgs degraded, 52 pgs undersized (PG_DEGRADED) 2024-02-10T08:20:40.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:40.377271+0000 mon.a (mon.0) 842 : cluster [DBG] osdmap e107: 8 total, 7 up, 8 in 2024-02-10T08:20:40.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:40.370533+0000 mon.a (mon.0) 841 : cluster [WRN] Health check update: Degraded data redundancy: 22623/217773 objects degraded (10.388%), 24 pgs degraded, 52 pgs undersized (PG_DEGRADED) 2024-02-10T08:20:40.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:40.377271+0000 mon.a (mon.0) 842 : cluster [DBG] osdmap e107: 8 total, 7 up, 8 in 2024-02-10T08:20:41.142 INFO:journalctl@ceph.osd.4.smithi071.stdout:Feb 10 08:20:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-4[71322]: debug 2024-02-10T08:20:40.873+0000 7fc2c8adc380 -1 Falling back to public interface 2024-02-10T08:20:41.226 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 51 16 76315 76299 93.4453 63.4375 0.0124006 0.0106972 2024-02-10T08:20:41.368 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:20:41.375 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:41.376 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:20:41.477 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:20:41.515 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:41.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:40.525664+0000 mgr.y (mgr.14505) 151 : cluster [DBG] pgmap v148: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 4.4 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 792 B/s rd, 49 MiB/s wr, 785 op/s; 22623/217773 objects degraded (10.388%) 2024-02-10T08:20:41.657 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:40.525664+0000 mgr.y (mgr.14505) 151 : cluster [DBG] pgmap v148: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 4.4 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 792 B/s rd, 49 MiB/s wr, 785 op/s; 22623/217773 objects degraded (10.388%) 2024-02-10T08:20:41.671 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:20:41.674 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:41.675 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:20:41.776 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:20:41.780 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:41 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:40.525664+0000 mgr.y (mgr.14505) 151 : cluster [DBG] pgmap v148: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 4.4 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 792 B/s rd, 49 MiB/s wr, 785 op/s; 22623/217773 objects degraded (10.388%) 2024-02-10T08:20:41.832 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:42.227 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 52 16 77232 77216 92.7508 57.3125 0.00621644 0.010776 2024-02-10T08:20:42.779 INFO:teuthology.orchestra.run.smithi071.stderr:no valid command found; 10 closest matches: 2024-02-10T08:20:42.780 INFO:teuthology.orchestra.run.smithi071.stderr:0 2024-02-10T08:20:42.780 INFO:teuthology.orchestra.run.smithi071.stderr:1 2024-02-10T08:20:42.780 INFO:teuthology.orchestra.run.smithi071.stderr:2 2024-02-10T08:20:42.780 INFO:teuthology.orchestra.run.smithi071.stderr:abort 2024-02-10T08:20:42.780 INFO:teuthology.orchestra.run.smithi071.stderr:assert 2024-02-10T08:20:42.780 INFO:teuthology.orchestra.run.smithi071.stderr:config diff 2024-02-10T08:20:42.780 INFO:teuthology.orchestra.run.smithi071.stderr:config diff get 2024-02-10T08:20:42.780 INFO:teuthology.orchestra.run.smithi071.stderr:config get 2024-02-10T08:20:42.780 INFO:teuthology.orchestra.run.smithi071.stderr:config help [] 2024-02-10T08:20:42.780 INFO:teuthology.orchestra.run.smithi071.stderr:config set ... 2024-02-10T08:20:42.780 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: invalid command 2024-02-10T08:20:43.227 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 53 16 78259 78243 92.2105 64.1875 0.0224006 0.0108404 2024-02-10T08:20:43.613 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-02-10T08:20:43.614 INFO:tasks.cephadm.ceph_manager.ceph:waiting on admin_socket for osd-4, ['dump_ops_in_flight'] 2024-02-10T08:20:43.632 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:43.633 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:20:43.633 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:20:43.734 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:20:43.765 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:43.785 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:20:43.788 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:43.789 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:20:43.889 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:20:43.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:42.527221+0000 mgr.y (mgr.14505) 152 : cluster [DBG] pgmap v149: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 4.7 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1.2 KiB/s rd, 79 MiB/s wr, 1.27k op/s; 24276/233034 objects degraded (10.417%) 2024-02-10T08:20:43.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:43.107012+0000 osd.1 (osd.1) 79 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:20:43.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:43.107068+0000 osd.1 (osd.1) 80 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:20:43.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:42.527221+0000 mgr.y (mgr.14505) 152 : cluster [DBG] pgmap v149: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 4.7 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1.2 KiB/s rd, 79 MiB/s wr, 1.27k op/s; 24276/233034 objects degraded (10.417%) 2024-02-10T08:20:43.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:43.107012+0000 osd.1 (osd.1) 79 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:20:43.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:43.107068+0000 osd.1 (osd.1) 80 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:20:43.917 INFO:journalctl@ceph.osd.4.smithi071.stdout:Feb 10 08:20:43 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-4[71322]: debug 2024-02-10T08:20:43.754+0000 7fc2c8adc380 -1 osd.4 87 log_to_monitors {default=true} 2024-02-10T08:20:43.917 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:43 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:42.527221+0000 mgr.y (mgr.14505) 152 : cluster [DBG] pgmap v149: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 4.7 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1.2 KiB/s rd, 79 MiB/s wr, 1.27k op/s; 24276/233034 objects degraded (10.417%) 2024-02-10T08:20:43.917 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:43 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:43.107012+0000 osd.1 (osd.1) 79 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:20:43.917 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:43 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:43.107068+0000 osd.1 (osd.1) 80 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:20:43.920 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:43.943 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:20:43.947 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:43.948 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:20:44.048 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:20:44.099 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:44.229 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 54 16 79129 79113 91.5099 54.375 0.0318158 0.0109223 2024-02-10T08:20:44.728 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:20:44.728 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:20:44.728 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:20:44.728 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:20:44.728 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:20:44.728 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:20:44.763 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:20:44.770 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:20:44.770 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-10T08:20:44.770 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-10T08:20:44.770 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-10T08:20:44.770 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-10T08:20:44.770 INFO:teuthology.orchestra.run.smithi018.stderr:Error ENXIO: problem getting command descriptions from osd.4 2024-02-10T08:20:44.771 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-10T08:20:44.771 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-10T08:20:44.771 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-10T08:20:44.772 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:44.773 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:20:44.874 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:20:44.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:43.587782+0000 mon.a (mon.0) 843 : cluster [DBG] osdmap e108: 8 total, 7 up, 8 in 2024-02-10T08:20:44.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:20:43.758298+0000 mon.c (mon.2) 26 : audit [INF] from='osd.4 v2:172.21.15.71:6800/3888817642' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-10T08:20:44.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:20:43.758624+0000 mon.a (mon.0) 844 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-10T08:20:44.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:20:44.422660+0000 mon.b (mon.1) 40 : audit [DBG] from='client.? 172.21.15.18:0/1997122271' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:20:44.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:43.587782+0000 mon.a (mon.0) 843 : cluster [DBG] osdmap e108: 8 total, 7 up, 8 in 2024-02-10T08:20:44.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:20:43.758298+0000 mon.c (mon.2) 26 : audit [INF] from='osd.4 v2:172.21.15.71:6800/3888817642' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-10T08:20:44.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:20:43.758624+0000 mon.a (mon.0) 844 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-10T08:20:44.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:20:44.422660+0000 mon.b (mon.1) 40 : audit [DBG] from='client.? 172.21.15.18:0/1997122271' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:20:44.946 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:45.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:44 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:43.587782+0000 mon.a (mon.0) 843 : cluster [DBG] osdmap e108: 8 total, 7 up, 8 in 2024-02-10T08:20:45.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:44 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:20:43.758298+0000 mon.c (mon.2) 26 : audit [INF] from='osd.4 v2:172.21.15.71:6800/3888817642' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-10T08:20:45.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:44 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:20:43.758624+0000 mon.a (mon.0) 844 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-10T08:20:45.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:44 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:20:44.422660+0000 mon.b (mon.1) 40 : audit [DBG] from='client.? 172.21.15.18:0/1997122271' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:20:45.040 INFO:journalctl@ceph.osd.4.smithi071.stdout:Feb 10 08:20:44 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-4[71322]: debug 2024-02-10T08:20:44.620+0000 7fc2ba7c4700 -1 osd.4 87 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-10T08:20:45.065 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:20:45.070 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:45.070 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:20:45.171 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:20:45.204 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:45.228 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 55 16 80012 79996 90.8497 55.1875 0.00680499 0.0110025 2024-02-10T08:20:45.229 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:20:45.234 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:45.235 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:20:45.336 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:20:45.366 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:45.394 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:20:45.405 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:45.406 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:20:45.507 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:20:45.535 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:45.610 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:20:45.615 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:45.615 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:20:45.616 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-02-10T08:20:45.616 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-02-10T08:20:45.656 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:20:45.717 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:20:45.743 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:45.761 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:20:45.763 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:45.763 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:20:45.864 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:20:45.886 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:44.527956+0000 mgr.y (mgr.14505) 153 : cluster [DBG] pgmap v151: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 4.7 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1.2 KiB/s rd, 79 MiB/s wr, 1.27k op/s; 24276/233034 objects degraded (10.417%) 2024-02-10T08:20:45.886 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:20:44.610281+0000 mon.a (mon.0) 845 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-10T08:20:45.887 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:44.610363+0000 mon.a (mon.0) 846 : cluster [DBG] osdmap e109: 8 total, 7 up, 8 in 2024-02-10T08:20:45.887 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:20:44.614332+0000 mon.c (mon.2) 27 : audit [INF] from='osd.4 v2:172.21.15.71:6800/3888817642' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-02-10T08:20:45.887 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:20:44.614933+0000 mon.a (mon.0) 847 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-02-10T08:20:45.887 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:45.372293+0000 mon.a (mon.0) 848 : cluster [WRN] Health check update: Degraded data redundancy: 24276/233034 objects degraded (10.417%), 24 pgs degraded, 57 pgs undersized (PG_DEGRADED) 2024-02-10T08:20:45.887 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:45.373559+0000 mon.a (mon.0) 849 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-10T08:20:45.887 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:45.383326+0000 mon.a (mon.0) 850 : cluster [INF] osd.4 v2:172.21.15.71:6800/3888817642 boot 2024-02-10T08:20:45.887 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:45.383369+0000 mon.a (mon.0) 851 : cluster [DBG] osdmap e110: 8 total, 8 up, 8 in 2024-02-10T08:20:45.887 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:20:45.384771+0000 mon.a (mon.0) 852 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-10T08:20:45.888 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:44.527956+0000 mgr.y (mgr.14505) 153 : cluster [DBG] pgmap v151: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 4.7 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1.2 KiB/s rd, 79 MiB/s wr, 1.27k op/s; 24276/233034 objects degraded (10.417%) 2024-02-10T08:20:45.888 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:20:44.610281+0000 mon.a (mon.0) 845 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-10T08:20:45.888 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:44.610363+0000 mon.a (mon.0) 846 : cluster [DBG] osdmap e109: 8 total, 7 up, 8 in 2024-02-10T08:20:45.888 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:20:44.614332+0000 mon.c (mon.2) 27 : audit [INF] from='osd.4 v2:172.21.15.71:6800/3888817642' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-02-10T08:20:45.888 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:20:44.614933+0000 mon.a (mon.0) 847 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-02-10T08:20:45.888 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:45.372293+0000 mon.a (mon.0) 848 : cluster [WRN] Health check update: Degraded data redundancy: 24276/233034 objects degraded (10.417%), 24 pgs degraded, 57 pgs undersized (PG_DEGRADED) 2024-02-10T08:20:45.888 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:45.373559+0000 mon.a (mon.0) 849 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-10T08:20:45.888 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:45.383326+0000 mon.a (mon.0) 850 : cluster [INF] osd.4 v2:172.21.15.71:6800/3888817642 boot 2024-02-10T08:20:45.888 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:45.383369+0000 mon.a (mon.0) 851 : cluster [DBG] osdmap e110: 8 total, 8 up, 8 in 2024-02-10T08:20:45.888 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:20:45.384771+0000 mon.a (mon.0) 852 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-10T08:20:45.894 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:45.916 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:20:45.918 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:45.919 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:20:46.020 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:20:46.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:44.527956+0000 mgr.y (mgr.14505) 153 : cluster [DBG] pgmap v151: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 4.7 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1.2 KiB/s rd, 79 MiB/s wr, 1.27k op/s; 24276/233034 objects degraded (10.417%) 2024-02-10T08:20:46.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:20:44.610281+0000 mon.a (mon.0) 845 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-10T08:20:46.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:44.610363+0000 mon.a (mon.0) 846 : cluster [DBG] osdmap e109: 8 total, 7 up, 8 in 2024-02-10T08:20:46.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:20:44.614332+0000 mon.c (mon.2) 27 : audit [INF] from='osd.4 v2:172.21.15.71:6800/3888817642' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-02-10T08:20:46.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:20:44.614933+0000 mon.a (mon.0) 847 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-02-10T08:20:46.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:45.372293+0000 mon.a (mon.0) 848 : cluster [WRN] Health check update: Degraded data redundancy: 24276/233034 objects degraded (10.417%), 24 pgs degraded, 57 pgs undersized (PG_DEGRADED) 2024-02-10T08:20:46.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:45.373559+0000 mon.a (mon.0) 849 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-10T08:20:46.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:45.383326+0000 mon.a (mon.0) 850 : cluster [INF] osd.4 v2:172.21.15.71:6800/3888817642 boot 2024-02-10T08:20:46.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:45.383369+0000 mon.a (mon.0) 851 : cluster [DBG] osdmap e110: 8 total, 8 up, 8 in 2024-02-10T08:20:46.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:20:45.384771+0000 mon.a (mon.0) 852 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-10T08:20:46.046 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:46.064 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:20:46.067 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:46.067 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:20:46.168 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:20:46.197 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:46.228 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 56 16 80221 80205 89.4613 13.0625 0.00228607 0.0110133 2024-02-10T08:20:46.395 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:20:46.403 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:46.404 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:20:46.504 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:20:46.533 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:46.789 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:20:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:20:46] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:20:46.794 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd set nodeep-scrub 2024-02-10T08:20:46.883 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:20:46.887 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:46.887 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:20:46.988 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:20:47.016 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:47.148 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:20:47.154 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:47.154 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:20:47.228 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 57 16 80221 80205 87.8925 0 - 0.0110133 2024-02-10T08:20:47.256 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:20:47.284 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:47.395 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:20:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:20:47] "GET /metrics HTTP/1.1" 200 175124 "" "Prometheus/2.33.4" 2024-02-10T08:20:47.398 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:44.738921+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:20:47.399 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:44.738988+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:20:47.399 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:46.380206+0000 osd.0 (osd.0) 71 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:20:47.399 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:46.380256+0000 osd.0 (osd.0) 72 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:20:47.399 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:46.384541+0000 mon.a (mon.0) 853 : cluster [DBG] osdmap e111: 8 total, 8 up, 8 in 2024-02-10T08:20:47.399 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:46.528547+0000 mgr.y (mgr.14505) 154 : cluster [DBG] pgmap v155: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 4.7 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 24276/233034 objects degraded (10.417%) 2024-02-10T08:20:47.399 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:20:46.607439+0000 mon.a (mon.0) 854 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:20:47.407 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:20:47.412 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:47.413 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:20:47.453 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-02-10T08:20:47.453 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:20:47.455 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:20:47.514 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:20:47.542 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:47.617 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-10T08:20:47.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:44.738921+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:20:47.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:44.738988+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:20:47.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:46.380206+0000 osd.0 (osd.0) 71 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:20:47.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:46.380256+0000 osd.0 (osd.0) 72 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:20:47.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:46.384541+0000 mon.a (mon.0) 853 : cluster [DBG] osdmap e111: 8 total, 8 up, 8 in 2024-02-10T08:20:47.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:46.528547+0000 mgr.y (mgr.14505) 154 : cluster [DBG] pgmap v155: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 4.7 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 24276/233034 objects degraded (10.417%) 2024-02-10T08:20:47.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:20:46.607439+0000 mon.a (mon.0) 854 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:20:47.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:44.738921+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:20:47.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:44.738988+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:20:47.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:46.380206+0000 osd.0 (osd.0) 71 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:20:47.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:46.380256+0000 osd.0 (osd.0) 72 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:20:47.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:46.384541+0000 mon.a (mon.0) 853 : cluster [DBG] osdmap e111: 8 total, 8 up, 8 in 2024-02-10T08:20:47.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:46.528547+0000 mgr.y (mgr.14505) 154 : cluster [DBG] pgmap v155: 148 pgs: 24 active+undersized+degraded, 33 active+undersized, 91 active+clean; 4.7 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 24276/233034 objects degraded (10.417%) 2024-02-10T08:20:47.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:20:46.607439+0000 mon.a (mon.0) 854 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:20:47.790 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:20:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:20:47.795 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:20:47.798 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:47.798 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:20:47.899 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:20:47.941 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:48.179 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:20:48.183 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:48.184 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:20:48.230 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 58 16 80428 80412 86.5981 6.46875 0.0189707 0.0115413 2024-02-10T08:20:48.285 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:20:48.391 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:48.581 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:20:48.588 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:48.588 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:20:48.590 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:47.384461+0000 osd.3 (osd.3) 85 : cluster [DBG] 7.1 starting backfill to osd.4 from (0'0,0'0] MAX to 109'5020 2024-02-10T08:20:48.591 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:47.385798+0000 mon.a (mon.0) 855 : cluster [DBG] osdmap e112: 8 total, 8 up, 8 in 2024-02-10T08:20:48.591 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:47.392709+0000 osd.3 (osd.3) 86 : cluster [DBG] 7.3 starting backfill to osd.4 from (0'0,0'0] MAX to 109'4974 2024-02-10T08:20:48.591 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:20:47.636728+0000 mgr.y (mgr.14505) 155 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:20:48.591 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:47.384461+0000 osd.3 (osd.3) 85 : cluster [DBG] 7.1 starting backfill to osd.4 from (0'0,0'0] MAX to 109'5020 2024-02-10T08:20:48.591 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:47.385798+0000 mon.a (mon.0) 855 : cluster [DBG] osdmap e112: 8 total, 8 up, 8 in 2024-02-10T08:20:48.591 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:47.392709+0000 osd.3 (osd.3) 86 : cluster [DBG] 7.3 starting backfill to osd.4 from (0'0,0'0] MAX to 109'4974 2024-02-10T08:20:48.591 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:20:47.636728+0000 mgr.y (mgr.14505) 155 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:20:48.615 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.4 dump_ops_in_flight 2024-02-10T08:20:48.690 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:20:48.775 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:48.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:47.384461+0000 osd.3 (osd.3) 85 : cluster [DBG] 7.1 starting backfill to osd.4 from (0'0,0'0] MAX to 109'5020 2024-02-10T08:20:48.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:47.385798+0000 mon.a (mon.0) 855 : cluster [DBG] osdmap e112: 8 total, 8 up, 8 in 2024-02-10T08:20:48.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:47.392709+0000 osd.3 (osd.3) 86 : cluster [DBG] 7.3 starting backfill to osd.4 from (0'0,0'0] MAX to 109'4974 2024-02-10T08:20:48.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:20:47.636728+0000 mgr.y (mgr.14505) 155 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:20:48.950 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:20:49.159 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:20:49.166 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:49.167 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:20:49.198 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:20:49.230 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 59 16 81098 81082 85.8398 41.875 0.0163688 0.011642 2024-02-10T08:20:49.268 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:20:49.300 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:49.324 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:20:49.329 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:49.329 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:20:49.430 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:20:49.461 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:49.493 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:49 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:48.529522+0000 mgr.y (mgr.14505) 156 : cluster [DBG] pgmap v157: 148 pgs: 5 activating+undersized+degraded+remapped, 11 active+undersized+degraded, 8 active+undersized, 124 active+clean; 4.9 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1.2 KiB/s rd, 43 MiB/s wr, 681 op/s; 25049/241200 objects degraded (10.385%) 2024-02-10T08:20:49.717 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:48.529522+0000 mgr.y (mgr.14505) 156 : cluster [DBG] pgmap v157: 148 pgs: 5 activating+undersized+degraded+remapped, 11 active+undersized+degraded, 8 active+undersized, 124 active+clean; 4.9 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1.2 KiB/s rd, 43 MiB/s wr, 681 op/s; 25049/241200 objects degraded (10.385%) 2024-02-10T08:20:49.718 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:48.529522+0000 mgr.y (mgr.14505) 156 : cluster [DBG] pgmap v157: 148 pgs: 5 activating+undersized+degraded+remapped, 11 active+undersized+degraded, 8 active+undersized, 124 active+clean; 4.9 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1.2 KiB/s rd, 43 MiB/s wr, 681 op/s; 25049/241200 objects degraded (10.385%) 2024-02-10T08:20:49.757 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.2 dump_historic_ops 2024-02-10T08:20:49.823 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:20:49.826 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:49.827 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:20:49.928 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:20:49.961 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:50.232 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:2024-02-10T08:20:50.232046+0000 min lat: 0.0013002 max lat: 2.58205 avg lat: 0.0117478 2024-02-10T08:20:50.232 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-02-10T08:20:50.232 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 60 16 81740 81724 85.0769 40.125 0.0143606 0.0117478 2024-02-10T08:20:50.513 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:20:50.516 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:50.517 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:20:50.618 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:20:50.647 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:50.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:50.380426+0000 mon.a (mon.0) 856 : cluster [WRN] Health check update: Degraded data redundancy: 25049/241200 objects degraded (10.385%), 16 pgs degraded, 19 pgs undersized (PG_DEGRADED) 2024-02-10T08:20:50.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:50.404176+0000 mon.a (mon.0) 857 : cluster [DBG] osdmap e113: 8 total, 8 up, 8 in 2024-02-10T08:20:50.796 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:50.380426+0000 mon.a (mon.0) 856 : cluster [WRN] Health check update: Degraded data redundancy: 25049/241200 objects degraded (10.385%), 16 pgs degraded, 19 pgs undersized (PG_DEGRADED) 2024-02-10T08:20:50.796 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:50.404176+0000 mon.a (mon.0) 857 : cluster [DBG] osdmap e113: 8 total, 8 up, 8 in 2024-02-10T08:20:50.796 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:50.380426+0000 mon.a (mon.0) 856 : cluster [WRN] Health check update: Degraded data redundancy: 25049/241200 objects degraded (10.385%), 16 pgs degraded, 19 pgs undersized (PG_DEGRADED) 2024-02-10T08:20:50.796 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:50.404176+0000 mon.a (mon.0) 857 : cluster [DBG] osdmap e113: 8 total, 8 up, 8 in 2024-02-10T08:20:50.802 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:20:50.806 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:50.807 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:20:50.907 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:20:50.940 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:50.969 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:20:50.973 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:50.973 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:20:51.074 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:20:51.119 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-02-10T08:20:51.120 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-02-10T08:20:51.120 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:20:51.120 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.14784.0:82283 7.4 e113/111 7:27f30d0c:::benchmark_data_smithi018_80623_object82282:head v 113'5158, mlcod=95'85)", 2024-02-10T08:20:51.120 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:20:51.117179+0000", 2024-02-10T08:20:51.120 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.002220049, 2024-02-10T08:20:51.120 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022424509999999999, 2024-02-10T08:20:51.120 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:20:51.120 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-02-10T08:20:51.120 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:20:51.120 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:20:51.120 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:20:51.120 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:51.117179+0000", 2024-02-10T08:20:51.121 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:20:51.121 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:20:51.121 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:20:51.121 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:20:51.121 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:51.117179+0000", 2024-02-10T08:20:51.121 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-02-10T08:20:51.121 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:20:51.121 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:20:51.121 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:20:51.121 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:51.117178+0000", 2024-02-10T08:20:51.121 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0309000000000002e-05 2024-02-10T08:20:51.121 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:20:51.121 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:20:51.121 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:20:51.122 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:51.117228+0000", 2024-02-10T08:20:51.122 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2095e-05 2024-02-10T08:20:51.122 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:20:51.122 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:20:51.122 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:20:51.122 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:51.117241+0000", 2024-02-10T08:20:51.122 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2310000000000001e-06 2024-02-10T08:20:51.122 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:20:51.122 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:20:51.122 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:20:51.122 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:51.117247+0000", 2024-02-10T08:20:51.122 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2407000000000002e-05 2024-02-10T08:20:51.122 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:20:51.122 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:20:51.122 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:20:51.123 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:51.117299+0000", 2024-02-10T08:20:51.123 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2523000000000001e-05 2024-02-10T08:20:51.123 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:20:51.123 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:20:51.123 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:20:51.123 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:51.117322+0000", 2024-02-10T08:20:51.123 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014248599999999999 2024-02-10T08:20:51.123 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:20:51.123 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:20:51.123 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:20:51.123 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:20:51.123 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-02-10T08:20:51.123 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 1 2024-02-10T08:20:51.123 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-02-10T08:20:51.169 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:51.232 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 61 16 82355 82339 84.3121 38.4375 0.0183102 0.0118539 2024-02-10T08:20:51.410 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:20:51.420 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:51.420 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:20:51.521 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:20:51.527 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is set 2024-02-10T08:20:51.612 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:51.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:51 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:50.529975+0000 mgr.y (mgr.14505) 157 : cluster [DBG] pgmap v159: 148 pgs: 5 activating+undersized+degraded+remapped, 143 active+clean; 4.9 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1.2 KiB/s rd, 33 MiB/s wr, 529 op/s; 25001/241200 objects degraded (10.365%) 2024-02-10T08:20:51.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:51 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:20:50.964448+0000 mon.a (mon.0) 858 : audit [INF] from='client.? 172.21.15.18:0/2436665035' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:20:51.907 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:50.529975+0000 mgr.y (mgr.14505) 157 : cluster [DBG] pgmap v159: 148 pgs: 5 activating+undersized+degraded+remapped, 143 active+clean; 4.9 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1.2 KiB/s rd, 33 MiB/s wr, 529 op/s; 25001/241200 objects degraded (10.365%) 2024-02-10T08:20:51.907 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:20:50.964448+0000 mon.a (mon.0) 858 : audit [INF] from='client.? 172.21.15.18:0/2436665035' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:20:51.907 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:50.529975+0000 mgr.y (mgr.14505) 157 : cluster [DBG] pgmap v159: 148 pgs: 5 activating+undersized+degraded+remapped, 143 active+clean; 4.9 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1.2 KiB/s rd, 33 MiB/s wr, 529 op/s; 25001/241200 objects degraded (10.365%) 2024-02-10T08:20:51.908 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:20:50.964448+0000 mon.a (mon.0) 858 : audit [INF] from='client.? 172.21.15.18:0/2436665035' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:20:51.992 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:20:52.000 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:52.001 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:20:52.101 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:20:52.135 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:52.156 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:20:52.160 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:52.160 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:20:52.232 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 62 16 83011 82995 83.6138 41 0.0139874 0.011953 2024-02-10T08:20:52.261 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:20:52.279 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:20:52.356 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:52.658 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:51.482850+0000 mon.a (mon.0) 859 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:20:52.659 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:20:51.505540+0000 mon.a (mon.0) 860 : audit [INF] from='client.? 172.21.15.18:0/2436665035' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-10T08:20:52.659 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:51.505586+0000 mon.a (mon.0) 861 : cluster [DBG] osdmap e114: 8 total, 8 up, 8 in 2024-02-10T08:20:52.659 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:51.482850+0000 mon.a (mon.0) 859 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:20:52.659 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:20:51.505540+0000 mon.a (mon.0) 860 : audit [INF] from='client.? 172.21.15.18:0/2436665035' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-10T08:20:52.659 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:51.505586+0000 mon.a (mon.0) 861 : cluster [DBG] osdmap e114: 8 total, 8 up, 8 in 2024-02-10T08:20:52.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:52 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:51.482850+0000 mon.a (mon.0) 859 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:20:52.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:52 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:20:51.505540+0000 mon.a (mon.0) 860 : audit [INF] from='client.? 172.21.15.18:0/2436665035' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-10T08:20:52.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:52 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:51.505586+0000 mon.a (mon.0) 861 : cluster [DBG] osdmap e114: 8 total, 8 up, 8 in 2024-02-10T08:20:52.872 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:20:52.875 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:52.876 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:20:52.976 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:20:53.031 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:53.182 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:20:53.191 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:53.191 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:20:53.232 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 63 16 83684 83668 82.9544 42.0625 0.0308219 0.0120498 2024-02-10T08:20:53.293 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:20:53.389 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:53.509 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:20:53.512 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:53.513 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:20:53.614 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:20:53.689 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:53.779 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:20:53.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:53 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:52.531596+0000 mgr.y (mgr.14505) 158 : cluster [DBG] pgmap v161: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 5.1 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1.8 KiB/s rd, 59 MiB/s wr, 948 op/s; 25012/250086 objects degraded (10.001%); 3.7 MiB/s, 58 objects/s recovering 2024-02-10T08:20:53.814 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:20:53.816 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:52.531596+0000 mgr.y (mgr.14505) 158 : cluster [DBG] pgmap v161: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 5.1 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1.8 KiB/s rd, 59 MiB/s wr, 948 op/s; 25012/250086 objects degraded (10.001%); 3.7 MiB/s, 58 objects/s recovering 2024-02-10T08:20:53.817 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:52.531596+0000 mgr.y (mgr.14505) 158 : cluster [DBG] pgmap v161: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 5.1 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1.8 KiB/s rd, 59 MiB/s wr, 948 op/s; 25012/250086 objects degraded (10.001%); 3.7 MiB/s, 58 objects/s recovering 2024-02-10T08:20:53.822 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:53.823 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:20:53.835 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:20:53.889 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:20:53.924 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:20:53.933 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:20:53.960 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:20:53.993 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:54.002 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:20:54.053 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:20:54.089 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:20:54.129 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-10T08:20:54.130 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-10T08:20:54.130 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-10T08:20:54.130 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-10T08:20:54.130 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-10T08:20:54.130 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-10T08:20:54.130 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-10T08:20:54.130 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-10T08:20:54.234 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 64 16 84287 84271 82.2458 37.6875 0.022361 0.0121512 2024-02-10T08:20:54.757 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:20:54.761 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:54.761 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:20:54.831 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd unset noscrub 2024-02-10T08:20:54.862 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:20:54.892 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:53.502569+0000 mon.a (mon.0) 862 : cluster [WRN] Health check failed: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull (PG_BACKFILL_FULL) 2024-02-10T08:20:54.892 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:20:53.679064+0000 mon.c (mon.2) 28 : audit [DBG] from='client.? 172.21.15.18:0/670322653' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:20:54.893 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:53.502569+0000 mon.a (mon.0) 862 : cluster [WRN] Health check failed: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull (PG_BACKFILL_FULL) 2024-02-10T08:20:54.893 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:20:53.679064+0000 mon.c (mon.2) 28 : audit [DBG] from='client.? 172.21.15.18:0/670322653' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:20:54.969 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:55.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:54 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:53.502569+0000 mon.a (mon.0) 862 : cluster [WRN] Health check failed: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull (PG_BACKFILL_FULL) 2024-02-10T08:20:55.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:54 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:20:53.679064+0000 mon.c (mon.2) 28 : audit [DBG] from='client.? 172.21.15.18:0/670322653' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:20:55.234 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 65 16 84938 84922 81.6067 40.6875 0.00817762 0.0122482 2024-02-10T08:20:55.364 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:20:55.373 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:55.373 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:20:55.474 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:20:55.512 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:55.539 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:20:55.543 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:55.543 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:20:55.644 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:20:55.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:54.533452+0000 mgr.y (mgr.14505) 159 : cluster [DBG] pgmap v162: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 5.1 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1.5 KiB/s rd, 50 MiB/s wr, 796 op/s; 25012/250086 objects degraded (10.001%); 3.1 MiB/s, 49 objects/s recovering 2024-02-10T08:20:55.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:55.384930+0000 mon.a (mon.0) 863 : cluster [WRN] Health check update: Degraded data redundancy: 25012/250086 objects degraded (10.001%), 5 pgs degraded (PG_DEGRADED) 2024-02-10T08:20:55.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:55.415835+0000 mon.a (mon.0) 864 : cluster [DBG] osdmap e115: 8 total, 8 up, 8 in 2024-02-10T08:20:55.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:54.533452+0000 mgr.y (mgr.14505) 159 : cluster [DBG] pgmap v162: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 5.1 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1.5 KiB/s rd, 50 MiB/s wr, 796 op/s; 25012/250086 objects degraded (10.001%); 3.1 MiB/s, 49 objects/s recovering 2024-02-10T08:20:55.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:55.384930+0000 mon.a (mon.0) 863 : cluster [WRN] Health check update: Degraded data redundancy: 25012/250086 objects degraded (10.001%), 5 pgs degraded (PG_DEGRADED) 2024-02-10T08:20:55.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:55.415835+0000 mon.a (mon.0) 864 : cluster [DBG] osdmap e115: 8 total, 8 up, 8 in 2024-02-10T08:20:55.681 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:55.704 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:20:55.708 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:55.708 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:20:55.791 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:54.533452+0000 mgr.y (mgr.14505) 159 : cluster [DBG] pgmap v162: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 5.1 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1.5 KiB/s rd, 50 MiB/s wr, 796 op/s; 25012/250086 objects degraded (10.001%); 3.1 MiB/s, 49 objects/s recovering 2024-02-10T08:20:55.791 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:55.384930+0000 mon.a (mon.0) 863 : cluster [WRN] Health check update: Degraded data redundancy: 25012/250086 objects degraded (10.001%), 5 pgs degraded (PG_DEGRADED) 2024-02-10T08:20:55.791 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:55.415835+0000 mon.a (mon.0) 864 : cluster [DBG] osdmap e115: 8 total, 8 up, 8 in 2024-02-10T08:20:55.809 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:20:55.841 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:55.866 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:20:55.869 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:55.869 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:20:55.970 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:20:56.000 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:56.023 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:20:56.027 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:56.027 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:20:56.128 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:20:56.155 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:56.186 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:20:56.189 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:56.189 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:20:56.234 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 66 16 85608 85592 81.0043 41.875 0.0250412 0.0123392 2024-02-10T08:20:56.290 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:20:56.377 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:56.520 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:20:56.523 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:56.523 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:20:56.624 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:20:56.645 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:20:56.715 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-02-10T08:20:56.716 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-02-10T08:20:56.716 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-02-10T08:20:56.716 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-02-10T08:20:56.716 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.716 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:26617 7.e 7:7ed9de84:::benchmark_data_smithi018_80623_object26616:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e96)", 2024-02-10T08:20:56.716 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:01.755206+0000", 2024-02-10T08:20:56.716 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 54.956422992, 2024-02-10T08:20:56.716 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.062528802999999994, 2024-02-10T08:20:56.716 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:20:56.716 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:20:56.716 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:20:56.716 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:20:56.717 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:20:56.717 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 26617 2024-02-10T08:20:56.717 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.717 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:20:56.717 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.717 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:20:56.717 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:01.755206+0000", 2024-02-10T08:20:56.717 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:20:56.717 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.717 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.717 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:20:56.717 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:01.755206+0000", 2024-02-10T08:20:56.717 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999981 2024-02-10T08:20:56.717 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.717 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.718 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:20:56.718 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:01.755205+0000", 2024-02-10T08:20:56.718 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.6333999999999999e-05 2024-02-10T08:20:56.718 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.718 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.718 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:20:56.718 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:01.755231+0000", 2024-02-10T08:20:56.718 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1654000000000001e-05 2024-02-10T08:20:56.718 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.718 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.718 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:20:56.718 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:01.755243+0000", 2024-02-10T08:20:56.718 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9920000000000001e-06 2024-02-10T08:20:56.718 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.719 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.719 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:20:56.719 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:01.755250+0000", 2024-02-10T08:20:56.719 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001178704 2024-02-10T08:20:56.719 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.719 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.719 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:20:56.719 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:01.756428+0000", 2024-02-10T08:20:56.719 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000113849 2024-02-10T08:20:56.719 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.719 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.720 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:20:56.720 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:01.756542+0000", 2024-02-10T08:20:56.720 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000140059 2024-02-10T08:20:56.720 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.720 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.720 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0,5", 2024-02-10T08:20:56.720 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:01.756682+0000", 2024-02-10T08:20:56.720 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001184322 2024-02-10T08:20:56.720 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.720 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.720 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:20:56.720 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:01.757867+0000", 2024-02-10T08:20:56.720 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00049811199999999999 2024-02-10T08:20:56.721 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.721 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.721 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:20:56.721 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:01.758365+0000", 2024-02-10T08:20:56.721 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059280685999999999 2024-02-10T08:20:56.721 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.721 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.721 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:20:56.721 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:01.817645+0000", 2024-02-10T08:20:56.721 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0720000000000002e-05 2024-02-10T08:20:56.721 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.721 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.721 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:20:56.721 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:01.817696+0000", 2024-02-10T08:20:56.721 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9042000000000003e-05 2024-02-10T08:20:56.722 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.722 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.722 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:20:56.722 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:01.817735+0000", 2024-02-10T08:20:56.722 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.062528802999999994 2024-02-10T08:20:56.722 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:56.722 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:56.722 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:56.722 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.722 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.722 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:29661 7.e 7:73e85c20:::benchmark_data_smithi018_80623_object29660:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e96)", 2024-02-10T08:20:56.722 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:03.388471+0000", 2024-02-10T08:20:56.722 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 53.323158093000004, 2024-02-10T08:20:56.722 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.100315289, 2024-02-10T08:20:56.722 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:20:56.723 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:20:56.723 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:20:56.723 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:20:56.723 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:20:56.723 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 29661 2024-02-10T08:20:56.723 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.723 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:20:56.723 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.723 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:20:56.723 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.388471+0000", 2024-02-10T08:20:56.723 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:20:56.723 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.723 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.723 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:20:56.724 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.388471+0000", 2024-02-10T08:20:56.724 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999981 2024-02-10T08:20:56.724 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.725 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.725 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:20:56.725 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.388469+0000", 2024-02-10T08:20:56.725 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.6262999999999999e-05 2024-02-10T08:20:56.725 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.725 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.725 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:20:56.725 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.388496+0000", 2024-02-10T08:20:56.725 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1531e-05 2024-02-10T08:20:56.725 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.725 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.725 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:20:56.726 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.388507+0000", 2024-02-10T08:20:56.726 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8689999999999998e-06 2024-02-10T08:20:56.726 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.726 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.726 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:20:56.726 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.388514+0000", 2024-02-10T08:20:56.726 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6048999999999999e-05 2024-02-10T08:20:56.726 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.726 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.726 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:20:56.726 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.388560+0000", 2024-02-10T08:20:56.726 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000119809 2024-02-10T08:20:56.726 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.726 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.726 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:20:56.727 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.388680+0000", 2024-02-10T08:20:56.727 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014598500000000001 2024-02-10T08:20:56.727 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.727 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.727 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0,5", 2024-02-10T08:20:56.727 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.388826+0000", 2024-02-10T08:20:56.727 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0013111589999999999 2024-02-10T08:20:56.727 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.727 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.727 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:20:56.727 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.390137+0000", 2024-02-10T08:20:56.727 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4440000000000002e-05 2024-02-10T08:20:56.727 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.727 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.727 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:20:56.727 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.390172+0000", 2024-02-10T08:20:56.728 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.098523346999999997 2024-02-10T08:20:56.728 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.728 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.728 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:20:56.728 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.488695+0000", 2024-02-10T08:20:56.728 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1742e-05 2024-02-10T08:20:56.728 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.728 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.728 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:20:56.728 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.488747+0000", 2024-02-10T08:20:56.728 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9879999999999998e-05 2024-02-10T08:20:56.728 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.728 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.728 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:20:56.728 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.488787+0000", 2024-02-10T08:20:56.729 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.100315289 2024-02-10T08:20:56.729 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:56.729 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:56.729 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:56.729 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.729 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.729 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:32776 7.e 7:7809c17a:::benchmark_data_smithi018_80623_object32775:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e96)", 2024-02-10T08:20:56.729 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:05.227933+0000", 2024-02-10T08:20:56.729 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 51.483696315000003, 2024-02-10T08:20:56.729 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.064077647000000001, 2024-02-10T08:20:56.729 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:20:56.729 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:20:56.729 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:20:56.729 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:20:56.729 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:20:56.730 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 32776 2024-02-10T08:20:56.730 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.730 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:20:56.730 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.730 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:20:56.730 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:05.227933+0000", 2024-02-10T08:20:56.730 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:20:56.730 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.730 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.730 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:20:56.730 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:05.227933+0000", 2024-02-10T08:20:56.730 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:20:56.730 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.730 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.731 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:20:56.731 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:05.227931+0000", 2024-02-10T08:20:56.731 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7671999999999999e-05 2024-02-10T08:20:56.731 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.731 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.731 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:20:56.731 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:05.227959+0000", 2024-02-10T08:20:56.731 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2069000000000001e-05 2024-02-10T08:20:56.731 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.731 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.731 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:20:56.731 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:05.227971+0000", 2024-02-10T08:20:56.731 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.652e-06 2024-02-10T08:20:56.731 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.731 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.732 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:20:56.732 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:05.227978+0000", 2024-02-10T08:20:56.732 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0368000000000001e-05 2024-02-10T08:20:56.732 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.732 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.732 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:20:56.732 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:05.228008+0000", 2024-02-10T08:20:56.732 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013204100000000001 2024-02-10T08:20:56.732 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.732 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.732 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:20:56.732 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:05.228140+0000", 2024-02-10T08:20:56.732 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015752999999999999 2024-02-10T08:20:56.732 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.733 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.733 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0,5", 2024-02-10T08:20:56.733 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:05.228298+0000", 2024-02-10T08:20:56.733 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002696777 2024-02-10T08:20:56.733 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.733 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.733 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:20:56.733 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:05.230994+0000", 2024-02-10T08:20:56.733 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00052450700000000001 2024-02-10T08:20:56.733 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.733 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.733 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:20:56.733 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:05.231519+0000", 2024-02-10T08:20:56.733 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.060404431000000001 2024-02-10T08:20:56.733 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.734 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.734 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:20:56.734 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:05.291923+0000", 2024-02-10T08:20:56.734 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9650000000000001e-05 2024-02-10T08:20:56.734 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.734 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.734 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:20:56.734 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:05.291973+0000", 2024-02-10T08:20:56.734 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7579000000000001e-05 2024-02-10T08:20:56.734 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.734 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.734 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:20:56.734 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:05.292011+0000", 2024-02-10T08:20:56.734 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.064077647000000001 2024-02-10T08:20:56.734 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:56.735 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:56.735 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:56.735 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.735 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.735 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:35554 7.e 7:7a726d8b:::benchmark_data_smithi018_80623_object35553:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e97)", 2024-02-10T08:20:56.735 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:06.988976+0000", 2024-02-10T08:20:56.735 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 49.722652844000002, 2024-02-10T08:20:56.735 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.056952807000000001, 2024-02-10T08:20:56.735 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:20:56.735 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:20:56.735 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:20:56.735 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:20:56.735 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:20:56.735 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 35554 2024-02-10T08:20:56.736 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.736 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:20:56.736 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.736 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:20:56.736 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:06.988976+0000", 2024-02-10T08:20:56.736 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:20:56.736 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.736 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.736 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:20:56.736 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:06.988976+0000", 2024-02-10T08:20:56.736 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:20:56.736 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.736 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.736 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:20:56.736 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:06.988976+0000", 2024-02-10T08:20:56.737 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1503999999999999e-05 2024-02-10T08:20:56.737 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.737 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.737 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:20:56.737 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:06.988997+0000", 2024-02-10T08:20:56.737 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.345e-06 2024-02-10T08:20:56.737 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.737 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.737 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:20:56.737 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:06.989005+0000", 2024-02-10T08:20:56.737 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0239999999999997e-06 2024-02-10T08:20:56.737 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.737 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.737 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:20:56.738 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:06.989010+0000", 2024-02-10T08:20:56.738 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.051237691000000002 2024-02-10T08:20:56.738 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.738 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.738 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:20:56.738 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:07.040247+0000", 2024-02-10T08:20:56.738 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000129107 2024-02-10T08:20:56.738 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.738 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.738 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:20:56.738 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:07.040376+0000", 2024-02-10T08:20:56.738 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017156499999999999 2024-02-10T08:20:56.738 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.738 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.738 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0,5", 2024-02-10T08:20:56.738 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:07.040548+0000", 2024-02-10T08:20:56.739 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002720423 2024-02-10T08:20:56.739 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.739 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.739 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:20:56.739 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:07.043268+0000", 2024-02-10T08:20:56.739 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0942e-05 2024-02-10T08:20:56.739 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.739 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.739 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:20:56.739 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:07.043279+0000", 2024-02-10T08:20:56.739 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0025937529999999999 2024-02-10T08:20:56.739 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.739 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.739 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:20:56.739 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:07.045873+0000", 2024-02-10T08:20:56.740 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1090000000000002e-05 2024-02-10T08:20:56.740 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.740 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.740 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:20:56.740 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:07.045904+0000", 2024-02-10T08:20:56.740 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5065000000000001e-05 2024-02-10T08:20:56.740 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.740 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.740 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:20:56.740 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:07.045929+0000", 2024-02-10T08:20:56.740 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.056952807000000001 2024-02-10T08:20:56.740 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:56.740 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:56.740 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:56.741 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.741 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.741 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.14784.0:37308 7.a e97/91 7:56a0d08d:::benchmark_data_smithi018_80623_object37307:head v 97'2240, mlcod=97'2238)", 2024-02-10T08:20:56.741 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:08.128569+0000", 2024-02-10T08:20:56.741 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 48.583060414999998, 2024-02-10T08:20:56.741 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.081960281999999995, 2024-02-10T08:20:56.741 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:20:56.741 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:20:56.741 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:20:56.741 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.741 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:20:56.741 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.128569+0000", 2024-02-10T08:20:56.741 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:20:56.741 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.741 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.742 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:20:56.742 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.128569+0000", 2024-02-10T08:20:56.742 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:20:56.742 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.742 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.742 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:20:56.742 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.128568+0000", 2024-02-10T08:20:56.742 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7795000000000001e-05 2024-02-10T08:20:56.742 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.742 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.742 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:20:56.742 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.128596+0000", 2024-02-10T08:20:56.742 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6149999999999999e-06 2024-02-10T08:20:56.742 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.742 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.743 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:20:56.743 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.128603+0000", 2024-02-10T08:20:56.743 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9270000000000002e-06 2024-02-10T08:20:56.743 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.743 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.743 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:20:56.743 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.128609+0000", 2024-02-10T08:20:56.743 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1239999999999997e-05 2024-02-10T08:20:56.743 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.743 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.743 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:20:56.743 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.128660+0000", 2024-02-10T08:20:56.743 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.225e-05 2024-02-10T08:20:56.743 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.743 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.744 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:20:56.744 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.128673+0000", 2024-02-10T08:20:56.744 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0028425350000000002 2024-02-10T08:20:56.744 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.744 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.744 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:20:56.744 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.131515+0000", 2024-02-10T08:20:56.744 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.079013946000000002 2024-02-10T08:20:56.744 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.744 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.744 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:20:56.744 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.210529+0000", 2024-02-10T08:20:56.744 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.081960281999999995 2024-02-10T08:20:56.744 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:56.745 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:56.745 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:56.745 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.745 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.745 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.14784.0:37313 7.3 e97/91 7:c6933c07:::benchmark_data_smithi018_80623_object37312:head v 97'2282, mlcod=97'2280)", 2024-02-10T08:20:56.745 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:08.130157+0000", 2024-02-10T08:20:56.745 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 48.581471845000003, 2024-02-10T08:20:56.745 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.082694955000000001, 2024-02-10T08:20:56.745 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:20:56.745 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:20:56.745 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:20:56.745 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.745 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:20:56.745 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.130157+0000", 2024-02-10T08:20:56.745 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:20:56.745 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.746 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.746 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:20:56.746 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.130157+0000", 2024-02-10T08:20:56.746 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:20:56.746 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.746 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.746 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:20:56.746 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.130157+0000", 2024-02-10T08:20:56.746 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5371000000000002e-05 2024-02-10T08:20:56.746 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.746 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.746 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:20:56.746 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.130182+0000", 2024-02-10T08:20:56.746 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6779999999999995e-06 2024-02-10T08:20:56.746 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.747 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.747 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:20:56.747 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.130192+0000", 2024-02-10T08:20:56.747 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7819999999999999e-06 2024-02-10T08:20:56.747 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.747 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.747 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:20:56.747 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.130197+0000", 2024-02-10T08:20:56.747 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5999999999999999e-05 2024-02-10T08:20:56.747 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.747 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.747 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:20:56.747 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.130253+0000", 2024-02-10T08:20:56.747 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6087999999999999e-05 2024-02-10T08:20:56.747 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.748 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.748 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:20:56.748 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.130269+0000", 2024-02-10T08:20:56.748 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.082548794999999994 2024-02-10T08:20:56.748 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.748 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.748 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:20:56.748 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.212818+0000", 2024-02-10T08:20:56.748 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4175999999999999e-05 2024-02-10T08:20:56.748 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.748 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.748 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:20:56.748 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.212852+0000", 2024-02-10T08:20:56.748 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.082694955000000001 2024-02-10T08:20:56.749 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:56.749 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:56.749 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:56.749 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.749 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.749 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.14784.0:37318 7.5 e97/91 7:ac4469da:::benchmark_data_smithi018_80623_object37317:head v 97'2354, mlcod=97'2352)", 2024-02-10T08:20:56.749 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:08.130839+0000", 2024-02-10T08:20:56.749 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 48.580790733999997, 2024-02-10T08:20:56.749 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.082094496000000003, 2024-02-10T08:20:56.749 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:20:56.749 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:20:56.749 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:20:56.749 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.749 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:20:56.749 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.130839+0000", 2024-02-10T08:20:56.750 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:20:56.750 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.750 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.750 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:20:56.750 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.130839+0000", 2024-02-10T08:20:56.750 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:20:56.750 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.750 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.750 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:20:56.750 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.130838+0000", 2024-02-10T08:20:56.750 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9406999999999994e-05 2024-02-10T08:20:56.750 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.750 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.750 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:20:56.750 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.130917+0000", 2024-02-10T08:20:56.750 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.078250107999999999 2024-02-10T08:20:56.751 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.751 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.751 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:20:56.751 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.209167+0000", 2024-02-10T08:20:56.751 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5850000000000002e-06 2024-02-10T08:20:56.751 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.751 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.751 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:20:56.751 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.209175+0000", 2024-02-10T08:20:56.751 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3845999999999998e-05 2024-02-10T08:20:56.751 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.751 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.751 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:20:56.751 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.209239+0000", 2024-02-10T08:20:56.751 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1801999999999999e-05 2024-02-10T08:20:56.752 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.752 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.752 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:20:56.752 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.209261+0000", 2024-02-10T08:20:56.752 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.003640023 2024-02-10T08:20:56.752 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.752 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.752 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:20:56.752 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.212901+0000", 2024-02-10T08:20:56.752 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2498e-05 2024-02-10T08:20:56.752 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.752 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.752 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:20:56.752 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.212933+0000", 2024-02-10T08:20:56.752 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.082094496000000003 2024-02-10T08:20:56.753 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:56.753 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:56.753 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:56.753 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.753 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.753 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:37323 7.e 7:7986e1c6:::benchmark_data_smithi018_80623_object37322:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e97)", 2024-02-10T08:20:56.753 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:08.132586+0000", 2024-02-10T08:20:56.754 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 48.579043632999998, 2024-02-10T08:20:56.755 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.080560971999999995, 2024-02-10T08:20:56.755 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:20:56.755 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:20:56.755 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:20:56.755 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:20:56.755 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:20:56.755 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 37323 2024-02-10T08:20:56.755 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.755 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:20:56.755 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.755 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:20:56.755 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.132586+0000", 2024-02-10T08:20:56.755 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:20:56.756 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.756 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.756 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:20:56.756 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.132586+0000", 2024-02-10T08:20:56.756 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:20:56.756 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.756 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.756 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:20:56.756 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.132584+0000", 2024-02-10T08:20:56.756 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0639e-05 2024-02-10T08:20:56.756 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.756 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.756 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:20:56.757 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.132605+0000", 2024-02-10T08:20:56.757 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.076539075999999998 2024-02-10T08:20:56.757 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.757 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.757 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:20:56.757 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.209144+0000", 2024-02-10T08:20:56.757 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4319e-05 2024-02-10T08:20:56.757 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.757 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.757 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:20:56.757 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.209158+0000", 2024-02-10T08:20:56.757 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0922999999999999e-05 2024-02-10T08:20:56.758 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.758 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.758 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:20:56.758 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.209219+0000", 2024-02-10T08:20:56.758 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012928500000000001 2024-02-10T08:20:56.758 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.758 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.758 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:20:56.758 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.209349+0000", 2024-02-10T08:20:56.758 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013689299999999999 2024-02-10T08:20:56.758 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.758 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.758 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0,5", 2024-02-10T08:20:56.758 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.209485+0000", 2024-02-10T08:20:56.759 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0029609549999999999 2024-02-10T08:20:56.759 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.759 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.759 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:20:56.759 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.212446+0000", 2024-02-10T08:20:56.759 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00060790400000000004 2024-02-10T08:20:56.759 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.759 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.759 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:20:56.759 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.213054+0000", 2024-02-10T08:20:56.759 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5039999999999999e-06 2024-02-10T08:20:56.759 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.759 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.759 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:20:56.759 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.213061+0000", 2024-02-10T08:20:56.760 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8043000000000001e-05 2024-02-10T08:20:56.760 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.760 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.760 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:20:56.760 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.213109+0000", 2024-02-10T08:20:56.760 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7772999999999999e-05 2024-02-10T08:20:56.760 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.760 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.760 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:20:56.760 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.213147+0000", 2024-02-10T08:20:56.760 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.080560971999999995 2024-02-10T08:20:56.760 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:56.760 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:56.760 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:56.761 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.761 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.761 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.14784.0:37314 7.a e97/91 7:56fd1ac9:::benchmark_data_smithi018_80623_object37313:head v 97'2241, mlcod=97'2238)", 2024-02-10T08:20:56.761 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:08.132626+0000", 2024-02-10T08:20:56.761 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 48.579003061999998, 2024-02-10T08:20:56.761 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.082542091999999997, 2024-02-10T08:20:56.761 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:20:56.761 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:20:56.761 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:20:56.761 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.761 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:20:56.761 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.132626+0000", 2024-02-10T08:20:56.761 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:20:56.761 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.761 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.762 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:20:56.762 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.132626+0000", 2024-02-10T08:20:56.762 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:20:56.762 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.762 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.762 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:20:56.762 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.132625+0000", 2024-02-10T08:20:56.762 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1951999999999999e-05 2024-02-10T08:20:56.762 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.762 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.762 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:20:56.762 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.132647+0000", 2024-02-10T08:20:56.762 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.076644761000000006 2024-02-10T08:20:56.762 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.762 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.763 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:20:56.763 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.209292+0000", 2024-02-10T08:20:56.763 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0319999999999992e-06 2024-02-10T08:20:56.763 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.763 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.763 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:20:56.763 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.209301+0000", 2024-02-10T08:20:56.763 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0012539669999999999 2024-02-10T08:20:56.763 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.763 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.763 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:20:56.763 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.210555+0000", 2024-02-10T08:20:56.763 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7204e-05 2024-02-10T08:20:56.763 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.763 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.764 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:20:56.764 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.210572+0000", 2024-02-10T08:20:56.764 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0045533270000000002 2024-02-10T08:20:56.764 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.764 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.764 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:20:56.764 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.215126+0000", 2024-02-10T08:20:56.764 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2664999999999999e-05 2024-02-10T08:20:56.764 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.764 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.764 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:20:56.764 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.215168+0000", 2024-02-10T08:20:56.764 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.082542091999999997 2024-02-10T08:20:56.764 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:56.765 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:56.765 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:56.765 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.765 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.765 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:73105 7.e 7:7b018df3:::benchmark_data_smithi018_80623_object73104:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e106)", 2024-02-10T08:20:56.765 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:38.185700+0000", 2024-02-10T08:20:56.765 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 18.525929494, 2024-02-10T08:20:56.765 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.067896701000000004, 2024-02-10T08:20:56.765 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:20:56.765 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:20:56.765 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:20:56.766 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:20:56.766 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:20:56.766 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 73105 2024-02-10T08:20:56.766 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.766 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:20:56.766 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.766 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:20:56.766 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:38.185700+0000", 2024-02-10T08:20:56.766 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:20:56.766 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.766 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.766 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:20:56.766 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:38.185700+0000", 2024-02-10T08:20:56.766 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999981 2024-02-10T08:20:56.767 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.767 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.767 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:20:56.767 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:38.185698+0000", 2024-02-10T08:20:56.767 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3737999999999999e-05 2024-02-10T08:20:56.767 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.767 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.767 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:20:56.767 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:38.185722+0000", 2024-02-10T08:20:56.767 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0423e-05 2024-02-10T08:20:56.767 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.767 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.767 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:20:56.767 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:38.185732+0000", 2024-02-10T08:20:56.767 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9630000000000003e-06 2024-02-10T08:20:56.768 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.768 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.768 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:20:56.768 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:38.185738+0000", 2024-02-10T08:20:56.768 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6313000000000002e-05 2024-02-10T08:20:56.768 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.768 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.768 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:20:56.768 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:38.185784+0000", 2024-02-10T08:20:56.768 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012074900000000001 2024-02-10T08:20:56.768 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.768 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.768 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:20:56.769 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:38.185905+0000", 2024-02-10T08:20:56.769 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000156992 2024-02-10T08:20:56.769 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.769 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.769 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0,5", 2024-02-10T08:20:56.769 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:38.186062+0000", 2024-02-10T08:20:56.769 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0055094000000000002 2024-02-10T08:20:56.769 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.769 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.769 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:20:56.769 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:38.191572+0000", 2024-02-10T08:20:56.769 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010686809999999999 2024-02-10T08:20:56.769 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.769 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.769 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:20:56.770 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:38.192640+0000", 2024-02-10T08:20:56.770 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.060862988 2024-02-10T08:20:56.770 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.770 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.770 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:20:56.770 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:38.253503+0000", 2024-02-10T08:20:56.770 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4072e-05 2024-02-10T08:20:56.770 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.770 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.770 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:20:56.770 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:38.253557+0000", 2024-02-10T08:20:56.770 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9156999999999998e-05 2024-02-10T08:20:56.770 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.770 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.771 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:20:56.771 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:38.253597+0000", 2024-02-10T08:20:56.771 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.067896701000000004 2024-02-10T08:20:56.771 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:56.771 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:56.771 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:56.771 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.771 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.771 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:73107 7.e 7:7e4031d3:::benchmark_data_smithi018_80623_object73106:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e106)", 2024-02-10T08:20:56.771 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:38.188673+0000", 2024-02-10T08:20:56.771 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 18.522955849999999, 2024-02-10T08:20:56.771 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.065993588000000006, 2024-02-10T08:20:56.771 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:20:56.771 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:20:56.771 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:20:56.772 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:20:56.772 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:20:56.772 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 73107 2024-02-10T08:20:56.772 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.772 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:20:56.772 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.772 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:20:56.772 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:38.188673+0000", 2024-02-10T08:20:56.772 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:20:56.772 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.772 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.772 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:20:56.772 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:38.188673+0000", 2024-02-10T08:20:56.772 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:20:56.773 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.773 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.773 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:20:56.773 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:38.188672+0000", 2024-02-10T08:20:56.773 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5687e-05 2024-02-10T08:20:56.773 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.773 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.773 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:20:56.773 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:38.188698+0000", 2024-02-10T08:20:56.773 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1474999999999999e-05 2024-02-10T08:20:56.773 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.773 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.773 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:20:56.773 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:38.188709+0000", 2024-02-10T08:20:56.773 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8390000000000001e-06 2024-02-10T08:20:56.774 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.774 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.774 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:20:56.774 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:38.188716+0000", 2024-02-10T08:20:56.774 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4163999999999999e-05 2024-02-10T08:20:56.774 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.774 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.774 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:20:56.774 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:38.188760+0000", 2024-02-10T08:20:56.774 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4662999999999998e-05 2024-02-10T08:20:56.774 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.774 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.774 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:20:56.774 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:38.188855+0000", 2024-02-10T08:20:56.774 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3138000000000002e-05 2024-02-10T08:20:56.775 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.775 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.775 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0,5", 2024-02-10T08:20:56.775 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:38.188948+0000", 2024-02-10T08:20:56.775 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0027523629999999999 2024-02-10T08:20:56.775 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.775 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.775 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:20:56.775 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:38.191700+0000", 2024-02-10T08:20:56.775 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010097890000000001 2024-02-10T08:20:56.775 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.775 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.775 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:20:56.775 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:38.192710+0000", 2024-02-10T08:20:56.775 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.061862977999999999 2024-02-10T08:20:56.776 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.776 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.776 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:20:56.776 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:38.254573+0000", 2024-02-10T08:20:56.776 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6858999999999999e-05 2024-02-10T08:20:56.776 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.776 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.776 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:20:56.776 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:38.254630+0000", 2024-02-10T08:20:56.776 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7073999999999998e-05 2024-02-10T08:20:56.776 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.776 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.776 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:20:56.776 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:38.254667+0000", 2024-02-10T08:20:56.776 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.065993588000000006 2024-02-10T08:20:56.777 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:56.777 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:56.777 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:56.777 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.777 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.777 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:75456 7.e 7:780a5640:::benchmark_data_smithi018_80623_object75455:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e106)", 2024-02-10T08:20:56.777 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:40.366549+0000", 2024-02-10T08:20:56.777 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 16.345080568, 2024-02-10T08:20:56.777 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.056974389, 2024-02-10T08:20:56.777 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:20:56.777 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:20:56.777 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:20:56.777 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:20:56.777 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:20:56.777 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 75456 2024-02-10T08:20:56.778 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.778 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:20:56.778 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.778 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:20:56.778 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:40.366549+0000", 2024-02-10T08:20:56.778 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:20:56.778 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.778 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.778 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:20:56.778 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:40.366549+0000", 2024-02-10T08:20:56.778 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:20:56.778 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.778 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.778 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:20:56.778 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:40.366548+0000", 2024-02-10T08:20:56.779 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5091e-05 2024-02-10T08:20:56.779 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.779 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.779 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:20:56.779 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:40.366563+0000", 2024-02-10T08:20:56.779 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3809999999999999e-06 2024-02-10T08:20:56.779 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.779 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.779 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:20:56.779 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:40.366567+0000", 2024-02-10T08:20:56.779 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3539999999999998e-06 2024-02-10T08:20:56.779 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.779 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.779 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:20:56.779 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:40.366569+0000", 2024-02-10T08:20:56.780 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0028925180000000002 2024-02-10T08:20:56.780 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.780 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.780 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:20:56.780 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:40.369462+0000", 2024-02-10T08:20:56.780 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011144700000000001 2024-02-10T08:20:56.780 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.780 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.780 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:20:56.780 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:40.369573+0000", 2024-02-10T08:20:56.780 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014517600000000001 2024-02-10T08:20:56.780 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.780 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.780 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0,5", 2024-02-10T08:20:56.780 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:40.369718+0000", 2024-02-10T08:20:56.781 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0032299590000000001 2024-02-10T08:20:56.781 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.781 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.781 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:20:56.781 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:40.372948+0000", 2024-02-10T08:20:56.781 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0036470439999999999 2024-02-10T08:20:56.781 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.781 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.781 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:20:56.781 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:40.376595+0000", 2024-02-10T08:20:56.781 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.046834745999999997 2024-02-10T08:20:56.781 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.781 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.781 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:20:56.781 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:40.423430+0000", 2024-02-10T08:20:56.782 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3520000000000003e-05 2024-02-10T08:20:56.782 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.782 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.782 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:20:56.782 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:40.423484+0000", 2024-02-10T08:20:56.782 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9557000000000001e-05 2024-02-10T08:20:56.782 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.782 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.782 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:20:56.782 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:40.423523+0000", 2024-02-10T08:20:56.782 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.056974389 2024-02-10T08:20:56.782 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:56.782 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:56.782 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:56.782 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.783 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.783 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:77142 7.e 7:73ce8a4b:::benchmark_data_smithi018_80623_object77141:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e107)", 2024-02-10T08:20:56.783 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:42.071690+0000", 2024-02-10T08:20:56.783 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 14.639939801000001, 2024-02-10T08:20:56.783 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.092322842000000002, 2024-02-10T08:20:56.783 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:20:56.783 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:20:56.783 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:20:56.783 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:20:56.783 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:20:56.783 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 77142 2024-02-10T08:20:56.783 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.783 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:20:56.783 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.784 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:20:56.784 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.071690+0000", 2024-02-10T08:20:56.784 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:20:56.784 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.784 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.784 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:20:56.784 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.071690+0000", 2024-02-10T08:20:56.784 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:20:56.784 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.784 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.784 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:20:56.784 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.071688+0000", 2024-02-10T08:20:56.784 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4189000000000001e-05 2024-02-10T08:20:56.784 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.785 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.785 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:20:56.785 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.071722+0000", 2024-02-10T08:20:56.785 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2629000000000001e-05 2024-02-10T08:20:56.785 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.785 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.785 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:20:56.785 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.071735+0000", 2024-02-10T08:20:56.785 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5379999999999999e-06 2024-02-10T08:20:56.785 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.785 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.785 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:20:56.785 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.071742+0000", 2024-02-10T08:20:56.785 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001768574 2024-02-10T08:20:56.785 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.786 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.786 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:20:56.786 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.073510+0000", 2024-02-10T08:20:56.786 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6097e-05 2024-02-10T08:20:56.786 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.786 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.786 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:20:56.786 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.073586+0000", 2024-02-10T08:20:56.786 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0943e-05 2024-02-10T08:20:56.786 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.786 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.786 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0,5", 2024-02-10T08:20:56.786 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.073677+0000", 2024-02-10T08:20:56.786 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.003793341 2024-02-10T08:20:56.786 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.787 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.787 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:20:56.787 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.077470+0000", 2024-02-10T08:20:56.787 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000151135 2024-02-10T08:20:56.787 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.787 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.787 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:20:56.787 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.077622+0000", 2024-02-10T08:20:56.787 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086301667999999998 2024-02-10T08:20:56.787 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.787 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.787 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:20:56.787 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.163923+0000", 2024-02-10T08:20:56.787 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.164e-05 2024-02-10T08:20:56.787 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.788 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.788 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:20:56.788 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.163975+0000", 2024-02-10T08:20:56.788 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7425000000000002e-05 2024-02-10T08:20:56.788 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.788 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.788 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:20:56.788 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.164012+0000", 2024-02-10T08:20:56.788 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.092322842000000002 2024-02-10T08:20:56.788 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:56.788 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:56.788 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:56.788 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.788 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.789 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:77145 7.e 7:7c9ce184:::benchmark_data_smithi018_80623_object77144:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e107)", 2024-02-10T08:20:56.789 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:42.072051+0000", 2024-02-10T08:20:56.789 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 14.639578329000001, 2024-02-10T08:20:56.789 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.092845153, 2024-02-10T08:20:56.789 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:20:56.789 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:20:56.789 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:20:56.789 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:20:56.789 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:20:56.789 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 77145 2024-02-10T08:20:56.789 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.789 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:20:56.789 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.789 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:20:56.789 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.072051+0000", 2024-02-10T08:20:56.790 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:20:56.790 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.790 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.790 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:20:56.790 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.072051+0000", 2024-02-10T08:20:56.790 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:20:56.790 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.790 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.790 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:20:56.790 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.072050+0000", 2024-02-10T08:20:56.790 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1413999999999999e-05 2024-02-10T08:20:56.790 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.790 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.790 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:20:56.790 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.072071+0000", 2024-02-10T08:20:56.791 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7030000000000001e-06 2024-02-10T08:20:56.791 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.791 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.791 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:20:56.791 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.072081+0000", 2024-02-10T08:20:56.791 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4520000000000002e-06 2024-02-10T08:20:56.791 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.791 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.791 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:20:56.791 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.072088+0000", 2024-02-10T08:20:56.791 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0035117870000000002 2024-02-10T08:20:56.791 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.791 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.791 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:20:56.791 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.075599+0000", 2024-02-10T08:20:56.792 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3490000000000002e-05 2024-02-10T08:20:56.792 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.792 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.792 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:20:56.792 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.075683+0000", 2024-02-10T08:20:56.792 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000126196 2024-02-10T08:20:56.792 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.792 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.792 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0,5", 2024-02-10T08:20:56.792 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.075809+0000", 2024-02-10T08:20:56.792 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0017862589999999999 2024-02-10T08:20:56.792 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.792 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.792 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:20:56.792 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.077595+0000", 2024-02-10T08:20:56.793 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013382300000000001 2024-02-10T08:20:56.793 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.793 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.793 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:20:56.793 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.077729+0000", 2024-02-10T08:20:56.793 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087078800999999997 2024-02-10T08:20:56.793 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.793 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.793 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:20:56.793 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.164808+0000", 2024-02-10T08:20:56.793 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0198999999999998e-05 2024-02-10T08:20:56.793 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.793 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.793 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:20:56.793 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.164858+0000", 2024-02-10T08:20:56.793 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7963000000000002e-05 2024-02-10T08:20:56.794 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.794 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.794 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:20:56.794 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.164896+0000", 2024-02-10T08:20:56.794 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.092845153 2024-02-10T08:20:56.794 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:56.794 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:56.794 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:56.794 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.794 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.794 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:77212 7.8 7:17377681:::benchmark_data_smithi018_80623_object77211:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e107)", 2024-02-10T08:20:56.794 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:42.209248+0000", 2024-02-10T08:20:56.794 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 14.502381128, 2024-02-10T08:20:56.794 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.071707436999999999, 2024-02-10T08:20:56.794 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:20:56.795 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:20:56.795 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:20:56.795 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:20:56.795 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:20:56.795 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 77212 2024-02-10T08:20:56.795 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.795 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:20:56.795 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.795 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:20:56.795 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.209248+0000", 2024-02-10T08:20:56.795 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:20:56.795 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.795 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.795 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:20:56.795 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.209248+0000", 2024-02-10T08:20:56.795 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999981 2024-02-10T08:20:56.796 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.796 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.796 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:20:56.796 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.209246+0000", 2024-02-10T08:20:56.796 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8294e-05 2024-02-10T08:20:56.796 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.796 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.796 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:20:56.796 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.209274+0000", 2024-02-10T08:20:56.796 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5107e-05 2024-02-10T08:20:56.796 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.796 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.796 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:20:56.796 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.209289+0000", 2024-02-10T08:20:56.797 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6179999999999997e-06 2024-02-10T08:20:56.797 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.797 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.797 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:20:56.797 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.209297+0000", 2024-02-10T08:20:56.797 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6609e-05 2024-02-10T08:20:56.797 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.797 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.797 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:20:56.797 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.209344+0000", 2024-02-10T08:20:56.797 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000120903 2024-02-10T08:20:56.797 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.797 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.797 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:20:56.797 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.209465+0000", 2024-02-10T08:20:56.798 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014661899999999999 2024-02-10T08:20:56.798 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.798 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.798 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 7", 2024-02-10T08:20:56.798 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.209611+0000", 2024-02-10T08:20:56.798 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.060654079999999999 2024-02-10T08:20:56.798 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.798 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.798 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:20:56.798 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.270265+0000", 2024-02-10T08:20:56.798 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.010553294 2024-02-10T08:20:56.798 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.798 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.798 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:20:56.798 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.280819+0000", 2024-02-10T08:20:56.799 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0373e-05 2024-02-10T08:20:56.799 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.799 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.799 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:20:56.799 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.280869+0000", 2024-02-10T08:20:56.799 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6683999999999999e-05 2024-02-10T08:20:56.799 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.799 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.799 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:20:56.799 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.280956+0000", 2024-02-10T08:20:56.799 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.071707436999999999 2024-02-10T08:20:56.799 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:56.799 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:56.799 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:56.800 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.800 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.800 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.14784.0:77209 7.a e107/91 7:5061b25c:::benchmark_data_smithi018_80623_object77208:head v 107'4770, mlcod=107'4768)", 2024-02-10T08:20:56.800 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:42.210360+0000", 2024-02-10T08:20:56.800 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 14.501269564999999, 2024-02-10T08:20:56.800 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.064333155000000003, 2024-02-10T08:20:56.800 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:20:56.800 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:20:56.800 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:20:56.800 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.800 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:20:56.800 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.210360+0000", 2024-02-10T08:20:56.800 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:20:56.800 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.800 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.801 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:20:56.801 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.210360+0000", 2024-02-10T08:20:56.801 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:20:56.801 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.801 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.801 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:20:56.801 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.210359+0000", 2024-02-10T08:20:56.801 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0323000000000001e-05 2024-02-10T08:20:56.801 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.801 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.801 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:20:56.801 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.210389+0000", 2024-02-10T08:20:56.801 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.057343207 2024-02-10T08:20:56.801 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.801 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.802 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:20:56.802 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.267732+0000", 2024-02-10T08:20:56.802 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4922999999999999e-05 2024-02-10T08:20:56.802 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.802 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.802 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:20:56.802 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.267747+0000", 2024-02-10T08:20:56.802 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8024e-05 2024-02-10T08:20:56.802 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.802 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.802 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:20:56.802 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.267795+0000", 2024-02-10T08:20:56.802 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2670000000000001e-05 2024-02-10T08:20:56.802 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.802 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.803 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:20:56.803 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.267818+0000", 2024-02-10T08:20:56.803 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0068577209999999998 2024-02-10T08:20:56.803 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.803 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.803 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:20:56.803 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.274676+0000", 2024-02-10T08:20:56.803 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7277000000000001e-05 2024-02-10T08:20:56.803 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.803 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.803 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:20:56.803 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.274693+0000", 2024-02-10T08:20:56.803 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.064333155000000003 2024-02-10T08:20:56.803 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:56.804 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:56.804 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:56.804 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.804 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.804 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop_reply(client.14784.0:77212 7.8 e107/91 ondisk, result = 0)", 2024-02-10T08:20:56.804 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:42.212167+0000", 2024-02-10T08:20:56.804 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 14.49946248, 2024-02-10T08:20:56.804 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058104008999999998, 2024-02-10T08:20:56.804 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:20:56.804 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-02-10T08:20:56.804 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:20:56.804 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.804 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:20:56.804 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.212167+0000", 2024-02-10T08:20:56.805 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:20:56.805 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.805 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.805 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:20:56.805 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.212167+0000", 2024-02-10T08:20:56.805 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:20:56.805 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.805 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.805 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:20:56.805 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.212166+0000", 2024-02-10T08:20:56.805 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6309999999999997e-06 2024-02-10T08:20:56.805 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.805 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.805 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:20:56.805 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.212172+0000", 2024-02-10T08:20:56.805 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.055562746000000003 2024-02-10T08:20:56.806 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.806 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.806 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:20:56.806 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.267735+0000", 2024-02-10T08:20:56.806 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2653000000000001e-05 2024-02-10T08:20:56.806 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.806 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.806 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:20:56.806 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.267748+0000", 2024-02-10T08:20:56.806 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002500571 2024-02-10T08:20:56.806 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.806 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.806 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:20:56.806 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.270248+0000", 2024-02-10T08:20:56.806 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2240000000000001e-06 2024-02-10T08:20:56.807 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.807 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.807 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:20:56.807 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.270258+0000", 2024-02-10T08:20:56.807 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3258000000000001e-05 2024-02-10T08:20:56.807 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.807 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.807 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:20:56.807 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.270271+0000", 2024-02-10T08:20:56.807 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058104008999999998 2024-02-10T08:20:56.807 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:56.807 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:56.807 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:56.807 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.807 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.807 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:77219 7.8 7:10e0829d:::benchmark_data_smithi018_80623_object77218:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e107)", 2024-02-10T08:20:56.808 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:42.216322+0000", 2024-02-10T08:20:56.808 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 14.495307136999999, 2024-02-10T08:20:56.808 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.064769191000000004, 2024-02-10T08:20:56.808 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:20:56.808 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:20:56.808 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:20:56.808 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:20:56.808 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:20:56.808 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 77219 2024-02-10T08:20:56.808 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.808 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:20:56.808 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.808 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:20:56.808 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.216322+0000", 2024-02-10T08:20:56.809 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:20:56.809 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.809 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.809 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:20:56.809 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.216322+0000", 2024-02-10T08:20:56.809 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999981 2024-02-10T08:20:56.809 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.809 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.809 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:20:56.809 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.216320+0000", 2024-02-10T08:20:56.809 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6799999999999999e-05 2024-02-10T08:20:56.809 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.809 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.809 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:20:56.809 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.216367+0000", 2024-02-10T08:20:56.810 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.051374562999999998 2024-02-10T08:20:56.810 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.810 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.810 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:20:56.810 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.267741+0000", 2024-02-10T08:20:56.810 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1912e-05 2024-02-10T08:20:56.810 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.810 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.810 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:20:56.810 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.267753+0000", 2024-02-10T08:20:56.810 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0025475139999999999 2024-02-10T08:20:56.810 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.810 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.810 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:20:56.810 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.270301+0000", 2024-02-10T08:20:56.811 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000141199 2024-02-10T08:20:56.811 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.811 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.811 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:20:56.811 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.270442+0000", 2024-02-10T08:20:56.811 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017275100000000001 2024-02-10T08:20:56.811 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.811 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.811 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 7", 2024-02-10T08:20:56.811 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.270615+0000", 2024-02-10T08:20:56.811 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0075506870000000004 2024-02-10T08:20:56.811 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.811 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.811 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:20:56.811 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.278166+0000", 2024-02-10T08:20:56.812 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0028010859999999999 2024-02-10T08:20:56.812 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.812 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.812 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:20:56.812 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.280967+0000", 2024-02-10T08:20:56.812 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0859999999999998e-05 2024-02-10T08:20:56.812 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.812 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.812 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:20:56.812 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.281007+0000", 2024-02-10T08:20:56.812 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3879000000000001e-05 2024-02-10T08:20:56.812 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.812 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.812 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:20:56.813 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.281091+0000", 2024-02-10T08:20:56.813 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.064769191000000004 2024-02-10T08:20:56.813 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:56.813 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:56.813 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:56.813 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.813 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.813 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:77924 7.e 7:7842cc32:::benchmark_data_smithi018_80623_object77923:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e107)", 2024-02-10T08:20:56.813 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:42.890615+0000", 2024-02-10T08:20:56.813 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 13.821014738000001, 2024-02-10T08:20:56.813 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.054614199000000002, 2024-02-10T08:20:56.814 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:20:56.814 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:20:56.814 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:20:56.814 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:20:56.814 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:20:56.814 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 77924 2024-02-10T08:20:56.814 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.814 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:20:56.814 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.814 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:20:56.814 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.890615+0000", 2024-02-10T08:20:56.814 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:20:56.814 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.815 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.815 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:20:56.815 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.890615+0000", 2024-02-10T08:20:56.815 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:20:56.815 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.815 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.815 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:20:56.815 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.890614+0000", 2024-02-10T08:20:56.815 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1506999999999999e-05 2024-02-10T08:20:56.815 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.815 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.815 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:20:56.815 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.890636+0000", 2024-02-10T08:20:56.815 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.866e-06 2024-02-10T08:20:56.815 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.816 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.816 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:20:56.816 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.890642+0000", 2024-02-10T08:20:56.816 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4770000000000002e-06 2024-02-10T08:20:56.816 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.816 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.816 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:20:56.816 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.890648+0000", 2024-02-10T08:20:56.816 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015232000000000001 2024-02-10T08:20:56.816 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.816 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.816 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:20:56.816 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.890800+0000", 2024-02-10T08:20:56.816 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011964300000000001 2024-02-10T08:20:56.817 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.817 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.817 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:20:56.817 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.890920+0000", 2024-02-10T08:20:56.817 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013131199999999999 2024-02-10T08:20:56.817 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.817 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.817 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0,5", 2024-02-10T08:20:56.817 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.891051+0000", 2024-02-10T08:20:56.817 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0019571689999999999 2024-02-10T08:20:56.817 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.817 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.817 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:20:56.817 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.893008+0000", 2024-02-10T08:20:56.817 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00040504700000000001 2024-02-10T08:20:56.818 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.818 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.818 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:20:56.818 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.893413+0000", 2024-02-10T08:20:56.818 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.051724439999999997 2024-02-10T08:20:56.818 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.818 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.818 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:20:56.818 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.945138+0000", 2024-02-10T08:20:56.818 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3498999999999997e-05 2024-02-10T08:20:56.818 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.818 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.818 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:20:56.818 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.945191+0000", 2024-02-10T08:20:56.818 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7496000000000001e-05 2024-02-10T08:20:56.818 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.819 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.819 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:20:56.819 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.945229+0000", 2024-02-10T08:20:56.819 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.054614199000000002 2024-02-10T08:20:56.819 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:56.819 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:56.819 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:56.819 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.819 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.819 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:78704 7.e 7:79f2739a:::benchmark_data_smithi018_80623_object78703:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e108)", 2024-02-10T08:20:56.819 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:43.717497+0000", 2024-02-10T08:20:56.820 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 12.994132798999999, 2024-02-10T08:20:56.820 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.074093422000000006, 2024-02-10T08:20:56.820 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:20:56.820 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:20:56.820 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:20:56.820 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:20:56.820 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:20:56.820 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 78704 2024-02-10T08:20:56.820 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.820 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:20:56.820 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.820 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:20:56.820 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:43.717497+0000", 2024-02-10T08:20:56.820 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:20:56.821 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.821 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.821 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:20:56.821 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:43.717497+0000", 2024-02-10T08:20:56.821 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:20:56.821 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.821 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.821 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:20:56.821 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:43.717496+0000", 2024-02-10T08:20:56.821 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9797e-05 2024-02-10T08:20:56.821 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.821 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.821 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:20:56.821 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:43.717516+0000", 2024-02-10T08:20:56.821 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8799999999999996e-06 2024-02-10T08:20:56.822 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.822 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.822 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:20:56.822 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:43.717522+0000", 2024-02-10T08:20:56.822 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0559999999999998e-06 2024-02-10T08:20:56.822 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.822 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.822 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:20:56.822 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:43.717526+0000", 2024-02-10T08:20:56.822 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4842999999999997e-05 2024-02-10T08:20:56.822 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.822 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.822 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:20:56.822 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:43.717571+0000", 2024-02-10T08:20:56.822 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011793100000000001 2024-02-10T08:20:56.823 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.823 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.823 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:20:56.823 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:43.717688+0000", 2024-02-10T08:20:56.823 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015541200000000001 2024-02-10T08:20:56.823 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.823 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.823 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0,5", 2024-02-10T08:20:56.823 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:43.717844+0000", 2024-02-10T08:20:56.823 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0028873929999999998 2024-02-10T08:20:56.823 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.823 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.823 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:20:56.823 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:43.720731+0000", 2024-02-10T08:20:56.823 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0022189140000000002 2024-02-10T08:20:56.824 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.824 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.824 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:20:56.824 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:43.722950+0000", 2024-02-10T08:20:56.824 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.068548869999999998 2024-02-10T08:20:56.824 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.824 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.824 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:20:56.824 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:43.791499+0000", 2024-02-10T08:20:56.824 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0464999999999999e-05 2024-02-10T08:20:56.824 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.824 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.824 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:20:56.824 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:43.791550+0000", 2024-02-10T08:20:56.824 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0417999999999998e-05 2024-02-10T08:20:56.825 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:20:56.825 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:20:56.825 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:20:56.825 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:43.791590+0000", 2024-02-10T08:20:56.825 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.074093422000000006 2024-02-10T08:20:56.825 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:56.825 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:56.825 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:56.825 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:20:56.825 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:20:56.825 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-02-10T08:20:56.826 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:20:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:20:56] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:20:56.826 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:56.981 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 5, 6, 7, 4] 2024-02-10T08:20:56.981 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-10T08:20:56.981 INFO:tasks.thrashosds.thrasher:fixing pg num pool default.rgw.log 2024-02-10T08:20:56.981 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph pg dump --format=json 2024-02-10T08:20:57.238 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 67 16 86179 86163 80.3281 35.6875 0.0172857 0.0124429 2024-02-10T08:20:57.411 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:20:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:20:57] "GET /metrics HTTP/1.1" 200 175124 "" "Prometheus/2.33.4" 2024-02-10T08:20:57.498 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:20:57.512 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:57.513 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:20:57.614 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:20:57.647 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:57.669 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:20:57.672 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:57.672 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:20:57.773 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:20:57.837 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:56.537475+0000 mgr.y (mgr.14505) 160 : cluster [DBG] pgmap v164: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 5.1 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 835 B/s rd, 30 MiB/s wr, 483 op/s; 25012/250086 objects degraded (10.001%); 3.6 MiB/s, 57 objects/s recovering 2024-02-10T08:20:57.842 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:57.842 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:56.537475+0000 mgr.y (mgr.14505) 160 : cluster [DBG] pgmap v164: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 5.1 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 835 B/s rd, 30 MiB/s wr, 483 op/s; 25012/250086 objects degraded (10.001%); 3.6 MiB/s, 57 objects/s recovering 2024-02-10T08:20:57.887 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:20:57.893 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:57.893 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:20:57.994 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:20:57.995 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-10T08:20:58.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:56.537475+0000 mgr.y (mgr.14505) 160 : cluster [DBG] pgmap v164: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 5.1 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 835 B/s rd, 30 MiB/s wr, 483 op/s; 25012/250086 objects degraded (10.001%); 3.6 MiB/s, 57 objects/s recovering 2024-02-10T08:20:58.039 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:20:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:20:58.087 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:58.237 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 68 16 86816 86800 79.7298 39.8125 0.0228507 0.0125365 2024-02-10T08:20:58.570 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:20:58.579 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:58.580 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:20:58.681 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:20:58.714 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:58.736 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:20:58.742 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:58.743 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:20:58.843 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:20:58.900 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:20:57.657659+0000 mgr.y (mgr.14505) 161 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:20:58.900 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:20:57.657659+0000 mgr.y (mgr.14505) 161 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:20:58.925 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.3 dump_ops_in_flight 2024-02-10T08:20:58.959 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:59.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:20:57.657659+0000 mgr.y (mgr.14505) 161 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:20:59.071 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:20:59.077 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:59.077 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:20:59.178 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:20:59.237 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 69 16 87420 87404 79.1217 37.75 0.0296271 0.0126326 2024-02-10T08:20:59.308 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:59.573 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:20:59.573 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:20:59.575 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:20:59.587 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:59.587 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:20:59.688 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:20:59.763 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:20:59.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:20:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:20:58.540821+0000 mgr.y (mgr.14505) 162 : cluster [DBG] pgmap v165: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 5.3 GiB data, 17 GiB used, 699 GiB / 715 GiB avail; 1.2 KiB/s rd, 48 MiB/s wr, 765 op/s; 25023/259554 objects degraded (9.641%); 5.7 MiB/s, 91 objects/s recovering 2024-02-10T08:20:59.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:20:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:20:58.540821+0000 mgr.y (mgr.14505) 162 : cluster [DBG] pgmap v165: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 5.3 GiB data, 17 GiB used, 699 GiB / 715 GiB avail; 1.2 KiB/s rd, 48 MiB/s wr, 765 op/s; 25023/259554 objects degraded (9.641%); 5.7 MiB/s, 91 objects/s recovering 2024-02-10T08:20:59.912 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:20:59.918 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:20:59.919 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:21:00.020 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:21:00.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:20:59 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:20:58.540821+0000 mgr.y (mgr.14505) 162 : cluster [DBG] pgmap v165: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 5.3 GiB data, 17 GiB used, 699 GiB / 715 GiB avail; 1.2 KiB/s rd, 48 MiB/s wr, 765 op/s; 25023/259554 objects degraded (9.641%); 5.7 MiB/s, 91 objects/s recovering 2024-02-10T08:21:00.106 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:00.240 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 70 16 87978 87962 78.4869 34.875 0.0185868 0.0127353 2024-02-10T08:21:00.687 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:21:00.690 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:00.690 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:21:00.697 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is unset 2024-02-10T08:21:00.792 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:21:00.830 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:00.851 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:21:00.856 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:00.856 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:21:00.957 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:21:00.985 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:20:59.902456+0000 mon.b (mon.1) 41 : audit [INF] from='client.? 172.21.15.18:0/3848928174' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:21:00.985 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:20:59.907987+0000 mon.a (mon.0) 865 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:21:00.985 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:21:00.389120+0000 mon.a (mon.0) 866 : cluster [WRN] Health check update: Degraded data redundancy: 25023/259554 objects degraded (9.641%), 5 pgs degraded (PG_DEGRADED) 2024-02-10T08:21:00.987 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:01.007 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:21:01.012 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:01.012 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:21:01.113 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:21:01.158 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:20:59.902456+0000 mon.b (mon.1) 41 : audit [INF] from='client.? 172.21.15.18:0/3848928174' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:21:01.158 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:20:59.907987+0000 mon.a (mon.0) 865 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:21:01.158 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:21:00.389120+0000 mon.a (mon.0) 866 : cluster [WRN] Health check update: Degraded data redundancy: 25023/259554 objects degraded (9.641%), 5 pgs degraded (PG_DEGRADED) 2024-02-10T08:21:01.158 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:20:59.902456+0000 mon.b (mon.1) 41 : audit [INF] from='client.? 172.21.15.18:0/3848928174' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:21:01.158 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:20:59.907987+0000 mon.a (mon.0) 865 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:21:01.159 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:21:00.389120+0000 mon.a (mon.0) 866 : cluster [WRN] Health check update: Degraded data redundancy: 25023/259554 objects degraded (9.641%), 5 pgs degraded (PG_DEGRADED) 2024-02-10T08:21:01.194 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:01.240 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 71 16 88613 88597 77.9407 39.6875 0.0336714 0.0128251 2024-02-10T08:21:01.258 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:21:01.269 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:01.269 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:21:01.370 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:21:01.472 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:01.712 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:21:00.542381+0000 mgr.y (mgr.14505) 163 : cluster [DBG] pgmap v166: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 5.3 GiB data, 17 GiB used, 699 GiB / 715 GiB avail; 1.1 KiB/s rd, 42 MiB/s wr, 678 op/s; 25023/259554 objects degraded (9.641%); 5.0 MiB/s, 80 objects/s recovering 2024-02-10T08:21:01.712 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:21:00.633551+0000 mon.a (mon.0) 867 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:21:01.712 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:21:00.643205+0000 mon.a (mon.0) 868 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-10T08:21:01.712 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:21:00.643282+0000 mon.a (mon.0) 869 : cluster [DBG] osdmap e116: 8 total, 8 up, 8 in 2024-02-10T08:21:01.712 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:21:01.618666+0000 mon.a (mon.0) 870 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:21:01.712 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:21:00.542381+0000 mgr.y (mgr.14505) 163 : cluster [DBG] pgmap v166: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 5.3 GiB data, 17 GiB used, 699 GiB / 715 GiB avail; 1.1 KiB/s rd, 42 MiB/s wr, 678 op/s; 25023/259554 objects degraded (9.641%); 5.0 MiB/s, 80 objects/s recovering 2024-02-10T08:21:01.712 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:21:00.633551+0000 mon.a (mon.0) 867 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:21:01.712 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:21:00.643205+0000 mon.a (mon.0) 868 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-10T08:21:01.713 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:21:00.643282+0000 mon.a (mon.0) 869 : cluster [DBG] osdmap e116: 8 total, 8 up, 8 in 2024-02-10T08:21:01.713 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:21:01.618666+0000 mon.a (mon.0) 870 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:21:02.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:21:00.542381+0000 mgr.y (mgr.14505) 163 : cluster [DBG] pgmap v166: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 5.3 GiB data, 17 GiB used, 699 GiB / 715 GiB avail; 1.1 KiB/s rd, 42 MiB/s wr, 678 op/s; 25023/259554 objects degraded (9.641%); 5.0 MiB/s, 80 objects/s recovering 2024-02-10T08:21:02.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:21:00.633551+0000 mon.a (mon.0) 867 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:21:02.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:21:00.643205+0000 mon.a (mon.0) 868 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-10T08:21:02.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:21:00.643282+0000 mon.a (mon.0) 869 : cluster [DBG] osdmap e116: 8 total, 8 up, 8 in 2024-02-10T08:21:02.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:21:01.618666+0000 mon.a (mon.0) 870 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:21:02.055 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:21:02.060 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:02.060 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:21:02.161 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:21:02.233 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:02.240 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 72 16 89263 89247 77.4227 40.625 0.0297728 0.012911 2024-02-10T08:21:02.350 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:21:02.354 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:02.354 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:21:02.455 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:21:02.489 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:02.513 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:21:02.516 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:02.516 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:21:02.617 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:21:02.645 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:02.665 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:21:02.668 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:02.669 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:21:02.769 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:21:02.907 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:02.976 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:21:02.981 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:02.982 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:21:03.083 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:21:03.115 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:03.142 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:21:03.144 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:03.144 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:21:03.242 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 73 16 89881 89865 76.8895 38.625 0.0243371 0.0130008 2024-02-10T08:21:03.245 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:21:03.337 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:03.806 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:21:03.814 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:03.814 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:21:03.915 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:21:03.990 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:21:02.543122+0000 mgr.y (mgr.14505) 164 : cluster [DBG] pgmap v168: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 5.4 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1.2 KiB/s rd, 43 MiB/s wr, 686 op/s; 25248/266556 objects degraded (9.472%); 4.4 MiB/s, 70 objects/s recovering 2024-02-10T08:21:03.990 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:21:02.847209+0000 mgr.y (mgr.14505) 165 : audit [DBG] from='client.24746 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-10T08:21:03.990 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:21:02.543122+0000 mgr.y (mgr.14505) 164 : cluster [DBG] pgmap v168: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 5.4 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1.2 KiB/s rd, 43 MiB/s wr, 686 op/s; 25248/266556 objects degraded (9.472%); 4.4 MiB/s, 70 objects/s recovering 2024-02-10T08:21:03.990 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:21:02.847209+0000 mgr.y (mgr.14505) 165 : audit [DBG] from='client.24746 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-10T08:21:04.010 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:04.041 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:21:02.543122+0000 mgr.y (mgr.14505) 164 : cluster [DBG] pgmap v168: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 5.4 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1.2 KiB/s rd, 43 MiB/s wr, 686 op/s; 25248/266556 objects degraded (9.472%); 4.4 MiB/s, 70 objects/s recovering 2024-02-10T08:21:04.042 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:21:02.847209+0000 mgr.y (mgr.14505) 165 : audit [DBG] from='client.24746 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-10T08:21:04.085 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:21:04.103 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:21:04.105 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:21:04.106 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-02-10T08:21:04.109 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:04.110 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:21:04.210 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:21:04.236 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:21:04.241 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:21:04.242 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 74 16 90494 90478 76.3684 38.3125 0.0477696 0.013087 2024-02-10T08:21:04.283 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:21:04.296 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:04.347 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:21:04.390 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:21:04.431 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:21:04.499 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:21:04.535 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:21:04.562 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-10T08:21:04.563 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-10T08:21:04.563 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-10T08:21:04.563 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-10T08:21:04.563 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-10T08:21:04.563 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-10T08:21:04.563 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-10T08:21:04.563 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-10T08:21:04.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:21:04.125442+0000 mon.b (mon.1) 42 : audit [DBG] from='client.? 172.21.15.18:0/70396882' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:21:04.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:21:04.125442+0000 mon.b (mon.1) 42 : audit [DBG] from='client.? 172.21.15.18:0/70396882' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:21:05.041 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:21:04.125442+0000 mon.b (mon.1) 42 : audit [DBG] from='client.? 172.21.15.18:0/70396882' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:21:05.242 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 75 16 91169 91153 75.9128 42.1875 0.0220204 0.0131665 2024-02-10T08:21:05.288 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:21:05.299 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:05.300 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:21:05.401 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:21:05.432 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:05.453 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:21:05.456 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:05.456 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:21:05.557 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:21:05.631 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:05.745 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:21:04.544663+0000 mgr.y (mgr.14505) 166 : cluster [DBG] pgmap v169: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 5.5 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1.1 KiB/s rd, 43 MiB/s wr, 686 op/s; 25046/268836 objects degraded (9.316%); 5.3 MiB/s, 84 objects/s recovering 2024-02-10T08:21:05.745 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:21:05.391057+0000 mon.a (mon.0) 871 : cluster [WRN] Health check update: Degraded data redundancy: 25046/268836 objects degraded (9.316%), 5 pgs degraded (PG_DEGRADED) 2024-02-10T08:21:05.746 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:21:05.405292+0000 mon.a (mon.0) 872 : cluster [DBG] osdmap e117: 8 total, 8 up, 8 in 2024-02-10T08:21:05.791 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd unset nodeep-scrub 2024-02-10T08:21:05.870 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:21:04.544663+0000 mgr.y (mgr.14505) 166 : cluster [DBG] pgmap v169: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 5.5 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1.1 KiB/s rd, 43 MiB/s wr, 686 op/s; 25046/268836 objects degraded (9.316%); 5.3 MiB/s, 84 objects/s recovering 2024-02-10T08:21:05.871 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:21:05.391057+0000 mon.a (mon.0) 871 : cluster [WRN] Health check update: Degraded data redundancy: 25046/268836 objects degraded (9.316%), 5 pgs degraded (PG_DEGRADED) 2024-02-10T08:21:05.871 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:21:05.405292+0000 mon.a (mon.0) 872 : cluster [DBG] osdmap e117: 8 total, 8 up, 8 in 2024-02-10T08:21:05.871 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:21:04.544663+0000 mgr.y (mgr.14505) 166 : cluster [DBG] pgmap v169: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 5.5 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1.1 KiB/s rd, 43 MiB/s wr, 686 op/s; 25046/268836 objects degraded (9.316%); 5.3 MiB/s, 84 objects/s recovering 2024-02-10T08:21:05.871 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:21:05.391057+0000 mon.a (mon.0) 871 : cluster [WRN] Health check update: Degraded data redundancy: 25046/268836 objects degraded (9.316%), 5 pgs degraded (PG_DEGRADED) 2024-02-10T08:21:05.871 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:21:05.405292+0000 mon.a (mon.0) 872 : cluster [DBG] osdmap e117: 8 total, 8 up, 8 in 2024-02-10T08:21:05.925 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:21:05.931 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:05.932 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:21:06.032 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:21:06.135 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:06.245 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 76 16 91778 91762 75.415 38.0625 0.0293378 0.0132546 2024-02-10T08:21:06.471 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":168,"stamp":"2024-02-10T08:21:02.542538+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":5810427556,"num_objects":88852,"num_object_clones":0,"num_object_copies":266556,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":25248,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88852,"num_whiteouts":0,"num_read":944,"num_read_kb":696,"num_write":89088,"num_write_kb":5674281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":928,"num_bytes_recovered":60031416,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":84658,"ondisk_log_size":84658,"up":444,"acting":439,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":444,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":17808044,"kb_used_data":15376492,"kb_used_omap":0,"kb_used_meta":2431487,"kb_avail":732153172,"statfs":{"total":767960285184,"available":749724848128,"internally_reserved":0,"allocated":15745527808,"data_stored":15741696842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":972,"internal_metadata":2489842740},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,2,0,3,3,3],"upper_bound":64},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":359792640,"num_objects":5490,"num_object_clones":0,"num_object_copies":16470,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":236,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5490,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5490,"num_write_kb":351360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":565,"num_bytes_recovered":37027840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.009410"},"pg_stats":[{"pgid":"6.1b","version":"0'0","reported_seq":69,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.422491+0000","last_change":"2024-02-10T08:19:01.075963+0000","last_active":"2024-02-10T08:20:55.422491+0000","last_peered":"2024-02-10T08:20:55.422491+0000","last_clean":"2024-02-10T08:20:55.422491+0000","last_became_active":"2024-02-10T08:16:58.892091+0000","last_became_peered":"2024-02-10T08:16:58.892091+0000","last_unstale":"2024-02-10T08:20:55.422491+0000","last_undegraded":"2024-02-10T08:20:55.422491+0000","last_fullsized":"2024-02-10T08:20:55.422491+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:01.075886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:19:01.075886+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":47,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-02-10T08:20:51.517197+0000","last_change":"2024-02-10T08:20:46.404906+0000","last_active":"2024-02-10T08:20:51.517197+0000","last_peered":"2024-02-10T08:20:51.517197+0000","last_clean":"2024-02-10T08:20:51.517197+0000","last_became_active":"2024-02-10T08:20:46.404597+0000","last_became_peered":"2024-02-10T08:20:46.404597+0000","last_unstale":"2024-02-10T08:20:51.517197+0000","last_undegraded":"2024-02-10T08:20:51.517197+0000","last_fullsized":"2024-02-10T08:20:51.517197+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:09.941898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:09.941898+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":88,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-02-10T08:20:51.538639+0000","last_change":"2024-02-10T08:20:46.407187+0000","last_active":"2024-02-10T08:20:51.538639+0000","last_peered":"2024-02-10T08:20:51.538639+0000","last_clean":"2024-02-10T08:20:51.538639+0000","last_became_active":"2024-02-10T08:20:46.406826+0000","last_became_peered":"2024-02-10T08:20:46.406826+0000","last_unstale":"2024-02-10T08:20:51.538639+0000","last_undegraded":"2024-02-10T08:20:51.538639+0000","last_fullsized":"2024-02-10T08:20:51.538639+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:43.744900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:43.744900+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"62'15","reported_seq":103,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.422602+0000","last_change":"2024-02-10T08:20:03.330608+0000","last_active":"2024-02-10T08:20:55.422602+0000","last_peered":"2024-02-10T08:20:55.422602+0000","last_clean":"2024-02-10T08:20:55.422602+0000","last_became_active":"2024-02-10T08:16:54.849232+0000","last_became_peered":"2024-02-10T08:16:54.849232+0000","last_unstale":"2024-02-10T08:20:55.422602+0000","last_undegraded":"2024-02-10T08:20:55.422602+0000","last_fullsized":"2024-02-10T08:20:55.422602+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'15","last_scrub_stamp":"2024-02-10T08:20:03.330508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:20:03.330508+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":51,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-02-10T08:20:51.517419+0000","last_change":"2024-02-10T08:20:46.405782+0000","last_active":"2024-02-10T08:20:51.517419+0000","last_peered":"2024-02-10T08:20:51.517419+0000","last_clean":"2024-02-10T08:20:51.517419+0000","last_became_active":"2024-02-10T08:20:46.405314+0000","last_became_peered":"2024-02-10T08:20:46.405314+0000","last_unstale":"2024-02-10T08:20:51.517419+0000","last_undegraded":"2024-02-10T08:20:51.517419+0000","last_fullsized":"2024-02-10T08:20:51.517419+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:19.058317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:19.058317+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":76,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.435666+0000","last_change":"2024-02-10T08:20:06.810606+0000","last_active":"2024-02-10T08:20:55.435666+0000","last_peered":"2024-02-10T08:20:55.435666+0000","last_clean":"2024-02-10T08:20:55.435666+0000","last_became_active":"2024-02-10T08:16:56.863353+0000","last_became_peered":"2024-02-10T08:16:56.863353+0000","last_unstale":"2024-02-10T08:20:55.435666+0000","last_undegraded":"2024-02-10T08:20:55.435666+0000","last_fullsized":"2024-02-10T08:20:55.435666+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:06.810521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:20:06.810521+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":80,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.429630+0000","last_change":"2024-02-10T08:19:28.176418+0000","last_active":"2024-02-10T08:20:55.429630+0000","last_peered":"2024-02-10T08:20:55.429630+0000","last_clean":"2024-02-10T08:20:55.429630+0000","last_became_active":"2024-02-10T08:16:52.787183+0000","last_became_peered":"2024-02-10T08:16:52.787183+0000","last_unstale":"2024-02-10T08:20:55.429630+0000","last_undegraded":"2024-02-10T08:20:55.429630+0000","last_fullsized":"2024-02-10T08:20:55.429630+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:28.176344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:19:28.176344+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"62'9","reported_seq":66,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-02-10T08:20:51.517347+0000","last_change":"2024-02-10T08:20:46.405346+0000","last_active":"2024-02-10T08:20:51.517347+0000","last_peered":"2024-02-10T08:20:51.517347+0000","last_clean":"2024-02-10T08:20:51.517347+0000","last_became_active":"2024-02-10T08:20:46.404966+0000","last_became_peered":"2024-02-10T08:20:46.404966+0000","last_unstale":"2024-02-10T08:20:51.517347+0000","last_undegraded":"2024-02-10T08:20:51.517347+0000","last_fullsized":"2024-02-10T08:20:51.517347+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'9","last_scrub_stamp":"2024-02-10T08:18:12.998167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:12.998167+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":73,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.406838+0000","last_change":"2024-02-10T08:20:09.280914+0000","last_active":"2024-02-10T08:20:55.406838+0000","last_peered":"2024-02-10T08:20:55.406838+0000","last_clean":"2024-02-10T08:20:55.406838+0000","last_became_active":"2024-02-10T08:16:58.867430+0000","last_became_peered":"2024-02-10T08:16:58.867430+0000","last_unstale":"2024-02-10T08:20:55.406838+0000","last_undegraded":"2024-02-10T08:20:55.406838+0000","last_fullsized":"2024-02-10T08:20:55.406838+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:09.280825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:20:09.280825+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":90,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.432381+0000","last_change":"2024-02-10T08:20:46.407232+0000","last_active":"2024-02-10T08:20:55.432381+0000","last_peered":"2024-02-10T08:20:55.432381+0000","last_clean":"2024-02-10T08:20:55.432381+0000","last_became_active":"2024-02-10T08:20:46.406783+0000","last_became_peered":"2024-02-10T08:20:46.406783+0000","last_unstale":"2024-02-10T08:20:55.432381+0000","last_undegraded":"2024-02-10T08:20:55.432381+0000","last_fullsized":"2024-02-10T08:20:55.432381+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:19.291495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:19:19.291495+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"55'1","reported_seq":86,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.433084+0000","last_change":"2024-02-10T08:20:20.303814+0000","last_active":"2024-02-10T08:20:55.433084+0000","last_peered":"2024-02-10T08:20:55.433084+0000","last_clean":"2024-02-10T08:20:55.433084+0000","last_became_active":"2024-02-10T08:16:52.790462+0000","last_became_peered":"2024-02-10T08:16:52.790462+0000","last_unstale":"2024-02-10T08:20:55.433084+0000","last_undegraded":"2024-02-10T08:20:55.433084+0000","last_fullsized":"2024-02-10T08:20:55.433084+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'1","last_scrub_stamp":"2024-02-10T08:20:20.303730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:20:20.303730+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"62'5","reported_seq":74,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-02-10T08:20:51.518252+0000","last_change":"2024-02-10T08:20:46.403728+0000","last_active":"2024-02-10T08:20:51.518252+0000","last_peered":"2024-02-10T08:20:51.518252+0000","last_clean":"2024-02-10T08:20:51.518252+0000","last_became_active":"2024-02-10T08:20:46.403373+0000","last_became_peered":"2024-02-10T08:20:46.403373+0000","last_unstale":"2024-02-10T08:20:51.518252+0000","last_undegraded":"2024-02-10T08:20:51.518252+0000","last_fullsized":"2024-02-10T08:20:51.518252+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'5","last_scrub_stamp":"2024-02-10T08:19:29.251633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:19:29.251633+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":6,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":72,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-02-10T08:20:51.530961+0000","last_change":"2024-02-10T08:20:00.830960+0000","last_active":"2024-02-10T08:20:51.530961+0000","last_peered":"2024-02-10T08:20:51.530961+0000","last_clean":"2024-02-10T08:20:51.530961+0000","last_became_active":"2024-02-10T08:16:58.860591+0000","last_became_peered":"2024-02-10T08:16:58.860591+0000","last_unstale":"2024-02-10T08:20:51.530961+0000","last_undegraded":"2024-02-10T08:20:51.530961+0000","last_fullsized":"2024-02-10T08:20:51.530961+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:00.830869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:20:00.830869+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":80,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.407917+0000","last_change":"2024-02-10T08:20:32.126091+0000","last_active":"2024-02-10T08:20:55.407917+0000","last_peered":"2024-02-10T08:20:55.407917+0000","last_clean":"2024-02-10T08:20:55.407917+0000","last_became_active":"2024-02-10T08:16:56.864532+0000","last_became_peered":"2024-02-10T08:16:56.864532+0000","last_unstale":"2024-02-10T08:20:55.407917+0000","last_undegraded":"2024-02-10T08:20:55.407917+0000","last_fullsized":"2024-02-10T08:20:55.407917+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:32.126007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:20:32.126007+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":79,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.432607+0000","last_change":"2024-02-10T08:20:02.245653+0000","last_active":"2024-02-10T08:20:55.432607+0000","last_peered":"2024-02-10T08:20:55.432607+0000","last_clean":"2024-02-10T08:20:55.432607+0000","last_became_active":"2024-02-10T08:16:52.787865+0000","last_became_peered":"2024-02-10T08:16:52.787865+0000","last_unstale":"2024-02-10T08:20:55.432607+0000","last_undegraded":"2024-02-10T08:20:55.432607+0000","last_fullsized":"2024-02-10T08:20:55.432607+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:02.245593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:28.028556+0000","last_clean_scrub_stamp":"2024-02-10T08:20:02.245593+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"62'9","reported_seq":68,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-02-10T08:20:51.517449+0000","last_change":"2024-02-10T08:20:46.401585+0000","last_active":"2024-02-10T08:20:51.517449+0000","last_peered":"2024-02-10T08:20:51.517449+0000","last_clean":"2024-02-10T08:20:51.517449+0000","last_became_active":"2024-02-10T08:20:46.401156+0000","last_became_peered":"2024-02-10T08:20:46.401156+0000","last_unstale":"2024-02-10T08:20:51.517449+0000","last_undegraded":"2024-02-10T08:20:51.517449+0000","last_fullsized":"2024-02-10T08:20:51.517449+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'9","last_scrub_stamp":"2024-02-10T08:18:15.012657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:15.012657+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":69,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.442431+0000","last_change":"2024-02-10T08:18:52.045246+0000","last_active":"2024-02-10T08:20:55.442431+0000","last_peered":"2024-02-10T08:20:55.442431+0000","last_clean":"2024-02-10T08:20:55.442431+0000","last_became_active":"2024-02-10T08:16:58.891365+0000","last_became_peered":"2024-02-10T08:16:58.891365+0000","last_unstale":"2024-02-10T08:20:55.442431+0000","last_undegraded":"2024-02-10T08:20:55.442431+0000","last_fullsized":"2024-02-10T08:20:55.442431+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:52.045180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:52.045180+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":53,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-02-10T08:20:51.517672+0000","last_change":"2024-02-10T08:20:46.399318+0000","last_active":"2024-02-10T08:20:51.517672+0000","last_peered":"2024-02-10T08:20:51.517672+0000","last_clean":"2024-02-10T08:20:51.517672+0000","last_became_active":"2024-02-10T08:20:46.398532+0000","last_became_peered":"2024-02-10T08:20:46.398532+0000","last_unstale":"2024-02-10T08:20:51.517672+0000","last_undegraded":"2024-02-10T08:20:51.517672+0000","last_fullsized":"2024-02-10T08:20:51.517672+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:22.000811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:22.000811+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":80,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.422671+0000","last_change":"2024-02-10T08:20:04.345319+0000","last_active":"2024-02-10T08:20:55.422671+0000","last_peered":"2024-02-10T08:20:55.422671+0000","last_clean":"2024-02-10T08:20:55.422671+0000","last_became_active":"2024-02-10T08:16:52.785404+0000","last_became_peered":"2024-02-10T08:16:52.785404+0000","last_unstale":"2024-02-10T08:20:55.422671+0000","last_undegraded":"2024-02-10T08:20:55.422671+0000","last_fullsized":"2024-02-10T08:20:55.422671+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:04.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:20:04.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"74'17","reported_seq":116,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.422386+0000","last_change":"2024-02-10T08:20:46.400148+0000","last_active":"2024-02-10T08:20:55.422386+0000","last_peered":"2024-02-10T08:20:55.422386+0000","last_clean":"2024-02-10T08:20:55.422386+0000","last_became_active":"2024-02-10T08:20:46.399726+0000","last_became_peered":"2024-02-10T08:20:46.399726+0000","last_unstale":"2024-02-10T08:20:55.422386+0000","last_undegraded":"2024-02-10T08:20:55.422386+0000","last_fullsized":"2024-02-10T08:20:55.422386+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'17","last_scrub_stamp":"2024-02-10T08:18:02.949298+0000","last_deep_scrub":"74'17","last_deep_scrub_stamp":"2024-02-10T08:18:02.949298+0000","last_clean_scrub_stamp":"2024-02-10T08:18:02.949298+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":51,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-02-10T08:20:51.517578+0000","last_change":"2024-02-10T08:20:46.403697+0000","last_active":"2024-02-10T08:20:51.517578+0000","last_peered":"2024-02-10T08:20:51.517578+0000","last_clean":"2024-02-10T08:20:51.517578+0000","last_became_active":"2024-02-10T08:20:46.403378+0000","last_became_peered":"2024-02-10T08:20:46.403378+0000","last_unstale":"2024-02-10T08:20:51.517578+0000","last_undegraded":"2024-02-10T08:20:51.517578+0000","last_fullsized":"2024-02-10T08:20:51.517578+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:26.952496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:26.952496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":86,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.436048+0000","last_change":"2024-02-10T08:20:46.407843+0000","last_active":"2024-02-10T08:20:55.436048+0000","last_peered":"2024-02-10T08:20:55.436048+0000","last_clean":"2024-02-10T08:20:55.436048+0000","last_became_active":"2024-02-10T08:20:46.407373+0000","last_became_peered":"2024-02-10T08:20:46.407373+0000","last_unstale":"2024-02-10T08:20:55.436048+0000","last_undegraded":"2024-02-10T08:20:55.436048+0000","last_fullsized":"2024-02-10T08:20:55.436048+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:38.230210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:38.230210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":94,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.431698+0000","last_change":"2024-02-10T08:20:46.396617+0000","last_active":"2024-02-10T08:20:55.431698+0000","last_peered":"2024-02-10T08:20:55.431698+0000","last_clean":"2024-02-10T08:20:55.431698+0000","last_became_active":"2024-02-10T08:20:46.396303+0000","last_became_peered":"2024-02-10T08:20:46.396303+0000","last_unstale":"2024-02-10T08:20:55.431698+0000","last_undegraded":"2024-02-10T08:20:55.431698+0000","last_fullsized":"2024-02-10T08:20:55.431698+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:10.370746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:10.370746+0000","last_clean_scrub_stamp":"2024-02-10T08:19:10.370746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1c","version":"62'15","reported_seq":108,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.436482+0000","last_change":"2024-02-10T08:20:30.939623+0000","last_active":"2024-02-10T08:20:55.436482+0000","last_peered":"2024-02-10T08:20:55.436482+0000","last_clean":"2024-02-10T08:20:55.436482+0000","last_became_active":"2024-02-10T08:16:54.849361+0000","last_became_peered":"2024-02-10T08:16:54.849361+0000","last_unstale":"2024-02-10T08:20:55.436482+0000","last_undegraded":"2024-02-10T08:20:55.436482+0000","last_fullsized":"2024-02-10T08:20:55.436482+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'15","last_scrub_stamp":"2024-02-10T08:20:30.939526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:20:30.939526+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":84,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.435699+0000","last_change":"2024-02-10T08:20:46.408820+0000","last_active":"2024-02-10T08:20:55.435699+0000","last_peered":"2024-02-10T08:20:55.435699+0000","last_clean":"2024-02-10T08:20:55.435699+0000","last_became_active":"2024-02-10T08:20:46.408504+0000","last_became_peered":"2024-02-10T08:20:46.408504+0000","last_unstale":"2024-02-10T08:20:55.435699+0000","last_undegraded":"2024-02-10T08:20:55.435699+0000","last_fullsized":"2024-02-10T08:20:55.435699+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:22.104988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:22.104988+0000","last_clean_scrub_stamp":"2024-02-10T08:18:22.104988+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":74,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-02-10T08:20:51.539798+0000","last_change":"2024-02-10T08:20:02.843334+0000","last_active":"2024-02-10T08:20:51.539798+0000","last_peered":"2024-02-10T08:20:51.539798+0000","last_clean":"2024-02-10T08:20:51.539798+0000","last_became_active":"2024-02-10T08:16:56.863348+0000","last_became_peered":"2024-02-10T08:16:56.863348+0000","last_unstale":"2024-02-10T08:20:51.539798+0000","last_undegraded":"2024-02-10T08:20:51.539798+0000","last_fullsized":"2024-02-10T08:20:51.539798+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:02.843237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:20:02.843237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":80,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.422387+0000","last_change":"2024-02-10T08:20:14.239093+0000","last_active":"2024-02-10T08:20:55.422387+0000","last_peered":"2024-02-10T08:20:55.422387+0000","last_clean":"2024-02-10T08:20:55.422387+0000","last_became_active":"2024-02-10T08:16:52.785743+0000","last_became_peered":"2024-02-10T08:16:52.785743+0000","last_unstale":"2024-02-10T08:20:55.422387+0000","last_undegraded":"2024-02-10T08:20:55.422387+0000","last_fullsized":"2024-02-10T08:20:55.422387+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:14.238991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:20:14.238991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"62'11","reported_seq":96,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.431148+0000","last_change":"2024-02-10T08:19:29.497168+0000","last_active":"2024-02-10T08:20:55.431148+0000","last_peered":"2024-02-10T08:20:55.431148+0000","last_clean":"2024-02-10T08:20:55.431148+0000","last_became_active":"2024-02-10T08:16:54.852665+0000","last_became_peered":"2024-02-10T08:16:54.852665+0000","last_unstale":"2024-02-10T08:20:55.431148+0000","last_undegraded":"2024-02-10T08:20:55.431148+0000","last_fullsized":"2024-02-10T08:20:55.431148+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'11","last_scrub_stamp":"2024-02-10T08:19:29.497086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:19:29.497086+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"87'2","reported_seq":75,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.432904+0000","last_change":"2024-02-10T08:19:29.207609+0000","last_active":"2024-02-10T08:20:55.432904+0000","last_peered":"2024-02-10T08:20:55.432904+0000","last_clean":"2024-02-10T08:20:55.432904+0000","last_became_active":"2024-02-10T08:16:58.859047+0000","last_became_peered":"2024-02-10T08:16:58.859047+0000","last_unstale":"2024-02-10T08:20:55.432904+0000","last_undegraded":"2024-02-10T08:20:55.432904+0000","last_fullsized":"2024-02-10T08:20:55.432904+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'2","last_scrub_stamp":"2024-02-10T08:19:29.207531+0000","last_deep_scrub":"87'2","last_deep_scrub_stamp":"2024-02-10T08:19:29.207531+0000","last_clean_scrub_stamp":"2024-02-10T08:19:29.207531+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"111'11","reported_seq":152,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-02-10T08:21:00.656282+0000","last_change":"2024-02-10T08:20:46.403619+0000","last_active":"2024-02-10T08:21:00.656282+0000","last_peered":"2024-02-10T08:21:00.656282+0000","last_clean":"2024-02-10T08:21:00.656282+0000","last_became_active":"2024-02-10T08:20:46.402663+0000","last_became_peered":"2024-02-10T08:20:46.402663+0000","last_unstale":"2024-02-10T08:21:00.656282+0000","last_undegraded":"2024-02-10T08:21:00.656282+0000","last_fullsized":"2024-02-10T08:21:00.656282+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'9","last_scrub_stamp":"2024-02-10T08:18:36.323217+0000","last_deep_scrub":"82'9","last_deep_scrub_stamp":"2024-02-10T08:18:36.323217+0000","last_clean_scrub_stamp":"2024-02-10T08:18:36.323217+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":89,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.408968+0000","last_change":"2024-02-10T08:20:46.392818+0000","last_active":"2024-02-10T08:20:55.408968+0000","last_peered":"2024-02-10T08:20:55.408968+0000","last_clean":"2024-02-10T08:20:55.408968+0000","last_became_active":"2024-02-10T08:20:46.392466+0000","last_became_peered":"2024-02-10T08:20:46.392466+0000","last_unstale":"2024-02-10T08:20:55.408968+0000","last_undegraded":"2024-02-10T08:20:55.408968+0000","last_fullsized":"2024-02-10T08:20:55.408968+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:30.422800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:30.422800+0000","last_clean_scrub_stamp":"2024-02-10T08:18:30.422800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"74'15","reported_seq":96,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-02-10T08:20:51.534439+0000","last_change":"2024-02-10T08:19:15.492916+0000","last_active":"2024-02-10T08:20:51.534439+0000","last_peered":"2024-02-10T08:20:51.534439+0000","last_clean":"2024-02-10T08:20:51.534439+0000","last_became_active":"2024-02-10T08:16:55.204738+0000","last_became_peered":"2024-02-10T08:16:55.204738+0000","last_unstale":"2024-02-10T08:20:51.534439+0000","last_undegraded":"2024-02-10T08:20:51.534439+0000","last_fullsized":"2024-02-10T08:20:51.534439+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'15","last_scrub_stamp":"2024-02-10T08:19:15.492821+0000","last_deep_scrub":"74'15","last_deep_scrub_stamp":"2024-02-10T08:17:57.637346+0000","last_clean_scrub_stamp":"2024-02-10T08:19:15.492821+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":74,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.423072+0000","last_change":"2024-02-10T08:20:15.204543+0000","last_active":"2024-02-10T08:20:55.423072+0000","last_peered":"2024-02-10T08:20:55.423072+0000","last_clean":"2024-02-10T08:20:55.423072+0000","last_became_active":"2024-02-10T08:16:58.892622+0000","last_became_peered":"2024-02-10T08:16:58.892622+0000","last_unstale":"2024-02-10T08:20:55.423072+0000","last_undegraded":"2024-02-10T08:20:55.423072+0000","last_fullsized":"2024-02-10T08:20:55.423072+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:15.204475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:20:15.204475+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":90,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.432617+0000","last_change":"2024-02-10T08:20:46.400144+0000","last_active":"2024-02-10T08:20:55.432617+0000","last_peered":"2024-02-10T08:20:55.432617+0000","last_clean":"2024-02-10T08:20:55.432617+0000","last_became_active":"2024-02-10T08:20:46.399838+0000","last_became_peered":"2024-02-10T08:20:46.399838+0000","last_unstale":"2024-02-10T08:20:55.432617+0000","last_undegraded":"2024-02-10T08:20:55.432617+0000","last_fullsized":"2024-02-10T08:20:55.432617+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:06.357048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:19:06.357048+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":79,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.431069+0000","last_change":"2024-02-10T08:19:22.466525+0000","last_active":"2024-02-10T08:20:55.431069+0000","last_peered":"2024-02-10T08:20:55.431069+0000","last_clean":"2024-02-10T08:20:55.431069+0000","last_became_active":"2024-02-10T08:16:52.788629+0000","last_became_peered":"2024-02-10T08:16:52.788629+0000","last_unstale":"2024-02-10T08:20:55.431069+0000","last_undegraded":"2024-02-10T08:20:55.431069+0000","last_fullsized":"2024-02-10T08:20:55.431069+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:22.466453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:19:22.466453+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"62'11","reported_seq":97,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.422554+0000","last_change":"2024-02-10T08:19:32.166896+0000","last_active":"2024-02-10T08:20:55.422554+0000","last_peered":"2024-02-10T08:20:55.422554+0000","last_clean":"2024-02-10T08:20:55.422554+0000","last_became_active":"2024-02-10T08:16:55.204751+0000","last_became_peered":"2024-02-10T08:16:55.204751+0000","last_unstale":"2024-02-10T08:20:55.422554+0000","last_undegraded":"2024-02-10T08:20:55.422554+0000","last_fullsized":"2024-02-10T08:20:55.422554+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'11","last_scrub_stamp":"2024-02-10T08:19:32.166830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:19:32.166830+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":88,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.432418+0000","last_change":"2024-02-10T08:20:46.399860+0000","last_active":"2024-02-10T08:20:55.432418+0000","last_peered":"2024-02-10T08:20:55.432418+0000","last_clean":"2024-02-10T08:20:55.432418+0000","last_became_active":"2024-02-10T08:20:46.399515+0000","last_became_peered":"2024-02-10T08:20:46.399515+0000","last_unstale":"2024-02-10T08:20:55.432418+0000","last_undegraded":"2024-02-10T08:20:55.432418+0000","last_fullsized":"2024-02-10T08:20:55.432418+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:27.276490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:27.276490+0000","last_clean_scrub_stamp":"2024-02-10T08:19:27.276490+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":85,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.430657+0000","last_change":"2024-02-10T08:20:46.397801+0000","last_active":"2024-02-10T08:20:55.430657+0000","last_peered":"2024-02-10T08:20:55.430657+0000","last_clean":"2024-02-10T08:20:55.430657+0000","last_became_active":"2024-02-10T08:20:46.397495+0000","last_became_peered":"2024-02-10T08:20:46.397495+0000","last_unstale":"2024-02-10T08:20:55.430657+0000","last_undegraded":"2024-02-10T08:20:55.430657+0000","last_fullsized":"2024-02-10T08:20:55.430657+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:34.381329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:34.381329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":84,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.407613+0000","last_change":"2024-02-10T08:20:24.226131+0000","last_active":"2024-02-10T08:20:55.407613+0000","last_peered":"2024-02-10T08:20:55.407613+0000","last_clean":"2024-02-10T08:20:55.407613+0000","last_became_active":"2024-02-10T08:16:52.788704+0000","last_became_peered":"2024-02-10T08:16:52.788704+0000","last_unstale":"2024-02-10T08:20:55.407613+0000","last_undegraded":"2024-02-10T08:20:55.407613+0000","last_fullsized":"2024-02-10T08:20:55.407613+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:24.226061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:20:24.226061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"62'4","reported_seq":79,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.439104+0000","last_change":"2024-02-10T08:18:50.134758+0000","last_active":"2024-02-10T08:20:55.439104+0000","last_peered":"2024-02-10T08:20:55.439104+0000","last_clean":"2024-02-10T08:20:55.439104+0000","last_became_active":"2024-02-10T08:16:54.852959+0000","last_became_peered":"2024-02-10T08:16:54.852959+0000","last_unstale":"2024-02-10T08:20:55.439104+0000","last_undegraded":"2024-02-10T08:20:55.439104+0000","last_fullsized":"2024-02-10T08:20:55.439104+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'4","last_scrub_stamp":"2024-02-10T08:18:50.134690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:50.134690+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":74,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.422302+0000","last_change":"2024-02-10T08:19:02.030164+0000","last_active":"2024-02-10T08:20:55.422302+0000","last_peered":"2024-02-10T08:20:55.422302+0000","last_clean":"2024-02-10T08:20:55.422302+0000","last_became_active":"2024-02-10T08:16:58.864301+0000","last_became_peered":"2024-02-10T08:16:58.864301+0000","last_unstale":"2024-02-10T08:20:55.422302+0000","last_undegraded":"2024-02-10T08:20:55.422302+0000","last_fullsized":"2024-02-10T08:20:55.422302+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:02.030086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:19:02.030086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":76,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.435517+0000","last_change":"2024-02-10T08:20:07.754989+0000","last_active":"2024-02-10T08:20:55.435517+0000","last_peered":"2024-02-10T08:20:55.435517+0000","last_clean":"2024-02-10T08:20:55.435517+0000","last_became_active":"2024-02-10T08:16:56.860953+0000","last_became_peered":"2024-02-10T08:16:56.860953+0000","last_unstale":"2024-02-10T08:20:55.435517+0000","last_undegraded":"2024-02-10T08:20:55.435517+0000","last_fullsized":"2024-02-10T08:20:55.435517+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:07.754900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:20:07.754900+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":82,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.435860+0000","last_change":"2024-02-10T08:20:03.782239+0000","last_active":"2024-02-10T08:20:55.435860+0000","last_peered":"2024-02-10T08:20:55.435860+0000","last_clean":"2024-02-10T08:20:55.435860+0000","last_became_active":"2024-02-10T08:16:52.786400+0000","last_became_peered":"2024-02-10T08:16:52.786400+0000","last_unstale":"2024-02-10T08:20:55.435860+0000","last_undegraded":"2024-02-10T08:20:55.435860+0000","last_fullsized":"2024-02-10T08:20:55.435860+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:03.782136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:20:03.782136+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"62'11","reported_seq":96,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-02-10T08:20:51.518263+0000","last_change":"2024-02-10T08:20:46.396436+0000","last_active":"2024-02-10T08:20:51.518263+0000","last_peered":"2024-02-10T08:20:51.518263+0000","last_clean":"2024-02-10T08:20:51.518263+0000","last_became_active":"2024-02-10T08:20:46.396130+0000","last_became_peered":"2024-02-10T08:20:46.396130+0000","last_unstale":"2024-02-10T08:20:51.518263+0000","last_undegraded":"2024-02-10T08:20:51.518263+0000","last_fullsized":"2024-02-10T08:20:51.518263+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'11","last_scrub_stamp":"2024-02-10T08:18:17.029517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:17.029517+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":72,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-02-10T08:20:51.530551+0000","last_change":"2024-02-10T08:20:06.911888+0000","last_active":"2024-02-10T08:20:51.530551+0000","last_peered":"2024-02-10T08:20:51.530551+0000","last_clean":"2024-02-10T08:20:51.530551+0000","last_became_active":"2024-02-10T08:16:58.861031+0000","last_became_peered":"2024-02-10T08:16:58.861031+0000","last_unstale":"2024-02-10T08:20:51.530551+0000","last_undegraded":"2024-02-10T08:20:51.530551+0000","last_fullsized":"2024-02-10T08:20:51.530551+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:06.911805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:20:06.911805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":76,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.422738+0000","last_change":"2024-02-10T08:20:33.201454+0000","last_active":"2024-02-10T08:20:55.422738+0000","last_peered":"2024-02-10T08:20:55.422738+0000","last_clean":"2024-02-10T08:20:55.422738+0000","last_became_active":"2024-02-10T08:16:56.862136+0000","last_became_peered":"2024-02-10T08:16:56.862136+0000","last_unstale":"2024-02-10T08:20:55.422738+0000","last_undegraded":"2024-02-10T08:20:55.422738+0000","last_fullsized":"2024-02-10T08:20:55.422738+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:33.201370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:20:33.201370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":86,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.430728+0000","last_change":"2024-02-10T08:20:32.148461+0000","last_active":"2024-02-10T08:20:55.430728+0000","last_peered":"2024-02-10T08:20:55.430728+0000","last_clean":"2024-02-10T08:20:55.430728+0000","last_became_active":"2024-02-10T08:16:52.786213+0000","last_became_peered":"2024-02-10T08:16:52.786213+0000","last_unstale":"2024-02-10T08:20:55.430728+0000","last_undegraded":"2024-02-10T08:20:55.430728+0000","last_fullsized":"2024-02-10T08:20:55.430728+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:32.148377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:20:32.148377+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"62'9","reported_seq":99,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.435367+0000","last_change":"2024-02-10T08:20:27.597657+0000","last_active":"2024-02-10T08:20:55.435367+0000","last_peered":"2024-02-10T08:20:55.435367+0000","last_clean":"2024-02-10T08:20:55.435367+0000","last_became_active":"2024-02-10T08:16:54.851971+0000","last_became_peered":"2024-02-10T08:16:54.851971+0000","last_unstale":"2024-02-10T08:20:55.435367+0000","last_undegraded":"2024-02-10T08:20:55.435367+0000","last_fullsized":"2024-02-10T08:20:55.435367+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'9","last_scrub_stamp":"2024-02-10T08:20:27.597547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:20:27.597547+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":51,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-02-10T08:20:51.517620+0000","last_change":"2024-02-10T08:20:46.396485+0000","last_active":"2024-02-10T08:20:51.517620+0000","last_peered":"2024-02-10T08:20:51.517620+0000","last_clean":"2024-02-10T08:20:51.517620+0000","last_became_active":"2024-02-10T08:20:46.395788+0000","last_became_peered":"2024-02-10T08:20:46.395788+0000","last_unstale":"2024-02-10T08:20:51.517620+0000","last_undegraded":"2024-02-10T08:20:51.517620+0000","last_fullsized":"2024-02-10T08:20:51.517620+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:22.955823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:22.955823+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"62'8","reported_seq":134,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-02-10T08:21:00.653605+0000","last_change":"2024-02-10T08:20:10.352015+0000","last_active":"2024-02-10T08:21:00.653605+0000","last_peered":"2024-02-10T08:21:00.653605+0000","last_clean":"2024-02-10T08:21:00.653605+0000","last_became_active":"2024-02-10T08:16:56.854151+0000","last_became_peered":"2024-02-10T08:16:56.854151+0000","last_unstale":"2024-02-10T08:21:00.653605+0000","last_undegraded":"2024-02-10T08:21:00.653605+0000","last_fullsized":"2024-02-10T08:21:00.653605+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'8","last_scrub_stamp":"2024-02-10T08:20:10.351918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:20:10.351918+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":93,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-02-10T08:20:51.531422+0000","last_change":"2024-02-10T08:20:46.404011+0000","last_active":"2024-02-10T08:20:51.531422+0000","last_peered":"2024-02-10T08:20:51.531422+0000","last_clean":"2024-02-10T08:20:51.531422+0000","last_became_active":"2024-02-10T08:20:46.403803+0000","last_became_peered":"2024-02-10T08:20:46.403803+0000","last_unstale":"2024-02-10T08:20:51.531422+0000","last_undegraded":"2024-02-10T08:20:51.531422+0000","last_fullsized":"2024-02-10T08:20:51.531422+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:08.548458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:19:08.548458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"62'9","reported_seq":93,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.407085+0000","last_change":"2024-02-10T08:20:11.315987+0000","last_active":"2024-02-10T08:20:55.407085+0000","last_peered":"2024-02-10T08:20:55.407085+0000","last_clean":"2024-02-10T08:20:55.407085+0000","last_became_active":"2024-02-10T08:16:55.204734+0000","last_became_peered":"2024-02-10T08:16:55.204734+0000","last_unstale":"2024-02-10T08:20:55.407085+0000","last_undegraded":"2024-02-10T08:20:55.407085+0000","last_fullsized":"2024-02-10T08:20:55.407085+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'9","last_scrub_stamp":"2024-02-10T08:20:11.315903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:20:11.315903+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":77,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-02-10T08:20:51.533171+0000","last_change":"2024-02-10T08:20:26.027398+0000","last_active":"2024-02-10T08:20:51.533171+0000","last_peered":"2024-02-10T08:20:51.533171+0000","last_clean":"2024-02-10T08:20:51.533171+0000","last_became_active":"2024-02-10T08:16:58.869673+0000","last_became_peered":"2024-02-10T08:16:58.869673+0000","last_unstale":"2024-02-10T08:20:51.533171+0000","last_undegraded":"2024-02-10T08:20:51.533171+0000","last_fullsized":"2024-02-10T08:20:51.533171+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:26.027321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:05.662947+0000","last_clean_scrub_stamp":"2024-02-10T08:20:26.027321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"89'9","reported_seq":134,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-02-10T08:21:00.649864+0000","last_change":"2024-02-10T08:19:33.299741+0000","last_active":"2024-02-10T08:21:00.649864+0000","last_peered":"2024-02-10T08:21:00.649864+0000","last_clean":"2024-02-10T08:21:00.649864+0000","last_became_active":"2024-02-10T08:16:56.864587+0000","last_became_peered":"2024-02-10T08:16:56.864587+0000","last_unstale":"2024-02-10T08:21:00.649864+0000","last_undegraded":"2024-02-10T08:21:00.649864+0000","last_fullsized":"2024-02-10T08:21:00.649864+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'9","last_scrub_stamp":"2024-02-10T08:19:33.299671+0000","last_deep_scrub":"89'9","last_deep_scrub_stamp":"2024-02-10T08:19:33.299671+0000","last_clean_scrub_stamp":"2024-02-10T08:19:33.299671+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":79,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.407029+0000","last_change":"2024-02-10T08:20:04.285337+0000","last_active":"2024-02-10T08:20:55.407029+0000","last_peered":"2024-02-10T08:20:55.407029+0000","last_clean":"2024-02-10T08:20:55.407029+0000","last_became_active":"2024-02-10T08:16:52.789834+0000","last_became_peered":"2024-02-10T08:16:52.789834+0000","last_unstale":"2024-02-10T08:20:55.407029+0000","last_undegraded":"2024-02-10T08:20:55.407029+0000","last_fullsized":"2024-02-10T08:20:55.407029+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:04.285243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:20:04.285243+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"62'10","reported_seq":93,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.434039+0000","last_change":"2024-02-10T08:19:09.007459+0000","last_active":"2024-02-10T08:20:55.434039+0000","last_peered":"2024-02-10T08:20:55.434039+0000","last_clean":"2024-02-10T08:20:55.434039+0000","last_became_active":"2024-02-10T08:16:55.204789+0000","last_became_peered":"2024-02-10T08:16:55.204789+0000","last_unstale":"2024-02-10T08:20:55.434039+0000","last_undegraded":"2024-02-10T08:20:55.434039+0000","last_fullsized":"2024-02-10T08:20:55.434039+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'10","last_scrub_stamp":"2024-02-10T08:19:09.007376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:19:09.007376+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":83,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.432998+0000","last_change":"2024-02-10T08:20:46.399218+0000","last_active":"2024-02-10T08:20:55.432998+0000","last_peered":"2024-02-10T08:20:55.432998+0000","last_clean":"2024-02-10T08:20:55.432998+0000","last_became_active":"2024-02-10T08:20:46.398903+0000","last_became_peered":"2024-02-10T08:20:46.398903+0000","last_unstale":"2024-02-10T08:20:55.432998+0000","last_undegraded":"2024-02-10T08:20:55.432998+0000","last_fullsized":"2024-02-10T08:20:55.432998+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:22.944593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:22.944593+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":75,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.407576+0000","last_change":"2024-02-10T08:20:10.278739+0000","last_active":"2024-02-10T08:20:55.407576+0000","last_peered":"2024-02-10T08:20:55.407576+0000","last_clean":"2024-02-10T08:20:55.407576+0000","last_became_active":"2024-02-10T08:16:56.863948+0000","last_became_peered":"2024-02-10T08:16:56.863948+0000","last_unstale":"2024-02-10T08:20:55.407576+0000","last_undegraded":"2024-02-10T08:20:55.407576+0000","last_fullsized":"2024-02-10T08:20:55.407576+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:10.278678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:20:10.278678+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":89,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.430697+0000","last_change":"2024-02-10T08:20:46.401136+0000","last_active":"2024-02-10T08:20:55.430697+0000","last_peered":"2024-02-10T08:20:55.430697+0000","last_clean":"2024-02-10T08:20:55.430697+0000","last_became_active":"2024-02-10T08:20:46.400758+0000","last_became_peered":"2024-02-10T08:20:46.400758+0000","last_unstale":"2024-02-10T08:20:55.430697+0000","last_undegraded":"2024-02-10T08:20:55.430697+0000","last_fullsized":"2024-02-10T08:20:55.430697+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:08.233096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:08.233096+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"62'6","reported_seq":87,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.442528+0000","last_change":"2024-02-10T08:20:08.360978+0000","last_active":"2024-02-10T08:20:55.442528+0000","last_peered":"2024-02-10T08:20:55.442528+0000","last_clean":"2024-02-10T08:20:55.442528+0000","last_became_active":"2024-02-10T08:16:55.203401+0000","last_became_peered":"2024-02-10T08:16:55.203401+0000","last_unstale":"2024-02-10T08:20:55.442528+0000","last_undegraded":"2024-02-10T08:20:55.442528+0000","last_fullsized":"2024-02-10T08:20:55.442528+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'6","last_scrub_stamp":"2024-02-10T08:20:08.360881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:20:08.360881+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":84,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.436211+0000","last_change":"2024-02-10T08:20:46.407558+0000","last_active":"2024-02-10T08:20:55.436211+0000","last_peered":"2024-02-10T08:20:55.436211+0000","last_clean":"2024-02-10T08:20:55.436211+0000","last_became_active":"2024-02-10T08:20:46.407214+0000","last_became_peered":"2024-02-10T08:20:46.407214+0000","last_unstale":"2024-02-10T08:20:55.436211+0000","last_undegraded":"2024-02-10T08:20:55.436211+0000","last_fullsized":"2024-02-10T08:20:55.436211+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:10.716763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:10.716763+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":76,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.442676+0000","last_change":"2024-02-10T08:20:07.352836+0000","last_active":"2024-02-10T08:20:55.442676+0000","last_peered":"2024-02-10T08:20:55.442676+0000","last_clean":"2024-02-10T08:20:55.442676+0000","last_became_active":"2024-02-10T08:16:56.860904+0000","last_became_peered":"2024-02-10T08:16:56.860904+0000","last_unstale":"2024-02-10T08:20:55.442676+0000","last_undegraded":"2024-02-10T08:20:55.442676+0000","last_fullsized":"2024-02-10T08:20:55.442676+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:07.352745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:20:07.352745+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"55'1","reported_seq":86,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.435144+0000","last_change":"2024-02-10T08:19:59.845452+0000","last_active":"2024-02-10T08:20:55.435144+0000","last_peered":"2024-02-10T08:20:55.435144+0000","last_clean":"2024-02-10T08:20:55.435144+0000","last_became_active":"2024-02-10T08:16:52.782734+0000","last_became_peered":"2024-02-10T08:16:52.782734+0000","last_unstale":"2024-02-10T08:20:55.435144+0000","last_undegraded":"2024-02-10T08:20:55.435144+0000","last_fullsized":"2024-02-10T08:20:55.435144+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'1","last_scrub_stamp":"2024-02-10T08:19:59.845351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:19:59.845351+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"62'9","reported_seq":92,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-02-10T08:20:51.533909+0000","last_change":"2024-02-10T08:19:14.500843+0000","last_active":"2024-02-10T08:20:51.533909+0000","last_peered":"2024-02-10T08:20:51.533909+0000","last_clean":"2024-02-10T08:20:51.533909+0000","last_became_active":"2024-02-10T08:16:55.204727+0000","last_became_peered":"2024-02-10T08:16:55.204727+0000","last_unstale":"2024-02-10T08:20:51.533909+0000","last_undegraded":"2024-02-10T08:20:51.533909+0000","last_fullsized":"2024-02-10T08:20:51.533909+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'9","last_scrub_stamp":"2024-02-10T08:19:14.500766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:19:14.500766+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.a","version":"116'5530","reported_seq":5563,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-02-10T08:21:02.453406+0000","last_change":"2024-02-10T08:19:39.843283+0000","last_active":"2024-02-10T08:21:02.453406+0000","last_peered":"2024-02-10T08:21:02.453406+0000","last_clean":"2024-02-10T08:21:02.453406+0000","last_became_active":"2024-02-10T08:19:39.842909+0000","last_became_peered":"2024-02-10T08:19:39.842909+0000","last_unstale":"2024-02-10T08:21:02.453406+0000","last_undegraded":"2024-02-10T08:21:02.453406+0000","last_fullsized":"2024-02-10T08:21:02.453406+0000","mapping_epoch":91,"log_start":"95'800","ondisk_log_start":"95'800","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_clean_scrub_stamp":"2024-02-10T08:19:38.813165+0000","log_size":4730,"ondisk_log_size":4730,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":362414080,"num_objects":5530,"num_object_clones":0,"num_object_copies":16590,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5530,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5530,"num_write_kb":353920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":74,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.422805+0000","last_change":"2024-02-10T08:20:18.128576+0000","last_active":"2024-02-10T08:20:55.422805+0000","last_peered":"2024-02-10T08:20:55.422805+0000","last_clean":"2024-02-10T08:20:55.422805+0000","last_became_active":"2024-02-10T08:16:58.868848+0000","last_became_peered":"2024-02-10T08:16:58.868848+0000","last_unstale":"2024-02-10T08:20:55.422805+0000","last_undegraded":"2024-02-10T08:20:55.422805+0000","last_fullsized":"2024-02-10T08:20:55.422805+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:18.128487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:20:18.128487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"55'2","reported_seq":62,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-02-10T08:20:51.517858+0000","last_change":"2024-02-10T08:20:46.398750+0000","last_active":"2024-02-10T08:20:51.517858+0000","last_peered":"2024-02-10T08:20:51.517858+0000","last_clean":"2024-02-10T08:20:51.517858+0000","last_became_active":"2024-02-10T08:20:46.398441+0000","last_became_peered":"2024-02-10T08:20:46.398441+0000","last_unstale":"2024-02-10T08:20:51.517858+0000","last_undegraded":"2024-02-10T08:20:51.517858+0000","last_fullsized":"2024-02-10T08:20:51.517858+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'2","last_scrub_stamp":"2024-02-10T08:18:03.916322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:03.916322+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"82'17","reported_seq":83,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-02-10T08:20:51.521990+0000","last_change":"2024-02-10T08:20:46.404791+0000","last_active":"2024-02-10T08:20:51.521990+0000","last_peered":"2024-02-10T08:20:51.521990+0000","last_clean":"2024-02-10T08:20:51.521990+0000","last_became_active":"2024-02-10T08:20:46.404286+0000","last_became_peered":"2024-02-10T08:20:46.404286+0000","last_unstale":"2024-02-10T08:20:51.521990+0000","last_undegraded":"2024-02-10T08:20:51.521990+0000","last_fullsized":"2024-02-10T08:20:51.521990+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'17","last_scrub_stamp":"2024-02-10T08:18:21.015873+0000","last_deep_scrub":"82'17","last_deep_scrub_stamp":"2024-02-10T08:18:21.015873+0000","last_clean_scrub_stamp":"2024-02-10T08:18:21.015873+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":76,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.435056+0000","last_change":"2024-02-10T08:19:26.899727+0000","last_active":"2024-02-10T08:20:55.435056+0000","last_peered":"2024-02-10T08:20:55.435056+0000","last_clean":"2024-02-10T08:20:55.435056+0000","last_became_active":"2024-02-10T08:16:56.860850+0000","last_became_peered":"2024-02-10T08:16:56.860850+0000","last_unstale":"2024-02-10T08:20:55.435056+0000","last_undegraded":"2024-02-10T08:20:55.435056+0000","last_fullsized":"2024-02-10T08:20:55.435056+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:26.899655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:19:26.899655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1","version":"116'5608","reported_seq":5647,"reported_epoch":116,"state":"active+undersized+degraded+remapped+backfill_toofull","last_fresh":"2024-02-10T08:21:02.498504+0000","last_change":"2024-02-10T08:20:47.922297+0000","last_active":"2024-02-10T08:21:02.498504+0000","last_peered":"2024-02-10T08:21:02.498504+0000","last_clean":"2024-02-10T08:19:38.813165+0000","last_became_active":"2024-02-10T08:20:47.901963+0000","last_became_peered":"2024-02-10T08:20:47.901963+0000","last_unstale":"2024-02-10T08:21:02.498504+0000","last_undegraded":"2024-02-10T08:20:47.398636+0000","last_fullsized":"2024-02-10T08:20:47.384354+0000","mapping_epoch":111,"log_start":"95'900","ondisk_log_start":"95'900","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_clean_scrub_stamp":"2024-02-10T08:19:38.813165+0000","log_size":4708,"ondisk_log_size":4708,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":367525888,"num_objects":5608,"num_object_clones":0,"num_object_copies":16824,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":5608,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5608,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5608,"num_write_kb":358912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[3,6],"avail_no_missing":["3","6"],"object_location_counts":[{"shards":"3,6","objects":5608}],"blocked_by":[],"up_primary":4,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":77,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-02-10T08:20:51.530647+0000","last_change":"2024-02-10T08:20:18.941070+0000","last_active":"2024-02-10T08:20:51.530647+0000","last_peered":"2024-02-10T08:20:51.530647+0000","last_clean":"2024-02-10T08:20:51.530647+0000","last_became_active":"2024-02-10T08:16:58.864957+0000","last_became_peered":"2024-02-10T08:16:58.864957+0000","last_unstale":"2024-02-10T08:20:51.530647+0000","last_undegraded":"2024-02-10T08:20:51.530647+0000","last_fullsized":"2024-02-10T08:20:51.530647+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:18.940944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:20:18.940944+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":80,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.434685+0000","last_change":"2024-02-10T08:20:08.744631+0000","last_active":"2024-02-10T08:20:55.434685+0000","last_peered":"2024-02-10T08:20:55.434685+0000","last_clean":"2024-02-10T08:20:55.434685+0000","last_became_active":"2024-02-10T08:16:52.789354+0000","last_became_peered":"2024-02-10T08:16:52.789354+0000","last_unstale":"2024-02-10T08:20:55.434685+0000","last_undegraded":"2024-02-10T08:20:55.434685+0000","last_fullsized":"2024-02-10T08:20:55.434685+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:08.744567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:20:08.744567+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"62'10","reported_seq":103,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.435449+0000","last_change":"2024-02-10T08:20:46.408860+0000","last_active":"2024-02-10T08:20:55.435449+0000","last_peered":"2024-02-10T08:20:55.435449+0000","last_clean":"2024-02-10T08:20:55.435449+0000","last_became_active":"2024-02-10T08:20:46.408495+0000","last_became_peered":"2024-02-10T08:20:46.408495+0000","last_unstale":"2024-02-10T08:20:55.435449+0000","last_undegraded":"2024-02-10T08:20:55.435449+0000","last_fullsized":"2024-02-10T08:20:55.435449+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'10","last_scrub_stamp":"2024-02-10T08:18:26.189127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:26.189127+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"62'8","reported_seq":131,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.470176+0000","last_change":"2024-02-10T08:20:08.840019+0000","last_active":"2024-02-10T08:20:55.470176+0000","last_peered":"2024-02-10T08:20:55.470176+0000","last_clean":"2024-02-10T08:20:55.470176+0000","last_became_active":"2024-02-10T08:16:56.862677+0000","last_became_peered":"2024-02-10T08:16:56.862677+0000","last_unstale":"2024-02-10T08:20:55.470176+0000","last_undegraded":"2024-02-10T08:20:55.470176+0000","last_fullsized":"2024-02-10T08:20:55.470176+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'8","last_scrub_stamp":"2024-02-10T08:20:08.839890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:20:08.839890+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.7","version":"116'5635","reported_seq":5668,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-02-10T08:21:02.450112+0000","last_change":"2024-02-10T08:19:39.830249+0000","last_active":"2024-02-10T08:21:02.450112+0000","last_peered":"2024-02-10T08:21:02.450112+0000","last_clean":"2024-02-10T08:21:02.450112+0000","last_became_active":"2024-02-10T08:19:39.829937+0000","last_became_peered":"2024-02-10T08:19:39.829937+0000","last_unstale":"2024-02-10T08:21:02.450112+0000","last_undegraded":"2024-02-10T08:21:02.450112+0000","last_fullsized":"2024-02-10T08:21:02.450112+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_clean_scrub_stamp":"2024-02-10T08:19:38.813165+0000","log_size":5635,"ondisk_log_size":5635,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":369295360,"num_objects":5635,"num_object_clones":0,"num_object_copies":16905,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5635,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5635,"num_write_kb":360640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,3],"acting":[6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":84,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.429703+0000","last_change":"2024-02-10T08:20:46.396575+0000","last_active":"2024-02-10T08:20:55.429703+0000","last_peered":"2024-02-10T08:20:55.429703+0000","last_clean":"2024-02-10T08:20:55.429703+0000","last_became_active":"2024-02-10T08:20:46.396276+0000","last_became_peered":"2024-02-10T08:20:46.396276+0000","last_unstale":"2024-02-10T08:20:55.429703+0000","last_undegraded":"2024-02-10T08:20:55.429703+0000","last_fullsized":"2024-02-10T08:20:55.429703+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:47.116727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:47.116727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":79,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.407050+0000","last_change":"2024-02-10T08:20:07.299708+0000","last_active":"2024-02-10T08:20:55.407050+0000","last_peered":"2024-02-10T08:20:55.407050+0000","last_clean":"2024-02-10T08:20:55.407050+0000","last_became_active":"2024-02-10T08:16:52.791027+0000","last_became_peered":"2024-02-10T08:16:52.791027+0000","last_unstale":"2024-02-10T08:20:55.407050+0000","last_undegraded":"2024-02-10T08:20:55.407050+0000","last_fullsized":"2024-02-10T08:20:55.407050+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:07.299640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:20:07.299640+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"62'28","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-02-10T08:21:00.655170+0000","last_change":"2024-02-10T08:20:16.678248+0000","last_active":"2024-02-10T08:21:00.655170+0000","last_peered":"2024-02-10T08:21:00.655170+0000","last_clean":"2024-02-10T08:21:00.655170+0000","last_became_active":"2024-02-10T08:16:54.856000+0000","last_became_peered":"2024-02-10T08:16:54.856000+0000","last_unstale":"2024-02-10T08:21:00.655170+0000","last_undegraded":"2024-02-10T08:21:00.655170+0000","last_fullsized":"2024-02-10T08:21:00.655170+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'28","last_scrub_stamp":"2024-02-10T08:20:16.678147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:20:16.678147+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":48,"num_read_kb":33,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":84,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-02-10T08:20:51.532002+0000","last_change":"2024-02-10T08:20:46.406682+0000","last_active":"2024-02-10T08:20:51.532002+0000","last_peered":"2024-02-10T08:20:51.532002+0000","last_clean":"2024-02-10T08:20:51.532002+0000","last_became_active":"2024-02-10T08:20:46.406395+0000","last_became_peered":"2024-02-10T08:20:46.406395+0000","last_unstale":"2024-02-10T08:20:51.532002+0000","last_undegraded":"2024-02-10T08:20:51.532002+0000","last_fullsized":"2024-02-10T08:20:51.532002+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:51.533128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:51.533128+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"115'5413","reported_seq":5980,"reported_epoch":115,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-02-10T08:20:57.497786+0000","last_change":"2024-02-10T08:20:47.997666+0000","last_active":"2024-02-10T08:20:57.497786+0000","last_peered":"2024-02-10T08:20:57.497786+0000","last_clean":"2024-02-10T08:19:38.813165+0000","last_became_active":"2024-02-10T08:20:47.928046+0000","last_became_peered":"2024-02-10T08:20:47.928046+0000","last_unstale":"2024-02-10T08:20:57.497786+0000","last_undegraded":"2024-02-10T08:20:47.424280+0000","last_fullsized":"2024-02-10T08:20:47.387445+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_clean_scrub_stamp":"2024-02-10T08:19:38.813165+0000","log_size":5413,"ondisk_log_size":5413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":354746368,"num_objects":5413,"num_object_clones":0,"num_object_copies":16239,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":4752,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5413,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5413,"num_write_kb":346432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":265,"num_bytes_recovered":17367040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0,1","objects":661}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":73,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.433199+0000","last_change":"2024-02-10T08:20:08.316774+0000","last_active":"2024-02-10T08:20:55.433199+0000","last_peered":"2024-02-10T08:20:55.433199+0000","last_clean":"2024-02-10T08:20:55.433199+0000","last_became_active":"2024-02-10T08:16:58.891249+0000","last_became_peered":"2024-02-10T08:16:58.891249+0000","last_unstale":"2024-02-10T08:20:55.433199+0000","last_undegraded":"2024-02-10T08:20:55.433199+0000","last_fullsized":"2024-02-10T08:20:55.433199+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:08.316685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:11.750537+0000","last_clean_scrub_stamp":"2024-02-10T08:20:08.316685+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"63'5","reported_seq":325,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-02-10T08:21:01.243525+0000","last_change":"2024-02-10T08:19:12.466527+0000","last_active":"2024-02-10T08:21:01.243525+0000","last_peered":"2024-02-10T08:21:01.243525+0000","last_clean":"2024-02-10T08:21:01.243525+0000","last_became_active":"2024-02-10T08:16:52.780989+0000","last_became_peered":"2024-02-10T08:16:52.780989+0000","last_unstale":"2024-02-10T08:21:01.243525+0000","last_undegraded":"2024-02-10T08:21:01.243525+0000","last_fullsized":"2024-02-10T08:21:01.243525+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'5","last_scrub_stamp":"2024-02-10T08:19:12.466451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:19:12.466451+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":242,"num_read_kb":237,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":80,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.432635+0000","last_change":"2024-02-10T08:19:13.900328+0000","last_active":"2024-02-10T08:20:55.432635+0000","last_peered":"2024-02-10T08:20:55.432635+0000","last_clean":"2024-02-10T08:20:55.432635+0000","last_became_active":"2024-02-10T08:16:52.787737+0000","last_became_peered":"2024-02-10T08:16:52.787737+0000","last_unstale":"2024-02-10T08:20:55.432635+0000","last_undegraded":"2024-02-10T08:20:55.432635+0000","last_fullsized":"2024-02-10T08:20:55.432635+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:13.900264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:11.681169+0000","last_clean_scrub_stamp":"2024-02-10T08:19:13.900264+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"62'13","reported_seq":35,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.433106+0000","last_change":"2024-02-10T08:20:31.890688+0000","last_active":"2024-02-10T08:20:55.433106+0000","last_peered":"2024-02-10T08:20:55.433106+0000","last_clean":"2024-02-10T08:20:55.433106+0000","last_became_active":"2024-02-10T08:20:31.024371+0000","last_became_peered":"2024-02-10T08:20:31.024371+0000","last_unstale":"2024-02-10T08:20:55.433106+0000","last_undegraded":"2024-02-10T08:20:55.433106+0000","last_fullsized":"2024-02-10T08:20:55.433106+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'13","last_scrub_stamp":"2024-02-10T08:20:13.727564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:20:13.727564+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":18,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":76,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.438061+0000","last_change":"2024-02-10T08:20:00.886336+0000","last_active":"2024-02-10T08:20:55.438061+0000","last_peered":"2024-02-10T08:20:55.438061+0000","last_clean":"2024-02-10T08:20:55.438061+0000","last_became_active":"2024-02-10T08:16:56.857856+0000","last_became_peered":"2024-02-10T08:16:56.857856+0000","last_unstale":"2024-02-10T08:20:55.438061+0000","last_undegraded":"2024-02-10T08:20:55.438061+0000","last_fullsized":"2024-02-10T08:20:55.438061+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:00.886232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:20:00.886232+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"115'5308","reported_seq":5340,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:57.516074+0000","last_change":"2024-02-10T08:19:39.831855+0000","last_active":"2024-02-10T08:20:57.516074+0000","last_peered":"2024-02-10T08:20:57.516074+0000","last_clean":"2024-02-10T08:20:57.516074+0000","last_became_active":"2024-02-10T08:19:39.831585+0000","last_became_peered":"2024-02-10T08:19:39.831585+0000","last_unstale":"2024-02-10T08:20:57.516074+0000","last_undegraded":"2024-02-10T08:20:57.516074+0000","last_fullsized":"2024-02-10T08:20:57.516074+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_clean_scrub_stamp":"2024-02-10T08:19:38.813165+0000","log_size":5308,"ondisk_log_size":5308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":347865088,"num_objects":5308,"num_object_clones":0,"num_object_copies":15924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5308,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5308,"num_write_kb":339712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":83,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.407490+0000","last_change":"2024-02-10T08:20:46.394535+0000","last_active":"2024-02-10T08:20:55.407490+0000","last_peered":"2024-02-10T08:20:55.407490+0000","last_clean":"2024-02-10T08:20:55.407490+0000","last_became_active":"2024-02-10T08:20:46.394169+0000","last_became_peered":"2024-02-10T08:20:46.394169+0000","last_unstale":"2024-02-10T08:20:55.407490+0000","last_undegraded":"2024-02-10T08:20:55.407490+0000","last_fullsized":"2024-02-10T08:20:55.407490+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:45.379932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:45.379932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":80,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.421484+0000","last_change":"2024-02-10T08:19:31.148600+0000","last_active":"2024-02-10T08:20:55.421484+0000","last_peered":"2024-02-10T08:20:55.421484+0000","last_clean":"2024-02-10T08:20:55.421484+0000","last_became_active":"2024-02-10T08:16:52.788195+0000","last_became_peered":"2024-02-10T08:16:52.788195+0000","last_unstale":"2024-02-10T08:20:55.421484+0000","last_undegraded":"2024-02-10T08:20:55.421484+0000","last_fullsized":"2024-02-10T08:20:55.421484+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:31.148535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:19:31.148535+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":79,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.407961+0000","last_change":"2024-02-10T08:19:34.283969+0000","last_active":"2024-02-10T08:20:55.407961+0000","last_peered":"2024-02-10T08:20:55.407961+0000","last_clean":"2024-02-10T08:20:55.407961+0000","last_became_active":"2024-02-10T08:16:52.788767+0000","last_became_peered":"2024-02-10T08:16:52.788767+0000","last_unstale":"2024-02-10T08:20:55.407961+0000","last_undegraded":"2024-02-10T08:20:55.407961+0000","last_fullsized":"2024-02-10T08:20:55.407961+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:34.283900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:19:34.283900+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":90,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.432207+0000","last_change":"2024-02-10T08:20:06.252519+0000","last_active":"2024-02-10T08:20:55.432207+0000","last_peered":"2024-02-10T08:20:55.432207+0000","last_clean":"2024-02-10T08:20:55.432207+0000","last_became_active":"2024-02-10T08:16:46.402267+0000","last_became_peered":"2024-02-10T08:16:46.402267+0000","last_unstale":"2024-02-10T08:20:55.432207+0000","last_undegraded":"2024-02-10T08:20:55.432207+0000","last_fullsized":"2024-02-10T08:20:55.432207+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:06.252449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:14:44.584370+0000","last_clean_scrub_stamp":"2024-02-10T08:20:06.252449+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"62'14","reported_seq":109,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.430975+0000","last_change":"2024-02-10T08:20:46.402358+0000","last_active":"2024-02-10T08:20:55.430975+0000","last_peered":"2024-02-10T08:20:55.430975+0000","last_clean":"2024-02-10T08:20:55.430975+0000","last_became_active":"2024-02-10T08:20:46.401981+0000","last_became_peered":"2024-02-10T08:20:46.401981+0000","last_unstale":"2024-02-10T08:20:55.430975+0000","last_undegraded":"2024-02-10T08:20:55.430975+0000","last_fullsized":"2024-02-10T08:20:55.430975+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'14","last_scrub_stamp":"2024-02-10T08:18:33.416365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:33.416365+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":15,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":75,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.432800+0000","last_change":"2024-02-10T08:19:34.226328+0000","last_active":"2024-02-10T08:20:55.432800+0000","last_peered":"2024-02-10T08:20:55.432800+0000","last_clean":"2024-02-10T08:20:55.432800+0000","last_became_active":"2024-02-10T08:16:56.867159+0000","last_became_peered":"2024-02-10T08:16:56.867159+0000","last_unstale":"2024-02-10T08:20:55.432800+0000","last_undegraded":"2024-02-10T08:20:55.432800+0000","last_fullsized":"2024-02-10T08:20:55.432800+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:34.226262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:04.766780+0000","last_clean_scrub_stamp":"2024-02-10T08:19:34.226262+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"116'5594","reported_seq":5627,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-02-10T08:21:02.466634+0000","last_change":"2024-02-10T08:19:39.841394+0000","last_active":"2024-02-10T08:21:02.466634+0000","last_peered":"2024-02-10T08:21:02.466634+0000","last_clean":"2024-02-10T08:21:02.466634+0000","last_became_active":"2024-02-10T08:19:39.841073+0000","last_became_peered":"2024-02-10T08:19:39.841073+0000","last_unstale":"2024-02-10T08:21:02.466634+0000","last_undegraded":"2024-02-10T08:21:02.466634+0000","last_fullsized":"2024-02-10T08:21:02.466634+0000","mapping_epoch":91,"log_start":"95'700","ondisk_log_start":"95'700","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_clean_scrub_stamp":"2024-02-10T08:19:38.813165+0000","log_size":4894,"ondisk_log_size":4894,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":366608384,"num_objects":5594,"num_object_clones":0,"num_object_copies":16782,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5594,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5594,"num_write_kb":358016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,0],"acting":[7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":74,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.434960+0000","last_change":"2024-02-10T08:20:09.785179+0000","last_active":"2024-02-10T08:20:55.434960+0000","last_peered":"2024-02-10T08:20:55.434960+0000","last_clean":"2024-02-10T08:20:55.434960+0000","last_became_active":"2024-02-10T08:16:58.867593+0000","last_became_peered":"2024-02-10T08:16:58.867593+0000","last_unstale":"2024-02-10T08:20:55.434960+0000","last_undegraded":"2024-02-10T08:20:55.434960+0000","last_fullsized":"2024-02-10T08:20:55.434960+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:09.785096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:20:09.785096+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":90,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-02-10T08:20:51.543291+0000","last_change":"2024-02-10T08:20:46.398840+0000","last_active":"2024-02-10T08:20:51.543291+0000","last_peered":"2024-02-10T08:20:51.543291+0000","last_clean":"2024-02-10T08:20:51.543291+0000","last_became_active":"2024-02-10T08:20:46.398542+0000","last_became_peered":"2024-02-10T08:20:46.398542+0000","last_unstale":"2024-02-10T08:20:51.543291+0000","last_undegraded":"2024-02-10T08:20:51.543291+0000","last_fullsized":"2024-02-10T08:20:51.543291+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:20.736224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:20.736224+0000","last_clean_scrub_stamp":"2024-02-10T08:18:20.736224+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":79,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.432106+0000","last_change":"2024-02-10T08:20:12.387549+0000","last_active":"2024-02-10T08:20:55.432106+0000","last_peered":"2024-02-10T08:20:55.432106+0000","last_clean":"2024-02-10T08:20:55.432106+0000","last_became_active":"2024-02-10T08:16:52.787180+0000","last_became_peered":"2024-02-10T08:16:52.787180+0000","last_unstale":"2024-02-10T08:20:55.432106+0000","last_undegraded":"2024-02-10T08:20:55.432106+0000","last_fullsized":"2024-02-10T08:20:55.432106+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:12.387482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:20:12.387482+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"62'12","reported_seq":94,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-02-10T08:20:51.533731+0000","last_change":"2024-02-10T08:20:04.883379+0000","last_active":"2024-02-10T08:20:51.533731+0000","last_peered":"2024-02-10T08:20:51.533731+0000","last_clean":"2024-02-10T08:20:51.533731+0000","last_became_active":"2024-02-10T08:16:54.853330+0000","last_became_peered":"2024-02-10T08:16:54.853330+0000","last_unstale":"2024-02-10T08:20:51.533731+0000","last_undegraded":"2024-02-10T08:20:51.533731+0000","last_fullsized":"2024-02-10T08:20:51.533731+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'12","last_scrub_stamp":"2024-02-10T08:20:04.883293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:20:04.883293+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":75,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.407441+0000","last_change":"2024-02-10T08:20:08.318643+0000","last_active":"2024-02-10T08:20:55.407441+0000","last_peered":"2024-02-10T08:20:55.407441+0000","last_clean":"2024-02-10T08:20:55.407441+0000","last_became_active":"2024-02-10T08:16:56.864030+0000","last_became_peered":"2024-02-10T08:16:56.864030+0000","last_unstale":"2024-02-10T08:20:55.407441+0000","last_undegraded":"2024-02-10T08:20:55.407441+0000","last_fullsized":"2024-02-10T08:20:55.407441+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:08.318570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:41.360241+0000","last_clean_scrub_stamp":"2024-02-10T08:20:08.318570+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.0","version":"116'5551","reported_seq":5584,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-02-10T08:21:02.439331+0000","last_change":"2024-02-10T08:19:39.828087+0000","last_active":"2024-02-10T08:21:02.439331+0000","last_peered":"2024-02-10T08:21:02.439331+0000","last_clean":"2024-02-10T08:21:02.439331+0000","last_became_active":"2024-02-10T08:19:39.827835+0000","last_became_peered":"2024-02-10T08:19:39.827835+0000","last_unstale":"2024-02-10T08:21:02.439331+0000","last_undegraded":"2024-02-10T08:21:02.439331+0000","last_fullsized":"2024-02-10T08:21:02.439331+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_clean_scrub_stamp":"2024-02-10T08:19:38.813165+0000","log_size":5551,"ondisk_log_size":5551,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":363790336,"num_objects":5551,"num_object_clones":0,"num_object_copies":16653,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5551,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5551,"num_write_kb":355264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":74,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.435754+0000","last_change":"2024-02-10T08:19:25.568522+0000","last_active":"2024-02-10T08:20:55.435754+0000","last_peered":"2024-02-10T08:20:55.435754+0000","last_clean":"2024-02-10T08:20:55.435754+0000","last_became_active":"2024-02-10T08:16:58.891287+0000","last_became_peered":"2024-02-10T08:16:58.891287+0000","last_unstale":"2024-02-10T08:20:55.435754+0000","last_undegraded":"2024-02-10T08:20:55.435754+0000","last_fullsized":"2024-02-10T08:20:55.435754+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:25.568342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:19:25.568342+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":59,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.436667+0000","last_change":"2024-02-10T08:20:46.401459+0000","last_active":"2024-02-10T08:20:55.436667+0000","last_peered":"2024-02-10T08:20:55.436667+0000","last_clean":"2024-02-10T08:20:55.436667+0000","last_became_active":"2024-02-10T08:20:46.401149+0000","last_became_peered":"2024-02-10T08:20:46.401149+0000","last_unstale":"2024-02-10T08:20:55.436667+0000","last_undegraded":"2024-02-10T08:20:55.436667+0000","last_fullsized":"2024-02-10T08:20:55.436667+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:16.912336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:16.912336+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4],"acting":[2,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"62'19","reported_seq":112,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-02-10T08:20:51.531321+0000","last_change":"2024-02-10T08:20:01.822882+0000","last_active":"2024-02-10T08:20:51.531321+0000","last_peered":"2024-02-10T08:20:51.531321+0000","last_clean":"2024-02-10T08:20:51.531321+0000","last_became_active":"2024-02-10T08:16:55.203453+0000","last_became_peered":"2024-02-10T08:16:55.203453+0000","last_unstale":"2024-02-10T08:20:51.531321+0000","last_undegraded":"2024-02-10T08:20:51.531321+0000","last_fullsized":"2024-02-10T08:20:51.531321+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'19","last_scrub_stamp":"2024-02-10T08:20:01.822753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:20:01.822753+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":75,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.431763+0000","last_change":"2024-02-10T08:20:07.350344+0000","last_active":"2024-02-10T08:20:55.431763+0000","last_peered":"2024-02-10T08:20:55.431763+0000","last_clean":"2024-02-10T08:20:55.431763+0000","last_became_active":"2024-02-10T08:16:56.861172+0000","last_became_peered":"2024-02-10T08:16:56.861172+0000","last_unstale":"2024-02-10T08:20:55.431763+0000","last_undegraded":"2024-02-10T08:20:55.431763+0000","last_fullsized":"2024-02-10T08:20:55.431763+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:07.350256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:20:07.350256+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.3","version":"116'5548","reported_seq":5592,"reported_epoch":116,"state":"active+undersized+degraded+remapped+backfill_wait","last_fresh":"2024-02-10T08:21:02.498629+0000","last_change":"2024-02-10T08:20:47.982094+0000","last_active":"2024-02-10T08:21:02.498629+0000","last_peered":"2024-02-10T08:21:02.498629+0000","last_clean":"2024-02-10T08:19:38.813165+0000","last_became_active":"2024-02-10T08:20:47.844011+0000","last_became_peered":"2024-02-10T08:20:47.844011+0000","last_unstale":"2024-02-10T08:21:02.498629+0000","last_undegraded":"2024-02-10T08:20:47.406887+0000","last_fullsized":"2024-02-10T08:20:47.392565+0000","mapping_epoch":111,"log_start":"95'800","ondisk_log_start":"95'800","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_clean_scrub_stamp":"2024-02-10T08:19:38.813165+0000","log_size":4748,"ondisk_log_size":4748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":363593728,"num_objects":5548,"num_object_clones":0,"num_object_copies":16644,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":5548,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5548,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5548,"num_write_kb":355072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[{"shards":"2,3","objects":5548}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":60,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-02-10T08:20:51.517277+0000","last_change":"2024-02-10T08:20:46.398051+0000","last_active":"2024-02-10T08:20:51.517277+0000","last_peered":"2024-02-10T08:20:51.517277+0000","last_clean":"2024-02-10T08:20:51.517277+0000","last_became_active":"2024-02-10T08:20:46.397393+0000","last_became_peered":"2024-02-10T08:20:46.397393+0000","last_unstale":"2024-02-10T08:20:51.517277+0000","last_undegraded":"2024-02-10T08:20:51.517277+0000","last_fullsized":"2024-02-10T08:20:51.517277+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:22.216312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:19:22.216312+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":90,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.435082+0000","last_change":"2024-02-10T08:20:46.408082+0000","last_active":"2024-02-10T08:20:55.435082+0000","last_peered":"2024-02-10T08:20:55.435082+0000","last_clean":"2024-02-10T08:20:55.435082+0000","last_became_active":"2024-02-10T08:20:46.407667+0000","last_became_peered":"2024-02-10T08:20:46.407667+0000","last_unstale":"2024-02-10T08:20:55.435082+0000","last_undegraded":"2024-02-10T08:20:55.435082+0000","last_fullsized":"2024-02-10T08:20:55.435082+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:12.069322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:12.069322+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"62'18","reported_seq":105,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.438968+0000","last_change":"2024-02-10T08:18:41.077152+0000","last_active":"2024-02-10T08:20:55.438968+0000","last_peered":"2024-02-10T08:20:55.438968+0000","last_clean":"2024-02-10T08:20:55.438968+0000","last_became_active":"2024-02-10T08:16:55.204981+0000","last_became_peered":"2024-02-10T08:16:55.204981+0000","last_unstale":"2024-02-10T08:20:55.438968+0000","last_undegraded":"2024-02-10T08:20:55.438968+0000","last_fullsized":"2024-02-10T08:20:55.438968+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'18","last_scrub_stamp":"2024-02-10T08:18:41.077080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:41.077080+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":51,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-02-10T08:20:51.522128+0000","last_change":"2024-02-10T08:20:46.395373+0000","last_active":"2024-02-10T08:20:51.522128+0000","last_peered":"2024-02-10T08:20:51.522128+0000","last_clean":"2024-02-10T08:20:51.522128+0000","last_became_active":"2024-02-10T08:20:46.395070+0000","last_became_peered":"2024-02-10T08:20:46.395070+0000","last_unstale":"2024-02-10T08:20:51.522128+0000","last_undegraded":"2024-02-10T08:20:51.522128+0000","last_fullsized":"2024-02-10T08:20:51.522128+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:15.979973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:15.979973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"116'5656","reported_seq":5689,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-02-10T08:21:02.453362+0000","last_change":"2024-02-10T08:19:39.844259+0000","last_active":"2024-02-10T08:21:02.453362+0000","last_peered":"2024-02-10T08:21:02.453362+0000","last_clean":"2024-02-10T08:21:02.453362+0000","last_became_active":"2024-02-10T08:19:39.843993+0000","last_became_peered":"2024-02-10T08:19:39.843993+0000","last_unstale":"2024-02-10T08:21:02.453362+0000","last_undegraded":"2024-02-10T08:21:02.453362+0000","last_fullsized":"2024-02-10T08:21:02.453362+0000","mapping_epoch":91,"log_start":"95'900","ondisk_log_start":"95'900","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_clean_scrub_stamp":"2024-02-10T08:19:38.813165+0000","log_size":4756,"ondisk_log_size":4756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":370671616,"num_objects":5656,"num_object_clones":0,"num_object_copies":16968,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5656,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5656,"num_write_kb":361984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":73,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.432581+0000","last_change":"2024-02-10T08:20:22.273046+0000","last_active":"2024-02-10T08:20:55.432581+0000","last_peered":"2024-02-10T08:20:55.432581+0000","last_clean":"2024-02-10T08:20:55.432581+0000","last_became_active":"2024-02-10T08:16:58.893253+0000","last_became_peered":"2024-02-10T08:16:58.893253+0000","last_unstale":"2024-02-10T08:20:55.432581+0000","last_undegraded":"2024-02-10T08:20:55.432581+0000","last_fullsized":"2024-02-10T08:20:55.432581+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:22.272986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:20:22.272986+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":79,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.431100+0000","last_change":"2024-02-10T08:20:03.392639+0000","last_active":"2024-02-10T08:20:55.431100+0000","last_peered":"2024-02-10T08:20:55.431100+0000","last_clean":"2024-02-10T08:20:55.431100+0000","last_became_active":"2024-02-10T08:16:52.789020+0000","last_became_peered":"2024-02-10T08:16:52.789020+0000","last_unstale":"2024-02-10T08:20:55.431100+0000","last_undegraded":"2024-02-10T08:20:55.431100+0000","last_fullsized":"2024-02-10T08:20:55.431100+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:03.392561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:20:03.392561+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"62'14","reported_seq":70,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-02-10T08:20:51.522053+0000","last_change":"2024-02-10T08:20:46.401263+0000","last_active":"2024-02-10T08:20:51.522053+0000","last_peered":"2024-02-10T08:20:51.522053+0000","last_clean":"2024-02-10T08:20:51.522053+0000","last_became_active":"2024-02-10T08:20:46.400760+0000","last_became_peered":"2024-02-10T08:20:46.400760+0000","last_unstale":"2024-02-10T08:20:51.522053+0000","last_undegraded":"2024-02-10T08:20:51.522053+0000","last_fullsized":"2024-02-10T08:20:51.522053+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'14","last_scrub_stamp":"2024-02-10T08:18:10.980421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:10.980421+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"111'10","reported_seq":146,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-02-10T08:21:00.653248+0000","last_change":"2024-02-10T08:20:46.392755+0000","last_active":"2024-02-10T08:21:00.653248+0000","last_peered":"2024-02-10T08:21:00.653248+0000","last_clean":"2024-02-10T08:21:00.653248+0000","last_became_active":"2024-02-10T08:20:46.391243+0000","last_became_peered":"2024-02-10T08:20:46.391243+0000","last_unstale":"2024-02-10T08:21:00.653248+0000","last_undegraded":"2024-02-10T08:21:00.653248+0000","last_fullsized":"2024-02-10T08:21:00.653248+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'8","last_scrub_stamp":"2024-02-10T08:18:30.090065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:30.090065+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"116'5541","reported_seq":5574,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-02-10T08:21:02.421867+0000","last_change":"2024-02-10T08:19:39.826713+0000","last_active":"2024-02-10T08:21:02.421867+0000","last_peered":"2024-02-10T08:21:02.421867+0000","last_clean":"2024-02-10T08:21:02.421867+0000","last_became_active":"2024-02-10T08:19:39.826451+0000","last_became_peered":"2024-02-10T08:19:39.826451+0000","last_unstale":"2024-02-10T08:21:02.421867+0000","last_undegraded":"2024-02-10T08:21:02.421867+0000","last_fullsized":"2024-02-10T08:21:02.421867+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_clean_scrub_stamp":"2024-02-10T08:19:38.813165+0000","log_size":5541,"ondisk_log_size":5541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":363134976,"num_objects":5541,"num_object_clones":0,"num_object_copies":16623,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5541,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5541,"num_write_kb":354624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,0],"acting":[6,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":74,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.433946+0000","last_change":"2024-02-10T08:20:30.227463+0000","last_active":"2024-02-10T08:20:55.433946+0000","last_peered":"2024-02-10T08:20:55.433946+0000","last_clean":"2024-02-10T08:20:55.433946+0000","last_became_active":"2024-02-10T08:16:58.891261+0000","last_became_peered":"2024-02-10T08:16:58.891261+0000","last_unstale":"2024-02-10T08:20:55.433946+0000","last_undegraded":"2024-02-10T08:20:55.433946+0000","last_fullsized":"2024-02-10T08:20:55.433946+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:30.227375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:20:30.227375+0000","last_clean_scrub_stamp":"2024-02-10T08:20:30.227375+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":89,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-02-10T08:21:02.333918+0000","last_change":"2024-02-10T08:21:02.334554+0000","last_active":"2024-02-10T08:21:02.333918+0000","last_peered":"2024-02-10T08:21:02.333918+0000","last_clean":"2024-02-10T08:21:02.333918+0000","last_became_active":"2024-02-10T08:20:46.400500+0000","last_became_peered":"2024-02-10T08:20:46.400500+0000","last_unstale":"2024-02-10T08:21:02.333918+0000","last_undegraded":"2024-02-10T08:21:02.333918+0000","last_fullsized":"2024-02-10T08:21:02.333918+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:25.442097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:25.442097+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":79,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.432210+0000","last_change":"2024-02-10T08:20:01.263757+0000","last_active":"2024-02-10T08:20:55.432210+0000","last_peered":"2024-02-10T08:20:55.432210+0000","last_clean":"2024-02-10T08:20:55.432210+0000","last_became_active":"2024-02-10T08:16:52.786822+0000","last_became_peered":"2024-02-10T08:16:52.786822+0000","last_unstale":"2024-02-10T08:20:55.432210+0000","last_undegraded":"2024-02-10T08:20:55.432210+0000","last_fullsized":"2024-02-10T08:20:55.432210+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:01.263661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:20:01.263661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"76'16","reported_seq":88,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-02-10T08:20:51.517572+0000","last_change":"2024-02-10T08:20:46.406601+0000","last_active":"2024-02-10T08:20:51.517572+0000","last_peered":"2024-02-10T08:20:51.517572+0000","last_clean":"2024-02-10T08:20:51.517572+0000","last_became_active":"2024-02-10T08:20:46.406023+0000","last_became_peered":"2024-02-10T08:20:46.406023+0000","last_unstale":"2024-02-10T08:20:51.517572+0000","last_undegraded":"2024-02-10T08:20:51.517572+0000","last_fullsized":"2024-02-10T08:20:51.517572+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'16","last_scrub_stamp":"2024-02-10T08:19:24.195140+0000","last_deep_scrub":"76'16","last_deep_scrub_stamp":"2024-02-10T08:18:07.909782+0000","last_clean_scrub_stamp":"2024-02-10T08:19:24.195140+0000","log_size":16,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"116'5702","reported_seq":5735,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-02-10T08:21:02.439163+0000","last_change":"2024-02-10T08:19:39.830160+0000","last_active":"2024-02-10T08:21:02.439163+0000","last_peered":"2024-02-10T08:21:02.439163+0000","last_clean":"2024-02-10T08:21:02.439163+0000","last_became_active":"2024-02-10T08:19:39.829875+0000","last_became_peered":"2024-02-10T08:19:39.829875+0000","last_unstale":"2024-02-10T08:21:02.439163+0000","last_undegraded":"2024-02-10T08:21:02.439163+0000","last_fullsized":"2024-02-10T08:21:02.439163+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_clean_scrub_stamp":"2024-02-10T08:19:38.813165+0000","log_size":5702,"ondisk_log_size":5702,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":373686272,"num_objects":5702,"num_object_clones":0,"num_object_copies":17106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5702,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5702,"num_write_kb":364928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":73,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.407368+0000","last_change":"2024-02-10T08:20:03.250648+0000","last_active":"2024-02-10T08:20:55.407368+0000","last_peered":"2024-02-10T08:20:55.407368+0000","last_clean":"2024-02-10T08:20:55.407368+0000","last_became_active":"2024-02-10T08:16:58.859956+0000","last_became_peered":"2024-02-10T08:16:58.859956+0000","last_unstale":"2024-02-10T08:20:55.407368+0000","last_undegraded":"2024-02-10T08:20:55.407368+0000","last_fullsized":"2024-02-10T08:20:55.407368+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:03.250587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:20:03.250587+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"111'10","reported_seq":83,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.435344+0000","last_change":"2024-02-10T08:20:46.402756+0000","last_active":"2024-02-10T08:20:55.435344+0000","last_peered":"2024-02-10T08:20:55.435344+0000","last_clean":"2024-02-10T08:20:55.435344+0000","last_became_active":"2024-02-10T08:20:46.401894+0000","last_became_peered":"2024-02-10T08:20:46.401894+0000","last_unstale":"2024-02-10T08:20:55.435344+0000","last_undegraded":"2024-02-10T08:20:55.435344+0000","last_fullsized":"2024-02-10T08:20:55.435344+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'8","last_scrub_stamp":"2024-02-10T08:18:28.991446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:28.991446+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":80,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.435587+0000","last_change":"2024-02-10T08:20:04.745454+0000","last_active":"2024-02-10T08:20:55.435587+0000","last_peered":"2024-02-10T08:20:55.435587+0000","last_clean":"2024-02-10T08:20:55.435587+0000","last_became_active":"2024-02-10T08:16:52.783634+0000","last_became_peered":"2024-02-10T08:16:52.783634+0000","last_unstale":"2024-02-10T08:20:55.435587+0000","last_undegraded":"2024-02-10T08:20:55.435587+0000","last_fullsized":"2024-02-10T08:20:55.435587+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:04.745360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:20:04.745360+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"62'15","reported_seq":80,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.433280+0000","last_change":"2024-02-10T08:20:46.402507+0000","last_active":"2024-02-10T08:20:55.433280+0000","last_peered":"2024-02-10T08:20:55.433280+0000","last_clean":"2024-02-10T08:20:55.433280+0000","last_became_active":"2024-02-10T08:20:46.401777+0000","last_became_peered":"2024-02-10T08:20:46.401777+0000","last_unstale":"2024-02-10T08:20:55.433280+0000","last_undegraded":"2024-02-10T08:20:55.433280+0000","last_fullsized":"2024-02-10T08:20:55.433280+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'15","last_scrub_stamp":"2024-02-10T08:18:19.720164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:19.720164+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"115'5387","reported_seq":5419,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:57.332536+0000","last_change":"2024-02-10T08:19:39.833126+0000","last_active":"2024-02-10T08:20:57.332536+0000","last_peered":"2024-02-10T08:20:57.332536+0000","last_clean":"2024-02-10T08:20:57.332536+0000","last_became_active":"2024-02-10T08:19:39.832691+0000","last_became_peered":"2024-02-10T08:19:39.832691+0000","last_unstale":"2024-02-10T08:20:57.332536+0000","last_undegraded":"2024-02-10T08:20:57.332536+0000","last_fullsized":"2024-02-10T08:20:57.332536+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_clean_scrub_stamp":"2024-02-10T08:19:38.813165+0000","log_size":5387,"ondisk_log_size":5387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":353042432,"num_objects":5387,"num_object_clones":0,"num_object_copies":16161,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5387,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5387,"num_write_kb":344768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":43,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-02-10T08:20:51.517662+0000","last_change":"2024-02-10T08:20:46.406374+0000","last_active":"2024-02-10T08:20:51.517662+0000","last_peered":"2024-02-10T08:20:51.517662+0000","last_clean":"2024-02-10T08:20:51.517662+0000","last_became_active":"2024-02-10T08:20:46.405578+0000","last_became_peered":"2024-02-10T08:20:46.405578+0000","last_unstale":"2024-02-10T08:20:51.517662+0000","last_undegraded":"2024-02-10T08:20:51.517662+0000","last_fullsized":"2024-02-10T08:20:51.517662+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:17:59.857977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:17:59.857977+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"62'8","reported_seq":134,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-02-10T08:21:00.648972+0000","last_change":"2024-02-10T08:19:24.859730+0000","last_active":"2024-02-10T08:21:00.648972+0000","last_peered":"2024-02-10T08:21:00.648972+0000","last_clean":"2024-02-10T08:21:00.648972+0000","last_became_active":"2024-02-10T08:16:56.858101+0000","last_became_peered":"2024-02-10T08:16:56.858101+0000","last_unstale":"2024-02-10T08:21:00.648972+0000","last_undegraded":"2024-02-10T08:21:00.648972+0000","last_fullsized":"2024-02-10T08:21:00.648972+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'8","last_scrub_stamp":"2024-02-10T08:19:24.859657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:19:24.859657+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":80,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.435246+0000","last_change":"2024-02-10T08:19:31.561674+0000","last_active":"2024-02-10T08:20:55.435246+0000","last_peered":"2024-02-10T08:20:55.435246+0000","last_clean":"2024-02-10T08:20:55.435246+0000","last_became_active":"2024-02-10T08:16:52.785545+0000","last_became_peered":"2024-02-10T08:16:52.785545+0000","last_unstale":"2024-02-10T08:20:55.435246+0000","last_undegraded":"2024-02-10T08:20:55.435246+0000","last_fullsized":"2024-02-10T08:20:55.435246+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:31.561534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:19:31.561534+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"62'10","reported_seq":78,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-02-10T08:20:51.517539+0000","last_change":"2024-02-10T08:20:46.399522+0000","last_active":"2024-02-10T08:20:51.517539+0000","last_peered":"2024-02-10T08:20:51.517539+0000","last_clean":"2024-02-10T08:20:51.517539+0000","last_became_active":"2024-02-10T08:20:46.398973+0000","last_became_peered":"2024-02-10T08:20:46.398973+0000","last_unstale":"2024-02-10T08:20:51.517539+0000","last_undegraded":"2024-02-10T08:20:51.517539+0000","last_fullsized":"2024-02-10T08:20:51.517539+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'10","last_scrub_stamp":"2024-02-10T08:19:16.196834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:19:16.196834+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"116'5594","reported_seq":5627,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-02-10T08:21:02.456915+0000","last_change":"2024-02-10T08:19:39.847131+0000","last_active":"2024-02-10T08:21:02.456915+0000","last_peered":"2024-02-10T08:21:02.456915+0000","last_clean":"2024-02-10T08:21:02.456915+0000","last_became_active":"2024-02-10T08:19:39.846850+0000","last_became_peered":"2024-02-10T08:19:39.846850+0000","last_unstale":"2024-02-10T08:21:02.456915+0000","last_undegraded":"2024-02-10T08:21:02.456915+0000","last_fullsized":"2024-02-10T08:21:02.456915+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_clean_scrub_stamp":"2024-02-10T08:19:38.813165+0000","log_size":5594,"ondisk_log_size":5594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":366608384,"num_objects":5594,"num_object_clones":0,"num_object_copies":16782,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5594,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5594,"num_write_kb":358016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":84,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.433417+0000","last_change":"2024-02-10T08:20:46.402693+0000","last_active":"2024-02-10T08:20:55.433417+0000","last_peered":"2024-02-10T08:20:55.433417+0000","last_clean":"2024-02-10T08:20:55.433417+0000","last_became_active":"2024-02-10T08:20:46.402181+0000","last_became_peered":"2024-02-10T08:20:46.402181+0000","last_unstale":"2024-02-10T08:20:55.433417+0000","last_undegraded":"2024-02-10T08:20:55.433417+0000","last_fullsized":"2024-02-10T08:20:55.433417+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:17.709697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:17.709697+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":86,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.434878+0000","last_change":"2024-02-10T08:20:46.407303+0000","last_active":"2024-02-10T08:20:55.434878+0000","last_peered":"2024-02-10T08:20:55.434878+0000","last_clean":"2024-02-10T08:20:55.434878+0000","last_became_active":"2024-02-10T08:20:46.406971+0000","last_became_peered":"2024-02-10T08:20:46.406971+0000","last_unstale":"2024-02-10T08:20:55.434878+0000","last_undegraded":"2024-02-10T08:20:55.434878+0000","last_fullsized":"2024-02-10T08:20:55.434878+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:37.273476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:37.273476+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":94,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.432344+0000","last_change":"2024-02-10T08:20:46.399889+0000","last_active":"2024-02-10T08:20:55.432344+0000","last_peered":"2024-02-10T08:20:55.432344+0000","last_clean":"2024-02-10T08:20:55.432344+0000","last_became_active":"2024-02-10T08:20:46.399568+0000","last_became_peered":"2024-02-10T08:20:46.399568+0000","last_unstale":"2024-02-10T08:20:55.432344+0000","last_undegraded":"2024-02-10T08:20:55.432344+0000","last_fullsized":"2024-02-10T08:20:55.432344+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:22.228064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:19:22.228064+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"62'17","reported_seq":119,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-02-10T08:20:51.517601+0000","last_change":"2024-02-10T08:20:46.396386+0000","last_active":"2024-02-10T08:20:51.517601+0000","last_peered":"2024-02-10T08:20:51.517601+0000","last_clean":"2024-02-10T08:20:51.517601+0000","last_became_active":"2024-02-10T08:20:46.395694+0000","last_became_peered":"2024-02-10T08:20:46.395694+0000","last_unstale":"2024-02-10T08:20:51.517601+0000","last_undegraded":"2024-02-10T08:20:51.517601+0000","last_fullsized":"2024-02-10T08:20:51.517601+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'17","last_scrub_stamp":"2024-02-10T08:19:26.245091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:19:26.245091+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":28,"num_read_kb":18,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.9","version":"115'5460","reported_seq":5718,"reported_epoch":115,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-02-10T08:20:57.515984+0000","last_change":"2024-02-10T08:20:47.981923+0000","last_active":"2024-02-10T08:20:57.515984+0000","last_peered":"2024-02-10T08:20:57.515984+0000","last_clean":"2024-02-10T08:19:38.813165+0000","last_became_active":"2024-02-10T08:20:47.908798+0000","last_became_peered":"2024-02-10T08:20:47.908798+0000","last_unstale":"2024-02-10T08:20:57.515984+0000","last_undegraded":"2024-02-10T08:20:47.430669+0000","last_fullsized":"2024-02-10T08:20:47.388200+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_clean_scrub_stamp":"2024-02-10T08:19:38.813165+0000","log_size":5460,"ondisk_log_size":5460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":357826560,"num_objects":5460,"num_object_clones":0,"num_object_copies":16380,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":4957,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5460,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5460,"num_write_kb":349440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":111,"num_bytes_recovered":7274496,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0,1","objects":503}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":73,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.432103+0000","last_change":"2024-02-10T08:19:24.200005+0000","last_active":"2024-02-10T08:20:55.432103+0000","last_peered":"2024-02-10T08:20:55.432103+0000","last_clean":"2024-02-10T08:20:55.432103+0000","last_became_active":"2024-02-10T08:16:58.866831+0000","last_became_peered":"2024-02-10T08:16:58.866831+0000","last_unstale":"2024-02-10T08:20:55.432103+0000","last_undegraded":"2024-02-10T08:20:55.432103+0000","last_fullsized":"2024-02-10T08:20:55.432103+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:24.199920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:19:24.199920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":76,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.433182+0000","last_change":"2024-02-10T08:19:30.942724+0000","last_active":"2024-02-10T08:20:55.433182+0000","last_peered":"2024-02-10T08:20:55.433182+0000","last_clean":"2024-02-10T08:20:55.433182+0000","last_became_active":"2024-02-10T08:16:56.864026+0000","last_became_peered":"2024-02-10T08:16:56.864026+0000","last_unstale":"2024-02-10T08:20:55.433182+0000","last_undegraded":"2024-02-10T08:20:55.433182+0000","last_fullsized":"2024-02-10T08:20:55.433182+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:30.942646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:19:30.942646+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":85,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.436411+0000","last_change":"2024-02-10T08:20:21.977157+0000","last_active":"2024-02-10T08:20:55.436411+0000","last_peered":"2024-02-10T08:20:55.436411+0000","last_clean":"2024-02-10T08:20:55.436411+0000","last_became_active":"2024-02-10T08:16:52.789100+0000","last_became_peered":"2024-02-10T08:16:52.789100+0000","last_unstale":"2024-02-10T08:20:55.436411+0000","last_undegraded":"2024-02-10T08:20:55.436411+0000","last_fullsized":"2024-02-10T08:20:55.436411+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:21.977065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:20:21.977065+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"62'19","reported_seq":108,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.431631+0000","last_change":"2024-02-10T08:20:01.351638+0000","last_active":"2024-02-10T08:20:55.431631+0000","last_peered":"2024-02-10T08:20:55.431631+0000","last_clean":"2024-02-10T08:20:55.431631+0000","last_became_active":"2024-02-10T08:16:55.203415+0000","last_became_peered":"2024-02-10T08:16:55.203415+0000","last_unstale":"2024-02-10T08:20:55.431631+0000","last_undegraded":"2024-02-10T08:20:55.431631+0000","last_fullsized":"2024-02-10T08:20:55.431631+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'19","last_scrub_stamp":"2024-02-10T08:20:01.351573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:20:01.351573+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.8","version":"116'5465","reported_seq":6581,"reported_epoch":116,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-02-10T08:21:02.526294+0000","last_change":"2024-02-10T08:20:47.918334+0000","last_active":"2024-02-10T08:21:02.526294+0000","last_peered":"2024-02-10T08:21:02.526294+0000","last_clean":"2024-02-10T08:19:38.813165+0000","last_became_active":"2024-02-10T08:20:47.896245+0000","last_became_peered":"2024-02-10T08:20:47.896245+0000","last_unstale":"2024-02-10T08:21:02.526294+0000","last_undegraded":"2024-02-10T08:20:47.427105+0000","last_fullsized":"2024-02-10T08:20:47.389351+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_clean_scrub_stamp":"2024-02-10T08:19:38.813165+0000","log_size":5465,"ondisk_log_size":5465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358154240,"num_objects":5465,"num_object_clones":0,"num_object_copies":16395,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":4383,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5465,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5465,"num_write_kb":349760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":539,"num_bytes_recovered":35323904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4],"acting":[2,7],"avail_no_missing":["2","7"],"object_location_counts":[{"shards":"2,7","objects":1082}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"76'2","reported_seq":74,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-02-10T08:20:51.547897+0000","last_change":"2024-02-10T08:19:28.458200+0000","last_active":"2024-02-10T08:20:51.547897+0000","last_peered":"2024-02-10T08:20:51.547897+0000","last_clean":"2024-02-10T08:20:51.547897+0000","last_became_active":"2024-02-10T08:16:58.860294+0000","last_became_peered":"2024-02-10T08:16:58.860294+0000","last_unstale":"2024-02-10T08:20:51.547897+0000","last_undegraded":"2024-02-10T08:20:51.547897+0000","last_fullsized":"2024-02-10T08:20:51.547897+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'2","last_scrub_stamp":"2024-02-10T08:19:28.458129+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2024-02-10T08:18:08.680038+0000","last_clean_scrub_stamp":"2024-02-10T08:19:28.458129+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":86,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.434693+0000","last_change":"2024-02-10T08:20:46.402430+0000","last_active":"2024-02-10T08:20:55.434693+0000","last_peered":"2024-02-10T08:20:55.434693+0000","last_clean":"2024-02-10T08:20:55.434693+0000","last_became_active":"2024-02-10T08:20:46.402072+0000","last_became_peered":"2024-02-10T08:20:46.402072+0000","last_unstale":"2024-02-10T08:20:55.434693+0000","last_undegraded":"2024-02-10T08:20:55.434693+0000","last_fullsized":"2024-02-10T08:20:55.434693+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:27.611094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:27.611094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":95,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.435919+0000","last_change":"2024-02-10T08:20:46.407715+0000","last_active":"2024-02-10T08:20:55.435919+0000","last_peered":"2024-02-10T08:20:55.435919+0000","last_clean":"2024-02-10T08:20:55.435919+0000","last_became_active":"2024-02-10T08:20:46.407311+0000","last_became_peered":"2024-02-10T08:20:46.407311+0000","last_unstale":"2024-02-10T08:20:55.435919+0000","last_undegraded":"2024-02-10T08:20:55.435919+0000","last_fullsized":"2024-02-10T08:20:55.435919+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:21.523096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:21.523096+0000","last_clean_scrub_stamp":"2024-02-10T08:19:21.523096+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"62'9","reported_seq":102,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-02-10T08:20:51.531486+0000","last_change":"2024-02-10T08:20:46.403104+0000","last_active":"2024-02-10T08:20:51.531486+0000","last_peered":"2024-02-10T08:20:51.531486+0000","last_clean":"2024-02-10T08:20:51.531486+0000","last_became_active":"2024-02-10T08:20:46.402749+0000","last_became_peered":"2024-02-10T08:20:46.402749+0000","last_unstale":"2024-02-10T08:20:51.531486+0000","last_undegraded":"2024-02-10T08:20:51.531486+0000","last_fullsized":"2024-02-10T08:20:51.531486+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'9","last_scrub_stamp":"2024-02-10T08:18:14.705229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:14.705229+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"116'5668","reported_seq":5701,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-02-10T08:21:02.424329+0000","last_change":"2024-02-10T08:19:39.829202+0000","last_active":"2024-02-10T08:21:02.424329+0000","last_peered":"2024-02-10T08:21:02.424329+0000","last_clean":"2024-02-10T08:21:02.424329+0000","last_became_active":"2024-02-10T08:19:39.828947+0000","last_became_peered":"2024-02-10T08:19:39.828947+0000","last_unstale":"2024-02-10T08:21:02.424329+0000","last_undegraded":"2024-02-10T08:21:02.424329+0000","last_fullsized":"2024-02-10T08:21:02.424329+0000","mapping_epoch":91,"log_start":"95'400","ondisk_log_start":"95'400","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_clean_scrub_stamp":"2024-02-10T08:19:38.813165+0000","log_size":5268,"ondisk_log_size":5268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":371458048,"num_objects":5668,"num_object_clones":0,"num_object_copies":17004,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5668,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5668,"num_write_kb":362752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[1,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":73,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.406964+0000","last_change":"2024-02-10T08:19:20.392327+0000","last_active":"2024-02-10T08:20:55.406964+0000","last_peered":"2024-02-10T08:20:55.406964+0000","last_clean":"2024-02-10T08:20:55.406964+0000","last_became_active":"2024-02-10T08:16:58.891260+0000","last_became_peered":"2024-02-10T08:16:58.891260+0000","last_unstale":"2024-02-10T08:20:55.406964+0000","last_undegraded":"2024-02-10T08:20:55.406964+0000","last_fullsized":"2024-02-10T08:20:55.406964+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:20.392249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:20.392249+0000","last_clean_scrub_stamp":"2024-02-10T08:19:20.392249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":85,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.437864+0000","last_change":"2024-02-10T08:20:24.969410+0000","last_active":"2024-02-10T08:20:55.437864+0000","last_peered":"2024-02-10T08:20:55.437864+0000","last_clean":"2024-02-10T08:20:55.437864+0000","last_became_active":"2024-02-10T08:16:52.785754+0000","last_became_peered":"2024-02-10T08:16:52.785754+0000","last_unstale":"2024-02-10T08:20:55.437864+0000","last_undegraded":"2024-02-10T08:20:55.437864+0000","last_fullsized":"2024-02-10T08:20:55.437864+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:24.969327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:20:24.969327+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"62'15","reported_seq":102,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-02-10T08:20:55.409038+0000","last_change":"2024-02-10T08:20:05.314332+0000","last_active":"2024-02-10T08:20:55.409038+0000","last_peered":"2024-02-10T08:20:55.409038+0000","last_clean":"2024-02-10T08:20:55.409038+0000","last_became_active":"2024-02-10T08:16:55.204597+0000","last_became_peered":"2024-02-10T08:16:55.204597+0000","last_unstale":"2024-02-10T08:20:55.409038+0000","last_undegraded":"2024-02-10T08:20:55.409038+0000","last_fullsized":"2024-02-10T08:20:55.409038+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'15","last_scrub_stamp":"2024-02-10T08:20:05.314225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:20:05.314225+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"111'10","reported_seq":145,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-02-10T08:21:00.642376+0000","last_change":"2024-02-10T08:20:46.399807+0000","last_active":"2024-02-10T08:21:00.642376+0000","last_peered":"2024-02-10T08:21:00.642376+0000","last_clean":"2024-02-10T08:21:00.642376+0000","last_became_active":"2024-02-10T08:20:46.399193+0000","last_became_peered":"2024-02-10T08:20:46.399193+0000","last_unstale":"2024-02-10T08:21:00.642376+0000","last_undegraded":"2024-02-10T08:21:00.642376+0000","last_fullsized":"2024-02-10T08:21:00.642376+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'8","last_scrub_stamp":"2024-02-10T08:18:29.052907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:29.052907+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":5810421760,"num_objects":88660,"num_object_clones":0,"num_object_copies":265980,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":25248,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88660,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88660,"num_write_kb":5674240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":916,"num_bytes_recovered":60030976,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":15802302464,"data_stored":15802302464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":84160,"ondisk_log_size":84160,"up":48,"acting":43,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":3},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":242,"num_read_kb":237,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":9,"acting":9,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":691,"num_read_kb":448,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":411,"ondisk_log_size":411,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":96,"acting":96,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":50,"seq":214748364854,"num_pgs":62,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2081404,"kb_used_data":1771892,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":91663748,"statfs":{"total":95995035648,"available":93863677952,"internally_reserved":0,"allocated":1814417408,"data_stored":1813925982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:20:51 2024","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":0.65800000000000003,"15min":0.54800000000000004},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":8.7850000000000001,"5min":8.7850000000000001,"15min":8.7850000000000001},"last":0.315},{"interface":"front","average":{"1min":1.768,"5min":0.77000000000000002,"15min":0.58199999999999996},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":9.7629999999999999,"5min":9.7629999999999999,"15min":9.7629999999999999},"last":0.24099999999999999}]},{"osd":1,"last update":"Sat Feb 10 08:20:51 2024","interfaces":[{"interface":"back","average":{"1min":1.609,"5min":0.73899999999999999,"15min":0.58399999999999996},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":8.6500000000000004,"5min":8.6500000000000004,"15min":8.6500000000000004},"last":0.27100000000000002},{"interface":"front","average":{"1min":1.5289999999999999,"5min":0.71999999999999997,"15min":0.58599999999999997},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":8.7300000000000004,"5min":8.7300000000000004,"15min":8.7300000000000004},"last":12.048}]},{"osd":2,"last update":"Sat Feb 10 08:20:51 2024","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":0.628,"15min":0.53500000000000003},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":3.1909999999999998,"5min":3.1909999999999998,"15min":3.1909999999999998},"last":4.7880000000000003},{"interface":"front","average":{"1min":1.5429999999999999,"5min":0.73799999999999999,"15min":0.59799999999999998},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":6.4969999999999999,"5min":6.4969999999999999,"15min":6.4969999999999999},"last":4.5780000000000003}]},{"osd":3,"last update":"Sat Feb 10 08:20:51 2024","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":0.68600000000000005,"15min":0.57399999999999995},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":8.766,"5min":8.766,"15min":8.766},"last":1.472},{"interface":"front","average":{"1min":2.4279999999999999,"5min":0.91600000000000004,"15min":0.65200000000000002},"min":{"1min":0.35499999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":9.5719999999999992,"5min":9.5719999999999992,"15min":9.5719999999999992},"last":0.38300000000000001}]},{"osd":4,"last update":"Sat Feb 10 08:18:45 2024","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.40300000000000002,"15min":0.40100000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.56599999999999995,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.433,"15min":0.42999999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.58999999999999997,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.35499999999999998}]},{"osd":5,"last update":"Sat Feb 10 08:20:51 2024","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.432,"15min":0.41799999999999998},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.32300000000000001,"5min":0.44500000000000001,"15min":0.45300000000000001},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.30399999999999999}]},{"osd":6,"last update":"Sat Feb 10 08:20:51 2024","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.45900000000000002,"15min":0.44500000000000001},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.47199999999999998,"15min":0.46800000000000003},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.86599999999999999,"5min":1.22,"15min":1.22},"last":0.371}]}]},{"osd":6,"up_from":43,"seq":184683593787,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2108384,"kb_used_data":1798872,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":91636768,"statfs":{"total":95995035648,"available":93836050432,"internally_reserved":0,"allocated":1842044928,"data_stored":1841581804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,0,1,2],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:20:27 2024","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":0.68400000000000005,"15min":0.58799999999999997},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":7.0890000000000004,"5min":7.0890000000000004,"15min":7.0890000000000004},"last":1.7},{"interface":"front","average":{"1min":1.0289999999999999,"5min":0.64100000000000001,"15min":0.58499999999999996},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":4.1200000000000001,"5min":4.1200000000000001,"15min":4.1200000000000001},"last":11.768000000000001}]},{"osd":1,"last update":"Sat Feb 10 08:20:27 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.58499999999999996,"15min":0.56299999999999994},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":2.2149999999999999,"5min":2.2149999999999999,"15min":2.2149999999999999},"last":1.323},{"interface":"front","average":{"1min":0.871,"5min":0.60799999999999998,"15min":0.58399999999999996},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":2.3580000000000001,"5min":2.3580000000000001,"15min":2.3580000000000001},"last":1.4330000000000001}]},{"osd":2,"last update":"Sat Feb 10 08:20:27 2024","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":0.67500000000000004,"15min":0.61299999999999999},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":5.3490000000000002,"5min":5.3490000000000002,"15min":5.3490000000000002},"last":1.512},{"interface":"front","average":{"1min":1.1080000000000001,"5min":0.67900000000000005,"15min":0.61399999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":5.3630000000000004,"5min":5.3630000000000004,"15min":5.3630000000000004},"last":1.5229999999999999}]},{"osd":3,"last update":"Sat Feb 10 08:20:27 2024","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.625,"15min":0.58699999999999997},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":3.0630000000000002,"5min":3.0630000000000002,"15min":3.0630000000000002},"last":2.9529999999999998},{"interface":"front","average":{"1min":1.0720000000000001,"5min":0.65900000000000003,"15min":0.59199999999999997},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":3.302,"5min":3.302,"15min":3.302},"last":3.0249999999999999}]},{"osd":4,"last update":"Sat Feb 10 08:19:27 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.45500000000000002,"15min":0.44900000000000001},"min":{"1min":0.29699999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.751,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.47799999999999998,"15min":0.46800000000000003},"min":{"1min":0.33500000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.71899999999999997,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":1.9239999999999999}]},{"osd":5,"last update":"Sat Feb 10 08:20:27 2024","interfaces":[{"interface":"back","average":{"1min":0.308,"5min":0.44400000000000001,"15min":0.44800000000000001},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.68899999999999995,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.45900000000000002,"15min":0.45300000000000001},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.45900000000000002,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.40899999999999997}]},{"osd":7,"last update":"Sat Feb 10 08:20:54 2024","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.495,"15min":0.52100000000000002},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.53500000000000003,"15min":0.56100000000000005},"min":{"1min":0.28799999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.88200000000000001,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.433}]}]},{"osd":1,"up_from":13,"seq":55834574930,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2441208,"kb_used_data":2139888,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":91303944,"statfs":{"total":95995035648,"available":93495238656,"internally_reserved":0,"allocated":2191245312,"data_stored":2190757426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,0,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:20:25 2024","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":0.56000000000000005,"15min":0.38600000000000001},"min":{"1min":0.223,"5min":0.223,"15min":0.20000000000000001},"max":{"1min":9.2080000000000002,"5min":9.2080000000000002,"15min":9.2080000000000002},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.9910000000000001,"5min":0.71999999999999997,"15min":0.44800000000000001},"min":{"1min":0.27300000000000002,"5min":0.24099999999999999,"15min":0.20999999999999999},"max":{"1min":8.2739999999999991,"5min":8.2739999999999991,"15min":8.2739999999999991},"last":10.881}]},{"osd":2,"last update":"Sat Feb 10 08:20:56 2024","interfaces":[{"interface":"back","average":{"1min":4.3650000000000002,"5min":1.306,"15min":0.67200000000000004},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":29.084,"5min":29.084,"15min":29.084},"last":0.23799999999999999},{"interface":"front","average":{"1min":3.778,"5min":1.1679999999999999,"15min":0.63100000000000001},"min":{"1min":0.312,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":29.131,"5min":29.131,"15min":29.131},"last":11.801}]},{"osd":3,"last update":"Sat Feb 10 08:20:15 2024","interfaces":[{"interface":"back","average":{"1min":1.673,"5min":0.68899999999999995,"15min":0.53700000000000003},"min":{"1min":0.33200000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":9.2319999999999993,"5min":9.2319999999999993,"15min":9.2319999999999993},"last":11.837},{"interface":"front","average":{"1min":1.105,"5min":0.55800000000000005,"15min":0.47899999999999998},"min":{"1min":0.23899999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":8.1709999999999994,"5min":8.1709999999999994,"15min":8.1709999999999994},"last":1.319}]},{"osd":4,"last update":"Sat Feb 10 08:18:37 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.58599999999999997,"15min":0.59099999999999997},"min":{"1min":0.39200000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.83899999999999997,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.57199999999999995,"15min":0.58199999999999996},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.85099999999999998,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":6.6559999999999997}]},{"osd":5,"last update":"Sat Feb 10 08:20:03 2024","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.65100000000000002,"15min":0.60099999999999998},"min":{"1min":0.41499999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":8.2240000000000002,"5min":8.2240000000000002,"15min":8.2240000000000002},"last":0.434},{"interface":"front","average":{"1min":1.048,"5min":0.69299999999999995,"15min":0.64200000000000002},"min":{"1min":0.39400000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":8.3770000000000007,"5min":8.3770000000000007,"15min":8.3770000000000007},"last":6.7549999999999999}]},{"osd":6,"last update":"Sat Feb 10 08:20:25 2024","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":0.69799999999999995,"15min":0.629},"min":{"1min":0.42499999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":8.3309999999999995,"5min":8.3309999999999995,"15min":8.3309999999999995},"last":6.7279999999999998},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.67800000000000005,"15min":0.63800000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":7.6859999999999999,"5min":7.6859999999999999,"15min":7.6859999999999999},"last":1.226}]},{"osd":7,"last update":"Sat Feb 10 08:20:50 2024","interfaces":[{"interface":"back","average":{"1min":1.7030000000000001,"5min":0.80000000000000004,"15min":0.64100000000000001},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":8.4109999999999996,"5min":8.4109999999999996,"15min":8.4109999999999996},"last":6.6950000000000003},{"interface":"front","average":{"1min":1.7350000000000001,"5min":0.81999999999999995,"15min":0.66400000000000003},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":7.7229999999999999,"5min":7.7229999999999999,"15min":7.7229999999999999},"last":1.2609999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738454,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":3053868,"kb_used_data":2756644,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":90691284,"statfs":{"total":95995035648,"available":92867874816,"internally_reserved":0,"allocated":2822803456,"data_stored":2822321493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 10 08:20:28 2024","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":0.58399999999999996,"15min":0.41199999999999998},"min":{"1min":0.23999999999999999,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":4.2030000000000003,"5min":4.2030000000000003,"15min":4.2030000000000003},"last":13.954000000000001},{"interface":"front","average":{"1min":1.0029999999999999,"5min":0.51500000000000001,"15min":0.38600000000000001},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":4.8780000000000001,"5min":4.8780000000000001,"15min":4.8780000000000001},"last":3.5019999999999998}]},{"osd":2,"last update":"Sat Feb 10 08:20:52 2024","interfaces":[{"interface":"back","average":{"1min":3.448,"5min":1.01,"15min":0.59399999999999997},"min":{"1min":0.25600000000000001,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":14.185,"5min":14.185,"15min":14.185},"last":5.0960000000000001},{"interface":"front","average":{"1min":2.4199999999999999,"5min":0.81699999999999995,"15min":0.53200000000000003},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":6.7510000000000003,"5min":6.7510000000000003,"15min":6.7510000000000003},"last":0.21199999999999999}]},{"osd":3,"last update":"Sat Feb 10 08:20:14 2024","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":0.59899999999999998,"15min":0.497},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":4.8380000000000001,"5min":4.8380000000000001,"15min":4.8380000000000001},"last":10.941000000000001},{"interface":"front","average":{"1min":1.363,"5min":0.61499999999999999,"15min":0.50600000000000001},"min":{"1min":0.317,"5min":0.246,"15min":0.246},"max":{"1min":6.0910000000000002,"5min":6.0910000000000002,"15min":6.0910000000000002},"last":5.0709999999999997}]},{"osd":4,"last update":"Sat Feb 10 08:18:35 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.59399999999999997,"15min":0.59199999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":4.9580000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.59399999999999997,"15min":0.60399999999999998},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":1.1100000000000001}]},{"osd":5,"last update":"Sat Feb 10 08:20:04 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.59399999999999997,"15min":0.59599999999999997},"min":{"1min":0.46500000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.499,"5min":0.55900000000000005,"15min":0.57499999999999996},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.74199999999999999,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":1.1399999999999999}]},{"osd":6,"last update":"Sat Feb 10 08:20:28 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.65400000000000003,"15min":0.61599999999999999},"min":{"1min":0.40899999999999997,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":3.359,"5min":3.359,"15min":3.359},"last":1.8180000000000001},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":2.8610000000000002,"5min":2.8610000000000002,"15min":2.8610000000000002},"last":2.4729999999999999}]},{"osd":7,"last update":"Sat Feb 10 08:20:52 2024","interfaces":[{"interface":"back","average":{"1min":1.4630000000000001,"5min":0.77300000000000002,"15min":0.65700000000000003},"min":{"1min":0.38700000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":3.5299999999999998,"5min":3.5299999999999998,"15min":3.5299999999999998},"last":0.437},{"interface":"front","average":{"1min":1.169,"5min":0.71299999999999997,"15min":0.63700000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":5.702,"5min":5.702,"15min":5.702},"last":1.173}]}]},{"osd":2,"up_from":18,"seq":77309411406,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2432108,"kb_used_data":2130788,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":91313044,"statfs":{"total":95995035648,"available":93504557056,"internally_reserved":0,"allocated":2181926912,"data_stored":2181451351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,1,0,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:20:48 2024","interfaces":[{"interface":"back","average":{"1min":2.9329999999999998,"5min":0.871,"15min":0.52000000000000002},"min":{"1min":0.17399999999999999,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":19.768999999999998,"5min":19.768999999999998,"15min":19.768999999999998},"last":5.0170000000000003},{"interface":"front","average":{"1min":3.2839999999999998,"5min":0.96199999999999997,"15min":0.56000000000000005},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":17.635000000000002,"5min":17.635000000000002,"15min":17.635000000000002},"last":1.8400000000000001}]},{"osd":1,"last update":"Sat Feb 10 08:20:48 2024","interfaces":[{"interface":"back","average":{"1min":1.649,"5min":0.64400000000000002,"15min":0.45800000000000002},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":5.9880000000000004,"5min":5.9880000000000004,"15min":5.9880000000000004},"last":9.3059999999999992},{"interface":"front","average":{"1min":1.5649999999999999,"5min":0.63400000000000001,"15min":0.46200000000000002},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":5.7460000000000004,"5min":5.7460000000000004,"15min":5.7460000000000004},"last":4.9859999999999998}]},{"osd":3,"last update":"Sat Feb 10 08:20:16 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.53000000000000003,"15min":0.48399999999999999},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":3.4129999999999998,"5min":3.4129999999999998,"15min":3.4129999999999998},"last":9.3339999999999996},{"interface":"front","average":{"1min":1.0089999999999999,"5min":0.54900000000000004,"15min":0.48399999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":5.5039999999999996,"5min":5.5039999999999996,"15min":5.5039999999999996},"last":2.919}]},{"osd":4,"last update":"Sat Feb 10 08:18:35 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.58499999999999996,"15min":0.58099999999999996},"min":{"1min":0.496,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.86299999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":9.2430000000000003},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.57399999999999995,"15min":0.57699999999999996},"min":{"1min":0.39800000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":2.984}]},{"osd":5,"last update":"Sat Feb 10 08:20:05 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.56999999999999995,"15min":0.57099999999999995},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":1.5009999999999999},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.60499999999999998,"15min":0.57999999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":2.786,"5min":2.786,"15min":2.786},"last":9.1969999999999992}]},{"osd":6,"last update":"Sat Feb 10 08:20:32 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.63200000000000001,"15min":0.60199999999999998},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":3.302,"5min":3.302,"15min":3.302},"last":1.5289999999999999},{"interface":"front","average":{"1min":1.0489999999999999,"5min":0.68799999999999994,"15min":0.63600000000000001},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":6.0110000000000001,"5min":6.0110000000000001,"15min":6.0110000000000001},"last":9.2759999999999998}]},{"osd":7,"last update":"Sat Feb 10 08:20:48 2024","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":0.75700000000000001,"15min":0.65900000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":5.9619999999999997,"5min":5.9619999999999997,"15min":5.9619999999999997},"last":9.4149999999999991},{"interface":"front","average":{"1min":1.694,"5min":0.81799999999999995,"15min":0.68000000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":5.8819999999999997,"5min":5.8819999999999997,"15min":5.8819999999999997},"last":3.0089999999999999}]}]},{"osd":3,"up_from":25,"seq":107374182473,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":3509564,"kb_used_data":3212340,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":90235588,"statfs":{"total":95995035648,"available":92401242112,"internally_reserved":0,"allocated":3289436160,"data_stored":3288943966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:20:14 2024","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":0.50800000000000001,"15min":0.41399999999999998},"min":{"1min":0.20499999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":5.7400000000000002,"5min":5.7400000000000002,"15min":5.7400000000000002},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.48299999999999998,"15min":0.443},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":2.7519999999999998,"5min":2.7519999999999998,"15min":2.7519999999999998},"last":0.29599999999999999}]},{"osd":1,"last update":"Sat Feb 10 08:20:14 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.47299999999999998,"15min":0.45400000000000001},"min":{"1min":0.23300000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":4.1980000000000004,"5min":4.1980000000000004,"15min":4.1980000000000004},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.495,"15min":0.47599999999999998},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":3.8140000000000001,"5min":3.8140000000000001,"15min":3.8140000000000001},"last":0.36799999999999999}]},{"osd":2,"last update":"Sat Feb 10 08:20:14 2024","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":0.56200000000000006,"15min":0.49199999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":4.1669999999999998,"5min":4.1669999999999998,"15min":4.1669999999999998},"last":5.016},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.54500000000000004,"15min":0.48299999999999998},"min":{"1min":0.28699999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":3.504,"5min":3.504,"15min":3.504},"last":10.096}]},{"osd":4,"last update":"Sat Feb 10 08:18:36 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54700000000000004,"15min":0.54500000000000004},"min":{"1min":0.38800000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.56899999999999995,"15min":0.57299999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.83099999999999996,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.48799999999999999}]},{"osd":5,"last update":"Sat Feb 10 08:20:05 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.59599999999999997,"15min":0.59799999999999998},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59099999999999997,"15min":0.59699999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":0.51200000000000001}]},{"osd":6,"last update":"Sat Feb 10 08:20:27 2024","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":0.65900000000000003,"15min":0.59899999999999998},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":6.6369999999999996,"5min":6.6369999999999996,"15min":6.6369999999999996},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.61399999999999999,"15min":0.59199999999999997},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":2.0670000000000002,"5min":2.0670000000000002,"15min":2.0670000000000002},"last":0.66700000000000004}]},{"osd":7,"last update":"Sat Feb 10 08:20:49 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.61499999999999999,"15min":0.58899999999999997},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":2.0459999999999998,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":0.62},{"interface":"front","average":{"1min":1.6899999999999999,"5min":0.80600000000000005,"15min":0.64800000000000002},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":7.2649999999999997,"5min":7.2649999999999997,"15min":7.2649999999999997},"last":0.56599999999999995}]}]},{"osd":4,"up_from":110,"seq":472446402564,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":446756,"kb_used_data":136732,"kb_used_omap":0,"kb_used_meta":310015,"kb_avail":93298396,"statfs":{"total":95995035648,"available":95537557504,"internally_reserved":0,"allocated":140013568,"data_stored":139538707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":972,"internal_metadata":317455412},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0310000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.8230000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]}]},{"osd":5,"up_from":37,"seq":158913790016,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1734752,"kb_used_data":1429336,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":92010400,"statfs":{"total":95995035648,"available":94218649600,"internally_reserved":0,"allocated":1463640064,"data_stored":1463176113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:20:58 2024","interfaces":[{"interface":"back","average":{"1min":2.9350000000000001,"5min":1.022,"15min":0.73699999999999999},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":22.914000000000001,"5min":22.914000000000001,"15min":22.914000000000001},"last":4.9279999999999999},{"interface":"front","average":{"1min":2.9340000000000002,"5min":0.98999999999999999,"15min":0.68000000000000005},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":23.161000000000001,"5min":23.161000000000001,"15min":23.161000000000001},"last":5.4740000000000002}]},{"osd":1,"last update":"Sat Feb 10 08:20:58 2024","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":0.63600000000000001,"15min":0.59099999999999997},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":8.1289999999999996,"5min":8.1289999999999996,"15min":8.1289999999999996},"last":0.33200000000000002},{"interface":"front","average":{"1min":1.3009999999999999,"5min":0.66900000000000004,"15min":0.59299999999999997},"min":{"1min":0.33800000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":4.6989999999999998,"5min":4.6989999999999998,"15min":4.6989999999999998},"last":0.35899999999999999}]},{"osd":2,"last update":"Sat Feb 10 08:20:58 2024","interfaces":[{"interface":"back","average":{"1min":2.4239999999999999,"5min":0.92600000000000005,"15min":0.69399999999999995},"min":{"1min":0.32300000000000001,"5min":0.314,"15min":0.314},"max":{"1min":9.5709999999999997,"5min":9.5709999999999997,"15min":9.5709999999999997},"last":8.9420000000000002},{"interface":"front","average":{"1min":1.9950000000000001,"5min":0.84199999999999997,"15min":0.68200000000000005},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":9.2810000000000006,"5min":9.2810000000000006,"15min":9.2810000000000006},"last":4.7149999999999999}]},{"osd":3,"last update":"Sat Feb 10 08:20:58 2024","interfaces":[{"interface":"back","average":{"1min":3.113,"5min":1.0549999999999999,"15min":0.749},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":24.198,"5min":24.198,"15min":24.198},"last":1.0029999999999999},{"interface":"front","average":{"1min":3.77,"5min":1.2010000000000001,"15min":0.77800000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":22.701000000000001,"5min":22.701000000000001,"15min":22.701000000000001},"last":9.0570000000000004}]},{"osd":4,"last update":"Sat Feb 10 08:18:57 2024","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.371,"15min":0.36099999999999999},"min":{"1min":0.26400000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.65400000000000003,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.433,"5min":0.38300000000000001,"15min":0.36899999999999999},"min":{"1min":0.30399999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.68700000000000006,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.373}]},{"osd":6,"last update":"Sat Feb 10 08:20:26 2024","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.40999999999999998,"15min":0.38400000000000001},"min":{"1min":0.255,"5min":0.254,"15min":0.254},"max":{"1min":0.55700000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.46200000000000002,"15min":0.434},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.45300000000000001}]},{"osd":7,"last update":"Sat Feb 10 08:20:50 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.46899999999999997,"15min":0.44600000000000001},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.9239999999999999,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.49099999999999999,"15min":0.44500000000000001},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":3.387,"5min":3.387,"15min":3.387},"last":0.42899999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":1678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2828140544,"data_stored":2828140544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2205876224,"data_stored":2205876224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2188574720,"data_stored":2188574720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3297443840,"data_stored":3297443840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":149291008,"data_stored":149291008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1464205312,"data_stored":1464205312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1844772864,"data_stored":1844772864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1823997952,"data_stored":1823997952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-10T08:21:06.479 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd pool set default.rgw.log pgp_num 32 2024-02-10T08:21:06.632 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:21:06.640 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:06.641 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:21:06.742 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:21:06.789 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:21:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:21:06] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:21:06.857 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:07.167 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:21:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:21:07] "GET /metrics HTTP/1.1" 200 175471 "" "Prometheus/2.33.4" 2024-02-10T08:21:07.244 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 77 16 92356 92340 74.9034 36.125 0.0210877 0.013346 2024-02-10T08:21:07.339 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:21:07.345 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:07.345 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:21:07.435 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:21:07.447 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:21:07.523 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:07.769 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:21:06.545160+0000 mgr.y (mgr.14505) 167 : cluster [DBG] pgmap v171: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 5.5 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 639 B/s rd, 24 MiB/s wr, 387 op/s; 25046/268836 objects degraded (9.316%); 3.0 MiB/s, 48 objects/s recovering 2024-02-10T08:21:07.769 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:21:06.545160+0000 mgr.y (mgr.14505) 167 : cluster [DBG] pgmap v171: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 5.5 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 639 B/s rd, 24 MiB/s wr, 387 op/s; 25046/268836 objects degraded (9.316%); 3.0 MiB/s, 48 objects/s recovering 2024-02-10T08:21:07.923 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:21:07.930 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:07.930 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:21:07.962 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-10T08:21:08.031 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:21:08.039 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:21:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:21:08.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:21:06.545160+0000 mgr.y (mgr.14505) 167 : cluster [DBG] pgmap v171: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 5.5 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 639 B/s rd, 24 MiB/s wr, 387 op/s; 25046/268836 objects degraded (9.316%); 3.0 MiB/s, 48 objects/s recovering 2024-02-10T08:21:08.174 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:08.244 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 78 16 92966 92950 74.4316 38.125 0.0504982 0.0134286 2024-02-10T08:21:08.259 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:21:08.267 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:08.267 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:21:08.368 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:21:08.468 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:08.536 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:21:08.543 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:08.544 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:21:08.644 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:21:08.674 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:08.695 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:21:08.698 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:08.698 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:21:08.799 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:21:08.829 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:08.854 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:21:08.857 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:08.858 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:21:08.907 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:21:07.667523+0000 mgr.y (mgr.14505) 168 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:21:08.907 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:21:07.667523+0000 mgr.y (mgr.14505) 168 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:21:08.958 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:21:08.985 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:21:07.667523+0000 mgr.y (mgr.14505) 168 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:21:08.987 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:09.008 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:21:09.010 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:09.011 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:21:09.111 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:21:09.206 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:09.246 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 79 16 93570 93554 73.9674 37.75 0.0478039 0.0135132 2024-02-10T08:21:09.275 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:21:09.284 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:09.285 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:21:09.378 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-02-10T08:21:09.378 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:21:09.386 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:21:09.476 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:09.616 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:21:09.620 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:09.620 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:21:09.721 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:21:09.794 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:09.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:21:08.545966+0000 mgr.y (mgr.14505) 169 : cluster [DBG] pgmap v172: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 5.6 GiB data, 18 GiB used, 698 GiB / 715 GiB avail; 1.2 KiB/s rd, 48 MiB/s wr, 775 op/s; 25036/278151 objects degraded (9.001%); 6.2 MiB/s, 99 objects/s recovering 2024-02-10T08:21:09.906 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:21:08.545966+0000 mgr.y (mgr.14505) 169 : cluster [DBG] pgmap v172: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 5.6 GiB data, 18 GiB used, 698 GiB / 715 GiB avail; 1.2 KiB/s rd, 48 MiB/s wr, 775 op/s; 25036/278151 objects degraded (9.001%); 6.2 MiB/s, 99 objects/s recovering 2024-02-10T08:21:10.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:21:08.545966+0000 mgr.y (mgr.14505) 169 : cluster [DBG] pgmap v172: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 5.6 GiB data, 18 GiB used, 698 GiB / 715 GiB avail; 1.2 KiB/s rd, 48 MiB/s wr, 775 op/s; 25036/278151 objects degraded (9.001%); 6.2 MiB/s, 99 objects/s recovering 2024-02-10T08:21:10.248 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:2024-02-10T08:21:10.248055+0000 min lat: 0.0013002 max lat: 2.58205 avg lat: 0.0135844 2024-02-10T08:21:10.248 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-02-10T08:21:10.248 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 80 16 94254 94238 73.5748 42.75 0.0177716 0.0135844 2024-02-10T08:21:11.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:21:10.396582+0000 mon.a (mon.0) 873 : cluster [WRN] Health check update: Degraded data redundancy: 25036/278151 objects degraded (9.001%), 5 pgs degraded (PG_DEGRADED) 2024-02-10T08:21:11.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:21:10.396582+0000 mon.a (mon.0) 873 : cluster [WRN] Health check update: Degraded data redundancy: 25036/278151 objects degraded (9.001%), 5 pgs degraded (PG_DEGRADED) 2024-02-10T08:21:11.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:21:10.396582+0000 mon.a (mon.0) 873 : cluster [WRN] Health check update: Degraded data redundancy: 25036/278151 objects degraded (9.001%), 5 pgs degraded (PG_DEGRADED) 2024-02-10T08:21:11.248 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 81 16 94928 94912 73.1867 42.125 0.0318861 0.0136585 2024-02-10T08:21:11.798 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:21:10.551452+0000 mgr.y (mgr.14505) 170 : cluster [DBG] pgmap v173: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 5.6 GiB data, 18 GiB used, 698 GiB / 715 GiB avail; 1.0 KiB/s rd, 39 MiB/s wr, 626 op/s; 25036/278151 objects degraded (9.001%); 5.0 MiB/s, 80 objects/s recovering 2024-02-10T08:21:12.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:21:10.551452+0000 mgr.y (mgr.14505) 170 : cluster [DBG] pgmap v173: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 5.6 GiB data, 18 GiB used, 698 GiB / 715 GiB avail; 1.0 KiB/s rd, 39 MiB/s wr, 626 op/s; 25036/278151 objects degraded (9.001%); 5.0 MiB/s, 80 objects/s recovering 2024-02-10T08:21:12.248 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 82 16 95610 95594 72.8142 42.625 0.0156983 0.0137281 2024-02-10T08:21:12.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:21:10.551452+0000 mgr.y (mgr.14505) 170 : cluster [DBG] pgmap v173: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 5.6 GiB data, 18 GiB used, 698 GiB / 715 GiB avail; 1.0 KiB/s rd, 39 MiB/s wr, 626 op/s; 25036/278151 objects degraded (9.001%); 5.0 MiB/s, 80 objects/s recovering 2024-02-10T08:21:13.248 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 83 16 96321 96305 72.4724 44.4375 0.0379853 0.0137922 2024-02-10T08:21:14.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:21:12.554790+0000 mgr.y (mgr.14505) 171 : cluster [DBG] pgmap v174: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 5.8 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 1022 B/s rd, 40 MiB/s wr, 637 op/s; 25224/285684 objects degraded (8.829%); 5.1 MiB/s, 81 objects/s recovering 2024-02-10T08:21:14.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:21:13.442327+0000 mon.a (mon.0) 874 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:21:14.168 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:21:12.554790+0000 mgr.y (mgr.14505) 171 : cluster [DBG] pgmap v174: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 5.8 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 1022 B/s rd, 40 MiB/s wr, 637 op/s; 25224/285684 objects degraded (8.829%); 5.1 MiB/s, 81 objects/s recovering 2024-02-10T08:21:14.168 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:21:13.442327+0000 mon.a (mon.0) 874 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:21:14.250 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 84 16 96997 96981 72.1115 42.25 0.052936 0.013862 2024-02-10T08:21:14.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:21:12.554790+0000 mgr.y (mgr.14505) 171 : cluster [DBG] pgmap v174: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 5.8 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 1022 B/s rd, 40 MiB/s wr, 637 op/s; 25224/285684 objects degraded (8.829%); 5.1 MiB/s, 81 objects/s recovering 2024-02-10T08:21:14.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:21:13.442327+0000 mon.a (mon.0) 874 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:21:15.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:21:14.581537+0000 mon.a (mon.0) 875 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:21:15.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:21:14.588159+0000 mon.a (mon.0) 876 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:21:15.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:21:14.595526+0000 mon.a (mon.0) 877 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:21:15.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:21:14.581537+0000 mon.a (mon.0) 875 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:21:15.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:21:14.588159+0000 mon.a (mon.0) 876 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:21:15.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:21:14.595526+0000 mon.a (mon.0) 877 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:21:15.249 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 85 16 97654 97638 71.7464 41.0625 0.0529387 0.0139324 2024-02-10T08:21:15.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:21:14.581537+0000 mon.a (mon.0) 875 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:21:15.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:21:14.588159+0000 mon.a (mon.0) 876 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:21:15.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:21:14.595526+0000 mon.a (mon.0) 877 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:21:15.451 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.3 dump_blocked_ops 2024-02-10T08:21:15.880 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:21:14.557489+0000 mgr.y (mgr.14505) 172 : cluster [DBG] pgmap v175: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 5.8 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 1022 B/s rd, 40 MiB/s wr, 638 op/s; 25000/288000 objects degraded (8.681%); 5.2 MiB/s, 83 objects/s recovering 2024-02-10T08:21:15.880 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:21:15.404310+0000 mon.a (mon.0) 878 : cluster [WRN] Health check update: Degraded data redundancy: 25000/288000 objects degraded (8.681%), 5 pgs degraded (PG_DEGRADED) 2024-02-10T08:21:16.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:21:14.557489+0000 mgr.y (mgr.14505) 172 : cluster [DBG] pgmap v175: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 5.8 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 1022 B/s rd, 40 MiB/s wr, 638 op/s; 25000/288000 objects degraded (8.681%); 5.2 MiB/s, 83 objects/s recovering 2024-02-10T08:21:16.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:21:15.404310+0000 mon.a (mon.0) 878 : cluster [WRN] Health check update: Degraded data redundancy: 25000/288000 objects degraded (8.681%), 5 pgs degraded (PG_DEGRADED) 2024-02-10T08:21:16.251 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 86 16 98330 98314 71.4027 42.25 0.0279478 0.0139995 2024-02-10T08:21:16.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:21:14.557489+0000 mgr.y (mgr.14505) 172 : cluster [DBG] pgmap v175: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 5.8 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 1022 B/s rd, 40 MiB/s wr, 638 op/s; 25000/288000 objects degraded (8.681%); 5.2 MiB/s, 83 objects/s recovering 2024-02-10T08:21:16.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:21:15.404310+0000 mon.a (mon.0) 878 : cluster [WRN] Health check update: Degraded data redundancy: 25000/288000 objects degraded (8.681%), 5 pgs degraded (PG_DEGRADED) 2024-02-10T08:21:16.578 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:21:16.648 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:21:16.789 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:21:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:21:16] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:21:16.883 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:21:15.394932+0000 osd.7 (osd.7) 73 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:21:16.883 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:21:15.394990+0000 osd.7 (osd.7) 74 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:21:16.884 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:21:15.862412+0000 mon.a (mon.0) 879 : cluster [DBG] osdmap e118: 8 total, 8 up, 8 in 2024-02-10T08:21:17.152 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:21:15.394932+0000 osd.7 (osd.7) 73 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:21:17.153 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:21:15.394990+0000 osd.7 (osd.7) 74 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:21:17.153 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:21:15.862412+0000 mon.a (mon.0) 879 : cluster [DBG] osdmap e118: 8 total, 8 up, 8 in 2024-02-10T08:21:17.251 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 87 16 98964 98948 71.0369 39.625 0.0225607 0.0140717 2024-02-10T08:21:17.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:21:15.394932+0000 osd.7 (osd.7) 73 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:21:17.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:21:15.394990+0000 osd.7 (osd.7) 74 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:21:17.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:21:15.862412+0000 mon.a (mon.0) 879 : cluster [DBG] osdmap e118: 8 total, 8 up, 8 in 2024-02-10T08:21:17.408 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:21:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:21:17] "GET /metrics HTTP/1.1" 200 175524 "" "Prometheus/2.33.4" 2024-02-10T08:21:18.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:21:16.557965+0000 mgr.y (mgr.14505) 173 : cluster [DBG] pgmap v177: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 5.8 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 1022 B/s rd, 40 MiB/s wr, 638 op/s; 25000/288000 objects degraded (8.681%); 5.2 MiB/s, 83 objects/s recovering 2024-02-10T08:21:18.039 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:21:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:21:18.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:21:16.557965+0000 mgr.y (mgr.14505) 173 : cluster [DBG] pgmap v177: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 5.8 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 1022 B/s rd, 40 MiB/s wr, 638 op/s; 25000/288000 objects degraded (8.681%); 5.2 MiB/s, 83 objects/s recovering 2024-02-10T08:21:18.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:21:16.557965+0000 mgr.y (mgr.14505) 173 : cluster [DBG] pgmap v177: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 5.8 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 1022 B/s rd, 40 MiB/s wr, 638 op/s; 25000/288000 objects degraded (8.681%); 5.2 MiB/s, 83 objects/s recovering 2024-02-10T08:21:18.253 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 88 16 99639 99623 70.7084 42.1875 0.0192715 0.0141373 2024-02-10T08:21:19.156 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:21:19.206 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:21:17.680822+0000 mgr.y (mgr.14505) 174 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:21:19.207 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:21:17.680822+0000 mgr.y (mgr.14505) 174 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:21:19.210 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:19.210 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:21:19.253 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 89 16 100313 100297 70.3874 42.125 0.0233903 0.0142012 2024-02-10T08:21:19.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:21:17.680822+0000 mgr.y (mgr.14505) 174 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:21:19.312 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:21:19.405 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:19.889 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:21:19.897 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:19.898 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:21:19.999 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:21:20.029 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:20.048 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:21:20.051 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:20.051 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:21:20.152 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:21:20.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:21:18.558850+0000 mgr.y (mgr.14505) 175 : cluster [DBG] pgmap v178: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 6.1 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 1022 B/s rd, 41 MiB/s wr, 661 op/s; 24974/297999 objects degraded (8.381%); 5.3 MiB/s, 85 objects/s recovering 2024-02-10T08:21:20.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:21:18.558850+0000 mgr.y (mgr.14505) 175 : cluster [DBG] pgmap v178: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 6.1 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 1022 B/s rd, 41 MiB/s wr, 661 op/s; 24974/297999 objects degraded (8.381%); 5.3 MiB/s, 85 objects/s recovering 2024-02-10T08:21:20.183 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:21:18.558850+0000 mgr.y (mgr.14505) 175 : cluster [DBG] pgmap v178: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 6.1 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 1022 B/s rd, 41 MiB/s wr, 661 op/s; 24974/297999 objects degraded (8.381%); 5.3 MiB/s, 85 objects/s recovering 2024-02-10T08:21:20.186 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:20.206 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:21:20.209 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:20.209 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:21:20.253 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Total time run: 90.0082 2024-02-10T08:21:20.253 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Total writes made: 100925 2024-02-10T08:21:20.253 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Write size: 65536 2024-02-10T08:21:20.253 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Object size: 65536 2024-02-10T08:21:20.253 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Bandwidth (MB/sec): 70.0804 2024-02-10T08:21:20.253 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Stddev Bandwidth: 37.0896 2024-02-10T08:21:20.253 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Max bandwidth (MB/sec): 182.75 2024-02-10T08:21:20.253 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Min bandwidth (MB/sec): 0 2024-02-10T08:21:20.253 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Average IOPS: 1121 2024-02-10T08:21:20.253 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Stddev IOPS: 593.443 2024-02-10T08:21:20.253 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Max IOPS: 2924 2024-02-10T08:21:20.254 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Min IOPS: 0 2024-02-10T08:21:20.254 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Average Latency(s): 0.0142656 2024-02-10T08:21:20.254 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Stddev Latency(s): 0.0330057 2024-02-10T08:21:20.254 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Max latency(s): 2.58205 2024-02-10T08:21:20.254 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Min latency(s): 0.0013002 2024-02-10T08:21:20.259 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Cleaning up (deleting benchmark objects) 2024-02-10T08:21:20.310 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:21:20.343 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:20.368 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:21:20.373 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:20.373 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:21:20.474 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:21:20.503 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:20.521 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:21:20.524 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:20.524 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:21:20.625 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:21:20.658 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:20.682 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:21:20.686 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:20.686 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:21:20.773 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:21:20.787 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:21:20.863 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:21.031 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:21:21.049 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:21.050 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:21:21.151 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:21:21.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:21:20.411938+0000 mon.a (mon.0) 880 : cluster [WRN] Health check update: Degraded data redundancy: 24974/297999 objects degraded (8.381%), 5 pgs degraded (PG_DEGRADED) 2024-02-10T08:21:21.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:21:20.422785+0000 mon.a (mon.0) 881 : cluster [DBG] osdmap e119: 8 total, 8 up, 8 in 2024-02-10T08:21:21.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:21:20.411938+0000 mon.a (mon.0) 880 : cluster [WRN] Health check update: Degraded data redundancy: 24974/297999 objects degraded (8.381%), 5 pgs degraded (PG_DEGRADED) 2024-02-10T08:21:21.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:21:20.422785+0000 mon.a (mon.0) 881 : cluster [DBG] osdmap e119: 8 total, 8 up, 8 in 2024-02-10T08:21:21.272 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:21.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:21:20.411938+0000 mon.a (mon.0) 880 : cluster [WRN] Health check update: Degraded data redundancy: 24974/297999 objects degraded (8.381%), 5 pgs degraded (PG_DEGRADED) 2024-02-10T08:21:21.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:21:20.422785+0000 mon.a (mon.0) 881 : cluster [DBG] osdmap e119: 8 total, 8 up, 8 in 2024-02-10T08:21:21.551 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:21:21.558 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:21.559 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:21:21.660 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:21:21.690 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:21.712 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:21:21.714 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:21.715 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:21:21.816 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:21:21.849 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:21.872 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:21:21.876 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:21.877 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:21:21.977 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:21:21.984 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:21:20.559282+0000 mgr.y (mgr.14505) 176 : cluster [DBG] pgmap v180: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 6.1 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 639 B/s rd, 32 MiB/s wr, 513 op/s; 24974/297999 objects degraded (8.381%); 5.0 MiB/s, 80 objects/s recovering 2024-02-10T08:21:21.984 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:21:21.432272+0000 mon.b (mon.1) 43 : audit [INF] from='client.? 172.21.15.18:0/2223692474' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:21:21.984 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is unset 2024-02-10T08:21:22.073 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:22.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:21:20.559282+0000 mgr.y (mgr.14505) 176 : cluster [DBG] pgmap v180: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 6.1 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 639 B/s rd, 32 MiB/s wr, 513 op/s; 24974/297999 objects degraded (8.381%); 5.0 MiB/s, 80 objects/s recovering 2024-02-10T08:21:22.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:21:21.432272+0000 mon.b (mon.1) 43 : audit [INF] from='client.? 172.21.15.18:0/2223692474' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:21:22.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:21:21.435829+0000 mon.a (mon.0) 882 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:21:22.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:21:20.559282+0000 mgr.y (mgr.14505) 176 : cluster [DBG] pgmap v180: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 6.1 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 639 B/s rd, 32 MiB/s wr, 513 op/s; 24974/297999 objects degraded (8.381%); 5.0 MiB/s, 80 objects/s recovering 2024-02-10T08:21:22.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:21:21.432272+0000 mon.b (mon.1) 43 : audit [INF] from='client.? 172.21.15.18:0/2223692474' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:21:22.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:21:21.435829+0000 mon.a (mon.0) 882 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:21:22.192 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:21:22.201 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:22.202 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:21:22.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:21:21.435829+0000 mon.a (mon.0) 882 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:21:22.303 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:21:22.358 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:23.132 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:21:23.143 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:23.144 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:21:21.933737+0000 mon.a (mon.0) 883 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-10T08:21:23.144 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:21:21.948678+0000 mon.a (mon.0) 884 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-10T08:21:23.144 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:21:21.948752+0000 mon.a (mon.0) 885 : cluster [DBG] osdmap e120: 8 total, 8 up, 8 in 2024-02-10T08:21:23.144 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:21:21.933737+0000 mon.a (mon.0) 883 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-10T08:21:23.144 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:21:21.948678+0000 mon.a (mon.0) 884 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-10T08:21:23.145 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:21:21.948752+0000 mon.a (mon.0) 885 : cluster [DBG] osdmap e120: 8 total, 8 up, 8 in 2024-02-10T08:21:23.145 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:21:23.246 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:21:23.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:21:21.933737+0000 mon.a (mon.0) 883 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-10T08:21:23.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:21:21.948678+0000 mon.a (mon.0) 884 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-10T08:21:23.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:21:21.948752+0000 mon.a (mon.0) 885 : cluster [DBG] osdmap e120: 8 total, 8 up, 8 in 2024-02-10T08:21:23.323 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:23.383 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:21:23.388 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:23.389 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:21:23.489 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:21:23.523 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:23.547 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:21:23.550 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:23.551 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:21:23.652 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:21:23.681 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:23.705 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:21:23.707 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:23.708 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:21:23.809 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:21:23.919 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:24.013 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:21:24.033 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:24.034 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:21:24.134 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:21:24.214 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:21:22.559855+0000 mgr.y (mgr.14505) 177 : cluster [DBG] pgmap v182: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 6.1 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 1.6 KiB/s rd, 42 MiB/s wr, 810 op/s; 25028/298713 objects degraded (8.379%); 3.9 MiB/s, 63 objects/s recovering 2024-02-10T08:21:24.215 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:21:22.559855+0000 mgr.y (mgr.14505) 177 : cluster [DBG] pgmap v182: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 6.1 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 1.6 KiB/s rd, 42 MiB/s wr, 810 op/s; 25028/298713 objects degraded (8.379%); 3.9 MiB/s, 63 objects/s recovering 2024-02-10T08:21:24.215 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:24.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:21:22.559855+0000 mgr.y (mgr.14505) 177 : cluster [DBG] pgmap v182: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 6.1 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 1.6 KiB/s rd, 42 MiB/s wr, 810 op/s; 25028/298713 objects degraded (8.379%); 3.9 MiB/s, 63 objects/s recovering 2024-02-10T08:21:24.387 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:21:24.391 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:24.391 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:21:24.492 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:21:24.522 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:24.548 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:21:24.551 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:24.551 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:21:24.652 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:21:24.734 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:25.063 INFO:teuthology.orchestra.run.smithi018.stderr:set pool 4 pgp_num to 32 2024-02-10T08:21:25.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:21:24.191753+0000 mon.c (mon.2) 29 : audit [INF] from='client.? 172.21.15.18:0/4224867421' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.log", "var": "pgp_num", "val": "32"}]: dispatch 2024-02-10T08:21:25.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:21:24.192431+0000 mon.a (mon.0) 886 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.log", "var": "pgp_num", "val": "32"}]: dispatch 2024-02-10T08:21:25.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:21:24.191753+0000 mon.c (mon.2) 29 : audit [INF] from='client.? 172.21.15.18:0/4224867421' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.log", "var": "pgp_num", "val": "32"}]: dispatch 2024-02-10T08:21:25.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:21:24.192431+0000 mon.a (mon.0) 886 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.log", "var": "pgp_num", "val": "32"}]: dispatch 2024-02-10T08:21:25.422 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:21:25.427 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:25.428 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:21:25.528 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:21:25.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:21:24.191753+0000 mon.c (mon.2) 29 : audit [INF] from='client.? 172.21.15.18:0/4224867421' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.log", "var": "pgp_num", "val": "32"}]: dispatch 2024-02-10T08:21:25.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:21:24.192431+0000 mon.a (mon.0) 886 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.log", "var": "pgp_num", "val": "32"}]: dispatch 2024-02-10T08:21:25.566 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:25.596 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:21:25.600 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:25.600 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:21:25.633 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:21:25.633 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:21:25.633 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:21:25.633 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:21:25.633 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:21:25.633 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:21:25.633 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:21:25.633 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:21:25.634 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-10T08:21:25.634 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-10T08:21:25.634 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-10T08:21:25.634 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-10T08:21:25.634 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-10T08:21:25.634 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-10T08:21:25.634 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-10T08:21:25.634 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-10T08:21:25.701 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:21:25.762 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:25.818 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:21:25.822 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:25.823 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:21:25.924 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:21:25.958 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:25.983 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:21:25.989 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:25.989 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:21:26.056 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:21:24.560404+0000 mgr.y (mgr.14505) 178 : cluster [DBG] pgmap v183: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 6.1 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 1.4 KiB/s rd, 40 MiB/s wr, 828 op/s; 24579/298851 objects degraded (8.224%); 6.8 MiB/s, 108 objects/s recovering 2024-02-10T08:21:26.056 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:21:25.023761+0000 mon.a (mon.0) 887 : audit [DBG] from='client.? 172.21.15.18:0/1929208763' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:21:26.056 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:21:25.035428+0000 mon.a (mon.0) 888 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.log", "var": "pgp_num", "val": "32"}]': finished 2024-02-10T08:21:26.090 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:21:26.122 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:26.151 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:21:26.156 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:26.156 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:21:26.257 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:21:26.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:21:24.560404+0000 mgr.y (mgr.14505) 178 : cluster [DBG] pgmap v183: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 6.1 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 1.4 KiB/s rd, 40 MiB/s wr, 828 op/s; 24579/298851 objects degraded (8.224%); 6.8 MiB/s, 108 objects/s recovering 2024-02-10T08:21:26.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:21:25.023761+0000 mon.a (mon.0) 887 : audit [DBG] from='client.? 172.21.15.18:0/1929208763' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:21:26.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:21:25.035428+0000 mon.a (mon.0) 888 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.log", "var": "pgp_num", "val": "32"}]': finished 2024-02-10T08:21:26.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:21:25.035498+0000 mon.a (mon.0) 889 : cluster [DBG] osdmap e121: 8 total, 8 up, 8 in 2024-02-10T08:21:26.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:21:25.419889+0000 mon.a (mon.0) 890 : cluster [WRN] Health check update: Degraded data redundancy: 24579/298851 objects degraded (8.224%), 5 pgs degraded (PG_DEGRADED) 2024-02-10T08:21:26.334 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:21:25.035498+0000 mon.a (mon.0) 889 : cluster [DBG] osdmap e121: 8 total, 8 up, 8 in 2024-02-10T08:21:26.335 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:21:25.419889+0000 mon.a (mon.0) 890 : cluster [WRN] Health check update: Degraded data redundancy: 24579/298851 objects degraded (8.224%), 5 pgs degraded (PG_DEGRADED) 2024-02-10T08:21:26.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:21:24.560404+0000 mgr.y (mgr.14505) 178 : cluster [DBG] pgmap v183: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 6.1 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 1.4 KiB/s rd, 40 MiB/s wr, 828 op/s; 24579/298851 objects degraded (8.224%); 6.8 MiB/s, 108 objects/s recovering 2024-02-10T08:21:26.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:21:25.023761+0000 mon.a (mon.0) 887 : audit [DBG] from='client.? 172.21.15.18:0/1929208763' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:21:26.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:21:25.035428+0000 mon.a (mon.0) 888 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.log", "var": "pgp_num", "val": "32"}]': finished 2024-02-10T08:21:26.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:21:25.035498+0000 mon.a (mon.0) 889 : cluster [DBG] osdmap e121: 8 total, 8 up, 8 in 2024-02-10T08:21:26.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:21:25.419889+0000 mon.a (mon.0) 890 : cluster [WRN] Health check update: Degraded data redundancy: 24579/298851 objects degraded (8.224%), 5 pgs degraded (PG_DEGRADED) 2024-02-10T08:21:26.349 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:26.422 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd set noscrub 2024-02-10T08:21:26.789 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:21:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:21:26] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:21:27.087 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:21:26.561438+0000 mgr.y (mgr.14505) 179 : cluster [DBG] pgmap v185: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 6.1 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 1000 B/s rd, 18 MiB/s wr, 536 op/s; 24579/298851 objects degraded (8.224%); 4.6 MiB/s, 73 objects/s recovering 2024-02-10T08:21:27.341 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:21:27.346 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:21:26.561438+0000 mgr.y (mgr.14505) 179 : cluster [DBG] pgmap v185: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 6.1 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 1000 B/s rd, 18 MiB/s wr, 536 op/s; 24579/298851 objects degraded (8.224%); 4.6 MiB/s, 73 objects/s recovering 2024-02-10T08:21:27.346 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:27.347 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:21:27.347 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:21:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:21:27] "GET /metrics HTTP/1.1" 200 175524 "" "Prometheus/2.33.4" 2024-02-10T08:21:27.448 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:21:27.449 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-02-10T08:21:27.449 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-02-10T08:21:27.450 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-02-10T08:21:27.450 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-02-10T08:21:27.450 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-02-10T08:21:27.482 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:21:26.561438+0000 mgr.y (mgr.14505) 179 : cluster [DBG] pgmap v185: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 6.1 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 1000 B/s rd, 18 MiB/s wr, 536 op/s; 24579/298851 objects degraded (8.224%); 4.6 MiB/s, 73 objects/s recovering 2024-02-10T08:21:27.485 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:27.507 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:21:27.512 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:27.512 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:21:27.613 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:21:27.647 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:27.669 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:21:27.672 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:27.672 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:21:27.773 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:21:27.790 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:21:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:21:27.807 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:27.829 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:21:27.832 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:27.833 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:21:27.933 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:21:27.961 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:27.986 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:21:27.989 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:27.990 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:21:28.091 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:21:28.123 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:28.143 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:21:28.148 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:28.148 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:21:28.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:21:27.694519+0000 mgr.y (mgr.14505) 180 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:21:28.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:21:27.694519+0000 mgr.y (mgr.14505) 180 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:21:28.249 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:21:28.258 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.3 dump_historic_ops 2024-02-10T08:21:28.321 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:21:28.350 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:28.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:21:27.694519+0000 mgr.y (mgr.14505) 180 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:21:28.739 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:21:28.747 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:28.747 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:21:28.848 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:21:28.880 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:28.902 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:21:28.908 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:28.908 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:21:29.009 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:21:29.037 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:29.062 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:21:29.066 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:29.067 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:21:29.168 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:21:29.199 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:21:28.562504+0000 mgr.y (mgr.14505) 181 : cluster [DBG] pgmap v186: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 5.9 GiB data, 19 GiB used, 697 GiB / 715 GiB avail; 1.4 KiB/s rd, 14 MiB/s wr, 820 op/s; 23660/289050 objects degraded (8.185%); 7.2 MiB/s, 114 objects/s recovering 2024-02-10T08:21:29.201 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:29.225 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:21:29.229 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:29.230 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:21:29.317 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-10T08:21:29.330 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:21:29.392 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:21:28.562504+0000 mgr.y (mgr.14505) 181 : cluster [DBG] pgmap v186: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 5.9 GiB data, 19 GiB used, 697 GiB / 715 GiB avail; 1.4 KiB/s rd, 14 MiB/s wr, 820 op/s; 23660/289050 objects degraded (8.185%); 7.2 MiB/s, 114 objects/s recovering 2024-02-10T08:21:29.392 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:21:28.562504+0000 mgr.y (mgr.14505) 181 : cluster [DBG] pgmap v186: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 5.9 GiB data, 19 GiB used, 697 GiB / 715 GiB avail; 1.4 KiB/s rd, 14 MiB/s wr, 820 op/s; 23660/289050 objects degraded (8.185%); 7.2 MiB/s, 114 objects/s recovering 2024-02-10T08:21:29.437 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:30.195 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:21:30.249 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:21:30.252 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:30.252 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:21:30.353 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:21:30.422 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:30.525 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:21:30.536 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:30.536 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:21:30.637 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:21:30.667 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:30.691 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:21:30.696 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:30.697 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:21:30.797 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:21:30.837 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:30.863 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:21:30.867 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:30.868 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:21:30.969 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:21:31.024 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:31.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:21:29.802921+0000 osd.6 (osd.6) 47 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:21:31.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:21:29.802978+0000 osd.6 (osd.6) 48 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:21:31.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:21:30.120337+0000 mon.a (mon.0) 891 : cluster [DBG] osdmap e122: 8 total, 8 up, 8 in 2024-02-10T08:21:31.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:21:30.440602+0000 mon.a (mon.0) 892 : cluster [WRN] Health check update: Degraded data redundancy: 23660/289050 objects degraded (8.185%), 5 pgs degraded (PG_DEGRADED) 2024-02-10T08:21:31.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:21:30.458320+0000 mon.a (mon.0) 893 : cluster [DBG] osdmap e123: 8 total, 8 up, 8 in 2024-02-10T08:21:31.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:21:30.564624+0000 mgr.y (mgr.14505) 182 : cluster [DBG] pgmap v189: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 5.9 GiB data, 19 GiB used, 697 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 544 op/s; 23660/289050 objects degraded (8.185%); 4.9 MiB/s, 78 objects/s recovering 2024-02-10T08:21:31.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:21:29.802921+0000 osd.6 (osd.6) 47 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:21:31.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:21:29.802978+0000 osd.6 (osd.6) 48 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:21:31.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:21:30.120337+0000 mon.a (mon.0) 891 : cluster [DBG] osdmap e122: 8 total, 8 up, 8 in 2024-02-10T08:21:31.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:21:30.440602+0000 mon.a (mon.0) 892 : cluster [WRN] Health check update: Degraded data redundancy: 23660/289050 objects degraded (8.185%), 5 pgs degraded (PG_DEGRADED) 2024-02-10T08:21:31.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:21:30.458320+0000 mon.a (mon.0) 893 : cluster [DBG] osdmap e123: 8 total, 8 up, 8 in 2024-02-10T08:21:31.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:21:30.564624+0000 mgr.y (mgr.14505) 182 : cluster [DBG] pgmap v189: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 5.9 GiB data, 19 GiB used, 697 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 544 op/s; 23660/289050 objects degraded (8.185%); 4.9 MiB/s, 78 objects/s recovering 2024-02-10T08:21:31.287 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:21:31.319 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:21:31.331 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:31.331 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:21:31.334 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 5, 6, 7, 4] 2024-02-10T08:21:31.334 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-10T08:21:31.334 INFO:tasks.thrashosds.thrasher:Growing pool default.rgw.meta 2024-02-10T08:21:31.335 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph pg dump --format=json 2024-02-10T08:21:31.433 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:21:31.462 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:21:29.802921+0000 osd.6 (osd.6) 47 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:21:31.462 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:21:29.802978+0000 osd.6 (osd.6) 48 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:21:31.462 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:21:30.120337+0000 mon.a (mon.0) 891 : cluster [DBG] osdmap e122: 8 total, 8 up, 8 in 2024-02-10T08:21:31.462 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:21:30.440602+0000 mon.a (mon.0) 892 : cluster [WRN] Health check update: Degraded data redundancy: 23660/289050 objects degraded (8.185%), 5 pgs degraded (PG_DEGRADED) 2024-02-10T08:21:31.462 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:21:30.458320+0000 mon.a (mon.0) 893 : cluster [DBG] osdmap e123: 8 total, 8 up, 8 in 2024-02-10T08:21:31.462 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:21:30.564624+0000 mgr.y (mgr.14505) 182 : cluster [DBG] pgmap v189: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 5.9 GiB data, 19 GiB used, 697 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 544 op/s; 23660/289050 objects degraded (8.185%); 4.9 MiB/s, 78 objects/s recovering 2024-02-10T08:21:31.464 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:31.489 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:21:31.492 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:31.492 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:21:31.593 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:21:31.626 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:31.645 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:21:31.647 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:31.648 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:21:31.748 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:21:31.777 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:31.805 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:21:31.810 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:31.811 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:21:31.911 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:21:31.988 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:32.132 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:21:32.134 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:32.135 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:21:32.236 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:21:32.378 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:32.644 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:21:31.616524+0000 mon.a (mon.0) 894 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:21:32.644 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:21:32.349157+0000 mon.b (mon.1) 44 : audit [INF] from='client.? 172.21.15.18:0/389107673' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:21:32.644 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:21:32.351233+0000 mon.a (mon.0) 895 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:21:32.656 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:21:32.661 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:32.662 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:21:32.673 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is set 2024-02-10T08:21:32.763 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:21:32.793 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:32.819 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:21:32.826 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:32.826 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:21:32.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:21:31.616524+0000 mon.a (mon.0) 894 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:21:32.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:21:32.349157+0000 mon.b (mon.1) 44 : audit [INF] from='client.? 172.21.15.18:0/389107673' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:21:32.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:21:32.351233+0000 mon.a (mon.0) 895 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:21:32.928 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:21:33.012 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:33.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:21:31.616524+0000 mon.a (mon.0) 894 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:21:33.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:21:32.349157+0000 mon.b (mon.1) 44 : audit [INF] from='client.? 172.21.15.18:0/389107673' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:21:33.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:21:32.351233+0000 mon.a (mon.0) 895 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:21:33.147 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:21:33.151 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:33.152 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:21:33.256 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:21:33.287 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:33.308 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:21:33.312 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:33.312 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:21:33.333 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-02-10T08:21:33.334 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-02-10T08:21:33.334 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-02-10T08:21:33.334 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-02-10T08:21:33.334 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.334 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.24299.0:672 5.0 5:05bf5b68:::notify.1:head [watch reconnect cookie 94587203960832 gen 1] snapc 0=[] ondisk+write+known_if_redirected e88)", 2024-02-10T08:21:33.334 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:19:30.798269+0000", 2024-02-10T08:21:33.334 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 122.530628896, 2024-02-10T08:21:33.334 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.019838426, 2024-02-10T08:21:33.334 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:21:33.334 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-02-10T08:21:33.334 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:21:33.334 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.24299", 2024-02-10T08:21:33.334 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/871408063", 2024-02-10T08:21:33.335 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 672 2024-02-10T08:21:33.335 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.335 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:21:33.335 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.335 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:21:33.335 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:30.798269+0000", 2024-02-10T08:21:33.335 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:21:33.335 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.336 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.336 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:21:33.336 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:30.798269+0000", 2024-02-10T08:21:33.336 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999971 2024-02-10T08:21:33.336 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.336 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.336 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:21:33.336 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:30.798266+0000", 2024-02-10T08:21:33.336 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3550999999999999e-05 2024-02-10T08:21:33.336 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.336 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.336 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:21:33.336 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:30.798290+0000", 2024-02-10T08:21:33.336 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3221e-05 2024-02-10T08:21:33.337 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.337 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.337 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:21:33.337 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:30.798313+0000", 2024-02-10T08:21:33.337 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1939e-05 2024-02-10T08:21:33.337 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.337 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.337 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:21:33.337 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:30.798325+0000", 2024-02-10T08:21:33.337 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1451000000000004e-05 2024-02-10T08:21:33.337 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.338 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.338 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:21:33.338 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:30.798396+0000", 2024-02-10T08:21:33.338 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6050000000000003e-06 2024-02-10T08:21:33.338 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.338 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.338 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op must wait for map", 2024-02-10T08:21:33.338 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:30.798403+0000", 2024-02-10T08:21:33.338 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0076789980000000002 2024-02-10T08:21:33.338 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.338 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.338 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:21:33.338 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:30.806082+0000", 2024-02-10T08:21:33.338 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9099999999999994e-06 2024-02-10T08:21:33.339 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.339 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.339 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:21:33.339 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:30.806091+0000", 2024-02-10T08:21:33.339 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.99968515000000002 2024-02-10T08:21:33.339 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.339 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.339 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:21:33.339 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:31.805776+0000", 2024-02-10T08:21:33.339 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015864300000000001 2024-02-10T08:21:33.339 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.339 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.339 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:21:33.339 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:31.805935+0000", 2024-02-10T08:21:33.340 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.012172792 2024-02-10T08:21:33.340 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.340 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.340 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:21:33.340 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:31.818108+0000", 2024-02-10T08:21:33.340 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.019838426 2024-02-10T08:21:33.340 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:21:33.340 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:21:33.340 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:21:33.340 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.341 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.341 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.24299.0:679 5.0 5:05bf5b68:::notify.1:head [watch ping cookie 94587203960832 gen 1] snapc 0=[] ondisk+write+known_if_redirected e88)", 2024-02-10T08:21:33.341 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:19:30.927547+0000", 2024-02-10T08:21:33.341 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 122.4013511, 2024-02-10T08:21:33.341 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.878864019, 2024-02-10T08:21:33.341 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:21:33.341 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-02-10T08:21:33.341 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:21:33.341 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.24299", 2024-02-10T08:21:33.341 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/871408063", 2024-02-10T08:21:33.341 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 679 2024-02-10T08:21:33.341 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.341 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:21:33.341 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.342 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:21:33.342 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:30.927547+0000", 2024-02-10T08:21:33.342 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:21:33.342 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.342 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.342 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:21:33.342 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:30.927547+0000", 2024-02-10T08:21:33.342 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999981 2024-02-10T08:21:33.342 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.343 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.343 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:21:33.343 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:30.927545+0000", 2024-02-10T08:21:33.343 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8460000000000003e-06 2024-02-10T08:21:33.343 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.343 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.343 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:21:33.343 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:30.927555+0000", 2024-02-10T08:21:33.343 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9910000000000001e-05 2024-02-10T08:21:33.343 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.343 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.344 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:21:33.344 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:30.927575+0000", 2024-02-10T08:21:33.344 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8234000000000001e-05 2024-02-10T08:21:33.344 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.344 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.344 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:21:33.344 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:30.927603+0000", 2024-02-10T08:21:33.344 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1118999999999995e-05 2024-02-10T08:21:33.344 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.344 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.344 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:21:33.344 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:30.927664+0000", 2024-02-10T08:21:33.344 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2609999999999993e-06 2024-02-10T08:21:33.344 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.345 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.345 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:21:33.345 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:30.927672+0000", 2024-02-10T08:21:33.345 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.87856715900000004 2024-02-10T08:21:33.345 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.345 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.345 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:21:33.345 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:31.806240+0000", 2024-02-10T08:21:33.345 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5648000000000005e-05 2024-02-10T08:21:33.345 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.345 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.345 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:21:33.345 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:31.806315+0000", 2024-02-10T08:21:33.345 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5744999999999999e-05 2024-02-10T08:21:33.345 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.346 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.346 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:21:33.346 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:31.806411+0000", 2024-02-10T08:21:33.346 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.878864019 2024-02-10T08:21:33.346 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:21:33.346 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:21:33.346 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:21:33.346 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.347 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.347 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:29649 7.2 7:4493dc73:::benchmark_data_smithi018_80623_object29648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e96)", 2024-02-10T08:21:33.347 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:03.385646+0000", 2024-02-10T08:21:33.347 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 89.943252146000006, 2024-02-10T08:21:33.347 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.101875721, 2024-02-10T08:21:33.347 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:21:33.347 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:21:33.347 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:21:33.347 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:21:33.348 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:21:33.348 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 29649 2024-02-10T08:21:33.348 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.348 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:21:33.348 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.348 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:21:33.348 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.385646+0000", 2024-02-10T08:21:33.348 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:21:33.348 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.348 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.348 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:21:33.348 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.385646+0000", 2024-02-10T08:21:33.348 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:21:33.349 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.349 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.349 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:21:33.349 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.385644+0000", 2024-02-10T08:21:33.349 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.4049999999999998e-05 2024-02-10T08:21:33.349 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.349 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.349 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:21:33.349 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.385668+0000", 2024-02-10T08:21:33.349 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1548e-05 2024-02-10T08:21:33.349 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.350 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.350 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:21:33.350 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.385680+0000", 2024-02-10T08:21:33.350 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5130000000000002e-06 2024-02-10T08:21:33.350 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.350 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.350 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:21:33.350 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.385686+0000", 2024-02-10T08:21:33.350 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000129665 2024-02-10T08:21:33.350 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.351 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.351 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:21:33.351 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.385816+0000", 2024-02-10T08:21:33.351 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000121935 2024-02-10T08:21:33.351 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.351 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.351 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:21:33.351 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.385938+0000", 2024-02-10T08:21:33.351 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001199203 2024-02-10T08:21:33.351 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.351 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.351 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1,2", 2024-02-10T08:21:33.351 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.387137+0000", 2024-02-10T08:21:33.352 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.099128972999999995 2024-02-10T08:21:33.352 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.352 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.352 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:21:33.352 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.486266+0000", 2024-02-10T08:21:33.352 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010999709999999999 2024-02-10T08:21:33.352 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.352 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.353 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:21:33.353 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.487366+0000", 2024-02-10T08:21:33.353 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1018000000000002e-05 2024-02-10T08:21:33.353 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.353 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.353 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:21:33.353 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.487457+0000", 2024-02-10T08:21:33.353 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3683000000000003e-05 2024-02-10T08:21:33.353 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.353 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.354 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:21:33.354 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.487491+0000", 2024-02-10T08:21:33.354 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0655999999999999e-05 2024-02-10T08:21:33.354 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.354 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.354 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:21:33.354 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.487522+0000", 2024-02-10T08:21:33.354 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.101875721 2024-02-10T08:21:33.354 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:21:33.354 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:21:33.354 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:21:33.354 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.354 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.354 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:29650 7.a 7:5b1dc048:::benchmark_data_smithi018_80623_object29649:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e96)", 2024-02-10T08:21:33.354 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:03.385714+0000", 2024-02-10T08:21:33.355 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 89.943184165999995, 2024-02-10T08:21:33.355 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.101736045, 2024-02-10T08:21:33.355 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:21:33.355 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:21:33.355 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:21:33.355 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:21:33.355 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:21:33.355 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 29650 2024-02-10T08:21:33.355 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.355 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:21:33.355 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.355 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:21:33.355 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.385714+0000", 2024-02-10T08:21:33.355 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:21:33.355 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.356 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.356 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:21:33.356 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.385714+0000", 2024-02-10T08:21:33.356 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:21:33.356 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.356 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.356 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:21:33.356 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.385713+0000", 2024-02-10T08:21:33.356 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1231000000000001e-05 2024-02-10T08:21:33.356 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.356 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.356 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:21:33.356 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.385734+0000", 2024-02-10T08:21:33.356 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3069999999999997e-06 2024-02-10T08:21:33.357 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.357 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.357 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:21:33.357 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.385742+0000", 2024-02-10T08:21:33.357 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.724e-06 2024-02-10T08:21:33.357 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.357 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.357 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:21:33.357 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.385746+0000", 2024-02-10T08:21:33.357 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4610000000000004e-05 2024-02-10T08:21:33.357 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.357 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.357 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:21:33.357 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.385841+0000", 2024-02-10T08:21:33.358 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000121997 2024-02-10T08:21:33.358 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.358 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.358 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:21:33.358 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.385963+0000", 2024-02-10T08:21:33.358 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012458900000000001 2024-02-10T08:21:33.358 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.358 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.358 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 2,5", 2024-02-10T08:21:33.358 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.386088+0000", 2024-02-10T08:21:33.358 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0022443770000000001 2024-02-10T08:21:33.358 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.359 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.359 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:21:33.359 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.388332+0000", 2024-02-10T08:21:33.359 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.097902377999999998 2024-02-10T08:21:33.359 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.359 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.359 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:21:33.359 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.486234+0000", 2024-02-10T08:21:33.359 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0011412320000000001 2024-02-10T08:21:33.359 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.359 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.359 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:21:33.359 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.487376+0000", 2024-02-10T08:21:33.359 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.019e-05 2024-02-10T08:21:33.359 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.360 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.360 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:21:33.360 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.487416+0000", 2024-02-10T08:21:33.360 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4168999999999998e-05 2024-02-10T08:21:33.360 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.360 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.360 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:21:33.360 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.487450+0000", 2024-02-10T08:21:33.360 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.101736045 2024-02-10T08:21:33.360 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:21:33.360 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:21:33.360 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:21:33.360 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.360 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.360 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:29651 7.3 7:ccbe6b35:::benchmark_data_smithi018_80623_object29650:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e96)", 2024-02-10T08:21:33.361 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:03.385752+0000", 2024-02-10T08:21:33.361 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 89.943145783000006, 2024-02-10T08:21:33.361 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.10009203999999999, 2024-02-10T08:21:33.361 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:21:33.361 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:21:33.361 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:21:33.361 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:21:33.361 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:21:33.361 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 29651 2024-02-10T08:21:33.361 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.361 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:21:33.361 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.361 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:21:33.361 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.385752+0000", 2024-02-10T08:21:33.361 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:21:33.362 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.362 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.362 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:21:33.362 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.385752+0000", 2024-02-10T08:21:33.362 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:21:33.362 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.362 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.362 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:21:33.362 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.385752+0000", 2024-02-10T08:21:33.362 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0015999999999999e-05 2024-02-10T08:21:33.362 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.362 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.362 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:21:33.362 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.385772+0000", 2024-02-10T08:21:33.362 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8220000000000001e-06 2024-02-10T08:21:33.363 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.363 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.363 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:21:33.363 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.385778+0000", 2024-02-10T08:21:33.363 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9400000000000001e-06 2024-02-10T08:21:33.364 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.364 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.364 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:21:33.364 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.385783+0000", 2024-02-10T08:21:33.364 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00026216199999999997 2024-02-10T08:21:33.364 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.364 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.364 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:21:33.364 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.386045+0000", 2024-02-10T08:21:33.364 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5407000000000003e-05 2024-02-10T08:21:33.365 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.365 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.365 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:21:33.365 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.386141+0000", 2024-02-10T08:21:33.365 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000114066 2024-02-10T08:21:33.365 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.365 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.365 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 2", 2024-02-10T08:21:33.365 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.386255+0000", 2024-02-10T08:21:33.365 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.098175977999999997 2024-02-10T08:21:33.365 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.365 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.365 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:21:33.365 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.484431+0000", 2024-02-10T08:21:33.365 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00127709 2024-02-10T08:21:33.366 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.366 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.366 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:21:33.366 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.485708+0000", 2024-02-10T08:21:33.366 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5793e-05 2024-02-10T08:21:33.366 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.366 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.366 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:21:33.366 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.485754+0000", 2024-02-10T08:21:33.366 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0465999999999997e-05 2024-02-10T08:21:33.366 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.366 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.366 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:21:33.366 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.485844+0000", 2024-02-10T08:21:33.366 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.10009203999999999 2024-02-10T08:21:33.367 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:21:33.367 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:21:33.367 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:21:33.367 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.367 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.367 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:29655 7.1 7:868ebe2c:::benchmark_data_smithi018_80623_object29654:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e96)", 2024-02-10T08:21:33.367 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:03.386018+0000", 2024-02-10T08:21:33.367 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 89.942880196999994, 2024-02-10T08:21:33.367 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.099118429999999993, 2024-02-10T08:21:33.367 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:21:33.367 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:21:33.367 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:21:33.367 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:21:33.367 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:21:33.367 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 29655 2024-02-10T08:21:33.368 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.368 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:21:33.368 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.368 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:21:33.368 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.386018+0000", 2024-02-10T08:21:33.368 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:21:33.368 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.368 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.368 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:21:33.368 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.386018+0000", 2024-02-10T08:21:33.368 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:21:33.368 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.368 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.368 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:21:33.369 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.386017+0000", 2024-02-10T08:21:33.369 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1338999999999998e-05 2024-02-10T08:21:33.369 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.369 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.369 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:21:33.369 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.386058+0000", 2024-02-10T08:21:33.369 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0569999999999999e-06 2024-02-10T08:21:33.369 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.369 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.369 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:21:33.369 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.386067+0000", 2024-02-10T08:21:33.370 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5309999999999998e-06 2024-02-10T08:21:33.370 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.370 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.370 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:21:33.370 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.386074+0000", 2024-02-10T08:21:33.370 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0012513610000000001 2024-02-10T08:21:33.370 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.370 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.370 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:21:33.370 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.387325+0000", 2024-02-10T08:21:33.370 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000108404 2024-02-10T08:21:33.370 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.370 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.371 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:21:33.371 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.387434+0000", 2024-02-10T08:21:33.371 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013600400000000001 2024-02-10T08:21:33.371 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.371 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.371 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 6", 2024-02-10T08:21:33.371 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.387570+0000", 2024-02-10T08:21:33.371 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.097056086 2024-02-10T08:21:33.371 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.371 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.371 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:21:33.371 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.484626+0000", 2024-02-10T08:21:33.371 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00036365300000000002 2024-02-10T08:21:33.371 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.371 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.372 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:21:33.372 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.484989+0000", 2024-02-10T08:21:33.372 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4522000000000003e-05 2024-02-10T08:21:33.372 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.372 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.372 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:21:33.372 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.485054+0000", 2024-02-10T08:21:33.372 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2381999999999998e-05 2024-02-10T08:21:33.372 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.372 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.372 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:21:33.372 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.485136+0000", 2024-02-10T08:21:33.372 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.099118429999999993 2024-02-10T08:21:33.372 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:21:33.373 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:21:33.373 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:21:33.373 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.373 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.373 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.14784.0:29654 7.c e96/91 7:3f3ccd71:::benchmark_data_smithi018_80623_object29653:head v 96'1898, mlcod=96'1896)", 2024-02-10T08:21:33.373 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:03.387784+0000", 2024-02-10T08:21:33.373 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 89.941114025000005, 2024-02-10T08:21:33.373 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.098473966999999996, 2024-02-10T08:21:33.373 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:21:33.373 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:21:33.373 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:21:33.373 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.373 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:21:33.374 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.387784+0000", 2024-02-10T08:21:33.374 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:21:33.374 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.374 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.374 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:21:33.374 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.387784+0000", 2024-02-10T08:21:33.374 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:21:33.374 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.374 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.374 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:21:33.375 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.387783+0000", 2024-02-10T08:21:33.375 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9694000000000003e-05 2024-02-10T08:21:33.375 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.375 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.375 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:21:33.375 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.387823+0000", 2024-02-10T08:21:33.375 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1661999999999999e-05 2024-02-10T08:21:33.375 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.375 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.375 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:21:33.375 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.387835+0000", 2024-02-10T08:21:33.375 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4920000000000001e-06 2024-02-10T08:21:33.375 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.375 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.375 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:21:33.376 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.387840+0000", 2024-02-10T08:21:33.376 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.261e-05 2024-02-10T08:21:33.376 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.376 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.376 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:21:33.376 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.387883+0000", 2024-02-10T08:21:33.376 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.278e-05 2024-02-10T08:21:33.376 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.376 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.376 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:21:33.376 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.387895+0000", 2024-02-10T08:21:33.376 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.098339181999999997 2024-02-10T08:21:33.376 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.376 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.376 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:21:33.377 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.486235+0000", 2024-02-10T08:21:33.377 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3314000000000001e-05 2024-02-10T08:21:33.377 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.377 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.377 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:21:33.377 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.486258+0000", 2024-02-10T08:21:33.377 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.098473966999999996 2024-02-10T08:21:33.377 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:21:33.377 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:21:33.377 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:21:33.377 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.377 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.377 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:29657 7.3 7:cb3f2498:::benchmark_data_smithi018_80623_object29656:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e96)", 2024-02-10T08:21:33.378 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:03.388325+0000", 2024-02-10T08:21:33.378 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 89.940572599000006, 2024-02-10T08:21:33.378 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.099903744000000003, 2024-02-10T08:21:33.378 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:21:33.378 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:21:33.378 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:21:33.378 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:21:33.378 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:21:33.378 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 29657 2024-02-10T08:21:33.378 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.378 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:21:33.378 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.378 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:21:33.379 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.388325+0000", 2024-02-10T08:21:33.379 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:21:33.379 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.379 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.379 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:21:33.379 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.388325+0000", 2024-02-10T08:21:33.379 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:21:33.379 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.379 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.379 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:21:33.379 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.388324+0000", 2024-02-10T08:21:33.379 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0960000000000002e-05 2024-02-10T08:21:33.379 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.379 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.379 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:21:33.380 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.388355+0000", 2024-02-10T08:21:33.380 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0456e-05 2024-02-10T08:21:33.380 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.380 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.380 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:21:33.380 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.388365+0000", 2024-02-10T08:21:33.380 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8329999999999999e-06 2024-02-10T08:21:33.380 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.380 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.380 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:21:33.380 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.388371+0000", 2024-02-10T08:21:33.380 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2771000000000001e-05 2024-02-10T08:21:33.380 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.380 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.381 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:21:33.381 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.388414+0000", 2024-02-10T08:21:33.381 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8628999999999994e-05 2024-02-10T08:21:33.381 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.381 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.381 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:21:33.381 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.388513+0000", 2024-02-10T08:21:33.381 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000138281 2024-02-10T08:21:33.381 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.381 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.381 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 2", 2024-02-10T08:21:33.381 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.388651+0000", 2024-02-10T08:21:33.381 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.095787248000000005 2024-02-10T08:21:33.381 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.381 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.382 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:21:33.382 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.484438+0000", 2024-02-10T08:21:33.382 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0036706299999999998 2024-02-10T08:21:33.382 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.382 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.382 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:21:33.382 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.488109+0000", 2024-02-10T08:21:33.382 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0945000000000002e-05 2024-02-10T08:21:33.382 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.382 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.382 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:21:33.382 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.488150+0000", 2024-02-10T08:21:33.382 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9522000000000002e-05 2024-02-10T08:21:33.382 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.382 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.383 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:21:33.383 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.488229+0000", 2024-02-10T08:21:33.383 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.099903744000000003 2024-02-10T08:21:33.383 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:21:33.383 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:21:33.383 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:21:33.383 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.383 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.383 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop_reply(client.14784.0:29655 7.1 e96/91 ondisk, result = 0)", 2024-02-10T08:21:33.383 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:03.388832+0000", 2024-02-10T08:21:33.383 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 89.940066032000004, 2024-02-10T08:21:33.383 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.09580052, 2024-02-10T08:21:33.383 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:21:33.383 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-02-10T08:21:33.383 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:21:33.384 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.384 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:21:33.384 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.388832+0000", 2024-02-10T08:21:33.384 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:21:33.384 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.384 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.384 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:21:33.385 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.388832+0000", 2024-02-10T08:21:33.385 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:21:33.385 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.385 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.385 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:21:33.385 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.388831+0000", 2024-02-10T08:21:33.385 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3399999999999997e-06 2024-02-10T08:21:33.385 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.385 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.385 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:21:33.385 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.388837+0000", 2024-02-10T08:21:33.385 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0763e-05 2024-02-10T08:21:33.385 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.385 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.386 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:21:33.386 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.388847+0000", 2024-02-10T08:21:33.386 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8209999999999998e-06 2024-02-10T08:21:33.386 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.386 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.386 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:21:33.386 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.388853+0000", 2024-02-10T08:21:33.386 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5278999999999999e-05 2024-02-10T08:21:33.386 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.386 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.386 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:21:33.386 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.388888+0000", 2024-02-10T08:21:33.386 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.095724862999999993 2024-02-10T08:21:33.386 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.386 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.386 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:21:33.387 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.484613+0000", 2024-02-10T08:21:33.387 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9184000000000001e-05 2024-02-10T08:21:33.387 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.387 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.387 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:21:33.387 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.484633+0000", 2024-02-10T08:21:33.387 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.09580052 2024-02-10T08:21:33.387 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:21:33.387 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:21:33.387 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:21:33.387 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.387 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.387 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.14784.0:29664 7.c e96/91 7:344c3984:::benchmark_data_smithi018_80623_object29663:head v 96'1899, mlcod=96'1896)", 2024-02-10T08:21:33.388 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:03.389862+0000", 2024-02-10T08:21:33.388 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 89.939036110000004, 2024-02-10T08:21:33.388 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.098684963000000001, 2024-02-10T08:21:33.388 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:21:33.388 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:21:33.388 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:21:33.388 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.388 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:21:33.388 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.389862+0000", 2024-02-10T08:21:33.388 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:21:33.388 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.388 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.388 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:21:33.388 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.389862+0000", 2024-02-10T08:21:33.389 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:21:33.389 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.389 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.389 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:21:33.389 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.389861+0000", 2024-02-10T08:21:33.389 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1804000000000002e-05 2024-02-10T08:21:33.389 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.389 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.389 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:21:33.389 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.389893+0000", 2024-02-10T08:21:33.389 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.094748447999999999 2024-02-10T08:21:33.389 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.389 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.389 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:21:33.389 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.484641+0000", 2024-02-10T08:21:33.390 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.452e-06 2024-02-10T08:21:33.390 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.390 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.390 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:21:33.390 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.484649+0000", 2024-02-10T08:21:33.390 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00052471799999999997 2024-02-10T08:21:33.390 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.390 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.390 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:21:33.390 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.485174+0000", 2024-02-10T08:21:33.390 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8352e-05 2024-02-10T08:21:33.390 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.390 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.390 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:21:33.390 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.485192+0000", 2024-02-10T08:21:33.391 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0033272380000000002 2024-02-10T08:21:33.391 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.391 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.391 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:21:33.391 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.488519+0000", 2024-02-10T08:21:33.391 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7634999999999999e-05 2024-02-10T08:21:33.391 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.391 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.391 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:21:33.391 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.488547+0000", 2024-02-10T08:21:33.391 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.098684963000000001 2024-02-10T08:21:33.391 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:21:33.391 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:21:33.391 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:21:33.391 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.391 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.392 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop_reply(client.14784.0:29649 7.2 e96/91 ondisk, result = 0)", 2024-02-10T08:21:33.392 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:03.391109+0000", 2024-02-10T08:21:33.392 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 89.937788742999999, 2024-02-10T08:21:33.392 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.095158392999999994, 2024-02-10T08:21:33.392 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:21:33.392 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-02-10T08:21:33.392 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:21:33.392 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.392 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:21:33.392 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.391109+0000", 2024-02-10T08:21:33.392 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:21:33.392 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.392 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.392 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:21:33.393 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.391109+0000", 2024-02-10T08:21:33.393 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:21:33.393 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.393 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.393 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:21:33.393 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.391109+0000", 2024-02-10T08:21:33.393 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6659999999999999e-06 2024-02-10T08:21:33.393 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.393 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.393 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:21:33.393 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.391113+0000", 2024-02-10T08:21:33.393 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.094337252999999996 2024-02-10T08:21:33.393 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.393 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.394 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:21:33.394 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.485451+0000", 2024-02-10T08:21:33.394 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1349999999999998e-06 2024-02-10T08:21:33.394 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.394 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.394 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:21:33.394 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.485460+0000", 2024-02-10T08:21:33.394 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00079593199999999995 2024-02-10T08:21:33.394 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.394 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.394 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:21:33.394 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.486256+0000", 2024-02-10T08:21:33.394 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2599999999999996e-06 2024-02-10T08:21:33.394 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.394 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.395 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:21:33.395 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.486261+0000", 2024-02-10T08:21:33.395 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8329999999999996e-06 2024-02-10T08:21:33.395 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.395 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.395 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:21:33.395 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.486268+0000", 2024-02-10T08:21:33.395 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.095158392999999994 2024-02-10T08:21:33.395 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:21:33.395 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:21:33.395 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:21:33.395 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.395 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.395 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:37308 7.a 7:56a0d08d:::benchmark_data_smithi018_80623_object37307:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e97)", 2024-02-10T08:21:33.395 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:08.126302+0000", 2024-02-10T08:21:33.396 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 85.202595626000004, 2024-02-10T08:21:33.396 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086586306000000002, 2024-02-10T08:21:33.396 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:21:33.396 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:21:33.396 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:21:33.396 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:21:33.396 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:21:33.396 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 37308 2024-02-10T08:21:33.396 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.396 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:21:33.396 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.396 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:21:33.396 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.126302+0000", 2024-02-10T08:21:33.397 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:21:33.397 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.397 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.397 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:21:33.397 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.126302+0000", 2024-02-10T08:21:33.397 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999976 2024-02-10T08:21:33.397 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.397 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.397 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:21:33.397 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.126300+0000", 2024-02-10T08:21:33.397 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8377e-05 2024-02-10T08:21:33.397 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.398 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.398 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:21:33.398 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.126328+0000", 2024-02-10T08:21:33.398 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0068000000000001e-05 2024-02-10T08:21:33.398 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.398 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.398 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:21:33.398 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.126338+0000", 2024-02-10T08:21:33.398 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9880000000000001e-06 2024-02-10T08:21:33.398 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.398 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.398 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:21:33.398 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.126344+0000", 2024-02-10T08:21:33.398 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0018999970000000001 2024-02-10T08:21:33.399 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.399 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.399 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:21:33.399 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.128244+0000", 2024-02-10T08:21:33.399 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000112 2024-02-10T08:21:33.399 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.399 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.399 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:21:33.399 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.128356+0000", 2024-02-10T08:21:33.399 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000140529 2024-02-10T08:21:33.399 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.399 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.400 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 2,5", 2024-02-10T08:21:33.400 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.128497+0000", 2024-02-10T08:21:33.400 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002593035 2024-02-10T08:21:33.400 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.400 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.400 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:21:33.400 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.131090+0000", 2024-02-10T08:21:33.400 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.081697398000000004 2024-02-10T08:21:33.400 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.400 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.400 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:21:33.400 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.212787+0000", 2024-02-10T08:21:33.400 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6489999999999997e-06 2024-02-10T08:21:33.401 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.401 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.401 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:21:33.401 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.212796+0000", 2024-02-10T08:21:33.401 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1892999999999999e-05 2024-02-10T08:21:33.401 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.401 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.401 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:21:33.401 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.212848+0000", 2024-02-10T08:21:33.401 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0828000000000003e-05 2024-02-10T08:21:33.401 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.401 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.401 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:21:33.401 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.212889+0000", 2024-02-10T08:21:33.402 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086586306000000002 2024-02-10T08:21:33.402 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:21:33.402 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:21:33.402 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:21:33.402 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.402 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.402 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:37314 7.a 7:56fd1ac9:::benchmark_data_smithi018_80623_object37313:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e97)", 2024-02-10T08:21:33.402 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:08.129767+0000", 2024-02-10T08:21:33.402 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 85.199130973999999, 2024-02-10T08:21:33.402 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086330962999999997, 2024-02-10T08:21:33.402 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:21:33.402 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:21:33.402 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:21:33.402 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:21:33.402 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:21:33.403 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 37314 2024-02-10T08:21:33.403 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.403 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:21:33.403 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.403 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:21:33.403 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.129767+0000", 2024-02-10T08:21:33.403 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:21:33.403 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.403 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.403 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:21:33.403 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.129767+0000", 2024-02-10T08:21:33.403 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:21:33.403 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.403 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.403 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:21:33.404 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.129766+0000", 2024-02-10T08:21:33.404 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8759000000000001e-05 2024-02-10T08:21:33.404 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.404 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.404 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:21:33.404 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.129785+0000", 2024-02-10T08:21:33.404 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8310000000000003e-06 2024-02-10T08:21:33.404 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.404 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.404 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:21:33.404 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.129792+0000", 2024-02-10T08:21:33.404 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0159999999999999e-06 2024-02-10T08:21:33.404 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.404 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.404 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:21:33.404 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.129797+0000", 2024-02-10T08:21:33.405 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001313931 2024-02-10T08:21:33.405 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.405 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.405 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:21:33.405 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.131111+0000", 2024-02-10T08:21:33.405 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010491499999999999 2024-02-10T08:21:33.405 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.405 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.405 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:21:33.405 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.131216+0000", 2024-02-10T08:21:33.405 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015440699999999999 2024-02-10T08:21:33.405 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.405 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.405 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 2,5", 2024-02-10T08:21:33.405 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.131370+0000", 2024-02-10T08:21:33.406 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.081164300999999994 2024-02-10T08:21:33.406 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.406 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.406 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:21:33.406 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.212535+0000", 2024-02-10T08:21:33.406 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0034334639999999998 2024-02-10T08:21:33.406 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.406 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.406 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:21:33.406 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.215968+0000", 2024-02-10T08:21:33.406 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1806e-05 2024-02-10T08:21:33.406 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.406 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.406 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:21:33.407 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.216000+0000", 2024-02-10T08:21:33.407 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2252e-05 2024-02-10T08:21:33.407 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.407 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.407 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:21:33.407 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.216062+0000", 2024-02-10T08:21:33.407 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5880000000000002e-05 2024-02-10T08:21:33.407 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.407 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.407 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:21:33.407 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:08.216098+0000", 2024-02-10T08:21:33.407 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086330962999999997 2024-02-10T08:21:33.407 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:21:33.407 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:21:33.407 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:21:33.408 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.408 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.408 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.14784.0:77128 7.7 e107/91 7:e88de2a8:::benchmark_data_smithi018_80623_object77127:head v 107'4838, mlcod=107'4836)", 2024-02-10T08:21:33.408 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:42.059069+0000", 2024-02-10T08:21:33.408 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 51.269829504, 2024-02-10T08:21:33.408 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.10422234499999999, 2024-02-10T08:21:33.408 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:21:33.408 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:21:33.408 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:21:33.408 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.408 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:21:33.408 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.059069+0000", 2024-02-10T08:21:33.408 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:21:33.408 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.409 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.409 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:21:33.409 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.059069+0000", 2024-02-10T08:21:33.409 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:21:33.409 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.409 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.409 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:21:33.409 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.059068+0000", 2024-02-10T08:21:33.409 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3590999999999997e-05 2024-02-10T08:21:33.409 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.409 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.409 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:21:33.409 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.059101+0000", 2024-02-10T08:21:33.409 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9289999999999993e-06 2024-02-10T08:21:33.409 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.410 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.410 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:21:33.410 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.059111+0000", 2024-02-10T08:21:33.410 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.195e-06 2024-02-10T08:21:33.410 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.410 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.410 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:21:33.410 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.059117+0000", 2024-02-10T08:21:33.410 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0037655560000000002 2024-02-10T08:21:33.410 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.410 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.410 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:21:33.410 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.062883+0000", 2024-02-10T08:21:33.410 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0213000000000001e-05 2024-02-10T08:21:33.410 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.411 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.411 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:21:33.411 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.062903+0000", 2024-02-10T08:21:33.411 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.10035986700000001 2024-02-10T08:21:33.411 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.411 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.411 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:21:33.411 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.163263+0000", 2024-02-10T08:21:33.411 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7929e-05 2024-02-10T08:21:33.411 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.411 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.411 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:21:33.411 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.163291+0000", 2024-02-10T08:21:33.411 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.10422234499999999 2024-02-10T08:21:33.411 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:21:33.412 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:21:33.412 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:21:33.412 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.412 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.412 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.14784.0:77122 7.f e107/91 7:fbc1d2ad:::benchmark_data_smithi018_80623_object77121:head v 107'4810, mlcod=107'4808)", 2024-02-10T08:21:33.412 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:42.060195+0000", 2024-02-10T08:21:33.412 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 51.268703490999997, 2024-02-10T08:21:33.412 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.103133033, 2024-02-10T08:21:33.412 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:21:33.412 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:21:33.412 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:21:33.412 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.412 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:21:33.412 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.060195+0000", 2024-02-10T08:21:33.412 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:21:33.413 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.413 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.413 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:21:33.413 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.060195+0000", 2024-02-10T08:21:33.413 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:21:33.413 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.413 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.413 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:21:33.413 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.060194+0000", 2024-02-10T08:21:33.413 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3572999999999999e-05 2024-02-10T08:21:33.413 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.413 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.413 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:21:33.413 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.060217+0000", 2024-02-10T08:21:33.413 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6237999999999999e-05 2024-02-10T08:21:33.414 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.414 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.414 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:21:33.414 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.060233+0000", 2024-02-10T08:21:33.414 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7009999999999999e-06 2024-02-10T08:21:33.414 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.414 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.414 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:21:33.414 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.060240+0000", 2024-02-10T08:21:33.414 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0051317610000000003 2024-02-10T08:21:33.414 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.414 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.414 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:21:33.414 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.065372+0000", 2024-02-10T08:21:33.414 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9153000000000001e-05 2024-02-10T08:21:33.414 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.415 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.415 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:21:33.415 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.065391+0000", 2024-02-10T08:21:33.415 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.097902235000000004 2024-02-10T08:21:33.415 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.415 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.415 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:21:33.415 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.163293+0000", 2024-02-10T08:21:33.415 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4239999999999997e-05 2024-02-10T08:21:33.415 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.415 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.415 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:21:33.415 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.163328+0000", 2024-02-10T08:21:33.415 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.103133033 2024-02-10T08:21:33.415 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:21:33.416 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:21:33.416 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:21:33.416 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.416 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.416 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.14784.0:77130 7.f e107/91 7:ff8c0eaa:::benchmark_data_smithi018_80623_object77129:head v 107'4811, mlcod=107'4808)", 2024-02-10T08:21:33.416 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:42.066181+0000", 2024-02-10T08:21:33.416 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 51.26271663, 2024-02-10T08:21:33.416 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.097164088999999995, 2024-02-10T08:21:33.416 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:21:33.416 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:21:33.416 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:21:33.416 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.416 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:21:33.416 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.066181+0000", 2024-02-10T08:21:33.416 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:21:33.417 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.417 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.417 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:21:33.417 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.066181+0000", 2024-02-10T08:21:33.417 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:21:33.417 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.417 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.417 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:21:33.417 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.066181+0000", 2024-02-10T08:21:33.417 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2979000000000001e-05 2024-02-10T08:21:33.417 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.417 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.417 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:21:33.417 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.066204+0000", 2024-02-10T08:21:33.417 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5429999999999999e-06 2024-02-10T08:21:33.418 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.418 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.418 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:21:33.418 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.066210+0000", 2024-02-10T08:21:33.418 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2470000000000002e-06 2024-02-10T08:21:33.418 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.418 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.418 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:21:33.418 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.066215+0000", 2024-02-10T08:21:33.418 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0020595940000000001 2024-02-10T08:21:33.418 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.418 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.418 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:21:33.418 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.068274+0000", 2024-02-10T08:21:33.418 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0086999999999999e-05 2024-02-10T08:21:33.418 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.419 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.419 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:21:33.419 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.068294+0000", 2024-02-10T08:21:33.419 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.095037076999999998 2024-02-10T08:21:33.419 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.419 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.419 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:21:33.419 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.163331+0000", 2024-02-10T08:21:33.420 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4095e-05 2024-02-10T08:21:33.420 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.420 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.420 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:21:33.420 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.163345+0000", 2024-02-10T08:21:33.420 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.097164088999999995 2024-02-10T08:21:33.420 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:21:33.420 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:21:33.420 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:21:33.420 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.420 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.420 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.14784.0:77133 7.f e107/91 7:f016bff6:::benchmark_data_smithi018_80623_object77132:head v 107'4812, mlcod=107'4808)", 2024-02-10T08:21:33.420 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:42.069091+0000", 2024-02-10T08:21:33.420 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 51.259806900999997, 2024-02-10T08:21:33.421 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.094268312000000007, 2024-02-10T08:21:33.421 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:21:33.421 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:21:33.421 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:21:33.421 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.421 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:21:33.421 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.069091+0000", 2024-02-10T08:21:33.421 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:21:33.421 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.421 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.421 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:21:33.421 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.069091+0000", 2024-02-10T08:21:33.421 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:21:33.421 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.421 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.422 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:21:33.422 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.069090+0000", 2024-02-10T08:21:33.422 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7095999999999999e-05 2024-02-10T08:21:33.422 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.422 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.422 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:21:33.422 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.069117+0000", 2024-02-10T08:21:33.422 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9790000000000005e-06 2024-02-10T08:21:33.422 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.422 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.422 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:21:33.422 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.069127+0000", 2024-02-10T08:21:33.422 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0329999999999997e-06 2024-02-10T08:21:33.422 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.422 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.423 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:21:33.423 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.069133+0000", 2024-02-10T08:21:33.423 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001407541 2024-02-10T08:21:33.423 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.423 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.423 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:21:33.423 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.070541+0000", 2024-02-10T08:21:33.423 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086372666000000001 2024-02-10T08:21:33.423 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.423 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.423 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:21:33.423 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.156914+0000", 2024-02-10T08:21:33.423 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0064336209999999996 2024-02-10T08:21:33.423 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.423 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.424 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:21:33.424 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.163347+0000", 2024-02-10T08:21:33.424 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2243e-05 2024-02-10T08:21:33.424 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.424 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.424 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:21:33.424 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.163359+0000", 2024-02-10T08:21:33.424 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.094268312000000007 2024-02-10T08:21:33.424 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:21:33.424 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:21:33.424 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:21:33.424 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.424 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.424 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.14784.0:77132 7.6 e107/91 7:6a0a2bbe:::benchmark_data_smithi018_80623_object77131:head v 107'4728, mlcod=107'4725)", 2024-02-10T08:21:33.425 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:42.069143+0000", 2024-02-10T08:21:33.425 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 51.259754653999998, 2024-02-10T08:21:33.425 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.090677862999999997, 2024-02-10T08:21:33.425 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:21:33.425 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:21:33.425 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:21:33.425 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.425 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:21:33.425 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.069143+0000", 2024-02-10T08:21:33.425 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:21:33.425 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.425 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.425 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:21:33.425 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.069143+0000", 2024-02-10T08:21:33.425 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:21:33.426 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.426 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.426 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:21:33.426 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.069143+0000", 2024-02-10T08:21:33.426 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3553999999999998e-05 2024-02-10T08:21:33.426 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.426 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.426 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:21:33.426 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.069166+0000", 2024-02-10T08:21:33.426 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3790000000000003e-06 2024-02-10T08:21:33.426 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.426 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.426 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:21:33.426 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.069173+0000", 2024-02-10T08:21:33.426 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5499999999999996e-06 2024-02-10T08:21:33.427 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.427 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.427 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:21:33.427 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.069177+0000", 2024-02-10T08:21:33.427 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3005e-05 2024-02-10T08:21:33.427 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.427 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.427 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:21:33.427 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.069210+0000", 2024-02-10T08:21:33.427 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9902999999999999e-05 2024-02-10T08:21:33.427 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.427 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.427 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:21:33.427 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.069230+0000", 2024-02-10T08:21:33.427 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.090549527000000005 2024-02-10T08:21:33.428 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.428 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.428 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:21:33.428 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.159780+0000", 2024-02-10T08:21:33.428 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1525e-05 2024-02-10T08:21:33.428 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.428 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.428 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:21:33.428 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.159821+0000", 2024-02-10T08:21:33.428 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.090677862999999997 2024-02-10T08:21:33.428 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:21:33.428 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:21:33.428 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:21:33.428 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.429 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.429 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.14784.0:77135 7.f e107/91 7:f81e7e4c:::benchmark_data_smithi018_80623_object77134:head v 107'4813, mlcod=107'4808)", 2024-02-10T08:21:33.429 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:42.069629+0000", 2024-02-10T08:21:33.429 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 51.259269369999998, 2024-02-10T08:21:33.429 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.094352981000000002, 2024-02-10T08:21:33.429 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:21:33.429 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:21:33.429 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:21:33.429 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.429 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:21:33.429 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.069629+0000", 2024-02-10T08:21:33.429 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:21:33.429 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.429 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.429 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:21:33.430 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.069629+0000", 2024-02-10T08:21:33.430 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:21:33.430 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.430 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.430 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:21:33.430 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.069628+0000", 2024-02-10T08:21:33.430 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2112000000000001e-05 2024-02-10T08:21:33.430 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.430 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.430 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:21:33.430 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.069650+0000", 2024-02-10T08:21:33.430 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3100000000000006e-06 2024-02-10T08:21:33.430 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.430 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.430 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:21:33.431 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.069659+0000", 2024-02-10T08:21:33.431 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4979999999999997e-06 2024-02-10T08:21:33.431 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.431 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.431 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:21:33.431 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.069665+0000", 2024-02-10T08:21:33.431 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.090952846000000004 2024-02-10T08:21:33.431 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.431 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.431 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:21:33.431 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.160618+0000", 2024-02-10T08:21:33.431 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9514999999999999e-05 2024-02-10T08:21:33.431 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.431 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.432 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:21:33.432 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.160637+0000", 2024-02-10T08:21:33.432 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.003312822 2024-02-10T08:21:33.432 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.432 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.432 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:21:33.432 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.163950+0000", 2024-02-10T08:21:33.432 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1473999999999997e-05 2024-02-10T08:21:33.432 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.432 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.432 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:21:33.432 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.163982+0000", 2024-02-10T08:21:33.432 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.094352981000000002 2024-02-10T08:21:33.432 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:21:33.433 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:21:33.433 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:21:33.433 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.433 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.433 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:77138 7.3 7:cbb2b15e:::benchmark_data_smithi018_80623_object77137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e107)", 2024-02-10T08:21:33.433 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:42.071482+0000", 2024-02-10T08:21:33.433 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 51.257415547999997, 2024-02-10T08:21:33.433 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.093265420000000002, 2024-02-10T08:21:33.433 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:21:33.433 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:21:33.433 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:21:33.433 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:21:33.433 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:21:33.433 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 77138 2024-02-10T08:21:33.433 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.434 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:21:33.434 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.434 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:21:33.434 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.071482+0000", 2024-02-10T08:21:33.434 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:21:33.434 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.434 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.434 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:21:33.434 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.071482+0000", 2024-02-10T08:21:33.434 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999981 2024-02-10T08:21:33.434 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.434 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.434 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:21:33.434 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.071481+0000", 2024-02-10T08:21:33.434 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0560999999999998e-05 2024-02-10T08:21:33.434 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.435 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.435 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:21:33.435 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.071501+0000", 2024-02-10T08:21:33.435 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.085323494 2024-02-10T08:21:33.435 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.435 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.435 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:21:33.435 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.156825+0000", 2024-02-10T08:21:33.435 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6481e-05 2024-02-10T08:21:33.435 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.435 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.435 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:21:33.435 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.156841+0000", 2024-02-10T08:21:33.435 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00024292199999999999 2024-02-10T08:21:33.436 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.436 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.436 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:21:33.436 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.157084+0000", 2024-02-10T08:21:33.436 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015046100000000001 2024-02-10T08:21:33.436 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.436 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.436 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:21:33.436 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.157235+0000", 2024-02-10T08:21:33.436 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018826699999999999 2024-02-10T08:21:33.436 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.436 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.436 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 2", 2024-02-10T08:21:33.436 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.157423+0000", 2024-02-10T08:21:33.436 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0043834249999999998 2024-02-10T08:21:33.437 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.437 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.437 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:21:33.437 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.161806+0000", 2024-02-10T08:21:33.437 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0028096530000000001 2024-02-10T08:21:33.437 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.437 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.437 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:21:33.437 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.164616+0000", 2024-02-10T08:21:33.437 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6128000000000003e-05 2024-02-10T08:21:33.437 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.437 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.437 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:21:33.437 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.164662+0000", 2024-02-10T08:21:33.437 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5844e-05 2024-02-10T08:21:33.438 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:21:33.438 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:21:33.438 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:21:33.438 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.164748+0000", 2024-02-10T08:21:33.438 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.093265420000000002 2024-02-10T08:21:33.438 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:21:33.438 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:21:33.438 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:21:33.438 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:21:33.438 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:21:33.438 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-02-10T08:21:33.438 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:21:33.490 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:33.642 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:21:32.565406+0000 mgr.y (mgr.14505) 183 : cluster [DBG] pgmap v190: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 5.7 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 700 op/s; 23245/283050 objects degraded (8.212%); 3.9 MiB/s, 62 objects/s recovering 2024-02-10T08:21:33.642 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:21:32.614368+0000 mon.a (mon.0) 896 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:21:33.642 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:21:32.638377+0000 mon.a (mon.0) 897 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-10T08:21:33.746 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:21:33.751 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:33.752 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:21:33.853 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:21:33.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:21:32.638428+0000 mon.a (mon.0) 898 : cluster [DBG] osdmap e124: 8 total, 8 up, 8 in 2024-02-10T08:21:33.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:21:33.049226+0000 osd.3 (osd.3) 87 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:21:33.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:21:33.049274+0000 osd.3 (osd.3) 88 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:21:33.907 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:21:32.565406+0000 mgr.y (mgr.14505) 183 : cluster [DBG] pgmap v190: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 5.7 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 700 op/s; 23245/283050 objects degraded (8.212%); 3.9 MiB/s, 62 objects/s recovering 2024-02-10T08:21:33.907 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:21:32.614368+0000 mon.a (mon.0) 896 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:21:33.907 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:21:32.638377+0000 mon.a (mon.0) 897 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-10T08:21:33.907 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:21:32.638428+0000 mon.a (mon.0) 898 : cluster [DBG] osdmap e124: 8 total, 8 up, 8 in 2024-02-10T08:21:33.908 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:21:33.049226+0000 osd.3 (osd.3) 87 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:21:33.908 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:21:33.049274+0000 osd.3 (osd.3) 88 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:21:33.917 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:34.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:21:32.565406+0000 mgr.y (mgr.14505) 183 : cluster [DBG] pgmap v190: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 5.7 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 700 op/s; 23245/283050 objects degraded (8.212%); 3.9 MiB/s, 62 objects/s recovering 2024-02-10T08:21:34.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:21:32.614368+0000 mon.a (mon.0) 896 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:21:34.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:21:32.638377+0000 mon.a (mon.0) 897 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-10T08:21:34.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:21:32.638428+0000 mon.a (mon.0) 898 : cluster [DBG] osdmap e124: 8 total, 8 up, 8 in 2024-02-10T08:21:34.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:21:33.049226+0000 osd.3 (osd.3) 87 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:21:34.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:21:33.049274+0000 osd.3 (osd.3) 88 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:21:34.907 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:21:33.656839+0000 mon.a (mon.0) 899 : cluster [DBG] osdmap e125: 8 total, 8 up, 8 in 2024-02-10T08:21:34.907 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:21:33.656839+0000 mon.a (mon.0) 899 : cluster [DBG] osdmap e125: 8 total, 8 up, 8 in 2024-02-10T08:21:34.931 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:21:35.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:21:33.656839+0000 mon.a (mon.0) 899 : cluster [DBG] osdmap e125: 8 total, 8 up, 8 in 2024-02-10T08:21:36.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:21:34.568232+0000 mgr.y (mgr.14505) 184 : cluster [DBG] pgmap v193: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 5.7 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 713 op/s; 22768/279555 objects degraded (8.144%); 6.7 MiB/s, 107 objects/s recovering 2024-02-10T08:21:36.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:21:35.442103+0000 mon.a (mon.0) 900 : cluster [WRN] Health check update: Degraded data redundancy: 22768/279555 objects degraded (8.144%), 5 pgs degraded (PG_DEGRADED) 2024-02-10T08:21:36.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:21:34.568232+0000 mgr.y (mgr.14505) 184 : cluster [DBG] pgmap v193: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 5.7 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 713 op/s; 22768/279555 objects degraded (8.144%); 6.7 MiB/s, 107 objects/s recovering 2024-02-10T08:21:36.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:21:35.442103+0000 mon.a (mon.0) 900 : cluster [WRN] Health check update: Degraded data redundancy: 22768/279555 objects degraded (8.144%), 5 pgs degraded (PG_DEGRADED) 2024-02-10T08:21:36.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:21:34.568232+0000 mgr.y (mgr.14505) 184 : cluster [DBG] pgmap v193: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 5.7 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 713 op/s; 22768/279555 objects degraded (8.144%); 6.7 MiB/s, 107 objects/s recovering 2024-02-10T08:21:36.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:21:35.442103+0000 mon.a (mon.0) 900 : cluster [WRN] Health check update: Degraded data redundancy: 22768/279555 objects degraded (8.144%), 5 pgs degraded (PG_DEGRADED) 2024-02-10T08:21:36.789 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:21:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:21:36] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:21:37.539 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:21:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:21:37] "GET /metrics HTTP/1.1" 200 175559 "" "Prometheus/2.33.4" 2024-02-10T08:21:37.621 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:21:37.621 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:21:37.622 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:21:37.622 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:21:37.622 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:21:37.622 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:21:37.622 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:21:37.622 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:21:37.622 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-10T08:21:37.622 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-10T08:21:37.622 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-10T08:21:37.622 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-10T08:21:37.622 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-10T08:21:37.622 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-10T08:21:37.622 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-10T08:21:37.623 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-10T08:21:37.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:21:36.570177+0000 mgr.y (mgr.14505) 185 : cluster [DBG] pgmap v194: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 5.7 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 837 B/s rd, 0 B/s wr, 518 op/s; 22768/279555 objects degraded (8.144%); 4.9 MiB/s, 78 objects/s recovering 2024-02-10T08:21:37.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:21:36.940661+0000 mon.a (mon.0) 901 : audit [DBG] from='client.? 172.21.15.18:0/859827670' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:21:37.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:21:36.570177+0000 mgr.y (mgr.14505) 185 : cluster [DBG] pgmap v194: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 5.7 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 837 B/s rd, 0 B/s wr, 518 op/s; 22768/279555 objects degraded (8.144%); 4.9 MiB/s, 78 objects/s recovering 2024-02-10T08:21:37.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:21:36.940661+0000 mon.a (mon.0) 901 : audit [DBG] from='client.? 172.21.15.18:0/859827670' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:21:38.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:21:36.570177+0000 mgr.y (mgr.14505) 185 : cluster [DBG] pgmap v194: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 5.7 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 837 B/s rd, 0 B/s wr, 518 op/s; 22768/279555 objects degraded (8.144%); 4.9 MiB/s, 78 objects/s recovering 2024-02-10T08:21:38.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:21:36.940661+0000 mon.a (mon.0) 901 : audit [DBG] from='client.? 172.21.15.18:0/859827670' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:21:38.040 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:21:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:21:38.843 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:21:38.848 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:38.850 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:21:38.951 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:21:39.027 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:21:37.704468+0000 mgr.y (mgr.14505) 186 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:21:39.027 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:21:37.704468+0000 mgr.y (mgr.14505) 186 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:21:39.034 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:39.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:21:37.704468+0000 mgr.y (mgr.14505) 186 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:21:39.191 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd set nodeep-scrub 2024-02-10T08:21:39.384 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.5 dump_ops_in_flight 2024-02-10T08:21:39.722 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:21:39.830 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:21:39.838 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:39.839 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:21:39.940 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:21:40.014 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:21:38.571982+0000 mgr.y (mgr.14505) 187 : cluster [DBG] pgmap v195: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 5.5 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 831 op/s; 21868/269112 objects degraded (8.126%); 7.5 MiB/s, 120 objects/s recovering 2024-02-10T08:21:40.014 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:21:38.571982+0000 mgr.y (mgr.14505) 187 : cluster [DBG] pgmap v195: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 5.5 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 831 op/s; 21868/269112 objects degraded (8.126%); 7.5 MiB/s, 120 objects/s recovering 2024-02-10T08:21:40.018 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:40.023 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:21:38.571982+0000 mgr.y (mgr.14505) 187 : cluster [DBG] pgmap v195: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 5.5 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 831 op/s; 21868/269112 objects degraded (8.126%); 7.5 MiB/s, 120 objects/s recovering 2024-02-10T08:21:40.174 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:21:40.178 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:40.178 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:21:40.279 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:21:40.344 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:40.420 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:21:40.424 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:40.425 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:21:40.526 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:21:40.584 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:40.616 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:21:40.624 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:40.625 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:21:40.671 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:21:40.725 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:21:40.762 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:40.791 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:21:40.801 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:40.802 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:21:40.885 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-10T08:21:40.903 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:21:40.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:21:40.443404+0000 mon.a (mon.0) 902 : cluster [WRN] Health check update: Degraded data redundancy: 21868/269112 objects degraded (8.126%), 5 pgs degraded (PG_DEGRADED) 2024-02-10T08:21:40.908 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:21:40.443404+0000 mon.a (mon.0) 902 : cluster [WRN] Health check update: Degraded data redundancy: 21868/269112 objects degraded (8.126%), 5 pgs degraded (PG_DEGRADED) 2024-02-10T08:21:40.934 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:40.955 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:21:40.967 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-02-10T08:21:41.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:21:40.443404+0000 mon.a (mon.0) 902 : cluster [WRN] Health check update: Degraded data redundancy: 21868/269112 objects degraded (8.126%), 5 pgs degraded (PG_DEGRADED) 2024-02-10T08:21:41.285 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:21:41.291 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:41.292 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:21:41.393 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:21:41.432 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:41.537 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:21:41.542 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:41.543 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:21:41.644 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:21:41.709 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:41.795 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:21:41.803 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:41.804 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:21:41.905 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:21:41.965 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:21:40.572545+0000 mgr.y (mgr.14505) 188 : cluster [DBG] pgmap v196: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 5.5 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 580 op/s; 21868/269112 objects degraded (8.126%); 7.5 MiB/s, 120 objects/s recovering 2024-02-10T08:21:41.966 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:21:40.925199+0000 mgr.y (mgr.14505) 189 : audit [DBG] from='client.14841 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-10T08:21:41.966 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:21:40.572545+0000 mgr.y (mgr.14505) 188 : cluster [DBG] pgmap v196: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 5.5 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 580 op/s; 21868/269112 objects degraded (8.126%); 7.5 MiB/s, 120 objects/s recovering 2024-02-10T08:21:41.966 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:21:40.925199+0000 mgr.y (mgr.14505) 189 : audit [DBG] from='client.14841 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-10T08:21:41.967 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:41.976 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:41 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:21:40.572545+0000 mgr.y (mgr.14505) 188 : cluster [DBG] pgmap v196: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 5.5 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 580 op/s; 21868/269112 objects degraded (8.126%); 7.5 MiB/s, 120 objects/s recovering 2024-02-10T08:21:41.976 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:41 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:21:40.925199+0000 mgr.y (mgr.14505) 189 : audit [DBG] from='client.14841 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-10T08:21:42.746 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-02-10T08:21:42.746 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:21:43.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:21:42.574731+0000 mgr.y (mgr.14505) 190 : cluster [DBG] pgmap v197: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 5.3 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 638 op/s; 21488/262971 objects degraded (8.171%); 4.6 MiB/s, 73 objects/s recovering 2024-02-10T08:21:43.906 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:21:42.574731+0000 mgr.y (mgr.14505) 190 : cluster [DBG] pgmap v197: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 5.3 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 638 op/s; 21488/262971 objects degraded (8.171%); 4.6 MiB/s, 73 objects/s recovering 2024-02-10T08:21:44.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:43 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:21:42.574731+0000 mgr.y (mgr.14505) 190 : cluster [DBG] pgmap v197: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 5.3 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 638 op/s; 21488/262971 objects degraded (8.171%); 4.6 MiB/s, 73 objects/s recovering 2024-02-10T08:21:45.360 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.5 dump_blocked_ops 2024-02-10T08:21:45.659 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:21:45.667 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:45.668 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:21:45.715 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:21:45.769 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:21:45.816 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:45.863 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:21:45.871 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:45.872 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:21:45.906 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:21:44.576129+0000 mgr.y (mgr.14505) 191 : cluster [DBG] pgmap v198: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 5.3 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 937 B/s rd, 0 B/s wr, 624 op/s; 20975/259140 objects degraded (8.094%); 5.7 MiB/s, 91 objects/s recovering 2024-02-10T08:21:45.906 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:21:45.454116+0000 mon.a (mon.0) 903 : cluster [WRN] Health check update: Degraded data redundancy: 20975/259140 objects degraded (8.094%), 5 pgs degraded (PG_DEGRADED) 2024-02-10T08:21:45.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:21:44.576129+0000 mgr.y (mgr.14505) 191 : cluster [DBG] pgmap v198: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 5.3 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 937 B/s rd, 0 B/s wr, 624 op/s; 20975/259140 objects degraded (8.094%); 5.7 MiB/s, 91 objects/s recovering 2024-02-10T08:21:45.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:21:45.454116+0000 mon.a (mon.0) 903 : cluster [WRN] Health check update: Degraded data redundancy: 20975/259140 objects degraded (8.094%), 5 pgs degraded (PG_DEGRADED) 2024-02-10T08:21:45.973 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:21:46.039 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:46.057 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:21:44.576129+0000 mgr.y (mgr.14505) 191 : cluster [DBG] pgmap v198: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 5.3 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 937 B/s rd, 0 B/s wr, 624 op/s; 20975/259140 objects degraded (8.094%); 5.7 MiB/s, 91 objects/s recovering 2024-02-10T08:21:46.058 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:21:45.454116+0000 mon.a (mon.0) 903 : cluster [WRN] Health check update: Degraded data redundancy: 20975/259140 objects degraded (8.094%), 5 pgs degraded (PG_DEGRADED) 2024-02-10T08:21:46.251 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:21:46.258 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:46.259 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:21:46.268 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":196,"stamp":"2024-02-10T08:21:40.572146+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":5866198716,"num_objects":89704,"num_object_clones":0,"num_object_copies":269112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":21868,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89704,"num_whiteouts":0,"num_read":980,"num_read_kb":732,"num_write":112768,"num_write_kb":6459242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4279,"num_bytes_recovered":279642552,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":88938,"ondisk_log_size":88938,"up":444,"acting":439,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":444,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":18313008,"kb_used_data":15856368,"kb_used_omap":0,"kb_used_meta":2456191,"kb_avail":731648208,"statfs":{"total":767960285184,"available":749207764992,"internally_reserved":0,"allocated":16236920832,"data_stored":16232683656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":972,"internal_metadata":2515139636},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,5,4,6,4,7],"upper_bound":64},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-304480256,"num_objects":-4646,"num_object_clones":0,"num_object_copies":-13938,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1377,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-4646,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4646,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":966,"num_bytes_recovered":63307776,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.007353"},"pg_stats":[{"pgid":"6.1b","version":"0'0","reported_seq":78,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.644636+0000","last_change":"2024-02-10T08:19:01.075963+0000","last_active":"2024-02-10T08:21:32.644636+0000","last_peered":"2024-02-10T08:21:32.644636+0000","last_clean":"2024-02-10T08:21:32.644636+0000","last_became_active":"2024-02-10T08:16:58.892091+0000","last_became_peered":"2024-02-10T08:16:58.892091+0000","last_unstale":"2024-02-10T08:21:32.644636+0000","last_undegraded":"2024-02-10T08:21:32.644636+0000","last_fullsized":"2024-02-10T08:21:32.644636+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:01.075886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:19:01.075886+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":57,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.644451+0000","last_change":"2024-02-10T08:20:46.404906+0000","last_active":"2024-02-10T08:21:32.644451+0000","last_peered":"2024-02-10T08:21:32.644451+0000","last_clean":"2024-02-10T08:21:32.644451+0000","last_became_active":"2024-02-10T08:20:46.404597+0000","last_became_peered":"2024-02-10T08:20:46.404597+0000","last_unstale":"2024-02-10T08:21:32.644451+0000","last_undegraded":"2024-02-10T08:21:32.644451+0000","last_fullsized":"2024-02-10T08:21:32.644451+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:09.941898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:09.941898+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":98,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.676416+0000","last_change":"2024-02-10T08:20:46.407187+0000","last_active":"2024-02-10T08:21:32.676416+0000","last_peered":"2024-02-10T08:21:32.676416+0000","last_clean":"2024-02-10T08:21:32.676416+0000","last_became_active":"2024-02-10T08:20:46.406826+0000","last_became_peered":"2024-02-10T08:20:46.406826+0000","last_unstale":"2024-02-10T08:21:32.676416+0000","last_undegraded":"2024-02-10T08:21:32.676416+0000","last_fullsized":"2024-02-10T08:21:32.676416+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:43.744900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:43.744900+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"62'15","reported_seq":112,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.643995+0000","last_change":"2024-02-10T08:20:03.330608+0000","last_active":"2024-02-10T08:21:32.643995+0000","last_peered":"2024-02-10T08:21:32.643995+0000","last_clean":"2024-02-10T08:21:32.643995+0000","last_became_active":"2024-02-10T08:16:54.849232+0000","last_became_peered":"2024-02-10T08:16:54.849232+0000","last_unstale":"2024-02-10T08:21:32.643995+0000","last_undegraded":"2024-02-10T08:21:32.643995+0000","last_fullsized":"2024-02-10T08:21:32.643995+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'15","last_scrub_stamp":"2024-02-10T08:20:03.330508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:20:03.330508+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":61,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.644783+0000","last_change":"2024-02-10T08:20:46.405782+0000","last_active":"2024-02-10T08:21:32.644783+0000","last_peered":"2024-02-10T08:21:32.644783+0000","last_clean":"2024-02-10T08:21:32.644783+0000","last_became_active":"2024-02-10T08:20:46.405314+0000","last_became_peered":"2024-02-10T08:20:46.405314+0000","last_unstale":"2024-02-10T08:21:32.644783+0000","last_undegraded":"2024-02-10T08:21:32.644783+0000","last_fullsized":"2024-02-10T08:21:32.644783+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:19.058317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:19.058317+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":85,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.644260+0000","last_change":"2024-02-10T08:20:06.810606+0000","last_active":"2024-02-10T08:21:32.644260+0000","last_peered":"2024-02-10T08:21:32.644260+0000","last_clean":"2024-02-10T08:21:32.644260+0000","last_became_active":"2024-02-10T08:16:56.863353+0000","last_became_peered":"2024-02-10T08:16:56.863353+0000","last_unstale":"2024-02-10T08:21:32.644260+0000","last_undegraded":"2024-02-10T08:21:32.644260+0000","last_fullsized":"2024-02-10T08:21:32.644260+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:06.810521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:20:06.810521+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":89,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.646653+0000","last_change":"2024-02-10T08:19:28.176418+0000","last_active":"2024-02-10T08:21:32.646653+0000","last_peered":"2024-02-10T08:21:32.646653+0000","last_clean":"2024-02-10T08:21:32.646653+0000","last_became_active":"2024-02-10T08:16:52.787183+0000","last_became_peered":"2024-02-10T08:16:52.787183+0000","last_unstale":"2024-02-10T08:21:32.646653+0000","last_undegraded":"2024-02-10T08:21:32.646653+0000","last_fullsized":"2024-02-10T08:21:32.646653+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:28.176344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:19:28.176344+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"62'9","reported_seq":76,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.644617+0000","last_change":"2024-02-10T08:20:46.405346+0000","last_active":"2024-02-10T08:21:32.644617+0000","last_peered":"2024-02-10T08:21:32.644617+0000","last_clean":"2024-02-10T08:21:32.644617+0000","last_became_active":"2024-02-10T08:20:46.404966+0000","last_became_peered":"2024-02-10T08:20:46.404966+0000","last_unstale":"2024-02-10T08:21:32.644617+0000","last_undegraded":"2024-02-10T08:21:32.644617+0000","last_fullsized":"2024-02-10T08:21:32.644617+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'9","last_scrub_stamp":"2024-02-10T08:18:12.998167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:12.998167+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":82,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.635367+0000","last_change":"2024-02-10T08:20:09.280914+0000","last_active":"2024-02-10T08:21:32.635367+0000","last_peered":"2024-02-10T08:21:32.635367+0000","last_clean":"2024-02-10T08:21:32.635367+0000","last_became_active":"2024-02-10T08:16:58.867430+0000","last_became_peered":"2024-02-10T08:16:58.867430+0000","last_unstale":"2024-02-10T08:21:32.635367+0000","last_undegraded":"2024-02-10T08:21:32.635367+0000","last_fullsized":"2024-02-10T08:21:32.635367+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:09.280825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:20:09.280825+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":99,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.656041+0000","last_change":"2024-02-10T08:20:46.407232+0000","last_active":"2024-02-10T08:21:32.656041+0000","last_peered":"2024-02-10T08:21:32.656041+0000","last_clean":"2024-02-10T08:21:32.656041+0000","last_became_active":"2024-02-10T08:20:46.406783+0000","last_became_peered":"2024-02-10T08:20:46.406783+0000","last_unstale":"2024-02-10T08:21:32.656041+0000","last_undegraded":"2024-02-10T08:21:32.656041+0000","last_fullsized":"2024-02-10T08:21:32.656041+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:19.291495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:19:19.291495+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"55'1","reported_seq":95,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.657052+0000","last_change":"2024-02-10T08:20:20.303814+0000","last_active":"2024-02-10T08:21:32.657052+0000","last_peered":"2024-02-10T08:21:32.657052+0000","last_clean":"2024-02-10T08:21:32.657052+0000","last_became_active":"2024-02-10T08:16:52.790462+0000","last_became_peered":"2024-02-10T08:16:52.790462+0000","last_unstale":"2024-02-10T08:21:32.657052+0000","last_undegraded":"2024-02-10T08:21:32.657052+0000","last_fullsized":"2024-02-10T08:21:32.657052+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'1","last_scrub_stamp":"2024-02-10T08:20:20.303730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:20:20.303730+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"62'5","reported_seq":84,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.644779+0000","last_change":"2024-02-10T08:20:46.403728+0000","last_active":"2024-02-10T08:21:32.644779+0000","last_peered":"2024-02-10T08:21:32.644779+0000","last_clean":"2024-02-10T08:21:32.644779+0000","last_became_active":"2024-02-10T08:20:46.403373+0000","last_became_peered":"2024-02-10T08:20:46.403373+0000","last_unstale":"2024-02-10T08:21:32.644779+0000","last_undegraded":"2024-02-10T08:21:32.644779+0000","last_fullsized":"2024-02-10T08:21:32.644779+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'5","last_scrub_stamp":"2024-02-10T08:19:29.251633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:19:29.251633+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":6,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":82,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.653934+0000","last_change":"2024-02-10T08:20:00.830960+0000","last_active":"2024-02-10T08:21:32.653934+0000","last_peered":"2024-02-10T08:21:32.653934+0000","last_clean":"2024-02-10T08:21:32.653934+0000","last_became_active":"2024-02-10T08:16:58.860591+0000","last_became_peered":"2024-02-10T08:16:58.860591+0000","last_unstale":"2024-02-10T08:21:32.653934+0000","last_undegraded":"2024-02-10T08:21:32.653934+0000","last_fullsized":"2024-02-10T08:21:32.653934+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:00.830869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:20:00.830869+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":89,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.636514+0000","last_change":"2024-02-10T08:20:32.126091+0000","last_active":"2024-02-10T08:21:32.636514+0000","last_peered":"2024-02-10T08:21:32.636514+0000","last_clean":"2024-02-10T08:21:32.636514+0000","last_became_active":"2024-02-10T08:16:56.864532+0000","last_became_peered":"2024-02-10T08:16:56.864532+0000","last_unstale":"2024-02-10T08:21:32.636514+0000","last_undegraded":"2024-02-10T08:21:32.636514+0000","last_fullsized":"2024-02-10T08:21:32.636514+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:32.126007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:20:32.126007+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":88,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.656598+0000","last_change":"2024-02-10T08:20:02.245653+0000","last_active":"2024-02-10T08:21:32.656598+0000","last_peered":"2024-02-10T08:21:32.656598+0000","last_clean":"2024-02-10T08:21:32.656598+0000","last_became_active":"2024-02-10T08:16:52.787865+0000","last_became_peered":"2024-02-10T08:16:52.787865+0000","last_unstale":"2024-02-10T08:21:32.656598+0000","last_undegraded":"2024-02-10T08:21:32.656598+0000","last_fullsized":"2024-02-10T08:21:32.656598+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:02.245593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:28.028556+0000","last_clean_scrub_stamp":"2024-02-10T08:20:02.245593+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"62'9","reported_seq":78,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.644880+0000","last_change":"2024-02-10T08:20:46.401585+0000","last_active":"2024-02-10T08:21:32.644880+0000","last_peered":"2024-02-10T08:21:32.644880+0000","last_clean":"2024-02-10T08:21:32.644880+0000","last_became_active":"2024-02-10T08:20:46.401156+0000","last_became_peered":"2024-02-10T08:20:46.401156+0000","last_unstale":"2024-02-10T08:21:32.644880+0000","last_undegraded":"2024-02-10T08:21:32.644880+0000","last_fullsized":"2024-02-10T08:21:32.644880+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'9","last_scrub_stamp":"2024-02-10T08:18:15.012657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:15.012657+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":78,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.647962+0000","last_change":"2024-02-10T08:18:52.045246+0000","last_active":"2024-02-10T08:21:32.647962+0000","last_peered":"2024-02-10T08:21:32.647962+0000","last_clean":"2024-02-10T08:21:32.647962+0000","last_became_active":"2024-02-10T08:16:58.891365+0000","last_became_peered":"2024-02-10T08:16:58.891365+0000","last_unstale":"2024-02-10T08:21:32.647962+0000","last_undegraded":"2024-02-10T08:21:32.647962+0000","last_fullsized":"2024-02-10T08:21:32.647962+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:52.045180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:52.045180+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":63,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.644836+0000","last_change":"2024-02-10T08:20:46.399318+0000","last_active":"2024-02-10T08:21:32.644836+0000","last_peered":"2024-02-10T08:21:32.644836+0000","last_clean":"2024-02-10T08:21:32.644836+0000","last_became_active":"2024-02-10T08:20:46.398532+0000","last_became_peered":"2024-02-10T08:20:46.398532+0000","last_unstale":"2024-02-10T08:21:32.644836+0000","last_undegraded":"2024-02-10T08:21:32.644836+0000","last_fullsized":"2024-02-10T08:21:32.644836+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:22.000811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:22.000811+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":89,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.644929+0000","last_change":"2024-02-10T08:20:04.345319+0000","last_active":"2024-02-10T08:21:32.644929+0000","last_peered":"2024-02-10T08:21:32.644929+0000","last_clean":"2024-02-10T08:21:32.644929+0000","last_became_active":"2024-02-10T08:16:52.785404+0000","last_became_peered":"2024-02-10T08:16:52.785404+0000","last_unstale":"2024-02-10T08:21:32.644929+0000","last_undegraded":"2024-02-10T08:21:32.644929+0000","last_fullsized":"2024-02-10T08:21:32.644929+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:04.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:20:04.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"74'17","reported_seq":125,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.646321+0000","last_change":"2024-02-10T08:20:46.400148+0000","last_active":"2024-02-10T08:21:32.646321+0000","last_peered":"2024-02-10T08:21:32.646321+0000","last_clean":"2024-02-10T08:21:32.646321+0000","last_became_active":"2024-02-10T08:20:46.399726+0000","last_became_peered":"2024-02-10T08:20:46.399726+0000","last_unstale":"2024-02-10T08:21:32.646321+0000","last_undegraded":"2024-02-10T08:21:32.646321+0000","last_fullsized":"2024-02-10T08:21:32.646321+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'17","last_scrub_stamp":"2024-02-10T08:18:02.949298+0000","last_deep_scrub":"74'17","last_deep_scrub_stamp":"2024-02-10T08:18:02.949298+0000","last_clean_scrub_stamp":"2024-02-10T08:18:02.949298+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":61,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.645154+0000","last_change":"2024-02-10T08:20:46.403697+0000","last_active":"2024-02-10T08:21:32.645154+0000","last_peered":"2024-02-10T08:21:32.645154+0000","last_clean":"2024-02-10T08:21:32.645154+0000","last_became_active":"2024-02-10T08:20:46.403378+0000","last_became_peered":"2024-02-10T08:20:46.403378+0000","last_unstale":"2024-02-10T08:21:32.645154+0000","last_undegraded":"2024-02-10T08:21:32.645154+0000","last_fullsized":"2024-02-10T08:21:32.645154+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:26.952496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:26.952496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":95,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.650249+0000","last_change":"2024-02-10T08:20:46.407843+0000","last_active":"2024-02-10T08:21:32.650249+0000","last_peered":"2024-02-10T08:21:32.650249+0000","last_clean":"2024-02-10T08:21:32.650249+0000","last_became_active":"2024-02-10T08:20:46.407373+0000","last_became_peered":"2024-02-10T08:20:46.407373+0000","last_unstale":"2024-02-10T08:21:32.650249+0000","last_undegraded":"2024-02-10T08:21:32.650249+0000","last_fullsized":"2024-02-10T08:21:32.650249+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:38.230210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:38.230210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":103,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.650015+0000","last_change":"2024-02-10T08:20:46.396617+0000","last_active":"2024-02-10T08:21:32.650015+0000","last_peered":"2024-02-10T08:21:32.650015+0000","last_clean":"2024-02-10T08:21:32.650015+0000","last_became_active":"2024-02-10T08:20:46.396303+0000","last_became_peered":"2024-02-10T08:20:46.396303+0000","last_unstale":"2024-02-10T08:21:32.650015+0000","last_undegraded":"2024-02-10T08:21:32.650015+0000","last_fullsized":"2024-02-10T08:21:32.650015+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:10.370746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:10.370746+0000","last_clean_scrub_stamp":"2024-02-10T08:19:10.370746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1c","version":"62'15","reported_seq":117,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.649634+0000","last_change":"2024-02-10T08:20:30.939623+0000","last_active":"2024-02-10T08:21:32.649634+0000","last_peered":"2024-02-10T08:21:32.649634+0000","last_clean":"2024-02-10T08:21:32.649634+0000","last_became_active":"2024-02-10T08:16:54.849361+0000","last_became_peered":"2024-02-10T08:16:54.849361+0000","last_unstale":"2024-02-10T08:21:32.649634+0000","last_undegraded":"2024-02-10T08:21:32.649634+0000","last_fullsized":"2024-02-10T08:21:32.649634+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'15","last_scrub_stamp":"2024-02-10T08:20:30.939526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:20:30.939526+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":93,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.649878+0000","last_change":"2024-02-10T08:20:46.408820+0000","last_active":"2024-02-10T08:21:32.649878+0000","last_peered":"2024-02-10T08:21:32.649878+0000","last_clean":"2024-02-10T08:21:32.649878+0000","last_became_active":"2024-02-10T08:20:46.408504+0000","last_became_peered":"2024-02-10T08:20:46.408504+0000","last_unstale":"2024-02-10T08:21:32.649878+0000","last_undegraded":"2024-02-10T08:21:32.649878+0000","last_fullsized":"2024-02-10T08:21:32.649878+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:22.104988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:22.104988+0000","last_clean_scrub_stamp":"2024-02-10T08:18:22.104988+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":84,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.659954+0000","last_change":"2024-02-10T08:20:02.843334+0000","last_active":"2024-02-10T08:21:32.659954+0000","last_peered":"2024-02-10T08:21:32.659954+0000","last_clean":"2024-02-10T08:21:32.659954+0000","last_became_active":"2024-02-10T08:16:56.863348+0000","last_became_peered":"2024-02-10T08:16:56.863348+0000","last_unstale":"2024-02-10T08:21:32.659954+0000","last_undegraded":"2024-02-10T08:21:32.659954+0000","last_fullsized":"2024-02-10T08:21:32.659954+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:02.843237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:20:02.843237+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":89,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.643562+0000","last_change":"2024-02-10T08:20:14.239093+0000","last_active":"2024-02-10T08:21:32.643562+0000","last_peered":"2024-02-10T08:21:32.643562+0000","last_clean":"2024-02-10T08:21:32.643562+0000","last_became_active":"2024-02-10T08:16:52.785743+0000","last_became_peered":"2024-02-10T08:16:52.785743+0000","last_unstale":"2024-02-10T08:21:32.643562+0000","last_undegraded":"2024-02-10T08:21:32.643562+0000","last_fullsized":"2024-02-10T08:21:32.643562+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:14.238991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:20:14.238991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"62'11","reported_seq":105,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.650284+0000","last_change":"2024-02-10T08:19:29.497168+0000","last_active":"2024-02-10T08:21:32.650284+0000","last_peered":"2024-02-10T08:21:32.650284+0000","last_clean":"2024-02-10T08:21:32.650284+0000","last_became_active":"2024-02-10T08:16:54.852665+0000","last_became_peered":"2024-02-10T08:16:54.852665+0000","last_unstale":"2024-02-10T08:21:32.650284+0000","last_undegraded":"2024-02-10T08:21:32.650284+0000","last_fullsized":"2024-02-10T08:21:32.650284+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'11","last_scrub_stamp":"2024-02-10T08:19:29.497086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:19:29.497086+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"87'2","reported_seq":84,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.656943+0000","last_change":"2024-02-10T08:19:29.207609+0000","last_active":"2024-02-10T08:21:32.656943+0000","last_peered":"2024-02-10T08:21:32.656943+0000","last_clean":"2024-02-10T08:21:32.656943+0000","last_became_active":"2024-02-10T08:16:58.859047+0000","last_became_peered":"2024-02-10T08:16:58.859047+0000","last_unstale":"2024-02-10T08:21:32.656943+0000","last_undegraded":"2024-02-10T08:21:32.656943+0000","last_fullsized":"2024-02-10T08:21:32.656943+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'2","last_scrub_stamp":"2024-02-10T08:19:29.207531+0000","last_deep_scrub":"87'2","last_deep_scrub_stamp":"2024-02-10T08:19:29.207531+0000","last_clean_scrub_stamp":"2024-02-10T08:19:29.207531+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"111'11","reported_seq":168,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-02-10T08:21:33.657161+0000","last_change":"2024-02-10T08:20:46.403619+0000","last_active":"2024-02-10T08:21:33.657161+0000","last_peered":"2024-02-10T08:21:33.657161+0000","last_clean":"2024-02-10T08:21:33.657161+0000","last_became_active":"2024-02-10T08:20:46.402663+0000","last_became_peered":"2024-02-10T08:20:46.402663+0000","last_unstale":"2024-02-10T08:21:33.657161+0000","last_undegraded":"2024-02-10T08:21:33.657161+0000","last_fullsized":"2024-02-10T08:21:33.657161+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'9","last_scrub_stamp":"2024-02-10T08:18:36.323217+0000","last_deep_scrub":"82'9","last_deep_scrub_stamp":"2024-02-10T08:18:36.323217+0000","last_clean_scrub_stamp":"2024-02-10T08:18:36.323217+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":98,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.639975+0000","last_change":"2024-02-10T08:20:46.392818+0000","last_active":"2024-02-10T08:21:32.639975+0000","last_peered":"2024-02-10T08:21:32.639975+0000","last_clean":"2024-02-10T08:21:32.639975+0000","last_became_active":"2024-02-10T08:20:46.392466+0000","last_became_peered":"2024-02-10T08:20:46.392466+0000","last_unstale":"2024-02-10T08:21:32.639975+0000","last_undegraded":"2024-02-10T08:21:32.639975+0000","last_fullsized":"2024-02-10T08:21:32.639975+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:30.422800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:30.422800+0000","last_clean_scrub_stamp":"2024-02-10T08:18:30.422800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"74'15","reported_seq":106,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.659871+0000","last_change":"2024-02-10T08:19:15.492916+0000","last_active":"2024-02-10T08:21:32.659871+0000","last_peered":"2024-02-10T08:21:32.659871+0000","last_clean":"2024-02-10T08:21:32.659871+0000","last_became_active":"2024-02-10T08:16:55.204738+0000","last_became_peered":"2024-02-10T08:16:55.204738+0000","last_unstale":"2024-02-10T08:21:32.659871+0000","last_undegraded":"2024-02-10T08:21:32.659871+0000","last_fullsized":"2024-02-10T08:21:32.659871+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'15","last_scrub_stamp":"2024-02-10T08:19:15.492821+0000","last_deep_scrub":"74'15","last_deep_scrub_stamp":"2024-02-10T08:17:57.637346+0000","last_clean_scrub_stamp":"2024-02-10T08:19:15.492821+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":83,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.645370+0000","last_change":"2024-02-10T08:20:15.204543+0000","last_active":"2024-02-10T08:21:32.645370+0000","last_peered":"2024-02-10T08:21:32.645370+0000","last_clean":"2024-02-10T08:21:32.645370+0000","last_became_active":"2024-02-10T08:16:58.892622+0000","last_became_peered":"2024-02-10T08:16:58.892622+0000","last_unstale":"2024-02-10T08:21:32.645370+0000","last_undegraded":"2024-02-10T08:21:32.645370+0000","last_fullsized":"2024-02-10T08:21:32.645370+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:15.204475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:20:15.204475+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":99,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.657878+0000","last_change":"2024-02-10T08:20:46.400144+0000","last_active":"2024-02-10T08:21:32.657878+0000","last_peered":"2024-02-10T08:21:32.657878+0000","last_clean":"2024-02-10T08:21:32.657878+0000","last_became_active":"2024-02-10T08:20:46.399838+0000","last_became_peered":"2024-02-10T08:20:46.399838+0000","last_unstale":"2024-02-10T08:21:32.657878+0000","last_undegraded":"2024-02-10T08:21:32.657878+0000","last_fullsized":"2024-02-10T08:21:32.657878+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:06.357048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:19:06.357048+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":88,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.650134+0000","last_change":"2024-02-10T08:19:22.466525+0000","last_active":"2024-02-10T08:21:32.650134+0000","last_peered":"2024-02-10T08:21:32.650134+0000","last_clean":"2024-02-10T08:21:32.650134+0000","last_became_active":"2024-02-10T08:16:52.788629+0000","last_became_peered":"2024-02-10T08:16:52.788629+0000","last_unstale":"2024-02-10T08:21:32.650134+0000","last_undegraded":"2024-02-10T08:21:32.650134+0000","last_fullsized":"2024-02-10T08:21:32.650134+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:22.466453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:19:22.466453+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"62'11","reported_seq":106,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.643912+0000","last_change":"2024-02-10T08:19:32.166896+0000","last_active":"2024-02-10T08:21:32.643912+0000","last_peered":"2024-02-10T08:21:32.643912+0000","last_clean":"2024-02-10T08:21:32.643912+0000","last_became_active":"2024-02-10T08:16:55.204751+0000","last_became_peered":"2024-02-10T08:16:55.204751+0000","last_unstale":"2024-02-10T08:21:32.643912+0000","last_undegraded":"2024-02-10T08:21:32.643912+0000","last_fullsized":"2024-02-10T08:21:32.643912+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'11","last_scrub_stamp":"2024-02-10T08:19:32.166830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:19:32.166830+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":97,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.655935+0000","last_change":"2024-02-10T08:20:46.399860+0000","last_active":"2024-02-10T08:21:32.655935+0000","last_peered":"2024-02-10T08:21:32.655935+0000","last_clean":"2024-02-10T08:21:32.655935+0000","last_became_active":"2024-02-10T08:20:46.399515+0000","last_became_peered":"2024-02-10T08:20:46.399515+0000","last_unstale":"2024-02-10T08:21:32.655935+0000","last_undegraded":"2024-02-10T08:21:32.655935+0000","last_fullsized":"2024-02-10T08:21:32.655935+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:27.276490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:27.276490+0000","last_clean_scrub_stamp":"2024-02-10T08:19:27.276490+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":94,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.649763+0000","last_change":"2024-02-10T08:20:46.397801+0000","last_active":"2024-02-10T08:21:32.649763+0000","last_peered":"2024-02-10T08:21:32.649763+0000","last_clean":"2024-02-10T08:21:32.649763+0000","last_became_active":"2024-02-10T08:20:46.397495+0000","last_became_peered":"2024-02-10T08:20:46.397495+0000","last_unstale":"2024-02-10T08:21:32.649763+0000","last_undegraded":"2024-02-10T08:21:32.649763+0000","last_fullsized":"2024-02-10T08:21:32.649763+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:34.381329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:34.381329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":93,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.637399+0000","last_change":"2024-02-10T08:20:24.226131+0000","last_active":"2024-02-10T08:21:32.637399+0000","last_peered":"2024-02-10T08:21:32.637399+0000","last_clean":"2024-02-10T08:21:32.637399+0000","last_became_active":"2024-02-10T08:16:52.788704+0000","last_became_peered":"2024-02-10T08:16:52.788704+0000","last_unstale":"2024-02-10T08:21:32.637399+0000","last_undegraded":"2024-02-10T08:21:32.637399+0000","last_fullsized":"2024-02-10T08:21:32.637399+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:24.226061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:20:24.226061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"62'4","reported_seq":88,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.645564+0000","last_change":"2024-02-10T08:18:50.134758+0000","last_active":"2024-02-10T08:21:32.645564+0000","last_peered":"2024-02-10T08:21:32.645564+0000","last_clean":"2024-02-10T08:21:32.645564+0000","last_became_active":"2024-02-10T08:16:54.852959+0000","last_became_peered":"2024-02-10T08:16:54.852959+0000","last_unstale":"2024-02-10T08:21:32.645564+0000","last_undegraded":"2024-02-10T08:21:32.645564+0000","last_fullsized":"2024-02-10T08:21:32.645564+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'4","last_scrub_stamp":"2024-02-10T08:18:50.134690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:50.134690+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":83,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.643435+0000","last_change":"2024-02-10T08:19:02.030164+0000","last_active":"2024-02-10T08:21:32.643435+0000","last_peered":"2024-02-10T08:21:32.643435+0000","last_clean":"2024-02-10T08:21:32.643435+0000","last_became_active":"2024-02-10T08:16:58.864301+0000","last_became_peered":"2024-02-10T08:16:58.864301+0000","last_unstale":"2024-02-10T08:21:32.643435+0000","last_undegraded":"2024-02-10T08:21:32.643435+0000","last_fullsized":"2024-02-10T08:21:32.643435+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:02.030086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:19:02.030086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":85,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.647558+0000","last_change":"2024-02-10T08:20:07.754989+0000","last_active":"2024-02-10T08:21:32.647558+0000","last_peered":"2024-02-10T08:21:32.647558+0000","last_clean":"2024-02-10T08:21:32.647558+0000","last_became_active":"2024-02-10T08:16:56.860953+0000","last_became_peered":"2024-02-10T08:16:56.860953+0000","last_unstale":"2024-02-10T08:21:32.647558+0000","last_undegraded":"2024-02-10T08:21:32.647558+0000","last_fullsized":"2024-02-10T08:21:32.647558+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:07.754900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:20:07.754900+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":91,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.650056+0000","last_change":"2024-02-10T08:20:03.782239+0000","last_active":"2024-02-10T08:21:32.650056+0000","last_peered":"2024-02-10T08:21:32.650056+0000","last_clean":"2024-02-10T08:21:32.650056+0000","last_became_active":"2024-02-10T08:16:52.786400+0000","last_became_peered":"2024-02-10T08:16:52.786400+0000","last_unstale":"2024-02-10T08:21:32.650056+0000","last_undegraded":"2024-02-10T08:21:32.650056+0000","last_fullsized":"2024-02-10T08:21:32.650056+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:03.782136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:20:03.782136+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"62'11","reported_seq":106,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.644893+0000","last_change":"2024-02-10T08:20:46.396436+0000","last_active":"2024-02-10T08:21:32.644893+0000","last_peered":"2024-02-10T08:21:32.644893+0000","last_clean":"2024-02-10T08:21:32.644893+0000","last_became_active":"2024-02-10T08:20:46.396130+0000","last_became_peered":"2024-02-10T08:20:46.396130+0000","last_unstale":"2024-02-10T08:21:32.644893+0000","last_undegraded":"2024-02-10T08:21:32.644893+0000","last_fullsized":"2024-02-10T08:21:32.644893+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'11","last_scrub_stamp":"2024-02-10T08:18:17.029517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:17.029517+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":82,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.653598+0000","last_change":"2024-02-10T08:20:06.911888+0000","last_active":"2024-02-10T08:21:32.653598+0000","last_peered":"2024-02-10T08:21:32.653598+0000","last_clean":"2024-02-10T08:21:32.653598+0000","last_became_active":"2024-02-10T08:16:58.861031+0000","last_became_peered":"2024-02-10T08:16:58.861031+0000","last_unstale":"2024-02-10T08:21:32.653598+0000","last_undegraded":"2024-02-10T08:21:32.653598+0000","last_fullsized":"2024-02-10T08:21:32.653598+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:06.911805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:20:06.911805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":85,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.645001+0000","last_change":"2024-02-10T08:20:33.201454+0000","last_active":"2024-02-10T08:21:32.645001+0000","last_peered":"2024-02-10T08:21:32.645001+0000","last_clean":"2024-02-10T08:21:32.645001+0000","last_became_active":"2024-02-10T08:16:56.862136+0000","last_became_peered":"2024-02-10T08:16:56.862136+0000","last_unstale":"2024-02-10T08:21:32.645001+0000","last_undegraded":"2024-02-10T08:21:32.645001+0000","last_fullsized":"2024-02-10T08:21:32.645001+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:33.201370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:20:33.201370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":95,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.650117+0000","last_change":"2024-02-10T08:20:32.148461+0000","last_active":"2024-02-10T08:21:32.650117+0000","last_peered":"2024-02-10T08:21:32.650117+0000","last_clean":"2024-02-10T08:21:32.650117+0000","last_became_active":"2024-02-10T08:16:52.786213+0000","last_became_peered":"2024-02-10T08:16:52.786213+0000","last_unstale":"2024-02-10T08:21:32.650117+0000","last_undegraded":"2024-02-10T08:21:32.650117+0000","last_fullsized":"2024-02-10T08:21:32.650117+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:32.148377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:20:32.148377+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"62'9","reported_seq":108,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.647408+0000","last_change":"2024-02-10T08:20:27.597657+0000","last_active":"2024-02-10T08:21:32.647408+0000","last_peered":"2024-02-10T08:21:32.647408+0000","last_clean":"2024-02-10T08:21:32.647408+0000","last_became_active":"2024-02-10T08:16:54.851971+0000","last_became_peered":"2024-02-10T08:16:54.851971+0000","last_unstale":"2024-02-10T08:21:32.647408+0000","last_undegraded":"2024-02-10T08:21:32.647408+0000","last_fullsized":"2024-02-10T08:21:32.647408+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'9","last_scrub_stamp":"2024-02-10T08:20:27.597547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:20:27.597547+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":61,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.645347+0000","last_change":"2024-02-10T08:20:46.396485+0000","last_active":"2024-02-10T08:21:32.645347+0000","last_peered":"2024-02-10T08:21:32.645347+0000","last_clean":"2024-02-10T08:21:32.645347+0000","last_became_active":"2024-02-10T08:20:46.395788+0000","last_became_peered":"2024-02-10T08:20:46.395788+0000","last_unstale":"2024-02-10T08:21:32.645347+0000","last_undegraded":"2024-02-10T08:21:32.645347+0000","last_fullsized":"2024-02-10T08:21:32.645347+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:22.955823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:22.955823+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"62'8","reported_seq":150,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-02-10T08:21:33.674507+0000","last_change":"2024-02-10T08:20:10.352015+0000","last_active":"2024-02-10T08:21:33.674507+0000","last_peered":"2024-02-10T08:21:33.674507+0000","last_clean":"2024-02-10T08:21:33.674507+0000","last_became_active":"2024-02-10T08:16:56.854151+0000","last_became_peered":"2024-02-10T08:16:56.854151+0000","last_unstale":"2024-02-10T08:21:33.674507+0000","last_undegraded":"2024-02-10T08:21:33.674507+0000","last_fullsized":"2024-02-10T08:21:33.674507+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'8","last_scrub_stamp":"2024-02-10T08:20:10.351918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:20:10.351918+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":103,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.655447+0000","last_change":"2024-02-10T08:20:46.404011+0000","last_active":"2024-02-10T08:21:32.655447+0000","last_peered":"2024-02-10T08:21:32.655447+0000","last_clean":"2024-02-10T08:21:32.655447+0000","last_became_active":"2024-02-10T08:20:46.403803+0000","last_became_peered":"2024-02-10T08:20:46.403803+0000","last_unstale":"2024-02-10T08:21:32.655447+0000","last_undegraded":"2024-02-10T08:21:32.655447+0000","last_fullsized":"2024-02-10T08:21:32.655447+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:08.548458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:19:08.548458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"62'9","reported_seq":102,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.636925+0000","last_change":"2024-02-10T08:20:11.315987+0000","last_active":"2024-02-10T08:21:32.636925+0000","last_peered":"2024-02-10T08:21:32.636925+0000","last_clean":"2024-02-10T08:21:32.636925+0000","last_became_active":"2024-02-10T08:16:55.204734+0000","last_became_peered":"2024-02-10T08:16:55.204734+0000","last_unstale":"2024-02-10T08:21:32.636925+0000","last_undegraded":"2024-02-10T08:21:32.636925+0000","last_fullsized":"2024-02-10T08:21:32.636925+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'9","last_scrub_stamp":"2024-02-10T08:20:11.315903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:20:11.315903+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":87,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.656359+0000","last_change":"2024-02-10T08:20:26.027398+0000","last_active":"2024-02-10T08:21:32.656359+0000","last_peered":"2024-02-10T08:21:32.656359+0000","last_clean":"2024-02-10T08:21:32.656359+0000","last_became_active":"2024-02-10T08:16:58.869673+0000","last_became_peered":"2024-02-10T08:16:58.869673+0000","last_unstale":"2024-02-10T08:21:32.656359+0000","last_undegraded":"2024-02-10T08:21:32.656359+0000","last_fullsized":"2024-02-10T08:21:32.656359+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:26.027321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:05.662947+0000","last_clean_scrub_stamp":"2024-02-10T08:20:26.027321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"89'9","reported_seq":150,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-02-10T08:21:33.688100+0000","last_change":"2024-02-10T08:19:33.299741+0000","last_active":"2024-02-10T08:21:33.688100+0000","last_peered":"2024-02-10T08:21:33.688100+0000","last_clean":"2024-02-10T08:21:33.688100+0000","last_became_active":"2024-02-10T08:16:56.864587+0000","last_became_peered":"2024-02-10T08:16:56.864587+0000","last_unstale":"2024-02-10T08:21:33.688100+0000","last_undegraded":"2024-02-10T08:21:33.688100+0000","last_fullsized":"2024-02-10T08:21:33.688100+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'9","last_scrub_stamp":"2024-02-10T08:19:33.299671+0000","last_deep_scrub":"89'9","last_deep_scrub_stamp":"2024-02-10T08:19:33.299671+0000","last_clean_scrub_stamp":"2024-02-10T08:19:33.299671+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":88,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.636401+0000","last_change":"2024-02-10T08:20:04.285337+0000","last_active":"2024-02-10T08:21:32.636401+0000","last_peered":"2024-02-10T08:21:32.636401+0000","last_clean":"2024-02-10T08:21:32.636401+0000","last_became_active":"2024-02-10T08:16:52.789834+0000","last_became_peered":"2024-02-10T08:16:52.789834+0000","last_unstale":"2024-02-10T08:21:32.636401+0000","last_undegraded":"2024-02-10T08:21:32.636401+0000","last_fullsized":"2024-02-10T08:21:32.636401+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:04.285243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:20:04.285243+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"62'10","reported_seq":102,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.646260+0000","last_change":"2024-02-10T08:19:09.007459+0000","last_active":"2024-02-10T08:21:32.646260+0000","last_peered":"2024-02-10T08:21:32.646260+0000","last_clean":"2024-02-10T08:21:32.646260+0000","last_became_active":"2024-02-10T08:16:55.204789+0000","last_became_peered":"2024-02-10T08:16:55.204789+0000","last_unstale":"2024-02-10T08:21:32.646260+0000","last_undegraded":"2024-02-10T08:21:32.646260+0000","last_fullsized":"2024-02-10T08:21:32.646260+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'10","last_scrub_stamp":"2024-02-10T08:19:09.007376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:19:09.007376+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":92,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.657009+0000","last_change":"2024-02-10T08:20:46.399218+0000","last_active":"2024-02-10T08:21:32.657009+0000","last_peered":"2024-02-10T08:21:32.657009+0000","last_clean":"2024-02-10T08:21:32.657009+0000","last_became_active":"2024-02-10T08:20:46.398903+0000","last_became_peered":"2024-02-10T08:20:46.398903+0000","last_unstale":"2024-02-10T08:21:32.657009+0000","last_undegraded":"2024-02-10T08:21:32.657009+0000","last_fullsized":"2024-02-10T08:21:32.657009+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:22.944593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:22.944593+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":84,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.637335+0000","last_change":"2024-02-10T08:20:10.278739+0000","last_active":"2024-02-10T08:21:32.637335+0000","last_peered":"2024-02-10T08:21:32.637335+0000","last_clean":"2024-02-10T08:21:32.637335+0000","last_became_active":"2024-02-10T08:16:56.863948+0000","last_became_peered":"2024-02-10T08:16:56.863948+0000","last_unstale":"2024-02-10T08:21:32.637335+0000","last_undegraded":"2024-02-10T08:21:32.637335+0000","last_fullsized":"2024-02-10T08:21:32.637335+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:10.278678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:20:10.278678+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":110,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.649790+0000","last_change":"2024-02-10T08:21:32.148524+0000","last_active":"2024-02-10T08:21:32.649790+0000","last_peered":"2024-02-10T08:21:32.649790+0000","last_clean":"2024-02-10T08:21:32.649790+0000","last_became_active":"2024-02-10T08:20:46.400758+0000","last_became_peered":"2024-02-10T08:20:46.400758+0000","last_unstale":"2024-02-10T08:21:32.649790+0000","last_undegraded":"2024-02-10T08:21:32.649790+0000","last_fullsized":"2024-02-10T08:21:32.649790+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:08.233096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:08.233096+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"62'6","reported_seq":96,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.648010+0000","last_change":"2024-02-10T08:20:08.360978+0000","last_active":"2024-02-10T08:21:32.648010+0000","last_peered":"2024-02-10T08:21:32.648010+0000","last_clean":"2024-02-10T08:21:32.648010+0000","last_became_active":"2024-02-10T08:16:55.203401+0000","last_became_peered":"2024-02-10T08:16:55.203401+0000","last_unstale":"2024-02-10T08:21:32.648010+0000","last_undegraded":"2024-02-10T08:21:32.648010+0000","last_fullsized":"2024-02-10T08:21:32.648010+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'6","last_scrub_stamp":"2024-02-10T08:20:08.360881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:20:08.360881+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":93,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.649309+0000","last_change":"2024-02-10T08:20:46.407558+0000","last_active":"2024-02-10T08:21:32.649309+0000","last_peered":"2024-02-10T08:21:32.649309+0000","last_clean":"2024-02-10T08:21:32.649309+0000","last_became_active":"2024-02-10T08:20:46.407214+0000","last_became_peered":"2024-02-10T08:20:46.407214+0000","last_unstale":"2024-02-10T08:21:32.649309+0000","last_undegraded":"2024-02-10T08:21:32.649309+0000","last_fullsized":"2024-02-10T08:21:32.649309+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:10.716763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:10.716763+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":85,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.648121+0000","last_change":"2024-02-10T08:20:07.352836+0000","last_active":"2024-02-10T08:21:32.648121+0000","last_peered":"2024-02-10T08:21:32.648121+0000","last_clean":"2024-02-10T08:21:32.648121+0000","last_became_active":"2024-02-10T08:16:56.860904+0000","last_became_peered":"2024-02-10T08:16:56.860904+0000","last_unstale":"2024-02-10T08:21:32.648121+0000","last_undegraded":"2024-02-10T08:21:32.648121+0000","last_fullsized":"2024-02-10T08:21:32.648121+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:07.352745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:20:07.352745+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"55'1","reported_seq":95,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.658332+0000","last_change":"2024-02-10T08:19:59.845452+0000","last_active":"2024-02-10T08:21:32.658332+0000","last_peered":"2024-02-10T08:21:32.658332+0000","last_clean":"2024-02-10T08:21:32.658332+0000","last_became_active":"2024-02-10T08:16:52.782734+0000","last_became_peered":"2024-02-10T08:16:52.782734+0000","last_unstale":"2024-02-10T08:21:32.658332+0000","last_undegraded":"2024-02-10T08:21:32.658332+0000","last_fullsized":"2024-02-10T08:21:32.658332+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'1","last_scrub_stamp":"2024-02-10T08:19:59.845351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:19:59.845351+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"62'9","reported_seq":102,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.656589+0000","last_change":"2024-02-10T08:19:14.500843+0000","last_active":"2024-02-10T08:21:32.656589+0000","last_peered":"2024-02-10T08:21:32.656589+0000","last_clean":"2024-02-10T08:21:32.656589+0000","last_became_active":"2024-02-10T08:16:55.204727+0000","last_became_peered":"2024-02-10T08:16:55.204727+0000","last_unstale":"2024-02-10T08:21:32.656589+0000","last_undegraded":"2024-02-10T08:21:32.656589+0000","last_fullsized":"2024-02-10T08:21:32.656589+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'9","last_scrub_stamp":"2024-02-10T08:19:14.500766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:19:14.500766+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.a","version":"125'6937","reported_seq":6979,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-02-10T08:21:37.542787+0000","last_change":"2024-02-10T08:19:39.843283+0000","last_active":"2024-02-10T08:21:37.542787+0000","last_peered":"2024-02-10T08:21:37.542787+0000","last_clean":"2024-02-10T08:21:37.542787+0000","last_became_active":"2024-02-10T08:19:39.842909+0000","last_became_peered":"2024-02-10T08:19:39.842909+0000","last_unstale":"2024-02-10T08:21:37.542787+0000","last_undegraded":"2024-02-10T08:21:37.542787+0000","last_fullsized":"2024-02-10T08:21:37.542787+0000","mapping_epoch":91,"log_start":"97'2200","ondisk_log_start":"97'2200","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_clean_scrub_stamp":"2024-02-10T08:19:38.813165+0000","log_size":4737,"ondisk_log_size":4737,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":368640000,"num_objects":5625,"num_object_clones":0,"num_object_copies":16875,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5625,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6937,"num_write_kb":401984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":83,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.645093+0000","last_change":"2024-02-10T08:20:18.128576+0000","last_active":"2024-02-10T08:21:32.645093+0000","last_peered":"2024-02-10T08:21:32.645093+0000","last_clean":"2024-02-10T08:21:32.645093+0000","last_became_active":"2024-02-10T08:16:58.868848+0000","last_became_peered":"2024-02-10T08:16:58.868848+0000","last_unstale":"2024-02-10T08:21:32.645093+0000","last_undegraded":"2024-02-10T08:21:32.645093+0000","last_fullsized":"2024-02-10T08:21:32.645093+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:18.128487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:20:18.128487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"55'2","reported_seq":72,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.645488+0000","last_change":"2024-02-10T08:20:46.398750+0000","last_active":"2024-02-10T08:21:32.645488+0000","last_peered":"2024-02-10T08:21:32.645488+0000","last_clean":"2024-02-10T08:21:32.645488+0000","last_became_active":"2024-02-10T08:20:46.398441+0000","last_became_peered":"2024-02-10T08:20:46.398441+0000","last_unstale":"2024-02-10T08:21:32.645488+0000","last_undegraded":"2024-02-10T08:21:32.645488+0000","last_fullsized":"2024-02-10T08:21:32.645488+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'2","last_scrub_stamp":"2024-02-10T08:18:03.916322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:03.916322+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"82'17","reported_seq":93,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.644604+0000","last_change":"2024-02-10T08:20:46.404791+0000","last_active":"2024-02-10T08:21:32.644604+0000","last_peered":"2024-02-10T08:21:32.644604+0000","last_clean":"2024-02-10T08:21:32.644604+0000","last_became_active":"2024-02-10T08:20:46.404286+0000","last_became_peered":"2024-02-10T08:20:46.404286+0000","last_unstale":"2024-02-10T08:21:32.644604+0000","last_undegraded":"2024-02-10T08:21:32.644604+0000","last_fullsized":"2024-02-10T08:21:32.644604+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'17","last_scrub_stamp":"2024-02-10T08:18:21.015873+0000","last_deep_scrub":"82'17","last_deep_scrub_stamp":"2024-02-10T08:18:21.015873+0000","last_clean_scrub_stamp":"2024-02-10T08:18:21.015873+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":85,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.658256+0000","last_change":"2024-02-10T08:19:26.899727+0000","last_active":"2024-02-10T08:21:32.658256+0000","last_peered":"2024-02-10T08:21:32.658256+0000","last_clean":"2024-02-10T08:21:32.658256+0000","last_became_active":"2024-02-10T08:16:56.860850+0000","last_became_peered":"2024-02-10T08:16:56.860850+0000","last_unstale":"2024-02-10T08:21:32.658256+0000","last_undegraded":"2024-02-10T08:21:32.658256+0000","last_fullsized":"2024-02-10T08:21:32.658256+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:26.899655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:19:26.899655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1","version":"125'7068","reported_seq":7118,"reported_epoch":125,"state":"active+undersized+degraded+remapped+backfill_wait+backfill_toofull","last_fresh":"2024-02-10T08:21:37.482930+0000","last_change":"2024-02-10T08:21:17.924829+0000","last_active":"2024-02-10T08:21:37.482930+0000","last_peered":"2024-02-10T08:21:37.482930+0000","last_clean":"2024-02-10T08:19:38.813165+0000","last_became_active":"2024-02-10T08:20:47.901963+0000","last_became_peered":"2024-02-10T08:20:47.901963+0000","last_unstale":"2024-02-10T08:21:37.482930+0000","last_undegraded":"2024-02-10T08:20:47.398636+0000","last_fullsized":"2024-02-10T08:20:47.384354+0000","mapping_epoch":111,"log_start":"97'2300","ondisk_log_start":"97'2300","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_clean_scrub_stamp":"2024-02-10T08:19:38.813165+0000","log_size":4768,"ondisk_log_size":4768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":368574464,"num_objects":5624,"num_object_clones":0,"num_object_copies":16872,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":5624,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5624,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7068,"num_write_kb":406144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[3,6],"avail_no_missing":["3","6"],"object_location_counts":[{"shards":"3,6","objects":5624}],"blocked_by":[],"up_primary":4,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":87,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.653678+0000","last_change":"2024-02-10T08:20:18.941070+0000","last_active":"2024-02-10T08:21:32.653678+0000","last_peered":"2024-02-10T08:21:32.653678+0000","last_clean":"2024-02-10T08:21:32.653678+0000","last_became_active":"2024-02-10T08:16:58.864957+0000","last_became_peered":"2024-02-10T08:16:58.864957+0000","last_unstale":"2024-02-10T08:21:32.653678+0000","last_undegraded":"2024-02-10T08:21:32.653678+0000","last_fullsized":"2024-02-10T08:21:32.653678+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:18.940944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:20:18.940944+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":89,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.650829+0000","last_change":"2024-02-10T08:20:08.744631+0000","last_active":"2024-02-10T08:21:32.650829+0000","last_peered":"2024-02-10T08:21:32.650829+0000","last_clean":"2024-02-10T08:21:32.650829+0000","last_became_active":"2024-02-10T08:16:52.789354+0000","last_became_peered":"2024-02-10T08:16:52.789354+0000","last_unstale":"2024-02-10T08:21:32.650829+0000","last_undegraded":"2024-02-10T08:21:32.650829+0000","last_fullsized":"2024-02-10T08:21:32.650829+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:08.744567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:20:08.744567+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"62'10","reported_seq":112,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.647487+0000","last_change":"2024-02-10T08:20:46.408860+0000","last_active":"2024-02-10T08:21:32.647487+0000","last_peered":"2024-02-10T08:21:32.647487+0000","last_clean":"2024-02-10T08:21:32.647487+0000","last_became_active":"2024-02-10T08:20:46.408495+0000","last_became_peered":"2024-02-10T08:20:46.408495+0000","last_unstale":"2024-02-10T08:21:32.647487+0000","last_undegraded":"2024-02-10T08:21:32.647487+0000","last_fullsized":"2024-02-10T08:21:32.647487+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'10","last_scrub_stamp":"2024-02-10T08:18:26.189127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:26.189127+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"62'8","reported_seq":149,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-02-10T08:21:33.674836+0000","last_change":"2024-02-10T08:20:08.840019+0000","last_active":"2024-02-10T08:21:33.674836+0000","last_peered":"2024-02-10T08:21:33.674836+0000","last_clean":"2024-02-10T08:21:33.674836+0000","last_became_active":"2024-02-10T08:16:56.862677+0000","last_became_peered":"2024-02-10T08:16:56.862677+0000","last_unstale":"2024-02-10T08:21:33.674836+0000","last_undegraded":"2024-02-10T08:21:33.674836+0000","last_fullsized":"2024-02-10T08:21:33.674836+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'8","last_scrub_stamp":"2024-02-10T08:20:08.839890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:20:08.839890+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.7","version":"125'7111","reported_seq":7153,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-02-10T08:21:37.440421+0000","last_change":"2024-02-10T08:19:39.830249+0000","last_active":"2024-02-10T08:21:37.440421+0000","last_peered":"2024-02-10T08:21:37.440421+0000","last_clean":"2024-02-10T08:21:37.440421+0000","last_became_active":"2024-02-10T08:19:39.829937+0000","last_became_peered":"2024-02-10T08:19:39.829937+0000","last_unstale":"2024-02-10T08:21:37.440421+0000","last_undegraded":"2024-02-10T08:21:37.440421+0000","last_fullsized":"2024-02-10T08:21:37.440421+0000","mapping_epoch":91,"log_start":"95'900","ondisk_log_start":"95'900","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_clean_scrub_stamp":"2024-02-10T08:19:38.813165+0000","log_size":6211,"ondisk_log_size":6211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":370081792,"num_objects":5647,"num_object_clones":0,"num_object_copies":16941,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5647,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7111,"num_write_kb":408256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,3],"acting":[6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":93,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.646724+0000","last_change":"2024-02-10T08:20:46.396575+0000","last_active":"2024-02-10T08:21:32.646724+0000","last_peered":"2024-02-10T08:21:32.646724+0000","last_clean":"2024-02-10T08:21:32.646724+0000","last_became_active":"2024-02-10T08:20:46.396276+0000","last_became_peered":"2024-02-10T08:20:46.396276+0000","last_unstale":"2024-02-10T08:21:32.646724+0000","last_undegraded":"2024-02-10T08:21:32.646724+0000","last_fullsized":"2024-02-10T08:21:32.646724+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:47.116727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:47.116727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":88,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.636444+0000","last_change":"2024-02-10T08:20:07.299708+0000","last_active":"2024-02-10T08:21:32.636444+0000","last_peered":"2024-02-10T08:21:32.636444+0000","last_clean":"2024-02-10T08:21:32.636444+0000","last_became_active":"2024-02-10T08:16:52.791027+0000","last_became_peered":"2024-02-10T08:16:52.791027+0000","last_unstale":"2024-02-10T08:21:32.636444+0000","last_undegraded":"2024-02-10T08:21:32.636444+0000","last_fullsized":"2024-02-10T08:21:32.636444+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:07.299640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:20:07.299640+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"62'28","reported_seq":197,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-02-10T08:21:33.673208+0000","last_change":"2024-02-10T08:20:16.678248+0000","last_active":"2024-02-10T08:21:33.673208+0000","last_peered":"2024-02-10T08:21:33.673208+0000","last_clean":"2024-02-10T08:21:33.673208+0000","last_became_active":"2024-02-10T08:16:54.856000+0000","last_became_peered":"2024-02-10T08:16:54.856000+0000","last_unstale":"2024-02-10T08:21:33.673208+0000","last_undegraded":"2024-02-10T08:21:33.673208+0000","last_fullsized":"2024-02-10T08:21:33.673208+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'28","last_scrub_stamp":"2024-02-10T08:20:16.678147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:20:16.678147+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":48,"num_read_kb":33,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":94,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.657603+0000","last_change":"2024-02-10T08:20:46.406682+0000","last_active":"2024-02-10T08:21:32.657603+0000","last_peered":"2024-02-10T08:21:32.657603+0000","last_clean":"2024-02-10T08:21:32.657603+0000","last_became_active":"2024-02-10T08:20:46.406395+0000","last_became_peered":"2024-02-10T08:20:46.406395+0000","last_unstale":"2024-02-10T08:21:32.657603+0000","last_undegraded":"2024-02-10T08:21:32.657603+0000","last_fullsized":"2024-02-10T08:21:32.657603+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:51.533128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:51.533128+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"125'7007","reported_seq":10296,"reported_epoch":125,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-02-10T08:21:37.766133+0000","last_change":"2024-02-10T08:20:47.997666+0000","last_active":"2024-02-10T08:21:37.766133+0000","last_peered":"2024-02-10T08:21:37.766133+0000","last_clean":"2024-02-10T08:19:38.813165+0000","last_became_active":"2024-02-10T08:20:47.928046+0000","last_became_peered":"2024-02-10T08:20:47.928046+0000","last_unstale":"2024-02-10T08:21:37.766133+0000","last_undegraded":"2024-02-10T08:20:47.424280+0000","last_fullsized":"2024-02-10T08:20:47.387445+0000","mapping_epoch":111,"log_start":"96'1500","ondisk_log_start":"96'1500","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_clean_scrub_stamp":"2024-02-10T08:19:38.813165+0000","log_size":5507,"ondisk_log_size":5507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":363790336,"num_objects":5551,"num_object_clones":0,"num_object_copies":16653,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3396,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5551,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7007,"num_write_kb":401856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1621,"num_bytes_recovered":106233856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0,1","objects":2155}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":82,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.657124+0000","last_change":"2024-02-10T08:20:08.316774+0000","last_active":"2024-02-10T08:21:32.657124+0000","last_peered":"2024-02-10T08:21:32.657124+0000","last_clean":"2024-02-10T08:21:32.657124+0000","last_became_active":"2024-02-10T08:16:58.891249+0000","last_became_peered":"2024-02-10T08:16:58.891249+0000","last_unstale":"2024-02-10T08:21:32.657124+0000","last_undegraded":"2024-02-10T08:21:32.657124+0000","last_fullsized":"2024-02-10T08:21:32.657124+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:08.316685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:11.750537+0000","last_clean_scrub_stamp":"2024-02-10T08:20:08.316685+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"63'5","reported_seq":369,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-02-10T08:21:36.372486+0000","last_change":"2024-02-10T08:19:12.466527+0000","last_active":"2024-02-10T08:21:36.372486+0000","last_peered":"2024-02-10T08:21:36.372486+0000","last_clean":"2024-02-10T08:21:36.372486+0000","last_became_active":"2024-02-10T08:16:52.780989+0000","last_became_peered":"2024-02-10T08:16:52.780989+0000","last_unstale":"2024-02-10T08:21:36.372486+0000","last_undegraded":"2024-02-10T08:21:36.372486+0000","last_fullsized":"2024-02-10T08:21:36.372486+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'5","last_scrub_stamp":"2024-02-10T08:19:12.466451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:19:12.466451+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":277,"num_read_kb":272,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":89,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.649288+0000","last_change":"2024-02-10T08:19:13.900328+0000","last_active":"2024-02-10T08:21:32.649288+0000","last_peered":"2024-02-10T08:21:32.649288+0000","last_clean":"2024-02-10T08:21:32.649288+0000","last_became_active":"2024-02-10T08:16:52.787737+0000","last_became_peered":"2024-02-10T08:16:52.787737+0000","last_unstale":"2024-02-10T08:21:32.649288+0000","last_undegraded":"2024-02-10T08:21:32.649288+0000","last_fullsized":"2024-02-10T08:21:32.649288+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:13.900264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:11.681169+0000","last_clean_scrub_stamp":"2024-02-10T08:19:13.900264+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"62'13","reported_seq":44,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.656587+0000","last_change":"2024-02-10T08:20:31.890688+0000","last_active":"2024-02-10T08:21:32.656587+0000","last_peered":"2024-02-10T08:21:32.656587+0000","last_clean":"2024-02-10T08:21:32.656587+0000","last_became_active":"2024-02-10T08:20:31.024371+0000","last_became_peered":"2024-02-10T08:20:31.024371+0000","last_unstale":"2024-02-10T08:21:32.656587+0000","last_undegraded":"2024-02-10T08:21:32.656587+0000","last_fullsized":"2024-02-10T08:21:32.656587+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'13","last_scrub_stamp":"2024-02-10T08:20:13.727564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:20:13.727564+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":18,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":85,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.649635+0000","last_change":"2024-02-10T08:20:00.886336+0000","last_active":"2024-02-10T08:21:32.649635+0000","last_peered":"2024-02-10T08:21:32.649635+0000","last_clean":"2024-02-10T08:21:32.649635+0000","last_became_active":"2024-02-10T08:16:56.857856+0000","last_became_peered":"2024-02-10T08:16:56.857856+0000","last_unstale":"2024-02-10T08:21:32.649635+0000","last_undegraded":"2024-02-10T08:21:32.649635+0000","last_fullsized":"2024-02-10T08:21:32.649635+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:00.886232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:20:00.886232+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"125'6874","reported_seq":6916,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-02-10T08:21:37.781689+0000","last_change":"2024-02-10T08:19:39.831855+0000","last_active":"2024-02-10T08:21:37.781689+0000","last_peered":"2024-02-10T08:21:37.781689+0000","last_clean":"2024-02-10T08:21:37.781689+0000","last_became_active":"2024-02-10T08:19:39.831585+0000","last_became_peered":"2024-02-10T08:19:39.831585+0000","last_unstale":"2024-02-10T08:21:37.781689+0000","last_undegraded":"2024-02-10T08:21:37.781689+0000","last_fullsized":"2024-02-10T08:21:37.781689+0000","mapping_epoch":91,"log_start":"95'1400","ondisk_log_start":"95'1400","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_clean_scrub_stamp":"2024-02-10T08:19:38.813165+0000","log_size":5474,"ondisk_log_size":5474,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":360972288,"num_objects":5508,"num_object_clones":0,"num_object_copies":16524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5508,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6874,"num_write_kb":396224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":92,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.637594+0000","last_change":"2024-02-10T08:20:46.394535+0000","last_active":"2024-02-10T08:21:32.637594+0000","last_peered":"2024-02-10T08:21:32.637594+0000","last_clean":"2024-02-10T08:21:32.637594+0000","last_became_active":"2024-02-10T08:20:46.394169+0000","last_became_peered":"2024-02-10T08:20:46.394169+0000","last_unstale":"2024-02-10T08:21:32.637594+0000","last_undegraded":"2024-02-10T08:21:32.637594+0000","last_fullsized":"2024-02-10T08:21:32.637594+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:45.379932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:45.379932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":89,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.644625+0000","last_change":"2024-02-10T08:19:31.148600+0000","last_active":"2024-02-10T08:21:32.644625+0000","last_peered":"2024-02-10T08:21:32.644625+0000","last_clean":"2024-02-10T08:21:32.644625+0000","last_became_active":"2024-02-10T08:16:52.788195+0000","last_became_peered":"2024-02-10T08:16:52.788195+0000","last_unstale":"2024-02-10T08:21:32.644625+0000","last_undegraded":"2024-02-10T08:21:32.644625+0000","last_fullsized":"2024-02-10T08:21:32.644625+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:31.148535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:19:31.148535+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":88,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.636598+0000","last_change":"2024-02-10T08:19:34.283969+0000","last_active":"2024-02-10T08:21:32.636598+0000","last_peered":"2024-02-10T08:21:32.636598+0000","last_clean":"2024-02-10T08:21:32.636598+0000","last_became_active":"2024-02-10T08:16:52.788767+0000","last_became_peered":"2024-02-10T08:16:52.788767+0000","last_unstale":"2024-02-10T08:21:32.636598+0000","last_undegraded":"2024-02-10T08:21:32.636598+0000","last_fullsized":"2024-02-10T08:21:32.636598+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:34.283900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:19:34.283900+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":99,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.657804+0000","last_change":"2024-02-10T08:20:06.252519+0000","last_active":"2024-02-10T08:21:32.657804+0000","last_peered":"2024-02-10T08:21:32.657804+0000","last_clean":"2024-02-10T08:21:32.657804+0000","last_became_active":"2024-02-10T08:16:46.402267+0000","last_became_peered":"2024-02-10T08:16:46.402267+0000","last_unstale":"2024-02-10T08:21:32.657804+0000","last_undegraded":"2024-02-10T08:21:32.657804+0000","last_fullsized":"2024-02-10T08:21:32.657804+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:06.252449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:14:44.584370+0000","last_clean_scrub_stamp":"2024-02-10T08:20:06.252449+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"62'14","reported_seq":118,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.650179+0000","last_change":"2024-02-10T08:20:46.402358+0000","last_active":"2024-02-10T08:21:32.650179+0000","last_peered":"2024-02-10T08:21:32.650179+0000","last_clean":"2024-02-10T08:21:32.650179+0000","last_became_active":"2024-02-10T08:20:46.401981+0000","last_became_peered":"2024-02-10T08:20:46.401981+0000","last_unstale":"2024-02-10T08:21:32.650179+0000","last_undegraded":"2024-02-10T08:21:32.650179+0000","last_fullsized":"2024-02-10T08:21:32.650179+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'14","last_scrub_stamp":"2024-02-10T08:18:33.416365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:33.416365+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":15,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":84,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.656798+0000","last_change":"2024-02-10T08:19:34.226328+0000","last_active":"2024-02-10T08:21:32.656798+0000","last_peered":"2024-02-10T08:21:32.656798+0000","last_clean":"2024-02-10T08:21:32.656798+0000","last_became_active":"2024-02-10T08:16:56.867159+0000","last_became_peered":"2024-02-10T08:16:56.867159+0000","last_unstale":"2024-02-10T08:21:32.656798+0000","last_undegraded":"2024-02-10T08:21:32.656798+0000","last_fullsized":"2024-02-10T08:21:32.656798+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:34.226262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:04.766780+0000","last_clean_scrub_stamp":"2024-02-10T08:19:34.226262+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"125'7088","reported_seq":7130,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-02-10T08:21:37.454648+0000","last_change":"2024-02-10T08:19:39.841394+0000","last_active":"2024-02-10T08:21:37.454648+0000","last_peered":"2024-02-10T08:21:37.454648+0000","last_clean":"2024-02-10T08:21:37.454648+0000","last_became_active":"2024-02-10T08:19:39.841073+0000","last_became_peered":"2024-02-10T08:19:39.841073+0000","last_unstale":"2024-02-10T08:21:37.454648+0000","last_undegraded":"2024-02-10T08:21:37.454648+0000","last_fullsized":"2024-02-10T08:21:37.454648+0000","mapping_epoch":91,"log_start":"96'2200","ondisk_log_start":"96'2200","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_clean_scrub_stamp":"2024-02-10T08:19:38.813165+0000","log_size":4888,"ondisk_log_size":4888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":371195904,"num_objects":5664,"num_object_clones":0,"num_object_copies":16992,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5664,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7088,"num_write_kb":408064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,0],"acting":[7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":83,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.651084+0000","last_change":"2024-02-10T08:20:09.785179+0000","last_active":"2024-02-10T08:21:32.651084+0000","last_peered":"2024-02-10T08:21:32.651084+0000","last_clean":"2024-02-10T08:21:32.651084+0000","last_became_active":"2024-02-10T08:16:58.867593+0000","last_became_peered":"2024-02-10T08:16:58.867593+0000","last_unstale":"2024-02-10T08:21:32.651084+0000","last_undegraded":"2024-02-10T08:21:32.651084+0000","last_fullsized":"2024-02-10T08:21:32.651084+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:09.785096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:20:09.785096+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":100,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.662542+0000","last_change":"2024-02-10T08:20:46.398840+0000","last_active":"2024-02-10T08:21:32.662542+0000","last_peered":"2024-02-10T08:21:32.662542+0000","last_clean":"2024-02-10T08:21:32.662542+0000","last_became_active":"2024-02-10T08:20:46.398542+0000","last_became_peered":"2024-02-10T08:20:46.398542+0000","last_unstale":"2024-02-10T08:21:32.662542+0000","last_undegraded":"2024-02-10T08:21:32.662542+0000","last_fullsized":"2024-02-10T08:21:32.662542+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:20.736224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:20.736224+0000","last_clean_scrub_stamp":"2024-02-10T08:18:20.736224+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":88,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.657759+0000","last_change":"2024-02-10T08:20:12.387549+0000","last_active":"2024-02-10T08:21:32.657759+0000","last_peered":"2024-02-10T08:21:32.657759+0000","last_clean":"2024-02-10T08:21:32.657759+0000","last_became_active":"2024-02-10T08:16:52.787180+0000","last_became_peered":"2024-02-10T08:16:52.787180+0000","last_unstale":"2024-02-10T08:21:32.657759+0000","last_undegraded":"2024-02-10T08:21:32.657759+0000","last_fullsized":"2024-02-10T08:21:32.657759+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:12.387482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:20:12.387482+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"62'12","reported_seq":104,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.656435+0000","last_change":"2024-02-10T08:20:04.883379+0000","last_active":"2024-02-10T08:21:32.656435+0000","last_peered":"2024-02-10T08:21:32.656435+0000","last_clean":"2024-02-10T08:21:32.656435+0000","last_became_active":"2024-02-10T08:16:54.853330+0000","last_became_peered":"2024-02-10T08:16:54.853330+0000","last_unstale":"2024-02-10T08:21:32.656435+0000","last_undegraded":"2024-02-10T08:21:32.656435+0000","last_fullsized":"2024-02-10T08:21:32.656435+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'12","last_scrub_stamp":"2024-02-10T08:20:04.883293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:20:04.883293+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":84,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.637534+0000","last_change":"2024-02-10T08:20:08.318643+0000","last_active":"2024-02-10T08:21:32.637534+0000","last_peered":"2024-02-10T08:21:32.637534+0000","last_clean":"2024-02-10T08:21:32.637534+0000","last_became_active":"2024-02-10T08:16:56.864030+0000","last_became_peered":"2024-02-10T08:16:56.864030+0000","last_unstale":"2024-02-10T08:21:32.637534+0000","last_undegraded":"2024-02-10T08:21:32.637534+0000","last_fullsized":"2024-02-10T08:21:32.637534+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:08.318570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:41.360241+0000","last_clean_scrub_stamp":"2024-02-10T08:20:08.318570+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.0","version":"125'6974","reported_seq":7015,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-02-10T08:21:37.427500+0000","last_change":"2024-02-10T08:19:39.828087+0000","last_active":"2024-02-10T08:21:37.427500+0000","last_peered":"2024-02-10T08:21:37.427500+0000","last_clean":"2024-02-10T08:21:37.427500+0000","last_became_active":"2024-02-10T08:19:39.827835+0000","last_became_peered":"2024-02-10T08:19:39.827835+0000","last_unstale":"2024-02-10T08:21:37.427500+0000","last_undegraded":"2024-02-10T08:21:37.427500+0000","last_fullsized":"2024-02-10T08:21:37.427500+0000","mapping_epoch":91,"log_start":"95'1300","ondisk_log_start":"95'1300","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_clean_scrub_stamp":"2024-02-10T08:19:38.813165+0000","log_size":5674,"ondisk_log_size":5674,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":363069440,"num_objects":5540,"num_object_clones":0,"num_object_copies":16620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5540,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6974,"num_write_kb":400448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":83,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.644342+0000","last_change":"2024-02-10T08:19:25.568522+0000","last_active":"2024-02-10T08:21:32.644342+0000","last_peered":"2024-02-10T08:21:32.644342+0000","last_clean":"2024-02-10T08:21:32.644342+0000","last_became_active":"2024-02-10T08:16:58.891287+0000","last_became_peered":"2024-02-10T08:16:58.891287+0000","last_unstale":"2024-02-10T08:21:32.644342+0000","last_undegraded":"2024-02-10T08:21:32.644342+0000","last_fullsized":"2024-02-10T08:21:32.644342+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:25.568342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:19:25.568342+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":68,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.650021+0000","last_change":"2024-02-10T08:20:46.401459+0000","last_active":"2024-02-10T08:21:32.650021+0000","last_peered":"2024-02-10T08:21:32.650021+0000","last_clean":"2024-02-10T08:21:32.650021+0000","last_became_active":"2024-02-10T08:20:46.401149+0000","last_became_peered":"2024-02-10T08:20:46.401149+0000","last_unstale":"2024-02-10T08:21:32.650021+0000","last_undegraded":"2024-02-10T08:21:32.650021+0000","last_fullsized":"2024-02-10T08:21:32.650021+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:16.912336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:16.912336+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4],"acting":[2,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"62'19","reported_seq":122,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.655304+0000","last_change":"2024-02-10T08:20:01.822882+0000","last_active":"2024-02-10T08:21:32.655304+0000","last_peered":"2024-02-10T08:21:32.655304+0000","last_clean":"2024-02-10T08:21:32.655304+0000","last_became_active":"2024-02-10T08:16:55.203453+0000","last_became_peered":"2024-02-10T08:16:55.203453+0000","last_unstale":"2024-02-10T08:21:32.655304+0000","last_undegraded":"2024-02-10T08:21:32.655304+0000","last_fullsized":"2024-02-10T08:21:32.655304+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'19","last_scrub_stamp":"2024-02-10T08:20:01.822753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:20:01.822753+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":84,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.650078+0000","last_change":"2024-02-10T08:20:07.350344+0000","last_active":"2024-02-10T08:21:32.650078+0000","last_peered":"2024-02-10T08:21:32.650078+0000","last_clean":"2024-02-10T08:21:32.650078+0000","last_became_active":"2024-02-10T08:16:56.861172+0000","last_became_peered":"2024-02-10T08:16:56.861172+0000","last_unstale":"2024-02-10T08:21:32.650078+0000","last_undegraded":"2024-02-10T08:21:32.650078+0000","last_fullsized":"2024-02-10T08:21:32.650078+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:07.350256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:20:07.350256+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.3","version":"125'6967","reported_seq":7020,"reported_epoch":125,"state":"active+undersized+degraded+remapped+backfill_wait","last_fresh":"2024-02-10T08:21:37.515348+0000","last_change":"2024-02-10T08:20:47.982094+0000","last_active":"2024-02-10T08:21:37.515348+0000","last_peered":"2024-02-10T08:21:37.515348+0000","last_clean":"2024-02-10T08:19:38.813165+0000","last_became_active":"2024-02-10T08:20:47.844011+0000","last_became_peered":"2024-02-10T08:20:47.844011+0000","last_unstale":"2024-02-10T08:21:37.515348+0000","last_undegraded":"2024-02-10T08:20:47.406887+0000","last_fullsized":"2024-02-10T08:20:47.392565+0000","mapping_epoch":111,"log_start":"97'2200","ondisk_log_start":"97'2200","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_clean_scrub_stamp":"2024-02-10T08:19:38.813165+0000","log_size":4767,"ondisk_log_size":4767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":360644608,"num_objects":5503,"num_object_clones":0,"num_object_copies":16509,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":5503,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5503,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6967,"num_write_kb":399040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[{"shards":"2,3","objects":5503}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":70,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.644619+0000","last_change":"2024-02-10T08:20:46.398051+0000","last_active":"2024-02-10T08:21:32.644619+0000","last_peered":"2024-02-10T08:21:32.644619+0000","last_clean":"2024-02-10T08:21:32.644619+0000","last_became_active":"2024-02-10T08:20:46.397393+0000","last_became_peered":"2024-02-10T08:20:46.397393+0000","last_unstale":"2024-02-10T08:21:32.644619+0000","last_undegraded":"2024-02-10T08:21:32.644619+0000","last_fullsized":"2024-02-10T08:21:32.644619+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:22.216312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:19:22.216312+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":99,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.649040+0000","last_change":"2024-02-10T08:20:46.408082+0000","last_active":"2024-02-10T08:21:32.649040+0000","last_peered":"2024-02-10T08:21:32.649040+0000","last_clean":"2024-02-10T08:21:32.649040+0000","last_became_active":"2024-02-10T08:20:46.407667+0000","last_became_peered":"2024-02-10T08:20:46.407667+0000","last_unstale":"2024-02-10T08:21:32.649040+0000","last_undegraded":"2024-02-10T08:21:32.649040+0000","last_fullsized":"2024-02-10T08:21:32.649040+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:12.069322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:12.069322+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"62'18","reported_seq":114,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.645433+0000","last_change":"2024-02-10T08:18:41.077152+0000","last_active":"2024-02-10T08:21:32.645433+0000","last_peered":"2024-02-10T08:21:32.645433+0000","last_clean":"2024-02-10T08:21:32.645433+0000","last_became_active":"2024-02-10T08:16:55.204981+0000","last_became_peered":"2024-02-10T08:16:55.204981+0000","last_unstale":"2024-02-10T08:21:32.645433+0000","last_undegraded":"2024-02-10T08:21:32.645433+0000","last_fullsized":"2024-02-10T08:21:32.645433+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'18","last_scrub_stamp":"2024-02-10T08:18:41.077080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:41.077080+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":61,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.644924+0000","last_change":"2024-02-10T08:20:46.395373+0000","last_active":"2024-02-10T08:21:32.644924+0000","last_peered":"2024-02-10T08:21:32.644924+0000","last_clean":"2024-02-10T08:21:32.644924+0000","last_became_active":"2024-02-10T08:20:46.395070+0000","last_became_peered":"2024-02-10T08:20:46.395070+0000","last_unstale":"2024-02-10T08:21:32.644924+0000","last_undegraded":"2024-02-10T08:21:32.644924+0000","last_fullsized":"2024-02-10T08:21:32.644924+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:15.979973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:15.979973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"125'7053","reported_seq":7093,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-02-10T08:21:37.538337+0000","last_change":"2024-02-10T08:19:39.844259+0000","last_active":"2024-02-10T08:21:37.538337+0000","last_peered":"2024-02-10T08:21:37.538337+0000","last_clean":"2024-02-10T08:21:37.538337+0000","last_became_active":"2024-02-10T08:19:39.843993+0000","last_became_peered":"2024-02-10T08:19:39.843993+0000","last_unstale":"2024-02-10T08:21:37.538337+0000","last_undegraded":"2024-02-10T08:21:37.538337+0000","last_fullsized":"2024-02-10T08:21:37.538337+0000","mapping_epoch":91,"log_start":"97'2300","ondisk_log_start":"97'2300","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_clean_scrub_stamp":"2024-02-10T08:19:38.813165+0000","log_size":4753,"ondisk_log_size":4753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":372703232,"num_objects":5687,"num_object_clones":0,"num_object_copies":17061,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5687,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7053,"num_write_kb":407680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":82,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.656415+0000","last_change":"2024-02-10T08:20:22.273046+0000","last_active":"2024-02-10T08:21:32.656415+0000","last_peered":"2024-02-10T08:21:32.656415+0000","last_clean":"2024-02-10T08:21:32.656415+0000","last_became_active":"2024-02-10T08:16:58.893253+0000","last_became_peered":"2024-02-10T08:16:58.893253+0000","last_unstale":"2024-02-10T08:21:32.656415+0000","last_undegraded":"2024-02-10T08:21:32.656415+0000","last_fullsized":"2024-02-10T08:21:32.656415+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:22.272986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:20:22.272986+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":88,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.650376+0000","last_change":"2024-02-10T08:20:03.392639+0000","last_active":"2024-02-10T08:21:32.650376+0000","last_peered":"2024-02-10T08:21:32.650376+0000","last_clean":"2024-02-10T08:21:32.650376+0000","last_became_active":"2024-02-10T08:16:52.789020+0000","last_became_peered":"2024-02-10T08:16:52.789020+0000","last_unstale":"2024-02-10T08:21:32.650376+0000","last_undegraded":"2024-02-10T08:21:32.650376+0000","last_fullsized":"2024-02-10T08:21:32.650376+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:03.392561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:20:03.392561+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"62'14","reported_seq":80,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.644799+0000","last_change":"2024-02-10T08:20:46.401263+0000","last_active":"2024-02-10T08:21:32.644799+0000","last_peered":"2024-02-10T08:21:32.644799+0000","last_clean":"2024-02-10T08:21:32.644799+0000","last_became_active":"2024-02-10T08:20:46.400760+0000","last_became_peered":"2024-02-10T08:20:46.400760+0000","last_unstale":"2024-02-10T08:21:32.644799+0000","last_undegraded":"2024-02-10T08:21:32.644799+0000","last_fullsized":"2024-02-10T08:21:32.644799+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'14","last_scrub_stamp":"2024-02-10T08:18:10.980421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:10.980421+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"111'10","reported_seq":162,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-02-10T08:21:33.673451+0000","last_change":"2024-02-10T08:20:46.392755+0000","last_active":"2024-02-10T08:21:33.673451+0000","last_peered":"2024-02-10T08:21:33.673451+0000","last_clean":"2024-02-10T08:21:33.673451+0000","last_became_active":"2024-02-10T08:20:46.391243+0000","last_became_peered":"2024-02-10T08:20:46.391243+0000","last_unstale":"2024-02-10T08:21:33.673451+0000","last_undegraded":"2024-02-10T08:21:33.673451+0000","last_fullsized":"2024-02-10T08:21:33.673451+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'8","last_scrub_stamp":"2024-02-10T08:18:30.090065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:30.090065+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"125'7056","reported_seq":7099,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-02-10T08:21:37.460061+0000","last_change":"2024-02-10T08:19:39.826713+0000","last_active":"2024-02-10T08:21:37.460061+0000","last_peered":"2024-02-10T08:21:37.460061+0000","last_clean":"2024-02-10T08:21:37.460061+0000","last_became_active":"2024-02-10T08:19:39.826451+0000","last_became_peered":"2024-02-10T08:19:39.826451+0000","last_unstale":"2024-02-10T08:21:37.460061+0000","last_undegraded":"2024-02-10T08:21:37.460061+0000","last_fullsized":"2024-02-10T08:21:37.460061+0000","mapping_epoch":91,"log_start":"95'900","ondisk_log_start":"95'900","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_clean_scrub_stamp":"2024-02-10T08:19:38.813165+0000","log_size":6156,"ondisk_log_size":6156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":365101080,"num_objects":5572,"num_object_clones":0,"num_object_copies":16716,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5572,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7056,"num_write_kb":404033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,0],"acting":[6,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":83,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.646169+0000","last_change":"2024-02-10T08:20:30.227463+0000","last_active":"2024-02-10T08:21:32.646169+0000","last_peered":"2024-02-10T08:21:32.646169+0000","last_clean":"2024-02-10T08:21:32.646169+0000","last_became_active":"2024-02-10T08:16:58.891261+0000","last_became_peered":"2024-02-10T08:16:58.891261+0000","last_unstale":"2024-02-10T08:21:32.646169+0000","last_undegraded":"2024-02-10T08:21:32.646169+0000","last_fullsized":"2024-02-10T08:21:32.646169+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:30.227375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:20:30.227375+0000","last_clean_scrub_stamp":"2024-02-10T08:20:30.227375+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":126,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.637458+0000","last_change":"2024-02-10T08:21:31.368482+0000","last_active":"2024-02-10T08:21:32.637458+0000","last_peered":"2024-02-10T08:21:32.637458+0000","last_clean":"2024-02-10T08:21:32.637458+0000","last_became_active":"2024-02-10T08:20:46.400500+0000","last_became_peered":"2024-02-10T08:20:46.400500+0000","last_unstale":"2024-02-10T08:21:32.637458+0000","last_undegraded":"2024-02-10T08:21:32.637458+0000","last_fullsized":"2024-02-10T08:21:32.637458+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:25.442097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:25.442097+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":88,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.657812+0000","last_change":"2024-02-10T08:20:01.263757+0000","last_active":"2024-02-10T08:21:32.657812+0000","last_peered":"2024-02-10T08:21:32.657812+0000","last_clean":"2024-02-10T08:21:32.657812+0000","last_became_active":"2024-02-10T08:16:52.786822+0000","last_became_peered":"2024-02-10T08:16:52.786822+0000","last_unstale":"2024-02-10T08:21:32.657812+0000","last_undegraded":"2024-02-10T08:21:32.657812+0000","last_fullsized":"2024-02-10T08:21:32.657812+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:01.263661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:20:01.263661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"76'16","reported_seq":98,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.645081+0000","last_change":"2024-02-10T08:20:46.406601+0000","last_active":"2024-02-10T08:21:32.645081+0000","last_peered":"2024-02-10T08:21:32.645081+0000","last_clean":"2024-02-10T08:21:32.645081+0000","last_became_active":"2024-02-10T08:20:46.406023+0000","last_became_peered":"2024-02-10T08:20:46.406023+0000","last_unstale":"2024-02-10T08:21:32.645081+0000","last_undegraded":"2024-02-10T08:21:32.645081+0000","last_fullsized":"2024-02-10T08:21:32.645081+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'16","last_scrub_stamp":"2024-02-10T08:19:24.195140+0000","last_deep_scrub":"76'16","last_deep_scrub_stamp":"2024-02-10T08:18:07.909782+0000","last_clean_scrub_stamp":"2024-02-10T08:19:24.195140+0000","log_size":16,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"125'7225","reported_seq":7266,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-02-10T08:21:37.430893+0000","last_change":"2024-02-10T08:19:39.830160+0000","last_active":"2024-02-10T08:21:37.430893+0000","last_peered":"2024-02-10T08:21:37.430893+0000","last_clean":"2024-02-10T08:21:37.430893+0000","last_became_active":"2024-02-10T08:19:39.829875+0000","last_became_peered":"2024-02-10T08:19:39.829875+0000","last_unstale":"2024-02-10T08:21:37.430893+0000","last_undegraded":"2024-02-10T08:21:37.430893+0000","last_fullsized":"2024-02-10T08:21:37.430893+0000","mapping_epoch":91,"log_start":"95'1100","ondisk_log_start":"95'1100","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_clean_scrub_stamp":"2024-02-10T08:19:38.813165+0000","log_size":6125,"ondisk_log_size":6125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":374407168,"num_objects":5713,"num_object_clones":0,"num_object_copies":17139,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5713,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7225,"num_write_kb":414016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":82,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.637141+0000","last_change":"2024-02-10T08:20:03.250648+0000","last_active":"2024-02-10T08:21:32.637141+0000","last_peered":"2024-02-10T08:21:32.637141+0000","last_clean":"2024-02-10T08:21:32.637141+0000","last_became_active":"2024-02-10T08:16:58.859956+0000","last_became_peered":"2024-02-10T08:16:58.859956+0000","last_unstale":"2024-02-10T08:21:32.637141+0000","last_undegraded":"2024-02-10T08:21:32.637141+0000","last_fullsized":"2024-02-10T08:21:32.637141+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:03.250587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:20:03.250587+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"111'10","reported_seq":101,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-02-10T08:21:33.662312+0000","last_change":"2024-02-10T08:20:46.402756+0000","last_active":"2024-02-10T08:21:33.662312+0000","last_peered":"2024-02-10T08:21:33.662312+0000","last_clean":"2024-02-10T08:21:33.662312+0000","last_became_active":"2024-02-10T08:20:46.401894+0000","last_became_peered":"2024-02-10T08:20:46.401894+0000","last_unstale":"2024-02-10T08:21:33.662312+0000","last_undegraded":"2024-02-10T08:21:33.662312+0000","last_fullsized":"2024-02-10T08:21:33.662312+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'8","last_scrub_stamp":"2024-02-10T08:18:28.991446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:28.991446+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":89,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.644185+0000","last_change":"2024-02-10T08:20:04.745454+0000","last_active":"2024-02-10T08:21:32.644185+0000","last_peered":"2024-02-10T08:21:32.644185+0000","last_clean":"2024-02-10T08:21:32.644185+0000","last_became_active":"2024-02-10T08:16:52.783634+0000","last_became_peered":"2024-02-10T08:16:52.783634+0000","last_unstale":"2024-02-10T08:21:32.644185+0000","last_undegraded":"2024-02-10T08:21:32.644185+0000","last_fullsized":"2024-02-10T08:21:32.644185+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:04.745360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:20:04.745360+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"62'15","reported_seq":89,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.649860+0000","last_change":"2024-02-10T08:20:46.402507+0000","last_active":"2024-02-10T08:21:32.649860+0000","last_peered":"2024-02-10T08:21:32.649860+0000","last_clean":"2024-02-10T08:21:32.649860+0000","last_became_active":"2024-02-10T08:20:46.401777+0000","last_became_peered":"2024-02-10T08:20:46.401777+0000","last_unstale":"2024-02-10T08:21:32.649860+0000","last_undegraded":"2024-02-10T08:21:32.649860+0000","last_fullsized":"2024-02-10T08:21:32.649860+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'15","last_scrub_stamp":"2024-02-10T08:18:19.720164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:19.720164+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"125'6988","reported_seq":7030,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-02-10T08:21:37.682490+0000","last_change":"2024-02-10T08:19:39.833126+0000","last_active":"2024-02-10T08:21:37.682490+0000","last_peered":"2024-02-10T08:21:37.682490+0000","last_clean":"2024-02-10T08:21:37.682490+0000","last_became_active":"2024-02-10T08:19:39.832691+0000","last_became_peered":"2024-02-10T08:19:39.832691+0000","last_unstale":"2024-02-10T08:21:37.682490+0000","last_undegraded":"2024-02-10T08:21:37.682490+0000","last_fullsized":"2024-02-10T08:21:37.682490+0000","mapping_epoch":91,"log_start":"96'1500","ondisk_log_start":"96'1500","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_clean_scrub_stamp":"2024-02-10T08:19:38.813165+0000","log_size":5488,"ondisk_log_size":5488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":361496576,"num_objects":5516,"num_object_clones":0,"num_object_copies":16548,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5516,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6988,"num_write_kb":400128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":53,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.645239+0000","last_change":"2024-02-10T08:20:46.406374+0000","last_active":"2024-02-10T08:21:32.645239+0000","last_peered":"2024-02-10T08:21:32.645239+0000","last_clean":"2024-02-10T08:21:32.645239+0000","last_became_active":"2024-02-10T08:20:46.405578+0000","last_became_peered":"2024-02-10T08:20:46.405578+0000","last_unstale":"2024-02-10T08:21:32.645239+0000","last_undegraded":"2024-02-10T08:21:32.645239+0000","last_fullsized":"2024-02-10T08:21:32.645239+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:17:59.857977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:17:59.857977+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"62'8","reported_seq":150,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-02-10T08:21:33.678691+0000","last_change":"2024-02-10T08:19:24.859730+0000","last_active":"2024-02-10T08:21:33.678691+0000","last_peered":"2024-02-10T08:21:33.678691+0000","last_clean":"2024-02-10T08:21:33.678691+0000","last_became_active":"2024-02-10T08:16:56.858101+0000","last_became_peered":"2024-02-10T08:16:56.858101+0000","last_unstale":"2024-02-10T08:21:33.678691+0000","last_undegraded":"2024-02-10T08:21:33.678691+0000","last_fullsized":"2024-02-10T08:21:33.678691+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'8","last_scrub_stamp":"2024-02-10T08:19:24.859657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:19:24.859657+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":89,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.647272+0000","last_change":"2024-02-10T08:19:31.561674+0000","last_active":"2024-02-10T08:21:32.647272+0000","last_peered":"2024-02-10T08:21:32.647272+0000","last_clean":"2024-02-10T08:21:32.647272+0000","last_became_active":"2024-02-10T08:16:52.785545+0000","last_became_peered":"2024-02-10T08:16:52.785545+0000","last_unstale":"2024-02-10T08:21:32.647272+0000","last_undegraded":"2024-02-10T08:21:32.647272+0000","last_fullsized":"2024-02-10T08:21:32.647272+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:31.561534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:19:31.561534+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"62'10","reported_seq":88,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.644783+0000","last_change":"2024-02-10T08:20:46.399522+0000","last_active":"2024-02-10T08:21:32.644783+0000","last_peered":"2024-02-10T08:21:32.644783+0000","last_clean":"2024-02-10T08:21:32.644783+0000","last_became_active":"2024-02-10T08:20:46.398973+0000","last_became_peered":"2024-02-10T08:20:46.398973+0000","last_unstale":"2024-02-10T08:21:32.644783+0000","last_undegraded":"2024-02-10T08:21:32.644783+0000","last_fullsized":"2024-02-10T08:21:32.644783+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'10","last_scrub_stamp":"2024-02-10T08:19:16.196834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:19:16.196834+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"125'6981","reported_seq":7023,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-02-10T08:21:37.583703+0000","last_change":"2024-02-10T08:19:39.847131+0000","last_active":"2024-02-10T08:21:37.583703+0000","last_peered":"2024-02-10T08:21:37.583703+0000","last_clean":"2024-02-10T08:21:37.583703+0000","last_became_active":"2024-02-10T08:19:39.846850+0000","last_became_peered":"2024-02-10T08:19:39.846850+0000","last_unstale":"2024-02-10T08:21:37.583703+0000","last_undegraded":"2024-02-10T08:21:37.583703+0000","last_fullsized":"2024-02-10T08:21:37.583703+0000","mapping_epoch":91,"log_start":"95'400","ondisk_log_start":"95'400","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_clean_scrub_stamp":"2024-02-10T08:19:38.813165+0000","log_size":6581,"ondisk_log_size":6581,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":366149632,"num_objects":5587,"num_object_clones":0,"num_object_copies":16761,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5587,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6981,"num_write_kb":402176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":93,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.649996+0000","last_change":"2024-02-10T08:20:46.402693+0000","last_active":"2024-02-10T08:21:32.649996+0000","last_peered":"2024-02-10T08:21:32.649996+0000","last_clean":"2024-02-10T08:21:32.649996+0000","last_became_active":"2024-02-10T08:20:46.402181+0000","last_became_peered":"2024-02-10T08:20:46.402181+0000","last_unstale":"2024-02-10T08:21:32.649996+0000","last_undegraded":"2024-02-10T08:21:32.649996+0000","last_fullsized":"2024-02-10T08:21:32.649996+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:17.709697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:17.709697+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":95,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.651004+0000","last_change":"2024-02-10T08:20:46.407303+0000","last_active":"2024-02-10T08:21:32.651004+0000","last_peered":"2024-02-10T08:21:32.651004+0000","last_clean":"2024-02-10T08:21:32.651004+0000","last_became_active":"2024-02-10T08:20:46.406971+0000","last_became_peered":"2024-02-10T08:20:46.406971+0000","last_unstale":"2024-02-10T08:21:32.651004+0000","last_undegraded":"2024-02-10T08:21:32.651004+0000","last_fullsized":"2024-02-10T08:21:32.651004+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:37.273476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:37.273476+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":103,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.656206+0000","last_change":"2024-02-10T08:20:46.399889+0000","last_active":"2024-02-10T08:21:32.656206+0000","last_peered":"2024-02-10T08:21:32.656206+0000","last_clean":"2024-02-10T08:21:32.656206+0000","last_became_active":"2024-02-10T08:20:46.399568+0000","last_became_peered":"2024-02-10T08:20:46.399568+0000","last_unstale":"2024-02-10T08:21:32.656206+0000","last_undegraded":"2024-02-10T08:21:32.656206+0000","last_fullsized":"2024-02-10T08:21:32.656206+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:22.228064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:19:22.228064+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"62'17","reported_seq":129,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.644852+0000","last_change":"2024-02-10T08:20:46.396386+0000","last_active":"2024-02-10T08:21:32.644852+0000","last_peered":"2024-02-10T08:21:32.644852+0000","last_clean":"2024-02-10T08:21:32.644852+0000","last_became_active":"2024-02-10T08:20:46.395694+0000","last_became_peered":"2024-02-10T08:20:46.395694+0000","last_unstale":"2024-02-10T08:21:32.644852+0000","last_undegraded":"2024-02-10T08:21:32.644852+0000","last_fullsized":"2024-02-10T08:21:32.644852+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'17","last_scrub_stamp":"2024-02-10T08:19:26.245091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:19:26.245091+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":28,"num_read_kb":18,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.9","version":"125'7076","reported_seq":8282,"reported_epoch":125,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-02-10T08:21:37.781927+0000","last_change":"2024-02-10T08:20:47.981923+0000","last_active":"2024-02-10T08:21:37.781927+0000","last_peered":"2024-02-10T08:21:37.781927+0000","last_clean":"2024-02-10T08:19:38.813165+0000","last_became_active":"2024-02-10T08:20:47.908798+0000","last_became_peered":"2024-02-10T08:20:47.908798+0000","last_unstale":"2024-02-10T08:21:37.781927+0000","last_undegraded":"2024-02-10T08:20:47.430669+0000","last_fullsized":"2024-02-10T08:20:47.388200+0000","mapping_epoch":111,"log_start":"96'1600","ondisk_log_start":"96'1600","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_clean_scrub_stamp":"2024-02-10T08:19:38.813165+0000","log_size":5476,"ondisk_log_size":5476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":369098752,"num_objects":5632,"num_object_clones":0,"num_object_copies":16896,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":4488,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5632,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7076,"num_write_kb":406656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":580,"num_bytes_recovered":38010880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0,1","objects":1144}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":82,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.657760+0000","last_change":"2024-02-10T08:19:24.200005+0000","last_active":"2024-02-10T08:21:32.657760+0000","last_peered":"2024-02-10T08:21:32.657760+0000","last_clean":"2024-02-10T08:21:32.657760+0000","last_became_active":"2024-02-10T08:16:58.866831+0000","last_became_peered":"2024-02-10T08:16:58.866831+0000","last_unstale":"2024-02-10T08:21:32.657760+0000","last_undegraded":"2024-02-10T08:21:32.657760+0000","last_fullsized":"2024-02-10T08:21:32.657760+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:24.199920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:19:24.199920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":85,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.650465+0000","last_change":"2024-02-10T08:19:30.942724+0000","last_active":"2024-02-10T08:21:32.650465+0000","last_peered":"2024-02-10T08:21:32.650465+0000","last_clean":"2024-02-10T08:21:32.650465+0000","last_became_active":"2024-02-10T08:16:56.864026+0000","last_became_peered":"2024-02-10T08:16:56.864026+0000","last_unstale":"2024-02-10T08:21:32.650465+0000","last_undegraded":"2024-02-10T08:21:32.650465+0000","last_fullsized":"2024-02-10T08:21:32.650465+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:30.942646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:19:30.942646+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":94,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.649548+0000","last_change":"2024-02-10T08:20:21.977157+0000","last_active":"2024-02-10T08:21:32.649548+0000","last_peered":"2024-02-10T08:21:32.649548+0000","last_clean":"2024-02-10T08:21:32.649548+0000","last_became_active":"2024-02-10T08:16:52.789100+0000","last_became_peered":"2024-02-10T08:16:52.789100+0000","last_unstale":"2024-02-10T08:21:32.649548+0000","last_undegraded":"2024-02-10T08:21:32.649548+0000","last_fullsized":"2024-02-10T08:21:32.649548+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:21.977065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:20:21.977065+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"62'19","reported_seq":117,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.649932+0000","last_change":"2024-02-10T08:20:01.351638+0000","last_active":"2024-02-10T08:21:32.649932+0000","last_peered":"2024-02-10T08:21:32.649932+0000","last_clean":"2024-02-10T08:21:32.649932+0000","last_became_active":"2024-02-10T08:16:55.203415+0000","last_became_peered":"2024-02-10T08:16:55.203415+0000","last_unstale":"2024-02-10T08:21:32.649932+0000","last_undegraded":"2024-02-10T08:21:32.649932+0000","last_fullsized":"2024-02-10T08:21:32.649932+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'19","last_scrub_stamp":"2024-02-10T08:20:01.351573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:20:01.351573+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.8","version":"125'6877","reported_seq":11053,"reported_epoch":125,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-02-10T08:21:37.599359+0000","last_change":"2024-02-10T08:20:47.918334+0000","last_active":"2024-02-10T08:21:37.599359+0000","last_peered":"2024-02-10T08:21:37.599359+0000","last_clean":"2024-02-10T08:19:38.813165+0000","last_became_active":"2024-02-10T08:20:47.896245+0000","last_became_peered":"2024-02-10T08:20:47.896245+0000","last_unstale":"2024-02-10T08:21:37.599359+0000","last_undegraded":"2024-02-10T08:20:47.427105+0000","last_fullsized":"2024-02-10T08:20:47.389351+0000","mapping_epoch":111,"log_start":"95'300","ondisk_log_start":"95'300","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_clean_scrub_stamp":"2024-02-10T08:19:38.813165+0000","log_size":6577,"ondisk_log_size":6577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":360513536,"num_objects":5501,"num_object_clones":0,"num_object_copies":16503,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2857,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5501,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6877,"num_write_kb":396096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2065,"num_bytes_recovered":135331840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4],"acting":[2,7],"avail_no_missing":["2","7"],"object_location_counts":[{"shards":"2,7","objects":2644}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"76'2","reported_seq":84,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.662838+0000","last_change":"2024-02-10T08:19:28.458200+0000","last_active":"2024-02-10T08:21:32.662838+0000","last_peered":"2024-02-10T08:21:32.662838+0000","last_clean":"2024-02-10T08:21:32.662838+0000","last_became_active":"2024-02-10T08:16:58.860294+0000","last_became_peered":"2024-02-10T08:16:58.860294+0000","last_unstale":"2024-02-10T08:21:32.662838+0000","last_undegraded":"2024-02-10T08:21:32.662838+0000","last_fullsized":"2024-02-10T08:21:32.662838+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'2","last_scrub_stamp":"2024-02-10T08:19:28.458129+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2024-02-10T08:18:08.680038+0000","last_clean_scrub_stamp":"2024-02-10T08:19:28.458129+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":95,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.649508+0000","last_change":"2024-02-10T08:20:46.402430+0000","last_active":"2024-02-10T08:21:32.649508+0000","last_peered":"2024-02-10T08:21:32.649508+0000","last_clean":"2024-02-10T08:21:32.649508+0000","last_became_active":"2024-02-10T08:20:46.402072+0000","last_became_peered":"2024-02-10T08:20:46.402072+0000","last_unstale":"2024-02-10T08:21:32.649508+0000","last_undegraded":"2024-02-10T08:21:32.649508+0000","last_fullsized":"2024-02-10T08:21:32.649508+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:27.611094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:27.611094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":104,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.650127+0000","last_change":"2024-02-10T08:20:46.407715+0000","last_active":"2024-02-10T08:21:32.650127+0000","last_peered":"2024-02-10T08:21:32.650127+0000","last_clean":"2024-02-10T08:21:32.650127+0000","last_became_active":"2024-02-10T08:20:46.407311+0000","last_became_peered":"2024-02-10T08:20:46.407311+0000","last_unstale":"2024-02-10T08:21:32.650127+0000","last_undegraded":"2024-02-10T08:21:32.650127+0000","last_fullsized":"2024-02-10T08:21:32.650127+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:21.523096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:21.523096+0000","last_clean_scrub_stamp":"2024-02-10T08:19:21.523096+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"62'9","reported_seq":112,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.655521+0000","last_change":"2024-02-10T08:20:46.403104+0000","last_active":"2024-02-10T08:21:32.655521+0000","last_peered":"2024-02-10T08:21:32.655521+0000","last_clean":"2024-02-10T08:21:32.655521+0000","last_became_active":"2024-02-10T08:20:46.402749+0000","last_became_peered":"2024-02-10T08:20:46.402749+0000","last_unstale":"2024-02-10T08:21:32.655521+0000","last_undegraded":"2024-02-10T08:21:32.655521+0000","last_fullsized":"2024-02-10T08:21:32.655521+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'9","last_scrub_stamp":"2024-02-10T08:18:14.705229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:14.705229+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"125'7058","reported_seq":7100,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-02-10T08:21:37.481185+0000","last_change":"2024-02-10T08:19:39.829202+0000","last_active":"2024-02-10T08:21:37.481185+0000","last_peered":"2024-02-10T08:21:37.481185+0000","last_clean":"2024-02-10T08:21:37.481185+0000","last_became_active":"2024-02-10T08:19:39.828947+0000","last_became_peered":"2024-02-10T08:19:39.828947+0000","last_unstale":"2024-02-10T08:21:37.481185+0000","last_undegraded":"2024-02-10T08:21:37.481185+0000","last_fullsized":"2024-02-10T08:21:37.481185+0000","mapping_epoch":91,"log_start":"96'1800","ondisk_log_start":"96'1800","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:38.813165+0000","last_clean_scrub_stamp":"2024-02-10T08:19:38.813165+0000","log_size":5258,"ondisk_log_size":5258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":369754112,"num_objects":5642,"num_object_clones":0,"num_object_copies":16926,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5642,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7058,"num_write_kb":406400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[1,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":82,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.636373+0000","last_change":"2024-02-10T08:19:20.392327+0000","last_active":"2024-02-10T08:21:32.636373+0000","last_peered":"2024-02-10T08:21:32.636373+0000","last_clean":"2024-02-10T08:21:32.636373+0000","last_became_active":"2024-02-10T08:16:58.891260+0000","last_became_peered":"2024-02-10T08:16:58.891260+0000","last_unstale":"2024-02-10T08:21:32.636373+0000","last_undegraded":"2024-02-10T08:21:32.636373+0000","last_fullsized":"2024-02-10T08:21:32.636373+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:20.392249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:20.392249+0000","last_clean_scrub_stamp":"2024-02-10T08:19:20.392249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":94,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.649514+0000","last_change":"2024-02-10T08:20:24.969410+0000","last_active":"2024-02-10T08:21:32.649514+0000","last_peered":"2024-02-10T08:21:32.649514+0000","last_clean":"2024-02-10T08:21:32.649514+0000","last_became_active":"2024-02-10T08:16:52.785754+0000","last_became_peered":"2024-02-10T08:16:52.785754+0000","last_unstale":"2024-02-10T08:21:32.649514+0000","last_undegraded":"2024-02-10T08:21:32.649514+0000","last_fullsized":"2024-02-10T08:21:32.649514+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:24.969327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:20:24.969327+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"62'15","reported_seq":111,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-02-10T08:21:32.639991+0000","last_change":"2024-02-10T08:20:05.314332+0000","last_active":"2024-02-10T08:21:32.639991+0000","last_peered":"2024-02-10T08:21:32.639991+0000","last_clean":"2024-02-10T08:21:32.639991+0000","last_became_active":"2024-02-10T08:16:55.204597+0000","last_became_peered":"2024-02-10T08:16:55.204597+0000","last_unstale":"2024-02-10T08:21:32.639991+0000","last_undegraded":"2024-02-10T08:21:32.639991+0000","last_fullsized":"2024-02-10T08:21:32.639991+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'15","last_scrub_stamp":"2024-02-10T08:20:05.314225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:20:05.314225+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"111'10","reported_seq":161,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-02-10T08:21:33.687559+0000","last_change":"2024-02-10T08:20:46.399807+0000","last_active":"2024-02-10T08:21:33.687559+0000","last_peered":"2024-02-10T08:21:33.687559+0000","last_clean":"2024-02-10T08:21:33.687559+0000","last_became_active":"2024-02-10T08:20:46.399193+0000","last_became_peered":"2024-02-10T08:20:46.399193+0000","last_unstale":"2024-02-10T08:21:33.687559+0000","last_undegraded":"2024-02-10T08:21:33.687559+0000","last_fullsized":"2024-02-10T08:21:33.687559+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'8","last_scrub_stamp":"2024-02-10T08:18:29.052907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:29.052907+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":5866192920,"num_objects":89512,"num_object_clones":0,"num_object_copies":268536,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":21868,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89512,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":112340,"num_write_kb":6459201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4267,"num_bytes_recovered":279642112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16175869952,"data_stored":16175857736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":88440,"ondisk_log_size":88440,"up":48,"acting":43,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":3},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":277,"num_read_kb":272,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":9,"acting":9,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":691,"num_read_kb":448,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":411,"ondisk_log_size":411,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":96,"acting":96,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":50,"seq":214748364861,"num_pgs":62,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2096296,"kb_used_data":1790880,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":91648856,"statfs":{"total":95995035648,"available":93848428544,"internally_reserved":0,"allocated":1833861120,"data_stored":1833321789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,0,0,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:20:51 2024","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":0.65800000000000003,"15min":0.54800000000000004},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":8.7850000000000001,"5min":8.7850000000000001,"15min":8.7850000000000001},"last":0.249},{"interface":"front","average":{"1min":1.768,"5min":0.77000000000000002,"15min":0.58199999999999996},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":9.7629999999999999,"5min":9.7629999999999999,"15min":9.7629999999999999},"last":2.0550000000000002}]},{"osd":1,"last update":"Sat Feb 10 08:20:51 2024","interfaces":[{"interface":"back","average":{"1min":1.609,"5min":0.73899999999999999,"15min":0.58399999999999996},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":8.6500000000000004,"5min":8.6500000000000004,"15min":8.6500000000000004},"last":0.34699999999999998},{"interface":"front","average":{"1min":1.5289999999999999,"5min":0.71999999999999997,"15min":0.58599999999999997},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":8.7300000000000004,"5min":8.7300000000000004,"15min":8.7300000000000004},"last":0.32500000000000001}]},{"osd":2,"last update":"Sat Feb 10 08:20:51 2024","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":0.628,"15min":0.53500000000000003},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":3.1909999999999998,"5min":3.1909999999999998,"15min":3.1909999999999998},"last":0.41299999999999998},{"interface":"front","average":{"1min":1.5429999999999999,"5min":0.73799999999999999,"15min":0.59799999999999998},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":6.4969999999999999,"5min":6.4969999999999999,"15min":6.4969999999999999},"last":6.5220000000000002}]},{"osd":3,"last update":"Sat Feb 10 08:20:51 2024","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":0.68600000000000005,"15min":0.57399999999999995},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":8.766,"5min":8.766,"15min":8.766},"last":0.36299999999999999},{"interface":"front","average":{"1min":2.4279999999999999,"5min":0.91600000000000004,"15min":0.65200000000000002},"min":{"1min":0.35499999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":9.5719999999999992,"5min":9.5719999999999992,"15min":9.5719999999999992},"last":1.3859999999999999}]},{"osd":4,"last update":"Sat Feb 10 08:18:45 2024","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.40300000000000002,"15min":0.40100000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.56599999999999995,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.309},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.433,"15min":0.42999999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.58999999999999997,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.29199999999999998}]},{"osd":5,"last update":"Sat Feb 10 08:20:51 2024","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.432,"15min":0.41799999999999998},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.32300000000000001,"5min":0.44500000000000001,"15min":0.45300000000000001},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.372}]},{"osd":6,"last update":"Sat Feb 10 08:20:51 2024","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.45900000000000002,"15min":0.44500000000000001},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.47199999999999998,"15min":0.46800000000000003},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.86599999999999999,"5min":1.22,"15min":1.22},"last":0.38500000000000001}]}]},{"osd":6,"up_from":43,"seq":184683593794,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2117904,"kb_used_data":1812488,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":91627248,"statfs":{"total":95995035648,"available":93826301952,"internally_reserved":0,"allocated":1855987712,"data_stored":1855472611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,4],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:21:29 2024","interfaces":[{"interface":"back","average":{"1min":5.2869999999999999,"5min":1.633,"15min":0.90500000000000003},"min":{"1min":0.245,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":23.268999999999998,"5min":23.268999999999998,"15min":23.268999999999998},"last":3.145},{"interface":"front","average":{"1min":3.1920000000000002,"5min":1.1679999999999999,"15min":0.76000000000000001},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":11.768000000000001,"5min":11.768000000000001,"15min":11.768000000000001},"last":0.84199999999999997}]},{"osd":1,"last update":"Sat Feb 10 08:21:29 2024","interfaces":[{"interface":"back","average":{"1min":1.891,"5min":0.85299999999999998,"15min":0.65300000000000002},"min":{"1min":0.252,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":8.3130000000000006,"5min":8.3130000000000006,"15min":8.3130000000000006},"last":1.2609999999999999},{"interface":"front","average":{"1min":2.952,"5min":1.083,"15min":0.74299999999999999},"min":{"1min":0.27000000000000002,"5min":0.247,"15min":0.247},"max":{"1min":10.256,"5min":10.256,"15min":10.256},"last":4.2709999999999999}]},{"osd":2,"last update":"Sat Feb 10 08:21:29 2024","interfaces":[{"interface":"back","average":{"1min":2.3889999999999998,"5min":1.036,"15min":0.73299999999999998},"min":{"1min":0.29099999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":11.273999999999999,"5min":11.273999999999999,"15min":11.273999999999999},"last":0.95899999999999996},{"interface":"front","average":{"1min":2.3559999999999999,"5min":1.0329999999999999,"15min":0.73199999999999998},"min":{"1min":0.28899999999999998,"5min":0.247,"15min":0.247},"max":{"1min":11.288,"5min":11.288,"15min":11.288},"last":0.94599999999999995}]},{"osd":3,"last update":"Sat Feb 10 08:21:29 2024","interfaces":[{"interface":"back","average":{"1min":1.704,"5min":0.85199999999999998,"15min":0.66200000000000003},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":5.2359999999999998,"5min":5.2359999999999998,"15min":5.2359999999999998},"last":2.851},{"interface":"front","average":{"1min":1.7549999999999999,"5min":0.89800000000000002,"15min":0.67200000000000004},"min":{"1min":0.314,"5min":0.308,"15min":0.308},"max":{"1min":9.1850000000000005,"5min":9.1850000000000005,"15min":9.1850000000000005},"last":0.40899999999999997}]},{"osd":4,"last update":"Sat Feb 10 08:19:27 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.45500000000000002,"15min":0.44900000000000001},"min":{"1min":0.29699999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.751,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.317},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.47799999999999998,"15min":0.46800000000000003},"min":{"1min":0.33500000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.71899999999999997,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.312}]},{"osd":5,"last update":"Sat Feb 10 08:21:29 2024","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.435,"15min":0.44500000000000001},"min":{"1min":0.21299999999999999,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.52600000000000002,"15min":0.47599999999999998},"min":{"1min":0.27000000000000002,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":4.2720000000000002,"5min":4.2720000000000002,"15min":4.2720000000000002},"last":0.28199999999999997}]},{"osd":7,"last update":"Sat Feb 10 08:20:54 2024","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.495,"15min":0.52100000000000002},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.53500000000000003,"15min":0.56100000000000005},"min":{"1min":0.28799999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.88200000000000001,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.33500000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574937,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2481960,"kb_used_data":2168352,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":91263192,"statfs":{"total":95995035648,"available":93453508608,"internally_reserved":0,"allocated":2220392448,"data_stored":2219852585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:21:26 2024","interfaces":[{"interface":"back","average":{"1min":4.4470000000000001,"5min":1.367,"15min":0.66200000000000003},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":16.030999999999999,"5min":16.030999999999999,"15min":16.030999999999999},"last":5.9710000000000001},{"interface":"front","average":{"1min":5.3019999999999996,"5min":1.696,"15min":0.78000000000000003},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.20999999999999999},"max":{"1min":17.684999999999999,"5min":17.684999999999999,"15min":17.684999999999999},"last":0.36799999999999999}]},{"osd":2,"last update":"Sat Feb 10 08:20:56 2024","interfaces":[{"interface":"back","average":{"1min":4.3650000000000002,"5min":1.306,"15min":0.67200000000000004},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":29.084,"5min":29.084,"15min":29.084},"last":0.55400000000000005},{"interface":"front","average":{"1min":3.778,"5min":1.1679999999999999,"15min":0.63100000000000001},"min":{"1min":0.312,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":29.131,"5min":29.131,"15min":29.131},"last":1.415}]},{"osd":3,"last update":"Sat Feb 10 08:21:17 2024","interfaces":[{"interface":"back","average":{"1min":4.359,"5min":1.468,"15min":0.79700000000000004},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":11.837,"5min":11.837,"15min":11.837},"last":1.913},{"interface":"front","average":{"1min":3.6720000000000002,"5min":1.204,"15min":0.69399999999999995},"min":{"1min":0.32900000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":10.308999999999999,"5min":10.308999999999999,"15min":10.308999999999999},"last":1.2370000000000001}]},{"osd":4,"last update":"Sat Feb 10 08:18:37 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.58599999999999997,"15min":0.59099999999999997},"min":{"1min":0.39200000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.83899999999999997,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.57199999999999995,"15min":0.58199999999999996},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.85099999999999998,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":1.125}]},{"osd":5,"last update":"Sat Feb 10 08:21:04 2024","interfaces":[{"interface":"back","average":{"1min":2.6040000000000001,"5min":1.0569999999999999,"15min":0.73599999999999999},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":11.819000000000001,"5min":11.819000000000001,"15min":11.819000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":2.0489999999999999,"5min":0.97999999999999998,"15min":0.73799999999999999},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":11.747999999999999,"5min":11.747999999999999,"15min":11.747999999999999},"last":1.163}]},{"osd":6,"last update":"Sat Feb 10 08:21:26 2024","interfaces":[{"interface":"back","average":{"1min":2.681,"5min":1.115,"15min":0.76800000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":8.2200000000000006,"5min":8.3309999999999995,"15min":8.3309999999999995},"last":1.2070000000000001},{"interface":"front","average":{"1min":2.3769999999999998,"5min":1.0289999999999999,"15min":0.755},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":10.433,"5min":10.433,"15min":10.433},"last":1.278}]},{"osd":7,"last update":"Sat Feb 10 08:20:50 2024","interfaces":[{"interface":"back","average":{"1min":1.7030000000000001,"5min":0.80000000000000004,"15min":0.64100000000000001},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":8.4109999999999996,"5min":8.4109999999999996,"15min":8.4109999999999996},"last":1.1859999999999999},{"interface":"front","average":{"1min":1.7350000000000001,"5min":0.81999999999999995,"15min":0.66400000000000003},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":7.7229999999999999,"5min":7.7229999999999999,"15min":7.7229999999999999},"last":1.2569999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738462,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":3171432,"kb_used_data":2869984,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":90573720,"statfs":{"total":95995035648,"available":92747489280,"internally_reserved":0,"allocated":2938863616,"data_stored":2938324299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,2,0,1,2,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 10 08:21:29 2024","interfaces":[{"interface":"back","average":{"1min":4.2670000000000003,"5min":1.3540000000000001,"15min":0.67400000000000004},"min":{"1min":0.311,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":16.116,"5min":16.116,"15min":16.116},"last":10.895},{"interface":"front","average":{"1min":3.891,"5min":1.2070000000000001,"15min":0.624},"min":{"1min":0.26800000000000002,"5min":0.193,"15min":0.193},"max":{"1min":15.766999999999999,"5min":15.766999999999999,"15min":15.766999999999999},"last":2.0329999999999999}]},{"osd":2,"last update":"Sat Feb 10 08:20:52 2024","interfaces":[{"interface":"back","average":{"1min":3.448,"5min":1.01,"15min":0.59399999999999997},"min":{"1min":0.25600000000000001,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":14.185,"5min":14.185,"15min":14.185},"last":3.8889999999999998},{"interface":"front","average":{"1min":2.4199999999999999,"5min":0.81699999999999995,"15min":0.53200000000000003},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":6.7510000000000003,"5min":6.7510000000000003,"15min":6.7510000000000003},"last":10.84}]},{"osd":3,"last update":"Sat Feb 10 08:21:20 2024","interfaces":[{"interface":"back","average":{"1min":4.3090000000000002,"5min":1.3720000000000001,"15min":0.754},"min":{"1min":0.36099999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":15.792,"5min":15.792,"15min":15.792},"last":2.1040000000000001},{"interface":"front","average":{"1min":4.6609999999999996,"5min":1.456,"15min":0.78600000000000003},"min":{"1min":0.29799999999999999,"5min":0.246,"15min":0.246},"max":{"1min":15.077999999999999,"5min":15.077999999999999,"15min":15.077999999999999},"last":19.870999999999999}]},{"osd":4,"last update":"Sat Feb 10 08:18:35 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.59399999999999997,"15min":0.59199999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":2.2370000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.59399999999999997,"15min":0.60399999999999998},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":1.9550000000000001}]},{"osd":5,"last update":"Sat Feb 10 08:21:07 2024","interfaces":[{"interface":"back","average":{"1min":2.4249999999999998,"5min":0.95999999999999996,"15min":0.71799999999999997},"min":{"1min":0.39800000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":11.787000000000001,"5min":11.787000000000001,"15min":11.787000000000001},"last":2.1269999999999998},{"interface":"front","average":{"1min":1.778,"5min":0.79800000000000004,"15min":0.65500000000000003},"min":{"1min":0.32800000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":8.2989999999999995,"5min":8.2989999999999995,"15min":8.2989999999999995},"last":1.986}]},{"osd":6,"last update":"Sat Feb 10 08:21:29 2024","interfaces":[{"interface":"back","average":{"1min":3.2639999999999998,"5min":1.1870000000000001,"15min":0.79300000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":11.833,"5min":11.833,"15min":11.833},"last":2.1930000000000001},{"interface":"front","average":{"1min":2.145,"5min":0.94899999999999995,"15min":0.749},"min":{"1min":0.32800000000000001,"5min":0.309,"15min":0.309},"max":{"1min":7.6449999999999996,"5min":7.6449999999999996,"15min":7.6449999999999996},"last":2.056}]},{"osd":7,"last update":"Sat Feb 10 08:20:52 2024","interfaces":[{"interface":"back","average":{"1min":1.4630000000000001,"5min":0.77300000000000002,"15min":0.65700000000000003},"min":{"1min":0.38700000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":3.5299999999999998,"5min":3.5299999999999998,"15min":3.5299999999999998},"last":2.165},{"interface":"front","average":{"1min":1.169,"5min":0.71299999999999997,"15min":0.63700000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":5.702,"5min":5.702,"15min":5.702},"last":2.0099999999999998}]}]},{"osd":2,"up_from":18,"seq":77309411413,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2466008,"kb_used_data":2156432,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":91279144,"statfs":{"total":95995035648,"available":93469843456,"internally_reserved":0,"allocated":2208186368,"data_stored":2207662902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2,1,0,0,2],"upper_bound":64},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:20:48 2024","interfaces":[{"interface":"back","average":{"1min":2.9329999999999998,"5min":0.871,"15min":0.52000000000000002},"min":{"1min":0.17399999999999999,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":19.768999999999998,"5min":19.768999999999998,"15min":19.768999999999998},"last":2.5600000000000001},{"interface":"front","average":{"1min":3.2839999999999998,"5min":0.96199999999999997,"15min":0.56000000000000005},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":17.635000000000002,"5min":17.635000000000002,"15min":17.635000000000002},"last":3.758}]},{"osd":1,"last update":"Sat Feb 10 08:20:48 2024","interfaces":[{"interface":"back","average":{"1min":1.649,"5min":0.64400000000000002,"15min":0.45800000000000002},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":5.9880000000000004,"5min":5.9880000000000004,"15min":5.9880000000000004},"last":3.4279999999999999},{"interface":"front","average":{"1min":1.5649999999999999,"5min":0.63400000000000001,"15min":0.46200000000000002},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":5.7460000000000004,"5min":5.7460000000000004,"15min":5.7460000000000004},"last":2.363}]},{"osd":3,"last update":"Sat Feb 10 08:21:18 2024","interfaces":[{"interface":"back","average":{"1min":3.1299999999999999,"5min":1.0629999999999999,"15min":0.66100000000000003},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":14.77,"5min":14.77,"15min":14.77},"last":2.2789999999999999},{"interface":"front","average":{"1min":2.9209999999999998,"5min":1.042,"15min":0.64800000000000002},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":15.058999999999999,"5min":15.058999999999999,"15min":15.058999999999999},"last":4.1500000000000004}]},{"osd":4,"last update":"Sat Feb 10 08:18:35 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.58499999999999996,"15min":0.58099999999999996},"min":{"1min":0.496,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.86299999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":2.3090000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.57399999999999995,"15min":0.57699999999999996},"min":{"1min":0.39800000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":2.1669999999999998}]},{"osd":5,"last update":"Sat Feb 10 08:21:05 2024","interfaces":[{"interface":"back","average":{"1min":2.165,"5min":0.88800000000000001,"15min":0.67700000000000005},"min":{"1min":0.42799999999999999,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":9.1869999999999994,"5min":9.1869999999999994,"15min":9.1869999999999994},"last":0.31900000000000001},{"interface":"front","average":{"1min":1.6040000000000001,"5min":0.81299999999999994,"15min":0.64900000000000002},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":9.1969999999999992,"5min":9.1969999999999992,"15min":9.1969999999999992},"last":2.3780000000000001}]},{"osd":6,"last update":"Sat Feb 10 08:21:35 2024","interfaces":[{"interface":"back","average":{"1min":2.677,"5min":1.05,"15min":0.74099999999999999},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":9.2219999999999995,"5min":9.2219999999999995,"15min":9.2219999999999995},"last":0.28000000000000003},{"interface":"front","average":{"1min":2.1190000000000002,"5min":0.98999999999999999,"15min":0.73599999999999999},"min":{"1min":0.308,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":9.2759999999999998,"5min":9.2759999999999998,"15min":9.2759999999999998},"last":2.3410000000000002}]},{"osd":7,"last update":"Sat Feb 10 08:20:48 2024","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":0.75700000000000001,"15min":0.65900000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":5.9619999999999997,"5min":5.9619999999999997,"15min":5.9619999999999997},"last":2.4049999999999998},{"interface":"front","average":{"1min":1.694,"5min":0.81799999999999995,"15min":0.68000000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":5.8819999999999997,"5min":5.8819999999999997,"15min":5.8819999999999997},"last":2.1960000000000002}]}]},{"osd":3,"up_from":25,"seq":107374182480,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":3533160,"kb_used_data":3231648,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":90211992,"statfs":{"total":95995035648,"available":92377079808,"internally_reserved":0,"allocated":3309207552,"data_stored":3308667453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,0,1,2,3],"upper_bound":64},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:21:15 2024","interfaces":[{"interface":"back","average":{"1min":2.5950000000000002,"5min":0.95299999999999996,"15min":0.56200000000000006},"min":{"1min":0.28000000000000003,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":7.8259999999999996,"5min":7.8259999999999996,"15min":7.8259999999999996},"last":4.0099999999999998},{"interface":"front","average":{"1min":2.9900000000000002,"5min":0.997,"15min":0.61399999999999999},"min":{"1min":0.27200000000000002,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":26.643000000000001,"5min":26.643000000000001,"15min":26.643000000000001},"last":0.433}]},{"osd":1,"last update":"Sat Feb 10 08:21:15 2024","interfaces":[{"interface":"back","average":{"1min":2.4540000000000002,"5min":0.875,"15min":0.58799999999999997},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":7.3860000000000001,"5min":7.3860000000000001,"15min":7.3860000000000001},"last":3.9700000000000002},{"interface":"front","average":{"1min":2.8900000000000001,"5min":0.97899999999999998,"15min":0.63700000000000001},"min":{"1min":0.27300000000000002,"5min":0.191,"15min":0.191},"max":{"1min":9.9060000000000006,"5min":9.9060000000000006,"15min":9.9060000000000006},"last":1.2609999999999999}]},{"osd":2,"last update":"Sat Feb 10 08:21:15 2024","interfaces":[{"interface":"back","average":{"1min":3.7450000000000001,"5min":1.22,"15min":0.71199999999999997},"min":{"1min":0.44900000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":10.002000000000001,"5min":10.002000000000001,"15min":10.002000000000001},"last":1.323},{"interface":"front","average":{"1min":3.9550000000000001,"5min":1.246,"15min":0.71699999999999997},"min":{"1min":0.34100000000000003,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":18.061,"5min":18.061,"15min":18.061},"last":0.61399999999999999}]},{"osd":4,"last update":"Sat Feb 10 08:18:36 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54700000000000004,"15min":0.54500000000000004},"min":{"1min":0.38800000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.56899999999999995,"15min":0.57299999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.83099999999999996,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.41699999999999998}]},{"osd":5,"last update":"Sat Feb 10 08:21:11 2024","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":0.70999999999999996,"15min":0.63600000000000001},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":12.388999999999999,"5min":12.388999999999999,"15min":12.388999999999999},"last":0.35599999999999998},{"interface":"front","average":{"1min":1.8839999999999999,"5min":0.84699999999999998,"15min":0.68300000000000005},"min":{"1min":0.36799999999999999,"5min":0.317,"15min":0.317},"max":{"1min":6.5999999999999996,"5min":6.5999999999999996,"15min":6.5999999999999996},"last":0.47799999999999998}]},{"osd":6,"last update":"Sat Feb 10 08:21:28 2024","interfaces":[{"interface":"back","average":{"1min":2.0590000000000002,"5min":0.95699999999999996,"15min":0.69899999999999995},"min":{"1min":0.51700000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":5.9480000000000004,"5min":6.6369999999999996,"15min":6.6369999999999996},"last":0.45200000000000001},{"interface":"front","average":{"1min":1.2669999999999999,"5min":0.751,"15min":0.63800000000000001},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":12.324999999999999,"5min":12.324999999999999,"15min":12.324999999999999},"last":0.57499999999999996}]},{"osd":7,"last update":"Sat Feb 10 08:20:49 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.61499999999999999,"15min":0.58899999999999997},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":2.0459999999999998,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":0.69599999999999995},{"interface":"front","average":{"1min":1.6899999999999999,"5min":0.80600000000000005,"15min":0.64800000000000002},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":7.2649999999999997,"5min":7.2649999999999997,"15min":7.2649999999999997},"last":1.2869999999999999}]}]},{"osd":4,"up_from":110,"seq":472446402572,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":700764,"kb_used_data":390612,"kb_used_omap":0,"kb_used_meta":310143,"kb_avail":93044388,"statfs":{"total":95995035648,"available":95277453312,"internally_reserved":0,"allocated":399986688,"data_stored":399458545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":972,"internal_metadata":317586484},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.0570000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.8399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.8680000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.024}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]}]},{"osd":5,"up_from":37,"seq":158913790023,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1745484,"kb_used_data":1435972,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":91999668,"statfs":{"total":95995035648,"available":94207660032,"internally_reserved":0,"allocated":1470435328,"data_stored":1469923472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:20:58 2024","interfaces":[{"interface":"back","average":{"1min":2.9350000000000001,"5min":1.022,"15min":0.73699999999999999},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":22.914000000000001,"5min":22.914000000000001,"15min":22.914000000000001},"last":3.4510000000000001},{"interface":"front","average":{"1min":2.9340000000000002,"5min":0.98999999999999999,"15min":0.68000000000000005},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":23.161000000000001,"5min":23.161000000000001,"15min":23.161000000000001},"last":1.1850000000000001}]},{"osd":1,"last update":"Sat Feb 10 08:20:58 2024","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":0.63600000000000001,"15min":0.59099999999999997},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":8.1289999999999996,"5min":8.1289999999999996,"15min":8.1289999999999996},"last":0.27300000000000002},{"interface":"front","average":{"1min":1.3009999999999999,"5min":0.66900000000000004,"15min":0.59299999999999997},"min":{"1min":0.33800000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":4.6989999999999998,"5min":4.6989999999999998,"15min":4.6989999999999998},"last":0.309}]},{"osd":2,"last update":"Sat Feb 10 08:20:58 2024","interfaces":[{"interface":"back","average":{"1min":2.4239999999999999,"5min":0.92600000000000005,"15min":0.69399999999999995},"min":{"1min":0.32300000000000001,"5min":0.314,"15min":0.314},"max":{"1min":9.5709999999999997,"5min":9.5709999999999997,"15min":9.5709999999999997},"last":1.3580000000000001},{"interface":"front","average":{"1min":1.9950000000000001,"5min":0.84199999999999997,"15min":0.68200000000000005},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":9.2810000000000006,"5min":9.2810000000000006,"15min":9.2810000000000006},"last":1.4159999999999999}]},{"osd":3,"last update":"Sat Feb 10 08:20:58 2024","interfaces":[{"interface":"back","average":{"1min":3.113,"5min":1.0549999999999999,"15min":0.749},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":24.198,"5min":24.198,"15min":24.198},"last":0.50800000000000001},{"interface":"front","average":{"1min":3.77,"5min":1.2010000000000001,"15min":0.77800000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":22.701000000000001,"5min":22.701000000000001,"15min":22.701000000000001},"last":3.1880000000000002}]},{"osd":4,"last update":"Sat Feb 10 08:18:57 2024","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.371,"15min":0.36099999999999999},"min":{"1min":0.26400000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.65400000000000003,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.252},{"interface":"front","average":{"1min":0.433,"5min":0.38300000000000001,"15min":0.36899999999999999},"min":{"1min":0.30399999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.68700000000000006,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.39800000000000002}]},{"osd":6,"last update":"Sat Feb 10 08:21:28 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.45900000000000002,"15min":0.40000000000000002},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":1.99,"5min":1.99,"15min":1.99},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.51500000000000001,"15min":0.45100000000000001},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":1.964,"5min":1.964,"15min":1.964},"last":0.36099999999999999}]},{"osd":7,"last update":"Sat Feb 10 08:20:50 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.46899999999999997,"15min":0.44600000000000001},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.9239999999999999,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.49099999999999999,"15min":0.44500000000000001},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":3.387,"5min":3.387,"15min":3.387},"last":0.32800000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":1678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2924679168,"data_stored":2924675096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2205552640,"data_stored":2205548568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2199126016,"data_stored":2199126016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3300851712,"data_stored":3300851712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":398721024,"data_stored":398721024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1468399616,"data_stored":1468399616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1848119296,"data_stored":1848115224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1830420480,"data_stored":1830420480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-10T08:21:46.276 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2024-02-10T08:21:46.276 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd pool set default.rgw.meta pg_num 42 2024-02-10T08:21:46.360 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:21:46.464 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:46.519 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:21:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:21:46] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:21:46.542 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:21:46.547 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:46.548 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:21:46.649 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:21:46.725 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:46.993 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:21:47.000 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:47.000 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:21:47.001 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:21:47.085 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:21:47.102 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:21:47.137 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:47.160 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:21:47.162 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:47.162 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:21:47.263 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:21:47.297 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:47.365 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:21:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:21:47] "GET /metrics HTTP/1.1" 200 175577 "" "Prometheus/2.33.4" 2024-02-10T08:21:47.454 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:21:47.461 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:47.461 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:21:47.562 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:21:47.595 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:47.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:21:46.579925+0000 mgr.y (mgr.14505) 192 : cluster [DBG] pgmap v199: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 5.3 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 567 op/s; 20975/259140 objects degraded (8.094%); 5.2 MiB/s, 83 objects/s recovering 2024-02-10T08:21:47.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:21:46.614464+0000 mon.a (mon.0) 904 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:21:47.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:21:47.276425+0000 mon.b (mon.1) 45 : audit [INF] from='client.? 172.21.15.18:0/2064847516' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:21:47.714 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:21:46.579925+0000 mgr.y (mgr.14505) 192 : cluster [DBG] pgmap v199: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 5.3 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 567 op/s; 20975/259140 objects degraded (8.094%); 5.2 MiB/s, 83 objects/s recovering 2024-02-10T08:21:47.715 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:21:46.614464+0000 mon.a (mon.0) 904 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:21:47.715 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:21:47.276425+0000 mon.b (mon.1) 45 : audit [INF] from='client.? 172.21.15.18:0/2064847516' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:21:47.715 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:21:47.276995+0000 mon.a (mon.0) 905 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:21:47.715 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:21:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:21:47.732 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:21:47.736 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:47.737 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:21:47.751 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-02-10T08:21:47.751 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:21:47.838 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:21:47.850 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is set 2024-02-10T08:21:47.876 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:47.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:21:47.276995+0000 mon.a (mon.0) 905 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:21:47.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:21:46.579925+0000 mgr.y (mgr.14505) 192 : cluster [DBG] pgmap v199: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 5.3 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 567 op/s; 20975/259140 objects degraded (8.094%); 5.2 MiB/s, 83 objects/s recovering 2024-02-10T08:21:47.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:21:46.614464+0000 mon.a (mon.0) 904 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:21:47.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:21:47.276425+0000 mon.b (mon.1) 45 : audit [INF] from='client.? 172.21.15.18:0/2064847516' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:21:47.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:21:47.276995+0000 mon.a (mon.0) 905 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:21:48.002 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:21:48.005 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:48.006 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:21:48.106 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:21:48.143 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:48.599 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:21:48.604 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:48.605 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:21:48.628 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.5 dump_historic_ops 2024-02-10T08:21:48.706 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:21:48.749 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:48.778 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:21:48.783 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:48.783 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:21:48.884 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:21:48.923 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:21:47.714452+0000 mgr.y (mgr.14505) 193 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:21:48.923 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:21:47.808314+0000 mon.a (mon.0) 906 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:21:48.923 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:21:47.830346+0000 mon.a (mon.0) 907 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-10T08:21:48.923 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:21:47.830421+0000 mon.a (mon.0) 908 : cluster [DBG] osdmap e126: 8 total, 8 up, 8 in 2024-02-10T08:21:48.925 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:48.954 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:21:48.958 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:48.959 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:21:49.034 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:21:49.060 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:21:49.124 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:21:47.714452+0000 mgr.y (mgr.14505) 193 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:21:49.124 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:21:47.808314+0000 mon.a (mon.0) 906 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:21:49.124 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:21:47.830346+0000 mon.a (mon.0) 907 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-10T08:21:49.124 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:21:47.830421+0000 mon.a (mon.0) 908 : cluster [DBG] osdmap e126: 8 total, 8 up, 8 in 2024-02-10T08:21:49.125 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:21:47.714452+0000 mgr.y (mgr.14505) 193 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:21:49.125 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:21:47.808314+0000 mon.a (mon.0) 906 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:21:49.126 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:21:47.830346+0000 mon.a (mon.0) 907 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-10T08:21:49.126 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:21:47.830421+0000 mon.a (mon.0) 908 : cluster [DBG] osdmap e126: 8 total, 8 up, 8 in 2024-02-10T08:21:49.134 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:49.242 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:21:49.245 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:49.246 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:21:49.346 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:21:49.411 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:50.080 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:21:50.084 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:50.084 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:21:50.158 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:21:48.580438+0000 mgr.y (mgr.14505) 194 : cluster [DBG] pgmap v201: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 5.1 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 674 op/s; 20026/248886 objects degraded (8.046%); 6.6 MiB/s, 105 objects/s recovering 2024-02-10T08:21:50.158 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:21:48.580438+0000 mgr.y (mgr.14505) 194 : cluster [DBG] pgmap v201: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 5.1 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 674 op/s; 20026/248886 objects degraded (8.046%); 6.6 MiB/s, 105 objects/s recovering 2024-02-10T08:21:50.185 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:21:50.215 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:49 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:21:48.580438+0000 mgr.y (mgr.14505) 194 : cluster [DBG] pgmap v201: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 5.1 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 674 op/s; 20026/248886 objects degraded (8.046%); 6.6 MiB/s, 105 objects/s recovering 2024-02-10T08:21:50.217 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:50.471 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:21:50.475 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:50.475 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:21:50.576 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:21:50.609 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:50.719 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:21:50.723 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:50.723 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:21:50.825 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:21:50.923 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:51.033 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-02-10T08:21:51.033 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:21:51.044 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:21:50.456426+0000 mon.a (mon.0) 909 : cluster [WRN] Health check update: Degraded data redundancy: 20026/248886 objects degraded (8.046%), 5 pgs degraded, 5 pgs undersized (PG_DEGRADED) 2024-02-10T08:21:51.045 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:21:50.484512+0000 mon.a (mon.0) 910 : cluster [DBG] osdmap e127: 8 total, 8 up, 8 in 2024-02-10T08:21:51.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:21:50.456426+0000 mon.a (mon.0) 909 : cluster [WRN] Health check update: Degraded data redundancy: 20026/248886 objects degraded (8.046%), 5 pgs degraded, 5 pgs undersized (PG_DEGRADED) 2024-02-10T08:21:51.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:21:50.484512+0000 mon.a (mon.0) 910 : cluster [DBG] osdmap e127: 8 total, 8 up, 8 in 2024-02-10T08:21:51.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:21:50.456426+0000 mon.a (mon.0) 909 : cluster [WRN] Health check update: Degraded data redundancy: 20026/248886 objects degraded (8.046%), 5 pgs degraded, 5 pgs undersized (PG_DEGRADED) 2024-02-10T08:21:51.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:21:50.484512+0000 mon.a (mon.0) 910 : cluster [DBG] osdmap e127: 8 total, 8 up, 8 in 2024-02-10T08:21:51.890 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.6 dump_ops_in_flight 2024-02-10T08:21:52.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:21:50.582374+0000 mgr.y (mgr.14505) 195 : cluster [DBG] pgmap v203: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 5.1 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 586 op/s; 20026/248886 objects degraded (8.046%); 8.2 MiB/s, 131 objects/s recovering 2024-02-10T08:21:52.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:21:50.582374+0000 mgr.y (mgr.14505) 195 : cluster [DBG] pgmap v203: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 5.1 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 586 op/s; 20026/248886 objects degraded (8.046%); 8.2 MiB/s, 131 objects/s recovering 2024-02-10T08:21:52.239 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:21:52.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:51 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:21:50.582374+0000 mgr.y (mgr.14505) 195 : cluster [DBG] pgmap v203: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 5.1 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 586 op/s; 20026/248886 objects degraded (8.046%); 8.2 MiB/s, 131 objects/s recovering 2024-02-10T08:21:53.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:21:52.169713+0000 osd.1 (osd.1) 81 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:21:53.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:21:52.169783+0000 osd.1 (osd.1) 82 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:21:53.158 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:21:52.169713+0000 osd.1 (osd.1) 81 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:21:53.158 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:21:52.169783+0000 osd.1 (osd.1) 82 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:21:53.259 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:52 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:21:52.169713+0000 osd.1 (osd.1) 81 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:21:53.259 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:52 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:21:52.169783+0000 osd.1 (osd.1) 82 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:21:53.975 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:53 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:21:52.584720+0000 mgr.y (mgr.14505) 196 : cluster [DBG] pgmap v204: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 4.9 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 705 op/s; 19585/242223 objects degraded (8.086%); 4.2 MiB/s, 67 objects/s recovering 2024-02-10T08:21:53.975 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:53 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:21:52.894306+0000 mon.a (mon.0) 911 : cluster [DBG] osdmap e128: 8 total, 8 up, 8 in 2024-02-10T08:21:53.975 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:53 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:21:53.434019+0000 osd.4 (osd.4) 3 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:21:53.975 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:53 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:21:53.434066+0000 osd.4 (osd.4) 4 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:21:54.105 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd unset noscrub 2024-02-10T08:21:54.187 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:21:52.584720+0000 mgr.y (mgr.14505) 196 : cluster [DBG] pgmap v204: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 4.9 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 705 op/s; 19585/242223 objects degraded (8.086%); 4.2 MiB/s, 67 objects/s recovering 2024-02-10T08:21:54.188 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:21:52.894306+0000 mon.a (mon.0) 911 : cluster [DBG] osdmap e128: 8 total, 8 up, 8 in 2024-02-10T08:21:54.188 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:21:53.434019+0000 osd.4 (osd.4) 3 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:21:54.188 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:21:53.434066+0000 osd.4 (osd.4) 4 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:21:54.188 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:21:52.584720+0000 mgr.y (mgr.14505) 196 : cluster [DBG] pgmap v204: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 4.9 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 705 op/s; 19585/242223 objects degraded (8.086%); 4.2 MiB/s, 67 objects/s recovering 2024-02-10T08:21:54.188 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:21:52.894306+0000 mon.a (mon.0) 911 : cluster [DBG] osdmap e128: 8 total, 8 up, 8 in 2024-02-10T08:21:54.188 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:21:53.434019+0000 osd.4 (osd.4) 3 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:21:54.188 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:21:53.434066+0000 osd.4 (osd.4) 4 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:21:54.330 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-02-10T08:21:54.330 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:21:54.645 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:21:54.649 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:54.649 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:21:54.750 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:21:54.817 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:55.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:54 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:21:53.920790+0000 mon.a (mon.0) 912 : cluster [DBG] osdmap e129: 8 total, 8 up, 8 in 2024-02-10T08:21:55.067 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:21:55.071 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:55.071 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:21:55.172 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:21:55.176 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.6 dump_blocked_ops 2024-02-10T08:21:55.184 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:21:53.920790+0000 mon.a (mon.0) 912 : cluster [DBG] osdmap e129: 8 total, 8 up, 8 in 2024-02-10T08:21:55.184 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:21:53.920790+0000 mon.a (mon.0) 912 : cluster [DBG] osdmap e129: 8 total, 8 up, 8 in 2024-02-10T08:21:55.207 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:55.240 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:21:55.244 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:55.245 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:21:55.346 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:21:55.451 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:55.535 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:21:55.552 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:21:55.552 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:21:55.556 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:55.556 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:21:55.580 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:21:55.593 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:21:55.641 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:21:55.658 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:21:55.705 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:21:55.732 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:21:55.753 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:21:55.755 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:55.808 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:21:55.858 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:21:55.881 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-10T08:21:55.881 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-10T08:21:55.881 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-10T08:21:55.881 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-10T08:21:55.881 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-10T08:21:55.881 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-10T08:21:55.882 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-10T08:21:55.882 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-10T08:21:56.010 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:21:54.587310+0000 mgr.y (mgr.14505) 197 : cluster [DBG] pgmap v207: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 4.8 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 594 op/s; 19004/238179 objects degraded (7.979%); 6.0 MiB/s, 96 objects/s recovering 2024-02-10T08:21:56.010 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:21:55.461331+0000 mon.a (mon.0) 913 : cluster [WRN] Health check update: Degraded data redundancy: 19004/238179 objects degraded (7.979%), 5 pgs degraded, 5 pgs undersized (PG_DEGRADED) 2024-02-10T08:21:56.010 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:21:55.509075+0000 mon.b (mon.1) 46 : audit [DBG] from='client.? 172.21.15.18:0/338190002' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:21:56.010 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:21:55.711545+0000 mon.b (mon.1) 47 : audit [INF] from='client.? 172.21.15.18:0/663302884' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num", "val": "42"}]: dispatch 2024-02-10T08:21:56.010 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:21:55.712028+0000 mon.a (mon.0) 914 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num", "val": "42"}]: dispatch 2024-02-10T08:21:56.010 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:21:54.587310+0000 mgr.y (mgr.14505) 197 : cluster [DBG] pgmap v207: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 4.8 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 594 op/s; 19004/238179 objects degraded (7.979%); 6.0 MiB/s, 96 objects/s recovering 2024-02-10T08:21:56.011 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:21:55.461331+0000 mon.a (mon.0) 913 : cluster [WRN] Health check update: Degraded data redundancy: 19004/238179 objects degraded (7.979%), 5 pgs degraded, 5 pgs undersized (PG_DEGRADED) 2024-02-10T08:21:56.011 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:21:55.509075+0000 mon.b (mon.1) 46 : audit [DBG] from='client.? 172.21.15.18:0/338190002' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:21:56.011 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:21:55.711545+0000 mon.b (mon.1) 47 : audit [INF] from='client.? 172.21.15.18:0/663302884' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num", "val": "42"}]: dispatch 2024-02-10T08:21:56.011 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:21:55.712028+0000 mon.a (mon.0) 914 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num", "val": "42"}]: dispatch 2024-02-10T08:21:56.055 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:21:54.587310+0000 mgr.y (mgr.14505) 197 : cluster [DBG] pgmap v207: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 4.8 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 594 op/s; 19004/238179 objects degraded (7.979%); 6.0 MiB/s, 96 objects/s recovering 2024-02-10T08:21:56.055 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:21:55.461331+0000 mon.a (mon.0) 913 : cluster [WRN] Health check update: Degraded data redundancy: 19004/238179 objects degraded (7.979%), 5 pgs degraded, 5 pgs undersized (PG_DEGRADED) 2024-02-10T08:21:56.055 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:21:55.509075+0000 mon.b (mon.1) 46 : audit [DBG] from='client.? 172.21.15.18:0/338190002' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:21:56.055 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:21:55.711545+0000 mon.b (mon.1) 47 : audit [INF] from='client.? 172.21.15.18:0/663302884' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num", "val": "42"}]: dispatch 2024-02-10T08:21:56.055 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:21:55.712028+0000 mon.a (mon.0) 914 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num", "val": "42"}]: dispatch 2024-02-10T08:21:56.357 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:21:56.361 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:56.362 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:21:56.463 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:21:56.505 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:56.544 INFO:teuthology.orchestra.run.smithi018.stderr:set pool 6 pg_num to 42 2024-02-10T08:21:56.590 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:21:56.595 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:56.595 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:21:56.696 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:21:56.737 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:56.789 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:21:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:21:56] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:21:57.297 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:21:57.300 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:57.301 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:21:57.402 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:21:57.404 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:21:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:21:57] "GET /metrics HTTP/1.1" 200 175577 "" "Prometheus/2.33.4" 2024-02-10T08:21:57.444 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:57.471 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:21:57.473 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:57.474 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:21:57.575 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:21:57.617 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-02-10T08:21:57.617 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-02-10T08:21:57.617 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-02-10T08:21:57.617 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-02-10T08:21:57.617 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-02-10T08:21:57.640 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:21:56.487790+0000 mon.a (mon.0) 915 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num", "val": "42"}]': finished 2024-02-10T08:21:57.640 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:21:56.487866+0000 mon.a (mon.0) 916 : cluster [DBG] osdmap e130: 8 total, 8 up, 8 in 2024-02-10T08:21:57.640 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:21:56.576023+0000 osd.5 (osd.5) 73 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:21:57.640 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:21:56.576068+0000 osd.5 (osd.5) 74 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:21:57.640 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:21:56.589048+0000 mgr.y (mgr.14505) 198 : cluster [DBG] pgmap v209: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 4.8 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 595 op/s; 19004/238179 objects degraded (7.979%); 6.0 MiB/s, 96 objects/s recovering 2024-02-10T08:21:57.640 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:21:56.591223+0000 mon.a (mon.0) 917 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_actual", "val": "42"}]: dispatch 2024-02-10T08:21:57.657 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:57.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:21:56.487790+0000 mon.a (mon.0) 915 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num", "val": "42"}]': finished 2024-02-10T08:21:57.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:21:56.487866+0000 mon.a (mon.0) 916 : cluster [DBG] osdmap e130: 8 total, 8 up, 8 in 2024-02-10T08:21:57.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:21:56.576023+0000 osd.5 (osd.5) 73 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:21:57.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:21:56.576068+0000 osd.5 (osd.5) 74 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:21:57.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:21:56.589048+0000 mgr.y (mgr.14505) 198 : cluster [DBG] pgmap v209: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 4.8 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 595 op/s; 19004/238179 objects degraded (7.979%); 6.0 MiB/s, 96 objects/s recovering 2024-02-10T08:21:57.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:21:56.591223+0000 mon.a (mon.0) 917 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_actual", "val": "42"}]: dispatch 2024-02-10T08:21:57.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:21:56.487790+0000 mon.a (mon.0) 915 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num", "val": "42"}]': finished 2024-02-10T08:21:57.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:21:56.487866+0000 mon.a (mon.0) 916 : cluster [DBG] osdmap e130: 8 total, 8 up, 8 in 2024-02-10T08:21:57.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:21:56.576023+0000 osd.5 (osd.5) 73 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:21:57.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:21:56.576068+0000 osd.5 (osd.5) 74 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:21:57.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:21:56.589048+0000 mgr.y (mgr.14505) 198 : cluster [DBG] pgmap v209: 148 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 143 active+clean; 4.8 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 595 op/s; 19004/238179 objects degraded (7.979%); 6.0 MiB/s, 96 objects/s recovering 2024-02-10T08:21:57.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:21:56.591223+0000 mon.a (mon.0) 917 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_actual", "val": "42"}]: dispatch 2024-02-10T08:21:58.035 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:21:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:21:58.478 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.6 dump_historic_ops 2024-02-10T08:21:58.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:21:57.515632+0000 mon.a (mon.0) 918 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_actual", "val": "42"}]': finished 2024-02-10T08:21:58.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:21:57.515686+0000 mon.a (mon.0) 919 : cluster [DBG] osdmap e131: 8 total, 8 up, 8 in 2024-02-10T08:21:58.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:21:57.725179+0000 mgr.y (mgr.14505) 199 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:21:58.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:21:57.515632+0000 mon.a (mon.0) 918 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_actual", "val": "42"}]': finished 2024-02-10T08:21:58.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:21:57.515686+0000 mon.a (mon.0) 919 : cluster [DBG] osdmap e131: 8 total, 8 up, 8 in 2024-02-10T08:21:58.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:21:57.725179+0000 mgr.y (mgr.14505) 199 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:21:58.793 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:21:57.515632+0000 mon.a (mon.0) 918 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_actual", "val": "42"}]': finished 2024-02-10T08:21:58.793 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:21:57.515686+0000 mon.a (mon.0) 919 : cluster [DBG] osdmap e131: 8 total, 8 up, 8 in 2024-02-10T08:21:58.793 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:21:57.725179+0000 mgr.y (mgr.14505) 199 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:21:58.816 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:21:59.036 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:21:59.040 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:59.041 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:21:59.142 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:21:59.221 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:59.254 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:21:59.263 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:59.263 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:21:59.364 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:21:59.451 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:59.490 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:21:59.495 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:59.495 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:21:59.596 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:21:59.599 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is unset 2024-02-10T08:21:59.630 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:21:59.731 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:21:59.736 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:59 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:21:58.514461+0000 mon.a (mon.0) 920 : cluster [DBG] osdmap e132: 8 total, 8 up, 8 in 2024-02-10T08:21:59.736 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:59 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:21:58.593490+0000 mgr.y (mgr.14505) 200 : cluster [DBG] pgmap v212: 158 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 5 peering, 10 unknown, 3 active+recovering+undersized+degraded+remapped, 138 active+clean; 4.6 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 729 op/s; 17948/227955 objects degraded (7.873%); 8.5 MiB/s, 135 objects/s recovering 2024-02-10T08:21:59.736 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:59 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:21:58.594837+0000 mon.a (mon.0) 921 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pgp_num_actual", "val": "42"}]: dispatch 2024-02-10T08:21:59.736 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:59 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:21:59.033531+0000 mon.c (mon.2) 30 : audit [INF] from='client.? 172.21.15.18:0/1231092518' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:21:59.737 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:21:59 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:21:59.035468+0000 mon.a (mon.0) 922 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:21:59.737 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:21:59.738 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:21:59.839 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:21:59.903 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:21:58.514461+0000 mon.a (mon.0) 920 : cluster [DBG] osdmap e132: 8 total, 8 up, 8 in 2024-02-10T08:21:59.903 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:21:58.593490+0000 mgr.y (mgr.14505) 200 : cluster [DBG] pgmap v212: 158 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 5 peering, 10 unknown, 3 active+recovering+undersized+degraded+remapped, 138 active+clean; 4.6 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 729 op/s; 17948/227955 objects degraded (7.873%); 8.5 MiB/s, 135 objects/s recovering 2024-02-10T08:21:59.903 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:21:58.594837+0000 mon.a (mon.0) 921 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pgp_num_actual", "val": "42"}]: dispatch 2024-02-10T08:21:59.903 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:21:59.033531+0000 mon.c (mon.2) 30 : audit [INF] from='client.? 172.21.15.18:0/1231092518' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:21:59.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:21:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:21:59.035468+0000 mon.a (mon.0) 922 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:21:59.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:21:58.514461+0000 mon.a (mon.0) 920 : cluster [DBG] osdmap e132: 8 total, 8 up, 8 in 2024-02-10T08:21:59.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:21:58.593490+0000 mgr.y (mgr.14505) 200 : cluster [DBG] pgmap v212: 158 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 5 peering, 10 unknown, 3 active+recovering+undersized+degraded+remapped, 138 active+clean; 4.6 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 729 op/s; 17948/227955 objects degraded (7.873%); 8.5 MiB/s, 135 objects/s recovering 2024-02-10T08:21:59.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:21:58.594837+0000 mon.a (mon.0) 921 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pgp_num_actual", "val": "42"}]: dispatch 2024-02-10T08:21:59.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:21:59.033531+0000 mon.c (mon.2) 30 : audit [INF] from='client.? 172.21.15.18:0/1231092518' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:21:59.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:21:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:21:59.035468+0000 mon.a (mon.0) 922 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:21:59.905 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:00.678 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:21:59.532399+0000 mon.a (mon.0) 923 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:22:00.678 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:21:59.539629+0000 mon.a (mon.0) 924 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pgp_num_actual", "val": "42"}]': finished 2024-02-10T08:22:00.678 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:21:59.539704+0000 mon.a (mon.0) 925 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-10T08:22:00.679 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:21:59.539761+0000 mon.a (mon.0) 926 : cluster [DBG] osdmap e133: 8 total, 8 up, 8 in 2024-02-10T08:22:00.679 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:00.466069+0000 mon.a (mon.0) 927 : cluster [WRN] Health check update: Degraded data redundancy: 17948/227955 objects degraded (7.873%), 5 pgs degraded, 5 pgs undersized (PG_DEGRADED) 2024-02-10T08:22:00.679 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:00.544364+0000 mon.a (mon.0) 928 : cluster [DBG] osdmap e134: 8 total, 8 up, 8 in 2024-02-10T08:22:00.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:21:59.532399+0000 mon.a (mon.0) 923 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:22:00.906 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:21:59.539629+0000 mon.a (mon.0) 924 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pgp_num_actual", "val": "42"}]': finished 2024-02-10T08:22:00.906 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:21:59.539704+0000 mon.a (mon.0) 925 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-10T08:22:00.906 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:21:59.539761+0000 mon.a (mon.0) 926 : cluster [DBG] osdmap e133: 8 total, 8 up, 8 in 2024-02-10T08:22:00.906 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:00.466069+0000 mon.a (mon.0) 927 : cluster [WRN] Health check update: Degraded data redundancy: 17948/227955 objects degraded (7.873%), 5 pgs degraded, 5 pgs undersized (PG_DEGRADED) 2024-02-10T08:22:00.906 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:00.544364+0000 mon.a (mon.0) 928 : cluster [DBG] osdmap e134: 8 total, 8 up, 8 in 2024-02-10T08:22:00.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:21:59.532399+0000 mon.a (mon.0) 923 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:22:00.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:21:59.539629+0000 mon.a (mon.0) 924 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pgp_num_actual", "val": "42"}]': finished 2024-02-10T08:22:00.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:21:59.539704+0000 mon.a (mon.0) 925 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-10T08:22:00.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:21:59.539761+0000 mon.a (mon.0) 926 : cluster [DBG] osdmap e133: 8 total, 8 up, 8 in 2024-02-10T08:22:00.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:00.466069+0000 mon.a (mon.0) 927 : cluster [WRN] Health check update: Degraded data redundancy: 17948/227955 objects degraded (7.873%), 5 pgs degraded, 5 pgs undersized (PG_DEGRADED) 2024-02-10T08:22:00.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:00.544364+0000 mon.a (mon.0) 928 : cluster [DBG] osdmap e134: 8 total, 8 up, 8 in 2024-02-10T08:22:00.958 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-10T08:22:01.009 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-02-10T08:22:01.009 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-02-10T08:22:01.009 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-02-10T08:22:01.009 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-02-10T08:22:01.009 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.010 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.24299.0:674 5.1f 5:f95f44c2:::notify.0:head [watch reconnect cookie 94587189541504 gen 1] snapc 0=[] ondisk+write+known_if_redirected e88)", 2024-02-10T08:22:01.010 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:19:30.798304+0000", 2024-02-10T08:22:01.010 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 150.20714522899999, 2024-02-10T08:22:01.010 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0169715699999999, 2024-02-10T08:22:01.010 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:22:01.010 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-02-10T08:22:01.010 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:22:01.010 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.24299", 2024-02-10T08:22:01.010 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/871408063", 2024-02-10T08:22:01.010 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 674 2024-02-10T08:22:01.010 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.010 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:22:01.010 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.010 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:22:01.011 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:30.798304+0000", 2024-02-10T08:22:01.011 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:22:01.011 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.011 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.011 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:22:01.011 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:30.798304+0000", 2024-02-10T08:22:01.011 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999981 2024-02-10T08:22:01.011 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.011 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.011 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:22:01.011 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:30.798302+0000", 2024-02-10T08:22:01.011 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9e-06 2024-02-10T08:22:01.011 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.011 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.011 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:22:01.012 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:30.798309+0000", 2024-02-10T08:22:01.012 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4748e-05 2024-02-10T08:22:01.012 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.012 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.012 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:22:01.012 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:30.798324+0000", 2024-02-10T08:22:01.012 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9549999999999998e-06 2024-02-10T08:22:01.012 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.012 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.012 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:22:01.012 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:30.798332+0000", 2024-02-10T08:22:01.012 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7087000000000002e-05 2024-02-10T08:22:01.012 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.013 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.013 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:22:01.013 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:30.798410+0000", 2024-02-10T08:22:01.013 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0960000000000003e-06 2024-02-10T08:22:01.013 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.013 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.013 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-02-10T08:22:01.013 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:30.798417+0000", 2024-02-10T08:22:01.013 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011099538000000001 2024-02-10T08:22:01.013 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.013 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.013 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:22:01.013 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:30.809516+0000", 2024-02-10T08:22:01.013 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7360000000000007e-06 2024-02-10T08:22:01.014 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.014 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.014 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:22:01.014 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:30.809525+0000", 2024-02-10T08:22:01.014 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0041937139999999 2024-02-10T08:22:01.014 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.014 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.014 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:22:01.014 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:31.813719+0000", 2024-02-10T08:22:01.014 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015807199999999999 2024-02-10T08:22:01.014 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.014 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.015 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:22:01.015 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:31.813877+0000", 2024-02-10T08:22:01.015 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0013983929999999999 2024-02-10T08:22:01.015 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.015 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.015 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:22:01.015 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:31.815275+0000", 2024-02-10T08:22:01.015 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0169715699999999 2024-02-10T08:22:01.015 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:22:01.015 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:22:01.015 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:22:01.015 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.015 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.016 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.24299.0:683 5.1f 5:f95f44c2:::notify.0:head [watch ping cookie 94587189541504 gen 1] snapc 0=[] ondisk+write+known_if_redirected e88)", 2024-02-10T08:22:01.016 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:19:30.927533+0000", 2024-02-10T08:22:01.016 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 150.07791565799999, 2024-02-10T08:22:01.016 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.88684627199999999, 2024-02-10T08:22:01.016 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:22:01.016 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-02-10T08:22:01.016 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:22:01.016 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.24299", 2024-02-10T08:22:01.016 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/871408063", 2024-02-10T08:22:01.016 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 683 2024-02-10T08:22:01.016 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.016 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:22:01.016 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.016 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:22:01.016 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:30.927533+0000", 2024-02-10T08:22:01.017 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:22:01.017 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.017 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.017 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:22:01.017 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:30.927533+0000", 2024-02-10T08:22:01.017 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-02-10T08:22:01.017 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.017 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.017 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:22:01.017 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:30.927532+0000", 2024-02-10T08:22:01.017 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7039000000000001e-05 2024-02-10T08:22:01.018 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.018 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.018 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:22:01.018 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:30.927549+0000", 2024-02-10T08:22:01.018 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5580000000000006e-06 2024-02-10T08:22:01.018 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.018 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.018 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:22:01.018 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:30.927559+0000", 2024-02-10T08:22:01.018 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1199999999999996e-06 2024-02-10T08:22:01.018 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.018 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.018 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:22:01.018 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:30.927566+0000", 2024-02-10T08:22:01.019 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2524000000000001e-05 2024-02-10T08:22:01.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.019 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.019 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:22:01.019 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:30.927618+0000", 2024-02-10T08:22:01.019 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9719999999999998e-06 2024-02-10T08:22:01.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.019 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.019 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:22:01.019 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:30.927627+0000", 2024-02-10T08:22:01.019 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.88652165999999999 2024-02-10T08:22:01.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.019 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.019 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:22:01.019 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:31.814149+0000", 2024-02-10T08:22:01.020 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0580000000000004e-05 2024-02-10T08:22:01.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.020 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.020 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:22:01.020 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:31.814229+0000", 2024-02-10T08:22:01.020 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000149949 2024-02-10T08:22:01.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.020 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.020 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:22:01.020 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:31.814379+0000", 2024-02-10T08:22:01.020 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.88684627199999999 2024-02-10T08:22:01.020 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:22:01.020 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:22:01.020 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:22:01.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.021 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14784.0:29654 7.c 7:3f3ccd71:::benchmark_data_smithi018_80623_object29653:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e96)", 2024-02-10T08:22:01.021 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:20:03.387316+0000", 2024-02-10T08:22:01.021 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 117.61813250599999, 2024-02-10T08:22:01.021 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.099666355999999998, 2024-02-10T08:22:01.021 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:22:01.021 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:22:01.021 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:22:01.021 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14784", 2024-02-10T08:22:01.021 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:22:01.021 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 29654 2024-02-10T08:22:01.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.021 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:22:01.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.021 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:22:01.022 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:03.387316+0000", 2024-02-10T08:22:01.022 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:22:01.022 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.022 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.022 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:22:01.022 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:03.387316+0000", 2024-02-10T08:22:01.022 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-02-10T08:22:01.022 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.022 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.022 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:22:01.022 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:03.387315+0000", 2024-02-10T08:22:01.022 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4715999999999997e-05 2024-02-10T08:22:01.022 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.022 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.023 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:22:01.023 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:03.387359+0000", 2024-02-10T08:22:01.023 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8199999999999992e-06 2024-02-10T08:22:01.023 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.023 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.023 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:22:01.023 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:03.387369+0000", 2024-02-10T08:22:01.023 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5769999999999999e-06 2024-02-10T08:22:01.023 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.023 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.023 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:22:01.023 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:03.387376+0000", 2024-02-10T08:22:01.023 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3590000000000001e-05 2024-02-10T08:22:01.023 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.023 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.024 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:22:01.024 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:03.387419+0000", 2024-02-10T08:22:01.024 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7578999999999995e-05 2024-02-10T08:22:01.024 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.024 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.024 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:22:01.024 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:03.387517+0000", 2024-02-10T08:22:01.024 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015813700000000001 2024-02-10T08:22:01.024 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.024 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.024 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3,7", 2024-02-10T08:22:01.024 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:03.387675+0000", 2024-02-10T08:22:01.024 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0010076460000000001 2024-02-10T08:22:01.024 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.025 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:22:01.025 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:03.388683+0000", 2024-02-10T08:22:01.025 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000178004 2024-02-10T08:22:01.025 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.025 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:22:01.025 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:03.388861+0000", 2024-02-10T08:22:01.026 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.098022174000000004 2024-02-10T08:22:01.026 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.026 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.026 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:22:01.026 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:03.486883+0000", 2024-02-10T08:22:01.026 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6647000000000002e-05 2024-02-10T08:22:01.026 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.026 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.027 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:22:01.027 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:03.486940+0000", 2024-02-10T08:22:01.027 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3003999999999997e-05 2024-02-10T08:22:01.027 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.027 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.027 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:22:01.027 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:03.486983+0000", 2024-02-10T08:22:01.028 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.099666355999999998 2024-02-10T08:22:01.028 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:22:01.028 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:22:01.028 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:22:01.028 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.028 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.029 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14784.0:29664 7.c 7:344c3984:::benchmark_data_smithi018_80623_object29663:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e96)", 2024-02-10T08:22:01.029 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:20:03.389201+0000", 2024-02-10T08:22:01.029 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 117.616247507, 2024-02-10T08:22:01.029 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.099623642999999998, 2024-02-10T08:22:01.029 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:22:01.029 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:22:01.030 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:22:01.030 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14784", 2024-02-10T08:22:01.030 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:22:01.030 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 29664 2024-02-10T08:22:01.030 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.030 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:22:01.030 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.030 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:22:01.031 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:03.389201+0000", 2024-02-10T08:22:01.031 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:22:01.031 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.031 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.031 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:22:01.031 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:03.389201+0000", 2024-02-10T08:22:01.031 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-02-10T08:22:01.032 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.032 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.032 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:22:01.032 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:03.389200+0000", 2024-02-10T08:22:01.032 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8878999999999997e-05 2024-02-10T08:22:01.032 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.032 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.033 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:22:01.033 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:03.389249+0000", 2024-02-10T08:22:01.033 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6379999999999999e-06 2024-02-10T08:22:01.033 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.033 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.033 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:22:01.033 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:03.389259+0000", 2024-02-10T08:22:01.034 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.34e-06 2024-02-10T08:22:01.034 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.034 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.034 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:22:01.034 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:03.389263+0000", 2024-02-10T08:22:01.034 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7836999999999997e-05 2024-02-10T08:22:01.035 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.035 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.035 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:22:01.035 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:03.389301+0000", 2024-02-10T08:22:01.035 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013076299999999999 2024-02-10T08:22:01.035 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.035 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.036 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:22:01.036 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:03.389432+0000", 2024-02-10T08:22:01.036 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014099300000000001 2024-02-10T08:22:01.036 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.036 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.036 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3,7", 2024-02-10T08:22:01.036 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:03.389573+0000", 2024-02-10T08:22:01.036 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00092140699999999996 2024-02-10T08:22:01.037 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.037 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.037 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:22:01.037 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:03.390494+0000", 2024-02-10T08:22:01.037 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00026458500000000002 2024-02-10T08:22:01.037 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.037 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.037 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:22:01.037 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:03.390759+0000", 2024-02-10T08:22:01.037 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.097994390000000001 2024-02-10T08:22:01.037 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.037 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.037 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:22:01.037 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:03.488753+0000", 2024-02-10T08:22:01.038 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0025999999999999e-05 2024-02-10T08:22:01.038 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.038 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:22:01.038 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:03.488793+0000", 2024-02-10T08:22:01.038 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1844999999999997e-05 2024-02-10T08:22:01.038 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.038 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:22:01.038 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:03.488825+0000", 2024-02-10T08:22:01.038 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.099623642999999998 2024-02-10T08:22:01.038 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:22:01.038 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:22:01.038 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:22:01.038 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.039 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.039 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14784.0:37315 7.c 7:340e3164:::benchmark_data_smithi018_80623_object37314:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e97)", 2024-02-10T08:22:01.039 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:20:08.129851+0000", 2024-02-10T08:22:01.039 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 112.875597876, 2024-02-10T08:22:01.039 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.081949789999999995, 2024-02-10T08:22:01.039 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:22:01.039 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:22:01.039 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:22:01.039 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14784", 2024-02-10T08:22:01.039 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:22:01.039 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 37315 2024-02-10T08:22:01.039 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.039 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:22:01.039 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.039 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:22:01.040 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:08.129851+0000", 2024-02-10T08:22:01.040 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:22:01.040 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.040 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.040 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:22:01.040 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:08.129851+0000", 2024-02-10T08:22:01.040 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-02-10T08:22:01.040 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.040 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.040 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:22:01.040 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:08.129850+0000", 2024-02-10T08:22:01.040 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7649000000000003e-05 2024-02-10T08:22:01.040 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.041 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.041 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:22:01.041 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:08.129907+0000", 2024-02-10T08:22:01.041 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.044e-05 2024-02-10T08:22:01.041 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.041 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.041 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:22:01.041 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:08.129918+0000", 2024-02-10T08:22:01.041 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7609999999999998e-06 2024-02-10T08:22:01.041 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.041 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.041 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:22:01.042 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:08.129923+0000", 2024-02-10T08:22:01.042 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3921999999999998e-05 2024-02-10T08:22:01.042 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.042 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.042 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:22:01.042 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:08.129957+0000", 2024-02-10T08:22:01.042 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1887999999999998e-05 2024-02-10T08:22:01.042 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.042 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.042 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:22:01.043 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:08.130048+0000", 2024-02-10T08:22:01.043 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2768000000000004e-05 2024-02-10T08:22:01.043 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.043 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.043 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3,7", 2024-02-10T08:22:01.043 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:08.130141+0000", 2024-02-10T08:22:01.043 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033731519999999999 2024-02-10T08:22:01.043 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.043 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.043 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:22:01.043 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:08.133514+0000", 2024-02-10T08:22:01.043 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8597999999999995e-05 2024-02-10T08:22:01.044 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.044 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.044 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:22:01.044 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:08.133593+0000", 2024-02-10T08:22:01.044 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.078144246000000001 2024-02-10T08:22:01.044 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.044 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.044 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:22:01.044 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:08.211737+0000", 2024-02-10T08:22:01.044 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7747000000000003e-05 2024-02-10T08:22:01.044 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.044 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.045 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:22:01.045 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:08.211775+0000", 2024-02-10T08:22:01.045 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5746999999999999e-05 2024-02-10T08:22:01.045 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.045 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.045 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:22:01.045 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:08.211801+0000", 2024-02-10T08:22:01.045 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.081949789999999995 2024-02-10T08:22:01.045 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:22:01.045 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:22:01.045 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:22:01.045 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.046 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.046 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14784.0:37319 7.c 7:355de450:::benchmark_data_smithi018_80623_object37318:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e97)", 2024-02-10T08:22:01.046 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:20:08.130541+0000", 2024-02-10T08:22:01.046 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 112.87490820799999, 2024-02-10T08:22:01.046 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.083560182999999996, 2024-02-10T08:22:01.046 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:22:01.046 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:22:01.046 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:22:01.046 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14784", 2024-02-10T08:22:01.046 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:22:01.046 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 37319 2024-02-10T08:22:01.047 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.047 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:22:01.047 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.047 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:22:01.047 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:08.130541+0000", 2024-02-10T08:22:01.047 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:22:01.047 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.047 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.047 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:22:01.047 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:08.130541+0000", 2024-02-10T08:22:01.047 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-02-10T08:22:01.047 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.047 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.047 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:22:01.048 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:08.130539+0000", 2024-02-10T08:22:01.048 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0926000000000005e-05 2024-02-10T08:22:01.048 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.048 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.048 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:22:01.048 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:08.130610+0000", 2024-02-10T08:22:01.048 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1544e-05 2024-02-10T08:22:01.048 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.048 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.048 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:22:01.048 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:08.130622+0000", 2024-02-10T08:22:01.048 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4860000000000002e-06 2024-02-10T08:22:01.049 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.049 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.049 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:22:01.049 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:08.130628+0000", 2024-02-10T08:22:01.049 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00077973199999999999 2024-02-10T08:22:01.049 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.049 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.049 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:22:01.049 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:08.131408+0000", 2024-02-10T08:22:01.049 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000120705 2024-02-10T08:22:01.049 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.049 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.049 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:22:01.049 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:08.131529+0000", 2024-02-10T08:22:01.049 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000139047 2024-02-10T08:22:01.050 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.050 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.050 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3,7", 2024-02-10T08:22:01.050 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:08.131668+0000", 2024-02-10T08:22:01.050 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001852923 2024-02-10T08:22:01.050 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.050 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.050 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:22:01.050 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:08.133521+0000", 2024-02-10T08:22:01.050 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000102668 2024-02-10T08:22:01.050 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.050 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.050 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:22:01.050 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:08.133623+0000", 2024-02-10T08:22:01.050 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.080405160000000003 2024-02-10T08:22:01.051 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.051 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.051 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:22:01.051 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:08.214029+0000", 2024-02-10T08:22:01.051 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2805999999999997e-05 2024-02-10T08:22:01.051 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.051 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.051 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:22:01.051 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:08.214061+0000", 2024-02-10T08:22:01.051 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9322000000000001e-05 2024-02-10T08:22:01.051 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.051 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.051 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:22:01.051 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:08.214101+0000", 2024-02-10T08:22:01.051 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.083560182999999996 2024-02-10T08:22:01.052 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:22:01.052 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:22:01.052 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:22:01.052 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.052 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.052 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14784.0:37322 7.c 7:3b314ee2:::benchmark_data_smithi018_80623_object37321:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e97)", 2024-02-10T08:22:01.052 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:20:08.132290+0000", 2024-02-10T08:22:01.052 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 112.873158686, 2024-02-10T08:22:01.053 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.081906016999999998, 2024-02-10T08:22:01.053 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:22:01.053 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:22:01.053 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:22:01.053 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14784", 2024-02-10T08:22:01.053 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:22:01.053 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 37322 2024-02-10T08:22:01.053 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.053 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:22:01.053 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.053 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:22:01.053 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:08.132290+0000", 2024-02-10T08:22:01.053 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:22:01.053 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.053 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.054 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:22:01.054 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:08.132290+0000", 2024-02-10T08:22:01.054 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-02-10T08:22:01.054 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.054 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.054 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:22:01.054 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:08.132289+0000", 2024-02-10T08:22:01.054 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8532999999999997e-05 2024-02-10T08:22:01.054 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.054 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.054 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:22:01.054 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:08.132348+0000", 2024-02-10T08:22:01.054 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1195e-05 2024-02-10T08:22:01.054 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.055 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.055 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:22:01.055 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:08.132359+0000", 2024-02-10T08:22:01.055 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0490000000000003e-06 2024-02-10T08:22:01.055 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.055 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.055 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:22:01.055 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:08.132364+0000", 2024-02-10T08:22:01.055 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000143566 2024-02-10T08:22:01.055 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.055 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.055 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:22:01.055 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:08.132507+0000", 2024-02-10T08:22:01.055 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000113346 2024-02-10T08:22:01.055 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.056 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.056 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:22:01.056 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:08.132621+0000", 2024-02-10T08:22:01.056 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015515900000000001 2024-02-10T08:22:01.056 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.056 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.056 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3,7", 2024-02-10T08:22:01.056 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:08.132776+0000", 2024-02-10T08:22:01.056 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00088563300000000004 2024-02-10T08:22:01.056 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.056 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.056 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:22:01.056 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:08.133662+0000", 2024-02-10T08:22:01.057 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00099621600000000007 2024-02-10T08:22:01.057 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.057 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.057 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:22:01.057 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:08.134658+0000", 2024-02-10T08:22:01.057 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.079472632000000001 2024-02-10T08:22:01.057 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.057 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.057 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:22:01.057 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:08.214130+0000", 2024-02-10T08:22:01.057 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6787999999999998e-05 2024-02-10T08:22:01.058 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.058 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.058 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:22:01.058 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:08.214157+0000", 2024-02-10T08:22:01.058 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8914e-05 2024-02-10T08:22:01.058 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.058 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.058 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:22:01.058 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:08.214196+0000", 2024-02-10T08:22:01.058 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.081906016999999998 2024-02-10T08:22:01.058 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:22:01.058 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:22:01.058 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:22:01.058 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.059 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.059 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14784.0:72742 7.7 7:ef56a575:::benchmark_data_smithi018_80623_object72741:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e106)", 2024-02-10T08:22:01.059 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:20:37.803116+0000", 2024-02-10T08:22:01.059 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 83.202332280999997, 2024-02-10T08:22:01.059 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.086907639999999994, 2024-02-10T08:22:01.059 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:22:01.059 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:22:01.059 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:22:01.059 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14784", 2024-02-10T08:22:01.059 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:22:01.059 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 72742 2024-02-10T08:22:01.059 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.059 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:22:01.059 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.060 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:22:01.060 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.803116+0000", 2024-02-10T08:22:01.060 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:22:01.060 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.060 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.060 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:22:01.060 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.803116+0000", 2024-02-10T08:22:01.060 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-02-10T08:22:01.060 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.060 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.060 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:22:01.060 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.803116+0000", 2024-02-10T08:22:01.060 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1088999999999997e-05 2024-02-10T08:22:01.060 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.061 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.061 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:22:01.061 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.803177+0000", 2024-02-10T08:22:01.061 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8808999999999999e-05 2024-02-10T08:22:01.061 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.061 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.061 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:22:01.061 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.803196+0000", 2024-02-10T08:22:01.061 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5270000000000004e-06 2024-02-10T08:22:01.061 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.061 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.061 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:22:01.061 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.803202+0000", 2024-02-10T08:22:01.061 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0025028170000000001 2024-02-10T08:22:01.062 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.062 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.062 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:22:01.062 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.805705+0000", 2024-02-10T08:22:01.062 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0858000000000003e-05 2024-02-10T08:22:01.062 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.062 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.062 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:22:01.062 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.805796+0000", 2024-02-10T08:22:01.062 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000104972 2024-02-10T08:22:01.062 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.062 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.062 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,3", 2024-02-10T08:22:01.063 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.805901+0000", 2024-02-10T08:22:01.063 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0070977920000000003 2024-02-10T08:22:01.063 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.063 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.063 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:22:01.063 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.812999+0000", 2024-02-10T08:22:01.063 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0041987550000000002 2024-02-10T08:22:01.063 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.063 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.063 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:22:01.063 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.817198+0000", 2024-02-10T08:22:01.063 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.072723243000000007 2024-02-10T08:22:01.064 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.064 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.064 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:22:01.064 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.889921+0000", 2024-02-10T08:22:01.064 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6628000000000001e-05 2024-02-10T08:22:01.064 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.064 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.064 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:22:01.064 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.889977+0000", 2024-02-10T08:22:01.064 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6640000000000001e-05 2024-02-10T08:22:01.065 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.065 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.065 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:22:01.065 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.890024+0000", 2024-02-10T08:22:01.065 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.086907639999999994 2024-02-10T08:22:01.065 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:22:01.065 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:22:01.065 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:22:01.065 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.065 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.066 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14784.0:72745 7.7 7:e9cc2731:::benchmark_data_smithi018_80623_object72744:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e106)", 2024-02-10T08:22:01.066 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:20:37.806078+0000", 2024-02-10T08:22:01.066 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 83.199370367, 2024-02-10T08:22:01.066 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.085158207, 2024-02-10T08:22:01.066 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:22:01.066 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:22:01.066 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:22:01.066 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14784", 2024-02-10T08:22:01.066 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:22:01.066 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 72745 2024-02-10T08:22:01.066 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.066 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:22:01.067 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.067 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:22:01.067 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.806078+0000", 2024-02-10T08:22:01.067 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:22:01.068 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.068 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.068 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:22:01.068 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.806078+0000", 2024-02-10T08:22:01.068 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-02-10T08:22:01.068 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.068 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.068 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:22:01.068 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.806077+0000", 2024-02-10T08:22:01.068 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2630999999999998e-05 2024-02-10T08:22:01.069 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.069 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.069 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:22:01.069 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.806130+0000", 2024-02-10T08:22:01.069 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0769e-05 2024-02-10T08:22:01.069 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.069 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.069 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:22:01.069 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.806141+0000", 2024-02-10T08:22:01.069 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2420000000000002e-06 2024-02-10T08:22:01.069 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.069 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.069 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:22:01.069 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.806145+0000", 2024-02-10T08:22:01.070 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0010880620000000001 2024-02-10T08:22:01.070 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.070 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.070 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:22:01.070 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.807233+0000", 2024-02-10T08:22:01.070 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4390999999999999e-05 2024-02-10T08:22:01.070 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.070 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.070 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:22:01.070 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.807317+0000", 2024-02-10T08:22:01.070 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7225000000000005e-05 2024-02-10T08:22:01.070 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.070 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.070 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,3", 2024-02-10T08:22:01.070 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.807415+0000", 2024-02-10T08:22:01.071 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0055909769999999996 2024-02-10T08:22:01.071 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.071 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.071 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:22:01.071 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.813006+0000", 2024-02-10T08:22:01.071 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.072641490000000003 2024-02-10T08:22:01.071 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.071 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.071 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:22:01.071 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.885647+0000", 2024-02-10T08:22:01.071 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0054696279999999998 2024-02-10T08:22:01.071 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.071 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.071 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:22:01.071 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.891117+0000", 2024-02-10T08:22:01.072 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8591999999999998e-05 2024-02-10T08:22:01.072 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.072 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.072 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:22:01.072 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.891165+0000", 2024-02-10T08:22:01.072 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1209000000000002e-05 2024-02-10T08:22:01.072 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.072 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.072 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:22:01.072 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.891237+0000", 2024-02-10T08:22:01.072 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.085158207 2024-02-10T08:22:01.072 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:22:01.072 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:22:01.073 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:22:01.073 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.073 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.073 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14784.0:72748 7.7 7:e9affe9b:::benchmark_data_smithi018_80623_object72747:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e106)", 2024-02-10T08:22:01.073 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:20:37.806150+0000", 2024-02-10T08:22:01.073 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 83.199298408000004, 2024-02-10T08:22:01.073 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.085199753000000003, 2024-02-10T08:22:01.073 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:22:01.073 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:22:01.073 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:22:01.073 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14784", 2024-02-10T08:22:01.073 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:22:01.073 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 72748 2024-02-10T08:22:01.073 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.074 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:22:01.074 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.074 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:22:01.074 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.806150+0000", 2024-02-10T08:22:01.074 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:22:01.074 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.074 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.074 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:22:01.074 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.806150+0000", 2024-02-10T08:22:01.074 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-02-10T08:22:01.074 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.074 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.074 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:22:01.074 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.806150+0000", 2024-02-10T08:22:01.075 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3244000000000001e-05 2024-02-10T08:22:01.075 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.075 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.075 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:22:01.075 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.806193+0000", 2024-02-10T08:22:01.075 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3959999999999997e-06 2024-02-10T08:22:01.075 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.075 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.075 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:22:01.075 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.806199+0000", 2024-02-10T08:22:01.075 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8100000000000002e-06 2024-02-10T08:22:01.075 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.075 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.075 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:22:01.075 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.806201+0000", 2024-02-10T08:22:01.076 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0024597249999999998 2024-02-10T08:22:01.076 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.076 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.076 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:22:01.076 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.808661+0000", 2024-02-10T08:22:01.076 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010481500000000001 2024-02-10T08:22:01.076 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.076 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.076 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:22:01.076 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.808766+0000", 2024-02-10T08:22:01.076 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5070999999999998e-05 2024-02-10T08:22:01.076 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.077 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.077 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,3", 2024-02-10T08:22:01.077 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.808861+0000", 2024-02-10T08:22:01.077 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0041479200000000003 2024-02-10T08:22:01.077 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.077 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.077 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:22:01.077 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.813009+0000", 2024-02-10T08:22:01.077 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.072682149000000001 2024-02-10T08:22:01.077 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.078 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.078 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:22:01.078 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.885691+0000", 2024-02-10T08:22:01.078 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0055810510000000001 2024-02-10T08:22:01.078 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.078 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.078 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:22:01.078 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.891272+0000", 2024-02-10T08:22:01.078 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4243999999999999e-05 2024-02-10T08:22:01.079 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.079 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.079 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:22:01.079 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.891316+0000", 2024-02-10T08:22:01.079 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3798999999999999e-05 2024-02-10T08:22:01.079 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.079 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.079 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:22:01.079 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.891350+0000", 2024-02-10T08:22:01.079 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.085199753000000003 2024-02-10T08:22:01.079 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:22:01.079 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:22:01.079 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:22:01.079 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.080 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.080 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14784.0:72749 7.7 7:eb0caa8d:::benchmark_data_smithi018_80623_object72748:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e106)", 2024-02-10T08:22:01.080 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:20:37.806205+0000", 2024-02-10T08:22:01.080 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 83.199243883999998, 2024-02-10T08:22:01.080 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.087516799000000006, 2024-02-10T08:22:01.080 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:22:01.080 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:22:01.080 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:22:01.080 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14784", 2024-02-10T08:22:01.080 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:22:01.080 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 72749 2024-02-10T08:22:01.080 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.080 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:22:01.081 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.081 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:22:01.081 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.806205+0000", 2024-02-10T08:22:01.081 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:22:01.081 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.081 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.081 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:22:01.081 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.806205+0000", 2024-02-10T08:22:01.081 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-02-10T08:22:01.081 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.081 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.081 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:22:01.081 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.806204+0000", 2024-02-10T08:22:01.082 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1427000000000002e-05 2024-02-10T08:22:01.082 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.082 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.082 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:22:01.082 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.806246+0000", 2024-02-10T08:22:01.082 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7110000000000003e-06 2024-02-10T08:22:01.082 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.082 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.082 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:22:01.082 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.806251+0000", 2024-02-10T08:22:01.082 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5450000000000002e-06 2024-02-10T08:22:01.082 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.082 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.082 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:22:01.083 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.806253+0000", 2024-02-10T08:22:01.083 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040430179999999998 2024-02-10T08:22:01.083 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.083 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.083 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:22:01.083 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.810296+0000", 2024-02-10T08:22:01.083 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011337599999999999 2024-02-10T08:22:01.083 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.083 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.083 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:22:01.083 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.810410+0000", 2024-02-10T08:22:01.083 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6667000000000001e-05 2024-02-10T08:22:01.083 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.083 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.083 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,3", 2024-02-10T08:22:01.084 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.810506+0000", 2024-02-10T08:22:01.084 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002507371 2024-02-10T08:22:01.084 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.084 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.084 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:22:01.084 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.813014+0000", 2024-02-10T08:22:01.084 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.075304407000000004 2024-02-10T08:22:01.084 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.084 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.084 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:22:01.084 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.888318+0000", 2024-02-10T08:22:01.085 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0053001189999999998 2024-02-10T08:22:01.085 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.085 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.085 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:22:01.085 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.893618+0000", 2024-02-10T08:22:01.085 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0225e-05 2024-02-10T08:22:01.085 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.085 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.085 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:22:01.085 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.893678+0000", 2024-02-10T08:22:01.085 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3373e-05 2024-02-10T08:22:01.085 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.085 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.085 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:22:01.085 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.893722+0000", 2024-02-10T08:22:01.086 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.087516799000000006 2024-02-10T08:22:01.086 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:22:01.086 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:22:01.086 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:22:01.086 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.086 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.086 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14784.0:72751 7.d 7:b89b70a2:::benchmark_data_smithi018_80623_object72750:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e106)", 2024-02-10T08:22:01.086 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:20:37.808960+0000", 2024-02-10T08:22:01.086 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 83.196489165000003, 2024-02-10T08:22:01.086 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.078105791999999993, 2024-02-10T08:22:01.086 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:22:01.086 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:22:01.086 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:22:01.086 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14784", 2024-02-10T08:22:01.087 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:22:01.087 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 72751 2024-02-10T08:22:01.087 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.087 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:22:01.087 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.087 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:22:01.087 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.808960+0000", 2024-02-10T08:22:01.087 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:22:01.087 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.087 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.087 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:22:01.087 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.808960+0000", 2024-02-10T08:22:01.087 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-02-10T08:22:01.087 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.088 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.088 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:22:01.088 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.808958+0000", 2024-02-10T08:22:01.088 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9724e-05 2024-02-10T08:22:01.088 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.088 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.088 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:22:01.088 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.809008+0000", 2024-02-10T08:22:01.088 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3535e-05 2024-02-10T08:22:01.089 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.089 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.089 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:22:01.089 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.809021+0000", 2024-02-10T08:22:01.089 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2400000000000001e-06 2024-02-10T08:22:01.089 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.089 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.089 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:22:01.089 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.809029+0000", 2024-02-10T08:22:01.089 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4116999999999998e-05 2024-02-10T08:22:01.089 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.089 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.090 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:22:01.090 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.809073+0000", 2024-02-10T08:22:01.090 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012595999999999999 2024-02-10T08:22:01.090 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.090 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.090 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:22:01.090 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.809199+0000", 2024-02-10T08:22:01.090 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015016300000000001 2024-02-10T08:22:01.090 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.090 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.090 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,1", 2024-02-10T08:22:01.090 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.809349+0000", 2024-02-10T08:22:01.090 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0018432139999999999 2024-02-10T08:22:01.091 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.091 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.091 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:22:01.091 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.811192+0000", 2024-02-10T08:22:01.091 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020677859999999998 2024-02-10T08:22:01.091 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.091 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.091 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:22:01.091 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.813260+0000", 2024-02-10T08:22:01.091 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.073698449999999999 2024-02-10T08:22:01.091 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.091 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.091 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:22:01.091 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.886958+0000", 2024-02-10T08:22:01.092 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8261999999999999e-05 2024-02-10T08:22:01.092 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.092 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.092 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:22:01.092 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.887017+0000", 2024-02-10T08:22:01.092 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8865000000000001e-05 2024-02-10T08:22:01.092 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.092 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.092 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:22:01.092 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.887065+0000", 2024-02-10T08:22:01.092 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.078105791999999993 2024-02-10T08:22:01.092 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:22:01.092 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:22:01.093 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:22:01.093 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.093 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.093 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14784.0:72752 7.7 7:eeb6c44b:::benchmark_data_smithi018_80623_object72751:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e106)", 2024-02-10T08:22:01.093 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:20:37.809045+0000", 2024-02-10T08:22:01.093 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 83.196403489999994, 2024-02-10T08:22:01.093 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.085285735000000001, 2024-02-10T08:22:01.093 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:22:01.093 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:22:01.093 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:22:01.093 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14784", 2024-02-10T08:22:01.093 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:22:01.093 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 72752 2024-02-10T08:22:01.093 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.094 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:22:01.094 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.094 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:22:01.094 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.809045+0000", 2024-02-10T08:22:01.094 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:22:01.094 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.094 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.094 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:22:01.094 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.809045+0000", 2024-02-10T08:22:01.094 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-02-10T08:22:01.094 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.094 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.094 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:22:01.094 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.809045+0000", 2024-02-10T08:22:01.094 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1576999999999999e-05 2024-02-10T08:22:01.095 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.095 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.095 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:22:01.095 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.809086+0000", 2024-02-10T08:22:01.095 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1289999999999998e-06 2024-02-10T08:22:01.095 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.095 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.095 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:22:01.095 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.809093+0000", 2024-02-10T08:22:01.095 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2470000000000002e-06 2024-02-10T08:22:01.095 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.095 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.095 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:22:01.095 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.809097+0000", 2024-02-10T08:22:01.096 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027725979999999998 2024-02-10T08:22:01.096 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.096 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.096 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:22:01.096 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.811870+0000", 2024-02-10T08:22:01.096 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8659999999999996e-05 2024-02-10T08:22:01.096 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.096 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.096 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:22:01.096 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.811949+0000", 2024-02-10T08:22:01.096 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3141999999999997e-05 2024-02-10T08:22:01.097 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.097 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.097 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,3", 2024-02-10T08:22:01.097 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.812042+0000", 2024-02-10T08:22:01.097 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001068783 2024-02-10T08:22:01.097 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.097 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.097 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:22:01.097 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.813111+0000", 2024-02-10T08:22:01.097 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.080843742999999996 2024-02-10T08:22:01.097 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.097 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.097 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:22:01.097 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.893954+0000", 2024-02-10T08:22:01.097 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00030730699999999999 2024-02-10T08:22:01.098 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.098 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.098 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:22:01.098 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.894262+0000", 2024-02-10T08:22:01.098 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1396999999999998e-05 2024-02-10T08:22:01.098 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.098 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.098 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:22:01.098 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.894293+0000", 2024-02-10T08:22:01.098 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7886000000000003e-05 2024-02-10T08:22:01.098 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.098 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.098 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:22:01.098 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.894331+0000", 2024-02-10T08:22:01.098 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.085285735000000001 2024-02-10T08:22:01.099 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:22:01.099 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:22:01.099 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:22:01.099 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.099 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.099 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14784.0:72756 7.7 7:ecf5be3c:::benchmark_data_smithi018_80623_object72755:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e106)", 2024-02-10T08:22:01.099 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:20:37.815402+0000", 2024-02-10T08:22:01.099 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 83.190046311000003, 2024-02-10T08:22:01.099 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.081076934000000003, 2024-02-10T08:22:01.100 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:22:01.100 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:22:01.100 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:22:01.100 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14784", 2024-02-10T08:22:01.100 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:22:01.100 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 72756 2024-02-10T08:22:01.100 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.101 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:22:01.101 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.101 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:22:01.101 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.815402+0000", 2024-02-10T08:22:01.101 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:22:01.101 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.101 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.101 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:22:01.101 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.815402+0000", 2024-02-10T08:22:01.101 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-02-10T08:22:01.101 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.101 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.101 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:22:01.102 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.815401+0000", 2024-02-10T08:22:01.102 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3752999999999999e-05 2024-02-10T08:22:01.102 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.102 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.102 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:22:01.102 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.815445+0000", 2024-02-10T08:22:01.102 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0250000000000008e-06 2024-02-10T08:22:01.102 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.102 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.102 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:22:01.102 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.815454+0000", 2024-02-10T08:22:01.102 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6059999999999996e-06 2024-02-10T08:22:01.102 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.102 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.102 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:22:01.103 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.815459+0000", 2024-02-10T08:22:01.103 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0491e-05 2024-02-10T08:22:01.103 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.103 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.103 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:22:01.103 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.815489+0000", 2024-02-10T08:22:01.103 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5451999999999994e-05 2024-02-10T08:22:01.103 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.103 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.103 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:22:01.103 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.815574+0000", 2024-02-10T08:22:01.103 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9141999999999994e-05 2024-02-10T08:22:01.103 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.103 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.104 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,3", 2024-02-10T08:22:01.104 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.815674+0000", 2024-02-10T08:22:01.104 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0015313639999999999 2024-02-10T08:22:01.104 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.104 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.104 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:22:01.104 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.817205+0000", 2024-02-10T08:22:01.104 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.076846215999999995 2024-02-10T08:22:01.104 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.104 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.104 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:22:01.104 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.894051+0000", 2024-02-10T08:22:01.104 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0023233389999999998 2024-02-10T08:22:01.105 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.105 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.105 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:22:01.105 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.896375+0000", 2024-02-10T08:22:01.105 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2353000000000004e-05 2024-02-10T08:22:01.105 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.105 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.105 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:22:01.105 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.896437+0000", 2024-02-10T08:22:01.105 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2508e-05 2024-02-10T08:22:01.105 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.105 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.105 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:22:01.105 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:37.896479+0000", 2024-02-10T08:22:01.105 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.081076934000000003 2024-02-10T08:22:01.106 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:22:01.106 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:22:01.106 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:22:01.106 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.106 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.106 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14784.0:77128 7.7 7:e88de2a8:::benchmark_data_smithi018_80623_object77127:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e107)", 2024-02-10T08:22:01.106 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:20:42.057680+0000", 2024-02-10T08:22:01.106 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 78.947768322000002, 2024-02-10T08:22:01.106 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.106255799, 2024-02-10T08:22:01.106 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:22:01.106 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:22:01.106 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:22:01.106 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14784", 2024-02-10T08:22:01.106 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:22:01.107 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 77128 2024-02-10T08:22:01.107 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.107 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:22:01.107 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.107 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:22:01.107 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:42.057680+0000", 2024-02-10T08:22:01.107 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:22:01.107 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.107 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.107 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:22:01.107 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:42.057680+0000", 2024-02-10T08:22:01.107 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-02-10T08:22:01.107 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.107 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.107 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:22:01.108 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:42.057679+0000", 2024-02-10T08:22:01.108 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5815e-05 2024-02-10T08:22:01.108 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.108 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.108 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:22:01.108 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:42.057735+0000", 2024-02-10T08:22:01.108 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1749999999999994e-06 2024-02-10T08:22:01.108 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.108 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.108 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:22:01.108 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:42.057744+0000", 2024-02-10T08:22:01.108 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9840000000000001e-06 2024-02-10T08:22:01.108 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.109 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.109 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:22:01.109 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:42.057749+0000", 2024-02-10T08:22:01.109 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1900000000000002e-05 2024-02-10T08:22:01.109 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.109 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.109 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:22:01.109 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:42.057791+0000", 2024-02-10T08:22:01.109 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000112187 2024-02-10T08:22:01.109 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.109 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.109 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:22:01.109 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:42.057903+0000", 2024-02-10T08:22:01.110 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010792499999999999 2024-02-10T08:22:01.110 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.110 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.110 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,3", 2024-02-10T08:22:01.110 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:42.058011+0000", 2024-02-10T08:22:01.110 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001940067 2024-02-10T08:22:01.110 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.110 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.110 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:22:01.110 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:42.059951+0000", 2024-02-10T08:22:01.111 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0071184860000000003 2024-02-10T08:22:01.111 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.111 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.111 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:22:01.111 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:42.067070+0000", 2024-02-10T08:22:01.111 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.096811475999999994 2024-02-10T08:22:01.111 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.111 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.111 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:22:01.111 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:42.163881+0000", 2024-02-10T08:22:01.111 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1439000000000002e-05 2024-02-10T08:22:01.111 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.111 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.111 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:22:01.111 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:42.163913+0000", 2024-02-10T08:22:01.112 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3506000000000002e-05 2024-02-10T08:22:01.112 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.112 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.112 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:22:01.112 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:42.163936+0000", 2024-02-10T08:22:01.112 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.106255799 2024-02-10T08:22:01.112 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:22:01.112 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:22:01.112 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:22:01.112 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.112 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.112 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14784.0:77144 7.d 7:b82c5686:::benchmark_data_smithi018_80623_object77143:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e107)", 2024-02-10T08:22:01.112 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:20:42.074209+0000", 2024-02-10T08:22:01.112 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 78.931239544999997, 2024-02-10T08:22:01.113 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089104509999999998, 2024-02-10T08:22:01.113 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:22:01.113 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:22:01.113 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:22:01.113 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14784", 2024-02-10T08:22:01.113 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:22:01.113 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 77144 2024-02-10T08:22:01.113 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.113 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:22:01.113 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.113 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:22:01.113 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:42.074209+0000", 2024-02-10T08:22:01.113 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:22:01.113 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.113 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.114 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:22:01.114 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:42.074209+0000", 2024-02-10T08:22:01.114 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-02-10T08:22:01.114 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.114 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.114 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:22:01.114 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:42.074208+0000", 2024-02-10T08:22:01.114 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9762999999999999e-05 2024-02-10T08:22:01.114 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.114 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.114 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:22:01.114 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:42.074237+0000", 2024-02-10T08:22:01.115 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6090999999999999e-05 2024-02-10T08:22:01.115 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.115 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.115 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:22:01.115 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:42.074253+0000", 2024-02-10T08:22:01.115 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7170000000000008e-06 2024-02-10T08:22:01.115 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.115 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.115 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:22:01.115 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:42.074261+0000", 2024-02-10T08:22:01.116 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2599000000000002e-05 2024-02-10T08:22:01.116 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.116 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.116 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:22:01.116 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:42.074314+0000", 2024-02-10T08:22:01.116 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013811199999999999 2024-02-10T08:22:01.117 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.117 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.117 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:22:01.117 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:42.074452+0000", 2024-02-10T08:22:01.117 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017973500000000001 2024-02-10T08:22:01.117 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.117 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.118 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,1", 2024-02-10T08:22:01.118 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:42.074632+0000", 2024-02-10T08:22:01.118 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0021942289999999998 2024-02-10T08:22:01.118 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.118 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.118 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:22:01.118 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:42.076826+0000", 2024-02-10T08:22:01.119 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017593400000000001 2024-02-10T08:22:01.119 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.119 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.119 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:22:01.119 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:42.077002+0000", 2024-02-10T08:22:01.119 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.086210774000000004 2024-02-10T08:22:01.120 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.120 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.120 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:22:01.120 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:42.163213+0000", 2024-02-10T08:22:01.120 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9571000000000003e-05 2024-02-10T08:22:01.120 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.120 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.121 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:22:01.121 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:42.163272+0000", 2024-02-10T08:22:01.121 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1578000000000001e-05 2024-02-10T08:22:01.121 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.121 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.121 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:22:01.122 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:42.163314+0000", 2024-02-10T08:22:01.122 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089104509999999998 2024-02-10T08:22:01.122 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:22:01.122 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:22:01.122 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:22:01.122 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.122 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.123 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14784.0:77149 7.d 7:bf968826:::benchmark_data_smithi018_80623_object77148:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e107)", 2024-02-10T08:22:01.123 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:20:42.078525+0000", 2024-02-10T08:22:01.123 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 78.926923360000004, 2024-02-10T08:22:01.123 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.087595026000000006, 2024-02-10T08:22:01.123 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:22:01.123 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:22:01.124 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:22:01.124 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14784", 2024-02-10T08:22:01.124 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:22:01.124 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 77149 2024-02-10T08:22:01.124 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.124 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:22:01.125 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.125 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:22:01.125 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:42.078525+0000", 2024-02-10T08:22:01.125 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:22:01.125 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.125 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.126 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:22:01.126 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:42.078525+0000", 2024-02-10T08:22:01.126 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999981 2024-02-10T08:22:01.126 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.126 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.126 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:22:01.126 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:42.078524+0000", 2024-02-10T08:22:01.126 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8675000000000003e-05 2024-02-10T08:22:01.126 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.127 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.127 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:22:01.127 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:42.078582+0000", 2024-02-10T08:22:01.127 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1504e-05 2024-02-10T08:22:01.127 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.127 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.127 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:22:01.128 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:42.078594+0000", 2024-02-10T08:22:01.128 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7419999999999997e-06 2024-02-10T08:22:01.128 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.128 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.128 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:22:01.128 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:42.078599+0000", 2024-02-10T08:22:01.129 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1377e-05 2024-02-10T08:22:01.129 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.129 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.129 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:22:01.129 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:42.078640+0000", 2024-02-10T08:22:01.129 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012532299999999999 2024-02-10T08:22:01.129 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.130 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.130 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:22:01.130 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:42.078765+0000", 2024-02-10T08:22:01.130 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000167004 2024-02-10T08:22:01.130 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.130 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.131 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,1", 2024-02-10T08:22:01.131 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:42.078932+0000", 2024-02-10T08:22:01.131 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019760749999999999 2024-02-10T08:22:01.131 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.131 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.132 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:22:01.132 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:42.080908+0000", 2024-02-10T08:22:01.132 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.082968643999999994 2024-02-10T08:22:01.132 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.132 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.132 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:22:01.133 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:42.163877+0000", 2024-02-10T08:22:01.133 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0021257860000000002 2024-02-10T08:22:01.133 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.133 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.133 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:22:01.133 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:42.166003+0000", 2024-02-10T08:22:01.133 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7645999999999995e-05 2024-02-10T08:22:01.134 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.134 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.134 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:22:01.134 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:42.166080+0000", 2024-02-10T08:22:01.134 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9959000000000001e-05 2024-02-10T08:22:01.134 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.135 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.135 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:22:01.135 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:42.166120+0000", 2024-02-10T08:22:01.135 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.087595026000000006 2024-02-10T08:22:01.135 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:22:01.135 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:22:01.136 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:22:01.136 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.136 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.136 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14784.0:111553 7.d 7:b4d81314:::benchmark_data_smithi018_80623_object10625:head [delete] snapc 0=[] ondisk+write+known_if_redirected e125)", 2024-02-10T08:22:01.136 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:21:36.364088+0000", 2024-02-10T08:22:01.136 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 24.641360694999999, 2024-02-10T08:22:01.137 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.079956991000000005, 2024-02-10T08:22:01.137 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:22:01.137 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:22:01.137 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:22:01.137 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14784", 2024-02-10T08:22:01.137 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:22:01.138 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 111553 2024-02-10T08:22:01.138 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.138 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:22:01.138 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.138 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:22:01.138 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:21:36.364088+0000", 2024-02-10T08:22:01.138 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:22:01.139 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.139 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.139 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:22:01.139 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:21:36.364088+0000", 2024-02-10T08:22:01.139 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-02-10T08:22:01.139 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.140 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.140 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:22:01.140 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:21:36.364087+0000", 2024-02-10T08:22:01.140 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6179999999999997e-06 2024-02-10T08:22:01.140 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.140 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.141 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:22:01.141 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:21:36.364094+0000", 2024-02-10T08:22:01.141 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2852e-05 2024-02-10T08:22:01.141 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.141 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.141 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:22:01.142 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:21:36.364107+0000", 2024-02-10T08:22:01.142 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2540000000000003e-06 2024-02-10T08:22:01.142 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.142 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.142 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:22:01.142 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:21:36.364114+0000", 2024-02-10T08:22:01.142 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0590000000000002e-05 2024-02-10T08:22:01.143 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.143 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.143 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:22:01.143 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:21:36.364165+0000", 2024-02-10T08:22:01.143 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013218799999999999 2024-02-10T08:22:01.143 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.144 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.144 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:22:01.144 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:21:36.364297+0000", 2024-02-10T08:22:01.144 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000102042 2024-02-10T08:22:01.144 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.144 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.145 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,1", 2024-02-10T08:22:01.145 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:21:36.364399+0000", 2024-02-10T08:22:01.145 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026770140000000001 2024-02-10T08:22:01.145 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.145 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.145 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:22:01.146 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:21:36.367076+0000", 2024-02-10T08:22:01.146 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.01319564 2024-02-10T08:22:01.146 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.146 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.146 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:22:01.146 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:21:36.380272+0000", 2024-02-10T08:22:01.147 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063677223000000005 2024-02-10T08:22:01.147 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.147 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.147 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:22:01.147 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:21:36.443949+0000", 2024-02-10T08:22:01.147 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9784999999999999e-05 2024-02-10T08:22:01.147 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.148 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.148 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:22:01.148 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:21:36.443999+0000", 2024-02-10T08:22:01.148 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6304999999999998e-05 2024-02-10T08:22:01.148 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.148 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.149 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:22:01.149 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:21:36.444045+0000", 2024-02-10T08:22:01.149 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.079956991000000005 2024-02-10T08:22:01.149 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:22:01.149 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:22:01.149 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:22:01.149 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.149 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.150 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14784.0:111558 7.7 7:e3df6459:::benchmark_data_smithi018_80623_object10630:head [delete] snapc 0=[] ondisk+write+known_if_redirected e125)", 2024-02-10T08:22:01.150 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:21:36.373421+0000", 2024-02-10T08:22:01.150 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 24.632028255000002, 2024-02-10T08:22:01.150 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.079387173000000005, 2024-02-10T08:22:01.150 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:22:01.150 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:22:01.150 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:22:01.150 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14784", 2024-02-10T08:22:01.150 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:22:01.151 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 111558 2024-02-10T08:22:01.151 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.151 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:22:01.151 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.151 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:22:01.151 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:21:36.373421+0000", 2024-02-10T08:22:01.151 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:22:01.151 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.151 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.152 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:22:01.152 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:21:36.373421+0000", 2024-02-10T08:22:01.152 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-02-10T08:22:01.152 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.152 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.152 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:22:01.153 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:21:36.373419+0000", 2024-02-10T08:22:01.153 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.002e-06 2024-02-10T08:22:01.153 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.153 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.153 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:22:01.153 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:21:36.373426+0000", 2024-02-10T08:22:01.153 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2007999999999999e-05 2024-02-10T08:22:01.153 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.153 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.153 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:22:01.154 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:21:36.373438+0000", 2024-02-10T08:22:01.154 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2049999999999999e-06 2024-02-10T08:22:01.154 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.154 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.154 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:22:01.154 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:21:36.373444+0000", 2024-02-10T08:22:01.154 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2039999999999997e-05 2024-02-10T08:22:01.154 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.154 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.154 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:22:01.154 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:21:36.373486+0000", 2024-02-10T08:22:01.154 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4129999999999996e-05 2024-02-10T08:22:01.154 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.154 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.154 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:22:01.155 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:21:36.373570+0000", 2024-02-10T08:22:01.155 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1211000000000005e-05 2024-02-10T08:22:01.155 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.155 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.155 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,3", 2024-02-10T08:22:01.155 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:21:36.373662+0000", 2024-02-10T08:22:01.155 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0024285309999999998 2024-02-10T08:22:01.155 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.155 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.155 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:22:01.155 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:21:36.376090+0000", 2024-02-10T08:22:01.155 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062120034999999997 2024-02-10T08:22:01.155 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.155 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.155 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:22:01.156 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:21:36.438210+0000", 2024-02-10T08:22:01.156 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014508739999999999 2024-02-10T08:22:01.156 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.156 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.156 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:22:01.156 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:21:36.452719+0000", 2024-02-10T08:22:01.156 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7484000000000001e-05 2024-02-10T08:22:01.156 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.156 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.156 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:22:01.156 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:21:36.452766+0000", 2024-02-10T08:22:01.156 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1214000000000002e-05 2024-02-10T08:22:01.156 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.157 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.157 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:22:01.157 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:21:36.452808+0000", 2024-02-10T08:22:01.157 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.079387173000000005 2024-02-10T08:22:01.157 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:22:01.157 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:22:01.157 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:22:01.157 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.157 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.157 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14784.0:111559 7.d 7:b8e6a48a:::benchmark_data_smithi018_80623_object10631:head [delete] snapc 0=[] ondisk+write+known_if_redirected e125)", 2024-02-10T08:22:01.157 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:21:36.373454+0000", 2024-02-10T08:22:01.157 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 24.631994862999999, 2024-02-10T08:22:01.157 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.075650841999999996, 2024-02-10T08:22:01.157 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:22:01.158 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:22:01.158 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:22:01.158 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14784", 2024-02-10T08:22:01.158 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:22:01.158 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 111559 2024-02-10T08:22:01.158 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.158 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:22:01.158 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.158 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:22:01.158 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:21:36.373454+0000", 2024-02-10T08:22:01.158 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:22:01.158 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.158 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.158 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:22:01.159 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:21:36.373454+0000", 2024-02-10T08:22:01.159 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-02-10T08:22:01.159 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.159 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.159 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:22:01.159 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:21:36.373453+0000", 2024-02-10T08:22:01.159 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8499999999999998e-06 2024-02-10T08:22:01.159 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.159 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.159 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:22:01.159 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:21:36.373456+0000", 2024-02-10T08:22:01.159 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8640000000000004e-06 2024-02-10T08:22:01.159 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.159 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.160 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:22:01.160 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:21:36.373461+0000", 2024-02-10T08:22:01.160 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8930000000000004e-06 2024-02-10T08:22:01.160 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.160 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.160 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:22:01.160 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:21:36.373466+0000", 2024-02-10T08:22:01.160 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2823000000000001e-05 2024-02-10T08:22:01.160 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.160 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.160 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:22:01.160 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:21:36.373499+0000", 2024-02-10T08:22:01.161 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3404000000000004e-05 2024-02-10T08:22:01.161 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.161 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.161 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:22:01.161 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:21:36.373572+0000", 2024-02-10T08:22:01.161 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9720000000000002e-05 2024-02-10T08:22:01.161 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.161 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.161 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,1", 2024-02-10T08:22:01.161 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:21:36.373662+0000", 2024-02-10T08:22:01.161 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002436129 2024-02-10T08:22:01.161 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.161 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.161 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:22:01.162 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:21:36.376098+0000", 2024-02-10T08:22:01.162 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0042048540000000001 2024-02-10T08:22:01.162 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.162 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.162 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:22:01.162 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:21:36.380303+0000", 2024-02-10T08:22:01.162 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.068707211000000004 2024-02-10T08:22:01.162 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.162 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.162 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:22:01.162 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:21:36.449010+0000", 2024-02-10T08:22:01.162 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.664e-05 2024-02-10T08:22:01.162 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.162 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.162 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:22:01.163 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:21:36.449067+0000", 2024-02-10T08:22:01.163 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7901999999999997e-05 2024-02-10T08:22:01.163 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:01.163 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:01.163 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:22:01.163 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:21:36.449105+0000", 2024-02-10T08:22:01.163 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.075650841999999996 2024-02-10T08:22:01.163 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:22:01.163 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:22:01.163 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:22:01.163 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:22:01.164 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:22:01.164 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-02-10T08:22:01.164 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:01.165 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:22:01.165 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:22:01.266 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:22:01.307 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:01.862 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:00.544984+0000 osd.2 (osd.2) 63 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:22:01.862 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:00.545050+0000 osd.2 (osd.2) 64 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:22:01.862 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:00.594391+0000 mgr.y (mgr.14505) 201 : cluster [DBG] pgmap v215: 158 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 5 peering, 10 unknown, 3 active+recovering+undersized+degraded+remapped, 138 active+clean; 4.6 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 851 op/s; 17948/227955 objects degraded (7.873%); 9.9 MiB/s, 158 objects/s recovering 2024-02-10T08:22:01.862 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:01.554079+0000 mon.a (mon.0) 929 : cluster [DBG] osdmap e135: 8 total, 8 up, 8 in 2024-02-10T08:22:01.869 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:22:01.881 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:01.882 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:22:01.891 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.7 dump_ops_in_flight 2024-02-10T08:22:01.906 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:00.544984+0000 osd.2 (osd.2) 63 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:22:01.906 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:00.545050+0000 osd.2 (osd.2) 64 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:22:01.906 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:00.594391+0000 mgr.y (mgr.14505) 201 : cluster [DBG] pgmap v215: 158 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 5 peering, 10 unknown, 3 active+recovering+undersized+degraded+remapped, 138 active+clean; 4.6 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 851 op/s; 17948/227955 objects degraded (7.873%); 9.9 MiB/s, 158 objects/s recovering 2024-02-10T08:22:01.906 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:01.554079+0000 mon.a (mon.0) 929 : cluster [DBG] osdmap e135: 8 total, 8 up, 8 in 2024-02-10T08:22:01.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:00.544984+0000 osd.2 (osd.2) 63 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:22:01.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:00.545050+0000 osd.2 (osd.2) 64 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:22:01.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:00.594391+0000 mgr.y (mgr.14505) 201 : cluster [DBG] pgmap v215: 158 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 5 peering, 10 unknown, 3 active+recovering+undersized+degraded+remapped, 138 active+clean; 4.6 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 851 op/s; 17948/227955 objects degraded (7.873%); 9.9 MiB/s, 158 objects/s recovering 2024-02-10T08:22:01.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:01.554079+0000 mon.a (mon.0) 929 : cluster [DBG] osdmap e135: 8 total, 8 up, 8 in 2024-02-10T08:22:01.983 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:22:02.029 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:02.067 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:22:02.072 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:02.073 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:22:02.173 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:22:02.214 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:02.245 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:22:02.251 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:02.251 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:22:02.318 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:22:02.352 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:22:02.447 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:02.979 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 5, 6, 7, 4] 2024-02-10T08:22:02.979 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-10T08:22:02.980 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-02-10T08:22:02.980 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd dump -f json-pretty 2024-02-10T08:22:04.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:02.595102+0000 mgr.y (mgr.14505) 202 : cluster [DBG] pgmap v217: 158 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 2 peering, 1 unknown, 3 active+recovering+undersized+degraded+remapped, 150 active+clean; 4.5 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1.2 KiB/s rd, 251 B/s wr, 578 op/s; 17477/220905 objects degraded (7.912%) 2024-02-10T08:22:04.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:02.595102+0000 mgr.y (mgr.14505) 202 : cluster [DBG] pgmap v217: 158 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 2 peering, 1 unknown, 3 active+recovering+undersized+degraded+remapped, 150 active+clean; 4.5 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1.2 KiB/s rd, 251 B/s wr, 578 op/s; 17477/220905 objects degraded (7.912%) 2024-02-10T08:22:04.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:02.595102+0000 mgr.y (mgr.14505) 202 : cluster [DBG] pgmap v217: 158 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 2 peering, 1 unknown, 3 active+recovering+undersized+degraded+remapped, 150 active+clean; 4.5 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1.2 KiB/s rd, 251 B/s wr, 578 op/s; 17477/220905 objects degraded (7.912%) 2024-02-10T08:22:04.493 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-02-10T08:22:04.494 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-02-10T08:22:04.494 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:04.494 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14784.0:131171 7.5 7:ab09ad1e:::benchmark_data_smithi018_80623_object30243:head [delete] snapc 0=[] ondisk+write+known_if_redirected e136)", 2024-02-10T08:22:04.494 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:22:04.486123+0000", 2024-02-10T08:22:04.494 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0069931840000000004, 2024-02-10T08:22:04.494 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0070169409999999996, 2024-02-10T08:22:04.494 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:22:04.494 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "waiting for sub ops", 2024-02-10T08:22:04.494 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:22:04.494 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14784", 2024-02-10T08:22:04.494 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:22:04.494 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 131171 2024-02-10T08:22:04.495 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:04.495 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:22:04.495 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:04.495 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:22:04.495 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:04.486123+0000", 2024-02-10T08:22:04.495 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:22:04.495 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:04.495 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:04.495 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:22:04.495 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:04.486123+0000", 2024-02-10T08:22:04.495 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999981 2024-02-10T08:22:04.495 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:04.495 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:04.496 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:22:04.496 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:04.486121+0000", 2024-02-10T08:22:04.496 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5449999999999992e-06 2024-02-10T08:22:04.496 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:04.496 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:04.496 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:22:04.496 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:04.486130+0000", 2024-02-10T08:22:04.496 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6731e-05 2024-02-10T08:22:04.496 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:04.496 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:04.496 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:22:04.496 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:04.486147+0000", 2024-02-10T08:22:04.496 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2920000000000001e-06 2024-02-10T08:22:04.497 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:04.497 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:04.497 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:22:04.497 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:04.486153+0000", 2024-02-10T08:22:04.497 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2078999999999998e-05 2024-02-10T08:22:04.497 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:04.497 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:04.497 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:22:04.497 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:04.486235+0000", 2024-02-10T08:22:04.497 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012092 2024-02-10T08:22:04.497 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:04.497 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:04.497 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:22:04.497 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:04.486356+0000", 2024-02-10T08:22:04.497 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8864999999999997e-05 2024-02-10T08:22:04.498 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:04.498 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:04.498 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,2", 2024-02-10T08:22:04.498 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:04.486445+0000", 2024-02-10T08:22:04.498 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022157470000000001 2024-02-10T08:22:04.498 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:04.498 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:04.498 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:22:04.498 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:04.488661+0000", 2024-02-10T08:22:04.498 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0024337360000000001 2024-02-10T08:22:04.498 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:22:04.498 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:22:04.498 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:22:04.499 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:04.491095+0000", 2024-02-10T08:22:04.499 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.004972064 2024-02-10T08:22:04.499 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:22:04.499 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:22:04.499 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:22:04.499 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:22:04.499 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-02-10T08:22:04.499 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 1 2024-02-10T08:22:04.499 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-02-10T08:22:04.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:03.482618+0000 osd.0 (osd.0) 73 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:22:04.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:03.482661+0000 osd.0 (osd.0) 74 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:22:04.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:03.661281+0000 mon.a (mon.0) 930 : cluster [DBG] osdmap e136: 8 total, 8 up, 8 in 2024-02-10T08:22:05.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:03.482618+0000 osd.0 (osd.0) 73 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:22:05.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:03.482661+0000 osd.0 (osd.0) 74 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:22:05.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:03.661281+0000 mon.a (mon.0) 930 : cluster [DBG] osdmap e136: 8 total, 8 up, 8 in 2024-02-10T08:22:05.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:03.482618+0000 osd.0 (osd.0) 73 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:22:05.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:03.482661+0000 osd.0 (osd.0) 74 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:22:05.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:03.661281+0000 mon.a (mon.0) 930 : cluster [DBG] osdmap e136: 8 total, 8 up, 8 in 2024-02-10T08:22:05.624 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.7 dump_blocked_ops 2024-02-10T08:22:05.987 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:22:06.044 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:04.595672+0000 mgr.y (mgr.14505) 203 : cluster [DBG] pgmap v219: 158 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 153 active+clean; 4.4 GiB data, 15 GiB used, 701 GiB / 715 GiB avail; 1012 B/s rd, 202 B/s wr, 741 op/s; 16813/216732 objects degraded (7.758%); 8.2 MiB/s, 131 objects/s recovering 2024-02-10T08:22:06.044 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:05.467470+0000 mon.a (mon.0) 931 : cluster [WRN] Health check update: Degraded data redundancy: 16813/216732 objects degraded (7.758%), 5 pgs degraded, 5 pgs undersized (PG_DEGRADED) 2024-02-10T08:22:06.044 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:05.484077+0000 mon.a (mon.0) 932 : cluster [DBG] osdmap e137: 8 total, 8 up, 8 in 2024-02-10T08:22:06.083 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:04.595672+0000 mgr.y (mgr.14505) 203 : cluster [DBG] pgmap v219: 158 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 153 active+clean; 4.4 GiB data, 15 GiB used, 701 GiB / 715 GiB avail; 1012 B/s rd, 202 B/s wr, 741 op/s; 16813/216732 objects degraded (7.758%); 8.2 MiB/s, 131 objects/s recovering 2024-02-10T08:22:06.083 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:05.467470+0000 mon.a (mon.0) 931 : cluster [WRN] Health check update: Degraded data redundancy: 16813/216732 objects degraded (7.758%), 5 pgs degraded, 5 pgs undersized (PG_DEGRADED) 2024-02-10T08:22:06.083 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:05.484077+0000 mon.a (mon.0) 932 : cluster [DBG] osdmap e137: 8 total, 8 up, 8 in 2024-02-10T08:22:06.083 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:04.595672+0000 mgr.y (mgr.14505) 203 : cluster [DBG] pgmap v219: 158 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 153 active+clean; 4.4 GiB data, 15 GiB used, 701 GiB / 715 GiB avail; 1012 B/s rd, 202 B/s wr, 741 op/s; 16813/216732 objects degraded (7.758%); 8.2 MiB/s, 131 objects/s recovering 2024-02-10T08:22:06.083 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:05.467470+0000 mon.a (mon.0) 931 : cluster [WRN] Health check update: Degraded data redundancy: 16813/216732 objects degraded (7.758%), 5 pgs degraded, 5 pgs undersized (PG_DEGRADED) 2024-02-10T08:22:06.083 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:05.484077+0000 mon.a (mon.0) 932 : cluster [DBG] osdmap e137: 8 total, 8 up, 8 in 2024-02-10T08:22:06.132 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:22:06.138 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:06.139 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:22:06.240 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:22:06.246 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:22:06.276 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:06.280 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:22:06.305 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:22:06.307 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:06.308 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:22:06.409 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:22:06.445 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:06.507 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:22:06.509 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:06.510 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:22:06.522 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:22:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:22:06] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:22:06.610 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:22:06.713 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:06.756 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:22:06.765 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:06.766 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:22:06.867 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:22:06.897 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:06.924 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:22:06.926 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:06.927 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:22:07.028 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:22:07.063 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:07.511 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:22:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:22:07] "GET /metrics HTTP/1.1" 200 175591 "" "Prometheus/2.33.4" 2024-02-10T08:22:07.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:06.597462+0000 mgr.y (mgr.14505) 204 : cluster [DBG] pgmap v221: 158 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 153 active+clean; 4.4 GiB data, 15 GiB used, 701 GiB / 715 GiB avail; 852 B/s rd, 170 B/s wr, 624 op/s; 16813/216732 objects degraded (7.758%); 6.9 MiB/s, 110 objects/s recovering 2024-02-10T08:22:07.789 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:22:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:22:07.882 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:06.597462+0000 mgr.y (mgr.14505) 204 : cluster [DBG] pgmap v221: 158 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 153 active+clean; 4.4 GiB data, 15 GiB used, 701 GiB / 715 GiB avail; 852 B/s rd, 170 B/s wr, 624 op/s; 16813/216732 objects degraded (7.758%); 6.9 MiB/s, 110 objects/s recovering 2024-02-10T08:22:07.882 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:06.597462+0000 mgr.y (mgr.14505) 204 : cluster [DBG] pgmap v221: 158 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 153 active+clean; 4.4 GiB data, 15 GiB used, 701 GiB / 715 GiB avail; 852 B/s rd, 170 B/s wr, 624 op/s; 16813/216732 objects degraded (7.758%); 6.9 MiB/s, 110 objects/s recovering 2024-02-10T08:22:07.915 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:22:07.918 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:07.918 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:22:08.019 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:22:08.109 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:08.119 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd unset nodeep-scrub 2024-02-10T08:22:08.177 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-02-10T08:22:08.177 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-02-10T08:22:08.177 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-02-10T08:22:08.178 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-02-10T08:22:08.178 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-02-10T08:22:08.929 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:22:07.735480+0000 mgr.y (mgr.14505) 205 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:22:08.952 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.7 dump_historic_ops 2024-02-10T08:22:09.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:22:07.735480+0000 mgr.y (mgr.14505) 205 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:22:09.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:22:07.735480+0000 mgr.y (mgr.14505) 205 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:22:09.293 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:22:09.313 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:22:09.319 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:09.320 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:22:09.421 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:22:09.469 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:22:09.469 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-02-10T08:22:09.469 INFO:teuthology.orchestra.run.smithi018.stdout: "epoch": 137, 2024-02-10T08:22:09.469 INFO:teuthology.orchestra.run.smithi018.stdout: "fsid": "d46257c8-c7eb-11ee-95b8-87774f69a715", 2024-02-10T08:22:09.469 INFO:teuthology.orchestra.run.smithi018.stdout: "created": "2024-02-10T08:10:57.425061+0000", 2024-02-10T08:22:09.469 INFO:teuthology.orchestra.run.smithi018.stdout: "modified": "2024-02-10T08:22:05.468147+0000", 2024-02-10T08:22:09.469 INFO:teuthology.orchestra.run.smithi018.stdout: "last_up_change": "2024-02-10T08:20:45.372678+0000", 2024-02-10T08:22:09.469 INFO:teuthology.orchestra.run.smithi018.stdout: "last_in_change": "2024-02-10T08:16:27.586635+0000", 2024-02-10T08:22:09.469 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-02-10T08:22:09.469 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_num": 5804032, 2024-02-10T08:22:09.470 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_set": [ 2024-02-10T08:22:09.470 INFO:teuthology.orchestra.run.smithi018.stdout: "nodeep-scrub", 2024-02-10T08:22:09.470 INFO:teuthology.orchestra.run.smithi018.stdout: "pglog_hardlimit", 2024-02-10T08:22:09.470 INFO:teuthology.orchestra.run.smithi018.stdout: "purged_snapdirs", 2024-02-10T08:22:09.470 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_deletes", 2024-02-10T08:22:09.470 INFO:teuthology.orchestra.run.smithi018.stdout: "sortbitwise" 2024-02-10T08:22:09.470 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-02-10T08:22:09.470 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_version": 19, 2024-02-10T08:22:09.470 INFO:teuthology.orchestra.run.smithi018.stdout: "full_ratio": 0.94999998807907104, 2024-02-10T08:22:09.470 INFO:teuthology.orchestra.run.smithi018.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-02-10T08:22:09.470 INFO:teuthology.orchestra.run.smithi018.stdout: "nearfull_ratio": 0.85000002384185791, 2024-02-10T08:22:09.470 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_snapshot": "", 2024-02-10T08:22:09.470 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_max": 7, 2024-02-10T08:22:09.470 INFO:teuthology.orchestra.run.smithi018.stdout: "max_osd": 8, 2024-02-10T08:22:09.471 INFO:teuthology.orchestra.run.smithi018.stdout: "require_min_compat_client": "luminous", 2024-02-10T08:22:09.471 INFO:teuthology.orchestra.run.smithi018.stdout: "min_compat_client": "luminous", 2024-02-10T08:22:09.471 INFO:teuthology.orchestra.run.smithi018.stdout: "require_osd_release": "pacific", 2024-02-10T08:22:09.471 INFO:teuthology.orchestra.run.smithi018.stdout: "pools": [ 2024-02-10T08:22:09.471 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:09.471 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 1, 2024-02-10T08:22:09.471 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "device_health_metrics", 2024-02-10T08:22:09.471 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-02-10T08:14:44.034966+0000", 2024-02-10T08:22:09.471 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-02-10T08:22:09.471 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-02-10T08:22:09.471 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-02-10T08:22:09.471 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 3, 2024-02-10T08:22:09.471 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 2, 2024-02-10T08:22:09.471 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-02-10T08:22:09.472 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-02-10T08:22:09.472 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-02-10T08:22:09.472 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-02-10T08:22:09.472 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-10T08:22:09.472 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-02-10T08:22:09.472 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-02-10T08:22:09.472 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 1, 2024-02-10T08:22:09.472 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 1, 2024-02-10T08:22:09.472 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 1, 2024-02-10T08:22:09.472 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 1, 2024-02-10T08:22:09.472 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 1, 2024-02-10T08:22:09.472 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-02-10T08:22:09.472 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-02-10T08:22:09.472 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-02-10T08:22:09.473 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-02-10T08:22:09.473 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-02-10T08:22:09.473 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-02-10T08:22:09.473 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-02-10T08:22:09.473 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:09.473 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "66", 2024-02-10T08:22:09.473 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-02-10T08:22:09.473 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-10T08:22:09.473 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-02-10T08:22:09.473 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-02-10T08:22:09.473 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-02-10T08:22:09.473 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-02-10T08:22:09.473 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-02-10T08:22:09.473 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-02-10T08:22:09.474 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-02-10T08:22:09.474 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-02-10T08:22:09.474 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-02-10T08:22:09.474 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-02-10T08:22:09.474 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-02-10T08:22:09.474 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-02-10T08:22:09.474 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-02-10T08:22:09.474 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-02-10T08:22:09.474 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-02-10T08:22:09.474 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-02-10T08:22:09.474 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-10T08:22:09.474 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-10T08:22:09.474 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-10T08:22:09.474 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-02-10T08:22:09.474 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-02-10T08:22:09.475 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-02-10T08:22:09.475 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-02-10T08:22:09.475 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-02-10T08:22:09.475 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:09.475 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-02-10T08:22:09.475 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-02-10T08:22:09.475 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-02-10T08:22:09.475 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-02-10T08:22:09.475 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-02-10T08:22:09.475 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-02-10T08:22:09.475 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-02-10T08:22:09.475 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-02-10T08:22:09.475 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-02-10T08:22:09.475 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-02-10T08:22:09.476 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-02-10T08:22:09.476 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-02-10T08:22:09.476 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_max": 32, 2024-02-10T08:22:09.476 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 1 2024-02-10T08:22:09.476 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:09.476 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-02-10T08:22:09.476 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_devicehealth": {} 2024-02-10T08:22:09.476 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:22:09.476 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:09.476 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:09.476 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 2, 2024-02-10T08:22:09.476 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": ".rgw.root", 2024-02-10T08:22:09.476 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-02-10T08:16:51.334631+0000", 2024-02-10T08:22:09.476 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-02-10T08:22:09.477 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-02-10T08:22:09.477 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-02-10T08:22:09.477 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 3, 2024-02-10T08:22:09.477 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 2, 2024-02-10T08:22:09.477 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-02-10T08:22:09.477 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-02-10T08:22:09.477 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-02-10T08:22:09.477 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-02-10T08:22:09.477 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-10T08:22:09.477 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-02-10T08:22:09.477 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-02-10T08:22:09.477 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 32, 2024-02-10T08:22:09.477 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 32, 2024-02-10T08:22:09.477 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 32, 2024-02-10T08:22:09.478 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 32, 2024-02-10T08:22:09.478 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 32, 2024-02-10T08:22:09.478 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-02-10T08:22:09.478 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-02-10T08:22:09.478 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-02-10T08:22:09.478 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-02-10T08:22:09.478 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-02-10T08:22:09.478 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-02-10T08:22:09.478 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-02-10T08:22:09.478 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:09.478 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "56", 2024-02-10T08:22:09.478 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-02-10T08:22:09.478 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-10T08:22:09.478 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-02-10T08:22:09.479 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-02-10T08:22:09.479 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-02-10T08:22:09.479 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-02-10T08:22:09.479 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-02-10T08:22:09.479 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-02-10T08:22:09.479 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-02-10T08:22:09.479 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-02-10T08:22:09.479 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-02-10T08:22:09.479 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-02-10T08:22:09.479 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-02-10T08:22:09.479 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-02-10T08:22:09.479 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-02-10T08:22:09.479 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-02-10T08:22:09.479 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-02-10T08:22:09.480 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-02-10T08:22:09.480 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-10T08:22:09.480 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-10T08:22:09.480 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-10T08:22:09.480 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-02-10T08:22:09.480 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-02-10T08:22:09.480 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-02-10T08:22:09.480 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-02-10T08:22:09.480 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-02-10T08:22:09.480 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:09.480 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-02-10T08:22:09.480 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-02-10T08:22:09.480 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-02-10T08:22:09.481 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-02-10T08:22:09.481 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-02-10T08:22:09.481 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-02-10T08:22:09.481 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-02-10T08:22:09.481 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-02-10T08:22:09.481 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-02-10T08:22:09.481 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-02-10T08:22:09.481 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-02-10T08:22:09.481 INFO:teuthology.orchestra.run.smithi018.stdout: "options": {}, 2024-02-10T08:22:09.481 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-02-10T08:22:09.481 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw": {} 2024-02-10T08:22:09.481 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:22:09.481 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:09.481 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:09.481 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 3, 2024-02-10T08:22:09.482 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "iscsi", 2024-02-10T08:22:09.482 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-02-10T08:16:51.762963+0000", 2024-02-10T08:22:09.482 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-02-10T08:22:09.482 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-02-10T08:22:09.482 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-02-10T08:22:09.482 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 3, 2024-02-10T08:22:09.482 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 2, 2024-02-10T08:22:09.482 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-02-10T08:22:09.482 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-02-10T08:22:09.482 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-02-10T08:22:09.482 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-02-10T08:22:09.483 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-10T08:22:09.483 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-02-10T08:22:09.483 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-02-10T08:22:09.483 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 3, 2024-02-10T08:22:09.483 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 3, 2024-02-10T08:22:09.483 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 3, 2024-02-10T08:22:09.483 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 3, 2024-02-10T08:22:09.483 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 3, 2024-02-10T08:22:09.483 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-02-10T08:22:09.483 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-02-10T08:22:09.483 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-02-10T08:22:09.483 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-02-10T08:22:09.483 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-02-10T08:22:09.483 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-02-10T08:22:09.483 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-02-10T08:22:09.484 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:09.484 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "57", 2024-02-10T08:22:09.484 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-02-10T08:22:09.484 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-10T08:22:09.484 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-02-10T08:22:09.484 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-02-10T08:22:09.484 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-02-10T08:22:09.484 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-02-10T08:22:09.484 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-02-10T08:22:09.484 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-02-10T08:22:09.484 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-02-10T08:22:09.484 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-02-10T08:22:09.484 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-02-10T08:22:09.484 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-02-10T08:22:09.485 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-02-10T08:22:09.485 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-02-10T08:22:09.485 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-02-10T08:22:09.485 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-02-10T08:22:09.485 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-02-10T08:22:09.485 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-02-10T08:22:09.485 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-10T08:22:09.485 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-10T08:22:09.485 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-10T08:22:09.485 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-02-10T08:22:09.485 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-02-10T08:22:09.485 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-02-10T08:22:09.485 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-02-10T08:22:09.485 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-02-10T08:22:09.485 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:09.486 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-02-10T08:22:09.486 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-02-10T08:22:09.486 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-02-10T08:22:09.486 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-02-10T08:22:09.486 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-02-10T08:22:09.486 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-02-10T08:22:09.486 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-02-10T08:22:09.486 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-02-10T08:22:09.486 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-02-10T08:22:09.486 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-02-10T08:22:09.486 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-02-10T08:22:09.486 INFO:teuthology.orchestra.run.smithi018.stdout: "options": {}, 2024-02-10T08:22:09.486 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-02-10T08:22:09.486 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd": {} 2024-02-10T08:22:09.487 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:22:09.487 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:09.487 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:09.487 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 4, 2024-02-10T08:22:09.487 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "default.rgw.log", 2024-02-10T08:22:09.487 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-02-10T08:16:53.258098+0000", 2024-02-10T08:22:09.487 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-02-10T08:22:09.487 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-02-10T08:22:09.487 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-02-10T08:22:09.487 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 3, 2024-02-10T08:22:09.487 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 2, 2024-02-10T08:22:09.487 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-02-10T08:22:09.487 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-02-10T08:22:09.487 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-02-10T08:22:09.488 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-02-10T08:22:09.488 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-10T08:22:09.488 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-02-10T08:22:09.488 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-02-10T08:22:09.488 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 32, 2024-02-10T08:22:09.488 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 32, 2024-02-10T08:22:09.488 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 32, 2024-02-10T08:22:09.488 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 32, 2024-02-10T08:22:09.488 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 32, 2024-02-10T08:22:09.488 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-02-10T08:22:09.488 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-02-10T08:22:09.488 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-02-10T08:22:09.488 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-02-10T08:22:09.488 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-02-10T08:22:09.489 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-02-10T08:22:09.489 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-02-10T08:22:09.489 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:09.489 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "121", 2024-02-10T08:22:09.489 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-02-10T08:22:09.489 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-10T08:22:09.489 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-02-10T08:22:09.489 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-02-10T08:22:09.489 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-02-10T08:22:09.489 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-02-10T08:22:09.489 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-02-10T08:22:09.489 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-02-10T08:22:09.489 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-02-10T08:22:09.489 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-02-10T08:22:09.489 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-02-10T08:22:09.490 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-02-10T08:22:09.490 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-02-10T08:22:09.490 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-02-10T08:22:09.490 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-02-10T08:22:09.490 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-02-10T08:22:09.490 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-02-10T08:22:09.490 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-02-10T08:22:09.490 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-10T08:22:09.490 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-10T08:22:09.490 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-10T08:22:09.490 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-02-10T08:22:09.490 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-02-10T08:22:09.490 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-02-10T08:22:09.490 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-02-10T08:22:09.490 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-02-10T08:22:09.490 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:09.491 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-02-10T08:22:09.491 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-02-10T08:22:09.491 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-02-10T08:22:09.491 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-02-10T08:22:09.491 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-02-10T08:22:09.491 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-02-10T08:22:09.491 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-02-10T08:22:09.491 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-02-10T08:22:09.491 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-02-10T08:22:09.491 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-02-10T08:22:09.491 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-02-10T08:22:09.491 INFO:teuthology.orchestra.run.smithi018.stdout: "options": {}, 2024-02-10T08:22:09.491 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-02-10T08:22:09.491 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw": {} 2024-02-10T08:22:09.491 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:22:09.492 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:09.492 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:09.492 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 5, 2024-02-10T08:22:09.492 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "default.rgw.control", 2024-02-10T08:22:09.492 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-02-10T08:16:55.289300+0000", 2024-02-10T08:22:09.492 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-02-10T08:22:09.492 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-02-10T08:22:09.492 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-02-10T08:22:09.492 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 3, 2024-02-10T08:22:09.492 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 2, 2024-02-10T08:22:09.492 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-02-10T08:22:09.492 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-02-10T08:22:09.492 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-02-10T08:22:09.493 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-02-10T08:22:09.493 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-10T08:22:09.493 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-02-10T08:22:09.493 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-02-10T08:22:09.493 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 32, 2024-02-10T08:22:09.493 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 32, 2024-02-10T08:22:09.493 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 32, 2024-02-10T08:22:09.493 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 32, 2024-02-10T08:22:09.493 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 32, 2024-02-10T08:22:09.493 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-02-10T08:22:09.493 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-02-10T08:22:09.493 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-02-10T08:22:09.493 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-02-10T08:22:09.494 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-02-10T08:22:09.494 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-02-10T08:22:09.494 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-02-10T08:22:09.494 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:09.494 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "60", 2024-02-10T08:22:09.494 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-02-10T08:22:09.494 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-10T08:22:09.494 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-02-10T08:22:09.494 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-02-10T08:22:09.494 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-02-10T08:22:09.494 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-02-10T08:22:09.494 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-02-10T08:22:09.494 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-02-10T08:22:09.494 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-02-10T08:22:09.494 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-02-10T08:22:09.495 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-02-10T08:22:09.495 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-02-10T08:22:09.495 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-02-10T08:22:09.495 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-02-10T08:22:09.495 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-02-10T08:22:09.495 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-02-10T08:22:09.495 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-02-10T08:22:09.495 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-02-10T08:22:09.495 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-10T08:22:09.495 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-10T08:22:09.495 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-10T08:22:09.495 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-02-10T08:22:09.495 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-02-10T08:22:09.495 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-02-10T08:22:09.495 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-02-10T08:22:09.496 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-02-10T08:22:09.496 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:09.496 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-02-10T08:22:09.496 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-02-10T08:22:09.496 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-02-10T08:22:09.496 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-02-10T08:22:09.496 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-02-10T08:22:09.496 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-02-10T08:22:09.496 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-02-10T08:22:09.496 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-02-10T08:22:09.496 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-02-10T08:22:09.496 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-02-10T08:22:09.496 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-02-10T08:22:09.496 INFO:teuthology.orchestra.run.smithi018.stdout: "options": {}, 2024-02-10T08:22:09.497 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-02-10T08:22:09.497 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw": {} 2024-02-10T08:22:09.497 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:22:09.497 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:09.497 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:09.497 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 6, 2024-02-10T08:22:09.497 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "default.rgw.meta", 2024-02-10T08:22:09.497 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-02-10T08:16:57.354868+0000", 2024-02-10T08:22:09.497 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-02-10T08:22:09.497 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-02-10T08:22:09.497 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-02-10T08:22:09.497 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 3, 2024-02-10T08:22:09.497 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 2, 2024-02-10T08:22:09.497 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-02-10T08:22:09.498 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-02-10T08:22:09.498 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-02-10T08:22:09.498 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-02-10T08:22:09.498 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-10T08:22:09.498 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-02-10T08:22:09.498 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-02-10T08:22:09.498 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 42, 2024-02-10T08:22:09.498 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 42, 2024-02-10T08:22:09.498 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 42, 2024-02-10T08:22:09.498 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 42, 2024-02-10T08:22:09.498 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 42, 2024-02-10T08:22:09.498 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-02-10T08:22:09.498 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-02-10T08:22:09.498 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-02-10T08:22:09.498 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-02-10T08:22:09.499 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-02-10T08:22:09.499 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-02-10T08:22:09.499 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-02-10T08:22:09.499 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:09.499 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "133", 2024-02-10T08:22:09.499 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-02-10T08:22:09.499 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-10T08:22:09.499 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "131", 2024-02-10T08:22:09.499 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-02-10T08:22:09.499 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-02-10T08:22:09.499 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-02-10T08:22:09.499 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-02-10T08:22:09.499 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-02-10T08:22:09.499 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-02-10T08:22:09.499 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-02-10T08:22:09.500 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-02-10T08:22:09.500 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-02-10T08:22:09.500 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-02-10T08:22:09.500 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-02-10T08:22:09.500 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-02-10T08:22:09.500 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-02-10T08:22:09.500 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-02-10T08:22:09.500 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-02-10T08:22:09.500 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-10T08:22:09.500 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-10T08:22:09.500 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-10T08:22:09.500 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-02-10T08:22:09.500 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-02-10T08:22:09.500 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-02-10T08:22:09.501 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-02-10T08:22:09.501 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-02-10T08:22:09.501 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:09.501 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-02-10T08:22:09.501 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-02-10T08:22:09.501 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-02-10T08:22:09.501 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-02-10T08:22:09.501 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-02-10T08:22:09.501 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-02-10T08:22:09.501 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-02-10T08:22:09.501 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-02-10T08:22:09.501 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-02-10T08:22:09.501 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-02-10T08:22:09.501 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-02-10T08:22:09.501 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-02-10T08:22:09.502 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_bias": 4 2024-02-10T08:22:09.502 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:09.502 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-02-10T08:22:09.502 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw": {} 2024-02-10T08:22:09.502 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:22:09.502 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:09.502 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:09.502 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 7, 2024-02-10T08:22:09.502 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "unique_pool_0", 2024-02-10T08:22:09.502 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-02-10T08:19:38.373573+0000", 2024-02-10T08:22:09.502 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-02-10T08:22:09.502 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-02-10T08:22:09.502 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-02-10T08:22:09.502 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 3, 2024-02-10T08:22:09.503 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 2, 2024-02-10T08:22:09.503 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-02-10T08:22:09.503 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-02-10T08:22:09.503 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-02-10T08:22:09.503 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-02-10T08:22:09.503 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-10T08:22:09.503 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-02-10T08:22:09.503 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-02-10T08:22:09.503 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 16, 2024-02-10T08:22:09.503 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 16, 2024-02-10T08:22:09.503 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 16, 2024-02-10T08:22:09.503 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 16, 2024-02-10T08:22:09.503 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 16, 2024-02-10T08:22:09.503 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-02-10T08:22:09.503 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-02-10T08:22:09.504 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-02-10T08:22:09.504 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-02-10T08:22:09.504 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-02-10T08:22:09.504 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-02-10T08:22:09.504 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-02-10T08:22:09.504 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:09.504 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "95", 2024-02-10T08:22:09.504 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-02-10T08:22:09.504 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-10T08:22:09.504 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-02-10T08:22:09.504 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-02-10T08:22:09.504 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-02-10T08:22:09.504 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-02-10T08:22:09.505 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-02-10T08:22:09.505 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-02-10T08:22:09.505 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-02-10T08:22:09.505 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-02-10T08:22:09.505 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-02-10T08:22:09.505 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-02-10T08:22:09.505 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-02-10T08:22:09.505 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-02-10T08:22:09.505 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-02-10T08:22:09.505 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-02-10T08:22:09.505 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-02-10T08:22:09.505 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-02-10T08:22:09.505 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-10T08:22:09.505 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-10T08:22:09.505 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-10T08:22:09.506 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-02-10T08:22:09.506 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-02-10T08:22:09.506 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-02-10T08:22:09.506 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-02-10T08:22:09.506 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-02-10T08:22:09.506 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:09.506 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-02-10T08:22:09.506 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-02-10T08:22:09.506 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-02-10T08:22:09.506 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-02-10T08:22:09.506 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-02-10T08:22:09.506 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-02-10T08:22:09.506 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-02-10T08:22:09.506 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-02-10T08:22:09.506 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-02-10T08:22:09.507 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-02-10T08:22:09.507 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-02-10T08:22:09.507 INFO:teuthology.orchestra.run.smithi018.stdout: "options": {}, 2024-02-10T08:22:09.507 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-02-10T08:22:09.507 INFO:teuthology.orchestra.run.smithi018.stdout: "rados": {} 2024-02-10T08:22:09.507 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:22:09.507 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:22:09.507 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-02-10T08:22:09.507 INFO:teuthology.orchestra.run.smithi018.stdout: "osds": [ 2024-02-10T08:22:09.507 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:09.507 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-02-10T08:22:09.507 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "f9043fee-a3ed-4e16-921d-bb86756d0c48", 2024-02-10T08:22:09.507 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-02-10T08:22:09.507 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-02-10T08:22:09.508 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-02-10T08:22:09.508 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-02-10T08:22:09.508 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-02-10T08:22:09.508 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-02-10T08:22:09.508 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 8, 2024-02-10T08:22:09.508 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 131, 2024-02-10T08:22:09.508 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-02-10T08:22:09.508 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-02-10T08:22:09.508 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-02-10T08:22:09.508 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:22:09.508 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:09.508 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:22:09.508 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6801", 2024-02-10T08:22:09.508 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 276034406 2024-02-10T08:22:09.509 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:22:09.509 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:22:09.509 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:09.509 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-02-10T08:22:09.509 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:22:09.509 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:09.509 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:22:09.509 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6802", 2024-02-10T08:22:09.509 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 276034406 2024-02-10T08:22:09.509 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:22:09.509 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:22:09.509 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:09.509 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-02-10T08:22:09.509 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:22:09.510 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:09.510 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:22:09.510 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6804", 2024-02-10T08:22:09.510 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 276034406 2024-02-10T08:22:09.510 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:22:09.510 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:22:09.510 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:09.510 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-02-10T08:22:09.510 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:22:09.510 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:09.510 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:22:09.510 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6803", 2024-02-10T08:22:09.510 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 276034406 2024-02-10T08:22:09.510 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:22:09.511 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:22:09.511 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:09.511 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6801/276034406", 2024-02-10T08:22:09.511 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6802/276034406", 2024-02-10T08:22:09.511 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6804/276034406", 2024-02-10T08:22:09.511 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6803/276034406", 2024-02-10T08:22:09.511 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-02-10T08:22:09.511 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-02-10T08:22:09.511 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-02-10T08:22:09.511 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:22:09.511 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:09.511 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:09.511 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-02-10T08:22:09.512 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "ff958272-ce6b-4162-959a-6da9729e537b", 2024-02-10T08:22:09.512 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-02-10T08:22:09.512 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-02-10T08:22:09.512 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-02-10T08:22:09.512 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-02-10T08:22:09.512 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-02-10T08:22:09.512 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-02-10T08:22:09.512 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-02-10T08:22:09.512 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 133, 2024-02-10T08:22:09.512 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-02-10T08:22:09.512 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-02-10T08:22:09.512 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-02-10T08:22:09.512 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:22:09.512 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:09.513 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:22:09.513 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6805", 2024-02-10T08:22:09.513 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1941014296 2024-02-10T08:22:09.513 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:22:09.513 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:22:09.513 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:09.513 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-02-10T08:22:09.513 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:22:09.513 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:09.513 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:22:09.513 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6806", 2024-02-10T08:22:09.513 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1941014296 2024-02-10T08:22:09.513 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:22:09.513 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:22:09.514 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:09.514 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-02-10T08:22:09.514 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:22:09.514 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:09.514 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:22:09.514 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6808", 2024-02-10T08:22:09.514 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1941014296 2024-02-10T08:22:09.514 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:22:09.514 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:22:09.514 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:09.514 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-02-10T08:22:09.514 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:22:09.514 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:09.514 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:22:09.515 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6807", 2024-02-10T08:22:09.515 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1941014296 2024-02-10T08:22:09.515 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:22:09.515 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:22:09.515 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:09.515 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6805/1941014296", 2024-02-10T08:22:09.515 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6806/1941014296", 2024-02-10T08:22:09.515 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6808/1941014296", 2024-02-10T08:22:09.515 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6807/1941014296", 2024-02-10T08:22:09.515 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-02-10T08:22:09.515 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-02-10T08:22:09.515 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-02-10T08:22:09.515 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:22:09.515 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:09.515 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:09.516 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-02-10T08:22:09.516 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "29bb47e2-5c81-4ae8-bb9f-d1b02ea01d3f", 2024-02-10T08:22:09.516 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-02-10T08:22:09.516 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-02-10T08:22:09.516 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-02-10T08:22:09.516 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-02-10T08:22:09.516 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-02-10T08:22:09.516 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-02-10T08:22:09.516 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 18, 2024-02-10T08:22:09.516 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 133, 2024-02-10T08:22:09.516 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-02-10T08:22:09.516 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-02-10T08:22:09.516 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-02-10T08:22:09.516 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:22:09.517 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:09.517 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:22:09.517 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6809", 2024-02-10T08:22:09.517 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3122474567 2024-02-10T08:22:09.517 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:22:09.517 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:22:09.517 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:09.517 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-02-10T08:22:09.517 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:22:09.517 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:09.517 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:22:09.517 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6810", 2024-02-10T08:22:09.517 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3122474567 2024-02-10T08:22:09.517 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:22:09.517 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:22:09.518 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:09.518 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-02-10T08:22:09.518 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:22:09.518 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:09.518 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:22:09.518 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6812", 2024-02-10T08:22:09.518 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3122474567 2024-02-10T08:22:09.518 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:22:09.518 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:22:09.518 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:09.518 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-02-10T08:22:09.518 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:22:09.518 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:09.518 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:22:09.519 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6811", 2024-02-10T08:22:09.519 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3122474567 2024-02-10T08:22:09.519 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:22:09.519 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:22:09.519 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:09.519 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6809/3122474567", 2024-02-10T08:22:09.519 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6810/3122474567", 2024-02-10T08:22:09.519 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6812/3122474567", 2024-02-10T08:22:09.519 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6811/3122474567", 2024-02-10T08:22:09.519 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-02-10T08:22:09.519 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-02-10T08:22:09.519 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-02-10T08:22:09.519 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:22:09.519 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:09.519 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:09.519 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-02-10T08:22:09.520 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "87ad37de-5f49-4e5b-9683-3bb9c3e33907", 2024-02-10T08:22:09.520 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-02-10T08:22:09.520 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-02-10T08:22:09.520 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-02-10T08:22:09.520 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-02-10T08:22:09.520 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-02-10T08:22:09.520 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-02-10T08:22:09.520 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 25, 2024-02-10T08:22:09.520 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 131, 2024-02-10T08:22:09.520 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-02-10T08:22:09.520 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-02-10T08:22:09.520 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-02-10T08:22:09.520 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:22:09.521 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:09.521 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:22:09.521 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6813", 2024-02-10T08:22:09.521 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3484706437 2024-02-10T08:22:09.521 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:22:09.521 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:22:09.521 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:09.521 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-02-10T08:22:09.521 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:22:09.521 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:09.521 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:22:09.521 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6814", 2024-02-10T08:22:09.521 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3484706437 2024-02-10T08:22:09.521 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:22:09.521 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:22:09.522 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:09.522 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-02-10T08:22:09.522 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:22:09.522 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:09.522 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:22:09.522 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6816", 2024-02-10T08:22:09.522 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3484706437 2024-02-10T08:22:09.522 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:22:09.522 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:22:09.522 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:09.522 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-02-10T08:22:09.522 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:22:09.522 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:09.522 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:22:09.523 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6815", 2024-02-10T08:22:09.523 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3484706437 2024-02-10T08:22:09.523 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:22:09.523 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:22:09.523 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:09.523 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6813/3484706437", 2024-02-10T08:22:09.523 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6814/3484706437", 2024-02-10T08:22:09.523 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6816/3484706437", 2024-02-10T08:22:09.523 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6815/3484706437", 2024-02-10T08:22:09.523 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-02-10T08:22:09.523 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-02-10T08:22:09.523 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-02-10T08:22:09.523 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:22:09.523 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:09.523 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:09.524 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-02-10T08:22:09.524 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "f5708f20-f98d-4d12-b8ae-71a5049a14cc", 2024-02-10T08:22:09.524 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-02-10T08:22:09.524 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-02-10T08:22:09.524 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-02-10T08:22:09.524 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-02-10T08:22:09.524 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 30, 2024-02-10T08:22:09.524 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 87, 2024-02-10T08:22:09.524 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 110, 2024-02-10T08:22:09.524 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 131, 2024-02-10T08:22:09.524 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 88, 2024-02-10T08:22:09.524 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-02-10T08:22:09.524 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-02-10T08:22:09.524 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:22:09.525 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:09.525 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:22:09.525 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6800", 2024-02-10T08:22:09.525 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3888817642 2024-02-10T08:22:09.525 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:22:09.525 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:22:09.525 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:09.525 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-02-10T08:22:09.525 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:22:09.525 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:09.525 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:22:09.525 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6801", 2024-02-10T08:22:09.525 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3888817642 2024-02-10T08:22:09.525 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:22:09.526 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:22:09.526 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:09.526 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-02-10T08:22:09.526 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:22:09.526 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:09.526 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:22:09.526 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6803", 2024-02-10T08:22:09.526 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3888817642 2024-02-10T08:22:09.526 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:22:09.526 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:22:09.526 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:09.526 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-02-10T08:22:09.526 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:22:09.526 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:09.526 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:22:09.527 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6802", 2024-02-10T08:22:09.527 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3888817642 2024-02-10T08:22:09.527 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:22:09.527 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:22:09.527 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:09.527 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.71:6800/3888817642", 2024-02-10T08:22:09.527 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.71:6801/3888817642", 2024-02-10T08:22:09.527 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.71:6803/3888817642", 2024-02-10T08:22:09.527 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.71:6802/3888817642", 2024-02-10T08:22:09.527 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-02-10T08:22:09.527 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-02-10T08:22:09.527 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-02-10T08:22:09.527 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:22:09.527 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:09.527 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:09.528 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-02-10T08:22:09.528 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "e36a71dd-5088-4bff-965e-7dc8708ef7e3", 2024-02-10T08:22:09.528 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-02-10T08:22:09.528 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-02-10T08:22:09.528 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-02-10T08:22:09.528 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-02-10T08:22:09.528 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-02-10T08:22:09.528 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-02-10T08:22:09.528 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 37, 2024-02-10T08:22:09.528 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 133, 2024-02-10T08:22:09.528 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-02-10T08:22:09.528 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-02-10T08:22:09.528 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-02-10T08:22:09.528 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:22:09.528 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:09.529 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:22:09.529 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6804", 2024-02-10T08:22:09.529 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1932648316 2024-02-10T08:22:09.529 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:22:09.529 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:22:09.529 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:09.529 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-02-10T08:22:09.529 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:22:09.529 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:09.529 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:22:09.529 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6805", 2024-02-10T08:22:09.529 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1932648316 2024-02-10T08:22:09.529 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:22:09.529 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:22:09.530 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:09.530 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-02-10T08:22:09.530 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:22:09.530 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:09.530 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:22:09.530 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6807", 2024-02-10T08:22:09.530 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1932648316 2024-02-10T08:22:09.530 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:22:09.530 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:22:09.530 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:09.530 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-02-10T08:22:09.530 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:22:09.530 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:09.530 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:22:09.531 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6806", 2024-02-10T08:22:09.531 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1932648316 2024-02-10T08:22:09.531 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:22:09.531 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:22:09.531 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:09.531 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.71:6804/1932648316", 2024-02-10T08:22:09.531 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.71:6805/1932648316", 2024-02-10T08:22:09.531 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.71:6807/1932648316", 2024-02-10T08:22:09.531 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.71:6806/1932648316", 2024-02-10T08:22:09.531 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-02-10T08:22:09.531 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-02-10T08:22:09.531 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-02-10T08:22:09.531 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:22:09.531 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:09.531 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:09.531 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-02-10T08:22:09.532 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "210a8790-78b6-4efa-a969-17efb17e9c0b", 2024-02-10T08:22:09.532 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-02-10T08:22:09.532 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-02-10T08:22:09.532 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-02-10T08:22:09.532 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-02-10T08:22:09.532 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-02-10T08:22:09.532 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-02-10T08:22:09.532 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 43, 2024-02-10T08:22:09.532 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 133, 2024-02-10T08:22:09.532 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-02-10T08:22:09.532 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-02-10T08:22:09.532 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-02-10T08:22:09.532 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:22:09.532 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:09.533 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:22:09.533 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6808", 2024-02-10T08:22:09.533 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3724399458 2024-02-10T08:22:09.533 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:22:09.533 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:22:09.533 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:09.533 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-02-10T08:22:09.533 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:22:09.533 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:09.533 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:22:09.533 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6809", 2024-02-10T08:22:09.533 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3724399458 2024-02-10T08:22:09.533 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:22:09.533 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:22:09.533 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:09.534 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-02-10T08:22:09.534 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:22:09.534 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:09.534 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:22:09.534 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6811", 2024-02-10T08:22:09.534 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3724399458 2024-02-10T08:22:09.534 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:22:09.534 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:22:09.534 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:09.534 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-02-10T08:22:09.534 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:22:09.534 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:09.534 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:22:09.534 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6810", 2024-02-10T08:22:09.534 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3724399458 2024-02-10T08:22:09.534 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:22:09.535 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:22:09.535 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:09.535 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.71:6808/3724399458", 2024-02-10T08:22:09.535 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.71:6809/3724399458", 2024-02-10T08:22:09.535 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.71:6811/3724399458", 2024-02-10T08:22:09.535 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.71:6810/3724399458", 2024-02-10T08:22:09.535 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-02-10T08:22:09.535 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-02-10T08:22:09.535 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-02-10T08:22:09.535 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:22:09.535 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:09.535 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:09.535 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-02-10T08:22:09.535 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "9778a0e9-2ff3-4700-bf2a-675edaba630b", 2024-02-10T08:22:09.536 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-02-10T08:22:09.536 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-02-10T08:22:09.536 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-02-10T08:22:09.536 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-02-10T08:22:09.536 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-02-10T08:22:09.536 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-02-10T08:22:09.536 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 50, 2024-02-10T08:22:09.536 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 133, 2024-02-10T08:22:09.536 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-02-10T08:22:09.536 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-02-10T08:22:09.536 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-02-10T08:22:09.536 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:22:09.536 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:09.536 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:22:09.537 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6812", 2024-02-10T08:22:09.537 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 163573852 2024-02-10T08:22:09.537 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:22:09.537 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:22:09.537 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:09.537 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-02-10T08:22:09.537 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:22:09.537 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:09.537 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:22:09.537 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6813", 2024-02-10T08:22:09.537 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 163573852 2024-02-10T08:22:09.537 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:22:09.537 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:22:09.537 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:09.537 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-02-10T08:22:09.538 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:22:09.538 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:09.538 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:22:09.538 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6815", 2024-02-10T08:22:09.538 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 163573852 2024-02-10T08:22:09.538 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:22:09.538 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:22:09.538 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:09.538 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-02-10T08:22:09.538 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:22:09.538 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:09.538 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:22:09.538 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6814", 2024-02-10T08:22:09.538 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 163573852 2024-02-10T08:22:09.539 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:22:09.539 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:22:09.539 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:09.539 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.71:6812/163573852", 2024-02-10T08:22:09.539 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.71:6813/163573852", 2024-02-10T08:22:09.539 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.71:6815/163573852", 2024-02-10T08:22:09.539 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.71:6814/163573852", 2024-02-10T08:22:09.539 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-02-10T08:22:09.539 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-02-10T08:22:09.539 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-02-10T08:22:09.539 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:22:09.539 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:22:09.539 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-02-10T08:22:09.539 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_xinfo": [ 2024-02-10T08:22:09.540 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:09.540 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-02-10T08:22:09.540 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-02-10T08:22:09.540 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-02-10T08:22:09.540 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-02-10T08:22:09.540 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540138314316775423, 2024-02-10T08:22:09.540 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-02-10T08:22:09.540 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-02-10T08:22:03.482663+0000", 2024-02-10T08:22:09.540 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-02-10T08:22:09.540 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:09.540 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:09.540 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-02-10T08:22:09.540 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-02-10T08:22:09.540 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-02-10T08:22:09.541 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-02-10T08:22:09.541 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540138314316775423, 2024-02-10T08:22:09.541 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-02-10T08:22:09.541 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-02-10T08:21:52.169786+0000", 2024-02-10T08:22:09.541 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-02-10T08:22:09.541 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:09.541 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:09.541 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-02-10T08:22:09.541 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-02-10T08:22:09.541 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-02-10T08:22:09.541 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-02-10T08:22:09.541 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540138314316775423, 2024-02-10T08:22:09.541 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-02-10T08:22:09.541 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-02-10T08:22:00.545053+0000", 2024-02-10T08:22:09.542 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-02-10T08:22:09.542 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:09.542 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:09.542 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-02-10T08:22:09.542 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-02-10T08:22:09.542 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-02-10T08:22:09.542 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-02-10T08:22:09.542 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540138314316775423, 2024-02-10T08:22:09.542 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-02-10T08:22:09.542 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-02-10T08:21:33.049279+0000", 2024-02-10T08:22:09.542 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-02-10T08:22:09.542 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:09.542 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:09.542 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-02-10T08:22:09.543 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-02-10T08:22:09.543 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-02-10T08:22:09.543 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-02-10T08:22:09.543 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540138314316775423, 2024-02-10T08:22:09.543 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-02-10T08:22:09.543 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-02-10T08:21:53.434067+0000", 2024-02-10T08:22:09.543 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 87 2024-02-10T08:22:09.543 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:09.543 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:09.543 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-02-10T08:22:09.543 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-02-10T08:22:09.543 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-02-10T08:22:09.543 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-02-10T08:22:09.543 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540138314316775423, 2024-02-10T08:22:09.543 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-02-10T08:22:09.544 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-02-10T08:21:56.576070+0000", 2024-02-10T08:22:09.544 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-02-10T08:22:09.544 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:09.544 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:09.544 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-02-10T08:22:09.544 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-02-10T08:22:09.544 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-02-10T08:22:09.544 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-02-10T08:22:09.544 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540138314316775423, 2024-02-10T08:22:09.544 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-02-10T08:22:09.544 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-02-10T08:21:29.802988+0000", 2024-02-10T08:22:09.544 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-02-10T08:22:09.544 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:09.544 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:09.545 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-02-10T08:22:09.545 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-02-10T08:22:09.545 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-02-10T08:22:09.545 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-02-10T08:22:09.545 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540138314316775423, 2024-02-10T08:22:09.545 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-02-10T08:22:09.547 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-02-10T08:21:15.394993+0000", 2024-02-10T08:22:09.547 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-02-10T08:22:09.547 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:22:09.547 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-02-10T08:22:09.547 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap": [], 2024-02-10T08:22:09.548 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_items": [ 2024-02-10T08:22:09.548 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:09.548 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "2.5", 2024-02-10T08:22:09.548 INFO:teuthology.orchestra.run.smithi018.stdout: "mappings": [ 2024-02-10T08:22:09.548 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:09.548 INFO:teuthology.orchestra.run.smithi018.stdout: "from": 7, 2024-02-10T08:22:09.548 INFO:teuthology.orchestra.run.smithi018.stdout: "to": 2 2024-02-10T08:22:09.548 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:22:09.548 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:22:09.548 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:09.548 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:09.548 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "4.7", 2024-02-10T08:22:09.548 INFO:teuthology.orchestra.run.smithi018.stdout: "mappings": [ 2024-02-10T08:22:09.548 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:09.549 INFO:teuthology.orchestra.run.smithi018.stdout: "from": 1, 2024-02-10T08:22:09.549 INFO:teuthology.orchestra.run.smithi018.stdout: "to": 7 2024-02-10T08:22:09.549 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:09.549 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:09.549 INFO:teuthology.orchestra.run.smithi018.stdout: "from": 0, 2024-02-10T08:22:09.549 INFO:teuthology.orchestra.run.smithi018.stdout: "to": 5 2024-02-10T08:22:09.549 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:22:09.549 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:22:09.549 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:09.549 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:09.549 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "4.d", 2024-02-10T08:22:09.549 INFO:teuthology.orchestra.run.smithi018.stdout: "mappings": [ 2024-02-10T08:22:09.549 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:09.549 INFO:teuthology.orchestra.run.smithi018.stdout: "from": 1, 2024-02-10T08:22:09.550 INFO:teuthology.orchestra.run.smithi018.stdout: "to": 5 2024-02-10T08:22:09.550 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:22:09.550 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:22:09.550 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:09.550 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:09.550 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "4.f", 2024-02-10T08:22:09.550 INFO:teuthology.orchestra.run.smithi018.stdout: "mappings": [ 2024-02-10T08:22:09.550 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:09.550 INFO:teuthology.orchestra.run.smithi018.stdout: "from": 1, 2024-02-10T08:22:09.550 INFO:teuthology.orchestra.run.smithi018.stdout: "to": 2 2024-02-10T08:22:09.550 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:22:09.550 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:22:09.550 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:09.550 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:09.551 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "4.13", 2024-02-10T08:22:09.551 INFO:teuthology.orchestra.run.smithi018.stdout: "mappings": [ 2024-02-10T08:22:09.551 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:09.551 INFO:teuthology.orchestra.run.smithi018.stdout: "from": 1, 2024-02-10T08:22:09.551 INFO:teuthology.orchestra.run.smithi018.stdout: "to": 2 2024-02-10T08:22:09.551 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:22:09.551 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:22:09.551 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:22:09.551 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-02-10T08:22:09.551 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_temp": [ 2024-02-10T08:22:09.551 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:09.551 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "7.1", 2024-02-10T08:22:09.551 INFO:teuthology.orchestra.run.smithi018.stdout: "osds": [ 2024-02-10T08:22:09.551 INFO:teuthology.orchestra.run.smithi018.stdout: 3, 2024-02-10T08:22:09.551 INFO:teuthology.orchestra.run.smithi018.stdout: 6 2024-02-10T08:22:09.552 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:22:09.552 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:09.552 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:09.552 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "7.3", 2024-02-10T08:22:09.552 INFO:teuthology.orchestra.run.smithi018.stdout: "osds": [ 2024-02-10T08:22:09.552 INFO:teuthology.orchestra.run.smithi018.stdout: 3, 2024-02-10T08:22:09.552 INFO:teuthology.orchestra.run.smithi018.stdout: 2 2024-02-10T08:22:09.552 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:22:09.552 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:09.552 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:09.552 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "7.4", 2024-02-10T08:22:09.552 INFO:teuthology.orchestra.run.smithi018.stdout: "osds": [ 2024-02-10T08:22:09.552 INFO:teuthology.orchestra.run.smithi018.stdout: 0, 2024-02-10T08:22:09.553 INFO:teuthology.orchestra.run.smithi018.stdout: 1 2024-02-10T08:22:09.553 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:22:09.553 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:09.553 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:09.553 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "7.8", 2024-02-10T08:22:09.553 INFO:teuthology.orchestra.run.smithi018.stdout: "osds": [ 2024-02-10T08:22:09.553 INFO:teuthology.orchestra.run.smithi018.stdout: 2, 2024-02-10T08:22:09.553 INFO:teuthology.orchestra.run.smithi018.stdout: 7 2024-02-10T08:22:09.553 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:22:09.553 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:09.553 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:09.553 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "7.9", 2024-02-10T08:22:09.553 INFO:teuthology.orchestra.run.smithi018.stdout: "osds": [ 2024-02-10T08:22:09.553 INFO:teuthology.orchestra.run.smithi018.stdout: 0, 2024-02-10T08:22:09.553 INFO:teuthology.orchestra.run.smithi018.stdout: 1 2024-02-10T08:22:09.554 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:22:09.554 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:22:09.554 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-02-10T08:22:09.554 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_temp": [], 2024-02-10T08:22:09.554 INFO:teuthology.orchestra.run.smithi018.stdout: "blocklist": { 2024-02-10T08:22:09.554 INFO:teuthology.orchestra.run.smithi018.stdout: "172.21.15.18:6800/542054629": "2024-02-11T08:17:16.433947+0000", 2024-02-10T08:22:09.554 INFO:teuthology.orchestra.run.smithi018.stdout: "172.21.15.18:0/491217791": "2024-02-11T08:17:16.433947+0000", 2024-02-10T08:22:09.554 INFO:teuthology.orchestra.run.smithi018.stdout: "172.21.15.18:0/781076548": "2024-02-11T08:17:16.433947+0000", 2024-02-10T08:22:09.554 INFO:teuthology.orchestra.run.smithi018.stdout: "172.21.15.18:0/957318754": "2024-02-11T08:17:16.433947+0000", 2024-02-10T08:22:09.554 INFO:teuthology.orchestra.run.smithi018.stdout: "172.21.15.18:0/2662732452": "2024-02-11T08:11:55.105124+0000", 2024-02-10T08:22:09.554 INFO:teuthology.orchestra.run.smithi018.stdout: "172.21.15.18:0/1407788916": "2024-02-11T08:11:55.105124+0000", 2024-02-10T08:22:09.554 INFO:teuthology.orchestra.run.smithi018.stdout: "172.21.15.18:6800/3798687064": "2024-02-11T08:11:55.105124+0000", 2024-02-10T08:22:09.554 INFO:teuthology.orchestra.run.smithi018.stdout: "172.21.15.18:6800/3570839557": "2024-02-11T08:11:31.445897+0000", 2024-02-10T08:22:09.554 INFO:teuthology.orchestra.run.smithi018.stdout: "172.21.15.18:0/541168116": "2024-02-11T08:11:31.445897+0000", 2024-02-10T08:22:09.554 INFO:teuthology.orchestra.run.smithi018.stdout: "172.21.15.18:0/806236095": "2024-02-11T08:11:31.445897+0000" 2024-02-10T08:22:09.555 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:09.555 INFO:teuthology.orchestra.run.smithi018.stdout: "range_blocklist": {}, 2024-02-10T08:22:09.555 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profiles": { 2024-02-10T08:22:09.555 INFO:teuthology.orchestra.run.smithi018.stdout: "default": { 2024-02-10T08:22:09.555 INFO:teuthology.orchestra.run.smithi018.stdout: "crush-failure-domain": "osd", 2024-02-10T08:22:09.555 INFO:teuthology.orchestra.run.smithi018.stdout: "k": "2", 2024-02-10T08:22:09.555 INFO:teuthology.orchestra.run.smithi018.stdout: "m": "1", 2024-02-10T08:22:09.555 INFO:teuthology.orchestra.run.smithi018.stdout: "plugin": "jerasure", 2024-02-10T08:22:09.555 INFO:teuthology.orchestra.run.smithi018.stdout: "ruleset-failure-domain": "osd", 2024-02-10T08:22:09.555 INFO:teuthology.orchestra.run.smithi018.stdout: "technique": "reed_sol_van" 2024-02-10T08:22:09.555 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:22:09.555 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:09.555 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps_queue": [], 2024-02-10T08:22:09.555 INFO:teuthology.orchestra.run.smithi018.stdout: "new_removed_snaps": [], 2024-02-10T08:22:09.555 INFO:teuthology.orchestra.run.smithi018.stdout: "new_purged_snaps": [], 2024-02-10T08:22:09.555 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_node_flags": {}, 2024-02-10T08:22:09.556 INFO:teuthology.orchestra.run.smithi018.stdout: "device_class_flags": {}, 2024-02-10T08:22:09.556 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode": { 2024-02-10T08:22:09.556 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_enabled": false, 2024-02-10T08:22:09.556 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_bucket_count": 0, 2024-02-10T08:22:09.556 INFO:teuthology.orchestra.run.smithi018.stdout: "degraded_stretch_mode": 0, 2024-02-10T08:22:09.556 INFO:teuthology.orchestra.run.smithi018.stdout: "recovering_stretch_mode": 0, 2024-02-10T08:22:09.556 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_bucket": 0 2024-02-10T08:22:09.556 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:22:09.556 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-02-10T08:22:09.557 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:09.724 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:22:09.734 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:09.735 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:22:09.813 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:08.598362+0000 mgr.y (mgr.14505) 206 : cluster [DBG] pgmap v222: 158 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 153 active+clean; 4.2 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 1.4 KiB/s rd, 145 B/s wr, 1.06k op/s; 15562/205551 objects degraded (7.571%); 13 MiB/s, 204 objects/s recovering 2024-02-10T08:22:09.814 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:22:09.364837+0000 mon.c (mon.2) 31 : audit [DBG] from='client.? 172.21.15.18:0/617360888' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2024-02-10T08:22:09.835 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:22:09.875 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:10.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:08.598362+0000 mgr.y (mgr.14505) 206 : cluster [DBG] pgmap v222: 158 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 153 active+clean; 4.2 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 1.4 KiB/s rd, 145 B/s wr, 1.06k op/s; 15562/205551 objects degraded (7.571%); 13 MiB/s, 204 objects/s recovering 2024-02-10T08:22:10.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:22:09.364837+0000 mon.c (mon.2) 31 : audit [DBG] from='client.? 172.21.15.18:0/617360888' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2024-02-10T08:22:10.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:08.598362+0000 mgr.y (mgr.14505) 206 : cluster [DBG] pgmap v222: 158 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 153 active+clean; 4.2 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 1.4 KiB/s rd, 145 B/s wr, 1.06k op/s; 15562/205551 objects degraded (7.571%); 13 MiB/s, 204 objects/s recovering 2024-02-10T08:22:10.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:22:09.364837+0000 mon.c (mon.2) 31 : audit [DBG] from='client.? 172.21.15.18:0/617360888' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2024-02-10T08:22:10.233 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:22:10.237 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:10.237 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:22:10.317 INFO:tasks.thrashosds.thrasher:j is {'epoch': 137, 'fsid': 'd46257c8-c7eb-11ee-95b8-87774f69a715', 'created': '2024-02-10T08:10:57.425061+0000', 'modified': '2024-02-10T08:22:05.468147+0000', 'last_up_change': '2024-02-10T08:20:45.372678+0000', 'last_in_change': '2024-02-10T08:16:27.586635+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 19, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 7, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'pacific', 'pools': [{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-02-10T08:14:44.034966+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': '.rgw.root', 'create_time': '2024-02-10T08:16:51.334631+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 3, 'pool_name': 'iscsi', 'create_time': '2024-02-10T08:16:51.762963+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 3, 'pg_placement_num': 3, 'pg_placement_num_target': 3, 'pg_num_target': 3, 'pg_num_pending': 3, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '57', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 4, 'pool_name': 'default.rgw.log', 'create_time': '2024-02-10T08:16:53.258098+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '121', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 5, 'pool_name': 'default.rgw.control', 'create_time': '2024-02-10T08:16:55.289300+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 6, 'pool_name': 'default.rgw.meta', 'create_time': '2024-02-10T08:16:57.354868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 42, 'pg_placement_num': 42, 'pg_placement_num_target': 42, 'pg_num_target': 42, 'pg_num_pending': 42, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '133', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '131', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4}, 'application_metadata': {'rgw': {}}}, {'pool': 7, 'pool_name': 'unique_pool_0', 'create_time': '2024-02-10T08:19:38.373573+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '95', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}], 'osds': [{'osd': 0, 'uuid': 'f9043fee-a3ed-4e16-921d-bb86756d0c48', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 131, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6801', 'nonce': 276034406}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6802', 'nonce': 276034406}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6804', 'nonce': 276034406}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6803', 'nonce': 276034406}]}, 'public_addr': '172.21.15.18:6801/276034406', 'cluster_addr': '172.21.15.18:6802/276034406', 'heartbeat_back_addr': '172.21.15.18:6804/276034406', 'heartbeat_front_addr': '172.21.15.18:6803/276034406', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'ff958272-ce6b-4162-959a-6da9729e537b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 133, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6805', 'nonce': 1941014296}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6806', 'nonce': 1941014296}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6808', 'nonce': 1941014296}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6807', 'nonce': 1941014296}]}, 'public_addr': '172.21.15.18:6805/1941014296', 'cluster_addr': '172.21.15.18:6806/1941014296', 'heartbeat_back_addr': '172.21.15.18:6808/1941014296', 'heartbeat_front_addr': '172.21.15.18:6807/1941014296', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '29bb47e2-5c81-4ae8-bb9f-d1b02ea01d3f', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 18, 'up_thru': 133, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6809', 'nonce': 3122474567}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6810', 'nonce': 3122474567}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6812', 'nonce': 3122474567}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6811', 'nonce': 3122474567}]}, 'public_addr': '172.21.15.18:6809/3122474567', 'cluster_addr': '172.21.15.18:6810/3122474567', 'heartbeat_back_addr': '172.21.15.18:6812/3122474567', 'heartbeat_front_addr': '172.21.15.18:6811/3122474567', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '87ad37de-5f49-4e5b-9683-3bb9c3e33907', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 25, 'up_thru': 131, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6813', 'nonce': 3484706437}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6814', 'nonce': 3484706437}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6816', 'nonce': 3484706437}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6815', 'nonce': 3484706437}]}, 'public_addr': '172.21.15.18:6813/3484706437', 'cluster_addr': '172.21.15.18:6814/3484706437', 'heartbeat_back_addr': '172.21.15.18:6816/3484706437', 'heartbeat_front_addr': '172.21.15.18:6815/3484706437', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': 'f5708f20-f98d-4d12-b8ae-71a5049a14cc', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 30, 'last_clean_end': 87, 'up_from': 110, 'up_thru': 131, 'down_at': 88, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6800', 'nonce': 3888817642}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6801', 'nonce': 3888817642}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6803', 'nonce': 3888817642}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6802', 'nonce': 3888817642}]}, 'public_addr': '172.21.15.71:6800/3888817642', 'cluster_addr': '172.21.15.71:6801/3888817642', 'heartbeat_back_addr': '172.21.15.71:6803/3888817642', 'heartbeat_front_addr': '172.21.15.71:6802/3888817642', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'e36a71dd-5088-4bff-965e-7dc8708ef7e3', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 37, 'up_thru': 133, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6804', 'nonce': 1932648316}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6805', 'nonce': 1932648316}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6807', 'nonce': 1932648316}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6806', 'nonce': 1932648316}]}, 'public_addr': '172.21.15.71:6804/1932648316', 'cluster_addr': '172.21.15.71:6805/1932648316', 'heartbeat_back_addr': '172.21.15.71:6807/1932648316', 'heartbeat_front_addr': '172.21.15.71:6806/1932648316', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '210a8790-78b6-4efa-a969-17efb17e9c0b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 43, 'up_thru': 133, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6808', 'nonce': 3724399458}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6809', 'nonce': 3724399458}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6811', 'nonce': 3724399458}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6810', 'nonce': 3724399458}]}, 'public_addr': '172.21.15.71:6808/3724399458', 'cluster_addr': '172.21.15.71:6809/3724399458', 'heartbeat_back_addr': '172.21.15.71:6811/3724399458', 'heartbeat_front_addr': '172.21.15.71:6810/3724399458', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '9778a0e9-2ff3-4700-bf2a-675edaba630b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 50, 'up_thru': 133, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6812', 'nonce': 163573852}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6813', 'nonce': 163573852}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6815', 'nonce': 163573852}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6814', 'nonce': 163573852}]}, 'public_addr': '172.21.15.71:6812/163573852', 'cluster_addr': '172.21.15.71:6813/163573852', 'heartbeat_back_addr': '172.21.15.71:6815/163573852', 'heartbeat_front_addr': '172.21.15.71:6814/163573852', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-10T08:22:03.482663+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-10T08:21:52.169786+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-10T08:22:00.545053+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-10T08:21:33.049279+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-10T08:21:53.434067+0000', 'dead_epoch': 87}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-10T08:21:56.576070+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-10T08:21:29.802988+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-10T08:21:15.394993+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [{'pgid': '2.5', 'mappings': [{'from': 7, 'to': 2}]}, {'pgid': '4.7', 'mappings': [{'from': 1, 'to': 7}, {'from': 0, 'to': 5}]}, {'pgid': '4.d', 'mappings': [{'from': 1, 'to': 5}]}, {'pgid': '4.f', 'mappings': [{'from': 1, 'to': 2}]}, {'pgid': '4.13', 'mappings': [{'from': 1, 'to': 2}]}], 'pg_temp': [{'pgid': '7.1', 'osds': [3, 6]}, {'pgid': '7.3', 'osds': [3, 2]}, {'pgid': '7.4', 'osds': [0, 1]}, {'pgid': '7.8', 'osds': [2, 7]}, {'pgid': '7.9', 'osds': [0, 1]}], 'primary_temp': [], 'blocklist': {'172.21.15.18:6800/542054629': '2024-02-11T08:17:16.433947+0000', '172.21.15.18:0/491217791': '2024-02-11T08:17:16.433947+0000', '172.21.15.18:0/781076548': '2024-02-11T08:17:16.433947+0000', '172.21.15.18:0/957318754': '2024-02-11T08:17:16.433947+0000', '172.21.15.18:0/2662732452': '2024-02-11T08:11:55.105124+0000', '172.21.15.18:0/1407788916': '2024-02-11T08:11:55.105124+0000', '172.21.15.18:6800/3798687064': '2024-02-11T08:11:55.105124+0000', '172.21.15.18:6800/3570839557': '2024-02-11T08:11:31.445897+0000', '172.21.15.18:0/541168116': '2024-02-11T08:11:31.445897+0000', '172.21.15.18:0/806236095': '2024-02-11T08:11:31.445897+0000'}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'ruleset-failure-domain': 'osd', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-02-10T08:22:10.317 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2024-02-10T08:22:10.338 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:22:10.401 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:10.434 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:22:10.437 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:10.437 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:22:10.538 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:22:10.572 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:10.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:10.469448+0000 mon.a (mon.0) 933 : cluster [WRN] Health check update: Degraded data redundancy: 15562/205551 objects degraded (7.571%), 5 pgs degraded, 5 pgs undersized (PG_DEGRADED) 2024-02-10T08:22:10.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:10.469448+0000 mon.a (mon.0) 933 : cluster [WRN] Health check update: Degraded data redundancy: 15562/205551 objects degraded (7.571%), 5 pgs degraded, 5 pgs undersized (PG_DEGRADED) 2024-02-10T08:22:10.976 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:22:11.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:10.469448+0000 mon.a (mon.0) 933 : cluster [WRN] Health check update: Degraded data redundancy: 15562/205551 objects degraded (7.571%), 5 pgs degraded, 5 pgs undersized (PG_DEGRADED) 2024-02-10T08:22:11.044 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:22:11.097 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:22:11.151 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:22:11.201 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:22:11.236 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:22:11.267 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:22:11.295 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:22:11.334 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:22:11.369 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-10T08:22:11.370 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-10T08:22:11.370 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-10T08:22:11.370 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-10T08:22:11.370 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-10T08:22:11.370 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-10T08:22:11.370 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-10T08:22:11.370 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-10T08:22:12.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:10.598983+0000 mgr.y (mgr.14505) 207 : cluster [DBG] pgmap v223: 158 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 153 active+clean; 4.2 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 640 op/s; 15562/205551 objects degraded (7.571%); 11 MiB/s, 179 objects/s recovering 2024-02-10T08:22:12.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:22:10.993409+0000 mon.c (mon.2) 32 : audit [DBG] from='client.? 172.21.15.18:0/638030495' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:22:12.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:10.598983+0000 mgr.y (mgr.14505) 207 : cluster [DBG] pgmap v223: 158 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 153 active+clean; 4.2 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 640 op/s; 15562/205551 objects degraded (7.571%); 11 MiB/s, 179 objects/s recovering 2024-02-10T08:22:12.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:22:10.993409+0000 mon.c (mon.2) 32 : audit [DBG] from='client.? 172.21.15.18:0/638030495' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:22:12.102 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:10.598983+0000 mgr.y (mgr.14505) 207 : cluster [DBG] pgmap v223: 158 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 153 active+clean; 4.2 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 640 op/s; 15562/205551 objects degraded (7.571%); 11 MiB/s, 179 objects/s recovering 2024-02-10T08:22:12.102 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:22:10.993409+0000 mon.c (mon.2) 32 : audit [DBG] from='client.? 172.21.15.18:0/638030495' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:22:14.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:12.599792+0000 mgr.y (mgr.14505) 208 : cluster [DBG] pgmap v224: 158 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 153 active+clean; 4.0 GiB data, 14 GiB used, 702 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 682 op/s; 15074/198453 objects degraded (7.596%); 5.4 MiB/s, 86 objects/s recovering 2024-02-10T08:22:14.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:12.599792+0000 mgr.y (mgr.14505) 208 : cluster [DBG] pgmap v224: 158 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 153 active+clean; 4.0 GiB data, 14 GiB used, 702 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 682 op/s; 15074/198453 objects degraded (7.596%); 5.4 MiB/s, 86 objects/s recovering 2024-02-10T08:22:14.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:12.599792+0000 mgr.y (mgr.14505) 208 : cluster [DBG] pgmap v224: 158 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 153 active+clean; 4.0 GiB data, 14 GiB used, 702 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 682 op/s; 15074/198453 objects degraded (7.596%); 5.4 MiB/s, 86 objects/s recovering 2024-02-10T08:22:14.181 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:22:14.189 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:14.189 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:22:14.290 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:22:14.338 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:14.442 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:22:14.446 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:14.446 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:22:14.547 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:22:14.591 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:14.656 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:22:14.664 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:14.664 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:22:14.765 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:22:14.814 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:14.835 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-02-10T08:22:14.835 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:22:14.853 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:22:14.855 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:14.855 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:22:14.956 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:22:15.035 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:15.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:22:14.601833+0000 mon.a (mon.0) 934 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:22:15.161 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:22:14.601833+0000 mon.a (mon.0) 934 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:22:15.231 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:22:14.601833+0000 mon.a (mon.0) 934 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:22:15.318 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 5, 6, 7, 4] 2024-02-10T08:22:15.318 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-10T08:22:15.318 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-02-10T08:22:15.318 INFO:tasks.thrashosds.thrasher:Setting osd 3 primary_affinity to 0.000000 2024-02-10T08:22:15.318 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd primary-affinity 3 0 2024-02-10T08:22:15.504 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:22:15.511 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:15.511 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:22:15.610 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.4 dump_ops_in_flight 2024-02-10T08:22:15.612 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:22:15.650 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:15.680 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:22:15.685 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:15.686 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:22:15.787 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:22:15.822 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:15.846 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:22:15.850 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:14.600441+0000 mgr.y (mgr.14505) 209 : cluster [DBG] pgmap v225: 158 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 153 active+clean; 3.9 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 748 op/s; 14190/194283 objects degraded (7.304%); 10 MiB/s, 165 objects/s recovering 2024-02-10T08:22:15.850 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:15.473872+0000 mon.a (mon.0) 935 : cluster [WRN] Health check update: Degraded data redundancy: 14190/194283 objects degraded (7.304%), 5 pgs degraded, 5 pgs undersized (PG_DEGRADED) 2024-02-10T08:22:15.851 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:22:15.627299+0000 mon.a (mon.0) 936 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:22:15.851 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:15.852 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:22:15.953 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:22:15.956 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:22:15.990 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:16.163 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:14.600441+0000 mgr.y (mgr.14505) 209 : cluster [DBG] pgmap v225: 158 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 153 active+clean; 3.9 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 748 op/s; 14190/194283 objects degraded (7.304%); 10 MiB/s, 165 objects/s recovering 2024-02-10T08:22:16.163 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:15.473872+0000 mon.a (mon.0) 935 : cluster [WRN] Health check update: Degraded data redundancy: 14190/194283 objects degraded (7.304%), 5 pgs degraded, 5 pgs undersized (PG_DEGRADED) 2024-02-10T08:22:16.163 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:22:15.627299+0000 mon.a (mon.0) 936 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:22:16.163 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:14.600441+0000 mgr.y (mgr.14505) 209 : cluster [DBG] pgmap v225: 158 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 153 active+clean; 3.9 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 748 op/s; 14190/194283 objects degraded (7.304%); 10 MiB/s, 165 objects/s recovering 2024-02-10T08:22:16.163 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:15.473872+0000 mon.a (mon.0) 935 : cluster [WRN] Health check update: Degraded data redundancy: 14190/194283 objects degraded (7.304%), 5 pgs degraded, 5 pgs undersized (PG_DEGRADED) 2024-02-10T08:22:16.164 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:22:15.627299+0000 mon.a (mon.0) 936 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:22:16.348 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:22:16.350 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:16.350 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:22:16.451 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:22:16.483 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:16.789 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:22:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:22:16] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:22:16.941 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:22:16.947 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:16.948 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:22:16.990 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:22:17.048 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:22:17.080 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:17.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:22:16.675787+0000 mon.a (mon.0) 937 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:22:17.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:22:16.687726+0000 mon.a (mon.0) 938 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:22:17.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:22:16.720604+0000 mon.a (mon.0) 939 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:22:17.154 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:22:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:22:17] "GET /metrics HTTP/1.1" 200 175602 "" "Prometheus/2.33.4" 2024-02-10T08:22:17.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:22:16.675787+0000 mon.a (mon.0) 937 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:22:17.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:22:16.687726+0000 mon.a (mon.0) 938 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:22:17.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:22:16.720604+0000 mon.a (mon.0) 939 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:22:17.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:22:16.675787+0000 mon.a (mon.0) 937 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:22:17.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:22:16.687726+0000 mon.a (mon.0) 938 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:22:17.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:22:16.720604+0000 mon.a (mon.0) 939 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:22:17.429 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:22:17.432 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:17.433 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:22:17.533 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:22:17.589 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:17.719 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:22:17.723 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:17.723 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:22:17.824 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:22:17.850 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:16.601004+0000 mgr.y (mgr.14505) 210 : cluster [DBG] pgmap v226: 158 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 153 active+clean; 3.9 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 921 B/s rd, 0 B/s wr, 673 op/s; 14190/194283 objects degraded (7.304%); 9.3 MiB/s, 149 objects/s recovering 2024-02-10T08:22:17.850 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:16.845776+0000 mon.a (mon.0) 940 : cluster [DBG] osdmap e138: 8 total, 8 up, 8 in 2024-02-10T08:22:17.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:16.601004+0000 mgr.y (mgr.14505) 210 : cluster [DBG] pgmap v226: 158 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 153 active+clean; 3.9 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 921 B/s rd, 0 B/s wr, 673 op/s; 14190/194283 objects degraded (7.304%); 9.3 MiB/s, 149 objects/s recovering 2024-02-10T08:22:17.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:16.845776+0000 mon.a (mon.0) 940 : cluster [DBG] osdmap e138: 8 total, 8 up, 8 in 2024-02-10T08:22:17.857 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:17.955 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:22:17.959 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:16.601004+0000 mgr.y (mgr.14505) 210 : cluster [DBG] pgmap v226: 158 pgs: 1 active+undersized+degraded+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 3 active+recovering+undersized+degraded+remapped, 153 active+clean; 3.9 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 921 B/s rd, 0 B/s wr, 673 op/s; 14190/194283 objects degraded (7.304%); 9.3 MiB/s, 149 objects/s recovering 2024-02-10T08:22:17.960 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:16.845776+0000 mon.a (mon.0) 940 : cluster [DBG] osdmap e138: 8 total, 8 up, 8 in 2024-02-10T08:22:17.960 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:22:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:22:17.961 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:17.961 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:22:17.978 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-02-10T08:22:17.978 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:22:18.062 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:22:18.099 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:18.354 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:22:18.357 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:18.357 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:22:18.415 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-10T08:22:18.458 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:22:18.491 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:18.744 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:22:18.745 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.4 dump_blocked_ops 2024-02-10T08:22:18.746 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:18.747 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:22:18.847 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:22:18.893 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is unset 2024-02-10T08:22:18.905 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:19.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:22:17.741769+0000 mgr.y (mgr.14505) 211 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:22:19.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:17.846345+0000 mon.a (mon.0) 941 : cluster [DBG] osdmap e139: 8 total, 8 up, 8 in 2024-02-10T08:22:19.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:22:18.709215+0000 mon.c (mon.2) 33 : audit [INF] from='client.? 172.21.15.18:0/2458561912' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:22:19.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:22:18.709887+0000 mon.a (mon.0) 942 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:22:19.112 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:22:19.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:22:17.741769+0000 mgr.y (mgr.14505) 211 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:22:19.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:17.846345+0000 mon.a (mon.0) 941 : cluster [DBG] osdmap e139: 8 total, 8 up, 8 in 2024-02-10T08:22:19.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:22:18.709215+0000 mon.c (mon.2) 33 : audit [INF] from='client.? 172.21.15.18:0/2458561912' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:22:19.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:22:18.709887+0000 mon.a (mon.0) 942 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:22:19.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:22:17.741769+0000 mgr.y (mgr.14505) 211 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:22:19.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:17.846345+0000 mon.a (mon.0) 941 : cluster [DBG] osdmap e139: 8 total, 8 up, 8 in 2024-02-10T08:22:19.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:22:18.709215+0000 mon.c (mon.2) 33 : audit [INF] from='client.? 172.21.15.18:0/2458561912' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:22:19.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:22:18.709887+0000 mon.a (mon.0) 942 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:22:19.876 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:18.602003+0000 mgr.y (mgr.14505) 212 : cluster [DBG] pgmap v229: 158 pgs: 1 peering, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 1 active+undersized+degraded+remapped+backfilling, 2 active+recovering+undersized+degraded+remapped, 153 active+clean; 3.7 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 911 op/s; 12853/183705 objects degraded (6.997%); 14 MiB/s, 223 objects/s recovering 2024-02-10T08:22:19.876 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:18.861527+0000 mon.a (mon.0) 943 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-10T08:22:19.876 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:22:18.879670+0000 mon.a (mon.0) 944 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-10T08:22:19.876 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:18.879736+0000 mon.a (mon.0) 945 : cluster [DBG] osdmap e140: 8 total, 8 up, 8 in 2024-02-10T08:22:20.144 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:18.602003+0000 mgr.y (mgr.14505) 212 : cluster [DBG] pgmap v229: 158 pgs: 1 peering, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 1 active+undersized+degraded+remapped+backfilling, 2 active+recovering+undersized+degraded+remapped, 153 active+clean; 3.7 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 911 op/s; 12853/183705 objects degraded (6.997%); 14 MiB/s, 223 objects/s recovering 2024-02-10T08:22:20.144 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:18.861527+0000 mon.a (mon.0) 943 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-10T08:22:20.144 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:22:18.879670+0000 mon.a (mon.0) 944 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-10T08:22:20.144 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:18.879736+0000 mon.a (mon.0) 945 : cluster [DBG] osdmap e140: 8 total, 8 up, 8 in 2024-02-10T08:22:20.144 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:18.602003+0000 mgr.y (mgr.14505) 212 : cluster [DBG] pgmap v229: 158 pgs: 1 peering, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 1 active+undersized+degraded+remapped+backfilling, 2 active+recovering+undersized+degraded+remapped, 153 active+clean; 3.7 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 911 op/s; 12853/183705 objects degraded (6.997%); 14 MiB/s, 223 objects/s recovering 2024-02-10T08:22:20.145 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:18.861527+0000 mon.a (mon.0) 943 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-10T08:22:20.145 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:22:18.879670+0000 mon.a (mon.0) 944 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-10T08:22:20.145 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:18.879736+0000 mon.a (mon.0) 945 : cluster [DBG] osdmap e140: 8 total, 8 up, 8 in 2024-02-10T08:22:21.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:20.484784+0000 mon.a (mon.0) 946 : cluster [WRN] Health check update: Degraded data redundancy: 12853/183705 objects degraded (6.997%), 4 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2024-02-10T08:22:21.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:20.494001+0000 mon.a (mon.0) 947 : cluster [DBG] osdmap e141: 8 total, 8 up, 8 in 2024-02-10T08:22:21.052 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-02-10T08:22:21.052 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:22:21.160 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:20.484784+0000 mon.a (mon.0) 946 : cluster [WRN] Health check update: Degraded data redundancy: 12853/183705 objects degraded (6.997%), 4 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2024-02-10T08:22:21.160 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:20.494001+0000 mon.a (mon.0) 947 : cluster [DBG] osdmap e141: 8 total, 8 up, 8 in 2024-02-10T08:22:21.160 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:20.484784+0000 mon.a (mon.0) 946 : cluster [WRN] Health check update: Degraded data redundancy: 12853/183705 objects degraded (6.997%), 4 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2024-02-10T08:22:21.160 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:20.494001+0000 mon.a (mon.0) 947 : cluster [DBG] osdmap e141: 8 total, 8 up, 8 in 2024-02-10T08:22:21.195 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:22:21.203 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:21.204 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:22:21.305 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:22:21.339 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:21.362 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:22:21.364 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:21.365 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:22:21.466 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:22:21.502 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:21.845 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.4 dump_historic_ops 2024-02-10T08:22:21.856 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:22:21.859 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:21.860 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:22:21.961 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:22:22.039 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:22.146 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd set noscrub 2024-02-10T08:22:22.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:20.602434+0000 mgr.y (mgr.14505) 213 : cluster [DBG] pgmap v232: 158 pgs: 1 peering, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 1 active+undersized+degraded+remapped+backfilling, 2 active+recovering+undersized+degraded+remapped, 153 active+clean; 3.7 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 882 op/s; 12853/183705 objects degraded (6.997%); 14 MiB/s, 225 objects/s recovering 2024-02-10T08:22:22.158 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:22:21.677909+0000 mon.a (mon.0) 948 : audit [INF] from='client.? 172.21.15.18:0/1476409327' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 3, "weight": 0.0}]: dispatch 2024-02-10T08:22:22.158 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:20.602434+0000 mgr.y (mgr.14505) 213 : cluster [DBG] pgmap v232: 158 pgs: 1 peering, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 1 active+undersized+degraded+remapped+backfilling, 2 active+recovering+undersized+degraded+remapped, 153 active+clean; 3.7 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 882 op/s; 12853/183705 objects degraded (6.997%); 14 MiB/s, 225 objects/s recovering 2024-02-10T08:22:22.158 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:22:21.677909+0000 mon.a (mon.0) 948 : audit [INF] from='client.? 172.21.15.18:0/1476409327' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 3, "weight": 0.0}]: dispatch 2024-02-10T08:22:22.190 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:22:22.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:20.602434+0000 mgr.y (mgr.14505) 213 : cluster [DBG] pgmap v232: 158 pgs: 1 peering, 1 active+undersized+degraded+remapped+backfill_wait+backfill_toofull, 1 active+undersized+degraded+remapped+backfilling, 2 active+recovering+undersized+degraded+remapped, 153 active+clean; 3.7 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 882 op/s; 12853/183705 objects degraded (6.997%); 14 MiB/s, 225 objects/s recovering 2024-02-10T08:22:22.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:22:21.677909+0000 mon.a (mon.0) 948 : audit [INF] from='client.? 172.21.15.18:0/1476409327' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 3, "weight": 0.0}]: dispatch 2024-02-10T08:22:22.544 INFO:teuthology.orchestra.run.smithi018.stderr:set osd.3 primary-affinity to 0 (802) 2024-02-10T08:22:22.629 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:22:22.634 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:22.634 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:22:22.696 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:22:22.697 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:22:22.735 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:22:22.764 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:23.110 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:22:23.113 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:23.113 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:22:23.214 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:22:23.241 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:23.789 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:22:23.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:22:22.514798+0000 mon.a (mon.0) 949 : audit [INF] from='client.? 172.21.15.18:0/1476409327' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 3, "weight": 0.0}]': finished 2024-02-10T08:22:23.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:22.514864+0000 mon.a (mon.0) 950 : cluster [DBG] osdmap e142: 8 total, 8 up, 8 in 2024-02-10T08:22:23.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:22.603644+0000 mgr.y (mgr.14505) 214 : cluster [DBG] pgmap v234: 158 pgs: 1 remapped+peering, 7 peering, 1 active+undersized+degraded+remapped+backfilling, 2 active+recovering+undersized+degraded+remapped, 147 active+clean; 3.6 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 645 B/s rd, 0 B/s wr, 573 op/s; 8865/178104 objects degraded (4.977%); 7.1 MiB/s, 113 objects/s recovering 2024-02-10T08:22:23.792 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:23.792 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:22:23.893 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:22:23.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:22:22.514798+0000 mon.a (mon.0) 949 : audit [INF] from='client.? 172.21.15.18:0/1476409327' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 3, "weight": 0.0}]': finished 2024-02-10T08:22:23.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:22.514864+0000 mon.a (mon.0) 950 : cluster [DBG] osdmap e142: 8 total, 8 up, 8 in 2024-02-10T08:22:23.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:22.603644+0000 mgr.y (mgr.14505) 214 : cluster [DBG] pgmap v234: 158 pgs: 1 remapped+peering, 7 peering, 1 active+undersized+degraded+remapped+backfilling, 2 active+recovering+undersized+degraded+remapped, 147 active+clean; 3.6 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 645 B/s rd, 0 B/s wr, 573 op/s; 8865/178104 objects degraded (4.977%); 7.1 MiB/s, 113 objects/s recovering 2024-02-10T08:22:23.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:22:22.514798+0000 mon.a (mon.0) 949 : audit [INF] from='client.? 172.21.15.18:0/1476409327' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 3, "weight": 0.0}]': finished 2024-02-10T08:22:23.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:22.514864+0000 mon.a (mon.0) 950 : cluster [DBG] osdmap e142: 8 total, 8 up, 8 in 2024-02-10T08:22:23.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:22.603644+0000 mgr.y (mgr.14505) 214 : cluster [DBG] pgmap v234: 158 pgs: 1 remapped+peering, 7 peering, 1 active+undersized+degraded+remapped+backfilling, 2 active+recovering+undersized+degraded+remapped, 147 active+clean; 3.6 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 645 B/s rd, 0 B/s wr, 573 op/s; 8865/178104 objects degraded (4.977%); 7.1 MiB/s, 113 objects/s recovering 2024-02-10T08:22:23.920 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:24.069 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:22:24.072 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:24.072 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:22:24.173 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:22:24.204 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:24.351 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-02-10T08:22:24.351 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:22:24.529 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:23.343395+0000 osd.7 (osd.7) 75 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:22:24.530 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:23.343437+0000 osd.7 (osd.7) 76 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:22:24.530 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:23.511450+0000 mon.a (mon.0) 951 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 5 pgs peering (PG_AVAILABILITY) 2024-02-10T08:22:24.530 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:23.511487+0000 mon.a (mon.0) 952 : cluster [INF] Health check cleared: PG_BACKFILL_FULL (was: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull) 2024-02-10T08:22:24.530 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:23.520186+0000 mon.a (mon.0) 953 : cluster [DBG] osdmap e143: 8 total, 8 up, 8 in 2024-02-10T08:22:24.697 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:23.343395+0000 osd.7 (osd.7) 75 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:22:24.697 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:23.343437+0000 osd.7 (osd.7) 76 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:22:24.697 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:23.511450+0000 mon.a (mon.0) 951 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 5 pgs peering (PG_AVAILABILITY) 2024-02-10T08:22:24.697 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:23.511487+0000 mon.a (mon.0) 952 : cluster [INF] Health check cleared: PG_BACKFILL_FULL (was: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull) 2024-02-10T08:22:24.697 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:23.520186+0000 mon.a (mon.0) 953 : cluster [DBG] osdmap e143: 8 total, 8 up, 8 in 2024-02-10T08:22:24.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:23.343395+0000 osd.7 (osd.7) 75 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:22:24.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:23.343437+0000 osd.7 (osd.7) 76 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:22:24.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:23.511450+0000 mon.a (mon.0) 951 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 5 pgs peering (PG_AVAILABILITY) 2024-02-10T08:22:24.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:23.511487+0000 mon.a (mon.0) 952 : cluster [INF] Health check cleared: PG_BACKFILL_FULL (was: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull) 2024-02-10T08:22:24.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:23.520186+0000 mon.a (mon.0) 953 : cluster [DBG] osdmap e143: 8 total, 8 up, 8 in 2024-02-10T08:22:25.106 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.0 dump_ops_in_flight 2024-02-10T08:22:25.861 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:24.519996+0000 mon.a (mon.0) 954 : cluster [DBG] osdmap e144: 8 total, 8 up, 8 in 2024-02-10T08:22:25.862 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:24.607740+0000 mgr.y (mgr.14505) 215 : cluster [DBG] pgmap v237: 158 pgs: 1 remapped+peering, 12 peering, 1 active+undersized+degraded+remapped+backfilling, 2 active+recovering+undersized+degraded+remapped, 142 active+clean; 3.5 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 497 B/s rd, 0 B/s wr, 800 op/s; 8367/173835 objects degraded (4.813%); 8.4 MiB/s, 135 objects/s recovering 2024-02-10T08:22:25.862 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:25.489514+0000 mon.a (mon.0) 955 : cluster [WRN] Health check update: Degraded data redundancy: 8865/178104 objects degraded (4.977%), 3 pgs degraded, 3 pgs undersized (PG_DEGRADED) 2024-02-10T08:22:25.862 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:25.509025+0000 mon.a (mon.0) 956 : cluster [DBG] osdmap e145: 8 total, 8 up, 8 in 2024-02-10T08:22:25.862 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:24.519996+0000 mon.a (mon.0) 954 : cluster [DBG] osdmap e144: 8 total, 8 up, 8 in 2024-02-10T08:22:25.862 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:24.607740+0000 mgr.y (mgr.14505) 215 : cluster [DBG] pgmap v237: 158 pgs: 1 remapped+peering, 12 peering, 1 active+undersized+degraded+remapped+backfilling, 2 active+recovering+undersized+degraded+remapped, 142 active+clean; 3.5 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 497 B/s rd, 0 B/s wr, 800 op/s; 8367/173835 objects degraded (4.813%); 8.4 MiB/s, 135 objects/s recovering 2024-02-10T08:22:25.862 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:25.489514+0000 mon.a (mon.0) 955 : cluster [WRN] Health check update: Degraded data redundancy: 8865/178104 objects degraded (4.977%), 3 pgs degraded, 3 pgs undersized (PG_DEGRADED) 2024-02-10T08:22:25.862 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:25.509025+0000 mon.a (mon.0) 956 : cluster [DBG] osdmap e145: 8 total, 8 up, 8 in 2024-02-10T08:22:26.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:24.519996+0000 mon.a (mon.0) 954 : cluster [DBG] osdmap e144: 8 total, 8 up, 8 in 2024-02-10T08:22:26.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:24.607740+0000 mgr.y (mgr.14505) 215 : cluster [DBG] pgmap v237: 158 pgs: 1 remapped+peering, 12 peering, 1 active+undersized+degraded+remapped+backfilling, 2 active+recovering+undersized+degraded+remapped, 142 active+clean; 3.5 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 497 B/s rd, 0 B/s wr, 800 op/s; 8367/173835 objects degraded (4.813%); 8.4 MiB/s, 135 objects/s recovering 2024-02-10T08:22:26.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:25.489514+0000 mon.a (mon.0) 955 : cluster [WRN] Health check update: Degraded data redundancy: 8865/178104 objects degraded (4.977%), 3 pgs degraded, 3 pgs undersized (PG_DEGRADED) 2024-02-10T08:22:26.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:25.509025+0000 mon.a (mon.0) 956 : cluster [DBG] osdmap e145: 8 total, 8 up, 8 in 2024-02-10T08:22:26.469 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:22:26.480 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:26.481 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:22:26.582 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:22:26.617 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:26.642 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:22:26.647 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:26.647 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:22:26.748 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:22:26.778 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:22:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:22:26] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:22:26.780 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:26.803 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:22:26.808 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:26.808 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:22:26.909 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:22:27.005 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:27.408 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:22:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:22:27] "GET /metrics HTTP/1.1" 200 175602 "" "Prometheus/2.33.4" 2024-02-10T08:22:27.665 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:22:27.671 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:27.672 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:22:27.773 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:22:27.823 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:27.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:26.608660+0000 mgr.y (mgr.14505) 216 : cluster [DBG] pgmap v239: 158 pgs: 1 remapped+peering, 12 peering, 1 active+undersized+degraded+remapped+backfilling, 2 active+recovering+undersized+degraded+remapped, 142 active+clean; 3.5 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 500 B/s rd, 0 B/s wr, 557 op/s; 8367/173835 objects degraded (4.813%); 8.5 MiB/s, 135 objects/s recovering 2024-02-10T08:22:27.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:26.608660+0000 mgr.y (mgr.14505) 216 : cluster [DBG] pgmap v239: 158 pgs: 1 remapped+peering, 12 peering, 1 active+undersized+degraded+remapped+backfilling, 2 active+recovering+undersized+degraded+remapped, 142 active+clean; 3.5 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 500 B/s rd, 0 B/s wr, 557 op/s; 8367/173835 objects degraded (4.813%); 8.5 MiB/s, 135 objects/s recovering 2024-02-10T08:22:28.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:26.608660+0000 mgr.y (mgr.14505) 216 : cluster [DBG] pgmap v239: 158 pgs: 1 remapped+peering, 12 peering, 1 active+undersized+degraded+remapped+backfilling, 2 active+recovering+undersized+degraded+remapped, 142 active+clean; 3.5 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 500 B/s rd, 0 B/s wr, 557 op/s; 8367/173835 objects degraded (4.813%); 8.5 MiB/s, 135 objects/s recovering 2024-02-10T08:22:28.040 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:22:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:22:28.086 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:22:28.097 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:28.098 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:22:28.098 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:22:28.199 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:22:28.227 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:28.246 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:22:28.248 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:28.249 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:22:28.350 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:22:28.381 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:28.633 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:22:28.639 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:28.640 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:22:28.741 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:22:28.776 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:28.798 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:22:28.802 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:28.802 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:22:28.903 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:22:28.909 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:27.701193+0000 mon.a (mon.0) 957 : cluster [DBG] osdmap e146: 8 total, 8 up, 8 in 2024-02-10T08:22:28.910 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:22:27.751527+0000 mgr.y (mgr.14505) 217 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:22:28.910 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:27.701193+0000 mon.a (mon.0) 957 : cluster [DBG] osdmap e146: 8 total, 8 up, 8 in 2024-02-10T08:22:28.910 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:22:27.751527+0000 mgr.y (mgr.14505) 217 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:22:28.935 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:28.957 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:22:28.958 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:27.701193+0000 mon.a (mon.0) 957 : cluster [DBG] osdmap e146: 8 total, 8 up, 8 in 2024-02-10T08:22:28.958 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:22:27.751527+0000 mgr.y (mgr.14505) 217 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:22:28.959 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:28.960 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:22:29.060 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:22:29.130 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:29.516 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:22:29.523 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:29.523 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:22:29.624 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:22:29.654 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:29.675 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:22:29.679 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:29.679 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:22:29.780 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:22:29.832 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:28.609144+0000 mgr.y (mgr.14505) 218 : cluster [DBG] pgmap v241: 158 pgs: 1 peering, 1 active+recovering+undersized+degraded+remapped, 2 active+undersized+degraded+remapped+backfilling, 154 active+clean; 3.4 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 402 B/s rd, 0 B/s wr, 478 op/s; 10574/166533 objects degraded (6.349%); 12 MiB/s, 194 objects/s recovering 2024-02-10T08:22:29.832 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:28.698132+0000 mon.a (mon.0) 958 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 5 pgs inactive, 10 pgs peering) 2024-02-10T08:22:29.832 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:28.706488+0000 mon.a (mon.0) 959 : cluster [DBG] osdmap e147: 8 total, 8 up, 8 in 2024-02-10T08:22:29.832 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:22:29.522173+0000 mon.b (mon.1) 48 : audit [DBG] from='client.? 172.21.15.18:0/303467863' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:22:29.833 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:28.609144+0000 mgr.y (mgr.14505) 218 : cluster [DBG] pgmap v241: 158 pgs: 1 peering, 1 active+recovering+undersized+degraded+remapped, 2 active+undersized+degraded+remapped+backfilling, 154 active+clean; 3.4 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 402 B/s rd, 0 B/s wr, 478 op/s; 10574/166533 objects degraded (6.349%); 12 MiB/s, 194 objects/s recovering 2024-02-10T08:22:29.833 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:28.698132+0000 mon.a (mon.0) 958 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 5 pgs inactive, 10 pgs peering) 2024-02-10T08:22:29.833 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:28.706488+0000 mon.a (mon.0) 959 : cluster [DBG] osdmap e147: 8 total, 8 up, 8 in 2024-02-10T08:22:29.833 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:22:29.522173+0000 mon.b (mon.1) 48 : audit [DBG] from='client.? 172.21.15.18:0/303467863' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:22:29.839 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:29.979 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:22:29.979 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:22:29.980 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:22:29.980 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:22:29.980 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:22:29.980 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:22:29.980 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:22:29.980 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:22:29.980 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-10T08:22:29.980 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-10T08:22:29.980 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-10T08:22:29.980 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-10T08:22:29.981 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-10T08:22:29.981 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-10T08:22:29.981 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-10T08:22:29.981 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-10T08:22:30.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:28.609144+0000 mgr.y (mgr.14505) 218 : cluster [DBG] pgmap v241: 158 pgs: 1 peering, 1 active+recovering+undersized+degraded+remapped, 2 active+undersized+degraded+remapped+backfilling, 154 active+clean; 3.4 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 402 B/s rd, 0 B/s wr, 478 op/s; 10574/166533 objects degraded (6.349%); 12 MiB/s, 194 objects/s recovering 2024-02-10T08:22:30.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:28.698132+0000 mon.a (mon.0) 958 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 5 pgs inactive, 10 pgs peering) 2024-02-10T08:22:30.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:28.706488+0000 mon.a (mon.0) 959 : cluster [DBG] osdmap e147: 8 total, 8 up, 8 in 2024-02-10T08:22:30.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:22:29.522173+0000 mon.b (mon.1) 48 : audit [DBG] from='client.? 172.21.15.18:0/303467863' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:22:31.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:30.498091+0000 mon.a (mon.0) 960 : cluster [WRN] Health check update: Degraded data redundancy: 10574/166533 objects degraded (6.349%), 3 pgs degraded, 2 pgs undersized (PG_DEGRADED) 2024-02-10T08:22:31.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:30.498091+0000 mon.a (mon.0) 960 : cluster [WRN] Health check update: Degraded data redundancy: 10574/166533 objects degraded (6.349%), 3 pgs degraded, 2 pgs undersized (PG_DEGRADED) 2024-02-10T08:22:31.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:30.498091+0000 mon.a (mon.0) 960 : cluster [WRN] Health check update: Degraded data redundancy: 10574/166533 objects degraded (6.349%), 3 pgs degraded, 2 pgs undersized (PG_DEGRADED) 2024-02-10T08:22:31.457 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 5, 6, 7, 4] 2024-02-10T08:22:31.457 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-10T08:22:31.457 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '3.0', 'overage': '110', 'type': 'test-reweight-by-utilization'} 2024-02-10T08:22:31.457 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd test-reweight-by-utilization 110 3.0 2024-02-10T08:22:31.906 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:30.610486+0000 mgr.y (mgr.14505) 219 : cluster [DBG] pgmap v243: 158 pgs: 1 peering, 1 active+recovering+undersized+degraded+remapped, 2 active+undersized+degraded+remapped+backfilling, 154 active+clean; 3.4 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 341 B/s rd, 0 B/s wr, 405 op/s; 10574/166533 objects degraded (6.349%); 10 MiB/s, 164 objects/s recovering 2024-02-10T08:22:31.906 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:22:31.628368+0000 mon.a (mon.0) 961 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:22:31.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:30.610486+0000 mgr.y (mgr.14505) 219 : cluster [DBG] pgmap v243: 158 pgs: 1 peering, 1 active+recovering+undersized+degraded+remapped, 2 active+undersized+degraded+remapped+backfilling, 154 active+clean; 3.4 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 341 B/s rd, 0 B/s wr, 405 op/s; 10574/166533 objects degraded (6.349%); 10 MiB/s, 164 objects/s recovering 2024-02-10T08:22:31.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:22:31.628368+0000 mon.a (mon.0) 961 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:22:32.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:30.610486+0000 mgr.y (mgr.14505) 219 : cluster [DBG] pgmap v243: 158 pgs: 1 peering, 1 active+recovering+undersized+degraded+remapped, 2 active+undersized+degraded+remapped+backfilling, 154 active+clean; 3.4 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 341 B/s rd, 0 B/s wr, 405 op/s; 10574/166533 objects degraded (6.349%); 10 MiB/s, 164 objects/s recovering 2024-02-10T08:22:32.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:22:31.628368+0000 mon.a (mon.0) 961 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:22:32.329 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:22:32.335 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:32.335 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:22:32.436 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:22:32.470 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:32.492 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:22:32.497 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:32.497 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:22:32.598 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:22:32.632 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:32.655 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:22:32.657 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:32.658 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:22:32.758 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:22:32.780 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is set 2024-02-10T08:22:32.826 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:33.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:22:32.044238+0000 mon.c (mon.2) 34 : audit [INF] from='client.? 172.21.15.18:0/2931896869' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:22:33.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:22:32.044551+0000 mon.a (mon.0) 962 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:22:33.080 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:22:33.087 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:33.088 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:22:33.088 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:22:32.044238+0000 mon.c (mon.2) 34 : audit [INF] from='client.? 172.21.15.18:0/2931896869' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:22:33.088 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:22:32.044551+0000 mon.a (mon.0) 962 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:22:33.088 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:22:32.044238+0000 mon.c (mon.2) 34 : audit [INF] from='client.? 172.21.15.18:0/2931896869' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:22:33.088 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:22:32.044551+0000 mon.a (mon.0) 962 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:22:33.189 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:22:33.252 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:33.723 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:22:33.737 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:33.738 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:22:33.839 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:22:33.937 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:34.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:32.611290+0000 mgr.y (mgr.14505) 220 : cluster [DBG] pgmap v244: 158 pgs: 1 peering, 1 active+recovering+undersized+degraded+remapped, 2 active+undersized+degraded+remapped+backfilling, 154 active+clean; 3.3 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 1009 B/s rd, 0 B/s wr, 569 op/s; 10333/161724 objects degraded (6.389%); 9.2 MiB/s, 147 objects/s recovering 2024-02-10T08:22:34.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:32.724508+0000 mon.a (mon.0) 963 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:22:34.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:22:32.745385+0000 mon.a (mon.0) 964 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-10T08:22:34.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:32.745443+0000 mon.a (mon.0) 965 : cluster [DBG] osdmap e148: 8 total, 8 up, 8 in 2024-02-10T08:22:34.052 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:22:34.058 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:34.059 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:22:34.059 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:32.611290+0000 mgr.y (mgr.14505) 220 : cluster [DBG] pgmap v244: 158 pgs: 1 peering, 1 active+recovering+undersized+degraded+remapped, 2 active+undersized+degraded+remapped+backfilling, 154 active+clean; 3.3 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 1009 B/s rd, 0 B/s wr, 569 op/s; 10333/161724 objects degraded (6.389%); 9.2 MiB/s, 147 objects/s recovering 2024-02-10T08:22:34.059 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:32.724508+0000 mon.a (mon.0) 963 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:22:34.059 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:22:32.745385+0000 mon.a (mon.0) 964 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-10T08:22:34.060 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:32.745443+0000 mon.a (mon.0) 965 : cluster [DBG] osdmap e148: 8 total, 8 up, 8 in 2024-02-10T08:22:34.060 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:32.611290+0000 mgr.y (mgr.14505) 220 : cluster [DBG] pgmap v244: 158 pgs: 1 peering, 1 active+recovering+undersized+degraded+remapped, 2 active+undersized+degraded+remapped+backfilling, 154 active+clean; 3.3 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 1009 B/s rd, 0 B/s wr, 569 op/s; 10333/161724 objects degraded (6.389%); 9.2 MiB/s, 147 objects/s recovering 2024-02-10T08:22:34.060 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:32.724508+0000 mon.a (mon.0) 963 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:22:34.060 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:22:32.745385+0000 mon.a (mon.0) 964 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-10T08:22:34.060 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:32.745443+0000 mon.a (mon.0) 965 : cluster [DBG] osdmap e148: 8 total, 8 up, 8 in 2024-02-10T08:22:34.160 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:22:34.196 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:34.218 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:22:34.221 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:34.221 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:22:34.322 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:22:34.352 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:34.377 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:22:34.381 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:34.381 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:22:34.416 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:22:34.474 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-02-10T08:22:34.474 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-02-10T08:22:34.474 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:34.474 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop_reply(client.14784.0:151006 7.4 e148/146)", 2024-02-10T08:22:34.475 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:22:34.462219+0000", 2024-02-10T08:22:34.475 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.01065091, 2024-02-10T08:22:34.475 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.01067968, 2024-02-10T08:22:34.475 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:22:34.475 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "queued for pg", 2024-02-10T08:22:34.475 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:22:34.475 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:34.475 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:22:34.475 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:34.462219+0000", 2024-02-10T08:22:34.475 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:22:34.475 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:34.475 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:34.475 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:22:34.475 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:34.462219+0000", 2024-02-10T08:22:34.476 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:22:34.476 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:34.476 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:34.476 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:22:34.476 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:34.462218+0000", 2024-02-10T08:22:34.476 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8620000000000003e-06 2024-02-10T08:22:34.476 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:34.476 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:34.476 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:22:34.476 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:34.462226+0000", 2024-02-10T08:22:34.476 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2852e-05 2024-02-10T08:22:34.476 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:34.476 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:34.476 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:22:34.477 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:34.462239+0000", 2024-02-10T08:22:34.477 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9099999999999999e-06 2024-02-10T08:22:34.477 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:34.477 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:34.477 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:22:34.477 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:34.462246+0000", 2024-02-10T08:22:34.477 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.65e-05 2024-02-10T08:22:34.477 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:22:34.477 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:22:34.477 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:22:34.477 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:34.477 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:34.477 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop_reply(client.14784.0:151010 7.9 e148/111 ondisk, result = 0)", 2024-02-10T08:22:34.477 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:22:34.471067+0000", 2024-02-10T08:22:34.478 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.001803416, 2024-02-10T08:22:34.478 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0018995430000000001, 2024-02-10T08:22:34.478 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:22:34.478 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-02-10T08:22:34.478 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:22:34.478 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:34.478 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:22:34.478 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:34.471067+0000", 2024-02-10T08:22:34.478 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:22:34.478 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:34.478 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:34.478 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:22:34.478 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:34.471067+0000", 2024-02-10T08:22:34.478 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:22:34.478 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:34.479 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:34.479 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:22:34.479 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:34.471066+0000", 2024-02-10T08:22:34.479 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0711e-05 2024-02-10T08:22:34.479 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:34.479 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:34.479 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:22:34.479 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:34.471076+0000", 2024-02-10T08:22:34.479 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4283e-05 2024-02-10T08:22:34.479 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:34.479 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:34.479 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:22:34.479 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:34.471091+0000", 2024-02-10T08:22:34.479 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9149999999999999e-06 2024-02-10T08:22:34.480 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:34.480 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:34.480 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:22:34.480 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:34.471097+0000", 2024-02-10T08:22:34.480 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3623e-05 2024-02-10T08:22:34.480 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:34.480 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:34.480 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:22:34.480 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:34.471131+0000", 2024-02-10T08:22:34.480 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0890000000000006e-06 2024-02-10T08:22:34.480 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:34.480 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:34.480 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:22:34.480 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:34.471140+0000", 2024-02-10T08:22:34.481 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3602000000000004e-05 2024-02-10T08:22:34.481 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:22:34.481 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:22:34.481 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:22:34.481 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:34.481 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:34.481 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:151006 7.4 7:230746e1:::benchmark_data_smithi018_80623_object50078:head [delete] snapc 0=[] ondisk+write+known_if_redirected e148)", 2024-02-10T08:22:34.481 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:22:34.440383+0000", 2024-02-10T08:22:34.481 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.032486776000000002, 2024-02-10T08:22:34.481 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.032683522999999999, 2024-02-10T08:22:34.481 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:22:34.481 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "waiting for sub ops", 2024-02-10T08:22:34.481 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:22:34.481 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:22:34.481 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:22:34.482 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 151006 2024-02-10T08:22:34.482 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:34.482 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:22:34.482 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:34.482 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:22:34.482 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:34.440383+0000", 2024-02-10T08:22:34.482 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:22:34.482 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:34.482 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:34.482 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:22:34.482 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:34.440383+0000", 2024-02-10T08:22:34.482 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999976 2024-02-10T08:22:34.482 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:34.482 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:34.483 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:22:34.483 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:34.440381+0000", 2024-02-10T08:22:34.483 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6809999999999993e-06 2024-02-10T08:22:34.483 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:34.483 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:34.483 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:22:34.483 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:34.440390+0000", 2024-02-10T08:22:34.483 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2211999999999999e-05 2024-02-10T08:22:34.483 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:34.483 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:34.483 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:22:34.483 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:34.440403+0000", 2024-02-10T08:22:34.483 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1860000000000003e-06 2024-02-10T08:22:34.483 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:34.484 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:34.484 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:22:34.484 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:34.440410+0000", 2024-02-10T08:22:34.484 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0424999999999999e-05 2024-02-10T08:22:34.484 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:34.484 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:34.484 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:22:34.484 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:34.440460+0000", 2024-02-10T08:22:34.484 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011379600000000001 2024-02-10T08:22:34.484 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:34.484 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:34.484 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:22:34.484 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:34.440574+0000", 2024-02-10T08:22:34.484 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013736 2024-02-10T08:22:34.484 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:34.485 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:34.485 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1,4", 2024-02-10T08:22:34.485 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:34.440711+0000", 2024-02-10T08:22:34.485 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0032542410000000002 2024-02-10T08:22:34.485 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:34.485 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:34.485 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:22:34.485 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:34.443966+0000", 2024-02-10T08:22:34.485 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0077259929999999996 2024-02-10T08:22:34.485 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:34.485 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:34.485 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:22:34.485 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:34.451692+0000", 2024-02-10T08:22:34.485 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011308336 2024-02-10T08:22:34.486 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:22:34.486 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:22:34.486 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:22:34.486 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:34.486 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:34.486 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:151010 7.9 7:989f0aba:::benchmark_data_smithi018_80623_object50082:head [delete] snapc 0=[] ondisk+write+known_if_redirected e148)", 2024-02-10T08:22:34.486 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:22:34.443862+0000", 2024-02-10T08:22:34.486 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.029007591999999999, 2024-02-10T08:22:34.486 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.029314115000000002, 2024-02-10T08:22:34.486 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:22:34.486 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:22:34.486 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:22:34.486 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:22:34.486 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:22:34.486 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 151010 2024-02-10T08:22:34.487 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:34.487 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:22:34.487 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:34.487 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:22:34.487 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:34.443862+0000", 2024-02-10T08:22:34.487 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:22:34.487 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:34.487 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:34.487 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:22:34.487 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:34.443862+0000", 2024-02-10T08:22:34.487 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999976 2024-02-10T08:22:34.487 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:34.487 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:34.487 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:22:34.488 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:34.443860+0000", 2024-02-10T08:22:34.488 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1439999999999992e-06 2024-02-10T08:22:34.488 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:34.488 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:34.488 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:22:34.488 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:34.443869+0000", 2024-02-10T08:22:34.488 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3936e-05 2024-02-10T08:22:34.488 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:34.488 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:34.488 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:22:34.488 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:34.443883+0000", 2024-02-10T08:22:34.488 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0739999999999993e-06 2024-02-10T08:22:34.488 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:34.489 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:34.489 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:22:34.489 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:34.443891+0000", 2024-02-10T08:22:34.489 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0097464679999999995 2024-02-10T08:22:34.489 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:34.489 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:34.489 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:22:34.489 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:34.453638+0000", 2024-02-10T08:22:34.489 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2428000000000003e-05 2024-02-10T08:22:34.489 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:34.489 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:34.489 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:22:34.489 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:34.453730+0000", 2024-02-10T08:22:34.489 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010216400000000001 2024-02-10T08:22:34.489 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:34.490 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:34.490 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1,4", 2024-02-10T08:22:34.490 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:34.453832+0000", 2024-02-10T08:22:34.490 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0028654420000000002 2024-02-10T08:22:34.490 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:34.490 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:34.490 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:22:34.490 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:34.456698+0000", 2024-02-10T08:22:34.490 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0075343909999999997 2024-02-10T08:22:34.490 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:34.490 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:34.490 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:22:34.490 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:34.464232+0000", 2024-02-10T08:22:34.490 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0069157589999999996 2024-02-10T08:22:34.490 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:34.491 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:34.491 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:22:34.491 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:34.471148+0000", 2024-02-10T08:22:34.491 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9539000000000001e-05 2024-02-10T08:22:34.491 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:22:34.491 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:22:34.491 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:22:34.491 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:34.471197+0000", 2024-02-10T08:22:34.491 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.027334896000000001 2024-02-10T08:22:34.491 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:22:34.491 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:22:34.491 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:22:34.491 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:22:34.491 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-02-10T08:22:34.492 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 4 2024-02-10T08:22:34.492 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-02-10T08:22:34.492 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:22:34.521 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:34.546 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:22:34.548 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:34.549 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:22:34.650 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:22:34.718 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:34.883 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-10T08:22:34.891 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:22:34.898 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:34.899 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:22:35.000 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:22:35.030 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:35.052 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:22:35.058 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:35.059 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:22:35.160 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:22:35.189 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:35.209 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:22:35.211 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:35.211 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:22:35.312 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:22:35.403 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:35.759 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd set nodeep-scrub 2024-02-10T08:22:35.853 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.0 dump_blocked_ops 2024-02-10T08:22:35.882 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:22:35.894 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:35.895 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:22:35.995 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:22:36.022 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:34.611818+0000 mgr.y (mgr.14505) 221 : cluster [DBG] pgmap v246: 158 pgs: 1 active+recovering+undersized+degraded+remapped, 2 active+undersized+degraded+remapped+backfilling, 155 active+clean; 3.2 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 740 B/s rd, 0 B/s wr, 551 op/s; 8866/157017 objects degraded (5.647%); 20 MiB/s, 326 objects/s recovering 2024-02-10T08:22:36.022 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:35.504438+0000 mon.a (mon.0) 966 : cluster [WRN] Health check update: Degraded data redundancy: 8866/157017 objects degraded (5.647%), 3 pgs degraded, 2 pgs undersized (PG_DEGRADED) 2024-02-10T08:22:36.022 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:35.513193+0000 mon.a (mon.0) 967 : cluster [DBG] osdmap e149: 8 total, 8 up, 8 in 2024-02-10T08:22:36.024 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:36.038 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:34.611818+0000 mgr.y (mgr.14505) 221 : cluster [DBG] pgmap v246: 158 pgs: 1 active+recovering+undersized+degraded+remapped, 2 active+undersized+degraded+remapped+backfilling, 155 active+clean; 3.2 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 740 B/s rd, 0 B/s wr, 551 op/s; 8866/157017 objects degraded (5.647%); 20 MiB/s, 326 objects/s recovering 2024-02-10T08:22:36.038 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:35.504438+0000 mon.a (mon.0) 966 : cluster [WRN] Health check update: Degraded data redundancy: 8866/157017 objects degraded (5.647%), 3 pgs degraded, 2 pgs undersized (PG_DEGRADED) 2024-02-10T08:22:36.038 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:35.513193+0000 mon.a (mon.0) 967 : cluster [DBG] osdmap e149: 8 total, 8 up, 8 in 2024-02-10T08:22:36.039 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:34.611818+0000 mgr.y (mgr.14505) 221 : cluster [DBG] pgmap v246: 158 pgs: 1 active+recovering+undersized+degraded+remapped, 2 active+undersized+degraded+remapped+backfilling, 155 active+clean; 3.2 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 740 B/s rd, 0 B/s wr, 551 op/s; 8866/157017 objects degraded (5.647%); 20 MiB/s, 326 objects/s recovering 2024-02-10T08:22:36.039 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:35.504438+0000 mon.a (mon.0) 966 : cluster [WRN] Health check update: Degraded data redundancy: 8866/157017 objects degraded (5.647%), 3 pgs degraded, 2 pgs undersized (PG_DEGRADED) 2024-02-10T08:22:36.039 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:35.513193+0000 mon.a (mon.0) 967 : cluster [DBG] osdmap e149: 8 total, 8 up, 8 in 2024-02-10T08:22:36.046 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:22:36.051 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:36.051 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:22:36.152 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:22:36.181 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:36.201 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:22:36.205 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:36.205 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:22:36.306 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:22:36.377 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:36.413 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:22:36.420 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:36.420 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:22:36.521 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:22:36.579 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:36.789 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:22:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:22:36] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:22:37.409 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:22:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:22:37] "GET /metrics HTTP/1.1" 200 175614 "" "Prometheus/2.33.4" 2024-02-10T08:22:38.039 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:22:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:22:38.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:36.616479+0000 mgr.y (mgr.14505) 222 : cluster [DBG] pgmap v248: 158 pgs: 1 active+recovering+undersized+degraded+remapped, 2 active+undersized+degraded+remapped+backfilling, 155 active+clean; 3.2 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 647 B/s rd, 0 B/s wr, 401 op/s; 8866/157017 objects degraded (5.647%); 11 MiB/s, 176 objects/s recovering 2024-02-10T08:22:38.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:36.616479+0000 mgr.y (mgr.14505) 222 : cluster [DBG] pgmap v248: 158 pgs: 1 active+recovering+undersized+degraded+remapped, 2 active+undersized+degraded+remapped+backfilling, 155 active+clean; 3.2 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 647 B/s rd, 0 B/s wr, 401 op/s; 8866/157017 objects degraded (5.647%); 11 MiB/s, 176 objects/s recovering 2024-02-10T08:22:38.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:36.616479+0000 mgr.y (mgr.14505) 222 : cluster [DBG] pgmap v248: 158 pgs: 1 active+recovering+undersized+degraded+remapped, 2 active+undersized+degraded+remapped+backfilling, 155 active+clean; 3.2 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 647 B/s rd, 0 B/s wr, 401 op/s; 8866/157017 objects degraded (5.647%); 11 MiB/s, 176 objects/s recovering 2024-02-10T08:22:39.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:22:37.774217+0000 mgr.y (mgr.14505) 223 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:22:39.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:22:37.774217+0000 mgr.y (mgr.14505) 223 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:22:39.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:22:37.774217+0000 mgr.y (mgr.14505) 223 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:22:40.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:38.617319+0000 mgr.y (mgr.14505) 224 : cluster [DBG] pgmap v249: 158 pgs: 1 active+recovering+undersized+degraded+remapped, 2 active+undersized+degraded+remapped+backfilling, 155 active+clean; 3.0 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 839 op/s; 7527/146403 objects degraded (5.141%); 19 MiB/s, 304 objects/s recovering 2024-02-10T08:22:40.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:38.617319+0000 mgr.y (mgr.14505) 224 : cluster [DBG] pgmap v249: 158 pgs: 1 active+recovering+undersized+degraded+remapped, 2 active+undersized+degraded+remapped+backfilling, 155 active+clean; 3.0 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 839 op/s; 7527/146403 objects degraded (5.141%); 19 MiB/s, 304 objects/s recovering 2024-02-10T08:22:40.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:38.617319+0000 mgr.y (mgr.14505) 224 : cluster [DBG] pgmap v249: 158 pgs: 1 active+recovering+undersized+degraded+remapped, 2 active+undersized+degraded+remapped+backfilling, 155 active+clean; 3.0 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 839 op/s; 7527/146403 objects degraded (5.141%); 19 MiB/s, 304 objects/s recovering 2024-02-10T08:22:41.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:40.506511+0000 mon.a (mon.0) 968 : cluster [WRN] Health check update: Degraded data redundancy: 7527/146403 objects degraded (5.141%), 3 pgs degraded, 2 pgs undersized (PG_DEGRADED) 2024-02-10T08:22:41.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:40.506511+0000 mon.a (mon.0) 968 : cluster [WRN] Health check update: Degraded data redundancy: 7527/146403 objects degraded (5.141%), 3 pgs degraded, 2 pgs undersized (PG_DEGRADED) 2024-02-10T08:22:41.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:40.506511+0000 mon.a (mon.0) 968 : cluster [WRN] Health check update: Degraded data redundancy: 7527/146403 objects degraded (5.141%), 3 pgs degraded, 2 pgs undersized (PG_DEGRADED) 2024-02-10T08:22:42.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:40.617963+0000 mgr.y (mgr.14505) 225 : cluster [DBG] pgmap v250: 158 pgs: 1 active+recovering+undersized+degraded+remapped, 2 active+undersized+degraded+remapped+backfilling, 155 active+clean; 3.0 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 638 op/s; 7527/146403 objects degraded (5.141%); 19 MiB/s, 296 objects/s recovering 2024-02-10T08:22:42.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:40.803186+0000 osd.3 (osd.3) 89 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:22:42.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:40.803238+0000 osd.3 (osd.3) 90 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:22:42.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:41.585548+0000 mon.a (mon.0) 969 : cluster [DBG] osdmap e150: 8 total, 8 up, 8 in 2024-02-10T08:22:42.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:40.617963+0000 mgr.y (mgr.14505) 225 : cluster [DBG] pgmap v250: 158 pgs: 1 active+recovering+undersized+degraded+remapped, 2 active+undersized+degraded+remapped+backfilling, 155 active+clean; 3.0 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 638 op/s; 7527/146403 objects degraded (5.141%); 19 MiB/s, 296 objects/s recovering 2024-02-10T08:22:42.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:40.803186+0000 osd.3 (osd.3) 89 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:22:42.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:40.803238+0000 osd.3 (osd.3) 90 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:22:42.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:41.585548+0000 mon.a (mon.0) 969 : cluster [DBG] osdmap e150: 8 total, 8 up, 8 in 2024-02-10T08:22:42.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:41 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:40.617963+0000 mgr.y (mgr.14505) 225 : cluster [DBG] pgmap v250: 158 pgs: 1 active+recovering+undersized+degraded+remapped, 2 active+undersized+degraded+remapped+backfilling, 155 active+clean; 3.0 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 638 op/s; 7527/146403 objects degraded (5.141%); 19 MiB/s, 296 objects/s recovering 2024-02-10T08:22:42.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:41 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:40.803186+0000 osd.3 (osd.3) 89 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:22:42.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:41 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:40.803238+0000 osd.3 (osd.3) 90 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:22:42.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:41 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:41.585548+0000 mon.a (mon.0) 969 : cluster [DBG] osdmap e150: 8 total, 8 up, 8 in 2024-02-10T08:22:42.484 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:22:42.521 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:22:42.529 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:42.529 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:22:42.630 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:22:42.676 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:22:42.726 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:44.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:42.619609+0000 mgr.y (mgr.14505) 226 : cluster [DBG] pgmap v252: 158 pgs: 1 active+recovering+undersized+degraded+remapped, 2 active+undersized+degraded+remapped+backfilling, 155 active+clean; 2.9 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 646 op/s; 7527/141525 objects degraded (5.318%); 8.1 MiB/s, 129 objects/s recovering 2024-02-10T08:22:44.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:42.884874+0000 mon.a (mon.0) 970 : cluster [DBG] osdmap e151: 8 total, 8 up, 8 in 2024-02-10T08:22:44.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:42.619609+0000 mgr.y (mgr.14505) 226 : cluster [DBG] pgmap v252: 158 pgs: 1 active+recovering+undersized+degraded+remapped, 2 active+undersized+degraded+remapped+backfilling, 155 active+clean; 2.9 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 646 op/s; 7527/141525 objects degraded (5.318%); 8.1 MiB/s, 129 objects/s recovering 2024-02-10T08:22:44.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:42.884874+0000 mon.a (mon.0) 970 : cluster [DBG] osdmap e151: 8 total, 8 up, 8 in 2024-02-10T08:22:44.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:43 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:42.619609+0000 mgr.y (mgr.14505) 226 : cluster [DBG] pgmap v252: 158 pgs: 1 active+recovering+undersized+degraded+remapped, 2 active+undersized+degraded+remapped+backfilling, 155 active+clean; 2.9 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 646 op/s; 7527/141525 objects degraded (5.318%); 8.1 MiB/s, 129 objects/s recovering 2024-02-10T08:22:44.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:43 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:42.884874+0000 mon.a (mon.0) 970 : cluster [DBG] osdmap e151: 8 total, 8 up, 8 in 2024-02-10T08:22:45.134 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:22:45.145 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:45.145 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:22:45.146 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:43.889739+0000 mon.a (mon.0) 971 : cluster [DBG] osdmap e152: 8 total, 8 up, 8 in 2024-02-10T08:22:45.147 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:43.889739+0000 mon.a (mon.0) 971 : cluster [DBG] osdmap e152: 8 total, 8 up, 8 in 2024-02-10T08:22:45.246 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:22:45.277 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:44 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:43.889739+0000 mon.a (mon.0) 971 : cluster [DBG] osdmap e152: 8 total, 8 up, 8 in 2024-02-10T08:22:45.277 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:45.302 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:22:45.307 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:45.307 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:22:45.408 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:22:45.464 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:45.616 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:22:45.618 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:45.619 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:22:45.720 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:22:45.751 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:45.774 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:22:45.777 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:45.778 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:22:45.879 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:22:45.899 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:44.620126+0000 mgr.y (mgr.14505) 227 : cluster [DBG] pgmap v255: 158 pgs: 1 active+undersized+remapped, 1 active+recovering+undersized+degraded+remapped, 1 active+undersized+degraded+remapped+backfilling, 155 active+clean; 2.7 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 616 op/s; 6352/135312 objects degraded (4.694%); 9.7 MiB/s, 155 objects/s recovering 2024-02-10T08:22:45.900 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:44.847739+0000 osd.6 (osd.6) 49 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:22:45.900 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:44.847783+0000 osd.6 (osd.6) 50 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:22:45.900 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:44.943258+0000 mon.a (mon.0) 972 : cluster [DBG] osdmap e153: 8 total, 8 up, 8 in 2024-02-10T08:22:45.900 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:45.509412+0000 mon.a (mon.0) 973 : cluster [WRN] Health check update: Degraded data redundancy: 6352/135312 objects degraded (4.694%), 2 pgs degraded, 2 pgs undersized (PG_DEGRADED) 2024-02-10T08:22:45.901 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:44.620126+0000 mgr.y (mgr.14505) 227 : cluster [DBG] pgmap v255: 158 pgs: 1 active+undersized+remapped, 1 active+recovering+undersized+degraded+remapped, 1 active+undersized+degraded+remapped+backfilling, 155 active+clean; 2.7 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 616 op/s; 6352/135312 objects degraded (4.694%); 9.7 MiB/s, 155 objects/s recovering 2024-02-10T08:22:45.901 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:44.847739+0000 osd.6 (osd.6) 49 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:22:45.901 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:44.847783+0000 osd.6 (osd.6) 50 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:22:45.901 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:44.943258+0000 mon.a (mon.0) 972 : cluster [DBG] osdmap e153: 8 total, 8 up, 8 in 2024-02-10T08:22:45.901 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:45.509412+0000 mon.a (mon.0) 973 : cluster [WRN] Health check update: Degraded data redundancy: 6352/135312 objects degraded (4.694%), 2 pgs degraded, 2 pgs undersized (PG_DEGRADED) 2024-02-10T08:22:45.959 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:46.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:44.620126+0000 mgr.y (mgr.14505) 227 : cluster [DBG] pgmap v255: 158 pgs: 1 active+undersized+remapped, 1 active+recovering+undersized+degraded+remapped, 1 active+undersized+degraded+remapped+backfilling, 155 active+clean; 2.7 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 616 op/s; 6352/135312 objects degraded (4.694%); 9.7 MiB/s, 155 objects/s recovering 2024-02-10T08:22:46.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:44.847739+0000 osd.6 (osd.6) 49 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:22:46.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:44.847783+0000 osd.6 (osd.6) 50 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:22:46.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:44.943258+0000 mon.a (mon.0) 972 : cluster [DBG] osdmap e153: 8 total, 8 up, 8 in 2024-02-10T08:22:46.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:45.509412+0000 mon.a (mon.0) 973 : cluster [WRN] Health check update: Degraded data redundancy: 6352/135312 objects degraded (4.694%), 2 pgs degraded, 2 pgs undersized (PG_DEGRADED) 2024-02-10T08:22:46.789 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:22:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:22:46] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:22:46.854 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:22:46.862 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:46.863 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:22:46.964 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:22:47.022 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:47.148 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:22:47.155 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:47.155 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:22:47.156 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:22:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:22:47] "GET /metrics HTTP/1.1" 200 175633 "" "Prometheus/2.33.4" 2024-02-10T08:22:47.256 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:22:47.285 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:47.307 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:22:47.310 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:47.310 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:22:47.411 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:22:47.456 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:22:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:22:47.449+0000 7f52f8ade700 -1 mgr.server reply reply (2) No such file or directory no change 2024-02-10T08:22:47.457 INFO:teuthology.orchestra.run.smithi018.stdout:moved 32 / 474 (6.75105%) 2024-02-10T08:22:47.458 INFO:teuthology.orchestra.run.smithi018.stdout:avg 59.25 2024-02-10T08:22:47.458 INFO:teuthology.orchestra.run.smithi018.stdout:stddev 5.16599 -> 8.56957 (expected baseline 7.20026) 2024-02-10T08:22:47.458 INFO:teuthology.orchestra.run.smithi018.stdout:min osd.2 with 52 -> 60 pgs (0.877637 -> 1.01266 * mean) 2024-02-10T08:22:47.458 INFO:teuthology.orchestra.run.smithi018.stdout:max osd.3 with 66 -> 50 pgs (1.11392 -> 0.843882 * mean) 2024-02-10T08:22:47.458 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:22:47.458 INFO:teuthology.orchestra.run.smithi018.stdout:oload 110 2024-02-10T08:22:47.458 INFO:teuthology.orchestra.run.smithi018.stdout:max_change 3 2024-02-10T08:22:47.458 INFO:teuthology.orchestra.run.smithi018.stdout:max_change_osds 4 2024-02-10T08:22:47.458 INFO:teuthology.orchestra.run.smithi018.stdout:average_utilization 0.0145 2024-02-10T08:22:47.458 INFO:teuthology.orchestra.run.smithi018.stdout:overload_utilization 0.0159 2024-02-10T08:22:47.458 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3 weight 1.0000 -> 0.7020 2024-02-10T08:22:47.458 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0 weight 1.0000 -> 0.7816 2024-02-10T08:22:47.480 INFO:teuthology.orchestra.run.smithi018.stderr:no change 2024-02-10T08:22:47.500 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:47.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:46.622120+0000 mgr.y (mgr.14505) 228 : cluster [DBG] pgmap v257: 158 pgs: 1 active+undersized+remapped, 1 active+recovering+undersized+degraded+remapped, 1 active+undersized+degraded+remapped+backfilling, 155 active+clean; 2.7 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 1016 B/s rd, 0 B/s wr, 735 op/s; 6352/135312 objects degraded (4.694%); 12 MiB/s, 185 objects/s recovering 2024-02-10T08:22:47.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:22:46.648796+0000 mon.a (mon.0) 974 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:22:47.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:46.622120+0000 mgr.y (mgr.14505) 228 : cluster [DBG] pgmap v257: 158 pgs: 1 active+undersized+remapped, 1 active+recovering+undersized+degraded+remapped, 1 active+undersized+degraded+remapped+backfilling, 155 active+clean; 2.7 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 1016 B/s rd, 0 B/s wr, 735 op/s; 6352/135312 objects degraded (4.694%); 12 MiB/s, 185 objects/s recovering 2024-02-10T08:22:47.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:22:46.648796+0000 mon.a (mon.0) 974 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:22:48.039 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:22:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:22:48.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:46.622120+0000 mgr.y (mgr.14505) 228 : cluster [DBG] pgmap v257: 158 pgs: 1 active+undersized+remapped, 1 active+recovering+undersized+degraded+remapped, 1 active+undersized+degraded+remapped+backfilling, 155 active+clean; 2.7 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 1016 B/s rd, 0 B/s wr, 735 op/s; 6352/135312 objects degraded (4.694%); 12 MiB/s, 185 objects/s recovering 2024-02-10T08:22:48.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:22:46.648796+0000 mon.a (mon.0) 974 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:22:48.317 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:22:48.317 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:22:48.322 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:48.323 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:22:48.424 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:22:48.452 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:48.475 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:22:48.479 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:48.480 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:22:48.580 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:22:48.681 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:48.709 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:22:48.754 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:22:48.766 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:22:48.774 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:48.775 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:22:48.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:22:47.449369+0000 mgr.y (mgr.14505) 229 : audit [DBG] from='client.24815 -' entity='client.admin' cmd=[{"prefix": "osd test-reweight-by-utilization", "oload": 110, "max_change": 3.0, "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:22:48.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:22:47.787405+0000 mgr.y (mgr.14505) 230 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:22:48.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:22:48.660376+0000 mon.b (mon.1) 49 : audit [DBG] from='client.? 172.21.15.18:0/2145644552' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:22:48.796 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:22:48.849 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:22:48.876 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:22:48.877 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:22:48.919 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:22:47.449369+0000 mgr.y (mgr.14505) 229 : audit [DBG] from='client.24815 -' entity='client.admin' cmd=[{"prefix": "osd test-reweight-by-utilization", "oload": 110, "max_change": 3.0, "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:22:48.919 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:22:47.787405+0000 mgr.y (mgr.14505) 230 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:22:48.919 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:22:48.660376+0000 mon.b (mon.1) 49 : audit [DBG] from='client.? 172.21.15.18:0/2145644552' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:22:48.920 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:22:47.449369+0000 mgr.y (mgr.14505) 229 : audit [DBG] from='client.24815 -' entity='client.admin' cmd=[{"prefix": "osd test-reweight-by-utilization", "oload": 110, "max_change": 3.0, "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:22:48.920 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:22:47.787405+0000 mgr.y (mgr.14505) 230 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:22:48.920 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:22:48.660376+0000 mon.b (mon.1) 49 : audit [DBG] from='client.? 172.21.15.18:0/2145644552' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:22:48.929 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:22:48.961 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:48.983 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:22:49.012 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:22:49.020 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-10T08:22:49.020 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-10T08:22:49.020 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-10T08:22:49.020 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-10T08:22:49.020 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-10T08:22:49.020 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-10T08:22:49.020 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-10T08:22:49.020 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-10T08:22:49.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:48.624746+0000 mgr.y (mgr.14505) 231 : cluster [DBG] pgmap v258: 158 pgs: 1 active+recovering+undersized+degraded+remapped, 1 active+undersized+degraded+remapped+backfilling, 156 active+clean; 2.5 GiB data, 9.8 GiB used, 705 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 886 op/s; 6063/125562 objects degraded (4.829%); 11 MiB/s, 175 objects/s recovering 2024-02-10T08:22:49.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:48.624746+0000 mgr.y (mgr.14505) 231 : cluster [DBG] pgmap v258: 158 pgs: 1 active+recovering+undersized+degraded+remapped, 1 active+undersized+degraded+remapped+backfilling, 156 active+clean; 2.5 GiB data, 9.8 GiB used, 705 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 886 op/s; 6063/125562 objects degraded (4.829%); 11 MiB/s, 175 objects/s recovering 2024-02-10T08:22:50.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:49 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:48.624746+0000 mgr.y (mgr.14505) 231 : cluster [DBG] pgmap v258: 158 pgs: 1 active+recovering+undersized+degraded+remapped, 1 active+undersized+degraded+remapped+backfilling, 156 active+clean; 2.5 GiB data, 9.8 GiB used, 705 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 886 op/s; 6063/125562 objects degraded (4.829%); 11 MiB/s, 175 objects/s recovering 2024-02-10T08:22:50.573 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '110', 'type': 'test-reweight-by-utilization'} 2024-02-10T08:22:50.573 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd test-reweight-by-utilization 110 0.05 2024-02-10T08:22:50.773 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:22:50.781 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:50.781 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:22:50.882 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:22:50.899 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:50.510407+0000 mon.a (mon.0) 975 : cluster [WRN] Health check update: Degraded data redundancy: 6063/125562 objects degraded (4.829%), 2 pgs degraded, 2 pgs undersized (PG_DEGRADED) 2024-02-10T08:22:50.899 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:50.510407+0000 mon.a (mon.0) 975 : cluster [WRN] Health check update: Degraded data redundancy: 6063/125562 objects degraded (4.829%), 2 pgs degraded, 2 pgs undersized (PG_DEGRADED) 2024-02-10T08:22:50.911 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:50.932 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:22:50.934 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:50.935 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:22:51.035 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:22:51.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:50.510407+0000 mon.a (mon.0) 975 : cluster [WRN] Health check update: Degraded data redundancy: 6063/125562 objects degraded (4.829%), 2 pgs degraded, 2 pgs undersized (PG_DEGRADED) 2024-02-10T08:22:51.063 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:51.091 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:22:51.095 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:51.095 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:22:51.196 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:22:51.292 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:52.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:51 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:50.625298+0000 mgr.y (mgr.14505) 232 : cluster [DBG] pgmap v259: 158 pgs: 1 active+recovering+undersized+degraded+remapped, 1 active+undersized+degraded+remapped+backfilling, 156 active+clean; 2.5 GiB data, 9.8 GiB used, 705 GiB / 715 GiB avail; 661 B/s rd, 0 B/s wr, 541 op/s; 6063/125562 objects degraded (4.829%); 1.4 MiB/s, 22 objects/s recovering 2024-02-10T08:22:52.115 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-10T08:22:52.159 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:50.625298+0000 mgr.y (mgr.14505) 232 : cluster [DBG] pgmap v259: 158 pgs: 1 active+recovering+undersized+degraded+remapped, 1 active+undersized+degraded+remapped+backfilling, 156 active+clean; 2.5 GiB data, 9.8 GiB used, 705 GiB / 715 GiB avail; 661 B/s rd, 0 B/s wr, 541 op/s; 6063/125562 objects degraded (4.829%); 1.4 MiB/s, 22 objects/s recovering 2024-02-10T08:22:52.165 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:50.625298+0000 mgr.y (mgr.14505) 232 : cluster [DBG] pgmap v259: 158 pgs: 1 active+recovering+undersized+degraded+remapped, 1 active+undersized+degraded+remapped+backfilling, 156 active+clean; 2.5 GiB data, 9.8 GiB used, 705 GiB / 715 GiB avail; 661 B/s rd, 0 B/s wr, 541 op/s; 6063/125562 objects degraded (4.829%); 1.4 MiB/s, 22 objects/s recovering 2024-02-10T08:22:52.186 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:22:52.192 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:52.192 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:22:52.293 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:22:52.321 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:52.346 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:22:52.350 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:52.350 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:22:52.452 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:22:52.515 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:52.985 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-02-10T08:22:52.985 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:22:53.288 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:22:53.294 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:53.294 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:22:53.395 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:22:53.424 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:53.447 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:22:53.451 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:53.451 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:22:53.552 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:22:53.586 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:53.606 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:22:53.609 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:53.609 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:22:53.710 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:22:53.740 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:53.762 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:22:53.764 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:53.765 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:22:53.765 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is set 2024-02-10T08:22:53.866 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:22:53.894 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:53.915 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:22:53.919 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:53.920 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:22:54.004 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.0 dump_historic_ops 2024-02-10T08:22:54.021 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:22:54.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:53 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:52.629749+0000 mgr.y (mgr.14505) 233 : cluster [DBG] pgmap v260: 158 pgs: 1 active+recovering+undersized+degraded+remapped, 1 active+undersized+degraded+remapped+backfilling, 156 active+clean; 2.4 GiB data, 9.5 GiB used, 706 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 560 op/s; 6063/120645 objects degraded (5.025%); 849 KiB/s, 13 objects/s recovering 2024-02-10T08:22:54.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:53 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:22:53.199067+0000 mon.b (mon.1) 50 : audit [INF] from='client.? 172.21.15.18:0/3170189889' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:22:54.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:53 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:22:53.199499+0000 mon.a (mon.0) 976 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:22:54.087 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:52.629749+0000 mgr.y (mgr.14505) 233 : cluster [DBG] pgmap v260: 158 pgs: 1 active+recovering+undersized+degraded+remapped, 1 active+undersized+degraded+remapped+backfilling, 156 active+clean; 2.4 GiB data, 9.5 GiB used, 706 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 560 op/s; 6063/120645 objects degraded (5.025%); 849 KiB/s, 13 objects/s recovering 2024-02-10T08:22:54.087 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:22:53.199067+0000 mon.b (mon.1) 50 : audit [INF] from='client.? 172.21.15.18:0/3170189889' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:22:54.087 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:22:53.199499+0000 mon.a (mon.0) 976 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:22:54.088 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:52.629749+0000 mgr.y (mgr.14505) 233 : cluster [DBG] pgmap v260: 158 pgs: 1 active+recovering+undersized+degraded+remapped, 1 active+undersized+degraded+remapped+backfilling, 156 active+clean; 2.4 GiB data, 9.5 GiB used, 706 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 560 op/s; 6063/120645 objects degraded (5.025%); 849 KiB/s, 13 objects/s recovering 2024-02-10T08:22:54.088 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:22:53.199067+0000 mon.b (mon.1) 50 : audit [INF] from='client.? 172.21.15.18:0/3170189889' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:22:54.088 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:22:53.199499+0000 mon.a (mon.0) 976 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:22:54.114 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:54.212 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:22:54.218 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:54.218 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:22:54.319 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:22:54.385 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:54.857 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:22:54.868 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:54.869 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:22:54.910 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:22:54.916 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:22:54.970 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:22:54.984 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:22:55.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:54 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:53.741445+0000 mon.a (mon.0) 977 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:22:55.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:54 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:22:53.753618+0000 mon.a (mon.0) 978 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-10T08:22:55.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:54 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:53.753680+0000 mon.a (mon.0) 979 : cluster [DBG] osdmap e154: 8 total, 8 up, 8 in 2024-02-10T08:22:55.047 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:53.741445+0000 mon.a (mon.0) 977 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:22:55.047 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:22:53.753618+0000 mon.a (mon.0) 978 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-10T08:22:55.048 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:53.753680+0000 mon.a (mon.0) 979 : cluster [DBG] osdmap e154: 8 total, 8 up, 8 in 2024-02-10T08:22:55.048 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:53.741445+0000 mon.a (mon.0) 977 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:22:55.048 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:22:53.753618+0000 mon.a (mon.0) 978 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-10T08:22:55.048 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:53.753680+0000 mon.a (mon.0) 979 : cluster [DBG] osdmap e154: 8 total, 8 up, 8 in 2024-02-10T08:22:55.056 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:55.287 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:22:55.296 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:55.297 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:22:55.398 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:22:55.466 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:56.110 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:54.632926+0000 mgr.y (mgr.14505) 234 : cluster [DBG] pgmap v262: 158 pgs: 1 active+recovering+undersized+degraded+remapped, 1 active+undersized+degraded+remapped+backfilling, 156 active+clean; 2.3 GiB data, 9.2 GiB used, 706 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 718 op/s; 5770/114330 objects degraded (5.047%); 1.5 MiB/s, 23 objects/s recovering 2024-02-10T08:22:56.110 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:55.513350+0000 mon.a (mon.0) 980 : cluster [WRN] Health check update: Degraded data redundancy: 5770/114330 objects degraded (5.047%), 2 pgs degraded, 2 pgs undersized (PG_DEGRADED) 2024-02-10T08:22:56.110 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:55.532704+0000 mon.a (mon.0) 981 : cluster [DBG] osdmap e155: 8 total, 8 up, 8 in 2024-02-10T08:22:56.111 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:54.632926+0000 mgr.y (mgr.14505) 234 : cluster [DBG] pgmap v262: 158 pgs: 1 active+recovering+undersized+degraded+remapped, 1 active+undersized+degraded+remapped+backfilling, 156 active+clean; 2.3 GiB data, 9.2 GiB used, 706 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 718 op/s; 5770/114330 objects degraded (5.047%); 1.5 MiB/s, 23 objects/s recovering 2024-02-10T08:22:56.111 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:55.513350+0000 mon.a (mon.0) 980 : cluster [WRN] Health check update: Degraded data redundancy: 5770/114330 objects degraded (5.047%), 2 pgs degraded, 2 pgs undersized (PG_DEGRADED) 2024-02-10T08:22:56.111 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:55.532704+0000 mon.a (mon.0) 981 : cluster [DBG] osdmap e155: 8 total, 8 up, 8 in 2024-02-10T08:22:56.249 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:22:56.260 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:56.261 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:22:56.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:54.632926+0000 mgr.y (mgr.14505) 234 : cluster [DBG] pgmap v262: 158 pgs: 1 active+recovering+undersized+degraded+remapped, 1 active+undersized+degraded+remapped+backfilling, 156 active+clean; 2.3 GiB data, 9.2 GiB used, 706 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 718 op/s; 5770/114330 objects degraded (5.047%); 1.5 MiB/s, 23 objects/s recovering 2024-02-10T08:22:56.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:55.513350+0000 mon.a (mon.0) 980 : cluster [WRN] Health check update: Degraded data redundancy: 5770/114330 objects degraded (5.047%), 2 pgs degraded, 2 pgs undersized (PG_DEGRADED) 2024-02-10T08:22:56.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:55.532704+0000 mon.a (mon.0) 981 : cluster [DBG] osdmap e155: 8 total, 8 up, 8 in 2024-02-10T08:22:56.361 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:22:56.392 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:56.413 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:22:56.417 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:56.418 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:22:56.518 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:22:56.550 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:56.572 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:22:56.577 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:56.578 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:22:56.678 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:22:56.708 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:22:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:22:56] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:22:56.708 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:56.728 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:22:56.731 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:56.731 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:22:56.832 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:22:56.842 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd unset noscrub 2024-02-10T08:22:56.859 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:56.881 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:22:56.885 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:56.885 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:22:56.986 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:22:57.089 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:57.409 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:22:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:22:57] "GET /metrics HTTP/1.1" 200 175633 "" "Prometheus/2.33.4" 2024-02-10T08:22:57.496 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:22:57.502 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:57.503 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:22:57.603 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:22:57.637 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:57.662 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:22:57.665 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:57.665 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:22:57.766 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:22:57.798 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:57.823 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:22:57.826 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:56.633305+0000 mgr.y (mgr.14505) 235 : cluster [DBG] pgmap v264: 158 pgs: 1 active+recovering+undersized+degraded+remapped, 1 active+undersized+degraded+remapped+backfilling, 156 active+clean; 2.3 GiB data, 9.1 GiB used, 706 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 468 op/s; 5770/114330 objects degraded (5.047%); 935 KiB/s, 14 objects/s recovering 2024-02-10T08:22:57.826 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:56.982677+0000 osd.4 (osd.4) 5 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:22:57.827 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:57.828 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:22:57.928 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:22:57.993 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:58.039 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:22:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:22:58.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:56.633305+0000 mgr.y (mgr.14505) 235 : cluster [DBG] pgmap v264: 158 pgs: 1 active+recovering+undersized+degraded+remapped, 1 active+undersized+degraded+remapped+backfilling, 156 active+clean; 2.3 GiB data, 9.1 GiB used, 706 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 468 op/s; 5770/114330 objects degraded (5.047%); 935 KiB/s, 14 objects/s recovering 2024-02-10T08:22:58.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:56.982677+0000 osd.4 (osd.4) 5 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:22:58.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:56.982745+0000 osd.4 (osd.4) 6 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:22:58.084 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:56.982745+0000 osd.4 (osd.4) 6 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:22:58.085 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:56.633305+0000 mgr.y (mgr.14505) 235 : cluster [DBG] pgmap v264: 158 pgs: 1 active+recovering+undersized+degraded+remapped, 1 active+undersized+degraded+remapped+backfilling, 156 active+clean; 2.3 GiB data, 9.1 GiB used, 706 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 468 op/s; 5770/114330 objects degraded (5.047%); 935 KiB/s, 14 objects/s recovering 2024-02-10T08:22:58.085 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:56.982677+0000 osd.4 (osd.4) 5 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:22:58.085 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:56.982745+0000 osd.4 (osd.4) 6 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:22:58.093 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:22:58.096 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:58.097 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:22:58.197 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:22:58.227 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:58.250 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:22:58.255 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:58.255 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:22:58.356 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:22:58.419 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:58.510 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:22:58.517 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:58.518 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:22:58.619 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:22:58.652 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:58.676 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:22:58.678 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:58.679 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:22:58.780 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:22:58.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:22:57.802213+0000 mgr.y (mgr.14505) 236 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:22:58.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:57.832365+0000 mon.a (mon.0) 982 : cluster [DBG] osdmap e156: 8 total, 8 up, 8 in 2024-02-10T08:22:58.867 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:59.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:22:57.802213+0000 mgr.y (mgr.14505) 236 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:22:59.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:57.832365+0000 mon.a (mon.0) 982 : cluster [DBG] osdmap e156: 8 total, 8 up, 8 in 2024-02-10T08:22:59.133 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:22:59.138 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:59.139 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:22:59.139 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:22:57.802213+0000 mgr.y (mgr.14505) 236 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:22:59.139 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:57.832365+0000 mon.a (mon.0) 982 : cluster [DBG] osdmap e156: 8 total, 8 up, 8 in 2024-02-10T08:22:59.240 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:22:59.273 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:59.294 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:22:59.297 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:59.297 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:22:59.398 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:22:59.485 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:22:59.759 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:22:59.771 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:22:59.772 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:22:59.873 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:22:59.943 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:00.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:22:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:22:58.634483+0000 mgr.y (mgr.14505) 237 : cluster [DBG] pgmap v266: 158 pgs: 1 active+recovering+undersized+degraded+remapped, 1 active+undersized+degraded+remapped+backfilling, 156 active+clean; 2.1 GiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 966 op/s; 5446/103251 objects degraded (5.275%); 2.4 MiB/s, 38 objects/s recovering 2024-02-10T08:23:00.160 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:22:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:22:58.634483+0000 mgr.y (mgr.14505) 237 : cluster [DBG] pgmap v266: 158 pgs: 1 active+recovering+undersized+degraded+remapped, 1 active+undersized+degraded+remapped+backfilling, 156 active+clean; 2.1 GiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 966 op/s; 5446/103251 objects degraded (5.275%); 2.4 MiB/s, 38 objects/s recovering 2024-02-10T08:23:00.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:22:59 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:22:58.634483+0000 mgr.y (mgr.14505) 237 : cluster [DBG] pgmap v266: 158 pgs: 1 active+recovering+undersized+degraded+remapped, 1 active+undersized+degraded+remapped+backfilling, 156 active+clean; 2.1 GiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 966 op/s; 5446/103251 objects degraded (5.275%); 2.4 MiB/s, 38 objects/s recovering 2024-02-10T08:23:00.368 INFO:teuthology.orchestra.run.smithi018.stdout:moved 4 / 474 (0.843882%) 2024-02-10T08:23:00.368 INFO:teuthology.orchestra.run.smithi018.stdout:avg 59.25 2024-02-10T08:23:00.368 INFO:teuthology.orchestra.run.smithi018.stdout:stddev 5.16599 -> 5.33268 (expected baseline 7.20026) 2024-02-10T08:23:00.368 INFO:teuthology.orchestra.run.smithi018.stdout:min osd.2 with 52 -> 53 pgs (0.877637 -> 0.894515 * mean) 2024-02-10T08:23:00.368 INFO:teuthology.orchestra.run.smithi018.stdout:max osd.3 with 66 -> 64 pgs (1.11392 -> 1.08017 * mean) 2024-02-10T08:23:00.369 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:23:00.369 INFO:teuthology.orchestra.run.smithi018.stdout:oload 110 2024-02-10T08:23:00.369 INFO:teuthology.orchestra.run.smithi018.stdout:max_change 0.05 2024-02-10T08:23:00.369 INFO:teuthology.orchestra.run.smithi018.stdout:max_change_osds 4 2024-02-10T08:23:00.369 INFO:teuthology.orchestra.run.smithi018.stdout:average_utilization 0.0119 2024-02-10T08:23:00.369 INFO:teuthology.orchestra.run.smithi018.stdout:overload_utilization 0.0131 2024-02-10T08:23:00.369 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3 weight 1.0000 -> 0.9500 2024-02-10T08:23:00.369 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0 weight 1.0000 -> 0.9500 2024-02-10T08:23:00.399 INFO:teuthology.orchestra.run.smithi018.stderr:no change 2024-02-10T08:23:00.629 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:23:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:23:00.358+0000 7f52f8ade700 -1 mgr.server reply reply (2) No such file or directory no change 2024-02-10T08:23:00.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:23:00.215061+0000 mon.b (mon.1) 51 : audit [DBG] from='client.? 172.21.15.18:0/708766357' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:23:00.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:00.527057+0000 mon.a (mon.0) 983 : cluster [WRN] Health check update: Degraded data redundancy: 5446/103251 objects degraded (5.275%), 2 pgs degraded, 2 pgs undersized (PG_DEGRADED) 2024-02-10T08:23:00.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:00.559184+0000 mon.a (mon.0) 984 : cluster [DBG] osdmap e157: 8 total, 8 up, 8 in 2024-02-10T08:23:00.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:23:00.215061+0000 mon.b (mon.1) 51 : audit [DBG] from='client.? 172.21.15.18:0/708766357' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:23:00.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:00.527057+0000 mon.a (mon.0) 983 : cluster [WRN] Health check update: Degraded data redundancy: 5446/103251 objects degraded (5.275%), 2 pgs degraded, 2 pgs undersized (PG_DEGRADED) 2024-02-10T08:23:00.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:00.559184+0000 mon.a (mon.0) 984 : cluster [DBG] osdmap e157: 8 total, 8 up, 8 in 2024-02-10T08:23:00.973 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:23:00.979 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:00.980 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:23:01.081 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:23:01.114 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:23:01.115 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:23:01.115 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:23:01.115 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:23:01.115 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:23:01.115 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:23:01.115 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:23:01.115 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:23:01.115 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-10T08:23:01.115 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-10T08:23:01.115 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-10T08:23:01.115 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-10T08:23:01.116 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-10T08:23:01.116 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-10T08:23:01.116 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-10T08:23:01.116 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-10T08:23:01.152 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:01.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:23:00.215061+0000 mon.b (mon.1) 51 : audit [DBG] from='client.? 172.21.15.18:0/708766357' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:23:01.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:00.527057+0000 mon.a (mon.0) 983 : cluster [WRN] Health check update: Degraded data redundancy: 5446/103251 objects degraded (5.275%), 2 pgs degraded, 2 pgs undersized (PG_DEGRADED) 2024-02-10T08:23:01.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:00.559184+0000 mon.a (mon.0) 984 : cluster [DBG] osdmap e157: 8 total, 8 up, 8 in 2024-02-10T08:23:02.158 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:23:00.358670+0000 mgr.y (mgr.14505) 238 : audit [DBG] from='client.24827 -' entity='client.admin' cmd=[{"prefix": "osd test-reweight-by-utilization", "oload": 110, "max_change": 0.05, "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:23:02.158 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:00.634923+0000 mgr.y (mgr.14505) 239 : cluster [DBG] pgmap v268: 158 pgs: 1 active+recovering+undersized+degraded+remapped, 1 active+undersized+degraded+remapped+backfilling, 156 active+clean; 2.1 GiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 616 op/s; 5446/103251 objects degraded (5.275%); 1.2 MiB/s, 19 objects/s recovering 2024-02-10T08:23:02.158 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:01.416525+0000 osd.1 (osd.1) 83 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:23:02.159 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:01.416578+0000 osd.1 (osd.1) 84 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:23:02.159 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:23:00.358670+0000 mgr.y (mgr.14505) 238 : audit [DBG] from='client.24827 -' entity='client.admin' cmd=[{"prefix": "osd test-reweight-by-utilization", "oload": 110, "max_change": 0.05, "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:23:02.159 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:00.634923+0000 mgr.y (mgr.14505) 239 : cluster [DBG] pgmap v268: 158 pgs: 1 active+recovering+undersized+degraded+remapped, 1 active+undersized+degraded+remapped+backfilling, 156 active+clean; 2.1 GiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 616 op/s; 5446/103251 objects degraded (5.275%); 1.2 MiB/s, 19 objects/s recovering 2024-02-10T08:23:02.159 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:01.416525+0000 osd.1 (osd.1) 83 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:23:02.159 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:01.416578+0000 osd.1 (osd.1) 84 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:23:02.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:23:00.358670+0000 mgr.y (mgr.14505) 238 : audit [DBG] from='client.24827 -' entity='client.admin' cmd=[{"prefix": "osd test-reweight-by-utilization", "oload": 110, "max_change": 0.05, "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:23:02.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:00.634923+0000 mgr.y (mgr.14505) 239 : cluster [DBG] pgmap v268: 158 pgs: 1 active+recovering+undersized+degraded+remapped, 1 active+undersized+degraded+remapped+backfilling, 156 active+clean; 2.1 GiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 616 op/s; 5446/103251 objects degraded (5.275%); 1.2 MiB/s, 19 objects/s recovering 2024-02-10T08:23:02.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:01.416525+0000 osd.1 (osd.1) 83 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:23:02.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:01.416578+0000 osd.1 (osd.1) 84 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:23:03.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:01.899593+0000 mon.a (mon.0) 985 : cluster [DBG] osdmap e158: 8 total, 8 up, 8 in 2024-02-10T08:23:03.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:01.899593+0000 mon.a (mon.0) 985 : cluster [DBG] osdmap e158: 8 total, 8 up, 8 in 2024-02-10T08:23:03.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:01.899593+0000 mon.a (mon.0) 985 : cluster [DBG] osdmap e158: 8 total, 8 up, 8 in 2024-02-10T08:23:03.939 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:02.635559+0000 mgr.y (mgr.14505) 240 : cluster [DBG] pgmap v270: 158 pgs: 1 active+undersized+degraded+remapped+backfilling, 1 active+recovering+undersized+degraded+remapped, 156 active+clean; 2.0 GiB data, 8.1 GiB used, 707 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 937 op/s; 5191/97482 objects degraded (5.325%); 1.8 MiB/s, 28 objects/s recovering 2024-02-10T08:23:04.275 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:02.635559+0000 mgr.y (mgr.14505) 240 : cluster [DBG] pgmap v270: 158 pgs: 1 active+undersized+degraded+remapped+backfilling, 1 active+recovering+undersized+degraded+remapped, 156 active+clean; 2.0 GiB data, 8.1 GiB used, 707 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 937 op/s; 5191/97482 objects degraded (5.325%); 1.8 MiB/s, 28 objects/s recovering 2024-02-10T08:23:04.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:02.635559+0000 mgr.y (mgr.14505) 240 : cluster [DBG] pgmap v270: 158 pgs: 1 active+undersized+degraded+remapped+backfilling, 1 active+recovering+undersized+degraded+remapped, 156 active+clean; 2.0 GiB data, 8.1 GiB used, 707 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 937 op/s; 5191/97482 objects degraded (5.325%); 1.8 MiB/s, 28 objects/s recovering 2024-02-10T08:23:04.965 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:23:04.970 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '3.0', 'overage': '110', 'type': 'reweight-by-utilization'} 2024-02-10T08:23:04.970 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd reweight-by-utilization 110 3.0 2024-02-10T08:23:04.972 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:04.973 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:23:04.998 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:23:05.074 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:23:05.104 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:05.126 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:23:05.131 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:05.131 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:23:05.232 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:23:05.264 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:05.287 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:23:05.293 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:05.294 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:23:05.395 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:23:05.461 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:05.588 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:23:05.592 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:05.592 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:23:05.693 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:23:05.771 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-02-10T08:23:05.771 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-02-10T08:23:05.771 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-02-10T08:23:05.772 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-02-10T08:23:05.772 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.772 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:29656 7.9 7:9f4ae493:::benchmark_data_smithi018_80623_object29655:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e96)", 2024-02-10T08:23:05.772 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:03.387317+0000", 2024-02-10T08:23:05.772 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 182.380499673, 2024-02-10T08:23:05.772 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.097272687999999996, 2024-02-10T08:23:05.772 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:23:05.772 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:23:05.772 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:23:05.772 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:23:05.772 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:23:05.772 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 29656 2024-02-10T08:23:05.772 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.773 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:23:05.773 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.773 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:23:05.773 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.387317+0000", 2024-02-10T08:23:05.773 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:23:05.773 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.773 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.773 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:23:05.773 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.387317+0000", 2024-02-10T08:23:05.773 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:23:05.773 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.773 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.773 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:23:05.774 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.387316+0000", 2024-02-10T08:23:05.774 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0238000000000001e-05 2024-02-10T08:23:05.774 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.774 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.774 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:23:05.774 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.387346+0000", 2024-02-10T08:23:05.774 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9570000000000001e-05 2024-02-10T08:23:05.774 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.774 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.774 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:23:05.774 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.387366+0000", 2024-02-10T08:23:05.774 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4929999999999998e-06 2024-02-10T08:23:05.774 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.774 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.775 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:23:05.775 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.387374+0000", 2024-02-10T08:23:05.775 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4245000000000002e-05 2024-02-10T08:23:05.775 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.775 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.775 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:23:05.775 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.387409+0000", 2024-02-10T08:23:05.775 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4789000000000005e-05 2024-02-10T08:23:05.775 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.775 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.775 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:23:05.775 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.387483+0000", 2024-02-10T08:23:05.775 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2770999999999997e-05 2024-02-10T08:23:05.775 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.776 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.776 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-02-10T08:23:05.776 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.387576+0000", 2024-02-10T08:23:05.776 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0019925810000000002 2024-02-10T08:23:05.776 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.776 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.776 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:23:05.776 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.389569+0000", 2024-02-10T08:23:05.776 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.094893417999999993 2024-02-10T08:23:05.777 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.777 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.777 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:23:05.777 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.484462+0000", 2024-02-10T08:23:05.777 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8390000000000003e-05 2024-02-10T08:23:05.777 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.777 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.777 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:23:05.777 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.484511+0000", 2024-02-10T08:23:05.777 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9562999999999997e-05 2024-02-10T08:23:05.777 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.777 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.777 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:23:05.777 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.484590+0000", 2024-02-10T08:23:05.778 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.097272687999999996 2024-02-10T08:23:05.778 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:23:05.778 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:23:05.778 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:23:05.778 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.778 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.778 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:29658 7.6 7:6374d7c3:::benchmark_data_smithi018_80623_object29657:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e96)", 2024-02-10T08:23:05.778 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:03.388919+0000", 2024-02-10T08:23:05.778 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 182.378897628, 2024-02-10T08:23:05.778 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.10048816100000001, 2024-02-10T08:23:05.778 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:23:05.778 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:23:05.778 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:23:05.778 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:23:05.778 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:23:05.779 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 29658 2024-02-10T08:23:05.779 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.779 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:23:05.779 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.779 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:23:05.779 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.388919+0000", 2024-02-10T08:23:05.779 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:23:05.779 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.779 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.779 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:23:05.779 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.388919+0000", 2024-02-10T08:23:05.779 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999981 2024-02-10T08:23:05.779 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.779 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.779 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:23:05.780 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.388918+0000", 2024-02-10T08:23:05.780 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8322999999999999e-05 2024-02-10T08:23:05.780 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.780 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.780 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:23:05.780 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.388956+0000", 2024-02-10T08:23:05.780 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0576e-05 2024-02-10T08:23:05.780 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.780 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.780 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:23:05.780 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.388967+0000", 2024-02-10T08:23:05.780 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4229999999999998e-06 2024-02-10T08:23:05.780 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.780 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.781 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:23:05.781 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.388971+0000", 2024-02-10T08:23:05.781 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.095437275000000002 2024-02-10T08:23:05.781 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.781 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.781 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:23:05.781 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.484408+0000", 2024-02-10T08:23:05.781 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000144707 2024-02-10T08:23:05.781 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.781 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.781 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:23:05.781 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.484553+0000", 2024-02-10T08:23:05.781 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000172122 2024-02-10T08:23:05.781 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.781 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.782 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,7", 2024-02-10T08:23:05.782 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.484725+0000", 2024-02-10T08:23:05.782 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002940008 2024-02-10T08:23:05.782 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.782 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.782 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:23:05.782 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.487665+0000", 2024-02-10T08:23:05.782 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00080987599999999996 2024-02-10T08:23:05.782 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.782 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.782 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:23:05.782 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.488475+0000", 2024-02-10T08:23:05.782 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00084143300000000005 2024-02-10T08:23:05.782 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.782 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.783 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:23:05.783 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.489316+0000", 2024-02-10T08:23:05.783 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2364000000000002e-05 2024-02-10T08:23:05.783 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.783 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.783 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:23:05.783 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.489369+0000", 2024-02-10T08:23:05.783 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8856999999999997e-05 2024-02-10T08:23:05.783 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.783 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.783 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:23:05.783 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.489408+0000", 2024-02-10T08:23:05.783 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.10048816100000001 2024-02-10T08:23:05.783 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:23:05.784 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:23:05.784 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:23:05.784 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.784 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.784 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:29659 7.4 7:2daff190:::benchmark_data_smithi018_80623_object29658:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e96)", 2024-02-10T08:23:05.784 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:03.389187+0000", 2024-02-10T08:23:05.784 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 182.37862973, 2024-02-10T08:23:05.784 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.100323041, 2024-02-10T08:23:05.784 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:23:05.784 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:23:05.784 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:23:05.784 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:23:05.784 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:23:05.784 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 29659 2024-02-10T08:23:05.785 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.785 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:23:05.785 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.785 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:23:05.785 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.389187+0000", 2024-02-10T08:23:05.785 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:23:05.785 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.785 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.785 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:23:05.785 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.389187+0000", 2024-02-10T08:23:05.785 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:23:05.785 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.785 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.785 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:23:05.786 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.389187+0000", 2024-02-10T08:23:05.786 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4876000000000003e-05 2024-02-10T08:23:05.786 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.786 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.786 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:23:05.786 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.389221+0000", 2024-02-10T08:23:05.786 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0295999999999999e-05 2024-02-10T08:23:05.786 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.786 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.786 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:23:05.786 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.389232+0000", 2024-02-10T08:23:05.786 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.28e-06 2024-02-10T08:23:05.786 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.786 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.786 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:23:05.787 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.389238+0000", 2024-02-10T08:23:05.787 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.096661150000000001 2024-02-10T08:23:05.787 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.787 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.787 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:23:05.787 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.485899+0000", 2024-02-10T08:23:05.787 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014505799999999999 2024-02-10T08:23:05.787 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.787 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.787 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:23:05.787 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.486044+0000", 2024-02-10T08:23:05.787 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000147467 2024-02-10T08:23:05.787 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.787 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.788 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-02-10T08:23:05.788 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.486192+0000", 2024-02-10T08:23:05.788 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0023046989999999999 2024-02-10T08:23:05.788 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.788 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.788 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:23:05.788 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.488496+0000", 2024-02-10T08:23:05.788 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00086944699999999997 2024-02-10T08:23:05.788 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.788 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.788 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:23:05.788 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.489366+0000", 2024-02-10T08:23:05.788 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4959000000000001e-05 2024-02-10T08:23:05.788 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.789 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.789 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:23:05.789 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.489411+0000", 2024-02-10T08:23:05.789 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9672000000000004e-05 2024-02-10T08:23:05.789 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.789 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.789 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:23:05.789 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.489510+0000", 2024-02-10T08:23:05.789 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.100323041 2024-02-10T08:23:05.789 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:23:05.789 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:23:05.789 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:23:05.789 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.789 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.790 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:29660 7.4 7:24354929:::benchmark_data_smithi018_80623_object29659:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e96)", 2024-02-10T08:23:05.790 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:03.389249+0000", 2024-02-10T08:23:05.790 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 182.37856791199999, 2024-02-10T08:23:05.790 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.100695496, 2024-02-10T08:23:05.790 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:23:05.790 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:23:05.790 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:23:05.790 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:23:05.790 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:23:05.790 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 29660 2024-02-10T08:23:05.790 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.790 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:23:05.790 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.790 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:23:05.790 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.389249+0000", 2024-02-10T08:23:05.791 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:23:05.791 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.791 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.791 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:23:05.791 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.389249+0000", 2024-02-10T08:23:05.791 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:23:05.791 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.791 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.791 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:23:05.791 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.389248+0000", 2024-02-10T08:23:05.791 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1061e-05 2024-02-10T08:23:05.791 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.791 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.791 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:23:05.791 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.389270+0000", 2024-02-10T08:23:05.792 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2130000000000002e-06 2024-02-10T08:23:05.792 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.792 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.792 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:23:05.792 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.389277+0000", 2024-02-10T08:23:05.792 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0640000000000001e-06 2024-02-10T08:23:05.792 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.792 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.792 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:23:05.792 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.389282+0000", 2024-02-10T08:23:05.792 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.097971920000000004 2024-02-10T08:23:05.792 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.792 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.792 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:23:05.793 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.487254+0000", 2024-02-10T08:23:05.793 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000118917 2024-02-10T08:23:05.793 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.793 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.793 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:23:05.793 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.487373+0000", 2024-02-10T08:23:05.793 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000152385 2024-02-10T08:23:05.793 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.793 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.793 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-02-10T08:23:05.793 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.487525+0000", 2024-02-10T08:23:05.793 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0013384289999999999 2024-02-10T08:23:05.793 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.793 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.793 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:23:05.794 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.488863+0000", 2024-02-10T08:23:05.794 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00093813200000000005 2024-02-10T08:23:05.794 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.794 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.794 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:23:05.794 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.489802+0000", 2024-02-10T08:23:05.794 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2296999999999998e-05 2024-02-10T08:23:05.794 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.794 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.794 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:23:05.794 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.489854+0000", 2024-02-10T08:23:05.794 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0787999999999999e-05 2024-02-10T08:23:05.794 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.794 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.795 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:23:05.795 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.489945+0000", 2024-02-10T08:23:05.795 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.100695496 2024-02-10T08:23:05.795 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:23:05.795 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:23:05.795 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:23:05.795 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.795 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.795 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:29662 7.f 7:f5791515:::benchmark_data_smithi018_80623_object29661:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e96)", 2024-02-10T08:23:05.795 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:03.389287+0000", 2024-02-10T08:23:05.795 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 182.37853012799999, 2024-02-10T08:23:05.795 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.106154526, 2024-02-10T08:23:05.795 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:23:05.796 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:23:05.796 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:23:05.796 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:23:05.796 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:23:05.796 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 29662 2024-02-10T08:23:05.796 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.796 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:23:05.796 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.796 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:23:05.796 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.389287+0000", 2024-02-10T08:23:05.796 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:23:05.796 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.796 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.796 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:23:05.796 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.389287+0000", 2024-02-10T08:23:05.797 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:23:05.797 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.797 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.797 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:23:05.797 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.389286+0000", 2024-02-10T08:23:05.797 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3587e-05 2024-02-10T08:23:05.797 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.797 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.797 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:23:05.797 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.389310+0000", 2024-02-10T08:23:05.797 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6699999999999997e-06 2024-02-10T08:23:05.797 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.797 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.797 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:23:05.797 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.389317+0000", 2024-02-10T08:23:05.798 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6800000000000001e-06 2024-02-10T08:23:05.798 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.798 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.798 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:23:05.798 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.389321+0000", 2024-02-10T08:23:05.798 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.096291437999999993 2024-02-10T08:23:05.798 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.798 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.798 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:23:05.798 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.485613+0000", 2024-02-10T08:23:05.798 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012495200000000001 2024-02-10T08:23:05.798 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.798 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.798 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:23:05.799 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.485738+0000", 2024-02-10T08:23:05.799 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000163449 2024-02-10T08:23:05.799 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.799 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.799 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,7", 2024-02-10T08:23:05.799 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.485901+0000", 2024-02-10T08:23:05.799 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0014973950000000001 2024-02-10T08:23:05.799 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.799 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.799 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:23:05.799 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.487399+0000", 2024-02-10T08:23:05.799 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0011120730000000001 2024-02-10T08:23:05.799 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.799 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.799 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:23:05.800 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.488511+0000", 2024-02-10T08:23:05.800 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0068342689999999996 2024-02-10T08:23:05.800 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.800 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.800 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:23:05.800 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.495345+0000", 2024-02-10T08:23:05.800 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6263e-05 2024-02-10T08:23:05.800 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.800 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.800 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:23:05.800 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.495401+0000", 2024-02-10T08:23:05.800 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0355999999999998e-05 2024-02-10T08:23:05.800 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.800 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.801 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:23:05.801 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.495442+0000", 2024-02-10T08:23:05.801 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.106154526 2024-02-10T08:23:05.801 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:23:05.801 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:23:05.801 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:23:05.801 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.801 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.801 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.14784.0:29661 7.e e96/91 7:73e85c20:::benchmark_data_smithi018_80623_object29660:head v 96'1840, mlcod=96'1837)", 2024-02-10T08:23:05.801 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:03.389370+0000", 2024-02-10T08:23:05.801 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 182.37844708899999, 2024-02-10T08:23:05.801 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.098286282000000003, 2024-02-10T08:23:05.801 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:23:05.801 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:23:05.801 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:23:05.802 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.802 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:23:05.802 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.389370+0000", 2024-02-10T08:23:05.802 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:23:05.802 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.802 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.802 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:23:05.802 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.389370+0000", 2024-02-10T08:23:05.802 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:23:05.802 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.802 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.802 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:23:05.802 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.389369+0000", 2024-02-10T08:23:05.802 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3745999999999999e-05 2024-02-10T08:23:05.802 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.803 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.803 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:23:05.803 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.389393+0000", 2024-02-10T08:23:05.803 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0362e-05 2024-02-10T08:23:05.803 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.803 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.803 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:23:05.803 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.389404+0000", 2024-02-10T08:23:05.803 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7509999999999999e-06 2024-02-10T08:23:05.803 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.803 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.803 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:23:05.803 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.389408+0000", 2024-02-10T08:23:05.803 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0065000000000003e-05 2024-02-10T08:23:05.803 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.804 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.804 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:23:05.804 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.389458+0000", 2024-02-10T08:23:05.804 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8431e-05 2024-02-10T08:23:05.804 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.804 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.804 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:23:05.804 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.389477+0000", 2024-02-10T08:23:05.804 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.098148698000000006 2024-02-10T08:23:05.804 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.804 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.804 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:23:05.804 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.487626+0000", 2024-02-10T08:23:05.804 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0781999999999998e-05 2024-02-10T08:23:05.805 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.805 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.805 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:23:05.805 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.487656+0000", 2024-02-10T08:23:05.805 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.098286282000000003 2024-02-10T08:23:05.805 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:23:05.805 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:23:05.805 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:23:05.805 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.805 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.805 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.14784.0:29663 7.5 e96/91 7:ae9fb4dd:::benchmark_data_smithi018_80623_object29662:head v 96'1898, mlcod=96'1896)", 2024-02-10T08:23:05.805 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:03.389611+0000", 2024-02-10T08:23:05.805 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 182.37820610599999, 2024-02-10T08:23:05.805 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.098696648999999997, 2024-02-10T08:23:05.805 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:23:05.806 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:23:05.806 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:23:05.806 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.806 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:23:05.806 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.389611+0000", 2024-02-10T08:23:05.806 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:23:05.806 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.806 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.806 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:23:05.806 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.389611+0000", 2024-02-10T08:23:05.806 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:23:05.806 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.806 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.806 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:23:05.806 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.389610+0000", 2024-02-10T08:23:05.807 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7945999999999999e-05 2024-02-10T08:23:05.807 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.807 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.807 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:23:05.807 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.389648+0000", 2024-02-10T08:23:05.807 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.096174522999999998 2024-02-10T08:23:05.807 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.807 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.807 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:23:05.807 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.485823+0000", 2024-02-10T08:23:05.807 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9280000000000004e-06 2024-02-10T08:23:05.807 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.807 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.808 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:23:05.808 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.485830+0000", 2024-02-10T08:23:05.808 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018384299999999999 2024-02-10T08:23:05.808 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.808 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.808 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:23:05.808 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.486013+0000", 2024-02-10T08:23:05.808 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5380000000000001e-05 2024-02-10T08:23:05.808 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.808 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.808 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:23:05.808 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.486039+0000", 2024-02-10T08:23:05.808 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0022319319999999998 2024-02-10T08:23:05.808 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.808 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.809 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:23:05.809 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.488271+0000", 2024-02-10T08:23:05.809 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6937000000000002e-05 2024-02-10T08:23:05.809 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.809 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.809 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:23:05.809 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.488308+0000", 2024-02-10T08:23:05.809 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.098696648999999997 2024-02-10T08:23:05.809 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:23:05.809 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:23:05.809 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:23:05.809 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.809 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.809 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:77122 7.f 7:fbc1d2ad:::benchmark_data_smithi018_80623_object77121:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e107)", 2024-02-10T08:23:05.809 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:42.057541+0000", 2024-02-10T08:23:05.810 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 143.710276214, 2024-02-10T08:23:05.810 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.107663749, 2024-02-10T08:23:05.810 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:23:05.810 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:23:05.810 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:23:05.810 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:23:05.810 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:23:05.810 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 77122 2024-02-10T08:23:05.810 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.810 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:23:05.810 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.810 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:23:05.810 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.057541+0000", 2024-02-10T08:23:05.810 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:23:05.810 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.811 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.811 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:23:05.811 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.057541+0000", 2024-02-10T08:23:05.811 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999981 2024-02-10T08:23:05.811 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.811 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.811 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:23:05.811 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.057539+0000", 2024-02-10T08:23:05.811 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0675000000000001e-05 2024-02-10T08:23:05.811 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.811 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.811 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:23:05.811 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.057560+0000", 2024-02-10T08:23:05.811 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0512e-05 2024-02-10T08:23:05.811 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.812 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.812 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:23:05.812 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.057570+0000", 2024-02-10T08:23:05.812 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0839999999999999e-06 2024-02-10T08:23:05.812 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.812 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.812 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:23:05.812 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.057575+0000", 2024-02-10T08:23:05.812 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6105000000000003e-05 2024-02-10T08:23:05.812 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.812 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.812 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:23:05.812 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.057661+0000", 2024-02-10T08:23:05.812 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2281000000000006e-05 2024-02-10T08:23:05.813 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.813 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.813 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:23:05.813 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.057754+0000", 2024-02-10T08:23:05.813 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000164754 2024-02-10T08:23:05.813 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.813 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.813 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,7", 2024-02-10T08:23:05.813 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.057918+0000", 2024-02-10T08:23:05.813 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.006321017 2024-02-10T08:23:05.813 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.813 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.813 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:23:05.813 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.064239+0000", 2024-02-10T08:23:05.813 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0025116650000000002 2024-02-10T08:23:05.814 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.814 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.814 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:23:05.814 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.066751+0000", 2024-02-10T08:23:05.814 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.098358857999999993 2024-02-10T08:23:05.814 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.814 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.814 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:23:05.814 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.165110+0000", 2024-02-10T08:23:05.814 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3987000000000003e-05 2024-02-10T08:23:05.814 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.814 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.814 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:23:05.814 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.165164+0000", 2024-02-10T08:23:05.815 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0818999999999997e-05 2024-02-10T08:23:05.815 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.815 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.815 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:23:05.815 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.165205+0000", 2024-02-10T08:23:05.815 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.107663749 2024-02-10T08:23:05.815 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:23:05.815 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:23:05.815 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:23:05.815 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.815 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.815 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:77130 7.f 7:ff8c0eaa:::benchmark_data_smithi018_80623_object77129:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e107)", 2024-02-10T08:23:05.815 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:42.061312+0000", 2024-02-10T08:23:05.815 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 143.706505346, 2024-02-10T08:23:05.815 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.104018578, 2024-02-10T08:23:05.816 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:23:05.816 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:23:05.816 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:23:05.816 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:23:05.816 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:23:05.816 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 77130 2024-02-10T08:23:05.816 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.816 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:23:05.816 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.816 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:23:05.816 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.061312+0000", 2024-02-10T08:23:05.816 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:23:05.816 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.816 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.817 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:23:05.817 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.061312+0000", 2024-02-10T08:23:05.817 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:23:05.817 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.817 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.817 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:23:05.817 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.061310+0000", 2024-02-10T08:23:05.817 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0628999999999998e-05 2024-02-10T08:23:05.817 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.817 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.817 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:23:05.817 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.061331+0000", 2024-02-10T08:23:05.817 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0589999999999992e-06 2024-02-10T08:23:05.817 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.817 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.817 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:23:05.818 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.061340+0000", 2024-02-10T08:23:05.818 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.352e-06 2024-02-10T08:23:05.818 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.818 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.818 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:23:05.818 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.061344+0000", 2024-02-10T08:23:05.818 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0029262099999999998 2024-02-10T08:23:05.818 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.818 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.818 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:23:05.818 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.064271+0000", 2024-02-10T08:23:05.818 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012769800000000001 2024-02-10T08:23:05.818 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.818 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.818 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:23:05.819 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.064398+0000", 2024-02-10T08:23:05.819 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000143907 2024-02-10T08:23:05.819 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.819 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.819 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,7", 2024-02-10T08:23:05.819 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.064542+0000", 2024-02-10T08:23:05.819 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0069906320000000001 2024-02-10T08:23:05.819 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.819 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.819 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:23:05.819 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.071533+0000", 2024-02-10T08:23:05.819 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7592999999999997e-05 2024-02-10T08:23:05.819 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.819 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.820 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:23:05.820 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.071570+0000", 2024-02-10T08:23:05.820 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.093671189000000002 2024-02-10T08:23:05.820 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.820 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.820 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:23:05.820 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.165242+0000", 2024-02-10T08:23:05.820 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1273999999999998e-05 2024-02-10T08:23:05.820 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.820 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.820 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:23:05.820 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.165283+0000", 2024-02-10T08:23:05.820 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7463999999999998e-05 2024-02-10T08:23:05.820 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.820 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.821 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:23:05.821 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.165330+0000", 2024-02-10T08:23:05.821 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.104018578 2024-02-10T08:23:05.821 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:23:05.821 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:23:05.821 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:23:05.821 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.821 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.821 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:77132 7.6 7:6a0a2bbe:::benchmark_data_smithi018_80623_object77131:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e107)", 2024-02-10T08:23:05.821 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:42.066818+0000", 2024-02-10T08:23:05.821 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 143.700999008, 2024-02-10T08:23:05.821 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.094245710999999996, 2024-02-10T08:23:05.821 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:23:05.821 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:23:05.821 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:23:05.822 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:23:05.822 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:23:05.822 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 77132 2024-02-10T08:23:05.822 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.822 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:23:05.822 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.822 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:23:05.822 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.066818+0000", 2024-02-10T08:23:05.822 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:23:05.822 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.822 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.822 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:23:05.822 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.066818+0000", 2024-02-10T08:23:05.822 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:23:05.822 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.823 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.823 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:23:05.823 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.066817+0000", 2024-02-10T08:23:05.823 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8977000000000001e-05 2024-02-10T08:23:05.823 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.823 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.823 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:23:05.823 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.066836+0000", 2024-02-10T08:23:05.823 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0299999999999996e-06 2024-02-10T08:23:05.823 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.823 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.823 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:23:05.823 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.066843+0000", 2024-02-10T08:23:05.823 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1779999999999996e-06 2024-02-10T08:23:05.823 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.824 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.824 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:23:05.824 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.066847+0000", 2024-02-10T08:23:05.824 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8730000000000003e-05 2024-02-10T08:23:05.824 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.824 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.824 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:23:05.824 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.066896+0000", 2024-02-10T08:23:05.824 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000124964 2024-02-10T08:23:05.824 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.824 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.824 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:23:05.824 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.067021+0000", 2024-02-10T08:23:05.824 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000169335 2024-02-10T08:23:05.825 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.825 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.825 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,7", 2024-02-10T08:23:05.825 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.067190+0000", 2024-02-10T08:23:05.825 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0020294309999999999 2024-02-10T08:23:05.825 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.825 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.825 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:23:05.825 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.069219+0000", 2024-02-10T08:23:05.825 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0048905980000000003 2024-02-10T08:23:05.825 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.825 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.825 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:23:05.825 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.074110+0000", 2024-02-10T08:23:05.825 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086847147 2024-02-10T08:23:05.826 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.826 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.826 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:23:05.826 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.160957+0000", 2024-02-10T08:23:05.826 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5186000000000003e-05 2024-02-10T08:23:05.826 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.826 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.826 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:23:05.826 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.161012+0000", 2024-02-10T08:23:05.826 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1476e-05 2024-02-10T08:23:05.826 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.826 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.826 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:23:05.826 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.161064+0000", 2024-02-10T08:23:05.827 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.094245710999999996 2024-02-10T08:23:05.827 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:23:05.827 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:23:05.827 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:23:05.827 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.827 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.827 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:77133 7.f 7:f016bff6:::benchmark_data_smithi018_80623_object77132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e107)", 2024-02-10T08:23:05.827 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:42.066857+0000", 2024-02-10T08:23:05.827 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 143.70095990799999, 2024-02-10T08:23:05.827 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.098603551999999997, 2024-02-10T08:23:05.827 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:23:05.827 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:23:05.827 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:23:05.827 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:23:05.827 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:23:05.828 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 77133 2024-02-10T08:23:05.828 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.828 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:23:05.828 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.828 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:23:05.828 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.066857+0000", 2024-02-10T08:23:05.828 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:23:05.828 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.828 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.828 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:23:05.828 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.066857+0000", 2024-02-10T08:23:05.828 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:23:05.828 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.828 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.828 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:23:05.829 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.066857+0000", 2024-02-10T08:23:05.829 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6022e-05 2024-02-10T08:23:05.829 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.829 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.829 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:23:05.829 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.066873+0000", 2024-02-10T08:23:05.829 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6689999999999997e-06 2024-02-10T08:23:05.829 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.829 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.829 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:23:05.829 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.066877+0000", 2024-02-10T08:23:05.829 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5190000000000003e-06 2024-02-10T08:23:05.829 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.829 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.829 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:23:05.830 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.066882+0000", 2024-02-10T08:23:05.830 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9916000000000002e-05 2024-02-10T08:23:05.830 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.830 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.830 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:23:05.830 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.066922+0000", 2024-02-10T08:23:05.830 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013538299999999999 2024-02-10T08:23:05.830 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.830 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.830 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:23:05.830 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.067057+0000", 2024-02-10T08:23:05.830 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000108482 2024-02-10T08:23:05.830 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.830 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.830 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,7", 2024-02-10T08:23:05.831 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.067166+0000", 2024-02-10T08:23:05.831 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0044118739999999997 2024-02-10T08:23:05.831 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.831 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.831 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:23:05.831 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.071578+0000", 2024-02-10T08:23:05.831 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9609999999999999e-05 2024-02-10T08:23:05.831 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.831 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.831 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:23:05.831 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.071607+0000", 2024-02-10T08:23:05.831 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.093769928000000002 2024-02-10T08:23:05.831 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.831 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.832 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:23:05.832 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.165377+0000", 2024-02-10T08:23:05.832 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5618999999999998e-05 2024-02-10T08:23:05.832 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.832 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.832 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:23:05.832 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.165423+0000", 2024-02-10T08:23:05.832 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8016999999999999e-05 2024-02-10T08:23:05.832 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.832 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.832 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:23:05.832 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.165461+0000", 2024-02-10T08:23:05.832 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.098603551999999997 2024-02-10T08:23:05.832 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:23:05.832 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:23:05.833 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:23:05.833 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.833 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.833 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:77135 7.f 7:f81e7e4c:::benchmark_data_smithi018_80623_object77134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e107)", 2024-02-10T08:23:05.833 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:42.068297+0000", 2024-02-10T08:23:05.833 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 143.69952028899999, 2024-02-10T08:23:05.833 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.097290753999999993, 2024-02-10T08:23:05.833 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:23:05.833 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:23:05.833 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:23:05.833 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:23:05.833 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:23:05.833 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 77135 2024-02-10T08:23:05.833 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.834 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:23:05.834 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.834 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:23:05.834 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.068297+0000", 2024-02-10T08:23:05.834 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:23:05.834 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.834 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.834 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:23:05.834 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.068297+0000", 2024-02-10T08:23:05.834 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:23:05.834 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.834 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.834 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:23:05.834 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.068295+0000", 2024-02-10T08:23:05.834 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3615999999999999e-05 2024-02-10T08:23:05.834 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.835 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.835 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:23:05.835 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.068319+0000", 2024-02-10T08:23:05.835 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0293e-05 2024-02-10T08:23:05.835 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.835 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.835 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:23:05.835 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.068329+0000", 2024-02-10T08:23:05.835 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2079999999999997e-06 2024-02-10T08:23:05.835 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.835 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.835 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:23:05.835 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.068335+0000", 2024-02-10T08:23:05.835 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00089107300000000004 2024-02-10T08:23:05.835 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.836 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.836 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:23:05.836 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.069226+0000", 2024-02-10T08:23:05.836 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010846 2024-02-10T08:23:05.836 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.836 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.836 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:23:05.836 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.069335+0000", 2024-02-10T08:23:05.836 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000124695 2024-02-10T08:23:05.836 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.836 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.836 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,7", 2024-02-10T08:23:05.836 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.069460+0000", 2024-02-10T08:23:05.836 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0021538239999999999 2024-02-10T08:23:05.837 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.837 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.837 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:23:05.837 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.071613+0000", 2024-02-10T08:23:05.837 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0024102640000000001 2024-02-10T08:23:05.837 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.837 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.837 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:23:05.837 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.074024+0000", 2024-02-10T08:23:05.837 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.091483014000000001 2024-02-10T08:23:05.837 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.837 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.837 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:23:05.837 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.165507+0000", 2024-02-10T08:23:05.837 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6424999999999997e-05 2024-02-10T08:23:05.838 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.838 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.838 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:23:05.838 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.165553+0000", 2024-02-10T08:23:05.838 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4539999999999998e-05 2024-02-10T08:23:05.838 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.838 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.838 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:23:05.838 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.165588+0000", 2024-02-10T08:23:05.838 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.097290753999999993 2024-02-10T08:23:05.838 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:23:05.838 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:23:05.838 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:23:05.838 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.838 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.839 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:77139 7.6 7:6e6b1aac:::benchmark_data_smithi018_80623_object77138:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e107)", 2024-02-10T08:23:05.839 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:42.071766+0000", 2024-02-10T08:23:05.839 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 143.696050805, 2024-02-10T08:23:05.839 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.091507055000000004, 2024-02-10T08:23:05.839 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:23:05.839 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:23:05.839 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:23:05.839 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:23:05.839 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:23:05.839 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 77139 2024-02-10T08:23:05.839 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.839 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:23:05.839 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.839 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:23:05.839 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.071766+0000", 2024-02-10T08:23:05.840 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:23:05.840 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.840 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.840 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:23:05.840 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.071766+0000", 2024-02-10T08:23:05.840 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:23:05.840 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.840 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.840 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:23:05.840 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.071765+0000", 2024-02-10T08:23:05.840 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1899000000000002e-05 2024-02-10T08:23:05.840 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.840 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.840 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:23:05.840 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.071787+0000", 2024-02-10T08:23:05.841 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5440000000000004e-06 2024-02-10T08:23:05.841 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.841 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.841 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:23:05.841 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.071796+0000", 2024-02-10T08:23:05.841 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0050000000000001e-06 2024-02-10T08:23:05.841 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.841 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.841 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:23:05.841 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.071802+0000", 2024-02-10T08:23:05.841 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4669000000000002e-05 2024-02-10T08:23:05.841 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.841 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.841 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:23:05.841 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.071847+0000", 2024-02-10T08:23:05.842 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5126999999999999e-05 2024-02-10T08:23:05.842 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.842 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.842 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:23:05.842 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.071942+0000", 2024-02-10T08:23:05.842 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014349799999999999 2024-02-10T08:23:05.842 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.842 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.842 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,7", 2024-02-10T08:23:05.842 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.072086+0000", 2024-02-10T08:23:05.842 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0021594610000000001 2024-02-10T08:23:05.842 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.842 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.842 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:23:05.842 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.074245+0000", 2024-02-10T08:23:05.843 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.082298965000000002 2024-02-10T08:23:05.843 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.843 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.843 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:23:05.843 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.156544+0000", 2024-02-10T08:23:05.843 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0066336340000000002 2024-02-10T08:23:05.843 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.843 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.843 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:23:05.843 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.163178+0000", 2024-02-10T08:23:05.843 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4361999999999999e-05 2024-02-10T08:23:05.843 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.843 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.843 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:23:05.843 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.163232+0000", 2024-02-10T08:23:05.844 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1325999999999997e-05 2024-02-10T08:23:05.844 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.844 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.844 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:23:05.844 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.163273+0000", 2024-02-10T08:23:05.844 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.091507055000000004 2024-02-10T08:23:05.844 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:23:05.844 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:23:05.844 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:23:05.844 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.844 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.844 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.14784.0:77142 7.e e107/91 7:73ce8a4b:::benchmark_data_smithi018_80623_object77141:head v 107'4836, mlcod=107'4832)", 2024-02-10T08:23:05.844 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:42.073754+0000", 2024-02-10T08:23:05.844 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 143.694063277, 2024-02-10T08:23:05.844 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.089694775000000004, 2024-02-10T08:23:05.845 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:23:05.845 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:23:05.845 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:23:05.845 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.845 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:23:05.845 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.073754+0000", 2024-02-10T08:23:05.845 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:23:05.845 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.845 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.845 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:23:05.845 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.073754+0000", 2024-02-10T08:23:05.845 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:23:05.845 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.846 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.846 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:23:05.846 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.073753+0000", 2024-02-10T08:23:05.846 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1767e-05 2024-02-10T08:23:05.846 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.846 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.846 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:23:05.846 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.073775+0000", 2024-02-10T08:23:05.846 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.157e-06 2024-02-10T08:23:05.846 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.846 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.846 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:23:05.846 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.073783+0000", 2024-02-10T08:23:05.846 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5050000000000001e-06 2024-02-10T08:23:05.847 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.847 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.847 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:23:05.847 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.073788+0000", 2024-02-10T08:23:05.847 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.084504844999999995 2024-02-10T08:23:05.847 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.847 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.847 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:23:05.847 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.158292+0000", 2024-02-10T08:23:05.847 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0205000000000001e-05 2024-02-10T08:23:05.847 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.847 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.847 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:23:05.847 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.158313+0000", 2024-02-10T08:23:05.847 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0050980890000000001 2024-02-10T08:23:05.848 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.848 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.848 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:23:05.848 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.163411+0000", 2024-02-10T08:23:05.848 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7901000000000002e-05 2024-02-10T08:23:05.848 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.848 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.848 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:23:05.848 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.163449+0000", 2024-02-10T08:23:05.848 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.089694775000000004 2024-02-10T08:23:05.848 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:23:05.848 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:23:05.848 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:23:05.848 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.848 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.849 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:87251 7.4 7:2a595778:::benchmark_data_smithi018_80623_object87250:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e115)", 2024-02-10T08:23:05.849 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:58.905843+0000", 2024-02-10T08:23:05.849 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 126.861973901, 2024-02-10T08:23:05.849 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.092739273999999997, 2024-02-10T08:23:05.849 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:23:05.849 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:23:05.849 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:23:05.849 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:23:05.849 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:23:05.849 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 87251 2024-02-10T08:23:05.849 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.849 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:23:05.849 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.849 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:23:05.850 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:58.905843+0000", 2024-02-10T08:23:05.850 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:23:05.850 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.850 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.850 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:23:05.850 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:58.905843+0000", 2024-02-10T08:23:05.850 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999971 2024-02-10T08:23:05.850 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.850 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.850 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:23:05.850 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:58.905840+0000", 2024-02-10T08:23:05.850 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2014000000000002e-05 2024-02-10T08:23:05.850 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.850 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.850 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:23:05.851 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:58.905872+0000", 2024-02-10T08:23:05.851 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7648999999999999e-05 2024-02-10T08:23:05.851 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.851 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.851 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:23:05.851 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:58.905900+0000", 2024-02-10T08:23:05.851 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5129999999999996e-06 2024-02-10T08:23:05.851 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.851 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.851 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:23:05.851 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:58.905909+0000", 2024-02-10T08:23:05.851 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.043173587999999999 2024-02-10T08:23:05.851 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.851 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.851 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:23:05.852 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:58.949082+0000", 2024-02-10T08:23:05.852 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018973699999999999 2024-02-10T08:23:05.852 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.852 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.852 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:23:05.852 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:58.949272+0000", 2024-02-10T08:23:05.852 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000233778 2024-02-10T08:23:05.852 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.852 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.852 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1,4", 2024-02-10T08:23:05.852 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:58.949506+0000", 2024-02-10T08:23:05.852 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.036473179000000001 2024-02-10T08:23:05.852 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.852 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.853 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:23:05.853 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:58.985979+0000", 2024-02-10T08:23:05.853 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5271000000000001e-05 2024-02-10T08:23:05.853 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.853 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.853 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:23:05.853 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:58.986024+0000", 2024-02-10T08:23:05.853 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0087840230000000002 2024-02-10T08:23:05.853 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.853 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.853 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:23:05.853 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:58.994808+0000", 2024-02-10T08:23:05.853 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4022000000000005e-05 2024-02-10T08:23:05.853 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.853 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.854 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:23:05.854 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:58.994872+0000", 2024-02-10T08:23:05.854 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0037102379999999998 2024-02-10T08:23:05.854 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.854 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.854 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:23:05.854 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:58.998582+0000", 2024-02-10T08:23:05.854 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.092739273999999997 2024-02-10T08:23:05.854 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:23:05.854 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:23:05.854 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:23:05.854 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.854 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.854 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:88069 7.4 7:2e561420:::benchmark_data_smithi018_80623_object88068:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e115)", 2024-02-10T08:23:05.854 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:21:00.373918+0000", 2024-02-10T08:23:05.855 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 125.393899488, 2024-02-10T08:23:05.855 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.10139813, 2024-02-10T08:23:05.855 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:23:05.855 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:23:05.855 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:23:05.855 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:23:05.855 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:23:05.855 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 88069 2024-02-10T08:23:05.855 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.855 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:23:05.855 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.855 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:23:05.855 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:00.373918+0000", 2024-02-10T08:23:05.855 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:23:05.856 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.856 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.856 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:23:05.856 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:00.373918+0000", 2024-02-10T08:23:05.856 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:23:05.856 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.856 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.856 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:23:05.856 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:00.373917+0000", 2024-02-10T08:23:05.856 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0143999999999999e-05 2024-02-10T08:23:05.856 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.856 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.856 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:23:05.856 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:00.373937+0000", 2024-02-10T08:23:05.856 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7159999999999997e-06 2024-02-10T08:23:05.857 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.857 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.857 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:23:05.857 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:00.373944+0000", 2024-02-10T08:23:05.857 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8840000000000002e-06 2024-02-10T08:23:05.857 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.857 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.857 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:23:05.857 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:00.373949+0000", 2024-02-10T08:23:05.857 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.031637589000000001 2024-02-10T08:23:05.857 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.857 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.857 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:23:05.857 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:00.405586+0000", 2024-02-10T08:23:05.857 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017427999999999999 2024-02-10T08:23:05.858 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.858 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.858 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:23:05.858 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:00.405761+0000", 2024-02-10T08:23:05.858 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00021252 2024-02-10T08:23:05.858 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.858 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.858 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1,4", 2024-02-10T08:23:05.858 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:00.405973+0000", 2024-02-10T08:23:05.858 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.033536756000000001 2024-02-10T08:23:05.858 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.858 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.858 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:23:05.858 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:00.439510+0000", 2024-02-10T08:23:05.858 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1723000000000001e-05 2024-02-10T08:23:05.859 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.859 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.859 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:23:05.859 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:00.439542+0000", 2024-02-10T08:23:05.859 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.032458138999999997 2024-02-10T08:23:05.859 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.859 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.859 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:23:05.859 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:00.472000+0000", 2024-02-10T08:23:05.859 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8993999999999998e-05 2024-02-10T08:23:05.859 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.859 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.859 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:23:05.859 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:00.472059+0000", 2024-02-10T08:23:05.859 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0032571010000000001 2024-02-10T08:23:05.860 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.860 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.860 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:23:05.860 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:00.475316+0000", 2024-02-10T08:23:05.860 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.10139813 2024-02-10T08:23:05.860 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:23:05.860 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:23:05.860 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:23:05.860 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.860 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.860 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:89436 7.4 7:2d99f46b:::benchmark_data_smithi018_80623_object89435:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e116)", 2024-02-10T08:23:05.860 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:21:02.534381+0000", 2024-02-10T08:23:05.860 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 123.233435914, 2024-02-10T08:23:05.860 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.092091809999999996, 2024-02-10T08:23:05.861 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:23:05.861 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:23:05.861 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:23:05.861 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:23:05.861 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:23:05.861 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 89436 2024-02-10T08:23:05.861 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.861 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:23:05.861 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.861 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:23:05.861 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:02.534381+0000", 2024-02-10T08:23:05.861 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:23:05.861 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.861 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.861 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:23:05.862 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:02.534381+0000", 2024-02-10T08:23:05.862 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:23:05.862 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.862 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.862 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:23:05.862 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:02.534381+0000", 2024-02-10T08:23:05.862 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1735000000000001e-05 2024-02-10T08:23:05.862 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.862 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.862 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:23:05.862 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:02.534402+0000", 2024-02-10T08:23:05.862 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7379999999999999e-06 2024-02-10T08:23:05.862 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.862 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.863 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:23:05.863 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:02.534408+0000", 2024-02-10T08:23:05.863 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.16e-06 2024-02-10T08:23:05.863 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.863 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.863 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:23:05.863 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:02.534412+0000", 2024-02-10T08:23:05.863 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.022822371000000001 2024-02-10T08:23:05.863 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.863 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.863 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:23:05.863 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:02.557235+0000", 2024-02-10T08:23:05.863 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.003968325 2024-02-10T08:23:05.863 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.864 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.864 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:23:05.864 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:02.561203+0000", 2024-02-10T08:23:05.864 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018000000000000001 2024-02-10T08:23:05.864 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.864 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.864 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1,4", 2024-02-10T08:23:05.864 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:02.561383+0000", 2024-02-10T08:23:05.864 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.023027720000000002 2024-02-10T08:23:05.864 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.864 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.864 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:23:05.864 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:02.584411+0000", 2024-02-10T08:23:05.864 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6369999999999999e-05 2024-02-10T08:23:05.864 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.865 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.865 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:23:05.865 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:02.584447+0000", 2024-02-10T08:23:05.865 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039155078000000003 2024-02-10T08:23:05.865 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.865 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.865 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:23:05.865 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:02.623602+0000", 2024-02-10T08:23:05.865 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1888000000000001e-05 2024-02-10T08:23:05.865 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.865 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.865 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:23:05.865 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:02.623664+0000", 2024-02-10T08:23:05.865 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0028089450000000002 2024-02-10T08:23:05.865 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.866 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.866 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:23:05.866 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:02.626473+0000", 2024-02-10T08:23:05.866 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.092091809999999996 2024-02-10T08:23:05.866 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:23:05.866 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:23:05.866 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:23:05.866 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.866 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.866 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:111557 7.9 7:9a811b0f:::benchmark_data_smithi018_80623_object10629:head [delete] snapc 0=[] ondisk+write+known_if_redirected e125)", 2024-02-10T08:23:05.866 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:21:36.370217+0000", 2024-02-10T08:23:05.866 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 89.397600249000007, 2024-02-10T08:23:05.866 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.10686563, 2024-02-10T08:23:05.866 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:23:05.866 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:23:05.867 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:23:05.867 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:23:05.867 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:23:05.867 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 111557 2024-02-10T08:23:05.867 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.867 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:23:05.867 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.867 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:23:05.867 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:36.370217+0000", 2024-02-10T08:23:05.867 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:23:05.867 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.867 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.867 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:23:05.867 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:36.370217+0000", 2024-02-10T08:23:05.867 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:23:05.868 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.868 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.868 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:23:05.868 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:36.370216+0000", 2024-02-10T08:23:05.868 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9170000000000002e-06 2024-02-10T08:23:05.868 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.868 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.868 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:23:05.868 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:36.370219+0000", 2024-02-10T08:23:05.868 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7620000000000001e-06 2024-02-10T08:23:05.868 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.868 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.868 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:23:05.868 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:36.370225+0000", 2024-02-10T08:23:05.868 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0870000000000007e-06 2024-02-10T08:23:05.869 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.869 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.869 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:23:05.869 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:36.370233+0000", 2024-02-10T08:23:05.869 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.075982803000000002 2024-02-10T08:23:05.869 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.869 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.869 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:23:05.869 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:36.446216+0000", 2024-02-10T08:23:05.869 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000112775 2024-02-10T08:23:05.869 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.869 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.869 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for rw locks", 2024-02-10T08:23:05.869 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:36.446329+0000", 2024-02-10T08:23:05.869 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.010151980999999999 2024-02-10T08:23:05.870 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.870 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.870 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:23:05.870 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:36.456481+0000", 2024-02-10T08:23:05.870 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5962000000000003e-05 2024-02-10T08:23:05.870 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.870 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.870 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:23:05.870 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:36.456547+0000", 2024-02-10T08:23:05.870 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000113489 2024-02-10T08:23:05.870 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.870 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.870 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1,4", 2024-02-10T08:23:05.870 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:36.456660+0000", 2024-02-10T08:23:05.870 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.016782783999999999 2024-02-10T08:23:05.871 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.871 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.871 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:23:05.871 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:36.473443+0000", 2024-02-10T08:23:05.871 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3780000000000007e-06 2024-02-10T08:23:05.871 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.871 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.871 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:23:05.871 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:36.473452+0000", 2024-02-10T08:23:05.871 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1501000000000004e-05 2024-02-10T08:23:05.871 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.871 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.871 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:23:05.871 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:36.473544+0000", 2024-02-10T08:23:05.871 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7315999999999998e-05 2024-02-10T08:23:05.871 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.872 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.872 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:23:05.872 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:36.473601+0000", 2024-02-10T08:23:05.872 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0034814139999999999 2024-02-10T08:23:05.872 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.872 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.872 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:23:05.872 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:36.477082+0000", 2024-02-10T08:23:05.872 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.10686563 2024-02-10T08:23:05.872 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:23:05.872 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:23:05.872 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:23:05.872 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.872 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.873 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:131654 7.9 7:9f11397a:::benchmark_data_smithi018_80623_object30726:head [delete] snapc 0=[] ondisk+write+known_if_redirected e136)", 2024-02-10T08:23:05.873 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:22:05.105688+0000", 2024-02-10T08:23:05.873 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 60.662128701999997, 2024-02-10T08:23:05.873 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.10515804500000001, 2024-02-10T08:23:05.873 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:23:05.873 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:23:05.873 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:23:05.873 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:23:05.873 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:23:05.873 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 131654 2024-02-10T08:23:05.873 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.873 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:23:05.873 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.873 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:23:05.873 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:05.105688+0000", 2024-02-10T08:23:05.874 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:23:05.874 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.874 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.874 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:23:05.874 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:05.105688+0000", 2024-02-10T08:23:05.874 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:23:05.874 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.874 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.874 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:23:05.874 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:05.105687+0000", 2024-02-10T08:23:05.874 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9380000000000003e-06 2024-02-10T08:23:05.874 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.874 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.874 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:23:05.874 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:05.105694+0000", 2024-02-10T08:23:05.874 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2033e-05 2024-02-10T08:23:05.875 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.875 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.875 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:23:05.875 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:05.105706+0000", 2024-02-10T08:23:05.875 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8750000000000002e-06 2024-02-10T08:23:05.875 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.875 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.875 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:23:05.875 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:05.105713+0000", 2024-02-10T08:23:05.875 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013532631 2024-02-10T08:23:05.875 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.875 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.875 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:23:05.875 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:05.119246+0000", 2024-02-10T08:23:05.875 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000111408 2024-02-10T08:23:05.876 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.876 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.876 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for rw locks", 2024-02-10T08:23:05.876 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:05.119357+0000", 2024-02-10T08:23:05.876 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0076216620000000004 2024-02-10T08:23:05.876 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.876 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.876 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:23:05.876 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:05.126979+0000", 2024-02-10T08:23:05.876 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7869999999999997e-05 2024-02-10T08:23:05.876 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.876 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.876 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:23:05.876 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:05.127066+0000", 2024-02-10T08:23:05.877 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000148114 2024-02-10T08:23:05.877 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.877 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.877 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1,4", 2024-02-10T08:23:05.877 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:05.127215+0000", 2024-02-10T08:23:05.877 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.010892005999999999 2024-02-10T08:23:05.877 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.877 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.877 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:23:05.877 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:05.138107+0000", 2024-02-10T08:23:05.877 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.070534193999999995 2024-02-10T08:23:05.877 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.877 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.877 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:23:05.877 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:05.208641+0000", 2024-02-10T08:23:05.878 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1748000000000001e-05 2024-02-10T08:23:05.878 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.878 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.878 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:23:05.878 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:05.208683+0000", 2024-02-10T08:23:05.878 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9348999999999998e-05 2024-02-10T08:23:05.878 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.878 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.878 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:23:05.878 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:05.208732+0000", 2024-02-10T08:23:05.878 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002114608 2024-02-10T08:23:05.878 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.878 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.878 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:23:05.878 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:05.210846+0000", 2024-02-10T08:23:05.878 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.10515804500000001 2024-02-10T08:23:05.879 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:23:05.879 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:23:05.879 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:23:05.879 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.879 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.879 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:131667 7.9 7:995adc74:::benchmark_data_smithi018_80623_object30739:head [delete] snapc 0=[] ondisk+write+known_if_redirected e136)", 2024-02-10T08:23:05.879 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:22:05.122357+0000", 2024-02-10T08:23:05.879 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 60.645459750999997, 2024-02-10T08:23:05.879 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.090874943999999999, 2024-02-10T08:23:05.879 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:23:05.879 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:23:05.879 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:23:05.879 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:23:05.879 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:23:05.880 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 131667 2024-02-10T08:23:05.880 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.880 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:23:05.880 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.880 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:23:05.880 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:05.122357+0000", 2024-02-10T08:23:05.880 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:23:05.880 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.880 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.880 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:23:05.880 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:05.122357+0000", 2024-02-10T08:23:05.880 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999981 2024-02-10T08:23:05.880 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.880 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.880 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:23:05.881 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:05.122355+0000", 2024-02-10T08:23:05.881 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0279999999999997e-06 2024-02-10T08:23:05.881 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.881 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.881 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:23:05.881 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:05.122361+0000", 2024-02-10T08:23:05.881 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.312e-06 2024-02-10T08:23:05.881 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.881 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.881 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:23:05.881 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:05.122371+0000", 2024-02-10T08:23:05.881 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9379999999999997e-06 2024-02-10T08:23:05.881 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.881 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.881 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:23:05.881 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:05.122377+0000", 2024-02-10T08:23:05.882 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0076288889999999998 2024-02-10T08:23:05.882 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.882 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.882 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:23:05.882 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:05.130005+0000", 2024-02-10T08:23:05.882 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000144852 2024-02-10T08:23:05.882 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.882 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.882 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:23:05.882 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:05.130150+0000", 2024-02-10T08:23:05.882 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018406999999999999 2024-02-10T08:23:05.882 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.882 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.882 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1,4", 2024-02-10T08:23:05.882 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:05.130334+0000", 2024-02-10T08:23:05.883 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.007791816 2024-02-10T08:23:05.883 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.883 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.883 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:23:05.883 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:05.138126+0000", 2024-02-10T08:23:05.883 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.072796880999999994 2024-02-10T08:23:05.883 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.883 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.883 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:23:05.883 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:05.210923+0000", 2024-02-10T08:23:05.883 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9119999999999997e-05 2024-02-10T08:23:05.883 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.883 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.883 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:23:05.884 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:05.210972+0000", 2024-02-10T08:23:05.884 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9518000000000007e-05 2024-02-10T08:23:05.884 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.884 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.884 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:23:05.884 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:05.211052+0000", 2024-02-10T08:23:05.884 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0021805779999999999 2024-02-10T08:23:05.884 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:23:05.884 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:23:05.884 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:23:05.884 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:05.213232+0000", 2024-02-10T08:23:05.884 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.090874943999999999 2024-02-10T08:23:05.884 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:23:05.884 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:23:05.885 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:23:05.885 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:23:05.885 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:23:05.885 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-02-10T08:23:05.885 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:05.961 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:23:05.967 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:05.967 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:23:06.068 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:23:06.097 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:06.119 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:23:06.122 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:06.123 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:23:06.224 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:23:06.253 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:06.253 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:04.636192+0000 mgr.y (mgr.14505) 241 : cluster [DBG] pgmap v271: 158 pgs: 1 active+recovering+undersized+degraded+remapped, 1 active+undersized+degraded+remapped+backfilling, 156 active+clean; 1.9 GiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 752 B/s rd, 0 B/s wr, 686 op/s; 5132/91968 objects degraded (5.580%); 1.6 MiB/s, 25 objects/s recovering 2024-02-10T08:23:06.253 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:05.534392+0000 mon.a (mon.0) 986 : cluster [WRN] Health check update: Degraded data redundancy: 5132/91968 objects degraded (5.580%), 2 pgs degraded, 2 pgs undersized (PG_DEGRADED) 2024-02-10T08:23:06.253 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:05.558700+0000 mon.a (mon.0) 987 : cluster [DBG] osdmap e159: 8 total, 8 up, 8 in 2024-02-10T08:23:06.279 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:23:06.282 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:06.283 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:23:06.302 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-10T08:23:06.366 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:04.636192+0000 mgr.y (mgr.14505) 241 : cluster [DBG] pgmap v271: 158 pgs: 1 active+recovering+undersized+degraded+remapped, 1 active+undersized+degraded+remapped+backfilling, 156 active+clean; 1.9 GiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 752 B/s rd, 0 B/s wr, 686 op/s; 5132/91968 objects degraded (5.580%); 1.6 MiB/s, 25 objects/s recovering 2024-02-10T08:23:06.366 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:05.534392+0000 mon.a (mon.0) 986 : cluster [WRN] Health check update: Degraded data redundancy: 5132/91968 objects degraded (5.580%), 2 pgs degraded, 2 pgs undersized (PG_DEGRADED) 2024-02-10T08:23:06.366 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:05.558700+0000 mon.a (mon.0) 987 : cluster [DBG] osdmap e159: 8 total, 8 up, 8 in 2024-02-10T08:23:06.366 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:04.636192+0000 mgr.y (mgr.14505) 241 : cluster [DBG] pgmap v271: 158 pgs: 1 active+recovering+undersized+degraded+remapped, 1 active+undersized+degraded+remapped+backfilling, 156 active+clean; 1.9 GiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 752 B/s rd, 0 B/s wr, 686 op/s; 5132/91968 objects degraded (5.580%); 1.6 MiB/s, 25 objects/s recovering 2024-02-10T08:23:06.366 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:05.534392+0000 mon.a (mon.0) 986 : cluster [WRN] Health check update: Degraded data redundancy: 5132/91968 objects degraded (5.580%), 2 pgs degraded, 2 pgs undersized (PG_DEGRADED) 2024-02-10T08:23:06.366 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:05.558700+0000 mon.a (mon.0) 987 : cluster [DBG] osdmap e159: 8 total, 8 up, 8 in 2024-02-10T08:23:06.384 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:23:06.412 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:06.434 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:23:06.437 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:06.437 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:23:06.538 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:23:06.643 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:06.789 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:23:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:23:06] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:23:07.317 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.1 dump_ops_in_flight 2024-02-10T08:23:07.327 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:23:07.333 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:07.334 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:23:07.405 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:23:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:23:07] "GET /metrics HTTP/1.1" 200 175652 "" "Prometheus/2.33.4" 2024-02-10T08:23:07.434 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:23:07.464 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:07.486 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:23:07.491 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:07.491 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:23:07.592 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:23:07.620 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:07.643 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:23:07.645 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:07.646 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:23:07.746 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:23:07.841 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:07.857 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:23:07.886 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:23:07.895 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:07.895 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:23:07.996 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:23:08.023 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:08.045 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:23:08.048 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:08.048 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:23:08.149 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:23:08.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:06.636522+0000 mgr.y (mgr.14505) 242 : cluster [DBG] pgmap v273: 158 pgs: 1 active+recovering+undersized+degraded+remapped, 1 active+undersized+degraded+remapped+backfilling, 156 active+clean; 1.9 GiB data, 7.8 GiB used, 707 GiB / 715 GiB avail; 842 B/s rd, 0 B/s wr, 619 op/s; 5132/91968 objects degraded (5.580%); 1.2 MiB/s, 19 objects/s recovering 2024-02-10T08:23:08.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:06.636522+0000 mgr.y (mgr.14505) 242 : cluster [DBG] pgmap v273: 158 pgs: 1 active+recovering+undersized+degraded+remapped, 1 active+undersized+degraded+remapped+backfilling, 156 active+clean; 1.9 GiB data, 7.8 GiB used, 707 GiB / 715 GiB avail; 842 B/s rd, 0 B/s wr, 619 op/s; 5132/91968 objects degraded (5.580%); 1.2 MiB/s, 19 objects/s recovering 2024-02-10T08:23:08.176 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:06.636522+0000 mgr.y (mgr.14505) 242 : cluster [DBG] pgmap v273: 158 pgs: 1 active+recovering+undersized+degraded+remapped, 1 active+undersized+degraded+remapped+backfilling, 156 active+clean; 1.9 GiB data, 7.8 GiB used, 707 GiB / 715 GiB avail; 842 B/s rd, 0 B/s wr, 619 op/s; 5132/91968 objects degraded (5.580%); 1.2 MiB/s, 19 objects/s recovering 2024-02-10T08:23:08.176 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:23:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:23:08.178 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:08.201 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:23:08.204 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:08.205 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:23:08.305 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:23:08.333 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:08.357 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:23:08.359 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:08.359 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:23:08.460 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:23:08.525 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:08.648 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:23:08.653 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:08.654 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:23:08.754 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:23:08.843 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:09.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:07.298868+0000 osd.5 (osd.5) 75 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:23:09.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:07.298919+0000 osd.5 (osd.5) 76 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:23:09.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:23:07.814749+0000 mgr.y (mgr.14505) 243 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:23:09.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:07.982939+0000 mon.a (mon.0) 988 : cluster [DBG] osdmap e160: 8 total, 8 up, 8 in 2024-02-10T08:23:09.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:07.298868+0000 osd.5 (osd.5) 75 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:23:09.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:07.298919+0000 osd.5 (osd.5) 76 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:23:09.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:23:07.814749+0000 mgr.y (mgr.14505) 243 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:23:09.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:07.982939+0000 mon.a (mon.0) 988 : cluster [DBG] osdmap e160: 8 total, 8 up, 8 in 2024-02-10T08:23:09.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:07.298868+0000 osd.5 (osd.5) 75 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:23:09.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:07.298919+0000 osd.5 (osd.5) 76 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:23:09.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:23:07.814749+0000 mgr.y (mgr.14505) 243 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:23:09.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:07.982939+0000 mon.a (mon.0) 988 : cluster [DBG] osdmap e160: 8 total, 8 up, 8 in 2024-02-10T08:23:10.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:08.640712+0000 mgr.y (mgr.14505) 244 : cluster [DBG] pgmap v275: 158 pgs: 1 active+recovering+undersized+degraded+remapped, 1 active+undersized+degraded+remapped+backfilling, 156 active+clean; 1.6 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1.12k op/s; 4827/80715 objects degraded (5.980%); 2.2 MiB/s, 34 objects/s recovering 2024-02-10T08:23:10.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:08.640712+0000 mgr.y (mgr.14505) 244 : cluster [DBG] pgmap v275: 158 pgs: 1 active+recovering+undersized+degraded+remapped, 1 active+undersized+degraded+remapped+backfilling, 156 active+clean; 1.6 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1.12k op/s; 4827/80715 objects degraded (5.980%); 2.2 MiB/s, 34 objects/s recovering 2024-02-10T08:23:10.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:08.640712+0000 mgr.y (mgr.14505) 244 : cluster [DBG] pgmap v275: 158 pgs: 1 active+recovering+undersized+degraded+remapped, 1 active+undersized+degraded+remapped+backfilling, 156 active+clean; 1.6 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1.12k op/s; 4827/80715 objects degraded (5.980%); 2.2 MiB/s, 34 objects/s recovering 2024-02-10T08:23:10.733 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:23:10.746 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:10.746 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:23:10.847 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:23:10.915 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:11.009 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:10.537879+0000 mon.a (mon.0) 989 : cluster [WRN] Health check update: Degraded data redundancy: 4827/80715 objects degraded (5.980%), 2 pgs degraded, 2 pgs undersized (PG_DEGRADED) 2024-02-10T08:23:11.009 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:10.542585+0000 mon.a (mon.0) 990 : cluster [DBG] osdmap e161: 8 total, 8 up, 8 in 2024-02-10T08:23:11.031 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:23:11.036 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:11.036 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:23:11.137 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:23:11.167 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:11.189 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:23:11.192 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:11.193 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:23:11.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:10.537879+0000 mon.a (mon.0) 989 : cluster [WRN] Health check update: Degraded data redundancy: 4827/80715 objects degraded (5.980%), 2 pgs degraded, 2 pgs undersized (PG_DEGRADED) 2024-02-10T08:23:11.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:10.542585+0000 mon.a (mon.0) 990 : cluster [DBG] osdmap e161: 8 total, 8 up, 8 in 2024-02-10T08:23:11.294 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:23:11.325 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:11.346 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:23:11.348 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:11.349 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:23:11.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:10.537879+0000 mon.a (mon.0) 989 : cluster [WRN] Health check update: Degraded data redundancy: 4827/80715 objects degraded (5.980%), 2 pgs degraded, 2 pgs undersized (PG_DEGRADED) 2024-02-10T08:23:11.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:10.542585+0000 mon.a (mon.0) 990 : cluster [DBG] osdmap e161: 8 total, 8 up, 8 in 2024-02-10T08:23:11.450 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:23:11.479 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:11.504 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:23:11.507 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:11.508 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:23:11.608 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:23:11.697 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:11.736 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:23:11.744 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:11.744 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:23:11.762 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:23:11.770 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:23:11.845 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:23:11.879 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:11.902 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:23:11.904 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:11.905 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:23:12.006 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:23:12.041 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is unset 2024-02-10T08:23:12.071 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:12.102 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:23:12.107 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:12.108 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:23:12.209 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:23:12.245 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:10.644077+0000 mgr.y (mgr.14505) 245 : cluster [DBG] pgmap v277: 158 pgs: 1 active+recovering+undersized+degraded+remapped, 1 active+undersized+degraded+remapped+backfilling, 156 active+clean; 1.6 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 625 op/s; 4827/80715 objects degraded (5.980%); 1.2 MiB/s, 19 objects/s recovering 2024-02-10T08:23:12.246 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:23:11.407481+0000 mon.a (mon.0) 991 : audit [INF] from='client.? 172.21.15.18:0/2177237663' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:23:12.248 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:12.274 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:23:12.276 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:12.277 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:23:12.378 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:23:12.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:10.644077+0000 mgr.y (mgr.14505) 245 : cluster [DBG] pgmap v277: 158 pgs: 1 active+recovering+undersized+degraded+remapped, 1 active+undersized+degraded+remapped+backfilling, 156 active+clean; 1.6 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 625 op/s; 4827/80715 objects degraded (5.980%); 1.2 MiB/s, 19 objects/s recovering 2024-02-10T08:23:12.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:23:11.407481+0000 mon.a (mon.0) 991 : audit [INF] from='client.? 172.21.15.18:0/2177237663' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:23:12.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:10.644077+0000 mgr.y (mgr.14505) 245 : cluster [DBG] pgmap v277: 158 pgs: 1 active+recovering+undersized+degraded+remapped, 1 active+undersized+degraded+remapped+backfilling, 156 active+clean; 1.6 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 625 op/s; 4827/80715 objects degraded (5.980%); 1.2 MiB/s, 19 objects/s recovering 2024-02-10T08:23:12.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:23:11.407481+0000 mon.a (mon.0) 991 : audit [INF] from='client.? 172.21.15.18:0/2177237663' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:23:12.412 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:12.436 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:23:12.439 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:12.440 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:23:12.541 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:23:12.610 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:12.803 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:23:12.809 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:12.809 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:23:12.910 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:23:13.004 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:13.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:12.006756+0000 mon.a (mon.0) 992 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:23:13.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:23:12.029688+0000 mon.a (mon.0) 993 : audit [INF] from='client.? 172.21.15.18:0/2177237663' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-10T08:23:13.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:12.029748+0000 mon.a (mon.0) 994 : cluster [DBG] osdmap e162: 8 total, 8 up, 8 in 2024-02-10T08:23:13.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:12.006756+0000 mon.a (mon.0) 992 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:23:13.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:23:12.029688+0000 mon.a (mon.0) 993 : audit [INF] from='client.? 172.21.15.18:0/2177237663' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-10T08:23:13.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:12.029748+0000 mon.a (mon.0) 994 : cluster [DBG] osdmap e162: 8 total, 8 up, 8 in 2024-02-10T08:23:13.218 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:23:13.230 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:13.231 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:23:13.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:12.006756+0000 mon.a (mon.0) 992 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:23:13.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:23:12.029688+0000 mon.a (mon.0) 993 : audit [INF] from='client.? 172.21.15.18:0/2177237663' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-10T08:23:13.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:12.029748+0000 mon.a (mon.0) 994 : cluster [DBG] osdmap e162: 8 total, 8 up, 8 in 2024-02-10T08:23:13.332 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:23:13.422 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:13.543 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:23:13.568 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:13.568 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:23:13.669 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:23:13.748 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:14.324 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:12.644835+0000 mgr.y (mgr.14505) 246 : cluster [DBG] pgmap v279: 158 pgs: 1 active+recovering+undersized+degraded+remapped, 1 active+undersized+degraded+remapped+backfilling, 156 active+clean; 1.5 GiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 887 op/s; 4827/75999 objects degraded (6.351%); 1.2 MiB/s, 19 objects/s recovering 2024-02-10T08:23:14.324 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:23:13.826294+0000 mon.a (mon.0) 995 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd reweightn", "weights": "{'0':'51011','3':'46710'}"}]: dispatch 2024-02-10T08:23:14.324 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:12.644835+0000 mgr.y (mgr.14505) 246 : cluster [DBG] pgmap v279: 158 pgs: 1 active+recovering+undersized+degraded+remapped, 1 active+undersized+degraded+remapped+backfilling, 156 active+clean; 1.5 GiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 887 op/s; 4827/75999 objects degraded (6.351%); 1.2 MiB/s, 19 objects/s recovering 2024-02-10T08:23:14.325 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:23:13.826294+0000 mon.a (mon.0) 995 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd reweightn", "weights": "{'0':'51011','3':'46710'}"}]: dispatch 2024-02-10T08:23:14.439 INFO:teuthology.orchestra.run.smithi018.stdout:moved 32 / 474 (6.75105%) 2024-02-10T08:23:14.439 INFO:teuthology.orchestra.run.smithi018.stdout:avg 59.25 2024-02-10T08:23:14.440 INFO:teuthology.orchestra.run.smithi018.stdout:stddev 5.16599 -> 8.56957 (expected baseline 7.20026) 2024-02-10T08:23:14.440 INFO:teuthology.orchestra.run.smithi018.stdout:min osd.2 with 52 -> 60 pgs (0.877637 -> 1.01266 * mean) 2024-02-10T08:23:14.440 INFO:teuthology.orchestra.run.smithi018.stdout:max osd.3 with 66 -> 50 pgs (1.11392 -> 0.843882 * mean) 2024-02-10T08:23:14.440 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:23:14.440 INFO:teuthology.orchestra.run.smithi018.stdout:oload 110 2024-02-10T08:23:14.440 INFO:teuthology.orchestra.run.smithi018.stdout:max_change 3 2024-02-10T08:23:14.440 INFO:teuthology.orchestra.run.smithi018.stdout:max_change_osds 4 2024-02-10T08:23:14.441 INFO:teuthology.orchestra.run.smithi018.stdout:average_utilization 0.0097 2024-02-10T08:23:14.441 INFO:teuthology.orchestra.run.smithi018.stdout:overload_utilization 0.0106 2024-02-10T08:23:14.441 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3 weight 1.0000 -> 0.7127 2024-02-10T08:23:14.441 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0 weight 1.0000 -> 0.7784 2024-02-10T08:23:14.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:12.644835+0000 mgr.y (mgr.14505) 246 : cluster [DBG] pgmap v279: 158 pgs: 1 active+recovering+undersized+degraded+remapped, 1 active+undersized+degraded+remapped+backfilling, 156 active+clean; 1.5 GiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 887 op/s; 4827/75999 objects degraded (6.351%); 1.2 MiB/s, 19 objects/s recovering 2024-02-10T08:23:14.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:23:13.826294+0000 mon.a (mon.0) 995 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd reweightn", "weights": "{'0':'51011','3':'46710'}"}]: dispatch 2024-02-10T08:23:15.110 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:23:13.824950+0000 mgr.y (mgr.14505) 247 : audit [DBG] from='client.24829 -' entity='client.admin' cmd=[{"prefix": "osd reweight-by-utilization", "oload": 110, "max_change": 3.0, "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:23:15.110 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:23:14.064334+0000 mon.a (mon.0) 996 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd reweightn", "weights": "{'0':'51011','3':'46710'}"}]': finished 2024-02-10T08:23:15.110 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:14.064398+0000 mon.a (mon.0) 997 : cluster [DBG] osdmap e163: 8 total, 8 up, 8 in 2024-02-10T08:23:15.110 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:15.058508+0000 mon.a (mon.0) 998 : cluster [DBG] osdmap e164: 8 total, 8 up, 8 in 2024-02-10T08:23:15.178 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '3.0', 'overage': '110', 'type': 'reweight-by-utilization'} 2024-02-10T08:23:15.179 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd reweight-by-utilization 110 3.0 2024-02-10T08:23:15.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:23:13.824950+0000 mgr.y (mgr.14505) 247 : audit [DBG] from='client.24829 -' entity='client.admin' cmd=[{"prefix": "osd reweight-by-utilization", "oload": 110, "max_change": 3.0, "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:23:15.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:23:14.064334+0000 mon.a (mon.0) 996 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd reweightn", "weights": "{'0':'51011','3':'46710'}"}]': finished 2024-02-10T08:23:15.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:14.064398+0000 mon.a (mon.0) 997 : cluster [DBG] osdmap e163: 8 total, 8 up, 8 in 2024-02-10T08:23:15.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:15.058508+0000 mon.a (mon.0) 998 : cluster [DBG] osdmap e164: 8 total, 8 up, 8 in 2024-02-10T08:23:15.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:23:13.824950+0000 mgr.y (mgr.14505) 247 : audit [DBG] from='client.24829 -' entity='client.admin' cmd=[{"prefix": "osd reweight-by-utilization", "oload": 110, "max_change": 3.0, "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:23:15.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:23:14.064334+0000 mon.a (mon.0) 996 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd reweightn", "weights": "{'0':'51011','3':'46710'}"}]': finished 2024-02-10T08:23:15.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:14.064398+0000 mon.a (mon.0) 997 : cluster [DBG] osdmap e163: 8 total, 8 up, 8 in 2024-02-10T08:23:15.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:15.058508+0000 mon.a (mon.0) 998 : cluster [DBG] osdmap e164: 8 total, 8 up, 8 in 2024-02-10T08:23:16.104 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd unset nodeep-scrub 2024-02-10T08:23:16.121 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:14.645266+0000 mgr.y (mgr.14505) 248 : cluster [DBG] pgmap v281: 158 pgs: 1 active+recovering+undersized+degraded+remapped, 1 active+undersized+degraded+remapped+backfilling, 156 active+clean; 1.4 GiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 625 op/s; 4497/69459 objects degraded (6.474%); 1.2 MiB/s, 19 objects/s recovering 2024-02-10T08:23:16.121 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:15.057145+0000 osd.3 (osd.3) 91 : cluster [DBG] 7.1 starting backfill to osd.1 from (0'0,0'0] MAX to 162'11294 2024-02-10T08:23:16.121 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:15.069129+0000 osd.3 (osd.3) 92 : cluster [INF] 7.1 continuing backfill to osd.4 from (121'6729,162'11294] 7:83c3b405:::benchmark_data_smithi018_80623_object82484:head to 162'11294 2024-02-10T08:23:16.121 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:15.539246+0000 mon.a (mon.0) 999 : cluster [WRN] Health check update: Degraded data redundancy: 4497/69459 objects degraded (6.474%), 2 pgs degraded, 2 pgs undersized (PG_DEGRADED) 2024-02-10T08:23:16.121 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:15.543908+0000 mon.a (mon.0) 1000 : cluster [DBG] osdmap e165: 8 total, 8 up, 8 in 2024-02-10T08:23:16.122 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:15.546286+0000 osd.2 (osd.2) 65 : cluster [DBG] 7.e starting backfill to osd.3 from (0'0,0'0] MAX to 162'11229 2024-02-10T08:23:16.122 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:15.546716+0000 osd.7 (osd.7) 77 : cluster [DBG] 7.f starting backfill to osd.4 from (0'0,0'0] MAX to 162'11174 2024-02-10T08:23:16.122 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:15.547999+0000 osd.0 (osd.0) 75 : cluster [DBG] 7.6 starting backfill to osd.5 from (0'0,0'0] MAX to 162'11038 2024-02-10T08:23:16.122 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:15.548502+0000 osd.7 (osd.7) 78 : cluster [DBG] 7.5 starting backfill to osd.1 from (0'0,0'0] MAX to 162'11289 2024-02-10T08:23:16.122 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:15.552525+0000 osd.4 (osd.4) 7 : cluster [DBG] 7.4 starting backfill to osd.6 from (0'0,0'0] MAX to 162'11234 2024-02-10T08:23:16.407 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:14.645266+0000 mgr.y (mgr.14505) 248 : cluster [DBG] pgmap v281: 158 pgs: 1 active+recovering+undersized+degraded+remapped, 1 active+undersized+degraded+remapped+backfilling, 156 active+clean; 1.4 GiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 625 op/s; 4497/69459 objects degraded (6.474%); 1.2 MiB/s, 19 objects/s recovering 2024-02-10T08:23:16.407 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:15.057145+0000 osd.3 (osd.3) 91 : cluster [DBG] 7.1 starting backfill to osd.1 from (0'0,0'0] MAX to 162'11294 2024-02-10T08:23:16.408 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:15.069129+0000 osd.3 (osd.3) 92 : cluster [INF] 7.1 continuing backfill to osd.4 from (121'6729,162'11294] 7:83c3b405:::benchmark_data_smithi018_80623_object82484:head to 162'11294 2024-02-10T08:23:16.408 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:15.539246+0000 mon.a (mon.0) 999 : cluster [WRN] Health check update: Degraded data redundancy: 4497/69459 objects degraded (6.474%), 2 pgs degraded, 2 pgs undersized (PG_DEGRADED) 2024-02-10T08:23:16.408 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:15.543908+0000 mon.a (mon.0) 1000 : cluster [DBG] osdmap e165: 8 total, 8 up, 8 in 2024-02-10T08:23:16.408 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:15.546286+0000 osd.2 (osd.2) 65 : cluster [DBG] 7.e starting backfill to osd.3 from (0'0,0'0] MAX to 162'11229 2024-02-10T08:23:16.408 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:15.546716+0000 osd.7 (osd.7) 77 : cluster [DBG] 7.f starting backfill to osd.4 from (0'0,0'0] MAX to 162'11174 2024-02-10T08:23:16.408 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:15.547999+0000 osd.0 (osd.0) 75 : cluster [DBG] 7.6 starting backfill to osd.5 from (0'0,0'0] MAX to 162'11038 2024-02-10T08:23:16.408 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:15.548502+0000 osd.7 (osd.7) 78 : cluster [DBG] 7.5 starting backfill to osd.1 from (0'0,0'0] MAX to 162'11289 2024-02-10T08:23:16.408 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:15.552525+0000 osd.4 (osd.4) 7 : cluster [DBG] 7.4 starting backfill to osd.6 from (0'0,0'0] MAX to 162'11234 2024-02-10T08:23:16.535 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:23:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:23:16] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:23:16.537 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:14.645266+0000 mgr.y (mgr.14505) 248 : cluster [DBG] pgmap v281: 158 pgs: 1 active+recovering+undersized+degraded+remapped, 1 active+undersized+degraded+remapped+backfilling, 156 active+clean; 1.4 GiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 625 op/s; 4497/69459 objects degraded (6.474%); 1.2 MiB/s, 19 objects/s recovering 2024-02-10T08:23:16.537 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:15.057145+0000 osd.3 (osd.3) 91 : cluster [DBG] 7.1 starting backfill to osd.1 from (0'0,0'0] MAX to 162'11294 2024-02-10T08:23:16.537 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:15.069129+0000 osd.3 (osd.3) 92 : cluster [INF] 7.1 continuing backfill to osd.4 from (121'6729,162'11294] 7:83c3b405:::benchmark_data_smithi018_80623_object82484:head to 162'11294 2024-02-10T08:23:16.537 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:15.539246+0000 mon.a (mon.0) 999 : cluster [WRN] Health check update: Degraded data redundancy: 4497/69459 objects degraded (6.474%), 2 pgs degraded, 2 pgs undersized (PG_DEGRADED) 2024-02-10T08:23:16.537 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:15.543908+0000 mon.a (mon.0) 1000 : cluster [DBG] osdmap e165: 8 total, 8 up, 8 in 2024-02-10T08:23:16.537 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:15.546286+0000 osd.2 (osd.2) 65 : cluster [DBG] 7.e starting backfill to osd.3 from (0'0,0'0] MAX to 162'11229 2024-02-10T08:23:16.537 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:15.546716+0000 osd.7 (osd.7) 77 : cluster [DBG] 7.f starting backfill to osd.4 from (0'0,0'0] MAX to 162'11174 2024-02-10T08:23:16.537 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:15.547999+0000 osd.0 (osd.0) 75 : cluster [DBG] 7.6 starting backfill to osd.5 from (0'0,0'0] MAX to 162'11038 2024-02-10T08:23:16.537 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:15.548502+0000 osd.7 (osd.7) 78 : cluster [DBG] 7.5 starting backfill to osd.1 from (0'0,0'0] MAX to 162'11289 2024-02-10T08:23:16.538 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:15.552525+0000 osd.4 (osd.4) 7 : cluster [DBG] 7.4 starting backfill to osd.6 from (0'0,0'0] MAX to 162'11234 2024-02-10T08:23:17.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:15.544909+0000 osd.6 (osd.6) 51 : cluster [DBG] 7.c starting backfill to osd.2 from (0'0,0'0] MAX to 162'11520 2024-02-10T08:23:17.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:23:16.732698+0000 mon.a (mon.0) 1001 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:23:17.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:23:17.099355+0000 mon.a (mon.0) 1002 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:23:17.405 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:23:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:23:17] "GET /metrics HTTP/1.1" 200 175680 "" "Prometheus/2.33.4" 2024-02-10T08:23:17.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:15.544909+0000 osd.6 (osd.6) 51 : cluster [DBG] 7.c starting backfill to osd.2 from (0'0,0'0] MAX to 162'11520 2024-02-10T08:23:17.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:23:16.732698+0000 mon.a (mon.0) 1001 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:23:17.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:23:17.099355+0000 mon.a (mon.0) 1002 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:23:17.544 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:15.544909+0000 osd.6 (osd.6) 51 : cluster [DBG] 7.c starting backfill to osd.2 from (0'0,0'0] MAX to 162'11520 2024-02-10T08:23:17.544 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:23:16.732698+0000 mon.a (mon.0) 1001 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:23:17.544 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:23:17.099355+0000 mon.a (mon.0) 1002 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:23:18.141 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:16.650894+0000 mgr.y (mgr.14505) 249 : cluster [DBG] pgmap v284: 158 pgs: 3 peering, 1 active+recovering+undersized+degraded+remapped, 1 active+undersized+degraded+remapped+backfilling, 153 active+clean; 1.4 GiB data, 6.5 GiB used, 709 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 824 op/s; 4497/69303 objects degraded (6.489%); 1.6 MiB/s, 25 objects/s recovering 2024-02-10T08:23:18.142 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:23:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:23:18.330 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:23:18.339 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:18.340 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:23:18.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:16.650894+0000 mgr.y (mgr.14505) 249 : cluster [DBG] pgmap v284: 158 pgs: 3 peering, 1 active+recovering+undersized+degraded+remapped, 1 active+undersized+degraded+remapped+backfilling, 153 active+clean; 1.4 GiB data, 6.5 GiB used, 709 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 824 op/s; 4497/69303 objects degraded (6.489%); 1.6 MiB/s, 25 objects/s recovering 2024-02-10T08:23:18.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:16.650894+0000 mgr.y (mgr.14505) 249 : cluster [DBG] pgmap v284: 158 pgs: 3 peering, 1 active+recovering+undersized+degraded+remapped, 1 active+undersized+degraded+remapped+backfilling, 153 active+clean; 1.4 GiB data, 6.5 GiB used, 709 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 824 op/s; 4497/69303 objects degraded (6.489%); 1.6 MiB/s, 25 objects/s recovering 2024-02-10T08:23:18.441 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:23:18.491 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:18.536 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:23:18.540 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:18.541 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:23:18.641 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:23:18.697 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:18.719 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:23:18.722 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:18.722 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:23:18.823 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:23:18.866 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:18.897 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:23:18.900 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:18.901 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:23:19.002 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:23:19.110 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:19.407 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:23:17.828555+0000 mgr.y (mgr.14505) 250 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:23:19.408 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:23:17.828555+0000 mgr.y (mgr.14505) 250 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:23:19.543 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:23:17.828555+0000 mgr.y (mgr.14505) 250 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:23:20.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:18.651754+0000 mgr.y (mgr.14505) 251 : cluster [DBG] pgmap v285: 158 pgs: 5 active+remapped+backfilling, 3 peering, 1 active+recovering+undersized+degraded+remapped, 1 active+undersized+degraded+remapped+backfilling, 148 active+clean; 1.3 GiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 681 B/s rd, 0 B/s wr, 737 op/s; 4310/62718 objects degraded (6.872%); 7573/62718 objects misplaced (12.075%); 4.2 MiB/s, 72 objects/s recovering 2024-02-10T08:23:20.657 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:18.651754+0000 mgr.y (mgr.14505) 251 : cluster [DBG] pgmap v285: 158 pgs: 5 active+remapped+backfilling, 3 peering, 1 active+recovering+undersized+degraded+remapped, 1 active+undersized+degraded+remapped+backfilling, 148 active+clean; 1.3 GiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 681 B/s rd, 0 B/s wr, 737 op/s; 4310/62718 objects degraded (6.872%); 7573/62718 objects misplaced (12.075%); 4.2 MiB/s, 72 objects/s recovering 2024-02-10T08:23:20.657 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:18.651754+0000 mgr.y (mgr.14505) 251 : cluster [DBG] pgmap v285: 158 pgs: 5 active+remapped+backfilling, 3 peering, 1 active+recovering+undersized+degraded+remapped, 1 active+undersized+degraded+remapped+backfilling, 148 active+clean; 1.3 GiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 681 B/s rd, 0 B/s wr, 737 op/s; 4310/62718 objects degraded (6.872%); 7573/62718 objects misplaced (12.075%); 4.2 MiB/s, 72 objects/s recovering 2024-02-10T08:23:21.545 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:20.540709+0000 mon.a (mon.0) 1003 : cluster [WRN] Health check update: Degraded data redundancy: 4310/62718 objects degraded (6.872%), 2 pgs degraded, 1 pg undersized (PG_DEGRADED) 2024-02-10T08:23:21.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:20.540709+0000 mon.a (mon.0) 1003 : cluster [WRN] Health check update: Degraded data redundancy: 4310/62718 objects degraded (6.872%), 2 pgs degraded, 1 pg undersized (PG_DEGRADED) 2024-02-10T08:23:21.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:20.540709+0000 mon.a (mon.0) 1003 : cluster [WRN] Health check update: Degraded data redundancy: 4310/62718 objects degraded (6.872%), 2 pgs degraded, 1 pg undersized (PG_DEGRADED) 2024-02-10T08:23:22.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:20.653921+0000 mgr.y (mgr.14505) 252 : cluster [DBG] pgmap v286: 158 pgs: 1 active+remapped+backfill_toofull, 5 active+remapped+backfilling, 1 active+recovering+undersized+degraded+remapped, 1 active+undersized+degraded+remapped+backfilling, 150 active+clean; 1.3 GiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 621 B/s rd, 0 B/s wr, 365 op/s; 4310/62241 objects degraded (6.925%); 8738/62241 objects misplaced (14.039%); 2.8 MiB/s, 49 objects/s recovering 2024-02-10T08:23:22.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:21.576471+0000 mon.a (mon.0) 1004 : cluster [WRN] Health check failed: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull (PG_BACKFILL_FULL) 2024-02-10T08:23:22.657 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:20.653921+0000 mgr.y (mgr.14505) 252 : cluster [DBG] pgmap v286: 158 pgs: 1 active+remapped+backfill_toofull, 5 active+remapped+backfilling, 1 active+recovering+undersized+degraded+remapped, 1 active+undersized+degraded+remapped+backfilling, 150 active+clean; 1.3 GiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 621 B/s rd, 0 B/s wr, 365 op/s; 4310/62241 objects degraded (6.925%); 8738/62241 objects misplaced (14.039%); 2.8 MiB/s, 49 objects/s recovering 2024-02-10T08:23:22.657 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:21.576471+0000 mon.a (mon.0) 1004 : cluster [WRN] Health check failed: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull (PG_BACKFILL_FULL) 2024-02-10T08:23:22.658 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:20.653921+0000 mgr.y (mgr.14505) 252 : cluster [DBG] pgmap v286: 158 pgs: 1 active+remapped+backfill_toofull, 5 active+remapped+backfilling, 1 active+recovering+undersized+degraded+remapped, 1 active+undersized+degraded+remapped+backfilling, 150 active+clean; 1.3 GiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 621 B/s rd, 0 B/s wr, 365 op/s; 4310/62241 objects degraded (6.925%); 8738/62241 objects misplaced (14.039%); 2.8 MiB/s, 49 objects/s recovering 2024-02-10T08:23:22.658 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:21.576471+0000 mon.a (mon.0) 1004 : cluster [WRN] Health check failed: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull (PG_BACKFILL_FULL) 2024-02-10T08:23:23.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:22.515091+0000 osd.2 (osd.2) 66 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:23:23.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:22.515138+0000 osd.2 (osd.2) 67 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:23:23.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:22.515091+0000 osd.2 (osd.2) 66 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:23:23.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:22.515138+0000 osd.2 (osd.2) 67 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:23:23.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:22.515091+0000 osd.2 (osd.2) 66 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:23:23.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:22.515138+0000 osd.2 (osd.2) 67 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:23:24.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:22.657129+0000 mgr.y (mgr.14505) 253 : cluster [DBG] pgmap v287: 158 pgs: 1 active+remapped+backfill_toofull, 5 active+remapped+backfilling, 1 active+recovering+undersized+degraded+remapped, 1 active+undersized+degraded+remapped+backfilling, 150 active+clean; 1.2 GiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 513 op/s; 4310/57153 objects degraded (7.541%); 7937/57153 objects misplaced (13.887%); 3.6 MiB/s, 62 objects/s recovering 2024-02-10T08:23:24.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:23.223267+0000 mon.a (mon.0) 1005 : cluster [DBG] osdmap e166: 8 total, 8 up, 8 in 2024-02-10T08:23:24.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:22.657129+0000 mgr.y (mgr.14505) 253 : cluster [DBG] pgmap v287: 158 pgs: 1 active+remapped+backfill_toofull, 5 active+remapped+backfilling, 1 active+recovering+undersized+degraded+remapped, 1 active+undersized+degraded+remapped+backfilling, 150 active+clean; 1.2 GiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 513 op/s; 4310/57153 objects degraded (7.541%); 7937/57153 objects misplaced (13.887%); 3.6 MiB/s, 62 objects/s recovering 2024-02-10T08:23:24.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:23.223267+0000 mon.a (mon.0) 1005 : cluster [DBG] osdmap e166: 8 total, 8 up, 8 in 2024-02-10T08:23:24.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:22.657129+0000 mgr.y (mgr.14505) 253 : cluster [DBG] pgmap v287: 158 pgs: 1 active+remapped+backfill_toofull, 5 active+remapped+backfilling, 1 active+recovering+undersized+degraded+remapped, 1 active+undersized+degraded+remapped+backfilling, 150 active+clean; 1.2 GiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 513 op/s; 4310/57153 objects degraded (7.541%); 7937/57153 objects misplaced (13.887%); 3.6 MiB/s, 62 objects/s recovering 2024-02-10T08:23:24.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:23.223267+0000 mon.a (mon.0) 1005 : cluster [DBG] osdmap e166: 8 total, 8 up, 8 in 2024-02-10T08:23:25.464 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:23:25.468 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:25.469 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:23:25.511 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:24.146983+0000 osd.7 (osd.7) 79 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:23:25.511 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:24.147037+0000 osd.7 (osd.7) 80 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:23:25.511 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:24.238413+0000 mon.a (mon.0) 1006 : cluster [DBG] osdmap e167: 8 total, 8 up, 8 in 2024-02-10T08:23:25.511 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:24.657492+0000 mgr.y (mgr.14505) 254 : cluster [DBG] pgmap v290: 158 pgs: 1 active+remapped+backfill_toofull, 5 active+remapped+backfilling, 1 active+recovering+undersized+degraded+remapped, 1 active+undersized+degraded+remapped+backfilling, 150 active+clean; 1.1 GiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 686 op/s; 4118/52848 objects degraded (7.792%); 6918/52848 objects misplaced (13.090%); 7.4 MiB/s, 129 objects/s recovering 2024-02-10T08:23:25.513 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:24.146983+0000 osd.7 (osd.7) 79 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:23:25.513 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:24.147037+0000 osd.7 (osd.7) 80 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:23:25.513 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:24.238413+0000 mon.a (mon.0) 1006 : cluster [DBG] osdmap e167: 8 total, 8 up, 8 in 2024-02-10T08:23:25.513 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:24.657492+0000 mgr.y (mgr.14505) 254 : cluster [DBG] pgmap v290: 158 pgs: 1 active+remapped+backfill_toofull, 5 active+remapped+backfilling, 1 active+recovering+undersized+degraded+remapped, 1 active+undersized+degraded+remapped+backfilling, 150 active+clean; 1.1 GiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 686 op/s; 4118/52848 objects degraded (7.792%); 6918/52848 objects misplaced (13.090%); 7.4 MiB/s, 129 objects/s recovering 2024-02-10T08:23:25.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:24.146983+0000 osd.7 (osd.7) 79 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:23:25.542 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:24.147037+0000 osd.7 (osd.7) 80 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:23:25.542 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:24.238413+0000 mon.a (mon.0) 1006 : cluster [DBG] osdmap e167: 8 total, 8 up, 8 in 2024-02-10T08:23:25.542 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:24.657492+0000 mgr.y (mgr.14505) 254 : cluster [DBG] pgmap v290: 158 pgs: 1 active+remapped+backfill_toofull, 5 active+remapped+backfilling, 1 active+recovering+undersized+degraded+remapped, 1 active+undersized+degraded+remapped+backfilling, 150 active+clean; 1.1 GiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 686 op/s; 4118/52848 objects degraded (7.792%); 6918/52848 objects misplaced (13.090%); 7.4 MiB/s, 129 objects/s recovering 2024-02-10T08:23:25.570 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:23:25.617 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:25.646 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:23:25.652 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:25.653 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:23:25.754 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:23:25.849 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:26.091 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:23:26.095 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:26.096 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:23:26.197 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:23:26.251 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:26.284 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:23:26.296 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:26.297 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:23:26.330 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:23:26.398 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:23:26.401 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:23:26.442 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:26.450 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:23:26.469 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:23:26.474 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:26.474 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:23:26.499 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:23:26.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:25.544108+0000 mon.a (mon.0) 1007 : cluster [WRN] Health check update: Degraded data redundancy: 4118/52848 objects degraded (7.792%), 2 pgs degraded, 1 pg undersized (PG_DEGRADED) 2024-02-10T08:23:26.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:23:26.100623+0000 mon.a (mon.0) 1008 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:23:26.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:23:26.103255+0000 mon.a (mon.0) 1009 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:23:26.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:23:26.142598+0000 mon.a (mon.0) 1010 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:23:26.520 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:23:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:23:26] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:23:26.546 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:23:26.571 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:25.544108+0000 mon.a (mon.0) 1007 : cluster [WRN] Health check update: Degraded data redundancy: 4118/52848 objects degraded (7.792%), 2 pgs degraded, 1 pg undersized (PG_DEGRADED) 2024-02-10T08:23:26.571 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:23:26.100623+0000 mon.a (mon.0) 1008 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:23:26.571 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:23:26.103255+0000 mon.a (mon.0) 1009 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:23:26.571 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:23:26.142598+0000 mon.a (mon.0) 1010 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:23:26.573 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:25.544108+0000 mon.a (mon.0) 1007 : cluster [WRN] Health check update: Degraded data redundancy: 4118/52848 objects degraded (7.792%), 2 pgs degraded, 1 pg undersized (PG_DEGRADED) 2024-02-10T08:23:26.573 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:23:26.100623+0000 mon.a (mon.0) 1008 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:23:26.574 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:23:26.103255+0000 mon.a (mon.0) 1009 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:23:26.574 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:23:26.142598+0000 mon.a (mon.0) 1010 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:23:26.575 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:23:26.592 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:23:26.606 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:26.637 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:23:26.640 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:23:26.643 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:26.644 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:23:26.683 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:23:26.717 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-10T08:23:26.717 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-10T08:23:26.717 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-10T08:23:26.717 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-10T08:23:26.717 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-10T08:23:26.717 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-10T08:23:26.717 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-10T08:23:26.717 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-10T08:23:26.745 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:23:26.826 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:27.295 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-02-10T08:23:27.295 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:23:27.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:23:26.265868+0000 mon.a (mon.0) 1011 : audit [DBG] from='client.? 172.21.15.18:0/3415403900' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:23:27.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:26.660045+0000 mgr.y (mgr.14505) 255 : cluster [DBG] pgmap v291: 158 pgs: 1 active+remapped+backfill_toofull, 5 active+remapped+backfilling, 1 active+recovering+undersized+degraded+remapped, 1 active+undersized+degraded+remapped+backfilling, 150 active+clean; 1.1 GiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 438 op/s; 4118/52209 objects degraded (7.888%); 6705/52209 objects misplaced (12.843%); 5.1 MiB/s, 89 objects/s recovering 2024-02-10T08:23:27.413 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:23:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:23:27] "GET /metrics HTTP/1.1" 200 175680 "" "Prometheus/2.33.4" 2024-02-10T08:23:27.414 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:23:26.265868+0000 mon.a (mon.0) 1011 : audit [DBG] from='client.? 172.21.15.18:0/3415403900' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:23:27.414 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:26.660045+0000 mgr.y (mgr.14505) 255 : cluster [DBG] pgmap v291: 158 pgs: 1 active+remapped+backfill_toofull, 5 active+remapped+backfilling, 1 active+recovering+undersized+degraded+remapped, 1 active+undersized+degraded+remapped+backfilling, 150 active+clean; 1.1 GiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 438 op/s; 4118/52209 objects degraded (7.888%); 6705/52209 objects misplaced (12.843%); 5.1 MiB/s, 89 objects/s recovering 2024-02-10T08:23:27.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:23:26.265868+0000 mon.a (mon.0) 1011 : audit [DBG] from='client.? 172.21.15.18:0/3415403900' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:23:27.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:26.660045+0000 mgr.y (mgr.14505) 255 : cluster [DBG] pgmap v291: 158 pgs: 1 active+remapped+backfill_toofull, 5 active+remapped+backfilling, 1 active+recovering+undersized+degraded+remapped, 1 active+undersized+degraded+remapped+backfilling, 150 active+clean; 1.1 GiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 438 op/s; 4118/52209 objects degraded (7.888%); 6705/52209 objects misplaced (12.843%); 5.1 MiB/s, 89 objects/s recovering 2024-02-10T08:23:28.230 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:23:28.237 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:23:28.240 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:28.240 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:23:28.286 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:23:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:23:28.286 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:23:27.838479+0000 mgr.y (mgr.14505) 256 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:23:28.342 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:23:28.390 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:28.415 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:23:28.417 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:28.418 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:23:28.519 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:23:28.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:23:27.838479+0000 mgr.y (mgr.14505) 256 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:23:28.596 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:23:27.838479+0000 mgr.y (mgr.14505) 256 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:23:28.598 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:28.726 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:23:28.734 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:28.735 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:23:28.771 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.1 dump_blocked_ops 2024-02-10T08:23:28.835 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:23:28.844 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:23:28.944 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:28.999 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:23:29.013 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:29.014 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:23:29.115 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:23:29.222 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:29.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:28.660842+0000 mgr.y (mgr.14505) 257 : cluster [DBG] pgmap v292: 158 pgs: 1 active+remapped+backfill_toofull, 5 active+remapped+backfilling, 1 active+recovering+undersized+degraded+remapped, 1 active+undersized+degraded+remapped+backfilling, 150 active+clean; 887 MiB data, 5.0 GiB used, 710 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 795 op/s; 3898/43158 objects degraded (9.032%); 4982/43158 objects misplaced (11.544%); 11 MiB/s, 186 objects/s recovering 2024-02-10T08:23:29.407 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:28.660842+0000 mgr.y (mgr.14505) 257 : cluster [DBG] pgmap v292: 158 pgs: 1 active+remapped+backfill_toofull, 5 active+remapped+backfilling, 1 active+recovering+undersized+degraded+remapped, 1 active+undersized+degraded+remapped+backfilling, 150 active+clean; 887 MiB data, 5.0 GiB used, 710 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 795 op/s; 3898/43158 objects degraded (9.032%); 4982/43158 objects misplaced (11.544%); 11 MiB/s, 186 objects/s recovering 2024-02-10T08:23:29.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:28.660842+0000 mgr.y (mgr.14505) 257 : cluster [DBG] pgmap v292: 158 pgs: 1 active+remapped+backfill_toofull, 5 active+remapped+backfilling, 1 active+recovering+undersized+degraded+remapped, 1 active+undersized+degraded+remapped+backfilling, 150 active+clean; 887 MiB data, 5.0 GiB used, 710 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 795 op/s; 3898/43158 objects degraded (9.032%); 4982/43158 objects misplaced (11.544%); 11 MiB/s, 186 objects/s recovering 2024-02-10T08:23:30.257 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-10T08:23:30.516 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:23:30.546 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:30.547 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:23:30.648 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:23:30.683 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:30.719 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:23:30.724 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:30.725 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:23:30.825 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:23:30.875 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:30.911 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:23:30.913 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:30.914 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:23:31.015 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:23:31.126 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:31.196 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:23:31.199 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:31.199 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:23:31.300 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:23:31.374 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:30.334218+0000 mon.a (mon.0) 1012 : cluster [DBG] osdmap e168: 8 total, 8 up, 8 in 2024-02-10T08:23:31.374 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:30.552826+0000 mon.a (mon.0) 1013 : cluster [WRN] Health check update: Degraded data redundancy: 3898/43158 objects degraded (9.032%), 2 pgs degraded, 1 pg undersized (PG_DEGRADED) 2024-02-10T08:23:31.374 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:30.559748+0000 mon.a (mon.0) 1014 : cluster [DBG] osdmap e169: 8 total, 8 up, 8 in 2024-02-10T08:23:31.374 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:30.661318+0000 mgr.y (mgr.14505) 258 : cluster [DBG] pgmap v295: 158 pgs: 1 active+remapped+backfill_toofull, 5 active+remapped+backfilling, 1 active+recovering+undersized+degraded+remapped, 1 active+undersized+degraded+remapped+backfilling, 150 active+clean; 874 MiB data, 5.0 GiB used, 710 GiB / 715 GiB avail; 797 B/s rd, 0 B/s wr, 535 op/s; 3898/42534 objects degraded (9.164%); 4774/42534 objects misplaced (11.224%); 7.0 MiB/s, 120 objects/s recovering 2024-02-10T08:23:31.374 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:30.334218+0000 mon.a (mon.0) 1012 : cluster [DBG] osdmap e168: 8 total, 8 up, 8 in 2024-02-10T08:23:31.374 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:30.552826+0000 mon.a (mon.0) 1013 : cluster [WRN] Health check update: Degraded data redundancy: 3898/43158 objects degraded (9.032%), 2 pgs degraded, 1 pg undersized (PG_DEGRADED) 2024-02-10T08:23:31.375 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:30.559748+0000 mon.a (mon.0) 1014 : cluster [DBG] osdmap e169: 8 total, 8 up, 8 in 2024-02-10T08:23:31.375 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:30.661318+0000 mgr.y (mgr.14505) 258 : cluster [DBG] pgmap v295: 158 pgs: 1 active+remapped+backfill_toofull, 5 active+remapped+backfilling, 1 active+recovering+undersized+degraded+remapped, 1 active+undersized+degraded+remapped+backfilling, 150 active+clean; 874 MiB data, 5.0 GiB used, 710 GiB / 715 GiB avail; 797 B/s rd, 0 B/s wr, 535 op/s; 3898/42534 objects degraded (9.164%); 4774/42534 objects misplaced (11.224%); 7.0 MiB/s, 120 objects/s recovering 2024-02-10T08:23:31.382 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:31.411 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:23:31.427 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:31.428 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:23:31.529 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:23:31.622 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:31.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:30.334218+0000 mon.a (mon.0) 1012 : cluster [DBG] osdmap e168: 8 total, 8 up, 8 in 2024-02-10T08:23:31.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:30.552826+0000 mon.a (mon.0) 1013 : cluster [WRN] Health check update: Degraded data redundancy: 3898/43158 objects degraded (9.032%), 2 pgs degraded, 1 pg undersized (PG_DEGRADED) 2024-02-10T08:23:31.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:30.559748+0000 mon.a (mon.0) 1014 : cluster [DBG] osdmap e169: 8 total, 8 up, 8 in 2024-02-10T08:23:31.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:30.661318+0000 mgr.y (mgr.14505) 258 : cluster [DBG] pgmap v295: 158 pgs: 1 active+remapped+backfill_toofull, 5 active+remapped+backfilling, 1 active+recovering+undersized+degraded+remapped, 1 active+undersized+degraded+remapped+backfilling, 150 active+clean; 874 MiB data, 5.0 GiB used, 710 GiB / 715 GiB avail; 797 B/s rd, 0 B/s wr, 535 op/s; 3898/42534 objects degraded (9.164%); 4774/42534 objects misplaced (11.224%); 7.0 MiB/s, 120 objects/s recovering 2024-02-10T08:23:31.895 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:23:31.898 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:31.898 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:23:31.999 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:23:32.061 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:32.217 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:32.217 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:23:32.218 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:23:32.318 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:23:32.360 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:32.405 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:23:32.409 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:32.410 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:23:32.511 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:23:32.551 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:32.583 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:23:32.586 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:32.587 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:23:32.641 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:31.471371+0000 osd.0 (osd.0) 76 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:23:32.641 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:31.471414+0000 osd.0 (osd.0) 77 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:23:32.688 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:23:32.726 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:32.763 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:23:32.767 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:32.768 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:23:32.868 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:23:32.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:31.471371+0000 osd.0 (osd.0) 76 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:23:32.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:31.471414+0000 osd.0 (osd.0) 77 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:23:32.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:23:31.634537+0000 mon.a (mon.0) 1015 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:23:32.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:32.347533+0000 mon.a (mon.0) 1016 : cluster [DBG] osdmap e170: 8 total, 8 up, 8 in 2024-02-10T08:23:32.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:31.471371+0000 osd.0 (osd.0) 76 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:23:32.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:31.471414+0000 osd.0 (osd.0) 77 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:23:32.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:23:31.634537+0000 mon.a (mon.0) 1015 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:23:32.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:32.347533+0000 mon.a (mon.0) 1016 : cluster [DBG] osdmap e170: 8 total, 8 up, 8 in 2024-02-10T08:23:33.025 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:33.041 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:23:31.634537+0000 mon.a (mon.0) 1015 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:23:33.041 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:32.347533+0000 mon.a (mon.0) 1016 : cluster [DBG] osdmap e170: 8 total, 8 up, 8 in 2024-02-10T08:23:33.093 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:23:33.108 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:33.109 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:23:33.152 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:23:33.209 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:23:33.242 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:33.279 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:23:33.283 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:33.284 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:23:33.385 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:23:33.445 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:33.490 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:23:33.492 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:33.493 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:23:33.506 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:23:33.594 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:23:33.661 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:33.703 INFO:teuthology.orchestra.run.smithi018.stdout:moved 29 / 474 (6.11814%) 2024-02-10T08:23:33.703 INFO:teuthology.orchestra.run.smithi018.stdout:avg 59.25 2024-02-10T08:23:33.703 INFO:teuthology.orchestra.run.smithi018.stdout:stddev 8.56957 -> 15.5704 (expected baseline 7.20026) 2024-02-10T08:23:33.703 INFO:teuthology.orchestra.run.smithi018.stdout:min osd.0 with 43 -> 36 pgs (0.725738 -> 0.607595 * mean) 2024-02-10T08:23:33.703 INFO:teuthology.orchestra.run.smithi018.stdout:max osd.1 with 70 -> 76 pgs (1.18143 -> 1.2827 * mean) 2024-02-10T08:23:33.703 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:23:33.703 INFO:teuthology.orchestra.run.smithi018.stdout:oload 110 2024-02-10T08:23:33.703 INFO:teuthology.orchestra.run.smithi018.stdout:max_change 3 2024-02-10T08:23:33.703 INFO:teuthology.orchestra.run.smithi018.stdout:max_change_osds 4 2024-02-10T08:23:33.703 INFO:teuthology.orchestra.run.smithi018.stdout:average_utilization 0.0066 2024-02-10T08:23:33.704 INFO:teuthology.orchestra.run.smithi018.stdout:overload_utilization 0.0073 2024-02-10T08:23:33.704 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3 weight 0.7127 -> 0.5121 2024-02-10T08:23:33.704 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0 weight 0.7784 -> 0.6357 2024-02-10T08:23:33.733 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is unset 2024-02-10T08:23:33.759 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:32.662106+0000 mgr.y (mgr.14505) 259 : cluster [DBG] pgmap v297: 158 pgs: 1 active+remapped+backfill_toofull, 5 active+remapped+backfilling, 1 active+recovering+undersized+degraded+remapped, 1 active+undersized+degraded+remapped+backfilling, 150 active+clean; 772 MiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 810 op/s; 3898/37641 objects degraded (10.356%); 4104/37641 objects misplaced (10.903%); 9.3 MiB/s, 158 objects/s recovering 2024-02-10T08:23:33.759 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:23:33.209373+0000 mon.a (mon.0) 1017 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd reweightn", "weights": "{'0':'41659','3':'33564'}"}]: dispatch 2024-02-10T08:23:33.759 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:23:33.301104+0000 mon.a (mon.0) 1018 : audit [INF] from='client.? 172.21.15.18:0/3115642172' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:23:33.759 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:32.662106+0000 mgr.y (mgr.14505) 259 : cluster [DBG] pgmap v297: 158 pgs: 1 active+remapped+backfill_toofull, 5 active+remapped+backfilling, 1 active+recovering+undersized+degraded+remapped, 1 active+undersized+degraded+remapped+backfilling, 150 active+clean; 772 MiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 810 op/s; 3898/37641 objects degraded (10.356%); 4104/37641 objects misplaced (10.903%); 9.3 MiB/s, 158 objects/s recovering 2024-02-10T08:23:33.759 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:23:33.209373+0000 mon.a (mon.0) 1017 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd reweightn", "weights": "{'0':'41659','3':'33564'}"}]: dispatch 2024-02-10T08:23:33.759 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:23:33.301104+0000 mon.a (mon.0) 1018 : audit [INF] from='client.? 172.21.15.18:0/3115642172' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:23:33.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:32.662106+0000 mgr.y (mgr.14505) 259 : cluster [DBG] pgmap v297: 158 pgs: 1 active+remapped+backfill_toofull, 5 active+remapped+backfilling, 1 active+recovering+undersized+degraded+remapped, 1 active+undersized+degraded+remapped+backfilling, 150 active+clean; 772 MiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 810 op/s; 3898/37641 objects degraded (10.356%); 4104/37641 objects misplaced (10.903%); 9.3 MiB/s, 158 objects/s recovering 2024-02-10T08:23:33.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:23:33.209373+0000 mon.a (mon.0) 1017 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd reweightn", "weights": "{'0':'41659','3':'33564'}"}]: dispatch 2024-02-10T08:23:33.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:23:33.301104+0000 mon.a (mon.0) 1018 : audit [INF] from='client.? 172.21.15.18:0/3115642172' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:23:33.831 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:23:33.833 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:33.834 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:23:33.935 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:23:33.964 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:34.167 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:23:34.170 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:34.171 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:23:34.271 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:23:34.299 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:34.397 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:23:34.400 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:34.401 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:23:34.501 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:23:34.527 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:34.552 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:23:34.554 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:34.555 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:23:34.656 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:23:34.681 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:34.712 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:23:34.721 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:34.721 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:23:34.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:23:33.205175+0000 mgr.y (mgr.14505) 260 : audit [DBG] from='client.24842 -' entity='client.admin' cmd=[{"prefix": "osd reweight-by-utilization", "oload": 110, "max_change": 3.0, "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:23:34.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:33.644200+0000 mon.a (mon.0) 1019 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-10T08:23:34.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:23:33.697022+0000 mon.a (mon.0) 1020 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd reweightn", "weights": "{'0':'41659','3':'33564'}"}]': finished 2024-02-10T08:23:34.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:23:33.697087+0000 mon.a (mon.0) 1021 : audit [INF] from='client.? 172.21.15.18:0/3115642172' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-10T08:23:34.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:33.697137+0000 mon.a (mon.0) 1022 : cluster [DBG] osdmap e171: 8 total, 8 up, 8 in 2024-02-10T08:23:34.822 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:23:34.850 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:34.878 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:23:34.881 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:34.881 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:23:34.982 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:23:35.014 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:23:33.205175+0000 mgr.y (mgr.14505) 260 : audit [DBG] from='client.24842 -' entity='client.admin' cmd=[{"prefix": "osd reweight-by-utilization", "oload": 110, "max_change": 3.0, "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:23:35.014 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:33.644200+0000 mon.a (mon.0) 1019 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-10T08:23:35.014 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:23:33.697022+0000 mon.a (mon.0) 1020 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd reweightn", "weights": "{'0':'41659','3':'33564'}"}]': finished 2024-02-10T08:23:35.014 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:23:33.697087+0000 mon.a (mon.0) 1021 : audit [INF] from='client.? 172.21.15.18:0/3115642172' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-10T08:23:35.014 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:33.697137+0000 mon.a (mon.0) 1022 : cluster [DBG] osdmap e171: 8 total, 8 up, 8 in 2024-02-10T08:23:35.014 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:23:33.205175+0000 mgr.y (mgr.14505) 260 : audit [DBG] from='client.24842 -' entity='client.admin' cmd=[{"prefix": "osd reweight-by-utilization", "oload": 110, "max_change": 3.0, "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:23:35.014 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:33.644200+0000 mon.a (mon.0) 1019 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-10T08:23:35.015 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:23:33.697022+0000 mon.a (mon.0) 1020 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd reweightn", "weights": "{'0':'41659','3':'33564'}"}]': finished 2024-02-10T08:23:35.015 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:23:33.697087+0000 mon.a (mon.0) 1021 : audit [INF] from='client.? 172.21.15.18:0/3115642172' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-10T08:23:35.015 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:33.697137+0000 mon.a (mon.0) 1022 : cluster [DBG] osdmap e171: 8 total, 8 up, 8 in 2024-02-10T08:23:35.015 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:35.865 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:23:35.869 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:35.869 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:23:35.884 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '110', 'type': 'test-reweight-by-utilization'} 2024-02-10T08:23:35.885 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd test-reweight-by-utilization 110 0.05 2024-02-10T08:23:35.952 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:34.662579+0000 mgr.y (mgr.14505) 261 : cluster [DBG] pgmap v299: 158 pgs: 1 active+remapped+backfill_toofull, 4 active+remapped+backfilling, 1 active+recovering+undersized+degraded+remapped, 1 active+undersized+degraded+remapped+backfilling, 151 active+clean; 685 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 699 op/s; 3674/33459 objects degraded (10.981%); 3519/33459 objects misplaced (10.517%); 5.8 MiB/s, 106 objects/s recovering 2024-02-10T08:23:35.952 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:34.695610+0000 mon.a (mon.0) 1023 : cluster [DBG] osdmap e172: 8 total, 8 up, 8 in 2024-02-10T08:23:35.952 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:34.705697+0000 osd.7 (osd.7) 81 : cluster [INF] 7.f continuing backfill to osd.4 from (127'7589,170'11893] 7:f37d4082:::benchmark_data_smithi018_80623_object98608:head to 170'11893 2024-02-10T08:23:35.953 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:34.705729+0000 osd.7 (osd.7) 82 : cluster [DBG] 7.f starting backfill to osd.5 from (0'0,0'0] MAX to 170'11893 2024-02-10T08:23:35.953 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:35.555389+0000 mon.a (mon.0) 1024 : cluster [WRN] Health check update: Degraded data redundancy: 3674/33459 objects degraded (10.981%), 2 pgs degraded, 1 pg undersized (PG_DEGRADED) 2024-02-10T08:23:35.953 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:35.560394+0000 mon.a (mon.0) 1025 : cluster [DBG] osdmap e173: 8 total, 8 up, 8 in 2024-02-10T08:23:35.953 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:35.577754+0000 osd.1 (osd.1) 85 : cluster [DBG] 7.9 starting backfill to osd.7 from (0'0,0'0] MAX to 170'12062 2024-02-10T08:23:35.953 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:34.662579+0000 mgr.y (mgr.14505) 261 : cluster [DBG] pgmap v299: 158 pgs: 1 active+remapped+backfill_toofull, 4 active+remapped+backfilling, 1 active+recovering+undersized+degraded+remapped, 1 active+undersized+degraded+remapped+backfilling, 151 active+clean; 685 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 699 op/s; 3674/33459 objects degraded (10.981%); 3519/33459 objects misplaced (10.517%); 5.8 MiB/s, 106 objects/s recovering 2024-02-10T08:23:35.953 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:34.695610+0000 mon.a (mon.0) 1023 : cluster [DBG] osdmap e172: 8 total, 8 up, 8 in 2024-02-10T08:23:35.953 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:34.705697+0000 osd.7 (osd.7) 81 : cluster [INF] 7.f continuing backfill to osd.4 from (127'7589,170'11893] 7:f37d4082:::benchmark_data_smithi018_80623_object98608:head to 170'11893 2024-02-10T08:23:35.953 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:34.705729+0000 osd.7 (osd.7) 82 : cluster [DBG] 7.f starting backfill to osd.5 from (0'0,0'0] MAX to 170'11893 2024-02-10T08:23:35.953 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:35.555389+0000 mon.a (mon.0) 1024 : cluster [WRN] Health check update: Degraded data redundancy: 3674/33459 objects degraded (10.981%), 2 pgs degraded, 1 pg undersized (PG_DEGRADED) 2024-02-10T08:23:35.953 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:35.560394+0000 mon.a (mon.0) 1025 : cluster [DBG] osdmap e173: 8 total, 8 up, 8 in 2024-02-10T08:23:35.953 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:35.577754+0000 osd.1 (osd.1) 85 : cluster [DBG] 7.9 starting backfill to osd.7 from (0'0,0'0] MAX to 170'12062 2024-02-10T08:23:35.970 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:23:35.995 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:34.662579+0000 mgr.y (mgr.14505) 261 : cluster [DBG] pgmap v299: 158 pgs: 1 active+remapped+backfill_toofull, 4 active+remapped+backfilling, 1 active+recovering+undersized+degraded+remapped, 1 active+undersized+degraded+remapped+backfilling, 151 active+clean; 685 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 699 op/s; 3674/33459 objects degraded (10.981%); 3519/33459 objects misplaced (10.517%); 5.8 MiB/s, 106 objects/s recovering 2024-02-10T08:23:35.995 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:34.695610+0000 mon.a (mon.0) 1023 : cluster [DBG] osdmap e172: 8 total, 8 up, 8 in 2024-02-10T08:23:35.995 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:34.705697+0000 osd.7 (osd.7) 81 : cluster [INF] 7.f continuing backfill to osd.4 from (127'7589,170'11893] 7:f37d4082:::benchmark_data_smithi018_80623_object98608:head to 170'11893 2024-02-10T08:23:35.995 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:34.705729+0000 osd.7 (osd.7) 82 : cluster [DBG] 7.f starting backfill to osd.5 from (0'0,0'0] MAX to 170'11893 2024-02-10T08:23:35.995 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:35.555389+0000 mon.a (mon.0) 1024 : cluster [WRN] Health check update: Degraded data redundancy: 3674/33459 objects degraded (10.981%), 2 pgs degraded, 1 pg undersized (PG_DEGRADED) 2024-02-10T08:23:35.995 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:35.560394+0000 mon.a (mon.0) 1025 : cluster [DBG] osdmap e173: 8 total, 8 up, 8 in 2024-02-10T08:23:35.995 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:35.577754+0000 osd.1 (osd.1) 85 : cluster [DBG] 7.9 starting backfill to osd.7 from (0'0,0'0] MAX to 170'12062 2024-02-10T08:23:35.996 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:36.021 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:23:36.024 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:36.024 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:23:36.125 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:23:36.151 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:36.172 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:23:36.175 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:36.175 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:23:36.276 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:23:36.304 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:36.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:35.561935+0000 osd.6 (osd.6) 52 : cluster [DBG] 7.7 starting backfill to osd.1 from (0'0,0'0] MAX to 170'12092 2024-02-10T08:23:36.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:35.565339+0000 osd.2 (osd.2) 68 : cluster [DBG] 7.e starting backfill to osd.1 from (0'0,0'0] MAX to 170'11968 2024-02-10T08:23:36.792 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:23:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:23:36] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:23:37.153 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:35.561935+0000 osd.6 (osd.6) 52 : cluster [DBG] 7.7 starting backfill to osd.1 from (0'0,0'0] MAX to 170'12092 2024-02-10T08:23:37.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:35.565339+0000 osd.2 (osd.2) 68 : cluster [DBG] 7.e starting backfill to osd.1 from (0'0,0'0] MAX to 170'11968 2024-02-10T08:23:37.158 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:23:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:23:37] "GET /metrics HTTP/1.1" 200 175745 "" "Prometheus/2.33.4" 2024-02-10T08:23:37.158 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:35.561935+0000 osd.6 (osd.6) 52 : cluster [DBG] 7.7 starting backfill to osd.1 from (0'0,0'0] MAX to 170'12092 2024-02-10T08:23:37.158 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:35.565339+0000 osd.2 (osd.2) 68 : cluster [DBG] 7.e starting backfill to osd.1 from (0'0,0'0] MAX to 170'11968 2024-02-10T08:23:37.276 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd set noscrub 2024-02-10T08:23:37.757 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:23:37.771 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:37.771 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:23:37.872 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:23:37.889 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:36.666326+0000 mgr.y (mgr.14505) 262 : cluster [DBG] pgmap v302: 158 pgs: 1 active+remapped+backfill_toofull, 3 peering, 4 active+remapped+backfilling, 1 active+recovering+undersized+degraded+remapped, 1 active+undersized+degraded+remapped+backfilling, 148 active+clean; 676 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 737 op/s; 3674/33003 objects degraded (11.132%); 3367/33003 objects misplaced (10.202%); 5.8 MiB/s, 107 objects/s recovering 2024-02-10T08:23:37.889 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:36.698712+0000 mon.a (mon.0) 1026 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-02-10T08:23:37.889 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:36.666326+0000 mgr.y (mgr.14505) 262 : cluster [DBG] pgmap v302: 158 pgs: 1 active+remapped+backfill_toofull, 3 peering, 4 active+remapped+backfilling, 1 active+recovering+undersized+degraded+remapped, 1 active+undersized+degraded+remapped+backfilling, 148 active+clean; 676 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 737 op/s; 3674/33003 objects degraded (11.132%); 3367/33003 objects misplaced (10.202%); 5.8 MiB/s, 107 objects/s recovering 2024-02-10T08:23:37.889 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:36.698712+0000 mon.a (mon.0) 1026 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-02-10T08:23:37.913 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:37.955 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:23:37.959 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:37.960 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:23:38.040 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:23:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:23:38.042 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:36.666326+0000 mgr.y (mgr.14505) 262 : cluster [DBG] pgmap v302: 158 pgs: 1 active+remapped+backfill_toofull, 3 peering, 4 active+remapped+backfilling, 1 active+recovering+undersized+degraded+remapped, 1 active+undersized+degraded+remapped+backfilling, 148 active+clean; 676 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 737 op/s; 3674/33003 objects degraded (11.132%); 3367/33003 objects misplaced (10.202%); 5.8 MiB/s, 107 objects/s recovering 2024-02-10T08:23:38.042 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:36.698712+0000 mon.a (mon.0) 1026 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-02-10T08:23:38.061 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:23:38.115 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:38.144 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:23:38.147 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:38.147 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:23:38.248 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:23:38.306 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:38.867 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-02-10T08:23:38.867 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:23:39.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:23:37.856205+0000 mgr.y (mgr.14505) 263 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:23:39.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:23:37.856205+0000 mgr.y (mgr.14505) 263 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:23:39.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:23:37.856205+0000 mgr.y (mgr.14505) 263 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:23:39.760 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:38.667330+0000 mgr.y (mgr.14505) 264 : cluster [DBG] pgmap v303: 158 pgs: 1 active+remapped+backfill_wait, 146 active+clean, 1 active+undersized+degraded+remapped+backfilling, 4 active+remapped+backfilling, 3 peering, 2 active+remapped+backfill_toofull, 1 active+recovering+undersized+remapped; 586 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 682 B/s rd, 0 B/s wr, 496 op/s; 446/28701 objects degraded (1.554%); 4474/28701 objects misplaced (15.588%); 5.1 MiB/s, 99 objects/s recovering 2024-02-10T08:23:39.760 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:38.748579+0000 mon.a (mon.0) 1027 : cluster [WRN] Health check update: Low space hindering backfill (add storage if this doesn't resolve itself): 2 pgs backfill_toofull (PG_BACKFILL_FULL) 2024-02-10T08:23:40.042 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:38.667330+0000 mgr.y (mgr.14505) 264 : cluster [DBG] pgmap v303: 158 pgs: 1 active+remapped+backfill_wait, 146 active+clean, 1 active+undersized+degraded+remapped+backfilling, 4 active+remapped+backfilling, 3 peering, 2 active+remapped+backfill_toofull, 1 active+recovering+undersized+remapped; 586 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 682 B/s rd, 0 B/s wr, 496 op/s; 446/28701 objects degraded (1.554%); 4474/28701 objects misplaced (15.588%); 5.1 MiB/s, 99 objects/s recovering 2024-02-10T08:23:40.042 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:38.748579+0000 mon.a (mon.0) 1027 : cluster [WRN] Health check update: Low space hindering backfill (add storage if this doesn't resolve itself): 2 pgs backfill_toofull (PG_BACKFILL_FULL) 2024-02-10T08:23:40.043 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:38.667330+0000 mgr.y (mgr.14505) 264 : cluster [DBG] pgmap v303: 158 pgs: 1 active+remapped+backfill_wait, 146 active+clean, 1 active+undersized+degraded+remapped+backfilling, 4 active+remapped+backfilling, 3 peering, 2 active+remapped+backfill_toofull, 1 active+recovering+undersized+remapped; 586 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 682 B/s rd, 0 B/s wr, 496 op/s; 446/28701 objects degraded (1.554%); 4474/28701 objects misplaced (15.588%); 5.1 MiB/s, 99 objects/s recovering 2024-02-10T08:23:40.043 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:38.748579+0000 mon.a (mon.0) 1027 : cluster [WRN] Health check update: Low space hindering backfill (add storage if this doesn't resolve itself): 2 pgs backfill_toofull (PG_BACKFILL_FULL) 2024-02-10T08:23:40.650 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:23:40.654 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:40.654 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:23:40.661 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.1 dump_historic_ops 2024-02-10T08:23:40.756 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:23:40.810 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:40.836 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:23:40.839 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:40.840 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:23:40.911 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:23:40.360134+0000 mon.a (mon.0) 1028 : audit [DBG] from='client.? 172.21.15.18:0/2350376481' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:23:40.911 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:40.558690+0000 mon.a (mon.0) 1029 : cluster [WRN] Health check update: Degraded data redundancy: 446/28701 objects degraded (1.554%), 1 pg degraded (PG_DEGRADED) 2024-02-10T08:23:40.912 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:23:40.360134+0000 mon.a (mon.0) 1028 : audit [DBG] from='client.? 172.21.15.18:0/2350376481' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:23:40.912 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:40.558690+0000 mon.a (mon.0) 1029 : cluster [WRN] Health check update: Degraded data redundancy: 446/28701 objects degraded (1.554%), 1 pg degraded (PG_DEGRADED) 2024-02-10T08:23:40.912 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:23:40.913 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:23:40.913 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:23:40.913 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:23:40.913 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:23:40.913 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:23:40.913 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:23:40.914 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:23:40.914 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-10T08:23:40.914 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-10T08:23:40.914 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-10T08:23:40.914 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-10T08:23:40.915 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-10T08:23:40.915 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-10T08:23:40.915 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-10T08:23:40.915 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-10T08:23:40.941 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:23:40.982 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:41.018 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:23:41.021 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:41.021 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:23:41.021 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:23:40.360134+0000 mon.a (mon.0) 1028 : audit [DBG] from='client.? 172.21.15.18:0/2350376481' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:23:41.021 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:40.558690+0000 mon.a (mon.0) 1029 : cluster [WRN] Health check update: Degraded data redundancy: 446/28701 objects degraded (1.554%), 1 pg degraded (PG_DEGRADED) 2024-02-10T08:23:41.122 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:23:41.184 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:41.225 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:23:41.253 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:23:41.279 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:41.280 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:23:41.380 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:23:41.457 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:41.927 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:23:41.934 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:41.934 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:23:42.035 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:23:42.089 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:41 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:40.667924+0000 mgr.y (mgr.14505) 265 : cluster [DBG] pgmap v304: 158 pgs: 1 active+remapped+backfill_wait, 149 active+clean, 1 active+undersized+degraded+remapped+backfilling, 4 active+remapped+backfilling, 2 active+remapped+backfill_toofull, 1 active+recovering+undersized+remapped; 577 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 587 B/s rd, 0 B/s wr, 249 op/s; 446/28260 objects degraded (1.578%); 4327/28260 objects misplaced (15.311%); 2.3 MiB/s, 44 objects/s recovering 2024-02-10T08:23:42.090 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:41 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:41.585628+0000 mon.a (mon.0) 1030 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-02-10T08:23:42.091 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:42.130 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:23:42.135 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:42.136 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:23:42.159 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:40.667924+0000 mgr.y (mgr.14505) 265 : cluster [DBG] pgmap v304: 158 pgs: 1 active+remapped+backfill_wait, 149 active+clean, 1 active+undersized+degraded+remapped+backfilling, 4 active+remapped+backfilling, 2 active+remapped+backfill_toofull, 1 active+recovering+undersized+remapped; 577 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 587 B/s rd, 0 B/s wr, 249 op/s; 446/28260 objects degraded (1.578%); 4327/28260 objects misplaced (15.311%); 2.3 MiB/s, 44 objects/s recovering 2024-02-10T08:23:42.159 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:41.585628+0000 mon.a (mon.0) 1030 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-02-10T08:23:42.160 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:40.667924+0000 mgr.y (mgr.14505) 265 : cluster [DBG] pgmap v304: 158 pgs: 1 active+remapped+backfill_wait, 149 active+clean, 1 active+undersized+degraded+remapped+backfilling, 4 active+remapped+backfilling, 2 active+remapped+backfill_toofull, 1 active+recovering+undersized+remapped; 577 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 587 B/s rd, 0 B/s wr, 249 op/s; 446/28260 objects degraded (1.578%); 4327/28260 objects misplaced (15.311%); 2.3 MiB/s, 44 objects/s recovering 2024-02-10T08:23:42.160 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:41.585628+0000 mon.a (mon.0) 1030 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-02-10T08:23:42.237 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:23:42.263 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:23:42.263 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:23:42.335 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:43.970 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-10T08:23:44.036 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:42.668547+0000 mgr.y (mgr.14505) 266 : cluster [DBG] pgmap v305: 158 pgs: 1 active+recovering+undersized+remapped, 1 active+remapped+backfill_wait, 149 active+clean, 1 active+undersized+degraded+remapped+backfilling, 4 active+remapped+backfilling, 2 active+remapped+backfill_toofull; 457 MiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 456 op/s; 446/22518 objects degraded (1.981%); 3290/22518 objects misplaced (14.611%); 3.4 MiB/s, 68 objects/s recovering 2024-02-10T08:23:44.037 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:42.668547+0000 mgr.y (mgr.14505) 266 : cluster [DBG] pgmap v305: 158 pgs: 1 active+recovering+undersized+remapped, 1 active+remapped+backfill_wait, 149 active+clean, 1 active+undersized+degraded+remapped+backfilling, 4 active+remapped+backfilling, 2 active+remapped+backfill_toofull; 457 MiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 456 op/s; 446/22518 objects degraded (1.981%); 3290/22518 objects misplaced (14.611%); 3.4 MiB/s, 68 objects/s recovering 2024-02-10T08:23:44.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:43 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:42.668547+0000 mgr.y (mgr.14505) 266 : cluster [DBG] pgmap v305: 158 pgs: 1 active+recovering+undersized+remapped, 1 active+remapped+backfill_wait, 149 active+clean, 1 active+undersized+degraded+remapped+backfilling, 4 active+remapped+backfilling, 2 active+remapped+backfill_toofull; 457 MiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 456 op/s; 446/22518 objects degraded (1.981%); 3290/22518 objects misplaced (14.611%); 3.4 MiB/s, 68 objects/s recovering 2024-02-10T08:23:44.704 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:23:44.720 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:44.721 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:23:44.821 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:23:44.911 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:45.299 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:23:45.302 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:45.303 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:23:45.404 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:23:45.502 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:46.139 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:44.678536+0000 mgr.y (mgr.14505) 267 : cluster [DBG] pgmap v306: 158 pgs: 1 active+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfilling, 1 active+recovering+undersized+remapped, 149 active+clean, 4 active+remapped+backfilling, 2 active+remapped+backfill_toofull; 380 MiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 922 B/s rd, 0 B/s wr, 474 op/s; 248/18819 objects degraded (1.318%); 2710/18819 objects misplaced (14.400%); 3.4 MiB/s, 66 objects/s recovering 2024-02-10T08:23:46.139 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:45.560428+0000 mon.a (mon.0) 1031 : cluster [WRN] Health check update: Degraded data redundancy: 248/18819 objects degraded (1.318%), 1 pg degraded (PG_DEGRADED) 2024-02-10T08:23:46.139 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:44.678536+0000 mgr.y (mgr.14505) 267 : cluster [DBG] pgmap v306: 158 pgs: 1 active+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfilling, 1 active+recovering+undersized+remapped, 149 active+clean, 4 active+remapped+backfilling, 2 active+remapped+backfill_toofull; 380 MiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 922 B/s rd, 0 B/s wr, 474 op/s; 248/18819 objects degraded (1.318%); 2710/18819 objects misplaced (14.400%); 3.4 MiB/s, 66 objects/s recovering 2024-02-10T08:23:46.139 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:45.560428+0000 mon.a (mon.0) 1031 : cluster [WRN] Health check update: Degraded data redundancy: 248/18819 objects degraded (1.318%), 1 pg degraded (PG_DEGRADED) 2024-02-10T08:23:46.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:44.678536+0000 mgr.y (mgr.14505) 267 : cluster [DBG] pgmap v306: 158 pgs: 1 active+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfilling, 1 active+recovering+undersized+remapped, 149 active+clean, 4 active+remapped+backfilling, 2 active+remapped+backfill_toofull; 380 MiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 922 B/s rd, 0 B/s wr, 474 op/s; 248/18819 objects degraded (1.318%); 2710/18819 objects misplaced (14.400%); 3.4 MiB/s, 66 objects/s recovering 2024-02-10T08:23:46.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:45.560428+0000 mon.a (mon.0) 1031 : cluster [WRN] Health check update: Degraded data redundancy: 248/18819 objects degraded (1.318%), 1 pg degraded (PG_DEGRADED) 2024-02-10T08:23:46.789 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:23:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:23:46] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:23:47.103 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:23:47.108 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:47.109 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:23:47.209 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:23:47.214 INFO:teuthology.orchestra.run.smithi018.stdout:moved 2 / 474 (0.421941%) 2024-02-10T08:23:47.214 INFO:teuthology.orchestra.run.smithi018.stdout:avg 59.25 2024-02-10T08:23:47.214 INFO:teuthology.orchestra.run.smithi018.stdout:stddev 15.5704 -> 16.1381 (expected baseline 7.20026) 2024-02-10T08:23:47.214 INFO:teuthology.orchestra.run.smithi018.stdout:min osd.3 with 31 -> 29 pgs (0.523207 -> 0.489451 * mean) 2024-02-10T08:23:47.214 INFO:teuthology.orchestra.run.smithi018.stdout:max osd.1 with 76 -> 76 pgs (1.2827 -> 1.2827 * mean) 2024-02-10T08:23:47.215 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:23:47.215 INFO:teuthology.orchestra.run.smithi018.stdout:oload 110 2024-02-10T08:23:47.215 INFO:teuthology.orchestra.run.smithi018.stdout:max_change 0.05 2024-02-10T08:23:47.215 INFO:teuthology.orchestra.run.smithi018.stdout:max_change_osds 4 2024-02-10T08:23:47.215 INFO:teuthology.orchestra.run.smithi018.stdout:average_utilization 0.0050 2024-02-10T08:23:47.215 INFO:teuthology.orchestra.run.smithi018.stdout:overload_utilization 0.0055 2024-02-10T08:23:47.215 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3 weight 0.5121 -> 0.4622 2024-02-10T08:23:47.237 INFO:teuthology.orchestra.run.smithi018.stderr:no change 2024-02-10T08:23:47.243 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:47.267 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:23:47.270 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:47.270 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:23:47.371 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:23:47.398 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:47.405 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:23:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:23:47] "GET /metrics HTTP/1.1" 200 175771 "" "Prometheus/2.33.4" 2024-02-10T08:23:47.405 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:23:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:23:47.211+0000 7f52f8ade700 -1 mgr.server reply reply (1) Operation not permitted no change 2024-02-10T08:23:47.417 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:23:47.420 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:47.420 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:23:47.521 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:23:47.548 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:47.572 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:23:47.575 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:47.576 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:23:47.677 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:23:47.703 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:47.725 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:23:47.728 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:47.728 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:23:47.829 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:23:47.848 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is set 2024-02-10T08:23:47.861 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:23:46.632501+0000 mon.a (mon.0) 1032 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:23:47.861 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:46.679141+0000 mgr.y (mgr.14505) 268 : cluster [DBG] pgmap v307: 158 pgs: 1 active+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfilling, 1 active+recovering+undersized+remapped, 149 active+clean, 4 active+remapped+backfilling, 2 active+remapped+backfill_toofull; 369 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 828 B/s rd, 0 B/s wr, 441 op/s; 248/18285 objects degraded (1.356%); 2532/18285 objects misplaced (13.847%); 3.1 MiB/s, 59 objects/s recovering 2024-02-10T08:23:47.861 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:46.842224+0000 mon.a (mon.0) 1033 : cluster [DBG] osdmap e174: 8 total, 8 up, 8 in 2024-02-10T08:23:47.861 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:23:47.419086+0000 mon.b (mon.1) 52 : audit [INF] from='client.? 172.21.15.18:0/2615561916' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:23:47.861 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:23:47.419796+0000 mon.a (mon.0) 1034 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:23:47.862 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:47.888 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:23:47.891 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:47.891 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:23:47.907 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:23:46.632501+0000 mon.a (mon.0) 1032 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:23:47.907 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:46.679141+0000 mgr.y (mgr.14505) 268 : cluster [DBG] pgmap v307: 158 pgs: 1 active+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfilling, 1 active+recovering+undersized+remapped, 149 active+clean, 4 active+remapped+backfilling, 2 active+remapped+backfill_toofull; 369 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 828 B/s rd, 0 B/s wr, 441 op/s; 248/18285 objects degraded (1.356%); 2532/18285 objects misplaced (13.847%); 3.1 MiB/s, 59 objects/s recovering 2024-02-10T08:23:47.907 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:46.842224+0000 mon.a (mon.0) 1033 : cluster [DBG] osdmap e174: 8 total, 8 up, 8 in 2024-02-10T08:23:47.908 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:23:47.419086+0000 mon.b (mon.1) 52 : audit [INF] from='client.? 172.21.15.18:0/2615561916' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:23:47.908 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:23:47.419796+0000 mon.a (mon.0) 1034 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:23:47.908 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:23:46.632501+0000 mon.a (mon.0) 1032 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:23:47.908 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:46.679141+0000 mgr.y (mgr.14505) 268 : cluster [DBG] pgmap v307: 158 pgs: 1 active+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfilling, 1 active+recovering+undersized+remapped, 149 active+clean, 4 active+remapped+backfilling, 2 active+remapped+backfill_toofull; 369 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 828 B/s rd, 0 B/s wr, 441 op/s; 248/18285 objects degraded (1.356%); 2532/18285 objects misplaced (13.847%); 3.1 MiB/s, 59 objects/s recovering 2024-02-10T08:23:47.908 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:46.842224+0000 mon.a (mon.0) 1033 : cluster [DBG] osdmap e174: 8 total, 8 up, 8 in 2024-02-10T08:23:47.908 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:23:47.419086+0000 mon.b (mon.1) 52 : audit [INF] from='client.? 172.21.15.18:0/2615561916' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:23:47.908 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:23:47.419796+0000 mon.a (mon.0) 1034 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:23:47.992 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:23:48.062 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:48.095 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:23:48.100 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:48.101 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:23:48.202 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:23:48.273 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:48.295 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:23:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:23:48.510 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:23:48.515 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:48.516 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:23:48.616 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:23:48.723 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:48.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:23:47.211395+0000 mgr.y (mgr.14505) 269 : audit [DBG] from='client.24851 -' entity='client.admin' cmd=[{"prefix": "osd test-reweight-by-utilization", "oload": 110, "max_change": 0.05, "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:23:48.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:47.838457+0000 mon.a (mon.0) 1035 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:23:48.906 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:23:47.842521+0000 mon.a (mon.0) 1036 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-10T08:23:48.906 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:47.842571+0000 mon.a (mon.0) 1037 : cluster [DBG] osdmap e175: 8 total, 8 up, 8 in 2024-02-10T08:23:48.906 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:23:47.872483+0000 mgr.y (mgr.14505) 270 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:23:48.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:23:47.211395+0000 mgr.y (mgr.14505) 269 : audit [DBG] from='client.24851 -' entity='client.admin' cmd=[{"prefix": "osd test-reweight-by-utilization", "oload": 110, "max_change": 0.05, "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:23:48.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:47.838457+0000 mon.a (mon.0) 1035 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:23:48.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:23:47.842521+0000 mon.a (mon.0) 1036 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-10T08:23:48.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:47.842571+0000 mon.a (mon.0) 1037 : cluster [DBG] osdmap e175: 8 total, 8 up, 8 in 2024-02-10T08:23:48.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:23:47.872483+0000 mgr.y (mgr.14505) 270 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:23:49.041 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:23:47.211395+0000 mgr.y (mgr.14505) 269 : audit [DBG] from='client.24851 -' entity='client.admin' cmd=[{"prefix": "osd test-reweight-by-utilization", "oload": 110, "max_change": 0.05, "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:23:49.041 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:47.838457+0000 mon.a (mon.0) 1035 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:23:49.041 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:23:47.842521+0000 mon.a (mon.0) 1036 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-10T08:23:49.041 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:47.842571+0000 mon.a (mon.0) 1037 : cluster [DBG] osdmap e175: 8 total, 8 up, 8 in 2024-02-10T08:23:49.041 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:23:47.872483+0000 mgr.y (mgr.14505) 270 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:23:50.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:49 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:48.679679+0000 mgr.y (mgr.14505) 271 : cluster [DBG] pgmap v310: 158 pgs: 1 active+remapped+backfill_wait, 1 active+recovering+undersized+remapped, 1 active+undersized+degraded+remapped+backfilling, 149 active+clean, 4 active+remapped+backfilling, 2 active+remapped+backfill_toofull; 183 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 787 op/s; 76/9357 objects degraded (0.812%); 1134/9357 objects misplaced (12.119%); 4.6 MiB/s, 87 objects/s recovering 2024-02-10T08:23:50.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:48.679679+0000 mgr.y (mgr.14505) 271 : cluster [DBG] pgmap v310: 158 pgs: 1 active+remapped+backfill_wait, 1 active+recovering+undersized+remapped, 1 active+undersized+degraded+remapped+backfilling, 149 active+clean, 4 active+remapped+backfilling, 2 active+remapped+backfill_toofull; 183 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 787 op/s; 76/9357 objects degraded (0.812%); 1134/9357 objects misplaced (12.119%); 4.6 MiB/s, 87 objects/s recovering 2024-02-10T08:23:50.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:48.679679+0000 mgr.y (mgr.14505) 271 : cluster [DBG] pgmap v310: 158 pgs: 1 active+remapped+backfill_wait, 1 active+recovering+undersized+remapped, 1 active+undersized+degraded+remapped+backfilling, 149 active+clean, 4 active+remapped+backfilling, 2 active+remapped+backfill_toofull; 183 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 787 op/s; 76/9357 objects degraded (0.812%); 1134/9357 objects misplaced (12.119%); 4.6 MiB/s, 87 objects/s recovering 2024-02-10T08:23:51.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:50.565776+0000 mon.a (mon.0) 1038 : cluster [WRN] Health check update: Degraded data redundancy: 76/9357 objects degraded (0.812%), 1 pg degraded (PG_DEGRADED) 2024-02-10T08:23:51.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:50.565776+0000 mon.a (mon.0) 1038 : cluster [WRN] Health check update: Degraded data redundancy: 76/9357 objects degraded (0.812%), 1 pg degraded (PG_DEGRADED) 2024-02-10T08:23:51.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:50.565776+0000 mon.a (mon.0) 1038 : cluster [WRN] Health check update: Degraded data redundancy: 76/9357 objects degraded (0.812%), 1 pg degraded (PG_DEGRADED) 2024-02-10T08:23:51.647 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Removed 100925 objects 2024-02-10T08:23:51.648 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Clean up completed and total clean up time :151.389 2024-02-10T08:23:52.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:51 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:50.680301+0000 mgr.y (mgr.14505) 272 : cluster [DBG] pgmap v311: 158 pgs: 1 active+remapped+backfill_wait, 1 active+recovering+undersized+remapped, 1 active+undersized+degraded+remapped+backfilling, 150 active+clean, 4 active+remapped+backfilling, 1 active+remapped+backfill_toofull; 171 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 571 op/s; 76/8790 objects degraded (0.865%); 867/8790 objects misplaced (9.863%); 4.8 MiB/s, 83 objects/s recovering 2024-02-10T08:23:52.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:50.680301+0000 mgr.y (mgr.14505) 272 : cluster [DBG] pgmap v311: 158 pgs: 1 active+remapped+backfill_wait, 1 active+recovering+undersized+remapped, 1 active+undersized+degraded+remapped+backfilling, 150 active+clean, 4 active+remapped+backfilling, 1 active+remapped+backfill_toofull; 171 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 571 op/s; 76/8790 objects degraded (0.865%); 867/8790 objects misplaced (9.863%); 4.8 MiB/s, 83 objects/s recovering 2024-02-10T08:23:52.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:50.680301+0000 mgr.y (mgr.14505) 272 : cluster [DBG] pgmap v311: 158 pgs: 1 active+remapped+backfill_wait, 1 active+recovering+undersized+remapped, 1 active+undersized+degraded+remapped+backfilling, 150 active+clean, 4 active+remapped+backfilling, 1 active+remapped+backfill_toofull; 171 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 571 op/s; 76/8790 objects degraded (0.865%); 867/8790 objects misplaced (9.863%); 4.8 MiB/s, 83 objects/s recovering 2024-02-10T08:23:53.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:52 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:51.659020+0000 mon.a (mon.0) 1039 : cluster [WRN] Health check update: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull (PG_BACKFILL_FULL) 2024-02-10T08:23:53.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:52 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:51.666910+0000 mon.a (mon.0) 1040 : cluster [DBG] osdmap e176: 8 total, 8 up, 8 in 2024-02-10T08:23:53.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:51.659020+0000 mon.a (mon.0) 1039 : cluster [WRN] Health check update: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull (PG_BACKFILL_FULL) 2024-02-10T08:23:53.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:51.666910+0000 mon.a (mon.0) 1040 : cluster [DBG] osdmap e176: 8 total, 8 up, 8 in 2024-02-10T08:23:53.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:51.659020+0000 mon.a (mon.0) 1039 : cluster [WRN] Health check update: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull (PG_BACKFILL_FULL) 2024-02-10T08:23:53.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:51.666910+0000 mon.a (mon.0) 1040 : cluster [DBG] osdmap e176: 8 total, 8 up, 8 in 2024-02-10T08:23:53.206 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 5, 6, 7, 4] 2024-02-10T08:23:53.206 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-10T08:23:53.206 INFO:tasks.thrashosds.thrasher:inject_pause on osd.3 2024-02-10T08:23:53.206 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-02-10T08:23:53.206 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-02-10T08:23:53.207 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.3 config set filestore_inject_stall 3 2024-02-10T08:23:54.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:53 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:52.668054+0000 mon.a (mon.0) 1041 : cluster [DBG] osdmap e177: 8 total, 8 up, 8 in 2024-02-10T08:23:54.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:53 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:52.680679+0000 mgr.y (mgr.14505) 273 : cluster [DBG] pgmap v314: 158 pgs: 1 active+remapped+backfill_toofull, 1 active+recovering+undersized+remapped, 3 peering, 1 active+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfilling, 150 active+clean, 1 active+remapped+backfilling; 71 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 816 op/s; 76/4005 objects degraded (1.898%); 298/4005 objects misplaced (7.441%); 6.7 MiB/s, 127 objects/s recovering 2024-02-10T08:23:54.054 INFO:tasks.cephadm.ceph_manager.ceph:removing pool_name unique_pool_0 2024-02-10T08:23:54.054 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd pool rm unique_pool_0 unique_pool_0 --yes-i-really-really-mean-it 2024-02-10T08:23:54.079 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:52.668054+0000 mon.a (mon.0) 1041 : cluster [DBG] osdmap e177: 8 total, 8 up, 8 in 2024-02-10T08:23:54.079 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:52.680679+0000 mgr.y (mgr.14505) 273 : cluster [DBG] pgmap v314: 158 pgs: 1 active+remapped+backfill_toofull, 1 active+recovering+undersized+remapped, 3 peering, 1 active+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfilling, 150 active+clean, 1 active+remapped+backfilling; 71 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 816 op/s; 76/4005 objects degraded (1.898%); 298/4005 objects misplaced (7.441%); 6.7 MiB/s, 127 objects/s recovering 2024-02-10T08:23:54.079 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:52.668054+0000 mon.a (mon.0) 1041 : cluster [DBG] osdmap e177: 8 total, 8 up, 8 in 2024-02-10T08:23:54.079 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:52.680679+0000 mgr.y (mgr.14505) 273 : cluster [DBG] pgmap v314: 158 pgs: 1 active+remapped+backfill_toofull, 1 active+recovering+undersized+remapped, 3 peering, 1 active+remapped+backfill_wait, 1 active+undersized+degraded+remapped+backfilling, 150 active+clean, 1 active+remapped+backfilling; 71 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 816 op/s; 76/4005 objects degraded (1.898%); 298/4005 objects misplaced (7.441%); 6.7 MiB/s, 127 objects/s recovering 2024-02-10T08:23:54.712 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:23:54.715 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:54.715 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:23:54.816 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:23:54.848 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:54.869 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:23:54.872 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:23:54.872 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:23:54.973 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:23:54.998 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:53.091469+0000 osd.3 (osd.3) 93 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:23:54.999 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:53.091518+0000 osd.3 (osd.3) 94 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:23:54.999 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:53.682867+0000 mon.a (mon.0) 1042 : cluster [DBG] osdmap e178: 8 total, 8 up, 8 in 2024-02-10T08:23:54.999 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:53.091469+0000 osd.3 (osd.3) 93 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:23:54.999 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:53.091518+0000 osd.3 (osd.3) 94 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:23:54.999 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:53.682867+0000 mon.a (mon.0) 1042 : cluster [DBG] osdmap e178: 8 total, 8 up, 8 in 2024-02-10T08:23:55.000 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:23:55.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:54 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:53.091469+0000 osd.3 (osd.3) 93 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:23:55.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:54 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:53.091518+0000 osd.3 (osd.3) 94 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:23:55.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:54 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:53.682867+0000 mon.a (mon.0) 1042 : cluster [DBG] osdmap e178: 8 total, 8 up, 8 in 2024-02-10T08:23:56.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:54.681028+0000 mgr.y (mgr.14505) 274 : cluster [DBG] pgmap v316: 158 pgs: 1 active+remapped+backfill_toofull, 1 active+recovering+undersized+remapped, 3 peering, 1 active+undersized+degraded+remapped+backfilling, 152 active+clean; 16 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 446 op/s; 76/1341 objects degraded (5.667%); 76/1341 objects misplaced (5.667%); 4.1 MiB/s, 74 objects/s recovering 2024-02-10T08:23:56.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:55.577376+0000 mon.a (mon.0) 1043 : cluster [WRN] Health check update: Degraded data redundancy: 76/1341 objects degraded (5.667%), 1 pg degraded (PG_DEGRADED) 2024-02-10T08:23:56.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:55.581764+0000 mon.a (mon.0) 1044 : cluster [DBG] osdmap e179: 8 total, 8 up, 8 in 2024-02-10T08:23:56.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:54.681028+0000 mgr.y (mgr.14505) 274 : cluster [DBG] pgmap v316: 158 pgs: 1 active+remapped+backfill_toofull, 1 active+recovering+undersized+remapped, 3 peering, 1 active+undersized+degraded+remapped+backfilling, 152 active+clean; 16 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 446 op/s; 76/1341 objects degraded (5.667%); 76/1341 objects misplaced (5.667%); 4.1 MiB/s, 74 objects/s recovering 2024-02-10T08:23:56.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:55.577376+0000 mon.a (mon.0) 1043 : cluster [WRN] Health check update: Degraded data redundancy: 76/1341 objects degraded (5.667%), 1 pg degraded (PG_DEGRADED) 2024-02-10T08:23:56.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:55.581764+0000 mon.a (mon.0) 1044 : cluster [DBG] osdmap e179: 8 total, 8 up, 8 in 2024-02-10T08:23:56.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:54.681028+0000 mgr.y (mgr.14505) 274 : cluster [DBG] pgmap v316: 158 pgs: 1 active+remapped+backfill_toofull, 1 active+recovering+undersized+remapped, 3 peering, 1 active+undersized+degraded+remapped+backfilling, 152 active+clean; 16 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 446 op/s; 76/1341 objects degraded (5.667%); 76/1341 objects misplaced (5.667%); 4.1 MiB/s, 74 objects/s recovering 2024-02-10T08:23:56.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:55.577376+0000 mon.a (mon.0) 1043 : cluster [WRN] Health check update: Degraded data redundancy: 76/1341 objects degraded (5.667%), 1 pg degraded (PG_DEGRADED) 2024-02-10T08:23:56.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:55.581764+0000 mon.a (mon.0) 1044 : cluster [DBG] osdmap e179: 8 total, 8 up, 8 in 2024-02-10T08:23:56.789 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:23:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:23:56] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:23:56.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:55.798623+0000 osd.6 (osd.6) 53 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:23:56.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:55.798705+0000 osd.6 (osd.6) 54 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:23:57.152 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:55.798623+0000 osd.6 (osd.6) 53 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:23:57.153 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:55.798705+0000 osd.6 (osd.6) 54 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:23:57.153 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:55.798623+0000 osd.6 (osd.6) 53 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:23:57.153 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:55.798705+0000 osd.6 (osd.6) 54 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:23:57.404 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:23:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:23:57] "GET /metrics HTTP/1.1" 200 175771 "" "Prometheus/2.33.4" 2024-02-10T08:23:58.039 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:23:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:23:58.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:56.681374+0000 mgr.y (mgr.14505) 275 : cluster [DBG] pgmap v318: 158 pgs: 1 active+remapped+backfill_toofull, 1 active+recovering+undersized+remapped, 3 peering, 153 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1022 B/s rd, 0 B/s wr, 547 op/s; 2.8 MiB/s, 56 objects/s recovering 2024-02-10T08:23:58.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:56.734262+0000 mon.a (mon.0) 1045 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 76/1341 objects degraded (5.667%), 1 pg degraded) 2024-02-10T08:23:58.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:56.741948+0000 mon.a (mon.0) 1046 : cluster [DBG] osdmap e180: 8 total, 8 up, 8 in 2024-02-10T08:23:58.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:56.681374+0000 mgr.y (mgr.14505) 275 : cluster [DBG] pgmap v318: 158 pgs: 1 active+remapped+backfill_toofull, 1 active+recovering+undersized+remapped, 3 peering, 153 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1022 B/s rd, 0 B/s wr, 547 op/s; 2.8 MiB/s, 56 objects/s recovering 2024-02-10T08:23:58.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:56.734262+0000 mon.a (mon.0) 1045 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 76/1341 objects degraded (5.667%), 1 pg degraded) 2024-02-10T08:23:58.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:56.741948+0000 mon.a (mon.0) 1046 : cluster [DBG] osdmap e180: 8 total, 8 up, 8 in 2024-02-10T08:23:58.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:56.681374+0000 mgr.y (mgr.14505) 275 : cluster [DBG] pgmap v318: 158 pgs: 1 active+remapped+backfill_toofull, 1 active+recovering+undersized+remapped, 3 peering, 153 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1022 B/s rd, 0 B/s wr, 547 op/s; 2.8 MiB/s, 56 objects/s recovering 2024-02-10T08:23:58.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:56.734262+0000 mon.a (mon.0) 1045 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 76/1341 objects degraded (5.667%), 1 pg degraded) 2024-02-10T08:23:58.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:56.741948+0000 mon.a (mon.0) 1046 : cluster [DBG] osdmap e180: 8 total, 8 up, 8 in 2024-02-10T08:23:59.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:23:57.883760+0000 mgr.y (mgr.14505) 276 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:23:59.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:23:57.883760+0000 mgr.y (mgr.14505) 276 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:23:59.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:23:57.883760+0000 mgr.y (mgr.14505) 276 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:24:00.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:23:59 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:23:58.681993+0000 mgr.y (mgr.14505) 277 : cluster [DBG] pgmap v320: 158 pgs: 1 active+remapped+backfill_toofull, 1 active+recovering+undersized+remapped, 156 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 191 op/s; 1024 KiB/s, 25 objects/s recovering 2024-02-10T08:24:00.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:23:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:23:58.681993+0000 mgr.y (mgr.14505) 277 : cluster [DBG] pgmap v320: 158 pgs: 1 active+remapped+backfill_toofull, 1 active+recovering+undersized+remapped, 156 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 191 op/s; 1024 KiB/s, 25 objects/s recovering 2024-02-10T08:24:00.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:23:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:23:58.681993+0000 mgr.y (mgr.14505) 277 : cluster [DBG] pgmap v320: 158 pgs: 1 active+remapped+backfill_toofull, 1 active+recovering+undersized+remapped, 156 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 191 op/s; 1024 KiB/s, 25 objects/s recovering 2024-02-10T08:24:01.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:00.583071+0000 mon.a (mon.0) 1047 : cluster [DBG] osdmap e181: 8 total, 8 up, 8 in 2024-02-10T08:24:01.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:00.682353+0000 mgr.y (mgr.14505) 278 : cluster [DBG] pgmap v322: 158 pgs: 1 active+remapped+backfill_toofull, 1 active+recovering+undersized+remapped, 156 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 43 op/s; 395 KiB/s, 15 objects/s recovering 2024-02-10T08:24:01.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:00.583071+0000 mon.a (mon.0) 1047 : cluster [DBG] osdmap e181: 8 total, 8 up, 8 in 2024-02-10T08:24:01.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:00.682353+0000 mgr.y (mgr.14505) 278 : cluster [DBG] pgmap v322: 158 pgs: 1 active+remapped+backfill_toofull, 1 active+recovering+undersized+remapped, 156 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 43 op/s; 395 KiB/s, 15 objects/s recovering 2024-02-10T08:24:02.004 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-02-10T08:24:02.004 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-02-10T08:24:02.004 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-02-10T08:24:02.004 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-02-10T08:24:02.005 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.005 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:64572 7.b 7:d4591f65:::benchmark_data_smithi018_80623_object64571:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e102)", 2024-02-10T08:24:02.005 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:29.952114+0000", 2024-02-10T08:24:02.005 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 212.04935086, 2024-02-10T08:24:02.005 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.081601512000000001, 2024-02-10T08:24:02.005 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:24:02.005 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:24:02.005 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:24:02.005 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:24:02.005 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:24:02.005 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 64572 2024-02-10T08:24:02.005 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.005 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:24:02.005 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.005 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:24:02.006 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:29.952114+0000", 2024-02-10T08:24:02.006 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:24:02.006 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.006 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.006 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:24:02.006 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:29.952114+0000", 2024-02-10T08:24:02.006 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999981 2024-02-10T08:24:02.006 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.006 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.006 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:24:02.006 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:29.952112+0000", 2024-02-10T08:24:02.006 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0598000000000002e-05 2024-02-10T08:24:02.006 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.006 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.007 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:24:02.007 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:29.952133+0000", 2024-02-10T08:24:02.007 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0789e-05 2024-02-10T08:24:02.007 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.007 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.007 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:24:02.007 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:29.952144+0000", 2024-02-10T08:24:02.007 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5590000000000002e-06 2024-02-10T08:24:02.007 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.007 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.007 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:24:02.007 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:29.952150+0000", 2024-02-10T08:24:02.007 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9857000000000001e-05 2024-02-10T08:24:02.007 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.007 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.008 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:24:02.008 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:29.952190+0000", 2024-02-10T08:24:02.008 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.826e-06 2024-02-10T08:24:02.008 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.008 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.008 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-02-10T08:24:02.008 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:29.952195+0000", 2024-02-10T08:24:02.008 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.026224085000000001 2024-02-10T08:24:02.008 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.008 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.008 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:24:02.008 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:29.978419+0000", 2024-02-10T08:24:02.008 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000127121 2024-02-10T08:24:02.008 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.009 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.009 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:24:02.009 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:29.978546+0000", 2024-02-10T08:24:02.009 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015838399999999999 2024-02-10T08:24:02.009 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.009 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.009 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 5,6", 2024-02-10T08:24:02.009 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:29.978704+0000", 2024-02-10T08:24:02.009 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0073248339999999997 2024-02-10T08:24:02.009 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.009 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.009 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:24:02.009 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:29.986029+0000", 2024-02-10T08:24:02.009 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.031156205999999999 2024-02-10T08:24:02.010 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.010 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.010 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:24:02.010 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:30.017185+0000", 2024-02-10T08:24:02.010 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.016439120000000002 2024-02-10T08:24:02.010 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.010 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.010 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:24:02.010 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:30.033625+0000", 2024-02-10T08:24:02.010 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2543000000000002e-05 2024-02-10T08:24:02.010 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.010 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.010 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:24:02.010 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:30.033677+0000", 2024-02-10T08:24:02.011 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8359999999999999e-05 2024-02-10T08:24:02.011 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.011 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.011 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:24:02.011 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:30.033715+0000", 2024-02-10T08:24:02.011 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.081601512000000001 2024-02-10T08:24:02.011 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:02.011 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:24:02.011 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:02.011 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.011 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.011 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.14784.0:77149 7.d e107/91 7:bf968826:::benchmark_data_smithi018_80623_object77148:head v 107'4768, mlcod=107'4765)", 2024-02-10T08:24:02.011 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:42.079066+0000", 2024-02-10T08:24:02.011 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 199.92239855400001, 2024-02-10T08:24:02.011 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086684774000000006, 2024-02-10T08:24:02.012 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:24:02.012 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:24:02.012 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:24:02.012 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.012 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:24:02.012 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.079066+0000", 2024-02-10T08:24:02.012 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:24:02.012 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.012 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.012 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:24:02.012 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.079066+0000", 2024-02-10T08:24:02.012 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:24:02.012 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.012 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.013 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:24:02.013 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.079066+0000", 2024-02-10T08:24:02.013 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4546000000000002e-05 2024-02-10T08:24:02.013 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.013 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.013 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:24:02.013 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.079130+0000", 2024-02-10T08:24:02.013 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.515e-06 2024-02-10T08:24:02.013 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.013 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.014 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:24:02.014 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.079138+0000", 2024-02-10T08:24:02.014 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0929999999999996e-06 2024-02-10T08:24:02.014 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.014 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.014 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:24:02.014 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.079142+0000", 2024-02-10T08:24:02.014 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0508e-05 2024-02-10T08:24:02.014 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.014 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.014 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:24:02.014 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.079172+0000", 2024-02-10T08:24:02.014 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1972e-05 2024-02-10T08:24:02.014 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.014 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.015 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:24:02.015 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.079184+0000", 2024-02-10T08:24:02.015 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.084501413999999997 2024-02-10T08:24:02.015 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.015 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.015 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:24:02.015 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.163686+0000", 2024-02-10T08:24:02.015 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0020654459999999999 2024-02-10T08:24:02.015 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.015 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.015 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:24:02.015 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.165751+0000", 2024-02-10T08:24:02.015 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086684774000000006 2024-02-10T08:24:02.015 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:02.015 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:24:02.016 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:02.016 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.016 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.016 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:153198 7.b 7:d965b4d6:::benchmark_data_smithi018_80623_object52270:head [delete] snapc 0=[] ondisk+write+known_if_redirected e149)", 2024-02-10T08:24:02.016 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:22:37.562841+0000", 2024-02-10T08:24:02.016 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 84.438623616000001, 2024-02-10T08:24:02.016 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.068126513999999999, 2024-02-10T08:24:02.016 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:24:02.016 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:24:02.016 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:24:02.016 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:24:02.016 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:24:02.016 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 153198 2024-02-10T08:24:02.016 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.017 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:24:02.017 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.017 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:24:02.017 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.562841+0000", 2024-02-10T08:24:02.017 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:24:02.017 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.017 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.017 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:24:02.017 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.562841+0000", 2024-02-10T08:24:02.017 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:24:02.017 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.017 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.017 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:24:02.017 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.562841+0000", 2024-02-10T08:24:02.017 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1350000000000001e-06 2024-02-10T08:24:02.018 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.018 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.018 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:24:02.018 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.562844+0000", 2024-02-10T08:24:02.018 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0179999999999998e-06 2024-02-10T08:24:02.018 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.018 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.018 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:24:02.018 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.562850+0000", 2024-02-10T08:24:02.018 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3209999999999998e-06 2024-02-10T08:24:02.018 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.018 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.018 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:24:02.018 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.562854+0000", 2024-02-10T08:24:02.019 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00246437 2024-02-10T08:24:02.019 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.019 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.019 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:24:02.019 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.565318+0000", 2024-02-10T08:24:02.019 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000100599 2024-02-10T08:24:02.019 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.019 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.019 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:24:02.019 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.565419+0000", 2024-02-10T08:24:02.019 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012306099999999999 2024-02-10T08:24:02.019 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.019 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.019 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 5,6", 2024-02-10T08:24:02.019 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.565542+0000", 2024-02-10T08:24:02.020 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0020561189999999999 2024-02-10T08:24:02.020 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.020 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.020 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:24:02.020 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.567598+0000", 2024-02-10T08:24:02.020 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00075990599999999997 2024-02-10T08:24:02.020 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.020 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.020 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:24:02.020 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.568358+0000", 2024-02-10T08:24:02.020 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.062505851000000001 2024-02-10T08:24:02.020 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.020 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.020 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:24:02.020 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.630864+0000", 2024-02-10T08:24:02.021 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6558000000000003e-05 2024-02-10T08:24:02.021 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.021 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.021 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:24:02.021 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.630921+0000", 2024-02-10T08:24:02.021 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7172000000000002e-05 2024-02-10T08:24:02.021 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.021 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.021 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:24:02.021 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.630968+0000", 2024-02-10T08:24:02.021 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.068126513999999999 2024-02-10T08:24:02.021 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:02.021 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:24:02.021 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:02.022 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.022 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.022 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:153205 7.2 7:410b9e6c:::benchmark_data_smithi018_80623_object52277:head [delete] snapc 0=[] ondisk+write+known_if_redirected e149)", 2024-02-10T08:24:02.022 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:22:37.568270+0000", 2024-02-10T08:24:02.022 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 84.433194392999994, 2024-02-10T08:24:02.022 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.073131208000000003, 2024-02-10T08:24:02.022 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:24:02.022 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:24:02.022 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:24:02.022 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:24:02.022 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:24:02.022 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 153205 2024-02-10T08:24:02.022 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.022 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:24:02.022 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.023 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:24:02.023 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.568270+0000", 2024-02-10T08:24:02.023 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:24:02.023 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.023 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.023 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:24:02.023 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.568270+0000", 2024-02-10T08:24:02.023 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:24:02.023 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.023 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.023 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:24:02.023 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.568269+0000", 2024-02-10T08:24:02.023 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2200000000000003e-06 2024-02-10T08:24:02.023 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.023 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.024 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:24:02.024 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.568276+0000", 2024-02-10T08:24:02.024 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0849999999999997e-06 2024-02-10T08:24:02.024 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.024 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.024 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:24:02.024 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.568285+0000", 2024-02-10T08:24:02.024 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7649999999999999e-06 2024-02-10T08:24:02.024 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.024 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.024 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:24:02.024 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.568290+0000", 2024-02-10T08:24:02.024 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7422999999999995e-05 2024-02-10T08:24:02.024 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.025 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.025 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:24:02.025 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.568358+0000", 2024-02-10T08:24:02.025 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012063200000000001 2024-02-10T08:24:02.025 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.025 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.025 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:24:02.025 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.568478+0000", 2024-02-10T08:24:02.025 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013144900000000001 2024-02-10T08:24:02.025 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.025 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.025 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 2,3", 2024-02-10T08:24:02.025 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.568610+0000", 2024-02-10T08:24:02.025 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.063553605999999999 2024-02-10T08:24:02.025 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.025 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.026 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:24:02.026 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.632163+0000", 2024-02-10T08:24:02.026 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0066444420000000004 2024-02-10T08:24:02.026 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.026 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.026 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:24:02.026 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.638808+0000", 2024-02-10T08:24:02.026 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0025031630000000001 2024-02-10T08:24:02.026 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.026 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.026 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:24:02.026 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.641311+0000", 2024-02-10T08:24:02.026 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1916999999999998e-05 2024-02-10T08:24:02.026 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.027 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.027 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:24:02.027 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.641363+0000", 2024-02-10T08:24:02.027 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8655999999999997e-05 2024-02-10T08:24:02.027 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.027 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.027 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:24:02.027 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.641402+0000", 2024-02-10T08:24:02.027 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.073131208000000003 2024-02-10T08:24:02.027 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:02.027 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:24:02.027 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:02.027 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.027 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.027 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.14784.0:153201 7.0 e149/91 7:0da3817c:::benchmark_data_smithi018_80623_object52273:head v 149'9496, mlcod=149'9494)", 2024-02-10T08:24:02.028 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:22:37.568654+0000", 2024-02-10T08:24:02.028 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 84.432810889999999, 2024-02-10T08:24:02.028 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.073419021000000001, 2024-02-10T08:24:02.028 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:24:02.028 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:24:02.028 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:24:02.028 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.028 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:24:02.028 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.568654+0000", 2024-02-10T08:24:02.028 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:24:02.028 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.028 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.028 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:24:02.028 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.568654+0000", 2024-02-10T08:24:02.029 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:24:02.029 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.029 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.029 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:24:02.029 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.568653+0000", 2024-02-10T08:24:02.029 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2740000000000004e-06 2024-02-10T08:24:02.029 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.029 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.029 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:24:02.029 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.568660+0000", 2024-02-10T08:24:02.029 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.056815101 2024-02-10T08:24:02.029 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.029 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.029 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:24:02.029 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.625475+0000", 2024-02-10T08:24:02.030 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0129999999999996e-06 2024-02-10T08:24:02.030 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.030 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.030 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:24:02.030 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.625482+0000", 2024-02-10T08:24:02.030 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015673400000000001 2024-02-10T08:24:02.030 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.030 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.030 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:24:02.030 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.625638+0000", 2024-02-10T08:24:02.030 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1712000000000002e-05 2024-02-10T08:24:02.030 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.030 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.030 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:24:02.031 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.625660+0000", 2024-02-10T08:24:02.031 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.016385183000000001 2024-02-10T08:24:02.031 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.031 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.031 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:24:02.031 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.642045+0000", 2024-02-10T08:24:02.031 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7665999999999999e-05 2024-02-10T08:24:02.031 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.031 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.031 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:24:02.032 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.642073+0000", 2024-02-10T08:24:02.032 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.073419021000000001 2024-02-10T08:24:02.032 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:02.032 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:24:02.032 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:02.032 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.032 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.032 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:154696 7.2 7:40aef3be:::benchmark_data_smithi018_80623_object53768:head [delete] snapc 0=[] ondisk+write+known_if_redirected e149)", 2024-02-10T08:24:02.032 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:22:39.548912+0000", 2024-02-10T08:24:02.032 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 82.452553101000007, 2024-02-10T08:24:02.032 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.069045797000000006, 2024-02-10T08:24:02.032 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:24:02.032 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:24:02.032 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:24:02.033 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:24:02.033 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:24:02.033 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 154696 2024-02-10T08:24:02.033 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.033 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:24:02.033 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.033 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:24:02.033 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.548912+0000", 2024-02-10T08:24:02.033 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:24:02.033 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.033 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.033 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:24:02.033 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.548912+0000", 2024-02-10T08:24:02.033 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:24:02.034 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.034 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.034 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:24:02.034 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.548910+0000", 2024-02-10T08:24:02.034 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2210000000000002e-06 2024-02-10T08:24:02.034 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.034 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.034 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:24:02.034 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.548916+0000", 2024-02-10T08:24:02.034 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1537e-05 2024-02-10T08:24:02.034 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.034 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.034 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:24:02.034 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.548928+0000", 2024-02-10T08:24:02.035 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0400000000000004e-06 2024-02-10T08:24:02.035 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.035 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.035 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:24:02.035 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.548935+0000", 2024-02-10T08:24:02.035 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0695999999999998e-05 2024-02-10T08:24:02.035 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.035 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.035 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:24:02.035 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.548976+0000", 2024-02-10T08:24:02.035 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012357399999999999 2024-02-10T08:24:02.035 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.035 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.035 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:24:02.035 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.549099+0000", 2024-02-10T08:24:02.036 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000128446 2024-02-10T08:24:02.036 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.036 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.036 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 2,3", 2024-02-10T08:24:02.036 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.549228+0000", 2024-02-10T08:24:02.036 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0079650209999999992 2024-02-10T08:24:02.036 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.036 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.036 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:24:02.036 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.557193+0000", 2024-02-10T08:24:02.036 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0048933140000000002 2024-02-10T08:24:02.036 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.036 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.036 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:24:02.036 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.562086+0000", 2024-02-10T08:24:02.037 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.055774518000000002 2024-02-10T08:24:02.037 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.037 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.037 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:24:02.037 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.617860+0000", 2024-02-10T08:24:02.037 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5177999999999999e-05 2024-02-10T08:24:02.037 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.037 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.037 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:24:02.037 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.617916+0000", 2024-02-10T08:24:02.037 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1836999999999999e-05 2024-02-10T08:24:02.037 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.037 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.037 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:24:02.038 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.617958+0000", 2024-02-10T08:24:02.038 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.069045797000000006 2024-02-10T08:24:02.038 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:02.038 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:24:02.038 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:02.038 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.038 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.038 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:154713 7.2 7:4f99dedd:::benchmark_data_smithi018_80623_object53785:head [delete] snapc 0=[] ondisk+write+known_if_redirected e149)", 2024-02-10T08:24:02.038 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:22:39.568591+0000", 2024-02-10T08:24:02.038 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 82.432873856000001, 2024-02-10T08:24:02.038 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.066936960000000004, 2024-02-10T08:24:02.038 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:24:02.038 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:24:02.038 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:24:02.038 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:24:02.039 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:24:02.039 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 154713 2024-02-10T08:24:02.039 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.039 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:24:02.039 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.039 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:24:02.039 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.568591+0000", 2024-02-10T08:24:02.039 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:24:02.039 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.039 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.039 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:24:02.039 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.568591+0000", 2024-02-10T08:24:02.039 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:24:02.039 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.039 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.040 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:24:02.040 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.568590+0000", 2024-02-10T08:24:02.040 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3169999999999998e-06 2024-02-10T08:24:02.040 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.040 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.040 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:24:02.040 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.568596+0000", 2024-02-10T08:24:02.040 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0489000000000001e-05 2024-02-10T08:24:02.040 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.040 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.040 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:24:02.040 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.568606+0000", 2024-02-10T08:24:02.040 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.818e-06 2024-02-10T08:24:02.040 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.040 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.041 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:24:02.041 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.568612+0000", 2024-02-10T08:24:02.041 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8578000000000002e-05 2024-02-10T08:24:02.041 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.041 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.041 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:24:02.041 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.568651+0000", 2024-02-10T08:24:02.041 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7990000000000004e-05 2024-02-10T08:24:02.041 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.041 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.041 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:24:02.041 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.568729+0000", 2024-02-10T08:24:02.041 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8199000000000001e-05 2024-02-10T08:24:02.041 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.041 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.042 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 2,3", 2024-02-10T08:24:02.042 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.568807+0000", 2024-02-10T08:24:02.042 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0023466469999999999 2024-02-10T08:24:02.042 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.042 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.042 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:24:02.042 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.571154+0000", 2024-02-10T08:24:02.042 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000334366 2024-02-10T08:24:02.042 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.042 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.042 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:24:02.042 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.571488+0000", 2024-02-10T08:24:02.042 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.063954092000000004 2024-02-10T08:24:02.042 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.042 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.042 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:24:02.043 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.635442+0000", 2024-02-10T08:24:02.043 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7292000000000001e-05 2024-02-10T08:24:02.043 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.043 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.043 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:24:02.043 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.635489+0000", 2024-02-10T08:24:02.043 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8464000000000003e-05 2024-02-10T08:24:02.043 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.043 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.043 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:24:02.043 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.635528+0000", 2024-02-10T08:24:02.043 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.066936960000000004 2024-02-10T08:24:02.043 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:02.043 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:24:02.043 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:02.044 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.044 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.044 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:154715 7.2 7:44e78da6:::benchmark_data_smithi018_80623_object53787:head [delete] snapc 0=[] ondisk+write+known_if_redirected e149)", 2024-02-10T08:24:02.044 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:22:39.571888+0000", 2024-02-10T08:24:02.044 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 82.429576372, 2024-02-10T08:24:02.044 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.072221726, 2024-02-10T08:24:02.044 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:24:02.044 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:24:02.044 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:24:02.044 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:24:02.044 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:24:02.044 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 154715 2024-02-10T08:24:02.044 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.044 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:24:02.045 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.045 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:24:02.045 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.571888+0000", 2024-02-10T08:24:02.045 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:24:02.045 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.045 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.045 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:24:02.045 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.571888+0000", 2024-02-10T08:24:02.045 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:24:02.045 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.045 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.045 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:24:02.045 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.571888+0000", 2024-02-10T08:24:02.045 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8609999999999997e-06 2024-02-10T08:24:02.046 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.046 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.046 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:24:02.046 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.571893+0000", 2024-02-10T08:24:02.046 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4279999999999999e-06 2024-02-10T08:24:02.046 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.046 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.046 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:24:02.046 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.571900+0000", 2024-02-10T08:24:02.046 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9659999999999998e-06 2024-02-10T08:24:02.046 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.046 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.046 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:24:02.046 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.571904+0000", 2024-02-10T08:24:02.046 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9781000000000002e-05 2024-02-10T08:24:02.047 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.047 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.047 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:24:02.047 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.571934+0000", 2024-02-10T08:24:02.047 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5530000000000004e-05 2024-02-10T08:24:02.047 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.047 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.047 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:24:02.047 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.571999+0000", 2024-02-10T08:24:02.047 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6127999999999999e-05 2024-02-10T08:24:02.047 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.047 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.047 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 2,3", 2024-02-10T08:24:02.047 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.572085+0000", 2024-02-10T08:24:02.047 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001400089 2024-02-10T08:24:02.048 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.048 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.048 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:24:02.048 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.573485+0000", 2024-02-10T08:24:02.048 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.045431224999999999 2024-02-10T08:24:02.048 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.048 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.048 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:24:02.048 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.618917+0000", 2024-02-10T08:24:02.048 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.025093054 2024-02-10T08:24:02.048 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.048 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.048 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:24:02.048 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.644010+0000", 2024-02-10T08:24:02.049 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8428999999999999e-05 2024-02-10T08:24:02.049 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.049 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.049 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:24:02.049 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.644068+0000", 2024-02-10T08:24:02.049 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1990000000000003e-05 2024-02-10T08:24:02.049 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.049 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.049 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:24:02.049 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.644110+0000", 2024-02-10T08:24:02.049 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.072221726 2024-02-10T08:24:02.049 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:02.049 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:24:02.049 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:02.049 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.050 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.050 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:155167 7.2 7:48650d8a:::benchmark_data_smithi018_80623_object54239:head [delete] snapc 0=[] ondisk+write+known_if_redirected e149)", 2024-02-10T08:24:02.050 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:22:40.199455+0000", 2024-02-10T08:24:02.050 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 81.802009338999994, 2024-02-10T08:24:02.050 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.081791193999999998, 2024-02-10T08:24:02.050 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:24:02.050 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:24:02.050 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:24:02.050 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:24:02.050 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:24:02.050 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 155167 2024-02-10T08:24:02.050 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.050 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:24:02.050 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.050 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:24:02.051 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.199455+0000", 2024-02-10T08:24:02.051 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:24:02.051 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.051 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.051 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:24:02.051 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.199455+0000", 2024-02-10T08:24:02.051 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:24:02.051 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.051 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.051 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:24:02.051 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.199454+0000", 2024-02-10T08:24:02.051 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3420000000000002e-06 2024-02-10T08:24:02.051 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.051 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.052 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:24:02.052 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.199461+0000", 2024-02-10T08:24:02.052 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1419e-05 2024-02-10T08:24:02.052 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.052 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.052 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:24:02.052 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.199473+0000", 2024-02-10T08:24:02.052 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3630000000000002e-06 2024-02-10T08:24:02.052 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.052 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.052 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:24:02.052 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.199478+0000", 2024-02-10T08:24:02.052 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9564000000000002e-05 2024-02-10T08:24:02.052 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.053 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.053 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:24:02.053 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.199528+0000", 2024-02-10T08:24:02.053 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000114601 2024-02-10T08:24:02.053 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.053 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.053 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:24:02.053 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.199642+0000", 2024-02-10T08:24:02.053 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013268700000000001 2024-02-10T08:24:02.053 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.053 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.053 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 2,3", 2024-02-10T08:24:02.053 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.199775+0000", 2024-02-10T08:24:02.053 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0056025650000000003 2024-02-10T08:24:02.053 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.054 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.054 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:24:02.054 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.205377+0000", 2024-02-10T08:24:02.054 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011831441 2024-02-10T08:24:02.054 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.054 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.054 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:24:02.054 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.217209+0000", 2024-02-10T08:24:02.054 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.063949695000000001 2024-02-10T08:24:02.054 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.054 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.054 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:24:02.054 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.281159+0000", 2024-02-10T08:24:02.054 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9061999999999999e-05 2024-02-10T08:24:02.054 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.055 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.055 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:24:02.055 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.281208+0000", 2024-02-10T08:24:02.055 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9029000000000002e-05 2024-02-10T08:24:02.055 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.055 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.055 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:24:02.055 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.281247+0000", 2024-02-10T08:24:02.055 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.081791193999999998 2024-02-10T08:24:02.055 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:02.055 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:24:02.055 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:02.055 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.055 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.055 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:155666 7.2 7:4479b2d2:::benchmark_data_smithi018_80623_object54738:head [delete] snapc 0=[] ondisk+write+known_if_redirected e149)", 2024-02-10T08:24:02.055 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:22:40.892255+0000", 2024-02-10T08:24:02.056 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 81.109209926000005, 2024-02-10T08:24:02.056 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.078684826999999999, 2024-02-10T08:24:02.056 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:24:02.056 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:24:02.056 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:24:02.056 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:24:02.056 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:24:02.056 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 155666 2024-02-10T08:24:02.056 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.056 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:24:02.056 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.056 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:24:02.056 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.892255+0000", 2024-02-10T08:24:02.056 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:24:02.057 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.057 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.057 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:24:02.057 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.892255+0000", 2024-02-10T08:24:02.057 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:24:02.057 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.057 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.057 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:24:02.057 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.892254+0000", 2024-02-10T08:24:02.057 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1499999999999999e-06 2024-02-10T08:24:02.057 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.057 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.057 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:24:02.057 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.892258+0000", 2024-02-10T08:24:02.058 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5759999999999996e-06 2024-02-10T08:24:02.058 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.058 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.058 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:24:02.058 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.892263+0000", 2024-02-10T08:24:02.058 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1869999999999999e-06 2024-02-10T08:24:02.058 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.058 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.058 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:24:02.058 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.892267+0000", 2024-02-10T08:24:02.058 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002597387 2024-02-10T08:24:02.058 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.058 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.058 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:24:02.058 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.894865+0000", 2024-02-10T08:24:02.059 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010696699999999999 2024-02-10T08:24:02.059 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.059 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.059 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:24:02.059 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.894972+0000", 2024-02-10T08:24:02.059 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012987299999999999 2024-02-10T08:24:02.059 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.059 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.059 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 2,3", 2024-02-10T08:24:02.059 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.895102+0000", 2024-02-10T08:24:02.059 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0057554190000000003 2024-02-10T08:24:02.059 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.059 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.059 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:24:02.059 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.900857+0000", 2024-02-10T08:24:02.060 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0021897359999999999 2024-02-10T08:24:02.060 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.060 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.060 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:24:02.060 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.903047+0000", 2024-02-10T08:24:02.060 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.067804812000000006 2024-02-10T08:24:02.060 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.060 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.060 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:24:02.060 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.970851+0000", 2024-02-10T08:24:02.060 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9815999999999999e-05 2024-02-10T08:24:02.060 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.060 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.060 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:24:02.061 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.970901+0000", 2024-02-10T08:24:02.061 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8402000000000003e-05 2024-02-10T08:24:02.061 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.061 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.061 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:24:02.061 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.970940+0000", 2024-02-10T08:24:02.061 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.078684826999999999 2024-02-10T08:24:02.061 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:02.061 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:24:02.061 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:02.061 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.061 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.061 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:155939 7.2 7:49ed207d:::benchmark_data_smithi018_80623_object55011:head [delete] snapc 0=[] ondisk+write+known_if_redirected e149)", 2024-02-10T08:24:02.061 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:22:41.281367+0000", 2024-02-10T08:24:02.061 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 80.720098203999996, 2024-02-10T08:24:02.062 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.083337313999999996, 2024-02-10T08:24:02.062 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:24:02.062 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:24:02.062 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:24:02.062 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:24:02.062 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:24:02.062 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 155939 2024-02-10T08:24:02.062 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.062 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:24:02.062 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.062 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:24:02.062 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.281367+0000", 2024-02-10T08:24:02.062 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:24:02.062 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.062 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.063 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:24:02.063 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.281367+0000", 2024-02-10T08:24:02.063 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:24:02.063 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.063 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.063 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:24:02.063 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.281366+0000", 2024-02-10T08:24:02.063 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5899999999999998e-06 2024-02-10T08:24:02.063 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.063 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.063 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:24:02.063 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.281371+0000", 2024-02-10T08:24:02.063 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8969999999999997e-06 2024-02-10T08:24:02.063 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.064 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.064 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:24:02.064 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.281380+0000", 2024-02-10T08:24:02.064 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6119999999999998e-06 2024-02-10T08:24:02.064 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.064 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.064 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:24:02.064 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.281386+0000", 2024-02-10T08:24:02.064 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0033349830000000001 2024-02-10T08:24:02.064 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.064 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.064 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:24:02.064 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.284721+0000", 2024-02-10T08:24:02.064 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010802300000000001 2024-02-10T08:24:02.064 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.065 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.065 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:24:02.065 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.284829+0000", 2024-02-10T08:24:02.065 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012728199999999999 2024-02-10T08:24:02.065 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.065 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.065 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 2,3", 2024-02-10T08:24:02.065 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.284956+0000", 2024-02-10T08:24:02.065 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.012928574999999999 2024-02-10T08:24:02.065 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.065 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.065 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:24:02.065 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.297885+0000", 2024-02-10T08:24:02.065 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018071299999999999 2024-02-10T08:24:02.065 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.066 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.066 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:24:02.066 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.298065+0000", 2024-02-10T08:24:02.066 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.066551182 2024-02-10T08:24:02.066 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.066 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.066 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:24:02.066 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.364617+0000", 2024-02-10T08:24:02.066 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8584000000000001e-05 2024-02-10T08:24:02.066 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.066 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.066 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:24:02.066 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.364665+0000", 2024-02-10T08:24:02.066 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8834000000000001e-05 2024-02-10T08:24:02.067 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.067 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.067 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:24:02.067 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.364704+0000", 2024-02-10T08:24:02.067 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.083337313999999996 2024-02-10T08:24:02.067 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:02.067 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:24:02.067 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:02.067 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.067 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.067 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:156135 7.2 7:4200c1a2:::benchmark_data_smithi018_80623_object55207:head [delete] snapc 0=[] ondisk+write+known_if_redirected e149)", 2024-02-10T08:24:02.067 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:22:41.576363+0000", 2024-02-10T08:24:02.067 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 80.425102115000001, 2024-02-10T08:24:02.067 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.070036589999999996, 2024-02-10T08:24:02.067 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:24:02.068 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:24:02.068 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:24:02.068 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:24:02.068 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:24:02.068 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 156135 2024-02-10T08:24:02.068 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.068 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:24:02.068 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.068 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:24:02.068 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.576363+0000", 2024-02-10T08:24:02.068 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:24:02.068 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.068 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.068 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:24:02.068 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.576363+0000", 2024-02-10T08:24:02.069 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999981 2024-02-10T08:24:02.069 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.069 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.069 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:24:02.069 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.576361+0000", 2024-02-10T08:24:02.069 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2130000000000008e-06 2024-02-10T08:24:02.069 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.069 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.069 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:24:02.069 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.576369+0000", 2024-02-10T08:24:02.069 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2225000000000001e-05 2024-02-10T08:24:02.069 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.069 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.069 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:24:02.069 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.576381+0000", 2024-02-10T08:24:02.070 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9330000000000004e-06 2024-02-10T08:24:02.070 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.070 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.070 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:24:02.070 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.576388+0000", 2024-02-10T08:24:02.070 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00074003600000000001 2024-02-10T08:24:02.070 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.070 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.070 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:24:02.070 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.577128+0000", 2024-02-10T08:24:02.070 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000109788 2024-02-10T08:24:02.070 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.070 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.070 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:24:02.071 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.577238+0000", 2024-02-10T08:24:02.071 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012592699999999999 2024-02-10T08:24:02.071 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.071 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.071 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 2,3", 2024-02-10T08:24:02.071 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.577364+0000", 2024-02-10T08:24:02.071 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0058726539999999997 2024-02-10T08:24:02.071 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.071 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.071 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:24:02.071 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.583237+0000", 2024-02-10T08:24:02.071 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.029150738999999998 2024-02-10T08:24:02.071 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.071 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.071 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:24:02.072 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.612387+0000", 2024-02-10T08:24:02.072 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.033925438000000002 2024-02-10T08:24:02.072 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.072 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.072 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:24:02.072 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.646313+0000", 2024-02-10T08:24:02.072 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8245999999999999e-05 2024-02-10T08:24:02.072 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.072 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.072 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:24:02.072 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.646361+0000", 2024-02-10T08:24:02.072 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8219000000000001e-05 2024-02-10T08:24:02.072 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.072 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.073 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:24:02.073 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.646399+0000", 2024-02-10T08:24:02.073 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.070036589999999996 2024-02-10T08:24:02.073 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:02.073 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:24:02.073 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:02.073 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.073 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.073 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:158145 7.2 7:4e3f3d32:::benchmark_data_smithi018_80623_object57217:head [delete] snapc 0=[] ondisk+write+known_if_redirected e152)", 2024-02-10T08:24:02.073 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:22:44.856304+0000", 2024-02-10T08:24:02.073 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 77.145160888000007, 2024-02-10T08:24:02.073 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.090853510999999998, 2024-02-10T08:24:02.073 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:24:02.073 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:24:02.073 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:24:02.074 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:24:02.074 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:24:02.074 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 158145 2024-02-10T08:24:02.074 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.074 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:24:02.074 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.074 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:24:02.074 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.856304+0000", 2024-02-10T08:24:02.074 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:24:02.074 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.074 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.074 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:24:02.074 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.856304+0000", 2024-02-10T08:24:02.074 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:24:02.074 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.075 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.075 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:24:02.075 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.856303+0000", 2024-02-10T08:24:02.075 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6949999999999999e-06 2024-02-10T08:24:02.075 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.075 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.075 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:24:02.075 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.856308+0000", 2024-02-10T08:24:02.075 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5439999999999999e-06 2024-02-10T08:24:02.075 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.075 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.075 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:24:02.075 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.856316+0000", 2024-02-10T08:24:02.075 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1009999999999997e-06 2024-02-10T08:24:02.075 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.075 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.076 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:24:02.076 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.856322+0000", 2024-02-10T08:24:02.076 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0246e-05 2024-02-10T08:24:02.076 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.076 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.076 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:24:02.076 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.856373+0000", 2024-02-10T08:24:02.076 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000110302 2024-02-10T08:24:02.076 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.076 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.076 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:24:02.076 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.856483+0000", 2024-02-10T08:24:02.076 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012738499999999999 2024-02-10T08:24:02.076 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.077 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.077 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 2,3", 2024-02-10T08:24:02.077 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.856610+0000", 2024-02-10T08:24:02.077 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.014536597 2024-02-10T08:24:02.077 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.077 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.077 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:24:02.077 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.871147+0000", 2024-02-10T08:24:02.077 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.003922193 2024-02-10T08:24:02.077 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.077 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.077 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:24:02.077 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.875069+0000", 2024-02-10T08:24:02.077 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.072002255000000001 2024-02-10T08:24:02.077 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.078 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.078 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:24:02.078 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.947071+0000", 2024-02-10T08:24:02.078 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5423999999999997e-05 2024-02-10T08:24:02.078 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.078 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.078 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:24:02.078 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.947117+0000", 2024-02-10T08:24:02.078 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0692999999999998e-05 2024-02-10T08:24:02.078 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.078 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.078 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:24:02.078 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.947157+0000", 2024-02-10T08:24:02.078 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.090853510999999998 2024-02-10T08:24:02.079 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:02.079 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:24:02.079 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:02.079 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.079 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.079 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:158156 7.2 7:4b742d49:::benchmark_data_smithi018_80623_object57228:head [delete] snapc 0=[] ondisk+write+known_if_redirected e152)", 2024-02-10T08:24:02.079 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:22:44.875979+0000", 2024-02-10T08:24:02.079 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 77.125486093000006, 2024-02-10T08:24:02.079 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.079453853000000005, 2024-02-10T08:24:02.079 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:24:02.079 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:24:02.079 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:24:02.079 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:24:02.079 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:24:02.079 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 158156 2024-02-10T08:24:02.079 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.080 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:24:02.080 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.080 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:24:02.080 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.875979+0000", 2024-02-10T08:24:02.080 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:24:02.080 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.080 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.080 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:24:02.080 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.875979+0000", 2024-02-10T08:24:02.080 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999981 2024-02-10T08:24:02.080 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.080 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.080 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:24:02.080 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.875977+0000", 2024-02-10T08:24:02.081 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9209999999999998e-06 2024-02-10T08:24:02.081 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.081 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.081 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:24:02.081 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.875986+0000", 2024-02-10T08:24:02.081 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4076e-05 2024-02-10T08:24:02.081 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.081 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.081 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:24:02.081 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.876000+0000", 2024-02-10T08:24:02.081 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3319999999999992e-06 2024-02-10T08:24:02.081 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.081 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.081 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:24:02.081 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.876008+0000", 2024-02-10T08:24:02.082 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6607000000000002e-05 2024-02-10T08:24:02.082 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.082 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.082 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:24:02.082 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.876065+0000", 2024-02-10T08:24:02.082 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0260999999999995e-05 2024-02-10T08:24:02.082 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.082 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.082 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:24:02.082 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.876155+0000", 2024-02-10T08:24:02.082 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011905600000000001 2024-02-10T08:24:02.082 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.082 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.082 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 2,3", 2024-02-10T08:24:02.082 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.876274+0000", 2024-02-10T08:24:02.083 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001980435 2024-02-10T08:24:02.083 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.083 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.083 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:24:02.083 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.878254+0000", 2024-02-10T08:24:02.083 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00026547400000000003 2024-02-10T08:24:02.083 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.083 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.083 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:24:02.083 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.878520+0000", 2024-02-10T08:24:02.083 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.076825067999999996 2024-02-10T08:24:02.083 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.083 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.083 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:24:02.083 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.955345+0000", 2024-02-10T08:24:02.084 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7264e-05 2024-02-10T08:24:02.084 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.084 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.084 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:24:02.084 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.955392+0000", 2024-02-10T08:24:02.084 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0404000000000001e-05 2024-02-10T08:24:02.084 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.084 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.084 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:24:02.084 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.955433+0000", 2024-02-10T08:24:02.084 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.079453853000000005 2024-02-10T08:24:02.084 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:02.084 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:24:02.084 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:02.084 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.085 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.085 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:182653 7.2 7:4f924604:::benchmark_data_smithi018_80623_object81725:head [delete] snapc 0=[] ondisk+write+known_if_redirected e165)", 2024-02-10T08:24:02.085 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:23:19.802863+0000", 2024-02-10T08:24:02.085 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 42.198602102000002, 2024-02-10T08:24:02.085 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.092449144999999996, 2024-02-10T08:24:02.085 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:24:02.085 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:24:02.085 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:24:02.085 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:24:02.085 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:24:02.085 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 182653 2024-02-10T08:24:02.085 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.085 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:24:02.085 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.085 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:24:02.086 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.802863+0000", 2024-02-10T08:24:02.086 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:24:02.086 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.086 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.086 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:24:02.086 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.802863+0000", 2024-02-10T08:24:02.086 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:24:02.086 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.086 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.086 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:24:02.086 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.802861+0000", 2024-02-10T08:24:02.086 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.737e-06 2024-02-10T08:24:02.086 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.086 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.086 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:24:02.087 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.802868+0000", 2024-02-10T08:24:02.087 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0404999999999999e-05 2024-02-10T08:24:02.087 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.087 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.087 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:24:02.087 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.802878+0000", 2024-02-10T08:24:02.087 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7690000000000002e-06 2024-02-10T08:24:02.087 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.087 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.087 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:24:02.087 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.802884+0000", 2024-02-10T08:24:02.087 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0051375580000000004 2024-02-10T08:24:02.087 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.087 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.087 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:24:02.088 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.808022+0000", 2024-02-10T08:24:02.088 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000110547 2024-02-10T08:24:02.088 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.088 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.088 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:24:02.088 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.808132+0000", 2024-02-10T08:24:02.088 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012938500000000001 2024-02-10T08:24:02.088 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.088 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.088 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 2,3", 2024-02-10T08:24:02.088 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.808262+0000", 2024-02-10T08:24:02.088 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.061389966999999997 2024-02-10T08:24:02.088 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.088 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.088 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:24:02.089 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.869652+0000", 2024-02-10T08:24:02.089 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.01027989 2024-02-10T08:24:02.089 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.089 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.089 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:24:02.089 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.879931+0000", 2024-02-10T08:24:02.089 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015289181000000001 2024-02-10T08:24:02.089 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.089 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.089 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:24:02.089 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.895221+0000", 2024-02-10T08:24:02.089 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1431999999999998e-05 2024-02-10T08:24:02.089 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.089 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.089 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:24:02.090 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.895272+0000", 2024-02-10T08:24:02.090 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9768000000000003e-05 2024-02-10T08:24:02.090 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.090 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.090 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:24:02.090 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.895312+0000", 2024-02-10T08:24:02.090 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.092449144999999996 2024-02-10T08:24:02.090 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:02.090 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:24:02.090 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:02.090 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.090 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.090 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:182655 7.b 7:d954dfa7:::benchmark_data_smithi018_80623_object81727:head [delete] snapc 0=[] ondisk+write+known_if_redirected e165)", 2024-02-10T08:24:02.090 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:23:19.802965+0000", 2024-02-10T08:24:02.090 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 42.198499773999998, 2024-02-10T08:24:02.091 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.067251508000000002, 2024-02-10T08:24:02.091 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:24:02.091 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:24:02.091 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:24:02.091 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:24:02.091 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:24:02.091 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 182655 2024-02-10T08:24:02.091 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.091 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:24:02.091 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.091 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:24:02.091 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.802965+0000", 2024-02-10T08:24:02.091 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:24:02.091 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.091 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.092 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:24:02.092 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.802965+0000", 2024-02-10T08:24:02.092 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:24:02.092 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.092 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.092 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:24:02.092 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.802964+0000", 2024-02-10T08:24:02.092 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6620000000000002e-06 2024-02-10T08:24:02.092 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.092 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.092 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:24:02.092 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.802970+0000", 2024-02-10T08:24:02.092 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8380000000000008e-06 2024-02-10T08:24:02.092 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.092 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.093 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:24:02.093 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.802979+0000", 2024-02-10T08:24:02.093 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0989999999999998e-06 2024-02-10T08:24:02.093 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.093 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.093 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:24:02.093 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.802984+0000", 2024-02-10T08:24:02.093 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5933000000000002e-05 2024-02-10T08:24:02.093 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.093 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.093 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:24:02.093 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.803030+0000", 2024-02-10T08:24:02.093 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000120615 2024-02-10T08:24:02.093 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.093 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.094 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:24:02.094 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.803150+0000", 2024-02-10T08:24:02.094 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000118876 2024-02-10T08:24:02.094 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.094 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.094 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 5,6", 2024-02-10T08:24:02.094 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.803269+0000", 2024-02-10T08:24:02.094 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0025142670000000002 2024-02-10T08:24:02.094 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.094 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.094 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:24:02.094 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.805783+0000", 2024-02-10T08:24:02.094 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0016602349999999999 2024-02-10T08:24:02.094 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.094 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.095 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:24:02.095 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.807444+0000", 2024-02-10T08:24:02.095 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.062687231999999996 2024-02-10T08:24:02.095 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.095 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.095 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:24:02.095 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.870131+0000", 2024-02-10T08:24:02.095 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7092999999999998e-05 2024-02-10T08:24:02.095 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.095 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.095 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:24:02.095 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.870178+0000", 2024-02-10T08:24:02.095 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8680000000000002e-05 2024-02-10T08:24:02.095 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.096 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.096 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:24:02.096 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.870217+0000", 2024-02-10T08:24:02.096 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.067251508000000002 2024-02-10T08:24:02.096 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:02.096 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:24:02.096 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:02.096 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.096 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.096 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:182658 7.2 7:45e33f02:::benchmark_data_smithi018_80623_object81730:head [delete] snapc 0=[] ondisk+write+known_if_redirected e165)", 2024-02-10T08:24:02.096 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:23:19.809349+0000", 2024-02-10T08:24:02.096 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 42.192115801, 2024-02-10T08:24:02.096 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086067777999999998, 2024-02-10T08:24:02.096 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:24:02.096 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:24:02.097 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:24:02.097 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:24:02.097 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:24:02.097 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 182658 2024-02-10T08:24:02.097 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.097 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:24:02.097 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.097 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:24:02.097 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.809349+0000", 2024-02-10T08:24:02.097 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:24:02.097 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.097 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.097 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:24:02.097 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.809349+0000", 2024-02-10T08:24:02.098 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:24:02.098 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.098 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.098 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:24:02.098 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.809348+0000", 2024-02-10T08:24:02.098 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.501e-06 2024-02-10T08:24:02.098 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.098 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.098 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:24:02.098 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.809352+0000", 2024-02-10T08:24:02.098 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9429999999999999e-06 2024-02-10T08:24:02.098 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.098 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.098 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:24:02.098 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.809357+0000", 2024-02-10T08:24:02.099 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.185e-06 2024-02-10T08:24:02.099 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.099 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.099 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:24:02.099 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.809360+0000", 2024-02-10T08:24:02.099 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.060314260000000001 2024-02-10T08:24:02.099 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.099 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.099 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:24:02.099 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.869674+0000", 2024-02-10T08:24:02.099 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012447000000000001 2024-02-10T08:24:02.099 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.099 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.099 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:24:02.099 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.869799+0000", 2024-02-10T08:24:02.100 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000144707 2024-02-10T08:24:02.100 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.100 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.100 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 2,3", 2024-02-10T08:24:02.100 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.869943+0000", 2024-02-10T08:24:02.100 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0099495309999999993 2024-02-10T08:24:02.100 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.100 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.100 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:24:02.100 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.879893+0000", 2024-02-10T08:24:02.100 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0056066010000000001 2024-02-10T08:24:02.100 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.100 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.100 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:24:02.101 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.885499+0000", 2024-02-10T08:24:02.101 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0098464190000000004 2024-02-10T08:24:02.101 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.101 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.101 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:24:02.101 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.895346+0000", 2024-02-10T08:24:02.101 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6343000000000001e-05 2024-02-10T08:24:02.101 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.101 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.101 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:24:02.101 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.895382+0000", 2024-02-10T08:24:02.101 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4675000000000003e-05 2024-02-10T08:24:02.101 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.101 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.101 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:24:02.102 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.895417+0000", 2024-02-10T08:24:02.102 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086067777999999998 2024-02-10T08:24:02.102 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:02.102 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:24:02.102 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:02.102 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.102 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.102 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:184097 7.2 7:428fedb3:::benchmark_data_smithi018_80623_object83169:head [delete] snapc 0=[] ondisk+write+known_if_redirected e165)", 2024-02-10T08:24:02.102 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:23:21.936658+0000", 2024-02-10T08:24:02.102 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 40.064806775999998, 2024-02-10T08:24:02.102 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.075418111999999995, 2024-02-10T08:24:02.102 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:24:02.102 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:24:02.102 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:24:02.102 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:24:02.103 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:24:02.103 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 184097 2024-02-10T08:24:02.103 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.103 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:24:02.103 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.103 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:24:02.103 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:21.936658+0000", 2024-02-10T08:24:02.103 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:24:02.103 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.103 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.103 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:24:02.103 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:21.936658+0000", 2024-02-10T08:24:02.103 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:24:02.103 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.103 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.104 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:24:02.104 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:21.936657+0000", 2024-02-10T08:24:02.104 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5039999999999998e-06 2024-02-10T08:24:02.104 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.104 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.104 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:24:02.104 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:21.936661+0000", 2024-02-10T08:24:02.104 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1279999999999996e-06 2024-02-10T08:24:02.104 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.104 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.104 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:24:02.104 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:21.936667+0000", 2024-02-10T08:24:02.104 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5689999999999998e-06 2024-02-10T08:24:02.104 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.105 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.105 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:24:02.105 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:21.936672+0000", 2024-02-10T08:24:02.105 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0025274410000000001 2024-02-10T08:24:02.105 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.105 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.105 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:24:02.105 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:21.939199+0000", 2024-02-10T08:24:02.105 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000112501 2024-02-10T08:24:02.105 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.105 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.105 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:24:02.105 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:21.939312+0000", 2024-02-10T08:24:02.105 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013330199999999999 2024-02-10T08:24:02.105 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.106 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.106 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 2,3", 2024-02-10T08:24:02.106 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:21.939445+0000", 2024-02-10T08:24:02.106 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0030086000000000002 2024-02-10T08:24:02.106 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.106 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.106 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:24:02.106 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:21.942453+0000", 2024-02-10T08:24:02.106 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0054853810000000001 2024-02-10T08:24:02.106 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.106 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.106 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:24:02.106 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:21.947939+0000", 2024-02-10T08:24:02.106 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.064034720000000003 2024-02-10T08:24:02.106 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.106 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.107 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:24:02.107 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:22.011974+0000", 2024-02-10T08:24:02.107 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2256000000000002e-05 2024-02-10T08:24:02.107 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.107 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.107 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:24:02.107 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:22.012026+0000", 2024-02-10T08:24:02.107 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0303999999999998e-05 2024-02-10T08:24:02.107 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.107 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.107 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:24:02.107 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:22.012076+0000", 2024-02-10T08:24:02.107 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.075418111999999995 2024-02-10T08:24:02.107 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:02.107 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:24:02.108 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:02.108 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.108 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.108 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:184795 7.2 7:4f3b0903:::benchmark_data_smithi018_80623_object83867:head [delete] snapc 0=[] ondisk+write+known_if_redirected e165)", 2024-02-10T08:24:02.108 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:23:22.987095+0000", 2024-02-10T08:24:02.108 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 39.014369729999999, 2024-02-10T08:24:02.108 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.072374869999999994, 2024-02-10T08:24:02.108 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:24:02.108 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:24:02.108 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:24:02.108 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:24:02.108 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:24:02.108 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 184795 2024-02-10T08:24:02.108 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.109 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:24:02.109 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.109 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:24:02.109 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:22.987095+0000", 2024-02-10T08:24:02.109 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:24:02.109 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.109 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.109 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:24:02.109 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:22.987095+0000", 2024-02-10T08:24:02.109 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999976 2024-02-10T08:24:02.109 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.109 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.109 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:24:02.109 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:22.987093+0000", 2024-02-10T08:24:02.109 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7499999999999992e-06 2024-02-10T08:24:02.110 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.110 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.110 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:24:02.110 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:22.987102+0000", 2024-02-10T08:24:02.110 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2413e-05 2024-02-10T08:24:02.110 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.110 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.110 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:24:02.110 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:22.987114+0000", 2024-02-10T08:24:02.110 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5270000000000004e-06 2024-02-10T08:24:02.110 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.110 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.110 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:24:02.110 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:22.987121+0000", 2024-02-10T08:24:02.110 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6124000000000001e-05 2024-02-10T08:24:02.111 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.111 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.111 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:24:02.111 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:22.987167+0000", 2024-02-10T08:24:02.111 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000116276 2024-02-10T08:24:02.111 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.111 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.111 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:24:02.111 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:22.987283+0000", 2024-02-10T08:24:02.111 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013644699999999999 2024-02-10T08:24:02.111 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.111 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.111 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 2,3", 2024-02-10T08:24:02.111 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:22.987419+0000", 2024-02-10T08:24:02.111 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0025659419999999999 2024-02-10T08:24:02.112 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.112 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.112 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:24:02.112 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:22.989985+0000", 2024-02-10T08:24:02.112 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0037304819999999998 2024-02-10T08:24:02.112 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.112 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.112 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:24:02.112 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:22.993716+0000", 2024-02-10T08:24:02.112 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.065665486999999995 2024-02-10T08:24:02.112 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.112 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.112 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:24:02.112 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:23.059381+0000", 2024-02-10T08:24:02.112 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8535999999999997e-05 2024-02-10T08:24:02.113 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.113 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.113 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:24:02.113 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:23.059430+0000", 2024-02-10T08:24:02.113 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0151999999999998e-05 2024-02-10T08:24:02.113 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.113 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.113 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:24:02.113 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:23.059470+0000", 2024-02-10T08:24:02.113 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.072374869999999994 2024-02-10T08:24:02.113 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:02.113 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:24:02.113 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:02.113 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.113 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.114 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:184803 7.2 7:4a0039a9:::benchmark_data_smithi018_80623_object83875:head [delete] snapc 0=[] ondisk+write+known_if_redirected e165)", 2024-02-10T08:24:02.114 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:23:22.994200+0000", 2024-02-10T08:24:02.114 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 39.007264945000003, 2024-02-10T08:24:02.114 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.067094714, 2024-02-10T08:24:02.114 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:24:02.114 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:24:02.114 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:24:02.114 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:24:02.114 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:24:02.114 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 184803 2024-02-10T08:24:02.114 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.114 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:24:02.114 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.114 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:24:02.115 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:22.994200+0000", 2024-02-10T08:24:02.115 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:24:02.115 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.115 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.115 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:24:02.115 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:22.994200+0000", 2024-02-10T08:24:02.115 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999981 2024-02-10T08:24:02.115 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.115 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.115 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:24:02.115 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:22.994198+0000", 2024-02-10T08:24:02.115 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5140000000000004e-06 2024-02-10T08:24:02.115 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.115 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.115 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:24:02.116 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:22.994206+0000", 2024-02-10T08:24:02.116 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1911e-05 2024-02-10T08:24:02.116 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.116 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.116 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:24:02.116 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:22.994217+0000", 2024-02-10T08:24:02.116 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1239999999999999e-06 2024-02-10T08:24:02.116 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.116 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.116 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:24:02.116 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:22.994225+0000", 2024-02-10T08:24:02.116 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00062291799999999997 2024-02-10T08:24:02.116 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.116 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.116 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:24:02.117 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:22.994847+0000", 2024-02-10T08:24:02.117 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5529e-05 2024-02-10T08:24:02.117 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.117 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.117 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:24:02.117 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:22.994943+0000", 2024-02-10T08:24:02.117 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015091700000000001 2024-02-10T08:24:02.117 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.117 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.117 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 2,3", 2024-02-10T08:24:02.117 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:22.995094+0000", 2024-02-10T08:24:02.117 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.003058711 2024-02-10T08:24:02.117 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.117 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.117 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:24:02.118 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:22.998153+0000", 2024-02-10T08:24:02.118 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.061467698000000001 2024-02-10T08:24:02.118 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.118 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.118 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:24:02.118 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:23.059620+0000", 2024-02-10T08:24:02.118 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001591954 2024-02-10T08:24:02.118 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.118 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.118 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:24:02.118 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:23.061212+0000", 2024-02-10T08:24:02.118 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4863000000000001e-05 2024-02-10T08:24:02.118 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.118 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.118 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:24:02.119 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:23.061257+0000", 2024-02-10T08:24:02.119 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7410999999999998e-05 2024-02-10T08:24:02.119 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:02.119 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:02.119 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:24:02.119 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:23.061295+0000", 2024-02-10T08:24:02.119 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.067094714 2024-02-10T08:24:02.119 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:02.119 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:24:02.119 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:02.119 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:02.119 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:24:02.119 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-02-10T08:24:02.120 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:00.583071+0000 mon.a (mon.0) 1047 : cluster [DBG] osdmap e181: 8 total, 8 up, 8 in 2024-02-10T08:24:02.120 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:00.682353+0000 mgr.y (mgr.14505) 278 : cluster [DBG] pgmap v322: 158 pgs: 1 active+remapped+backfill_toofull, 1 active+recovering+undersized+remapped, 156 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 43 op/s; 395 KiB/s, 15 objects/s recovering 2024-02-10T08:24:02.120 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:24:02.121 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:24:02.121 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:02.122 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:24:02.122 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:24:02.223 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:24:02.252 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:02.451 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:24:02.454 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:02.455 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:24:02.556 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:24:02.584 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:02.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:24:01.630360+0000 mon.a (mon.0) 1048 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:24:02.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:24:01.630360+0000 mon.a (mon.0) 1048 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:24:03.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:24:01.630360+0000 mon.a (mon.0) 1048 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:24:03.134 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:24:03.157 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:03.158 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:24:03.259 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:24:03.292 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:03.314 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:24:03.316 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:03.317 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:24:03.418 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:24:03.446 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:03.465 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:24:03.467 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:03.467 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:24:03.569 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:24:03.600 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:03.768 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd set nodeep-scrub 2024-02-10T08:24:03.798 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:24:03.802 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:03.802 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:24:03.903 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:24:03.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:02.030501+0000 osd.4 (osd.4) 8 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:24:03.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:02.030593+0000 osd.4 (osd.4) 9 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:24:03.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:02.636178+0000 mon.a (mon.0) 1049 : cluster [DBG] osdmap e182: 8 total, 8 up, 8 in 2024-02-10T08:24:03.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:02.682718+0000 mgr.y (mgr.14505) 279 : cluster [DBG] pgmap v324: 158 pgs: 1 active+remapped+backfill_toofull, 1 active+recovering+undersized+remapped, 156 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s; 0 B/s, 19 objects/s recovering 2024-02-10T08:24:03.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:02.030501+0000 osd.4 (osd.4) 8 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:24:03.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:02.030593+0000 osd.4 (osd.4) 9 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:24:03.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:02.636178+0000 mon.a (mon.0) 1049 : cluster [DBG] osdmap e182: 8 total, 8 up, 8 in 2024-02-10T08:24:03.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:02.682718+0000 mgr.y (mgr.14505) 279 : cluster [DBG] pgmap v324: 158 pgs: 1 active+remapped+backfill_toofull, 1 active+recovering+undersized+remapped, 156 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s; 0 B/s, 19 objects/s recovering 2024-02-10T08:24:03.934 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:02.030501+0000 osd.4 (osd.4) 8 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:24:03.934 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:02.030593+0000 osd.4 (osd.4) 9 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:24:03.934 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:02.636178+0000 mon.a (mon.0) 1049 : cluster [DBG] osdmap e182: 8 total, 8 up, 8 in 2024-02-10T08:24:03.934 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:02.682718+0000 mgr.y (mgr.14505) 279 : cluster [DBG] pgmap v324: 158 pgs: 1 active+remapped+backfill_toofull, 1 active+recovering+undersized+remapped, 156 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s; 0 B/s, 19 objects/s recovering 2024-02-10T08:24:03.936 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:03.957 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:24:03.959 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:03.960 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:24:04.061 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:24:04.089 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:04.109 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:24:04.111 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:04.112 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:24:04.212 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:24:04.240 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:04.410 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.2 dump_ops_in_flight 2024-02-10T08:24:04.806 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:24:04.809 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:04.809 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:24:04.910 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:24:04.942 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:05.113 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:24:05.146 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:24:05.150 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:05.150 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:24:05.251 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:24:05.279 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:05.642 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:24:05.642 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:24:05.642 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:24:05.643 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:24:05.643 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:24:05.643 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:24:05.643 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:24:05.643 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:24:05.643 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-10T08:24:05.643 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-10T08:24:05.643 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-10T08:24:05.643 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-10T08:24:05.643 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-10T08:24:05.643 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-10T08:24:05.643 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-10T08:24:05.644 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-10T08:24:05.896 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:04.683211+0000 mgr.y (mgr.14505) 280 : cluster [DBG] pgmap v325: 158 pgs: 1 active+remapped+backfill_toofull, 1 active+recovering+undersized+remapped, 156 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s; 0 B/s, 14 objects/s recovering 2024-02-10T08:24:05.896 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:24:05.362633+0000 mon.c (mon.2) 35 : audit [DBG] from='client.? 172.21.15.18:0/3585001298' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:24:05.897 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:05.584634+0000 mon.a (mon.0) 1050 : cluster [DBG] osdmap e183: 8 total, 8 up, 8 in 2024-02-10T08:24:05.897 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:04.683211+0000 mgr.y (mgr.14505) 280 : cluster [DBG] pgmap v325: 158 pgs: 1 active+remapped+backfill_toofull, 1 active+recovering+undersized+remapped, 156 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s; 0 B/s, 14 objects/s recovering 2024-02-10T08:24:05.897 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:24:05.362633+0000 mon.c (mon.2) 35 : audit [DBG] from='client.? 172.21.15.18:0/3585001298' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:24:05.897 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:05.584634+0000 mon.a (mon.0) 1050 : cluster [DBG] osdmap e183: 8 total, 8 up, 8 in 2024-02-10T08:24:06.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:04.683211+0000 mgr.y (mgr.14505) 280 : cluster [DBG] pgmap v325: 158 pgs: 1 active+remapped+backfill_toofull, 1 active+recovering+undersized+remapped, 156 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s; 0 B/s, 14 objects/s recovering 2024-02-10T08:24:06.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:24:05.362633+0000 mon.c (mon.2) 35 : audit [DBG] from='client.? 172.21.15.18:0/3585001298' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:24:06.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:05.584634+0000 mon.a (mon.0) 1050 : cluster [DBG] osdmap e183: 8 total, 8 up, 8 in 2024-02-10T08:24:06.789 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:24:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:24:06] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:24:07.405 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:24:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:24:07] "GET /metrics HTTP/1.1" 200 175763 "" "Prometheus/2.33.4" 2024-02-10T08:24:07.529 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:24:07.532 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:07.533 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:24:07.633 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:24:07.666 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:07.687 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:24:07.689 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:07.690 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:24:07.791 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:24:07.820 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:07.840 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:24:07.842 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:07.842 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:24:07.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:06.683555+0000 mgr.y (mgr.14505) 281 : cluster [DBG] pgmap v327: 158 pgs: 1 active+remapped+backfill_toofull, 1 active+recovering+undersized+remapped, 156 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 838 B/s rd, 0 op/s; 0 B/s, 9 objects/s recovering 2024-02-10T08:24:07.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:06.683555+0000 mgr.y (mgr.14505) 281 : cluster [DBG] pgmap v327: 158 pgs: 1 active+remapped+backfill_toofull, 1 active+recovering+undersized+remapped, 156 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 838 B/s rd, 0 op/s; 0 B/s, 9 objects/s recovering 2024-02-10T08:24:07.943 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:24:07.945 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:24:07.969 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:24:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:24:07.969 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:06.683555+0000 mgr.y (mgr.14505) 281 : cluster [DBG] pgmap v327: 158 pgs: 1 active+remapped+backfill_toofull, 1 active+recovering+undersized+remapped, 156 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 838 B/s rd, 0 op/s; 0 B/s, 9 objects/s recovering 2024-02-10T08:24:07.971 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:07.991 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:24:07.993 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:07.994 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:24:08.095 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:24:08.122 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:08.140 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:24:08.142 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:08.143 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:24:08.243 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:24:08.270 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:08.289 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:24:08.291 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:08.291 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:24:08.294 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-02-10T08:24:08.294 INFO:teuthology.orchestra.run.smithi018.stdout: "success": "filestore_inject_stall = '3' (not observed, change may require restart) " 2024-02-10T08:24:08.294 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-02-10T08:24:08.393 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:24:08.419 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:08.437 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:24:08.439 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:08.440 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:24:08.541 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:24:08.567 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:08.585 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:24:08.587 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:08.587 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:24:08.688 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:24:08.715 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:08.733 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:24:08.735 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:08.735 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:24:08.776 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'unique_pool_0' removed 2024-02-10T08:24:08.837 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:24:08.862 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:24:07.888556+0000 mgr.y (mgr.14505) 282 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:24:08.862 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:24:08.009981+0000 mon.a (mon.0) 1051 : audit [INF] from='client.? 172.21.15.18:0/2240473874' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-10T08:24:08.864 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:08.882 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:24:08.885 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:08.885 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:24:08.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:24:07.888556+0000 mgr.y (mgr.14505) 282 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:24:08.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:24:08.009981+0000 mon.a (mon.0) 1051 : audit [INF] from='client.? 172.21.15.18:0/2240473874' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-10T08:24:08.917 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:24:07.888556+0000 mgr.y (mgr.14505) 282 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:24:08.917 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:24:08.009981+0000 mon.a (mon.0) 1051 : audit [INF] from='client.? 172.21.15.18:0/2240473874' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-10T08:24:08.987 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:24:09.018 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:09.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:08.684206+0000 mgr.y (mgr.14505) 283 : cluster [DBG] pgmap v328: 158 pgs: 1 active+remapped+backfill_toofull, 1 active+recovering+undersized+remapped, 156 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 0 B/s, 14 objects/s recovering 2024-02-10T08:24:09.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:24:08.745974+0000 mon.a (mon.0) 1052 : audit [INF] from='client.? 172.21.15.18:0/2240473874' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true}]': finished 2024-02-10T08:24:09.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:08.746047+0000 mon.a (mon.0) 1053 : cluster [DBG] osdmap e184: 8 total, 8 up, 8 in 2024-02-10T08:24:09.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:08.684206+0000 mgr.y (mgr.14505) 283 : cluster [DBG] pgmap v328: 158 pgs: 1 active+remapped+backfill_toofull, 1 active+recovering+undersized+remapped, 156 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 0 B/s, 14 objects/s recovering 2024-02-10T08:24:09.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:24:08.745974+0000 mon.a (mon.0) 1052 : audit [INF] from='client.? 172.21.15.18:0/2240473874' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true}]': finished 2024-02-10T08:24:09.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:08.746047+0000 mon.a (mon.0) 1053 : cluster [DBG] osdmap e184: 8 total, 8 up, 8 in 2024-02-10T08:24:10.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:08.684206+0000 mgr.y (mgr.14505) 283 : cluster [DBG] pgmap v328: 158 pgs: 1 active+remapped+backfill_toofull, 1 active+recovering+undersized+remapped, 156 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 0 B/s, 14 objects/s recovering 2024-02-10T08:24:10.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:24:08.745974+0000 mon.a (mon.0) 1052 : audit [INF] from='client.? 172.21.15.18:0/2240473874' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true}]': finished 2024-02-10T08:24:10.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:08.746047+0000 mon.a (mon.0) 1053 : cluster [DBG] osdmap e184: 8 total, 8 up, 8 in 2024-02-10T08:24:10.068 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:24:10.070 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:10.071 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:24:10.172 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:24:10.202 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:11.497 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2024-02-10T08:24:11.498 INFO:tasks.radosbench:Beginning radosbench... 2024-02-10T08:24:11.498 INFO:tasks.cephadm.ceph_manager.ceph:creating pool_name unique_pool_1 2024-02-10T08:24:11.498 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd pool create unique_pool_1 16 2024-02-10T08:24:11.828 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:10.586353+0000 mon.a (mon.0) 1054 : cluster [DBG] osdmap e185: 8 total, 8 up, 8 in 2024-02-10T08:24:11.828 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:10.684534+0000 mgr.y (mgr.14505) 284 : cluster [DBG] pgmap v331: 142 pgs: 142 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 682 B/s rd, 0 op/s 2024-02-10T08:24:11.828 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:10.586353+0000 mon.a (mon.0) 1054 : cluster [DBG] osdmap e185: 8 total, 8 up, 8 in 2024-02-10T08:24:11.828 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:10.684534+0000 mgr.y (mgr.14505) 284 : cluster [DBG] pgmap v331: 142 pgs: 142 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 682 B/s rd, 0 op/s 2024-02-10T08:24:11.829 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:24:11.853 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:24:11.856 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:11.857 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:24:11.959 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:24:11.989 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:10.586353+0000 mon.a (mon.0) 1054 : cluster [DBG] osdmap e185: 8 total, 8 up, 8 in 2024-02-10T08:24:11.989 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:10.684534+0000 mgr.y (mgr.14505) 284 : cluster [DBG] pgmap v331: 142 pgs: 142 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 682 B/s rd, 0 op/s 2024-02-10T08:24:11.991 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:12.012 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:24:12.015 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:12.015 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:24:12.116 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:24:12.145 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:12.183 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:24:12.185 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:12.186 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:24:12.208 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-02-10T08:24:12.208 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:24:12.287 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:24:12.319 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:12.340 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:24:12.342 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:12.343 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:24:12.444 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:24:12.472 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:12.530 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-10T08:24:12.777 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:11.588149+0000 mon.a (mon.0) 1055 : cluster [INF] Health check cleared: PG_BACKFILL_FULL (was: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull) 2024-02-10T08:24:12.778 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:11.588149+0000 mon.a (mon.0) 1055 : cluster [INF] Health check cleared: PG_BACKFILL_FULL (was: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull) 2024-02-10T08:24:13.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:11.588149+0000 mon.a (mon.0) 1055 : cluster [INF] Health check cleared: PG_BACKFILL_FULL (was: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull) 2024-02-10T08:24:13.185 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.2 dump_blocked_ops 2024-02-10T08:24:13.591 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:12.685239+0000 mgr.y (mgr.14505) 285 : cluster [DBG] pgmap v332: 142 pgs: 142 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-02-10T08:24:13.701 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:24:13.702 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:24:13.704 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:13.705 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:24:13.805 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:24:13.837 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:13.858 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:24:13.860 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:12.685239+0000 mgr.y (mgr.14505) 285 : cluster [DBG] pgmap v332: 142 pgs: 142 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-02-10T08:24:13.861 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:13.861 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:24:13.867 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:12.685239+0000 mgr.y (mgr.14505) 285 : cluster [DBG] pgmap v332: 142 pgs: 142 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-02-10T08:24:13.962 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:24:13.992 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:14.116 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:24:14.119 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:14.119 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:24:14.220 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:24:14.249 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:15.099 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:24:15.101 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:15.102 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:24:15.128 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:24:15.203 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:24:15.235 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:15.256 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:24:15.258 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:15.259 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:24:15.360 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:24:15.396 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:15.647 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:24:15.649 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:14.492815+0000 osd.1 (osd.1) 86 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:24:15.649 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:14.492863+0000 osd.1 (osd.1) 87 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:24:15.649 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:14.594457+0000 mon.a (mon.0) 1056 : cluster [DBG] osdmap e186: 8 total, 8 up, 8 in 2024-02-10T08:24:15.650 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:14.685583+0000 mgr.y (mgr.14505) 286 : cluster [DBG] pgmap v334: 142 pgs: 142 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 682 B/s rd, 0 op/s 2024-02-10T08:24:15.650 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:15.587107+0000 mon.a (mon.0) 1057 : cluster [DBG] osdmap e187: 8 total, 8 up, 8 in 2024-02-10T08:24:15.650 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:14.492815+0000 osd.1 (osd.1) 86 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:24:15.650 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:14.492863+0000 osd.1 (osd.1) 87 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:24:15.650 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:14.594457+0000 mon.a (mon.0) 1056 : cluster [DBG] osdmap e186: 8 total, 8 up, 8 in 2024-02-10T08:24:15.650 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:14.685583+0000 mgr.y (mgr.14505) 286 : cluster [DBG] pgmap v334: 142 pgs: 142 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 682 B/s rd, 0 op/s 2024-02-10T08:24:15.650 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:15.587107+0000 mon.a (mon.0) 1057 : cluster [DBG] osdmap e187: 8 total, 8 up, 8 in 2024-02-10T08:24:15.651 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:15.651 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:24:15.752 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:24:15.784 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:15.805 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:24:15.807 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:15.808 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:24:15.890 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:24:15.909 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:24:15.939 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:16.012 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:24:16.014 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:16.015 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:24:16.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:14.492815+0000 osd.1 (osd.1) 86 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:24:16.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:14.492863+0000 osd.1 (osd.1) 87 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:24:16.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:14.594457+0000 mon.a (mon.0) 1056 : cluster [DBG] osdmap e186: 8 total, 8 up, 8 in 2024-02-10T08:24:16.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:14.685583+0000 mgr.y (mgr.14505) 286 : cluster [DBG] pgmap v334: 142 pgs: 142 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 682 B/s rd, 0 op/s 2024-02-10T08:24:16.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:15.587107+0000 mon.a (mon.0) 1057 : cluster [DBG] osdmap e187: 8 total, 8 up, 8 in 2024-02-10T08:24:16.115 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:24:16.144 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:16.268 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:24:16.272 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:16.272 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:24:16.373 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:24:16.401 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:16.606 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:24:16.066624+0000 mon.c (mon.2) 36 : audit [INF] from='client.? 172.21.15.18:0/836595631' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:24:16.607 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:24:16.067094+0000 mon.a (mon.0) 1058 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:24:16.608 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is set 2024-02-10T08:24:16.789 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:24:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:24:16] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:24:16.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:24:16.066624+0000 mon.c (mon.2) 36 : audit [INF] from='client.? 172.21.15.18:0/836595631' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:24:16.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:24:16.067094+0000 mon.a (mon.0) 1058 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:24:16.857 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 5, 6, 7, 4] 2024-02-10T08:24:16.857 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-10T08:24:16.858 INFO:tasks.thrashosds.thrasher:inject_pause on osd.7 2024-02-10T08:24:16.858 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-02-10T08:24:16.858 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-02-10T08:24:16.858 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.7 config set filestore_inject_stall 3 2024-02-10T08:24:16.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:24:16.066624+0000 mon.c (mon.2) 36 : audit [INF] from='client.? 172.21.15.18:0/836595631' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:24:16.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:24:16.067094+0000 mon.a (mon.0) 1058 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:24:17.134 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:24:17.404 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:24:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:24:17] "GET /metrics HTTP/1.1" 200 173398 "" "Prometheus/2.33.4" 2024-02-10T08:24:17.452 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:24:17.456 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:17.456 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:24:17.557 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:24:17.589 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:17.646 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:16.594732+0000 mon.a (mon.0) 1059 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:24:17.647 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:24:16.599123+0000 mon.a (mon.0) 1060 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-10T08:24:17.647 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:16.599196+0000 mon.a (mon.0) 1061 : cluster [DBG] osdmap e188: 8 total, 8 up, 8 in 2024-02-10T08:24:17.647 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:24:16.631615+0000 mon.a (mon.0) 1062 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:24:17.647 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:16.685987+0000 mgr.y (mgr.14505) 287 : cluster [DBG] pgmap v337: 142 pgs: 142 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:24:17.647 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:24:17.170184+0000 mon.a (mon.0) 1063 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 0]}]: dispatch 2024-02-10T08:24:17.647 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:24:17.170407+0000 mon.a (mon.0) 1064 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.15", "id": [0, 6]}]: dispatch 2024-02-10T08:24:17.647 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:24:17.170579+0000 mon.a (mon.0) 1065 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.8", "id": [2, 4]}]: dispatch 2024-02-10T08:24:17.647 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:24:17.170729+0000 mon.a (mon.0) 1066 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.f", "id": [2, 0]}]: dispatch 2024-02-10T08:24:17.647 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:24:17.170877+0000 mon.a (mon.0) 1067 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.23", "id": [6, 0]}]: dispatch 2024-02-10T08:24:17.647 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:24:17.171024+0000 mon.a (mon.0) 1068 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.25", "id": [2, 0]}]: dispatch 2024-02-10T08:24:17.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:16.594732+0000 mon.a (mon.0) 1059 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:24:17.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:24:16.599123+0000 mon.a (mon.0) 1060 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-10T08:24:17.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:16.599196+0000 mon.a (mon.0) 1061 : cluster [DBG] osdmap e188: 8 total, 8 up, 8 in 2024-02-10T08:24:17.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:24:16.631615+0000 mon.a (mon.0) 1062 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:24:17.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:16.685987+0000 mgr.y (mgr.14505) 287 : cluster [DBG] pgmap v337: 142 pgs: 142 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:24:17.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:24:17.170184+0000 mon.a (mon.0) 1063 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 0]}]: dispatch 2024-02-10T08:24:17.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:24:17.170407+0000 mon.a (mon.0) 1064 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.15", "id": [0, 6]}]: dispatch 2024-02-10T08:24:17.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:24:17.170579+0000 mon.a (mon.0) 1065 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.8", "id": [2, 4]}]: dispatch 2024-02-10T08:24:17.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:24:17.170729+0000 mon.a (mon.0) 1066 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.f", "id": [2, 0]}]: dispatch 2024-02-10T08:24:17.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:24:17.170877+0000 mon.a (mon.0) 1067 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.23", "id": [6, 0]}]: dispatch 2024-02-10T08:24:17.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:24:17.171024+0000 mon.a (mon.0) 1068 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.25", "id": [2, 0]}]: dispatch 2024-02-10T08:24:17.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:16.594732+0000 mon.a (mon.0) 1059 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:24:17.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:24:16.599123+0000 mon.a (mon.0) 1060 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-10T08:24:17.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:16.599196+0000 mon.a (mon.0) 1061 : cluster [DBG] osdmap e188: 8 total, 8 up, 8 in 2024-02-10T08:24:17.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:24:16.631615+0000 mon.a (mon.0) 1062 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:24:17.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:16.685987+0000 mgr.y (mgr.14505) 287 : cluster [DBG] pgmap v337: 142 pgs: 142 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:24:17.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:24:17.170184+0000 mon.a (mon.0) 1063 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 0]}]: dispatch 2024-02-10T08:24:17.906 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:24:17.170407+0000 mon.a (mon.0) 1064 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.15", "id": [0, 6]}]: dispatch 2024-02-10T08:24:17.906 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:24:17.170579+0000 mon.a (mon.0) 1065 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.8", "id": [2, 4]}]: dispatch 2024-02-10T08:24:17.906 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:24:17.170729+0000 mon.a (mon.0) 1066 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.f", "id": [2, 0]}]: dispatch 2024-02-10T08:24:17.906 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:24:17.170877+0000 mon.a (mon.0) 1067 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.23", "id": [6, 0]}]: dispatch 2024-02-10T08:24:17.906 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:24:17.171024+0000 mon.a (mon.0) 1068 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.25", "id": [2, 0]}]: dispatch 2024-02-10T08:24:18.033 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:24:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:24:18.348 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:24:18.352 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:18.352 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:24:18.453 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:24:18.486 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:18.721 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:24:17.634863+0000 mon.a (mon.0) 1069 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 0]}]': finished 2024-02-10T08:24:18.721 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:24:17.634932+0000 mon.a (mon.0) 1070 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.15", "id": [0, 6]}]': finished 2024-02-10T08:24:18.721 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:24:17.634991+0000 mon.a (mon.0) 1071 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.8", "id": [2, 4]}]': finished 2024-02-10T08:24:18.721 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:24:17.635056+0000 mon.a (mon.0) 1072 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.f", "id": [2, 0]}]': finished 2024-02-10T08:24:18.721 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:24:17.635115+0000 mon.a (mon.0) 1073 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.23", "id": [6, 0]}]': finished 2024-02-10T08:24:18.721 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:24:17.635171+0000 mon.a (mon.0) 1074 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.25", "id": [2, 0]}]': finished 2024-02-10T08:24:18.721 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:17.635220+0000 mon.a (mon.0) 1075 : cluster [DBG] osdmap e189: 8 total, 8 up, 8 in 2024-02-10T08:24:18.722 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:24:17.892801+0000 mgr.y (mgr.14505) 288 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:24:18.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:24:17.634863+0000 mon.a (mon.0) 1069 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 0]}]': finished 2024-02-10T08:24:18.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:24:17.634932+0000 mon.a (mon.0) 1070 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.15", "id": [0, 6]}]': finished 2024-02-10T08:24:18.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:24:17.634991+0000 mon.a (mon.0) 1071 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.8", "id": [2, 4]}]': finished 2024-02-10T08:24:18.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:24:17.635056+0000 mon.a (mon.0) 1072 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.f", "id": [2, 0]}]': finished 2024-02-10T08:24:18.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:24:17.635115+0000 mon.a (mon.0) 1073 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.23", "id": [6, 0]}]': finished 2024-02-10T08:24:18.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:24:17.635171+0000 mon.a (mon.0) 1074 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.25", "id": [2, 0]}]': finished 2024-02-10T08:24:18.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:17.635220+0000 mon.a (mon.0) 1075 : cluster [DBG] osdmap e189: 8 total, 8 up, 8 in 2024-02-10T08:24:18.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:24:17.892801+0000 mgr.y (mgr.14505) 288 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:24:18.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:24:17.634863+0000 mon.a (mon.0) 1069 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 0]}]': finished 2024-02-10T08:24:18.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:24:17.634932+0000 mon.a (mon.0) 1070 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.15", "id": [0, 6]}]': finished 2024-02-10T08:24:18.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:24:17.634991+0000 mon.a (mon.0) 1071 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.8", "id": [2, 4]}]': finished 2024-02-10T08:24:18.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:24:17.635056+0000 mon.a (mon.0) 1072 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.f", "id": [2, 0]}]': finished 2024-02-10T08:24:18.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:24:17.635115+0000 mon.a (mon.0) 1073 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.23", "id": [6, 0]}]': finished 2024-02-10T08:24:18.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:24:17.635171+0000 mon.a (mon.0) 1074 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.25", "id": [2, 0]}]': finished 2024-02-10T08:24:18.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:17.635220+0000 mon.a (mon.0) 1075 : cluster [DBG] osdmap e189: 8 total, 8 up, 8 in 2024-02-10T08:24:18.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:24:17.892801+0000 mgr.y (mgr.14505) 288 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:24:18.981 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-02-10T08:24:18.981 INFO:teuthology.orchestra.run.smithi071.stdout: "success": "filestore_inject_stall = '3' (not observed, change may require restart) " 2024-02-10T08:24:18.981 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-02-10T08:24:19.638 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:24:19.642 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:19.643 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:24:19.744 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:24:19.777 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:19.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:18.640809+0000 mon.a (mon.0) 1076 : cluster [DBG] osdmap e190: 8 total, 8 up, 8 in 2024-02-10T08:24:19.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:18.686343+0000 mgr.y (mgr.14505) 289 : cluster [DBG] pgmap v340: 142 pgs: 2 peering, 140 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:24:19.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:18.640809+0000 mon.a (mon.0) 1076 : cluster [DBG] osdmap e190: 8 total, 8 up, 8 in 2024-02-10T08:24:19.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:18.686343+0000 mgr.y (mgr.14505) 289 : cluster [DBG] pgmap v340: 142 pgs: 2 peering, 140 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:24:20.032 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd unset noscrub 2024-02-10T08:24:20.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:18.640809+0000 mon.a (mon.0) 1076 : cluster [DBG] osdmap e190: 8 total, 8 up, 8 in 2024-02-10T08:24:20.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:18.686343+0000 mgr.y (mgr.14505) 289 : cluster [DBG] pgmap v340: 142 pgs: 2 peering, 140 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:24:20.238 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:24:20.243 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:20.243 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:24:20.344 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:24:20.356 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-02-10T08:24:20.356 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:24:20.379 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:20.400 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:24:20.402 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:20.403 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:24:20.425 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:24:20.504 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:24:20.533 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:20.597 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'unique_pool_1' created 2024-02-10T08:24:20.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:24:20.082105+0000 mon.a (mon.0) 1077 : audit [INF] from='client.? 172.21.15.18:0/2882095819' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_1", "pg_num": 16}]: dispatch 2024-02-10T08:24:20.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:24:20.590177+0000 mon.a (mon.0) 1078 : audit [INF] from='client.? 172.21.15.18:0/2882095819' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_1", "pg_num": 16}]': finished 2024-02-10T08:24:20.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:20.590266+0000 mon.a (mon.0) 1079 : cluster [DBG] osdmap e191: 8 total, 8 up, 8 in 2024-02-10T08:24:20.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:24:20.082105+0000 mon.a (mon.0) 1077 : audit [INF] from='client.? 172.21.15.18:0/2882095819' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_1", "pg_num": 16}]: dispatch 2024-02-10T08:24:20.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:24:20.590177+0000 mon.a (mon.0) 1078 : audit [INF] from='client.? 172.21.15.18:0/2882095819' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_1", "pg_num": 16}]': finished 2024-02-10T08:24:20.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:20.590266+0000 mon.a (mon.0) 1079 : cluster [DBG] osdmap e191: 8 total, 8 up, 8 in 2024-02-10T08:24:21.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:24:20.082105+0000 mon.a (mon.0) 1077 : audit [INF] from='client.? 172.21.15.18:0/2882095819' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_1", "pg_num": 16}]: dispatch 2024-02-10T08:24:21.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:24:20.590177+0000 mon.a (mon.0) 1078 : audit [INF] from='client.? 172.21.15.18:0/2882095819' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_1", "pg_num": 16}]': finished 2024-02-10T08:24:21.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:20.590266+0000 mon.a (mon.0) 1079 : cluster [DBG] osdmap e191: 8 total, 8 up, 8 in 2024-02-10T08:24:21.193 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:24:21.198 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:21.198 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:24:21.299 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:24:21.333 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:21.354 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:24:21.356 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:21.357 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:24:21.458 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:24:21.487 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:21.508 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:24:21.510 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:21.511 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:24:21.612 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:24:21.640 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:21.661 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:24:21.663 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:21.664 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:24:21.764 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:24:21.795 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:22.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:20.686738+0000 mgr.y (mgr.14505) 290 : cluster [DBG] pgmap v342: 158 pgs: 16 unknown, 2 peering, 140 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 26 B/s, 0 objects/s recovering 2024-02-10T08:24:22.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:21.591389+0000 mon.a (mon.0) 1080 : cluster [DBG] osdmap e192: 8 total, 8 up, 8 in 2024-02-10T08:24:22.082 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:20.686738+0000 mgr.y (mgr.14505) 290 : cluster [DBG] pgmap v342: 158 pgs: 16 unknown, 2 peering, 140 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 26 B/s, 0 objects/s recovering 2024-02-10T08:24:22.082 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:21.591389+0000 mon.a (mon.0) 1080 : cluster [DBG] osdmap e192: 8 total, 8 up, 8 in 2024-02-10T08:24:22.083 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:20.686738+0000 mgr.y (mgr.14505) 290 : cluster [DBG] pgmap v342: 158 pgs: 16 unknown, 2 peering, 140 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 26 B/s, 0 objects/s recovering 2024-02-10T08:24:22.083 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:21.591389+0000 mon.a (mon.0) 1080 : cluster [DBG] osdmap e192: 8 total, 8 up, 8 in 2024-02-10T08:24:22.468 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:24:22.469 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:24:22.469 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:24:22.469 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:24:22.469 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:24:22.469 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:24:22.469 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:24:22.469 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:24:22.470 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-10T08:24:22.470 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-10T08:24:22.470 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-10T08:24:22.470 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-10T08:24:22.470 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-10T08:24:22.470 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-10T08:24:22.470 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-10T08:24:22.471 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-10T08:24:23.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:24:21.705030+0000 mon.a (mon.0) 1081 : audit [DBG] from='client.? 172.21.15.18:0/2683478364' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:24:23.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:22.592618+0000 mon.a (mon.0) 1082 : cluster [DBG] osdmap e193: 8 total, 8 up, 8 in 2024-02-10T08:24:23.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:24:21.705030+0000 mon.a (mon.0) 1081 : audit [DBG] from='client.? 172.21.15.18:0/2683478364' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:24:23.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:22.592618+0000 mon.a (mon.0) 1082 : cluster [DBG] osdmap e193: 8 total, 8 up, 8 in 2024-02-10T08:24:23.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:24:21.705030+0000 mon.a (mon.0) 1081 : audit [DBG] from='client.? 172.21.15.18:0/2683478364' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:24:23.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:22.592618+0000 mon.a (mon.0) 1082 : cluster [DBG] osdmap e193: 8 total, 8 up, 8 in 2024-02-10T08:24:23.254 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd pool application enable unique_pool_1 rados --yes-i-really-mean-it || true 2024-02-10T08:24:23.725 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.2 dump_historic_ops 2024-02-10T08:24:23.747 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:24:23.750 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:23.751 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:24:23.852 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:24:23.881 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:23.953 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:22.687220+0000 mgr.y (mgr.14505) 291 : cluster [DBG] pgmap v345: 158 pgs: 5 unknown, 2 peering, 151 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 27 B/s, 0 objects/s recovering 2024-02-10T08:24:23.953 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:22.687220+0000 mgr.y (mgr.14505) 291 : cluster [DBG] pgmap v345: 158 pgs: 5 unknown, 2 peering, 151 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 27 B/s, 0 objects/s recovering 2024-02-10T08:24:23.954 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:24:23.964 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:23.964 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:24:24.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:22.687220+0000 mgr.y (mgr.14505) 291 : cluster [DBG] pgmap v345: 158 pgs: 5 unknown, 2 peering, 151 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 27 B/s, 0 objects/s recovering 2024-02-10T08:24:24.065 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:24:24.093 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:24.441 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:24:24.445 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:24.445 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:24:24.546 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:24:24.575 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:24.714 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 5, 6, 7, 4] 2024-02-10T08:24:24.714 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-10T08:24:24.878 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:24:24.881 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:24.881 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:24:24.891 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:24:24.903 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:24:24.982 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:24:25.010 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:25.158 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:24:25.160 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:25.161 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:24:25.261 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:24:25.290 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:25.415 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:24:25.421 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:25.422 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:24:25.522 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:24:25.555 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:25.576 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:24:25.579 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:25.580 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:24:25.680 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:24:25.710 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:25.730 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:24:25.732 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:25.733 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:24:25.833 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:24:25.860 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:24.687633+0000 mgr.y (mgr.14505) 292 : cluster [DBG] pgmap v346: 158 pgs: 2 unknown, 156 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 18 B/s, 0 objects/s recovering 2024-02-10T08:24:25.862 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:25.881 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:24:25.884 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:25.885 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:24:25.985 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:24:26.013 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:26.032 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:24:26.034 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:26.035 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:24:26.135 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:24:26.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:24.687633+0000 mgr.y (mgr.14505) 292 : cluster [DBG] pgmap v346: 158 pgs: 2 unknown, 156 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 18 B/s, 0 objects/s recovering 2024-02-10T08:24:26.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:24.687633+0000 mgr.y (mgr.14505) 292 : cluster [DBG] pgmap v346: 158 pgs: 2 unknown, 156 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 18 B/s, 0 objects/s recovering 2024-02-10T08:24:26.163 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:26.182 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:24:26.185 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:26.185 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:24:26.286 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:24:26.312 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:26.331 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:24:26.334 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:26.334 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:24:26.379 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-10T08:24:26.435 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:24:26.469 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:26.725 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:24:26.728 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:26.728 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:24:26.789 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:24:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:24:26] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:24:26.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:24:26.152998+0000 mon.a (mon.0) 1083 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:24:26.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:24:26.500672+0000 mon.a (mon.0) 1084 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:24:26.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:24:26.501680+0000 mon.a (mon.0) 1085 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:24:26.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:24:26.508721+0000 mon.a (mon.0) 1086 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:24:26.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:24:26.512128+0000 mon.a (mon.0) 1087 : audit [INF] from='client.? 172.21.15.18:0/4091186002' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:24:26.829 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:24:26.857 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:26.876 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:24:26.878 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:26.879 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:24:26.979 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:24:27.006 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:27.025 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:24:27.027 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:27.028 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:24:27.076 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:24:26.152998+0000 mon.a (mon.0) 1083 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:24:27.076 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:24:26.500672+0000 mon.a (mon.0) 1084 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:24:27.076 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:24:26.501680+0000 mon.a (mon.0) 1085 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:24:27.076 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:24:26.508721+0000 mon.a (mon.0) 1086 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:24:27.077 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:24:26.512128+0000 mon.a (mon.0) 1087 : audit [INF] from='client.? 172.21.15.18:0/4091186002' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:24:27.077 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:24:26.152998+0000 mon.a (mon.0) 1083 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:24:27.077 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:24:26.500672+0000 mon.a (mon.0) 1084 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:24:27.077 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:24:26.501680+0000 mon.a (mon.0) 1085 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:24:27.077 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:24:26.508721+0000 mon.a (mon.0) 1086 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:24:27.077 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:24:26.512128+0000 mon.a (mon.0) 1087 : audit [INF] from='client.? 172.21.15.18:0/4091186002' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:24:27.128 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:24:27.155 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:27.173 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:24:27.175 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:27.176 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:24:27.276 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:24:27.307 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:27.404 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:24:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:24:27] "GET /metrics HTTP/1.1" 200 173398 "" "Prometheus/2.33.4" 2024-02-10T08:24:27.519 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is unset 2024-02-10T08:24:27.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:26.688053+0000 mgr.y (mgr.14505) 293 : cluster [DBG] pgmap v347: 158 pgs: 158 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 839 B/s rd, 0 op/s; 0 B/s, 0 objects/s recovering 2024-02-10T08:24:27.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:27.507502+0000 mon.a (mon.0) 1088 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:24:27.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:24:27.513905+0000 mon.a (mon.0) 1089 : audit [INF] from='client.? 172.21.15.18:0/4091186002' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-10T08:24:27.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:27.513976+0000 mon.a (mon.0) 1090 : cluster [DBG] osdmap e194: 8 total, 8 up, 8 in 2024-02-10T08:24:27.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:26.688053+0000 mgr.y (mgr.14505) 293 : cluster [DBG] pgmap v347: 158 pgs: 158 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 839 B/s rd, 0 op/s; 0 B/s, 0 objects/s recovering 2024-02-10T08:24:27.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:27.507502+0000 mon.a (mon.0) 1088 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:24:27.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:24:27.513905+0000 mon.a (mon.0) 1089 : audit [INF] from='client.? 172.21.15.18:0/4091186002' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-10T08:24:27.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:27.513976+0000 mon.a (mon.0) 1090 : cluster [DBG] osdmap e194: 8 total, 8 up, 8 in 2024-02-10T08:24:28.039 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:24:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:24:28.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:26.688053+0000 mgr.y (mgr.14505) 293 : cluster [DBG] pgmap v347: 158 pgs: 158 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 839 B/s rd, 0 op/s; 0 B/s, 0 objects/s recovering 2024-02-10T08:24:28.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:27.507502+0000 mon.a (mon.0) 1088 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:24:28.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:24:27.513905+0000 mon.a (mon.0) 1089 : audit [INF] from='client.? 172.21.15.18:0/4091186002' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-10T08:24:28.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:27.513976+0000 mon.a (mon.0) 1090 : cluster [DBG] osdmap e194: 8 total, 8 up, 8 in 2024-02-10T08:24:28.743 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-02-10T08:24:28.744 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-02-10T08:24:28.744 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-02-10T08:24:28.744 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-02-10T08:24:28.744 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.744 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:157099 7.3 7:cd526bdb:::benchmark_data_smithi018_80623_object56171:head [delete] snapc 0=[] ondisk+write+known_if_redirected e151)", 2024-02-10T08:24:28.744 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:22:42.923620+0000", 2024-02-10T08:24:28.744 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 105.708761364, 2024-02-10T08:24:28.744 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0924102659999999, 2024-02-10T08:24:28.744 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:24:28.744 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:24:28.744 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:24:28.744 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:24:28.745 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:24:28.745 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 157099 2024-02-10T08:24:28.745 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.745 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:24:28.745 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.745 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:24:28.745 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:42.923620+0000", 2024-02-10T08:24:28.745 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:24:28.745 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.745 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.745 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:24:28.745 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:42.923620+0000", 2024-02-10T08:24:28.745 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:24:28.745 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.745 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.746 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:24:28.746 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:42.923619+0000", 2024-02-10T08:24:28.746 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.874e-06 2024-02-10T08:24:28.746 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.746 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.746 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:24:28.746 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:42.923624+0000", 2024-02-10T08:24:28.746 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4190000000000002e-06 2024-02-10T08:24:28.746 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.746 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.746 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:24:28.746 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:42.923633+0000", 2024-02-10T08:24:28.746 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0599999999999998e-06 2024-02-10T08:24:28.746 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.747 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.747 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:24:28.747 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:42.923638+0000", 2024-02-10T08:24:28.747 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.004065155 2024-02-10T08:24:28.747 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.747 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.747 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:24:28.747 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:42.927703+0000", 2024-02-10T08:24:28.747 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1509999999999993e-06 2024-02-10T08:24:28.747 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.747 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.747 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:24:28.747 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:42.927712+0000", 2024-02-10T08:24:28.747 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.072839882 2024-02-10T08:24:28.748 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.748 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.748 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:24:28.748 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.000552+0000", 2024-02-10T08:24:28.748 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011776400000000001 2024-02-10T08:24:28.748 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.748 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.748 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:24:28.748 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.000670+0000", 2024-02-10T08:24:28.748 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4479000000000002e-05 2024-02-10T08:24:28.748 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.748 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.748 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,4", 2024-02-10T08:24:28.748 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.000754+0000", 2024-02-10T08:24:28.749 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0061497440000000004 2024-02-10T08:24:28.749 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.749 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.749 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:24:28.749 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.006904+0000", 2024-02-10T08:24:28.749 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8655999999999997e-05 2024-02-10T08:24:28.749 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.749 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.749 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:24:28.749 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.006943+0000", 2024-02-10T08:24:28.749 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0090054490000000004 2024-02-10T08:24:28.749 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.749 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.750 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:24:28.750 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.015948+0000", 2024-02-10T08:24:28.750 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0065000000000003e-05 2024-02-10T08:24:28.750 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.750 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.750 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:24:28.750 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.015998+0000", 2024-02-10T08:24:28.750 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1606000000000002e-05 2024-02-10T08:24:28.750 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.750 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.750 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:24:28.750 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.016030+0000", 2024-02-10T08:24:28.750 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0924102659999999 2024-02-10T08:24:28.750 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:28.750 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:24:28.751 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:28.751 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.751 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.751 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:157103 7.3 7:c8dea79b:::benchmark_data_smithi018_80623_object56175:head [delete] snapc 0=[] ondisk+write+known_if_redirected e151)", 2024-02-10T08:24:28.751 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:22:42.927761+0000", 2024-02-10T08:24:28.751 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 105.704619912, 2024-02-10T08:24:28.751 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0884696, 2024-02-10T08:24:28.751 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:24:28.751 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:24:28.751 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:24:28.751 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:24:28.752 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:24:28.752 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 157103 2024-02-10T08:24:28.752 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.752 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:24:28.752 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.752 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:24:28.752 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:42.927761+0000", 2024-02-10T08:24:28.752 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:24:28.752 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.752 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.752 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:24:28.752 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:42.927761+0000", 2024-02-10T08:24:28.753 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:24:28.753 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.753 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.753 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:24:28.753 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:42.927760+0000", 2024-02-10T08:24:28.753 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7260000000000002e-06 2024-02-10T08:24:28.753 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.753 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.753 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:24:28.753 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:42.927767+0000", 2024-02-10T08:24:28.753 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5466000000000001e-05 2024-02-10T08:24:28.753 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.753 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.753 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:24:28.754 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:42.927783+0000", 2024-02-10T08:24:28.754 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4690000000000002e-06 2024-02-10T08:24:28.754 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.754 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.754 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:24:28.754 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:42.927789+0000", 2024-02-10T08:24:28.754 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6159000000000003e-05 2024-02-10T08:24:28.754 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.754 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.754 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:24:28.754 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:42.927836+0000", 2024-02-10T08:24:28.754 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9410000000000002e-06 2024-02-10T08:24:28.754 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.754 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.754 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:24:28.755 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:42.927845+0000", 2024-02-10T08:24:28.755 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.07553985 2024-02-10T08:24:28.755 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.755 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.755 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:24:28.755 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.003385+0000", 2024-02-10T08:24:28.755 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5144999999999998e-05 2024-02-10T08:24:28.755 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.755 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.755 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:24:28.755 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.003480+0000", 2024-02-10T08:24:28.755 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6260000000000005e-05 2024-02-10T08:24:28.755 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.755 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.756 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,4", 2024-02-10T08:24:28.756 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.003557+0000", 2024-02-10T08:24:28.756 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.003415979 2024-02-10T08:24:28.756 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.756 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.756 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:24:28.756 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.006973+0000", 2024-02-10T08:24:28.756 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2410000000000002e-05 2024-02-10T08:24:28.756 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.756 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.756 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:24:28.756 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.007015+0000", 2024-02-10T08:24:28.756 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0091309560000000008 2024-02-10T08:24:28.756 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.756 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.757 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:24:28.757 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.016146+0000", 2024-02-10T08:24:28.757 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3359999999999998e-05 2024-02-10T08:24:28.757 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.757 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.757 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:24:28.757 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.016189+0000", 2024-02-10T08:24:28.757 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1214999999999998e-05 2024-02-10T08:24:28.757 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.757 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.757 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:24:28.757 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.016231+0000", 2024-02-10T08:24:28.757 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0884696 2024-02-10T08:24:28.758 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:28.758 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:24:28.758 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:28.758 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.758 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.758 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:157142 7.3 7:c44444c5:::benchmark_data_smithi018_80623_object56214:head [delete] snapc 0=[] ondisk+write+known_if_redirected e151)", 2024-02-10T08:24:28.758 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:22:42.972596+0000", 2024-02-10T08:24:28.758 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 105.65978517000001, 2024-02-10T08:24:28.758 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0437792480000001, 2024-02-10T08:24:28.758 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:24:28.758 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:24:28.758 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:24:28.758 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:24:28.758 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:24:28.759 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 157142 2024-02-10T08:24:28.759 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.759 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:24:28.759 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.759 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:24:28.759 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:42.972596+0000", 2024-02-10T08:24:28.759 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:24:28.759 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.759 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.759 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:24:28.759 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:42.972596+0000", 2024-02-10T08:24:28.760 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:24:28.760 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.760 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.760 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:24:28.760 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:42.972595+0000", 2024-02-10T08:24:28.760 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4429999999999996e-06 2024-02-10T08:24:28.760 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.760 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.760 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:24:28.760 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:42.972599+0000", 2024-02-10T08:24:28.760 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7589999999999997e-06 2024-02-10T08:24:28.760 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.760 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.760 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:24:28.761 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:42.972607+0000", 2024-02-10T08:24:28.761 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1659999999999996e-06 2024-02-10T08:24:28.761 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.761 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.761 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:24:28.761 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:42.972611+0000", 2024-02-10T08:24:28.761 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7869999999999998e-05 2024-02-10T08:24:28.761 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.761 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.761 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:24:28.761 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:42.972689+0000", 2024-02-10T08:24:28.761 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7290000000000006e-06 2024-02-10T08:24:28.761 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.761 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.761 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:24:28.762 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:42.972698+0000", 2024-02-10T08:24:28.762 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0327068230000001 2024-02-10T08:24:28.762 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.762 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.762 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:24:28.762 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.005404+0000", 2024-02-10T08:24:28.762 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1199999999999997e-05 2024-02-10T08:24:28.762 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.762 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.762 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:24:28.762 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.005466+0000", 2024-02-10T08:24:28.762 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6575000000000004e-05 2024-02-10T08:24:28.762 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.762 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.762 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,4", 2024-02-10T08:24:28.763 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.005552+0000", 2024-02-10T08:24:28.763 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0040631 2024-02-10T08:24:28.763 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.763 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.763 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:24:28.763 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.009615+0000", 2024-02-10T08:24:28.763 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8640000000000003e-05 2024-02-10T08:24:28.763 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.763 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.763 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:24:28.763 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.009654+0000", 2024-02-10T08:24:28.763 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0066338339999999999 2024-02-10T08:24:28.763 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.763 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.763 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:24:28.764 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.016288+0000", 2024-02-10T08:24:28.764 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2299000000000003e-05 2024-02-10T08:24:28.764 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.764 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.764 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:24:28.764 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.016330+0000", 2024-02-10T08:24:28.764 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5065000000000003e-05 2024-02-10T08:24:28.764 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.764 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.764 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:24:28.764 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.016375+0000", 2024-02-10T08:24:28.764 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0437792480000001 2024-02-10T08:24:28.764 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:28.764 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:24:28.765 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:28.765 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.765 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.765 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:157151 7.3 7:cee2eb08:::benchmark_data_smithi018_80623_object56223:head [delete] snapc 0=[] ondisk+write+known_if_redirected e151)", 2024-02-10T08:24:28.765 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:22:42.988420+0000", 2024-02-10T08:24:28.765 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 105.643960816, 2024-02-10T08:24:28.765 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0280947949999999, 2024-02-10T08:24:28.765 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:24:28.765 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:24:28.765 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:24:28.765 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:24:28.765 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:24:28.765 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 157151 2024-02-10T08:24:28.765 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.766 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:24:28.766 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.766 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:24:28.766 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:42.988420+0000", 2024-02-10T08:24:28.766 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:24:28.766 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.766 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.766 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:24:28.766 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:42.988420+0000", 2024-02-10T08:24:28.766 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999981 2024-02-10T08:24:28.766 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.766 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.766 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:24:28.766 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:42.988418+0000", 2024-02-10T08:24:28.766 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0299999999999999e-06 2024-02-10T08:24:28.766 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.767 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.767 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:24:28.767 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:42.988427+0000", 2024-02-10T08:24:28.767 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2763e-05 2024-02-10T08:24:28.767 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.767 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.767 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:24:28.767 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:42.988440+0000", 2024-02-10T08:24:28.767 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1559999999999998e-06 2024-02-10T08:24:28.767 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.767 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.767 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:24:28.767 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:42.988447+0000", 2024-02-10T08:24:28.767 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010882000000000001 2024-02-10T08:24:28.767 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.768 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.768 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:24:28.768 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:42.988556+0000", 2024-02-10T08:24:28.768 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0960000000000007e-06 2024-02-10T08:24:28.768 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.768 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.768 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:24:28.768 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:42.988565+0000", 2024-02-10T08:24:28.768 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.018487914 2024-02-10T08:24:28.768 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.768 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.768 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:24:28.768 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.007053+0000", 2024-02-10T08:24:28.768 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9953e-05 2024-02-10T08:24:28.769 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.769 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.769 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:24:28.769 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.007113+0000", 2024-02-10T08:24:28.769 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4193e-05 2024-02-10T08:24:28.769 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.769 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.769 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,4", 2024-02-10T08:24:28.769 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.007177+0000", 2024-02-10T08:24:28.769 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002484904 2024-02-10T08:24:28.769 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.769 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.769 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:24:28.769 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.009662+0000", 2024-02-10T08:24:28.769 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5729000000000002e-05 2024-02-10T08:24:28.770 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.770 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.770 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:24:28.770 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.009708+0000", 2024-02-10T08:24:28.770 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0067299179999999997 2024-02-10T08:24:28.770 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.770 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.770 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:24:28.770 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.016438+0000", 2024-02-10T08:24:28.770 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3043000000000001e-05 2024-02-10T08:24:28.770 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.770 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.770 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:24:28.770 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.016481+0000", 2024-02-10T08:24:28.770 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4218999999999999e-05 2024-02-10T08:24:28.771 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.771 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.771 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:24:28.771 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.016515+0000", 2024-02-10T08:24:28.771 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0280947949999999 2024-02-10T08:24:28.771 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:28.771 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:24:28.771 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:28.771 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.771 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.771 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:157165 7.3 7:c0c1600c:::benchmark_data_smithi018_80623_object56237:head [delete] snapc 0=[] ondisk+write+known_if_redirected e151)", 2024-02-10T08:24:28.771 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:22:42.997224+0000", 2024-02-10T08:24:28.771 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 105.635157033, 2024-02-10T08:24:28.771 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0194350720000001, 2024-02-10T08:24:28.772 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:24:28.772 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:24:28.772 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:24:28.772 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:24:28.772 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:24:28.772 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 157165 2024-02-10T08:24:28.772 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.772 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:24:28.772 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.772 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:24:28.772 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:42.997224+0000", 2024-02-10T08:24:28.772 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:24:28.772 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.772 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.773 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:24:28.773 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:42.997224+0000", 2024-02-10T08:24:28.773 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:24:28.773 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.773 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.773 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:24:28.773 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:42.997223+0000", 2024-02-10T08:24:28.773 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7780000000000004e-06 2024-02-10T08:24:28.773 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.773 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.773 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:24:28.773 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:42.997228+0000", 2024-02-10T08:24:28.773 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6690000000000006e-06 2024-02-10T08:24:28.773 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.773 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.774 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:24:28.774 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:42.997236+0000", 2024-02-10T08:24:28.774 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9200000000000003e-06 2024-02-10T08:24:28.774 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.774 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.774 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:24:28.774 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:42.997241+0000", 2024-02-10T08:24:28.774 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9993000000000001e-05 2024-02-10T08:24:28.774 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.774 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.774 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:24:28.774 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:42.997281+0000", 2024-02-10T08:24:28.774 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5579999999999997e-06 2024-02-10T08:24:28.774 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.774 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.775 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:24:28.775 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:42.997288+0000", 2024-02-10T08:24:28.775 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0110483480000001 2024-02-10T08:24:28.775 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.775 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.775 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:24:28.775 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.008336+0000", 2024-02-10T08:24:28.775 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2686000000000001e-05 2024-02-10T08:24:28.775 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.775 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.775 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:24:28.775 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.008419+0000", 2024-02-10T08:24:28.775 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2162999999999994e-05 2024-02-10T08:24:28.775 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.775 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.776 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,4", 2024-02-10T08:24:28.776 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.008481+0000", 2024-02-10T08:24:28.776 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0045856969999999997 2024-02-10T08:24:28.776 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.776 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.776 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:24:28.776 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.013066+0000", 2024-02-10T08:24:28.776 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4399999999999994e-06 2024-02-10T08:24:28.776 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.776 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.776 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:24:28.776 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.013076+0000", 2024-02-10T08:24:28.776 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0034993849999999998 2024-02-10T08:24:28.776 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.776 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.777 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:24:28.777 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.016575+0000", 2024-02-10T08:24:28.777 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4719999999999999e-05 2024-02-10T08:24:28.777 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.777 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.777 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:24:28.777 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.016620+0000", 2024-02-10T08:24:28.777 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9001000000000001e-05 2024-02-10T08:24:28.777 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.777 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.777 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:24:28.777 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.016659+0000", 2024-02-10T08:24:28.777 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0194350720000001 2024-02-10T08:24:28.777 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:28.777 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:24:28.778 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:28.778 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.778 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.778 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:157170 7.3 7:cdd7d9b5:::benchmark_data_smithi018_80623_object56242:head [delete] snapc 0=[] ondisk+write+known_if_redirected e151)", 2024-02-10T08:24:28.778 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:22:43.000587+0000", 2024-02-10T08:24:28.778 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 105.63179406, 2024-02-10T08:24:28.778 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.016241425, 2024-02-10T08:24:28.778 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:24:28.778 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:24:28.778 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:24:28.778 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:24:28.778 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:24:28.778 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 157170 2024-02-10T08:24:28.778 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.779 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:24:28.779 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.779 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:24:28.779 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.000587+0000", 2024-02-10T08:24:28.779 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:24:28.779 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.779 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.779 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:24:28.779 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.000587+0000", 2024-02-10T08:24:28.779 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:24:28.779 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.779 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.779 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:24:28.779 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.000586+0000", 2024-02-10T08:24:28.780 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1179999999999997e-06 2024-02-10T08:24:28.780 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.780 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.780 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:24:28.780 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.000592+0000", 2024-02-10T08:24:28.780 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5119999999999997e-06 2024-02-10T08:24:28.780 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.780 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.780 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:24:28.780 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.000601+0000", 2024-02-10T08:24:28.780 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8019999999999997e-06 2024-02-10T08:24:28.780 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.780 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.780 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:24:28.781 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.000607+0000", 2024-02-10T08:24:28.781 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2259999999999999e-05 2024-02-10T08:24:28.781 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.781 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.781 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:24:28.781 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.000649+0000", 2024-02-10T08:24:28.781 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2580000000000001e-06 2024-02-10T08:24:28.781 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.781 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.781 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:24:28.781 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.000656+0000", 2024-02-10T08:24:28.781 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.009083113 2024-02-10T08:24:28.781 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.781 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.782 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:24:28.782 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.009739+0000", 2024-02-10T08:24:28.782 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0674999999999998e-05 2024-02-10T08:24:28.782 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.782 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.782 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:24:28.782 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.009799+0000", 2024-02-10T08:24:28.782 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2755999999999993e-05 2024-02-10T08:24:28.782 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.782 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.782 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,4", 2024-02-10T08:24:28.782 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.009862+0000", 2024-02-10T08:24:28.782 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.003236704 2024-02-10T08:24:28.782 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.782 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.783 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:24:28.783 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.013099+0000", 2024-02-10T08:24:28.783 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001486986 2024-02-10T08:24:28.783 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.783 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.783 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:24:28.783 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.014586+0000", 2024-02-10T08:24:28.783 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0021708930000000001 2024-02-10T08:24:28.783 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.783 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.783 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:24:28.783 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.016757+0000", 2024-02-10T08:24:28.783 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7506999999999999e-05 2024-02-10T08:24:28.783 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.783 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.784 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:24:28.784 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.016794+0000", 2024-02-10T08:24:28.784 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4118000000000001e-05 2024-02-10T08:24:28.784 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.784 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.784 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:24:28.784 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.016828+0000", 2024-02-10T08:24:28.784 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.016241425 2024-02-10T08:24:28.784 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:28.784 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:24:28.784 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:28.784 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.784 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.784 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:157197 7.3 7:c4729bc2:::benchmark_data_smithi018_80623_object56269:head [delete] snapc 0=[] ondisk+write+known_if_redirected e151)", 2024-02-10T08:24:28.785 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:22:43.040572+0000", 2024-02-10T08:24:28.785 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 105.59180900600001, 2024-02-10T08:24:28.785 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.97637103999999997, 2024-02-10T08:24:28.785 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:24:28.785 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:24:28.785 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:24:28.785 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:24:28.785 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:24:28.785 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 157197 2024-02-10T08:24:28.785 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.785 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:24:28.785 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.785 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:24:28.785 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.040572+0000", 2024-02-10T08:24:28.785 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:24:28.786 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.786 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.786 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:24:28.786 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.040572+0000", 2024-02-10T08:24:28.786 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:24:28.786 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.786 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.786 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:24:28.786 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.040571+0000", 2024-02-10T08:24:28.786 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.613e-06 2024-02-10T08:24:28.786 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.786 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.786 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:24:28.786 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.040577+0000", 2024-02-10T08:24:28.786 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1826e-05 2024-02-10T08:24:28.787 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.787 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.787 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:24:28.787 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.040589+0000", 2024-02-10T08:24:28.787 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2960000000000004e-06 2024-02-10T08:24:28.787 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.787 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.787 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:24:28.787 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.040596+0000", 2024-02-10T08:24:28.787 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9116000000000001e-05 2024-02-10T08:24:28.787 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.787 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.787 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:24:28.787 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.040655+0000", 2024-02-10T08:24:28.788 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9910000000000002e-06 2024-02-10T08:24:28.788 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.788 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.788 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:24:28.788 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.040663+0000", 2024-02-10T08:24:28.788 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.97090337199999999 2024-02-10T08:24:28.788 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.788 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.788 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:24:28.788 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.011566+0000", 2024-02-10T08:24:28.788 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2589000000000005e-05 2024-02-10T08:24:28.788 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.788 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.788 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:24:28.789 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.011649+0000", 2024-02-10T08:24:28.789 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8821999999999999e-05 2024-02-10T08:24:28.789 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.789 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.789 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,4", 2024-02-10T08:24:28.789 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.011717+0000", 2024-02-10T08:24:28.789 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0041765750000000001 2024-02-10T08:24:28.789 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.789 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.789 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:24:28.789 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.015894+0000", 2024-02-10T08:24:28.789 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016212 2024-02-10T08:24:28.789 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.789 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.789 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:24:28.790 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.016056+0000", 2024-02-10T08:24:28.790 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00081899299999999996 2024-02-10T08:24:28.790 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.790 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.790 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:24:28.790 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.016875+0000", 2024-02-10T08:24:28.790 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4431999999999998e-05 2024-02-10T08:24:28.790 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.790 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.790 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:24:28.790 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.016910+0000", 2024-02-10T08:24:28.790 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3476000000000003e-05 2024-02-10T08:24:28.790 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.790 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.790 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:24:28.790 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.016943+0000", 2024-02-10T08:24:28.791 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.97637103999999997 2024-02-10T08:24:28.791 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:28.791 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:24:28.791 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:28.791 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.791 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.791 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:157249 7.3 7:c8ab35ca:::benchmark_data_smithi018_80623_object56321:head [delete] snapc 0=[] ondisk+write+known_if_redirected e151)", 2024-02-10T08:24:28.791 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:22:43.109281+0000", 2024-02-10T08:24:28.791 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 105.523100395, 2024-02-10T08:24:28.791 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.91941263399999995, 2024-02-10T08:24:28.791 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:24:28.791 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:24:28.791 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:24:28.791 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:24:28.792 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:24:28.792 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 157249 2024-02-10T08:24:28.792 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.792 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:24:28.792 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.792 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:24:28.792 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.109281+0000", 2024-02-10T08:24:28.792 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:24:28.792 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.792 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.792 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:24:28.792 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.109281+0000", 2024-02-10T08:24:28.792 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:24:28.792 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.793 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.793 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:24:28.793 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.109279+0000", 2024-02-10T08:24:28.793 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0160000000000003e-06 2024-02-10T08:24:28.793 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.793 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.793 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:24:28.793 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.109286+0000", 2024-02-10T08:24:28.793 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1148000000000001e-05 2024-02-10T08:24:28.793 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.793 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.793 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:24:28.793 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.109297+0000", 2024-02-10T08:24:28.793 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.156e-06 2024-02-10T08:24:28.793 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.794 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.794 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:24:28.794 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.109303+0000", 2024-02-10T08:24:28.794 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1968e-05 2024-02-10T08:24:28.794 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.794 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.794 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:24:28.794 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.109365+0000", 2024-02-10T08:24:28.794 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2339999999999997e-06 2024-02-10T08:24:28.794 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.794 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.794 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:24:28.794 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.109373+0000", 2024-02-10T08:24:28.794 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.90375726599999995 2024-02-10T08:24:28.794 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.795 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.795 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:24:28.795 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.013130+0000", 2024-02-10T08:24:28.795 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9067999999999995e-05 2024-02-10T08:24:28.795 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.795 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.795 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:24:28.795 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.013219+0000", 2024-02-10T08:24:28.795 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6460999999999999e-05 2024-02-10T08:24:28.795 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.795 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.795 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,4", 2024-02-10T08:24:28.795 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.013285+0000", 2024-02-10T08:24:28.795 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0028228179999999999 2024-02-10T08:24:28.795 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.796 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.796 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:24:28.796 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.016108+0000", 2024-02-10T08:24:28.796 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00028006 2024-02-10T08:24:28.796 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.796 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.796 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:24:28.796 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.016388+0000", 2024-02-10T08:24:28.796 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.01222526 2024-02-10T08:24:28.796 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.796 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.796 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:24:28.796 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.028613+0000", 2024-02-10T08:24:28.796 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2979000000000003e-05 2024-02-10T08:24:28.797 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.797 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.797 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:24:28.797 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.028656+0000", 2024-02-10T08:24:28.797 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6730999999999998e-05 2024-02-10T08:24:28.797 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.797 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.797 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:24:28.797 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.028693+0000", 2024-02-10T08:24:28.797 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.91941263399999995 2024-02-10T08:24:28.797 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:28.797 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:24:28.797 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:28.797 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.798 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.798 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:157295 7.3 7:c2780e2e:::benchmark_data_smithi018_80623_object56367:head [delete] snapc 0=[] ondisk+write+known_if_redirected e151)", 2024-02-10T08:24:28.798 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:22:43.166398+0000", 2024-02-10T08:24:28.798 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 105.46598268, 2024-02-10T08:24:28.798 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.86242126600000002, 2024-02-10T08:24:28.798 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:24:28.798 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:24:28.798 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:24:28.798 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:24:28.798 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:24:28.798 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 157295 2024-02-10T08:24:28.798 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.798 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:24:28.798 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.799 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:24:28.799 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.166398+0000", 2024-02-10T08:24:28.799 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:24:28.799 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.799 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.799 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:24:28.799 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.166398+0000", 2024-02-10T08:24:28.799 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:24:28.799 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.799 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.799 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:24:28.799 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.166398+0000", 2024-02-10T08:24:28.799 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.794e-06 2024-02-10T08:24:28.799 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.799 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.800 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:24:28.800 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.166401+0000", 2024-02-10T08:24:28.800 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.259e-06 2024-02-10T08:24:28.800 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.800 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.800 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:24:28.800 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.166407+0000", 2024-02-10T08:24:28.800 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0800000000000002e-06 2024-02-10T08:24:28.800 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.800 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.800 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:24:28.800 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.166410+0000", 2024-02-10T08:24:28.800 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3977000000000002e-05 2024-02-10T08:24:28.800 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.801 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.801 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:24:28.801 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.166464+0000", 2024-02-10T08:24:28.801 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8069999999999994e-06 2024-02-10T08:24:28.801 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.801 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.801 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:24:28.801 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.166474+0000", 2024-02-10T08:24:28.801 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.84814851099999999 2024-02-10T08:24:28.801 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.801 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.801 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:24:28.801 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.014622+0000", 2024-02-10T08:24:28.801 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2628999999999998e-05 2024-02-10T08:24:28.802 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.802 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.802 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:24:28.802 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.014705+0000", 2024-02-10T08:24:28.802 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3663000000000004e-05 2024-02-10T08:24:28.802 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.802 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.802 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,4", 2024-02-10T08:24:28.802 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.014768+0000", 2024-02-10T08:24:28.802 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0016297289999999999 2024-02-10T08:24:28.802 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.802 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.802 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:24:28.802 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.016398+0000", 2024-02-10T08:24:28.802 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00031701899999999998 2024-02-10T08:24:28.803 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.803 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.803 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:24:28.803 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.016715+0000", 2024-02-10T08:24:28.803 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.012039431999999999 2024-02-10T08:24:28.803 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.803 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.803 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:24:28.803 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.028755+0000", 2024-02-10T08:24:28.803 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3828999999999997e-05 2024-02-10T08:24:28.803 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.804 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.804 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:24:28.804 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.028788+0000", 2024-02-10T08:24:28.804 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1217999999999998e-05 2024-02-10T08:24:28.804 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.804 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.804 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:24:28.804 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.028820+0000", 2024-02-10T08:24:28.804 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.86242126600000002 2024-02-10T08:24:28.804 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:28.804 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:24:28.804 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:28.804 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.805 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.805 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:157337 7.3 7:cc70225f:::benchmark_data_smithi018_80623_object56409:head [delete] snapc 0=[] ondisk+write+known_if_redirected e151)", 2024-02-10T08:24:28.805 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:22:43.223749+0000", 2024-02-10T08:24:28.805 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 105.408631818, 2024-02-10T08:24:28.805 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.81578523599999997, 2024-02-10T08:24:28.805 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:24:28.805 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:24:28.805 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:24:28.805 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:24:28.805 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:24:28.805 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 157337 2024-02-10T08:24:28.805 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.805 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:24:28.805 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.805 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:24:28.806 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.223749+0000", 2024-02-10T08:24:28.806 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:24:28.806 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.806 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.806 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:24:28.806 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.223749+0000", 2024-02-10T08:24:28.806 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:24:28.806 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.806 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.806 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:24:28.806 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.223748+0000", 2024-02-10T08:24:28.806 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7050000000000002e-06 2024-02-10T08:24:28.806 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.806 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.806 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:24:28.807 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.223754+0000", 2024-02-10T08:24:28.807 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0438000000000001e-05 2024-02-10T08:24:28.807 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.807 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.807 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:24:28.807 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.223765+0000", 2024-02-10T08:24:28.807 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2380000000000002e-06 2024-02-10T08:24:28.807 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.807 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.807 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:24:28.807 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.223771+0000", 2024-02-10T08:24:28.807 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2930000000000003e-05 2024-02-10T08:24:28.807 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.807 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.807 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:24:28.808 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.223824+0000", 2024-02-10T08:24:28.808 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2809999999999997e-06 2024-02-10T08:24:28.808 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.808 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.808 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:24:28.808 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.223833+0000", 2024-02-10T08:24:28.808 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.79314152800000004 2024-02-10T08:24:28.808 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.808 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.808 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:24:28.808 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.016975+0000", 2024-02-10T08:24:28.808 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9807000000000002e-05 2024-02-10T08:24:28.808 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.808 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.809 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:24:28.809 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.017075+0000", 2024-02-10T08:24:28.809 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000105145 2024-02-10T08:24:28.809 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.809 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.809 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,4", 2024-02-10T08:24:28.809 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.017180+0000", 2024-02-10T08:24:28.809 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011367825 2024-02-10T08:24:28.809 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.809 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.809 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:24:28.809 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.028548+0000", 2024-02-10T08:24:28.809 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00030412899999999999 2024-02-10T08:24:28.809 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.810 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.810 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:24:28.810 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.028852+0000", 2024-02-10T08:24:28.810 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.010594226999999999 2024-02-10T08:24:28.810 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.810 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.810 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:24:28.810 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.039446+0000", 2024-02-10T08:24:28.810 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7737000000000001e-05 2024-02-10T08:24:28.810 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.810 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.810 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:24:28.810 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.039494+0000", 2024-02-10T08:24:28.810 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0630999999999998e-05 2024-02-10T08:24:28.811 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.811 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.811 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:24:28.811 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.039534+0000", 2024-02-10T08:24:28.811 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.81578523599999997 2024-02-10T08:24:28.811 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:28.811 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:24:28.811 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:28.811 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.811 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.811 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:157343 7.3 7:c98d99ee:::benchmark_data_smithi018_80623_object56415:head [delete] snapc 0=[] ondisk+write+known_if_redirected e151)", 2024-02-10T08:24:28.811 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:22:43.234682+0000", 2024-02-10T08:24:28.811 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 105.397699186, 2024-02-10T08:24:28.811 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.80492876000000002, 2024-02-10T08:24:28.812 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:24:28.812 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:24:28.812 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:24:28.812 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:24:28.812 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:24:28.812 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 157343 2024-02-10T08:24:28.812 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.812 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:24:28.812 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.812 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:24:28.812 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.234682+0000", 2024-02-10T08:24:28.812 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:24:28.812 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.813 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.813 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:24:28.813 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.234682+0000", 2024-02-10T08:24:28.813 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:24:28.813 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.813 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.813 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:24:28.813 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.234680+0000", 2024-02-10T08:24:28.813 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9950000000000002e-06 2024-02-10T08:24:28.813 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.813 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.813 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:24:28.813 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.234686+0000", 2024-02-10T08:24:28.813 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0524e-05 2024-02-10T08:24:28.814 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.814 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.814 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:24:28.814 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.234697+0000", 2024-02-10T08:24:28.814 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7540000000000003e-06 2024-02-10T08:24:28.814 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.814 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.814 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:24:28.814 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.234703+0000", 2024-02-10T08:24:28.814 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7046999999999998e-05 2024-02-10T08:24:28.814 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.814 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.814 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:24:28.814 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.234760+0000", 2024-02-10T08:24:28.814 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6490000000000002e-06 2024-02-10T08:24:28.815 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.815 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.815 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:24:28.815 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.234766+0000", 2024-02-10T08:24:28.815 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.78580552999999997 2024-02-10T08:24:28.815 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.815 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.815 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:24:28.815 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.020572+0000", 2024-02-10T08:24:28.815 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011150900000000001 2024-02-10T08:24:28.815 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.815 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.815 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:24:28.815 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.020683+0000", 2024-02-10T08:24:28.816 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012321899999999999 2024-02-10T08:24:28.816 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.816 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.816 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,4", 2024-02-10T08:24:28.816 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.020807+0000", 2024-02-10T08:24:28.816 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.007778348 2024-02-10T08:24:28.816 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.816 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.816 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:24:28.816 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.028585+0000", 2024-02-10T08:24:28.816 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.010851072 2024-02-10T08:24:28.816 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.816 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.816 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:24:28.816 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.039436+0000", 2024-02-10T08:24:28.817 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000105664 2024-02-10T08:24:28.817 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.817 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.817 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:24:28.817 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.039542+0000", 2024-02-10T08:24:28.817 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5531999999999998e-05 2024-02-10T08:24:28.817 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.817 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.817 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:24:28.817 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.039577+0000", 2024-02-10T08:24:28.817 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3237e-05 2024-02-10T08:24:28.817 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.817 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.817 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:24:28.818 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.039611+0000", 2024-02-10T08:24:28.818 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.80492876000000002 2024-02-10T08:24:28.818 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:28.818 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:24:28.818 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:28.818 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.818 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.818 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:157393 7.3 7:c94b9379:::benchmark_data_smithi018_80623_object56465:head [delete] snapc 0=[] ondisk+write+known_if_redirected e151)", 2024-02-10T08:24:28.818 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:22:43.311143+0000", 2024-02-10T08:24:28.818 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 105.321237866, 2024-02-10T08:24:28.818 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.72857992500000002, 2024-02-10T08:24:28.818 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:24:28.818 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:24:28.818 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:24:28.818 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:24:28.819 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:24:28.819 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 157393 2024-02-10T08:24:28.819 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.819 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:24:28.819 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.819 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:24:28.819 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.311143+0000", 2024-02-10T08:24:28.819 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:24:28.819 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.819 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.819 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:24:28.819 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.311143+0000", 2024-02-10T08:24:28.819 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999981 2024-02-10T08:24:28.819 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.819 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.820 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:24:28.820 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.311141+0000", 2024-02-10T08:24:28.820 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1689999999999992e-06 2024-02-10T08:24:28.820 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.820 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.820 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:24:28.820 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.311150+0000", 2024-02-10T08:24:28.820 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3509999999999999e-05 2024-02-10T08:24:28.820 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.820 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.820 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:24:28.820 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.311163+0000", 2024-02-10T08:24:28.820 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2110000000000001e-06 2024-02-10T08:24:28.820 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.820 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.821 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:24:28.821 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.311170+0000", 2024-02-10T08:24:28.821 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4722999999999998e-05 2024-02-10T08:24:28.821 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.821 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.821 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:24:28.821 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.311225+0000", 2024-02-10T08:24:28.821 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0803e-05 2024-02-10T08:24:28.821 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.821 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.821 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:24:28.821 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.311236+0000", 2024-02-10T08:24:28.821 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.71203997399999996 2024-02-10T08:24:28.821 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.821 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.822 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:24:28.822 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.023276+0000", 2024-02-10T08:24:28.822 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5785000000000005e-05 2024-02-10T08:24:28.822 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.822 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.822 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:24:28.822 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.023372+0000", 2024-02-10T08:24:28.822 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7613999999999993e-05 2024-02-10T08:24:28.822 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.822 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.822 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,4", 2024-02-10T08:24:28.822 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.023439+0000", 2024-02-10T08:24:28.822 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0052872689999999998 2024-02-10T08:24:28.822 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.822 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.822 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:24:28.823 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.028726+0000", 2024-02-10T08:24:28.823 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.010890365000000001 2024-02-10T08:24:28.823 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.823 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.823 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:24:28.823 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.039617+0000", 2024-02-10T08:24:28.823 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6528e-05 2024-02-10T08:24:28.823 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.823 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.823 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:24:28.823 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.039653+0000", 2024-02-10T08:24:28.823 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5358000000000003e-05 2024-02-10T08:24:28.823 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.823 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.824 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:24:28.824 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.039689+0000", 2024-02-10T08:24:28.824 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4285000000000001e-05 2024-02-10T08:24:28.824 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.824 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.824 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:24:28.824 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.039723+0000", 2024-02-10T08:24:28.824 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.72857992500000002 2024-02-10T08:24:28.824 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:28.824 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:24:28.824 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:28.824 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.824 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.824 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:157415 7.3 7:c45d9e59:::benchmark_data_smithi018_80623_object56487:head [delete] snapc 0=[] ondisk+write+known_if_redirected e151)", 2024-02-10T08:24:28.824 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:22:43.346516+0000", 2024-02-10T08:24:28.825 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 105.285864757, 2024-02-10T08:24:28.825 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.69684925099999995, 2024-02-10T08:24:28.825 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:24:28.825 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:24:28.825 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:24:28.825 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:24:28.825 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:24:28.825 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 157415 2024-02-10T08:24:28.825 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.825 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:24:28.825 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.825 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:24:28.825 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.346516+0000", 2024-02-10T08:24:28.825 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:24:28.825 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.826 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.826 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:24:28.826 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.346516+0000", 2024-02-10T08:24:28.826 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:24:28.826 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.826 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.826 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:24:28.826 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.346515+0000", 2024-02-10T08:24:28.826 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.657e-06 2024-02-10T08:24:28.826 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.826 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.826 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:24:28.826 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.346522+0000", 2024-02-10T08:24:28.826 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1800999999999999e-05 2024-02-10T08:24:28.826 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.827 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.827 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:24:28.827 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.346533+0000", 2024-02-10T08:24:28.827 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2110000000000003e-06 2024-02-10T08:24:28.827 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.827 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.827 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:24:28.827 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.346540+0000", 2024-02-10T08:24:28.827 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2573e-05 2024-02-10T08:24:28.827 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.827 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.827 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:24:28.827 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.346592+0000", 2024-02-10T08:24:28.827 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6440000000000003e-06 2024-02-10T08:24:28.827 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.828 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.828 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:24:28.828 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.346599+0000", 2024-02-10T08:24:28.828 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.67906896900000002 2024-02-10T08:24:28.828 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.828 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.828 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:24:28.828 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.025668+0000", 2024-02-10T08:24:28.828 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010035399999999999 2024-02-10T08:24:28.828 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.828 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.828 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:24:28.828 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.025768+0000", 2024-02-10T08:24:28.828 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011332699999999999 2024-02-10T08:24:28.828 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.829 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.829 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,4", 2024-02-10T08:24:28.829 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.025882+0000", 2024-02-10T08:24:28.829 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013848953000000001 2024-02-10T08:24:28.829 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.829 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.829 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:24:28.829 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.039730+0000", 2024-02-10T08:24:28.829 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1199999999999998e-05 2024-02-10T08:24:28.829 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.829 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.829 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:24:28.829 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.039782+0000", 2024-02-10T08:24:28.829 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.003505233 2024-02-10T08:24:28.829 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.830 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.830 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:24:28.830 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.043287+0000", 2024-02-10T08:24:28.830 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0602000000000002e-05 2024-02-10T08:24:28.830 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.830 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.830 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:24:28.830 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.043328+0000", 2024-02-10T08:24:28.830 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7935000000000002e-05 2024-02-10T08:24:28.830 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.830 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.830 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:24:28.830 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.043365+0000", 2024-02-10T08:24:28.830 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.69684925099999995 2024-02-10T08:24:28.830 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:28.831 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:24:28.831 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:28.831 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.831 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.831 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:157442 7.3 7:c360dcfc:::benchmark_data_smithi018_80623_object56514:head [delete] snapc 0=[] ondisk+write+known_if_redirected e151)", 2024-02-10T08:24:28.831 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:22:43.394825+0000", 2024-02-10T08:24:28.831 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 105.237556102, 2024-02-10T08:24:28.831 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.64864449800000001, 2024-02-10T08:24:28.831 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:24:28.831 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:24:28.831 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:24:28.831 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:24:28.831 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:24:28.831 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 157442 2024-02-10T08:24:28.831 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.832 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:24:28.832 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.832 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:24:28.832 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.394825+0000", 2024-02-10T08:24:28.832 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:24:28.832 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.832 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.832 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:24:28.832 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.394825+0000", 2024-02-10T08:24:28.832 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:24:28.832 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.832 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.832 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:24:28.832 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.394823+0000", 2024-02-10T08:24:28.833 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7050000000000002e-06 2024-02-10T08:24:28.833 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.833 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.833 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:24:28.833 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.394830+0000", 2024-02-10T08:24:28.833 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6879999999999994e-06 2024-02-10T08:24:28.833 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.833 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.833 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:24:28.833 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.394840+0000", 2024-02-10T08:24:28.833 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0399999999999998e-06 2024-02-10T08:24:28.833 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.833 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.833 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:24:28.833 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.394846+0000", 2024-02-10T08:24:28.834 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2652999999999999e-05 2024-02-10T08:24:28.834 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.834 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.834 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:24:28.834 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.394898+0000", 2024-02-10T08:24:28.834 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9799999999999993e-06 2024-02-10T08:24:28.834 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.834 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.834 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:24:28.834 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.394908+0000", 2024-02-10T08:24:28.834 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.63396280900000002 2024-02-10T08:24:28.834 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.834 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.834 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:24:28.834 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.028871+0000", 2024-02-10T08:24:28.835 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8096000000000005e-05 2024-02-10T08:24:28.835 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.835 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.835 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:24:28.835 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.028959+0000", 2024-02-10T08:24:28.835 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012165199999999999 2024-02-10T08:24:28.835 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.835 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.835 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,4", 2024-02-10T08:24:28.835 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.029081+0000", 2024-02-10T08:24:28.835 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.010654807000000001 2024-02-10T08:24:28.835 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.835 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.835 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:24:28.836 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.039736+0000", 2024-02-10T08:24:28.836 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9159000000000006e-05 2024-02-10T08:24:28.836 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.836 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.836 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:24:28.836 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.039815+0000", 2024-02-10T08:24:28.836 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.003585132 2024-02-10T08:24:28.836 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.836 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.836 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:24:28.836 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.043400+0000", 2024-02-10T08:24:28.836 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5491000000000003e-05 2024-02-10T08:24:28.836 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.836 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.837 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:24:28.837 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.043436+0000", 2024-02-10T08:24:28.837 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3739999999999999e-05 2024-02-10T08:24:28.837 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.837 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.837 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:24:28.837 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.043469+0000", 2024-02-10T08:24:28.837 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.64864449800000001 2024-02-10T08:24:28.837 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:28.837 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:24:28.837 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:28.837 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.837 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.837 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:157448 7.3 7:c49077b4:::benchmark_data_smithi018_80623_object56520:head [delete] snapc 0=[] ondisk+write+known_if_redirected e151)", 2024-02-10T08:24:28.838 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:22:43.404301+0000", 2024-02-10T08:24:28.838 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 105.228079888, 2024-02-10T08:24:28.838 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.63983854100000004, 2024-02-10T08:24:28.838 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:24:28.838 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:24:28.838 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:24:28.838 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:24:28.838 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:24:28.838 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 157448 2024-02-10T08:24:28.838 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.838 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:24:28.838 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.838 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:24:28.838 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.404301+0000", 2024-02-10T08:24:28.838 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:24:28.839 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.839 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.839 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:24:28.839 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.404301+0000", 2024-02-10T08:24:28.839 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999981 2024-02-10T08:24:28.839 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.839 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.839 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:24:28.839 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.404299+0000", 2024-02-10T08:24:28.839 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0129999999999993e-06 2024-02-10T08:24:28.839 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.839 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.839 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:24:28.839 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.404307+0000", 2024-02-10T08:24:28.840 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4270000000000001e-05 2024-02-10T08:24:28.840 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.840 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.840 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:24:28.840 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.404321+0000", 2024-02-10T08:24:28.840 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3309999999999998e-06 2024-02-10T08:24:28.840 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.840 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.840 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:24:28.840 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.404329+0000", 2024-02-10T08:24:28.840 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1716000000000003e-05 2024-02-10T08:24:28.840 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.840 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.840 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:24:28.841 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.404390+0000", 2024-02-10T08:24:28.841 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1070000000000001e-05 2024-02-10T08:24:28.841 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.841 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.841 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:24:28.841 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.404401+0000", 2024-02-10T08:24:28.841 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.62703652499999996 2024-02-10T08:24:28.841 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.841 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.841 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:24:28.841 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.031438+0000", 2024-02-10T08:24:28.841 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9425000000000005e-05 2024-02-10T08:24:28.841 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.841 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.841 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:24:28.842 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.031527+0000", 2024-02-10T08:24:28.842 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1803000000000004e-05 2024-02-10T08:24:28.842 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.842 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.842 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,4", 2024-02-10T08:24:28.842 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.031599+0000", 2024-02-10T08:24:28.842 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.008141835 2024-02-10T08:24:28.842 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.842 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.842 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:24:28.842 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.039741+0000", 2024-02-10T08:24:28.842 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0034845499999999999 2024-02-10T08:24:28.842 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.842 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.842 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:24:28.843 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.043226+0000", 2024-02-10T08:24:28.843 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00083247300000000002 2024-02-10T08:24:28.843 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.843 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.843 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:24:28.843 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.044058+0000", 2024-02-10T08:24:28.843 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5082e-05 2024-02-10T08:24:28.843 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.843 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.843 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:24:28.843 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.044103+0000", 2024-02-10T08:24:28.843 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6449999999999998e-05 2024-02-10T08:24:28.843 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.843 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.844 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:24:28.844 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.044140+0000", 2024-02-10T08:24:28.844 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.63983854100000004 2024-02-10T08:24:28.844 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:28.844 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:24:28.844 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:28.844 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.844 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.844 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:157457 7.3 7:c0fc0a37:::benchmark_data_smithi018_80623_object56529:head [delete] snapc 0=[] ondisk+write+known_if_redirected e151)", 2024-02-10T08:24:28.844 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:22:43.433933+0000", 2024-02-10T08:24:28.844 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 105.19844824099999, 2024-02-10T08:24:28.844 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.613788797, 2024-02-10T08:24:28.844 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:24:28.844 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:24:28.845 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:24:28.845 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:24:28.845 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:24:28.845 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 157457 2024-02-10T08:24:28.845 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.845 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:24:28.845 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.845 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:24:28.845 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.433933+0000", 2024-02-10T08:24:28.845 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:24:28.845 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.845 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.845 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:24:28.845 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.433933+0000", 2024-02-10T08:24:28.845 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:24:28.846 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.846 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.846 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:24:28.846 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.433931+0000", 2024-02-10T08:24:28.846 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6569999999999997e-06 2024-02-10T08:24:28.846 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.846 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.846 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:24:28.846 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.433939+0000", 2024-02-10T08:24:28.846 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2330000000000001e-05 2024-02-10T08:24:28.846 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.846 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.846 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:24:28.846 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.433951+0000", 2024-02-10T08:24:28.846 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5410000000000003e-06 2024-02-10T08:24:28.847 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.847 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.847 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:24:28.847 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.433959+0000", 2024-02-10T08:24:28.847 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8600000000000001e-05 2024-02-10T08:24:28.847 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.847 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.847 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:24:28.847 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.434017+0000", 2024-02-10T08:24:28.847 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1365999999999999e-05 2024-02-10T08:24:28.847 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.847 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.847 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:24:28.847 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.434029+0000", 2024-02-10T08:24:28.847 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.59955279299999997 2024-02-10T08:24:28.848 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.848 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.848 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:24:28.848 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.033581+0000", 2024-02-10T08:24:28.848 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2068e-05 2024-02-10T08:24:28.848 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.848 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.848 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:24:28.848 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.033674+0000", 2024-02-10T08:24:28.848 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000107172 2024-02-10T08:24:28.848 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.848 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.848 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,4", 2024-02-10T08:24:28.848 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.033781+0000", 2024-02-10T08:24:28.849 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0094765909999999995 2024-02-10T08:24:28.849 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.849 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.849 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:24:28.849 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.043257+0000", 2024-02-10T08:24:28.849 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0021626610000000002 2024-02-10T08:24:28.849 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.849 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.849 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:24:28.849 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.045420+0000", 2024-02-10T08:24:28.849 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0022185429999999999 2024-02-10T08:24:28.849 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.849 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.849 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:24:28.850 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.047639+0000", 2024-02-10T08:24:28.850 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6199999999999998e-05 2024-02-10T08:24:28.850 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.850 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.850 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:24:28.850 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.047685+0000", 2024-02-10T08:24:28.850 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6789999999999998e-05 2024-02-10T08:24:28.850 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.850 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.850 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:24:28.850 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.047722+0000", 2024-02-10T08:24:28.850 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.613788797 2024-02-10T08:24:28.850 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:28.851 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:24:28.851 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:28.851 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.851 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.851 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:179907 7.e 7:7231e2fb:::benchmark_data_smithi018_80623_object78979:head [delete] snapc 0=[] ondisk+write+known_if_redirected e162)", 2024-02-10T08:24:28.851 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:23:14.043336+0000", 2024-02-10T08:24:28.851 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 74.589045236999993, 2024-02-10T08:24:28.851 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6648055909999999, 2024-02-10T08:24:28.851 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:24:28.851 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-02-10T08:24:28.851 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:24:28.851 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:24:28.851 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:24:28.851 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 179907 2024-02-10T08:24:28.851 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.852 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:24:28.852 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.852 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:24:28.852 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.043336+0000", 2024-02-10T08:24:28.852 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:24:28.852 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.852 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.852 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:24:28.852 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.043336+0000", 2024-02-10T08:24:28.852 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999981 2024-02-10T08:24:28.852 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.852 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.852 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:24:28.852 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.043334+0000", 2024-02-10T08:24:28.852 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1280000000000008e-06 2024-02-10T08:24:28.853 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.853 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.853 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:24:28.853 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.043342+0000", 2024-02-10T08:24:28.853 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3698e-05 2024-02-10T08:24:28.853 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.853 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.853 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:24:28.853 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.043356+0000", 2024-02-10T08:24:28.853 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8650000000000003e-06 2024-02-10T08:24:28.853 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.853 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.853 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:24:28.853 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.043363+0000", 2024-02-10T08:24:28.854 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.003475363 2024-02-10T08:24:28.854 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.854 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.854 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:24:28.854 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.046838+0000", 2024-02-10T08:24:28.854 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011392600000000001 2024-02-10T08:24:28.854 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.854 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.854 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:24:28.854 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.046952+0000", 2024-02-10T08:24:28.854 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000146372 2024-02-10T08:24:28.854 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.854 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.854 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0,5", 2024-02-10T08:24:28.854 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.047098+0000", 2024-02-10T08:24:28.855 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.003034302 2024-02-10T08:24:28.855 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.855 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.855 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:24:28.855 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.050133+0000", 2024-02-10T08:24:28.855 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0045547590000000002 2024-02-10T08:24:28.855 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.855 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.855 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:24:28.855 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.054687+0000", 2024-02-10T08:24:28.855 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.031944001 2024-02-10T08:24:28.855 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.855 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.855 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:24:28.856 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.086631+0000", 2024-02-10T08:24:28.856 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1980000000000001e-06 2024-02-10T08:24:28.856 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.856 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.856 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:24:28.856 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.086640+0000", 2024-02-10T08:24:28.856 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.98181184200000005 2024-02-10T08:24:28.856 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.856 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.856 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:24:28.856 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.068451+0000", 2024-02-10T08:24:28.856 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0975000000000001e-05 2024-02-10T08:24:28.856 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.856 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.857 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:24:28.857 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.068462+0000", 2024-02-10T08:24:28.857 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.63960430700000004 2024-02-10T08:24:28.857 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.857 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.857 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:24:28.857 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.708067+0000", 2024-02-10T08:24:28.857 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4673999999999997e-05 2024-02-10T08:24:28.857 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.857 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.857 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:24:28.857 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.708141+0000", 2024-02-10T08:24:28.857 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6648055909999999 2024-02-10T08:24:28.857 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:28.858 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:24:28.858 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:28.858 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.858 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.858 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:179925 7.e 7:72968301:::benchmark_data_smithi018_80623_object78997:head [delete] snapc 0=[] ondisk+write+known_if_redirected e163)", 2024-02-10T08:24:28.858 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:23:14.078690+0000", 2024-02-10T08:24:28.858 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 74.553690950000004, 2024-02-10T08:24:28.858 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.677725116, 2024-02-10T08:24:28.858 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:24:28.858 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:24:28.858 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:24:28.858 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:24:28.858 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:24:28.858 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 179925 2024-02-10T08:24:28.858 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.859 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:24:28.859 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.859 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:24:28.859 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.078690+0000", 2024-02-10T08:24:28.859 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:24:28.859 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.859 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.859 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:24:28.859 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.078690+0000", 2024-02-10T08:24:28.859 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:24:28.859 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.859 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.859 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:24:28.859 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.078688+0000", 2024-02-10T08:24:28.859 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9439999999999999e-06 2024-02-10T08:24:28.860 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.860 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.860 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:24:28.860 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.078695+0000", 2024-02-10T08:24:28.860 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2506e-05 2024-02-10T08:24:28.860 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.860 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.860 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:24:28.860 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.078708+0000", 2024-02-10T08:24:28.860 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6969999999999993e-06 2024-02-10T08:24:28.860 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.860 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.860 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:24:28.860 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.078716+0000", 2024-02-10T08:24:28.861 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0079431369999999994 2024-02-10T08:24:28.861 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.861 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.861 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:24:28.861 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.086659+0000", 2024-02-10T08:24:28.861 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0859999999999998e-06 2024-02-10T08:24:28.861 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.861 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.861 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:24:28.861 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.086665+0000", 2024-02-10T08:24:28.861 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.98181665100000004 2024-02-10T08:24:28.861 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.861 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.861 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:24:28.862 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.068481+0000", 2024-02-10T08:24:28.862 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8859999999999998e-06 2024-02-10T08:24:28.862 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.862 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.862 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:24:28.862 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.068488+0000", 2024-02-10T08:24:28.862 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.64001606899999997 2024-02-10T08:24:28.862 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.862 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.862 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:24:28.862 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.708504+0000", 2024-02-10T08:24:28.862 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010408000000000001 2024-02-10T08:24:28.862 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.862 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.862 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:24:28.863 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.708608+0000", 2024-02-10T08:24:28.863 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00045112599999999999 2024-02-10T08:24:28.863 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.863 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.863 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0,3,5", 2024-02-10T08:24:28.863 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.709060+0000", 2024-02-10T08:24:28.863 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.025245005000000001 2024-02-10T08:24:28.863 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.863 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.863 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:24:28.863 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.734305+0000", 2024-02-10T08:24:28.863 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0342e-05 2024-02-10T08:24:28.863 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.863 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.864 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:24:28.864 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.734355+0000", 2024-02-10T08:24:28.864 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001417202 2024-02-10T08:24:28.864 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.864 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.864 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:24:28.864 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.735772+0000", 2024-02-10T08:24:28.864 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.020468496999999999 2024-02-10T08:24:28.864 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.864 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.864 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:24:28.864 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.756241+0000", 2024-02-10T08:24:28.864 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4324999999999999e-05 2024-02-10T08:24:28.864 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.865 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.865 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:24:28.865 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.756295+0000", 2024-02-10T08:24:28.865 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000120222 2024-02-10T08:24:28.865 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.865 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.865 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:24:28.865 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.756415+0000", 2024-02-10T08:24:28.865 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.677725116 2024-02-10T08:24:28.865 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:28.865 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:24:28.865 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:28.865 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.865 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.865 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:179928 7.e 7:72d266e4:::benchmark_data_smithi018_80623_object79000:head [delete] snapc 0=[] ondisk+write+known_if_redirected e163)", 2024-02-10T08:24:28.866 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:23:14.092649+0000", 2024-02-10T08:24:28.866 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 74.539732071000003, 2024-02-10T08:24:28.866 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.666747126, 2024-02-10T08:24:28.866 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:24:28.866 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:24:28.866 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:24:28.866 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:24:28.866 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:24:28.866 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 179928 2024-02-10T08:24:28.866 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.866 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:24:28.866 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.866 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:24:28.866 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.092649+0000", 2024-02-10T08:24:28.867 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:24:28.867 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.867 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.867 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:24:28.867 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.092649+0000", 2024-02-10T08:24:28.867 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999981 2024-02-10T08:24:28.867 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.867 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.867 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:24:28.867 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.092647+0000", 2024-02-10T08:24:28.867 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1449999999999996e-06 2024-02-10T08:24:28.867 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.867 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.867 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:24:28.867 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.092653+0000", 2024-02-10T08:24:28.867 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3961000000000001e-05 2024-02-10T08:24:28.868 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.868 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.868 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:24:28.868 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.092667+0000", 2024-02-10T08:24:28.868 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8449999999999999e-06 2024-02-10T08:24:28.868 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.868 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.868 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:24:28.868 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.092673+0000", 2024-02-10T08:24:28.868 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00056664599999999997 2024-02-10T08:24:28.868 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.868 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.868 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:24:28.868 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.093240+0000", 2024-02-10T08:24:28.869 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0120000000000005e-06 2024-02-10T08:24:28.869 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.869 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.869 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:24:28.869 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.093248+0000", 2024-02-10T08:24:28.869 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.97525832499999998 2024-02-10T08:24:28.869 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.869 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.869 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:24:28.869 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.068506+0000", 2024-02-10T08:24:28.869 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4230000000000002e-06 2024-02-10T08:24:28.869 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.869 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.869 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:24:28.869 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.068512+0000", 2024-02-10T08:24:28.870 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.65053395999999997 2024-02-10T08:24:28.870 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.870 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.870 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:24:28.870 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.719046+0000", 2024-02-10T08:24:28.870 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000114819 2024-02-10T08:24:28.870 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.870 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.870 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:24:28.870 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.719161+0000", 2024-02-10T08:24:28.870 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014697700000000001 2024-02-10T08:24:28.870 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.870 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.870 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0,3,5", 2024-02-10T08:24:28.871 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.719308+0000", 2024-02-10T08:24:28.871 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015003345 2024-02-10T08:24:28.871 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.871 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.871 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:24:28.871 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.734312+0000", 2024-02-10T08:24:28.871 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0014970579999999999 2024-02-10T08:24:28.871 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.871 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.871 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:24:28.871 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.735809+0000", 2024-02-10T08:24:28.871 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00070790299999999996 2024-02-10T08:24:28.871 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.871 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.871 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:24:28.872 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.736517+0000", 2024-02-10T08:24:28.872 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.022755646000000001 2024-02-10T08:24:28.872 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.872 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.872 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:24:28.872 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.759272+0000", 2024-02-10T08:24:28.872 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3754999999999998e-05 2024-02-10T08:24:28.872 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.872 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.872 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:24:28.872 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.759306+0000", 2024-02-10T08:24:28.872 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0101999999999999e-05 2024-02-10T08:24:28.872 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.872 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.872 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:24:28.873 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.759396+0000", 2024-02-10T08:24:28.873 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.666747126 2024-02-10T08:24:28.873 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:28.873 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:24:28.873 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:28.873 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.873 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.873 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:179945 7.e 7:73b3a950:::benchmark_data_smithi018_80623_object79017:head [delete] snapc 0=[] ondisk+write+known_if_redirected e163)", 2024-02-10T08:24:28.873 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:23:14.119145+0000", 2024-02-10T08:24:28.873 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 74.513236230000004, 2024-02-10T08:24:28.873 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6404200420000001, 2024-02-10T08:24:28.873 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:24:28.873 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:24:28.873 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:24:28.873 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:24:28.874 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:24:28.874 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 179945 2024-02-10T08:24:28.874 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.874 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:24:28.874 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.874 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:24:28.874 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.119145+0000", 2024-02-10T08:24:28.874 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:24:28.874 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.874 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.874 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:24:28.874 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.119145+0000", 2024-02-10T08:24:28.874 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:24:28.874 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.875 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.875 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:24:28.875 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.119144+0000", 2024-02-10T08:24:28.875 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0290000000000001e-06 2024-02-10T08:24:28.875 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.875 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.875 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:24:28.875 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.119147+0000", 2024-02-10T08:24:28.875 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1449999999999999e-06 2024-02-10T08:24:28.875 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.875 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.875 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:24:28.875 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.119152+0000", 2024-02-10T08:24:28.875 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.693e-06 2024-02-10T08:24:28.875 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.876 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.876 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:24:28.876 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.119156+0000", 2024-02-10T08:24:28.876 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7330000000000003e-05 2024-02-10T08:24:28.876 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.876 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.876 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:24:28.876 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.119203+0000", 2024-02-10T08:24:28.876 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3399999999999998e-06 2024-02-10T08:24:28.876 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.876 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.876 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:24:28.876 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.119212+0000", 2024-02-10T08:24:28.876 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.94931920199999997 2024-02-10T08:24:28.877 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.877 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.877 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:24:28.877 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.068531+0000", 2024-02-10T08:24:28.877 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9009999999999997e-06 2024-02-10T08:24:28.877 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.877 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.877 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:24:28.877 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.068538+0000", 2024-02-10T08:24:28.877 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.65529383500000005 2024-02-10T08:24:28.877 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.877 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.877 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:24:28.877 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.723832+0000", 2024-02-10T08:24:28.877 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000131526 2024-02-10T08:24:28.878 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.878 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.878 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:24:28.878 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.723963+0000", 2024-02-10T08:24:28.878 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016254900000000001 2024-02-10T08:24:28.878 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.878 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.878 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0,3,5", 2024-02-10T08:24:28.878 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.724126+0000", 2024-02-10T08:24:28.878 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.010192308000000001 2024-02-10T08:24:28.878 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.878 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.878 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:24:28.878 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.734318+0000", 2024-02-10T08:24:28.878 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0079136729999999995 2024-02-10T08:24:28.879 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.879 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.879 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:24:28.879 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.742232+0000", 2024-02-10T08:24:28.879 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0048784900000000001 2024-02-10T08:24:28.879 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.879 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.879 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:24:28.879 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.747110+0000", 2024-02-10T08:24:28.879 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.012339822 2024-02-10T08:24:28.879 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.879 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.879 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:24:28.879 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.759450+0000", 2024-02-10T08:24:28.879 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0015000000000001e-05 2024-02-10T08:24:28.880 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.880 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.880 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:24:28.880 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.759500+0000", 2024-02-10T08:24:28.880 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4652000000000004e-05 2024-02-10T08:24:28.880 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:24:28.880 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:24:28.880 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:24:28.880 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.759565+0000", 2024-02-10T08:24:28.880 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6404200420000001 2024-02-10T08:24:28.880 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:28.880 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:24:28.880 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:28.880 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:24:28.881 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:24:28.881 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-02-10T08:24:28.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:24:27.896571+0000 mgr.y (mgr.14505) 294 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:24:28.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:27.960725+0000 osd.2 (osd.2) 69 : cluster [DBG] 4.f scrub starts 2024-02-10T08:24:28.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:27.962874+0000 osd.2 (osd.2) 70 : cluster [DBG] 4.f scrub ok 2024-02-10T08:24:28.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:24:27.896571+0000 mgr.y (mgr.14505) 294 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:24:28.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:27.960725+0000 osd.2 (osd.2) 69 : cluster [DBG] 4.f scrub starts 2024-02-10T08:24:28.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:27.962874+0000 osd.2 (osd.2) 70 : cluster [DBG] 4.f scrub ok 2024-02-10T08:24:28.957 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:24:28.961 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:28.962 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:24:29.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:24:27.896571+0000 mgr.y (mgr.14505) 294 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:24:29.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:27.960725+0000 osd.2 (osd.2) 69 : cluster [DBG] 4.f scrub starts 2024-02-10T08:24:29.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:27.962874+0000 osd.2 (osd.2) 70 : cluster [DBG] 4.f scrub ok 2024-02-10T08:24:29.063 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:24:29.093 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:29.442 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:24:29.446 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:29.446 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:24:29.547 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:24:29.575 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:29.917 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.3 dump_ops_in_flight 2024-02-10T08:24:30.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:28.688631+0000 mgr.y (mgr.14505) 295 : cluster [DBG] pgmap v349: 158 pgs: 158 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-02-10T08:24:30.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:28.924745+0000 osd.2 (osd.2) 71 : cluster [DBG] 6.14 scrub starts 2024-02-10T08:24:30.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:28.925983+0000 osd.2 (osd.2) 72 : cluster [DBG] 6.14 scrub ok 2024-02-10T08:24:30.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:29.540618+0000 osd.1 (osd.1) 88 : cluster [DBG] 4.1d scrub starts 2024-02-10T08:24:30.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:29.544413+0000 osd.1 (osd.1) 89 : cluster [DBG] 4.1d scrub ok 2024-02-10T08:24:30.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:28.688631+0000 mgr.y (mgr.14505) 295 : cluster [DBG] pgmap v349: 158 pgs: 158 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-02-10T08:24:30.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:28.924745+0000 osd.2 (osd.2) 71 : cluster [DBG] 6.14 scrub starts 2024-02-10T08:24:30.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:28.925983+0000 osd.2 (osd.2) 72 : cluster [DBG] 6.14 scrub ok 2024-02-10T08:24:30.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:29.540618+0000 osd.1 (osd.1) 88 : cluster [DBG] 4.1d scrub starts 2024-02-10T08:24:30.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:29.544413+0000 osd.1 (osd.1) 89 : cluster [DBG] 4.1d scrub ok 2024-02-10T08:24:30.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:28.688631+0000 mgr.y (mgr.14505) 295 : cluster [DBG] pgmap v349: 158 pgs: 158 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-02-10T08:24:30.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:28.924745+0000 osd.2 (osd.2) 71 : cluster [DBG] 6.14 scrub starts 2024-02-10T08:24:30.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:28.925983+0000 osd.2 (osd.2) 72 : cluster [DBG] 6.14 scrub ok 2024-02-10T08:24:30.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:29.540618+0000 osd.1 (osd.1) 88 : cluster [DBG] 4.1d scrub starts 2024-02-10T08:24:30.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:29.544413+0000 osd.1 (osd.1) 89 : cluster [DBG] 4.1d scrub ok 2024-02-10T08:24:30.635 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:24:30.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:30.075321+0000 osd.6 (osd.6) 55 : cluster [DBG] 2.11 scrub starts 2024-02-10T08:24:30.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:30.076331+0000 osd.6 (osd.6) 56 : cluster [DBG] 2.11 scrub ok 2024-02-10T08:24:30.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:30.592014+0000 mon.a (mon.0) 1091 : cluster [DBG] osdmap e195: 8 total, 8 up, 8 in 2024-02-10T08:24:30.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:30.075321+0000 osd.6 (osd.6) 55 : cluster [DBG] 2.11 scrub starts 2024-02-10T08:24:30.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:30.076331+0000 osd.6 (osd.6) 56 : cluster [DBG] 2.11 scrub ok 2024-02-10T08:24:30.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:30.592014+0000 mon.a (mon.0) 1091 : cluster [DBG] osdmap e195: 8 total, 8 up, 8 in 2024-02-10T08:24:31.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:30.075321+0000 osd.6 (osd.6) 55 : cluster [DBG] 2.11 scrub starts 2024-02-10T08:24:31.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:30.076331+0000 osd.6 (osd.6) 56 : cluster [DBG] 2.11 scrub ok 2024-02-10T08:24:31.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:30.592014+0000 mon.a (mon.0) 1091 : cluster [DBG] osdmap e195: 8 total, 8 up, 8 in 2024-02-10T08:24:31.445 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd unset nodeep-scrub 2024-02-10T08:24:31.635 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:24:31.639 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:31.639 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:24:31.740 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:24:31.772 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:31.793 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:24:31.795 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:31.796 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:24:31.897 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:24:31.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:30.689053+0000 mgr.y (mgr.14505) 296 : cluster [DBG] pgmap v351: 158 pgs: 158 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-10T08:24:31.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:30.900560+0000 osd.0 (osd.0) 78 : cluster [DBG] 4.b scrub starts 2024-02-10T08:24:31.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:30.902116+0000 osd.0 (osd.0) 79 : cluster [DBG] 4.b scrub ok 2024-02-10T08:24:31.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:30.913619+0000 osd.2 (osd.2) 73 : cluster [DBG] 2.5 scrub starts 2024-02-10T08:24:31.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:30.914496+0000 osd.2 (osd.2) 74 : cluster [DBG] 2.5 scrub ok 2024-02-10T08:24:31.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:31.036920+0000 osd.7 (osd.7) 83 : cluster [DBG] 5.9 scrub starts 2024-02-10T08:24:31.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:31.038092+0000 osd.7 (osd.7) 84 : cluster [DBG] 5.9 scrub ok 2024-02-10T08:24:31.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:30.689053+0000 mgr.y (mgr.14505) 296 : cluster [DBG] pgmap v351: 158 pgs: 158 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-10T08:24:31.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:30.900560+0000 osd.0 (osd.0) 78 : cluster [DBG] 4.b scrub starts 2024-02-10T08:24:31.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:30.902116+0000 osd.0 (osd.0) 79 : cluster [DBG] 4.b scrub ok 2024-02-10T08:24:31.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:30.913619+0000 osd.2 (osd.2) 73 : cluster [DBG] 2.5 scrub starts 2024-02-10T08:24:31.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:30.914496+0000 osd.2 (osd.2) 74 : cluster [DBG] 2.5 scrub ok 2024-02-10T08:24:31.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:31.036920+0000 osd.7 (osd.7) 83 : cluster [DBG] 5.9 scrub starts 2024-02-10T08:24:31.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:31.038092+0000 osd.7 (osd.7) 84 : cluster [DBG] 5.9 scrub ok 2024-02-10T08:24:31.926 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:32.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:30.689053+0000 mgr.y (mgr.14505) 296 : cluster [DBG] pgmap v351: 158 pgs: 158 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-10T08:24:32.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:30.900560+0000 osd.0 (osd.0) 78 : cluster [DBG] 4.b scrub starts 2024-02-10T08:24:32.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:30.902116+0000 osd.0 (osd.0) 79 : cluster [DBG] 4.b scrub ok 2024-02-10T08:24:32.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:30.913619+0000 osd.2 (osd.2) 73 : cluster [DBG] 2.5 scrub starts 2024-02-10T08:24:32.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:30.914496+0000 osd.2 (osd.2) 74 : cluster [DBG] 2.5 scrub ok 2024-02-10T08:24:32.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:31.036920+0000 osd.7 (osd.7) 83 : cluster [DBG] 5.9 scrub starts 2024-02-10T08:24:32.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:31.038092+0000 osd.7 (osd.7) 84 : cluster [DBG] 5.9 scrub ok 2024-02-10T08:24:32.060 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:24:32.075 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:24:32.078 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:32.078 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:24:32.179 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:24:32.212 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:32.232 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:24:32.235 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:32.236 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:24:32.337 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:24:32.366 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:32.387 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:24:32.389 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:32.390 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:24:32.491 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:24:32.522 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:32.575 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:24:32.581 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:32.581 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:24:32.582 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:24:32.682 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:24:32.710 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:32.764 INFO:teuthology.orchestra.run.smithi018.stderr:enabled application 'rados' on pool 'unique_pool_1' 2024-02-10T08:24:32.783 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:24:31.786183+0000 mon.a (mon.0) 1092 : audit [INF] from='client.? 172.21.15.18:0/1322361063' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_1", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-02-10T08:24:32.783 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:32.041625+0000 osd.7 (osd.7) 85 : cluster [DBG] 2.1f scrub starts 2024-02-10T08:24:32.783 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:32.044639+0000 osd.7 (osd.7) 86 : cluster [DBG] 2.1f scrub ok 2024-02-10T08:24:32.784 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:24:31.786183+0000 mon.a (mon.0) 1092 : audit [INF] from='client.? 172.21.15.18:0/1322361063' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_1", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-02-10T08:24:32.784 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:32.041625+0000 osd.7 (osd.7) 85 : cluster [DBG] 2.1f scrub starts 2024-02-10T08:24:32.784 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:32.044639+0000 osd.7 (osd.7) 86 : cluster [DBG] 2.1f scrub ok 2024-02-10T08:24:33.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:24:31.786183+0000 mon.a (mon.0) 1092 : audit [INF] from='client.? 172.21.15.18:0/1322361063' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_1", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-02-10T08:24:33.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:32.041625+0000 osd.7 (osd.7) 85 : cluster [DBG] 2.1f scrub starts 2024-02-10T08:24:33.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:32.044639+0000 osd.7 (osd.7) 86 : cluster [DBG] 2.1f scrub ok 2024-02-10T08:24:34.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:32.689615+0000 mgr.y (mgr.14505) 297 : cluster [DBG] pgmap v352: 158 pgs: 158 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:24:34.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:24:32.760121+0000 mon.a (mon.0) 1093 : audit [INF] from='client.? 172.21.15.18:0/1322361063' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_1", "app": "rados", "yes_i_really_mean_it": true}]': finished 2024-02-10T08:24:34.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:32.760194+0000 mon.a (mon.0) 1094 : cluster [DBG] osdmap e196: 8 total, 8 up, 8 in 2024-02-10T08:24:34.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:32.840387+0000 osd.0 (osd.0) 80 : cluster [DBG] 3.1 scrub starts 2024-02-10T08:24:34.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:32.843326+0000 osd.0 (osd.0) 81 : cluster [DBG] 3.1 scrub ok 2024-02-10T08:24:34.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:32.855403+0000 osd.5 (osd.5) 77 : cluster [DBG] 5.f scrub starts 2024-02-10T08:24:34.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:32.858631+0000 osd.5 (osd.5) 78 : cluster [DBG] 5.f scrub ok 2024-02-10T08:24:34.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:32.689615+0000 mgr.y (mgr.14505) 297 : cluster [DBG] pgmap v352: 158 pgs: 158 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:24:34.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:24:32.760121+0000 mon.a (mon.0) 1093 : audit [INF] from='client.? 172.21.15.18:0/1322361063' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_1", "app": "rados", "yes_i_really_mean_it": true}]': finished 2024-02-10T08:24:34.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:32.760194+0000 mon.a (mon.0) 1094 : cluster [DBG] osdmap e196: 8 total, 8 up, 8 in 2024-02-10T08:24:34.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:32.840387+0000 osd.0 (osd.0) 80 : cluster [DBG] 3.1 scrub starts 2024-02-10T08:24:34.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:32.843326+0000 osd.0 (osd.0) 81 : cluster [DBG] 3.1 scrub ok 2024-02-10T08:24:34.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:32.855403+0000 osd.5 (osd.5) 77 : cluster [DBG] 5.f scrub starts 2024-02-10T08:24:34.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:32.858631+0000 osd.5 (osd.5) 78 : cluster [DBG] 5.f scrub ok 2024-02-10T08:24:34.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:32.689615+0000 mgr.y (mgr.14505) 297 : cluster [DBG] pgmap v352: 158 pgs: 158 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:24:34.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:24:32.760121+0000 mon.a (mon.0) 1093 : audit [INF] from='client.? 172.21.15.18:0/1322361063' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_1", "app": "rados", "yes_i_really_mean_it": true}]': finished 2024-02-10T08:24:34.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:32.760194+0000 mon.a (mon.0) 1094 : cluster [DBG] osdmap e196: 8 total, 8 up, 8 in 2024-02-10T08:24:34.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:32.840387+0000 osd.0 (osd.0) 80 : cluster [DBG] 3.1 scrub starts 2024-02-10T08:24:34.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:32.843326+0000 osd.0 (osd.0) 81 : cluster [DBG] 3.1 scrub ok 2024-02-10T08:24:34.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:32.855403+0000 osd.5 (osd.5) 77 : cluster [DBG] 5.f scrub starts 2024-02-10T08:24:34.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:32.858631+0000 osd.5 (osd.5) 78 : cluster [DBG] 5.f scrub ok 2024-02-10T08:24:35.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:33.087743+0000 osd.7 (osd.7) 87 : cluster [DBG] 6.15 scrub starts 2024-02-10T08:24:35.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:33.098308+0000 osd.7 (osd.7) 88 : cluster [DBG] 6.15 scrub ok 2024-02-10T08:24:35.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:33.861251+0000 osd.0 (osd.0) 82 : cluster [DBG] 6.f scrub starts 2024-02-10T08:24:35.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:33.895859+0000 osd.0 (osd.0) 83 : cluster [DBG] 6.f scrub ok 2024-02-10T08:24:35.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:34.097932+0000 osd.6 (osd.6) 57 : cluster [DBG] 4.5 scrub starts 2024-02-10T08:24:35.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:34.101469+0000 osd.6 (osd.6) 58 : cluster [DBG] 4.5 scrub ok 2024-02-10T08:24:35.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:33.087743+0000 osd.7 (osd.7) 87 : cluster [DBG] 6.15 scrub starts 2024-02-10T08:24:35.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:33.098308+0000 osd.7 (osd.7) 88 : cluster [DBG] 6.15 scrub ok 2024-02-10T08:24:35.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:33.861251+0000 osd.0 (osd.0) 82 : cluster [DBG] 6.f scrub starts 2024-02-10T08:24:35.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:33.895859+0000 osd.0 (osd.0) 83 : cluster [DBG] 6.f scrub ok 2024-02-10T08:24:35.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:34.097932+0000 osd.6 (osd.6) 57 : cluster [DBG] 4.5 scrub starts 2024-02-10T08:24:35.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:34.101469+0000 osd.6 (osd.6) 58 : cluster [DBG] 4.5 scrub ok 2024-02-10T08:24:35.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:33.087743+0000 osd.7 (osd.7) 87 : cluster [DBG] 6.15 scrub starts 2024-02-10T08:24:35.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:33.098308+0000 osd.7 (osd.7) 88 : cluster [DBG] 6.15 scrub ok 2024-02-10T08:24:35.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:33.861251+0000 osd.0 (osd.0) 82 : cluster [DBG] 6.f scrub starts 2024-02-10T08:24:35.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:33.895859+0000 osd.0 (osd.0) 83 : cluster [DBG] 6.f scrub ok 2024-02-10T08:24:35.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:34.097932+0000 osd.6 (osd.6) 57 : cluster [DBG] 4.5 scrub starts 2024-02-10T08:24:35.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:34.101469+0000 osd.6 (osd.6) 58 : cluster [DBG] 4.5 scrub ok 2024-02-10T08:24:35.261 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:24:35.265 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:35.266 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:24:35.367 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:24:35.398 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:35.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:34.690224+0000 mgr.y (mgr.14505) 298 : cluster [DBG] pgmap v354: 158 pgs: 158 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-02-10T08:24:35.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:34.833101+0000 osd.0 (osd.0) 84 : cluster [DBG] 4.1e scrub starts 2024-02-10T08:24:35.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:34.836825+0000 osd.0 (osd.0) 85 : cluster [DBG] 4.1e scrub ok 2024-02-10T08:24:35.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:34.868011+0000 osd.2 (osd.2) 75 : cluster [DBG] 5.a scrub starts 2024-02-10T08:24:35.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:34.869028+0000 osd.2 (osd.2) 76 : cluster [DBG] 5.a scrub ok 2024-02-10T08:24:35.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:35.063558+0000 osd.6 (osd.6) 59 : cluster [DBG] 5.1f scrub starts 2024-02-10T08:24:35.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:35.067051+0000 osd.6 (osd.6) 60 : cluster [DBG] 5.1f scrub ok 2024-02-10T08:24:35.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:35.593498+0000 mon.a (mon.0) 1095 : cluster [DBG] osdmap e197: 8 total, 8 up, 8 in 2024-02-10T08:24:35.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:34.690224+0000 mgr.y (mgr.14505) 298 : cluster [DBG] pgmap v354: 158 pgs: 158 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-02-10T08:24:35.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:34.833101+0000 osd.0 (osd.0) 84 : cluster [DBG] 4.1e scrub starts 2024-02-10T08:24:35.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:34.836825+0000 osd.0 (osd.0) 85 : cluster [DBG] 4.1e scrub ok 2024-02-10T08:24:35.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:34.868011+0000 osd.2 (osd.2) 75 : cluster [DBG] 5.a scrub starts 2024-02-10T08:24:35.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:34.869028+0000 osd.2 (osd.2) 76 : cluster [DBG] 5.a scrub ok 2024-02-10T08:24:35.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:35.063558+0000 osd.6 (osd.6) 59 : cluster [DBG] 5.1f scrub starts 2024-02-10T08:24:35.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:35.067051+0000 osd.6 (osd.6) 60 : cluster [DBG] 5.1f scrub ok 2024-02-10T08:24:35.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:35.593498+0000 mon.a (mon.0) 1095 : cluster [DBG] osdmap e197: 8 total, 8 up, 8 in 2024-02-10T08:24:36.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:34.690224+0000 mgr.y (mgr.14505) 298 : cluster [DBG] pgmap v354: 158 pgs: 158 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-02-10T08:24:36.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:34.833101+0000 osd.0 (osd.0) 84 : cluster [DBG] 4.1e scrub starts 2024-02-10T08:24:36.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:34.836825+0000 osd.0 (osd.0) 85 : cluster [DBG] 4.1e scrub ok 2024-02-10T08:24:36.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:34.868011+0000 osd.2 (osd.2) 75 : cluster [DBG] 5.a scrub starts 2024-02-10T08:24:36.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:34.869028+0000 osd.2 (osd.2) 76 : cluster [DBG] 5.a scrub ok 2024-02-10T08:24:36.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:35.063558+0000 osd.6 (osd.6) 59 : cluster [DBG] 5.1f scrub starts 2024-02-10T08:24:36.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:35.067051+0000 osd.6 (osd.6) 60 : cluster [DBG] 5.1f scrub ok 2024-02-10T08:24:36.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:35.593498+0000 mon.a (mon.0) 1095 : cluster [DBG] osdmap e197: 8 total, 8 up, 8 in 2024-02-10T08:24:36.251 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:24:36.255 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:36.255 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:24:36.356 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:24:36.388 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:36.409 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:24:36.411 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:36.412 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:24:36.513 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:24:36.542 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:36.562 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:24:36.565 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:36.566 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:24:36.666 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:24:36.697 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:36.770 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:24:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:24:36] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:24:36.771 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:35.814622+0000 osd.0 (osd.0) 86 : cluster [DBG] 5.1e scrub starts 2024-02-10T08:24:36.772 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:35.817691+0000 osd.0 (osd.0) 87 : cluster [DBG] 5.1e scrub ok 2024-02-10T08:24:36.772 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:35.862833+0000 osd.5 (osd.5) 79 : cluster [DBG] 2.18 scrub starts 2024-02-10T08:24:36.772 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:35.866133+0000 osd.5 (osd.5) 80 : cluster [DBG] 2.18 scrub ok 2024-02-10T08:24:36.772 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:24:35.887862+0000 mon.c (mon.2) 37 : audit [DBG] from='client.? 172.21.15.18:0/4194271992' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:24:37.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:35.814622+0000 osd.0 (osd.0) 86 : cluster [DBG] 5.1e scrub starts 2024-02-10T08:24:37.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:35.817691+0000 osd.0 (osd.0) 87 : cluster [DBG] 5.1e scrub ok 2024-02-10T08:24:37.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:35.862833+0000 osd.5 (osd.5) 79 : cluster [DBG] 2.18 scrub starts 2024-02-10T08:24:37.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:35.866133+0000 osd.5 (osd.5) 80 : cluster [DBG] 2.18 scrub ok 2024-02-10T08:24:37.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:24:35.887862+0000 mon.c (mon.2) 37 : audit [DBG] from='client.? 172.21.15.18:0/4194271992' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:24:37.153 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:35.814622+0000 osd.0 (osd.0) 86 : cluster [DBG] 5.1e scrub starts 2024-02-10T08:24:37.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:35.817691+0000 osd.0 (osd.0) 87 : cluster [DBG] 5.1e scrub ok 2024-02-10T08:24:37.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:35.862833+0000 osd.5 (osd.5) 79 : cluster [DBG] 2.18 scrub starts 2024-02-10T08:24:37.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:35.866133+0000 osd.5 (osd.5) 80 : cluster [DBG] 2.18 scrub ok 2024-02-10T08:24:37.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:24:35.887862+0000 mon.c (mon.2) 37 : audit [DBG] from='client.? 172.21.15.18:0/4194271992' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:24:37.273 DEBUG:teuthology.orchestra.run.smithi018:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 65536 --object-size 65536 -p unique_pool_1 bench 90 write' 2024-02-10T08:24:37.274 INFO:tasks.thrashosds.thrasher:fixing pg num pool default.rgw.log 2024-02-10T08:24:37.274 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph pg dump --format=json 2024-02-10T08:24:37.277 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2024-02-10T08:24:37.278 INFO:teuthology.orchestra.run:waiting for 3000 2024-02-10T08:24:37.329 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:hints = 1 2024-02-10T08:24:37.329 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Maintaining 16 concurrent writes of 65536 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2024-02-10T08:24:37.329 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Object prefix: benchmark_data_smithi018_103312 2024-02-10T08:24:37.329 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-02-10T08:24:37.329 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 0 0 0 0 0 0 - 0 2024-02-10T08:24:37.406 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:24:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:24:37] "GET /metrics HTTP/1.1" 200 175802 "" "Prometheus/2.33.4" 2024-02-10T08:24:37.729 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:24:37.729 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:24:37.729 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:24:37.729 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:24:37.730 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:24:37.730 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:24:37.730 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:24:37.730 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:24:37.730 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-10T08:24:37.730 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-10T08:24:37.730 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-10T08:24:37.730 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-10T08:24:37.730 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-10T08:24:37.731 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-10T08:24:37.731 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-10T08:24:37.731 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-10T08:24:37.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:36.690554+0000 mgr.y (mgr.14505) 299 : cluster [DBG] pgmap v356: 158 pgs: 158 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 839 B/s rd, 0 op/s 2024-02-10T08:24:37.906 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:36.815984+0000 osd.5 (osd.5) 81 : cluster [DBG] 6.11 scrub starts 2024-02-10T08:24:37.906 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:36.822082+0000 osd.5 (osd.5) 82 : cluster [DBG] 6.11 scrub ok 2024-02-10T08:24:37.906 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:36.831860+0000 osd.0 (osd.0) 88 : cluster [DBG] 6.10 scrub starts 2024-02-10T08:24:37.906 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:36.840414+0000 osd.0 (osd.0) 89 : cluster [DBG] 6.10 scrub ok 2024-02-10T08:24:37.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:36.690554+0000 mgr.y (mgr.14505) 299 : cluster [DBG] pgmap v356: 158 pgs: 158 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 839 B/s rd, 0 op/s 2024-02-10T08:24:37.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:36.815984+0000 osd.5 (osd.5) 81 : cluster [DBG] 6.11 scrub starts 2024-02-10T08:24:37.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:36.822082+0000 osd.5 (osd.5) 82 : cluster [DBG] 6.11 scrub ok 2024-02-10T08:24:37.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:36.831860+0000 osd.0 (osd.0) 88 : cluster [DBG] 6.10 scrub starts 2024-02-10T08:24:37.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:36.840414+0000 osd.0 (osd.0) 89 : cluster [DBG] 6.10 scrub ok 2024-02-10T08:24:38.040 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:24:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:24:38.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:36.690554+0000 mgr.y (mgr.14505) 299 : cluster [DBG] pgmap v356: 158 pgs: 158 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 839 B/s rd, 0 op/s 2024-02-10T08:24:38.041 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:36.815984+0000 osd.5 (osd.5) 81 : cluster [DBG] 6.11 scrub starts 2024-02-10T08:24:38.041 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:36.822082+0000 osd.5 (osd.5) 82 : cluster [DBG] 6.11 scrub ok 2024-02-10T08:24:38.041 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:36.831860+0000 osd.0 (osd.0) 88 : cluster [DBG] 6.10 scrub starts 2024-02-10T08:24:38.041 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:36.840414+0000 osd.0 (osd.0) 89 : cluster [DBG] 6.10 scrub ok 2024-02-10T08:24:38.329 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 1 16 3575 3559 222.276 222.438 0.00414152 0.00448479 2024-02-10T08:24:38.551 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:24:38.554 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:38.554 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:24:38.655 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:24:38.697 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:38.728 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:24:38.732 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:38.732 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:24:38.798 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:37.831954+0000 osd.5 (osd.5) 83 : cluster [DBG] 6.a scrub starts 2024-02-10T08:24:38.798 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:37.842342+0000 osd.5 (osd.5) 84 : cluster [DBG] 6.a scrub ok 2024-02-10T08:24:38.798 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:37.881685+0000 osd.2 (osd.2) 77 : cluster [DBG] 5.b scrub starts 2024-02-10T08:24:38.798 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:37.884426+0000 osd.2 (osd.2) 78 : cluster [DBG] 5.b scrub ok 2024-02-10T08:24:38.798 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:37.904970+0000 osd.5 (osd.5) 85 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:24:38.799 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:37.905023+0000 osd.5 (osd.5) 86 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:24:38.799 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:24:37.906482+0000 mgr.y (mgr.14505) 300 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:24:38.833 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:24:38.876 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:38.905 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:24:38.911 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:38.911 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:24:39.012 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:24:39.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:37.831954+0000 osd.5 (osd.5) 83 : cluster [DBG] 6.a scrub starts 2024-02-10T08:24:39.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:37.842342+0000 osd.5 (osd.5) 84 : cluster [DBG] 6.a scrub ok 2024-02-10T08:24:39.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:37.881685+0000 osd.2 (osd.2) 77 : cluster [DBG] 5.b scrub starts 2024-02-10T08:24:39.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:37.884426+0000 osd.2 (osd.2) 78 : cluster [DBG] 5.b scrub ok 2024-02-10T08:24:39.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:37.904970+0000 osd.5 (osd.5) 85 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:24:39.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:37.905023+0000 osd.5 (osd.5) 86 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:24:39.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:24:37.906482+0000 mgr.y (mgr.14505) 300 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:24:39.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:38.501418+0000 osd.1 (osd.1) 90 : cluster [DBG] 2.6 scrub starts 2024-02-10T08:24:39.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:38.505727+0000 osd.1 (osd.1) 91 : cluster [DBG] 2.6 scrub ok 2024-02-10T08:24:39.050 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:39.076 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:24:39.078 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:39.079 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:24:39.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:37.831954+0000 osd.5 (osd.5) 83 : cluster [DBG] 6.a scrub starts 2024-02-10T08:24:39.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:37.842342+0000 osd.5 (osd.5) 84 : cluster [DBG] 6.a scrub ok 2024-02-10T08:24:39.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:37.881685+0000 osd.2 (osd.2) 77 : cluster [DBG] 5.b scrub starts 2024-02-10T08:24:39.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:37.884426+0000 osd.2 (osd.2) 78 : cluster [DBG] 5.b scrub ok 2024-02-10T08:24:39.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:37.904970+0000 osd.5 (osd.5) 85 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:24:39.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:37.905023+0000 osd.5 (osd.5) 86 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:24:39.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:24:37.906482+0000 mgr.y (mgr.14505) 300 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:24:39.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:38.501418+0000 osd.1 (osd.1) 90 : cluster [DBG] 2.6 scrub starts 2024-02-10T08:24:39.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:38.505727+0000 osd.1 (osd.1) 91 : cluster [DBG] 2.6 scrub ok 2024-02-10T08:24:39.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:38.501418+0000 osd.1 (osd.1) 90 : cluster [DBG] 2.6 scrub starts 2024-02-10T08:24:39.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:38.505727+0000 osd.1 (osd.1) 91 : cluster [DBG] 2.6 scrub ok 2024-02-10T08:24:39.180 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:24:39.236 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:39.330 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 2 16 6649 6633 207.198 192.125 0.004387 0.00481806 2024-02-10T08:24:39.584 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:24:39.601 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:24:39.604 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:39.605 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:24:39.706 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:24:39.748 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:39.781 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:24:39.783 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:39.784 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:24:39.819 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is unset 2024-02-10T08:24:39.847 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:38.693522+0000 mgr.y (mgr.14505) 301 : cluster [DBG] pgmap v357: 158 pgs: 158 active+clean; 56 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 7.0 MiB/s wr, 112 op/s 2024-02-10T08:24:39.847 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:38.798967+0000 mon.a (mon.0) 1096 : cluster [DBG] osdmap e198: 8 total, 8 up, 8 in 2024-02-10T08:24:39.847 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:38.926080+0000 osd.2 (osd.2) 79 : cluster [DBG] 2.1 scrub starts 2024-02-10T08:24:39.848 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:38.934604+0000 osd.2 (osd.2) 80 : cluster [DBG] 2.1 scrub ok 2024-02-10T08:24:39.848 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:39.046960+0000 osd.7 (osd.7) 89 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:24:39.848 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:39.047010+0000 osd.7 (osd.7) 90 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:24:39.848 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:24:39.276966+0000 mon.b (mon.1) 53 : audit [INF] from='client.? 172.21.15.18:0/2820110298' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:24:39.848 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:24:39.277715+0000 mon.a (mon.0) 1097 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:24:39.848 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:38.693522+0000 mgr.y (mgr.14505) 301 : cluster [DBG] pgmap v357: 158 pgs: 158 active+clean; 56 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 7.0 MiB/s wr, 112 op/s 2024-02-10T08:24:39.848 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:38.798967+0000 mon.a (mon.0) 1096 : cluster [DBG] osdmap e198: 8 total, 8 up, 8 in 2024-02-10T08:24:39.848 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:38.926080+0000 osd.2 (osd.2) 79 : cluster [DBG] 2.1 scrub starts 2024-02-10T08:24:39.848 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:38.934604+0000 osd.2 (osd.2) 80 : cluster [DBG] 2.1 scrub ok 2024-02-10T08:24:39.848 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:39.046960+0000 osd.7 (osd.7) 89 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:24:39.848 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:39.047010+0000 osd.7 (osd.7) 90 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:24:39.848 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:24:39.276966+0000 mon.b (mon.1) 53 : audit [INF] from='client.? 172.21.15.18:0/2820110298' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:24:39.849 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:24:39.277715+0000 mon.a (mon.0) 1097 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:24:39.885 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:24:39.929 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:40.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:38.693522+0000 mgr.y (mgr.14505) 301 : cluster [DBG] pgmap v357: 158 pgs: 158 active+clean; 56 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 7.0 MiB/s wr, 112 op/s 2024-02-10T08:24:40.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:38.798967+0000 mon.a (mon.0) 1096 : cluster [DBG] osdmap e198: 8 total, 8 up, 8 in 2024-02-10T08:24:40.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:38.926080+0000 osd.2 (osd.2) 79 : cluster [DBG] 2.1 scrub starts 2024-02-10T08:24:40.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:38.934604+0000 osd.2 (osd.2) 80 : cluster [DBG] 2.1 scrub ok 2024-02-10T08:24:40.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:39.046960+0000 osd.7 (osd.7) 89 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:24:40.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:39.047010+0000 osd.7 (osd.7) 90 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:24:40.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:24:39.276966+0000 mon.b (mon.1) 53 : audit [INF] from='client.? 172.21.15.18:0/2820110298' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:24:40.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:24:39.277715+0000 mon.a (mon.0) 1097 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:24:40.137 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:24:40.140 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:40.141 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:24:40.241 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:24:40.277 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:40.300 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:24:40.302 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:40.303 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:24:40.330 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 3 16 9637 9621 200.38 186.75 0.0079802 0.00498555 2024-02-10T08:24:40.403 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:24:40.461 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:40.507 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:24:40.513 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:40.513 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:24:40.573 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-10T08:24:40.614 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:24:40.690 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:40.699 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-02-10T08:24:40.699 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:24:41.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:39.795545+0000 mon.a (mon.0) 1098 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-10T08:24:41.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:39.795572+0000 mon.a (mon.0) 1099 : cluster [INF] Cluster is now healthy 2024-02-10T08:24:41.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:24:39.809419+0000 mon.a (mon.0) 1100 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-10T08:24:41.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:39.809484+0000 mon.a (mon.0) 1101 : cluster [DBG] osdmap e199: 8 total, 8 up, 8 in 2024-02-10T08:24:41.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:39.829688+0000 osd.5 (osd.5) 87 : cluster [DBG] 5.15 scrub starts 2024-02-10T08:24:41.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:39.834770+0000 osd.5 (osd.5) 88 : cluster [DBG] 5.15 scrub ok 2024-02-10T08:24:41.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:39.913954+0000 osd.2 (osd.2) 81 : cluster [DBG] 5.d scrub starts 2024-02-10T08:24:41.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:39.917167+0000 osd.2 (osd.2) 82 : cluster [DBG] 5.d scrub ok 2024-02-10T08:24:41.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:39.795545+0000 mon.a (mon.0) 1098 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-10T08:24:41.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:39.795572+0000 mon.a (mon.0) 1099 : cluster [INF] Cluster is now healthy 2024-02-10T08:24:41.158 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:24:39.809419+0000 mon.a (mon.0) 1100 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-10T08:24:41.158 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:39.809484+0000 mon.a (mon.0) 1101 : cluster [DBG] osdmap e199: 8 total, 8 up, 8 in 2024-02-10T08:24:41.158 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:39.829688+0000 osd.5 (osd.5) 87 : cluster [DBG] 5.15 scrub starts 2024-02-10T08:24:41.158 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:39.834770+0000 osd.5 (osd.5) 88 : cluster [DBG] 5.15 scrub ok 2024-02-10T08:24:41.158 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:39.913954+0000 osd.2 (osd.2) 81 : cluster [DBG] 5.d scrub starts 2024-02-10T08:24:41.158 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:39.917167+0000 osd.2 (osd.2) 82 : cluster [DBG] 5.d scrub ok 2024-02-10T08:24:41.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:39.795545+0000 mon.a (mon.0) 1098 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-10T08:24:41.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:39.795572+0000 mon.a (mon.0) 1099 : cluster [INF] Cluster is now healthy 2024-02-10T08:24:41.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:24:39.809419+0000 mon.a (mon.0) 1100 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-10T08:24:41.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:39.809484+0000 mon.a (mon.0) 1101 : cluster [DBG] osdmap e199: 8 total, 8 up, 8 in 2024-02-10T08:24:41.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:39.829688+0000 osd.5 (osd.5) 87 : cluster [DBG] 5.15 scrub starts 2024-02-10T08:24:41.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:39.834770+0000 osd.5 (osd.5) 88 : cluster [DBG] 5.15 scrub ok 2024-02-10T08:24:41.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:39.913954+0000 osd.2 (osd.2) 81 : cluster [DBG] 5.d scrub starts 2024-02-10T08:24:41.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:39.917167+0000 osd.2 (osd.2) 82 : cluster [DBG] 5.d scrub ok 2024-02-10T08:24:41.330 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 4 15 12077 12062 188.424 152.562 0.00656335 0.00529892 2024-02-10T08:24:42.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:40.693915+0000 mgr.y (mgr.14505) 302 : cluster [DBG] pgmap v360: 158 pgs: 158 active+clean; 117 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 19 MiB/s wr, 312 op/s 2024-02-10T08:24:42.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:40.799771+0000 osd.5 (osd.5) 89 : cluster [DBG] 3.2 scrub starts 2024-02-10T08:24:42.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:40.803024+0000 osd.5 (osd.5) 90 : cluster [DBG] 3.2 scrub ok 2024-02-10T08:24:42.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:41.026445+0000 osd.7 (osd.7) 91 : cluster [DBG] 4.0 scrub starts 2024-02-10T08:24:42.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:41.032188+0000 osd.7 (osd.7) 92 : cluster [DBG] 4.0 scrub ok 2024-02-10T08:24:42.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:40.693915+0000 mgr.y (mgr.14505) 302 : cluster [DBG] pgmap v360: 158 pgs: 158 active+clean; 117 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 19 MiB/s wr, 312 op/s 2024-02-10T08:24:42.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:40.799771+0000 osd.5 (osd.5) 89 : cluster [DBG] 3.2 scrub starts 2024-02-10T08:24:42.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:40.803024+0000 osd.5 (osd.5) 90 : cluster [DBG] 3.2 scrub ok 2024-02-10T08:24:42.158 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:41.026445+0000 osd.7 (osd.7) 91 : cluster [DBG] 4.0 scrub starts 2024-02-10T08:24:42.158 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:41.032188+0000 osd.7 (osd.7) 92 : cluster [DBG] 4.0 scrub ok 2024-02-10T08:24:42.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:41 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:40.693915+0000 mgr.y (mgr.14505) 302 : cluster [DBG] pgmap v360: 158 pgs: 158 active+clean; 117 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 19 MiB/s wr, 312 op/s 2024-02-10T08:24:42.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:41 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:40.799771+0000 osd.5 (osd.5) 89 : cluster [DBG] 3.2 scrub starts 2024-02-10T08:24:42.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:41 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:40.803024+0000 osd.5 (osd.5) 90 : cluster [DBG] 3.2 scrub ok 2024-02-10T08:24:42.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:41 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:41.026445+0000 osd.7 (osd.7) 91 : cluster [DBG] 4.0 scrub starts 2024-02-10T08:24:42.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:41 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:41.032188+0000 osd.7 (osd.7) 92 : cluster [DBG] 4.0 scrub ok 2024-02-10T08:24:42.330 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 5 16 14907 14891 186.099 176.812 0.00395076 0.00536682 2024-02-10T08:24:42.605 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:24:42.608 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:42.609 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:24:42.709 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:24:42.762 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:42.907 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:41.796283+0000 osd.0 (osd.0) 90 : cluster [DBG] 5.3 scrub starts 2024-02-10T08:24:42.907 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:41.799633+0000 osd.0 (osd.0) 91 : cluster [DBG] 5.3 scrub ok 2024-02-10T08:24:42.908 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:41.796283+0000 osd.0 (osd.0) 90 : cluster [DBG] 5.3 scrub starts 2024-02-10T08:24:42.908 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:41.799633+0000 osd.0 (osd.0) 91 : cluster [DBG] 5.3 scrub ok 2024-02-10T08:24:43.124 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:24:43.137 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:43.138 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:24:43.139 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.3 dump_blocked_ops 2024-02-10T08:24:43.169 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:24:43.239 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:24:43.272 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:41.796283+0000 osd.0 (osd.0) 90 : cluster [DBG] 5.3 scrub starts 2024-02-10T08:24:43.272 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:41.799633+0000 osd.0 (osd.0) 91 : cluster [DBG] 5.3 scrub ok 2024-02-10T08:24:43.275 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:43.303 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:24:43.306 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:43.306 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:24:43.331 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 6 16 17377 17361 180.788 154.375 0.00475923 0.00552567 2024-02-10T08:24:43.407 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:24:43.444 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:43.471 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:24:43.474 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:43.474 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:24:43.575 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:24:43.625 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:43.677 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:24:43.681 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:43.682 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:24:43.783 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:24:43.823 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:43.836 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:42.695182+0000 mgr.y (mgr.14505) 303 : cluster [DBG] pgmap v361: 158 pgs: 158 active+clean; 757 MiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 1.4 KiB/s rd, 107 MiB/s wr, 1.71k op/s 2024-02-10T08:24:43.836 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:42.817258+0000 osd.0 (osd.0) 92 : cluster [DBG] 4.3 deep-scrub starts 2024-02-10T08:24:43.837 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:42.695182+0000 mgr.y (mgr.14505) 303 : cluster [DBG] pgmap v361: 158 pgs: 158 active+clean; 757 MiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 1.4 KiB/s rd, 107 MiB/s wr, 1.71k op/s 2024-02-10T08:24:43.837 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:42.817258+0000 osd.0 (osd.0) 92 : cluster [DBG] 4.3 deep-scrub starts 2024-02-10T08:24:43.837 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:42.826431+0000 osd.0 (osd.0) 93 : cluster [DBG] 4.3 deep-scrub ok 2024-02-10T08:24:43.837 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:43.026618+0000 osd.7 (osd.7) 93 : cluster [DBG] 6.1b scrub starts 2024-02-10T08:24:43.837 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:43.055473+0000 osd.7 (osd.7) 94 : cluster [DBG] 6.1b scrub ok 2024-02-10T08:24:43.837 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:43.492982+0000 osd.1 (osd.1) 92 : cluster [DBG] 4.2 scrub starts 2024-02-10T08:24:43.837 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:43.501063+0000 osd.1 (osd.1) 93 : cluster [DBG] 4.2 scrub ok 2024-02-10T08:24:43.850 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:24:43.854 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:43.855 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:24:43.956 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:24:44.018 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:44.057 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd set noscrub 2024-02-10T08:24:44.102 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:24:44.120 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:44.121 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:42.826431+0000 osd.0 (osd.0) 93 : cluster [DBG] 4.3 deep-scrub ok 2024-02-10T08:24:44.121 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:43.026618+0000 osd.7 (osd.7) 93 : cluster [DBG] 6.1b scrub starts 2024-02-10T08:24:44.121 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:43.055473+0000 osd.7 (osd.7) 94 : cluster [DBG] 6.1b scrub ok 2024-02-10T08:24:44.121 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:43.492982+0000 osd.1 (osd.1) 92 : cluster [DBG] 4.2 scrub starts 2024-02-10T08:24:44.121 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:43.501063+0000 osd.1 (osd.1) 93 : cluster [DBG] 4.2 scrub ok 2024-02-10T08:24:44.122 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:24:44.193 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:24:44.202 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-02-10T08:24:44.222 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:24:44.263 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:43 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:42.695182+0000 mgr.y (mgr.14505) 303 : cluster [DBG] pgmap v361: 158 pgs: 158 active+clean; 757 MiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 1.4 KiB/s rd, 107 MiB/s wr, 1.71k op/s 2024-02-10T08:24:44.263 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:43 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:42.817258+0000 osd.0 (osd.0) 92 : cluster [DBG] 4.3 deep-scrub starts 2024-02-10T08:24:44.263 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:43 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:42.826431+0000 osd.0 (osd.0) 93 : cluster [DBG] 4.3 deep-scrub ok 2024-02-10T08:24:44.263 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:43 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:43.026618+0000 osd.7 (osd.7) 93 : cluster [DBG] 6.1b scrub starts 2024-02-10T08:24:44.263 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:43 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:43.055473+0000 osd.7 (osd.7) 94 : cluster [DBG] 6.1b scrub ok 2024-02-10T08:24:44.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:43 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:43.492982+0000 osd.1 (osd.1) 92 : cluster [DBG] 4.2 scrub starts 2024-02-10T08:24:44.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:43 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:43.501063+0000 osd.1 (osd.1) 93 : cluster [DBG] 4.2 scrub ok 2024-02-10T08:24:44.267 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:44.298 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:24:44.304 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:44.305 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:24:44.331 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 7 16 19430 19414 173.268 128.312 0.00747149 0.00576491 2024-02-10T08:24:44.405 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:24:44.449 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:44.476 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:24:44.478 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:44.478 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:24:44.579 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:24:44.621 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:44.643 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:24:44.645 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:44.645 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:24:44.746 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:24:44.805 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:45.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:44 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:24:44.166141+0000 mgr.y (mgr.14505) 304 : audit [DBG] from='client.24920 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-10T08:24:45.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:24:44.166141+0000 mgr.y (mgr.14505) 304 : audit [DBG] from='client.24920 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-10T08:24:45.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:24:44.166141+0000 mgr.y (mgr.14505) 304 : audit [DBG] from='client.24920 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-10T08:24:45.332 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 8 16 20576 20560 160.564 71.625 0.00229918 0.00588963 2024-02-10T08:24:45.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:44.695845+0000 mgr.y (mgr.14505) 305 : cluster [DBG] pgmap v362: 158 pgs: 158 active+clean; 1016 MiB data, 5.1 GiB used, 710 GiB / 715 GiB avail; 1.2 KiB/s rd, 127 MiB/s wr, 2.03k op/s 2024-02-10T08:24:45.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:45.189714+0000 osd.4 (osd.4) 10 : cluster [DBG] 6.e scrub starts 2024-02-10T08:24:45.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:45.194611+0000 osd.4 (osd.4) 11 : cluster [DBG] 6.e scrub ok 2024-02-10T08:24:45.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:44.695845+0000 mgr.y (mgr.14505) 305 : cluster [DBG] pgmap v362: 158 pgs: 158 active+clean; 1016 MiB data, 5.1 GiB used, 710 GiB / 715 GiB avail; 1.2 KiB/s rd, 127 MiB/s wr, 2.03k op/s 2024-02-10T08:24:45.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:45.189714+0000 osd.4 (osd.4) 10 : cluster [DBG] 6.e scrub starts 2024-02-10T08:24:45.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:45.194611+0000 osd.4 (osd.4) 11 : cluster [DBG] 6.e scrub ok 2024-02-10T08:24:46.106 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:24:46.115 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:46.115 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:24:46.120 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:24:46.137 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":361,"stamp":"2024-02-10T08:24:42.694601+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":793908900,"num_objects":12306,"num_object_clones":0,"num_object_copies":36918,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12306,"num_whiteouts":0,"num_read":1155,"num_read_kb":907,"num_write":12542,"num_write_kb":775337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":77,"num_bytes_recovered":1898,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12620,"ondisk_log_size":12620,"up":474,"acting":474,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":474,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":4098032,"kb_used_data":1641776,"kb_used_omap":0,"kb_used_meta":2456191,"kb_avail":745863184,"statfs":{"total":767960285184,"available":763763900416,"internally_reserved":0,"allocated":1681178624,"data_stored":1673803774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":972,"internal_metadata":2515139636},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":793903104,"num_objects":12114,"num_object_clones":0,"num_object_copies":36342,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12114,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":12114,"num_write_kb":775296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.103409"},"pg_stats":[{"pgid":"6.29","version":"76'2","reported_seq":102,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.803275+0000","last_change":"2024-02-10T08:22:00.615760+0000","last_active":"2024-02-10T08:24:38.803275+0000","last_peered":"2024-02-10T08:24:38.803275+0000","last_clean":"2024-02-10T08:24:38.803275+0000","last_became_active":"2024-02-10T08:22:00.615454+0000","last_became_peered":"2024-02-10T08:22:00.615454+0000","last_unstale":"2024-02-10T08:24:38.803275+0000","last_undegraded":"2024-02-10T08:24:38.803275+0000","last_fullsized":"2024-02-10T08:24:38.803275+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":6,"last_scrub":"76'2","last_scrub_stamp":"2024-02-10T08:19:28.458129+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2024-02-10T08:18:08.680038+0000","last_clean_scrub_stamp":"2024-02-10T08:19:28.458129+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,0],"acting":[7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":163,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-02-10T08:24:32.874982+0000","last_change":"2024-02-10T08:22:00.578467+0000","last_active":"2024-02-10T08:24:32.874982+0000","last_peered":"2024-02-10T08:24:32.874982+0000","last_clean":"2024-02-10T08:24:32.874982+0000","last_became_active":"2024-02-10T08:22:00.578118+0000","last_became_peered":"2024-02-10T08:22:00.578118+0000","last_unstale":"2024-02-10T08:24:32.874982+0000","last_undegraded":"2024-02-10T08:24:32.874982+0000","last_fullsized":"2024-02-10T08:24:32.874982+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:24.199920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:19:24.199920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,6],"acting":[2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":84,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.807451+0000","last_change":"2024-02-10T08:23:15.079750+0000","last_active":"2024-02-10T08:24:38.807451+0000","last_peered":"2024-02-10T08:24:38.807451+0000","last_clean":"2024-02-10T08:24:38.807451+0000","last_became_active":"2024-02-10T08:23:15.079456+0000","last_became_peered":"2024-02-10T08:23:15.079456+0000","last_unstale":"2024-02-10T08:24:38.807451+0000","last_undegraded":"2024-02-10T08:24:38.807451+0000","last_fullsized":"2024-02-10T08:24:38.807451+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:45.379932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:45.379932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":84,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.803243+0000","last_change":"2024-02-10T08:23:15.077790+0000","last_active":"2024-02-10T08:24:38.803243+0000","last_peered":"2024-02-10T08:24:38.803243+0000","last_clean":"2024-02-10T08:24:38.803243+0000","last_became_active":"2024-02-10T08:23:15.077457+0000","last_became_peered":"2024-02-10T08:23:15.077457+0000","last_unstale":"2024-02-10T08:24:38.803243+0000","last_undegraded":"2024-02-10T08:24:38.803243+0000","last_fullsized":"2024-02-10T08:24:38.803243+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:47.116727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:47.116727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":174,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.807589+0000","last_change":"2024-02-10T08:24:18.647687+0000","last_active":"2024-02-10T08:24:38.807589+0000","last_peered":"2024-02-10T08:24:38.807589+0000","last_clean":"2024-02-10T08:24:38.807589+0000","last_became_active":"2024-02-10T08:24:18.647304+0000","last_became_peered":"2024-02-10T08:24:18.647304+0000","last_unstale":"2024-02-10T08:24:38.807589+0000","last_undegraded":"2024-02-10T08:24:38.807589+0000","last_fullsized":"2024-02-10T08:24:38.807589+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:08.316685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:11.750537+0000","last_clean_scrub_stamp":"2024-02-10T08:20:08.316685+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1],"acting":[6,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":175,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.800207+0000","last_change":"2024-02-10T08:23:15.065300+0000","last_active":"2024-02-10T08:24:38.800207+0000","last_peered":"2024-02-10T08:24:38.800207+0000","last_clean":"2024-02-10T08:24:38.800207+0000","last_became_active":"2024-02-10T08:23:15.064896+0000","last_became_peered":"2024-02-10T08:23:15.064896+0000","last_unstale":"2024-02-10T08:24:38.800207+0000","last_undegraded":"2024-02-10T08:24:38.800207+0000","last_fullsized":"2024-02-10T08:24:38.800207+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:09.785096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:20:09.785096+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":17,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-02-10T08:24:32.760357+0000","last_change":"2024-02-10T08:24:18.645834+0000","last_active":"2024-02-10T08:24:32.760357+0000","last_peered":"2024-02-10T08:24:32.760357+0000","last_clean":"2024-02-10T08:24:32.760357+0000","last_became_active":"2024-02-10T08:24:18.645377+0000","last_became_peered":"2024-02-10T08:24:18.645377+0000","last_unstale":"2024-02-10T08:24:32.760357+0000","last_undegraded":"2024-02-10T08:24:32.760357+0000","last_fullsized":"2024-02-10T08:24:32.760357+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:22.272986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:20:22.272986+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":75,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.807161+0000","last_change":"2024-02-10T08:22:00.600550+0000","last_active":"2024-02-10T08:24:38.807161+0000","last_peered":"2024-02-10T08:24:38.807161+0000","last_clean":"2024-02-10T08:24:38.807161+0000","last_became_active":"2024-02-10T08:22:00.600200+0000","last_became_peered":"2024-02-10T08:22:00.600200+0000","last_unstale":"2024-02-10T08:24:38.807161+0000","last_undegraded":"2024-02-10T08:24:38.807161+0000","last_fullsized":"2024-02-10T08:24:38.807161+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:22.216312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:19:22.216312+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1],"acting":[6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":75,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.803275+0000","last_change":"2024-02-10T08:22:00.584830+0000","last_active":"2024-02-10T08:24:38.803275+0000","last_peered":"2024-02-10T08:24:38.803275+0000","last_clean":"2024-02-10T08:24:38.803275+0000","last_became_active":"2024-02-10T08:22:00.584555+0000","last_became_peered":"2024-02-10T08:22:00.584555+0000","last_unstale":"2024-02-10T08:24:38.803275+0000","last_undegraded":"2024-02-10T08:24:38.803275+0000","last_fullsized":"2024-02-10T08:24:38.803275+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:25.568342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:19:25.568342+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":75,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.801963+0000","last_change":"2024-02-10T08:22:00.586057+0000","last_active":"2024-02-10T08:24:38.801963+0000","last_peered":"2024-02-10T08:24:38.801963+0000","last_clean":"2024-02-10T08:24:38.801963+0000","last_became_active":"2024-02-10T08:22:00.581772+0000","last_became_peered":"2024-02-10T08:22:00.581772+0000","last_unstale":"2024-02-10T08:24:38.801963+0000","last_undegraded":"2024-02-10T08:24:38.801963+0000","last_fullsized":"2024-02-10T08:24:38.801963+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:18.940944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:20:18.940944+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,7],"acting":[1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":77,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.804264+0000","last_change":"2024-02-10T08:23:15.079527+0000","last_active":"2024-02-10T08:24:38.804264+0000","last_peered":"2024-02-10T08:24:38.804264+0000","last_clean":"2024-02-10T08:24:38.804264+0000","last_became_active":"2024-02-10T08:23:15.079180+0000","last_became_peered":"2024-02-10T08:23:15.079180+0000","last_unstale":"2024-02-10T08:24:38.804264+0000","last_undegraded":"2024-02-10T08:24:38.804264+0000","last_fullsized":"2024-02-10T08:24:38.804264+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:01.075886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:19:01.075886+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":130,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-02-10T08:24:35.592581+0000","last_change":"2024-02-10T08:20:46.404906+0000","last_active":"2024-02-10T08:24:35.592581+0000","last_peered":"2024-02-10T08:24:35.592581+0000","last_clean":"2024-02-10T08:24:35.592581+0000","last_became_active":"2024-02-10T08:20:46.404597+0000","last_became_peered":"2024-02-10T08:20:46.404597+0000","last_unstale":"2024-02-10T08:24:35.592581+0000","last_undegraded":"2024-02-10T08:24:35.592581+0000","last_fullsized":"2024-02-10T08:24:35.592581+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:09.941898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:09.941898+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":119,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.805762+0000","last_change":"2024-02-10T08:24:32.044728+0000","last_active":"2024-02-10T08:24:38.805762+0000","last_peered":"2024-02-10T08:24:38.805762+0000","last_clean":"2024-02-10T08:24:38.805762+0000","last_became_active":"2024-02-10T08:23:34.723324+0000","last_became_peered":"2024-02-10T08:23:34.723324+0000","last_unstale":"2024-02-10T08:24:38.805762+0000","last_undegraded":"2024-02-10T08:24:38.805762+0000","last_fullsized":"2024-02-10T08:24:38.805762+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:32.044644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:24:32.044644+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"62'15","reported_seq":128,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-02-10T08:24:32.876509+0000","last_change":"2024-02-10T08:23:34.749805+0000","last_active":"2024-02-10T08:24:32.876509+0000","last_peered":"2024-02-10T08:24:32.876509+0000","last_clean":"2024-02-10T08:24:32.876509+0000","last_became_active":"2024-02-10T08:23:34.706163+0000","last_became_peered":"2024-02-10T08:23:34.706163+0000","last_unstale":"2024-02-10T08:24:32.876509+0000","last_undegraded":"2024-02-10T08:24:32.876509+0000","last_fullsized":"2024-02-10T08:24:32.876509+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'15","last_scrub_stamp":"2024-02-10T08:20:03.330508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:20:03.330508+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":134,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-02-10T08:24:35.593054+0000","last_change":"2024-02-10T08:20:46.405782+0000","last_active":"2024-02-10T08:24:35.593054+0000","last_peered":"2024-02-10T08:24:35.593054+0000","last_clean":"2024-02-10T08:24:35.593054+0000","last_became_active":"2024-02-10T08:20:46.405314+0000","last_became_peered":"2024-02-10T08:20:46.405314+0000","last_unstale":"2024-02-10T08:24:35.593054+0000","last_undegraded":"2024-02-10T08:24:35.593054+0000","last_fullsized":"2024-02-10T08:24:35.593054+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:19.058317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:19.058317+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":159,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.802325+0000","last_change":"2024-02-10T08:20:06.810606+0000","last_active":"2024-02-10T08:24:38.802325+0000","last_peered":"2024-02-10T08:24:38.802325+0000","last_clean":"2024-02-10T08:24:38.802325+0000","last_became_active":"2024-02-10T08:16:56.863353+0000","last_became_peered":"2024-02-10T08:16:56.863353+0000","last_unstale":"2024-02-10T08:24:38.802325+0000","last_undegraded":"2024-02-10T08:24:38.802325+0000","last_fullsized":"2024-02-10T08:24:38.802325+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:06.810521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:20:06.810521+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":50,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.800517+0000","last_change":"2024-02-10T08:23:15.074655+0000","last_active":"2024-02-10T08:24:38.800517+0000","last_peered":"2024-02-10T08:24:38.800517+0000","last_clean":"2024-02-10T08:24:38.800517+0000","last_became_active":"2024-02-10T08:23:15.074301+0000","last_became_peered":"2024-02-10T08:23:15.074301+0000","last_unstale":"2024-02-10T08:24:38.800517+0000","last_undegraded":"2024-02-10T08:24:38.800517+0000","last_fullsized":"2024-02-10T08:24:38.800517+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:28.176344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:19:28.176344+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"62'9","reported_seq":149,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-02-10T08:24:35.592810+0000","last_change":"2024-02-10T08:20:46.405346+0000","last_active":"2024-02-10T08:24:35.592810+0000","last_peered":"2024-02-10T08:24:35.592810+0000","last_clean":"2024-02-10T08:24:35.592810+0000","last_became_active":"2024-02-10T08:20:46.404966+0000","last_became_peered":"2024-02-10T08:20:46.404966+0000","last_unstale":"2024-02-10T08:24:35.592810+0000","last_undegraded":"2024-02-10T08:24:35.592810+0000","last_fullsized":"2024-02-10T08:24:35.592810+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'9","last_scrub_stamp":"2024-02-10T08:18:12.998167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:12.998167+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":165,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.799908+0000","last_change":"2024-02-10T08:23:15.126285+0000","last_active":"2024-02-10T08:24:38.799908+0000","last_peered":"2024-02-10T08:24:38.799908+0000","last_clean":"2024-02-10T08:24:38.799908+0000","last_became_active":"2024-02-10T08:23:15.125955+0000","last_became_peered":"2024-02-10T08:23:15.125955+0000","last_unstale":"2024-02-10T08:24:38.799908+0000","last_undegraded":"2024-02-10T08:24:38.799908+0000","last_fullsized":"2024-02-10T08:24:38.799908+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:09.280825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:20:09.280825+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,2],"acting":[5,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":173,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.804443+0000","last_change":"2024-02-10T08:20:46.407232+0000","last_active":"2024-02-10T08:24:38.804443+0000","last_peered":"2024-02-10T08:24:38.804443+0000","last_clean":"2024-02-10T08:24:38.804443+0000","last_became_active":"2024-02-10T08:20:46.406783+0000","last_became_peered":"2024-02-10T08:20:46.406783+0000","last_unstale":"2024-02-10T08:24:38.804443+0000","last_undegraded":"2024-02-10T08:24:38.804443+0000","last_fullsized":"2024-02-10T08:24:38.804443+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:19.291495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:19:19.291495+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"55'1","reported_seq":169,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.805902+0000","last_change":"2024-02-10T08:20:20.303814+0000","last_active":"2024-02-10T08:24:38.805902+0000","last_peered":"2024-02-10T08:24:38.805902+0000","last_clean":"2024-02-10T08:24:38.805902+0000","last_became_active":"2024-02-10T08:16:52.790462+0000","last_became_peered":"2024-02-10T08:16:52.790462+0000","last_unstale":"2024-02-10T08:24:38.805902+0000","last_undegraded":"2024-02-10T08:24:38.805902+0000","last_fullsized":"2024-02-10T08:24:38.805902+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'1","last_scrub_stamp":"2024-02-10T08:20:20.303730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:20:20.303730+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"62'5","reported_seq":172,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-02-10T08:24:35.593201+0000","last_change":"2024-02-10T08:24:18.649450+0000","last_active":"2024-02-10T08:24:35.593201+0000","last_peered":"2024-02-10T08:24:35.593201+0000","last_clean":"2024-02-10T08:24:35.593201+0000","last_became_active":"2024-02-10T08:24:18.645076+0000","last_became_peered":"2024-02-10T08:24:18.645076+0000","last_unstale":"2024-02-10T08:24:35.593201+0000","last_undegraded":"2024-02-10T08:24:35.593201+0000","last_fullsized":"2024-02-10T08:24:35.593201+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'5","last_scrub_stamp":"2024-02-10T08:19:29.251633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:19:29.251633+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":6,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":47,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.802152+0000","last_change":"2024-02-10T08:23:15.078468+0000","last_active":"2024-02-10T08:24:38.802152+0000","last_peered":"2024-02-10T08:24:38.802152+0000","last_clean":"2024-02-10T08:24:38.802152+0000","last_became_active":"2024-02-10T08:23:15.078168+0000","last_became_peered":"2024-02-10T08:23:15.078168+0000","last_unstale":"2024-02-10T08:24:38.802152+0000","last_undegraded":"2024-02-10T08:24:38.802152+0000","last_fullsized":"2024-02-10T08:24:38.802152+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:00.830869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:20:00.830869+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,2],"acting":[1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":163,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.800085+0000","last_change":"2024-02-10T08:20:32.126091+0000","last_active":"2024-02-10T08:24:38.800085+0000","last_peered":"2024-02-10T08:24:38.800085+0000","last_clean":"2024-02-10T08:24:38.800085+0000","last_became_active":"2024-02-10T08:16:56.864532+0000","last_became_peered":"2024-02-10T08:16:56.864532+0000","last_unstale":"2024-02-10T08:24:38.800085+0000","last_undegraded":"2024-02-10T08:24:38.800085+0000","last_fullsized":"2024-02-10T08:24:38.800085+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:32.126007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:20:32.126007+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":162,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.804901+0000","last_change":"2024-02-10T08:20:02.245653+0000","last_active":"2024-02-10T08:24:38.804901+0000","last_peered":"2024-02-10T08:24:38.804901+0000","last_clean":"2024-02-10T08:24:38.804901+0000","last_became_active":"2024-02-10T08:16:52.787865+0000","last_became_peered":"2024-02-10T08:16:52.787865+0000","last_unstale":"2024-02-10T08:24:38.804901+0000","last_undegraded":"2024-02-10T08:24:38.804901+0000","last_fullsized":"2024-02-10T08:24:38.804901+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:02.245593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:28.028556+0000","last_clean_scrub_stamp":"2024-02-10T08:20:02.245593+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"62'9","reported_seq":151,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-02-10T08:24:35.593114+0000","last_change":"2024-02-10T08:20:46.401585+0000","last_active":"2024-02-10T08:24:35.593114+0000","last_peered":"2024-02-10T08:24:35.593114+0000","last_clean":"2024-02-10T08:24:35.593114+0000","last_became_active":"2024-02-10T08:20:46.401156+0000","last_became_peered":"2024-02-10T08:20:46.401156+0000","last_unstale":"2024-02-10T08:24:35.593114+0000","last_undegraded":"2024-02-10T08:24:35.593114+0000","last_fullsized":"2024-02-10T08:24:35.593114+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'9","last_scrub_stamp":"2024-02-10T08:18:15.012657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:15.012657+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":68,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.807723+0000","last_change":"2024-02-10T08:22:23.526526+0000","last_active":"2024-02-10T08:24:38.807723+0000","last_peered":"2024-02-10T08:24:38.807723+0000","last_clean":"2024-02-10T08:24:38.807723+0000","last_became_active":"2024-02-10T08:22:23.526229+0000","last_became_peered":"2024-02-10T08:22:23.526229+0000","last_unstale":"2024-02-10T08:24:38.807723+0000","last_undegraded":"2024-02-10T08:24:38.807723+0000","last_fullsized":"2024-02-10T08:24:38.807723+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:52.045180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:52.045180+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":136,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-02-10T08:24:35.593203+0000","last_change":"2024-02-10T08:20:46.399318+0000","last_active":"2024-02-10T08:24:35.593203+0000","last_peered":"2024-02-10T08:24:35.593203+0000","last_clean":"2024-02-10T08:24:35.593203+0000","last_became_active":"2024-02-10T08:20:46.398532+0000","last_became_peered":"2024-02-10T08:20:46.398532+0000","last_unstale":"2024-02-10T08:24:35.593203+0000","last_undegraded":"2024-02-10T08:24:35.593203+0000","last_fullsized":"2024-02-10T08:24:35.593203+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:22.000811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:22.000811+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":77,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.804763+0000","last_change":"2024-02-10T08:23:34.729120+0000","last_active":"2024-02-10T08:24:38.804763+0000","last_peered":"2024-02-10T08:24:38.804763+0000","last_clean":"2024-02-10T08:24:38.804763+0000","last_became_active":"2024-02-10T08:23:34.728772+0000","last_became_peered":"2024-02-10T08:23:34.728772+0000","last_unstale":"2024-02-10T08:24:38.804763+0000","last_undegraded":"2024-02-10T08:24:38.804763+0000","last_fullsized":"2024-02-10T08:24:38.804763+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:04.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:20:04.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1d","version":"74'17","reported_seq":144,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.803949+0000","last_change":"2024-02-10T08:24:29.544596+0000","last_active":"2024-02-10T08:24:38.803949+0000","last_peered":"2024-02-10T08:24:38.803949+0000","last_clean":"2024-02-10T08:24:38.803949+0000","last_became_active":"2024-02-10T08:23:34.710443+0000","last_became_peered":"2024-02-10T08:23:34.710443+0000","last_unstale":"2024-02-10T08:24:38.803949+0000","last_undegraded":"2024-02-10T08:24:38.803949+0000","last_fullsized":"2024-02-10T08:24:38.803949+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'17","last_scrub_stamp":"2024-02-10T08:24:29.544422+0000","last_deep_scrub":"74'17","last_deep_scrub_stamp":"2024-02-10T08:18:02.949298+0000","last_clean_scrub_stamp":"2024-02-10T08:24:29.544422+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,6],"acting":[1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":134,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-02-10T08:24:35.593489+0000","last_change":"2024-02-10T08:20:46.403697+0000","last_active":"2024-02-10T08:24:35.593489+0000","last_peered":"2024-02-10T08:24:35.593489+0000","last_clean":"2024-02-10T08:24:35.593489+0000","last_became_active":"2024-02-10T08:20:46.403378+0000","last_became_peered":"2024-02-10T08:20:46.403378+0000","last_unstale":"2024-02-10T08:24:35.593489+0000","last_undegraded":"2024-02-10T08:24:35.593489+0000","last_fullsized":"2024-02-10T08:24:35.593489+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:26.952496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:26.952496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":169,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.804125+0000","last_change":"2024-02-10T08:20:46.407843+0000","last_active":"2024-02-10T08:24:38.804125+0000","last_peered":"2024-02-10T08:24:38.804125+0000","last_clean":"2024-02-10T08:24:38.804125+0000","last_became_active":"2024-02-10T08:20:46.407373+0000","last_became_peered":"2024-02-10T08:20:46.407373+0000","last_unstale":"2024-02-10T08:24:38.804125+0000","last_undegraded":"2024-02-10T08:24:38.804125+0000","last_fullsized":"2024-02-10T08:24:38.804125+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:38.230210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:38.230210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":177,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.807329+0000","last_change":"2024-02-10T08:20:46.396617+0000","last_active":"2024-02-10T08:24:38.807329+0000","last_peered":"2024-02-10T08:24:38.807329+0000","last_clean":"2024-02-10T08:24:38.807329+0000","last_became_active":"2024-02-10T08:20:46.396303+0000","last_became_peered":"2024-02-10T08:20:46.396303+0000","last_unstale":"2024-02-10T08:24:38.807329+0000","last_undegraded":"2024-02-10T08:24:38.807329+0000","last_fullsized":"2024-02-10T08:24:38.807329+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:10.370746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:10.370746+0000","last_clean_scrub_stamp":"2024-02-10T08:19:10.370746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1c","version":"62'15","reported_seq":214,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-02-10T08:24:32.876235+0000","last_change":"2024-02-10T08:23:34.751643+0000","last_active":"2024-02-10T08:24:32.876235+0000","last_peered":"2024-02-10T08:24:32.876235+0000","last_clean":"2024-02-10T08:24:32.876235+0000","last_became_active":"2024-02-10T08:23:34.712669+0000","last_became_peered":"2024-02-10T08:23:34.712669+0000","last_unstale":"2024-02-10T08:24:32.876235+0000","last_undegraded":"2024-02-10T08:24:32.876235+0000","last_fullsized":"2024-02-10T08:24:32.876235+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'15","last_scrub_stamp":"2024-02-10T08:20:30.939526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:20:30.939526+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4],"acting":[2,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":167,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.804208+0000","last_change":"2024-02-10T08:20:46.408820+0000","last_active":"2024-02-10T08:24:38.804208+0000","last_peered":"2024-02-10T08:24:38.804208+0000","last_clean":"2024-02-10T08:24:38.804208+0000","last_became_active":"2024-02-10T08:20:46.408504+0000","last_became_peered":"2024-02-10T08:20:46.408504+0000","last_unstale":"2024-02-10T08:24:38.804208+0000","last_undegraded":"2024-02-10T08:24:38.804208+0000","last_fullsized":"2024-02-10T08:24:38.804208+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:22.104988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:22.104988+0000","last_clean_scrub_stamp":"2024-02-10T08:18:22.104988+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":161,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-02-10T08:24:35.817848+0000","last_change":"2024-02-10T08:24:35.817815+0000","last_active":"2024-02-10T08:24:35.817848+0000","last_peered":"2024-02-10T08:24:35.817848+0000","last_clean":"2024-02-10T08:24:35.817848+0000","last_became_active":"2024-02-10T08:16:56.863348+0000","last_became_peered":"2024-02-10T08:16:56.863348+0000","last_unstale":"2024-02-10T08:24:35.817848+0000","last_undegraded":"2024-02-10T08:24:35.817848+0000","last_fullsized":"2024-02-10T08:24:35.817848+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:35.817703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:24:35.817703+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":77,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.806812+0000","last_change":"2024-02-10T08:23:34.718956+0000","last_active":"2024-02-10T08:24:38.806812+0000","last_peered":"2024-02-10T08:24:38.806812+0000","last_clean":"2024-02-10T08:24:38.806812+0000","last_became_active":"2024-02-10T08:23:34.718640+0000","last_became_peered":"2024-02-10T08:23:34.718640+0000","last_unstale":"2024-02-10T08:24:38.806812+0000","last_undegraded":"2024-02-10T08:24:38.806812+0000","last_fullsized":"2024-02-10T08:24:38.806812+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:14.238991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:20:14.238991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2],"acting":[6,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"62'11","reported_seq":179,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.807637+0000","last_change":"2024-02-10T08:19:29.497168+0000","last_active":"2024-02-10T08:24:38.807637+0000","last_peered":"2024-02-10T08:24:38.807637+0000","last_clean":"2024-02-10T08:24:38.807637+0000","last_became_active":"2024-02-10T08:16:54.852665+0000","last_became_peered":"2024-02-10T08:16:54.852665+0000","last_unstale":"2024-02-10T08:24:38.807637+0000","last_undegraded":"2024-02-10T08:24:38.807637+0000","last_fullsized":"2024-02-10T08:24:38.807637+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'11","last_scrub_stamp":"2024-02-10T08:19:29.497086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:19:29.497086+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"87'2","reported_seq":158,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.805167+0000","last_change":"2024-02-10T08:19:29.207609+0000","last_active":"2024-02-10T08:24:38.805167+0000","last_peered":"2024-02-10T08:24:38.805167+0000","last_clean":"2024-02-10T08:24:38.805167+0000","last_became_active":"2024-02-10T08:16:58.859047+0000","last_became_peered":"2024-02-10T08:16:58.859047+0000","last_unstale":"2024-02-10T08:24:38.805167+0000","last_undegraded":"2024-02-10T08:24:38.805167+0000","last_fullsized":"2024-02-10T08:24:38.805167+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'2","last_scrub_stamp":"2024-02-10T08:19:29.207531+0000","last_deep_scrub":"87'2","last_deep_scrub_stamp":"2024-02-10T08:19:29.207531+0000","last_clean_scrub_stamp":"2024-02-10T08:19:29.207531+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"111'11","reported_seq":284,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-10T08:24:39.819596+0000","last_change":"2024-02-10T08:24:35.067134+0000","last_active":"2024-02-10T08:24:39.819596+0000","last_peered":"2024-02-10T08:24:39.819596+0000","last_clean":"2024-02-10T08:24:39.819596+0000","last_became_active":"2024-02-10T08:20:46.402663+0000","last_became_peered":"2024-02-10T08:20:46.402663+0000","last_unstale":"2024-02-10T08:24:39.819596+0000","last_undegraded":"2024-02-10T08:24:39.819596+0000","last_fullsized":"2024-02-10T08:24:39.819596+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'11","last_scrub_stamp":"2024-02-10T08:24:35.067055+0000","last_deep_scrub":"82'9","last_deep_scrub_stamp":"2024-02-10T08:18:36.323217+0000","last_clean_scrub_stamp":"2024-02-10T08:24:35.067055+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":177,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.800221+0000","last_change":"2024-02-10T08:24:35.866229+0000","last_active":"2024-02-10T08:24:38.800221+0000","last_peered":"2024-02-10T08:24:38.800221+0000","last_clean":"2024-02-10T08:24:38.800221+0000","last_became_active":"2024-02-10T08:20:46.392466+0000","last_became_peered":"2024-02-10T08:20:46.392466+0000","last_unstale":"2024-02-10T08:24:38.800221+0000","last_undegraded":"2024-02-10T08:24:38.800221+0000","last_fullsized":"2024-02-10T08:24:38.800221+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:35.866138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:30.422800+0000","last_clean_scrub_stamp":"2024-02-10T08:24:35.866138+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"74'15","reported_seq":204,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-02-10T08:24:34.836951+0000","last_change":"2024-02-10T08:24:34.836917+0000","last_active":"2024-02-10T08:24:34.836951+0000","last_peered":"2024-02-10T08:24:34.836951+0000","last_clean":"2024-02-10T08:24:34.836951+0000","last_became_active":"2024-02-10T08:23:15.079324+0000","last_became_peered":"2024-02-10T08:23:15.079324+0000","last_unstale":"2024-02-10T08:24:34.836951+0000","last_undegraded":"2024-02-10T08:24:34.836951+0000","last_fullsized":"2024-02-10T08:24:34.836951+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'15","last_scrub_stamp":"2024-02-10T08:24:34.836829+0000","last_deep_scrub":"74'15","last_deep_scrub_stamp":"2024-02-10T08:17:57.637346+0000","last_clean_scrub_stamp":"2024-02-10T08:24:34.836829+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":59,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.806810+0000","last_change":"2024-02-10T08:23:34.710627+0000","last_active":"2024-02-10T08:24:38.806810+0000","last_peered":"2024-02-10T08:24:38.806810+0000","last_clean":"2024-02-10T08:24:38.806810+0000","last_became_active":"2024-02-10T08:23:34.710302+0000","last_became_peered":"2024-02-10T08:23:34.710302+0000","last_unstale":"2024-02-10T08:24:38.806810+0000","last_undegraded":"2024-02-10T08:24:38.806810+0000","last_fullsized":"2024-02-10T08:24:38.806810+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:15.204475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:20:15.204475+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4],"acting":[6,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":173,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.803542+0000","last_change":"2024-02-10T08:20:46.400144+0000","last_active":"2024-02-10T08:24:38.803542+0000","last_peered":"2024-02-10T08:24:38.803542+0000","last_clean":"2024-02-10T08:24:38.803542+0000","last_became_active":"2024-02-10T08:20:46.399838+0000","last_became_peered":"2024-02-10T08:20:46.399838+0000","last_unstale":"2024-02-10T08:24:38.803542+0000","last_undegraded":"2024-02-10T08:24:38.803542+0000","last_fullsized":"2024-02-10T08:24:38.803542+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:06.357048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:19:06.357048+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":162,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.807498+0000","last_change":"2024-02-10T08:19:22.466525+0000","last_active":"2024-02-10T08:24:38.807498+0000","last_peered":"2024-02-10T08:24:38.807498+0000","last_clean":"2024-02-10T08:24:38.807498+0000","last_became_active":"2024-02-10T08:16:52.788629+0000","last_became_peered":"2024-02-10T08:16:52.788629+0000","last_unstale":"2024-02-10T08:24:38.807498+0000","last_undegraded":"2024-02-10T08:24:38.807498+0000","last_fullsized":"2024-02-10T08:24:38.807498+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:22.466453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:19:22.466453+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"62'11","reported_seq":99,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.804210+0000","last_change":"2024-02-10T08:22:23.526546+0000","last_active":"2024-02-10T08:24:38.804210+0000","last_peered":"2024-02-10T08:24:38.804210+0000","last_clean":"2024-02-10T08:24:38.804210+0000","last_became_active":"2024-02-10T08:22:23.526198+0000","last_became_peered":"2024-02-10T08:22:23.526198+0000","last_unstale":"2024-02-10T08:24:38.804210+0000","last_undegraded":"2024-02-10T08:24:38.804210+0000","last_fullsized":"2024-02-10T08:24:38.804210+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'11","last_scrub_stamp":"2024-02-10T08:19:32.166830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:19:32.166830+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":171,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.804577+0000","last_change":"2024-02-10T08:20:46.399860+0000","last_active":"2024-02-10T08:24:38.804577+0000","last_peered":"2024-02-10T08:24:38.804577+0000","last_clean":"2024-02-10T08:24:38.804577+0000","last_became_active":"2024-02-10T08:20:46.399515+0000","last_became_peered":"2024-02-10T08:20:46.399515+0000","last_unstale":"2024-02-10T08:24:38.804577+0000","last_undegraded":"2024-02-10T08:24:38.804577+0000","last_fullsized":"2024-02-10T08:24:38.804577+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:27.276490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:27.276490+0000","last_clean_scrub_stamp":"2024-02-10T08:19:27.276490+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":168,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.806883+0000","last_change":"2024-02-10T08:20:46.397801+0000","last_active":"2024-02-10T08:24:38.806883+0000","last_peered":"2024-02-10T08:24:38.806883+0000","last_clean":"2024-02-10T08:24:38.806883+0000","last_became_active":"2024-02-10T08:20:46.397495+0000","last_became_peered":"2024-02-10T08:20:46.397495+0000","last_unstale":"2024-02-10T08:24:38.806883+0000","last_undegraded":"2024-02-10T08:24:38.806883+0000","last_fullsized":"2024-02-10T08:24:38.806883+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:34.381329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:34.381329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":167,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.800111+0000","last_change":"2024-02-10T08:20:24.226131+0000","last_active":"2024-02-10T08:24:38.800111+0000","last_peered":"2024-02-10T08:24:38.800111+0000","last_clean":"2024-02-10T08:24:38.800111+0000","last_became_active":"2024-02-10T08:16:52.788704+0000","last_became_peered":"2024-02-10T08:16:52.788704+0000","last_unstale":"2024-02-10T08:24:38.800111+0000","last_undegraded":"2024-02-10T08:24:38.800111+0000","last_fullsized":"2024-02-10T08:24:38.800111+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:24.226061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:20:24.226061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"62'4","reported_seq":86,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.802883+0000","last_change":"2024-02-10T08:22:23.523381+0000","last_active":"2024-02-10T08:24:38.802883+0000","last_peered":"2024-02-10T08:24:38.802883+0000","last_clean":"2024-02-10T08:24:38.802883+0000","last_became_active":"2024-02-10T08:22:23.522936+0000","last_became_peered":"2024-02-10T08:22:23.522936+0000","last_unstale":"2024-02-10T08:24:38.802883+0000","last_undegraded":"2024-02-10T08:24:38.802883+0000","last_fullsized":"2024-02-10T08:24:38.802883+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'4","last_scrub_stamp":"2024-02-10T08:18:50.134690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:50.134690+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,6],"acting":[1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":77,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.800033+0000","last_change":"2024-02-10T08:24:36.822214+0000","last_active":"2024-02-10T08:24:38.800033+0000","last_peered":"2024-02-10T08:24:38.800033+0000","last_clean":"2024-02-10T08:24:38.800033+0000","last_became_active":"2024-02-10T08:23:34.710130+0000","last_became_peered":"2024-02-10T08:23:34.710130+0000","last_unstale":"2024-02-10T08:24:38.800033+0000","last_undegraded":"2024-02-10T08:24:38.800033+0000","last_fullsized":"2024-02-10T08:24:38.800033+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:36.822086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:24:36.822086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":168,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.802791+0000","last_change":"2024-02-10T08:23:15.078988+0000","last_active":"2024-02-10T08:24:38.802791+0000","last_peered":"2024-02-10T08:24:38.802791+0000","last_clean":"2024-02-10T08:24:38.802791+0000","last_became_active":"2024-02-10T08:23:15.078667+0000","last_became_peered":"2024-02-10T08:23:15.078667+0000","last_unstale":"2024-02-10T08:24:38.802791+0000","last_undegraded":"2024-02-10T08:24:38.802791+0000","last_fullsized":"2024-02-10T08:24:38.802791+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:07.754900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:20:07.754900+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":174,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.803778+0000","last_change":"2024-02-10T08:23:15.079985+0000","last_active":"2024-02-10T08:24:38.803778+0000","last_peered":"2024-02-10T08:24:38.803778+0000","last_clean":"2024-02-10T08:24:38.803778+0000","last_became_active":"2024-02-10T08:23:15.079635+0000","last_became_peered":"2024-02-10T08:23:15.079635+0000","last_unstale":"2024-02-10T08:24:38.803778+0000","last_undegraded":"2024-02-10T08:24:38.803778+0000","last_fullsized":"2024-02-10T08:24:38.803778+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:03.782136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:20:03.782136+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[1,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"62'11","reported_seq":179,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-02-10T08:24:35.593071+0000","last_change":"2024-02-10T08:20:46.396436+0000","last_active":"2024-02-10T08:24:35.593071+0000","last_peered":"2024-02-10T08:24:35.593071+0000","last_clean":"2024-02-10T08:24:35.593071+0000","last_became_active":"2024-02-10T08:20:46.396130+0000","last_became_peered":"2024-02-10T08:20:46.396130+0000","last_unstale":"2024-02-10T08:24:35.593071+0000","last_undegraded":"2024-02-10T08:24:35.593071+0000","last_fullsized":"2024-02-10T08:24:35.593071+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'11","last_scrub_stamp":"2024-02-10T08:18:17.029517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:17.029517+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":159,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-02-10T08:24:36.840489+0000","last_change":"2024-02-10T08:24:36.840489+0000","last_active":"2024-02-10T08:24:36.840489+0000","last_peered":"2024-02-10T08:24:36.840489+0000","last_clean":"2024-02-10T08:24:36.840489+0000","last_became_active":"2024-02-10T08:16:58.861031+0000","last_became_peered":"2024-02-10T08:16:58.861031+0000","last_unstale":"2024-02-10T08:24:36.840489+0000","last_undegraded":"2024-02-10T08:24:36.840489+0000","last_fullsized":"2024-02-10T08:24:36.840489+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:36.840418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:24:36.840418+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":66,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-02-10T08:24:32.760814+0000","last_change":"2024-02-10T08:22:23.544616+0000","last_active":"2024-02-10T08:24:32.760814+0000","last_peered":"2024-02-10T08:24:32.760814+0000","last_clean":"2024-02-10T08:24:32.760814+0000","last_became_active":"2024-02-10T08:22:23.544158+0000","last_became_peered":"2024-02-10T08:22:23.544158+0000","last_unstale":"2024-02-10T08:24:32.760814+0000","last_undegraded":"2024-02-10T08:24:32.760814+0000","last_fullsized":"2024-02-10T08:24:32.760814+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:33.201370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:20:33.201370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":169,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.806979+0000","last_change":"2024-02-10T08:20:32.148461+0000","last_active":"2024-02-10T08:24:38.806979+0000","last_peered":"2024-02-10T08:24:38.806979+0000","last_clean":"2024-02-10T08:24:38.806979+0000","last_became_active":"2024-02-10T08:16:52.786213+0000","last_became_peered":"2024-02-10T08:16:52.786213+0000","last_unstale":"2024-02-10T08:24:38.806979+0000","last_undegraded":"2024-02-10T08:24:38.806979+0000","last_fullsized":"2024-02-10T08:24:38.806979+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:32.148377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:20:32.148377+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"62'9","reported_seq":182,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.802629+0000","last_change":"2024-02-10T08:20:27.597657+0000","last_active":"2024-02-10T08:24:38.802629+0000","last_peered":"2024-02-10T08:24:38.802629+0000","last_clean":"2024-02-10T08:24:38.802629+0000","last_became_active":"2024-02-10T08:16:54.851971+0000","last_became_peered":"2024-02-10T08:16:54.851971+0000","last_unstale":"2024-02-10T08:24:38.802629+0000","last_undegraded":"2024-02-10T08:24:38.802629+0000","last_fullsized":"2024-02-10T08:24:38.802629+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'9","last_scrub_stamp":"2024-02-10T08:20:27.597547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:20:27.597547+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":134,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-02-10T08:24:35.593486+0000","last_change":"2024-02-10T08:20:46.396485+0000","last_active":"2024-02-10T08:24:35.593486+0000","last_peered":"2024-02-10T08:24:35.593486+0000","last_clean":"2024-02-10T08:24:35.593486+0000","last_became_active":"2024-02-10T08:20:46.395788+0000","last_became_peered":"2024-02-10T08:20:46.395788+0000","last_unstale":"2024-02-10T08:24:35.593486+0000","last_undegraded":"2024-02-10T08:24:35.593486+0000","last_fullsized":"2024-02-10T08:24:35.593486+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:22.955823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:22.955823+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"165'10","reported_seq":128,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-10T08:24:39.815116+0000","last_change":"2024-02-10T08:23:15.344871+0000","last_active":"2024-02-10T08:24:39.815116+0000","last_peered":"2024-02-10T08:24:39.815116+0000","last_clean":"2024-02-10T08:24:39.815116+0000","last_became_active":"2024-02-10T08:23:15.080370+0000","last_became_peered":"2024-02-10T08:23:15.080370+0000","last_unstale":"2024-02-10T08:24:39.815116+0000","last_undegraded":"2024-02-10T08:24:39.815116+0000","last_fullsized":"2024-02-10T08:24:39.815116+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'8","last_scrub_stamp":"2024-02-10T08:20:10.351918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:20:10.351918+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,1],"acting":[7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":118,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-02-10T08:24:35.593267+0000","last_change":"2024-02-10T08:23:34.717367+0000","last_active":"2024-02-10T08:24:35.593267+0000","last_peered":"2024-02-10T08:24:35.593267+0000","last_clean":"2024-02-10T08:24:35.593267+0000","last_became_active":"2024-02-10T08:23:34.717015+0000","last_became_peered":"2024-02-10T08:23:34.717015+0000","last_unstale":"2024-02-10T08:24:35.593267+0000","last_undegraded":"2024-02-10T08:24:35.593267+0000","last_fullsized":"2024-02-10T08:24:35.593267+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:08.548458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:19:08.548458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"62'9","reported_seq":176,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.800340+0000","last_change":"2024-02-10T08:20:11.315987+0000","last_active":"2024-02-10T08:24:38.800340+0000","last_peered":"2024-02-10T08:24:38.800340+0000","last_clean":"2024-02-10T08:24:38.800340+0000","last_became_active":"2024-02-10T08:16:55.204734+0000","last_became_peered":"2024-02-10T08:16:55.204734+0000","last_unstale":"2024-02-10T08:24:38.800340+0000","last_undegraded":"2024-02-10T08:24:38.800340+0000","last_fullsized":"2024-02-10T08:24:38.800340+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'9","last_scrub_stamp":"2024-02-10T08:20:11.315903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:20:11.315903+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":47,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.805755+0000","last_change":"2024-02-10T08:23:15.068153+0000","last_active":"2024-02-10T08:24:38.805755+0000","last_peered":"2024-02-10T08:24:38.805755+0000","last_clean":"2024-02-10T08:24:38.805755+0000","last_became_active":"2024-02-10T08:23:15.067821+0000","last_became_peered":"2024-02-10T08:23:15.067821+0000","last_unstale":"2024-02-10T08:24:38.805755+0000","last_undegraded":"2024-02-10T08:24:38.805755+0000","last_fullsized":"2024-02-10T08:24:38.805755+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:26.027321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:05.662947+0000","last_clean_scrub_stamp":"2024-02-10T08:20:26.027321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"191'10","reported_seq":279,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-10T08:24:39.835070+0000","last_change":"2024-02-10T08:24:39.834882+0000","last_active":"2024-02-10T08:24:39.835070+0000","last_peered":"2024-02-10T08:24:39.835070+0000","last_clean":"2024-02-10T08:24:39.835070+0000","last_became_active":"2024-02-10T08:24:18.648087+0000","last_became_peered":"2024-02-10T08:24:18.648087+0000","last_unstale":"2024-02-10T08:24:39.835070+0000","last_undegraded":"2024-02-10T08:24:39.835070+0000","last_fullsized":"2024-02-10T08:24:39.835070+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"191'10","last_scrub_stamp":"2024-02-10T08:24:39.834778+0000","last_deep_scrub":"89'9","last_deep_scrub_stamp":"2024-02-10T08:19:33.299671+0000","last_clean_scrub_stamp":"2024-02-10T08:24:39.834778+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":162,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.800168+0000","last_change":"2024-02-10T08:20:04.285337+0000","last_active":"2024-02-10T08:24:38.800168+0000","last_peered":"2024-02-10T08:24:38.800168+0000","last_clean":"2024-02-10T08:24:38.800168+0000","last_became_active":"2024-02-10T08:16:52.789834+0000","last_became_peered":"2024-02-10T08:16:52.789834+0000","last_unstale":"2024-02-10T08:24:38.800168+0000","last_undegraded":"2024-02-10T08:24:38.800168+0000","last_fullsized":"2024-02-10T08:24:38.800168+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:04.285243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:20:04.285243+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"62'10","reported_seq":95,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.802613+0000","last_change":"2024-02-10T08:22:23.534468+0000","last_active":"2024-02-10T08:24:38.802613+0000","last_peered":"2024-02-10T08:24:38.802613+0000","last_clean":"2024-02-10T08:24:38.802613+0000","last_became_active":"2024-02-10T08:22:23.534081+0000","last_became_peered":"2024-02-10T08:22:23.534081+0000","last_unstale":"2024-02-10T08:24:38.802613+0000","last_undegraded":"2024-02-10T08:24:38.802613+0000","last_fullsized":"2024-02-10T08:24:38.802613+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'10","last_scrub_stamp":"2024-02-10T08:19:09.007376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:19:09.007376+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":171,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.805652+0000","last_change":"2024-02-10T08:24:33.098417+0000","last_active":"2024-02-10T08:24:38.805652+0000","last_peered":"2024-02-10T08:24:38.805652+0000","last_clean":"2024-02-10T08:24:38.805652+0000","last_became_active":"2024-02-10T08:20:46.398903+0000","last_became_peered":"2024-02-10T08:20:46.398903+0000","last_unstale":"2024-02-10T08:24:38.805652+0000","last_undegraded":"2024-02-10T08:24:38.805652+0000","last_fullsized":"2024-02-10T08:24:38.805652+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:33.098313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:24:33.098313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":158,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.800035+0000","last_change":"2024-02-10T08:20:10.278739+0000","last_active":"2024-02-10T08:24:38.800035+0000","last_peered":"2024-02-10T08:24:38.800035+0000","last_clean":"2024-02-10T08:24:38.800035+0000","last_became_active":"2024-02-10T08:16:56.863948+0000","last_became_peered":"2024-02-10T08:16:56.863948+0000","last_unstale":"2024-02-10T08:24:38.800035+0000","last_undegraded":"2024-02-10T08:24:38.800035+0000","last_fullsized":"2024-02-10T08:24:38.800035+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:10.278678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:20:10.278678+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":211,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.806953+0000","last_change":"2024-02-10T08:24:30.076419+0000","last_active":"2024-02-10T08:24:38.806953+0000","last_peered":"2024-02-10T08:24:38.806953+0000","last_clean":"2024-02-10T08:24:38.806953+0000","last_became_active":"2024-02-10T08:20:46.400758+0000","last_became_peered":"2024-02-10T08:20:46.400758+0000","last_unstale":"2024-02-10T08:24:38.806953+0000","last_undegraded":"2024-02-10T08:24:38.806953+0000","last_fullsized":"2024-02-10T08:24:38.806953+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:30.076335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:24:30.076335+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"62'6","reported_seq":106,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.806123+0000","last_change":"2024-02-10T08:23:15.341991+0000","last_active":"2024-02-10T08:24:38.806123+0000","last_peered":"2024-02-10T08:24:38.806123+0000","last_clean":"2024-02-10T08:24:38.806123+0000","last_became_active":"2024-02-10T08:23:15.079382+0000","last_became_peered":"2024-02-10T08:23:15.079382+0000","last_unstale":"2024-02-10T08:24:38.806123+0000","last_undegraded":"2024-02-10T08:24:38.806123+0000","last_fullsized":"2024-02-10T08:24:38.806123+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'6","last_scrub_stamp":"2024-02-10T08:20:08.360881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:20:08.360881+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":170,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-02-10T08:24:32.875928+0000","last_change":"2024-02-10T08:24:28.926064+0000","last_active":"2024-02-10T08:24:32.875928+0000","last_peered":"2024-02-10T08:24:32.875928+0000","last_clean":"2024-02-10T08:24:32.875928+0000","last_became_active":"2024-02-10T08:20:46.407214+0000","last_became_peered":"2024-02-10T08:20:46.407214+0000","last_unstale":"2024-02-10T08:24:32.875928+0000","last_undegraded":"2024-02-10T08:24:32.875928+0000","last_fullsized":"2024-02-10T08:24:32.875928+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:28.925986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:24:28.925986+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":77,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.803885+0000","last_change":"2024-02-10T08:23:34.730646+0000","last_active":"2024-02-10T08:24:38.803885+0000","last_peered":"2024-02-10T08:24:38.803885+0000","last_clean":"2024-02-10T08:24:38.803885+0000","last_became_active":"2024-02-10T08:23:34.730121+0000","last_became_peered":"2024-02-10T08:23:34.730121+0000","last_unstale":"2024-02-10T08:24:38.803885+0000","last_undegraded":"2024-02-10T08:24:38.803885+0000","last_fullsized":"2024-02-10T08:24:38.803885+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:07.352745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:20:07.352745+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"55'1","reported_seq":167,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-02-10T08:24:32.875133+0000","last_change":"2024-02-10T08:19:59.845452+0000","last_active":"2024-02-10T08:24:32.875133+0000","last_peered":"2024-02-10T08:24:32.875133+0000","last_clean":"2024-02-10T08:24:32.875133+0000","last_became_active":"2024-02-10T08:16:52.782734+0000","last_became_peered":"2024-02-10T08:16:52.782734+0000","last_unstale":"2024-02-10T08:24:32.875133+0000","last_undegraded":"2024-02-10T08:24:32.875133+0000","last_fullsized":"2024-02-10T08:24:32.875133+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'1","last_scrub_stamp":"2024-02-10T08:19:59.845351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:19:59.845351+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"62'9","reported_seq":77,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.805859+0000","last_change":"2024-02-10T08:23:35.071311+0000","last_active":"2024-02-10T08:24:38.805859+0000","last_peered":"2024-02-10T08:24:38.805859+0000","last_clean":"2024-02-10T08:24:38.805859+0000","last_became_active":"2024-02-10T08:23:34.719714+0000","last_became_peered":"2024-02-10T08:23:34.719714+0000","last_unstale":"2024-02-10T08:24:38.805859+0000","last_undegraded":"2024-02-10T08:24:38.805859+0000","last_fullsized":"2024-02-10T08:24:38.805859+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'9","last_scrub_stamp":"2024-02-10T08:19:14.500766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:19:14.500766+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.5","version":"199'958","reported_seq":974,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-10T08:24:42.505214+0000","last_change":"2024-02-10T08:24:21.599844+0000","last_active":"2024-02-10T08:24:42.505214+0000","last_peered":"2024-02-10T08:24:42.505214+0000","last_clean":"2024-02-10T08:24:42.505214+0000","last_became_active":"2024-02-10T08:24:21.599552+0000","last_became_peered":"2024-02-10T08:24:21.599552+0000","last_unstale":"2024-02-10T08:24:42.505214+0000","last_undegraded":"2024-02-10T08:24:42.505214+0000","last_fullsized":"2024-02-10T08:24:42.505214+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:20.584872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:24:20.584872+0000","last_clean_scrub_stamp":"2024-02-10T08:24:20.584872+0000","log_size":958,"ondisk_log_size":958,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":62783488,"num_objects":958,"num_object_clones":0,"num_object_copies":2874,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":958,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":958,"num_write_kb":61312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":68,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.804688+0000","last_change":"2024-02-10T08:22:23.528605+0000","last_active":"2024-02-10T08:24:38.804688+0000","last_peered":"2024-02-10T08:24:38.804688+0000","last_clean":"2024-02-10T08:24:38.804688+0000","last_became_active":"2024-02-10T08:22:23.528310+0000","last_became_peered":"2024-02-10T08:22:23.528310+0000","last_unstale":"2024-02-10T08:24:38.804688+0000","last_undegraded":"2024-02-10T08:24:38.804688+0000","last_fullsized":"2024-02-10T08:24:38.804688+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:18.128487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:20:18.128487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"55'2","reported_seq":145,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-02-10T08:24:35.593686+0000","last_change":"2024-02-10T08:20:46.398750+0000","last_active":"2024-02-10T08:24:35.593686+0000","last_peered":"2024-02-10T08:24:35.593686+0000","last_clean":"2024-02-10T08:24:35.593686+0000","last_became_active":"2024-02-10T08:20:46.398441+0000","last_became_peered":"2024-02-10T08:20:46.398441+0000","last_unstale":"2024-02-10T08:24:35.593686+0000","last_undegraded":"2024-02-10T08:24:35.593686+0000","last_fullsized":"2024-02-10T08:24:35.593686+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'2","last_scrub_stamp":"2024-02-10T08:18:03.916322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:03.916322+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"82'17","reported_seq":187,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-02-10T08:24:35.592636+0000","last_change":"2024-02-10T08:23:15.516523+0000","last_active":"2024-02-10T08:24:35.592636+0000","last_peered":"2024-02-10T08:24:35.592636+0000","last_clean":"2024-02-10T08:24:35.592636+0000","last_became_active":"2024-02-10T08:23:15.126133+0000","last_became_peered":"2024-02-10T08:23:15.126133+0000","last_unstale":"2024-02-10T08:24:35.592636+0000","last_undegraded":"2024-02-10T08:24:35.592636+0000","last_fullsized":"2024-02-10T08:24:35.592636+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'17","last_scrub_stamp":"2024-02-10T08:18:21.015873+0000","last_deep_scrub":"82'17","last_deep_scrub_stamp":"2024-02-10T08:18:21.015873+0000","last_clean_scrub_stamp":"2024-02-10T08:18:21.015873+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6],"acting":[4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":157,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-02-10T08:24:32.875230+0000","last_change":"2024-02-10T08:19:26.899727+0000","last_active":"2024-02-10T08:24:32.875230+0000","last_peered":"2024-02-10T08:24:32.875230+0000","last_clean":"2024-02-10T08:24:32.875230+0000","last_became_active":"2024-02-10T08:16:56.860850+0000","last_became_peered":"2024-02-10T08:16:56.860850+0000","last_unstale":"2024-02-10T08:24:32.875230+0000","last_undegraded":"2024-02-10T08:24:32.875230+0000","last_fullsized":"2024-02-10T08:24:32.875230+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:26.899655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:19:26.899655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"197'146","reported_seq":160,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.032200+0000","last_change":"2024-02-10T08:24:21.601824+0000","last_active":"2024-02-10T08:24:38.032200+0000","last_peered":"2024-02-10T08:24:38.032200+0000","last_clean":"2024-02-10T08:24:38.032200+0000","last_became_active":"2024-02-10T08:24:21.601429+0000","last_became_peered":"2024-02-10T08:24:21.601429+0000","last_unstale":"2024-02-10T08:24:38.032200+0000","last_undegraded":"2024-02-10T08:24:38.032200+0000","last_fullsized":"2024-02-10T08:24:38.032200+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:20.584872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:24:20.584872+0000","last_clean_scrub_stamp":"2024-02-10T08:24:20.584872+0000","log_size":146,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":9568256,"num_objects":146,"num_object_clones":0,"num_object_copies":438,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":146,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":9344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4],"acting":[0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":168,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-02-10T08:24:32.759646+0000","last_change":"2024-02-10T08:21:58.554585+0000","last_active":"2024-02-10T08:24:32.759646+0000","last_peered":"2024-02-10T08:24:32.759646+0000","last_clean":"2024-02-10T08:24:32.759646+0000","last_became_active":"2024-02-10T08:21:58.554263+0000","last_became_peered":"2024-02-10T08:21:58.554263+0000","last_unstale":"2024-02-10T08:24:32.759646+0000","last_undegraded":"2024-02-10T08:24:32.759646+0000","last_fullsized":"2024-02-10T08:24:32.759646+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:18.940944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:20:18.940944+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":163,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.802273+0000","last_change":"2024-02-10T08:20:08.744631+0000","last_active":"2024-02-10T08:24:38.802273+0000","last_peered":"2024-02-10T08:24:38.802273+0000","last_clean":"2024-02-10T08:24:38.802273+0000","last_became_active":"2024-02-10T08:16:52.789354+0000","last_became_peered":"2024-02-10T08:16:52.789354+0000","last_unstale":"2024-02-10T08:24:38.802273+0000","last_undegraded":"2024-02-10T08:24:38.802273+0000","last_fullsized":"2024-02-10T08:24:38.802273+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:08.744567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:20:08.744567+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"62'10","reported_seq":186,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.802713+0000","last_change":"2024-02-10T08:20:46.408860+0000","last_active":"2024-02-10T08:24:38.802713+0000","last_peered":"2024-02-10T08:24:38.802713+0000","last_clean":"2024-02-10T08:24:38.802713+0000","last_became_active":"2024-02-10T08:20:46.408495+0000","last_became_peered":"2024-02-10T08:20:46.408495+0000","last_unstale":"2024-02-10T08:24:38.802713+0000","last_undegraded":"2024-02-10T08:24:38.802713+0000","last_fullsized":"2024-02-10T08:24:38.802713+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'10","last_scrub_stamp":"2024-02-10T08:18:26.189127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:26.189127+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"62'8","reported_seq":257,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-02-10T08:24:35.908246+0000","last_change":"2024-02-10T08:20:08.840019+0000","last_active":"2024-02-10T08:24:35.908246+0000","last_peered":"2024-02-10T08:24:35.908246+0000","last_clean":"2024-02-10T08:24:35.908246+0000","last_became_active":"2024-02-10T08:16:56.862677+0000","last_became_peered":"2024-02-10T08:16:56.862677+0000","last_unstale":"2024-02-10T08:24:35.908246+0000","last_undegraded":"2024-02-10T08:24:35.908246+0000","last_fullsized":"2024-02-10T08:24:35.908246+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'8","last_scrub_stamp":"2024-02-10T08:20:08.839890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:20:08.839890+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"199'981","reported_seq":996,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-10T08:24:42.499727+0000","last_change":"2024-02-10T08:24:21.600654+0000","last_active":"2024-02-10T08:24:42.499727+0000","last_peered":"2024-02-10T08:24:42.499727+0000","last_clean":"2024-02-10T08:24:42.499727+0000","last_became_active":"2024-02-10T08:24:21.600373+0000","last_became_peered":"2024-02-10T08:24:21.600373+0000","last_unstale":"2024-02-10T08:24:42.499727+0000","last_undegraded":"2024-02-10T08:24:42.499727+0000","last_fullsized":"2024-02-10T08:24:42.499727+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:20.584872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:24:20.584872+0000","last_clean_scrub_stamp":"2024-02-10T08:24:20.584872+0000","log_size":981,"ondisk_log_size":981,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":64290816,"num_objects":981,"num_object_clones":0,"num_object_copies":2943,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":981,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":981,"num_write_kb":62784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":176,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-02-10T08:24:35.593397+0000","last_change":"2024-02-10T08:23:34.716839+0000","last_active":"2024-02-10T08:24:35.593397+0000","last_peered":"2024-02-10T08:24:35.593397+0000","last_clean":"2024-02-10T08:24:35.593397+0000","last_became_active":"2024-02-10T08:23:34.716482+0000","last_became_peered":"2024-02-10T08:23:34.716482+0000","last_unstale":"2024-02-10T08:24:35.593397+0000","last_undegraded":"2024-02-10T08:24:35.593397+0000","last_fullsized":"2024-02-10T08:24:35.593397+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:47.116727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:47.116727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":162,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.800280+0000","last_change":"2024-02-10T08:20:07.299708+0000","last_active":"2024-02-10T08:24:38.800280+0000","last_peered":"2024-02-10T08:24:38.800280+0000","last_clean":"2024-02-10T08:24:38.800280+0000","last_became_active":"2024-02-10T08:16:52.791027+0000","last_became_peered":"2024-02-10T08:16:52.791027+0000","last_unstale":"2024-02-10T08:24:38.800280+0000","last_undegraded":"2024-02-10T08:24:38.800280+0000","last_fullsized":"2024-02-10T08:24:38.800280+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:07.299640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:20:07.299640+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"173'29","reported_seq":339,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-10T08:24:39.816519+0000","last_change":"2024-02-10T08:23:35.581967+0000","last_active":"2024-02-10T08:24:39.816519+0000","last_peered":"2024-02-10T08:24:39.816519+0000","last_clean":"2024-02-10T08:24:39.816519+0000","last_became_active":"2024-02-10T08:23:34.709222+0000","last_became_peered":"2024-02-10T08:23:34.709222+0000","last_unstale":"2024-02-10T08:24:39.816519+0000","last_undegraded":"2024-02-10T08:24:39.816519+0000","last_fullsized":"2024-02-10T08:24:39.816519+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'28","last_scrub_stamp":"2024-02-10T08:20:16.678147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:20:16.678147+0000","log_size":29,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":48,"num_read_kb":33,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":358,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":118,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.803647+0000","last_change":"2024-02-10T08:23:15.082129+0000","last_active":"2024-02-10T08:24:38.803647+0000","last_peered":"2024-02-10T08:24:38.803647+0000","last_clean":"2024-02-10T08:24:38.803647+0000","last_became_active":"2024-02-10T08:23:15.081822+0000","last_became_peered":"2024-02-10T08:23:15.081822+0000","last_unstale":"2024-02-10T08:24:38.803647+0000","last_undegraded":"2024-02-10T08:24:38.803647+0000","last_fullsized":"2024-02-10T08:24:38.803647+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:51.533128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:51.533128+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,6],"acting":[1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"198'504","reported_seq":518,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:39.687514+0000","last_change":"2024-02-10T08:24:21.599451+0000","last_active":"2024-02-10T08:24:39.687514+0000","last_peered":"2024-02-10T08:24:39.687514+0000","last_clean":"2024-02-10T08:24:39.687514+0000","last_became_active":"2024-02-10T08:24:21.599126+0000","last_became_peered":"2024-02-10T08:24:21.599126+0000","last_unstale":"2024-02-10T08:24:39.687514+0000","last_undegraded":"2024-02-10T08:24:39.687514+0000","last_fullsized":"2024-02-10T08:24:39.687514+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:20.584872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:24:20.584872+0000","last_clean_scrub_stamp":"2024-02-10T08:24:20.584872+0000","log_size":504,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":33030144,"num_objects":504,"num_object_clones":0,"num_object_copies":1512,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":504,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":504,"num_write_kb":32256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":165,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.805844+0000","last_change":"2024-02-10T08:21:58.550001+0000","last_active":"2024-02-10T08:24:38.805844+0000","last_peered":"2024-02-10T08:24:38.805844+0000","last_clean":"2024-02-10T08:24:38.805844+0000","last_became_active":"2024-02-10T08:21:58.549733+0000","last_became_peered":"2024-02-10T08:21:58.549733+0000","last_unstale":"2024-02-10T08:24:38.805844+0000","last_undegraded":"2024-02-10T08:24:38.805844+0000","last_fullsized":"2024-02-10T08:24:38.805844+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:08.316685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:11.750537+0000","last_clean_scrub_stamp":"2024-02-10T08:20:08.316685+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"63'5","reported_seq":627,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-10T08:24:40.998308+0000","last_change":"2024-02-10T08:19:12.466527+0000","last_active":"2024-02-10T08:24:40.998308+0000","last_peered":"2024-02-10T08:24:40.998308+0000","last_clean":"2024-02-10T08:24:40.998308+0000","last_became_active":"2024-02-10T08:16:52.780989+0000","last_became_peered":"2024-02-10T08:16:52.780989+0000","last_unstale":"2024-02-10T08:24:40.998308+0000","last_undegraded":"2024-02-10T08:24:40.998308+0000","last_fullsized":"2024-02-10T08:24:40.998308+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'5","last_scrub_stamp":"2024-02-10T08:19:12.466451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:19:12.466451+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":461,"num_read_kb":456,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":170,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-02-10T08:24:32.876623+0000","last_change":"2024-02-10T08:23:34.705413+0000","last_active":"2024-02-10T08:24:32.876623+0000","last_peered":"2024-02-10T08:24:32.876623+0000","last_clean":"2024-02-10T08:24:32.876623+0000","last_became_active":"2024-02-10T08:23:34.705014+0000","last_became_peered":"2024-02-10T08:23:34.705014+0000","last_unstale":"2024-02-10T08:24:32.876623+0000","last_undegraded":"2024-02-10T08:24:32.876623+0000","last_fullsized":"2024-02-10T08:24:32.876623+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:13.900264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:11.681169+0000","last_clean_scrub_stamp":"2024-02-10T08:19:13.900264+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"62'13","reported_seq":49,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.803800+0000","last_change":"2024-02-10T08:23:35.682739+0000","last_active":"2024-02-10T08:24:38.803800+0000","last_peered":"2024-02-10T08:24:38.803800+0000","last_clean":"2024-02-10T08:24:38.803800+0000","last_became_active":"2024-02-10T08:23:34.729593+0000","last_became_peered":"2024-02-10T08:23:34.729593+0000","last_unstale":"2024-02-10T08:24:38.803800+0000","last_undegraded":"2024-02-10T08:24:38.803800+0000","last_fullsized":"2024-02-10T08:24:38.803800+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'13","last_scrub_stamp":"2024-02-10T08:20:13.727564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:20:13.727564+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":18,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":157,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-02-10T08:24:32.877583+0000","last_change":"2024-02-10T08:20:00.886336+0000","last_active":"2024-02-10T08:24:32.877583+0000","last_peered":"2024-02-10T08:24:32.877583+0000","last_clean":"2024-02-10T08:24:32.877583+0000","last_became_active":"2024-02-10T08:16:56.857856+0000","last_became_peered":"2024-02-10T08:16:56.857856+0000","last_unstale":"2024-02-10T08:24:32.877583+0000","last_undegraded":"2024-02-10T08:24:32.877583+0000","last_fullsized":"2024-02-10T08:24:32.877583+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:00.886232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:20:00.886232+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"199'964","reported_seq":980,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-10T08:24:42.499938+0000","last_change":"2024-02-10T08:24:21.600043+0000","last_active":"2024-02-10T08:24:42.499938+0000","last_peered":"2024-02-10T08:24:42.499938+0000","last_clean":"2024-02-10T08:24:42.499938+0000","last_became_active":"2024-02-10T08:24:21.599733+0000","last_became_peered":"2024-02-10T08:24:21.599733+0000","last_unstale":"2024-02-10T08:24:42.499938+0000","last_undegraded":"2024-02-10T08:24:42.499938+0000","last_fullsized":"2024-02-10T08:24:42.499938+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:20.584872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:24:20.584872+0000","last_clean_scrub_stamp":"2024-02-10T08:24:20.584872+0000","log_size":964,"ondisk_log_size":964,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":63176704,"num_objects":964,"num_object_clones":0,"num_object_copies":2892,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":964,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":964,"num_write_kb":61696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,3],"acting":[6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":175,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.800914+0000","last_change":"2024-02-10T08:21:58.560883+0000","last_active":"2024-02-10T08:24:38.800914+0000","last_peered":"2024-02-10T08:24:38.800914+0000","last_clean":"2024-02-10T08:24:38.800914+0000","last_became_active":"2024-02-10T08:21:58.560646+0000","last_became_peered":"2024-02-10T08:21:58.560646+0000","last_unstale":"2024-02-10T08:24:38.800914+0000","last_undegraded":"2024-02-10T08:24:38.800914+0000","last_fullsized":"2024-02-10T08:24:38.800914+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:45.379932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:45.379932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":82,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-10T08:24:40.803085+0000","last_change":"2024-02-10T08:24:40.803085+0000","last_active":"2024-02-10T08:24:40.803085+0000","last_peered":"2024-02-10T08:24:40.803085+0000","last_clean":"2024-02-10T08:24:40.803085+0000","last_became_active":"2024-02-10T08:23:34.712122+0000","last_became_peered":"2024-02-10T08:23:34.712122+0000","last_unstale":"2024-02-10T08:24:40.803085+0000","last_undegraded":"2024-02-10T08:24:40.803085+0000","last_fullsized":"2024-02-10T08:24:40.803085+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:40.803027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:24:40.803027+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,4],"acting":[5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":162,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.800535+0000","last_change":"2024-02-10T08:19:34.283969+0000","last_active":"2024-02-10T08:24:38.800535+0000","last_peered":"2024-02-10T08:24:38.800535+0000","last_clean":"2024-02-10T08:24:38.800535+0000","last_became_active":"2024-02-10T08:16:52.788767+0000","last_became_peered":"2024-02-10T08:16:52.788767+0000","last_unstale":"2024-02-10T08:24:38.800535+0000","last_undegraded":"2024-02-10T08:24:38.800535+0000","last_fullsized":"2024-02-10T08:24:38.800535+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:34.283900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:19:34.283900+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":182,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.803330+0000","last_change":"2024-02-10T08:23:34.718189+0000","last_active":"2024-02-10T08:24:38.803330+0000","last_peered":"2024-02-10T08:24:38.803330+0000","last_clean":"2024-02-10T08:24:38.803330+0000","last_became_active":"2024-02-10T08:23:34.717837+0000","last_became_peered":"2024-02-10T08:23:34.717837+0000","last_unstale":"2024-02-10T08:24:38.803330+0000","last_undegraded":"2024-02-10T08:24:38.803330+0000","last_fullsized":"2024-02-10T08:24:38.803330+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:06.252449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:14:44.584370+0000","last_clean_scrub_stamp":"2024-02-10T08:20:06.252449+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"62'14","reported_seq":197,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.807528+0000","last_change":"2024-02-10T08:24:34.101557+0000","last_active":"2024-02-10T08:24:38.807528+0000","last_peered":"2024-02-10T08:24:38.807528+0000","last_clean":"2024-02-10T08:24:38.807528+0000","last_became_active":"2024-02-10T08:20:46.401981+0000","last_became_peered":"2024-02-10T08:20:46.401981+0000","last_unstale":"2024-02-10T08:24:38.807528+0000","last_undegraded":"2024-02-10T08:24:38.807528+0000","last_fullsized":"2024-02-10T08:24:38.807528+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'14","last_scrub_stamp":"2024-02-10T08:24:34.101474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:24:34.101474+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":15,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":158,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.804993+0000","last_change":"2024-02-10T08:19:34.226328+0000","last_active":"2024-02-10T08:24:38.804993+0000","last_peered":"2024-02-10T08:24:38.804993+0000","last_clean":"2024-02-10T08:24:38.804993+0000","last_became_active":"2024-02-10T08:16:56.867159+0000","last_became_peered":"2024-02-10T08:16:56.867159+0000","last_unstale":"2024-02-10T08:24:38.804993+0000","last_undegraded":"2024-02-10T08:24:38.804993+0000","last_fullsized":"2024-02-10T08:24:38.804993+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:34.226262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:04.766780+0000","last_clean_scrub_stamp":"2024-02-10T08:19:34.226262+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"199'996","reported_seq":1012,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-10T08:24:42.585941+0000","last_change":"2024-02-10T08:24:21.601506+0000","last_active":"2024-02-10T08:24:42.585941+0000","last_peered":"2024-02-10T08:24:42.585941+0000","last_clean":"2024-02-10T08:24:42.585941+0000","last_became_active":"2024-02-10T08:24:21.601203+0000","last_became_peered":"2024-02-10T08:24:21.601203+0000","last_unstale":"2024-02-10T08:24:42.585941+0000","last_undegraded":"2024-02-10T08:24:42.585941+0000","last_fullsized":"2024-02-10T08:24:42.585941+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:20.584872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:24:20.584872+0000","last_clean_scrub_stamp":"2024-02-10T08:24:20.584872+0000","log_size":996,"ondisk_log_size":996,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":65273856,"num_objects":996,"num_object_clones":0,"num_object_copies":2988,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":996,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":996,"num_write_kb":63744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":175,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.802797+0000","last_change":"2024-02-10T08:23:34.709678+0000","last_active":"2024-02-10T08:24:38.802797+0000","last_peered":"2024-02-10T08:24:38.802797+0000","last_clean":"2024-02-10T08:24:38.802797+0000","last_became_active":"2024-02-10T08:23:34.708536+0000","last_became_peered":"2024-02-10T08:23:34.708536+0000","last_unstale":"2024-02-10T08:24:38.802797+0000","last_undegraded":"2024-02-10T08:24:38.802797+0000","last_fullsized":"2024-02-10T08:24:38.802797+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:09.785096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:20:09.785096+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[1,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":186,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-02-10T08:24:32.843474+0000","last_change":"2024-02-10T08:24:32.843437+0000","last_active":"2024-02-10T08:24:32.843474+0000","last_peered":"2024-02-10T08:24:32.843474+0000","last_clean":"2024-02-10T08:24:32.843474+0000","last_became_active":"2024-02-10T08:23:15.074780+0000","last_became_peered":"2024-02-10T08:23:15.074780+0000","last_unstale":"2024-02-10T08:24:32.843474+0000","last_undegraded":"2024-02-10T08:24:32.843474+0000","last_fullsized":"2024-02-10T08:24:32.843474+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:32.843336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:20.736224+0000","last_clean_scrub_stamp":"2024-02-10T08:24:32.843336+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":162,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.803285+0000","last_change":"2024-02-10T08:20:12.387549+0000","last_active":"2024-02-10T08:24:38.803285+0000","last_peered":"2024-02-10T08:24:38.803285+0000","last_clean":"2024-02-10T08:24:38.803285+0000","last_became_active":"2024-02-10T08:16:52.787180+0000","last_became_peered":"2024-02-10T08:16:52.787180+0000","last_unstale":"2024-02-10T08:24:38.803285+0000","last_undegraded":"2024-02-10T08:24:38.803285+0000","last_fullsized":"2024-02-10T08:24:38.803285+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:12.387482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:20:12.387482+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"62'12","reported_seq":91,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.803392+0000","last_change":"2024-02-10T08:23:15.686615+0000","last_active":"2024-02-10T08:24:38.803392+0000","last_peered":"2024-02-10T08:24:38.803392+0000","last_clean":"2024-02-10T08:24:38.803392+0000","last_became_active":"2024-02-10T08:23:15.077476+0000","last_became_peered":"2024-02-10T08:23:15.077476+0000","last_unstale":"2024-02-10T08:24:38.803392+0000","last_undegraded":"2024-02-10T08:24:38.803392+0000","last_fullsized":"2024-02-10T08:24:38.803392+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'12","last_scrub_stamp":"2024-02-10T08:20:04.883293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:20:04.883293+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,7],"acting":[1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":158,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.800978+0000","last_change":"2024-02-10T08:20:08.318643+0000","last_active":"2024-02-10T08:24:38.800978+0000","last_peered":"2024-02-10T08:24:38.800978+0000","last_clean":"2024-02-10T08:24:38.800978+0000","last_became_active":"2024-02-10T08:16:56.864030+0000","last_became_peered":"2024-02-10T08:16:56.864030+0000","last_unstale":"2024-02-10T08:24:38.800978+0000","last_undegraded":"2024-02-10T08:24:38.800978+0000","last_fullsized":"2024-02-10T08:24:38.800978+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:08.318570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:41.360241+0000","last_clean_scrub_stamp":"2024-02-10T08:20:08.318570+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"197'89","reported_seq":101,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-02-10T08:24:37.748841+0000","last_change":"2024-02-10T08:24:21.603538+0000","last_active":"2024-02-10T08:24:37.748841+0000","last_peered":"2024-02-10T08:24:37.748841+0000","last_clean":"2024-02-10T08:24:37.748841+0000","last_became_active":"2024-02-10T08:24:21.603237+0000","last_became_peered":"2024-02-10T08:24:21.603237+0000","last_unstale":"2024-02-10T08:24:37.748841+0000","last_undegraded":"2024-02-10T08:24:37.748841+0000","last_fullsized":"2024-02-10T08:24:37.748841+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:20.584872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:24:20.584872+0000","last_clean_scrub_stamp":"2024-02-10T08:24:20.584872+0000","log_size":89,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":5832704,"num_objects":89,"num_object_clones":0,"num_object_copies":267,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":5696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":166,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.802357+0000","last_change":"2024-02-10T08:21:58.554689+0000","last_active":"2024-02-10T08:24:38.802357+0000","last_peered":"2024-02-10T08:24:38.802357+0000","last_clean":"2024-02-10T08:24:38.802357+0000","last_became_active":"2024-02-10T08:21:58.553966+0000","last_became_peered":"2024-02-10T08:21:58.553966+0000","last_unstale":"2024-02-10T08:24:38.802357+0000","last_undegraded":"2024-02-10T08:24:38.802357+0000","last_fullsized":"2024-02-10T08:24:38.802357+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:25.568342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:19:25.568342+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":154,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-02-10T08:24:32.876809+0000","last_change":"2024-02-10T08:24:30.914570+0000","last_active":"2024-02-10T08:24:32.876809+0000","last_peered":"2024-02-10T08:24:32.876809+0000","last_clean":"2024-02-10T08:24:32.876809+0000","last_became_active":"2024-02-10T08:23:34.708387+0000","last_became_peered":"2024-02-10T08:23:34.708387+0000","last_unstale":"2024-02-10T08:24:32.876809+0000","last_undegraded":"2024-02-10T08:24:32.876809+0000","last_fullsized":"2024-02-10T08:24:32.876809+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:30.914502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:24:30.914502+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"62'19","reported_seq":194,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-02-10T08:24:32.760491+0000","last_change":"2024-02-10T08:20:01.822882+0000","last_active":"2024-02-10T08:24:32.760491+0000","last_peered":"2024-02-10T08:24:32.760491+0000","last_clean":"2024-02-10T08:24:32.760491+0000","last_became_active":"2024-02-10T08:16:55.203453+0000","last_became_peered":"2024-02-10T08:16:55.203453+0000","last_unstale":"2024-02-10T08:24:32.760491+0000","last_undegraded":"2024-02-10T08:24:32.760491+0000","last_fullsized":"2024-02-10T08:24:32.760491+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'19","last_scrub_stamp":"2024-02-10T08:20:01.822753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:20:01.822753+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":158,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.807402+0000","last_change":"2024-02-10T08:20:07.350344+0000","last_active":"2024-02-10T08:24:38.807402+0000","last_peered":"2024-02-10T08:24:38.807402+0000","last_clean":"2024-02-10T08:24:38.807402+0000","last_became_active":"2024-02-10T08:16:56.861172+0000","last_became_peered":"2024-02-10T08:16:56.861172+0000","last_unstale":"2024-02-10T08:24:38.807402+0000","last_undegraded":"2024-02-10T08:24:38.807402+0000","last_fullsized":"2024-02-10T08:24:38.807402+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:07.350256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:20:07.350256+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.c","version":"199'960","reported_seq":976,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-10T08:24:42.504580+0000","last_change":"2024-02-10T08:24:21.603760+0000","last_active":"2024-02-10T08:24:42.504580+0000","last_peered":"2024-02-10T08:24:42.504580+0000","last_clean":"2024-02-10T08:24:42.504580+0000","last_became_active":"2024-02-10T08:24:21.603455+0000","last_became_peered":"2024-02-10T08:24:21.603455+0000","last_unstale":"2024-02-10T08:24:42.504580+0000","last_undegraded":"2024-02-10T08:24:42.504580+0000","last_fullsized":"2024-02-10T08:24:42.504580+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:20.584872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:24:20.584872+0000","last_clean_scrub_stamp":"2024-02-10T08:24:20.584872+0000","log_size":960,"ondisk_log_size":960,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":62914560,"num_objects":960,"num_object_clones":0,"num_object_copies":2880,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":960,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":960,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":161,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-02-10T08:24:35.592894+0000","last_change":"2024-02-10T08:23:15.074597+0000","last_active":"2024-02-10T08:24:35.592894+0000","last_peered":"2024-02-10T08:24:35.592894+0000","last_clean":"2024-02-10T08:24:35.592894+0000","last_became_active":"2024-02-10T08:23:15.074239+0000","last_became_peered":"2024-02-10T08:23:15.074239+0000","last_unstale":"2024-02-10T08:24:35.592894+0000","last_undegraded":"2024-02-10T08:24:35.592894+0000","last_fullsized":"2024-02-10T08:24:35.592894+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:22.216312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:19:22.216312+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":178,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.803162+0000","last_change":"2024-02-10T08:24:38.505837+0000","last_active":"2024-02-10T08:24:38.803162+0000","last_peered":"2024-02-10T08:24:38.803162+0000","last_clean":"2024-02-10T08:24:38.803162+0000","last_became_active":"2024-02-10T08:20:46.407667+0000","last_became_peered":"2024-02-10T08:20:46.407667+0000","last_unstale":"2024-02-10T08:24:38.803162+0000","last_undegraded":"2024-02-10T08:24:38.803162+0000","last_fullsized":"2024-02-10T08:24:38.803162+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:38.505735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:24:38.505735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"62'18","reported_seq":152,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-10T08:24:41.032303+0000","last_change":"2024-02-10T08:24:41.032303+0000","last_active":"2024-02-10T08:24:41.032303+0000","last_peered":"2024-02-10T08:24:41.032303+0000","last_clean":"2024-02-10T08:24:41.032303+0000","last_became_active":"2024-02-10T08:23:15.079674+0000","last_became_peered":"2024-02-10T08:23:15.079674+0000","last_unstale":"2024-02-10T08:24:41.032303+0000","last_undegraded":"2024-02-10T08:24:41.032303+0000","last_fullsized":"2024-02-10T08:24:41.032303+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'18","last_scrub_stamp":"2024-02-10T08:24:41.032197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:24:41.032197+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":33,"num_read_kb":21,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,5],"acting":[7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":143,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-02-10T08:24:35.592927+0000","last_change":"2024-02-10T08:23:34.706538+0000","last_active":"2024-02-10T08:24:35.592927+0000","last_peered":"2024-02-10T08:24:35.592927+0000","last_clean":"2024-02-10T08:24:35.592927+0000","last_became_active":"2024-02-10T08:23:34.706206+0000","last_became_peered":"2024-02-10T08:23:34.706206+0000","last_unstale":"2024-02-10T08:24:35.592927+0000","last_undegraded":"2024-02-10T08:24:35.592927+0000","last_fullsized":"2024-02-10T08:24:35.592927+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:15.979973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:15.979973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,5],"acting":[4,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"199'923","reported_seq":939,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-10T08:24:42.483622+0000","last_change":"2024-02-10T08:24:21.601386+0000","last_active":"2024-02-10T08:24:42.483622+0000","last_peered":"2024-02-10T08:24:42.483622+0000","last_clean":"2024-02-10T08:24:42.483622+0000","last_became_active":"2024-02-10T08:24:21.601091+0000","last_became_peered":"2024-02-10T08:24:21.601091+0000","last_unstale":"2024-02-10T08:24:42.483622+0000","last_undegraded":"2024-02-10T08:24:42.483622+0000","last_fullsized":"2024-02-10T08:24:42.483622+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:20.584872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:24:20.584872+0000","last_clean_scrub_stamp":"2024-02-10T08:24:20.584872+0000","log_size":923,"ondisk_log_size":923,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":60489728,"num_objects":923,"num_object_clones":0,"num_object_copies":2769,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":923,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":923,"num_write_kb":59072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2],"acting":[5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":165,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.804948+0000","last_change":"2024-02-10T08:21:58.547282+0000","last_active":"2024-02-10T08:24:38.804948+0000","last_peered":"2024-02-10T08:24:38.804948+0000","last_clean":"2024-02-10T08:24:38.804948+0000","last_became_active":"2024-02-10T08:21:58.546976+0000","last_became_peered":"2024-02-10T08:21:58.546976+0000","last_unstale":"2024-02-10T08:24:38.804948+0000","last_undegraded":"2024-02-10T08:24:38.804948+0000","last_fullsized":"2024-02-10T08:24:38.804948+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:22.272986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:20:22.272986+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":162,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.807526+0000","last_change":"2024-02-10T08:20:03.392639+0000","last_active":"2024-02-10T08:24:38.807526+0000","last_peered":"2024-02-10T08:24:38.807526+0000","last_clean":"2024-02-10T08:24:38.807526+0000","last_became_active":"2024-02-10T08:16:52.789020+0000","last_became_peered":"2024-02-10T08:16:52.789020+0000","last_unstale":"2024-02-10T08:24:38.807526+0000","last_undegraded":"2024-02-10T08:24:38.807526+0000","last_fullsized":"2024-02-10T08:24:38.807526+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:03.392561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:20:03.392561+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"62'14","reported_seq":153,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-02-10T08:24:35.592782+0000","last_change":"2024-02-10T08:20:46.401263+0000","last_active":"2024-02-10T08:24:35.592782+0000","last_peered":"2024-02-10T08:24:35.592782+0000","last_clean":"2024-02-10T08:24:35.592782+0000","last_became_active":"2024-02-10T08:20:46.400760+0000","last_became_peered":"2024-02-10T08:20:46.400760+0000","last_unstale":"2024-02-10T08:24:35.592782+0000","last_undegraded":"2024-02-10T08:24:35.592782+0000","last_fullsized":"2024-02-10T08:24:35.592782+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'14","last_scrub_stamp":"2024-02-10T08:18:10.980421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:10.980421+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"173'12","reported_seq":128,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-10T08:24:39.816210+0000","last_change":"2024-02-10T08:23:34.809378+0000","last_active":"2024-02-10T08:24:39.816210+0000","last_peered":"2024-02-10T08:24:39.816210+0000","last_clean":"2024-02-10T08:24:39.816210+0000","last_became_active":"2024-02-10T08:23:34.711450+0000","last_became_peered":"2024-02-10T08:23:34.711450+0000","last_unstale":"2024-02-10T08:24:39.816210+0000","last_undegraded":"2024-02-10T08:24:39.816210+0000","last_fullsized":"2024-02-10T08:24:39.816210+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'8","last_scrub_stamp":"2024-02-10T08:18:30.090065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:30.090065+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,2],"acting":[1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"198'472","reported_seq":486,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:39.686054+0000","last_change":"2024-02-10T08:24:21.599718+0000","last_active":"2024-02-10T08:24:39.686054+0000","last_peered":"2024-02-10T08:24:39.686054+0000","last_clean":"2024-02-10T08:24:39.686054+0000","last_became_active":"2024-02-10T08:24:21.599424+0000","last_became_peered":"2024-02-10T08:24:21.599424+0000","last_unstale":"2024-02-10T08:24:39.686054+0000","last_undegraded":"2024-02-10T08:24:39.686054+0000","last_fullsized":"2024-02-10T08:24:39.686054+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:20.584872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:24:20.584872+0000","last_clean_scrub_stamp":"2024-02-10T08:24:20.584872+0000","log_size":472,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":30932992,"num_objects":472,"num_object_clones":0,"num_object_copies":1416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":472,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":472,"num_write_kb":30208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,5],"acting":[4,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":77,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.807065+0000","last_change":"2024-02-10T08:23:34.716626+0000","last_active":"2024-02-10T08:24:38.807065+0000","last_peered":"2024-02-10T08:24:38.807065+0000","last_clean":"2024-02-10T08:24:38.807065+0000","last_became_active":"2024-02-10T08:23:34.716306+0000","last_became_peered":"2024-02-10T08:23:34.716306+0000","last_unstale":"2024-02-10T08:24:38.807065+0000","last_undegraded":"2024-02-10T08:24:38.807065+0000","last_fullsized":"2024-02-10T08:24:38.807065+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:30.227375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:20:30.227375+0000","last_clean_scrub_stamp":"2024-02-10T08:20:30.227375+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,7],"acting":[6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":223,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.800646+0000","last_change":"2024-02-10T08:24:32.858765+0000","last_active":"2024-02-10T08:24:38.800646+0000","last_peered":"2024-02-10T08:24:38.800646+0000","last_clean":"2024-02-10T08:24:38.800646+0000","last_became_active":"2024-02-10T08:20:46.400500+0000","last_became_peered":"2024-02-10T08:20:46.400500+0000","last_unstale":"2024-02-10T08:24:38.800646+0000","last_undegraded":"2024-02-10T08:24:38.800646+0000","last_fullsized":"2024-02-10T08:24:38.800646+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:32.858639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:24:32.858639+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":162,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.803371+0000","last_change":"2024-02-10T08:20:01.263757+0000","last_active":"2024-02-10T08:24:38.803371+0000","last_peered":"2024-02-10T08:24:38.803371+0000","last_clean":"2024-02-10T08:24:38.803371+0000","last_became_active":"2024-02-10T08:16:52.786822+0000","last_became_peered":"2024-02-10T08:16:52.786822+0000","last_unstale":"2024-02-10T08:24:38.803371+0000","last_undegraded":"2024-02-10T08:24:38.803371+0000","last_fullsized":"2024-02-10T08:24:38.803371+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:01.263661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:20:01.263661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"76'16","reported_seq":171,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-02-10T08:24:35.593510+0000","last_change":"2024-02-10T08:20:46.406601+0000","last_active":"2024-02-10T08:24:35.593510+0000","last_peered":"2024-02-10T08:24:35.593510+0000","last_clean":"2024-02-10T08:24:35.593510+0000","last_became_active":"2024-02-10T08:20:46.406023+0000","last_became_peered":"2024-02-10T08:20:46.406023+0000","last_unstale":"2024-02-10T08:24:35.593510+0000","last_undegraded":"2024-02-10T08:24:35.593510+0000","last_fullsized":"2024-02-10T08:24:35.593510+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'16","last_scrub_stamp":"2024-02-10T08:19:24.195140+0000","last_deep_scrub":"76'16","last_deep_scrub_stamp":"2024-02-10T08:18:07.909782+0000","last_clean_scrub_stamp":"2024-02-10T08:19:24.195140+0000","log_size":16,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3","version":"199'974","reported_seq":989,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-10T08:24:42.589634+0000","last_change":"2024-02-10T08:24:21.599851+0000","last_active":"2024-02-10T08:24:42.589634+0000","last_peered":"2024-02-10T08:24:42.589634+0000","last_clean":"2024-02-10T08:24:42.589634+0000","last_became_active":"2024-02-10T08:24:21.599504+0000","last_became_peered":"2024-02-10T08:24:21.599504+0000","last_unstale":"2024-02-10T08:24:42.589634+0000","last_undegraded":"2024-02-10T08:24:42.589634+0000","last_fullsized":"2024-02-10T08:24:42.589634+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:20.584872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:24:20.584872+0000","last_clean_scrub_stamp":"2024-02-10T08:24:20.584872+0000","log_size":974,"ondisk_log_size":974,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":63832064,"num_objects":974,"num_object_clones":0,"num_object_copies":2922,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":974,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":974,"num_write_kb":62336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[1,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":165,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.800547+0000","last_change":"2024-02-10T08:23:15.079722+0000","last_active":"2024-02-10T08:24:38.800547+0000","last_peered":"2024-02-10T08:24:38.800547+0000","last_clean":"2024-02-10T08:24:38.800547+0000","last_became_active":"2024-02-10T08:23:15.078797+0000","last_became_peered":"2024-02-10T08:23:15.078797+0000","last_unstale":"2024-02-10T08:24:38.800547+0000","last_undegraded":"2024-02-10T08:24:38.800547+0000","last_fullsized":"2024-02-10T08:24:38.800547+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:03.250587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:20:03.250587+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,2],"acting":[5,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"111'10","reported_seq":210,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-02-10T08:24:36.040788+0000","last_change":"2024-02-10T08:20:46.402756+0000","last_active":"2024-02-10T08:24:36.040788+0000","last_peered":"2024-02-10T08:24:36.040788+0000","last_clean":"2024-02-10T08:24:36.040788+0000","last_became_active":"2024-02-10T08:20:46.401894+0000","last_became_peered":"2024-02-10T08:20:46.401894+0000","last_unstale":"2024-02-10T08:24:36.040788+0000","last_undegraded":"2024-02-10T08:24:36.040788+0000","last_fullsized":"2024-02-10T08:24:36.040788+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'8","last_scrub_stamp":"2024-02-10T08:18:28.991446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:28.991446+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":163,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.802272+0000","last_change":"2024-02-10T08:20:04.745454+0000","last_active":"2024-02-10T08:24:38.802272+0000","last_peered":"2024-02-10T08:24:38.802272+0000","last_clean":"2024-02-10T08:24:38.802272+0000","last_became_active":"2024-02-10T08:16:52.783634+0000","last_became_peered":"2024-02-10T08:16:52.783634+0000","last_unstale":"2024-02-10T08:24:38.802272+0000","last_undegraded":"2024-02-10T08:24:38.802272+0000","last_fullsized":"2024-02-10T08:24:38.802272+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:04.745360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:20:04.745360+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"62'15","reported_seq":166,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-02-10T08:24:32.877393+0000","last_change":"2024-02-10T08:24:27.962957+0000","last_active":"2024-02-10T08:24:32.877393+0000","last_peered":"2024-02-10T08:24:32.877393+0000","last_clean":"2024-02-10T08:24:32.877393+0000","last_became_active":"2024-02-10T08:20:46.401777+0000","last_became_peered":"2024-02-10T08:20:46.401777+0000","last_unstale":"2024-02-10T08:24:32.877393+0000","last_undegraded":"2024-02-10T08:24:32.877393+0000","last_fullsized":"2024-02-10T08:24:32.877393+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'15","last_scrub_stamp":"2024-02-10T08:24:27.962879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:24:27.962879+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.0","version":"199'986","reported_seq":1002,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-10T08:24:42.499594+0000","last_change":"2024-02-10T08:24:21.600077+0000","last_active":"2024-02-10T08:24:42.499594+0000","last_peered":"2024-02-10T08:24:42.499594+0000","last_clean":"2024-02-10T08:24:42.499594+0000","last_became_active":"2024-02-10T08:24:21.599802+0000","last_became_peered":"2024-02-10T08:24:21.599802+0000","last_unstale":"2024-02-10T08:24:42.499594+0000","last_undegraded":"2024-02-10T08:24:42.499594+0000","last_fullsized":"2024-02-10T08:24:42.499594+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:20.584872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:24:20.584872+0000","last_clean_scrub_stamp":"2024-02-10T08:24:20.584872+0000","log_size":986,"ondisk_log_size":986,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":64618496,"num_objects":986,"num_object_clones":0,"num_object_copies":2958,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":986,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":986,"num_write_kb":63104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":126,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-02-10T08:24:35.593379+0000","last_change":"2024-02-10T08:20:46.406374+0000","last_active":"2024-02-10T08:24:35.593379+0000","last_peered":"2024-02-10T08:24:35.593379+0000","last_clean":"2024-02-10T08:24:35.593379+0000","last_became_active":"2024-02-10T08:20:46.405578+0000","last_became_peered":"2024-02-10T08:20:46.405578+0000","last_unstale":"2024-02-10T08:24:35.593379+0000","last_undegraded":"2024-02-10T08:24:35.593379+0000","last_fullsized":"2024-02-10T08:24:35.593379+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:17:59.857977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:17:59.857977+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"62'8","reported_seq":258,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-02-10T08:24:36.040591+0000","last_change":"2024-02-10T08:19:24.859730+0000","last_active":"2024-02-10T08:24:36.040591+0000","last_peered":"2024-02-10T08:24:36.040591+0000","last_clean":"2024-02-10T08:24:36.040591+0000","last_became_active":"2024-02-10T08:16:56.858101+0000","last_became_peered":"2024-02-10T08:16:56.858101+0000","last_unstale":"2024-02-10T08:24:36.040591+0000","last_undegraded":"2024-02-10T08:24:36.040591+0000","last_fullsized":"2024-02-10T08:24:36.040591+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'8","last_scrub_stamp":"2024-02-10T08:19:24.859657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:19:24.859657+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":163,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.802535+0000","last_change":"2024-02-10T08:19:31.561674+0000","last_active":"2024-02-10T08:24:38.802535+0000","last_peered":"2024-02-10T08:24:38.802535+0000","last_clean":"2024-02-10T08:24:38.802535+0000","last_became_active":"2024-02-10T08:16:52.785545+0000","last_became_peered":"2024-02-10T08:16:52.785545+0000","last_unstale":"2024-02-10T08:24:38.802535+0000","last_undegraded":"2024-02-10T08:24:38.802535+0000","last_fullsized":"2024-02-10T08:24:38.802535+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:31.561534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:19:31.561534+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"62'10","reported_seq":161,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-02-10T08:24:35.593122+0000","last_change":"2024-02-10T08:20:46.399522+0000","last_active":"2024-02-10T08:24:35.593122+0000","last_peered":"2024-02-10T08:24:35.593122+0000","last_clean":"2024-02-10T08:24:35.593122+0000","last_became_active":"2024-02-10T08:20:46.398973+0000","last_became_peered":"2024-02-10T08:20:46.398973+0000","last_unstale":"2024-02-10T08:24:35.593122+0000","last_undegraded":"2024-02-10T08:24:35.593122+0000","last_fullsized":"2024-02-10T08:24:35.593122+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'10","last_scrub_stamp":"2024-02-10T08:19:16.196834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:19:16.196834+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1","version":"199'1020","reported_seq":1036,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-10T08:24:42.591950+0000","last_change":"2024-02-10T08:24:21.601446+0000","last_active":"2024-02-10T08:24:42.591950+0000","last_peered":"2024-02-10T08:24:42.591950+0000","last_clean":"2024-02-10T08:24:42.591950+0000","last_became_active":"2024-02-10T08:24:21.598978+0000","last_became_peered":"2024-02-10T08:24:21.598978+0000","last_unstale":"2024-02-10T08:24:42.591950+0000","last_undegraded":"2024-02-10T08:24:42.591950+0000","last_fullsized":"2024-02-10T08:24:42.591950+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:20.584872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:24:20.584872+0000","last_clean_scrub_stamp":"2024-02-10T08:24:20.584872+0000","log_size":1020,"ondisk_log_size":1020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":66846720,"num_objects":1020,"num_object_clones":0,"num_object_copies":3060,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1020,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1020,"num_write_kb":65280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":22,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-02-10T08:24:33.896007+0000","last_change":"2024-02-10T08:24:33.895974+0000","last_active":"2024-02-10T08:24:33.896007+0000","last_peered":"2024-02-10T08:24:33.896007+0000","last_clean":"2024-02-10T08:24:33.896007+0000","last_became_active":"2024-02-10T08:24:18.646774+0000","last_became_peered":"2024-02-10T08:24:18.646774+0000","last_unstale":"2024-02-10T08:24:33.896007+0000","last_undegraded":"2024-02-10T08:24:33.896007+0000","last_fullsized":"2024-02-10T08:24:33.896007+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:33.895864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:24:33.895864+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6],"acting":[0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":169,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.802705+0000","last_change":"2024-02-10T08:20:46.407303+0000","last_active":"2024-02-10T08:24:38.802705+0000","last_peered":"2024-02-10T08:24:38.802705+0000","last_clean":"2024-02-10T08:24:38.802705+0000","last_became_active":"2024-02-10T08:20:46.406971+0000","last_became_peered":"2024-02-10T08:20:46.406971+0000","last_unstale":"2024-02-10T08:24:38.802705+0000","last_undegraded":"2024-02-10T08:24:38.802705+0000","last_fullsized":"2024-02-10T08:24:38.802705+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:37.273476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:37.273476+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":177,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.804345+0000","last_change":"2024-02-10T08:20:46.399889+0000","last_active":"2024-02-10T08:24:38.804345+0000","last_peered":"2024-02-10T08:24:38.804345+0000","last_clean":"2024-02-10T08:24:38.804345+0000","last_became_active":"2024-02-10T08:20:46.399568+0000","last_became_peered":"2024-02-10T08:20:46.399568+0000","last_unstale":"2024-02-10T08:24:38.804345+0000","last_undegraded":"2024-02-10T08:24:38.804345+0000","last_fullsized":"2024-02-10T08:24:38.804345+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:22.228064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:19:22.228064+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"62'17","reported_seq":202,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-02-10T08:24:35.593451+0000","last_change":"2024-02-10T08:20:46.396386+0000","last_active":"2024-02-10T08:24:35.593451+0000","last_peered":"2024-02-10T08:24:35.593451+0000","last_clean":"2024-02-10T08:24:35.593451+0000","last_became_active":"2024-02-10T08:20:46.395694+0000","last_became_peered":"2024-02-10T08:20:46.395694+0000","last_unstale":"2024-02-10T08:24:35.593451+0000","last_undegraded":"2024-02-10T08:24:35.593451+0000","last_fullsized":"2024-02-10T08:24:35.593451+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'17","last_scrub_stamp":"2024-02-10T08:19:26.245091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:19:26.245091+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":28,"num_read_kb":18,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.6","version":"197'158","reported_seq":172,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.038171+0000","last_change":"2024-02-10T08:24:21.598389+0000","last_active":"2024-02-10T08:24:38.038171+0000","last_peered":"2024-02-10T08:24:38.038171+0000","last_clean":"2024-02-10T08:24:38.038171+0000","last_became_active":"2024-02-10T08:24:21.598099+0000","last_became_peered":"2024-02-10T08:24:21.598099+0000","last_unstale":"2024-02-10T08:24:38.038171+0000","last_undegraded":"2024-02-10T08:24:38.038171+0000","last_fullsized":"2024-02-10T08:24:38.038171+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:20.584872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:24:20.584872+0000","last_clean_scrub_stamp":"2024-02-10T08:24:20.584872+0000","log_size":158,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":10354688,"num_objects":158,"num_object_clones":0,"num_object_copies":474,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":158,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":10112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,7],"acting":[0,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":174,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.803236+0000","last_change":"2024-02-10T08:24:18.645855+0000","last_active":"2024-02-10T08:24:38.803236+0000","last_peered":"2024-02-10T08:24:38.803236+0000","last_clean":"2024-02-10T08:24:38.803236+0000","last_became_active":"2024-02-10T08:24:18.645480+0000","last_became_peered":"2024-02-10T08:24:18.645480+0000","last_unstale":"2024-02-10T08:24:38.803236+0000","last_undegraded":"2024-02-10T08:24:38.803236+0000","last_fullsized":"2024-02-10T08:24:38.803236+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:24.199920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:19:24.199920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,3],"acting":[7,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":157,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-02-10T08:24:32.875634+0000","last_change":"2024-02-10T08:19:30.942724+0000","last_active":"2024-02-10T08:24:32.875634+0000","last_peered":"2024-02-10T08:24:32.875634+0000","last_clean":"2024-02-10T08:24:32.875634+0000","last_became_active":"2024-02-10T08:16:56.864026+0000","last_became_peered":"2024-02-10T08:16:56.864026+0000","last_unstale":"2024-02-10T08:24:32.875634+0000","last_undegraded":"2024-02-10T08:24:32.875634+0000","last_fullsized":"2024-02-10T08:24:32.875634+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:30.942646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:19:30.942646+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":166,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-02-10T08:24:32.876157+0000","last_change":"2024-02-10T08:20:21.977157+0000","last_active":"2024-02-10T08:24:32.876157+0000","last_peered":"2024-02-10T08:24:32.876157+0000","last_clean":"2024-02-10T08:24:32.876157+0000","last_became_active":"2024-02-10T08:16:52.789100+0000","last_became_peered":"2024-02-10T08:16:52.789100+0000","last_unstale":"2024-02-10T08:24:32.876157+0000","last_undegraded":"2024-02-10T08:24:32.876157+0000","last_fullsized":"2024-02-10T08:24:32.876157+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:21.977065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:20:21.977065+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"62'19","reported_seq":191,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.807113+0000","last_change":"2024-02-10T08:20:01.351638+0000","last_active":"2024-02-10T08:24:38.807113+0000","last_peered":"2024-02-10T08:24:38.807113+0000","last_clean":"2024-02-10T08:24:38.807113+0000","last_became_active":"2024-02-10T08:16:55.203415+0000","last_became_peered":"2024-02-10T08:16:55.203415+0000","last_unstale":"2024-02-10T08:24:38.807113+0000","last_undegraded":"2024-02-10T08:24:38.807113+0000","last_fullsized":"2024-02-10T08:24:38.807113+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'19","last_scrub_stamp":"2024-02-10T08:20:01.351573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:20:01.351573+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.7","version":"199'1011","reported_seq":1027,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-10T08:24:42.592576+0000","last_change":"2024-02-10T08:24:21.600562+0000","last_active":"2024-02-10T08:24:42.592576+0000","last_peered":"2024-02-10T08:24:42.592576+0000","last_clean":"2024-02-10T08:24:42.592576+0000","last_became_active":"2024-02-10T08:24:21.600279+0000","last_became_peered":"2024-02-10T08:24:21.600279+0000","last_unstale":"2024-02-10T08:24:42.592576+0000","last_undegraded":"2024-02-10T08:24:42.592576+0000","last_fullsized":"2024-02-10T08:24:42.592576+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:20.584872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:24:20.584872+0000","last_clean_scrub_stamp":"2024-02-10T08:24:20.584872+0000","log_size":1011,"ondisk_log_size":1011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":66256896,"num_objects":1011,"num_object_clones":0,"num_object_copies":3033,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1011,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1011,"num_write_kb":64704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,6],"acting":[1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.9","version":"76'2","reported_seq":64,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.803371+0000","last_change":"2024-02-10T08:23:34.718711+0000","last_active":"2024-02-10T08:24:38.803371+0000","last_peered":"2024-02-10T08:24:38.803371+0000","last_clean":"2024-02-10T08:24:38.803371+0000","last_became_active":"2024-02-10T08:23:34.718483+0000","last_became_peered":"2024-02-10T08:23:34.718483+0000","last_unstale":"2024-02-10T08:24:38.803371+0000","last_undegraded":"2024-02-10T08:24:38.803371+0000","last_fullsized":"2024-02-10T08:24:38.803371+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'2","last_scrub_stamp":"2024-02-10T08:19:28.458129+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2024-02-10T08:18:08.680038+0000","last_clean_scrub_stamp":"2024-02-10T08:19:28.458129+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":6,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":181,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-02-10T08:24:34.869156+0000","last_change":"2024-02-10T08:24:34.869126+0000","last_active":"2024-02-10T08:24:34.869156+0000","last_peered":"2024-02-10T08:24:34.869156+0000","last_clean":"2024-02-10T08:24:34.869156+0000","last_became_active":"2024-02-10T08:23:34.704848+0000","last_became_peered":"2024-02-10T08:23:34.704848+0000","last_unstale":"2024-02-10T08:24:34.869156+0000","last_undegraded":"2024-02-10T08:24:34.869156+0000","last_fullsized":"2024-02-10T08:24:34.869156+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:34.869041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:24:34.869041+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0],"acting":[2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":178,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.803858+0000","last_change":"2024-02-10T08:20:46.407715+0000","last_active":"2024-02-10T08:24:38.803858+0000","last_peered":"2024-02-10T08:24:38.803858+0000","last_clean":"2024-02-10T08:24:38.803858+0000","last_became_active":"2024-02-10T08:20:46.407311+0000","last_became_peered":"2024-02-10T08:20:46.407311+0000","last_unstale":"2024-02-10T08:24:38.803858+0000","last_undegraded":"2024-02-10T08:24:38.803858+0000","last_fullsized":"2024-02-10T08:24:38.803858+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:21.523096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:21.523096+0000","last_clean_scrub_stamp":"2024-02-10T08:19:21.523096+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"62'9","reported_seq":189,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-02-10T08:24:32.760720+0000","last_change":"2024-02-10T08:24:30.902189+0000","last_active":"2024-02-10T08:24:32.760720+0000","last_peered":"2024-02-10T08:24:32.760720+0000","last_clean":"2024-02-10T08:24:32.760720+0000","last_became_active":"2024-02-10T08:20:46.402749+0000","last_became_peered":"2024-02-10T08:20:46.402749+0000","last_unstale":"2024-02-10T08:24:32.760720+0000","last_undegraded":"2024-02-10T08:24:32.760720+0000","last_fullsized":"2024-02-10T08:24:32.760720+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'9","last_scrub_stamp":"2024-02-10T08:24:30.902122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:24:30.902122+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"199'972","reported_seq":988,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-10T08:24:42.501728+0000","last_change":"2024-02-10T08:24:21.602014+0000","last_active":"2024-02-10T08:24:42.501728+0000","last_peered":"2024-02-10T08:24:42.501728+0000","last_clean":"2024-02-10T08:24:42.501728+0000","last_became_active":"2024-02-10T08:24:21.601677+0000","last_became_peered":"2024-02-10T08:24:21.601677+0000","last_unstale":"2024-02-10T08:24:42.501728+0000","last_undegraded":"2024-02-10T08:24:42.501728+0000","last_fullsized":"2024-02-10T08:24:42.501728+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:20.584872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:24:20.584872+0000","last_clean_scrub_stamp":"2024-02-10T08:24:20.584872+0000","log_size":972,"ondisk_log_size":972,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":63700992,"num_objects":972,"num_object_clones":0,"num_object_copies":2916,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":972,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":972,"num_write_kb":62208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,2],"acting":[5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":161,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.800195+0000","last_change":"2024-02-10T08:24:37.842446+0000","last_active":"2024-02-10T08:24:38.800195+0000","last_peered":"2024-02-10T08:24:38.800195+0000","last_clean":"2024-02-10T08:24:38.800195+0000","last_became_active":"2024-02-10T08:16:58.891260+0000","last_became_peered":"2024-02-10T08:16:58.891260+0000","last_unstale":"2024-02-10T08:24:38.800195+0000","last_undegraded":"2024-02-10T08:24:38.800195+0000","last_fullsized":"2024-02-10T08:24:38.800195+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:37.842356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:20.392249+0000","last_clean_scrub_stamp":"2024-02-10T08:24:37.842356+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":175,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-02-10T08:24:32.877404+0000","last_change":"2024-02-10T08:23:15.074385+0000","last_active":"2024-02-10T08:24:32.877404+0000","last_peered":"2024-02-10T08:24:32.877404+0000","last_clean":"2024-02-10T08:24:32.877404+0000","last_became_active":"2024-02-10T08:23:15.074046+0000","last_became_peered":"2024-02-10T08:23:15.074046+0000","last_unstale":"2024-02-10T08:24:32.877404+0000","last_undegraded":"2024-02-10T08:24:32.877404+0000","last_fullsized":"2024-02-10T08:24:32.877404+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:24.969327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:20:24.969327+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,6],"acting":[2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"62'15","reported_seq":185,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-02-10T08:24:38.800656+0000","last_change":"2024-02-10T08:20:05.314332+0000","last_active":"2024-02-10T08:24:38.800656+0000","last_peered":"2024-02-10T08:24:38.800656+0000","last_clean":"2024-02-10T08:24:38.800656+0000","last_became_active":"2024-02-10T08:16:55.204597+0000","last_became_peered":"2024-02-10T08:16:55.204597+0000","last_unstale":"2024-02-10T08:24:38.800656+0000","last_undegraded":"2024-02-10T08:24:38.800656+0000","last_fullsized":"2024-02-10T08:24:38.800656+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'15","last_scrub_stamp":"2024-02-10T08:20:05.314225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:20:05.314225+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"111'10","reported_seq":293,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-10T08:24:39.814885+0000","last_change":"2024-02-10T08:24:31.038188+0000","last_active":"2024-02-10T08:24:39.814885+0000","last_peered":"2024-02-10T08:24:39.814885+0000","last_clean":"2024-02-10T08:24:39.814885+0000","last_became_active":"2024-02-10T08:20:46.399193+0000","last_became_peered":"2024-02-10T08:20:46.399193+0000","last_unstale":"2024-02-10T08:24:39.814885+0000","last_undegraded":"2024-02-10T08:24:39.814885+0000","last_fullsized":"2024-02-10T08:24:39.814885+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'10","last_scrub_stamp":"2024-02-10T08:24:31.038099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:24:31.038099+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":793903104,"num_objects":12114,"num_object_clones":0,"num_object_copies":36342,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12114,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12114,"num_write_kb":775296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1917714432,"data_stored":1917714432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12114,"ondisk_log_size":12114,"up":48,"acting":48,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":4},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":461,"num_read_kb":456,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":9,"acting":9,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":683,"num_read_kb":440,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":74,"num_bytes_recovered":1898,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":412,"ondisk_log_size":412,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":96,"acting":96,"num_store_stats":8},{"poolid":6,"num_pg":42,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":126,"acting":126,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":50,"seq":214748364898,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":577316,"kb_used_data":275996,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":93167836,"statfs":{"total":95995035648,"available":95403864064,"internally_reserved":0,"allocated":282619904,"data_stored":281682222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:23:56 2024","interfaces":[{"interface":"back","average":{"1min":1.903,"5min":1.4950000000000001,"15min":0.82599999999999996},"min":{"1min":0.22600000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":6.1459999999999999,"5min":21.175999999999998,"15min":21.175999999999998},"last":0.27700000000000002},{"interface":"front","average":{"1min":3.2789999999999999,"5min":2.4849999999999999,"15min":1.155},"min":{"1min":0.29299999999999998,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":15.06,"5min":22.57,"15min":22.57},"last":0.22600000000000001}]},{"osd":1,"last update":"Sat Feb 10 08:23:56 2024","interfaces":[{"interface":"back","average":{"1min":1.742,"5min":1.577,"15min":0.86199999999999999},"min":{"1min":0.249,"5min":0.214,"15min":0.214},"max":{"1min":8.0199999999999996,"5min":15.476000000000001,"15min":15.476000000000001},"last":0.59899999999999998},{"interface":"front","average":{"1min":2.609,"5min":1.7509999999999999,"15min":0.92600000000000005},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":11.478,"5min":12.048,"15min":12.048},"last":0.245}]},{"osd":2,"last update":"Sat Feb 10 08:23:56 2024","interfaces":[{"interface":"back","average":{"1min":2.1219999999999999,"5min":1.7290000000000001,"15min":0.90200000000000002},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":5.9109999999999996,"5min":7.9029999999999996,"15min":7.9029999999999996},"last":0.55900000000000005},{"interface":"front","average":{"1min":2.177,"5min":1.839,"15min":0.96399999999999997},"min":{"1min":0.26300000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":12.797000000000001,"5min":12.797000000000001,"15min":12.797000000000001},"last":0.84799999999999998}]},{"osd":3,"last update":"Sat Feb 10 08:23:56 2024","interfaces":[{"interface":"back","average":{"1min":2.2050000000000001,"5min":1.772,"15min":0.93400000000000005},"min":{"1min":0.33600000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":6.0960000000000001,"5min":18.515000000000001,"15min":18.515000000000001},"last":0.34100000000000003},{"interface":"front","average":{"1min":2.8929999999999998,"5min":2.032,"15min":1.0229999999999999},"min":{"1min":0.36599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":9.9969999999999999,"5min":9.9969999999999999,"15min":9.9969999999999999},"last":0.52100000000000002}]},{"osd":4,"last update":"Sat Feb 10 08:23:48 2024","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.72599999999999998,"15min":0.50600000000000001},"min":{"1min":0.22700000000000001,"5min":0.216,"15min":0.216},"max":{"1min":2.8010000000000002,"5min":7.8710000000000004,"15min":7.8710000000000004},"last":0.28799999999999998},{"interface":"front","average":{"1min":1.1850000000000001,"5min":0.57199999999999995,"15min":0.47199999999999998},"min":{"1min":0.25800000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":6.1390000000000002,"5min":6.1390000000000002,"15min":6.1390000000000002},"last":0.54700000000000004}]},{"osd":5,"last update":"Sat Feb 10 08:23:56 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.57699999999999996,"15min":0.46999999999999997},"min":{"1min":0.28199999999999997,"5min":0.218,"15min":0.218},"max":{"1min":5.4829999999999997,"5min":5.4829999999999997,"15min":5.4829999999999997},"last":0.31},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.68899999999999995,"15min":0.53600000000000003},"min":{"1min":0.26300000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":4.2789999999999999,"5min":4.5149999999999997,"15min":4.5149999999999997},"last":0.48899999999999999}]},{"osd":6,"last update":"Sat Feb 10 08:23:56 2024","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":0.58199999999999996,"15min":0.49099999999999999},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":4.8879999999999999,"5min":4.8879999999999999,"15min":4.8879999999999999},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.68899999999999995,"15min":0.54300000000000004},"min":{"1min":0.28699999999999998,"5min":0.224,"15min":0.224},"max":{"1min":2.754,"5min":4.5750000000000002,"15min":4.5750000000000002},"last":0.63500000000000001}]}]},{"osd":6,"up_from":43,"seq":184683593831,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":589032,"kb_used_data":283616,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93156120,"statfs":{"total":95995035648,"available":95391866880,"internally_reserved":0,"allocated":290422784,"data_stored":289481434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:24:32 2024","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":2.738,"15min":1.2709999999999999},"min":{"1min":0.22700000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":3.4620000000000002,"5min":30.509,"15min":30.509},"last":1.665},{"interface":"front","average":{"1min":1.45,"5min":2.407,"15min":1.1699999999999999},"min":{"1min":0.35599999999999998,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":6.5419999999999998,"5min":36.090000000000003,"15min":36.090000000000003},"last":1.601}]},{"osd":1,"last update":"Sat Feb 10 08:24:32 2024","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.641,"15min":0.91400000000000003},"min":{"1min":0.374,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":6.3220000000000001,"5min":12.938000000000001,"15min":12.938000000000001},"last":0.253},{"interface":"front","average":{"1min":1.242,"5min":1.7689999999999999,"15min":0.96299999999999997},"min":{"1min":0.26200000000000001,"5min":0.247,"15min":0.247},"max":{"1min":4.569,"5min":10.256,"15min":10.256},"last":2.3100000000000001}]},{"osd":2,"last update":"Sat Feb 10 08:24:32 2024","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":2.2719999999999998,"15min":1.141},"min":{"1min":0.32100000000000001,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":4.1289999999999996,"5min":35.072000000000003,"15min":35.072000000000003},"last":2.0339999999999998},{"interface":"front","average":{"1min":0.79700000000000004,"5min":2.198,"15min":1.1180000000000001},"min":{"1min":0.40200000000000002,"5min":0.247,"15min":0.247},"max":{"1min":4.1390000000000002,"5min":35.103000000000002,"15min":35.103000000000002},"last":1.6339999999999999}]},{"osd":3,"last update":"Sat Feb 10 08:24:32 2024","interfaces":[{"interface":"back","average":{"1min":1.5469999999999999,"5min":1.7130000000000001,"15min":0.94799999999999995},"min":{"1min":0.36699999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":11.448,"5min":15.212999999999999,"15min":15.212999999999999},"last":0.34200000000000003},{"interface":"front","average":{"1min":1.395,"5min":2.0129999999999999,"15min":1.0429999999999999},"min":{"1min":0.34699999999999998,"5min":0.308,"15min":0.308},"max":{"1min":5.9059999999999997,"5min":17.797000000000001,"15min":17.797000000000001},"last":0.40600000000000003}]},{"osd":4,"last update":"Sat Feb 10 08:23:51 2024","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":0.627,"15min":0.53900000000000003},"min":{"1min":0.27200000000000002,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":5.468,"5min":5.468,"15min":5.468},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.60499999999999998,"15min":0.59099999999999997},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":3.371,"5min":3.4220000000000002,"15min":3.4220000000000002},"last":0.47999999999999998}]},{"osd":5,"last update":"Sat Feb 10 08:24:32 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.55100000000000005,"15min":0.49099999999999999},"min":{"1min":0.30299999999999999,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.91400000000000003,"5min":5.4989999999999997,"15min":5.4989999999999997},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.58599999999999997,"15min":0.50700000000000001},"min":{"1min":0.317,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":1.2110000000000001,"5min":4.3570000000000002,"15min":4.3570000000000002},"last":0.36599999999999999}]},{"osd":7,"last update":"Sat Feb 10 08:23:56 2024","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.55300000000000005,"15min":0.54000000000000004},"min":{"1min":0.29499999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":3.6360000000000001,"5min":3.6360000000000001,"15min":3.6360000000000001},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.61299999999999999,"15min":0.58899999999999997},"min":{"1min":0.34000000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":3.7080000000000002,"5min":5.0339999999999998,"15min":5.0339999999999998},"last":0.45900000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574974,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":748528,"kb_used_data":439016,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":92996624,"statfs":{"total":95995035648,"available":95228542976,"internally_reserved":0,"allocated":449552384,"data_stored":448602298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:24:34 2024","interfaces":[{"interface":"back","average":{"1min":2.0419999999999998,"5min":3.4289999999999998,"15min":1.367},"min":{"1min":0.20799999999999999,"5min":0.185,"15min":0.185},"max":{"1min":13.316000000000001,"5min":29.763999999999999,"15min":29.763999999999999},"last":1.48},{"interface":"front","average":{"1min":2.3290000000000002,"5min":3.6299999999999999,"15min":1.4419999999999999},"min":{"1min":0.246,"5min":0.185,"15min":0.185},"max":{"1min":21.405000000000001,"5min":29.637,"15min":29.637},"last":0.80400000000000005}]},{"osd":2,"last update":"Sat Feb 10 08:24:01 2024","interfaces":[{"interface":"back","average":{"1min":5.8940000000000001,"5min":3.5990000000000002,"15min":1.4470000000000001},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":31.420999999999999,"5min":31.420999999999999,"15min":31.420999999999999},"last":0.88400000000000001},{"interface":"front","average":{"1min":6.282,"5min":3.8140000000000001,"15min":1.522},"min":{"1min":0.311,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":31.484999999999999,"5min":31.484999999999999,"15min":31.484999999999999},"last":2.2629999999999999}]},{"osd":3,"last update":"Sat Feb 10 08:24:25 2024","interfaces":[{"interface":"back","average":{"1min":2.6930000000000001,"5min":3.629,"15min":1.512},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":19.096,"5min":28.082000000000001,"15min":28.082000000000001},"last":1.5449999999999999},{"interface":"front","average":{"1min":2.46,"5min":3.1560000000000001,"15min":1.3400000000000001},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.20300000000000001},"max":{"1min":21.103999999999999,"5min":29.722000000000001,"15min":29.722000000000001},"last":1.4359999999999999}]},{"osd":4,"last update":"Sat Feb 10 08:23:49 2024","interfaces":[{"interface":"back","average":{"1min":2.8439999999999999,"5min":2.524,"15min":2.3940000000000001},"min":{"1min":0.35699999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":14.086,"5min":14.086,"15min":14.086},"last":1.0349999999999999},{"interface":"front","average":{"1min":4.548,"5min":3.0350000000000001,"15min":2.7629999999999999},"min":{"1min":0.41999999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":31.515000000000001,"5min":31.515000000000001,"15min":31.515000000000001},"last":1.591}]},{"osd":5,"last update":"Sat Feb 10 08:24:09 2024","interfaces":[{"interface":"back","average":{"1min":2.6779999999999999,"5min":2.2589999999999999,"15min":1.1359999999999999},"min":{"1min":0.44700000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":14.061999999999999,"5min":14.061999999999999,"15min":14.061999999999999},"last":0.92500000000000004},{"interface":"front","average":{"1min":3.6880000000000002,"5min":2.4740000000000002,"15min":1.232},"min":{"1min":0.39700000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":31.542000000000002,"5min":31.542000000000002,"15min":31.542000000000002},"last":1.617}]},{"osd":6,"last update":"Sat Feb 10 08:24:34 2024","interfaces":[{"interface":"back","average":{"1min":3.2850000000000001,"5min":2.4369999999999998,"15min":1.21},"min":{"1min":0.378,"5min":0.311,"15min":0.311},"max":{"1min":31.27,"5min":31.27,"15min":31.27},"last":1.569},{"interface":"front","average":{"1min":1.7270000000000001,"5min":1.8640000000000001,"15min":1.0329999999999999},"min":{"1min":0.41099999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":10.238,"5min":10.433,"15min":10.433},"last":1.512}]},{"osd":7,"last update":"Sat Feb 10 08:24:01 2024","interfaces":[{"interface":"back","average":{"1min":4.5099999999999998,"5min":2.5459999999999998,"15min":1.226},"min":{"1min":0.44400000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":31.344999999999999,"5min":31.344999999999999,"15min":31.344999999999999},"last":1.651},{"interface":"front","average":{"1min":2.9049999999999998,"5min":1.9410000000000001,"15min":1.0409999999999999},"min":{"1min":0.371,"5min":0.312,"15min":0.312},"max":{"1min":14.872,"5min":14.872,"15min":14.872},"last":1.7529999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738498,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":338740,"kb_used_data":25132,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93406412,"statfs":{"total":95995035648,"available":95648165888,"internally_reserved":0,"allocated":25735168,"data_stored":24832050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 10 08:23:39 2024","interfaces":[{"interface":"back","average":{"1min":10.398999999999999,"5min":4.2709999999999999,"15min":1.6499999999999999},"min":{"1min":0.14399999999999999,"5min":0.14399999999999999,"15min":0.14399999999999999},"max":{"1min":102.48099999999999,"5min":102.48099999999999,"15min":102.48099999999999},"last":3.633},{"interface":"front","average":{"1min":9.0429999999999993,"5min":3.9390000000000001,"15min":1.542},"min":{"1min":0.23899999999999999,"5min":0.193,"15min":0.193},"max":{"1min":103.38800000000001,"5min":103.38800000000001,"15min":103.38800000000001},"last":1.381}]},{"osd":2,"last update":"Sat Feb 10 08:23:56 2024","interfaces":[{"interface":"back","average":{"1min":8.702,"5min":4.6180000000000003,"15min":1.7969999999999999},"min":{"1min":0.27100000000000002,"5min":0.25600000000000001,"15min":0.23499999999999999},"max":{"1min":102.462,"5min":102.462,"15min":102.462},"last":0.71799999999999997},{"interface":"front","average":{"1min":9.2520000000000007,"5min":4.3079999999999998,"15min":1.698},"min":{"1min":0.34599999999999997,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":102.66500000000001,"5min":102.66500000000001,"15min":102.66500000000001},"last":3.6589999999999998}]},{"osd":3,"last update":"Sat Feb 10 08:24:26 2024","interfaces":[{"interface":"back","average":{"1min":1.9390000000000001,"5min":3.5409999999999999,"15min":1.47},"min":{"1min":0.28599999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":11.936999999999999,"5min":16.495000000000001,"15min":16.495000000000001},"last":1.2609999999999999},{"interface":"front","average":{"1min":6.6399999999999997,"5min":4.5620000000000003,"15min":1.8149999999999999},"min":{"1min":0.309,"5min":0.29799999999999999,"15min":0.246},"max":{"1min":102.64400000000001,"5min":102.64400000000001,"15min":102.64400000000001},"last":3.528}]},{"osd":4,"last update":"Sat Feb 10 08:23:51 2024","interfaces":[{"interface":"back","average":{"1min":7.6829999999999998,"5min":4.4980000000000002,"15min":4.0490000000000004},"min":{"1min":0.30399999999999999,"5min":0.253,"15min":0.253},"max":{"1min":102.742,"5min":102.742,"15min":102.742},"last":1.494},{"interface":"front","average":{"1min":2.339,"5min":2.214,"15min":2.0609999999999999},"min":{"1min":0.26400000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":8.1669999999999998,"5min":16.352,"15min":16.352},"last":1.296}]},{"osd":5,"last update":"Sat Feb 10 08:24:18 2024","interfaces":[{"interface":"back","average":{"1min":6.7400000000000002,"5min":3.1789999999999998,"15min":1.4530000000000001},"min":{"1min":0.373,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":102.53100000000001,"5min":102.53100000000001,"15min":102.53100000000001},"last":0.85499999999999998},{"interface":"front","average":{"1min":2.4140000000000001,"5min":2.073,"15min":1.077},"min":{"1min":0.34599999999999997,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":10.103,"5min":16.463999999999999,"15min":16.463999999999999},"last":1.405}]},{"osd":6,"last update":"Sat Feb 10 08:23:39 2024","interfaces":[{"interface":"back","average":{"1min":8.5239999999999991,"5min":3.21,"15min":1.468},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":102.583,"5min":102.583,"15min":102.583},"last":0.81999999999999995},{"interface":"front","average":{"1min":2.7989999999999999,"5min":1.869,"15min":1.0529999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":8.2590000000000003,"5min":16.391999999999999,"15min":16.391999999999999},"last":1.355}]},{"osd":7,"last update":"Sat Feb 10 08:23:56 2024","interfaces":[{"interface":"back","average":{"1min":8.5510000000000002,"5min":3.383,"15min":1.5269999999999999},"min":{"1min":0.42299999999999999,"5min":0.35299999999999998,"15min":0.34100000000000003},"max":{"1min":102.627,"5min":102.627,"15min":102.627},"last":0.88300000000000001},{"interface":"front","average":{"1min":2.4900000000000002,"5min":1.992,"15min":1.0629999999999999},"min":{"1min":0.33100000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":8.234,"5min":16.422000000000001,"15min":16.422000000000001},"last":1.323}]}]},{"osd":2,"up_from":18,"seq":77309411449,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":311424,"kb_used_data":1912,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93433728,"statfs":{"total":95995035648,"available":95676137472,"internally_reserved":0,"allocated":1957888,"data_stored":1042633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:24:00 2024","interfaces":[{"interface":"back","average":{"1min":4.5609999999999999,"5min":3.4049999999999998,"15min":1.369},"min":{"1min":0.30199999999999999,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":20.898,"5min":24.859999999999999,"15min":24.859999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":4.7039999999999997,"5min":4.141,"15min":1.6259999999999999},"min":{"1min":0.29399999999999998,"5min":0.193,"15min":0.193},"max":{"1min":20.734999999999999,"5min":28.295999999999999,"15min":28.295999999999999},"last":0.622}]},{"osd":1,"last update":"Sat Feb 10 08:24:00 2024","interfaces":[{"interface":"back","average":{"1min":2.9540000000000002,"5min":2.419,"15min":1.0529999999999999},"min":{"1min":0.30399999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":12.853,"5min":15.644,"15min":15.644},"last":1.625},{"interface":"front","average":{"1min":3.7469999999999999,"5min":2.2040000000000002,"15min":0.99099999999999999},"min":{"1min":0.23599999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":16.968,"5min":16.968,"15min":16.968},"last":0.91500000000000004}]},{"osd":3,"last update":"Sat Feb 10 08:24:24 2024","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":2.944,"15min":1.284},"min":{"1min":0.28699999999999998,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":4.75,"5min":24.946000000000002,"15min":24.946000000000002},"last":1.5840000000000001},{"interface":"front","average":{"1min":2.3969999999999998,"5min":3.5760000000000001,"15min":1.488},"min":{"1min":0.34799999999999998,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":13.694000000000001,"5min":24.905000000000001,"15min":24.905000000000001},"last":0.83299999999999996}]},{"osd":4,"last update":"Sat Feb 10 08:23:49 2024","interfaces":[{"interface":"back","average":{"1min":1.897,"5min":2.4729999999999999,"15min":2.4489999999999998},"min":{"1min":0.34499999999999997,"5min":0.307,"15min":0.307},"max":{"1min":6.6420000000000003,"5min":13.260999999999999,"15min":13.260999999999999},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.5700000000000001,"5min":1.6319999999999999,"15min":1.413},"min":{"1min":0.28699999999999998,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":9.5190000000000001,"5min":15.696,"15min":15.696},"last":0.872}]},{"osd":5,"last update":"Sat Feb 10 08:24:08 2024","interfaces":[{"interface":"back","average":{"1min":2.238,"5min":2.157,"15min":1.0980000000000001},"min":{"1min":0.29999999999999999,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":8.4499999999999993,"5min":13.939,"15min":13.939},"last":1.079},{"interface":"front","average":{"1min":1.927,"5min":1.921,"15min":1.0189999999999999},"min":{"1min":0.41599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":6.6879999999999997,"5min":13.317,"15min":13.317},"last":1.0129999999999999}]},{"osd":6,"last update":"Sat Feb 10 08:23:40 2024","interfaces":[{"interface":"back","average":{"1min":2.879,"5min":1.9750000000000001,"15min":1.048},"min":{"1min":0.309,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":13.893000000000001,"5min":13.893000000000001,"15min":13.893000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":1.466,"5min":1.8080000000000001,"15min":1.006},"min":{"1min":0.40799999999999997,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":3.637,"5min":13.292,"15min":13.292},"last":0.98199999999999998}]},{"osd":7,"last update":"Sat Feb 10 08:24:00 2024","interfaces":[{"interface":"back","average":{"1min":1.968,"5min":1.974,"15min":1.0629999999999999},"min":{"1min":0.378,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":4.3390000000000004,"5min":13.231999999999999,"15min":13.231999999999999},"last":1.6599999999999999},{"interface":"front","average":{"1min":1.667,"5min":1.573,"15min":0.93100000000000005},"min":{"1min":0.312,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":9.4900000000000002,"5min":15.714,"15min":15.714},"last":0.80500000000000005}]}]},{"osd":3,"up_from":25,"seq":107374182516,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":317980,"kb_used_data":12564,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93427172,"statfs":{"total":95995035648,"available":95669424128,"internally_reserved":0,"allocated":12865536,"data_stored":11985548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:24:22 2024","interfaces":[{"interface":"back","average":{"1min":2.194,"5min":2.9180000000000001,"15min":1.222},"min":{"1min":0.23999999999999999,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":14.167,"5min":14.167,"15min":14.167},"last":0.22600000000000001},{"interface":"front","average":{"1min":2.4079999999999999,"5min":2.5390000000000001,"15min":1.123},"min":{"1min":0.25900000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":16.721,"5min":26.643000000000001,"15min":26.643000000000001},"last":0.28799999999999998}]},{"osd":1,"last update":"Sat Feb 10 08:24:22 2024","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":2.4670000000000001,"15min":1.111},"min":{"1min":0.255,"5min":0.218,"15min":0.218},"max":{"1min":6.2210000000000001,"5min":12.782999999999999,"15min":12.782999999999999},"last":0.27900000000000003},{"interface":"front","average":{"1min":3.2490000000000001,"5min":2.661,"15min":1.1870000000000001},"min":{"1min":0.28000000000000003,"5min":0.191,"15min":0.191},"max":{"1min":21.373999999999999,"5min":21.373999999999999,"15min":21.373999999999999},"last":0.31900000000000001}]},{"osd":2,"last update":"Sat Feb 10 08:24:22 2024","interfaces":[{"interface":"back","average":{"1min":2.9870000000000001,"5min":2.569,"15min":1.155},"min":{"1min":0.26900000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":21.434000000000001,"5min":21.434000000000001,"15min":21.434000000000001},"last":0.374},{"interface":"front","average":{"1min":1.9299999999999999,"5min":2.4860000000000002,"15min":1.1279999999999999},"min":{"1min":0.309,"5min":0.28699999999999998,"15min":0.27200000000000002},"max":{"1min":16.757999999999999,"5min":18.061,"15min":18.061},"last":0.34499999999999997}]},{"osd":4,"last update":"Sat Feb 10 08:23:48 2024","interfaces":[{"interface":"back","average":{"1min":2.528,"5min":1.79,"15min":1.7589999999999999},"min":{"1min":0.34699999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":8.0630000000000006,"5min":12.272,"15min":12.272},"last":0.82799999999999996},{"interface":"front","average":{"1min":4.0330000000000004,"5min":2.5630000000000002,"15min":2.4769999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":12.391999999999999,"5min":12.391999999999999,"15min":12.391999999999999},"last":0.76200000000000001}]},{"osd":5,"last update":"Sat Feb 10 08:24:16 2024","interfaces":[{"interface":"back","average":{"1min":1.669,"5min":1.254,"15min":0.81399999999999995},"min":{"1min":0.377,"5min":0.249,"15min":0.249},"max":{"1min":8.1080000000000005,"5min":12.388999999999999,"15min":12.388999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":2.2599999999999998,"5min":2.0230000000000001,"15min":1.0720000000000001},"min":{"1min":0.38800000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":10.217000000000001,"5min":12.438000000000001,"15min":12.438000000000001},"last":0.63800000000000001}]},{"osd":6,"last update":"Sat Feb 10 08:24:36 2024","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":2.0259999999999998,"15min":1.0549999999999999},"min":{"1min":0.41799999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":5.117,"5min":12.477,"15min":12.477},"last":0.58799999999999997},{"interface":"front","average":{"1min":1.236,"5min":1.325,"15min":0.83299999999999996},"min":{"1min":0.36099999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":6.7080000000000002,"5min":12.324999999999999,"15min":12.324999999999999},"last":0.77600000000000002}]},{"osd":7,"last update":"Sat Feb 10 08:23:56 2024","interfaces":[{"interface":"back","average":{"1min":2.0920000000000001,"5min":1.321,"15min":0.82499999999999996},"min":{"1min":0.40799999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":8.1739999999999995,"5min":12.358000000000001,"15min":12.358000000000001},"last":0.84399999999999997},{"interface":"front","average":{"1min":3.7999999999999998,"5min":1.986,"15min":1.0429999999999999},"min":{"1min":0.32500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":15.702,"5min":15.702,"15min":15.702},"last":0.66700000000000004}]}]},{"osd":4,"up_from":110,"seq":472446402608,"num_pgs":65,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":431760,"kb_used_data":121608,"kb_used_omap":0,"kb_used_meta":310143,"kb_avail":93313392,"statfs":{"total":95995035648,"available":95552913408,"internally_reserved":0,"allocated":124526592,"data_stored":123601386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":972,"internal_metadata":317586484},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:23:53 2024","interfaces":[{"interface":"back","average":{"1min":1.8480000000000001,"5min":1.4950000000000001,"15min":1.2150000000000001},"min":{"1min":0.23899999999999999,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":6.1879999999999997,"5min":11.257999999999999,"15min":11.257999999999999},"last":0.46800000000000003},{"interface":"front","average":{"1min":3.806,"5min":3.2149999999999999,"15min":3.2690000000000001},"min":{"1min":0.26800000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":16.524000000000001,"5min":16.524000000000001,"15min":16.524000000000001},"last":0.38600000000000001}]},{"osd":1,"last update":"Sat Feb 10 08:23:53 2024","interfaces":[{"interface":"back","average":{"1min":1.4730000000000001,"5min":2.0800000000000001,"15min":2.2130000000000001},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":7.5620000000000003,"5min":7.8230000000000004,"15min":7.8230000000000004},"last":0.57299999999999995},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.9359999999999999,"15min":2.0539999999999998},"min":{"1min":0.27500000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":7.569,"5min":7.8140000000000001,"15min":7.8140000000000001},"last":0.49399999999999999}]},{"osd":2,"last update":"Sat Feb 10 08:23:53 2024","interfaces":[{"interface":"back","average":{"1min":2.0790000000000002,"5min":2.1179999999999999,"15min":2.0939999999999999},"min":{"1min":0.26100000000000001,"5min":0.25,"15min":0.25},"max":{"1min":8.7870000000000008,"5min":8.9930000000000003,"15min":8.9930000000000003},"last":0.498},{"interface":"front","average":{"1min":2.2429999999999999,"5min":2.1800000000000002,"15min":2.1920000000000002},"min":{"1min":0.34499999999999997,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":8.9309999999999992,"5min":8.9309999999999992,"15min":8.9309999999999992},"last":0.48099999999999998}]},{"osd":3,"last update":"Sat Feb 10 08:23:53 2024","interfaces":[{"interface":"back","average":{"1min":2.7410000000000001,"5min":2.3290000000000002,"15min":2.2909999999999999},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":12.565,"5min":12.565,"15min":12.565},"last":0.52600000000000002},{"interface":"front","average":{"1min":1.663,"5min":1.9059999999999999,"15min":1.8280000000000001},"min":{"1min":0.27700000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":6.9400000000000004,"5min":11.648,"15min":11.648},"last":0.53700000000000003}]},{"osd":5,"last update":"Sat Feb 10 08:23:53 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.55700000000000005,"15min":0.56799999999999995},"min":{"1min":0.24199999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":2.8420000000000001,"5min":3.3839999999999999,"15min":3.3839999999999999},"last":0.37},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.79100000000000004,"15min":0.77600000000000002},"min":{"1min":0.28399999999999997,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":3.4990000000000001,"5min":5.1980000000000004,"15min":5.1980000000000004},"last":0.45300000000000001}]},{"osd":6,"last update":"Sat Feb 10 08:23:53 2024","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.66500000000000004,"15min":0.66000000000000003},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":3.9340000000000002,"5min":3.9340000000000002,"15min":3.9340000000000002},"last":0.41599999999999998},{"interface":"front","average":{"1min":1.012,"5min":0.876,"15min":0.83399999999999996},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":3.9580000000000002,"5min":4.8010000000000002,"15min":4.8010000000000002},"last":0.60399999999999998}]},{"osd":7,"last update":"Sat Feb 10 08:23:53 2024","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.84099999999999997,"15min":0.85499999999999998},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":3.6179999999999999,"5min":3.6179999999999999,"15min":3.6179999999999999},"last":0.63},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.57799999999999996,"15min":0.52700000000000002},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":2.9750000000000001,"5min":2.9750000000000001,"15min":2.9750000000000001},"last":0.433}]}]},{"osd":5,"up_from":37,"seq":158913790060,"num_pgs":65,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":783252,"kb_used_data":481932,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":92961900,"statfs":{"total":95995035648,"available":95192985600,"internally_reserved":0,"allocated":493498368,"data_stored":492576203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:24:07 2024","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":2.2240000000000002,"15min":1.1279999999999999},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":4.8170000000000002,"5min":22.914000000000001,"15min":22.914000000000001},"last":0.96399999999999997},{"interface":"front","average":{"1min":1.286,"5min":1.835,"15min":0.95699999999999996},"min":{"1min":0.23400000000000001,"5min":0.219,"15min":0.219},"max":{"1min":6.1669999999999998,"5min":23.161000000000001,"15min":23.161000000000001},"last":0.23999999999999999}]},{"osd":1,"last update":"Sat Feb 10 08:24:07 2024","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.2410000000000001,"15min":0.78400000000000003},"min":{"1min":0.223,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":5.4720000000000004,"5min":8.1289999999999996,"15min":8.1289999999999996},"last":1.9450000000000001},{"interface":"front","average":{"1min":1.365,"5min":1.4330000000000001,"15min":0.83899999999999997},"min":{"1min":0.27900000000000003,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":6.9660000000000002,"5min":6.9660000000000002,"15min":6.9660000000000002},"last":0.34899999999999998}]},{"osd":2,"last update":"Sat Feb 10 08:24:07 2024","interfaces":[{"interface":"back","average":{"1min":1.7669999999999999,"5min":2.1539999999999999,"15min":1.095},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":8.657,"5min":9.5709999999999997,"15min":9.5709999999999997},"last":0.30199999999999999},{"interface":"front","average":{"1min":1.149,"5min":1.579,"15min":0.91600000000000004},"min":{"1min":0.31900000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":5.3390000000000004,"5min":9.2810000000000006,"15min":9.2810000000000006},"last":0.625}]},{"osd":3,"last update":"Sat Feb 10 08:24:07 2024","interfaces":[{"interface":"back","average":{"1min":1.484,"5min":1.788,"15min":0.98199999999999998},"min":{"1min":0.34399999999999997,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":6.117,"5min":24.198,"15min":24.198},"last":0.432},{"interface":"front","average":{"1min":1.119,"5min":2.024,"15min":1.052},"min":{"1min":0.318,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":9.1159999999999997,"5min":22.701000000000001,"15min":22.701000000000001},"last":0.46700000000000003}]},{"osd":4,"last update":"Sat Feb 10 08:23:47 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.60799999999999998,"15min":0.58199999999999996},"min":{"1min":0.24199999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":5.6509999999999998,"5min":5.6509999999999998,"15min":5.6509999999999998},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.54400000000000004,"15min":0.49199999999999999},"min":{"1min":0.27900000000000003,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":1.8280000000000001,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":0.40000000000000002}]},{"osd":6,"last update":"Sat Feb 10 08:24:36 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.57499999999999996,"15min":0.45300000000000001},"min":{"1min":0.254,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":1.5049999999999999,"5min":3.8690000000000002,"15min":3.8690000000000002},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.65500000000000003,"15min":0.51300000000000001},"min":{"1min":0.34699999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":1.923,"5min":5.0529999999999999,"15min":5.0529999999999999},"last":0.38600000000000001}]},{"osd":7,"last update":"Sat Feb 10 08:23:57 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.57599999999999996,"15min":0.48299999999999998},"min":{"1min":0.32100000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":2.4239999999999999,"5min":2.5449999999999999,"15min":2.5449999999999999},"last":0.41099999999999998},{"interface":"front","average":{"1min":1.367,"5min":0.746,"15min":0.53300000000000003},"min":{"1min":0.34200000000000003,"5min":0.251,"15min":0.251},"max":{"1min":8.3230000000000004,"5min":8.3230000000000004,"15min":8.3230000000000004},"last":0.42299999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":2118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":1832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":39714816,"data_stored":39714816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":455868416,"data_stored":455868416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":39911424,"data_stored":39911424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":30932992,"data_stored":30932992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":157745152,"data_stored":157745152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":566820864,"data_stored":566820864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":315031552,"data_stored":315031552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":311689216,"data_stored":311689216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-10T08:24:46.144 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd pool set default.rgw.log pgp_num 32 2024-02-10T08:24:46.216 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:24:46.255 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:44.695845+0000 mgr.y (mgr.14505) 305 : cluster [DBG] pgmap v362: 158 pgs: 158 active+clean; 1016 MiB data, 5.1 GiB used, 710 GiB / 715 GiB avail; 1.2 KiB/s rd, 127 MiB/s wr, 2.03k op/s 2024-02-10T08:24:46.255 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:45.189714+0000 osd.4 (osd.4) 10 : cluster [DBG] 6.e scrub starts 2024-02-10T08:24:46.255 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:45.194611+0000 osd.4 (osd.4) 11 : cluster [DBG] 6.e scrub ok 2024-02-10T08:24:46.257 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:46.282 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:24:46.285 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:46.285 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:24:46.332 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 9 16 22752 22736 157.826 136 0.0097326 0.00632999 2024-02-10T08:24:46.386 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:24:46.460 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:46.789 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:24:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:24:46] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:24:46.858 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:24:46.858 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:24:46.883 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:24:46.890 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:24:46.937 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:24:46.977 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:24:47.007 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:24:47.028 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:45.802092+0000 osd.5 (osd.5) 91 : cluster [DBG] 2.1e scrub starts 2024-02-10T08:24:47.028 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:45.805575+0000 osd.5 (osd.5) 92 : cluster [DBG] 2.1e scrub ok 2024-02-10T08:24:47.028 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:45.944744+0000 osd.2 (osd.2) 83 : cluster [DBG] 5.8 scrub starts 2024-02-10T08:24:47.028 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:45.946706+0000 osd.2 (osd.2) 84 : cluster [DBG] 5.8 scrub ok 2024-02-10T08:24:47.028 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:24:46.634543+0000 mon.a (mon.0) 1102 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:24:47.028 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:24:46.786488+0000 mon.b (mon.1) 54 : audit [DBG] from='client.? 172.21.15.18:0/2745126159' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:24:47.029 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:45.802092+0000 osd.5 (osd.5) 91 : cluster [DBG] 2.1e scrub starts 2024-02-10T08:24:47.029 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:45.805575+0000 osd.5 (osd.5) 92 : cluster [DBG] 2.1e scrub ok 2024-02-10T08:24:47.029 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:45.944744+0000 osd.2 (osd.2) 83 : cluster [DBG] 5.8 scrub starts 2024-02-10T08:24:47.029 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:45.946706+0000 osd.2 (osd.2) 84 : cluster [DBG] 5.8 scrub ok 2024-02-10T08:24:47.029 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:24:46.634543+0000 mon.a (mon.0) 1102 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:24:47.029 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:24:46.786488+0000 mon.b (mon.1) 54 : audit [DBG] from='client.? 172.21.15.18:0/2745126159' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:24:47.037 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:24:47.070 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:24:47.074 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-10T08:24:47.074 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-10T08:24:47.074 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-10T08:24:47.074 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-10T08:24:47.074 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-10T08:24:47.074 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-10T08:24:47.074 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-10T08:24:47.074 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-10T08:24:47.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:45.802092+0000 osd.5 (osd.5) 91 : cluster [DBG] 2.1e scrub starts 2024-02-10T08:24:47.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:45.805575+0000 osd.5 (osd.5) 92 : cluster [DBG] 2.1e scrub ok 2024-02-10T08:24:47.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:45.944744+0000 osd.2 (osd.2) 83 : cluster [DBG] 5.8 scrub starts 2024-02-10T08:24:47.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:45.946706+0000 osd.2 (osd.2) 84 : cluster [DBG] 5.8 scrub ok 2024-02-10T08:24:47.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:24:46.634543+0000 mon.a (mon.0) 1102 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:24:47.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:24:46.786488+0000 mon.b (mon.1) 54 : audit [DBG] from='client.? 172.21.15.18:0/2745126159' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:24:47.333 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 10 16 24596 24580 153.553 115.25 0.00307162 0.00650604 2024-02-10T08:24:47.407 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:24:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:24:47] "GET /metrics HTTP/1.1" 200 175897 "" "Prometheus/2.33.4" 2024-02-10T08:24:47.525 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:24:47.534 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:47.535 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:24:47.636 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:24:47.687 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:47.867 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:46.385537+0000 osd.7 (osd.7) 95 : cluster [DBG] 5.1a scrub starts 2024-02-10T08:24:47.867 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:46.389587+0000 osd.7 (osd.7) 96 : cluster [DBG] 5.1a scrub ok 2024-02-10T08:24:47.867 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:46.698354+0000 mgr.y (mgr.14505) 306 : cluster [DBG] pgmap v363: 158 pgs: 158 active+clean; 1016 MiB data, 5.1 GiB used, 710 GiB / 715 GiB avail; 639 B/s rd, 120 MiB/s wr, 1.92k op/s 2024-02-10T08:24:47.867 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:46.830708+0000 osd.5 (osd.5) 93 : cluster [DBG] 2.3 scrub starts 2024-02-10T08:24:47.867 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:46.833854+0000 osd.5 (osd.5) 94 : cluster [DBG] 2.3 scrub ok 2024-02-10T08:24:48.048 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:24:48.058 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:48.059 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:24:48.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:46.385537+0000 osd.7 (osd.7) 95 : cluster [DBG] 5.1a scrub starts 2024-02-10T08:24:48.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:46.389587+0000 osd.7 (osd.7) 96 : cluster [DBG] 5.1a scrub ok 2024-02-10T08:24:48.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:46.698354+0000 mgr.y (mgr.14505) 306 : cluster [DBG] pgmap v363: 158 pgs: 158 active+clean; 1016 MiB data, 5.1 GiB used, 710 GiB / 715 GiB avail; 639 B/s rd, 120 MiB/s wr, 1.92k op/s 2024-02-10T08:24:48.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:46.830708+0000 osd.5 (osd.5) 93 : cluster [DBG] 2.3 scrub starts 2024-02-10T08:24:48.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:46.833854+0000 osd.5 (osd.5) 94 : cluster [DBG] 2.3 scrub ok 2024-02-10T08:24:48.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:46.903118+0000 osd.6 (osd.6) 61 : cluster [DBG] 5.11 scrub starts 2024-02-10T08:24:48.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:46.903952+0000 osd.6 (osd.6) 62 : cluster [DBG] 5.11 scrub ok 2024-02-10T08:24:48.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:47.520544+0000 osd.1 (osd.1) 94 : cluster [DBG] 5.0 deep-scrub starts 2024-02-10T08:24:48.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:47.529431+0000 osd.1 (osd.1) 95 : cluster [DBG] 5.0 deep-scrub ok 2024-02-10T08:24:48.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:46.903118+0000 osd.6 (osd.6) 61 : cluster [DBG] 5.11 scrub starts 2024-02-10T08:24:48.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:46.903952+0000 osd.6 (osd.6) 62 : cluster [DBG] 5.11 scrub ok 2024-02-10T08:24:48.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:47.520544+0000 osd.1 (osd.1) 94 : cluster [DBG] 5.0 deep-scrub starts 2024-02-10T08:24:48.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:47.529431+0000 osd.1 (osd.1) 95 : cluster [DBG] 5.0 deep-scrub ok 2024-02-10T08:24:48.160 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:24:48.199 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:24:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:24:48.200 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:46.385537+0000 osd.7 (osd.7) 95 : cluster [DBG] 5.1a scrub starts 2024-02-10T08:24:48.200 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:46.389587+0000 osd.7 (osd.7) 96 : cluster [DBG] 5.1a scrub ok 2024-02-10T08:24:48.200 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:46.698354+0000 mgr.y (mgr.14505) 306 : cluster [DBG] pgmap v363: 158 pgs: 158 active+clean; 1016 MiB data, 5.1 GiB used, 710 GiB / 715 GiB avail; 639 B/s rd, 120 MiB/s wr, 1.92k op/s 2024-02-10T08:24:48.200 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:46.830708+0000 osd.5 (osd.5) 93 : cluster [DBG] 2.3 scrub starts 2024-02-10T08:24:48.200 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:46.833854+0000 osd.5 (osd.5) 94 : cluster [DBG] 2.3 scrub ok 2024-02-10T08:24:48.200 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:46.903118+0000 osd.6 (osd.6) 61 : cluster [DBG] 5.11 scrub starts 2024-02-10T08:24:48.200 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:46.903952+0000 osd.6 (osd.6) 62 : cluster [DBG] 5.11 scrub ok 2024-02-10T08:24:48.200 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:47.520544+0000 osd.1 (osd.1) 94 : cluster [DBG] 5.0 deep-scrub starts 2024-02-10T08:24:48.200 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:47.529431+0000 osd.1 (osd.1) 95 : cluster [DBG] 5.0 deep-scrub ok 2024-02-10T08:24:48.206 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:48.233 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:24:48.237 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:48.238 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:24:48.333 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 11 16 26772 26756 151.957 136 0.00785676 0.00657431 2024-02-10T08:24:48.339 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:24:48.393 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:48.559 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:24:48.563 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:48.564 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:24:48.664 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:24:48.717 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:48.828 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:24:48.831 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:48.831 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:24:48.932 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:24:48.976 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:49.007 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:24:49.011 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:49.011 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:24:49.112 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:24:49.148 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:47.271077+0000 osd.0 (osd.0) 94 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:24:49.149 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:47.271130+0000 osd.0 (osd.0) 95 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:24:49.149 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:47.781813+0000 osd.5 (osd.5) 95 : cluster [DBG] 6.d scrub starts 2024-02-10T08:24:49.149 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:47.799291+0000 osd.5 (osd.5) 96 : cluster [DBG] 6.d scrub ok 2024-02-10T08:24:49.149 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:47.876827+0000 mon.a (mon.0) 1103 : cluster [DBG] osdmap e200: 8 total, 8 up, 8 in 2024-02-10T08:24:49.149 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:24:47.917372+0000 mgr.y (mgr.14505) 307 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:24:49.153 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:49.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:47.271077+0000 osd.0 (osd.0) 94 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:24:49.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:47.271130+0000 osd.0 (osd.0) 95 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:24:49.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:47.781813+0000 osd.5 (osd.5) 95 : cluster [DBG] 6.d scrub starts 2024-02-10T08:24:49.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:47.799291+0000 osd.5 (osd.5) 96 : cluster [DBG] 6.d scrub ok 2024-02-10T08:24:49.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:47.876827+0000 mon.a (mon.0) 1103 : cluster [DBG] osdmap e200: 8 total, 8 up, 8 in 2024-02-10T08:24:49.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:24:47.917372+0000 mgr.y (mgr.14505) 307 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:24:49.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:47.271077+0000 osd.0 (osd.0) 94 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:24:49.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:47.271130+0000 osd.0 (osd.0) 95 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:24:49.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:47.781813+0000 osd.5 (osd.5) 95 : cluster [DBG] 6.d scrub starts 2024-02-10T08:24:49.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:47.799291+0000 osd.5 (osd.5) 96 : cluster [DBG] 6.d scrub ok 2024-02-10T08:24:49.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:47.876827+0000 mon.a (mon.0) 1103 : cluster [DBG] osdmap e200: 8 total, 8 up, 8 in 2024-02-10T08:24:49.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:24:47.917372+0000 mgr.y (mgr.14505) 307 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:24:49.179 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:24:49.183 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:49.183 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:24:49.284 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:24:49.334 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 12 16 28655 28639 149.101 117.688 0.0118793 0.00670024 2024-02-10T08:24:49.349 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:49.915 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is set 2024-02-10T08:24:50.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:48.369918+0000 osd.2 (osd.2) 85 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:24:50.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:48.369979+0000 osd.2 (osd.2) 86 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:24:50.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:48.698877+0000 mgr.y (mgr.14505) 308 : cluster [DBG] pgmap v365: 158 pgs: 158 active+clean; 1.5 GiB data, 6.7 GiB used, 709 GiB / 715 GiB avail; 1.1 KiB/s rd, 160 MiB/s wr, 2.56k op/s 2024-02-10T08:24:50.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:48.737245+0000 osd.5 (osd.5) 97 : cluster [DBG] 2.12 scrub starts 2024-02-10T08:24:50.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:48.740781+0000 osd.5 (osd.5) 98 : cluster [DBG] 2.12 scrub ok 2024-02-10T08:24:50.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:48.853596+0000 osd.0 (osd.0) 96 : cluster [DBG] 6.0 scrub starts 2024-02-10T08:24:50.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:48.866663+0000 osd.0 (osd.0) 97 : cluster [DBG] 6.0 scrub ok 2024-02-10T08:24:50.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:48.891564+0000 mon.a (mon.0) 1104 : cluster [DBG] osdmap e201: 8 total, 8 up, 8 in 2024-02-10T08:24:50.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:48.905133+0000 osd.6 (osd.6) 63 : cluster [DBG] 6.1f scrub starts 2024-02-10T08:24:50.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:48.943968+0000 osd.6 (osd.6) 64 : cluster [DBG] 6.1f scrub ok 2024-02-10T08:24:50.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:49.164960+0000 osd.4 (osd.4) 12 : cluster [DBG] 4.13 deep-scrub starts 2024-02-10T08:24:50.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:49.177352+0000 osd.4 (osd.4) 13 : cluster [DBG] 4.13 deep-scrub ok 2024-02-10T08:24:50.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:24:49.482978+0000 mon.c (mon.2) 38 : audit [INF] from='client.? 172.21.15.18:0/1235569764' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:24:50.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:24:49.483623+0000 mon.a (mon.0) 1105 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:24:50.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:49.495095+0000 osd.1 (osd.1) 96 : cluster [DBG] 6.1d scrub starts 2024-02-10T08:24:50.158 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:49.507644+0000 osd.1 (osd.1) 97 : cluster [DBG] 6.1d scrub ok 2024-02-10T08:24:50.158 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:48.369918+0000 osd.2 (osd.2) 85 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:24:50.158 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:48.369979+0000 osd.2 (osd.2) 86 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:24:50.158 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:48.698877+0000 mgr.y (mgr.14505) 308 : cluster [DBG] pgmap v365: 158 pgs: 158 active+clean; 1.5 GiB data, 6.7 GiB used, 709 GiB / 715 GiB avail; 1.1 KiB/s rd, 160 MiB/s wr, 2.56k op/s 2024-02-10T08:24:50.158 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:48.737245+0000 osd.5 (osd.5) 97 : cluster [DBG] 2.12 scrub starts 2024-02-10T08:24:50.158 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:48.740781+0000 osd.5 (osd.5) 98 : cluster [DBG] 2.12 scrub ok 2024-02-10T08:24:50.158 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:48.853596+0000 osd.0 (osd.0) 96 : cluster [DBG] 6.0 scrub starts 2024-02-10T08:24:50.158 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:48.866663+0000 osd.0 (osd.0) 97 : cluster [DBG] 6.0 scrub ok 2024-02-10T08:24:50.158 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:48.891564+0000 mon.a (mon.0) 1104 : cluster [DBG] osdmap e201: 8 total, 8 up, 8 in 2024-02-10T08:24:50.158 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:48.905133+0000 osd.6 (osd.6) 63 : cluster [DBG] 6.1f scrub starts 2024-02-10T08:24:50.158 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:48.943968+0000 osd.6 (osd.6) 64 : cluster [DBG] 6.1f scrub ok 2024-02-10T08:24:50.158 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:49.164960+0000 osd.4 (osd.4) 12 : cluster [DBG] 4.13 deep-scrub starts 2024-02-10T08:24:50.159 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:49.177352+0000 osd.4 (osd.4) 13 : cluster [DBG] 4.13 deep-scrub ok 2024-02-10T08:24:50.159 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:24:49.482978+0000 mon.c (mon.2) 38 : audit [INF] from='client.? 172.21.15.18:0/1235569764' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:24:50.159 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:24:49.483623+0000 mon.a (mon.0) 1105 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:24:50.159 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:49.495095+0000 osd.1 (osd.1) 96 : cluster [DBG] 6.1d scrub starts 2024-02-10T08:24:50.159 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:49.507644+0000 osd.1 (osd.1) 97 : cluster [DBG] 6.1d scrub ok 2024-02-10T08:24:50.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:49 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:48.369918+0000 osd.2 (osd.2) 85 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:24:50.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:49 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:48.369979+0000 osd.2 (osd.2) 86 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:24:50.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:49 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:48.698877+0000 mgr.y (mgr.14505) 308 : cluster [DBG] pgmap v365: 158 pgs: 158 active+clean; 1.5 GiB data, 6.7 GiB used, 709 GiB / 715 GiB avail; 1.1 KiB/s rd, 160 MiB/s wr, 2.56k op/s 2024-02-10T08:24:50.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:49 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:48.737245+0000 osd.5 (osd.5) 97 : cluster [DBG] 2.12 scrub starts 2024-02-10T08:24:50.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:49 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:48.740781+0000 osd.5 (osd.5) 98 : cluster [DBG] 2.12 scrub ok 2024-02-10T08:24:50.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:49 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:48.853596+0000 osd.0 (osd.0) 96 : cluster [DBG] 6.0 scrub starts 2024-02-10T08:24:50.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:49 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:48.866663+0000 osd.0 (osd.0) 97 : cluster [DBG] 6.0 scrub ok 2024-02-10T08:24:50.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:49 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:48.891564+0000 mon.a (mon.0) 1104 : cluster [DBG] osdmap e201: 8 total, 8 up, 8 in 2024-02-10T08:24:50.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:49 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:48.905133+0000 osd.6 (osd.6) 63 : cluster [DBG] 6.1f scrub starts 2024-02-10T08:24:50.293 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:49 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:48.943968+0000 osd.6 (osd.6) 64 : cluster [DBG] 6.1f scrub ok 2024-02-10T08:24:50.293 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:49 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:49.164960+0000 osd.4 (osd.4) 12 : cluster [DBG] 4.13 deep-scrub starts 2024-02-10T08:24:50.293 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:49 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:49.177352+0000 osd.4 (osd.4) 13 : cluster [DBG] 4.13 deep-scrub ok 2024-02-10T08:24:50.293 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:49 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:24:49.482978+0000 mon.c (mon.2) 38 : audit [INF] from='client.? 172.21.15.18:0/1235569764' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:24:50.293 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:49 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:24:49.483623+0000 mon.a (mon.0) 1105 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:24:50.293 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:49 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:49.495095+0000 osd.1 (osd.1) 96 : cluster [DBG] 6.1d scrub starts 2024-02-10T08:24:50.293 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:49 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:49.507644+0000 osd.1 (osd.1) 97 : cluster [DBG] 6.1d scrub ok 2024-02-10T08:24:50.334 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 13 16 30708 30692 147.501 128.312 0.00885597 0.00677487 2024-02-10T08:24:51.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:49.439644+0000 osd.7 (osd.7) 97 : cluster [DBG] 6.1c scrub starts 2024-02-10T08:24:51.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:49.441347+0000 osd.7 (osd.7) 98 : cluster [DBG] 6.1c scrub ok 2024-02-10T08:24:51.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:49.890100+0000 mon.a (mon.0) 1106 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:24:51.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:24:49.904781+0000 mon.a (mon.0) 1107 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-10T08:24:51.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:49.904856+0000 mon.a (mon.0) 1108 : cluster [DBG] osdmap e202: 8 total, 8 up, 8 in 2024-02-10T08:24:51.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:50.603134+0000 mon.a (mon.0) 1109 : cluster [DBG] osdmap e203: 8 total, 8 up, 8 in 2024-02-10T08:24:51.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:49.439644+0000 osd.7 (osd.7) 97 : cluster [DBG] 6.1c scrub starts 2024-02-10T08:24:51.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:49.441347+0000 osd.7 (osd.7) 98 : cluster [DBG] 6.1c scrub ok 2024-02-10T08:24:51.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:49.890100+0000 mon.a (mon.0) 1106 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:24:51.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:24:49.904781+0000 mon.a (mon.0) 1107 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-10T08:24:51.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:49.904856+0000 mon.a (mon.0) 1108 : cluster [DBG] osdmap e202: 8 total, 8 up, 8 in 2024-02-10T08:24:51.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:50.603134+0000 mon.a (mon.0) 1109 : cluster [DBG] osdmap e203: 8 total, 8 up, 8 in 2024-02-10T08:24:51.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:49.439644+0000 osd.7 (osd.7) 97 : cluster [DBG] 6.1c scrub starts 2024-02-10T08:24:51.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:49.441347+0000 osd.7 (osd.7) 98 : cluster [DBG] 6.1c scrub ok 2024-02-10T08:24:51.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:49.890100+0000 mon.a (mon.0) 1106 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:24:51.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:24:49.904781+0000 mon.a (mon.0) 1107 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-10T08:24:51.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:49.904856+0000 mon.a (mon.0) 1108 : cluster [DBG] osdmap e202: 8 total, 8 up, 8 in 2024-02-10T08:24:51.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:50.603134+0000 mon.a (mon.0) 1109 : cluster [DBG] osdmap e203: 8 total, 8 up, 8 in 2024-02-10T08:24:51.334 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 14 16 32638 32622 145.578 120.625 0.00454816 0.00686312 2024-02-10T08:24:51.831 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:24:51.843 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:51.844 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:24:51.945 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:24:52.001 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:52.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:50.699336+0000 mgr.y (mgr.14505) 309 : cluster [DBG] pgmap v369: 158 pgs: 158 active+clean; 1.6 GiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 1.2 KiB/s rd, 149 MiB/s wr, 2.38k op/s 2024-02-10T08:24:52.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:50.699336+0000 mgr.y (mgr.14505) 309 : cluster [DBG] pgmap v369: 158 pgs: 158 active+clean; 1.6 GiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 1.2 KiB/s rd, 149 MiB/s wr, 2.38k op/s 2024-02-10T08:24:52.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:51 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:50.699336+0000 mgr.y (mgr.14505) 309 : cluster [DBG] pgmap v369: 158 pgs: 158 active+clean; 1.6 GiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 1.2 KiB/s rd, 149 MiB/s wr, 2.38k op/s 2024-02-10T08:24:52.334 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 15 16 34572 34556 143.931 120.875 0.00763214 0.00694256 2024-02-10T08:24:52.354 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:24:52.362 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:24:52.367 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:52.368 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:24:52.468 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:24:52.518 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:52.651 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:24:52.654 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:52.654 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:24:52.755 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:24:52.802 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:52.836 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:24:52.841 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:52.842 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:24:52.857 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-02-10T08:24:52.857 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-02-10T08:24:52.857 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-02-10T08:24:52.857 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-02-10T08:24:52.857 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-02-10T08:24:52.942 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:24:52.989 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:53.076 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:24:53.080 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:53.080 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:24:53.181 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:24:53.233 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:53.334 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 16 16 36350 36334 141.881 111.125 0.00436147 0.00704375 2024-02-10T08:24:53.770 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.3 dump_historic_ops 2024-02-10T08:24:53.796 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:24:53.799 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:53.800 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:24:53.900 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:24:53.943 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:53.972 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:24:53.975 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:53.975 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:24:53.998 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:52.701719+0000 mgr.y (mgr.14505) 310 : cluster [DBG] pgmap v370: 158 pgs: 158 active+clean; 2.0 GiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 1.0 KiB/s rd, 118 MiB/s wr, 1.88k op/s 2024-02-10T08:24:53.998 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:52.701719+0000 mgr.y (mgr.14505) 310 : cluster [DBG] pgmap v370: 158 pgs: 158 active+clean; 2.0 GiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 1.0 KiB/s rd, 118 MiB/s wr, 1.88k op/s 2024-02-10T08:24:54.077 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:24:54.113 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:54.144 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:24:54.149 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:54.149 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:24:54.250 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:24:54.267 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-10T08:24:54.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:53 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:52.701719+0000 mgr.y (mgr.14505) 310 : cluster [DBG] pgmap v370: 158 pgs: 158 active+clean; 2.0 GiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 1.0 KiB/s rd, 118 MiB/s wr, 1.88k op/s 2024-02-10T08:24:54.303 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:54.335 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 17 16 38105 38089 139.984 109.688 0.0130201 0.00713804 2024-02-10T08:24:54.341 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:24:54.346 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:54.347 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:24:54.381 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd set nodeep-scrub 2024-02-10T08:24:54.448 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:24:54.484 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:54.509 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:24:54.513 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:54.514 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:24:54.615 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:24:54.653 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:54.681 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:24:54.685 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:54.685 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:24:54.787 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:24:54.838 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:55.000 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:24:55.004 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:55.005 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:24:55.106 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:24:55.155 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:55.317 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:24:55.319 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:55.320 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:24:55.334 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 18 16 39629 39613 137.499 95.25 0.00657546 0.00726556 2024-02-10T08:24:55.421 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:24:55.471 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:55.503 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:24:55.505 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:55.505 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:24:55.607 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:24:55.638 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:55.640 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:24:55.642 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:24:55.662 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:24:55.665 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:55.665 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:24:55.721 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:24:55.766 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:24:55.809 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:55.836 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:24:55.839 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:55.840 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:24:55.940 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:24:55.998 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:56.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:54.702352+0000 mgr.y (mgr.14505) 311 : cluster [DBG] pgmap v371: 158 pgs: 158 active+clean; 2.2 GiB data, 8.7 GiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 113 MiB/s wr, 1.81k op/s 2024-02-10T08:24:56.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:55.271147+0000 osd.3 (osd.3) 95 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:24:56.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:55.271241+0000 osd.3 (osd.3) 96 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:24:56.337 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 19 16 41147 41131 135.243 94.875 0.00569038 0.00738903 2024-02-10T08:24:56.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:54.702352+0000 mgr.y (mgr.14505) 311 : cluster [DBG] pgmap v371: 158 pgs: 158 active+clean; 2.2 GiB data, 8.7 GiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 113 MiB/s wr, 1.81k op/s 2024-02-10T08:24:56.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:55.271147+0000 osd.3 (osd.3) 95 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:24:56.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:55.271241+0000 osd.3 (osd.3) 96 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:24:56.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:54.702352+0000 mgr.y (mgr.14505) 311 : cluster [DBG] pgmap v371: 158 pgs: 158 active+clean; 2.2 GiB data, 8.7 GiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 113 MiB/s wr, 1.81k op/s 2024-02-10T08:24:56.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:55.271147+0000 osd.3 (osd.3) 95 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:24:56.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:55.271241+0000 osd.3 (osd.3) 96 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:24:56.792 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:24:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:24:56] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:24:56.987 INFO:teuthology.orchestra.run.smithi018.stderr:set pool 4 pgp_num to 32 2024-02-10T08:24:57.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:55.956057+0000 mon.a (mon.0) 1110 : cluster [DBG] osdmap e204: 8 total, 8 up, 8 in 2024-02-10T08:24:57.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:24:56.003749+0000 mon.c (mon.2) 39 : audit [INF] from='client.? 172.21.15.18:0/123471810' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.log", "var": "pgp_num", "val": "32"}]: dispatch 2024-02-10T08:24:57.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:24:56.004251+0000 mon.a (mon.0) 1111 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.log", "var": "pgp_num", "val": "32"}]: dispatch 2024-02-10T08:24:57.337 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:2024-02-10T08:24:57.337158+0000 min lat: 0.00125956 max lat: 0.474095 avg lat: 0.00746964 2024-02-10T08:24:57.337 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-02-10T08:24:57.337 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 20 16 42843 42827 133.781 106 0.0144197 0.00746964 2024-02-10T08:24:57.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:55.956057+0000 mon.a (mon.0) 1110 : cluster [DBG] osdmap e204: 8 total, 8 up, 8 in 2024-02-10T08:24:57.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:24:56.003749+0000 mon.c (mon.2) 39 : audit [INF] from='client.? 172.21.15.18:0/123471810' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.log", "var": "pgp_num", "val": "32"}]: dispatch 2024-02-10T08:24:57.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:24:56.004251+0000 mon.a (mon.0) 1111 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.log", "var": "pgp_num", "val": "32"}]: dispatch 2024-02-10T08:24:57.405 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:24:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:24:57] "GET /metrics HTTP/1.1" 200 175897 "" "Prometheus/2.33.4" 2024-02-10T08:24:57.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:55.956057+0000 mon.a (mon.0) 1110 : cluster [DBG] osdmap e204: 8 total, 8 up, 8 in 2024-02-10T08:24:57.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:24:56.003749+0000 mon.c (mon.2) 39 : audit [INF] from='client.? 172.21.15.18:0/123471810' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.log", "var": "pgp_num", "val": "32"}]: dispatch 2024-02-10T08:24:57.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:24:56.004251+0000 mon.a (mon.0) 1111 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.log", "var": "pgp_num", "val": "32"}]: dispatch 2024-02-10T08:24:58.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:56.702690+0000 mgr.y (mgr.14505) 312 : cluster [DBG] pgmap v373: 158 pgs: 158 active+clean; 2.2 GiB data, 8.7 GiB used, 707 GiB / 715 GiB avail; 752 B/s rd, 89 MiB/s wr, 1.43k op/s 2024-02-10T08:24:58.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:24:56.967334+0000 mon.a (mon.0) 1112 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.log", "var": "pgp_num", "val": "32"}]': finished 2024-02-10T08:24:58.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:56.967433+0000 mon.a (mon.0) 1113 : cluster [DBG] osdmap e205: 8 total, 8 up, 8 in 2024-02-10T08:24:58.290 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:24:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:24:58.337 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 21 16 44460 44444 132.223 101.062 0.00554529 0.00755904 2024-02-10T08:24:58.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:56.702690+0000 mgr.y (mgr.14505) 312 : cluster [DBG] pgmap v373: 158 pgs: 158 active+clean; 2.2 GiB data, 8.7 GiB used, 707 GiB / 715 GiB avail; 752 B/s rd, 89 MiB/s wr, 1.43k op/s 2024-02-10T08:24:58.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:24:56.967334+0000 mon.a (mon.0) 1112 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.log", "var": "pgp_num", "val": "32"}]': finished 2024-02-10T08:24:58.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:56.967433+0000 mon.a (mon.0) 1113 : cluster [DBG] osdmap e205: 8 total, 8 up, 8 in 2024-02-10T08:24:58.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:56.702690+0000 mgr.y (mgr.14505) 312 : cluster [DBG] pgmap v373: 158 pgs: 158 active+clean; 2.2 GiB data, 8.7 GiB used, 707 GiB / 715 GiB avail; 752 B/s rd, 89 MiB/s wr, 1.43k op/s 2024-02-10T08:24:58.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:24:56.967334+0000 mon.a (mon.0) 1112 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.log", "var": "pgp_num", "val": "32"}]': finished 2024-02-10T08:24:58.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:56.967433+0000 mon.a (mon.0) 1113 : cluster [DBG] osdmap e205: 8 total, 8 up, 8 in 2024-02-10T08:24:59.061 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:24:57.930614+0000 mgr.y (mgr.14505) 313 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:24:59.061 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:24:57.930614+0000 mgr.y (mgr.14505) 313 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:24:59.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:24:57.930614+0000 mgr.y (mgr.14505) 313 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:24:59.338 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 22 16 46079 46063 130.806 101.188 0.0109305 0.00763936 2024-02-10T08:24:59.605 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:24:59.610 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:59.610 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:24:59.711 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:24:59.758 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:59.786 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:24:59.792 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:59.793 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:24:59.893 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:24:59.937 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:24:59.965 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:24:59.970 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:24:59.971 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:25:00.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:24:59 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:58.703516+0000 mgr.y (mgr.14505) 314 : cluster [DBG] pgmap v375: 158 pgs: 158 active+clean; 2.6 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 1.2 KiB/s rd, 132 MiB/s wr, 2.11k op/s 2024-02-10T08:25:00.072 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:25:00.127 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:00.195 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:25:00.200 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:00.201 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:25:00.302 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:25:00.338 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 23 16 47684 47668 129.48 100.312 0.0140454 0.0077187 2024-02-10T08:25:00.350 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:00.373 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:25:00.381 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:00.382 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:25:00.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:24:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:58.703516+0000 mgr.y (mgr.14505) 314 : cluster [DBG] pgmap v375: 158 pgs: 158 active+clean; 2.6 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 1.2 KiB/s rd, 132 MiB/s wr, 2.11k op/s 2024-02-10T08:25:00.386 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:24:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:58.703516+0000 mgr.y (mgr.14505) 314 : cluster [DBG] pgmap v375: 158 pgs: 158 active+clean; 2.6 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 1.2 KiB/s rd, 132 MiB/s wr, 2.11k op/s 2024-02-10T08:25:00.483 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:25:00.532 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:00.563 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:00.564 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:25:00.564 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:25:00.665 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:25:00.724 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:01.001 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:59.996881+0000 osd.6 (osd.6) 65 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:25:01.001 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:24:59.996946+0000 osd.6 (osd.6) 66 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:25:01.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:59.996881+0000 osd.6 (osd.6) 65 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:25:01.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:24:59.996946+0000 osd.6 (osd.6) 66 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:25:01.302 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:59.996881+0000 osd.6 (osd.6) 65 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:25:01.302 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:24:59.996946+0000 osd.6 (osd.6) 66 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:25:01.338 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 24 16 49171 49155 127.957 92.9375 0.0105123 0.00781069 2024-02-10T08:25:01.490 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:25:01.501 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:01.502 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:25:01.604 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:25:01.641 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:01.672 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:25:01.674 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:01.675 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:25:01.776 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:25:01.845 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:01.985 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:25:01.988 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:01.988 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:25:02.089 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:25:02.143 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:02.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:00.704067+0000 mgr.y (mgr.14505) 315 : cluster [DBG] pgmap v376: 158 pgs: 158 active+clean; 2.7 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 639 B/s rd, 88 MiB/s wr, 1.40k op/s 2024-02-10T08:25:02.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:01.014702+0000 mon.a (mon.0) 1114 : cluster [DBG] osdmap e206: 8 total, 8 up, 8 in 2024-02-10T08:25:02.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:25:01.637731+0000 mon.a (mon.0) 1115 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:25:02.338 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 25 16 50663 50647 126.569 93.25 0.012698 0.00789575 2024-02-10T08:25:02.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:00.704067+0000 mgr.y (mgr.14505) 315 : cluster [DBG] pgmap v376: 158 pgs: 158 active+clean; 2.7 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 639 B/s rd, 88 MiB/s wr, 1.40k op/s 2024-02-10T08:25:02.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:01.014702+0000 mon.a (mon.0) 1114 : cluster [DBG] osdmap e206: 8 total, 8 up, 8 in 2024-02-10T08:25:02.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:25:01.637731+0000 mon.a (mon.0) 1115 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:25:02.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:00.704067+0000 mgr.y (mgr.14505) 315 : cluster [DBG] pgmap v376: 158 pgs: 158 active+clean; 2.7 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 639 B/s rd, 88 MiB/s wr, 1.40k op/s 2024-02-10T08:25:02.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:01.014702+0000 mon.a (mon.0) 1114 : cluster [DBG] osdmap e206: 8 total, 8 up, 8 in 2024-02-10T08:25:02.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:25:01.637731+0000 mon.a (mon.0) 1115 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:25:02.514 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:25:02.518 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:02.519 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:25:02.620 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:25:02.667 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:02.694 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:25:02.700 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:02.701 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:25:02.802 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:25:02.853 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:02.888 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:25:02.894 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:02.895 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:25:02.996 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:25:03.058 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:03.341 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 26 16 52184 52168 125.348 95.0625 0.00873963 0.00797221 2024-02-10T08:25:03.676 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:25:03.702 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:25:03.733 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:25:03.780 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:25:03.817 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:25:03.851 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:25:03.899 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:25:03.922 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:25:03.931 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-10T08:25:03.931 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-10T08:25:03.931 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-10T08:25:03.931 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-10T08:25:03.931 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-10T08:25:03.931 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-10T08:25:03.931 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-10T08:25:03.931 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-10T08:25:04.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:02.705046+0000 mgr.y (mgr.14505) 316 : cluster [DBG] pgmap v378: 158 pgs: 158 active+clean; 3.0 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 1.5 KiB/s rd, 125 MiB/s wr, 2.00k op/s 2024-02-10T08:25:04.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:25:03.634848+0000 mon.b (mon.1) 55 : audit [DBG] from='client.? 172.21.15.18:0/2673053735' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:25:04.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:02.705046+0000 mgr.y (mgr.14505) 316 : cluster [DBG] pgmap v378: 158 pgs: 158 active+clean; 3.0 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 1.5 KiB/s rd, 125 MiB/s wr, 2.00k op/s 2024-02-10T08:25:04.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:25:03.634848+0000 mon.b (mon.1) 55 : audit [DBG] from='client.? 172.21.15.18:0/2673053735' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:25:04.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:02.705046+0000 mgr.y (mgr.14505) 316 : cluster [DBG] pgmap v378: 158 pgs: 158 active+clean; 3.0 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 1.5 KiB/s rd, 125 MiB/s wr, 2.00k op/s 2024-02-10T08:25:04.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:25:03.634848+0000 mon.b (mon.1) 55 : audit [DBG] from='client.? 172.21.15.18:0/2673053735' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:25:04.340 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 27 16 53561 53545 123.893 86.0625 0.0106883 0.00806666 2024-02-10T08:25:04.421 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:25:04.425 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:04.426 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:25:04.527 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:25:04.595 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:04.811 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-02-10T08:25:04.811 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:25:04.815 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:25:04.822 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:04.822 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:25:04.923 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:25:04.964 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:04.998 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:25:05.000 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:05.001 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:25:05.102 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:25:05.145 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:05.171 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:25:05.177 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:05.177 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:25:05.278 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:25:05.328 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:05.340 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 28 16 54908 54892 122.475 84.1875 0.00765549 0.00815985 2024-02-10T08:25:05.355 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:25:05.359 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:05.360 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:25:05.461 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:25:05.512 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:05.772 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:25:05.776 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:05.776 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:25:05.799 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.5 dump_ops_in_flight 2024-02-10T08:25:05.878 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:25:05.925 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:06.060 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is set 2024-02-10T08:25:06.218 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:25:06.224 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:25:06.232 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:06.233 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:25:06.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:04.706075+0000 mgr.y (mgr.14505) 317 : cluster [DBG] pgmap v379: 158 pgs: 158 active+clean; 3.1 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 1.2 KiB/s rd, 124 MiB/s wr, 1.99k op/s 2024-02-10T08:25:06.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:04.952034+0000 osd.4 (osd.4) 14 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:25:06.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:04.952094+0000 osd.4 (osd.4) 15 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:25:06.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:05.037426+0000 mon.a (mon.0) 1116 : cluster [DBG] osdmap e207: 8 total, 8 up, 8 in 2024-02-10T08:25:06.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:25:05.149984+0000 mon.c (mon.2) 40 : audit [INF] from='client.? 172.21.15.18:0/1058897732' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:25:06.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:25:05.150491+0000 mon.a (mon.0) 1117 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:25:06.333 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 5, 6, 7, 4] 2024-02-10T08:25:06.333 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-10T08:25:06.333 INFO:tasks.thrashosds.thrasher:fixing pg num pool default.rgw.meta 2024-02-10T08:25:06.333 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph pg dump --format=json 2024-02-10T08:25:06.334 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:25:06.340 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 29 16 56258 56242 121.162 84.375 0.0106926 0.00824836 2024-02-10T08:25:06.373 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:04.706075+0000 mgr.y (mgr.14505) 317 : cluster [DBG] pgmap v379: 158 pgs: 158 active+clean; 3.1 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 1.2 KiB/s rd, 124 MiB/s wr, 1.99k op/s 2024-02-10T08:25:06.373 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:04.952034+0000 osd.4 (osd.4) 14 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:25:06.373 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:04.952094+0000 osd.4 (osd.4) 15 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:25:06.373 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:05.037426+0000 mon.a (mon.0) 1116 : cluster [DBG] osdmap e207: 8 total, 8 up, 8 in 2024-02-10T08:25:06.373 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:25:05.149984+0000 mon.c (mon.2) 40 : audit [INF] from='client.? 172.21.15.18:0/1058897732' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:25:06.373 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:25:05.150491+0000 mon.a (mon.0) 1117 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:25:06.373 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:04.706075+0000 mgr.y (mgr.14505) 317 : cluster [DBG] pgmap v379: 158 pgs: 158 active+clean; 3.1 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 1.2 KiB/s rd, 124 MiB/s wr, 1.99k op/s 2024-02-10T08:25:06.374 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:04.952034+0000 osd.4 (osd.4) 14 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:25:06.374 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:04.952094+0000 osd.4 (osd.4) 15 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:25:06.374 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:05.037426+0000 mon.a (mon.0) 1116 : cluster [DBG] osdmap e207: 8 total, 8 up, 8 in 2024-02-10T08:25:06.374 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:25:05.149984+0000 mon.c (mon.2) 40 : audit [INF] from='client.? 172.21.15.18:0/1058897732' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:25:06.374 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:25:05.150491+0000 mon.a (mon.0) 1117 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:25:06.380 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:06.538 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:25:06.543 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:06.544 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:25:06.647 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:25:06.700 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:25:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:25:06] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:25:06.708 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:07.116 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:25:07.154 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:25:07.160 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:07.161 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:25:07.264 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:25:07.316 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:25:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:25:07] "GET /metrics HTTP/1.1" 200 175918 "" "Prometheus/2.33.4" 2024-02-10T08:25:07.317 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:06.032806+0000 mon.a (mon.0) 1118 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:25:07.318 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:25:06.043289+0000 mon.a (mon.0) 1119 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-10T08:25:07.318 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:06.043362+0000 mon.a (mon.0) 1120 : cluster [DBG] osdmap e208: 8 total, 8 up, 8 in 2024-02-10T08:25:07.318 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:06.032806+0000 mon.a (mon.0) 1118 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:25:07.318 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:25:06.043289+0000 mon.a (mon.0) 1119 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-10T08:25:07.318 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:06.043362+0000 mon.a (mon.0) 1120 : cluster [DBG] osdmap e208: 8 total, 8 up, 8 in 2024-02-10T08:25:07.322 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:07.341 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 30 16 57557 57541 119.826 81.1875 0.0198447 0.00833999 2024-02-10T08:25:07.482 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:25:07.487 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:07.487 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:25:07.543 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:06.032806+0000 mon.a (mon.0) 1118 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:25:07.543 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:25:06.043289+0000 mon.a (mon.0) 1119 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-10T08:25:07.543 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:06.043362+0000 mon.a (mon.0) 1120 : cluster [DBG] osdmap e208: 8 total, 8 up, 8 in 2024-02-10T08:25:07.588 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:25:07.625 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:07.713 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:25:07.721 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:07.721 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:25:07.822 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:25:07.876 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:08.072 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:06.706510+0000 mgr.y (mgr.14505) 318 : cluster [DBG] pgmap v382: 158 pgs: 158 active+clean; 3.1 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 852 B/s rd, 80 MiB/s wr, 1.28k op/s 2024-02-10T08:25:08.072 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:06.706510+0000 mgr.y (mgr.14505) 318 : cluster [DBG] pgmap v382: 158 pgs: 158 active+clean; 3.1 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 852 B/s rd, 80 MiB/s wr, 1.28k op/s 2024-02-10T08:25:08.134 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:25:08.142 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:08.143 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:25:08.243 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:25:08.255 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-10T08:25:08.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:06.706510+0000 mgr.y (mgr.14505) 318 : cluster [DBG] pgmap v382: 158 pgs: 158 active+clean; 3.1 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 852 B/s rd, 80 MiB/s wr, 1.28k op/s 2024-02-10T08:25:08.293 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:25:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:25:08.293 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:08.343 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 31 16 58870 58854 118.604 82.0625 0.0180953 0.00842523 2024-02-10T08:25:08.421 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-02-10T08:25:08.421 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:25:08.759 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:25:08.763 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:08.763 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:25:08.864 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:25:08.912 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:09.017 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd unset noscrub 2024-02-10T08:25:09.076 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:25:09.086 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:09.086 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:25:09.101 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:25:07.942286+0000 mgr.y (mgr.14505) 319 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:25:09.187 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:25:09.197 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.5 dump_blocked_ops 2024-02-10T08:25:09.251 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:09.343 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 32 16 60066 60050 117.233 74.75 0.00708351 0.00852437 2024-02-10T08:25:09.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:25:07.942286+0000 mgr.y (mgr.14505) 319 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:25:09.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:25:07.942286+0000 mgr.y (mgr.14505) 319 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:25:09.577 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:25:09.742 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:25:10.116 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:25:10.121 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:10.121 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:25:10.124 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:08.707850+0000 mgr.y (mgr.14505) 320 : cluster [DBG] pgmap v383: 158 pgs: 158 active+clean; 3.5 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 1.3 KiB/s rd, 112 MiB/s wr, 1.79k op/s 2024-02-10T08:25:10.149 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:25:10.162 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-02-10T08:25:10.222 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:25:10.268 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:10.343 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 33 16 61257 61241 115.936 74.4375 0.0114467 0.00862035 2024-02-10T08:25:10.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:08.707850+0000 mgr.y (mgr.14505) 320 : cluster [DBG] pgmap v383: 158 pgs: 158 active+clean; 3.5 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 1.3 KiB/s rd, 112 MiB/s wr, 1.79k op/s 2024-02-10T08:25:10.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:08.707850+0000 mgr.y (mgr.14505) 320 : cluster [DBG] pgmap v383: 158 pgs: 158 active+clean; 3.5 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 1.3 KiB/s rd, 112 MiB/s wr, 1.79k op/s 2024-02-10T08:25:10.476 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:25:10.479 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:10.480 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:25:10.580 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:25:10.645 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:11.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:25:10.115200+0000 mgr.y (mgr.14505) 321 : audit [DBG] from='client.14982 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-10T08:25:11.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:10.622604+0000 mon.a (mon.0) 1121 : cluster [DBG] osdmap e209: 8 total, 8 up, 8 in 2024-02-10T08:25:11.343 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 34 16 62572 62556 114.944 82.1875 0.00913877 0.00869448 2024-02-10T08:25:11.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:25:10.115200+0000 mgr.y (mgr.14505) 321 : audit [DBG] from='client.14982 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-10T08:25:11.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:10.622604+0000 mon.a (mon.0) 1121 : cluster [DBG] osdmap e209: 8 total, 8 up, 8 in 2024-02-10T08:25:11.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:25:10.115200+0000 mgr.y (mgr.14505) 321 : audit [DBG] from='client.14982 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-10T08:25:11.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:10.622604+0000 mon.a (mon.0) 1121 : cluster [DBG] osdmap e209: 8 total, 8 up, 8 in 2024-02-10T08:25:11.613 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:25:11.621 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:11.622 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:25:11.629 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":383,"stamp":"2024-02-10T08:25:08.707182+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3767408292,"num_objects":57678,"num_object_clones":0,"num_object_copies":173034,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57678,"num_whiteouts":0,"num_read":1180,"num_read_kb":932,"num_write":57914,"num_write_kb":3679145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":77,"num_bytes_recovered":1898,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":58006,"ondisk_log_size":58006,"up":474,"acting":474,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":474,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":13393228,"kb_used_data":10957452,"kb_used_omap":0,"kb_used_meta":2435711,"kb_avail":736567988,"statfs":{"total":767960285184,"available":754245619712,"internally_reserved":0,"allocated":11220430848,"data_stored":11212651054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":972,"internal_metadata":2494168116},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":899940352,"num_objects":13732,"num_object_clones":0,"num_object_copies":41196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13732,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":13732,"num_write_kb":878848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.689833"},"pg_stats":[{"pgid":"6.29","version":"76'2","reported_seq":111,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.043303+0000","last_change":"2024-02-10T08:22:00.615760+0000","last_active":"2024-02-10T08:25:05.043303+0000","last_peered":"2024-02-10T08:25:05.043303+0000","last_clean":"2024-02-10T08:25:05.043303+0000","last_became_active":"2024-02-10T08:22:00.615454+0000","last_became_peered":"2024-02-10T08:22:00.615454+0000","last_unstale":"2024-02-10T08:25:05.043303+0000","last_undegraded":"2024-02-10T08:25:05.043303+0000","last_fullsized":"2024-02-10T08:25:05.043303+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":6,"last_scrub":"76'2","last_scrub_stamp":"2024-02-10T08:19:28.458129+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2024-02-10T08:18:08.680038+0000","last_clean_scrub_stamp":"2024-02-10T08:19:28.458129+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,0],"acting":[7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":174,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.045212+0000","last_change":"2024-02-10T08:22:00.578467+0000","last_active":"2024-02-10T08:25:05.045212+0000","last_peered":"2024-02-10T08:25:05.045212+0000","last_clean":"2024-02-10T08:25:05.045212+0000","last_became_active":"2024-02-10T08:22:00.578118+0000","last_became_peered":"2024-02-10T08:22:00.578118+0000","last_unstale":"2024-02-10T08:25:05.045212+0000","last_undegraded":"2024-02-10T08:25:05.045212+0000","last_fullsized":"2024-02-10T08:25:05.045212+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:24.199920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:19:24.199920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,6],"acting":[2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":93,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.044401+0000","last_change":"2024-02-10T08:23:15.079750+0000","last_active":"2024-02-10T08:25:05.044401+0000","last_peered":"2024-02-10T08:25:05.044401+0000","last_clean":"2024-02-10T08:25:05.044401+0000","last_became_active":"2024-02-10T08:23:15.079456+0000","last_became_peered":"2024-02-10T08:23:15.079456+0000","last_unstale":"2024-02-10T08:25:05.044401+0000","last_undegraded":"2024-02-10T08:25:05.044401+0000","last_fullsized":"2024-02-10T08:25:05.044401+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:45.379932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:45.379932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":93,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.051241+0000","last_change":"2024-02-10T08:23:15.077790+0000","last_active":"2024-02-10T08:25:05.051241+0000","last_peered":"2024-02-10T08:25:05.051241+0000","last_clean":"2024-02-10T08:25:05.051241+0000","last_became_active":"2024-02-10T08:23:15.077457+0000","last_became_peered":"2024-02-10T08:23:15.077457+0000","last_unstale":"2024-02-10T08:25:05.051241+0000","last_undegraded":"2024-02-10T08:25:05.051241+0000","last_fullsized":"2024-02-10T08:25:05.051241+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:47.116727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:47.116727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":183,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.045153+0000","last_change":"2024-02-10T08:24:18.647687+0000","last_active":"2024-02-10T08:25:05.045153+0000","last_peered":"2024-02-10T08:25:05.045153+0000","last_clean":"2024-02-10T08:25:05.045153+0000","last_became_active":"2024-02-10T08:24:18.647304+0000","last_became_peered":"2024-02-10T08:24:18.647304+0000","last_unstale":"2024-02-10T08:25:05.045153+0000","last_undegraded":"2024-02-10T08:25:05.045153+0000","last_fullsized":"2024-02-10T08:25:05.045153+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:08.316685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:11.750537+0000","last_clean_scrub_stamp":"2024-02-10T08:20:08.316685+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1],"acting":[6,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":184,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.037743+0000","last_change":"2024-02-10T08:23:15.065300+0000","last_active":"2024-02-10T08:25:05.037743+0000","last_peered":"2024-02-10T08:25:05.037743+0000","last_clean":"2024-02-10T08:25:05.037743+0000","last_became_active":"2024-02-10T08:23:15.064896+0000","last_became_peered":"2024-02-10T08:23:15.064896+0000","last_unstale":"2024-02-10T08:25:05.037743+0000","last_undegraded":"2024-02-10T08:25:05.037743+0000","last_fullsized":"2024-02-10T08:25:05.037743+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:09.785096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:20:09.785096+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":28,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.046766+0000","last_change":"2024-02-10T08:24:18.645834+0000","last_active":"2024-02-10T08:25:05.046766+0000","last_peered":"2024-02-10T08:25:05.046766+0000","last_clean":"2024-02-10T08:25:05.046766+0000","last_became_active":"2024-02-10T08:24:18.645377+0000","last_became_peered":"2024-02-10T08:24:18.645377+0000","last_unstale":"2024-02-10T08:25:05.046766+0000","last_undegraded":"2024-02-10T08:25:05.046766+0000","last_fullsized":"2024-02-10T08:25:05.046766+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:22.272986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:20:22.272986+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":84,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.044245+0000","last_change":"2024-02-10T08:22:00.600550+0000","last_active":"2024-02-10T08:25:05.044245+0000","last_peered":"2024-02-10T08:25:05.044245+0000","last_clean":"2024-02-10T08:25:05.044245+0000","last_became_active":"2024-02-10T08:22:00.600200+0000","last_became_peered":"2024-02-10T08:22:00.600200+0000","last_unstale":"2024-02-10T08:25:05.044245+0000","last_undegraded":"2024-02-10T08:25:05.044245+0000","last_fullsized":"2024-02-10T08:25:05.044245+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:22.216312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:19:22.216312+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1],"acting":[6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":84,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.043222+0000","last_change":"2024-02-10T08:22:00.584830+0000","last_active":"2024-02-10T08:25:05.043222+0000","last_peered":"2024-02-10T08:25:05.043222+0000","last_clean":"2024-02-10T08:25:05.043222+0000","last_became_active":"2024-02-10T08:22:00.584555+0000","last_became_peered":"2024-02-10T08:22:00.584555+0000","last_unstale":"2024-02-10T08:25:05.043222+0000","last_undegraded":"2024-02-10T08:25:05.043222+0000","last_fullsized":"2024-02-10T08:25:05.043222+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:25.568342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:19:25.568342+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":84,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.049531+0000","last_change":"2024-02-10T08:22:00.586057+0000","last_active":"2024-02-10T08:25:05.049531+0000","last_peered":"2024-02-10T08:25:05.049531+0000","last_clean":"2024-02-10T08:25:05.049531+0000","last_became_active":"2024-02-10T08:22:00.581772+0000","last_became_peered":"2024-02-10T08:22:00.581772+0000","last_unstale":"2024-02-10T08:25:05.049531+0000","last_undegraded":"2024-02-10T08:25:05.049531+0000","last_fullsized":"2024-02-10T08:25:05.049531+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:18.940944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:20:18.940944+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,7],"acting":[1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":91,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.044225+0000","last_change":"2024-02-10T08:24:43.055548+0000","last_active":"2024-02-10T08:25:05.044225+0000","last_peered":"2024-02-10T08:25:05.044225+0000","last_clean":"2024-02-10T08:25:05.044225+0000","last_became_active":"2024-02-10T08:23:15.079180+0000","last_became_peered":"2024-02-10T08:23:15.079180+0000","last_unstale":"2024-02-10T08:25:05.044225+0000","last_undegraded":"2024-02-10T08:25:05.044225+0000","last_fullsized":"2024-02-10T08:25:05.044225+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:43.055477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:24:43.055477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":138,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-02-10T08:24:56.968845+0000","last_change":"2024-02-10T08:20:46.404906+0000","last_active":"2024-02-10T08:24:56.968845+0000","last_peered":"2024-02-10T08:24:56.968845+0000","last_clean":"2024-02-10T08:24:56.968845+0000","last_became_active":"2024-02-10T08:20:46.404597+0000","last_became_peered":"2024-02-10T08:20:46.404597+0000","last_unstale":"2024-02-10T08:24:56.968845+0000","last_undegraded":"2024-02-10T08:24:56.968845+0000","last_fullsized":"2024-02-10T08:24:56.968845+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:09.941898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:09.941898+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":128,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.045108+0000","last_change":"2024-02-10T08:24:32.044728+0000","last_active":"2024-02-10T08:25:05.045108+0000","last_peered":"2024-02-10T08:25:05.045108+0000","last_clean":"2024-02-10T08:25:05.045108+0000","last_became_active":"2024-02-10T08:23:34.723324+0000","last_became_peered":"2024-02-10T08:23:34.723324+0000","last_unstale":"2024-02-10T08:25:05.045108+0000","last_undegraded":"2024-02-10T08:25:05.045108+0000","last_fullsized":"2024-02-10T08:25:05.045108+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:32.044644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:24:32.044644+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"62'15","reported_seq":139,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.045665+0000","last_change":"2024-02-10T08:23:34.749805+0000","last_active":"2024-02-10T08:25:05.045665+0000","last_peered":"2024-02-10T08:25:05.045665+0000","last_clean":"2024-02-10T08:25:05.045665+0000","last_became_active":"2024-02-10T08:23:34.706163+0000","last_became_peered":"2024-02-10T08:23:34.706163+0000","last_unstale":"2024-02-10T08:25:05.045665+0000","last_undegraded":"2024-02-10T08:25:05.045665+0000","last_fullsized":"2024-02-10T08:25:05.045665+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'15","last_scrub_stamp":"2024-02-10T08:20:03.330508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:20:03.330508+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":142,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-02-10T08:24:56.970989+0000","last_change":"2024-02-10T08:20:46.405782+0000","last_active":"2024-02-10T08:24:56.970989+0000","last_peered":"2024-02-10T08:24:56.970989+0000","last_clean":"2024-02-10T08:24:56.970989+0000","last_became_active":"2024-02-10T08:20:46.405314+0000","last_became_peered":"2024-02-10T08:20:46.405314+0000","last_unstale":"2024-02-10T08:24:56.970989+0000","last_undegraded":"2024-02-10T08:24:56.970989+0000","last_fullsized":"2024-02-10T08:24:56.970989+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:19.058317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:19.058317+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":168,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.053630+0000","last_change":"2024-02-10T08:20:06.810606+0000","last_active":"2024-02-10T08:25:05.053630+0000","last_peered":"2024-02-10T08:25:05.053630+0000","last_clean":"2024-02-10T08:25:05.053630+0000","last_became_active":"2024-02-10T08:16:56.863353+0000","last_became_peered":"2024-02-10T08:16:56.863353+0000","last_unstale":"2024-02-10T08:25:05.053630+0000","last_undegraded":"2024-02-10T08:25:05.053630+0000","last_fullsized":"2024-02-10T08:25:05.053630+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:06.810521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:20:06.810521+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":64,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.038110+0000","last_change":"2024-02-10T08:24:45.805682+0000","last_active":"2024-02-10T08:25:05.038110+0000","last_peered":"2024-02-10T08:25:05.038110+0000","last_clean":"2024-02-10T08:25:05.038110+0000","last_became_active":"2024-02-10T08:23:15.074301+0000","last_became_peered":"2024-02-10T08:23:15.074301+0000","last_unstale":"2024-02-10T08:25:05.038110+0000","last_undegraded":"2024-02-10T08:25:05.038110+0000","last_fullsized":"2024-02-10T08:25:05.038110+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:45.805584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:24:45.805584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"62'9","reported_seq":157,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-02-10T08:24:56.969157+0000","last_change":"2024-02-10T08:20:46.405346+0000","last_active":"2024-02-10T08:24:56.969157+0000","last_peered":"2024-02-10T08:24:56.969157+0000","last_clean":"2024-02-10T08:24:56.969157+0000","last_became_active":"2024-02-10T08:20:46.404966+0000","last_became_peered":"2024-02-10T08:20:46.404966+0000","last_unstale":"2024-02-10T08:24:56.969157+0000","last_undegraded":"2024-02-10T08:24:56.969157+0000","last_fullsized":"2024-02-10T08:24:56.969157+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'9","last_scrub_stamp":"2024-02-10T08:18:12.998167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:12.998167+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":174,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.037608+0000","last_change":"2024-02-10T08:23:15.126285+0000","last_active":"2024-02-10T08:25:05.037608+0000","last_peered":"2024-02-10T08:25:05.037608+0000","last_clean":"2024-02-10T08:25:05.037608+0000","last_became_active":"2024-02-10T08:23:15.125955+0000","last_became_peered":"2024-02-10T08:23:15.125955+0000","last_unstale":"2024-02-10T08:25:05.037608+0000","last_undegraded":"2024-02-10T08:25:05.037608+0000","last_fullsized":"2024-02-10T08:25:05.037608+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:09.280825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:20:09.280825+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,2],"acting":[5,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":187,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.043970+0000","last_change":"2024-02-10T08:24:46.389663+0000","last_active":"2024-02-10T08:25:05.043970+0000","last_peered":"2024-02-10T08:25:05.043970+0000","last_clean":"2024-02-10T08:25:05.043970+0000","last_became_active":"2024-02-10T08:20:46.406783+0000","last_became_peered":"2024-02-10T08:20:46.406783+0000","last_unstale":"2024-02-10T08:25:05.043970+0000","last_undegraded":"2024-02-10T08:25:05.043970+0000","last_fullsized":"2024-02-10T08:25:05.043970+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:46.389591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:24:46.389591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"55'1","reported_seq":178,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.046534+0000","last_change":"2024-02-10T08:20:20.303814+0000","last_active":"2024-02-10T08:25:05.046534+0000","last_peered":"2024-02-10T08:25:05.046534+0000","last_clean":"2024-02-10T08:25:05.046534+0000","last_became_active":"2024-02-10T08:16:52.790462+0000","last_became_peered":"2024-02-10T08:16:52.790462+0000","last_unstale":"2024-02-10T08:25:05.046534+0000","last_undegraded":"2024-02-10T08:25:05.046534+0000","last_fullsized":"2024-02-10T08:25:05.046534+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'1","last_scrub_stamp":"2024-02-10T08:20:20.303730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:20:20.303730+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"62'5","reported_seq":180,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-02-10T08:24:56.970287+0000","last_change":"2024-02-10T08:24:18.649450+0000","last_active":"2024-02-10T08:24:56.970287+0000","last_peered":"2024-02-10T08:24:56.970287+0000","last_clean":"2024-02-10T08:24:56.970287+0000","last_became_active":"2024-02-10T08:24:18.645076+0000","last_became_peered":"2024-02-10T08:24:18.645076+0000","last_unstale":"2024-02-10T08:24:56.970287+0000","last_undegraded":"2024-02-10T08:24:56.970287+0000","last_fullsized":"2024-02-10T08:24:56.970287+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'5","last_scrub_stamp":"2024-02-10T08:19:29.251633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:19:29.251633+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":6,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":56,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.049842+0000","last_change":"2024-02-10T08:23:15.078468+0000","last_active":"2024-02-10T08:25:05.049842+0000","last_peered":"2024-02-10T08:25:05.049842+0000","last_clean":"2024-02-10T08:25:05.049842+0000","last_became_active":"2024-02-10T08:23:15.078168+0000","last_became_peered":"2024-02-10T08:23:15.078168+0000","last_unstale":"2024-02-10T08:25:05.049842+0000","last_undegraded":"2024-02-10T08:25:05.049842+0000","last_fullsized":"2024-02-10T08:25:05.049842+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:00.830869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:20:00.830869+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,2],"acting":[1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":172,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.037781+0000","last_change":"2024-02-10T08:20:32.126091+0000","last_active":"2024-02-10T08:25:05.037781+0000","last_peered":"2024-02-10T08:25:05.037781+0000","last_clean":"2024-02-10T08:25:05.037781+0000","last_became_active":"2024-02-10T08:16:56.864532+0000","last_became_peered":"2024-02-10T08:16:56.864532+0000","last_unstale":"2024-02-10T08:25:05.037781+0000","last_undegraded":"2024-02-10T08:25:05.037781+0000","last_fullsized":"2024-02-10T08:25:05.037781+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:32.126007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:20:32.126007+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":171,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.044967+0000","last_change":"2024-02-10T08:20:02.245653+0000","last_active":"2024-02-10T08:25:05.044967+0000","last_peered":"2024-02-10T08:25:05.044967+0000","last_clean":"2024-02-10T08:25:05.044967+0000","last_became_active":"2024-02-10T08:16:52.787865+0000","last_became_peered":"2024-02-10T08:16:52.787865+0000","last_unstale":"2024-02-10T08:25:05.044967+0000","last_undegraded":"2024-02-10T08:25:05.044967+0000","last_fullsized":"2024-02-10T08:25:05.044967+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:02.245593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:28.028556+0000","last_clean_scrub_stamp":"2024-02-10T08:20:02.245593+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"62'9","reported_seq":159,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-02-10T08:24:56.971052+0000","last_change":"2024-02-10T08:20:46.401585+0000","last_active":"2024-02-10T08:24:56.971052+0000","last_peered":"2024-02-10T08:24:56.971052+0000","last_clean":"2024-02-10T08:24:56.971052+0000","last_became_active":"2024-02-10T08:20:46.401156+0000","last_became_peered":"2024-02-10T08:20:46.401156+0000","last_unstale":"2024-02-10T08:24:56.971052+0000","last_undegraded":"2024-02-10T08:24:56.971052+0000","last_fullsized":"2024-02-10T08:24:56.971052+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'9","last_scrub_stamp":"2024-02-10T08:18:15.012657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:15.012657+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":82,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.044753+0000","last_change":"2024-02-10T08:24:48.944058+0000","last_active":"2024-02-10T08:25:05.044753+0000","last_peered":"2024-02-10T08:25:05.044753+0000","last_clean":"2024-02-10T08:25:05.044753+0000","last_became_active":"2024-02-10T08:22:23.526229+0000","last_became_peered":"2024-02-10T08:22:23.526229+0000","last_unstale":"2024-02-10T08:25:05.044753+0000","last_undegraded":"2024-02-10T08:25:05.044753+0000","last_fullsized":"2024-02-10T08:25:05.044753+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:48.943972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:24:48.943972+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":144,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-02-10T08:24:56.970042+0000","last_change":"2024-02-10T08:20:46.399318+0000","last_active":"2024-02-10T08:24:56.970042+0000","last_peered":"2024-02-10T08:24:56.970042+0000","last_clean":"2024-02-10T08:24:56.970042+0000","last_became_active":"2024-02-10T08:20:46.398532+0000","last_became_peered":"2024-02-10T08:20:46.398532+0000","last_unstale":"2024-02-10T08:24:56.970042+0000","last_undegraded":"2024-02-10T08:24:56.970042+0000","last_fullsized":"2024-02-10T08:24:56.970042+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:22.000811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:22.000811+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":86,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.044461+0000","last_change":"2024-02-10T08:23:34.729120+0000","last_active":"2024-02-10T08:25:05.044461+0000","last_peered":"2024-02-10T08:25:05.044461+0000","last_clean":"2024-02-10T08:25:05.044461+0000","last_became_active":"2024-02-10T08:23:34.728772+0000","last_became_peered":"2024-02-10T08:23:34.728772+0000","last_unstale":"2024-02-10T08:25:05.044461+0000","last_undegraded":"2024-02-10T08:25:05.044461+0000","last_fullsized":"2024-02-10T08:25:05.044461+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:04.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:20:04.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1d","version":"74'17","reported_seq":153,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.049889+0000","last_change":"2024-02-10T08:24:29.544596+0000","last_active":"2024-02-10T08:25:05.049889+0000","last_peered":"2024-02-10T08:25:05.049889+0000","last_clean":"2024-02-10T08:25:05.049889+0000","last_became_active":"2024-02-10T08:23:34.710443+0000","last_became_peered":"2024-02-10T08:23:34.710443+0000","last_unstale":"2024-02-10T08:25:05.049889+0000","last_undegraded":"2024-02-10T08:25:05.049889+0000","last_fullsized":"2024-02-10T08:25:05.049889+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'17","last_scrub_stamp":"2024-02-10T08:24:29.544422+0000","last_deep_scrub":"74'17","last_deep_scrub_stamp":"2024-02-10T08:18:02.949298+0000","last_clean_scrub_stamp":"2024-02-10T08:24:29.544422+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,6],"acting":[1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":142,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-02-10T08:24:56.970649+0000","last_change":"2024-02-10T08:20:46.403697+0000","last_active":"2024-02-10T08:24:56.970649+0000","last_peered":"2024-02-10T08:24:56.970649+0000","last_clean":"2024-02-10T08:24:56.970649+0000","last_became_active":"2024-02-10T08:20:46.403378+0000","last_became_peered":"2024-02-10T08:20:46.403378+0000","last_unstale":"2024-02-10T08:24:56.970649+0000","last_undegraded":"2024-02-10T08:24:56.970649+0000","last_fullsized":"2024-02-10T08:24:56.970649+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:26.952496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:26.952496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":178,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.052578+0000","last_change":"2024-02-10T08:20:46.407843+0000","last_active":"2024-02-10T08:25:05.052578+0000","last_peered":"2024-02-10T08:25:05.052578+0000","last_clean":"2024-02-10T08:25:05.052578+0000","last_became_active":"2024-02-10T08:20:46.407373+0000","last_became_peered":"2024-02-10T08:20:46.407373+0000","last_unstale":"2024-02-10T08:25:05.052578+0000","last_undegraded":"2024-02-10T08:25:05.052578+0000","last_fullsized":"2024-02-10T08:25:05.052578+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:38.230210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:38.230210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":186,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.044627+0000","last_change":"2024-02-10T08:20:46.396617+0000","last_active":"2024-02-10T08:25:05.044627+0000","last_peered":"2024-02-10T08:25:05.044627+0000","last_clean":"2024-02-10T08:25:05.044627+0000","last_became_active":"2024-02-10T08:20:46.396303+0000","last_became_peered":"2024-02-10T08:20:46.396303+0000","last_unstale":"2024-02-10T08:25:05.044627+0000","last_undegraded":"2024-02-10T08:25:05.044627+0000","last_fullsized":"2024-02-10T08:25:05.044627+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:10.370746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:10.370746+0000","last_clean_scrub_stamp":"2024-02-10T08:19:10.370746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1c","version":"62'15","reported_seq":225,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.046997+0000","last_change":"2024-02-10T08:23:34.751643+0000","last_active":"2024-02-10T08:25:05.046997+0000","last_peered":"2024-02-10T08:25:05.046997+0000","last_clean":"2024-02-10T08:25:05.046997+0000","last_became_active":"2024-02-10T08:23:34.712669+0000","last_became_peered":"2024-02-10T08:23:34.712669+0000","last_unstale":"2024-02-10T08:25:05.046997+0000","last_undegraded":"2024-02-10T08:25:05.046997+0000","last_fullsized":"2024-02-10T08:25:05.046997+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'15","last_scrub_stamp":"2024-02-10T08:20:30.939526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:20:30.939526+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4],"acting":[2,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":181,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.049525+0000","last_change":"2024-02-10T08:24:49.507878+0000","last_active":"2024-02-10T08:25:05.049525+0000","last_peered":"2024-02-10T08:25:05.049525+0000","last_clean":"2024-02-10T08:25:05.049525+0000","last_became_active":"2024-02-10T08:20:46.408504+0000","last_became_peered":"2024-02-10T08:20:46.408504+0000","last_unstale":"2024-02-10T08:25:05.049525+0000","last_undegraded":"2024-02-10T08:25:05.049525+0000","last_fullsized":"2024-02-10T08:25:05.049525+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:49.507652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:22.104988+0000","last_clean_scrub_stamp":"2024-02-10T08:24:49.507652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":172,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.049210+0000","last_change":"2024-02-10T08:24:35.817815+0000","last_active":"2024-02-10T08:25:05.049210+0000","last_peered":"2024-02-10T08:25:05.049210+0000","last_clean":"2024-02-10T08:25:05.049210+0000","last_became_active":"2024-02-10T08:16:56.863348+0000","last_became_peered":"2024-02-10T08:16:56.863348+0000","last_unstale":"2024-02-10T08:25:05.049210+0000","last_undegraded":"2024-02-10T08:25:05.049210+0000","last_fullsized":"2024-02-10T08:25:05.049210+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:35.817703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:24:35.817703+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":86,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.043916+0000","last_change":"2024-02-10T08:23:34.718956+0000","last_active":"2024-02-10T08:25:05.043916+0000","last_peered":"2024-02-10T08:25:05.043916+0000","last_clean":"2024-02-10T08:25:05.043916+0000","last_became_active":"2024-02-10T08:23:34.718640+0000","last_became_peered":"2024-02-10T08:23:34.718640+0000","last_unstale":"2024-02-10T08:25:05.043916+0000","last_undegraded":"2024-02-10T08:25:05.043916+0000","last_fullsized":"2024-02-10T08:25:05.043916+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:14.238991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:20:14.238991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2],"acting":[6,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"62'11","reported_seq":188,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.044625+0000","last_change":"2024-02-10T08:19:29.497168+0000","last_active":"2024-02-10T08:25:05.044625+0000","last_peered":"2024-02-10T08:25:05.044625+0000","last_clean":"2024-02-10T08:25:05.044625+0000","last_became_active":"2024-02-10T08:16:54.852665+0000","last_became_peered":"2024-02-10T08:16:54.852665+0000","last_unstale":"2024-02-10T08:25:05.044625+0000","last_undegraded":"2024-02-10T08:25:05.044625+0000","last_fullsized":"2024-02-10T08:25:05.044625+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'11","last_scrub_stamp":"2024-02-10T08:19:29.497086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:19:29.497086+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"87'2","reported_seq":172,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.045310+0000","last_change":"2024-02-10T08:24:49.441418+0000","last_active":"2024-02-10T08:25:05.045310+0000","last_peered":"2024-02-10T08:25:05.045310+0000","last_clean":"2024-02-10T08:25:05.045310+0000","last_became_active":"2024-02-10T08:16:58.859047+0000","last_became_peered":"2024-02-10T08:16:58.859047+0000","last_unstale":"2024-02-10T08:25:05.045310+0000","last_undegraded":"2024-02-10T08:25:05.045310+0000","last_fullsized":"2024-02-10T08:25:05.045310+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'2","last_scrub_stamp":"2024-02-10T08:24:49.441352+0000","last_deep_scrub":"87'2","last_deep_scrub_stamp":"2024-02-10T08:19:29.207531+0000","last_clean_scrub_stamp":"2024-02-10T08:24:49.441352+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"111'11","reported_seq":298,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:06.049860+0000","last_change":"2024-02-10T08:24:35.067134+0000","last_active":"2024-02-10T08:25:06.049860+0000","last_peered":"2024-02-10T08:25:06.049860+0000","last_clean":"2024-02-10T08:25:06.049860+0000","last_became_active":"2024-02-10T08:20:46.402663+0000","last_became_peered":"2024-02-10T08:20:46.402663+0000","last_unstale":"2024-02-10T08:25:06.049860+0000","last_undegraded":"2024-02-10T08:25:06.049860+0000","last_fullsized":"2024-02-10T08:25:06.049860+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'11","last_scrub_stamp":"2024-02-10T08:24:35.067055+0000","last_deep_scrub":"82'9","last_deep_scrub_stamp":"2024-02-10T08:18:36.323217+0000","last_clean_scrub_stamp":"2024-02-10T08:24:35.067055+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":186,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.037398+0000","last_change":"2024-02-10T08:24:35.866229+0000","last_active":"2024-02-10T08:25:05.037398+0000","last_peered":"2024-02-10T08:25:05.037398+0000","last_clean":"2024-02-10T08:25:05.037398+0000","last_became_active":"2024-02-10T08:20:46.392466+0000","last_became_peered":"2024-02-10T08:20:46.392466+0000","last_unstale":"2024-02-10T08:25:05.037398+0000","last_undegraded":"2024-02-10T08:25:05.037398+0000","last_fullsized":"2024-02-10T08:25:05.037398+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:35.866138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:30.422800+0000","last_clean_scrub_stamp":"2024-02-10T08:24:35.866138+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"74'15","reported_seq":215,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.049217+0000","last_change":"2024-02-10T08:24:34.836917+0000","last_active":"2024-02-10T08:25:05.049217+0000","last_peered":"2024-02-10T08:25:05.049217+0000","last_clean":"2024-02-10T08:25:05.049217+0000","last_became_active":"2024-02-10T08:23:15.079324+0000","last_became_peered":"2024-02-10T08:23:15.079324+0000","last_unstale":"2024-02-10T08:25:05.049217+0000","last_undegraded":"2024-02-10T08:25:05.049217+0000","last_fullsized":"2024-02-10T08:25:05.049217+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'15","last_scrub_stamp":"2024-02-10T08:24:34.836829+0000","last_deep_scrub":"74'15","last_deep_scrub_stamp":"2024-02-10T08:17:57.637346+0000","last_clean_scrub_stamp":"2024-02-10T08:24:34.836829+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":68,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.046349+0000","last_change":"2024-02-10T08:23:34.710627+0000","last_active":"2024-02-10T08:25:05.046349+0000","last_peered":"2024-02-10T08:25:05.046349+0000","last_clean":"2024-02-10T08:25:05.046349+0000","last_became_active":"2024-02-10T08:23:34.710302+0000","last_became_peered":"2024-02-10T08:23:34.710302+0000","last_unstale":"2024-02-10T08:25:05.046349+0000","last_undegraded":"2024-02-10T08:25:05.046349+0000","last_fullsized":"2024-02-10T08:25:05.046349+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:15.204475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:20:15.204475+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4],"acting":[6,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":182,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.043636+0000","last_change":"2024-02-10T08:20:46.400144+0000","last_active":"2024-02-10T08:25:05.043636+0000","last_peered":"2024-02-10T08:25:05.043636+0000","last_clean":"2024-02-10T08:25:05.043636+0000","last_became_active":"2024-02-10T08:20:46.399838+0000","last_became_peered":"2024-02-10T08:20:46.399838+0000","last_unstale":"2024-02-10T08:25:05.043636+0000","last_undegraded":"2024-02-10T08:25:05.043636+0000","last_fullsized":"2024-02-10T08:25:05.043636+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:06.357048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:19:06.357048+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":171,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.044441+0000","last_change":"2024-02-10T08:19:22.466525+0000","last_active":"2024-02-10T08:25:05.044441+0000","last_peered":"2024-02-10T08:25:05.044441+0000","last_clean":"2024-02-10T08:25:05.044441+0000","last_became_active":"2024-02-10T08:16:52.788629+0000","last_became_peered":"2024-02-10T08:16:52.788629+0000","last_unstale":"2024-02-10T08:25:05.044441+0000","last_undegraded":"2024-02-10T08:25:05.044441+0000","last_fullsized":"2024-02-10T08:25:05.044441+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:22.466453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:19:22.466453+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"62'11","reported_seq":108,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.043552+0000","last_change":"2024-02-10T08:22:23.526546+0000","last_active":"2024-02-10T08:25:05.043552+0000","last_peered":"2024-02-10T08:25:05.043552+0000","last_clean":"2024-02-10T08:25:05.043552+0000","last_became_active":"2024-02-10T08:22:23.526198+0000","last_became_peered":"2024-02-10T08:22:23.526198+0000","last_unstale":"2024-02-10T08:25:05.043552+0000","last_undegraded":"2024-02-10T08:25:05.043552+0000","last_fullsized":"2024-02-10T08:25:05.043552+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'11","last_scrub_stamp":"2024-02-10T08:19:32.166830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:19:32.166830+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":180,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.044091+0000","last_change":"2024-02-10T08:20:46.399860+0000","last_active":"2024-02-10T08:25:05.044091+0000","last_peered":"2024-02-10T08:25:05.044091+0000","last_clean":"2024-02-10T08:25:05.044091+0000","last_became_active":"2024-02-10T08:20:46.399515+0000","last_became_peered":"2024-02-10T08:20:46.399515+0000","last_unstale":"2024-02-10T08:25:05.044091+0000","last_undegraded":"2024-02-10T08:25:05.044091+0000","last_fullsized":"2024-02-10T08:25:05.044091+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:27.276490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:27.276490+0000","last_clean_scrub_stamp":"2024-02-10T08:19:27.276490+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":182,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.043987+0000","last_change":"2024-02-10T08:24:46.904048+0000","last_active":"2024-02-10T08:25:05.043987+0000","last_peered":"2024-02-10T08:25:05.043987+0000","last_clean":"2024-02-10T08:25:05.043987+0000","last_became_active":"2024-02-10T08:20:46.397495+0000","last_became_peered":"2024-02-10T08:20:46.397495+0000","last_unstale":"2024-02-10T08:25:05.043987+0000","last_undegraded":"2024-02-10T08:25:05.043987+0000","last_fullsized":"2024-02-10T08:25:05.043987+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:46.903959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:24:46.903959+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":176,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.037979+0000","last_change":"2024-02-10T08:20:24.226131+0000","last_active":"2024-02-10T08:25:05.037979+0000","last_peered":"2024-02-10T08:25:05.037979+0000","last_clean":"2024-02-10T08:25:05.037979+0000","last_became_active":"2024-02-10T08:16:52.788704+0000","last_became_peered":"2024-02-10T08:16:52.788704+0000","last_unstale":"2024-02-10T08:25:05.037979+0000","last_undegraded":"2024-02-10T08:25:05.037979+0000","last_fullsized":"2024-02-10T08:25:05.037979+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:24.226061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:20:24.226061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"62'4","reported_seq":95,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.052877+0000","last_change":"2024-02-10T08:22:23.523381+0000","last_active":"2024-02-10T08:25:05.052877+0000","last_peered":"2024-02-10T08:25:05.052877+0000","last_clean":"2024-02-10T08:25:05.052877+0000","last_became_active":"2024-02-10T08:22:23.522936+0000","last_became_peered":"2024-02-10T08:22:23.522936+0000","last_unstale":"2024-02-10T08:25:05.052877+0000","last_undegraded":"2024-02-10T08:25:05.052877+0000","last_fullsized":"2024-02-10T08:25:05.052877+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'4","last_scrub_stamp":"2024-02-10T08:18:50.134690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:50.134690+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,6],"acting":[1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":86,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.037653+0000","last_change":"2024-02-10T08:24:36.822214+0000","last_active":"2024-02-10T08:25:05.037653+0000","last_peered":"2024-02-10T08:25:05.037653+0000","last_clean":"2024-02-10T08:25:05.037653+0000","last_became_active":"2024-02-10T08:23:34.710130+0000","last_became_peered":"2024-02-10T08:23:34.710130+0000","last_unstale":"2024-02-10T08:25:05.037653+0000","last_undegraded":"2024-02-10T08:25:05.037653+0000","last_fullsized":"2024-02-10T08:25:05.037653+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:36.822086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:24:36.822086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":177,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.055674+0000","last_change":"2024-02-10T08:23:15.078988+0000","last_active":"2024-02-10T08:25:05.055674+0000","last_peered":"2024-02-10T08:25:05.055674+0000","last_clean":"2024-02-10T08:25:05.055674+0000","last_became_active":"2024-02-10T08:23:15.078667+0000","last_became_peered":"2024-02-10T08:23:15.078667+0000","last_unstale":"2024-02-10T08:25:05.055674+0000","last_undegraded":"2024-02-10T08:25:05.055674+0000","last_fullsized":"2024-02-10T08:25:05.055674+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:07.754900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:20:07.754900+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":183,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.049734+0000","last_change":"2024-02-10T08:23:15.079985+0000","last_active":"2024-02-10T08:25:05.049734+0000","last_peered":"2024-02-10T08:25:05.049734+0000","last_clean":"2024-02-10T08:25:05.049734+0000","last_became_active":"2024-02-10T08:23:15.079635+0000","last_became_peered":"2024-02-10T08:23:15.079635+0000","last_unstale":"2024-02-10T08:25:05.049734+0000","last_undegraded":"2024-02-10T08:25:05.049734+0000","last_fullsized":"2024-02-10T08:25:05.049734+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:03.782136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:20:03.782136+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[1,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"201'16","reported_seq":197,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-02-10T08:24:56.970111+0000","last_change":"2024-02-10T08:24:49.177450+0000","last_active":"2024-02-10T08:24:56.970111+0000","last_peered":"2024-02-10T08:24:56.970111+0000","last_clean":"2024-02-10T08:24:56.970111+0000","last_became_active":"2024-02-10T08:20:46.396130+0000","last_became_peered":"2024-02-10T08:20:46.396130+0000","last_unstale":"2024-02-10T08:24:56.970111+0000","last_undegraded":"2024-02-10T08:24:56.970111+0000","last_fullsized":"2024-02-10T08:24:56.970111+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'16","last_scrub_stamp":"2024-02-10T08:24:49.177357+0000","last_deep_scrub":"201'16","last_deep_scrub_stamp":"2024-02-10T08:24:49.177357+0000","last_clean_scrub_stamp":"2024-02-10T08:24:49.177357+0000","log_size":16,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":170,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.046305+0000","last_change":"2024-02-10T08:24:36.840489+0000","last_active":"2024-02-10T08:25:05.046305+0000","last_peered":"2024-02-10T08:25:05.046305+0000","last_clean":"2024-02-10T08:25:05.046305+0000","last_became_active":"2024-02-10T08:16:58.861031+0000","last_became_peered":"2024-02-10T08:16:58.861031+0000","last_unstale":"2024-02-10T08:25:05.046305+0000","last_undegraded":"2024-02-10T08:25:05.046305+0000","last_fullsized":"2024-02-10T08:25:05.046305+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:36.840418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:24:36.840418+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":77,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.047849+0000","last_change":"2024-02-10T08:22:23.544616+0000","last_active":"2024-02-10T08:25:05.047849+0000","last_peered":"2024-02-10T08:25:05.047849+0000","last_clean":"2024-02-10T08:25:05.047849+0000","last_became_active":"2024-02-10T08:22:23.544158+0000","last_became_peered":"2024-02-10T08:22:23.544158+0000","last_unstale":"2024-02-10T08:25:05.047849+0000","last_undegraded":"2024-02-10T08:25:05.047849+0000","last_fullsized":"2024-02-10T08:25:05.047849+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:33.201370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:20:33.201370+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":178,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.044919+0000","last_change":"2024-02-10T08:20:32.148461+0000","last_active":"2024-02-10T08:25:05.044919+0000","last_peered":"2024-02-10T08:25:05.044919+0000","last_clean":"2024-02-10T08:25:05.044919+0000","last_became_active":"2024-02-10T08:16:52.786213+0000","last_became_peered":"2024-02-10T08:16:52.786213+0000","last_unstale":"2024-02-10T08:25:05.044919+0000","last_undegraded":"2024-02-10T08:25:05.044919+0000","last_fullsized":"2024-02-10T08:25:05.044919+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:32.148377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:20:32.148377+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"62'9","reported_seq":191,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.055523+0000","last_change":"2024-02-10T08:20:27.597657+0000","last_active":"2024-02-10T08:25:05.055523+0000","last_peered":"2024-02-10T08:25:05.055523+0000","last_clean":"2024-02-10T08:25:05.055523+0000","last_became_active":"2024-02-10T08:16:54.851971+0000","last_became_peered":"2024-02-10T08:16:54.851971+0000","last_unstale":"2024-02-10T08:25:05.055523+0000","last_undegraded":"2024-02-10T08:25:05.055523+0000","last_fullsized":"2024-02-10T08:25:05.055523+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'9","last_scrub_stamp":"2024-02-10T08:20:27.597547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:20:27.597547+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":142,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-02-10T08:24:56.970452+0000","last_change":"2024-02-10T08:20:46.396485+0000","last_active":"2024-02-10T08:24:56.970452+0000","last_peered":"2024-02-10T08:24:56.970452+0000","last_clean":"2024-02-10T08:24:56.970452+0000","last_became_active":"2024-02-10T08:20:46.395788+0000","last_became_peered":"2024-02-10T08:20:46.395788+0000","last_unstale":"2024-02-10T08:24:56.970452+0000","last_undegraded":"2024-02-10T08:24:56.970452+0000","last_fullsized":"2024-02-10T08:24:56.970452+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:22.955823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:22.955823+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"165'10","reported_seq":142,"reported_epoch":208,"state":"active+clean","last_fresh":"2024-02-10T08:25:06.054280+0000","last_change":"2024-02-10T08:23:15.344871+0000","last_active":"2024-02-10T08:25:06.054280+0000","last_peered":"2024-02-10T08:25:06.054280+0000","last_clean":"2024-02-10T08:25:06.054280+0000","last_became_active":"2024-02-10T08:23:15.080370+0000","last_became_peered":"2024-02-10T08:23:15.080370+0000","last_unstale":"2024-02-10T08:25:06.054280+0000","last_undegraded":"2024-02-10T08:25:06.054280+0000","last_fullsized":"2024-02-10T08:25:06.054280+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'8","last_scrub_stamp":"2024-02-10T08:20:10.351918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:20:10.351918+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,1],"acting":[7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":126,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-02-10T08:24:56.970373+0000","last_change":"2024-02-10T08:23:34.717367+0000","last_active":"2024-02-10T08:24:56.970373+0000","last_peered":"2024-02-10T08:24:56.970373+0000","last_clean":"2024-02-10T08:24:56.970373+0000","last_became_active":"2024-02-10T08:23:34.717015+0000","last_became_peered":"2024-02-10T08:23:34.717015+0000","last_unstale":"2024-02-10T08:24:56.970373+0000","last_undegraded":"2024-02-10T08:24:56.970373+0000","last_fullsized":"2024-02-10T08:24:56.970373+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:08.548458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:19:08.548458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"62'9","reported_seq":185,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.037934+0000","last_change":"2024-02-10T08:20:11.315987+0000","last_active":"2024-02-10T08:25:05.037934+0000","last_peered":"2024-02-10T08:25:05.037934+0000","last_clean":"2024-02-10T08:25:05.037934+0000","last_became_active":"2024-02-10T08:16:55.204734+0000","last_became_peered":"2024-02-10T08:16:55.204734+0000","last_unstale":"2024-02-10T08:25:05.037934+0000","last_undegraded":"2024-02-10T08:25:05.037934+0000","last_fullsized":"2024-02-10T08:25:05.037934+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'9","last_scrub_stamp":"2024-02-10T08:20:11.315903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:20:11.315903+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":56,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.045695+0000","last_change":"2024-02-10T08:23:15.068153+0000","last_active":"2024-02-10T08:25:05.045695+0000","last_peered":"2024-02-10T08:25:05.045695+0000","last_clean":"2024-02-10T08:25:05.045695+0000","last_became_active":"2024-02-10T08:23:15.067821+0000","last_became_peered":"2024-02-10T08:23:15.067821+0000","last_unstale":"2024-02-10T08:25:05.045695+0000","last_undegraded":"2024-02-10T08:25:05.045695+0000","last_fullsized":"2024-02-10T08:25:05.045695+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:26.027321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:05.662947+0000","last_clean_scrub_stamp":"2024-02-10T08:20:26.027321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"191'10","reported_seq":293,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:06.049059+0000","last_change":"2024-02-10T08:24:39.834882+0000","last_active":"2024-02-10T08:25:06.049059+0000","last_peered":"2024-02-10T08:25:06.049059+0000","last_clean":"2024-02-10T08:25:06.049059+0000","last_became_active":"2024-02-10T08:24:18.648087+0000","last_became_peered":"2024-02-10T08:24:18.648087+0000","last_unstale":"2024-02-10T08:25:06.049059+0000","last_undegraded":"2024-02-10T08:25:06.049059+0000","last_fullsized":"2024-02-10T08:25:06.049059+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"191'10","last_scrub_stamp":"2024-02-10T08:24:39.834778+0000","last_deep_scrub":"89'9","last_deep_scrub_stamp":"2024-02-10T08:19:33.299671+0000","last_clean_scrub_stamp":"2024-02-10T08:24:39.834778+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":176,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.037527+0000","last_change":"2024-02-10T08:24:48.740848+0000","last_active":"2024-02-10T08:25:05.037527+0000","last_peered":"2024-02-10T08:25:05.037527+0000","last_clean":"2024-02-10T08:25:05.037527+0000","last_became_active":"2024-02-10T08:16:52.789834+0000","last_became_peered":"2024-02-10T08:16:52.789834+0000","last_unstale":"2024-02-10T08:25:05.037527+0000","last_undegraded":"2024-02-10T08:25:05.037527+0000","last_fullsized":"2024-02-10T08:25:05.037527+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:48.740785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:24:48.740785+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"62'10","reported_seq":104,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.051849+0000","last_change":"2024-02-10T08:22:23.534468+0000","last_active":"2024-02-10T08:25:05.051849+0000","last_peered":"2024-02-10T08:25:05.051849+0000","last_clean":"2024-02-10T08:25:05.051849+0000","last_became_active":"2024-02-10T08:22:23.534081+0000","last_became_peered":"2024-02-10T08:22:23.534081+0000","last_unstale":"2024-02-10T08:25:05.051849+0000","last_undegraded":"2024-02-10T08:25:05.051849+0000","last_fullsized":"2024-02-10T08:25:05.051849+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'10","last_scrub_stamp":"2024-02-10T08:19:09.007376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:19:09.007376+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":180,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.046456+0000","last_change":"2024-02-10T08:24:33.098417+0000","last_active":"2024-02-10T08:25:05.046456+0000","last_peered":"2024-02-10T08:25:05.046456+0000","last_clean":"2024-02-10T08:25:05.046456+0000","last_became_active":"2024-02-10T08:20:46.398903+0000","last_became_peered":"2024-02-10T08:20:46.398903+0000","last_unstale":"2024-02-10T08:25:05.046456+0000","last_undegraded":"2024-02-10T08:25:05.046456+0000","last_fullsized":"2024-02-10T08:25:05.046456+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:33.098313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:24:33.098313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":167,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.037928+0000","last_change":"2024-02-10T08:20:10.278739+0000","last_active":"2024-02-10T08:25:05.037928+0000","last_peered":"2024-02-10T08:25:05.037928+0000","last_clean":"2024-02-10T08:25:05.037928+0000","last_became_active":"2024-02-10T08:16:56.863948+0000","last_became_peered":"2024-02-10T08:16:56.863948+0000","last_unstale":"2024-02-10T08:25:05.037928+0000","last_undegraded":"2024-02-10T08:25:05.037928+0000","last_fullsized":"2024-02-10T08:25:05.037928+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:10.278678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:20:10.278678+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":220,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.044056+0000","last_change":"2024-02-10T08:24:30.076419+0000","last_active":"2024-02-10T08:25:05.044056+0000","last_peered":"2024-02-10T08:25:05.044056+0000","last_clean":"2024-02-10T08:25:05.044056+0000","last_became_active":"2024-02-10T08:20:46.400758+0000","last_became_peered":"2024-02-10T08:20:46.400758+0000","last_unstale":"2024-02-10T08:25:05.044056+0000","last_undegraded":"2024-02-10T08:25:05.044056+0000","last_fullsized":"2024-02-10T08:25:05.044056+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:30.076335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:24:30.076335+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"62'6","reported_seq":115,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.045266+0000","last_change":"2024-02-10T08:23:15.341991+0000","last_active":"2024-02-10T08:25:05.045266+0000","last_peered":"2024-02-10T08:25:05.045266+0000","last_clean":"2024-02-10T08:25:05.045266+0000","last_became_active":"2024-02-10T08:23:15.079382+0000","last_became_peered":"2024-02-10T08:23:15.079382+0000","last_unstale":"2024-02-10T08:25:05.045266+0000","last_undegraded":"2024-02-10T08:25:05.045266+0000","last_fullsized":"2024-02-10T08:25:05.045266+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'6","last_scrub_stamp":"2024-02-10T08:20:08.360881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:20:08.360881+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":181,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.046792+0000","last_change":"2024-02-10T08:24:28.926064+0000","last_active":"2024-02-10T08:25:05.046792+0000","last_peered":"2024-02-10T08:25:05.046792+0000","last_clean":"2024-02-10T08:25:05.046792+0000","last_became_active":"2024-02-10T08:20:46.407214+0000","last_became_peered":"2024-02-10T08:20:46.407214+0000","last_unstale":"2024-02-10T08:25:05.046792+0000","last_undegraded":"2024-02-10T08:25:05.046792+0000","last_fullsized":"2024-02-10T08:25:05.046792+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:28.925986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:24:28.925986+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":86,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.050430+0000","last_change":"2024-02-10T08:23:34.730646+0000","last_active":"2024-02-10T08:25:05.050430+0000","last_peered":"2024-02-10T08:25:05.050430+0000","last_clean":"2024-02-10T08:25:05.050430+0000","last_became_active":"2024-02-10T08:23:34.730121+0000","last_became_peered":"2024-02-10T08:23:34.730121+0000","last_unstale":"2024-02-10T08:25:05.050430+0000","last_undegraded":"2024-02-10T08:25:05.050430+0000","last_fullsized":"2024-02-10T08:25:05.050430+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:07.352745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:20:07.352745+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"55'1","reported_seq":178,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.045398+0000","last_change":"2024-02-10T08:19:59.845452+0000","last_active":"2024-02-10T08:25:05.045398+0000","last_peered":"2024-02-10T08:25:05.045398+0000","last_clean":"2024-02-10T08:25:05.045398+0000","last_became_active":"2024-02-10T08:16:52.782734+0000","last_became_peered":"2024-02-10T08:16:52.782734+0000","last_unstale":"2024-02-10T08:25:05.045398+0000","last_undegraded":"2024-02-10T08:25:05.045398+0000","last_fullsized":"2024-02-10T08:25:05.045398+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'1","last_scrub_stamp":"2024-02-10T08:19:59.845351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:19:59.845351+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"62'9","reported_seq":86,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.045468+0000","last_change":"2024-02-10T08:23:35.071311+0000","last_active":"2024-02-10T08:25:05.045468+0000","last_peered":"2024-02-10T08:25:05.045468+0000","last_clean":"2024-02-10T08:25:05.045468+0000","last_became_active":"2024-02-10T08:23:34.719714+0000","last_became_peered":"2024-02-10T08:23:34.719714+0000","last_unstale":"2024-02-10T08:25:05.045468+0000","last_undegraded":"2024-02-10T08:25:05.045468+0000","last_fullsized":"2024-02-10T08:25:05.045468+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'9","last_scrub_stamp":"2024-02-10T08:19:14.500766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:19:14.500766+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.5","version":"208'3576","reported_seq":3601,"reported_epoch":208,"state":"active+clean","last_fresh":"2024-02-10T08:25:07.496261+0000","last_change":"2024-02-10T08:24:21.599844+0000","last_active":"2024-02-10T08:25:07.496261+0000","last_peered":"2024-02-10T08:25:07.496261+0000","last_clean":"2024-02-10T08:25:07.496261+0000","last_became_active":"2024-02-10T08:24:21.599552+0000","last_became_peered":"2024-02-10T08:24:21.599552+0000","last_unstale":"2024-02-10T08:25:07.496261+0000","last_undegraded":"2024-02-10T08:25:07.496261+0000","last_fullsized":"2024-02-10T08:25:07.496261+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:20.584872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:24:20.584872+0000","last_clean_scrub_stamp":"2024-02-10T08:24:20.584872+0000","log_size":3576,"ondisk_log_size":3576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":234356736,"num_objects":3576,"num_object_clones":0,"num_object_copies":10728,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3576,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3576,"num_write_kb":228864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":77,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.044353+0000","last_change":"2024-02-10T08:22:23.528605+0000","last_active":"2024-02-10T08:25:05.044353+0000","last_peered":"2024-02-10T08:25:05.044353+0000","last_clean":"2024-02-10T08:25:05.044353+0000","last_became_active":"2024-02-10T08:22:23.528310+0000","last_became_peered":"2024-02-10T08:22:23.528310+0000","last_unstale":"2024-02-10T08:25:05.044353+0000","last_undegraded":"2024-02-10T08:25:05.044353+0000","last_fullsized":"2024-02-10T08:25:05.044353+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:18.128487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:20:18.128487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"55'2","reported_seq":153,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-02-10T08:24:56.970732+0000","last_change":"2024-02-10T08:20:46.398750+0000","last_active":"2024-02-10T08:24:56.970732+0000","last_peered":"2024-02-10T08:24:56.970732+0000","last_clean":"2024-02-10T08:24:56.970732+0000","last_became_active":"2024-02-10T08:20:46.398441+0000","last_became_peered":"2024-02-10T08:20:46.398441+0000","last_unstale":"2024-02-10T08:24:56.970732+0000","last_undegraded":"2024-02-10T08:24:56.970732+0000","last_fullsized":"2024-02-10T08:24:56.970732+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'2","last_scrub_stamp":"2024-02-10T08:18:03.916322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:18:03.916322+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"82'17","reported_seq":195,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-02-10T08:24:56.968942+0000","last_change":"2024-02-10T08:23:15.516523+0000","last_active":"2024-02-10T08:24:56.968942+0000","last_peered":"2024-02-10T08:24:56.968942+0000","last_clean":"2024-02-10T08:24:56.968942+0000","last_became_active":"2024-02-10T08:23:15.126133+0000","last_became_peered":"2024-02-10T08:23:15.126133+0000","last_unstale":"2024-02-10T08:24:56.968942+0000","last_undegraded":"2024-02-10T08:24:56.968942+0000","last_fullsized":"2024-02-10T08:24:56.968942+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'17","last_scrub_stamp":"2024-02-10T08:18:21.015873+0000","last_deep_scrub":"82'17","last_deep_scrub_stamp":"2024-02-10T08:18:21.015873+0000","last_clean_scrub_stamp":"2024-02-10T08:18:21.015873+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6],"acting":[4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":173,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.045510+0000","last_change":"2024-02-10T08:24:45.946818+0000","last_active":"2024-02-10T08:25:05.045510+0000","last_peered":"2024-02-10T08:25:05.045510+0000","last_clean":"2024-02-10T08:25:05.045510+0000","last_became_active":"2024-02-10T08:16:56.860850+0000","last_became_peered":"2024-02-10T08:16:56.860850+0000","last_unstale":"2024-02-10T08:25:05.045510+0000","last_undegraded":"2024-02-10T08:25:05.045510+0000","last_fullsized":"2024-02-10T08:25:05.045510+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:45.946713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:24:45.946713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"208'3663","reported_seq":3688,"reported_epoch":208,"state":"active+clean","last_fresh":"2024-02-10T08:25:08.008789+0000","last_change":"2024-02-10T08:24:21.601824+0000","last_active":"2024-02-10T08:25:08.008789+0000","last_peered":"2024-02-10T08:25:08.008789+0000","last_clean":"2024-02-10T08:25:08.008789+0000","last_became_active":"2024-02-10T08:24:21.601429+0000","last_became_peered":"2024-02-10T08:24:21.601429+0000","last_unstale":"2024-02-10T08:25:08.008789+0000","last_undegraded":"2024-02-10T08:25:08.008789+0000","last_fullsized":"2024-02-10T08:25:08.008789+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:20.584872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:24:20.584872+0000","last_clean_scrub_stamp":"2024-02-10T08:24:20.584872+0000","log_size":3663,"ondisk_log_size":3663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":240058368,"num_objects":3663,"num_object_clones":0,"num_object_copies":10989,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3663,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3663,"num_write_kb":234432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4],"acting":[0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":184,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.046371+0000","last_change":"2024-02-10T08:24:48.866799+0000","last_active":"2024-02-10T08:25:05.046371+0000","last_peered":"2024-02-10T08:25:05.046371+0000","last_clean":"2024-02-10T08:25:05.046371+0000","last_became_active":"2024-02-10T08:21:58.554263+0000","last_became_peered":"2024-02-10T08:21:58.554263+0000","last_unstale":"2024-02-10T08:25:05.046371+0000","last_undegraded":"2024-02-10T08:25:05.046371+0000","last_fullsized":"2024-02-10T08:25:05.046371+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:48.866676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:24:48.866676+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":172,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.051726+0000","last_change":"2024-02-10T08:20:08.744631+0000","last_active":"2024-02-10T08:25:05.051726+0000","last_peered":"2024-02-10T08:25:05.051726+0000","last_clean":"2024-02-10T08:25:05.051726+0000","last_became_active":"2024-02-10T08:16:52.789354+0000","last_became_peered":"2024-02-10T08:16:52.789354+0000","last_unstale":"2024-02-10T08:25:05.051726+0000","last_undegraded":"2024-02-10T08:25:05.051726+0000","last_fullsized":"2024-02-10T08:25:05.051726+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:08.744567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:20:08.744567+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"62'10","reported_seq":200,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.055599+0000","last_change":"2024-02-10T08:24:43.501177+0000","last_active":"2024-02-10T08:25:05.055599+0000","last_peered":"2024-02-10T08:25:05.055599+0000","last_clean":"2024-02-10T08:25:05.055599+0000","last_became_active":"2024-02-10T08:20:46.408495+0000","last_became_peered":"2024-02-10T08:20:46.408495+0000","last_unstale":"2024-02-10T08:25:05.055599+0000","last_undegraded":"2024-02-10T08:25:05.055599+0000","last_fullsized":"2024-02-10T08:25:05.055599+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'10","last_scrub_stamp":"2024-02-10T08:24:43.501071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:24:43.501071+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"62'8","reported_seq":279,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:06.046876+0000","last_change":"2024-02-10T08:24:41.799744+0000","last_active":"2024-02-10T08:25:06.046876+0000","last_peered":"2024-02-10T08:25:06.046876+0000","last_clean":"2024-02-10T08:25:06.046876+0000","last_became_active":"2024-02-10T08:16:56.862677+0000","last_became_peered":"2024-02-10T08:16:56.862677+0000","last_unstale":"2024-02-10T08:25:06.046876+0000","last_undegraded":"2024-02-10T08:25:06.046876+0000","last_fullsized":"2024-02-10T08:25:06.046876+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'8","last_scrub_stamp":"2024-02-10T08:24:41.799640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:24:41.799640+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"208'3596","reported_seq":3621,"reported_epoch":208,"state":"active+clean","last_fresh":"2024-02-10T08:25:07.464727+0000","last_change":"2024-02-10T08:24:21.600654+0000","last_active":"2024-02-10T08:25:07.464727+0000","last_peered":"2024-02-10T08:25:07.464727+0000","last_clean":"2024-02-10T08:25:07.464727+0000","last_became_active":"2024-02-10T08:24:21.600373+0000","last_became_peered":"2024-02-10T08:24:21.600373+0000","last_unstale":"2024-02-10T08:25:07.464727+0000","last_undegraded":"2024-02-10T08:25:07.464727+0000","last_fullsized":"2024-02-10T08:25:07.464727+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:20.584872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:24:20.584872+0000","last_clean_scrub_stamp":"2024-02-10T08:24:20.584872+0000","log_size":3596,"ondisk_log_size":3596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":235667456,"num_objects":3596,"num_object_clones":0,"num_object_copies":10788,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3596,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3596,"num_write_kb":230144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":184,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-02-10T08:24:56.970430+0000","last_change":"2024-02-10T08:23:34.716839+0000","last_active":"2024-02-10T08:24:56.970430+0000","last_peered":"2024-02-10T08:24:56.970430+0000","last_clean":"2024-02-10T08:24:56.970430+0000","last_became_active":"2024-02-10T08:23:34.716482+0000","last_became_peered":"2024-02-10T08:23:34.716482+0000","last_unstale":"2024-02-10T08:24:56.970430+0000","last_undegraded":"2024-02-10T08:24:56.970430+0000","last_fullsized":"2024-02-10T08:24:56.970430+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:47.116727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:47.116727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":171,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.037623+0000","last_change":"2024-02-10T08:20:07.299708+0000","last_active":"2024-02-10T08:25:05.037623+0000","last_peered":"2024-02-10T08:25:05.037623+0000","last_clean":"2024-02-10T08:25:05.037623+0000","last_became_active":"2024-02-10T08:16:52.791027+0000","last_became_peered":"2024-02-10T08:16:52.791027+0000","last_unstale":"2024-02-10T08:25:05.037623+0000","last_undegraded":"2024-02-10T08:25:05.037623+0000","last_fullsized":"2024-02-10T08:25:05.037623+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:07.299640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:20:07.299640+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"173'29","reported_seq":353,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:06.049132+0000","last_change":"2024-02-10T08:23:35.581967+0000","last_active":"2024-02-10T08:25:06.049132+0000","last_peered":"2024-02-10T08:25:06.049132+0000","last_clean":"2024-02-10T08:25:06.049132+0000","last_became_active":"2024-02-10T08:23:34.709222+0000","last_became_peered":"2024-02-10T08:23:34.709222+0000","last_unstale":"2024-02-10T08:25:06.049132+0000","last_undegraded":"2024-02-10T08:25:06.049132+0000","last_fullsized":"2024-02-10T08:25:06.049132+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'28","last_scrub_stamp":"2024-02-10T08:20:16.678147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:20:16.678147+0000","log_size":29,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":48,"num_read_kb":33,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":358,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":127,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.049609+0000","last_change":"2024-02-10T08:23:15.082129+0000","last_active":"2024-02-10T08:25:05.049609+0000","last_peered":"2024-02-10T08:25:05.049609+0000","last_clean":"2024-02-10T08:25:05.049609+0000","last_became_active":"2024-02-10T08:23:15.081822+0000","last_became_peered":"2024-02-10T08:23:15.081822+0000","last_unstale":"2024-02-10T08:25:05.049609+0000","last_undegraded":"2024-02-10T08:25:05.049609+0000","last_fullsized":"2024-02-10T08:25:05.049609+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:51.533128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:51.533128+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,6],"acting":[1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"206'3363","reported_seq":3386,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-02-10T08:25:04.658366+0000","last_change":"2024-02-10T08:24:21.599451+0000","last_active":"2024-02-10T08:25:04.658366+0000","last_peered":"2024-02-10T08:25:04.658366+0000","last_clean":"2024-02-10T08:25:04.658366+0000","last_became_active":"2024-02-10T08:24:21.599126+0000","last_became_peered":"2024-02-10T08:24:21.599126+0000","last_unstale":"2024-02-10T08:25:04.658366+0000","last_undegraded":"2024-02-10T08:25:04.658366+0000","last_fullsized":"2024-02-10T08:25:04.658366+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:20.584872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:24:20.584872+0000","last_clean_scrub_stamp":"2024-02-10T08:24:20.584872+0000","log_size":3363,"ondisk_log_size":3363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220397568,"num_objects":3363,"num_object_clones":0,"num_object_copies":10089,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3363,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3363,"num_write_kb":215232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":174,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.046669+0000","last_change":"2024-02-10T08:21:58.550001+0000","last_active":"2024-02-10T08:25:05.046669+0000","last_peered":"2024-02-10T08:25:05.046669+0000","last_clean":"2024-02-10T08:25:05.046669+0000","last_became_active":"2024-02-10T08:21:58.549733+0000","last_became_peered":"2024-02-10T08:21:58.549733+0000","last_unstale":"2024-02-10T08:25:05.046669+0000","last_undegraded":"2024-02-10T08:25:05.046669+0000","last_fullsized":"2024-02-10T08:25:05.046669+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:08.316685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:11.750537+0000","last_clean_scrub_stamp":"2024-02-10T08:20:08.316685+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"63'5","reported_seq":661,"reported_epoch":208,"state":"active+clean","last_fresh":"2024-02-10T08:25:06.063601+0000","last_change":"2024-02-10T08:19:12.466527+0000","last_active":"2024-02-10T08:25:06.063601+0000","last_peered":"2024-02-10T08:25:06.063601+0000","last_clean":"2024-02-10T08:25:06.063601+0000","last_became_active":"2024-02-10T08:16:52.780989+0000","last_became_peered":"2024-02-10T08:16:52.780989+0000","last_unstale":"2024-02-10T08:25:06.063601+0000","last_undegraded":"2024-02-10T08:25:06.063601+0000","last_fullsized":"2024-02-10T08:25:06.063601+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'5","last_scrub_stamp":"2024-02-10T08:19:12.466451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:19:12.466451+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":486,"num_read_kb":481,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":186,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.045830+0000","last_change":"2024-02-10T08:24:38.934675+0000","last_active":"2024-02-10T08:25:05.045830+0000","last_peered":"2024-02-10T08:25:05.045830+0000","last_clean":"2024-02-10T08:25:05.045830+0000","last_became_active":"2024-02-10T08:23:34.705014+0000","last_became_peered":"2024-02-10T08:23:34.705014+0000","last_unstale":"2024-02-10T08:25:05.045830+0000","last_undegraded":"2024-02-10T08:25:05.045830+0000","last_fullsized":"2024-02-10T08:25:05.045830+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:38.934608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:11.681169+0000","last_clean_scrub_stamp":"2024-02-10T08:24:38.934608+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"62'13","reported_seq":58,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.050348+0000","last_change":"2024-02-10T08:23:35.682739+0000","last_active":"2024-02-10T08:25:05.050348+0000","last_peered":"2024-02-10T08:25:05.050348+0000","last_clean":"2024-02-10T08:25:05.050348+0000","last_became_active":"2024-02-10T08:23:34.729593+0000","last_became_peered":"2024-02-10T08:23:34.729593+0000","last_unstale":"2024-02-10T08:25:05.050348+0000","last_undegraded":"2024-02-10T08:25:05.050348+0000","last_fullsized":"2024-02-10T08:25:05.050348+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'13","last_scrub_stamp":"2024-02-10T08:20:13.727564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:20:13.727564+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":18,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":168,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.047600+0000","last_change":"2024-02-10T08:20:00.886336+0000","last_active":"2024-02-10T08:25:05.047600+0000","last_peered":"2024-02-10T08:25:05.047600+0000","last_clean":"2024-02-10T08:25:05.047600+0000","last_became_active":"2024-02-10T08:16:56.857856+0000","last_became_peered":"2024-02-10T08:16:56.857856+0000","last_unstale":"2024-02-10T08:25:05.047600+0000","last_undegraded":"2024-02-10T08:25:05.047600+0000","last_fullsized":"2024-02-10T08:25:05.047600+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:00.886232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:20:00.886232+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"208'3588","reported_seq":3613,"reported_epoch":208,"state":"active+clean","last_fresh":"2024-02-10T08:25:07.488933+0000","last_change":"2024-02-10T08:24:21.600043+0000","last_active":"2024-02-10T08:25:07.488933+0000","last_peered":"2024-02-10T08:25:07.488933+0000","last_clean":"2024-02-10T08:25:07.488933+0000","last_became_active":"2024-02-10T08:24:21.599733+0000","last_became_peered":"2024-02-10T08:24:21.599733+0000","last_unstale":"2024-02-10T08:25:07.488933+0000","last_undegraded":"2024-02-10T08:25:07.488933+0000","last_fullsized":"2024-02-10T08:25:07.488933+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:20.584872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:24:20.584872+0000","last_clean_scrub_stamp":"2024-02-10T08:24:20.584872+0000","log_size":3588,"ondisk_log_size":3588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":235143168,"num_objects":3588,"num_object_clones":0,"num_object_copies":10764,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3588,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3588,"num_write_kb":229632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,3],"acting":[6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":184,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.038520+0000","last_change":"2024-02-10T08:21:58.560883+0000","last_active":"2024-02-10T08:25:05.038520+0000","last_peered":"2024-02-10T08:25:05.038520+0000","last_clean":"2024-02-10T08:25:05.038520+0000","last_became_active":"2024-02-10T08:21:58.560646+0000","last_became_peered":"2024-02-10T08:21:58.560646+0000","last_unstale":"2024-02-10T08:25:05.038520+0000","last_undegraded":"2024-02-10T08:25:05.038520+0000","last_fullsized":"2024-02-10T08:25:05.038520+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:45.379932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:45.379932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":91,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.037911+0000","last_change":"2024-02-10T08:24:40.803085+0000","last_active":"2024-02-10T08:25:05.037911+0000","last_peered":"2024-02-10T08:25:05.037911+0000","last_clean":"2024-02-10T08:25:05.037911+0000","last_became_active":"2024-02-10T08:23:34.712122+0000","last_became_peered":"2024-02-10T08:23:34.712122+0000","last_unstale":"2024-02-10T08:25:05.037911+0000","last_undegraded":"2024-02-10T08:25:05.037911+0000","last_fullsized":"2024-02-10T08:25:05.037911+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:40.803027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:24:40.803027+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,4],"acting":[5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":176,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.037596+0000","last_change":"2024-02-10T08:24:46.833927+0000","last_active":"2024-02-10T08:25:05.037596+0000","last_peered":"2024-02-10T08:25:05.037596+0000","last_clean":"2024-02-10T08:25:05.037596+0000","last_became_active":"2024-02-10T08:16:52.788767+0000","last_became_peered":"2024-02-10T08:16:52.788767+0000","last_unstale":"2024-02-10T08:25:05.037596+0000","last_undegraded":"2024-02-10T08:25:05.037596+0000","last_fullsized":"2024-02-10T08:25:05.037596+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:46.833859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:24:46.833859+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":191,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.043343+0000","last_change":"2024-02-10T08:23:34.718189+0000","last_active":"2024-02-10T08:25:05.043343+0000","last_peered":"2024-02-10T08:25:05.043343+0000","last_clean":"2024-02-10T08:25:05.043343+0000","last_became_active":"2024-02-10T08:23:34.717837+0000","last_became_peered":"2024-02-10T08:23:34.717837+0000","last_unstale":"2024-02-10T08:25:05.043343+0000","last_undegraded":"2024-02-10T08:25:05.043343+0000","last_fullsized":"2024-02-10T08:25:05.043343+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:06.252449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:14:44.584370+0000","last_clean_scrub_stamp":"2024-02-10T08:20:06.252449+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"62'14","reported_seq":206,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.045069+0000","last_change":"2024-02-10T08:24:34.101557+0000","last_active":"2024-02-10T08:25:05.045069+0000","last_peered":"2024-02-10T08:25:05.045069+0000","last_clean":"2024-02-10T08:25:05.045069+0000","last_became_active":"2024-02-10T08:20:46.401981+0000","last_became_peered":"2024-02-10T08:20:46.401981+0000","last_unstale":"2024-02-10T08:25:05.045069+0000","last_undegraded":"2024-02-10T08:25:05.045069+0000","last_fullsized":"2024-02-10T08:25:05.045069+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'14","last_scrub_stamp":"2024-02-10T08:24:34.101474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:24:34.101474+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":15,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":167,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.045143+0000","last_change":"2024-02-10T08:19:34.226328+0000","last_active":"2024-02-10T08:25:05.045143+0000","last_peered":"2024-02-10T08:25:05.045143+0000","last_clean":"2024-02-10T08:25:05.045143+0000","last_became_active":"2024-02-10T08:16:56.867159+0000","last_became_peered":"2024-02-10T08:16:56.867159+0000","last_unstale":"2024-02-10T08:25:05.045143+0000","last_undegraded":"2024-02-10T08:25:05.045143+0000","last_fullsized":"2024-02-10T08:25:05.045143+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:34.226262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:04.766780+0000","last_clean_scrub_stamp":"2024-02-10T08:19:34.226262+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"208'3715","reported_seq":3740,"reported_epoch":208,"state":"active+clean","last_fresh":"2024-02-10T08:25:07.586631+0000","last_change":"2024-02-10T08:24:21.601506+0000","last_active":"2024-02-10T08:25:07.586631+0000","last_peered":"2024-02-10T08:25:07.586631+0000","last_clean":"2024-02-10T08:25:07.586631+0000","last_became_active":"2024-02-10T08:24:21.601203+0000","last_became_peered":"2024-02-10T08:24:21.601203+0000","last_unstale":"2024-02-10T08:25:07.586631+0000","last_undegraded":"2024-02-10T08:25:07.586631+0000","last_fullsized":"2024-02-10T08:25:07.586631+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:20.584872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:24:20.584872+0000","last_clean_scrub_stamp":"2024-02-10T08:24:20.584872+0000","log_size":3715,"ondisk_log_size":3715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":243466240,"num_objects":3715,"num_object_clones":0,"num_object_copies":11145,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3715,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3715,"num_write_kb":237760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":184,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.051945+0000","last_change":"2024-02-10T08:23:34.709678+0000","last_active":"2024-02-10T08:25:05.051945+0000","last_peered":"2024-02-10T08:25:05.051945+0000","last_clean":"2024-02-10T08:25:05.051945+0000","last_became_active":"2024-02-10T08:23:34.708536+0000","last_became_peered":"2024-02-10T08:23:34.708536+0000","last_unstale":"2024-02-10T08:25:05.051945+0000","last_undegraded":"2024-02-10T08:25:05.051945+0000","last_fullsized":"2024-02-10T08:25:05.051945+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:09.785096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:20:09.785096+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[1,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":197,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.046643+0000","last_change":"2024-02-10T08:24:32.843437+0000","last_active":"2024-02-10T08:25:05.046643+0000","last_peered":"2024-02-10T08:25:05.046643+0000","last_clean":"2024-02-10T08:25:05.046643+0000","last_became_active":"2024-02-10T08:23:15.074780+0000","last_became_peered":"2024-02-10T08:23:15.074780+0000","last_unstale":"2024-02-10T08:25:05.046643+0000","last_undegraded":"2024-02-10T08:25:05.046643+0000","last_fullsized":"2024-02-10T08:25:05.046643+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:32.843336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:20.736224+0000","last_clean_scrub_stamp":"2024-02-10T08:24:32.843336+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":171,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.043267+0000","last_change":"2024-02-10T08:20:12.387549+0000","last_active":"2024-02-10T08:25:05.043267+0000","last_peered":"2024-02-10T08:25:05.043267+0000","last_clean":"2024-02-10T08:25:05.043267+0000","last_became_active":"2024-02-10T08:16:52.787180+0000","last_became_peered":"2024-02-10T08:16:52.787180+0000","last_unstale":"2024-02-10T08:25:05.043267+0000","last_undegraded":"2024-02-10T08:25:05.043267+0000","last_fullsized":"2024-02-10T08:25:05.043267+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:12.387482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:20:12.387482+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"62'12","reported_seq":100,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.051374+0000","last_change":"2024-02-10T08:23:15.686615+0000","last_active":"2024-02-10T08:25:05.051374+0000","last_peered":"2024-02-10T08:25:05.051374+0000","last_clean":"2024-02-10T08:25:05.051374+0000","last_became_active":"2024-02-10T08:23:15.077476+0000","last_became_peered":"2024-02-10T08:23:15.077476+0000","last_unstale":"2024-02-10T08:25:05.051374+0000","last_undegraded":"2024-02-10T08:25:05.051374+0000","last_fullsized":"2024-02-10T08:25:05.051374+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'12","last_scrub_stamp":"2024-02-10T08:20:04.883293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:20:04.883293+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,7],"acting":[1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":167,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.038432+0000","last_change":"2024-02-10T08:20:08.318643+0000","last_active":"2024-02-10T08:25:05.038432+0000","last_peered":"2024-02-10T08:25:05.038432+0000","last_clean":"2024-02-10T08:25:05.038432+0000","last_became_active":"2024-02-10T08:16:56.864030+0000","last_became_peered":"2024-02-10T08:16:56.864030+0000","last_unstale":"2024-02-10T08:25:05.038432+0000","last_undegraded":"2024-02-10T08:25:05.038432+0000","last_fullsized":"2024-02-10T08:25:05.038432+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:08.318570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:41.360241+0000","last_clean_scrub_stamp":"2024-02-10T08:20:08.318570+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"208'3669","reported_seq":3694,"reported_epoch":208,"state":"active+clean","last_fresh":"2024-02-10T08:25:07.708401+0000","last_change":"2024-02-10T08:24:21.603538+0000","last_active":"2024-02-10T08:25:07.708401+0000","last_peered":"2024-02-10T08:25:07.708401+0000","last_clean":"2024-02-10T08:25:07.708401+0000","last_became_active":"2024-02-10T08:24:21.603237+0000","last_became_peered":"2024-02-10T08:24:21.603237+0000","last_unstale":"2024-02-10T08:25:07.708401+0000","last_undegraded":"2024-02-10T08:25:07.708401+0000","last_fullsized":"2024-02-10T08:25:07.708401+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:20.584872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:24:20.584872+0000","last_clean_scrub_stamp":"2024-02-10T08:24:20.584872+0000","log_size":3669,"ondisk_log_size":3669,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":240451584,"num_objects":3669,"num_object_clones":0,"num_object_copies":11007,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3669,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3669,"num_write_kb":234816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":175,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.053688+0000","last_change":"2024-02-10T08:21:58.554689+0000","last_active":"2024-02-10T08:25:05.053688+0000","last_peered":"2024-02-10T08:25:05.053688+0000","last_clean":"2024-02-10T08:25:05.053688+0000","last_became_active":"2024-02-10T08:21:58.553966+0000","last_became_peered":"2024-02-10T08:21:58.553966+0000","last_unstale":"2024-02-10T08:25:05.053688+0000","last_undegraded":"2024-02-10T08:25:05.053688+0000","last_fullsized":"2024-02-10T08:25:05.053688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:25.568342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:19:25.568342+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":165,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.046211+0000","last_change":"2024-02-10T08:24:30.914570+0000","last_active":"2024-02-10T08:25:05.046211+0000","last_peered":"2024-02-10T08:25:05.046211+0000","last_clean":"2024-02-10T08:25:05.046211+0000","last_became_active":"2024-02-10T08:23:34.708387+0000","last_became_peered":"2024-02-10T08:23:34.708387+0000","last_unstale":"2024-02-10T08:25:05.046211+0000","last_undegraded":"2024-02-10T08:25:05.046211+0000","last_fullsized":"2024-02-10T08:25:05.046211+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:30.914502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:24:30.914502+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"199'27","reported_seq":218,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.047615+0000","last_change":"2024-02-10T08:24:42.826545+0000","last_active":"2024-02-10T08:25:05.047615+0000","last_peered":"2024-02-10T08:25:05.047615+0000","last_clean":"2024-02-10T08:25:05.047615+0000","last_became_active":"2024-02-10T08:16:55.203453+0000","last_became_peered":"2024-02-10T08:16:55.203453+0000","last_unstale":"2024-02-10T08:25:05.047615+0000","last_undegraded":"2024-02-10T08:25:05.047615+0000","last_fullsized":"2024-02-10T08:25:05.047615+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"199'27","last_scrub_stamp":"2024-02-10T08:24:42.826442+0000","last_deep_scrub":"199'27","last_deep_scrub_stamp":"2024-02-10T08:24:42.826442+0000","last_clean_scrub_stamp":"2024-02-10T08:24:42.826442+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":167,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.044706+0000","last_change":"2024-02-10T08:20:07.350344+0000","last_active":"2024-02-10T08:25:05.044706+0000","last_peered":"2024-02-10T08:25:05.044706+0000","last_clean":"2024-02-10T08:25:05.044706+0000","last_became_active":"2024-02-10T08:16:56.861172+0000","last_became_peered":"2024-02-10T08:16:56.861172+0000","last_unstale":"2024-02-10T08:25:05.044706+0000","last_undegraded":"2024-02-10T08:25:05.044706+0000","last_fullsized":"2024-02-10T08:25:05.044706+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:07.350256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:20:07.350256+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.c","version":"208'3635","reported_seq":3660,"reported_epoch":208,"state":"active+clean","last_fresh":"2024-02-10T08:25:07.480943+0000","last_change":"2024-02-10T08:24:21.603760+0000","last_active":"2024-02-10T08:25:07.480943+0000","last_peered":"2024-02-10T08:25:07.480943+0000","last_clean":"2024-02-10T08:25:07.480943+0000","last_became_active":"2024-02-10T08:24:21.603455+0000","last_became_peered":"2024-02-10T08:24:21.603455+0000","last_unstale":"2024-02-10T08:25:07.480943+0000","last_undegraded":"2024-02-10T08:25:07.480943+0000","last_fullsized":"2024-02-10T08:25:07.480943+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:20.584872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:24:20.584872+0000","last_clean_scrub_stamp":"2024-02-10T08:24:20.584872+0000","log_size":3635,"ondisk_log_size":3635,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":238223360,"num_objects":3635,"num_object_clones":0,"num_object_copies":10905,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3635,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3635,"num_write_kb":232640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":169,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-02-10T08:24:56.970301+0000","last_change":"2024-02-10T08:23:15.074597+0000","last_active":"2024-02-10T08:24:56.970301+0000","last_peered":"2024-02-10T08:24:56.970301+0000","last_clean":"2024-02-10T08:24:56.970301+0000","last_became_active":"2024-02-10T08:23:15.074239+0000","last_became_peered":"2024-02-10T08:23:15.074239+0000","last_unstale":"2024-02-10T08:24:56.970301+0000","last_undegraded":"2024-02-10T08:24:56.970301+0000","last_fullsized":"2024-02-10T08:24:56.970301+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:22.216312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:19:22.216312+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":187,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.051161+0000","last_change":"2024-02-10T08:24:38.505837+0000","last_active":"2024-02-10T08:25:05.051161+0000","last_peered":"2024-02-10T08:25:05.051161+0000","last_clean":"2024-02-10T08:25:05.051161+0000","last_became_active":"2024-02-10T08:20:46.407667+0000","last_became_peered":"2024-02-10T08:20:46.407667+0000","last_unstale":"2024-02-10T08:25:05.051161+0000","last_undegraded":"2024-02-10T08:25:05.051161+0000","last_fullsized":"2024-02-10T08:25:05.051161+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:38.505735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:24:38.505735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"62'18","reported_seq":161,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.043688+0000","last_change":"2024-02-10T08:24:41.032303+0000","last_active":"2024-02-10T08:25:05.043688+0000","last_peered":"2024-02-10T08:25:05.043688+0000","last_clean":"2024-02-10T08:25:05.043688+0000","last_became_active":"2024-02-10T08:23:15.079674+0000","last_became_peered":"2024-02-10T08:23:15.079674+0000","last_unstale":"2024-02-10T08:25:05.043688+0000","last_undegraded":"2024-02-10T08:25:05.043688+0000","last_fullsized":"2024-02-10T08:25:05.043688+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'18","last_scrub_stamp":"2024-02-10T08:24:41.032197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:24:41.032197+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":33,"num_read_kb":21,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,5],"acting":[7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":151,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-02-10T08:24:56.969855+0000","last_change":"2024-02-10T08:23:34.706538+0000","last_active":"2024-02-10T08:24:56.969855+0000","last_peered":"2024-02-10T08:24:56.969855+0000","last_clean":"2024-02-10T08:24:56.969855+0000","last_became_active":"2024-02-10T08:23:34.706206+0000","last_became_peered":"2024-02-10T08:23:34.706206+0000","last_unstale":"2024-02-10T08:24:56.969855+0000","last_undegraded":"2024-02-10T08:24:56.969855+0000","last_fullsized":"2024-02-10T08:24:56.969855+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:15.979973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:15.979973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,5],"acting":[4,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"208'3558","reported_seq":3583,"reported_epoch":208,"state":"active+clean","last_fresh":"2024-02-10T08:25:07.490535+0000","last_change":"2024-02-10T08:24:21.601386+0000","last_active":"2024-02-10T08:25:07.490535+0000","last_peered":"2024-02-10T08:25:07.490535+0000","last_clean":"2024-02-10T08:25:07.490535+0000","last_became_active":"2024-02-10T08:24:21.601091+0000","last_became_peered":"2024-02-10T08:24:21.601091+0000","last_unstale":"2024-02-10T08:25:07.490535+0000","last_undegraded":"2024-02-10T08:25:07.490535+0000","last_fullsized":"2024-02-10T08:25:07.490535+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:20.584872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:24:20.584872+0000","last_clean_scrub_stamp":"2024-02-10T08:24:20.584872+0000","log_size":3558,"ondisk_log_size":3558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":233177088,"num_objects":3558,"num_object_clones":0,"num_object_copies":10674,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3558,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3558,"num_write_kb":227712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2],"acting":[5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":174,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.044644+0000","last_change":"2024-02-10T08:21:58.547282+0000","last_active":"2024-02-10T08:25:05.044644+0000","last_peered":"2024-02-10T08:25:05.044644+0000","last_clean":"2024-02-10T08:25:05.044644+0000","last_became_active":"2024-02-10T08:21:58.546976+0000","last_became_peered":"2024-02-10T08:21:58.546976+0000","last_unstale":"2024-02-10T08:25:05.044644+0000","last_undegraded":"2024-02-10T08:25:05.044644+0000","last_fullsized":"2024-02-10T08:25:05.044644+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:22.272986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:20:22.272986+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":171,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.044468+0000","last_change":"2024-02-10T08:20:03.392639+0000","last_active":"2024-02-10T08:25:05.044468+0000","last_peered":"2024-02-10T08:25:05.044468+0000","last_clean":"2024-02-10T08:25:05.044468+0000","last_became_active":"2024-02-10T08:16:52.789020+0000","last_became_peered":"2024-02-10T08:16:52.789020+0000","last_unstale":"2024-02-10T08:25:05.044468+0000","last_undegraded":"2024-02-10T08:25:05.044468+0000","last_fullsized":"2024-02-10T08:25:05.044468+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:03.392561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:20:03.392561+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"62'14","reported_seq":161,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-02-10T08:24:56.969460+0000","last_change":"2024-02-10T08:20:46.401263+0000","last_active":"2024-02-10T08:24:56.969460+0000","last_peered":"2024-02-10T08:24:56.969460+0000","last_clean":"2024-02-10T08:24:56.969460+0000","last_became_active":"2024-02-10T08:20:46.400760+0000","last_became_peered":"2024-02-10T08:20:46.400760+0000","last_unstale":"2024-02-10T08:24:56.969460+0000","last_undegraded":"2024-02-10T08:24:56.969460+0000","last_fullsized":"2024-02-10T08:24:56.969460+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'14","last_scrub_stamp":"2024-02-10T08:18:10.980421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:18:10.980421+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"199'13","reported_seq":148,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:06.049148+0000","last_change":"2024-02-10T08:24:47.529599+0000","last_active":"2024-02-10T08:25:06.049148+0000","last_peered":"2024-02-10T08:25:06.049148+0000","last_clean":"2024-02-10T08:25:06.049148+0000","last_became_active":"2024-02-10T08:23:34.711450+0000","last_became_peered":"2024-02-10T08:23:34.711450+0000","last_unstale":"2024-02-10T08:25:06.049148+0000","last_undegraded":"2024-02-10T08:25:06.049148+0000","last_fullsized":"2024-02-10T08:25:06.049148+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"199'13","last_scrub_stamp":"2024-02-10T08:24:47.529439+0000","last_deep_scrub":"199'13","last_deep_scrub_stamp":"2024-02-10T08:24:47.529439+0000","last_clean_scrub_stamp":"2024-02-10T08:24:47.529439+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,2],"acting":[1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"206'3386","reported_seq":3409,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-02-10T08:25:04.681359+0000","last_change":"2024-02-10T08:24:21.599718+0000","last_active":"2024-02-10T08:25:04.681359+0000","last_peered":"2024-02-10T08:25:04.681359+0000","last_clean":"2024-02-10T08:25:04.681359+0000","last_became_active":"2024-02-10T08:24:21.599424+0000","last_became_peered":"2024-02-10T08:24:21.599424+0000","last_unstale":"2024-02-10T08:25:04.681359+0000","last_undegraded":"2024-02-10T08:25:04.681359+0000","last_fullsized":"2024-02-10T08:25:04.681359+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:20.584872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:24:20.584872+0000","last_clean_scrub_stamp":"2024-02-10T08:24:20.584872+0000","log_size":3386,"ondisk_log_size":3386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":221904896,"num_objects":3386,"num_object_clones":0,"num_object_copies":10158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3386,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3386,"num_write_kb":216704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,5],"acting":[4,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":86,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.044996+0000","last_change":"2024-02-10T08:23:34.716626+0000","last_active":"2024-02-10T08:25:05.044996+0000","last_peered":"2024-02-10T08:25:05.044996+0000","last_clean":"2024-02-10T08:25:05.044996+0000","last_became_active":"2024-02-10T08:23:34.716306+0000","last_became_peered":"2024-02-10T08:23:34.716306+0000","last_unstale":"2024-02-10T08:25:05.044996+0000","last_undegraded":"2024-02-10T08:25:05.044996+0000","last_fullsized":"2024-02-10T08:25:05.044996+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:30.227375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:20:30.227375+0000","last_clean_scrub_stamp":"2024-02-10T08:20:30.227375+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,7],"acting":[6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":232,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.038421+0000","last_change":"2024-02-10T08:24:32.858765+0000","last_active":"2024-02-10T08:25:05.038421+0000","last_peered":"2024-02-10T08:25:05.038421+0000","last_clean":"2024-02-10T08:25:05.038421+0000","last_became_active":"2024-02-10T08:20:46.400500+0000","last_became_peered":"2024-02-10T08:20:46.400500+0000","last_unstale":"2024-02-10T08:25:05.038421+0000","last_undegraded":"2024-02-10T08:25:05.038421+0000","last_fullsized":"2024-02-10T08:25:05.038421+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:32.858639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:24:32.858639+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":171,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.043418+0000","last_change":"2024-02-10T08:20:01.263757+0000","last_active":"2024-02-10T08:25:05.043418+0000","last_peered":"2024-02-10T08:25:05.043418+0000","last_clean":"2024-02-10T08:25:05.043418+0000","last_became_active":"2024-02-10T08:16:52.786822+0000","last_became_peered":"2024-02-10T08:16:52.786822+0000","last_unstale":"2024-02-10T08:25:05.043418+0000","last_undegraded":"2024-02-10T08:25:05.043418+0000","last_fullsized":"2024-02-10T08:25:05.043418+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:01.263661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:20:01.263661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"76'16","reported_seq":179,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-02-10T08:24:56.970789+0000","last_change":"2024-02-10T08:20:46.406601+0000","last_active":"2024-02-10T08:24:56.970789+0000","last_peered":"2024-02-10T08:24:56.970789+0000","last_clean":"2024-02-10T08:24:56.970789+0000","last_became_active":"2024-02-10T08:20:46.406023+0000","last_became_peered":"2024-02-10T08:20:46.406023+0000","last_unstale":"2024-02-10T08:24:56.970789+0000","last_undegraded":"2024-02-10T08:24:56.970789+0000","last_fullsized":"2024-02-10T08:24:56.970789+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'16","last_scrub_stamp":"2024-02-10T08:19:24.195140+0000","last_deep_scrub":"76'16","last_deep_scrub_stamp":"2024-02-10T08:18:07.909782+0000","last_clean_scrub_stamp":"2024-02-10T08:19:24.195140+0000","log_size":16,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3","version":"208'3576","reported_seq":3601,"reported_epoch":208,"state":"active+clean","last_fresh":"2024-02-10T08:25:07.572157+0000","last_change":"2024-02-10T08:24:21.599851+0000","last_active":"2024-02-10T08:25:07.572157+0000","last_peered":"2024-02-10T08:25:07.572157+0000","last_clean":"2024-02-10T08:25:07.572157+0000","last_became_active":"2024-02-10T08:24:21.599504+0000","last_became_peered":"2024-02-10T08:24:21.599504+0000","last_unstale":"2024-02-10T08:25:07.572157+0000","last_undegraded":"2024-02-10T08:25:07.572157+0000","last_fullsized":"2024-02-10T08:25:07.572157+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:20.584872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:24:20.584872+0000","last_clean_scrub_stamp":"2024-02-10T08:24:20.584872+0000","log_size":3576,"ondisk_log_size":3576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":234356736,"num_objects":3576,"num_object_clones":0,"num_object_copies":10728,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3576,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3576,"num_write_kb":228864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[1,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":179,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.038245+0000","last_change":"2024-02-10T08:24:47.799386+0000","last_active":"2024-02-10T08:25:05.038245+0000","last_peered":"2024-02-10T08:25:05.038245+0000","last_clean":"2024-02-10T08:25:05.038245+0000","last_became_active":"2024-02-10T08:23:15.078797+0000","last_became_peered":"2024-02-10T08:23:15.078797+0000","last_unstale":"2024-02-10T08:25:05.038245+0000","last_undegraded":"2024-02-10T08:25:05.038245+0000","last_fullsized":"2024-02-10T08:25:05.038245+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:47.799298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:24:47.799298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,2],"acting":[5,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"111'10","reported_seq":223,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-02-10T08:25:01.020755+0000","last_change":"2024-02-10T08:20:46.402756+0000","last_active":"2024-02-10T08:25:01.020755+0000","last_peered":"2024-02-10T08:25:01.020755+0000","last_clean":"2024-02-10T08:25:01.020755+0000","last_became_active":"2024-02-10T08:20:46.401894+0000","last_became_peered":"2024-02-10T08:20:46.401894+0000","last_unstale":"2024-02-10T08:25:01.020755+0000","last_undegraded":"2024-02-10T08:25:01.020755+0000","last_fullsized":"2024-02-10T08:25:01.020755+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'8","last_scrub_stamp":"2024-02-10T08:18:28.991446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:28.991446+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":172,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.053583+0000","last_change":"2024-02-10T08:20:04.745454+0000","last_active":"2024-02-10T08:25:05.053583+0000","last_peered":"2024-02-10T08:25:05.053583+0000","last_clean":"2024-02-10T08:25:05.053583+0000","last_became_active":"2024-02-10T08:16:52.783634+0000","last_became_peered":"2024-02-10T08:16:52.783634+0000","last_unstale":"2024-02-10T08:25:05.053583+0000","last_undegraded":"2024-02-10T08:25:05.053583+0000","last_fullsized":"2024-02-10T08:25:05.053583+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:04.745360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:20:04.745360+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"62'15","reported_seq":177,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.047949+0000","last_change":"2024-02-10T08:24:27.962957+0000","last_active":"2024-02-10T08:25:05.047949+0000","last_peered":"2024-02-10T08:25:05.047949+0000","last_clean":"2024-02-10T08:25:05.047949+0000","last_became_active":"2024-02-10T08:20:46.401777+0000","last_became_peered":"2024-02-10T08:20:46.401777+0000","last_unstale":"2024-02-10T08:25:05.047949+0000","last_undegraded":"2024-02-10T08:25:05.047949+0000","last_fullsized":"2024-02-10T08:25:05.047949+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'15","last_scrub_stamp":"2024-02-10T08:24:27.962879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:24:27.962879+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.0","version":"208'3658","reported_seq":3683,"reported_epoch":208,"state":"active+clean","last_fresh":"2024-02-10T08:25:07.497549+0000","last_change":"2024-02-10T08:24:21.600077+0000","last_active":"2024-02-10T08:25:07.497549+0000","last_peered":"2024-02-10T08:25:07.497549+0000","last_clean":"2024-02-10T08:25:07.497549+0000","last_became_active":"2024-02-10T08:24:21.599802+0000","last_became_peered":"2024-02-10T08:24:21.599802+0000","last_unstale":"2024-02-10T08:25:07.497549+0000","last_undegraded":"2024-02-10T08:25:07.497549+0000","last_fullsized":"2024-02-10T08:25:07.497549+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:20.584872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:24:20.584872+0000","last_clean_scrub_stamp":"2024-02-10T08:24:20.584872+0000","log_size":3658,"ondisk_log_size":3658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":239730688,"num_objects":3658,"num_object_clones":0,"num_object_copies":10974,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3658,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3658,"num_write_kb":234112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":139,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-02-10T08:24:56.970545+0000","last_change":"2024-02-10T08:24:45.194692+0000","last_active":"2024-02-10T08:24:56.970545+0000","last_peered":"2024-02-10T08:24:56.970545+0000","last_clean":"2024-02-10T08:24:56.970545+0000","last_became_active":"2024-02-10T08:20:46.405578+0000","last_became_peered":"2024-02-10T08:20:46.405578+0000","last_unstale":"2024-02-10T08:24:56.970545+0000","last_undegraded":"2024-02-10T08:24:56.970545+0000","last_fullsized":"2024-02-10T08:24:56.970545+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:45.194614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:24:45.194614+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"62'8","reported_seq":280,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:06.046875+0000","last_change":"2024-02-10T08:24:39.917285+0000","last_active":"2024-02-10T08:25:06.046875+0000","last_peered":"2024-02-10T08:25:06.046875+0000","last_clean":"2024-02-10T08:25:06.046875+0000","last_became_active":"2024-02-10T08:16:56.858101+0000","last_became_peered":"2024-02-10T08:16:56.858101+0000","last_unstale":"2024-02-10T08:25:06.046875+0000","last_undegraded":"2024-02-10T08:25:06.046875+0000","last_fullsized":"2024-02-10T08:25:06.046875+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'8","last_scrub_stamp":"2024-02-10T08:24:39.917176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:24:39.917176+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":172,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.055452+0000","last_change":"2024-02-10T08:19:31.561674+0000","last_active":"2024-02-10T08:25:05.055452+0000","last_peered":"2024-02-10T08:25:05.055452+0000","last_clean":"2024-02-10T08:25:05.055452+0000","last_became_active":"2024-02-10T08:16:52.785545+0000","last_became_peered":"2024-02-10T08:16:52.785545+0000","last_unstale":"2024-02-10T08:25:05.055452+0000","last_undegraded":"2024-02-10T08:25:05.055452+0000","last_fullsized":"2024-02-10T08:25:05.055452+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:31.561534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:19:31.561534+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"62'10","reported_seq":169,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-02-10T08:24:56.970046+0000","last_change":"2024-02-10T08:20:46.399522+0000","last_active":"2024-02-10T08:24:56.970046+0000","last_peered":"2024-02-10T08:24:56.970046+0000","last_clean":"2024-02-10T08:24:56.970046+0000","last_became_active":"2024-02-10T08:20:46.398973+0000","last_became_peered":"2024-02-10T08:20:46.398973+0000","last_unstale":"2024-02-10T08:24:56.970046+0000","last_undegraded":"2024-02-10T08:24:56.970046+0000","last_fullsized":"2024-02-10T08:24:56.970046+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'10","last_scrub_stamp":"2024-02-10T08:19:16.196834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:19:16.196834+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1","version":"208'3567","reported_seq":3590,"reported_epoch":208,"state":"active+clean","last_fresh":"2024-02-10T08:25:07.596398+0000","last_change":"2024-02-10T08:24:21.601446+0000","last_active":"2024-02-10T08:25:07.596398+0000","last_peered":"2024-02-10T08:25:07.596398+0000","last_clean":"2024-02-10T08:25:07.596398+0000","last_became_active":"2024-02-10T08:24:21.598978+0000","last_became_peered":"2024-02-10T08:24:21.598978+0000","last_unstale":"2024-02-10T08:25:07.596398+0000","last_undegraded":"2024-02-10T08:25:07.596398+0000","last_fullsized":"2024-02-10T08:25:07.596398+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:20.584872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:24:20.584872+0000","last_clean_scrub_stamp":"2024-02-10T08:24:20.584872+0000","log_size":3567,"ondisk_log_size":3567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":233766912,"num_objects":3567,"num_object_clones":0,"num_object_copies":10701,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3567,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3567,"num_write_kb":228288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":33,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.047300+0000","last_change":"2024-02-10T08:24:33.895974+0000","last_active":"2024-02-10T08:25:05.047300+0000","last_peered":"2024-02-10T08:25:05.047300+0000","last_clean":"2024-02-10T08:25:05.047300+0000","last_became_active":"2024-02-10T08:24:18.646774+0000","last_became_peered":"2024-02-10T08:24:18.646774+0000","last_unstale":"2024-02-10T08:25:05.047300+0000","last_undegraded":"2024-02-10T08:25:05.047300+0000","last_fullsized":"2024-02-10T08:25:05.047300+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:33.895864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:24:33.895864+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6],"acting":[0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":178,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.051890+0000","last_change":"2024-02-10T08:20:46.407303+0000","last_active":"2024-02-10T08:25:05.051890+0000","last_peered":"2024-02-10T08:25:05.051890+0000","last_clean":"2024-02-10T08:25:05.051890+0000","last_became_active":"2024-02-10T08:20:46.406971+0000","last_became_peered":"2024-02-10T08:20:46.406971+0000","last_unstale":"2024-02-10T08:25:05.051890+0000","last_undegraded":"2024-02-10T08:25:05.051890+0000","last_fullsized":"2024-02-10T08:25:05.051890+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:37.273476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:18:37.273476+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":186,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.044289+0000","last_change":"2024-02-10T08:20:46.399889+0000","last_active":"2024-02-10T08:25:05.044289+0000","last_peered":"2024-02-10T08:25:05.044289+0000","last_clean":"2024-02-10T08:25:05.044289+0000","last_became_active":"2024-02-10T08:20:46.399568+0000","last_became_peered":"2024-02-10T08:20:46.399568+0000","last_unstale":"2024-02-10T08:25:05.044289+0000","last_undegraded":"2024-02-10T08:25:05.044289+0000","last_fullsized":"2024-02-10T08:25:05.044289+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:22.228064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:19:22.228064+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"62'17","reported_seq":210,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-02-10T08:24:56.970194+0000","last_change":"2024-02-10T08:20:46.396386+0000","last_active":"2024-02-10T08:24:56.970194+0000","last_peered":"2024-02-10T08:24:56.970194+0000","last_clean":"2024-02-10T08:24:56.970194+0000","last_became_active":"2024-02-10T08:20:46.395694+0000","last_became_peered":"2024-02-10T08:20:46.395694+0000","last_unstale":"2024-02-10T08:24:56.970194+0000","last_undegraded":"2024-02-10T08:24:56.970194+0000","last_fullsized":"2024-02-10T08:24:56.970194+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'17","last_scrub_stamp":"2024-02-10T08:19:26.245091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:19:26.245091+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":28,"num_read_kb":18,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.6","version":"208'3625","reported_seq":3650,"reported_epoch":208,"state":"active+clean","last_fresh":"2024-02-10T08:25:08.031849+0000","last_change":"2024-02-10T08:24:21.598389+0000","last_active":"2024-02-10T08:25:08.031849+0000","last_peered":"2024-02-10T08:25:08.031849+0000","last_clean":"2024-02-10T08:25:08.031849+0000","last_became_active":"2024-02-10T08:24:21.598099+0000","last_became_peered":"2024-02-10T08:24:21.598099+0000","last_unstale":"2024-02-10T08:25:08.031849+0000","last_undegraded":"2024-02-10T08:25:08.031849+0000","last_fullsized":"2024-02-10T08:25:08.031849+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:20.584872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:24:20.584872+0000","last_clean_scrub_stamp":"2024-02-10T08:24:20.584872+0000","log_size":3625,"ondisk_log_size":3625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":237568000,"num_objects":3625,"num_object_clones":0,"num_object_copies":10875,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3625,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3625,"num_write_kb":232000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,7],"acting":[0,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":183,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.043176+0000","last_change":"2024-02-10T08:24:18.645855+0000","last_active":"2024-02-10T08:25:05.043176+0000","last_peered":"2024-02-10T08:25:05.043176+0000","last_clean":"2024-02-10T08:25:05.043176+0000","last_became_active":"2024-02-10T08:24:18.645480+0000","last_became_peered":"2024-02-10T08:24:18.645480+0000","last_unstale":"2024-02-10T08:25:05.043176+0000","last_undegraded":"2024-02-10T08:25:05.043176+0000","last_fullsized":"2024-02-10T08:25:05.043176+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:24.199920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:19:24.199920+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,3],"acting":[7,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":173,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.046559+0000","last_change":"2024-02-10T08:24:37.884534+0000","last_active":"2024-02-10T08:25:05.046559+0000","last_peered":"2024-02-10T08:25:05.046559+0000","last_clean":"2024-02-10T08:25:05.046559+0000","last_became_active":"2024-02-10T08:16:56.864026+0000","last_became_peered":"2024-02-10T08:16:56.864026+0000","last_unstale":"2024-02-10T08:25:05.046559+0000","last_undegraded":"2024-02-10T08:25:05.046559+0000","last_fullsized":"2024-02-10T08:25:05.046559+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:37.884438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:24:37.884438+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":177,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.046951+0000","last_change":"2024-02-10T08:20:21.977157+0000","last_active":"2024-02-10T08:25:05.046951+0000","last_peered":"2024-02-10T08:25:05.046951+0000","last_clean":"2024-02-10T08:25:05.046951+0000","last_became_active":"2024-02-10T08:16:52.789100+0000","last_became_peered":"2024-02-10T08:16:52.789100+0000","last_unstale":"2024-02-10T08:25:05.046951+0000","last_undegraded":"2024-02-10T08:25:05.046951+0000","last_fullsized":"2024-02-10T08:25:05.046951+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:21.977065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:20:21.977065+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"62'19","reported_seq":200,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.044551+0000","last_change":"2024-02-10T08:20:01.351638+0000","last_active":"2024-02-10T08:25:05.044551+0000","last_peered":"2024-02-10T08:25:05.044551+0000","last_clean":"2024-02-10T08:25:05.044551+0000","last_became_active":"2024-02-10T08:16:55.203415+0000","last_became_peered":"2024-02-10T08:16:55.203415+0000","last_unstale":"2024-02-10T08:25:05.044551+0000","last_undegraded":"2024-02-10T08:25:05.044551+0000","last_fullsized":"2024-02-10T08:25:05.044551+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'19","last_scrub_stamp":"2024-02-10T08:20:01.351573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:20:01.351573+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.7","version":"208'3645","reported_seq":3670,"reported_epoch":208,"state":"active+clean","last_fresh":"2024-02-10T08:25:07.581140+0000","last_change":"2024-02-10T08:24:21.600562+0000","last_active":"2024-02-10T08:25:07.581140+0000","last_peered":"2024-02-10T08:25:07.581140+0000","last_clean":"2024-02-10T08:25:07.581140+0000","last_became_active":"2024-02-10T08:24:21.600279+0000","last_became_peered":"2024-02-10T08:24:21.600279+0000","last_unstale":"2024-02-10T08:25:07.581140+0000","last_undegraded":"2024-02-10T08:25:07.581140+0000","last_fullsized":"2024-02-10T08:25:07.581140+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:20.584872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:24:20.584872+0000","last_clean_scrub_stamp":"2024-02-10T08:24:20.584872+0000","log_size":3645,"ondisk_log_size":3645,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":238878720,"num_objects":3645,"num_object_clones":0,"num_object_copies":10935,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3645,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3645,"num_write_kb":233280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,6],"acting":[1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.9","version":"76'2","reported_seq":73,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.043383+0000","last_change":"2024-02-10T08:23:34.718711+0000","last_active":"2024-02-10T08:25:05.043383+0000","last_peered":"2024-02-10T08:25:05.043383+0000","last_clean":"2024-02-10T08:25:05.043383+0000","last_became_active":"2024-02-10T08:23:34.718483+0000","last_became_peered":"2024-02-10T08:23:34.718483+0000","last_unstale":"2024-02-10T08:25:05.043383+0000","last_undegraded":"2024-02-10T08:25:05.043383+0000","last_fullsized":"2024-02-10T08:25:05.043383+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'2","last_scrub_stamp":"2024-02-10T08:19:28.458129+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2024-02-10T08:18:08.680038+0000","last_clean_scrub_stamp":"2024-02-10T08:19:28.458129+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":6,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":192,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.046030+0000","last_change":"2024-02-10T08:24:34.869126+0000","last_active":"2024-02-10T08:25:05.046030+0000","last_peered":"2024-02-10T08:25:05.046030+0000","last_clean":"2024-02-10T08:25:05.046030+0000","last_became_active":"2024-02-10T08:23:34.704848+0000","last_became_peered":"2024-02-10T08:23:34.704848+0000","last_unstale":"2024-02-10T08:25:05.046030+0000","last_undegraded":"2024-02-10T08:25:05.046030+0000","last_fullsized":"2024-02-10T08:25:05.046030+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:34.869041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:24:34.869041+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0],"acting":[2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":187,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.049803+0000","last_change":"2024-02-10T08:20:46.407715+0000","last_active":"2024-02-10T08:25:05.049803+0000","last_peered":"2024-02-10T08:25:05.049803+0000","last_clean":"2024-02-10T08:25:05.049803+0000","last_became_active":"2024-02-10T08:20:46.407311+0000","last_became_peered":"2024-02-10T08:20:46.407311+0000","last_unstale":"2024-02-10T08:25:05.049803+0000","last_undegraded":"2024-02-10T08:25:05.049803+0000","last_fullsized":"2024-02-10T08:25:05.049803+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:19:21.523096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:21.523096+0000","last_clean_scrub_stamp":"2024-02-10T08:19:21.523096+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"62'9","reported_seq":200,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.047783+0000","last_change":"2024-02-10T08:24:30.902189+0000","last_active":"2024-02-10T08:25:05.047783+0000","last_peered":"2024-02-10T08:25:05.047783+0000","last_clean":"2024-02-10T08:25:05.047783+0000","last_became_active":"2024-02-10T08:20:46.402749+0000","last_became_peered":"2024-02-10T08:20:46.402749+0000","last_unstale":"2024-02-10T08:25:05.047783+0000","last_undegraded":"2024-02-10T08:25:05.047783+0000","last_fullsized":"2024-02-10T08:25:05.047783+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'9","last_scrub_stamp":"2024-02-10T08:24:30.902122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:24:30.902122+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"208'3666","reported_seq":3691,"reported_epoch":208,"state":"active+clean","last_fresh":"2024-02-10T08:25:07.477828+0000","last_change":"2024-02-10T08:24:21.602014+0000","last_active":"2024-02-10T08:25:07.477828+0000","last_peered":"2024-02-10T08:25:07.477828+0000","last_clean":"2024-02-10T08:25:07.477828+0000","last_became_active":"2024-02-10T08:24:21.601677+0000","last_became_peered":"2024-02-10T08:24:21.601677+0000","last_unstale":"2024-02-10T08:25:07.477828+0000","last_undegraded":"2024-02-10T08:25:07.477828+0000","last_fullsized":"2024-02-10T08:25:07.477828+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:20.584872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:24:20.584872+0000","last_clean_scrub_stamp":"2024-02-10T08:24:20.584872+0000","log_size":3666,"ondisk_log_size":3666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":240254976,"num_objects":3666,"num_object_clones":0,"num_object_copies":10998,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3666,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3666,"num_write_kb":234624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,2],"acting":[5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":170,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.037771+0000","last_change":"2024-02-10T08:24:37.842446+0000","last_active":"2024-02-10T08:25:05.037771+0000","last_peered":"2024-02-10T08:25:05.037771+0000","last_clean":"2024-02-10T08:25:05.037771+0000","last_became_active":"2024-02-10T08:16:58.891260+0000","last_became_peered":"2024-02-10T08:16:58.891260+0000","last_unstale":"2024-02-10T08:25:05.037771+0000","last_undegraded":"2024-02-10T08:25:05.037771+0000","last_fullsized":"2024-02-10T08:25:05.037771+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:37.842356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:20.392249+0000","last_clean_scrub_stamp":"2024-02-10T08:24:37.842356+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":186,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.047405+0000","last_change":"2024-02-10T08:23:15.074385+0000","last_active":"2024-02-10T08:25:05.047405+0000","last_peered":"2024-02-10T08:25:05.047405+0000","last_clean":"2024-02-10T08:25:05.047405+0000","last_became_active":"2024-02-10T08:23:15.074046+0000","last_became_peered":"2024-02-10T08:23:15.074046+0000","last_unstale":"2024-02-10T08:25:05.047405+0000","last_undegraded":"2024-02-10T08:25:05.047405+0000","last_fullsized":"2024-02-10T08:25:05.047405+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:24.969327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:20:24.969327+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,6],"acting":[2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"62'15","reported_seq":194,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-02-10T08:25:05.037439+0000","last_change":"2024-02-10T08:20:05.314332+0000","last_active":"2024-02-10T08:25:05.037439+0000","last_peered":"2024-02-10T08:25:05.037439+0000","last_clean":"2024-02-10T08:25:05.037439+0000","last_became_active":"2024-02-10T08:16:55.204597+0000","last_became_peered":"2024-02-10T08:16:55.204597+0000","last_unstale":"2024-02-10T08:25:05.037439+0000","last_undegraded":"2024-02-10T08:25:05.037439+0000","last_fullsized":"2024-02-10T08:25:05.037439+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'15","last_scrub_stamp":"2024-02-10T08:20:05.314225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:20:05.314225+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"111'10","reported_seq":307,"reported_epoch":208,"state":"active+clean","last_fresh":"2024-02-10T08:25:06.048704+0000","last_change":"2024-02-10T08:24:31.038188+0000","last_active":"2024-02-10T08:25:06.048704+0000","last_peered":"2024-02-10T08:25:06.048704+0000","last_clean":"2024-02-10T08:25:06.048704+0000","last_became_active":"2024-02-10T08:20:46.399193+0000","last_became_peered":"2024-02-10T08:20:46.399193+0000","last_unstale":"2024-02-10T08:25:06.048704+0000","last_undegraded":"2024-02-10T08:25:06.048704+0000","last_fullsized":"2024-02-10T08:25:06.048704+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'10","last_scrub_stamp":"2024-02-10T08:24:31.038099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:24:31.038099+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":3767402496,"num_objects":57486,"num_object_clones":0,"num_object_copies":172458,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57486,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57486,"num_write_kb":3679104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":11320492032,"data_stored":11320492032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":57486,"ondisk_log_size":57486,"up":48,"acting":48,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":4},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":486,"num_read_kb":481,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":9,"acting":9,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":683,"num_read_kb":440,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":74,"num_bytes_recovered":1898,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":425,"ondisk_log_size":425,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80,"ondisk_log_size":80,"up":96,"acting":96,"num_store_stats":8},{"poolid":6,"num_pg":42,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":126,"acting":126,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":50,"seq":214748364903,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1448784,"kb_used_data":1147464,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":92296368,"statfs":{"total":95995035648,"available":94511480832,"internally_reserved":0,"allocated":1175003136,"data_stored":1174018126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:25:01 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":1.496,"15min":0.82899999999999996},"min":{"1min":0.221,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":2.1909999999999998,"5min":21.175999999999998,"15min":21.175999999999998},"last":2.6379999999999999},{"interface":"front","average":{"1min":0.96799999999999997,"5min":2.5569999999999999,"15min":1.1859999999999999},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":4.7930000000000001,"5min":22.57,"15min":22.57},"last":3.7440000000000002}]},{"osd":1,"last update":"Sat Feb 10 08:25:01 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":1.5760000000000001,"15min":0.86699999999999999},"min":{"1min":0.28499999999999998,"5min":0.214,"15min":0.214},"max":{"1min":1.853,"5min":15.476000000000001,"15min":15.476000000000001},"last":0.28299999999999997},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.855,"15min":0.96399999999999997},"min":{"1min":0.245,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":6.4000000000000004,"5min":12.048,"15min":12.048},"last":1.3120000000000001}]},{"osd":2,"last update":"Sat Feb 10 08:25:01 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":1.7589999999999999,"15min":0.91700000000000004},"min":{"1min":0.26500000000000001,"5min":0.251,"15min":0.251},"max":{"1min":1.9430000000000001,"5min":7.9029999999999996,"15min":7.9029999999999996},"last":8.3940000000000001},{"interface":"front","average":{"1min":0.66100000000000003,"5min":1.8540000000000001,"15min":0.97299999999999998},"min":{"1min":0.29599999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":2.6309999999999998,"5min":12.797000000000001,"15min":12.797000000000001},"last":0.437}]},{"osd":3,"last update":"Sat Feb 10 08:25:01 2024","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.8580000000000001,"15min":0.96799999999999997},"min":{"1min":0.318,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":6.7720000000000002,"5min":18.515000000000001,"15min":18.515000000000001},"last":1.5680000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":2.0219999999999998,"15min":1.0249999999999999},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.343,"5min":9.9969999999999999,"15min":9.9969999999999999},"last":0.33300000000000002}]},{"osd":4,"last update":"Sat Feb 10 08:24:48 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.747,"15min":0.51300000000000001},"min":{"1min":0.28799999999999998,"5min":0.216,"15min":0.216},"max":{"1min":1.1879999999999999,"5min":7.8710000000000004,"15min":7.8710000000000004},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.58399999999999996,"15min":0.47599999999999998},"min":{"1min":0.34300000000000003,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.79700000000000004,"5min":6.1390000000000002,"15min":6.1390000000000002},"last":0.313}]},{"osd":5,"last update":"Sat Feb 10 08:25:01 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.58199999999999996,"15min":0.47799999999999998},"min":{"1min":0.31,"5min":0.218,"15min":0.218},"max":{"1min":1.486,"5min":5.4829999999999997,"15min":5.4829999999999997},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.75800000000000001,"15min":0.56299999999999994},"min":{"1min":0.29499999999999998,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":5.2270000000000003,"5min":5.2270000000000003,"15min":5.2270000000000003},"last":0.52000000000000002}]},{"osd":6,"last update":"Sat Feb 10 08:25:01 2024","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.64200000000000002,"15min":0.51900000000000002},"min":{"1min":0.307,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":4.1470000000000002,"5min":4.8879999999999999,"15min":4.8879999999999999},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.69499999999999995,"15min":0.55100000000000005},"min":{"1min":0.314,"5min":0.224,"15min":0.224},"max":{"1min":1.302,"5min":4.5750000000000002,"15min":4.5750000000000002},"last":0.45900000000000002}]}]},{"osd":6,"up_from":43,"seq":184683593836,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1447188,"kb_used_data":1141772,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":92297964,"statfs":{"total":95995035648,"available":94513115136,"internally_reserved":0,"allocated":1169174528,"data_stored":1168185850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:24:32 2024","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":2.738,"15min":1.2709999999999999},"min":{"1min":0.22700000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":3.4620000000000002,"5min":30.509,"15min":30.509},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.45,"5min":2.407,"15min":1.1699999999999999},"min":{"1min":0.35599999999999998,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":6.5419999999999998,"5min":36.090000000000003,"15min":36.090000000000003},"last":4.415}]},{"osd":1,"last update":"Sat Feb 10 08:24:32 2024","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.641,"15min":0.91400000000000003},"min":{"1min":0.374,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":6.3220000000000001,"5min":12.938000000000001,"15min":12.938000000000001},"last":1.0389999999999999},{"interface":"front","average":{"1min":1.242,"5min":1.7689999999999999,"15min":0.96299999999999997},"min":{"1min":0.26200000000000001,"5min":0.247,"15min":0.247},"max":{"1min":4.569,"5min":10.256,"15min":10.256},"last":0.27400000000000002}]},{"osd":2,"last update":"Sat Feb 10 08:24:32 2024","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":2.2719999999999998,"15min":1.141},"min":{"1min":0.32100000000000001,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":4.1289999999999996,"5min":35.072000000000003,"15min":35.072000000000003},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.79700000000000004,"5min":2.198,"15min":1.1180000000000001},"min":{"1min":0.40200000000000002,"5min":0.247,"15min":0.247},"max":{"1min":4.1390000000000002,"5min":35.103000000000002,"15min":35.103000000000002},"last":4.3760000000000003}]},{"osd":3,"last update":"Sat Feb 10 08:24:32 2024","interfaces":[{"interface":"back","average":{"1min":1.5469999999999999,"5min":1.7130000000000001,"15min":0.94799999999999995},"min":{"1min":0.36699999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":11.448,"5min":15.212999999999999,"15min":15.212999999999999},"last":1.1060000000000001},{"interface":"front","average":{"1min":1.395,"5min":2.0129999999999999,"15min":1.0429999999999999},"min":{"1min":0.34699999999999998,"5min":0.308,"15min":0.308},"max":{"1min":5.9059999999999997,"5min":17.797000000000001,"15min":17.797000000000001},"last":0.35399999999999998}]},{"osd":4,"last update":"Sat Feb 10 08:24:54 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.63100000000000001,"15min":0.54000000000000004},"min":{"1min":0.23899999999999999,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":1.264,"5min":5.468,"15min":5.468},"last":4.4690000000000003},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.59099999999999997,"15min":0.58599999999999997},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":1.556,"5min":3.4220000000000002,"15min":3.4220000000000002},"last":10.348000000000001}]},{"osd":5,"last update":"Sat Feb 10 08:24:32 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.55100000000000005,"15min":0.49099999999999999},"min":{"1min":0.30299999999999999,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.91400000000000003,"5min":5.4989999999999997,"15min":5.4989999999999997},"last":4.4429999999999996},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.58599999999999997,"15min":0.50700000000000001},"min":{"1min":0.317,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":1.2110000000000001,"5min":4.3570000000000002,"15min":4.3570000000000002},"last":3.7250000000000001}]},{"osd":7,"last update":"Sat Feb 10 08:24:58 2024","interfaces":[{"interface":"back","average":{"1min":10.291,"5min":2.5179999999999998,"15min":1.1910000000000001},"min":{"1min":0.33000000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":194.88900000000001,"5min":194.88900000000001,"15min":194.88900000000001},"last":5.3390000000000004},{"interface":"front","average":{"1min":10.355,"5min":2.5830000000000002,"15min":1.2410000000000001},"min":{"1min":0.38800000000000001,"5min":0.28799999999999998,"15min":0.26400000000000001},"max":{"1min":194.74100000000001,"5min":194.74100000000001,"15min":194.74100000000001},"last":1.085}]}]},{"osd":1,"up_from":13,"seq":55834574979,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1939420,"kb_used_data":1625812,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":91805732,"statfs":{"total":95995035648,"available":94009069568,"internally_reserved":0,"allocated":1664831488,"data_stored":1663834074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:24:34 2024","interfaces":[{"interface":"back","average":{"1min":2.0419999999999998,"5min":3.4289999999999998,"15min":1.367},"min":{"1min":0.20799999999999999,"5min":0.185,"15min":0.185},"max":{"1min":13.316000000000001,"5min":29.763999999999999,"15min":29.763999999999999},"last":0.33800000000000002},{"interface":"front","average":{"1min":2.3290000000000002,"5min":3.6299999999999999,"15min":1.4419999999999999},"min":{"1min":0.246,"5min":0.185,"15min":0.185},"max":{"1min":21.405000000000001,"5min":29.637,"15min":29.637},"last":0.79500000000000004}]},{"osd":2,"last update":"Sat Feb 10 08:25:02 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":3.5259999999999998,"15min":1.462},"min":{"1min":0.22700000000000001,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":1.6759999999999999,"5min":31.420999999999999,"15min":31.420999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":1.3999999999999999,"5min":3.9249999999999998,"15min":1.591},"min":{"1min":0.26200000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":5.2969999999999997,"5min":31.484999999999999,"15min":31.484999999999999},"last":4.774}]},{"osd":3,"last update":"Sat Feb 10 08:24:25 2024","interfaces":[{"interface":"back","average":{"1min":2.6930000000000001,"5min":3.629,"15min":1.512},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":19.096,"5min":28.082000000000001,"15min":28.082000000000001},"last":4.6269999999999998},{"interface":"front","average":{"1min":2.46,"5min":3.1560000000000001,"15min":1.3400000000000001},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.20300000000000001},"max":{"1min":21.103999999999999,"5min":29.722000000000001,"15min":29.722000000000001},"last":0.28399999999999997}]},{"osd":4,"last update":"Sat Feb 10 08:24:53 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":2.2090000000000001,"15min":2.2890000000000001},"min":{"1min":0.34200000000000003,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":2.7690000000000001,"5min":14.086,"15min":14.086},"last":0.82999999999999996},{"interface":"front","average":{"1min":1.054,"5min":2.7210000000000001,"15min":2.6589999999999998},"min":{"1min":0.377,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":5.4939999999999998,"5min":31.515000000000001,"15min":31.515000000000001},"last":4.7320000000000002}]},{"osd":5,"last update":"Sat Feb 10 08:24:09 2024","interfaces":[{"interface":"back","average":{"1min":2.6779999999999999,"5min":2.2589999999999999,"15min":1.1359999999999999},"min":{"1min":0.44700000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":14.061999999999999,"5min":14.061999999999999,"15min":14.061999999999999},"last":0.85499999999999998},{"interface":"front","average":{"1min":3.6880000000000002,"5min":2.4740000000000002,"15min":1.232},"min":{"1min":0.39700000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":31.542000000000002,"5min":31.542000000000002,"15min":31.542000000000002},"last":4.694}]},{"osd":6,"last update":"Sat Feb 10 08:24:34 2024","interfaces":[{"interface":"back","average":{"1min":3.2850000000000001,"5min":2.4369999999999998,"15min":1.21},"min":{"1min":0.378,"5min":0.311,"15min":0.311},"max":{"1min":31.27,"5min":31.27,"15min":31.27},"last":4.8040000000000003},{"interface":"front","average":{"1min":1.7270000000000001,"5min":1.8640000000000001,"15min":1.0329999999999999},"min":{"1min":0.41099999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":10.238,"5min":10.433,"15min":10.433},"last":0.39900000000000002}]},{"osd":7,"last update":"Sat Feb 10 08:25:02 2024","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":2.6720000000000002,"15min":1.2689999999999999},"min":{"1min":0.38300000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":4.1790000000000003,"5min":31.344999999999999,"15min":31.344999999999999},"last":4.8330000000000002},{"interface":"front","average":{"1min":0.89500000000000002,"5min":2.008,"15min":1.0609999999999999},"min":{"1min":0.32600000000000001,"5min":0.312,"15min":0.312},"max":{"1min":3.431,"5min":14.872,"15min":14.872},"last":0.372}]}]},{"osd":0,"up_from":8,"seq":34359738504,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1238648,"kb_used_data":929136,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":92506504,"statfs":{"total":95995035648,"available":94726660096,"internally_reserved":0,"allocated":951435264,"data_stored":950474270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 10 08:24:41 2024","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":4.3570000000000002,"15min":1.6839999999999999},"min":{"1min":0.20899999999999999,"5min":0.14399999999999999,"15min":0.14399999999999999},"max":{"1min":4.5389999999999997,"5min":102.48099999999999,"15min":102.48099999999999},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.72099999999999997,"5min":4.0049999999999999,"15min":1.569},"min":{"1min":0.26200000000000001,"5min":0.193,"15min":0.193},"max":{"1min":3.077,"5min":103.38800000000001,"15min":103.38800000000001},"last":0.34000000000000002}]},{"osd":2,"last update":"Sat Feb 10 08:24:58 2024","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":4.7450000000000001,"15min":1.843},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":6.96,"5min":102.462,"15min":102.462},"last":1.7490000000000001},{"interface":"front","average":{"1min":0.83399999999999996,"5min":4.3840000000000003,"15min":1.728},"min":{"1min":0.27200000000000002,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":5.2169999999999996,"5min":102.66500000000001,"15min":102.66500000000001},"last":2.3479999999999999}]},{"osd":3,"last update":"Sat Feb 10 08:24:26 2024","interfaces":[{"interface":"back","average":{"1min":1.9390000000000001,"5min":3.5409999999999999,"15min":1.47},"min":{"1min":0.28599999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":11.936999999999999,"5min":16.495000000000001,"15min":16.495000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":6.6399999999999997,"5min":4.5620000000000003,"15min":1.8149999999999999},"min":{"1min":0.309,"5min":0.29799999999999999,"15min":0.246},"max":{"1min":102.64400000000001,"5min":102.64400000000001,"15min":102.64400000000001},"last":1.698}]},{"osd":4,"last update":"Sat Feb 10 08:24:51 2024","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":3.9289999999999998,"15min":3.859},"min":{"1min":0.39600000000000002,"5min":0.253,"15min":0.253},"max":{"1min":4.1230000000000002,"5min":102.742,"15min":102.742},"last":1.8029999999999999},{"interface":"front","average":{"1min":0.873,"5min":1.992,"15min":1.9870000000000001},"min":{"1min":0.38200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":4.3040000000000003,"5min":16.352,"15min":16.352},"last":1.631}]},{"osd":5,"last update":"Sat Feb 10 08:24:18 2024","interfaces":[{"interface":"back","average":{"1min":6.7400000000000002,"5min":3.1789999999999998,"15min":1.4530000000000001},"min":{"1min":0.373,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":102.53100000000001,"5min":102.53100000000001,"15min":102.53100000000001},"last":2.4409999999999998},{"interface":"front","average":{"1min":2.4140000000000001,"5min":2.073,"15min":1.077},"min":{"1min":0.34599999999999997,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":10.103,"5min":16.463999999999999,"15min":16.463999999999999},"last":0.54900000000000004}]},{"osd":6,"last update":"Sat Feb 10 08:24:41 2024","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":3.351,"15min":1.5169999999999999},"min":{"1min":0.40000000000000002,"5min":0.317,"15min":0.317},"max":{"1min":10.896000000000001,"5min":102.583,"15min":102.583},"last":2.4159999999999999},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.9530000000000001,"15min":1.079},"min":{"1min":0.45200000000000001,"5min":0.308,"15min":0.308},"max":{"1min":5.0609999999999999,"5min":16.391999999999999,"15min":16.391999999999999},"last":3.9289999999999998}]},{"osd":7,"last update":"Sat Feb 10 08:24:58 2024","interfaces":[{"interface":"back","average":{"1min":12.037000000000001,"5min":5.6689999999999996,"15min":2.2890000000000001},"min":{"1min":0.40100000000000002,"5min":0.35299999999999998,"15min":0.34100000000000003},"max":{"1min":255.53200000000001,"5min":255.53200000000001,"15min":255.53200000000001},"last":2.391},{"interface":"front","average":{"1min":11.993,"5min":4.2699999999999996,"15min":1.823},"min":{"1min":0.443,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":254.88800000000001,"5min":254.88800000000001,"15min":254.88800000000001},"last":0.67100000000000004}]}]},{"osd":2,"up_from":18,"seq":77309411455,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1905092,"kb_used_data":1603772,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":91840060,"statfs":{"total":95995035648,"available":94044221440,"internally_reserved":0,"allocated":1642262528,"data_stored":1641289397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:25:04 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":3.4470000000000001,"15min":1.3819999999999999},"min":{"1min":0.184,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":1.6890000000000001,"5min":24.859999999999999,"15min":24.859999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":4.194,"15min":1.643},"min":{"1min":0.21199999999999999,"5min":0.193,"15min":0.193},"max":{"1min":2.4119999999999999,"5min":28.295999999999999,"15min":28.295999999999999},"last":0.84599999999999997}]},{"osd":1,"last update":"Sat Feb 10 08:25:04 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":2.4700000000000002,"15min":1.0740000000000001},"min":{"1min":0.20999999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":2.6549999999999998,"5min":15.644,"15min":15.644},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.754,"5min":2.278,"15min":1.0169999999999999},"min":{"1min":0.25,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":2.7839999999999998,"5min":16.968,"15min":16.968},"last":2.7839999999999998}]},{"osd":3,"last update":"Sat Feb 10 08:24:24 2024","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":2.944,"15min":1.284},"min":{"1min":0.28699999999999998,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":4.75,"5min":24.946000000000002,"15min":24.946000000000002},"last":0.50600000000000001},{"interface":"front","average":{"1min":2.3969999999999998,"5min":3.5760000000000001,"15min":1.488},"min":{"1min":0.34799999999999998,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":13.694000000000001,"5min":24.905000000000001,"15min":24.905000000000001},"last":2.7469999999999999}]},{"osd":4,"last update":"Sat Feb 10 08:24:53 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":2.149,"15min":2.3410000000000002},"min":{"1min":0.39900000000000002,"5min":0.307,"15min":0.307},"max":{"1min":2.7160000000000002,"5min":13.260999999999999,"15min":13.260999999999999},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.73099999999999998,"5min":1.5169999999999999,"15min":1.375},"min":{"1min":0.42299999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.6160000000000001,"5min":15.696,"15min":15.696},"last":0.46100000000000002}]},{"osd":5,"last update":"Sat Feb 10 08:24:08 2024","interfaces":[{"interface":"back","average":{"1min":2.238,"5min":2.157,"15min":1.0980000000000001},"min":{"1min":0.29999999999999999,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":8.4499999999999993,"5min":13.939,"15min":13.939},"last":1.446},{"interface":"front","average":{"1min":1.927,"5min":1.921,"15min":1.0189999999999999},"min":{"1min":0.41599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":6.6879999999999997,"5min":13.317,"15min":13.317},"last":0.48999999999999999}]},{"osd":6,"last update":"Sat Feb 10 08:24:43 2024","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":2.093,"15min":1.0880000000000001},"min":{"1min":0.39800000000000002,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":4.4199999999999999,"5min":13.893000000000001,"15min":13.893000000000001},"last":1.841},{"interface":"front","average":{"1min":1.5980000000000001,"5min":2.0070000000000001,"15min":1.0720000000000001},"min":{"1min":0.36899999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":7.8879999999999999,"5min":13.292,"15min":13.292},"last":0.439}]},{"osd":7,"last update":"Sat Feb 10 08:25:04 2024","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":2.0369999999999999,"15min":1.087},"min":{"1min":0.45500000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":2.492,"5min":13.231999999999999,"15min":13.231999999999999},"last":1.4299999999999999},{"interface":"front","average":{"1min":0.76000000000000001,"5min":1.6120000000000001,"15min":0.94099999999999995},"min":{"1min":0.38800000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.6619999999999999,"5min":15.714,"15min":15.714},"last":0.51200000000000001}]}]},{"osd":3,"up_from":25,"seq":107374182522,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1704288,"kb_used_data":1394776,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":92040864,"statfs":{"total":95995035648,"available":94249844736,"internally_reserved":0,"allocated":1428250624,"data_stored":1427312760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:24:22 2024","interfaces":[{"interface":"back","average":{"1min":2.194,"5min":2.9180000000000001,"15min":1.222},"min":{"1min":0.23999999999999999,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":14.167,"5min":14.167,"15min":14.167},"last":3.0720000000000001},{"interface":"front","average":{"1min":2.4079999999999999,"5min":2.5390000000000001,"15min":1.123},"min":{"1min":0.25900000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":16.721,"5min":26.643000000000001,"15min":26.643000000000001},"last":2.617}]},{"osd":1,"last update":"Sat Feb 10 08:24:22 2024","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":2.4670000000000001,"15min":1.111},"min":{"1min":0.255,"5min":0.218,"15min":0.218},"max":{"1min":6.2210000000000001,"5min":12.782999999999999,"15min":12.782999999999999},"last":3.0009999999999999},{"interface":"front","average":{"1min":3.2490000000000001,"5min":2.661,"15min":1.1870000000000001},"min":{"1min":0.28000000000000003,"5min":0.191,"15min":0.191},"max":{"1min":21.373999999999999,"5min":21.373999999999999,"15min":21.373999999999999},"last":3.3079999999999998}]},{"osd":2,"last update":"Sat Feb 10 08:24:22 2024","interfaces":[{"interface":"back","average":{"1min":2.9870000000000001,"5min":2.569,"15min":1.155},"min":{"1min":0.26900000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":21.434000000000001,"5min":21.434000000000001,"15min":21.434000000000001},"last":1.6919999999999999},{"interface":"front","average":{"1min":1.9299999999999999,"5min":2.4860000000000002,"15min":1.1279999999999999},"min":{"1min":0.309,"5min":0.28699999999999998,"15min":0.27200000000000002},"max":{"1min":16.757999999999999,"5min":18.061,"15min":18.061},"last":2.5510000000000002}]},{"osd":4,"last update":"Sat Feb 10 08:24:49 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":1.591,"15min":1.6930000000000001},"min":{"1min":0.28899999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":2.7440000000000002,"5min":12.272,"15min":12.272},"last":2.5880000000000001},{"interface":"front","average":{"1min":0.82399999999999995,"5min":2.2410000000000001,"15min":2.3690000000000002},"min":{"1min":0.371,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":4.1459999999999999,"5min":12.391999999999999,"15min":12.391999999999999},"last":3.1030000000000002}]},{"osd":5,"last update":"Sat Feb 10 08:24:16 2024","interfaces":[{"interface":"back","average":{"1min":1.669,"5min":1.254,"15min":0.81399999999999995},"min":{"1min":0.377,"5min":0.249,"15min":0.249},"max":{"1min":8.1080000000000005,"5min":12.388999999999999,"15min":12.388999999999999},"last":5.3490000000000002},{"interface":"front","average":{"1min":2.2599999999999998,"5min":2.0230000000000001,"15min":1.0720000000000001},"min":{"1min":0.38800000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":10.217000000000001,"5min":12.438000000000001,"15min":12.438000000000001},"last":3.1349999999999998}]},{"osd":6,"last update":"Sat Feb 10 08:24:36 2024","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":2.0259999999999998,"15min":1.0549999999999999},"min":{"1min":0.41799999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":5.117,"5min":12.477,"15min":12.477},"last":3.0350000000000001},{"interface":"front","average":{"1min":1.236,"5min":1.325,"15min":0.83299999999999996},"min":{"1min":0.36099999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":6.7080000000000002,"5min":12.324999999999999,"15min":12.324999999999999},"last":2.52}]},{"osd":7,"last update":"Sat Feb 10 08:25:00 2024","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.4410000000000001,"15min":0.86699999999999999},"min":{"1min":0.41399999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":7.1020000000000003,"5min":12.358000000000001,"15min":12.358000000000001},"last":2.6429999999999998},{"interface":"front","average":{"1min":1.361,"5min":2.137,"15min":1.0960000000000001},"min":{"1min":0.42199999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":7.7309999999999999,"5min":15.702,"15min":15.702},"last":1.7290000000000001}]}]},{"osd":4,"up_from":110,"seq":472446402613,"num_pgs":65,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1367152,"kb_used_data":1069288,"kb_used_omap":0,"kb_used_meta":297855,"kb_avail":92378000,"statfs":{"total":95995035648,"available":94595072000,"internally_reserved":0,"allocated":1094950912,"data_stored":1093983702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":972,"internal_metadata":305003572},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:24:57 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":1.415,"15min":1.1890000000000001},"min":{"1min":0.29199999999999998,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":2.823,"5min":11.257999999999999,"15min":11.257999999999999},"last":1.147},{"interface":"front","average":{"1min":0.72399999999999998,"5min":2.7000000000000002,"15min":3.0979999999999999},"min":{"1min":0.38,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":2.6699999999999999,"5min":16.524000000000001,"15min":16.524000000000001},"last":0.46100000000000002}]},{"osd":1,"last update":"Sat Feb 10 08:24:57 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":1.7450000000000001,"15min":2.101},"min":{"1min":0.36499999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":1.607,"5min":7.8230000000000004,"15min":7.8230000000000004},"last":2.4100000000000001},{"interface":"front","average":{"1min":0.56200000000000006,"5min":1.6259999999999999,"15min":1.9510000000000001},"min":{"1min":0.374,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.93600000000000005,"5min":7.8140000000000001,"15min":7.8140000000000001},"last":0.40699999999999997}]},{"osd":2,"last update":"Sat Feb 10 08:24:57 2024","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":1.8640000000000001,"15min":2.0089999999999999},"min":{"1min":0.377,"5min":0.25,"15min":0.25},"max":{"1min":3.5939999999999999,"5min":8.9930000000000003,"15min":8.9930000000000003},"last":0.499},{"interface":"front","average":{"1min":0.53400000000000003,"5min":1.847,"15min":2.081},"min":{"1min":0.33400000000000002,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.95499999999999996,"5min":8.9309999999999992,"15min":8.9309999999999992},"last":2.4430000000000001}]},{"osd":3,"last update":"Sat Feb 10 08:24:57 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":2.0249999999999999,"15min":2.1899999999999999},"min":{"1min":0.28100000000000003,"5min":0.254,"15min":0.254},"max":{"1min":2.7570000000000001,"5min":12.565,"15min":12.565},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.66800000000000004,"5min":1.6819999999999999,"15min":1.754},"min":{"1min":0.38800000000000001,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.6419999999999999,"5min":11.648,"15min":11.648},"last":4.1699999999999999}]},{"osd":5,"last update":"Sat Feb 10 08:24:57 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55300000000000005,"15min":0.56699999999999995},"min":{"1min":0.309,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":1.948,"5min":3.3839999999999999,"15min":3.3839999999999999},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.754,"15min":0.76400000000000001},"min":{"1min":0.316,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.7330000000000001,"5min":5.1980000000000004,"15min":5.1980000000000004},"last":2.6899999999999999}]},{"osd":6,"last update":"Sat Feb 10 08:24:57 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.64000000000000001,"15min":0.65200000000000002},"min":{"1min":0.315,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.7070000000000001,"5min":3.9340000000000002,"15min":3.9340000000000002},"last":2.496},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.81599999999999995,"15min":0.81399999999999995},"min":{"1min":0.38700000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.746,"5min":4.8010000000000002,"15min":4.8010000000000002},"last":2.375}]},{"osd":7,"last update":"Sat Feb 10 08:24:57 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.77500000000000002,"15min":0.83299999999999996},"min":{"1min":0.34200000000000003,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.77400000000000002,"5min":3.6179999999999999,"15min":3.6179999999999999},"last":2.4710000000000001},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.58299999999999996,"15min":0.52900000000000003},"min":{"1min":0.35599999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.81599999999999995,"5min":2.9750000000000001,"15min":2.9750000000000001},"last":0.51000000000000001}]}]},{"osd":5,"up_from":37,"seq":158913790065,"num_pgs":65,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2342656,"kb_used_data":2045432,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":91402496,"statfs":{"total":95995035648,"available":93596155904,"internally_reserved":0,"allocated":2094522368,"data_stored":2093552875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:24:07 2024","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":2.2240000000000002,"15min":1.1279999999999999},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":4.8170000000000002,"5min":22.914000000000001,"15min":22.914000000000001},"last":1.6040000000000001},{"interface":"front","average":{"1min":1.286,"5min":1.835,"15min":0.95699999999999996},"min":{"1min":0.23400000000000001,"5min":0.219,"15min":0.219},"max":{"1min":6.1669999999999998,"5min":23.161000000000001,"15min":23.161000000000001},"last":3.0059999999999998}]},{"osd":1,"last update":"Sat Feb 10 08:24:07 2024","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.2410000000000001,"15min":0.78400000000000003},"min":{"1min":0.223,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":5.4720000000000004,"5min":8.1289999999999996,"15min":8.1289999999999996},"last":1.8400000000000001},{"interface":"front","average":{"1min":1.365,"5min":1.4330000000000001,"15min":0.83899999999999997},"min":{"1min":0.27900000000000003,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":6.9660000000000002,"5min":6.9660000000000002,"15min":6.9660000000000002},"last":2.7759999999999998}]},{"osd":2,"last update":"Sat Feb 10 08:24:07 2024","interfaces":[{"interface":"back","average":{"1min":1.7669999999999999,"5min":2.1539999999999999,"15min":1.095},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":8.657,"5min":9.5709999999999997,"15min":9.5709999999999997},"last":0.35099999999999998},{"interface":"front","average":{"1min":1.149,"5min":1.579,"15min":0.91600000000000004},"min":{"1min":0.31900000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":5.3390000000000004,"5min":9.2810000000000006,"15min":9.2810000000000006},"last":1.734}]},{"osd":3,"last update":"Sat Feb 10 08:24:07 2024","interfaces":[{"interface":"back","average":{"1min":1.484,"5min":1.788,"15min":0.98199999999999998},"min":{"1min":0.34399999999999997,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":6.117,"5min":24.198,"15min":24.198},"last":0.373},{"interface":"front","average":{"1min":1.119,"5min":2.024,"15min":1.052},"min":{"1min":0.318,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":9.1159999999999997,"5min":22.701000000000001,"15min":22.701000000000001},"last":1.631}]},{"osd":4,"last update":"Sat Feb 10 08:24:49 2024","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.58099999999999996,"15min":0.57299999999999995},"min":{"1min":0.26900000000000002,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.68400000000000005,"5min":5.6509999999999998,"15min":5.6509999999999998},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.54000000000000004,"15min":0.49099999999999999},"min":{"1min":0.30499999999999999,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.69399999999999995,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.659}]},{"osd":6,"last update":"Sat Feb 10 08:24:36 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.57499999999999996,"15min":0.45300000000000001},"min":{"1min":0.254,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":1.5049999999999999,"5min":3.8690000000000002,"15min":3.8690000000000002},"last":3.0419999999999998},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.65500000000000003,"15min":0.51300000000000001},"min":{"1min":0.34699999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":1.923,"5min":5.0529999999999999,"15min":5.0529999999999999},"last":2.7050000000000001}]},{"osd":7,"last update":"Sat Feb 10 08:25:00 2024","interfaces":[{"interface":"back","average":{"1min":19.199000000000002,"5min":4.3170000000000002,"15min":1.734},"min":{"1min":0.32200000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":371.87400000000002,"5min":371.87400000000002,"15min":371.87400000000002},"last":2.669},{"interface":"front","average":{"1min":19.329999999999998,"5min":4.5129999999999999,"15min":1.794},"min":{"1min":0.28699999999999998,"5min":0.251,"15min":0.251},"max":{"1min":372.63099999999997,"5min":372.63099999999997,"15min":372.63099999999997},"last":1.681}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":2118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":1832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":952696832,"data_stored":952696832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1665204224,"data_stored":1665204224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1669464064,"data_stored":1669464064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1434386432,"data_stored":1434386432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1108475904,"data_stored":1108475904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":2135687168,"data_stored":2135687168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1177616384,"data_stored":1177616384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1176961024,"data_stored":1176961024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-10T08:25:11.636 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd pool set default.rgw.meta pgp_num 42 2024-02-10T08:25:11.703 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-02-10T08:25:11.703 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:25:11.723 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:25:11.776 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:11.987 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:25:11.990 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:11.990 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:25:12.091 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:25:12.136 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:12.176 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:25:12.187 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:25:12.191 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:12.192 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:25:12.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:10.708213+0000 mgr.y (mgr.14505) 322 : cluster [DBG] pgmap v385: 158 pgs: 158 active+clean; 3.6 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 852 B/s rd, 70 MiB/s wr, 1.12k op/s 2024-02-10T08:25:12.293 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:25:12.339 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:12.343 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 35 16 63781 63765 113.819 75.5625 0.0176743 0.00878076 2024-02-10T08:25:12.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:10.708213+0000 mgr.y (mgr.14505) 322 : cluster [DBG] pgmap v385: 158 pgs: 158 active+clean; 3.6 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 852 B/s rd, 70 MiB/s wr, 1.12k op/s 2024-02-10T08:25:12.407 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:10.708213+0000 mgr.y (mgr.14505) 322 : cluster [DBG] pgmap v385: 158 pgs: 158 active+clean; 3.6 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 852 B/s rd, 70 MiB/s wr, 1.12k op/s 2024-02-10T08:25:12.481 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:25:12.484 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:12.484 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:25:12.499 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.5 dump_historic_ops 2024-02-10T08:25:12.585 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:25:12.645 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:12.758 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:25:12.764 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:12.765 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:25:12.866 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:25:12.935 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:12.955 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:25:12.986 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:25:12.997 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:12.998 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:25:13.098 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:25:13.143 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:25:13.143 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:25:13.162 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:13.183 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:25:13.222 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:25:13.252 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:25:13.280 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:25:13.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:25:13.057536+0000 mon.c (mon.2) 41 : audit [DBG] from='client.? 172.21.15.18:0/3133520716' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:25:13.319 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:25:13.343 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 36 16 64920 64904 112.635 71.1875 0.00810452 0.00887292 2024-02-10T08:25:13.352 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:25:13.376 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-10T08:25:13.376 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-10T08:25:13.376 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-10T08:25:13.376 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-10T08:25:13.376 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-10T08:25:13.376 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-10T08:25:13.376 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-10T08:25:13.376 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-10T08:25:13.403 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:25:13.057536+0000 mon.c (mon.2) 41 : audit [DBG] from='client.? 172.21.15.18:0/3133520716' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:25:13.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:25:13.057536+0000 mon.c (mon.2) 41 : audit [DBG] from='client.? 172.21.15.18:0/3133520716' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:25:13.538 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:25:13.543 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:13.544 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:25:13.645 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:25:13.699 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:13.910 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:25:13.919 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:13.920 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:25:14.021 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:25:14.067 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:14.142 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:12.708964+0000 mgr.y (mgr.14505) 323 : cluster [DBG] pgmap v386: 158 pgs: 158 active+clean; 3.8 GiB data, 14 GiB used, 702 GiB / 715 GiB avail; 1.3 KiB/s rd, 90 MiB/s wr, 1.44k op/s 2024-02-10T08:25:14.147 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:12.708964+0000 mgr.y (mgr.14505) 323 : cluster [DBG] pgmap v386: 158 pgs: 158 active+clean; 3.8 GiB data, 14 GiB used, 702 GiB / 715 GiB avail; 1.3 KiB/s rd, 90 MiB/s wr, 1.44k op/s 2024-02-10T08:25:14.237 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:25:14.242 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:14.243 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:25:14.343 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 37 16 66191 66175 111.738 79.4375 0.0112772 0.00894499 2024-02-10T08:25:14.344 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:25:14.392 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:14.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:12.708964+0000 mgr.y (mgr.14505) 323 : cluster [DBG] pgmap v386: 158 pgs: 158 active+clean; 3.8 GiB data, 14 GiB used, 702 GiB / 715 GiB avail; 1.3 KiB/s rd, 90 MiB/s wr, 1.44k op/s 2024-02-10T08:25:15.343 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 38 16 67408 67392 110.799 76.0625 0.00942505 0.00902059 2024-02-10T08:25:15.430 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-02-10T08:25:15.431 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-02-10T08:25:15.431 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-02-10T08:25:15.431 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-02-10T08:25:15.431 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.431 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.24299.0:673 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 94587203964288 gen 1] snapc 0=[] ondisk+write+known_if_redirected e88)", 2024-02-10T08:25:15.431 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:19:30.798285+0000", 2024-02-10T08:25:15.431 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 344.62743314900001, 2024-02-10T08:25:15.431 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.018598715, 2024-02-10T08:25:15.431 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:25:15.431 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-02-10T08:25:15.431 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:25:15.431 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.24299", 2024-02-10T08:25:15.431 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/871408063", 2024-02-10T08:25:15.432 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 673 2024-02-10T08:25:15.432 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.432 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:25:15.432 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.432 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:25:15.432 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:30.798285+0000", 2024-02-10T08:25:15.432 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:25:15.432 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.432 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.432 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:25:15.432 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:30.798285+0000", 2024-02-10T08:25:15.432 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-02-10T08:25:15.432 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.432 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.433 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:25:15.433 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:30.798283+0000", 2024-02-10T08:25:15.433 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2915999999999999e-05 2024-02-10T08:25:15.433 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.433 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.433 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:25:15.433 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:30.798306+0000", 2024-02-10T08:25:15.433 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4932e-05 2024-02-10T08:25:15.433 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.433 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.433 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:25:15.433 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:30.798321+0000", 2024-02-10T08:25:15.433 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7820000000000005e-06 2024-02-10T08:25:15.433 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.434 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.434 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:25:15.434 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:30.798331+0000", 2024-02-10T08:25:15.434 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8304e-05 2024-02-10T08:25:15.434 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.434 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.434 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:25:15.434 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:30.798419+0000", 2024-02-10T08:25:15.434 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3329999999999997e-06 2024-02-10T08:25:15.434 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.434 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.434 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-02-10T08:25:15.434 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:30.798427+0000", 2024-02-10T08:25:15.435 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027020210000000002 2024-02-10T08:25:15.435 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.435 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.435 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:25:15.435 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:30.801129+0000", 2024-02-10T08:25:15.435 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0142999999999999e-05 2024-02-10T08:25:15.435 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.435 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.435 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:25:15.435 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:30.801140+0000", 2024-02-10T08:25:15.435 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0128087210000001 2024-02-10T08:25:15.435 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.435 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.435 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:25:15.436 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:31.813948+0000", 2024-02-10T08:25:15.436 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000130968 2024-02-10T08:25:15.436 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.436 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.436 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:25:15.436 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:31.814079+0000", 2024-02-10T08:25:15.436 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028041450000000001 2024-02-10T08:25:15.436 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.436 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.436 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:25:15.436 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:31.816883+0000", 2024-02-10T08:25:15.436 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.018598715 2024-02-10T08:25:15.437 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:15.437 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:25:15.437 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:15.437 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.437 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.437 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.24299.0:682 5.e 5:7759931f:::notify.3:head [watch ping cookie 94587203964288 gen 1] snapc 0=[] ondisk+write+known_if_redirected e88)", 2024-02-10T08:25:15.437 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:19:30.927526+0000", 2024-02-10T08:25:15.437 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 344.49819150399998, 2024-02-10T08:25:15.437 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.88693027000000002, 2024-02-10T08:25:15.437 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:25:15.437 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-02-10T08:25:15.437 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:25:15.437 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.24299", 2024-02-10T08:25:15.437 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/871408063", 2024-02-10T08:25:15.438 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 682 2024-02-10T08:25:15.438 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.438 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:25:15.438 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.438 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:25:15.438 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:30.927526+0000", 2024-02-10T08:25:15.438 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:25:15.438 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.438 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.438 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:25:15.438 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:30.927526+0000", 2024-02-10T08:25:15.438 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-02-10T08:25:15.438 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.438 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.439 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:25:15.439 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:30.927526+0000", 2024-02-10T08:25:15.439 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4320000000000002e-06 2024-02-10T08:25:15.439 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.439 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.439 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:25:15.439 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:30.927528+0000", 2024-02-10T08:25:15.439 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0260000000000004e-06 2024-02-10T08:25:15.439 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.439 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.439 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:25:15.439 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:30.927534+0000", 2024-02-10T08:25:15.439 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2530000000000004e-06 2024-02-10T08:25:15.440 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.440 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.440 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:25:15.440 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:30.927540+0000", 2024-02-10T08:25:15.440 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013312799999999999 2024-02-10T08:25:15.440 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.440 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.440 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:25:15.440 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:30.927673+0000", 2024-02-10T08:25:15.440 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7070000000000003e-06 2024-02-10T08:25:15.440 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.440 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.440 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:25:15.440 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:30.927679+0000", 2024-02-10T08:25:15.441 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.88660603400000004 2024-02-10T08:25:15.441 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.441 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.441 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:25:15.441 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:31.814285+0000", 2024-02-10T08:25:15.441 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9539e-05 2024-02-10T08:25:15.441 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.441 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.441 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:25:15.441 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:31.814345+0000", 2024-02-10T08:25:15.441 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011155899999999999 2024-02-10T08:25:15.441 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.441 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.441 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:25:15.442 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:31.814457+0000", 2024-02-10T08:25:15.442 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.88693027000000002 2024-02-10T08:25:15.442 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:15.442 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:25:15.442 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:15.442 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.442 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.442 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14784.0:26620 7.0 7:08abb8f4:::benchmark_data_smithi018_80623_object26619:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e96)", 2024-02-10T08:25:15.442 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:20:01.756911+0000", 2024-02-10T08:25:15.442 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 313.66880726800002, 2024-02-10T08:25:15.442 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.055677539999999998, 2024-02-10T08:25:15.442 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:25:15.442 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:25:15.442 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:25:15.442 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14784", 2024-02-10T08:25:15.442 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:25:15.443 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 26620 2024-02-10T08:25:15.443 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.443 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:25:15.443 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.443 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:25:15.443 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:01.756911+0000", 2024-02-10T08:25:15.443 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:25:15.443 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.443 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.443 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:25:15.443 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:01.756911+0000", 2024-02-10T08:25:15.443 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-02-10T08:25:15.443 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.443 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.443 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:25:15.443 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:01.756910+0000", 2024-02-10T08:25:15.444 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7999e-05 2024-02-10T08:25:15.444 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.444 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.444 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:25:15.444 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:01.756948+0000", 2024-02-10T08:25:15.444 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9079999999999998e-06 2024-02-10T08:25:15.444 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.444 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.444 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:25:15.444 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:01.756954+0000", 2024-02-10T08:25:15.444 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5559999999999999e-06 2024-02-10T08:25:15.444 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.444 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.445 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:25:15.445 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:01.756958+0000", 2024-02-10T08:25:15.445 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9966999999999999e-05 2024-02-10T08:25:15.445 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.445 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.445 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:25:15.445 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:01.756998+0000", 2024-02-10T08:25:15.445 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012773 2024-02-10T08:25:15.445 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.445 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.445 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:25:15.445 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:01.757126+0000", 2024-02-10T08:25:15.445 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016596300000000001 2024-02-10T08:25:15.445 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.446 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.446 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1,3", 2024-02-10T08:25:15.446 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:01.757292+0000", 2024-02-10T08:25:15.446 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00088507799999999997 2024-02-10T08:25:15.446 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.446 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.446 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:25:15.446 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:01.758177+0000", 2024-02-10T08:25:15.446 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00045197800000000002 2024-02-10T08:25:15.446 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.446 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.446 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:25:15.446 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:01.758629+0000", 2024-02-10T08:25:15.446 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.053873703000000002 2024-02-10T08:25:15.447 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.447 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.447 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:25:15.447 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:01.812502+0000", 2024-02-10T08:25:15.447 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7667000000000003e-05 2024-02-10T08:25:15.447 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.447 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.447 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:25:15.447 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:01.812550+0000", 2024-02-10T08:25:15.447 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7978000000000001e-05 2024-02-10T08:25:15.447 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.447 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.447 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:25:15.447 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:01.812588+0000", 2024-02-10T08:25:15.447 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.055677539999999998 2024-02-10T08:25:15.448 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:15.448 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:25:15.448 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:15.448 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.448 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.448 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14784.0:28609 7.0 7:019cbdd0:::benchmark_data_smithi018_80623_object28608:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e96)", 2024-02-10T08:25:15.448 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:20:02.772900+0000", 2024-02-10T08:25:15.448 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 312.65281739400001, 2024-02-10T08:25:15.448 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061987441999999997, 2024-02-10T08:25:15.448 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:25:15.448 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:25:15.448 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:25:15.448 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14784", 2024-02-10T08:25:15.448 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:25:15.449 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 28609 2024-02-10T08:25:15.449 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.449 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:25:15.449 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.449 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:25:15.449 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:02.772900+0000", 2024-02-10T08:25:15.449 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:25:15.449 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.449 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.449 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:25:15.449 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:02.772900+0000", 2024-02-10T08:25:15.449 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-02-10T08:25:15.449 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.449 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.449 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:25:15.450 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:02.772899+0000", 2024-02-10T08:25:15.450 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5336000000000001e-05 2024-02-10T08:25:15.450 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.450 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.450 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:25:15.450 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:02.772944+0000", 2024-02-10T08:25:15.450 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2393e-05 2024-02-10T08:25:15.450 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.450 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.450 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:25:15.450 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:02.772957+0000", 2024-02-10T08:25:15.450 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6779999999999997e-06 2024-02-10T08:25:15.450 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.450 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.451 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:25:15.451 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:02.772963+0000", 2024-02-10T08:25:15.451 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1397999999999999e-05 2024-02-10T08:25:15.451 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.451 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.451 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:25:15.451 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:02.773004+0000", 2024-02-10T08:25:15.451 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8280000000000003e-05 2024-02-10T08:25:15.451 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.451 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.451 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:25:15.451 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:02.773082+0000", 2024-02-10T08:25:15.451 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3220000000000005e-05 2024-02-10T08:25:15.451 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.451 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.452 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1,3", 2024-02-10T08:25:15.452 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:02.773175+0000", 2024-02-10T08:25:15.452 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00088865799999999996 2024-02-10T08:25:15.452 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.452 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.452 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:25:15.452 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:02.774064+0000", 2024-02-10T08:25:15.452 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0021768030000000002 2024-02-10T08:25:15.452 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.452 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.452 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:25:15.452 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:02.776241+0000", 2024-02-10T08:25:15.452 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.058590638 2024-02-10T08:25:15.452 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.453 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.453 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:25:15.453 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:02.834832+0000", 2024-02-10T08:25:15.453 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3541999999999998e-05 2024-02-10T08:25:15.453 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.453 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.453 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:25:15.453 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:02.834865+0000", 2024-02-10T08:25:15.453 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2753999999999999e-05 2024-02-10T08:25:15.453 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.453 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.453 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:25:15.453 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:02.834888+0000", 2024-02-10T08:25:15.453 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061987441999999997 2024-02-10T08:25:15.453 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:15.454 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:25:15.454 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:15.454 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.454 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.454 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14784.0:28610 7.0 7:0e511354:::benchmark_data_smithi018_80623_object28609:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e96)", 2024-02-10T08:25:15.454 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:20:02.774289+0000", 2024-02-10T08:25:15.454 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 312.65142887899998, 2024-02-10T08:25:15.454 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060686351999999999, 2024-02-10T08:25:15.454 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:25:15.454 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:25:15.454 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:25:15.454 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14784", 2024-02-10T08:25:15.454 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:25:15.454 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 28610 2024-02-10T08:25:15.455 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.455 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:25:15.455 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.455 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:25:15.455 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:02.774289+0000", 2024-02-10T08:25:15.455 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:25:15.455 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.455 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.455 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:25:15.455 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:02.774289+0000", 2024-02-10T08:25:15.455 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-02-10T08:25:15.455 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.455 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.455 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:25:15.455 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:02.774288+0000", 2024-02-10T08:25:15.456 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1309999999999994e-05 2024-02-10T08:25:15.456 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.456 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.456 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:25:15.456 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:02.774349+0000", 2024-02-10T08:25:15.456 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3899999999999999e-06 2024-02-10T08:25:15.456 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.456 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.456 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:25:15.456 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:02.774359+0000", 2024-02-10T08:25:15.456 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2389999999999999e-06 2024-02-10T08:25:15.456 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.456 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.456 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:25:15.457 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:02.774365+0000", 2024-02-10T08:25:15.457 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9641999999999998e-05 2024-02-10T08:25:15.457 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.457 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.457 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:25:15.457 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:02.774405+0000", 2024-02-10T08:25:15.457 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012236899999999999 2024-02-10T08:25:15.457 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.457 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.457 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:25:15.457 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:02.774527+0000", 2024-02-10T08:25:15.457 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000153778 2024-02-10T08:25:15.457 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.457 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.457 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1,3", 2024-02-10T08:25:15.458 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:02.774681+0000", 2024-02-10T08:25:15.458 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00082690599999999997 2024-02-10T08:25:15.458 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.458 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.458 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:25:15.458 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:02.775508+0000", 2024-02-10T08:25:15.458 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017336059999999999 2024-02-10T08:25:15.458 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.458 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.458 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:25:15.458 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:02.777241+0000", 2024-02-10T08:25:15.458 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.057675667999999999 2024-02-10T08:25:15.458 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.458 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.458 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:25:15.459 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:02.834917+0000", 2024-02-10T08:25:15.459 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7905999999999999e-05 2024-02-10T08:25:15.459 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.459 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.459 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:25:15.459 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:02.834955+0000", 2024-02-10T08:25:15.459 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0375999999999999e-05 2024-02-10T08:25:15.459 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.459 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.459 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:25:15.459 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:02.834975+0000", 2024-02-10T08:25:15.459 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060686351999999999 2024-02-10T08:25:15.459 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:15.459 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:25:15.460 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:15.460 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.460 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.460 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14784.0:29231 7.0 7:071d3ddc:::benchmark_data_smithi018_80623_object29230:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e96)", 2024-02-10T08:25:15.460 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:20:03.131822+0000", 2024-02-10T08:25:15.460 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 312.29389544399999, 2024-02-10T08:25:15.460 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.052241155999999997, 2024-02-10T08:25:15.460 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:25:15.460 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:25:15.460 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:25:15.460 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14784", 2024-02-10T08:25:15.460 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:25:15.460 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 29231 2024-02-10T08:25:15.460 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.461 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:25:15.461 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.461 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:25:15.461 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:03.131822+0000", 2024-02-10T08:25:15.461 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:25:15.461 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.461 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.461 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:25:15.461 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:03.131822+0000", 2024-02-10T08:25:15.461 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-02-10T08:25:15.461 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.461 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.461 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:25:15.461 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:03.131821+0000", 2024-02-10T08:25:15.461 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4109000000000004e-05 2024-02-10T08:25:15.462 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.462 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.462 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:25:15.462 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:03.131905+0000", 2024-02-10T08:25:15.462 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3200000000000006e-06 2024-02-10T08:25:15.462 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.462 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.462 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:25:15.462 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:03.131915+0000", 2024-02-10T08:25:15.462 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5220000000000001e-06 2024-02-10T08:25:15.462 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.462 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.462 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:25:15.462 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:03.131919+0000", 2024-02-10T08:25:15.462 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7045000000000002e-05 2024-02-10T08:25:15.463 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.463 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.463 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:25:15.463 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:03.131956+0000", 2024-02-10T08:25:15.463 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1181000000000007e-05 2024-02-10T08:25:15.463 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.463 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.463 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:25:15.463 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:03.132047+0000", 2024-02-10T08:25:15.463 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4265000000000006e-05 2024-02-10T08:25:15.463 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.463 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.463 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1,3", 2024-02-10T08:25:15.463 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:03.132142+0000", 2024-02-10T08:25:15.464 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0010165669999999999 2024-02-10T08:25:15.464 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.464 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.464 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:25:15.464 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:03.133158+0000", 2024-02-10T08:25:15.464 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00092708199999999997 2024-02-10T08:25:15.464 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.464 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.464 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:25:15.464 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:03.134085+0000", 2024-02-10T08:25:15.464 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.049881518 2024-02-10T08:25:15.464 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.464 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.464 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:25:15.465 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:03.183967+0000", 2024-02-10T08:25:15.465 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0568e-05 2024-02-10T08:25:15.465 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.465 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.465 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:25:15.465 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:03.184027+0000", 2024-02-10T08:25:15.465 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6185e-05 2024-02-10T08:25:15.465 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.465 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.465 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:25:15.465 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:03.184063+0000", 2024-02-10T08:25:15.465 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.052241155999999997 2024-02-10T08:25:15.465 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:15.465 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:25:15.465 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:15.466 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.466 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.466 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14784.0:76647 7.0 7:06f521c3:::benchmark_data_smithi018_80623_object76646:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e107)", 2024-02-10T08:25:15.466 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:20:41.562223+0000", 2024-02-10T08:25:15.466 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 273.86349447700002, 2024-02-10T08:25:15.466 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.071293885000000001, 2024-02-10T08:25:15.466 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:25:15.466 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:25:15.466 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:25:15.466 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14784", 2024-02-10T08:25:15.466 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:25:15.466 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 76647 2024-02-10T08:25:15.466 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.466 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:25:15.466 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.467 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:25:15.467 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:41.562223+0000", 2024-02-10T08:25:15.467 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:25:15.467 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.467 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.467 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:25:15.467 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:41.562223+0000", 2024-02-10T08:25:15.467 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-02-10T08:25:15.467 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.467 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.467 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:25:15.467 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:41.562222+0000", 2024-02-10T08:25:15.467 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9740000000000001e-05 2024-02-10T08:25:15.467 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.467 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.468 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:25:15.468 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:41.562272+0000", 2024-02-10T08:25:15.468 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0049e-05 2024-02-10T08:25:15.468 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.468 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.468 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:25:15.468 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:41.562282+0000", 2024-02-10T08:25:15.468 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8100000000000003e-06 2024-02-10T08:25:15.468 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.468 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.468 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:25:15.468 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:41.562287+0000", 2024-02-10T08:25:15.468 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6164000000000001e-05 2024-02-10T08:25:15.468 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.468 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.469 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:25:15.471 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:41.562324+0000", 2024-02-10T08:25:15.471 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3189000000000006e-05 2024-02-10T08:25:15.471 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.471 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.471 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:25:15.471 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:41.562407+0000", 2024-02-10T08:25:15.471 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2053999999999997e-05 2024-02-10T08:25:15.471 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.471 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.471 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1,3", 2024-02-10T08:25:15.472 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:41.562499+0000", 2024-02-10T08:25:15.472 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0023047879999999999 2024-02-10T08:25:15.472 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.472 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.472 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:25:15.472 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:41.564804+0000", 2024-02-10T08:25:15.472 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003375673 2024-02-10T08:25:15.472 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.472 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.472 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:25:15.472 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:41.568179+0000", 2024-02-10T08:25:15.472 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.065233693999999995 2024-02-10T08:25:15.472 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.473 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.473 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:25:15.473 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:41.633413+0000", 2024-02-10T08:25:15.473 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7459e-05 2024-02-10T08:25:15.473 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.473 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.473 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:25:15.473 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:41.633471+0000", 2024-02-10T08:25:15.473 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6683e-05 2024-02-10T08:25:15.473 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.473 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.473 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:25:15.473 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:41.633517+0000", 2024-02-10T08:25:15.473 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.071293885000000001 2024-02-10T08:25:15.473 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:15.473 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:25:15.474 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:15.474 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.474 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.474 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14784.0:76660 7.0 7:077381ba:::benchmark_data_smithi018_80623_object76659:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e107)", 2024-02-10T08:25:15.474 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:20:41.570847+0000", 2024-02-10T08:25:15.474 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 273.85487071799997, 2024-02-10T08:25:15.474 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.066285814999999998, 2024-02-10T08:25:15.474 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:25:15.474 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:25:15.475 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:25:15.475 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14784", 2024-02-10T08:25:15.475 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:25:15.475 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 76660 2024-02-10T08:25:15.475 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.475 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:25:15.475 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.475 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:25:15.475 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:41.570847+0000", 2024-02-10T08:25:15.475 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:25:15.475 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.475 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.475 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:25:15.475 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:41.570847+0000", 2024-02-10T08:25:15.476 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999981 2024-02-10T08:25:15.476 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.476 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.476 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:25:15.476 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:41.570845+0000", 2024-02-10T08:25:15.476 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7565999999999999e-05 2024-02-10T08:25:15.476 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.476 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.476 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:25:15.476 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:41.570883+0000", 2024-02-10T08:25:15.476 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.22e-05 2024-02-10T08:25:15.476 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.476 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.476 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:25:15.477 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:41.570895+0000", 2024-02-10T08:25:15.477 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9300000000000002e-06 2024-02-10T08:25:15.477 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.477 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.477 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:25:15.477 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:41.570900+0000", 2024-02-10T08:25:15.477 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9459999999999997e-05 2024-02-10T08:25:15.477 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.477 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.477 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:25:15.477 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:41.570950+0000", 2024-02-10T08:25:15.477 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014272199999999999 2024-02-10T08:25:15.478 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.478 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.478 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:25:15.478 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:41.571092+0000", 2024-02-10T08:25:15.478 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018231500000000001 2024-02-10T08:25:15.478 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.478 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.478 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1,3", 2024-02-10T08:25:15.478 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:41.571275+0000", 2024-02-10T08:25:15.478 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022261059999999998 2024-02-10T08:25:15.478 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.478 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.478 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:25:15.478 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:41.573501+0000", 2024-02-10T08:25:15.478 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00025793000000000002 2024-02-10T08:25:15.479 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.479 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.479 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:25:15.479 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:41.573759+0000", 2024-02-10T08:25:15.479 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063277274999999994 2024-02-10T08:25:15.479 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.479 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.479 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:25:15.479 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:41.637036+0000", 2024-02-10T08:25:15.479 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2345999999999997e-05 2024-02-10T08:25:15.479 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.479 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.479 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:25:15.479 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:41.637078+0000", 2024-02-10T08:25:15.479 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4651999999999998e-05 2024-02-10T08:25:15.480 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.480 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.480 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:25:15.480 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:41.637133+0000", 2024-02-10T08:25:15.480 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.066285814999999998 2024-02-10T08:25:15.480 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:15.480 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:25:15.480 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:15.480 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.480 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.480 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14784.0:78862 7.0 7:06fdc26b:::benchmark_data_smithi018_80623_object78861:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e108)", 2024-02-10T08:25:15.480 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:20:43.929308+0000", 2024-02-10T08:25:15.480 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 271.49640983500001, 2024-02-10T08:25:15.481 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.054301543000000001, 2024-02-10T08:25:15.481 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:25:15.481 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:25:15.481 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:25:15.481 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14784", 2024-02-10T08:25:15.481 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:25:15.481 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 78862 2024-02-10T08:25:15.481 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.481 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:25:15.481 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.481 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:25:15.482 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:43.929308+0000", 2024-02-10T08:25:15.482 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:25:15.482 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.482 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.482 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:25:15.482 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:43.929308+0000", 2024-02-10T08:25:15.482 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-02-10T08:25:15.482 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.482 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.482 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:25:15.482 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:43.929306+0000", 2024-02-10T08:25:15.482 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6759999999999999e-05 2024-02-10T08:25:15.482 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.482 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.482 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:25:15.483 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:43.929363+0000", 2024-02-10T08:25:15.483 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1943999999999999e-05 2024-02-10T08:25:15.483 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.483 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.483 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:25:15.483 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:43.929375+0000", 2024-02-10T08:25:15.483 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1910000000000003e-06 2024-02-10T08:25:15.483 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.483 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.483 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:25:15.483 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:43.929382+0000", 2024-02-10T08:25:15.483 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5207999999999998e-05 2024-02-10T08:25:15.483 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.483 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.483 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:25:15.484 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:43.929428+0000", 2024-02-10T08:25:15.484 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013369599999999999 2024-02-10T08:25:15.484 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.484 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.484 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:25:15.484 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:43.929561+0000", 2024-02-10T08:25:15.484 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016317 2024-02-10T08:25:15.484 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.484 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.484 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1,3", 2024-02-10T08:25:15.484 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:43.929724+0000", 2024-02-10T08:25:15.484 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027248730000000001 2024-02-10T08:25:15.484 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.484 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.485 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:25:15.485 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:43.932449+0000", 2024-02-10T08:25:15.485 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00048668099999999998 2024-02-10T08:25:15.485 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.485 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.485 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:25:15.485 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:43.932936+0000", 2024-02-10T08:25:15.485 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.050531140000000002 2024-02-10T08:25:15.485 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.485 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.485 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:25:15.485 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:43.983467+0000", 2024-02-10T08:25:15.485 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1939000000000003e-05 2024-02-10T08:25:15.485 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.485 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.486 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:25:15.486 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:43.983549+0000", 2024-02-10T08:25:15.486 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0455999999999999e-05 2024-02-10T08:25:15.486 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.486 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.486 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:25:15.486 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:43.983609+0000", 2024-02-10T08:25:15.486 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.054301543000000001 2024-02-10T08:25:15.486 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:15.486 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:25:15.486 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:15.486 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.486 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.486 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14784.0:131416 7.0 7:07d917c4:::benchmark_data_smithi018_80623_object30488:head [delete] snapc 0=[] ondisk+write+known_if_redirected e136)", 2024-02-10T08:25:15.487 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:22:04.788709+0000", 2024-02-10T08:25:15.487 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 190.63700899599999, 2024-02-10T08:25:15.487 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.052006626, 2024-02-10T08:25:15.487 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:25:15.487 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:25:15.487 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:25:15.487 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14784", 2024-02-10T08:25:15.487 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:25:15.487 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 131416 2024-02-10T08:25:15.487 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.487 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:25:15.487 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.487 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:25:15.487 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:04.788709+0000", 2024-02-10T08:25:15.488 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:25:15.488 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.488 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.488 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:25:15.488 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:04.788709+0000", 2024-02-10T08:25:15.488 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-02-10T08:25:15.488 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.488 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.488 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:25:15.488 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:04.788708+0000", 2024-02-10T08:25:15.488 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2760000000000001e-06 2024-02-10T08:25:15.488 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.488 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.488 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:25:15.489 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:04.788711+0000", 2024-02-10T08:25:15.489 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2179999999999996e-06 2024-02-10T08:25:15.489 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.489 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.489 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:25:15.489 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:04.788718+0000", 2024-02-10T08:25:15.489 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4460000000000003e-06 2024-02-10T08:25:15.489 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.489 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.489 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:25:15.489 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:04.788722+0000", 2024-02-10T08:25:15.489 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027483490000000002 2024-02-10T08:25:15.489 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.489 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.490 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:25:15.490 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:04.791470+0000", 2024-02-10T08:25:15.490 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012734700000000001 2024-02-10T08:25:15.490 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.490 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.490 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:25:15.490 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:04.791598+0000", 2024-02-10T08:25:15.490 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012505 2024-02-10T08:25:15.490 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.490 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.490 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1,3", 2024-02-10T08:25:15.490 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:04.791723+0000", 2024-02-10T08:25:15.490 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002507408 2024-02-10T08:25:15.490 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.491 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.491 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:25:15.491 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:04.794230+0000", 2024-02-10T08:25:15.491 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001231427 2024-02-10T08:25:15.491 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.491 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.491 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:25:15.491 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:04.795462+0000", 2024-02-10T08:25:15.491 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.045196020000000003 2024-02-10T08:25:15.491 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.491 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.491 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:25:15.491 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:04.840658+0000", 2024-02-10T08:25:15.491 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7322999999999999e-05 2024-02-10T08:25:15.492 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.492 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.492 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:25:15.492 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:04.840685+0000", 2024-02-10T08:25:15.492 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0355999999999999e-05 2024-02-10T08:25:15.492 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.492 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.492 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:25:15.492 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:04.840715+0000", 2024-02-10T08:25:15.492 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.052006626 2024-02-10T08:25:15.492 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:15.492 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:25:15.492 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:15.492 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.493 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.493 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14784.0:153201 7.0 7:0da3817c:::benchmark_data_smithi018_80623_object52273:head [delete] snapc 0=[] ondisk+write+known_if_redirected e149)", 2024-02-10T08:25:15.493 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:22:37.568299+0000", 2024-02-10T08:25:15.493 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 157.85741858, 2024-02-10T08:25:15.493 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.074004055999999999, 2024-02-10T08:25:15.493 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:25:15.493 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:25:15.493 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:25:15.493 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14784", 2024-02-10T08:25:15.493 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:25:15.493 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 153201 2024-02-10T08:25:15.493 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.493 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:25:15.493 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.493 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:25:15.494 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:37.568299+0000", 2024-02-10T08:25:15.494 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:25:15.494 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.494 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.494 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:25:15.494 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:37.568299+0000", 2024-02-10T08:25:15.494 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999981 2024-02-10T08:25:15.494 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.494 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.494 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:25:15.494 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:37.568298+0000", 2024-02-10T08:25:15.494 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8169999999999999e-06 2024-02-10T08:25:15.494 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.494 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.494 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:25:15.495 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:37.568305+0000", 2024-02-10T08:25:15.495 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3730999999999999e-05 2024-02-10T08:25:15.495 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.495 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.495 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:25:15.495 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:37.568319+0000", 2024-02-10T08:25:15.495 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5390000000000004e-06 2024-02-10T08:25:15.495 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.495 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.495 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:25:15.495 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:37.568326+0000", 2024-02-10T08:25:15.495 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8596e-05 2024-02-10T08:25:15.495 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.495 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.495 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:25:15.496 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:37.568374+0000", 2024-02-10T08:25:15.496 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011027900000000001 2024-02-10T08:25:15.496 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.496 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.496 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:25:15.496 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:37.568484+0000", 2024-02-10T08:25:15.496 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000113342 2024-02-10T08:25:15.496 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.496 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.496 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1,3", 2024-02-10T08:25:15.496 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:37.568598+0000", 2024-02-10T08:25:15.496 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0042781390000000002 2024-02-10T08:25:15.496 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.496 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.496 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:25:15.497 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:37.572876+0000", 2024-02-10T08:25:15.497 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00635405 2024-02-10T08:25:15.497 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.497 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.497 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:25:15.497 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:37.579230+0000", 2024-02-10T08:25:15.497 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062985816 2024-02-10T08:25:15.497 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.497 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.497 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:25:15.497 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:37.642216+0000", 2024-02-10T08:25:15.497 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7260999999999999e-05 2024-02-10T08:25:15.497 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.497 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.497 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:25:15.498 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:37.642273+0000", 2024-02-10T08:25:15.498 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0176e-05 2024-02-10T08:25:15.498 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.498 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.498 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:25:15.498 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:37.642303+0000", 2024-02-10T08:25:15.498 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.074004055999999999 2024-02-10T08:25:15.498 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:15.498 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:25:15.498 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:15.498 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.498 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.498 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14784.0:153202 7.0 7:02753f4a:::benchmark_data_smithi018_80623_object52274:head [delete] snapc 0=[] ondisk+write+known_if_redirected e149)", 2024-02-10T08:25:15.498 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:22:37.568340+0000", 2024-02-10T08:25:15.498 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 157.85737745500001, 2024-02-10T08:25:15.499 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.074038372000000005, 2024-02-10T08:25:15.499 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:25:15.499 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:25:15.499 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:25:15.499 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14784", 2024-02-10T08:25:15.499 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:25:15.499 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 153202 2024-02-10T08:25:15.499 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.499 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:25:15.499 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.499 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:25:15.499 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:37.568340+0000", 2024-02-10T08:25:15.499 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:25:15.499 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.500 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.500 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:25:15.500 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:37.568340+0000", 2024-02-10T08:25:15.500 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-02-10T08:25:15.500 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.500 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.500 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:25:15.500 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:37.568340+0000", 2024-02-10T08:25:15.500 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4460000000000001e-06 2024-02-10T08:25:15.500 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.500 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.500 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:25:15.500 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:37.568343+0000", 2024-02-10T08:25:15.500 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2890000000000003e-06 2024-02-10T08:25:15.500 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.501 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.501 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:25:15.501 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:37.568350+0000", 2024-02-10T08:25:15.501 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3549999999999998e-06 2024-02-10T08:25:15.501 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.501 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.501 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:25:15.501 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:37.568354+0000", 2024-02-10T08:25:15.501 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027350780000000002 2024-02-10T08:25:15.501 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.501 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.501 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:25:15.501 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:37.571089+0000", 2024-02-10T08:25:15.501 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8084999999999995e-05 2024-02-10T08:25:15.502 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.502 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.502 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:25:15.502 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:37.571167+0000", 2024-02-10T08:25:15.502 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0115e-05 2024-02-10T08:25:15.502 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.502 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.502 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1,3", 2024-02-10T08:25:15.502 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:37.571257+0000", 2024-02-10T08:25:15.502 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001757677 2024-02-10T08:25:15.502 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.502 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.502 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:25:15.502 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:37.573015+0000", 2024-02-10T08:25:15.503 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0085990879999999995 2024-02-10T08:25:15.503 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.503 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.503 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:25:15.503 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:37.581614+0000", 2024-02-10T08:25:15.503 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060711752000000001 2024-02-10T08:25:15.503 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.503 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.503 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:25:15.503 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:37.642326+0000", 2024-02-10T08:25:15.503 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0349e-05 2024-02-10T08:25:15.503 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.503 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.503 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:25:15.503 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:37.642356+0000", 2024-02-10T08:25:15.504 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2648999999999999e-05 2024-02-10T08:25:15.504 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.504 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.504 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:25:15.504 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:37.642379+0000", 2024-02-10T08:25:15.504 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.074038372000000005 2024-02-10T08:25:15.504 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:15.504 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:25:15.504 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:15.504 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.504 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.504 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14784.0:153219 7.0 7:0f3f4a66:::benchmark_data_smithi018_80623_object52291:head [delete] snapc 0=[] ondisk+write+known_if_redirected e149)", 2024-02-10T08:25:15.504 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:22:37.588708+0000", 2024-02-10T08:25:15.505 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 157.83701020999999, 2024-02-10T08:25:15.505 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.053734906999999998, 2024-02-10T08:25:15.505 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:25:15.505 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:25:15.505 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:25:15.505 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14784", 2024-02-10T08:25:15.505 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:25:15.505 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 153219 2024-02-10T08:25:15.505 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.505 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:25:15.505 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.505 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:25:15.505 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:37.588708+0000", 2024-02-10T08:25:15.505 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:25:15.505 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.506 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.506 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:25:15.506 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:37.588708+0000", 2024-02-10T08:25:15.506 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999981 2024-02-10T08:25:15.506 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.506 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.506 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:25:15.506 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:37.588706+0000", 2024-02-10T08:25:15.506 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0220000000000004e-06 2024-02-10T08:25:15.506 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.506 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.506 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:25:15.506 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:37.588714+0000", 2024-02-10T08:25:15.506 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3210000000000001e-05 2024-02-10T08:25:15.506 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.507 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.507 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:25:15.507 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:37.588727+0000", 2024-02-10T08:25:15.507 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1339999999999998e-06 2024-02-10T08:25:15.507 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.507 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.507 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:25:15.507 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:37.588734+0000", 2024-02-10T08:25:15.507 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2843000000000002e-05 2024-02-10T08:25:15.507 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.507 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.507 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:25:15.507 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:37.588787+0000", 2024-02-10T08:25:15.507 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013826999999999999 2024-02-10T08:25:15.507 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.508 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.508 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:25:15.508 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:37.588925+0000", 2024-02-10T08:25:15.508 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000131178 2024-02-10T08:25:15.508 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.508 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.508 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1,3", 2024-02-10T08:25:15.508 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:37.589056+0000", 2024-02-10T08:25:15.508 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0025419850000000001 2024-02-10T08:25:15.508 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.508 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.508 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:25:15.508 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:37.591598+0000", 2024-02-10T08:25:15.508 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0036887500000000002 2024-02-10T08:25:15.509 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.509 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.509 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:25:15.509 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:37.595287+0000", 2024-02-10T08:25:15.509 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.047113032999999999 2024-02-10T08:25:15.509 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.509 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.509 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:25:15.509 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:37.642400+0000", 2024-02-10T08:25:15.509 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3839999999999999e-05 2024-02-10T08:25:15.509 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.509 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.509 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:25:15.509 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:37.642424+0000", 2024-02-10T08:25:15.509 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8502999999999999e-05 2024-02-10T08:25:15.510 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.510 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.510 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:25:15.510 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:37.642442+0000", 2024-02-10T08:25:15.510 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.053734906999999998 2024-02-10T08:25:15.510 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:15.510 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:25:15.510 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:15.510 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.510 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.510 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14784.0:154207 7.0 7:07c9bdfd:::benchmark_data_smithi018_80623_object53279:head [delete] snapc 0=[] ondisk+write+known_if_redirected e149)", 2024-02-10T08:25:15.510 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:22:38.909281+0000", 2024-02-10T08:25:15.510 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 156.51643628799999, 2024-02-10T08:25:15.510 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.058826527000000003, 2024-02-10T08:25:15.511 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:25:15.511 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:25:15.511 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:25:15.511 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14784", 2024-02-10T08:25:15.511 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:25:15.511 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 154207 2024-02-10T08:25:15.511 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.511 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:25:15.511 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.511 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:25:15.511 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:38.909281+0000", 2024-02-10T08:25:15.511 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:25:15.511 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.511 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.511 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:25:15.512 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:38.909281+0000", 2024-02-10T08:25:15.512 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-02-10T08:25:15.512 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.512 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.512 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:25:15.512 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:38.909280+0000", 2024-02-10T08:25:15.512 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2310000000000001e-06 2024-02-10T08:25:15.512 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.512 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.512 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:25:15.512 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:38.909287+0000", 2024-02-10T08:25:15.512 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4469999999999995e-06 2024-02-10T08:25:15.512 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.512 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.513 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:25:15.513 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:38.909296+0000", 2024-02-10T08:25:15.513 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7779999999999998e-06 2024-02-10T08:25:15.513 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.513 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.513 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:25:15.513 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:38.909301+0000", 2024-02-10T08:25:15.513 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4183e-05 2024-02-10T08:25:15.513 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.513 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.513 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:25:15.513 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:38.909345+0000", 2024-02-10T08:25:15.513 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011571800000000001 2024-02-10T08:25:15.513 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.513 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.514 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:25:15.514 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:38.909461+0000", 2024-02-10T08:25:15.514 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013064500000000001 2024-02-10T08:25:15.514 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.514 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.514 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1,3", 2024-02-10T08:25:15.514 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:38.909591+0000", 2024-02-10T08:25:15.514 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0036781259999999999 2024-02-10T08:25:15.514 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.514 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.514 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:25:15.514 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:38.913269+0000", 2024-02-10T08:25:15.514 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0064917869999999997 2024-02-10T08:25:15.514 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.515 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.515 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:25:15.515 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:38.919761+0000", 2024-02-10T08:25:15.515 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.048257065000000002 2024-02-10T08:25:15.515 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.515 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.515 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:25:15.515 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:38.968018+0000", 2024-02-10T08:25:15.515 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1378000000000002e-05 2024-02-10T08:25:15.515 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.515 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.515 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:25:15.515 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:38.968070+0000", 2024-02-10T08:25:15.515 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8368000000000003e-05 2024-02-10T08:25:15.515 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.516 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.516 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:25:15.516 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:38.968108+0000", 2024-02-10T08:25:15.516 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.058826527000000003 2024-02-10T08:25:15.516 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:15.516 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:25:15.516 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:15.516 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.516 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.516 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14784.0:157842 7.0 7:097e4743:::benchmark_data_smithi018_80623_object56914:head [delete] snapc 0=[] ondisk+write+known_if_redirected e152)", 2024-02-10T08:25:15.516 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:22:44.470769+0000", 2024-02-10T08:25:15.516 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 150.95494862000001, 2024-02-10T08:25:15.516 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060205296999999998, 2024-02-10T08:25:15.516 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:25:15.516 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:25:15.517 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:25:15.517 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14784", 2024-02-10T08:25:15.517 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:25:15.517 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 157842 2024-02-10T08:25:15.517 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.517 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:25:15.517 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.517 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:25:15.517 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:44.470769+0000", 2024-02-10T08:25:15.517 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:25:15.517 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.517 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.517 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:25:15.517 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:44.470769+0000", 2024-02-10T08:25:15.518 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999981 2024-02-10T08:25:15.518 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.518 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.518 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:25:15.518 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:44.470767+0000", 2024-02-10T08:25:15.518 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2659999999999998e-06 2024-02-10T08:25:15.518 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.518 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.518 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:25:15.518 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:44.470774+0000", 2024-02-10T08:25:15.518 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2524000000000001e-05 2024-02-10T08:25:15.518 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.518 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.518 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:25:15.518 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:44.470786+0000", 2024-02-10T08:25:15.519 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.967e-06 2024-02-10T08:25:15.519 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.519 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.519 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:25:15.519 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:44.470791+0000", 2024-02-10T08:25:15.519 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4880999999999999e-05 2024-02-10T08:25:15.519 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.519 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.519 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:25:15.519 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:44.470836+0000", 2024-02-10T08:25:15.519 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3628000000000006e-05 2024-02-10T08:25:15.519 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.519 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.519 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:25:15.520 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:44.470920+0000", 2024-02-10T08:25:15.520 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1520000000000005e-05 2024-02-10T08:25:15.520 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.520 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.520 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1,3", 2024-02-10T08:25:15.520 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:44.471011+0000", 2024-02-10T08:25:15.520 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027916439999999998 2024-02-10T08:25:15.520 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.520 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.520 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:25:15.520 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:44.473803+0000", 2024-02-10T08:25:15.520 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0045161630000000001 2024-02-10T08:25:15.520 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.520 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.521 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:25:15.521 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:44.478319+0000", 2024-02-10T08:25:15.521 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.052597352 2024-02-10T08:25:15.521 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.521 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.521 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:25:15.521 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:44.530916+0000", 2024-02-10T08:25:15.521 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1976e-05 2024-02-10T08:25:15.521 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.521 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.521 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:25:15.521 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:44.530948+0000", 2024-02-10T08:25:15.521 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6115999999999999e-05 2024-02-10T08:25:15.521 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.521 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.522 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:25:15.522 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:44.530974+0000", 2024-02-10T08:25:15.522 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060205296999999998 2024-02-10T08:25:15.522 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:15.522 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:25:15.522 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:15.522 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.522 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.522 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14784.0:157848 7.0 7:055a19b2:::benchmark_data_smithi018_80623_object56920:head [delete] snapc 0=[] ondisk+write+known_if_redirected e152)", 2024-02-10T08:25:15.522 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:22:44.490317+0000", 2024-02-10T08:25:15.522 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 150.93540096500001, 2024-02-10T08:25:15.522 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.055200196999999999, 2024-02-10T08:25:15.522 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:25:15.522 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:25:15.522 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:25:15.523 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14784", 2024-02-10T08:25:15.523 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:25:15.523 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 157848 2024-02-10T08:25:15.523 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.523 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:25:15.523 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.523 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:25:15.523 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:44.490317+0000", 2024-02-10T08:25:15.523 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:25:15.523 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.523 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.523 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:25:15.523 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:44.490317+0000", 2024-02-10T08:25:15.523 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-02-10T08:25:15.523 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.524 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.524 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:25:15.524 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:44.490315+0000", 2024-02-10T08:25:15.524 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6680000000000001e-06 2024-02-10T08:25:15.524 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.524 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.524 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:25:15.524 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:44.490323+0000", 2024-02-10T08:25:15.524 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4703e-05 2024-02-10T08:25:15.524 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.524 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.524 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:25:15.524 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:44.490338+0000", 2024-02-10T08:25:15.524 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.516e-06 2024-02-10T08:25:15.525 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.525 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.525 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:25:15.525 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:44.490344+0000", 2024-02-10T08:25:15.525 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1421000000000001e-05 2024-02-10T08:25:15.525 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.525 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.525 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:25:15.525 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:44.490396+0000", 2024-02-10T08:25:15.525 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000103025 2024-02-10T08:25:15.525 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.525 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.525 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:25:15.525 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:44.490499+0000", 2024-02-10T08:25:15.526 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7491999999999995e-05 2024-02-10T08:25:15.526 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.526 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.526 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1,3", 2024-02-10T08:25:15.526 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:44.490586+0000", 2024-02-10T08:25:15.526 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0049265059999999998 2024-02-10T08:25:15.526 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.526 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.526 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:25:15.526 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:44.495513+0000", 2024-02-10T08:25:15.526 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.047894557999999997 2024-02-10T08:25:15.526 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.526 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.526 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:25:15.526 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:44.543407+0000", 2024-02-10T08:25:15.527 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020158839999999999 2024-02-10T08:25:15.527 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.527 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.527 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:25:15.527 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:44.545423+0000", 2024-02-10T08:25:15.527 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1848999999999998e-05 2024-02-10T08:25:15.527 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.527 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.527 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:25:15.527 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:44.545475+0000", 2024-02-10T08:25:15.527 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2144999999999997e-05 2024-02-10T08:25:15.527 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.527 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.527 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:25:15.527 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:44.545517+0000", 2024-02-10T08:25:15.528 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.055200196999999999 2024-02-10T08:25:15.528 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:15.528 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:25:15.528 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:15.528 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.528 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.528 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14784.0:157851 7.0 7:03ab5202:::benchmark_data_smithi018_80623_object56923:head [delete] snapc 0=[] ondisk+write+known_if_redirected e152)", 2024-02-10T08:25:15.528 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:22:44.490355+0000", 2024-02-10T08:25:15.528 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 150.93536303799999, 2024-02-10T08:25:15.528 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.055285159, 2024-02-10T08:25:15.528 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:25:15.528 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:25:15.528 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:25:15.528 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14784", 2024-02-10T08:25:15.528 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:25:15.529 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 157851 2024-02-10T08:25:15.529 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.529 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:25:15.529 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.529 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:25:15.529 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:44.490355+0000", 2024-02-10T08:25:15.529 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:25:15.529 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.529 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.529 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:25:15.529 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:44.490355+0000", 2024-02-10T08:25:15.529 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-02-10T08:25:15.529 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.529 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.530 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:25:15.530 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:44.490354+0000", 2024-02-10T08:25:15.530 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0539999999999999e-06 2024-02-10T08:25:15.530 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.530 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.530 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:25:15.530 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:44.490357+0000", 2024-02-10T08:25:15.530 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9919999999999998e-06 2024-02-10T08:25:15.530 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.530 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.530 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:25:15.530 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:44.490362+0000", 2024-02-10T08:25:15.530 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2097e-05 2024-02-10T08:25:15.530 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.530 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.531 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:25:15.531 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:44.490375+0000", 2024-02-10T08:25:15.531 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003009575 2024-02-10T08:25:15.531 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.531 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.531 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:25:15.531 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:44.493384+0000", 2024-02-10T08:25:15.531 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012137399999999999 2024-02-10T08:25:15.531 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.531 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.531 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:25:15.531 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:44.493505+0000", 2024-02-10T08:25:15.531 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013223299999999999 2024-02-10T08:25:15.531 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.531 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.532 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1,3", 2024-02-10T08:25:15.532 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:44.493638+0000", 2024-02-10T08:25:15.532 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019808019999999998 2024-02-10T08:25:15.532 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.532 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.532 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:25:15.532 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:44.495618+0000", 2024-02-10T08:25:15.532 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.047827254 2024-02-10T08:25:15.532 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.532 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.532 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:25:15.532 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:44.543446+0000", 2024-02-10T08:25:15.532 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0021143239999999999 2024-02-10T08:25:15.532 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.533 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.533 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:25:15.533 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:44.545560+0000", 2024-02-10T08:25:15.533 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4313000000000001e-05 2024-02-10T08:25:15.533 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.533 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.533 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:25:15.533 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:44.545604+0000", 2024-02-10T08:25:15.533 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5516999999999999e-05 2024-02-10T08:25:15.533 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.533 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.533 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:25:15.533 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:44.545640+0000", 2024-02-10T08:25:15.533 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.055285159 2024-02-10T08:25:15.534 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:15.534 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:25:15.534 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:15.534 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.534 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.534 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14784.0:195949 7.0 7:035c13c6:::benchmark_data_smithi018_80623_object95021:head [delete] snapc 0=[] ondisk+write+known_if_redirected e173)", 2024-02-10T08:25:15.534 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:23:42.706842+0000", 2024-02-10T08:25:15.534 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 92.718875338999993, 2024-02-10T08:25:15.534 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.058291610000000001, 2024-02-10T08:25:15.534 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:25:15.534 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:25:15.534 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:25:15.534 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14784", 2024-02-10T08:25:15.534 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:25:15.534 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 195949 2024-02-10T08:25:15.534 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.535 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:25:15.535 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.535 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:25:15.535 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:42.706842+0000", 2024-02-10T08:25:15.535 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:25:15.535 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.535 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.535 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:25:15.535 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:42.706842+0000", 2024-02-10T08:25:15.535 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999981 2024-02-10T08:25:15.535 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.535 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.535 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:25:15.535 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:42.706841+0000", 2024-02-10T08:25:15.536 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5870000000000004e-06 2024-02-10T08:25:15.536 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.536 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.536 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:25:15.536 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:42.706848+0000", 2024-02-10T08:25:15.536 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3912e-05 2024-02-10T08:25:15.536 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.536 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.536 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:25:15.536 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:42.706862+0000", 2024-02-10T08:25:15.536 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7479999999999996e-06 2024-02-10T08:25:15.536 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.536 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.536 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:25:15.537 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:42.706869+0000", 2024-02-10T08:25:15.537 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012731 2024-02-10T08:25:15.537 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.537 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.537 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:25:15.537 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:42.706996+0000", 2024-02-10T08:25:15.537 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011945700000000001 2024-02-10T08:25:15.537 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.537 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.537 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:25:15.537 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:42.707116+0000", 2024-02-10T08:25:15.537 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000147155 2024-02-10T08:25:15.537 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.537 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.538 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1,3", 2024-02-10T08:25:15.538 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:42.707263+0000", 2024-02-10T08:25:15.538 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0060216469999999998 2024-02-10T08:25:15.538 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.538 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.538 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:25:15.538 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:42.713284+0000", 2024-02-10T08:25:15.538 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.047941441000000001 2024-02-10T08:25:15.538 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.538 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.538 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:25:15.538 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:42.761226+0000", 2024-02-10T08:25:15.538 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0038327690000000002 2024-02-10T08:25:15.538 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.538 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.539 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:25:15.539 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:42.765059+0000", 2024-02-10T08:25:15.539 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6247e-05 2024-02-10T08:25:15.539 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.539 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.539 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:25:15.539 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:42.765095+0000", 2024-02-10T08:25:15.539 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9118000000000001e-05 2024-02-10T08:25:15.539 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.539 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.539 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:25:15.539 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:42.765134+0000", 2024-02-10T08:25:15.539 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.058291610000000001 2024-02-10T08:25:15.539 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:15.540 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:25:15.540 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:15.540 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.540 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.540 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14964.0:66251 8.0 8:05844fe2:::benchmark_data_smithi018_103312_object66250:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e209)", 2024-02-10T08:25:15.540 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:25:14.399691+0000", 2024-02-10T08:25:15.540 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 1.0260270730000001, 2024-02-10T08:25:15.540 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.052217136999999997, 2024-02-10T08:25:15.540 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:25:15.540 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:25:15.540 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:25:15.540 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14964", 2024-02-10T08:25:15.540 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3173131962", 2024-02-10T08:25:15.540 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 66251 2024-02-10T08:25:15.541 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.541 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:25:15.541 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.541 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:25:15.541 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:14.399691+0000", 2024-02-10T08:25:15.541 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:25:15.541 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.541 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.541 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:25:15.541 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:14.399691+0000", 2024-02-10T08:25:15.541 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-02-10T08:25:15.541 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.541 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.541 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:25:15.541 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:14.399690+0000", 2024-02-10T08:25:15.542 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8888999999999999e-05 2024-02-10T08:25:15.542 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.542 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.542 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:25:15.542 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:14.399738+0000", 2024-02-10T08:25:15.542 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2690000000000005e-06 2024-02-10T08:25:15.542 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.542 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.542 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:25:15.542 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:14.399748+0000", 2024-02-10T08:25:15.542 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5040000000000002e-06 2024-02-10T08:25:15.542 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.542 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.542 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:25:15.542 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:14.399753+0000", 2024-02-10T08:25:15.543 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5306000000000003e-05 2024-02-10T08:25:15.543 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.543 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.543 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:25:15.543 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:14.399799+0000", 2024-02-10T08:25:15.543 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016141899999999999 2024-02-10T08:25:15.543 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.543 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.543 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:25:15.543 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:14.399960+0000", 2024-02-10T08:25:15.543 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014888999999999999 2024-02-10T08:25:15.543 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.543 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.543 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1,3", 2024-02-10T08:25:15.544 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:14.400109+0000", 2024-02-10T08:25:15.544 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040822920000000004 2024-02-10T08:25:15.544 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.544 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.544 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:25:15.544 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:14.404191+0000", 2024-02-10T08:25:15.544 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030832049999999999 2024-02-10T08:25:15.544 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.544 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.544 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:25:15.544 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:14.407274+0000", 2024-02-10T08:25:15.544 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.044543590000000001 2024-02-10T08:25:15.544 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.544 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.544 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:25:15.545 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:14.451818+0000", 2024-02-10T08:25:15.545 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1116000000000003e-05 2024-02-10T08:25:15.545 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.545 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.545 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:25:15.545 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:14.451869+0000", 2024-02-10T08:25:15.545 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8821e-05 2024-02-10T08:25:15.545 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.545 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.545 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:25:15.545 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:14.451908+0000", 2024-02-10T08:25:15.545 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.052217136999999997 2024-02-10T08:25:15.545 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:15.545 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:25:15.545 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:15.546 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.546 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.546 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14964.0:66254 8.0 8:0ccf77c8:::benchmark_data_smithi018_103312_object66253:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e209)", 2024-02-10T08:25:15.546 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:25:14.399827+0000", 2024-02-10T08:25:15.546 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 1.0258906940000001, 2024-02-10T08:25:15.546 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.052226524000000003, 2024-02-10T08:25:15.546 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:25:15.546 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:25:15.546 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:25:15.546 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14964", 2024-02-10T08:25:15.546 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3173131962", 2024-02-10T08:25:15.546 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 66254 2024-02-10T08:25:15.546 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.546 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:25:15.547 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.547 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:25:15.547 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:14.399827+0000", 2024-02-10T08:25:15.547 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:25:15.547 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.547 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.547 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:25:15.547 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:14.399827+0000", 2024-02-10T08:25:15.547 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-02-10T08:25:15.547 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.547 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.547 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:25:15.547 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:14.399826+0000", 2024-02-10T08:25:15.547 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4984000000000003e-05 2024-02-10T08:25:15.547 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.548 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.548 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:25:15.548 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:14.399861+0000", 2024-02-10T08:25:15.548 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1850000000000001e-06 2024-02-10T08:25:15.548 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.548 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.548 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:25:15.548 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:14.399868+0000", 2024-02-10T08:25:15.548 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4599999999999997e-06 2024-02-10T08:25:15.548 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.548 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.548 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:25:15.548 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:14.399875+0000", 2024-02-10T08:25:15.548 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002223324 2024-02-10T08:25:15.548 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.549 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.549 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:25:15.549 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:14.402098+0000", 2024-02-10T08:25:15.549 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000100759 2024-02-10T08:25:15.549 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.549 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.549 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:25:15.549 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:14.402199+0000", 2024-02-10T08:25:15.549 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015170599999999999 2024-02-10T08:25:15.549 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.549 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.549 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1,3", 2024-02-10T08:25:15.549 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:14.402351+0000", 2024-02-10T08:25:15.549 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0037352140000000002 2024-02-10T08:25:15.549 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.550 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.550 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:25:15.550 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:14.406086+0000", 2024-02-10T08:25:15.550 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0013013829999999999 2024-02-10T08:25:15.550 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.550 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.550 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:25:15.550 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:14.407388+0000", 2024-02-10T08:25:15.550 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.044577283000000002 2024-02-10T08:25:15.550 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.550 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.550 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:25:15.550 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:14.451965+0000", 2024-02-10T08:25:15.550 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9215999999999998e-05 2024-02-10T08:25:15.550 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.551 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.551 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:25:15.551 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:14.452014+0000", 2024-02-10T08:25:15.551 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9610000000000002e-05 2024-02-10T08:25:15.551 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:15.551 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:15.551 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:25:15.551 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:14.452054+0000", 2024-02-10T08:25:15.551 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.052226524000000003 2024-02-10T08:25:15.551 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:15.551 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:25:15.551 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:15.551 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:15.551 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:25:15.551 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-02-10T08:25:16.191 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.6 dump_ops_in_flight 2024-02-10T08:25:16.343 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 39 16 68606 68590 109.878 74.875 0.0220344 0.00909564 2024-02-10T08:25:16.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:14.709578+0000 mgr.y (mgr.14505) 324 : cluster [DBG] pgmap v387: 158 pgs: 158 active+clean; 3.9 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 1.2 KiB/s rd, 94 MiB/s wr, 1.50k op/s 2024-02-10T08:25:16.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:14.709578+0000 mgr.y (mgr.14505) 324 : cluster [DBG] pgmap v387: 158 pgs: 158 active+clean; 3.9 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 1.2 KiB/s rd, 94 MiB/s wr, 1.50k op/s 2024-02-10T08:25:16.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:14.709578+0000 mgr.y (mgr.14505) 324 : cluster [DBG] pgmap v387: 158 pgs: 158 active+clean; 3.9 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 1.2 KiB/s rd, 94 MiB/s wr, 1.50k op/s 2024-02-10T08:25:16.629 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:25:16.790 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:25:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:25:16] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:25:17.154 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:25:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:25:17] "GET /metrics HTTP/1.1" 200 175941 "" "Prometheus/2.33.4" 2024-02-10T08:25:17.344 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:2024-02-10T08:25:17.344051+0000 min lat: 0.00125956 max lat: 0.474095 avg lat: 0.0091674 2024-02-10T08:25:17.344 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-02-10T08:25:17.344 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 40 16 69817 69801 109.024 75.6875 0.0145865 0.0091674 2024-02-10T08:25:17.554 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-10T08:25:18.040 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:25:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:25:18.345 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 41 16 70955 70939 108.096 71.125 0.0082778 0.00924645 2024-02-10T08:25:18.431 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:16.710110+0000 mgr.y (mgr.14505) 325 : cluster [DBG] pgmap v388: 158 pgs: 158 active+clean; 3.9 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 1023 B/s rd, 81 MiB/s wr, 1.30k op/s 2024-02-10T08:25:18.657 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:16.710110+0000 mgr.y (mgr.14505) 325 : cluster [DBG] pgmap v388: 158 pgs: 158 active+clean; 3.9 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 1023 B/s rd, 81 MiB/s wr, 1.30k op/s 2024-02-10T08:25:18.657 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:16.710110+0000 mgr.y (mgr.14505) 325 : cluster [DBG] pgmap v388: 158 pgs: 158 active+clean; 3.9 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 1023 B/s rd, 81 MiB/s wr, 1.30k op/s 2024-02-10T08:25:18.779 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-02-10T08:25:18.779 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-02-10T08:25:18.779 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:18.779 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14964.0:71447 8.9 8:9036a994:::benchmark_data_smithi018_103312_object71446:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected e209)", 2024-02-10T08:25:18.779 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:25:18.768422+0000", 2024-02-10T08:25:18.779 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0098033189999999996, 2024-02-10T08:25:18.779 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0098298110000000008, 2024-02-10T08:25:18.779 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:25:18.779 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "waiting for sub ops", 2024-02-10T08:25:18.779 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:25:18.780 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14964", 2024-02-10T08:25:18.780 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3173131962", 2024-02-10T08:25:18.780 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 71447 2024-02-10T08:25:18.780 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:18.780 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:25:18.780 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:18.780 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:25:18.780 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:18.768422+0000", 2024-02-10T08:25:18.780 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:25:18.780 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:18.780 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:18.780 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:25:18.780 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:18.768422+0000", 2024-02-10T08:25:18.781 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-02-10T08:25:18.781 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:18.781 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:18.781 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:25:18.781 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:18.768420+0000", 2024-02-10T08:25:18.781 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018719099999999999 2024-02-10T08:25:18.781 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:18.781 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:18.781 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:25:18.781 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:18.768608+0000", 2024-02-10T08:25:18.781 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4217e-05 2024-02-10T08:25:18.781 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:18.781 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:18.782 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:25:18.782 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:18.768622+0000", 2024-02-10T08:25:18.782 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6610000000000003e-06 2024-02-10T08:25:18.782 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:18.782 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:18.782 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:25:18.782 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:18.768628+0000", 2024-02-10T08:25:18.782 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001324918 2024-02-10T08:25:18.782 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:18.782 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:18.782 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:25:18.782 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:18.769953+0000", 2024-02-10T08:25:18.782 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8496000000000002e-05 2024-02-10T08:25:18.782 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:18.782 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:18.782 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:25:18.783 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:18.770032+0000", 2024-02-10T08:25:18.783 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4393000000000002e-05 2024-02-10T08:25:18.783 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:18.783 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:18.783 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3,5", 2024-02-10T08:25:18.783 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:18.770126+0000", 2024-02-10T08:25:18.783 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0051727559999999997 2024-02-10T08:25:18.783 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:18.783 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:18.783 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:25:18.783 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:18.775299+0000", 2024-02-10T08:25:18.783 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6646999999999998e-05 2024-02-10T08:25:18.783 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:18.783 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:18.783 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:25:18.784 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:18.775316+0000", 2024-02-10T08:25:18.784 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0068937379999999999 2024-02-10T08:25:18.784 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:18.784 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:25:18.784 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:18.784 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:18.784 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:18.784 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.14964.0:71452 8.6 e209/191 8:641f52ce:::benchmark_data_smithi018_103312_object71451:head v 209'4458, mlcod=209'4454)", 2024-02-10T08:25:18.784 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:25:18.775921+0000", 2024-02-10T08:25:18.784 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.002304211, 2024-02-10T08:25:18.784 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002392014, 2024-02-10T08:25:18.784 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:25:18.784 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-02-10T08:25:18.784 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:25:18.784 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:18.785 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:25:18.785 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:18.775921+0000", 2024-02-10T08:25:18.785 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:25:18.785 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:18.785 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:18.785 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:25:18.785 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:18.775921+0000", 2024-02-10T08:25:18.785 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-02-10T08:25:18.785 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:18.785 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:18.785 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:25:18.785 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:18.775920+0000", 2024-02-10T08:25:18.785 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1677999999999997e-05 2024-02-10T08:25:18.785 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:18.786 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:18.786 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:25:18.786 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:18.775952+0000", 2024-02-10T08:25:18.786 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9550000000000003e-06 2024-02-10T08:25:18.786 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:18.786 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:18.786 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:25:18.786 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:18.775959+0000", 2024-02-10T08:25:18.786 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3760000000000001e-06 2024-02-10T08:25:18.786 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:18.786 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:18.786 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:25:18.786 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:18.775963+0000", 2024-02-10T08:25:18.786 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6088999999999999e-05 2024-02-10T08:25:18.786 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:18.787 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:18.787 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:25:18.787 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:18.776009+0000", 2024-02-10T08:25:18.787 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0910000000000001e-05 2024-02-10T08:25:18.787 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:18.787 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:18.787 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:25:18.787 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:18.776030+0000", 2024-02-10T08:25:18.787 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000109276 2024-02-10T08:25:18.787 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:18.787 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:25:18.787 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:18.787 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:18.787 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:18.787 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14964.0:71457 8.5 8.8c25e8c5 (undecoded) ondisk+write+known_if_redirected e209)", 2024-02-10T08:25:18.787 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:25:18.778216+0000", 2024-02-10T08:25:18.788 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.8480000000000007e-06, 2024-02-10T08:25:18.788 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000133487, 2024-02-10T08:25:18.788 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:25:18.788 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-02-10T08:25:18.788 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:25:18.788 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14964", 2024-02-10T08:25:18.788 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3173131962", 2024-02-10T08:25:18.788 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 71457 2024-02-10T08:25:18.788 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:18.788 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:25:18.788 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:18.788 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:25:18.788 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:18.778216+0000", 2024-02-10T08:25:18.788 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:25:18.789 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:18.789 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:18.789 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:25:18.789 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:18.778216+0000", 2024-02-10T08:25:18.789 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999981 2024-02-10T08:25:18.789 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:18.789 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:18.789 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:25:18.789 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:18.778215+0000", 2024-02-10T08:25:18.789 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9677e-05 2024-02-10T08:25:18.789 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:18.789 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:18.789 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:25:18.790 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:18.778254+0000", 2024-02-10T08:25:18.790 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5835999999999999e-05 2024-02-10T08:25:18.790 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:18.790 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:18.790 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:25:18.790 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:18.778270+0000", 2024-02-10T08:25:18.790 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.635e-06 2024-02-10T08:25:18.790 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:18.790 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:18.790 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:25:18.790 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:18.778277+0000", 2024-02-10T08:25:18.790 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0439000000000002e-05 2024-02-10T08:25:18.790 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:18.790 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:25:18.790 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:18.791 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:18.791 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:18.791 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14964.0:71458 8.9 8.924d92b9 (undecoded) ondisk+write+known_if_redirected e209)", 2024-02-10T08:25:18.791 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:25:18.778292+0000", 2024-02-10T08:25:18.791 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4294967295.9999337, 2024-02-10T08:25:18.791 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1514000000000005e-05, 2024-02-10T08:25:18.791 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:25:18.791 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-02-10T08:25:18.791 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:25:18.791 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14964", 2024-02-10T08:25:18.791 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3173131962", 2024-02-10T08:25:18.791 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 71458 2024-02-10T08:25:18.791 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:18.791 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:25:18.791 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:18.792 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:25:18.792 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:18.778292+0000", 2024-02-10T08:25:18.792 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:25:18.792 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:18.792 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:18.792 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:25:18.792 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:18.778292+0000", 2024-02-10T08:25:18.792 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-02-10T08:25:18.792 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:18.792 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:18.792 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:25:18.792 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:18.778291+0000", 2024-02-10T08:25:18.792 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8730999999999999e-05 2024-02-10T08:25:18.792 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:18.793 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:18.793 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:25:18.793 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:18.778330+0000", 2024-02-10T08:25:18.793 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4500000000000001e-06 2024-02-10T08:25:18.793 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:18.793 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:18.793 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:25:18.793 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:18.778336+0000", 2024-02-10T08:25:18.793 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1559999999999997e-06 2024-02-10T08:25:18.793 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:18.793 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:18.793 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:25:18.793 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:18.778340+0000", 2024-02-10T08:25:18.793 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8726000000000001e-05 2024-02-10T08:25:18.793 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:18.794 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:25:18.794 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:18.794 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:18.794 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-02-10T08:25:18.794 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 4 2024-02-10T08:25:18.794 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-02-10T08:25:19.184 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:25:17.952491+0000 mgr.y (mgr.14505) 326 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:25:19.345 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 42 16 72131 72115 107.272 73.5 0.00890428 0.00931701 2024-02-10T08:25:19.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:25:17.952491+0000 mgr.y (mgr.14505) 326 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:25:19.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:25:17.952491+0000 mgr.y (mgr.14505) 326 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:25:20.345 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 43 16 73239 73223 106.388 69.25 0.0117613 0.00939542 2024-02-10T08:25:20.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:18.710778+0000 mgr.y (mgr.14505) 327 : cluster [DBG] pgmap v389: 158 pgs: 158 active+clean; 4.3 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1023 B/s rd, 76 MiB/s wr, 1.22k op/s 2024-02-10T08:25:20.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:18.710778+0000 mgr.y (mgr.14505) 327 : cluster [DBG] pgmap v389: 158 pgs: 158 active+clean; 4.3 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1023 B/s rd, 76 MiB/s wr, 1.22k op/s 2024-02-10T08:25:20.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:18.710778+0000 mgr.y (mgr.14505) 327 : cluster [DBG] pgmap v389: 158 pgs: 158 active+clean; 4.3 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1023 B/s rd, 76 MiB/s wr, 1.22k op/s 2024-02-10T08:25:21.345 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 44 16 74384 74368 105.596 71.5625 0.0110927 0.00946502 2024-02-10T08:25:21.398 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:25:21.412 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:25:21.415 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:21.415 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:25:21.516 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:25:21.582 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:21.648 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:20.711244+0000 mgr.y (mgr.14505) 328 : cluster [DBG] pgmap v390: 158 pgs: 158 active+clean; 4.3 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1015 B/s rd, 76 MiB/s wr, 1.22k op/s 2024-02-10T08:25:21.769 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:25:21.776 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:21.776 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:25:21.877 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:25:21.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:20.711244+0000 mgr.y (mgr.14505) 328 : cluster [DBG] pgmap v390: 158 pgs: 158 active+clean; 4.3 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1015 B/s rd, 76 MiB/s wr, 1.22k op/s 2024-02-10T08:25:21.917 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:20.711244+0000 mgr.y (mgr.14505) 328 : cluster [DBG] pgmap v390: 158 pgs: 158 active+clean; 4.3 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1015 B/s rd, 76 MiB/s wr, 1.22k op/s 2024-02-10T08:25:21.930 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:22.345 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 45 16 75428 75412 104.7 65.25 0.0139411 0.00954606 2024-02-10T08:25:23.346 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 46 16 76652 76636 104.087 76.5 0.00583353 0.00960182 2024-02-10T08:25:24.042 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:22.712665+0000 mgr.y (mgr.14505) 329 : cluster [DBG] pgmap v391: 158 pgs: 158 active+clean; 4.5 GiB data, 16 GiB used, 700 GiB / 715 GiB avail; 1.2 KiB/s rd, 84 MiB/s wr, 1.34k op/s 2024-02-10T08:25:24.112 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:22.712665+0000 mgr.y (mgr.14505) 329 : cluster [DBG] pgmap v391: 158 pgs: 158 active+clean; 4.5 GiB data, 16 GiB used, 700 GiB / 715 GiB avail; 1.2 KiB/s rd, 84 MiB/s wr, 1.34k op/s 2024-02-10T08:25:24.112 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:22.712665+0000 mgr.y (mgr.14505) 329 : cluster [DBG] pgmap v391: 158 pgs: 158 active+clean; 4.5 GiB data, 16 GiB used, 700 GiB / 715 GiB avail; 1.2 KiB/s rd, 84 MiB/s wr, 1.34k op/s 2024-02-10T08:25:24.347 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 47 16 77753 77737 103.334 68.8125 0.0129715 0.00967262 2024-02-10T08:25:25.347 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 48 16 78966 78950 102.761 75.8125 0.0106053 0.0097265 2024-02-10T08:25:26.139 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:25:26.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:24.715297+0000 mgr.y (mgr.14505) 330 : cluster [DBG] pgmap v392: 158 pgs: 158 active+clean; 4.6 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 852 B/s rd, 71 MiB/s wr, 1.13k op/s 2024-02-10T08:25:26.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:24.715297+0000 mgr.y (mgr.14505) 330 : cluster [DBG] pgmap v392: 158 pgs: 158 active+clean; 4.6 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 852 B/s rd, 71 MiB/s wr, 1.13k op/s 2024-02-10T08:25:26.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:24.715297+0000 mgr.y (mgr.14505) 330 : cluster [DBG] pgmap v392: 158 pgs: 158 active+clean; 4.6 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 852 B/s rd, 71 MiB/s wr, 1.13k op/s 2024-02-10T08:25:26.349 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 49 16 79956 79940 101.922 61.875 0.0188257 0.00980653 2024-02-10T08:25:26.581 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:25:26.583 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:26.584 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:25:26.594 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.6 dump_blocked_ops 2024-02-10T08:25:26.685 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:25:26.762 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:26.790 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:25:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:25:26] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:25:26.855 INFO:teuthology.orchestra.run.smithi018.stderr:set pool 6 pgp_num to 42 2024-02-10T08:25:26.870 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is unset 2024-02-10T08:25:27.067 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:25:27.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:25:25.893118+0000 mon.c (mon.2) 42 : audit [INF] from='client.? 172.21.15.18:0/1457192935' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:25:27.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:25:25.893550+0000 mon.a (mon.0) 1122 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:25:27.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:25:26.420288+0000 mon.a (mon.0) 1123 : audit [INF] from='client.? 172.21.15.18:0/3923504260' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pgp_num", "val": "42"}]: dispatch 2024-02-10T08:25:27.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:25:26.515172+0000 mon.a (mon.0) 1124 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:25:27.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:25:25.893118+0000 mon.c (mon.2) 42 : audit [INF] from='client.? 172.21.15.18:0/1457192935' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:25:27.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:25:25.893550+0000 mon.a (mon.0) 1122 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:25:27.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:25:26.420288+0000 mon.a (mon.0) 1123 : audit [INF] from='client.? 172.21.15.18:0/3923504260' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pgp_num", "val": "42"}]: dispatch 2024-02-10T08:25:27.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:25:26.515172+0000 mon.a (mon.0) 1124 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:25:27.157 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:25:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:25:27] "GET /metrics HTTP/1.1" 200 175941 "" "Prometheus/2.33.4" 2024-02-10T08:25:27.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:25:25.893118+0000 mon.c (mon.2) 42 : audit [INF] from='client.? 172.21.15.18:0/1457192935' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:25:27.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:25:25.893550+0000 mon.a (mon.0) 1122 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:25:27.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:25:26.420288+0000 mon.a (mon.0) 1123 : audit [INF] from='client.? 172.21.15.18:0/3923504260' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pgp_num", "val": "42"}]: dispatch 2024-02-10T08:25:27.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:25:26.515172+0000 mon.a (mon.0) 1124 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:25:27.349 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 50 16 80958 80942 101.136 62.625 0.0143001 0.00988299 2024-02-10T08:25:28.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:26.716804+0000 mgr.y (mgr.14505) 331 : cluster [DBG] pgmap v393: 158 pgs: 158 active+clean; 4.6 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 852 B/s rd, 61 MiB/s wr, 969 op/s 2024-02-10T08:25:28.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:26.794628+0000 mon.a (mon.0) 1125 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:25:28.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:25:26.833285+0000 mon.a (mon.0) 1126 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-10T08:25:28.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:25:26.833383+0000 mon.a (mon.0) 1127 : audit [INF] from='client.? 172.21.15.18:0/3923504260' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pgp_num", "val": "42"}]': finished 2024-02-10T08:25:28.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:26.833435+0000 mon.a (mon.0) 1128 : cluster [DBG] osdmap e210: 8 total, 8 up, 8 in 2024-02-10T08:25:28.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:25:26.991006+0000 mon.a (mon.0) 1129 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:25:28.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:25:26.991844+0000 mon.a (mon.0) 1130 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:25:28.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:25:27.002663+0000 mon.a (mon.0) 1131 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:25:28.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:27.265625+0000 osd.6 (osd.6) 67 : cluster [DBG] 2.1a scrub starts 2024-02-10T08:25:28.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:27.271590+0000 osd.6 (osd.6) 68 : cluster [DBG] 2.1a scrub ok 2024-02-10T08:25:28.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:27.288556+0000 osd.7 (osd.7) 99 : cluster [DBG] 5.10 scrub starts 2024-02-10T08:25:28.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:27.291518+0000 osd.7 (osd.7) 100 : cluster [DBG] 5.10 scrub ok 2024-02-10T08:25:28.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:26.716804+0000 mgr.y (mgr.14505) 331 : cluster [DBG] pgmap v393: 158 pgs: 158 active+clean; 4.6 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 852 B/s rd, 61 MiB/s wr, 969 op/s 2024-02-10T08:25:28.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:26.794628+0000 mon.a (mon.0) 1125 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:25:28.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:25:26.833285+0000 mon.a (mon.0) 1126 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-10T08:25:28.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:25:26.833383+0000 mon.a (mon.0) 1127 : audit [INF] from='client.? 172.21.15.18:0/3923504260' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pgp_num", "val": "42"}]': finished 2024-02-10T08:25:28.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:26.833435+0000 mon.a (mon.0) 1128 : cluster [DBG] osdmap e210: 8 total, 8 up, 8 in 2024-02-10T08:25:28.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:25:26.991006+0000 mon.a (mon.0) 1129 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:25:28.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:25:26.991844+0000 mon.a (mon.0) 1130 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:25:28.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:25:27.002663+0000 mon.a (mon.0) 1131 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:25:28.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:27.265625+0000 osd.6 (osd.6) 67 : cluster [DBG] 2.1a scrub starts 2024-02-10T08:25:28.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:27.271590+0000 osd.6 (osd.6) 68 : cluster [DBG] 2.1a scrub ok 2024-02-10T08:25:28.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:27.288556+0000 osd.7 (osd.7) 99 : cluster [DBG] 5.10 scrub starts 2024-02-10T08:25:28.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:27.291518+0000 osd.7 (osd.7) 100 : cluster [DBG] 5.10 scrub ok 2024-02-10T08:25:28.289 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:25:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:25:28.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:26.716804+0000 mgr.y (mgr.14505) 331 : cluster [DBG] pgmap v393: 158 pgs: 158 active+clean; 4.6 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 852 B/s rd, 61 MiB/s wr, 969 op/s 2024-02-10T08:25:28.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:26.794628+0000 mon.a (mon.0) 1125 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:25:28.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:25:26.833285+0000 mon.a (mon.0) 1126 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-10T08:25:28.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:25:26.833383+0000 mon.a (mon.0) 1127 : audit [INF] from='client.? 172.21.15.18:0/3923504260' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pgp_num", "val": "42"}]': finished 2024-02-10T08:25:28.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:26.833435+0000 mon.a (mon.0) 1128 : cluster [DBG] osdmap e210: 8 total, 8 up, 8 in 2024-02-10T08:25:28.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:25:26.991006+0000 mon.a (mon.0) 1129 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:25:28.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:25:26.991844+0000 mon.a (mon.0) 1130 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:25:28.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:25:27.002663+0000 mon.a (mon.0) 1131 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:25:28.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:27.265625+0000 osd.6 (osd.6) 67 : cluster [DBG] 2.1a scrub starts 2024-02-10T08:25:28.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:27.271590+0000 osd.6 (osd.6) 68 : cluster [DBG] 2.1a scrub ok 2024-02-10T08:25:28.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:27.288556+0000 osd.7 (osd.7) 99 : cluster [DBG] 5.10 scrub starts 2024-02-10T08:25:28.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:27.291518+0000 osd.7 (osd.7) 100 : cluster [DBG] 5.10 scrub ok 2024-02-10T08:25:28.351 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 51 16 82140 82124 100.599 73.875 0.0106856 0.00993589 2024-02-10T08:25:28.746 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:25:28.749 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:28.749 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:25:28.850 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:25:28.912 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:27.752091+0000 osd.5 (osd.5) 99 : cluster [DBG] 4.8 scrub starts 2024-02-10T08:25:28.912 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:27.758984+0000 osd.5 (osd.5) 100 : cluster [DBG] 4.8 scrub ok 2024-02-10T08:25:28.912 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:25:27.966483+0000 mgr.y (mgr.14505) 332 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:25:28.912 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:28.153493+0000 osd.2 (osd.2) 87 : cluster [DBG] 2.10 scrub starts 2024-02-10T08:25:28.912 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:28.166648+0000 osd.2 (osd.2) 88 : cluster [DBG] 2.10 scrub ok 2024-02-10T08:25:28.913 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:28.218942+0000 osd.6 (osd.6) 69 : cluster [DBG] 2.17 scrub starts 2024-02-10T08:25:28.913 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:28.222002+0000 osd.6 (osd.6) 70 : cluster [DBG] 2.17 scrub ok 2024-02-10T08:25:28.913 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:28.299465+0000 osd.7 (osd.7) 101 : cluster [DBG] 4.16 scrub starts 2024-02-10T08:25:28.913 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:28.309149+0000 osd.7 (osd.7) 102 : cluster [DBG] 4.16 scrub ok 2024-02-10T08:25:28.913 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:27.752091+0000 osd.5 (osd.5) 99 : cluster [DBG] 4.8 scrub starts 2024-02-10T08:25:28.913 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:27.758984+0000 osd.5 (osd.5) 100 : cluster [DBG] 4.8 scrub ok 2024-02-10T08:25:28.913 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:25:27.966483+0000 mgr.y (mgr.14505) 332 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:25:28.913 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:28.153493+0000 osd.2 (osd.2) 87 : cluster [DBG] 2.10 scrub starts 2024-02-10T08:25:28.913 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:28.166648+0000 osd.2 (osd.2) 88 : cluster [DBG] 2.10 scrub ok 2024-02-10T08:25:28.913 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:28.218942+0000 osd.6 (osd.6) 69 : cluster [DBG] 2.17 scrub starts 2024-02-10T08:25:28.913 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:28.222002+0000 osd.6 (osd.6) 70 : cluster [DBG] 2.17 scrub ok 2024-02-10T08:25:28.914 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:28.299465+0000 osd.7 (osd.7) 101 : cluster [DBG] 4.16 scrub starts 2024-02-10T08:25:28.914 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:28.309149+0000 osd.7 (osd.7) 102 : cluster [DBG] 4.16 scrub ok 2024-02-10T08:25:28.918 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:29.133 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:27.752091+0000 osd.5 (osd.5) 99 : cluster [DBG] 4.8 scrub starts 2024-02-10T08:25:29.134 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:27.758984+0000 osd.5 (osd.5) 100 : cluster [DBG] 4.8 scrub ok 2024-02-10T08:25:29.134 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:25:27.966483+0000 mgr.y (mgr.14505) 332 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:25:29.134 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:28.153493+0000 osd.2 (osd.2) 87 : cluster [DBG] 2.10 scrub starts 2024-02-10T08:25:29.134 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:28.166648+0000 osd.2 (osd.2) 88 : cluster [DBG] 2.10 scrub ok 2024-02-10T08:25:29.134 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:28.218942+0000 osd.6 (osd.6) 69 : cluster [DBG] 2.17 scrub starts 2024-02-10T08:25:29.134 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:28.222002+0000 osd.6 (osd.6) 70 : cluster [DBG] 2.17 scrub ok 2024-02-10T08:25:29.134 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:28.299465+0000 osd.7 (osd.7) 101 : cluster [DBG] 4.16 scrub starts 2024-02-10T08:25:29.134 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:28.309149+0000 osd.7 (osd.7) 102 : cluster [DBG] 4.16 scrub ok 2024-02-10T08:25:29.351 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 52 16 83338 83322 100.104 74.875 0.0139205 0.00998435 2024-02-10T08:25:29.377 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:25:29.383 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:29.384 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:25:29.485 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:25:29.541 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:29.757 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:25:29.762 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:29.762 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:25:29.863 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:25:29.869 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:28.717612+0000 mgr.y (mgr.14505) 333 : cluster [DBG] pgmap v395: 158 pgs: 158 active+clean; 4.9 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1023 B/s rd, 70 MiB/s wr, 1.12k op/s 2024-02-10T08:25:29.869 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:28.811429+0000 osd.1 (osd.1) 98 : cluster [DBG] 5.1d scrub starts 2024-02-10T08:25:29.869 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:28.818306+0000 osd.1 (osd.1) 99 : cluster [DBG] 5.1d scrub ok 2024-02-10T08:25:29.870 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:28.946883+0000 osd.0 (osd.0) 98 : cluster [DBG] 5.13 scrub starts 2024-02-10T08:25:29.870 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:28.951600+0000 osd.0 (osd.0) 99 : cluster [DBG] 5.13 scrub ok 2024-02-10T08:25:29.870 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:29.271780+0000 osd.4 (osd.4) 16 : cluster [DBG] 6.1a scrub starts 2024-02-10T08:25:29.870 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:29.279220+0000 osd.4 (osd.4) 17 : cluster [DBG] 6.1a scrub ok 2024-02-10T08:25:29.870 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:29.290279+0000 osd.7 (osd.7) 103 : cluster [DBG] 2.b scrub starts 2024-02-10T08:25:29.870 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:29.292941+0000 osd.7 (osd.7) 104 : cluster [DBG] 2.b scrub ok 2024-02-10T08:25:29.929 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:29.970 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:25:29.973 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:29.974 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:25:30.075 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:25:30.119 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:30.158 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:28.717612+0000 mgr.y (mgr.14505) 333 : cluster [DBG] pgmap v395: 158 pgs: 158 active+clean; 4.9 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1023 B/s rd, 70 MiB/s wr, 1.12k op/s 2024-02-10T08:25:30.158 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:28.811429+0000 osd.1 (osd.1) 98 : cluster [DBG] 5.1d scrub starts 2024-02-10T08:25:30.158 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:28.818306+0000 osd.1 (osd.1) 99 : cluster [DBG] 5.1d scrub ok 2024-02-10T08:25:30.158 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:28.946883+0000 osd.0 (osd.0) 98 : cluster [DBG] 5.13 scrub starts 2024-02-10T08:25:30.158 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:28.951600+0000 osd.0 (osd.0) 99 : cluster [DBG] 5.13 scrub ok 2024-02-10T08:25:30.158 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:29.271780+0000 osd.4 (osd.4) 16 : cluster [DBG] 6.1a scrub starts 2024-02-10T08:25:30.158 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:29.279220+0000 osd.4 (osd.4) 17 : cluster [DBG] 6.1a scrub ok 2024-02-10T08:25:30.158 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:29.290279+0000 osd.7 (osd.7) 103 : cluster [DBG] 2.b scrub starts 2024-02-10T08:25:30.158 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:29.292941+0000 osd.7 (osd.7) 104 : cluster [DBG] 2.b scrub ok 2024-02-10T08:25:30.159 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:28.717612+0000 mgr.y (mgr.14505) 333 : cluster [DBG] pgmap v395: 158 pgs: 158 active+clean; 4.9 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1023 B/s rd, 70 MiB/s wr, 1.12k op/s 2024-02-10T08:25:30.159 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:28.811429+0000 osd.1 (osd.1) 98 : cluster [DBG] 5.1d scrub starts 2024-02-10T08:25:30.159 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:28.818306+0000 osd.1 (osd.1) 99 : cluster [DBG] 5.1d scrub ok 2024-02-10T08:25:30.159 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:28.946883+0000 osd.0 (osd.0) 98 : cluster [DBG] 5.13 scrub starts 2024-02-10T08:25:30.159 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:28.951600+0000 osd.0 (osd.0) 99 : cluster [DBG] 5.13 scrub ok 2024-02-10T08:25:30.159 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:29.271780+0000 osd.4 (osd.4) 16 : cluster [DBG] 6.1a scrub starts 2024-02-10T08:25:30.159 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:29.279220+0000 osd.4 (osd.4) 17 : cluster [DBG] 6.1a scrub ok 2024-02-10T08:25:30.159 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:29.290279+0000 osd.7 (osd.7) 103 : cluster [DBG] 2.b scrub starts 2024-02-10T08:25:30.159 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:29.292941+0000 osd.7 (osd.7) 104 : cluster [DBG] 2.b scrub ok 2024-02-10T08:25:30.178 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:25:30.216 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:25:30.239 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:25:30.246 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:25:30.247 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:30.248 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:25:30.282 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:25:30.316 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:25:30.348 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:25:30.349 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:25:30.351 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 53 16 84469 84453 99.5483 70.6875 0.0202578 0.0100412 2024-02-10T08:25:30.392 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:25:30.398 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:30.429 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:25:30.434 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:25:30.436 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-10T08:25:30.436 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-10T08:25:30.436 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-10T08:25:30.436 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-10T08:25:30.436 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-10T08:25:30.436 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-10T08:25:30.436 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-10T08:25:30.437 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-10T08:25:30.437 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:30.438 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:25:30.538 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:25:30.602 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:30.608 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-02-10T08:25:30.609 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:25:30.630 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:25:30.636 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:30.637 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:25:30.692 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd unset nodeep-scrub 2024-02-10T08:25:30.737 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:25:30.806 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:30.904 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:25:30.914 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:30.915 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:25:31.016 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:25:31.064 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:29.195855+0000 osd.2 (osd.2) 89 : cluster [DBG] 4.19 scrub starts 2024-02-10T08:25:31.064 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:29.198594+0000 osd.2 (osd.2) 90 : cluster [DBG] 4.19 scrub ok 2024-02-10T08:25:31.065 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:25:30.129704+0000 mon.c (mon.2) 43 : audit [DBG] from='client.? 172.21.15.18:0/1800413345' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:25:31.065 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:30.319350+0000 osd.7 (osd.7) 105 : cluster [DBG] 5.4 scrub starts 2024-02-10T08:25:31.065 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:30.324877+0000 osd.7 (osd.7) 106 : cluster [DBG] 5.4 scrub ok 2024-02-10T08:25:31.065 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:30.635129+0000 mon.a (mon.0) 1132 : cluster [DBG] osdmap e211: 8 total, 8 up, 8 in 2024-02-10T08:25:31.065 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:29.195855+0000 osd.2 (osd.2) 89 : cluster [DBG] 4.19 scrub starts 2024-02-10T08:25:31.065 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:29.198594+0000 osd.2 (osd.2) 90 : cluster [DBG] 4.19 scrub ok 2024-02-10T08:25:31.065 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:25:30.129704+0000 mon.c (mon.2) 43 : audit [DBG] from='client.? 172.21.15.18:0/1800413345' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:25:31.065 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:30.319350+0000 osd.7 (osd.7) 105 : cluster [DBG] 5.4 scrub starts 2024-02-10T08:25:31.065 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:30.324877+0000 osd.7 (osd.7) 106 : cluster [DBG] 5.4 scrub ok 2024-02-10T08:25:31.065 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:30.635129+0000 mon.a (mon.0) 1132 : cluster [DBG] osdmap e211: 8 total, 8 up, 8 in 2024-02-10T08:25:31.067 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:31.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:29.195855+0000 osd.2 (osd.2) 89 : cluster [DBG] 4.19 scrub starts 2024-02-10T08:25:31.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:29.198594+0000 osd.2 (osd.2) 90 : cluster [DBG] 4.19 scrub ok 2024-02-10T08:25:31.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:25:30.129704+0000 mon.c (mon.2) 43 : audit [DBG] from='client.? 172.21.15.18:0/1800413345' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:25:31.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:30.319350+0000 osd.7 (osd.7) 105 : cluster [DBG] 5.4 scrub starts 2024-02-10T08:25:31.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:30.324877+0000 osd.7 (osd.7) 106 : cluster [DBG] 5.4 scrub ok 2024-02-10T08:25:31.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:30.635129+0000 mon.a (mon.0) 1132 : cluster [DBG] osdmap e211: 8 total, 8 up, 8 in 2024-02-10T08:25:31.351 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 54 16 85544 85528 98.9491 67.1875 0.0181832 0.0101004 2024-02-10T08:25:31.367 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:25:31.377 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:31.377 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:25:31.380 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.6 dump_historic_ops 2024-02-10T08:25:31.478 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:25:31.534 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:31.551 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:25:31.568 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:25:31.578 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:31.578 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:25:31.679 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:25:31.759 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:31.795 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:25:31.802 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:31.802 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:25:31.826 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:25:31.903 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:25:31.956 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:32.018 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:25:32.028 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:32.029 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:25:32.029 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:30.720355+0000 mgr.y (mgr.14505) 334 : cluster [DBG] pgmap v397: 158 pgs: 158 active+clean; 5.0 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 639 B/s rd, 57 MiB/s wr, 908 op/s 2024-02-10T08:25:32.029 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:30.856301+0000 osd.1 (osd.1) 100 : cluster [DBG] 4.10 scrub starts 2024-02-10T08:25:32.029 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:30.862059+0000 osd.1 (osd.1) 101 : cluster [DBG] 4.10 scrub ok 2024-02-10T08:25:32.029 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:31.003659+0000 osd.0 (osd.0) 100 : cluster [DBG] 6.23 scrub starts 2024-02-10T08:25:32.029 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:31.052793+0000 osd.0 (osd.0) 101 : cluster [DBG] 6.23 scrub ok 2024-02-10T08:25:32.029 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:31.216493+0000 osd.4 (osd.4) 18 : cluster [DBG] 5.18 scrub starts 2024-02-10T08:25:32.029 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:31.222872+0000 osd.4 (osd.4) 19 : cluster [DBG] 5.18 scrub ok 2024-02-10T08:25:32.029 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:31.254428+0000 osd.6 (osd.6) 71 : cluster [DBG] 4.1f scrub starts 2024-02-10T08:25:32.030 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:31.279638+0000 osd.6 (osd.6) 72 : cluster [DBG] 4.1f scrub ok 2024-02-10T08:25:32.030 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:31.342036+0000 osd.7 (osd.7) 107 : cluster [DBG] 6.12 scrub starts 2024-02-10T08:25:32.030 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:31.346708+0000 osd.7 (osd.7) 108 : cluster [DBG] 6.12 scrub ok 2024-02-10T08:25:32.129 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:25:32.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:30.720355+0000 mgr.y (mgr.14505) 334 : cluster [DBG] pgmap v397: 158 pgs: 158 active+clean; 5.0 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 639 B/s rd, 57 MiB/s wr, 908 op/s 2024-02-10T08:25:32.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:30.856301+0000 osd.1 (osd.1) 100 : cluster [DBG] 4.10 scrub starts 2024-02-10T08:25:32.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:30.862059+0000 osd.1 (osd.1) 101 : cluster [DBG] 4.10 scrub ok 2024-02-10T08:25:32.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:31.003659+0000 osd.0 (osd.0) 100 : cluster [DBG] 6.23 scrub starts 2024-02-10T08:25:32.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:31.052793+0000 osd.0 (osd.0) 101 : cluster [DBG] 6.23 scrub ok 2024-02-10T08:25:32.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:31.216493+0000 osd.4 (osd.4) 18 : cluster [DBG] 5.18 scrub starts 2024-02-10T08:25:32.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:31.222872+0000 osd.4 (osd.4) 19 : cluster [DBG] 5.18 scrub ok 2024-02-10T08:25:32.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:31.254428+0000 osd.6 (osd.6) 71 : cluster [DBG] 4.1f scrub starts 2024-02-10T08:25:32.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:31.279638+0000 osd.6 (osd.6) 72 : cluster [DBG] 4.1f scrub ok 2024-02-10T08:25:32.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:31.342036+0000 osd.7 (osd.7) 107 : cluster [DBG] 6.12 scrub starts 2024-02-10T08:25:32.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:31.346708+0000 osd.7 (osd.7) 108 : cluster [DBG] 6.12 scrub ok 2024-02-10T08:25:32.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:30.720355+0000 mgr.y (mgr.14505) 334 : cluster [DBG] pgmap v397: 158 pgs: 158 active+clean; 5.0 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 639 B/s rd, 57 MiB/s wr, 908 op/s 2024-02-10T08:25:32.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:30.856301+0000 osd.1 (osd.1) 100 : cluster [DBG] 4.10 scrub starts 2024-02-10T08:25:32.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:30.862059+0000 osd.1 (osd.1) 101 : cluster [DBG] 4.10 scrub ok 2024-02-10T08:25:32.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:31.003659+0000 osd.0 (osd.0) 100 : cluster [DBG] 6.23 scrub starts 2024-02-10T08:25:32.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:31.052793+0000 osd.0 (osd.0) 101 : cluster [DBG] 6.23 scrub ok 2024-02-10T08:25:32.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:31.216493+0000 osd.4 (osd.4) 18 : cluster [DBG] 5.18 scrub starts 2024-02-10T08:25:32.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:31.222872+0000 osd.4 (osd.4) 19 : cluster [DBG] 5.18 scrub ok 2024-02-10T08:25:32.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:31.254428+0000 osd.6 (osd.6) 71 : cluster [DBG] 4.1f scrub starts 2024-02-10T08:25:32.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:31.279638+0000 osd.6 (osd.6) 72 : cluster [DBG] 4.1f scrub ok 2024-02-10T08:25:32.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:31.342036+0000 osd.7 (osd.7) 107 : cluster [DBG] 6.12 scrub starts 2024-02-10T08:25:32.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:31.346708+0000 osd.7 (osd.7) 108 : cluster [DBG] 6.12 scrub ok 2024-02-10T08:25:32.199 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:32.227 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:25:32.232 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:32.232 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:25:32.333 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:25:32.351 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 55 16 86639 86623 98.3944 68.4375 0.0119813 0.010158 2024-02-10T08:25:32.374 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:32.835 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:25:32.838 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:32.838 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:25:32.939 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:25:32.987 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:31.873296+0000 osd.1 (osd.1) 102 : cluster [DBG] 5.c scrub starts 2024-02-10T08:25:32.988 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:31.881765+0000 osd.1 (osd.1) 103 : cluster [DBG] 5.c scrub ok 2024-02-10T08:25:32.988 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:32.221550+0000 osd.4 (osd.4) 20 : cluster [DBG] 6.1e scrub starts 2024-02-10T08:25:32.988 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:32.229642+0000 osd.4 (osd.4) 21 : cluster [DBG] 6.1e scrub ok 2024-02-10T08:25:32.988 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:31.873296+0000 osd.1 (osd.1) 102 : cluster [DBG] 5.c scrub starts 2024-02-10T08:25:32.988 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:31.881765+0000 osd.1 (osd.1) 103 : cluster [DBG] 5.c scrub ok 2024-02-10T08:25:32.988 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:32.221550+0000 osd.4 (osd.4) 20 : cluster [DBG] 6.1e scrub starts 2024-02-10T08:25:32.988 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:32.229642+0000 osd.4 (osd.4) 21 : cluster [DBG] 6.1e scrub ok 2024-02-10T08:25:32.991 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:33.124 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:25:33.126 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:33.127 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:25:33.203 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 5, 6, 7, 4] 2024-02-10T08:25:33.203 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-10T08:25:33.204 INFO:tasks.thrashosds.thrasher:reset_purged_snaps_last 2024-02-10T08:25:33.204 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph tell osd.0 reset_purged_snaps_last 2024-02-10T08:25:33.227 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:25:33.266 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:31.873296+0000 osd.1 (osd.1) 102 : cluster [DBG] 5.c scrub starts 2024-02-10T08:25:33.266 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:31.881765+0000 osd.1 (osd.1) 103 : cluster [DBG] 5.c scrub ok 2024-02-10T08:25:33.266 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:32.221550+0000 osd.4 (osd.4) 20 : cluster [DBG] 6.1e scrub starts 2024-02-10T08:25:33.266 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:32.229642+0000 osd.4 (osd.4) 21 : cluster [DBG] 6.1e scrub ok 2024-02-10T08:25:33.267 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:33.303 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:25:33.316 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:33.317 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:25:33.352 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 56 16 87772 87756 97.902 70.8125 0.0147978 0.0102099 2024-02-10T08:25:33.387 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-10T08:25:33.417 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:25:33.451 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:33.608 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:25:33.611 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:33.611 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:25:33.712 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:25:33.774 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:33.888 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:25:33.893 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:33.893 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:25:33.932 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-02-10T08:25:33.932 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:25:33.974 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:25:33.994 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:25:34.037 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:34.058 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:25:34.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:32.721085+0000 mgr.y (mgr.14505) 335 : cluster [DBG] pgmap v398: 158 pgs: 158 active+clean; 5.2 GiB data, 18 GiB used, 698 GiB / 715 GiB avail; 1.2 KiB/s rd, 74 MiB/s wr, 1.19k op/s 2024-02-10T08:25:34.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:33.227442+0000 osd.4 (osd.4) 22 : cluster [DBG] 4.9 scrub starts 2024-02-10T08:25:34.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:33.232613+0000 osd.4 (osd.4) 23 : cluster [DBG] 4.9 scrub ok 2024-02-10T08:25:34.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:33.454441+0000 osd.1 (osd.1) 104 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:25:34.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:33.454497+0000 osd.1 (osd.1) 105 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:25:34.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:32.721085+0000 mgr.y (mgr.14505) 335 : cluster [DBG] pgmap v398: 158 pgs: 158 active+clean; 5.2 GiB data, 18 GiB used, 698 GiB / 715 GiB avail; 1.2 KiB/s rd, 74 MiB/s wr, 1.19k op/s 2024-02-10T08:25:34.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:33.227442+0000 osd.4 (osd.4) 22 : cluster [DBG] 4.9 scrub starts 2024-02-10T08:25:34.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:33.232613+0000 osd.4 (osd.4) 23 : cluster [DBG] 4.9 scrub ok 2024-02-10T08:25:34.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:33.454441+0000 osd.1 (osd.1) 104 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:25:34.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:33.454497+0000 osd.1 (osd.1) 105 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:25:34.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:32.721085+0000 mgr.y (mgr.14505) 335 : cluster [DBG] pgmap v398: 158 pgs: 158 active+clean; 5.2 GiB data, 18 GiB used, 698 GiB / 715 GiB avail; 1.2 KiB/s rd, 74 MiB/s wr, 1.19k op/s 2024-02-10T08:25:34.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:33.227442+0000 osd.4 (osd.4) 22 : cluster [DBG] 4.9 scrub starts 2024-02-10T08:25:34.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:33.232613+0000 osd.4 (osd.4) 23 : cluster [DBG] 4.9 scrub ok 2024-02-10T08:25:34.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:33.454441+0000 osd.1 (osd.1) 104 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:25:34.293 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:33.454497+0000 osd.1 (osd.1) 105 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:25:34.352 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 57 16 88683 88667 97.1835 56.9375 0.010652 0.0102836 2024-02-10T08:25:34.688 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.7 dump_ops_in_flight 2024-02-10T08:25:34.953 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:33.945373+0000 mon.a (mon.0) 1133 : cluster [DBG] osdmap e212: 8 total, 8 up, 8 in 2024-02-10T08:25:34.953 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:25:34.257382+0000 mon.c (mon.2) 44 : audit [INF] from='client.? 172.21.15.18:0/1848696398' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:25:34.953 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:25:34.257936+0000 mon.a (mon.0) 1134 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:25:34.985 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is unset 2024-02-10T08:25:35.131 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:25:35.354 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 58 16 89795 89779 96.7031 69.5 0.00975079 0.0103368 2024-02-10T08:25:35.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:33.945373+0000 mon.a (mon.0) 1133 : cluster [DBG] osdmap e212: 8 total, 8 up, 8 in 2024-02-10T08:25:35.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:25:34.257382+0000 mon.c (mon.2) 44 : audit [INF] from='client.? 172.21.15.18:0/1848696398' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:25:35.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:25:34.257936+0000 mon.a (mon.0) 1134 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:25:35.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:33.945373+0000 mon.a (mon.0) 1133 : cluster [DBG] osdmap e212: 8 total, 8 up, 8 in 2024-02-10T08:25:35.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:25:34.257382+0000 mon.c (mon.2) 44 : audit [INF] from='client.? 172.21.15.18:0/1848696398' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:25:35.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:25:34.257936+0000 mon.a (mon.0) 1134 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:25:35.620 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:25:35.625 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:35.625 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:25:35.726 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:25:35.784 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:36.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:34.260485+0000 osd.2 (osd.2) 91 : cluster [DBG] 5.6 scrub starts 2024-02-10T08:25:36.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:34.266209+0000 osd.2 (osd.2) 92 : cluster [DBG] 5.6 scrub ok 2024-02-10T08:25:36.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:34.721499+0000 mgr.y (mgr.14505) 336 : cluster [DBG] pgmap v400: 158 pgs: 158 active+clean; 5.3 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 1.3 KiB/s rd, 88 MiB/s wr, 1.42k op/s 2024-02-10T08:25:36.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:34.757671+0000 osd.5 (osd.5) 101 : cluster [DBG] 6.19 scrub starts 2024-02-10T08:25:36.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:34.794242+0000 osd.5 (osd.5) 102 : cluster [DBG] 6.19 scrub ok 2024-02-10T08:25:36.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:34.943324+0000 mon.a (mon.0) 1135 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-10T08:25:36.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:34.943357+0000 mon.a (mon.0) 1136 : cluster [INF] Cluster is now healthy 2024-02-10T08:25:36.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:25:34.964857+0000 mon.a (mon.0) 1137 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-10T08:25:36.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:34.964932+0000 mon.a (mon.0) 1138 : cluster [DBG] osdmap e213: 8 total, 8 up, 8 in 2024-02-10T08:25:36.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:35.167082+0000 osd.6 (osd.6) 73 : cluster [DBG] 5.2 scrub starts 2024-02-10T08:25:36.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:35.177644+0000 osd.6 (osd.6) 74 : cluster [DBG] 5.2 scrub ok 2024-02-10T08:25:36.354 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 59 16 90966 90950 96.3046 73.1875 0.0103297 0.0103791 2024-02-10T08:25:36.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:34.260485+0000 osd.2 (osd.2) 91 : cluster [DBG] 5.6 scrub starts 2024-02-10T08:25:36.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:34.266209+0000 osd.2 (osd.2) 92 : cluster [DBG] 5.6 scrub ok 2024-02-10T08:25:36.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:34.721499+0000 mgr.y (mgr.14505) 336 : cluster [DBG] pgmap v400: 158 pgs: 158 active+clean; 5.3 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 1.3 KiB/s rd, 88 MiB/s wr, 1.42k op/s 2024-02-10T08:25:36.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:34.757671+0000 osd.5 (osd.5) 101 : cluster [DBG] 6.19 scrub starts 2024-02-10T08:25:36.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:34.794242+0000 osd.5 (osd.5) 102 : cluster [DBG] 6.19 scrub ok 2024-02-10T08:25:36.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:34.943324+0000 mon.a (mon.0) 1135 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-10T08:25:36.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:34.943357+0000 mon.a (mon.0) 1136 : cluster [INF] Cluster is now healthy 2024-02-10T08:25:36.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:25:34.964857+0000 mon.a (mon.0) 1137 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-10T08:25:36.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:34.964932+0000 mon.a (mon.0) 1138 : cluster [DBG] osdmap e213: 8 total, 8 up, 8 in 2024-02-10T08:25:36.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:35.167082+0000 osd.6 (osd.6) 73 : cluster [DBG] 5.2 scrub starts 2024-02-10T08:25:36.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:35.177644+0000 osd.6 (osd.6) 74 : cluster [DBG] 5.2 scrub ok 2024-02-10T08:25:36.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:34.260485+0000 osd.2 (osd.2) 91 : cluster [DBG] 5.6 scrub starts 2024-02-10T08:25:36.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:34.266209+0000 osd.2 (osd.2) 92 : cluster [DBG] 5.6 scrub ok 2024-02-10T08:25:36.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:34.721499+0000 mgr.y (mgr.14505) 336 : cluster [DBG] pgmap v400: 158 pgs: 158 active+clean; 5.3 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 1.3 KiB/s rd, 88 MiB/s wr, 1.42k op/s 2024-02-10T08:25:36.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:34.757671+0000 osd.5 (osd.5) 101 : cluster [DBG] 6.19 scrub starts 2024-02-10T08:25:36.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:34.794242+0000 osd.5 (osd.5) 102 : cluster [DBG] 6.19 scrub ok 2024-02-10T08:25:36.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:34.943324+0000 mon.a (mon.0) 1135 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-10T08:25:36.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:34.943357+0000 mon.a (mon.0) 1136 : cluster [INF] Cluster is now healthy 2024-02-10T08:25:36.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:25:34.964857+0000 mon.a (mon.0) 1137 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-10T08:25:36.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:34.964932+0000 mon.a (mon.0) 1138 : cluster [DBG] osdmap e213: 8 total, 8 up, 8 in 2024-02-10T08:25:36.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:35.167082+0000 osd.6 (osd.6) 73 : cluster [DBG] 5.2 scrub starts 2024-02-10T08:25:36.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:35.177644+0000 osd.6 (osd.6) 74 : cluster [DBG] 5.2 scrub ok 2024-02-10T08:25:36.721 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:25:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:25:36] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:25:36.965 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:25:36.971 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:36.972 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:25:36.998 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:35.269267+0000 osd.2 (osd.2) 93 : cluster [DBG] 2.e scrub starts 2024-02-10T08:25:36.998 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:35.271386+0000 osd.2 (osd.2) 94 : cluster [DBG] 2.e scrub ok 2024-02-10T08:25:36.999 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:35.399602+0000 osd.7 (osd.7) 109 : cluster [DBG] 4.11 scrub starts 2024-02-10T08:25:36.999 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:35.410085+0000 osd.7 (osd.7) 110 : cluster [DBG] 4.11 scrub ok 2024-02-10T08:25:36.999 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:35.794531+0000 osd.5 (osd.5) 103 : cluster [DBG] 2.16 scrub starts 2024-02-10T08:25:36.999 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:35.807012+0000 osd.5 (osd.5) 104 : cluster [DBG] 2.16 scrub ok 2024-02-10T08:25:36.999 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:36.156800+0000 osd.6 (osd.6) 75 : cluster [DBG] 6.13 scrub starts 2024-02-10T08:25:36.999 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:36.186015+0000 osd.6 (osd.6) 76 : cluster [DBG] 6.13 scrub ok 2024-02-10T08:25:37.070 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-02-10T08:25:37.070 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:25:37.073 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:25:37.137 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:35.269267+0000 osd.2 (osd.2) 93 : cluster [DBG] 2.e scrub starts 2024-02-10T08:25:37.137 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:35.271386+0000 osd.2 (osd.2) 94 : cluster [DBG] 2.e scrub ok 2024-02-10T08:25:37.137 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:35.399602+0000 osd.7 (osd.7) 109 : cluster [DBG] 4.11 scrub starts 2024-02-10T08:25:37.137 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:35.410085+0000 osd.7 (osd.7) 110 : cluster [DBG] 4.11 scrub ok 2024-02-10T08:25:37.137 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:35.794531+0000 osd.5 (osd.5) 103 : cluster [DBG] 2.16 scrub starts 2024-02-10T08:25:37.138 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:35.807012+0000 osd.5 (osd.5) 104 : cluster [DBG] 2.16 scrub ok 2024-02-10T08:25:37.138 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:36.156800+0000 osd.6 (osd.6) 75 : cluster [DBG] 6.13 scrub starts 2024-02-10T08:25:37.138 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:36.186015+0000 osd.6 (osd.6) 76 : cluster [DBG] 6.13 scrub ok 2024-02-10T08:25:37.138 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:35.269267+0000 osd.2 (osd.2) 93 : cluster [DBG] 2.e scrub starts 2024-02-10T08:25:37.138 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:35.271386+0000 osd.2 (osd.2) 94 : cluster [DBG] 2.e scrub ok 2024-02-10T08:25:37.138 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:35.399602+0000 osd.7 (osd.7) 109 : cluster [DBG] 4.11 scrub starts 2024-02-10T08:25:37.138 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:35.410085+0000 osd.7 (osd.7) 110 : cluster [DBG] 4.11 scrub ok 2024-02-10T08:25:37.138 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:35.794531+0000 osd.5 (osd.5) 103 : cluster [DBG] 2.16 scrub starts 2024-02-10T08:25:37.138 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:35.807012+0000 osd.5 (osd.5) 104 : cluster [DBG] 2.16 scrub ok 2024-02-10T08:25:37.138 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:36.156800+0000 osd.6 (osd.6) 75 : cluster [DBG] 6.13 scrub starts 2024-02-10T08:25:37.138 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:36.186015+0000 osd.6 (osd.6) 76 : cluster [DBG] 6.13 scrub ok 2024-02-10T08:25:37.145 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:37.181 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:25:37.190 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:37.190 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:25:37.291 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:25:37.345 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:37.355 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:2024-02-10T08:25:37.355055+0000 min lat: 0.00125956 max lat: 0.474095 avg lat: 0.010424 2024-02-10T08:25:37.355 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-02-10T08:25:37.355 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 60 16 92103 92087 95.8826 71.0625 0.016172 0.010424 2024-02-10T08:25:37.374 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:25:37.378 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:37.379 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:25:37.404 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:25:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:25:37] "GET /metrics HTTP/1.1" 200 175939 "" "Prometheus/2.33.4" 2024-02-10T08:25:37.480 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:25:37.542 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:37.660 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:25:37.665 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:37.666 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:25:37.706 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:25:37.744 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:25:37.767 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:25:37.779 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:25:37.815 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:25:37.820 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:37.858 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:25:37.886 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:25:37.892 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:25:37.892 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:37.893 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:25:37.909 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.7 dump_blocked_ops 2024-02-10T08:25:37.931 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:25:37.976 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:25:37.978 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-10T08:25:37.979 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-10T08:25:37.979 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-10T08:25:37.979 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-10T08:25:37.979 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-10T08:25:37.979 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-10T08:25:37.979 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-10T08:25:37.979 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-10T08:25:37.993 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:25:38.062 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:38.065 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:36.721887+0000 mgr.y (mgr.14505) 337 : cluster [DBG] pgmap v402: 158 pgs: 158 active+clean; 5.3 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 841 B/s rd, 58 MiB/s wr, 929 op/s 2024-02-10T08:25:38.065 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:36.917919+0000 osd.1 (osd.1) 106 : cluster [DBG] 5.5 scrub starts 2024-02-10T08:25:38.065 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:36.924998+0000 osd.1 (osd.1) 107 : cluster [DBG] 5.5 scrub ok 2024-02-10T08:25:38.065 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:37.123866+0000 osd.6 (osd.6) 77 : cluster [DBG] 4.a scrub starts 2024-02-10T08:25:38.065 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:37.130507+0000 osd.6 (osd.6) 78 : cluster [DBG] 4.a scrub ok 2024-02-10T08:25:38.065 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:37.367283+0000 osd.7 (osd.7) 111 : cluster [DBG] 2.8 scrub starts 2024-02-10T08:25:38.065 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:37.371535+0000 osd.7 (osd.7) 112 : cluster [DBG] 2.8 scrub ok 2024-02-10T08:25:38.065 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:25:37.664783+0000 mon.b (mon.1) 56 : audit [DBG] from='client.? 172.21.15.18:0/3689800276' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:25:38.066 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:25:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:25:38.091 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:25:38.097 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:38.097 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:25:38.198 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:25:38.256 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:36.721887+0000 mgr.y (mgr.14505) 337 : cluster [DBG] pgmap v402: 158 pgs: 158 active+clean; 5.3 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 841 B/s rd, 58 MiB/s wr, 929 op/s 2024-02-10T08:25:38.256 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:36.917919+0000 osd.1 (osd.1) 106 : cluster [DBG] 5.5 scrub starts 2024-02-10T08:25:38.256 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:36.924998+0000 osd.1 (osd.1) 107 : cluster [DBG] 5.5 scrub ok 2024-02-10T08:25:38.256 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:37.123866+0000 osd.6 (osd.6) 77 : cluster [DBG] 4.a scrub starts 2024-02-10T08:25:38.256 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:37.130507+0000 osd.6 (osd.6) 78 : cluster [DBG] 4.a scrub ok 2024-02-10T08:25:38.256 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:37.367283+0000 osd.7 (osd.7) 111 : cluster [DBG] 2.8 scrub starts 2024-02-10T08:25:38.256 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:37.371535+0000 osd.7 (osd.7) 112 : cluster [DBG] 2.8 scrub ok 2024-02-10T08:25:38.256 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:25:37.664783+0000 mon.b (mon.1) 56 : audit [DBG] from='client.? 172.21.15.18:0/3689800276' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:25:38.256 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:38.260 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:36.721887+0000 mgr.y (mgr.14505) 337 : cluster [DBG] pgmap v402: 158 pgs: 158 active+clean; 5.3 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 841 B/s rd, 58 MiB/s wr, 929 op/s 2024-02-10T08:25:38.260 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:36.917919+0000 osd.1 (osd.1) 106 : cluster [DBG] 5.5 scrub starts 2024-02-10T08:25:38.260 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:36.924998+0000 osd.1 (osd.1) 107 : cluster [DBG] 5.5 scrub ok 2024-02-10T08:25:38.260 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:37.123866+0000 osd.6 (osd.6) 77 : cluster [DBG] 4.a scrub starts 2024-02-10T08:25:38.260 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:37.130507+0000 osd.6 (osd.6) 78 : cluster [DBG] 4.a scrub ok 2024-02-10T08:25:38.260 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:37.367283+0000 osd.7 (osd.7) 111 : cluster [DBG] 2.8 scrub starts 2024-02-10T08:25:38.260 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:37.371535+0000 osd.7 (osd.7) 112 : cluster [DBG] 2.8 scrub ok 2024-02-10T08:25:38.260 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:25:37.664783+0000 mon.b (mon.1) 56 : audit [DBG] from='client.? 172.21.15.18:0/3689800276' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:25:38.356 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 61 16 93184 93168 95.4157 67.5625 0.015164 0.0104757 2024-02-10T08:25:38.379 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:25:38.727 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:25:38.737 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:38.738 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:25:38.838 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:25:38.854 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd set noscrub 2024-02-10T08:25:38.907 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:39.027 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:25:37.977642+0000 mgr.y (mgr.14505) 338 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:25:39.028 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:38.126023+0000 osd.4 (osd.4) 24 : cluster [DBG] 2.f scrub starts 2024-02-10T08:25:39.028 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:38.137699+0000 osd.4 (osd.4) 25 : cluster [DBG] 2.f scrub ok 2024-02-10T08:25:39.293 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:25:37.977642+0000 mgr.y (mgr.14505) 338 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:25:39.294 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:38.126023+0000 osd.4 (osd.4) 24 : cluster [DBG] 2.f scrub starts 2024-02-10T08:25:39.294 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:38.137699+0000 osd.4 (osd.4) 25 : cluster [DBG] 2.f scrub ok 2024-02-10T08:25:39.356 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 62 16 94248 94232 94.9494 66.5 0.0133167 0.0105272 2024-02-10T08:25:39.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:25:37.977642+0000 mgr.y (mgr.14505) 338 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:25:39.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:38.126023+0000 osd.4 (osd.4) 24 : cluster [DBG] 2.f scrub starts 2024-02-10T08:25:39.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:38.137699+0000 osd.4 (osd.4) 25 : cluster [DBG] 2.f scrub ok 2024-02-10T08:25:39.783 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:25:39.791 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:39.792 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:25:39.893 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:25:39.941 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:40.034 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:38.722775+0000 mgr.y (mgr.14505) 339 : cluster [DBG] pgmap v403: 158 pgs: 158 active+clean; 5.6 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 1.2 KiB/s rd, 81 MiB/s wr, 1.30k op/s 2024-02-10T08:25:40.034 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:38.725849+0000 osd.5 (osd.5) 105 : cluster [DBG] 5.16 scrub starts 2024-02-10T08:25:40.034 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:38.730939+0000 osd.5 (osd.5) 106 : cluster [DBG] 5.16 scrub ok 2024-02-10T08:25:40.034 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:39.152251+0000 osd.4 (osd.4) 26 : cluster [DBG] 4.1 scrub starts 2024-02-10T08:25:40.034 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:39.155456+0000 osd.4 (osd.4) 27 : cluster [DBG] 4.1 scrub ok 2024-02-10T08:25:40.034 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:39.161788+0000 osd.6 (osd.6) 79 : cluster [DBG] 2.7 scrub starts 2024-02-10T08:25:40.034 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:39.170694+0000 osd.6 (osd.6) 80 : cluster [DBG] 2.7 scrub ok 2024-02-10T08:25:40.184 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:38.722775+0000 mgr.y (mgr.14505) 339 : cluster [DBG] pgmap v403: 158 pgs: 158 active+clean; 5.6 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 1.2 KiB/s rd, 81 MiB/s wr, 1.30k op/s 2024-02-10T08:25:40.184 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:38.725849+0000 osd.5 (osd.5) 105 : cluster [DBG] 5.16 scrub starts 2024-02-10T08:25:40.184 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:38.730939+0000 osd.5 (osd.5) 106 : cluster [DBG] 5.16 scrub ok 2024-02-10T08:25:40.184 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:39.152251+0000 osd.4 (osd.4) 26 : cluster [DBG] 4.1 scrub starts 2024-02-10T08:25:40.184 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:39.155456+0000 osd.4 (osd.4) 27 : cluster [DBG] 4.1 scrub ok 2024-02-10T08:25:40.184 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:39.161788+0000 osd.6 (osd.6) 79 : cluster [DBG] 2.7 scrub starts 2024-02-10T08:25:40.184 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:39.170694+0000 osd.6 (osd.6) 80 : cluster [DBG] 2.7 scrub ok 2024-02-10T08:25:40.191 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph tell osd.1 reset_purged_snaps_last 2024-02-10T08:25:40.206 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:25:40.209 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:40.210 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:25:40.311 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:25:40.312 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:38.722775+0000 mgr.y (mgr.14505) 339 : cluster [DBG] pgmap v403: 158 pgs: 158 active+clean; 5.6 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 1.2 KiB/s rd, 81 MiB/s wr, 1.30k op/s 2024-02-10T08:25:40.313 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:38.725849+0000 osd.5 (osd.5) 105 : cluster [DBG] 5.16 scrub starts 2024-02-10T08:25:40.313 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:38.730939+0000 osd.5 (osd.5) 106 : cluster [DBG] 5.16 scrub ok 2024-02-10T08:25:40.313 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:39.152251+0000 osd.4 (osd.4) 26 : cluster [DBG] 4.1 scrub starts 2024-02-10T08:25:40.313 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:39.155456+0000 osd.4 (osd.4) 27 : cluster [DBG] 4.1 scrub ok 2024-02-10T08:25:40.313 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:39.161788+0000 osd.6 (osd.6) 79 : cluster [DBG] 2.7 scrub starts 2024-02-10T08:25:40.313 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:39.170694+0000 osd.6 (osd.6) 80 : cluster [DBG] 2.7 scrub ok 2024-02-10T08:25:40.356 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 63 16 95400 95384 94.5852 72 0.0153481 0.0105668 2024-02-10T08:25:40.374 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:40.424 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:25:40.428 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:40.428 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:25:40.508 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-02-10T08:25:40.508 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-02-10T08:25:40.508 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-02-10T08:25:40.509 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-02-10T08:25:40.509 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-02-10T08:25:40.529 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:25:40.544 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:25:40.656 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:40.875 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:25:40.878 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:40.878 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:25:40.979 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:25:41.061 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:41.119 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:25:41.131 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:41.132 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:25:41.233 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:25:41.273 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:41 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:40.103471+0000 osd.4 (osd.4) 28 : cluster [DBG] 4.18 scrub starts 2024-02-10T08:25:41.273 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:41 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:40.109812+0000 osd.4 (osd.4) 29 : cluster [DBG] 4.18 scrub ok 2024-02-10T08:25:41.273 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:41 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:40.117858+0000 osd.6 (osd.6) 81 : cluster [DBG] 6.c scrub starts 2024-02-10T08:25:41.273 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:41 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:40.120774+0000 osd.6 (osd.6) 82 : cluster [DBG] 6.c scrub ok 2024-02-10T08:25:41.277 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:41.357 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 64 16 96411 96395 94.0945 63.1875 0.0152289 0.0106232 2024-02-10T08:25:41.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:40.103471+0000 osd.4 (osd.4) 28 : cluster [DBG] 4.18 scrub starts 2024-02-10T08:25:41.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:40.109812+0000 osd.4 (osd.4) 29 : cluster [DBG] 4.18 scrub ok 2024-02-10T08:25:41.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:40.117858+0000 osd.6 (osd.6) 81 : cluster [DBG] 6.c scrub starts 2024-02-10T08:25:41.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:40.120774+0000 osd.6 (osd.6) 82 : cluster [DBG] 6.c scrub ok 2024-02-10T08:25:41.407 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:40.103471+0000 osd.4 (osd.4) 28 : cluster [DBG] 4.18 scrub starts 2024-02-10T08:25:41.407 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:40.109812+0000 osd.4 (osd.4) 29 : cluster [DBG] 4.18 scrub ok 2024-02-10T08:25:41.407 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:40.117858+0000 osd.6 (osd.6) 81 : cluster [DBG] 6.c scrub starts 2024-02-10T08:25:41.407 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:40.120774+0000 osd.6 (osd.6) 82 : cluster [DBG] 6.c scrub ok 2024-02-10T08:25:41.423 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:25:41.433 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:41.434 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:25:41.451 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.7 dump_historic_ops 2024-02-10T08:25:41.533 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:25:41.535 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:25:41.611 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:41.915 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:25:42.027 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:25:42.033 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:42.033 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:25:42.134 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:25:42.188 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:42.343 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-10T08:25:42.350 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:25:42.353 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:42.354 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:25:42.354 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:40.723350+0000 mgr.y (mgr.14505) 340 : cluster [DBG] pgmap v404: 158 pgs: 158 active+clean; 5.7 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 639 B/s rd, 56 MiB/s wr, 890 op/s 2024-02-10T08:25:42.354 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:41.132456+0000 osd.0 (osd.0) 102 : cluster [DBG] 3.1 scrub starts 2024-02-10T08:25:42.354 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:41.136359+0000 osd.0 (osd.0) 103 : cluster [DBG] 3.1 scrub ok 2024-02-10T08:25:42.354 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:41.318933+0000 osd.7 (osd.7) 113 : cluster [DBG] 2.1c scrub starts 2024-02-10T08:25:42.354 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:41.322486+0000 osd.7 (osd.7) 114 : cluster [DBG] 2.1c scrub ok 2024-02-10T08:25:42.355 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:40.723350+0000 mgr.y (mgr.14505) 340 : cluster [DBG] pgmap v404: 158 pgs: 158 active+clean; 5.7 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 639 B/s rd, 56 MiB/s wr, 890 op/s 2024-02-10T08:25:42.355 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:41.132456+0000 osd.0 (osd.0) 102 : cluster [DBG] 3.1 scrub starts 2024-02-10T08:25:42.355 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:41.136359+0000 osd.0 (osd.0) 103 : cluster [DBG] 3.1 scrub ok 2024-02-10T08:25:42.355 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:41.318933+0000 osd.7 (osd.7) 113 : cluster [DBG] 2.1c scrub starts 2024-02-10T08:25:42.355 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:41.322486+0000 osd.7 (osd.7) 114 : cluster [DBG] 2.1c scrub ok 2024-02-10T08:25:42.357 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 65 16 97515 97499 93.7085 69 0.00755188 0.0106659 2024-02-10T08:25:42.455 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:25:42.504 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:40.723350+0000 mgr.y (mgr.14505) 340 : cluster [DBG] pgmap v404: 158 pgs: 158 active+clean; 5.7 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 639 B/s rd, 56 MiB/s wr, 890 op/s 2024-02-10T08:25:42.504 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:41.132456+0000 osd.0 (osd.0) 102 : cluster [DBG] 3.1 scrub starts 2024-02-10T08:25:42.504 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:41.136359+0000 osd.0 (osd.0) 103 : cluster [DBG] 3.1 scrub ok 2024-02-10T08:25:42.504 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:41.318933+0000 osd.7 (osd.7) 113 : cluster [DBG] 2.1c scrub starts 2024-02-10T08:25:42.504 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:41.322486+0000 osd.7 (osd.7) 114 : cluster [DBG] 2.1c scrub ok 2024-02-10T08:25:42.524 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:42.563 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:25:42.572 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:42.573 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:25:42.674 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:25:42.730 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:42.865 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:25:42.871 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:42.871 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:25:42.972 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:25:43.017 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:43.058 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:41.751001+0000 osd.5 (osd.5) 107 : cluster [DBG] 2.2 scrub starts 2024-02-10T08:25:43.059 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:41.756262+0000 osd.5 (osd.5) 108 : cluster [DBG] 2.2 scrub ok 2024-02-10T08:25:43.059 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:42.025743+0000 osd.1 (osd.1) 108 : cluster [DBG] 2.d scrub starts 2024-02-10T08:25:43.059 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:42.035490+0000 osd.1 (osd.1) 109 : cluster [DBG] 2.d scrub ok 2024-02-10T08:25:43.059 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:42.123478+0000 osd.6 (osd.6) 83 : cluster [DBG] 2.19 deep-scrub starts 2024-02-10T08:25:43.059 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:42.124904+0000 osd.6 (osd.6) 84 : cluster [DBG] 2.19 deep-scrub ok 2024-02-10T08:25:43.263 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:43 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:41.751001+0000 osd.5 (osd.5) 107 : cluster [DBG] 2.2 scrub starts 2024-02-10T08:25:43.263 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:43 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:41.756262+0000 osd.5 (osd.5) 108 : cluster [DBG] 2.2 scrub ok 2024-02-10T08:25:43.263 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:43 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:42.025743+0000 osd.1 (osd.1) 108 : cluster [DBG] 2.d scrub starts 2024-02-10T08:25:43.263 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:43 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:42.035490+0000 osd.1 (osd.1) 109 : cluster [DBG] 2.d scrub ok 2024-02-10T08:25:43.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:43 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:42.123478+0000 osd.6 (osd.6) 83 : cluster [DBG] 2.19 deep-scrub starts 2024-02-10T08:25:43.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:43 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:42.124904+0000 osd.6 (osd.6) 84 : cluster [DBG] 2.19 deep-scrub ok 2024-02-10T08:25:43.282 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:25:43.292 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:43.292 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:25:43.360 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 66 16 98492 98476 93.2139 61.0625 0.00903315 0.0107237 2024-02-10T08:25:43.393 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:25:43.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:41.751001+0000 osd.5 (osd.5) 107 : cluster [DBG] 2.2 scrub starts 2024-02-10T08:25:43.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:41.756262+0000 osd.5 (osd.5) 108 : cluster [DBG] 2.2 scrub ok 2024-02-10T08:25:43.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:42.025743+0000 osd.1 (osd.1) 108 : cluster [DBG] 2.d scrub starts 2024-02-10T08:25:43.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:42.035490+0000 osd.1 (osd.1) 109 : cluster [DBG] 2.d scrub ok 2024-02-10T08:25:43.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:42.123478+0000 osd.6 (osd.6) 83 : cluster [DBG] 2.19 deep-scrub starts 2024-02-10T08:25:43.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:42.124904+0000 osd.6 (osd.6) 84 : cluster [DBG] 2.19 deep-scrub ok 2024-02-10T08:25:43.437 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:43.478 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:25:43.483 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:43.483 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:25:43.584 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:25:43.641 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:43.682 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:25:43.690 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:43.690 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:25:43.791 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:25:43.850 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:43.984 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-02-10T08:25:43.985 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-02-10T08:25:43.985 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-02-10T08:25:43.985 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-02-10T08:25:43.985 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:43.985 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.24299.0:675 5.9 5:93e5b521:::notify.7:head [watch reconnect cookie 94587203968896 gen 1] snapc 0=[] ondisk+write+known_if_redirected e88)", 2024-02-10T08:25:43.985 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:19:30.798313+0000", 2024-02-10T08:25:43.985 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 373.18235558200001, 2024-02-10T08:25:43.985 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.014984294, 2024-02-10T08:25:43.985 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:25:43.985 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-02-10T08:25:43.985 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:25:43.985 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.24299", 2024-02-10T08:25:43.985 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/871408063", 2024-02-10T08:25:43.986 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 675 2024-02-10T08:25:43.986 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:43.986 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:25:43.986 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:43.986 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:25:43.986 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:30.798313+0000", 2024-02-10T08:25:43.986 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:25:43.986 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:43.986 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:43.986 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:25:43.986 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:30.798313+0000", 2024-02-10T08:25:43.986 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-02-10T08:25:43.986 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:43.986 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:43.986 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:25:43.987 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:30.798311+0000", 2024-02-10T08:25:43.987 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4619999999999996e-06 2024-02-10T08:25:43.987 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:43.987 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:43.987 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:25:43.987 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:30.798320+0000", 2024-02-10T08:25:43.987 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3451e-05 2024-02-10T08:25:43.987 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:43.987 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:43.987 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:25:43.987 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:30.798333+0000", 2024-02-10T08:25:43.987 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0100000000000001e-06 2024-02-10T08:25:43.987 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:43.987 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:43.987 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:25:43.987 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:30.798342+0000", 2024-02-10T08:25:43.987 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7089999999999996e-05 2024-02-10T08:25:43.988 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:43.988 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:43.988 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:25:43.988 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:30.798409+0000", 2024-02-10T08:25:43.988 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.551e-06 2024-02-10T08:25:43.988 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:43.988 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:43.988 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-02-10T08:25:43.988 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:30.798418+0000", 2024-02-10T08:25:43.988 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0066360530000000003 2024-02-10T08:25:43.988 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:43.988 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:43.988 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:25:43.988 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:30.805054+0000", 2024-02-10T08:25:43.989 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6859999999999995e-06 2024-02-10T08:25:43.989 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:43.989 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:43.989 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:25:43.989 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:30.805063+0000", 2024-02-10T08:25:43.989 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.003985567 2024-02-10T08:25:43.989 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:43.989 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:43.989 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:25:43.989 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:31.809048+0000", 2024-02-10T08:25:43.989 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014688 2024-02-10T08:25:43.989 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:43.989 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:43.989 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:25:43.989 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:31.809195+0000", 2024-02-10T08:25:43.990 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0041021629999999998 2024-02-10T08:25:43.990 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:43.990 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:43.990 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:25:43.990 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:31.813297+0000", 2024-02-10T08:25:43.990 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.014984294 2024-02-10T08:25:43.990 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:43.990 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:25:43.990 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:43.990 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:43.990 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:43.990 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.24299.0:684 5.9 5:93e5b521:::notify.7:head [watch ping cookie 94587203968896 gen 1] snapc 0=[] ondisk+write+known_if_redirected e88)", 2024-02-10T08:25:43.990 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:19:30.927556+0000", 2024-02-10T08:25:43.990 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 373.05311286900002, 2024-02-10T08:25:43.990 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.88213612200000002, 2024-02-10T08:25:43.991 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:25:43.991 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-02-10T08:25:43.991 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:25:43.991 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.24299", 2024-02-10T08:25:43.991 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/871408063", 2024-02-10T08:25:43.991 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 684 2024-02-10T08:25:43.991 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:43.991 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:25:43.991 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:43.991 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:25:43.991 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:30.927556+0000", 2024-02-10T08:25:43.991 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:25:43.991 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:43.991 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:43.992 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:25:43.992 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:30.927556+0000", 2024-02-10T08:25:43.992 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-02-10T08:25:43.992 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:43.992 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:43.992 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:25:43.992 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:30.927555+0000", 2024-02-10T08:25:43.992 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.775e-06 2024-02-10T08:25:43.992 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:43.992 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:43.992 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:25:43.992 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:30.927559+0000", 2024-02-10T08:25:43.992 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3250000000000002e-06 2024-02-10T08:25:43.993 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:43.993 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:43.993 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:25:43.993 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:30.927567+0000", 2024-02-10T08:25:43.993 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1640000000000004e-06 2024-02-10T08:25:43.993 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:43.993 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:43.993 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:25:43.993 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:30.927574+0000", 2024-02-10T08:25:43.993 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7911999999999996e-05 2024-02-10T08:25:43.993 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:43.993 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:43.994 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:25:43.994 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:30.927642+0000", 2024-02-10T08:25:43.994 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3049999999999993e-06 2024-02-10T08:25:43.994 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:43.994 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:43.994 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:25:43.994 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:30.927650+0000", 2024-02-10T08:25:43.994 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.88181563699999999 2024-02-10T08:25:43.994 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:43.994 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:43.994 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:25:43.994 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:31.809466+0000", 2024-02-10T08:25:43.994 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3170000000000006e-05 2024-02-10T08:25:43.994 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:43.994 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:43.994 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:25:43.995 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:31.809539+0000", 2024-02-10T08:25:43.995 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015295 2024-02-10T08:25:43.995 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:43.995 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:43.995 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:25:43.995 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:31.809692+0000", 2024-02-10T08:25:43.995 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.88213612200000002 2024-02-10T08:25:43.995 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:43.995 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:25:43.995 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:43.995 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:43.995 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:43.995 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14784.0:29663 7.5 7:ae9fb4dd:::benchmark_data_smithi018_80623_object29662:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e96)", 2024-02-10T08:25:43.995 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:20:03.389040+0000", 2024-02-10T08:25:43.995 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 340.59162848699998, 2024-02-10T08:25:43.996 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.099606389000000004, 2024-02-10T08:25:43.996 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:25:43.996 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:25:43.996 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:25:43.996 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14784", 2024-02-10T08:25:43.996 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:25:43.996 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 29663 2024-02-10T08:25:43.996 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:43.996 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:25:43.996 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:43.996 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:25:43.996 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:03.389040+0000", 2024-02-10T08:25:43.996 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:25:43.996 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:43.997 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:43.997 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:25:43.997 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:03.389040+0000", 2024-02-10T08:25:43.997 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-02-10T08:25:43.997 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:43.997 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:43.997 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:25:43.997 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:03.389039+0000", 2024-02-10T08:25:43.997 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5191000000000001e-05 2024-02-10T08:25:43.997 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:43.997 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:43.997 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:25:43.997 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:03.389094+0000", 2024-02-10T08:25:43.997 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6879999999999994e-06 2024-02-10T08:25:43.997 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:43.997 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:43.998 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:25:43.998 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:03.389104+0000", 2024-02-10T08:25:43.998 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.442e-06 2024-02-10T08:25:43.998 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:43.998 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:43.998 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:25:43.998 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:03.389108+0000", 2024-02-10T08:25:43.998 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1771999999999999e-05 2024-02-10T08:25:43.998 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:43.998 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:43.998 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:25:43.998 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:03.389150+0000", 2024-02-10T08:25:43.998 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013057499999999999 2024-02-10T08:25:43.998 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:43.998 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:43.999 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:25:43.999 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:03.389280+0000", 2024-02-10T08:25:43.999 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014369599999999999 2024-02-10T08:25:43.999 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:43.999 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:43.999 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,2", 2024-02-10T08:25:43.999 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:03.389424+0000", 2024-02-10T08:25:43.999 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001800013 2024-02-10T08:25:43.999 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:43.999 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:43.999 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:25:43.999 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:03.391224+0000", 2024-02-10T08:25:43.999 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00035118500000000001 2024-02-10T08:25:43.999 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:43.999 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.000 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:25:44.000 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:03.391575+0000", 2024-02-10T08:25:44.000 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.096980106999999996 2024-02-10T08:25:44.000 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.000 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.000 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:25:44.000 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:03.488555+0000", 2024-02-10T08:25:44.000 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9839000000000002e-05 2024-02-10T08:25:44.000 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.000 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.000 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:25:44.000 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:03.488605+0000", 2024-02-10T08:25:44.000 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1152999999999997e-05 2024-02-10T08:25:44.000 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.001 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.001 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:25:44.001 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:03.488646+0000", 2024-02-10T08:25:44.001 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.099606389000000004 2024-02-10T08:25:44.001 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:44.001 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:25:44.001 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:44.001 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.001 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.001 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14784.0:29665 7.5 7:a0216f00:::benchmark_data_smithi018_80623_object29664:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e96)", 2024-02-10T08:25:44.001 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:20:03.390247+0000", 2024-02-10T08:25:44.001 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 340.59042161999997, 2024-02-10T08:25:44.001 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.098540717999999999, 2024-02-10T08:25:44.001 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:25:44.001 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:25:44.001 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:25:44.002 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14784", 2024-02-10T08:25:44.002 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:25:44.002 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 29665 2024-02-10T08:25:44.002 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.002 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:25:44.002 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.002 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:25:44.002 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:03.390247+0000", 2024-02-10T08:25:44.002 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:25:44.002 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.002 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.002 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:25:44.002 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:03.390247+0000", 2024-02-10T08:25:44.002 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-02-10T08:25:44.002 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.002 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.003 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:25:44.003 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:03.390246+0000", 2024-02-10T08:25:44.003 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9740000000000001e-05 2024-02-10T08:25:44.003 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.003 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.003 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:25:44.003 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:03.390305+0000", 2024-02-10T08:25:44.003 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1922999999999999e-05 2024-02-10T08:25:44.003 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.003 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.003 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:25:44.003 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:03.390317+0000", 2024-02-10T08:25:44.003 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.516e-06 2024-02-10T08:25:44.003 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.003 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.004 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:25:44.004 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:03.390324+0000", 2024-02-10T08:25:44.004 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0418000000000002e-05 2024-02-10T08:25:44.004 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.004 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.004 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:25:44.004 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:03.390394+0000", 2024-02-10T08:25:44.004 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010226900000000001 2024-02-10T08:25:44.004 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.004 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.004 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:25:44.004 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:03.390497+0000", 2024-02-10T08:25:44.004 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000100309 2024-02-10T08:25:44.004 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.004 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.005 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,2", 2024-02-10T08:25:44.005 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:03.390597+0000", 2024-02-10T08:25:44.005 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00073528999999999999 2024-02-10T08:25:44.005 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.005 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.005 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:25:44.005 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:03.391332+0000", 2024-02-10T08:25:44.005 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000379606 2024-02-10T08:25:44.005 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.005 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.005 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:25:44.005 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:03.391712+0000", 2024-02-10T08:25:44.005 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.096996507999999995 2024-02-10T08:25:44.005 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.005 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.005 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:25:44.006 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:03.488708+0000", 2024-02-10T08:25:44.006 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4997999999999998e-05 2024-02-10T08:25:44.006 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.006 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.006 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:25:44.006 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:03.488753+0000", 2024-02-10T08:25:44.006 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4379999999999999e-05 2024-02-10T08:25:44.006 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.006 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.006 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:25:44.006 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:03.488788+0000", 2024-02-10T08:25:44.006 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.098540717999999999 2024-02-10T08:25:44.006 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:44.006 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:25:44.006 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:44.007 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.007 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.007 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14784.0:37318 7.5 7:ac4469da:::benchmark_data_smithi018_80623_object37317:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e97)", 2024-02-10T08:25:44.007 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:20:08.130291+0000", 2024-02-10T08:25:44.007 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 335.85037708800002, 2024-02-10T08:25:44.007 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.083977012000000004, 2024-02-10T08:25:44.007 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:25:44.007 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:25:44.007 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:25:44.007 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14784", 2024-02-10T08:25:44.007 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:25:44.007 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 37318 2024-02-10T08:25:44.007 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.007 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:25:44.007 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.007 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:25:44.008 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:08.130291+0000", 2024-02-10T08:25:44.008 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:25:44.008 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.008 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.008 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:25:44.008 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:08.130291+0000", 2024-02-10T08:25:44.008 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-02-10T08:25:44.008 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.008 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.008 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:25:44.008 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:08.130290+0000", 2024-02-10T08:25:44.008 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0000999999999995e-05 2024-02-10T08:25:44.008 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.008 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.008 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:25:44.009 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:08.130370+0000", 2024-02-10T08:25:44.009 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6569999999999997e-06 2024-02-10T08:25:44.009 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.009 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.009 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:25:44.009 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:08.130378+0000", 2024-02-10T08:25:44.009 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.07e-06 2024-02-10T08:25:44.009 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.009 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.009 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:25:44.009 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:08.130382+0000", 2024-02-10T08:25:44.009 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0963999999999997e-05 2024-02-10T08:25:44.009 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.009 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.010 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:25:44.010 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:08.130413+0000", 2024-02-10T08:25:44.010 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000134256 2024-02-10T08:25:44.010 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.010 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.010 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:25:44.010 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:08.130547+0000", 2024-02-10T08:25:44.010 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016807899999999999 2024-02-10T08:25:44.010 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.010 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.010 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,2", 2024-02-10T08:25:44.010 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:08.130715+0000", 2024-02-10T08:25:44.010 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0021556890000000001 2024-02-10T08:25:44.010 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.011 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.011 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:25:44.011 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:08.132871+0000", 2024-02-10T08:25:44.011 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.078073339000000005 2024-02-10T08:25:44.011 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.011 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.011 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:25:44.011 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:08.210944+0000", 2024-02-10T08:25:44.011 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0032684369999999999 2024-02-10T08:25:44.011 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.011 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.011 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:25:44.011 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:08.214213+0000", 2024-02-10T08:25:44.011 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2567999999999997e-05 2024-02-10T08:25:44.011 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.012 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.012 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:25:44.012 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:08.214245+0000", 2024-02-10T08:25:44.012 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3057999999999998e-05 2024-02-10T08:25:44.012 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.012 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.012 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:25:44.012 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:08.214268+0000", 2024-02-10T08:25:44.012 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.083977012000000004 2024-02-10T08:25:44.012 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:44.012 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:25:44.012 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:44.012 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.012 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.013 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14784.0:77148 7.5 7:ae66253b:::benchmark_data_smithi018_80623_object77147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e107)", 2024-02-10T08:25:44.013 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:20:42.077800+0000", 2024-02-10T08:25:44.013 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 301.90286870300002, 2024-02-10T08:25:44.013 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.085503454000000007, 2024-02-10T08:25:44.013 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:25:44.013 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:25:44.013 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:25:44.013 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14784", 2024-02-10T08:25:44.013 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:25:44.013 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 77148 2024-02-10T08:25:44.013 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.013 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:25:44.013 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.013 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:25:44.013 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:42.077800+0000", 2024-02-10T08:25:44.014 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:25:44.014 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.014 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.014 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:25:44.014 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:42.077800+0000", 2024-02-10T08:25:44.014 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-02-10T08:25:44.014 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.014 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.014 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:25:44.014 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:42.077798+0000", 2024-02-10T08:25:44.014 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9882000000000001e-05 2024-02-10T08:25:44.014 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.014 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.014 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:25:44.015 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:42.077848+0000", 2024-02-10T08:25:44.015 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3825999999999999e-05 2024-02-10T08:25:44.015 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.015 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.015 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:25:44.015 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:42.077862+0000", 2024-02-10T08:25:44.015 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6830000000000002e-06 2024-02-10T08:25:44.015 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.015 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.015 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:25:44.015 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:42.077869+0000", 2024-02-10T08:25:44.015 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7063e-05 2024-02-10T08:25:44.015 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.015 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.016 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:25:44.016 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:42.077916+0000", 2024-02-10T08:25:44.016 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000142905 2024-02-10T08:25:44.016 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.016 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.016 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:25:44.016 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:42.078059+0000", 2024-02-10T08:25:44.016 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012934099999999999 2024-02-10T08:25:44.016 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.016 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.016 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,2", 2024-02-10T08:25:44.016 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:42.078188+0000", 2024-02-10T08:25:44.016 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001957271 2024-02-10T08:25:44.016 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.017 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.017 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:25:44.017 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:42.080145+0000", 2024-02-10T08:25:44.017 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000202597 2024-02-10T08:25:44.017 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.017 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.017 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:25:44.017 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:42.080348+0000", 2024-02-10T08:25:44.017 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.082893627999999997 2024-02-10T08:25:44.017 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.017 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.017 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:25:44.017 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:42.163242+0000", 2024-02-10T08:25:44.017 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5785999999999999e-05 2024-02-10T08:25:44.017 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.017 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.017 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:25:44.018 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:42.163277+0000", 2024-02-10T08:25:44.018 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5964000000000001e-05 2024-02-10T08:25:44.018 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.018 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.018 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:25:44.018 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:42.163303+0000", 2024-02-10T08:25:44.018 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.085503454000000007 2024-02-10T08:25:44.018 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:44.018 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:25:44.018 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:44.018 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.018 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.018 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14784.0:111550 7.5 7:aa8a89c4:::benchmark_data_smithi018_80623_object10622:head [delete] snapc 0=[] ondisk+write+known_if_redirected e125)", 2024-02-10T08:25:44.018 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:21:36.363914+0000", 2024-02-10T08:25:44.018 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 247.616754837, 2024-02-10T08:25:44.019 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.080075859999999999, 2024-02-10T08:25:44.019 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:25:44.019 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:25:44.019 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:25:44.019 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14784", 2024-02-10T08:25:44.019 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:25:44.019 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 111550 2024-02-10T08:25:44.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.019 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:25:44.019 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.019 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:25:44.019 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:21:36.363914+0000", 2024-02-10T08:25:44.019 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:25:44.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.019 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.020 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:25:44.020 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:21:36.363914+0000", 2024-02-10T08:25:44.020 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999981 2024-02-10T08:25:44.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.020 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.020 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:25:44.020 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:21:36.363912+0000", 2024-02-10T08:25:44.020 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6130000000000004e-06 2024-02-10T08:25:44.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.020 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.020 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:25:44.020 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:21:36.363920+0000", 2024-02-10T08:25:44.020 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1619e-05 2024-02-10T08:25:44.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.021 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:25:44.021 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:21:36.363932+0000", 2024-02-10T08:25:44.021 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9410000000000001e-06 2024-02-10T08:25:44.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.021 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:25:44.021 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:21:36.363939+0000", 2024-02-10T08:25:44.021 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3260999999999998e-05 2024-02-10T08:25:44.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.021 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:25:44.021 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:21:36.363982+0000", 2024-02-10T08:25:44.021 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7929000000000005e-05 2024-02-10T08:25:44.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.022 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.022 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:25:44.022 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:21:36.364070+0000", 2024-02-10T08:25:44.022 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013379399999999999 2024-02-10T08:25:44.022 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.022 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.022 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,2", 2024-02-10T08:25:44.022 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:21:36.364204+0000", 2024-02-10T08:25:44.022 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0038401780000000001 2024-02-10T08:25:44.022 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.022 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.022 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:25:44.022 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:21:36.368044+0000", 2024-02-10T08:25:44.022 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022845909999999999 2024-02-10T08:25:44.022 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.022 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.023 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:25:44.023 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:21:36.370329+0000", 2024-02-10T08:25:44.023 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.073570398999999995 2024-02-10T08:25:44.023 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.023 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.023 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:25:44.023 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:21:36.443899+0000", 2024-02-10T08:25:44.023 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0194000000000001e-05 2024-02-10T08:25:44.023 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.023 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.023 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:25:44.023 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:21:36.443949+0000", 2024-02-10T08:25:44.023 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0333000000000002e-05 2024-02-10T08:25:44.024 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.024 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.024 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:25:44.024 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:21:36.443990+0000", 2024-02-10T08:25:44.024 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.080075859999999999 2024-02-10T08:25:44.024 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:44.024 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:25:44.024 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:44.024 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.024 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.024 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14784.0:111555 7.5 7:a9fd6f98:::benchmark_data_smithi018_80623_object10627:head [delete] snapc 0=[] ondisk+write+known_if_redirected e125)", 2024-02-10T08:25:44.024 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:21:36.364089+0000", 2024-02-10T08:25:44.024 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 247.616579825, 2024-02-10T08:25:44.024 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.083578967000000004, 2024-02-10T08:25:44.025 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:25:44.025 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:25:44.025 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:25:44.025 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14784", 2024-02-10T08:25:44.025 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:25:44.025 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 111555 2024-02-10T08:25:44.025 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.025 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:25:44.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.025 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:25:44.025 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:21:36.364089+0000", 2024-02-10T08:25:44.025 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:25:44.025 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.026 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.026 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:25:44.026 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:21:36.364089+0000", 2024-02-10T08:25:44.026 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-02-10T08:25:44.026 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.026 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.026 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:25:44.026 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:21:36.364088+0000", 2024-02-10T08:25:44.026 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8110000000000002e-06 2024-02-10T08:25:44.026 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.026 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.026 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:25:44.026 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:21:36.364093+0000", 2024-02-10T08:25:44.026 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8310000000000001e-06 2024-02-10T08:25:44.026 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.027 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.027 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:25:44.027 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:21:36.364101+0000", 2024-02-10T08:25:44.027 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4040000000000003e-06 2024-02-10T08:25:44.027 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.027 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.027 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:25:44.027 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:21:36.364106+0000", 2024-02-10T08:25:44.027 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001998512 2024-02-10T08:25:44.027 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.027 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.027 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:25:44.027 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:21:36.366104+0000", 2024-02-10T08:25:44.027 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000128169 2024-02-10T08:25:44.028 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.028 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.028 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:25:44.028 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:21:36.366233+0000", 2024-02-10T08:25:44.028 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5259000000000005e-05 2024-02-10T08:25:44.028 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.028 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.028 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,2", 2024-02-10T08:25:44.028 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:21:36.366318+0000", 2024-02-10T08:25:44.028 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0018789449999999999 2024-02-10T08:25:44.028 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.028 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.028 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:25:44.028 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:21:36.368197+0000", 2024-02-10T08:25:44.029 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0037450819999999998 2024-02-10T08:25:44.029 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.029 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.029 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:25:44.029 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:21:36.371942+0000", 2024-02-10T08:25:44.029 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.075637249000000004 2024-02-10T08:25:44.029 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.029 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.029 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:25:44.029 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:21:36.447579+0000", 2024-02-10T08:25:44.029 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9279e-05 2024-02-10T08:25:44.029 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.029 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.029 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:25:44.029 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:21:36.447628+0000", 2024-02-10T08:25:44.029 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9232e-05 2024-02-10T08:25:44.030 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.030 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.030 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:25:44.030 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:21:36.447668+0000", 2024-02-10T08:25:44.030 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.083578967000000004 2024-02-10T08:25:44.030 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:44.030 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:25:44.030 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:44.030 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.030 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.030 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14784.0:155160 7.5 7:a447c693:::benchmark_data_smithi018_80623_object54232:head [delete] snapc 0=[] ondisk+write+known_if_redirected e149)", 2024-02-10T08:25:44.030 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:22:40.191323+0000", 2024-02-10T08:25:44.030 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 183.78934580000001, 2024-02-10T08:25:44.030 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.088803113000000003, 2024-02-10T08:25:44.031 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:25:44.031 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:25:44.031 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:25:44.031 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14784", 2024-02-10T08:25:44.031 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:25:44.031 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 155160 2024-02-10T08:25:44.031 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.031 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:25:44.031 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.031 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:25:44.031 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:40.191323+0000", 2024-02-10T08:25:44.031 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:25:44.031 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.031 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.031 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:25:44.032 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:40.191323+0000", 2024-02-10T08:25:44.032 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999981 2024-02-10T08:25:44.032 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.032 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.032 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:25:44.032 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:40.191321+0000", 2024-02-10T08:25:44.032 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7520000000000002e-06 2024-02-10T08:25:44.032 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.032 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.032 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:25:44.032 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:40.191330+0000", 2024-02-10T08:25:44.032 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5142e-05 2024-02-10T08:25:44.032 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.032 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.032 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:25:44.033 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:40.191345+0000", 2024-02-10T08:25:44.033 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4869999999999996e-06 2024-02-10T08:25:44.033 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.033 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.033 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:25:44.033 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:40.191352+0000", 2024-02-10T08:25:44.033 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4799000000000002e-05 2024-02-10T08:25:44.033 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.033 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.033 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:25:44.033 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:40.191407+0000", 2024-02-10T08:25:44.033 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012921100000000001 2024-02-10T08:25:44.033 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.033 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.033 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:25:44.033 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:40.191536+0000", 2024-02-10T08:25:44.034 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013556500000000001 2024-02-10T08:25:44.034 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.034 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.034 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,2", 2024-02-10T08:25:44.034 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:40.191672+0000", 2024-02-10T08:25:44.034 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002076835 2024-02-10T08:25:44.034 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.034 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.034 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:25:44.034 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:40.193749+0000", 2024-02-10T08:25:44.034 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.026338651000000001 2024-02-10T08:25:44.034 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.034 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.034 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:25:44.034 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:40.220087+0000", 2024-02-10T08:25:44.034 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.059960197 2024-02-10T08:25:44.035 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.035 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.035 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:25:44.035 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:40.280048+0000", 2024-02-10T08:25:44.035 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5874999999999998e-05 2024-02-10T08:25:44.035 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.035 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.035 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:25:44.035 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:40.280084+0000", 2024-02-10T08:25:44.035 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2326000000000001e-05 2024-02-10T08:25:44.035 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.035 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.035 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:25:44.035 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:40.280126+0000", 2024-02-10T08:25:44.035 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.088803113000000003 2024-02-10T08:25:44.035 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:44.035 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:25:44.036 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:44.036 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.036 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.036 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14784.0:155945 7.5 7:a5084e66:::benchmark_data_smithi018_80623_object55017:head [delete] snapc 0=[] ondisk+write+known_if_redirected e149)", 2024-02-10T08:25:44.036 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:22:41.291825+0000", 2024-02-10T08:25:44.036 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 182.68884389999999, 2024-02-10T08:25:44.036 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.076081602999999998, 2024-02-10T08:25:44.036 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:25:44.036 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:25:44.036 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:25:44.036 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14784", 2024-02-10T08:25:44.036 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:25:44.036 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 155945 2024-02-10T08:25:44.036 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.037 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:25:44.037 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.037 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:25:44.037 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:41.291825+0000", 2024-02-10T08:25:44.037 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:25:44.037 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.037 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.037 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:25:44.037 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:41.291825+0000", 2024-02-10T08:25:44.037 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-02-10T08:25:44.037 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.037 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.037 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:25:44.037 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:41.291823+0000", 2024-02-10T08:25:44.037 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2010000000000002e-06 2024-02-10T08:25:44.037 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.038 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:25:44.038 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:41.291830+0000", 2024-02-10T08:25:44.038 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7329999999999998e-06 2024-02-10T08:25:44.038 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.038 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:25:44.038 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:41.291840+0000", 2024-02-10T08:25:44.038 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2720000000000003e-06 2024-02-10T08:25:44.038 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.038 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:25:44.038 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:41.291846+0000", 2024-02-10T08:25:44.038 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7422000000000001e-05 2024-02-10T08:25:44.038 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.038 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:25:44.039 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:41.291894+0000", 2024-02-10T08:25:44.039 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6323000000000006e-05 2024-02-10T08:25:44.039 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.039 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.039 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:25:44.039 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:41.291990+0000", 2024-02-10T08:25:44.039 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000112589 2024-02-10T08:25:44.039 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.039 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.039 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,2", 2024-02-10T08:25:44.039 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:41.292103+0000", 2024-02-10T08:25:44.039 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0038726580000000002 2024-02-10T08:25:44.039 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.039 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.039 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:25:44.039 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:41.295975+0000", 2024-02-10T08:25:44.040 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0021593459999999999 2024-02-10T08:25:44.040 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.040 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.040 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:25:44.040 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:41.298135+0000", 2024-02-10T08:25:44.040 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.069706072999999993 2024-02-10T08:25:44.040 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.040 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.040 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:25:44.040 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:41.367841+0000", 2024-02-10T08:25:44.040 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1615999999999997e-05 2024-02-10T08:25:44.040 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.040 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.040 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:25:44.041 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:41.367872+0000", 2024-02-10T08:25:44.041 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3788999999999998e-05 2024-02-10T08:25:44.041 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.041 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.041 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:25:44.041 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:41.367906+0000", 2024-02-10T08:25:44.041 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.076081602999999998 2024-02-10T08:25:44.041 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:44.041 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:25:44.041 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:44.041 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.041 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.041 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14784.0:179913 7.f 7:f6229f5c:::benchmark_data_smithi018_80623_object78985:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e163)", 2024-02-10T08:25:44.041 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:23:14.076678+0000", 2024-02-10T08:25:44.041 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 149.90399035300001, 2024-02-10T08:25:44.042 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.599766145, 2024-02-10T08:25:44.042 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:25:44.042 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-02-10T08:25:44.042 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:25:44.042 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14784", 2024-02-10T08:25:44.042 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:25:44.042 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 179913 2024-02-10T08:25:44.042 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.042 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:25:44.042 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.042 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:25:44.042 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:14.076678+0000", 2024-02-10T08:25:44.042 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:25:44.042 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.042 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.042 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:25:44.043 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:14.076678+0000", 2024-02-10T08:25:44.043 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-02-10T08:25:44.043 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.043 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.043 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:25:44.043 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:14.076677+0000", 2024-02-10T08:25:44.043 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2670000000000006e-06 2024-02-10T08:25:44.043 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.043 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.043 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:25:44.043 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:14.076685+0000", 2024-02-10T08:25:44.043 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5041e-05 2024-02-10T08:25:44.043 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.043 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.043 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:25:44.043 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:14.076700+0000", 2024-02-10T08:25:44.044 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1859999999999997e-06 2024-02-10T08:25:44.044 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.044 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.044 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:25:44.044 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:14.076706+0000", 2024-02-10T08:25:44.044 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5460000000000001e-05 2024-02-10T08:25:44.044 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.044 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.044 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:25:44.044 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:14.076762+0000", 2024-02-10T08:25:44.044 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8290000000000002e-06 2024-02-10T08:25:44.044 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.044 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.044 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:25:44.044 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:14.076768+0000", 2024-02-10T08:25:44.045 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.98643296199999997 2024-02-10T08:25:44.045 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.045 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.045 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:25:44.045 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:15.063201+0000", 2024-02-10T08:25:44.045 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0702e-05 2024-02-10T08:25:44.045 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.045 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.045 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:25:44.045 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:15.063212+0000", 2024-02-10T08:25:44.045 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.61185293699999999 2024-02-10T08:25:44.045 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.045 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.045 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:25:44.045 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:15.675065+0000", 2024-02-10T08:25:44.045 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0013793099999999999 2024-02-10T08:25:44.046 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.046 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.046 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:25:44.046 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:15.676444+0000", 2024-02-10T08:25:44.046 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.599766145 2024-02-10T08:25:44.046 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:44.046 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:25:44.046 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:44.046 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.046 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.046 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14784.0:179930 7.f 7:f3f2bf27:::benchmark_data_smithi018_80623_object79002:head [delete] snapc 0=[] ondisk+write+known_if_redirected e163)", 2024-02-10T08:25:44.046 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:23:14.092304+0000", 2024-02-10T08:25:44.046 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 149.888364427, 2024-02-10T08:25:44.046 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.617824409, 2024-02-10T08:25:44.047 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:25:44.047 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:25:44.047 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:25:44.047 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14784", 2024-02-10T08:25:44.047 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:25:44.047 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 179930 2024-02-10T08:25:44.047 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.047 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:25:44.047 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.047 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:25:44.047 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:14.092304+0000", 2024-02-10T08:25:44.047 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:25:44.047 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.047 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.047 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:25:44.047 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:14.092304+0000", 2024-02-10T08:25:44.048 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-02-10T08:25:44.048 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.048 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.048 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:25:44.048 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:14.092303+0000", 2024-02-10T08:25:44.048 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3700000000000001e-06 2024-02-10T08:25:44.048 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.048 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.048 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:25:44.048 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:14.092312+0000", 2024-02-10T08:25:44.048 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1009000000000001e-05 2024-02-10T08:25:44.048 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.048 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.048 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:25:44.049 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:14.092323+0000", 2024-02-10T08:25:44.049 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5659999999999997e-06 2024-02-10T08:25:44.049 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.049 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.049 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:25:44.049 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:14.092329+0000", 2024-02-10T08:25:44.049 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5998999999999999e-05 2024-02-10T08:25:44.049 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.049 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.049 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:25:44.049 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:14.092365+0000", 2024-02-10T08:25:44.049 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6370000000000002e-06 2024-02-10T08:25:44.049 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.049 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.049 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:25:44.049 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:14.092371+0000", 2024-02-10T08:25:44.050 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.97087489500000002 2024-02-10T08:25:44.050 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.050 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.050 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:25:44.050 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:15.063246+0000", 2024-02-10T08:25:44.050 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1419999999999993e-06 2024-02-10T08:25:44.050 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.050 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.050 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:25:44.050 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:15.063254+0000", 2024-02-10T08:25:44.050 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.61322881299999998 2024-02-10T08:25:44.050 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.050 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.050 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:25:44.050 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:15.676483+0000", 2024-02-10T08:25:44.051 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00034529199999999997 2024-02-10T08:25:44.051 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.051 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.051 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:25:44.051 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:15.676828+0000", 2024-02-10T08:25:44.051 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00025559299999999998 2024-02-10T08:25:44.051 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.051 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.051 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,3,4", 2024-02-10T08:25:44.051 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:15.677084+0000", 2024-02-10T08:25:44.051 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.01280281 2024-02-10T08:25:44.051 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.051 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.051 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:25:44.051 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:15.689887+0000", 2024-02-10T08:25:44.051 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00027219599999999999 2024-02-10T08:25:44.051 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.051 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.052 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:25:44.052 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:15.690159+0000", 2024-02-10T08:25:44.052 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018133776000000001 2024-02-10T08:25:44.052 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.052 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.052 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:25:44.052 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:15.708293+0000", 2024-02-10T08:25:44.052 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001652146 2024-02-10T08:25:44.052 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.052 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.052 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:25:44.052 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:15.709945+0000", 2024-02-10T08:25:44.052 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3143999999999998e-05 2024-02-10T08:25:44.052 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.052 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.053 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:25:44.053 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:15.709998+0000", 2024-02-10T08:25:44.053 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013047699999999999 2024-02-10T08:25:44.053 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.053 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.053 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:25:44.053 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:15.710129+0000", 2024-02-10T08:25:44.053 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.617824409 2024-02-10T08:25:44.053 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:44.053 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:25:44.053 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:44.053 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.053 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.053 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14784.0:179933 7.f 7:f4c11818:::benchmark_data_smithi018_80623_object79005:head [delete] snapc 0=[] ondisk+write+known_if_redirected e163)", 2024-02-10T08:25:44.053 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:23:14.101940+0000", 2024-02-10T08:25:44.054 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 149.878728744, 2024-02-10T08:25:44.054 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6084106839999999, 2024-02-10T08:25:44.054 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:25:44.054 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:25:44.054 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:25:44.054 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14784", 2024-02-10T08:25:44.054 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:25:44.054 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 179933 2024-02-10T08:25:44.054 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.054 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:25:44.054 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.054 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:25:44.054 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:14.101940+0000", 2024-02-10T08:25:44.054 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:25:44.054 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.054 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.055 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:25:44.055 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:14.101940+0000", 2024-02-10T08:25:44.055 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999971 2024-02-10T08:25:44.055 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.055 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.055 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:25:44.055 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:14.101937+0000", 2024-02-10T08:25:44.055 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4443e-05 2024-02-10T08:25:44.055 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.055 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.055 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:25:44.055 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:14.101951+0000", 2024-02-10T08:25:44.055 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5556000000000001e-05 2024-02-10T08:25:44.055 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.055 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.055 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:25:44.055 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:14.101977+0000", 2024-02-10T08:25:44.056 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7572999999999999e-05 2024-02-10T08:25:44.056 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.056 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.056 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:25:44.056 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:14.101995+0000", 2024-02-10T08:25:44.056 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011336900000000001 2024-02-10T08:25:44.056 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.056 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.056 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:25:44.056 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:14.102108+0000", 2024-02-10T08:25:44.056 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.028e-06 2024-02-10T08:25:44.056 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.056 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.056 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:25:44.056 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:14.102116+0000", 2024-02-10T08:25:44.057 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.96116316800000001 2024-02-10T08:25:44.057 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.057 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.057 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:25:44.057 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:15.063279+0000", 2024-02-10T08:25:44.057 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.311e-06 2024-02-10T08:25:44.057 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.057 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.057 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:25:44.057 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:15.063286+0000", 2024-02-10T08:25:44.057 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.62220498800000001 2024-02-10T08:25:44.057 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.057 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.058 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:25:44.058 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:15.685491+0000", 2024-02-10T08:25:44.058 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000141843 2024-02-10T08:25:44.058 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.058 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.058 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:25:44.058 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:15.685633+0000", 2024-02-10T08:25:44.058 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000181461 2024-02-10T08:25:44.058 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.058 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.058 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,3,4", 2024-02-10T08:25:44.058 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:15.685815+0000", 2024-02-10T08:25:44.058 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040807810000000003 2024-02-10T08:25:44.058 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.058 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.058 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:25:44.059 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:15.689896+0000", 2024-02-10T08:25:44.059 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00031660899999999998 2024-02-10T08:25:44.059 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.059 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.059 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:25:44.059 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:15.690212+0000", 2024-02-10T08:25:44.059 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018139809999999999 2024-02-10T08:25:44.059 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.059 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.059 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:25:44.059 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:15.708352+0000", 2024-02-10T08:25:44.059 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001824705 2024-02-10T08:25:44.059 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.059 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.059 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:25:44.060 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:15.710177+0000", 2024-02-10T08:25:44.060 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3056000000000002e-05 2024-02-10T08:25:44.060 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.060 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.060 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:25:44.060 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:15.710230+0000", 2024-02-10T08:25:44.060 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000120766 2024-02-10T08:25:44.060 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.060 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.060 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:25:44.060 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:15.710350+0000", 2024-02-10T08:25:44.060 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6084106839999999 2024-02-10T08:25:44.060 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:44.061 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:25:44.061 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:44.061 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.061 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.061 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14784.0:179939 7.5 7:a760656d:::benchmark_data_smithi018_80623_object79011:head [delete] snapc 0=[] ondisk+write+known_if_redirected e163)", 2024-02-10T08:25:44.061 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:23:14.112587+0000", 2024-02-10T08:25:44.061 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 149.86808200199999, 2024-02-10T08:25:44.061 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5578576179999999, 2024-02-10T08:25:44.061 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:25:44.061 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:25:44.061 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:25:44.061 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14784", 2024-02-10T08:25:44.061 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:25:44.061 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 179939 2024-02-10T08:25:44.062 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.062 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:25:44.062 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.062 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:25:44.062 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:14.112587+0000", 2024-02-10T08:25:44.062 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:25:44.062 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.062 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.062 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:25:44.062 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:14.112587+0000", 2024-02-10T08:25:44.062 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999981 2024-02-10T08:25:44.062 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.062 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.062 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:25:44.062 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:14.112585+0000", 2024-02-10T08:25:44.063 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3000000000000002e-06 2024-02-10T08:25:44.063 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.063 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.063 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:25:44.063 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:14.112593+0000", 2024-02-10T08:25:44.063 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4769999999999999e-05 2024-02-10T08:25:44.063 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.063 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.063 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:25:44.063 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:14.112608+0000", 2024-02-10T08:25:44.063 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5119999999999997e-06 2024-02-10T08:25:44.063 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.063 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.063 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:25:44.063 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:14.112614+0000", 2024-02-10T08:25:44.064 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6381000000000001e-05 2024-02-10T08:25:44.064 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.064 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.064 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:25:44.064 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:14.112671+0000", 2024-02-10T08:25:44.064 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7170000000000008e-06 2024-02-10T08:25:44.064 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.064 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.064 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:25:44.064 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:14.112678+0000", 2024-02-10T08:25:44.064 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.95047633200000003 2024-02-10T08:25:44.064 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.064 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.064 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:25:44.065 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:15.063155+0000", 2024-02-10T08:25:44.065 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1336e-05 2024-02-10T08:25:44.065 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.065 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.065 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:25:44.065 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:15.063166+0000", 2024-02-10T08:25:44.065 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.58279108300000004 2024-02-10T08:25:44.065 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.065 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.065 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:25:44.065 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:15.645957+0000", 2024-02-10T08:25:44.065 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016456700000000001 2024-02-10T08:25:44.065 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.065 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.065 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:25:44.066 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:15.646122+0000", 2024-02-10T08:25:44.066 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00041912299999999998 2024-02-10T08:25:44.066 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.066 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.066 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,1,2", 2024-02-10T08:25:44.066 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:15.646541+0000", 2024-02-10T08:25:44.066 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0049177439999999999 2024-02-10T08:25:44.066 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.066 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.066 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:25:44.066 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:15.651459+0000", 2024-02-10T08:25:44.066 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3137999999999998e-05 2024-02-10T08:25:44.066 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.066 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.066 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:25:44.066 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:15.651512+0000", 2024-02-10T08:25:44.067 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014222279000000001 2024-02-10T08:25:44.067 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.067 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.067 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:25:44.067 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:15.665734+0000", 2024-02-10T08:25:44.067 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0045148009999999997 2024-02-10T08:25:44.067 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.067 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.067 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:25:44.067 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:15.670249+0000", 2024-02-10T08:25:44.067 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9490000000000001e-05 2024-02-10T08:25:44.067 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.067 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.067 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:25:44.067 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:15.670308+0000", 2024-02-10T08:25:44.067 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013590799999999999 2024-02-10T08:25:44.068 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.068 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.068 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:25:44.068 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:15.670444+0000", 2024-02-10T08:25:44.068 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5578576179999999 2024-02-10T08:25:44.068 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:44.068 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:25:44.068 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:44.068 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.068 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.068 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14784.0:179956 7.f 7:fe1ec637:::benchmark_data_smithi018_80623_object79028:head [delete] snapc 0=[] ondisk+write+known_if_redirected e163)", 2024-02-10T08:25:44.068 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:23:14.145603+0000", 2024-02-10T08:25:44.068 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 149.83506600199999, 2024-02-10T08:25:44.068 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5649484390000001, 2024-02-10T08:25:44.068 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:25:44.069 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:25:44.069 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:25:44.069 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14784", 2024-02-10T08:25:44.069 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:25:44.069 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 179956 2024-02-10T08:25:44.069 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.069 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:25:44.069 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.069 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:25:44.069 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:14.145603+0000", 2024-02-10T08:25:44.069 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:25:44.069 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.069 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.069 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:25:44.069 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:14.145603+0000", 2024-02-10T08:25:44.070 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-02-10T08:25:44.070 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.070 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.070 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:25:44.070 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:14.145601+0000", 2024-02-10T08:25:44.070 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4039999999999995e-06 2024-02-10T08:25:44.070 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.070 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.070 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:25:44.070 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:14.145609+0000", 2024-02-10T08:25:44.070 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.56e-05 2024-02-10T08:25:44.070 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.070 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.071 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:25:44.071 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:14.145625+0000", 2024-02-10T08:25:44.071 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7429999999999996e-06 2024-02-10T08:25:44.071 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.071 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.071 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:25:44.071 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:14.145632+0000", 2024-02-10T08:25:44.071 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3597000000000003e-05 2024-02-10T08:25:44.071 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.071 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.071 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:25:44.071 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:14.145675+0000", 2024-02-10T08:25:44.071 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9610000000000005e-06 2024-02-10T08:25:44.071 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.071 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.071 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:25:44.072 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:14.145683+0000", 2024-02-10T08:25:44.072 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.91772898999999997 2024-02-10T08:25:44.072 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.072 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.072 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:25:44.072 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:15.063412+0000", 2024-02-10T08:25:44.072 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1009999999999998e-06 2024-02-10T08:25:44.072 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.072 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.072 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:25:44.072 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:15.063421+0000", 2024-02-10T08:25:44.072 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.62418406100000001 2024-02-10T08:25:44.072 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.072 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.072 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:25:44.072 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:15.687605+0000", 2024-02-10T08:25:44.072 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012646599999999999 2024-02-10T08:25:44.073 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.073 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.073 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:25:44.073 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:15.687732+0000", 2024-02-10T08:25:44.073 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016248599999999999 2024-02-10T08:25:44.073 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.073 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.073 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,3,4", 2024-02-10T08:25:44.073 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:15.687894+0000", 2024-02-10T08:25:44.073 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0023240869999999999 2024-02-10T08:25:44.073 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.073 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.073 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:25:44.073 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:15.690218+0000", 2024-02-10T08:25:44.073 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7116999999999997e-05 2024-02-10T08:25:44.074 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.074 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.074 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:25:44.074 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:15.690256+0000", 2024-02-10T08:25:44.074 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018144077000000002 2024-02-10T08:25:44.074 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.074 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.074 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:25:44.074 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:15.708400+0000", 2024-02-10T08:25:44.074 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019891589999999999 2024-02-10T08:25:44.074 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.074 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.074 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:25:44.074 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:15.710389+0000", 2024-02-10T08:25:44.074 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5658000000000002e-05 2024-02-10T08:25:44.075 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.075 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.075 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:25:44.075 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:15.710435+0000", 2024-02-10T08:25:44.075 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000116457 2024-02-10T08:25:44.075 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.075 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.075 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:25:44.075 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:15.710551+0000", 2024-02-10T08:25:44.075 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5649484390000001 2024-02-10T08:25:44.075 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:44.075 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:25:44.075 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:44.075 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.075 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.076 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14784.0:185699 7.f 7:f1a29ca9:::benchmark_data_smithi018_80623_object84771:head [delete] snapc 0=[] ondisk+write+known_if_redirected e167)", 2024-02-10T08:25:44.076 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:23:24.357894+0000", 2024-02-10T08:25:44.076 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 139.62277494099999, 2024-02-10T08:25:44.076 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.105650864, 2024-02-10T08:25:44.076 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:25:44.076 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:25:44.076 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:25:44.076 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14784", 2024-02-10T08:25:44.076 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:25:44.076 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 185699 2024-02-10T08:25:44.076 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.076 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:25:44.076 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.077 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:25:44.077 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:24.357894+0000", 2024-02-10T08:25:44.077 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:25:44.077 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.077 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.077 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:25:44.077 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:24.357894+0000", 2024-02-10T08:25:44.077 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999981 2024-02-10T08:25:44.077 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.077 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.077 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:25:44.077 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:24.357892+0000", 2024-02-10T08:25:44.077 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9580000000000002e-06 2024-02-10T08:25:44.078 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.078 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.078 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:25:44.078 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:24.357901+0000", 2024-02-10T08:25:44.078 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7450999999999999e-05 2024-02-10T08:25:44.078 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.078 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.078 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:25:44.078 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:24.357919+0000", 2024-02-10T08:25:44.078 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.148e-06 2024-02-10T08:25:44.078 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.078 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.078 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:25:44.078 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:24.357926+0000", 2024-02-10T08:25:44.079 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8828e-05 2024-02-10T08:25:44.079 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.079 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.079 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:25:44.079 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:24.357985+0000", 2024-02-10T08:25:44.079 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014110199999999999 2024-02-10T08:25:44.079 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.079 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.079 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:25:44.079 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:24.358126+0000", 2024-02-10T08:25:44.079 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000176434 2024-02-10T08:25:44.079 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.079 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.080 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,3,4", 2024-02-10T08:25:44.080 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:24.358302+0000", 2024-02-10T08:25:44.080 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0045892140000000003 2024-02-10T08:25:44.080 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.080 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.080 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:25:44.080 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:24.362892+0000", 2024-02-10T08:25:44.080 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00066167899999999998 2024-02-10T08:25:44.080 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.080 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.080 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:25:44.080 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:24.363553+0000", 2024-02-10T08:25:44.080 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000100249 2024-02-10T08:25:44.080 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.081 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.081 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:25:44.081 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:24.363654+0000", 2024-02-10T08:25:44.081 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.099696160000000006 2024-02-10T08:25:44.081 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.081 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.081 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:25:44.081 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:24.463350+0000", 2024-02-10T08:25:44.081 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7111000000000003e-05 2024-02-10T08:25:44.081 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.081 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.081 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:25:44.081 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:24.463407+0000", 2024-02-10T08:25:44.081 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000137591 2024-02-10T08:25:44.081 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.081 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.081 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:25:44.082 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:24.463544+0000", 2024-02-10T08:25:44.082 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.105650864 2024-02-10T08:25:44.082 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:44.082 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:25:44.082 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:44.082 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.082 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.082 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14784.0:185700 7.f 7:fa9fb72e:::benchmark_data_smithi018_80623_object84772:head [delete] snapc 0=[] ondisk+write+known_if_redirected e167)", 2024-02-10T08:25:44.082 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:23:24.357941+0000", 2024-02-10T08:25:44.082 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 139.62272729700001, 2024-02-10T08:25:44.082 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.108739488, 2024-02-10T08:25:44.082 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:25:44.082 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:25:44.082 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:25:44.082 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14784", 2024-02-10T08:25:44.082 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:25:44.082 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 185700 2024-02-10T08:25:44.083 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.083 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:25:44.083 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.083 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:25:44.083 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:24.357941+0000", 2024-02-10T08:25:44.083 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:25:44.083 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.083 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.083 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:25:44.083 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:24.357941+0000", 2024-02-10T08:25:44.083 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-02-10T08:25:44.083 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.083 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.083 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:25:44.083 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:24.357941+0000", 2024-02-10T08:25:44.083 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.18e-06 2024-02-10T08:25:44.083 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.084 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.084 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:25:44.084 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:24.357944+0000", 2024-02-10T08:25:44.084 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2119999999999999e-05 2024-02-10T08:25:44.084 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.084 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.084 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:25:44.084 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:24.357956+0000", 2024-02-10T08:25:44.084 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1049999999999997e-06 2024-02-10T08:25:44.084 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.084 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.084 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:25:44.084 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:24.357960+0000", 2024-02-10T08:25:44.084 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0023009800000000002 2024-02-10T08:25:44.085 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.085 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.085 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:25:44.085 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:24.360261+0000", 2024-02-10T08:25:44.085 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012557200000000001 2024-02-10T08:25:44.085 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.085 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.085 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:25:44.085 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:24.360387+0000", 2024-02-10T08:25:44.085 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014919999999999999 2024-02-10T08:25:44.085 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.085 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.085 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,3,4", 2024-02-10T08:25:44.085 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:24.360536+0000", 2024-02-10T08:25:44.085 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0031549170000000001 2024-02-10T08:25:44.085 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.086 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.086 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:25:44.086 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:24.363691+0000", 2024-02-10T08:25:44.086 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00060963900000000004 2024-02-10T08:25:44.086 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.086 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:25:44.087 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.087 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:25:44.087 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:24.364300+0000", 2024-02-10T08:25:44.087 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001459861 2024-02-10T08:25:44.087 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.087 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.087 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:25:44.087 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:24.365760+0000", 2024-02-10T08:25:44.087 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.100735926 2024-02-10T08:25:44.087 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.087 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.087 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:25:44.087 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:24.466496+0000", 2024-02-10T08:25:44.088 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3502999999999999e-05 2024-02-10T08:25:44.088 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.088 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.088 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:25:44.088 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:24.466550+0000", 2024-02-10T08:25:44.088 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013099800000000001 2024-02-10T08:25:44.088 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.088 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.088 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:25:44.088 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:24.466681+0000", 2024-02-10T08:25:44.088 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.108739488 2024-02-10T08:25:44.088 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:44.088 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:25:44.088 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:44.089 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.089 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.089 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14784.0:185705 7.5 7:a1305556:::benchmark_data_smithi018_80623_object84777:head [delete] snapc 0=[] ondisk+write+known_if_redirected e167)", 2024-02-10T08:25:44.089 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:23:24.364102+0000", 2024-02-10T08:25:44.089 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 139.61656672699999, 2024-02-10T08:25:44.089 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.10845845799999999, 2024-02-10T08:25:44.089 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:25:44.089 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:25:44.089 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:25:44.089 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14784", 2024-02-10T08:25:44.089 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:25:44.089 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 185705 2024-02-10T08:25:44.089 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.089 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:25:44.089 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.090 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:25:44.090 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:24.364102+0000", 2024-02-10T08:25:44.090 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:25:44.090 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.090 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.090 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:25:44.090 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:24.364102+0000", 2024-02-10T08:25:44.090 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-02-10T08:25:44.090 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.090 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.090 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:25:44.090 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:24.364100+0000", 2024-02-10T08:25:44.090 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4580000000000004e-06 2024-02-10T08:25:44.090 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.090 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.091 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:25:44.091 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:24.364108+0000", 2024-02-10T08:25:44.091 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2361000000000001e-05 2024-02-10T08:25:44.091 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.091 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.091 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:25:44.091 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:24.364120+0000", 2024-02-10T08:25:44.091 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3009999999999997e-06 2024-02-10T08:25:44.091 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.091 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.091 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:25:44.091 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:24.364125+0000", 2024-02-10T08:25:44.091 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6885999999999998e-05 2024-02-10T08:25:44.091 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.091 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.091 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:25:44.092 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:24.364172+0000", 2024-02-10T08:25:44.092 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6650999999999993e-05 2024-02-10T08:25:44.092 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.092 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.092 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:25:44.092 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:24.364269+0000", 2024-02-10T08:25:44.092 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015784999999999999 2024-02-10T08:25:44.092 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.092 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.092 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,1,2", 2024-02-10T08:25:44.092 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:24.364427+0000", 2024-02-10T08:25:44.092 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0025025899999999998 2024-02-10T08:25:44.092 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.092 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.093 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:25:44.093 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:24.366929+0000", 2024-02-10T08:25:44.093 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00052231599999999999 2024-02-10T08:25:44.093 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.093 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.093 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:25:44.093 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:24.367452+0000", 2024-02-10T08:25:44.093 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0049947000000000004 2024-02-10T08:25:44.093 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.093 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.093 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:25:44.093 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:24.372446+0000", 2024-02-10T08:25:44.093 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.099914629000000005 2024-02-10T08:25:44.093 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.094 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.094 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:25:44.094 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:24.472361+0000", 2024-02-10T08:25:44.094 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9045000000000001e-05 2024-02-10T08:25:44.094 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.094 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.094 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:25:44.094 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:24.472420+0000", 2024-02-10T08:25:44.094 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014027000000000001 2024-02-10T08:25:44.094 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.094 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.094 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:25:44.094 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:24.472560+0000", 2024-02-10T08:25:44.094 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.10845845799999999 2024-02-10T08:25:44.095 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:44.095 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:25:44.095 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:44.095 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.095 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.095 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14784.0:196457 7.5 7:afda09c9:::benchmark_data_smithi018_80623_object95529:head [delete] snapc 0=[] ondisk+write+known_if_redirected e173)", 2024-02-10T08:25:44.095 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:23:43.454569+0000", 2024-02-10T08:25:44.095 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 120.526099522, 2024-02-10T08:25:44.095 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.086891544000000001, 2024-02-10T08:25:44.095 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:25:44.095 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:25:44.095 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:25:44.095 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14784", 2024-02-10T08:25:44.095 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:25:44.095 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 196457 2024-02-10T08:25:44.096 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.096 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:25:44.096 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.096 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:25:44.096 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:43.454569+0000", 2024-02-10T08:25:44.096 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:25:44.096 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.096 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.096 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:25:44.096 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:43.454569+0000", 2024-02-10T08:25:44.096 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-02-10T08:25:44.096 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.096 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.096 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:25:44.097 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:43.454568+0000", 2024-02-10T08:25:44.097 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7300000000000002e-06 2024-02-10T08:25:44.097 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.097 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.097 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:25:44.097 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:43.454574+0000", 2024-02-10T08:25:44.097 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2539999999999992e-06 2024-02-10T08:25:44.097 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.097 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.097 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:25:44.097 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:43.454582+0000", 2024-02-10T08:25:44.097 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5319999999999997e-06 2024-02-10T08:25:44.097 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.097 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.097 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:25:44.097 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:43.454587+0000", 2024-02-10T08:25:44.098 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0072815609999999998 2024-02-10T08:25:44.098 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.098 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.098 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:25:44.098 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:43.461869+0000", 2024-02-10T08:25:44.098 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000114337 2024-02-10T08:25:44.098 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.098 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.098 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:25:44.098 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:43.461983+0000", 2024-02-10T08:25:44.098 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015437799999999999 2024-02-10T08:25:44.098 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.098 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.098 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,1,2", 2024-02-10T08:25:44.098 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:43.462138+0000", 2024-02-10T08:25:44.098 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00369243 2024-02-10T08:25:44.099 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.099 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.099 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:25:44.099 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:43.465830+0000", 2024-02-10T08:25:44.099 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0052639710000000001 2024-02-10T08:25:44.099 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.099 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.099 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:25:44.099 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:43.471094+0000", 2024-02-10T08:25:44.099 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0042060400000000003 2024-02-10T08:25:44.099 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.099 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.099 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:25:44.099 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:43.475300+0000", 2024-02-10T08:25:44.099 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.065953883000000005 2024-02-10T08:25:44.100 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.100 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.100 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:25:44.100 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:43.541254+0000", 2024-02-10T08:25:44.100 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7219999999999998e-05 2024-02-10T08:25:44.100 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.100 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.100 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:25:44.100 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:43.541311+0000", 2024-02-10T08:25:44.100 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000149307 2024-02-10T08:25:44.100 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.100 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.100 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:25:44.100 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:43.541461+0000", 2024-02-10T08:25:44.101 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.086891544000000001 2024-02-10T08:25:44.101 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:44.101 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:25:44.101 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:44.101 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.101 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.101 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14964.0:79645 8.c 8:36e194de:::benchmark_data_smithi018_103312_object79644:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e209)", 2024-02-10T08:25:44.101 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:25:25.988449+0000", 2024-02-10T08:25:44.101 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 17.992219463000001, 2024-02-10T08:25:44.101 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.075749432000000005, 2024-02-10T08:25:44.101 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:25:44.101 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:25:44.101 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:25:44.101 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14964", 2024-02-10T08:25:44.101 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3173131962", 2024-02-10T08:25:44.101 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 79645 2024-02-10T08:25:44.102 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.102 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:25:44.102 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.102 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:25:44.102 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:25.988449+0000", 2024-02-10T08:25:44.102 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:25:44.102 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.102 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.102 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:25:44.102 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:25.988449+0000", 2024-02-10T08:25:44.102 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-02-10T08:25:44.102 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.102 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.102 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:25:44.102 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:25.988448+0000", 2024-02-10T08:25:44.102 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5306000000000001e-05 2024-02-10T08:25:44.103 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.103 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.103 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:25:44.103 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:25.988513+0000", 2024-02-10T08:25:44.103 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5170000000000002e-06 2024-02-10T08:25:44.103 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.103 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.103 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:25:44.103 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:25.988521+0000", 2024-02-10T08:25:44.103 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2259999999999999e-06 2024-02-10T08:25:44.103 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.103 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.103 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:25:44.103 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:25.988525+0000", 2024-02-10T08:25:44.104 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7772999999999999e-05 2024-02-10T08:25:44.104 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.104 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.104 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:25:44.104 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:25.988563+0000", 2024-02-10T08:25:44.104 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000111649 2024-02-10T08:25:44.104 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.104 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.104 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:25:44.104 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:25.988674+0000", 2024-02-10T08:25:44.104 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014434699999999999 2024-02-10T08:25:44.104 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.104 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.105 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3,5", 2024-02-10T08:25:44.105 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:25.988819+0000", 2024-02-10T08:25:44.105 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020879190000000001 2024-02-10T08:25:44.105 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.105 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.105 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:25:44.105 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:25.990907+0000", 2024-02-10T08:25:44.105 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001657585 2024-02-10T08:25:44.105 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.105 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.105 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:25:44.105 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:25.992564+0000", 2024-02-10T08:25:44.105 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.071539987999999999 2024-02-10T08:25:44.105 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.105 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.106 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:25:44.106 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:26.064104+0000", 2024-02-10T08:25:44.106 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7286000000000001e-05 2024-02-10T08:25:44.106 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.106 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.106 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:25:44.106 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:26.064151+0000", 2024-02-10T08:25:44.106 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7021999999999998e-05 2024-02-10T08:25:44.106 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:25:44.106 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:25:44.106 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:25:44.106 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:26.064198+0000", 2024-02-10T08:25:44.106 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.075749432000000005 2024-02-10T08:25:44.106 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:44.106 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:25:44.107 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:44.107 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:25:44.107 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:25:44.107 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-02-10T08:25:44.107 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:44.108 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:25:44.108 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:25:44.108 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is set 2024-02-10T08:25:44.209 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:25:44.263 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:44.295 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:44 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:42.724046+0000 mgr.y (mgr.14505) 341 : cluster [DBG] pgmap v405: 158 pgs: 158 active+clean; 5.9 GiB data, 20 GiB used, 696 GiB / 715 GiB avail; 1.1 KiB/s rd, 70 MiB/s wr, 1.11k op/s 2024-02-10T08:25:44.295 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:44 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:43.004615+0000 osd.1 (osd.1) 110 : cluster [DBG] 3.0 scrub starts 2024-02-10T08:25:44.295 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:44 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:43.009387+0000 osd.1 (osd.1) 111 : cluster [DBG] 3.0 scrub ok 2024-02-10T08:25:44.295 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:44 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:43.160556+0000 osd.6 (osd.6) 85 : cluster [DBG] 2.14 scrub starts 2024-02-10T08:25:44.295 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:44 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:43.163464+0000 osd.6 (osd.6) 86 : cluster [DBG] 2.14 scrub ok 2024-02-10T08:25:44.295 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:44 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:25:43.181560+0000 mon.b (mon.1) 57 : audit [INF] from='client.? 172.21.15.18:0/2482267205' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:25:44.295 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:44 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:25:43.182248+0000 mon.a (mon.0) 1139 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:25:44.357 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 67 16 99553 99537 92.8125 66.3125 0.0121907 0.0107697 2024-02-10T08:25:44.367 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:25:44.368 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:42.724046+0000 mgr.y (mgr.14505) 341 : cluster [DBG] pgmap v405: 158 pgs: 158 active+clean; 5.9 GiB data, 20 GiB used, 696 GiB / 715 GiB avail; 1.1 KiB/s rd, 70 MiB/s wr, 1.11k op/s 2024-02-10T08:25:44.369 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:43.004615+0000 osd.1 (osd.1) 110 : cluster [DBG] 3.0 scrub starts 2024-02-10T08:25:44.369 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:43.009387+0000 osd.1 (osd.1) 111 : cluster [DBG] 3.0 scrub ok 2024-02-10T08:25:44.369 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:43.160556+0000 osd.6 (osd.6) 85 : cluster [DBG] 2.14 scrub starts 2024-02-10T08:25:44.369 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:43.163464+0000 osd.6 (osd.6) 86 : cluster [DBG] 2.14 scrub ok 2024-02-10T08:25:44.369 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:25:43.181560+0000 mon.b (mon.1) 57 : audit [INF] from='client.? 172.21.15.18:0/2482267205' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:25:44.369 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:25:43.182248+0000 mon.a (mon.0) 1139 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:25:44.369 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:42.724046+0000 mgr.y (mgr.14505) 341 : cluster [DBG] pgmap v405: 158 pgs: 158 active+clean; 5.9 GiB data, 20 GiB used, 696 GiB / 715 GiB avail; 1.1 KiB/s rd, 70 MiB/s wr, 1.11k op/s 2024-02-10T08:25:44.369 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:43.004615+0000 osd.1 (osd.1) 110 : cluster [DBG] 3.0 scrub starts 2024-02-10T08:25:44.370 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:43.009387+0000 osd.1 (osd.1) 111 : cluster [DBG] 3.0 scrub ok 2024-02-10T08:25:44.370 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:43.160556+0000 osd.6 (osd.6) 85 : cluster [DBG] 2.14 scrub starts 2024-02-10T08:25:44.370 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:43.163464+0000 osd.6 (osd.6) 86 : cluster [DBG] 2.14 scrub ok 2024-02-10T08:25:44.370 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:25:43.181560+0000 mon.b (mon.1) 57 : audit [INF] from='client.? 172.21.15.18:0/2482267205' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:25:44.370 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:25:43.182248+0000 mon.a (mon.0) 1139 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:25:44.372 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:44.373 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:25:44.474 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:25:44.522 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:44.591 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:25:44.596 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:44.597 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:25:44.697 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:25:44.751 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:45.004 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.4 dump_ops_in_flight 2024-02-10T08:25:45.104 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:43.703420+0000 osd.5 (osd.5) 109 : cluster [DBG] 4.15 deep-scrub starts 2024-02-10T08:25:45.104 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:43.713325+0000 osd.5 (osd.5) 110 : cluster [DBG] 4.15 deep-scrub ok 2024-02-10T08:25:45.104 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:44.058626+0000 mon.a (mon.0) 1140 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:25:45.104 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:25:44.078140+0000 mon.a (mon.0) 1141 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-10T08:25:45.109 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:43.703420+0000 osd.5 (osd.5) 109 : cluster [DBG] 4.15 deep-scrub starts 2024-02-10T08:25:45.109 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:43.713325+0000 osd.5 (osd.5) 110 : cluster [DBG] 4.15 deep-scrub ok 2024-02-10T08:25:45.109 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:44.058626+0000 mon.a (mon.0) 1140 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:25:45.109 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:25:44.078140+0000 mon.a (mon.0) 1141 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-10T08:25:45.109 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:44.078202+0000 mon.a (mon.0) 1142 : cluster [DBG] osdmap e214: 8 total, 8 up, 8 in 2024-02-10T08:25:45.109 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:44.268164+0000 osd.7 (osd.7) 115 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:25:45.109 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:44.268223+0000 osd.7 (osd.7) 116 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:25:45.119 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:25:45.128 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:45.129 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:25:45.230 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:25:45.310 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:45.351 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:25:45.359 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:45.360 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:25:45.360 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 68 16 100664 100648 92.4657 69.4375 0.0130721 0.0108102 2024-02-10T08:25:45.377 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:44.078202+0000 mon.a (mon.0) 1142 : cluster [DBG] osdmap e214: 8 total, 8 up, 8 in 2024-02-10T08:25:45.378 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:44.268164+0000 osd.7 (osd.7) 115 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:25:45.378 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:44.268223+0000 osd.7 (osd.7) 116 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:25:45.378 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:43.703420+0000 osd.5 (osd.5) 109 : cluster [DBG] 4.15 deep-scrub starts 2024-02-10T08:25:45.378 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:43.713325+0000 osd.5 (osd.5) 110 : cluster [DBG] 4.15 deep-scrub ok 2024-02-10T08:25:45.378 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:44.058626+0000 mon.a (mon.0) 1140 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:25:45.378 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:25:44.078140+0000 mon.a (mon.0) 1141 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-10T08:25:45.378 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:44.078202+0000 mon.a (mon.0) 1142 : cluster [DBG] osdmap e214: 8 total, 8 up, 8 in 2024-02-10T08:25:45.378 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:44.268164+0000 osd.7 (osd.7) 115 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:25:45.378 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:44.268223+0000 osd.7 (osd.7) 116 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:25:45.449 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:25:45.461 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:25:45.511 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:46.196 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:25:46.199 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:46.200 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:25:46.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:44.724550+0000 mgr.y (mgr.14505) 342 : cluster [DBG] pgmap v407: 158 pgs: 158 active+clean; 6.0 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 1.0 KiB/s rd, 69 MiB/s wr, 1.11k op/s 2024-02-10T08:25:46.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:45.105979+0000 mon.a (mon.0) 1143 : cluster [DBG] osdmap e215: 8 total, 8 up, 8 in 2024-02-10T08:25:46.301 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:25:46.360 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 69 16 101744 101728 92.1039 67.5 0.0106349 0.010853 2024-02-10T08:25:46.366 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:46.366 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:44.724550+0000 mgr.y (mgr.14505) 342 : cluster [DBG] pgmap v407: 158 pgs: 158 active+clean; 6.0 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 1.0 KiB/s rd, 69 MiB/s wr, 1.11k op/s 2024-02-10T08:25:46.366 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:45.105979+0000 mon.a (mon.0) 1143 : cluster [DBG] osdmap e215: 8 total, 8 up, 8 in 2024-02-10T08:25:46.367 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:44.724550+0000 mgr.y (mgr.14505) 342 : cluster [DBG] pgmap v407: 158 pgs: 158 active+clean; 6.0 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 1.0 KiB/s rd, 69 MiB/s wr, 1.11k op/s 2024-02-10T08:25:46.367 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:45.105979+0000 mon.a (mon.0) 1143 : cluster [DBG] osdmap e215: 8 total, 8 up, 8 in 2024-02-10T08:25:46.789 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:25:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:25:46] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:25:47.360 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 70 16 102858 102842 91.7828 69.625 0.0129213 0.010891 2024-02-10T08:25:47.407 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:25:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:25:47] "GET /metrics HTTP/1.1" 200 175951 "" "Prometheus/2.33.4" 2024-02-10T08:25:47.569 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-02-10T08:25:47.569 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-02-10T08:25:47.569 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-02-10T08:25:47.569 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-02-10T08:25:47.642 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:25:47.647 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:47.648 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:25:47.749 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:25:47.803 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:47.842 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:25:47.855 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:47.856 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:25:47.886 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd set nodeep-scrub 2024-02-10T08:25:47.957 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:25:47.998 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:48.124 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:25:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:25:48.124 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:46.724950+0000 mgr.y (mgr.14505) 343 : cluster [DBG] pgmap v409: 158 pgs: 158 active+clean; 6.0 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 639 B/s rd, 48 MiB/s wr, 761 op/s 2024-02-10T08:25:48.328 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.4 dump_blocked_ops 2024-02-10T08:25:48.353 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:25:48.358 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:48.359 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:25:48.359 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 71 16 103925 103909 91.4295 66.6875 0.0138533 0.0109325 2024-02-10T08:25:48.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:46.724950+0000 mgr.y (mgr.14505) 343 : cluster [DBG] pgmap v409: 158 pgs: 158 active+clean; 6.0 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 639 B/s rd, 48 MiB/s wr, 761 op/s 2024-02-10T08:25:48.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:46.724950+0000 mgr.y (mgr.14505) 343 : cluster [DBG] pgmap v409: 158 pgs: 158 active+clean; 6.0 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 639 B/s rd, 48 MiB/s wr, 761 op/s 2024-02-10T08:25:48.459 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:25:48.512 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:48.547 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:25:48.553 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:48.554 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:25:48.655 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:25:48.715 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:48.739 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph tell osd.2 reset_purged_snaps_last 2024-02-10T08:25:48.772 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:25:48.837 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:25:48.837 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:25:48.837 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:25:48.837 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:25:48.838 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:25:48.838 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:25:48.838 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:25:48.838 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:25:48.838 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-10T08:25:48.838 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-10T08:25:48.838 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-10T08:25:48.838 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-10T08:25:48.838 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-10T08:25:48.839 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-10T08:25:48.839 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-10T08:25:48.839 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-10T08:25:49.083 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:25:49.090 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:49.090 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:25:49.191 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:25:49.230 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:49.285 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:25:49.293 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:49.293 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:25:49.302 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:49 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:25:47.987494+0000 mgr.y (mgr.14505) 344 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:25:49.302 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:49 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:25:48.330014+0000 mon.c (mon.2) 45 : audit [DBG] from='client.? 172.21.15.18:0/208793146' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:25:49.362 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 72 15 104952 104937 91.0509 64.25 0.0131927 0.0109787 2024-02-10T08:25:49.394 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:25:49.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:25:47.987494+0000 mgr.y (mgr.14505) 344 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:25:49.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:25:48.330014+0000 mon.c (mon.2) 45 : audit [DBG] from='client.? 172.21.15.18:0/208793146' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:25:49.409 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:25:47.987494+0000 mgr.y (mgr.14505) 344 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:25:49.409 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:25:48.330014+0000 mon.c (mon.2) 45 : audit [DBG] from='client.? 172.21.15.18:0/208793146' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:25:49.437 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:49.746 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:25:49.800 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:25:49.802 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:49.802 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:25:49.903 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:25:49.960 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:50.149 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:25:50.174 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:48.726638+0000 mgr.y (mgr.14505) 345 : cluster [DBG] pgmap v410: 158 pgs: 158 active+clean; 6.3 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 1.2 KiB/s rd, 79 MiB/s wr, 1.27k op/s 2024-02-10T08:25:50.361 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 73 16 106041 106025 90.7352 68 0.0196655 0.0110165 2024-02-10T08:25:50.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:48.726638+0000 mgr.y (mgr.14505) 345 : cluster [DBG] pgmap v410: 158 pgs: 158 active+clean; 6.3 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 1.2 KiB/s rd, 79 MiB/s wr, 1.27k op/s 2024-02-10T08:25:50.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:48.726638+0000 mgr.y (mgr.14505) 345 : cluster [DBG] pgmap v410: 158 pgs: 158 active+clean; 6.3 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 1.2 KiB/s rd, 79 MiB/s wr, 1.27k op/s 2024-02-10T08:25:50.452 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:25:50.461 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:50.462 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:25:50.562 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:25:50.609 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:50.731 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:25:50.735 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:50.735 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:25:50.836 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:25:50.888 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:51.088 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:25:51.096 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:51.096 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:25:51.145 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-02-10T08:25:51.145 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:25:51.197 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:25:51.262 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:51.363 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 74 16 107141 107125 90.4356 68.75 0.0125472 0.0110527 2024-02-10T08:25:51.395 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:25:51.401 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:51.402 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:25:51.502 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:25:51.550 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:51.668 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-10T08:25:51.720 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:50.727176+0000 mgr.y (mgr.14505) 346 : cluster [DBG] pgmap v411: 158 pgs: 158 active+clean; 6.3 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 639 B/s rd, 55 MiB/s wr, 885 op/s 2024-02-10T08:25:51.721 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:50.727176+0000 mgr.y (mgr.14505) 346 : cluster [DBG] pgmap v411: 158 pgs: 158 active+clean; 6.3 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 639 B/s rd, 55 MiB/s wr, 885 op/s 2024-02-10T08:25:51.997 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:51 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:50.727176+0000 mgr.y (mgr.14505) 346 : cluster [DBG] pgmap v411: 158 pgs: 158 active+clean; 6.3 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 639 B/s rd, 55 MiB/s wr, 885 op/s 2024-02-10T08:25:52.012 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:25:52.017 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:52.017 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:25:52.021 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.4 dump_historic_ops 2024-02-10T08:25:52.118 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:25:52.162 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:52.195 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:25:52.202 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:52.203 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:25:52.303 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:25:52.363 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 75 16 108186 108170 90.1007 65.3125 0.00737627 0.0110937 2024-02-10T08:25:52.376 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:52.410 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:25:52.413 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:52.413 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:25:52.496 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:25:52.514 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:25:52.560 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:52.782 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:25:52.786 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:52.787 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:25:52.888 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:25:52.931 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:53.363 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 76 15 109273 109258 89.8099 68 0.0135644 0.0111304 2024-02-10T08:25:53.407 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:25:53.412 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:53.413 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:25:53.514 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:25:53.572 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:53.671 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph tell osd.3 reset_purged_snaps_last 2024-02-10T08:25:53.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:52.729457+0000 mgr.y (mgr.14505) 347 : cluster [DBG] pgmap v412: 158 pgs: 158 active+clean; 6.5 GiB data, 22 GiB used, 694 GiB / 715 GiB avail; 1.2 KiB/s rd, 70 MiB/s wr, 1.12k op/s 2024-02-10T08:25:53.906 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:52.729457+0000 mgr.y (mgr.14505) 347 : cluster [DBG] pgmap v412: 158 pgs: 158 active+clean; 6.5 GiB data, 22 GiB used, 694 GiB / 715 GiB avail; 1.2 KiB/s rd, 70 MiB/s wr, 1.12k op/s 2024-02-10T08:25:53.946 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:25:53.950 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:53.951 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:25:54.052 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:25:54.080 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:53 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:52.729457+0000 mgr.y (mgr.14505) 347 : cluster [DBG] pgmap v412: 158 pgs: 158 active+clean; 6.5 GiB data, 22 GiB used, 694 GiB / 715 GiB avail; 1.2 KiB/s rd, 70 MiB/s wr, 1.12k op/s 2024-02-10T08:25:54.083 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:54.164 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:25:54.246 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:25:54.250 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:54.250 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:25:54.351 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:25:54.363 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 77 16 110328 110312 89.4991 65.875 0.017328 0.0111688 2024-02-10T08:25:54.427 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:54.467 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:25:54.473 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:54.473 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:25:54.574 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:25:54.608 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-02-10T08:25:54.608 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:25:54.648 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:54.676 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:25:54.681 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:54.681 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:25:54.782 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:25:54.831 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:54.859 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:25:54.864 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:54.864 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:25:54.965 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:25:55.031 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:55.127 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:25:55.130 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:55.131 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:25:55.146 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:25:55.232 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:25:55.277 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:55.363 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 78 16 111317 111301 89.1442 61.8125 0.010103 0.0112134 2024-02-10T08:25:55.850 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is set 2024-02-10T08:25:56.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:54.730059+0000 mgr.y (mgr.14505) 348 : cluster [DBG] pgmap v413: 158 pgs: 158 active+clean; 6.6 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 1023 B/s rd, 67 MiB/s wr, 1.07k op/s 2024-02-10T08:25:56.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:25:55.326445+0000 mon.b (mon.1) 58 : audit [INF] from='client.? 172.21.15.18:0/4236772111' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:25:56.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:25:55.327144+0000 mon.a (mon.0) 1144 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:25:56.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:54.730059+0000 mgr.y (mgr.14505) 348 : cluster [DBG] pgmap v413: 158 pgs: 158 active+clean; 6.6 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 1023 B/s rd, 67 MiB/s wr, 1.07k op/s 2024-02-10T08:25:56.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:25:55.326445+0000 mon.b (mon.1) 58 : audit [INF] from='client.? 172.21.15.18:0/4236772111' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:25:56.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:25:55.327144+0000 mon.a (mon.0) 1144 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:25:56.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:54.730059+0000 mgr.y (mgr.14505) 348 : cluster [DBG] pgmap v413: 158 pgs: 158 active+clean; 6.6 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 1023 B/s rd, 67 MiB/s wr, 1.07k op/s 2024-02-10T08:25:56.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:25:55.326445+0000 mon.b (mon.1) 58 : audit [INF] from='client.? 172.21.15.18:0/4236772111' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:25:56.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:25:55.327144+0000 mon.a (mon.0) 1144 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:25:56.363 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 79 16 112461 112445 88.9209 71.5 0.0127857 0.0112417 2024-02-10T08:25:56.791 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:25:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:25:56] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:25:57.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:55.805800+0000 mon.a (mon.0) 1145 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:25:57.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:25:55.819658+0000 mon.a (mon.0) 1146 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-10T08:25:57.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:55.819722+0000 mon.a (mon.0) 1147 : cluster [DBG] osdmap e216: 8 total, 8 up, 8 in 2024-02-10T08:25:57.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:55.805800+0000 mon.a (mon.0) 1145 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:25:57.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:25:55.819658+0000 mon.a (mon.0) 1146 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-10T08:25:57.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:55.819722+0000 mon.a (mon.0) 1147 : cluster [DBG] osdmap e216: 8 total, 8 up, 8 in 2024-02-10T08:25:57.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:55.805800+0000 mon.a (mon.0) 1145 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:25:57.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:25:55.819658+0000 mon.a (mon.0) 1146 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-10T08:25:57.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:55.819722+0000 mon.a (mon.0) 1147 : cluster [DBG] osdmap e216: 8 total, 8 up, 8 in 2024-02-10T08:25:57.363 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:2024-02-10T08:25:57.363716+0000 min lat: 0.00125956 max lat: 0.474095 avg lat: 0.0112761 2024-02-10T08:25:57.363 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-02-10T08:25:57.363 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 80 16 113535 113519 88.6485 67.125 0.0195425 0.0112761 2024-02-10T08:25:57.404 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:25:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:25:57] "GET /metrics HTTP/1.1" 200 175951 "" "Prometheus/2.33.4" 2024-02-10T08:25:57.829 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:56.730459+0000 mgr.y (mgr.14505) 349 : cluster [DBG] pgmap v415: 158 pgs: 158 active+clean; 6.6 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 1023 B/s rd, 67 MiB/s wr, 1.07k op/s 2024-02-10T08:25:58.055 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:25:58.061 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:25:58.061 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:25:58.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:56.730459+0000 mgr.y (mgr.14505) 349 : cluster [DBG] pgmap v415: 158 pgs: 158 active+clean; 6.6 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 1023 B/s rd, 67 MiB/s wr, 1.07k op/s 2024-02-10T08:25:58.162 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:25:58.195 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:25:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:25:58.195 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:56.730459+0000 mgr.y (mgr.14505) 349 : cluster [DBG] pgmap v415: 158 pgs: 158 active+clean; 6.6 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 1023 B/s rd, 67 MiB/s wr, 1.07k op/s 2024-02-10T08:25:58.197 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:25:58.356 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:25:58.356 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:25:58.363 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 81 16 114616 114600 88.3881 67.5625 0.0192242 0.0113093 2024-02-10T08:25:58.368 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:25:58.409 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:25:58.457 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:25:58.493 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:25:58.527 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:25:58.576 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:25:58.599 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-10T08:25:58.599 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-10T08:25:58.599 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-10T08:25:58.600 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-10T08:25:58.600 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-10T08:25:58.600 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-10T08:25:58.600 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-10T08:25:58.600 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-10T08:25:58.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:25:57.998658+0000 mgr.y (mgr.14505) 350 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:25:58.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:25:58.260777+0000 mon.c (mon.2) 46 : audit [DBG] from='client.? 172.21.15.18:0/125165697' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:25:58.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:25:57.998658+0000 mgr.y (mgr.14505) 350 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:25:58.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:25:58.260777+0000 mon.c (mon.2) 46 : audit [DBG] from='client.? 172.21.15.18:0/125165697' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:25:58.906 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd unset noscrub 2024-02-10T08:25:59.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:25:57.998658+0000 mgr.y (mgr.14505) 350 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:25:59.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:25:58.260777+0000 mon.c (mon.2) 46 : audit [DBG] from='client.? 172.21.15.18:0/125165697' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:25:59.363 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 82 16 115672 115656 88.1151 66 0.00919129 0.0113442 2024-02-10T08:26:00.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:25:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:25:58.731119+0000 mgr.y (mgr.14505) 351 : cluster [DBG] pgmap v416: 158 pgs: 158 active+clean; 6.9 GiB data, 23 GiB used, 692 GiB / 715 GiB avail; 1023 B/s rd, 67 MiB/s wr, 1.07k op/s 2024-02-10T08:26:00.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:25:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:25:58.731119+0000 mgr.y (mgr.14505) 351 : cluster [DBG] pgmap v416: 158 pgs: 158 active+clean; 6.9 GiB data, 23 GiB used, 692 GiB / 715 GiB avail; 1023 B/s rd, 67 MiB/s wr, 1.07k op/s 2024-02-10T08:26:00.293 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:25:59 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:25:58.731119+0000 mgr.y (mgr.14505) 351 : cluster [DBG] pgmap v416: 158 pgs: 158 active+clean; 6.9 GiB data, 23 GiB used, 692 GiB / 715 GiB avail; 1023 B/s rd, 67 MiB/s wr, 1.07k op/s 2024-02-10T08:26:00.363 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 83 15 116751 116736 87.8668 67.5 0.0108984 0.0113769 2024-02-10T08:26:01.364 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 84 16 117797 117781 87.5983 65.3125 0.00730506 0.0114117 2024-02-10T08:26:01.726 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:26:01.729 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.0 dump_ops_in_flight 2024-02-10T08:26:01.729 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:01.730 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:26:01.732 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-10T08:26:01.830 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:26:01.876 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:01.911 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:26:01.920 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:00.731825+0000 mgr.y (mgr.14505) 352 : cluster [DBG] pgmap v417: 158 pgs: 158 active+clean; 7.0 GiB data, 23 GiB used, 692 GiB / 715 GiB avail; 1023 B/s rd, 67 MiB/s wr, 1.07k op/s 2024-02-10T08:26:01.920 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:01.921 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:26:02.022 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:26:02.080 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:00.731825+0000 mgr.y (mgr.14505) 352 : cluster [DBG] pgmap v417: 158 pgs: 158 active+clean; 7.0 GiB data, 23 GiB used, 692 GiB / 715 GiB avail; 1023 B/s rd, 67 MiB/s wr, 1.07k op/s 2024-02-10T08:26:02.081 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:00.731825+0000 mgr.y (mgr.14505) 352 : cluster [DBG] pgmap v417: 158 pgs: 158 active+clean; 7.0 GiB data, 23 GiB used, 692 GiB / 715 GiB avail; 1023 B/s rd, 67 MiB/s wr, 1.07k op/s 2024-02-10T08:26:02.082 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:02.364 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 85 16 118808 118792 87.3112 63.1875 0.0108439 0.0114493 2024-02-10T08:26:03.364 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 86 16 119924 119908 87.107 69.75 0.0142805 0.0114759 2024-02-10T08:26:04.051 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:26:04.059 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:02.733654+0000 mgr.y (mgr.14505) 353 : cluster [DBG] pgmap v418: 158 pgs: 158 active+clean; 7.2 GiB data, 24 GiB used, 692 GiB / 715 GiB avail; 1023 B/s rd, 66 MiB/s wr, 1.06k op/s 2024-02-10T08:26:04.059 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:04.060 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:26:04.060 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:02.733654+0000 mgr.y (mgr.14505) 353 : cluster [DBG] pgmap v418: 158 pgs: 158 active+clean; 7.2 GiB data, 24 GiB used, 692 GiB / 715 GiB avail; 1023 B/s rd, 66 MiB/s wr, 1.06k op/s 2024-02-10T08:26:04.161 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:26:04.204 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:02.733654+0000 mgr.y (mgr.14505) 353 : cluster [DBG] pgmap v418: 158 pgs: 158 active+clean; 7.2 GiB data, 24 GiB used, 692 GiB / 715 GiB avail; 1023 B/s rd, 66 MiB/s wr, 1.06k op/s 2024-02-10T08:26:04.205 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:04.246 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:26:04.249 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:04.249 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:26:04.350 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:26:04.366 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 87 16 121065 121049 86.923 71.3125 0.0126205 0.0114999 2024-02-10T08:26:04.406 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:05.368 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 88 16 122198 122182 86.7387 70.8125 0.0141958 0.0115249 2024-02-10T08:26:06.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:04.734264+0000 mgr.y (mgr.14505) 354 : cluster [DBG] pgmap v419: 158 pgs: 158 active+clean; 7.3 GiB data, 24 GiB used, 691 GiB / 715 GiB avail; 1023 B/s rd, 66 MiB/s wr, 1.06k op/s 2024-02-10T08:26:06.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:05.116218+0000 osd.0 (osd.0) 104 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:26:06.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:05.116288+0000 osd.0 (osd.0) 105 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:26:06.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:04.734264+0000 mgr.y (mgr.14505) 354 : cluster [DBG] pgmap v419: 158 pgs: 158 active+clean; 7.3 GiB data, 24 GiB used, 691 GiB / 715 GiB avail; 1023 B/s rd, 66 MiB/s wr, 1.06k op/s 2024-02-10T08:26:06.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:05.116218+0000 osd.0 (osd.0) 104 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:26:06.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:05.116288+0000 osd.0 (osd.0) 105 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:26:06.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:04.734264+0000 mgr.y (mgr.14505) 354 : cluster [DBG] pgmap v419: 158 pgs: 158 active+clean; 7.3 GiB data, 24 GiB used, 691 GiB / 715 GiB avail; 1023 B/s rd, 66 MiB/s wr, 1.06k op/s 2024-02-10T08:26:06.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:05.116218+0000 osd.0 (osd.0) 104 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:26:06.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:05.116288+0000 osd.0 (osd.0) 105 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:26:06.370 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 89 16 123370 123354 86.5847 73.25 0.010919 0.0115451 2024-02-10T08:26:06.789 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:26:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:26:06] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:26:07.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:05.806062+0000 mon.a (mon.0) 1148 : cluster [DBG] osdmap e217: 8 total, 8 up, 8 in 2024-02-10T08:26:07.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:05.806062+0000 mon.a (mon.0) 1148 : cluster [DBG] osdmap e217: 8 total, 8 up, 8 in 2024-02-10T08:26:07.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:05.806062+0000 mon.a (mon.0) 1148 : cluster [DBG] osdmap e217: 8 total, 8 up, 8 in 2024-02-10T08:26:07.370 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Total time run: 90.0059 2024-02-10T08:26:07.370 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Total writes made: 124429 2024-02-10T08:26:07.371 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Write size: 65536 2024-02-10T08:26:07.371 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Object size: 65536 2024-02-10T08:26:07.371 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Bandwidth (MB/sec): 86.4033 2024-02-10T08:26:07.371 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Stddev Bandwidth: 32.0062 2024-02-10T08:26:07.371 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Max bandwidth (MB/sec): 222.438 2024-02-10T08:26:07.371 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Min bandwidth (MB/sec): 56.9375 2024-02-10T08:26:07.371 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Average IOPS: 1382 2024-02-10T08:26:07.371 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Stddev IOPS: 512.099 2024-02-10T08:26:07.371 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Max IOPS: 3559 2024-02-10T08:26:07.371 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Min IOPS: 911 2024-02-10T08:26:07.371 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Average Latency(s): 0.0115701 2024-02-10T08:26:07.371 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Stddev Latency(s): 0.00830727 2024-02-10T08:26:07.371 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Max latency(s): 0.474095 2024-02-10T08:26:07.371 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Min latency(s): 0.00125956 2024-02-10T08:26:07.375 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Cleaning up (deleting benchmark objects) 2024-02-10T08:26:07.404 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:26:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:26:07] "GET /metrics HTTP/1.1" 200 175964 "" "Prometheus/2.33.4" 2024-02-10T08:26:08.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:06.735888+0000 mgr.y (mgr.14505) 355 : cluster [DBG] pgmap v421: 158 pgs: 158 active+clean; 7.3 GiB data, 24 GiB used, 691 GiB / 715 GiB avail; 1023 B/s rd, 66 MiB/s wr, 1.06k op/s 2024-02-10T08:26:08.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:06.735888+0000 mgr.y (mgr.14505) 355 : cluster [DBG] pgmap v421: 158 pgs: 158 active+clean; 7.3 GiB data, 24 GiB used, 691 GiB / 715 GiB avail; 1023 B/s rd, 66 MiB/s wr, 1.06k op/s 2024-02-10T08:26:08.289 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:26:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:26:08.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:06.735888+0000 mgr.y (mgr.14505) 355 : cluster [DBG] pgmap v421: 158 pgs: 158 active+clean; 7.3 GiB data, 24 GiB used, 691 GiB / 715 GiB avail; 1023 B/s rd, 66 MiB/s wr, 1.06k op/s 2024-02-10T08:26:09.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:07.546990+0000 osd.5 (osd.5) 111 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:26:09.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:07.547045+0000 osd.5 (osd.5) 112 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:26:09.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:07.841803+0000 mon.a (mon.0) 1149 : cluster [DBG] osdmap e218: 8 total, 8 up, 8 in 2024-02-10T08:26:09.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:26:08.008495+0000 mgr.y (mgr.14505) 356 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:26:09.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:07.546990+0000 osd.5 (osd.5) 111 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:26:09.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:07.547045+0000 osd.5 (osd.5) 112 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:26:09.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:07.841803+0000 mon.a (mon.0) 1149 : cluster [DBG] osdmap e218: 8 total, 8 up, 8 in 2024-02-10T08:26:09.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:26:08.008495+0000 mgr.y (mgr.14505) 356 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:26:09.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:07.546990+0000 osd.5 (osd.5) 111 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:26:09.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:07.547045+0000 osd.5 (osd.5) 112 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:26:09.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:07.841803+0000 mon.a (mon.0) 1149 : cluster [DBG] osdmap e218: 8 total, 8 up, 8 in 2024-02-10T08:26:09.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:26:08.008495+0000 mgr.y (mgr.14505) 356 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:26:09.386 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:26:09.391 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph tell osd.4 reset_purged_snaps_last 2024-02-10T08:26:09.394 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:09.394 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:26:09.411 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:26:09.495 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:26:09.536 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:09.559 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:26:09.565 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:09.566 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:26:09.666 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:26:09.704 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:09.731 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:26:09.737 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:09.737 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:26:09.838 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:26:09.905 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:10.021 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:26:10.025 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:10.025 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:26:10.026 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:08.736349+0000 mgr.y (mgr.14505) 357 : cluster [DBG] pgmap v423: 158 pgs: 158 active+clean; 7.6 GiB data, 25 GiB used, 690 GiB / 715 GiB avail; 1.4 KiB/s rd, 77 MiB/s wr, 1.28k op/s 2024-02-10T08:26:10.026 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:08.736349+0000 mgr.y (mgr.14505) 357 : cluster [DBG] pgmap v423: 158 pgs: 158 active+clean; 7.6 GiB data, 25 GiB used, 690 GiB / 715 GiB avail; 1.4 KiB/s rd, 77 MiB/s wr, 1.28k op/s 2024-02-10T08:26:10.126 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:26:10.169 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:08.736349+0000 mgr.y (mgr.14505) 357 : cluster [DBG] pgmap v423: 158 pgs: 158 active+clean; 7.6 GiB data, 25 GiB used, 690 GiB / 715 GiB avail; 1.4 KiB/s rd, 77 MiB/s wr, 1.28k op/s 2024-02-10T08:26:10.171 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:10.198 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:26:10.202 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:10.202 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:26:10.303 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:26:10.347 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:10.378 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:26:10.381 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:10.382 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:26:10.408 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:26:10.417 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:26:10.474 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:26:10.482 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:26:10.539 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:11.948 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:10.738418+0000 mgr.y (mgr.14505) 358 : cluster [DBG] pgmap v424: 158 pgs: 158 active+clean; 7.6 GiB data, 25 GiB used, 690 GiB / 715 GiB avail; 767 B/s rd, 52 MiB/s wr, 914 op/s 2024-02-10T08:26:11.948 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:10.738418+0000 mgr.y (mgr.14505) 358 : cluster [DBG] pgmap v424: 158 pgs: 158 active+clean; 7.6 GiB data, 25 GiB used, 690 GiB / 715 GiB avail; 767 B/s rd, 52 MiB/s wr, 914 op/s 2024-02-10T08:26:12.043 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:10.738418+0000 mgr.y (mgr.14505) 358 : cluster [DBG] pgmap v424: 158 pgs: 158 active+clean; 7.6 GiB data, 25 GiB used, 690 GiB / 715 GiB avail; 767 B/s rd, 52 MiB/s wr, 914 op/s 2024-02-10T08:26:13.854 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is unset 2024-02-10T08:26:14.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:12.739148+0000 mgr.y (mgr.14505) 359 : cluster [DBG] pgmap v425: 158 pgs: 158 active+clean; 7.3 GiB data, 25 GiB used, 691 GiB / 715 GiB avail; 1.4 KiB/s rd, 39 MiB/s wr, 1.22k op/s 2024-02-10T08:26:14.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:26:13.564381+0000 mon.b (mon.1) 59 : audit [INF] from='client.? 172.21.15.18:0/979976264' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:26:14.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:26:13.566058+0000 mon.a (mon.0) 1150 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:26:14.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:12.739148+0000 mgr.y (mgr.14505) 359 : cluster [DBG] pgmap v425: 158 pgs: 158 active+clean; 7.3 GiB data, 25 GiB used, 691 GiB / 715 GiB avail; 1.4 KiB/s rd, 39 MiB/s wr, 1.22k op/s 2024-02-10T08:26:14.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:26:13.564381+0000 mon.b (mon.1) 59 : audit [INF] from='client.? 172.21.15.18:0/979976264' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:26:14.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:26:13.566058+0000 mon.a (mon.0) 1150 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:26:14.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:12.739148+0000 mgr.y (mgr.14505) 359 : cluster [DBG] pgmap v425: 158 pgs: 158 active+clean; 7.3 GiB data, 25 GiB used, 691 GiB / 715 GiB avail; 1.4 KiB/s rd, 39 MiB/s wr, 1.22k op/s 2024-02-10T08:26:14.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:26:13.564381+0000 mon.b (mon.1) 59 : audit [INF] from='client.? 172.21.15.18:0/979976264' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:26:14.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:26:13.566058+0000 mon.a (mon.0) 1150 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:26:15.124 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:13.806291+0000 mon.a (mon.0) 1151 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:26:15.125 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:26:13.832812+0000 mon.a (mon.0) 1152 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-10T08:26:15.125 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:13.832871+0000 mon.a (mon.0) 1153 : cluster [DBG] osdmap e219: 8 total, 8 up, 8 in 2024-02-10T08:26:15.125 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:14.118579+0000 osd.7 (osd.7) 117 : cluster [DBG] 2.1b scrub starts 2024-02-10T08:26:15.125 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:14.128443+0000 osd.7 (osd.7) 118 : cluster [DBG] 2.1b scrub ok 2024-02-10T08:26:15.125 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:14.183227+0000 osd.1 (osd.1) 112 : cluster [DBG] 4.14 scrub starts 2024-02-10T08:26:15.125 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:14.187208+0000 osd.1 (osd.1) 113 : cluster [DBG] 4.14 scrub ok 2024-02-10T08:26:15.126 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:13.806291+0000 mon.a (mon.0) 1151 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:26:15.126 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:26:13.832812+0000 mon.a (mon.0) 1152 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-10T08:26:15.126 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:13.832871+0000 mon.a (mon.0) 1153 : cluster [DBG] osdmap e219: 8 total, 8 up, 8 in 2024-02-10T08:26:15.126 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:14.118579+0000 osd.7 (osd.7) 117 : cluster [DBG] 2.1b scrub starts 2024-02-10T08:26:15.126 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:14.128443+0000 osd.7 (osd.7) 118 : cluster [DBG] 2.1b scrub ok 2024-02-10T08:26:15.127 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:14.183227+0000 osd.1 (osd.1) 112 : cluster [DBG] 4.14 scrub starts 2024-02-10T08:26:15.127 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:14.187208+0000 osd.1 (osd.1) 113 : cluster [DBG] 4.14 scrub ok 2024-02-10T08:26:15.157 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:26:15.161 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:15.161 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:26:15.262 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:26:15.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:13.806291+0000 mon.a (mon.0) 1151 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:26:15.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:26:13.832812+0000 mon.a (mon.0) 1152 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-10T08:26:15.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:13.832871+0000 mon.a (mon.0) 1153 : cluster [DBG] osdmap e219: 8 total, 8 up, 8 in 2024-02-10T08:26:15.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:14.118579+0000 osd.7 (osd.7) 117 : cluster [DBG] 2.1b scrub starts 2024-02-10T08:26:15.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:14.128443+0000 osd.7 (osd.7) 118 : cluster [DBG] 2.1b scrub ok 2024-02-10T08:26:15.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:14.183227+0000 osd.1 (osd.1) 112 : cluster [DBG] 4.14 scrub starts 2024-02-10T08:26:15.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:14.187208+0000 osd.1 (osd.1) 113 : cluster [DBG] 4.14 scrub ok 2024-02-10T08:26:15.318 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:16.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:14.136529+0000 osd.4 (osd.4) 30 : cluster [DBG] 5.1 scrub starts 2024-02-10T08:26:16.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:14.142569+0000 osd.4 (osd.4) 31 : cluster [DBG] 5.1 scrub ok 2024-02-10T08:26:16.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:14.739815+0000 mgr.y (mgr.14505) 360 : cluster [DBG] pgmap v427: 158 pgs: 158 active+clean; 7.2 GiB data, 24 GiB used, 691 GiB / 715 GiB avail; 1.4 KiB/s rd, 39 MiB/s wr, 1.45k op/s 2024-02-10T08:26:16.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:14.834444+0000 osd.4 (osd.4) 32 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:26:16.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:14.834512+0000 osd.4 (osd.4) 33 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:26:16.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:15.110490+0000 osd.7 (osd.7) 119 : cluster [DBG] 5.14 scrub starts 2024-02-10T08:26:16.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:15.114801+0000 osd.7 (osd.7) 120 : cluster [DBG] 5.14 scrub ok 2024-02-10T08:26:16.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:15.189946+0000 osd.6 (osd.6) 87 : cluster [DBG] 6.22 scrub starts 2024-02-10T08:26:16.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:15.206500+0000 osd.6 (osd.6) 88 : cluster [DBG] 6.22 scrub ok 2024-02-10T08:26:16.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:14.136529+0000 osd.4 (osd.4) 30 : cluster [DBG] 5.1 scrub starts 2024-02-10T08:26:16.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:14.142569+0000 osd.4 (osd.4) 31 : cluster [DBG] 5.1 scrub ok 2024-02-10T08:26:16.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:14.739815+0000 mgr.y (mgr.14505) 360 : cluster [DBG] pgmap v427: 158 pgs: 158 active+clean; 7.2 GiB data, 24 GiB used, 691 GiB / 715 GiB avail; 1.4 KiB/s rd, 39 MiB/s wr, 1.45k op/s 2024-02-10T08:26:16.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:14.834444+0000 osd.4 (osd.4) 32 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:26:16.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:14.834512+0000 osd.4 (osd.4) 33 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:26:16.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:15.110490+0000 osd.7 (osd.7) 119 : cluster [DBG] 5.14 scrub starts 2024-02-10T08:26:16.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:15.114801+0000 osd.7 (osd.7) 120 : cluster [DBG] 5.14 scrub ok 2024-02-10T08:26:16.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:15.189946+0000 osd.6 (osd.6) 87 : cluster [DBG] 6.22 scrub starts 2024-02-10T08:26:16.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:15.206500+0000 osd.6 (osd.6) 88 : cluster [DBG] 6.22 scrub ok 2024-02-10T08:26:16.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:14.136529+0000 osd.4 (osd.4) 30 : cluster [DBG] 5.1 scrub starts 2024-02-10T08:26:16.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:14.142569+0000 osd.4 (osd.4) 31 : cluster [DBG] 5.1 scrub ok 2024-02-10T08:26:16.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:14.739815+0000 mgr.y (mgr.14505) 360 : cluster [DBG] pgmap v427: 158 pgs: 158 active+clean; 7.2 GiB data, 24 GiB used, 691 GiB / 715 GiB avail; 1.4 KiB/s rd, 39 MiB/s wr, 1.45k op/s 2024-02-10T08:26:16.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:14.834444+0000 osd.4 (osd.4) 32 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:26:16.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:14.834512+0000 osd.4 (osd.4) 33 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:26:16.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:15.110490+0000 osd.7 (osd.7) 119 : cluster [DBG] 5.14 scrub starts 2024-02-10T08:26:16.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:15.114801+0000 osd.7 (osd.7) 120 : cluster [DBG] 5.14 scrub ok 2024-02-10T08:26:16.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:15.189946+0000 osd.6 (osd.6) 87 : cluster [DBG] 6.22 scrub starts 2024-02-10T08:26:16.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:15.206500+0000 osd.6 (osd.6) 88 : cluster [DBG] 6.22 scrub ok 2024-02-10T08:26:16.609 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:26:16.616 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:16.617 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:26:16.718 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:26:16.763 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:16.792 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:26:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:26:16] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:26:16.796 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:26:16.800 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:16.801 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:26:16.902 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:26:16.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:15.832519+0000 mon.a (mon.0) 1154 : cluster [DBG] osdmap e220: 8 total, 8 up, 8 in 2024-02-10T08:26:16.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:16.152531+0000 osd.6 (osd.6) 89 : cluster [DBG] 6.27 scrub starts 2024-02-10T08:26:16.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:16.187109+0000 osd.6 (osd.6) 90 : cluster [DBG] 6.27 scrub ok 2024-02-10T08:26:16.907 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:15.832519+0000 mon.a (mon.0) 1154 : cluster [DBG] osdmap e220: 8 total, 8 up, 8 in 2024-02-10T08:26:16.907 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:16.152531+0000 osd.6 (osd.6) 89 : cluster [DBG] 6.27 scrub starts 2024-02-10T08:26:16.907 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:16.187109+0000 osd.6 (osd.6) 90 : cluster [DBG] 6.27 scrub ok 2024-02-10T08:26:16.941 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:16.966 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:26:16.970 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:16.971 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:26:17.072 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:26:17.158 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:17.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:15.832519+0000 mon.a (mon.0) 1154 : cluster [DBG] osdmap e220: 8 total, 8 up, 8 in 2024-02-10T08:26:17.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:16.152531+0000 osd.6 (osd.6) 89 : cluster [DBG] 6.27 scrub starts 2024-02-10T08:26:17.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:16.187109+0000 osd.6 (osd.6) 90 : cluster [DBG] 6.27 scrub ok 2024-02-10T08:26:17.326 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:26:17.336 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:17.337 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:26:17.356 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph tell osd.5 reset_purged_snaps_last 2024-02-10T08:26:17.358 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:26:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:26:17] "GET /metrics HTTP/1.1" 200 175978 "" "Prometheus/2.33.4" 2024-02-10T08:26:17.438 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:26:17.525 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:17.945 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-02-10T08:26:17.945 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-02-10T08:26:17.945 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:17.945 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14964.0:135705 8.e 8:78702c5b:::benchmark_data_smithi018_103312_object11273:head [delete] snapc 0=[] ondisk+write+known_if_redirected e220)", 2024-02-10T08:26:17.945 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:26:17.065527+0000", 2024-02-10T08:26:17.945 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.012613292, 2024-02-10T08:26:17.945 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.012640635000000001, 2024-02-10T08:26:17.945 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:26:17.945 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "waiting for sub ops", 2024-02-10T08:26:17.945 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:26:17.945 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14964", 2024-02-10T08:26:17.946 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/3173131962", 2024-02-10T08:26:17.946 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 135705 2024-02-10T08:26:17.946 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:17.946 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:26:17.946 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:17.946 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:26:17.946 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:17.065527+0000", 2024-02-10T08:26:17.946 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:26:17.946 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:17.946 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:17.946 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:26:17.946 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:17.065527+0000", 2024-02-10T08:26:17.946 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:26:17.946 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:17.946 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:17.946 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:26:17.947 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:17.065525+0000", 2024-02-10T08:26:17.947 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4590000000000001e-06 2024-02-10T08:26:17.947 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:17.947 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:17.947 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:26:17.947 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:17.065533+0000", 2024-02-10T08:26:17.947 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4766999999999999e-05 2024-02-10T08:26:17.947 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:17.947 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:17.947 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:26:17.947 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:17.065547+0000", 2024-02-10T08:26:17.947 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0849999999999999e-06 2024-02-10T08:26:17.947 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:17.947 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:17.947 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:26:17.947 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:17.065554+0000", 2024-02-10T08:26:17.948 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000109089 2024-02-10T08:26:17.948 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:17.948 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:17.948 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:26:17.948 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:17.065663+0000", 2024-02-10T08:26:17.948 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012894999999999999 2024-02-10T08:26:17.948 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:17.948 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:17.948 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:26:17.948 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:17.065792+0000", 2024-02-10T08:26:17.948 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011614499999999999 2024-02-10T08:26:17.948 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:17.948 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:17.948 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 2,4", 2024-02-10T08:26:17.949 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:17.065909+0000", 2024-02-10T08:26:17.949 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0082539390000000001 2024-02-10T08:26:17.949 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:17.949 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:17.949 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:26:17.949 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:17.074163+0000", 2024-02-10T08:26:17.949 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000135659 2024-02-10T08:26:17.949 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:17.949 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:17.949 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:26:17.949 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:17.074298+0000", 2024-02-10T08:26:17.949 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0087716370000000005 2024-02-10T08:26:17.949 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:26:17.949 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:26:17.949 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:26:17.950 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:17.950 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:17.950 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14964.0:135706 8.6 8:6352ce16:::benchmark_data_smithi018_103312_object11274:head [delete] snapc 0=[] ondisk+write+known_if_redirected e220)", 2024-02-10T08:26:17.950 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:26:17.065568+0000", 2024-02-10T08:26:17.950 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.012571901, 2024-02-10T08:26:17.950 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.012709109999999999, 2024-02-10T08:26:17.950 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:26:17.950 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "waiting for sub ops", 2024-02-10T08:26:17.950 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:26:17.950 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14964", 2024-02-10T08:26:17.950 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/3173131962", 2024-02-10T08:26:17.950 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 135706 2024-02-10T08:26:17.950 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:17.950 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:26:17.951 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:17.951 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:26:17.951 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:17.065568+0000", 2024-02-10T08:26:17.951 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:26:17.951 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:17.951 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:17.951 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:26:17.951 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:17.065568+0000", 2024-02-10T08:26:17.951 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:26:17.951 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:17.951 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:17.951 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:26:17.951 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:17.065567+0000", 2024-02-10T08:26:17.951 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9639999999999997e-06 2024-02-10T08:26:17.951 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:17.951 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:17.952 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:26:17.952 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:17.065571+0000", 2024-02-10T08:26:17.952 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9269999999999999e-06 2024-02-10T08:26:17.952 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:17.952 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:17.952 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:26:17.952 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:17.065578+0000", 2024-02-10T08:26:17.952 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6600000000000003e-06 2024-02-10T08:26:17.952 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:17.952 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:17.952 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:26:17.952 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:17.065583+0000", 2024-02-10T08:26:17.952 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00066482599999999998 2024-02-10T08:26:17.952 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:17.953 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:17.953 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:26:17.953 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:17.066248+0000", 2024-02-10T08:26:17.953 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8196000000000006e-05 2024-02-10T08:26:17.953 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:17.953 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:17.953 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:26:17.953 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:17.066346+0000", 2024-02-10T08:26:17.953 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000115469 2024-02-10T08:26:17.953 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:17.953 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:17.953 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 6,7", 2024-02-10T08:26:17.953 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:17.066461+0000", 2024-02-10T08:26:17.953 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0078441980000000001 2024-02-10T08:26:17.953 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:17.953 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:17.954 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:26:17.954 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:17.074305+0000", 2024-02-10T08:26:17.954 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00079257299999999998 2024-02-10T08:26:17.954 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:17.954 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:17.954 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:26:17.954 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:17.075098+0000", 2024-02-10T08:26:17.954 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0095301020000000004 2024-02-10T08:26:17.954 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:26:17.954 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:26:17.954 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:26:17.954 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:17.954 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:17.954 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.14964.0:135713 8.2 e220/191 8:44f64ff3:::benchmark_data_smithi018_103312_object11281:head v 220'8452, mlcod=220'8449)", 2024-02-10T08:26:17.954 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:26:17.073004+0000", 2024-02-10T08:26:17.954 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.0051354959999999998, 2024-02-10T08:26:17.954 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.005374307, 2024-02-10T08:26:17.955 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:26:17.955 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-02-10T08:26:17.955 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:26:17.955 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:17.955 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:26:17.955 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:17.073004+0000", 2024-02-10T08:26:17.955 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:26:17.955 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:17.955 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:17.955 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:26:17.955 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:17.073004+0000", 2024-02-10T08:26:17.955 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:26:17.955 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:17.955 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:17.955 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:26:17.955 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:17.073004+0000", 2024-02-10T08:26:17.955 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2300000000000008e-06 2024-02-10T08:26:17.956 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:17.956 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:17.956 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:26:17.956 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:17.073012+0000", 2024-02-10T08:26:17.956 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5699999999999999e-05 2024-02-10T08:26:17.956 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:17.956 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:17.956 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:26:17.956 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:17.073027+0000", 2024-02-10T08:26:17.956 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0463e-05 2024-02-10T08:26:17.956 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:17.956 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:17.956 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:26:17.956 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:17.073038+0000", 2024-02-10T08:26:17.957 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000123705 2024-02-10T08:26:17.957 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:17.957 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:17.957 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:26:17.957 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:17.073162+0000", 2024-02-10T08:26:17.957 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9564000000000001e-05 2024-02-10T08:26:17.957 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:17.957 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:17.957 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:26:17.957 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:17.073181+0000", 2024-02-10T08:26:17.957 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017684499999999999 2024-02-10T08:26:17.957 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:26:17.957 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:26:17.957 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:26:17.957 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:17.958 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:17.958 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop_reply(client.14964.0:135705 8.e e220/191)", 2024-02-10T08:26:17.958 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:26:17.076238+0000", 2024-02-10T08:26:17.958 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.0019021719999999999, 2024-02-10T08:26:17.958 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0021784539999999998, 2024-02-10T08:26:17.958 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:26:17.958 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "queued for pg", 2024-02-10T08:26:17.958 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:26:17.958 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:17.958 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:26:17.958 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:17.076238+0000", 2024-02-10T08:26:17.958 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:26:17.958 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:17.958 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:17.958 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:26:17.959 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:17.076238+0000", 2024-02-10T08:26:17.959 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:26:17.959 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:17.959 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:17.959 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:26:17.959 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:17.076237+0000", 2024-02-10T08:26:17.959 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6109999999999999e-06 2024-02-10T08:26:17.959 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:17.959 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:17.959 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:26:17.959 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:17.076243+0000", 2024-02-10T08:26:17.959 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4131000000000001e-05 2024-02-10T08:26:17.959 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:17.959 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:17.959 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:26:17.959 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:17.076258+0000", 2024-02-10T08:26:17.959 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.844e-06 2024-02-10T08:26:17.960 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:17.960 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:17.960 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:26:17.960 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:17.076264+0000", 2024-02-10T08:26:17.960 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.6774000000000001e-05 2024-02-10T08:26:17.960 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:26:17.960 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:26:17.960 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:26:17.960 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:17.960 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:17.960 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14964.0:135718 8.6 8.62a43146 (undecoded) ondisk+write+known_if_redirected e220)", 2024-02-10T08:26:17.960 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:26:17.078264+0000", 2024-02-10T08:26:17.960 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4294967295.9998755, 2024-02-10T08:26:17.961 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000196854, 2024-02-10T08:26:17.961 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:26:17.961 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "queued for pg", 2024-02-10T08:26:17.961 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:26:17.961 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14964", 2024-02-10T08:26:17.961 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/3173131962", 2024-02-10T08:26:17.961 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 135718 2024-02-10T08:26:17.961 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:17.961 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:26:17.961 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:17.961 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:26:17.961 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:17.078264+0000", 2024-02-10T08:26:17.961 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:26:17.961 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:17.962 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:17.962 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:26:17.962 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:17.078264+0000", 2024-02-10T08:26:17.962 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:26:17.962 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:17.962 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:17.962 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:26:17.962 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:17.078263+0000", 2024-02-10T08:26:17.962 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5410000000000003e-06 2024-02-10T08:26:17.962 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:17.962 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:17.962 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:26:17.962 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:17.078270+0000", 2024-02-10T08:26:17.962 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4595e-05 2024-02-10T08:26:17.962 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:17.962 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:17.963 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:26:17.963 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:17.078285+0000", 2024-02-10T08:26:17.963 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4479999999999999e-06 2024-02-10T08:26:17.963 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:17.963 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:17.963 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:26:17.963 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:17.078291+0000", 2024-02-10T08:26:17.963 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.6948999999999999e-05 2024-02-10T08:26:17.963 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:26:17.963 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:26:17.963 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:26:17.963 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:17.963 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:17.963 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop_reply(client.14964.0:135706 8.6 e220/191)", 2024-02-10T08:26:17.963 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:26:17.078379+0000", 2024-02-10T08:26:17.964 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4294967295.9997616, 2024-02-10T08:26:17.964 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014934799999999999, 2024-02-10T08:26:17.964 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:26:17.964 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "queued for pg", 2024-02-10T08:26:17.964 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:26:17.964 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:17.964 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:26:17.964 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:17.078379+0000", 2024-02-10T08:26:17.964 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:26:17.964 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:17.964 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:17.964 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:26:17.964 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:17.078379+0000", 2024-02-10T08:26:17.964 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:26:17.964 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:17.965 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:17.965 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:26:17.965 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:17.078378+0000", 2024-02-10T08:26:17.965 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9339999999999999e-06 2024-02-10T08:26:17.965 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:17.965 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:17.965 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:26:17.965 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:17.078382+0000", 2024-02-10T08:26:17.965 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5710000000000004e-06 2024-02-10T08:26:17.965 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:17.965 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:17.965 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:26:17.965 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:17.078391+0000", 2024-02-10T08:26:17.965 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6290000000000001e-06 2024-02-10T08:26:17.965 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:17.965 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:17.965 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:26:17.966 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:17.078396+0000", 2024-02-10T08:26:17.966 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7561e-05 2024-02-10T08:26:17.966 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:26:17.966 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:26:17.966 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:26:17.966 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:26:17.966 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-02-10T08:26:17.966 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 6 2024-02-10T08:26:17.966 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-02-10T08:26:18.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:16.740210+0000 mgr.y (mgr.14505) 361 : cluster [DBG] pgmap v429: 158 pgs: 158 active+clean; 7.2 GiB data, 24 GiB used, 691 GiB / 715 GiB avail; 639 B/s rd, 2.9 MiB/s wr, 822 op/s 2024-02-10T08:26:18.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:17.095375+0000 osd.4 (osd.4) 34 : cluster [DBG] 5.e scrub starts 2024-02-10T08:26:18.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:17.102434+0000 osd.4 (osd.4) 35 : cluster [DBG] 5.e scrub ok 2024-02-10T08:26:18.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:17.209442+0000 osd.2 (osd.2) 95 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:26:18.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:17.209483+0000 osd.2 (osd.2) 96 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:26:18.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:16.740210+0000 mgr.y (mgr.14505) 361 : cluster [DBG] pgmap v429: 158 pgs: 158 active+clean; 7.2 GiB data, 24 GiB used, 691 GiB / 715 GiB avail; 639 B/s rd, 2.9 MiB/s wr, 822 op/s 2024-02-10T08:26:18.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:17.095375+0000 osd.4 (osd.4) 34 : cluster [DBG] 5.e scrub starts 2024-02-10T08:26:18.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:17.102434+0000 osd.4 (osd.4) 35 : cluster [DBG] 5.e scrub ok 2024-02-10T08:26:18.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:17.209442+0000 osd.2 (osd.2) 95 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:26:18.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:17.209483+0000 osd.2 (osd.2) 96 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:26:18.216 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd unset nodeep-scrub 2024-02-10T08:26:18.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:16.740210+0000 mgr.y (mgr.14505) 361 : cluster [DBG] pgmap v429: 158 pgs: 158 active+clean; 7.2 GiB data, 24 GiB used, 691 GiB / 715 GiB avail; 639 B/s rd, 2.9 MiB/s wr, 822 op/s 2024-02-10T08:26:18.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:17.095375+0000 osd.4 (osd.4) 34 : cluster [DBG] 5.e scrub starts 2024-02-10T08:26:18.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:17.102434+0000 osd.4 (osd.4) 35 : cluster [DBG] 5.e scrub ok 2024-02-10T08:26:18.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:17.209442+0000 osd.2 (osd.2) 95 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:26:18.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:17.209483+0000 osd.2 (osd.2) 96 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:26:18.292 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:26:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:26:18.695 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:26:18.697 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.0 dump_blocked_ops 2024-02-10T08:26:18.706 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:18.707 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:26:18.808 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:26:18.908 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:19.049 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:26:19.062 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:19.063 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:26:19.063 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:17.857401+0000 mon.a (mon.0) 1155 : cluster [DBG] osdmap e221: 8 total, 8 up, 8 in 2024-02-10T08:26:19.063 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:26:18.019612+0000 mgr.y (mgr.14505) 362 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:26:19.064 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:17.857401+0000 mon.a (mon.0) 1155 : cluster [DBG] osdmap e221: 8 total, 8 up, 8 in 2024-02-10T08:26:19.064 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:26:18.019612+0000 mgr.y (mgr.14505) 362 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:26:19.164 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:26:19.214 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:19.280 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:26:19.285 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:19.285 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:26:19.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:17.857401+0000 mon.a (mon.0) 1155 : cluster [DBG] osdmap e221: 8 total, 8 up, 8 in 2024-02-10T08:26:19.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:26:18.019612+0000 mgr.y (mgr.14505) 362 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:26:19.385 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:26:19.426 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:19.436 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:26:19.436 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:26:19.453 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:26:19.459 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:19.460 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:26:19.493 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:26:19.512 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:26:19.557 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:26:19.560 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:26:19.600 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:26:19.627 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:26:19.630 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:19.653 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:26:19.676 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:26:19.705 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:26:19.742 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:26:19.756 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-10T08:26:19.756 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-10T08:26:19.756 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-10T08:26:19.756 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-10T08:26:19.757 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-10T08:26:19.757 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-10T08:26:19.757 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-10T08:26:19.757 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-10T08:26:19.782 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:26:19.788 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:19.789 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:26:19.890 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:26:19.925 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:19.959 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:26:19.961 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:19.962 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:26:20.062 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:26:20.104 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:20.238 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:18.742926+0000 mgr.y (mgr.14505) 363 : cluster [DBG] pgmap v431: 158 pgs: 158 active+clean; 6.9 GiB data, 23 GiB used, 692 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 1.13k op/s 2024-02-10T08:26:20.238 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:19.130326+0000 osd.0 (osd.0) 106 : cluster [DBG] 8.e scrub starts 2024-02-10T08:26:20.239 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:19.192395+0000 osd.3 (osd.3) 97 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:26:20.239 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:19.192448+0000 osd.3 (osd.3) 98 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:26:20.239 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:19.215462+0000 osd.1 (osd.1) 114 : cluster [DBG] 2.a scrub starts 2024-02-10T08:26:20.239 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:19.229254+0000 osd.1 (osd.1) 115 : cluster [DBG] 2.a scrub ok 2024-02-10T08:26:20.239 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:26:19.461778+0000 mon.c (mon.2) 47 : audit [DBG] from='client.? 172.21.15.18:0/4241940810' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:26:20.239 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:18.742926+0000 mgr.y (mgr.14505) 363 : cluster [DBG] pgmap v431: 158 pgs: 158 active+clean; 6.9 GiB data, 23 GiB used, 692 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 1.13k op/s 2024-02-10T08:26:20.239 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:19.130326+0000 osd.0 (osd.0) 106 : cluster [DBG] 8.e scrub starts 2024-02-10T08:26:20.239 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:19.192395+0000 osd.3 (osd.3) 97 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:26:20.239 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:19.192448+0000 osd.3 (osd.3) 98 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:26:20.239 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:19.215462+0000 osd.1 (osd.1) 114 : cluster [DBG] 2.a scrub starts 2024-02-10T08:26:20.239 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:19.229254+0000 osd.1 (osd.1) 115 : cluster [DBG] 2.a scrub ok 2024-02-10T08:26:20.239 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:26:19.461778+0000 mon.c (mon.2) 47 : audit [DBG] from='client.? 172.21.15.18:0/4241940810' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:26:20.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:18.742926+0000 mgr.y (mgr.14505) 363 : cluster [DBG] pgmap v431: 158 pgs: 158 active+clean; 6.9 GiB data, 23 GiB used, 692 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 1.13k op/s 2024-02-10T08:26:20.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:19.130326+0000 osd.0 (osd.0) 106 : cluster [DBG] 8.e scrub starts 2024-02-10T08:26:20.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:19.192395+0000 osd.3 (osd.3) 97 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:26:20.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:19.192448+0000 osd.3 (osd.3) 98 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:26:20.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:19.215462+0000 osd.1 (osd.1) 114 : cluster [DBG] 2.a scrub starts 2024-02-10T08:26:20.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:19.229254+0000 osd.1 (osd.1) 115 : cluster [DBG] 2.a scrub ok 2024-02-10T08:26:20.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:26:19.461778+0000 mon.c (mon.2) 47 : audit [DBG] from='client.? 172.21.15.18:0/4241940810' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:26:21.182 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:26:21.183 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:19.924106+0000 mon.a (mon.0) 1156 : cluster [DBG] osdmap e222: 8 total, 8 up, 8 in 2024-02-10T08:26:21.183 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:20.146755+0000 osd.7 (osd.7) 121 : cluster [DBG] 6.b scrub starts 2024-02-10T08:26:21.183 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:20.173942+0000 osd.7 (osd.7) 122 : cluster [DBG] 6.b scrub ok 2024-02-10T08:26:21.185 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:19.924106+0000 mon.a (mon.0) 1156 : cluster [DBG] osdmap e222: 8 total, 8 up, 8 in 2024-02-10T08:26:21.185 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:20.146755+0000 osd.7 (osd.7) 121 : cluster [DBG] 6.b scrub starts 2024-02-10T08:26:21.185 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:20.173942+0000 osd.7 (osd.7) 122 : cluster [DBG] 6.b scrub ok 2024-02-10T08:26:21.186 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:21.187 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:26:21.287 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:26:21.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:19.924106+0000 mon.a (mon.0) 1156 : cluster [DBG] osdmap e222: 8 total, 8 up, 8 in 2024-02-10T08:26:21.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:20.146755+0000 osd.7 (osd.7) 121 : cluster [DBG] 6.b scrub starts 2024-02-10T08:26:21.293 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:20.173942+0000 osd.7 (osd.7) 122 : cluster [DBG] 6.b scrub ok 2024-02-10T08:26:21.337 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:21.469 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:26:21.480 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:21.481 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:26:21.582 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:26:21.639 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:21.709 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:26:21.716 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:21.717 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:26:21.818 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:26:21.860 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:21.887 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:26:21.892 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:21.892 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:26:21.993 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:26:22.013 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:20.743334+0000 mgr.y (mgr.14505) 364 : cluster [DBG] pgmap v433: 158 pgs: 158 active+clean; 6.9 GiB data, 23 GiB used, 692 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 939 op/s 2024-02-10T08:26:22.014 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:20.743334+0000 mgr.y (mgr.14505) 364 : cluster [DBG] pgmap v433: 158 pgs: 158 active+clean; 6.9 GiB data, 23 GiB used, 692 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 939 op/s 2024-02-10T08:26:22.041 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:22.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:20.743334+0000 mgr.y (mgr.14505) 364 : cluster [DBG] pgmap v433: 158 pgs: 158 active+clean; 6.9 GiB data, 23 GiB used, 692 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 939 op/s 2024-02-10T08:26:22.523 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:26:22.532 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:22.532 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:26:22.633 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:26:22.677 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:22.702 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:26:22.705 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:22.705 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:26:22.806 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:26:22.862 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:23.002 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:26:23.014 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:23.015 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:26:23.116 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:26:23.171 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:23.185 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-10T08:26:24.222 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:22.744062+0000 mgr.y (mgr.14505) 365 : cluster [DBG] pgmap v434: 158 pgs: 158 active+clean; 6.6 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 1.35k op/s 2024-02-10T08:26:24.222 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:23.179684+0000 osd.0 (osd.0) 107 : cluster [DBG] 8.e scrub ok 2024-02-10T08:26:24.225 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:22.744062+0000 mgr.y (mgr.14505) 365 : cluster [DBG] pgmap v434: 158 pgs: 158 active+clean; 6.6 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 1.35k op/s 2024-02-10T08:26:24.225 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:23.179684+0000 osd.0 (osd.0) 107 : cluster [DBG] 8.e scrub ok 2024-02-10T08:26:24.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:22.744062+0000 mgr.y (mgr.14505) 365 : cluster [DBG] pgmap v434: 158 pgs: 158 active+clean; 6.6 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 1.35k op/s 2024-02-10T08:26:24.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:23.179684+0000 osd.0 (osd.0) 107 : cluster [DBG] 8.e scrub ok 2024-02-10T08:26:24.466 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:26:24.476 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:24.476 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:26:24.577 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:26:24.617 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:24.640 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:26:24.643 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:24.643 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:26:24.744 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:26:24.791 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:24.890 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:26:24.895 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:24.896 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:26:24.996 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:26:25.034 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:25.069 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:26:25.072 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:25.073 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:26:25.091 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:23.860498+0000 osd.5 (osd.5) 113 : cluster [DBG] 5.7 scrub starts 2024-02-10T08:26:25.091 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:23.864672+0000 osd.5 (osd.5) 114 : cluster [DBG] 5.7 scrub ok 2024-02-10T08:26:25.091 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:23.973375+0000 osd.4 (osd.4) 36 : cluster [DBG] 4.1a scrub starts 2024-02-10T08:26:25.091 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:23.981831+0000 osd.4 (osd.4) 37 : cluster [DBG] 4.1a scrub ok 2024-02-10T08:26:25.091 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:24.162073+0000 osd.1 (osd.1) 116 : cluster [DBG] 2.9 scrub starts 2024-02-10T08:26:25.091 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:24.169334+0000 osd.1 (osd.1) 117 : cluster [DBG] 2.9 scrub ok 2024-02-10T08:26:25.091 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:24.209584+0000 osd.7 (osd.7) 123 : cluster [DBG] 1.0 scrub starts 2024-02-10T08:26:25.091 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:24.214173+0000 osd.7 (osd.7) 124 : cluster [DBG] 1.0 scrub ok 2024-02-10T08:26:25.091 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:24.261242+0000 osd.6 (osd.6) 91 : cluster [DBG] 6.25 scrub starts 2024-02-10T08:26:25.091 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:24.287552+0000 osd.6 (osd.6) 92 : cluster [DBG] 6.25 scrub ok 2024-02-10T08:26:25.092 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:23.860498+0000 osd.5 (osd.5) 113 : cluster [DBG] 5.7 scrub starts 2024-02-10T08:26:25.092 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:23.864672+0000 osd.5 (osd.5) 114 : cluster [DBG] 5.7 scrub ok 2024-02-10T08:26:25.092 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:23.973375+0000 osd.4 (osd.4) 36 : cluster [DBG] 4.1a scrub starts 2024-02-10T08:26:25.092 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:23.981831+0000 osd.4 (osd.4) 37 : cluster [DBG] 4.1a scrub ok 2024-02-10T08:26:25.092 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:24.162073+0000 osd.1 (osd.1) 116 : cluster [DBG] 2.9 scrub starts 2024-02-10T08:26:25.092 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:24.169334+0000 osd.1 (osd.1) 117 : cluster [DBG] 2.9 scrub ok 2024-02-10T08:26:25.092 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:24.209584+0000 osd.7 (osd.7) 123 : cluster [DBG] 1.0 scrub starts 2024-02-10T08:26:25.092 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:24.214173+0000 osd.7 (osd.7) 124 : cluster [DBG] 1.0 scrub ok 2024-02-10T08:26:25.092 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:24.261242+0000 osd.6 (osd.6) 91 : cluster [DBG] 6.25 scrub starts 2024-02-10T08:26:25.092 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:24.287552+0000 osd.6 (osd.6) 92 : cluster [DBG] 6.25 scrub ok 2024-02-10T08:26:25.173 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:26:25.222 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:25.283 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-02-10T08:26:25.283 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:26:25.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:23.860498+0000 osd.5 (osd.5) 113 : cluster [DBG] 5.7 scrub starts 2024-02-10T08:26:25.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:23.864672+0000 osd.5 (osd.5) 114 : cluster [DBG] 5.7 scrub ok 2024-02-10T08:26:25.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:23.973375+0000 osd.4 (osd.4) 36 : cluster [DBG] 4.1a scrub starts 2024-02-10T08:26:25.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:23.981831+0000 osd.4 (osd.4) 37 : cluster [DBG] 4.1a scrub ok 2024-02-10T08:26:25.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:24.162073+0000 osd.1 (osd.1) 116 : cluster [DBG] 2.9 scrub starts 2024-02-10T08:26:25.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:24.169334+0000 osd.1 (osd.1) 117 : cluster [DBG] 2.9 scrub ok 2024-02-10T08:26:25.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:24.209584+0000 osd.7 (osd.7) 123 : cluster [DBG] 1.0 scrub starts 2024-02-10T08:26:25.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:24.214173+0000 osd.7 (osd.7) 124 : cluster [DBG] 1.0 scrub ok 2024-02-10T08:26:25.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:24.261242+0000 osd.6 (osd.6) 91 : cluster [DBG] 6.25 scrub starts 2024-02-10T08:26:25.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:24.287552+0000 osd.6 (osd.6) 92 : cluster [DBG] 6.25 scrub ok 2024-02-10T08:26:26.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:24.744651+0000 mgr.y (mgr.14505) 366 : cluster [DBG] pgmap v435: 158 pgs: 1 active+clean+scrubbing, 157 active+clean; 6.5 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.38k op/s 2024-02-10T08:26:26.159 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:24.853047+0000 osd.5 (osd.5) 115 : cluster [DBG] 5.1b scrub starts 2024-02-10T08:26:26.159 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:24.860463+0000 osd.5 (osd.5) 116 : cluster [DBG] 5.1b scrub ok 2024-02-10T08:26:26.159 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:25.119875+0000 osd.2 (osd.2) 97 : cluster [DBG] 2.c scrub starts 2024-02-10T08:26:26.159 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:25.120933+0000 osd.2 (osd.2) 98 : cluster [DBG] 2.c scrub ok 2024-02-10T08:26:26.160 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:24.744651+0000 mgr.y (mgr.14505) 366 : cluster [DBG] pgmap v435: 158 pgs: 1 active+clean+scrubbing, 157 active+clean; 6.5 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.38k op/s 2024-02-10T08:26:26.160 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:24.853047+0000 osd.5 (osd.5) 115 : cluster [DBG] 5.1b scrub starts 2024-02-10T08:26:26.160 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:24.860463+0000 osd.5 (osd.5) 116 : cluster [DBG] 5.1b scrub ok 2024-02-10T08:26:26.160 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:25.119875+0000 osd.2 (osd.2) 97 : cluster [DBG] 2.c scrub starts 2024-02-10T08:26:26.160 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:25.120933+0000 osd.2 (osd.2) 98 : cluster [DBG] 2.c scrub ok 2024-02-10T08:26:26.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:24.744651+0000 mgr.y (mgr.14505) 366 : cluster [DBG] pgmap v435: 158 pgs: 1 active+clean+scrubbing, 157 active+clean; 6.5 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.38k op/s 2024-02-10T08:26:26.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:24.853047+0000 osd.5 (osd.5) 115 : cluster [DBG] 5.1b scrub starts 2024-02-10T08:26:26.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:24.860463+0000 osd.5 (osd.5) 116 : cluster [DBG] 5.1b scrub ok 2024-02-10T08:26:26.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:25.119875+0000 osd.2 (osd.2) 97 : cluster [DBG] 2.c scrub starts 2024-02-10T08:26:26.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:25.120933+0000 osd.2 (osd.2) 98 : cluster [DBG] 2.c scrub ok 2024-02-10T08:26:26.369 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph tell osd.6 reset_purged_snaps_last 2024-02-10T08:26:26.790 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:26:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:26:26] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:26:26.909 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:26:26.921 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:26.921 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:26:26.926 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:26:27.022 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:26:27.087 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:27.143 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:26:27.146 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:27.146 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:26:27.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:26.155867+0000 osd.0 (osd.0) 108 : cluster [DBG] 8.6 scrub starts 2024-02-10T08:26:27.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:26.155867+0000 osd.0 (osd.0) 108 : cluster [DBG] 8.6 scrub starts 2024-02-10T08:26:27.247 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:26:27.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:26.155867+0000 osd.0 (osd.0) 108 : cluster [DBG] 8.6 scrub starts 2024-02-10T08:26:27.327 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:27.596 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:26:27.603 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:26:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:26:27] "GET /metrics HTTP/1.1" 200 175978 "" "Prometheus/2.33.4" 2024-02-10T08:26:27.603 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:27.604 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:26:27.704 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:26:27.767 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:27.891 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:26:27.902 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:27.903 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:26:28.003 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:26:28.020 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is unset 2024-02-10T08:26:28.050 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:28.081 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:26:28.085 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:28.086 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:26:28.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:26.744978+0000 mgr.y (mgr.14505) 367 : cluster [DBG] pgmap v436: 158 pgs: 1 active+clean+scrubbing, 157 active+clean; 6.5 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 575 B/s rd, 0 B/s wr, 761 op/s 2024-02-10T08:26:28.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:26.886946+0000 osd.4 (osd.4) 38 : cluster [DBG] 5.1c scrub starts 2024-02-10T08:26:28.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:26.889647+0000 osd.4 (osd.4) 39 : cluster [DBG] 5.1c scrub ok 2024-02-10T08:26:28.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:26:27.010355+0000 mon.a (mon.0) 1157 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:26:28.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:27.016321+0000 osd.6 (osd.6) 93 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:26:28.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:27.016372+0000 osd.6 (osd.6) 94 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:26:28.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:26:27.536743+0000 mon.a (mon.0) 1158 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:26:28.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:26:27.537877+0000 mon.a (mon.0) 1159 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:26:28.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:26:27.546228+0000 mon.a (mon.0) 1160 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:26:28.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:26:27.913909+0000 mon.a (mon.0) 1161 : audit [INF] from='client.? 172.21.15.18:0/3122407144' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:26:28.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:26.744978+0000 mgr.y (mgr.14505) 367 : cluster [DBG] pgmap v436: 158 pgs: 1 active+clean+scrubbing, 157 active+clean; 6.5 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 575 B/s rd, 0 B/s wr, 761 op/s 2024-02-10T08:26:28.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:26.886946+0000 osd.4 (osd.4) 38 : cluster [DBG] 5.1c scrub starts 2024-02-10T08:26:28.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:26.889647+0000 osd.4 (osd.4) 39 : cluster [DBG] 5.1c scrub ok 2024-02-10T08:26:28.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:26:27.010355+0000 mon.a (mon.0) 1157 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:26:28.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:27.016321+0000 osd.6 (osd.6) 93 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:26:28.158 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:27.016372+0000 osd.6 (osd.6) 94 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:26:28.158 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:26:27.536743+0000 mon.a (mon.0) 1158 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:26:28.158 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:26:27.537877+0000 mon.a (mon.0) 1159 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:26:28.158 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:26:27.546228+0000 mon.a (mon.0) 1160 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:26:28.158 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:26:27.913909+0000 mon.a (mon.0) 1161 : audit [INF] from='client.? 172.21.15.18:0/3122407144' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:26:28.187 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:26:28.238 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:28.239 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:26:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:26:28.239 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:26.744978+0000 mgr.y (mgr.14505) 367 : cluster [DBG] pgmap v436: 158 pgs: 1 active+clean+scrubbing, 157 active+clean; 6.5 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 575 B/s rd, 0 B/s wr, 761 op/s 2024-02-10T08:26:28.239 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:26.886946+0000 osd.4 (osd.4) 38 : cluster [DBG] 5.1c scrub starts 2024-02-10T08:26:28.239 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:26.889647+0000 osd.4 (osd.4) 39 : cluster [DBG] 5.1c scrub ok 2024-02-10T08:26:28.239 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:26:27.010355+0000 mon.a (mon.0) 1157 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:26:28.239 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:27.016321+0000 osd.6 (osd.6) 93 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:26:28.240 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:27.016372+0000 osd.6 (osd.6) 94 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:26:28.240 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:26:27.536743+0000 mon.a (mon.0) 1158 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:26:28.240 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:26:27.537877+0000 mon.a (mon.0) 1159 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:26:28.240 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:26:27.546228+0000 mon.a (mon.0) 1160 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:26:28.240 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:26:27.913909+0000 mon.a (mon.0) 1161 : audit [INF] from='client.? 172.21.15.18:0/3122407144' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:26:28.279 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:26:28.285 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:28.286 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:26:28.387 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:26:28.448 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:28.478 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:26:28.481 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:28.481 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:26:28.544 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.0 dump_historic_ops 2024-02-10T08:26:28.582 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:26:28.627 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:28.652 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:26:28.656 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:28.657 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:26:28.757 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:26:28.832 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:28.994 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:27.983991+0000 mon.a (mon.0) 1162 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-10T08:26:28.994 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:27.984024+0000 mon.a (mon.0) 1163 : cluster [INF] Cluster is now healthy 2024-02-10T08:26:28.994 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:26:28.002610+0000 mon.a (mon.0) 1164 : audit [INF] from='client.? 172.21.15.18:0/3122407144' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-10T08:26:28.994 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:28.002664+0000 mon.a (mon.0) 1165 : cluster [DBG] osdmap e223: 8 total, 8 up, 8 in 2024-02-10T08:26:28.994 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:26:28.031827+0000 mgr.y (mgr.14505) 368 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:26:28.994 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:28.081055+0000 osd.2 (osd.2) 99 : cluster [DBG] 4.1c scrub starts 2024-02-10T08:26:28.994 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:28.088984+0000 osd.2 (osd.2) 100 : cluster [DBG] 4.1c scrub ok 2024-02-10T08:26:29.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:27.983991+0000 mon.a (mon.0) 1162 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-10T08:26:29.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:27.984024+0000 mon.a (mon.0) 1163 : cluster [INF] Cluster is now healthy 2024-02-10T08:26:29.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:26:28.002610+0000 mon.a (mon.0) 1164 : audit [INF] from='client.? 172.21.15.18:0/3122407144' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-10T08:26:29.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:28.002664+0000 mon.a (mon.0) 1165 : cluster [DBG] osdmap e223: 8 total, 8 up, 8 in 2024-02-10T08:26:29.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:26:28.031827+0000 mgr.y (mgr.14505) 368 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:26:29.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:28.081055+0000 osd.2 (osd.2) 99 : cluster [DBG] 4.1c scrub starts 2024-02-10T08:26:29.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:28.088984+0000 osd.2 (osd.2) 100 : cluster [DBG] 4.1c scrub ok 2024-02-10T08:26:29.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:27.983991+0000 mon.a (mon.0) 1162 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-10T08:26:29.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:27.984024+0000 mon.a (mon.0) 1163 : cluster [INF] Cluster is now healthy 2024-02-10T08:26:29.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:26:28.002610+0000 mon.a (mon.0) 1164 : audit [INF] from='client.? 172.21.15.18:0/3122407144' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-10T08:26:29.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:28.002664+0000 mon.a (mon.0) 1165 : cluster [DBG] osdmap e223: 8 total, 8 up, 8 in 2024-02-10T08:26:29.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:26:28.031827+0000 mgr.y (mgr.14505) 368 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:26:29.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:28.081055+0000 osd.2 (osd.2) 99 : cluster [DBG] 4.1c scrub starts 2024-02-10T08:26:29.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:28.088984+0000 osd.2 (osd.2) 100 : cluster [DBG] 4.1c scrub ok 2024-02-10T08:26:29.287 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:26:30.018 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:28.745442+0000 mgr.y (mgr.14505) 369 : cluster [DBG] pgmap v438: 158 pgs: 1 active+clean+scrubbing, 157 active+clean; 6.2 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1.16k op/s 2024-02-10T08:26:30.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:28.745442+0000 mgr.y (mgr.14505) 369 : cluster [DBG] pgmap v438: 158 pgs: 1 active+clean+scrubbing, 157 active+clean; 6.2 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1.16k op/s 2024-02-10T08:26:30.304 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:26:30.314 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:26:30.319 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:28.745442+0000 mgr.y (mgr.14505) 369 : cluster [DBG] pgmap v438: 158 pgs: 1 active+clean+scrubbing, 157 active+clean; 6.2 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1.16k op/s 2024-02-10T08:26:30.320 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:30.321 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:26:30.422 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:26:30.467 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:30.704 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:26:30.723 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:30.723 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:26:30.824 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:26:30.865 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:30.890 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:26:30.891 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:30.892 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:26:30.992 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:26:31.029 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:29.665234+0000 osd.0 (osd.0) 109 : cluster [DBG] 8.6 scrub ok 2024-02-10T08:26:31.029 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:29.886296+0000 osd.5 (osd.5) 117 : cluster [DBG] 6.7 deep-scrub starts 2024-02-10T08:26:31.029 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:29.921555+0000 osd.5 (osd.5) 118 : cluster [DBG] 6.7 deep-scrub ok 2024-02-10T08:26:31.029 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:30.145807+0000 osd.0 (osd.0) 110 : cluster [DBG] 6.10 scrub starts 2024-02-10T08:26:31.029 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:30.160918+0000 osd.0 (osd.0) 111 : cluster [DBG] 6.10 scrub ok 2024-02-10T08:26:31.029 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:29.665234+0000 osd.0 (osd.0) 109 : cluster [DBG] 8.6 scrub ok 2024-02-10T08:26:31.029 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:29.886296+0000 osd.5 (osd.5) 117 : cluster [DBG] 6.7 deep-scrub starts 2024-02-10T08:26:31.030 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:29.921555+0000 osd.5 (osd.5) 118 : cluster [DBG] 6.7 deep-scrub ok 2024-02-10T08:26:31.030 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:30.145807+0000 osd.0 (osd.0) 110 : cluster [DBG] 6.10 scrub starts 2024-02-10T08:26:31.030 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:30.160918+0000 osd.0 (osd.0) 111 : cluster [DBG] 6.10 scrub ok 2024-02-10T08:26:31.036 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:31.066 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:26:31.069 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:31.070 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:26:31.170 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:26:31.194 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:29.665234+0000 osd.0 (osd.0) 109 : cluster [DBG] 8.6 scrub ok 2024-02-10T08:26:31.194 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:29.886296+0000 osd.5 (osd.5) 117 : cluster [DBG] 6.7 deep-scrub starts 2024-02-10T08:26:31.194 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:29.921555+0000 osd.5 (osd.5) 118 : cluster [DBG] 6.7 deep-scrub ok 2024-02-10T08:26:31.194 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:30.145807+0000 osd.0 (osd.0) 110 : cluster [DBG] 6.10 scrub starts 2024-02-10T08:26:31.194 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:30.160918+0000 osd.0 (osd.0) 111 : cluster [DBG] 6.10 scrub ok 2024-02-10T08:26:31.196 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:31.234 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:26:31.239 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:31.239 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:26:31.340 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:26:31.394 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:31.422 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:26:31.424 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:31.425 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:26:31.526 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:26:31.578 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:31.603 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:26:31.607 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:31.607 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:26:31.621 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:26:31.649 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:26:31.690 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:26:31.707 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:26:31.732 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:26:31.756 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:31.770 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:26:31.770 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd set noscrub 2024-02-10T08:26:31.794 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:26:31.797 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:31.797 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:26:31.807 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:26:31.852 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:26:31.892 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:26:31.897 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:26:31.910 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-10T08:26:31.910 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-10T08:26:31.910 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-10T08:26:31.910 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-10T08:26:31.910 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-10T08:26:31.910 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-10T08:26:31.911 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-10T08:26:31.911 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-10T08:26:31.942 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:31.962 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:26:31.965 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:31.965 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:26:32.066 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:26:32.120 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:30.747426+0000 mgr.y (mgr.14505) 370 : cluster [DBG] pgmap v439: 158 pgs: 1 active+clean+scrubbing, 157 active+clean; 6.2 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.08k op/s 2024-02-10T08:26:32.120 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:31.158744+0000 osd.7 (osd.7) 125 : cluster [DBG] 2.0 scrub starts 2024-02-10T08:26:32.120 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:31.161636+0000 osd.7 (osd.7) 126 : cluster [DBG] 2.0 scrub ok 2024-02-10T08:26:32.120 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:26:31.591281+0000 mon.b (mon.1) 60 : audit [DBG] from='client.? 172.21.15.18:0/3698563522' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:26:32.120 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:26:31.648309+0000 mon.a (mon.0) 1166 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:26:32.122 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:30.747426+0000 mgr.y (mgr.14505) 370 : cluster [DBG] pgmap v439: 158 pgs: 1 active+clean+scrubbing, 157 active+clean; 6.2 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.08k op/s 2024-02-10T08:26:32.122 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:31.158744+0000 osd.7 (osd.7) 125 : cluster [DBG] 2.0 scrub starts 2024-02-10T08:26:32.122 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:31.161636+0000 osd.7 (osd.7) 126 : cluster [DBG] 2.0 scrub ok 2024-02-10T08:26:32.122 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:26:31.591281+0000 mon.b (mon.1) 60 : audit [DBG] from='client.? 172.21.15.18:0/3698563522' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:26:32.122 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:26:31.648309+0000 mon.a (mon.0) 1166 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:26:32.125 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:32.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:30.747426+0000 mgr.y (mgr.14505) 370 : cluster [DBG] pgmap v439: 158 pgs: 1 active+clean+scrubbing, 157 active+clean; 6.2 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.08k op/s 2024-02-10T08:26:32.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:31.158744+0000 osd.7 (osd.7) 125 : cluster [DBG] 2.0 scrub starts 2024-02-10T08:26:32.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:31.161636+0000 osd.7 (osd.7) 126 : cluster [DBG] 2.0 scrub ok 2024-02-10T08:26:32.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:26:31.591281+0000 mon.b (mon.1) 60 : audit [DBG] from='client.? 172.21.15.18:0/3698563522' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:26:32.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:26:31.648309+0000 mon.a (mon.0) 1166 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:26:33.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:31.867718+0000 osd.5 (osd.5) 119 : cluster [DBG] 6.24 scrub starts 2024-02-10T08:26:33.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:31.874725+0000 osd.5 (osd.5) 120 : cluster [DBG] 6.24 scrub ok 2024-02-10T08:26:33.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:32.114672+0000 osd.2 (osd.2) 101 : cluster [DBG] 6.28 scrub starts 2024-02-10T08:26:33.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:32.121845+0000 osd.2 (osd.2) 102 : cluster [DBG] 6.28 scrub ok 2024-02-10T08:26:33.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:31.867718+0000 osd.5 (osd.5) 119 : cluster [DBG] 6.24 scrub starts 2024-02-10T08:26:33.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:31.874725+0000 osd.5 (osd.5) 120 : cluster [DBG] 6.24 scrub ok 2024-02-10T08:26:33.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:32.114672+0000 osd.2 (osd.2) 101 : cluster [DBG] 6.28 scrub starts 2024-02-10T08:26:33.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:32.121845+0000 osd.2 (osd.2) 102 : cluster [DBG] 6.28 scrub ok 2024-02-10T08:26:33.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:31.867718+0000 osd.5 (osd.5) 119 : cluster [DBG] 6.24 scrub starts 2024-02-10T08:26:33.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:31.874725+0000 osd.5 (osd.5) 120 : cluster [DBG] 6.24 scrub ok 2024-02-10T08:26:33.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:32.114672+0000 osd.2 (osd.2) 101 : cluster [DBG] 6.28 scrub starts 2024-02-10T08:26:33.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:32.121845+0000 osd.2 (osd.2) 102 : cluster [DBG] 6.28 scrub ok 2024-02-10T08:26:34.065 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:32.750653+0000 mgr.y (mgr.14505) 371 : cluster [DBG] pgmap v440: 158 pgs: 1 active+clean+scrubbing, 157 active+clean; 6.0 GiB data, 21 GiB used, 695 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.08k op/s 2024-02-10T08:26:34.065 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:33.133323+0000 osd.7 (osd.7) 127 : cluster [DBG] 4.17 deep-scrub starts 2024-02-10T08:26:34.065 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:33.158021+0000 osd.7 (osd.7) 128 : cluster [DBG] 4.17 deep-scrub ok 2024-02-10T08:26:34.065 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:33.236657+0000 osd.6 (osd.6) 95 : cluster [DBG] 4.5 deep-scrub starts 2024-02-10T08:26:34.065 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:33.250607+0000 osd.6 (osd.6) 96 : cluster [DBG] 4.5 deep-scrub ok 2024-02-10T08:26:34.065 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:33.771713+0000 osd.4 (osd.4) 40 : cluster [DBG] 6.17 scrub starts 2024-02-10T08:26:34.065 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:33.798580+0000 osd.4 (osd.4) 41 : cluster [DBG] 6.17 scrub ok 2024-02-10T08:26:34.372 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:26:34.379 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:32.750653+0000 mgr.y (mgr.14505) 371 : cluster [DBG] pgmap v440: 158 pgs: 1 active+clean+scrubbing, 157 active+clean; 6.0 GiB data, 21 GiB used, 695 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.08k op/s 2024-02-10T08:26:34.379 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:33.133323+0000 osd.7 (osd.7) 127 : cluster [DBG] 4.17 deep-scrub starts 2024-02-10T08:26:34.380 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:33.158021+0000 osd.7 (osd.7) 128 : cluster [DBG] 4.17 deep-scrub ok 2024-02-10T08:26:34.380 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:33.236657+0000 osd.6 (osd.6) 95 : cluster [DBG] 4.5 deep-scrub starts 2024-02-10T08:26:34.380 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:33.250607+0000 osd.6 (osd.6) 96 : cluster [DBG] 4.5 deep-scrub ok 2024-02-10T08:26:34.380 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:33.771713+0000 osd.4 (osd.4) 40 : cluster [DBG] 6.17 scrub starts 2024-02-10T08:26:34.380 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:33.798580+0000 osd.4 (osd.4) 41 : cluster [DBG] 6.17 scrub ok 2024-02-10T08:26:34.381 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:34.381 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:26:34.482 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:26:34.538 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:32.750653+0000 mgr.y (mgr.14505) 371 : cluster [DBG] pgmap v440: 158 pgs: 1 active+clean+scrubbing, 157 active+clean; 6.0 GiB data, 21 GiB used, 695 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.08k op/s 2024-02-10T08:26:34.538 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:33.133323+0000 osd.7 (osd.7) 127 : cluster [DBG] 4.17 deep-scrub starts 2024-02-10T08:26:34.538 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:33.158021+0000 osd.7 (osd.7) 128 : cluster [DBG] 4.17 deep-scrub ok 2024-02-10T08:26:34.538 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:33.236657+0000 osd.6 (osd.6) 95 : cluster [DBG] 4.5 deep-scrub starts 2024-02-10T08:26:34.538 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:33.250607+0000 osd.6 (osd.6) 96 : cluster [DBG] 4.5 deep-scrub ok 2024-02-10T08:26:34.538 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:33.771713+0000 osd.4 (osd.4) 40 : cluster [DBG] 6.17 scrub starts 2024-02-10T08:26:34.538 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:33.798580+0000 osd.4 (osd.4) 41 : cluster [DBG] 6.17 scrub ok 2024-02-10T08:26:34.538 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:34.567 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:26:34.571 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:34.571 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:26:34.672 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:26:34.734 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:34.790 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:26:34.792 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:34.793 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:26:34.894 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:26:34.953 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:34.991 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:26:34.993 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:34.994 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:26:35.095 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:26:35.153 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:35.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:33.903519+0000 osd.5 (osd.5) 121 : cluster [DBG] 8.0 scrub starts 2024-02-10T08:26:35.358 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:33.903519+0000 osd.5 (osd.5) 121 : cluster [DBG] 8.0 scrub starts 2024-02-10T08:26:35.361 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:33.903519+0000 osd.5 (osd.5) 121 : cluster [DBG] 8.0 scrub starts 2024-02-10T08:26:35.368 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:26:35.372 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:35.373 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:26:35.383 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph tell osd.7 reset_purged_snaps_last 2024-02-10T08:26:35.474 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:26:35.515 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:35.804 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:26:35.815 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:35.816 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:26:35.917 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:26:35.983 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:36.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:34.751234+0000 mgr.y (mgr.14505) 372 : cluster [DBG] pgmap v441: 158 pgs: 158 active+clean; 5.9 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.08k op/s 2024-02-10T08:26:36.408 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:35.222068+0000 osd.6 (osd.6) 97 : cluster [DBG] 8.5 scrub starts 2024-02-10T08:26:36.408 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:34.751234+0000 mgr.y (mgr.14505) 372 : cluster [DBG] pgmap v441: 158 pgs: 158 active+clean; 5.9 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.08k op/s 2024-02-10T08:26:36.408 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:35.222068+0000 osd.6 (osd.6) 97 : cluster [DBG] 8.5 scrub starts 2024-02-10T08:26:36.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:34.751234+0000 mgr.y (mgr.14505) 372 : cluster [DBG] pgmap v441: 158 pgs: 158 active+clean; 5.9 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.08k op/s 2024-02-10T08:26:36.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:35.222068+0000 osd.6 (osd.6) 97 : cluster [DBG] 8.5 scrub starts 2024-02-10T08:26:36.790 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:26:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:26:36] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:26:37.097 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:26:37.102 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:37.103 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:26:37.204 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:26:37.249 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:37.281 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:26:37.295 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:37.295 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:26:37.396 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:26:37.405 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:26:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:26:37] "GET /metrics HTTP/1.1" 200 176004 "" "Prometheus/2.33.4" 2024-02-10T08:26:37.466 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:26:37.486 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:37.509 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-02-10T08:26:37.509 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-02-10T08:26:37.509 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-02-10T08:26:37.509 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-02-10T08:26:37.509 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.509 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:29662 7.f 7:f5791515:::benchmark_data_smithi018_80623_object29661:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e96)", 2024-02-10T08:26:37.509 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:03.389287+0000", 2024-02-10T08:26:37.509 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 394.11515178000002, 2024-02-10T08:26:37.509 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.106154526, 2024-02-10T08:26:37.509 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:26:37.510 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:26:37.510 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:26:37.510 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:26:37.510 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:26:37.510 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 29662 2024-02-10T08:26:37.510 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.510 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:26:37.510 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.510 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:26:37.510 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.389287+0000", 2024-02-10T08:26:37.510 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:26:37.510 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.510 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.510 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:26:37.511 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.389287+0000", 2024-02-10T08:26:37.511 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:26:37.511 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.511 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.511 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:26:37.511 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.389286+0000", 2024-02-10T08:26:37.511 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3587e-05 2024-02-10T08:26:37.511 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.511 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.511 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:26:37.511 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.389310+0000", 2024-02-10T08:26:37.511 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6699999999999997e-06 2024-02-10T08:26:37.511 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.511 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.512 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:26:37.512 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.389317+0000", 2024-02-10T08:26:37.512 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6800000000000001e-06 2024-02-10T08:26:37.512 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.512 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.512 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:26:37.512 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.389321+0000", 2024-02-10T08:26:37.512 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.096291437999999993 2024-02-10T08:26:37.512 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.512 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.512 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:26:37.512 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.485613+0000", 2024-02-10T08:26:37.512 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012495200000000001 2024-02-10T08:26:37.512 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.512 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.513 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:26:37.513 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.485738+0000", 2024-02-10T08:26:37.513 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000163449 2024-02-10T08:26:37.513 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.513 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.513 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,7", 2024-02-10T08:26:37.513 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.485901+0000", 2024-02-10T08:26:37.513 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0014973950000000001 2024-02-10T08:26:37.513 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.513 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.513 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:26:37.513 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.487399+0000", 2024-02-10T08:26:37.513 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0011120730000000001 2024-02-10T08:26:37.513 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.514 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.514 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:26:37.514 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.488511+0000", 2024-02-10T08:26:37.514 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0068342689999999996 2024-02-10T08:26:37.514 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.514 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.514 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:26:37.514 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.495345+0000", 2024-02-10T08:26:37.514 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6263e-05 2024-02-10T08:26:37.514 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.514 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.514 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:26:37.514 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.495401+0000", 2024-02-10T08:26:37.514 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0355999999999998e-05 2024-02-10T08:26:37.514 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.515 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.515 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:26:37.515 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.495442+0000", 2024-02-10T08:26:37.515 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.106154526 2024-02-10T08:26:37.515 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:26:37.515 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:26:37.515 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:26:37.515 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.515 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.515 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:77122 7.f 7:fbc1d2ad:::benchmark_data_smithi018_80623_object77121:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e107)", 2024-02-10T08:26:37.515 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:42.057541+0000", 2024-02-10T08:26:37.515 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 355.44689786599997, 2024-02-10T08:26:37.515 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.107663749, 2024-02-10T08:26:37.515 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:26:37.515 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:26:37.515 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:26:37.516 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:26:37.516 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:26:37.516 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 77122 2024-02-10T08:26:37.516 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.516 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:26:37.516 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.516 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:26:37.516 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.057541+0000", 2024-02-10T08:26:37.516 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:26:37.516 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.516 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.516 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:26:37.516 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.057541+0000", 2024-02-10T08:26:37.516 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999981 2024-02-10T08:26:37.517 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.517 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.517 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:26:37.517 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.057539+0000", 2024-02-10T08:26:37.517 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0675000000000001e-05 2024-02-10T08:26:37.517 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.517 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.517 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:26:37.517 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.057560+0000", 2024-02-10T08:26:37.517 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0512e-05 2024-02-10T08:26:37.517 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.517 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.517 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:26:37.517 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.057570+0000", 2024-02-10T08:26:37.517 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0839999999999999e-06 2024-02-10T08:26:37.517 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.518 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.518 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:26:37.518 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.057575+0000", 2024-02-10T08:26:37.518 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6105000000000003e-05 2024-02-10T08:26:37.518 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.518 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.518 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:26:37.518 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.057661+0000", 2024-02-10T08:26:37.518 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2281000000000006e-05 2024-02-10T08:26:37.518 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.518 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.518 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:26:37.518 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.057754+0000", 2024-02-10T08:26:37.518 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000164754 2024-02-10T08:26:37.518 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.518 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.519 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,7", 2024-02-10T08:26:37.519 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.057918+0000", 2024-02-10T08:26:37.519 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.006321017 2024-02-10T08:26:37.519 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.519 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.519 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:26:37.519 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.064239+0000", 2024-02-10T08:26:37.519 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0025116650000000002 2024-02-10T08:26:37.519 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.519 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.519 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:26:37.519 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.066751+0000", 2024-02-10T08:26:37.519 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.098358857999999993 2024-02-10T08:26:37.519 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.519 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.519 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:26:37.520 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.165110+0000", 2024-02-10T08:26:37.520 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3987000000000003e-05 2024-02-10T08:26:37.520 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.520 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.520 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:26:37.520 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.165164+0000", 2024-02-10T08:26:37.520 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0818999999999997e-05 2024-02-10T08:26:37.520 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.520 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.520 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:26:37.520 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.165205+0000", 2024-02-10T08:26:37.520 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.107663749 2024-02-10T08:26:37.520 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:26:37.520 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:26:37.520 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:26:37.521 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.521 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.521 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:77130 7.f 7:ff8c0eaa:::benchmark_data_smithi018_80623_object77129:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e107)", 2024-02-10T08:26:37.521 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:42.061312+0000", 2024-02-10T08:26:37.521 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 355.44312699800003, 2024-02-10T08:26:37.521 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.104018578, 2024-02-10T08:26:37.521 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:26:37.521 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:26:37.521 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:26:37.521 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:26:37.521 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:26:37.521 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 77130 2024-02-10T08:26:37.521 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.521 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:26:37.521 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.521 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:26:37.522 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.061312+0000", 2024-02-10T08:26:37.522 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:26:37.522 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.522 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.522 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:26:37.522 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.061312+0000", 2024-02-10T08:26:37.522 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:26:37.522 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.522 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.522 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:26:37.522 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.061310+0000", 2024-02-10T08:26:37.522 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0628999999999998e-05 2024-02-10T08:26:37.522 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.522 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.523 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:26:37.523 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.061331+0000", 2024-02-10T08:26:37.523 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0589999999999992e-06 2024-02-10T08:26:37.523 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.523 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.523 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:26:37.523 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.061340+0000", 2024-02-10T08:26:37.523 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.352e-06 2024-02-10T08:26:37.523 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.523 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.523 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:26:37.523 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.061344+0000", 2024-02-10T08:26:37.523 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0029262099999999998 2024-02-10T08:26:37.523 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.523 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.524 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:26:37.524 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.064271+0000", 2024-02-10T08:26:37.524 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012769800000000001 2024-02-10T08:26:37.524 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.524 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.524 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:26:37.524 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.064398+0000", 2024-02-10T08:26:37.524 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000143907 2024-02-10T08:26:37.524 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.524 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.524 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,7", 2024-02-10T08:26:37.524 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.064542+0000", 2024-02-10T08:26:37.524 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0069906320000000001 2024-02-10T08:26:37.524 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.525 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.525 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:26:37.525 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.071533+0000", 2024-02-10T08:26:37.525 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7592999999999997e-05 2024-02-10T08:26:37.525 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.525 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.525 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:26:37.525 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.071570+0000", 2024-02-10T08:26:37.525 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.093671189000000002 2024-02-10T08:26:37.525 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.525 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.525 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:26:37.525 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.165242+0000", 2024-02-10T08:26:37.525 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1273999999999998e-05 2024-02-10T08:26:37.525 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.525 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.525 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:26:37.526 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.165283+0000", 2024-02-10T08:26:37.526 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7463999999999998e-05 2024-02-10T08:26:37.526 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.526 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.526 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:26:37.526 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.165330+0000", 2024-02-10T08:26:37.526 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.104018578 2024-02-10T08:26:37.526 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:26:37.526 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:26:37.526 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:26:37.526 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.526 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.526 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:88069 7.4 7:2e561420:::benchmark_data_smithi018_80623_object88068:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e115)", 2024-02-10T08:26:37.526 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:21:00.373918+0000", 2024-02-10T08:26:37.526 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 337.13052113999998, 2024-02-10T08:26:37.526 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.10139813, 2024-02-10T08:26:37.527 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:26:37.527 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:26:37.527 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:26:37.527 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:26:37.527 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:26:37.527 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 88069 2024-02-10T08:26:37.527 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.527 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:26:37.527 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.527 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:26:37.527 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:00.373918+0000", 2024-02-10T08:26:37.527 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:26:37.527 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.527 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.527 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:26:37.527 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:00.373918+0000", 2024-02-10T08:26:37.528 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:26:37.528 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.528 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.528 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:26:37.528 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:00.373917+0000", 2024-02-10T08:26:37.528 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0143999999999999e-05 2024-02-10T08:26:37.528 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.528 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.528 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:26:37.528 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:00.373937+0000", 2024-02-10T08:26:37.528 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7159999999999997e-06 2024-02-10T08:26:37.528 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.528 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.528 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:26:37.528 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:00.373944+0000", 2024-02-10T08:26:37.529 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8840000000000002e-06 2024-02-10T08:26:37.529 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.529 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.529 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:26:37.529 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:00.373949+0000", 2024-02-10T08:26:37.529 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.031637589000000001 2024-02-10T08:26:37.529 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.529 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.529 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:26:37.529 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:00.405586+0000", 2024-02-10T08:26:37.529 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017427999999999999 2024-02-10T08:26:37.529 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.529 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.529 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:26:37.529 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:00.405761+0000", 2024-02-10T08:26:37.530 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00021252 2024-02-10T08:26:37.530 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.530 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.530 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1,4", 2024-02-10T08:26:37.530 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:00.405973+0000", 2024-02-10T08:26:37.530 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.033536756000000001 2024-02-10T08:26:37.530 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.530 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.530 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:26:37.530 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:00.439510+0000", 2024-02-10T08:26:37.530 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1723000000000001e-05 2024-02-10T08:26:37.530 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.530 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.530 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:26:37.530 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:00.439542+0000", 2024-02-10T08:26:37.531 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.032458138999999997 2024-02-10T08:26:37.531 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.531 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.531 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:26:37.531 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:00.472000+0000", 2024-02-10T08:26:37.531 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8993999999999998e-05 2024-02-10T08:26:37.531 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.531 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.531 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:26:37.531 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:00.472059+0000", 2024-02-10T08:26:37.531 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0032571010000000001 2024-02-10T08:26:37.531 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.531 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.531 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:26:37.531 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:00.475316+0000", 2024-02-10T08:26:37.531 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.10139813 2024-02-10T08:26:37.532 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:26:37.532 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:26:37.532 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:26:37.532 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.532 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.532 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:111557 7.9 7:9a811b0f:::benchmark_data_smithi018_80623_object10629:head [delete] snapc 0=[] ondisk+write+known_if_redirected e125)", 2024-02-10T08:26:37.532 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:21:36.370217+0000", 2024-02-10T08:26:37.532 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 301.13422190099999, 2024-02-10T08:26:37.532 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.10686563, 2024-02-10T08:26:37.532 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:26:37.532 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:26:37.532 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:26:37.532 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:26:37.532 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:26:37.533 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 111557 2024-02-10T08:26:37.533 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.533 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:26:37.533 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.533 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:26:37.533 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:36.370217+0000", 2024-02-10T08:26:37.533 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:26:37.533 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.533 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.533 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:26:37.533 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:36.370217+0000", 2024-02-10T08:26:37.533 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:26:37.533 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.533 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.533 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:26:37.533 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:36.370216+0000", 2024-02-10T08:26:37.533 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9170000000000002e-06 2024-02-10T08:26:37.533 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.534 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.534 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:26:37.534 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:36.370219+0000", 2024-02-10T08:26:37.534 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7620000000000001e-06 2024-02-10T08:26:37.534 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.534 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.534 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:26:37.534 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:36.370225+0000", 2024-02-10T08:26:37.534 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0870000000000007e-06 2024-02-10T08:26:37.534 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.534 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.534 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:26:37.534 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:36.370233+0000", 2024-02-10T08:26:37.534 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.075982803000000002 2024-02-10T08:26:37.534 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.535 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.535 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:26:37.535 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:36.446216+0000", 2024-02-10T08:26:37.535 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000112775 2024-02-10T08:26:37.535 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.535 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.535 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for rw locks", 2024-02-10T08:26:37.535 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:36.446329+0000", 2024-02-10T08:26:37.535 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.010151980999999999 2024-02-10T08:26:37.535 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.535 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.535 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:26:37.535 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:36.456481+0000", 2024-02-10T08:26:37.535 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5962000000000003e-05 2024-02-10T08:26:37.536 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.536 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.536 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:26:37.536 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:36.456547+0000", 2024-02-10T08:26:37.536 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000113489 2024-02-10T08:26:37.536 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.536 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.536 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1,4", 2024-02-10T08:26:37.536 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:36.456660+0000", 2024-02-10T08:26:37.536 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.016782783999999999 2024-02-10T08:26:37.536 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.536 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.536 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:26:37.536 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:36.473443+0000", 2024-02-10T08:26:37.536 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3780000000000007e-06 2024-02-10T08:26:37.537 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.537 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.537 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:26:37.537 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:36.473452+0000", 2024-02-10T08:26:37.537 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1501000000000004e-05 2024-02-10T08:26:37.537 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.537 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.537 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:26:37.537 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:36.473544+0000", 2024-02-10T08:26:37.537 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7315999999999998e-05 2024-02-10T08:26:37.537 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.537 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.537 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:26:37.537 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:36.473601+0000", 2024-02-10T08:26:37.537 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0034814139999999999 2024-02-10T08:26:37.537 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.538 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.538 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:26:37.538 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:36.477082+0000", 2024-02-10T08:26:37.538 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.10686563 2024-02-10T08:26:37.538 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:26:37.538 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:26:37.538 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:26:37.538 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.538 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.538 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:131654 7.9 7:9f11397a:::benchmark_data_smithi018_80623_object30726:head [delete] snapc 0=[] ondisk+write+known_if_redirected e136)", 2024-02-10T08:26:37.538 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:22:05.105688+0000", 2024-02-10T08:26:37.538 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 272.39875035400001, 2024-02-10T08:26:37.538 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.10515804500000001, 2024-02-10T08:26:37.538 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:26:37.538 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:26:37.538 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:26:37.539 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:26:37.539 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:26:37.539 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 131654 2024-02-10T08:26:37.539 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.539 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:26:37.539 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.539 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:26:37.539 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:05.105688+0000", 2024-02-10T08:26:37.539 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:26:37.539 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.539 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.539 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:26:37.539 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:05.105688+0000", 2024-02-10T08:26:37.539 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:26:37.539 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.539 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.540 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:26:37.540 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:05.105687+0000", 2024-02-10T08:26:37.540 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9380000000000003e-06 2024-02-10T08:26:37.540 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.540 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.540 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:26:37.540 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:05.105694+0000", 2024-02-10T08:26:37.540 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2033e-05 2024-02-10T08:26:37.540 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.540 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.540 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:26:37.540 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:05.105706+0000", 2024-02-10T08:26:37.540 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8750000000000002e-06 2024-02-10T08:26:37.540 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.540 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.541 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:26:37.541 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:05.105713+0000", 2024-02-10T08:26:37.541 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013532631 2024-02-10T08:26:37.541 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.541 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.541 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:26:37.541 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:05.119246+0000", 2024-02-10T08:26:37.541 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000111408 2024-02-10T08:26:37.541 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.541 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.541 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for rw locks", 2024-02-10T08:26:37.541 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:05.119357+0000", 2024-02-10T08:26:37.541 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0076216620000000004 2024-02-10T08:26:37.541 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.541 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.541 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:26:37.541 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:05.126979+0000", 2024-02-10T08:26:37.542 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7869999999999997e-05 2024-02-10T08:26:37.542 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.542 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.542 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:26:37.542 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:05.127066+0000", 2024-02-10T08:26:37.542 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000148114 2024-02-10T08:26:37.542 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.542 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.542 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1,4", 2024-02-10T08:26:37.542 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:05.127215+0000", 2024-02-10T08:26:37.542 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.010892005999999999 2024-02-10T08:26:37.542 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.542 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.542 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:26:37.542 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:05.138107+0000", 2024-02-10T08:26:37.542 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.070534193999999995 2024-02-10T08:26:37.542 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.543 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.543 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:26:37.543 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:05.208641+0000", 2024-02-10T08:26:37.543 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1748000000000001e-05 2024-02-10T08:26:37.543 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.543 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.543 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:26:37.543 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:05.208683+0000", 2024-02-10T08:26:37.543 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9348999999999998e-05 2024-02-10T08:26:37.543 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.543 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.543 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:26:37.543 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:05.208732+0000", 2024-02-10T08:26:37.543 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002114608 2024-02-10T08:26:37.543 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.544 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.544 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:26:37.544 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:05.210846+0000", 2024-02-10T08:26:37.544 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.10515804500000001 2024-02-10T08:26:37.544 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:26:37.544 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:26:37.544 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:26:37.544 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.544 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.544 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:179932 7.6 7:622bb803:::benchmark_data_smithi018_80623_object79004:head [delete] snapc 0=[] ondisk+write+known_if_redirected e163)", 2024-02-10T08:26:37.544 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:23:14.099878+0000", 2024-02-10T08:26:37.544 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 203.40456095799999, 2024-02-10T08:26:37.544 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.593618239, 2024-02-10T08:26:37.544 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:26:37.544 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:26:37.545 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:26:37.545 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:26:37.545 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:26:37.545 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 179932 2024-02-10T08:26:37.545 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.545 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:26:37.545 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.545 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:26:37.545 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.099878+0000", 2024-02-10T08:26:37.545 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:26:37.545 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.545 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.545 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:26:37.545 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.099878+0000", 2024-02-10T08:26:37.545 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999981 2024-02-10T08:26:37.545 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.545 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.546 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:26:37.546 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.099876+0000", 2024-02-10T08:26:37.546 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0070000000000003e-06 2024-02-10T08:26:37.546 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.546 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.546 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:26:37.546 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.099882+0000", 2024-02-10T08:26:37.546 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.208e-06 2024-02-10T08:26:37.546 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.546 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.546 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:26:37.546 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.099890+0000", 2024-02-10T08:26:37.546 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1850000000000001e-06 2024-02-10T08:26:37.546 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.546 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.547 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:26:37.547 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.099896+0000", 2024-02-10T08:26:37.547 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0044118309999999997 2024-02-10T08:26:37.547 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.547 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.547 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:26:37.547 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.104308+0000", 2024-02-10T08:26:37.547 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1224e-05 2024-02-10T08:26:37.547 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.547 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.547 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:26:37.547 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.104319+0000", 2024-02-10T08:26:37.547 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.95846239700000002 2024-02-10T08:26:37.547 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.548 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.548 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:26:37.548 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.062782+0000", 2024-02-10T08:26:37.548 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.134e-05 2024-02-10T08:26:37.548 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.548 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.548 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:26:37.548 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.062793+0000", 2024-02-10T08:26:37.548 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.60692910600000005 2024-02-10T08:26:37.548 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.548 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.548 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:26:37.548 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.669722+0000", 2024-02-10T08:26:37.548 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015991399999999999 2024-02-10T08:26:37.548 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.549 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.549 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:26:37.549 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.669882+0000", 2024-02-10T08:26:37.549 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018509 2024-02-10T08:26:37.549 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.549 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.549 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,5,7", 2024-02-10T08:26:37.549 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.670067+0000", 2024-02-10T08:26:37.549 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0099177139999999993 2024-02-10T08:26:37.549 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.549 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.549 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:26:37.549 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.679985+0000", 2024-02-10T08:26:37.549 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9059e-05 2024-02-10T08:26:37.550 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.550 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.550 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:26:37.550 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.680024+0000", 2024-02-10T08:26:37.550 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000251067 2024-02-10T08:26:37.550 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.550 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.550 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:26:37.550 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.680275+0000", 2024-02-10T08:26:37.550 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013023241 2024-02-10T08:26:37.550 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.550 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.550 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:26:37.550 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.693298+0000", 2024-02-10T08:26:37.551 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4793000000000002e-05 2024-02-10T08:26:37.551 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.551 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.551 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:26:37.551 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.693353+0000", 2024-02-10T08:26:37.551 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000142869 2024-02-10T08:26:37.551 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.551 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.551 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:26:37.551 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.693496+0000", 2024-02-10T08:26:37.551 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.593618239 2024-02-10T08:26:37.551 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:26:37.551 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:26:37.551 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:26:37.551 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.551 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.552 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:179935 7.6 7:612ee4b2:::benchmark_data_smithi018_80623_object79007:head [delete] snapc 0=[] ondisk+write+known_if_redirected e163)", 2024-02-10T08:26:37.552 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:23:14.105897+0000", 2024-02-10T08:26:37.552 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 203.398541631, 2024-02-10T08:26:37.552 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5878203129999999, 2024-02-10T08:26:37.552 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:26:37.552 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:26:37.552 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:26:37.552 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:26:37.552 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:26:37.552 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 179935 2024-02-10T08:26:37.552 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.552 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:26:37.552 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.552 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:26:37.552 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.105897+0000", 2024-02-10T08:26:37.553 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:26:37.553 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.553 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.553 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:26:37.553 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.105897+0000", 2024-02-10T08:26:37.553 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:26:37.553 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.553 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.553 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:26:37.553 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.105896+0000", 2024-02-10T08:26:37.553 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6050000000000003e-06 2024-02-10T08:26:37.553 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.553 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.553 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:26:37.553 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.105902+0000", 2024-02-10T08:26:37.553 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.011e-06 2024-02-10T08:26:37.554 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.554 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.554 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:26:37.554 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.105910+0000", 2024-02-10T08:26:37.554 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6529999999999997e-06 2024-02-10T08:26:37.554 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.554 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.554 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:26:37.554 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.105917+0000", 2024-02-10T08:26:37.554 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000154303 2024-02-10T08:26:37.554 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.554 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.554 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:26:37.554 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.106071+0000", 2024-02-10T08:26:37.554 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7540000000000003e-06 2024-02-10T08:26:37.554 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.554 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.554 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:26:37.555 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.106077+0000", 2024-02-10T08:26:37.555 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.95673804200000001 2024-02-10T08:26:37.555 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.555 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.555 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:26:37.555 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.062815+0000", 2024-02-10T08:26:37.555 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9240000000000007e-06 2024-02-10T08:26:37.555 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.555 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.555 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:26:37.555 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.062823+0000", 2024-02-10T08:26:37.555 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.60969109200000005 2024-02-10T08:26:37.555 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.555 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.555 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:26:37.555 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.672514+0000", 2024-02-10T08:26:37.556 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014302799999999999 2024-02-10T08:26:37.556 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.556 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.556 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:26:37.556 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.672657+0000", 2024-02-10T08:26:37.556 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017783 2024-02-10T08:26:37.556 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.556 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.556 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,5,7", 2024-02-10T08:26:37.556 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.672835+0000", 2024-02-10T08:26:37.556 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0073871930000000002 2024-02-10T08:26:37.556 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.556 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.556 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:26:37.556 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.680222+0000", 2024-02-10T08:26:37.557 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9824000000000002e-05 2024-02-10T08:26:37.557 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.557 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.557 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:26:37.557 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.680282+0000", 2024-02-10T08:26:37.557 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6982000000000001e-05 2024-02-10T08:26:37.557 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.557 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.557 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:26:37.557 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.680379+0000", 2024-02-10T08:26:37.557 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013162759 2024-02-10T08:26:37.557 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.557 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.557 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:26:37.557 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.693542+0000", 2024-02-10T08:26:37.557 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8619999999999999e-05 2024-02-10T08:26:37.558 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.558 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.558 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:26:37.558 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.693590+0000", 2024-02-10T08:26:37.558 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000127262 2024-02-10T08:26:37.558 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.558 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.558 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:26:37.558 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.693717+0000", 2024-02-10T08:26:37.558 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5878203129999999 2024-02-10T08:26:37.558 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:26:37.558 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:26:37.558 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:26:37.558 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.558 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.558 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:179936 7.6 7:6740eab7:::benchmark_data_smithi018_80623_object79008:head [delete] snapc 0=[] ondisk+write+known_if_redirected e163)", 2024-02-10T08:26:37.559 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:23:14.108981+0000", 2024-02-10T08:26:37.559 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 203.39545752399999, 2024-02-10T08:26:37.559 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5852249789999999, 2024-02-10T08:26:37.559 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:26:37.559 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:26:37.559 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:26:37.559 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:26:37.559 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:26:37.559 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 179936 2024-02-10T08:26:37.559 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.559 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:26:37.559 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.559 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:26:37.559 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.108981+0000", 2024-02-10T08:26:37.559 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:26:37.560 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.560 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.560 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:26:37.560 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.108981+0000", 2024-02-10T08:26:37.560 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999981 2024-02-10T08:26:37.560 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.560 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.560 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:26:37.560 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.108979+0000", 2024-02-10T08:26:37.560 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0089999999999996e-06 2024-02-10T08:26:37.560 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.560 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.560 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:26:37.561 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.108988+0000", 2024-02-10T08:26:37.561 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2675e-05 2024-02-10T08:26:37.561 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.561 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.561 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:26:37.561 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.109001+0000", 2024-02-10T08:26:37.561 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5170000000000002e-06 2024-02-10T08:26:37.561 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.561 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.561 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:26:37.561 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.109009+0000", 2024-02-10T08:26:37.561 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7682000000000001e-05 2024-02-10T08:26:37.561 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.561 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.561 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:26:37.562 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.109066+0000", 2024-02-10T08:26:37.562 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2139999999999999e-06 2024-02-10T08:26:37.562 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.562 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.562 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:26:37.562 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.109073+0000", 2024-02-10T08:26:37.562 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.95377067599999998 2024-02-10T08:26:37.562 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.562 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.562 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:26:37.562 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.062844+0000", 2024-02-10T08:26:37.562 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.678e-06 2024-02-10T08:26:37.562 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.562 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.563 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:26:37.563 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.062852+0000", 2024-02-10T08:26:37.563 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.61274752899999996 2024-02-10T08:26:37.563 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.563 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.563 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:26:37.563 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.675599+0000", 2024-02-10T08:26:37.563 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000113472 2024-02-10T08:26:37.563 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.563 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.563 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:26:37.563 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.675713+0000", 2024-02-10T08:26:37.563 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000138596 2024-02-10T08:26:37.563 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.563 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.563 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,5,7", 2024-02-10T08:26:37.564 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.675851+0000", 2024-02-10T08:26:37.564 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0044139050000000001 2024-02-10T08:26:37.564 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.564 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.564 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:26:37.564 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.680265+0000", 2024-02-10T08:26:37.564 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012036699999999999 2024-02-10T08:26:37.564 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.564 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.564 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:26:37.564 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.680386+0000", 2024-02-10T08:26:37.564 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012687000000000001 2024-02-10T08:26:37.564 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.564 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.565 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:26:37.565 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.680513+0000", 2024-02-10T08:26:37.565 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013500929 2024-02-10T08:26:37.565 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.565 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.565 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:26:37.565 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.694013+0000", 2024-02-10T08:26:37.565 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9317999999999997e-05 2024-02-10T08:26:37.565 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.565 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.565 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:26:37.565 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.694073+0000", 2024-02-10T08:26:37.565 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000133421 2024-02-10T08:26:37.565 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.565 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.565 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:26:37.566 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.694206+0000", 2024-02-10T08:26:37.566 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5852249789999999 2024-02-10T08:26:37.566 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:26:37.566 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:26:37.566 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:26:37.566 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.566 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.566 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:185679 7.9 7:9dfa0d6b:::benchmark_data_smithi018_80623_object84751:head [delete] snapc 0=[] ondisk+write+known_if_redirected e167)", 2024-02-10T08:26:37.566 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:23:24.331633+0000", 2024-02-10T08:26:37.566 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 193.17280564399999, 2024-02-10T08:26:37.566 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.131336863, 2024-02-10T08:26:37.566 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:26:37.566 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:26:37.566 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:26:37.567 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:26:37.567 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:26:37.567 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 185679 2024-02-10T08:26:37.567 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.567 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:26:37.567 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.567 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:26:37.567 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.331633+0000", 2024-02-10T08:26:37.567 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:26:37.567 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.567 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.567 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:26:37.567 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.331633+0000", 2024-02-10T08:26:37.567 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999976 2024-02-10T08:26:37.567 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.567 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.568 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:26:37.568 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.331631+0000", 2024-02-10T08:26:37.568 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5499999999999995e-06 2024-02-10T08:26:37.568 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.568 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.568 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:26:37.568 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.331639+0000", 2024-02-10T08:26:37.568 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1477e-05 2024-02-10T08:26:37.568 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.568 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.568 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:26:37.568 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.331651+0000", 2024-02-10T08:26:37.568 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7909999999999999e-06 2024-02-10T08:26:37.568 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.569 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.569 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:26:37.569 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.331658+0000", 2024-02-10T08:26:37.569 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0092112500000000007 2024-02-10T08:26:37.569 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.569 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.569 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:26:37.569 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.340869+0000", 2024-02-10T08:26:37.569 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9961000000000001e-05 2024-02-10T08:26:37.569 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.569 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.569 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:26:37.569 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.340959+0000", 2024-02-10T08:26:37.569 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000144389 2024-02-10T08:26:37.569 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.570 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.570 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1,4", 2024-02-10T08:26:37.570 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.341103+0000", 2024-02-10T08:26:37.570 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.010862764 2024-02-10T08:26:37.570 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.570 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.570 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:26:37.570 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.351966+0000", 2024-02-10T08:26:37.570 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3222e-05 2024-02-10T08:26:37.570 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.570 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.570 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:26:37.570 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.351979+0000", 2024-02-10T08:26:37.570 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.01040195 2024-02-10T08:26:37.570 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.571 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.571 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:26:37.571 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.362381+0000", 2024-02-10T08:26:37.571 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1693000000000001e-05 2024-02-10T08:26:37.571 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.571 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.571 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:26:37.571 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.362433+0000", 2024-02-10T08:26:37.571 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.100537026 2024-02-10T08:26:37.571 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.571 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.571 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:26:37.571 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.462970+0000", 2024-02-10T08:26:37.571 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.131336863 2024-02-10T08:26:37.572 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:26:37.572 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:26:37.572 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:26:37.572 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.572 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.572 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:185687 7.9 7:9ee476f1:::benchmark_data_smithi018_80623_object84759:head [delete] snapc 0=[] ondisk+write+known_if_redirected e167)", 2024-02-10T08:26:37.572 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:23:24.340882+0000", 2024-02-10T08:26:37.572 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 193.16355661599999, 2024-02-10T08:26:37.572 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.123437612, 2024-02-10T08:26:37.572 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:26:37.572 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:26:37.572 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:26:37.572 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:26:37.572 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:26:37.573 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 185687 2024-02-10T08:26:37.573 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.573 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:26:37.573 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.573 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:26:37.573 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.340882+0000", 2024-02-10T08:26:37.573 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:26:37.573 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.573 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.573 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:26:37.573 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.340882+0000", 2024-02-10T08:26:37.573 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:26:37.573 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.573 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.573 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:26:37.574 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.340882+0000", 2024-02-10T08:26:37.574 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0520000000000002e-06 2024-02-10T08:26:37.574 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.574 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.574 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:26:37.574 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.340885+0000", 2024-02-10T08:26:37.574 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2100000000000003e-06 2024-02-10T08:26:37.574 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.574 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.574 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:26:37.574 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.340889+0000", 2024-02-10T08:26:37.574 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4410000000000002e-06 2024-02-10T08:26:37.574 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.574 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.574 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:26:37.575 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.340892+0000", 2024-02-10T08:26:37.575 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0024863340000000002 2024-02-10T08:26:37.575 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.575 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.575 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:26:37.575 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.343379+0000", 2024-02-10T08:26:37.575 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3487999999999998e-05 2024-02-10T08:26:37.575 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.575 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.575 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:26:37.575 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.343462+0000", 2024-02-10T08:26:37.575 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9333999999999995e-05 2024-02-10T08:26:37.575 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.575 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.575 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1,4", 2024-02-10T08:26:37.575 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.343561+0000", 2024-02-10T08:26:37.576 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.014180066999999999 2024-02-10T08:26:37.576 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.576 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.576 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:26:37.576 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.357741+0000", 2024-02-10T08:26:37.576 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7206000000000001e-05 2024-02-10T08:26:37.576 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.576 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.576 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:26:37.576 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.357799+0000", 2024-02-10T08:26:37.576 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.105230039 2024-02-10T08:26:37.576 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.576 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.576 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:26:37.576 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.463029+0000", 2024-02-10T08:26:37.577 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8053000000000001e-05 2024-02-10T08:26:37.577 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.577 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.577 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:26:37.577 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.463087+0000", 2024-02-10T08:26:37.577 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001233025 2024-02-10T08:26:37.577 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.577 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.577 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:26:37.577 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.464320+0000", 2024-02-10T08:26:37.577 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.123437612 2024-02-10T08:26:37.577 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:26:37.577 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:26:37.577 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:26:37.577 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.578 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.578 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:185688 7.9 7:99430034:::benchmark_data_smithi018_80623_object84760:head [delete] snapc 0=[] ondisk+write+known_if_redirected e167)", 2024-02-10T08:26:37.578 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:23:24.340914+0000", 2024-02-10T08:26:37.578 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 193.16352429200001, 2024-02-10T08:26:37.578 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.124567673, 2024-02-10T08:26:37.578 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:26:37.578 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:26:37.578 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:26:37.578 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:26:37.578 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:26:37.578 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 185688 2024-02-10T08:26:37.578 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.578 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:26:37.578 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.579 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:26:37.579 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.340914+0000", 2024-02-10T08:26:37.579 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:26:37.579 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.579 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.579 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:26:37.579 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.340914+0000", 2024-02-10T08:26:37.579 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:26:37.579 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.579 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.579 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:26:37.579 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.340914+0000", 2024-02-10T08:26:37.579 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.384e-06 2024-02-10T08:26:37.579 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.579 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.579 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:26:37.580 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.340916+0000", 2024-02-10T08:26:37.580 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.631e-06 2024-02-10T08:26:37.580 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.580 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.580 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:26:37.580 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.340920+0000", 2024-02-10T08:26:37.580 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0900000000000001e-06 2024-02-10T08:26:37.580 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.580 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.580 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:26:37.580 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.340923+0000", 2024-02-10T08:26:37.580 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0052687360000000004 2024-02-10T08:26:37.580 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.580 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.580 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:26:37.581 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.346192+0000", 2024-02-10T08:26:37.581 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011723 2024-02-10T08:26:37.581 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.581 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.581 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:26:37.581 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.346309+0000", 2024-02-10T08:26:37.581 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013480400000000001 2024-02-10T08:26:37.581 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.581 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.581 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1,4", 2024-02-10T08:26:37.581 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.346444+0000", 2024-02-10T08:26:37.581 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011310209999999999 2024-02-10T08:26:37.581 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.581 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.581 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:26:37.581 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.357754+0000", 2024-02-10T08:26:37.581 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3480999999999995e-05 2024-02-10T08:26:37.582 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.582 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.582 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:26:37.582 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.357848+0000", 2024-02-10T08:26:37.582 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.106515707 2024-02-10T08:26:37.582 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.582 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.582 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:26:37.582 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.464363+0000", 2024-02-10T08:26:37.582 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0077000000000002e-05 2024-02-10T08:26:37.582 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.582 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.582 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:26:37.582 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.464413+0000", 2024-02-10T08:26:37.582 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010688480000000001 2024-02-10T08:26:37.582 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.582 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.583 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:26:37.583 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.465482+0000", 2024-02-10T08:26:37.583 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.124567673 2024-02-10T08:26:37.583 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:26:37.583 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:26:37.583 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:26:37.583 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.583 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.583 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:185689 7.9 7:9c498ea9:::benchmark_data_smithi018_80623_object84761:head [delete] snapc 0=[] ondisk+write+known_if_redirected e167)", 2024-02-10T08:26:37.583 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:23:24.340944+0000", 2024-02-10T08:26:37.583 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 193.16349493499999, 2024-02-10T08:26:37.583 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.12545147800000001, 2024-02-10T08:26:37.583 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:26:37.583 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:26:37.583 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:26:37.583 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:26:37.583 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:26:37.584 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 185689 2024-02-10T08:26:37.584 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.584 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:26:37.584 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.584 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:26:37.584 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.340944+0000", 2024-02-10T08:26:37.584 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:26:37.584 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.584 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.584 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:26:37.584 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.340944+0000", 2024-02-10T08:26:37.584 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:26:37.584 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.584 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.584 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:26:37.585 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.340943+0000", 2024-02-10T08:26:37.585 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5339999999999998e-06 2024-02-10T08:26:37.585 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.585 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.585 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:26:37.585 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.340946+0000", 2024-02-10T08:26:37.585 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8060000000000001e-06 2024-02-10T08:26:37.585 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.585 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.585 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:26:37.585 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.340950+0000", 2024-02-10T08:26:37.585 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5720000000000001e-06 2024-02-10T08:26:37.585 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.585 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.585 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:26:37.586 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.340952+0000", 2024-02-10T08:26:37.586 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0084502299999999995 2024-02-10T08:26:37.586 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.586 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.586 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:26:37.586 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.349403+0000", 2024-02-10T08:26:37.586 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013141100000000001 2024-02-10T08:26:37.586 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.586 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.586 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:26:37.586 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.349534+0000", 2024-02-10T08:26:37.586 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012961400000000001 2024-02-10T08:26:37.586 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.586 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.586 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1,4", 2024-02-10T08:26:37.586 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.349664+0000", 2024-02-10T08:26:37.587 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0081434149999999993 2024-02-10T08:26:37.587 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.587 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.587 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:26:37.587 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.357807+0000", 2024-02-10T08:26:37.587 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.10771916400000001 2024-02-10T08:26:37.587 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.587 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.587 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:26:37.587 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.465526+0000", 2024-02-10T08:26:37.587 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5643999999999997e-05 2024-02-10T08:26:37.587 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.587 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.587 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:26:37.588 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.465592+0000", 2024-02-10T08:26:37.588 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5314e-05 2024-02-10T08:26:37.588 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.588 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.588 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:26:37.588 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.465637+0000", 2024-02-10T08:26:37.588 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000758193 2024-02-10T08:26:37.588 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.588 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.588 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:26:37.588 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.466395+0000", 2024-02-10T08:26:37.588 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.12545147800000001 2024-02-10T08:26:37.588 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:26:37.588 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:26:37.588 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:26:37.589 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.589 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.589 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:185695 7.9 7:951ad5ff:::benchmark_data_smithi018_80623_object84767:head [delete] snapc 0=[] ondisk+write+known_if_redirected e167)", 2024-02-10T08:26:37.589 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:23:24.355809+0000", 2024-02-10T08:26:37.589 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 193.148629726, 2024-02-10T08:26:37.589 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.127651502, 2024-02-10T08:26:37.589 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:26:37.589 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:26:37.589 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:26:37.589 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:26:37.589 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:26:37.589 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 185695 2024-02-10T08:26:37.589 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.589 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:26:37.589 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.590 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:26:37.590 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.355809+0000", 2024-02-10T08:26:37.590 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:26:37.590 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.590 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.590 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:26:37.590 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.355809+0000", 2024-02-10T08:26:37.590 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:26:37.590 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.590 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.590 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:26:37.590 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.355808+0000", 2024-02-10T08:26:37.590 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8369999999999996e-06 2024-02-10T08:26:37.590 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.591 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.591 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:26:37.591 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.355812+0000", 2024-02-10T08:26:37.591 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7840000000000004e-06 2024-02-10T08:26:37.591 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.591 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.591 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:26:37.591 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.355820+0000", 2024-02-10T08:26:37.591 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8180000000000003e-06 2024-02-10T08:26:37.591 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.591 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.591 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:26:37.591 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.355825+0000", 2024-02-10T08:26:37.591 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0021991039999999999 2024-02-10T08:26:37.592 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.592 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.592 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:26:37.592 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.358024+0000", 2024-02-10T08:26:37.592 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013111000000000001 2024-02-10T08:26:37.592 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.592 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.592 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:26:37.592 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.358155+0000", 2024-02-10T08:26:37.592 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014176799999999999 2024-02-10T08:26:37.592 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.592 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.592 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1,4", 2024-02-10T08:26:37.592 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.358297+0000", 2024-02-10T08:26:37.592 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.10726297899999999 2024-02-10T08:26:37.593 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.593 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.593 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:26:37.593 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.465560+0000", 2024-02-10T08:26:37.593 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00088626600000000003 2024-02-10T08:26:37.593 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.593 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.593 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:26:37.593 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.466446+0000", 2024-02-10T08:26:37.593 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015808071 2024-02-10T08:26:37.593 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.593 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.593 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:26:37.593 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.482254+0000", 2024-02-10T08:26:37.593 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6811000000000002e-05 2024-02-10T08:26:37.594 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.594 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.594 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:26:37.594 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.482311+0000", 2024-02-10T08:26:37.594 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001149377 2024-02-10T08:26:37.594 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.594 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.594 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:26:37.594 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.483461+0000", 2024-02-10T08:26:37.594 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.127651502 2024-02-10T08:26:37.594 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:26:37.594 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:26:37.594 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:26:37.594 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.594 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.595 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.14784.0:185697 7.e e167/164 7:7ae1591d:::benchmark_data_smithi018_80623_object84769:head v 167'11600, mlcod=167'11597)", 2024-02-10T08:26:37.595 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:23:24.358293+0000", 2024-02-10T08:26:37.595 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 193.146146246, 2024-02-10T08:26:37.595 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.104620729, 2024-02-10T08:26:37.595 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:26:37.595 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:26:37.595 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:26:37.595 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.595 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:26:37.595 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.358293+0000", 2024-02-10T08:26:37.595 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:26:37.595 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.595 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.595 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:26:37.595 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.358293+0000", 2024-02-10T08:26:37.595 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:26:37.596 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.596 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.596 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:26:37.596 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.358292+0000", 2024-02-10T08:26:37.596 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6159999999999996e-06 2024-02-10T08:26:37.596 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.596 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.596 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:26:37.596 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.358299+0000", 2024-02-10T08:26:37.596 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8279999999999998e-06 2024-02-10T08:26:37.596 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.596 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.596 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:26:37.596 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.358309+0000", 2024-02-10T08:26:37.597 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0039999999999996e-06 2024-02-10T08:26:37.597 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.597 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.597 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:26:37.597 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.358315+0000", 2024-02-10T08:26:37.597 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9883999999999995e-05 2024-02-10T08:26:37.597 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.597 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.597 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:26:37.597 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.358405+0000", 2024-02-10T08:26:37.597 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1214000000000001e-05 2024-02-10T08:26:37.597 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.597 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.597 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:26:37.598 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.358426+0000", 2024-02-10T08:26:37.598 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0057889780000000002 2024-02-10T08:26:37.598 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.598 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.598 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:26:37.598 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.364215+0000", 2024-02-10T08:26:37.598 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.098697931000000003 2024-02-10T08:26:37.598 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.598 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.598 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:26:37.598 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.462913+0000", 2024-02-10T08:26:37.598 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.104620729 2024-02-10T08:26:37.598 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:26:37.598 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:26:37.598 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:26:37.599 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.599 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.599 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.14784.0:185699 7.f e167/164 7:f1a29ca9:::benchmark_data_smithi018_80623_object84771:head v 167'11542, mlcod=167'11540)", 2024-02-10T08:26:37.599 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:23:24.361663+0000", 2024-02-10T08:26:37.599 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 193.14277547, 2024-02-10T08:26:37.599 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.101331583, 2024-02-10T08:26:37.599 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:26:37.599 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:26:37.599 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:26:37.599 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.599 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:26:37.599 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.361663+0000", 2024-02-10T08:26:37.599 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:26:37.599 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.599 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.599 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:26:37.600 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.361663+0000", 2024-02-10T08:26:37.600 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:26:37.600 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.600 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.600 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:26:37.600 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.361662+0000", 2024-02-10T08:26:37.600 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4540000000000001e-06 2024-02-10T08:26:37.600 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.600 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.600 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:26:37.600 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.361670+0000", 2024-02-10T08:26:37.600 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6155999999999999e-05 2024-02-10T08:26:37.600 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.600 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.601 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:26:37.601 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.361686+0000", 2024-02-10T08:26:37.601 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2229999999999998e-06 2024-02-10T08:26:37.601 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.601 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.601 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:26:37.601 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.361691+0000", 2024-02-10T08:26:37.601 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8482000000000002e-05 2024-02-10T08:26:37.601 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.601 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.601 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:26:37.601 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.361730+0000", 2024-02-10T08:26:37.601 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.658e-05 2024-02-10T08:26:37.601 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.601 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.602 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:26:37.602 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.361756+0000", 2024-02-10T08:26:37.602 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.10120646599999999 2024-02-10T08:26:37.602 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.602 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.602 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:26:37.602 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.462963+0000", 2024-02-10T08:26:37.602 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2165999999999997e-05 2024-02-10T08:26:37.602 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.602 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.602 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:26:37.602 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.462995+0000", 2024-02-10T08:26:37.602 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.101331583 2024-02-10T08:26:37.602 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:26:37.602 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:26:37.603 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:26:37.603 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.603 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.603 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.14784.0:185700 7.f e167/164 7:fa9fb72e:::benchmark_data_smithi018_80623_object84772:head v 167'11543, mlcod=167'11540)", 2024-02-10T08:26:37.603 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:23:24.361704+0000", 2024-02-10T08:26:37.603 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 193.14273460000001, 2024-02-10T08:26:37.603 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.103814714, 2024-02-10T08:26:37.603 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:26:37.603 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:26:37.603 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:26:37.603 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.603 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:26:37.603 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.361704+0000", 2024-02-10T08:26:37.603 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:26:37.603 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.604 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.604 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:26:37.604 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.361704+0000", 2024-02-10T08:26:37.604 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:26:37.604 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.604 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.604 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:26:37.604 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.361704+0000", 2024-02-10T08:26:37.604 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.374e-06 2024-02-10T08:26:37.604 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.604 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.604 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:26:37.604 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.361708+0000", 2024-02-10T08:26:37.604 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5970000000000002e-06 2024-02-10T08:26:37.605 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.605 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.605 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:26:37.605 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.361713+0000", 2024-02-10T08:26:37.605 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.019e-06 2024-02-10T08:26:37.605 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.605 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.605 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:26:37.605 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.361717+0000", 2024-02-10T08:26:37.605 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.101305982 2024-02-10T08:26:37.605 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.605 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.605 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:26:37.605 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.463023+0000", 2024-02-10T08:26:37.605 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9838000000000001e-05 2024-02-10T08:26:37.606 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.606 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.606 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:26:37.606 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.463053+0000", 2024-02-10T08:26:37.606 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0024393349999999999 2024-02-10T08:26:37.606 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.606 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.606 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:26:37.606 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.465492+0000", 2024-02-10T08:26:37.606 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.692e-05 2024-02-10T08:26:37.606 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.606 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.606 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:26:37.606 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.465519+0000", 2024-02-10T08:26:37.607 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.103814714 2024-02-10T08:26:37.607 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:26:37.607 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:26:37.607 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:26:37.607 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.607 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.607 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop_reply(client.14784.0:185687 7.9 e167/111 ondisk, result = 0)", 2024-02-10T08:26:37.607 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:23:24.362330+0000", 2024-02-10T08:26:37.607 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 193.14210888100001, 2024-02-10T08:26:37.607 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.10199463, 2024-02-10T08:26:37.607 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:26:37.607 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-02-10T08:26:37.607 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:26:37.607 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.607 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:26:37.608 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.362330+0000", 2024-02-10T08:26:37.608 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:26:37.608 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.608 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.608 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:26:37.608 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.362330+0000", 2024-02-10T08:26:37.608 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:26:37.608 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.608 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.608 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:26:37.608 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.362330+0000", 2024-02-10T08:26:37.608 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.565e-06 2024-02-10T08:26:37.608 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.608 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.609 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:26:37.609 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.362332+0000", 2024-02-10T08:26:37.609 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8539999999999996e-06 2024-02-10T08:26:37.609 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.609 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.609 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:26:37.609 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.362337+0000", 2024-02-10T08:26:37.609 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.641e-06 2024-02-10T08:26:37.609 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.609 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.609 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:26:37.609 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.362341+0000", 2024-02-10T08:26:37.609 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.10066953300000001 2024-02-10T08:26:37.609 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.609 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.610 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:26:37.610 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.463010+0000", 2024-02-10T08:26:37.610 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6970000000000005e-06 2024-02-10T08:26:37.610 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.611 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.611 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:26:37.611 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.463020+0000", 2024-02-10T08:26:37.611 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001304609 2024-02-10T08:26:37.611 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.611 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.611 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:26:37.611 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.464325+0000", 2024-02-10T08:26:37.611 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.10199463 2024-02-10T08:26:37.611 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:26:37.611 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:26:37.611 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:26:37.611 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.611 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.611 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop_reply(client.14784.0:185688 7.9 e167/111 ondisk, result = 0)", 2024-02-10T08:26:37.612 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:23:24.363840+0000", 2024-02-10T08:26:37.612 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 193.140598522, 2024-02-10T08:26:37.612 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.101645918, 2024-02-10T08:26:37.612 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:26:37.612 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-02-10T08:26:37.612 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:26:37.612 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.612 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:26:37.612 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.363840+0000", 2024-02-10T08:26:37.612 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:26:37.612 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.612 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.612 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:26:37.613 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.363840+0000", 2024-02-10T08:26:37.613 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:26:37.613 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.613 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.613 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:26:37.613 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.363840+0000", 2024-02-10T08:26:37.613 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6849999999999998e-06 2024-02-10T08:26:37.613 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.613 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.613 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:26:37.613 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.363845+0000", 2024-02-10T08:26:37.613 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.098908898999999995 2024-02-10T08:26:37.613 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.613 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.613 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:26:37.614 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.462754+0000", 2024-02-10T08:26:37.614 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3319000000000001e-05 2024-02-10T08:26:37.614 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.614 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.614 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:26:37.614 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.462767+0000", 2024-02-10T08:26:37.614 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0015808529999999999 2024-02-10T08:26:37.614 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.614 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.614 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:26:37.614 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.464348+0000", 2024-02-10T08:26:37.614 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5100000000000001e-06 2024-02-10T08:26:37.614 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.614 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.614 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:26:37.615 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.464356+0000", 2024-02-10T08:26:37.615 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001130381 2024-02-10T08:26:37.615 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.615 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.615 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:26:37.615 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.465486+0000", 2024-02-10T08:26:37.615 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.101645918 2024-02-10T08:26:37.615 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:26:37.615 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:26:37.615 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:26:37.615 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.615 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.615 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.14784.0:185704 7.4 e167/164 7:2ed1b197:::benchmark_data_smithi018_80623_object84776:head v 167'11593, mlcod=167'11590)", 2024-02-10T08:26:37.615 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:23:24.366203+0000", 2024-02-10T08:26:37.616 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 193.13823578500001, 2024-02-10T08:26:37.616 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.103812249, 2024-02-10T08:26:37.616 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:26:37.616 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:26:37.616 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:26:37.616 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.616 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:26:37.616 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.366203+0000", 2024-02-10T08:26:37.616 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:26:37.616 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.616 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.616 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:26:37.616 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.366203+0000", 2024-02-10T08:26:37.617 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:26:37.617 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.617 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.617 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:26:37.617 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.366202+0000", 2024-02-10T08:26:37.617 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4850000000000003e-06 2024-02-10T08:26:37.617 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.617 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.617 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:26:37.617 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.366210+0000", 2024-02-10T08:26:37.617 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.097461556000000005 2024-02-10T08:26:37.617 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.617 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.617 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:26:37.617 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.463671+0000", 2024-02-10T08:26:37.618 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1309999999999995e-06 2024-02-10T08:26:37.618 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.618 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.618 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:26:37.618 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.463680+0000", 2024-02-10T08:26:37.618 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001691609 2024-02-10T08:26:37.618 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.618 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.618 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:26:37.618 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.465372+0000", 2024-02-10T08:26:37.618 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.4521000000000001e-05 2024-02-10T08:26:37.618 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.618 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.618 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:26:37.618 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.465397+0000", 2024-02-10T08:26:37.619 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0045736479999999996 2024-02-10T08:26:37.619 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.619 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.619 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:26:37.619 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.469970+0000", 2024-02-10T08:26:37.619 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5059999999999999e-05 2024-02-10T08:26:37.619 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:37.619 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:37.619 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:26:37.619 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.470015+0000", 2024-02-10T08:26:37.619 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.103812249 2024-02-10T08:26:37.619 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:26:37.619 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:26:37.619 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:26:37.619 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:26:37.620 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:26:37.620 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-02-10T08:26:37.620 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:26:37.620 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:37.621 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:26:37.621 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:26:37.722 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:26:37.782 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:37.805 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:26:37.809 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:37.809 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:26:37.910 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:26:37.956 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:38.023 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:26:38.027 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:38.028 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:26:38.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:36.751635+0000 mgr.y (mgr.14505) 373 : cluster [DBG] pgmap v442: 158 pgs: 158 active+clean; 5.9 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.08k op/s 2024-02-10T08:26:38.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:36.752465+0000 osd.5 (osd.5) 122 : cluster [DBG] 8.0 scrub ok 2024-02-10T08:26:38.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:37.387311+0000 osd.6 (osd.6) 98 : cluster [DBG] 8.5 scrub ok 2024-02-10T08:26:38.129 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:26:38.182 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:38.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:36.751635+0000 mgr.y (mgr.14505) 373 : cluster [DBG] pgmap v442: 158 pgs: 158 active+clean; 5.9 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.08k op/s 2024-02-10T08:26:38.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:36.752465+0000 osd.5 (osd.5) 122 : cluster [DBG] 8.0 scrub ok 2024-02-10T08:26:38.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:37.387311+0000 osd.6 (osd.6) 98 : cluster [DBG] 8.5 scrub ok 2024-02-10T08:26:38.539 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:26:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:26:38.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:36.751635+0000 mgr.y (mgr.14505) 373 : cluster [DBG] pgmap v442: 158 pgs: 158 active+clean; 5.9 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.08k op/s 2024-02-10T08:26:38.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:36.752465+0000 osd.5 (osd.5) 122 : cluster [DBG] 8.0 scrub ok 2024-02-10T08:26:38.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:37.387311+0000 osd.6 (osd.6) 98 : cluster [DBG] 8.5 scrub ok 2024-02-10T08:26:38.998 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-10T08:26:39.248 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:26:39.254 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:39.254 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:26:39.355 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:26:39.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:26:38.042478+0000 mgr.y (mgr.14505) 374 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:26:39.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:38.058628+0000 osd.1 (osd.1) 118 : cluster [DBG] 5.17 scrub starts 2024-02-10T08:26:39.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:38.062158+0000 osd.1 (osd.1) 119 : cluster [DBG] 5.17 scrub ok 2024-02-10T08:26:39.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:26:38.042478+0000 mgr.y (mgr.14505) 374 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:26:39.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:38.058628+0000 osd.1 (osd.1) 118 : cluster [DBG] 5.17 scrub starts 2024-02-10T08:26:39.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:38.062158+0000 osd.1 (osd.1) 119 : cluster [DBG] 5.17 scrub ok 2024-02-10T08:26:39.406 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:39.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:26:38.042478+0000 mgr.y (mgr.14505) 374 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:26:39.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:38.058628+0000 osd.1 (osd.1) 118 : cluster [DBG] 5.17 scrub starts 2024-02-10T08:26:39.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:38.062158+0000 osd.1 (osd.1) 119 : cluster [DBG] 5.17 scrub ok 2024-02-10T08:26:39.892 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.1 dump_ops_in_flight 2024-02-10T08:26:40.137 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:38.754740+0000 mgr.y (mgr.14505) 375 : cluster [DBG] pgmap v443: 158 pgs: 158 active+clean; 5.6 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 952 B/s rd, 0 B/s wr, 1.07k op/s 2024-02-10T08:26:40.137 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:38.947276+0000 osd.5 (osd.5) 123 : cluster [DBG] 8.d scrub starts 2024-02-10T08:26:40.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:38.754740+0000 mgr.y (mgr.14505) 375 : cluster [DBG] pgmap v443: 158 pgs: 158 active+clean; 5.6 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 952 B/s rd, 0 B/s wr, 1.07k op/s 2024-02-10T08:26:40.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:38.947276+0000 osd.5 (osd.5) 123 : cluster [DBG] 8.d scrub starts 2024-02-10T08:26:40.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:38.754740+0000 mgr.y (mgr.14505) 375 : cluster [DBG] pgmap v443: 158 pgs: 158 active+clean; 5.6 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 952 B/s rd, 0 B/s wr, 1.07k op/s 2024-02-10T08:26:40.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:38.947276+0000 osd.5 (osd.5) 123 : cluster [DBG] 8.d scrub starts 2024-02-10T08:26:41.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:39.904716+0000 osd.4 (osd.4) 42 : cluster [DBG] 4.c scrub starts 2024-02-10T08:26:41.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:39.910187+0000 osd.4 (osd.4) 43 : cluster [DBG] 4.c scrub ok 2024-02-10T08:26:41.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:40.144498+0000 osd.0 (osd.0) 112 : cluster [DBG] 4.b scrub starts 2024-02-10T08:26:41.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:40.150786+0000 osd.0 (osd.0) 113 : cluster [DBG] 4.b scrub ok 2024-02-10T08:26:41.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:39.904716+0000 osd.4 (osd.4) 42 : cluster [DBG] 4.c scrub starts 2024-02-10T08:26:41.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:39.910187+0000 osd.4 (osd.4) 43 : cluster [DBG] 4.c scrub ok 2024-02-10T08:26:41.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:40.144498+0000 osd.0 (osd.0) 112 : cluster [DBG] 4.b scrub starts 2024-02-10T08:26:41.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:40.150786+0000 osd.0 (osd.0) 113 : cluster [DBG] 4.b scrub ok 2024-02-10T08:26:41.542 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:41 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:39.904716+0000 osd.4 (osd.4) 42 : cluster [DBG] 4.c scrub starts 2024-02-10T08:26:41.543 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:41 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:39.910187+0000 osd.4 (osd.4) 43 : cluster [DBG] 4.c scrub ok 2024-02-10T08:26:41.543 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:41 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:40.144498+0000 osd.0 (osd.0) 112 : cluster [DBG] 4.b scrub starts 2024-02-10T08:26:41.543 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:41 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:40.150786+0000 osd.0 (osd.0) 113 : cluster [DBG] 4.b scrub ok 2024-02-10T08:26:41.997 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:26:42.007 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:42.008 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:26:42.109 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:26:42.155 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:42.184 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:26:42.187 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:42.187 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:26:42.192 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is set 2024-02-10T08:26:42.217 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:40.755865+0000 mgr.y (mgr.14505) 376 : cluster [DBG] pgmap v444: 158 pgs: 158 active+clean; 5.5 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 960 op/s 2024-02-10T08:26:42.217 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:41.144491+0000 osd.5 (osd.5) 124 : cluster [DBG] 8.d scrub ok 2024-02-10T08:26:42.217 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:41.231842+0000 osd.6 (osd.6) 99 : cluster [DBG] 8.9 scrub starts 2024-02-10T08:26:42.217 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:26:41.383218+0000 mon.a (mon.0) 1167 : audit [INF] from='client.? 172.21.15.18:0/3337526322' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:26:42.219 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:40.755865+0000 mgr.y (mgr.14505) 376 : cluster [DBG] pgmap v444: 158 pgs: 158 active+clean; 5.5 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 960 op/s 2024-02-10T08:26:42.219 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:41.144491+0000 osd.5 (osd.5) 124 : cluster [DBG] 8.d scrub ok 2024-02-10T08:26:42.219 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:41.231842+0000 osd.6 (osd.6) 99 : cluster [DBG] 8.9 scrub starts 2024-02-10T08:26:42.219 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:26:41.383218+0000 mon.a (mon.0) 1167 : audit [INF] from='client.? 172.21.15.18:0/3337526322' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:26:42.288 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:26:42.337 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:42.367 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:26:42.377 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:42.377 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:26:42.478 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:26:42.516 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:40.755865+0000 mgr.y (mgr.14505) 376 : cluster [DBG] pgmap v444: 158 pgs: 158 active+clean; 5.5 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 960 op/s 2024-02-10T08:26:42.516 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:41.144491+0000 osd.5 (osd.5) 124 : cluster [DBG] 8.d scrub ok 2024-02-10T08:26:42.516 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:41.231842+0000 osd.6 (osd.6) 99 : cluster [DBG] 8.9 scrub starts 2024-02-10T08:26:42.516 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:26:41.383218+0000 mon.a (mon.0) 1167 : audit [INF] from='client.? 172.21.15.18:0/3337526322' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:26:42.525 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:42.552 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:26:42.555 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:42.556 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:26:42.657 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:26:42.706 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:42.735 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:26:42.742 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:42.743 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:26:42.844 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:26:42.913 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:42.963 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:26:42.967 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:42.968 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:26:42.975 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:26:43.069 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:26:43.122 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:43.150 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:26:43.153 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:43.154 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:26:43.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:42.144659+0000 mon.a (mon.0) 1168 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:26:43.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:26:42.158363+0000 mon.a (mon.0) 1169 : audit [INF] from='client.? 172.21.15.18:0/3337526322' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-10T08:26:43.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:42.158420+0000 mon.a (mon.0) 1170 : cluster [DBG] osdmap e224: 8 total, 8 up, 8 in 2024-02-10T08:26:43.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:42.144659+0000 mon.a (mon.0) 1168 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:26:43.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:26:42.158363+0000 mon.a (mon.0) 1169 : audit [INF] from='client.? 172.21.15.18:0/3337526322' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-10T08:26:43.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:42.158420+0000 mon.a (mon.0) 1170 : cluster [DBG] osdmap e224: 8 total, 8 up, 8 in 2024-02-10T08:26:43.254 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:26:43.308 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:43.339 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:26:43.342 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:43.342 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:26:43.443 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:26:43.499 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:43.535 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:26:43.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:43 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:42.144659+0000 mon.a (mon.0) 1168 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:26:43.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:43 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:26:42.158363+0000 mon.a (mon.0) 1169 : audit [INF] from='client.? 172.21.15.18:0/3337526322' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-10T08:26:43.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:43 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:42.158420+0000 mon.a (mon.0) 1170 : cluster [DBG] osdmap e224: 8 total, 8 up, 8 in 2024-02-10T08:26:43.545 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:43.545 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:26:43.646 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:26:43.689 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:43.726 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:26:43.728 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:43.728 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:26:43.829 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:26:43.884 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:44.068 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:26:44.253 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:26:44.259 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:44.260 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:26:44.361 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:26:44.425 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:42.756595+0000 mgr.y (mgr.14505) 377 : cluster [DBG] pgmap v446: 158 pgs: 158 active+clean; 5.3 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.10k op/s 2024-02-10T08:26:44.425 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:42.756595+0000 mgr.y (mgr.14505) 377 : cluster [DBG] pgmap v446: 158 pgs: 158 active+clean; 5.3 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.10k op/s 2024-02-10T08:26:44.437 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:44.543 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:44 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:42.756595+0000 mgr.y (mgr.14505) 377 : cluster [DBG] pgmap v446: 158 pgs: 158 active+clean; 5.3 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.10k op/s 2024-02-10T08:26:45.533 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd set nodeep-scrub 2024-02-10T08:26:46.312 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:26:46.318 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:46.318 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:26:46.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:44.764106+0000 mgr.y (mgr.14505) 378 : cluster [DBG] pgmap v447: 158 pgs: 158 active+clean; 5.2 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.11k op/s 2024-02-10T08:26:46.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:44.764106+0000 mgr.y (mgr.14505) 378 : cluster [DBG] pgmap v447: 158 pgs: 158 active+clean; 5.2 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.11k op/s 2024-02-10T08:26:46.419 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:26:46.480 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:46.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:44.764106+0000 mgr.y (mgr.14505) 378 : cluster [DBG] pgmap v447: 158 pgs: 158 active+clean; 5.2 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.11k op/s 2024-02-10T08:26:46.595 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:26:46.602 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:46.603 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:26:46.704 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:26:46.768 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:46.791 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:26:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:26:46] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:26:46.793 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-02-10T08:26:46.793 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-02-10T08:26:46.793 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:46.793 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14964.0:168278 8.1 8:8b9b2a17:::benchmark_data_smithi018_103312_object43846:head [delete] snapc 0=[] ondisk+write+known_if_redirected e224)", 2024-02-10T08:26:46.793 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:26:46.781101+0000", 2024-02-10T08:26:46.793 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.010624286, 2024-02-10T08:26:46.793 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.010654953, 2024-02-10T08:26:46.793 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:26:46.793 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "waiting for sub ops", 2024-02-10T08:26:46.793 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:26:46.793 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14964", 2024-02-10T08:26:46.793 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/3173131962", 2024-02-10T08:26:46.794 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 168278 2024-02-10T08:26:46.794 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:46.794 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:26:46.794 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:46.794 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:26:46.794 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:46.781101+0000", 2024-02-10T08:26:46.794 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:26:46.794 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:46.794 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:46.794 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:26:46.794 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:46.781101+0000", 2024-02-10T08:26:46.794 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:26:46.794 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:46.794 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:46.794 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:26:46.794 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:46.781100+0000", 2024-02-10T08:26:46.795 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9399999999999999e-06 2024-02-10T08:26:46.795 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:46.795 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:46.795 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:26:46.795 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:46.781106+0000", 2024-02-10T08:26:46.795 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2729999999999997e-06 2024-02-10T08:26:46.795 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:46.795 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:46.795 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:26:46.795 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:46.781113+0000", 2024-02-10T08:26:46.795 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2079999999999999e-06 2024-02-10T08:26:46.795 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:46.795 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:46.795 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:26:46.795 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:46.781118+0000", 2024-02-10T08:26:46.795 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5582999999999996e-05 2024-02-10T08:26:46.796 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:46.796 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:46.796 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:26:46.796 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:46.781214+0000", 2024-02-10T08:26:46.796 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2436999999999998e-05 2024-02-10T08:26:46.796 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:46.796 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:46.796 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:26:46.796 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:46.781286+0000", 2024-02-10T08:26:46.796 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9450000000000007e-05 2024-02-10T08:26:46.796 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:46.796 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:46.796 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0,2", 2024-02-10T08:26:46.796 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:46.781366+0000", 2024-02-10T08:26:46.796 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0035468869999999999 2024-02-10T08:26:46.796 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:46.797 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:46.797 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:26:46.797 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:46.784913+0000", 2024-02-10T08:26:46.797 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6527999999999997e-05 2024-02-10T08:26:46.797 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:46.797 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:46.797 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:26:46.797 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:46.784979+0000", 2024-02-10T08:26:46.797 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.003877999 2024-02-10T08:26:46.797 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:26:46.797 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:26:46.797 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:26:46.797 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:46.797 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:46.797 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.14964.0:168282 8.0 e224/191 8:02efe226:::benchmark_data_smithi018_103312_object43850:head v 224'10676, mlcod=224'10673)", 2024-02-10T08:26:46.798 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:26:46.790900+0000", 2024-02-10T08:26:46.798 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.00082563700000000005, 2024-02-10T08:26:46.798 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00097238399999999997, 2024-02-10T08:26:46.798 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:26:46.798 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-02-10T08:26:46.798 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:26:46.798 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:46.798 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:26:46.798 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:46.790900+0000", 2024-02-10T08:26:46.798 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:26:46.798 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:46.798 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:46.798 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:26:46.798 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:46.790900+0000", 2024-02-10T08:26:46.798 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:26:46.798 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:46.799 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:46.799 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:26:46.799 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:46.790899+0000", 2024-02-10T08:26:46.799 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1598e-05 2024-02-10T08:26:46.799 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:46.799 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:46.799 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:26:46.799 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:46.790910+0000", 2024-02-10T08:26:46.799 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6960999999999999e-05 2024-02-10T08:26:46.799 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:46.799 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:46.799 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:26:46.799 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:46.790927+0000", 2024-02-10T08:26:46.800 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7700000000000001e-06 2024-02-10T08:26:46.800 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:46.800 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:46.800 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:26:46.800 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:46.790935+0000", 2024-02-10T08:26:46.800 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7363e-05 2024-02-10T08:26:46.800 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:46.800 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:46.800 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:26:46.800 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:46.790983+0000", 2024-02-10T08:26:46.800 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2665999999999999e-05 2024-02-10T08:26:46.800 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:46.800 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:46.800 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:26:46.800 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:46.791005+0000", 2024-02-10T08:26:46.801 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000105469 2024-02-10T08:26:46.801 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:26:46.801 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:26:46.801 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:26:46.801 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:46.801 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:46.801 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop_reply(client.14964.0:168273 8.7 e224/191 ondisk, result = 0)", 2024-02-10T08:26:46.801 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:26:46.791811+0000", 2024-02-10T08:26:46.801 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4294967295.9999146, 2024-02-10T08:26:46.801 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012517, 2024-02-10T08:26:46.801 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:26:46.801 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-02-10T08:26:46.801 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:26:46.801 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:46.801 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:26:46.801 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:46.791811+0000", 2024-02-10T08:26:46.802 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:26:46.802 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:46.802 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:46.802 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:26:46.802 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:46.791811+0000", 2024-02-10T08:26:46.802 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:26:46.802 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:46.802 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:46.802 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:26:46.802 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:46.791810+0000", 2024-02-10T08:26:46.802 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3230000000000003e-06 2024-02-10T08:26:46.802 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:46.802 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:46.802 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:26:46.802 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:46.791816+0000", 2024-02-10T08:26:46.802 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3784000000000001e-05 2024-02-10T08:26:46.803 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:46.803 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:46.803 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:26:46.803 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:46.791830+0000", 2024-02-10T08:26:46.803 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.117e-06 2024-02-10T08:26:46.803 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:46.803 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:46.803 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:26:46.803 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:46.791836+0000", 2024-02-10T08:26:46.803 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1025000000000004e-05 2024-02-10T08:26:46.803 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:46.803 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:46.803 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:26:46.803 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:46.791917+0000", 2024-02-10T08:26:46.803 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9289999999999998e-06 2024-02-10T08:26:46.803 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:46.803 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:46.804 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:26:46.804 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:46.791925+0000", 2024-02-10T08:26:46.804 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000114367 2024-02-10T08:26:46.804 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:26:46.804 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:26:46.804 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:26:46.804 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:46.804 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:46.804 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14964.0:168273 8.7 8:e0ee9e94:::benchmark_data_smithi018_103312_object43841:head [delete] snapc 0=[] ondisk+write+known_if_redirected e224)", 2024-02-10T08:26:46.804 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:26:46.774242+0000", 2024-02-10T08:26:46.804 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.017483414999999999, 2024-02-10T08:26:46.804 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.017775824999999999, 2024-02-10T08:26:46.804 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:26:46.804 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:26:46.804 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:26:46.804 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14964", 2024-02-10T08:26:46.805 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/3173131962", 2024-02-10T08:26:46.805 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 168273 2024-02-10T08:26:46.805 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:46.805 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:26:46.805 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:46.805 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:26:46.805 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:46.774242+0000", 2024-02-10T08:26:46.805 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:26:46.805 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:46.805 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:46.805 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:26:46.805 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:46.774242+0000", 2024-02-10T08:26:46.805 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:26:46.805 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:46.805 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:46.806 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:26:46.806 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:46.774241+0000", 2024-02-10T08:26:46.806 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.281e-06 2024-02-10T08:26:46.806 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:46.806 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:46.806 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:26:46.806 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:46.774245+0000", 2024-02-10T08:26:46.806 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4070000000000001e-06 2024-02-10T08:26:46.806 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:46.806 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:46.806 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:26:46.806 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:46.774250+0000", 2024-02-10T08:26:46.806 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8e-06 2024-02-10T08:26:46.806 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:46.806 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:46.806 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:26:46.807 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:46.774254+0000", 2024-02-10T08:26:46.807 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0033165669999999999 2024-02-10T08:26:46.807 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:46.807 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:46.807 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:26:46.807 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:46.777570+0000", 2024-02-10T08:26:46.807 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013794799999999999 2024-02-10T08:26:46.807 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:46.807 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:46.807 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:26:46.807 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:46.777708+0000", 2024-02-10T08:26:46.807 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016178699999999999 2024-02-10T08:26:46.807 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:46.807 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:46.807 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,6", 2024-02-10T08:26:46.808 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:46.777870+0000", 2024-02-10T08:26:46.808 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002982883 2024-02-10T08:26:46.808 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:46.808 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:46.808 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:26:46.808 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:46.780853+0000", 2024-02-10T08:26:46.808 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0041455950000000002 2024-02-10T08:26:46.808 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:46.808 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:46.808 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:26:46.808 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:46.784999+0000", 2024-02-10T08:26:46.808 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0069334039999999998 2024-02-10T08:26:46.808 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:46.809 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:46.809 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:26:46.809 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:46.791932+0000", 2024-02-10T08:26:46.809 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9172999999999998e-05 2024-02-10T08:26:46.809 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:46.809 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:46.809 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:26:46.809 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:46.791981+0000", 2024-02-10T08:26:46.809 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1655e-05 2024-02-10T08:26:46.809 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:26:46.809 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:26:46.809 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:26:46.809 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:26:46.792023+0000", 2024-02-10T08:26:46.809 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.017780996 2024-02-10T08:26:46.809 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:26:46.809 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:26:46.810 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:26:46.810 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:26:46.810 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-02-10T08:26:46.810 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 4 2024-02-10T08:26:46.810 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-02-10T08:26:47.157 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:26:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:26:47] "GET /metrics HTTP/1.1" 200 175991 "" "Prometheus/2.33.4" 2024-02-10T08:26:47.442 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:26:47.450 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:47.450 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:26:47.551 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:26:47.592 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:47.627 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:26:47.635 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:47.635 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:26:47.736 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:26:47.786 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:26:46.647480+0000 mon.a (mon.0) 1171 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:26:47.786 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:46.764547+0000 mgr.y (mgr.14505) 379 : cluster [DBG] pgmap v448: 158 pgs: 158 active+clean; 5.2 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 1022 B/s rd, 0 B/s wr, 1.11k op/s 2024-02-10T08:26:47.786 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:26:46.647480+0000 mon.a (mon.0) 1171 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:26:47.787 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:46.764547+0000 mgr.y (mgr.14505) 379 : cluster [DBG] pgmap v448: 158 pgs: 158 active+clean; 5.2 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 1022 B/s rd, 0 B/s wr, 1.11k op/s 2024-02-10T08:26:47.793 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:48.042 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:26:46.647480+0000 mon.a (mon.0) 1171 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:26:48.042 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:46.764547+0000 mgr.y (mgr.14505) 379 : cluster [DBG] pgmap v448: 158 pgs: 158 active+clean; 5.2 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 1022 B/s rd, 0 B/s wr, 1.11k op/s 2024-02-10T08:26:48.544 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:26:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:26:48.726 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.1 dump_blocked_ops 2024-02-10T08:26:48.999 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:26:49.008 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:26:48.052521+0000 mgr.y (mgr.14505) 380 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:26:49.008 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:26:48.052521+0000 mgr.y (mgr.14505) 380 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:26:49.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:26:48.052521+0000 mgr.y (mgr.14505) 380 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:26:49.073 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:26:49.079 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:49.080 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:26:49.100 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 5, 6, 7, 4] 2024-02-10T08:26:49.100 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-10T08:26:49.100 INFO:tasks.thrashosds.thrasher:inject_pause on osd.6 2024-02-10T08:26:49.100 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-02-10T08:26:49.101 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-02-10T08:26:49.101 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.6 config set filestore_inject_stall 3 2024-02-10T08:26:49.181 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:26:49.226 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:49.363 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:26:49.368 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:49.369 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:26:49.422 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:26:49.431 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:26:49.469 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:26:49.471 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:26:49.509 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:26:49.521 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:26:49.531 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:49.561 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:26:49.598 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:26:49.629 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:26:49.657 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:26:49.691 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:26:49.692 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:26:49.695 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:49.695 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:26:49.700 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-10T08:26:49.700 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-10T08:26:49.700 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-10T08:26:49.700 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-10T08:26:49.700 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-10T08:26:49.700 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-10T08:26:49.700 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-10T08:26:49.701 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-10T08:26:49.796 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:26:49.856 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:50.007 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:48.765414+0000 mgr.y (mgr.14505) 381 : cluster [DBG] pgmap v449: 158 pgs: 158 active+clean; 4.9 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1022 B/s rd, 0 B/s wr, 1.12k op/s 2024-02-10T08:26:50.008 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:26:49.383882+0000 mon.c (mon.2) 48 : audit [DBG] from='client.? 172.21.15.18:0/2875291964' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:26:50.008 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:48.765414+0000 mgr.y (mgr.14505) 381 : cluster [DBG] pgmap v449: 158 pgs: 158 active+clean; 4.9 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1022 B/s rd, 0 B/s wr, 1.12k op/s 2024-02-10T08:26:50.008 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:26:49.383882+0000 mon.c (mon.2) 48 : audit [DBG] from='client.? 172.21.15.18:0/2875291964' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:26:50.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:49 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:48.765414+0000 mgr.y (mgr.14505) 381 : cluster [DBG] pgmap v449: 158 pgs: 158 active+clean; 4.9 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1022 B/s rd, 0 B/s wr, 1.12k op/s 2024-02-10T08:26:50.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:49 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:26:49.383882+0000 mon.c (mon.2) 48 : audit [DBG] from='client.? 172.21.15.18:0/2875291964' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:26:50.419 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:26:50.423 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:50.424 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:26:50.524 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:26:50.581 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:51.350 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:26:51.353 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:51.354 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:26:51.454 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:26:51.513 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:51.660 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:26:51.666 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:51.666 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:26:51.708 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-02-10T08:26:51.709 INFO:teuthology.orchestra.run.smithi071.stdout: "success": "filestore_inject_stall = '3' (not observed, change may require restart) " 2024-02-10T08:26:51.709 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-02-10T08:26:51.767 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:26:51.829 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:51.873 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:26:51.876 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:51.877 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:26:51.975 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:50.765900+0000 mgr.y (mgr.14505) 382 : cluster [DBG] pgmap v450: 158 pgs: 158 active+clean; 4.8 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1022 B/s rd, 0 B/s wr, 1.13k op/s 2024-02-10T08:26:51.975 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:50.765900+0000 mgr.y (mgr.14505) 382 : cluster [DBG] pgmap v450: 158 pgs: 158 active+clean; 4.8 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1022 B/s rd, 0 B/s wr, 1.13k op/s 2024-02-10T08:26:51.977 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:26:52.036 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:51 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:50.765900+0000 mgr.y (mgr.14505) 382 : cluster [DBG] pgmap v450: 158 pgs: 158 active+clean; 4.8 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1022 B/s rd, 0 B/s wr, 1.13k op/s 2024-02-10T08:26:52.040 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:52.625 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:26:52.635 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:52.635 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:26:52.736 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:26:52.811 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:54.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:52.769624+0000 mgr.y (mgr.14505) 383 : cluster [DBG] pgmap v451: 158 pgs: 158 active+clean; 4.6 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 1.43k op/s 2024-02-10T08:26:54.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:26:53.353595+0000 mon.a (mon.0) 1172 : audit [INF] from='client.? 172.21.15.18:0/1692801723' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:26:54.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:52.769624+0000 mgr.y (mgr.14505) 383 : cluster [DBG] pgmap v451: 158 pgs: 158 active+clean; 4.6 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 1.43k op/s 2024-02-10T08:26:54.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:26:53.353595+0000 mon.a (mon.0) 1172 : audit [INF] from='client.? 172.21.15.18:0/1692801723' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:26:54.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:53 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:52.769624+0000 mgr.y (mgr.14505) 383 : cluster [DBG] pgmap v451: 158 pgs: 158 active+clean; 4.6 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 1.43k op/s 2024-02-10T08:26:54.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:53 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:26:53.353595+0000 mon.a (mon.0) 1172 : audit [INF] from='client.? 172.21.15.18:0/1692801723' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:26:54.380 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-10T08:26:54.574 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is set 2024-02-10T08:26:54.871 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:53.829692+0000 mon.a (mon.0) 1173 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:26:54.871 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:26:53.836832+0000 mon.a (mon.0) 1174 : audit [INF] from='client.? 172.21.15.18:0/1692801723' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-10T08:26:54.871 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:53.837142+0000 mon.a (mon.0) 1175 : cluster [DBG] osdmap e225: 8 total, 8 up, 8 in 2024-02-10T08:26:55.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:53.829692+0000 mon.a (mon.0) 1173 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:26:55.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:26:53.836832+0000 mon.a (mon.0) 1174 : audit [INF] from='client.? 172.21.15.18:0/1692801723' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-10T08:26:55.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:53.837142+0000 mon.a (mon.0) 1175 : cluster [DBG] osdmap e225: 8 total, 8 up, 8 in 2024-02-10T08:26:55.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:54 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:53.829692+0000 mon.a (mon.0) 1173 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:26:55.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:54 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:26:53.836832+0000 mon.a (mon.0) 1174 : audit [INF] from='client.? 172.21.15.18:0/1692801723' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-10T08:26:55.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:54 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:53.837142+0000 mon.a (mon.0) 1175 : cluster [DBG] osdmap e225: 8 total, 8 up, 8 in 2024-02-10T08:26:56.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:54.770201+0000 mgr.y (mgr.14505) 384 : cluster [DBG] pgmap v453: 158 pgs: 158 active+clean; 4.5 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1022 B/s rd, 0 B/s wr, 1.14k op/s 2024-02-10T08:26:56.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:54.770201+0000 mgr.y (mgr.14505) 384 : cluster [DBG] pgmap v453: 158 pgs: 158 active+clean; 4.5 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1022 B/s rd, 0 B/s wr, 1.14k op/s 2024-02-10T08:26:56.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:54.770201+0000 mgr.y (mgr.14505) 384 : cluster [DBG] pgmap v453: 158 pgs: 158 active+clean; 4.5 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1022 B/s rd, 0 B/s wr, 1.14k op/s 2024-02-10T08:26:56.792 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:26:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:26:56] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:26:57.628 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 5, 6, 7, 4] 2024-02-10T08:26:57.628 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-10T08:26:57.629 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-02-10T08:26:57.629 INFO:tasks.thrashosds.thrasher:Setting osd 0 primary_affinity to 0.125230 2024-02-10T08:26:57.629 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd primary-affinity 0 0.12522991961645147 2024-02-10T08:26:57.656 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:26:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:26:57] "GET /metrics HTTP/1.1" 200 175991 "" "Prometheus/2.33.4" 2024-02-10T08:26:57.907 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:26:57.912 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:57.912 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:26:58.013 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:26:58.067 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:58.086 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:26:58.089 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:58.089 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:26:58.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:56.771120+0000 mgr.y (mgr.14505) 385 : cluster [DBG] pgmap v454: 158 pgs: 158 active+clean; 4.5 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.14k op/s 2024-02-10T08:26:58.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:56.771120+0000 mgr.y (mgr.14505) 385 : cluster [DBG] pgmap v454: 158 pgs: 158 active+clean; 4.5 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.14k op/s 2024-02-10T08:26:58.190 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:26:58.235 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:26:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:26:58.236 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:56.771120+0000 mgr.y (mgr.14505) 385 : cluster [DBG] pgmap v454: 158 pgs: 158 active+clean; 4.5 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.14k op/s 2024-02-10T08:26:58.245 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:58.273 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:26:58.280 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:26:58.280 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:26:58.381 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:26:58.443 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:26:59.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:26:58.064770+0000 mgr.y (mgr.14505) 386 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:26:59.158 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:26:58.064770+0000 mgr.y (mgr.14505) 386 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:26:59.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:26:58.064770+0000 mgr.y (mgr.14505) 386 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:27:00.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:26:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:26:58.772808+0000 mgr.y (mgr.14505) 387 : cluster [DBG] pgmap v455: 158 pgs: 158 active+clean; 4.2 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.16k op/s 2024-02-10T08:27:00.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:26:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:26:58.772808+0000 mgr.y (mgr.14505) 387 : cluster [DBG] pgmap v455: 158 pgs: 158 active+clean; 4.2 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.16k op/s 2024-02-10T08:27:00.294 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:26:59 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:26:58.772808+0000 mgr.y (mgr.14505) 387 : cluster [DBG] pgmap v455: 158 pgs: 158 active+clean; 4.2 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.16k op/s 2024-02-10T08:27:02.042 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:00.773324+0000 mgr.y (mgr.14505) 388 : cluster [DBG] pgmap v456: 158 pgs: 158 active+clean; 4.1 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.16k op/s 2024-02-10T08:27:02.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:00.773324+0000 mgr.y (mgr.14505) 388 : cluster [DBG] pgmap v456: 158 pgs: 158 active+clean; 4.1 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.16k op/s 2024-02-10T08:27:02.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:00.773324+0000 mgr.y (mgr.14505) 388 : cluster [DBG] pgmap v456: 158 pgs: 158 active+clean; 4.1 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.16k op/s 2024-02-10T08:27:03.573 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:27:03.583 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:03.584 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:27:03.591 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:27:03.685 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:27:03.732 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:03.816 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:27:03.828 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:02.579163+0000 osd.1 (osd.1) 120 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:27:03.829 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:02.579223+0000 osd.1 (osd.1) 121 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:27:03.829 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:02.713200+0000 mon.a (mon.0) 1176 : cluster [DBG] osdmap e226: 8 total, 8 up, 8 in 2024-02-10T08:27:03.829 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:02.773735+0000 mgr.y (mgr.14505) 389 : cluster [DBG] pgmap v458: 158 pgs: 158 active+clean; 3.9 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 25 KiB/s rd, 0 B/s wr, 1.21k op/s 2024-02-10T08:27:03.829 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:02.579163+0000 osd.1 (osd.1) 120 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:27:03.829 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:02.579223+0000 osd.1 (osd.1) 121 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:27:03.829 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:02.713200+0000 mon.a (mon.0) 1176 : cluster [DBG] osdmap e226: 8 total, 8 up, 8 in 2024-02-10T08:27:03.829 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:02.773735+0000 mgr.y (mgr.14505) 389 : cluster [DBG] pgmap v458: 158 pgs: 158 active+clean; 3.9 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 25 KiB/s rd, 0 B/s wr, 1.21k op/s 2024-02-10T08:27:03.831 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:03.832 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:27:03.933 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:27:03.978 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:04.010 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:27:04.019 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:04.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:02.579163+0000 osd.1 (osd.1) 120 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:27:04.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:02.579223+0000 osd.1 (osd.1) 121 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:27:04.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:02.713200+0000 mon.a (mon.0) 1176 : cluster [DBG] osdmap e226: 8 total, 8 up, 8 in 2024-02-10T08:27:04.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:02.773735+0000 mgr.y (mgr.14505) 389 : cluster [DBG] pgmap v458: 158 pgs: 158 active+clean; 3.9 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 25 KiB/s rd, 0 B/s wr, 1.21k op/s 2024-02-10T08:27:04.020 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:27:04.121 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:27:04.160 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:04.200 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:27:04.206 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:04.206 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:27:04.307 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:27:04.355 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:04.364 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-02-10T08:27:04.364 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:27:04.591 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:27:04.601 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:04.602 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:27:04.703 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:27:04.756 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:05.115 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:27:05.125 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:05.125 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:27:05.148 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.1 dump_historic_ops 2024-02-10T08:27:05.226 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:27:05.294 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:05.572 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd unset noscrub 2024-02-10T08:27:05.608 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:27:05.673 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:27:05.678 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:05.678 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:27:05.779 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:27:05.831 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:05.855 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:27:05.861 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:05.861 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:27:05.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:04.774292+0000 mgr.y (mgr.14505) 390 : cluster [DBG] pgmap v459: 158 pgs: 158 active+clean; 3.8 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 42 KiB/s rd, 0 B/s wr, 1.22k op/s 2024-02-10T08:27:05.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:04.774292+0000 mgr.y (mgr.14505) 390 : cluster [DBG] pgmap v459: 158 pgs: 158 active+clean; 3.8 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 42 KiB/s rd, 0 B/s wr, 1.22k op/s 2024-02-10T08:27:05.962 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:27:06.004 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:06.040 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:27:06.044 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:06.044 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:27:06.145 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:27:06.209 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:04.774292+0000 mgr.y (mgr.14505) 390 : cluster [DBG] pgmap v459: 158 pgs: 158 active+clean; 3.8 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 42 KiB/s rd, 0 B/s wr, 1.22k op/s 2024-02-10T08:27:06.210 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:06.239 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:27:06.241 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:06.241 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:27:06.342 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:27:06.388 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:06.789 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:27:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:27:06] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:27:06.957 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:27:06.962 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:06.963 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:27:07.064 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:27:07.113 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:07.404 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:27:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:27:07] "GET /metrics HTTP/1.1" 200 176001 "" "Prometheus/2.33.4" 2024-02-10T08:27:07.555 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:27:07.582 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:27:07.587 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:07.588 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:27:07.688 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:27:07.736 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:07.901 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:27:07.906 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:07.906 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:27:08.007 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:27:08.067 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:08.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:06.774718+0000 mgr.y (mgr.14505) 391 : cluster [DBG] pgmap v460: 158 pgs: 158 active+clean; 3.8 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 42 KiB/s rd, 0 B/s wr, 1.22k op/s 2024-02-10T08:27:08.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:06.774718+0000 mgr.y (mgr.14505) 391 : cluster [DBG] pgmap v460: 158 pgs: 158 active+clean; 3.8 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 42 KiB/s rd, 0 B/s wr, 1.22k op/s 2024-02-10T08:27:08.211 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:27:08.217 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:08.217 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:27:08.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:06.774718+0000 mgr.y (mgr.14505) 391 : cluster [DBG] pgmap v460: 158 pgs: 158 active+clean; 3.8 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 42 KiB/s rd, 0 B/s wr, 1.22k op/s 2024-02-10T08:27:08.291 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:27:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:27:08.318 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:27:08.379 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:09.158 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:27:08.075289+0000 mgr.y (mgr.14505) 392 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:27:09.162 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:27:08.075289+0000 mgr.y (mgr.14505) 392 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:27:09.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:27:08.075289+0000 mgr.y (mgr.14505) 392 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:27:09.429 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:27:09.856 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:27:09.860 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:09.860 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:27:09.962 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:27:10.007 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:08.775552+0000 mgr.y (mgr.14505) 393 : cluster [DBG] pgmap v461: 158 pgs: 158 active+clean; 3.5 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 44 KiB/s rd, 0 B/s wr, 1.18k op/s 2024-02-10T08:27:10.007 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:27:09.132515+0000 mon.a (mon.0) 1177 : audit [DBG] from='client.? 172.21.15.18:0/762712546' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:27:10.007 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:08.775552+0000 mgr.y (mgr.14505) 393 : cluster [DBG] pgmap v461: 158 pgs: 158 active+clean; 3.5 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 44 KiB/s rd, 0 B/s wr, 1.18k op/s 2024-02-10T08:27:10.007 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:27:09.132515+0000 mon.a (mon.0) 1177 : audit [DBG] from='client.? 172.21.15.18:0/762712546' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:27:10.012 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:10.230 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:27:10.234 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:10.235 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:27:10.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:08.775552+0000 mgr.y (mgr.14505) 393 : cluster [DBG] pgmap v461: 158 pgs: 158 active+clean; 3.5 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 44 KiB/s rd, 0 B/s wr, 1.18k op/s 2024-02-10T08:27:10.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:27:09.132515+0000 mon.a (mon.0) 1177 : audit [DBG] from='client.? 172.21.15.18:0/762712546' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:27:10.335 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:27:10.426 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:10.545 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-02-10T08:27:10.545 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-02-10T08:27:10.545 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-02-10T08:27:10.545 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-02-10T08:27:10.545 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.545 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:64572 7.b 7:d4591f65:::benchmark_data_smithi018_80623_object64571:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e102)", 2024-02-10T08:27:10.545 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:29.952114+0000", 2024-02-10T08:27:10.545 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 400.45962804700002, 2024-02-10T08:27:10.546 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.081601512000000001, 2024-02-10T08:27:10.546 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:27:10.546 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:27:10.546 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:27:10.546 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:27:10.546 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:27:10.546 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 64572 2024-02-10T08:27:10.546 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.546 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:27:10.546 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.546 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:27:10.546 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:29.952114+0000", 2024-02-10T08:27:10.546 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:27:10.546 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.546 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.546 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:27:10.547 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:29.952114+0000", 2024-02-10T08:27:10.547 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999981 2024-02-10T08:27:10.547 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.547 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.547 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:27:10.547 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:29.952112+0000", 2024-02-10T08:27:10.547 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0598000000000002e-05 2024-02-10T08:27:10.547 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.547 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.547 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:27:10.547 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:29.952133+0000", 2024-02-10T08:27:10.547 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0789e-05 2024-02-10T08:27:10.547 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.547 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.547 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:27:10.547 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:29.952144+0000", 2024-02-10T08:27:10.548 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5590000000000002e-06 2024-02-10T08:27:10.548 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.548 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.548 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:27:10.548 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:29.952150+0000", 2024-02-10T08:27:10.548 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9857000000000001e-05 2024-02-10T08:27:10.548 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.548 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.548 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:27:10.548 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:29.952190+0000", 2024-02-10T08:27:10.548 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.826e-06 2024-02-10T08:27:10.550 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.551 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.551 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-02-10T08:27:10.551 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:29.952195+0000", 2024-02-10T08:27:10.551 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.026224085000000001 2024-02-10T08:27:10.551 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.551 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.551 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:27:10.551 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:29.978419+0000", 2024-02-10T08:27:10.551 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000127121 2024-02-10T08:27:10.551 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.551 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.551 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:27:10.551 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:29.978546+0000", 2024-02-10T08:27:10.551 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015838399999999999 2024-02-10T08:27:10.551 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.552 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.552 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 5,6", 2024-02-10T08:27:10.552 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:29.978704+0000", 2024-02-10T08:27:10.552 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0073248339999999997 2024-02-10T08:27:10.552 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.552 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.552 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:27:10.552 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:29.986029+0000", 2024-02-10T08:27:10.552 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.031156205999999999 2024-02-10T08:27:10.552 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.552 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.552 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:27:10.552 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:30.017185+0000", 2024-02-10T08:27:10.552 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.016439120000000002 2024-02-10T08:27:10.552 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.552 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.553 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:27:10.553 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:30.033625+0000", 2024-02-10T08:27:10.553 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2543000000000002e-05 2024-02-10T08:27:10.553 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.553 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.553 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:27:10.553 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:30.033677+0000", 2024-02-10T08:27:10.553 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8359999999999999e-05 2024-02-10T08:27:10.553 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.553 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.553 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:27:10.553 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:30.033715+0000", 2024-02-10T08:27:10.553 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.081601512000000001 2024-02-10T08:27:10.553 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:10.554 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:27:10.554 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:10.554 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.554 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.554 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.14784.0:77149 7.d e107/91 7:bf968826:::benchmark_data_smithi018_80623_object77148:head v 107'4768, mlcod=107'4765)", 2024-02-10T08:27:10.554 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:42.079066+0000", 2024-02-10T08:27:10.554 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 388.332675741, 2024-02-10T08:27:10.554 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086684774000000006, 2024-02-10T08:27:10.554 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:27:10.554 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:27:10.554 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:27:10.554 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.554 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:27:10.554 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.079066+0000", 2024-02-10T08:27:10.554 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:27:10.554 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.554 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.555 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:27:10.555 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.079066+0000", 2024-02-10T08:27:10.555 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:27:10.555 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.555 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.555 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:27:10.555 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.079066+0000", 2024-02-10T08:27:10.555 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4546000000000002e-05 2024-02-10T08:27:10.555 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.555 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.555 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:27:10.555 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.079130+0000", 2024-02-10T08:27:10.555 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.515e-06 2024-02-10T08:27:10.555 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.555 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.556 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:27:10.556 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.079138+0000", 2024-02-10T08:27:10.556 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0929999999999996e-06 2024-02-10T08:27:10.556 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.556 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.556 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:27:10.556 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.079142+0000", 2024-02-10T08:27:10.556 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0508e-05 2024-02-10T08:27:10.556 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.556 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.556 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:27:10.556 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.079172+0000", 2024-02-10T08:27:10.556 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1972e-05 2024-02-10T08:27:10.556 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.556 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.557 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:27:10.557 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.079184+0000", 2024-02-10T08:27:10.557 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.084501413999999997 2024-02-10T08:27:10.557 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.557 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.557 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:27:10.557 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.163686+0000", 2024-02-10T08:27:10.557 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0020654459999999999 2024-02-10T08:27:10.557 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.557 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.557 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:27:10.557 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.165751+0000", 2024-02-10T08:27:10.557 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086684774000000006 2024-02-10T08:27:10.557 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:10.557 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:27:10.557 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:10.558 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.558 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.558 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:153198 7.b 7:d965b4d6:::benchmark_data_smithi018_80623_object52270:head [delete] snapc 0=[] ondisk+write+known_if_redirected e149)", 2024-02-10T08:27:10.558 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:22:37.562841+0000", 2024-02-10T08:27:10.558 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 272.84890080299999, 2024-02-10T08:27:10.558 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.068126513999999999, 2024-02-10T08:27:10.558 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:27:10.558 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:27:10.558 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:27:10.558 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:27:10.558 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:27:10.558 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 153198 2024-02-10T08:27:10.558 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.558 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:27:10.558 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.558 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:27:10.559 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.562841+0000", 2024-02-10T08:27:10.559 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:27:10.559 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.559 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.559 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:27:10.559 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.562841+0000", 2024-02-10T08:27:10.559 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:27:10.559 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.559 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.559 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:27:10.559 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.562841+0000", 2024-02-10T08:27:10.559 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1350000000000001e-06 2024-02-10T08:27:10.559 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.559 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.559 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:27:10.559 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.562844+0000", 2024-02-10T08:27:10.559 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0179999999999998e-06 2024-02-10T08:27:10.560 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.560 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.560 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:27:10.560 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.562850+0000", 2024-02-10T08:27:10.560 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3209999999999998e-06 2024-02-10T08:27:10.560 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.560 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.560 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:27:10.560 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.562854+0000", 2024-02-10T08:27:10.560 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00246437 2024-02-10T08:27:10.560 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.560 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.560 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:27:10.560 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.565318+0000", 2024-02-10T08:27:10.560 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000100599 2024-02-10T08:27:10.560 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.561 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.561 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:27:10.561 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.565419+0000", 2024-02-10T08:27:10.561 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012306099999999999 2024-02-10T08:27:10.561 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.561 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.561 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 5,6", 2024-02-10T08:27:10.561 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.565542+0000", 2024-02-10T08:27:10.561 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0020561189999999999 2024-02-10T08:27:10.561 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.561 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.561 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:27:10.561 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.567598+0000", 2024-02-10T08:27:10.561 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00075990599999999997 2024-02-10T08:27:10.561 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.561 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.561 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:27:10.562 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.568358+0000", 2024-02-10T08:27:10.562 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.062505851000000001 2024-02-10T08:27:10.562 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.562 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.562 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:27:10.562 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.630864+0000", 2024-02-10T08:27:10.562 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6558000000000003e-05 2024-02-10T08:27:10.562 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.562 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.562 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:27:10.562 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.630921+0000", 2024-02-10T08:27:10.562 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7172000000000002e-05 2024-02-10T08:27:10.562 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.562 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.562 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:27:10.562 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.630968+0000", 2024-02-10T08:27:10.563 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.068126513999999999 2024-02-10T08:27:10.563 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:10.563 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:27:10.563 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:10.563 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.563 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.563 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:153205 7.2 7:410b9e6c:::benchmark_data_smithi018_80623_object52277:head [delete] snapc 0=[] ondisk+write+known_if_redirected e149)", 2024-02-10T08:27:10.563 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:22:37.568270+0000", 2024-02-10T08:27:10.563 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 272.84347158000003, 2024-02-10T08:27:10.563 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.073131208000000003, 2024-02-10T08:27:10.563 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:27:10.563 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:27:10.563 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:27:10.563 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:27:10.564 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:27:10.564 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 153205 2024-02-10T08:27:10.564 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.564 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:27:10.564 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.564 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:27:10.564 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.568270+0000", 2024-02-10T08:27:10.564 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:27:10.564 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.564 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.564 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:27:10.564 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.568270+0000", 2024-02-10T08:27:10.564 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:27:10.564 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.565 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.565 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:27:10.565 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.568269+0000", 2024-02-10T08:27:10.565 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2200000000000003e-06 2024-02-10T08:27:10.565 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.565 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.565 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:27:10.565 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.568276+0000", 2024-02-10T08:27:10.565 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0849999999999997e-06 2024-02-10T08:27:10.565 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.565 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.565 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:27:10.565 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.568285+0000", 2024-02-10T08:27:10.565 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7649999999999999e-06 2024-02-10T08:27:10.565 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.565 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.565 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:27:10.566 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.568290+0000", 2024-02-10T08:27:10.566 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7422999999999995e-05 2024-02-10T08:27:10.566 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.566 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.566 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:27:10.566 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.568358+0000", 2024-02-10T08:27:10.566 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012063200000000001 2024-02-10T08:27:10.566 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.566 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.566 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:27:10.566 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.568478+0000", 2024-02-10T08:27:10.566 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013144900000000001 2024-02-10T08:27:10.566 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.566 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.566 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 2,3", 2024-02-10T08:27:10.566 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.568610+0000", 2024-02-10T08:27:10.566 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.063553605999999999 2024-02-10T08:27:10.567 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.567 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.567 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:27:10.567 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.632163+0000", 2024-02-10T08:27:10.567 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0066444420000000004 2024-02-10T08:27:10.567 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.567 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.567 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:27:10.567 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.638808+0000", 2024-02-10T08:27:10.567 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0025031630000000001 2024-02-10T08:27:10.567 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.567 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.567 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:27:10.567 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.641311+0000", 2024-02-10T08:27:10.567 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1916999999999998e-05 2024-02-10T08:27:10.567 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.568 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.568 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:27:10.568 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.641363+0000", 2024-02-10T08:27:10.568 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8655999999999997e-05 2024-02-10T08:27:10.568 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.568 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.568 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:27:10.568 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.641402+0000", 2024-02-10T08:27:10.568 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.073131208000000003 2024-02-10T08:27:10.568 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:10.568 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:27:10.568 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:10.568 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.568 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.568 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.14784.0:153201 7.0 e149/91 7:0da3817c:::benchmark_data_smithi018_80623_object52273:head v 149'9496, mlcod=149'9494)", 2024-02-10T08:27:10.569 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:22:37.568654+0000", 2024-02-10T08:27:10.569 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 272.843088077, 2024-02-10T08:27:10.569 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.073419021000000001, 2024-02-10T08:27:10.569 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:27:10.569 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:27:10.569 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:27:10.569 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.569 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:27:10.569 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.568654+0000", 2024-02-10T08:27:10.569 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:27:10.569 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.569 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.569 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:27:10.569 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.568654+0000", 2024-02-10T08:27:10.569 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:27:10.570 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.570 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.570 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:27:10.570 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.568653+0000", 2024-02-10T08:27:10.570 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2740000000000004e-06 2024-02-10T08:27:10.570 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.570 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.570 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:27:10.570 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.568660+0000", 2024-02-10T08:27:10.570 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.056815101 2024-02-10T08:27:10.570 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.570 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.570 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:27:10.570 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.625475+0000", 2024-02-10T08:27:10.570 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0129999999999996e-06 2024-02-10T08:27:10.570 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.571 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.571 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:27:10.571 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.625482+0000", 2024-02-10T08:27:10.571 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015673400000000001 2024-02-10T08:27:10.571 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.571 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.571 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:27:10.571 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.625638+0000", 2024-02-10T08:27:10.571 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1712000000000002e-05 2024-02-10T08:27:10.571 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.571 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.571 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:27:10.571 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.625660+0000", 2024-02-10T08:27:10.571 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.016385183000000001 2024-02-10T08:27:10.571 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.571 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.571 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:27:10.572 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.642045+0000", 2024-02-10T08:27:10.572 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7665999999999999e-05 2024-02-10T08:27:10.572 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.572 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.572 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:27:10.572 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.642073+0000", 2024-02-10T08:27:10.572 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.073419021000000001 2024-02-10T08:27:10.572 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:10.572 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:27:10.572 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:10.572 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.572 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.572 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:154696 7.2 7:40aef3be:::benchmark_data_smithi018_80623_object53768:head [delete] snapc 0=[] ondisk+write+known_if_redirected e149)", 2024-02-10T08:27:10.572 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:22:39.548912+0000", 2024-02-10T08:27:10.572 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 270.862830288, 2024-02-10T08:27:10.572 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.069045797000000006, 2024-02-10T08:27:10.573 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:27:10.573 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:27:10.573 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:27:10.573 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:27:10.573 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:27:10.573 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 154696 2024-02-10T08:27:10.573 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.573 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:27:10.573 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.573 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:27:10.573 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.548912+0000", 2024-02-10T08:27:10.573 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:27:10.573 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.573 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.573 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:27:10.574 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.548912+0000", 2024-02-10T08:27:10.574 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:27:10.574 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.574 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.574 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:27:10.574 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.548910+0000", 2024-02-10T08:27:10.574 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2210000000000002e-06 2024-02-10T08:27:10.574 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.574 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.574 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:27:10.574 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.548916+0000", 2024-02-10T08:27:10.574 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1537e-05 2024-02-10T08:27:10.574 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.574 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.574 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:27:10.574 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.548928+0000", 2024-02-10T08:27:10.575 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0400000000000004e-06 2024-02-10T08:27:10.575 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.575 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.575 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:27:10.575 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.548935+0000", 2024-02-10T08:27:10.575 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0695999999999998e-05 2024-02-10T08:27:10.575 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.575 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.575 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:27:10.575 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.548976+0000", 2024-02-10T08:27:10.575 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012357399999999999 2024-02-10T08:27:10.575 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.575 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.575 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:27:10.575 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.549099+0000", 2024-02-10T08:27:10.575 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000128446 2024-02-10T08:27:10.576 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.576 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.576 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 2,3", 2024-02-10T08:27:10.576 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.549228+0000", 2024-02-10T08:27:10.576 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0079650209999999992 2024-02-10T08:27:10.576 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.576 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.576 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:27:10.576 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.557193+0000", 2024-02-10T08:27:10.576 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0048933140000000002 2024-02-10T08:27:10.576 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.576 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.576 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:27:10.576 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.562086+0000", 2024-02-10T08:27:10.576 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.055774518000000002 2024-02-10T08:27:10.576 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.577 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.577 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:27:10.577 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.617860+0000", 2024-02-10T08:27:10.577 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5177999999999999e-05 2024-02-10T08:27:10.577 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.577 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.577 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:27:10.577 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.617916+0000", 2024-02-10T08:27:10.577 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1836999999999999e-05 2024-02-10T08:27:10.577 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.577 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.577 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:27:10.577 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.617958+0000", 2024-02-10T08:27:10.577 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.069045797000000006 2024-02-10T08:27:10.577 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:10.578 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:27:10.578 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:10.578 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.578 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.578 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:154715 7.2 7:44e78da6:::benchmark_data_smithi018_80623_object53787:head [delete] snapc 0=[] ondisk+write+known_if_redirected e149)", 2024-02-10T08:27:10.578 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:22:39.571888+0000", 2024-02-10T08:27:10.578 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 270.83985355900001, 2024-02-10T08:27:10.578 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.072221726, 2024-02-10T08:27:10.578 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:27:10.578 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:27:10.578 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:27:10.578 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:27:10.578 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:27:10.578 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 154715 2024-02-10T08:27:10.578 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.578 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:27:10.578 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.579 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:27:10.579 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.571888+0000", 2024-02-10T08:27:10.579 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:27:10.579 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.579 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.579 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:27:10.579 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.571888+0000", 2024-02-10T08:27:10.579 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:27:10.579 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.579 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.579 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:27:10.579 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.571888+0000", 2024-02-10T08:27:10.579 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8609999999999997e-06 2024-02-10T08:27:10.579 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.579 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.579 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:27:10.580 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.571893+0000", 2024-02-10T08:27:10.580 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4279999999999999e-06 2024-02-10T08:27:10.580 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.580 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.580 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:27:10.580 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.571900+0000", 2024-02-10T08:27:10.580 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9659999999999998e-06 2024-02-10T08:27:10.580 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.580 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.580 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:27:10.580 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.571904+0000", 2024-02-10T08:27:10.580 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9781000000000002e-05 2024-02-10T08:27:10.580 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.580 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.580 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:27:10.580 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.571934+0000", 2024-02-10T08:27:10.580 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5530000000000004e-05 2024-02-10T08:27:10.581 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.581 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.581 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:27:10.581 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.571999+0000", 2024-02-10T08:27:10.581 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6127999999999999e-05 2024-02-10T08:27:10.581 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.581 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.581 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 2,3", 2024-02-10T08:27:10.581 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.572085+0000", 2024-02-10T08:27:10.581 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001400089 2024-02-10T08:27:10.581 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.581 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.581 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:27:10.581 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.573485+0000", 2024-02-10T08:27:10.581 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.045431224999999999 2024-02-10T08:27:10.581 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.581 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.582 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:27:10.582 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.618917+0000", 2024-02-10T08:27:10.582 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.025093054 2024-02-10T08:27:10.582 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.582 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.582 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:27:10.582 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.644010+0000", 2024-02-10T08:27:10.582 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8428999999999999e-05 2024-02-10T08:27:10.582 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.582 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.582 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:27:10.582 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.644068+0000", 2024-02-10T08:27:10.582 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1990000000000003e-05 2024-02-10T08:27:10.582 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.582 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.582 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:27:10.582 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.644110+0000", 2024-02-10T08:27:10.583 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.072221726 2024-02-10T08:27:10.583 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:10.583 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:27:10.583 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:10.583 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.583 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.583 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:155167 7.2 7:48650d8a:::benchmark_data_smithi018_80623_object54239:head [delete] snapc 0=[] ondisk+write+known_if_redirected e149)", 2024-02-10T08:27:10.583 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:22:40.199455+0000", 2024-02-10T08:27:10.583 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 270.21228652600001, 2024-02-10T08:27:10.583 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.081791193999999998, 2024-02-10T08:27:10.583 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:27:10.583 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:27:10.583 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:27:10.583 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:27:10.583 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:27:10.583 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 155167 2024-02-10T08:27:10.584 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.584 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:27:10.584 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.584 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:27:10.584 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.199455+0000", 2024-02-10T08:27:10.584 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:27:10.584 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.584 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.584 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:27:10.584 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.199455+0000", 2024-02-10T08:27:10.584 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:27:10.584 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.584 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.584 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:27:10.585 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.199454+0000", 2024-02-10T08:27:10.585 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3420000000000002e-06 2024-02-10T08:27:10.585 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.585 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.585 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:27:10.585 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.199461+0000", 2024-02-10T08:27:10.585 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1419e-05 2024-02-10T08:27:10.585 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.585 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.585 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:27:10.585 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.199473+0000", 2024-02-10T08:27:10.585 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3630000000000002e-06 2024-02-10T08:27:10.585 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.585 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.585 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:27:10.585 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.199478+0000", 2024-02-10T08:27:10.585 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9564000000000002e-05 2024-02-10T08:27:10.586 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.586 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.586 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:27:10.586 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.199528+0000", 2024-02-10T08:27:10.586 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000114601 2024-02-10T08:27:10.586 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.586 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.586 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:27:10.586 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.199642+0000", 2024-02-10T08:27:10.586 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013268700000000001 2024-02-10T08:27:10.586 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.586 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.586 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 2,3", 2024-02-10T08:27:10.586 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.199775+0000", 2024-02-10T08:27:10.586 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0056025650000000003 2024-02-10T08:27:10.586 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.587 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.587 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:27:10.587 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.205377+0000", 2024-02-10T08:27:10.587 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011831441 2024-02-10T08:27:10.587 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.587 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.587 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:27:10.587 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.217209+0000", 2024-02-10T08:27:10.587 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.063949695000000001 2024-02-10T08:27:10.587 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.587 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.587 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:27:10.587 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.281159+0000", 2024-02-10T08:27:10.587 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9061999999999999e-05 2024-02-10T08:27:10.587 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.587 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.588 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:27:10.588 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.281208+0000", 2024-02-10T08:27:10.588 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9029000000000002e-05 2024-02-10T08:27:10.588 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.588 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.588 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:27:10.588 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.281247+0000", 2024-02-10T08:27:10.588 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.081791193999999998 2024-02-10T08:27:10.588 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:10.588 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:27:10.588 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:10.588 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.588 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.588 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:155666 7.2 7:4479b2d2:::benchmark_data_smithi018_80623_object54738:head [delete] snapc 0=[] ondisk+write+known_if_redirected e149)", 2024-02-10T08:27:10.588 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:22:40.892255+0000", 2024-02-10T08:27:10.588 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 269.51948711300003, 2024-02-10T08:27:10.589 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.078684826999999999, 2024-02-10T08:27:10.589 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:27:10.589 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:27:10.589 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:27:10.589 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:27:10.589 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:27:10.589 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 155666 2024-02-10T08:27:10.589 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.589 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:27:10.589 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.589 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:27:10.589 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.892255+0000", 2024-02-10T08:27:10.589 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:27:10.589 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.589 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.589 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:27:10.590 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.892255+0000", 2024-02-10T08:27:10.590 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:27:10.590 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.590 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.590 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:27:10.590 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.892254+0000", 2024-02-10T08:27:10.590 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1499999999999999e-06 2024-02-10T08:27:10.590 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.590 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.590 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:27:10.590 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.892258+0000", 2024-02-10T08:27:10.590 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5759999999999996e-06 2024-02-10T08:27:10.590 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.590 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.590 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:27:10.590 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.892263+0000", 2024-02-10T08:27:10.591 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1869999999999999e-06 2024-02-10T08:27:10.591 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.591 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.591 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:27:10.591 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.892267+0000", 2024-02-10T08:27:10.591 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002597387 2024-02-10T08:27:10.591 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.591 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.591 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:27:10.591 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.894865+0000", 2024-02-10T08:27:10.591 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010696699999999999 2024-02-10T08:27:10.591 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.591 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.591 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:27:10.591 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.894972+0000", 2024-02-10T08:27:10.591 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012987299999999999 2024-02-10T08:27:10.591 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.592 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.592 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 2,3", 2024-02-10T08:27:10.592 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.895102+0000", 2024-02-10T08:27:10.592 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0057554190000000003 2024-02-10T08:27:10.592 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.592 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.592 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:27:10.592 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.900857+0000", 2024-02-10T08:27:10.592 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0021897359999999999 2024-02-10T08:27:10.592 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.592 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.592 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:27:10.592 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.903047+0000", 2024-02-10T08:27:10.592 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.067804812000000006 2024-02-10T08:27:10.592 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.592 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.593 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:27:10.593 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.970851+0000", 2024-02-10T08:27:10.593 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9815999999999999e-05 2024-02-10T08:27:10.593 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.593 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.593 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:27:10.593 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.970901+0000", 2024-02-10T08:27:10.593 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8402000000000003e-05 2024-02-10T08:27:10.593 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.593 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.593 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:27:10.593 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.970940+0000", 2024-02-10T08:27:10.593 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.078684826999999999 2024-02-10T08:27:10.593 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:10.593 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:27:10.593 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:10.593 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.594 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.594 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:155939 7.2 7:49ed207d:::benchmark_data_smithi018_80623_object55011:head [delete] snapc 0=[] ondisk+write+known_if_redirected e149)", 2024-02-10T08:27:10.594 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:22:41.281367+0000", 2024-02-10T08:27:10.594 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 269.13037539099997, 2024-02-10T08:27:10.594 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.083337313999999996, 2024-02-10T08:27:10.594 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:27:10.594 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:27:10.594 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:27:10.594 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:27:10.594 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:27:10.594 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 155939 2024-02-10T08:27:10.594 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.594 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:27:10.594 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.594 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:27:10.594 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.281367+0000", 2024-02-10T08:27:10.595 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:27:10.595 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.595 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.595 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:27:10.595 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.281367+0000", 2024-02-10T08:27:10.595 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:27:10.595 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.595 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.595 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:27:10.595 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.281366+0000", 2024-02-10T08:27:10.595 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5899999999999998e-06 2024-02-10T08:27:10.595 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.595 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.595 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:27:10.595 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.281371+0000", 2024-02-10T08:27:10.596 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8969999999999997e-06 2024-02-10T08:27:10.596 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.596 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.596 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:27:10.596 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.281380+0000", 2024-02-10T08:27:10.596 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6119999999999998e-06 2024-02-10T08:27:10.596 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.596 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.596 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:27:10.596 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.281386+0000", 2024-02-10T08:27:10.596 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0033349830000000001 2024-02-10T08:27:10.596 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.596 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.596 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:27:10.597 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.284721+0000", 2024-02-10T08:27:10.597 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010802300000000001 2024-02-10T08:27:10.597 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.597 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.597 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:27:10.597 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.284829+0000", 2024-02-10T08:27:10.597 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012728199999999999 2024-02-10T08:27:10.597 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.597 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.597 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 2,3", 2024-02-10T08:27:10.597 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.284956+0000", 2024-02-10T08:27:10.597 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.012928574999999999 2024-02-10T08:27:10.597 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.597 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.598 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:27:10.598 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.297885+0000", 2024-02-10T08:27:10.598 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018071299999999999 2024-02-10T08:27:10.598 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.598 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.598 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:27:10.598 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.298065+0000", 2024-02-10T08:27:10.598 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.066551182 2024-02-10T08:27:10.598 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.598 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.598 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:27:10.598 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.364617+0000", 2024-02-10T08:27:10.598 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8584000000000001e-05 2024-02-10T08:27:10.598 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.598 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.598 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:27:10.599 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.364665+0000", 2024-02-10T08:27:10.599 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8834000000000001e-05 2024-02-10T08:27:10.599 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.599 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.599 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:27:10.599 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.364704+0000", 2024-02-10T08:27:10.599 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.083337313999999996 2024-02-10T08:27:10.599 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:10.599 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:27:10.599 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:10.599 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.599 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.599 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:156135 7.2 7:4200c1a2:::benchmark_data_smithi018_80623_object55207:head [delete] snapc 0=[] ondisk+write+known_if_redirected e149)", 2024-02-10T08:27:10.599 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:22:41.576363+0000", 2024-02-10T08:27:10.599 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 268.83537930199998, 2024-02-10T08:27:10.600 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.070036589999999996, 2024-02-10T08:27:10.600 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:27:10.600 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:27:10.600 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:27:10.600 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:27:10.600 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:27:10.600 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 156135 2024-02-10T08:27:10.600 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.600 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:27:10.600 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.600 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:27:10.600 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.576363+0000", 2024-02-10T08:27:10.600 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:27:10.600 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.600 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.601 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:27:10.601 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.576363+0000", 2024-02-10T08:27:10.601 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999981 2024-02-10T08:27:10.601 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.601 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.601 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:27:10.601 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.576361+0000", 2024-02-10T08:27:10.601 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2130000000000008e-06 2024-02-10T08:27:10.601 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.601 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.601 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:27:10.601 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.576369+0000", 2024-02-10T08:27:10.601 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2225000000000001e-05 2024-02-10T08:27:10.601 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.601 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.602 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:27:10.602 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.576381+0000", 2024-02-10T08:27:10.602 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9330000000000004e-06 2024-02-10T08:27:10.602 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.602 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.602 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:27:10.602 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.576388+0000", 2024-02-10T08:27:10.602 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00074003600000000001 2024-02-10T08:27:10.602 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.602 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.602 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:27:10.602 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.577128+0000", 2024-02-10T08:27:10.602 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000109788 2024-02-10T08:27:10.602 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.602 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.602 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:27:10.602 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.577238+0000", 2024-02-10T08:27:10.603 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012592699999999999 2024-02-10T08:27:10.603 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.603 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.603 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 2,3", 2024-02-10T08:27:10.603 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.577364+0000", 2024-02-10T08:27:10.603 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0058726539999999997 2024-02-10T08:27:10.603 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.603 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.603 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:27:10.603 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.583237+0000", 2024-02-10T08:27:10.603 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.029150738999999998 2024-02-10T08:27:10.603 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.603 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.603 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:27:10.603 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.612387+0000", 2024-02-10T08:27:10.603 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.033925438000000002 2024-02-10T08:27:10.603 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.604 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.604 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:27:10.604 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.646313+0000", 2024-02-10T08:27:10.604 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8245999999999999e-05 2024-02-10T08:27:10.604 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.604 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.604 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:27:10.604 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.646361+0000", 2024-02-10T08:27:10.604 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8219000000000001e-05 2024-02-10T08:27:10.604 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.604 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.604 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:27:10.604 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.646399+0000", 2024-02-10T08:27:10.604 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.070036589999999996 2024-02-10T08:27:10.604 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:10.605 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:27:10.605 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:10.605 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.605 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.605 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:158145 7.2 7:4e3f3d32:::benchmark_data_smithi018_80623_object57217:head [delete] snapc 0=[] ondisk+write+known_if_redirected e152)", 2024-02-10T08:27:10.605 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:22:44.856304+0000", 2024-02-10T08:27:10.605 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 265.55543807499998, 2024-02-10T08:27:10.605 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.090853510999999998, 2024-02-10T08:27:10.605 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:27:10.605 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:27:10.605 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:27:10.605 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:27:10.605 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:27:10.605 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 158145 2024-02-10T08:27:10.605 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.605 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:27:10.606 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.606 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:27:10.606 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.856304+0000", 2024-02-10T08:27:10.606 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:27:10.606 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.606 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.606 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:27:10.606 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.856304+0000", 2024-02-10T08:27:10.606 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:27:10.606 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.606 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.606 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:27:10.606 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.856303+0000", 2024-02-10T08:27:10.606 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6949999999999999e-06 2024-02-10T08:27:10.606 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.606 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.606 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:27:10.607 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.856308+0000", 2024-02-10T08:27:10.607 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5439999999999999e-06 2024-02-10T08:27:10.607 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.607 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.607 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:27:10.607 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.856316+0000", 2024-02-10T08:27:10.607 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1009999999999997e-06 2024-02-10T08:27:10.607 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.607 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.607 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:27:10.607 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.856322+0000", 2024-02-10T08:27:10.607 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0246e-05 2024-02-10T08:27:10.607 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.607 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.607 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:27:10.608 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.856373+0000", 2024-02-10T08:27:10.608 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000110302 2024-02-10T08:27:10.608 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.608 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.608 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:27:10.608 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.856483+0000", 2024-02-10T08:27:10.608 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012738499999999999 2024-02-10T08:27:10.608 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.608 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.608 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 2,3", 2024-02-10T08:27:10.608 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.856610+0000", 2024-02-10T08:27:10.608 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.014536597 2024-02-10T08:27:10.608 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.608 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.608 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:27:10.609 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.871147+0000", 2024-02-10T08:27:10.609 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.003922193 2024-02-10T08:27:10.609 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.609 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.609 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:27:10.609 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.875069+0000", 2024-02-10T08:27:10.609 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.072002255000000001 2024-02-10T08:27:10.609 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.609 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.609 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:27:10.609 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.947071+0000", 2024-02-10T08:27:10.609 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5423999999999997e-05 2024-02-10T08:27:10.609 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.609 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.609 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:27:10.609 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.947117+0000", 2024-02-10T08:27:10.610 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0692999999999998e-05 2024-02-10T08:27:10.610 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.610 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.610 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:27:10.610 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.947157+0000", 2024-02-10T08:27:10.610 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.090853510999999998 2024-02-10T08:27:10.610 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:10.610 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:27:10.610 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:10.610 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.610 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.610 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:158156 7.2 7:4b742d49:::benchmark_data_smithi018_80623_object57228:head [delete] snapc 0=[] ondisk+write+known_if_redirected e152)", 2024-02-10T08:27:10.610 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:22:44.875979+0000", 2024-02-10T08:27:10.610 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 265.53576328000003, 2024-02-10T08:27:10.610 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.079453853000000005, 2024-02-10T08:27:10.610 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:27:10.611 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:27:10.611 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:27:10.611 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:27:10.611 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:27:10.611 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 158156 2024-02-10T08:27:10.611 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.611 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:27:10.611 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.611 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:27:10.611 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.875979+0000", 2024-02-10T08:27:10.611 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:27:10.611 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.611 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.611 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:27:10.611 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.875979+0000", 2024-02-10T08:27:10.611 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999981 2024-02-10T08:27:10.612 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.612 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.612 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:27:10.612 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.875977+0000", 2024-02-10T08:27:10.612 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9209999999999998e-06 2024-02-10T08:27:10.612 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.612 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.612 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:27:10.612 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.875986+0000", 2024-02-10T08:27:10.612 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4076e-05 2024-02-10T08:27:10.612 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.612 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.612 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:27:10.612 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.876000+0000", 2024-02-10T08:27:10.612 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3319999999999992e-06 2024-02-10T08:27:10.613 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.613 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.613 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:27:10.613 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.876008+0000", 2024-02-10T08:27:10.613 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6607000000000002e-05 2024-02-10T08:27:10.613 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.613 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.613 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:27:10.613 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.876065+0000", 2024-02-10T08:27:10.613 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0260999999999995e-05 2024-02-10T08:27:10.613 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.613 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.613 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:27:10.613 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.876155+0000", 2024-02-10T08:27:10.614 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011905600000000001 2024-02-10T08:27:10.614 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.614 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.614 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 2,3", 2024-02-10T08:27:10.614 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.876274+0000", 2024-02-10T08:27:10.614 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001980435 2024-02-10T08:27:10.614 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.614 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.614 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:27:10.614 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.878254+0000", 2024-02-10T08:27:10.615 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00026547400000000003 2024-02-10T08:27:10.615 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.615 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.615 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:27:10.615 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.878520+0000", 2024-02-10T08:27:10.615 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.076825067999999996 2024-02-10T08:27:10.615 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.615 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.615 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:27:10.615 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.955345+0000", 2024-02-10T08:27:10.615 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7264e-05 2024-02-10T08:27:10.615 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.615 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.615 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:27:10.615 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.955392+0000", 2024-02-10T08:27:10.616 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0404000000000001e-05 2024-02-10T08:27:10.616 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.616 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.616 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:27:10.616 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.955433+0000", 2024-02-10T08:27:10.616 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.079453853000000005 2024-02-10T08:27:10.616 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:10.616 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:27:10.616 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:10.616 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.616 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.617 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:182653 7.2 7:4f924604:::benchmark_data_smithi018_80623_object81725:head [delete] snapc 0=[] ondisk+write+known_if_redirected e165)", 2024-02-10T08:27:10.617 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:23:19.802863+0000", 2024-02-10T08:27:10.617 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 230.60887928899999, 2024-02-10T08:27:10.617 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.092449144999999996, 2024-02-10T08:27:10.617 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:27:10.617 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:27:10.617 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:27:10.617 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:27:10.617 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:27:10.617 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 182653 2024-02-10T08:27:10.617 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.617 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:27:10.617 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.617 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:27:10.617 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.802863+0000", 2024-02-10T08:27:10.617 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:27:10.618 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.618 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.618 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:27:10.618 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.802863+0000", 2024-02-10T08:27:10.618 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:27:10.618 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.618 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.618 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:27:10.618 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.802861+0000", 2024-02-10T08:27:10.618 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.737e-06 2024-02-10T08:27:10.618 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.618 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.618 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:27:10.618 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.802868+0000", 2024-02-10T08:27:10.618 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0404999999999999e-05 2024-02-10T08:27:10.619 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.619 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.619 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:27:10.619 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.802878+0000", 2024-02-10T08:27:10.619 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7690000000000002e-06 2024-02-10T08:27:10.619 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.619 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.619 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:27:10.619 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.802884+0000", 2024-02-10T08:27:10.619 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0051375580000000004 2024-02-10T08:27:10.619 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.619 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.620 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:27:10.620 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.808022+0000", 2024-02-10T08:27:10.620 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000110547 2024-02-10T08:27:10.620 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.620 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.620 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:27:10.620 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.808132+0000", 2024-02-10T08:27:10.620 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012938500000000001 2024-02-10T08:27:10.620 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.620 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.620 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 2,3", 2024-02-10T08:27:10.620 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.808262+0000", 2024-02-10T08:27:10.620 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.061389966999999997 2024-02-10T08:27:10.620 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.621 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.621 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:27:10.621 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.869652+0000", 2024-02-10T08:27:10.621 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.01027989 2024-02-10T08:27:10.621 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.621 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.621 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:27:10.621 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.879931+0000", 2024-02-10T08:27:10.621 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015289181000000001 2024-02-10T08:27:10.621 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.621 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.621 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:27:10.621 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.895221+0000", 2024-02-10T08:27:10.621 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1431999999999998e-05 2024-02-10T08:27:10.622 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.622 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.622 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:27:10.622 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.895272+0000", 2024-02-10T08:27:10.622 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9768000000000003e-05 2024-02-10T08:27:10.622 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.622 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.622 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:27:10.622 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.895312+0000", 2024-02-10T08:27:10.622 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.092449144999999996 2024-02-10T08:27:10.622 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:10.622 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:27:10.622 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:10.622 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.622 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.622 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:182658 7.2 7:45e33f02:::benchmark_data_smithi018_80623_object81730:head [delete] snapc 0=[] ondisk+write+known_if_redirected e165)", 2024-02-10T08:27:10.623 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:23:19.809349+0000", 2024-02-10T08:27:10.623 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 230.60239298799999, 2024-02-10T08:27:10.623 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086067777999999998, 2024-02-10T08:27:10.623 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:27:10.623 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:27:10.623 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:27:10.623 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:27:10.623 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:27:10.623 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 182658 2024-02-10T08:27:10.623 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.623 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:27:10.623 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.623 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:27:10.623 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.809349+0000", 2024-02-10T08:27:10.623 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:27:10.624 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.624 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.624 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:27:10.624 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.809349+0000", 2024-02-10T08:27:10.624 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:27:10.624 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.624 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.624 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:27:10.624 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.809348+0000", 2024-02-10T08:27:10.624 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.501e-06 2024-02-10T08:27:10.624 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.624 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.624 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:27:10.624 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.809352+0000", 2024-02-10T08:27:10.624 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9429999999999999e-06 2024-02-10T08:27:10.625 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.625 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.625 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:27:10.625 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.809357+0000", 2024-02-10T08:27:10.625 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.185e-06 2024-02-10T08:27:10.625 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.625 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.625 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:27:10.625 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.809360+0000", 2024-02-10T08:27:10.625 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.060314260000000001 2024-02-10T08:27:10.625 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.625 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.625 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:27:10.625 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.869674+0000", 2024-02-10T08:27:10.625 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012447000000000001 2024-02-10T08:27:10.625 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.626 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.626 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:27:10.626 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.869799+0000", 2024-02-10T08:27:10.626 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000144707 2024-02-10T08:27:10.626 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.626 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.626 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 2,3", 2024-02-10T08:27:10.626 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.869943+0000", 2024-02-10T08:27:10.626 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0099495309999999993 2024-02-10T08:27:10.626 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.626 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.626 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:27:10.626 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.879893+0000", 2024-02-10T08:27:10.627 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0056066010000000001 2024-02-10T08:27:10.627 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.627 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.627 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:27:10.627 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.885499+0000", 2024-02-10T08:27:10.627 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0098464190000000004 2024-02-10T08:27:10.627 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.627 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.627 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:27:10.627 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.895346+0000", 2024-02-10T08:27:10.627 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6343000000000001e-05 2024-02-10T08:27:10.627 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.627 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.627 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:27:10.627 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.895382+0000", 2024-02-10T08:27:10.628 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4675000000000003e-05 2024-02-10T08:27:10.628 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.628 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.628 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:27:10.628 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.895417+0000", 2024-02-10T08:27:10.628 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086067777999999998 2024-02-10T08:27:10.628 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:10.628 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:27:10.628 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:10.628 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.628 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.628 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:184097 7.2 7:428fedb3:::benchmark_data_smithi018_80623_object83169:head [delete] snapc 0=[] ondisk+write+known_if_redirected e165)", 2024-02-10T08:27:10.628 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:23:21.936658+0000", 2024-02-10T08:27:10.628 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 228.475083963, 2024-02-10T08:27:10.629 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.075418111999999995, 2024-02-10T08:27:10.629 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:27:10.629 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:27:10.629 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:27:10.629 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:27:10.629 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:27:10.629 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 184097 2024-02-10T08:27:10.629 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.629 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:27:10.629 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.630 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:27:10.630 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:21.936658+0000", 2024-02-10T08:27:10.630 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:27:10.630 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.630 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.630 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:27:10.630 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:21.936658+0000", 2024-02-10T08:27:10.630 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:27:10.630 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.630 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.630 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:27:10.630 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:21.936657+0000", 2024-02-10T08:27:10.630 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5039999999999998e-06 2024-02-10T08:27:10.631 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.631 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.631 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:27:10.631 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:21.936661+0000", 2024-02-10T08:27:10.631 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1279999999999996e-06 2024-02-10T08:27:10.631 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.631 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.631 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:27:10.631 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:21.936667+0000", 2024-02-10T08:27:10.631 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5689999999999998e-06 2024-02-10T08:27:10.631 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.631 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.632 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:27:10.632 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:21.936672+0000", 2024-02-10T08:27:10.632 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0025274410000000001 2024-02-10T08:27:10.632 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.632 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.632 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:27:10.632 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:21.939199+0000", 2024-02-10T08:27:10.632 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000112501 2024-02-10T08:27:10.632 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.632 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.632 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:27:10.632 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:21.939312+0000", 2024-02-10T08:27:10.633 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013330199999999999 2024-02-10T08:27:10.633 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.633 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.633 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 2,3", 2024-02-10T08:27:10.633 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:21.939445+0000", 2024-02-10T08:27:10.633 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0030086000000000002 2024-02-10T08:27:10.633 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.633 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.633 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:27:10.633 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:21.942453+0000", 2024-02-10T08:27:10.633 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0054853810000000001 2024-02-10T08:27:10.633 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.634 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.634 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:27:10.634 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:21.947939+0000", 2024-02-10T08:27:10.634 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.064034720000000003 2024-02-10T08:27:10.634 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.634 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.634 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:27:10.634 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:22.011974+0000", 2024-02-10T08:27:10.635 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2256000000000002e-05 2024-02-10T08:27:10.635 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.635 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.635 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:27:10.635 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:22.012026+0000", 2024-02-10T08:27:10.635 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0303999999999998e-05 2024-02-10T08:27:10.635 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.635 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.635 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:27:10.635 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:22.012076+0000", 2024-02-10T08:27:10.635 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.075418111999999995 2024-02-10T08:27:10.635 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:10.635 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:27:10.635 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:10.635 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.636 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.636 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:184795 7.2 7:4f3b0903:::benchmark_data_smithi018_80623_object83867:head [delete] snapc 0=[] ondisk+write+known_if_redirected e165)", 2024-02-10T08:27:10.636 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:23:22.987095+0000", 2024-02-10T08:27:10.636 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 227.42464691699999, 2024-02-10T08:27:10.636 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.072374869999999994, 2024-02-10T08:27:10.636 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:27:10.636 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:27:10.636 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:27:10.636 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:27:10.636 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:27:10.636 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 184795 2024-02-10T08:27:10.636 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.637 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:27:10.637 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.637 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:27:10.637 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:22.987095+0000", 2024-02-10T08:27:10.637 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:27:10.637 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.637 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.637 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:27:10.637 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:22.987095+0000", 2024-02-10T08:27:10.637 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999976 2024-02-10T08:27:10.637 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.637 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.637 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:27:10.637 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:22.987093+0000", 2024-02-10T08:27:10.638 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7499999999999992e-06 2024-02-10T08:27:10.638 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.638 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.638 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:27:10.638 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:22.987102+0000", 2024-02-10T08:27:10.638 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2413e-05 2024-02-10T08:27:10.638 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.638 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.638 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:27:10.638 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:22.987114+0000", 2024-02-10T08:27:10.638 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5270000000000004e-06 2024-02-10T08:27:10.638 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.638 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.638 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:27:10.638 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:22.987121+0000", 2024-02-10T08:27:10.638 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6124000000000001e-05 2024-02-10T08:27:10.639 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.639 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.639 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:27:10.639 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:22.987167+0000", 2024-02-10T08:27:10.639 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000116276 2024-02-10T08:27:10.639 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.639 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.639 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:27:10.639 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:22.987283+0000", 2024-02-10T08:27:10.639 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013644699999999999 2024-02-10T08:27:10.639 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.639 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.639 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 2,3", 2024-02-10T08:27:10.639 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:22.987419+0000", 2024-02-10T08:27:10.639 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0025659419999999999 2024-02-10T08:27:10.639 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.640 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.640 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:27:10.640 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:22.989985+0000", 2024-02-10T08:27:10.640 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0037304819999999998 2024-02-10T08:27:10.640 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.640 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.640 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:27:10.640 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:22.993716+0000", 2024-02-10T08:27:10.640 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.065665486999999995 2024-02-10T08:27:10.640 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.640 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.640 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:27:10.640 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:23.059381+0000", 2024-02-10T08:27:10.640 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8535999999999997e-05 2024-02-10T08:27:10.641 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.641 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.641 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:27:10.641 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:23.059430+0000", 2024-02-10T08:27:10.641 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0151999999999998e-05 2024-02-10T08:27:10.641 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.641 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.641 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:27:10.641 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:23.059470+0000", 2024-02-10T08:27:10.641 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.072374869999999994 2024-02-10T08:27:10.641 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:10.641 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:27:10.641 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:10.641 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.641 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.641 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14964.0:70770 8.3 8:c5906313:::benchmark_data_smithi018_103312_object70769:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e209)", 2024-02-10T08:27:10.641 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:25:18.167936+0000", 2024-02-10T08:27:10.642 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 112.24380619599999, 2024-02-10T08:27:10.642 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.071705841000000006, 2024-02-10T08:27:10.642 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:27:10.642 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:27:10.642 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:27:10.642 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14964", 2024-02-10T08:27:10.642 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/3173131962", 2024-02-10T08:27:10.642 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 70770 2024-02-10T08:27:10.642 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.642 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:27:10.642 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.642 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:27:10.642 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:18.167936+0000", 2024-02-10T08:27:10.642 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:27:10.642 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.642 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.643 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:27:10.643 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:18.167936+0000", 2024-02-10T08:27:10.643 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999981 2024-02-10T08:27:10.643 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.643 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.643 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:27:10.643 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:18.167934+0000", 2024-02-10T08:27:10.643 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.6766000000000001e-05 2024-02-10T08:27:10.643 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.643 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.643 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:27:10.643 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:18.167961+0000", 2024-02-10T08:27:10.643 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2619000000000001e-05 2024-02-10T08:27:10.643 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.643 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.643 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:27:10.643 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:18.167973+0000", 2024-02-10T08:27:10.643 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5449999999999998e-06 2024-02-10T08:27:10.644 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.644 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.644 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:27:10.644 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:18.167981+0000", 2024-02-10T08:27:10.644 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1509999999999999e-05 2024-02-10T08:27:10.644 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.644 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.644 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:27:10.644 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:18.168042+0000", 2024-02-10T08:27:10.644 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014111199999999999 2024-02-10T08:27:10.644 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.644 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.644 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:27:10.644 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:18.168184+0000", 2024-02-10T08:27:10.644 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017789999999999999 2024-02-10T08:27:10.645 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.645 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.645 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 5,6", 2024-02-10T08:27:10.645 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:18.168361+0000", 2024-02-10T08:27:10.645 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0026412580000000001 2024-02-10T08:27:10.645 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.645 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.645 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:27:10.645 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:18.171003+0000", 2024-02-10T08:27:10.645 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0084240270000000006 2024-02-10T08:27:10.645 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.645 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.645 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:27:10.645 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:18.179427+0000", 2024-02-10T08:27:10.645 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.060128529 2024-02-10T08:27:10.645 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.646 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.646 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:27:10.646 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:18.239555+0000", 2024-02-10T08:27:10.646 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4583999999999999e-05 2024-02-10T08:27:10.646 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.646 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.646 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:27:10.646 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:18.239600+0000", 2024-02-10T08:27:10.646 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1802999999999999e-05 2024-02-10T08:27:10.646 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.646 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.646 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:27:10.646 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:18.239642+0000", 2024-02-10T08:27:10.646 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.071705841000000006 2024-02-10T08:27:10.646 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:10.646 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:27:10.646 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:10.647 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.647 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.647 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14964.0:70778 8.3 8:cda73e1b:::benchmark_data_smithi018_103312_object70777:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e209)", 2024-02-10T08:27:10.647 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:25:18.171362+0000", 2024-02-10T08:27:10.647 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 112.240380061, 2024-02-10T08:27:10.647 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.068391459000000002, 2024-02-10T08:27:10.647 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:27:10.647 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:27:10.647 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:27:10.647 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14964", 2024-02-10T08:27:10.647 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/3173131962", 2024-02-10T08:27:10.647 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 70778 2024-02-10T08:27:10.647 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.647 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:27:10.648 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.648 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:27:10.648 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:18.171362+0000", 2024-02-10T08:27:10.648 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:27:10.648 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.648 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.648 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:27:10.648 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:18.171362+0000", 2024-02-10T08:27:10.648 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:27:10.648 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.648 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.648 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:27:10.648 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:18.171361+0000", 2024-02-10T08:27:10.648 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5360000000000001e-05 2024-02-10T08:27:10.649 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.649 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.649 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:27:10.649 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:18.171386+0000", 2024-02-10T08:27:10.649 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1195e-05 2024-02-10T08:27:10.649 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.649 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.649 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:27:10.649 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:18.171407+0000", 2024-02-10T08:27:10.649 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3359999999999997e-06 2024-02-10T08:27:10.649 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.649 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.649 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:27:10.649 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:18.171415+0000", 2024-02-10T08:27:10.649 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8318999999999997e-05 2024-02-10T08:27:10.650 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.650 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.650 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:27:10.650 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:18.171453+0000", 2024-02-10T08:27:10.650 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000117002 2024-02-10T08:27:10.650 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.650 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.650 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:27:10.650 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:18.171570+0000", 2024-02-10T08:27:10.650 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015448999999999999 2024-02-10T08:27:10.650 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.650 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.650 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 5,6", 2024-02-10T08:27:10.650 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:18.171724+0000", 2024-02-10T08:27:10.650 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0075935380000000004 2024-02-10T08:27:10.650 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.650 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.651 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:27:10.651 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:18.179318+0000", 2024-02-10T08:27:10.651 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.060132634999999997 2024-02-10T08:27:10.651 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.651 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.651 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:27:10.651 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:18.239451+0000", 2024-02-10T08:27:10.651 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00022795500000000001 2024-02-10T08:27:10.651 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.651 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.651 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:27:10.651 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:18.239678+0000", 2024-02-10T08:27:10.651 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0646999999999999e-05 2024-02-10T08:27:10.651 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.651 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.652 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:27:10.652 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:18.239719+0000", 2024-02-10T08:27:10.652 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4273000000000002e-05 2024-02-10T08:27:10.652 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.652 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.652 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:27:10.652 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:18.239753+0000", 2024-02-10T08:27:10.652 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.068391459000000002 2024-02-10T08:27:10.652 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:10.652 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:27:10.652 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:10.652 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.652 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.652 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14964.0:73145 8.a 8:5acaec24:::benchmark_data_smithi018_103312_object73144:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e209)", 2024-02-10T08:27:10.652 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:25:20.215525+0000", 2024-02-10T08:27:10.653 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 110.196216603, 2024-02-10T08:27:10.653 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.078879046999999994, 2024-02-10T08:27:10.653 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:27:10.653 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:27:10.653 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:27:10.653 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14964", 2024-02-10T08:27:10.653 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/3173131962", 2024-02-10T08:27:10.653 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 73145 2024-02-10T08:27:10.653 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.653 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:27:10.653 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.653 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:27:10.653 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:20.215525+0000", 2024-02-10T08:27:10.653 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:27:10.654 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.654 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.654 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:27:10.654 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:20.215525+0000", 2024-02-10T08:27:10.654 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:27:10.654 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.654 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.654 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:27:10.654 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:20.215524+0000", 2024-02-10T08:27:10.654 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2860000000000001e-05 2024-02-10T08:27:10.654 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.654 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.654 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:27:10.654 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:20.215547+0000", 2024-02-10T08:27:10.654 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2758999999999999e-05 2024-02-10T08:27:10.654 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.655 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.655 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:27:10.655 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:20.215560+0000", 2024-02-10T08:27:10.655 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8359999999999992e-06 2024-02-10T08:27:10.655 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.655 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.655 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:27:10.655 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:20.215567+0000", 2024-02-10T08:27:10.655 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1795000000000001e-05 2024-02-10T08:27:10.655 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.655 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.655 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:27:10.655 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:20.215619+0000", 2024-02-10T08:27:10.655 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8151000000000004e-05 2024-02-10T08:27:10.655 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.655 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.656 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:27:10.656 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:20.215707+0000", 2024-02-10T08:27:10.656 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7585999999999997e-05 2024-02-10T08:27:10.656 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.656 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.656 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 2,5", 2024-02-10T08:27:10.656 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:20.215805+0000", 2024-02-10T08:27:10.656 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0046909789999999996 2024-02-10T08:27:10.656 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.656 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.656 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:27:10.656 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:20.220496+0000", 2024-02-10T08:27:10.656 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0029217190000000001 2024-02-10T08:27:10.656 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.656 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.657 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:27:10.657 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:20.223418+0000", 2024-02-10T08:27:10.657 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.070824407000000006 2024-02-10T08:27:10.657 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.657 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.657 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:27:10.657 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:20.294242+0000", 2024-02-10T08:27:10.657 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000115182 2024-02-10T08:27:10.657 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.657 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.657 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:27:10.657 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:20.294357+0000", 2024-02-10T08:27:10.657 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7193e-05 2024-02-10T08:27:10.657 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:10.657 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:10.658 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:27:10.658 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:20.294404+0000", 2024-02-10T08:27:10.658 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.078879046999999994 2024-02-10T08:27:10.658 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:10.658 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:27:10.658 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:10.658 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:10.658 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:27:10.658 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-02-10T08:27:10.868 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:09.975611+0000 osd.7 (osd.7) 129 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:27:10.868 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:09.975658+0000 osd.7 (osd.7) 130 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:27:10.868 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:27:10.667037+0000 mon.b (mon.1) 61 : audit [INF] from='client.? 172.21.15.18:0/1683590523' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 0, "weight": 0.12522991961645147}]: dispatch 2024-02-10T08:27:10.868 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:27:10.675378+0000 mon.a (mon.0) 1178 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 0, "weight": 0.12522991961645147}]: dispatch 2024-02-10T08:27:10.899 INFO:teuthology.orchestra.run.smithi018.stderr:set osd.0 primary-affinity to 0.12523 (882072) 2024-02-10T08:27:11.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:09.975611+0000 osd.7 (osd.7) 129 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:27:11.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:09.975658+0000 osd.7 (osd.7) 130 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:27:11.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:27:10.667037+0000 mon.b (mon.1) 61 : audit [INF] from='client.? 172.21.15.18:0/1683590523' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 0, "weight": 0.12522991961645147}]: dispatch 2024-02-10T08:27:11.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:27:10.675378+0000 mon.a (mon.0) 1178 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 0, "weight": 0.12522991961645147}]: dispatch 2024-02-10T08:27:11.216 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:27:11.219 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:11.219 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:27:11.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:09.975611+0000 osd.7 (osd.7) 129 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:27:11.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:09.975658+0000 osd.7 (osd.7) 130 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:27:11.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:27:10.667037+0000 mon.b (mon.1) 61 : audit [INF] from='client.? 172.21.15.18:0/1683590523' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 0, "weight": 0.12522991961645147}]: dispatch 2024-02-10T08:27:11.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:27:10.675378+0000 mon.a (mon.0) 1178 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 0, "weight": 0.12522991961645147}]: dispatch 2024-02-10T08:27:11.320 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:27:11.348 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:11.613 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.2 dump_ops_in_flight 2024-02-10T08:27:11.689 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:27:11.689 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:27:11.689 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:27:11.689 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:27:11.689 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:27:11.689 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:27:11.689 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:27:11.689 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:27:11.689 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-10T08:27:11.689 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-10T08:27:11.689 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-10T08:27:11.689 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-10T08:27:11.690 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-10T08:27:11.690 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-10T08:27:11.690 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-10T08:27:11.690 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-10T08:27:11.890 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:10.775988+0000 mgr.y (mgr.14505) 394 : cluster [DBG] pgmap v462: 158 pgs: 158 active+clean; 3.5 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 44 KiB/s rd, 0 B/s wr, 1.19k op/s 2024-02-10T08:27:11.890 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:27:10.881286+0000 mon.a (mon.0) 1179 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 0, "weight": 0.12522991961645147}]': finished 2024-02-10T08:27:11.890 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:10.881355+0000 mon.a (mon.0) 1180 : cluster [DBG] osdmap e227: 8 total, 8 up, 8 in 2024-02-10T08:27:11.897 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:27:11.900 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:11.900 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:27:12.001 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:27:12.068 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:12.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:10.775988+0000 mgr.y (mgr.14505) 394 : cluster [DBG] pgmap v462: 158 pgs: 158 active+clean; 3.5 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 44 KiB/s rd, 0 B/s wr, 1.19k op/s 2024-02-10T08:27:12.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:27:10.881286+0000 mon.a (mon.0) 1179 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 0, "weight": 0.12522991961645147}]': finished 2024-02-10T08:27:12.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:10.881355+0000 mon.a (mon.0) 1180 : cluster [DBG] osdmap e227: 8 total, 8 up, 8 in 2024-02-10T08:27:12.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:10.775988+0000 mgr.y (mgr.14505) 394 : cluster [DBG] pgmap v462: 158 pgs: 158 active+clean; 3.5 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 44 KiB/s rd, 0 B/s wr, 1.19k op/s 2024-02-10T08:27:12.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:27:10.881286+0000 mon.a (mon.0) 1179 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 0, "weight": 0.12522991961645147}]': finished 2024-02-10T08:27:12.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:10.881355+0000 mon.a (mon.0) 1180 : cluster [DBG] osdmap e227: 8 total, 8 up, 8 in 2024-02-10T08:27:12.431 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:27:12.437 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:12.438 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:27:12.538 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:27:12.591 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:12.961 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:27:12.967 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:12.967 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:27:13.068 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:27:13.118 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:13.254 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:11.714986+0000 osd.5 (osd.5) 125 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:27:13.254 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:11.715061+0000 osd.5 (osd.5) 126 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:27:13.255 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:11.882231+0000 mon.a (mon.0) 1181 : cluster [DBG] osdmap e228: 8 total, 8 up, 8 in 2024-02-10T08:27:13.255 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:11.714986+0000 osd.5 (osd.5) 125 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:27:13.256 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:11.715061+0000 osd.5 (osd.5) 126 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:27:13.256 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:11.882231+0000 mon.a (mon.0) 1181 : cluster [DBG] osdmap e228: 8 total, 8 up, 8 in 2024-02-10T08:27:13.264 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:27:13.270 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:13.270 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:27:13.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:11.714986+0000 osd.5 (osd.5) 125 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:27:13.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:11.715061+0000 osd.5 (osd.5) 126 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:27:13.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:11.882231+0000 mon.a (mon.0) 1181 : cluster [DBG] osdmap e228: 8 total, 8 up, 8 in 2024-02-10T08:27:13.355 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:27:13.371 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:27:13.410 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:13.437 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:27:13.440 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:13.440 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:27:13.541 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:27:13.602 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:13.678 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:27:13.682 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:13.682 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:27:13.783 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:27:13.845 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:14.094 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:12.776779+0000 mgr.y (mgr.14505) 395 : cluster [DBG] pgmap v465: 158 pgs: 158 active+clean; 3.2 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.9 KiB/s rd, 0 B/s wr, 1.12k op/s 2024-02-10T08:27:14.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:12.776779+0000 mgr.y (mgr.14505) 395 : cluster [DBG] pgmap v465: 158 pgs: 158 active+clean; 3.2 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.9 KiB/s rd, 0 B/s wr, 1.12k op/s 2024-02-10T08:27:14.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:12.776779+0000 mgr.y (mgr.14505) 395 : cluster [DBG] pgmap v465: 158 pgs: 158 active+clean; 3.2 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.9 KiB/s rd, 0 B/s wr, 1.12k op/s 2024-02-10T08:27:14.413 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-10T08:27:15.810 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:27:15.815 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:15.816 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:27:15.917 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:27:15.972 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:16.007 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:27:16.014 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:16.014 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:27:16.115 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:27:16.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:14.778404+0000 mgr.y (mgr.14505) 396 : cluster [DBG] pgmap v466: 158 pgs: 158 active+clean; 3.2 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.9 KiB/s rd, 0 B/s wr, 1.27k op/s 2024-02-10T08:27:16.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:14.778404+0000 mgr.y (mgr.14505) 396 : cluster [DBG] pgmap v466: 158 pgs: 158 active+clean; 3.2 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.9 KiB/s rd, 0 B/s wr, 1.27k op/s 2024-02-10T08:27:16.166 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:16.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:14.778404+0000 mgr.y (mgr.14505) 396 : cluster [DBG] pgmap v466: 158 pgs: 158 active+clean; 3.2 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.9 KiB/s rd, 0 B/s wr, 1.27k op/s 2024-02-10T08:27:16.789 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:27:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:27:16] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:27:16.974 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:27:16.981 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:16.981 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:27:17.082 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:27:17.136 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:17.165 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:27:17.170 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:17.171 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:27:17.271 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:27:17.319 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:17.347 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:27:17.351 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:27:17.355 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:17.355 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:27:17.356 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-02-10T08:27:17.356 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-02-10T08:27:17.356 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:17.356 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.14964.0:202073 8.d e228/191)", 2024-02-10T08:27:17.356 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:27:17.344628+0000", 2024-02-10T08:27:17.356 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.000106765, 2024-02-10T08:27:17.356 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000132583, 2024-02-10T08:27:17.356 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:27:17.356 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "queued for pg", 2024-02-10T08:27:17.356 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:27:17.356 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:17.356 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:27:17.357 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:17.344628+0000", 2024-02-10T08:27:17.357 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:27:17.357 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:17.357 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:17.357 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:27:17.357 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:17.344628+0000", 2024-02-10T08:27:17.357 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:27:17.357 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:17.357 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:17.357 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:27:17.357 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:17.344627+0000", 2024-02-10T08:27:17.357 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2839999999999995e-06 2024-02-10T08:27:17.357 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:17.357 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:17.357 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:27:17.358 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:17.344636+0000", 2024-02-10T08:27:17.358 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5339999999999999e-05 2024-02-10T08:27:17.358 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:17.358 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:17.358 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:27:17.358 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:17.344651+0000", 2024-02-10T08:27:17.358 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3419999999999996e-06 2024-02-10T08:27:17.358 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:17.358 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:17.358 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:27:17.358 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:17.344658+0000", 2024-02-10T08:27:17.358 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9916999999999998e-05 2024-02-10T08:27:17.358 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:17.359 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:27:17.359 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:17.359 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:17.359 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-02-10T08:27:17.359 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 1 2024-02-10T08:27:17.359 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-02-10T08:27:17.376 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:27:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:27:17] "GET /metrics HTTP/1.1" 200 176044 "" "Prometheus/2.33.4" 2024-02-10T08:27:17.456 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:27:17.505 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:17.590 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:27:17.598 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:17.598 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:27:17.699 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:27:17.758 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:17.795 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:27:17.800 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:17.801 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:27:17.901 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:27:17.944 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:17.948 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is unset 2024-02-10T08:27:17.983 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:27:17.987 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:17.987 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:27:17.989 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 5, 6, 7, 4] 2024-02-10T08:27:17.989 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-10T08:27:17.990 INFO:tasks.thrashosds.thrasher:Removing osd 0, in_osds are: [0, 1, 2, 3, 4, 5, 6, 7] 2024-02-10T08:27:17.990 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd out 0 2024-02-10T08:27:18.037 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:16.780406+0000 mgr.y (mgr.14505) 397 : cluster [DBG] pgmap v467: 158 pgs: 158 active+clean; 3.2 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 383 B/s rd, 0 B/s wr, 672 op/s 2024-02-10T08:27:18.037 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:27:17.058621+0000 mon.c (mon.2) 49 : audit [INF] from='client.? 172.21.15.18:0/1227167735' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:27:18.037 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:27:17.059289+0000 mon.a (mon.0) 1182 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:27:18.038 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:16.780406+0000 mgr.y (mgr.14505) 397 : cluster [DBG] pgmap v467: 158 pgs: 158 active+clean; 3.2 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 383 B/s rd, 0 B/s wr, 672 op/s 2024-02-10T08:27:18.038 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:27:17.058621+0000 mon.c (mon.2) 49 : audit [INF] from='client.? 172.21.15.18:0/1227167735' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:27:18.038 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:27:17.059289+0000 mon.a (mon.0) 1182 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:27:18.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:16.780406+0000 mgr.y (mgr.14505) 397 : cluster [DBG] pgmap v467: 158 pgs: 158 active+clean; 3.2 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 383 B/s rd, 0 B/s wr, 672 op/s 2024-02-10T08:27:18.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:27:17.058621+0000 mon.c (mon.2) 49 : audit [INF] from='client.? 172.21.15.18:0/1227167735' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:27:18.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:27:17.059289+0000 mon.a (mon.0) 1182 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:27:18.088 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:27:18.149 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:18.239 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:27:18.252 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:18.253 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:27:18.271 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.2 dump_blocked_ops 2024-02-10T08:27:18.353 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:27:18.389 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:27:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:27:18.391 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:18.415 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:27:18.418 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:18.418 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:27:18.519 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:27:18.580 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:18.624 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:27:18.637 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:18.638 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:27:18.738 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:27:18.781 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:18.807 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:27:18.815 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:18.816 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:27:18.916 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:27:18.965 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:19.000 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:27:19.003 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:19.004 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:27:19.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:17.925664+0000 mon.a (mon.0) 1183 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:27:19.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:27:17.933095+0000 mon.a (mon.0) 1184 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-10T08:27:19.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:17.933168+0000 mon.a (mon.0) 1185 : cluster [DBG] osdmap e229: 8 total, 8 up, 8 in 2024-02-10T08:27:19.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:27:18.091171+0000 mgr.y (mgr.14505) 398 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:27:19.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:18.262737+0000 osd.0 (osd.0) 114 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:27:19.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:18.262796+0000 osd.0 (osd.0) 115 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:27:19.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:18.287277+0000 osd.7 (osd.7) 131 : cluster [DBG] 2.1d scrub starts 2024-02-10T08:27:19.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:18.293852+0000 osd.7 (osd.7) 132 : cluster [DBG] 2.1d scrub ok 2024-02-10T08:27:19.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:18.868691+0000 osd.4 (osd.4) 44 : cluster [DBG] 2.13 scrub starts 2024-02-10T08:27:19.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:18.873877+0000 osd.4 (osd.4) 45 : cluster [DBG] 2.13 scrub ok 2024-02-10T08:27:19.105 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:27:19.150 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:19.175 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:27:19.181 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:19.181 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:27:19.282 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:27:19.327 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:19.360 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:27:19.364 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:19.365 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:27:19.368 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:17.925664+0000 mon.a (mon.0) 1183 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:27:19.368 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:27:17.933095+0000 mon.a (mon.0) 1184 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-10T08:27:19.368 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:17.933168+0000 mon.a (mon.0) 1185 : cluster [DBG] osdmap e229: 8 total, 8 up, 8 in 2024-02-10T08:27:19.368 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:27:18.091171+0000 mgr.y (mgr.14505) 398 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:27:19.368 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:18.262737+0000 osd.0 (osd.0) 114 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:27:19.368 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:18.262796+0000 osd.0 (osd.0) 115 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:27:19.369 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:18.287277+0000 osd.7 (osd.7) 131 : cluster [DBG] 2.1d scrub starts 2024-02-10T08:27:19.369 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:18.293852+0000 osd.7 (osd.7) 132 : cluster [DBG] 2.1d scrub ok 2024-02-10T08:27:19.369 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:18.868691+0000 osd.4 (osd.4) 44 : cluster [DBG] 2.13 scrub starts 2024-02-10T08:27:19.369 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:18.873877+0000 osd.4 (osd.4) 45 : cluster [DBG] 2.13 scrub ok 2024-02-10T08:27:19.369 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:17.925664+0000 mon.a (mon.0) 1183 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:27:19.369 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:27:17.933095+0000 mon.a (mon.0) 1184 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-10T08:27:19.369 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:17.933168+0000 mon.a (mon.0) 1185 : cluster [DBG] osdmap e229: 8 total, 8 up, 8 in 2024-02-10T08:27:19.369 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:27:18.091171+0000 mgr.y (mgr.14505) 398 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:27:19.369 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:18.262737+0000 osd.0 (osd.0) 114 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:27:19.369 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:18.262796+0000 osd.0 (osd.0) 115 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:27:19.369 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:18.287277+0000 osd.7 (osd.7) 131 : cluster [DBG] 2.1d scrub starts 2024-02-10T08:27:19.369 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:18.293852+0000 osd.7 (osd.7) 132 : cluster [DBG] 2.1d scrub ok 2024-02-10T08:27:19.369 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:18.868691+0000 osd.4 (osd.4) 44 : cluster [DBG] 2.13 scrub starts 2024-02-10T08:27:19.370 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:18.873877+0000 osd.4 (osd.4) 45 : cluster [DBG] 2.13 scrub ok 2024-02-10T08:27:19.465 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:27:19.505 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:19.535 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:27:19.543 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:19.543 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:27:19.644 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:27:19.704 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:19.970 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:18.780803+0000 mgr.y (mgr.14505) 399 : cluster [DBG] pgmap v469: 158 pgs: 158 active+clean; 2.9 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 1.23k op/s 2024-02-10T08:27:19.970 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:18.962549+0000 mon.a (mon.0) 1186 : cluster [DBG] osdmap e230: 8 total, 8 up, 8 in 2024-02-10T08:27:19.970 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:19.239722+0000 osd.1 (osd.1) 122 : cluster [DBG] 6.18 scrub starts 2024-02-10T08:27:19.970 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:19.250872+0000 osd.1 (osd.1) 123 : cluster [DBG] 6.18 scrub ok 2024-02-10T08:27:19.970 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:19.280694+0000 osd.7 (osd.7) 133 : cluster [DBG] 6.16 scrub starts 2024-02-10T08:27:20.066 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:27:20.075 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:20.075 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:27:20.099 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:27:20.102 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:27:20.176 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:27:20.220 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:18.780803+0000 mgr.y (mgr.14505) 399 : cluster [DBG] pgmap v469: 158 pgs: 158 active+clean; 2.9 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 1.23k op/s 2024-02-10T08:27:20.221 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:18.962549+0000 mon.a (mon.0) 1186 : cluster [DBG] osdmap e230: 8 total, 8 up, 8 in 2024-02-10T08:27:20.221 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:19.239722+0000 osd.1 (osd.1) 122 : cluster [DBG] 6.18 scrub starts 2024-02-10T08:27:20.221 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:19.250872+0000 osd.1 (osd.1) 123 : cluster [DBG] 6.18 scrub ok 2024-02-10T08:27:20.221 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:19.280694+0000 osd.7 (osd.7) 133 : cluster [DBG] 6.16 scrub starts 2024-02-10T08:27:20.221 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:19.286339+0000 osd.7 (osd.7) 134 : cluster [DBG] 6.16 scrub ok 2024-02-10T08:27:20.221 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:19.286339+0000 osd.7 (osd.7) 134 : cluster [DBG] 6.16 scrub ok 2024-02-10T08:27:20.224 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:18.780803+0000 mgr.y (mgr.14505) 399 : cluster [DBG] pgmap v469: 158 pgs: 158 active+clean; 2.9 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 1.23k op/s 2024-02-10T08:27:20.224 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:18.962549+0000 mon.a (mon.0) 1186 : cluster [DBG] osdmap e230: 8 total, 8 up, 8 in 2024-02-10T08:27:20.225 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:19.239722+0000 osd.1 (osd.1) 122 : cluster [DBG] 6.18 scrub starts 2024-02-10T08:27:20.225 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:19.250872+0000 osd.1 (osd.1) 123 : cluster [DBG] 6.18 scrub ok 2024-02-10T08:27:20.225 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:19.280694+0000 osd.7 (osd.7) 133 : cluster [DBG] 6.16 scrub starts 2024-02-10T08:27:20.225 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:19.286339+0000 osd.7 (osd.7) 134 : cluster [DBG] 6.16 scrub ok 2024-02-10T08:27:20.227 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:20.261 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:27:20.268 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:20.269 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:27:20.369 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:27:20.409 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:20.444 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:27:20.449 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:20.449 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:27:20.550 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:27:20.603 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:20.747 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:27:20.754 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:20.754 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:27:20.855 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:27:20.910 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:21.028 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:27:21.038 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:21.038 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:27:21.072 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd unset nodeep-scrub 2024-02-10T08:27:21.140 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:27:21.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:19.888952+0000 osd.4 (osd.4) 46 : cluster [DBG] 4.1b scrub starts 2024-02-10T08:27:21.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:19.895559+0000 osd.4 (osd.4) 47 : cluster [DBG] 4.1b scrub ok 2024-02-10T08:27:21.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:20.140510+0000 osd.5 (osd.5) 127 : cluster [DBG] 8.8 scrub starts 2024-02-10T08:27:21.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:19.888952+0000 osd.4 (osd.4) 46 : cluster [DBG] 4.1b scrub starts 2024-02-10T08:27:21.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:19.895559+0000 osd.4 (osd.4) 47 : cluster [DBG] 4.1b scrub ok 2024-02-10T08:27:21.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:20.140510+0000 osd.5 (osd.5) 127 : cluster [DBG] 8.8 scrub starts 2024-02-10T08:27:21.200 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:21.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:19.888952+0000 osd.4 (osd.4) 46 : cluster [DBG] 4.1b scrub starts 2024-02-10T08:27:21.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:19.895559+0000 osd.4 (osd.4) 47 : cluster [DBG] 4.1b scrub ok 2024-02-10T08:27:21.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:20.140510+0000 osd.5 (osd.5) 127 : cluster [DBG] 8.8 scrub starts 2024-02-10T08:27:21.307 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:27:21.312 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:21.313 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:27:21.413 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:27:21.463 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:21.906 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:27:21.950 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:27:21.999 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:27:22.026 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:27:22.045 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:27:22.056 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:22.057 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:27:22.067 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:27:22.110 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:27:22.139 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:27:22.158 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:27:22.182 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:27:22.184 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-10T08:27:22.185 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-10T08:27:22.185 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-10T08:27:22.185 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-10T08:27:22.185 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-10T08:27:22.185 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-10T08:27:22.185 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-10T08:27:22.185 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-10T08:27:22.208 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:22.235 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:27:22.241 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:22.242 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:27:22.242 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:20.781330+0000 mgr.y (mgr.14505) 400 : cluster [DBG] pgmap v471: 158 pgs: 158 active+clean; 2.8 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 867 op/s 2024-02-10T08:27:22.242 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:21.369506+0000 osd.5 (osd.5) 128 : cluster [DBG] 8.8 scrub ok 2024-02-10T08:27:22.242 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:27:21.852163+0000 mon.b (mon.1) 62 : audit [DBG] from='client.? 172.21.15.18:0/4028482345' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:27:22.343 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:27:22.384 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:22.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:20.781330+0000 mgr.y (mgr.14505) 400 : cluster [DBG] pgmap v471: 158 pgs: 158 active+clean; 2.8 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 867 op/s 2024-02-10T08:27:22.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:21.369506+0000 osd.5 (osd.5) 128 : cluster [DBG] 8.8 scrub ok 2024-02-10T08:27:22.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:27:21.852163+0000 mon.b (mon.1) 62 : audit [DBG] from='client.? 172.21.15.18:0/4028482345' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:27:22.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:20.781330+0000 mgr.y (mgr.14505) 400 : cluster [DBG] pgmap v471: 158 pgs: 158 active+clean; 2.8 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 867 op/s 2024-02-10T08:27:22.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:21.369506+0000 osd.5 (osd.5) 128 : cluster [DBG] 8.8 scrub ok 2024-02-10T08:27:22.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:27:21.852163+0000 mon.b (mon.1) 62 : audit [DBG] from='client.? 172.21.15.18:0/4028482345' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:27:22.415 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:27:22.422 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:22.423 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:27:22.523 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:27:22.567 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:22.608 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:27:22.616 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:22.617 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:27:22.717 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:27:22.763 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:22.785 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:27:22.789 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:22.789 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:27:22.890 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:27:22.944 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:24.251 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:22.781951+0000 mgr.y (mgr.14505) 401 : cluster [DBG] pgmap v472: 158 pgs: 158 active+clean; 2.6 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.24k op/s 2024-02-10T08:27:24.251 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:23.158509+0000 osd.5 (osd.5) 129 : cluster [DBG] 2.18 scrub starts 2024-02-10T08:27:24.251 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:23.161484+0000 osd.5 (osd.5) 130 : cluster [DBG] 2.18 scrub ok 2024-02-10T08:27:24.252 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:22.781951+0000 mgr.y (mgr.14505) 401 : cluster [DBG] pgmap v472: 158 pgs: 158 active+clean; 2.6 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.24k op/s 2024-02-10T08:27:24.252 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:23.158509+0000 osd.5 (osd.5) 129 : cluster [DBG] 2.18 scrub starts 2024-02-10T08:27:24.252 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:23.161484+0000 osd.5 (osd.5) 130 : cluster [DBG] 2.18 scrub ok 2024-02-10T08:27:24.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:22.781951+0000 mgr.y (mgr.14505) 401 : cluster [DBG] pgmap v472: 158 pgs: 158 active+clean; 2.6 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.24k op/s 2024-02-10T08:27:24.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:23.158509+0000 osd.5 (osd.5) 129 : cluster [DBG] 2.18 scrub starts 2024-02-10T08:27:24.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:23.161484+0000 osd.5 (osd.5) 130 : cluster [DBG] 2.18 scrub ok 2024-02-10T08:27:24.711 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:27:24.717 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:24.718 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:27:24.818 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:27:24.860 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:24.887 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:27:24.892 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:24.893 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:27:24.993 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:27:25.035 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:25.065 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:27:25.071 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:25.072 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:27:25.173 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:27:25.207 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:24.113611+0000 osd.2 (osd.2) 103 : cluster [DBG] 8.f scrub starts 2024-02-10T08:27:25.208 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:25.243 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:27:25.247 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:25.248 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:27:25.349 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:27:25.402 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:24.113611+0000 osd.2 (osd.2) 103 : cluster [DBG] 8.f scrub starts 2024-02-10T08:27:25.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:24.113611+0000 osd.2 (osd.2) 103 : cluster [DBG] 8.f scrub starts 2024-02-10T08:27:25.407 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:25.443 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:27:25.451 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:25.451 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:27:25.552 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:27:25.629 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:25.820 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:27:26.101 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:27:26.104 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:27:25.902+0000 7f97240ed700 -1 mon.a@0(leader).osd e231 definitely_dead 0 2024-02-10T08:27:26.104 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:24.784522+0000 mgr.y (mgr.14505) 402 : cluster [DBG] pgmap v473: 158 pgs: 158 active+clean; 2.5 GiB data, 9.8 GiB used, 705 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.41k op/s 2024-02-10T08:27:26.104 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:24.861066+0000 osd.3 (osd.3) 99 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:27:26.104 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:24.861116+0000 osd.3 (osd.3) 100 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:27:26.104 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:25.000982+0000 mon.a (mon.0) 1187 : cluster [DBG] osdmap e231: 8 total, 8 up, 8 in 2024-02-10T08:27:26.104 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:25.175893+0000 osd.2 (osd.2) 104 : cluster [DBG] 8.f scrub ok 2024-02-10T08:27:26.104 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:27:25.902355+0000 mon.c (mon.2) 50 : audit [INF] from='client.? 172.21.15.18:0/1781824834' entity='client.admin' cmd=[{"prefix": "osd out", "ids": ["0"]}]: dispatch 2024-02-10T08:27:26.104 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:27:25.903001+0000 mon.a (mon.0) 1188 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd out", "ids": ["0"]}]: dispatch 2024-02-10T08:27:26.104 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:25.903105+0000 mon.a (mon.0) 1189 : cluster [INF] Client client.admin marked osd.0 out, while it was still marked up 2024-02-10T08:27:26.105 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:24.784522+0000 mgr.y (mgr.14505) 402 : cluster [DBG] pgmap v473: 158 pgs: 158 active+clean; 2.5 GiB data, 9.8 GiB used, 705 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.41k op/s 2024-02-10T08:27:26.105 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:24.861066+0000 osd.3 (osd.3) 99 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:27:26.105 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:24.861116+0000 osd.3 (osd.3) 100 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:27:26.105 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:25.000982+0000 mon.a (mon.0) 1187 : cluster [DBG] osdmap e231: 8 total, 8 up, 8 in 2024-02-10T08:27:26.105 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:25.175893+0000 osd.2 (osd.2) 104 : cluster [DBG] 8.f scrub ok 2024-02-10T08:27:26.105 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:27:25.902355+0000 mon.c (mon.2) 50 : audit [INF] from='client.? 172.21.15.18:0/1781824834' entity='client.admin' cmd=[{"prefix": "osd out", "ids": ["0"]}]: dispatch 2024-02-10T08:27:26.105 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:27:25.903001+0000 mon.a (mon.0) 1188 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd out", "ids": ["0"]}]: dispatch 2024-02-10T08:27:26.105 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:25.903105+0000 mon.a (mon.0) 1189 : cluster [INF] Client client.admin marked osd.0 out, while it was still marked up 2024-02-10T08:27:26.105 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:26.106 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:27:26.207 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:27:26.258 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:26.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:24.784522+0000 mgr.y (mgr.14505) 402 : cluster [DBG] pgmap v473: 158 pgs: 158 active+clean; 2.5 GiB data, 9.8 GiB used, 705 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.41k op/s 2024-02-10T08:27:26.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:24.861066+0000 osd.3 (osd.3) 99 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:27:26.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:24.861116+0000 osd.3 (osd.3) 100 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:27:26.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:25.000982+0000 mon.a (mon.0) 1187 : cluster [DBG] osdmap e231: 8 total, 8 up, 8 in 2024-02-10T08:27:26.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:25.175893+0000 osd.2 (osd.2) 104 : cluster [DBG] 8.f scrub ok 2024-02-10T08:27:26.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:27:25.902355+0000 mon.c (mon.2) 50 : audit [INF] from='client.? 172.21.15.18:0/1781824834' entity='client.admin' cmd=[{"prefix": "osd out", "ids": ["0"]}]: dispatch 2024-02-10T08:27:26.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:27:25.903001+0000 mon.a (mon.0) 1188 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd out", "ids": ["0"]}]: dispatch 2024-02-10T08:27:26.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:25.903105+0000 mon.a (mon.0) 1189 : cluster [INF] Client client.admin marked osd.0 out, while it was still marked up 2024-02-10T08:27:26.343 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:27:26.346 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:26.346 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:27:26.447 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:27:26.497 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:26.526 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:27:26.529 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:26.530 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:27:26.630 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:27:26.672 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:26.696 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-02-10T08:27:26.696 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:27:26.718 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:27:26.721 INFO:teuthology.orchestra.run.smithi018.stderr:marked out osd.0. 2024-02-10T08:27:26.722 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:26.723 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:27:26.789 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:27:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:27:26] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:27:26.824 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:27:26.857 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:27.056 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:27:27.058 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:27.058 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:27:27.159 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:27:27.187 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:27.207 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:27:27.210 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:27.210 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:27:27.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:26.124740+0000 osd.2 (osd.2) 105 : cluster [DBG] 6.14 scrub starts 2024-02-10T08:27:27.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:26.129328+0000 osd.2 (osd.2) 106 : cluster [DBG] 6.14 scrub ok 2024-02-10T08:27:27.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:27:26.693553+0000 mon.a (mon.0) 1190 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd out", "ids": ["0"]}]': finished 2024-02-10T08:27:27.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:26.693619+0000 mon.a (mon.0) 1191 : cluster [DBG] osdmap e232: 8 total, 8 up, 7 in 2024-02-10T08:27:27.311 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:27:27.339 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:27.357 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:27:27.359 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:27.359 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:27:27.404 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:27:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:27:27] "GET /metrics HTTP/1.1" 200 176044 "" "Prometheus/2.33.4" 2024-02-10T08:27:27.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:26.124740+0000 osd.2 (osd.2) 105 : cluster [DBG] 6.14 scrub starts 2024-02-10T08:27:27.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:26.129328+0000 osd.2 (osd.2) 106 : cluster [DBG] 6.14 scrub ok 2024-02-10T08:27:27.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:27:26.693553+0000 mon.a (mon.0) 1190 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd out", "ids": ["0"]}]': finished 2024-02-10T08:27:27.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:26.693619+0000 mon.a (mon.0) 1191 : cluster [DBG] osdmap e232: 8 total, 8 up, 7 in 2024-02-10T08:27:27.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:26.124740+0000 osd.2 (osd.2) 105 : cluster [DBG] 6.14 scrub starts 2024-02-10T08:27:27.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:26.129328+0000 osd.2 (osd.2) 106 : cluster [DBG] 6.14 scrub ok 2024-02-10T08:27:27.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:27:26.693553+0000 mon.a (mon.0) 1190 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd out", "ids": ["0"]}]': finished 2024-02-10T08:27:27.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:26.693619+0000 mon.a (mon.0) 1191 : cluster [DBG] osdmap e232: 8 total, 8 up, 7 in 2024-02-10T08:27:27.460 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:27:27.486 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:27.509 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:27:27.511 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:27.512 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:27:27.612 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:27:27.642 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:27.852 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-10T08:27:27.996 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:27:28.001 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:28.002 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:27:28.103 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:27:28.129 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:26.590626+0000 osd.6 (osd.6) 100 : cluster [DBG] 8.9 scrub starts 2024-02-10T08:27:28.129 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:26.784841+0000 mgr.y (mgr.14505) 403 : cluster [DBG] pgmap v476: 158 pgs: 158 active+clean; 2.5 GiB data, 8.9 GiB used, 617 GiB / 626 GiB avail; 654 B/s rd, 0 B/s wr, 801 op/s 2024-02-10T08:27:28.129 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:26.957963+0000 osd.6 (osd.6) 101 : cluster [DBG] 8.9 scrub ok 2024-02-10T08:27:28.129 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:27.093402+0000 osd.2 (osd.2) 107 : cluster [DBG] 2.5 scrub starts 2024-02-10T08:27:28.129 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:27.094234+0000 osd.2 (osd.2) 108 : cluster [DBG] 2.5 scrub ok 2024-02-10T08:27:28.129 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:27.155330+0000 osd.5 (osd.5) 131 : cluster [DBG] 8.4 scrub starts 2024-02-10T08:27:28.129 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:27:27.553238+0000 mon.a (mon.0) 1192 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:27:28.129 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:27.697788+0000 mon.a (mon.0) 1193 : cluster [DBG] osdmap e233: 8 total, 8 up, 7 in 2024-02-10T08:27:28.129 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:27:27.885556+0000 mon.a (mon.0) 1194 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:27:28.130 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:27:27.886277+0000 mon.a (mon.0) 1195 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:27:28.130 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:27:27.886916+0000 mon.a (mon.0) 1196 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:27:28.130 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:27:27.887571+0000 mon.a (mon.0) 1197 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:27:28.130 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:27:27.892228+0000 mon.a (mon.0) 1198 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:27:28.130 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:26.590626+0000 osd.6 (osd.6) 100 : cluster [DBG] 8.9 scrub starts 2024-02-10T08:27:28.130 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:26.784841+0000 mgr.y (mgr.14505) 403 : cluster [DBG] pgmap v476: 158 pgs: 158 active+clean; 2.5 GiB data, 8.9 GiB used, 617 GiB / 626 GiB avail; 654 B/s rd, 0 B/s wr, 801 op/s 2024-02-10T08:27:28.130 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:26.957963+0000 osd.6 (osd.6) 101 : cluster [DBG] 8.9 scrub ok 2024-02-10T08:27:28.130 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:27.093402+0000 osd.2 (osd.2) 107 : cluster [DBG] 2.5 scrub starts 2024-02-10T08:27:28.130 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:27.094234+0000 osd.2 (osd.2) 108 : cluster [DBG] 2.5 scrub ok 2024-02-10T08:27:28.130 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:27.155330+0000 osd.5 (osd.5) 131 : cluster [DBG] 8.4 scrub starts 2024-02-10T08:27:28.131 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:27:27.553238+0000 mon.a (mon.0) 1192 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:27:28.131 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:27.697788+0000 mon.a (mon.0) 1193 : cluster [DBG] osdmap e233: 8 total, 8 up, 7 in 2024-02-10T08:27:28.131 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:27:27.885556+0000 mon.a (mon.0) 1194 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:27:28.131 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:27:27.886277+0000 mon.a (mon.0) 1195 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:27:28.131 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:27:27.886916+0000 mon.a (mon.0) 1196 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:27:28.131 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:27:27.887571+0000 mon.a (mon.0) 1197 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:27:28.131 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:27:27.892228+0000 mon.a (mon.0) 1198 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:27:28.131 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:28.289 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:27:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:27:28.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:26.590626+0000 osd.6 (osd.6) 100 : cluster [DBG] 8.9 scrub starts 2024-02-10T08:27:28.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:26.784841+0000 mgr.y (mgr.14505) 403 : cluster [DBG] pgmap v476: 158 pgs: 158 active+clean; 2.5 GiB data, 8.9 GiB used, 617 GiB / 626 GiB avail; 654 B/s rd, 0 B/s wr, 801 op/s 2024-02-10T08:27:28.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:26.957963+0000 osd.6 (osd.6) 101 : cluster [DBG] 8.9 scrub ok 2024-02-10T08:27:28.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:27.093402+0000 osd.2 (osd.2) 107 : cluster [DBG] 2.5 scrub starts 2024-02-10T08:27:28.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:27.094234+0000 osd.2 (osd.2) 108 : cluster [DBG] 2.5 scrub ok 2024-02-10T08:27:28.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:27.155330+0000 osd.5 (osd.5) 131 : cluster [DBG] 8.4 scrub starts 2024-02-10T08:27:28.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:27:27.553238+0000 mon.a (mon.0) 1192 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:27:28.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:27.697788+0000 mon.a (mon.0) 1193 : cluster [DBG] osdmap e233: 8 total, 8 up, 7 in 2024-02-10T08:27:28.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:27:27.885556+0000 mon.a (mon.0) 1194 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:27:28.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:27:27.886277+0000 mon.a (mon.0) 1195 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:27:28.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:27:27.886916+0000 mon.a (mon.0) 1196 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:27:28.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:27:27.887571+0000 mon.a (mon.0) 1197 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:27:28.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:27:27.892228+0000 mon.a (mon.0) 1198 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:27:28.852 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.2 dump_historic_ops 2024-02-10T08:27:29.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:27.509391+0000 osd.5 (osd.5) 132 : cluster [DBG] 8.4 scrub ok 2024-02-10T08:27:29.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cephadm 2024-02-10T08:27:27.888077+0000 mgr.y (mgr.14505) 404 : cephadm [INF] Adjusting osd_memory_target on smithi071 to 3256M 2024-02-10T08:27:29.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:27:28.102512+0000 mgr.y (mgr.14505) 405 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:27:29.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:27:28.139185+0000 mon.a (mon.0) 1199 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:27:29.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:27:28.139850+0000 mon.a (mon.0) 1200 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:27:29.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:27:28.140437+0000 mon.a (mon.0) 1201 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:27:29.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:27:28.140998+0000 mon.a (mon.0) 1202 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:27:29.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cephadm 2024-02-10T08:27:28.141460+0000 mgr.y (mgr.14505) 406 : cephadm [INF] Adjusting osd_memory_target on smithi018 to 3257M 2024-02-10T08:27:29.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:27:28.145379+0000 mon.a (mon.0) 1203 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:27:29.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:27:28.147116+0000 mon.a (mon.0) 1204 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:27:29.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:27:28.147753+0000 mon.a (mon.0) 1205 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:27:29.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:27:28.152406+0000 mon.a (mon.0) 1206 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:27:29.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:28.698383+0000 osd.4 (osd.4) 48 : cluster [DBG] 8.2 starting backfill to osd.6 from (0'0,0'0] MAX to 231'13251 2024-02-10T08:27:29.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:28.699173+0000 mon.a (mon.0) 1207 : cluster [DBG] osdmap e234: 8 total, 8 up, 7 in 2024-02-10T08:27:29.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:28.704049+0000 osd.1 (osd.1) 124 : cluster [DBG] 8.1 starting backfill to osd.5 from (0'0,0'0] MAX to 231'13174 2024-02-10T08:27:29.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:27:28.805912+0000 mon.c (mon.2) 51 : audit [INF] from='client.? 172.21.15.18:0/1170123383' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:27:29.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:27:28.806510+0000 mon.a (mon.0) 1208 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:27:29.158 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:27.509391+0000 osd.5 (osd.5) 132 : cluster [DBG] 8.4 scrub ok 2024-02-10T08:27:29.158 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cephadm 2024-02-10T08:27:27.888077+0000 mgr.y (mgr.14505) 404 : cephadm [INF] Adjusting osd_memory_target on smithi071 to 3256M 2024-02-10T08:27:29.158 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:27:28.102512+0000 mgr.y (mgr.14505) 405 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:27:29.158 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:27:28.139185+0000 mon.a (mon.0) 1199 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:27:29.158 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:27:28.139850+0000 mon.a (mon.0) 1200 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:27:29.158 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:27:28.140437+0000 mon.a (mon.0) 1201 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:27:29.158 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:27:28.140998+0000 mon.a (mon.0) 1202 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:27:29.158 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cephadm 2024-02-10T08:27:28.141460+0000 mgr.y (mgr.14505) 406 : cephadm [INF] Adjusting osd_memory_target on smithi018 to 3257M 2024-02-10T08:27:29.158 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:27:28.145379+0000 mon.a (mon.0) 1203 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:27:29.158 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:27:28.147116+0000 mon.a (mon.0) 1204 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:27:29.158 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:27:28.147753+0000 mon.a (mon.0) 1205 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:27:29.158 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:27:28.152406+0000 mon.a (mon.0) 1206 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:27:29.159 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:28.698383+0000 osd.4 (osd.4) 48 : cluster [DBG] 8.2 starting backfill to osd.6 from (0'0,0'0] MAX to 231'13251 2024-02-10T08:27:29.159 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:28.699173+0000 mon.a (mon.0) 1207 : cluster [DBG] osdmap e234: 8 total, 8 up, 7 in 2024-02-10T08:27:29.159 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:28.704049+0000 osd.1 (osd.1) 124 : cluster [DBG] 8.1 starting backfill to osd.5 from (0'0,0'0] MAX to 231'13174 2024-02-10T08:27:29.159 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:27:28.805912+0000 mon.c (mon.2) 51 : audit [INF] from='client.? 172.21.15.18:0/1170123383' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:27:29.159 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:27:28.806510+0000 mon.a (mon.0) 1208 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:27:29.285 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:27:29.295 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:27.509391+0000 osd.5 (osd.5) 132 : cluster [DBG] 8.4 scrub ok 2024-02-10T08:27:29.295 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cephadm 2024-02-10T08:27:27.888077+0000 mgr.y (mgr.14505) 404 : cephadm [INF] Adjusting osd_memory_target on smithi071 to 3256M 2024-02-10T08:27:29.295 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:27:28.102512+0000 mgr.y (mgr.14505) 405 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:27:29.295 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:27:28.139185+0000 mon.a (mon.0) 1199 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:27:29.295 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:27:28.139850+0000 mon.a (mon.0) 1200 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:27:29.295 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:27:28.140437+0000 mon.a (mon.0) 1201 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:27:29.295 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:27:28.140998+0000 mon.a (mon.0) 1202 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-10T08:27:29.296 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cephadm 2024-02-10T08:27:28.141460+0000 mgr.y (mgr.14505) 406 : cephadm [INF] Adjusting osd_memory_target on smithi018 to 3257M 2024-02-10T08:27:29.296 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:27:28.145379+0000 mon.a (mon.0) 1203 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:27:29.296 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:27:28.147116+0000 mon.a (mon.0) 1204 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:27:29.296 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:27:28.147753+0000 mon.a (mon.0) 1205 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:27:29.296 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:27:28.152406+0000 mon.a (mon.0) 1206 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:27:29.296 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:28.698383+0000 osd.4 (osd.4) 48 : cluster [DBG] 8.2 starting backfill to osd.6 from (0'0,0'0] MAX to 231'13251 2024-02-10T08:27:29.296 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:28.699173+0000 mon.a (mon.0) 1207 : cluster [DBG] osdmap e234: 8 total, 8 up, 7 in 2024-02-10T08:27:29.296 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:28.704049+0000 osd.1 (osd.1) 124 : cluster [DBG] 8.1 starting backfill to osd.5 from (0'0,0'0] MAX to 231'13174 2024-02-10T08:27:29.296 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:27:28.805912+0000 mon.c (mon.2) 51 : audit [INF] from='client.? 172.21.15.18:0/1170123383' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:27:29.296 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:27:28.806510+0000 mon.a (mon.0) 1208 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:27:29.306 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:29.306 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:27:29.407 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:27:29.464 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:29.491 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:27:29.495 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:29.495 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:27:29.596 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:27:29.649 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:29.675 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:27:29.684 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:29.687 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:27:29.731 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is unset 2024-02-10T08:27:29.789 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:27:29.828 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:29.868 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:27:29.872 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:29.872 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:27:29.973 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:27:30.020 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:30.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:28.701761+0000 osd.2 (osd.2) 109 : cluster [DBG] 8.e starting backfill to osd.7 from (0'0,0'0] MAX to 231'13359 2024-02-10T08:27:30.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:28.702370+0000 osd.6 (osd.6) 102 : cluster [DBG] 8.6 starting backfill to osd.2 from (0'0,0'0] MAX to 231'13275 2024-02-10T08:27:30.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:28.785246+0000 mgr.y (mgr.14505) 407 : cluster [DBG] pgmap v479: 158 pgs: 1 remapped+peering, 1 active+recovery_wait+degraded, 25 peering, 131 active+clean; 2.2 GiB data, 8.2 GiB used, 618 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 1.03k op/s; 7/109956 objects degraded (0.006%); 89 B/s, 0 objects/s recovering 2024-02-10T08:27:30.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:29.696255+0000 mon.a (mon.0) 1209 : cluster [WRN] Health check failed: Degraded data redundancy: 7/109956 objects degraded (0.006%), 1 pg degraded (PG_DEGRADED) 2024-02-10T08:27:30.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:29.697498+0000 mon.a (mon.0) 1210 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-10T08:27:30.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:29.697524+0000 mon.a (mon.0) 1211 : cluster [INF] Cluster is now healthy 2024-02-10T08:27:30.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:27:29.713832+0000 mon.a (mon.0) 1212 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-10T08:27:30.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:29.713917+0000 mon.a (mon.0) 1213 : cluster [DBG] osdmap e235: 8 total, 8 up, 7 in 2024-02-10T08:27:30.408 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:28.701761+0000 osd.2 (osd.2) 109 : cluster [DBG] 8.e starting backfill to osd.7 from (0'0,0'0] MAX to 231'13359 2024-02-10T08:27:30.408 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:28.702370+0000 osd.6 (osd.6) 102 : cluster [DBG] 8.6 starting backfill to osd.2 from (0'0,0'0] MAX to 231'13275 2024-02-10T08:27:30.408 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:28.785246+0000 mgr.y (mgr.14505) 407 : cluster [DBG] pgmap v479: 158 pgs: 1 remapped+peering, 1 active+recovery_wait+degraded, 25 peering, 131 active+clean; 2.2 GiB data, 8.2 GiB used, 618 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 1.03k op/s; 7/109956 objects degraded (0.006%); 89 B/s, 0 objects/s recovering 2024-02-10T08:27:30.408 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:29.696255+0000 mon.a (mon.0) 1209 : cluster [WRN] Health check failed: Degraded data redundancy: 7/109956 objects degraded (0.006%), 1 pg degraded (PG_DEGRADED) 2024-02-10T08:27:30.408 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:29.697498+0000 mon.a (mon.0) 1210 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-10T08:27:30.408 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:29.697524+0000 mon.a (mon.0) 1211 : cluster [INF] Cluster is now healthy 2024-02-10T08:27:30.408 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:27:29.713832+0000 mon.a (mon.0) 1212 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-10T08:27:30.409 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:29.713917+0000 mon.a (mon.0) 1213 : cluster [DBG] osdmap e235: 8 total, 8 up, 7 in 2024-02-10T08:27:30.409 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:28.701761+0000 osd.2 (osd.2) 109 : cluster [DBG] 8.e starting backfill to osd.7 from (0'0,0'0] MAX to 231'13359 2024-02-10T08:27:30.409 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:28.702370+0000 osd.6 (osd.6) 102 : cluster [DBG] 8.6 starting backfill to osd.2 from (0'0,0'0] MAX to 231'13275 2024-02-10T08:27:30.409 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:28.785246+0000 mgr.y (mgr.14505) 407 : cluster [DBG] pgmap v479: 158 pgs: 1 remapped+peering, 1 active+recovery_wait+degraded, 25 peering, 131 active+clean; 2.2 GiB data, 8.2 GiB used, 618 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 1.03k op/s; 7/109956 objects degraded (0.006%); 89 B/s, 0 objects/s recovering 2024-02-10T08:27:30.409 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:29.696255+0000 mon.a (mon.0) 1209 : cluster [WRN] Health check failed: Degraded data redundancy: 7/109956 objects degraded (0.006%), 1 pg degraded (PG_DEGRADED) 2024-02-10T08:27:30.409 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:29.697498+0000 mon.a (mon.0) 1210 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-10T08:27:30.409 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:29.697524+0000 mon.a (mon.0) 1211 : cluster [INF] Cluster is now healthy 2024-02-10T08:27:30.409 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:27:29.713832+0000 mon.a (mon.0) 1212 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-10T08:27:30.409 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:29.713917+0000 mon.a (mon.0) 1213 : cluster [DBG] osdmap e235: 8 total, 8 up, 7 in 2024-02-10T08:27:32.041 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:30.785732+0000 mgr.y (mgr.14505) 408 : cluster [DBG] pgmap v481: 158 pgs: 1 active+remapped+backfilling, 1 remapped+peering, 1 active+recovery_wait+degraded, 25 peering, 130 active+clean; 2.2 GiB data, 8.1 GiB used, 618 GiB / 626 GiB avail; 1001 B/s rd, 0 B/s wr, 1.10k op/s; 7/108852 objects degraded (0.006%); 2028/108852 objects misplaced (1.863%); 2.9 MiB/s, 48 objects/s recovering 2024-02-10T08:27:32.041 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:27:31.654276+0000 mon.a (mon.0) 1214 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:27:32.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:30.785732+0000 mgr.y (mgr.14505) 408 : cluster [DBG] pgmap v481: 158 pgs: 1 active+remapped+backfilling, 1 remapped+peering, 1 active+recovery_wait+degraded, 25 peering, 130 active+clean; 2.2 GiB data, 8.1 GiB used, 618 GiB / 626 GiB avail; 1001 B/s rd, 0 B/s wr, 1.10k op/s; 7/108852 objects degraded (0.006%); 2028/108852 objects misplaced (1.863%); 2.9 MiB/s, 48 objects/s recovering 2024-02-10T08:27:32.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:27:31.654276+0000 mon.a (mon.0) 1214 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:27:32.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:30.785732+0000 mgr.y (mgr.14505) 408 : cluster [DBG] pgmap v481: 158 pgs: 1 active+remapped+backfilling, 1 remapped+peering, 1 active+recovery_wait+degraded, 25 peering, 130 active+clean; 2.2 GiB data, 8.1 GiB used, 618 GiB / 626 GiB avail; 1001 B/s rd, 0 B/s wr, 1.10k op/s; 7/108852 objects degraded (0.006%); 2028/108852 objects misplaced (1.863%); 2.9 MiB/s, 48 objects/s recovering 2024-02-10T08:27:32.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:27:31.654276+0000 mon.a (mon.0) 1214 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:27:33.041 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:31.798428+0000 osd.4 (osd.4) 49 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:27:33.041 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:31.798484+0000 osd.4 (osd.4) 50 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:27:33.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:31.798428+0000 osd.4 (osd.4) 49 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:27:33.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:31.798484+0000 osd.4 (osd.4) 50 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:27:33.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:31.798428+0000 osd.4 (osd.4) 49 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:27:33.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:31.798484+0000 osd.4 (osd.4) 50 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:27:34.016 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:27:34.021 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:34.022 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:27:34.024 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:32.734792+0000 mon.a (mon.0) 1215 : cluster [DBG] osdmap e236: 8 total, 8 up, 7 in 2024-02-10T08:27:34.024 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:32.786149+0000 mgr.y (mgr.14505) 409 : cluster [DBG] pgmap v483: 158 pgs: 3 active+remapped+backfilling, 1 remapped+peering, 1 active+recovery_wait+degraded, 153 active+clean; 2.0 GiB data, 7.7 GiB used, 618 GiB / 626 GiB avail; 1005 B/s rd, 0 B/s wr, 731 op/s; 7/100341 objects degraded (0.007%); 6026/100341 objects misplaced (6.006%); 3.4 MiB/s, 59 objects/s recovering 2024-02-10T08:27:34.024 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:32.734792+0000 mon.a (mon.0) 1215 : cluster [DBG] osdmap e236: 8 total, 8 up, 7 in 2024-02-10T08:27:34.024 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:32.786149+0000 mgr.y (mgr.14505) 409 : cluster [DBG] pgmap v483: 158 pgs: 3 active+remapped+backfilling, 1 remapped+peering, 1 active+recovery_wait+degraded, 153 active+clean; 2.0 GiB data, 7.7 GiB used, 618 GiB / 626 GiB avail; 1005 B/s rd, 0 B/s wr, 731 op/s; 7/100341 objects degraded (0.007%); 6026/100341 objects misplaced (6.006%); 3.4 MiB/s, 59 objects/s recovering 2024-02-10T08:27:34.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:32.734792+0000 mon.a (mon.0) 1215 : cluster [DBG] osdmap e236: 8 total, 8 up, 7 in 2024-02-10T08:27:34.041 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:32.786149+0000 mgr.y (mgr.14505) 409 : cluster [DBG] pgmap v483: 158 pgs: 3 active+remapped+backfilling, 1 remapped+peering, 1 active+recovery_wait+degraded, 153 active+clean; 2.0 GiB data, 7.7 GiB used, 618 GiB / 626 GiB avail; 1005 B/s rd, 0 B/s wr, 731 op/s; 7/100341 objects degraded (0.007%); 6026/100341 objects misplaced (6.006%); 3.4 MiB/s, 59 objects/s recovering 2024-02-10T08:27:34.123 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:27:34.182 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:34.214 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:27:34.218 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:34.219 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:27:34.320 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:27:34.376 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:35.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:34.837761+0000 mon.a (mon.0) 1216 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 7/100341 objects degraded (0.007%), 1 pg degraded) 2024-02-10T08:27:35.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:34.837784+0000 mon.a (mon.0) 1217 : cluster [INF] Cluster is now healthy 2024-02-10T08:27:35.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:34.837761+0000 mon.a (mon.0) 1216 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 7/100341 objects degraded (0.007%), 1 pg degraded) 2024-02-10T08:27:35.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:34.837784+0000 mon.a (mon.0) 1217 : cluster [INF] Cluster is now healthy 2024-02-10T08:27:35.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:34.837761+0000 mon.a (mon.0) 1216 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 7/100341 objects degraded (0.007%), 1 pg degraded) 2024-02-10T08:27:35.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:34.837784+0000 mon.a (mon.0) 1217 : cluster [INF] Cluster is now healthy 2024-02-10T08:27:35.344 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:27:35.351 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:35.352 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:27:35.453 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:27:35.511 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:35.551 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:27:35.557 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:35.557 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:27:35.658 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:27:35.695 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:35.717 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:27:35.720 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:35.721 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:27:35.822 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:27:35.872 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:36.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:34.786652+0000 mgr.y (mgr.14505) 410 : cluster [DBG] pgmap v484: 158 pgs: 4 active+remapped+backfilling, 154 active+clean; 2.0 GiB data, 7.5 GiB used, 618 GiB / 626 GiB avail; 840 B/s rd, 0 B/s wr, 719 op/s; 6544/96834 objects misplaced (6.758%); 16 MiB/s, 269 objects/s recovering 2024-02-10T08:27:36.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:34.786652+0000 mgr.y (mgr.14505) 410 : cluster [DBG] pgmap v484: 158 pgs: 4 active+remapped+backfilling, 154 active+clean; 2.0 GiB data, 7.5 GiB used, 618 GiB / 626 GiB avail; 840 B/s rd, 0 B/s wr, 719 op/s; 6544/96834 objects misplaced (6.758%); 16 MiB/s, 269 objects/s recovering 2024-02-10T08:27:36.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:34.786652+0000 mgr.y (mgr.14505) 410 : cluster [DBG] pgmap v484: 158 pgs: 4 active+remapped+backfilling, 154 active+clean; 2.0 GiB data, 7.5 GiB used, 618 GiB / 626 GiB avail; 840 B/s rd, 0 B/s wr, 719 op/s; 6544/96834 objects misplaced (6.758%); 16 MiB/s, 269 objects/s recovering 2024-02-10T08:27:36.440 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:27:36.456 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:36.457 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:27:36.518 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:27:36.523 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:27:36.558 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:27:36.610 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:36.639 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:27:36.643 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:36.643 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:27:36.744 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:27:36.789 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:27:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:27:36] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:27:36.805 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:36.846 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:27:36.853 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:36.854 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:27:36.954 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:27:37.027 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:37.173 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:27:37.176 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:37.176 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:27:37.277 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:27:37.325 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:37.655 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:27:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:27:37] "GET /metrics HTTP/1.1" 200 176063 "" "Prometheus/2.33.4" 2024-02-10T08:27:38.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:36.788613+0000 mgr.y (mgr.14505) 411 : cluster [DBG] pgmap v485: 158 pgs: 4 active+remapped+backfilling, 154 active+clean; 2.0 GiB data, 7.5 GiB used, 618 GiB / 626 GiB avail; 639 B/s rd, 0 B/s wr, 547 op/s; 6544/96834 objects misplaced (6.758%); 13 MiB/s, 204 objects/s recovering 2024-02-10T08:27:38.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:36.788613+0000 mgr.y (mgr.14505) 411 : cluster [DBG] pgmap v485: 158 pgs: 4 active+remapped+backfilling, 154 active+clean; 2.0 GiB data, 7.5 GiB used, 618 GiB / 626 GiB avail; 639 B/s rd, 0 B/s wr, 547 op/s; 6544/96834 objects misplaced (6.758%); 13 MiB/s, 204 objects/s recovering 2024-02-10T08:27:38.290 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:27:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:27:38.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:36.788613+0000 mgr.y (mgr.14505) 411 : cluster [DBG] pgmap v485: 158 pgs: 4 active+remapped+backfilling, 154 active+clean; 2.0 GiB data, 7.5 GiB used, 618 GiB / 626 GiB avail; 639 B/s rd, 0 B/s wr, 547 op/s; 6544/96834 objects misplaced (6.758%); 13 MiB/s, 204 objects/s recovering 2024-02-10T08:27:38.480 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd set noscrub 2024-02-10T08:27:39.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:27:38.114982+0000 mgr.y (mgr.14505) 412 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:27:39.368 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:27:38.114982+0000 mgr.y (mgr.14505) 412 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:27:39.370 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:27:38.114982+0000 mgr.y (mgr.14505) 412 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:27:39.517 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-02-10T08:27:39.517 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:27:40.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:38.544768+0000 osd.2 (osd.2) 110 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:27:40.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:38.544823+0000 osd.2 (osd.2) 111 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:27:40.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:38.789772+0000 mgr.y (mgr.14505) 413 : cluster [DBG] pgmap v486: 158 pgs: 4 active+remapped+backfilling, 154 active+clean; 1.7 GiB data, 6.8 GiB used, 619 GiB / 626 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 982 op/s; 4928/83220 objects misplaced (5.922%); 17 MiB/s, 268 objects/s recovering 2024-02-10T08:27:40.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:38.957677+0000 mon.a (mon.0) 1218 : cluster [DBG] osdmap e237: 8 total, 8 up, 7 in 2024-02-10T08:27:40.346 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:27:40.353 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 3, 4, 5, 6, 7] out_osds: [0] dead_osds: [] live_osds: [0, 1, 2, 3, 5, 6, 7, 4] 2024-02-10T08:27:40.353 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-10T08:27:40.353 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-02-10T08:27:40.353 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd dump -f json-pretty 2024-02-10T08:27:40.356 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:40.356 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:27:40.358 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:38.544768+0000 osd.2 (osd.2) 110 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:27:40.358 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:38.544823+0000 osd.2 (osd.2) 111 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:27:40.358 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:38.789772+0000 mgr.y (mgr.14505) 413 : cluster [DBG] pgmap v486: 158 pgs: 4 active+remapped+backfilling, 154 active+clean; 1.7 GiB data, 6.8 GiB used, 619 GiB / 626 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 982 op/s; 4928/83220 objects misplaced (5.922%); 17 MiB/s, 268 objects/s recovering 2024-02-10T08:27:40.358 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:38.957677+0000 mon.a (mon.0) 1218 : cluster [DBG] osdmap e237: 8 total, 8 up, 7 in 2024-02-10T08:27:40.358 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:38.544768+0000 osd.2 (osd.2) 110 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:27:40.358 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:38.544823+0000 osd.2 (osd.2) 111 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:27:40.358 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:38.789772+0000 mgr.y (mgr.14505) 413 : cluster [DBG] pgmap v486: 158 pgs: 4 active+remapped+backfilling, 154 active+clean; 1.7 GiB data, 6.8 GiB used, 619 GiB / 626 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 982 op/s; 4928/83220 objects misplaced (5.922%); 17 MiB/s, 268 objects/s recovering 2024-02-10T08:27:40.358 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:38.957677+0000 mon.a (mon.0) 1218 : cluster [DBG] osdmap e237: 8 total, 8 up, 7 in 2024-02-10T08:27:40.457 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:27:40.482 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:27:40.496 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:40.516 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:27:40.521 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.3 dump_ops_in_flight 2024-02-10T08:27:40.522 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:40.522 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:27:40.622 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:27:40.667 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:40.697 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:27:40.700 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:40.700 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:27:40.801 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:27:40.881 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:41.398 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:27:41.417 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:27:41.434 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:27:41.451 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:27:41.471 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:27:41.488 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:27:41.505 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:27:41.524 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:27:41.525 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-10T08:27:41.525 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-10T08:27:41.526 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-10T08:27:41.526 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-10T08:27:41.526 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-10T08:27:41.526 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-10T08:27:41.526 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-10T08:27:41.526 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-10T08:27:41.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:40.704952+0000 mon.a (mon.0) 1219 : cluster [DBG] osdmap e238: 8 total, 8 up, 7 in 2024-02-10T08:27:41.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:40.791067+0000 mgr.y (mgr.14505) 414 : cluster [DBG] pgmap v489: 158 pgs: 4 active+remapped+backfilling, 154 active+clean; 1.6 GiB data, 6.8 GiB used, 619 GiB / 626 GiB avail; 639 B/s rd, 0 B/s wr, 795 op/s; 3970/81249 objects misplaced (4.886%); 23 MiB/s, 374 objects/s recovering 2024-02-10T08:27:41.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:27:41.377621+0000 mon.c (mon.2) 52 : audit [DBG] from='client.? 172.21.15.18:0/3099213988' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:27:41.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:40.704952+0000 mon.a (mon.0) 1219 : cluster [DBG] osdmap e238: 8 total, 8 up, 7 in 2024-02-10T08:27:41.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:40.791067+0000 mgr.y (mgr.14505) 414 : cluster [DBG] pgmap v489: 158 pgs: 4 active+remapped+backfilling, 154 active+clean; 1.6 GiB data, 6.8 GiB used, 619 GiB / 626 GiB avail; 639 B/s rd, 0 B/s wr, 795 op/s; 3970/81249 objects misplaced (4.886%); 23 MiB/s, 374 objects/s recovering 2024-02-10T08:27:41.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:27:41.377621+0000 mon.c (mon.2) 52 : audit [DBG] from='client.? 172.21.15.18:0/3099213988' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:27:42.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:41 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:40.704952+0000 mon.a (mon.0) 1219 : cluster [DBG] osdmap e238: 8 total, 8 up, 7 in 2024-02-10T08:27:42.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:41 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:40.791067+0000 mgr.y (mgr.14505) 414 : cluster [DBG] pgmap v489: 158 pgs: 4 active+remapped+backfilling, 154 active+clean; 1.6 GiB data, 6.8 GiB used, 619 GiB / 626 GiB avail; 639 B/s rd, 0 B/s wr, 795 op/s; 3970/81249 objects misplaced (4.886%); 23 MiB/s, 374 objects/s recovering 2024-02-10T08:27:42.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:41 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:27:41.377621+0000 mon.c (mon.2) 52 : audit [DBG] from='client.? 172.21.15.18:0/3099213988' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:27:42.151 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:27:42.153 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:27:42.155 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:42.156 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:27:42.257 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:27:42.286 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:42.484 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:27:42.486 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:42.487 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:27:42.527 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:27:42.587 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:27:42.615 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:43.041 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:41.716515+0000 mon.a (mon.0) 1220 : cluster [DBG] osdmap e239: 8 total, 8 up, 7 in 2024-02-10T08:27:43.041 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:27:41.912825+0000 mon.a (mon.0) 1221 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:27:43.041 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:42.023901+0000 osd.6 (osd.6) 103 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:27:43.041 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:42.023941+0000 osd.6 (osd.6) 104 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:27:43.065 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:27:43.068 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:41.716515+0000 mon.a (mon.0) 1220 : cluster [DBG] osdmap e239: 8 total, 8 up, 7 in 2024-02-10T08:27:43.068 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:27:41.912825+0000 mon.a (mon.0) 1221 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:27:43.068 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:42.023901+0000 osd.6 (osd.6) 103 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:27:43.068 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:42.023941+0000 osd.6 (osd.6) 104 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:27:43.073 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:43.074 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:41.716515+0000 mon.a (mon.0) 1220 : cluster [DBG] osdmap e239: 8 total, 8 up, 7 in 2024-02-10T08:27:43.074 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:27:41.912825+0000 mon.a (mon.0) 1221 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:27:43.074 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:42.023901+0000 osd.6 (osd.6) 103 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:27:43.074 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:42.023941+0000 osd.6 (osd.6) 104 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:27:43.074 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:27:43.175 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:27:43.232 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:43.704 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:27:43.707 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:43.707 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:27:43.808 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:27:43.858 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:42.721680+0000 mon.a (mon.0) 1222 : cluster [DBG] osdmap e240: 8 total, 8 up, 7 in 2024-02-10T08:27:43.858 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:42.791852+0000 mgr.y (mgr.14505) 415 : cluster [DBG] pgmap v492: 158 pgs: 4 active+remapped+backfilling, 154 active+clean; 1.5 GiB data, 6.3 GiB used, 619 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 840 op/s; 3415/73143 objects misplaced (4.669%); 15 MiB/s, 244 objects/s recovering 2024-02-10T08:27:43.858 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:42.721680+0000 mon.a (mon.0) 1222 : cluster [DBG] osdmap e240: 8 total, 8 up, 7 in 2024-02-10T08:27:43.858 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:42.791852+0000 mgr.y (mgr.14505) 415 : cluster [DBG] pgmap v492: 158 pgs: 4 active+remapped+backfilling, 154 active+clean; 1.5 GiB data, 6.3 GiB used, 619 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 840 op/s; 3415/73143 objects misplaced (4.669%); 15 MiB/s, 244 objects/s recovering 2024-02-10T08:27:43.867 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:43.998 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:27:44.002 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:44.002 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:27:44.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:43 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:42.721680+0000 mon.a (mon.0) 1222 : cluster [DBG] osdmap e240: 8 total, 8 up, 7 in 2024-02-10T08:27:44.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:43 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:42.791852+0000 mgr.y (mgr.14505) 415 : cluster [DBG] pgmap v492: 158 pgs: 4 active+remapped+backfilling, 154 active+clean; 1.5 GiB data, 6.3 GiB used, 619 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 840 op/s; 3415/73143 objects misplaced (4.669%); 15 MiB/s, 244 objects/s recovering 2024-02-10T08:27:44.103 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:27:44.172 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:44.289 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:27:44.293 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:44.294 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:27:44.394 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:27:44.460 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:44.942 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:27:44.947 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:44.948 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:27:45.049 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:27:45.100 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:45.128 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:27:45.133 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:45.133 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:27:45.234 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:27:45.300 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:45.328 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:27:45.330 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:45.331 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:27:45.431 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:27:45.486 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:45.520 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:27:45.542 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:45.542 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:27:45.624 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-10T08:27:45.643 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:27:45.740 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:45.889 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is set 2024-02-10T08:27:46.080 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:44.792447+0000 mgr.y (mgr.14505) 416 : cluster [DBG] pgmap v493: 158 pgs: 2 active+remapped+backfilling, 156 active+clean; 1.4 GiB data, 6.2 GiB used, 620 GiB / 626 GiB avail; 701 B/s rd, 0 B/s wr, 735 op/s; 2706/70359 objects misplaced (3.846%); 17 MiB/s, 279 objects/s recovering 2024-02-10T08:27:46.080 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:27:44.923388+0000 mon.b (mon.1) 63 : audit [INF] from='client.? 172.21.15.18:0/2882024421' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:27:46.080 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:27:44.930485+0000 mon.a (mon.0) 1223 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:27:46.080 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:44.792447+0000 mgr.y (mgr.14505) 416 : cluster [DBG] pgmap v493: 158 pgs: 2 active+remapped+backfilling, 156 active+clean; 1.4 GiB data, 6.2 GiB used, 620 GiB / 626 GiB avail; 701 B/s rd, 0 B/s wr, 735 op/s; 2706/70359 objects misplaced (3.846%); 17 MiB/s, 279 objects/s recovering 2024-02-10T08:27:46.081 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:27:44.923388+0000 mon.b (mon.1) 63 : audit [INF] from='client.? 172.21.15.18:0/2882024421' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:27:46.081 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:27:44.930485+0000 mon.a (mon.0) 1223 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:27:46.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:44.792447+0000 mgr.y (mgr.14505) 416 : cluster [DBG] pgmap v493: 158 pgs: 2 active+remapped+backfilling, 156 active+clean; 1.4 GiB data, 6.2 GiB used, 620 GiB / 626 GiB avail; 701 B/s rd, 0 B/s wr, 735 op/s; 2706/70359 objects misplaced (3.846%); 17 MiB/s, 279 objects/s recovering 2024-02-10T08:27:46.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:27:44.923388+0000 mon.b (mon.1) 63 : audit [INF] from='client.? 172.21.15.18:0/2882024421' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:27:46.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:27:44.930485+0000 mon.a (mon.0) 1223 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:27:46.789 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:27:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:27:46] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:27:47.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:45.854492+0000 mon.a (mon.0) 1224 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:27:47.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:27:45.860701+0000 mon.a (mon.0) 1225 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-10T08:27:47.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:45.860770+0000 mon.a (mon.0) 1226 : cluster [DBG] osdmap e241: 8 total, 8 up, 7 in 2024-02-10T08:27:47.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:27:46.654329+0000 mon.a (mon.0) 1227 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:27:47.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:45.854492+0000 mon.a (mon.0) 1224 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:27:47.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:27:45.860701+0000 mon.a (mon.0) 1225 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-10T08:27:47.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:45.860770+0000 mon.a (mon.0) 1226 : cluster [DBG] osdmap e241: 8 total, 8 up, 7 in 2024-02-10T08:27:47.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:27:46.654329+0000 mon.a (mon.0) 1227 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:27:47.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:45.854492+0000 mon.a (mon.0) 1224 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:27:47.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:27:45.860701+0000 mon.a (mon.0) 1225 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-10T08:27:47.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:45.860770+0000 mon.a (mon.0) 1226 : cluster [DBG] osdmap e241: 8 total, 8 up, 7 in 2024-02-10T08:27:47.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:27:46.654329+0000 mon.a (mon.0) 1227 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:27:47.655 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:27:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:27:47] "GET /metrics HTTP/1.1" 200 176035 "" "Prometheus/2.33.4" 2024-02-10T08:27:48.002 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:27:48.003 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-02-10T08:27:48.003 INFO:teuthology.orchestra.run.smithi018.stdout: "epoch": 241, 2024-02-10T08:27:48.003 INFO:teuthology.orchestra.run.smithi018.stdout: "fsid": "d46257c8-c7eb-11ee-95b8-87774f69a715", 2024-02-10T08:27:48.003 INFO:teuthology.orchestra.run.smithi018.stdout: "created": "2024-02-10T08:10:57.425061+0000", 2024-02-10T08:27:48.003 INFO:teuthology.orchestra.run.smithi018.stdout: "modified": "2024-02-10T08:27:45.854231+0000", 2024-02-10T08:27:48.003 INFO:teuthology.orchestra.run.smithi018.stdout: "last_up_change": "2024-02-10T08:20:45.372678+0000", 2024-02-10T08:27:48.003 INFO:teuthology.orchestra.run.smithi018.stdout: "last_in_change": "2024-02-10T08:27:26.687243+0000", 2024-02-10T08:27:48.003 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": "noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-02-10T08:27:48.003 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_num": 5801984, 2024-02-10T08:27:48.003 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_set": [ 2024-02-10T08:27:48.003 INFO:teuthology.orchestra.run.smithi018.stdout: "noscrub", 2024-02-10T08:27:48.003 INFO:teuthology.orchestra.run.smithi018.stdout: "pglog_hardlimit", 2024-02-10T08:27:48.003 INFO:teuthology.orchestra.run.smithi018.stdout: "purged_snapdirs", 2024-02-10T08:27:48.004 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_deletes", 2024-02-10T08:27:48.004 INFO:teuthology.orchestra.run.smithi018.stdout: "sortbitwise" 2024-02-10T08:27:48.004 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-02-10T08:27:48.004 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_version": 19, 2024-02-10T08:27:48.004 INFO:teuthology.orchestra.run.smithi018.stdout: "full_ratio": 0.94999998807907104, 2024-02-10T08:27:48.004 INFO:teuthology.orchestra.run.smithi018.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-02-10T08:27:48.004 INFO:teuthology.orchestra.run.smithi018.stdout: "nearfull_ratio": 0.85000002384185791, 2024-02-10T08:27:48.004 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_snapshot": "", 2024-02-10T08:27:48.004 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_max": 8, 2024-02-10T08:27:48.004 INFO:teuthology.orchestra.run.smithi018.stdout: "max_osd": 8, 2024-02-10T08:27:48.004 INFO:teuthology.orchestra.run.smithi018.stdout: "require_min_compat_client": "luminous", 2024-02-10T08:27:48.004 INFO:teuthology.orchestra.run.smithi018.stdout: "min_compat_client": "luminous", 2024-02-10T08:27:48.004 INFO:teuthology.orchestra.run.smithi018.stdout: "require_osd_release": "pacific", 2024-02-10T08:27:48.005 INFO:teuthology.orchestra.run.smithi018.stdout: "pools": [ 2024-02-10T08:27:48.005 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:48.005 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 1, 2024-02-10T08:27:48.005 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "device_health_metrics", 2024-02-10T08:27:48.005 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-02-10T08:14:44.034966+0000", 2024-02-10T08:27:48.005 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-02-10T08:27:48.005 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-02-10T08:27:48.005 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-02-10T08:27:48.005 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 3, 2024-02-10T08:27:48.005 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 2, 2024-02-10T08:27:48.005 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-02-10T08:27:48.005 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-02-10T08:27:48.005 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-02-10T08:27:48.005 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-02-10T08:27:48.005 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-10T08:27:48.006 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-02-10T08:27:48.006 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-02-10T08:27:48.006 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 1, 2024-02-10T08:27:48.006 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 1, 2024-02-10T08:27:48.006 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 1, 2024-02-10T08:27:48.006 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 1, 2024-02-10T08:27:48.006 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 1, 2024-02-10T08:27:48.006 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-02-10T08:27:48.006 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-02-10T08:27:48.006 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-02-10T08:27:48.006 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-02-10T08:27:48.006 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-02-10T08:27:48.006 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-02-10T08:27:48.006 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-02-10T08:27:48.006 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:48.006 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "66", 2024-02-10T08:27:48.007 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-02-10T08:27:48.007 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-10T08:27:48.007 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-02-10T08:27:48.007 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-02-10T08:27:48.007 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-02-10T08:27:48.007 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-02-10T08:27:48.007 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-02-10T08:27:48.007 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-02-10T08:27:48.007 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-02-10T08:27:48.007 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-02-10T08:27:48.007 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-02-10T08:27:48.007 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-02-10T08:27:48.007 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-02-10T08:27:48.007 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-02-10T08:27:48.007 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-02-10T08:27:48.008 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-02-10T08:27:48.008 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-02-10T08:27:48.008 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-02-10T08:27:48.008 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-10T08:27:48.008 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-10T08:27:48.008 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-10T08:27:48.008 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-02-10T08:27:48.008 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-02-10T08:27:48.008 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-02-10T08:27:48.008 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-02-10T08:27:48.008 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-02-10T08:27:48.009 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:48.009 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-02-10T08:27:48.009 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-02-10T08:27:48.009 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-02-10T08:27:48.009 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-02-10T08:27:48.009 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-02-10T08:27:48.009 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-02-10T08:27:48.009 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-02-10T08:27:48.009 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-02-10T08:27:48.009 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-02-10T08:27:48.010 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-02-10T08:27:48.010 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-02-10T08:27:48.010 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-02-10T08:27:48.010 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_max": 32, 2024-02-10T08:27:48.010 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 1 2024-02-10T08:27:48.010 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:48.010 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-02-10T08:27:48.010 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_devicehealth": {} 2024-02-10T08:27:48.010 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:48.010 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:48.010 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:48.010 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 2, 2024-02-10T08:27:48.010 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": ".rgw.root", 2024-02-10T08:27:48.010 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-02-10T08:16:51.334631+0000", 2024-02-10T08:27:48.010 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-02-10T08:27:48.010 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-02-10T08:27:48.011 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-02-10T08:27:48.011 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 3, 2024-02-10T08:27:48.011 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 2, 2024-02-10T08:27:48.011 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-02-10T08:27:48.011 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-02-10T08:27:48.011 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-02-10T08:27:48.011 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-02-10T08:27:48.011 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-10T08:27:48.011 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-02-10T08:27:48.011 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-02-10T08:27:48.011 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 32, 2024-02-10T08:27:48.011 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 32, 2024-02-10T08:27:48.011 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 32, 2024-02-10T08:27:48.011 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 32, 2024-02-10T08:27:48.011 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 32, 2024-02-10T08:27:48.012 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-02-10T08:27:48.012 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-02-10T08:27:48.012 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-02-10T08:27:48.012 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-02-10T08:27:48.012 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-02-10T08:27:48.012 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-02-10T08:27:48.012 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-02-10T08:27:48.012 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:48.012 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "56", 2024-02-10T08:27:48.012 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-02-10T08:27:48.012 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-10T08:27:48.013 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-02-10T08:27:48.013 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-02-10T08:27:48.013 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-02-10T08:27:48.013 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-02-10T08:27:48.013 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-02-10T08:27:48.013 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-02-10T08:27:48.013 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-02-10T08:27:48.013 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-02-10T08:27:48.013 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-02-10T08:27:48.013 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-02-10T08:27:48.013 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-02-10T08:27:48.013 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-02-10T08:27:48.013 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-02-10T08:27:48.013 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-02-10T08:27:48.014 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-02-10T08:27:48.014 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-02-10T08:27:48.014 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-10T08:27:48.014 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-10T08:27:48.014 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-10T08:27:48.014 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-02-10T08:27:48.014 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-02-10T08:27:48.014 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-02-10T08:27:48.014 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-02-10T08:27:48.014 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-02-10T08:27:48.014 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:48.014 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-02-10T08:27:48.014 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-02-10T08:27:48.014 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-02-10T08:27:48.014 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-02-10T08:27:48.015 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-02-10T08:27:48.015 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-02-10T08:27:48.015 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-02-10T08:27:48.015 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-02-10T08:27:48.015 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-02-10T08:27:48.015 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-02-10T08:27:48.015 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-02-10T08:27:48.015 INFO:teuthology.orchestra.run.smithi018.stdout: "options": {}, 2024-02-10T08:27:48.015 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-02-10T08:27:48.015 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw": {} 2024-02-10T08:27:48.015 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:48.015 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:48.015 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:48.015 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 3, 2024-02-10T08:27:48.015 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "iscsi", 2024-02-10T08:27:48.015 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-02-10T08:16:51.762963+0000", 2024-02-10T08:27:48.016 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-02-10T08:27:48.016 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-02-10T08:27:48.016 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-02-10T08:27:48.016 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 3, 2024-02-10T08:27:48.016 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 2, 2024-02-10T08:27:48.016 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-02-10T08:27:48.016 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-02-10T08:27:48.016 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-02-10T08:27:48.016 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-02-10T08:27:48.016 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-10T08:27:48.016 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-02-10T08:27:48.016 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-02-10T08:27:48.016 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 3, 2024-02-10T08:27:48.016 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 3, 2024-02-10T08:27:48.017 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 3, 2024-02-10T08:27:48.017 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 3, 2024-02-10T08:27:48.017 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 3, 2024-02-10T08:27:48.017 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-02-10T08:27:48.017 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-02-10T08:27:48.017 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-02-10T08:27:48.017 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-02-10T08:27:48.017 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-02-10T08:27:48.017 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-02-10T08:27:48.017 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-02-10T08:27:48.017 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:48.017 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "57", 2024-02-10T08:27:48.017 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-02-10T08:27:48.017 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-10T08:27:48.017 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-02-10T08:27:48.018 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-02-10T08:27:48.018 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-02-10T08:27:48.018 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-02-10T08:27:48.018 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-02-10T08:27:48.018 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-02-10T08:27:48.018 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-02-10T08:27:48.018 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-02-10T08:27:48.018 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-02-10T08:27:48.018 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-02-10T08:27:48.018 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-02-10T08:27:48.018 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-02-10T08:27:48.018 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-02-10T08:27:48.019 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-02-10T08:27:48.019 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-02-10T08:27:48.019 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-02-10T08:27:48.019 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-10T08:27:48.019 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-10T08:27:48.019 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-10T08:27:48.019 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-02-10T08:27:48.019 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-02-10T08:27:48.019 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-02-10T08:27:48.019 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-02-10T08:27:48.019 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-02-10T08:27:48.019 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:48.019 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-02-10T08:27:48.019 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-02-10T08:27:48.020 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-02-10T08:27:48.020 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-02-10T08:27:48.020 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-02-10T08:27:48.020 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-02-10T08:27:48.020 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-02-10T08:27:48.020 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-02-10T08:27:48.020 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-02-10T08:27:48.020 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-02-10T08:27:48.020 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-02-10T08:27:48.020 INFO:teuthology.orchestra.run.smithi018.stdout: "options": {}, 2024-02-10T08:27:48.020 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-02-10T08:27:48.020 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd": {} 2024-02-10T08:27:48.020 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:48.020 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:48.021 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:48.021 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 4, 2024-02-10T08:27:48.021 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "default.rgw.log", 2024-02-10T08:27:48.021 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-02-10T08:16:53.258098+0000", 2024-02-10T08:27:48.021 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-02-10T08:27:48.021 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-02-10T08:27:48.021 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-02-10T08:27:48.021 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 3, 2024-02-10T08:27:48.021 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 2, 2024-02-10T08:27:48.021 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-02-10T08:27:48.021 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-02-10T08:27:48.021 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-02-10T08:27:48.021 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-02-10T08:27:48.021 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-10T08:27:48.022 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-02-10T08:27:48.022 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-02-10T08:27:48.022 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 32, 2024-02-10T08:27:48.022 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 32, 2024-02-10T08:27:48.022 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 32, 2024-02-10T08:27:48.022 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 32, 2024-02-10T08:27:48.022 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 32, 2024-02-10T08:27:48.022 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-02-10T08:27:48.022 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-02-10T08:27:48.022 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-02-10T08:27:48.022 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-02-10T08:27:48.022 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-02-10T08:27:48.022 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-02-10T08:27:48.022 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-02-10T08:27:48.022 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:48.022 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "205", 2024-02-10T08:27:48.023 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-02-10T08:27:48.023 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-10T08:27:48.023 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-02-10T08:27:48.023 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-02-10T08:27:48.023 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-02-10T08:27:48.023 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-02-10T08:27:48.023 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-02-10T08:27:48.023 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-02-10T08:27:48.023 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-02-10T08:27:48.023 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-02-10T08:27:48.023 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-02-10T08:27:48.023 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-02-10T08:27:48.023 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-02-10T08:27:48.023 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-02-10T08:27:48.024 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-02-10T08:27:48.024 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-02-10T08:27:48.024 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-02-10T08:27:48.024 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-02-10T08:27:48.024 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-10T08:27:48.024 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-10T08:27:48.024 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-10T08:27:48.024 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-02-10T08:27:48.024 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-02-10T08:27:48.024 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-02-10T08:27:48.024 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-02-10T08:27:48.024 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-02-10T08:27:48.024 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:48.024 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-02-10T08:27:48.025 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-02-10T08:27:48.025 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-02-10T08:27:48.025 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-02-10T08:27:48.025 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-02-10T08:27:48.025 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-02-10T08:27:48.025 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-02-10T08:27:48.025 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-02-10T08:27:48.025 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-02-10T08:27:48.025 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-02-10T08:27:48.025 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-02-10T08:27:48.025 INFO:teuthology.orchestra.run.smithi018.stdout: "options": {}, 2024-02-10T08:27:48.025 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-02-10T08:27:48.025 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw": {} 2024-02-10T08:27:48.025 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:48.025 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:48.026 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:48.026 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 5, 2024-02-10T08:27:48.026 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "default.rgw.control", 2024-02-10T08:27:48.026 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-02-10T08:16:55.289300+0000", 2024-02-10T08:27:48.026 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-02-10T08:27:48.026 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-02-10T08:27:48.026 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-02-10T08:27:48.026 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 3, 2024-02-10T08:27:48.026 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 2, 2024-02-10T08:27:48.026 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-02-10T08:27:48.026 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-02-10T08:27:48.026 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-02-10T08:27:48.026 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-02-10T08:27:48.026 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-10T08:27:48.027 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-02-10T08:27:48.027 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-02-10T08:27:48.027 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 32, 2024-02-10T08:27:48.027 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 32, 2024-02-10T08:27:48.027 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 32, 2024-02-10T08:27:48.027 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 32, 2024-02-10T08:27:48.027 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 32, 2024-02-10T08:27:48.027 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-02-10T08:27:48.027 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-02-10T08:27:48.027 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-02-10T08:27:48.027 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-02-10T08:27:48.027 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-02-10T08:27:48.027 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-02-10T08:27:48.027 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-02-10T08:27:48.027 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:48.027 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "60", 2024-02-10T08:27:48.028 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-02-10T08:27:48.028 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-10T08:27:48.028 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-02-10T08:27:48.028 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-02-10T08:27:48.028 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-02-10T08:27:48.028 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-02-10T08:27:48.028 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-02-10T08:27:48.028 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-02-10T08:27:48.028 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-02-10T08:27:48.028 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-02-10T08:27:48.028 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-02-10T08:27:48.028 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-02-10T08:27:48.029 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-02-10T08:27:48.029 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-02-10T08:27:48.029 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-02-10T08:27:48.029 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-02-10T08:27:48.029 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-02-10T08:27:48.029 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-02-10T08:27:48.029 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-10T08:27:48.029 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-10T08:27:48.029 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-10T08:27:48.029 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-02-10T08:27:48.029 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-02-10T08:27:48.029 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-02-10T08:27:48.029 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-02-10T08:27:48.029 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-02-10T08:27:48.030 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:48.030 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-02-10T08:27:48.030 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-02-10T08:27:48.030 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-02-10T08:27:48.030 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-02-10T08:27:48.030 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-02-10T08:27:48.030 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-02-10T08:27:48.030 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-02-10T08:27:48.030 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-02-10T08:27:48.030 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-02-10T08:27:48.030 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-02-10T08:27:48.030 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-02-10T08:27:48.030 INFO:teuthology.orchestra.run.smithi018.stdout: "options": {}, 2024-02-10T08:27:48.030 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-02-10T08:27:48.030 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw": {} 2024-02-10T08:27:48.030 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:48.030 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:48.031 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:48.031 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 6, 2024-02-10T08:27:48.031 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "default.rgw.meta", 2024-02-10T08:27:48.031 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-02-10T08:16:57.354868+0000", 2024-02-10T08:27:48.031 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-02-10T08:27:48.031 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-02-10T08:27:48.031 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-02-10T08:27:48.031 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 3, 2024-02-10T08:27:48.031 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 2, 2024-02-10T08:27:48.031 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-02-10T08:27:48.031 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-02-10T08:27:48.031 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-02-10T08:27:48.032 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-02-10T08:27:48.032 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-10T08:27:48.032 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-02-10T08:27:48.032 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-02-10T08:27:48.032 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 42, 2024-02-10T08:27:48.032 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 42, 2024-02-10T08:27:48.032 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 42, 2024-02-10T08:27:48.032 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 42, 2024-02-10T08:27:48.032 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 42, 2024-02-10T08:27:48.032 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-02-10T08:27:48.032 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-02-10T08:27:48.032 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-02-10T08:27:48.032 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-02-10T08:27:48.033 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-02-10T08:27:48.033 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-02-10T08:27:48.033 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-02-10T08:27:48.033 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:48.033 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "210", 2024-02-10T08:27:48.033 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-02-10T08:27:48.033 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-10T08:27:48.033 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "131", 2024-02-10T08:27:48.033 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-02-10T08:27:48.033 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-02-10T08:27:48.033 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-02-10T08:27:48.033 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-02-10T08:27:48.033 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-02-10T08:27:48.033 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-02-10T08:27:48.033 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-02-10T08:27:48.033 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-02-10T08:27:48.034 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-02-10T08:27:48.034 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-02-10T08:27:48.034 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-02-10T08:27:48.034 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-02-10T08:27:48.034 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-02-10T08:27:48.034 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-02-10T08:27:48.034 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-02-10T08:27:48.034 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-10T08:27:48.034 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-10T08:27:48.034 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-10T08:27:48.034 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-02-10T08:27:48.034 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-02-10T08:27:48.034 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-02-10T08:27:48.034 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-02-10T08:27:48.034 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-02-10T08:27:48.035 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:48.035 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-02-10T08:27:48.035 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-02-10T08:27:48.035 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-02-10T08:27:48.035 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-02-10T08:27:48.035 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-02-10T08:27:48.035 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-02-10T08:27:48.035 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-02-10T08:27:48.035 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-02-10T08:27:48.035 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-02-10T08:27:48.035 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-02-10T08:27:48.035 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-02-10T08:27:48.035 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-02-10T08:27:48.035 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_bias": 4 2024-02-10T08:27:48.035 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:48.036 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-02-10T08:27:48.036 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw": {} 2024-02-10T08:27:48.036 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:48.036 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:48.036 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:48.036 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 8, 2024-02-10T08:27:48.036 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "unique_pool_1", 2024-02-10T08:27:48.036 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-02-10T08:24:20.523338+0000", 2024-02-10T08:27:48.036 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-02-10T08:27:48.036 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-02-10T08:27:48.036 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-02-10T08:27:48.036 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 3, 2024-02-10T08:27:48.036 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 2, 2024-02-10T08:27:48.036 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-02-10T08:27:48.036 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-02-10T08:27:48.037 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-02-10T08:27:48.037 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-02-10T08:27:48.037 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-10T08:27:48.037 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-02-10T08:27:48.037 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-02-10T08:27:48.037 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 16, 2024-02-10T08:27:48.037 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 16, 2024-02-10T08:27:48.037 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 16, 2024-02-10T08:27:48.037 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 16, 2024-02-10T08:27:48.037 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 16, 2024-02-10T08:27:48.037 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-02-10T08:27:48.037 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-02-10T08:27:48.037 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-02-10T08:27:48.037 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-02-10T08:27:48.037 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-02-10T08:27:48.037 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-02-10T08:27:48.038 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-02-10T08:27:48.038 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:48.038 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "196", 2024-02-10T08:27:48.038 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-02-10T08:27:48.038 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-10T08:27:48.038 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-02-10T08:27:48.038 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-02-10T08:27:48.038 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-02-10T08:27:48.038 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-02-10T08:27:48.038 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-02-10T08:27:48.038 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-02-10T08:27:48.038 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-02-10T08:27:48.039 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-02-10T08:27:48.039 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-02-10T08:27:48.039 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-02-10T08:27:48.039 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-02-10T08:27:48.039 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-02-10T08:27:48.039 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-02-10T08:27:48.039 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-02-10T08:27:48.039 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-02-10T08:27:48.039 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-02-10T08:27:48.039 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-10T08:27:48.039 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-10T08:27:48.039 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-10T08:27:48.040 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-02-10T08:27:48.040 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-02-10T08:27:48.040 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-02-10T08:27:48.040 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-02-10T08:27:48.040 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-02-10T08:27:48.040 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:48.040 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-02-10T08:27:48.040 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-02-10T08:27:48.040 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-02-10T08:27:48.040 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-02-10T08:27:48.040 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-02-10T08:27:48.040 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-02-10T08:27:48.040 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-02-10T08:27:48.040 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-02-10T08:27:48.040 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-02-10T08:27:48.041 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-02-10T08:27:48.041 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-02-10T08:27:48.041 INFO:teuthology.orchestra.run.smithi018.stdout: "options": {}, 2024-02-10T08:27:48.041 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-02-10T08:27:48.041 INFO:teuthology.orchestra.run.smithi018.stdout: "rados": {} 2024-02-10T08:27:48.041 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:48.041 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:48.041 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-02-10T08:27:48.041 INFO:teuthology.orchestra.run.smithi018.stdout: "osds": [ 2024-02-10T08:27:48.041 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:48.041 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-02-10T08:27:48.041 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "f9043fee-a3ed-4e16-921d-bb86756d0c48", 2024-02-10T08:27:48.041 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-02-10T08:27:48.041 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 0, 2024-02-10T08:27:48.041 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 0, 2024-02-10T08:27:48.041 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 0.1252288818359375, 2024-02-10T08:27:48.041 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-02-10T08:27:48.042 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-02-10T08:27:48.042 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 8, 2024-02-10T08:27:48.042 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 191, 2024-02-10T08:27:48.042 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-02-10T08:27:48.042 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-02-10T08:27:48.042 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-02-10T08:27:48.042 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:27:48.042 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:48.042 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:27:48.042 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6801", 2024-02-10T08:27:48.042 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 276034406 2024-02-10T08:27:48.042 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:48.042 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:27:48.042 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:48.042 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-02-10T08:27:48.042 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:27:48.043 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:48.043 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:27:48.043 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6802", 2024-02-10T08:27:48.043 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 276034406 2024-02-10T08:27:48.043 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:48.043 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:27:48.043 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:48.043 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-02-10T08:27:48.043 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:27:48.043 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:48.043 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:27:48.043 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6804", 2024-02-10T08:27:48.043 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 276034406 2024-02-10T08:27:48.043 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:48.043 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:27:48.043 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:48.043 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-02-10T08:27:48.044 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:27:48.044 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:48.044 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:27:48.044 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6803", 2024-02-10T08:27:48.044 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 276034406 2024-02-10T08:27:48.044 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:48.044 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:27:48.044 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:48.044 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6801/276034406", 2024-02-10T08:27:48.044 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6802/276034406", 2024-02-10T08:27:48.044 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6804/276034406", 2024-02-10T08:27:48.044 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6803/276034406", 2024-02-10T08:27:48.045 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-02-10T08:27:48.045 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-02-10T08:27:48.045 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-02-10T08:27:48.045 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:27:48.045 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:48.045 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:48.045 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-02-10T08:27:48.045 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "ff958272-ce6b-4162-959a-6da9729e537b", 2024-02-10T08:27:48.045 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-02-10T08:27:48.045 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-02-10T08:27:48.045 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-02-10T08:27:48.045 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-02-10T08:27:48.045 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-02-10T08:27:48.045 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-02-10T08:27:48.045 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-02-10T08:27:48.046 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 233, 2024-02-10T08:27:48.046 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-02-10T08:27:48.046 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-02-10T08:27:48.046 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-02-10T08:27:48.046 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:27:48.046 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:48.046 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:27:48.046 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6805", 2024-02-10T08:27:48.046 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1941014296 2024-02-10T08:27:48.046 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:48.046 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:27:48.046 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:48.046 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-02-10T08:27:48.046 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:27:48.046 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:48.047 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:27:48.047 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6806", 2024-02-10T08:27:48.047 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1941014296 2024-02-10T08:27:48.047 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:48.047 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:27:48.047 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:48.047 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-02-10T08:27:48.047 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:27:48.047 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:48.047 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:27:48.047 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6808", 2024-02-10T08:27:48.047 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1941014296 2024-02-10T08:27:48.047 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:48.047 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:27:48.047 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:48.047 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-02-10T08:27:48.048 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:27:48.048 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:48.048 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:27:48.048 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6807", 2024-02-10T08:27:48.048 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1941014296 2024-02-10T08:27:48.048 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:48.048 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:27:48.048 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:48.048 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6805/1941014296", 2024-02-10T08:27:48.048 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6806/1941014296", 2024-02-10T08:27:48.048 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6808/1941014296", 2024-02-10T08:27:48.049 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6807/1941014296", 2024-02-10T08:27:48.049 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-02-10T08:27:48.049 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-02-10T08:27:48.049 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-02-10T08:27:48.049 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:27:48.049 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:48.049 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:48.049 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-02-10T08:27:48.049 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "29bb47e2-5c81-4ae8-bb9f-d1b02ea01d3f", 2024-02-10T08:27:48.049 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-02-10T08:27:48.049 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-02-10T08:27:48.050 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-02-10T08:27:48.050 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-02-10T08:27:48.050 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-02-10T08:27:48.050 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-02-10T08:27:48.050 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 18, 2024-02-10T08:27:48.050 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 239, 2024-02-10T08:27:48.050 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-02-10T08:27:48.050 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-02-10T08:27:48.050 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-02-10T08:27:48.050 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:27:48.050 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:48.050 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:27:48.050 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6809", 2024-02-10T08:27:48.050 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3122474567 2024-02-10T08:27:48.051 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:48.051 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:27:48.051 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:48.051 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-02-10T08:27:48.051 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:27:48.051 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:48.051 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:27:48.051 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6810", 2024-02-10T08:27:48.051 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3122474567 2024-02-10T08:27:48.051 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:48.051 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:27:48.051 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:48.051 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-02-10T08:27:48.051 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:27:48.051 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:48.051 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:27:48.051 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6812", 2024-02-10T08:27:48.052 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3122474567 2024-02-10T08:27:48.052 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:48.052 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:27:48.052 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:48.052 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-02-10T08:27:48.052 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:27:48.052 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:48.052 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:27:48.052 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6811", 2024-02-10T08:27:48.052 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3122474567 2024-02-10T08:27:48.052 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:48.052 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:27:48.052 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:48.052 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6809/3122474567", 2024-02-10T08:27:48.052 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6810/3122474567", 2024-02-10T08:27:48.053 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6812/3122474567", 2024-02-10T08:27:48.053 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6811/3122474567", 2024-02-10T08:27:48.053 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-02-10T08:27:48.053 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-02-10T08:27:48.053 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-02-10T08:27:48.053 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:27:48.053 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:48.053 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:48.053 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-02-10T08:27:48.053 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "87ad37de-5f49-4e5b-9683-3bb9c3e33907", 2024-02-10T08:27:48.053 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-02-10T08:27:48.053 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-02-10T08:27:48.053 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 0.51214599609375, 2024-02-10T08:27:48.053 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 0, 2024-02-10T08:27:48.053 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-02-10T08:27:48.054 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-02-10T08:27:48.054 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 25, 2024-02-10T08:27:48.054 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 175, 2024-02-10T08:27:48.054 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-02-10T08:27:48.054 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-02-10T08:27:48.054 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-02-10T08:27:48.054 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:27:48.054 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:48.054 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:27:48.054 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6813", 2024-02-10T08:27:48.054 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3484706437 2024-02-10T08:27:48.054 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:48.054 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:27:48.054 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:48.054 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-02-10T08:27:48.055 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:27:48.055 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:48.055 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:27:48.055 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6814", 2024-02-10T08:27:48.055 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3484706437 2024-02-10T08:27:48.055 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:48.055 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:27:48.055 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:48.055 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-02-10T08:27:48.055 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:27:48.055 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:48.055 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:27:48.055 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6816", 2024-02-10T08:27:48.055 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3484706437 2024-02-10T08:27:48.055 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:48.055 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:27:48.056 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:48.056 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-02-10T08:27:48.056 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:27:48.056 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:48.056 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:27:48.056 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6815", 2024-02-10T08:27:48.056 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3484706437 2024-02-10T08:27:48.056 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:48.056 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:27:48.056 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:48.056 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6813/3484706437", 2024-02-10T08:27:48.056 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6814/3484706437", 2024-02-10T08:27:48.056 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6816/3484706437", 2024-02-10T08:27:48.056 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6815/3484706437", 2024-02-10T08:27:48.056 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-02-10T08:27:48.057 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-02-10T08:27:48.057 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-02-10T08:27:48.057 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:27:48.057 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:48.057 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:48.057 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-02-10T08:27:48.057 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "f5708f20-f98d-4d12-b8ae-71a5049a14cc", 2024-02-10T08:27:48.057 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-02-10T08:27:48.057 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-02-10T08:27:48.057 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-02-10T08:27:48.057 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-02-10T08:27:48.057 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 30, 2024-02-10T08:27:48.057 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 87, 2024-02-10T08:27:48.057 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 110, 2024-02-10T08:27:48.057 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 238, 2024-02-10T08:27:48.057 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 88, 2024-02-10T08:27:48.058 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-02-10T08:27:48.058 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-02-10T08:27:48.058 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:27:48.058 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:48.058 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:27:48.058 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6800", 2024-02-10T08:27:48.058 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3888817642 2024-02-10T08:27:48.058 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:48.058 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:27:48.058 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:48.058 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-02-10T08:27:48.058 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:27:48.058 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:48.058 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:27:48.059 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6801", 2024-02-10T08:27:48.059 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3888817642 2024-02-10T08:27:48.059 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:48.059 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:27:48.059 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:48.059 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-02-10T08:27:48.059 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:27:48.059 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:48.059 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:27:48.059 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6803", 2024-02-10T08:27:48.059 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3888817642 2024-02-10T08:27:48.059 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:48.059 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:27:48.059 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:48.059 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-02-10T08:27:48.060 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:27:48.060 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:48.060 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:27:48.060 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6802", 2024-02-10T08:27:48.060 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3888817642 2024-02-10T08:27:48.060 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:48.060 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:27:48.060 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:48.060 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.71:6800/3888817642", 2024-02-10T08:27:48.060 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.71:6801/3888817642", 2024-02-10T08:27:48.060 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.71:6803/3888817642", 2024-02-10T08:27:48.060 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.71:6802/3888817642", 2024-02-10T08:27:48.060 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-02-10T08:27:48.060 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-02-10T08:27:48.060 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-02-10T08:27:48.061 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:27:48.061 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:48.061 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:48.061 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-02-10T08:27:48.061 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "e36a71dd-5088-4bff-965e-7dc8708ef7e3", 2024-02-10T08:27:48.061 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-02-10T08:27:48.061 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-02-10T08:27:48.061 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-02-10T08:27:48.061 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-02-10T08:27:48.061 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-02-10T08:27:48.061 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-02-10T08:27:48.061 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 37, 2024-02-10T08:27:48.061 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 232, 2024-02-10T08:27:48.061 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-02-10T08:27:48.061 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-02-10T08:27:48.062 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-02-10T08:27:48.062 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:27:48.062 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:48.062 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:27:48.062 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6804", 2024-02-10T08:27:48.062 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1932648316 2024-02-10T08:27:48.062 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:48.062 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:27:48.062 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:48.062 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-02-10T08:27:48.062 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:27:48.062 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:48.062 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:27:48.062 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6805", 2024-02-10T08:27:48.062 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1932648316 2024-02-10T08:27:48.062 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:48.063 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:27:48.063 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:48.063 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-02-10T08:27:48.063 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:27:48.063 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:48.063 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:27:48.063 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6807", 2024-02-10T08:27:48.063 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1932648316 2024-02-10T08:27:48.063 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:48.063 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:27:48.063 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:48.063 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-02-10T08:27:48.063 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:27:48.063 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:48.063 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:27:48.063 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6806", 2024-02-10T08:27:48.064 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1932648316 2024-02-10T08:27:48.064 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:48.064 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:27:48.064 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:48.064 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.71:6804/1932648316", 2024-02-10T08:27:48.064 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.71:6805/1932648316", 2024-02-10T08:27:48.064 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.71:6807/1932648316", 2024-02-10T08:27:48.064 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.71:6806/1932648316", 2024-02-10T08:27:48.064 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-02-10T08:27:48.064 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-02-10T08:27:48.064 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-02-10T08:27:48.064 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:27:48.064 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:48.064 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:48.065 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-02-10T08:27:48.065 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "210a8790-78b6-4efa-a969-17efb17e9c0b", 2024-02-10T08:27:48.065 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-02-10T08:27:48.065 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-02-10T08:27:48.065 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-02-10T08:27:48.065 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-02-10T08:27:48.065 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-02-10T08:27:48.065 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-02-10T08:27:48.065 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 43, 2024-02-10T08:27:48.065 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 233, 2024-02-10T08:27:48.065 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-02-10T08:27:48.065 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-02-10T08:27:48.065 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-02-10T08:27:48.065 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:27:48.065 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:48.065 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:27:48.066 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6808", 2024-02-10T08:27:48.066 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3724399458 2024-02-10T08:27:48.066 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:48.066 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:27:48.066 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:48.066 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-02-10T08:27:48.066 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:27:48.066 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:48.066 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:27:48.066 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6809", 2024-02-10T08:27:48.066 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3724399458 2024-02-10T08:27:48.066 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:48.066 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:27:48.066 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:48.066 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-02-10T08:27:48.066 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:27:48.067 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:48.067 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:27:48.067 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6811", 2024-02-10T08:27:48.067 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3724399458 2024-02-10T08:27:48.067 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:48.067 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:27:48.067 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:48.067 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-02-10T08:27:48.067 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:27:48.067 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:48.067 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:27:48.067 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6810", 2024-02-10T08:27:48.067 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3724399458 2024-02-10T08:27:48.067 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:48.068 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:27:48.068 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:48.068 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.71:6808/3724399458", 2024-02-10T08:27:48.068 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.71:6809/3724399458", 2024-02-10T08:27:48.068 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.71:6811/3724399458", 2024-02-10T08:27:48.068 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.71:6810/3724399458", 2024-02-10T08:27:48.068 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-02-10T08:27:48.068 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-02-10T08:27:48.068 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-02-10T08:27:48.068 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:27:48.068 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:48.068 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:48.068 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-02-10T08:27:48.069 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "9778a0e9-2ff3-4700-bf2a-675edaba630b", 2024-02-10T08:27:48.069 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-02-10T08:27:48.069 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-02-10T08:27:48.069 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-02-10T08:27:48.069 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-02-10T08:27:48.069 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-02-10T08:27:48.069 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-02-10T08:27:48.069 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 50, 2024-02-10T08:27:48.069 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 232, 2024-02-10T08:27:48.069 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-02-10T08:27:48.069 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-02-10T08:27:48.069 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-02-10T08:27:48.069 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:27:48.069 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:48.070 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:27:48.070 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6812", 2024-02-10T08:27:48.070 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 163573852 2024-02-10T08:27:48.070 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:48.070 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:27:48.070 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:48.070 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-02-10T08:27:48.070 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:27:48.070 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:48.070 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:27:48.070 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6813", 2024-02-10T08:27:48.070 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 163573852 2024-02-10T08:27:48.070 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:48.070 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:27:48.070 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:48.070 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-02-10T08:27:48.070 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:27:48.071 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:48.071 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:27:48.071 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6815", 2024-02-10T08:27:48.071 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 163573852 2024-02-10T08:27:48.071 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:48.071 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:27:48.071 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:48.071 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-02-10T08:27:48.071 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:27:48.071 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:48.071 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:27:48.071 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6814", 2024-02-10T08:27:48.072 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 163573852 2024-02-10T08:27:48.072 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:48.072 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:27:48.072 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:48.072 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.71:6812/163573852", 2024-02-10T08:27:48.072 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.71:6813/163573852", 2024-02-10T08:27:48.072 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.71:6815/163573852", 2024-02-10T08:27:48.072 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.71:6814/163573852", 2024-02-10T08:27:48.072 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-02-10T08:27:48.072 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-02-10T08:27:48.072 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-02-10T08:27:48.072 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:27:48.072 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:48.072 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-02-10T08:27:48.072 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_xinfo": [ 2024-02-10T08:27:48.072 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:48.073 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-02-10T08:27:48.073 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-02-10T08:27:48.073 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-02-10T08:27:48.073 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-02-10T08:27:48.073 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540138314316775423, 2024-02-10T08:27:48.073 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 41659, 2024-02-10T08:27:48.073 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-02-10T08:27:18.262799+0000", 2024-02-10T08:27:48.073 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-02-10T08:27:48.073 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:48.073 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:48.073 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-02-10T08:27:48.073 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-02-10T08:27:48.073 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-02-10T08:27:48.073 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-02-10T08:27:48.073 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540138314316775423, 2024-02-10T08:27:48.073 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-02-10T08:27:48.074 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-02-10T08:27:02.579226+0000", 2024-02-10T08:27:48.074 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-02-10T08:27:48.074 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:48.074 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:48.074 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-02-10T08:27:48.074 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-02-10T08:27:48.074 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-02-10T08:27:48.074 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-02-10T08:27:48.074 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540138314316775423, 2024-02-10T08:27:48.074 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-02-10T08:27:48.074 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-02-10T08:27:38.544826+0000", 2024-02-10T08:27:48.074 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-02-10T08:27:48.074 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:48.074 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:48.075 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-02-10T08:27:48.075 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-02-10T08:27:48.075 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-02-10T08:27:48.075 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-02-10T08:27:48.075 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540138314316775423, 2024-02-10T08:27:48.075 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-02-10T08:27:48.075 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-02-10T08:27:24.861119+0000", 2024-02-10T08:27:48.075 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-02-10T08:27:48.075 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:48.075 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:48.075 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-02-10T08:27:48.075 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-02-10T08:27:48.075 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-02-10T08:27:48.075 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-02-10T08:27:48.075 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540138314316775423, 2024-02-10T08:27:48.075 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-02-10T08:27:48.076 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-02-10T08:27:31.798487+0000", 2024-02-10T08:27:48.076 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 87 2024-02-10T08:27:48.076 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:48.076 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:48.076 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-02-10T08:27:48.076 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-02-10T08:27:48.076 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-02-10T08:27:48.076 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-02-10T08:27:48.076 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540138314316775423, 2024-02-10T08:27:48.076 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-02-10T08:27:48.076 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-02-10T08:27:11.715062+0000", 2024-02-10T08:27:48.076 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-02-10T08:27:48.076 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:48.076 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:48.076 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-02-10T08:27:48.076 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-02-10T08:27:48.077 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-02-10T08:27:48.077 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-02-10T08:27:48.077 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540138314316775423, 2024-02-10T08:27:48.077 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-02-10T08:27:48.077 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-02-10T08:27:42.023943+0000", 2024-02-10T08:27:48.077 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-02-10T08:27:48.077 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:48.077 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:48.077 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-02-10T08:27:48.077 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-02-10T08:27:48.077 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-02-10T08:27:48.077 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-02-10T08:27:48.077 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540138314316775423, 2024-02-10T08:27:48.077 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-02-10T08:27:48.077 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-02-10T08:27:09.975660+0000", 2024-02-10T08:27:48.078 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-02-10T08:27:48.078 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:48.078 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-02-10T08:27:48.078 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap": [], 2024-02-10T08:27:48.078 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_items": [ 2024-02-10T08:27:48.078 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:48.078 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "2.5", 2024-02-10T08:27:48.078 INFO:teuthology.orchestra.run.smithi018.stdout: "mappings": [ 2024-02-10T08:27:48.078 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:48.078 INFO:teuthology.orchestra.run.smithi018.stdout: "from": 7, 2024-02-10T08:27:48.078 INFO:teuthology.orchestra.run.smithi018.stdout: "to": 2 2024-02-10T08:27:48.078 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:48.078 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:27:48.078 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:48.078 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:48.079 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "4.7", 2024-02-10T08:27:48.079 INFO:teuthology.orchestra.run.smithi018.stdout: "mappings": [ 2024-02-10T08:27:48.079 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:48.079 INFO:teuthology.orchestra.run.smithi018.stdout: "from": 1, 2024-02-10T08:27:48.079 INFO:teuthology.orchestra.run.smithi018.stdout: "to": 7 2024-02-10T08:27:48.079 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:48.079 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:27:48.079 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:48.079 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:48.079 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "4.d", 2024-02-10T08:27:48.079 INFO:teuthology.orchestra.run.smithi018.stdout: "mappings": [ 2024-02-10T08:27:48.079 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:48.079 INFO:teuthology.orchestra.run.smithi018.stdout: "from": 1, 2024-02-10T08:27:48.079 INFO:teuthology.orchestra.run.smithi018.stdout: "to": 5 2024-02-10T08:27:48.079 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:48.080 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:27:48.080 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:48.080 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:48.080 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "4.f", 2024-02-10T08:27:48.080 INFO:teuthology.orchestra.run.smithi018.stdout: "mappings": [ 2024-02-10T08:27:48.080 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:48.080 INFO:teuthology.orchestra.run.smithi018.stdout: "from": 1, 2024-02-10T08:27:48.080 INFO:teuthology.orchestra.run.smithi018.stdout: "to": 2 2024-02-10T08:27:48.080 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:48.080 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:27:48.080 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:48.080 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:48.080 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "4.13", 2024-02-10T08:27:48.080 INFO:teuthology.orchestra.run.smithi018.stdout: "mappings": [ 2024-02-10T08:27:48.080 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:48.080 INFO:teuthology.orchestra.run.smithi018.stdout: "from": 1, 2024-02-10T08:27:48.081 INFO:teuthology.orchestra.run.smithi018.stdout: "to": 2 2024-02-10T08:27:48.081 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:48.081 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:27:48.081 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:48.081 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:48.081 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "6.8", 2024-02-10T08:27:48.081 INFO:teuthology.orchestra.run.smithi018.stdout: "mappings": [ 2024-02-10T08:27:48.081 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:48.081 INFO:teuthology.orchestra.run.smithi018.stdout: "from": 2, 2024-02-10T08:27:48.081 INFO:teuthology.orchestra.run.smithi018.stdout: "to": 4 2024-02-10T08:27:48.081 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:48.081 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:27:48.081 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:48.081 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-02-10T08:27:48.081 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_temp": [ 2024-02-10T08:27:48.081 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:48.081 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "8.1", 2024-02-10T08:27:48.082 INFO:teuthology.orchestra.run.smithi018.stdout: "osds": [ 2024-02-10T08:27:48.082 INFO:teuthology.orchestra.run.smithi018.stdout: 1, 2024-02-10T08:27:48.082 INFO:teuthology.orchestra.run.smithi018.stdout: 2, 2024-02-10T08:27:48.082 INFO:teuthology.orchestra.run.smithi018.stdout: 0 2024-02-10T08:27:48.082 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:27:48.082 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:48.082 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:48.082 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "8.6", 2024-02-10T08:27:48.082 INFO:teuthology.orchestra.run.smithi018.stdout: "osds": [ 2024-02-10T08:27:48.082 INFO:teuthology.orchestra.run.smithi018.stdout: 6, 2024-02-10T08:27:48.082 INFO:teuthology.orchestra.run.smithi018.stdout: 7, 2024-02-10T08:27:48.082 INFO:teuthology.orchestra.run.smithi018.stdout: 0 2024-02-10T08:27:48.082 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:27:48.082 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:48.082 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-02-10T08:27:48.082 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_temp": [], 2024-02-10T08:27:48.083 INFO:teuthology.orchestra.run.smithi018.stdout: "blocklist": { 2024-02-10T08:27:48.083 INFO:teuthology.orchestra.run.smithi018.stdout: "172.21.15.18:6800/542054629": "2024-02-11T08:17:16.433947+0000", 2024-02-10T08:27:48.083 INFO:teuthology.orchestra.run.smithi018.stdout: "172.21.15.18:0/491217791": "2024-02-11T08:17:16.433947+0000", 2024-02-10T08:27:48.083 INFO:teuthology.orchestra.run.smithi018.stdout: "172.21.15.18:0/781076548": "2024-02-11T08:17:16.433947+0000", 2024-02-10T08:27:48.083 INFO:teuthology.orchestra.run.smithi018.stdout: "172.21.15.18:0/957318754": "2024-02-11T08:17:16.433947+0000", 2024-02-10T08:27:48.083 INFO:teuthology.orchestra.run.smithi018.stdout: "172.21.15.18:0/2662732452": "2024-02-11T08:11:55.105124+0000", 2024-02-10T08:27:48.083 INFO:teuthology.orchestra.run.smithi018.stdout: "172.21.15.18:0/1407788916": "2024-02-11T08:11:55.105124+0000", 2024-02-10T08:27:48.083 INFO:teuthology.orchestra.run.smithi018.stdout: "172.21.15.18:6800/3798687064": "2024-02-11T08:11:55.105124+0000", 2024-02-10T08:27:48.083 INFO:teuthology.orchestra.run.smithi018.stdout: "172.21.15.18:6800/3570839557": "2024-02-11T08:11:31.445897+0000", 2024-02-10T08:27:48.083 INFO:teuthology.orchestra.run.smithi018.stdout: "172.21.15.18:0/541168116": "2024-02-11T08:11:31.445897+0000", 2024-02-10T08:27:48.083 INFO:teuthology.orchestra.run.smithi018.stdout: "172.21.15.18:0/806236095": "2024-02-11T08:11:31.445897+0000" 2024-02-10T08:27:48.083 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:48.083 INFO:teuthology.orchestra.run.smithi018.stdout: "range_blocklist": {}, 2024-02-10T08:27:48.083 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profiles": { 2024-02-10T08:27:48.083 INFO:teuthology.orchestra.run.smithi018.stdout: "default": { 2024-02-10T08:27:48.083 INFO:teuthology.orchestra.run.smithi018.stdout: "crush-failure-domain": "osd", 2024-02-10T08:27:48.084 INFO:teuthology.orchestra.run.smithi018.stdout: "k": "2", 2024-02-10T08:27:48.084 INFO:teuthology.orchestra.run.smithi018.stdout: "m": "1", 2024-02-10T08:27:48.084 INFO:teuthology.orchestra.run.smithi018.stdout: "plugin": "jerasure", 2024-02-10T08:27:48.084 INFO:teuthology.orchestra.run.smithi018.stdout: "ruleset-failure-domain": "osd", 2024-02-10T08:27:48.084 INFO:teuthology.orchestra.run.smithi018.stdout: "technique": "reed_sol_van" 2024-02-10T08:27:48.084 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:48.084 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:48.084 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps_queue": [], 2024-02-10T08:27:48.084 INFO:teuthology.orchestra.run.smithi018.stdout: "new_removed_snaps": [], 2024-02-10T08:27:48.084 INFO:teuthology.orchestra.run.smithi018.stdout: "new_purged_snaps": [], 2024-02-10T08:27:48.084 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_node_flags": {}, 2024-02-10T08:27:48.084 INFO:teuthology.orchestra.run.smithi018.stdout: "device_class_flags": {}, 2024-02-10T08:27:48.084 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode": { 2024-02-10T08:27:48.084 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_enabled": false, 2024-02-10T08:27:48.084 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_bucket_count": 0, 2024-02-10T08:27:48.084 INFO:teuthology.orchestra.run.smithi018.stdout: "degraded_stretch_mode": 0, 2024-02-10T08:27:48.085 INFO:teuthology.orchestra.run.smithi018.stdout: "recovering_stretch_mode": 0, 2024-02-10T08:27:48.085 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_bucket": 0 2024-02-10T08:27:48.085 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:48.085 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-02-10T08:27:48.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:46.792847+0000 mgr.y (mgr.14505) 417 : cluster [DBG] pgmap v495: 158 pgs: 2 active+remapped+backfilling, 156 active+clean; 1.4 GiB data, 6.2 GiB used, 620 GiB / 626 GiB avail; 682 B/s rd, 0 B/s wr, 605 op/s; 2706/70359 objects misplaced (3.846%); 8.0 MiB/s, 127 objects/s recovering 2024-02-10T08:27:48.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:27:47.792710+0000 mon.a (mon.0) 1228 : audit [DBG] from='client.? 172.21.15.18:0/474518308' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2024-02-10T08:27:48.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:46.792847+0000 mgr.y (mgr.14505) 417 : cluster [DBG] pgmap v495: 158 pgs: 2 active+remapped+backfilling, 156 active+clean; 1.4 GiB data, 6.2 GiB used, 620 GiB / 626 GiB avail; 682 B/s rd, 0 B/s wr, 605 op/s; 2706/70359 objects misplaced (3.846%); 8.0 MiB/s, 127 objects/s recovering 2024-02-10T08:27:48.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:27:47.792710+0000 mon.a (mon.0) 1228 : audit [DBG] from='client.? 172.21.15.18:0/474518308' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2024-02-10T08:27:48.290 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:27:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:27:48.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:46.792847+0000 mgr.y (mgr.14505) 417 : cluster [DBG] pgmap v495: 158 pgs: 2 active+remapped+backfilling, 156 active+clean; 1.4 GiB data, 6.2 GiB used, 620 GiB / 626 GiB avail; 682 B/s rd, 0 B/s wr, 605 op/s; 2706/70359 objects misplaced (3.846%); 8.0 MiB/s, 127 objects/s recovering 2024-02-10T08:27:48.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:27:47.792710+0000 mon.a (mon.0) 1228 : audit [DBG] from='client.? 172.21.15.18:0/474518308' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2024-02-10T08:27:48.894 INFO:tasks.thrashosds.thrasher:j is {'epoch': 241, 'fsid': 'd46257c8-c7eb-11ee-95b8-87774f69a715', 'created': '2024-02-10T08:10:57.425061+0000', 'modified': '2024-02-10T08:27:45.854231+0000', 'last_up_change': '2024-02-10T08:20:45.372678+0000', 'last_in_change': '2024-02-10T08:27:26.687243+0000', 'flags': 'noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5801984, 'flags_set': ['noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 19, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 8, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'pacific', 'pools': [{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-02-10T08:14:44.034966+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': '.rgw.root', 'create_time': '2024-02-10T08:16:51.334631+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 3, 'pool_name': 'iscsi', 'create_time': '2024-02-10T08:16:51.762963+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 3, 'pg_placement_num': 3, 'pg_placement_num_target': 3, 'pg_num_target': 3, 'pg_num_pending': 3, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '57', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 4, 'pool_name': 'default.rgw.log', 'create_time': '2024-02-10T08:16:53.258098+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '205', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 5, 'pool_name': 'default.rgw.control', 'create_time': '2024-02-10T08:16:55.289300+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 6, 'pool_name': 'default.rgw.meta', 'create_time': '2024-02-10T08:16:57.354868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 42, 'pg_placement_num': 42, 'pg_placement_num_target': 42, 'pg_num_target': 42, 'pg_num_pending': 42, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '210', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '131', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4}, 'application_metadata': {'rgw': {}}}, {'pool': 8, 'pool_name': 'unique_pool_1', 'create_time': '2024-02-10T08:24:20.523338+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '196', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}], 'osds': [{'osd': 0, 'uuid': 'f9043fee-a3ed-4e16-921d-bb86756d0c48', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 0.1252288818359375, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 191, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6801', 'nonce': 276034406}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6802', 'nonce': 276034406}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6804', 'nonce': 276034406}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6803', 'nonce': 276034406}]}, 'public_addr': '172.21.15.18:6801/276034406', 'cluster_addr': '172.21.15.18:6802/276034406', 'heartbeat_back_addr': '172.21.15.18:6804/276034406', 'heartbeat_front_addr': '172.21.15.18:6803/276034406', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'ff958272-ce6b-4162-959a-6da9729e537b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 233, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6805', 'nonce': 1941014296}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6806', 'nonce': 1941014296}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6808', 'nonce': 1941014296}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6807', 'nonce': 1941014296}]}, 'public_addr': '172.21.15.18:6805/1941014296', 'cluster_addr': '172.21.15.18:6806/1941014296', 'heartbeat_back_addr': '172.21.15.18:6808/1941014296', 'heartbeat_front_addr': '172.21.15.18:6807/1941014296', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '29bb47e2-5c81-4ae8-bb9f-d1b02ea01d3f', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 18, 'up_thru': 239, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6809', 'nonce': 3122474567}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6810', 'nonce': 3122474567}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6812', 'nonce': 3122474567}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6811', 'nonce': 3122474567}]}, 'public_addr': '172.21.15.18:6809/3122474567', 'cluster_addr': '172.21.15.18:6810/3122474567', 'heartbeat_back_addr': '172.21.15.18:6812/3122474567', 'heartbeat_front_addr': '172.21.15.18:6811/3122474567', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '87ad37de-5f49-4e5b-9683-3bb9c3e33907', 'up': 1, 'in': 1, 'weight': 0.51214599609375, 'primary_affinity': 0, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 25, 'up_thru': 175, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6813', 'nonce': 3484706437}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6814', 'nonce': 3484706437}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6816', 'nonce': 3484706437}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6815', 'nonce': 3484706437}]}, 'public_addr': '172.21.15.18:6813/3484706437', 'cluster_addr': '172.21.15.18:6814/3484706437', 'heartbeat_back_addr': '172.21.15.18:6816/3484706437', 'heartbeat_front_addr': '172.21.15.18:6815/3484706437', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': 'f5708f20-f98d-4d12-b8ae-71a5049a14cc', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 30, 'last_clean_end': 87, 'up_from': 110, 'up_thru': 238, 'down_at': 88, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6800', 'nonce': 3888817642}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6801', 'nonce': 3888817642}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6803', 'nonce': 3888817642}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6802', 'nonce': 3888817642}]}, 'public_addr': '172.21.15.71:6800/3888817642', 'cluster_addr': '172.21.15.71:6801/3888817642', 'heartbeat_back_addr': '172.21.15.71:6803/3888817642', 'heartbeat_front_addr': '172.21.15.71:6802/3888817642', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'e36a71dd-5088-4bff-965e-7dc8708ef7e3', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 37, 'up_thru': 232, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6804', 'nonce': 1932648316}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6805', 'nonce': 1932648316}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6807', 'nonce': 1932648316}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6806', 'nonce': 1932648316}]}, 'public_addr': '172.21.15.71:6804/1932648316', 'cluster_addr': '172.21.15.71:6805/1932648316', 'heartbeat_back_addr': '172.21.15.71:6807/1932648316', 'heartbeat_front_addr': '172.21.15.71:6806/1932648316', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '210a8790-78b6-4efa-a969-17efb17e9c0b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 43, 'up_thru': 233, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6808', 'nonce': 3724399458}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6809', 'nonce': 3724399458}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6811', 'nonce': 3724399458}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6810', 'nonce': 3724399458}]}, 'public_addr': '172.21.15.71:6808/3724399458', 'cluster_addr': '172.21.15.71:6809/3724399458', 'heartbeat_back_addr': '172.21.15.71:6811/3724399458', 'heartbeat_front_addr': '172.21.15.71:6810/3724399458', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '9778a0e9-2ff3-4700-bf2a-675edaba630b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 50, 'up_thru': 232, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6812', 'nonce': 163573852}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6813', 'nonce': 163573852}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6815', 'nonce': 163573852}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6814', 'nonce': 163573852}]}, 'public_addr': '172.21.15.71:6812/163573852', 'cluster_addr': '172.21.15.71:6813/163573852', 'heartbeat_back_addr': '172.21.15.71:6815/163573852', 'heartbeat_front_addr': '172.21.15.71:6814/163573852', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 41659, 'last_purged_snaps_scrub': '2024-02-10T08:27:18.262799+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-10T08:27:02.579226+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-10T08:27:38.544826+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-10T08:27:24.861119+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-10T08:27:31.798487+0000', 'dead_epoch': 87}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-10T08:27:11.715062+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-10T08:27:42.023943+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-10T08:27:09.975660+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [{'pgid': '2.5', 'mappings': [{'from': 7, 'to': 2}]}, {'pgid': '4.7', 'mappings': [{'from': 1, 'to': 7}]}, {'pgid': '4.d', 'mappings': [{'from': 1, 'to': 5}]}, {'pgid': '4.f', 'mappings': [{'from': 1, 'to': 2}]}, {'pgid': '4.13', 'mappings': [{'from': 1, 'to': 2}]}, {'pgid': '6.8', 'mappings': [{'from': 2, 'to': 4}]}], 'pg_temp': [{'pgid': '8.1', 'osds': [1, 2, 0]}, {'pgid': '8.6', 'osds': [6, 7, 0]}], 'primary_temp': [], 'blocklist': {'172.21.15.18:6800/542054629': '2024-02-11T08:17:16.433947+0000', '172.21.15.18:0/491217791': '2024-02-11T08:17:16.433947+0000', '172.21.15.18:0/781076548': '2024-02-11T08:17:16.433947+0000', '172.21.15.18:0/957318754': '2024-02-11T08:17:16.433947+0000', '172.21.15.18:0/2662732452': '2024-02-11T08:11:55.105124+0000', '172.21.15.18:0/1407788916': '2024-02-11T08:11:55.105124+0000', '172.21.15.18:6800/3798687064': '2024-02-11T08:11:55.105124+0000', '172.21.15.18:6800/3570839557': '2024-02-11T08:11:31.445897+0000', '172.21.15.18:0/541168116': '2024-02-11T08:11:31.445897+0000', '172.21.15.18:0/806236095': '2024-02-11T08:11:31.445897+0000'}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'ruleset-failure-domain': 'osd', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-02-10T08:27:48.894 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2024-02-10T08:27:48.901 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd set nodeep-scrub 2024-02-10T08:27:49.018 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:27:49.024 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:49.025 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:27:49.125 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:27:49.141 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:27:48.127698+0000 mgr.y (mgr.14505) 418 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:27:49.142 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:27:48.127698+0000 mgr.y (mgr.14505) 418 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:27:49.168 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:27:48.127698+0000 mgr.y (mgr.14505) 418 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:27:49.170 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:49.212 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:27:49.217 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:49.217 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:27:49.318 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:27:49.363 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:49.395 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:27:49.400 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:49.401 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:27:49.502 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:27:49.528 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-02-10T08:27:49.529 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-02-10T08:27:49.529 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:49.529 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.14964.0:232979 8.8 e241/191 8:1f18fc8b:::benchmark_data_smithi018_103312_object108547:head v 241'14449, mlcod=241'14447)", 2024-02-10T08:27:49.529 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:27:49.518990+0000", 2024-02-10T08:27:49.529 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.0068859029999999996, 2024-02-10T08:27:49.529 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0069180250000000004, 2024-02-10T08:27:49.529 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:27:49.529 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-02-10T08:27:49.529 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:27:49.529 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:49.529 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:27:49.530 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:49.518990+0000", 2024-02-10T08:27:49.530 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:27:49.530 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:49.530 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:49.530 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:27:49.530 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:49.518990+0000", 2024-02-10T08:27:49.530 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:27:49.530 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:49.530 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:49.530 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:27:49.530 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:49.518988+0000", 2024-02-10T08:27:49.530 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3360000000000001e-05 2024-02-10T08:27:49.530 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:49.530 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:49.530 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:27:49.530 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:49.519001+0000", 2024-02-10T08:27:49.531 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3600000000000001e-05 2024-02-10T08:27:49.531 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:49.531 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:49.531 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:27:49.531 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:49.519025+0000", 2024-02-10T08:27:49.531 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3053000000000001e-05 2024-02-10T08:27:49.531 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:49.531 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:49.531 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:27:49.531 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:49.519048+0000", 2024-02-10T08:27:49.531 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000106103 2024-02-10T08:27:49.531 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:49.531 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:49.531 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:27:49.531 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:49.519154+0000", 2024-02-10T08:27:49.532 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3044000000000002e-05 2024-02-10T08:27:49.532 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:49.532 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:49.532 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:27:49.532 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:49.519177+0000", 2024-02-10T08:27:49.532 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018755200000000001 2024-02-10T08:27:49.532 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:49.532 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:27:49.532 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:49.532 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:49.532 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:49.532 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.14964.0:232980 8.7 e241/191 8:e1759d58:::benchmark_data_smithi018_103312_object108548:head v 241'14545, mlcod=241'14543)", 2024-02-10T08:27:49.532 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:27:49.523781+0000", 2024-02-10T08:27:49.532 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.0020942970000000002, 2024-02-10T08:27:49.533 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002201382, 2024-02-10T08:27:49.533 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:27:49.533 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-02-10T08:27:49.533 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:27:49.533 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:49.533 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:27:49.533 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:49.523781+0000", 2024-02-10T08:27:49.533 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:27:49.533 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:49.533 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:49.533 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:27:49.533 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:49.523781+0000", 2024-02-10T08:27:49.533 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999981 2024-02-10T08:27:49.533 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:49.533 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:49.534 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:27:49.534 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:49.523780+0000", 2024-02-10T08:27:49.534 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3149000000000001e-05 2024-02-10T08:27:49.534 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:49.534 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:49.534 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:27:49.534 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:49.523793+0000", 2024-02-10T08:27:49.534 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5160999999999999e-05 2024-02-10T08:27:49.534 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:49.534 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:49.534 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:27:49.534 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:49.523808+0000", 2024-02-10T08:27:49.534 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0960000000000007e-06 2024-02-10T08:27:49.534 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:49.534 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:49.534 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:27:49.535 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:49.523817+0000", 2024-02-10T08:27:49.535 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000142006 2024-02-10T08:27:49.535 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:49.535 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:49.535 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:27:49.535 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:49.523959+0000", 2024-02-10T08:27:49.535 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3422e-05 2024-02-10T08:27:49.535 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:27:49.535 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:27:49.535 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:27:49.535 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:49.523982+0000", 2024-02-10T08:27:49.535 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00020114800000000001 2024-02-10T08:27:49.535 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:49.535 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:27:49.535 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:49.536 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:27:49.536 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-02-10T08:27:49.536 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 2 2024-02-10T08:27:49.536 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-02-10T08:27:49.536 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:49.541 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:27:49.572 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:27:49.575 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:49.576 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:27:49.676 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:27:49.717 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:49.826 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:27:49.829 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:49.829 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:27:49.847 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:27:49.930 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:27:49.986 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:50.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:48.794757+0000 mgr.y (mgr.14505) 419 : cluster [DBG] pgmap v496: 158 pgs: 2 active+remapped+backfilling, 156 active+clean; 1.1 GiB data, 5.3 GiB used, 620 GiB / 626 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1.20k op/s; 1963/55866 objects misplaced (3.514%); 7.8 MiB/s, 124 objects/s recovering 2024-02-10T08:27:50.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:48.794757+0000 mgr.y (mgr.14505) 419 : cluster [DBG] pgmap v496: 158 pgs: 2 active+remapped+backfilling, 156 active+clean; 1.1 GiB data, 5.3 GiB used, 620 GiB / 626 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1.20k op/s; 1963/55866 objects misplaced (3.514%); 7.8 MiB/s, 124 objects/s recovering 2024-02-10T08:27:50.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:49 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:48.794757+0000 mgr.y (mgr.14505) 419 : cluster [DBG] pgmap v496: 158 pgs: 2 active+remapped+backfilling, 156 active+clean; 1.1 GiB data, 5.3 GiB used, 620 GiB / 626 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1.20k op/s; 1963/55866 objects misplaced (3.514%); 7.8 MiB/s, 124 objects/s recovering 2024-02-10T08:27:50.509 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.3 dump_blocked_ops 2024-02-10T08:27:50.756 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:27:50.765 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:50.765 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:27:50.866 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:27:50.919 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:51.716 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:27:51.720 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:51.720 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:27:51.821 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:27:51.862 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:51.895 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:27:51.898 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:51.899 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:27:52.000 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:27:52.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:51 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:50.800181+0000 mgr.y (mgr.14505) 420 : cluster [DBG] pgmap v497: 158 pgs: 2 active+remapped+backfilling, 156 active+clean; 1.1 GiB data, 5.2 GiB used, 621 GiB / 626 GiB avail; 633 B/s rd, 0 B/s wr, 801 op/s; 1963/53736 objects misplaced (3.653%); 5.9 MiB/s, 94 objects/s recovering 2024-02-10T08:27:52.050 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:52.084 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:27:52.087 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:52.088 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:27:52.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:50.800181+0000 mgr.y (mgr.14505) 420 : cluster [DBG] pgmap v497: 158 pgs: 2 active+remapped+backfilling, 156 active+clean; 1.1 GiB data, 5.2 GiB used, 621 GiB / 626 GiB avail; 633 B/s rd, 0 B/s wr, 801 op/s; 1963/53736 objects misplaced (3.653%); 5.9 MiB/s, 94 objects/s recovering 2024-02-10T08:27:52.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:50.800181+0000 mgr.y (mgr.14505) 420 : cluster [DBG] pgmap v497: 158 pgs: 2 active+remapped+backfilling, 156 active+clean; 1.1 GiB data, 5.2 GiB used, 621 GiB / 626 GiB avail; 633 B/s rd, 0 B/s wr, 801 op/s; 1963/53736 objects misplaced (3.653%); 5.9 MiB/s, 94 objects/s recovering 2024-02-10T08:27:52.189 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:27:52.239 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:52.282 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:27:52.287 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:52.288 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:27:52.389 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:27:52.447 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:52.657 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:27:52.662 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:52.662 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:27:52.763 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:27:52.825 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:52.969 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:27:51.941889+0000 mon.a (mon.0) 1229 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:27:53.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:52 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:27:51.941889+0000 mon.a (mon.0) 1229 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:27:53.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:27:51.941889+0000 mon.a (mon.0) 1229 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:27:53.755 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:27:53.895 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 3, 4, 5, 6, 7] out_osds: [0] dead_osds: [] live_osds: [0, 1, 2, 3, 5, 6, 7, 4] 2024-02-10T08:27:53.895 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-10T08:27:53.895 INFO:tasks.thrashosds.thrasher:Adding osd 0 2024-02-10T08:27:53.896 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd in 0 2024-02-10T08:27:53.903 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:27:53.903 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:27:53.903 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:27:53.903 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:27:53.903 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:27:53.903 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:27:53.903 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:27:53.904 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:27:53.904 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-10T08:27:53.904 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-10T08:27:53.904 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-10T08:27:53.904 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-10T08:27:53.904 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-10T08:27:53.904 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-10T08:27:53.904 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-10T08:27:53.904 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-10T08:27:54.098 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:27:54.106 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:54.106 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:27:54.207 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:27:54.253 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:52.800912+0000 mgr.y (mgr.14505) 421 : cluster [DBG] pgmap v498: 158 pgs: 2 active+remapped+backfilling, 156 active+clean; 842 MiB data, 4.5 GiB used, 621 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 1.07k op/s; 1247/40986 objects misplaced (3.043%); 5.5 MiB/s, 88 objects/s recovering 2024-02-10T08:27:54.253 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:27:53.378008+0000 mon.b (mon.1) 64 : audit [DBG] from='client.? 172.21.15.18:0/2743556651' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:27:54.253 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:52.800912+0000 mgr.y (mgr.14505) 421 : cluster [DBG] pgmap v498: 158 pgs: 2 active+remapped+backfilling, 156 active+clean; 842 MiB data, 4.5 GiB used, 621 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 1.07k op/s; 1247/40986 objects misplaced (3.043%); 5.5 MiB/s, 88 objects/s recovering 2024-02-10T08:27:54.253 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:27:53.378008+0000 mon.b (mon.1) 64 : audit [DBG] from='client.? 172.21.15.18:0/2743556651' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:27:54.257 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:54.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:53 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:52.800912+0000 mgr.y (mgr.14505) 421 : cluster [DBG] pgmap v498: 158 pgs: 2 active+remapped+backfilling, 156 active+clean; 842 MiB data, 4.5 GiB used, 621 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 1.07k op/s; 1247/40986 objects misplaced (3.043%); 5.5 MiB/s, 88 objects/s recovering 2024-02-10T08:27:54.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:53 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:27:53.378008+0000 mon.b (mon.1) 64 : audit [DBG] from='client.? 172.21.15.18:0/2743556651' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:27:54.627 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:27:54.633 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:54.634 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:27:54.735 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:27:54.778 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:54.805 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:27:54.810 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:54.811 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:27:54.912 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:27:54.958 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:54.995 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:27:55.001 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:55.001 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:27:55.102 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:27:55.165 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:55.206 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:27:55.208 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:55.209 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:27:55.309 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:27:55.389 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:55.439 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:27:55.445 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:55.446 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:27:55.547 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:27:55.610 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:56.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:54.801404+0000 mgr.y (mgr.14505) 422 : cluster [DBG] pgmap v499: 158 pgs: 2 active+remapped+backfilling, 156 active+clean; 753 MiB data, 4.3 GiB used, 622 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 1.12k op/s; 1247/36738 objects misplaced (3.394%); 1.4 MiB/s, 23 objects/s recovering 2024-02-10T08:27:56.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:27:55.922271+0000 mon.b (mon.1) 65 : audit [INF] from='client.? 172.21.15.18:0/3802099963' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:27:56.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:27:55.922920+0000 mon.a (mon.0) 1230 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:27:56.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:54.801404+0000 mgr.y (mgr.14505) 422 : cluster [DBG] pgmap v499: 158 pgs: 2 active+remapped+backfilling, 156 active+clean; 753 MiB data, 4.3 GiB used, 622 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 1.12k op/s; 1247/36738 objects misplaced (3.394%); 1.4 MiB/s, 23 objects/s recovering 2024-02-10T08:27:56.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:27:55.922271+0000 mon.b (mon.1) 65 : audit [INF] from='client.? 172.21.15.18:0/3802099963' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:27:56.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:27:55.922920+0000 mon.a (mon.0) 1230 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:27:56.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:54.801404+0000 mgr.y (mgr.14505) 422 : cluster [DBG] pgmap v499: 158 pgs: 2 active+remapped+backfilling, 156 active+clean; 753 MiB data, 4.3 GiB used, 622 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 1.12k op/s; 1247/36738 objects misplaced (3.394%); 1.4 MiB/s, 23 objects/s recovering 2024-02-10T08:27:56.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:27:55.922271+0000 mon.b (mon.1) 65 : audit [INF] from='client.? 172.21.15.18:0/3802099963' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:27:56.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:27:55.922920+0000 mon.a (mon.0) 1230 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:27:56.555 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:27:56.585 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:27:56.592 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:56.593 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:27:56.658 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-10T08:27:56.693 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:27:56.739 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:56.753 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is set 2024-02-10T08:27:56.773 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:27:56.779 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:56.780 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:27:56.780 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:27:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:27:56] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:27:56.881 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:27:56.926 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:56.958 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:27:56.961 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:56.961 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:27:57.045 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:56.711973+0000 mon.a (mon.0) 1231 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:27:57.045 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:27:56.723788+0000 mon.a (mon.0) 1232 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-10T08:27:57.045 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:56.723855+0000 mon.a (mon.0) 1233 : cluster [DBG] osdmap e242: 8 total, 8 up, 7 in 2024-02-10T08:27:57.063 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:27:57.112 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:57.147 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:27:57.152 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:57.153 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:27:57.254 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:27:57.303 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:57.347 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:27:57.359 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:57.360 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:27:57.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:56.711973+0000 mon.a (mon.0) 1231 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:27:57.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:27:56.723788+0000 mon.a (mon.0) 1232 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-10T08:27:57.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:56.723855+0000 mon.a (mon.0) 1233 : cluster [DBG] osdmap e242: 8 total, 8 up, 7 in 2024-02-10T08:27:57.405 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:27:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:27:57] "GET /metrics HTTP/1.1" 200 176035 "" "Prometheus/2.33.4" 2024-02-10T08:27:57.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:56.711973+0000 mon.a (mon.0) 1231 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:27:57.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:27:56.723788+0000 mon.a (mon.0) 1232 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-10T08:27:57.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:56.723855+0000 mon.a (mon.0) 1233 : cluster [DBG] osdmap e242: 8 total, 8 up, 7 in 2024-02-10T08:27:57.461 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:27:57.525 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:57.788 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:27:57.793 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:57.794 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:27:57.895 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:27:57.940 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:57.965 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:27:57.968 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:57.968 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:27:58.069 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:27:58.121 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:56.803075+0000 mgr.y (mgr.14505) 423 : cluster [DBG] pgmap v501: 158 pgs: 2 active+remapped+backfilling, 156 active+clean; 753 MiB data, 4.3 GiB used, 622 GiB / 626 GiB avail; 1022 B/s rd, 0 B/s wr, 1.12k op/s; 1247/36738 objects misplaced (3.394%); 1.4 MiB/s, 23 objects/s recovering 2024-02-10T08:27:58.122 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:56.803075+0000 mgr.y (mgr.14505) 423 : cluster [DBG] pgmap v501: 158 pgs: 2 active+remapped+backfilling, 156 active+clean; 753 MiB data, 4.3 GiB used, 622 GiB / 626 GiB avail; 1022 B/s rd, 0 B/s wr, 1.12k op/s; 1247/36738 objects misplaced (3.394%); 1.4 MiB/s, 23 objects/s recovering 2024-02-10T08:27:58.130 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:58.156 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:27:58.160 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:58.160 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:27:58.261 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:27:58.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:56.803075+0000 mgr.y (mgr.14505) 423 : cluster [DBG] pgmap v501: 158 pgs: 2 active+remapped+backfilling, 156 active+clean; 753 MiB data, 4.3 GiB used, 622 GiB / 626 GiB avail; 1022 B/s rd, 0 B/s wr, 1.12k op/s; 1247/36738 objects misplaced (3.394%); 1.4 MiB/s, 23 objects/s recovering 2024-02-10T08:27:58.289 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:27:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:27:58.331 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:59.216 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:27:59.245 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:59.246 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:27:59.246 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:27:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:27:58.137878+0000 mgr.y (mgr.14505) 424 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:27:59.248 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:27:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:27:58.137878+0000 mgr.y (mgr.14505) 424 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:27:59.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:27:59 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:27:58.137878+0000 mgr.y (mgr.14505) 424 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:27:59.347 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:27:59.353 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-02-10T08:27:59.353 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:27:59.404 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:59.428 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:27:59.434 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:59.435 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:27:59.535 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:27:59.580 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:59.612 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:27:59.625 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:59.626 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:27:59.726 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:27:59.775 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:59.808 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:27:59.812 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:59.812 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:27:59.913 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:27:59.957 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:27:59.982 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:27:59.984 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:27:59.985 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:28:00.025 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:27:58.804001+0000 mgr.y (mgr.14505) 425 : cluster [DBG] pgmap v502: 158 pgs: 2 active+remapped+backfilling, 156 active+clean; 451 MiB data, 3.4 GiB used, 622 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 1.12k op/s; 603/22239 objects misplaced (2.711%); 1.5 MiB/s, 23 objects/s recovering 2024-02-10T08:28:00.086 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:28:00.140 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:00.174 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:28:00.178 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:00.178 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:28:00.268 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:27:58.804001+0000 mgr.y (mgr.14505) 425 : cluster [DBG] pgmap v502: 158 pgs: 2 active+remapped+backfilling, 156 active+clean; 451 MiB data, 3.4 GiB used, 622 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 1.12k op/s; 603/22239 objects misplaced (2.711%); 1.5 MiB/s, 23 objects/s recovering 2024-02-10T08:28:00.268 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:27:58.804001+0000 mgr.y (mgr.14505) 425 : cluster [DBG] pgmap v502: 158 pgs: 2 active+remapped+backfilling, 156 active+clean; 451 MiB data, 3.4 GiB used, 622 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 1.12k op/s; 603/22239 objects misplaced (2.711%); 1.5 MiB/s, 23 objects/s recovering 2024-02-10T08:28:00.279 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:28:00.356 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:00.985 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.3 dump_historic_ops 2024-02-10T08:28:01.006 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd unset noscrub 2024-02-10T08:28:01.249 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:28:01.330 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:28:01.339 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:01.340 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:28:01.440 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:28:01.482 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:01.510 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:28:01.518 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:01.519 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:28:01.600 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:28:01.593+0000 7f97240ed700 -1 mon.a@0(leader).osd e242 definitely_dead 0 2024-02-10T08:28:01.619 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:28:01.679 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:01.711 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:28:01.718 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:01.718 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:28:01.752 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:00.804576+0000 mgr.y (mgr.14505) 426 : cluster [DBG] pgmap v503: 158 pgs: 2 active+remapped+backfilling, 156 active+clean; 407 MiB data, 3.3 GiB used, 623 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 1.12k op/s; 603/20115 objects misplaced (2.998%); 1.5 MiB/s, 23 objects/s recovering 2024-02-10T08:28:01.752 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:28:01.592069+0000 mon.c (mon.2) 53 : audit [DBG] from='client.? 172.21.15.18:0/724699533' entity='client.admin' cmd=[{"prefix": "osd in", "ids": ["0"]}]: dispatch 2024-02-10T08:28:01.752 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:28:01.594728+0000 mon.a (mon.0) 1234 : audit [DBG] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd in", "ids": ["0"]}]: dispatch 2024-02-10T08:28:01.765 INFO:teuthology.orchestra.run.smithi018.stderr:marked in osd.0. 2024-02-10T08:28:01.819 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:28:01.846 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:01.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:00.804576+0000 mgr.y (mgr.14505) 426 : cluster [DBG] pgmap v503: 158 pgs: 2 active+remapped+backfilling, 156 active+clean; 407 MiB data, 3.3 GiB used, 623 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 1.12k op/s; 603/20115 objects misplaced (2.998%); 1.5 MiB/s, 23 objects/s recovering 2024-02-10T08:28:01.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:28:01.592069+0000 mon.c (mon.2) 53 : audit [DBG] from='client.? 172.21.15.18:0/724699533' entity='client.admin' cmd=[{"prefix": "osd in", "ids": ["0"]}]: dispatch 2024-02-10T08:28:01.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:28:01.594728+0000 mon.a (mon.0) 1234 : audit [DBG] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd in", "ids": ["0"]}]: dispatch 2024-02-10T08:28:01.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:00.804576+0000 mgr.y (mgr.14505) 426 : cluster [DBG] pgmap v503: 158 pgs: 2 active+remapped+backfilling, 156 active+clean; 407 MiB data, 3.3 GiB used, 623 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 1.12k op/s; 603/20115 objects misplaced (2.998%); 1.5 MiB/s, 23 objects/s recovering 2024-02-10T08:28:01.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:28:01.592069+0000 mon.c (mon.2) 53 : audit [DBG] from='client.? 172.21.15.18:0/724699533' entity='client.admin' cmd=[{"prefix": "osd in", "ids": ["0"]}]: dispatch 2024-02-10T08:28:01.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:28:01.594728+0000 mon.a (mon.0) 1234 : audit [DBG] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd in", "ids": ["0"]}]: dispatch 2024-02-10T08:28:03.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:28:01.752621+0000 mon.a (mon.0) 1235 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd in", "ids": ["0"]}]': finished 2024-02-10T08:28:03.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:01.752745+0000 mon.a (mon.0) 1236 : cluster [DBG] osdmap e243: 8 total, 8 up, 8 in 2024-02-10T08:28:03.113 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:28:01.752621+0000 mon.a (mon.0) 1235 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd in", "ids": ["0"]}]': finished 2024-02-10T08:28:03.113 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:01.752745+0000 mon.a (mon.0) 1236 : cluster [DBG] osdmap e243: 8 total, 8 up, 8 in 2024-02-10T08:28:03.114 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:28:01.752621+0000 mon.a (mon.0) 1235 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd in", "ids": ["0"]}]': finished 2024-02-10T08:28:03.114 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:01.752745+0000 mon.a (mon.0) 1236 : cluster [DBG] osdmap e243: 8 total, 8 up, 8 in 2024-02-10T08:28:03.596 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:28:03.599 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:03.600 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:28:03.701 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:28:03.732 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:03.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:02.754277+0000 mon.a (mon.0) 1237 : cluster [DBG] osdmap e244: 8 total, 8 up, 8 in 2024-02-10T08:28:03.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:02.805217+0000 mgr.y (mgr.14505) 427 : cluster [DBG] pgmap v506: 158 pgs: 2 remapped+peering, 20 peering, 136 active+clean; 192 MiB data, 2.6 GiB used, 623 GiB / 626 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 1.48k op/s; 2.2 MiB/s, 35 objects/s recovering 2024-02-10T08:28:03.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:03.754500+0000 mon.a (mon.0) 1238 : cluster [DBG] osdmap e245: 8 total, 8 up, 8 in 2024-02-10T08:28:03.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:02.754277+0000 mon.a (mon.0) 1237 : cluster [DBG] osdmap e244: 8 total, 8 up, 8 in 2024-02-10T08:28:03.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:02.805217+0000 mgr.y (mgr.14505) 427 : cluster [DBG] pgmap v506: 158 pgs: 2 remapped+peering, 20 peering, 136 active+clean; 192 MiB data, 2.6 GiB used, 623 GiB / 626 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 1.48k op/s; 2.2 MiB/s, 35 objects/s recovering 2024-02-10T08:28:03.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:03.754500+0000 mon.a (mon.0) 1238 : cluster [DBG] osdmap e245: 8 total, 8 up, 8 in 2024-02-10T08:28:03.950 INFO:tasks.thrashosds.thrasher:Added osd 0 2024-02-10T08:28:04.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:02.754277+0000 mon.a (mon.0) 1237 : cluster [DBG] osdmap e244: 8 total, 8 up, 8 in 2024-02-10T08:28:04.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:02.805217+0000 mgr.y (mgr.14505) 427 : cluster [DBG] pgmap v506: 158 pgs: 2 remapped+peering, 20 peering, 136 active+clean; 192 MiB data, 2.6 GiB used, 623 GiB / 626 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 1.48k op/s; 2.2 MiB/s, 35 objects/s recovering 2024-02-10T08:28:04.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:03.754500+0000 mon.a (mon.0) 1238 : cluster [DBG] osdmap e245: 8 total, 8 up, 8 in 2024-02-10T08:28:04.184 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:28:04.186 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:04.187 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:28:04.287 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:28:04.342 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:04.458 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:28:04.462 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:04.462 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:28:04.527 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:28:04.527 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:28:04.536 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:28:04.564 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:28:04.576 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:28:04.610 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:04.615 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:28:04.641 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:28:04.667 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:28:04.671 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:28:04.671 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:04.671 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:28:04.711 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:28:04.747 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:28:04.772 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:28:04.774 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:03.754206+0000 osd.4 (osd.4) 51 : cluster [DBG] 8.2 starting backfill to osd.0 from (223'9604,237'14048] MIN to 242'15361 2024-02-10T08:28:04.774 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:03.756552+0000 osd.2 (osd.2) 112 : cluster [DBG] 8.e starting backfill to osd.0 from (223'9812,238'14171] MIN to 242'15554 2024-02-10T08:28:04.774 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:28:04.486336+0000 mon.c (mon.2) 54 : audit [DBG] from='client.? 172.21.15.18:0/2204332203' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:28:04.776 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:28:04.796 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-10T08:28:04.796 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-10T08:28:04.796 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-10T08:28:04.796 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-10T08:28:04.796 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-10T08:28:04.796 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-10T08:28:04.796 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-10T08:28:04.796 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-10T08:28:04.822 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:04.849 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:28:04.855 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:04.856 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:28:04.956 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:28:04.997 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:03.754206+0000 osd.4 (osd.4) 51 : cluster [DBG] 8.2 starting backfill to osd.0 from (223'9604,237'14048] MIN to 242'15361 2024-02-10T08:28:04.997 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:03.756552+0000 osd.2 (osd.2) 112 : cluster [DBG] 8.e starting backfill to osd.0 from (223'9812,238'14171] MIN to 242'15554 2024-02-10T08:28:04.997 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:28:04.486336+0000 mon.c (mon.2) 54 : audit [DBG] from='client.? 172.21.15.18:0/2204332203' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:28:05.001 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:05.051 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:28:05.058 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:05.059 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:28:05.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:03.754206+0000 osd.4 (osd.4) 51 : cluster [DBG] 8.2 starting backfill to osd.0 from (223'9604,237'14048] MIN to 242'15361 2024-02-10T08:28:05.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:03.756552+0000 osd.2 (osd.2) 112 : cluster [DBG] 8.e starting backfill to osd.0 from (223'9812,238'14171] MIN to 242'15554 2024-02-10T08:28:05.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:28:04.486336+0000 mon.c (mon.2) 54 : audit [DBG] from='client.? 172.21.15.18:0/2204332203' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:28:05.159 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:28:05.205 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:05.230 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:28:05.234 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:05.234 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:28:05.335 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:28:05.388 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:05.497 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:28:05.505 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:05.505 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:28:05.606 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:28:05.652 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:05.682 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:28:05.687 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:05.687 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:28:05.788 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:28:05.830 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:05.875 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:28:05.879 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:05.880 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:28:05.981 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:28:06.005 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:04.808114+0000 mgr.y (mgr.14505) 428 : cluster [DBG] pgmap v508: 158 pgs: 2 active+recovery_wait+degraded, 3 remapped+peering, 20 peering, 133 active+clean; 159 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 780 op/s; 8/8190 objects degraded (0.098%); 1023 KiB/s, 16 objects/s recovering 2024-02-10T08:28:06.005 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:05.712556+0000 mon.a (mon.0) 1239 : cluster [DBG] osdmap e246: 8 total, 8 up, 8 in 2024-02-10T08:28:06.007 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:06.025 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:28:06.028 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:06.028 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:28:06.129 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:28:06.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:04.808114+0000 mgr.y (mgr.14505) 428 : cluster [DBG] pgmap v508: 158 pgs: 2 active+recovery_wait+degraded, 3 remapped+peering, 20 peering, 133 active+clean; 159 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 780 op/s; 8/8190 objects degraded (0.098%); 1023 KiB/s, 16 objects/s recovering 2024-02-10T08:28:06.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:05.712556+0000 mon.a (mon.0) 1239 : cluster [DBG] osdmap e246: 8 total, 8 up, 8 in 2024-02-10T08:28:06.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:04.808114+0000 mgr.y (mgr.14505) 428 : cluster [DBG] pgmap v508: 158 pgs: 2 active+recovery_wait+degraded, 3 remapped+peering, 20 peering, 133 active+clean; 159 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 780 op/s; 8/8190 objects degraded (0.098%); 1023 KiB/s, 16 objects/s recovering 2024-02-10T08:28:06.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:05.712556+0000 mon.a (mon.0) 1239 : cluster [DBG] osdmap e246: 8 total, 8 up, 8 in 2024-02-10T08:28:06.157 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:06.779 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:28:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:28:06] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:28:06.779 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:05.766748+0000 mon.a (mon.0) 1240 : cluster [WRN] Health check failed: Degraded data redundancy: 8/8190 objects degraded (0.098%), 2 pgs degraded (PG_DEGRADED) 2024-02-10T08:28:06.779 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:06.718295+0000 mon.a (mon.0) 1241 : cluster [DBG] osdmap e247: 8 total, 8 up, 8 in 2024-02-10T08:28:06.906 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:05.766748+0000 mon.a (mon.0) 1240 : cluster [WRN] Health check failed: Degraded data redundancy: 8/8190 objects degraded (0.098%), 2 pgs degraded (PG_DEGRADED) 2024-02-10T08:28:06.906 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:06.718295+0000 mon.a (mon.0) 1241 : cluster [DBG] osdmap e247: 8 total, 8 up, 8 in 2024-02-10T08:28:06.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:05.766748+0000 mon.a (mon.0) 1240 : cluster [WRN] Health check failed: Degraded data redundancy: 8/8190 objects degraded (0.098%), 2 pgs degraded (PG_DEGRADED) 2024-02-10T08:28:06.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:06.718295+0000 mon.a (mon.0) 1241 : cluster [DBG] osdmap e247: 8 total, 8 up, 8 in 2024-02-10T08:28:06.907 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:28:06.910 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:06.911 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:28:07.012 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:28:07.063 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:07.255 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Removed 124429 objects 2024-02-10T08:28:07.256 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Clean up completed and total clean up time :119.88 2024-02-10T08:28:07.404 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:28:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:28:07] "GET /metrics HTTP/1.1" 200 176028 "" "Prometheus/2.33.4" 2024-02-10T08:28:08.262 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:06.808522+0000 mgr.y (mgr.14505) 429 : cluster [DBG] pgmap v511: 158 pgs: 1 active+remapped+backfilling, 2 active+recovery_wait+degraded, 3 remapped+peering, 20 peering, 132 active+clean; 141 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 0 B/s wr, 203 op/s; 8/7323 objects degraded (0.109%); 74/7323 objects misplaced (1.011%); 931 KiB/s, 17 objects/s recovering 2024-02-10T08:28:08.262 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:28:06.970264+0000 mon.a (mon.0) 1242 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:28:08.262 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:06.808522+0000 mgr.y (mgr.14505) 429 : cluster [DBG] pgmap v511: 158 pgs: 1 active+remapped+backfilling, 2 active+recovery_wait+degraded, 3 remapped+peering, 20 peering, 132 active+clean; 141 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 0 B/s wr, 203 op/s; 8/7323 objects degraded (0.109%); 74/7323 objects misplaced (1.011%); 931 KiB/s, 17 objects/s recovering 2024-02-10T08:28:08.262 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:28:06.970264+0000 mon.a (mon.0) 1242 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:28:08.289 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:28:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:28:08.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:06.808522+0000 mgr.y (mgr.14505) 429 : cluster [DBG] pgmap v511: 158 pgs: 1 active+remapped+backfilling, 2 active+recovery_wait+degraded, 3 remapped+peering, 20 peering, 132 active+clean; 141 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 0 B/s wr, 203 op/s; 8/7323 objects degraded (0.109%); 74/7323 objects misplaced (1.011%); 931 KiB/s, 17 objects/s recovering 2024-02-10T08:28:08.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:28:06.970264+0000 mon.a (mon.0) 1242 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:28:08.393 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-10T08:28:08.952 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 3, 4, 5, 6, 7, 0] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 5, 6, 7, 4] 2024-02-10T08:28:08.952 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-10T08:28:08.952 INFO:tasks.thrashosds.thrasher:inject_pause on osd.7 2024-02-10T08:28:08.952 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-02-10T08:28:08.952 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-02-10T08:28:08.952 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.7 config set filestore_inject_stall 3 2024-02-10T08:28:09.224 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:28:09.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:28:08.148714+0000 mgr.y (mgr.14505) 430 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:28:09.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:28:08.148714+0000 mgr.y (mgr.14505) 430 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:28:09.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:28:08.148714+0000 mgr.y (mgr.14505) 430 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:28:09.978 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:08.809442+0000 mgr.y (mgr.14505) 431 : cluster [DBG] pgmap v512: 158 pgs: 1 active+remapped+backfill_toofull, 1 active+remapped+backfilling, 156 active+clean; 14 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 475 op/s; 74/1257 objects misplaced (5.887%); 629 KiB/s, 16 objects/s recovering 2024-02-10T08:28:09.978 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:08.969632+0000 mon.a (mon.0) 1243 : cluster [WRN] Health check failed: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull (PG_BACKFILL_FULL) 2024-02-10T08:28:09.978 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:08.969660+0000 mon.a (mon.0) 1244 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 8/7323 objects degraded (0.109%), 2 pgs degraded) 2024-02-10T08:28:10.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:08.809442+0000 mgr.y (mgr.14505) 431 : cluster [DBG] pgmap v512: 158 pgs: 1 active+remapped+backfill_toofull, 1 active+remapped+backfilling, 156 active+clean; 14 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 475 op/s; 74/1257 objects misplaced (5.887%); 629 KiB/s, 16 objects/s recovering 2024-02-10T08:28:10.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:08.969632+0000 mon.a (mon.0) 1243 : cluster [WRN] Health check failed: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull (PG_BACKFILL_FULL) 2024-02-10T08:28:10.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:08.969660+0000 mon.a (mon.0) 1244 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 8/7323 objects degraded (0.109%), 2 pgs degraded) 2024-02-10T08:28:10.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:08.809442+0000 mgr.y (mgr.14505) 431 : cluster [DBG] pgmap v512: 158 pgs: 1 active+remapped+backfill_toofull, 1 active+remapped+backfilling, 156 active+clean; 14 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 475 op/s; 74/1257 objects misplaced (5.887%); 629 KiB/s, 16 objects/s recovering 2024-02-10T08:28:10.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:08.969632+0000 mon.a (mon.0) 1243 : cluster [WRN] Health check failed: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull (PG_BACKFILL_FULL) 2024-02-10T08:28:10.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:08.969660+0000 mon.a (mon.0) 1244 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 8/7323 objects degraded (0.109%), 2 pgs degraded) 2024-02-10T08:28:10.825 INFO:tasks.cephadm.ceph_manager.ceph:removing pool_name unique_pool_1 2024-02-10T08:28:10.825 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd pool rm unique_pool_1 unique_pool_1 --yes-i-really-really-mean-it 2024-02-10T08:28:11.389 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-02-10T08:28:11.389 INFO:teuthology.orchestra.run.smithi071.stdout: "success": "" 2024-02-10T08:28:11.389 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-02-10T08:28:12.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:10.809909+0000 mgr.y (mgr.14505) 432 : cluster [DBG] pgmap v513: 158 pgs: 1 active+remapped+backfill_toofull, 157 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 725 B/s rd, 0 B/s wr, 360 op/s; 535 KiB/s, 13 objects/s recovering 2024-02-10T08:28:12.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:10.809909+0000 mgr.y (mgr.14505) 432 : cluster [DBG] pgmap v513: 158 pgs: 1 active+remapped+backfill_toofull, 157 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 725 B/s rd, 0 B/s wr, 360 op/s; 535 KiB/s, 13 objects/s recovering 2024-02-10T08:28:12.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:10.809909+0000 mgr.y (mgr.14505) 432 : cluster [DBG] pgmap v513: 158 pgs: 1 active+remapped+backfill_toofull, 157 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 725 B/s rd, 0 B/s wr, 360 op/s; 535 KiB/s, 13 objects/s recovering 2024-02-10T08:28:13.351 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:28:13.354 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:13.354 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:28:13.455 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:28:13.488 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:13.870 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:28:13.879 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:13.879 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:28:13.885 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is unset 2024-02-10T08:28:13.980 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:28:14.017 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:14.039 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:28:14.041 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:14.042 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:28:14.142 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:28:14.145 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-02-10T08:28:14.145 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-02-10T08:28:14.145 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-02-10T08:28:14.145 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-02-10T08:28:14.146 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.146 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.24299.0:672 5.0 5:05bf5b68:::notify.1:head [watch reconnect cookie 94587203960832 gen 1] snapc 0=[] ondisk+write+known_if_redirected e88)", 2024-02-10T08:28:14.146 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:19:30.798269+0000", 2024-02-10T08:28:14.146 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 523.34515538899996, 2024-02-10T08:28:14.146 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.019838426, 2024-02-10T08:28:14.146 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:28:14.146 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-02-10T08:28:14.146 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:28:14.146 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.24299", 2024-02-10T08:28:14.146 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/871408063", 2024-02-10T08:28:14.146 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 672 2024-02-10T08:28:14.146 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.146 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:28:14.146 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.146 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:28:14.146 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:30.798269+0000", 2024-02-10T08:28:14.147 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:28:14.147 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.147 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.147 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:28:14.147 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:30.798269+0000", 2024-02-10T08:28:14.147 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999971 2024-02-10T08:28:14.147 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.147 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.147 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:28:14.147 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:30.798266+0000", 2024-02-10T08:28:14.147 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3550999999999999e-05 2024-02-10T08:28:14.147 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.147 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.147 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:28:14.148 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:30.798290+0000", 2024-02-10T08:28:14.148 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3221e-05 2024-02-10T08:28:14.148 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.148 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.148 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:28:14.148 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:30.798313+0000", 2024-02-10T08:28:14.148 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1939e-05 2024-02-10T08:28:14.148 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.148 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.148 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:28:14.148 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:30.798325+0000", 2024-02-10T08:28:14.148 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1451000000000004e-05 2024-02-10T08:28:14.148 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.148 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.149 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:28:14.149 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:30.798396+0000", 2024-02-10T08:28:14.149 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6050000000000003e-06 2024-02-10T08:28:14.149 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.149 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.149 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op must wait for map", 2024-02-10T08:28:14.149 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:30.798403+0000", 2024-02-10T08:28:14.149 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0076789980000000002 2024-02-10T08:28:14.149 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.149 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.149 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:28:14.149 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:30.806082+0000", 2024-02-10T08:28:14.149 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9099999999999994e-06 2024-02-10T08:28:14.149 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.149 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.150 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:28:14.150 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:30.806091+0000", 2024-02-10T08:28:14.150 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.99968515000000002 2024-02-10T08:28:14.150 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.150 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.150 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:28:14.150 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:31.805776+0000", 2024-02-10T08:28:14.150 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015864300000000001 2024-02-10T08:28:14.150 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.150 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.150 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:28:14.150 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:31.805935+0000", 2024-02-10T08:28:14.150 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.012172792 2024-02-10T08:28:14.150 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.150 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.151 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:28:14.151 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:31.818108+0000", 2024-02-10T08:28:14.151 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.019838426 2024-02-10T08:28:14.151 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:14.151 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:28:14.151 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:14.151 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.151 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.151 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.24299.0:679 5.0 5:05bf5b68:::notify.1:head [watch ping cookie 94587203960832 gen 1] snapc 0=[] ondisk+write+known_if_redirected e88)", 2024-02-10T08:28:14.151 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:19:30.927547+0000", 2024-02-10T08:28:14.151 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 523.21587759299996, 2024-02-10T08:28:14.151 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.878864019, 2024-02-10T08:28:14.151 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:28:14.151 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-02-10T08:28:14.151 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:28:14.152 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.24299", 2024-02-10T08:28:14.152 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/871408063", 2024-02-10T08:28:14.152 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 679 2024-02-10T08:28:14.152 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.152 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:28:14.152 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.152 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:28:14.152 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:30.927547+0000", 2024-02-10T08:28:14.152 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:28:14.152 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.152 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.152 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:28:14.152 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:30.927547+0000", 2024-02-10T08:28:14.152 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999981 2024-02-10T08:28:14.153 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.153 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.153 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:28:14.153 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:30.927545+0000", 2024-02-10T08:28:14.153 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8460000000000003e-06 2024-02-10T08:28:14.153 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.153 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.153 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:28:14.153 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:30.927555+0000", 2024-02-10T08:28:14.153 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9910000000000001e-05 2024-02-10T08:28:14.153 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.153 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.153 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:28:14.153 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:30.927575+0000", 2024-02-10T08:28:14.153 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8234000000000001e-05 2024-02-10T08:28:14.153 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.154 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.154 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:28:14.154 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:30.927603+0000", 2024-02-10T08:28:14.154 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1118999999999995e-05 2024-02-10T08:28:14.154 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.154 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.154 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:28:14.154 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:30.927664+0000", 2024-02-10T08:28:14.154 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2609999999999993e-06 2024-02-10T08:28:14.154 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.154 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.154 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:28:14.154 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:30.927672+0000", 2024-02-10T08:28:14.154 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.87856715900000004 2024-02-10T08:28:14.154 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.155 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.155 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:28:14.155 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:31.806240+0000", 2024-02-10T08:28:14.155 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5648000000000005e-05 2024-02-10T08:28:14.155 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.155 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.155 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:28:14.155 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:31.806315+0000", 2024-02-10T08:28:14.155 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5744999999999999e-05 2024-02-10T08:28:14.155 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.155 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.155 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:28:14.155 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:19:31.806411+0000", 2024-02-10T08:28:14.155 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.878864019 2024-02-10T08:28:14.155 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:14.155 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:28:14.155 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:14.156 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.156 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.156 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:29649 7.2 7:4493dc73:::benchmark_data_smithi018_80623_object29648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e96)", 2024-02-10T08:28:14.156 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:03.385646+0000", 2024-02-10T08:28:14.156 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 490.75777863899998, 2024-02-10T08:28:14.156 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.101875721, 2024-02-10T08:28:14.156 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:28:14.156 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:28:14.156 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:28:14.156 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:28:14.156 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:28:14.156 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 29649 2024-02-10T08:28:14.156 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.156 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:28:14.156 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.157 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:28:14.157 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.385646+0000", 2024-02-10T08:28:14.157 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:28:14.157 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.157 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.157 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:28:14.157 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.385646+0000", 2024-02-10T08:28:14.157 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:28:14.157 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.157 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.157 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:28:14.157 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.385644+0000", 2024-02-10T08:28:14.157 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.4049999999999998e-05 2024-02-10T08:28:14.157 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.157 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.158 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:28:14.158 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.385668+0000", 2024-02-10T08:28:14.158 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1548e-05 2024-02-10T08:28:14.158 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.158 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.158 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:28:14.158 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.385680+0000", 2024-02-10T08:28:14.158 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5130000000000002e-06 2024-02-10T08:28:14.158 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.158 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.158 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:28:14.158 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.385686+0000", 2024-02-10T08:28:14.158 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000129665 2024-02-10T08:28:14.158 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.158 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.159 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:28:14.159 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.385816+0000", 2024-02-10T08:28:14.159 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000121935 2024-02-10T08:28:14.159 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.159 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.159 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:28:14.159 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.385938+0000", 2024-02-10T08:28:14.159 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001199203 2024-02-10T08:28:14.159 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.159 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.159 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1,2", 2024-02-10T08:28:14.159 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.387137+0000", 2024-02-10T08:28:14.159 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.099128972999999995 2024-02-10T08:28:14.159 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.159 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.160 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:28:14.160 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.486266+0000", 2024-02-10T08:28:14.160 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010999709999999999 2024-02-10T08:28:14.160 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.160 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.160 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:28:14.160 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.487366+0000", 2024-02-10T08:28:14.160 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1018000000000002e-05 2024-02-10T08:28:14.160 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.160 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.160 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:28:14.160 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.487457+0000", 2024-02-10T08:28:14.160 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3683000000000003e-05 2024-02-10T08:28:14.161 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.161 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.161 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:28:14.161 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.487491+0000", 2024-02-10T08:28:14.161 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0655999999999999e-05 2024-02-10T08:28:14.161 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.161 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.161 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:28:14.161 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.487522+0000", 2024-02-10T08:28:14.161 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.101875721 2024-02-10T08:28:14.161 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:14.161 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:28:14.161 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:14.161 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.161 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.161 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:29650 7.a 7:5b1dc048:::benchmark_data_smithi018_80623_object29649:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e96)", 2024-02-10T08:28:14.162 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:03.385714+0000", 2024-02-10T08:28:14.162 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 490.757710659, 2024-02-10T08:28:14.162 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.101736045, 2024-02-10T08:28:14.162 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:28:14.162 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:28:14.162 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:28:14.162 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:28:14.162 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:28:14.162 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 29650 2024-02-10T08:28:14.162 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.162 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:28:14.162 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.162 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:28:14.162 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.385714+0000", 2024-02-10T08:28:14.162 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:28:14.162 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.163 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.163 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:28:14.163 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.385714+0000", 2024-02-10T08:28:14.163 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:28:14.163 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.163 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.163 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:28:14.163 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.385713+0000", 2024-02-10T08:28:14.163 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1231000000000001e-05 2024-02-10T08:28:14.163 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.163 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.163 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:28:14.163 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.385734+0000", 2024-02-10T08:28:14.163 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3069999999999997e-06 2024-02-10T08:28:14.163 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.163 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.164 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:28:14.164 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.385742+0000", 2024-02-10T08:28:14.164 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.724e-06 2024-02-10T08:28:14.164 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.164 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.164 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:28:14.164 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.385746+0000", 2024-02-10T08:28:14.164 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4610000000000004e-05 2024-02-10T08:28:14.164 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.164 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.164 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:28:14.164 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.385841+0000", 2024-02-10T08:28:14.164 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000121997 2024-02-10T08:28:14.164 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.164 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.165 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:28:14.165 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.385963+0000", 2024-02-10T08:28:14.165 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012458900000000001 2024-02-10T08:28:14.165 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.165 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.165 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 2,5", 2024-02-10T08:28:14.165 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.386088+0000", 2024-02-10T08:28:14.165 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0022443770000000001 2024-02-10T08:28:14.165 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.165 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.165 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:28:14.165 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.388332+0000", 2024-02-10T08:28:14.165 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.097902377999999998 2024-02-10T08:28:14.165 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.165 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.165 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:28:14.165 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.486234+0000", 2024-02-10T08:28:14.166 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0011412320000000001 2024-02-10T08:28:14.166 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.166 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.166 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:28:14.166 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.487376+0000", 2024-02-10T08:28:14.166 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.019e-05 2024-02-10T08:28:14.166 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.166 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.166 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:28:14.166 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.487416+0000", 2024-02-10T08:28:14.166 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4168999999999998e-05 2024-02-10T08:28:14.166 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.166 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.166 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:28:14.167 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.487450+0000", 2024-02-10T08:28:14.167 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.101736045 2024-02-10T08:28:14.167 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:14.167 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:28:14.167 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:14.167 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.167 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.167 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:29651 7.3 7:ccbe6b35:::benchmark_data_smithi018_80623_object29650:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e96)", 2024-02-10T08:28:14.167 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:03.385752+0000", 2024-02-10T08:28:14.167 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 490.75767227599999, 2024-02-10T08:28:14.167 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.10009203999999999, 2024-02-10T08:28:14.167 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:28:14.167 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:28:14.167 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:28:14.167 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:28:14.168 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:28:14.168 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 29651 2024-02-10T08:28:14.168 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.168 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:28:14.168 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.168 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:28:14.168 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.385752+0000", 2024-02-10T08:28:14.168 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:28:14.168 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.168 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.168 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:28:14.168 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.385752+0000", 2024-02-10T08:28:14.168 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:28:14.168 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.169 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.169 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:28:14.169 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.385752+0000", 2024-02-10T08:28:14.169 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0015999999999999e-05 2024-02-10T08:28:14.169 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.169 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.169 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:28:14.169 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.385772+0000", 2024-02-10T08:28:14.169 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8220000000000001e-06 2024-02-10T08:28:14.169 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.169 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.169 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:28:14.169 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.385778+0000", 2024-02-10T08:28:14.169 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9400000000000001e-06 2024-02-10T08:28:14.169 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.170 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.170 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:28:14.170 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.385783+0000", 2024-02-10T08:28:14.170 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00026216199999999997 2024-02-10T08:28:14.170 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.170 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.170 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:28:14.170 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.386045+0000", 2024-02-10T08:28:14.170 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5407000000000003e-05 2024-02-10T08:28:14.170 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.170 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.170 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:28:14.170 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.386141+0000", 2024-02-10T08:28:14.170 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000114066 2024-02-10T08:28:14.171 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.171 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.171 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 2", 2024-02-10T08:28:14.171 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.386255+0000", 2024-02-10T08:28:14.171 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.098175977999999997 2024-02-10T08:28:14.171 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.171 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.171 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:28:14.171 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.484431+0000", 2024-02-10T08:28:14.171 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00127709 2024-02-10T08:28:14.171 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.171 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.171 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:28:14.171 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.485708+0000", 2024-02-10T08:28:14.171 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5793e-05 2024-02-10T08:28:14.171 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.172 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.172 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:28:14.172 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.485754+0000", 2024-02-10T08:28:14.172 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0465999999999997e-05 2024-02-10T08:28:14.172 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.172 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.172 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:28:14.172 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.485844+0000", 2024-02-10T08:28:14.172 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.10009203999999999 2024-02-10T08:28:14.172 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:14.172 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:28:14.172 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:14.172 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.172 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.173 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:29655 7.1 7:868ebe2c:::benchmark_data_smithi018_80623_object29654:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e96)", 2024-02-10T08:28:14.173 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:03.386018+0000", 2024-02-10T08:28:14.173 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 490.75740668999998, 2024-02-10T08:28:14.173 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.099118429999999993, 2024-02-10T08:28:14.173 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:28:14.173 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:28:14.173 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:28:14.173 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:28:14.173 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:28:14.173 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 29655 2024-02-10T08:28:14.173 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.173 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:28:14.173 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.173 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:28:14.174 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.386018+0000", 2024-02-10T08:28:14.174 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:28:14.174 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.174 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.174 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:28:14.174 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.386018+0000", 2024-02-10T08:28:14.174 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:28:14.174 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.174 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.174 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:28:14.174 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.386017+0000", 2024-02-10T08:28:14.174 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1338999999999998e-05 2024-02-10T08:28:14.174 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.174 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.174 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:28:14.175 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.386058+0000", 2024-02-10T08:28:14.175 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0569999999999999e-06 2024-02-10T08:28:14.175 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.175 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.175 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:28:14.175 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.386067+0000", 2024-02-10T08:28:14.175 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5309999999999998e-06 2024-02-10T08:28:14.175 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.175 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.175 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:28:14.175 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.386074+0000", 2024-02-10T08:28:14.175 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0012513610000000001 2024-02-10T08:28:14.175 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.175 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.175 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:28:14.175 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.387325+0000", 2024-02-10T08:28:14.176 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000108404 2024-02-10T08:28:14.176 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.176 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.176 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:28:14.176 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.387434+0000", 2024-02-10T08:28:14.176 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013600400000000001 2024-02-10T08:28:14.176 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.176 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.176 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 6", 2024-02-10T08:28:14.176 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.387570+0000", 2024-02-10T08:28:14.176 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.097056086 2024-02-10T08:28:14.176 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.176 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.176 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:28:14.176 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.484626+0000", 2024-02-10T08:28:14.176 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00036365300000000002 2024-02-10T08:28:14.177 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.177 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.177 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:28:14.177 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.484989+0000", 2024-02-10T08:28:14.177 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4522000000000003e-05 2024-02-10T08:28:14.177 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.177 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.177 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:28:14.177 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.485054+0000", 2024-02-10T08:28:14.177 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2381999999999998e-05 2024-02-10T08:28:14.177 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.177 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.177 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:28:14.177 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.485136+0000", 2024-02-10T08:28:14.177 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.099118429999999993 2024-02-10T08:28:14.177 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:14.178 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:28:14.178 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:14.178 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.178 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.178 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.14784.0:29654 7.c e96/91 7:3f3ccd71:::benchmark_data_smithi018_80623_object29653:head v 96'1898, mlcod=96'1896)", 2024-02-10T08:28:14.178 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:03.387784+0000", 2024-02-10T08:28:14.178 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 490.75564051800001, 2024-02-10T08:28:14.178 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.098473966999999996, 2024-02-10T08:28:14.178 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:28:14.178 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:28:14.178 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:28:14.178 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.178 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:28:14.178 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.387784+0000", 2024-02-10T08:28:14.178 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:28:14.179 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.179 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.179 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:28:14.179 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.387784+0000", 2024-02-10T08:28:14.179 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:28:14.179 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.179 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.179 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:28:14.179 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.387783+0000", 2024-02-10T08:28:14.179 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9694000000000003e-05 2024-02-10T08:28:14.179 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.179 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.179 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:28:14.179 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.387823+0000", 2024-02-10T08:28:14.179 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1661999999999999e-05 2024-02-10T08:28:14.180 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.180 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.180 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:28:14.180 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.387835+0000", 2024-02-10T08:28:14.180 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4920000000000001e-06 2024-02-10T08:28:14.180 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.180 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.180 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:28:14.180 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.387840+0000", 2024-02-10T08:28:14.180 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.261e-05 2024-02-10T08:28:14.180 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.180 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.181 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:28:14.181 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.387883+0000", 2024-02-10T08:28:14.181 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.278e-05 2024-02-10T08:28:14.181 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.181 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.181 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:28:14.181 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.387895+0000", 2024-02-10T08:28:14.181 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.098339181999999997 2024-02-10T08:28:14.181 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.181 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.181 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:28:14.181 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.486235+0000", 2024-02-10T08:28:14.181 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3314000000000001e-05 2024-02-10T08:28:14.182 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.182 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.182 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:28:14.182 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.486258+0000", 2024-02-10T08:28:14.182 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.098473966999999996 2024-02-10T08:28:14.182 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:14.182 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:28:14.182 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:14.182 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.182 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.182 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:29657 7.3 7:cb3f2498:::benchmark_data_smithi018_80623_object29656:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e96)", 2024-02-10T08:28:14.182 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:03.388325+0000", 2024-02-10T08:28:14.182 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 490.75509909200002, 2024-02-10T08:28:14.182 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.099903744000000003, 2024-02-10T08:28:14.182 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:28:14.182 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:28:14.183 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:28:14.183 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:28:14.183 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:28:14.183 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 29657 2024-02-10T08:28:14.183 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.183 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:28:14.183 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.183 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:28:14.183 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.388325+0000", 2024-02-10T08:28:14.183 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:28:14.183 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.183 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.183 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:28:14.183 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.388325+0000", 2024-02-10T08:28:14.183 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:28:14.183 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.184 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.184 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:28:14.184 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.388324+0000", 2024-02-10T08:28:14.184 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0960000000000002e-05 2024-02-10T08:28:14.184 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.184 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.184 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:28:14.184 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.388355+0000", 2024-02-10T08:28:14.184 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0456e-05 2024-02-10T08:28:14.184 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.184 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.184 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:28:14.184 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.388365+0000", 2024-02-10T08:28:14.184 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8329999999999999e-06 2024-02-10T08:28:14.184 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.184 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.185 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:28:14.185 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.388371+0000", 2024-02-10T08:28:14.185 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2771000000000001e-05 2024-02-10T08:28:14.185 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.185 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.185 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:28:14.185 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.388414+0000", 2024-02-10T08:28:14.185 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8628999999999994e-05 2024-02-10T08:28:14.185 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.185 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.185 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:28:14.185 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.388513+0000", 2024-02-10T08:28:14.185 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000138281 2024-02-10T08:28:14.185 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.185 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.186 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 2", 2024-02-10T08:28:14.186 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.388651+0000", 2024-02-10T08:28:14.186 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.095787248000000005 2024-02-10T08:28:14.186 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.186 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.186 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:28:14.186 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.484438+0000", 2024-02-10T08:28:14.186 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0036706299999999998 2024-02-10T08:28:14.186 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.186 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.186 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:28:14.186 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.488109+0000", 2024-02-10T08:28:14.186 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0945000000000002e-05 2024-02-10T08:28:14.186 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.186 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.186 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:28:14.187 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.488150+0000", 2024-02-10T08:28:14.187 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9522000000000002e-05 2024-02-10T08:28:14.187 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.187 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.187 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:28:14.187 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.488229+0000", 2024-02-10T08:28:14.187 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.099903744000000003 2024-02-10T08:28:14.187 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:14.187 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:28:14.187 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:14.187 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.187 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.187 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop_reply(client.14784.0:29655 7.1 e96/91 ondisk, result = 0)", 2024-02-10T08:28:14.187 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:03.388832+0000", 2024-02-10T08:28:14.187 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 490.75459252500002, 2024-02-10T08:28:14.188 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.09580052, 2024-02-10T08:28:14.188 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:28:14.188 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-02-10T08:28:14.188 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:28:14.188 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.188 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:28:14.188 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.388832+0000", 2024-02-10T08:28:14.188 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:28:14.188 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.188 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.188 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:28:14.188 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.388832+0000", 2024-02-10T08:28:14.188 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:28:14.188 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.188 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.189 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:28:14.189 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.388831+0000", 2024-02-10T08:28:14.189 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3399999999999997e-06 2024-02-10T08:28:14.189 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.189 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.189 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:28:14.189 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.388837+0000", 2024-02-10T08:28:14.189 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0763e-05 2024-02-10T08:28:14.189 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.189 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.189 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:28:14.189 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.388847+0000", 2024-02-10T08:28:14.189 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8209999999999998e-06 2024-02-10T08:28:14.189 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.190 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.190 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:28:14.190 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.388853+0000", 2024-02-10T08:28:14.190 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5278999999999999e-05 2024-02-10T08:28:14.190 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.190 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.190 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:28:14.190 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.388888+0000", 2024-02-10T08:28:14.190 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.095724862999999993 2024-02-10T08:28:14.190 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.190 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.190 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:28:14.190 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.484613+0000", 2024-02-10T08:28:14.191 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9184000000000001e-05 2024-02-10T08:28:14.191 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.191 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.191 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:28:14.191 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.484633+0000", 2024-02-10T08:28:14.191 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.09580052 2024-02-10T08:28:14.191 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:14.191 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:28:14.191 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:14.191 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.191 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.191 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.14784.0:29664 7.c e96/91 7:344c3984:::benchmark_data_smithi018_80623_object29663:head v 96'1899, mlcod=96'1896)", 2024-02-10T08:28:14.191 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:03.389862+0000", 2024-02-10T08:28:14.191 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 490.75356260299998, 2024-02-10T08:28:14.191 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.098684963000000001, 2024-02-10T08:28:14.192 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:28:14.192 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:28:14.192 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:28:14.192 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.192 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:28:14.192 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.389862+0000", 2024-02-10T08:28:14.192 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:28:14.192 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.192 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.192 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:28:14.192 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.389862+0000", 2024-02-10T08:28:14.192 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:28:14.192 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.193 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.193 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:28:14.193 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.389861+0000", 2024-02-10T08:28:14.193 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1804000000000002e-05 2024-02-10T08:28:14.193 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.193 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.193 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:28:14.193 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.389893+0000", 2024-02-10T08:28:14.193 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.094748447999999999 2024-02-10T08:28:14.193 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.193 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.193 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:28:14.193 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.484641+0000", 2024-02-10T08:28:14.193 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.452e-06 2024-02-10T08:28:14.193 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.194 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.194 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:28:14.194 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.484649+0000", 2024-02-10T08:28:14.194 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00052471799999999997 2024-02-10T08:28:14.194 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.194 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.194 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:28:14.194 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.485174+0000", 2024-02-10T08:28:14.194 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8352e-05 2024-02-10T08:28:14.194 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.194 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.194 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:28:14.194 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.485192+0000", 2024-02-10T08:28:14.194 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0033272380000000002 2024-02-10T08:28:14.195 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.195 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.195 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:28:14.195 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.488519+0000", 2024-02-10T08:28:14.195 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7634999999999999e-05 2024-02-10T08:28:14.195 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.195 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.195 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:28:14.195 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.488547+0000", 2024-02-10T08:28:14.195 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.098684963000000001 2024-02-10T08:28:14.195 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:14.195 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:28:14.195 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:14.195 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.196 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.196 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop_reply(client.14784.0:29649 7.2 e96/91 ondisk, result = 0)", 2024-02-10T08:28:14.196 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:03.391109+0000", 2024-02-10T08:28:14.196 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 490.75231523600002, 2024-02-10T08:28:14.196 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.095158392999999994, 2024-02-10T08:28:14.196 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:28:14.196 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-02-10T08:28:14.196 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:28:14.196 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.196 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:28:14.196 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.391109+0000", 2024-02-10T08:28:14.196 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:28:14.196 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.196 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.197 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:28:14.197 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.391109+0000", 2024-02-10T08:28:14.197 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:28:14.197 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.197 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.197 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:28:14.197 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.391109+0000", 2024-02-10T08:28:14.197 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6659999999999999e-06 2024-02-10T08:28:14.197 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.197 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.197 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:28:14.197 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.391113+0000", 2024-02-10T08:28:14.197 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.094337252999999996 2024-02-10T08:28:14.197 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.197 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.198 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:28:14.198 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.485451+0000", 2024-02-10T08:28:14.198 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1349999999999998e-06 2024-02-10T08:28:14.198 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.198 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.198 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:28:14.198 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.485460+0000", 2024-02-10T08:28:14.198 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00079593199999999995 2024-02-10T08:28:14.198 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.198 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.198 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:28:14.198 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.486256+0000", 2024-02-10T08:28:14.198 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2599999999999996e-06 2024-02-10T08:28:14.198 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.198 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.199 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:28:14.199 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.486261+0000", 2024-02-10T08:28:14.199 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8329999999999996e-06 2024-02-10T08:28:14.199 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.199 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.199 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:28:14.199 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.486268+0000", 2024-02-10T08:28:14.199 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.095158392999999994 2024-02-10T08:28:14.199 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:14.199 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:28:14.199 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:14.199 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.199 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.200 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.14784.0:77128 7.7 e107/91 7:e88de2a8:::benchmark_data_smithi018_80623_object77127:head v 107'4838, mlcod=107'4836)", 2024-02-10T08:28:14.200 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:42.059069+0000", 2024-02-10T08:28:14.200 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 452.08435599699999, 2024-02-10T08:28:14.200 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.10422234499999999, 2024-02-10T08:28:14.200 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:28:14.200 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:28:14.200 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:28:14.200 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.200 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:28:14.200 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.059069+0000", 2024-02-10T08:28:14.200 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:28:14.200 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.200 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.201 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:28:14.201 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.059069+0000", 2024-02-10T08:28:14.201 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:28:14.201 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.201 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.201 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:28:14.201 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.059068+0000", 2024-02-10T08:28:14.201 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3590999999999997e-05 2024-02-10T08:28:14.201 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.201 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.201 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:28:14.201 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.059101+0000", 2024-02-10T08:28:14.201 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9289999999999993e-06 2024-02-10T08:28:14.202 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.202 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.202 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:28:14.202 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.059111+0000", 2024-02-10T08:28:14.202 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.195e-06 2024-02-10T08:28:14.202 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.202 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.202 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:28:14.202 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.059117+0000", 2024-02-10T08:28:14.202 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0037655560000000002 2024-02-10T08:28:14.202 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.202 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.202 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:28:14.202 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.062883+0000", 2024-02-10T08:28:14.202 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0213000000000001e-05 2024-02-10T08:28:14.202 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.202 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.203 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:28:14.203 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.062903+0000", 2024-02-10T08:28:14.203 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.10035986700000001 2024-02-10T08:28:14.203 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.203 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.203 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:28:14.203 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.163263+0000", 2024-02-10T08:28:14.203 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7929e-05 2024-02-10T08:28:14.203 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.203 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.203 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:28:14.203 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.163291+0000", 2024-02-10T08:28:14.203 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.10422234499999999 2024-02-10T08:28:14.203 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:14.203 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:28:14.203 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:14.204 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.204 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.204 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.14784.0:77122 7.f e107/91 7:fbc1d2ad:::benchmark_data_smithi018_80623_object77121:head v 107'4810, mlcod=107'4808)", 2024-02-10T08:28:14.204 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:42.060195+0000", 2024-02-10T08:28:14.204 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 452.08322998400001, 2024-02-10T08:28:14.204 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.103133033, 2024-02-10T08:28:14.204 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:28:14.204 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:28:14.204 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:28:14.204 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.204 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:28:14.204 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.060195+0000", 2024-02-10T08:28:14.204 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:28:14.204 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.204 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.205 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:28:14.205 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.060195+0000", 2024-02-10T08:28:14.205 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:28:14.205 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.205 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.205 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:28:14.205 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.060194+0000", 2024-02-10T08:28:14.205 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3572999999999999e-05 2024-02-10T08:28:14.205 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.205 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.205 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:28:14.205 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.060217+0000", 2024-02-10T08:28:14.205 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6237999999999999e-05 2024-02-10T08:28:14.205 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.205 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.205 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:28:14.206 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.060233+0000", 2024-02-10T08:28:14.206 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7009999999999999e-06 2024-02-10T08:28:14.206 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.206 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.206 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:28:14.206 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.060240+0000", 2024-02-10T08:28:14.206 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0051317610000000003 2024-02-10T08:28:14.206 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.206 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.206 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:28:14.206 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.065372+0000", 2024-02-10T08:28:14.206 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9153000000000001e-05 2024-02-10T08:28:14.206 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.206 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.206 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:28:14.207 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.065391+0000", 2024-02-10T08:28:14.207 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.097902235000000004 2024-02-10T08:28:14.207 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.207 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.207 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:28:14.207 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.163293+0000", 2024-02-10T08:28:14.207 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4239999999999997e-05 2024-02-10T08:28:14.207 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.207 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.207 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:28:14.207 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.163328+0000", 2024-02-10T08:28:14.207 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.103133033 2024-02-10T08:28:14.207 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:14.207 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:28:14.207 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:14.208 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.208 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.208 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.14784.0:77130 7.f e107/91 7:ff8c0eaa:::benchmark_data_smithi018_80623_object77129:head v 107'4811, mlcod=107'4808)", 2024-02-10T08:28:14.208 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:42.066181+0000", 2024-02-10T08:28:14.208 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 452.07724312300002, 2024-02-10T08:28:14.208 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.097164088999999995, 2024-02-10T08:28:14.208 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:28:14.208 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:28:14.208 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:28:14.208 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.208 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:28:14.208 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.066181+0000", 2024-02-10T08:28:14.208 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:28:14.208 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.208 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.208 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:28:14.209 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.066181+0000", 2024-02-10T08:28:14.209 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:28:14.209 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.209 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.209 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:28:14.209 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.066181+0000", 2024-02-10T08:28:14.209 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2979000000000001e-05 2024-02-10T08:28:14.209 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.209 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.209 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:28:14.209 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.066204+0000", 2024-02-10T08:28:14.209 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5429999999999999e-06 2024-02-10T08:28:14.209 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.209 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.210 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:28:14.210 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.066210+0000", 2024-02-10T08:28:14.210 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2470000000000002e-06 2024-02-10T08:28:14.210 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.210 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.210 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:28:14.210 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.066215+0000", 2024-02-10T08:28:14.210 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0020595940000000001 2024-02-10T08:28:14.210 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.210 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.210 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:28:14.210 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.068274+0000", 2024-02-10T08:28:14.210 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0086999999999999e-05 2024-02-10T08:28:14.210 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.211 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.211 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:28:14.211 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.068294+0000", 2024-02-10T08:28:14.211 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.095037076999999998 2024-02-10T08:28:14.211 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.211 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.211 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:28:14.211 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.163331+0000", 2024-02-10T08:28:14.211 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4095e-05 2024-02-10T08:28:14.211 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.211 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.211 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:28:14.211 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.163345+0000", 2024-02-10T08:28:14.211 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.097164088999999995 2024-02-10T08:28:14.211 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:14.211 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:28:14.212 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:14.212 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.212 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.212 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.14784.0:77133 7.f e107/91 7:f016bff6:::benchmark_data_smithi018_80623_object77132:head v 107'4812, mlcod=107'4808)", 2024-02-10T08:28:14.212 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:42.069091+0000", 2024-02-10T08:28:14.212 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 452.07433339400001, 2024-02-10T08:28:14.212 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.094268312000000007, 2024-02-10T08:28:14.212 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:28:14.212 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:28:14.212 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:28:14.212 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.212 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:28:14.212 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.069091+0000", 2024-02-10T08:28:14.212 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:28:14.212 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.213 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.213 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:28:14.213 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.069091+0000", 2024-02-10T08:28:14.213 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:28:14.213 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.213 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.213 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:28:14.213 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.069090+0000", 2024-02-10T08:28:14.213 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7095999999999999e-05 2024-02-10T08:28:14.213 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.213 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.213 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:28:14.213 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.069117+0000", 2024-02-10T08:28:14.213 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9790000000000005e-06 2024-02-10T08:28:14.213 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.213 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.214 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:28:14.214 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.069127+0000", 2024-02-10T08:28:14.214 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0329999999999997e-06 2024-02-10T08:28:14.214 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.214 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.214 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:28:14.214 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.069133+0000", 2024-02-10T08:28:14.214 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001407541 2024-02-10T08:28:14.214 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.214 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.214 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:28:14.214 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.070541+0000", 2024-02-10T08:28:14.214 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086372666000000001 2024-02-10T08:28:14.214 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.214 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.214 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:28:14.214 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.156914+0000", 2024-02-10T08:28:14.215 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0064336209999999996 2024-02-10T08:28:14.215 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.215 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.215 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:28:14.215 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.163347+0000", 2024-02-10T08:28:14.215 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2243e-05 2024-02-10T08:28:14.215 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.215 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.215 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:28:14.215 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.163359+0000", 2024-02-10T08:28:14.215 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.094268312000000007 2024-02-10T08:28:14.215 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:14.215 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:28:14.215 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:14.215 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.215 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.216 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.14784.0:77132 7.6 e107/91 7:6a0a2bbe:::benchmark_data_smithi018_80623_object77131:head v 107'4728, mlcod=107'4725)", 2024-02-10T08:28:14.216 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:42.069143+0000", 2024-02-10T08:28:14.216 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 452.07428114700002, 2024-02-10T08:28:14.216 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.090677862999999997, 2024-02-10T08:28:14.216 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:28:14.216 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:28:14.216 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:28:14.216 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.216 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:28:14.216 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.069143+0000", 2024-02-10T08:28:14.216 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:28:14.216 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.216 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.217 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:28:14.217 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.069143+0000", 2024-02-10T08:28:14.217 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:28:14.217 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.217 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.217 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:28:14.217 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.069143+0000", 2024-02-10T08:28:14.217 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3553999999999998e-05 2024-02-10T08:28:14.217 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.217 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.217 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:28:14.217 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.069166+0000", 2024-02-10T08:28:14.217 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3790000000000003e-06 2024-02-10T08:28:14.217 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.217 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.218 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:28:14.218 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.069173+0000", 2024-02-10T08:28:14.218 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5499999999999996e-06 2024-02-10T08:28:14.218 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.218 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.218 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:28:14.218 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.069177+0000", 2024-02-10T08:28:14.218 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3005e-05 2024-02-10T08:28:14.218 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.218 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.218 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:28:14.218 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.069210+0000", 2024-02-10T08:28:14.218 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9902999999999999e-05 2024-02-10T08:28:14.218 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.218 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.218 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:28:14.218 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.069230+0000", 2024-02-10T08:28:14.219 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.090549527000000005 2024-02-10T08:28:14.219 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.219 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.219 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:28:14.219 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.159780+0000", 2024-02-10T08:28:14.219 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1525e-05 2024-02-10T08:28:14.219 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.219 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.219 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:28:14.219 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.159821+0000", 2024-02-10T08:28:14.219 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.090677862999999997 2024-02-10T08:28:14.219 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:14.219 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:28:14.219 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:14.219 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.220 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.220 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.14784.0:77135 7.f e107/91 7:f81e7e4c:::benchmark_data_smithi018_80623_object77134:head v 107'4813, mlcod=107'4808)", 2024-02-10T08:28:14.220 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:42.069629+0000", 2024-02-10T08:28:14.220 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 452.07379586299999, 2024-02-10T08:28:14.220 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.094352981000000002, 2024-02-10T08:28:14.220 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:28:14.220 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:28:14.220 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:28:14.220 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.220 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:28:14.220 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.069629+0000", 2024-02-10T08:28:14.220 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:28:14.220 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.220 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.221 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:28:14.221 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.069629+0000", 2024-02-10T08:28:14.221 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:28:14.221 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.221 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.221 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:28:14.221 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.069628+0000", 2024-02-10T08:28:14.221 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2112000000000001e-05 2024-02-10T08:28:14.221 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.221 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.221 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:28:14.221 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.069650+0000", 2024-02-10T08:28:14.221 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3100000000000006e-06 2024-02-10T08:28:14.221 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.221 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.221 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:28:14.222 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.069659+0000", 2024-02-10T08:28:14.222 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4979999999999997e-06 2024-02-10T08:28:14.222 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.222 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.222 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:28:14.222 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.069665+0000", 2024-02-10T08:28:14.222 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.090952846000000004 2024-02-10T08:28:14.222 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.222 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.222 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:28:14.222 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.160618+0000", 2024-02-10T08:28:14.222 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9514999999999999e-05 2024-02-10T08:28:14.222 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.222 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.222 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:28:14.223 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.160637+0000", 2024-02-10T08:28:14.223 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.003312822 2024-02-10T08:28:14.223 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.223 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.223 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:28:14.223 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.163950+0000", 2024-02-10T08:28:14.223 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1473999999999997e-05 2024-02-10T08:28:14.223 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.223 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.223 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:28:14.223 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.163982+0000", 2024-02-10T08:28:14.223 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.094352981000000002 2024-02-10T08:28:14.223 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:14.223 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:28:14.223 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:14.223 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.224 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.224 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:77138 7.3 7:cbb2b15e:::benchmark_data_smithi018_80623_object77137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e107)", 2024-02-10T08:28:14.224 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:42.071482+0000", 2024-02-10T08:28:14.224 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 452.071942041, 2024-02-10T08:28:14.224 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.093265420000000002, 2024-02-10T08:28:14.224 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:28:14.224 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:28:14.224 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:28:14.224 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:28:14.224 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:28:14.224 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 77138 2024-02-10T08:28:14.225 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.225 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:28:14.225 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.225 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:28:14.225 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.071482+0000", 2024-02-10T08:28:14.225 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:28:14.225 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.225 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.225 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:28:14.225 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.071482+0000", 2024-02-10T08:28:14.225 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999981 2024-02-10T08:28:14.225 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.225 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.225 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:28:14.225 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.071481+0000", 2024-02-10T08:28:14.226 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0560999999999998e-05 2024-02-10T08:28:14.226 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.226 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.226 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:28:14.226 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.071501+0000", 2024-02-10T08:28:14.226 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.085323494 2024-02-10T08:28:14.226 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.226 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.226 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:28:14.226 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.156825+0000", 2024-02-10T08:28:14.226 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6481e-05 2024-02-10T08:28:14.226 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.226 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.226 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:28:14.226 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.156841+0000", 2024-02-10T08:28:14.226 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00024292199999999999 2024-02-10T08:28:14.227 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.227 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.227 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:28:14.227 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.157084+0000", 2024-02-10T08:28:14.227 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015046100000000001 2024-02-10T08:28:14.227 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.227 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.227 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:28:14.227 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.157235+0000", 2024-02-10T08:28:14.227 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018826699999999999 2024-02-10T08:28:14.227 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.227 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.227 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 2", 2024-02-10T08:28:14.227 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.157423+0000", 2024-02-10T08:28:14.227 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0043834249999999998 2024-02-10T08:28:14.227 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.228 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.228 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:28:14.228 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.161806+0000", 2024-02-10T08:28:14.228 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0028096530000000001 2024-02-10T08:28:14.228 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.228 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.228 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:28:14.228 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.164616+0000", 2024-02-10T08:28:14.228 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6128000000000003e-05 2024-02-10T08:28:14.228 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.228 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.228 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:28:14.228 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.164662+0000", 2024-02-10T08:28:14.229 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5844e-05 2024-02-10T08:28:14.229 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.229 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.229 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:28:14.229 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.164748+0000", 2024-02-10T08:28:14.229 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.093265420000000002 2024-02-10T08:28:14.229 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:14.229 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:28:14.229 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:14.229 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.229 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.229 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.14784.0:130005 7.c e135/91 7:363dee26:::benchmark_data_smithi018_80623_object29077:head v 135'8320, mlcod=135'8317)", 2024-02-10T08:28:14.229 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:22:02.881527+0000", 2024-02-10T08:28:14.229 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 371.261897901, 2024-02-10T08:28:14.230 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.088328176999999994, 2024-02-10T08:28:14.230 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:28:14.230 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:28:14.230 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:28:14.230 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.230 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:28:14.230 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:02.881527+0000", 2024-02-10T08:28:14.230 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:28:14.230 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.230 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.230 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:28:14.230 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:02.881527+0000", 2024-02-10T08:28:14.230 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:28:14.230 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.230 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.230 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:28:14.231 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:02.881526+0000", 2024-02-10T08:28:14.231 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6500000000000001e-06 2024-02-10T08:28:14.231 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.231 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.231 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:28:14.231 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:02.881532+0000", 2024-02-10T08:28:14.231 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6219999999999998e-06 2024-02-10T08:28:14.231 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.231 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.231 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:28:14.231 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:02.881540+0000", 2024-02-10T08:28:14.232 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0219999999999999e-06 2024-02-10T08:28:14.232 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.232 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.232 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:28:14.232 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:02.881547+0000", 2024-02-10T08:28:14.232 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0032073039999999998 2024-02-10T08:28:14.232 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.232 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.232 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:28:14.232 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:02.884755+0000", 2024-02-10T08:28:14.232 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0207000000000002e-05 2024-02-10T08:28:14.232 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.232 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.232 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:28:14.233 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:02.884775+0000", 2024-02-10T08:28:14.233 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.014928784 2024-02-10T08:28:14.233 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.233 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.233 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:28:14.233 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:02.899704+0000", 2024-02-10T08:28:14.233 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.070151141 2024-02-10T08:28:14.233 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.233 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.233 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:28:14.233 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:02.969855+0000", 2024-02-10T08:28:14.233 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.088328176999999994 2024-02-10T08:28:14.233 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:14.233 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:28:14.233 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:14.234 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.234 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.234 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:179943 7.1 7:8254db62:::benchmark_data_smithi018_80623_object79015:head [delete] snapc 0=[] ondisk+write+known_if_redirected e163)", 2024-02-10T08:28:14.234 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:23:14.119071+0000", 2024-02-10T08:28:14.234 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 300.024353249, 2024-02-10T08:28:14.234 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.04500525, 2024-02-10T08:28:14.234 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:28:14.234 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:28:14.234 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:28:14.234 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:28:14.234 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:28:14.234 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 179943 2024-02-10T08:28:14.234 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.234 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:28:14.234 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.234 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:28:14.235 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.119071+0000", 2024-02-10T08:28:14.235 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:28:14.235 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.235 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.235 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:28:14.235 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.119071+0000", 2024-02-10T08:28:14.235 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999981 2024-02-10T08:28:14.235 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.235 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.235 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:28:14.235 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.119069+0000", 2024-02-10T08:28:14.235 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1390000000000001e-06 2024-02-10T08:28:14.235 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.235 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.235 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:28:14.236 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.119079+0000", 2024-02-10T08:28:14.236 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3317e-05 2024-02-10T08:28:14.236 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.236 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.236 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:28:14.236 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.119092+0000", 2024-02-10T08:28:14.236 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9020000000000002e-06 2024-02-10T08:28:14.236 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.236 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.236 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:28:14.236 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.119099+0000", 2024-02-10T08:28:14.236 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4695999999999999e-05 2024-02-10T08:28:14.236 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.236 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.236 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:28:14.237 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.119154+0000", 2024-02-10T08:28:14.237 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4891e-05 2024-02-10T08:28:14.237 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.237 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.237 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:28:14.237 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.119168+0000", 2024-02-10T08:28:14.237 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.040161903 2024-02-10T08:28:14.237 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.237 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.237 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:28:14.237 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.159330+0000", 2024-02-10T08:28:14.237 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000159839 2024-02-10T08:28:14.237 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.237 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.237 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:28:14.237 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.159490+0000", 2024-02-10T08:28:14.238 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016440500000000001 2024-02-10T08:28:14.238 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.238 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.238 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1,4,6", 2024-02-10T08:28:14.238 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.159655+0000", 2024-02-10T08:28:14.238 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0030797699999999999 2024-02-10T08:28:14.238 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.238 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.238 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:28:14.238 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.162734+0000", 2024-02-10T08:28:14.238 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6673000000000004e-05 2024-02-10T08:28:14.238 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.238 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.238 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:28:14.238 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.162801+0000", 2024-02-10T08:28:14.239 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.117e-05 2024-02-10T08:28:14.239 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.239 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.239 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:28:14.239 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.162812+0000", 2024-02-10T08:28:14.239 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001065882 2024-02-10T08:28:14.239 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.239 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.239 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:28:14.239 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.163878+0000", 2024-02-10T08:28:14.239 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1802000000000002e-05 2024-02-10T08:28:14.239 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.239 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.239 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:28:14.239 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.163940+0000", 2024-02-10T08:28:14.240 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000136637 2024-02-10T08:28:14.240 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:14.240 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:14.240 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:28:14.240 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.164077+0000", 2024-02-10T08:28:14.240 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.04500525 2024-02-10T08:28:14.240 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:14.240 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:28:14.240 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:14.240 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:14.240 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:28:14.240 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-02-10T08:28:14.241 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:12.810623+0000 mgr.y (mgr.14505) 433 : cluster [DBG] pgmap v514: 158 pgs: 1 active+remapped+backfill_toofull, 157 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 318 op/s; 472 KiB/s, 11 objects/s recovering 2024-02-10T08:28:14.241 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:28:13.793382+0000 mon.a (mon.0) 1245 : audit [INF] from='client.? 172.21.15.18:0/3191731554' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:28:14.242 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:12.810623+0000 mgr.y (mgr.14505) 433 : cluster [DBG] pgmap v514: 158 pgs: 1 active+remapped+backfill_toofull, 157 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 318 op/s; 472 KiB/s, 11 objects/s recovering 2024-02-10T08:28:14.242 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:28:13.793382+0000 mon.a (mon.0) 1245 : audit [INF] from='client.? 172.21.15.18:0/3191731554' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:28:14.242 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:12.810623+0000 mgr.y (mgr.14505) 433 : cluster [DBG] pgmap v514: 158 pgs: 1 active+remapped+backfill_toofull, 157 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 318 op/s; 472 KiB/s, 11 objects/s recovering 2024-02-10T08:28:14.242 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:28:13.793382+0000 mon.a (mon.0) 1245 : audit [INF] from='client.? 172.21.15.18:0/3191731554' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:28:14.243 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:14.243 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:14.243 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:28:14.243 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:28:14.344 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:28:14.375 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:14.573 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:28:14.576 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:14.577 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:28:14.677 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:28:14.705 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:14.725 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:28:14.728 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:14.728 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:28:14.829 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:28:14.856 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:14.874 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:28:14.877 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:13.863137+0000 mon.a (mon.0) 1246 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:28:14.877 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:28:13.867272+0000 mon.a (mon.0) 1247 : audit [INF] from='client.? 172.21.15.18:0/3191731554' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-10T08:28:14.877 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:13.867330+0000 mon.a (mon.0) 1248 : cluster [DBG] osdmap e248: 8 total, 8 up, 8 in 2024-02-10T08:28:14.877 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:14.878 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:28:14.978 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:28:15.008 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:15.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:13.863137+0000 mon.a (mon.0) 1246 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:28:15.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:28:13.867272+0000 mon.a (mon.0) 1247 : audit [INF] from='client.? 172.21.15.18:0/3191731554' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-10T08:28:15.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:13.867330+0000 mon.a (mon.0) 1248 : cluster [DBG] osdmap e248: 8 total, 8 up, 8 in 2024-02-10T08:28:15.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:13.863137+0000 mon.a (mon.0) 1246 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:28:15.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:28:13.867272+0000 mon.a (mon.0) 1247 : audit [INF] from='client.? 172.21.15.18:0/3191731554' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-10T08:28:15.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:13.867330+0000 mon.a (mon.0) 1248 : cluster [DBG] osdmap e248: 8 total, 8 up, 8 in 2024-02-10T08:28:15.597 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.5 dump_ops_in_flight 2024-02-10T08:28:15.758 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:28:15.762 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:15.763 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:28:15.842 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:28:15.847 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:28:15.863 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:28:15.864 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:28:15.879 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:13.998895+0000 osd.4 (osd.4) 52 : cluster [DBG] 4.d scrub starts 2024-02-10T08:28:15.880 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:14.001121+0000 osd.4 (osd.4) 53 : cluster [DBG] 4.d scrub ok 2024-02-10T08:28:15.897 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:16.132 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:13.998895+0000 osd.4 (osd.4) 52 : cluster [DBG] 4.d scrub starts 2024-02-10T08:28:16.133 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:14.001121+0000 osd.4 (osd.4) 53 : cluster [DBG] 4.d scrub ok 2024-02-10T08:28:16.133 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:14.811016+0000 mgr.y (mgr.14505) 434 : cluster [DBG] pgmap v516: 158 pgs: 1 active+remapped+backfill_toofull, 157 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 279 op/s; 208 B/s, 3 objects/s recovering 2024-02-10T08:28:16.133 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:15.047416+0000 osd.0 (osd.0) 116 : cluster [DBG] 4.b scrub starts 2024-02-10T08:28:16.133 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:15.049055+0000 osd.0 (osd.0) 117 : cluster [DBG] 4.b scrub ok 2024-02-10T08:28:16.133 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:15.252238+0000 osd.5 (osd.5) 133 : cluster [DBG] 2.1e scrub starts 2024-02-10T08:28:16.133 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:15.255128+0000 osd.5 (osd.5) 134 : cluster [DBG] 2.1e scrub ok 2024-02-10T08:28:16.133 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:14.811016+0000 mgr.y (mgr.14505) 434 : cluster [DBG] pgmap v516: 158 pgs: 1 active+remapped+backfill_toofull, 157 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 279 op/s; 208 B/s, 3 objects/s recovering 2024-02-10T08:28:16.133 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:15.047416+0000 osd.0 (osd.0) 116 : cluster [DBG] 4.b scrub starts 2024-02-10T08:28:16.133 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:15.049055+0000 osd.0 (osd.0) 117 : cluster [DBG] 4.b scrub ok 2024-02-10T08:28:16.133 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:15.252238+0000 osd.5 (osd.5) 133 : cluster [DBG] 2.1e scrub starts 2024-02-10T08:28:16.133 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:15.255128+0000 osd.5 (osd.5) 134 : cluster [DBG] 2.1e scrub ok 2024-02-10T08:28:16.141 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:13.998895+0000 osd.4 (osd.4) 52 : cluster [DBG] 4.d scrub starts 2024-02-10T08:28:16.141 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:14.001121+0000 osd.4 (osd.4) 53 : cluster [DBG] 4.d scrub ok 2024-02-10T08:28:16.141 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:14.811016+0000 mgr.y (mgr.14505) 434 : cluster [DBG] pgmap v516: 158 pgs: 1 active+remapped+backfill_toofull, 157 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 279 op/s; 208 B/s, 3 objects/s recovering 2024-02-10T08:28:16.141 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:15.047416+0000 osd.0 (osd.0) 116 : cluster [DBG] 4.b scrub starts 2024-02-10T08:28:16.141 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:15.049055+0000 osd.0 (osd.0) 117 : cluster [DBG] 4.b scrub ok 2024-02-10T08:28:16.141 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:15.252238+0000 osd.5 (osd.5) 133 : cluster [DBG] 2.1e scrub starts 2024-02-10T08:28:16.141 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:15.255128+0000 osd.5 (osd.5) 134 : cluster [DBG] 2.1e scrub ok 2024-02-10T08:28:16.745 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:28:16.748 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:16.748 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:28:16.789 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:28:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:28:16] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:28:16.849 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:28:16.880 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:16.903 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:28:16.905 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:16.905 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:28:17.006 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:28:17.036 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:17.066 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 3, 4, 5, 6, 7, 0] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 5, 6, 7, 4] 2024-02-10T08:28:17.066 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-10T08:28:17.066 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-02-10T08:28:17.066 INFO:tasks.thrashosds.thrasher:Setting osd 0 primary_affinity to 1.000000 2024-02-10T08:28:17.067 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd primary-affinity 0 1 2024-02-10T08:28:17.093 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:16.091331+0000 osd.7 (osd.7) 135 : cluster [DBG] 6.5 scrub starts 2024-02-10T08:28:17.093 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:16.113685+0000 osd.7 (osd.7) 136 : cluster [DBG] 6.5 scrub ok 2024-02-10T08:28:17.093 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:16.287562+0000 osd.5 (osd.5) 135 : cluster [DBG] 5.15 scrub starts 2024-02-10T08:28:17.093 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:16.291051+0000 osd.5 (osd.5) 136 : cluster [DBG] 5.15 scrub ok 2024-02-10T08:28:17.093 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:28:16.655795+0000 mon.a (mon.0) 1249 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:28:17.094 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:16.091331+0000 osd.7 (osd.7) 135 : cluster [DBG] 6.5 scrub starts 2024-02-10T08:28:17.094 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:16.113685+0000 osd.7 (osd.7) 136 : cluster [DBG] 6.5 scrub ok 2024-02-10T08:28:17.094 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:16.287562+0000 osd.5 (osd.5) 135 : cluster [DBG] 5.15 scrub starts 2024-02-10T08:28:17.094 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:16.291051+0000 osd.5 (osd.5) 136 : cluster [DBG] 5.15 scrub ok 2024-02-10T08:28:17.094 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:28:16.655795+0000 mon.a (mon.0) 1249 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:28:17.154 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:16.091331+0000 osd.7 (osd.7) 135 : cluster [DBG] 6.5 scrub starts 2024-02-10T08:28:17.155 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:16.113685+0000 osd.7 (osd.7) 136 : cluster [DBG] 6.5 scrub ok 2024-02-10T08:28:17.155 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:16.287562+0000 osd.5 (osd.5) 135 : cluster [DBG] 5.15 scrub starts 2024-02-10T08:28:17.155 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:16.291051+0000 osd.5 (osd.5) 136 : cluster [DBG] 5.15 scrub ok 2024-02-10T08:28:17.155 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:28:16.655795+0000 mon.a (mon.0) 1249 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:28:17.161 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:28:17.163 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:17.164 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:28:17.265 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:28:17.292 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:17.389 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:28:17.393 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:17.394 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:28:17.404 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:28:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:28:17] "GET /metrics HTTP/1.1" 200 176028 "" "Prometheus/2.33.4" 2024-02-10T08:28:17.495 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:28:17.523 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:17.542 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:28:17.544 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:17.545 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:28:17.645 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:28:17.658 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-02-10T08:28:17.658 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-02-10T08:28:17.658 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-02-10T08:28:17.658 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-02-10T08:28:17.672 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:17.691 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:28:17.693 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:17.694 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:28:17.775 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd unset nodeep-scrub 2024-02-10T08:28:17.795 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:28:17.848 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:17.952 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:28:17.955 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:17.956 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:28:17.997 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:16.811470+0000 mgr.y (mgr.14505) 435 : cluster [DBG] pgmap v517: 158 pgs: 1 active+remapped+backfill_toofull, 157 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 225 op/s; 168 B/s, 2 objects/s recovering 2024-02-10T08:28:17.997 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:17.047861+0000 osd.7 (osd.7) 137 : cluster [DBG] 6.3 scrub starts 2024-02-10T08:28:17.998 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:17.059693+0000 osd.7 (osd.7) 138 : cluster [DBG] 6.3 scrub ok 2024-02-10T08:28:17.998 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:28:17.649999+0000 mon.a (mon.0) 1250 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 0]}]: dispatch 2024-02-10T08:28:17.998 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:28:17.650278+0000 mon.a (mon.0) 1251 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.1b", "id": [0, 6]}]: dispatch 2024-02-10T08:28:17.998 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:28:17.650458+0000 mon.a (mon.0) 1252 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.0", "id": [2, 1]}]: dispatch 2024-02-10T08:28:17.998 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:28:17.650677+0000 mon.a (mon.0) 1253 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.4", "id": [6, 3]}]: dispatch 2024-02-10T08:28:17.998 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:28:17.650860+0000 mon.a (mon.0) 1254 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.f", "id": [2, 0]}]: dispatch 2024-02-10T08:28:17.998 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:28:17.651027+0000 mon.a (mon.0) 1255 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.14", "id": [2, 0, 7, 5]}]: dispatch 2024-02-10T08:28:17.998 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:28:17.651207+0000 mon.a (mon.0) 1256 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.23", "id": [6, 0]}]: dispatch 2024-02-10T08:28:18.057 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:28:18.083 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:18.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:16.811470+0000 mgr.y (mgr.14505) 435 : cluster [DBG] pgmap v517: 158 pgs: 1 active+remapped+backfill_toofull, 157 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 225 op/s; 168 B/s, 2 objects/s recovering 2024-02-10T08:28:18.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:17.047861+0000 osd.7 (osd.7) 137 : cluster [DBG] 6.3 scrub starts 2024-02-10T08:28:18.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:17.059693+0000 osd.7 (osd.7) 138 : cluster [DBG] 6.3 scrub ok 2024-02-10T08:28:18.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:28:17.649999+0000 mon.a (mon.0) 1250 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 0]}]: dispatch 2024-02-10T08:28:18.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:28:17.650278+0000 mon.a (mon.0) 1251 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.1b", "id": [0, 6]}]: dispatch 2024-02-10T08:28:18.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:28:17.650458+0000 mon.a (mon.0) 1252 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.0", "id": [2, 1]}]: dispatch 2024-02-10T08:28:18.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:28:17.650677+0000 mon.a (mon.0) 1253 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.4", "id": [6, 3]}]: dispatch 2024-02-10T08:28:18.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:28:17.650860+0000 mon.a (mon.0) 1254 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.f", "id": [2, 0]}]: dispatch 2024-02-10T08:28:18.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:28:17.651027+0000 mon.a (mon.0) 1255 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.14", "id": [2, 0, 7, 5]}]: dispatch 2024-02-10T08:28:18.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:28:17.651207+0000 mon.a (mon.0) 1256 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.23", "id": [6, 0]}]: dispatch 2024-02-10T08:28:18.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:16.811470+0000 mgr.y (mgr.14505) 435 : cluster [DBG] pgmap v517: 158 pgs: 1 active+remapped+backfill_toofull, 157 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 225 op/s; 168 B/s, 2 objects/s recovering 2024-02-10T08:28:18.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:17.047861+0000 osd.7 (osd.7) 137 : cluster [DBG] 6.3 scrub starts 2024-02-10T08:28:18.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:17.059693+0000 osd.7 (osd.7) 138 : cluster [DBG] 6.3 scrub ok 2024-02-10T08:28:18.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:28:17.649999+0000 mon.a (mon.0) 1250 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 0]}]: dispatch 2024-02-10T08:28:18.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:28:17.650278+0000 mon.a (mon.0) 1251 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.1b", "id": [0, 6]}]: dispatch 2024-02-10T08:28:18.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:28:17.650458+0000 mon.a (mon.0) 1252 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.0", "id": [2, 1]}]: dispatch 2024-02-10T08:28:18.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:28:17.650677+0000 mon.a (mon.0) 1253 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.4", "id": [6, 3]}]: dispatch 2024-02-10T08:28:18.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:28:17.650860+0000 mon.a (mon.0) 1254 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.f", "id": [2, 0]}]: dispatch 2024-02-10T08:28:18.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:28:17.651027+0000 mon.a (mon.0) 1255 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.14", "id": [2, 0, 7, 5]}]: dispatch 2024-02-10T08:28:18.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:28:17.651207+0000 mon.a (mon.0) 1256 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.23", "id": [6, 0]}]: dispatch 2024-02-10T08:28:18.287 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:28:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:28:18.304 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.5 dump_blocked_ops 2024-02-10T08:28:18.332 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:28:18.335 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:18.335 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:28:18.436 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:28:18.466 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:18.486 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:28:18.489 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:18.490 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:28:18.591 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:28:18.593 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:28:18.619 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:18.867 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:28:18.870 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:18.870 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:28:18.935 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'unique_pool_1' removed 2024-02-10T08:28:18.971 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:28:19.014 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:19.033 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:28:19.038 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:19.038 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:28:19.139 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:28:19.164 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:28:17.882738+0000 mon.a (mon.0) 1257 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 0]}]': finished 2024-02-10T08:28:19.164 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:28:17.882795+0000 mon.a (mon.0) 1258 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.1b", "id": [0, 6]}]': finished 2024-02-10T08:28:19.165 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:28:17.882848+0000 mon.a (mon.0) 1259 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.0", "id": [2, 1]}]': finished 2024-02-10T08:28:19.165 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:28:17.882909+0000 mon.a (mon.0) 1260 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.4", "id": [6, 3]}]': finished 2024-02-10T08:28:19.165 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:28:17.882983+0000 mon.a (mon.0) 1261 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.f", "id": [2, 0]}]': finished 2024-02-10T08:28:19.165 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:28:17.883051+0000 mon.a (mon.0) 1262 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.14", "id": [2, 0, 7, 5]}]': finished 2024-02-10T08:28:19.165 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:28:17.883104+0000 mon.a (mon.0) 1263 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.23", "id": [6, 0]}]': finished 2024-02-10T08:28:19.165 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:17.883131+0000 mon.a (mon.0) 1264 : cluster [DBG] osdmap e249: 8 total, 8 up, 8 in 2024-02-10T08:28:19.165 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:18.048370+0000 osd.7 (osd.7) 139 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:28:19.165 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:18.048410+0000 osd.7 (osd.7) 140 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:28:19.165 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:18.093292+0000 osd.7 (osd.7) 141 : cluster [DBG] 6.21 scrub starts 2024-02-10T08:28:19.165 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:18.099171+0000 osd.7 (osd.7) 142 : cluster [DBG] 6.21 scrub ok 2024-02-10T08:28:19.165 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:18.106724+0000 osd.2 (osd.2) 113 : cluster [DBG] 4.f scrub starts 2024-02-10T08:28:19.165 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:18.108703+0000 osd.2 (osd.2) 114 : cluster [DBG] 4.f scrub ok 2024-02-10T08:28:19.165 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:28:18.159584+0000 mgr.y (mgr.14505) 436 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:28:19.165 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:18.281833+0000 osd.5 (osd.5) 137 : cluster [DBG] 5.f scrub starts 2024-02-10T08:28:19.166 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:18.284747+0000 osd.5 (osd.5) 138 : cluster [DBG] 5.f scrub ok 2024-02-10T08:28:19.166 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:18.490751+0000 osd.6 (osd.6) 105 : cluster [DBG] 5.3 scrub starts 2024-02-10T08:28:19.166 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:18.492198+0000 osd.6 (osd.6) 106 : cluster [DBG] 5.3 scrub ok 2024-02-10T08:28:19.166 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:28:18.685131+0000 mon.c (mon.2) 55 : audit [INF] from='client.? 172.21.15.18:0/3759704210' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_1", "pool2": "unique_pool_1", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-10T08:28:19.166 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:28:18.685481+0000 mon.a (mon.0) 1265 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_1", "pool2": "unique_pool_1", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-10T08:28:19.166 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:28:18.883770+0000 mon.a (mon.0) 1266 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_1", "pool2": "unique_pool_1", "yes_i_really_really_mean_it": true}]': finished 2024-02-10T08:28:19.166 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:18.883858+0000 mon.a (mon.0) 1267 : cluster [DBG] osdmap e250: 8 total, 8 up, 8 in 2024-02-10T08:28:19.166 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:19.342 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:28:17.882738+0000 mon.a (mon.0) 1257 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 0]}]': finished 2024-02-10T08:28:19.342 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:28:17.882795+0000 mon.a (mon.0) 1258 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.1b", "id": [0, 6]}]': finished 2024-02-10T08:28:19.342 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:28:17.882848+0000 mon.a (mon.0) 1259 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.0", "id": [2, 1]}]': finished 2024-02-10T08:28:19.342 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:28:17.882909+0000 mon.a (mon.0) 1260 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.4", "id": [6, 3]}]': finished 2024-02-10T08:28:19.342 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:28:17.882983+0000 mon.a (mon.0) 1261 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.f", "id": [2, 0]}]': finished 2024-02-10T08:28:19.342 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:28:17.883051+0000 mon.a (mon.0) 1262 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.14", "id": [2, 0, 7, 5]}]': finished 2024-02-10T08:28:19.342 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:28:17.883104+0000 mon.a (mon.0) 1263 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.23", "id": [6, 0]}]': finished 2024-02-10T08:28:19.342 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:17.883131+0000 mon.a (mon.0) 1264 : cluster [DBG] osdmap e249: 8 total, 8 up, 8 in 2024-02-10T08:28:19.342 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:18.048370+0000 osd.7 (osd.7) 139 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:28:19.343 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:18.048410+0000 osd.7 (osd.7) 140 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:28:19.343 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:18.093292+0000 osd.7 (osd.7) 141 : cluster [DBG] 6.21 scrub starts 2024-02-10T08:28:19.343 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:18.099171+0000 osd.7 (osd.7) 142 : cluster [DBG] 6.21 scrub ok 2024-02-10T08:28:19.343 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:18.106724+0000 osd.2 (osd.2) 113 : cluster [DBG] 4.f scrub starts 2024-02-10T08:28:19.343 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:18.108703+0000 osd.2 (osd.2) 114 : cluster [DBG] 4.f scrub ok 2024-02-10T08:28:19.343 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:28:18.159584+0000 mgr.y (mgr.14505) 436 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:28:19.343 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:18.281833+0000 osd.5 (osd.5) 137 : cluster [DBG] 5.f scrub starts 2024-02-10T08:28:19.343 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:18.284747+0000 osd.5 (osd.5) 138 : cluster [DBG] 5.f scrub ok 2024-02-10T08:28:19.343 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:28:17.882738+0000 mon.a (mon.0) 1257 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 0]}]': finished 2024-02-10T08:28:19.343 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:28:17.882795+0000 mon.a (mon.0) 1258 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.1b", "id": [0, 6]}]': finished 2024-02-10T08:28:19.344 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:28:17.882848+0000 mon.a (mon.0) 1259 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.0", "id": [2, 1]}]': finished 2024-02-10T08:28:19.344 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:28:17.882909+0000 mon.a (mon.0) 1260 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.4", "id": [6, 3]}]': finished 2024-02-10T08:28:19.344 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:28:17.882983+0000 mon.a (mon.0) 1261 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.f", "id": [2, 0]}]': finished 2024-02-10T08:28:19.344 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:28:17.883051+0000 mon.a (mon.0) 1262 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.14", "id": [2, 0, 7, 5]}]': finished 2024-02-10T08:28:19.344 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:28:17.883104+0000 mon.a (mon.0) 1263 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.23", "id": [6, 0]}]': finished 2024-02-10T08:28:19.344 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:17.883131+0000 mon.a (mon.0) 1264 : cluster [DBG] osdmap e249: 8 total, 8 up, 8 in 2024-02-10T08:28:19.344 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:18.048370+0000 osd.7 (osd.7) 139 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:28:19.344 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:18.048410+0000 osd.7 (osd.7) 140 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:28:19.344 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:18.093292+0000 osd.7 (osd.7) 141 : cluster [DBG] 6.21 scrub starts 2024-02-10T08:28:19.344 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:18.099171+0000 osd.7 (osd.7) 142 : cluster [DBG] 6.21 scrub ok 2024-02-10T08:28:19.344 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:18.106724+0000 osd.2 (osd.2) 113 : cluster [DBG] 4.f scrub starts 2024-02-10T08:28:19.344 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:18.108703+0000 osd.2 (osd.2) 114 : cluster [DBG] 4.f scrub ok 2024-02-10T08:28:19.344 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:28:18.159584+0000 mgr.y (mgr.14505) 436 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:28:19.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:18.281833+0000 osd.5 (osd.5) 137 : cluster [DBG] 5.f scrub starts 2024-02-10T08:28:19.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:18.284747+0000 osd.5 (osd.5) 138 : cluster [DBG] 5.f scrub ok 2024-02-10T08:28:19.345 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:18.490751+0000 osd.6 (osd.6) 105 : cluster [DBG] 5.3 scrub starts 2024-02-10T08:28:19.345 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:18.492198+0000 osd.6 (osd.6) 106 : cluster [DBG] 5.3 scrub ok 2024-02-10T08:28:19.345 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:28:18.685131+0000 mon.c (mon.2) 55 : audit [INF] from='client.? 172.21.15.18:0/3759704210' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_1", "pool2": "unique_pool_1", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-10T08:28:19.345 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:28:18.685481+0000 mon.a (mon.0) 1265 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_1", "pool2": "unique_pool_1", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-10T08:28:19.345 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:28:18.883770+0000 mon.a (mon.0) 1266 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_1", "pool2": "unique_pool_1", "yes_i_really_really_mean_it": true}]': finished 2024-02-10T08:28:19.345 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:18.883858+0000 mon.a (mon.0) 1267 : cluster [DBG] osdmap e250: 8 total, 8 up, 8 in 2024-02-10T08:28:19.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:18.490751+0000 osd.6 (osd.6) 105 : cluster [DBG] 5.3 scrub starts 2024-02-10T08:28:19.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:18.492198+0000 osd.6 (osd.6) 106 : cluster [DBG] 5.3 scrub ok 2024-02-10T08:28:19.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:28:18.685131+0000 mon.c (mon.2) 55 : audit [INF] from='client.? 172.21.15.18:0/3759704210' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_1", "pool2": "unique_pool_1", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-10T08:28:19.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:28:18.685481+0000 mon.a (mon.0) 1265 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_1", "pool2": "unique_pool_1", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-10T08:28:19.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:28:18.883770+0000 mon.a (mon.0) 1266 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_1", "pool2": "unique_pool_1", "yes_i_really_really_mean_it": true}]': finished 2024-02-10T08:28:19.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:18.883858+0000 mon.a (mon.0) 1267 : cluster [DBG] osdmap e250: 8 total, 8 up, 8 in 2024-02-10T08:28:19.514 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:28:19.516 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:19.517 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:28:19.617 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:28:19.648 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:19.702 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:28:19.706 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:19.706 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:28:19.730 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2024-02-10T08:28:19.731 INFO:tasks.radosbench:Beginning radosbench... 2024-02-10T08:28:19.731 INFO:tasks.cephadm.ceph_manager.ceph:creating pool_name unique_pool_2 2024-02-10T08:28:19.731 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd pool create unique_pool_2 16 2024-02-10T08:28:19.807 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:28:19.835 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:19.889 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:28:19.891 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:19.891 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:28:19.992 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:28:20.030 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:20.050 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:28:20.052 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:20.053 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:28:20.151 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:18.008623+0000 osd.4 (osd.4) 54 : cluster [DBG] 4.e scrub starts 2024-02-10T08:28:20.151 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:18.012096+0000 osd.4 (osd.4) 55 : cluster [DBG] 4.e scrub ok 2024-02-10T08:28:20.151 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:18.811853+0000 mgr.y (mgr.14505) 437 : cluster [DBG] pgmap v519: 158 pgs: 1 active+remapped+backfill_toofull, 157 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:28:20.151 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:19.149122+0000 osd.2 (osd.2) 115 : cluster [DBG] 5.b scrub starts 2024-02-10T08:28:20.151 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:19.149897+0000 osd.2 (osd.2) 116 : cluster [DBG] 5.b scrub ok 2024-02-10T08:28:20.151 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:19.240044+0000 osd.5 (osd.5) 139 : cluster [DBG] 2.12 scrub starts 2024-02-10T08:28:20.151 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:19.242932+0000 osd.5 (osd.5) 140 : cluster [DBG] 2.12 scrub ok 2024-02-10T08:28:20.154 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:28:20.184 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:20.283 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:28:20.285 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:20.285 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:28:20.289 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:28:20.290 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:28:20.332 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:28:20.344 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:28:20.353 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:28:20.372 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:28:20.386 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:28:20.389 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:28:20.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:18.008623+0000 osd.4 (osd.4) 54 : cluster [DBG] 4.e scrub starts 2024-02-10T08:28:20.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:18.012096+0000 osd.4 (osd.4) 55 : cluster [DBG] 4.e scrub ok 2024-02-10T08:28:20.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:18.811853+0000 mgr.y (mgr.14505) 437 : cluster [DBG] pgmap v519: 158 pgs: 1 active+remapped+backfill_toofull, 157 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:28:20.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:19.149122+0000 osd.2 (osd.2) 115 : cluster [DBG] 5.b scrub starts 2024-02-10T08:28:20.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:19.149897+0000 osd.2 (osd.2) 116 : cluster [DBG] 5.b scrub ok 2024-02-10T08:28:20.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:19.240044+0000 osd.5 (osd.5) 139 : cluster [DBG] 2.12 scrub starts 2024-02-10T08:28:20.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:19.242932+0000 osd.5 (osd.5) 140 : cluster [DBG] 2.12 scrub ok 2024-02-10T08:28:20.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:18.008623+0000 osd.4 (osd.4) 54 : cluster [DBG] 4.e scrub starts 2024-02-10T08:28:20.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:18.012096+0000 osd.4 (osd.4) 55 : cluster [DBG] 4.e scrub ok 2024-02-10T08:28:20.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:18.811853+0000 mgr.y (mgr.14505) 437 : cluster [DBG] pgmap v519: 158 pgs: 1 active+remapped+backfill_toofull, 157 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:28:20.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:19.149122+0000 osd.2 (osd.2) 115 : cluster [DBG] 5.b scrub starts 2024-02-10T08:28:20.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:19.149897+0000 osd.2 (osd.2) 116 : cluster [DBG] 5.b scrub ok 2024-02-10T08:28:20.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:19.240044+0000 osd.5 (osd.5) 139 : cluster [DBG] 2.12 scrub starts 2024-02-10T08:28:20.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:19.242932+0000 osd.5 (osd.5) 140 : cluster [DBG] 2.12 scrub ok 2024-02-10T08:28:20.405 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-02-10T08:28:20.406 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-02-10T08:28:20.406 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-02-10T08:28:20.406 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-02-10T08:28:20.406 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-02-10T08:28:20.409 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:28:20.415 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:20.427 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:28:20.435 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:28:20.437 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:20.437 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:28:20.445 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:28:20.462 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:28:20.463 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-10T08:28:20.463 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-10T08:28:20.463 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-10T08:28:20.463 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-10T08:28:20.463 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-10T08:28:20.463 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-10T08:28:20.463 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-10T08:28:20.463 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-10T08:28:20.538 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:28:20.565 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:20.662 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:28:20.665 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:20.665 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:28:20.766 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:28:20.797 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:21.053 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:19.557454+0000 osd.5 (osd.5) 141 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:28:21.054 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:19.557534+0000 osd.5 (osd.5) 142 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:28:21.054 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:19.922358+0000 mon.a (mon.0) 1268 : cluster [DBG] osdmap e251: 8 total, 8 up, 8 in 2024-02-10T08:28:21.054 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:20.052989+0000 osd.7 (osd.7) 143 : cluster [DBG] 6.9 scrub starts 2024-02-10T08:28:21.054 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:20.073101+0000 osd.7 (osd.7) 144 : cluster [DBG] 6.9 scrub ok 2024-02-10T08:28:21.054 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:28:20.302225+0000 mon.b (mon.1) 66 : audit [DBG] from='client.? 172.21.15.18:0/137475942' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:28:21.054 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:20.391800+0000 osd.1 (osd.1) 125 : cluster [DBG] 5.12 scrub starts 2024-02-10T08:28:21.054 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:20.394692+0000 osd.1 (osd.1) 126 : cluster [DBG] 5.12 scrub ok 2024-02-10T08:28:21.054 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:19.557454+0000 osd.5 (osd.5) 141 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:28:21.054 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:19.557534+0000 osd.5 (osd.5) 142 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:28:21.054 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:19.922358+0000 mon.a (mon.0) 1268 : cluster [DBG] osdmap e251: 8 total, 8 up, 8 in 2024-02-10T08:28:21.054 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:20.052989+0000 osd.7 (osd.7) 143 : cluster [DBG] 6.9 scrub starts 2024-02-10T08:28:21.055 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:20.073101+0000 osd.7 (osd.7) 144 : cluster [DBG] 6.9 scrub ok 2024-02-10T08:28:21.055 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:28:20.302225+0000 mon.b (mon.1) 66 : audit [DBG] from='client.? 172.21.15.18:0/137475942' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:28:21.055 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:20.391800+0000 osd.1 (osd.1) 125 : cluster [DBG] 5.12 scrub starts 2024-02-10T08:28:21.055 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:20.394692+0000 osd.1 (osd.1) 126 : cluster [DBG] 5.12 scrub ok 2024-02-10T08:28:21.124 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.5 dump_historic_ops 2024-02-10T08:28:21.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:19.557454+0000 osd.5 (osd.5) 141 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:28:21.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:19.557534+0000 osd.5 (osd.5) 142 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:28:21.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:19.922358+0000 mon.a (mon.0) 1268 : cluster [DBG] osdmap e251: 8 total, 8 up, 8 in 2024-02-10T08:28:21.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:20.052989+0000 osd.7 (osd.7) 143 : cluster [DBG] 6.9 scrub starts 2024-02-10T08:28:21.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:20.073101+0000 osd.7 (osd.7) 144 : cluster [DBG] 6.9 scrub ok 2024-02-10T08:28:21.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:28:20.302225+0000 mon.b (mon.1) 66 : audit [DBG] from='client.? 172.21.15.18:0/137475942' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:28:21.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:20.391800+0000 osd.1 (osd.1) 125 : cluster [DBG] 5.12 scrub starts 2024-02-10T08:28:21.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:20.394692+0000 osd.1 (osd.1) 126 : cluster [DBG] 5.12 scrub ok 2024-02-10T08:28:21.388 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:28:22.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:20.812200+0000 mgr.y (mgr.14505) 438 : cluster [DBG] pgmap v522: 142 pgs: 142 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 682 B/s rd, 0 op/s 2024-02-10T08:28:22.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:21.406219+0000 osd.1 (osd.1) 127 : cluster [DBG] 2.4 scrub starts 2024-02-10T08:28:22.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:21.409104+0000 osd.1 (osd.1) 128 : cluster [DBG] 2.4 scrub ok 2024-02-10T08:28:22.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:21.453587+0000 osd.6 (osd.6) 107 : cluster [DBG] 4.12 scrub starts 2024-02-10T08:28:22.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:21.454912+0000 osd.6 (osd.6) 108 : cluster [DBG] 4.12 scrub ok 2024-02-10T08:28:22.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:21.717758+0000 mon.a (mon.0) 1269 : cluster [INF] Health check cleared: PG_BACKFILL_FULL (was: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull) 2024-02-10T08:28:22.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:21.823330+0000 osd.1 (osd.1) 129 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:28:22.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:21.823425+0000 osd.1 (osd.1) 130 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:28:22.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:20.812200+0000 mgr.y (mgr.14505) 438 : cluster [DBG] pgmap v522: 142 pgs: 142 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 682 B/s rd, 0 op/s 2024-02-10T08:28:22.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:21.406219+0000 osd.1 (osd.1) 127 : cluster [DBG] 2.4 scrub starts 2024-02-10T08:28:22.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:21.409104+0000 osd.1 (osd.1) 128 : cluster [DBG] 2.4 scrub ok 2024-02-10T08:28:22.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:21.453587+0000 osd.6 (osd.6) 107 : cluster [DBG] 4.12 scrub starts 2024-02-10T08:28:22.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:21.454912+0000 osd.6 (osd.6) 108 : cluster [DBG] 4.12 scrub ok 2024-02-10T08:28:22.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:21.717758+0000 mon.a (mon.0) 1269 : cluster [INF] Health check cleared: PG_BACKFILL_FULL (was: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull) 2024-02-10T08:28:22.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:21.823330+0000 osd.1 (osd.1) 129 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:28:22.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:21.823425+0000 osd.1 (osd.1) 130 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:28:22.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:20.812200+0000 mgr.y (mgr.14505) 438 : cluster [DBG] pgmap v522: 142 pgs: 142 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 682 B/s rd, 0 op/s 2024-02-10T08:28:22.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:21.406219+0000 osd.1 (osd.1) 127 : cluster [DBG] 2.4 scrub starts 2024-02-10T08:28:22.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:21.409104+0000 osd.1 (osd.1) 128 : cluster [DBG] 2.4 scrub ok 2024-02-10T08:28:22.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:21.453587+0000 osd.6 (osd.6) 107 : cluster [DBG] 4.12 scrub starts 2024-02-10T08:28:22.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:21.454912+0000 osd.6 (osd.6) 108 : cluster [DBG] 4.12 scrub ok 2024-02-10T08:28:22.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:21.717758+0000 mon.a (mon.0) 1269 : cluster [INF] Health check cleared: PG_BACKFILL_FULL (was: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull) 2024-02-10T08:28:22.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:21.823330+0000 osd.1 (osd.1) 129 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:28:22.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:21.823425+0000 osd.1 (osd.1) 130 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:28:22.351 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:28:22.354 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:22.354 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:28:22.455 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:28:22.491 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:22.998 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:22.015828+0000 osd.4 (osd.4) 56 : cluster [DBG] 6.2 scrub starts 2024-02-10T08:28:22.999 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:22.016687+0000 osd.4 (osd.4) 57 : cluster [DBG] 6.2 scrub ok 2024-02-10T08:28:22.999 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:22.098837+0000 osd.7 (osd.7) 145 : cluster [DBG] 6.8 scrub starts 2024-02-10T08:28:22.999 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:22.114418+0000 osd.7 (osd.7) 146 : cluster [DBG] 6.8 scrub ok 2024-02-10T08:28:22.999 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:22.451400+0000 osd.1 (osd.1) 131 : cluster [DBG] 4.4 scrub starts 2024-02-10T08:28:22.999 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:22.455132+0000 osd.1 (osd.1) 132 : cluster [DBG] 4.4 scrub ok 2024-02-10T08:28:22.999 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:22.723275+0000 mon.a (mon.0) 1270 : cluster [DBG] osdmap e252: 8 total, 8 up, 8 in 2024-02-10T08:28:23.212 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:22.015828+0000 osd.4 (osd.4) 56 : cluster [DBG] 6.2 scrub starts 2024-02-10T08:28:23.212 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:22.016687+0000 osd.4 (osd.4) 57 : cluster [DBG] 6.2 scrub ok 2024-02-10T08:28:23.212 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:22.098837+0000 osd.7 (osd.7) 145 : cluster [DBG] 6.8 scrub starts 2024-02-10T08:28:23.212 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:22.114418+0000 osd.7 (osd.7) 146 : cluster [DBG] 6.8 scrub ok 2024-02-10T08:28:23.212 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:22.451400+0000 osd.1 (osd.1) 131 : cluster [DBG] 4.4 scrub starts 2024-02-10T08:28:23.212 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:22.455132+0000 osd.1 (osd.1) 132 : cluster [DBG] 4.4 scrub ok 2024-02-10T08:28:23.212 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:22.723275+0000 mon.a (mon.0) 1270 : cluster [DBG] osdmap e252: 8 total, 8 up, 8 in 2024-02-10T08:28:23.212 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:22.015828+0000 osd.4 (osd.4) 56 : cluster [DBG] 6.2 scrub starts 2024-02-10T08:28:23.212 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:22.016687+0000 osd.4 (osd.4) 57 : cluster [DBG] 6.2 scrub ok 2024-02-10T08:28:23.212 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:22.098837+0000 osd.7 (osd.7) 145 : cluster [DBG] 6.8 scrub starts 2024-02-10T08:28:23.212 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:22.114418+0000 osd.7 (osd.7) 146 : cluster [DBG] 6.8 scrub ok 2024-02-10T08:28:23.213 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:22.451400+0000 osd.1 (osd.1) 131 : cluster [DBG] 4.4 scrub starts 2024-02-10T08:28:23.213 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:22.455132+0000 osd.1 (osd.1) 132 : cluster [DBG] 4.4 scrub ok 2024-02-10T08:28:23.213 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:22.723275+0000 mon.a (mon.0) 1270 : cluster [DBG] osdmap e252: 8 total, 8 up, 8 in 2024-02-10T08:28:23.274 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-02-10T08:28:23.275 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:28:23.399 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-10T08:28:23.545 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:28:23.547 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:23.548 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:28:23.649 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:28:23.680 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:24.016 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.6 dump_ops_in_flight 2024-02-10T08:28:24.028 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:28:24.031 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:24.032 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:28:24.132 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:28:24.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:22.780541+0000 osd.0 (osd.0) 118 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:28:24.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:22.780619+0000 osd.0 (osd.0) 119 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:28:24.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:22.812702+0000 mgr.y (mgr.14505) 439 : cluster [DBG] pgmap v524: 142 pgs: 142 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 622 B/s rd, 0 op/s 2024-02-10T08:28:24.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:23.726753+0000 mon.a (mon.0) 1271 : cluster [DBG] osdmap e253: 8 total, 8 up, 8 in 2024-02-10T08:28:24.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:22.780541+0000 osd.0 (osd.0) 118 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:28:24.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:22.780619+0000 osd.0 (osd.0) 119 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:28:24.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:22.812702+0000 mgr.y (mgr.14505) 439 : cluster [DBG] pgmap v524: 142 pgs: 142 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 622 B/s rd, 0 op/s 2024-02-10T08:28:24.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:23.726753+0000 mon.a (mon.0) 1271 : cluster [DBG] osdmap e253: 8 total, 8 up, 8 in 2024-02-10T08:28:24.159 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:24.177 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:28:24.180 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:22.780541+0000 osd.0 (osd.0) 118 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:28:24.180 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:22.780619+0000 osd.0 (osd.0) 119 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:28:24.180 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:22.812702+0000 mgr.y (mgr.14505) 439 : cluster [DBG] pgmap v524: 142 pgs: 142 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 622 B/s rd, 0 op/s 2024-02-10T08:28:24.180 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:23.726753+0000 mon.a (mon.0) 1271 : cluster [DBG] osdmap e253: 8 total, 8 up, 8 in 2024-02-10T08:28:24.181 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:24.181 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:28:24.282 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:28:24.302 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:28:24.312 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:24.336 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:28:24.339 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:24.340 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:28:24.441 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:28:24.468 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:24.566 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:28:24.569 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:24.569 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:28:24.670 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:28:24.700 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:24.942 INFO:teuthology.orchestra.run.smithi018.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-02-10T08:28:25.167 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:28:24.373488+0000 mon.c (mon.2) 56 : audit [INF] from='client.? 172.21.15.18:0/2377392236' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 0, "weight": 1.0}]: dispatch 2024-02-10T08:28:25.167 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:28:24.373899+0000 mon.a (mon.0) 1272 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 0, "weight": 1.0}]: dispatch 2024-02-10T08:28:25.167 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:24.447353+0000 osd.1 (osd.1) 133 : cluster [DBG] 5.19 scrub starts 2024-02-10T08:28:25.167 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:24.450343+0000 osd.1 (osd.1) 134 : cluster [DBG] 5.19 scrub ok 2024-02-10T08:28:25.389 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:28:24.373488+0000 mon.c (mon.2) 56 : audit [INF] from='client.? 172.21.15.18:0/2377392236' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 0, "weight": 1.0}]: dispatch 2024-02-10T08:28:25.389 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:28:24.373899+0000 mon.a (mon.0) 1272 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 0, "weight": 1.0}]: dispatch 2024-02-10T08:28:25.389 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:24.447353+0000 osd.1 (osd.1) 133 : cluster [DBG] 5.19 scrub starts 2024-02-10T08:28:25.389 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:24.450343+0000 osd.1 (osd.1) 134 : cluster [DBG] 5.19 scrub ok 2024-02-10T08:28:25.389 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:28:24.373488+0000 mon.c (mon.2) 56 : audit [INF] from='client.? 172.21.15.18:0/2377392236' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 0, "weight": 1.0}]: dispatch 2024-02-10T08:28:25.389 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:28:24.373899+0000 mon.a (mon.0) 1272 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 0, "weight": 1.0}]: dispatch 2024-02-10T08:28:25.389 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:24.447353+0000 osd.1 (osd.1) 133 : cluster [DBG] 5.19 scrub starts 2024-02-10T08:28:25.389 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:24.450343+0000 osd.1 (osd.1) 134 : cluster [DBG] 5.19 scrub ok 2024-02-10T08:28:25.750 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:28:25.752 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:25.753 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:28:25.855 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:28:25.884 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:26.028 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:24.813246+0000 mgr.y (mgr.14505) 440 : cluster [DBG] pgmap v526: 142 pgs: 142 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 690 B/s rd, 0 op/s; 18 B/s, 0 objects/s recovering 2024-02-10T08:28:26.028 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:28:24.929220+0000 mon.a (mon.0) 1273 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 0, "weight": 1.0}]': finished 2024-02-10T08:28:26.028 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:24.929299+0000 mon.a (mon.0) 1274 : cluster [DBG] osdmap e254: 8 total, 8 up, 8 in 2024-02-10T08:28:26.028 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:25.264739+0000 osd.2 (osd.2) 117 : cluster [DBG] 5.a scrub starts 2024-02-10T08:28:26.028 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:25.266118+0000 osd.2 (osd.2) 118 : cluster [DBG] 5.a scrub ok 2024-02-10T08:28:26.029 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:25.489792+0000 osd.6 (osd.6) 109 : cluster [DBG] 2.11 scrub starts 2024-02-10T08:28:26.029 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:25.490608+0000 osd.6 (osd.6) 110 : cluster [DBG] 2.11 scrub ok 2024-02-10T08:28:26.029 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:24.813246+0000 mgr.y (mgr.14505) 440 : cluster [DBG] pgmap v526: 142 pgs: 142 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 690 B/s rd, 0 op/s; 18 B/s, 0 objects/s recovering 2024-02-10T08:28:26.029 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:28:24.929220+0000 mon.a (mon.0) 1273 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 0, "weight": 1.0}]': finished 2024-02-10T08:28:26.029 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:24.929299+0000 mon.a (mon.0) 1274 : cluster [DBG] osdmap e254: 8 total, 8 up, 8 in 2024-02-10T08:28:26.029 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:25.264739+0000 osd.2 (osd.2) 117 : cluster [DBG] 5.a scrub starts 2024-02-10T08:28:26.029 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:25.266118+0000 osd.2 (osd.2) 118 : cluster [DBG] 5.a scrub ok 2024-02-10T08:28:26.029 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:25.489792+0000 osd.6 (osd.6) 109 : cluster [DBG] 2.11 scrub starts 2024-02-10T08:28:26.029 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:25.490608+0000 osd.6 (osd.6) 110 : cluster [DBG] 2.11 scrub ok 2024-02-10T08:28:26.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:24.813246+0000 mgr.y (mgr.14505) 440 : cluster [DBG] pgmap v526: 142 pgs: 142 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 690 B/s rd, 0 op/s; 18 B/s, 0 objects/s recovering 2024-02-10T08:28:26.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:28:24.929220+0000 mon.a (mon.0) 1273 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 0, "weight": 1.0}]': finished 2024-02-10T08:28:26.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:24.929299+0000 mon.a (mon.0) 1274 : cluster [DBG] osdmap e254: 8 total, 8 up, 8 in 2024-02-10T08:28:26.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:25.264739+0000 osd.2 (osd.2) 117 : cluster [DBG] 5.a scrub starts 2024-02-10T08:28:26.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:25.266118+0000 osd.2 (osd.2) 118 : cluster [DBG] 5.a scrub ok 2024-02-10T08:28:26.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:25.489792+0000 osd.6 (osd.6) 109 : cluster [DBG] 2.11 scrub starts 2024-02-10T08:28:26.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:25.490608+0000 osd.6 (osd.6) 110 : cluster [DBG] 2.11 scrub ok 2024-02-10T08:28:26.076 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-02-10T08:28:26.077 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:28:26.720 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:28:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:28:26] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:28:26.734 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:28:26.736 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:28:26.739 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:26.740 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.6 dump_blocked_ops 2024-02-10T08:28:26.740 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:28:26.841 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:28:26.868 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:26.888 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:28:26.891 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:26.891 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:28:26.992 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:28:27.019 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:28:27.020 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:27.040 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:28:27.043 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:27.043 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:28:27.144 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:28:27.169 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:27.184 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'unique_pool_2' created 2024-02-10T08:28:27.185 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is unset 2024-02-10T08:28:27.193 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:28:27.197 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:27.197 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:28:27.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:25.943425+0000 mon.a (mon.0) 1275 : cluster [DBG] osdmap e255: 8 total, 8 up, 8 in 2024-02-10T08:28:27.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:26.459265+0000 osd.6 (osd.6) 111 : cluster [DBG] 5.11 scrub starts 2024-02-10T08:28:27.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:26.460151+0000 osd.6 (osd.6) 112 : cluster [DBG] 5.11 scrub ok 2024-02-10T08:28:27.298 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:28:27.319 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:28:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:28:27] "GET /metrics HTTP/1.1" 200 176028 "" "Prometheus/2.33.4" 2024-02-10T08:28:27.319 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:25.943425+0000 mon.a (mon.0) 1275 : cluster [DBG] osdmap e255: 8 total, 8 up, 8 in 2024-02-10T08:28:27.319 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:26.459265+0000 osd.6 (osd.6) 111 : cluster [DBG] 5.11 scrub starts 2024-02-10T08:28:27.320 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:26.460151+0000 osd.6 (osd.6) 112 : cluster [DBG] 5.11 scrub ok 2024-02-10T08:28:27.320 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:25.943425+0000 mon.a (mon.0) 1275 : cluster [DBG] osdmap e255: 8 total, 8 up, 8 in 2024-02-10T08:28:27.320 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:26.459265+0000 osd.6 (osd.6) 111 : cluster [DBG] 5.11 scrub starts 2024-02-10T08:28:27.320 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:26.460151+0000 osd.6 (osd.6) 112 : cluster [DBG] 5.11 scrub ok 2024-02-10T08:28:27.329 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:28.130 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:25.998153+0000 osd.4 (osd.4) 58 : cluster [DBG] 6.6 scrub starts 2024-02-10T08:28:28.130 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:26.013054+0000 osd.4 (osd.4) 59 : cluster [DBG] 6.6 scrub ok 2024-02-10T08:28:28.130 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:26.501598+0000 osd.1 (osd.1) 135 : cluster [DBG] 4.6 scrub starts 2024-02-10T08:28:28.130 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:26.505265+0000 osd.1 (osd.1) 136 : cluster [DBG] 4.6 scrub ok 2024-02-10T08:28:28.130 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:28:26.682052+0000 mon.a (mon.0) 1276 : audit [INF] from='client.? 172.21.15.18:0/4033597945' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_2", "pg_num": 16}]: dispatch 2024-02-10T08:28:28.130 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:28:26.805610+0000 mon.c (mon.2) 57 : audit [INF] from='client.? 172.21.15.18:0/1995461499' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:28:28.130 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:26.813536+0000 mgr.y (mgr.14505) 441 : cluster [DBG] pgmap v529: 142 pgs: 142 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-10T08:28:28.130 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:26.958722+0000 osd.4 (osd.4) 60 : cluster [DBG] 6.e scrub starts 2024-02-10T08:28:28.130 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:26.976019+0000 osd.4 (osd.4) 61 : cluster [DBG] 6.e scrub ok 2024-02-10T08:28:28.130 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:28:27.123440+0000 mon.a (mon.0) 1277 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:28:28.130 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:28:27.130516+0000 mon.a (mon.0) 1278 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:28:28.130 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:27.172945+0000 mon.a (mon.0) 1279 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-10T08:28:28.131 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:27.172969+0000 mon.a (mon.0) 1280 : cluster [INF] Cluster is now healthy 2024-02-10T08:28:28.131 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:28:27.176869+0000 mon.a (mon.0) 1281 : audit [INF] from='client.? 172.21.15.18:0/4033597945' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_2", "pg_num": 16}]': finished 2024-02-10T08:28:28.131 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:28:27.176943+0000 mon.a (mon.0) 1282 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-10T08:28:28.131 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:27.177009+0000 mon.a (mon.0) 1283 : cluster [DBG] osdmap e256: 8 total, 8 up, 8 in 2024-02-10T08:28:28.131 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:27.231640+0000 osd.5 (osd.5) 143 : cluster [DBG] 6.11 scrub starts 2024-02-10T08:28:28.131 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:27.240236+0000 osd.5 (osd.5) 144 : cluster [DBG] 6.11 scrub ok 2024-02-10T08:28:28.131 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:27.461031+0000 osd.6 (osd.6) 113 : cluster [DBG] 6.1f scrub starts 2024-02-10T08:28:28.180 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:28:28.187 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:28.188 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:28:28.260 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:28:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:28:28.261 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:25.998153+0000 osd.4 (osd.4) 58 : cluster [DBG] 6.6 scrub starts 2024-02-10T08:28:28.261 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:26.013054+0000 osd.4 (osd.4) 59 : cluster [DBG] 6.6 scrub ok 2024-02-10T08:28:28.261 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:26.501598+0000 osd.1 (osd.1) 135 : cluster [DBG] 4.6 scrub starts 2024-02-10T08:28:28.261 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:26.505265+0000 osd.1 (osd.1) 136 : cluster [DBG] 4.6 scrub ok 2024-02-10T08:28:28.261 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:28:26.682052+0000 mon.a (mon.0) 1276 : audit [INF] from='client.? 172.21.15.18:0/4033597945' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_2", "pg_num": 16}]: dispatch 2024-02-10T08:28:28.261 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:28:26.805610+0000 mon.c (mon.2) 57 : audit [INF] from='client.? 172.21.15.18:0/1995461499' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:28:28.261 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:26.813536+0000 mgr.y (mgr.14505) 441 : cluster [DBG] pgmap v529: 142 pgs: 142 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-10T08:28:28.261 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:26.958722+0000 osd.4 (osd.4) 60 : cluster [DBG] 6.e scrub starts 2024-02-10T08:28:28.261 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:26.976019+0000 osd.4 (osd.4) 61 : cluster [DBG] 6.e scrub ok 2024-02-10T08:28:28.261 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:28:27.123440+0000 mon.a (mon.0) 1277 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:28:28.262 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:28:27.130516+0000 mon.a (mon.0) 1278 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:28:28.262 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:27.172945+0000 mon.a (mon.0) 1279 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-10T08:28:28.262 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:27.172969+0000 mon.a (mon.0) 1280 : cluster [INF] Cluster is now healthy 2024-02-10T08:28:28.262 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:28:27.176869+0000 mon.a (mon.0) 1281 : audit [INF] from='client.? 172.21.15.18:0/4033597945' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_2", "pg_num": 16}]': finished 2024-02-10T08:28:28.262 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:28:27.176943+0000 mon.a (mon.0) 1282 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-10T08:28:28.262 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:27.177009+0000 mon.a (mon.0) 1283 : cluster [DBG] osdmap e256: 8 total, 8 up, 8 in 2024-02-10T08:28:28.262 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:27.231640+0000 osd.5 (osd.5) 143 : cluster [DBG] 6.11 scrub starts 2024-02-10T08:28:28.262 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:27.240236+0000 osd.5 (osd.5) 144 : cluster [DBG] 6.11 scrub ok 2024-02-10T08:28:28.262 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:27.461031+0000 osd.6 (osd.6) 113 : cluster [DBG] 6.1f scrub starts 2024-02-10T08:28:28.288 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:28:28.321 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:28.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:25.998153+0000 osd.4 (osd.4) 58 : cluster [DBG] 6.6 scrub starts 2024-02-10T08:28:28.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:26.013054+0000 osd.4 (osd.4) 59 : cluster [DBG] 6.6 scrub ok 2024-02-10T08:28:28.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:26.501598+0000 osd.1 (osd.1) 135 : cluster [DBG] 4.6 scrub starts 2024-02-10T08:28:28.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:26.505265+0000 osd.1 (osd.1) 136 : cluster [DBG] 4.6 scrub ok 2024-02-10T08:28:28.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:28:26.682052+0000 mon.a (mon.0) 1276 : audit [INF] from='client.? 172.21.15.18:0/4033597945' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_2", "pg_num": 16}]: dispatch 2024-02-10T08:28:28.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:28:26.805610+0000 mon.c (mon.2) 57 : audit [INF] from='client.? 172.21.15.18:0/1995461499' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:28:28.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:26.813536+0000 mgr.y (mgr.14505) 441 : cluster [DBG] pgmap v529: 142 pgs: 142 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-10T08:28:28.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:26.958722+0000 osd.4 (osd.4) 60 : cluster [DBG] 6.e scrub starts 2024-02-10T08:28:28.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:26.976019+0000 osd.4 (osd.4) 61 : cluster [DBG] 6.e scrub ok 2024-02-10T08:28:28.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:28:27.123440+0000 mon.a (mon.0) 1277 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:28:28.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:28:27.130516+0000 mon.a (mon.0) 1278 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:28:28.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:27.172945+0000 mon.a (mon.0) 1279 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-10T08:28:28.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:27.172969+0000 mon.a (mon.0) 1280 : cluster [INF] Cluster is now healthy 2024-02-10T08:28:28.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:28:27.176869+0000 mon.a (mon.0) 1281 : audit [INF] from='client.? 172.21.15.18:0/4033597945' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_2", "pg_num": 16}]': finished 2024-02-10T08:28:28.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:28:27.176943+0000 mon.a (mon.0) 1282 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-10T08:28:28.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:27.177009+0000 mon.a (mon.0) 1283 : cluster [DBG] osdmap e256: 8 total, 8 up, 8 in 2024-02-10T08:28:28.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:27.231640+0000 osd.5 (osd.5) 143 : cluster [DBG] 6.11 scrub starts 2024-02-10T08:28:28.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:27.240236+0000 osd.5 (osd.5) 144 : cluster [DBG] 6.11 scrub ok 2024-02-10T08:28:28.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:27.461031+0000 osd.6 (osd.6) 113 : cluster [DBG] 6.1f scrub starts 2024-02-10T08:28:28.867 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-02-10T08:28:28.867 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:28:29.221 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:27.516246+0000 osd.6 (osd.6) 114 : cluster [DBG] 6.1f scrub ok 2024-02-10T08:28:29.221 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:28:28.157063+0000 mon.a (mon.0) 1284 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:28:29.222 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:28:28.169547+0000 mgr.y (mgr.14505) 442 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:28:29.222 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:28.179632+0000 mon.a (mon.0) 1285 : cluster [DBG] osdmap e257: 8 total, 8 up, 8 in 2024-02-10T08:28:29.222 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:28.483861+0000 osd.1 (osd.1) 137 : cluster [DBG] 2.15 scrub starts 2024-02-10T08:28:29.222 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:28.486922+0000 osd.1 (osd.1) 138 : cluster [DBG] 2.15 scrub ok 2024-02-10T08:28:29.222 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:28:28.870358+0000 mon.a (mon.0) 1286 : audit [DBG] from='client.? 172.21.15.18:0/3747834211' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:28:29.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:27.516246+0000 osd.6 (osd.6) 114 : cluster [DBG] 6.1f scrub ok 2024-02-10T08:28:29.422 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:28:28.157063+0000 mon.a (mon.0) 1284 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:28:29.422 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:28:28.169547+0000 mgr.y (mgr.14505) 442 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:28:29.422 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:28.179632+0000 mon.a (mon.0) 1285 : cluster [DBG] osdmap e257: 8 total, 8 up, 8 in 2024-02-10T08:28:29.422 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:28.483861+0000 osd.1 (osd.1) 137 : cluster [DBG] 2.15 scrub starts 2024-02-10T08:28:29.422 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:28.486922+0000 osd.1 (osd.1) 138 : cluster [DBG] 2.15 scrub ok 2024-02-10T08:28:29.422 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:28:28.870358+0000 mon.a (mon.0) 1286 : audit [DBG] from='client.? 172.21.15.18:0/3747834211' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:28:29.422 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:27.516246+0000 osd.6 (osd.6) 114 : cluster [DBG] 6.1f scrub ok 2024-02-10T08:28:29.423 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:28:28.157063+0000 mon.a (mon.0) 1284 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:28:29.423 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:28:28.169547+0000 mgr.y (mgr.14505) 442 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:28:29.423 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:28.179632+0000 mon.a (mon.0) 1285 : cluster [DBG] osdmap e257: 8 total, 8 up, 8 in 2024-02-10T08:28:29.423 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:28.483861+0000 osd.1 (osd.1) 137 : cluster [DBG] 2.15 scrub starts 2024-02-10T08:28:29.423 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:28.486922+0000 osd.1 (osd.1) 138 : cluster [DBG] 2.15 scrub ok 2024-02-10T08:28:29.423 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:28:28.870358+0000 mon.a (mon.0) 1286 : audit [DBG] from='client.? 172.21.15.18:0/3747834211' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:28:29.547 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.6 dump_historic_ops 2024-02-10T08:28:29.564 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd pool application enable unique_pool_2 rados --yes-i-really-mean-it || true 2024-02-10T08:28:30.272 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:28:30.374 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:28.813872+0000 mgr.y (mgr.14505) 443 : cluster [DBG] pgmap v532: 158 pgs: 15 creating+peering, 1 unknown, 142 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:28:30.374 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:29.195092+0000 osd.7 (osd.7) 147 : cluster [DBG] 5.9 scrub starts 2024-02-10T08:28:30.374 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:29.196105+0000 osd.7 (osd.7) 148 : cluster [DBG] 5.9 scrub ok 2024-02-10T08:28:30.374 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:29.196534+0000 mon.a (mon.0) 1287 : cluster [DBG] osdmap e258: 8 total, 8 up, 8 in 2024-02-10T08:28:30.374 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:29.458024+0000 osd.6 (osd.6) 115 : cluster [DBG] 5.1f scrub starts 2024-02-10T08:28:30.374 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:29.461495+0000 osd.6 (osd.6) 116 : cluster [DBG] 5.1f scrub ok 2024-02-10T08:28:30.374 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:28.813872+0000 mgr.y (mgr.14505) 443 : cluster [DBG] pgmap v532: 158 pgs: 15 creating+peering, 1 unknown, 142 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:28:30.374 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:29.195092+0000 osd.7 (osd.7) 147 : cluster [DBG] 5.9 scrub starts 2024-02-10T08:28:30.374 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:29.196105+0000 osd.7 (osd.7) 148 : cluster [DBG] 5.9 scrub ok 2024-02-10T08:28:30.374 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:29.196534+0000 mon.a (mon.0) 1287 : cluster [DBG] osdmap e258: 8 total, 8 up, 8 in 2024-02-10T08:28:30.375 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:29.458024+0000 osd.6 (osd.6) 115 : cluster [DBG] 5.1f scrub starts 2024-02-10T08:28:30.375 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:29.461495+0000 osd.6 (osd.6) 116 : cluster [DBG] 5.1f scrub ok 2024-02-10T08:28:30.401 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:28:30.404 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:30.404 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:28:30.505 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:28:30.537 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:30.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:28.813872+0000 mgr.y (mgr.14505) 443 : cluster [DBG] pgmap v532: 158 pgs: 15 creating+peering, 1 unknown, 142 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:28:30.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:29.195092+0000 osd.7 (osd.7) 147 : cluster [DBG] 5.9 scrub starts 2024-02-10T08:28:30.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:29.196105+0000 osd.7 (osd.7) 148 : cluster [DBG] 5.9 scrub ok 2024-02-10T08:28:30.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:29.196534+0000 mon.a (mon.0) 1287 : cluster [DBG] osdmap e258: 8 total, 8 up, 8 in 2024-02-10T08:28:30.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:29.458024+0000 osd.6 (osd.6) 115 : cluster [DBG] 5.1f scrub starts 2024-02-10T08:28:30.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:29.461495+0000 osd.6 (osd.6) 116 : cluster [DBG] 5.1f scrub ok 2024-02-10T08:28:30.551 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:28:30.551 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:28:30.551 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:28:30.551 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:28:30.551 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:28:30.551 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:28:30.552 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:28:30.552 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:28:30.552 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-10T08:28:30.552 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-10T08:28:30.552 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-10T08:28:30.552 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-10T08:28:30.552 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-10T08:28:30.552 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-10T08:28:30.552 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-10T08:28:30.552 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-10T08:28:30.777 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 3, 4, 5, 6, 7, 0] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 5, 6, 7, 4] 2024-02-10T08:28:30.777 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-10T08:28:30.777 INFO:tasks.thrashosds.thrasher:Reweighting osd 4 to 0.9274573833985167 2024-02-10T08:28:30.778 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd reweight 4 0.9274573833985167 2024-02-10T08:28:30.791 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:28:30.795 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:30.795 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:28:30.800 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:28:30.897 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:28:30.924 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:31.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:30.216984+0000 osd.5 (osd.5) 145 : cluster [DBG] 6.a scrub starts 2024-02-10T08:28:31.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:30.227116+0000 osd.5 (osd.5) 146 : cluster [DBG] 6.a scrub ok 2024-02-10T08:28:31.301 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:28:31.303 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:31.304 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:28:31.405 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:28:31.432 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:31.649 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:30.216984+0000 osd.5 (osd.5) 145 : cluster [DBG] 6.a scrub starts 2024-02-10T08:28:31.649 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:30.227116+0000 osd.5 (osd.5) 146 : cluster [DBG] 6.a scrub ok 2024-02-10T08:28:31.649 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:30.216984+0000 osd.5 (osd.5) 145 : cluster [DBG] 6.a scrub starts 2024-02-10T08:28:31.649 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:30.227116+0000 osd.5 (osd.5) 146 : cluster [DBG] 6.a scrub ok 2024-02-10T08:28:31.681 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:28:31.686 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:31.686 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:28:31.787 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:28:31.816 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:32.014 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:28:32.019 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:32.019 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:28:32.120 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:28:32.147 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:32.220 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:28:32.223 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:32.224 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:28:32.225 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:28:32.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:30.814320+0000 mgr.y (mgr.14505) 444 : cluster [DBG] pgmap v534: 158 pgs: 15 creating+peering, 143 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-02-10T08:28:32.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:31.261447+0000 osd.7 (osd.7) 149 : cluster [DBG] 2.1f scrub starts 2024-02-10T08:28:32.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:31.264348+0000 osd.7 (osd.7) 150 : cluster [DBG] 2.1f scrub ok 2024-02-10T08:28:32.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:28:31.656351+0000 mon.a (mon.0) 1288 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:28:32.324 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:28:32.353 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:32.397 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd set noscrub 2024-02-10T08:28:32.500 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-02-10T08:28:32.500 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-02-10T08:28:32.501 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-02-10T08:28:32.501 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-02-10T08:28:32.501 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.501 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.24299.0:674 5.1f 5:f95f44c2:::notify.0:head [watch reconnect cookie 94587189541504 gen 1] snapc 0=[] ondisk+write+known_if_redirected e88)", 2024-02-10T08:28:32.501 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:19:30.798304+0000", 2024-02-10T08:28:32.501 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 541.69891061600003, 2024-02-10T08:28:32.501 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0169715699999999, 2024-02-10T08:28:32.501 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:28:32.501 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-02-10T08:28:32.501 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:28:32.501 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.24299", 2024-02-10T08:28:32.501 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/871408063", 2024-02-10T08:28:32.501 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 674 2024-02-10T08:28:32.501 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.501 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:28:32.501 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.502 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:28:32.502 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:30.798304+0000", 2024-02-10T08:28:32.502 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:28:32.502 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.502 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.502 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:28:32.502 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:30.798304+0000", 2024-02-10T08:28:32.502 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999981 2024-02-10T08:28:32.502 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.502 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.502 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:28:32.502 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:30.798302+0000", 2024-02-10T08:28:32.502 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9e-06 2024-02-10T08:28:32.502 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.502 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.503 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:28:32.503 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:30.798309+0000", 2024-02-10T08:28:32.503 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4748e-05 2024-02-10T08:28:32.503 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.503 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.503 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:28:32.503 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:30.798324+0000", 2024-02-10T08:28:32.503 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9549999999999998e-06 2024-02-10T08:28:32.503 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.503 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.503 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:28:32.503 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:30.798332+0000", 2024-02-10T08:28:32.503 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7087000000000002e-05 2024-02-10T08:28:32.503 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.503 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.503 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:32.503 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:30.798410+0000", 2024-02-10T08:28:32.504 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0960000000000003e-06 2024-02-10T08:28:32.504 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.504 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.504 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-02-10T08:28:32.504 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:30.798417+0000", 2024-02-10T08:28:32.504 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011099538000000001 2024-02-10T08:28:32.504 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.504 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.504 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:32.504 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:30.809516+0000", 2024-02-10T08:28:32.504 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7360000000000007e-06 2024-02-10T08:28:32.504 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.504 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.504 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:28:32.505 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:30.809525+0000", 2024-02-10T08:28:32.505 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0041937139999999 2024-02-10T08:28:32.505 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.505 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.505 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:32.505 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:31.813719+0000", 2024-02-10T08:28:32.505 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015807199999999999 2024-02-10T08:28:32.505 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.505 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.505 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:28:32.505 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:31.813877+0000", 2024-02-10T08:28:32.505 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0013983929999999999 2024-02-10T08:28:32.505 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.505 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.505 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:28:32.506 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:31.815275+0000", 2024-02-10T08:28:32.506 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0169715699999999 2024-02-10T08:28:32.506 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:32.506 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:28:32.506 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:32.506 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.506 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.506 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.24299.0:683 5.1f 5:f95f44c2:::notify.0:head [watch ping cookie 94587189541504 gen 1] snapc 0=[] ondisk+write+known_if_redirected e88)", 2024-02-10T08:28:32.506 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:19:30.927533+0000", 2024-02-10T08:28:32.506 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 541.56968104500004, 2024-02-10T08:28:32.506 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.88684627199999999, 2024-02-10T08:28:32.506 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:28:32.506 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-02-10T08:28:32.506 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:28:32.506 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.24299", 2024-02-10T08:28:32.506 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/871408063", 2024-02-10T08:28:32.506 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 683 2024-02-10T08:28:32.507 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.507 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:28:32.507 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.507 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:28:32.507 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:30.927533+0000", 2024-02-10T08:28:32.507 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:28:32.507 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.507 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.507 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:28:32.507 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:30.927533+0000", 2024-02-10T08:28:32.507 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-02-10T08:28:32.507 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.507 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.507 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:28:32.507 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:30.927532+0000", 2024-02-10T08:28:32.507 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7039000000000001e-05 2024-02-10T08:28:32.507 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.508 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.508 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:28:32.508 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:30.927549+0000", 2024-02-10T08:28:32.508 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5580000000000006e-06 2024-02-10T08:28:32.508 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.508 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.508 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:28:32.508 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:30.927559+0000", 2024-02-10T08:28:32.508 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1199999999999996e-06 2024-02-10T08:28:32.508 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.508 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.508 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:28:32.508 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:30.927566+0000", 2024-02-10T08:28:32.508 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2524000000000001e-05 2024-02-10T08:28:32.508 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.509 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.509 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:32.509 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:30.927618+0000", 2024-02-10T08:28:32.509 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9719999999999998e-06 2024-02-10T08:28:32.509 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.509 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.509 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:28:32.509 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:30.927627+0000", 2024-02-10T08:28:32.509 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.88652165999999999 2024-02-10T08:28:32.509 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.509 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.509 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:32.509 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:31.814149+0000", 2024-02-10T08:28:32.509 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0580000000000004e-05 2024-02-10T08:28:32.509 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.509 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.509 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:28:32.510 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:31.814229+0000", 2024-02-10T08:28:32.510 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000149949 2024-02-10T08:28:32.510 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.510 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.510 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:28:32.510 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:19:31.814379+0000", 2024-02-10T08:28:32.510 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.88684627199999999 2024-02-10T08:28:32.510 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:32.510 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:28:32.510 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:32.510 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.510 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.510 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14784.0:179950 7.c 7:382cfb17:::benchmark_data_smithi018_80623_object79022:head [delete] snapc 0=[] ondisk+write+known_if_redirected e163)", 2024-02-10T08:28:32.510 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:23:14.129443+0000", 2024-02-10T08:28:32.510 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 318.36777144000001, 2024-02-10T08:28:32.510 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.594838677, 2024-02-10T08:28:32.510 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:28:32.511 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:28:32.511 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:28:32.511 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14784", 2024-02-10T08:28:32.511 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:28:32.511 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 179950 2024-02-10T08:28:32.511 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.511 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:28:32.511 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.511 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:28:32.511 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:14.129443+0000", 2024-02-10T08:28:32.511 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:28:32.511 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.511 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.511 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:28:32.512 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:14.129443+0000", 2024-02-10T08:28:32.512 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999976 2024-02-10T08:28:32.512 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.512 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.512 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:28:32.512 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:14.129440+0000", 2024-02-10T08:28:32.512 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1249999999999999e-06 2024-02-10T08:28:32.512 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.512 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.512 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:28:32.512 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:14.129450+0000", 2024-02-10T08:28:32.512 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4966999999999999e-05 2024-02-10T08:28:32.512 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.512 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.512 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:28:32.512 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:14.129465+0000", 2024-02-10T08:28:32.513 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2889999999999998e-06 2024-02-10T08:28:32.513 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.513 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.513 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:28:32.513 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:14.129473+0000", 2024-02-10T08:28:32.513 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0749999999999999e-05 2024-02-10T08:28:32.513 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.513 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.513 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:32.513 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:14.129534+0000", 2024-02-10T08:28:32.513 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1593000000000001e-05 2024-02-10T08:28:32.513 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.513 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.514 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:28:32.514 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:14.129545+0000", 2024-02-10T08:28:32.514 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.93084525799999995 2024-02-10T08:28:32.514 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.514 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.514 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:32.514 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:15.060390+0000", 2024-02-10T08:28:32.514 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1864e-05 2024-02-10T08:28:32.514 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.514 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.514 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:28:32.514 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:15.060402+0000", 2024-02-10T08:28:32.514 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.63735591599999997 2024-02-10T08:28:32.514 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.514 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.514 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:32.515 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:15.697758+0000", 2024-02-10T08:28:32.515 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011372800000000001 2024-02-10T08:28:32.515 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.515 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.515 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:28:32.515 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:15.697872+0000", 2024-02-10T08:28:32.515 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00040110599999999998 2024-02-10T08:28:32.515 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.515 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.515 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2,3,7", 2024-02-10T08:28:32.515 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:15.698273+0000", 2024-02-10T08:28:32.515 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011369659000000001 2024-02-10T08:28:32.515 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.515 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.516 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:28:32.516 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:15.709643+0000", 2024-02-10T08:28:32.516 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011196159999999999 2024-02-10T08:28:32.516 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.516 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.516 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:28:32.516 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:15.710762+0000", 2024-02-10T08:28:32.516 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0044219239999999998 2024-02-10T08:28:32.516 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.516 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.516 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:28:32.516 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:15.715184+0000", 2024-02-10T08:28:32.516 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0089129029999999998 2024-02-10T08:28:32.516 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.516 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.517 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:28:32.517 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:15.724097+0000", 2024-02-10T08:28:32.517 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7095999999999997e-05 2024-02-10T08:28:32.517 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.517 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.517 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:28:32.517 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:15.724154+0000", 2024-02-10T08:28:32.517 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012717300000000001 2024-02-10T08:28:32.517 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.517 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.517 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:28:32.517 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:15.724281+0000", 2024-02-10T08:28:32.517 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.594838677 2024-02-10T08:28:32.517 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:32.517 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:28:32.517 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:32.517 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.518 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.518 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14784.0:179952 7.c 7:393d977d:::benchmark_data_smithi018_80623_object79024:head [delete] snapc 0=[] ondisk+write+known_if_redirected e163)", 2024-02-10T08:28:32.518 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:23:14.132801+0000", 2024-02-10T08:28:32.518 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 318.36441281399999, 2024-02-10T08:28:32.518 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5916585250000002, 2024-02-10T08:28:32.518 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:28:32.518 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:28:32.518 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:28:32.518 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14784", 2024-02-10T08:28:32.518 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:28:32.518 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 179952 2024-02-10T08:28:32.518 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.518 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:28:32.518 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.518 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:28:32.519 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:14.132801+0000", 2024-02-10T08:28:32.519 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:28:32.519 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.519 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.519 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:28:32.519 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:14.132801+0000", 2024-02-10T08:28:32.519 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-02-10T08:28:32.519 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.519 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.519 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:28:32.519 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:14.132801+0000", 2024-02-10T08:28:32.519 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5419999999999999e-06 2024-02-10T08:28:32.519 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.519 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.519 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:28:32.519 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:14.132805+0000", 2024-02-10T08:28:32.520 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8410000000000002e-06 2024-02-10T08:28:32.520 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.520 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.520 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:28:32.520 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:14.132812+0000", 2024-02-10T08:28:32.520 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5170000000000001e-06 2024-02-10T08:28:32.520 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.520 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.520 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:28:32.520 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:14.132816+0000", 2024-02-10T08:28:32.520 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0043000000000003e-05 2024-02-10T08:28:32.520 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.520 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.520 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:32.520 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:14.132857+0000", 2024-02-10T08:28:32.521 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8119999999999996e-06 2024-02-10T08:28:32.521 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.521 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.521 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:28:32.521 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:14.132862+0000", 2024-02-10T08:28:32.521 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.92757749099999998 2024-02-10T08:28:32.521 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.521 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.521 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:32.521 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:15.060440+0000", 2024-02-10T08:28:32.521 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5610000000000001e-06 2024-02-10T08:28:32.521 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.521 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.521 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:28:32.521 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:15.060447+0000", 2024-02-10T08:28:32.521 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.64527584500000001 2024-02-10T08:28:32.522 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.522 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.522 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:32.522 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:15.705723+0000", 2024-02-10T08:28:32.522 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013384900000000001 2024-02-10T08:28:32.522 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.522 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.522 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:28:32.522 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:15.705857+0000", 2024-02-10T08:28:32.522 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014457700000000001 2024-02-10T08:28:32.522 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.522 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.522 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2,3,7", 2024-02-10T08:28:32.522 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:15.706002+0000", 2024-02-10T08:28:32.522 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003647576 2024-02-10T08:28:32.522 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.523 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.523 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:28:32.523 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:15.709649+0000", 2024-02-10T08:28:32.523 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019227820000000001 2024-02-10T08:28:32.523 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.523 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.523 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:28:32.523 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:15.711572+0000", 2024-02-10T08:28:32.523 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0049803820000000002 2024-02-10T08:28:32.523 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.523 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.523 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:28:32.523 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:15.716552+0000", 2024-02-10T08:28:32.523 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0077640629999999999 2024-02-10T08:28:32.523 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.523 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.524 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:28:32.524 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:15.724316+0000", 2024-02-10T08:28:32.524 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9360000000000003e-05 2024-02-10T08:28:32.524 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.524 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.524 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:28:32.524 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:15.724356+0000", 2024-02-10T08:28:32.524 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000104047 2024-02-10T08:28:32.524 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.524 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.524 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:28:32.524 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:15.724460+0000", 2024-02-10T08:28:32.524 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5916585250000002 2024-02-10T08:28:32.524 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:32.524 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:28:32.525 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:32.525 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.525 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.525 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.24299.0:1641 5.3 5:c609908c:::notify.5:head [watch reconnect cookie 94587203966592 gen 1] snapc 0=[] ondisk+write+known_if_redirected e227)", 2024-02-10T08:28:32.525 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:27:10.880310+0000", 2024-02-10T08:28:32.525 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 81.616904031999994, 2024-02-10T08:28:32.525 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0160440610000001, 2024-02-10T08:28:32.525 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:28:32.525 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-02-10T08:28:32.525 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:28:32.525 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.24299", 2024-02-10T08:28:32.525 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/871408063", 2024-02-10T08:28:32.525 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1641 2024-02-10T08:28:32.525 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.525 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:28:32.526 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.526 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:28:32.526 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:10.880310+0000", 2024-02-10T08:28:32.526 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:28:32.526 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.526 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.526 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:28:32.526 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:10.880310+0000", 2024-02-10T08:28:32.526 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-02-10T08:28:32.526 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.526 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.526 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:28:32.526 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:10.880309+0000", 2024-02-10T08:28:32.526 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4290000000000003e-06 2024-02-10T08:28:32.526 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.527 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.527 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:28:32.527 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:10.880313+0000", 2024-02-10T08:28:32.527 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2969999999999998e-06 2024-02-10T08:28:32.527 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.527 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.527 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:28:32.527 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:10.880320+0000", 2024-02-10T08:28:32.527 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2089999999999999e-06 2024-02-10T08:28:32.527 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.527 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.527 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:28:32.527 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:10.880325+0000", 2024-02-10T08:28:32.527 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6227e-05 2024-02-10T08:28:32.527 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.528 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.528 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:32.528 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:10.880411+0000", 2024-02-10T08:28:32.528 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3010000000000001e-06 2024-02-10T08:28:32.528 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.528 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.528 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-02-10T08:28:32.528 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:10.880418+0000", 2024-02-10T08:28:32.528 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0063473440000000004 2024-02-10T08:28:32.528 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.528 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.528 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:32.528 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:10.886765+0000", 2024-02-10T08:28:32.528 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9789999999999993e-06 2024-02-10T08:28:32.528 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.529 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.529 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:28:32.529 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:10.886773+0000", 2024-02-10T08:28:32.529 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.005664755 2024-02-10T08:28:32.529 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.529 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.529 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:32.529 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.892438+0000", 2024-02-10T08:28:32.529 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000172788 2024-02-10T08:28:32.529 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.529 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.529 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:28:32.529 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.892611+0000", 2024-02-10T08:28:32.529 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0037432609999999999 2024-02-10T08:28:32.529 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.530 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.530 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:28:32.530 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.896354+0000", 2024-02-10T08:28:32.530 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0160440610000001 2024-02-10T08:28:32.530 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:32.530 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:28:32.530 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:32.530 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.530 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.530 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14964.0:195552 8.6 8:6f2bef50:::benchmark_data_smithi018_103312_object71120:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e227)", 2024-02-10T08:28:32.530 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:27:10.886258+0000", 2024-02-10T08:28:32.530 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 81.610956490999996, 2024-02-10T08:28:32.530 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0369675709999999, 2024-02-10T08:28:32.530 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:28:32.530 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-02-10T08:28:32.530 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:28:32.530 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14964", 2024-02-10T08:28:32.531 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3173131962", 2024-02-10T08:28:32.531 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 195552 2024-02-10T08:28:32.531 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.531 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:28:32.531 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.531 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:28:32.531 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:10.886258+0000", 2024-02-10T08:28:32.531 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:28:32.531 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.531 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.531 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:28:32.531 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:10.886258+0000", 2024-02-10T08:28:32.531 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999981 2024-02-10T08:28:32.531 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.532 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.532 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:28:32.532 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:10.886256+0000", 2024-02-10T08:28:32.532 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9199999999999993e-06 2024-02-10T08:28:32.532 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.532 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.532 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:28:32.532 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:10.886265+0000", 2024-02-10T08:28:32.532 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1717e-05 2024-02-10T08:28:32.532 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.532 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.532 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:28:32.532 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:10.886276+0000", 2024-02-10T08:28:32.532 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.713e-05 2024-02-10T08:28:32.533 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.533 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.533 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:28:32.533 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:10.886293+0000", 2024-02-10T08:28:32.533 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018327999999999999 2024-02-10T08:28:32.533 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.533 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.533 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:32.533 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:10.886477+0000", 2024-02-10T08:28:32.533 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7950000000000002e-06 2024-02-10T08:28:32.533 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.533 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.533 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-02-10T08:28:32.533 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:10.886484+0000", 2024-02-10T08:28:32.533 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0047576679999999996 2024-02-10T08:28:32.533 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.533 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.534 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:32.534 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:10.891241+0000", 2024-02-10T08:28:32.534 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5089999999999996e-06 2024-02-10T08:28:32.534 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.534 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.534 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:28:32.534 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:10.891249+0000", 2024-02-10T08:28:32.534 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0293309049999999 2024-02-10T08:28:32.534 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.534 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.534 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:32.534 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.920580+0000", 2024-02-10T08:28:32.534 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026456409999999998 2024-02-10T08:28:32.534 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.534 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.534 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:28:32.534 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.923225+0000", 2024-02-10T08:28:32.535 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0369675709999999 2024-02-10T08:28:32.535 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:32.535 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:28:32.535 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:32.535 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.535 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.535 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14964.0:195553 8.6 8:6cc5f2b1:::benchmark_data_smithi018_103312_object71121:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e227)", 2024-02-10T08:28:32.535 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:27:10.886311+0000", 2024-02-10T08:28:32.535 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 81.610903206000003, 2024-02-10T08:28:32.535 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0369966479999999, 2024-02-10T08:28:32.535 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:28:32.535 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-02-10T08:28:32.535 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:28:32.535 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14964", 2024-02-10T08:28:32.535 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3173131962", 2024-02-10T08:28:32.536 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 195553 2024-02-10T08:28:32.536 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.536 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:28:32.536 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.536 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:28:32.536 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:10.886311+0000", 2024-02-10T08:28:32.536 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:28:32.536 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.536 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.536 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:28:32.536 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:10.886311+0000", 2024-02-10T08:28:32.536 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-02-10T08:28:32.536 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.536 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.536 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:28:32.536 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:10.886310+0000", 2024-02-10T08:28:32.537 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.58e-06 2024-02-10T08:28:32.537 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.537 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.537 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:28:32.537 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:10.886314+0000", 2024-02-10T08:28:32.537 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.156e-06 2024-02-10T08:28:32.537 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.537 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.537 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:28:32.537 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:10.886320+0000", 2024-02-10T08:28:32.537 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6310000000000002e-06 2024-02-10T08:28:32.537 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.537 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.537 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:28:32.537 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:10.886325+0000", 2024-02-10T08:28:32.537 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000179817 2024-02-10T08:28:32.538 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.538 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.538 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:32.538 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:10.886505+0000", 2024-02-10T08:28:32.538 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7169999999999996e-06 2024-02-10T08:28:32.538 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.538 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.538 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting_for_map not empty", 2024-02-10T08:28:32.538 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:10.886510+0000", 2024-02-10T08:28:32.538 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0047560379999999998 2024-02-10T08:28:32.538 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.538 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.538 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:32.538 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:10.891266+0000", 2024-02-10T08:28:32.538 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7969999999999997e-06 2024-02-10T08:28:32.538 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.539 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.539 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:28:32.539 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:10.891272+0000", 2024-02-10T08:28:32.539 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0319732930000001 2024-02-10T08:28:32.539 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.539 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.539 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:32.539 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.923245+0000", 2024-02-10T08:28:32.539 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2205000000000005e-05 2024-02-10T08:28:32.539 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.539 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.539 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:28:32.539 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.923308+0000", 2024-02-10T08:28:32.539 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0369966479999999 2024-02-10T08:28:32.539 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:32.539 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:28:32.539 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:32.540 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.540 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.540 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14964.0:195580 8.6 8:6db3bdd6:::benchmark_data_smithi018_103312_object71148:head [delete] snapc 0=[] ondisk+write+known_if_redirected e227)", 2024-02-10T08:28:32.540 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:27:10.899388+0000", 2024-02-10T08:28:32.540 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 81.597826521000002, 2024-02-10T08:28:32.540 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.077390305, 2024-02-10T08:28:32.540 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:28:32.540 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:28:32.540 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:28:32.540 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14964", 2024-02-10T08:28:32.540 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3173131962", 2024-02-10T08:28:32.540 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 195580 2024-02-10T08:28:32.540 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.540 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:28:32.540 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.540 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:28:32.541 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:10.899388+0000", 2024-02-10T08:28:32.541 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:28:32.541 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.541 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.541 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:28:32.541 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:10.899388+0000", 2024-02-10T08:28:32.541 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-02-10T08:28:32.541 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.541 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.541 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:28:32.541 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:10.899387+0000", 2024-02-10T08:28:32.541 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.08e-06 2024-02-10T08:28:32.541 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.541 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.541 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:28:32.541 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:10.899389+0000", 2024-02-10T08:28:32.541 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9670000000000001e-06 2024-02-10T08:28:32.542 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.542 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.542 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:28:32.542 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:10.899392+0000", 2024-02-10T08:28:32.542 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1600000000000001e-06 2024-02-10T08:28:32.542 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.542 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.542 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:28:32.542 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:10.899394+0000", 2024-02-10T08:28:32.542 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00034688399999999999 2024-02-10T08:28:32.542 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.542 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.542 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:32.542 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:10.899741+0000", 2024-02-10T08:28:32.542 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0910000000000001e-05 2024-02-10T08:28:32.542 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.542 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.543 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:28:32.543 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:10.899752+0000", 2024-02-10T08:28:32.543 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.023593218 2024-02-10T08:28:32.543 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.543 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.543 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:32.543 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.923345+0000", 2024-02-10T08:28:32.543 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00090603299999999999 2024-02-10T08:28:32.543 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.543 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.543 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:28:32.543 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.924251+0000", 2024-02-10T08:28:32.543 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00030303200000000001 2024-02-10T08:28:32.543 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.543 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.543 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,7", 2024-02-10T08:28:32.543 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.924555+0000", 2024-02-10T08:28:32.544 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.033844606999999999 2024-02-10T08:28:32.544 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.544 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.544 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:28:32.544 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.958399+0000", 2024-02-10T08:28:32.544 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018219437000000002 2024-02-10T08:28:32.544 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.544 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.544 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:28:32.544 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.976619+0000", 2024-02-10T08:28:32.544 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2776999999999998e-05 2024-02-10T08:28:32.544 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.544 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.544 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:28:32.544 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.976691+0000", 2024-02-10T08:28:32.544 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6338000000000003e-05 2024-02-10T08:28:32.545 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.545 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.545 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:28:32.545 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.976738+0000", 2024-02-10T08:28:32.545 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0262000000000002e-05 2024-02-10T08:28:32.545 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.545 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.545 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:28:32.545 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.976778+0000", 2024-02-10T08:28:32.545 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.077390305 2024-02-10T08:28:32.545 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:32.545 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:28:32.545 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:32.545 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.545 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.545 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14964.0:195630 8.6 8:67e61b7e:::benchmark_data_smithi018_103312_object71198:head [delete] snapc 0=[] ondisk+write+known_if_redirected e227)", 2024-02-10T08:28:32.545 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:27:10.943945+0000", 2024-02-10T08:28:32.546 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 81.553269227000001, 2024-02-10T08:28:32.546 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0330023779999999, 2024-02-10T08:28:32.546 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:28:32.546 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:28:32.546 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:28:32.546 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14964", 2024-02-10T08:28:32.546 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3173131962", 2024-02-10T08:28:32.546 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 195630 2024-02-10T08:28:32.546 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.546 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:28:32.546 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.546 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:28:32.546 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:10.943945+0000", 2024-02-10T08:28:32.546 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:28:32.546 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.546 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.546 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:28:32.547 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:10.943945+0000", 2024-02-10T08:28:32.547 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-02-10T08:28:32.547 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.547 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.547 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:28:32.547 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:10.943944+0000", 2024-02-10T08:28:32.547 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7220000000000001e-06 2024-02-10T08:28:32.547 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.547 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.547 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:28:32.547 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:10.943948+0000", 2024-02-10T08:28:32.547 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0641e-05 2024-02-10T08:28:32.547 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.547 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.547 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:28:32.547 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:10.943959+0000", 2024-02-10T08:28:32.547 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0050000000000004e-06 2024-02-10T08:28:32.547 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.548 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.548 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:28:32.548 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:10.943964+0000", 2024-02-10T08:28:32.548 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8903999999999997e-05 2024-02-10T08:28:32.548 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.548 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.548 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:32.548 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:10.944023+0000", 2024-02-10T08:28:32.548 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1799e-05 2024-02-10T08:28:32.548 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.548 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.548 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:28:32.548 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:10.944034+0000", 2024-02-10T08:28:32.548 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.005017644 2024-02-10T08:28:32.548 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.549 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.549 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:32.549 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.949052+0000", 2024-02-10T08:28:32.549 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012271499999999999 2024-02-10T08:28:32.549 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.549 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.549 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:28:32.549 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.949175+0000", 2024-02-10T08:28:32.549 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015600499999999999 2024-02-10T08:28:32.549 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.549 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.549 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,7", 2024-02-10T08:28:32.549 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.949331+0000", 2024-02-10T08:28:32.549 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0090748419999999996 2024-02-10T08:28:32.549 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.549 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.549 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:28:32.550 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.958406+0000", 2024-02-10T08:28:32.550 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018252771000000001 2024-02-10T08:28:32.550 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.550 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.550 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:28:32.550 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.976658+0000", 2024-02-10T08:28:32.550 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00020765900000000001 2024-02-10T08:28:32.550 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.550 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.550 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:28:32.550 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.976866+0000", 2024-02-10T08:28:32.550 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1523000000000002e-05 2024-02-10T08:28:32.550 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.550 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.550 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:28:32.550 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.976907+0000", 2024-02-10T08:28:32.551 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9817000000000002e-05 2024-02-10T08:28:32.551 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.551 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.551 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:28:32.551 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.976947+0000", 2024-02-10T08:28:32.551 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0330023779999999 2024-02-10T08:28:32.551 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:32.551 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:28:32.551 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:32.551 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.551 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.551 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14964.0:195659 8.6 8:6d3316c5:::benchmark_data_smithi018_103312_object71227:head [delete] snapc 0=[] ondisk+write+known_if_redirected e227)", 2024-02-10T08:28:32.551 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:27:10.970227+0000", 2024-02-10T08:28:32.551 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 81.526987090000006, 2024-02-10T08:28:32.551 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0068634970000001, 2024-02-10T08:28:32.551 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:28:32.551 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:28:32.552 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:28:32.552 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14964", 2024-02-10T08:28:32.552 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3173131962", 2024-02-10T08:28:32.552 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 195659 2024-02-10T08:28:32.552 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.552 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:28:32.552 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.552 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:28:32.552 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:10.970227+0000", 2024-02-10T08:28:32.552 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:28:32.552 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.552 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.552 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:28:32.552 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:10.970227+0000", 2024-02-10T08:28:32.553 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-02-10T08:28:32.553 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.553 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.553 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:28:32.553 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:10.970226+0000", 2024-02-10T08:28:32.553 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.55e-06 2024-02-10T08:28:32.553 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.553 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.553 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:28:32.553 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:10.970232+0000", 2024-02-10T08:28:32.553 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0332e-05 2024-02-10T08:28:32.553 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.553 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.553 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:28:32.553 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:10.970243+0000", 2024-02-10T08:28:32.554 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3340000000000001e-06 2024-02-10T08:28:32.554 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.554 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.554 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:28:32.554 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:10.970248+0000", 2024-02-10T08:28:32.554 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5140000000000002e-05 2024-02-10T08:28:32.554 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.554 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.554 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:32.554 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:10.970323+0000", 2024-02-10T08:28:32.554 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1204e-05 2024-02-10T08:28:32.554 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.554 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.554 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:28:32.554 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:10.970334+0000", 2024-02-10T08:28:32.554 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.98133937800000004 2024-02-10T08:28:32.554 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.555 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.555 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:32.555 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.951674+0000", 2024-02-10T08:28:32.555 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000114905 2024-02-10T08:28:32.555 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.555 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.555 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:28:32.555 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.951789+0000", 2024-02-10T08:28:32.555 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000117731 2024-02-10T08:28:32.555 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.555 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.555 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,7", 2024-02-10T08:28:32.555 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.951906+0000", 2024-02-10T08:28:32.555 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010354623 2024-02-10T08:28:32.555 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.556 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.556 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:28:32.556 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.962261+0000", 2024-02-10T08:28:32.556 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014566457999999999 2024-02-10T08:28:32.556 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.556 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.556 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:28:32.556 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.976827+0000", 2024-02-10T08:28:32.556 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00020476700000000001 2024-02-10T08:28:32.556 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.556 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.556 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:28:32.556 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.977032+0000", 2024-02-10T08:28:32.556 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9836e-05 2024-02-10T08:28:32.557 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.557 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.557 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:28:32.557 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.977062+0000", 2024-02-10T08:28:32.557 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8492000000000001e-05 2024-02-10T08:28:32.557 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.557 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.557 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:28:32.557 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.977091+0000", 2024-02-10T08:28:32.557 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0068634970000001 2024-02-10T08:28:32.557 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:32.557 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:28:32.557 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:32.557 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.557 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.557 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14964.0:195664 8.6 8:61f80c43:::benchmark_data_smithi018_103312_object71232:head [delete] snapc 0=[] ondisk+write+known_if_redirected e227)", 2024-02-10T08:28:32.557 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:27:10.973139+0000", 2024-02-10T08:28:32.558 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 81.524075085000007, 2024-02-10T08:28:32.558 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0040236339999999, 2024-02-10T08:28:32.558 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:28:32.558 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:28:32.558 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:28:32.558 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14964", 2024-02-10T08:28:32.558 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3173131962", 2024-02-10T08:28:32.558 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 195664 2024-02-10T08:28:32.558 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.558 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:28:32.558 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.558 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:28:32.558 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:10.973139+0000", 2024-02-10T08:28:32.558 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:28:32.558 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.558 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.558 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:28:32.559 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:10.973139+0000", 2024-02-10T08:28:32.559 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-02-10T08:28:32.559 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.559 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.559 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:28:32.559 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:10.973137+0000", 2024-02-10T08:28:32.559 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1370000000000002e-06 2024-02-10T08:28:32.559 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.559 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.559 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:28:32.559 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:10.973146+0000", 2024-02-10T08:28:32.559 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1661000000000001e-05 2024-02-10T08:28:32.559 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.559 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.559 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:28:32.559 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:10.973157+0000", 2024-02-10T08:28:32.560 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9570000000000002e-06 2024-02-10T08:28:32.560 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.560 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.560 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:28:32.560 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:10.973165+0000", 2024-02-10T08:28:32.560 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8944999999999998e-05 2024-02-10T08:28:32.560 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.560 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.560 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:32.560 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:10.973234+0000", 2024-02-10T08:28:32.560 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0353999999999999e-05 2024-02-10T08:28:32.560 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.560 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.560 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:28:32.560 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:10.973244+0000", 2024-02-10T08:28:32.560 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.980967327 2024-02-10T08:28:32.561 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.561 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.561 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:32.561 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.954212+0000", 2024-02-10T08:28:32.561 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012958699999999999 2024-02-10T08:28:32.561 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.561 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.561 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:28:32.561 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.954341+0000", 2024-02-10T08:28:32.561 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8729999999999999e-05 2024-02-10T08:28:32.561 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.561 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.561 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,7", 2024-02-10T08:28:32.561 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.954430+0000", 2024-02-10T08:28:32.561 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0078398449999999998 2024-02-10T08:28:32.561 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.562 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.562 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:28:32.562 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.962270+0000", 2024-02-10T08:28:32.562 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014724401999999999 2024-02-10T08:28:32.562 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.562 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.562 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:28:32.562 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.976994+0000", 2024-02-10T08:28:32.562 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012665300000000001 2024-02-10T08:28:32.562 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.562 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.562 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:28:32.562 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.977121+0000", 2024-02-10T08:28:32.562 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1953000000000001e-05 2024-02-10T08:28:32.562 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.563 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.563 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:28:32.563 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.977143+0000", 2024-02-10T08:28:32.563 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9721e-05 2024-02-10T08:28:32.563 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.563 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.563 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:28:32.563 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.977163+0000", 2024-02-10T08:28:32.563 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0040236339999999 2024-02-10T08:28:32.563 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:32.563 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:28:32.563 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:32.563 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.563 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.564 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14964.0:195676 8.6 8:69018c1e:::benchmark_data_smithi018_103312_object71244:head [delete] snapc 0=[] ondisk+write+known_if_redirected e227)", 2024-02-10T08:28:32.564 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:27:10.985272+0000", 2024-02-10T08:28:32.564 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 81.511941745000001, 2024-02-10T08:28:32.564 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.99227928899999995, 2024-02-10T08:28:32.564 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:28:32.564 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:28:32.564 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:28:32.564 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14964", 2024-02-10T08:28:32.564 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3173131962", 2024-02-10T08:28:32.564 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 195676 2024-02-10T08:28:32.564 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.564 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:28:32.564 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.564 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:28:32.564 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:10.985272+0000", 2024-02-10T08:28:32.564 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:28:32.565 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.565 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.565 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:28:32.565 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:10.985272+0000", 2024-02-10T08:28:32.565 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-02-10T08:28:32.565 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.565 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.565 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:28:32.565 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:10.985271+0000", 2024-02-10T08:28:32.565 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5640000000000002e-06 2024-02-10T08:28:32.565 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.565 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.565 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:28:32.565 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:10.985278+0000", 2024-02-10T08:28:32.565 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1292e-05 2024-02-10T08:28:32.566 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.566 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.566 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:28:32.566 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:10.985289+0000", 2024-02-10T08:28:32.566 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9950000000000002e-06 2024-02-10T08:28:32.566 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.566 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.566 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:28:32.566 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:10.985295+0000", 2024-02-10T08:28:32.566 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7368999999999998e-05 2024-02-10T08:28:32.566 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.566 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.566 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:32.566 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:10.985363+0000", 2024-02-10T08:28:32.566 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0481e-05 2024-02-10T08:28:32.566 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.567 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.567 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:28:32.567 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:10.985373+0000", 2024-02-10T08:28:32.567 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.970876988 2024-02-10T08:28:32.567 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.567 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.567 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:32.567 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.956250+0000", 2024-02-10T08:28:32.567 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000108625 2024-02-10T08:28:32.567 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.567 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.567 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:28:32.567 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.956359+0000", 2024-02-10T08:28:32.567 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000143101 2024-02-10T08:28:32.567 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.567 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.568 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,7", 2024-02-10T08:28:32.568 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.956502+0000", 2024-02-10T08:28:32.568 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0095343140000000003 2024-02-10T08:28:32.568 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.568 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.568 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:28:32.568 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.966036+0000", 2024-02-10T08:28:32.568 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011303653 2024-02-10T08:28:32.568 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.568 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.568 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:28:32.568 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.977340+0000", 2024-02-10T08:28:32.568 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000141927 2024-02-10T08:28:32.568 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.568 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.569 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:28:32.569 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.977482+0000", 2024-02-10T08:28:32.569 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4501e-05 2024-02-10T08:28:32.569 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.569 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.569 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:28:32.569 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.977526+0000", 2024-02-10T08:28:32.569 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5542999999999999e-05 2024-02-10T08:28:32.569 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.569 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.569 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:28:32.569 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.977552+0000", 2024-02-10T08:28:32.569 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.99227928899999995 2024-02-10T08:28:32.569 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:32.569 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:28:32.569 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:32.570 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.570 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.570 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14964.0:195679 8.6 8:6e106e4d:::benchmark_data_smithi018_103312_object71247:head [delete] snapc 0=[] ondisk+write+known_if_redirected e227)", 2024-02-10T08:28:32.570 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:27:10.988084+0000", 2024-02-10T08:28:32.570 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 81.509130138000003, 2024-02-10T08:28:32.570 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.989587997, 2024-02-10T08:28:32.570 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:28:32.570 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:28:32.570 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:28:32.570 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14964", 2024-02-10T08:28:32.570 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3173131962", 2024-02-10T08:28:32.570 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 195679 2024-02-10T08:28:32.570 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.570 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:28:32.570 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.570 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:28:32.571 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:10.988084+0000", 2024-02-10T08:28:32.571 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:28:32.571 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.571 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.571 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:28:32.571 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:10.988084+0000", 2024-02-10T08:28:32.571 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-02-10T08:28:32.571 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.571 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.571 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:28:32.571 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:10.988083+0000", 2024-02-10T08:28:32.571 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2920000000000003e-06 2024-02-10T08:28:32.571 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.571 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.571 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:28:32.571 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:10.988088+0000", 2024-02-10T08:28:32.572 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8510000000000005e-06 2024-02-10T08:28:32.572 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.572 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.572 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:28:32.572 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:10.988097+0000", 2024-02-10T08:28:32.572 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.639e-06 2024-02-10T08:28:32.572 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.572 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.572 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:28:32.572 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:10.988102+0000", 2024-02-10T08:28:32.572 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4311000000000002e-05 2024-02-10T08:28:32.572 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.572 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.572 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:32.573 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:10.988156+0000", 2024-02-10T08:28:32.573 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0495e-05 2024-02-10T08:28:32.573 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.573 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.573 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:28:32.573 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:10.988167+0000", 2024-02-10T08:28:32.573 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.97027879699999997 2024-02-10T08:28:32.573 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.573 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.573 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:32.573 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.958445+0000", 2024-02-10T08:28:32.573 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000121685 2024-02-10T08:28:32.573 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.573 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.573 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:28:32.573 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.958567+0000", 2024-02-10T08:28:32.574 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011658 2024-02-10T08:28:32.574 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.574 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.574 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,7", 2024-02-10T08:28:32.574 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.958684+0000", 2024-02-10T08:28:32.574 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0073600540000000004 2024-02-10T08:28:32.574 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.574 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.574 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:28:32.574 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.966044+0000", 2024-02-10T08:28:32.574 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011346995 2024-02-10T08:28:32.574 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.574 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.574 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:28:32.575 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.977391+0000", 2024-02-10T08:28:32.575 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00020208800000000001 2024-02-10T08:28:32.575 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.575 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.575 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:28:32.575 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.977593+0000", 2024-02-10T08:28:32.575 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2787000000000002e-05 2024-02-10T08:28:32.575 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.575 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.575 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:28:32.575 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.977636+0000", 2024-02-10T08:28:32.575 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6488e-05 2024-02-10T08:28:32.575 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.575 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.575 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:28:32.575 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.977672+0000", 2024-02-10T08:28:32.575 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.989587997 2024-02-10T08:28:32.576 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:32.576 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:28:32.576 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:32.576 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.576 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.576 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14964.0:195698 8.6 8:668fc00e:::benchmark_data_smithi018_103312_object71266:head [delete] snapc 0=[] ondisk+write+known_if_redirected e227)", 2024-02-10T08:28:32.576 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:27:11.006956+0000", 2024-02-10T08:28:32.576 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 81.490258506000004, 2024-02-10T08:28:32.576 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.97084577500000002, 2024-02-10T08:28:32.576 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:28:32.576 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:28:32.576 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:28:32.576 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14964", 2024-02-10T08:28:32.576 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3173131962", 2024-02-10T08:28:32.576 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 195698 2024-02-10T08:28:32.577 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.577 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:28:32.577 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.577 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:28:32.577 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.006956+0000", 2024-02-10T08:28:32.577 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:28:32.577 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.577 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.577 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:28:32.577 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.006956+0000", 2024-02-10T08:28:32.577 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-02-10T08:28:32.577 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.577 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.577 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:28:32.577 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.006954+0000", 2024-02-10T08:28:32.578 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7309999999999996e-06 2024-02-10T08:28:32.578 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.578 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.578 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:28:32.578 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.006961+0000", 2024-02-10T08:28:32.578 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8460000000000003e-06 2024-02-10T08:28:32.578 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.578 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.578 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:28:32.578 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.006971+0000", 2024-02-10T08:28:32.578 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4829999999999996e-06 2024-02-10T08:28:32.578 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.578 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.578 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:28:32.578 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.006977+0000", 2024-02-10T08:28:32.579 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6475000000000003e-05 2024-02-10T08:28:32.579 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.579 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.579 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:32.579 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.007044+0000", 2024-02-10T08:28:32.579 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0216e-05 2024-02-10T08:28:32.579 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.579 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.579 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:28:32.579 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.007054+0000", 2024-02-10T08:28:32.579 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.95311030200000002 2024-02-10T08:28:32.579 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.579 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.579 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:32.579 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.960164+0000", 2024-02-10T08:28:32.579 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000114225 2024-02-10T08:28:32.580 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.580 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.580 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:28:32.580 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.960279+0000", 2024-02-10T08:28:32.580 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013471699999999999 2024-02-10T08:28:32.580 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.580 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.580 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,7", 2024-02-10T08:28:32.580 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.960413+0000", 2024-02-10T08:28:32.580 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010010165999999999 2024-02-10T08:28:32.580 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.580 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.580 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:28:32.580 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.970423+0000", 2024-02-10T08:28:32.580 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0070173070000000004 2024-02-10T08:28:32.580 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.580 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.581 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:28:32.581 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.977441+0000", 2024-02-10T08:28:32.581 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000276927 2024-02-10T08:28:32.581 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.581 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.581 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:28:32.581 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.977718+0000", 2024-02-10T08:28:32.581 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5226999999999999e-05 2024-02-10T08:28:32.581 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.581 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.581 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:28:32.581 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.977763+0000", 2024-02-10T08:28:32.581 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8534000000000001e-05 2024-02-10T08:28:32.581 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.581 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.581 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:28:32.582 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.977801+0000", 2024-02-10T08:28:32.582 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.97084577500000002 2024-02-10T08:28:32.582 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:32.582 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:28:32.582 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:32.582 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.582 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.582 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14964.0:195721 8.6 8:6192e74e:::benchmark_data_smithi018_103312_object71289:head [delete] snapc 0=[] ondisk+write+known_if_redirected e227)", 2024-02-10T08:28:32.582 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:27:11.029152+0000", 2024-02-10T08:28:32.582 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 81.468062013999997, 2024-02-10T08:28:32.582 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.94884289099999997, 2024-02-10T08:28:32.582 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:28:32.582 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:28:32.582 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:28:32.582 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14964", 2024-02-10T08:28:32.582 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3173131962", 2024-02-10T08:28:32.583 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 195721 2024-02-10T08:28:32.583 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.583 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:28:32.583 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.583 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:28:32.583 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.029152+0000", 2024-02-10T08:28:32.583 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:28:32.583 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.583 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.583 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:28:32.583 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.029152+0000", 2024-02-10T08:28:32.583 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-02-10T08:28:32.583 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.583 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.583 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:28:32.583 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.029151+0000", 2024-02-10T08:28:32.584 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3760000000000002e-06 2024-02-10T08:28:32.584 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.584 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.584 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:28:32.584 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.029158+0000", 2024-02-10T08:28:32.584 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1798e-05 2024-02-10T08:28:32.584 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.584 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.584 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:28:32.584 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.029170+0000", 2024-02-10T08:28:32.584 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6930000000000004e-06 2024-02-10T08:28:32.584 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.584 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.584 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:28:32.584 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.029176+0000", 2024-02-10T08:28:32.584 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4719999999999998e-05 2024-02-10T08:28:32.585 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.585 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.585 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:32.585 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.029230+0000", 2024-02-10T08:28:32.585 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7299999999999994e-06 2024-02-10T08:28:32.585 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.585 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.585 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:28:32.585 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.029239+0000", 2024-02-10T08:28:32.585 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.93307669999999998 2024-02-10T08:28:32.585 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.585 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.585 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:32.585 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.962316+0000", 2024-02-10T08:28:32.585 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9692999999999997e-05 2024-02-10T08:28:32.586 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.586 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.586 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:28:32.586 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.962405+0000", 2024-02-10T08:28:32.586 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000114002 2024-02-10T08:28:32.586 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.586 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.586 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,7", 2024-02-10T08:28:32.586 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.962519+0000", 2024-02-10T08:28:32.586 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0079116919999999997 2024-02-10T08:28:32.586 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.586 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.586 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:28:32.586 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.970431+0000", 2024-02-10T08:28:32.586 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0074115659999999996 2024-02-10T08:28:32.587 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.587 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.587 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:28:32.587 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.977843+0000", 2024-02-10T08:28:32.587 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0271999999999994e-05 2024-02-10T08:28:32.587 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.587 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.587 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:28:32.587 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.977913+0000", 2024-02-10T08:28:32.587 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2166000000000003e-05 2024-02-10T08:28:32.587 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.587 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.587 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:28:32.587 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.977955+0000", 2024-02-10T08:28:32.587 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9903000000000001e-05 2024-02-10T08:28:32.588 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.588 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.588 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:28:32.588 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.977995+0000", 2024-02-10T08:28:32.588 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.94884289099999997 2024-02-10T08:28:32.588 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:32.588 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:28:32.588 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:32.588 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.588 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.588 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14964.0:195727 8.6 8:697cb5cc:::benchmark_data_smithi018_103312_object71295:head [delete] snapc 0=[] ondisk+write+known_if_redirected e227)", 2024-02-10T08:28:32.588 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:27:11.033781+0000", 2024-02-10T08:28:32.588 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 81.463432995999995, 2024-02-10T08:28:32.588 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.94435256700000003, 2024-02-10T08:28:32.588 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:28:32.589 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:28:32.589 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:28:32.589 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14964", 2024-02-10T08:28:32.589 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3173131962", 2024-02-10T08:28:32.589 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 195727 2024-02-10T08:28:32.589 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.589 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:28:32.589 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.589 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:28:32.589 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.033781+0000", 2024-02-10T08:28:32.589 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:28:32.589 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.589 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.589 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:28:32.590 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.033781+0000", 2024-02-10T08:28:32.590 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-02-10T08:28:32.590 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.590 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.590 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:28:32.590 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.033780+0000", 2024-02-10T08:28:32.590 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3969999999999997e-06 2024-02-10T08:28:32.590 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.590 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.590 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:28:32.590 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.033787+0000", 2024-02-10T08:28:32.590 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3562e-05 2024-02-10T08:28:32.590 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.590 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.590 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:28:32.590 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.033801+0000", 2024-02-10T08:28:32.591 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4549999999999998e-06 2024-02-10T08:28:32.591 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.591 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.591 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:28:32.591 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.033808+0000", 2024-02-10T08:28:32.591 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2416999999999995e-05 2024-02-10T08:28:32.591 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.591 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.591 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:32.591 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.033870+0000", 2024-02-10T08:28:32.591 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1453e-05 2024-02-10T08:28:32.591 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.591 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.591 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:28:32.591 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.033882+0000", 2024-02-10T08:28:32.591 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.930081304 2024-02-10T08:28:32.592 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.592 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.592 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:32.592 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.963963+0000", 2024-02-10T08:28:32.592 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000105733 2024-02-10T08:28:32.592 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.592 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.592 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:28:32.592 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.964069+0000", 2024-02-10T08:28:32.592 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014509500000000001 2024-02-10T08:28:32.592 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.592 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.592 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,7", 2024-02-10T08:28:32.593 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.964214+0000", 2024-02-10T08:28:32.593 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010127911999999999 2024-02-10T08:28:32.593 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.593 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.593 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:28:32.593 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.974342+0000", 2024-02-10T08:28:32.593 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035369360000000001 2024-02-10T08:28:32.593 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.593 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.593 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:28:32.593 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.977879+0000", 2024-02-10T08:28:32.593 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000186417 2024-02-10T08:28:32.593 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.593 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.593 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:28:32.594 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.978065+0000", 2024-02-10T08:28:32.594 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1696999999999997e-05 2024-02-10T08:28:32.594 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.594 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.594 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:28:32.594 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.978107+0000", 2024-02-10T08:28:32.594 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6729000000000001e-05 2024-02-10T08:28:32.594 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.594 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.594 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:28:32.594 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.978134+0000", 2024-02-10T08:28:32.594 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.94435256700000003 2024-02-10T08:28:32.594 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:32.594 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:28:32.594 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:32.594 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.595 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.595 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14964.0:195734 8.6 8:6083ad17:::benchmark_data_smithi018_103312_object71302:head [delete] snapc 0=[] ondisk+write+known_if_redirected e227)", 2024-02-10T08:28:32.595 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:27:11.040190+0000", 2024-02-10T08:28:32.595 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 81.457024363000002, 2024-02-10T08:28:32.595 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.93801939599999995, 2024-02-10T08:28:32.595 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:28:32.595 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:28:32.595 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:28:32.595 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14964", 2024-02-10T08:28:32.595 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3173131962", 2024-02-10T08:28:32.595 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 195734 2024-02-10T08:28:32.595 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.595 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:28:32.595 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.595 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:28:32.595 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.040190+0000", 2024-02-10T08:28:32.595 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:28:32.596 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.596 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.596 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:28:32.596 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.040190+0000", 2024-02-10T08:28:32.596 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999981 2024-02-10T08:28:32.596 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.596 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.596 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:28:32.596 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.040188+0000", 2024-02-10T08:28:32.596 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6852000000000001e-05 2024-02-10T08:28:32.596 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.596 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.596 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:28:32.596 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.040205+0000", 2024-02-10T08:28:32.597 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1545e-05 2024-02-10T08:28:32.597 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.597 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.597 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:28:32.597 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.040216+0000", 2024-02-10T08:28:32.597 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5430000000000001e-06 2024-02-10T08:28:32.597 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.597 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.597 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:28:32.597 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.040222+0000", 2024-02-10T08:28:32.597 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9066000000000001e-05 2024-02-10T08:28:32.597 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.597 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.597 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:32.597 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.040271+0000", 2024-02-10T08:28:32.598 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1079999999999999e-06 2024-02-10T08:28:32.598 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.598 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.598 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:28:32.598 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.040280+0000", 2024-02-10T08:28:32.598 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.92581332800000005 2024-02-10T08:28:32.598 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.598 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.598 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:32.598 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.966094+0000", 2024-02-10T08:28:32.598 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000127198 2024-02-10T08:28:32.598 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.598 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.598 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:28:32.598 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.966221+0000", 2024-02-10T08:28:32.599 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013531700000000001 2024-02-10T08:28:32.599 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.599 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.599 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,7", 2024-02-10T08:28:32.599 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.966356+0000", 2024-02-10T08:28:32.599 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0079923349999999997 2024-02-10T08:28:32.599 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.599 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.599 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:28:32.599 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.974348+0000", 2024-02-10T08:28:32.599 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0036831530000000002 2024-02-10T08:28:32.599 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.599 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.599 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:28:32.600 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.978032+0000", 2024-02-10T08:28:32.600 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012333799999999999 2024-02-10T08:28:32.600 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.600 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.600 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:28:32.600 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.978155+0000", 2024-02-10T08:28:32.600 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1721000000000001e-05 2024-02-10T08:28:32.600 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.600 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.600 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:28:32.600 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.978177+0000", 2024-02-10T08:28:32.600 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2589000000000003e-05 2024-02-10T08:28:32.600 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.600 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.600 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:28:32.601 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.978209+0000", 2024-02-10T08:28:32.601 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.93801939599999995 2024-02-10T08:28:32.601 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:32.601 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:28:32.601 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:32.601 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.601 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.601 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14964.0:195776 8.6 8:6d6cb3b3:::benchmark_data_smithi018_103312_object71344:head [delete] snapc 0=[] ondisk+write+known_if_redirected e227)", 2024-02-10T08:28:32.601 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:27:11.085602+0000", 2024-02-10T08:28:32.601 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 81.411612476000002, 2024-02-10T08:28:32.601 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.89273061399999998, 2024-02-10T08:28:32.601 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:28:32.601 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:28:32.601 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:28:32.601 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14964", 2024-02-10T08:28:32.601 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3173131962", 2024-02-10T08:28:32.602 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 195776 2024-02-10T08:28:32.602 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.602 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:28:32.602 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.602 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:28:32.602 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.085602+0000", 2024-02-10T08:28:32.602 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:28:32.602 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.602 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.602 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:28:32.602 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.085602+0000", 2024-02-10T08:28:32.602 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-02-10T08:28:32.602 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.602 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.602 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:28:32.602 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.085600+0000", 2024-02-10T08:28:32.603 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3679999999999996e-06 2024-02-10T08:28:32.603 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.603 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.603 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:28:32.603 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.085608+0000", 2024-02-10T08:28:32.603 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.294e-05 2024-02-10T08:28:32.603 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.603 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.603 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:28:32.603 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.085621+0000", 2024-02-10T08:28:32.603 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1580000000000002e-06 2024-02-10T08:28:32.603 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.603 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.603 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:28:32.603 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.085627+0000", 2024-02-10T08:28:32.603 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8285999999999997e-05 2024-02-10T08:28:32.603 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.604 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.604 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:32.604 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.085685+0000", 2024-02-10T08:28:32.604 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2680000000000001e-05 2024-02-10T08:28:32.604 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.604 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.604 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:28:32.604 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.085698+0000", 2024-02-10T08:28:32.604 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.88265687400000004 2024-02-10T08:28:32.604 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.604 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.604 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:32.604 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.968355+0000", 2024-02-10T08:28:32.604 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011123100000000001 2024-02-10T08:28:32.604 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.605 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.605 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:28:32.605 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.968466+0000", 2024-02-10T08:28:32.605 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013589299999999999 2024-02-10T08:28:32.605 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.605 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.605 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,7", 2024-02-10T08:28:32.605 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.968602+0000", 2024-02-10T08:28:32.605 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0076309910000000002 2024-02-10T08:28:32.605 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.605 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.605 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:28:32.605 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.976233+0000", 2024-02-10T08:28:32.605 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020053689999999999 2024-02-10T08:28:32.605 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.606 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.606 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:28:32.606 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.978238+0000", 2024-02-10T08:28:32.606 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9288e-05 2024-02-10T08:28:32.606 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.606 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.606 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:28:32.606 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.978288+0000", 2024-02-10T08:28:32.606 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3116e-05 2024-02-10T08:28:32.606 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.606 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.606 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:28:32.606 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.978311+0000", 2024-02-10T08:28:32.606 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1665999999999999e-05 2024-02-10T08:28:32.606 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.607 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.607 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:28:32.607 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.978332+0000", 2024-02-10T08:28:32.607 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.89273061399999998 2024-02-10T08:28:32.607 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:32.607 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:28:32.607 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:32.607 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.607 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.607 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14964.0:195787 8.6 8:61b7f211:::benchmark_data_smithi018_103312_object71355:head [delete] snapc 0=[] ondisk+write+known_if_redirected e227)", 2024-02-10T08:28:32.607 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:27:11.095902+0000", 2024-02-10T08:28:32.607 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 81.401312621000002, 2024-02-10T08:28:32.607 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.88248943599999996, 2024-02-10T08:28:32.607 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:28:32.607 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:28:32.608 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:28:32.608 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14964", 2024-02-10T08:28:32.608 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3173131962", 2024-02-10T08:28:32.608 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 195787 2024-02-10T08:28:32.608 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.608 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:28:32.608 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.608 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:28:32.608 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.095902+0000", 2024-02-10T08:28:32.608 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:28:32.608 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.608 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.608 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:28:32.608 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.095902+0000", 2024-02-10T08:28:32.609 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-02-10T08:28:32.609 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.609 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.609 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:28:32.609 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.095901+0000", 2024-02-10T08:28:32.609 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6610000000000002e-06 2024-02-10T08:28:32.609 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.609 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.609 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:28:32.609 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.095904+0000", 2024-02-10T08:28:32.609 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9469999999999997e-06 2024-02-10T08:28:32.609 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.609 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.609 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:28:32.609 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.095911+0000", 2024-02-10T08:28:32.609 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7100000000000001e-06 2024-02-10T08:28:32.610 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.610 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.610 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:28:32.610 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.095915+0000", 2024-02-10T08:28:32.610 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4571999999999999e-05 2024-02-10T08:28:32.610 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.610 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.610 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:32.610 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.095960+0000", 2024-02-10T08:28:32.610 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8320000000000006e-06 2024-02-10T08:28:32.610 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.610 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.610 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:28:32.610 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.095967+0000", 2024-02-10T08:28:32.610 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.87450777199999996 2024-02-10T08:28:32.610 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.611 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.611 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:32.611 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.970475+0000", 2024-02-10T08:28:32.611 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000114937 2024-02-10T08:28:32.611 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.611 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.611 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:28:32.611 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.970590+0000", 2024-02-10T08:28:32.611 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1971000000000004e-05 2024-02-10T08:28:32.611 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.611 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.611 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,7", 2024-02-10T08:28:32.611 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.970682+0000", 2024-02-10T08:28:32.611 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0055571809999999996 2024-02-10T08:28:32.611 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.611 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.612 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:28:32.612 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.976239+0000", 2024-02-10T08:28:32.612 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020159150000000001 2024-02-10T08:28:32.612 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.612 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.612 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:28:32.612 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.978255+0000", 2024-02-10T08:28:32.612 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5878999999999995e-05 2024-02-10T08:28:32.612 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.612 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.612 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:28:32.612 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.978351+0000", 2024-02-10T08:28:32.612 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1543999999999999e-05 2024-02-10T08:28:32.612 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.613 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.613 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:28:32.613 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.978373+0000", 2024-02-10T08:28:32.613 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8284e-05 2024-02-10T08:28:32.613 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.613 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.613 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:28:32.613 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.978391+0000", 2024-02-10T08:28:32.613 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.88248943599999996 2024-02-10T08:28:32.613 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:32.613 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:28:32.613 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:32.613 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.613 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.613 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14964.0:195805 8.6 8:632ae76f:::benchmark_data_smithi018_103312_object71373:head [delete] snapc 0=[] ondisk+write+known_if_redirected e227)", 2024-02-10T08:28:32.614 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:27:11.123252+0000", 2024-02-10T08:28:32.614 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 81.373962339000002, 2024-02-10T08:28:32.614 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.85521516500000005, 2024-02-10T08:28:32.614 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:28:32.614 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:28:32.614 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:28:32.614 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14964", 2024-02-10T08:28:32.614 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3173131962", 2024-02-10T08:28:32.614 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 195805 2024-02-10T08:28:32.614 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.614 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:28:32.614 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.614 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:28:32.614 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.123252+0000", 2024-02-10T08:28:32.614 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:28:32.615 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.615 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.615 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:28:32.615 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.123252+0000", 2024-02-10T08:28:32.615 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-02-10T08:28:32.615 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.615 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.615 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:28:32.615 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.123250+0000", 2024-02-10T08:28:32.615 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.199e-06 2024-02-10T08:28:32.615 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.615 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.615 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:28:32.615 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.123258+0000", 2024-02-10T08:28:32.615 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0513000000000001e-05 2024-02-10T08:28:32.615 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.616 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.616 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:28:32.616 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.123268+0000", 2024-02-10T08:28:32.616 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0979999999999999e-06 2024-02-10T08:28:32.616 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.616 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.616 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:28:32.616 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.123274+0000", 2024-02-10T08:28:32.616 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5489999999999998e-05 2024-02-10T08:28:32.616 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.616 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.616 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:32.616 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.123340+0000", 2024-02-10T08:28:32.616 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.382e-05 2024-02-10T08:28:32.616 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.617 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.617 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:28:32.617 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.123353+0000", 2024-02-10T08:28:32.617 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.84885866700000001 2024-02-10T08:28:32.617 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.617 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.617 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:32.617 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.972212+0000", 2024-02-10T08:28:32.617 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000104973 2024-02-10T08:28:32.617 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.617 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.617 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:28:32.617 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.972317+0000", 2024-02-10T08:28:32.617 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000130622 2024-02-10T08:28:32.617 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.617 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.618 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,7", 2024-02-10T08:28:32.618 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.972448+0000", 2024-02-10T08:28:32.618 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0045093679999999997 2024-02-10T08:28:32.618 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.618 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.618 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:28:32.618 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.976957+0000", 2024-02-10T08:28:32.618 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0013150709999999999 2024-02-10T08:28:32.618 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.618 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.618 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:28:32.618 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.978272+0000", 2024-02-10T08:28:32.618 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000154504 2024-02-10T08:28:32.618 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.618 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.618 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:28:32.619 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.978427+0000", 2024-02-10T08:28:32.619 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1571999999999999e-05 2024-02-10T08:28:32.619 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.619 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.619 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:28:32.619 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.978448+0000", 2024-02-10T08:28:32.619 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8728000000000001e-05 2024-02-10T08:28:32.619 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:32.619 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:32.619 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:28:32.619 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:27:11.978467+0000", 2024-02-10T08:28:32.619 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.85521516500000005 2024-02-10T08:28:32.619 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:32.619 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:28:32.619 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:32.620 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:32.620 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:28:32.620 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-02-10T08:28:32.620 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:30.814320+0000 mgr.y (mgr.14505) 444 : cluster [DBG] pgmap v534: 158 pgs: 15 creating+peering, 143 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-02-10T08:28:32.621 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:31.261447+0000 osd.7 (osd.7) 149 : cluster [DBG] 2.1f scrub starts 2024-02-10T08:28:32.621 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:31.264348+0000 osd.7 (osd.7) 150 : cluster [DBG] 2.1f scrub ok 2024-02-10T08:28:32.621 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:28:31.656351+0000 mon.a (mon.0) 1288 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:28:32.621 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:30.814320+0000 mgr.y (mgr.14505) 444 : cluster [DBG] pgmap v534: 158 pgs: 15 creating+peering, 143 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-02-10T08:28:32.621 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:31.261447+0000 osd.7 (osd.7) 149 : cluster [DBG] 2.1f scrub starts 2024-02-10T08:28:32.621 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:31.264348+0000 osd.7 (osd.7) 150 : cluster [DBG] 2.1f scrub ok 2024-02-10T08:28:32.621 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:28:31.656351+0000 mon.a (mon.0) 1288 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:28:32.622 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:32.622 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:28:32.622 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:28:32.723 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:28:32.751 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:33.295 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-10T08:28:33.322 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:32.174880+0000 osd.0 (osd.0) 120 : cluster [DBG] 5.1e scrub starts 2024-02-10T08:28:33.322 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:32.177766+0000 osd.0 (osd.0) 121 : cluster [DBG] 5.1e scrub ok 2024-02-10T08:28:33.323 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:32.174880+0000 osd.0 (osd.0) 120 : cluster [DBG] 5.1e scrub starts 2024-02-10T08:28:33.323 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:32.177766+0000 osd.0 (osd.0) 121 : cluster [DBG] 5.1e scrub ok 2024-02-10T08:28:33.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:32.174880+0000 osd.0 (osd.0) 120 : cluster [DBG] 5.1e scrub starts 2024-02-10T08:28:33.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:32.177766+0000 osd.0 (osd.0) 121 : cluster [DBG] 5.1e scrub ok 2024-02-10T08:28:33.591 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.7 dump_ops_in_flight 2024-02-10T08:28:33.802 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:28:33.804 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:33.805 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:28:33.905 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:28:33.934 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:34.092 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:28:34.096 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:34.096 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:28:34.197 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:28:34.205 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:32.814993+0000 mgr.y (mgr.14505) 445 : cluster [DBG] pgmap v535: 158 pgs: 3 creating+peering, 155 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-02-10T08:28:34.205 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:33.203800+0000 osd.0 (osd.0) 122 : cluster [DBG] 4.3 scrub starts 2024-02-10T08:28:34.205 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:33.205886+0000 osd.0 (osd.0) 123 : cluster [DBG] 4.3 scrub ok 2024-02-10T08:28:34.205 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:33.211915+0000 osd.7 (osd.7) 151 : cluster [DBG] 6.15 scrub starts 2024-02-10T08:28:34.206 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:33.229014+0000 osd.7 (osd.7) 152 : cluster [DBG] 6.15 scrub ok 2024-02-10T08:28:34.206 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:33.455960+0000 osd.6 (osd.6) 117 : cluster [DBG] 2.1a scrub starts 2024-02-10T08:28:34.206 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:33.456776+0000 osd.6 (osd.6) 118 : cluster [DBG] 2.1a scrub ok 2024-02-10T08:28:34.225 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:34.322 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:28:34.325 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:34.326 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:28:34.350 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:28:34.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:32.814993+0000 mgr.y (mgr.14505) 445 : cluster [DBG] pgmap v535: 158 pgs: 3 creating+peering, 155 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-02-10T08:28:34.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:33.203800+0000 osd.0 (osd.0) 122 : cluster [DBG] 4.3 scrub starts 2024-02-10T08:28:34.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:33.205886+0000 osd.0 (osd.0) 123 : cluster [DBG] 4.3 scrub ok 2024-02-10T08:28:34.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:33.211915+0000 osd.7 (osd.7) 151 : cluster [DBG] 6.15 scrub starts 2024-02-10T08:28:34.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:33.229014+0000 osd.7 (osd.7) 152 : cluster [DBG] 6.15 scrub ok 2024-02-10T08:28:34.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:33.455960+0000 osd.6 (osd.6) 117 : cluster [DBG] 2.1a scrub starts 2024-02-10T08:28:34.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:33.456776+0000 osd.6 (osd.6) 118 : cluster [DBG] 2.1a scrub ok 2024-02-10T08:28:34.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:32.814993+0000 mgr.y (mgr.14505) 445 : cluster [DBG] pgmap v535: 158 pgs: 3 creating+peering, 155 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-02-10T08:28:34.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:33.203800+0000 osd.0 (osd.0) 122 : cluster [DBG] 4.3 scrub starts 2024-02-10T08:28:34.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:33.205886+0000 osd.0 (osd.0) 123 : cluster [DBG] 4.3 scrub ok 2024-02-10T08:28:34.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:33.211915+0000 osd.7 (osd.7) 151 : cluster [DBG] 6.15 scrub starts 2024-02-10T08:28:34.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:33.229014+0000 osd.7 (osd.7) 152 : cluster [DBG] 6.15 scrub ok 2024-02-10T08:28:34.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:33.455960+0000 osd.6 (osd.6) 117 : cluster [DBG] 2.1a scrub starts 2024-02-10T08:28:34.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:33.456776+0000 osd.6 (osd.6) 118 : cluster [DBG] 2.1a scrub ok 2024-02-10T08:28:34.427 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:28:34.460 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:34.491 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:28:34.495 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:34.496 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:28:34.597 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:28:34.624 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:34.645 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:28:34.648 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:34.648 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:28:34.749 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:28:34.777 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:35.118 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:28:35.118 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:28:35.125 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:28:35.128 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:35.129 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:28:35.216 INFO:teuthology.orchestra.run.smithi018.stderr:enabled application 'rados' on pool 'unique_pool_2' 2024-02-10T08:28:35.229 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:28:35.259 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:35.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:34.168960+0000 osd.0 (osd.0) 124 : cluster [DBG] 6.f deep-scrub starts 2024-02-10T08:28:35.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:34.215358+0000 osd.0 (osd.0) 125 : cluster [DBG] 6.f deep-scrub ok 2024-02-10T08:28:35.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:34.445263+0000 osd.6 (osd.6) 119 : cluster [DBG] 6.13 scrub starts 2024-02-10T08:28:35.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:28:34.645847+0000 mon.c (mon.2) 58 : audit [INF] from='client.? 172.21.15.18:0/2959463058' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_2", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-02-10T08:28:35.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:28:34.646249+0000 mon.a (mon.0) 1289 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_2", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-02-10T08:28:35.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:34.168960+0000 osd.0 (osd.0) 124 : cluster [DBG] 6.f deep-scrub starts 2024-02-10T08:28:35.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:34.215358+0000 osd.0 (osd.0) 125 : cluster [DBG] 6.f deep-scrub ok 2024-02-10T08:28:35.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:34.445263+0000 osd.6 (osd.6) 119 : cluster [DBG] 6.13 scrub starts 2024-02-10T08:28:35.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:28:34.645847+0000 mon.c (mon.2) 58 : audit [INF] from='client.? 172.21.15.18:0/2959463058' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_2", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-02-10T08:28:35.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:28:34.646249+0000 mon.a (mon.0) 1289 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_2", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-02-10T08:28:35.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:34.168960+0000 osd.0 (osd.0) 124 : cluster [DBG] 6.f deep-scrub starts 2024-02-10T08:28:35.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:34.215358+0000 osd.0 (osd.0) 125 : cluster [DBG] 6.f deep-scrub ok 2024-02-10T08:28:35.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:34.445263+0000 osd.6 (osd.6) 119 : cluster [DBG] 6.13 scrub starts 2024-02-10T08:28:35.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:28:34.645847+0000 mon.c (mon.2) 58 : audit [INF] from='client.? 172.21.15.18:0/2959463058' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_2", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-02-10T08:28:35.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:28:34.646249+0000 mon.a (mon.0) 1289 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_2", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-02-10T08:28:35.607 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:28:35.610 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:35.611 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:28:35.711 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:28:35.746 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:35.773 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:28:35.776 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:35.776 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:28:35.877 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:28:35.906 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:36.005 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:28:36.007 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:36.008 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:28:36.108 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:28:36.135 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:36.158 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:28:36.161 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:36.162 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:28:36.263 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:28:36.295 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:36.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:34.502778+0000 osd.6 (osd.6) 120 : cluster [DBG] 6.13 scrub ok 2024-02-10T08:28:36.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:34.815480+0000 mgr.y (mgr.14505) 446 : cluster [DBG] pgmap v536: 158 pgs: 158 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-02-10T08:28:36.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:35.174230+0000 osd.5 (osd.5) 147 : cluster [DBG] 3.2 scrub starts 2024-02-10T08:28:36.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:35.177134+0000 osd.5 (osd.5) 148 : cluster [DBG] 3.2 scrub ok 2024-02-10T08:28:36.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:28:35.211618+0000 mon.a (mon.0) 1290 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_2", "app": "rados", "yes_i_really_mean_it": true}]': finished 2024-02-10T08:28:36.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:35.211696+0000 mon.a (mon.0) 1291 : cluster [DBG] osdmap e259: 8 total, 8 up, 8 in 2024-02-10T08:28:36.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:35.242031+0000 osd.7 (osd.7) 153 : cluster [DBG] 4.0 scrub starts 2024-02-10T08:28:36.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:35.245656+0000 osd.7 (osd.7) 154 : cluster [DBG] 4.0 scrub ok 2024-02-10T08:28:36.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:34.502778+0000 osd.6 (osd.6) 120 : cluster [DBG] 6.13 scrub ok 2024-02-10T08:28:36.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:34.815480+0000 mgr.y (mgr.14505) 446 : cluster [DBG] pgmap v536: 158 pgs: 158 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-02-10T08:28:36.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:35.174230+0000 osd.5 (osd.5) 147 : cluster [DBG] 3.2 scrub starts 2024-02-10T08:28:36.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:35.177134+0000 osd.5 (osd.5) 148 : cluster [DBG] 3.2 scrub ok 2024-02-10T08:28:36.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:28:35.211618+0000 mon.a (mon.0) 1290 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_2", "app": "rados", "yes_i_really_mean_it": true}]': finished 2024-02-10T08:28:36.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:35.211696+0000 mon.a (mon.0) 1291 : cluster [DBG] osdmap e259: 8 total, 8 up, 8 in 2024-02-10T08:28:36.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:35.242031+0000 osd.7 (osd.7) 153 : cluster [DBG] 4.0 scrub starts 2024-02-10T08:28:36.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:35.245656+0000 osd.7 (osd.7) 154 : cluster [DBG] 4.0 scrub ok 2024-02-10T08:28:36.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:34.502778+0000 osd.6 (osd.6) 120 : cluster [DBG] 6.13 scrub ok 2024-02-10T08:28:36.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:34.815480+0000 mgr.y (mgr.14505) 446 : cluster [DBG] pgmap v536: 158 pgs: 158 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-02-10T08:28:36.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:35.174230+0000 osd.5 (osd.5) 147 : cluster [DBG] 3.2 scrub starts 2024-02-10T08:28:36.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:35.177134+0000 osd.5 (osd.5) 148 : cluster [DBG] 3.2 scrub ok 2024-02-10T08:28:36.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:28:35.211618+0000 mon.a (mon.0) 1290 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_2", "app": "rados", "yes_i_really_mean_it": true}]': finished 2024-02-10T08:28:36.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:35.211696+0000 mon.a (mon.0) 1291 : cluster [DBG] osdmap e259: 8 total, 8 up, 8 in 2024-02-10T08:28:36.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:35.242031+0000 osd.7 (osd.7) 153 : cluster [DBG] 4.0 scrub starts 2024-02-10T08:28:36.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:35.245656+0000 osd.7 (osd.7) 154 : cluster [DBG] 4.0 scrub ok 2024-02-10T08:28:36.690 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-02-10T08:28:36.690 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-02-10T08:28:36.690 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-02-10T08:28:36.690 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-02-10T08:28:36.789 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:28:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:28:36] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:28:37.223 INFO:teuthology.orchestra.run.smithi018.stderr:reweighted osd.4 to 0.927457 (ed6d) 2024-02-10T08:28:37.404 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:28:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:28:37] "GET /metrics HTTP/1.1" 200 176065 "" "Prometheus/2.33.4" 2024-02-10T08:28:37.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:35.475623+0000 osd.2 (osd.2) 119 : cluster [DBG] 2.1 scrub starts 2024-02-10T08:28:37.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:35.476413+0000 osd.2 (osd.2) 120 : cluster [DBG] 2.1 scrub ok 2024-02-10T08:28:37.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:35.982331+0000 osd.4 (osd.4) 62 : cluster [DBG] 4.13 scrub starts 2024-02-10T08:28:37.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:35.984178+0000 osd.4 (osd.4) 63 : cluster [DBG] 4.13 scrub ok 2024-02-10T08:28:37.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:36.136714+0000 osd.5 (osd.5) 149 : cluster [DBG] 6.d scrub starts 2024-02-10T08:28:37.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:36.163120+0000 osd.5 (osd.5) 150 : cluster [DBG] 6.d scrub ok 2024-02-10T08:28:37.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:28:36.878664+0000 mon.a (mon.0) 1292 : audit [INF] from='client.? 172.21.15.18:0/2458433049' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 4, "weight": 0.9274573833985167}]: dispatch 2024-02-10T08:28:37.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:35.475623+0000 osd.2 (osd.2) 119 : cluster [DBG] 2.1 scrub starts 2024-02-10T08:28:37.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:35.476413+0000 osd.2 (osd.2) 120 : cluster [DBG] 2.1 scrub ok 2024-02-10T08:28:37.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:35.982331+0000 osd.4 (osd.4) 62 : cluster [DBG] 4.13 scrub starts 2024-02-10T08:28:37.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:35.984178+0000 osd.4 (osd.4) 63 : cluster [DBG] 4.13 scrub ok 2024-02-10T08:28:37.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:36.136714+0000 osd.5 (osd.5) 149 : cluster [DBG] 6.d scrub starts 2024-02-10T08:28:37.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:36.163120+0000 osd.5 (osd.5) 150 : cluster [DBG] 6.d scrub ok 2024-02-10T08:28:37.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:28:36.878664+0000 mon.a (mon.0) 1292 : audit [INF] from='client.? 172.21.15.18:0/2458433049' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 4, "weight": 0.9274573833985167}]: dispatch 2024-02-10T08:28:37.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:35.475623+0000 osd.2 (osd.2) 119 : cluster [DBG] 2.1 scrub starts 2024-02-10T08:28:37.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:35.476413+0000 osd.2 (osd.2) 120 : cluster [DBG] 2.1 scrub ok 2024-02-10T08:28:37.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:35.982331+0000 osd.4 (osd.4) 62 : cluster [DBG] 4.13 scrub starts 2024-02-10T08:28:37.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:35.984178+0000 osd.4 (osd.4) 63 : cluster [DBG] 4.13 scrub ok 2024-02-10T08:28:37.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:36.136714+0000 osd.5 (osd.5) 149 : cluster [DBG] 6.d scrub starts 2024-02-10T08:28:37.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:36.163120+0000 osd.5 (osd.5) 150 : cluster [DBG] 6.d scrub ok 2024-02-10T08:28:37.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:28:36.878664+0000 mon.a (mon.0) 1292 : audit [INF] from='client.? 172.21.15.18:0/2458433049' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 4, "weight": 0.9274573833985167}]: dispatch 2024-02-10T08:28:37.547 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:28:37.549 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:37.550 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:28:37.651 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:28:37.681 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:37.880 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:28:37.882 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:37.883 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:28:37.984 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:28:38.015 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:38.030 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.7 dump_blocked_ops 2024-02-10T08:28:38.037 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:28:38.041 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:38.041 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:28:38.078 DEBUG:teuthology.orchestra.run.smithi018:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 65536 --object-size 65536 -p unique_pool_2 bench 90 write' 2024-02-10T08:28:38.081 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2024-02-10T08:28:38.081 INFO:teuthology.orchestra.run:waiting for 3000 2024-02-10T08:28:38.133 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:hints = 1 2024-02-10T08:28:38.133 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Maintaining 16 concurrent writes of 65536 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2024-02-10T08:28:38.133 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Object prefix: benchmark_data_smithi018_124176 2024-02-10T08:28:38.134 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-02-10T08:28:38.134 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 0 0 0 0 0 0 - 0 2024-02-10T08:28:38.141 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:28:38.204 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:38.260 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:28:38.267 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:38.268 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:28:38.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:36.815815+0000 mgr.y (mgr.14505) 447 : cluster [DBG] pgmap v538: 158 pgs: 158 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-10T08:28:38.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:28:37.213803+0000 mon.a (mon.0) 1293 : audit [INF] from='client.? 172.21.15.18:0/2458433049' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 4, "weight": 0.9274573833985167}]': finished 2024-02-10T08:28:38.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:37.213889+0000 mon.a (mon.0) 1294 : cluster [DBG] osdmap e260: 8 total, 8 up, 8 in 2024-02-10T08:28:38.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:37.259483+0000 osd.7 (osd.7) 155 : cluster [DBG] 6.1c scrub starts 2024-02-10T08:28:38.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:37.260941+0000 osd.7 (osd.7) 156 : cluster [DBG] 6.1c scrub ok 2024-02-10T08:28:38.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:28:37.605117+0000 mon.a (mon.0) 1295 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:28:38.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:28:38.143676+0000 mon.a (mon.0) 1296 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:28:38.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:28:38.145493+0000 mon.a (mon.0) 1297 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:28:38.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:28:38.156930+0000 mon.a (mon.0) 1298 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:28:38.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:38.217369+0000 mon.a (mon.0) 1299 : cluster [DBG] osdmap e261: 8 total, 8 up, 8 in 2024-02-10T08:28:38.270 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:28:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:28:38.368 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:28:38.420 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:38.448 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:28:38.452 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:38.452 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:28:38.455 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:28:38.553 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:28:38.600 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:38.634 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:28:38.642 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:38.643 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:28:38.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:36.815815+0000 mgr.y (mgr.14505) 447 : cluster [DBG] pgmap v538: 158 pgs: 158 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-10T08:28:38.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:28:37.213803+0000 mon.a (mon.0) 1293 : audit [INF] from='client.? 172.21.15.18:0/2458433049' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 4, "weight": 0.9274573833985167}]': finished 2024-02-10T08:28:38.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:37.213889+0000 mon.a (mon.0) 1294 : cluster [DBG] osdmap e260: 8 total, 8 up, 8 in 2024-02-10T08:28:38.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:37.259483+0000 osd.7 (osd.7) 155 : cluster [DBG] 6.1c scrub starts 2024-02-10T08:28:38.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:37.260941+0000 osd.7 (osd.7) 156 : cluster [DBG] 6.1c scrub ok 2024-02-10T08:28:38.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:28:37.605117+0000 mon.a (mon.0) 1295 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:28:38.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:28:38.143676+0000 mon.a (mon.0) 1296 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:28:38.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:28:38.145493+0000 mon.a (mon.0) 1297 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:28:38.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:28:38.156930+0000 mon.a (mon.0) 1298 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:28:38.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:38.217369+0000 mon.a (mon.0) 1299 : cluster [DBG] osdmap e261: 8 total, 8 up, 8 in 2024-02-10T08:28:38.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:36.815815+0000 mgr.y (mgr.14505) 447 : cluster [DBG] pgmap v538: 158 pgs: 158 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-10T08:28:38.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:28:37.213803+0000 mon.a (mon.0) 1293 : audit [INF] from='client.? 172.21.15.18:0/2458433049' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 4, "weight": 0.9274573833985167}]': finished 2024-02-10T08:28:38.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:37.213889+0000 mon.a (mon.0) 1294 : cluster [DBG] osdmap e260: 8 total, 8 up, 8 in 2024-02-10T08:28:38.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:37.259483+0000 osd.7 (osd.7) 155 : cluster [DBG] 6.1c scrub starts 2024-02-10T08:28:38.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:37.260941+0000 osd.7 (osd.7) 156 : cluster [DBG] 6.1c scrub ok 2024-02-10T08:28:38.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:28:37.605117+0000 mon.a (mon.0) 1295 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:28:38.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:28:38.143676+0000 mon.a (mon.0) 1296 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:28:38.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:28:38.145493+0000 mon.a (mon.0) 1297 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:28:38.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:28:38.156930+0000 mon.a (mon.0) 1298 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:28:38.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:38.217369+0000 mon.a (mon.0) 1299 : cluster [DBG] osdmap e261: 8 total, 8 up, 8 in 2024-02-10T08:28:38.743 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:28:38.786 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:39.134 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 1 16 3266 3250 203.111 203.125 0.00210643 0.00491352 2024-02-10T08:28:39.539 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:38.115234+0000 osd.0 (osd.0) 126 : cluster [DBG] 4.1e scrub starts 2024-02-10T08:28:39.539 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:38.118832+0000 osd.0 (osd.0) 127 : cluster [DBG] 4.1e scrub ok 2024-02-10T08:28:39.539 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:28:38.179787+0000 mgr.y (mgr.14505) 448 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:28:39.539 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:38.275940+0000 osd.7 (osd.7) 157 : cluster [DBG] 5.1a scrub starts 2024-02-10T08:28:39.539 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:38.278742+0000 osd.7 (osd.7) 158 : cluster [DBG] 5.1a scrub ok 2024-02-10T08:28:39.540 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:38.356417+0000 osd.6 (osd.6) 121 : cluster [DBG] 2.17 deep-scrub starts 2024-02-10T08:28:39.540 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:38.360921+0000 osd.6 (osd.6) 122 : cluster [DBG] 2.17 deep-scrub ok 2024-02-10T08:28:39.540 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:38.614109+0000 osd.1 (osd.1) 139 : cluster [DBG] 4.7 scrub starts 2024-02-10T08:28:39.540 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:38.619513+0000 osd.1 (osd.1) 140 : cluster [DBG] 4.7 scrub ok 2024-02-10T08:28:39.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:38.115234+0000 osd.0 (osd.0) 126 : cluster [DBG] 4.1e scrub starts 2024-02-10T08:28:39.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:38.118832+0000 osd.0 (osd.0) 127 : cluster [DBG] 4.1e scrub ok 2024-02-10T08:28:39.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:28:38.179787+0000 mgr.y (mgr.14505) 448 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:28:39.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:38.275940+0000 osd.7 (osd.7) 157 : cluster [DBG] 5.1a scrub starts 2024-02-10T08:28:39.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:38.278742+0000 osd.7 (osd.7) 158 : cluster [DBG] 5.1a scrub ok 2024-02-10T08:28:39.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:38.356417+0000 osd.6 (osd.6) 121 : cluster [DBG] 2.17 deep-scrub starts 2024-02-10T08:28:39.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:38.360921+0000 osd.6 (osd.6) 122 : cluster [DBG] 2.17 deep-scrub ok 2024-02-10T08:28:39.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:38.614109+0000 osd.1 (osd.1) 139 : cluster [DBG] 4.7 scrub starts 2024-02-10T08:28:39.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:38.619513+0000 osd.1 (osd.1) 140 : cluster [DBG] 4.7 scrub ok 2024-02-10T08:28:39.541 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:38.115234+0000 osd.0 (osd.0) 126 : cluster [DBG] 4.1e scrub starts 2024-02-10T08:28:39.541 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:38.118832+0000 osd.0 (osd.0) 127 : cluster [DBG] 4.1e scrub ok 2024-02-10T08:28:39.541 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:28:38.179787+0000 mgr.y (mgr.14505) 448 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:28:39.541 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:38.275940+0000 osd.7 (osd.7) 157 : cluster [DBG] 5.1a scrub starts 2024-02-10T08:28:39.541 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:38.278742+0000 osd.7 (osd.7) 158 : cluster [DBG] 5.1a scrub ok 2024-02-10T08:28:39.541 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:38.356417+0000 osd.6 (osd.6) 121 : cluster [DBG] 2.17 deep-scrub starts 2024-02-10T08:28:39.541 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:38.360921+0000 osd.6 (osd.6) 122 : cluster [DBG] 2.17 deep-scrub ok 2024-02-10T08:28:39.541 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:38.614109+0000 osd.1 (osd.1) 139 : cluster [DBG] 4.7 scrub starts 2024-02-10T08:28:39.542 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:38.619513+0000 osd.1 (osd.1) 140 : cluster [DBG] 4.7 scrub ok 2024-02-10T08:28:39.544 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:28:39.553 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:39.554 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:28:39.655 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:28:39.701 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:39.910 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:28:39.914 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:39.915 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:28:40.015 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:28:40.063 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:40.134 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 2 16 6604 6588 205.859 208.625 0.00334188 0.00484651 2024-02-10T08:28:40.228 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:28:40.233 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:40.234 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:28:40.335 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:28:40.380 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:40.426 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:28:40.434 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:40.434 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:28:40.535 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:28:40.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:38.816266+0000 mgr.y (mgr.14505) 449 : cluster [DBG] pgmap v541: 158 pgs: 8 peering, 150 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 682 B/s rd, 0 op/s 2024-02-10T08:28:40.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:39.224735+0000 mon.a (mon.0) 1300 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 3 pgs peering (PG_AVAILABILITY) 2024-02-10T08:28:40.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:39.629596+0000 osd.1 (osd.1) 141 : cluster [DBG] 6.1 deep-scrub starts 2024-02-10T08:28:40.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:39.633623+0000 osd.1 (osd.1) 142 : cluster [DBG] 6.1 deep-scrub ok 2024-02-10T08:28:40.599 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:38.816266+0000 mgr.y (mgr.14505) 449 : cluster [DBG] pgmap v541: 158 pgs: 8 peering, 150 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 682 B/s rd, 0 op/s 2024-02-10T08:28:40.599 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:39.224735+0000 mon.a (mon.0) 1300 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 3 pgs peering (PG_AVAILABILITY) 2024-02-10T08:28:40.599 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:39.629596+0000 osd.1 (osd.1) 141 : cluster [DBG] 6.1 deep-scrub starts 2024-02-10T08:28:40.599 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:39.633623+0000 osd.1 (osd.1) 142 : cluster [DBG] 6.1 deep-scrub ok 2024-02-10T08:28:40.599 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:38.816266+0000 mgr.y (mgr.14505) 449 : cluster [DBG] pgmap v541: 158 pgs: 8 peering, 150 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 682 B/s rd, 0 op/s 2024-02-10T08:28:40.599 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:39.224735+0000 mon.a (mon.0) 1300 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 3 pgs peering (PG_AVAILABILITY) 2024-02-10T08:28:40.599 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:39.629596+0000 osd.1 (osd.1) 141 : cluster [DBG] 6.1 deep-scrub starts 2024-02-10T08:28:40.599 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:39.633623+0000 osd.1 (osd.1) 142 : cluster [DBG] 6.1 deep-scrub ok 2024-02-10T08:28:40.601 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:40.664 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:28:40.669 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:40.670 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:28:40.770 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:28:40.771 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-02-10T08:28:40.771 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-02-10T08:28:40.771 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-02-10T08:28:40.771 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-02-10T08:28:40.771 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-02-10T08:28:40.805 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:28:40.807 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:28:40.810 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:40.844 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:28:40.848 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:40.849 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:28:40.849 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:28:40.891 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:28:40.931 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:28:40.949 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:28:40.969 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:28:40.995 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:28:40.995 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:41.030 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:28:41.031 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-10T08:28:41.032 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-10T08:28:41.032 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-10T08:28:41.032 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-10T08:28:41.032 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-10T08:28:41.032 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-10T08:28:41.032 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-10T08:28:41.032 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-10T08:28:41.134 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 3 16 9159 9143 190.447 159.688 0.0127243 0.00524261 2024-02-10T08:28:41.244 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:41 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:40.337151+0000 osd.6 (osd.6) 123 : cluster [DBG] 4.1f scrub starts 2024-02-10T08:28:41.244 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:41 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:40.341636+0000 osd.6 (osd.6) 124 : cluster [DBG] 4.1f scrub ok 2024-02-10T08:28:41.244 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:41 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:28:40.717870+0000 mon.c (mon.2) 59 : audit [DBG] from='client.? 172.21.15.18:0/204066008' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:28:41.244 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:41 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:28:40.968629+0000 mon.a (mon.0) 1301 : audit [INF] from='client.? 172.21.15.18:0/847717999' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:28:41.266 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is set 2024-02-10T08:28:41.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:40.337151+0000 osd.6 (osd.6) 123 : cluster [DBG] 4.1f scrub starts 2024-02-10T08:28:41.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:40.341636+0000 osd.6 (osd.6) 124 : cluster [DBG] 4.1f scrub ok 2024-02-10T08:28:41.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:28:40.717870+0000 mon.c (mon.2) 59 : audit [DBG] from='client.? 172.21.15.18:0/204066008' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:28:41.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:28:40.968629+0000 mon.a (mon.0) 1301 : audit [INF] from='client.? 172.21.15.18:0/847717999' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:28:41.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:40.337151+0000 osd.6 (osd.6) 123 : cluster [DBG] 4.1f scrub starts 2024-02-10T08:28:41.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:40.341636+0000 osd.6 (osd.6) 124 : cluster [DBG] 4.1f scrub ok 2024-02-10T08:28:41.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:28:40.717870+0000 mon.c (mon.2) 59 : audit [DBG] from='client.? 172.21.15.18:0/204066008' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:28:41.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:28:40.968629+0000 mon.a (mon.0) 1301 : audit [INF] from='client.? 172.21.15.18:0/847717999' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:28:42.134 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 4 16 11826 11810 184.504 166.688 0.0032959 0.00540863 2024-02-10T08:28:42.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:40.683097+0000 osd.2 (osd.2) 121 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:28:42.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:40.683151+0000 osd.2 (osd.2) 122 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:28:42.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:40.816781+0000 mgr.y (mgr.14505) 450 : cluster [DBG] pgmap v542: 158 pgs: 8 peering, 150 active+clean; 22 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 682 B/s rd, 3.7 MiB/s wr, 60 op/s 2024-02-10T08:28:42.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:41.239884+0000 mon.a (mon.0) 1302 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:28:42.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:28:41.250636+0000 mon.a (mon.0) 1303 : audit [INF] from='client.? 172.21.15.18:0/847717999' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-10T08:28:42.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:41.250691+0000 mon.a (mon.0) 1304 : cluster [DBG] osdmap e262: 8 total, 8 up, 8 in 2024-02-10T08:28:42.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:40.683097+0000 osd.2 (osd.2) 121 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:28:42.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:40.683151+0000 osd.2 (osd.2) 122 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:28:42.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:40.816781+0000 mgr.y (mgr.14505) 450 : cluster [DBG] pgmap v542: 158 pgs: 8 peering, 150 active+clean; 22 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 682 B/s rd, 3.7 MiB/s wr, 60 op/s 2024-02-10T08:28:42.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:41.239884+0000 mon.a (mon.0) 1302 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:28:42.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:28:41.250636+0000 mon.a (mon.0) 1303 : audit [INF] from='client.? 172.21.15.18:0/847717999' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-10T08:28:42.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:41.250691+0000 mon.a (mon.0) 1304 : cluster [DBG] osdmap e262: 8 total, 8 up, 8 in 2024-02-10T08:28:42.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:40.683097+0000 osd.2 (osd.2) 121 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:28:42.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:40.683151+0000 osd.2 (osd.2) 122 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:28:42.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:40.816781+0000 mgr.y (mgr.14505) 450 : cluster [DBG] pgmap v542: 158 pgs: 8 peering, 150 active+clean; 22 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 682 B/s rd, 3.7 MiB/s wr, 60 op/s 2024-02-10T08:28:42.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:41.239884+0000 mon.a (mon.0) 1302 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:28:42.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:28:41.250636+0000 mon.a (mon.0) 1303 : audit [INF] from='client.? 172.21.15.18:0/847717999' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-10T08:28:42.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:41.250691+0000 mon.a (mon.0) 1304 : cluster [DBG] osdmap e262: 8 total, 8 up, 8 in 2024-02-10T08:28:43.135 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 5 15 14536 14521 181.487 169.438 0.00349553 0.00550348 2024-02-10T08:28:44.135 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 6 16 17112 17096 178.059 160.938 0.0040273 0.00560903 2024-02-10T08:28:44.152 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd set nodeep-scrub 2024-02-10T08:28:44.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:44 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:42.817567+0000 mgr.y (mgr.14505) 451 : cluster [DBG] pgmap v544: 158 pgs: 3 peering, 155 active+clean; 636 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 1.5 KiB/s rd, 106 MiB/s wr, 1.70k op/s 2024-02-10T08:28:44.370 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:28:44.375 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:44.376 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:28:44.388 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.7 dump_historic_ops 2024-02-10T08:28:44.447 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 3, 4, 5, 6, 7, 0] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 5, 6, 7, 4] 2024-02-10T08:28:44.447 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-10T08:28:44.447 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-02-10T08:28:44.447 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd dump -f json-pretty 2024-02-10T08:28:44.476 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:28:44.487 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:42.817567+0000 mgr.y (mgr.14505) 451 : cluster [DBG] pgmap v544: 158 pgs: 3 peering, 155 active+clean; 636 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 1.5 KiB/s rd, 106 MiB/s wr, 1.70k op/s 2024-02-10T08:28:44.488 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:42.817567+0000 mgr.y (mgr.14505) 451 : cluster [DBG] pgmap v544: 158 pgs: 3 peering, 155 active+clean; 636 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 1.5 KiB/s rd, 106 MiB/s wr, 1.70k op/s 2024-02-10T08:28:44.521 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:44.568 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:28:44.571 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:44.571 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:28:44.602 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:28:44.672 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:28:44.723 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:44.751 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-10T08:28:44.851 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:28:44.914 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:28:44.922 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:44.923 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:28:45.023 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:28:45.073 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:45.117 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:28:45.123 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:45.124 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:28:45.135 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 7 16 19216 19200 171.39 131.5 0.00568332 0.00582862 2024-02-10T08:28:45.225 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:28:45.264 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:45.389 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:45.256001+0000 mon.a (mon.0) 1305 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-02-10T08:28:45.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:45.256001+0000 mon.a (mon.0) 1305 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-02-10T08:28:45.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:45.256001+0000 mon.a (mon.0) 1305 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-02-10T08:28:46.136 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 8 16 21559 21543 168.27 146.438 0.00620699 0.00593701 2024-02-10T08:28:46.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:44.818221+0000 mgr.y (mgr.14505) 452 : cluster [DBG] pgmap v545: 158 pgs: 158 active+clean; 806 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 1.2 KiB/s rd, 106 MiB/s wr, 1.70k op/s; 14 B/s, 0 objects/s recovering 2024-02-10T08:28:46.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:45.734416+0000 mon.a (mon.0) 1306 : cluster [DBG] osdmap e263: 8 total, 8 up, 8 in 2024-02-10T08:28:46.540 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:28:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:28:46] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:28:46.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:44.818221+0000 mgr.y (mgr.14505) 452 : cluster [DBG] pgmap v545: 158 pgs: 158 active+clean; 806 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 1.2 KiB/s rd, 106 MiB/s wr, 1.70k op/s; 14 B/s, 0 objects/s recovering 2024-02-10T08:28:46.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:45.734416+0000 mon.a (mon.0) 1306 : cluster [DBG] osdmap e263: 8 total, 8 up, 8 in 2024-02-10T08:28:46.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:44.818221+0000 mgr.y (mgr.14505) 452 : cluster [DBG] pgmap v545: 158 pgs: 158 active+clean; 806 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 1.2 KiB/s rd, 106 MiB/s wr, 1.70k op/s; 14 B/s, 0 objects/s recovering 2024-02-10T08:28:46.657 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:45.734416+0000 mon.a (mon.0) 1306 : cluster [DBG] osdmap e263: 8 total, 8 up, 8 in 2024-02-10T08:28:46.930 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-02-10T08:28:46.930 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:28:47.132 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:28:47.137 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:47.138 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:28:47.138 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 9 16 23608 23592 163.772 128.062 0.0076629 0.00609944 2024-02-10T08:28:47.239 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:28:47.295 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:47.403 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:28:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:28:47] "GET /metrics HTTP/1.1" 200 176167 "" "Prometheus/2.33.4" 2024-02-10T08:28:47.640 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.4 dump_ops_in_flight 2024-02-10T08:28:47.656 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:28:47.660 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:47.661 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:28:47.761 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:28:47.802 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:47.846 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:28:47.849 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:47.850 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:28:47.940 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:28:46.661219+0000 mon.a (mon.0) 1307 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:28:47.941 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:46.818604+0000 mgr.y (mgr.14505) 453 : cluster [DBG] pgmap v547: 158 pgs: 158 active+clean; 855 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 639 B/s rd, 107 MiB/s wr, 1.71k op/s; 27 B/s, 1 objects/s recovering 2024-02-10T08:28:47.941 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:28:46.661219+0000 mon.a (mon.0) 1307 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:28:47.941 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:46.818604+0000 mgr.y (mgr.14505) 453 : cluster [DBG] pgmap v547: 158 pgs: 158 active+clean; 855 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 639 B/s rd, 107 MiB/s wr, 1.71k op/s; 27 B/s, 1 objects/s recovering 2024-02-10T08:28:47.950 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:28:47.997 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:48.042 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:28:46.661219+0000 mon.a (mon.0) 1307 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:28:48.042 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:46.818604+0000 mgr.y (mgr.14505) 453 : cluster [DBG] pgmap v547: 158 pgs: 158 active+clean; 855 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 639 B/s rd, 107 MiB/s wr, 1.71k op/s; 27 B/s, 1 objects/s recovering 2024-02-10T08:28:48.096 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:28:48.137 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 10 16 25619 25603 159.963 125.688 0.00742382 0.00624504 2024-02-10T08:28:48.372 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:28:48.372 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:28:48.540 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:28:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:28:48.853 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:28:48.858 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:48.859 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:28:48.960 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:28:49.007 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:47.640735+0000 osd.4 (osd.4) 64 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:28:49.007 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:47.640797+0000 osd.4 (osd.4) 65 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:28:49.007 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:47.672346+0000 mon.a (mon.0) 1308 : cluster [DBG] osdmap e264: 8 total, 8 up, 8 in 2024-02-10T08:28:49.007 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:28:48.191210+0000 mgr.y (mgr.14505) 454 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:28:49.007 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:47.640735+0000 osd.4 (osd.4) 64 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:28:49.007 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:47.640797+0000 osd.4 (osd.4) 65 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:28:49.007 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:47.672346+0000 mon.a (mon.0) 1308 : cluster [DBG] osdmap e264: 8 total, 8 up, 8 in 2024-02-10T08:28:49.007 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:28:48.191210+0000 mgr.y (mgr.14505) 454 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:28:49.010 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:49.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:47.640735+0000 osd.4 (osd.4) 64 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:28:49.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:47.640797+0000 osd.4 (osd.4) 65 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:28:49.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:47.672346+0000 mon.a (mon.0) 1308 : cluster [DBG] osdmap e264: 8 total, 8 up, 8 in 2024-02-10T08:28:49.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:28:48.191210+0000 mgr.y (mgr.14505) 454 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:28:49.140 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 11 16 27674 27658 157.061 128.438 0.00955415 0.00636055 2024-02-10T08:28:49.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:49 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:48.819247+0000 mgr.y (mgr.14505) 455 : cluster [DBG] pgmap v549: 158 pgs: 158 active+clean; 1.5 GiB data, 6.7 GiB used, 709 GiB / 715 GiB avail; 1.3 KiB/s rd, 199 MiB/s wr, 3.19k op/s; 29 B/s, 1 objects/s recovering 2024-02-10T08:28:49.877 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:28:49.881 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:49.881 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:28:49.948 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:48.819247+0000 mgr.y (mgr.14505) 455 : cluster [DBG] pgmap v549: 158 pgs: 158 active+clean; 1.5 GiB data, 6.7 GiB used, 709 GiB / 715 GiB avail; 1.3 KiB/s rd, 199 MiB/s wr, 3.19k op/s; 29 B/s, 1 objects/s recovering 2024-02-10T08:28:49.949 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:48.819247+0000 mgr.y (mgr.14505) 455 : cluster [DBG] pgmap v549: 158 pgs: 158 active+clean; 1.5 GiB data, 6.7 GiB used, 709 GiB / 715 GiB avail; 1.3 KiB/s rd, 199 MiB/s wr, 3.19k op/s; 29 B/s, 1 objects/s recovering 2024-02-10T08:28:49.982 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:28:50.028 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:50.140 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 12 16 29676 29660 154.4 125.125 0.00387123 0.00647042 2024-02-10T08:28:50.171 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-02-10T08:28:50.171 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:28:50.692 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:28:50.718 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:50.719 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:28:50.819 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:28:50.878 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:50.978 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.4 dump_blocked_ops 2024-02-10T08:28:51.085 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:28:51.091 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:51.091 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:28:51.140 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 13 16 31516 31500 151.37 115 0.00735932 0.00660119 2024-02-10T08:28:51.192 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:28:51.256 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:51.298 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:28:51.309 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:51.309 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:28:51.400 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:28:51.410 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:28:51.460 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:51.785 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is set 2024-02-10T08:28:52.001 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:51 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:50.739856+0000 mon.a (mon.0) 1309 : cluster [DBG] osdmap e265: 8 total, 8 up, 8 in 2024-02-10T08:28:52.001 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:51 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:50.819678+0000 mgr.y (mgr.14505) 456 : cluster [DBG] pgmap v551: 158 pgs: 158 active+clean; 1.5 GiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 853 B/s rd, 127 MiB/s wr, 2.04k op/s 2024-02-10T08:28:52.001 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:51 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:28:50.899831+0000 mon.c (mon.2) 60 : audit [INF] from='client.? 172.21.15.18:0/3016572527' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:28:52.001 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:51 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:28:50.900266+0000 mon.a (mon.0) 1310 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:28:52.021 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:28:52.024 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:52.025 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:28:52.025 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:50.739856+0000 mon.a (mon.0) 1309 : cluster [DBG] osdmap e265: 8 total, 8 up, 8 in 2024-02-10T08:28:52.026 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:50.819678+0000 mgr.y (mgr.14505) 456 : cluster [DBG] pgmap v551: 158 pgs: 158 active+clean; 1.5 GiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 853 B/s rd, 127 MiB/s wr, 2.04k op/s 2024-02-10T08:28:52.026 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:28:50.899831+0000 mon.c (mon.2) 60 : audit [INF] from='client.? 172.21.15.18:0/3016572527' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:28:52.026 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:28:50.900266+0000 mon.a (mon.0) 1310 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:28:52.026 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:50.739856+0000 mon.a (mon.0) 1309 : cluster [DBG] osdmap e265: 8 total, 8 up, 8 in 2024-02-10T08:28:52.026 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:50.819678+0000 mgr.y (mgr.14505) 456 : cluster [DBG] pgmap v551: 158 pgs: 158 active+clean; 1.5 GiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 853 B/s rd, 127 MiB/s wr, 2.04k op/s 2024-02-10T08:28:52.026 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:28:50.899831+0000 mon.c (mon.2) 60 : audit [INF] from='client.? 172.21.15.18:0/3016572527' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:28:52.026 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:28:50.900266+0000 mon.a (mon.0) 1310 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:28:52.126 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:28:52.140 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 14 16 33303 33287 148.536 111.688 0.0128717 0.00672651 2024-02-10T08:28:52.172 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:52.312 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:28:52.320 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:52.321 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:28:52.421 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:28:52.477 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:52.735 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:28:52.741 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:52.741 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:28:52.842 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:28:52.901 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:53.043 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:52 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:51.748623+0000 mon.a (mon.0) 1311 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:28:53.043 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:52 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:28:51.765416+0000 mon.a (mon.0) 1312 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-10T08:28:53.043 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:52 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:51.765462+0000 mon.a (mon.0) 1313 : cluster [DBG] osdmap e266: 8 total, 8 up, 8 in 2024-02-10T08:28:53.114 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:28:53.127 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:53.128 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:28:53.140 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 15 16 35132 35116 146.254 114.312 0.00590321 0.00683122 2024-02-10T08:28:53.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:51.748623+0000 mon.a (mon.0) 1311 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:28:53.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:28:51.765416+0000 mon.a (mon.0) 1312 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-10T08:28:53.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:51.765462+0000 mon.a (mon.0) 1313 : cluster [DBG] osdmap e266: 8 total, 8 up, 8 in 2024-02-10T08:28:53.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:51.748623+0000 mon.a (mon.0) 1311 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:28:53.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:28:51.765416+0000 mon.a (mon.0) 1312 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-10T08:28:53.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:51.765462+0000 mon.a (mon.0) 1313 : cluster [DBG] osdmap e266: 8 total, 8 up, 8 in 2024-02-10T08:28:53.212 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:28:53.228 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:28:53.242 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:28:53.270 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:28:53.291 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:53.300 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:28:53.334 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:28:53.363 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:28:53.375 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:28:53.380 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:53.381 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:28:53.402 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:28:53.433 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:28:53.439 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-10T08:28:53.439 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-10T08:28:53.439 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-10T08:28:53.439 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-10T08:28:53.439 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-10T08:28:53.439 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-10T08:28:53.439 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-10T08:28:53.439 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-10T08:28:53.440 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-02-10T08:28:53.441 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-02-10T08:28:53.441 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-02-10T08:28:53.441 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-02-10T08:28:53.441 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-02-10T08:28:53.481 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:28:53.522 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:53.691 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:28:53.695 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:53.695 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:28:53.796 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:28:53.847 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:53.963 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:28:53.963 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-02-10T08:28:53.963 INFO:teuthology.orchestra.run.smithi018.stdout: "epoch": 266, 2024-02-10T08:28:53.964 INFO:teuthology.orchestra.run.smithi018.stdout: "fsid": "d46257c8-c7eb-11ee-95b8-87774f69a715", 2024-02-10T08:28:53.964 INFO:teuthology.orchestra.run.smithi018.stdout: "created": "2024-02-10T08:10:57.425061+0000", 2024-02-10T08:28:53.964 INFO:teuthology.orchestra.run.smithi018.stdout: "modified": "2024-02-10T08:28:51.748376+0000", 2024-02-10T08:28:53.964 INFO:teuthology.orchestra.run.smithi018.stdout: "last_up_change": "2024-02-10T08:20:45.372678+0000", 2024-02-10T08:28:53.964 INFO:teuthology.orchestra.run.smithi018.stdout: "last_in_change": "2024-02-10T08:28:01.734588+0000", 2024-02-10T08:28:53.964 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-02-10T08:28:53.964 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_num": 5806080, 2024-02-10T08:28:53.964 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_set": [ 2024-02-10T08:28:53.964 INFO:teuthology.orchestra.run.smithi018.stdout: "nodeep-scrub", 2024-02-10T08:28:53.964 INFO:teuthology.orchestra.run.smithi018.stdout: "noscrub", 2024-02-10T08:28:53.964 INFO:teuthology.orchestra.run.smithi018.stdout: "pglog_hardlimit", 2024-02-10T08:28:53.964 INFO:teuthology.orchestra.run.smithi018.stdout: "purged_snapdirs", 2024-02-10T08:28:53.964 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_deletes", 2024-02-10T08:28:53.965 INFO:teuthology.orchestra.run.smithi018.stdout: "sortbitwise" 2024-02-10T08:28:53.965 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-02-10T08:28:53.965 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_version": 19, 2024-02-10T08:28:53.965 INFO:teuthology.orchestra.run.smithi018.stdout: "full_ratio": 0.94999998807907104, 2024-02-10T08:28:53.965 INFO:teuthology.orchestra.run.smithi018.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-02-10T08:28:53.965 INFO:teuthology.orchestra.run.smithi018.stdout: "nearfull_ratio": 0.85000002384185791, 2024-02-10T08:28:53.965 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_snapshot": "", 2024-02-10T08:28:53.965 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_max": 9, 2024-02-10T08:28:53.965 INFO:teuthology.orchestra.run.smithi018.stdout: "max_osd": 8, 2024-02-10T08:28:53.965 INFO:teuthology.orchestra.run.smithi018.stdout: "require_min_compat_client": "luminous", 2024-02-10T08:28:53.965 INFO:teuthology.orchestra.run.smithi018.stdout: "min_compat_client": "luminous", 2024-02-10T08:28:53.965 INFO:teuthology.orchestra.run.smithi018.stdout: "require_osd_release": "pacific", 2024-02-10T08:28:53.965 INFO:teuthology.orchestra.run.smithi018.stdout: "pools": [ 2024-02-10T08:28:53.965 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:53.965 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 1, 2024-02-10T08:28:53.965 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "device_health_metrics", 2024-02-10T08:28:53.965 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-02-10T08:14:44.034966+0000", 2024-02-10T08:28:53.966 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-02-10T08:28:53.966 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-02-10T08:28:53.966 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-02-10T08:28:53.966 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 3, 2024-02-10T08:28:53.966 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 2, 2024-02-10T08:28:53.966 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-02-10T08:28:53.966 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-02-10T08:28:53.966 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-02-10T08:28:53.966 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-02-10T08:28:53.966 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-10T08:28:53.966 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-02-10T08:28:53.966 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-02-10T08:28:53.966 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 1, 2024-02-10T08:28:53.966 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 1, 2024-02-10T08:28:53.966 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 1, 2024-02-10T08:28:53.966 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 1, 2024-02-10T08:28:53.967 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 1, 2024-02-10T08:28:53.967 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-02-10T08:28:53.967 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-02-10T08:28:53.967 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-02-10T08:28:53.967 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-02-10T08:28:53.967 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-02-10T08:28:53.967 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-02-10T08:28:53.967 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-02-10T08:28:53.967 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:53.967 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "66", 2024-02-10T08:28:53.967 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-02-10T08:28:53.967 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-10T08:28:53.967 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-02-10T08:28:53.967 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-02-10T08:28:53.967 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-02-10T08:28:53.967 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-02-10T08:28:53.968 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-02-10T08:28:53.968 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-02-10T08:28:53.968 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-02-10T08:28:53.968 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-02-10T08:28:53.968 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-02-10T08:28:53.968 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-02-10T08:28:53.968 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-02-10T08:28:53.968 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-02-10T08:28:53.968 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-02-10T08:28:53.968 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-02-10T08:28:53.968 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-02-10T08:28:53.968 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-02-10T08:28:53.968 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-10T08:28:53.969 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-10T08:28:53.969 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-10T08:28:53.969 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-02-10T08:28:53.969 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-02-10T08:28:53.969 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-02-10T08:28:53.969 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-02-10T08:28:53.969 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-02-10T08:28:53.969 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:53.969 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-02-10T08:28:53.969 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-02-10T08:28:53.969 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-02-10T08:28:53.969 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-02-10T08:28:53.970 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-02-10T08:28:53.970 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-02-10T08:28:53.970 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-02-10T08:28:53.970 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-02-10T08:28:53.970 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-02-10T08:28:53.970 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-02-10T08:28:53.970 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-02-10T08:28:53.970 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-02-10T08:28:53.970 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_max": 32, 2024-02-10T08:28:53.970 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 1 2024-02-10T08:28:53.970 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:53.970 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-02-10T08:28:53.970 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_devicehealth": {} 2024-02-10T08:28:53.970 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:53.970 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:53.971 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:53.971 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 2, 2024-02-10T08:28:53.971 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": ".rgw.root", 2024-02-10T08:28:53.971 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-02-10T08:16:51.334631+0000", 2024-02-10T08:28:53.971 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-02-10T08:28:53.971 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-02-10T08:28:53.971 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-02-10T08:28:53.971 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 3, 2024-02-10T08:28:53.971 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 2, 2024-02-10T08:28:53.971 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-02-10T08:28:53.971 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-02-10T08:28:53.971 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-02-10T08:28:53.971 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-02-10T08:28:53.971 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-10T08:28:53.971 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-02-10T08:28:53.971 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-02-10T08:28:53.972 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 32, 2024-02-10T08:28:53.972 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 32, 2024-02-10T08:28:53.972 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 32, 2024-02-10T08:28:53.972 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 32, 2024-02-10T08:28:53.972 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 32, 2024-02-10T08:28:53.972 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-02-10T08:28:53.972 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-02-10T08:28:53.972 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-02-10T08:28:53.972 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-02-10T08:28:53.972 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-02-10T08:28:53.972 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-02-10T08:28:53.972 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-02-10T08:28:53.972 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:53.972 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "56", 2024-02-10T08:28:53.972 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-02-10T08:28:53.973 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-10T08:28:53.973 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-02-10T08:28:53.973 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-02-10T08:28:53.973 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-02-10T08:28:53.973 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-02-10T08:28:53.973 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-02-10T08:28:53.973 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-02-10T08:28:53.973 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-02-10T08:28:53.973 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-02-10T08:28:53.973 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-02-10T08:28:53.973 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-02-10T08:28:53.973 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-02-10T08:28:53.973 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-02-10T08:28:53.973 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-02-10T08:28:53.973 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-02-10T08:28:53.973 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-02-10T08:28:53.973 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-02-10T08:28:53.974 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-10T08:28:53.974 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-10T08:28:53.974 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-10T08:28:53.974 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-02-10T08:28:53.974 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-02-10T08:28:53.974 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-02-10T08:28:53.974 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-02-10T08:28:53.974 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-02-10T08:28:53.974 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:53.974 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-02-10T08:28:53.974 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-02-10T08:28:53.974 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-02-10T08:28:53.974 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-02-10T08:28:53.974 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-02-10T08:28:53.974 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-02-10T08:28:53.974 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-02-10T08:28:53.974 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-02-10T08:28:53.975 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-02-10T08:28:53.975 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-02-10T08:28:53.975 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-02-10T08:28:53.975 INFO:teuthology.orchestra.run.smithi018.stdout: "options": {}, 2024-02-10T08:28:53.975 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-02-10T08:28:53.975 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw": {} 2024-02-10T08:28:53.975 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:53.975 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:53.975 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:53.975 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 3, 2024-02-10T08:28:53.975 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "iscsi", 2024-02-10T08:28:53.975 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-02-10T08:16:51.762963+0000", 2024-02-10T08:28:53.975 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-02-10T08:28:53.975 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-02-10T08:28:53.975 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-02-10T08:28:53.975 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 3, 2024-02-10T08:28:53.976 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 2, 2024-02-10T08:28:53.976 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-02-10T08:28:53.976 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-02-10T08:28:53.976 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-02-10T08:28:53.976 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-02-10T08:28:53.976 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-10T08:28:53.976 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-02-10T08:28:53.976 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-02-10T08:28:53.976 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 3, 2024-02-10T08:28:53.976 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 3, 2024-02-10T08:28:53.976 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 3, 2024-02-10T08:28:53.977 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 3, 2024-02-10T08:28:53.977 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 3, 2024-02-10T08:28:53.977 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-02-10T08:28:53.977 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-02-10T08:28:53.977 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-02-10T08:28:53.977 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-02-10T08:28:53.977 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-02-10T08:28:53.977 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-02-10T08:28:53.977 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-02-10T08:28:53.977 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:53.977 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "57", 2024-02-10T08:28:53.977 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-02-10T08:28:53.977 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-10T08:28:53.977 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-02-10T08:28:53.977 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-02-10T08:28:53.978 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-02-10T08:28:53.978 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-02-10T08:28:53.978 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-02-10T08:28:53.978 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-02-10T08:28:53.978 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-02-10T08:28:53.978 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-02-10T08:28:53.978 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-02-10T08:28:53.978 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-02-10T08:28:53.978 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-02-10T08:28:53.978 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-02-10T08:28:53.978 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-02-10T08:28:53.978 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-02-10T08:28:53.978 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-02-10T08:28:53.978 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-02-10T08:28:53.978 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-10T08:28:53.979 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-10T08:28:53.979 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-10T08:28:53.979 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-02-10T08:28:53.979 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-02-10T08:28:53.979 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-02-10T08:28:53.979 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-02-10T08:28:53.979 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-02-10T08:28:53.979 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:53.979 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-02-10T08:28:53.979 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-02-10T08:28:53.979 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-02-10T08:28:53.979 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-02-10T08:28:53.979 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-02-10T08:28:53.980 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-02-10T08:28:53.980 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-02-10T08:28:53.980 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-02-10T08:28:53.980 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-02-10T08:28:53.980 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-02-10T08:28:53.980 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-02-10T08:28:53.980 INFO:teuthology.orchestra.run.smithi018.stdout: "options": {}, 2024-02-10T08:28:53.980 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-02-10T08:28:53.980 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd": {} 2024-02-10T08:28:53.980 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:53.980 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:53.980 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:53.981 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 4, 2024-02-10T08:28:53.981 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "default.rgw.log", 2024-02-10T08:28:53.981 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-02-10T08:16:53.258098+0000", 2024-02-10T08:28:53.981 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-02-10T08:28:53.981 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-02-10T08:28:53.981 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-02-10T08:28:53.981 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 3, 2024-02-10T08:28:53.981 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 2, 2024-02-10T08:28:53.981 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-02-10T08:28:53.981 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-02-10T08:28:53.981 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-02-10T08:28:53.981 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-02-10T08:28:53.981 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-10T08:28:53.981 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-02-10T08:28:53.981 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-02-10T08:28:53.982 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 32, 2024-02-10T08:28:53.982 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 32, 2024-02-10T08:28:53.982 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 32, 2024-02-10T08:28:53.982 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 32, 2024-02-10T08:28:53.982 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 32, 2024-02-10T08:28:53.982 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-02-10T08:28:53.982 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-02-10T08:28:53.982 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-02-10T08:28:53.982 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-02-10T08:28:53.982 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-02-10T08:28:53.982 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-02-10T08:28:53.982 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-02-10T08:28:53.982 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:53.982 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "205", 2024-02-10T08:28:53.982 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-02-10T08:28:53.982 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-10T08:28:53.983 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-02-10T08:28:53.983 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-02-10T08:28:53.983 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-02-10T08:28:53.983 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-02-10T08:28:53.983 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-02-10T08:28:53.983 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-02-10T08:28:53.983 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-02-10T08:28:53.983 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-02-10T08:28:53.983 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-02-10T08:28:53.983 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-02-10T08:28:53.983 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-02-10T08:28:53.983 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-02-10T08:28:53.983 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-02-10T08:28:53.983 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-02-10T08:28:53.983 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-02-10T08:28:53.983 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-02-10T08:28:53.983 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-10T08:28:53.984 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-10T08:28:53.984 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-10T08:28:53.984 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-02-10T08:28:53.984 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-02-10T08:28:53.984 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-02-10T08:28:53.984 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-02-10T08:28:53.984 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-02-10T08:28:53.984 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:53.984 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-02-10T08:28:53.984 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-02-10T08:28:53.984 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-02-10T08:28:53.984 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-02-10T08:28:53.984 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-02-10T08:28:53.984 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-02-10T08:28:53.984 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-02-10T08:28:53.985 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-02-10T08:28:53.985 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-02-10T08:28:53.985 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-02-10T08:28:53.985 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-02-10T08:28:53.985 INFO:teuthology.orchestra.run.smithi018.stdout: "options": {}, 2024-02-10T08:28:53.985 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-02-10T08:28:53.985 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw": {} 2024-02-10T08:28:53.985 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:53.985 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:53.985 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:53.985 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 5, 2024-02-10T08:28:53.985 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "default.rgw.control", 2024-02-10T08:28:53.985 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-02-10T08:16:55.289300+0000", 2024-02-10T08:28:53.986 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-02-10T08:28:53.986 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-02-10T08:28:53.986 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-02-10T08:28:53.986 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 3, 2024-02-10T08:28:53.986 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 2, 2024-02-10T08:28:53.986 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-02-10T08:28:53.986 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-02-10T08:28:53.986 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-02-10T08:28:53.986 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-02-10T08:28:53.986 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-10T08:28:53.986 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-02-10T08:28:53.986 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-02-10T08:28:53.986 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 32, 2024-02-10T08:28:53.987 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 32, 2024-02-10T08:28:53.987 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 32, 2024-02-10T08:28:53.987 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 32, 2024-02-10T08:28:53.987 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 32, 2024-02-10T08:28:53.987 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-02-10T08:28:53.987 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-02-10T08:28:53.987 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-02-10T08:28:53.987 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-02-10T08:28:53.987 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-02-10T08:28:53.987 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-02-10T08:28:53.987 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-02-10T08:28:53.987 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:53.988 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "60", 2024-02-10T08:28:53.988 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-02-10T08:28:53.988 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-10T08:28:53.988 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-02-10T08:28:53.988 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-02-10T08:28:53.988 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-02-10T08:28:53.988 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-02-10T08:28:53.988 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-02-10T08:28:53.988 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-02-10T08:28:53.988 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-02-10T08:28:53.988 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-02-10T08:28:53.988 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-02-10T08:28:53.989 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-02-10T08:28:53.989 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-02-10T08:28:53.989 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-02-10T08:28:53.989 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-02-10T08:28:53.989 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-02-10T08:28:53.989 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-02-10T08:28:53.989 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-02-10T08:28:53.989 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-10T08:28:53.989 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-10T08:28:53.989 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-10T08:28:53.989 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-02-10T08:28:53.989 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-02-10T08:28:53.989 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-02-10T08:28:53.989 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-02-10T08:28:53.989 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-02-10T08:28:53.990 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:53.990 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-02-10T08:28:53.990 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-02-10T08:28:53.990 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-02-10T08:28:53.990 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-02-10T08:28:53.990 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-02-10T08:28:53.990 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-02-10T08:28:53.990 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-02-10T08:28:53.990 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-02-10T08:28:53.990 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-02-10T08:28:53.990 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-02-10T08:28:53.990 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-02-10T08:28:53.990 INFO:teuthology.orchestra.run.smithi018.stdout: "options": {}, 2024-02-10T08:28:53.990 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-02-10T08:28:53.990 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw": {} 2024-02-10T08:28:53.990 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:53.991 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:53.991 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:53.991 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 6, 2024-02-10T08:28:53.991 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "default.rgw.meta", 2024-02-10T08:28:53.991 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-02-10T08:16:57.354868+0000", 2024-02-10T08:28:53.991 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-02-10T08:28:53.991 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-02-10T08:28:53.991 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-02-10T08:28:53.991 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 3, 2024-02-10T08:28:53.991 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 2, 2024-02-10T08:28:53.991 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-02-10T08:28:53.991 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-02-10T08:28:53.991 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-02-10T08:28:53.991 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-02-10T08:28:53.991 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-10T08:28:53.991 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-02-10T08:28:53.992 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-02-10T08:28:53.992 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 42, 2024-02-10T08:28:53.992 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 42, 2024-02-10T08:28:53.992 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 42, 2024-02-10T08:28:53.992 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 42, 2024-02-10T08:28:53.992 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 42, 2024-02-10T08:28:53.992 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-02-10T08:28:53.992 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-02-10T08:28:53.992 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-02-10T08:28:53.992 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-02-10T08:28:53.992 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-02-10T08:28:53.992 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-02-10T08:28:53.992 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-02-10T08:28:53.993 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:53.993 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "210", 2024-02-10T08:28:53.993 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-02-10T08:28:53.993 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-10T08:28:53.993 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "131", 2024-02-10T08:28:53.993 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-02-10T08:28:53.993 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-02-10T08:28:53.993 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-02-10T08:28:53.993 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-02-10T08:28:53.993 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-02-10T08:28:53.993 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-02-10T08:28:53.993 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-02-10T08:28:53.993 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-02-10T08:28:53.993 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-02-10T08:28:53.993 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-02-10T08:28:53.993 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-02-10T08:28:53.994 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-02-10T08:28:53.994 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-02-10T08:28:53.994 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-02-10T08:28:53.994 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-02-10T08:28:53.994 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-10T08:28:53.994 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-10T08:28:53.994 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-10T08:28:53.994 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-02-10T08:28:53.994 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-02-10T08:28:53.994 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-02-10T08:28:53.994 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-02-10T08:28:53.994 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-02-10T08:28:53.994 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:53.994 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-02-10T08:28:53.994 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-02-10T08:28:53.994 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-02-10T08:28:53.994 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-02-10T08:28:53.995 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-02-10T08:28:53.995 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-02-10T08:28:53.995 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-02-10T08:28:53.995 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-02-10T08:28:53.995 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-02-10T08:28:53.995 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-02-10T08:28:53.995 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-02-10T08:28:53.995 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-02-10T08:28:53.995 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_bias": 4 2024-02-10T08:28:53.995 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:53.995 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-02-10T08:28:53.995 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw": {} 2024-02-10T08:28:53.995 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:53.995 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:53.995 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:53.996 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 9, 2024-02-10T08:28:53.996 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "unique_pool_2", 2024-02-10T08:28:53.996 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-02-10T08:28:27.122533+0000", 2024-02-10T08:28:53.996 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-02-10T08:28:53.996 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-02-10T08:28:53.996 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-02-10T08:28:53.996 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 3, 2024-02-10T08:28:53.996 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 2, 2024-02-10T08:28:53.996 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-02-10T08:28:53.996 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-02-10T08:28:53.996 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-02-10T08:28:53.996 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-02-10T08:28:53.996 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-10T08:28:53.996 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-02-10T08:28:53.996 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-02-10T08:28:53.996 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 16, 2024-02-10T08:28:53.997 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 16, 2024-02-10T08:28:53.997 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 16, 2024-02-10T08:28:53.997 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 16, 2024-02-10T08:28:53.997 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 16, 2024-02-10T08:28:53.997 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-02-10T08:28:53.997 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-02-10T08:28:53.997 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-02-10T08:28:53.997 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-02-10T08:28:53.997 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-02-10T08:28:53.997 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-02-10T08:28:53.997 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-02-10T08:28:53.997 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:53.997 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "259", 2024-02-10T08:28:53.997 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-02-10T08:28:53.997 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-10T08:28:53.998 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-02-10T08:28:53.998 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-02-10T08:28:53.998 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-02-10T08:28:53.998 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-02-10T08:28:53.998 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-02-10T08:28:53.998 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-02-10T08:28:53.998 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-02-10T08:28:53.998 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-02-10T08:28:53.998 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-02-10T08:28:53.998 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-02-10T08:28:53.998 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-02-10T08:28:53.998 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-02-10T08:28:53.998 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-02-10T08:28:53.998 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-02-10T08:28:53.998 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-02-10T08:28:53.999 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-02-10T08:28:53.999 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-10T08:28:53.999 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-10T08:28:53.999 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-10T08:28:53.999 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-02-10T08:28:53.999 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-02-10T08:28:53.999 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-02-10T08:28:53.999 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-02-10T08:28:53.999 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-02-10T08:28:53.999 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:53.999 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-02-10T08:28:53.999 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-02-10T08:28:53.999 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-02-10T08:28:53.999 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-02-10T08:28:54.000 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-02-10T08:28:54.000 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-02-10T08:28:54.000 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-02-10T08:28:54.000 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-02-10T08:28:54.000 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-02-10T08:28:54.000 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-02-10T08:28:54.000 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-02-10T08:28:54.000 INFO:teuthology.orchestra.run.smithi018.stdout: "options": {}, 2024-02-10T08:28:54.000 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-02-10T08:28:54.000 INFO:teuthology.orchestra.run.smithi018.stdout: "rados": {} 2024-02-10T08:28:54.000 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:54.000 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:54.000 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-02-10T08:28:54.001 INFO:teuthology.orchestra.run.smithi018.stdout: "osds": [ 2024-02-10T08:28:54.001 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:54.001 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-02-10T08:28:54.001 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "f9043fee-a3ed-4e16-921d-bb86756d0c48", 2024-02-10T08:28:54.001 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-02-10T08:28:54.001 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-02-10T08:28:54.001 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 0.6356658935546875, 2024-02-10T08:28:54.001 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-02-10T08:28:54.001 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-02-10T08:28:54.001 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-02-10T08:28:54.001 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 8, 2024-02-10T08:28:54.001 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 260, 2024-02-10T08:28:54.001 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-02-10T08:28:54.001 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-02-10T08:28:54.001 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-02-10T08:28:54.001 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:28:54.002 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:54.002 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:28:54.002 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6801", 2024-02-10T08:28:54.002 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 276034406 2024-02-10T08:28:54.002 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:54.002 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:28:54.002 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:54.002 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-02-10T08:28:54.002 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:28:54.002 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:54.002 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:28:54.002 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6802", 2024-02-10T08:28:54.002 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 276034406 2024-02-10T08:28:54.002 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:54.002 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:28:54.002 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:54.002 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-02-10T08:28:54.003 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:28:54.003 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:54.003 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:28:54.003 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6804", 2024-02-10T08:28:54.003 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 276034406 2024-02-10T08:28:54.003 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:54.003 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:28:54.003 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:54.003 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-02-10T08:28:54.003 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:28:54.003 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:54.003 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:28:54.003 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6803", 2024-02-10T08:28:54.003 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 276034406 2024-02-10T08:28:54.003 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:54.003 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:28:54.003 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:54.003 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6801/276034406", 2024-02-10T08:28:54.004 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6802/276034406", 2024-02-10T08:28:54.004 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6804/276034406", 2024-02-10T08:28:54.004 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6803/276034406", 2024-02-10T08:28:54.004 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-02-10T08:28:54.004 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-02-10T08:28:54.004 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-02-10T08:28:54.004 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:28:54.004 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:54.004 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:54.004 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-02-10T08:28:54.004 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "ff958272-ce6b-4162-959a-6da9729e537b", 2024-02-10T08:28:54.004 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-02-10T08:28:54.005 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-02-10T08:28:54.005 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-02-10T08:28:54.005 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-02-10T08:28:54.005 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-02-10T08:28:54.005 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-02-10T08:28:54.005 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-02-10T08:28:54.005 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 256, 2024-02-10T08:28:54.005 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-02-10T08:28:54.005 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-02-10T08:28:54.005 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-02-10T08:28:54.005 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:28:54.005 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:54.005 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:28:54.005 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6805", 2024-02-10T08:28:54.006 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1941014296 2024-02-10T08:28:54.006 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:54.006 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:28:54.006 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:54.006 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-02-10T08:28:54.006 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:28:54.006 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:54.006 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:28:54.006 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6806", 2024-02-10T08:28:54.006 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1941014296 2024-02-10T08:28:54.006 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:54.006 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:28:54.007 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:54.007 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-02-10T08:28:54.007 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:28:54.007 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:54.007 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:28:54.007 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6808", 2024-02-10T08:28:54.007 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1941014296 2024-02-10T08:28:54.007 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:54.007 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:28:54.007 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:54.007 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-02-10T08:28:54.007 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:28:54.008 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:54.008 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:28:54.008 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6807", 2024-02-10T08:28:54.008 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1941014296 2024-02-10T08:28:54.008 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:54.008 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:28:54.008 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:54.008 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6805/1941014296", 2024-02-10T08:28:54.008 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6806/1941014296", 2024-02-10T08:28:54.008 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6808/1941014296", 2024-02-10T08:28:54.008 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6807/1941014296", 2024-02-10T08:28:54.008 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-02-10T08:28:54.008 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-02-10T08:28:54.009 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-02-10T08:28:54.009 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:28:54.009 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:54.009 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:54.009 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-02-10T08:28:54.009 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "29bb47e2-5c81-4ae8-bb9f-d1b02ea01d3f", 2024-02-10T08:28:54.009 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-02-10T08:28:54.009 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-02-10T08:28:54.009 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-02-10T08:28:54.009 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-02-10T08:28:54.009 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-02-10T08:28:54.009 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-02-10T08:28:54.009 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 18, 2024-02-10T08:28:54.009 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 260, 2024-02-10T08:28:54.010 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-02-10T08:28:54.010 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-02-10T08:28:54.010 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-02-10T08:28:54.010 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:28:54.010 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:54.010 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:28:54.010 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6809", 2024-02-10T08:28:54.010 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3122474567 2024-02-10T08:28:54.010 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:54.010 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:28:54.010 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:54.011 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-02-10T08:28:54.011 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:28:54.011 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:54.011 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:28:54.011 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6810", 2024-02-10T08:28:54.011 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3122474567 2024-02-10T08:28:54.011 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:54.011 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:28:54.011 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:54.011 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-02-10T08:28:54.011 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:28:54.011 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:54.011 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:28:54.011 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6812", 2024-02-10T08:28:54.012 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3122474567 2024-02-10T08:28:54.012 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:54.012 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:28:54.012 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:54.012 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-02-10T08:28:54.012 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:28:54.012 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:54.012 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:28:54.012 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6811", 2024-02-10T08:28:54.012 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3122474567 2024-02-10T08:28:54.012 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:54.012 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:28:54.012 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:54.012 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6809/3122474567", 2024-02-10T08:28:54.013 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6810/3122474567", 2024-02-10T08:28:54.013 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6812/3122474567", 2024-02-10T08:28:54.013 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6811/3122474567", 2024-02-10T08:28:54.013 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-02-10T08:28:54.013 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-02-10T08:28:54.013 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-02-10T08:28:54.013 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:28:54.013 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:54.013 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:54.013 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-02-10T08:28:54.013 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "87ad37de-5f49-4e5b-9683-3bb9c3e33907", 2024-02-10T08:28:54.013 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-02-10T08:28:54.013 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-02-10T08:28:54.013 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 0.51214599609375, 2024-02-10T08:28:54.013 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 0, 2024-02-10T08:28:54.013 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-02-10T08:28:54.013 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-02-10T08:28:54.014 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 25, 2024-02-10T08:28:54.014 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 175, 2024-02-10T08:28:54.014 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-02-10T08:28:54.014 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-02-10T08:28:54.014 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-02-10T08:28:54.014 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:28:54.014 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:54.014 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:28:54.014 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6813", 2024-02-10T08:28:54.014 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3484706437 2024-02-10T08:28:54.014 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:54.014 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:28:54.014 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:54.014 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-02-10T08:28:54.014 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:28:54.014 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:54.014 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:28:54.015 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6814", 2024-02-10T08:28:54.015 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3484706437 2024-02-10T08:28:54.015 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:54.015 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:28:54.015 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:54.015 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-02-10T08:28:54.015 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:28:54.015 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:54.015 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:28:54.015 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6816", 2024-02-10T08:28:54.015 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3484706437 2024-02-10T08:28:54.015 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:54.015 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:28:54.015 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:54.015 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-02-10T08:28:54.015 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:28:54.015 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:54.016 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:28:54.016 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6815", 2024-02-10T08:28:54.016 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3484706437 2024-02-10T08:28:54.016 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:54.016 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:28:54.016 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:54.016 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6813/3484706437", 2024-02-10T08:28:54.016 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6814/3484706437", 2024-02-10T08:28:54.016 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6816/3484706437", 2024-02-10T08:28:54.016 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6815/3484706437", 2024-02-10T08:28:54.016 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-02-10T08:28:54.016 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-02-10T08:28:54.016 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-02-10T08:28:54.016 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:28:54.016 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:54.016 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:54.017 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-02-10T08:28:54.017 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "f5708f20-f98d-4d12-b8ae-71a5049a14cc", 2024-02-10T08:28:54.017 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-02-10T08:28:54.017 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-02-10T08:28:54.017 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 0.9274444580078125, 2024-02-10T08:28:54.017 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-02-10T08:28:54.017 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 30, 2024-02-10T08:28:54.017 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 87, 2024-02-10T08:28:54.017 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 110, 2024-02-10T08:28:54.017 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 256, 2024-02-10T08:28:54.017 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 88, 2024-02-10T08:28:54.017 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-02-10T08:28:54.017 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-02-10T08:28:54.017 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:28:54.017 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:54.017 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:28:54.018 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6800", 2024-02-10T08:28:54.018 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3888817642 2024-02-10T08:28:54.018 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:54.018 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:28:54.018 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:54.018 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-02-10T08:28:54.018 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:28:54.018 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:54.018 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:28:54.018 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6801", 2024-02-10T08:28:54.018 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3888817642 2024-02-10T08:28:54.018 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:54.018 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:28:54.018 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:54.018 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-02-10T08:28:54.018 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:28:54.019 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:54.019 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:28:54.019 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6803", 2024-02-10T08:28:54.019 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3888817642 2024-02-10T08:28:54.019 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:54.019 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:28:54.019 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:54.019 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-02-10T08:28:54.019 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:28:54.019 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:54.019 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:28:54.019 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6802", 2024-02-10T08:28:54.019 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3888817642 2024-02-10T08:28:54.020 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:54.020 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:28:54.020 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:54.020 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.71:6800/3888817642", 2024-02-10T08:28:54.020 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.71:6801/3888817642", 2024-02-10T08:28:54.020 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.71:6803/3888817642", 2024-02-10T08:28:54.020 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.71:6802/3888817642", 2024-02-10T08:28:54.020 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-02-10T08:28:54.020 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-02-10T08:28:54.020 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-02-10T08:28:54.020 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:28:54.020 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:54.020 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:54.020 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-02-10T08:28:54.021 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "e36a71dd-5088-4bff-965e-7dc8708ef7e3", 2024-02-10T08:28:54.021 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-02-10T08:28:54.021 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-02-10T08:28:54.021 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-02-10T08:28:54.021 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-02-10T08:28:54.021 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-02-10T08:28:54.021 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-02-10T08:28:54.021 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 37, 2024-02-10T08:28:54.021 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 260, 2024-02-10T08:28:54.021 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-02-10T08:28:54.021 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-02-10T08:28:54.021 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-02-10T08:28:54.021 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:28:54.021 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:54.021 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:28:54.022 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6804", 2024-02-10T08:28:54.022 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1932648316 2024-02-10T08:28:54.022 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:54.022 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:28:54.022 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:54.022 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-02-10T08:28:54.022 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:28:54.022 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:54.022 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:28:54.022 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6805", 2024-02-10T08:28:54.022 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1932648316 2024-02-10T08:28:54.022 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:54.022 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:28:54.022 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:54.022 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-02-10T08:28:54.023 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:28:54.023 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:54.023 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:28:54.023 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6807", 2024-02-10T08:28:54.023 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1932648316 2024-02-10T08:28:54.023 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:54.023 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:28:54.023 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:54.023 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-02-10T08:28:54.023 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:28:54.023 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:54.023 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:28:54.023 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6806", 2024-02-10T08:28:54.023 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1932648316 2024-02-10T08:28:54.023 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:54.023 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:28:54.024 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:54.024 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.71:6804/1932648316", 2024-02-10T08:28:54.024 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.71:6805/1932648316", 2024-02-10T08:28:54.024 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.71:6807/1932648316", 2024-02-10T08:28:54.024 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.71:6806/1932648316", 2024-02-10T08:28:54.024 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-02-10T08:28:54.024 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-02-10T08:28:54.024 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-02-10T08:28:54.024 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:28:54.024 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:54.024 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:54.024 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-02-10T08:28:54.024 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "210a8790-78b6-4efa-a969-17efb17e9c0b", 2024-02-10T08:28:54.025 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-02-10T08:28:54.025 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-02-10T08:28:54.025 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-02-10T08:28:54.025 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-02-10T08:28:54.025 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-02-10T08:28:54.025 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-02-10T08:28:54.025 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 43, 2024-02-10T08:28:54.025 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 260, 2024-02-10T08:28:54.025 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-02-10T08:28:54.025 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-02-10T08:28:54.025 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-02-10T08:28:54.025 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:28:54.025 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:54.025 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:28:54.025 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6808", 2024-02-10T08:28:54.025 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3724399458 2024-02-10T08:28:54.026 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:54.026 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:28:54.026 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:54.026 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-02-10T08:28:54.026 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:28:54.026 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:54.026 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:28:54.026 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6809", 2024-02-10T08:28:54.027 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3724399458 2024-02-10T08:28:54.027 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:54.027 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:28:54.027 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:54.027 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-02-10T08:28:54.027 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:28:54.027 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:54.028 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:28:54.028 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6811", 2024-02-10T08:28:54.028 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3724399458 2024-02-10T08:28:54.028 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:54.028 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:28:54.028 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:54.028 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-02-10T08:28:54.028 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:28:54.028 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:54.028 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:28:54.028 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6810", 2024-02-10T08:28:54.029 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3724399458 2024-02-10T08:28:54.029 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:54.029 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:28:54.029 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:54.029 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.71:6808/3724399458", 2024-02-10T08:28:54.029 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.71:6809/3724399458", 2024-02-10T08:28:54.029 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.71:6811/3724399458", 2024-02-10T08:28:54.029 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.71:6810/3724399458", 2024-02-10T08:28:54.029 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-02-10T08:28:54.029 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-02-10T08:28:54.029 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-02-10T08:28:54.029 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:28:54.029 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:54.029 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:54.029 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-02-10T08:28:54.030 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "9778a0e9-2ff3-4700-bf2a-675edaba630b", 2024-02-10T08:28:54.030 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-02-10T08:28:54.030 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-02-10T08:28:54.030 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-02-10T08:28:54.030 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-02-10T08:28:54.030 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-02-10T08:28:54.030 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-02-10T08:28:54.030 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 50, 2024-02-10T08:28:54.030 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 260, 2024-02-10T08:28:54.030 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-02-10T08:28:54.030 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-02-10T08:28:54.030 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-02-10T08:28:54.030 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:28:54.030 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:54.030 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:28:54.030 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6812", 2024-02-10T08:28:54.031 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 163573852 2024-02-10T08:28:54.031 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:54.031 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:28:54.031 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:54.031 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-02-10T08:28:54.031 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:28:54.031 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:54.031 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:28:54.031 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6813", 2024-02-10T08:28:54.031 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 163573852 2024-02-10T08:28:54.031 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:54.031 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:28:54.031 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:54.031 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-02-10T08:28:54.032 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:28:54.032 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:54.032 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:28:54.032 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6815", 2024-02-10T08:28:54.032 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 163573852 2024-02-10T08:28:54.032 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:54.032 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:28:54.033 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:54.033 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-02-10T08:28:54.033 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:28:54.033 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:54.033 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:28:54.033 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6814", 2024-02-10T08:28:54.033 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 163573852 2024-02-10T08:28:54.033 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:54.034 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:28:54.034 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:54.034 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.71:6812/163573852", 2024-02-10T08:28:54.034 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.71:6813/163573852", 2024-02-10T08:28:54.034 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.71:6815/163573852", 2024-02-10T08:28:54.034 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.71:6814/163573852", 2024-02-10T08:28:54.034 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-02-10T08:28:54.034 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-02-10T08:28:54.034 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-02-10T08:28:54.035 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:28:54.035 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:54.035 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-02-10T08:28:54.035 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_xinfo": [ 2024-02-10T08:28:54.035 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:54.035 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-02-10T08:28:54.035 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-02-10T08:28:54.035 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-02-10T08:28:54.035 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-02-10T08:28:54.035 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540138314316775423, 2024-02-10T08:28:54.035 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-02-10T08:28:54.035 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-02-10T08:28:22.780623+0000", 2024-02-10T08:28:54.035 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-02-10T08:28:54.035 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:54.035 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:54.036 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-02-10T08:28:54.036 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-02-10T08:28:54.036 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-02-10T08:28:54.036 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-02-10T08:28:54.036 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540138314316775423, 2024-02-10T08:28:54.036 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-02-10T08:28:54.036 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-02-10T08:28:21.823427+0000", 2024-02-10T08:28:54.036 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-02-10T08:28:54.036 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:54.036 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:54.037 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-02-10T08:28:54.037 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-02-10T08:28:54.037 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-02-10T08:28:54.037 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-02-10T08:28:54.037 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540138314316775423, 2024-02-10T08:28:54.037 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-02-10T08:28:54.037 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-02-10T08:28:40.683154+0000", 2024-02-10T08:28:54.037 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-02-10T08:28:54.037 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:54.037 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:54.037 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-02-10T08:28:54.037 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-02-10T08:28:54.037 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-02-10T08:28:54.038 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-02-10T08:28:54.038 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540138314316775423, 2024-02-10T08:28:54.038 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-02-10T08:28:54.038 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-02-10T08:27:24.861119+0000", 2024-02-10T08:28:54.038 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-02-10T08:28:54.038 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:54.038 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:54.038 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-02-10T08:28:54.038 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-02-10T08:28:54.038 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-02-10T08:28:54.038 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-02-10T08:28:54.038 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540138314316775423, 2024-02-10T08:28:54.038 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-02-10T08:28:54.038 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-02-10T08:28:47.640800+0000", 2024-02-10T08:28:54.039 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 87 2024-02-10T08:28:54.039 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:54.039 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:54.039 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-02-10T08:28:54.039 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-02-10T08:28:54.039 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-02-10T08:28:54.039 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-02-10T08:28:54.039 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540138314316775423, 2024-02-10T08:28:54.039 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-02-10T08:28:54.039 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-02-10T08:28:19.557537+0000", 2024-02-10T08:28:54.039 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-02-10T08:28:54.039 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:54.040 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:54.040 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-02-10T08:28:54.040 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-02-10T08:28:54.040 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-02-10T08:28:54.040 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-02-10T08:28:54.040 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540138314316775423, 2024-02-10T08:28:54.040 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-02-10T08:28:54.040 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-02-10T08:27:42.023943+0000", 2024-02-10T08:28:54.040 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-02-10T08:28:54.040 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:54.040 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:54.040 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-02-10T08:28:54.040 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-02-10T08:28:54.041 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-02-10T08:28:54.041 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-02-10T08:28:54.041 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540138314316775423, 2024-02-10T08:28:54.041 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-02-10T08:28:54.041 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-02-10T08:28:18.048412+0000", 2024-02-10T08:28:54.041 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-02-10T08:28:54.041 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:54.041 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-02-10T08:28:54.041 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap": [], 2024-02-10T08:28:54.041 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_items": [ 2024-02-10T08:28:54.041 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:54.041 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "2.5", 2024-02-10T08:28:54.041 INFO:teuthology.orchestra.run.smithi018.stdout: "mappings": [ 2024-02-10T08:28:54.041 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:54.041 INFO:teuthology.orchestra.run.smithi018.stdout: "from": 7, 2024-02-10T08:28:54.041 INFO:teuthology.orchestra.run.smithi018.stdout: "to": 2 2024-02-10T08:28:54.042 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:54.042 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:28:54.042 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:54.042 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:54.042 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "4.7", 2024-02-10T08:28:54.042 INFO:teuthology.orchestra.run.smithi018.stdout: "mappings": [ 2024-02-10T08:28:54.042 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:54.042 INFO:teuthology.orchestra.run.smithi018.stdout: "from": 1, 2024-02-10T08:28:54.042 INFO:teuthology.orchestra.run.smithi018.stdout: "to": 7 2024-02-10T08:28:54.042 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:54.042 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:28:54.042 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:54.042 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:54.042 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "4.d", 2024-02-10T08:28:54.042 INFO:teuthology.orchestra.run.smithi018.stdout: "mappings": [ 2024-02-10T08:28:54.042 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:54.042 INFO:teuthology.orchestra.run.smithi018.stdout: "from": 1, 2024-02-10T08:28:54.043 INFO:teuthology.orchestra.run.smithi018.stdout: "to": 5 2024-02-10T08:28:54.043 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:54.043 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:28:54.043 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:54.043 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:54.043 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "4.f", 2024-02-10T08:28:54.043 INFO:teuthology.orchestra.run.smithi018.stdout: "mappings": [ 2024-02-10T08:28:54.043 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:54.043 INFO:teuthology.orchestra.run.smithi018.stdout: "from": 1, 2024-02-10T08:28:54.043 INFO:teuthology.orchestra.run.smithi018.stdout: "to": 2 2024-02-10T08:28:54.043 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:54.043 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:28:54.043 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:54.043 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:54.043 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "4.12", 2024-02-10T08:28:54.043 INFO:teuthology.orchestra.run.smithi018.stdout: "mappings": [ 2024-02-10T08:28:54.043 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:54.044 INFO:teuthology.orchestra.run.smithi018.stdout: "from": 1, 2024-02-10T08:28:54.044 INFO:teuthology.orchestra.run.smithi018.stdout: "to": 0 2024-02-10T08:28:54.044 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:54.044 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:28:54.044 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:54.044 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:54.044 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "4.13", 2024-02-10T08:28:54.044 INFO:teuthology.orchestra.run.smithi018.stdout: "mappings": [ 2024-02-10T08:28:54.044 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:54.044 INFO:teuthology.orchestra.run.smithi018.stdout: "from": 1, 2024-02-10T08:28:54.044 INFO:teuthology.orchestra.run.smithi018.stdout: "to": 2 2024-02-10T08:28:54.044 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:54.044 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:28:54.044 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:54.044 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:54.045 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "5.1b", 2024-02-10T08:28:54.045 INFO:teuthology.orchestra.run.smithi018.stdout: "mappings": [ 2024-02-10T08:28:54.045 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:54.045 INFO:teuthology.orchestra.run.smithi018.stdout: "from": 0, 2024-02-10T08:28:54.045 INFO:teuthology.orchestra.run.smithi018.stdout: "to": 6 2024-02-10T08:28:54.045 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:54.045 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:28:54.045 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:54.045 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:54.045 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "6.0", 2024-02-10T08:28:54.045 INFO:teuthology.orchestra.run.smithi018.stdout: "mappings": [ 2024-02-10T08:28:54.045 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:54.045 INFO:teuthology.orchestra.run.smithi018.stdout: "from": 2, 2024-02-10T08:28:54.045 INFO:teuthology.orchestra.run.smithi018.stdout: "to": 1 2024-02-10T08:28:54.045 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:54.045 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:28:54.045 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:54.046 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:54.046 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "6.4", 2024-02-10T08:28:54.046 INFO:teuthology.orchestra.run.smithi018.stdout: "mappings": [ 2024-02-10T08:28:54.046 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:54.046 INFO:teuthology.orchestra.run.smithi018.stdout: "from": 6, 2024-02-10T08:28:54.046 INFO:teuthology.orchestra.run.smithi018.stdout: "to": 3 2024-02-10T08:28:54.046 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:54.046 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:28:54.046 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:54.046 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:54.046 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "6.8", 2024-02-10T08:28:54.046 INFO:teuthology.orchestra.run.smithi018.stdout: "mappings": [ 2024-02-10T08:28:54.046 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:54.046 INFO:teuthology.orchestra.run.smithi018.stdout: "from": 2, 2024-02-10T08:28:54.046 INFO:teuthology.orchestra.run.smithi018.stdout: "to": 4 2024-02-10T08:28:54.046 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:54.046 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:28:54.047 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:54.047 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:54.047 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "6.f", 2024-02-10T08:28:54.047 INFO:teuthology.orchestra.run.smithi018.stdout: "mappings": [ 2024-02-10T08:28:54.047 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:54.047 INFO:teuthology.orchestra.run.smithi018.stdout: "from": 2, 2024-02-10T08:28:54.047 INFO:teuthology.orchestra.run.smithi018.stdout: "to": 0 2024-02-10T08:28:54.047 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:54.047 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:28:54.047 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:54.047 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:54.047 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "6.14", 2024-02-10T08:28:54.047 INFO:teuthology.orchestra.run.smithi018.stdout: "mappings": [ 2024-02-10T08:28:54.047 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:54.047 INFO:teuthology.orchestra.run.smithi018.stdout: "from": 2, 2024-02-10T08:28:54.047 INFO:teuthology.orchestra.run.smithi018.stdout: "to": 0 2024-02-10T08:28:54.048 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:54.048 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:54.048 INFO:teuthology.orchestra.run.smithi018.stdout: "from": 7, 2024-02-10T08:28:54.048 INFO:teuthology.orchestra.run.smithi018.stdout: "to": 5 2024-02-10T08:28:54.048 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:54.048 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:28:54.048 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:54.048 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:54.048 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "6.23", 2024-02-10T08:28:54.048 INFO:teuthology.orchestra.run.smithi018.stdout: "mappings": [ 2024-02-10T08:28:54.048 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:28:54.048 INFO:teuthology.orchestra.run.smithi018.stdout: "from": 6, 2024-02-10T08:28:54.048 INFO:teuthology.orchestra.run.smithi018.stdout: "to": 0 2024-02-10T08:28:54.048 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:54.048 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:28:54.049 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:54.049 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-02-10T08:28:54.049 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_temp": [], 2024-02-10T08:28:54.049 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_temp": [], 2024-02-10T08:28:54.049 INFO:teuthology.orchestra.run.smithi018.stdout: "blocklist": { 2024-02-10T08:28:54.049 INFO:teuthology.orchestra.run.smithi018.stdout: "172.21.15.18:6800/542054629": "2024-02-11T08:17:16.433947+0000", 2024-02-10T08:28:54.049 INFO:teuthology.orchestra.run.smithi018.stdout: "172.21.15.18:0/491217791": "2024-02-11T08:17:16.433947+0000", 2024-02-10T08:28:54.049 INFO:teuthology.orchestra.run.smithi018.stdout: "172.21.15.18:0/781076548": "2024-02-11T08:17:16.433947+0000", 2024-02-10T08:28:54.049 INFO:teuthology.orchestra.run.smithi018.stdout: "172.21.15.18:0/957318754": "2024-02-11T08:17:16.433947+0000", 2024-02-10T08:28:54.049 INFO:teuthology.orchestra.run.smithi018.stdout: "172.21.15.18:0/2662732452": "2024-02-11T08:11:55.105124+0000", 2024-02-10T08:28:54.049 INFO:teuthology.orchestra.run.smithi018.stdout: "172.21.15.18:0/1407788916": "2024-02-11T08:11:55.105124+0000", 2024-02-10T08:28:54.049 INFO:teuthology.orchestra.run.smithi018.stdout: "172.21.15.18:6800/3798687064": "2024-02-11T08:11:55.105124+0000", 2024-02-10T08:28:54.049 INFO:teuthology.orchestra.run.smithi018.stdout: "172.21.15.18:6800/3570839557": "2024-02-11T08:11:31.445897+0000", 2024-02-10T08:28:54.049 INFO:teuthology.orchestra.run.smithi018.stdout: "172.21.15.18:0/541168116": "2024-02-11T08:11:31.445897+0000", 2024-02-10T08:28:54.049 INFO:teuthology.orchestra.run.smithi018.stdout: "172.21.15.18:0/806236095": "2024-02-11T08:11:31.445897+0000" 2024-02-10T08:28:54.050 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:54.050 INFO:teuthology.orchestra.run.smithi018.stdout: "range_blocklist": {}, 2024-02-10T08:28:54.050 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profiles": { 2024-02-10T08:28:54.050 INFO:teuthology.orchestra.run.smithi018.stdout: "default": { 2024-02-10T08:28:54.050 INFO:teuthology.orchestra.run.smithi018.stdout: "crush-failure-domain": "osd", 2024-02-10T08:28:54.050 INFO:teuthology.orchestra.run.smithi018.stdout: "k": "2", 2024-02-10T08:28:54.050 INFO:teuthology.orchestra.run.smithi018.stdout: "m": "1", 2024-02-10T08:28:54.050 INFO:teuthology.orchestra.run.smithi018.stdout: "plugin": "jerasure", 2024-02-10T08:28:54.050 INFO:teuthology.orchestra.run.smithi018.stdout: "ruleset-failure-domain": "osd", 2024-02-10T08:28:54.050 INFO:teuthology.orchestra.run.smithi018.stdout: "technique": "reed_sol_van" 2024-02-10T08:28:54.050 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:54.050 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:28:54.050 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps_queue": [], 2024-02-10T08:28:54.050 INFO:teuthology.orchestra.run.smithi018.stdout: "new_removed_snaps": [], 2024-02-10T08:28:54.050 INFO:teuthology.orchestra.run.smithi018.stdout: "new_purged_snaps": [], 2024-02-10T08:28:54.051 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_node_flags": {}, 2024-02-10T08:28:54.051 INFO:teuthology.orchestra.run.smithi018.stdout: "device_class_flags": {}, 2024-02-10T08:28:54.051 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode": { 2024-02-10T08:28:54.051 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_enabled": false, 2024-02-10T08:28:54.051 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_bucket_count": 0, 2024-02-10T08:28:54.051 INFO:teuthology.orchestra.run.smithi018.stdout: "degraded_stretch_mode": 0, 2024-02-10T08:28:54.051 INFO:teuthology.orchestra.run.smithi018.stdout: "recovering_stretch_mode": 0, 2024-02-10T08:28:54.051 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_bucket": 0 2024-02-10T08:28:54.051 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:28:54.051 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-02-10T08:28:54.052 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:53 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:52.820386+0000 mgr.y (mgr.14505) 457 : cluster [DBG] pgmap v553: 158 pgs: 158 active+clean; 2.0 GiB data, 8.1 GiB used, 707 GiB / 715 GiB avail; 1.7 KiB/s rd, 193 MiB/s wr, 3.09k op/s 2024-02-10T08:28:54.052 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:53 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:28:53.178468+0000 mon.b (mon.1) 67 : audit [DBG] from='client.? 172.21.15.18:0/2962493688' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:28:54.052 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:52.820386+0000 mgr.y (mgr.14505) 457 : cluster [DBG] pgmap v553: 158 pgs: 158 active+clean; 2.0 GiB data, 8.1 GiB used, 707 GiB / 715 GiB avail; 1.7 KiB/s rd, 193 MiB/s wr, 3.09k op/s 2024-02-10T08:28:54.052 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:28:53.178468+0000 mon.b (mon.1) 67 : audit [DBG] from='client.? 172.21.15.18:0/2962493688' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:28:54.052 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:52.820386+0000 mgr.y (mgr.14505) 457 : cluster [DBG] pgmap v553: 158 pgs: 158 active+clean; 2.0 GiB data, 8.1 GiB used, 707 GiB / 715 GiB avail; 1.7 KiB/s rd, 193 MiB/s wr, 3.09k op/s 2024-02-10T08:28:54.052 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:28:53.178468+0000 mon.b (mon.1) 67 : audit [DBG] from='client.? 172.21.15.18:0/2962493688' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:28:54.140 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 16 16 36806 36790 143.653 104.625 0.00839619 0.00695622 2024-02-10T08:28:54.267 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.4 dump_historic_ops 2024-02-10T08:28:54.315 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:28:54.321 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:54.321 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:28:54.422 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:28:54.501 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:54.535 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:28:54.540 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:54.541 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:28:54.642 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:28:54.708 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:28:54.710 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:54.748 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:28:54.752 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:54.753 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:28:54.769 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd unset noscrub 2024-02-10T08:28:54.853 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:28:54.906 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:55.015 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:54 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:28:53.958773+0000 mon.c (mon.2) 61 : audit [DBG] from='client.? 172.21.15.18:0/3032654515' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2024-02-10T08:28:55.015 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:28:55.021 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:55.021 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:28:55.122 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:28:55.141 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 17 16 38388 38372 141.019 98.875 0.00707014 0.00708512 2024-02-10T08:28:55.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:28:53.958773+0000 mon.c (mon.2) 61 : audit [DBG] from='client.? 172.21.15.18:0/3032654515' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2024-02-10T08:28:55.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:28:53.958773+0000 mon.c (mon.2) 61 : audit [DBG] from='client.? 172.21.15.18:0/3032654515' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2024-02-10T08:28:55.175 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:55.232 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:28:55.240 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:55.240 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:28:55.248 INFO:tasks.thrashosds.thrasher:j is {'epoch': 266, 'fsid': 'd46257c8-c7eb-11ee-95b8-87774f69a715', 'created': '2024-02-10T08:10:57.425061+0000', 'modified': '2024-02-10T08:28:51.748376+0000', 'last_up_change': '2024-02-10T08:20:45.372678+0000', 'last_in_change': '2024-02-10T08:28:01.734588+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 19, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 9, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'pacific', 'pools': [{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-02-10T08:14:44.034966+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': '.rgw.root', 'create_time': '2024-02-10T08:16:51.334631+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 3, 'pool_name': 'iscsi', 'create_time': '2024-02-10T08:16:51.762963+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 3, 'pg_placement_num': 3, 'pg_placement_num_target': 3, 'pg_num_target': 3, 'pg_num_pending': 3, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '57', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 4, 'pool_name': 'default.rgw.log', 'create_time': '2024-02-10T08:16:53.258098+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '205', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 5, 'pool_name': 'default.rgw.control', 'create_time': '2024-02-10T08:16:55.289300+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 6, 'pool_name': 'default.rgw.meta', 'create_time': '2024-02-10T08:16:57.354868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 42, 'pg_placement_num': 42, 'pg_placement_num_target': 42, 'pg_num_target': 42, 'pg_num_pending': 42, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '210', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '131', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4}, 'application_metadata': {'rgw': {}}}, {'pool': 9, 'pool_name': 'unique_pool_2', 'create_time': '2024-02-10T08:28:27.122533+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '259', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}], 'osds': [{'osd': 0, 'uuid': 'f9043fee-a3ed-4e16-921d-bb86756d0c48', 'up': 1, 'in': 1, 'weight': 0.6356658935546875, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 260, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6801', 'nonce': 276034406}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6802', 'nonce': 276034406}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6804', 'nonce': 276034406}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6803', 'nonce': 276034406}]}, 'public_addr': '172.21.15.18:6801/276034406', 'cluster_addr': '172.21.15.18:6802/276034406', 'heartbeat_back_addr': '172.21.15.18:6804/276034406', 'heartbeat_front_addr': '172.21.15.18:6803/276034406', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'ff958272-ce6b-4162-959a-6da9729e537b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 256, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6805', 'nonce': 1941014296}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6806', 'nonce': 1941014296}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6808', 'nonce': 1941014296}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6807', 'nonce': 1941014296}]}, 'public_addr': '172.21.15.18:6805/1941014296', 'cluster_addr': '172.21.15.18:6806/1941014296', 'heartbeat_back_addr': '172.21.15.18:6808/1941014296', 'heartbeat_front_addr': '172.21.15.18:6807/1941014296', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '29bb47e2-5c81-4ae8-bb9f-d1b02ea01d3f', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 18, 'up_thru': 260, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6809', 'nonce': 3122474567}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6810', 'nonce': 3122474567}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6812', 'nonce': 3122474567}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6811', 'nonce': 3122474567}]}, 'public_addr': '172.21.15.18:6809/3122474567', 'cluster_addr': '172.21.15.18:6810/3122474567', 'heartbeat_back_addr': '172.21.15.18:6812/3122474567', 'heartbeat_front_addr': '172.21.15.18:6811/3122474567', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '87ad37de-5f49-4e5b-9683-3bb9c3e33907', 'up': 1, 'in': 1, 'weight': 0.51214599609375, 'primary_affinity': 0, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 25, 'up_thru': 175, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6813', 'nonce': 3484706437}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6814', 'nonce': 3484706437}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6816', 'nonce': 3484706437}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6815', 'nonce': 3484706437}]}, 'public_addr': '172.21.15.18:6813/3484706437', 'cluster_addr': '172.21.15.18:6814/3484706437', 'heartbeat_back_addr': '172.21.15.18:6816/3484706437', 'heartbeat_front_addr': '172.21.15.18:6815/3484706437', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': 'f5708f20-f98d-4d12-b8ae-71a5049a14cc', 'up': 1, 'in': 1, 'weight': 0.9274444580078125, 'primary_affinity': 1, 'last_clean_begin': 30, 'last_clean_end': 87, 'up_from': 110, 'up_thru': 256, 'down_at': 88, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6800', 'nonce': 3888817642}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6801', 'nonce': 3888817642}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6803', 'nonce': 3888817642}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6802', 'nonce': 3888817642}]}, 'public_addr': '172.21.15.71:6800/3888817642', 'cluster_addr': '172.21.15.71:6801/3888817642', 'heartbeat_back_addr': '172.21.15.71:6803/3888817642', 'heartbeat_front_addr': '172.21.15.71:6802/3888817642', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'e36a71dd-5088-4bff-965e-7dc8708ef7e3', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 37, 'up_thru': 260, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6804', 'nonce': 1932648316}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6805', 'nonce': 1932648316}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6807', 'nonce': 1932648316}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6806', 'nonce': 1932648316}]}, 'public_addr': '172.21.15.71:6804/1932648316', 'cluster_addr': '172.21.15.71:6805/1932648316', 'heartbeat_back_addr': '172.21.15.71:6807/1932648316', 'heartbeat_front_addr': '172.21.15.71:6806/1932648316', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '210a8790-78b6-4efa-a969-17efb17e9c0b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 43, 'up_thru': 260, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6808', 'nonce': 3724399458}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6809', 'nonce': 3724399458}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6811', 'nonce': 3724399458}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6810', 'nonce': 3724399458}]}, 'public_addr': '172.21.15.71:6808/3724399458', 'cluster_addr': '172.21.15.71:6809/3724399458', 'heartbeat_back_addr': '172.21.15.71:6811/3724399458', 'heartbeat_front_addr': '172.21.15.71:6810/3724399458', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '9778a0e9-2ff3-4700-bf2a-675edaba630b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 50, 'up_thru': 260, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6812', 'nonce': 163573852}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6813', 'nonce': 163573852}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6815', 'nonce': 163573852}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6814', 'nonce': 163573852}]}, 'public_addr': '172.21.15.71:6812/163573852', 'cluster_addr': '172.21.15.71:6813/163573852', 'heartbeat_back_addr': '172.21.15.71:6815/163573852', 'heartbeat_front_addr': '172.21.15.71:6814/163573852', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-10T08:28:22.780623+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-10T08:28:21.823427+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-10T08:28:40.683154+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-10T08:27:24.861119+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-10T08:28:47.640800+0000', 'dead_epoch': 87}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-10T08:28:19.557537+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-10T08:27:42.023943+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-10T08:28:18.048412+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [{'pgid': '2.5', 'mappings': [{'from': 7, 'to': 2}]}, {'pgid': '4.7', 'mappings': [{'from': 1, 'to': 7}]}, {'pgid': '4.d', 'mappings': [{'from': 1, 'to': 5}]}, {'pgid': '4.f', 'mappings': [{'from': 1, 'to': 2}]}, {'pgid': '4.12', 'mappings': [{'from': 1, 'to': 0}]}, {'pgid': '4.13', 'mappings': [{'from': 1, 'to': 2}]}, {'pgid': '5.1b', 'mappings': [{'from': 0, 'to': 6}]}, {'pgid': '6.0', 'mappings': [{'from': 2, 'to': 1}]}, {'pgid': '6.4', 'mappings': [{'from': 6, 'to': 3}]}, {'pgid': '6.8', 'mappings': [{'from': 2, 'to': 4}]}, {'pgid': '6.f', 'mappings': [{'from': 2, 'to': 0}]}, {'pgid': '6.14', 'mappings': [{'from': 2, 'to': 0}, {'from': 7, 'to': 5}]}, {'pgid': '6.23', 'mappings': [{'from': 6, 'to': 0}]}], 'pg_temp': [], 'primary_temp': [], 'blocklist': {'172.21.15.18:6800/542054629': '2024-02-11T08:17:16.433947+0000', '172.21.15.18:0/491217791': '2024-02-11T08:17:16.433947+0000', '172.21.15.18:0/781076548': '2024-02-11T08:17:16.433947+0000', '172.21.15.18:0/957318754': '2024-02-11T08:17:16.433947+0000', '172.21.15.18:0/2662732452': '2024-02-11T08:11:55.105124+0000', '172.21.15.18:0/1407788916': '2024-02-11T08:11:55.105124+0000', '172.21.15.18:6800/3798687064': '2024-02-11T08:11:55.105124+0000', '172.21.15.18:6800/3570839557': '2024-02-11T08:11:31.445897+0000', '172.21.15.18:0/541168116': '2024-02-11T08:11:31.445897+0000', '172.21.15.18:0/806236095': '2024-02-11T08:11:31.445897+0000'}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'ruleset-failure-domain': 'osd', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-02-10T08:28:55.248 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph pg dump --format=json 2024-02-10T08:28:55.293 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:28:55.341 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:28:55.406 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:55.547 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:28:55.549 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:55.550 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:28:55.650 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:28:55.695 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:55.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:54.821028+0000 mgr.y (mgr.14505) 458 : cluster [DBG] pgmap v554: 158 pgs: 158 active+clean; 2.1 GiB data, 8.4 GiB used, 707 GiB / 715 GiB avail; 1.4 KiB/s rd, 121 MiB/s wr, 1.94k op/s 2024-02-10T08:28:55.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:55.733884+0000 mon.a (mon.0) 1314 : cluster [DBG] osdmap e267: 8 total, 8 up, 8 in 2024-02-10T08:28:55.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:54.821028+0000 mgr.y (mgr.14505) 458 : cluster [DBG] pgmap v554: 158 pgs: 158 active+clean; 2.1 GiB data, 8.4 GiB used, 707 GiB / 715 GiB avail; 1.4 KiB/s rd, 121 MiB/s wr, 1.94k op/s 2024-02-10T08:28:55.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:55.733884+0000 mon.a (mon.0) 1314 : cluster [DBG] osdmap e267: 8 total, 8 up, 8 in 2024-02-10T08:28:56.042 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:54.821028+0000 mgr.y (mgr.14505) 458 : cluster [DBG] pgmap v554: 158 pgs: 158 active+clean; 2.1 GiB data, 8.4 GiB used, 707 GiB / 715 GiB avail; 1.4 KiB/s rd, 121 MiB/s wr, 1.94k op/s 2024-02-10T08:28:56.042 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:55.733884+0000 mon.a (mon.0) 1314 : cluster [DBG] osdmap e267: 8 total, 8 up, 8 in 2024-02-10T08:28:56.141 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 18 16 39987 39971 138.735 99.9375 0.00598004 0.0072025 2024-02-10T08:28:56.153 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:28:56.161 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:56.161 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:28:56.262 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:28:56.320 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:56.425 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:28:56.427 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:28:56.432 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-10T08:28:56.436 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:56.436 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:28:56.537 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:28:56.597 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:56.715 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:28:56.720 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:28:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:28:56] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:28:56.721 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:56.721 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:28:56.767 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-02-10T08:28:56.767 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-02-10T08:28:56.767 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-02-10T08:28:56.767 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-02-10T08:28:56.768 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.768 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14784.0:80184 7.1 7.387e6e81 (undecoded) ondisk+write+known_if_redirected e110)", 2024-02-10T08:28:56.768 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:20:45.408455+0000", 2024-02-10T08:28:56.768 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 491.35548453799998, 2024-02-10T08:28:56.768 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.98005964300000004, 2024-02-10T08:28:56.768 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:28:56.768 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-02-10T08:28:56.768 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:28:56.768 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14784", 2024-02-10T08:28:56.768 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:28:56.768 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 80184 2024-02-10T08:28:56.768 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.768 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:28:56.768 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.769 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:28:56.769 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:45.408455+0000", 2024-02-10T08:28:56.769 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:28:56.769 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.769 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.769 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:28:56.769 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:45.408455+0000", 2024-02-10T08:28:56.769 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999981 2024-02-10T08:28:56.769 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.769 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.769 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:28:56.769 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:45.408453+0000", 2024-02-10T08:28:56.769 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000121824 2024-02-10T08:28:56.769 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.769 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.770 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:28:56.770 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:45.408575+0000", 2024-02-10T08:28:56.770 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8460000000000008e-06 2024-02-10T08:28:56.770 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.770 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.770 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:28:56.770 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:45.408583+0000", 2024-02-10T08:28:56.770 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6969999999999996e-06 2024-02-10T08:28:56.770 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.770 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.770 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:28:56.770 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:45.408590+0000", 2024-02-10T08:28:56.770 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014614782999999999 2024-02-10T08:28:56.770 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.770 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.770 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:56.771 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:45.423205+0000", 2024-02-10T08:28:56.771 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7460000000000003e-06 2024-02-10T08:28:56.771 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.771 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.771 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:28:56.771 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:45.423211+0000", 2024-02-10T08:28:56.771 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.96529285099999995 2024-02-10T08:28:56.771 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.771 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.771 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:56.771 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:46.388504+0000", 2024-02-10T08:28:56.771 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0871e-05 2024-02-10T08:28:56.771 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.771 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.771 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:28:56.771 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:46.388515+0000", 2024-02-10T08:28:56.772 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.98005964300000004 2024-02-10T08:28:56.772 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:56.772 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:28:56.772 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:56.772 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.772 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.772 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14784.0:80191 7.1 7.11ed1e21 (undecoded) ondisk+write+known_if_redirected e110)", 2024-02-10T08:28:56.772 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:20:45.420741+0000", 2024-02-10T08:28:56.772 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 491.34319885999997, 2024-02-10T08:28:56.772 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.96781002599999999, 2024-02-10T08:28:56.772 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:28:56.772 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-02-10T08:28:56.772 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:28:56.772 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14784", 2024-02-10T08:28:56.773 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:28:56.773 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 80191 2024-02-10T08:28:56.773 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.773 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:28:56.773 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.773 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:28:56.773 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:45.420741+0000", 2024-02-10T08:28:56.773 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:28:56.773 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.773 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.773 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:28:56.773 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:45.420741+0000", 2024-02-10T08:28:56.773 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999981 2024-02-10T08:28:56.773 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.773 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.774 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:28:56.774 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:45.420739+0000", 2024-02-10T08:28:56.774 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000188326 2024-02-10T08:28:56.774 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.774 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.774 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:28:56.774 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:45.420928+0000", 2024-02-10T08:28:56.774 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5014999999999999e-05 2024-02-10T08:28:56.774 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.774 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.774 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:28:56.774 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:45.420943+0000", 2024-02-10T08:28:56.774 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1409999999999999e-05 2024-02-10T08:28:56.774 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.774 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.775 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:28:56.775 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:45.420954+0000", 2024-02-10T08:28:56.775 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022789870000000001 2024-02-10T08:28:56.775 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.775 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.775 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:56.775 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:45.423233+0000", 2024-02-10T08:28:56.775 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7879999999999998e-06 2024-02-10T08:28:56.775 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.775 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.775 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:28:56.775 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:45.423236+0000", 2024-02-10T08:28:56.775 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.96529610399999999 2024-02-10T08:28:56.775 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.775 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.775 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:56.776 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:46.388532+0000", 2024-02-10T08:28:56.776 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9151e-05 2024-02-10T08:28:56.776 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.776 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.776 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:28:56.776 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:46.388551+0000", 2024-02-10T08:28:56.776 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.96781002599999999 2024-02-10T08:28:56.776 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:56.776 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:28:56.776 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:56.776 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.776 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.776 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14784.0:80193 7.1 7.544a1061 (undecoded) ondisk+write+known_if_redirected e110)", 2024-02-10T08:28:56.776 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:20:45.426784+0000", 2024-02-10T08:28:56.777 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 491.33715568100001, 2024-02-10T08:28:56.777 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.96184494099999995, 2024-02-10T08:28:56.777 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:28:56.777 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-02-10T08:28:56.777 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:28:56.777 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14784", 2024-02-10T08:28:56.777 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:28:56.777 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 80193 2024-02-10T08:28:56.777 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.777 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:28:56.777 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.777 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:28:56.777 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:45.426784+0000", 2024-02-10T08:28:56.777 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:28:56.777 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.778 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.778 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:28:56.778 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:45.426784+0000", 2024-02-10T08:28:56.778 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-02-10T08:28:56.778 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.778 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.778 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:28:56.778 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:45.426783+0000", 2024-02-10T08:28:56.778 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000118731 2024-02-10T08:28:56.778 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.778 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.778 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:28:56.778 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:45.426902+0000", 2024-02-10T08:28:56.778 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0616e-05 2024-02-10T08:28:56.778 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.779 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.779 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:28:56.779 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:45.426912+0000", 2024-02-10T08:28:56.779 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1759999999999993e-06 2024-02-10T08:28:56.779 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.779 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.779 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:28:56.779 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:45.426920+0000", 2024-02-10T08:28:56.779 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5954999999999997e-05 2024-02-10T08:28:56.779 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.779 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.779 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:56.779 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:45.426956+0000", 2024-02-10T08:28:56.779 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5939999999999994e-06 2024-02-10T08:28:56.779 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.780 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.780 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:28:56.780 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:45.426965+0000", 2024-02-10T08:28:56.780 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.96165234200000005 2024-02-10T08:28:56.780 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.780 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.780 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:56.780 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:46.388617+0000", 2024-02-10T08:28:56.780 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1987000000000001e-05 2024-02-10T08:28:56.780 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.780 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.780 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:28:56.780 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:46.388629+0000", 2024-02-10T08:28:56.780 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.96184494099999995 2024-02-10T08:28:56.781 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:56.781 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:28:56.781 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:56.781 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.781 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.781 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14784.0:80215 7.1 7.1b16c3f1 (undecoded) ondisk+write+known_if_redirected e110)", 2024-02-10T08:28:56.781 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:20:45.449775+0000", 2024-02-10T08:28:56.781 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 491.31416510100001, 2024-02-10T08:28:56.781 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.93895518300000003, 2024-02-10T08:28:56.781 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:28:56.781 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-02-10T08:28:56.781 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:28:56.781 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14784", 2024-02-10T08:28:56.781 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:28:56.782 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 80215 2024-02-10T08:28:56.782 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.782 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:28:56.782 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.782 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:28:56.782 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:45.449775+0000", 2024-02-10T08:28:56.782 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:28:56.782 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.782 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.782 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:28:56.782 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:45.449775+0000", 2024-02-10T08:28:56.782 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999976 2024-02-10T08:28:56.782 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.782 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.782 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:28:56.782 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:45.449773+0000", 2024-02-10T08:28:56.783 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2508000000000004e-05 2024-02-10T08:28:56.783 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.783 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.783 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:28:56.783 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:45.449845+0000", 2024-02-10T08:28:56.783 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7697999999999999e-05 2024-02-10T08:28:56.783 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.783 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.783 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:28:56.783 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:45.449863+0000", 2024-02-10T08:28:56.783 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8109999999999992e-06 2024-02-10T08:28:56.783 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.783 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.783 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:28:56.783 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:45.449872+0000", 2024-02-10T08:28:56.784 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8857999999999999e-05 2024-02-10T08:28:56.784 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.784 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.784 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:56.784 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:45.449920+0000", 2024-02-10T08:28:56.784 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8970000000000002e-06 2024-02-10T08:28:56.784 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.784 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.784 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:28:56.784 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:45.449927+0000", 2024-02-10T08:28:56.784 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.93879346299999999 2024-02-10T08:28:56.784 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.784 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.784 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:56.785 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:46.388721+0000", 2024-02-10T08:28:56.785 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2949999999999999e-06 2024-02-10T08:28:56.785 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.785 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.785 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:28:56.785 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:20:46.388730+0000", 2024-02-10T08:28:56.785 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.93895518300000003 2024-02-10T08:28:56.785 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:56.785 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:28:56.785 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:56.785 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.785 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.785 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14784.0:179915 7.4 7:24d5e43a:::benchmark_data_smithi018_80623_object78987:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e163)", 2024-02-10T08:28:56.785 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:23:14.073212+0000", 2024-02-10T08:28:56.785 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 342.690727987, 2024-02-10T08:28:56.786 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.592447884, 2024-02-10T08:28:56.786 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:28:56.786 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-02-10T08:28:56.786 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:28:56.786 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14784", 2024-02-10T08:28:56.786 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:28:56.786 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 179915 2024-02-10T08:28:56.786 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.786 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:28:56.786 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.786 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:28:56.786 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:14.073212+0000", 2024-02-10T08:28:56.786 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:28:56.786 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.786 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.787 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:28:56.787 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:14.073212+0000", 2024-02-10T08:28:56.787 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999981 2024-02-10T08:28:56.787 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.787 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.787 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:28:56.787 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:14.073210+0000", 2024-02-10T08:28:56.787 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.174e-06 2024-02-10T08:28:56.787 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.787 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.787 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:28:56.787 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:14.073218+0000", 2024-02-10T08:28:56.787 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2557e-05 2024-02-10T08:28:56.787 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.787 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.787 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:28:56.787 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:14.073231+0000", 2024-02-10T08:28:56.788 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2590000000000003e-06 2024-02-10T08:28:56.788 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.788 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.788 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:28:56.788 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:14.073238+0000", 2024-02-10T08:28:56.788 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3290000000000001e-05 2024-02-10T08:28:56.788 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.788 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.788 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:56.788 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:14.073271+0000", 2024-02-10T08:28:56.788 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5659999999999997e-06 2024-02-10T08:28:56.788 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.788 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.788 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:28:56.788 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:14.073277+0000", 2024-02-10T08:28:56.789 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.99451457700000001 2024-02-10T08:28:56.789 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.789 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.789 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:56.789 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:15.067791+0000", 2024-02-10T08:28:56.789 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2490000000000001e-05 2024-02-10T08:28:56.789 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.789 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.789 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:28:56.789 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:15.067804+0000", 2024-02-10T08:28:56.789 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.59776341 2024-02-10T08:28:56.789 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.789 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.789 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:56.789 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:15.665567+0000", 2024-02-10T08:28:56.789 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2585999999999998e-05 2024-02-10T08:28:56.790 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.790 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.790 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:28:56.790 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:15.665660+0000", 2024-02-10T08:28:56.790 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.592447884 2024-02-10T08:28:56.790 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:56.790 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:28:56.790 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:56.790 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.790 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.790 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14784.0:198796 7.4 7:22684d34:::benchmark_data_smithi018_80623_object97868:head [delete] snapc 0=[] ondisk+write+known_if_redirected e173)", 2024-02-10T08:28:56.790 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:23:46.857357+0000", 2024-02-10T08:28:56.790 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 309.90658305699998, 2024-02-10T08:28:56.790 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0332809890000001, 2024-02-10T08:28:56.790 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:28:56.790 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:28:56.791 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:28:56.791 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14784", 2024-02-10T08:28:56.791 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:28:56.791 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 198796 2024-02-10T08:28:56.791 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.791 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:28:56.791 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.791 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:28:56.791 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:46.857357+0000", 2024-02-10T08:28:56.791 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:28:56.791 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.791 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.791 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:28:56.791 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:46.857357+0000", 2024-02-10T08:28:56.791 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-02-10T08:28:56.792 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.792 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.792 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:28:56.792 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:46.857355+0000", 2024-02-10T08:28:56.792 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6630000000000001e-06 2024-02-10T08:28:56.792 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.792 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.792 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:28:56.792 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:46.857360+0000", 2024-02-10T08:28:56.792 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7060000000000004e-06 2024-02-10T08:28:56.792 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.792 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.792 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:28:56.792 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:46.857368+0000", 2024-02-10T08:28:56.793 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0140000000000004e-06 2024-02-10T08:28:56.793 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.793 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.793 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:28:56.793 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:46.857374+0000", 2024-02-10T08:28:56.793 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000118694 2024-02-10T08:28:56.793 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.793 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.793 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:56.793 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:46.857493+0000", 2024-02-10T08:28:56.793 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7709999999999995e-06 2024-02-10T08:28:56.793 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.793 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.793 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:28:56.793 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:46.857501+0000", 2024-02-10T08:28:56.794 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.025651697 2024-02-10T08:28:56.794 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.794 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.794 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:56.794 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:47.883153+0000", 2024-02-10T08:28:56.794 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014673799999999999 2024-02-10T08:28:56.794 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.794 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.794 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:28:56.794 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:47.883300+0000", 2024-02-10T08:28:56.794 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000171294 2024-02-10T08:28:56.794 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.794 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.794 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1,6", 2024-02-10T08:28:56.794 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:47.883471+0000", 2024-02-10T08:28:56.794 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027453680000000002 2024-02-10T08:28:56.795 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.795 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.795 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:28:56.795 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:47.886216+0000", 2024-02-10T08:28:56.795 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0042834550000000002 2024-02-10T08:28:56.795 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.795 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.795 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:28:56.795 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:47.890500+0000", 2024-02-10T08:28:56.795 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0394000000000002e-05 2024-02-10T08:28:56.795 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.795 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.795 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:28:56.795 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:47.890590+0000", 2024-02-10T08:28:56.795 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6103000000000001e-05 2024-02-10T08:28:56.795 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.796 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.796 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:28:56.796 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:47.890616+0000", 2024-02-10T08:28:56.796 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1495e-05 2024-02-10T08:28:56.796 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.796 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.796 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:28:56.796 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:47.890638+0000", 2024-02-10T08:28:56.796 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0332809890000001 2024-02-10T08:28:56.796 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:56.796 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:28:56.796 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:56.796 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.796 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.797 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14784.0:198809 7.4 7:26595044:::benchmark_data_smithi018_80623_object97881:head [delete] snapc 0=[] ondisk+write+known_if_redirected e174)", 2024-02-10T08:28:56.797 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:23:46.875764+0000", 2024-02-10T08:28:56.797 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 309.88817619399998, 2024-02-10T08:28:56.797 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.014932765, 2024-02-10T08:28:56.797 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:28:56.797 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:28:56.797 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:28:56.797 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14784", 2024-02-10T08:28:56.797 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:28:56.797 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 198809 2024-02-10T08:28:56.797 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.797 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:28:56.797 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.797 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:28:56.797 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:46.875764+0000", 2024-02-10T08:28:56.797 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:28:56.798 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.798 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.798 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:28:56.798 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:46.875764+0000", 2024-02-10T08:28:56.798 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-02-10T08:28:56.798 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.798 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.798 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:28:56.798 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:46.875762+0000", 2024-02-10T08:28:56.798 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2409999999999998e-06 2024-02-10T08:28:56.798 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.798 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.798 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:28:56.798 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:46.875769+0000", 2024-02-10T08:28:56.798 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0829000000000001e-05 2024-02-10T08:28:56.799 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.799 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.799 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:28:56.799 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:46.875780+0000", 2024-02-10T08:28:56.799 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5010000000000001e-06 2024-02-10T08:28:56.799 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.799 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.799 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:28:56.799 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:46.875787+0000", 2024-02-10T08:28:56.799 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7899000000000003e-05 2024-02-10T08:28:56.799 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.799 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.799 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:56.799 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:46.875835+0000", 2024-02-10T08:28:56.799 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0390999999999999e-05 2024-02-10T08:28:56.799 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.800 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.800 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:28:56.800 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:46.875845+0000", 2024-02-10T08:28:56.800 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0104128109999999 2024-02-10T08:28:56.800 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.800 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.800 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:56.800 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:47.886258+0000", 2024-02-10T08:28:56.800 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6355999999999999e-05 2024-02-10T08:28:56.800 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.800 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.800 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:28:56.800 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:47.886334+0000", 2024-02-10T08:28:56.800 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2133999999999996e-05 2024-02-10T08:28:56.800 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.801 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.801 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1,6", 2024-02-10T08:28:56.801 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:47.886426+0000", 2024-02-10T08:28:56.801 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.004143463 2024-02-10T08:28:56.801 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.801 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.801 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:28:56.801 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:47.890570+0000", 2024-02-10T08:28:56.801 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6500000000000002e-06 2024-02-10T08:28:56.801 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.801 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.801 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:28:56.801 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:47.890573+0000", 2024-02-10T08:28:56.801 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5853999999999995e-05 2024-02-10T08:28:56.801 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.801 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.802 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:28:56.802 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:47.890659+0000", 2024-02-10T08:28:56.802 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9392999999999999e-05 2024-02-10T08:28:56.802 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.802 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.802 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:28:56.802 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:47.890679+0000", 2024-02-10T08:28:56.802 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7802e-05 2024-02-10T08:28:56.802 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.802 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.802 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:28:56.802 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:47.890697+0000", 2024-02-10T08:28:56.802 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.014932765 2024-02-10T08:28:56.802 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:56.802 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:28:56.803 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:56.803 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.803 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.803 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14784.0:198824 7.4 7:2c1b76cf:::benchmark_data_smithi018_80623_object97896:head [delete] snapc 0=[] ondisk+write+known_if_redirected e174)", 2024-02-10T08:28:56.803 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:23:46.903247+0000", 2024-02-10T08:28:56.803 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 309.86069279700001, 2024-02-10T08:28:56.803 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.99430549099999999, 2024-02-10T08:28:56.803 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:28:56.803 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:28:56.803 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:28:56.803 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14784", 2024-02-10T08:28:56.803 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:28:56.803 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 198824 2024-02-10T08:28:56.803 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.804 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:28:56.804 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.804 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:28:56.804 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:46.903247+0000", 2024-02-10T08:28:56.804 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:28:56.804 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.804 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.804 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:28:56.804 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:46.903247+0000", 2024-02-10T08:28:56.804 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999976 2024-02-10T08:28:56.804 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.804 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.804 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:28:56.804 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:46.903245+0000", 2024-02-10T08:28:56.804 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4849999999999992e-06 2024-02-10T08:28:56.805 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.805 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.805 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:28:56.805 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:46.903253+0000", 2024-02-10T08:28:56.805 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4219999999999999e-05 2024-02-10T08:28:56.805 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.805 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.805 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:28:56.805 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:46.903268+0000", 2024-02-10T08:28:56.805 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.285e-06 2024-02-10T08:28:56.805 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.805 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.805 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:28:56.805 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:46.903274+0000", 2024-02-10T08:28:56.805 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5284000000000002e-05 2024-02-10T08:28:56.806 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.806 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.806 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:56.806 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:46.903319+0000", 2024-02-10T08:28:56.806 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.909e-06 2024-02-10T08:28:56.806 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.806 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.806 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:28:56.806 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:46.903327+0000", 2024-02-10T08:28:56.806 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.98517790500000002 2024-02-10T08:28:56.806 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.806 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.806 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:56.806 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:47.888505+0000", 2024-02-10T08:28:56.806 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012267800000000001 2024-02-10T08:28:56.807 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.807 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.807 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:28:56.807 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:47.888628+0000", 2024-02-10T08:28:56.807 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000134127 2024-02-10T08:28:56.807 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.807 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.807 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1,6", 2024-02-10T08:28:56.807 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:47.888762+0000", 2024-02-10T08:28:56.807 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003291937 2024-02-10T08:28:56.807 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.807 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.807 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:28:56.807 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:47.892054+0000", 2024-02-10T08:28:56.807 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019566000000000002 2024-02-10T08:28:56.807 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.808 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.808 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:28:56.808 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:47.894010+0000", 2024-02-10T08:28:56.808 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034600880000000001 2024-02-10T08:28:56.808 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.808 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.808 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:28:56.808 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:47.897470+0000", 2024-02-10T08:28:56.808 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4291e-05 2024-02-10T08:28:56.808 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.808 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.808 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:28:56.808 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:47.897515+0000", 2024-02-10T08:28:56.808 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7947000000000001e-05 2024-02-10T08:28:56.808 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.808 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.809 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:28:56.809 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:47.897553+0000", 2024-02-10T08:28:56.809 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.99430549099999999 2024-02-10T08:28:56.809 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:56.809 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:28:56.809 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:56.809 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.809 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.809 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14964.0:248057 8.2 8:4e72f17a:::benchmark_data_smithi018_103312_object123625:head [delete] snapc 0=[] ondisk+write+known_if_redirected e245)", 2024-02-10T08:28:56.809 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:28:05.693964+0000", 2024-02-10T08:28:56.809 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 51.069975741, 2024-02-10T08:28:56.809 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.052030805, 2024-02-10T08:28:56.809 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:28:56.809 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-02-10T08:28:56.809 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:28:56.809 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14964", 2024-02-10T08:28:56.810 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3173131962", 2024-02-10T08:28:56.810 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 248057 2024-02-10T08:28:56.810 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.810 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:28:56.810 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.810 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:28:56.810 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.693964+0000", 2024-02-10T08:28:56.810 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:28:56.810 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.810 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.810 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:28:56.810 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.693964+0000", 2024-02-10T08:28:56.810 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-02-10T08:28:56.810 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.810 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.810 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:28:56.811 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.693963+0000", 2024-02-10T08:28:56.811 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3730000000000001e-06 2024-02-10T08:28:56.811 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.811 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.811 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:28:56.811 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.693968+0000", 2024-02-10T08:28:56.811 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0090000000000007e-06 2024-02-10T08:28:56.811 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.811 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.811 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:28:56.811 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.693976+0000", 2024-02-10T08:28:56.811 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5800000000000002e-06 2024-02-10T08:28:56.811 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.811 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.811 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:28:56.811 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.693981+0000", 2024-02-10T08:28:56.812 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7899999999999999e-05 2024-02-10T08:28:56.812 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.812 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.812 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:56.812 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.694028+0000", 2024-02-10T08:28:56.812 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7101999999999995e-05 2024-02-10T08:28:56.812 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.812 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.812 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:28:56.812 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.694106+0000", 2024-02-10T08:28:56.812 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000118226 2024-02-10T08:28:56.812 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.812 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.812 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,5,6", 2024-02-10T08:28:56.813 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.694224+0000", 2024-02-10T08:28:56.813 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002449241 2024-02-10T08:28:56.813 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.813 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.813 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:28:56.813 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.696673+0000", 2024-02-10T08:28:56.813 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00086247799999999996 2024-02-10T08:28:56.813 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.813 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.813 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:28:56.813 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.697536+0000", 2024-02-10T08:28:56.813 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0023925589999999998 2024-02-10T08:28:56.813 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.813 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.813 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:28:56.814 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.699928+0000", 2024-02-10T08:28:56.814 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.046928281000000002 2024-02-10T08:28:56.814 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.814 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.814 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:56.814 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.746856+0000", 2024-02-10T08:28:56.814 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9709999999999999e-06 2024-02-10T08:28:56.814 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.814 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.814 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:28:56.814 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.746866+0000", 2024-02-10T08:28:56.814 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.99905785800000002 2024-02-10T08:28:56.814 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.814 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.814 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:56.815 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.745924+0000", 2024-02-10T08:28:56.815 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0840000000000006e-05 2024-02-10T08:28:56.815 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.815 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.815 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:28:56.815 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.745995+0000", 2024-02-10T08:28:56.815 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.052030805 2024-02-10T08:28:56.815 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:56.815 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:28:56.815 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:56.815 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.815 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.815 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14964.0:248073 8.2 8:4ee22618:::benchmark_data_smithi018_103312_object123641:head [delete] snapc 0=[] ondisk+write+known_if_redirected e245)", 2024-02-10T08:28:56.815 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:28:05.704023+0000", 2024-02-10T08:28:56.815 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 51.059917263999999, 2024-02-10T08:28:56.815 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.042410608, 2024-02-10T08:28:56.816 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:28:56.816 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-02-10T08:28:56.816 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:28:56.816 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14964", 2024-02-10T08:28:56.816 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3173131962", 2024-02-10T08:28:56.816 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 248073 2024-02-10T08:28:56.816 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.816 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:28:56.816 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.816 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:28:56.816 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.704023+0000", 2024-02-10T08:28:56.816 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:28:56.816 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.816 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.817 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:28:56.817 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.704023+0000", 2024-02-10T08:28:56.817 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-02-10T08:28:56.817 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.817 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.817 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:28:56.817 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.704021+0000", 2024-02-10T08:28:56.817 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5389999999999998e-06 2024-02-10T08:28:56.817 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.817 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.817 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:28:56.817 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.704027+0000", 2024-02-10T08:28:56.817 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8890000000000008e-06 2024-02-10T08:28:56.817 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.818 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.818 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:28:56.818 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.704036+0000", 2024-02-10T08:28:56.818 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.685e-06 2024-02-10T08:28:56.818 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.818 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.818 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:28:56.818 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.704040+0000", 2024-02-10T08:28:56.818 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.769e-05 2024-02-10T08:28:56.818 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.818 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.818 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:56.818 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.704078+0000", 2024-02-10T08:28:56.818 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1235000000000006e-05 2024-02-10T08:28:56.818 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.819 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.819 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:28:56.819 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.704139+0000", 2024-02-10T08:28:56.819 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0595999999999998e-05 2024-02-10T08:28:56.819 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.819 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.819 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,5,6", 2024-02-10T08:28:56.819 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.704230+0000", 2024-02-10T08:28:56.819 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001779709 2024-02-10T08:28:56.819 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.819 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.819 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:28:56.819 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.706010+0000", 2024-02-10T08:28:56.819 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00038055700000000001 2024-02-10T08:28:56.819 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.820 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.820 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:28:56.820 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.706390+0000", 2024-02-10T08:28:56.820 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.040501199000000002 2024-02-10T08:28:56.820 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.820 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.820 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:56.820 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.746891+0000", 2024-02-10T08:28:56.820 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7619999999999998e-06 2024-02-10T08:28:56.820 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.820 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.820 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:28:56.820 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.746898+0000", 2024-02-10T08:28:56.820 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.99947289299999997 2024-02-10T08:28:56.821 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.821 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.821 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:56.821 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.746371+0000", 2024-02-10T08:28:56.821 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2255999999999995e-05 2024-02-10T08:28:56.821 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.821 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.821 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:28:56.821 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.746433+0000", 2024-02-10T08:28:56.821 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.042410608 2024-02-10T08:28:56.821 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:56.821 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:28:56.821 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:56.821 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.821 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.822 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14964.0:248083 8.2 8:46df8c5c:::benchmark_data_smithi018_103312_object123651:head [delete] snapc 0=[] ondisk+write+known_if_redirected e246)", 2024-02-10T08:28:56.822 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:28:05.757882+0000", 2024-02-10T08:28:56.822 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 51.006057941999998, 2024-02-10T08:28:56.822 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.998812272, 2024-02-10T08:28:56.822 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:28:56.822 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:28:56.822 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:28:56.822 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14964", 2024-02-10T08:28:56.822 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3173131962", 2024-02-10T08:28:56.822 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 248083 2024-02-10T08:28:56.822 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.822 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:28:56.822 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.822 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:28:56.822 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.757882+0000", 2024-02-10T08:28:56.823 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:28:56.823 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.823 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.823 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:28:56.823 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.757882+0000", 2024-02-10T08:28:56.823 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-02-10T08:28:56.823 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.823 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.823 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:28:56.823 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.757880+0000", 2024-02-10T08:28:56.823 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8690000000000004e-06 2024-02-10T08:28:56.823 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.823 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.823 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:28:56.823 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.757888+0000", 2024-02-10T08:28:56.824 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0769e-05 2024-02-10T08:28:56.824 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.824 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.824 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:28:56.824 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.757899+0000", 2024-02-10T08:28:56.824 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3820000000000001e-06 2024-02-10T08:28:56.824 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.824 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.824 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:28:56.824 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.757905+0000", 2024-02-10T08:28:56.824 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020590790000000001 2024-02-10T08:28:56.824 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.824 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.824 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:56.824 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.759964+0000", 2024-02-10T08:28:56.825 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4420000000000003e-06 2024-02-10T08:28:56.825 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.825 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.825 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:28:56.825 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.759971+0000", 2024-02-10T08:28:56.825 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.98650727599999999 2024-02-10T08:28:56.825 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.825 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.825 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:56.825 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.746478+0000", 2024-02-10T08:28:56.825 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7355999999999995e-05 2024-02-10T08:28:56.825 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.825 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.825 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:28:56.825 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.746566+0000", 2024-02-10T08:28:56.826 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000132349 2024-02-10T08:28:56.826 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.826 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.826 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,5", 2024-02-10T08:28:56.826 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.746698+0000", 2024-02-10T08:28:56.826 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.009744862 2024-02-10T08:28:56.826 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.826 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.826 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:28:56.826 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.756443+0000", 2024-02-10T08:28:56.826 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000110237 2024-02-10T08:28:56.826 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.826 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.826 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:28:56.826 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.756553+0000", 2024-02-10T08:28:56.827 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7463999999999999e-05 2024-02-10T08:28:56.827 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.827 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.827 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:28:56.827 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.756590+0000", 2024-02-10T08:28:56.827 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5776000000000003e-05 2024-02-10T08:28:56.827 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.827 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.827 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:28:56.827 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.756646+0000", 2024-02-10T08:28:56.827 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8031999999999997e-05 2024-02-10T08:28:56.827 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.827 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.827 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:28:56.827 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.756694+0000", 2024-02-10T08:28:56.827 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.998812272 2024-02-10T08:28:56.828 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:56.828 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:28:56.828 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:56.828 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.828 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.828 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14964.0:248088 8.2 8:49a01a71:::benchmark_data_smithi018_103312_object123656:head [delete] snapc 0=[] ondisk+write+known_if_redirected e246)", 2024-02-10T08:28:56.828 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:28:05.761595+0000", 2024-02-10T08:28:56.828 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 51.002344761000003, 2024-02-10T08:28:56.828 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0063328789999999, 2024-02-10T08:28:56.828 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:28:56.828 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:28:56.828 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:28:56.828 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14964", 2024-02-10T08:28:56.828 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3173131962", 2024-02-10T08:28:56.829 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 248088 2024-02-10T08:28:56.829 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.829 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:28:56.829 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.829 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:28:56.829 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.761595+0000", 2024-02-10T08:28:56.829 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:28:56.829 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.829 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.829 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:28:56.829 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.761595+0000", 2024-02-10T08:28:56.829 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999981 2024-02-10T08:28:56.829 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.829 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.829 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:28:56.830 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.761593+0000", 2024-02-10T08:28:56.830 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1060000000000002e-06 2024-02-10T08:28:56.830 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.830 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.830 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:28:56.830 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.761600+0000", 2024-02-10T08:28:56.830 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4027e-05 2024-02-10T08:28:56.830 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.830 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.830 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:28:56.830 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.761614+0000", 2024-02-10T08:28:56.830 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2310000000000001e-06 2024-02-10T08:28:56.830 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.830 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.830 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:28:56.830 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.761621+0000", 2024-02-10T08:28:56.830 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2810000000000002e-05 2024-02-10T08:28:56.831 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.831 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.831 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:56.831 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.761704+0000", 2024-02-10T08:28:56.831 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0910000000000004e-06 2024-02-10T08:28:56.831 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.831 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:28:56.832 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.832 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:28:56.832 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.761711+0000", 2024-02-10T08:28:56.832 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.98744357800000004 2024-02-10T08:28:56.833 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.833 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.833 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:56.833 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.749154+0000", 2024-02-10T08:28:56.833 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000117133 2024-02-10T08:28:56.833 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.833 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.833 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:28:56.833 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.749271+0000", 2024-02-10T08:28:56.833 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014030999999999999 2024-02-10T08:28:56.833 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.833 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.833 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,5", 2024-02-10T08:28:56.833 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.749412+0000", 2024-02-10T08:28:56.834 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0070370900000000002 2024-02-10T08:28:56.834 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.834 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.834 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:28:56.834 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.756449+0000", 2024-02-10T08:28:56.834 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00031059499999999999 2024-02-10T08:28:56.834 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.834 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.834 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:28:56.834 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.756759+0000", 2024-02-10T08:28:56.834 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011094645 2024-02-10T08:28:56.834 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.834 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.834 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:28:56.834 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.767854+0000", 2024-02-10T08:28:56.835 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3083999999999997e-05 2024-02-10T08:28:56.835 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.835 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.835 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:28:56.835 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.767887+0000", 2024-02-10T08:28:56.835 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1014999999999999e-05 2024-02-10T08:28:56.835 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.835 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.835 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:28:56.835 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.767928+0000", 2024-02-10T08:28:56.835 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0063328789999999 2024-02-10T08:28:56.835 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:56.835 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:28:56.835 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:56.835 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.836 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.836 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14964.0:248091 8.2 8:4c7eb95c:::benchmark_data_smithi018_103312_object123659:head [delete] snapc 0=[] ondisk+write+known_if_redirected e246)", 2024-02-10T08:28:56.836 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:28:05.761631+0000", 2024-02-10T08:28:56.836 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 51.002308781000004, 2024-02-10T08:28:56.836 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.00641921, 2024-02-10T08:28:56.836 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:28:56.836 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:28:56.836 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:28:56.836 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14964", 2024-02-10T08:28:56.836 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3173131962", 2024-02-10T08:28:56.836 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 248091 2024-02-10T08:28:56.836 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.836 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:28:56.836 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.837 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:28:56.837 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.761631+0000", 2024-02-10T08:28:56.837 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:28:56.837 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.837 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.837 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:28:56.837 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.761631+0000", 2024-02-10T08:28:56.837 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-02-10T08:28:56.837 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.837 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.837 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:28:56.837 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.761631+0000", 2024-02-10T08:28:56.837 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8459999999999999e-06 2024-02-10T08:28:56.837 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.837 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.838 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:28:56.838 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.761634+0000", 2024-02-10T08:28:56.838 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4830000000000001e-06 2024-02-10T08:28:56.838 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.838 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.838 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:28:56.838 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.761638+0000", 2024-02-10T08:28:56.838 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6500000000000002e-06 2024-02-10T08:28:56.838 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.838 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.838 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:28:56.838 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.761642+0000", 2024-02-10T08:28:56.838 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9600999999999998e-05 2024-02-10T08:28:56.838 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.838 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.838 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:56.838 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.761731+0000", 2024-02-10T08:28:56.839 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.758e-06 2024-02-10T08:28:56.839 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.839 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.839 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:28:56.839 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.761736+0000", 2024-02-10T08:28:56.839 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.98969200099999999 2024-02-10T08:28:56.839 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.839 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.839 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:56.839 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.751428+0000", 2024-02-10T08:28:56.839 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000120124 2024-02-10T08:28:56.839 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.839 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.839 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:28:56.839 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.751548+0000", 2024-02-10T08:28:56.840 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000141521 2024-02-10T08:28:56.840 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.840 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.840 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,5", 2024-02-10T08:28:56.840 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.751690+0000", 2024-02-10T08:28:56.840 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.005081548 2024-02-10T08:28:56.840 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.840 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.840 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:28:56.840 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.756771+0000", 2024-02-10T08:28:56.840 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0066599099999999998 2024-02-10T08:28:56.840 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.840 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.840 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:28:56.840 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.763431+0000", 2024-02-10T08:28:56.841 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0045568830000000003 2024-02-10T08:28:56.841 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.841 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.841 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:28:56.841 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.767988+0000", 2024-02-10T08:28:56.841 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7288e-05 2024-02-10T08:28:56.841 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.841 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.841 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:28:56.841 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.768015+0000", 2024-02-10T08:28:56.841 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5055999999999998e-05 2024-02-10T08:28:56.841 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.841 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.841 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:28:56.841 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.768050+0000", 2024-02-10T08:28:56.841 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.00641921 2024-02-10T08:28:56.842 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:56.842 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:28:56.842 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:56.842 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.842 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.842 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14964.0:248100 8.2 8:4b40f43c:::benchmark_data_smithi018_103312_object123668:head [delete] snapc 0=[] ondisk+write+known_if_redirected e246)", 2024-02-10T08:28:56.842 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:28:05.766872+0000", 2024-02-10T08:28:56.842 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 50.997067739000002, 2024-02-10T08:28:56.842 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0052526770000001, 2024-02-10T08:28:56.842 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:28:56.842 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:28:56.842 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:28:56.842 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14964", 2024-02-10T08:28:56.842 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3173131962", 2024-02-10T08:28:56.842 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 248100 2024-02-10T08:28:56.842 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.842 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:28:56.843 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.843 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:28:56.843 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.766872+0000", 2024-02-10T08:28:56.843 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:28:56.843 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.843 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.843 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:28:56.843 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.766872+0000", 2024-02-10T08:28:56.843 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999976 2024-02-10T08:28:56.843 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.843 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.843 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:28:56.843 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.766870+0000", 2024-02-10T08:28:56.843 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6980000000000004e-06 2024-02-10T08:28:56.843 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.843 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.844 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:28:56.844 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.766878+0000", 2024-02-10T08:28:56.844 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2524000000000001e-05 2024-02-10T08:28:56.844 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.844 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.844 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:28:56.844 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.766891+0000", 2024-02-10T08:28:56.844 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4880000000000004e-06 2024-02-10T08:28:56.844 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.844 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.844 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:28:56.844 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.766897+0000", 2024-02-10T08:28:56.844 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8500000000000001e-05 2024-02-10T08:28:56.844 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.844 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.845 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:56.845 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.766936+0000", 2024-02-10T08:28:56.845 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1559999999999995e-06 2024-02-10T08:28:56.845 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.845 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.845 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:28:56.845 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.766944+0000", 2024-02-10T08:28:56.845 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.98716463899999995 2024-02-10T08:28:56.845 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.845 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.845 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:56.845 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.754109+0000", 2024-02-10T08:28:56.845 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000117099 2024-02-10T08:28:56.845 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.845 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.846 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:28:56.846 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.754226+0000", 2024-02-10T08:28:56.846 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000117209 2024-02-10T08:28:56.846 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.846 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.846 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,5", 2024-02-10T08:28:56.846 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.754343+0000", 2024-02-10T08:28:56.846 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0090969559999999998 2024-02-10T08:28:56.846 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.846 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.846 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:28:56.846 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.763440+0000", 2024-02-10T08:28:56.846 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0575999999999997e-05 2024-02-10T08:28:56.846 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.846 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.846 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:28:56.847 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.763500+0000", 2024-02-10T08:28:56.847 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0085535490000000006 2024-02-10T08:28:56.847 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.847 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.847 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:28:56.847 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.772054+0000", 2024-02-10T08:28:56.847 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9388000000000003e-05 2024-02-10T08:28:56.847 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.847 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.847 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:28:56.847 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.772093+0000", 2024-02-10T08:28:56.847 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1488000000000001e-05 2024-02-10T08:28:56.847 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.847 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.847 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:28:56.847 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.772125+0000", 2024-02-10T08:28:56.848 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0052526770000001 2024-02-10T08:28:56.848 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:56.848 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:28:56.848 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:56.848 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.848 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.848 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14964.0:248116 8.2 8:43faa874:::benchmark_data_smithi018_103312_object123684:head [delete] snapc 0=[] ondisk+write+known_if_redirected e246)", 2024-02-10T08:28:56.848 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:28:05.779908+0000", 2024-02-10T08:28:56.848 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 50.984032104999997, 2024-02-10T08:28:56.848 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.99236875400000002, 2024-02-10T08:28:56.848 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:28:56.848 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:28:56.848 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:28:56.848 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14964", 2024-02-10T08:28:56.849 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3173131962", 2024-02-10T08:28:56.849 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 248116 2024-02-10T08:28:56.849 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.849 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:28:56.849 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.849 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:28:56.849 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.779908+0000", 2024-02-10T08:28:56.849 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:28:56.849 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.849 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.849 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:28:56.849 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.779908+0000", 2024-02-10T08:28:56.849 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999981 2024-02-10T08:28:56.849 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.849 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.850 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:28:56.850 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.779906+0000", 2024-02-10T08:28:56.850 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6060000000000003e-06 2024-02-10T08:28:56.850 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.850 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.850 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:28:56.850 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.779915+0000", 2024-02-10T08:28:56.850 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2882e-05 2024-02-10T08:28:56.850 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.850 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.850 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:28:56.850 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.779927+0000", 2024-02-10T08:28:56.850 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7289999999999997e-06 2024-02-10T08:28:56.850 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.850 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.851 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:28:56.851 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.779933+0000", 2024-02-10T08:28:56.851 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8353000000000003e-05 2024-02-10T08:28:56.851 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.851 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.851 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:56.851 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.779982+0000", 2024-02-10T08:28:56.851 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9389999999999997e-06 2024-02-10T08:28:56.851 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.851 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.851 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:28:56.851 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.779990+0000", 2024-02-10T08:28:56.851 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.97681177500000005 2024-02-10T08:28:56.851 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.851 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.852 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:56.852 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.756801+0000", 2024-02-10T08:28:56.852 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5612999999999995e-05 2024-02-10T08:28:56.852 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.852 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.852 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:28:56.852 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.756887+0000", 2024-02-10T08:28:56.852 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000127556 2024-02-10T08:28:56.852 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.852 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.852 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,5", 2024-02-10T08:28:56.852 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.757014+0000", 2024-02-10T08:28:56.852 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0064331609999999997 2024-02-10T08:28:56.852 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.852 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.853 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:28:56.853 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.763448+0000", 2024-02-10T08:28:56.853 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000101436 2024-02-10T08:28:56.853 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.853 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.853 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:28:56.853 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.763549+0000", 2024-02-10T08:28:56.853 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0086278940000000005 2024-02-10T08:28:56.853 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.853 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.853 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:28:56.853 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.772177+0000", 2024-02-10T08:28:56.853 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5106999999999999e-05 2024-02-10T08:28:56.853 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.853 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.853 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:28:56.853 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.772232+0000", 2024-02-10T08:28:56.854 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4549999999999999e-05 2024-02-10T08:28:56.854 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.854 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.854 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:28:56.854 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.772277+0000", 2024-02-10T08:28:56.854 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.99236875400000002 2024-02-10T08:28:56.854 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:56.854 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:28:56.854 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:56.854 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.854 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.854 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14964.0:248129 8.2 8:452c0cb6:::benchmark_data_smithi018_103312_object123697:head [delete] snapc 0=[] ondisk+write+known_if_redirected e246)", 2024-02-10T08:28:56.854 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:28:05.791081+0000", 2024-02-10T08:28:56.854 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 50.972859051, 2024-02-10T08:28:56.854 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.98137006800000004, 2024-02-10T08:28:56.855 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:28:56.855 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:28:56.855 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:28:56.855 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14964", 2024-02-10T08:28:56.855 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3173131962", 2024-02-10T08:28:56.855 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 248129 2024-02-10T08:28:56.855 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.855 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:28:56.855 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.855 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:28:56.855 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.791081+0000", 2024-02-10T08:28:56.855 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:28:56.855 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.855 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.855 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:28:56.855 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.791081+0000", 2024-02-10T08:28:56.856 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999981 2024-02-10T08:28:56.856 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.856 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.856 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:28:56.856 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.791079+0000", 2024-02-10T08:28:56.856 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3000000000000007e-06 2024-02-10T08:28:56.856 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.856 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.856 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:28:56.856 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.791088+0000", 2024-02-10T08:28:56.856 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5789000000000001e-05 2024-02-10T08:28:56.856 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.856 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.856 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:28:56.856 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.791104+0000", 2024-02-10T08:28:56.857 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9880000000000004e-06 2024-02-10T08:28:56.857 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.857 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.857 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:28:56.857 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.791112+0000", 2024-02-10T08:28:56.857 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9119999999999997e-05 2024-02-10T08:28:56.857 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.857 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.857 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:56.857 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.791161+0000", 2024-02-10T08:28:56.857 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.61e-06 2024-02-10T08:28:56.857 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.857 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.857 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:28:56.857 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.791169+0000", 2024-02-10T08:28:56.857 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.967802096 2024-02-10T08:28:56.857 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.858 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.858 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:56.858 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.758971+0000", 2024-02-10T08:28:56.858 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012134 2024-02-10T08:28:56.858 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.858 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.858 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:28:56.858 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.759092+0000", 2024-02-10T08:28:56.858 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000166587 2024-02-10T08:28:56.858 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.858 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.858 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,5", 2024-02-10T08:28:56.858 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.759259+0000", 2024-02-10T08:28:56.858 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0042996700000000002 2024-02-10T08:28:56.858 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.858 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.859 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:28:56.859 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.763558+0000", 2024-02-10T08:28:56.859 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0042235479999999997 2024-02-10T08:28:56.859 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.859 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.859 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:28:56.859 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.767782+0000", 2024-02-10T08:28:56.859 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00458348 2024-02-10T08:28:56.859 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.859 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.859 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:28:56.859 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.772365+0000", 2024-02-10T08:28:56.859 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2488999999999999e-05 2024-02-10T08:28:56.859 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.859 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.860 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:28:56.860 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.772408+0000", 2024-02-10T08:28:56.860 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3130999999999998e-05 2024-02-10T08:28:56.860 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.860 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.860 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:28:56.860 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.772451+0000", 2024-02-10T08:28:56.860 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.98137006800000004 2024-02-10T08:28:56.860 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:56.860 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:28:56.860 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:56.860 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.860 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.860 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14964.0:248131 8.2 8:47baaa1d:::benchmark_data_smithi018_103312_object123699:head [delete] snapc 0=[] ondisk+write+known_if_redirected e246)", 2024-02-10T08:28:56.861 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:28:05.791610+0000", 2024-02-10T08:28:56.861 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 50.972329610000003, 2024-02-10T08:28:56.861 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.980974915, 2024-02-10T08:28:56.861 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:28:56.861 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:28:56.861 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:28:56.861 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14964", 2024-02-10T08:28:56.861 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3173131962", 2024-02-10T08:28:56.861 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 248131 2024-02-10T08:28:56.861 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.861 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:28:56.861 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.861 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:28:56.861 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.791610+0000", 2024-02-10T08:28:56.861 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:28:56.861 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.861 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.862 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:28:56.862 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.791610+0000", 2024-02-10T08:28:56.862 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-02-10T08:28:56.862 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.862 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.862 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:28:56.862 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.791609+0000", 2024-02-10T08:28:56.862 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6760000000000007e-06 2024-02-10T08:28:56.862 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.862 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.862 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:28:56.862 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.791617+0000", 2024-02-10T08:28:56.862 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7079999999999992e-06 2024-02-10T08:28:56.862 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.862 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.862 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:28:56.863 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.791627+0000", 2024-02-10T08:28:56.863 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.541e-06 2024-02-10T08:28:56.863 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.863 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.863 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:28:56.863 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.791632+0000", 2024-02-10T08:28:56.863 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8720000000000002e-05 2024-02-10T08:28:56.863 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.863 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.863 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:56.863 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.791671+0000", 2024-02-10T08:28:56.863 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4399999999999999e-06 2024-02-10T08:28:56.863 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.863 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.863 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:28:56.864 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.791679+0000", 2024-02-10T08:28:56.864 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.96969679900000005 2024-02-10T08:28:56.864 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.864 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.864 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:56.864 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.761375+0000", 2024-02-10T08:28:56.864 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1136000000000004e-05 2024-02-10T08:28:56.864 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.864 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.864 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:28:56.864 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.761456+0000", 2024-02-10T08:28:56.864 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5643999999999994e-05 2024-02-10T08:28:56.864 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.864 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.864 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,5", 2024-02-10T08:28:56.865 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.761552+0000", 2024-02-10T08:28:56.865 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0062639540000000004 2024-02-10T08:28:56.865 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.865 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.865 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:28:56.865 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.767816+0000", 2024-02-10T08:28:56.865 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2410000000000003e-06 2024-02-10T08:28:56.865 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.865 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.865 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:28:56.865 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.767821+0000", 2024-02-10T08:28:56.865 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0046872989999999998 2024-02-10T08:28:56.865 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.865 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.865 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:28:56.865 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.772509+0000", 2024-02-10T08:28:56.865 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8896999999999997e-05 2024-02-10T08:28:56.866 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.866 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.866 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:28:56.866 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.772548+0000", 2024-02-10T08:28:56.866 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7755e-05 2024-02-10T08:28:56.866 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.866 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.866 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:28:56.866 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.772585+0000", 2024-02-10T08:28:56.866 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.980974915 2024-02-10T08:28:56.866 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:56.866 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:28:56.866 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:56.866 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.866 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.866 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14964.0:248132 8.2 8:466b5f6d:::benchmark_data_smithi018_103312_object123700:head [delete] snapc 0=[] ondisk+write+known_if_redirected e246)", 2024-02-10T08:28:56.867 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:28:05.792646+0000", 2024-02-10T08:28:56.867 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 50.971293457000002, 2024-02-10T08:28:56.867 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.98001702000000002, 2024-02-10T08:28:56.867 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:28:56.867 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:28:56.867 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:28:56.867 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14964", 2024-02-10T08:28:56.867 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3173131962", 2024-02-10T08:28:56.867 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 248132 2024-02-10T08:28:56.867 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.867 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:28:56.867 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.867 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:28:56.867 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.792646+0000", 2024-02-10T08:28:56.867 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:28:56.868 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.868 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.868 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:28:56.868 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.792646+0000", 2024-02-10T08:28:56.868 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-02-10T08:28:56.868 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.868 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.868 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:28:56.868 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.792645+0000", 2024-02-10T08:28:56.868 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7680000000000003e-06 2024-02-10T08:28:56.868 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.868 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.868 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:28:56.868 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.792652+0000", 2024-02-10T08:28:56.868 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4893999999999999e-05 2024-02-10T08:28:56.869 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.869 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.869 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:28:56.869 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.792677+0000", 2024-02-10T08:28:56.869 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9406999999999999e-05 2024-02-10T08:28:56.869 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.869 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.869 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:28:56.869 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.792696+0000", 2024-02-10T08:28:56.869 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2664999999999999e-05 2024-02-10T08:28:56.869 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.869 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.869 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:56.869 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.792739+0000", 2024-02-10T08:28:56.869 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8729999999999996e-06 2024-02-10T08:28:56.869 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.869 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.870 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:28:56.870 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.792748+0000", 2024-02-10T08:28:56.870 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.97084718299999995 2024-02-10T08:28:56.870 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.870 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.870 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:56.870 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.763595+0000", 2024-02-10T08:28:56.870 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000118204 2024-02-10T08:28:56.870 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.870 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.870 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:28:56.870 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.763713+0000", 2024-02-10T08:28:56.870 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000132204 2024-02-10T08:28:56.870 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.871 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.871 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,5", 2024-02-10T08:28:56.871 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.763846+0000", 2024-02-10T08:28:56.871 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0039800360000000002 2024-02-10T08:28:56.871 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.871 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.871 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:28:56.871 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.767826+0000", 2024-02-10T08:28:56.871 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013412799999999999 2024-02-10T08:28:56.871 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.871 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.871 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:28:56.871 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.767960+0000", 2024-02-10T08:28:56.871 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.004659168 2024-02-10T08:28:56.871 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.871 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.872 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:28:56.872 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.772619+0000", 2024-02-10T08:28:56.872 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2050000000000001e-05 2024-02-10T08:28:56.872 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.872 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.872 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:28:56.872 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.772641+0000", 2024-02-10T08:28:56.872 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2549999999999999e-05 2024-02-10T08:28:56.872 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.872 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.872 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:28:56.872 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.772664+0000", 2024-02-10T08:28:56.872 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.98001702000000002 2024-02-10T08:28:56.872 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:56.873 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:28:56.873 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:56.873 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.873 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.873 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14964.0:248144 8.2 8:4f90dedb:::benchmark_data_smithi018_103312_object123712:head [delete] snapc 0=[] ondisk+write+known_if_redirected e246)", 2024-02-10T08:28:56.873 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:28:05.802281+0000", 2024-02-10T08:28:56.873 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 50.961659183999998, 2024-02-10T08:28:56.873 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.97045722099999998, 2024-02-10T08:28:56.873 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:28:56.873 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:28:56.873 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:28:56.873 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14964", 2024-02-10T08:28:56.873 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3173131962", 2024-02-10T08:28:56.873 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 248144 2024-02-10T08:28:56.873 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.874 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:28:56.874 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.874 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:28:56.874 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.802281+0000", 2024-02-10T08:28:56.874 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:28:56.874 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.874 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.874 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:28:56.874 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.802281+0000", 2024-02-10T08:28:56.874 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-02-10T08:28:56.874 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.874 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.874 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:28:56.874 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.802280+0000", 2024-02-10T08:28:56.874 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6210000000000001e-06 2024-02-10T08:28:56.875 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.875 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.875 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:28:56.875 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.802284+0000", 2024-02-10T08:28:56.875 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1051e-05 2024-02-10T08:28:56.875 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.875 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.875 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:28:56.875 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.802295+0000", 2024-02-10T08:28:56.875 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3449999999999999e-06 2024-02-10T08:28:56.875 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.875 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.875 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:28:56.875 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.802299+0000", 2024-02-10T08:28:56.875 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4619999999999997e-05 2024-02-10T08:28:56.875 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.876 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.876 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:56.876 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.802334+0000", 2024-02-10T08:28:56.876 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9179999999999999e-06 2024-02-10T08:28:56.876 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.876 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.876 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:28:56.876 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.802340+0000", 2024-02-10T08:28:56.876 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.96321955400000003 2024-02-10T08:28:56.876 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.876 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.876 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:56.876 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.765559+0000", 2024-02-10T08:28:56.876 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010735599999999999 2024-02-10T08:28:56.877 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.877 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.877 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:28:56.877 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.765667+0000", 2024-02-10T08:28:56.877 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012933399999999999 2024-02-10T08:28:56.877 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.877 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.877 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,5", 2024-02-10T08:28:56.877 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.765796+0000", 2024-02-10T08:28:56.877 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022901380000000002 2024-02-10T08:28:56.877 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.877 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.877 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:28:56.877 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.768086+0000", 2024-02-10T08:28:56.877 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0620000000000002e-06 2024-02-10T08:28:56.878 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.878 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.878 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:28:56.878 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.768090+0000", 2024-02-10T08:28:56.878 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0046063450000000004 2024-02-10T08:28:56.878 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.878 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.878 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:28:56.878 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.772696+0000", 2024-02-10T08:28:56.878 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1688999999999999e-05 2024-02-10T08:28:56.878 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.878 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.878 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:28:56.878 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.772718+0000", 2024-02-10T08:28:56.878 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9809e-05 2024-02-10T08:28:56.878 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.879 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.879 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:28:56.879 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.772738+0000", 2024-02-10T08:28:56.879 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.97045722099999998 2024-02-10T08:28:56.879 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:56.879 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:28:56.879 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:56.879 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.879 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.879 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14964.0:248182 8.2 8:4f280a8e:::benchmark_data_smithi018_103312_object123750:head [delete] snapc 0=[] ondisk+write+known_if_redirected e246)", 2024-02-10T08:28:56.879 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:28:05.841816+0000", 2024-02-10T08:28:56.879 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 50.922123704000001, 2024-02-10T08:28:56.879 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.94176548999999998, 2024-02-10T08:28:56.879 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:28:56.879 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:28:56.880 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:28:56.880 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14964", 2024-02-10T08:28:56.880 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3173131962", 2024-02-10T08:28:56.880 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 248182 2024-02-10T08:28:56.880 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.880 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:28:56.880 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.880 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:28:56.880 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.841816+0000", 2024-02-10T08:28:56.880 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:28:56.880 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.880 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.880 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:28:56.880 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.841816+0000", 2024-02-10T08:28:56.880 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-02-10T08:28:56.881 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.881 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.881 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:28:56.881 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.841816+0000", 2024-02-10T08:28:56.881 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.805e-06 2024-02-10T08:28:56.881 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.881 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.881 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:28:56.881 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.841819+0000", 2024-02-10T08:28:56.881 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4107999999999999e-05 2024-02-10T08:28:56.881 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.881 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.881 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:28:56.881 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.841833+0000", 2024-02-10T08:28:56.881 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2329999999999997e-06 2024-02-10T08:28:56.881 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.882 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.882 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:28:56.882 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.841839+0000", 2024-02-10T08:28:56.882 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2190999999999997e-05 2024-02-10T08:28:56.882 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.882 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.882 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:56.882 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.841871+0000", 2024-02-10T08:28:56.882 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7100000000000004e-06 2024-02-10T08:28:56.882 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.882 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.882 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:28:56.882 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.841877+0000", 2024-02-10T08:28:56.882 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.92622769500000002 2024-02-10T08:28:56.883 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.883 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.883 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:28:56.883 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.768104+0000", 2024-02-10T08:28:56.883 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000116035 2024-02-10T08:28:56.883 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.883 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.883 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:28:56.883 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.768220+0000", 2024-02-10T08:28:56.883 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000117858 2024-02-10T08:28:56.883 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.883 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.883 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,5", 2024-02-10T08:28:56.883 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.768338+0000", 2024-02-10T08:28:56.883 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0039479229999999999 2024-02-10T08:28:56.883 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.883 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.884 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:28:56.884 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.772286+0000", 2024-02-10T08:28:56.884 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6256e-05 2024-02-10T08:28:56.884 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.884 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.884 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:28:56.884 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.772322+0000", 2024-02-10T08:28:56.884 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011191141 2024-02-10T08:28:56.884 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.884 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.884 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:28:56.884 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.783514+0000", 2024-02-10T08:28:56.884 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2993000000000001e-05 2024-02-10T08:28:56.884 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.884 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.885 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:28:56.885 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.783547+0000", 2024-02-10T08:28:56.885 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5218000000000001e-05 2024-02-10T08:28:56.885 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:28:56.885 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:28:56.885 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:28:56.885 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.783582+0000", 2024-02-10T08:28:56.885 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.94176548999999998 2024-02-10T08:28:56.885 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:56.885 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:28:56.885 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:56.885 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:28:56.885 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:28:56.885 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-02-10T08:28:56.939 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:57.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:55.279844+0000 osd.3 (osd.3) 101 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:28:57.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:55.279910+0000 osd.3 (osd.3) 102 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:28:57.141 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 19 16 41546 41530 136.562 97.4375 0.0114963 0.00731636 2024-02-10T08:28:57.153 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:55.279844+0000 osd.3 (osd.3) 101 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:28:57.153 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:55.279910+0000 osd.3 (osd.3) 102 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:28:57.153 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:28:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:28:57] "GET /metrics HTTP/1.1" 200 176167 "" "Prometheus/2.33.4" 2024-02-10T08:28:57.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:55.279844+0000 osd.3 (osd.3) 101 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:28:57.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:55.279910+0000 osd.3 (osd.3) 102 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:28:57.550 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.0 dump_ops_in_flight 2024-02-10T08:28:57.794 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:56.825342+0000 mgr.y (mgr.14505) 459 : cluster [DBG] pgmap v556: 158 pgs: 158 active+clean; 2.1 GiB data, 8.6 GiB used, 707 GiB / 715 GiB avail; 841 B/s rd, 98 MiB/s wr, 1.57k op/s 2024-02-10T08:28:57.864 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:28:58.001 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:28:58.008 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:58.008 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:28:58.109 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:28:58.141 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:2024-02-10T08:28:58.141435+0000 min lat: 0.00124578 max lat: 0.076288 avg lat: 0.00741104 2024-02-10T08:28:58.141 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-02-10T08:28:58.141 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 20 16 43180 43164 134.84 102.125 0.0124171 0.00741104 2024-02-10T08:28:58.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:56.825342+0000 mgr.y (mgr.14505) 459 : cluster [DBG] pgmap v556: 158 pgs: 158 active+clean; 2.1 GiB data, 8.6 GiB used, 707 GiB / 715 GiB avail; 841 B/s rd, 98 MiB/s wr, 1.57k op/s 2024-02-10T08:28:58.158 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:58.202 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:56.825342+0000 mgr.y (mgr.14505) 459 : cluster [DBG] pgmap v556: 158 pgs: 158 active+clean; 2.1 GiB data, 8.6 GiB used, 707 GiB / 715 GiB avail; 841 B/s rd, 98 MiB/s wr, 1.57k op/s 2024-02-10T08:28:58.267 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:28:58.270 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:58.270 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:28:58.371 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:28:58.416 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:58.445 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:28:58.451 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:58.452 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:28:58.539 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:28:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:28:58.553 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:28:58.597 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:58.631 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:28:58.638 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:58.639 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:28:58.739 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:28:58.792 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:58.823 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:28:58.827 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:58.828 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:28:58.929 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:28:58.992 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:59.041 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:28:58.202159+0000 mgr.y (mgr.14505) 460 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:28:59.110 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:28:59.115 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:59.115 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:28:59.117 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:28:58.202159+0000 mgr.y (mgr.14505) 460 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:28:59.117 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:28:58.202159+0000 mgr.y (mgr.14505) 460 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:28:59.141 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 21 16 44761 44745 133.124 98.8125 0.0105652 0.0075064 2024-02-10T08:28:59.216 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:28:59.273 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:59.386 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:28:59.395 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:59.396 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:28:59.497 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:28:59.535 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:59.558 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:28:59.564 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:28:59.567 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:59.568 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:28:59.642 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:28:59.653 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-02-10T08:28:59.669 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:28:59.714 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:59.747 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:28:59.748 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:59.748 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:28:59.849 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:28:59.887 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:28:59.915 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:28:59.922 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:28:59.923 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:29:00.024 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:29:00.078 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:00.078 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:28:59 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:28:58.826175+0000 mgr.y (mgr.14505) 461 : cluster [DBG] pgmap v557: 158 pgs: 158 active+clean; 2.6 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 1.2 KiB/s rd, 133 MiB/s wr, 2.14k op/s 2024-02-10T08:29:00.110 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:29:00.132 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:00.132 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:29:00.141 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 22 16 46167 46151 131.067 87.875 0.00896848 0.00762468 2024-02-10T08:29:00.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:28:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:28:58.826175+0000 mgr.y (mgr.14505) 461 : cluster [DBG] pgmap v557: 158 pgs: 158 active+clean; 2.6 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 1.2 KiB/s rd, 133 MiB/s wr, 2.14k op/s 2024-02-10T08:29:00.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:28:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:28:58.826175+0000 mgr.y (mgr.14505) 461 : cluster [DBG] pgmap v557: 158 pgs: 158 active+clean; 2.6 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 1.2 KiB/s rd, 133 MiB/s wr, 2.14k op/s 2024-02-10T08:29:00.233 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:29:00.282 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:00.631 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":557,"stamp":"2024-02-10T08:28:58.825507+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2767328926,"num_objects":42418,"num_object_clones":0,"num_object_copies":127254,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42418,"num_whiteouts":0,"num_read":1833,"num_read_kb":1585,"num_write":42940,"num_write_kb":2702505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":144,"num_bytes_recovered":5780,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43055,"ondisk_log_size":43055,"up":474,"acting":474,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":474,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":10485120,"kb_used_data":8020672,"kb_used_omap":0,"kb_used_meta":2464383,"kb_avail":739476096,"statfs":{"total":767960285184,"available":757223522304,"internally_reserved":0,"allocated":8213168128,"data_stored":8209576180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":972,"internal_metadata":2523528244},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,10,4,3],"upper_bound":16},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1120534528,"num_objects":17098,"num_object_clones":0,"num_object_copies":51294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17098,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":17098,"num_write_kb":1094272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.006081"},"pg_stats":[{"pgid":"6.29","version":"76'2","reported_seq":196,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.772204+0000","last_change":"2024-02-10T08:28:02.797804+0000","last_active":"2024-02-10T08:28:51.772204+0000","last_peered":"2024-02-10T08:28:51.772204+0000","last_clean":"2024-02-10T08:28:51.772204+0000","last_became_active":"2024-02-10T08:28:02.767822+0000","last_became_peered":"2024-02-10T08:28:02.767822+0000","last_unstale":"2024-02-10T08:28:51.772204+0000","last_undegraded":"2024-02-10T08:28:51.772204+0000","last_fullsized":"2024-02-10T08:28:51.772204+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":6,"last_scrub":"76'2","last_scrub_stamp":"2024-02-10T08:19:28.458129+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2024-02-10T08:18:08.680038+0000","last_clean_scrub_stamp":"2024-02-10T08:19:28.458129+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":26,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,0],"acting":[7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":238,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.767487+0000","last_change":"2024-02-10T08:26:32.121942+0000","last_active":"2024-02-10T08:28:51.767487+0000","last_peered":"2024-02-10T08:28:51.767487+0000","last_clean":"2024-02-10T08:28:51.767487+0000","last_became_active":"2024-02-10T08:22:00.578118+0000","last_became_peered":"2024-02-10T08:22:00.578118+0000","last_unstale":"2024-02-10T08:28:51.767487+0000","last_undegraded":"2024-02-10T08:28:51.767487+0000","last_fullsized":"2024-02-10T08:28:51.767487+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:26:32.121852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:26:32.121852+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,6],"acting":[2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":157,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.776662+0000","last_change":"2024-02-10T08:26:16.187219+0000","last_active":"2024-02-10T08:28:51.776662+0000","last_peered":"2024-02-10T08:28:51.776662+0000","last_clean":"2024-02-10T08:28:51.776662+0000","last_became_active":"2024-02-10T08:23:15.079456+0000","last_became_peered":"2024-02-10T08:23:15.079456+0000","last_unstale":"2024-02-10T08:28:51.776662+0000","last_undegraded":"2024-02-10T08:28:51.776662+0000","last_fullsized":"2024-02-10T08:28:51.776662+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:26:16.187117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:26:16.187117+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":152,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.769176+0000","last_change":"2024-02-10T08:23:15.077790+0000","last_active":"2024-02-10T08:28:51.769176+0000","last_peered":"2024-02-10T08:28:51.769176+0000","last_clean":"2024-02-10T08:28:51.769176+0000","last_became_active":"2024-02-10T08:23:15.077457+0000","last_became_peered":"2024-02-10T08:23:15.077457+0000","last_unstale":"2024-02-10T08:28:51.769176+0000","last_undegraded":"2024-02-10T08:28:51.769176+0000","last_fullsized":"2024-02-10T08:28:51.769176+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:18:47.116727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:18:47.116727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":258,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.778835+0000","last_change":"2024-02-10T08:27:27.711007+0000","last_active":"2024-02-10T08:28:51.778835+0000","last_peered":"2024-02-10T08:28:51.778835+0000","last_clean":"2024-02-10T08:28:51.778835+0000","last_became_active":"2024-02-10T08:27:27.710587+0000","last_became_peered":"2024-02-10T08:27:27.710587+0000","last_unstale":"2024-02-10T08:28:51.778835+0000","last_undegraded":"2024-02-10T08:28:51.778835+0000","last_fullsized":"2024-02-10T08:28:51.778835+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:26:24.287556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:11.750537+0000","last_clean_scrub_stamp":"2024-02-10T08:26:24.287556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,1],"acting":[6,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":248,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.767834+0000","last_change":"2024-02-10T08:26:31.874813+0000","last_active":"2024-02-10T08:28:51.767834+0000","last_peered":"2024-02-10T08:28:51.767834+0000","last_clean":"2024-02-10T08:28:51.767834+0000","last_became_active":"2024-02-10T08:23:15.064896+0000","last_became_peered":"2024-02-10T08:23:15.064896+0000","last_unstale":"2024-02-10T08:28:51.767834+0000","last_undegraded":"2024-02-10T08:28:51.767834+0000","last_fullsized":"2024-02-10T08:28:51.767834+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:26:31.874732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:26:31.874732+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":132,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.776097+0000","last_change":"2024-02-10T08:28:25.999666+0000","last_active":"2024-02-10T08:28:51.776097+0000","last_peered":"2024-02-10T08:28:51.776097+0000","last_clean":"2024-02-10T08:28:51.776097+0000","last_became_active":"2024-02-10T08:28:25.999335+0000","last_became_peered":"2024-02-10T08:28:25.999335+0000","last_unstale":"2024-02-10T08:28:51.776097+0000","last_undegraded":"2024-02-10T08:28:51.776097+0000","last_fullsized":"2024-02-10T08:28:51.776097+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:25:31.052800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:25:31.052800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":148,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.776050+0000","last_change":"2024-02-10T08:26:15.206596+0000","last_active":"2024-02-10T08:28:51.776050+0000","last_peered":"2024-02-10T08:28:51.776050+0000","last_clean":"2024-02-10T08:28:51.776050+0000","last_became_active":"2024-02-10T08:22:00.600200+0000","last_became_peered":"2024-02-10T08:22:00.600200+0000","last_unstale":"2024-02-10T08:28:51.776050+0000","last_undegraded":"2024-02-10T08:28:51.776050+0000","last_fullsized":"2024-02-10T08:28:51.776050+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:26:15.206506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:26:15.206506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1],"acting":[6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":157,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.772139+0000","last_change":"2024-02-10T08:28:38.233240+0000","last_active":"2024-02-10T08:28:51.772139+0000","last_peered":"2024-02-10T08:28:51.772139+0000","last_clean":"2024-02-10T08:28:51.772139+0000","last_became_active":"2024-02-10T08:28:38.232920+0000","last_became_peered":"2024-02-10T08:28:38.232920+0000","last_unstale":"2024-02-10T08:28:51.772139+0000","last_undegraded":"2024-02-10T08:28:51.772139+0000","last_fullsized":"2024-02-10T08:28:51.772139+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:18.099177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:18.099177+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,1],"acting":[7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":143,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.769075+0000","last_change":"2024-02-10T08:22:00.586057+0000","last_active":"2024-02-10T08:28:51.769075+0000","last_peered":"2024-02-10T08:28:51.769075+0000","last_clean":"2024-02-10T08:28:51.769075+0000","last_became_active":"2024-02-10T08:22:00.581772+0000","last_became_peered":"2024-02-10T08:22:00.581772+0000","last_unstale":"2024-02-10T08:28:51.769075+0000","last_undegraded":"2024-02-10T08:28:51.769075+0000","last_fullsized":"2024-02-10T08:28:51.769075+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:18.940944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:20:18.940944+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,7],"acting":[1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":150,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.772750+0000","last_change":"2024-02-10T08:24:43.055548+0000","last_active":"2024-02-10T08:28:51.772750+0000","last_peered":"2024-02-10T08:28:51.772750+0000","last_clean":"2024-02-10T08:28:51.772750+0000","last_became_active":"2024-02-10T08:23:15.079180+0000","last_became_peered":"2024-02-10T08:23:15.079180+0000","last_unstale":"2024-02-10T08:28:51.772750+0000","last_undegraded":"2024-02-10T08:28:51.772750+0000","last_fullsized":"2024-02-10T08:28:51.772750+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:43.055477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:24:43.055477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":52,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.777500+0000","last_change":"2024-02-10T08:28:38.236663+0000","last_active":"2024-02-10T08:28:51.777500+0000","last_peered":"2024-02-10T08:28:51.777500+0000","last_clean":"2024-02-10T08:28:51.777500+0000","last_became_active":"2024-02-10T08:28:38.236371+0000","last_became_peered":"2024-02-10T08:28:38.236371+0000","last_unstale":"2024-02-10T08:28:51.777500+0000","last_undegraded":"2024-02-10T08:28:51.777500+0000","last_fullsized":"2024-02-10T08:28:51.777500+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:25:31.222880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:25:31.222880+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,2],"acting":[6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":192,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.773207+0000","last_change":"2024-02-10T08:28:31.264421+0000","last_active":"2024-02-10T08:28:51.773207+0000","last_peered":"2024-02-10T08:28:51.773207+0000","last_clean":"2024-02-10T08:28:51.773207+0000","last_became_active":"2024-02-10T08:23:34.723324+0000","last_became_peered":"2024-02-10T08:23:34.723324+0000","last_unstale":"2024-02-10T08:28:51.773207+0000","last_undegraded":"2024-02-10T08:28:51.773207+0000","last_fullsized":"2024-02-10T08:28:51.773207+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:31.264352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:28:31.264352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"225'27","reported_seq":271,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.767214+0000","last_change":"2024-02-10T08:28:02.959656+0000","last_active":"2024-02-10T08:28:51.767214+0000","last_peered":"2024-02-10T08:28:51.767214+0000","last_clean":"2024-02-10T08:28:51.767214+0000","last_became_active":"2024-02-10T08:28:02.789308+0000","last_became_peered":"2024-02-10T08:28:02.789308+0000","last_unstale":"2024-02-10T08:28:51.767214+0000","last_undegraded":"2024-02-10T08:28:51.767214+0000","last_fullsized":"2024-02-10T08:28:51.767214+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'15","last_scrub_stamp":"2024-02-10T08:25:29.198605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:25:29.198605+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":207,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-02-10T08:28:50.739499+0000","last_change":"2024-02-10T08:25:29.279322+0000","last_active":"2024-02-10T08:28:50.739499+0000","last_peered":"2024-02-10T08:28:50.739499+0000","last_clean":"2024-02-10T08:28:50.739499+0000","last_became_active":"2024-02-10T08:20:46.405314+0000","last_became_peered":"2024-02-10T08:20:46.405314+0000","last_unstale":"2024-02-10T08:28:50.739499+0000","last_undegraded":"2024-02-10T08:28:50.739499+0000","last_fullsized":"2024-02-10T08:28:50.739499+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:25:29.279228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:25:29.279228+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":232,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.767889+0000","last_change":"2024-02-10T08:28:24.450504+0000","last_active":"2024-02-10T08:28:51.767889+0000","last_peered":"2024-02-10T08:28:51.767889+0000","last_clean":"2024-02-10T08:28:51.767889+0000","last_became_active":"2024-02-10T08:16:56.863353+0000","last_became_peered":"2024-02-10T08:16:56.863353+0000","last_unstale":"2024-02-10T08:28:51.767889+0000","last_undegraded":"2024-02-10T08:28:51.767889+0000","last_fullsized":"2024-02-10T08:28:51.767889+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:24.450350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:28:24.450350+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":128,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.768607+0000","last_change":"2024-02-10T08:28:15.255199+0000","last_active":"2024-02-10T08:28:51.768607+0000","last_peered":"2024-02-10T08:28:51.768607+0000","last_clean":"2024-02-10T08:28:51.768607+0000","last_became_active":"2024-02-10T08:23:15.074301+0000","last_became_peered":"2024-02-10T08:23:15.074301+0000","last_unstale":"2024-02-10T08:28:51.768607+0000","last_undegraded":"2024-02-10T08:28:51.768607+0000","last_fullsized":"2024-02-10T08:28:51.768607+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:15.255132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:28:15.255132+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"225'15","reported_seq":231,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-02-10T08:28:50.738290+0000","last_change":"2024-02-10T08:25:40.109924+0000","last_active":"2024-02-10T08:28:50.738290+0000","last_peered":"2024-02-10T08:28:50.738290+0000","last_clean":"2024-02-10T08:28:50.738290+0000","last_became_active":"2024-02-10T08:20:46.404966+0000","last_became_peered":"2024-02-10T08:20:46.404966+0000","last_unstale":"2024-02-10T08:28:50.738290+0000","last_undegraded":"2024-02-10T08:28:50.738290+0000","last_fullsized":"2024-02-10T08:28:50.738290+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'9","last_scrub_stamp":"2024-02-10T08:25:40.109819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:25:40.109819+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":238,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.767297+0000","last_change":"2024-02-10T08:25:34.794346+0000","last_active":"2024-02-10T08:28:51.767297+0000","last_peered":"2024-02-10T08:28:51.767297+0000","last_clean":"2024-02-10T08:28:51.767297+0000","last_became_active":"2024-02-10T08:23:15.125955+0000","last_became_peered":"2024-02-10T08:23:15.125955+0000","last_unstale":"2024-02-10T08:28:51.767297+0000","last_undegraded":"2024-02-10T08:28:51.767297+0000","last_fullsized":"2024-02-10T08:28:51.767297+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:25:34.794249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:25:34.794249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,2],"acting":[5,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":251,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.772474+0000","last_change":"2024-02-10T08:28:38.278860+0000","last_active":"2024-02-10T08:28:51.772474+0000","last_peered":"2024-02-10T08:28:51.772474+0000","last_clean":"2024-02-10T08:28:51.772474+0000","last_became_active":"2024-02-10T08:20:46.406783+0000","last_became_peered":"2024-02-10T08:20:46.406783+0000","last_unstale":"2024-02-10T08:28:51.772474+0000","last_undegraded":"2024-02-10T08:28:51.772474+0000","last_fullsized":"2024-02-10T08:28:51.772474+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:38.278752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:28:38.278752+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"55'1","reported_seq":268,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.773817+0000","last_change":"2024-02-10T08:28:02.870043+0000","last_active":"2024-02-10T08:28:51.773817+0000","last_peered":"2024-02-10T08:28:51.773817+0000","last_clean":"2024-02-10T08:28:51.773817+0000","last_became_active":"2024-02-10T08:28:02.761299+0000","last_became_peered":"2024-02-10T08:28:02.761299+0000","last_unstale":"2024-02-10T08:28:51.773817+0000","last_undegraded":"2024-02-10T08:28:51.773817+0000","last_fullsized":"2024-02-10T08:28:51.773817+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'1","last_scrub_stamp":"2024-02-10T08:27:18.293859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:27:18.293859+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1746,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"225'7","reported_seq":263,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-02-10T08:28:50.738329+0000","last_change":"2024-02-10T08:27:27.742734+0000","last_active":"2024-02-10T08:28:50.738329+0000","last_peered":"2024-02-10T08:28:50.738329+0000","last_clean":"2024-02-10T08:28:50.738329+0000","last_became_active":"2024-02-10T08:27:27.715306+0000","last_became_peered":"2024-02-10T08:27:27.715306+0000","last_unstale":"2024-02-10T08:28:50.738329+0000","last_undegraded":"2024-02-10T08:28:50.738329+0000","last_fullsized":"2024-02-10T08:28:50.738329+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'7","last_scrub_stamp":"2024-02-10T08:27:19.895566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:27:19.895566+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":9,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":122,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.771473+0000","last_change":"2024-02-10T08:27:19.250964+0000","last_active":"2024-02-10T08:28:51.771473+0000","last_peered":"2024-02-10T08:28:51.771473+0000","last_clean":"2024-02-10T08:28:51.771473+0000","last_became_active":"2024-02-10T08:23:15.078168+0000","last_became_peered":"2024-02-10T08:23:15.078168+0000","last_unstale":"2024-02-10T08:28:51.771473+0000","last_undegraded":"2024-02-10T08:28:51.771473+0000","last_fullsized":"2024-02-10T08:28:51.771473+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:27:19.250878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:27:19.250878+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,2],"acting":[1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":263,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.768003+0000","last_change":"2024-02-10T08:28:19.065496+0000","last_active":"2024-02-10T08:28:51.768003+0000","last_peered":"2024-02-10T08:28:51.768003+0000","last_clean":"2024-02-10T08:28:51.768003+0000","last_became_active":"2024-02-10T08:28:19.065132+0000","last_became_peered":"2024-02-10T08:28:19.065132+0000","last_unstale":"2024-02-10T08:28:51.768003+0000","last_undegraded":"2024-02-10T08:28:51.768003+0000","last_fullsized":"2024-02-10T08:28:51.768003+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:26:24.860467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:26:24.860467+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,7],"acting":[5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":235,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.772783+0000","last_change":"2024-02-10T08:25:41.322590+0000","last_active":"2024-02-10T08:28:51.772783+0000","last_peered":"2024-02-10T08:28:51.772783+0000","last_clean":"2024-02-10T08:28:51.772783+0000","last_became_active":"2024-02-10T08:16:52.787865+0000","last_became_peered":"2024-02-10T08:16:52.787865+0000","last_unstale":"2024-02-10T08:28:51.772783+0000","last_undegraded":"2024-02-10T08:28:51.772783+0000","last_fullsized":"2024-02-10T08:28:51.772783+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:25:41.322493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:28.028556+0000","last_clean_scrub_stamp":"2024-02-10T08:25:41.322493+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"225'15","reported_seq":258,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.776066+0000","last_change":"2024-02-10T08:28:38.236952+0000","last_active":"2024-02-10T08:28:51.776066+0000","last_peered":"2024-02-10T08:28:51.776066+0000","last_clean":"2024-02-10T08:28:51.776066+0000","last_became_active":"2024-02-10T08:28:38.226796+0000","last_became_peered":"2024-02-10T08:28:38.226796+0000","last_unstale":"2024-02-10T08:28:51.776066+0000","last_undegraded":"2024-02-10T08:28:51.776066+0000","last_fullsized":"2024-02-10T08:28:51.776066+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'9","last_scrub_stamp":"2024-02-10T08:26:23.981840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:26:23.981840+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":146,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.777003+0000","last_change":"2024-02-10T08:28:27.516339+0000","last_active":"2024-02-10T08:28:51.777003+0000","last_peered":"2024-02-10T08:28:51.777003+0000","last_clean":"2024-02-10T08:28:51.777003+0000","last_became_active":"2024-02-10T08:22:23.526229+0000","last_became_peered":"2024-02-10T08:22:23.526229+0000","last_unstale":"2024-02-10T08:28:51.777003+0000","last_undegraded":"2024-02-10T08:28:51.777003+0000","last_fullsized":"2024-02-10T08:28:51.777003+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:27.516251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:27.516251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":209,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-02-10T08:28:50.738743+0000","last_change":"2024-02-10T08:26:26.889748+0000","last_active":"2024-02-10T08:28:50.738743+0000","last_peered":"2024-02-10T08:28:50.738743+0000","last_clean":"2024-02-10T08:28:50.738743+0000","last_became_active":"2024-02-10T08:20:46.398532+0000","last_became_peered":"2024-02-10T08:20:46.398532+0000","last_unstale":"2024-02-10T08:28:50.738743+0000","last_undegraded":"2024-02-10T08:28:50.738743+0000","last_fullsized":"2024-02-10T08:28:50.738743+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:26:26.889655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:26:26.889655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":150,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.773029+0000","last_change":"2024-02-10T08:26:14.128513+0000","last_active":"2024-02-10T08:28:51.773029+0000","last_peered":"2024-02-10T08:28:51.773029+0000","last_clean":"2024-02-10T08:28:51.773029+0000","last_became_active":"2024-02-10T08:23:34.728772+0000","last_became_peered":"2024-02-10T08:23:34.728772+0000","last_unstale":"2024-02-10T08:28:51.773029+0000","last_undegraded":"2024-02-10T08:28:51.773029+0000","last_fullsized":"2024-02-10T08:28:51.773029+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:26:14.128447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:26:14.128447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1d","version":"226'23","reported_seq":221,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.769139+0000","last_change":"2024-02-10T08:24:29.544596+0000","last_active":"2024-02-10T08:28:51.769139+0000","last_peered":"2024-02-10T08:28:51.769139+0000","last_clean":"2024-02-10T08:28:51.769139+0000","last_became_active":"2024-02-10T08:23:34.710443+0000","last_became_peered":"2024-02-10T08:23:34.710443+0000","last_unstale":"2024-02-10T08:28:51.769139+0000","last_undegraded":"2024-02-10T08:28:51.769139+0000","last_fullsized":"2024-02-10T08:28:51.769139+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'17","last_scrub_stamp":"2024-02-10T08:24:29.544422+0000","last_deep_scrub":"74'17","last_deep_scrub_stamp":"2024-02-10T08:18:02.949298+0000","last_clean_scrub_stamp":"2024-02-10T08:24:29.544422+0000","log_size":23,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":25,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,6],"acting":[1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":207,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-02-10T08:28:50.739405+0000","last_change":"2024-02-10T08:25:32.229735+0000","last_active":"2024-02-10T08:28:50.739405+0000","last_peered":"2024-02-10T08:28:50.739405+0000","last_clean":"2024-02-10T08:28:50.739405+0000","last_became_active":"2024-02-10T08:20:46.403378+0000","last_became_peered":"2024-02-10T08:20:46.403378+0000","last_unstale":"2024-02-10T08:28:50.739405+0000","last_undegraded":"2024-02-10T08:28:50.739405+0000","last_fullsized":"2024-02-10T08:28:50.739405+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:25:32.229648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:25:32.229648+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":260,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.769323+0000","last_change":"2024-02-10T08:28:02.763876+0000","last_active":"2024-02-10T08:28:51.769323+0000","last_peered":"2024-02-10T08:28:51.769323+0000","last_clean":"2024-02-10T08:28:51.769323+0000","last_became_active":"2024-02-10T08:28:02.763523+0000","last_became_peered":"2024-02-10T08:28:02.763523+0000","last_unstale":"2024-02-10T08:28:51.769323+0000","last_undegraded":"2024-02-10T08:28:51.769323+0000","last_fullsized":"2024-02-10T08:28:51.769323+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:25:28.818313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:25:28.818313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":255,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.776287+0000","last_change":"2024-02-10T08:28:33.456849+0000","last_active":"2024-02-10T08:28:51.776287+0000","last_peered":"2024-02-10T08:28:51.776287+0000","last_clean":"2024-02-10T08:28:51.776287+0000","last_became_active":"2024-02-10T08:20:46.396303+0000","last_became_peered":"2024-02-10T08:20:46.396303+0000","last_unstale":"2024-02-10T08:28:51.776287+0000","last_undegraded":"2024-02-10T08:28:51.776287+0000","last_fullsized":"2024-02-10T08:28:51.776287+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:33.456780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:10.370746+0000","last_clean_scrub_stamp":"2024-02-10T08:28:33.456780+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1c","version":"225'27","reported_seq":307,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.767634+0000","last_change":"2024-02-10T08:26:28.089083+0000","last_active":"2024-02-10T08:28:51.767634+0000","last_peered":"2024-02-10T08:28:51.767634+0000","last_clean":"2024-02-10T08:28:51.767634+0000","last_became_active":"2024-02-10T08:23:34.712669+0000","last_became_peered":"2024-02-10T08:23:34.712669+0000","last_unstale":"2024-02-10T08:28:51.767634+0000","last_undegraded":"2024-02-10T08:28:51.767634+0000","last_fullsized":"2024-02-10T08:28:51.767634+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'15","last_scrub_stamp":"2024-02-10T08:26:28.088989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:26:28.088989+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4],"acting":[2,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":240,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.768524+0000","last_change":"2024-02-10T08:24:49.507878+0000","last_active":"2024-02-10T08:28:51.768524+0000","last_peered":"2024-02-10T08:28:51.768524+0000","last_clean":"2024-02-10T08:28:51.768524+0000","last_became_active":"2024-02-10T08:20:46.408504+0000","last_became_peered":"2024-02-10T08:20:46.408504+0000","last_unstale":"2024-02-10T08:28:51.768524+0000","last_undegraded":"2024-02-10T08:28:51.768524+0000","last_fullsized":"2024-02-10T08:28:51.768524+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:49.507652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:22.104988+0000","last_clean_scrub_stamp":"2024-02-10T08:24:49.507652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":66,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.777104+0000","last_change":"2024-02-10T08:28:32.177848+0000","last_active":"2024-02-10T08:28:51.777104+0000","last_peered":"2024-02-10T08:28:51.777104+0000","last_clean":"2024-02-10T08:28:51.777104+0000","last_became_active":"2024-02-10T08:28:25.951312+0000","last_became_peered":"2024-02-10T08:28:25.951312+0000","last_unstale":"2024-02-10T08:28:51.777104+0000","last_undegraded":"2024-02-10T08:28:51.777104+0000","last_fullsized":"2024-02-10T08:28:51.777104+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:32.177772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:28:32.177772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":168,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.776304+0000","last_change":"2024-02-10T08:28:02.774298+0000","last_active":"2024-02-10T08:28:51.776304+0000","last_peered":"2024-02-10T08:28:51.776304+0000","last_clean":"2024-02-10T08:28:51.776304+0000","last_became_active":"2024-02-10T08:28:02.773857+0000","last_became_peered":"2024-02-10T08:28:02.773857+0000","last_unstale":"2024-02-10T08:28:51.776304+0000","last_undegraded":"2024-02-10T08:28:51.776304+0000","last_fullsized":"2024-02-10T08:28:51.776304+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:25:42.124914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:25:42.124914+0000","last_clean_scrub_stamp":"2024-02-10T08:25:42.124914+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2],"acting":[6,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"225'19","reported_seq":269,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.776929+0000","last_change":"2024-02-10T08:28:40.341710+0000","last_active":"2024-02-10T08:28:51.776929+0000","last_peered":"2024-02-10T08:28:51.776929+0000","last_clean":"2024-02-10T08:28:51.776929+0000","last_became_active":"2024-02-10T08:16:54.852665+0000","last_became_peered":"2024-02-10T08:16:54.852665+0000","last_unstale":"2024-02-10T08:28:51.776929+0000","last_undegraded":"2024-02-10T08:28:51.776929+0000","last_fullsized":"2024-02-10T08:28:51.776929+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'19","last_scrub_stamp":"2024-02-10T08:28:40.341641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:28:40.341641+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"87'2","reported_seq":236,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.772988+0000","last_change":"2024-02-10T08:28:37.261008+0000","last_active":"2024-02-10T08:28:51.772988+0000","last_peered":"2024-02-10T08:28:51.772988+0000","last_clean":"2024-02-10T08:28:51.772988+0000","last_became_active":"2024-02-10T08:16:58.859047+0000","last_became_peered":"2024-02-10T08:16:58.859047+0000","last_unstale":"2024-02-10T08:28:51.772988+0000","last_undegraded":"2024-02-10T08:28:51.772988+0000","last_fullsized":"2024-02-10T08:28:51.772988+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'2","last_scrub_stamp":"2024-02-10T08:28:37.260945+0000","last_deep_scrub":"87'2","last_deep_scrub_stamp":"2024-02-10T08:19:29.207531+0000","last_clean_scrub_stamp":"2024-02-10T08:28:37.260945+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"111'11","reported_seq":408,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-02-10T08:28:55.737750+0000","last_change":"2024-02-10T08:28:29.461568+0000","last_active":"2024-02-10T08:28:55.737750+0000","last_peered":"2024-02-10T08:28:55.737750+0000","last_clean":"2024-02-10T08:28:55.737750+0000","last_became_active":"2024-02-10T08:20:46.402663+0000","last_became_peered":"2024-02-10T08:20:46.402663+0000","last_unstale":"2024-02-10T08:28:55.737750+0000","last_undegraded":"2024-02-10T08:28:55.737750+0000","last_fullsized":"2024-02-10T08:28:55.737750+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'11","last_scrub_stamp":"2024-02-10T08:28:29.461499+0000","last_deep_scrub":"82'9","last_deep_scrub_stamp":"2024-02-10T08:18:36.323217+0000","last_clean_scrub_stamp":"2024-02-10T08:28:29.461499+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":250,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.767157+0000","last_change":"2024-02-10T08:27:23.161581+0000","last_active":"2024-02-10T08:28:51.767157+0000","last_peered":"2024-02-10T08:28:51.767157+0000","last_clean":"2024-02-10T08:28:51.767157+0000","last_became_active":"2024-02-10T08:20:46.392466+0000","last_became_peered":"2024-02-10T08:20:46.392466+0000","last_unstale":"2024-02-10T08:28:51.767157+0000","last_undegraded":"2024-02-10T08:28:51.767157+0000","last_fullsized":"2024-02-10T08:28:51.767157+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:27:23.161491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:30.422800+0000","last_clean_scrub_stamp":"2024-02-10T08:27:23.161491+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"225'25","reported_seq":325,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.776887+0000","last_change":"2024-02-10T08:28:38.118912+0000","last_active":"2024-02-10T08:28:51.776887+0000","last_peered":"2024-02-10T08:28:51.776887+0000","last_clean":"2024-02-10T08:28:51.776887+0000","last_became_active":"2024-02-10T08:28:25.951464+0000","last_became_peered":"2024-02-10T08:28:25.951464+0000","last_unstale":"2024-02-10T08:28:51.776887+0000","last_undegraded":"2024-02-10T08:28:51.776887+0000","last_fullsized":"2024-02-10T08:28:51.776887+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'25","last_scrub_stamp":"2024-02-10T08:28:38.118836+0000","last_deep_scrub":"74'15","last_deep_scrub_stamp":"2024-02-10T08:17:57.637346+0000","last_clean_scrub_stamp":"2024-02-10T08:28:38.118836+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":24,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":146,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.776981+0000","last_change":"2024-02-10T08:28:38.237508+0000","last_active":"2024-02-10T08:28:51.776981+0000","last_peered":"2024-02-10T08:28:51.776981+0000","last_clean":"2024-02-10T08:28:51.776981+0000","last_became_active":"2024-02-10T08:28:38.237168+0000","last_became_peered":"2024-02-10T08:28:38.237168+0000","last_unstale":"2024-02-10T08:28:51.776981+0000","last_undegraded":"2024-02-10T08:28:51.776981+0000","last_fullsized":"2024-02-10T08:28:51.776981+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:34.502781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:34.502781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,5],"acting":[6,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":246,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.773461+0000","last_change":"2024-02-10T08:25:27.291613+0000","last_active":"2024-02-10T08:28:51.773461+0000","last_peered":"2024-02-10T08:28:51.773461+0000","last_clean":"2024-02-10T08:28:51.773461+0000","last_became_active":"2024-02-10T08:20:46.399838+0000","last_became_peered":"2024-02-10T08:20:46.399838+0000","last_unstale":"2024-02-10T08:28:51.773461+0000","last_undegraded":"2024-02-10T08:28:51.773461+0000","last_fullsized":"2024-02-10T08:28:51.773461+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:25:27.291524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:25:27.291524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":240,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.776738+0000","last_change":"2024-02-10T08:28:38.361039+0000","last_active":"2024-02-10T08:28:51.776738+0000","last_peered":"2024-02-10T08:28:51.776738+0000","last_clean":"2024-02-10T08:28:51.776738+0000","last_became_active":"2024-02-10T08:16:52.788629+0000","last_became_peered":"2024-02-10T08:16:52.788629+0000","last_unstale":"2024-02-10T08:28:51.776738+0000","last_undegraded":"2024-02-10T08:28:51.776738+0000","last_fullsized":"2024-02-10T08:28:51.776738+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:38.360929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:38.360929+0000","last_clean_scrub_stamp":"2024-02-10T08:28:38.360929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"225'19","reported_seq":184,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.772363+0000","last_change":"2024-02-10T08:25:35.410198+0000","last_active":"2024-02-10T08:28:51.772363+0000","last_peered":"2024-02-10T08:28:51.772363+0000","last_clean":"2024-02-10T08:28:51.772363+0000","last_became_active":"2024-02-10T08:22:23.526198+0000","last_became_peered":"2024-02-10T08:22:23.526198+0000","last_unstale":"2024-02-10T08:28:51.772363+0000","last_undegraded":"2024-02-10T08:28:51.772363+0000","last_fullsized":"2024-02-10T08:28:51.772363+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'11","last_scrub_stamp":"2024-02-10T08:25:35.410093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:25:35.410093+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":24,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":244,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.772663+0000","last_change":"2024-02-10T08:25:31.346812+0000","last_active":"2024-02-10T08:28:51.772663+0000","last_peered":"2024-02-10T08:28:51.772663+0000","last_clean":"2024-02-10T08:28:51.772663+0000","last_became_active":"2024-02-10T08:20:46.399515+0000","last_became_peered":"2024-02-10T08:20:46.399515+0000","last_unstale":"2024-02-10T08:28:51.772663+0000","last_undegraded":"2024-02-10T08:28:51.772663+0000","last_fullsized":"2024-02-10T08:28:51.772663+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:25:31.346714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:27.276490+0000","last_clean_scrub_stamp":"2024-02-10T08:25:31.346714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":246,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.776375+0000","last_change":"2024-02-10T08:28:26.460262+0000","last_active":"2024-02-10T08:28:51.776375+0000","last_peered":"2024-02-10T08:28:51.776375+0000","last_clean":"2024-02-10T08:28:51.776375+0000","last_became_active":"2024-02-10T08:20:46.397495+0000","last_became_peered":"2024-02-10T08:20:46.397495+0000","last_unstale":"2024-02-10T08:28:51.776375+0000","last_undegraded":"2024-02-10T08:28:51.776375+0000","last_fullsized":"2024-02-10T08:28:51.776375+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:26.460158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:28:26.460158+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":240,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.768537+0000","last_change":"2024-02-10T08:25:35.807110+0000","last_active":"2024-02-10T08:28:51.768537+0000","last_peered":"2024-02-10T08:28:51.768537+0000","last_clean":"2024-02-10T08:28:51.768537+0000","last_became_active":"2024-02-10T08:16:52.788704+0000","last_became_peered":"2024-02-10T08:16:52.788704+0000","last_unstale":"2024-02-10T08:28:51.768537+0000","last_undegraded":"2024-02-10T08:28:51.768537+0000","last_fullsized":"2024-02-10T08:28:51.768537+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:25:35.807018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:25:35.807018+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"225'8","reported_seq":165,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.771998+0000","last_change":"2024-02-10T08:25:30.862232+0000","last_active":"2024-02-10T08:28:51.771998+0000","last_peered":"2024-02-10T08:28:51.771998+0000","last_clean":"2024-02-10T08:28:51.771998+0000","last_became_active":"2024-02-10T08:22:23.522936+0000","last_became_peered":"2024-02-10T08:22:23.522936+0000","last_unstale":"2024-02-10T08:28:51.771998+0000","last_undegraded":"2024-02-10T08:28:51.771998+0000","last_fullsized":"2024-02-10T08:28:51.771998+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'4","last_scrub_stamp":"2024-02-10T08:25:30.862066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:25:30.862066+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,6],"acting":[1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":150,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.767329+0000","last_change":"2024-02-10T08:28:27.240341+0000","last_active":"2024-02-10T08:28:51.767329+0000","last_peered":"2024-02-10T08:28:51.767329+0000","last_clean":"2024-02-10T08:28:51.767329+0000","last_became_active":"2024-02-10T08:23:34.710130+0000","last_became_peered":"2024-02-10T08:23:34.710130+0000","last_unstale":"2024-02-10T08:28:51.767329+0000","last_undegraded":"2024-02-10T08:28:51.767329+0000","last_fullsized":"2024-02-10T08:28:51.767329+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:27.240244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:27.240244+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":243,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.772010+0000","last_change":"2024-02-10T08:28:20.394761+0000","last_active":"2024-02-10T08:28:51.772010+0000","last_peered":"2024-02-10T08:28:51.772010+0000","last_clean":"2024-02-10T08:28:51.772010+0000","last_became_active":"2024-02-10T08:23:15.078667+0000","last_became_peered":"2024-02-10T08:23:15.078667+0000","last_unstale":"2024-02-10T08:28:51.772010+0000","last_undegraded":"2024-02-10T08:28:51.772010+0000","last_fullsized":"2024-02-10T08:28:51.772010+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:20.394696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:28:20.394696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":249,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.770226+0000","last_change":"2024-02-10T08:28:28.486997+0000","last_active":"2024-02-10T08:28:51.770226+0000","last_peered":"2024-02-10T08:28:51.770226+0000","last_clean":"2024-02-10T08:28:51.770226+0000","last_became_active":"2024-02-10T08:23:15.079635+0000","last_became_peered":"2024-02-10T08:23:15.079635+0000","last_unstale":"2024-02-10T08:28:51.770226+0000","last_undegraded":"2024-02-10T08:28:51.770226+0000","last_fullsized":"2024-02-10T08:28:51.770226+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:28.486926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:28:28.486926+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[1,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"225'24","reported_seq":274,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-02-10T08:28:50.738178+0000","last_change":"2024-02-10T08:28:35.984255+0000","last_active":"2024-02-10T08:28:50.738178+0000","last_peered":"2024-02-10T08:28:50.738178+0000","last_clean":"2024-02-10T08:28:50.738178+0000","last_became_active":"2024-02-10T08:20:46.396130+0000","last_became_peered":"2024-02-10T08:20:46.396130+0000","last_unstale":"2024-02-10T08:28:50.738178+0000","last_undegraded":"2024-02-10T08:28:50.738178+0000","last_fullsized":"2024-02-10T08:28:50.738178+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'24","last_scrub_stamp":"2024-02-10T08:28:35.984191+0000","last_deep_scrub":"201'16","last_deep_scrub_stamp":"2024-02-10T08:24:49.177357+0000","last_clean_scrub_stamp":"2024-02-10T08:28:35.984191+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":61,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.777136+0000","last_change":"2024-02-10T08:28:25.950558+0000","last_active":"2024-02-10T08:28:51.777136+0000","last_peered":"2024-02-10T08:28:51.777136+0000","last_clean":"2024-02-10T08:28:51.777136+0000","last_became_active":"2024-02-10T08:28:25.950245+0000","last_became_peered":"2024-02-10T08:28:25.950245+0000","last_unstale":"2024-02-10T08:28:51.777136+0000","last_undegraded":"2024-02-10T08:28:51.777136+0000","last_fullsized":"2024-02-10T08:28:51.777136+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:26:30.160922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:26:30.160922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":64,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.776607+0000","last_change":"2024-02-10T08:28:25.950568+0000","last_active":"2024-02-10T08:28:51.776607+0000","last_peered":"2024-02-10T08:28:51.776607+0000","last_clean":"2024-02-10T08:28:51.776607+0000","last_became_active":"2024-02-10T08:28:25.950221+0000","last_became_peered":"2024-02-10T08:28:25.950221+0000","last_unstale":"2024-02-10T08:28:51.776607+0000","last_undegraded":"2024-02-10T08:28:51.776607+0000","last_fullsized":"2024-02-10T08:28:51.776607+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:25:28.951619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:25:28.951619+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":242,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.776456+0000","last_change":"2024-02-10T08:25:43.163540+0000","last_active":"2024-02-10T08:28:51.776456+0000","last_peered":"2024-02-10T08:28:51.776456+0000","last_clean":"2024-02-10T08:28:51.776456+0000","last_became_active":"2024-02-10T08:16:52.786213+0000","last_became_peered":"2024-02-10T08:16:52.786213+0000","last_unstale":"2024-02-10T08:28:51.776456+0000","last_undegraded":"2024-02-10T08:28:51.776456+0000","last_fullsized":"2024-02-10T08:28:51.776456+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:25:43.163473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:25:43.163473+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"225'15","reported_seq":242,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.775835+0000","last_change":"2024-02-10T08:28:25.952604+0000","last_active":"2024-02-10T08:28:51.775835+0000","last_peered":"2024-02-10T08:28:51.775835+0000","last_clean":"2024-02-10T08:28:51.775835+0000","last_became_active":"2024-02-10T08:28:25.952354+0000","last_became_peered":"2024-02-10T08:28:25.952354+0000","last_unstale":"2024-02-10T08:28:51.775835+0000","last_undegraded":"2024-02-10T08:28:51.775835+0000","last_fullsized":"2024-02-10T08:28:51.775835+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'15","last_scrub_stamp":"2024-02-10T08:28:21.454916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:28:21.454916+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":207,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-02-10T08:28:50.738984+0000","last_change":"2024-02-10T08:26:33.798697+0000","last_active":"2024-02-10T08:28:50.738984+0000","last_peered":"2024-02-10T08:28:50.738984+0000","last_clean":"2024-02-10T08:28:50.738984+0000","last_became_active":"2024-02-10T08:20:46.395788+0000","last_became_peered":"2024-02-10T08:20:46.395788+0000","last_unstale":"2024-02-10T08:28:50.738984+0000","last_undegraded":"2024-02-10T08:28:50.738984+0000","last_fullsized":"2024-02-10T08:28:50.738984+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:26:33.798586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:26:33.798586+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"165'10","reported_seq":252,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-02-10T08:28:55.744385+0000","last_change":"2024-02-10T08:26:15.114882+0000","last_active":"2024-02-10T08:28:55.744385+0000","last_peered":"2024-02-10T08:28:55.744385+0000","last_clean":"2024-02-10T08:28:55.744385+0000","last_became_active":"2024-02-10T08:23:15.080370+0000","last_became_peered":"2024-02-10T08:23:15.080370+0000","last_unstale":"2024-02-10T08:28:55.744385+0000","last_undegraded":"2024-02-10T08:28:55.744385+0000","last_fullsized":"2024-02-10T08:28:55.744385+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"165'10","last_scrub_stamp":"2024-02-10T08:26:15.114806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:26:15.114806+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,1],"acting":[7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":191,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-02-10T08:28:50.738404+0000","last_change":"2024-02-10T08:27:18.873971+0000","last_active":"2024-02-10T08:28:50.738404+0000","last_peered":"2024-02-10T08:28:50.738404+0000","last_clean":"2024-02-10T08:28:50.738404+0000","last_became_active":"2024-02-10T08:23:34.717015+0000","last_became_peered":"2024-02-10T08:23:34.717015+0000","last_unstale":"2024-02-10T08:28:50.738404+0000","last_undegraded":"2024-02-10T08:28:50.738404+0000","last_fullsized":"2024-02-10T08:28:50.738404+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:27:18.873884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:27:18.873884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"225'19","reported_seq":262,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.768436+0000","last_change":"2024-02-10T08:25:43.713420+0000","last_active":"2024-02-10T08:28:51.768436+0000","last_peered":"2024-02-10T08:28:51.768436+0000","last_clean":"2024-02-10T08:28:51.768436+0000","last_became_active":"2024-02-10T08:16:55.204734+0000","last_became_peered":"2024-02-10T08:16:55.204734+0000","last_unstale":"2024-02-10T08:28:51.768436+0000","last_undegraded":"2024-02-10T08:28:51.768436+0000","last_fullsized":"2024-02-10T08:28:51.768436+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"213'13","last_scrub_stamp":"2024-02-10T08:25:43.713333+0000","last_deep_scrub":"213'13","last_deep_scrub_stamp":"2024-02-10T08:25:43.713333+0000","last_clean_scrub_stamp":"2024-02-10T08:25:43.713333+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":120,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.773175+0000","last_change":"2024-02-10T08:27:19.286440+0000","last_active":"2024-02-10T08:28:51.773175+0000","last_peered":"2024-02-10T08:28:51.773175+0000","last_clean":"2024-02-10T08:28:51.773175+0000","last_became_active":"2024-02-10T08:23:15.067821+0000","last_became_peered":"2024-02-10T08:23:15.067821+0000","last_unstale":"2024-02-10T08:28:51.773175+0000","last_undegraded":"2024-02-10T08:28:51.773175+0000","last_fullsized":"2024-02-10T08:28:51.773175+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:27:19.286346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:05.662947+0000","last_clean_scrub_stamp":"2024-02-10T08:27:19.286346+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"244'12","reported_seq":430,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-02-10T08:28:55.742949+0000","last_change":"2024-02-10T08:28:16.291133+0000","last_active":"2024-02-10T08:28:55.742949+0000","last_peered":"2024-02-10T08:28:55.742949+0000","last_clean":"2024-02-10T08:28:55.742949+0000","last_became_active":"2024-02-10T08:28:02.776097+0000","last_became_peered":"2024-02-10T08:28:02.776097+0000","last_unstale":"2024-02-10T08:28:55.742949+0000","last_undegraded":"2024-02-10T08:28:55.742949+0000","last_fullsized":"2024-02-10T08:28:55.742949+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"244'12","last_scrub_stamp":"2024-02-10T08:28:16.291055+0000","last_deep_scrub":"89'9","last_deep_scrub_stamp":"2024-02-10T08:19:33.299671+0000","last_clean_scrub_stamp":"2024-02-10T08:28:16.291055+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":240,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.767316+0000","last_change":"2024-02-10T08:28:19.243016+0000","last_active":"2024-02-10T08:28:51.767316+0000","last_peered":"2024-02-10T08:28:51.767316+0000","last_clean":"2024-02-10T08:28:51.767316+0000","last_became_active":"2024-02-10T08:16:52.789834+0000","last_became_peered":"2024-02-10T08:16:52.789834+0000","last_unstale":"2024-02-10T08:28:51.767316+0000","last_undegraded":"2024-02-10T08:28:51.767316+0000","last_fullsized":"2024-02-10T08:28:51.767316+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:19.242936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:28:19.242936+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"225'20","reported_seq":183,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.768414+0000","last_change":"2024-02-10T08:26:14.189385+0000","last_active":"2024-02-10T08:28:51.768414+0000","last_peered":"2024-02-10T08:28:51.768414+0000","last_clean":"2024-02-10T08:28:51.768414+0000","last_became_active":"2024-02-10T08:22:23.534081+0000","last_became_peered":"2024-02-10T08:22:23.534081+0000","last_unstale":"2024-02-10T08:28:51.768414+0000","last_undegraded":"2024-02-10T08:28:51.768414+0000","last_fullsized":"2024-02-10T08:28:51.768414+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'10","last_scrub_stamp":"2024-02-10T08:26:14.187217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:26:14.187217+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":24,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":244,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.773746+0000","last_change":"2024-02-10T08:28:33.229127+0000","last_active":"2024-02-10T08:28:51.773746+0000","last_peered":"2024-02-10T08:28:51.773746+0000","last_clean":"2024-02-10T08:28:51.773746+0000","last_became_active":"2024-02-10T08:20:46.398903+0000","last_became_peered":"2024-02-10T08:20:46.398903+0000","last_unstale":"2024-02-10T08:28:51.773746+0000","last_undegraded":"2024-02-10T08:28:51.773746+0000","last_fullsized":"2024-02-10T08:28:51.773746+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:33.229018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:33.229018+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":231,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.768506+0000","last_change":"2024-02-10T08:25:38.731043+0000","last_active":"2024-02-10T08:28:51.768506+0000","last_peered":"2024-02-10T08:28:51.768506+0000","last_clean":"2024-02-10T08:28:51.768506+0000","last_became_active":"2024-02-10T08:16:56.863948+0000","last_became_peered":"2024-02-10T08:16:56.863948+0000","last_unstale":"2024-02-10T08:28:51.768506+0000","last_undegraded":"2024-02-10T08:28:51.768506+0000","last_fullsized":"2024-02-10T08:28:51.768506+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:25:38.730946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:25:38.730946+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":293,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.776445+0000","last_change":"2024-02-10T08:28:38.232620+0000","last_active":"2024-02-10T08:28:51.776445+0000","last_peered":"2024-02-10T08:28:51.776445+0000","last_clean":"2024-02-10T08:28:51.776445+0000","last_became_active":"2024-02-10T08:28:38.232339+0000","last_became_peered":"2024-02-10T08:28:38.232339+0000","last_unstale":"2024-02-10T08:28:51.776445+0000","last_undegraded":"2024-02-10T08:28:51.776445+0000","last_fullsized":"2024-02-10T08:28:51.776445+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:25.490611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:28:25.490611+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,5],"acting":[6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"225'15","reported_seq":191,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.773333+0000","last_change":"2024-02-10T08:26:33.158094+0000","last_active":"2024-02-10T08:28:51.773333+0000","last_peered":"2024-02-10T08:28:51.773333+0000","last_clean":"2024-02-10T08:28:51.773333+0000","last_became_active":"2024-02-10T08:23:15.079382+0000","last_became_peered":"2024-02-10T08:23:15.079382+0000","last_unstale":"2024-02-10T08:28:51.773333+0000","last_undegraded":"2024-02-10T08:28:51.773333+0000","last_fullsized":"2024-02-10T08:28:51.773333+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'9","last_scrub_stamp":"2024-02-10T08:26:33.158025+0000","last_deep_scrub":"223'9","last_deep_scrub_stamp":"2024-02-10T08:26:33.158025+0000","last_clean_scrub_stamp":"2024-02-10T08:26:33.158025+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":97,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.776344+0000","last_change":"2024-02-10T08:28:25.999546+0000","last_active":"2024-02-10T08:28:51.776344+0000","last_peered":"2024-02-10T08:28:51.776344+0000","last_clean":"2024-02-10T08:28:51.776344+0000","last_became_active":"2024-02-10T08:28:25.999252+0000","last_became_peered":"2024-02-10T08:28:25.999252+0000","last_unstale":"2024-02-10T08:28:51.776344+0000","last_undegraded":"2024-02-10T08:28:51.776344+0000","last_fullsized":"2024-02-10T08:28:51.776344+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:27:26.129334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:27:26.129334+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":170,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.767593+0000","last_change":"2024-02-10T08:28:02.769046+0000","last_active":"2024-02-10T08:28:51.767593+0000","last_peered":"2024-02-10T08:28:51.767593+0000","last_clean":"2024-02-10T08:28:51.767593+0000","last_became_active":"2024-02-10T08:28:02.768667+0000","last_became_peered":"2024-02-10T08:28:02.768667+0000","last_unstale":"2024-02-10T08:28:51.767593+0000","last_undegraded":"2024-02-10T08:28:51.767593+0000","last_fullsized":"2024-02-10T08:28:51.767593+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:26:38.062164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:26:38.062164+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"55'1","reported_seq":268,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.768280+0000","last_change":"2024-02-10T08:28:02.878657+0000","last_active":"2024-02-10T08:28:51.768280+0000","last_peered":"2024-02-10T08:28:51.768280+0000","last_clean":"2024-02-10T08:28:51.768280+0000","last_became_active":"2024-02-10T08:28:02.778857+0000","last_became_peered":"2024-02-10T08:28:02.778857+0000","last_unstale":"2024-02-10T08:28:51.768280+0000","last_undegraded":"2024-02-10T08:28:51.768280+0000","last_fullsized":"2024-02-10T08:28:51.768280+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'1","last_scrub_stamp":"2024-02-10T08:25:28.166655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:25:28.166655+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":716,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"225'15","reported_seq":159,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.774968+0000","last_change":"2024-02-10T08:25:28.309306+0000","last_active":"2024-02-10T08:28:51.774968+0000","last_peered":"2024-02-10T08:28:51.774968+0000","last_clean":"2024-02-10T08:28:51.774968+0000","last_became_active":"2024-02-10T08:23:34.719714+0000","last_became_peered":"2024-02-10T08:23:34.719714+0000","last_unstale":"2024-02-10T08:28:51.774968+0000","last_undegraded":"2024-02-10T08:28:51.774968+0000","last_fullsized":"2024-02-10T08:28:51.774968+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'9","last_scrub_stamp":"2024-02-10T08:25:28.309156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:25:28.309156+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.4","version":"267'2584","reported_seq":2603,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-02-10T08:28:57.687339+0000","last_change":"2024-02-10T08:28:28.529619+0000","last_active":"2024-02-10T08:28:57.687339+0000","last_peered":"2024-02-10T08:28:57.687339+0000","last_clean":"2024-02-10T08:28:57.687339+0000","last_became_active":"2024-02-10T08:28:28.529130+0000","last_became_peered":"2024-02-10T08:28:28.529130+0000","last_unstale":"2024-02-10T08:28:57.687339+0000","last_undegraded":"2024-02-10T08:28:57.687339+0000","last_fullsized":"2024-02-10T08:28:57.687339+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_clean_scrub_stamp":"2024-02-10T08:28:27.172648+0000","log_size":2584,"ondisk_log_size":2584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":169345024,"num_objects":2584,"num_object_clones":0,"num_object_copies":7752,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2584,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2584,"num_write_kb":165376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":141,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.772914+0000","last_change":"2024-02-10T08:26:20.174043+0000","last_active":"2024-02-10T08:28:51.772914+0000","last_peered":"2024-02-10T08:28:51.772914+0000","last_clean":"2024-02-10T08:28:51.772914+0000","last_became_active":"2024-02-10T08:22:23.528310+0000","last_became_peered":"2024-02-10T08:22:23.528310+0000","last_unstale":"2024-02-10T08:28:51.772914+0000","last_undegraded":"2024-02-10T08:28:51.772914+0000","last_fullsized":"2024-02-10T08:28:51.772914+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:26:20.173948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:26:20.173948+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"55'2","reported_seq":250,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-02-10T08:28:50.739552+0000","last_change":"2024-02-10T08:28:02.952165+0000","last_active":"2024-02-10T08:28:50.739552+0000","last_peered":"2024-02-10T08:28:50.739552+0000","last_clean":"2024-02-10T08:28:50.739552+0000","last_became_active":"2024-02-10T08:28:02.768279+0000","last_became_peered":"2024-02-10T08:28:02.768279+0000","last_unstale":"2024-02-10T08:28:50.739552+0000","last_undegraded":"2024-02-10T08:28:50.739552+0000","last_fullsized":"2024-02-10T08:28:50.739552+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'2","last_scrub_stamp":"2024-02-10T08:25:38.137706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:25:38.137706+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":184,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"225'23","reported_seq":269,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-02-10T08:28:50.738777+0000","last_change":"2024-02-10T08:25:33.232711+0000","last_active":"2024-02-10T08:28:50.738777+0000","last_peered":"2024-02-10T08:28:50.738777+0000","last_clean":"2024-02-10T08:28:50.738777+0000","last_became_active":"2024-02-10T08:23:15.126133+0000","last_became_peered":"2024-02-10T08:23:15.126133+0000","last_unstale":"2024-02-10T08:28:50.738777+0000","last_undegraded":"2024-02-10T08:28:50.738777+0000","last_fullsized":"2024-02-10T08:28:50.738777+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'17","last_scrub_stamp":"2024-02-10T08:25:33.232620+0000","last_deep_scrub":"82'17","last_deep_scrub_stamp":"2024-02-10T08:18:21.015873+0000","last_clean_scrub_stamp":"2024-02-10T08:25:33.232620+0000","log_size":23,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":25,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6],"acting":[4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":250,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.768424+0000","last_change":"2024-02-10T08:28:02.779213+0000","last_active":"2024-02-10T08:28:51.768424+0000","last_peered":"2024-02-10T08:28:51.768424+0000","last_clean":"2024-02-10T08:28:51.768424+0000","last_became_active":"2024-02-10T08:28:02.777637+0000","last_became_peered":"2024-02-10T08:28:02.777637+0000","last_unstale":"2024-02-10T08:28:51.768424+0000","last_undegraded":"2024-02-10T08:28:51.768424+0000","last_fullsized":"2024-02-10T08:28:51.768424+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:45.946713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:24:45.946713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.f","version":"267'2621","reported_seq":2639,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-02-10T08:28:57.545394+0000","last_change":"2024-02-10T08:28:28.332012+0000","last_active":"2024-02-10T08:28:57.545394+0000","last_peered":"2024-02-10T08:28:57.545394+0000","last_clean":"2024-02-10T08:28:57.545394+0000","last_became_active":"2024-02-10T08:28:28.331729+0000","last_became_peered":"2024-02-10T08:28:28.331729+0000","last_unstale":"2024-02-10T08:28:57.545394+0000","last_undegraded":"2024-02-10T08:28:57.545394+0000","last_fullsized":"2024-02-10T08:28:57.545394+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_clean_scrub_stamp":"2024-02-10T08:28:27.172648+0000","log_size":2621,"ondisk_log_size":2621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":171769856,"num_objects":2621,"num_object_clones":0,"num_object_copies":7863,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2621,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2621,"num_write_kb":167744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,2],"acting":[5,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":155,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.776908+0000","last_change":"2024-02-10T08:28:25.950594+0000","last_active":"2024-02-10T08:28:51.776908+0000","last_peered":"2024-02-10T08:28:51.776908+0000","last_clean":"2024-02-10T08:28:51.776908+0000","last_became_active":"2024-02-10T08:28:25.950240+0000","last_became_peered":"2024-02-10T08:28:25.950240+0000","last_unstale":"2024-02-10T08:28:51.776908+0000","last_undegraded":"2024-02-10T08:28:51.776908+0000","last_fullsized":"2024-02-10T08:28:51.776908+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:48.866676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:24:48.866676+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":254,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.768184+0000","last_change":"2024-02-10T08:28:21.409185+0000","last_active":"2024-02-10T08:28:51.768184+0000","last_peered":"2024-02-10T08:28:51.768184+0000","last_clean":"2024-02-10T08:28:51.768184+0000","last_became_active":"2024-02-10T08:28:02.760784+0000","last_became_peered":"2024-02-10T08:28:02.760784+0000","last_unstale":"2024-02-10T08:28:51.768184+0000","last_undegraded":"2024-02-10T08:28:51.768184+0000","last_fullsized":"2024-02-10T08:28:51.768184+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:21.409109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:28:21.409109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"225'20","reported_seq":274,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.772013+0000","last_change":"2024-02-10T08:24:43.501177+0000","last_active":"2024-02-10T08:28:51.772013+0000","last_peered":"2024-02-10T08:28:51.772013+0000","last_clean":"2024-02-10T08:28:51.772013+0000","last_became_active":"2024-02-10T08:20:46.408495+0000","last_became_peered":"2024-02-10T08:20:46.408495+0000","last_unstale":"2024-02-10T08:28:51.772013+0000","last_undegraded":"2024-02-10T08:28:51.772013+0000","last_fullsized":"2024-02-10T08:28:51.772013+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'10","last_scrub_stamp":"2024-02-10T08:24:43.501071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:24:43.501071+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"255'12","reported_seq":103,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-02-10T08:28:55.752434+0000","last_change":"2024-02-10T08:28:25.952833+0000","last_active":"2024-02-10T08:28:55.752434+0000","last_peered":"2024-02-10T08:28:55.752434+0000","last_clean":"2024-02-10T08:28:55.752434+0000","last_became_active":"2024-02-10T08:28:25.952468+0000","last_became_peered":"2024-02-10T08:28:25.952468+0000","last_unstale":"2024-02-10T08:28:55.752434+0000","last_undegraded":"2024-02-10T08:28:55.752434+0000","last_fullsized":"2024-02-10T08:28:55.752434+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"244'11","last_scrub_stamp":"2024-02-10T08:28:18.492203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:28:18.492203+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.9","version":"267'2767","reported_seq":2786,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-02-10T08:28:58.129733+0000","last_change":"2024-02-10T08:28:28.190881+0000","last_active":"2024-02-10T08:28:58.129733+0000","last_peered":"2024-02-10T08:28:58.129733+0000","last_clean":"2024-02-10T08:28:58.129733+0000","last_became_active":"2024-02-10T08:28:28.190530+0000","last_became_peered":"2024-02-10T08:28:28.190530+0000","last_unstale":"2024-02-10T08:28:58.129733+0000","last_undegraded":"2024-02-10T08:28:58.129733+0000","last_fullsized":"2024-02-10T08:28:58.129733+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_clean_scrub_stamp":"2024-02-10T08:28:27.172648+0000","log_size":2767,"ondisk_log_size":2767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":181338112,"num_objects":2767,"num_object_clones":0,"num_object_copies":8301,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2767,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2767,"num_write_kb":177088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,5],"acting":[0,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":249,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-02-10T08:28:50.739173+0000","last_change":"2024-02-10T08:28:26.013133+0000","last_active":"2024-02-10T08:28:50.739173+0000","last_peered":"2024-02-10T08:28:50.739173+0000","last_clean":"2024-02-10T08:28:50.739173+0000","last_became_active":"2024-02-10T08:23:34.716482+0000","last_became_peered":"2024-02-10T08:23:34.716482+0000","last_unstale":"2024-02-10T08:28:50.739173+0000","last_undegraded":"2024-02-10T08:28:50.739173+0000","last_fullsized":"2024-02-10T08:28:50.739173+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:26.013060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:26.013060+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":235,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.767388+0000","last_change":"2024-02-10T08:25:41.756382+0000","last_active":"2024-02-10T08:28:51.767388+0000","last_peered":"2024-02-10T08:28:51.767388+0000","last_clean":"2024-02-10T08:28:51.767388+0000","last_became_active":"2024-02-10T08:16:52.791027+0000","last_became_peered":"2024-02-10T08:16:52.791027+0000","last_unstale":"2024-02-10T08:28:51.767388+0000","last_undegraded":"2024-02-10T08:28:51.767388+0000","last_fullsized":"2024-02-10T08:28:51.767388+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:25:41.756270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:25:41.756270+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"225'41","reported_seq":481,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-02-10T08:28:55.739146+0000","last_change":"2024-02-10T08:28:22.455298+0000","last_active":"2024-02-10T08:28:55.739146+0000","last_peered":"2024-02-10T08:28:55.739146+0000","last_clean":"2024-02-10T08:28:55.739146+0000","last_became_active":"2024-02-10T08:23:34.709222+0000","last_became_peered":"2024-02-10T08:23:34.709222+0000","last_unstale":"2024-02-10T08:28:55.739146+0000","last_undegraded":"2024-02-10T08:28:55.739146+0000","last_fullsized":"2024-02-10T08:28:55.739146+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'41","last_scrub_stamp":"2024-02-10T08:28:22.455139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:28:22.455139+0000","log_size":41,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":66,"num_read_kb":51,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":358,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":191,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.768951+0000","last_change":"2024-02-10T08:25:36.925113+0000","last_active":"2024-02-10T08:28:51.768951+0000","last_peered":"2024-02-10T08:28:51.768951+0000","last_clean":"2024-02-10T08:28:51.768951+0000","last_became_active":"2024-02-10T08:23:15.081822+0000","last_became_peered":"2024-02-10T08:23:15.081822+0000","last_unstale":"2024-02-10T08:28:51.768951+0000","last_undegraded":"2024-02-10T08:28:51.768951+0000","last_fullsized":"2024-02-10T08:28:51.768951+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:25:36.925006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:25:36.925006+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,6],"acting":[1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.a","version":"267'2669","reported_seq":2688,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-02-10T08:28:57.580339+0000","last_change":"2024-02-10T08:28:28.186010+0000","last_active":"2024-02-10T08:28:57.580339+0000","last_peered":"2024-02-10T08:28:57.580339+0000","last_clean":"2024-02-10T08:28:57.580339+0000","last_became_active":"2024-02-10T08:28:28.185721+0000","last_became_peered":"2024-02-10T08:28:28.185721+0000","last_unstale":"2024-02-10T08:28:57.580339+0000","last_undegraded":"2024-02-10T08:28:57.580339+0000","last_fullsized":"2024-02-10T08:28:57.580339+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_clean_scrub_stamp":"2024-02-10T08:28:27.172648+0000","log_size":2669,"ondisk_log_size":2669,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":174915584,"num_objects":2669,"num_object_clones":0,"num_object_copies":8007,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2669,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2669,"num_write_kb":170816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":244,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.773970+0000","last_change":"2024-02-10T08:28:16.113780+0000","last_active":"2024-02-10T08:28:51.773970+0000","last_peered":"2024-02-10T08:28:51.773970+0000","last_clean":"2024-02-10T08:28:51.773970+0000","last_became_active":"2024-02-10T08:21:58.549733+0000","last_became_peered":"2024-02-10T08:21:58.549733+0000","last_unstale":"2024-02-10T08:28:51.773970+0000","last_undegraded":"2024-02-10T08:28:51.773970+0000","last_fullsized":"2024-02-10T08:28:51.773970+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:16.113690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:11.750537+0000","last_clean_scrub_stamp":"2024-02-10T08:28:16.113690+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"63'5","reported_seq":954,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-02-10T08:28:55.873767+0000","last_change":"2024-02-10T08:25:43.009500+0000","last_active":"2024-02-10T08:28:55.873767+0000","last_peered":"2024-02-10T08:28:55.873767+0000","last_clean":"2024-02-10T08:28:55.873767+0000","last_became_active":"2024-02-10T08:16:52.780989+0000","last_became_peered":"2024-02-10T08:16:52.780989+0000","last_unstale":"2024-02-10T08:28:55.873767+0000","last_undegraded":"2024-02-10T08:28:55.873767+0000","last_fullsized":"2024-02-10T08:28:55.873767+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'5","last_scrub_stamp":"2024-02-10T08:25:43.009394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:25:43.009394+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":715,"num_read_kb":710,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":268,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.767329+0000","last_change":"2024-02-10T08:28:35.476480+0000","last_active":"2024-02-10T08:28:51.767329+0000","last_peered":"2024-02-10T08:28:51.767329+0000","last_clean":"2024-02-10T08:28:51.767329+0000","last_became_active":"2024-02-10T08:28:02.788789+0000","last_became_peered":"2024-02-10T08:28:02.788789+0000","last_unstale":"2024-02-10T08:28:51.767329+0000","last_undegraded":"2024-02-10T08:28:51.767329+0000","last_fullsized":"2024-02-10T08:28:51.767329+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:35.476417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:11.681169+0000","last_clean_scrub_stamp":"2024-02-10T08:28:35.476417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"225'17","reported_seq":128,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.767509+0000","last_change":"2024-02-10T08:28:38.619626+0000","last_active":"2024-02-10T08:28:51.767509+0000","last_peered":"2024-02-10T08:28:51.767509+0000","last_clean":"2024-02-10T08:28:51.767509+0000","last_became_active":"2024-02-10T08:23:34.729593+0000","last_became_peered":"2024-02-10T08:23:34.729593+0000","last_unstale":"2024-02-10T08:28:51.767509+0000","last_undegraded":"2024-02-10T08:28:51.767509+0000","last_fullsized":"2024-02-10T08:28:51.767509+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'17","last_scrub_stamp":"2024-02-10T08:28:38.619521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:28:38.619521+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":35,"num_read_kb":24,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":232,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.767867+0000","last_change":"2024-02-10T08:25:34.266280+0000","last_active":"2024-02-10T08:28:51.767867+0000","last_peered":"2024-02-10T08:28:51.767867+0000","last_clean":"2024-02-10T08:28:51.767867+0000","last_became_active":"2024-02-10T08:16:56.857856+0000","last_became_peered":"2024-02-10T08:16:56.857856+0000","last_unstale":"2024-02-10T08:28:51.767867+0000","last_undegraded":"2024-02-10T08:28:51.767867+0000","last_fullsized":"2024-02-10T08:28:51.767867+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:25:34.266213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:25:34.266213+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.8","version":"267'2695","reported_seq":2714,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-02-10T08:28:58.126889+0000","last_change":"2024-02-10T08:28:28.191187+0000","last_active":"2024-02-10T08:28:58.126889+0000","last_peered":"2024-02-10T08:28:58.126889+0000","last_clean":"2024-02-10T08:28:58.126889+0000","last_became_active":"2024-02-10T08:28:28.190724+0000","last_became_peered":"2024-02-10T08:28:28.190724+0000","last_unstale":"2024-02-10T08:28:58.126889+0000","last_undegraded":"2024-02-10T08:28:58.126889+0000","last_fullsized":"2024-02-10T08:28:58.126889+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_clean_scrub_stamp":"2024-02-10T08:28:27.172648+0000","log_size":2695,"ondisk_log_size":2695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":176619520,"num_objects":2695,"num_object_clones":0,"num_object_copies":8085,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2695,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2695,"num_write_kb":172480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":248,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.768956+0000","last_change":"2024-02-10T08:26:29.921655+0000","last_active":"2024-02-10T08:28:51.768956+0000","last_peered":"2024-02-10T08:28:51.768956+0000","last_clean":"2024-02-10T08:28:51.768956+0000","last_became_active":"2024-02-10T08:21:58.560646+0000","last_became_peered":"2024-02-10T08:21:58.560646+0000","last_unstale":"2024-02-10T08:28:51.768956+0000","last_undegraded":"2024-02-10T08:28:51.768956+0000","last_fullsized":"2024-02-10T08:28:51.768956+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:26:29.921562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:26:29.921562+0000","last_clean_scrub_stamp":"2024-02-10T08:26:29.921562+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":155,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.767406+0000","last_change":"2024-02-10T08:28:35.177207+0000","last_active":"2024-02-10T08:28:51.767406+0000","last_peered":"2024-02-10T08:28:51.767406+0000","last_clean":"2024-02-10T08:28:51.767406+0000","last_became_active":"2024-02-10T08:23:34.712122+0000","last_became_peered":"2024-02-10T08:23:34.712122+0000","last_unstale":"2024-02-10T08:28:51.767406+0000","last_undegraded":"2024-02-10T08:28:51.767406+0000","last_fullsized":"2024-02-10T08:28:51.767406+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:35.177138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:28:35.177138+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,4],"acting":[5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":235,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.768074+0000","last_change":"2024-02-10T08:24:46.833927+0000","last_active":"2024-02-10T08:28:51.768074+0000","last_peered":"2024-02-10T08:28:51.768074+0000","last_clean":"2024-02-10T08:28:51.768074+0000","last_became_active":"2024-02-10T08:16:52.788767+0000","last_became_peered":"2024-02-10T08:16:52.788767+0000","last_unstale":"2024-02-10T08:28:51.768074+0000","last_undegraded":"2024-02-10T08:28:51.768074+0000","last_fullsized":"2024-02-10T08:28:51.768074+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:46.833859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:24:46.833859+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":255,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.772899+0000","last_change":"2024-02-10T08:26:24.214276+0000","last_active":"2024-02-10T08:28:51.772899+0000","last_peered":"2024-02-10T08:28:51.772899+0000","last_clean":"2024-02-10T08:28:51.772899+0000","last_became_active":"2024-02-10T08:23:34.717837+0000","last_became_peered":"2024-02-10T08:23:34.717837+0000","last_unstale":"2024-02-10T08:28:51.772899+0000","last_undegraded":"2024-02-10T08:28:51.772899+0000","last_fullsized":"2024-02-10T08:28:51.772899+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:26:24.214179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:14:44.584370+0000","last_clean_scrub_stamp":"2024-02-10T08:26:24.214179+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"225'33","reported_seq":295,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.778691+0000","last_change":"2024-02-10T08:26:33.250702+0000","last_active":"2024-02-10T08:28:51.778691+0000","last_peered":"2024-02-10T08:28:51.778691+0000","last_clean":"2024-02-10T08:28:51.778691+0000","last_became_active":"2024-02-10T08:20:46.401981+0000","last_became_peered":"2024-02-10T08:20:46.401981+0000","last_unstale":"2024-02-10T08:28:51.778691+0000","last_undegraded":"2024-02-10T08:28:51.778691+0000","last_fullsized":"2024-02-10T08:28:51.778691+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'21","last_scrub_stamp":"2024-02-10T08:26:33.250614+0000","last_deep_scrub":"223'21","last_deep_scrub_stamp":"2024-02-10T08:26:33.250614+0000","last_clean_scrub_stamp":"2024-02-10T08:26:33.250614+0000","log_size":33,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":33,"num_write":25,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":231,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.772857+0000","last_change":"2024-02-10T08:25:30.324976+0000","last_active":"2024-02-10T08:28:51.772857+0000","last_peered":"2024-02-10T08:28:51.772857+0000","last_clean":"2024-02-10T08:28:51.772857+0000","last_became_active":"2024-02-10T08:16:56.867159+0000","last_became_peered":"2024-02-10T08:16:56.867159+0000","last_unstale":"2024-02-10T08:28:51.772857+0000","last_undegraded":"2024-02-10T08:28:51.772857+0000","last_fullsized":"2024-02-10T08:28:51.772857+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:25:30.324884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:04.766780+0000","last_clean_scrub_stamp":"2024-02-10T08:25:30.324884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.b","version":"267'2663","reported_seq":2682,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-02-10T08:28:57.571584+0000","last_change":"2024-02-10T08:28:28.331854+0000","last_active":"2024-02-10T08:28:57.571584+0000","last_peered":"2024-02-10T08:28:57.571584+0000","last_clean":"2024-02-10T08:28:57.571584+0000","last_became_active":"2024-02-10T08:28:28.331529+0000","last_became_peered":"2024-02-10T08:28:28.331529+0000","last_unstale":"2024-02-10T08:28:57.571584+0000","last_undegraded":"2024-02-10T08:28:57.571584+0000","last_fullsized":"2024-02-10T08:28:57.571584+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_clean_scrub_stamp":"2024-02-10T08:28:27.172648+0000","log_size":2663,"ondisk_log_size":2663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":174522368,"num_objects":2663,"num_object_clones":0,"num_object_copies":7989,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2663,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2663,"num_write_kb":170432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":252,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.768595+0000","last_change":"2024-02-10T08:28:19.044189+0000","last_active":"2024-02-10T08:28:51.768595+0000","last_peered":"2024-02-10T08:28:51.768595+0000","last_clean":"2024-02-10T08:28:51.768595+0000","last_became_active":"2024-02-10T08:28:19.022399+0000","last_became_peered":"2024-02-10T08:28:19.022399+0000","last_unstale":"2024-02-10T08:28:51.768595+0000","last_undegraded":"2024-02-10T08:28:51.768595+0000","last_fullsized":"2024-02-10T08:28:51.768595+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:09.785096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:20:09.785096+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":209,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.776339+0000","last_change":"2024-02-10T08:28:38.234434+0000","last_active":"2024-02-10T08:28:51.776339+0000","last_peered":"2024-02-10T08:28:51.776339+0000","last_clean":"2024-02-10T08:28:51.776339+0000","last_became_active":"2024-02-10T08:28:38.233974+0000","last_became_peered":"2024-02-10T08:28:38.233974+0000","last_unstale":"2024-02-10T08:28:51.776339+0000","last_undegraded":"2024-02-10T08:28:51.776339+0000","last_fullsized":"2024-02-10T08:28:51.776339+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:25:41.136369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:20.736224+0000","last_clean_scrub_stamp":"2024-02-10T08:25:41.136369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":253,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.771847+0000","last_change":"2024-02-10T08:28:02.761385+0000","last_active":"2024-02-10T08:28:51.771847+0000","last_peered":"2024-02-10T08:28:51.771847+0000","last_clean":"2024-02-10T08:28:51.771847+0000","last_became_active":"2024-02-10T08:28:02.760999+0000","last_became_peered":"2024-02-10T08:28:02.760999+0000","last_unstale":"2024-02-10T08:28:51.771847+0000","last_undegraded":"2024-02-10T08:28:51.771847+0000","last_fullsized":"2024-02-10T08:28:51.771847+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:26:31.161639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:26:31.161639+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"225'24","reported_seq":182,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.769330+0000","last_change":"2024-02-10T08:28:26.505341+0000","last_active":"2024-02-10T08:28:51.769330+0000","last_peered":"2024-02-10T08:28:51.769330+0000","last_clean":"2024-02-10T08:28:51.769330+0000","last_became_active":"2024-02-10T08:23:15.077476+0000","last_became_peered":"2024-02-10T08:23:15.077476+0000","last_unstale":"2024-02-10T08:28:51.769330+0000","last_undegraded":"2024-02-10T08:28:51.769330+0000","last_fullsized":"2024-02-10T08:28:51.769330+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'24","last_scrub_stamp":"2024-02-10T08:28:26.505270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:28:26.505270+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,7],"acting":[1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":253,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.768911+0000","last_change":"2024-02-10T08:28:02.773088+0000","last_active":"2024-02-10T08:28:51.768911+0000","last_peered":"2024-02-10T08:28:51.768911+0000","last_clean":"2024-02-10T08:28:51.768911+0000","last_became_active":"2024-02-10T08:28:02.772585+0000","last_became_peered":"2024-02-10T08:28:02.772585+0000","last_unstale":"2024-02-10T08:28:51.768911+0000","last_undegraded":"2024-02-10T08:28:51.768911+0000","last_fullsized":"2024-02-10T08:28:51.768911+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:26:23.864678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:41.360241+0000","last_clean_scrub_stamp":"2024-02-10T08:26:23.864678+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.e","version":"267'2628","reported_seq":2647,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-02-10T08:28:57.594840+0000","last_change":"2024-02-10T08:28:28.188744+0000","last_active":"2024-02-10T08:28:57.594840+0000","last_peered":"2024-02-10T08:28:57.594840+0000","last_clean":"2024-02-10T08:28:57.594840+0000","last_became_active":"2024-02-10T08:28:28.188416+0000","last_became_peered":"2024-02-10T08:28:28.188416+0000","last_unstale":"2024-02-10T08:28:57.594840+0000","last_undegraded":"2024-02-10T08:28:57.594840+0000","last_fullsized":"2024-02-10T08:28:57.594840+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_clean_scrub_stamp":"2024-02-10T08:28:27.172648+0000","log_size":2628,"ondisk_log_size":2628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":172228608,"num_objects":2628,"num_object_clones":0,"num_object_copies":7884,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2628,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2628,"num_write_kb":168192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":239,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.768017+0000","last_change":"2024-02-10T08:28:39.633777+0000","last_active":"2024-02-10T08:28:51.768017+0000","last_peered":"2024-02-10T08:28:51.768017+0000","last_clean":"2024-02-10T08:28:51.768017+0000","last_became_active":"2024-02-10T08:21:58.553966+0000","last_became_peered":"2024-02-10T08:21:58.553966+0000","last_unstale":"2024-02-10T08:28:51.768017+0000","last_undegraded":"2024-02-10T08:28:51.768017+0000","last_fullsized":"2024-02-10T08:28:51.768017+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:39.633627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:39.633627+0000","last_clean_scrub_stamp":"2024-02-10T08:28:39.633627+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":229,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.768109+0000","last_change":"2024-02-10T08:27:27.094310+0000","last_active":"2024-02-10T08:28:51.768109+0000","last_peered":"2024-02-10T08:28:51.768109+0000","last_clean":"2024-02-10T08:28:51.768109+0000","last_became_active":"2024-02-10T08:23:34.708387+0000","last_became_peered":"2024-02-10T08:23:34.708387+0000","last_unstale":"2024-02-10T08:28:51.768109+0000","last_undegraded":"2024-02-10T08:28:51.768109+0000","last_fullsized":"2024-02-10T08:28:51.768109+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:27:27.094240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:27:27.094240+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"225'37","reported_seq":332,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.776515+0000","last_change":"2024-02-10T08:28:33.205966+0000","last_active":"2024-02-10T08:28:51.776515+0000","last_peered":"2024-02-10T08:28:51.776515+0000","last_clean":"2024-02-10T08:28:51.776515+0000","last_became_active":"2024-02-10T08:28:25.951447+0000","last_became_peered":"2024-02-10T08:28:25.951447+0000","last_unstale":"2024-02-10T08:28:51.776515+0000","last_undegraded":"2024-02-10T08:28:51.776515+0000","last_fullsized":"2024-02-10T08:28:51.776515+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'37","last_scrub_stamp":"2024-02-10T08:28:33.205891+0000","last_deep_scrub":"199'27","last_deep_scrub_stamp":"2024-02-10T08:24:42.826442+0000","last_clean_scrub_stamp":"2024-02-10T08:28:33.205891+0000","log_size":37,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":53,"num_read_kb":39,"num_write":32,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":249,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.776333+0000","last_change":"2024-02-10T08:28:02.769776+0000","last_active":"2024-02-10T08:28:51.776333+0000","last_peered":"2024-02-10T08:28:51.776333+0000","last_clean":"2024-02-10T08:28:51.776333+0000","last_became_active":"2024-02-10T08:28:02.769069+0000","last_became_peered":"2024-02-10T08:28:02.769069+0000","last_unstale":"2024-02-10T08:28:51.776333+0000","last_undegraded":"2024-02-10T08:28:51.776333+0000","last_fullsized":"2024-02-10T08:28:51.776333+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:25:35.177653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:25:35.177653+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.d","version":"267'2694","reported_seq":2712,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-02-10T08:28:57.614272+0000","last_change":"2024-02-10T08:28:28.188686+0000","last_active":"2024-02-10T08:28:57.614272+0000","last_peered":"2024-02-10T08:28:57.614272+0000","last_clean":"2024-02-10T08:28:57.614272+0000","last_became_active":"2024-02-10T08:28:28.188347+0000","last_became_peered":"2024-02-10T08:28:28.188347+0000","last_unstale":"2024-02-10T08:28:57.614272+0000","last_undegraded":"2024-02-10T08:28:57.614272+0000","last_fullsized":"2024-02-10T08:28:57.614272+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_clean_scrub_stamp":"2024-02-10T08:28:27.172648+0000","log_size":2694,"ondisk_log_size":2694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":176553984,"num_objects":2694,"num_object_clones":0,"num_object_copies":8082,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2694,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2694,"num_write_kb":172416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,5],"acting":[7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":234,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-02-10T08:28:50.739256+0000","last_change":"2024-02-10T08:28:22.016781+0000","last_active":"2024-02-10T08:28:50.739256+0000","last_peered":"2024-02-10T08:28:50.739256+0000","last_clean":"2024-02-10T08:28:50.739256+0000","last_became_active":"2024-02-10T08:23:15.074239+0000","last_became_peered":"2024-02-10T08:23:15.074239+0000","last_unstale":"2024-02-10T08:28:50.739256+0000","last_undegraded":"2024-02-10T08:28:50.739256+0000","last_fullsized":"2024-02-10T08:28:50.739256+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:22.016693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:22.016693+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":246,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.769012+0000","last_change":"2024-02-10T08:24:38.505837+0000","last_active":"2024-02-10T08:28:51.769012+0000","last_peered":"2024-02-10T08:28:51.769012+0000","last_clean":"2024-02-10T08:28:51.769012+0000","last_became_active":"2024-02-10T08:20:46.407667+0000","last_became_peered":"2024-02-10T08:20:46.407667+0000","last_unstale":"2024-02-10T08:28:51.769012+0000","last_undegraded":"2024-02-10T08:28:51.769012+0000","last_fullsized":"2024-02-10T08:28:51.769012+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:24:38.505735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:24:38.505735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"225'30","reported_seq":243,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.773532+0000","last_change":"2024-02-10T08:28:35.245725+0000","last_active":"2024-02-10T08:28:51.773532+0000","last_peered":"2024-02-10T08:28:51.773532+0000","last_clean":"2024-02-10T08:28:51.773532+0000","last_became_active":"2024-02-10T08:23:15.079674+0000","last_became_peered":"2024-02-10T08:23:15.079674+0000","last_unstale":"2024-02-10T08:28:51.773532+0000","last_undegraded":"2024-02-10T08:28:51.773532+0000","last_fullsized":"2024-02-10T08:28:51.773532+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'30","last_scrub_stamp":"2024-02-10T08:28:35.245660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:28:35.245660+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":51,"num_read_kb":39,"num_write":32,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,5],"acting":[7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":216,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-02-10T08:28:50.739005+0000","last_change":"2024-02-10T08:26:14.142651+0000","last_active":"2024-02-10T08:28:50.739005+0000","last_peered":"2024-02-10T08:28:50.739005+0000","last_clean":"2024-02-10T08:28:50.739005+0000","last_became_active":"2024-02-10T08:23:34.706206+0000","last_became_peered":"2024-02-10T08:23:34.706206+0000","last_unstale":"2024-02-10T08:28:50.739005+0000","last_undegraded":"2024-02-10T08:28:50.739005+0000","last_fullsized":"2024-02-10T08:28:50.739005+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:26:14.142574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:26:14.142574+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,5],"acting":[4,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.c","version":"266'2382","reported_seq":2398,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:54.874291+0000","last_change":"2024-02-10T08:28:28.529419+0000","last_active":"2024-02-10T08:28:54.874291+0000","last_peered":"2024-02-10T08:28:54.874291+0000","last_clean":"2024-02-10T08:28:54.874291+0000","last_became_active":"2024-02-10T08:28:28.529047+0000","last_became_peered":"2024-02-10T08:28:28.529047+0000","last_unstale":"2024-02-10T08:28:54.874291+0000","last_undegraded":"2024-02-10T08:28:54.874291+0000","last_fullsized":"2024-02-10T08:28:54.874291+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_clean_scrub_stamp":"2024-02-10T08:28:27.172648+0000","log_size":2382,"ondisk_log_size":2382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":156106752,"num_objects":2382,"num_object_clones":0,"num_object_copies":7146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2382,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2382,"num_write_kb":152448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":238,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.773154+0000","last_change":"2024-02-10T08:28:17.059779+0000","last_active":"2024-02-10T08:28:51.773154+0000","last_peered":"2024-02-10T08:28:51.773154+0000","last_clean":"2024-02-10T08:28:51.773154+0000","last_became_active":"2024-02-10T08:21:58.546976+0000","last_became_peered":"2024-02-10T08:21:58.546976+0000","last_unstale":"2024-02-10T08:28:51.773154+0000","last_undegraded":"2024-02-10T08:28:51.773154+0000","last_fullsized":"2024-02-10T08:28:51.773154+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:17.059697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:17.059697+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":235,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.776784+0000","last_change":"2024-02-10T08:25:39.170802+0000","last_active":"2024-02-10T08:28:51.776784+0000","last_peered":"2024-02-10T08:28:51.776784+0000","last_clean":"2024-02-10T08:28:51.776784+0000","last_became_active":"2024-02-10T08:16:52.789020+0000","last_became_peered":"2024-02-10T08:16:52.789020+0000","last_unstale":"2024-02-10T08:28:51.776784+0000","last_undegraded":"2024-02-10T08:28:51.776784+0000","last_fullsized":"2024-02-10T08:28:51.776784+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:25:39.170701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:25:39.170701+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"225'28","reported_seq":247,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-02-10T08:28:50.738908+0000","last_change":"2024-02-10T08:25:39.155532+0000","last_active":"2024-02-10T08:28:50.738908+0000","last_peered":"2024-02-10T08:28:50.738908+0000","last_clean":"2024-02-10T08:28:50.738908+0000","last_became_active":"2024-02-10T08:20:46.400760+0000","last_became_peered":"2024-02-10T08:20:46.400760+0000","last_unstale":"2024-02-10T08:28:50.738908+0000","last_undegraded":"2024-02-10T08:28:50.738908+0000","last_fullsized":"2024-02-10T08:28:50.738908+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'14","last_scrub_stamp":"2024-02-10T08:25:39.155461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:25:39.155461+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":41,"num_read_kb":34,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"199'13","reported_seq":253,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-02-10T08:28:55.738198+0000","last_change":"2024-02-10T08:24:47.529599+0000","last_active":"2024-02-10T08:28:55.738198+0000","last_peered":"2024-02-10T08:28:55.738198+0000","last_clean":"2024-02-10T08:28:55.738198+0000","last_became_active":"2024-02-10T08:23:34.711450+0000","last_became_peered":"2024-02-10T08:23:34.711450+0000","last_unstale":"2024-02-10T08:28:55.738198+0000","last_undegraded":"2024-02-10T08:28:55.738198+0000","last_fullsized":"2024-02-10T08:28:55.738198+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"199'13","last_scrub_stamp":"2024-02-10T08:24:47.529439+0000","last_deep_scrub":"199'13","last_deep_scrub_stamp":"2024-02-10T08:24:47.529439+0000","last_clean_scrub_stamp":"2024-02-10T08:24:47.529439+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,2],"acting":[1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"267'2683","reported_seq":2702,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-02-10T08:28:57.579724+0000","last_change":"2024-02-10T08:28:28.529385+0000","last_active":"2024-02-10T08:28:57.579724+0000","last_peered":"2024-02-10T08:28:57.579724+0000","last_clean":"2024-02-10T08:28:57.579724+0000","last_became_active":"2024-02-10T08:28:28.529058+0000","last_became_peered":"2024-02-10T08:28:28.529058+0000","last_unstale":"2024-02-10T08:28:57.579724+0000","last_undegraded":"2024-02-10T08:28:57.579724+0000","last_fullsized":"2024-02-10T08:28:57.579724+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_clean_scrub_stamp":"2024-02-10T08:28:27.172648+0000","log_size":2683,"ondisk_log_size":2683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":175833088,"num_objects":2683,"num_object_clones":0,"num_object_copies":8049,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2683,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2683,"num_write_kb":171712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":150,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.776515+0000","last_change":"2024-02-10T08:25:40.120844+0000","last_active":"2024-02-10T08:28:51.776515+0000","last_peered":"2024-02-10T08:28:51.776515+0000","last_clean":"2024-02-10T08:28:51.776515+0000","last_became_active":"2024-02-10T08:23:34.716306+0000","last_became_peered":"2024-02-10T08:23:34.716306+0000","last_unstale":"2024-02-10T08:28:51.776515+0000","last_undegraded":"2024-02-10T08:28:51.776515+0000","last_fullsized":"2024-02-10T08:28:51.776515+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:25:40.120782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:20:30.227375+0000","last_clean_scrub_stamp":"2024-02-10T08:25:40.120782+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,7],"acting":[6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":296,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.768904+0000","last_change":"2024-02-10T08:28:18.284825+0000","last_active":"2024-02-10T08:28:51.768904+0000","last_peered":"2024-02-10T08:28:51.768904+0000","last_clean":"2024-02-10T08:28:51.768904+0000","last_became_active":"2024-02-10T08:20:46.400500+0000","last_became_peered":"2024-02-10T08:20:46.400500+0000","last_unstale":"2024-02-10T08:28:51.768904+0000","last_undegraded":"2024-02-10T08:28:51.768904+0000","last_fullsized":"2024-02-10T08:28:51.768904+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:18.284751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:28:18.284751+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":253,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.772987+0000","last_change":"2024-02-10T08:28:02.768983+0000","last_active":"2024-02-10T08:28:51.772987+0000","last_peered":"2024-02-10T08:28:51.772987+0000","last_clean":"2024-02-10T08:28:51.772987+0000","last_became_active":"2024-02-10T08:28:02.768633+0000","last_became_peered":"2024-02-10T08:28:02.768633+0000","last_unstale":"2024-02-10T08:28:51.772987+0000","last_undegraded":"2024-02-10T08:28:51.772987+0000","last_fullsized":"2024-02-10T08:28:51.772987+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:25:37.371542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:25:37.371542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"225'24","reported_seq":256,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-02-10T08:28:50.739499+0000","last_change":"2024-02-10T08:28:18.012177+0000","last_active":"2024-02-10T08:28:50.739499+0000","last_peered":"2024-02-10T08:28:50.739499+0000","last_clean":"2024-02-10T08:28:50.739499+0000","last_became_active":"2024-02-10T08:20:46.406023+0000","last_became_peered":"2024-02-10T08:20:46.406023+0000","last_unstale":"2024-02-10T08:28:50.739499+0000","last_undegraded":"2024-02-10T08:28:50.739499+0000","last_fullsized":"2024-02-10T08:28:50.739499+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'24","last_scrub_stamp":"2024-02-10T08:28:18.012102+0000","last_deep_scrub":"76'16","last_deep_scrub_stamp":"2024-02-10T08:18:07.909782+0000","last_clean_scrub_stamp":"2024-02-10T08:28:18.012102+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"267'2660","reported_seq":2679,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-02-10T08:28:57.686171+0000","last_change":"2024-02-10T08:28:28.332050+0000","last_active":"2024-02-10T08:28:57.686171+0000","last_peered":"2024-02-10T08:28:57.686171+0000","last_clean":"2024-02-10T08:28:57.686171+0000","last_became_active":"2024-02-10T08:28:28.331715+0000","last_became_peered":"2024-02-10T08:28:28.331715+0000","last_unstale":"2024-02-10T08:28:57.686171+0000","last_undegraded":"2024-02-10T08:28:57.686171+0000","last_fullsized":"2024-02-10T08:28:57.686171+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_clean_scrub_stamp":"2024-02-10T08:28:27.172648+0000","log_size":2660,"ondisk_log_size":2660,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":174325760,"num_objects":2660,"num_object_clones":0,"num_object_copies":7980,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2660,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2660,"num_write_kb":170240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,7],"acting":[1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":243,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.768612+0000","last_change":"2024-02-10T08:28:36.163224+0000","last_active":"2024-02-10T08:28:51.768612+0000","last_peered":"2024-02-10T08:28:51.768612+0000","last_clean":"2024-02-10T08:28:51.768612+0000","last_became_active":"2024-02-10T08:23:15.078797+0000","last_became_peered":"2024-02-10T08:23:15.078797+0000","last_unstale":"2024-02-10T08:28:51.768612+0000","last_undegraded":"2024-02-10T08:28:51.768612+0000","last_fullsized":"2024-02-10T08:28:51.768612+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:36.163125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:36.163125+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,2],"acting":[5,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"261'13","reported_seq":89,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-02-10T08:28:55.752729+0000","last_change":"2024-02-10T08:28:38.322264+0000","last_active":"2024-02-10T08:28:55.752729+0000","last_peered":"2024-02-10T08:28:55.752729+0000","last_clean":"2024-02-10T08:28:55.752729+0000","last_became_active":"2024-02-10T08:28:38.231242+0000","last_became_peered":"2024-02-10T08:28:38.231242+0000","last_unstale":"2024-02-10T08:28:55.752729+0000","last_undegraded":"2024-02-10T08:28:55.752729+0000","last_fullsized":"2024-02-10T08:28:55.752729+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'10","last_scrub_stamp":"2024-02-10T08:26:17.102439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:26:17.102439+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,2],"acting":[5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":236,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.767811+0000","last_change":"2024-02-10T08:26:24.169444+0000","last_active":"2024-02-10T08:28:51.767811+0000","last_peered":"2024-02-10T08:28:51.767811+0000","last_clean":"2024-02-10T08:28:51.767811+0000","last_became_active":"2024-02-10T08:16:52.783634+0000","last_became_peered":"2024-02-10T08:16:52.783634+0000","last_unstale":"2024-02-10T08:28:51.767811+0000","last_undegraded":"2024-02-10T08:28:51.767811+0000","last_fullsized":"2024-02-10T08:28:51.767811+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:26:24.169341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:26:24.169341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"226'27","reported_seq":259,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.768128+0000","last_change":"2024-02-10T08:28:18.108820+0000","last_active":"2024-02-10T08:28:51.768128+0000","last_peered":"2024-02-10T08:28:51.768128+0000","last_clean":"2024-02-10T08:28:51.768128+0000","last_became_active":"2024-02-10T08:20:46.401777+0000","last_became_peered":"2024-02-10T08:20:46.401777+0000","last_unstale":"2024-02-10T08:28:51.768128+0000","last_undegraded":"2024-02-10T08:28:51.768128+0000","last_fullsized":"2024-02-10T08:28:51.768128+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"226'27","last_scrub_stamp":"2024-02-10T08:28:18.108712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:28:18.108712+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1","version":"267'2555","reported_seq":2574,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-02-10T08:28:57.597256+0000","last_change":"2024-02-10T08:28:28.530157+0000","last_active":"2024-02-10T08:28:57.597256+0000","last_peered":"2024-02-10T08:28:57.597256+0000","last_clean":"2024-02-10T08:28:57.597256+0000","last_became_active":"2024-02-10T08:28:28.529924+0000","last_became_peered":"2024-02-10T08:28:28.529924+0000","last_unstale":"2024-02-10T08:28:57.597256+0000","last_undegraded":"2024-02-10T08:28:57.597256+0000","last_fullsized":"2024-02-10T08:28:57.597256+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_clean_scrub_stamp":"2024-02-10T08:28:27.172648+0000","log_size":2555,"ondisk_log_size":2555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":167444480,"num_objects":2555,"num_object_clones":0,"num_object_copies":7665,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2555,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2555,"num_write_kb":163520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":204,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-02-10T08:28:50.739259+0000","last_change":"2024-02-10T08:28:26.976109+0000","last_active":"2024-02-10T08:28:50.739259+0000","last_peered":"2024-02-10T08:28:50.739259+0000","last_clean":"2024-02-10T08:28:50.739259+0000","last_became_active":"2024-02-10T08:20:46.405578+0000","last_became_peered":"2024-02-10T08:20:46.405578+0000","last_unstale":"2024-02-10T08:28:50.739259+0000","last_undegraded":"2024-02-10T08:28:50.739259+0000","last_fullsized":"2024-02-10T08:28:50.739259+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:26.976023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:26.976023+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"62'8","reported_seq":385,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-02-10T08:28:55.744897+0000","last_change":"2024-02-10T08:24:39.917285+0000","last_active":"2024-02-10T08:28:55.744897+0000","last_peered":"2024-02-10T08:28:55.744897+0000","last_clean":"2024-02-10T08:28:55.744897+0000","last_became_active":"2024-02-10T08:16:56.858101+0000","last_became_peered":"2024-02-10T08:16:56.858101+0000","last_unstale":"2024-02-10T08:28:55.744897+0000","last_undegraded":"2024-02-10T08:28:55.744897+0000","last_fullsized":"2024-02-10T08:28:55.744897+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'8","last_scrub_stamp":"2024-02-10T08:24:39.917176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:24:39.917176+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":236,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.771927+0000","last_change":"2024-02-10T08:26:19.229352+0000","last_active":"2024-02-10T08:28:51.771927+0000","last_peered":"2024-02-10T08:28:51.771927+0000","last_clean":"2024-02-10T08:28:51.771927+0000","last_became_active":"2024-02-10T08:16:52.785545+0000","last_became_peered":"2024-02-10T08:16:52.785545+0000","last_unstale":"2024-02-10T08:28:51.771927+0000","last_undegraded":"2024-02-10T08:28:51.771927+0000","last_fullsized":"2024-02-10T08:28:51.771927+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:26:19.229261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:26:19.229261+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"225'20","reported_seq":249,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-02-10T08:28:50.738820+0000","last_change":"2024-02-10T08:26:39.910278+0000","last_active":"2024-02-10T08:28:50.738820+0000","last_peered":"2024-02-10T08:28:50.738820+0000","last_clean":"2024-02-10T08:28:50.738820+0000","last_became_active":"2024-02-10T08:20:46.398973+0000","last_became_peered":"2024-02-10T08:20:46.398973+0000","last_unstale":"2024-02-10T08:28:50.738820+0000","last_undegraded":"2024-02-10T08:28:50.738820+0000","last_fullsized":"2024-02-10T08:28:50.738820+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'10","last_scrub_stamp":"2024-02-10T08:26:39.910195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:26:39.910195+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":24,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"267'2601","reported_seq":2620,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-02-10T08:28:57.701448+0000","last_change":"2024-02-10T08:28:28.332122+0000","last_active":"2024-02-10T08:28:57.701448+0000","last_peered":"2024-02-10T08:28:57.701448+0000","last_clean":"2024-02-10T08:28:57.701448+0000","last_became_active":"2024-02-10T08:28:28.331811+0000","last_became_peered":"2024-02-10T08:28:28.331811+0000","last_unstale":"2024-02-10T08:28:57.701448+0000","last_undegraded":"2024-02-10T08:28:57.701448+0000","last_fullsized":"2024-02-10T08:28:57.701448+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_clean_scrub_stamp":"2024-02-10T08:28:27.172648+0000","log_size":2601,"ondisk_log_size":2601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":170459136,"num_objects":2601,"num_object_clones":0,"num_object_copies":7803,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2601,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2601,"num_write_kb":166464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":194,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.776952+0000","last_change":"2024-02-10T08:28:34.215446+0000","last_active":"2024-02-10T08:28:51.776952+0000","last_peered":"2024-02-10T08:28:51.776952+0000","last_clean":"2024-02-10T08:28:51.776952+0000","last_became_active":"2024-02-10T08:28:26.000711+0000","last_became_peered":"2024-02-10T08:28:26.000711+0000","last_unstale":"2024-02-10T08:28:51.776952+0000","last_undegraded":"2024-02-10T08:28:51.776952+0000","last_fullsized":"2024-02-10T08:28:51.776952+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:34.215363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:34.215363+0000","last_clean_scrub_stamp":"2024-02-10T08:28:34.215363+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6],"acting":[0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":260,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.768519+0000","last_change":"2024-02-10T08:28:02.764584+0000","last_active":"2024-02-10T08:28:51.768519+0000","last_peered":"2024-02-10T08:28:51.768519+0000","last_clean":"2024-02-10T08:28:51.768519+0000","last_became_active":"2024-02-10T08:28:02.764210+0000","last_became_peered":"2024-02-10T08:28:02.764210+0000","last_unstale":"2024-02-10T08:28:51.768519+0000","last_undegraded":"2024-02-10T08:28:51.768519+0000","last_fullsized":"2024-02-10T08:28:51.768519+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:25:31.881772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:25:31.881772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":250,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.772835+0000","last_change":"2024-02-10T08:25:29.293026+0000","last_active":"2024-02-10T08:28:51.772835+0000","last_peered":"2024-02-10T08:28:51.772835+0000","last_clean":"2024-02-10T08:28:51.772835+0000","last_became_active":"2024-02-10T08:20:46.399568+0000","last_became_peered":"2024-02-10T08:20:46.399568+0000","last_unstale":"2024-02-10T08:28:51.772835+0000","last_undegraded":"2024-02-10T08:28:51.772835+0000","last_fullsized":"2024-02-10T08:28:51.772835+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:25:29.292955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:25:29.292955+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"225'31","reported_seq":284,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.768196+0000","last_change":"2024-02-10T08:28:38.271681+0000","last_active":"2024-02-10T08:28:51.768196+0000","last_peered":"2024-02-10T08:28:51.768196+0000","last_clean":"2024-02-10T08:28:51.768196+0000","last_became_active":"2024-02-10T08:28:38.237476+0000","last_became_peered":"2024-02-10T08:28:38.237476+0000","last_unstale":"2024-02-10T08:28:51.768196+0000","last_undegraded":"2024-02-10T08:28:51.768196+0000","last_fullsized":"2024-02-10T08:28:51.768196+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'31","last_scrub_stamp":"2024-02-10T08:28:14.001126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:28:14.001126+0000","log_size":31,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":48,"num_read_kb":38,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.7","version":"267'2687","reported_seq":2706,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-02-10T08:28:57.590287+0000","last_change":"2024-02-10T08:28:28.331926+0000","last_active":"2024-02-10T08:28:57.590287+0000","last_peered":"2024-02-10T08:28:57.590287+0000","last_clean":"2024-02-10T08:28:57.590287+0000","last_became_active":"2024-02-10T08:28:28.331632+0000","last_became_peered":"2024-02-10T08:28:28.331632+0000","last_unstale":"2024-02-10T08:28:57.590287+0000","last_undegraded":"2024-02-10T08:28:57.590287+0000","last_fullsized":"2024-02-10T08:28:57.590287+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_clean_scrub_stamp":"2024-02-10T08:28:27.172648+0000","log_size":2687,"ondisk_log_size":2687,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":176095232,"num_objects":2687,"num_object_clones":0,"num_object_copies":8061,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2687,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2687,"num_write_kb":171968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2],"acting":[5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":247,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.771852+0000","last_change":"2024-02-10T08:28:22.114493+0000","last_active":"2024-02-10T08:28:51.771852+0000","last_peered":"2024-02-10T08:28:51.771852+0000","last_clean":"2024-02-10T08:28:51.771852+0000","last_became_active":"2024-02-10T08:24:18.645480+0000","last_became_peered":"2024-02-10T08:24:18.645480+0000","last_unstale":"2024-02-10T08:28:51.771852+0000","last_undegraded":"2024-02-10T08:28:51.771852+0000","last_fullsized":"2024-02-10T08:28:51.771852+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:22.114421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:22.114421+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,3],"acting":[7,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":255,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.769518+0000","last_change":"2024-02-10T08:28:19.149963+0000","last_active":"2024-02-10T08:28:51.769518+0000","last_peered":"2024-02-10T08:28:51.769518+0000","last_clean":"2024-02-10T08:28:51.769518+0000","last_became_active":"2024-02-10T08:28:02.779438+0000","last_became_peered":"2024-02-10T08:28:02.779438+0000","last_unstale":"2024-02-10T08:28:51.769518+0000","last_undegraded":"2024-02-10T08:28:51.769518+0000","last_fullsized":"2024-02-10T08:28:51.769518+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:19.149900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:28:19.149900+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":259,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.767537+0000","last_change":"2024-02-10T08:28:02.781347+0000","last_active":"2024-02-10T08:28:51.767537+0000","last_peered":"2024-02-10T08:28:51.767537+0000","last_clean":"2024-02-10T08:28:51.767537+0000","last_became_active":"2024-02-10T08:28:02.781029+0000","last_became_peered":"2024-02-10T08:28:02.781029+0000","last_unstale":"2024-02-10T08:28:51.767537+0000","last_undegraded":"2024-02-10T08:28:51.767537+0000","last_fullsized":"2024-02-10T08:28:51.767537+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:26:25.120940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:26:25.120940+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"226'35","reported_seq":288,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.776240+0000","last_change":"2024-02-10T08:25:37.130619+0000","last_active":"2024-02-10T08:28:51.776240+0000","last_peered":"2024-02-10T08:28:51.776240+0000","last_clean":"2024-02-10T08:28:51.776240+0000","last_became_active":"2024-02-10T08:16:55.203415+0000","last_became_peered":"2024-02-10T08:16:55.203415+0000","last_unstale":"2024-02-10T08:28:51.776240+0000","last_undegraded":"2024-02-10T08:28:51.776240+0000","last_fullsized":"2024-02-10T08:28:51.776240+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'19","last_scrub_stamp":"2024-02-10T08:25:37.130515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:25:37.130515+0000","log_size":35,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":56,"num_read_kb":45,"num_write":36,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.6","version":"267'2591","reported_seq":2610,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-02-10T08:28:57.589487+0000","last_change":"2024-02-10T08:28:28.331984+0000","last_active":"2024-02-10T08:28:57.589487+0000","last_peered":"2024-02-10T08:28:57.589487+0000","last_clean":"2024-02-10T08:28:57.589487+0000","last_became_active":"2024-02-10T08:28:28.331662+0000","last_became_peered":"2024-02-10T08:28:28.331662+0000","last_unstale":"2024-02-10T08:28:57.589487+0000","last_undegraded":"2024-02-10T08:28:57.589487+0000","last_fullsized":"2024-02-10T08:28:57.589487+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_clean_scrub_stamp":"2024-02-10T08:28:27.172648+0000","log_size":2591,"ondisk_log_size":2591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":169803776,"num_objects":2591,"num_object_clones":0,"num_object_copies":7773,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2591,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2591,"num_write_kb":165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,1],"acting":[5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"76'2","reported_seq":137,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.772257+0000","last_change":"2024-02-10T08:28:20.073164+0000","last_active":"2024-02-10T08:28:51.772257+0000","last_peered":"2024-02-10T08:28:51.772257+0000","last_clean":"2024-02-10T08:28:51.772257+0000","last_became_active":"2024-02-10T08:23:34.718483+0000","last_became_peered":"2024-02-10T08:23:34.718483+0000","last_unstale":"2024-02-10T08:28:51.772257+0000","last_undegraded":"2024-02-10T08:28:51.772257+0000","last_fullsized":"2024-02-10T08:28:51.772257+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'2","last_scrub_stamp":"2024-02-10T08:28:20.073105+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2024-02-10T08:18:08.680038+0000","last_clean_scrub_stamp":"2024-02-10T08:28:20.073105+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":274,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.767730+0000","last_change":"2024-02-10T08:28:25.266206+0000","last_active":"2024-02-10T08:28:51.767730+0000","last_peered":"2024-02-10T08:28:51.767730+0000","last_clean":"2024-02-10T08:28:51.767730+0000","last_became_active":"2024-02-10T08:28:02.781897+0000","last_became_peered":"2024-02-10T08:28:02.781897+0000","last_unstale":"2024-02-10T08:28:51.767730+0000","last_undegraded":"2024-02-10T08:28:51.767730+0000","last_fullsized":"2024-02-10T08:28:51.767730+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:25.266124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:28:25.266124+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0],"acting":[2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":251,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.769050+0000","last_change":"2024-02-10T08:25:42.035602+0000","last_active":"2024-02-10T08:28:51.769050+0000","last_peered":"2024-02-10T08:28:51.769050+0000","last_clean":"2024-02-10T08:28:51.769050+0000","last_became_active":"2024-02-10T08:20:46.407311+0000","last_became_peered":"2024-02-10T08:20:46.407311+0000","last_unstale":"2024-02-10T08:28:51.769050+0000","last_undegraded":"2024-02-10T08:28:51.769050+0000","last_fullsized":"2024-02-10T08:28:51.769050+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:25:42.035497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:21.523096+0000","last_clean_scrub_stamp":"2024-02-10T08:25:42.035497+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"225'15","reported_seq":48,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.776654+0000","last_change":"2024-02-10T08:28:15.049130+0000","last_active":"2024-02-10T08:28:51.776654+0000","last_peered":"2024-02-10T08:28:51.776654+0000","last_clean":"2024-02-10T08:28:51.776654+0000","last_became_active":"2024-02-10T08:28:02.770508+0000","last_became_peered":"2024-02-10T08:28:02.770508+0000","last_unstale":"2024-02-10T08:28:51.776654+0000","last_undegraded":"2024-02-10T08:28:51.776654+0000","last_fullsized":"2024-02-10T08:28:51.776654+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'15","last_scrub_stamp":"2024-02-10T08:28:15.049059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:28:15.049059+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.5","version":"267'2746","reported_seq":2765,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-02-10T08:28:58.105924+0000","last_change":"2024-02-10T08:28:28.190785+0000","last_active":"2024-02-10T08:28:58.105924+0000","last_peered":"2024-02-10T08:28:58.105924+0000","last_clean":"2024-02-10T08:28:58.105924+0000","last_became_active":"2024-02-10T08:28:28.190416+0000","last_became_peered":"2024-02-10T08:28:28.190416+0000","last_unstale":"2024-02-10T08:28:58.105924+0000","last_undegraded":"2024-02-10T08:28:58.105924+0000","last_fullsized":"2024-02-10T08:28:58.105924+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_clean_scrub_stamp":"2024-02-10T08:28:27.172648+0000","log_size":2746,"ondisk_log_size":2746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":179961856,"num_objects":2746,"num_object_clones":0,"num_object_copies":8238,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2746,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2746,"num_write_kb":175744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":252,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.767240+0000","last_change":"2024-02-10T08:28:30.227204+0000","last_active":"2024-02-10T08:28:51.767240+0000","last_peered":"2024-02-10T08:28:51.767240+0000","last_clean":"2024-02-10T08:28:51.767240+0000","last_became_active":"2024-02-10T08:28:02.776088+0000","last_became_peered":"2024-02-10T08:28:02.776088+0000","last_unstale":"2024-02-10T08:28:51.767240+0000","last_undegraded":"2024-02-10T08:28:51.767240+0000","last_fullsized":"2024-02-10T08:28:51.767240+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:30.227120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:20.392249+0000","last_clean_scrub_stamp":"2024-02-10T08:28:30.227120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":250,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.767671+0000","last_change":"2024-02-10T08:25:35.271459+0000","last_active":"2024-02-10T08:28:51.767671+0000","last_peered":"2024-02-10T08:28:51.767671+0000","last_clean":"2024-02-10T08:28:51.767671+0000","last_became_active":"2024-02-10T08:23:15.074046+0000","last_became_peered":"2024-02-10T08:23:15.074046+0000","last_unstale":"2024-02-10T08:28:51.767671+0000","last_undegraded":"2024-02-10T08:28:51.767671+0000","last_fullsized":"2024-02-10T08:28:51.767671+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:25:35.271397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:25:35.271397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,6],"acting":[2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"225'27","reported_seq":276,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-10T08:28:51.767068+0000","last_change":"2024-02-10T08:25:27.759088+0000","last_active":"2024-02-10T08:28:51.767068+0000","last_peered":"2024-02-10T08:28:51.767068+0000","last_clean":"2024-02-10T08:28:51.767068+0000","last_became_active":"2024-02-10T08:16:55.204597+0000","last_became_peered":"2024-02-10T08:16:55.204597+0000","last_unstale":"2024-02-10T08:28:51.767068+0000","last_undegraded":"2024-02-10T08:28:51.767068+0000","last_fullsized":"2024-02-10T08:28:51.767068+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'15","last_scrub_stamp":"2024-02-10T08:25:27.758994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:25:27.758994+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"111'10","reported_seq":417,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-02-10T08:28:55.744240+0000","last_change":"2024-02-10T08:28:29.196174+0000","last_active":"2024-02-10T08:28:55.744240+0000","last_peered":"2024-02-10T08:28:55.744240+0000","last_clean":"2024-02-10T08:28:55.744240+0000","last_became_active":"2024-02-10T08:20:46.399193+0000","last_became_peered":"2024-02-10T08:20:46.399193+0000","last_unstale":"2024-02-10T08:28:55.744240+0000","last_undegraded":"2024-02-10T08:28:55.744240+0000","last_fullsized":"2024-02-10T08:28:55.744240+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'10","last_scrub_stamp":"2024-02-10T08:28:29.196109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:28:29.196109+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":2767323136,"num_objects":42226,"num_object_clones":0,"num_object_copies":126678,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42226,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42226,"num_write_kb":2702464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8300199936,"data_stored":8300199936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42226,"ondisk_log_size":42226,"up":48,"acting":48,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2646,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":4},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":715,"num_read_kb":710,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":9,"acting":9,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":1107,"num_read_kb":864,"num_write":703,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":127,"num_bytes_recovered":3108,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":725,"ondisk_log_size":725,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":89,"ondisk_log_size":89,"up":96,"acting":96,"num_store_stats":8},{"poolid":6,"num_pg":42,"stat_sum":{"num_bytes":376,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":26,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":126,"acting":126,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":50,"seq":214748364949,"num_pgs":78,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2165048,"kb_used_data":1855536,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":91580104,"statfs":{"total":95995035648,"available":93778026496,"internally_reserved":0,"allocated":1900068864,"data_stored":1899605129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,4,1,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:28:04 2024","interfaces":[{"interface":"back","average":{"1min":1.514,"5min":1.669,"15min":1.1240000000000001},"min":{"1min":0.25600000000000001,"5min":0.20899999999999999,"15min":0.20300000000000001},"max":{"1min":6.899,"5min":14.734,"15min":21.175999999999998},"last":2.4140000000000001},{"interface":"front","average":{"1min":2.145,"5min":2.1139999999999999,"15min":1.51},"min":{"1min":0.23000000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":9.6999999999999993,"5min":15.06,"15min":22.57},"last":1.962}]},{"osd":1,"last update":"Sat Feb 10 08:28:04 2024","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.516,"15min":1.1160000000000001},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":5.9969999999999999,"5min":11.779,"15min":15.476000000000001},"last":4.6470000000000002},{"interface":"front","average":{"1min":1.839,"5min":1.8160000000000001,"15min":1.2190000000000001},"min":{"1min":0.34399999999999997,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":7.3799999999999999,"5min":12.237,"15min":12.237},"last":1.9159999999999999}]},{"osd":2,"last update":"Sat Feb 10 08:28:04 2024","interfaces":[{"interface":"back","average":{"1min":1.546,"5min":1.4650000000000001,"15min":1.1180000000000001},"min":{"1min":0.255,"5min":0.251,"15min":0.251},"max":{"1min":6.3150000000000004,"5min":8.3940000000000001,"15min":8.3940000000000001},"last":0.47699999999999998},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.4870000000000001,"15min":1.1739999999999999},"min":{"1min":0.31,"5min":0.26300000000000001,"15min":0.25900000000000001},"max":{"1min":6.2089999999999996,"5min":12.797000000000001,"15min":12.797000000000001},"last":2.456}]},{"osd":3,"last update":"Sat Feb 10 08:28:04 2024","interfaces":[{"interface":"back","average":{"1min":1.585,"5min":1.544,"15min":1.1639999999999999},"min":{"1min":0.31900000000000001,"5min":0.318,"15min":0.27700000000000002},"max":{"1min":4.4939999999999998,"5min":7.8330000000000002,"15min":18.515000000000001},"last":0.52800000000000002},{"interface":"front","average":{"1min":1.5109999999999999,"5min":1.681,"15min":1.252},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":8.5800000000000001,"5min":9.9969999999999999,"15min":9.9969999999999999},"last":2.5059999999999998}]},{"osd":4,"last update":"Sat Feb 10 08:28:00 2024","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.0029999999999999,"15min":0.68100000000000005},"min":{"1min":0.28499999999999998,"5min":0.22700000000000001,"15min":0.216},"max":{"1min":4.5860000000000003,"5min":9.7590000000000003,"15min":9.7590000000000003},"last":3.1640000000000001},{"interface":"front","average":{"1min":0.93799999999999994,"5min":1.214,"15min":0.68500000000000005},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":5.6790000000000003,"5min":12.987,"15min":12.987},"last":4.7130000000000001}]},{"osd":5,"last update":"Sat Feb 10 08:28:04 2024","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.498,"15min":0.80300000000000005},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.218},"max":{"1min":5.7220000000000004,"5min":11.314,"15min":11.314},"last":4.6879999999999997},{"interface":"front","average":{"1min":1.5680000000000001,"5min":1.2849999999999999,"15min":0.77800000000000002},"min":{"1min":0.26500000000000001,"5min":0.26300000000000001,"15min":0.22600000000000001},"max":{"1min":7.343,"5min":10.023999999999999,"15min":10.023999999999999},"last":2.1850000000000001}]},{"osd":6,"last update":"Sat Feb 10 08:28:04 2024","interfaces":[{"interface":"back","average":{"1min":1.623,"5min":1.2789999999999999,"15min":0.72999999999999998},"min":{"1min":0.34799999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":7.5030000000000001,"5min":7.5030000000000001,"15min":7.5030000000000001},"last":2.1259999999999999},{"interface":"front","average":{"1min":1.6140000000000001,"5min":1.0780000000000001,"15min":0.72099999999999997},"min":{"1min":0.35699999999999998,"5min":0.28199999999999997,"15min":0.224},"max":{"1min":5.694,"5min":9.4290000000000003,"15min":9.4290000000000003},"last":0.504}]}]},{"osd":6,"up_from":43,"seq":184683593882,"num_pgs":65,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":810364,"kb_used_data":496756,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":92934788,"statfs":{"total":95995035648,"available":95165222912,"internally_reserved":0,"allocated":508678144,"data_stored":508210586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:28:38 2024","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":1.6859999999999999,"15min":1.629},"min":{"1min":0.23300000000000001,"5min":0.21299999999999999,"15min":0.19400000000000001},"max":{"1min":4.5179999999999998,"5min":27.611000000000001,"15min":30.509},"last":0.222},{"interface":"front","average":{"1min":0.72399999999999998,"5min":1.496,"15min":1.4239999999999999},"min":{"1min":0.252,"5min":0.214,"15min":0.21099999999999999},"max":{"1min":3.5470000000000002,"5min":8.9559999999999995,"15min":36.090000000000003},"last":0.50600000000000001}]},{"osd":1,"last update":"Sat Feb 10 08:28:38 2024","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.528,"15min":1.202},"min":{"1min":0.23899999999999999,"5min":0.23000000000000001,"15min":0.20899999999999999},"max":{"1min":4.6289999999999996,"5min":8.9369999999999994,"15min":12.938000000000001},"last":2.2869999999999999},{"interface":"front","average":{"1min":0.93600000000000005,"5min":1.5680000000000001,"15min":1.25},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":5.1980000000000004,"5min":10.441000000000001,"15min":10.441000000000001},"last":4.375}]},{"osd":2,"last update":"Sat Feb 10 08:28:38 2024","interfaces":[{"interface":"back","average":{"1min":2.181,"5min":1.827,"15min":1.5229999999999999},"min":{"1min":0.307,"5min":0.28499999999999998,"15min":0.24399999999999999},"max":{"1min":25.146999999999998,"5min":25.146999999999998,"15min":35.072000000000003},"last":6.7380000000000004},{"interface":"front","average":{"1min":1.839,"5min":1.6919999999999999,"15min":1.4730000000000001},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":25.135999999999999,"5min":25.135999999999999,"15min":35.103000000000002},"last":6.2809999999999997}]},{"osd":3,"last update":"Sat Feb 10 08:28:38 2024","interfaces":[{"interface":"back","average":{"1min":1.494,"5min":1.865,"15min":1.3149999999999999},"min":{"1min":0.36699999999999999,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":4.6040000000000001,"5min":11.448,"15min":15.212999999999999},"last":3.294},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.5920000000000001,"15min":1.3320000000000001},"min":{"1min":0.26300000000000001,"5min":0.253,"15min":0.253},"max":{"1min":6.7839999999999998,"5min":10.586,"15min":17.797000000000001},"last":4.4100000000000001}]},{"osd":4,"last update":"Sat Feb 10 08:28:03 2024","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.1100000000000001,"15min":0.70599999999999996},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":5.4189999999999996,"5min":9.3879999999999999,"15min":9.3879999999999999},"last":2.3109999999999999},{"interface":"front","average":{"1min":1.573,"5min":1.1679999999999999,"15min":0.78600000000000003},"min":{"1min":0.27000000000000002,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":7.3419999999999996,"5min":10.348000000000001,"15min":10.348000000000001},"last":2.2570000000000001}]},{"osd":5,"last update":"Sat Feb 10 08:28:38 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":1.2490000000000001,"15min":0.753},"min":{"1min":0.30199999999999999,"5min":0.27000000000000002,"15min":0.20200000000000001},"max":{"1min":3.601,"5min":7.2320000000000002,"15min":7.2320000000000002},"last":4.7889999999999997},{"interface":"front","average":{"1min":1.3029999999999999,"5min":1.323,"15min":0.79100000000000004},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.22900000000000001},"max":{"1min":5.6239999999999997,"5min":6.7999999999999998,"15min":6.7999999999999998},"last":2.242}]},{"osd":7,"last update":"Sat Feb 10 08:28:03 2024","interfaces":[{"interface":"back","average":{"1min":1.401,"5min":3.2250000000000001,"15min":1.4159999999999999},"min":{"1min":0.29299999999999998,"5min":0.26200000000000001,"15min":0.23999999999999999},"max":{"1min":4.5810000000000004,"5min":194.88900000000001,"15min":194.88900000000001},"last":2.2189999999999999},{"interface":"front","average":{"1min":1.5629999999999999,"5min":3.419,"15min":1.5089999999999999},"min":{"1min":0.36499999999999999,"5min":0.34000000000000002,"15min":0.26400000000000001},"max":{"1min":6.4669999999999996,"5min":194.74100000000001,"15min":194.74100000000001},"last":2.2690000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575025,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1817284,"kb_used_data":1515964,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":91927868,"statfs":{"total":95995035648,"available":94134136832,"internally_reserved":0,"allocated":1552347136,"data_stored":1551871047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,2,0,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:28:40 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":1.264,"15min":1.573},"min":{"1min":0.23200000000000001,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":2.593,"5min":13.316000000000001,"15min":29.763999999999999},"last":3.4790000000000001},{"interface":"front","average":{"1min":0.77800000000000002,"5min":1.6499999999999999,"15min":1.7529999999999999},"min":{"1min":0.27900000000000003,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":6.3550000000000004,"5min":21.405000000000001,"15min":29.637},"last":5.827}]},{"osd":2,"last update":"Sat Feb 10 08:28:07 2024","interfaces":[{"interface":"back","average":{"1min":1.6419999999999999,"5min":2.3690000000000002,"15min":1.7490000000000001},"min":{"1min":0.23000000000000001,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":6.4450000000000003,"5min":31.420999999999999,"15min":31.420999999999999},"last":1.04},{"interface":"front","average":{"1min":1.111,"5min":2.6779999999999999,"15min":1.899},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":4.6539999999999999,"5min":31.484999999999999,"15min":31.484999999999999},"last":4.8070000000000004}]},{"osd":3,"last update":"Sat Feb 10 08:28:32 2024","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":2.0489999999999999,"15min":1.893},"min":{"1min":0.253,"5min":0.247,"15min":0.247},"max":{"1min":5.2779999999999996,"5min":19.096,"15min":28.082000000000001},"last":3.726},{"interface":"front","average":{"1min":1.149,"5min":1.4610000000000001,"15min":1.546},"min":{"1min":0.317,"5min":0.22900000000000001,"15min":0.20300000000000001},"max":{"1min":5.883,"5min":21.103999999999999,"15min":29.722000000000001},"last":0.27600000000000002}]},{"osd":4,"last update":"Sat Feb 10 08:27:59 2024","interfaces":[{"interface":"back","average":{"1min":1.9670000000000001,"5min":1.8240000000000001,"15min":2.1920000000000002},"min":{"1min":0.312,"5min":0.27300000000000002,"15min":0.26100000000000001},"max":{"1min":6.4059999999999997,"5min":14.086,"15min":14.086},"last":4.7679999999999998},{"interface":"front","average":{"1min":1.9119999999999999,"5min":2.496,"15min":2.5920000000000001},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":4.8840000000000003,"5min":31.515000000000001,"15min":31.515000000000001},"last":3.7989999999999999}]},{"osd":5,"last update":"Sat Feb 10 08:28:11 2024","interfaces":[{"interface":"back","average":{"1min":1.5209999999999999,"5min":2.153,"15min":1.5209999999999999},"min":{"1min":0.38200000000000001,"5min":0.32800000000000001,"15min":0.26000000000000001},"max":{"1min":6.4039999999999999,"5min":40.140999999999998,"15min":40.140999999999998},"last":4.7320000000000002},{"interface":"front","average":{"1min":1.7150000000000001,"5min":2.7949999999999999,"15min":1.754},"min":{"1min":0.434,"5min":0.30399999999999999,"15min":0.28499999999999998},"max":{"1min":6.1699999999999999,"5min":40.831000000000003,"15min":40.831000000000003},"last":3.77}]},{"osd":6,"last update":"Sat Feb 10 08:28:40 2024","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":2.1629999999999998,"15min":1.5529999999999999},"min":{"1min":0.39500000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":4.7290000000000001,"5min":31.27,"15min":31.27},"last":3.827},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.5149999999999999,"15min":1.258},"min":{"1min":0.41399999999999998,"5min":0.35399999999999998,"15min":0.27700000000000002},"max":{"1min":4.7430000000000003,"5min":10.238,"15min":10.433},"last":1.327}]},{"osd":7,"last update":"Sat Feb 10 08:28:07 2024","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":2.254,"15min":1.5269999999999999},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":4.7789999999999999,"5min":31.344999999999999,"15min":31.344999999999999},"last":3.859},{"interface":"front","average":{"1min":1.4830000000000001,"5min":1.583,"15min":1.2190000000000001},"min":{"1min":0.40699999999999997,"5min":0.32600000000000001,"15min":0.312},"max":{"1min":5.3520000000000003,"5min":14.872,"15min":14.872},"last":0.55600000000000005}]}]},{"osd":0,"up_from":8,"seq":34359738550,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":813468,"kb_used_data":508052,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":92931684,"statfs":{"total":95995035648,"available":95162044416,"internally_reserved":0,"allocated":520245248,"data_stored":519809360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 10 08:28:48 2024","interfaces":[{"interface":"back","average":{"1min":1.5920000000000001,"5min":1.863,"15min":2.1629999999999998},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.14399999999999999},"max":{"1min":7.9989999999999997,"5min":22.460000000000001,"15min":102.48099999999999},"last":5.0430000000000001},{"interface":"front","average":{"1min":1.625,"5min":1.671,"15min":1.992},"min":{"1min":0.23000000000000001,"5min":0.19800000000000001,"15min":0.193},"max":{"1min":11.367000000000001,"5min":23.27,"15min":103.38800000000001},"last":2.6890000000000001}]},{"osd":2,"last update":"Sat Feb 10 08:28:05 2024","interfaces":[{"interface":"back","average":{"1min":2.0379999999999998,"5min":3.2690000000000001,"15min":2.2029999999999998},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":9.5329999999999995,"5min":102.462,"15min":102.462},"last":0.83699999999999997},{"interface":"front","average":{"1min":1.8009999999999999,"5min":3.3370000000000002,"15min":2.0899999999999999},"min":{"1min":0.23000000000000001,"5min":0.222,"15min":0.20799999999999999},"max":{"1min":5.6509999999999998,"5min":102.66500000000001,"15min":102.66500000000001},"last":4.5780000000000003}]},{"osd":3,"last update":"Sat Feb 10 08:28:33 2024","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.575,"15min":1.7470000000000001},"min":{"1min":0.28899999999999998,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":6.0339999999999998,"5min":11.936999999999999,"15min":16.495000000000001},"last":1.6890000000000001},{"interface":"front","average":{"1min":1.23,"5min":2.9039999999999999,"15min":2.2200000000000002},"min":{"1min":0.28599999999999998,"5min":0.222,"15min":0.222},"max":{"1min":8.4570000000000007,"5min":102.64400000000001,"15min":102.64400000000001},"last":0.89600000000000002}]},{"osd":4,"last update":"Sat Feb 10 08:28:56 2024","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.573,"15min":3.298},"min":{"1min":0.32500000000000001,"5min":0.26800000000000002,"15min":0.253},"max":{"1min":4.9340000000000002,"5min":8.4239999999999995,"15min":102.742},"last":0.45600000000000002},{"interface":"front","average":{"1min":1.149,"5min":1.3620000000000001,"15min":1.8540000000000001},"min":{"1min":0.39200000000000002,"5min":0.31,"15min":0.26200000000000001},"max":{"1min":4.5579999999999998,"5min":7.3890000000000002,"15min":16.352},"last":3.3340000000000001}]},{"osd":5,"last update":"Sat Feb 10 08:28:23 2024","interfaces":[{"interface":"back","average":{"1min":1.762,"5min":2.681,"15min":1.738},"min":{"1min":0.34499999999999997,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":5.7590000000000003,"5min":102.53100000000001,"15min":102.53100000000001},"last":4.6239999999999997},{"interface":"front","average":{"1min":2.2429999999999999,"5min":1.837,"15min":1.373},"min":{"1min":0.34899999999999998,"5min":0.33900000000000002,"15min":0.22500000000000001},"max":{"1min":9.7360000000000007,"5min":10.103,"15min":16.463999999999999},"last":2.3530000000000002}]},{"osd":6,"last update":"Sat Feb 10 08:28:48 2024","interfaces":[{"interface":"back","average":{"1min":1.5389999999999999,"5min":1.609,"15min":1.8049999999999999},"min":{"1min":0.40999999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":7.5810000000000004,"5min":10.896000000000001,"15min":102.583},"last":5.5090000000000003},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.4610000000000001,"15min":1.3240000000000001},"min":{"1min":0.432,"5min":0.372,"15min":0.308},"max":{"1min":5.7060000000000004,"5min":6.0549999999999997,"15min":16.391999999999999},"last":1.7310000000000001}]},{"osd":7,"last update":"Sat Feb 10 08:28:05 2024","interfaces":[{"interface":"back","average":{"1min":2.161,"5min":5.3799999999999999,"15min":2.5899999999999999},"min":{"1min":0.36299999999999999,"5min":0.35299999999999998,"15min":0.34100000000000003},"max":{"1min":6.6130000000000004,"5min":255.53200000000001,"15min":255.53200000000001},"last":4.6859999999999999},{"interface":"front","average":{"1min":2.234,"5min":4.1219999999999999,"15min":2.1120000000000001},"min":{"1min":0.40600000000000003,"5min":0.33100000000000002,"15min":0.28599999999999998},"max":{"1min":6.8319999999999999,"5min":254.88800000000001,"15min":254.88800000000001},"last":3.1299999999999999}]}]},{"osd":2,"up_from":18,"seq":77309411501,"num_pgs":61,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1314284,"kb_used_data":1004772,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":92430868,"statfs":{"total":95995035648,"available":94649208832,"internally_reserved":0,"allocated":1028886528,"data_stored":1028434517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:28:14 2024","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":1.7529999999999999,"15min":1.5580000000000001},"min":{"1min":0.216,"5min":0.184,"15min":0.17399999999999999},"max":{"1min":6.1369999999999996,"5min":20.898,"15min":24.859999999999999},"last":0.28899999999999998},{"interface":"front","average":{"1min":1.6890000000000001,"5min":2.0750000000000002,"15min":1.909},"min":{"1min":0.254,"5min":0.20399999999999999,"15min":0.193},"max":{"1min":9.2219999999999995,"5min":20.734999999999999,"15min":28.295999999999999},"last":0.45000000000000001}]},{"osd":1,"last update":"Sat Feb 10 08:28:14 2024","interfaces":[{"interface":"back","average":{"1min":2.855,"5min":2.2690000000000001,"15min":1.5149999999999999},"min":{"1min":0.216,"5min":0.20999999999999999,"15min":0.19700000000000001},"max":{"1min":13.622,"5min":13.622,"15min":15.644},"last":0.746},{"interface":"front","average":{"1min":1.327,"5min":1.681,"15min":1.202},"min":{"1min":0.29599999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":5.9000000000000004,"5min":16.968,"15min":16.968},"last":0.25800000000000001}]},{"osd":3,"last update":"Sat Feb 10 08:28:32 2024","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.7829999999999999,"15min":1.665},"min":{"1min":0.35199999999999998,"5min":0.24199999999999999,"15min":0.23300000000000001},"max":{"1min":5.3899999999999997,"5min":10.734,"15min":24.946000000000002},"last":2.5049999999999999},{"interface":"front","average":{"1min":0.88900000000000001,"5min":1.778,"15min":1.8009999999999999},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.22900000000000001},"max":{"1min":4.2380000000000004,"5min":14.282,"15min":24.905000000000001},"last":0.315}]},{"osd":4,"last update":"Sat Feb 10 08:27:59 2024","interfaces":[{"interface":"back","average":{"1min":1.849,"5min":1.6759999999999999,"15min":2.2309999999999999},"min":{"1min":0.318,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":6.6529999999999996,"5min":7.3470000000000004,"15min":13.260999999999999},"last":2.1600000000000001},{"interface":"front","average":{"1min":1.8680000000000001,"5min":1.181,"15min":1.3540000000000001},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":6.7060000000000004,"5min":9.5190000000000001,"15min":15.696},"last":0.33200000000000002}]},{"osd":5,"last update":"Sat Feb 10 08:28:21 2024","interfaces":[{"interface":"back","average":{"1min":2.48,"5min":1.952,"15min":1.4470000000000001},"min":{"1min":0.34999999999999998,"5min":0.29999999999999999,"15min":0.26600000000000001},"max":{"1min":9.2590000000000003,"5min":9.2590000000000003,"15min":13.939},"last":0.57099999999999995},{"interface":"front","average":{"1min":1.6220000000000001,"5min":1.7310000000000001,"15min":1.3169999999999999},"min":{"1min":0.377,"5min":0.33600000000000002,"15min":0.28599999999999998},"max":{"1min":6.6820000000000004,"5min":8.6890000000000001,"15min":13.317},"last":5.8479999999999999}]},{"osd":6,"last update":"Sat Feb 10 08:28:53 2024","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.946,"15min":1.5009999999999999},"min":{"1min":0.35799999999999998,"5min":0.33700000000000002,"15min":0.28000000000000003},"max":{"1min":5.6100000000000003,"5min":38.177999999999997,"15min":38.177999999999997},"last":3.2770000000000001},{"interface":"front","average":{"1min":1.458,"5min":2.2389999999999999,"15min":1.5489999999999999},"min":{"1min":0.374,"5min":0.36899999999999999,"15min":0.29099999999999998},"max":{"1min":13.567,"5min":37.682000000000002,"15min":37.682000000000002},"last":2.1200000000000001}]},{"osd":7,"last update":"Sat Feb 10 08:28:14 2024","interfaces":[{"interface":"back","average":{"1min":2.0219999999999998,"5min":1.861,"15min":1.389},"min":{"1min":0.39900000000000002,"5min":0.378,"15min":0.33900000000000002},"max":{"1min":6.7000000000000002,"5min":6.7000000000000002,"15min":13.231999999999999},"last":2.4670000000000001},{"interface":"front","average":{"1min":1.9359999999999999,"5min":1.3300000000000001,"15min":1.101},"min":{"1min":0.30399999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":6.1740000000000004,"5min":9.4900000000000002,"15min":15.714},"last":0.35099999999999998}]}]},{"osd":3,"up_from":25,"seq":107374182568,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":987332,"kb_used_data":673724,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":92757820,"statfs":{"total":95995035648,"available":94984007680,"internally_reserved":0,"allocated":689893376,"data_stored":689480618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:28:32 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":1.4330000000000001,"15min":1.4550000000000001},"min":{"1min":0.19,"5min":0.182,"15min":0.182},"max":{"1min":3.2530000000000001,"5min":14.167,"15min":14.167},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":1.6519999999999999,"15min":1.3999999999999999},"min":{"1min":0.20300000000000001,"5min":0.185,"15min":0.185},"max":{"1min":1.931,"5min":16.721,"15min":26.643000000000001},"last":1.6040000000000001}]},{"osd":1,"last update":"Sat Feb 10 08:28:32 2024","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.669,"15min":1.4590000000000001},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.218},"max":{"1min":6.1779999999999999,"5min":9.4179999999999993,"15min":12.782999999999999},"last":2.2229999999999999},{"interface":"front","average":{"1min":1.377,"5min":2.5169999999999999,"15min":1.6850000000000001},"min":{"1min":0.214,"5min":0.214,"15min":0.191},"max":{"1min":17.513000000000002,"5min":21.373999999999999,"15min":21.373999999999999},"last":0.39100000000000001}]},{"osd":2,"last update":"Sat Feb 10 08:28:32 2024","interfaces":[{"interface":"back","average":{"1min":1.4690000000000001,"5min":2.4199999999999999,"15min":1.641},"min":{"1min":0.26700000000000002,"5min":0.24199999999999999,"15min":0.23699999999999999},"max":{"1min":14.631,"5min":21.434000000000001,"15min":21.434000000000001},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.84599999999999997,"5min":1.76,"15min":1.4650000000000001},"min":{"1min":0.28000000000000003,"5min":0.215,"15min":0.215},"max":{"1min":4.3460000000000001,"5min":16.757999999999999,"15min":18.061},"last":1.575}]},{"osd":4,"last update":"Sat Feb 10 08:28:02 2024","interfaces":[{"interface":"back","average":{"1min":1.712,"5min":1.8759999999999999,"15min":1.7509999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":8.8379999999999992,"5min":10.970000000000001,"15min":12.272},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.9750000000000001,"5min":2.298,"15min":2.3250000000000002},"min":{"1min":0.42299999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":7.7679999999999998,"5min":12.391999999999999,"15min":12.391999999999999},"last":0.373}]},{"osd":5,"last update":"Sat Feb 10 08:28:28 2024","interfaces":[{"interface":"back","average":{"1min":1.7749999999999999,"5min":1.8200000000000001,"15min":1.149},"min":{"1min":0.378,"5min":0.31,"15min":0.249},"max":{"1min":10.023,"5min":10.933999999999999,"15min":12.388999999999999},"last":0.97799999999999998},{"interface":"front","average":{"1min":1.722,"5min":1.919,"15min":1.401},"min":{"1min":0.35699999999999998,"5min":0.33800000000000002,"15min":0.29699999999999999},"max":{"1min":9.9900000000000002,"5min":10.217000000000001,"15min":12.438000000000001},"last":1.613}]},{"osd":6,"last update":"Sat Feb 10 08:28:43 2024","interfaces":[{"interface":"back","average":{"1min":1.329,"5min":1.7010000000000001,"15min":1.387},"min":{"1min":0.376,"5min":0.35799999999999998,"15min":0.33600000000000002},"max":{"1min":4.274,"5min":9.3740000000000006,"15min":12.477},"last":0.42699999999999999},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.665,"15min":1.1499999999999999},"min":{"1min":0.40200000000000002,"5min":0.31,"15min":0.28499999999999998},"max":{"1min":5.5709999999999997,"5min":8.8640000000000008,"15min":12.324999999999999},"last":2.387}]},{"osd":7,"last update":"Sat Feb 10 08:28:07 2024","interfaces":[{"interface":"back","average":{"1min":1.633,"5min":1.9510000000000001,"15min":1.1819999999999999},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.28299999999999997},"max":{"1min":8.9109999999999996,"5min":8.9109999999999996,"15min":12.358000000000001},"last":1.627},{"interface":"front","average":{"1min":2.335,"5min":2.4889999999999999,"15min":1.468},"min":{"1min":0.33000000000000002,"5min":0.32500000000000001,"15min":0.26500000000000001},"max":{"1min":14.587,"5min":15.702,"15min":15.702},"last":1.093}]}]},{"osd":4,"up_from":110,"seq":472446402659,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":763352,"kb_used_data":453200,"kb_used_omap":0,"kb_used_meta":310143,"kb_avail":92981800,"statfs":{"total":95995035648,"available":95213363200,"internally_reserved":0,"allocated":464076800,"data_stored":463637278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":972,"internal_metadata":317586484},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:28:04 2024","interfaces":[{"interface":"back","average":{"1min":1.8149999999999999,"5min":1.496,"15min":1.304},"min":{"1min":0.24099999999999999,"5min":0.23899999999999999,"15min":0.19800000000000001},"max":{"1min":6.258,"5min":6.258,"15min":11.257999999999999},"last":0.27200000000000002},{"interface":"front","average":{"1min":2.282,"5min":2.125,"15min":2.8450000000000002},"min":{"1min":0.22600000000000001,"5min":0.222,"15min":0.222},"max":{"1min":12.84,"5min":16.524000000000001,"15min":16.524000000000001},"last":0.57799999999999996}]},{"osd":1,"last update":"Sat Feb 10 08:28:04 2024","interfaces":[{"interface":"back","average":{"1min":2.3140000000000001,"5min":1.704,"15min":2.0750000000000002},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":7.6379999999999999,"5min":12.472,"15min":12.472},"last":0.84799999999999998},{"interface":"front","average":{"1min":2.4159999999999999,"5min":1.6120000000000001,"15min":1.9390000000000001},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":7.625,"5min":12.462,"15min":12.462},"last":0.82699999999999996}]},{"osd":2,"last update":"Sat Feb 10 08:28:04 2024","interfaces":[{"interface":"back","average":{"1min":2.8300000000000001,"5min":1.9199999999999999,"15min":2.04},"min":{"1min":0.34100000000000003,"5min":0.218,"15min":0.218},"max":{"1min":9.7539999999999996,"5min":9.7539999999999996,"15min":9.7539999999999996},"last":0.36199999999999999},{"interface":"front","average":{"1min":1.744,"5min":1.6779999999999999,"15min":2.0150000000000001},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":6.8099999999999996,"5min":8.9309999999999992,"15min":8.9309999999999992},"last":0.56699999999999995}]},{"osd":3,"last update":"Sat Feb 10 08:28:04 2024","interfaces":[{"interface":"back","average":{"1min":2.0550000000000002,"5min":1.8839999999999999,"15min":2.1299999999999999},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":5.1870000000000003,"5min":12.565,"15min":12.565},"last":0.33100000000000002},{"interface":"front","average":{"1min":1.651,"5min":1.427,"15min":1.716},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27200000000000002},"max":{"1min":5.1399999999999997,"5min":6.9400000000000004,"15min":11.648},"last":0.40000000000000002}]},{"osd":5,"last update":"Sat Feb 10 08:28:04 2024","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.377,"15min":0.82899999999999996},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":5.6929999999999996,"5min":41.488,"15min":41.488},"last":2.0739999999999998},{"interface":"front","average":{"1min":1.766,"5min":1.752,"15min":1.0980000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":10.287000000000001,"5min":42.527999999999999,"15min":42.527999999999999},"last":0.41299999999999998}]},{"osd":6,"last update":"Sat Feb 10 08:28:04 2024","interfaces":[{"interface":"back","average":{"1min":1.3979999999999999,"5min":1.6599999999999999,"15min":0.97999999999999998},"min":{"1min":0.28299999999999997,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":7.1639999999999997,"5min":39.554000000000002,"15min":39.554000000000002},"last":3.734},{"interface":"front","average":{"1min":1.49,"5min":1.504,"15min":1.0509999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":5.5529999999999999,"5min":41.741999999999997,"15min":41.741999999999997},"last":0.35299999999999998}]},{"osd":7,"last update":"Sat Feb 10 08:28:04 2024","interfaces":[{"interface":"back","average":{"1min":1.4279999999999999,"5min":1.278,"15min":0.98699999999999999},"min":{"1min":0.29199999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":5.5179999999999998,"5min":11.047000000000001,"15min":11.047000000000001},"last":2.2069999999999999},{"interface":"front","average":{"1min":1.8480000000000001,"5min":1.121,"15min":0.71599999999999997},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":5.7199999999999998,"5min":5.7859999999999996,"15min":5.7859999999999996},"last":0.93100000000000005}]}]},{"osd":5,"up_from":37,"seq":158913790111,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1813988,"kb_used_data":1512668,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":91931164,"statfs":{"total":95995035648,"available":94137511936,"internally_reserved":0,"allocated":1548972032,"data_stored":1548527645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:28:15 2024","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.452,"15min":1.3879999999999999},"min":{"1min":0.26000000000000001,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":3.9609999999999999,"5min":8.1110000000000007,"15min":22.914000000000001},"last":3.089},{"interface":"front","average":{"1min":1.5940000000000001,"5min":1.4950000000000001,"15min":1.23},"min":{"1min":0.23699999999999999,"5min":0.224,"15min":0.219},"max":{"1min":5.3129999999999997,"5min":6.1669999999999998,"15min":23.161000000000001},"last":0.47999999999999998}]},{"osd":1,"last update":"Sat Feb 10 08:28:15 2024","interfaces":[{"interface":"back","average":{"1min":1.4510000000000001,"5min":1.577,"15min":1.069},"min":{"1min":0.27900000000000003,"5min":0.20699999999999999,"15min":0.19500000000000001},"max":{"1min":4.0110000000000001,"5min":7.5730000000000004,"15min":8.1289999999999996},"last":2.9540000000000002},{"interface":"front","average":{"1min":0.97399999999999998,"5min":1.4359999999999999,"15min":1.0780000000000001},"min":{"1min":0.29999999999999999,"5min":0.254,"15min":0.254},"max":{"1min":3.8319999999999999,"5min":9.0579999999999998,"15min":9.0579999999999998},"last":0.442}]},{"osd":2,"last update":"Sat Feb 10 08:28:15 2024","interfaces":[{"interface":"back","average":{"1min":1.4610000000000001,"5min":1.4139999999999999,"15min":1.294},"min":{"1min":0.248,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":4.3760000000000003,"5min":8.657,"15min":9.5709999999999997},"last":0.747},{"interface":"front","average":{"1min":1.9810000000000001,"5min":1.573,"15min":1.2030000000000001},"min":{"1min":0.32300000000000001,"5min":0.28799999999999998,"15min":0.26400000000000001},"max":{"1min":5.7859999999999996,"5min":7.585,"15min":9.2810000000000006},"last":1.4370000000000001}]},{"osd":3,"last update":"Sat Feb 10 08:28:15 2024","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":1.1779999999999999,"15min":1.117},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.26700000000000002},"max":{"1min":4.3529999999999998,"5min":6.117,"15min":24.198},"last":2.8220000000000001},{"interface":"front","average":{"1min":1.7210000000000001,"5min":1.4830000000000001,"15min":1.321},"min":{"1min":0.44800000000000001,"5min":0.29799999999999999,"15min":0.25900000000000001},"max":{"1min":5.2510000000000003,"5min":9.1159999999999997,"15min":22.701000000000001},"last":3.7040000000000002}]},{"osd":4,"last update":"Sat Feb 10 08:27:54 2024","interfaces":[{"interface":"back","average":{"1min":1.649,"5min":1.268,"15min":0.80100000000000005},"min":{"1min":0.312,"5min":0.24199999999999999,"15min":0.23599999999999999},"max":{"1min":4.3310000000000004,"5min":6.1120000000000001,"15min":6.1120000000000001},"last":2.794},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.21,"15min":0.72799999999999998},"min":{"1min":0.29999999999999999,"5min":0.27800000000000002,"15min":0.22500000000000001},"max":{"1min":4.407,"5min":5.9720000000000004,"15min":5.9720000000000004},"last":1.337}]},{"osd":6,"last update":"Sat Feb 10 08:28:41 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":1.2969999999999999,"15min":0.753},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":5.226,"5min":8.3559999999999999,"15min":8.3559999999999999},"last":2.1720000000000002},{"interface":"front","average":{"1min":0.46999999999999997,"5min":1.1080000000000001,"15min":0.72799999999999998},"min":{"1min":0.33700000000000002,"5min":0.26300000000000001,"15min":0.23999999999999999},"max":{"1min":1.0720000000000001,"5min":6.3840000000000003,"15min":6.3840000000000003},"last":0.63600000000000001}]},{"osd":7,"last update":"Sat Feb 10 08:28:07 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":4.6859999999999999,"15min":1.8779999999999999},"min":{"1min":0.312,"5min":0.26700000000000002,"15min":0.23799999999999999},"max":{"1min":3.4420000000000002,"5min":371.87400000000002,"15min":371.87400000000002},"last":2.7610000000000001},{"interface":"front","average":{"1min":0.88300000000000001,"5min":4.968,"15min":1.986},"min":{"1min":0.38700000000000001,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":3.6259999999999999,"5min":372.63099999999997,"15min":372.63099999999997},"last":1.5629999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":2118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":538050560,"data_stored":538050560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1558904832,"data_stored":1558904832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1045364736,"data_stored":1045364736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":692715520,"data_stored":692715520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":463798272,"data_stored":463798272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1570242560,"data_stored":1570242560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":511246336,"data_stored":511246336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1919877120,"data_stored":1919877120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-10T08:29:00.638 INFO:tasks.thrashosds.thrasher:Setting 9.0 to [5, 6, 4] 2024-02-10T08:29:00.638 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '9.0', '5', '6', '4'] 2024-02-10T08:29:00.638 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd pg-upmap 9.0 5 6 4 2024-02-10T08:29:00.764 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is unset 2024-02-10T08:29:00.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:28:59.613182+0000 mgr.y (mgr.14505) 462 : audit [DBG] from='client.25150 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-10T08:29:00.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:28:59.877155+0000 mon.c (mon.2) 62 : audit [INF] from='client.? 172.21.15.18:0/1847792900' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:29:00.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:28:59.877713+0000 mon.a (mon.0) 1315 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:29:00.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:00.728661+0000 mon.a (mon.0) 1316 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:29:00.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:29:00.741030+0000 mon.a (mon.0) 1317 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-10T08:29:00.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:00.741305+0000 mon.a (mon.0) 1318 : cluster [DBG] osdmap e268: 8 total, 8 up, 8 in 2024-02-10T08:29:00.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:28:59.613182+0000 mgr.y (mgr.14505) 462 : audit [DBG] from='client.25150 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-10T08:29:00.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:28:59.877155+0000 mon.c (mon.2) 62 : audit [INF] from='client.? 172.21.15.18:0/1847792900' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:29:00.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:28:59.877713+0000 mon.a (mon.0) 1315 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:29:00.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:00.728661+0000 mon.a (mon.0) 1316 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:29:00.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:29:00.741030+0000 mon.a (mon.0) 1317 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-10T08:29:00.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:00.741305+0000 mon.a (mon.0) 1318 : cluster [DBG] osdmap e268: 8 total, 8 up, 8 in 2024-02-10T08:29:01.142 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 23 16 47684 47668 129.484 94.8125 0.00457645 0.00771859 2024-02-10T08:29:01.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:28:59.613182+0000 mgr.y (mgr.14505) 462 : audit [DBG] from='client.25150 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-10T08:29:01.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:28:59.877155+0000 mon.c (mon.2) 62 : audit [INF] from='client.? 172.21.15.18:0/1847792900' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:29:01.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:28:59.877713+0000 mon.a (mon.0) 1315 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:29:01.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:00.728661+0000 mon.a (mon.0) 1316 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:29:01.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:29:00.741030+0000 mon.a (mon.0) 1317 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-10T08:29:01.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:00.741305+0000 mon.a (mon.0) 1318 : cluster [DBG] osdmap e268: 8 total, 8 up, 8 in 2024-02-10T08:29:01.849 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:29:01.852 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:01.853 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:29:01.954 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:29:01.996 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:02.129 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:29:02.132 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:02.133 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:29:02.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:00.826619+0000 mgr.y (mgr.14505) 463 : cluster [DBG] pgmap v559: 158 pgs: 158 active+clean; 2.6 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 639 B/s rd, 82 MiB/s wr, 1.31k op/s 2024-02-10T08:29:02.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:00.900740+0000 osd.4 (osd.4) 66 : cluster [DBG] 6.1e scrub starts 2024-02-10T08:29:02.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:00.918375+0000 osd.4 (osd.4) 67 : cluster [DBG] 6.1e scrub ok 2024-02-10T08:29:02.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:01.318802+0000 osd.0 (osd.0) 128 : cluster [DBG] 5.13 scrub starts 2024-02-10T08:29:02.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:01.325131+0000 osd.0 (osd.0) 129 : cluster [DBG] 5.13 scrub ok 2024-02-10T08:29:02.139 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:00.826619+0000 mgr.y (mgr.14505) 463 : cluster [DBG] pgmap v559: 158 pgs: 158 active+clean; 2.6 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 639 B/s rd, 82 MiB/s wr, 1.31k op/s 2024-02-10T08:29:02.139 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:00.900740+0000 osd.4 (osd.4) 66 : cluster [DBG] 6.1e scrub starts 2024-02-10T08:29:02.139 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:00.918375+0000 osd.4 (osd.4) 67 : cluster [DBG] 6.1e scrub ok 2024-02-10T08:29:02.139 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:01.318802+0000 osd.0 (osd.0) 128 : cluster [DBG] 5.13 scrub starts 2024-02-10T08:29:02.140 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:01.325131+0000 osd.0 (osd.0) 129 : cluster [DBG] 5.13 scrub ok 2024-02-10T08:29:02.142 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 24 16 49265 49249 128.206 98.8125 0.00503998 0.00779357 2024-02-10T08:29:02.234 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:29:02.288 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:00.826619+0000 mgr.y (mgr.14505) 463 : cluster [DBG] pgmap v559: 158 pgs: 158 active+clean; 2.6 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 639 B/s rd, 82 MiB/s wr, 1.31k op/s 2024-02-10T08:29:02.288 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:00.900740+0000 osd.4 (osd.4) 66 : cluster [DBG] 6.1e scrub starts 2024-02-10T08:29:02.288 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:00.918375+0000 osd.4 (osd.4) 67 : cluster [DBG] 6.1e scrub ok 2024-02-10T08:29:02.288 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:01.318802+0000 osd.0 (osd.0) 128 : cluster [DBG] 5.13 scrub starts 2024-02-10T08:29:02.288 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:01.325131+0000 osd.0 (osd.0) 129 : cluster [DBG] 5.13 scrub ok 2024-02-10T08:29:02.293 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:02.331 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:29:02.335 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:02.335 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:29:02.436 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:29:02.491 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:02.520 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:29:02.523 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:02.524 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:29:02.625 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:29:02.679 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:03.143 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 25 16 50778 50762 126.861 94.5625 0.00749585 0.00787804 2024-02-10T08:29:03.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:01.643381+0000 osd.1 (osd.1) 143 : cluster [DBG] 6.20 scrub starts 2024-02-10T08:29:03.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:01.651085+0000 osd.1 (osd.1) 144 : cluster [DBG] 6.20 scrub ok 2024-02-10T08:29:03.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:01.643381+0000 osd.1 (osd.1) 143 : cluster [DBG] 6.20 scrub starts 2024-02-10T08:29:03.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:01.651085+0000 osd.1 (osd.1) 144 : cluster [DBG] 6.20 scrub ok 2024-02-10T08:29:03.182 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:29:03.188 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:03.189 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:29:03.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:01.643381+0000 osd.1 (osd.1) 143 : cluster [DBG] 6.20 scrub starts 2024-02-10T08:29:03.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:01.651085+0000 osd.1 (osd.1) 144 : cluster [DBG] 6.20 scrub ok 2024-02-10T08:29:03.289 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:29:03.333 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:03.832 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd unset nodeep-scrub 2024-02-10T08:29:04.143 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 26 16 52260 52244 125.544 92.625 0.0117121 0.00796087 2024-02-10T08:29:04.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:02.610495+0000 osd.1 (osd.1) 145 : cluster [DBG] 6.26 scrub starts 2024-02-10T08:29:04.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:02.618495+0000 osd.1 (osd.1) 146 : cluster [DBG] 6.26 scrub ok 2024-02-10T08:29:04.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:02.828347+0000 mgr.y (mgr.14505) 464 : cluster [DBG] pgmap v560: 158 pgs: 158 active+clean; 3.0 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 1.2 KiB/s rd, 112 MiB/s wr, 1.79k op/s 2024-02-10T08:29:04.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:03.390029+0000 osd.6 (osd.6) 125 : cluster [DBG] 2.7 scrub starts 2024-02-10T08:29:04.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:03.396722+0000 osd.6 (osd.6) 126 : cluster [DBG] 2.7 scrub ok 2024-02-10T08:29:04.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:02.610495+0000 osd.1 (osd.1) 145 : cluster [DBG] 6.26 scrub starts 2024-02-10T08:29:04.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:02.618495+0000 osd.1 (osd.1) 146 : cluster [DBG] 6.26 scrub ok 2024-02-10T08:29:04.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:02.828347+0000 mgr.y (mgr.14505) 464 : cluster [DBG] pgmap v560: 158 pgs: 158 active+clean; 3.0 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 1.2 KiB/s rd, 112 MiB/s wr, 1.79k op/s 2024-02-10T08:29:04.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:03.390029+0000 osd.6 (osd.6) 125 : cluster [DBG] 2.7 scrub starts 2024-02-10T08:29:04.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:03.396722+0000 osd.6 (osd.6) 126 : cluster [DBG] 2.7 scrub ok 2024-02-10T08:29:04.228 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:29:04.238 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:04.238 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:29:04.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:02.610495+0000 osd.1 (osd.1) 145 : cluster [DBG] 6.26 scrub starts 2024-02-10T08:29:04.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:02.618495+0000 osd.1 (osd.1) 146 : cluster [DBG] 6.26 scrub ok 2024-02-10T08:29:04.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:02.828347+0000 mgr.y (mgr.14505) 464 : cluster [DBG] pgmap v560: 158 pgs: 158 active+clean; 3.0 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 1.2 KiB/s rd, 112 MiB/s wr, 1.79k op/s 2024-02-10T08:29:04.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:03.390029+0000 osd.6 (osd.6) 125 : cluster [DBG] 2.7 scrub starts 2024-02-10T08:29:04.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:03.396722+0000 osd.6 (osd.6) 126 : cluster [DBG] 2.7 scrub ok 2024-02-10T08:29:04.339 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:29:04.383 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:04.420 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:29:04.424 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:04.425 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:29:04.525 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:29:04.525 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:29:04.587 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:04.799 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:29:04.808 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:04.808 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:29:04.909 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:29:04.959 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:05.143 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 27 16 53644 53628 124.097 86.5 0.00819566 0.00805333 2024-02-10T08:29:05.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:04.383098+0000 osd.6 (osd.6) 127 : cluster [DBG] 5.18 scrub starts 2024-02-10T08:29:05.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:04.388070+0000 osd.6 (osd.6) 128 : cluster [DBG] 5.18 scrub ok 2024-02-10T08:29:05.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:04.383098+0000 osd.6 (osd.6) 127 : cluster [DBG] 5.18 scrub starts 2024-02-10T08:29:05.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:04.388070+0000 osd.6 (osd.6) 128 : cluster [DBG] 5.18 scrub ok 2024-02-10T08:29:05.177 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:29:05.180 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:05.180 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:29:05.235 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-02-10T08:29:05.235 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-02-10T08:29:05.235 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:05.235 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.15198.0:53751 9.5 9:aef9ad5e:::benchmark_data_smithi018_124176_object53750:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected e268)", 2024-02-10T08:29:05.235 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:29:05.224339+0000", 2024-02-10T08:29:05.235 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.0095907200000000005, 2024-02-10T08:29:05.235 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0096149979999999996, 2024-02-10T08:29:05.235 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:29:05.235 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "waiting for sub ops", 2024-02-10T08:29:05.235 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:29:05.236 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.15198", 2024-02-10T08:29:05.236 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/1957604827", 2024-02-10T08:29:05.236 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 53751 2024-02-10T08:29:05.236 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:05.236 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:29:05.236 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:05.236 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:29:05.236 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:29:05.224339+0000", 2024-02-10T08:29:05.236 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:29:05.236 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:05.236 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:05.236 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:29:05.236 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:29:05.224339+0000", 2024-02-10T08:29:05.236 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:29:05.236 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:05.237 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:05.237 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:29:05.237 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:29:05.224337+0000", 2024-02-10T08:29:05.237 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018566500000000001 2024-02-10T08:29:05.237 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:05.237 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:05.237 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:29:05.237 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:29:05.224523+0000", 2024-02-10T08:29:05.237 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1725e-05 2024-02-10T08:29:05.237 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:05.237 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:05.237 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:29:05.237 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:29:05.224545+0000", 2024-02-10T08:29:05.237 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3833e-05 2024-02-10T08:29:05.237 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:05.238 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:05.238 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:29:05.238 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:29:05.224559+0000", 2024-02-10T08:29:05.238 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000106969 2024-02-10T08:29:05.238 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:05.238 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:05.238 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:29:05.238 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:29:05.224666+0000", 2024-02-10T08:29:05.238 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011976000000000001 2024-02-10T08:29:05.238 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:05.238 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:05.238 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:29:05.238 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:29:05.224785+0000", 2024-02-10T08:29:05.239 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001362563 2024-02-10T08:29:05.239 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:05.239 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:05.239 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 5,7", 2024-02-10T08:29:05.239 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:29:05.226148+0000", 2024-02-10T08:29:05.239 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0029021770000000001 2024-02-10T08:29:05.239 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:05.239 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:05.239 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:29:05.239 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:29:05.229050+0000", 2024-02-10T08:29:05.239 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001213677 2024-02-10T08:29:05.239 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:05.239 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:05.240 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:29:05.240 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:29:05.230264+0000", 2024-02-10T08:29:05.240 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0059249359999999996 2024-02-10T08:29:05.240 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:05.240 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:29:05.240 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:05.240 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:05.240 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:05.240 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.15198.0:53753 9.9 9:977e0b7c:::benchmark_data_smithi018_124176_object53752:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected e268)", 2024-02-10T08:29:05.240 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:29:05.224584+0000", 2024-02-10T08:29:05.240 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.0093456640000000001, 2024-02-10T08:29:05.240 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0094323889999999994, 2024-02-10T08:29:05.240 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:29:05.240 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "waiting for sub ops", 2024-02-10T08:29:05.241 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:29:05.241 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.15198", 2024-02-10T08:29:05.241 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/1957604827", 2024-02-10T08:29:05.241 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 53753 2024-02-10T08:29:05.241 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:05.241 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:29:05.241 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:05.241 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:29:05.241 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:29:05.224584+0000", 2024-02-10T08:29:05.241 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:29:05.241 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:05.241 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:05.241 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:29:05.241 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:29:05.224584+0000", 2024-02-10T08:29:05.241 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:29:05.241 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:05.241 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:05.242 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:29:05.242 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:29:05.224583+0000", 2024-02-10T08:29:05.242 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2391e-05 2024-02-10T08:29:05.242 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:05.242 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:05.242 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:29:05.242 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:29:05.224606+0000", 2024-02-10T08:29:05.242 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.392e-06 2024-02-10T08:29:05.242 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:05.242 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:05.242 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:29:05.242 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:29:05.224612+0000", 2024-02-10T08:29:05.242 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8290000000000001e-06 2024-02-10T08:29:05.242 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:05.242 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:05.242 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:29:05.243 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:29:05.224616+0000", 2024-02-10T08:29:05.243 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2030999999999998e-05 2024-02-10T08:29:05.243 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:05.243 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:05.243 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:29:05.243 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:29:05.224658+0000", 2024-02-10T08:29:05.243 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012817300000000001 2024-02-10T08:29:05.243 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:05.243 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:05.243 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:29:05.243 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:29:05.224786+0000", 2024-02-10T08:29:05.243 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016849000000000001 2024-02-10T08:29:05.243 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:05.243 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:05.243 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 5,7", 2024-02-10T08:29:05.244 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:29:05.224954+0000", 2024-02-10T08:29:05.244 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0054091790000000001 2024-02-10T08:29:05.244 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:05.244 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:05.244 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:29:05.244 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:29:05.230364+0000", 2024-02-10T08:29:05.244 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0057796369999999998 2024-02-10T08:29:05.244 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:05.244 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:29:05.244 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:05.244 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:05.244 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:05.244 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.15198.0:53757 9.9 9:922ab268:::benchmark_data_smithi018_124176_object53756:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected e268)", 2024-02-10T08:29:05.244 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:29:05.228064+0000", 2024-02-10T08:29:05.244 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.0058660320000000002, 2024-02-10T08:29:05.245 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0060346879999999999, 2024-02-10T08:29:05.245 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:29:05.245 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "waiting for sub ops", 2024-02-10T08:29:05.245 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:29:05.245 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.15198", 2024-02-10T08:29:05.245 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/1957604827", 2024-02-10T08:29:05.245 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 53757 2024-02-10T08:29:05.245 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:05.245 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:29:05.245 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:05.245 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:29:05.245 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:29:05.228064+0000", 2024-02-10T08:29:05.245 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:29:05.245 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:05.245 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:05.245 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:29:05.246 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:29:05.228064+0000", 2024-02-10T08:29:05.246 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999981 2024-02-10T08:29:05.246 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:05.246 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:05.246 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:29:05.246 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:29:05.228062+0000", 2024-02-10T08:29:05.246 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3130999999999999e-05 2024-02-10T08:29:05.246 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:05.246 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:05.246 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:29:05.246 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:29:05.228085+0000", 2024-02-10T08:29:05.246 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0601999999999999e-05 2024-02-10T08:29:05.246 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:05.246 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:05.246 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:29:05.247 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:29:05.228095+0000", 2024-02-10T08:29:05.247 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9299999999999997e-06 2024-02-10T08:29:05.247 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:05.247 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:05.247 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:29:05.247 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:29:05.228102+0000", 2024-02-10T08:29:05.247 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6731999999999998e-05 2024-02-10T08:29:05.247 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:05.247 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:05.247 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:29:05.247 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:29:05.228159+0000", 2024-02-10T08:29:05.247 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000141531 2024-02-10T08:29:05.247 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:05.247 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:05.247 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:29:05.247 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:29:05.228301+0000", 2024-02-10T08:29:05.247 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015656099999999999 2024-02-10T08:29:05.248 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:05.248 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:05.248 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 5,7", 2024-02-10T08:29:05.248 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:29:05.228457+0000", 2024-02-10T08:29:05.248 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00039353199999999999 2024-02-10T08:29:05.248 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:05.248 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:29:05.248 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:05.248 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:05.248 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:05.248 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.15198.0:53762 9.9 9:9e79d359:::benchmark_data_smithi018_124176_object53761:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected e268)", 2024-02-10T08:29:05.248 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:29:05.228119+0000", 2024-02-10T08:29:05.248 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.0058107089999999998, 2024-02-10T08:29:05.248 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0060276130000000002, 2024-02-10T08:29:05.248 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:29:05.249 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "waiting for sub ops", 2024-02-10T08:29:05.249 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:29:05.249 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.15198", 2024-02-10T08:29:05.249 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/1957604827", 2024-02-10T08:29:05.249 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 53762 2024-02-10T08:29:05.249 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:05.249 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:29:05.249 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:05.249 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:29:05.249 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:29:05.228119+0000", 2024-02-10T08:29:05.249 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:29:05.249 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:05.249 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:05.249 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:29:05.249 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:29:05.228119+0000", 2024-02-10T08:29:05.249 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:29:05.249 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:05.250 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:05.250 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:29:05.250 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:29:05.228118+0000", 2024-02-10T08:29:05.250 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9820000000000001e-05 2024-02-10T08:29:05.250 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:05.250 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:05.250 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:29:05.250 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:29:05.228168+0000", 2024-02-10T08:29:05.250 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.576e-06 2024-02-10T08:29:05.250 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:05.250 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:05.250 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:29:05.250 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:29:05.228176+0000", 2024-02-10T08:29:05.250 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2619999999999998e-06 2024-02-10T08:29:05.251 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:05.251 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:05.251 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:29:05.251 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:29:05.228181+0000", 2024-02-10T08:29:05.251 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002207395 2024-02-10T08:29:05.251 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:05.251 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:05.251 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:29:05.251 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:29:05.230388+0000", 2024-02-10T08:29:05.251 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013300399999999999 2024-02-10T08:29:05.251 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:05.251 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:05.251 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:29:05.251 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:29:05.230521+0000", 2024-02-10T08:29:05.251 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014916699999999999 2024-02-10T08:29:05.252 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:05.252 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:05.252 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 5,7", 2024-02-10T08:29:05.252 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:29:05.230670+0000", 2024-02-10T08:29:05.252 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0025514800000000001 2024-02-10T08:29:05.252 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:05.252 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:29:05.252 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:05.252 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:05.252 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:05.252 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop_reply(client.15198.0:53753 9.9 e268/256)", 2024-02-10T08:29:05.252 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:29:05.230380+0000", 2024-02-10T08:29:05.252 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.0035495869999999999, 2024-02-10T08:29:05.252 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0038089759999999999, 2024-02-10T08:29:05.253 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:29:05.253 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "queued for pg", 2024-02-10T08:29:05.253 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:29:05.253 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:05.253 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:29:05.253 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:29:05.230380+0000", 2024-02-10T08:29:05.253 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:29:05.253 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:05.253 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:05.253 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:29:05.253 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:29:05.230380+0000", 2024-02-10T08:29:05.253 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:29:05.253 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:05.253 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:05.253 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:29:05.254 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:29:05.230379+0000", 2024-02-10T08:29:05.254 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0770000000000001e-06 2024-02-10T08:29:05.254 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:05.254 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:05.254 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:29:05.254 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:29:05.230384+0000", 2024-02-10T08:29:05.254 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9190000000000004e-06 2024-02-10T08:29:05.254 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:05.254 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:05.254 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:29:05.254 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:29:05.230389+0000", 2024-02-10T08:29:05.254 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2270000000000004e-06 2024-02-10T08:29:05.254 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:05.254 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:05.255 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:29:05.255 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:29:05.230394+0000", 2024-02-10T08:29:05.255 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3675999999999999e-05 2024-02-10T08:29:05.255 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:05.255 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:29:05.255 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:05.255 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:05.255 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:05.255 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.15198.0:53765 9.8 9:1d85846e:::benchmark_data_smithi018_124176_object53764:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected e268)", 2024-02-10T08:29:05.255 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:29:05.232084+0000", 2024-02-10T08:29:05.255 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.0018452519999999999, 2024-02-10T08:29:05.255 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00213671, 2024-02-10T08:29:05.255 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:29:05.255 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "waiting for sub ops", 2024-02-10T08:29:05.256 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:29:05.256 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.15198", 2024-02-10T08:29:05.256 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/1957604827", 2024-02-10T08:29:05.256 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 53765 2024-02-10T08:29:05.256 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:05.256 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:29:05.256 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:05.256 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:29:05.256 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:29:05.232084+0000", 2024-02-10T08:29:05.256 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:29:05.256 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:05.256 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:05.256 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:29:05.256 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:29:05.232084+0000", 2024-02-10T08:29:05.256 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:29:05.257 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:05.257 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:05.257 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:29:05.257 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:29:05.232083+0000", 2024-02-10T08:29:05.257 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0516999999999998e-05 2024-02-10T08:29:05.257 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:05.257 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:05.257 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:29:05.257 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:29:05.232133+0000", 2024-02-10T08:29:05.257 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2677000000000001e-05 2024-02-10T08:29:05.257 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:05.257 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:05.257 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:29:05.257 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:29:05.232146+0000", 2024-02-10T08:29:05.257 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2030000000000003e-06 2024-02-10T08:29:05.257 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:05.258 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:05.258 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:29:05.258 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:29:05.232153+0000", 2024-02-10T08:29:05.258 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000103349 2024-02-10T08:29:05.258 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:05.258 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:05.258 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:29:05.258 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:29:05.232257+0000", 2024-02-10T08:29:05.258 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013438600000000001 2024-02-10T08:29:05.258 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:05.258 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:05.258 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:29:05.258 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:29:05.232391+0000", 2024-02-10T08:29:05.258 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000159961 2024-02-10T08:29:05.258 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:05.258 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:05.259 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 5,7", 2024-02-10T08:29:05.259 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:29:05.232551+0000", 2024-02-10T08:29:05.259 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00046647399999999998 2024-02-10T08:29:05.259 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:05.259 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:29:05.259 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:05.259 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:05.259 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-02-10T08:29:05.259 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 6 2024-02-10T08:29:05.259 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-02-10T08:29:05.281 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:29:05.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:04.383098+0000 osd.6 (osd.6) 127 : cluster [DBG] 5.18 scrub starts 2024-02-10T08:29:05.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:04.388070+0000 osd.6 (osd.6) 128 : cluster [DBG] 5.18 scrub ok 2024-02-10T08:29:05.332 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:05.362 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:29:05.363 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:05.364 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:29:05.465 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:29:05.526 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:05.551 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:29:05.556 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:05.557 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:29:05.658 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:29:05.716 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:05.747 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:29:05.751 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:05.752 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:29:05.852 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:29:05.905 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:06.041 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:04.694153+0000 osd.1 (osd.1) 147 : cluster [DBG] 2.6 scrub starts 2024-02-10T08:29:06.041 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:04.701154+0000 osd.1 (osd.1) 148 : cluster [DBG] 2.6 scrub ok 2024-02-10T08:29:06.041 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:04.828863+0000 mgr.y (mgr.14505) 465 : cluster [DBG] pgmap v561: 158 pgs: 158 active+clean; 3.0 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 1.1 KiB/s rd, 105 MiB/s wr, 1.68k op/s 2024-02-10T08:29:06.143 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 28 16 54982 54966 122.65 83.625 0.0191223 0.00814784 2024-02-10T08:29:06.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:04.694153+0000 osd.1 (osd.1) 147 : cluster [DBG] 2.6 scrub starts 2024-02-10T08:29:06.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:04.701154+0000 osd.1 (osd.1) 148 : cluster [DBG] 2.6 scrub ok 2024-02-10T08:29:06.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:04.828863+0000 mgr.y (mgr.14505) 465 : cluster [DBG] pgmap v561: 158 pgs: 158 active+clean; 3.0 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 1.1 KiB/s rd, 105 MiB/s wr, 1.68k op/s 2024-02-10T08:29:06.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:04.694153+0000 osd.1 (osd.1) 147 : cluster [DBG] 2.6 scrub starts 2024-02-10T08:29:06.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:04.701154+0000 osd.1 (osd.1) 148 : cluster [DBG] 2.6 scrub ok 2024-02-10T08:29:06.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:04.828863+0000 mgr.y (mgr.14505) 465 : cluster [DBG] pgmap v561: 158 pgs: 158 active+clean; 3.0 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 1.1 KiB/s rd, 105 MiB/s wr, 1.68k op/s 2024-02-10T08:29:06.267 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:29:06.274 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:06.275 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:29:06.375 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:29:06.428 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:06.472 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:29:06.476 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:06.476 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:29:06.577 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:29:06.631 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:06.758 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.0 dump_blocked_ops 2024-02-10T08:29:06.790 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:29:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:29:06] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:29:06.877 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:06.073497+0000 osd.5 (osd.5) 151 : cluster [DBG] 2.3 scrub starts 2024-02-10T08:29:06.877 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:06.087252+0000 osd.5 (osd.5) 152 : cluster [DBG] 2.3 scrub ok 2024-02-10T08:29:06.877 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:06.294213+0000 osd.7 (osd.7) 159 : cluster [DBG] 6.1b scrub starts 2024-02-10T08:29:06.877 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:06.366297+0000 osd.7 (osd.7) 160 : cluster [DBG] 6.1b scrub ok 2024-02-10T08:29:07.002 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:29:07.007 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:07.008 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:29:07.031 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:29:07.073 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:29:07.101 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:29:07.108 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:29:07.142 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:29:07.144 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 29 16 56287 56271 121.232 81.5625 0.0104409 0.00824527 2024-02-10T08:29:07.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:06.073497+0000 osd.5 (osd.5) 151 : cluster [DBG] 2.3 scrub starts 2024-02-10T08:29:07.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:06.087252+0000 osd.5 (osd.5) 152 : cluster [DBG] 2.3 scrub ok 2024-02-10T08:29:07.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:06.294213+0000 osd.7 (osd.7) 159 : cluster [DBG] 6.1b scrub starts 2024-02-10T08:29:07.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:06.366297+0000 osd.7 (osd.7) 160 : cluster [DBG] 6.1b scrub ok 2024-02-10T08:29:07.155 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:06.073497+0000 osd.5 (osd.5) 151 : cluster [DBG] 2.3 scrub starts 2024-02-10T08:29:07.155 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:06.087252+0000 osd.5 (osd.5) 152 : cluster [DBG] 2.3 scrub ok 2024-02-10T08:29:07.155 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:06.294213+0000 osd.7 (osd.7) 159 : cluster [DBG] 6.1b scrub starts 2024-02-10T08:29:07.156 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:06.366297+0000 osd.7 (osd.7) 160 : cluster [DBG] 6.1b scrub ok 2024-02-10T08:29:07.158 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:07.171 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:29:07.192 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:29:07.195 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:07.195 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:29:07.205 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:29:07.235 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:29:07.274 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:29:07.278 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-10T08:29:07.278 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-10T08:29:07.278 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-10T08:29:07.278 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-10T08:29:07.278 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-10T08:29:07.278 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-10T08:29:07.278 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-10T08:29:07.279 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-10T08:29:07.296 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:29:07.353 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:07.382 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:29:07.388 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:07.388 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:29:07.489 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:29:07.520 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:29:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:29:07] "GET /metrics HTTP/1.1" 200 176176 "" "Prometheus/2.33.4" 2024-02-10T08:29:07.547 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:07.810 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:29:07.815 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:29:07.818 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:07.818 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:29:07.919 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:29:07.986 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:08.144 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 30 16 57619 57603 119.966 83.25 0.0137494 0.0083308 2024-02-10T08:29:08.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:06.422846+0000 osd.0 (osd.0) 130 : cluster [DBG] 3.1 scrub starts 2024-02-10T08:29:08.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:06.426383+0000 osd.0 (osd.0) 131 : cluster [DBG] 3.1 scrub ok 2024-02-10T08:29:08.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:06.829405+0000 mgr.y (mgr.14505) 466 : cluster [DBG] pgmap v562: 158 pgs: 158 active+clean; 3.1 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 1023 B/s rd, 98 MiB/s wr, 1.57k op/s 2024-02-10T08:29:08.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:29:06.983100+0000 mon.c (mon.2) 63 : audit [DBG] from='client.? 172.21.15.18:0/3594998011' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:29:08.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:07.001876+0000 osd.6 (osd.6) 129 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:29:08.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:07.001940+0000 osd.6 (osd.6) 130 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:29:08.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:07.054344+0000 osd.5 (osd.5) 153 : cluster [DBG] 4.8 scrub starts 2024-02-10T08:29:08.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:07.059642+0000 osd.5 (osd.5) 154 : cluster [DBG] 4.8 scrub ok 2024-02-10T08:29:08.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:06.422846+0000 osd.0 (osd.0) 130 : cluster [DBG] 3.1 scrub starts 2024-02-10T08:29:08.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:06.426383+0000 osd.0 (osd.0) 131 : cluster [DBG] 3.1 scrub ok 2024-02-10T08:29:08.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:06.829405+0000 mgr.y (mgr.14505) 466 : cluster [DBG] pgmap v562: 158 pgs: 158 active+clean; 3.1 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 1023 B/s rd, 98 MiB/s wr, 1.57k op/s 2024-02-10T08:29:08.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:29:06.983100+0000 mon.c (mon.2) 63 : audit [DBG] from='client.? 172.21.15.18:0/3594998011' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:29:08.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:07.001876+0000 osd.6 (osd.6) 129 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:29:08.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:07.001940+0000 osd.6 (osd.6) 130 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:29:08.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:07.054344+0000 osd.5 (osd.5) 153 : cluster [DBG] 4.8 scrub starts 2024-02-10T08:29:08.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:07.059642+0000 osd.5 (osd.5) 154 : cluster [DBG] 4.8 scrub ok 2024-02-10T08:29:08.218 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:06.422846+0000 osd.0 (osd.0) 130 : cluster [DBG] 3.1 scrub starts 2024-02-10T08:29:08.219 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:06.426383+0000 osd.0 (osd.0) 131 : cluster [DBG] 3.1 scrub ok 2024-02-10T08:29:08.219 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:06.829405+0000 mgr.y (mgr.14505) 466 : cluster [DBG] pgmap v562: 158 pgs: 158 active+clean; 3.1 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 1023 B/s rd, 98 MiB/s wr, 1.57k op/s 2024-02-10T08:29:08.219 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:29:06.983100+0000 mon.c (mon.2) 63 : audit [DBG] from='client.? 172.21.15.18:0/3594998011' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:29:08.219 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:07.001876+0000 osd.6 (osd.6) 129 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:29:08.219 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:07.001940+0000 osd.6 (osd.6) 130 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:29:08.219 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:07.054344+0000 osd.5 (osd.5) 153 : cluster [DBG] 4.8 scrub starts 2024-02-10T08:29:08.219 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:07.059642+0000 osd.5 (osd.5) 154 : cluster [DBG] 4.8 scrub ok 2024-02-10T08:29:08.539 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:29:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:29:09.144 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 31 16 58992 58976 118.864 85.8125 0.00736281 0.00840867 2024-02-10T08:29:09.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:07.881702+0000 mon.a (mon.0) 1319 : cluster [DBG] osdmap e269: 8 total, 8 up, 8 in 2024-02-10T08:29:09.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:08.100109+0000 osd.5 (osd.5) 155 : cluster [DBG] 6.19 scrub starts 2024-02-10T08:29:09.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:08.143229+0000 osd.5 (osd.5) 156 : cluster [DBG] 6.19 scrub ok 2024-02-10T08:29:09.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:29:08.214102+0000 mgr.y (mgr.14505) 467 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:29:09.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:07.881702+0000 mon.a (mon.0) 1319 : cluster [DBG] osdmap e269: 8 total, 8 up, 8 in 2024-02-10T08:29:09.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:08.100109+0000 osd.5 (osd.5) 155 : cluster [DBG] 6.19 scrub starts 2024-02-10T08:29:09.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:08.143229+0000 osd.5 (osd.5) 156 : cluster [DBG] 6.19 scrub ok 2024-02-10T08:29:09.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:29:08.214102+0000 mgr.y (mgr.14505) 467 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:29:09.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:07.881702+0000 mon.a (mon.0) 1319 : cluster [DBG] osdmap e269: 8 total, 8 up, 8 in 2024-02-10T08:29:09.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:08.100109+0000 osd.5 (osd.5) 155 : cluster [DBG] 6.19 scrub starts 2024-02-10T08:29:09.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:08.143229+0000 osd.5 (osd.5) 156 : cluster [DBG] 6.19 scrub ok 2024-02-10T08:29:09.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:29:08.214102+0000 mgr.y (mgr.14505) 467 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:29:10.144 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 32 16 60345 60329 117.792 84.5625 0.00637829 0.00848472 2024-02-10T08:29:10.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:07.966353+0000 osd.4 (osd.4) 68 : cluster [DBG] 4.18 scrub starts 2024-02-10T08:29:10.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:07.976935+0000 osd.4 (osd.4) 69 : cluster [DBG] 4.18 scrub ok 2024-02-10T08:29:10.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:08.829927+0000 mgr.y (mgr.14505) 468 : cluster [DBG] pgmap v564: 158 pgs: 158 active+clean; 3.5 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 1.2 KiB/s rd, 109 MiB/s wr, 1.75k op/s 2024-02-10T08:29:10.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:09.128814+0000 osd.5 (osd.5) 157 : cluster [DBG] 4.15 scrub starts 2024-02-10T08:29:10.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:09.148223+0000 osd.5 (osd.5) 158 : cluster [DBG] 4.15 scrub ok 2024-02-10T08:29:10.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:09.325281+0000 osd.7 (osd.7) 161 : cluster [DBG] 4.16 scrub starts 2024-02-10T08:29:10.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:09.329152+0000 osd.7 (osd.7) 162 : cluster [DBG] 4.16 scrub ok 2024-02-10T08:29:10.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:09.395623+0000 osd.6 (osd.6) 131 : cluster [DBG] 4.a scrub starts 2024-02-10T08:29:10.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:09.404569+0000 osd.6 (osd.6) 132 : cluster [DBG] 4.a scrub ok 2024-02-10T08:29:10.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:07.966353+0000 osd.4 (osd.4) 68 : cluster [DBG] 4.18 scrub starts 2024-02-10T08:29:10.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:07.976935+0000 osd.4 (osd.4) 69 : cluster [DBG] 4.18 scrub ok 2024-02-10T08:29:10.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:08.829927+0000 mgr.y (mgr.14505) 468 : cluster [DBG] pgmap v564: 158 pgs: 158 active+clean; 3.5 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 1.2 KiB/s rd, 109 MiB/s wr, 1.75k op/s 2024-02-10T08:29:10.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:09.128814+0000 osd.5 (osd.5) 157 : cluster [DBG] 4.15 scrub starts 2024-02-10T08:29:10.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:09.148223+0000 osd.5 (osd.5) 158 : cluster [DBG] 4.15 scrub ok 2024-02-10T08:29:10.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:09.325281+0000 osd.7 (osd.7) 161 : cluster [DBG] 4.16 scrub starts 2024-02-10T08:29:10.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:09.329152+0000 osd.7 (osd.7) 162 : cluster [DBG] 4.16 scrub ok 2024-02-10T08:29:10.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:09.395623+0000 osd.6 (osd.6) 131 : cluster [DBG] 4.a scrub starts 2024-02-10T08:29:10.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:09.404569+0000 osd.6 (osd.6) 132 : cluster [DBG] 4.a scrub ok 2024-02-10T08:29:10.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:07.966353+0000 osd.4 (osd.4) 68 : cluster [DBG] 4.18 scrub starts 2024-02-10T08:29:10.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:07.976935+0000 osd.4 (osd.4) 69 : cluster [DBG] 4.18 scrub ok 2024-02-10T08:29:10.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:08.829927+0000 mgr.y (mgr.14505) 468 : cluster [DBG] pgmap v564: 158 pgs: 158 active+clean; 3.5 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 1.2 KiB/s rd, 109 MiB/s wr, 1.75k op/s 2024-02-10T08:29:10.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:09.128814+0000 osd.5 (osd.5) 157 : cluster [DBG] 4.15 scrub starts 2024-02-10T08:29:10.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:09.148223+0000 osd.5 (osd.5) 158 : cluster [DBG] 4.15 scrub ok 2024-02-10T08:29:10.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:09.325281+0000 osd.7 (osd.7) 161 : cluster [DBG] 4.16 scrub starts 2024-02-10T08:29:10.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:09.329152+0000 osd.7 (osd.7) 162 : cluster [DBG] 4.16 scrub ok 2024-02-10T08:29:10.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:09.395623+0000 osd.6 (osd.6) 131 : cluster [DBG] 4.a scrub starts 2024-02-10T08:29:10.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:09.404569+0000 osd.6 (osd.6) 132 : cluster [DBG] 4.a scrub ok 2024-02-10T08:29:11.144 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 33 16 61715 61699 116.817 85.625 0.0137023 0.00855555 2024-02-10T08:29:11.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:10.126767+0000 osd.5 (osd.5) 159 : cluster [DBG] 2.16 scrub starts 2024-02-10T08:29:11.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:10.131050+0000 osd.5 (osd.5) 160 : cluster [DBG] 2.16 scrub ok 2024-02-10T08:29:11.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:10.378468+0000 osd.6 (osd.6) 133 : cluster [DBG] 2.14 scrub starts 2024-02-10T08:29:11.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:10.389133+0000 osd.6 (osd.6) 134 : cluster [DBG] 2.14 scrub ok 2024-02-10T08:29:11.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:10.740691+0000 mon.a (mon.0) 1320 : cluster [DBG] osdmap e270: 8 total, 8 up, 8 in 2024-02-10T08:29:11.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:10.126767+0000 osd.5 (osd.5) 159 : cluster [DBG] 2.16 scrub starts 2024-02-10T08:29:11.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:10.131050+0000 osd.5 (osd.5) 160 : cluster [DBG] 2.16 scrub ok 2024-02-10T08:29:11.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:10.378468+0000 osd.6 (osd.6) 133 : cluster [DBG] 2.14 scrub starts 2024-02-10T08:29:11.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:10.389133+0000 osd.6 (osd.6) 134 : cluster [DBG] 2.14 scrub ok 2024-02-10T08:29:11.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:10.740691+0000 mon.a (mon.0) 1320 : cluster [DBG] osdmap e270: 8 total, 8 up, 8 in 2024-02-10T08:29:11.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:10.126767+0000 osd.5 (osd.5) 159 : cluster [DBG] 2.16 scrub starts 2024-02-10T08:29:11.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:10.131050+0000 osd.5 (osd.5) 160 : cluster [DBG] 2.16 scrub ok 2024-02-10T08:29:11.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:10.378468+0000 osd.6 (osd.6) 133 : cluster [DBG] 2.14 scrub starts 2024-02-10T08:29:11.407 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:10.389133+0000 osd.6 (osd.6) 134 : cluster [DBG] 2.14 scrub ok 2024-02-10T08:29:11.407 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:10.740691+0000 mon.a (mon.0) 1320 : cluster [DBG] osdmap e270: 8 total, 8 up, 8 in 2024-02-10T08:29:11.526 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-10T08:29:12.065 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:29:12.069 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:12.069 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:29:12.144 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 34 16 63028 63012 115.795 82.0625 0.0113533 0.00863156 2024-02-10T08:29:12.171 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:29:12.213 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:10.830416+0000 mgr.y (mgr.14505) 469 : cluster [DBG] pgmap v566: 158 pgs: 158 active+clean; 3.5 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 639 B/s rd, 69 MiB/s wr, 1.10k op/s 2024-02-10T08:29:12.213 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:11.162250+0000 osd.5 (osd.5) 161 : cluster [DBG] 2.2 scrub starts 2024-02-10T08:29:12.214 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:11.165671+0000 osd.5 (osd.5) 162 : cluster [DBG] 2.2 scrub ok 2024-02-10T08:29:12.214 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:11.415199+0000 osd.6 (osd.6) 135 : cluster [DBG] 5.2 scrub starts 2024-02-10T08:29:12.214 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:11.420024+0000 osd.6 (osd.6) 136 : cluster [DBG] 5.2 scrub ok 2024-02-10T08:29:12.214 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:10.830416+0000 mgr.y (mgr.14505) 469 : cluster [DBG] pgmap v566: 158 pgs: 158 active+clean; 3.5 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 639 B/s rd, 69 MiB/s wr, 1.10k op/s 2024-02-10T08:29:12.214 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:11.162250+0000 osd.5 (osd.5) 161 : cluster [DBG] 2.2 scrub starts 2024-02-10T08:29:12.214 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:11.165671+0000 osd.5 (osd.5) 162 : cluster [DBG] 2.2 scrub ok 2024-02-10T08:29:12.214 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:11.415199+0000 osd.6 (osd.6) 135 : cluster [DBG] 5.2 scrub starts 2024-02-10T08:29:12.214 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:11.420024+0000 osd.6 (osd.6) 136 : cluster [DBG] 5.2 scrub ok 2024-02-10T08:29:12.217 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:12.266 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:29:12.275 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:12.276 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:29:12.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:10.830416+0000 mgr.y (mgr.14505) 469 : cluster [DBG] pgmap v566: 158 pgs: 158 active+clean; 3.5 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 639 B/s rd, 69 MiB/s wr, 1.10k op/s 2024-02-10T08:29:12.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:11.162250+0000 osd.5 (osd.5) 161 : cluster [DBG] 2.2 scrub starts 2024-02-10T08:29:12.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:11.165671+0000 osd.5 (osd.5) 162 : cluster [DBG] 2.2 scrub ok 2024-02-10T08:29:12.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:11.415199+0000 osd.6 (osd.6) 135 : cluster [DBG] 5.2 scrub starts 2024-02-10T08:29:12.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:11.420024+0000 osd.6 (osd.6) 136 : cluster [DBG] 5.2 scrub ok 2024-02-10T08:29:12.376 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:29:12.427 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:12.457 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:29:12.461 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:12.462 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:29:12.562 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:29:12.621 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:12.969 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:29:13.092 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:29:13.098 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:13.099 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:29:13.109 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:29:13.144 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 35 16 64248 64232 114.665 76.25 0.0166734 0.00871589 2024-02-10T08:29:13.200 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:29:13.243 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:11.487244+0000 osd.0 (osd.0) 132 : cluster [DBG] 6.10 scrub starts 2024-02-10T08:29:13.243 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:11.496101+0000 osd.0 (osd.0) 133 : cluster [DBG] 6.10 scrub ok 2024-02-10T08:29:13.243 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:11.686990+0000 osd.1 (osd.1) 149 : cluster [DBG] 4.2 scrub starts 2024-02-10T08:29:13.243 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:11.694991+0000 osd.1 (osd.1) 150 : cluster [DBG] 4.2 scrub ok 2024-02-10T08:29:13.243 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:12.159925+0000 osd.5 (osd.5) 163 : cluster [DBG] 5.16 scrub starts 2024-02-10T08:29:13.243 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:12.163632+0000 osd.5 (osd.5) 164 : cluster [DBG] 5.16 scrub ok 2024-02-10T08:29:13.243 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:12.415427+0000 osd.7 (osd.7) 163 : cluster [DBG] 6.12 scrub starts 2024-02-10T08:29:13.243 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:12.421028+0000 osd.7 (osd.7) 164 : cluster [DBG] 6.12 scrub ok 2024-02-10T08:29:13.244 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:11.487244+0000 osd.0 (osd.0) 132 : cluster [DBG] 6.10 scrub starts 2024-02-10T08:29:13.244 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:11.496101+0000 osd.0 (osd.0) 133 : cluster [DBG] 6.10 scrub ok 2024-02-10T08:29:13.244 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:11.686990+0000 osd.1 (osd.1) 149 : cluster [DBG] 4.2 scrub starts 2024-02-10T08:29:13.244 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:11.694991+0000 osd.1 (osd.1) 150 : cluster [DBG] 4.2 scrub ok 2024-02-10T08:29:13.244 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:12.159925+0000 osd.5 (osd.5) 163 : cluster [DBG] 5.16 scrub starts 2024-02-10T08:29:13.244 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:12.163632+0000 osd.5 (osd.5) 164 : cluster [DBG] 5.16 scrub ok 2024-02-10T08:29:13.244 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:12.415427+0000 osd.7 (osd.7) 163 : cluster [DBG] 6.12 scrub starts 2024-02-10T08:29:13.244 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:12.421028+0000 osd.7 (osd.7) 164 : cluster [DBG] 6.12 scrub ok 2024-02-10T08:29:13.253 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:13.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:11.487244+0000 osd.0 (osd.0) 132 : cluster [DBG] 6.10 scrub starts 2024-02-10T08:29:13.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:11.496101+0000 osd.0 (osd.0) 133 : cluster [DBG] 6.10 scrub ok 2024-02-10T08:29:13.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:11.686990+0000 osd.1 (osd.1) 149 : cluster [DBG] 4.2 scrub starts 2024-02-10T08:29:13.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:11.694991+0000 osd.1 (osd.1) 150 : cluster [DBG] 4.2 scrub ok 2024-02-10T08:29:13.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:12.159925+0000 osd.5 (osd.5) 163 : cluster [DBG] 5.16 scrub starts 2024-02-10T08:29:13.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:12.163632+0000 osd.5 (osd.5) 164 : cluster [DBG] 5.16 scrub ok 2024-02-10T08:29:13.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:12.415427+0000 osd.7 (osd.7) 163 : cluster [DBG] 6.12 scrub starts 2024-02-10T08:29:13.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:12.421028+0000 osd.7 (osd.7) 164 : cluster [DBG] 6.12 scrub ok 2024-02-10T08:29:13.398 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:29:13.405 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:13.405 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:29:13.506 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:29:13.544 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:13.576 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:29:13.583 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:13.584 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:29:13.684 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:29:13.744 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:13.964 INFO:teuthology.orchestra.run.smithi018.stderr:set 9.0 pg_upmap mapping to [5,6,4] 2024-02-10T08:29:14.145 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 36 15 65497 65482 113.65 78.125 0.00586282 0.00877931 2024-02-10T08:29:14.248 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:12.424213+0000 osd.2 (osd.2) 123 : cluster [DBG] 5.d scrub starts 2024-02-10T08:29:14.248 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:12.429333+0000 osd.2 (osd.2) 124 : cluster [DBG] 5.d scrub ok 2024-02-10T08:29:14.248 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:12.831171+0000 mgr.y (mgr.14505) 470 : cluster [DBG] pgmap v567: 158 pgs: 158 active+clean; 3.8 GiB data, 14 GiB used, 702 GiB / 715 GiB avail; 1.2 KiB/s rd, 96 MiB/s wr, 1.54k op/s 2024-02-10T08:29:14.248 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:29:13.111567+0000 mon.a (mon.0) 1321 : audit [INF] from='client.? 172.21.15.18:0/935953378' entity='client.admin' cmd=[{"prefix": "osd pg-upmap", "pgid": "9.0", "id": [5, 6, 4]}]: dispatch 2024-02-10T08:29:14.249 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:13.136963+0000 osd.5 (osd.5) 165 : cluster [DBG] 5.e scrub starts 2024-02-10T08:29:14.249 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:13.140614+0000 osd.5 (osd.5) 166 : cluster [DBG] 5.e scrub ok 2024-02-10T08:29:14.249 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:13.412436+0000 osd.7 (osd.7) 165 : cluster [DBG] 5.4 scrub starts 2024-02-10T08:29:14.249 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:13.416456+0000 osd.7 (osd.7) 166 : cluster [DBG] 5.4 scrub ok 2024-02-10T08:29:14.249 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:12.424213+0000 osd.2 (osd.2) 123 : cluster [DBG] 5.d scrub starts 2024-02-10T08:29:14.249 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:12.429333+0000 osd.2 (osd.2) 124 : cluster [DBG] 5.d scrub ok 2024-02-10T08:29:14.249 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:12.831171+0000 mgr.y (mgr.14505) 470 : cluster [DBG] pgmap v567: 158 pgs: 158 active+clean; 3.8 GiB data, 14 GiB used, 702 GiB / 715 GiB avail; 1.2 KiB/s rd, 96 MiB/s wr, 1.54k op/s 2024-02-10T08:29:14.249 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:29:13.111567+0000 mon.a (mon.0) 1321 : audit [INF] from='client.? 172.21.15.18:0/935953378' entity='client.admin' cmd=[{"prefix": "osd pg-upmap", "pgid": "9.0", "id": [5, 6, 4]}]: dispatch 2024-02-10T08:29:14.249 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:13.136963+0000 osd.5 (osd.5) 165 : cluster [DBG] 5.e scrub starts 2024-02-10T08:29:14.249 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:13.140614+0000 osd.5 (osd.5) 166 : cluster [DBG] 5.e scrub ok 2024-02-10T08:29:14.250 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:13.412436+0000 osd.7 (osd.7) 165 : cluster [DBG] 5.4 scrub starts 2024-02-10T08:29:14.250 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:13.416456+0000 osd.7 (osd.7) 166 : cluster [DBG] 5.4 scrub ok 2024-02-10T08:29:14.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:12.424213+0000 osd.2 (osd.2) 123 : cluster [DBG] 5.d scrub starts 2024-02-10T08:29:14.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:12.429333+0000 osd.2 (osd.2) 124 : cluster [DBG] 5.d scrub ok 2024-02-10T08:29:14.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:12.831171+0000 mgr.y (mgr.14505) 470 : cluster [DBG] pgmap v567: 158 pgs: 158 active+clean; 3.8 GiB data, 14 GiB used, 702 GiB / 715 GiB avail; 1.2 KiB/s rd, 96 MiB/s wr, 1.54k op/s 2024-02-10T08:29:14.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:29:13.111567+0000 mon.a (mon.0) 1321 : audit [INF] from='client.? 172.21.15.18:0/935953378' entity='client.admin' cmd=[{"prefix": "osd pg-upmap", "pgid": "9.0", "id": [5, 6, 4]}]: dispatch 2024-02-10T08:29:14.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:13.136963+0000 osd.5 (osd.5) 165 : cluster [DBG] 5.e scrub starts 2024-02-10T08:29:14.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:13.140614+0000 osd.5 (osd.5) 166 : cluster [DBG] 5.e scrub ok 2024-02-10T08:29:14.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:13.412436+0000 osd.7 (osd.7) 165 : cluster [DBG] 5.4 scrub starts 2024-02-10T08:29:14.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:13.416456+0000 osd.7 (osd.7) 166 : cluster [DBG] 5.4 scrub ok 2024-02-10T08:29:15.145 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 37 16 65641 65625 110.821 8.9375 0.00284669 0.00876987 2024-02-10T08:29:15.269 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:13.498320+0000 osd.0 (osd.0) 134 : cluster [DBG] 4.1a scrub starts 2024-02-10T08:29:15.269 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:13.500013+0000 osd.0 (osd.0) 135 : cluster [DBG] 4.1a scrub ok 2024-02-10T08:29:15.269 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:29:13.937460+0000 mon.a (mon.0) 1322 : audit [INF] from='client.? 172.21.15.18:0/935953378' entity='client.admin' cmd='[{"prefix": "osd pg-upmap", "pgid": "9.0", "id": [5, 6, 4]}]': finished 2024-02-10T08:29:15.269 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:13.937520+0000 mon.a (mon.0) 1323 : cluster [DBG] osdmap e271: 8 total, 8 up, 8 in 2024-02-10T08:29:15.269 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:14.138332+0000 osd.5 (osd.5) 167 : cluster [DBG] 5.7 scrub starts 2024-02-10T08:29:15.269 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:14.145485+0000 osd.5 (osd.5) 168 : cluster [DBG] 5.7 scrub ok 2024-02-10T08:29:15.269 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:14.468152+0000 osd.6 (osd.6) 137 : cluster [DBG] 2.19 scrub starts 2024-02-10T08:29:15.270 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:14.469281+0000 osd.6 (osd.6) 138 : cluster [DBG] 2.19 scrub ok 2024-02-10T08:29:15.270 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:13.498320+0000 osd.0 (osd.0) 134 : cluster [DBG] 4.1a scrub starts 2024-02-10T08:29:15.270 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:13.500013+0000 osd.0 (osd.0) 135 : cluster [DBG] 4.1a scrub ok 2024-02-10T08:29:15.270 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:29:13.937460+0000 mon.a (mon.0) 1322 : audit [INF] from='client.? 172.21.15.18:0/935953378' entity='client.admin' cmd='[{"prefix": "osd pg-upmap", "pgid": "9.0", "id": [5, 6, 4]}]': finished 2024-02-10T08:29:15.270 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:13.937520+0000 mon.a (mon.0) 1323 : cluster [DBG] osdmap e271: 8 total, 8 up, 8 in 2024-02-10T08:29:15.270 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:14.138332+0000 osd.5 (osd.5) 167 : cluster [DBG] 5.7 scrub starts 2024-02-10T08:29:15.270 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:14.145485+0000 osd.5 (osd.5) 168 : cluster [DBG] 5.7 scrub ok 2024-02-10T08:29:15.270 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:14.468152+0000 osd.6 (osd.6) 137 : cluster [DBG] 2.19 scrub starts 2024-02-10T08:29:15.271 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:14.469281+0000 osd.6 (osd.6) 138 : cluster [DBG] 2.19 scrub ok 2024-02-10T08:29:15.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:13.498320+0000 osd.0 (osd.0) 134 : cluster [DBG] 4.1a scrub starts 2024-02-10T08:29:15.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:13.500013+0000 osd.0 (osd.0) 135 : cluster [DBG] 4.1a scrub ok 2024-02-10T08:29:15.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:29:13.937460+0000 mon.a (mon.0) 1322 : audit [INF] from='client.? 172.21.15.18:0/935953378' entity='client.admin' cmd='[{"prefix": "osd pg-upmap", "pgid": "9.0", "id": [5, 6, 4]}]': finished 2024-02-10T08:29:15.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:13.937520+0000 mon.a (mon.0) 1323 : cluster [DBG] osdmap e271: 8 total, 8 up, 8 in 2024-02-10T08:29:15.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:14.138332+0000 osd.5 (osd.5) 167 : cluster [DBG] 5.7 scrub starts 2024-02-10T08:29:15.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:14.145485+0000 osd.5 (osd.5) 168 : cluster [DBG] 5.7 scrub ok 2024-02-10T08:29:15.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:14.468152+0000 osd.6 (osd.6) 137 : cluster [DBG] 2.19 scrub starts 2024-02-10T08:29:15.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:14.469281+0000 osd.6 (osd.6) 138 : cluster [DBG] 2.19 scrub ok 2024-02-10T08:29:16.100 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:14.447053+0000 osd.2 (osd.2) 125 : cluster [DBG] 5.8 scrub starts 2024-02-10T08:29:16.100 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:14.447804+0000 osd.2 (osd.2) 126 : cluster [DBG] 5.8 scrub ok 2024-02-10T08:29:16.100 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:14.523943+0000 osd.0 (osd.0) 136 : cluster [DBG] 6.0 scrub starts 2024-02-10T08:29:16.100 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:14.537936+0000 osd.0 (osd.0) 137 : cluster [DBG] 6.0 scrub ok 2024-02-10T08:29:16.100 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:14.831585+0000 mgr.y (mgr.14505) 471 : cluster [DBG] pgmap v569: 158 pgs: 158 active+clean; 3.9 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 736 B/s rd, 71 MiB/s wr, 1.14k op/s 2024-02-10T08:29:16.100 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:14.951347+0000 mon.a (mon.0) 1324 : cluster [DBG] osdmap e272: 8 total, 8 up, 8 in 2024-02-10T08:29:16.100 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:15.488855+0000 osd.6 (osd.6) 139 : cluster [DBG] 6.c scrub starts 2024-02-10T08:29:16.100 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:15.491743+0000 osd.6 (osd.6) 140 : cluster [DBG] 6.c scrub ok 2024-02-10T08:29:16.100 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:15.696990+0000 osd.1 (osd.1) 151 : cluster [DBG] 5.0 scrub starts 2024-02-10T08:29:16.100 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:15.700459+0000 osd.1 (osd.1) 152 : cluster [DBG] 5.0 scrub ok 2024-02-10T08:29:16.101 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:14.447053+0000 osd.2 (osd.2) 125 : cluster [DBG] 5.8 scrub starts 2024-02-10T08:29:16.101 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:14.447804+0000 osd.2 (osd.2) 126 : cluster [DBG] 5.8 scrub ok 2024-02-10T08:29:16.101 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:14.523943+0000 osd.0 (osd.0) 136 : cluster [DBG] 6.0 scrub starts 2024-02-10T08:29:16.101 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:14.537936+0000 osd.0 (osd.0) 137 : cluster [DBG] 6.0 scrub ok 2024-02-10T08:29:16.101 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:14.831585+0000 mgr.y (mgr.14505) 471 : cluster [DBG] pgmap v569: 158 pgs: 158 active+clean; 3.9 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 736 B/s rd, 71 MiB/s wr, 1.14k op/s 2024-02-10T08:29:16.101 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:14.951347+0000 mon.a (mon.0) 1324 : cluster [DBG] osdmap e272: 8 total, 8 up, 8 in 2024-02-10T08:29:16.101 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:15.488855+0000 osd.6 (osd.6) 139 : cluster [DBG] 6.c scrub starts 2024-02-10T08:29:16.101 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:15.491743+0000 osd.6 (osd.6) 140 : cluster [DBG] 6.c scrub ok 2024-02-10T08:29:16.101 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:15.696990+0000 osd.1 (osd.1) 151 : cluster [DBG] 5.0 scrub starts 2024-02-10T08:29:16.101 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:15.700459+0000 osd.1 (osd.1) 152 : cluster [DBG] 5.0 scrub ok 2024-02-10T08:29:16.111 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:29:16.115 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:16.115 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:29:16.145 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 38 16 65641 65625 107.905 0 - 0.00876987 2024-02-10T08:29:16.216 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:29:16.247 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:16.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:14.447053+0000 osd.2 (osd.2) 125 : cluster [DBG] 5.8 scrub starts 2024-02-10T08:29:16.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:14.447804+0000 osd.2 (osd.2) 126 : cluster [DBG] 5.8 scrub ok 2024-02-10T08:29:16.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:14.523943+0000 osd.0 (osd.0) 136 : cluster [DBG] 6.0 scrub starts 2024-02-10T08:29:16.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:14.537936+0000 osd.0 (osd.0) 137 : cluster [DBG] 6.0 scrub ok 2024-02-10T08:29:16.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:14.831585+0000 mgr.y (mgr.14505) 471 : cluster [DBG] pgmap v569: 158 pgs: 158 active+clean; 3.9 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 736 B/s rd, 71 MiB/s wr, 1.14k op/s 2024-02-10T08:29:16.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:14.951347+0000 mon.a (mon.0) 1324 : cluster [DBG] osdmap e272: 8 total, 8 up, 8 in 2024-02-10T08:29:16.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:15.488855+0000 osd.6 (osd.6) 139 : cluster [DBG] 6.c scrub starts 2024-02-10T08:29:16.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:15.491743+0000 osd.6 (osd.6) 140 : cluster [DBG] 6.c scrub ok 2024-02-10T08:29:16.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:15.696990+0000 osd.1 (osd.1) 151 : cluster [DBG] 5.0 scrub starts 2024-02-10T08:29:16.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:15.700459+0000 osd.1 (osd.1) 152 : cluster [DBG] 5.0 scrub ok 2024-02-10T08:29:16.789 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:29:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:29:16] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:29:17.104 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:29:17.108 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:17.108 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:29:17.148 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 39 16 66456 66440 106.436 25.4688 0.0180658 0.0093896 2024-02-10T08:29:17.210 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:29:17.256 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:15.951964+0000 mon.a (mon.0) 1325 : cluster [DBG] osdmap e273: 8 total, 8 up, 8 in 2024-02-10T08:29:17.256 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:15.955003+0000 osd.1 (osd.1) 153 : cluster [DBG] 9.0 starting backfill to osd.4 from (0'0,0'0] MAX to 270'4123 2024-02-10T08:29:17.256 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:15.960933+0000 osd.1 (osd.1) 154 : cluster [DBG] 9.0 starting backfill to osd.5 from (0'0,0'0] MAX to 270'4123 2024-02-10T08:29:17.258 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:17.299 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:29:17.308 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:17.309 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:29:17.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:15.951964+0000 mon.a (mon.0) 1325 : cluster [DBG] osdmap e273: 8 total, 8 up, 8 in 2024-02-10T08:29:17.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:15.955003+0000 osd.1 (osd.1) 153 : cluster [DBG] 9.0 starting backfill to osd.4 from (0'0,0'0] MAX to 270'4123 2024-02-10T08:29:17.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:15.960933+0000 osd.1 (osd.1) 154 : cluster [DBG] 9.0 starting backfill to osd.5 from (0'0,0'0] MAX to 270'4123 2024-02-10T08:29:17.405 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:29:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:29:17] "GET /metrics HTTP/1.1" 200 176173 "" "Prometheus/2.33.4" 2024-02-10T08:29:17.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:15.951964+0000 mon.a (mon.0) 1325 : cluster [DBG] osdmap e273: 8 total, 8 up, 8 in 2024-02-10T08:29:17.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:15.955003+0000 osd.1 (osd.1) 153 : cluster [DBG] 9.0 starting backfill to osd.4 from (0'0,0'0] MAX to 270'4123 2024-02-10T08:29:17.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:15.960933+0000 osd.1 (osd.1) 154 : cluster [DBG] 9.0 starting backfill to osd.5 from (0'0,0'0] MAX to 270'4123 2024-02-10T08:29:17.410 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:29:17.464 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:17.506 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:29:17.509 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:17.510 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:29:17.610 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:29:17.675 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:17.716 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:29:17.722 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:17.723 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:29:17.824 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:29:17.893 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:17.992 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:16.831975+0000 mgr.y (mgr.14505) 472 : cluster [DBG] pgmap v572: 158 pgs: 158 active+clean; 3.9 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 853 B/s rd, 69 MiB/s wr, 1.10k op/s 2024-02-10T08:29:17.992 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:16.831975+0000 mgr.y (mgr.14505) 472 : cluster [DBG] pgmap v572: 158 pgs: 158 active+clean; 3.9 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 853 B/s rd, 69 MiB/s wr, 1.10k op/s 2024-02-10T08:29:18.022 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:29:18.023 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:18.023 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:29:18.124 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:29:18.150 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:2024-02-10T08:29:18.150629+0000 min lat: 0.00124578 max lat: 2.57704 avg lat: 0.00946585 2024-02-10T08:29:18.150 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-02-10T08:29:18.150 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 40 16 67614 67598 105.579 72.375 0.0141468 0.00946585 2024-02-10T08:29:18.167 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:18.194 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:29:18.196 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:18.196 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:29:18.201 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-02-10T08:29:18.202 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:29:18.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:16.831975+0000 mgr.y (mgr.14505) 472 : cluster [DBG] pgmap v572: 158 pgs: 158 active+clean; 3.9 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 853 B/s rd, 69 MiB/s wr, 1.10k op/s 2024-02-10T08:29:18.289 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:29:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:29:18.297 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:29:18.358 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:18.390 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:29:18.393 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:18.394 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:29:18.495 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:29:18.558 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:18.600 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:29:18.603 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:18.604 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:29:18.704 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:29:18.767 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:18.813 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:29:18.818 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:18.819 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:29:18.920 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:29:18.973 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:19.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:17.542356+0000 osd.6 (osd.6) 141 : cluster [DBG] 6.27 scrub starts 2024-02-10T08:29:19.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:17.607811+0000 osd.6 (osd.6) 142 : cluster [DBG] 6.27 scrub ok 2024-02-10T08:29:19.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:29:18.229079+0000 mgr.y (mgr.14505) 473 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:29:19.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:29:18.286446+0000 mon.c (mon.2) 64 : audit [INF] from='client.? 172.21.15.18:0/3960416174' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:29:19.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:29:18.288861+0000 mon.a (mon.0) 1326 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:29:19.020 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:29:19.023 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is unset 2024-02-10T08:29:19.024 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.0 dump_historic_ops 2024-02-10T08:29:19.024 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:19.025 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:29:19.126 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:29:19.150 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 41 16 68797 68781 104.807 73.9375 0.0291785 0.00953712 2024-02-10T08:29:19.178 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:19.219 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:29:19.223 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:19.223 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:29:19.324 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:29:19.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:17.542356+0000 osd.6 (osd.6) 141 : cluster [DBG] 6.27 scrub starts 2024-02-10T08:29:19.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:17.607811+0000 osd.6 (osd.6) 142 : cluster [DBG] 6.27 scrub ok 2024-02-10T08:29:19.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:29:18.229079+0000 mgr.y (mgr.14505) 473 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:29:19.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:29:18.286446+0000 mon.c (mon.2) 64 : audit [INF] from='client.? 172.21.15.18:0/3960416174' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:29:19.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:29:18.288861+0000 mon.a (mon.0) 1326 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:29:19.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:17.542356+0000 osd.6 (osd.6) 141 : cluster [DBG] 6.27 scrub starts 2024-02-10T08:29:19.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:17.607811+0000 osd.6 (osd.6) 142 : cluster [DBG] 6.27 scrub ok 2024-02-10T08:29:19.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:29:18.229079+0000 mgr.y (mgr.14505) 473 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:29:19.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:29:18.286446+0000 mon.c (mon.2) 64 : audit [INF] from='client.? 172.21.15.18:0/3960416174' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:29:19.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:29:18.288861+0000 mon.a (mon.0) 1326 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:29:19.414 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:19.529 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:29:19.547 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:19.547 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:29:19.648 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:29:19.709 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:19.743 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:29:19.746 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:19.746 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:29:19.847 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:29:19.890 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:20.012 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:18.561078+0000 osd.2 (osd.2) 127 : cluster [DBG] 4.19 scrub starts 2024-02-10T08:29:20.150 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 42 16 69978 69962 104.069 73.8125 0.0164942 0.00960389 2024-02-10T08:29:20.229 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:29:20.256 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:29:20.260 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:20.261 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:29:20.262 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:18.561078+0000 osd.2 (osd.2) 127 : cluster [DBG] 4.19 scrub starts 2024-02-10T08:29:20.262 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:18.566342+0000 osd.2 (osd.2) 128 : cluster [DBG] 4.19 scrub ok 2024-02-10T08:29:20.262 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:18.832863+0000 mgr.y (mgr.14505) 474 : cluster [DBG] pgmap v573: 158 pgs: 1 active+remapped+backfill_toofull, 1 active+clean+scrubbing, 156 active+clean; 4.1 GiB data, 15 GiB used, 701 GiB / 715 GiB avail; 853 B/s rd, 50 MiB/s wr, 801 op/s; 8446/201771 objects misplaced (4.186%); 11 KiB/s, 0 objects/s recovering 2024-02-10T08:29:20.262 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:18.987963+0000 mon.a (mon.0) 1327 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-10T08:29:20.262 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:18.988002+0000 mon.a (mon.0) 1328 : cluster [INF] Cluster is now healthy 2024-02-10T08:29:20.262 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:18.988504+0000 mon.a (mon.0) 1329 : cluster [WRN] Health check failed: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull (PG_BACKFILL_FULL) 2024-02-10T08:29:20.262 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:29:18.994722+0000 mon.a (mon.0) 1330 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-10T08:29:20.262 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:18.994802+0000 mon.a (mon.0) 1331 : cluster [DBG] osdmap e274: 8 total, 8 up, 8 in 2024-02-10T08:29:20.263 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:19.219730+0000 osd.5 (osd.5) 169 : cluster [DBG] 6.24 scrub starts 2024-02-10T08:29:20.263 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:19.225290+0000 osd.5 (osd.5) 170 : cluster [DBG] 6.24 scrub ok 2024-02-10T08:29:20.263 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:19.373163+0000 osd.7 (osd.7) 167 : cluster [DBG] 5.10 scrub starts 2024-02-10T08:29:20.263 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:19.380396+0000 osd.7 (osd.7) 168 : cluster [DBG] 5.10 scrub ok 2024-02-10T08:29:20.263 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:19.494725+0000 osd.6 (osd.6) 143 : cluster [DBG] 6.22 scrub starts 2024-02-10T08:29:20.263 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:19.663362+0000 osd.1 (osd.1) 155 : cluster [DBG] 4.1d scrub starts 2024-02-10T08:29:20.263 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:19.670136+0000 osd.1 (osd.1) 156 : cluster [DBG] 4.1d scrub ok 2024-02-10T08:29:20.263 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:18.561078+0000 osd.2 (osd.2) 127 : cluster [DBG] 4.19 scrub starts 2024-02-10T08:29:20.263 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:18.566342+0000 osd.2 (osd.2) 128 : cluster [DBG] 4.19 scrub ok 2024-02-10T08:29:20.263 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:18.832863+0000 mgr.y (mgr.14505) 474 : cluster [DBG] pgmap v573: 158 pgs: 1 active+remapped+backfill_toofull, 1 active+clean+scrubbing, 156 active+clean; 4.1 GiB data, 15 GiB used, 701 GiB / 715 GiB avail; 853 B/s rd, 50 MiB/s wr, 801 op/s; 8446/201771 objects misplaced (4.186%); 11 KiB/s, 0 objects/s recovering 2024-02-10T08:29:20.263 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:18.987963+0000 mon.a (mon.0) 1327 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-10T08:29:20.264 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:18.988002+0000 mon.a (mon.0) 1328 : cluster [INF] Cluster is now healthy 2024-02-10T08:29:20.264 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:18.988504+0000 mon.a (mon.0) 1329 : cluster [WRN] Health check failed: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull (PG_BACKFILL_FULL) 2024-02-10T08:29:20.264 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:29:18.994722+0000 mon.a (mon.0) 1330 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-10T08:29:20.264 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:18.994802+0000 mon.a (mon.0) 1331 : cluster [DBG] osdmap e274: 8 total, 8 up, 8 in 2024-02-10T08:29:20.264 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:19.219730+0000 osd.5 (osd.5) 169 : cluster [DBG] 6.24 scrub starts 2024-02-10T08:29:20.264 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:19.225290+0000 osd.5 (osd.5) 170 : cluster [DBG] 6.24 scrub ok 2024-02-10T08:29:20.264 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:19.373163+0000 osd.7 (osd.7) 167 : cluster [DBG] 5.10 scrub starts 2024-02-10T08:29:20.264 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:19.380396+0000 osd.7 (osd.7) 168 : cluster [DBG] 5.10 scrub ok 2024-02-10T08:29:20.264 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:19.494725+0000 osd.6 (osd.6) 143 : cluster [DBG] 6.22 scrub starts 2024-02-10T08:29:20.264 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:19.663362+0000 osd.1 (osd.1) 155 : cluster [DBG] 4.1d scrub starts 2024-02-10T08:29:20.264 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:19.670136+0000 osd.1 (osd.1) 156 : cluster [DBG] 4.1d scrub ok 2024-02-10T08:29:20.271 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:29:20.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:18.566342+0000 osd.2 (osd.2) 128 : cluster [DBG] 4.19 scrub ok 2024-02-10T08:29:20.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:18.832863+0000 mgr.y (mgr.14505) 474 : cluster [DBG] pgmap v573: 158 pgs: 1 active+remapped+backfill_toofull, 1 active+clean+scrubbing, 156 active+clean; 4.1 GiB data, 15 GiB used, 701 GiB / 715 GiB avail; 853 B/s rd, 50 MiB/s wr, 801 op/s; 8446/201771 objects misplaced (4.186%); 11 KiB/s, 0 objects/s recovering 2024-02-10T08:29:20.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:18.987963+0000 mon.a (mon.0) 1327 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-10T08:29:20.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:18.988002+0000 mon.a (mon.0) 1328 : cluster [INF] Cluster is now healthy 2024-02-10T08:29:20.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:18.988504+0000 mon.a (mon.0) 1329 : cluster [WRN] Health check failed: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull (PG_BACKFILL_FULL) 2024-02-10T08:29:20.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:29:18.994722+0000 mon.a (mon.0) 1330 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-10T08:29:20.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:18.994802+0000 mon.a (mon.0) 1331 : cluster [DBG] osdmap e274: 8 total, 8 up, 8 in 2024-02-10T08:29:20.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:19.219730+0000 osd.5 (osd.5) 169 : cluster [DBG] 6.24 scrub starts 2024-02-10T08:29:20.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:19.225290+0000 osd.5 (osd.5) 170 : cluster [DBG] 6.24 scrub ok 2024-02-10T08:29:20.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:19.373163+0000 osd.7 (osd.7) 167 : cluster [DBG] 5.10 scrub starts 2024-02-10T08:29:20.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:19.380396+0000 osd.7 (osd.7) 168 : cluster [DBG] 5.10 scrub ok 2024-02-10T08:29:20.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:19.494725+0000 osd.6 (osd.6) 143 : cluster [DBG] 6.22 scrub starts 2024-02-10T08:29:20.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:19.663362+0000 osd.1 (osd.1) 155 : cluster [DBG] 4.1d scrub starts 2024-02-10T08:29:20.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:19.670136+0000 osd.1 (osd.1) 156 : cluster [DBG] 4.1d scrub ok 2024-02-10T08:29:20.297 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:29:20.303 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:29:20.352 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:29:20.362 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:29:20.385 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:29:20.403 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:20.415 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:29:20.430 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:29:20.438 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:20.438 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:29:20.455 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:29:20.499 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:29:20.506 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-10T08:29:20.507 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-10T08:29:20.507 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-10T08:29:20.507 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-10T08:29:20.507 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-10T08:29:20.507 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-10T08:29:20.507 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-10T08:29:20.507 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-10T08:29:20.538 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:29:20.588 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:20.621 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:29:20.623 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:20.623 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:29:20.724 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:29:20.798 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:20.907 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:29:20.912 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:20.913 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:29:21.013 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:29:21.067 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:19.511912+0000 osd.6 (osd.6) 144 : cluster [DBG] 6.22 scrub ok 2024-02-10T08:29:21.067 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:29:20.191754+0000 mon.a (mon.0) 1332 : audit [DBG] from='client.? 172.21.15.18:0/612301518' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:29:21.067 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:20.707782+0000 osd.1 (osd.1) 157 : cluster [DBG] 6.1d scrub starts 2024-02-10T08:29:21.067 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:20.739744+0000 osd.1 (osd.1) 158 : cluster [DBG] 6.1d scrub ok 2024-02-10T08:29:21.067 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:19.511912+0000 osd.6 (osd.6) 144 : cluster [DBG] 6.22 scrub ok 2024-02-10T08:29:21.067 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:29:20.191754+0000 mon.a (mon.0) 1332 : audit [DBG] from='client.? 172.21.15.18:0/612301518' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:29:21.067 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:20.707782+0000 osd.1 (osd.1) 157 : cluster [DBG] 6.1d scrub starts 2024-02-10T08:29:21.067 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:20.739744+0000 osd.1 (osd.1) 158 : cluster [DBG] 6.1d scrub ok 2024-02-10T08:29:21.068 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:21.118 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 3, 4, 5, 6, 7, 0] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 5, 6, 7, 4] 2024-02-10T08:29:21.118 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-10T08:29:21.119 INFO:tasks.thrashosds.thrasher:inject_pause on osd.4 2024-02-10T08:29:21.119 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-02-10T08:29:21.119 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-02-10T08:29:21.119 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.4 config set filestore_inject_stall 3 2024-02-10T08:29:21.150 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 43 16 71082 71066 103.254 69 0.0149433 0.00967961 2024-02-10T08:29:21.293 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:19.511912+0000 osd.6 (osd.6) 144 : cluster [DBG] 6.22 scrub ok 2024-02-10T08:29:21.293 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:29:20.191754+0000 mon.a (mon.0) 1332 : audit [DBG] from='client.? 172.21.15.18:0/612301518' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:29:21.293 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:20.707782+0000 osd.1 (osd.1) 157 : cluster [DBG] 6.1d scrub starts 2024-02-10T08:29:21.293 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:20.739744+0000 osd.1 (osd.1) 158 : cluster [DBG] 6.1d scrub ok 2024-02-10T08:29:21.523 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:29:21.527 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:21.528 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:29:21.585 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:29:21.629 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:29:21.672 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:21.735 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:29:21.738 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:21.739 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:29:21.839 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:29:21.896 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:21.936 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:29:21.941 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:21.941 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:29:22.041 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:29:22.120 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:22.150 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 44 15 72165 72150 102.447 67.75 0.0197301 0.00975617 2024-02-10T08:29:22.163 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd set noscrub 2024-02-10T08:29:22.167 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:29:22.174 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:22.174 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:29:22.176 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:20.517409+0000 osd.6 (osd.6) 145 : cluster [DBG] 4.5 scrub starts 2024-02-10T08:29:22.176 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:20.522252+0000 osd.6 (osd.6) 146 : cluster [DBG] 4.5 scrub ok 2024-02-10T08:29:22.176 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:20.757417+0000 osd.5 (osd.5) 171 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:29:22.176 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:20.757474+0000 osd.5 (osd.5) 172 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:29:22.176 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:20.833405+0000 mgr.y (mgr.14505) 475 : cluster [DBG] pgmap v575: 158 pgs: 1 active+remapped+backfill_toofull, 1 active+clean+scrubbing, 156 active+clean; 4.1 GiB data, 15 GiB used, 701 GiB / 715 GiB avail; 853 B/s rd, 39 MiB/s wr, 632 op/s; 8446/202500 objects misplaced (4.171%); 11 KiB/s, 0 objects/s recovering 2024-02-10T08:29:22.176 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:21.762610+0000 mon.a (mon.0) 1333 : cluster [DBG] osdmap e275: 8 total, 8 up, 8 in 2024-02-10T08:29:22.275 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:29:22.338 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:22.368 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:20.517409+0000 osd.6 (osd.6) 145 : cluster [DBG] 4.5 scrub starts 2024-02-10T08:29:22.368 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:20.522252+0000 osd.6 (osd.6) 146 : cluster [DBG] 4.5 scrub ok 2024-02-10T08:29:22.368 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:20.757417+0000 osd.5 (osd.5) 171 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:29:22.368 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:20.757474+0000 osd.5 (osd.5) 172 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:29:22.368 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:20.833405+0000 mgr.y (mgr.14505) 475 : cluster [DBG] pgmap v575: 158 pgs: 1 active+remapped+backfill_toofull, 1 active+clean+scrubbing, 156 active+clean; 4.1 GiB data, 15 GiB used, 701 GiB / 715 GiB avail; 853 B/s rd, 39 MiB/s wr, 632 op/s; 8446/202500 objects misplaced (4.171%); 11 KiB/s, 0 objects/s recovering 2024-02-10T08:29:22.368 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:21.762610+0000 mon.a (mon.0) 1333 : cluster [DBG] osdmap e275: 8 total, 8 up, 8 in 2024-02-10T08:29:22.369 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:20.517409+0000 osd.6 (osd.6) 145 : cluster [DBG] 4.5 scrub starts 2024-02-10T08:29:22.369 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:20.522252+0000 osd.6 (osd.6) 146 : cluster [DBG] 4.5 scrub ok 2024-02-10T08:29:22.369 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:20.757417+0000 osd.5 (osd.5) 171 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:29:22.369 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:20.757474+0000 osd.5 (osd.5) 172 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:29:22.369 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:20.833405+0000 mgr.y (mgr.14505) 475 : cluster [DBG] pgmap v575: 158 pgs: 1 active+remapped+backfill_toofull, 1 active+clean+scrubbing, 156 active+clean; 4.1 GiB data, 15 GiB used, 701 GiB / 715 GiB avail; 853 B/s rd, 39 MiB/s wr, 632 op/s; 8446/202500 objects misplaced (4.171%); 11 KiB/s, 0 objects/s recovering 2024-02-10T08:29:22.369 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:21.762610+0000 mon.a (mon.0) 1333 : cluster [DBG] osdmap e275: 8 total, 8 up, 8 in 2024-02-10T08:29:23.123 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:29:23.125 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:23.126 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:29:23.128 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:21.566151+0000 osd.6 (osd.6) 147 : cluster [DBG] 6.25 scrub starts 2024-02-10T08:29:23.128 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:21.601946+0000 osd.6 (osd.6) 148 : cluster [DBG] 6.25 scrub ok 2024-02-10T08:29:23.128 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:22.028371+0000 osd.4 (osd.4) 70 : cluster [DBG] 2.f scrub starts 2024-02-10T08:29:23.128 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:22.034261+0000 osd.4 (osd.4) 71 : cluster [DBG] 2.f scrub ok 2024-02-10T08:29:23.128 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:22.163963+0000 osd.5 (osd.5) 173 : cluster [DBG] 5.1b scrub starts 2024-02-10T08:29:23.128 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:22.171899+0000 osd.5 (osd.5) 174 : cluster [DBG] 5.1b scrub ok 2024-02-10T08:29:23.128 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:22.293145+0000 osd.7 (osd.7) 169 : cluster [DBG] 4.11 scrub starts 2024-02-10T08:29:23.128 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:22.311994+0000 osd.7 (osd.7) 170 : cluster [DBG] 4.11 scrub ok 2024-02-10T08:29:23.128 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:21.566151+0000 osd.6 (osd.6) 147 : cluster [DBG] 6.25 scrub starts 2024-02-10T08:29:23.129 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:21.601946+0000 osd.6 (osd.6) 148 : cluster [DBG] 6.25 scrub ok 2024-02-10T08:29:23.129 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:22.028371+0000 osd.4 (osd.4) 70 : cluster [DBG] 2.f scrub starts 2024-02-10T08:29:23.129 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:22.034261+0000 osd.4 (osd.4) 71 : cluster [DBG] 2.f scrub ok 2024-02-10T08:29:23.129 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:22.163963+0000 osd.5 (osd.5) 173 : cluster [DBG] 5.1b scrub starts 2024-02-10T08:29:23.129 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:22.171899+0000 osd.5 (osd.5) 174 : cluster [DBG] 5.1b scrub ok 2024-02-10T08:29:23.129 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:22.293145+0000 osd.7 (osd.7) 169 : cluster [DBG] 4.11 scrub starts 2024-02-10T08:29:23.129 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:22.311994+0000 osd.7 (osd.7) 170 : cluster [DBG] 4.11 scrub ok 2024-02-10T08:29:23.150 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 45 16 73300 73284 101.746 70.875 0.00422956 0.00982398 2024-02-10T08:29:23.227 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:29:23.296 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:21.566151+0000 osd.6 (osd.6) 147 : cluster [DBG] 6.25 scrub starts 2024-02-10T08:29:23.296 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:21.601946+0000 osd.6 (osd.6) 148 : cluster [DBG] 6.25 scrub ok 2024-02-10T08:29:23.296 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:22.028371+0000 osd.4 (osd.4) 70 : cluster [DBG] 2.f scrub starts 2024-02-10T08:29:23.296 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:22.034261+0000 osd.4 (osd.4) 71 : cluster [DBG] 2.f scrub ok 2024-02-10T08:29:23.296 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:22.163963+0000 osd.5 (osd.5) 173 : cluster [DBG] 5.1b scrub starts 2024-02-10T08:29:23.296 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:22.171899+0000 osd.5 (osd.5) 174 : cluster [DBG] 5.1b scrub ok 2024-02-10T08:29:23.296 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:22.293145+0000 osd.7 (osd.7) 169 : cluster [DBG] 4.11 scrub starts 2024-02-10T08:29:23.296 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:22.311994+0000 osd.7 (osd.7) 170 : cluster [DBG] 4.11 scrub ok 2024-02-10T08:29:23.297 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:23.457 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:29:23.460 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:29:23.464 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:23.464 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:29:23.485 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-02-10T08:29:23.485 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-02-10T08:29:23.485 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-02-10T08:29:23.485 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-02-10T08:29:23.485 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.485 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:29662 7.f 7:f5791515:::benchmark_data_smithi018_80623_object29661:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e96)", 2024-02-10T08:29:23.485 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:03.389287+0000", 2024-02-10T08:29:23.485 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 560.09180098499996, 2024-02-10T08:29:23.485 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.106154526, 2024-02-10T08:29:23.485 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:29:23.485 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:29:23.485 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:29:23.485 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:29:23.486 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:29:23.486 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 29662 2024-02-10T08:29:23.486 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.486 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:29:23.486 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.486 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:29:23.486 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.389287+0000", 2024-02-10T08:29:23.486 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:29:23.486 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.486 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.486 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:29:23.486 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.389287+0000", 2024-02-10T08:29:23.486 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:29:23.486 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.487 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.487 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:29:23.487 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.389286+0000", 2024-02-10T08:29:23.487 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3587e-05 2024-02-10T08:29:23.487 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.487 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.487 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:29:23.487 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.389310+0000", 2024-02-10T08:29:23.487 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6699999999999997e-06 2024-02-10T08:29:23.487 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.487 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.487 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:29:23.487 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.389317+0000", 2024-02-10T08:29:23.487 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6800000000000001e-06 2024-02-10T08:29:23.488 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.488 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.488 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:29:23.488 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.389321+0000", 2024-02-10T08:29:23.488 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.096291437999999993 2024-02-10T08:29:23.488 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.488 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.488 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:29:23.488 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.485613+0000", 2024-02-10T08:29:23.488 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012495200000000001 2024-02-10T08:29:23.488 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.488 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.488 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:29:23.489 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.485738+0000", 2024-02-10T08:29:23.489 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000163449 2024-02-10T08:29:23.489 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.489 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.489 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,7", 2024-02-10T08:29:23.489 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.485901+0000", 2024-02-10T08:29:23.489 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0014973950000000001 2024-02-10T08:29:23.489 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.489 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.489 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:29:23.489 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.487399+0000", 2024-02-10T08:29:23.489 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0011120730000000001 2024-02-10T08:29:23.489 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.489 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.490 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:29:23.490 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.488511+0000", 2024-02-10T08:29:23.490 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0068342689999999996 2024-02-10T08:29:23.490 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.490 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.490 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:29:23.490 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.495345+0000", 2024-02-10T08:29:23.490 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6263e-05 2024-02-10T08:29:23.490 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.490 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.490 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:29:23.490 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.495401+0000", 2024-02-10T08:29:23.490 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0355999999999998e-05 2024-02-10T08:29:23.490 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.490 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.490 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:29:23.491 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:03.495442+0000", 2024-02-10T08:29:23.491 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.106154526 2024-02-10T08:29:23.491 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:23.491 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:29:23.491 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:23.491 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.491 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.491 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:77122 7.f 7:fbc1d2ad:::benchmark_data_smithi018_80623_object77121:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e107)", 2024-02-10T08:29:23.491 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:42.057541+0000", 2024-02-10T08:29:23.491 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 521.42354707100003, 2024-02-10T08:29:23.491 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.107663749, 2024-02-10T08:29:23.491 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:29:23.491 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:29:23.491 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:29:23.491 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:29:23.492 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:29:23.492 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 77122 2024-02-10T08:29:23.492 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.492 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:29:23.492 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.492 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:29:23.492 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.057541+0000", 2024-02-10T08:29:23.492 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:29:23.492 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.492 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.492 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:29:23.492 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.057541+0000", 2024-02-10T08:29:23.492 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999981 2024-02-10T08:29:23.492 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.493 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.493 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:29:23.493 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.057539+0000", 2024-02-10T08:29:23.493 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0675000000000001e-05 2024-02-10T08:29:23.493 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.493 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.493 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:29:23.493 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.057560+0000", 2024-02-10T08:29:23.493 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0512e-05 2024-02-10T08:29:23.493 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.493 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.493 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:29:23.493 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.057570+0000", 2024-02-10T08:29:23.493 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0839999999999999e-06 2024-02-10T08:29:23.493 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.493 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.494 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:29:23.494 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.057575+0000", 2024-02-10T08:29:23.494 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6105000000000003e-05 2024-02-10T08:29:23.494 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.494 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.494 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:29:23.494 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.057661+0000", 2024-02-10T08:29:23.494 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2281000000000006e-05 2024-02-10T08:29:23.494 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.494 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.494 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:29:23.494 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.057754+0000", 2024-02-10T08:29:23.494 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000164754 2024-02-10T08:29:23.494 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.494 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.495 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,7", 2024-02-10T08:29:23.495 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.057918+0000", 2024-02-10T08:29:23.495 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.006321017 2024-02-10T08:29:23.495 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.495 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.495 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:29:23.495 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.064239+0000", 2024-02-10T08:29:23.495 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0025116650000000002 2024-02-10T08:29:23.495 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.495 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.495 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:29:23.495 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.066751+0000", 2024-02-10T08:29:23.495 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.098358857999999993 2024-02-10T08:29:23.495 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.495 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.496 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:29:23.496 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.165110+0000", 2024-02-10T08:29:23.496 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3987000000000003e-05 2024-02-10T08:29:23.496 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.496 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.496 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:29:23.496 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.165164+0000", 2024-02-10T08:29:23.496 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0818999999999997e-05 2024-02-10T08:29:23.496 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.496 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.496 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:29:23.496 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.165205+0000", 2024-02-10T08:29:23.496 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.107663749 2024-02-10T08:29:23.496 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:23.496 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:29:23.497 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:23.497 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.497 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.497 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:77130 7.f 7:ff8c0eaa:::benchmark_data_smithi018_80623_object77129:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e107)", 2024-02-10T08:29:23.497 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:42.061312+0000", 2024-02-10T08:29:23.497 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 521.41977620299997, 2024-02-10T08:29:23.497 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.104018578, 2024-02-10T08:29:23.497 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:29:23.497 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:29:23.497 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:29:23.497 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:29:23.497 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:29:23.497 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 77130 2024-02-10T08:29:23.497 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.497 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:29:23.498 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.498 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:29:23.498 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.061312+0000", 2024-02-10T08:29:23.498 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:29:23.498 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.498 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.498 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:29:23.498 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.061312+0000", 2024-02-10T08:29:23.498 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:29:23.498 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.498 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.498 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:29:23.498 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.061310+0000", 2024-02-10T08:29:23.499 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0628999999999998e-05 2024-02-10T08:29:23.499 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.499 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.499 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:29:23.499 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.061331+0000", 2024-02-10T08:29:23.499 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0589999999999992e-06 2024-02-10T08:29:23.499 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.499 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.499 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:29:23.499 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.061340+0000", 2024-02-10T08:29:23.499 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.352e-06 2024-02-10T08:29:23.499 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.499 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.499 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:29:23.500 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.061344+0000", 2024-02-10T08:29:23.500 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0029262099999999998 2024-02-10T08:29:23.500 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.500 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.500 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:29:23.500 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.064271+0000", 2024-02-10T08:29:23.500 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012769800000000001 2024-02-10T08:29:23.500 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.500 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.500 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:29:23.500 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.064398+0000", 2024-02-10T08:29:23.500 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000143907 2024-02-10T08:29:23.500 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.501 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.501 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,7", 2024-02-10T08:29:23.501 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.064542+0000", 2024-02-10T08:29:23.501 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0069906320000000001 2024-02-10T08:29:23.501 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.501 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.501 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:29:23.501 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.071533+0000", 2024-02-10T08:29:23.501 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7592999999999997e-05 2024-02-10T08:29:23.501 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.501 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.501 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:29:23.501 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.071570+0000", 2024-02-10T08:29:23.501 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.093671189000000002 2024-02-10T08:29:23.501 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.501 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.502 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:29:23.502 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.165242+0000", 2024-02-10T08:29:23.502 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1273999999999998e-05 2024-02-10T08:29:23.502 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.502 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.502 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:29:23.502 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.165283+0000", 2024-02-10T08:29:23.502 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7463999999999998e-05 2024-02-10T08:29:23.502 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.502 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.502 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:29:23.502 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.165330+0000", 2024-02-10T08:29:23.502 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.104018578 2024-02-10T08:29:23.502 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:23.502 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:29:23.502 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:23.503 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.503 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.503 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:88069 7.4 7:2e561420:::benchmark_data_smithi018_80623_object88068:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e115)", 2024-02-10T08:29:23.503 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:21:00.373918+0000", 2024-02-10T08:29:23.503 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 503.10717034499999, 2024-02-10T08:29:23.503 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.10139813, 2024-02-10T08:29:23.503 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:29:23.503 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:29:23.503 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:29:23.503 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:29:23.503 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:29:23.503 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 88069 2024-02-10T08:29:23.503 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.503 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:29:23.503 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.504 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:29:23.504 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:00.373918+0000", 2024-02-10T08:29:23.504 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:29:23.504 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.504 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.504 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:29:23.504 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:00.373918+0000", 2024-02-10T08:29:23.504 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:29:23.504 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.504 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.504 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:29:23.504 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:00.373917+0000", 2024-02-10T08:29:23.504 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0143999999999999e-05 2024-02-10T08:29:23.504 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.505 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.505 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:29:23.505 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:00.373937+0000", 2024-02-10T08:29:23.505 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7159999999999997e-06 2024-02-10T08:29:23.505 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.505 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.505 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:29:23.505 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:00.373944+0000", 2024-02-10T08:29:23.505 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8840000000000002e-06 2024-02-10T08:29:23.505 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.505 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.505 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:29:23.505 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:00.373949+0000", 2024-02-10T08:29:23.505 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.031637589000000001 2024-02-10T08:29:23.505 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.505 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.506 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:29:23.506 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:00.405586+0000", 2024-02-10T08:29:23.506 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017427999999999999 2024-02-10T08:29:23.506 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.506 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.506 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:29:23.506 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:00.405761+0000", 2024-02-10T08:29:23.506 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00021252 2024-02-10T08:29:23.506 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.506 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.506 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1,4", 2024-02-10T08:29:23.506 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:00.405973+0000", 2024-02-10T08:29:23.506 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.033536756000000001 2024-02-10T08:29:23.506 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.506 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.506 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:29:23.507 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:00.439510+0000", 2024-02-10T08:29:23.507 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1723000000000001e-05 2024-02-10T08:29:23.507 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.507 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.507 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:29:23.507 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:00.439542+0000", 2024-02-10T08:29:23.507 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.032458138999999997 2024-02-10T08:29:23.507 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.507 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.507 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:29:23.507 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:00.472000+0000", 2024-02-10T08:29:23.507 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8993999999999998e-05 2024-02-10T08:29:23.507 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.507 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.507 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:29:23.507 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:00.472059+0000", 2024-02-10T08:29:23.508 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0032571010000000001 2024-02-10T08:29:23.508 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.508 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.508 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:29:23.508 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:00.475316+0000", 2024-02-10T08:29:23.508 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.10139813 2024-02-10T08:29:23.508 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:23.508 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:29:23.508 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:23.508 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.508 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.508 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:111557 7.9 7:9a811b0f:::benchmark_data_smithi018_80623_object10629:head [delete] snapc 0=[] ondisk+write+known_if_redirected e125)", 2024-02-10T08:29:23.508 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:21:36.370217+0000", 2024-02-10T08:29:23.509 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 467.11087110599999, 2024-02-10T08:29:23.509 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.10686563, 2024-02-10T08:29:23.509 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:29:23.509 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:29:23.509 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:29:23.509 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:29:23.509 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:29:23.509 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 111557 2024-02-10T08:29:23.509 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.509 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:29:23.509 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.509 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:29:23.509 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:36.370217+0000", 2024-02-10T08:29:23.509 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:29:23.509 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.510 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.510 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:29:23.510 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:36.370217+0000", 2024-02-10T08:29:23.510 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:29:23.510 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.510 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.510 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:29:23.510 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:36.370216+0000", 2024-02-10T08:29:23.510 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9170000000000002e-06 2024-02-10T08:29:23.510 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.510 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.510 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:29:23.510 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:36.370219+0000", 2024-02-10T08:29:23.510 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7620000000000001e-06 2024-02-10T08:29:23.510 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.511 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.511 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:29:23.511 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:36.370225+0000", 2024-02-10T08:29:23.511 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0870000000000007e-06 2024-02-10T08:29:23.511 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.511 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.511 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:29:23.511 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:36.370233+0000", 2024-02-10T08:29:23.511 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.075982803000000002 2024-02-10T08:29:23.511 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.511 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.511 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:29:23.511 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:36.446216+0000", 2024-02-10T08:29:23.511 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000112775 2024-02-10T08:29:23.511 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.511 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.512 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for rw locks", 2024-02-10T08:29:23.512 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:36.446329+0000", 2024-02-10T08:29:23.512 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.010151980999999999 2024-02-10T08:29:23.512 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.512 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.512 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:29:23.512 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:36.456481+0000", 2024-02-10T08:29:23.512 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5962000000000003e-05 2024-02-10T08:29:23.512 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.512 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.512 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:29:23.512 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:36.456547+0000", 2024-02-10T08:29:23.512 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000113489 2024-02-10T08:29:23.513 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.513 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.513 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1,4", 2024-02-10T08:29:23.513 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:36.456660+0000", 2024-02-10T08:29:23.513 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.016782783999999999 2024-02-10T08:29:23.513 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.513 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.513 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:29:23.513 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:36.473443+0000", 2024-02-10T08:29:23.513 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3780000000000007e-06 2024-02-10T08:29:23.513 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.513 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.513 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:29:23.513 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:36.473452+0000", 2024-02-10T08:29:23.513 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1501000000000004e-05 2024-02-10T08:29:23.514 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.514 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.514 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:29:23.514 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:36.473544+0000", 2024-02-10T08:29:23.514 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7315999999999998e-05 2024-02-10T08:29:23.514 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.514 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.514 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:29:23.514 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:36.473601+0000", 2024-02-10T08:29:23.514 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0034814139999999999 2024-02-10T08:29:23.514 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.514 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.514 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:29:23.514 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:21:36.477082+0000", 2024-02-10T08:29:23.514 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.10686563 2024-02-10T08:29:23.514 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:23.515 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:29:23.515 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:23.515 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.515 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.515 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:131654 7.9 7:9f11397a:::benchmark_data_smithi018_80623_object30726:head [delete] snapc 0=[] ondisk+write+known_if_redirected e136)", 2024-02-10T08:29:23.515 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:22:05.105688+0000", 2024-02-10T08:29:23.515 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 438.37539955900002, 2024-02-10T08:29:23.515 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.10515804500000001, 2024-02-10T08:29:23.515 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:29:23.515 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:29:23.515 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:29:23.515 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:29:23.515 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:29:23.515 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 131654 2024-02-10T08:29:23.515 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.516 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:29:23.516 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.516 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:29:23.516 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:05.105688+0000", 2024-02-10T08:29:23.516 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:29:23.516 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.516 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.516 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:29:23.516 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:05.105688+0000", 2024-02-10T08:29:23.516 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:29:23.516 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.516 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.516 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:29:23.516 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:05.105687+0000", 2024-02-10T08:29:23.517 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9380000000000003e-06 2024-02-10T08:29:23.517 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.517 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.517 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:29:23.517 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:05.105694+0000", 2024-02-10T08:29:23.517 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2033e-05 2024-02-10T08:29:23.517 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.517 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.517 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:29:23.517 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:05.105706+0000", 2024-02-10T08:29:23.517 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8750000000000002e-06 2024-02-10T08:29:23.517 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.517 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.517 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:29:23.518 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:05.105713+0000", 2024-02-10T08:29:23.518 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013532631 2024-02-10T08:29:23.518 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.518 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.518 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:29:23.518 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:05.119246+0000", 2024-02-10T08:29:23.518 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000111408 2024-02-10T08:29:23.518 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.518 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.518 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for rw locks", 2024-02-10T08:29:23.518 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:05.119357+0000", 2024-02-10T08:29:23.518 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0076216620000000004 2024-02-10T08:29:23.518 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.518 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.519 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:29:23.519 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:05.126979+0000", 2024-02-10T08:29:23.519 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7869999999999997e-05 2024-02-10T08:29:23.519 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.519 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.519 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:29:23.519 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:05.127066+0000", 2024-02-10T08:29:23.519 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000148114 2024-02-10T08:29:23.519 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.519 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.519 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1,4", 2024-02-10T08:29:23.519 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:05.127215+0000", 2024-02-10T08:29:23.519 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.010892005999999999 2024-02-10T08:29:23.519 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.519 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.520 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:29:23.520 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:05.138107+0000", 2024-02-10T08:29:23.520 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.070534193999999995 2024-02-10T08:29:23.520 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.520 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.520 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:29:23.520 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:05.208641+0000", 2024-02-10T08:29:23.520 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1748000000000001e-05 2024-02-10T08:29:23.520 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.520 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.520 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:29:23.520 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:05.208683+0000", 2024-02-10T08:29:23.520 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9348999999999998e-05 2024-02-10T08:29:23.520 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.521 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.521 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:29:23.521 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:05.208732+0000", 2024-02-10T08:29:23.521 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002114608 2024-02-10T08:29:23.521 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.521 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.521 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:29:23.521 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:05.210846+0000", 2024-02-10T08:29:23.521 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.10515804500000001 2024-02-10T08:29:23.521 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:23.521 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:29:23.521 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:23.521 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.521 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.521 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:179932 7.6 7:622bb803:::benchmark_data_smithi018_80623_object79004:head [delete] snapc 0=[] ondisk+write+known_if_redirected e163)", 2024-02-10T08:29:23.522 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:23:14.099878+0000", 2024-02-10T08:29:23.522 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 369.38121016299999, 2024-02-10T08:29:23.522 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.593618239, 2024-02-10T08:29:23.522 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:29:23.522 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:29:23.522 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:29:23.522 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:29:23.522 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:29:23.522 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 179932 2024-02-10T08:29:23.522 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.522 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:29:23.522 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.522 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:29:23.522 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.099878+0000", 2024-02-10T08:29:23.523 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:29:23.523 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.523 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.523 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:29:23.523 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.099878+0000", 2024-02-10T08:29:23.523 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999981 2024-02-10T08:29:23.523 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.523 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.523 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:29:23.523 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.099876+0000", 2024-02-10T08:29:23.523 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0070000000000003e-06 2024-02-10T08:29:23.523 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.523 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.523 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:29:23.523 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.099882+0000", 2024-02-10T08:29:23.523 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.208e-06 2024-02-10T08:29:23.524 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.524 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.524 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:29:23.524 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.099890+0000", 2024-02-10T08:29:23.524 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1850000000000001e-06 2024-02-10T08:29:23.524 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.524 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.524 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:29:23.524 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.099896+0000", 2024-02-10T08:29:23.524 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0044118309999999997 2024-02-10T08:29:23.524 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.524 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.524 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:29:23.524 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.104308+0000", 2024-02-10T08:29:23.525 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1224e-05 2024-02-10T08:29:23.525 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.525 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.525 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:29:23.525 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.104319+0000", 2024-02-10T08:29:23.525 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.95846239700000002 2024-02-10T08:29:23.525 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.525 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.525 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:29:23.525 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.062782+0000", 2024-02-10T08:29:23.525 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.134e-05 2024-02-10T08:29:23.525 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.525 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.525 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:29:23.525 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.062793+0000", 2024-02-10T08:29:23.525 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.60692910600000005 2024-02-10T08:29:23.526 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.526 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.526 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:29:23.526 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.669722+0000", 2024-02-10T08:29:23.526 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015991399999999999 2024-02-10T08:29:23.526 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.526 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.526 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:29:23.526 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.669882+0000", 2024-02-10T08:29:23.526 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018509 2024-02-10T08:29:23.526 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.526 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.526 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,5,7", 2024-02-10T08:29:23.526 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.670067+0000", 2024-02-10T08:29:23.526 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0099177139999999993 2024-02-10T08:29:23.527 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.527 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.527 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:29:23.527 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.679985+0000", 2024-02-10T08:29:23.527 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9059e-05 2024-02-10T08:29:23.527 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.527 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.527 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:29:23.527 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.680024+0000", 2024-02-10T08:29:23.527 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000251067 2024-02-10T08:29:23.527 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.527 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.527 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:29:23.527 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.680275+0000", 2024-02-10T08:29:23.528 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013023241 2024-02-10T08:29:23.528 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.528 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.528 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:29:23.528 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.693298+0000", 2024-02-10T08:29:23.528 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4793000000000002e-05 2024-02-10T08:29:23.528 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.528 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.528 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:29:23.528 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.693353+0000", 2024-02-10T08:29:23.528 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000142869 2024-02-10T08:29:23.528 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.528 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.529 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:29:23.529 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.693496+0000", 2024-02-10T08:29:23.529 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.593618239 2024-02-10T08:29:23.529 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:23.529 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:29:23.529 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:23.529 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.529 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.529 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:179935 7.6 7:612ee4b2:::benchmark_data_smithi018_80623_object79007:head [delete] snapc 0=[] ondisk+write+known_if_redirected e163)", 2024-02-10T08:29:23.529 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:23:14.105897+0000", 2024-02-10T08:29:23.529 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 369.375190836, 2024-02-10T08:29:23.529 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5878203129999999, 2024-02-10T08:29:23.529 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:29:23.529 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:29:23.529 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:29:23.530 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:29:23.530 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:29:23.530 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 179935 2024-02-10T08:29:23.530 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.530 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:29:23.530 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.530 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:29:23.530 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.105897+0000", 2024-02-10T08:29:23.530 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:29:23.530 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.530 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.530 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:29:23.530 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.105897+0000", 2024-02-10T08:29:23.530 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:29:23.530 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.530 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.531 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:29:23.531 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.105896+0000", 2024-02-10T08:29:23.531 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6050000000000003e-06 2024-02-10T08:29:23.531 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.531 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.531 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:29:23.531 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.105902+0000", 2024-02-10T08:29:23.531 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.011e-06 2024-02-10T08:29:23.531 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.531 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.531 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:29:23.531 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.105910+0000", 2024-02-10T08:29:23.531 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6529999999999997e-06 2024-02-10T08:29:23.531 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.531 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.531 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:29:23.531 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.105917+0000", 2024-02-10T08:29:23.532 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000154303 2024-02-10T08:29:23.532 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.532 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.532 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:29:23.532 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.106071+0000", 2024-02-10T08:29:23.532 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7540000000000003e-06 2024-02-10T08:29:23.532 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.532 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.532 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:29:23.532 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.106077+0000", 2024-02-10T08:29:23.532 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.95673804200000001 2024-02-10T08:29:23.532 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.532 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.532 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:29:23.533 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.062815+0000", 2024-02-10T08:29:23.533 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9240000000000007e-06 2024-02-10T08:29:23.533 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.533 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.533 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:29:23.533 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.062823+0000", 2024-02-10T08:29:23.533 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.60969109200000005 2024-02-10T08:29:23.533 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.533 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.533 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:29:23.533 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.672514+0000", 2024-02-10T08:29:23.533 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014302799999999999 2024-02-10T08:29:23.533 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.533 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.533 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:29:23.533 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.672657+0000", 2024-02-10T08:29:23.533 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017783 2024-02-10T08:29:23.534 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.534 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.534 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,5,7", 2024-02-10T08:29:23.534 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.672835+0000", 2024-02-10T08:29:23.534 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0073871930000000002 2024-02-10T08:29:23.534 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.534 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.534 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:29:23.534 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.680222+0000", 2024-02-10T08:29:23.534 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9824000000000002e-05 2024-02-10T08:29:23.534 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.534 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.534 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:29:23.534 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.680282+0000", 2024-02-10T08:29:23.535 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6982000000000001e-05 2024-02-10T08:29:23.535 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.535 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.535 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:29:23.535 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.680379+0000", 2024-02-10T08:29:23.535 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013162759 2024-02-10T08:29:23.535 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.535 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.535 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:29:23.535 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.693542+0000", 2024-02-10T08:29:23.535 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8619999999999999e-05 2024-02-10T08:29:23.535 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.535 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.535 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:29:23.535 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.693590+0000", 2024-02-10T08:29:23.535 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000127262 2024-02-10T08:29:23.536 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.536 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.536 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:29:23.536 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.693717+0000", 2024-02-10T08:29:23.536 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5878203129999999 2024-02-10T08:29:23.536 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:23.536 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:29:23.536 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:23.536 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.536 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.536 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:179936 7.6 7:6740eab7:::benchmark_data_smithi018_80623_object79008:head [delete] snapc 0=[] ondisk+write+known_if_redirected e163)", 2024-02-10T08:29:23.536 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:23:14.108981+0000", 2024-02-10T08:29:23.536 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 369.372106729, 2024-02-10T08:29:23.536 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5852249789999999, 2024-02-10T08:29:23.537 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:29:23.537 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:29:23.537 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:29:23.539 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:29:23.539 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:29:23.539 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 179936 2024-02-10T08:29:23.539 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.539 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:29:23.539 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.539 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:29:23.539 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.108981+0000", 2024-02-10T08:29:23.539 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:29:23.539 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.539 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.539 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:29:23.539 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.108981+0000", 2024-02-10T08:29:23.540 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999981 2024-02-10T08:29:23.540 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.540 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.540 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:29:23.540 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.108979+0000", 2024-02-10T08:29:23.540 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0089999999999996e-06 2024-02-10T08:29:23.540 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.540 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.540 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:29:23.540 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.108988+0000", 2024-02-10T08:29:23.540 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2675e-05 2024-02-10T08:29:23.540 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.540 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.540 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:29:23.540 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.109001+0000", 2024-02-10T08:29:23.541 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5170000000000002e-06 2024-02-10T08:29:23.541 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.541 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.541 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:29:23.541 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.109009+0000", 2024-02-10T08:29:23.541 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7682000000000001e-05 2024-02-10T08:29:23.541 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.541 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.541 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:29:23.541 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.109066+0000", 2024-02-10T08:29:23.541 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2139999999999999e-06 2024-02-10T08:29:23.541 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.541 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.541 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:29:23.541 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.109073+0000", 2024-02-10T08:29:23.541 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.95377067599999998 2024-02-10T08:29:23.542 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.542 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.542 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:29:23.542 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.062844+0000", 2024-02-10T08:29:23.542 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.678e-06 2024-02-10T08:29:23.542 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.542 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.542 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:29:23.542 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.062852+0000", 2024-02-10T08:29:23.542 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.61274752899999996 2024-02-10T08:29:23.542 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.542 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.542 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:29:23.542 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.675599+0000", 2024-02-10T08:29:23.543 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000113472 2024-02-10T08:29:23.543 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.543 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.543 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:29:23.543 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.675713+0000", 2024-02-10T08:29:23.543 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000138596 2024-02-10T08:29:23.543 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.543 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.543 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,5,7", 2024-02-10T08:29:23.543 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.675851+0000", 2024-02-10T08:29:23.543 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0044139050000000001 2024-02-10T08:29:23.543 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.543 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.543 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:29:23.543 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.680265+0000", 2024-02-10T08:29:23.543 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012036699999999999 2024-02-10T08:29:23.544 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.544 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.544 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:29:23.544 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.680386+0000", 2024-02-10T08:29:23.544 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012687000000000001 2024-02-10T08:29:23.544 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.544 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.544 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:29:23.544 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.680513+0000", 2024-02-10T08:29:23.544 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013500929 2024-02-10T08:29:23.544 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.544 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.544 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:29:23.545 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.694013+0000", 2024-02-10T08:29:23.545 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9317999999999997e-05 2024-02-10T08:29:23.545 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.545 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.545 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:29:23.545 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.694073+0000", 2024-02-10T08:29:23.545 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000133421 2024-02-10T08:29:23.545 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.545 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.545 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:29:23.545 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.694206+0000", 2024-02-10T08:29:23.545 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5852249789999999 2024-02-10T08:29:23.545 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:23.545 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:29:23.545 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:23.545 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.546 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.546 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:185679 7.9 7:9dfa0d6b:::benchmark_data_smithi018_80623_object84751:head [delete] snapc 0=[] ondisk+write+known_if_redirected e167)", 2024-02-10T08:29:23.546 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:23:24.331633+0000", 2024-02-10T08:29:23.546 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 359.14945484899999, 2024-02-10T08:29:23.546 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.131336863, 2024-02-10T08:29:23.546 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:29:23.546 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:29:23.546 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:29:23.546 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:29:23.546 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:29:23.546 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 185679 2024-02-10T08:29:23.546 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.546 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:29:23.546 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.546 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:29:23.547 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.331633+0000", 2024-02-10T08:29:23.547 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:29:23.547 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.547 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.547 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:29:23.547 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.331633+0000", 2024-02-10T08:29:23.547 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999976 2024-02-10T08:29:23.547 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.547 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.547 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:29:23.547 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.331631+0000", 2024-02-10T08:29:23.547 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5499999999999995e-06 2024-02-10T08:29:23.547 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.547 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.547 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:29:23.548 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.331639+0000", 2024-02-10T08:29:23.548 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1477e-05 2024-02-10T08:29:23.548 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.548 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.548 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:29:23.548 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.331651+0000", 2024-02-10T08:29:23.548 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7909999999999999e-06 2024-02-10T08:29:23.548 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.548 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.548 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:29:23.548 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.331658+0000", 2024-02-10T08:29:23.548 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0092112500000000007 2024-02-10T08:29:23.548 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.548 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.549 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:29:23.549 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.340869+0000", 2024-02-10T08:29:23.549 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9961000000000001e-05 2024-02-10T08:29:23.549 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.549 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.549 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:29:23.549 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.340959+0000", 2024-02-10T08:29:23.549 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000144389 2024-02-10T08:29:23.549 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.549 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.549 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1,4", 2024-02-10T08:29:23.549 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.341103+0000", 2024-02-10T08:29:23.549 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.010862764 2024-02-10T08:29:23.549 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.549 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.550 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:29:23.550 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.351966+0000", 2024-02-10T08:29:23.550 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3222e-05 2024-02-10T08:29:23.550 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.550 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.550 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:29:23.550 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.351979+0000", 2024-02-10T08:29:23.550 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.01040195 2024-02-10T08:29:23.550 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.550 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.550 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:29:23.550 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.362381+0000", 2024-02-10T08:29:23.550 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1693000000000001e-05 2024-02-10T08:29:23.550 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.550 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.551 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:29:23.551 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.362433+0000", 2024-02-10T08:29:23.551 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.100537026 2024-02-10T08:29:23.551 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.551 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.551 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:29:23.551 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.462970+0000", 2024-02-10T08:29:23.551 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.131336863 2024-02-10T08:29:23.551 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:23.551 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:29:23.551 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:23.551 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.551 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.551 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:185687 7.9 7:9ee476f1:::benchmark_data_smithi018_80623_object84759:head [delete] snapc 0=[] ondisk+write+known_if_redirected e167)", 2024-02-10T08:29:23.552 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:23:24.340882+0000", 2024-02-10T08:29:23.552 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 359.140205821, 2024-02-10T08:29:23.552 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.123437612, 2024-02-10T08:29:23.552 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:29:23.552 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:29:23.552 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:29:23.552 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:29:23.552 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:29:23.552 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 185687 2024-02-10T08:29:23.552 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.552 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:29:23.552 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.552 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:29:23.553 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.340882+0000", 2024-02-10T08:29:23.553 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:29:23.553 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.553 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.553 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:29:23.553 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.340882+0000", 2024-02-10T08:29:23.553 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:29:23.553 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.553 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.553 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:29:23.553 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.340882+0000", 2024-02-10T08:29:23.553 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0520000000000002e-06 2024-02-10T08:29:23.553 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.553 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.553 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:29:23.554 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.340885+0000", 2024-02-10T08:29:23.554 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2100000000000003e-06 2024-02-10T08:29:23.554 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.554 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.554 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:29:23.554 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.340889+0000", 2024-02-10T08:29:23.554 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4410000000000002e-06 2024-02-10T08:29:23.554 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.554 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.554 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:29:23.554 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.340892+0000", 2024-02-10T08:29:23.554 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0024863340000000002 2024-02-10T08:29:23.554 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.554 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.554 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:29:23.555 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.343379+0000", 2024-02-10T08:29:23.555 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3487999999999998e-05 2024-02-10T08:29:23.555 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.555 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.555 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:29:23.555 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.343462+0000", 2024-02-10T08:29:23.555 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9333999999999995e-05 2024-02-10T08:29:23.555 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.555 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.555 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1,4", 2024-02-10T08:29:23.555 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.343561+0000", 2024-02-10T08:29:23.555 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.014180066999999999 2024-02-10T08:29:23.555 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.555 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.555 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:29:23.556 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.357741+0000", 2024-02-10T08:29:23.556 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7206000000000001e-05 2024-02-10T08:29:23.556 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.556 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.556 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:29:23.556 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.357799+0000", 2024-02-10T08:29:23.556 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.105230039 2024-02-10T08:29:23.556 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.556 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.556 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:29:23.556 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.463029+0000", 2024-02-10T08:29:23.556 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8053000000000001e-05 2024-02-10T08:29:23.556 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.556 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.557 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:29:23.557 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.463087+0000", 2024-02-10T08:29:23.557 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001233025 2024-02-10T08:29:23.557 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.557 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.557 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:29:23.557 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.464320+0000", 2024-02-10T08:29:23.557 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.123437612 2024-02-10T08:29:23.557 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:23.557 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:29:23.557 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:23.557 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.557 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.557 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:185688 7.9 7:99430034:::benchmark_data_smithi018_80623_object84760:head [delete] snapc 0=[] ondisk+write+known_if_redirected e167)", 2024-02-10T08:29:23.557 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:23:24.340914+0000", 2024-02-10T08:29:23.557 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 359.14017349699998, 2024-02-10T08:29:23.558 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.124567673, 2024-02-10T08:29:23.558 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:29:23.558 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:29:23.558 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:29:23.558 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:29:23.558 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:29:23.558 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 185688 2024-02-10T08:29:23.558 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.558 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:29:23.558 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.558 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:29:23.558 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.340914+0000", 2024-02-10T08:29:23.558 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:29:23.558 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.558 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.559 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:29:23.559 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.340914+0000", 2024-02-10T08:29:23.559 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:29:23.559 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.559 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.559 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:29:23.559 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.340914+0000", 2024-02-10T08:29:23.559 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.384e-06 2024-02-10T08:29:23.559 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.559 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.559 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:29:23.559 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.340916+0000", 2024-02-10T08:29:23.559 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.631e-06 2024-02-10T08:29:23.559 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.559 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.560 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:29:23.560 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.340920+0000", 2024-02-10T08:29:23.560 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0900000000000001e-06 2024-02-10T08:29:23.560 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.560 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.560 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:29:23.560 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.340923+0000", 2024-02-10T08:29:23.560 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0052687360000000004 2024-02-10T08:29:23.560 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.560 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.560 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:29:23.560 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.346192+0000", 2024-02-10T08:29:23.560 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011723 2024-02-10T08:29:23.560 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.560 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.561 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:29:23.561 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.346309+0000", 2024-02-10T08:29:23.561 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013480400000000001 2024-02-10T08:29:23.561 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.561 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.561 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1,4", 2024-02-10T08:29:23.561 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.346444+0000", 2024-02-10T08:29:23.561 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011310209999999999 2024-02-10T08:29:23.561 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.561 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.561 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:29:23.561 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.357754+0000", 2024-02-10T08:29:23.561 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3480999999999995e-05 2024-02-10T08:29:23.561 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.561 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.561 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:29:23.562 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.357848+0000", 2024-02-10T08:29:23.562 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.106515707 2024-02-10T08:29:23.562 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.562 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.562 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:29:23.562 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.464363+0000", 2024-02-10T08:29:23.562 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0077000000000002e-05 2024-02-10T08:29:23.562 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.562 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.562 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:29:23.562 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.464413+0000", 2024-02-10T08:29:23.562 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010688480000000001 2024-02-10T08:29:23.562 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.562 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.562 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:29:23.562 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.465482+0000", 2024-02-10T08:29:23.563 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.124567673 2024-02-10T08:29:23.563 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:23.563 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:29:23.563 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:23.563 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.563 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.563 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:185689 7.9 7:9c498ea9:::benchmark_data_smithi018_80623_object84761:head [delete] snapc 0=[] ondisk+write+known_if_redirected e167)", 2024-02-10T08:29:23.563 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:23:24.340944+0000", 2024-02-10T08:29:23.563 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 359.14014414000002, 2024-02-10T08:29:23.563 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.12545147800000001, 2024-02-10T08:29:23.563 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:29:23.563 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:29:23.563 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:29:23.563 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:29:23.563 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:29:23.564 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 185689 2024-02-10T08:29:23.564 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.564 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:29:23.564 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.564 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:29:23.564 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.340944+0000", 2024-02-10T08:29:23.564 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:29:23.564 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.564 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.564 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:29:23.564 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.340944+0000", 2024-02-10T08:29:23.564 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:29:23.564 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.564 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.565 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:29:23.565 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.340943+0000", 2024-02-10T08:29:23.565 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5339999999999998e-06 2024-02-10T08:29:23.565 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.565 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.565 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:29:23.565 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.340946+0000", 2024-02-10T08:29:23.565 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8060000000000001e-06 2024-02-10T08:29:23.565 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.565 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.565 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:29:23.565 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.340950+0000", 2024-02-10T08:29:23.565 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5720000000000001e-06 2024-02-10T08:29:23.565 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.565 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.565 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:29:23.566 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.340952+0000", 2024-02-10T08:29:23.566 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0084502299999999995 2024-02-10T08:29:23.566 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.566 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.566 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:29:23.566 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.349403+0000", 2024-02-10T08:29:23.566 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013141100000000001 2024-02-10T08:29:23.566 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.566 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.566 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:29:23.566 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.349534+0000", 2024-02-10T08:29:23.566 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012961400000000001 2024-02-10T08:29:23.566 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.566 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.566 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1,4", 2024-02-10T08:29:23.566 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.349664+0000", 2024-02-10T08:29:23.567 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0081434149999999993 2024-02-10T08:29:23.567 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.567 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.567 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:29:23.567 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.357807+0000", 2024-02-10T08:29:23.567 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.10771916400000001 2024-02-10T08:29:23.567 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.567 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.567 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:29:23.567 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.465526+0000", 2024-02-10T08:29:23.567 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5643999999999997e-05 2024-02-10T08:29:23.567 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.567 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.567 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:29:23.567 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.465592+0000", 2024-02-10T08:29:23.568 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5314e-05 2024-02-10T08:29:23.568 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.568 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.568 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:29:23.568 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.465637+0000", 2024-02-10T08:29:23.568 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000758193 2024-02-10T08:29:23.568 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.568 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.568 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:29:23.568 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.466395+0000", 2024-02-10T08:29:23.568 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.12545147800000001 2024-02-10T08:29:23.568 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:23.568 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:29:23.569 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:23.569 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.569 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.569 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:185695 7.9 7:951ad5ff:::benchmark_data_smithi018_80623_object84767:head [delete] snapc 0=[] ondisk+write+known_if_redirected e167)", 2024-02-10T08:29:23.569 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:23:24.355809+0000", 2024-02-10T08:29:23.569 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 359.12527893100003, 2024-02-10T08:29:23.569 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.127651502, 2024-02-10T08:29:23.569 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:29:23.569 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:29:23.569 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:29:23.569 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:29:23.569 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:29:23.569 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 185695 2024-02-10T08:29:23.569 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.569 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:29:23.570 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.570 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:29:23.570 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.355809+0000", 2024-02-10T08:29:23.570 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:29:23.570 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.570 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.570 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:29:23.570 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.355809+0000", 2024-02-10T08:29:23.570 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:29:23.570 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.570 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.570 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:29:23.570 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.355808+0000", 2024-02-10T08:29:23.570 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8369999999999996e-06 2024-02-10T08:29:23.570 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.571 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.571 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:29:23.571 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.355812+0000", 2024-02-10T08:29:23.571 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7840000000000004e-06 2024-02-10T08:29:23.571 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.571 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.571 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:29:23.571 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.355820+0000", 2024-02-10T08:29:23.571 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8180000000000003e-06 2024-02-10T08:29:23.571 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.571 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.571 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:29:23.571 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.355825+0000", 2024-02-10T08:29:23.571 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0021991039999999999 2024-02-10T08:29:23.571 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.572 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.572 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:29:23.572 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.358024+0000", 2024-02-10T08:29:23.572 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013111000000000001 2024-02-10T08:29:23.572 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.572 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.572 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:29:23.572 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.358155+0000", 2024-02-10T08:29:23.572 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014176799999999999 2024-02-10T08:29:23.572 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.572 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.572 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1,4", 2024-02-10T08:29:23.572 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.358297+0000", 2024-02-10T08:29:23.572 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.10726297899999999 2024-02-10T08:29:23.572 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.573 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.573 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:29:23.573 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.465560+0000", 2024-02-10T08:29:23.573 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00088626600000000003 2024-02-10T08:29:23.573 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.573 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.573 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:29:23.573 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.466446+0000", 2024-02-10T08:29:23.573 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015808071 2024-02-10T08:29:23.573 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.573 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.573 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:29:23.573 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.482254+0000", 2024-02-10T08:29:23.573 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6811000000000002e-05 2024-02-10T08:29:23.574 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.574 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.574 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:29:23.574 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.482311+0000", 2024-02-10T08:29:23.574 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001149377 2024-02-10T08:29:23.574 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.574 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.574 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:29:23.574 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.483461+0000", 2024-02-10T08:29:23.574 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.127651502 2024-02-10T08:29:23.574 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:23.574 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:29:23.574 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:23.574 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.574 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.574 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.14784.0:185697 7.e e167/164 7:7ae1591d:::benchmark_data_smithi018_80623_object84769:head v 167'11600, mlcod=167'11597)", 2024-02-10T08:29:23.575 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:23:24.358293+0000", 2024-02-10T08:29:23.575 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 359.122795451, 2024-02-10T08:29:23.575 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.104620729, 2024-02-10T08:29:23.575 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:29:23.575 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:29:23.575 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:29:23.575 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.575 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:29:23.575 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.358293+0000", 2024-02-10T08:29:23.575 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:29:23.575 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.575 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.575 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:29:23.575 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.358293+0000", 2024-02-10T08:29:23.576 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:29:23.576 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.576 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.576 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:29:23.576 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.358292+0000", 2024-02-10T08:29:23.576 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6159999999999996e-06 2024-02-10T08:29:23.576 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.576 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.576 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:29:23.576 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.358299+0000", 2024-02-10T08:29:23.576 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8279999999999998e-06 2024-02-10T08:29:23.576 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.576 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.576 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:29:23.577 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.358309+0000", 2024-02-10T08:29:23.577 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0039999999999996e-06 2024-02-10T08:29:23.577 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.577 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.577 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:29:23.577 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.358315+0000", 2024-02-10T08:29:23.577 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9883999999999995e-05 2024-02-10T08:29:23.577 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.577 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.577 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:29:23.577 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.358405+0000", 2024-02-10T08:29:23.577 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1214000000000001e-05 2024-02-10T08:29:23.577 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.577 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.578 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:29:23.578 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.358426+0000", 2024-02-10T08:29:23.578 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0057889780000000002 2024-02-10T08:29:23.578 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.578 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.578 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:29:23.578 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.364215+0000", 2024-02-10T08:29:23.578 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.098697931000000003 2024-02-10T08:29:23.578 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.578 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.578 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:29:23.578 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.462913+0000", 2024-02-10T08:29:23.578 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.104620729 2024-02-10T08:29:23.578 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:23.578 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:29:23.579 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:23.579 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.579 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.579 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.14784.0:185699 7.f e167/164 7:f1a29ca9:::benchmark_data_smithi018_80623_object84771:head v 167'11542, mlcod=167'11540)", 2024-02-10T08:29:23.579 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:23:24.361663+0000", 2024-02-10T08:29:23.579 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 359.119424675, 2024-02-10T08:29:23.579 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.101331583, 2024-02-10T08:29:23.579 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:29:23.579 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:29:23.579 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:29:23.579 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.579 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:29:23.579 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.361663+0000", 2024-02-10T08:29:23.579 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:29:23.579 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.580 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.580 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:29:23.580 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.361663+0000", 2024-02-10T08:29:23.580 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:29:23.580 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.580 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.580 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:29:23.580 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.361662+0000", 2024-02-10T08:29:23.580 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4540000000000001e-06 2024-02-10T08:29:23.580 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.580 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.580 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:29:23.580 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.361670+0000", 2024-02-10T08:29:23.581 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6155999999999999e-05 2024-02-10T08:29:23.581 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.581 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.581 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:29:23.581 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.361686+0000", 2024-02-10T08:29:23.581 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2229999999999998e-06 2024-02-10T08:29:23.581 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.581 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.581 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:29:23.581 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.361691+0000", 2024-02-10T08:29:23.581 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8482000000000002e-05 2024-02-10T08:29:23.581 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.581 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.581 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:29:23.582 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.361730+0000", 2024-02-10T08:29:23.582 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.658e-05 2024-02-10T08:29:23.582 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.582 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.582 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:29:23.582 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.361756+0000", 2024-02-10T08:29:23.582 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.10120646599999999 2024-02-10T08:29:23.582 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.582 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.582 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:29:23.582 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.462963+0000", 2024-02-10T08:29:23.582 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2165999999999997e-05 2024-02-10T08:29:23.582 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.582 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.583 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:29:23.583 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.462995+0000", 2024-02-10T08:29:23.583 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.101331583 2024-02-10T08:29:23.583 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:23.583 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:29:23.583 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:23.583 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.583 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.583 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.14784.0:185700 7.f e167/164 7:fa9fb72e:::benchmark_data_smithi018_80623_object84772:head v 167'11543, mlcod=167'11540)", 2024-02-10T08:29:23.583 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:23:24.361704+0000", 2024-02-10T08:29:23.583 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 359.11938380499998, 2024-02-10T08:29:23.583 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.103814714, 2024-02-10T08:29:23.583 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:29:23.583 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:29:23.584 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:29:23.584 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.584 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:29:23.584 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.361704+0000", 2024-02-10T08:29:23.584 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:29:23.584 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.584 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.584 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:29:23.584 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.361704+0000", 2024-02-10T08:29:23.584 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:29:23.584 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.584 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.584 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:29:23.584 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.361704+0000", 2024-02-10T08:29:23.585 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.374e-06 2024-02-10T08:29:23.585 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.585 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.585 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:29:23.585 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.361708+0000", 2024-02-10T08:29:23.585 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5970000000000002e-06 2024-02-10T08:29:23.585 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.585 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.585 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:29:23.585 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.361713+0000", 2024-02-10T08:29:23.585 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.019e-06 2024-02-10T08:29:23.585 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.585 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.585 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:29:23.585 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.361717+0000", 2024-02-10T08:29:23.586 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.101305982 2024-02-10T08:29:23.586 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.586 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.586 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:29:23.586 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.463023+0000", 2024-02-10T08:29:23.586 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9838000000000001e-05 2024-02-10T08:29:23.586 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.586 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.586 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:29:23.586 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.463053+0000", 2024-02-10T08:29:23.586 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0024393349999999999 2024-02-10T08:29:23.586 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.586 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.586 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:29:23.586 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.465492+0000", 2024-02-10T08:29:23.587 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.692e-05 2024-02-10T08:29:23.587 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.587 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.587 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:29:23.587 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.465519+0000", 2024-02-10T08:29:23.587 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.103814714 2024-02-10T08:29:23.587 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:23.587 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:29:23.587 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:23.587 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.587 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.587 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop_reply(client.14784.0:185687 7.9 e167/111 ondisk, result = 0)", 2024-02-10T08:29:23.587 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:23:24.362330+0000", 2024-02-10T08:29:23.587 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 359.11875808600001, 2024-02-10T08:29:23.588 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.10199463, 2024-02-10T08:29:23.588 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:29:23.588 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-02-10T08:29:23.588 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:29:23.588 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.588 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:29:23.588 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.362330+0000", 2024-02-10T08:29:23.588 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:29:23.588 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.588 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.588 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:29:23.588 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.362330+0000", 2024-02-10T08:29:23.588 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:29:23.588 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.588 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.589 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:29:23.589 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.362330+0000", 2024-02-10T08:29:23.589 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.565e-06 2024-02-10T08:29:23.589 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.589 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.589 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:29:23.589 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.362332+0000", 2024-02-10T08:29:23.589 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8539999999999996e-06 2024-02-10T08:29:23.589 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.589 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.589 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:29:23.589 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.362337+0000", 2024-02-10T08:29:23.589 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.641e-06 2024-02-10T08:29:23.589 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.589 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.589 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:29:23.590 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.362341+0000", 2024-02-10T08:29:23.590 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.10066953300000001 2024-02-10T08:29:23.590 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.590 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.590 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:29:23.590 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.463010+0000", 2024-02-10T08:29:23.590 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6970000000000005e-06 2024-02-10T08:29:23.590 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.590 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.590 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:29:23.590 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.463020+0000", 2024-02-10T08:29:23.590 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001304609 2024-02-10T08:29:23.590 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.591 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.591 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:29:23.591 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.464325+0000", 2024-02-10T08:29:23.591 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.10199463 2024-02-10T08:29:23.591 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:23.591 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:29:23.591 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:23.591 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.591 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.591 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop_reply(client.14784.0:185688 7.9 e167/111 ondisk, result = 0)", 2024-02-10T08:29:23.591 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:23:24.363840+0000", 2024-02-10T08:29:23.591 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 359.11724772700001, 2024-02-10T08:29:23.591 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.101645918, 2024-02-10T08:29:23.591 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:29:23.591 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-02-10T08:29:23.592 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:29:23.592 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.592 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:29:23.592 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.363840+0000", 2024-02-10T08:29:23.592 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:29:23.592 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.592 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.592 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:29:23.592 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.363840+0000", 2024-02-10T08:29:23.592 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:29:23.592 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.592 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.592 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:29:23.593 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.363840+0000", 2024-02-10T08:29:23.593 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6849999999999998e-06 2024-02-10T08:29:23.593 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.593 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.593 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:29:23.593 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.363845+0000", 2024-02-10T08:29:23.593 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.098908898999999995 2024-02-10T08:29:23.593 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.593 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.593 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:29:23.593 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.462754+0000", 2024-02-10T08:29:23.593 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3319000000000001e-05 2024-02-10T08:29:23.593 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.593 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.594 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:29:23.594 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.462767+0000", 2024-02-10T08:29:23.594 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0015808529999999999 2024-02-10T08:29:23.594 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.594 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.594 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:29:23.594 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.464348+0000", 2024-02-10T08:29:23.594 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5100000000000001e-06 2024-02-10T08:29:23.594 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.594 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.594 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:29:23.594 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.464356+0000", 2024-02-10T08:29:23.594 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001130381 2024-02-10T08:29:23.594 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.595 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.595 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:29:23.595 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.465486+0000", 2024-02-10T08:29:23.595 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.101645918 2024-02-10T08:29:23.595 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:23.595 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:29:23.595 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:23.595 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.595 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.595 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.14784.0:185704 7.4 e167/164 7:2ed1b197:::benchmark_data_smithi018_80623_object84776:head v 167'11593, mlcod=167'11590)", 2024-02-10T08:29:23.595 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:23:24.366203+0000", 2024-02-10T08:29:23.595 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 359.11488499000001, 2024-02-10T08:29:23.595 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.103812249, 2024-02-10T08:29:23.595 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:29:23.596 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:29:23.596 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:29:23.596 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.596 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:29:23.596 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.366203+0000", 2024-02-10T08:29:23.596 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:29:23.596 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.596 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.596 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:29:23.596 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.366203+0000", 2024-02-10T08:29:23.596 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:29:23.596 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.596 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.596 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:29:23.597 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.366202+0000", 2024-02-10T08:29:23.597 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4850000000000003e-06 2024-02-10T08:29:23.597 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.597 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.597 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:29:23.597 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.366210+0000", 2024-02-10T08:29:23.597 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.097461556000000005 2024-02-10T08:29:23.597 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.597 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.597 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:29:23.597 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.463671+0000", 2024-02-10T08:29:23.597 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1309999999999995e-06 2024-02-10T08:29:23.597 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.597 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.597 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:29:23.598 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.463680+0000", 2024-02-10T08:29:23.598 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001691609 2024-02-10T08:29:23.598 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.598 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.598 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:29:23.598 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.465372+0000", 2024-02-10T08:29:23.598 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.4521000000000001e-05 2024-02-10T08:29:23.598 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.598 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.598 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:29:23.598 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.465397+0000", 2024-02-10T08:29:23.598 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0045736479999999996 2024-02-10T08:29:23.598 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.598 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.598 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:29:23.599 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.469970+0000", 2024-02-10T08:29:23.599 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5059999999999999e-05 2024-02-10T08:29:23.599 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:23.599 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:23.599 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:29:23.599 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.470015+0000", 2024-02-10T08:29:23.599 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.103812249 2024-02-10T08:29:23.599 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:23.599 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:29:23.599 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:23.599 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:23.599 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:29:23.599 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-02-10T08:29:23.600 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-10T08:29:23.600 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:29:23.653 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:23.776 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:29:23.779 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:23.780 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:29:23.820 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-02-10T08:29:23.820 INFO:teuthology.orchestra.run.smithi071.stdout: "success": "filestore_inject_stall = '3' (not observed, change may require restart) " 2024-02-10T08:29:23.820 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-02-10T08:29:23.881 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:29:23.942 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:24.045 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:22.489229+0000 osd.0 (osd.0) 138 : cluster [DBG] 6.23 scrub starts 2024-02-10T08:29:24.046 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:22.556442+0000 osd.0 (osd.0) 139 : cluster [DBG] 6.23 scrub ok 2024-02-10T08:29:24.046 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:22.834205+0000 mgr.y (mgr.14505) 476 : cluster [DBG] pgmap v577: 158 pgs: 1 active+remapped+backfill_toofull, 157 active+clean; 4.4 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1.5 KiB/s rd, 70 MiB/s wr, 1.12k op/s; 9216/215343 objects misplaced (4.280%); 9.3 KiB/s, 0 objects/s recovering 2024-02-10T08:29:24.046 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:23.022744+0000 osd.4 (osd.4) 72 : cluster [DBG] 4.9 scrub starts 2024-02-10T08:29:24.046 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:23.027201+0000 osd.4 (osd.4) 73 : cluster [DBG] 4.9 scrub ok 2024-02-10T08:29:24.083 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:29:24.085 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:24.085 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:29:24.153 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 46 16 74361 74345 100.971 66.3125 0.0122674 0.00989905 2024-02-10T08:29:24.186 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:29:24.217 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:22.489229+0000 osd.0 (osd.0) 138 : cluster [DBG] 6.23 scrub starts 2024-02-10T08:29:24.218 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:22.556442+0000 osd.0 (osd.0) 139 : cluster [DBG] 6.23 scrub ok 2024-02-10T08:29:24.218 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:22.834205+0000 mgr.y (mgr.14505) 476 : cluster [DBG] pgmap v577: 158 pgs: 1 active+remapped+backfill_toofull, 157 active+clean; 4.4 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1.5 KiB/s rd, 70 MiB/s wr, 1.12k op/s; 9216/215343 objects misplaced (4.280%); 9.3 KiB/s, 0 objects/s recovering 2024-02-10T08:29:24.218 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:23.022744+0000 osd.4 (osd.4) 72 : cluster [DBG] 4.9 scrub starts 2024-02-10T08:29:24.218 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:23.027201+0000 osd.4 (osd.4) 73 : cluster [DBG] 4.9 scrub ok 2024-02-10T08:29:24.229 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:24.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:22.489229+0000 osd.0 (osd.0) 138 : cluster [DBG] 6.23 scrub starts 2024-02-10T08:29:24.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:22.556442+0000 osd.0 (osd.0) 139 : cluster [DBG] 6.23 scrub ok 2024-02-10T08:29:24.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:22.834205+0000 mgr.y (mgr.14505) 476 : cluster [DBG] pgmap v577: 158 pgs: 1 active+remapped+backfill_toofull, 157 active+clean; 4.4 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1.5 KiB/s rd, 70 MiB/s wr, 1.12k op/s; 9216/215343 objects misplaced (4.280%); 9.3 KiB/s, 0 objects/s recovering 2024-02-10T08:29:24.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:23.022744+0000 osd.4 (osd.4) 72 : cluster [DBG] 4.9 scrub starts 2024-02-10T08:29:24.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:23.027201+0000 osd.4 (osd.4) 73 : cluster [DBG] 4.9 scrub ok 2024-02-10T08:29:24.500 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:29:24.506 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:24.506 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:29:24.607 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:29:24.670 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:24.703 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:29:24.709 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:24.709 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:29:24.810 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:29:24.863 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:25.076 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:29:25.083 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:25.083 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:29:25.153 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 47 16 75517 75501 100.36 72.25 0.0089771 0.00995818 2024-02-10T08:29:25.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:23.502985+0000 osd.2 (osd.2) 129 : cluster [DBG] 5.6 scrub starts 2024-02-10T08:29:25.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:23.504886+0000 osd.2 (osd.2) 130 : cluster [DBG] 5.6 scrub ok 2024-02-10T08:29:25.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:24.027649+0000 osd.4 (osd.4) 74 : cluster [DBG] 4.1 scrub starts 2024-02-10T08:29:25.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:24.036442+0000 osd.4 (osd.4) 75 : cluster [DBG] 4.1 scrub ok 2024-02-10T08:29:25.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:24.684476+0000 osd.1 (osd.1) 159 : cluster [DBG] 5.c scrub starts 2024-02-10T08:29:25.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:24.690615+0000 osd.1 (osd.1) 160 : cluster [DBG] 5.c scrub ok 2024-02-10T08:29:25.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:23.502985+0000 osd.2 (osd.2) 129 : cluster [DBG] 5.6 scrub starts 2024-02-10T08:29:25.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:23.504886+0000 osd.2 (osd.2) 130 : cluster [DBG] 5.6 scrub ok 2024-02-10T08:29:25.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:24.027649+0000 osd.4 (osd.4) 74 : cluster [DBG] 4.1 scrub starts 2024-02-10T08:29:25.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:24.036442+0000 osd.4 (osd.4) 75 : cluster [DBG] 4.1 scrub ok 2024-02-10T08:29:25.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:24.684476+0000 osd.1 (osd.1) 159 : cluster [DBG] 5.c scrub starts 2024-02-10T08:29:25.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:24.690615+0000 osd.1 (osd.1) 160 : cluster [DBG] 5.c scrub ok 2024-02-10T08:29:25.184 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:29:25.231 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:25.266 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:29:25.276 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:25.276 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:29:25.377 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:29:25.431 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:25.542 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:23.502985+0000 osd.2 (osd.2) 129 : cluster [DBG] 5.6 scrub starts 2024-02-10T08:29:25.542 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:23.504886+0000 osd.2 (osd.2) 130 : cluster [DBG] 5.6 scrub ok 2024-02-10T08:29:25.542 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:24.027649+0000 osd.4 (osd.4) 74 : cluster [DBG] 4.1 scrub starts 2024-02-10T08:29:25.542 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:24.036442+0000 osd.4 (osd.4) 75 : cluster [DBG] 4.1 scrub ok 2024-02-10T08:29:25.542 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:24.684476+0000 osd.1 (osd.1) 159 : cluster [DBG] 5.c scrub starts 2024-02-10T08:29:25.542 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:24.690615+0000 osd.1 (osd.1) 160 : cluster [DBG] 5.c scrub ok 2024-02-10T08:29:25.778 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.1 dump_ops_in_flight 2024-02-10T08:29:26.107 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:29:26.113 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:26.114 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:29:26.153 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 48 16 76640 76624 99.7302 70.1875 0.0127706 0.0100214 2024-02-10T08:29:26.215 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:29:26.264 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:26.300 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:29:26.302 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:26.303 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:29:26.403 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:29:26.413 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:24.491326+0000 osd.0 (osd.0) 140 : cluster [DBG] 6.14 scrub starts 2024-02-10T08:29:26.413 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:24.514682+0000 osd.0 (osd.0) 141 : cluster [DBG] 6.14 scrub ok 2024-02-10T08:29:26.413 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:24.546821+0000 osd.2 (osd.2) 131 : cluster [DBG] 2.e deep-scrub starts 2024-02-10T08:29:26.413 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:24.554971+0000 osd.2 (osd.2) 132 : cluster [DBG] 2.e deep-scrub ok 2024-02-10T08:29:26.413 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:24.834840+0000 mgr.y (mgr.14505) 477 : cluster [DBG] pgmap v578: 158 pgs: 1 active+remapped+backfill_toofull, 157 active+clean; 4.4 GiB data, 16 GiB used, 700 GiB / 715 GiB avail; 1.2 KiB/s rd, 69 MiB/s wr, 1.10k op/s; 9216/218502 objects misplaced (4.218%); 8.0 KiB/s, 0 objects/s recovering 2024-02-10T08:29:26.413 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:25.023439+0000 osd.4 (osd.4) 76 : cluster [DBG] 6.1a deep-scrub starts 2024-02-10T08:29:26.413 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:25.024405+0000 osd.4 (osd.4) 77 : cluster [DBG] 6.1a deep-scrub ok 2024-02-10T08:29:26.414 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:25.116433+0000 osd.5 (osd.5) 175 : cluster [DBG] 6.7 scrub starts 2024-02-10T08:29:26.414 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:25.198273+0000 osd.5 (osd.5) 176 : cluster [DBG] 6.7 scrub ok 2024-02-10T08:29:26.414 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:25.220126+0000 osd.7 (osd.7) 171 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:29:26.414 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:25.220177+0000 osd.7 (osd.7) 172 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:29:26.414 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:25.676732+0000 osd.1 (osd.1) 161 : cluster [DBG] 5.1d scrub starts 2024-02-10T08:29:26.414 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:25.682375+0000 osd.1 (osd.1) 162 : cluster [DBG] 5.1d scrub ok 2024-02-10T08:29:26.414 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:25.746341+0000 mon.a (mon.0) 1334 : cluster [DBG] osdmap e276: 8 total, 8 up, 8 in 2024-02-10T08:29:26.414 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:24.491326+0000 osd.0 (osd.0) 140 : cluster [DBG] 6.14 scrub starts 2024-02-10T08:29:26.415 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:24.514682+0000 osd.0 (osd.0) 141 : cluster [DBG] 6.14 scrub ok 2024-02-10T08:29:26.415 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:24.546821+0000 osd.2 (osd.2) 131 : cluster [DBG] 2.e deep-scrub starts 2024-02-10T08:29:26.415 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:24.554971+0000 osd.2 (osd.2) 132 : cluster [DBG] 2.e deep-scrub ok 2024-02-10T08:29:26.415 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:24.834840+0000 mgr.y (mgr.14505) 477 : cluster [DBG] pgmap v578: 158 pgs: 1 active+remapped+backfill_toofull, 157 active+clean; 4.4 GiB data, 16 GiB used, 700 GiB / 715 GiB avail; 1.2 KiB/s rd, 69 MiB/s wr, 1.10k op/s; 9216/218502 objects misplaced (4.218%); 8.0 KiB/s, 0 objects/s recovering 2024-02-10T08:29:26.415 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:25.023439+0000 osd.4 (osd.4) 76 : cluster [DBG] 6.1a deep-scrub starts 2024-02-10T08:29:26.415 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:25.024405+0000 osd.4 (osd.4) 77 : cluster [DBG] 6.1a deep-scrub ok 2024-02-10T08:29:26.415 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:25.116433+0000 osd.5 (osd.5) 175 : cluster [DBG] 6.7 scrub starts 2024-02-10T08:29:26.415 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:25.198273+0000 osd.5 (osd.5) 176 : cluster [DBG] 6.7 scrub ok 2024-02-10T08:29:26.415 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:25.220126+0000 osd.7 (osd.7) 171 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:29:26.415 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:25.220177+0000 osd.7 (osd.7) 172 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:29:26.415 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:25.676732+0000 osd.1 (osd.1) 161 : cluster [DBG] 5.1d scrub starts 2024-02-10T08:29:26.415 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:25.682375+0000 osd.1 (osd.1) 162 : cluster [DBG] 5.1d scrub ok 2024-02-10T08:29:26.415 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:25.746341+0000 mon.a (mon.0) 1334 : cluster [DBG] osdmap e276: 8 total, 8 up, 8 in 2024-02-10T08:29:26.416 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:29:26.472 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:29:26.493 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:26.516 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:24.491326+0000 osd.0 (osd.0) 140 : cluster [DBG] 6.14 scrub starts 2024-02-10T08:29:26.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:24.514682+0000 osd.0 (osd.0) 141 : cluster [DBG] 6.14 scrub ok 2024-02-10T08:29:26.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:24.546821+0000 osd.2 (osd.2) 131 : cluster [DBG] 2.e deep-scrub starts 2024-02-10T08:29:26.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:24.554971+0000 osd.2 (osd.2) 132 : cluster [DBG] 2.e deep-scrub ok 2024-02-10T08:29:26.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:24.834840+0000 mgr.y (mgr.14505) 477 : cluster [DBG] pgmap v578: 158 pgs: 1 active+remapped+backfill_toofull, 157 active+clean; 4.4 GiB data, 16 GiB used, 700 GiB / 715 GiB avail; 1.2 KiB/s rd, 69 MiB/s wr, 1.10k op/s; 9216/218502 objects misplaced (4.218%); 8.0 KiB/s, 0 objects/s recovering 2024-02-10T08:29:26.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:25.023439+0000 osd.4 (osd.4) 76 : cluster [DBG] 6.1a deep-scrub starts 2024-02-10T08:29:26.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:25.024405+0000 osd.4 (osd.4) 77 : cluster [DBG] 6.1a deep-scrub ok 2024-02-10T08:29:26.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:25.116433+0000 osd.5 (osd.5) 175 : cluster [DBG] 6.7 scrub starts 2024-02-10T08:29:26.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:25.198273+0000 osd.5 (osd.5) 176 : cluster [DBG] 6.7 scrub ok 2024-02-10T08:29:26.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:25.220126+0000 osd.7 (osd.7) 171 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:29:26.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:25.220177+0000 osd.7 (osd.7) 172 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:29:26.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:25.676732+0000 osd.1 (osd.1) 161 : cluster [DBG] 5.1d scrub starts 2024-02-10T08:29:26.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:25.682375+0000 osd.1 (osd.1) 162 : cluster [DBG] 5.1d scrub ok 2024-02-10T08:29:26.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:25.746341+0000 mon.a (mon.0) 1334 : cluster [DBG] osdmap e276: 8 total, 8 up, 8 in 2024-02-10T08:29:26.791 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:29:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:29:26] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:29:27.095 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is set 2024-02-10T08:29:27.155 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 49 16 77714 77698 99.0639 67.125 0.0117525 0.0100897 2024-02-10T08:29:27.394 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:26.069153+0000 osd.5 (osd.5) 177 : cluster [DBG] 2.18 deep-scrub starts 2024-02-10T08:29:27.395 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:26.072027+0000 osd.5 (osd.5) 178 : cluster [DBG] 2.18 deep-scrub ok 2024-02-10T08:29:27.395 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:26.209667+0000 osd.7 (osd.7) 173 : cluster [DBG] 2.1c scrub starts 2024-02-10T08:29:27.395 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:26.213411+0000 osd.7 (osd.7) 174 : cluster [DBG] 2.1c scrub ok 2024-02-10T08:29:27.395 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:26.287901+0000 osd.1 (osd.1) 163 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:29:27.395 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:26.287952+0000 osd.1 (osd.1) 164 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:29:27.395 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:26.693603+0000 osd.1 (osd.1) 165 : cluster [DBG] 5.5 scrub starts 2024-02-10T08:29:27.395 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:26.703434+0000 osd.1 (osd.1) 166 : cluster [DBG] 5.5 scrub ok 2024-02-10T08:29:27.395 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:29:26.790501+0000 mon.a (mon.0) 1335 : audit [INF] from='client.? 172.21.15.18:0/1397318377' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:29:27.395 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:29:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:29:27] "GET /metrics HTTP/1.1" 200 176173 "" "Prometheus/2.33.4" 2024-02-10T08:29:27.396 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:26.069153+0000 osd.5 (osd.5) 177 : cluster [DBG] 2.18 deep-scrub starts 2024-02-10T08:29:27.396 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:26.072027+0000 osd.5 (osd.5) 178 : cluster [DBG] 2.18 deep-scrub ok 2024-02-10T08:29:27.396 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:26.209667+0000 osd.7 (osd.7) 173 : cluster [DBG] 2.1c scrub starts 2024-02-10T08:29:27.396 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:26.213411+0000 osd.7 (osd.7) 174 : cluster [DBG] 2.1c scrub ok 2024-02-10T08:29:27.396 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:26.287901+0000 osd.1 (osd.1) 163 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:29:27.396 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:26.287952+0000 osd.1 (osd.1) 164 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:29:27.396 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:26.693603+0000 osd.1 (osd.1) 165 : cluster [DBG] 5.5 scrub starts 2024-02-10T08:29:27.396 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:26.703434+0000 osd.1 (osd.1) 166 : cluster [DBG] 5.5 scrub ok 2024-02-10T08:29:27.396 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:29:26.790501+0000 mon.a (mon.0) 1335 : audit [INF] from='client.? 172.21.15.18:0/1397318377' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:29:27.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:26.069153+0000 osd.5 (osd.5) 177 : cluster [DBG] 2.18 deep-scrub starts 2024-02-10T08:29:27.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:26.072027+0000 osd.5 (osd.5) 178 : cluster [DBG] 2.18 deep-scrub ok 2024-02-10T08:29:27.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:26.209667+0000 osd.7 (osd.7) 173 : cluster [DBG] 2.1c scrub starts 2024-02-10T08:29:27.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:26.213411+0000 osd.7 (osd.7) 174 : cluster [DBG] 2.1c scrub ok 2024-02-10T08:29:27.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:26.287901+0000 osd.1 (osd.1) 163 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:29:27.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:26.287952+0000 osd.1 (osd.1) 164 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:29:27.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:26.693603+0000 osd.1 (osd.1) 165 : cluster [DBG] 5.5 scrub starts 2024-02-10T08:29:27.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:26.703434+0000 osd.1 (osd.1) 166 : cluster [DBG] 5.5 scrub ok 2024-02-10T08:29:27.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:29:26.790501+0000 mon.a (mon.0) 1335 : audit [INF] from='client.? 172.21.15.18:0/1397318377' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:29:27.664 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:29:27.667 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:27.668 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:29:27.768 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:29:27.820 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:28.154 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 50 16 78890 78874 98.5527 73.5 0.00845396 0.0101424 2024-02-10T08:29:28.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:26.835244+0000 mgr.y (mgr.14505) 478 : cluster [DBG] pgmap v580: 158 pgs: 1 active+remapped+backfill_toofull, 157 active+clean; 4.5 GiB data, 16 GiB used, 700 GiB / 715 GiB avail; 652 B/s rd, 47 MiB/s wr, 755 op/s; 9216/219528 objects misplaced (4.198%) 2024-02-10T08:29:28.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:27.014510+0000 osd.4 (osd.4) 78 : cluster [DBG] 5.1 scrub starts 2024-02-10T08:29:28.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:27.021104+0000 osd.4 (osd.4) 79 : cluster [DBG] 5.1 scrub ok 2024-02-10T08:29:28.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:27.059979+0000 mon.a (mon.0) 1336 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:29:28.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:29:27.079064+0000 mon.a (mon.0) 1337 : audit [INF] from='client.? 172.21.15.18:0/1397318377' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-10T08:29:28.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:27.079129+0000 mon.a (mon.0) 1338 : cluster [DBG] osdmap e277: 8 total, 8 up, 8 in 2024-02-10T08:29:28.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:26.835244+0000 mgr.y (mgr.14505) 478 : cluster [DBG] pgmap v580: 158 pgs: 1 active+remapped+backfill_toofull, 157 active+clean; 4.5 GiB data, 16 GiB used, 700 GiB / 715 GiB avail; 652 B/s rd, 47 MiB/s wr, 755 op/s; 9216/219528 objects misplaced (4.198%) 2024-02-10T08:29:28.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:27.014510+0000 osd.4 (osd.4) 78 : cluster [DBG] 5.1 scrub starts 2024-02-10T08:29:28.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:27.021104+0000 osd.4 (osd.4) 79 : cluster [DBG] 5.1 scrub ok 2024-02-10T08:29:28.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:27.059979+0000 mon.a (mon.0) 1336 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:29:28.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:29:27.079064+0000 mon.a (mon.0) 1337 : audit [INF] from='client.? 172.21.15.18:0/1397318377' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-10T08:29:28.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:27.079129+0000 mon.a (mon.0) 1338 : cluster [DBG] osdmap e277: 8 total, 8 up, 8 in 2024-02-10T08:29:28.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:26.835244+0000 mgr.y (mgr.14505) 478 : cluster [DBG] pgmap v580: 158 pgs: 1 active+remapped+backfill_toofull, 157 active+clean; 4.5 GiB data, 16 GiB used, 700 GiB / 715 GiB avail; 652 B/s rd, 47 MiB/s wr, 755 op/s; 9216/219528 objects misplaced (4.198%) 2024-02-10T08:29:28.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:27.014510+0000 osd.4 (osd.4) 78 : cluster [DBG] 5.1 scrub starts 2024-02-10T08:29:28.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:27.021104+0000 osd.4 (osd.4) 79 : cluster [DBG] 5.1 scrub ok 2024-02-10T08:29:28.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:27.059979+0000 mon.a (mon.0) 1336 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:29:28.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:29:27.079064+0000 mon.a (mon.0) 1337 : audit [INF] from='client.? 172.21.15.18:0/1397318377' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-10T08:29:28.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:27.079129+0000 mon.a (mon.0) 1338 : cluster [DBG] osdmap e277: 8 total, 8 up, 8 in 2024-02-10T08:29:28.541 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:29:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:29:28.886 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:29:28.891 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:28.892 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:29:28.992 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:29:29.055 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:29.092 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:29:29.094 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:29.094 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:29:29.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:27.784603+0000 osd.0 (osd.0) 142 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:29:29.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:27.784644+0000 osd.0 (osd.0) 143 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:29:29.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:28.098256+0000 mon.a (mon.0) 1339 : cluster [DBG] osdmap e278: 8 total, 8 up, 8 in 2024-02-10T08:29:29.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:29:28.240632+0000 mgr.y (mgr.14505) 479 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:29:29.154 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 51 16 80093 80077 98.0946 75.1875 0.0182191 0.0101899 2024-02-10T08:29:29.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:27.784603+0000 osd.0 (osd.0) 142 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:29:29.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:27.784644+0000 osd.0 (osd.0) 143 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:29:29.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:28.098256+0000 mon.a (mon.0) 1339 : cluster [DBG] osdmap e278: 8 total, 8 up, 8 in 2024-02-10T08:29:29.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:29:28.240632+0000 mgr.y (mgr.14505) 479 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:29:29.196 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:29:29.246 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:29.288 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:29:29.292 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:29.293 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:29:29.394 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:29:29.450 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:29.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:27.784603+0000 osd.0 (osd.0) 142 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:29:29.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:27.784644+0000 osd.0 (osd.0) 143 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:29:29.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:28.098256+0000 mon.a (mon.0) 1339 : cluster [DBG] osdmap e278: 8 total, 8 up, 8 in 2024-02-10T08:29:29.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:29:28.240632+0000 mgr.y (mgr.14505) 479 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:29:29.634 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 3, 4, 5, 6, 7, 0] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 5, 6, 7, 4] 2024-02-10T08:29:29.634 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-10T08:29:29.634 INFO:tasks.thrashosds.thrasher:fixing pg num pool unique_pool_2 2024-02-10T08:29:29.634 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph pg dump --format=json 2024-02-10T08:29:30.154 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 52 16 81268 81252 97.6204 73.4375 0.0169118 0.0102385 2024-02-10T08:29:30.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:28.835743+0000 mgr.y (mgr.14505) 480 : cluster [DBG] pgmap v583: 158 pgs: 1 active+remapped+backfill_toofull, 157 active+clean; 4.8 GiB data, 17 GiB used, 699 GiB / 715 GiB avail; 853 B/s rd, 69 MiB/s wr, 1.10k op/s; 10018/235176 objects misplaced (4.260%) 2024-02-10T08:29:30.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:28.835743+0000 mgr.y (mgr.14505) 480 : cluster [DBG] pgmap v583: 158 pgs: 1 active+remapped+backfill_toofull, 157 active+clean; 4.8 GiB data, 17 GiB used, 699 GiB / 715 GiB avail; 853 B/s rd, 69 MiB/s wr, 1.10k op/s; 10018/235176 objects misplaced (4.260%) 2024-02-10T08:29:30.420 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:29:30.424 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:30.424 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:29:30.525 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:29:30.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:28.835743+0000 mgr.y (mgr.14505) 480 : cluster [DBG] pgmap v583: 158 pgs: 1 active+remapped+backfill_toofull, 157 active+clean; 4.8 GiB data, 17 GiB used, 699 GiB / 715 GiB avail; 853 B/s rd, 69 MiB/s wr, 1.10k op/s; 10018/235176 objects misplaced (4.260%) 2024-02-10T08:29:30.581 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:30.801 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:29:30.812 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:30.812 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:29:30.914 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:29:30.977 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:30.995 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:29:30.995 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:29:30.995 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:29:30.995 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:29:30.995 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:29:30.995 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:29:30.995 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:29:30.995 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:29:30.996 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-10T08:29:30.996 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-10T08:29:30.996 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-10T08:29:30.996 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-10T08:29:30.996 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-10T08:29:30.996 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-10T08:29:30.996 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-10T08:29:30.996 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-10T08:29:31.127 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:29:30.592892+0000 mon.a (mon.0) 1340 : audit [DBG] from='client.? 172.21.15.18:0/1528970828' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:29:31.128 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:29:30.592892+0000 mon.a (mon.0) 1340 : audit [DBG] from='client.? 172.21.15.18:0/1528970828' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:29:31.156 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 53 16 82378 82362 97.0838 69.375 0.0129472 0.0102964 2024-02-10T08:29:31.235 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:29:31.240 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:31.241 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:29:31.270 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:29:31.341 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:29:31.398 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:31.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:29:30.592892+0000 mon.a (mon.0) 1340 : audit [DBG] from='client.? 172.21.15.18:0/1528970828' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:29:32.156 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 54 16 83520 83504 96.6077 71.375 0.0117392 0.0103467 2024-02-10T08:29:32.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:30.836274+0000 mgr.y (mgr.14505) 481 : cluster [DBG] pgmap v584: 158 pgs: 1 active+remapped+backfill_toofull, 157 active+clean; 4.8 GiB data, 17 GiB used, 699 GiB / 715 GiB avail; 853 B/s rd, 62 MiB/s wr, 986 op/s; 10018/236241 objects misplaced (4.241%) 2024-02-10T08:29:32.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:29:31.674000+0000 mon.a (mon.0) 1341 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:29:32.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:30.836274+0000 mgr.y (mgr.14505) 481 : cluster [DBG] pgmap v584: 158 pgs: 1 active+remapped+backfill_toofull, 157 active+clean; 4.8 GiB data, 17 GiB used, 699 GiB / 715 GiB avail; 853 B/s rd, 62 MiB/s wr, 986 op/s; 10018/236241 objects misplaced (4.241%) 2024-02-10T08:29:32.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:29:31.674000+0000 mon.a (mon.0) 1341 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:29:32.542 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:30.836274+0000 mgr.y (mgr.14505) 481 : cluster [DBG] pgmap v584: 158 pgs: 1 active+remapped+backfill_toofull, 157 active+clean; 4.8 GiB data, 17 GiB used, 699 GiB / 715 GiB avail; 853 B/s rd, 62 MiB/s wr, 986 op/s; 10018/236241 objects misplaced (4.241%) 2024-02-10T08:29:32.542 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:29:31.674000+0000 mon.a (mon.0) 1341 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:29:32.826 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd set nodeep-scrub 2024-02-10T08:29:33.157 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 55 16 84701 84685 96.1915 73.8125 0.0151105 0.0103913 2024-02-10T08:29:33.171 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-02-10T08:29:33.172 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:29:34.158 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 56 16 85914 85898 95.8276 75.8125 0.00894635 0.0104306 2024-02-10T08:29:34.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:32.837616+0000 mgr.y (mgr.14505) 482 : cluster [DBG] pgmap v585: 158 pgs: 1 active+remapped+backfill_toofull, 157 active+clean; 5.1 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1.4 KiB/s rd, 87 MiB/s wr, 1.40k op/s; 10708/249246 objects misplaced (4.296%) 2024-02-10T08:29:34.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:32.837616+0000 mgr.y (mgr.14505) 482 : cluster [DBG] pgmap v585: 158 pgs: 1 active+remapped+backfill_toofull, 157 active+clean; 5.1 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1.4 KiB/s rd, 87 MiB/s wr, 1.40k op/s; 10708/249246 objects misplaced (4.296%) 2024-02-10T08:29:34.495 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-10T08:29:34.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:32.837616+0000 mgr.y (mgr.14505) 482 : cluster [DBG] pgmap v585: 158 pgs: 1 active+remapped+backfill_toofull, 157 active+clean; 5.1 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1.4 KiB/s rd, 87 MiB/s wr, 1.40k op/s; 10708/249246 objects misplaced (4.296%) 2024-02-10T08:29:35.158 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 57 16 87050 87034 95.392 71 0.0155228 0.0104783 2024-02-10T08:29:36.158 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 58 16 88222 88206 95.0103 73.25 0.0135286 0.0105208 2024-02-10T08:29:36.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:34.838234+0000 mgr.y (mgr.14505) 483 : cluster [DBG] pgmap v586: 158 pgs: 1 active+remapped+backfill_toofull, 157 active+clean; 5.1 GiB data, 18 GiB used, 698 GiB / 715 GiB avail; 1.2 KiB/s rd, 86 MiB/s wr, 1.37k op/s; 10708/252507 objects misplaced (4.241%) 2024-02-10T08:29:36.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:34.838234+0000 mgr.y (mgr.14505) 483 : cluster [DBG] pgmap v586: 158 pgs: 1 active+remapped+backfill_toofull, 157 active+clean; 5.1 GiB data, 18 GiB used, 698 GiB / 715 GiB avail; 1.2 KiB/s rd, 86 MiB/s wr, 1.37k op/s; 10708/252507 objects misplaced (4.241%) 2024-02-10T08:29:36.521 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:34.838234+0000 mgr.y (mgr.14505) 483 : cluster [DBG] pgmap v586: 158 pgs: 1 active+remapped+backfill_toofull, 157 active+clean; 5.1 GiB data, 18 GiB used, 698 GiB / 715 GiB avail; 1.2 KiB/s rd, 86 MiB/s wr, 1.37k op/s; 10708/252507 objects misplaced (4.241%) 2024-02-10T08:29:36.521 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:29:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:29:36] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:29:37.158 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 59 15 89395 89380 94.6436 73.375 0.0182064 0.0105616 2024-02-10T08:29:37.654 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:29:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:29:37] "GET /metrics HTTP/1.1" 200 176190 "" "Prometheus/2.33.4" 2024-02-10T08:29:38.158 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:2024-02-10T08:29:38.158508+0000 min lat: 0.00124578 max lat: 2.57704 avg lat: 0.0106018 2024-02-10T08:29:38.158 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-02-10T08:29:38.158 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 60 16 90560 90544 94.2787 72.75 0.0100897 0.0106018 2024-02-10T08:29:38.543 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:36.838749+0000 mgr.y (mgr.14505) 484 : cluster [DBG] pgmap v587: 158 pgs: 1 active+remapped+backfill_toofull, 157 active+clean; 5.1 GiB data, 18 GiB used, 698 GiB / 715 GiB avail; 1.0 KiB/s rd, 73 MiB/s wr, 1.17k op/s; 10708/253683 objects misplaced (4.221%) 2024-02-10T08:29:38.543 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:29:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:29:38.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:36.838749+0000 mgr.y (mgr.14505) 484 : cluster [DBG] pgmap v587: 158 pgs: 1 active+remapped+backfill_toofull, 157 active+clean; 5.1 GiB data, 18 GiB used, 698 GiB / 715 GiB avail; 1.0 KiB/s rd, 73 MiB/s wr, 1.17k op/s; 10708/253683 objects misplaced (4.221%) 2024-02-10T08:29:38.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:36.838749+0000 mgr.y (mgr.14505) 484 : cluster [DBG] pgmap v587: 158 pgs: 1 active+remapped+backfill_toofull, 157 active+clean; 5.1 GiB data, 18 GiB used, 698 GiB / 715 GiB avail; 1.0 KiB/s rd, 73 MiB/s wr, 1.17k op/s; 10708/253683 objects misplaced (4.221%) 2024-02-10T08:29:39.158 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 61 16 91669 91653 93.8694 69.3125 0.00960912 0.0106485 2024-02-10T08:29:39.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:29:38.164957+0000 mon.a (mon.0) 1342 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:29:39.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:29:38.257284+0000 mgr.y (mgr.14505) 485 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:29:39.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:29:38.164957+0000 mon.a (mon.0) 1342 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:29:39.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:29:38.257284+0000 mgr.y (mgr.14505) 485 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:29:39.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:29:38.164957+0000 mon.a (mon.0) 1342 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:29:39.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:29:38.257284+0000 mgr.y (mgr.14505) 485 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:29:40.158 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 62 16 92834 92818 93.5298 72.8125 0.00415161 0.0106854 2024-02-10T08:29:40.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:38.839420+0000 mgr.y (mgr.14505) 486 : cluster [DBG] pgmap v588: 158 pgs: 1 active+remapped+backfill_toofull, 157 active+clean; 5.5 GiB data, 19 GiB used, 697 GiB / 715 GiB avail; 953 B/s rd, 74 MiB/s wr, 1.18k op/s; 11440/270282 objects misplaced (4.233%) 2024-02-10T08:29:40.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:38.839420+0000 mgr.y (mgr.14505) 486 : cluster [DBG] pgmap v588: 158 pgs: 1 active+remapped+backfill_toofull, 157 active+clean; 5.5 GiB data, 19 GiB used, 697 GiB / 715 GiB avail; 953 B/s rd, 74 MiB/s wr, 1.18k op/s; 11440/270282 objects misplaced (4.233%) 2024-02-10T08:29:40.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:38.839420+0000 mgr.y (mgr.14505) 486 : cluster [DBG] pgmap v588: 158 pgs: 1 active+remapped+backfill_toofull, 157 active+clean; 5.5 GiB data, 19 GiB used, 697 GiB / 715 GiB avail; 953 B/s rd, 74 MiB/s wr, 1.18k op/s; 11440/270282 objects misplaced (4.233%) 2024-02-10T08:29:40.717 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:29:40.722 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:40.723 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:29:40.824 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:29:40.871 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.1 dump_blocked_ops 2024-02-10T08:29:40.913 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:41.135 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:29:41.139 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:41.139 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:29:41.158 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 63 16 93815 93799 93.0185 61.3125 0.0194738 0.0107453 2024-02-10T08:29:41.240 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:29:41.301 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:41.334 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:29:41.340 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:41.340 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:29:41.441 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:29:41.488 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:41.532 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:29:41.533 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:41.533 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:29:41.607 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:29:41.628 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:29:41.634 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:29:41.671 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:41.677 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:29:41.697 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:29:41.703 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:41.703 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:29:41.804 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:29:41.869 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:41.877 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:29:41.886 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-02-10T08:29:41.947 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:29:41.951 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:41.952 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:29:42.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:41 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:40.843574+0000 mgr.y (mgr.14505) 487 : cluster [DBG] pgmap v589: 158 pgs: 1 active+remapped+backfill_toofull, 157 active+clean; 5.5 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 852 B/s rd, 63 MiB/s wr, 1.00k op/s; 11440/271359 objects misplaced (4.216%) 2024-02-10T08:29:42.052 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:29:42.096 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:40.843574+0000 mgr.y (mgr.14505) 487 : cluster [DBG] pgmap v589: 158 pgs: 1 active+remapped+backfill_toofull, 157 active+clean; 5.5 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 852 B/s rd, 63 MiB/s wr, 1.00k op/s; 11440/271359 objects misplaced (4.216%) 2024-02-10T08:29:42.097 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:40.843574+0000 mgr.y (mgr.14505) 487 : cluster [DBG] pgmap v589: 158 pgs: 1 active+remapped+backfill_toofull, 157 active+clean; 5.5 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 852 B/s rd, 63 MiB/s wr, 1.00k op/s; 11440/271359 objects misplaced (4.216%) 2024-02-10T08:29:42.103 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:42.158 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 64 16 94786 94770 92.5134 60.6875 0.0120814 0.0108049 2024-02-10T08:29:42.196 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:29:42.198 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:42.199 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:29:42.300 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:29:42.350 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:43.041 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:29:41.851459+0000 mgr.y (mgr.14505) 488 : audit [DBG] from='client.25183 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-10T08:29:43.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:29:41.851459+0000 mgr.y (mgr.14505) 488 : audit [DBG] from='client.25183 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-10T08:29:43.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:29:41.851459+0000 mgr.y (mgr.14505) 488 : audit [DBG] from='client.25183 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-10T08:29:43.159 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 65 16 95942 95926 92.2001 72.25 0.0125059 0.0108415 2024-02-10T08:29:43.316 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:29:43.319 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":589,"stamp":"2024-02-10T08:29:40.843148+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":5915350686,"num_objects":90453,"num_object_clones":0,"num_object_copies":271359,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":11440,"num_objects_unfound":0,"num_objects_dirty":90453,"num_whiteouts":0,"num_read":1873,"num_read_kb":1625,"num_write":90975,"num_write_kb":5776745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":145,"num_bytes_recovered":71316,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":73990,"ondisk_log_size":73990,"up":474,"acting":474,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":476,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":19657580,"kb_used_data":17225900,"kb_used_omap":0,"kb_used_meta":2431615,"kb_avail":730303636,"statfs":{"total":767960285184,"available":747830923264,"internally_reserved":0,"allocated":17639321600,"data_stored":17635268356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":972,"internal_metadata":2489973812},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":790429696,"num_objects":12061,"num_object_clones":0,"num_object_copies":36183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":1422,"num_objects_unfound":0,"num_objects_dirty":12061,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":12061,"num_write_kb":771904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007757"},"pg_stats":[{"pgid":"6.29","version":"76'2","reported_seq":207,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.085199+0000","last_change":"2024-02-10T08:28:02.797804+0000","last_active":"2024-02-10T08:29:27.085199+0000","last_peered":"2024-02-10T08:29:27.085199+0000","last_clean":"2024-02-10T08:29:27.085199+0000","last_became_active":"2024-02-10T08:28:02.767822+0000","last_became_peered":"2024-02-10T08:28:02.767822+0000","last_unstale":"2024-02-10T08:29:27.085199+0000","last_undegraded":"2024-02-10T08:29:27.085199+0000","last_fullsized":"2024-02-10T08:29:27.085199+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":6,"last_scrub":"76'2","last_scrub_stamp":"2024-02-10T08:19:28.458129+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2024-02-10T08:18:08.680038+0000","last_clean_scrub_stamp":"2024-02-10T08:19:28.458129+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":26,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,0],"acting":[7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":249,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.092614+0000","last_change":"2024-02-10T08:26:32.121942+0000","last_active":"2024-02-10T08:29:27.092614+0000","last_peered":"2024-02-10T08:29:27.092614+0000","last_clean":"2024-02-10T08:29:27.092614+0000","last_became_active":"2024-02-10T08:22:00.578118+0000","last_became_peered":"2024-02-10T08:22:00.578118+0000","last_unstale":"2024-02-10T08:29:27.092614+0000","last_undegraded":"2024-02-10T08:29:27.092614+0000","last_fullsized":"2024-02-10T08:29:27.092614+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:26:32.121852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:26:32.121852+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,6],"acting":[2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":173,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.091349+0000","last_change":"2024-02-10T08:29:17.607943+0000","last_active":"2024-02-10T08:29:27.091349+0000","last_peered":"2024-02-10T08:29:27.091349+0000","last_clean":"2024-02-10T08:29:27.091349+0000","last_became_active":"2024-02-10T08:23:15.079456+0000","last_became_peered":"2024-02-10T08:23:15.079456+0000","last_unstale":"2024-02-10T08:29:27.091349+0000","last_undegraded":"2024-02-10T08:29:27.091349+0000","last_fullsized":"2024-02-10T08:29:27.091349+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:17.607818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:17.607818+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":168,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.093517+0000","last_change":"2024-02-10T08:29:02.618622+0000","last_active":"2024-02-10T08:29:27.093517+0000","last_peered":"2024-02-10T08:29:27.093517+0000","last_clean":"2024-02-10T08:29:27.093517+0000","last_became_active":"2024-02-10T08:23:15.077457+0000","last_became_peered":"2024-02-10T08:23:15.077457+0000","last_unstale":"2024-02-10T08:29:27.093517+0000","last_undegraded":"2024-02-10T08:29:27.093517+0000","last_fullsized":"2024-02-10T08:29:27.093517+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:02.618499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:02.618499+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":274,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.091641+0000","last_change":"2024-02-10T08:29:21.602049+0000","last_active":"2024-02-10T08:29:27.091641+0000","last_peered":"2024-02-10T08:29:27.091641+0000","last_clean":"2024-02-10T08:29:27.091641+0000","last_became_active":"2024-02-10T08:27:27.710587+0000","last_became_peered":"2024-02-10T08:27:27.710587+0000","last_unstale":"2024-02-10T08:29:27.091641+0000","last_undegraded":"2024-02-10T08:29:27.091641+0000","last_fullsized":"2024-02-10T08:29:27.091641+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:21.601953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:11.750537+0000","last_clean_scrub_stamp":"2024-02-10T08:29:21.601953+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,1],"acting":[6,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":264,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.089860+0000","last_change":"2024-02-10T08:29:19.225386+0000","last_active":"2024-02-10T08:29:27.089860+0000","last_peered":"2024-02-10T08:29:27.089860+0000","last_clean":"2024-02-10T08:29:27.089860+0000","last_became_active":"2024-02-10T08:23:15.064896+0000","last_became_peered":"2024-02-10T08:23:15.064896+0000","last_unstale":"2024-02-10T08:29:27.089860+0000","last_undegraded":"2024-02-10T08:29:27.089860+0000","last_fullsized":"2024-02-10T08:29:27.089860+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:19.225297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:19.225297+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":148,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.082436+0000","last_change":"2024-02-10T08:29:22.556568+0000","last_active":"2024-02-10T08:29:27.082436+0000","last_peered":"2024-02-10T08:29:27.082436+0000","last_clean":"2024-02-10T08:29:27.082436+0000","last_became_active":"2024-02-10T08:28:25.999335+0000","last_became_peered":"2024-02-10T08:28:25.999335+0000","last_unstale":"2024-02-10T08:29:27.082436+0000","last_undegraded":"2024-02-10T08:29:27.082436+0000","last_fullsized":"2024-02-10T08:29:27.082436+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:22.556451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:22.556451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":164,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.088498+0000","last_change":"2024-02-10T08:29:19.512005+0000","last_active":"2024-02-10T08:29:27.088498+0000","last_peered":"2024-02-10T08:29:27.088498+0000","last_clean":"2024-02-10T08:29:27.088498+0000","last_became_active":"2024-02-10T08:22:00.600200+0000","last_became_peered":"2024-02-10T08:22:00.600200+0000","last_unstale":"2024-02-10T08:29:27.088498+0000","last_undegraded":"2024-02-10T08:29:27.088498+0000","last_fullsized":"2024-02-10T08:29:27.088498+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:19.511918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:19.511918+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1],"acting":[6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":168,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.085108+0000","last_change":"2024-02-10T08:28:38.233240+0000","last_active":"2024-02-10T08:29:27.085108+0000","last_peered":"2024-02-10T08:29:27.085108+0000","last_clean":"2024-02-10T08:29:27.085108+0000","last_became_active":"2024-02-10T08:28:38.232920+0000","last_became_peered":"2024-02-10T08:28:38.232920+0000","last_unstale":"2024-02-10T08:29:27.085108+0000","last_undegraded":"2024-02-10T08:29:27.085108+0000","last_fullsized":"2024-02-10T08:29:27.085108+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:18.099177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:18.099177+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,1],"acting":[7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":159,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.081479+0000","last_change":"2024-02-10T08:29:01.651198+0000","last_active":"2024-02-10T08:29:27.081479+0000","last_peered":"2024-02-10T08:29:27.081479+0000","last_clean":"2024-02-10T08:29:27.081479+0000","last_became_active":"2024-02-10T08:22:00.581772+0000","last_became_peered":"2024-02-10T08:22:00.581772+0000","last_unstale":"2024-02-10T08:29:27.081479+0000","last_undegraded":"2024-02-10T08:29:27.081479+0000","last_fullsized":"2024-02-10T08:29:27.081479+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:01.651093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:01.651093+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,7],"acting":[1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":166,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.086195+0000","last_change":"2024-02-10T08:29:06.366400+0000","last_active":"2024-02-10T08:29:27.086195+0000","last_peered":"2024-02-10T08:29:27.086195+0000","last_clean":"2024-02-10T08:29:27.086195+0000","last_became_active":"2024-02-10T08:23:15.079180+0000","last_became_peered":"2024-02-10T08:23:15.079180+0000","last_unstale":"2024-02-10T08:29:27.086195+0000","last_undegraded":"2024-02-10T08:29:27.086195+0000","last_fullsized":"2024-02-10T08:29:27.086195+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:06.366305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:06.366305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":68,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.089394+0000","last_change":"2024-02-10T08:29:04.389674+0000","last_active":"2024-02-10T08:29:27.089394+0000","last_peered":"2024-02-10T08:29:27.089394+0000","last_clean":"2024-02-10T08:29:27.089394+0000","last_became_active":"2024-02-10T08:28:38.236371+0000","last_became_peered":"2024-02-10T08:28:38.236371+0000","last_unstale":"2024-02-10T08:29:27.089394+0000","last_undegraded":"2024-02-10T08:29:27.089394+0000","last_fullsized":"2024-02-10T08:29:27.089394+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:04.388074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:04.388074+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,2],"acting":[6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":203,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.085749+0000","last_change":"2024-02-10T08:28:31.264421+0000","last_active":"2024-02-10T08:29:27.085749+0000","last_peered":"2024-02-10T08:29:27.085749+0000","last_clean":"2024-02-10T08:29:27.085749+0000","last_became_active":"2024-02-10T08:23:34.723324+0000","last_became_peered":"2024-02-10T08:23:34.723324+0000","last_unstale":"2024-02-10T08:29:27.085749+0000","last_undegraded":"2024-02-10T08:29:27.085749+0000","last_fullsized":"2024-02-10T08:29:27.085749+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:31.264352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:28:31.264352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"225'27","reported_seq":287,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.090790+0000","last_change":"2024-02-10T08:29:18.566459+0000","last_active":"2024-02-10T08:29:27.090790+0000","last_peered":"2024-02-10T08:29:27.090790+0000","last_clean":"2024-02-10T08:29:27.090790+0000","last_became_active":"2024-02-10T08:28:02.789308+0000","last_became_peered":"2024-02-10T08:28:02.789308+0000","last_unstale":"2024-02-10T08:29:27.090790+0000","last_undegraded":"2024-02-10T08:29:27.090790+0000","last_fullsized":"2024-02-10T08:29:27.090790+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'27","last_scrub_stamp":"2024-02-10T08:29:18.566350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:29:18.566350+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":224,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.092813+0000","last_change":"2024-02-10T08:29:25.024508+0000","last_active":"2024-02-10T08:29:27.092813+0000","last_peered":"2024-02-10T08:29:27.092813+0000","last_clean":"2024-02-10T08:29:27.092813+0000","last_became_active":"2024-02-10T08:20:46.405314+0000","last_became_peered":"2024-02-10T08:20:46.405314+0000","last_unstale":"2024-02-10T08:29:27.092813+0000","last_undegraded":"2024-02-10T08:29:27.092813+0000","last_fullsized":"2024-02-10T08:29:27.092813+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:25.024412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:29:25.024412+0000","last_clean_scrub_stamp":"2024-02-10T08:29:25.024412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":243,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.081029+0000","last_change":"2024-02-10T08:28:24.450504+0000","last_active":"2024-02-10T08:29:27.081029+0000","last_peered":"2024-02-10T08:29:27.081029+0000","last_clean":"2024-02-10T08:29:27.081029+0000","last_became_active":"2024-02-10T08:16:56.863353+0000","last_became_peered":"2024-02-10T08:16:56.863353+0000","last_unstale":"2024-02-10T08:29:27.081029+0000","last_undegraded":"2024-02-10T08:29:27.081029+0000","last_fullsized":"2024-02-10T08:29:27.081029+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:24.450350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:28:24.450350+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":139,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.090940+0000","last_change":"2024-02-10T08:28:15.255199+0000","last_active":"2024-02-10T08:29:27.090940+0000","last_peered":"2024-02-10T08:29:27.090940+0000","last_clean":"2024-02-10T08:29:27.090940+0000","last_became_active":"2024-02-10T08:23:15.074301+0000","last_became_peered":"2024-02-10T08:23:15.074301+0000","last_unstale":"2024-02-10T08:29:27.090940+0000","last_undegraded":"2024-02-10T08:29:27.090940+0000","last_fullsized":"2024-02-10T08:29:27.090940+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:15.255132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:28:15.255132+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"225'15","reported_seq":248,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.092071+0000","last_change":"2024-02-10T08:29:07.977048+0000","last_active":"2024-02-10T08:29:27.092071+0000","last_peered":"2024-02-10T08:29:27.092071+0000","last_clean":"2024-02-10T08:29:27.092071+0000","last_became_active":"2024-02-10T08:20:46.404966+0000","last_became_peered":"2024-02-10T08:20:46.404966+0000","last_unstale":"2024-02-10T08:29:27.092071+0000","last_undegraded":"2024-02-10T08:29:27.092071+0000","last_fullsized":"2024-02-10T08:29:27.092071+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'15","last_scrub_stamp":"2024-02-10T08:29:07.976943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:29:07.976943+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":254,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.088521+0000","last_change":"2024-02-10T08:29:08.143346+0000","last_active":"2024-02-10T08:29:27.088521+0000","last_peered":"2024-02-10T08:29:27.088521+0000","last_clean":"2024-02-10T08:29:27.088521+0000","last_became_active":"2024-02-10T08:23:15.125955+0000","last_became_peered":"2024-02-10T08:23:15.125955+0000","last_unstale":"2024-02-10T08:29:27.088521+0000","last_undegraded":"2024-02-10T08:29:27.088521+0000","last_fullsized":"2024-02-10T08:29:27.088521+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:08.143236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:08.143236+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,2],"acting":[5,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":262,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.086061+0000","last_change":"2024-02-10T08:28:38.278860+0000","last_active":"2024-02-10T08:29:27.086061+0000","last_peered":"2024-02-10T08:29:27.086061+0000","last_clean":"2024-02-10T08:29:27.086061+0000","last_became_active":"2024-02-10T08:20:46.406783+0000","last_became_peered":"2024-02-10T08:20:46.406783+0000","last_unstale":"2024-02-10T08:29:27.086061+0000","last_undegraded":"2024-02-10T08:29:27.086061+0000","last_fullsized":"2024-02-10T08:29:27.086061+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:38.278752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:28:38.278752+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"55'1","reported_seq":279,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.086906+0000","last_change":"2024-02-10T08:28:02.870043+0000","last_active":"2024-02-10T08:29:27.086906+0000","last_peered":"2024-02-10T08:29:27.086906+0000","last_clean":"2024-02-10T08:29:27.086906+0000","last_became_active":"2024-02-10T08:28:02.761299+0000","last_became_peered":"2024-02-10T08:28:02.761299+0000","last_unstale":"2024-02-10T08:29:27.086906+0000","last_undegraded":"2024-02-10T08:29:27.086906+0000","last_fullsized":"2024-02-10T08:29:27.086906+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'1","last_scrub_stamp":"2024-02-10T08:27:18.293859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:27:18.293859+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1746,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"225'7","reported_seq":275,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.092480+0000","last_change":"2024-02-10T08:27:27.742734+0000","last_active":"2024-02-10T08:29:27.092480+0000","last_peered":"2024-02-10T08:29:27.092480+0000","last_clean":"2024-02-10T08:29:27.092480+0000","last_became_active":"2024-02-10T08:27:27.715306+0000","last_became_peered":"2024-02-10T08:27:27.715306+0000","last_unstale":"2024-02-10T08:29:27.092480+0000","last_undegraded":"2024-02-10T08:29:27.092480+0000","last_fullsized":"2024-02-10T08:29:27.092480+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'7","last_scrub_stamp":"2024-02-10T08:27:19.895566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:27:19.895566+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":9,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":133,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.081631+0000","last_change":"2024-02-10T08:27:19.250964+0000","last_active":"2024-02-10T08:29:27.081631+0000","last_peered":"2024-02-10T08:29:27.081631+0000","last_clean":"2024-02-10T08:29:27.081631+0000","last_became_active":"2024-02-10T08:23:15.078168+0000","last_became_peered":"2024-02-10T08:23:15.078168+0000","last_unstale":"2024-02-10T08:29:27.081631+0000","last_undegraded":"2024-02-10T08:29:27.081631+0000","last_fullsized":"2024-02-10T08:29:27.081631+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:27:19.250878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:27:19.250878+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,2],"acting":[1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":279,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.089687+0000","last_change":"2024-02-10T08:29:22.172003+0000","last_active":"2024-02-10T08:29:27.089687+0000","last_peered":"2024-02-10T08:29:27.089687+0000","last_clean":"2024-02-10T08:29:27.089687+0000","last_became_active":"2024-02-10T08:28:19.065132+0000","last_became_peered":"2024-02-10T08:28:19.065132+0000","last_unstale":"2024-02-10T08:29:27.089687+0000","last_undegraded":"2024-02-10T08:29:27.089687+0000","last_fullsized":"2024-02-10T08:29:27.089687+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:22.171906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:22.171906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,7],"acting":[5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":251,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.084572+0000","last_change":"2024-02-10T08:29:26.213501+0000","last_active":"2024-02-10T08:29:27.084572+0000","last_peered":"2024-02-10T08:29:27.084572+0000","last_clean":"2024-02-10T08:29:27.084572+0000","last_became_active":"2024-02-10T08:16:52.787865+0000","last_became_peered":"2024-02-10T08:16:52.787865+0000","last_unstale":"2024-02-10T08:29:27.084572+0000","last_undegraded":"2024-02-10T08:29:27.084572+0000","last_fullsized":"2024-02-10T08:29:27.084572+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:26.213417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:28.028556+0000","last_clean_scrub_stamp":"2024-02-10T08:29:26.213417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"225'15","reported_seq":274,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.082451+0000","last_change":"2024-02-10T08:29:13.500113+0000","last_active":"2024-02-10T08:29:27.082451+0000","last_peered":"2024-02-10T08:29:27.082451+0000","last_clean":"2024-02-10T08:29:27.082451+0000","last_became_active":"2024-02-10T08:28:38.226796+0000","last_became_peered":"2024-02-10T08:28:38.226796+0000","last_unstale":"2024-02-10T08:29:27.082451+0000","last_undegraded":"2024-02-10T08:29:27.082451+0000","last_fullsized":"2024-02-10T08:29:27.082451+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'15","last_scrub_stamp":"2024-02-10T08:29:13.500017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:29:13.500017+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":157,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.091742+0000","last_change":"2024-02-10T08:28:27.516339+0000","last_active":"2024-02-10T08:29:27.091742+0000","last_peered":"2024-02-10T08:29:27.091742+0000","last_clean":"2024-02-10T08:29:27.091742+0000","last_became_active":"2024-02-10T08:22:23.526229+0000","last_became_peered":"2024-02-10T08:22:23.526229+0000","last_unstale":"2024-02-10T08:29:27.091742+0000","last_undegraded":"2024-02-10T08:29:27.091742+0000","last_fullsized":"2024-02-10T08:29:27.091742+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:27.516251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:27.516251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":221,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.092861+0000","last_change":"2024-02-10T08:26:26.889748+0000","last_active":"2024-02-10T08:29:27.092861+0000","last_peered":"2024-02-10T08:29:27.092861+0000","last_clean":"2024-02-10T08:29:27.092861+0000","last_became_active":"2024-02-10T08:20:46.398532+0000","last_became_peered":"2024-02-10T08:20:46.398532+0000","last_unstale":"2024-02-10T08:29:27.092861+0000","last_undegraded":"2024-02-10T08:29:27.092861+0000","last_fullsized":"2024-02-10T08:29:27.092861+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:26:26.889655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:26:26.889655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":161,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.086473+0000","last_change":"2024-02-10T08:26:14.128513+0000","last_active":"2024-02-10T08:29:27.086473+0000","last_peered":"2024-02-10T08:29:27.086473+0000","last_clean":"2024-02-10T08:29:27.086473+0000","last_became_active":"2024-02-10T08:23:34.728772+0000","last_became_peered":"2024-02-10T08:23:34.728772+0000","last_unstale":"2024-02-10T08:29:27.086473+0000","last_undegraded":"2024-02-10T08:29:27.086473+0000","last_fullsized":"2024-02-10T08:29:27.086473+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:26:14.128447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:26:14.128447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1d","version":"226'23","reported_seq":237,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.089857+0000","last_change":"2024-02-10T08:29:19.670237+0000","last_active":"2024-02-10T08:29:27.089857+0000","last_peered":"2024-02-10T08:29:27.089857+0000","last_clean":"2024-02-10T08:29:27.089857+0000","last_became_active":"2024-02-10T08:23:34.710443+0000","last_became_peered":"2024-02-10T08:23:34.710443+0000","last_unstale":"2024-02-10T08:29:27.089857+0000","last_undegraded":"2024-02-10T08:29:27.089857+0000","last_fullsized":"2024-02-10T08:29:27.089857+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"226'23","last_scrub_stamp":"2024-02-10T08:29:19.670143+0000","last_deep_scrub":"74'17","last_deep_scrub_stamp":"2024-02-10T08:18:02.949298+0000","last_clean_scrub_stamp":"2024-02-10T08:29:19.670143+0000","log_size":23,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":25,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,6],"acting":[1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":224,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.093342+0000","last_change":"2024-02-10T08:29:00.918497+0000","last_active":"2024-02-10T08:29:27.093342+0000","last_peered":"2024-02-10T08:29:27.093342+0000","last_clean":"2024-02-10T08:29:27.093342+0000","last_became_active":"2024-02-10T08:20:46.403378+0000","last_became_peered":"2024-02-10T08:20:46.403378+0000","last_unstale":"2024-02-10T08:29:27.093342+0000","last_undegraded":"2024-02-10T08:29:27.093342+0000","last_fullsized":"2024-02-10T08:29:27.093342+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:00.918382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:00.918382+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":276,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.089981+0000","last_change":"2024-02-10T08:29:25.682482+0000","last_active":"2024-02-10T08:29:27.089981+0000","last_peered":"2024-02-10T08:29:27.089981+0000","last_clean":"2024-02-10T08:29:27.089981+0000","last_became_active":"2024-02-10T08:28:02.763523+0000","last_became_peered":"2024-02-10T08:28:02.763523+0000","last_unstale":"2024-02-10T08:29:27.089981+0000","last_undegraded":"2024-02-10T08:29:27.089981+0000","last_fullsized":"2024-02-10T08:29:27.089981+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:25.682383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:25.682383+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":266,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.088852+0000","last_change":"2024-02-10T08:28:33.456849+0000","last_active":"2024-02-10T08:29:27.088852+0000","last_peered":"2024-02-10T08:29:27.088852+0000","last_clean":"2024-02-10T08:29:27.088852+0000","last_became_active":"2024-02-10T08:20:46.396303+0000","last_became_peered":"2024-02-10T08:20:46.396303+0000","last_unstale":"2024-02-10T08:29:27.088852+0000","last_undegraded":"2024-02-10T08:29:27.088852+0000","last_fullsized":"2024-02-10T08:29:27.088852+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:33.456780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:10.370746+0000","last_clean_scrub_stamp":"2024-02-10T08:28:33.456780+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1c","version":"225'27","reported_seq":318,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.091111+0000","last_change":"2024-02-10T08:26:28.089083+0000","last_active":"2024-02-10T08:29:27.091111+0000","last_peered":"2024-02-10T08:29:27.091111+0000","last_clean":"2024-02-10T08:29:27.091111+0000","last_became_active":"2024-02-10T08:23:34.712669+0000","last_became_peered":"2024-02-10T08:23:34.712669+0000","last_unstale":"2024-02-10T08:29:27.091111+0000","last_undegraded":"2024-02-10T08:29:27.091111+0000","last_fullsized":"2024-02-10T08:29:27.091111+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'15","last_scrub_stamp":"2024-02-10T08:26:28.088989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:26:28.088989+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4],"acting":[2,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":256,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.089492+0000","last_change":"2024-02-10T08:29:20.739901+0000","last_active":"2024-02-10T08:29:27.089492+0000","last_peered":"2024-02-10T08:29:27.089492+0000","last_clean":"2024-02-10T08:29:27.089492+0000","last_became_active":"2024-02-10T08:20:46.408504+0000","last_became_peered":"2024-02-10T08:20:46.408504+0000","last_unstale":"2024-02-10T08:29:27.089492+0000","last_undegraded":"2024-02-10T08:29:27.089492+0000","last_fullsized":"2024-02-10T08:29:27.089492+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:20.739750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:22.104988+0000","last_clean_scrub_stamp":"2024-02-10T08:29:20.739750+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":77,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.083163+0000","last_change":"2024-02-10T08:28:32.177848+0000","last_active":"2024-02-10T08:29:27.083163+0000","last_peered":"2024-02-10T08:29:27.083163+0000","last_clean":"2024-02-10T08:29:27.083163+0000","last_became_active":"2024-02-10T08:28:25.951312+0000","last_became_peered":"2024-02-10T08:28:25.951312+0000","last_unstale":"2024-02-10T08:29:27.083163+0000","last_undegraded":"2024-02-10T08:29:27.083163+0000","last_fullsized":"2024-02-10T08:29:27.083163+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:32.177772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:28:32.177772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":184,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.089041+0000","last_change":"2024-02-10T08:29:14.469349+0000","last_active":"2024-02-10T08:29:27.089041+0000","last_peered":"2024-02-10T08:29:27.089041+0000","last_clean":"2024-02-10T08:29:27.089041+0000","last_became_active":"2024-02-10T08:28:02.773857+0000","last_became_peered":"2024-02-10T08:28:02.773857+0000","last_unstale":"2024-02-10T08:29:27.089041+0000","last_undegraded":"2024-02-10T08:29:27.089041+0000","last_fullsized":"2024-02-10T08:29:27.089041+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:14.469285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:25:42.124914+0000","last_clean_scrub_stamp":"2024-02-10T08:29:14.469285+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2],"acting":[6,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"225'19","reported_seq":280,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.091619+0000","last_change":"2024-02-10T08:28:40.341710+0000","last_active":"2024-02-10T08:29:27.091619+0000","last_peered":"2024-02-10T08:29:27.091619+0000","last_clean":"2024-02-10T08:29:27.091619+0000","last_became_active":"2024-02-10T08:16:54.852665+0000","last_became_peered":"2024-02-10T08:16:54.852665+0000","last_unstale":"2024-02-10T08:29:27.091619+0000","last_undegraded":"2024-02-10T08:29:27.091619+0000","last_fullsized":"2024-02-10T08:29:27.091619+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'19","last_scrub_stamp":"2024-02-10T08:28:40.341641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:28:40.341641+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"87'2","reported_seq":247,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.084852+0000","last_change":"2024-02-10T08:28:37.261008+0000","last_active":"2024-02-10T08:29:27.084852+0000","last_peered":"2024-02-10T08:29:27.084852+0000","last_clean":"2024-02-10T08:29:27.084852+0000","last_became_active":"2024-02-10T08:16:58.859047+0000","last_became_peered":"2024-02-10T08:16:58.859047+0000","last_unstale":"2024-02-10T08:29:27.084852+0000","last_undegraded":"2024-02-10T08:29:27.084852+0000","last_fullsized":"2024-02-10T08:29:27.084852+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'2","last_scrub_stamp":"2024-02-10T08:28:37.260945+0000","last_deep_scrub":"87'2","last_deep_scrub_stamp":"2024-02-10T08:19:29.207531+0000","last_clean_scrub_stamp":"2024-02-10T08:28:37.260945+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"111'11","reported_seq":427,"reported_epoch":278,"state":"active+clean","last_fresh":"2024-02-10T08:29:31.118433+0000","last_change":"2024-02-10T08:28:29.461568+0000","last_active":"2024-02-10T08:29:31.118433+0000","last_peered":"2024-02-10T08:29:31.118433+0000","last_clean":"2024-02-10T08:29:31.118433+0000","last_became_active":"2024-02-10T08:20:46.402663+0000","last_became_peered":"2024-02-10T08:20:46.402663+0000","last_unstale":"2024-02-10T08:29:31.118433+0000","last_undegraded":"2024-02-10T08:29:31.118433+0000","last_fullsized":"2024-02-10T08:29:31.118433+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'11","last_scrub_stamp":"2024-02-10T08:28:29.461499+0000","last_deep_scrub":"82'9","last_deep_scrub_stamp":"2024-02-10T08:18:36.323217+0000","last_clean_scrub_stamp":"2024-02-10T08:28:29.461499+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":266,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.087614+0000","last_change":"2024-02-10T08:29:26.072110+0000","last_active":"2024-02-10T08:29:27.087614+0000","last_peered":"2024-02-10T08:29:27.087614+0000","last_clean":"2024-02-10T08:29:27.087614+0000","last_became_active":"2024-02-10T08:20:46.392466+0000","last_became_peered":"2024-02-10T08:20:46.392466+0000","last_unstale":"2024-02-10T08:29:27.087614+0000","last_undegraded":"2024-02-10T08:29:27.087614+0000","last_fullsized":"2024-02-10T08:29:27.087614+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:26.072031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:29:26.072031+0000","last_clean_scrub_stamp":"2024-02-10T08:29:26.072031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"225'25","reported_seq":336,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.083085+0000","last_change":"2024-02-10T08:28:38.118912+0000","last_active":"2024-02-10T08:29:27.083085+0000","last_peered":"2024-02-10T08:29:27.083085+0000","last_clean":"2024-02-10T08:29:27.083085+0000","last_became_active":"2024-02-10T08:28:25.951464+0000","last_became_peered":"2024-02-10T08:28:25.951464+0000","last_unstale":"2024-02-10T08:29:27.083085+0000","last_undegraded":"2024-02-10T08:29:27.083085+0000","last_fullsized":"2024-02-10T08:29:27.083085+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'25","last_scrub_stamp":"2024-02-10T08:28:38.118836+0000","last_deep_scrub":"74'15","last_deep_scrub_stamp":"2024-02-10T08:17:57.637346+0000","last_clean_scrub_stamp":"2024-02-10T08:28:38.118836+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":24,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":157,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.090723+0000","last_change":"2024-02-10T08:28:38.237508+0000","last_active":"2024-02-10T08:29:27.090723+0000","last_peered":"2024-02-10T08:29:27.090723+0000","last_clean":"2024-02-10T08:29:27.090723+0000","last_became_active":"2024-02-10T08:28:38.237168+0000","last_became_peered":"2024-02-10T08:28:38.237168+0000","last_unstale":"2024-02-10T08:29:27.090723+0000","last_undegraded":"2024-02-10T08:29:27.090723+0000","last_fullsized":"2024-02-10T08:29:27.090723+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:34.502781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:34.502781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,5],"acting":[6,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":262,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.085142+0000","last_change":"2024-02-10T08:29:19.380493+0000","last_active":"2024-02-10T08:29:27.085142+0000","last_peered":"2024-02-10T08:29:27.085142+0000","last_clean":"2024-02-10T08:29:27.085142+0000","last_became_active":"2024-02-10T08:20:46.399838+0000","last_became_peered":"2024-02-10T08:20:46.399838+0000","last_unstale":"2024-02-10T08:29:27.085142+0000","last_undegraded":"2024-02-10T08:29:27.085142+0000","last_fullsized":"2024-02-10T08:29:27.085142+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:19.380403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:19.380403+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":251,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.091804+0000","last_change":"2024-02-10T08:28:38.361039+0000","last_active":"2024-02-10T08:29:27.091804+0000","last_peered":"2024-02-10T08:29:27.091804+0000","last_clean":"2024-02-10T08:29:27.091804+0000","last_became_active":"2024-02-10T08:16:52.788629+0000","last_became_peered":"2024-02-10T08:16:52.788629+0000","last_unstale":"2024-02-10T08:29:27.091804+0000","last_undegraded":"2024-02-10T08:29:27.091804+0000","last_fullsized":"2024-02-10T08:29:27.091804+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:38.360929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:38.360929+0000","last_clean_scrub_stamp":"2024-02-10T08:28:38.360929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"225'19","reported_seq":200,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.085480+0000","last_change":"2024-02-10T08:29:22.312103+0000","last_active":"2024-02-10T08:29:27.085480+0000","last_peered":"2024-02-10T08:29:27.085480+0000","last_clean":"2024-02-10T08:29:27.085480+0000","last_became_active":"2024-02-10T08:22:23.526198+0000","last_became_peered":"2024-02-10T08:22:23.526198+0000","last_unstale":"2024-02-10T08:29:27.085480+0000","last_undegraded":"2024-02-10T08:29:27.085480+0000","last_fullsized":"2024-02-10T08:29:27.085480+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'19","last_scrub_stamp":"2024-02-10T08:29:22.312001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:29:22.312001+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":24,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":260,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.086288+0000","last_change":"2024-02-10T08:29:12.421115+0000","last_active":"2024-02-10T08:29:27.086288+0000","last_peered":"2024-02-10T08:29:27.086288+0000","last_clean":"2024-02-10T08:29:27.086288+0000","last_became_active":"2024-02-10T08:20:46.399515+0000","last_became_peered":"2024-02-10T08:20:46.399515+0000","last_unstale":"2024-02-10T08:29:27.086288+0000","last_undegraded":"2024-02-10T08:29:27.086288+0000","last_fullsized":"2024-02-10T08:29:27.086288+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:12.421034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:27.276490+0000","last_clean_scrub_stamp":"2024-02-10T08:29:12.421034+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":257,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.089137+0000","last_change":"2024-02-10T08:28:26.460262+0000","last_active":"2024-02-10T08:29:27.089137+0000","last_peered":"2024-02-10T08:29:27.089137+0000","last_clean":"2024-02-10T08:29:27.089137+0000","last_became_active":"2024-02-10T08:20:46.397495+0000","last_became_peered":"2024-02-10T08:20:46.397495+0000","last_unstale":"2024-02-10T08:29:27.089137+0000","last_undegraded":"2024-02-10T08:29:27.089137+0000","last_fullsized":"2024-02-10T08:29:27.089137+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:26.460158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:28:26.460158+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":256,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.090795+0000","last_change":"2024-02-10T08:29:10.131158+0000","last_active":"2024-02-10T08:29:27.090795+0000","last_peered":"2024-02-10T08:29:27.090795+0000","last_clean":"2024-02-10T08:29:27.090795+0000","last_became_active":"2024-02-10T08:16:52.788704+0000","last_became_peered":"2024-02-10T08:16:52.788704+0000","last_unstale":"2024-02-10T08:29:27.090795+0000","last_undegraded":"2024-02-10T08:29:27.090795+0000","last_fullsized":"2024-02-10T08:29:27.090795+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:10.131056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:29:10.131056+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"225'8","reported_seq":176,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.081933+0000","last_change":"2024-02-10T08:25:30.862232+0000","last_active":"2024-02-10T08:29:27.081933+0000","last_peered":"2024-02-10T08:29:27.081933+0000","last_clean":"2024-02-10T08:29:27.081933+0000","last_became_active":"2024-02-10T08:22:23.522936+0000","last_became_peered":"2024-02-10T08:22:23.522936+0000","last_unstale":"2024-02-10T08:29:27.081933+0000","last_undegraded":"2024-02-10T08:29:27.081933+0000","last_fullsized":"2024-02-10T08:29:27.081933+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'4","last_scrub_stamp":"2024-02-10T08:25:30.862066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:25:30.862066+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,6],"acting":[1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":161,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.088591+0000","last_change":"2024-02-10T08:28:27.240341+0000","last_active":"2024-02-10T08:29:27.088591+0000","last_peered":"2024-02-10T08:29:27.088591+0000","last_clean":"2024-02-10T08:29:27.088591+0000","last_became_active":"2024-02-10T08:23:34.710130+0000","last_became_peered":"2024-02-10T08:23:34.710130+0000","last_unstale":"2024-02-10T08:29:27.088591+0000","last_undegraded":"2024-02-10T08:29:27.088591+0000","last_fullsized":"2024-02-10T08:29:27.088591+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:27.240244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:27.240244+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":254,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.085994+0000","last_change":"2024-02-10T08:28:20.394761+0000","last_active":"2024-02-10T08:29:27.085994+0000","last_peered":"2024-02-10T08:29:27.085994+0000","last_clean":"2024-02-10T08:29:27.085994+0000","last_became_active":"2024-02-10T08:23:15.078667+0000","last_became_peered":"2024-02-10T08:23:15.078667+0000","last_unstale":"2024-02-10T08:29:27.085994+0000","last_undegraded":"2024-02-10T08:29:27.085994+0000","last_fullsized":"2024-02-10T08:29:27.085994+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:20.394696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:28:20.394696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":260,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.089704+0000","last_change":"2024-02-10T08:28:28.486997+0000","last_active":"2024-02-10T08:29:27.089704+0000","last_peered":"2024-02-10T08:29:27.089704+0000","last_clean":"2024-02-10T08:29:27.089704+0000","last_became_active":"2024-02-10T08:23:15.079635+0000","last_became_peered":"2024-02-10T08:23:15.079635+0000","last_unstale":"2024-02-10T08:29:27.089704+0000","last_undegraded":"2024-02-10T08:29:27.089704+0000","last_fullsized":"2024-02-10T08:29:27.089704+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:28.486926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:28:28.486926+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[1,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"225'24","reported_seq":286,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.092393+0000","last_change":"2024-02-10T08:28:35.984255+0000","last_active":"2024-02-10T08:29:27.092393+0000","last_peered":"2024-02-10T08:29:27.092393+0000","last_clean":"2024-02-10T08:29:27.092393+0000","last_became_active":"2024-02-10T08:20:46.396130+0000","last_became_peered":"2024-02-10T08:20:46.396130+0000","last_unstale":"2024-02-10T08:29:27.092393+0000","last_undegraded":"2024-02-10T08:29:27.092393+0000","last_fullsized":"2024-02-10T08:29:27.092393+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'24","last_scrub_stamp":"2024-02-10T08:28:35.984191+0000","last_deep_scrub":"201'16","last_deep_scrub_stamp":"2024-02-10T08:24:49.177357+0000","last_clean_scrub_stamp":"2024-02-10T08:28:35.984191+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":77,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.082936+0000","last_change":"2024-02-10T08:29:11.496211+0000","last_active":"2024-02-10T08:29:27.082936+0000","last_peered":"2024-02-10T08:29:27.082936+0000","last_clean":"2024-02-10T08:29:27.082936+0000","last_became_active":"2024-02-10T08:28:25.950245+0000","last_became_peered":"2024-02-10T08:28:25.950245+0000","last_unstale":"2024-02-10T08:29:27.082936+0000","last_undegraded":"2024-02-10T08:29:27.082936+0000","last_fullsized":"2024-02-10T08:29:27.082936+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:11.496105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:11.496105+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":80,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.082744+0000","last_change":"2024-02-10T08:29:01.325236+0000","last_active":"2024-02-10T08:29:27.082744+0000","last_peered":"2024-02-10T08:29:27.082744+0000","last_clean":"2024-02-10T08:29:27.082744+0000","last_became_active":"2024-02-10T08:28:25.950221+0000","last_became_peered":"2024-02-10T08:28:25.950221+0000","last_unstale":"2024-02-10T08:29:27.082744+0000","last_undegraded":"2024-02-10T08:29:27.082744+0000","last_fullsized":"2024-02-10T08:29:27.082744+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:01.325135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:01.325135+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":258,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.090820+0000","last_change":"2024-02-10T08:29:10.389220+0000","last_active":"2024-02-10T08:29:27.090820+0000","last_peered":"2024-02-10T08:29:27.090820+0000","last_clean":"2024-02-10T08:29:27.090820+0000","last_became_active":"2024-02-10T08:16:52.786213+0000","last_became_peered":"2024-02-10T08:16:52.786213+0000","last_unstale":"2024-02-10T08:29:27.090820+0000","last_undegraded":"2024-02-10T08:29:27.090820+0000","last_fullsized":"2024-02-10T08:29:27.090820+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:10.389138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:29:10.389138+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"225'15","reported_seq":253,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.082315+0000","last_change":"2024-02-10T08:28:25.952604+0000","last_active":"2024-02-10T08:29:27.082315+0000","last_peered":"2024-02-10T08:29:27.082315+0000","last_clean":"2024-02-10T08:29:27.082315+0000","last_became_active":"2024-02-10T08:28:25.952354+0000","last_became_peered":"2024-02-10T08:28:25.952354+0000","last_unstale":"2024-02-10T08:29:27.082315+0000","last_undegraded":"2024-02-10T08:29:27.082315+0000","last_fullsized":"2024-02-10T08:29:27.082315+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'15","last_scrub_stamp":"2024-02-10T08:28:21.454916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:28:21.454916+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":219,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.093198+0000","last_change":"2024-02-10T08:26:33.798697+0000","last_active":"2024-02-10T08:29:27.093198+0000","last_peered":"2024-02-10T08:29:27.093198+0000","last_clean":"2024-02-10T08:29:27.093198+0000","last_became_active":"2024-02-10T08:20:46.395788+0000","last_became_peered":"2024-02-10T08:20:46.395788+0000","last_unstale":"2024-02-10T08:29:27.093198+0000","last_undegraded":"2024-02-10T08:29:27.093198+0000","last_fullsized":"2024-02-10T08:29:27.093198+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:26:33.798586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:26:33.798586+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"165'10","reported_seq":271,"reported_epoch":278,"state":"active+clean","last_fresh":"2024-02-10T08:29:31.118732+0000","last_change":"2024-02-10T08:26:15.114882+0000","last_active":"2024-02-10T08:29:31.118732+0000","last_peered":"2024-02-10T08:29:31.118732+0000","last_clean":"2024-02-10T08:29:31.118732+0000","last_became_active":"2024-02-10T08:23:15.080370+0000","last_became_peered":"2024-02-10T08:23:15.080370+0000","last_unstale":"2024-02-10T08:29:31.118732+0000","last_undegraded":"2024-02-10T08:29:31.118732+0000","last_fullsized":"2024-02-10T08:29:31.118732+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"165'10","last_scrub_stamp":"2024-02-10T08:26:15.114806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:26:15.114806+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,1],"acting":[7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":203,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.092722+0000","last_change":"2024-02-10T08:27:18.873971+0000","last_active":"2024-02-10T08:29:27.092722+0000","last_peered":"2024-02-10T08:29:27.092722+0000","last_clean":"2024-02-10T08:29:27.092722+0000","last_became_active":"2024-02-10T08:23:34.717015+0000","last_became_peered":"2024-02-10T08:23:34.717015+0000","last_unstale":"2024-02-10T08:29:27.092722+0000","last_undegraded":"2024-02-10T08:29:27.092722+0000","last_fullsized":"2024-02-10T08:29:27.092722+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:27:18.873884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:27:18.873884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"225'19","reported_seq":278,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.090662+0000","last_change":"2024-02-10T08:29:09.148326+0000","last_active":"2024-02-10T08:29:27.090662+0000","last_peered":"2024-02-10T08:29:27.090662+0000","last_clean":"2024-02-10T08:29:27.090662+0000","last_became_active":"2024-02-10T08:16:55.204734+0000","last_became_peered":"2024-02-10T08:16:55.204734+0000","last_unstale":"2024-02-10T08:29:27.090662+0000","last_undegraded":"2024-02-10T08:29:27.090662+0000","last_fullsized":"2024-02-10T08:29:27.090662+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'19","last_scrub_stamp":"2024-02-10T08:29:09.148231+0000","last_deep_scrub":"213'13","last_deep_scrub_stamp":"2024-02-10T08:25:43.713333+0000","last_clean_scrub_stamp":"2024-02-10T08:29:09.148231+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":131,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.087882+0000","last_change":"2024-02-10T08:27:19.286440+0000","last_active":"2024-02-10T08:29:27.087882+0000","last_peered":"2024-02-10T08:29:27.087882+0000","last_clean":"2024-02-10T08:29:27.087882+0000","last_became_active":"2024-02-10T08:23:15.067821+0000","last_became_peered":"2024-02-10T08:23:15.067821+0000","last_unstale":"2024-02-10T08:29:27.087882+0000","last_undegraded":"2024-02-10T08:29:27.087882+0000","last_fullsized":"2024-02-10T08:29:27.087882+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:27:19.286346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:05.662947+0000","last_clean_scrub_stamp":"2024-02-10T08:27:19.286346+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"244'12","reported_seq":449,"reported_epoch":278,"state":"active+clean","last_fresh":"2024-02-10T08:29:31.119358+0000","last_change":"2024-02-10T08:28:16.291133+0000","last_active":"2024-02-10T08:29:31.119358+0000","last_peered":"2024-02-10T08:29:31.119358+0000","last_clean":"2024-02-10T08:29:31.119358+0000","last_became_active":"2024-02-10T08:28:02.776097+0000","last_became_peered":"2024-02-10T08:28:02.776097+0000","last_unstale":"2024-02-10T08:29:31.119358+0000","last_undegraded":"2024-02-10T08:29:31.119358+0000","last_fullsized":"2024-02-10T08:29:31.119358+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"244'12","last_scrub_stamp":"2024-02-10T08:28:16.291055+0000","last_deep_scrub":"89'9","last_deep_scrub_stamp":"2024-02-10T08:19:33.299671+0000","last_clean_scrub_stamp":"2024-02-10T08:28:16.291055+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":251,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.087219+0000","last_change":"2024-02-10T08:28:19.243016+0000","last_active":"2024-02-10T08:29:27.087219+0000","last_peered":"2024-02-10T08:29:27.087219+0000","last_clean":"2024-02-10T08:29:27.087219+0000","last_became_active":"2024-02-10T08:16:52.789834+0000","last_became_peered":"2024-02-10T08:16:52.789834+0000","last_unstale":"2024-02-10T08:29:27.087219+0000","last_undegraded":"2024-02-10T08:29:27.087219+0000","last_fullsized":"2024-02-10T08:29:27.087219+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:19.242936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:28:19.242936+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"225'20","reported_seq":194,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.086400+0000","last_change":"2024-02-10T08:26:14.189385+0000","last_active":"2024-02-10T08:29:27.086400+0000","last_peered":"2024-02-10T08:29:27.086400+0000","last_clean":"2024-02-10T08:29:27.086400+0000","last_became_active":"2024-02-10T08:22:23.534081+0000","last_became_peered":"2024-02-10T08:22:23.534081+0000","last_unstale":"2024-02-10T08:29:27.086400+0000","last_undegraded":"2024-02-10T08:29:27.086400+0000","last_fullsized":"2024-02-10T08:29:27.086400+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'10","last_scrub_stamp":"2024-02-10T08:26:14.187217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:26:14.187217+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":24,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":255,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.086834+0000","last_change":"2024-02-10T08:28:33.229127+0000","last_active":"2024-02-10T08:29:27.086834+0000","last_peered":"2024-02-10T08:29:27.086834+0000","last_clean":"2024-02-10T08:29:27.086834+0000","last_became_active":"2024-02-10T08:20:46.398903+0000","last_became_peered":"2024-02-10T08:20:46.398903+0000","last_unstale":"2024-02-10T08:29:27.086834+0000","last_undegraded":"2024-02-10T08:29:27.086834+0000","last_fullsized":"2024-02-10T08:29:27.086834+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:33.229018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:33.229018+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":247,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.090723+0000","last_change":"2024-02-10T08:29:12.163752+0000","last_active":"2024-02-10T08:29:27.090723+0000","last_peered":"2024-02-10T08:29:27.090723+0000","last_clean":"2024-02-10T08:29:27.090723+0000","last_became_active":"2024-02-10T08:16:56.863948+0000","last_became_peered":"2024-02-10T08:16:56.863948+0000","last_unstale":"2024-02-10T08:29:27.090723+0000","last_undegraded":"2024-02-10T08:29:27.090723+0000","last_fullsized":"2024-02-10T08:29:27.090723+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:12.163638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:12.163638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":304,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.089195+0000","last_change":"2024-02-10T08:28:38.232620+0000","last_active":"2024-02-10T08:29:27.089195+0000","last_peered":"2024-02-10T08:29:27.089195+0000","last_clean":"2024-02-10T08:29:27.089195+0000","last_became_active":"2024-02-10T08:28:38.232339+0000","last_became_peered":"2024-02-10T08:28:38.232339+0000","last_unstale":"2024-02-10T08:29:27.089195+0000","last_undegraded":"2024-02-10T08:29:27.089195+0000","last_fullsized":"2024-02-10T08:29:27.089195+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:25.490611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:28:25.490611+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,5],"acting":[6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"225'15","reported_seq":202,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.085877+0000","last_change":"2024-02-10T08:26:33.158094+0000","last_active":"2024-02-10T08:29:27.085877+0000","last_peered":"2024-02-10T08:29:27.085877+0000","last_clean":"2024-02-10T08:29:27.085877+0000","last_became_active":"2024-02-10T08:23:15.079382+0000","last_became_peered":"2024-02-10T08:23:15.079382+0000","last_unstale":"2024-02-10T08:29:27.085877+0000","last_undegraded":"2024-02-10T08:29:27.085877+0000","last_fullsized":"2024-02-10T08:29:27.085877+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'9","last_scrub_stamp":"2024-02-10T08:26:33.158025+0000","last_deep_scrub":"223'9","last_deep_scrub_stamp":"2024-02-10T08:26:33.158025+0000","last_clean_scrub_stamp":"2024-02-10T08:26:33.158025+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":115,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.082393+0000","last_change":"2024-02-10T08:29:24.514793+0000","last_active":"2024-02-10T08:29:27.082393+0000","last_peered":"2024-02-10T08:29:27.082393+0000","last_clean":"2024-02-10T08:29:27.082393+0000","last_became_active":"2024-02-10T08:28:25.999252+0000","last_became_peered":"2024-02-10T08:28:25.999252+0000","last_unstale":"2024-02-10T08:29:27.082393+0000","last_undegraded":"2024-02-10T08:29:27.082393+0000","last_fullsized":"2024-02-10T08:29:27.082393+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:24.514690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:24.514690+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":181,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.089613+0000","last_change":"2024-02-10T08:28:02.769046+0000","last_active":"2024-02-10T08:29:27.089613+0000","last_peered":"2024-02-10T08:29:27.089613+0000","last_clean":"2024-02-10T08:29:27.089613+0000","last_became_active":"2024-02-10T08:28:02.768667+0000","last_became_peered":"2024-02-10T08:28:02.768667+0000","last_unstale":"2024-02-10T08:29:27.089613+0000","last_undegraded":"2024-02-10T08:29:27.089613+0000","last_fullsized":"2024-02-10T08:29:27.089613+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:26:38.062164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:26:38.062164+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"55'1","reported_seq":279,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.092817+0000","last_change":"2024-02-10T08:28:02.878657+0000","last_active":"2024-02-10T08:29:27.092817+0000","last_peered":"2024-02-10T08:29:27.092817+0000","last_clean":"2024-02-10T08:29:27.092817+0000","last_became_active":"2024-02-10T08:28:02.778857+0000","last_became_peered":"2024-02-10T08:28:02.778857+0000","last_unstale":"2024-02-10T08:29:27.092817+0000","last_undegraded":"2024-02-10T08:29:27.092817+0000","last_fullsized":"2024-02-10T08:29:27.092817+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'1","last_scrub_stamp":"2024-02-10T08:25:28.166655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:25:28.166655+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":716,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"225'15","reported_seq":175,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.087960+0000","last_change":"2024-02-10T08:29:09.329280+0000","last_active":"2024-02-10T08:29:27.087960+0000","last_peered":"2024-02-10T08:29:27.087960+0000","last_clean":"2024-02-10T08:29:27.087960+0000","last_became_active":"2024-02-10T08:23:34.719714+0000","last_became_peered":"2024-02-10T08:23:34.719714+0000","last_unstale":"2024-02-10T08:29:27.087960+0000","last_undegraded":"2024-02-10T08:29:27.087960+0000","last_fullsized":"2024-02-10T08:29:27.087960+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'15","last_scrub_stamp":"2024-02-10T08:29:09.329160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:29:09.329160+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.4","version":"278'5477","reported_seq":5507,"reported_epoch":278,"state":"active+clean","last_fresh":"2024-02-10T08:29:37.705516+0000","last_change":"2024-02-10T08:28:28.529619+0000","last_active":"2024-02-10T08:29:37.705516+0000","last_peered":"2024-02-10T08:29:37.705516+0000","last_clean":"2024-02-10T08:29:37.705516+0000","last_became_active":"2024-02-10T08:28:28.529130+0000","last_became_peered":"2024-02-10T08:28:28.529130+0000","last_unstale":"2024-02-10T08:29:37.705516+0000","last_undegraded":"2024-02-10T08:29:37.705516+0000","last_fullsized":"2024-02-10T08:29:37.705516+0000","mapping_epoch":256,"log_start":"264'1500","ondisk_log_start":"264'1500","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_clean_scrub_stamp":"2024-02-10T08:28:27.172648+0000","log_size":3977,"ondisk_log_size":3977,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358940672,"num_objects":5477,"num_object_clones":0,"num_object_copies":16431,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5477,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5477,"num_write_kb":350528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":152,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.086345+0000","last_change":"2024-02-10T08:26:20.174043+0000","last_active":"2024-02-10T08:29:27.086345+0000","last_peered":"2024-02-10T08:29:27.086345+0000","last_clean":"2024-02-10T08:29:27.086345+0000","last_became_active":"2024-02-10T08:22:23.528310+0000","last_became_peered":"2024-02-10T08:22:23.528310+0000","last_unstale":"2024-02-10T08:29:27.086345+0000","last_undegraded":"2024-02-10T08:29:27.086345+0000","last_fullsized":"2024-02-10T08:29:27.086345+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:26:20.173948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:26:20.173948+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"55'2","reported_seq":267,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.093451+0000","last_change":"2024-02-10T08:29:22.034366+0000","last_active":"2024-02-10T08:29:27.093451+0000","last_peered":"2024-02-10T08:29:27.093451+0000","last_clean":"2024-02-10T08:29:27.093451+0000","last_became_active":"2024-02-10T08:28:02.768279+0000","last_became_peered":"2024-02-10T08:28:02.768279+0000","last_unstale":"2024-02-10T08:29:27.093451+0000","last_undegraded":"2024-02-10T08:29:27.093451+0000","last_fullsized":"2024-02-10T08:29:27.093451+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'2","last_scrub_stamp":"2024-02-10T08:29:22.034268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:29:22.034268+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":184,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"225'23","reported_seq":286,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.092227+0000","last_change":"2024-02-10T08:29:23.027325+0000","last_active":"2024-02-10T08:29:27.092227+0000","last_peered":"2024-02-10T08:29:27.092227+0000","last_clean":"2024-02-10T08:29:27.092227+0000","last_became_active":"2024-02-10T08:23:15.126133+0000","last_became_peered":"2024-02-10T08:23:15.126133+0000","last_unstale":"2024-02-10T08:29:27.092227+0000","last_undegraded":"2024-02-10T08:29:27.092227+0000","last_fullsized":"2024-02-10T08:29:27.092227+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'23","last_scrub_stamp":"2024-02-10T08:29:23.027211+0000","last_deep_scrub":"82'17","last_deep_scrub_stamp":"2024-02-10T08:18:21.015873+0000","last_clean_scrub_stamp":"2024-02-10T08:29:23.027211+0000","log_size":23,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":25,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6],"acting":[4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":266,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.092948+0000","last_change":"2024-02-10T08:29:14.447872+0000","last_active":"2024-02-10T08:29:27.092948+0000","last_peered":"2024-02-10T08:29:27.092948+0000","last_clean":"2024-02-10T08:29:27.092948+0000","last_became_active":"2024-02-10T08:28:02.777637+0000","last_became_peered":"2024-02-10T08:28:02.777637+0000","last_unstale":"2024-02-10T08:29:27.092948+0000","last_undegraded":"2024-02-10T08:29:27.092948+0000","last_fullsized":"2024-02-10T08:29:27.092948+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:14.447807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:14.447807+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.f","version":"278'5535","reported_seq":5565,"reported_epoch":278,"state":"active+clean","last_fresh":"2024-02-10T08:29:37.613149+0000","last_change":"2024-02-10T08:28:28.332012+0000","last_active":"2024-02-10T08:29:37.613149+0000","last_peered":"2024-02-10T08:29:37.613149+0000","last_clean":"2024-02-10T08:29:37.613149+0000","last_became_active":"2024-02-10T08:28:28.331729+0000","last_became_peered":"2024-02-10T08:28:28.331729+0000","last_unstale":"2024-02-10T08:29:37.613149+0000","last_undegraded":"2024-02-10T08:29:37.613149+0000","last_fullsized":"2024-02-10T08:29:37.613149+0000","mapping_epoch":256,"log_start":"262'1100","ondisk_log_start":"262'1100","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_clean_scrub_stamp":"2024-02-10T08:28:27.172648+0000","log_size":4435,"ondisk_log_size":4435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":362741760,"num_objects":5535,"num_object_clones":0,"num_object_copies":16605,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5535,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5535,"num_write_kb":354240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,2],"acting":[5,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":171,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.082641+0000","last_change":"2024-02-10T08:29:14.538007+0000","last_active":"2024-02-10T08:29:27.082641+0000","last_peered":"2024-02-10T08:29:27.082641+0000","last_clean":"2024-02-10T08:29:27.082641+0000","last_became_active":"2024-02-10T08:28:25.950240+0000","last_became_peered":"2024-02-10T08:28:25.950240+0000","last_unstale":"2024-02-10T08:29:27.082641+0000","last_undegraded":"2024-02-10T08:29:27.082641+0000","last_fullsized":"2024-02-10T08:29:27.082641+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:14.537940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:14.537940+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":265,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.086296+0000","last_change":"2024-02-10T08:28:21.409185+0000","last_active":"2024-02-10T08:29:27.086296+0000","last_peered":"2024-02-10T08:29:27.086296+0000","last_clean":"2024-02-10T08:29:27.086296+0000","last_became_active":"2024-02-10T08:28:02.760784+0000","last_became_peered":"2024-02-10T08:28:02.760784+0000","last_unstale":"2024-02-10T08:29:27.086296+0000","last_undegraded":"2024-02-10T08:29:27.086296+0000","last_fullsized":"2024-02-10T08:29:27.086296+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:21.409109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:28:21.409109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"225'20","reported_seq":290,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.085943+0000","last_change":"2024-02-10T08:29:11.695106+0000","last_active":"2024-02-10T08:29:27.085943+0000","last_peered":"2024-02-10T08:29:27.085943+0000","last_clean":"2024-02-10T08:29:27.085943+0000","last_became_active":"2024-02-10T08:20:46.408495+0000","last_became_peered":"2024-02-10T08:20:46.408495+0000","last_unstale":"2024-02-10T08:29:27.085943+0000","last_undegraded":"2024-02-10T08:29:27.085943+0000","last_fullsized":"2024-02-10T08:29:27.085943+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'20","last_scrub_stamp":"2024-02-10T08:29:11.694999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:29:11.694999+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"255'12","reported_seq":122,"reported_epoch":278,"state":"active+clean","last_fresh":"2024-02-10T08:29:31.118453+0000","last_change":"2024-02-10T08:28:25.952833+0000","last_active":"2024-02-10T08:29:31.118453+0000","last_peered":"2024-02-10T08:29:31.118453+0000","last_clean":"2024-02-10T08:29:31.118453+0000","last_became_active":"2024-02-10T08:28:25.952468+0000","last_became_peered":"2024-02-10T08:28:25.952468+0000","last_unstale":"2024-02-10T08:29:31.118453+0000","last_undegraded":"2024-02-10T08:29:31.118453+0000","last_fullsized":"2024-02-10T08:29:31.118453+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"244'11","last_scrub_stamp":"2024-02-10T08:28:18.492203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:28:18.492203+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.9","version":"278'5733","reported_seq":5763,"reported_epoch":278,"state":"active+clean","last_fresh":"2024-02-10T08:29:38.088407+0000","last_change":"2024-02-10T08:28:28.190881+0000","last_active":"2024-02-10T08:29:38.088407+0000","last_peered":"2024-02-10T08:29:38.088407+0000","last_clean":"2024-02-10T08:29:38.088407+0000","last_became_active":"2024-02-10T08:28:28.190530+0000","last_became_peered":"2024-02-10T08:28:28.190530+0000","last_unstale":"2024-02-10T08:29:38.088407+0000","last_undegraded":"2024-02-10T08:29:38.088407+0000","last_fullsized":"2024-02-10T08:29:38.088407+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_clean_scrub_stamp":"2024-02-10T08:28:27.172648+0000","log_size":5733,"ondisk_log_size":5733,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":375717888,"num_objects":5733,"num_object_clones":0,"num_object_copies":17199,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5733,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5733,"num_write_kb":366912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,5],"acting":[0,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":261,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.093128+0000","last_change":"2024-02-10T08:28:26.013133+0000","last_active":"2024-02-10T08:29:27.093128+0000","last_peered":"2024-02-10T08:29:27.093128+0000","last_clean":"2024-02-10T08:29:27.093128+0000","last_became_active":"2024-02-10T08:23:34.716482+0000","last_became_peered":"2024-02-10T08:23:34.716482+0000","last_unstale":"2024-02-10T08:29:27.093128+0000","last_undegraded":"2024-02-10T08:29:27.093128+0000","last_fullsized":"2024-02-10T08:29:27.093128+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:26.013060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:26.013060+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":251,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.087287+0000","last_change":"2024-02-10T08:29:11.165779+0000","last_active":"2024-02-10T08:29:27.087287+0000","last_peered":"2024-02-10T08:29:27.087287+0000","last_clean":"2024-02-10T08:29:27.087287+0000","last_became_active":"2024-02-10T08:16:52.791027+0000","last_became_peered":"2024-02-10T08:16:52.791027+0000","last_unstale":"2024-02-10T08:29:27.087287+0000","last_undegraded":"2024-02-10T08:29:27.087287+0000","last_fullsized":"2024-02-10T08:29:27.087287+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:11.165678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:29:11.165678+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"225'41","reported_seq":500,"reported_epoch":278,"state":"active+clean","last_fresh":"2024-02-10T08:29:31.118450+0000","last_change":"2024-02-10T08:28:22.455298+0000","last_active":"2024-02-10T08:29:31.118450+0000","last_peered":"2024-02-10T08:29:31.118450+0000","last_clean":"2024-02-10T08:29:31.118450+0000","last_became_active":"2024-02-10T08:23:34.709222+0000","last_became_peered":"2024-02-10T08:23:34.709222+0000","last_unstale":"2024-02-10T08:29:31.118450+0000","last_undegraded":"2024-02-10T08:29:31.118450+0000","last_fullsized":"2024-02-10T08:29:31.118450+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'41","last_scrub_stamp":"2024-02-10T08:28:22.455139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:28:22.455139+0000","log_size":41,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":66,"num_read_kb":51,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":358,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":207,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.089571+0000","last_change":"2024-02-10T08:29:26.703538+0000","last_active":"2024-02-10T08:29:27.089571+0000","last_peered":"2024-02-10T08:29:27.089571+0000","last_clean":"2024-02-10T08:29:27.089571+0000","last_became_active":"2024-02-10T08:23:15.081822+0000","last_became_peered":"2024-02-10T08:23:15.081822+0000","last_unstale":"2024-02-10T08:29:27.089571+0000","last_undegraded":"2024-02-10T08:29:27.089571+0000","last_fullsized":"2024-02-10T08:29:27.089571+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:26.703441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:26.703441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,6],"acting":[1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.a","version":"278'5692","reported_seq":5722,"reported_epoch":278,"state":"active+clean","last_fresh":"2024-02-10T08:29:37.619496+0000","last_change":"2024-02-10T08:28:28.186010+0000","last_active":"2024-02-10T08:29:37.619496+0000","last_peered":"2024-02-10T08:29:37.619496+0000","last_clean":"2024-02-10T08:29:37.619496+0000","last_became_active":"2024-02-10T08:28:28.185721+0000","last_became_peered":"2024-02-10T08:28:28.185721+0000","last_unstale":"2024-02-10T08:29:37.619496+0000","last_undegraded":"2024-02-10T08:29:37.619496+0000","last_fullsized":"2024-02-10T08:29:37.619496+0000","mapping_epoch":256,"log_start":"263'1300","ondisk_log_start":"263'1300","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_clean_scrub_stamp":"2024-02-10T08:28:27.172648+0000","log_size":4392,"ondisk_log_size":4392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":373030912,"num_objects":5692,"num_object_clones":0,"num_object_copies":17076,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5692,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5692,"num_write_kb":364288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":255,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.087026+0000","last_change":"2024-02-10T08:28:16.113780+0000","last_active":"2024-02-10T08:29:27.087026+0000","last_peered":"2024-02-10T08:29:27.087026+0000","last_clean":"2024-02-10T08:29:27.087026+0000","last_became_active":"2024-02-10T08:21:58.549733+0000","last_became_peered":"2024-02-10T08:21:58.549733+0000","last_unstale":"2024-02-10T08:29:27.087026+0000","last_undegraded":"2024-02-10T08:29:27.087026+0000","last_fullsized":"2024-02-10T08:29:27.087026+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:16.113690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:11.750537+0000","last_clean_scrub_stamp":"2024-02-10T08:28:16.113690+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"63'5","reported_seq":1005,"reported_epoch":278,"state":"active+clean","last_fresh":"2024-02-10T08:29:35.994031+0000","last_change":"2024-02-10T08:25:43.009500+0000","last_active":"2024-02-10T08:29:35.994031+0000","last_peered":"2024-02-10T08:29:35.994031+0000","last_clean":"2024-02-10T08:29:35.994031+0000","last_became_active":"2024-02-10T08:16:52.780989+0000","last_became_peered":"2024-02-10T08:16:52.780989+0000","last_unstale":"2024-02-10T08:29:35.994031+0000","last_undegraded":"2024-02-10T08:29:35.994031+0000","last_fullsized":"2024-02-10T08:29:35.994031+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'5","last_scrub_stamp":"2024-02-10T08:25:43.009394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:25:43.009394+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":755,"num_read_kb":750,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":279,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.090937+0000","last_change":"2024-02-10T08:28:35.476480+0000","last_active":"2024-02-10T08:29:27.090937+0000","last_peered":"2024-02-10T08:29:27.090937+0000","last_clean":"2024-02-10T08:29:27.090937+0000","last_became_active":"2024-02-10T08:28:02.788789+0000","last_became_peered":"2024-02-10T08:28:02.788789+0000","last_unstale":"2024-02-10T08:29:27.090937+0000","last_undegraded":"2024-02-10T08:29:27.090937+0000","last_fullsized":"2024-02-10T08:29:27.090937+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:35.476417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:11.681169+0000","last_clean_scrub_stamp":"2024-02-10T08:28:35.476417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"225'17","reported_seq":139,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.089510+0000","last_change":"2024-02-10T08:28:38.619626+0000","last_active":"2024-02-10T08:29:27.089510+0000","last_peered":"2024-02-10T08:29:27.089510+0000","last_clean":"2024-02-10T08:29:27.089510+0000","last_became_active":"2024-02-10T08:23:34.729593+0000","last_became_peered":"2024-02-10T08:23:34.729593+0000","last_unstale":"2024-02-10T08:29:27.089510+0000","last_undegraded":"2024-02-10T08:29:27.089510+0000","last_fullsized":"2024-02-10T08:29:27.089510+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'17","last_scrub_stamp":"2024-02-10T08:28:38.619521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:28:38.619521+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":35,"num_read_kb":24,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":248,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.093533+0000","last_change":"2024-02-10T08:29:23.504992+0000","last_active":"2024-02-10T08:29:27.093533+0000","last_peered":"2024-02-10T08:29:27.093533+0000","last_clean":"2024-02-10T08:29:27.093533+0000","last_became_active":"2024-02-10T08:16:56.857856+0000","last_became_peered":"2024-02-10T08:16:56.857856+0000","last_unstale":"2024-02-10T08:29:27.093533+0000","last_undegraded":"2024-02-10T08:29:27.093533+0000","last_fullsized":"2024-02-10T08:29:27.093533+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:23.504892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:23.504892+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.8","version":"278'5634","reported_seq":5663,"reported_epoch":278,"state":"active+clean","last_fresh":"2024-02-10T08:29:38.141448+0000","last_change":"2024-02-10T08:28:28.191187+0000","last_active":"2024-02-10T08:29:38.141448+0000","last_peered":"2024-02-10T08:29:38.141448+0000","last_clean":"2024-02-10T08:29:38.141448+0000","last_became_active":"2024-02-10T08:28:28.190724+0000","last_became_peered":"2024-02-10T08:28:28.190724+0000","last_unstale":"2024-02-10T08:29:38.141448+0000","last_undegraded":"2024-02-10T08:29:38.141448+0000","last_fullsized":"2024-02-10T08:29:38.141448+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_clean_scrub_stamp":"2024-02-10T08:28:27.172648+0000","log_size":5634,"ondisk_log_size":5634,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":369229824,"num_objects":5634,"num_object_clones":0,"num_object_copies":16902,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5634,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5634,"num_write_kb":360576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":264,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.090321+0000","last_change":"2024-02-10T08:29:25.198375+0000","last_active":"2024-02-10T08:29:27.090321+0000","last_peered":"2024-02-10T08:29:27.090321+0000","last_clean":"2024-02-10T08:29:27.090321+0000","last_became_active":"2024-02-10T08:21:58.560646+0000","last_became_peered":"2024-02-10T08:21:58.560646+0000","last_unstale":"2024-02-10T08:29:27.090321+0000","last_undegraded":"2024-02-10T08:29:27.090321+0000","last_fullsized":"2024-02-10T08:29:27.090321+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:25.198277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:26:29.921562+0000","last_clean_scrub_stamp":"2024-02-10T08:29:25.198277+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":166,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.087398+0000","last_change":"2024-02-10T08:28:35.177207+0000","last_active":"2024-02-10T08:29:27.087398+0000","last_peered":"2024-02-10T08:29:27.087398+0000","last_clean":"2024-02-10T08:29:27.087398+0000","last_became_active":"2024-02-10T08:23:34.712122+0000","last_became_peered":"2024-02-10T08:23:34.712122+0000","last_unstale":"2024-02-10T08:29:27.087398+0000","last_undegraded":"2024-02-10T08:29:27.087398+0000","last_fullsized":"2024-02-10T08:29:27.087398+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:35.177138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:28:35.177138+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,4],"acting":[5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":251,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.089766+0000","last_change":"2024-02-10T08:29:06.087344+0000","last_active":"2024-02-10T08:29:27.089766+0000","last_peered":"2024-02-10T08:29:27.089766+0000","last_clean":"2024-02-10T08:29:27.089766+0000","last_became_active":"2024-02-10T08:16:52.788767+0000","last_became_peered":"2024-02-10T08:16:52.788767+0000","last_unstale":"2024-02-10T08:29:27.089766+0000","last_undegraded":"2024-02-10T08:29:27.089766+0000","last_fullsized":"2024-02-10T08:29:27.089766+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:06.087258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:29:06.087258+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":266,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.084776+0000","last_change":"2024-02-10T08:26:24.214276+0000","last_active":"2024-02-10T08:29:27.084776+0000","last_peered":"2024-02-10T08:29:27.084776+0000","last_clean":"2024-02-10T08:29:27.084776+0000","last_became_active":"2024-02-10T08:23:34.717837+0000","last_became_peered":"2024-02-10T08:23:34.717837+0000","last_unstale":"2024-02-10T08:29:27.084776+0000","last_undegraded":"2024-02-10T08:29:27.084776+0000","last_fullsized":"2024-02-10T08:29:27.084776+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:26:24.214179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:14:44.584370+0000","last_clean_scrub_stamp":"2024-02-10T08:26:24.214179+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"225'33","reported_seq":311,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.091567+0000","last_change":"2024-02-10T08:29:20.522358+0000","last_active":"2024-02-10T08:29:27.091567+0000","last_peered":"2024-02-10T08:29:27.091567+0000","last_clean":"2024-02-10T08:29:27.091567+0000","last_became_active":"2024-02-10T08:20:46.401981+0000","last_became_peered":"2024-02-10T08:20:46.401981+0000","last_unstale":"2024-02-10T08:29:27.091567+0000","last_undegraded":"2024-02-10T08:29:27.091567+0000","last_fullsized":"2024-02-10T08:29:27.091567+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'33","last_scrub_stamp":"2024-02-10T08:29:20.522259+0000","last_deep_scrub":"223'21","last_deep_scrub_stamp":"2024-02-10T08:26:33.250614+0000","last_clean_scrub_stamp":"2024-02-10T08:29:20.522259+0000","log_size":33,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":33,"num_write":25,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":247,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.084696+0000","last_change":"2024-02-10T08:29:13.416528+0000","last_active":"2024-02-10T08:29:27.084696+0000","last_peered":"2024-02-10T08:29:27.084696+0000","last_clean":"2024-02-10T08:29:27.084696+0000","last_became_active":"2024-02-10T08:16:56.867159+0000","last_became_peered":"2024-02-10T08:16:56.867159+0000","last_unstale":"2024-02-10T08:29:27.084696+0000","last_undegraded":"2024-02-10T08:29:27.084696+0000","last_fullsized":"2024-02-10T08:29:27.084696+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:13.416461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:04.766780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:13.416461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.b","version":"278'5755","reported_seq":5785,"reported_epoch":278,"state":"active+clean","last_fresh":"2024-02-10T08:29:37.571429+0000","last_change":"2024-02-10T08:28:28.331854+0000","last_active":"2024-02-10T08:29:37.571429+0000","last_peered":"2024-02-10T08:29:37.571429+0000","last_clean":"2024-02-10T08:29:37.571429+0000","last_became_active":"2024-02-10T08:28:28.331529+0000","last_became_peered":"2024-02-10T08:28:28.331529+0000","last_unstale":"2024-02-10T08:29:37.571429+0000","last_undegraded":"2024-02-10T08:29:37.571429+0000","last_fullsized":"2024-02-10T08:29:37.571429+0000","mapping_epoch":256,"log_start":"262'1100","ondisk_log_start":"262'1100","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_clean_scrub_stamp":"2024-02-10T08:28:27.172648+0000","log_size":4655,"ondisk_log_size":4655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":377159680,"num_objects":5755,"num_object_clones":0,"num_object_copies":17265,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5755,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5755,"num_write_kb":368320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":263,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.086560+0000","last_change":"2024-02-10T08:28:19.044189+0000","last_active":"2024-02-10T08:29:27.086560+0000","last_peered":"2024-02-10T08:29:27.086560+0000","last_clean":"2024-02-10T08:29:27.086560+0000","last_became_active":"2024-02-10T08:28:19.022399+0000","last_became_peered":"2024-02-10T08:28:19.022399+0000","last_unstale":"2024-02-10T08:29:27.086560+0000","last_undegraded":"2024-02-10T08:29:27.086560+0000","last_fullsized":"2024-02-10T08:29:27.086560+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:09.785096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:20:09.785096+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":225,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.083432+0000","last_change":"2024-02-10T08:29:06.426493+0000","last_active":"2024-02-10T08:29:27.083432+0000","last_peered":"2024-02-10T08:29:27.083432+0000","last_clean":"2024-02-10T08:29:27.083432+0000","last_became_active":"2024-02-10T08:28:38.233974+0000","last_became_peered":"2024-02-10T08:28:38.233974+0000","last_unstale":"2024-02-10T08:29:27.083432+0000","last_undegraded":"2024-02-10T08:29:27.083432+0000","last_fullsized":"2024-02-10T08:29:27.083432+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:06.426390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:20.736224+0000","last_clean_scrub_stamp":"2024-02-10T08:29:06.426390+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":264,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.084633+0000","last_change":"2024-02-10T08:28:02.761385+0000","last_active":"2024-02-10T08:29:27.084633+0000","last_peered":"2024-02-10T08:29:27.084633+0000","last_clean":"2024-02-10T08:29:27.084633+0000","last_became_active":"2024-02-10T08:28:02.760999+0000","last_became_peered":"2024-02-10T08:28:02.760999+0000","last_unstale":"2024-02-10T08:29:27.084633+0000","last_undegraded":"2024-02-10T08:29:27.084633+0000","last_fullsized":"2024-02-10T08:29:27.084633+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:26:31.161639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:26:31.161639+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"225'24","reported_seq":193,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.093626+0000","last_change":"2024-02-10T08:28:26.505341+0000","last_active":"2024-02-10T08:29:27.093626+0000","last_peered":"2024-02-10T08:29:27.093626+0000","last_clean":"2024-02-10T08:29:27.093626+0000","last_became_active":"2024-02-10T08:23:15.077476+0000","last_became_peered":"2024-02-10T08:23:15.077476+0000","last_unstale":"2024-02-10T08:29:27.093626+0000","last_undegraded":"2024-02-10T08:29:27.093626+0000","last_fullsized":"2024-02-10T08:29:27.093626+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'24","last_scrub_stamp":"2024-02-10T08:28:26.505270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:28:26.505270+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,7],"acting":[1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":269,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.090403+0000","last_change":"2024-02-10T08:29:14.145590+0000","last_active":"2024-02-10T08:29:27.090403+0000","last_peered":"2024-02-10T08:29:27.090403+0000","last_clean":"2024-02-10T08:29:27.090403+0000","last_became_active":"2024-02-10T08:28:02.772585+0000","last_became_peered":"2024-02-10T08:28:02.772585+0000","last_unstale":"2024-02-10T08:29:27.090403+0000","last_undegraded":"2024-02-10T08:29:27.090403+0000","last_fullsized":"2024-02-10T08:29:27.090403+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:14.145493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:41.360241+0000","last_clean_scrub_stamp":"2024-02-10T08:29:14.145493+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.e","version":"278'5568","reported_seq":5598,"reported_epoch":278,"state":"active+clean","last_fresh":"2024-02-10T08:29:37.603631+0000","last_change":"2024-02-10T08:28:28.188744+0000","last_active":"2024-02-10T08:29:37.603631+0000","last_peered":"2024-02-10T08:29:37.603631+0000","last_clean":"2024-02-10T08:29:37.603631+0000","last_became_active":"2024-02-10T08:28:28.188416+0000","last_became_peered":"2024-02-10T08:28:28.188416+0000","last_unstale":"2024-02-10T08:29:37.603631+0000","last_undegraded":"2024-02-10T08:29:37.603631+0000","last_fullsized":"2024-02-10T08:29:37.603631+0000","mapping_epoch":256,"log_start":"264'1700","ondisk_log_start":"264'1700","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_clean_scrub_stamp":"2024-02-10T08:28:27.172648+0000","log_size":3868,"ondisk_log_size":3868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":364904448,"num_objects":5568,"num_object_clones":0,"num_object_copies":16704,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5568,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5568,"num_write_kb":356352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":250,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.081119+0000","last_change":"2024-02-10T08:28:39.633777+0000","last_active":"2024-02-10T08:29:27.081119+0000","last_peered":"2024-02-10T08:29:27.081119+0000","last_clean":"2024-02-10T08:29:27.081119+0000","last_became_active":"2024-02-10T08:21:58.553966+0000","last_became_peered":"2024-02-10T08:21:58.553966+0000","last_unstale":"2024-02-10T08:29:27.081119+0000","last_undegraded":"2024-02-10T08:29:27.081119+0000","last_fullsized":"2024-02-10T08:29:27.081119+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:39.633627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:39.633627+0000","last_clean_scrub_stamp":"2024-02-10T08:28:39.633627+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":240,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.091484+0000","last_change":"2024-02-10T08:27:27.094310+0000","last_active":"2024-02-10T08:29:27.091484+0000","last_peered":"2024-02-10T08:29:27.091484+0000","last_clean":"2024-02-10T08:29:27.091484+0000","last_became_active":"2024-02-10T08:23:34.708387+0000","last_became_peered":"2024-02-10T08:23:34.708387+0000","last_unstale":"2024-02-10T08:29:27.091484+0000","last_undegraded":"2024-02-10T08:29:27.091484+0000","last_fullsized":"2024-02-10T08:29:27.091484+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:27:27.094240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:27:27.094240+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"225'37","reported_seq":343,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.082583+0000","last_change":"2024-02-10T08:28:33.205966+0000","last_active":"2024-02-10T08:29:27.082583+0000","last_peered":"2024-02-10T08:29:27.082583+0000","last_clean":"2024-02-10T08:29:27.082583+0000","last_became_active":"2024-02-10T08:28:25.951447+0000","last_became_peered":"2024-02-10T08:28:25.951447+0000","last_unstale":"2024-02-10T08:29:27.082583+0000","last_undegraded":"2024-02-10T08:29:27.082583+0000","last_fullsized":"2024-02-10T08:29:27.082583+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'37","last_scrub_stamp":"2024-02-10T08:28:33.205891+0000","last_deep_scrub":"199'27","last_deep_scrub_stamp":"2024-02-10T08:24:42.826442+0000","last_clean_scrub_stamp":"2024-02-10T08:28:33.205891+0000","log_size":37,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":53,"num_read_kb":39,"num_write":32,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":265,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.088921+0000","last_change":"2024-02-10T08:29:11.420173+0000","last_active":"2024-02-10T08:29:27.088921+0000","last_peered":"2024-02-10T08:29:27.088921+0000","last_clean":"2024-02-10T08:29:27.088921+0000","last_became_active":"2024-02-10T08:28:02.769069+0000","last_became_peered":"2024-02-10T08:28:02.769069+0000","last_unstale":"2024-02-10T08:29:27.088921+0000","last_undegraded":"2024-02-10T08:29:27.088921+0000","last_fullsized":"2024-02-10T08:29:27.088921+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:11.420031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:11.420031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.d","version":"278'5626","reported_seq":5656,"reported_epoch":278,"state":"active+clean","last_fresh":"2024-02-10T08:29:37.598608+0000","last_change":"2024-02-10T08:28:28.188686+0000","last_active":"2024-02-10T08:29:37.598608+0000","last_peered":"2024-02-10T08:29:37.598608+0000","last_clean":"2024-02-10T08:29:37.598608+0000","last_became_active":"2024-02-10T08:28:28.188347+0000","last_became_peered":"2024-02-10T08:28:28.188347+0000","last_unstale":"2024-02-10T08:29:37.598608+0000","last_undegraded":"2024-02-10T08:29:37.598608+0000","last_fullsized":"2024-02-10T08:29:37.598608+0000","mapping_epoch":256,"log_start":"264'1700","ondisk_log_start":"264'1700","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_clean_scrub_stamp":"2024-02-10T08:28:27.172648+0000","log_size":3926,"ondisk_log_size":3926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":368705536,"num_objects":5626,"num_object_clones":0,"num_object_copies":16878,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5626,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5626,"num_write_kb":360064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,5],"acting":[7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":246,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.092601+0000","last_change":"2024-02-10T08:28:22.016781+0000","last_active":"2024-02-10T08:29:27.092601+0000","last_peered":"2024-02-10T08:29:27.092601+0000","last_clean":"2024-02-10T08:29:27.092601+0000","last_became_active":"2024-02-10T08:23:15.074239+0000","last_became_peered":"2024-02-10T08:23:15.074239+0000","last_unstale":"2024-02-10T08:29:27.092601+0000","last_undegraded":"2024-02-10T08:29:27.092601+0000","last_fullsized":"2024-02-10T08:29:27.092601+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:22.016693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:22.016693+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":262,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.093435+0000","last_change":"2024-02-10T08:29:04.701249+0000","last_active":"2024-02-10T08:29:27.093435+0000","last_peered":"2024-02-10T08:29:27.093435+0000","last_clean":"2024-02-10T08:29:27.093435+0000","last_became_active":"2024-02-10T08:20:46.407667+0000","last_became_peered":"2024-02-10T08:20:46.407667+0000","last_unstale":"2024-02-10T08:29:27.093435+0000","last_undegraded":"2024-02-10T08:29:27.093435+0000","last_fullsized":"2024-02-10T08:29:27.093435+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:04.701160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:29:04.701160+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"225'30","reported_seq":254,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.085236+0000","last_change":"2024-02-10T08:28:35.245725+0000","last_active":"2024-02-10T08:29:27.085236+0000","last_peered":"2024-02-10T08:29:27.085236+0000","last_clean":"2024-02-10T08:29:27.085236+0000","last_became_active":"2024-02-10T08:23:15.079674+0000","last_became_peered":"2024-02-10T08:23:15.079674+0000","last_unstale":"2024-02-10T08:29:27.085236+0000","last_undegraded":"2024-02-10T08:29:27.085236+0000","last_fullsized":"2024-02-10T08:29:27.085236+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'30","last_scrub_stamp":"2024-02-10T08:28:35.245660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:28:35.245660+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":51,"num_read_kb":39,"num_write":32,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,5],"acting":[7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":233,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.092434+0000","last_change":"2024-02-10T08:29:27.021175+0000","last_active":"2024-02-10T08:29:27.092434+0000","last_peered":"2024-02-10T08:29:27.092434+0000","last_clean":"2024-02-10T08:29:27.092434+0000","last_became_active":"2024-02-10T08:23:34.706206+0000","last_became_peered":"2024-02-10T08:23:34.706206+0000","last_unstale":"2024-02-10T08:29:27.092434+0000","last_undegraded":"2024-02-10T08:29:27.092434+0000","last_fullsized":"2024-02-10T08:29:27.092434+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:27.021108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:27.021108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,5],"acting":[4,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.c","version":"278'5748","reported_seq":5778,"reported_epoch":278,"state":"active+clean","last_fresh":"2024-02-10T08:29:39.888330+0000","last_change":"2024-02-10T08:28:28.529419+0000","last_active":"2024-02-10T08:29:39.888330+0000","last_peered":"2024-02-10T08:29:39.888330+0000","last_clean":"2024-02-10T08:29:39.888330+0000","last_became_active":"2024-02-10T08:28:28.529047+0000","last_became_peered":"2024-02-10T08:28:28.529047+0000","last_unstale":"2024-02-10T08:29:39.888330+0000","last_undegraded":"2024-02-10T08:29:39.888330+0000","last_fullsized":"2024-02-10T08:29:39.888330+0000","mapping_epoch":256,"log_start":"261'300","ondisk_log_start":"261'300","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_clean_scrub_stamp":"2024-02-10T08:28:27.172648+0000","log_size":5448,"ondisk_log_size":5448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":376700928,"num_objects":5748,"num_object_clones":0,"num_object_copies":17244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5748,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5748,"num_write_kb":367872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":249,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.086639+0000","last_change":"2024-02-10T08:28:17.059779+0000","last_active":"2024-02-10T08:29:27.086639+0000","last_peered":"2024-02-10T08:29:27.086639+0000","last_clean":"2024-02-10T08:29:27.086639+0000","last_became_active":"2024-02-10T08:21:58.546976+0000","last_became_peered":"2024-02-10T08:21:58.546976+0000","last_unstale":"2024-02-10T08:29:27.086639+0000","last_undegraded":"2024-02-10T08:29:27.086639+0000","last_fullsized":"2024-02-10T08:29:27.086639+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:17.059697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:17.059697+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":251,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.091418+0000","last_change":"2024-02-10T08:29:03.396846+0000","last_active":"2024-02-10T08:29:27.091418+0000","last_peered":"2024-02-10T08:29:27.091418+0000","last_clean":"2024-02-10T08:29:27.091418+0000","last_became_active":"2024-02-10T08:16:52.789020+0000","last_became_peered":"2024-02-10T08:16:52.789020+0000","last_unstale":"2024-02-10T08:29:27.091418+0000","last_undegraded":"2024-02-10T08:29:27.091418+0000","last_fullsized":"2024-02-10T08:29:27.091418+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:03.396727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:29:03.396727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"225'28","reported_seq":264,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.092360+0000","last_change":"2024-02-10T08:29:24.036552+0000","last_active":"2024-02-10T08:29:27.092360+0000","last_peered":"2024-02-10T08:29:27.092360+0000","last_clean":"2024-02-10T08:29:27.092360+0000","last_became_active":"2024-02-10T08:20:46.400760+0000","last_became_peered":"2024-02-10T08:20:46.400760+0000","last_unstale":"2024-02-10T08:29:27.092360+0000","last_undegraded":"2024-02-10T08:29:27.092360+0000","last_fullsized":"2024-02-10T08:29:27.092360+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'28","last_scrub_stamp":"2024-02-10T08:29:24.036448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:29:24.036448+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":41,"num_read_kb":34,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"199'13","reported_seq":277,"reported_epoch":278,"state":"active+clean","last_fresh":"2024-02-10T08:29:31.118511+0000","last_change":"2024-02-10T08:29:15.700537+0000","last_active":"2024-02-10T08:29:31.118511+0000","last_peered":"2024-02-10T08:29:31.118511+0000","last_clean":"2024-02-10T08:29:31.118511+0000","last_became_active":"2024-02-10T08:23:34.711450+0000","last_became_peered":"2024-02-10T08:23:34.711450+0000","last_unstale":"2024-02-10T08:29:31.118511+0000","last_undegraded":"2024-02-10T08:29:31.118511+0000","last_fullsized":"2024-02-10T08:29:31.118511+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"199'13","last_scrub_stamp":"2024-02-10T08:29:15.700463+0000","last_deep_scrub":"199'13","last_deep_scrub_stamp":"2024-02-10T08:24:47.529439+0000","last_clean_scrub_stamp":"2024-02-10T08:29:15.700463+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,2],"acting":[1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"278'5567","reported_seq":5597,"reported_epoch":278,"state":"active+clean","last_fresh":"2024-02-10T08:29:37.626440+0000","last_change":"2024-02-10T08:28:28.529385+0000","last_active":"2024-02-10T08:29:37.626440+0000","last_peered":"2024-02-10T08:29:37.626440+0000","last_clean":"2024-02-10T08:29:37.626440+0000","last_became_active":"2024-02-10T08:28:28.529058+0000","last_became_peered":"2024-02-10T08:28:28.529058+0000","last_unstale":"2024-02-10T08:29:37.626440+0000","last_undegraded":"2024-02-10T08:29:37.626440+0000","last_fullsized":"2024-02-10T08:29:37.626440+0000","mapping_epoch":256,"log_start":"264'1700","ondisk_log_start":"264'1700","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_clean_scrub_stamp":"2024-02-10T08:28:27.172648+0000","log_size":3867,"ondisk_log_size":3867,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":364838912,"num_objects":5567,"num_object_clones":0,"num_object_copies":16701,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5567,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5567,"num_write_kb":356288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":166,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.090901+0000","last_change":"2024-02-10T08:29:15.491820+0000","last_active":"2024-02-10T08:29:27.090901+0000","last_peered":"2024-02-10T08:29:27.090901+0000","last_clean":"2024-02-10T08:29:27.090901+0000","last_became_active":"2024-02-10T08:23:34.716306+0000","last_became_peered":"2024-02-10T08:23:34.716306+0000","last_unstale":"2024-02-10T08:29:27.090901+0000","last_undegraded":"2024-02-10T08:29:27.090901+0000","last_fullsized":"2024-02-10T08:29:27.090901+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:15.491747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:20:30.227375+0000","last_clean_scrub_stamp":"2024-02-10T08:29:15.491747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,7],"acting":[6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":307,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.090262+0000","last_change":"2024-02-10T08:28:18.284825+0000","last_active":"2024-02-10T08:29:27.090262+0000","last_peered":"2024-02-10T08:29:27.090262+0000","last_clean":"2024-02-10T08:29:27.090262+0000","last_became_active":"2024-02-10T08:20:46.400500+0000","last_became_peered":"2024-02-10T08:20:46.400500+0000","last_unstale":"2024-02-10T08:29:27.090262+0000","last_undegraded":"2024-02-10T08:29:27.090262+0000","last_fullsized":"2024-02-10T08:29:27.090262+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:18.284751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:28:18.284751+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":264,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.084854+0000","last_change":"2024-02-10T08:28:02.768983+0000","last_active":"2024-02-10T08:29:27.084854+0000","last_peered":"2024-02-10T08:29:27.084854+0000","last_clean":"2024-02-10T08:29:27.084854+0000","last_became_active":"2024-02-10T08:28:02.768633+0000","last_became_peered":"2024-02-10T08:28:02.768633+0000","last_unstale":"2024-02-10T08:29:27.084854+0000","last_undegraded":"2024-02-10T08:29:27.084854+0000","last_fullsized":"2024-02-10T08:29:27.084854+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:25:37.371542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:25:37.371542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"225'24","reported_seq":268,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.093392+0000","last_change":"2024-02-10T08:28:18.012177+0000","last_active":"2024-02-10T08:29:27.093392+0000","last_peered":"2024-02-10T08:29:27.093392+0000","last_clean":"2024-02-10T08:29:27.093392+0000","last_became_active":"2024-02-10T08:20:46.406023+0000","last_became_peered":"2024-02-10T08:20:46.406023+0000","last_unstale":"2024-02-10T08:29:27.093392+0000","last_undegraded":"2024-02-10T08:29:27.093392+0000","last_fullsized":"2024-02-10T08:29:27.093392+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'24","last_scrub_stamp":"2024-02-10T08:28:18.012102+0000","last_deep_scrub":"76'16","last_deep_scrub_stamp":"2024-02-10T08:18:07.909782+0000","last_clean_scrub_stamp":"2024-02-10T08:28:18.012102+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"278'5625","reported_seq":5655,"reported_epoch":278,"state":"active+clean","last_fresh":"2024-02-10T08:29:37.720252+0000","last_change":"2024-02-10T08:28:28.332050+0000","last_active":"2024-02-10T08:29:37.720252+0000","last_peered":"2024-02-10T08:29:37.720252+0000","last_clean":"2024-02-10T08:29:37.720252+0000","last_became_active":"2024-02-10T08:28:28.331715+0000","last_became_peered":"2024-02-10T08:28:28.331715+0000","last_unstale":"2024-02-10T08:29:37.720252+0000","last_undegraded":"2024-02-10T08:29:37.720252+0000","last_fullsized":"2024-02-10T08:29:37.720252+0000","mapping_epoch":256,"log_start":"264'1600","ondisk_log_start":"264'1600","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_clean_scrub_stamp":"2024-02-10T08:28:27.172648+0000","log_size":4025,"ondisk_log_size":4025,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":368640000,"num_objects":5625,"num_object_clones":0,"num_object_copies":16875,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5625,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5625,"num_write_kb":360000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,7],"acting":[1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":254,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.090943+0000","last_change":"2024-02-10T08:28:36.163224+0000","last_active":"2024-02-10T08:29:27.090943+0000","last_peered":"2024-02-10T08:29:27.090943+0000","last_clean":"2024-02-10T08:29:27.090943+0000","last_became_active":"2024-02-10T08:23:15.078797+0000","last_became_peered":"2024-02-10T08:23:15.078797+0000","last_unstale":"2024-02-10T08:29:27.090943+0000","last_undegraded":"2024-02-10T08:29:27.090943+0000","last_fullsized":"2024-02-10T08:29:27.090943+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:36.163125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:36.163125+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,2],"acting":[5,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"261'13","reported_seq":113,"reported_epoch":278,"state":"active+clean","last_fresh":"2024-02-10T08:29:31.119519+0000","last_change":"2024-02-10T08:29:13.140731+0000","last_active":"2024-02-10T08:29:31.119519+0000","last_peered":"2024-02-10T08:29:31.119519+0000","last_clean":"2024-02-10T08:29:31.119519+0000","last_became_active":"2024-02-10T08:28:38.231242+0000","last_became_peered":"2024-02-10T08:28:38.231242+0000","last_unstale":"2024-02-10T08:29:31.119519+0000","last_undegraded":"2024-02-10T08:29:31.119519+0000","last_fullsized":"2024-02-10T08:29:31.119519+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'13","last_scrub_stamp":"2024-02-10T08:29:13.140622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:13.140622+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,2],"acting":[5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":247,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.080949+0000","last_change":"2024-02-10T08:26:24.169444+0000","last_active":"2024-02-10T08:29:27.080949+0000","last_peered":"2024-02-10T08:29:27.080949+0000","last_clean":"2024-02-10T08:29:27.080949+0000","last_became_active":"2024-02-10T08:16:52.783634+0000","last_became_peered":"2024-02-10T08:16:52.783634+0000","last_unstale":"2024-02-10T08:29:27.080949+0000","last_undegraded":"2024-02-10T08:29:27.080949+0000","last_fullsized":"2024-02-10T08:29:27.080949+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:26:24.169341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:26:24.169341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"226'27","reported_seq":270,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.094542+0000","last_change":"2024-02-10T08:28:18.108820+0000","last_active":"2024-02-10T08:29:27.094542+0000","last_peered":"2024-02-10T08:29:27.094542+0000","last_clean":"2024-02-10T08:29:27.094542+0000","last_became_active":"2024-02-10T08:20:46.401777+0000","last_became_peered":"2024-02-10T08:20:46.401777+0000","last_unstale":"2024-02-10T08:29:27.094542+0000","last_undegraded":"2024-02-10T08:29:27.094542+0000","last_fullsized":"2024-02-10T08:29:27.094542+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"226'27","last_scrub_stamp":"2024-02-10T08:28:18.108712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:28:18.108712+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1","version":"278'5536","reported_seq":5566,"reported_epoch":278,"state":"active+clean","last_fresh":"2024-02-10T08:29:37.582354+0000","last_change":"2024-02-10T08:28:28.530157+0000","last_active":"2024-02-10T08:29:37.582354+0000","last_peered":"2024-02-10T08:29:37.582354+0000","last_clean":"2024-02-10T08:29:37.582354+0000","last_became_active":"2024-02-10T08:28:28.529924+0000","last_became_peered":"2024-02-10T08:28:28.529924+0000","last_unstale":"2024-02-10T08:29:37.582354+0000","last_undegraded":"2024-02-10T08:29:37.582354+0000","last_fullsized":"2024-02-10T08:29:37.582354+0000","mapping_epoch":256,"log_start":"262'900","ondisk_log_start":"262'900","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_clean_scrub_stamp":"2024-02-10T08:28:27.172648+0000","log_size":4636,"ondisk_log_size":4636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":362807296,"num_objects":5536,"num_object_clones":0,"num_object_copies":16608,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5536,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5536,"num_write_kb":354304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":216,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.093228+0000","last_change":"2024-02-10T08:28:26.976109+0000","last_active":"2024-02-10T08:29:27.093228+0000","last_peered":"2024-02-10T08:29:27.093228+0000","last_clean":"2024-02-10T08:29:27.093228+0000","last_became_active":"2024-02-10T08:20:46.405578+0000","last_became_peered":"2024-02-10T08:20:46.405578+0000","last_unstale":"2024-02-10T08:29:27.093228+0000","last_undegraded":"2024-02-10T08:29:27.093228+0000","last_fullsized":"2024-02-10T08:29:27.093228+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:26.976023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:26.976023+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"62'8","reported_seq":409,"reported_epoch":278,"state":"active+clean","last_fresh":"2024-02-10T08:29:31.118599+0000","last_change":"2024-02-10T08:29:12.429460+0000","last_active":"2024-02-10T08:29:31.118599+0000","last_peered":"2024-02-10T08:29:31.118599+0000","last_clean":"2024-02-10T08:29:31.118599+0000","last_became_active":"2024-02-10T08:16:56.858101+0000","last_became_peered":"2024-02-10T08:16:56.858101+0000","last_unstale":"2024-02-10T08:29:31.118599+0000","last_undegraded":"2024-02-10T08:29:31.118599+0000","last_fullsized":"2024-02-10T08:29:31.118599+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'8","last_scrub_stamp":"2024-02-10T08:29:12.429342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:12.429342+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":247,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.085897+0000","last_change":"2024-02-10T08:26:19.229352+0000","last_active":"2024-02-10T08:29:27.085897+0000","last_peered":"2024-02-10T08:29:27.085897+0000","last_clean":"2024-02-10T08:29:27.085897+0000","last_became_active":"2024-02-10T08:16:52.785545+0000","last_became_peered":"2024-02-10T08:16:52.785545+0000","last_unstale":"2024-02-10T08:29:27.085897+0000","last_undegraded":"2024-02-10T08:29:27.085897+0000","last_fullsized":"2024-02-10T08:29:27.085897+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:26:19.229261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:26:19.229261+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"225'20","reported_seq":261,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.092555+0000","last_change":"2024-02-10T08:26:39.910278+0000","last_active":"2024-02-10T08:29:27.092555+0000","last_peered":"2024-02-10T08:29:27.092555+0000","last_clean":"2024-02-10T08:29:27.092555+0000","last_became_active":"2024-02-10T08:20:46.398973+0000","last_became_peered":"2024-02-10T08:20:46.398973+0000","last_unstale":"2024-02-10T08:29:27.092555+0000","last_undegraded":"2024-02-10T08:29:27.092555+0000","last_fullsized":"2024-02-10T08:29:27.092555+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'10","last_scrub_stamp":"2024-02-10T08:26:39.910195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:26:39.910195+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":24,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"278'5720","reported_seq":5764,"reported_epoch":278,"state":"active+remapped+backfill_toofull","last_fresh":"2024-02-10T08:29:37.693645+0000","last_change":"2024-02-10T08:29:16.611309+0000","last_active":"2024-02-10T08:29:37.693645+0000","last_peered":"2024-02-10T08:29:37.693645+0000","last_clean":"2024-02-10T08:29:13.933885+0000","last_became_active":"2024-02-10T08:29:16.482526+0000","last_became_peered":"2024-02-10T08:29:16.482526+0000","last_unstale":"2024-02-10T08:29:37.693645+0000","last_undegraded":"2024-02-10T08:29:37.693645+0000","last_fullsized":"2024-02-10T08:29:37.693645+0000","mapping_epoch":272,"log_start":"264'1700","ondisk_log_start":"264'1700","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_clean_scrub_stamp":"2024-02-10T08:28:27.172648+0000","log_size":4020,"ondisk_log_size":4020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":374865920,"num_objects":5720,"num_object_clones":0,"num_object_copies":17160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":11440,"num_objects_unfound":0,"num_objects_dirty":5720,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5720,"num_write_kb":366080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,4],"acting":[1,6,2],"avail_no_missing":["1","2","6"],"object_location_counts":[{"shards":"1,2,6","objects":5720}],"blocked_by":[],"up_primary":5,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":205,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.083421+0000","last_change":"2024-02-10T08:28:34.215446+0000","last_active":"2024-02-10T08:29:27.083421+0000","last_peered":"2024-02-10T08:29:27.083421+0000","last_clean":"2024-02-10T08:29:27.083421+0000","last_became_active":"2024-02-10T08:28:26.000711+0000","last_became_peered":"2024-02-10T08:28:26.000711+0000","last_unstale":"2024-02-10T08:29:27.083421+0000","last_undegraded":"2024-02-10T08:29:27.083421+0000","last_fullsized":"2024-02-10T08:29:27.083421+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:34.215363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:34.215363+0000","last_clean_scrub_stamp":"2024-02-10T08:28:34.215363+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6],"acting":[0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":276,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.086481+0000","last_change":"2024-02-10T08:29:24.690721+0000","last_active":"2024-02-10T08:29:27.086481+0000","last_peered":"2024-02-10T08:29:27.086481+0000","last_clean":"2024-02-10T08:29:27.086481+0000","last_became_active":"2024-02-10T08:28:02.764210+0000","last_became_peered":"2024-02-10T08:28:02.764210+0000","last_unstale":"2024-02-10T08:29:27.086481+0000","last_undegraded":"2024-02-10T08:29:27.086481+0000","last_fullsized":"2024-02-10T08:29:27.086481+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:24.690623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:24.690623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":261,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.086270+0000","last_change":"2024-02-10T08:25:29.293026+0000","last_active":"2024-02-10T08:29:27.086270+0000","last_peered":"2024-02-10T08:29:27.086270+0000","last_clean":"2024-02-10T08:29:27.086270+0000","last_became_active":"2024-02-10T08:20:46.399568+0000","last_became_peered":"2024-02-10T08:20:46.399568+0000","last_unstale":"2024-02-10T08:29:27.086270+0000","last_undegraded":"2024-02-10T08:29:27.086270+0000","last_fullsized":"2024-02-10T08:29:27.086270+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:25:29.292955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:25:29.292955+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"225'31","reported_seq":295,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.091567+0000","last_change":"2024-02-10T08:28:38.271681+0000","last_active":"2024-02-10T08:29:27.091567+0000","last_peered":"2024-02-10T08:29:27.091567+0000","last_clean":"2024-02-10T08:29:27.091567+0000","last_became_active":"2024-02-10T08:28:38.237476+0000","last_became_peered":"2024-02-10T08:28:38.237476+0000","last_unstale":"2024-02-10T08:29:27.091567+0000","last_undegraded":"2024-02-10T08:29:27.091567+0000","last_fullsized":"2024-02-10T08:29:27.091567+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'31","last_scrub_stamp":"2024-02-10T08:28:14.001126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:28:14.001126+0000","log_size":31,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":48,"num_read_kb":38,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.7","version":"278'5709","reported_seq":5737,"reported_epoch":278,"state":"active+clean","last_fresh":"2024-02-10T08:29:37.602601+0000","last_change":"2024-02-10T08:28:28.331926+0000","last_active":"2024-02-10T08:29:37.602601+0000","last_peered":"2024-02-10T08:29:37.602601+0000","last_clean":"2024-02-10T08:29:37.602601+0000","last_became_active":"2024-02-10T08:28:28.331632+0000","last_became_peered":"2024-02-10T08:28:28.331632+0000","last_unstale":"2024-02-10T08:29:37.602601+0000","last_undegraded":"2024-02-10T08:29:37.602601+0000","last_fullsized":"2024-02-10T08:29:37.602601+0000","mapping_epoch":256,"log_start":"262'1300","ondisk_log_start":"262'1300","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_clean_scrub_stamp":"2024-02-10T08:28:27.172648+0000","log_size":4409,"ondisk_log_size":4409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":374145024,"num_objects":5709,"num_object_clones":0,"num_object_copies":17127,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5709,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5709,"num_write_kb":365376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2],"acting":[5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":258,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.084552+0000","last_change":"2024-02-10T08:28:22.114493+0000","last_active":"2024-02-10T08:29:27.084552+0000","last_peered":"2024-02-10T08:29:27.084552+0000","last_clean":"2024-02-10T08:29:27.084552+0000","last_became_active":"2024-02-10T08:24:18.645480+0000","last_became_peered":"2024-02-10T08:24:18.645480+0000","last_unstale":"2024-02-10T08:29:27.084552+0000","last_undegraded":"2024-02-10T08:29:27.084552+0000","last_fullsized":"2024-02-10T08:29:27.084552+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:22.114421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:22.114421+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,3],"acting":[7,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":266,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.092380+0000","last_change":"2024-02-10T08:28:19.149963+0000","last_active":"2024-02-10T08:29:27.092380+0000","last_peered":"2024-02-10T08:29:27.092380+0000","last_clean":"2024-02-10T08:29:27.092380+0000","last_became_active":"2024-02-10T08:28:02.779438+0000","last_became_peered":"2024-02-10T08:28:02.779438+0000","last_unstale":"2024-02-10T08:29:27.092380+0000","last_undegraded":"2024-02-10T08:29:27.092380+0000","last_fullsized":"2024-02-10T08:29:27.092380+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:19.149900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:28:19.149900+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":270,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.091755+0000","last_change":"2024-02-10T08:28:02.781347+0000","last_active":"2024-02-10T08:29:27.091755+0000","last_peered":"2024-02-10T08:29:27.091755+0000","last_clean":"2024-02-10T08:29:27.091755+0000","last_became_active":"2024-02-10T08:28:02.781029+0000","last_became_peered":"2024-02-10T08:28:02.781029+0000","last_unstale":"2024-02-10T08:29:27.091755+0000","last_undegraded":"2024-02-10T08:29:27.091755+0000","last_fullsized":"2024-02-10T08:29:27.091755+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:26:25.120940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:26:25.120940+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"226'35","reported_seq":304,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.088778+0000","last_change":"2024-02-10T08:29:09.404681+0000","last_active":"2024-02-10T08:29:27.088778+0000","last_peered":"2024-02-10T08:29:27.088778+0000","last_clean":"2024-02-10T08:29:27.088778+0000","last_became_active":"2024-02-10T08:16:55.203415+0000","last_became_peered":"2024-02-10T08:16:55.203415+0000","last_unstale":"2024-02-10T08:29:27.088778+0000","last_undegraded":"2024-02-10T08:29:27.088778+0000","last_fullsized":"2024-02-10T08:29:27.088778+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"226'35","last_scrub_stamp":"2024-02-10T08:29:09.404577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:29:09.404577+0000","log_size":35,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":56,"num_read_kb":45,"num_write":36,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.6","version":"278'5630","reported_seq":5660,"reported_epoch":278,"state":"active+clean","last_fresh":"2024-02-10T08:29:37.610379+0000","last_change":"2024-02-10T08:28:28.331984+0000","last_active":"2024-02-10T08:29:37.610379+0000","last_peered":"2024-02-10T08:29:37.610379+0000","last_clean":"2024-02-10T08:29:37.610379+0000","last_became_active":"2024-02-10T08:28:28.331662+0000","last_became_peered":"2024-02-10T08:28:28.331662+0000","last_unstale":"2024-02-10T08:29:37.610379+0000","last_undegraded":"2024-02-10T08:29:37.610379+0000","last_fullsized":"2024-02-10T08:29:37.610379+0000","mapping_epoch":256,"log_start":"262'1200","ondisk_log_start":"262'1200","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_clean_scrub_stamp":"2024-02-10T08:28:27.172648+0000","log_size":4430,"ondisk_log_size":4430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":368967680,"num_objects":5630,"num_object_clones":0,"num_object_copies":16890,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5630,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5630,"num_write_kb":360320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,1],"acting":[5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"76'2","reported_seq":148,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.085295+0000","last_change":"2024-02-10T08:28:20.073164+0000","last_active":"2024-02-10T08:29:27.085295+0000","last_peered":"2024-02-10T08:29:27.085295+0000","last_clean":"2024-02-10T08:29:27.085295+0000","last_became_active":"2024-02-10T08:23:34.718483+0000","last_became_peered":"2024-02-10T08:23:34.718483+0000","last_unstale":"2024-02-10T08:29:27.085295+0000","last_undegraded":"2024-02-10T08:29:27.085295+0000","last_fullsized":"2024-02-10T08:29:27.085295+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'2","last_scrub_stamp":"2024-02-10T08:28:20.073105+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2024-02-10T08:18:08.680038+0000","last_clean_scrub_stamp":"2024-02-10T08:28:20.073105+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":285,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.091837+0000","last_change":"2024-02-10T08:28:25.266206+0000","last_active":"2024-02-10T08:29:27.091837+0000","last_peered":"2024-02-10T08:29:27.091837+0000","last_clean":"2024-02-10T08:29:27.091837+0000","last_became_active":"2024-02-10T08:28:02.781897+0000","last_became_peered":"2024-02-10T08:28:02.781897+0000","last_unstale":"2024-02-10T08:29:27.091837+0000","last_undegraded":"2024-02-10T08:29:27.091837+0000","last_fullsized":"2024-02-10T08:29:27.091837+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:25.266124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:28:25.266124+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0],"acting":[2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":262,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.089774+0000","last_change":"2024-02-10T08:25:42.035602+0000","last_active":"2024-02-10T08:29:27.089774+0000","last_peered":"2024-02-10T08:29:27.089774+0000","last_clean":"2024-02-10T08:29:27.089774+0000","last_became_active":"2024-02-10T08:20:46.407311+0000","last_became_peered":"2024-02-10T08:20:46.407311+0000","last_unstale":"2024-02-10T08:29:27.089774+0000","last_undegraded":"2024-02-10T08:29:27.089774+0000","last_fullsized":"2024-02-10T08:29:27.089774+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:25:42.035497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:21.523096+0000","last_clean_scrub_stamp":"2024-02-10T08:25:42.035497+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"225'15","reported_seq":59,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.082821+0000","last_change":"2024-02-10T08:28:15.049130+0000","last_active":"2024-02-10T08:29:27.082821+0000","last_peered":"2024-02-10T08:29:27.082821+0000","last_clean":"2024-02-10T08:29:27.082821+0000","last_became_active":"2024-02-10T08:28:02.770508+0000","last_became_peered":"2024-02-10T08:28:02.770508+0000","last_unstale":"2024-02-10T08:29:27.082821+0000","last_undegraded":"2024-02-10T08:29:27.082821+0000","last_fullsized":"2024-02-10T08:29:27.082821+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'15","last_scrub_stamp":"2024-02-10T08:28:15.049059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:28:15.049059+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.5","version":"278'5706","reported_seq":5736,"reported_epoch":278,"state":"active+clean","last_fresh":"2024-02-10T08:29:38.138576+0000","last_change":"2024-02-10T08:28:28.190785+0000","last_active":"2024-02-10T08:29:38.138576+0000","last_peered":"2024-02-10T08:29:38.138576+0000","last_clean":"2024-02-10T08:29:38.138576+0000","last_became_active":"2024-02-10T08:28:28.190416+0000","last_became_peered":"2024-02-10T08:28:28.190416+0000","last_unstale":"2024-02-10T08:29:38.138576+0000","last_undegraded":"2024-02-10T08:29:38.138576+0000","last_fullsized":"2024-02-10T08:29:38.138576+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_clean_scrub_stamp":"2024-02-10T08:28:27.172648+0000","log_size":5706,"ondisk_log_size":5706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":373948416,"num_objects":5706,"num_object_clones":0,"num_object_copies":17118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5706,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5706,"num_write_kb":365184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":263,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.087147+0000","last_change":"2024-02-10T08:28:30.227204+0000","last_active":"2024-02-10T08:29:27.087147+0000","last_peered":"2024-02-10T08:29:27.087147+0000","last_clean":"2024-02-10T08:29:27.087147+0000","last_became_active":"2024-02-10T08:28:02.776088+0000","last_became_peered":"2024-02-10T08:28:02.776088+0000","last_unstale":"2024-02-10T08:29:27.087147+0000","last_undegraded":"2024-02-10T08:29:27.087147+0000","last_fullsized":"2024-02-10T08:29:27.087147+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:30.227120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:20.392249+0000","last_clean_scrub_stamp":"2024-02-10T08:28:30.227120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":266,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.093348+0000","last_change":"2024-02-10T08:29:24.555085+0000","last_active":"2024-02-10T08:29:27.093348+0000","last_peered":"2024-02-10T08:29:27.093348+0000","last_clean":"2024-02-10T08:29:27.093348+0000","last_became_active":"2024-02-10T08:23:15.074046+0000","last_became_peered":"2024-02-10T08:23:15.074046+0000","last_unstale":"2024-02-10T08:29:27.093348+0000","last_undegraded":"2024-02-10T08:29:27.093348+0000","last_fullsized":"2024-02-10T08:29:27.093348+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:24.554978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:29:24.554978+0000","last_clean_scrub_stamp":"2024-02-10T08:29:24.554978+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,6],"acting":[2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"225'27","reported_seq":292,"reported_epoch":277,"state":"active+clean","last_fresh":"2024-02-10T08:29:27.087465+0000","last_change":"2024-02-10T08:29:07.059712+0000","last_active":"2024-02-10T08:29:27.087465+0000","last_peered":"2024-02-10T08:29:27.087465+0000","last_clean":"2024-02-10T08:29:27.087465+0000","last_became_active":"2024-02-10T08:16:55.204597+0000","last_became_peered":"2024-02-10T08:16:55.204597+0000","last_unstale":"2024-02-10T08:29:27.087465+0000","last_undegraded":"2024-02-10T08:29:27.087465+0000","last_fullsized":"2024-02-10T08:29:27.087465+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'27","last_scrub_stamp":"2024-02-10T08:29:07.059646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:29:07.059646+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"111'10","reported_seq":436,"reported_epoch":278,"state":"active+clean","last_fresh":"2024-02-10T08:29:31.118811+0000","last_change":"2024-02-10T08:28:29.196174+0000","last_active":"2024-02-10T08:29:31.118811+0000","last_peered":"2024-02-10T08:29:31.118811+0000","last_clean":"2024-02-10T08:29:31.118811+0000","last_became_active":"2024-02-10T08:20:46.399193+0000","last_became_peered":"2024-02-10T08:20:46.399193+0000","last_unstale":"2024-02-10T08:29:31.118811+0000","last_undegraded":"2024-02-10T08:29:31.118811+0000","last_fullsized":"2024-02-10T08:29:31.118811+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'10","last_scrub_stamp":"2024-02-10T08:28:29.196109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:28:29.196109+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":5915344896,"num_objects":90261,"num_object_clones":0,"num_object_copies":270783,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":11440,"num_objects_unfound":0,"num_objects_dirty":90261,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90261,"num_write_kb":5776704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":17740136448,"data_stored":17740136448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":73161,"ondisk_log_size":73161,"up":48,"acting":48,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2646,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":4},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":755,"num_read_kb":750,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":9,"acting":9,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":1107,"num_read_kb":864,"num_write":703,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":127,"num_bytes_recovered":3108,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":725,"ondisk_log_size":725,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":89,"ondisk_log_size":89,"up":96,"acting":96,"num_store_stats":8},{"poolid":6,"num_pg":42,"stat_sum":{"num_bytes":376,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":26,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":126,"acting":126,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":50,"seq":214748364957,"num_pgs":78,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":4238204,"kb_used_data":3936884,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":89506948,"statfs":{"total":95995035648,"available":91655114752,"internally_reserved":0,"allocated":4031369216,"data_stored":4030848470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:29:06 2024","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.524,"15min":1.1699999999999999},"min":{"1min":0.23499999999999999,"5min":0.20899999999999999,"15min":0.20300000000000001},"max":{"1min":6.8200000000000003,"5min":14.734,"15min":21.175999999999998},"last":3.6589999999999998},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.712,"15min":1.5620000000000001},"min":{"1min":0.253,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":3.6080000000000001,"5min":13.204000000000001,"15min":22.57},"last":0.40799999999999997}]},{"osd":1,"last update":"Sat Feb 10 08:29:06 2024","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.429,"15min":1.169},"min":{"1min":0.26200000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":4.6470000000000002,"5min":11.779,"15min":15.476000000000001},"last":3.7090000000000001},{"interface":"front","average":{"1min":1.038,"5min":1.502,"15min":1.2529999999999999},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":3.1339999999999999,"5min":12.237,"15min":12.237},"last":0.45500000000000002}]},{"osd":2,"last update":"Sat Feb 10 08:29:06 2024","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.2609999999999999,"15min":1.159},"min":{"1min":0.29199999999999998,"5min":0.255,"15min":0.251},"max":{"1min":6.2320000000000002,"5min":8.3940000000000001,"15min":8.3940000000000001},"last":3.5379999999999998},{"interface":"front","average":{"1min":0.999,"5min":1.252,"15min":1.2050000000000001},"min":{"1min":0.317,"5min":0.29599999999999999,"15min":0.25900000000000001},"max":{"1min":3.3900000000000001,"5min":6.383,"15min":12.797000000000001},"last":3.7349999999999999}]},{"osd":3,"last update":"Sat Feb 10 08:29:06 2024","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.3859999999999999,"15min":1.2230000000000001},"min":{"1min":0.32500000000000001,"5min":0.318,"15min":0.27700000000000002},"max":{"1min":13.07,"5min":13.07,"15min":18.515000000000001},"last":3.605},{"interface":"front","average":{"1min":1.01,"5min":1.3049999999999999,"15min":1.284},"min":{"1min":0.29899999999999999,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":3.5390000000000001,"5min":8.5800000000000001,"15min":9.9969999999999999},"last":3.79}]},{"osd":4,"last update":"Sat Feb 10 08:29:01 2024","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.0680000000000001,"15min":0.72999999999999998},"min":{"1min":0.24099999999999999,"5min":0.22700000000000001,"15min":0.216},"max":{"1min":3.6949999999999998,"5min":9.7590000000000003,"15min":9.7590000000000003},"last":3.508},{"interface":"front","average":{"1min":1.089,"5min":1.1950000000000001,"15min":0.72899999999999998},"min":{"1min":0.26200000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":4.7130000000000001,"5min":12.987,"15min":12.987},"last":3.8919999999999999}]},{"osd":5,"last update":"Sat Feb 10 08:29:06 2024","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.528,"15min":0.84199999999999997},"min":{"1min":0.28999999999999998,"5min":0.24199999999999999,"15min":0.218},"max":{"1min":4.6879999999999997,"5min":11.314,"15min":11.314},"last":3.7650000000000001},{"interface":"front","average":{"1min":1.012,"5min":1.296,"15min":0.81499999999999995},"min":{"1min":0.29699999999999999,"5min":0.26500000000000001,"15min":0.22600000000000001},"max":{"1min":4.1070000000000002,"5min":10.023999999999999,"15min":10.023999999999999},"last":2.8119999999999998}]},{"osd":6,"last update":"Sat Feb 10 08:29:06 2024","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":1.26,"15min":0.76500000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.26100000000000001},"max":{"1min":2.9710000000000001,"5min":7.5030000000000001,"15min":7.5030000000000001},"last":0.435},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.119,"15min":0.76100000000000001},"min":{"1min":0.33300000000000002,"5min":0.28199999999999997,"15min":0.224},"max":{"1min":2.9750000000000001,"5min":9.4290000000000003,"15min":9.4290000000000003},"last":6.1920000000000002}]}]},{"osd":6,"up_from":43,"seq":184683593890,"num_pgs":65,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1397440,"kb_used_data":1087928,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":92347712,"statfs":{"total":95995035648,"available":94564057088,"internally_reserved":0,"allocated":1114038272,"data_stored":1113513703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:28:38 2024","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":1.6859999999999999,"15min":1.629},"min":{"1min":0.23300000000000001,"5min":0.21299999999999999,"15min":0.19400000000000001},"max":{"1min":4.5179999999999998,"5min":27.611000000000001,"15min":30.509},"last":2.6059999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":1.496,"15min":1.4239999999999999},"min":{"1min":0.252,"5min":0.214,"15min":0.21099999999999999},"max":{"1min":3.5470000000000002,"5min":8.9559999999999995,"15min":36.090000000000003},"last":2.347}]},{"osd":1,"last update":"Sat Feb 10 08:28:38 2024","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.528,"15min":1.202},"min":{"1min":0.23899999999999999,"5min":0.23000000000000001,"15min":0.20899999999999999},"max":{"1min":4.6289999999999996,"5min":8.9369999999999994,"15min":12.938000000000001},"last":2.6400000000000001},{"interface":"front","average":{"1min":0.93600000000000005,"5min":1.5680000000000001,"15min":1.25},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":5.1980000000000004,"5min":10.441000000000001,"15min":10.441000000000001},"last":4.0339999999999998}]},{"osd":2,"last update":"Sat Feb 10 08:28:38 2024","interfaces":[{"interface":"back","average":{"1min":2.181,"5min":1.827,"15min":1.5229999999999999},"min":{"1min":0.307,"5min":0.28499999999999998,"15min":0.24399999999999999},"max":{"1min":25.146999999999998,"5min":25.146999999999998,"15min":35.072000000000003},"last":4.0700000000000003},{"interface":"front","average":{"1min":1.839,"5min":1.6919999999999999,"15min":1.4730000000000001},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":25.135999999999999,"5min":25.135999999999999,"15min":35.103000000000002},"last":2.7280000000000002}]},{"osd":3,"last update":"Sat Feb 10 08:28:38 2024","interfaces":[{"interface":"back","average":{"1min":1.494,"5min":1.865,"15min":1.3149999999999999},"min":{"1min":0.36699999999999999,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":4.6040000000000001,"5min":11.448,"15min":15.212999999999999},"last":2.5920000000000001},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.5920000000000001,"15min":1.3320000000000001},"min":{"1min":0.26300000000000001,"5min":0.253,"15min":0.253},"max":{"1min":6.7839999999999998,"5min":10.586,"15min":17.797000000000001},"last":4.056}]},{"osd":4,"last update":"Sat Feb 10 08:29:03 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":1.0149999999999999,"15min":0.71199999999999997},"min":{"1min":0.26200000000000001,"5min":0.224,"15min":0.224},"max":{"1min":2.3109999999999999,"5min":9.3879999999999999,"15min":9.3879999999999999},"last":2.6789999999999998},{"interface":"front","average":{"1min":0.81499999999999995,"5min":1.216,"15min":0.80100000000000005},"min":{"1min":0.30199999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":4.2160000000000002,"5min":10.348000000000001,"15min":10.348000000000001},"last":2.6259999999999999}]},{"osd":5,"last update":"Sat Feb 10 08:28:38 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":1.2490000000000001,"15min":0.753},"min":{"1min":0.30199999999999999,"5min":0.27000000000000002,"15min":0.20200000000000001},"max":{"1min":3.601,"5min":7.2320000000000002,"15min":7.2320000000000002},"last":10.507},{"interface":"front","average":{"1min":1.3029999999999999,"5min":1.323,"15min":0.79100000000000004},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.22900000000000001},"max":{"1min":5.6239999999999997,"5min":6.7999999999999998,"15min":6.7999999999999998},"last":4.8840000000000003}]},{"osd":7,"last update":"Sat Feb 10 08:29:03 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":3.1840000000000002,"15min":1.4239999999999999},"min":{"1min":0.34399999999999997,"5min":0.26200000000000001,"15min":0.23999999999999999},"max":{"1min":2.2759999999999998,"5min":194.88900000000001,"15min":194.88900000000001},"last":2.5710000000000002},{"interface":"front","average":{"1min":0.77200000000000002,"5min":3.3759999999999999,"15min":1.522},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.26400000000000001},"max":{"1min":3.0779999999999998,"5min":194.74100000000001,"15min":194.74100000000001},"last":5.4889999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575033,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":3531272,"kb_used_data":3229952,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":90213880,"statfs":{"total":95995035648,"available":92379013120,"internally_reserved":0,"allocated":3307470848,"data_stored":3306937748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:28:40 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":1.264,"15min":1.573},"min":{"1min":0.23200000000000001,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":2.593,"5min":13.316000000000001,"15min":29.763999999999999},"last":0.23499999999999999},{"interface":"front","average":{"1min":0.77800000000000002,"5min":1.6499999999999999,"15min":1.7529999999999999},"min":{"1min":0.27900000000000003,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":6.3550000000000004,"5min":21.405000000000001,"15min":29.637},"last":1.849}]},{"osd":2,"last update":"Sat Feb 10 08:29:07 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":1.333,"15min":1.7729999999999999},"min":{"1min":0.25700000000000001,"5min":0.224,"15min":0.21199999999999999},"max":{"1min":2.7679999999999998,"5min":7.5190000000000001,"15min":31.420999999999999},"last":0.317},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.681,"15min":1.9610000000000001},"min":{"1min":0.25800000000000001,"5min":0.184,"15min":0.184},"max":{"1min":5.5279999999999996,"5min":8.9749999999999996,"15min":31.484999999999999},"last":0.36199999999999999}]},{"osd":3,"last update":"Sat Feb 10 08:29:34 2024","interfaces":[{"interface":"back","average":{"1min":1.653,"5min":1.841,"15min":1.972},"min":{"1min":0.30299999999999999,"5min":0.253,"15min":0.247},"max":{"1min":5.0599999999999996,"5min":15.952999999999999,"15min":28.082000000000001},"last":1.671},{"interface":"front","average":{"1min":1.694,"5min":1.3069999999999999,"15min":1.629},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":8.7119999999999997,"5min":9.0879999999999992,"15min":29.722000000000001},"last":1.879}]},{"osd":4,"last update":"Sat Feb 10 08:29:04 2024","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":1.4410000000000001,"15min":2.0979999999999999},"min":{"1min":0.29799999999999999,"5min":0.27300000000000002,"15min":0.26100000000000001},"max":{"1min":4.7679999999999998,"5min":6.4059999999999997,"15min":14.086},"last":0.33900000000000002},{"interface":"front","average":{"1min":1.012,"5min":1.7889999999999999,"15min":2.484},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":3.7989999999999999,"5min":9.702,"15min":31.515000000000001},"last":1.8140000000000001}]},{"osd":5,"last update":"Sat Feb 10 08:29:13 2024","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.871,"15min":1.5669999999999999},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.26000000000000001},"max":{"1min":4.7320000000000002,"5min":40.140999999999998,"15min":40.140999999999998},"last":1.1719999999999999},{"interface":"front","average":{"1min":1.4570000000000001,"5min":2.3479999999999999,"15min":1.8100000000000001},"min":{"1min":0.42399999999999999,"5min":0.30399999999999999,"15min":0.28499999999999998},"max":{"1min":3.77,"5min":40.831000000000003,"15min":40.831000000000003},"last":1.4019999999999999}]},{"osd":6,"last update":"Sat Feb 10 08:28:40 2024","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":2.1629999999999998,"15min":1.5529999999999999},"min":{"1min":0.39500000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":4.7290000000000001,"5min":31.27,"15min":31.27},"last":0.30199999999999999},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.5149999999999999,"15min":1.258},"min":{"1min":0.41399999999999998,"5min":0.35399999999999998,"15min":0.27700000000000002},"max":{"1min":4.7430000000000003,"5min":10.238,"15min":10.433},"last":0.374}]},{"osd":7,"last update":"Sat Feb 10 08:29:07 2024","interfaces":[{"interface":"back","average":{"1min":1.645,"5min":1.681,"15min":1.599},"min":{"1min":0.39100000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":9.7840000000000007,"5min":9.7840000000000007,"15min":31.344999999999999},"last":1.637},{"interface":"front","average":{"1min":1.054,"5min":1.2130000000000001,"15min":1.25},"min":{"1min":0.34200000000000003,"5min":0.32600000000000001,"15min":0.312},"max":{"1min":3.3490000000000002,"5min":5.3520000000000003,"15min":14.872},"last":3.8450000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738558,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1389920,"kb_used_data":1084504,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":92355232,"statfs":{"total":95995035648,"available":94571757568,"internally_reserved":0,"allocated":1110532096,"data_stored":1110039197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 10 08:28:48 2024","interfaces":[{"interface":"back","average":{"1min":1.5920000000000001,"5min":1.863,"15min":2.1629999999999998},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.14399999999999999},"max":{"1min":7.9989999999999997,"5min":22.460000000000001,"15min":102.48099999999999},"last":1.657},{"interface":"front","average":{"1min":1.625,"5min":1.671,"15min":1.992},"min":{"1min":0.23000000000000001,"5min":0.19800000000000001,"15min":0.193},"max":{"1min":11.367000000000001,"5min":23.27,"15min":103.38800000000001},"last":0.307}]},{"osd":2,"last update":"Sat Feb 10 08:29:06 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.738,"15min":2.2469999999999999},"min":{"1min":0.22700000000000001,"5min":0.192,"15min":0.192},"max":{"1min":5.6269999999999998,"5min":11.782,"15min":102.462},"last":2.5110000000000001},{"interface":"front","average":{"1min":1.365,"5min":1.76,"15min":2.1549999999999998},"min":{"1min":0.27600000000000002,"5min":0.222,"15min":0.20799999999999999},"max":{"1min":4.5780000000000003,"5min":19.809999999999999,"15min":102.66500000000001},"last":1.704}]},{"osd":3,"last update":"Sat Feb 10 08:29:35 2024","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.464,"15min":1.8089999999999999},"min":{"1min":0.26800000000000002,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":4.6459999999999999,"5min":7.1550000000000002,"15min":16.495000000000001},"last":0.32700000000000001},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.7949999999999999,"15min":2.2629999999999999},"min":{"1min":0.31,"5min":0.222,"15min":0.222},"max":{"1min":3.3679999999999999,"5min":8.5419999999999998,"15min":102.64400000000001},"last":0.39600000000000002}]},{"osd":4,"last update":"Sat Feb 10 08:28:56 2024","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.573,"15min":3.298},"min":{"1min":0.32500000000000001,"5min":0.26800000000000002,"15min":0.253},"max":{"1min":4.9340000000000002,"5min":8.4239999999999995,"15min":102.742},"last":0.45900000000000002},{"interface":"front","average":{"1min":1.149,"5min":1.3620000000000001,"15min":1.8540000000000001},"min":{"1min":0.39200000000000002,"5min":0.31,"15min":0.26200000000000001},"max":{"1min":4.5579999999999998,"5min":7.3890000000000002,"15min":16.352},"last":2.1280000000000001}]},{"osd":5,"last update":"Sat Feb 10 08:29:25 2024","interfaces":[{"interface":"back","average":{"1min":1.5840000000000001,"5min":1.6499999999999999,"15min":1.804},"min":{"1min":0.377,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":4.6239999999999997,"5min":8.4320000000000004,"15min":102.53100000000001},"last":1.534},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.5800000000000001,"15min":1.409},"min":{"1min":0.39300000000000002,"5min":0.33900000000000002,"15min":0.22500000000000001},"max":{"1min":4.5910000000000002,"5min":9.7360000000000007,"15min":16.463999999999999},"last":1.575}]},{"osd":6,"last update":"Sat Feb 10 08:28:48 2024","interfaces":[{"interface":"back","average":{"1min":1.5389999999999999,"5min":1.609,"15min":1.8049999999999999},"min":{"1min":0.40999999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":7.5810000000000004,"5min":10.896000000000001,"15min":102.583},"last":1.492},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.4610000000000001,"15min":1.3240000000000001},"min":{"1min":0.432,"5min":0.372,"15min":0.308},"max":{"1min":5.7060000000000004,"5min":6.0549999999999997,"15min":16.391999999999999},"last":1.4710000000000001}]},{"osd":7,"last update":"Sat Feb 10 08:29:06 2024","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":3.9449999999999998,"15min":2.6419999999999999},"min":{"1min":0.47799999999999998,"5min":0.35299999999999998,"15min":0.34100000000000003},"max":{"1min":4.6859999999999999,"5min":255.53200000000001,"15min":255.53200000000001},"last":0.60199999999999998},{"interface":"front","average":{"1min":1.2589999999999999,"5min":3.8759999999999999,"15min":2.1560000000000001},"min":{"1min":0.499,"5min":0.39600000000000002,"15min":0.28599999999999998},"max":{"1min":4.6280000000000001,"5min":254.88800000000001,"15min":254.88800000000001},"last":0.55000000000000004}]}]},{"osd":2,"up_from":18,"seq":77309411509,"num_pgs":61,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2474672,"kb_used_data":2169256,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":91270480,"statfs":{"total":95995035648,"available":93460971520,"internally_reserved":0,"allocated":2221318144,"data_stored":2220809122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:29:18 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.98999999999999999,"15min":1.5840000000000001},"min":{"1min":0.22700000000000001,"5min":0.184,"15min":0.17399999999999999},"max":{"1min":2.9089999999999998,"5min":6.7530000000000001,"15min":24.859999999999999},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.85399999999999998,"5min":1.3049999999999999,"15min":1.9419999999999999},"min":{"1min":0.20999999999999999,"5min":0.20399999999999999,"15min":0.193},"max":{"1min":3.548,"5min":9.2219999999999995,"15min":28.295999999999999},"last":0.41899999999999998}]},{"osd":1,"last update":"Sat Feb 10 08:29:18 2024","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.895,"15min":1.5629999999999999},"min":{"1min":0.29399999999999998,"5min":0.20999999999999999,"15min":0.19700000000000001},"max":{"1min":8.4960000000000004,"5min":13.622,"15min":15.644},"last":2.4260000000000002},{"interface":"front","average":{"1min":0.82899999999999996,"5min":1.097,"15min":1.232},"min":{"1min":0.25800000000000001,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":3.5590000000000002,"5min":6.2809999999999997,"15min":16.968},"last":1.054}]},{"osd":3,"last update":"Sat Feb 10 08:29:35 2024","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.7290000000000001,"15min":1.7070000000000001},"min":{"1min":0.307,"5min":0.24199999999999999,"15min":0.23300000000000001},"max":{"1min":3.3599999999999999,"5min":10.734,"15min":24.946000000000002},"last":2.4079999999999999},{"interface":"front","average":{"1min":0.90500000000000003,"5min":1.48,"15min":1.831},"min":{"1min":0.255,"5min":0.23300000000000001,"15min":0.22900000000000001},"max":{"1min":2.7269999999999999,"5min":14.282,"15min":24.905000000000001},"last":1.3169999999999999}]},{"osd":4,"last update":"Sat Feb 10 08:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":1.4930000000000001,"15min":2.1339999999999999},"min":{"1min":0.32400000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":5.774,"5min":7.3470000000000004,"15min":13.260999999999999},"last":2.444},{"interface":"front","average":{"1min":0.78500000000000003,"5min":1.024,"15min":1.3200000000000001},"min":{"1min":0.33200000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":2.593,"5min":7.3150000000000004,"15min":15.696},"last":0.437}]},{"osd":5,"last update":"Sat Feb 10 08:29:21 2024","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.726,"15min":1.4830000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.26600000000000001},"max":{"1min":3.976,"5min":9.2590000000000003,"15min":13.939},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.611,"15min":1.367},"min":{"1min":0.35399999999999998,"5min":0.33600000000000002,"15min":0.28599999999999998},"max":{"1min":5.8479999999999999,"5min":8.6890000000000001,"15min":13.317},"last":2.4630000000000001}]},{"osd":6,"last update":"Sat Feb 10 08:28:53 2024","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.946,"15min":1.5009999999999999},"min":{"1min":0.35799999999999998,"5min":0.33700000000000002,"15min":0.28000000000000003},"max":{"1min":5.6100000000000003,"5min":38.177999999999997,"15min":38.177999999999997},"last":0.45900000000000002},{"interface":"front","average":{"1min":1.458,"5min":2.2389999999999999,"15min":1.5489999999999999},"min":{"1min":0.374,"5min":0.36899999999999999,"15min":0.29099999999999998},"max":{"1min":13.567,"5min":37.682000000000002,"15min":37.682000000000002},"last":2.3900000000000001}]},{"osd":7,"last update":"Sat Feb 10 08:29:18 2024","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.6679999999999999,"15min":1.415},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.33900000000000002},"max":{"1min":3.5150000000000001,"5min":6.7000000000000002,"15min":13.231999999999999},"last":2.3530000000000002},{"interface":"front","average":{"1min":1.05,"5min":1.2070000000000001,"15min":1.1299999999999999},"min":{"1min":0.35099999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":2.7799999999999998,"5min":6.7800000000000002,"15min":15.714},"last":1.081}]}]},{"osd":3,"up_from":25,"seq":107374182576,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1709064,"kb_used_data":1403648,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":92036088,"statfs":{"total":95995035648,"available":94244954112,"internally_reserved":0,"allocated":1437335552,"data_stored":1436865783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:29:34 2024","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.24,"15min":1.5129999999999999},"min":{"1min":0.20599999999999999,"5min":0.182,"15min":0.182},"max":{"1min":5.9000000000000004,"5min":7.5570000000000004,"15min":14.167},"last":2.3420000000000001},{"interface":"front","average":{"1min":1.929,"5min":1.556,"15min":1.5009999999999999},"min":{"1min":0.20200000000000001,"5min":0.185,"15min":0.185},"max":{"1min":16.155000000000001,"5min":16.155000000000001,"15min":26.643000000000001},"last":2.1840000000000002}]},{"osd":1,"last update":"Sat Feb 10 08:29:34 2024","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.657,"15min":1.5149999999999999},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":6.2670000000000003,"5min":9.4179999999999993,"15min":12.782999999999999},"last":0.26000000000000001},{"interface":"front","average":{"1min":1.03,"5min":2.073,"15min":1.7230000000000001},"min":{"1min":0.22900000000000001,"5min":0.214,"15min":0.191},"max":{"1min":5.5960000000000001,"5min":17.513000000000002,"15min":21.373999999999999},"last":4.9269999999999996}]},{"osd":2,"last update":"Sat Feb 10 08:29:34 2024","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":2.0169999999999999,"15min":1.675},"min":{"1min":0.255,"5min":0.24199999999999999,"15min":0.23699999999999999},"max":{"1min":3.5339999999999998,"5min":15.102,"15min":21.434000000000001},"last":0.24399999999999999},{"interface":"front","average":{"1min":1.109,"5min":1.5960000000000001,"15min":1.5089999999999999},"min":{"1min":0.26600000000000001,"5min":0.215,"15min":0.215},"max":{"1min":2.835,"5min":13.946999999999999,"15min":18.061},"last":2.0880000000000001}]},{"osd":4,"last update":"Sat Feb 10 08:29:06 2024","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.571,"15min":1.7010000000000001},"min":{"1min":0.38800000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":2.9889999999999999,"5min":10.970000000000001,"15min":12.272},"last":0.34499999999999997},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.708,"15min":2.2349999999999999},"min":{"1min":0.373,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":3.7320000000000002,"5min":9.0489999999999995,"15min":12.391999999999999},"last":0.36199999999999999}]},{"osd":5,"last update":"Sat Feb 10 08:29:29 2024","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.7809999999999999,"15min":1.208},"min":{"1min":0.41399999999999998,"5min":0.31,"15min":0.249},"max":{"1min":4.444,"5min":10.933999999999999,"15min":12.388999999999999},"last":1.3420000000000001},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.718,"15min":1.4450000000000001},"min":{"1min":0.34000000000000002,"5min":0.33800000000000002,"15min":0.29699999999999999},"max":{"1min":5.9340000000000002,"5min":9.9900000000000002,"15min":12.438000000000001},"last":1.5429999999999999}]},{"osd":6,"last update":"Sat Feb 10 08:28:43 2024","interfaces":[{"interface":"back","average":{"1min":1.329,"5min":1.7010000000000001,"15min":1.387},"min":{"1min":0.376,"5min":0.35799999999999998,"15min":0.33600000000000002},"max":{"1min":4.274,"5min":9.3740000000000006,"15min":12.477},"last":0.44900000000000001},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.665,"15min":1.1499999999999999},"min":{"1min":0.40200000000000002,"5min":0.31,"15min":0.28499999999999998},"max":{"1min":5.5709999999999997,"5min":8.8640000000000008,"15min":12.324999999999999},"last":0.40600000000000003}]},{"osd":7,"last update":"Sat Feb 10 08:29:07 2024","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":1.7090000000000001,"15min":1.2030000000000001},"min":{"1min":0.41999999999999998,"5min":0.33400000000000002,"15min":0.28299999999999997},"max":{"1min":2.8599999999999999,"5min":8.9109999999999996,"15min":12.358000000000001},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.89600000000000002,"5min":1.9079999999999999,"15min":1.49},"min":{"1min":0.374,"5min":0.33000000000000002,"15min":0.26500000000000001},"max":{"1min":2.335,"5min":14.587,"15min":15.702},"last":0.39600000000000002}]}]},{"osd":4,"up_from":110,"seq":472446402668,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1383080,"kb_used_data":1081120,"kb_used_omap":0,"kb_used_meta":301951,"kb_avail":92362072,"statfs":{"total":95995035648,"available":94578761728,"internally_reserved":0,"allocated":1107066880,"data_stored":1106565139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":972,"internal_metadata":309197876},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:29:10 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":1.278,"15min":1.2829999999999999},"min":{"1min":0.25,"5min":0.24099999999999999,"15min":0.19800000000000001},"max":{"1min":3.7509999999999999,"5min":6.258,"15min":11.257999999999999},"last":0.251},{"interface":"front","average":{"1min":1.056,"5min":1.575,"15min":2.6949999999999998},"min":{"1min":0.28699999999999998,"5min":0.222,"15min":0.222},"max":{"1min":2.9239999999999999,"5min":12.84,"15min":16.524000000000001},"last":0.45600000000000002}]},{"osd":1,"last update":"Sat Feb 10 08:29:10 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":1.5609999999999999,"15min":1.9730000000000001},"min":{"1min":0.23899999999999999,"5min":0.218,"15min":0.218},"max":{"1min":2.028,"5min":12.472,"15min":12.472},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.77700000000000002,"5min":1.5009999999999999,"15min":1.8500000000000001},"min":{"1min":0.27400000000000002,"5min":0.217,"15min":0.217},"max":{"1min":2.5539999999999998,"5min":12.462,"15min":12.462},"last":0.32100000000000001}]},{"osd":2,"last update":"Sat Feb 10 08:29:10 2024","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.7070000000000001,"15min":1.9690000000000001},"min":{"1min":0.27400000000000002,"5min":0.218,"15min":0.218},"max":{"1min":3.5990000000000002,"5min":9.7539999999999996,"15min":9.7539999999999996},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":1.341,"15min":1.9059999999999999},"min":{"1min":0.27400000000000002,"5min":0.247,"15min":0.247},"max":{"1min":2,"5min":7.0490000000000004,"15min":8.9309999999999992},"last":0.49199999999999999}]},{"osd":3,"last update":"Sat Feb 10 08:29:10 2024","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":1.5229999999999999,"15min":2.0409999999999999},"min":{"1min":0.33100000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":2.9620000000000002,"5min":10.971,"15min":12.565},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.74399999999999999,"5min":1.244,"15min":1.6459999999999999},"min":{"1min":0.30399999999999999,"5min":0.27300000000000002,"15min":0.27200000000000002},"max":{"1min":1.9650000000000001,"5min":5.7160000000000002,"15min":11.648},"last":0.51800000000000002}]},{"osd":5,"last update":"Sat Feb 10 08:29:10 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":1.401,"15min":0.84399999999999997},"min":{"1min":0.29399999999999998,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":2.4670000000000001,"5min":41.488,"15min":41.488},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.98299999999999998,"5min":1.778,"15min":1.113},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":5.2140000000000004,"5min":42.527999999999999,"15min":42.527999999999999},"last":0.42599999999999999}]},{"osd":6,"last update":"Sat Feb 10 08:29:10 2024","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.6879999999999999,"15min":1.004},"min":{"1min":0.30599999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":3.734,"5min":39.554000000000002,"15min":39.554000000000002},"last":2.532},{"interface":"front","average":{"1min":0.624,"5min":1.427,"15min":1.038},"min":{"1min":0.33300000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":2.081,"5min":41.741999999999997,"15min":41.741999999999997},"last":0.53800000000000003}]},{"osd":7,"last update":"Sat Feb 10 08:29:10 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":1.23,"15min":0.97799999999999998},"min":{"1min":0.315,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":2.2069999999999999,"5min":11.047000000000001,"15min":11.047000000000001},"last":1.4570000000000001},{"interface":"front","average":{"1min":0.83499999999999996,"5min":1.1359999999999999,"15min":0.73899999999999999},"min":{"1min":0.39300000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":2.5270000000000001,"5min":5.7859999999999996,"15min":5.7859999999999996},"last":3.044}]}]},{"osd":5,"up_from":37,"seq":158913790119,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":3533928,"kb_used_data":3232608,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":90211224,"statfs":{"total":95995035648,"available":92376293376,"internally_reserved":0,"allocated":3310190592,"data_stored":3309689194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:29:15 2024","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":1.413,"15min":1.3999999999999999},"min":{"1min":0.26600000000000001,"5min":0.21299999999999999,"15min":0.20499999999999999},"max":{"1min":3.089,"5min":8.1110000000000007,"15min":22.914000000000001},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.746,"5min":1.387,"15min":1.244},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":2.4980000000000002,"5min":5.7169999999999996,"15min":23.161000000000001},"last":1.363}]},{"osd":1,"last update":"Sat Feb 10 08:29:15 2024","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.5169999999999999,"15min":1.1000000000000001},"min":{"1min":0.307,"5min":0.20699999999999999,"15min":0.19500000000000001},"max":{"1min":5.5069999999999997,"5min":7.5730000000000004,"15min":8.1289999999999996},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.94299999999999995,"5min":1.351,"15min":1.1040000000000001},"min":{"1min":0.32800000000000001,"5min":0.254,"15min":0.254},"max":{"1min":3.093,"5min":9.0579999999999998,"15min":9.0579999999999998},"last":0.93500000000000005}]},{"osd":2,"last update":"Sat Feb 10 08:29:15 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":1.2310000000000001,"15min":1.3120000000000001},"min":{"1min":0.31,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":3.637,"5min":5.6740000000000004,"15min":9.5709999999999997},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.80700000000000005,"5min":1.5049999999999999,"15min":1.2170000000000001},"min":{"1min":0.33400000000000002,"5min":0.28799999999999998,"15min":0.26400000000000001},"max":{"1min":3.726,"5min":7.585,"15min":9.2810000000000006},"last":0.55100000000000005}]},{"osd":3,"last update":"Sat Feb 10 08:29:15 2024","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":1.0620000000000001,"15min":1.137},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":3.6629999999999998,"5min":5.8789999999999996,"15min":24.198},"last":0.40000000000000002},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.464,"15min":1.351},"min":{"1min":0.35399999999999998,"5min":0.29799999999999999,"15min":0.25900000000000001},"max":{"1min":3.762,"5min":6.242,"15min":22.701000000000001},"last":0.51800000000000002}]},{"osd":4,"last update":"Sat Feb 10 08:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":1.2569999999999999,"15min":0.81100000000000005},"min":{"1min":0.26300000000000001,"5min":0.248,"15min":0.23599999999999999},"max":{"1min":3.6869999999999998,"5min":6.1120000000000001,"15min":6.1120000000000001},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.51700000000000002,"5min":1.1830000000000001,"15min":0.73099999999999998},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.22500000000000001},"max":{"1min":1.573,"5min":5.9720000000000004,"15min":5.9720000000000004},"last":0.89300000000000002}]},{"osd":6,"last update":"Sat Feb 10 08:28:41 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":1.2969999999999999,"15min":0.753},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":5.226,"5min":8.3559999999999999,"15min":8.3559999999999999},"last":1.647},{"interface":"front","average":{"1min":0.46999999999999997,"5min":1.1080000000000001,"15min":0.72799999999999998},"min":{"1min":0.33700000000000002,"5min":0.26300000000000001,"15min":0.23999999999999999},"max":{"1min":1.0720000000000001,"5min":6.3840000000000003,"15min":6.3840000000000003},"last":1.8440000000000001}]},{"osd":7,"last update":"Sat Feb 10 08:29:08 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":4.7119999999999997,"15min":1.909},"min":{"1min":0.312,"5min":0.26700000000000002,"15min":0.23799999999999999},"max":{"1min":6.4100000000000001,"5min":371.87400000000002,"15min":371.87400000000002},"last":0.71299999999999997},{"interface":"front","average":{"1min":1.026,"5min":4.9000000000000004,"15min":2.0259999999999998},"min":{"1min":0.32000000000000001,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":3.8090000000000002,"5min":372.63099999999997,"15min":372.63099999999997},"last":1.619}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":2118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1118961664,"data_stored":1118961664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3308519424,"data_stored":3308519424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2233663488,"data_stored":2233663488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1453326336,"data_stored":1453326336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1122369536,"data_stored":1122369536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":3336306688,"data_stored":3336306688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1114439680,"data_stored":1114439680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4052549632,"data_stored":4052549632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-10T08:29:43.326 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd pool set unique_pool_2 pgp_num 16 2024-02-10T08:29:43.327 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:43.328 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:29:43.429 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:29:43.480 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:43.504 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:29:43.511 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:43.511 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:29:43.612 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:29:43.656 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:43.680 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:29:43.685 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:43.685 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:29:43.786 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:29:43.838 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:43.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:42.844382+0000 mgr.y (mgr.14505) 489 : cluster [DBG] pgmap v590: 158 pgs: 1 active+remapped+backfill_toofull, 157 active+clean; 5.8 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 1.2 KiB/s rd, 82 MiB/s wr, 1.31k op/s; 12086/283371 objects misplaced (4.265%) 2024-02-10T08:29:43.908 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:42.844382+0000 mgr.y (mgr.14505) 489 : cluster [DBG] pgmap v590: 158 pgs: 1 active+remapped+backfill_toofull, 157 active+clean; 5.8 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 1.2 KiB/s rd, 82 MiB/s wr, 1.31k op/s; 12086/283371 objects misplaced (4.265%) 2024-02-10T08:29:44.055 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:29:44.062 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:44.062 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:29:44.159 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 66 16 97022 97006 91.8259 67.5 0.0112632 0.010886 2024-02-10T08:29:44.163 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:29:44.218 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:44.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:43 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:42.844382+0000 mgr.y (mgr.14505) 489 : cluster [DBG] pgmap v590: 158 pgs: 1 active+remapped+backfill_toofull, 157 active+clean; 5.8 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 1.2 KiB/s rd, 82 MiB/s wr, 1.31k op/s; 12086/283371 objects misplaced (4.265%) 2024-02-10T08:29:45.160 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 67 16 98166 98150 91.5225 71.5 0.0125162 0.0109223 2024-02-10T08:29:45.478 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:29:45.482 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:45.482 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:29:45.583 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:29:45.640 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:45.744 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:29:45.749 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:45.749 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:29:45.850 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:29:45.905 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:45.942 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:29:45.945 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:45.946 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:29:46.046 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:29:46.060 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:44.846781+0000 mgr.y (mgr.14505) 490 : cluster [DBG] pgmap v591: 158 pgs: 1 active+remapped+backfill_toofull, 157 active+clean; 5.8 GiB data, 20 GiB used, 696 GiB / 715 GiB avail; 852 B/s rd, 64 MiB/s wr, 1.03k op/s; 12086/286395 objects misplaced (4.220%) 2024-02-10T08:29:46.062 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:44.846781+0000 mgr.y (mgr.14505) 490 : cluster [DBG] pgmap v591: 158 pgs: 1 active+remapped+backfill_toofull, 157 active+clean; 5.8 GiB data, 20 GiB used, 696 GiB / 715 GiB avail; 852 B/s rd, 64 MiB/s wr, 1.03k op/s; 12086/286395 objects misplaced (4.220%) 2024-02-10T08:29:46.103 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:46.160 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 68 16 99233 99217 91.1573 66.6875 0.0122027 0.0109652 2024-02-10T08:29:46.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:44.846781+0000 mgr.y (mgr.14505) 490 : cluster [DBG] pgmap v591: 158 pgs: 1 active+remapped+backfill_toofull, 157 active+clean; 5.8 GiB data, 20 GiB used, 696 GiB / 715 GiB avail; 852 B/s rd, 64 MiB/s wr, 1.03k op/s; 12086/286395 objects misplaced (4.220%) 2024-02-10T08:29:46.458 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-02-10T08:29:46.458 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:29:46.790 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:29:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:29:46] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:29:47.160 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 69 16 100350 100334 90.848 69.8125 0.0103726 0.0110021 2024-02-10T08:29:47.404 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:29:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:29:47] "GET /metrics HTTP/1.1" 200 176189 "" "Prometheus/2.33.4" 2024-02-10T08:29:48.071 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:29:48.075 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:48.076 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:46.847297+0000 mgr.y (mgr.14505) 491 : cluster [DBG] pgmap v592: 158 pgs: 1 active+remapped+backfill_toofull, 157 active+clean; 5.8 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 852 B/s rd, 61 MiB/s wr, 971 op/s; 12086/287463 objects misplaced (4.204%) 2024-02-10T08:29:48.077 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:29:48.077 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:46.847297+0000 mgr.y (mgr.14505) 491 : cluster [DBG] pgmap v592: 158 pgs: 1 active+remapped+backfill_toofull, 157 active+clean; 5.8 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 852 B/s rd, 61 MiB/s wr, 971 op/s; 12086/287463 objects misplaced (4.204%) 2024-02-10T08:29:48.160 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 70 16 101455 101439 90.5368 69.0625 0.0166653 0.0110402 2024-02-10T08:29:48.177 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:29:48.232 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:46.847297+0000 mgr.y (mgr.14505) 491 : cluster [DBG] pgmap v592: 158 pgs: 1 active+remapped+backfill_toofull, 157 active+clean; 5.8 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 852 B/s rd, 61 MiB/s wr, 971 op/s; 12086/287463 objects misplaced (4.204%) 2024-02-10T08:29:48.235 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:48.267 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:29:48.269 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:48.270 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:29:48.371 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:29:48.429 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:48.541 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:29:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:29:48.733 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.1 dump_historic_ops 2024-02-10T08:29:48.971 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:29:48.271477+0000 mgr.y (mgr.14505) 492 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:29:48.973 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:29:48.271477+0000 mgr.y (mgr.14505) 492 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:29:48.993 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:29:49.010 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:49.011 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:29:49.112 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:29:49.160 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 71 16 102478 102462 90.1622 63.9375 0.0118141 0.0110867 2024-02-10T08:29:49.166 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:49.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:29:48.271477+0000 mgr.y (mgr.14505) 492 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:29:49.424 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:29:49.428 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:49.428 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:29:49.529 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:29:49.606 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:49.692 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:29:49.695 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:49.695 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:29:49.796 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:29:49.833 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:29:49.838 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:49.863 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:29:49.864 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:49.864 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:29:49.908 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:29:49.945 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:29:49.965 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:29:49.967 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:48.853768+0000 mgr.y (mgr.14505) 493 : cluster [DBG] pgmap v593: 158 pgs: 1 active+remapped+backfilling, 157 active+clean; 6.2 GiB data, 21 GiB used, 695 GiB / 715 GiB avail; 1.2 KiB/s rd, 85 MiB/s wr, 1.37k op/s; 12756/302961 objects misplaced (4.210%); 64 KiB/s, 0 objects/s recovering 2024-02-10T08:29:49.967 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:48.918319+0000 mon.a (mon.0) 1343 : cluster [INF] Health check cleared: PG_BACKFILL_FULL (was: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull) 2024-02-10T08:29:49.967 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:29:49.781736+0000 mon.a (mon.0) 1344 : audit [INF] from='client.? 172.21.15.18:0/1158150187' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:29:49.967 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:29:49.913351+0000 mon.b (mon.1) 68 : audit [DBG] from='client.? 172.21.15.18:0/742955157' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:29:50.005 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:29:50.005 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is set 2024-02-10T08:29:50.021 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:50.068 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:29:50.101 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:29:50.139 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:29:50.162 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 72 16 103360 103344 89.6738 55.125 0.0213002 0.0111469 2024-02-10T08:29:50.185 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:29:50.226 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:48.853768+0000 mgr.y (mgr.14505) 493 : cluster [DBG] pgmap v593: 158 pgs: 1 active+remapped+backfilling, 157 active+clean; 6.2 GiB data, 21 GiB used, 695 GiB / 715 GiB avail; 1.2 KiB/s rd, 85 MiB/s wr, 1.37k op/s; 12756/302961 objects misplaced (4.210%); 64 KiB/s, 0 objects/s recovering 2024-02-10T08:29:50.226 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:48.918319+0000 mon.a (mon.0) 1343 : cluster [INF] Health check cleared: PG_BACKFILL_FULL (was: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull) 2024-02-10T08:29:50.226 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:29:49.781736+0000 mon.a (mon.0) 1344 : audit [INF] from='client.? 172.21.15.18:0/1158150187' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:29:50.226 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:29:49.913351+0000 mon.b (mon.1) 68 : audit [DBG] from='client.? 172.21.15.18:0/742955157' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:29:50.245 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:29:50.282 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:29:50.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:49 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:48.853768+0000 mgr.y (mgr.14505) 493 : cluster [DBG] pgmap v593: 158 pgs: 1 active+remapped+backfilling, 157 active+clean; 6.2 GiB data, 21 GiB used, 695 GiB / 715 GiB avail; 1.2 KiB/s rd, 85 MiB/s wr, 1.37k op/s; 12756/302961 objects misplaced (4.210%); 64 KiB/s, 0 objects/s recovering 2024-02-10T08:29:50.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:49 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:48.918319+0000 mon.a (mon.0) 1343 : cluster [INF] Health check cleared: PG_BACKFILL_FULL (was: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull) 2024-02-10T08:29:50.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:49 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:29:49.781736+0000 mon.a (mon.0) 1344 : audit [INF] from='client.? 172.21.15.18:0/1158150187' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:29:50.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:49 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:29:49.913351+0000 mon.b (mon.1) 68 : audit [DBG] from='client.? 172.21.15.18:0/742955157' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:29:50.310 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-10T08:29:50.310 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-10T08:29:50.311 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-10T08:29:50.311 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-10T08:29:50.311 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-10T08:29:50.311 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-10T08:29:50.311 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-10T08:29:50.311 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-10T08:29:50.793 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:29:50.797 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:50.798 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:29:50.898 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:29:50.945 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:51.106 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:29:51.110 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:51.111 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:29:51.165 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 73 16 104415 104399 89.3447 65.9375 0.0143985 0.011188 2024-02-10T08:29:51.212 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:29:51.258 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:49.949013+0000 mon.a (mon.0) 1345 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:29:51.258 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:29:49.971810+0000 mon.a (mon.0) 1346 : audit [INF] from='client.? 172.21.15.18:0/1158150187' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-10T08:29:51.258 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:49.971862+0000 mon.a (mon.0) 1347 : cluster [DBG] osdmap e279: 8 total, 8 up, 8 in 2024-02-10T08:29:51.260 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:49.949013+0000 mon.a (mon.0) 1345 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:29:51.261 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:29:49.971810+0000 mon.a (mon.0) 1346 : audit [INF] from='client.? 172.21.15.18:0/1158150187' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-10T08:29:51.261 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:49.971862+0000 mon.a (mon.0) 1347 : cluster [DBG] osdmap e279: 8 total, 8 up, 8 in 2024-02-10T08:29:51.261 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:51.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:49.949013+0000 mon.a (mon.0) 1345 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:29:51.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:29:49.971810+0000 mon.a (mon.0) 1346 : audit [INF] from='client.? 172.21.15.18:0/1158150187' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-10T08:29:51.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:49.971862+0000 mon.a (mon.0) 1347 : cluster [DBG] osdmap e279: 8 total, 8 up, 8 in 2024-02-10T08:29:51.408 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:29:51.419 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:51.420 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:29:51.520 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:29:51.578 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:52.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:50.854214+0000 mgr.y (mgr.14505) 494 : cluster [DBG] pgmap v595: 158 pgs: 1 active+remapped+backfilling, 157 active+clean; 6.2 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 1022 B/s rd, 68 MiB/s wr, 1.09k op/s; 12756/304026 objects misplaced (4.196%); 77 KiB/s, 1 objects/s recovering 2024-02-10T08:29:52.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:50.854214+0000 mgr.y (mgr.14505) 494 : cluster [DBG] pgmap v595: 158 pgs: 1 active+remapped+backfilling, 157 active+clean; 6.2 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 1022 B/s rd, 68 MiB/s wr, 1.09k op/s; 12756/304026 objects misplaced (4.196%); 77 KiB/s, 1 objects/s recovering 2024-02-10T08:29:52.165 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 74 15 105458 105443 89.0192 65.25 0.0116168 0.0112289 2024-02-10T08:29:52.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:51 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:50.854214+0000 mgr.y (mgr.14505) 494 : cluster [DBG] pgmap v595: 158 pgs: 1 active+remapped+backfilling, 157 active+clean; 6.2 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 1022 B/s rd, 68 MiB/s wr, 1.09k op/s; 12756/304026 objects misplaced (4.196%); 77 KiB/s, 1 objects/s recovering 2024-02-10T08:29:53.060 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:29:53.067 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:53.067 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:29:53.165 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 75 16 106538 106522 88.7314 67.4375 0.00715335 0.0112652 2024-02-10T08:29:53.168 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:29:53.224 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:53.268 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:29:53.273 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:53.273 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:29:53.374 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:29:53.421 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:53.682 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:29:53.686 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:53.686 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:29:53.787 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:29:53.837 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:54.166 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 76 16 107596 107580 88.4337 66.125 0.0109748 0.011304 2024-02-10T08:29:54.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:53 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:52.854985+0000 mgr.y (mgr.14505) 495 : cluster [DBG] pgmap v596: 158 pgs: 1 active+remapped+backfilling, 157 active+clean; 6.4 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 1022 B/s rd, 67 MiB/s wr, 1.07k op/s; 13348/315579 objects misplaced (4.230%); 448 KiB/s, 6 objects/s recovering 2024-02-10T08:29:54.379 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:52.854985+0000 mgr.y (mgr.14505) 495 : cluster [DBG] pgmap v596: 158 pgs: 1 active+remapped+backfilling, 157 active+clean; 6.4 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 1022 B/s rd, 67 MiB/s wr, 1.07k op/s; 13348/315579 objects misplaced (4.230%); 448 KiB/s, 6 objects/s recovering 2024-02-10T08:29:54.384 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:52.854985+0000 mgr.y (mgr.14505) 495 : cluster [DBG] pgmap v596: 158 pgs: 1 active+remapped+backfilling, 157 active+clean; 6.4 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 1022 B/s rd, 67 MiB/s wr, 1.07k op/s; 13348/315579 objects misplaced (4.230%); 448 KiB/s, 6 objects/s recovering 2024-02-10T08:29:54.633 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:29:54.637 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:54.638 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:29:54.738 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:29:54.785 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:54.819 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:29:54.822 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:54.823 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:29:54.923 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:29:54.986 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:55.021 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:29:55.023 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:55.024 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:29:55.054 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-10T08:29:55.111 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd unset noscrub 2024-02-10T08:29:55.124 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:29:55.166 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-02-10T08:29:55.166 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-02-10T08:29:55.166 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-02-10T08:29:55.166 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-02-10T08:29:55.166 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.166 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:64572 7.b 7:d4591f65:::benchmark_data_smithi018_80623_object64571:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e102)", 2024-02-10T08:29:55.167 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:29.952114+0000", 2024-02-10T08:29:55.167 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 565.20697819999998, 2024-02-10T08:29:55.167 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.081601512000000001, 2024-02-10T08:29:55.167 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:29:55.167 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:29:55.167 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:29:55.167 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:29:55.167 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:29:55.167 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 64572 2024-02-10T08:29:55.167 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.167 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:29:55.167 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.167 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:29:55.167 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:29.952114+0000", 2024-02-10T08:29:55.168 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:29:55.168 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.168 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.168 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:29:55.168 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:29.952114+0000", 2024-02-10T08:29:55.168 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999981 2024-02-10T08:29:55.168 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.168 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.168 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:29:55.168 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:29.952112+0000", 2024-02-10T08:29:55.168 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0598000000000002e-05 2024-02-10T08:29:55.168 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.168 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.168 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:29:55.169 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:29.952133+0000", 2024-02-10T08:29:55.169 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0789e-05 2024-02-10T08:29:55.169 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.169 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.169 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:29:55.169 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:29.952144+0000", 2024-02-10T08:29:55.169 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5590000000000002e-06 2024-02-10T08:29:55.169 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.169 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.169 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:29:55.169 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:29.952150+0000", 2024-02-10T08:29:55.169 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9857000000000001e-05 2024-02-10T08:29:55.169 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.169 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.170 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:29:55.170 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:29.952190+0000", 2024-02-10T08:29:55.170 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.826e-06 2024-02-10T08:29:55.170 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.170 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.170 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-02-10T08:29:55.170 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:29.952195+0000", 2024-02-10T08:29:55.170 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.026224085000000001 2024-02-10T08:29:55.170 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.170 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.170 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:29:55.170 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:29.978419+0000", 2024-02-10T08:29:55.170 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000127121 2024-02-10T08:29:55.170 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.170 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.171 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:29:55.171 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:29.978546+0000", 2024-02-10T08:29:55.171 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015838399999999999 2024-02-10T08:29:55.171 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.171 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.171 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 5,6", 2024-02-10T08:29:55.171 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:29.978704+0000", 2024-02-10T08:29:55.171 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0073248339999999997 2024-02-10T08:29:55.171 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.171 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.171 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:29:55.171 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:29.986029+0000", 2024-02-10T08:29:55.171 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.031156205999999999 2024-02-10T08:29:55.171 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.171 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.172 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:29:55.172 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:30.017185+0000", 2024-02-10T08:29:55.172 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.016439120000000002 2024-02-10T08:29:55.172 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.172 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.172 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:29:55.172 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:30.033625+0000", 2024-02-10T08:29:55.172 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2543000000000002e-05 2024-02-10T08:29:55.172 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.172 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.172 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:29:55.172 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:30.033677+0000", 2024-02-10T08:29:55.172 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8359999999999999e-05 2024-02-10T08:29:55.172 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.173 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.173 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:29:55.173 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:30.033715+0000", 2024-02-10T08:29:55.173 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.081601512000000001 2024-02-10T08:29:55.173 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:55.173 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:29:55.173 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:55.173 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.173 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.173 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.14784.0:77149 7.d e107/91 7:bf968826:::benchmark_data_smithi018_80623_object77148:head v 107'4768, mlcod=107'4765)", 2024-02-10T08:29:55.173 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:20:42.079066+0000", 2024-02-10T08:29:55.173 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 553.08002589399996, 2024-02-10T08:29:55.173 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086684774000000006, 2024-02-10T08:29:55.173 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:29:55.174 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:29:55.174 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:29:55.174 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.174 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:29:55.174 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.079066+0000", 2024-02-10T08:29:55.174 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:29:55.174 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.174 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.174 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:29:55.174 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.079066+0000", 2024-02-10T08:29:55.174 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:29:55.174 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.174 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.174 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:29:55.174 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.079066+0000", 2024-02-10T08:29:55.174 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4546000000000002e-05 2024-02-10T08:29:55.175 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.175 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.175 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:29:55.175 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.079130+0000", 2024-02-10T08:29:55.175 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.515e-06 2024-02-10T08:29:55.175 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.175 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.175 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:29:55.175 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.079138+0000", 2024-02-10T08:29:55.175 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0929999999999996e-06 2024-02-10T08:29:55.175 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.175 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.175 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:29:55.175 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.079142+0000", 2024-02-10T08:29:55.175 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0508e-05 2024-02-10T08:29:55.176 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.176 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.176 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:29:55.176 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.079172+0000", 2024-02-10T08:29:55.176 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1972e-05 2024-02-10T08:29:55.176 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.176 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.176 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:29:55.176 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.079184+0000", 2024-02-10T08:29:55.176 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.084501413999999997 2024-02-10T08:29:55.176 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.176 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.176 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:29:55.176 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.163686+0000", 2024-02-10T08:29:55.176 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0020654459999999999 2024-02-10T08:29:55.177 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.177 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.177 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:29:55.177 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:20:42.165751+0000", 2024-02-10T08:29:55.177 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086684774000000006 2024-02-10T08:29:55.177 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:55.177 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:29:55.177 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:55.177 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.177 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.177 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:153198 7.b 7:d965b4d6:::benchmark_data_smithi018_80623_object52270:head [delete] snapc 0=[] ondisk+write+known_if_redirected e149)", 2024-02-10T08:29:55.177 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:22:37.562841+0000", 2024-02-10T08:29:55.177 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 437.59625095600001, 2024-02-10T08:29:55.177 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.068126513999999999, 2024-02-10T08:29:55.177 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:29:55.178 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:29:55.178 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:29:55.178 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:29:55.178 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:29:55.178 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 153198 2024-02-10T08:29:55.178 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.178 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:29:55.178 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.178 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:29:55.178 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.562841+0000", 2024-02-10T08:29:55.178 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:29:55.178 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.178 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.178 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:29:55.178 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.562841+0000", 2024-02-10T08:29:55.179 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:29:55.179 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.179 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.179 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:29:55.179 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.562841+0000", 2024-02-10T08:29:55.179 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1350000000000001e-06 2024-02-10T08:29:55.179 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.179 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.179 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:29:55.179 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.562844+0000", 2024-02-10T08:29:55.179 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0179999999999998e-06 2024-02-10T08:29:55.179 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.179 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.179 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:29:55.179 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.562850+0000", 2024-02-10T08:29:55.180 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3209999999999998e-06 2024-02-10T08:29:55.180 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.180 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.180 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:29:55.180 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.562854+0000", 2024-02-10T08:29:55.180 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00246437 2024-02-10T08:29:55.180 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.180 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.180 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:29:55.180 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.565318+0000", 2024-02-10T08:29:55.180 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000100599 2024-02-10T08:29:55.180 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.180 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.181 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:29:55.181 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.565419+0000", 2024-02-10T08:29:55.181 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012306099999999999 2024-02-10T08:29:55.181 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.181 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.181 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 5,6", 2024-02-10T08:29:55.181 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.565542+0000", 2024-02-10T08:29:55.181 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0020561189999999999 2024-02-10T08:29:55.181 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.181 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.181 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:29:55.181 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.567598+0000", 2024-02-10T08:29:55.181 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00075990599999999997 2024-02-10T08:29:55.181 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.182 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.182 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:29:55.182 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.568358+0000", 2024-02-10T08:29:55.182 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.062505851000000001 2024-02-10T08:29:55.182 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.182 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.182 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:29:55.182 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.630864+0000", 2024-02-10T08:29:55.182 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6558000000000003e-05 2024-02-10T08:29:55.182 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.182 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.182 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:29:55.182 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.630921+0000", 2024-02-10T08:29:55.182 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7172000000000002e-05 2024-02-10T08:29:55.183 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.183 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.183 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:29:55.183 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.630968+0000", 2024-02-10T08:29:55.183 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.068126513999999999 2024-02-10T08:29:55.183 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:55.183 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:29:55.183 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:55.183 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.183 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.183 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:153205 7.2 7:410b9e6c:::benchmark_data_smithi018_80623_object52277:head [delete] snapc 0=[] ondisk+write+known_if_redirected e149)", 2024-02-10T08:29:55.183 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:22:37.568270+0000", 2024-02-10T08:29:55.183 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 437.59082173299998, 2024-02-10T08:29:55.183 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.073131208000000003, 2024-02-10T08:29:55.184 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:29:55.184 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:29:55.184 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:29:55.184 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:29:55.184 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:29:55.184 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 153205 2024-02-10T08:29:55.184 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.184 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:29:55.184 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.184 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:29:55.184 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.568270+0000", 2024-02-10T08:29:55.184 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:29:55.184 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.184 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.184 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:29:55.185 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.568270+0000", 2024-02-10T08:29:55.185 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:29:55.185 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.185 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.185 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:29:55.185 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.568269+0000", 2024-02-10T08:29:55.185 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2200000000000003e-06 2024-02-10T08:29:55.185 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.185 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.185 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:29:55.185 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.568276+0000", 2024-02-10T08:29:55.185 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0849999999999997e-06 2024-02-10T08:29:55.185 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.185 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.185 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:29:55.185 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.568285+0000", 2024-02-10T08:29:55.186 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7649999999999999e-06 2024-02-10T08:29:55.186 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.186 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.186 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:29:55.186 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.568290+0000", 2024-02-10T08:29:55.186 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7422999999999995e-05 2024-02-10T08:29:55.186 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.186 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.186 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:29:55.186 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.568358+0000", 2024-02-10T08:29:55.186 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012063200000000001 2024-02-10T08:29:55.186 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.186 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.186 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:29:55.186 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.568478+0000", 2024-02-10T08:29:55.186 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013144900000000001 2024-02-10T08:29:55.187 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.187 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.187 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 2,3", 2024-02-10T08:29:55.187 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.568610+0000", 2024-02-10T08:29:55.187 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.063553605999999999 2024-02-10T08:29:55.187 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.187 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.187 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:29:55.187 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.632163+0000", 2024-02-10T08:29:55.187 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0066444420000000004 2024-02-10T08:29:55.187 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.187 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.187 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:29:55.187 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.638808+0000", 2024-02-10T08:29:55.187 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0025031630000000001 2024-02-10T08:29:55.188 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.188 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.188 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:29:55.188 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.641311+0000", 2024-02-10T08:29:55.188 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1916999999999998e-05 2024-02-10T08:29:55.188 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.188 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.188 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:29:55.188 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.641363+0000", 2024-02-10T08:29:55.188 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8655999999999997e-05 2024-02-10T08:29:55.188 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.188 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.188 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:29:55.188 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.641402+0000", 2024-02-10T08:29:55.189 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.073131208000000003 2024-02-10T08:29:55.189 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:55.189 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:29:55.189 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:55.189 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.189 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.189 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.14784.0:153201 7.0 e149/91 7:0da3817c:::benchmark_data_smithi018_80623_object52273:head v 149'9496, mlcod=149'9494)", 2024-02-10T08:29:55.189 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:22:37.568654+0000", 2024-02-10T08:29:55.189 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 437.59043823000002, 2024-02-10T08:29:55.189 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.073419021000000001, 2024-02-10T08:29:55.189 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:29:55.189 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:29:55.189 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:29:55.189 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.190 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:29:55.190 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.568654+0000", 2024-02-10T08:29:55.190 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:29:55.190 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.190 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.190 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:29:55.190 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.568654+0000", 2024-02-10T08:29:55.190 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:29:55.190 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.190 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.190 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:29:55.190 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.568653+0000", 2024-02-10T08:29:55.190 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2740000000000004e-06 2024-02-10T08:29:55.190 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.190 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.191 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:29:55.191 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.568660+0000", 2024-02-10T08:29:55.191 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.056815101 2024-02-10T08:29:55.191 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.191 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.191 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:29:55.191 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.625475+0000", 2024-02-10T08:29:55.191 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0129999999999996e-06 2024-02-10T08:29:55.191 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.191 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.191 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:29:55.191 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.625482+0000", 2024-02-10T08:29:55.191 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015673400000000001 2024-02-10T08:29:55.191 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.191 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.191 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:29:55.191 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.625638+0000", 2024-02-10T08:29:55.192 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1712000000000002e-05 2024-02-10T08:29:55.192 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.192 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.192 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:29:55.192 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.625660+0000", 2024-02-10T08:29:55.192 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.016385183000000001 2024-02-10T08:29:55.192 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.192 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.192 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:29:55.192 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.642045+0000", 2024-02-10T08:29:55.192 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7665999999999999e-05 2024-02-10T08:29:55.192 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.192 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.192 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:29:55.192 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:37.642073+0000", 2024-02-10T08:29:55.193 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.073419021000000001 2024-02-10T08:29:55.193 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:55.193 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:29:55.193 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:55.193 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.193 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.193 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:154696 7.2 7:40aef3be:::benchmark_data_smithi018_80623_object53768:head [delete] snapc 0=[] ondisk+write+known_if_redirected e149)", 2024-02-10T08:29:55.193 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:22:39.548912+0000", 2024-02-10T08:29:55.193 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 435.61018044100001, 2024-02-10T08:29:55.193 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.069045797000000006, 2024-02-10T08:29:55.193 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:29:55.193 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:29:55.193 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:29:55.193 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:29:55.193 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:29:55.193 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 154696 2024-02-10T08:29:55.194 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.194 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:29:55.194 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.194 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:29:55.194 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.548912+0000", 2024-02-10T08:29:55.194 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:29:55.194 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.194 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.194 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:29:55.194 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.548912+0000", 2024-02-10T08:29:55.194 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:29:55.194 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.194 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.194 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:29:55.194 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.548910+0000", 2024-02-10T08:29:55.194 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2210000000000002e-06 2024-02-10T08:29:55.195 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.195 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.195 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:29:55.195 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.548916+0000", 2024-02-10T08:29:55.195 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1537e-05 2024-02-10T08:29:55.195 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.195 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.195 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:29:55.195 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.548928+0000", 2024-02-10T08:29:55.195 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0400000000000004e-06 2024-02-10T08:29:55.195 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.195 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.195 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:29:55.195 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.548935+0000", 2024-02-10T08:29:55.195 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0695999999999998e-05 2024-02-10T08:29:55.195 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.196 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.196 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:29:55.196 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.548976+0000", 2024-02-10T08:29:55.196 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012357399999999999 2024-02-10T08:29:55.196 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.196 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.196 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:29:55.196 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.549099+0000", 2024-02-10T08:29:55.196 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000128446 2024-02-10T08:29:55.196 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.196 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.196 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 2,3", 2024-02-10T08:29:55.196 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.549228+0000", 2024-02-10T08:29:55.196 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0079650209999999992 2024-02-10T08:29:55.197 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.197 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.197 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:29:55.197 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.557193+0000", 2024-02-10T08:29:55.197 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0048933140000000002 2024-02-10T08:29:55.197 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.197 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.197 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:29:55.197 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.562086+0000", 2024-02-10T08:29:55.197 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.055774518000000002 2024-02-10T08:29:55.197 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.197 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.197 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:29:55.197 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.617860+0000", 2024-02-10T08:29:55.197 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5177999999999999e-05 2024-02-10T08:29:55.197 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.198 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.198 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:29:55.198 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.617916+0000", 2024-02-10T08:29:55.198 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1836999999999999e-05 2024-02-10T08:29:55.198 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.198 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.198 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:29:55.198 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.617958+0000", 2024-02-10T08:29:55.198 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.069045797000000006 2024-02-10T08:29:55.198 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:55.198 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:29:55.198 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:55.198 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.198 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.198 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:154715 7.2 7:44e78da6:::benchmark_data_smithi018_80623_object53787:head [delete] snapc 0=[] ondisk+write+known_if_redirected e149)", 2024-02-10T08:29:55.199 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:22:39.571888+0000", 2024-02-10T08:29:55.199 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 435.58720371200002, 2024-02-10T08:29:55.199 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.072221726, 2024-02-10T08:29:55.199 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:29:55.199 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:29:55.199 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:29:55.199 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:29:55.199 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:29:55.199 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 154715 2024-02-10T08:29:55.199 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.199 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:29:55.199 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.199 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:29:55.199 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.571888+0000", 2024-02-10T08:29:55.200 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:29:55.200 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.200 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.200 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:29:55.200 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.571888+0000", 2024-02-10T08:29:55.200 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:29:55.200 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.200 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.200 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:29:55.200 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.571888+0000", 2024-02-10T08:29:55.200 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8609999999999997e-06 2024-02-10T08:29:55.200 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.200 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.200 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:29:55.200 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.571893+0000", 2024-02-10T08:29:55.201 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4279999999999999e-06 2024-02-10T08:29:55.201 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.201 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.201 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:29:55.201 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.571900+0000", 2024-02-10T08:29:55.201 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9659999999999998e-06 2024-02-10T08:29:55.201 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.201 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.201 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:29:55.201 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.571904+0000", 2024-02-10T08:29:55.201 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9781000000000002e-05 2024-02-10T08:29:55.201 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.201 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.201 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:29:55.201 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.571934+0000", 2024-02-10T08:29:55.201 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5530000000000004e-05 2024-02-10T08:29:55.202 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.202 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.202 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:29:55.202 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.571999+0000", 2024-02-10T08:29:55.202 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6127999999999999e-05 2024-02-10T08:29:55.202 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.202 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.202 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 2,3", 2024-02-10T08:29:55.202 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.572085+0000", 2024-02-10T08:29:55.202 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001400089 2024-02-10T08:29:55.202 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.202 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.202 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:29:55.202 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.573485+0000", 2024-02-10T08:29:55.202 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.045431224999999999 2024-02-10T08:29:55.203 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.203 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.203 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:29:55.203 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.618917+0000", 2024-02-10T08:29:55.203 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.025093054 2024-02-10T08:29:55.203 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.203 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.203 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:29:55.203 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.644010+0000", 2024-02-10T08:29:55.203 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8428999999999999e-05 2024-02-10T08:29:55.203 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.203 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.203 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:29:55.203 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.644068+0000", 2024-02-10T08:29:55.203 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1990000000000003e-05 2024-02-10T08:29:55.203 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.204 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.204 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:29:55.204 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:39.644110+0000", 2024-02-10T08:29:55.204 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.072221726 2024-02-10T08:29:55.204 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:55.204 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:29:55.204 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:55.204 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.204 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.204 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:155167 7.2 7:48650d8a:::benchmark_data_smithi018_80623_object54239:head [delete] snapc 0=[] ondisk+write+known_if_redirected e149)", 2024-02-10T08:29:55.204 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:22:40.199455+0000", 2024-02-10T08:29:55.204 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 434.95963667900003, 2024-02-10T08:29:55.204 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.081791193999999998, 2024-02-10T08:29:55.204 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:29:55.204 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:29:55.205 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:29:55.205 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:29:55.205 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:29:55.205 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 155167 2024-02-10T08:29:55.205 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.205 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:29:55.205 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.205 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:29:55.205 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.199455+0000", 2024-02-10T08:29:55.205 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:29:55.205 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.205 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.205 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:29:55.205 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.199455+0000", 2024-02-10T08:29:55.205 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:29:55.205 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.206 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.206 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:29:55.206 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.199454+0000", 2024-02-10T08:29:55.206 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3420000000000002e-06 2024-02-10T08:29:55.206 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.206 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.206 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:29:55.206 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.199461+0000", 2024-02-10T08:29:55.206 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1419e-05 2024-02-10T08:29:55.206 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.206 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.206 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:29:55.206 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.199473+0000", 2024-02-10T08:29:55.206 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3630000000000002e-06 2024-02-10T08:29:55.206 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.207 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.207 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:29:55.207 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.199478+0000", 2024-02-10T08:29:55.207 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9564000000000002e-05 2024-02-10T08:29:55.207 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.207 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.207 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:29:55.207 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.199528+0000", 2024-02-10T08:29:55.207 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000114601 2024-02-10T08:29:55.207 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.207 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.207 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:29:55.207 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.199642+0000", 2024-02-10T08:29:55.207 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013268700000000001 2024-02-10T08:29:55.207 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.207 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.208 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 2,3", 2024-02-10T08:29:55.208 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.199775+0000", 2024-02-10T08:29:55.208 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0056025650000000003 2024-02-10T08:29:55.208 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.208 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.208 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:29:55.208 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.205377+0000", 2024-02-10T08:29:55.208 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011831441 2024-02-10T08:29:55.208 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.208 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.208 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:29:55.208 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.217209+0000", 2024-02-10T08:29:55.208 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.063949695000000001 2024-02-10T08:29:55.208 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.209 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.209 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:29:55.209 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.281159+0000", 2024-02-10T08:29:55.209 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9061999999999999e-05 2024-02-10T08:29:55.209 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.209 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.209 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:29:55.209 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.281208+0000", 2024-02-10T08:29:55.209 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9029000000000002e-05 2024-02-10T08:29:55.209 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.209 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.209 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:29:55.209 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.281247+0000", 2024-02-10T08:29:55.209 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.081791193999999998 2024-02-10T08:29:55.209 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:55.210 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:29:55.210 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:55.210 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.210 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.210 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:155666 7.2 7:4479b2d2:::benchmark_data_smithi018_80623_object54738:head [delete] snapc 0=[] ondisk+write+known_if_redirected e149)", 2024-02-10T08:29:55.210 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:22:40.892255+0000", 2024-02-10T08:29:55.210 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 434.26683726599998, 2024-02-10T08:29:55.210 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.078684826999999999, 2024-02-10T08:29:55.210 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:29:55.210 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:29:55.210 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:29:55.210 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:29:55.210 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:29:55.210 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 155666 2024-02-10T08:29:55.210 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.210 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:29:55.211 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.211 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:29:55.211 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.892255+0000", 2024-02-10T08:29:55.211 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:29:55.211 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.211 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.211 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:29:55.211 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.892255+0000", 2024-02-10T08:29:55.211 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:29:55.211 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.211 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.211 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:29:55.211 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.892254+0000", 2024-02-10T08:29:55.211 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1499999999999999e-06 2024-02-10T08:29:55.211 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.212 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.212 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:29:55.212 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.892258+0000", 2024-02-10T08:29:55.212 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5759999999999996e-06 2024-02-10T08:29:55.212 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.212 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.212 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:29:55.212 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.892263+0000", 2024-02-10T08:29:55.212 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1869999999999999e-06 2024-02-10T08:29:55.212 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.212 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.212 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:29:55.212 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.892267+0000", 2024-02-10T08:29:55.212 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002597387 2024-02-10T08:29:55.212 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.213 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.213 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:29:55.213 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.894865+0000", 2024-02-10T08:29:55.213 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010696699999999999 2024-02-10T08:29:55.213 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.213 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.213 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:29:55.213 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.894972+0000", 2024-02-10T08:29:55.213 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012987299999999999 2024-02-10T08:29:55.213 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.213 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.213 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 2,3", 2024-02-10T08:29:55.213 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.895102+0000", 2024-02-10T08:29:55.213 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0057554190000000003 2024-02-10T08:29:55.213 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.214 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.214 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:29:55.214 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.900857+0000", 2024-02-10T08:29:55.214 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0021897359999999999 2024-02-10T08:29:55.214 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.214 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.214 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:29:55.214 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.903047+0000", 2024-02-10T08:29:55.214 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.067804812000000006 2024-02-10T08:29:55.214 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.214 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.214 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:29:55.214 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.970851+0000", 2024-02-10T08:29:55.214 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9815999999999999e-05 2024-02-10T08:29:55.214 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.215 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.215 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:29:55.215 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.970901+0000", 2024-02-10T08:29:55.215 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8402000000000003e-05 2024-02-10T08:29:55.215 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.215 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.215 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:29:55.215 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:40.970940+0000", 2024-02-10T08:29:55.215 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.078684826999999999 2024-02-10T08:29:55.215 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:55.215 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:29:55.215 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:55.215 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.215 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.215 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:155939 7.2 7:49ed207d:::benchmark_data_smithi018_80623_object55011:head [delete] snapc 0=[] ondisk+write+known_if_redirected e149)", 2024-02-10T08:29:55.215 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:22:41.281367+0000", 2024-02-10T08:29:55.216 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 433.87772554399999, 2024-02-10T08:29:55.216 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.083337313999999996, 2024-02-10T08:29:55.216 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:29:55.216 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:29:55.216 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:29:55.216 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:29:55.216 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:29:55.216 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 155939 2024-02-10T08:29:55.216 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.216 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:29:55.216 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.216 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:29:55.216 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.281367+0000", 2024-02-10T08:29:55.216 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:29:55.216 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.216 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.217 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:29:55.217 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.281367+0000", 2024-02-10T08:29:55.217 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:29:55.217 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.217 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.217 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:29:55.217 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.281366+0000", 2024-02-10T08:29:55.217 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5899999999999998e-06 2024-02-10T08:29:55.217 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.217 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.217 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:29:55.217 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.281371+0000", 2024-02-10T08:29:55.217 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8969999999999997e-06 2024-02-10T08:29:55.217 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.218 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.218 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:29:55.218 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.281380+0000", 2024-02-10T08:29:55.218 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6119999999999998e-06 2024-02-10T08:29:55.218 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.218 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.218 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:29:55.218 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.281386+0000", 2024-02-10T08:29:55.218 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0033349830000000001 2024-02-10T08:29:55.218 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.218 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.218 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:29:55.218 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.284721+0000", 2024-02-10T08:29:55.218 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010802300000000001 2024-02-10T08:29:55.218 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.219 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.219 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:29:55.219 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.284829+0000", 2024-02-10T08:29:55.219 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012728199999999999 2024-02-10T08:29:55.219 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.219 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.219 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 2,3", 2024-02-10T08:29:55.219 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.284956+0000", 2024-02-10T08:29:55.219 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.012928574999999999 2024-02-10T08:29:55.219 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.219 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.219 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:29:55.219 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.297885+0000", 2024-02-10T08:29:55.219 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018071299999999999 2024-02-10T08:29:55.219 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.220 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.220 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:29:55.220 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.298065+0000", 2024-02-10T08:29:55.220 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.066551182 2024-02-10T08:29:55.220 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.220 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.220 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:29:55.220 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.364617+0000", 2024-02-10T08:29:55.220 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8584000000000001e-05 2024-02-10T08:29:55.220 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.220 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.220 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:29:55.220 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.364665+0000", 2024-02-10T08:29:55.220 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8834000000000001e-05 2024-02-10T08:29:55.221 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.221 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.221 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:29:55.221 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.364704+0000", 2024-02-10T08:29:55.221 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.083337313999999996 2024-02-10T08:29:55.221 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:55.221 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:29:55.221 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:55.221 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.221 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.221 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:156135 7.2 7:4200c1a2:::benchmark_data_smithi018_80623_object55207:head [delete] snapc 0=[] ondisk+write+known_if_redirected e149)", 2024-02-10T08:29:55.221 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:22:41.576363+0000", 2024-02-10T08:29:55.221 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 433.58272945499999, 2024-02-10T08:29:55.221 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.070036589999999996, 2024-02-10T08:29:55.221 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:29:55.221 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:29:55.222 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:29:55.222 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:29:55.222 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:29:55.222 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 156135 2024-02-10T08:29:55.222 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.222 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:29:55.222 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.222 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:29:55.222 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.576363+0000", 2024-02-10T08:29:55.222 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:29:55.222 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.222 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.222 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:29:55.222 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.576363+0000", 2024-02-10T08:29:55.223 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999981 2024-02-10T08:29:55.223 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.223 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.223 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:29:55.223 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.576361+0000", 2024-02-10T08:29:55.223 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2130000000000008e-06 2024-02-10T08:29:55.223 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.223 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.223 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:29:55.223 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.576369+0000", 2024-02-10T08:29:55.223 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2225000000000001e-05 2024-02-10T08:29:55.223 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.223 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.223 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:29:55.223 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.576381+0000", 2024-02-10T08:29:55.223 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9330000000000004e-06 2024-02-10T08:29:55.224 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.224 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.224 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:29:55.224 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.576388+0000", 2024-02-10T08:29:55.224 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00074003600000000001 2024-02-10T08:29:55.224 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.224 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.224 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:29:55.224 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.577128+0000", 2024-02-10T08:29:55.224 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000109788 2024-02-10T08:29:55.224 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.224 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.224 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:29:55.224 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.577238+0000", 2024-02-10T08:29:55.224 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012592699999999999 2024-02-10T08:29:55.225 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.225 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.225 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 2,3", 2024-02-10T08:29:55.225 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.577364+0000", 2024-02-10T08:29:55.225 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0058726539999999997 2024-02-10T08:29:55.225 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.225 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.225 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:29:55.225 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.583237+0000", 2024-02-10T08:29:55.225 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.029150738999999998 2024-02-10T08:29:55.225 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.225 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.225 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:29:55.225 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.612387+0000", 2024-02-10T08:29:55.225 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.033925438000000002 2024-02-10T08:29:55.225 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.226 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.226 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:29:55.226 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.646313+0000", 2024-02-10T08:29:55.226 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8245999999999999e-05 2024-02-10T08:29:55.226 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.226 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.226 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:29:55.226 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.646361+0000", 2024-02-10T08:29:55.226 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8219000000000001e-05 2024-02-10T08:29:55.226 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.226 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.226 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:29:55.226 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:41.646399+0000", 2024-02-10T08:29:55.226 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.070036589999999996 2024-02-10T08:29:55.226 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:55.227 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:29:55.227 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:55.227 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.227 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.227 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:158145 7.2 7:4e3f3d32:::benchmark_data_smithi018_80623_object57217:head [delete] snapc 0=[] ondisk+write+known_if_redirected e152)", 2024-02-10T08:29:55.227 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:22:44.856304+0000", 2024-02-10T08:29:55.227 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 430.302788228, 2024-02-10T08:29:55.227 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.090853510999999998, 2024-02-10T08:29:55.227 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:29:55.227 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:29:55.227 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:29:55.227 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:29:55.227 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:29:55.227 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 158145 2024-02-10T08:29:55.227 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.228 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:29:55.228 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.228 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:29:55.228 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.856304+0000", 2024-02-10T08:29:55.228 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:29:55.228 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.228 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.228 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:29:55.228 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.856304+0000", 2024-02-10T08:29:55.228 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:29:55.228 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.228 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.228 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:29:55.229 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.856303+0000", 2024-02-10T08:29:55.229 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6949999999999999e-06 2024-02-10T08:29:55.229 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.229 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.229 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:29:55.229 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.856308+0000", 2024-02-10T08:29:55.229 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5439999999999999e-06 2024-02-10T08:29:55.229 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.229 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.229 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:29:55.229 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.856316+0000", 2024-02-10T08:29:55.229 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1009999999999997e-06 2024-02-10T08:29:55.229 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.229 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.229 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:29:55.229 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.856322+0000", 2024-02-10T08:29:55.230 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0246e-05 2024-02-10T08:29:55.230 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.230 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.230 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:29:55.230 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.856373+0000", 2024-02-10T08:29:55.230 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000110302 2024-02-10T08:29:55.230 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.230 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.230 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:29:55.230 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.856483+0000", 2024-02-10T08:29:55.230 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012738499999999999 2024-02-10T08:29:55.230 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.230 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.230 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 2,3", 2024-02-10T08:29:55.230 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.856610+0000", 2024-02-10T08:29:55.231 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.014536597 2024-02-10T08:29:55.231 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.231 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.231 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:29:55.231 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.871147+0000", 2024-02-10T08:29:55.231 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.003922193 2024-02-10T08:29:55.231 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.231 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.231 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:29:55.231 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.875069+0000", 2024-02-10T08:29:55.231 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.072002255000000001 2024-02-10T08:29:55.231 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.231 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.231 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:29:55.231 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.947071+0000", 2024-02-10T08:29:55.232 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5423999999999997e-05 2024-02-10T08:29:55.232 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.232 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.232 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:29:55.232 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.947117+0000", 2024-02-10T08:29:55.232 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0692999999999998e-05 2024-02-10T08:29:55.232 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.232 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.232 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:29:55.232 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.947157+0000", 2024-02-10T08:29:55.232 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.090853510999999998 2024-02-10T08:29:55.232 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:55.232 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:29:55.232 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:55.233 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.233 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.233 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:158156 7.2 7:4b742d49:::benchmark_data_smithi018_80623_object57228:head [delete] snapc 0=[] ondisk+write+known_if_redirected e152)", 2024-02-10T08:29:55.233 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:22:44.875979+0000", 2024-02-10T08:29:55.233 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 430.28311343299998, 2024-02-10T08:29:55.233 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.079453853000000005, 2024-02-10T08:29:55.233 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:29:55.233 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:29:55.233 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:29:55.233 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:29:55.233 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:29:55.233 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 158156 2024-02-10T08:29:55.233 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.233 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:29:55.234 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.234 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:29:55.234 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.875979+0000", 2024-02-10T08:29:55.234 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:29:55.234 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.234 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.234 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:29:55.234 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.875979+0000", 2024-02-10T08:29:55.234 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999981 2024-02-10T08:29:55.234 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.234 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.234 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:29:55.234 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.875977+0000", 2024-02-10T08:29:55.234 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9209999999999998e-06 2024-02-10T08:29:55.235 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.235 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.235 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:29:55.235 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.875986+0000", 2024-02-10T08:29:55.235 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4076e-05 2024-02-10T08:29:55.235 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.235 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.235 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:29:55.235 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.876000+0000", 2024-02-10T08:29:55.235 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3319999999999992e-06 2024-02-10T08:29:55.235 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.235 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.235 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:29:55.235 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.876008+0000", 2024-02-10T08:29:55.235 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6607000000000002e-05 2024-02-10T08:29:55.236 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.236 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.236 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:29:55.236 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.876065+0000", 2024-02-10T08:29:55.236 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0260999999999995e-05 2024-02-10T08:29:55.236 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.236 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.236 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:29:55.236 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.876155+0000", 2024-02-10T08:29:55.236 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011905600000000001 2024-02-10T08:29:55.236 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.236 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.236 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 2,3", 2024-02-10T08:29:55.236 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.876274+0000", 2024-02-10T08:29:55.236 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001980435 2024-02-10T08:29:55.237 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.237 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.237 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:29:55.237 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.878254+0000", 2024-02-10T08:29:55.237 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00026547400000000003 2024-02-10T08:29:55.237 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.237 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.237 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:29:55.237 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.878520+0000", 2024-02-10T08:29:55.237 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.076825067999999996 2024-02-10T08:29:55.237 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.237 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.237 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:29:55.237 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.955345+0000", 2024-02-10T08:29:55.237 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7264e-05 2024-02-10T08:29:55.238 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.238 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.238 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:29:55.238 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.955392+0000", 2024-02-10T08:29:55.238 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0404000000000001e-05 2024-02-10T08:29:55.238 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.238 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.238 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:29:55.238 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.955433+0000", 2024-02-10T08:29:55.238 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.079453853000000005 2024-02-10T08:29:55.238 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:55.238 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:29:55.238 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:55.238 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.238 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.239 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:182653 7.2 7:4f924604:::benchmark_data_smithi018_80623_object81725:head [delete] snapc 0=[] ondisk+write+known_if_redirected e165)", 2024-02-10T08:29:55.239 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:23:19.802863+0000", 2024-02-10T08:29:55.239 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 395.35622944199997, 2024-02-10T08:29:55.239 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.092449144999999996, 2024-02-10T08:29:55.239 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:29:55.239 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:29:55.239 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:29:55.239 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:29:55.239 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:29:55.239 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 182653 2024-02-10T08:29:55.239 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.239 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:29:55.239 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.239 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:29:55.239 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.802863+0000", 2024-02-10T08:29:55.240 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:29:55.240 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.240 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.240 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:29:55.240 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.802863+0000", 2024-02-10T08:29:55.240 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:29:55.240 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.240 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.240 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:29:55.240 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.802861+0000", 2024-02-10T08:29:55.240 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.737e-06 2024-02-10T08:29:55.240 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.240 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.240 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:29:55.241 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.802868+0000", 2024-02-10T08:29:55.241 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0404999999999999e-05 2024-02-10T08:29:55.241 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.241 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.241 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:29:55.241 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.802878+0000", 2024-02-10T08:29:55.241 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7690000000000002e-06 2024-02-10T08:29:55.241 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.241 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.241 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:29:55.241 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.802884+0000", 2024-02-10T08:29:55.241 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0051375580000000004 2024-02-10T08:29:55.241 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.241 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.241 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:29:55.241 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.808022+0000", 2024-02-10T08:29:55.242 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000110547 2024-02-10T08:29:55.242 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.242 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.242 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:29:55.242 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.808132+0000", 2024-02-10T08:29:55.242 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012938500000000001 2024-02-10T08:29:55.242 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.242 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.242 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 2,3", 2024-02-10T08:29:55.242 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.808262+0000", 2024-02-10T08:29:55.242 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.061389966999999997 2024-02-10T08:29:55.242 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.242 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.242 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:29:55.242 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.869652+0000", 2024-02-10T08:29:55.243 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.01027989 2024-02-10T08:29:55.243 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.243 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.243 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:29:55.243 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.879931+0000", 2024-02-10T08:29:55.243 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015289181000000001 2024-02-10T08:29:55.243 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.243 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.243 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:29:55.243 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.895221+0000", 2024-02-10T08:29:55.243 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1431999999999998e-05 2024-02-10T08:29:55.243 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.243 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.243 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:29:55.244 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.895272+0000", 2024-02-10T08:29:55.244 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9768000000000003e-05 2024-02-10T08:29:55.244 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.244 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.244 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:29:55.244 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.895312+0000", 2024-02-10T08:29:55.244 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.092449144999999996 2024-02-10T08:29:55.244 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:55.244 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:29:55.244 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:55.244 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.244 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.244 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:182658 7.2 7:45e33f02:::benchmark_data_smithi018_80623_object81730:head [delete] snapc 0=[] ondisk+write+known_if_redirected e165)", 2024-02-10T08:29:55.244 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:23:19.809349+0000", 2024-02-10T08:29:55.244 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 395.34974314099998, 2024-02-10T08:29:55.245 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086067777999999998, 2024-02-10T08:29:55.245 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:29:55.245 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:29:55.245 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:29:55.245 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:29:55.245 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:29:55.245 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 182658 2024-02-10T08:29:55.245 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.245 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:29:55.245 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.245 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:29:55.245 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.809349+0000", 2024-02-10T08:29:55.245 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:29:55.245 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.245 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.245 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:29:55.246 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.809349+0000", 2024-02-10T08:29:55.246 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:29:55.246 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.246 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.246 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:29:55.246 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.809348+0000", 2024-02-10T08:29:55.246 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.501e-06 2024-02-10T08:29:55.246 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.246 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.246 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:29:55.246 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.809352+0000", 2024-02-10T08:29:55.246 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9429999999999999e-06 2024-02-10T08:29:55.246 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.246 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.246 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:29:55.247 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.809357+0000", 2024-02-10T08:29:55.247 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.185e-06 2024-02-10T08:29:55.247 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.247 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.247 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:29:55.247 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.809360+0000", 2024-02-10T08:29:55.247 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.060314260000000001 2024-02-10T08:29:55.247 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.247 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.247 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:29:55.247 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.869674+0000", 2024-02-10T08:29:55.247 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012447000000000001 2024-02-10T08:29:55.247 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.247 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.247 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:29:55.248 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.869799+0000", 2024-02-10T08:29:55.248 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000144707 2024-02-10T08:29:55.248 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.248 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.248 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 2,3", 2024-02-10T08:29:55.248 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.869943+0000", 2024-02-10T08:29:55.248 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0099495309999999993 2024-02-10T08:29:55.248 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.248 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.248 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:29:55.248 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.879893+0000", 2024-02-10T08:29:55.248 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0056066010000000001 2024-02-10T08:29:55.248 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.248 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.248 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:29:55.249 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.885499+0000", 2024-02-10T08:29:55.249 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0098464190000000004 2024-02-10T08:29:55.249 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.249 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.249 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:29:55.249 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.895346+0000", 2024-02-10T08:29:55.249 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6343000000000001e-05 2024-02-10T08:29:55.249 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.249 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.249 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:29:55.249 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.895382+0000", 2024-02-10T08:29:55.249 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4675000000000003e-05 2024-02-10T08:29:55.249 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.249 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.250 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:29:55.250 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:19.895417+0000", 2024-02-10T08:29:55.250 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086067777999999998 2024-02-10T08:29:55.250 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:55.250 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:29:55.250 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:55.250 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.250 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.250 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:184097 7.2 7:428fedb3:::benchmark_data_smithi018_80623_object83169:head [delete] snapc 0=[] ondisk+write+known_if_redirected e165)", 2024-02-10T08:29:55.250 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:23:21.936658+0000", 2024-02-10T08:29:55.250 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 393.22243411599999, 2024-02-10T08:29:55.250 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.075418111999999995, 2024-02-10T08:29:55.250 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:29:55.250 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:29:55.250 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:29:55.250 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:29:55.251 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:29:55.251 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 184097 2024-02-10T08:29:55.251 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.251 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:29:55.251 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.251 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:29:55.251 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:21.936658+0000", 2024-02-10T08:29:55.251 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:29:55.251 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.251 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.251 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:29:55.251 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:21.936658+0000", 2024-02-10T08:29:55.251 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:29:55.251 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.251 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.251 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:29:55.252 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:21.936657+0000", 2024-02-10T08:29:55.252 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5039999999999998e-06 2024-02-10T08:29:55.252 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.252 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.252 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:29:55.252 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:21.936661+0000", 2024-02-10T08:29:55.252 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1279999999999996e-06 2024-02-10T08:29:55.252 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.252 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.252 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:29:55.252 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:21.936667+0000", 2024-02-10T08:29:55.252 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5689999999999998e-06 2024-02-10T08:29:55.252 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.252 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.253 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:29:55.253 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:21.936672+0000", 2024-02-10T08:29:55.253 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0025274410000000001 2024-02-10T08:29:55.253 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.253 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.253 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:29:55.253 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:21.939199+0000", 2024-02-10T08:29:55.253 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000112501 2024-02-10T08:29:55.253 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.253 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.253 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:29:55.253 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:21.939312+0000", 2024-02-10T08:29:55.253 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013330199999999999 2024-02-10T08:29:55.253 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.253 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.253 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 2,3", 2024-02-10T08:29:55.254 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:21.939445+0000", 2024-02-10T08:29:55.254 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0030086000000000002 2024-02-10T08:29:55.254 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.254 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.254 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:29:55.254 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:21.942453+0000", 2024-02-10T08:29:55.254 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0054853810000000001 2024-02-10T08:29:55.254 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.254 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.254 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:29:55.254 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:21.947939+0000", 2024-02-10T08:29:55.254 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.064034720000000003 2024-02-10T08:29:55.254 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.254 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.254 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:29:55.255 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:22.011974+0000", 2024-02-10T08:29:55.255 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2256000000000002e-05 2024-02-10T08:29:55.255 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.255 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.255 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:29:55.255 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:22.012026+0000", 2024-02-10T08:29:55.255 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0303999999999998e-05 2024-02-10T08:29:55.255 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.255 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.255 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:29:55.255 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:22.012076+0000", 2024-02-10T08:29:55.255 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.075418111999999995 2024-02-10T08:29:55.255 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:55.255 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:29:55.255 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:55.255 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.256 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.256 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:184795 7.2 7:4f3b0903:::benchmark_data_smithi018_80623_object83867:head [delete] snapc 0=[] ondisk+write+known_if_redirected e165)", 2024-02-10T08:29:55.256 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:23:22.987095+0000", 2024-02-10T08:29:55.256 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 392.17199706999997, 2024-02-10T08:29:55.256 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.072374869999999994, 2024-02-10T08:29:55.256 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:29:55.256 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:29:55.256 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:29:55.256 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:29:55.256 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:29:55.256 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 184795 2024-02-10T08:29:55.256 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.256 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:29:55.256 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.257 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:29:55.257 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:22.987095+0000", 2024-02-10T08:29:55.257 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:29:55.257 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.257 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.257 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:29:55.257 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:22.987095+0000", 2024-02-10T08:29:55.257 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999976 2024-02-10T08:29:55.257 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.257 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.257 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:29:55.257 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:22.987093+0000", 2024-02-10T08:29:55.257 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7499999999999992e-06 2024-02-10T08:29:55.257 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.257 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.258 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:29:55.258 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:22.987102+0000", 2024-02-10T08:29:55.258 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2413e-05 2024-02-10T08:29:55.258 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.258 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.258 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:29:55.258 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:22.987114+0000", 2024-02-10T08:29:55.258 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5270000000000004e-06 2024-02-10T08:29:55.258 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.258 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.258 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:29:55.258 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:22.987121+0000", 2024-02-10T08:29:55.258 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6124000000000001e-05 2024-02-10T08:29:55.258 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.258 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.259 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:29:55.259 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:22.987167+0000", 2024-02-10T08:29:55.259 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000116276 2024-02-10T08:29:55.259 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.259 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.259 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:29:55.259 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:22.987283+0000", 2024-02-10T08:29:55.259 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013644699999999999 2024-02-10T08:29:55.259 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.259 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.259 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 2,3", 2024-02-10T08:29:55.259 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:22.987419+0000", 2024-02-10T08:29:55.259 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0025659419999999999 2024-02-10T08:29:55.259 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.259 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.260 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:29:55.260 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:22.989985+0000", 2024-02-10T08:29:55.260 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0037304819999999998 2024-02-10T08:29:55.260 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.260 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.260 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:29:55.260 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:22.993716+0000", 2024-02-10T08:29:55.260 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.065665486999999995 2024-02-10T08:29:55.260 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.260 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.260 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:29:55.260 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:23.059381+0000", 2024-02-10T08:29:55.260 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8535999999999997e-05 2024-02-10T08:29:55.260 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.261 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.261 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:29:55.261 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:23.059430+0000", 2024-02-10T08:29:55.261 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0151999999999998e-05 2024-02-10T08:29:55.261 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.261 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.261 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:29:55.261 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:23.059470+0000", 2024-02-10T08:29:55.261 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.072374869999999994 2024-02-10T08:29:55.261 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:55.261 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:29:55.261 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:55.261 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.261 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.261 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14964.0:70770 8.3 8:c5906313:::benchmark_data_smithi018_103312_object70769:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e209)", 2024-02-10T08:29:55.262 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:25:18.167936+0000", 2024-02-10T08:29:55.262 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 276.99115634899999, 2024-02-10T08:29:55.262 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.071705841000000006, 2024-02-10T08:29:55.262 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:29:55.262 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:29:55.262 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:29:55.262 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14964", 2024-02-10T08:29:55.262 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/3173131962", 2024-02-10T08:29:55.262 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 70770 2024-02-10T08:29:55.262 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.262 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:29:55.262 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.262 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:29:55.262 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:18.167936+0000", 2024-02-10T08:29:55.262 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:29:55.263 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.263 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.263 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:29:55.263 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:18.167936+0000", 2024-02-10T08:29:55.263 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999981 2024-02-10T08:29:55.263 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.263 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.263 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:29:55.263 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:18.167934+0000", 2024-02-10T08:29:55.263 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.6766000000000001e-05 2024-02-10T08:29:55.263 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.263 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.263 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:29:55.263 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:18.167961+0000", 2024-02-10T08:29:55.263 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2619000000000001e-05 2024-02-10T08:29:55.264 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.264 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.264 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:29:55.264 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:18.167973+0000", 2024-02-10T08:29:55.264 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5449999999999998e-06 2024-02-10T08:29:55.264 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.264 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.264 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:29:55.264 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:18.167981+0000", 2024-02-10T08:29:55.264 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1509999999999999e-05 2024-02-10T08:29:55.264 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.264 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.264 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:29:55.264 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:18.168042+0000", 2024-02-10T08:29:55.265 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014111199999999999 2024-02-10T08:29:55.265 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.265 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.265 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:29:55.265 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:18.168184+0000", 2024-02-10T08:29:55.265 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017789999999999999 2024-02-10T08:29:55.265 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.265 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.265 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 5,6", 2024-02-10T08:29:55.265 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:18.168361+0000", 2024-02-10T08:29:55.265 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0026412580000000001 2024-02-10T08:29:55.265 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.265 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.265 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:29:55.265 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:18.171003+0000", 2024-02-10T08:29:55.266 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0084240270000000006 2024-02-10T08:29:55.266 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.266 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.266 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:29:55.266 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:18.179427+0000", 2024-02-10T08:29:55.266 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.060128529 2024-02-10T08:29:55.266 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.266 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.266 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:29:55.266 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:18.239555+0000", 2024-02-10T08:29:55.266 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4583999999999999e-05 2024-02-10T08:29:55.266 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.266 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.266 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:29:55.266 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:18.239600+0000", 2024-02-10T08:29:55.267 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1802999999999999e-05 2024-02-10T08:29:55.267 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.267 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.267 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:29:55.267 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:18.239642+0000", 2024-02-10T08:29:55.267 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.071705841000000006 2024-02-10T08:29:55.267 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:55.267 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:29:55.267 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:55.267 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.267 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.267 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14964.0:70778 8.3 8:cda73e1b:::benchmark_data_smithi018_103312_object70777:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e209)", 2024-02-10T08:29:55.268 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 77 16 108557 108541 88.0631 60.0625 0.0333212 0.0113504 2024-02-10T08:29:55.268 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:25:18.171362+0000", 2024-02-10T08:29:55.269 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 276.98773021400001, 2024-02-10T08:29:55.269 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.068391459000000002, 2024-02-10T08:29:55.269 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:29:55.269 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:29:55.269 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:29:55.269 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14964", 2024-02-10T08:29:55.269 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/3173131962", 2024-02-10T08:29:55.269 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 70778 2024-02-10T08:29:55.269 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.269 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:29:55.269 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.269 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:29:55.269 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:18.171362+0000", 2024-02-10T08:29:55.270 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:29:55.270 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.270 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.270 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:29:55.270 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:18.171362+0000", 2024-02-10T08:29:55.270 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:29:55.270 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.270 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.270 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:29:55.270 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:18.171361+0000", 2024-02-10T08:29:55.270 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5360000000000001e-05 2024-02-10T08:29:55.270 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.270 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.270 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:29:55.270 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:18.171386+0000", 2024-02-10T08:29:55.271 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1195e-05 2024-02-10T08:29:55.271 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.271 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.271 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:29:55.271 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:18.171407+0000", 2024-02-10T08:29:55.271 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3359999999999997e-06 2024-02-10T08:29:55.271 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.271 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.271 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:29:55.271 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:18.171415+0000", 2024-02-10T08:29:55.271 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8318999999999997e-05 2024-02-10T08:29:55.271 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.271 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.271 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:29:55.272 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:18.171453+0000", 2024-02-10T08:29:55.272 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000117002 2024-02-10T08:29:55.272 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.272 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.272 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:29:55.272 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:18.171570+0000", 2024-02-10T08:29:55.272 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015448999999999999 2024-02-10T08:29:55.272 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.272 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.272 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 5,6", 2024-02-10T08:29:55.272 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:18.171724+0000", 2024-02-10T08:29:55.272 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0075935380000000004 2024-02-10T08:29:55.272 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.272 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.273 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:29:55.273 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:18.179318+0000", 2024-02-10T08:29:55.273 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.060132634999999997 2024-02-10T08:29:55.273 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.273 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.273 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:29:55.273 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:18.239451+0000", 2024-02-10T08:29:55.273 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00022795500000000001 2024-02-10T08:29:55.273 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.273 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.273 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:29:55.273 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:18.239678+0000", 2024-02-10T08:29:55.273 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0646999999999999e-05 2024-02-10T08:29:55.273 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.274 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.274 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:29:55.274 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:18.239719+0000", 2024-02-10T08:29:55.274 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4273000000000002e-05 2024-02-10T08:29:55.274 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.274 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.274 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:29:55.274 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:18.239753+0000", 2024-02-10T08:29:55.274 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.068391459000000002 2024-02-10T08:29:55.274 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:55.274 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:29:55.274 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:55.274 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.274 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.275 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14964.0:73145 8.a 8:5acaec24:::benchmark_data_smithi018_103312_object73144:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e209)", 2024-02-10T08:29:55.275 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:25:20.215525+0000", 2024-02-10T08:29:55.275 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 274.943566756, 2024-02-10T08:29:55.275 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.078879046999999994, 2024-02-10T08:29:55.275 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:29:55.275 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:29:55.275 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:29:55.275 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14964", 2024-02-10T08:29:55.275 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/3173131962", 2024-02-10T08:29:55.275 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 73145 2024-02-10T08:29:55.275 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.275 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:29:55.275 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.275 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:29:55.275 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:20.215525+0000", 2024-02-10T08:29:55.276 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:29:55.276 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.276 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.276 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:29:55.276 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:20.215525+0000", 2024-02-10T08:29:55.276 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:29:55.276 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.276 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.276 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:29:55.276 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:20.215524+0000", 2024-02-10T08:29:55.276 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2860000000000001e-05 2024-02-10T08:29:55.276 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.276 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.276 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:29:55.277 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:20.215547+0000", 2024-02-10T08:29:55.277 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2758999999999999e-05 2024-02-10T08:29:55.277 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.277 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.277 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:29:55.277 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:20.215560+0000", 2024-02-10T08:29:55.277 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8359999999999992e-06 2024-02-10T08:29:55.277 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.277 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.277 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:29:55.277 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:20.215567+0000", 2024-02-10T08:29:55.277 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1795000000000001e-05 2024-02-10T08:29:55.277 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.277 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.278 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:29:55.278 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:20.215619+0000", 2024-02-10T08:29:55.278 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8151000000000004e-05 2024-02-10T08:29:55.278 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.278 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.278 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:29:55.278 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:20.215707+0000", 2024-02-10T08:29:55.278 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7585999999999997e-05 2024-02-10T08:29:55.278 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.278 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.278 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 2,5", 2024-02-10T08:29:55.278 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:20.215805+0000", 2024-02-10T08:29:55.278 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0046909789999999996 2024-02-10T08:29:55.278 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.278 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.279 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:29:55.279 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:20.220496+0000", 2024-02-10T08:29:55.279 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0029217190000000001 2024-02-10T08:29:55.279 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.279 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.279 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:29:55.279 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:20.223418+0000", 2024-02-10T08:29:55.279 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.070824407000000006 2024-02-10T08:29:55.279 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.279 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.279 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:29:55.279 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:20.294242+0000", 2024-02-10T08:29:55.279 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000115182 2024-02-10T08:29:55.279 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.280 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.280 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:29:55.280 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:20.294357+0000", 2024-02-10T08:29:55.280 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7193e-05 2024-02-10T08:29:55.280 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:29:55.280 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:29:55.280 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:29:55.280 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:25:20.294404+0000", 2024-02-10T08:29:55.280 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.078879046999999994 2024-02-10T08:29:55.280 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:55.280 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:29:55.280 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:55.280 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:29:55.280 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:29:55.280 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-02-10T08:29:55.281 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:55.281 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:55.281 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:29:55.282 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:29:55.382 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:29:55.479 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:55.581 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:29:55.590 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:55.591 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:29:55.691 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:29:55.751 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:55.782 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:29:55.785 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:55.786 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:29:55.886 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:29:55.939 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:55.979 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:29:55.984 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:55.985 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:29:56.048 INFO:teuthology.orchestra.run.smithi018.stderr:set pool 9 pgp_num to 16 2024-02-10T08:29:56.085 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:29:56.139 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:56.169 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 78 16 109493 109477 87.6824 58.5 0.0150325 0.0114 2024-02-10T08:29:56.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:54.855541+0000 mgr.y (mgr.14505) 496 : cluster [DBG] pgmap v597: 158 pgs: 1 active+remapped+backfilling, 157 active+clean; 6.5 GiB data, 22 GiB used, 694 GiB / 715 GiB avail; 1023 B/s rd, 67 MiB/s wr, 1.07k op/s; 13348/318384 objects misplaced (4.192%); 448 KiB/s, 6 objects/s recovering 2024-02-10T08:29:56.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:29:55.110346+0000 mon.a (mon.0) 1348 : audit [INF] from='client.? 172.21.15.18:0/69308078' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "unique_pool_2", "var": "pgp_num", "val": "16"}]: dispatch 2024-02-10T08:29:56.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:54.855541+0000 mgr.y (mgr.14505) 496 : cluster [DBG] pgmap v597: 158 pgs: 1 active+remapped+backfilling, 157 active+clean; 6.5 GiB data, 22 GiB used, 694 GiB / 715 GiB avail; 1023 B/s rd, 67 MiB/s wr, 1.07k op/s; 13348/318384 objects misplaced (4.192%); 448 KiB/s, 6 objects/s recovering 2024-02-10T08:29:56.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:29:55.110346+0000 mon.a (mon.0) 1348 : audit [INF] from='client.? 172.21.15.18:0/69308078' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "unique_pool_2", "var": "pgp_num", "val": "16"}]: dispatch 2024-02-10T08:29:56.407 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:54.855541+0000 mgr.y (mgr.14505) 496 : cluster [DBG] pgmap v597: 158 pgs: 1 active+remapped+backfilling, 157 active+clean; 6.5 GiB data, 22 GiB used, 694 GiB / 715 GiB avail; 1023 B/s rd, 67 MiB/s wr, 1.07k op/s; 13348/318384 objects misplaced (4.192%); 448 KiB/s, 6 objects/s recovering 2024-02-10T08:29:56.407 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:29:55.110346+0000 mon.a (mon.0) 1348 : audit [INF] from='client.? 172.21.15.18:0/69308078' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "unique_pool_2", "var": "pgp_num", "val": "16"}]: dispatch 2024-02-10T08:29:56.618 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:29:56.623 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:56.624 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:29:56.724 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:29:56.788 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:56.789 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:29:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:29:56] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:29:57.169 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 79 16 110549 110533 87.4079 66 0.0190652 0.0114361 2024-02-10T08:29:57.294 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:29:56.016031+0000 mon.a (mon.0) 1349 : audit [INF] from='client.? 172.21.15.18:0/69308078' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "unique_pool_2", "var": "pgp_num", "val": "16"}]': finished 2024-02-10T08:29:57.294 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:56.016108+0000 mon.a (mon.0) 1350 : cluster [DBG] osdmap e280: 8 total, 8 up, 8 in 2024-02-10T08:29:57.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:29:56.016031+0000 mon.a (mon.0) 1349 : audit [INF] from='client.? 172.21.15.18:0/69308078' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "unique_pool_2", "var": "pgp_num", "val": "16"}]': finished 2024-02-10T08:29:57.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:56.016108+0000 mon.a (mon.0) 1350 : cluster [DBG] osdmap e280: 8 total, 8 up, 8 in 2024-02-10T08:29:57.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:29:56.016031+0000 mon.a (mon.0) 1349 : audit [INF] from='client.? 172.21.15.18:0/69308078' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "unique_pool_2", "var": "pgp_num", "val": "16"}]': finished 2024-02-10T08:29:57.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:56.016108+0000 mon.a (mon.0) 1350 : cluster [DBG] osdmap e280: 8 total, 8 up, 8 in 2024-02-10T08:29:57.405 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:29:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:29:57] "GET /metrics HTTP/1.1" 200 176189 "" "Prometheus/2.33.4" 2024-02-10T08:29:57.965 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:29:57.969 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:57.969 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:29:57.989 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.2 dump_ops_in_flight 2024-02-10T08:29:58.046 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:29:58.057 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:29:58.070 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:29:58.108 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:56.855946+0000 mgr.y (mgr.14505) 497 : cluster [DBG] pgmap v599: 158 pgs: 1 active+remapped+backfilling, 157 active+clean; 6.5 GiB data, 22 GiB used, 694 GiB / 715 GiB avail; 639 B/s rd, 43 MiB/s wr, 681 op/s; 13348/319305 objects misplaced (4.180%); 464 KiB/s, 7 objects/s recovering 2024-02-10T08:29:58.108 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:56.855946+0000 mgr.y (mgr.14505) 497 : cluster [DBG] pgmap v599: 158 pgs: 1 active+remapped+backfilling, 157 active+clean; 6.5 GiB data, 22 GiB used, 694 GiB / 715 GiB avail; 639 B/s rd, 43 MiB/s wr, 681 op/s; 13348/319305 objects misplaced (4.180%); 464 KiB/s, 7 objects/s recovering 2024-02-10T08:29:58.162 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:58.169 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:2024-02-10T08:29:58.169724+0000 min lat: 0.00124578 max lat: 2.57704 avg lat: 0.0114732 2024-02-10T08:29:58.169 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-02-10T08:29:58.169 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 80 15 111577 111562 87.1193 64.3125 0.0269975 0.0114732 2024-02-10T08:29:58.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:56.855946+0000 mgr.y (mgr.14505) 497 : cluster [DBG] pgmap v599: 158 pgs: 1 active+remapped+backfilling, 157 active+clean; 6.5 GiB data, 22 GiB used, 694 GiB / 715 GiB avail; 639 B/s rd, 43 MiB/s wr, 681 op/s; 13348/319305 objects misplaced (4.180%); 464 KiB/s, 7 objects/s recovering 2024-02-10T08:29:58.540 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:29:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:29:59.169 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 81 15 112586 112571 86.8223 63.0625 0.0118001 0.0115137 2024-02-10T08:29:59.274 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:29:59.284 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:59.284 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:29:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:29:58.282212+0000 mgr.y (mgr.14505) 498 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:29:59.284 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:29:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:29:58.282212+0000 mgr.y (mgr.14505) 498 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:29:59.285 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:29:59.386 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:29:59.446 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:29:59 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:29:58.282212+0000 mgr.y (mgr.14505) 498 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:29:59.449 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:59.481 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:29:59.485 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:59.486 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:29:59.586 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:29:59.637 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:29:59.869 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:29:59.874 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:29:59.875 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:29:59.975 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:30:00.024 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:00.051 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:30:00.054 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:00.055 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:30:00.155 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:30:00.169 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 82 16 113608 113592 86.5417 63.8125 0.0211577 0.0115507 2024-02-10T08:30:00.207 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:00.246 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:30:00.260 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:00.260 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:30:00.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:58.673063+0000 osd.2 (osd.2) 133 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:30:00.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:58.673119+0000 osd.2 (osd.2) 134 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:30:00.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:58.856858+0000 mgr.y (mgr.14505) 499 : cluster [DBG] pgmap v600: 158 pgs: 1 active+remapped+backfilling, 157 active+clean; 6.8 GiB data, 23 GiB used, 693 GiB / 715 GiB avail; 1.1 KiB/s rd, 69 MiB/s wr, 1.11k op/s; 13900/333618 objects misplaced (4.166%); 843 KiB/s, 13 objects/s recovering 2024-02-10T08:30:00.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:29:59.060627+0000 mon.a (mon.0) 1351 : cluster [DBG] osdmap e281: 8 total, 8 up, 8 in 2024-02-10T08:30:00.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:30:00.000084+0000 mon.a (mon.0) 1352 : cluster [WRN] Health detail: HEALTH_WARN noscrub,nodeep-scrub flag(s) set 2024-02-10T08:30:00.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:30:00.000109+0000 mon.a (mon.0) 1353 : cluster [WRN] [WRN] OSDMAP_FLAGS: noscrub,nodeep-scrub flag(s) set 2024-02-10T08:30:00.361 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:30:00.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:58.673063+0000 osd.2 (osd.2) 133 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:30:00.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:58.673119+0000 osd.2 (osd.2) 134 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:30:00.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:58.856858+0000 mgr.y (mgr.14505) 499 : cluster [DBG] pgmap v600: 158 pgs: 1 active+remapped+backfilling, 157 active+clean; 6.8 GiB data, 23 GiB used, 693 GiB / 715 GiB avail; 1.1 KiB/s rd, 69 MiB/s wr, 1.11k op/s; 13900/333618 objects misplaced (4.166%); 843 KiB/s, 13 objects/s recovering 2024-02-10T08:30:00.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:29:59.060627+0000 mon.a (mon.0) 1351 : cluster [DBG] osdmap e281: 8 total, 8 up, 8 in 2024-02-10T08:30:00.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:30:00.000084+0000 mon.a (mon.0) 1352 : cluster [WRN] Health detail: HEALTH_WARN noscrub,nodeep-scrub flag(s) set 2024-02-10T08:30:00.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:30:00.000109+0000 mon.a (mon.0) 1353 : cluster [WRN] [WRN] OSDMAP_FLAGS: noscrub,nodeep-scrub flag(s) set 2024-02-10T08:30:00.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:58.673063+0000 osd.2 (osd.2) 133 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:30:00.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:58.673119+0000 osd.2 (osd.2) 134 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:30:00.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:58.856858+0000 mgr.y (mgr.14505) 499 : cluster [DBG] pgmap v600: 158 pgs: 1 active+remapped+backfilling, 157 active+clean; 6.8 GiB data, 23 GiB used, 693 GiB / 715 GiB avail; 1.1 KiB/s rd, 69 MiB/s wr, 1.11k op/s; 13900/333618 objects misplaced (4.166%); 843 KiB/s, 13 objects/s recovering 2024-02-10T08:30:00.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:29:59.060627+0000 mon.a (mon.0) 1351 : cluster [DBG] osdmap e281: 8 total, 8 up, 8 in 2024-02-10T08:30:00.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:30:00.000084+0000 mon.a (mon.0) 1352 : cluster [WRN] Health detail: HEALTH_WARN noscrub,nodeep-scrub flag(s) set 2024-02-10T08:30:00.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:30:00.000109+0000 mon.a (mon.0) 1353 : cluster [WRN] [WRN] OSDMAP_FLAGS: noscrub,nodeep-scrub flag(s) set 2024-02-10T08:30:00.433 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:00.469 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:30:00.479 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:00.479 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:30:00.580 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:30:00.630 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:00.673 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:30:00.677 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:00.678 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:30:00.778 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:30:00.845 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:01.169 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 83 16 114645 114629 86.28 64.8125 0.0233313 0.0115854 2024-02-10T08:30:01.217 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:30:01.228 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:01.229 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:30:01.329 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:30:01.373 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:01.410 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:30:01.418 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:01.418 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:30:01.519 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:30:01.575 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:01.618 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:30:01.628 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:01.629 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:30:01.730 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:30:01.791 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:02.169 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 84 16 115635 115619 85.9895 61.875 0.0156786 0.0116249 2024-02-10T08:30:02.546 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:30:00.857410+0000 mgr.y (mgr.14505) 500 : cluster [DBG] pgmap v602: 158 pgs: 1 active+remapped+backfilling, 157 active+clean; 6.8 GiB data, 23 GiB used, 693 GiB / 715 GiB avail; 639 B/s rd, 49 MiB/s wr, 792 op/s; 13900/334593 objects misplaced (4.154%); 472 KiB/s, 7 objects/s recovering 2024-02-10T08:30:02.546 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:30:01.236894+0000 mon.a (mon.0) 1354 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:30:02.546 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:30:01.674956+0000 mon.a (mon.0) 1355 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:30:02.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:30:00.857410+0000 mgr.y (mgr.14505) 500 : cluster [DBG] pgmap v602: 158 pgs: 1 active+remapped+backfilling, 157 active+clean; 6.8 GiB data, 23 GiB used, 693 GiB / 715 GiB avail; 639 B/s rd, 49 MiB/s wr, 792 op/s; 13900/334593 objects misplaced (4.154%); 472 KiB/s, 7 objects/s recovering 2024-02-10T08:30:02.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:30:01.236894+0000 mon.a (mon.0) 1354 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:30:02.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:30:01.674956+0000 mon.a (mon.0) 1355 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:30:02.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:30:00.857410+0000 mgr.y (mgr.14505) 500 : cluster [DBG] pgmap v602: 158 pgs: 1 active+remapped+backfilling, 157 active+clean; 6.8 GiB data, 23 GiB used, 693 GiB / 715 GiB avail; 639 B/s rd, 49 MiB/s wr, 792 op/s; 13900/334593 objects misplaced (4.154%); 472 KiB/s, 7 objects/s recovering 2024-02-10T08:30:02.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:30:01.236894+0000 mon.a (mon.0) 1354 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:30:02.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:30:01.674956+0000 mon.a (mon.0) 1355 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:30:02.866 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 3, 4, 5, 6, 7, 0] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 5, 6, 7, 4] 2024-02-10T08:30:02.866 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-10T08:30:02.867 INFO:tasks.thrashosds.thrasher:Growing pool default.rgw.meta 2024-02-10T08:30:02.867 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph pg dump --format=json 2024-02-10T08:30:03.170 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 85 16 116710 116694 85.7681 67.1875 0.0119692 0.0116547 2024-02-10T08:30:03.258 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:30:02.297280+0000 osd.4 (osd.4) 80 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:30:03.258 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:30:02.297341+0000 osd.4 (osd.4) 81 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:30:03.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:30:02.297280+0000 osd.4 (osd.4) 80 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:30:03.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:30:02.297341+0000 osd.4 (osd.4) 81 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:30:03.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:30:02.297280+0000 osd.4 (osd.4) 80 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:30:03.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:30:02.297341+0000 osd.4 (osd.4) 81 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:30:04.170 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 86 16 117740 117724 85.5193 64.375 0.0144155 0.0116891 2024-02-10T08:30:04.544 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:30:02.858186+0000 mgr.y (mgr.14505) 501 : cluster [DBG] pgmap v603: 158 pgs: 1 active+remapped+backfilling, 157 active+clean; 7.0 GiB data, 23 GiB used, 692 GiB / 715 GiB avail; 1.2 KiB/s rd, 72 MiB/s wr, 1.15k op/s; 14368/345987 objects misplaced (4.153%); 936 KiB/s, 14 objects/s recovering 2024-02-10T08:30:04.544 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:30:03.256372+0000 mon.a (mon.0) 1356 : cluster [DBG] osdmap e282: 8 total, 8 up, 8 in 2024-02-10T08:30:04.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:30:02.858186+0000 mgr.y (mgr.14505) 501 : cluster [DBG] pgmap v603: 158 pgs: 1 active+remapped+backfilling, 157 active+clean; 7.0 GiB data, 23 GiB used, 692 GiB / 715 GiB avail; 1.2 KiB/s rd, 72 MiB/s wr, 1.15k op/s; 14368/345987 objects misplaced (4.153%); 936 KiB/s, 14 objects/s recovering 2024-02-10T08:30:04.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:30:03.256372+0000 mon.a (mon.0) 1356 : cluster [DBG] osdmap e282: 8 total, 8 up, 8 in 2024-02-10T08:30:04.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:30:02.858186+0000 mgr.y (mgr.14505) 501 : cluster [DBG] pgmap v603: 158 pgs: 1 active+remapped+backfilling, 157 active+clean; 7.0 GiB data, 23 GiB used, 692 GiB / 715 GiB avail; 1.2 KiB/s rd, 72 MiB/s wr, 1.15k op/s; 14368/345987 objects misplaced (4.153%); 936 KiB/s, 14 objects/s recovering 2024-02-10T08:30:04.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:30:03.256372+0000 mon.a (mon.0) 1356 : cluster [DBG] osdmap e282: 8 total, 8 up, 8 in 2024-02-10T08:30:05.170 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 87 16 118744 118728 85.2576 62.75 0.0148069 0.0117249 2024-02-10T08:30:05.370 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:30:05.434 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:30:05.521 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:30:04.467893+0000 mon.a (mon.0) 1357 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:30:05.521 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:30:04.471533+0000 mon.a (mon.0) 1358 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:30:05.521 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:30:04.482938+0000 mon.a (mon.0) 1359 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:30:05.521 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:05.522 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:30:04.467893+0000 mon.a (mon.0) 1357 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:30:05.522 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:30:04.471533+0000 mon.a (mon.0) 1358 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:30:05.522 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:30:04.482938+0000 mon.a (mon.0) 1359 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:30:05.522 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:30:05.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:30:04.467893+0000 mon.a (mon.0) 1357 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:30:05.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:30:04.471533+0000 mon.a (mon.0) 1358 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:30:05.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:30:04.482938+0000 mon.a (mon.0) 1359 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:30:05.594 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:30:05.623 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:30:05.693 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:06.171 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 88 16 119781 119765 85.0244 64.8125 0.0169643 0.0117567 2024-02-10T08:30:06.271 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:30:06.276 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:06.277 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:30:06.378 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:30:06.433 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:06.482 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:06.482 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:30:06.483 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:30:06.539 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:30:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:30:06] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:30:06.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:30:04.860249+0000 mgr.y (mgr.14505) 502 : cluster [DBG] pgmap v605: 158 pgs: 1 active+remapped+backfilling, 157 active+clean; 7.1 GiB data, 24 GiB used, 692 GiB / 715 GiB avail; 1.2 KiB/s rd, 77 MiB/s wr, 1.23k op/s; 14368/348786 objects misplaced (4.119%); 935 KiB/s, 14 objects/s recovering 2024-02-10T08:30:06.558 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:30:04.860249+0000 mgr.y (mgr.14505) 502 : cluster [DBG] pgmap v605: 158 pgs: 1 active+remapped+backfilling, 157 active+clean; 7.1 GiB data, 24 GiB used, 692 GiB / 715 GiB avail; 1.2 KiB/s rd, 77 MiB/s wr, 1.23k op/s; 14368/348786 objects misplaced (4.119%); 935 KiB/s, 14 objects/s recovering 2024-02-10T08:30:06.558 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:30:04.860249+0000 mgr.y (mgr.14505) 502 : cluster [DBG] pgmap v605: 158 pgs: 1 active+remapped+backfilling, 157 active+clean; 7.1 GiB data, 24 GiB used, 692 GiB / 715 GiB avail; 1.2 KiB/s rd, 77 MiB/s wr, 1.23k op/s; 14368/348786 objects misplaced (4.119%); 935 KiB/s, 14 objects/s recovering 2024-02-10T08:30:06.583 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:30:06.657 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:07.173 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 89 16 120739 120723 84.7405 59.875 0.0101341 0.0117968 2024-02-10T08:30:07.321 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is unset 2024-02-10T08:30:07.347 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:30:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:30:07] "GET /metrics HTTP/1.1" 200 176217 "" "Prometheus/2.33.4" 2024-02-10T08:30:07.348 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:30:07.143069+0000 mon.c (mon.2) 65 : audit [INF] from='client.? 172.21.15.18:0/392050724' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:30:07.348 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:30:07.143849+0000 mon.a (mon.0) 1360 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:30:07.348 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:30:07.143069+0000 mon.c (mon.2) 65 : audit [INF] from='client.? 172.21.15.18:0/392050724' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:30:07.348 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:30:07.143849+0000 mon.a (mon.0) 1360 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:30:07.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:30:07.143069+0000 mon.c (mon.2) 65 : audit [INF] from='client.? 172.21.15.18:0/392050724' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:30:07.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:30:07.143849+0000 mon.a (mon.0) 1360 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:30:08.046 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:30:08.055 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:08.056 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:30:08.157 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:30:08.173 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Total time run: 90.0043 2024-02-10T08:30:08.173 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Total writes made: 121736 2024-02-10T08:30:08.173 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Write size: 65536 2024-02-10T08:30:08.173 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Object size: 65536 2024-02-10T08:30:08.173 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Bandwidth (MB/sec): 84.5349 2024-02-10T08:30:08.173 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Stddev Bandwidth: 34.4161 2024-02-10T08:30:08.173 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Max bandwidth (MB/sec): 208.625 2024-02-10T08:30:08.173 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Min bandwidth (MB/sec): 0 2024-02-10T08:30:08.173 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Average IOPS: 1352 2024-02-10T08:30:08.173 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Stddev IOPS: 550.668 2024-02-10T08:30:08.173 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Max IOPS: 3338 2024-02-10T08:30:08.173 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Min IOPS: 0 2024-02-10T08:30:08.173 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Average Latency(s): 0.0118261 2024-02-10T08:30:08.174 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Stddev Latency(s): 0.0280295 2024-02-10T08:30:08.174 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Max latency(s): 2.57704 2024-02-10T08:30:08.174 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Min latency(s): 0.00124578 2024-02-10T08:30:08.177 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Cleaning up (deleting benchmark objects) 2024-02-10T08:30:08.196 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:08.313 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:30:06.867426+0000 mgr.y (mgr.14505) 503 : cluster [DBG] pgmap v606: 158 pgs: 1 active+remapped+backfilling, 157 active+clean; 7.1 GiB data, 24 GiB used, 692 GiB / 715 GiB avail; 639 B/s rd, 42 MiB/s wr, 673 op/s; 14368/349782 objects misplaced (4.108%); 463 KiB/s, 7 objects/s recovering 2024-02-10T08:30:08.313 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:30:07.284593+0000 mon.a (mon.0) 1361 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:30:08.314 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:30:07.295185+0000 mon.a (mon.0) 1362 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-10T08:30:08.314 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:30:07.295258+0000 mon.a (mon.0) 1363 : cluster [DBG] osdmap e283: 8 total, 8 up, 8 in 2024-02-10T08:30:08.629 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:30:06.867426+0000 mgr.y (mgr.14505) 503 : cluster [DBG] pgmap v606: 158 pgs: 1 active+remapped+backfilling, 157 active+clean; 7.1 GiB data, 24 GiB used, 692 GiB / 715 GiB avail; 639 B/s rd, 42 MiB/s wr, 673 op/s; 14368/349782 objects misplaced (4.108%); 463 KiB/s, 7 objects/s recovering 2024-02-10T08:30:08.629 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:30:07.284593+0000 mon.a (mon.0) 1361 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:30:08.629 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:30:07.295185+0000 mon.a (mon.0) 1362 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-10T08:30:08.630 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:30:07.295258+0000 mon.a (mon.0) 1363 : cluster [DBG] osdmap e283: 8 total, 8 up, 8 in 2024-02-10T08:30:08.789 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:30:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:30:08.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:30:06.867426+0000 mgr.y (mgr.14505) 503 : cluster [DBG] pgmap v606: 158 pgs: 1 active+remapped+backfilling, 157 active+clean; 7.1 GiB data, 24 GiB used, 692 GiB / 715 GiB avail; 639 B/s rd, 42 MiB/s wr, 673 op/s; 14368/349782 objects misplaced (4.108%); 463 KiB/s, 7 objects/s recovering 2024-02-10T08:30:08.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:30:07.284593+0000 mon.a (mon.0) 1361 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:30:08.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:30:07.295185+0000 mon.a (mon.0) 1362 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-10T08:30:08.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:30:07.295258+0000 mon.a (mon.0) 1363 : cluster [DBG] osdmap e283: 8 total, 8 up, 8 in 2024-02-10T08:30:09.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:30:08.292576+0000 mgr.y (mgr.14505) 504 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:30:09.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:30:08.436990+0000 osd.3 (osd.3) 103 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:30:09.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:30:08.437052+0000 osd.3 (osd.3) 104 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:30:09.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:30:08.292576+0000 mgr.y (mgr.14505) 504 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:30:09.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:30:08.436990+0000 osd.3 (osd.3) 103 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:30:09.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:30:08.437052+0000 osd.3 (osd.3) 104 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:30:09.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:30:08.292576+0000 mgr.y (mgr.14505) 504 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:30:09.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:30:08.436990+0000 osd.3 (osd.3) 103 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:30:09.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:30:08.437052+0000 osd.3 (osd.3) 104 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:30:10.058 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:30:10.066 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:10.066 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:30:10.167 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:30:10.210 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:10.250 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:30:10.253 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:10.254 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:30:10.355 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:30:10.413 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:10.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:30:08.871185+0000 mgr.y (mgr.14505) 505 : cluster [DBG] pgmap v608: 158 pgs: 1 active+remapped+backfilling, 157 active+clean; 7.4 GiB data, 24 GiB used, 691 GiB / 715 GiB avail; 1.2 KiB/s rd, 77 MiB/s wr, 1.23k op/s; 14860/364074 objects misplaced (4.082%); 926 KiB/s, 14 objects/s recovering 2024-02-10T08:30:10.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:30:09.323704+0000 mon.a (mon.0) 1364 : cluster [DBG] osdmap e284: 8 total, 8 up, 8 in 2024-02-10T08:30:10.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:30:09.398245+0000 mon.a (mon.0) 1365 : audit [DBG] from='client.? 172.21.15.18:0/2456636688' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:30:10.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:30:08.871185+0000 mgr.y (mgr.14505) 505 : cluster [DBG] pgmap v608: 158 pgs: 1 active+remapped+backfilling, 157 active+clean; 7.4 GiB data, 24 GiB used, 691 GiB / 715 GiB avail; 1.2 KiB/s rd, 77 MiB/s wr, 1.23k op/s; 14860/364074 objects misplaced (4.082%); 926 KiB/s, 14 objects/s recovering 2024-02-10T08:30:10.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:30:09.323704+0000 mon.a (mon.0) 1364 : cluster [DBG] osdmap e284: 8 total, 8 up, 8 in 2024-02-10T08:30:10.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:30:09.398245+0000 mon.a (mon.0) 1365 : audit [DBG] from='client.? 172.21.15.18:0/2456636688' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:30:10.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:30:08.871185+0000 mgr.y (mgr.14505) 505 : cluster [DBG] pgmap v608: 158 pgs: 1 active+remapped+backfilling, 157 active+clean; 7.4 GiB data, 24 GiB used, 691 GiB / 715 GiB avail; 1.2 KiB/s rd, 77 MiB/s wr, 1.23k op/s; 14860/364074 objects misplaced (4.082%); 926 KiB/s, 14 objects/s recovering 2024-02-10T08:30:10.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:30:09.323704+0000 mon.a (mon.0) 1364 : cluster [DBG] osdmap e284: 8 total, 8 up, 8 in 2024-02-10T08:30:10.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:30:09.398245+0000 mon.a (mon.0) 1365 : audit [DBG] from='client.? 172.21.15.18:0/2456636688' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:30:11.024 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-02-10T08:30:11.024 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:30:11.286 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:30:11.290 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:11.291 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:30:11.392 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:30:11.435 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:30:11.435 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:30:11.435 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:30:11.435 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:30:11.435 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:30:11.435 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:30:11.435 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:30:11.435 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:30:11.436 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-10T08:30:11.436 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-10T08:30:11.436 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-10T08:30:11.436 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-10T08:30:11.436 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-10T08:30:11.436 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-10T08:30:11.436 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-10T08:30:11.436 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-10T08:30:11.445 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:11.489 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:30:11.496 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:11.497 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:30:11.598 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:30:11.662 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:11.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:30:10.871714+0000 mgr.y (mgr.14505) 506 : cluster [DBG] pgmap v610: 158 pgs: 1 active+remapped+backfilling, 157 active+clean; 7.4 GiB data, 25 GiB used, 691 GiB / 715 GiB avail; 672 B/s rd, 43 MiB/s wr, 712 op/s; 14860/364305 objects misplaced (4.079%); 488 KiB/s, 7 objects/s recovering 2024-02-10T08:30:11.934 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd unset nodeep-scrub 2024-02-10T08:30:11.987 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:30:10.871714+0000 mgr.y (mgr.14505) 506 : cluster [DBG] pgmap v610: 158 pgs: 1 active+remapped+backfilling, 157 active+clean; 7.4 GiB data, 25 GiB used, 691 GiB / 715 GiB avail; 672 B/s rd, 43 MiB/s wr, 712 op/s; 14860/364305 objects misplaced (4.079%); 488 KiB/s, 7 objects/s recovering 2024-02-10T08:30:11.988 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:30:10.871714+0000 mgr.y (mgr.14505) 506 : cluster [DBG] pgmap v610: 158 pgs: 1 active+remapped+backfilling, 157 active+clean; 7.4 GiB data, 25 GiB used, 691 GiB / 715 GiB avail; 672 B/s rd, 43 MiB/s wr, 712 op/s; 14860/364305 objects misplaced (4.079%); 488 KiB/s, 7 objects/s recovering 2024-02-10T08:30:12.240 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:12.240 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:30:12.241 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:30:12.342 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:30:12.396 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:12.605 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:30:12.609 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:12.610 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:30:12.711 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:30:12.767 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:12.798 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:30:12.801 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:12.802 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:30:12.875 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:30:12.889 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-02-10T08:30:12.902 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:30:12.935 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:12.971 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:30:12.975 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:12.975 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:30:13.076 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:30:13.135 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:13.176 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:30:13.180 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:13.181 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:30:13.281 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:30:13.340 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:13.485 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:30:13.492 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:13.493 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:30:13.514 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.2 dump_blocked_ops 2024-02-10T08:30:13.593 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:30:13.674 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:13.835 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:30:13.839 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:13.840 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:30:13.940 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:30:13.994 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:14.025 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:30:14.034 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:14.035 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:30:14.136 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:30:14.215 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:30:12.847408+0000 mgr.y (mgr.14505) 507 : audit [DBG] from='client.25210 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-10T08:30:14.216 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:30:12.875809+0000 mgr.y (mgr.14505) 508 : cluster [DBG] pgmap v611: 158 pgs: 1 active+remapped+backfilling, 157 active+clean; 7.2 GiB data, 24 GiB used, 691 GiB / 715 GiB avail; 1.4 KiB/s rd, 44 MiB/s wr, 1.18k op/s; 14256/354426 objects misplaced (4.022%); 926 KiB/s, 14 objects/s recovering 2024-02-10T08:30:14.216 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:14.240 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:30:14.247 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:14.248 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:30:14.264 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-10T08:30:14.302 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:30:12.847408+0000 mgr.y (mgr.14505) 507 : audit [DBG] from='client.25210 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-10T08:30:14.302 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:30:12.875809+0000 mgr.y (mgr.14505) 508 : cluster [DBG] pgmap v611: 158 pgs: 1 active+remapped+backfilling, 157 active+clean; 7.2 GiB data, 24 GiB used, 691 GiB / 715 GiB avail; 1.4 KiB/s rd, 44 MiB/s wr, 1.18k op/s; 14256/354426 objects misplaced (4.022%); 926 KiB/s, 14 objects/s recovering 2024-02-10T08:30:14.302 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:30:12.847408+0000 mgr.y (mgr.14505) 507 : audit [DBG] from='client.25210 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-10T08:30:14.302 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:30:12.875809+0000 mgr.y (mgr.14505) 508 : cluster [DBG] pgmap v611: 158 pgs: 1 active+remapped+backfilling, 157 active+clean; 7.2 GiB data, 24 GiB used, 691 GiB / 715 GiB avail; 1.4 KiB/s rd, 44 MiB/s wr, 1.18k op/s; 14256/354426 objects misplaced (4.022%); 926 KiB/s, 14 objects/s recovering 2024-02-10T08:30:14.333 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:30:14.348 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:30:14.365 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":610,"stamp":"2024-02-10T08:30:10.871348+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":7945787038,"num_objects":121435,"num_object_clones":0,"num_object_copies":364305,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":14860,"num_objects_unfound":0,"num_objects_dirty":121435,"num_whiteouts":0,"num_read":1903,"num_read_kb":1655,"num_write":122203,"num_write_kb":7767465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":390,"num_bytes_recovered":16127636,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79818,"ondisk_log_size":79818,"up":474,"acting":474,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":476,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":25691316,"kb_used_data":23263732,"kb_used_omap":0,"kb_used_meta":2427519,"kb_avail":724269900,"statfs":{"total":767960285184,"available":741652377600,"internally_reserved":0,"allocated":23822061568,"data_stored":23819249092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":972,"internal_metadata":2485779508},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,3,12,6,1,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":339017728,"num_objects":5173,"num_object_clones":0,"num_object_copies":15519,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":492,"num_objects_unfound":0,"num_objects_dirty":5173,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5419,"num_write_kb":338944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":58,"num_bytes_recovered":3801088,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.613827"},"pg_stats":[{"pgid":"6.29","version":"76'2","reported_seq":212,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.267682+0000","last_change":"2024-02-10T08:28:02.797804+0000","last_active":"2024-02-10T08:30:03.267682+0000","last_peered":"2024-02-10T08:30:03.267682+0000","last_clean":"2024-02-10T08:30:03.267682+0000","last_became_active":"2024-02-10T08:28:02.767822+0000","last_became_peered":"2024-02-10T08:28:02.767822+0000","last_unstale":"2024-02-10T08:30:03.267682+0000","last_undegraded":"2024-02-10T08:30:03.267682+0000","last_fullsized":"2024-02-10T08:30:03.267682+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":6,"last_scrub":"76'2","last_scrub_stamp":"2024-02-10T08:19:28.458129+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2024-02-10T08:18:08.680038+0000","last_clean_scrub_stamp":"2024-02-10T08:19:28.458129+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":26,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,0],"acting":[7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":254,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.270582+0000","last_change":"2024-02-10T08:26:32.121942+0000","last_active":"2024-02-10T08:30:03.270582+0000","last_peered":"2024-02-10T08:30:03.270582+0000","last_clean":"2024-02-10T08:30:03.270582+0000","last_became_active":"2024-02-10T08:22:00.578118+0000","last_became_peered":"2024-02-10T08:22:00.578118+0000","last_unstale":"2024-02-10T08:30:03.270582+0000","last_undegraded":"2024-02-10T08:30:03.270582+0000","last_fullsized":"2024-02-10T08:30:03.270582+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:26:32.121852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:26:32.121852+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,6],"acting":[2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":178,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.275314+0000","last_change":"2024-02-10T08:29:17.607943+0000","last_active":"2024-02-10T08:30:03.275314+0000","last_peered":"2024-02-10T08:30:03.275314+0000","last_clean":"2024-02-10T08:30:03.275314+0000","last_became_active":"2024-02-10T08:23:15.079456+0000","last_became_peered":"2024-02-10T08:23:15.079456+0000","last_unstale":"2024-02-10T08:30:03.275314+0000","last_undegraded":"2024-02-10T08:30:03.275314+0000","last_fullsized":"2024-02-10T08:30:03.275314+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:17.607818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:17.607818+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":173,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.259992+0000","last_change":"2024-02-10T08:29:02.618622+0000","last_active":"2024-02-10T08:30:03.259992+0000","last_peered":"2024-02-10T08:30:03.259992+0000","last_clean":"2024-02-10T08:30:03.259992+0000","last_became_active":"2024-02-10T08:23:15.077457+0000","last_became_peered":"2024-02-10T08:23:15.077457+0000","last_unstale":"2024-02-10T08:30:03.259992+0000","last_undegraded":"2024-02-10T08:30:03.259992+0000","last_fullsized":"2024-02-10T08:30:03.259992+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:02.618499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:02.618499+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":279,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.274439+0000","last_change":"2024-02-10T08:29:21.602049+0000","last_active":"2024-02-10T08:30:03.274439+0000","last_peered":"2024-02-10T08:30:03.274439+0000","last_clean":"2024-02-10T08:30:03.274439+0000","last_became_active":"2024-02-10T08:27:27.710587+0000","last_became_peered":"2024-02-10T08:27:27.710587+0000","last_unstale":"2024-02-10T08:30:03.274439+0000","last_undegraded":"2024-02-10T08:30:03.274439+0000","last_fullsized":"2024-02-10T08:30:03.274439+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:21.601953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:11.750537+0000","last_clean_scrub_stamp":"2024-02-10T08:29:21.601953+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,1],"acting":[6,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":269,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.265600+0000","last_change":"2024-02-10T08:29:19.225386+0000","last_active":"2024-02-10T08:30:03.265600+0000","last_peered":"2024-02-10T08:30:03.265600+0000","last_clean":"2024-02-10T08:30:03.265600+0000","last_became_active":"2024-02-10T08:23:15.064896+0000","last_became_peered":"2024-02-10T08:23:15.064896+0000","last_unstale":"2024-02-10T08:30:03.265600+0000","last_undegraded":"2024-02-10T08:30:03.265600+0000","last_fullsized":"2024-02-10T08:30:03.265600+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:19.225297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:19.225297+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":153,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.263601+0000","last_change":"2024-02-10T08:29:22.556568+0000","last_active":"2024-02-10T08:30:03.263601+0000","last_peered":"2024-02-10T08:30:03.263601+0000","last_clean":"2024-02-10T08:30:03.263601+0000","last_became_active":"2024-02-10T08:28:25.999335+0000","last_became_peered":"2024-02-10T08:28:25.999335+0000","last_unstale":"2024-02-10T08:30:03.263601+0000","last_undegraded":"2024-02-10T08:30:03.263601+0000","last_fullsized":"2024-02-10T08:30:03.263601+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:22.556451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:22.556451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":169,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.273854+0000","last_change":"2024-02-10T08:29:19.512005+0000","last_active":"2024-02-10T08:30:03.273854+0000","last_peered":"2024-02-10T08:30:03.273854+0000","last_clean":"2024-02-10T08:30:03.273854+0000","last_became_active":"2024-02-10T08:22:00.600200+0000","last_became_peered":"2024-02-10T08:22:00.600200+0000","last_unstale":"2024-02-10T08:30:03.273854+0000","last_undegraded":"2024-02-10T08:30:03.273854+0000","last_fullsized":"2024-02-10T08:30:03.273854+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:19.511918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:19.511918+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1],"acting":[6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":173,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.267645+0000","last_change":"2024-02-10T08:28:38.233240+0000","last_active":"2024-02-10T08:30:03.267645+0000","last_peered":"2024-02-10T08:30:03.267645+0000","last_clean":"2024-02-10T08:30:03.267645+0000","last_became_active":"2024-02-10T08:28:38.232920+0000","last_became_peered":"2024-02-10T08:28:38.232920+0000","last_unstale":"2024-02-10T08:30:03.267645+0000","last_undegraded":"2024-02-10T08:30:03.267645+0000","last_fullsized":"2024-02-10T08:30:03.267645+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:18.099177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:18.099177+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,1],"acting":[7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":164,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.258322+0000","last_change":"2024-02-10T08:29:01.651198+0000","last_active":"2024-02-10T08:30:03.258322+0000","last_peered":"2024-02-10T08:30:03.258322+0000","last_clean":"2024-02-10T08:30:03.258322+0000","last_became_active":"2024-02-10T08:22:00.581772+0000","last_became_peered":"2024-02-10T08:22:00.581772+0000","last_unstale":"2024-02-10T08:30:03.258322+0000","last_undegraded":"2024-02-10T08:30:03.258322+0000","last_fullsized":"2024-02-10T08:30:03.258322+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:01.651093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:01.651093+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,7],"acting":[1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":171,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.268406+0000","last_change":"2024-02-10T08:29:06.366400+0000","last_active":"2024-02-10T08:30:03.268406+0000","last_peered":"2024-02-10T08:30:03.268406+0000","last_clean":"2024-02-10T08:30:03.268406+0000","last_became_active":"2024-02-10T08:23:15.079180+0000","last_became_peered":"2024-02-10T08:23:15.079180+0000","last_unstale":"2024-02-10T08:30:03.268406+0000","last_undegraded":"2024-02-10T08:30:03.268406+0000","last_fullsized":"2024-02-10T08:30:03.268406+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:06.366305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:06.366305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":73,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.273847+0000","last_change":"2024-02-10T08:29:04.389674+0000","last_active":"2024-02-10T08:30:03.273847+0000","last_peered":"2024-02-10T08:30:03.273847+0000","last_clean":"2024-02-10T08:30:03.273847+0000","last_became_active":"2024-02-10T08:28:38.236371+0000","last_became_peered":"2024-02-10T08:28:38.236371+0000","last_unstale":"2024-02-10T08:30:03.273847+0000","last_undegraded":"2024-02-10T08:30:03.273847+0000","last_fullsized":"2024-02-10T08:30:03.273847+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:04.388074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:04.388074+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,2],"acting":[6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":208,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.270457+0000","last_change":"2024-02-10T08:28:31.264421+0000","last_active":"2024-02-10T08:30:03.270457+0000","last_peered":"2024-02-10T08:30:03.270457+0000","last_clean":"2024-02-10T08:30:03.270457+0000","last_became_active":"2024-02-10T08:23:34.723324+0000","last_became_peered":"2024-02-10T08:23:34.723324+0000","last_unstale":"2024-02-10T08:30:03.270457+0000","last_undegraded":"2024-02-10T08:30:03.270457+0000","last_fullsized":"2024-02-10T08:30:03.270457+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:31.264352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:28:31.264352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"225'27","reported_seq":292,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.270434+0000","last_change":"2024-02-10T08:29:18.566459+0000","last_active":"2024-02-10T08:30:03.270434+0000","last_peered":"2024-02-10T08:30:03.270434+0000","last_clean":"2024-02-10T08:30:03.270434+0000","last_became_active":"2024-02-10T08:28:02.789308+0000","last_became_peered":"2024-02-10T08:28:02.789308+0000","last_unstale":"2024-02-10T08:30:03.270434+0000","last_undegraded":"2024-02-10T08:30:03.270434+0000","last_fullsized":"2024-02-10T08:30:03.270434+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'27","last_scrub_stamp":"2024-02-10T08:29:18.566350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:29:18.566350+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":230,"reported_epoch":283,"state":"active+clean","last_fresh":"2024-02-10T08:30:07.311079+0000","last_change":"2024-02-10T08:29:25.024508+0000","last_active":"2024-02-10T08:30:07.311079+0000","last_peered":"2024-02-10T08:30:07.311079+0000","last_clean":"2024-02-10T08:30:07.311079+0000","last_became_active":"2024-02-10T08:20:46.405314+0000","last_became_peered":"2024-02-10T08:20:46.405314+0000","last_unstale":"2024-02-10T08:30:07.311079+0000","last_undegraded":"2024-02-10T08:30:07.311079+0000","last_fullsized":"2024-02-10T08:30:07.311079+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:25.024412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:29:25.024412+0000","last_clean_scrub_stamp":"2024-02-10T08:29:25.024412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":248,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.258638+0000","last_change":"2024-02-10T08:28:24.450504+0000","last_active":"2024-02-10T08:30:03.258638+0000","last_peered":"2024-02-10T08:30:03.258638+0000","last_clean":"2024-02-10T08:30:03.258638+0000","last_became_active":"2024-02-10T08:16:56.863353+0000","last_became_peered":"2024-02-10T08:16:56.863353+0000","last_unstale":"2024-02-10T08:30:03.258638+0000","last_undegraded":"2024-02-10T08:30:03.258638+0000","last_fullsized":"2024-02-10T08:30:03.258638+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:24.450350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:28:24.450350+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":144,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.265928+0000","last_change":"2024-02-10T08:28:15.255199+0000","last_active":"2024-02-10T08:30:03.265928+0000","last_peered":"2024-02-10T08:30:03.265928+0000","last_clean":"2024-02-10T08:30:03.265928+0000","last_became_active":"2024-02-10T08:23:15.074301+0000","last_became_peered":"2024-02-10T08:23:15.074301+0000","last_unstale":"2024-02-10T08:30:03.265928+0000","last_undegraded":"2024-02-10T08:30:03.265928+0000","last_fullsized":"2024-02-10T08:30:03.265928+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:15.255132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:28:15.255132+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"225'15","reported_seq":254,"reported_epoch":283,"state":"active+clean","last_fresh":"2024-02-10T08:30:07.310466+0000","last_change":"2024-02-10T08:29:07.977048+0000","last_active":"2024-02-10T08:30:07.310466+0000","last_peered":"2024-02-10T08:30:07.310466+0000","last_clean":"2024-02-10T08:30:07.310466+0000","last_became_active":"2024-02-10T08:20:46.404966+0000","last_became_peered":"2024-02-10T08:20:46.404966+0000","last_unstale":"2024-02-10T08:30:07.310466+0000","last_undegraded":"2024-02-10T08:30:07.310466+0000","last_fullsized":"2024-02-10T08:30:07.310466+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'15","last_scrub_stamp":"2024-02-10T08:29:07.976943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:29:07.976943+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":259,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.265264+0000","last_change":"2024-02-10T08:29:08.143346+0000","last_active":"2024-02-10T08:30:03.265264+0000","last_peered":"2024-02-10T08:30:03.265264+0000","last_clean":"2024-02-10T08:30:03.265264+0000","last_became_active":"2024-02-10T08:23:15.125955+0000","last_became_peered":"2024-02-10T08:23:15.125955+0000","last_unstale":"2024-02-10T08:30:03.265264+0000","last_undegraded":"2024-02-10T08:30:03.265264+0000","last_fullsized":"2024-02-10T08:30:03.265264+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:08.143236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:08.143236+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,2],"acting":[5,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":267,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.271045+0000","last_change":"2024-02-10T08:28:38.278860+0000","last_active":"2024-02-10T08:30:03.271045+0000","last_peered":"2024-02-10T08:30:03.271045+0000","last_clean":"2024-02-10T08:30:03.271045+0000","last_became_active":"2024-02-10T08:20:46.406783+0000","last_became_peered":"2024-02-10T08:20:46.406783+0000","last_unstale":"2024-02-10T08:30:03.271045+0000","last_undegraded":"2024-02-10T08:30:03.271045+0000","last_fullsized":"2024-02-10T08:30:03.271045+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:38.278752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:28:38.278752+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"55'1","reported_seq":284,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.271604+0000","last_change":"2024-02-10T08:28:02.870043+0000","last_active":"2024-02-10T08:30:03.271604+0000","last_peered":"2024-02-10T08:30:03.271604+0000","last_clean":"2024-02-10T08:30:03.271604+0000","last_became_active":"2024-02-10T08:28:02.761299+0000","last_became_peered":"2024-02-10T08:28:02.761299+0000","last_unstale":"2024-02-10T08:30:03.271604+0000","last_undegraded":"2024-02-10T08:30:03.271604+0000","last_fullsized":"2024-02-10T08:30:03.271604+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'1","last_scrub_stamp":"2024-02-10T08:27:18.293859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:27:18.293859+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1746,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"225'7","reported_seq":281,"reported_epoch":283,"state":"active+clean","last_fresh":"2024-02-10T08:30:07.311434+0000","last_change":"2024-02-10T08:27:27.742734+0000","last_active":"2024-02-10T08:30:07.311434+0000","last_peered":"2024-02-10T08:30:07.311434+0000","last_clean":"2024-02-10T08:30:07.311434+0000","last_became_active":"2024-02-10T08:27:27.715306+0000","last_became_peered":"2024-02-10T08:27:27.715306+0000","last_unstale":"2024-02-10T08:30:07.311434+0000","last_undegraded":"2024-02-10T08:30:07.311434+0000","last_fullsized":"2024-02-10T08:30:07.311434+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'7","last_scrub_stamp":"2024-02-10T08:27:19.895566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:27:19.895566+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":9,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":138,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.258576+0000","last_change":"2024-02-10T08:27:19.250964+0000","last_active":"2024-02-10T08:30:03.258576+0000","last_peered":"2024-02-10T08:30:03.258576+0000","last_clean":"2024-02-10T08:30:03.258576+0000","last_became_active":"2024-02-10T08:23:15.078168+0000","last_became_peered":"2024-02-10T08:23:15.078168+0000","last_unstale":"2024-02-10T08:30:03.258576+0000","last_undegraded":"2024-02-10T08:30:03.258576+0000","last_fullsized":"2024-02-10T08:30:03.258576+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:27:19.250878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:27:19.250878+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,2],"acting":[1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":284,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.265640+0000","last_change":"2024-02-10T08:29:22.172003+0000","last_active":"2024-02-10T08:30:03.265640+0000","last_peered":"2024-02-10T08:30:03.265640+0000","last_clean":"2024-02-10T08:30:03.265640+0000","last_became_active":"2024-02-10T08:28:19.065132+0000","last_became_peered":"2024-02-10T08:28:19.065132+0000","last_unstale":"2024-02-10T08:30:03.265640+0000","last_undegraded":"2024-02-10T08:30:03.265640+0000","last_fullsized":"2024-02-10T08:30:03.265640+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:22.171906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:22.171906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,7],"acting":[5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":256,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.268665+0000","last_change":"2024-02-10T08:29:26.213501+0000","last_active":"2024-02-10T08:30:03.268665+0000","last_peered":"2024-02-10T08:30:03.268665+0000","last_clean":"2024-02-10T08:30:03.268665+0000","last_became_active":"2024-02-10T08:16:52.787865+0000","last_became_peered":"2024-02-10T08:16:52.787865+0000","last_unstale":"2024-02-10T08:30:03.268665+0000","last_undegraded":"2024-02-10T08:30:03.268665+0000","last_fullsized":"2024-02-10T08:30:03.268665+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:26.213417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:28.028556+0000","last_clean_scrub_stamp":"2024-02-10T08:29:26.213417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"225'15","reported_seq":279,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.264316+0000","last_change":"2024-02-10T08:29:13.500113+0000","last_active":"2024-02-10T08:30:03.264316+0000","last_peered":"2024-02-10T08:30:03.264316+0000","last_clean":"2024-02-10T08:30:03.264316+0000","last_became_active":"2024-02-10T08:28:38.226796+0000","last_became_peered":"2024-02-10T08:28:38.226796+0000","last_unstale":"2024-02-10T08:30:03.264316+0000","last_undegraded":"2024-02-10T08:30:03.264316+0000","last_fullsized":"2024-02-10T08:30:03.264316+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'15","last_scrub_stamp":"2024-02-10T08:29:13.500017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:29:13.500017+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":162,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.275803+0000","last_change":"2024-02-10T08:28:27.516339+0000","last_active":"2024-02-10T08:30:03.275803+0000","last_peered":"2024-02-10T08:30:03.275803+0000","last_clean":"2024-02-10T08:30:03.275803+0000","last_became_active":"2024-02-10T08:22:23.526229+0000","last_became_peered":"2024-02-10T08:22:23.526229+0000","last_unstale":"2024-02-10T08:30:03.275803+0000","last_undegraded":"2024-02-10T08:30:03.275803+0000","last_fullsized":"2024-02-10T08:30:03.275803+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:27.516251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:27.516251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":227,"reported_epoch":283,"state":"active+clean","last_fresh":"2024-02-10T08:30:07.310981+0000","last_change":"2024-02-10T08:26:26.889748+0000","last_active":"2024-02-10T08:30:07.310981+0000","last_peered":"2024-02-10T08:30:07.310981+0000","last_clean":"2024-02-10T08:30:07.310981+0000","last_became_active":"2024-02-10T08:20:46.398532+0000","last_became_peered":"2024-02-10T08:20:46.398532+0000","last_unstale":"2024-02-10T08:30:07.310981+0000","last_undegraded":"2024-02-10T08:30:07.310981+0000","last_fullsized":"2024-02-10T08:30:07.310981+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:26:26.889655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:26:26.889655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":166,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.269275+0000","last_change":"2024-02-10T08:26:14.128513+0000","last_active":"2024-02-10T08:30:03.269275+0000","last_peered":"2024-02-10T08:30:03.269275+0000","last_clean":"2024-02-10T08:30:03.269275+0000","last_became_active":"2024-02-10T08:23:34.728772+0000","last_became_peered":"2024-02-10T08:23:34.728772+0000","last_unstale":"2024-02-10T08:30:03.269275+0000","last_undegraded":"2024-02-10T08:30:03.269275+0000","last_fullsized":"2024-02-10T08:30:03.269275+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:26:14.128447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:26:14.128447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1d","version":"226'23","reported_seq":242,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.259572+0000","last_change":"2024-02-10T08:29:19.670237+0000","last_active":"2024-02-10T08:30:03.259572+0000","last_peered":"2024-02-10T08:30:03.259572+0000","last_clean":"2024-02-10T08:30:03.259572+0000","last_became_active":"2024-02-10T08:23:34.710443+0000","last_became_peered":"2024-02-10T08:23:34.710443+0000","last_unstale":"2024-02-10T08:30:03.259572+0000","last_undegraded":"2024-02-10T08:30:03.259572+0000","last_fullsized":"2024-02-10T08:30:03.259572+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"226'23","last_scrub_stamp":"2024-02-10T08:29:19.670143+0000","last_deep_scrub":"74'17","last_deep_scrub_stamp":"2024-02-10T08:18:02.949298+0000","last_clean_scrub_stamp":"2024-02-10T08:29:19.670143+0000","log_size":23,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":25,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,6],"acting":[1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":230,"reported_epoch":283,"state":"active+clean","last_fresh":"2024-02-10T08:30:07.314082+0000","last_change":"2024-02-10T08:29:00.918497+0000","last_active":"2024-02-10T08:30:07.314082+0000","last_peered":"2024-02-10T08:30:07.314082+0000","last_clean":"2024-02-10T08:30:07.314082+0000","last_became_active":"2024-02-10T08:20:46.403378+0000","last_became_peered":"2024-02-10T08:20:46.403378+0000","last_unstale":"2024-02-10T08:30:07.314082+0000","last_undegraded":"2024-02-10T08:30:07.314082+0000","last_fullsized":"2024-02-10T08:30:07.314082+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:00.918382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:00.918382+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":281,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.259687+0000","last_change":"2024-02-10T08:29:25.682482+0000","last_active":"2024-02-10T08:30:03.259687+0000","last_peered":"2024-02-10T08:30:03.259687+0000","last_clean":"2024-02-10T08:30:03.259687+0000","last_became_active":"2024-02-10T08:28:02.763523+0000","last_became_peered":"2024-02-10T08:28:02.763523+0000","last_unstale":"2024-02-10T08:30:03.259687+0000","last_undegraded":"2024-02-10T08:30:03.259687+0000","last_fullsized":"2024-02-10T08:30:03.259687+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:25.682383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:25.682383+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":271,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.274242+0000","last_change":"2024-02-10T08:28:33.456849+0000","last_active":"2024-02-10T08:30:03.274242+0000","last_peered":"2024-02-10T08:30:03.274242+0000","last_clean":"2024-02-10T08:30:03.274242+0000","last_became_active":"2024-02-10T08:20:46.396303+0000","last_became_peered":"2024-02-10T08:20:46.396303+0000","last_unstale":"2024-02-10T08:30:03.274242+0000","last_undegraded":"2024-02-10T08:30:03.274242+0000","last_fullsized":"2024-02-10T08:30:03.274242+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:33.456780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:10.370746+0000","last_clean_scrub_stamp":"2024-02-10T08:28:33.456780+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1c","version":"225'27","reported_seq":323,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.271097+0000","last_change":"2024-02-10T08:26:28.089083+0000","last_active":"2024-02-10T08:30:03.271097+0000","last_peered":"2024-02-10T08:30:03.271097+0000","last_clean":"2024-02-10T08:30:03.271097+0000","last_became_active":"2024-02-10T08:23:34.712669+0000","last_became_peered":"2024-02-10T08:23:34.712669+0000","last_unstale":"2024-02-10T08:30:03.271097+0000","last_undegraded":"2024-02-10T08:30:03.271097+0000","last_fullsized":"2024-02-10T08:30:03.271097+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'15","last_scrub_stamp":"2024-02-10T08:26:28.088989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:26:28.088989+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4],"acting":[2,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":261,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.259247+0000","last_change":"2024-02-10T08:29:20.739901+0000","last_active":"2024-02-10T08:30:03.259247+0000","last_peered":"2024-02-10T08:30:03.259247+0000","last_clean":"2024-02-10T08:30:03.259247+0000","last_became_active":"2024-02-10T08:20:46.408504+0000","last_became_peered":"2024-02-10T08:20:46.408504+0000","last_unstale":"2024-02-10T08:30:03.259247+0000","last_undegraded":"2024-02-10T08:30:03.259247+0000","last_fullsized":"2024-02-10T08:30:03.259247+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:20.739750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:22.104988+0000","last_clean_scrub_stamp":"2024-02-10T08:29:20.739750+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":82,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.263317+0000","last_change":"2024-02-10T08:28:32.177848+0000","last_active":"2024-02-10T08:30:03.263317+0000","last_peered":"2024-02-10T08:30:03.263317+0000","last_clean":"2024-02-10T08:30:03.263317+0000","last_became_active":"2024-02-10T08:28:25.951312+0000","last_became_peered":"2024-02-10T08:28:25.951312+0000","last_unstale":"2024-02-10T08:30:03.263317+0000","last_undegraded":"2024-02-10T08:30:03.263317+0000","last_fullsized":"2024-02-10T08:30:03.263317+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:32.177772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:28:32.177772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":189,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.284443+0000","last_change":"2024-02-10T08:29:14.469349+0000","last_active":"2024-02-10T08:30:03.284443+0000","last_peered":"2024-02-10T08:30:03.284443+0000","last_clean":"2024-02-10T08:30:03.284443+0000","last_became_active":"2024-02-10T08:28:02.773857+0000","last_became_peered":"2024-02-10T08:28:02.773857+0000","last_unstale":"2024-02-10T08:30:03.284443+0000","last_undegraded":"2024-02-10T08:30:03.284443+0000","last_fullsized":"2024-02-10T08:30:03.284443+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:14.469285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:25:42.124914+0000","last_clean_scrub_stamp":"2024-02-10T08:29:14.469285+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2],"acting":[6,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"225'19","reported_seq":285,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.275675+0000","last_change":"2024-02-10T08:28:40.341710+0000","last_active":"2024-02-10T08:30:03.275675+0000","last_peered":"2024-02-10T08:30:03.275675+0000","last_clean":"2024-02-10T08:30:03.275675+0000","last_became_active":"2024-02-10T08:16:54.852665+0000","last_became_peered":"2024-02-10T08:16:54.852665+0000","last_unstale":"2024-02-10T08:30:03.275675+0000","last_undegraded":"2024-02-10T08:30:03.275675+0000","last_fullsized":"2024-02-10T08:30:03.275675+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'19","last_scrub_stamp":"2024-02-10T08:28:40.341641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:28:40.341641+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"87'2","reported_seq":252,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.268974+0000","last_change":"2024-02-10T08:28:37.261008+0000","last_active":"2024-02-10T08:30:03.268974+0000","last_peered":"2024-02-10T08:30:03.268974+0000","last_clean":"2024-02-10T08:30:03.268974+0000","last_became_active":"2024-02-10T08:16:58.859047+0000","last_became_peered":"2024-02-10T08:16:58.859047+0000","last_unstale":"2024-02-10T08:30:03.268974+0000","last_undegraded":"2024-02-10T08:30:03.268974+0000","last_fullsized":"2024-02-10T08:30:03.268974+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'2","last_scrub_stamp":"2024-02-10T08:28:37.260945+0000","last_deep_scrub":"87'2","last_deep_scrub_stamp":"2024-02-10T08:19:29.207531+0000","last_clean_scrub_stamp":"2024-02-10T08:28:37.260945+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"111'11","reported_seq":438,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:06.126594+0000","last_change":"2024-02-10T08:28:29.461568+0000","last_active":"2024-02-10T08:30:06.126594+0000","last_peered":"2024-02-10T08:30:06.126594+0000","last_clean":"2024-02-10T08:30:06.126594+0000","last_became_active":"2024-02-10T08:20:46.402663+0000","last_became_peered":"2024-02-10T08:20:46.402663+0000","last_unstale":"2024-02-10T08:30:06.126594+0000","last_undegraded":"2024-02-10T08:30:06.126594+0000","last_fullsized":"2024-02-10T08:30:06.126594+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'11","last_scrub_stamp":"2024-02-10T08:28:29.461499+0000","last_deep_scrub":"82'9","last_deep_scrub_stamp":"2024-02-10T08:18:36.323217+0000","last_clean_scrub_stamp":"2024-02-10T08:28:29.461499+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":271,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.264963+0000","last_change":"2024-02-10T08:29:26.072110+0000","last_active":"2024-02-10T08:30:03.264963+0000","last_peered":"2024-02-10T08:30:03.264963+0000","last_clean":"2024-02-10T08:30:03.264963+0000","last_became_active":"2024-02-10T08:20:46.392466+0000","last_became_peered":"2024-02-10T08:20:46.392466+0000","last_unstale":"2024-02-10T08:30:03.264963+0000","last_undegraded":"2024-02-10T08:30:03.264963+0000","last_fullsized":"2024-02-10T08:30:03.264963+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:26.072031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:29:26.072031+0000","last_clean_scrub_stamp":"2024-02-10T08:29:26.072031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"225'25","reported_seq":341,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.263238+0000","last_change":"2024-02-10T08:28:38.118912+0000","last_active":"2024-02-10T08:30:03.263238+0000","last_peered":"2024-02-10T08:30:03.263238+0000","last_clean":"2024-02-10T08:30:03.263238+0000","last_became_active":"2024-02-10T08:28:25.951464+0000","last_became_peered":"2024-02-10T08:28:25.951464+0000","last_unstale":"2024-02-10T08:30:03.263238+0000","last_undegraded":"2024-02-10T08:30:03.263238+0000","last_fullsized":"2024-02-10T08:30:03.263238+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'25","last_scrub_stamp":"2024-02-10T08:28:38.118836+0000","last_deep_scrub":"74'15","last_deep_scrub_stamp":"2024-02-10T08:17:57.637346+0000","last_clean_scrub_stamp":"2024-02-10T08:28:38.118836+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":24,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":162,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.274756+0000","last_change":"2024-02-10T08:28:38.237508+0000","last_active":"2024-02-10T08:30:03.274756+0000","last_peered":"2024-02-10T08:30:03.274756+0000","last_clean":"2024-02-10T08:30:03.274756+0000","last_became_active":"2024-02-10T08:28:38.237168+0000","last_became_peered":"2024-02-10T08:28:38.237168+0000","last_unstale":"2024-02-10T08:30:03.274756+0000","last_undegraded":"2024-02-10T08:30:03.274756+0000","last_fullsized":"2024-02-10T08:30:03.274756+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:34.502781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:34.502781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,5],"acting":[6,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":267,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.267984+0000","last_change":"2024-02-10T08:29:19.380493+0000","last_active":"2024-02-10T08:30:03.267984+0000","last_peered":"2024-02-10T08:30:03.267984+0000","last_clean":"2024-02-10T08:30:03.267984+0000","last_became_active":"2024-02-10T08:20:46.399838+0000","last_became_peered":"2024-02-10T08:20:46.399838+0000","last_unstale":"2024-02-10T08:30:03.267984+0000","last_undegraded":"2024-02-10T08:30:03.267984+0000","last_fullsized":"2024-02-10T08:30:03.267984+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:19.380403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:19.380403+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":256,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.275389+0000","last_change":"2024-02-10T08:28:38.361039+0000","last_active":"2024-02-10T08:30:03.275389+0000","last_peered":"2024-02-10T08:30:03.275389+0000","last_clean":"2024-02-10T08:30:03.275389+0000","last_became_active":"2024-02-10T08:16:52.788629+0000","last_became_peered":"2024-02-10T08:16:52.788629+0000","last_unstale":"2024-02-10T08:30:03.275389+0000","last_undegraded":"2024-02-10T08:30:03.275389+0000","last_fullsized":"2024-02-10T08:30:03.275389+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:38.360929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:38.360929+0000","last_clean_scrub_stamp":"2024-02-10T08:28:38.360929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"225'19","reported_seq":205,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.267876+0000","last_change":"2024-02-10T08:29:22.312103+0000","last_active":"2024-02-10T08:30:03.267876+0000","last_peered":"2024-02-10T08:30:03.267876+0000","last_clean":"2024-02-10T08:30:03.267876+0000","last_became_active":"2024-02-10T08:22:23.526198+0000","last_became_peered":"2024-02-10T08:22:23.526198+0000","last_unstale":"2024-02-10T08:30:03.267876+0000","last_undegraded":"2024-02-10T08:30:03.267876+0000","last_fullsized":"2024-02-10T08:30:03.267876+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'19","last_scrub_stamp":"2024-02-10T08:29:22.312001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:29:22.312001+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":24,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":265,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.271175+0000","last_change":"2024-02-10T08:29:12.421115+0000","last_active":"2024-02-10T08:30:03.271175+0000","last_peered":"2024-02-10T08:30:03.271175+0000","last_clean":"2024-02-10T08:30:03.271175+0000","last_became_active":"2024-02-10T08:20:46.399515+0000","last_became_peered":"2024-02-10T08:20:46.399515+0000","last_unstale":"2024-02-10T08:30:03.271175+0000","last_undegraded":"2024-02-10T08:30:03.271175+0000","last_fullsized":"2024-02-10T08:30:03.271175+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:12.421034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:27.276490+0000","last_clean_scrub_stamp":"2024-02-10T08:29:12.421034+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":262,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.284510+0000","last_change":"2024-02-10T08:28:26.460262+0000","last_active":"2024-02-10T08:30:03.284510+0000","last_peered":"2024-02-10T08:30:03.284510+0000","last_clean":"2024-02-10T08:30:03.284510+0000","last_became_active":"2024-02-10T08:20:46.397495+0000","last_became_peered":"2024-02-10T08:20:46.397495+0000","last_unstale":"2024-02-10T08:30:03.284510+0000","last_undegraded":"2024-02-10T08:30:03.284510+0000","last_fullsized":"2024-02-10T08:30:03.284510+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:26.460158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:28:26.460158+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":261,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.265863+0000","last_change":"2024-02-10T08:29:10.131158+0000","last_active":"2024-02-10T08:30:03.265863+0000","last_peered":"2024-02-10T08:30:03.265863+0000","last_clean":"2024-02-10T08:30:03.265863+0000","last_became_active":"2024-02-10T08:16:52.788704+0000","last_became_peered":"2024-02-10T08:16:52.788704+0000","last_unstale":"2024-02-10T08:30:03.265863+0000","last_undegraded":"2024-02-10T08:30:03.265863+0000","last_fullsized":"2024-02-10T08:30:03.265863+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:10.131056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:29:10.131056+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"225'8","reported_seq":181,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.259220+0000","last_change":"2024-02-10T08:25:30.862232+0000","last_active":"2024-02-10T08:30:03.259220+0000","last_peered":"2024-02-10T08:30:03.259220+0000","last_clean":"2024-02-10T08:30:03.259220+0000","last_became_active":"2024-02-10T08:22:23.522936+0000","last_became_peered":"2024-02-10T08:22:23.522936+0000","last_unstale":"2024-02-10T08:30:03.259220+0000","last_undegraded":"2024-02-10T08:30:03.259220+0000","last_fullsized":"2024-02-10T08:30:03.259220+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'4","last_scrub_stamp":"2024-02-10T08:25:30.862066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:25:30.862066+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,6],"acting":[1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":166,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.265317+0000","last_change":"2024-02-10T08:28:27.240341+0000","last_active":"2024-02-10T08:30:03.265317+0000","last_peered":"2024-02-10T08:30:03.265317+0000","last_clean":"2024-02-10T08:30:03.265317+0000","last_became_active":"2024-02-10T08:23:34.710130+0000","last_became_peered":"2024-02-10T08:23:34.710130+0000","last_unstale":"2024-02-10T08:30:03.265317+0000","last_undegraded":"2024-02-10T08:30:03.265317+0000","last_fullsized":"2024-02-10T08:30:03.265317+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:27.240244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:27.240244+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":259,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.261596+0000","last_change":"2024-02-10T08:28:20.394761+0000","last_active":"2024-02-10T08:30:03.261596+0000","last_peered":"2024-02-10T08:30:03.261596+0000","last_clean":"2024-02-10T08:30:03.261596+0000","last_became_active":"2024-02-10T08:23:15.078667+0000","last_became_peered":"2024-02-10T08:23:15.078667+0000","last_unstale":"2024-02-10T08:30:03.261596+0000","last_undegraded":"2024-02-10T08:30:03.261596+0000","last_fullsized":"2024-02-10T08:30:03.261596+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:20.394696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:28:20.394696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":265,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.259434+0000","last_change":"2024-02-10T08:28:28.486997+0000","last_active":"2024-02-10T08:30:03.259434+0000","last_peered":"2024-02-10T08:30:03.259434+0000","last_clean":"2024-02-10T08:30:03.259434+0000","last_became_active":"2024-02-10T08:23:15.079635+0000","last_became_peered":"2024-02-10T08:23:15.079635+0000","last_unstale":"2024-02-10T08:30:03.259434+0000","last_undegraded":"2024-02-10T08:30:03.259434+0000","last_fullsized":"2024-02-10T08:30:03.259434+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:28.486926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:28:28.486926+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[1,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"225'24","reported_seq":292,"reported_epoch":283,"state":"active+clean","last_fresh":"2024-02-10T08:30:07.311317+0000","last_change":"2024-02-10T08:28:35.984255+0000","last_active":"2024-02-10T08:30:07.311317+0000","last_peered":"2024-02-10T08:30:07.311317+0000","last_clean":"2024-02-10T08:30:07.311317+0000","last_became_active":"2024-02-10T08:20:46.396130+0000","last_became_peered":"2024-02-10T08:20:46.396130+0000","last_unstale":"2024-02-10T08:30:07.311317+0000","last_undegraded":"2024-02-10T08:30:07.311317+0000","last_fullsized":"2024-02-10T08:30:07.311317+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'24","last_scrub_stamp":"2024-02-10T08:28:35.984191+0000","last_deep_scrub":"201'16","last_deep_scrub_stamp":"2024-02-10T08:24:49.177357+0000","last_clean_scrub_stamp":"2024-02-10T08:28:35.984191+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":82,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.263316+0000","last_change":"2024-02-10T08:29:11.496211+0000","last_active":"2024-02-10T08:30:03.263316+0000","last_peered":"2024-02-10T08:30:03.263316+0000","last_clean":"2024-02-10T08:30:03.263316+0000","last_became_active":"2024-02-10T08:28:25.950245+0000","last_became_peered":"2024-02-10T08:28:25.950245+0000","last_unstale":"2024-02-10T08:30:03.263316+0000","last_undegraded":"2024-02-10T08:30:03.263316+0000","last_fullsized":"2024-02-10T08:30:03.263316+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:11.496105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:11.496105+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":85,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.263872+0000","last_change":"2024-02-10T08:29:01.325236+0000","last_active":"2024-02-10T08:30:03.263872+0000","last_peered":"2024-02-10T08:30:03.263872+0000","last_clean":"2024-02-10T08:30:03.263872+0000","last_became_active":"2024-02-10T08:28:25.950221+0000","last_became_peered":"2024-02-10T08:28:25.950221+0000","last_unstale":"2024-02-10T08:30:03.263872+0000","last_undegraded":"2024-02-10T08:30:03.263872+0000","last_fullsized":"2024-02-10T08:30:03.263872+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:01.325135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:01.325135+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":263,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.274650+0000","last_change":"2024-02-10T08:29:10.389220+0000","last_active":"2024-02-10T08:30:03.274650+0000","last_peered":"2024-02-10T08:30:03.274650+0000","last_clean":"2024-02-10T08:30:03.274650+0000","last_became_active":"2024-02-10T08:16:52.786213+0000","last_became_peered":"2024-02-10T08:16:52.786213+0000","last_unstale":"2024-02-10T08:30:03.274650+0000","last_undegraded":"2024-02-10T08:30:03.274650+0000","last_fullsized":"2024-02-10T08:30:03.274650+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:10.389138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:29:10.389138+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"225'15","reported_seq":258,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.264122+0000","last_change":"2024-02-10T08:28:25.952604+0000","last_active":"2024-02-10T08:30:03.264122+0000","last_peered":"2024-02-10T08:30:03.264122+0000","last_clean":"2024-02-10T08:30:03.264122+0000","last_became_active":"2024-02-10T08:28:25.952354+0000","last_became_peered":"2024-02-10T08:28:25.952354+0000","last_unstale":"2024-02-10T08:30:03.264122+0000","last_undegraded":"2024-02-10T08:30:03.264122+0000","last_fullsized":"2024-02-10T08:30:03.264122+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'15","last_scrub_stamp":"2024-02-10T08:28:21.454916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:28:21.454916+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":225,"reported_epoch":283,"state":"active+clean","last_fresh":"2024-02-10T08:30:07.313282+0000","last_change":"2024-02-10T08:26:33.798697+0000","last_active":"2024-02-10T08:30:07.313282+0000","last_peered":"2024-02-10T08:30:07.313282+0000","last_clean":"2024-02-10T08:30:07.313282+0000","last_became_active":"2024-02-10T08:20:46.395788+0000","last_became_peered":"2024-02-10T08:20:46.395788+0000","last_unstale":"2024-02-10T08:30:07.313282+0000","last_undegraded":"2024-02-10T08:30:07.313282+0000","last_fullsized":"2024-02-10T08:30:07.313282+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:26:33.798586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:26:33.798586+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"165'10","reported_seq":282,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:06.129319+0000","last_change":"2024-02-10T08:26:15.114882+0000","last_active":"2024-02-10T08:30:06.129319+0000","last_peered":"2024-02-10T08:30:06.129319+0000","last_clean":"2024-02-10T08:30:06.129319+0000","last_became_active":"2024-02-10T08:23:15.080370+0000","last_became_peered":"2024-02-10T08:23:15.080370+0000","last_unstale":"2024-02-10T08:30:06.129319+0000","last_undegraded":"2024-02-10T08:30:06.129319+0000","last_fullsized":"2024-02-10T08:30:06.129319+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"165'10","last_scrub_stamp":"2024-02-10T08:26:15.114806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:26:15.114806+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,1],"acting":[7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":209,"reported_epoch":283,"state":"active+clean","last_fresh":"2024-02-10T08:30:07.311501+0000","last_change":"2024-02-10T08:27:18.873971+0000","last_active":"2024-02-10T08:30:07.311501+0000","last_peered":"2024-02-10T08:30:07.311501+0000","last_clean":"2024-02-10T08:30:07.311501+0000","last_became_active":"2024-02-10T08:23:34.717015+0000","last_became_peered":"2024-02-10T08:23:34.717015+0000","last_unstale":"2024-02-10T08:30:07.311501+0000","last_undegraded":"2024-02-10T08:30:07.311501+0000","last_fullsized":"2024-02-10T08:30:07.311501+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:27:18.873884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:27:18.873884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"225'19","reported_seq":283,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.268622+0000","last_change":"2024-02-10T08:29:09.148326+0000","last_active":"2024-02-10T08:30:03.268622+0000","last_peered":"2024-02-10T08:30:03.268622+0000","last_clean":"2024-02-10T08:30:03.268622+0000","last_became_active":"2024-02-10T08:16:55.204734+0000","last_became_peered":"2024-02-10T08:16:55.204734+0000","last_unstale":"2024-02-10T08:30:03.268622+0000","last_undegraded":"2024-02-10T08:30:03.268622+0000","last_fullsized":"2024-02-10T08:30:03.268622+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'19","last_scrub_stamp":"2024-02-10T08:29:09.148231+0000","last_deep_scrub":"213'13","last_deep_scrub_stamp":"2024-02-10T08:25:43.713333+0000","last_clean_scrub_stamp":"2024-02-10T08:29:09.148231+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":136,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.269422+0000","last_change":"2024-02-10T08:27:19.286440+0000","last_active":"2024-02-10T08:30:03.269422+0000","last_peered":"2024-02-10T08:30:03.269422+0000","last_clean":"2024-02-10T08:30:03.269422+0000","last_became_active":"2024-02-10T08:23:15.067821+0000","last_became_peered":"2024-02-10T08:23:15.067821+0000","last_unstale":"2024-02-10T08:30:03.269422+0000","last_undegraded":"2024-02-10T08:30:03.269422+0000","last_fullsized":"2024-02-10T08:30:03.269422+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:27:19.286346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:05.662947+0000","last_clean_scrub_stamp":"2024-02-10T08:27:19.286346+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"244'12","reported_seq":460,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:06.130456+0000","last_change":"2024-02-10T08:28:16.291133+0000","last_active":"2024-02-10T08:30:06.130456+0000","last_peered":"2024-02-10T08:30:06.130456+0000","last_clean":"2024-02-10T08:30:06.130456+0000","last_became_active":"2024-02-10T08:28:02.776097+0000","last_became_peered":"2024-02-10T08:28:02.776097+0000","last_unstale":"2024-02-10T08:30:06.130456+0000","last_undegraded":"2024-02-10T08:30:06.130456+0000","last_fullsized":"2024-02-10T08:30:06.130456+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"244'12","last_scrub_stamp":"2024-02-10T08:28:16.291055+0000","last_deep_scrub":"89'9","last_deep_scrub_stamp":"2024-02-10T08:19:33.299671+0000","last_clean_scrub_stamp":"2024-02-10T08:28:16.291055+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":256,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.265322+0000","last_change":"2024-02-10T08:28:19.243016+0000","last_active":"2024-02-10T08:30:03.265322+0000","last_peered":"2024-02-10T08:30:03.265322+0000","last_clean":"2024-02-10T08:30:03.265322+0000","last_became_active":"2024-02-10T08:16:52.789834+0000","last_became_peered":"2024-02-10T08:16:52.789834+0000","last_unstale":"2024-02-10T08:30:03.265322+0000","last_undegraded":"2024-02-10T08:30:03.265322+0000","last_fullsized":"2024-02-10T08:30:03.265322+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:19.242936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:28:19.242936+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"225'20","reported_seq":199,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.258999+0000","last_change":"2024-02-10T08:26:14.189385+0000","last_active":"2024-02-10T08:30:03.258999+0000","last_peered":"2024-02-10T08:30:03.258999+0000","last_clean":"2024-02-10T08:30:03.258999+0000","last_became_active":"2024-02-10T08:22:23.534081+0000","last_became_peered":"2024-02-10T08:22:23.534081+0000","last_unstale":"2024-02-10T08:30:03.258999+0000","last_undegraded":"2024-02-10T08:30:03.258999+0000","last_fullsized":"2024-02-10T08:30:03.258999+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'10","last_scrub_stamp":"2024-02-10T08:26:14.187217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:26:14.187217+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":24,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":260,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.271581+0000","last_change":"2024-02-10T08:28:33.229127+0000","last_active":"2024-02-10T08:30:03.271581+0000","last_peered":"2024-02-10T08:30:03.271581+0000","last_clean":"2024-02-10T08:30:03.271581+0000","last_became_active":"2024-02-10T08:20:46.398903+0000","last_became_peered":"2024-02-10T08:20:46.398903+0000","last_unstale":"2024-02-10T08:30:03.271581+0000","last_undegraded":"2024-02-10T08:30:03.271581+0000","last_fullsized":"2024-02-10T08:30:03.271581+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:33.229018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:33.229018+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":252,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.265842+0000","last_change":"2024-02-10T08:29:12.163752+0000","last_active":"2024-02-10T08:30:03.265842+0000","last_peered":"2024-02-10T08:30:03.265842+0000","last_clean":"2024-02-10T08:30:03.265842+0000","last_became_active":"2024-02-10T08:16:56.863948+0000","last_became_peered":"2024-02-10T08:16:56.863948+0000","last_unstale":"2024-02-10T08:30:03.265842+0000","last_undegraded":"2024-02-10T08:30:03.265842+0000","last_fullsized":"2024-02-10T08:30:03.265842+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:12.163638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:12.163638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":309,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.284557+0000","last_change":"2024-02-10T08:28:38.232620+0000","last_active":"2024-02-10T08:30:03.284557+0000","last_peered":"2024-02-10T08:30:03.284557+0000","last_clean":"2024-02-10T08:30:03.284557+0000","last_became_active":"2024-02-10T08:28:38.232339+0000","last_became_peered":"2024-02-10T08:28:38.232339+0000","last_unstale":"2024-02-10T08:30:03.284557+0000","last_undegraded":"2024-02-10T08:30:03.284557+0000","last_fullsized":"2024-02-10T08:30:03.284557+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:25.490611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:28:25.490611+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,5],"acting":[6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"225'15","reported_seq":207,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.270582+0000","last_change":"2024-02-10T08:26:33.158094+0000","last_active":"2024-02-10T08:30:03.270582+0000","last_peered":"2024-02-10T08:30:03.270582+0000","last_clean":"2024-02-10T08:30:03.270582+0000","last_became_active":"2024-02-10T08:23:15.079382+0000","last_became_peered":"2024-02-10T08:23:15.079382+0000","last_unstale":"2024-02-10T08:30:03.270582+0000","last_undegraded":"2024-02-10T08:30:03.270582+0000","last_fullsized":"2024-02-10T08:30:03.270582+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'9","last_scrub_stamp":"2024-02-10T08:26:33.158025+0000","last_deep_scrub":"223'9","last_deep_scrub_stamp":"2024-02-10T08:26:33.158025+0000","last_clean_scrub_stamp":"2024-02-10T08:26:33.158025+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":120,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.264039+0000","last_change":"2024-02-10T08:29:24.514793+0000","last_active":"2024-02-10T08:30:03.264039+0000","last_peered":"2024-02-10T08:30:03.264039+0000","last_clean":"2024-02-10T08:30:03.264039+0000","last_became_active":"2024-02-10T08:28:25.999252+0000","last_became_peered":"2024-02-10T08:28:25.999252+0000","last_unstale":"2024-02-10T08:30:03.264039+0000","last_undegraded":"2024-02-10T08:30:03.264039+0000","last_fullsized":"2024-02-10T08:30:03.264039+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:24.514690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:24.514690+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":186,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.260713+0000","last_change":"2024-02-10T08:28:02.769046+0000","last_active":"2024-02-10T08:30:03.260713+0000","last_peered":"2024-02-10T08:30:03.260713+0000","last_clean":"2024-02-10T08:30:03.260713+0000","last_became_active":"2024-02-10T08:28:02.768667+0000","last_became_peered":"2024-02-10T08:28:02.768667+0000","last_unstale":"2024-02-10T08:30:03.260713+0000","last_undegraded":"2024-02-10T08:30:03.260713+0000","last_fullsized":"2024-02-10T08:30:03.260713+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:26:38.062164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:26:38.062164+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"55'1","reported_seq":286,"reported_epoch":283,"state":"active+clean","last_fresh":"2024-02-10T08:30:07.371167+0000","last_change":"2024-02-10T08:30:07.371595+0000","last_active":"2024-02-10T08:30:07.371167+0000","last_peered":"2024-02-10T08:30:07.371167+0000","last_clean":"2024-02-10T08:30:07.371167+0000","last_became_active":"2024-02-10T08:28:02.778857+0000","last_became_peered":"2024-02-10T08:28:02.778857+0000","last_unstale":"2024-02-10T08:30:07.371167+0000","last_undegraded":"2024-02-10T08:30:07.371167+0000","last_fullsized":"2024-02-10T08:30:07.371167+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'1","last_scrub_stamp":"2024-02-10T08:25:28.166655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:25:28.166655+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":716,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"225'15","reported_seq":180,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.269500+0000","last_change":"2024-02-10T08:29:09.329280+0000","last_active":"2024-02-10T08:30:03.269500+0000","last_peered":"2024-02-10T08:30:03.269500+0000","last_clean":"2024-02-10T08:30:03.269500+0000","last_became_active":"2024-02-10T08:23:34.719714+0000","last_became_peered":"2024-02-10T08:23:34.719714+0000","last_unstale":"2024-02-10T08:30:03.269500+0000","last_undegraded":"2024-02-10T08:30:03.269500+0000","last_fullsized":"2024-02-10T08:30:03.269500+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'15","last_scrub_stamp":"2024-02-10T08:29:09.329160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:29:09.329160+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.4","version":"283'7442","reported_seq":7477,"reported_epoch":283,"state":"active+clean","last_fresh":"2024-02-10T08:30:07.707764+0000","last_change":"2024-02-10T08:28:28.529619+0000","last_active":"2024-02-10T08:30:07.707764+0000","last_peered":"2024-02-10T08:30:07.707764+0000","last_clean":"2024-02-10T08:30:07.707764+0000","last_became_active":"2024-02-10T08:28:28.529130+0000","last_became_peered":"2024-02-10T08:28:28.529130+0000","last_unstale":"2024-02-10T08:30:07.707764+0000","last_undegraded":"2024-02-10T08:30:07.707764+0000","last_fullsized":"2024-02-10T08:30:07.707764+0000","mapping_epoch":256,"log_start":"268'3400","ondisk_log_start":"268'3400","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_clean_scrub_stamp":"2024-02-10T08:28:27.172648+0000","log_size":4042,"ondisk_log_size":4042,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":487718912,"num_objects":7442,"num_object_clones":0,"num_object_copies":22326,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7442,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7442,"num_write_kb":476288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":157,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.269134+0000","last_change":"2024-02-10T08:26:20.174043+0000","last_active":"2024-02-10T08:30:03.269134+0000","last_peered":"2024-02-10T08:30:03.269134+0000","last_clean":"2024-02-10T08:30:03.269134+0000","last_became_active":"2024-02-10T08:22:23.528310+0000","last_became_peered":"2024-02-10T08:22:23.528310+0000","last_unstale":"2024-02-10T08:30:03.269134+0000","last_undegraded":"2024-02-10T08:30:03.269134+0000","last_fullsized":"2024-02-10T08:30:03.269134+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:26:20.173948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:26:20.173948+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"55'2","reported_seq":273,"reported_epoch":283,"state":"active+clean","last_fresh":"2024-02-10T08:30:07.313593+0000","last_change":"2024-02-10T08:29:22.034366+0000","last_active":"2024-02-10T08:30:07.313593+0000","last_peered":"2024-02-10T08:30:07.313593+0000","last_clean":"2024-02-10T08:30:07.313593+0000","last_became_active":"2024-02-10T08:28:02.768279+0000","last_became_peered":"2024-02-10T08:28:02.768279+0000","last_unstale":"2024-02-10T08:30:07.313593+0000","last_undegraded":"2024-02-10T08:30:07.313593+0000","last_fullsized":"2024-02-10T08:30:07.313593+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'2","last_scrub_stamp":"2024-02-10T08:29:22.034268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:29:22.034268+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":184,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"225'23","reported_seq":292,"reported_epoch":283,"state":"active+clean","last_fresh":"2024-02-10T08:30:07.310474+0000","last_change":"2024-02-10T08:29:23.027325+0000","last_active":"2024-02-10T08:30:07.310474+0000","last_peered":"2024-02-10T08:30:07.310474+0000","last_clean":"2024-02-10T08:30:07.310474+0000","last_became_active":"2024-02-10T08:23:15.126133+0000","last_became_peered":"2024-02-10T08:23:15.126133+0000","last_unstale":"2024-02-10T08:30:07.310474+0000","last_undegraded":"2024-02-10T08:30:07.310474+0000","last_fullsized":"2024-02-10T08:30:07.310474+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'23","last_scrub_stamp":"2024-02-10T08:29:23.027211+0000","last_deep_scrub":"82'17","last_deep_scrub_stamp":"2024-02-10T08:18:21.015873+0000","last_clean_scrub_stamp":"2024-02-10T08:29:23.027211+0000","log_size":23,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":25,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6],"acting":[4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":271,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.270824+0000","last_change":"2024-02-10T08:29:14.447872+0000","last_active":"2024-02-10T08:30:03.270824+0000","last_peered":"2024-02-10T08:30:03.270824+0000","last_clean":"2024-02-10T08:30:03.270824+0000","last_became_active":"2024-02-10T08:28:02.777637+0000","last_became_peered":"2024-02-10T08:28:02.777637+0000","last_unstale":"2024-02-10T08:30:03.270824+0000","last_undegraded":"2024-02-10T08:30:03.270824+0000","last_fullsized":"2024-02-10T08:30:03.270824+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:14.447807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:14.447807+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.f","version":"283'7429","reported_seq":7464,"reported_epoch":283,"state":"active+clean","last_fresh":"2024-02-10T08:30:07.610508+0000","last_change":"2024-02-10T08:28:28.332012+0000","last_active":"2024-02-10T08:30:07.610508+0000","last_peered":"2024-02-10T08:30:07.610508+0000","last_clean":"2024-02-10T08:30:07.610508+0000","last_became_active":"2024-02-10T08:28:28.331729+0000","last_became_peered":"2024-02-10T08:28:28.331729+0000","last_unstale":"2024-02-10T08:30:07.610508+0000","last_undegraded":"2024-02-10T08:30:07.610508+0000","last_fullsized":"2024-02-10T08:30:07.610508+0000","mapping_epoch":256,"log_start":"268'3000","ondisk_log_start":"268'3000","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_clean_scrub_stamp":"2024-02-10T08:28:27.172648+0000","log_size":4429,"ondisk_log_size":4429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":486866944,"num_objects":7429,"num_object_clones":0,"num_object_copies":22287,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7429,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7429,"num_write_kb":475456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,2],"acting":[5,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":176,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.262971+0000","last_change":"2024-02-10T08:29:14.538007+0000","last_active":"2024-02-10T08:30:03.262971+0000","last_peered":"2024-02-10T08:30:03.262971+0000","last_clean":"2024-02-10T08:30:03.262971+0000","last_became_active":"2024-02-10T08:28:25.950240+0000","last_became_peered":"2024-02-10T08:28:25.950240+0000","last_unstale":"2024-02-10T08:30:03.262971+0000","last_undegraded":"2024-02-10T08:30:03.262971+0000","last_fullsized":"2024-02-10T08:30:03.262971+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:14.537940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:14.537940+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":270,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.258851+0000","last_change":"2024-02-10T08:28:21.409185+0000","last_active":"2024-02-10T08:30:03.258851+0000","last_peered":"2024-02-10T08:30:03.258851+0000","last_clean":"2024-02-10T08:30:03.258851+0000","last_became_active":"2024-02-10T08:28:02.760784+0000","last_became_peered":"2024-02-10T08:28:02.760784+0000","last_unstale":"2024-02-10T08:30:03.258851+0000","last_undegraded":"2024-02-10T08:30:03.258851+0000","last_fullsized":"2024-02-10T08:30:03.258851+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:21.409109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:28:21.409109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"225'20","reported_seq":295,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.261526+0000","last_change":"2024-02-10T08:29:11.695106+0000","last_active":"2024-02-10T08:30:03.261526+0000","last_peered":"2024-02-10T08:30:03.261526+0000","last_clean":"2024-02-10T08:30:03.261526+0000","last_became_active":"2024-02-10T08:20:46.408495+0000","last_became_peered":"2024-02-10T08:20:46.408495+0000","last_unstale":"2024-02-10T08:30:03.261526+0000","last_undegraded":"2024-02-10T08:30:03.261526+0000","last_fullsized":"2024-02-10T08:30:03.261526+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'20","last_scrub_stamp":"2024-02-10T08:29:11.694999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:29:11.694999+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"255'12","reported_seq":133,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:06.127355+0000","last_change":"2024-02-10T08:28:25.952833+0000","last_active":"2024-02-10T08:30:06.127355+0000","last_peered":"2024-02-10T08:30:06.127355+0000","last_clean":"2024-02-10T08:30:06.127355+0000","last_became_active":"2024-02-10T08:28:25.952468+0000","last_became_peered":"2024-02-10T08:28:25.952468+0000","last_unstale":"2024-02-10T08:30:06.127355+0000","last_undegraded":"2024-02-10T08:30:06.127355+0000","last_fullsized":"2024-02-10T08:30:06.127355+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"244'11","last_scrub_stamp":"2024-02-10T08:28:18.492203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:28:18.492203+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.9","version":"283'7652","reported_seq":7689,"reported_epoch":283,"state":"active+clean","last_fresh":"2024-02-10T08:30:08.106765+0000","last_change":"2024-02-10T08:30:07.380510+0000","last_active":"2024-02-10T08:30:08.106765+0000","last_peered":"2024-02-10T08:30:08.106765+0000","last_clean":"2024-02-10T08:30:08.106765+0000","last_became_active":"2024-02-10T08:28:28.190530+0000","last_became_peered":"2024-02-10T08:28:28.190530+0000","last_unstale":"2024-02-10T08:30:08.106765+0000","last_undegraded":"2024-02-10T08:30:08.106765+0000","last_fullsized":"2024-02-10T08:30:08.106765+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_clean_scrub_stamp":"2024-02-10T08:28:27.172648+0000","log_size":7652,"ondisk_log_size":7652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":501481472,"num_objects":7652,"num_object_clones":0,"num_object_copies":22956,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7652,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7652,"num_write_kb":489728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,5],"acting":[0,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":267,"reported_epoch":283,"state":"active+clean","last_fresh":"2024-02-10T08:30:07.313858+0000","last_change":"2024-02-10T08:28:26.013133+0000","last_active":"2024-02-10T08:30:07.313858+0000","last_peered":"2024-02-10T08:30:07.313858+0000","last_clean":"2024-02-10T08:30:07.313858+0000","last_became_active":"2024-02-10T08:23:34.716482+0000","last_became_peered":"2024-02-10T08:23:34.716482+0000","last_unstale":"2024-02-10T08:30:07.313858+0000","last_undegraded":"2024-02-10T08:30:07.313858+0000","last_fullsized":"2024-02-10T08:30:07.313858+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:26.013060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:26.013060+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":256,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.265378+0000","last_change":"2024-02-10T08:29:11.165779+0000","last_active":"2024-02-10T08:30:03.265378+0000","last_peered":"2024-02-10T08:30:03.265378+0000","last_clean":"2024-02-10T08:30:03.265378+0000","last_became_active":"2024-02-10T08:16:52.791027+0000","last_became_peered":"2024-02-10T08:16:52.791027+0000","last_unstale":"2024-02-10T08:30:03.265378+0000","last_undegraded":"2024-02-10T08:30:03.265378+0000","last_fullsized":"2024-02-10T08:30:03.265378+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:11.165678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:29:11.165678+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"225'41","reported_seq":511,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:06.128417+0000","last_change":"2024-02-10T08:28:22.455298+0000","last_active":"2024-02-10T08:30:06.128417+0000","last_peered":"2024-02-10T08:30:06.128417+0000","last_clean":"2024-02-10T08:30:06.128417+0000","last_became_active":"2024-02-10T08:23:34.709222+0000","last_became_peered":"2024-02-10T08:23:34.709222+0000","last_unstale":"2024-02-10T08:30:06.128417+0000","last_undegraded":"2024-02-10T08:30:06.128417+0000","last_fullsized":"2024-02-10T08:30:06.128417+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'41","last_scrub_stamp":"2024-02-10T08:28:22.455139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:28:22.455139+0000","log_size":41,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":66,"num_read_kb":51,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":358,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":212,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.259316+0000","last_change":"2024-02-10T08:29:26.703538+0000","last_active":"2024-02-10T08:30:03.259316+0000","last_peered":"2024-02-10T08:30:03.259316+0000","last_clean":"2024-02-10T08:30:03.259316+0000","last_became_active":"2024-02-10T08:23:15.081822+0000","last_became_peered":"2024-02-10T08:23:15.081822+0000","last_unstale":"2024-02-10T08:30:03.259316+0000","last_undegraded":"2024-02-10T08:30:03.259316+0000","last_fullsized":"2024-02-10T08:30:03.259316+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:26.703441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:26.703441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,6],"acting":[1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.a","version":"283'7710","reported_seq":7745,"reported_epoch":283,"state":"active+clean","last_fresh":"2024-02-10T08:30:07.617711+0000","last_change":"2024-02-10T08:28:28.186010+0000","last_active":"2024-02-10T08:30:07.617711+0000","last_peered":"2024-02-10T08:30:07.617711+0000","last_clean":"2024-02-10T08:30:07.617711+0000","last_became_active":"2024-02-10T08:28:28.185721+0000","last_became_peered":"2024-02-10T08:28:28.185721+0000","last_unstale":"2024-02-10T08:30:07.617711+0000","last_undegraded":"2024-02-10T08:30:07.617711+0000","last_fullsized":"2024-02-10T08:30:07.617711+0000","mapping_epoch":256,"log_start":"268'3300","ondisk_log_start":"268'3300","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_clean_scrub_stamp":"2024-02-10T08:28:27.172648+0000","log_size":4410,"ondisk_log_size":4410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":505282560,"num_objects":7710,"num_object_clones":0,"num_object_copies":23130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7710,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7710,"num_write_kb":493440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":260,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.271679+0000","last_change":"2024-02-10T08:28:16.113780+0000","last_active":"2024-02-10T08:30:03.271679+0000","last_peered":"2024-02-10T08:30:03.271679+0000","last_clean":"2024-02-10T08:30:03.271679+0000","last_became_active":"2024-02-10T08:21:58.549733+0000","last_became_peered":"2024-02-10T08:21:58.549733+0000","last_unstale":"2024-02-10T08:30:03.271679+0000","last_undegraded":"2024-02-10T08:30:03.271679+0000","last_fullsized":"2024-02-10T08:30:03.271679+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:16.113690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:11.750537+0000","last_clean_scrub_stamp":"2024-02-10T08:28:16.113690+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"63'5","reported_seq":1040,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:07.111833+0000","last_change":"2024-02-10T08:25:43.009500+0000","last_active":"2024-02-10T08:30:07.111833+0000","last_peered":"2024-02-10T08:30:07.111833+0000","last_clean":"2024-02-10T08:30:07.111833+0000","last_became_active":"2024-02-10T08:16:52.780989+0000","last_became_peered":"2024-02-10T08:16:52.780989+0000","last_unstale":"2024-02-10T08:30:07.111833+0000","last_undegraded":"2024-02-10T08:30:07.111833+0000","last_fullsized":"2024-02-10T08:30:07.111833+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'5","last_scrub_stamp":"2024-02-10T08:25:43.009394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:25:43.009394+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":785,"num_read_kb":780,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":284,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.270572+0000","last_change":"2024-02-10T08:28:35.476480+0000","last_active":"2024-02-10T08:30:03.270572+0000","last_peered":"2024-02-10T08:30:03.270572+0000","last_clean":"2024-02-10T08:30:03.270572+0000","last_became_active":"2024-02-10T08:28:02.788789+0000","last_became_peered":"2024-02-10T08:28:02.788789+0000","last_unstale":"2024-02-10T08:30:03.270572+0000","last_undegraded":"2024-02-10T08:30:03.270572+0000","last_fullsized":"2024-02-10T08:30:03.270572+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:35.476417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:11.681169+0000","last_clean_scrub_stamp":"2024-02-10T08:28:35.476417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"225'17","reported_seq":144,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.260628+0000","last_change":"2024-02-10T08:28:38.619626+0000","last_active":"2024-02-10T08:30:03.260628+0000","last_peered":"2024-02-10T08:30:03.260628+0000","last_clean":"2024-02-10T08:30:03.260628+0000","last_became_active":"2024-02-10T08:23:34.729593+0000","last_became_peered":"2024-02-10T08:23:34.729593+0000","last_unstale":"2024-02-10T08:30:03.260628+0000","last_undegraded":"2024-02-10T08:30:03.260628+0000","last_fullsized":"2024-02-10T08:30:03.260628+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'17","last_scrub_stamp":"2024-02-10T08:28:38.619521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:28:38.619521+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":35,"num_read_kb":24,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":253,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.272149+0000","last_change":"2024-02-10T08:29:23.504992+0000","last_active":"2024-02-10T08:30:03.272149+0000","last_peered":"2024-02-10T08:30:03.272149+0000","last_clean":"2024-02-10T08:30:03.272149+0000","last_became_active":"2024-02-10T08:16:56.857856+0000","last_became_peered":"2024-02-10T08:16:56.857856+0000","last_unstale":"2024-02-10T08:30:03.272149+0000","last_undegraded":"2024-02-10T08:30:03.272149+0000","last_fullsized":"2024-02-10T08:30:03.272149+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:23.504892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:23.504892+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.8","version":"283'7486","reported_seq":7521,"reported_epoch":283,"state":"active+clean","last_fresh":"2024-02-10T08:30:08.131374+0000","last_change":"2024-02-10T08:28:28.191187+0000","last_active":"2024-02-10T08:30:08.131374+0000","last_peered":"2024-02-10T08:30:08.131374+0000","last_clean":"2024-02-10T08:30:08.131374+0000","last_became_active":"2024-02-10T08:28:28.190724+0000","last_became_peered":"2024-02-10T08:28:28.190724+0000","last_unstale":"2024-02-10T08:30:08.131374+0000","last_undegraded":"2024-02-10T08:30:08.131374+0000","last_fullsized":"2024-02-10T08:30:08.131374+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_clean_scrub_stamp":"2024-02-10T08:28:27.172648+0000","log_size":7486,"ondisk_log_size":7486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":490602496,"num_objects":7486,"num_object_clones":0,"num_object_copies":22458,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7486,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7486,"num_write_kb":479104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":269,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.266295+0000","last_change":"2024-02-10T08:29:25.198375+0000","last_active":"2024-02-10T08:30:03.266295+0000","last_peered":"2024-02-10T08:30:03.266295+0000","last_clean":"2024-02-10T08:30:03.266295+0000","last_became_active":"2024-02-10T08:21:58.560646+0000","last_became_peered":"2024-02-10T08:21:58.560646+0000","last_unstale":"2024-02-10T08:30:03.266295+0000","last_undegraded":"2024-02-10T08:30:03.266295+0000","last_fullsized":"2024-02-10T08:30:03.266295+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:25.198277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:26:29.921562+0000","last_clean_scrub_stamp":"2024-02-10T08:29:25.198277+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":171,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.265444+0000","last_change":"2024-02-10T08:28:35.177207+0000","last_active":"2024-02-10T08:30:03.265444+0000","last_peered":"2024-02-10T08:30:03.265444+0000","last_clean":"2024-02-10T08:30:03.265444+0000","last_became_active":"2024-02-10T08:23:34.712122+0000","last_became_peered":"2024-02-10T08:23:34.712122+0000","last_unstale":"2024-02-10T08:30:03.265444+0000","last_undegraded":"2024-02-10T08:30:03.265444+0000","last_fullsized":"2024-02-10T08:30:03.265444+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:35.177138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:28:35.177138+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,4],"acting":[5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":256,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.265711+0000","last_change":"2024-02-10T08:29:06.087344+0000","last_active":"2024-02-10T08:30:03.265711+0000","last_peered":"2024-02-10T08:30:03.265711+0000","last_clean":"2024-02-10T08:30:03.265711+0000","last_became_active":"2024-02-10T08:16:52.788767+0000","last_became_peered":"2024-02-10T08:16:52.788767+0000","last_unstale":"2024-02-10T08:30:03.265711+0000","last_undegraded":"2024-02-10T08:30:03.265711+0000","last_fullsized":"2024-02-10T08:30:03.265711+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:06.087258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:29:06.087258+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":271,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.267618+0000","last_change":"2024-02-10T08:26:24.214276+0000","last_active":"2024-02-10T08:30:03.267618+0000","last_peered":"2024-02-10T08:30:03.267618+0000","last_clean":"2024-02-10T08:30:03.267618+0000","last_became_active":"2024-02-10T08:23:34.717837+0000","last_became_peered":"2024-02-10T08:23:34.717837+0000","last_unstale":"2024-02-10T08:30:03.267618+0000","last_undegraded":"2024-02-10T08:30:03.267618+0000","last_fullsized":"2024-02-10T08:30:03.267618+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:26:24.214179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:14:44.584370+0000","last_clean_scrub_stamp":"2024-02-10T08:26:24.214179+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"225'33","reported_seq":316,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.274365+0000","last_change":"2024-02-10T08:29:20.522358+0000","last_active":"2024-02-10T08:30:03.274365+0000","last_peered":"2024-02-10T08:30:03.274365+0000","last_clean":"2024-02-10T08:30:03.274365+0000","last_became_active":"2024-02-10T08:20:46.401981+0000","last_became_peered":"2024-02-10T08:20:46.401981+0000","last_unstale":"2024-02-10T08:30:03.274365+0000","last_undegraded":"2024-02-10T08:30:03.274365+0000","last_fullsized":"2024-02-10T08:30:03.274365+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'33","last_scrub_stamp":"2024-02-10T08:29:20.522259+0000","last_deep_scrub":"223'21","last_deep_scrub_stamp":"2024-02-10T08:26:33.250614+0000","last_clean_scrub_stamp":"2024-02-10T08:29:20.522259+0000","log_size":33,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":33,"num_write":25,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":252,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.268801+0000","last_change":"2024-02-10T08:29:13.416528+0000","last_active":"2024-02-10T08:30:03.268801+0000","last_peered":"2024-02-10T08:30:03.268801+0000","last_clean":"2024-02-10T08:30:03.268801+0000","last_became_active":"2024-02-10T08:16:56.867159+0000","last_became_peered":"2024-02-10T08:16:56.867159+0000","last_unstale":"2024-02-10T08:30:03.268801+0000","last_undegraded":"2024-02-10T08:30:03.268801+0000","last_fullsized":"2024-02-10T08:30:03.268801+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:13.416461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:04.766780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:13.416461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.b","version":"283'7648","reported_seq":7683,"reported_epoch":283,"state":"active+clean","last_fresh":"2024-02-10T08:30:07.610811+0000","last_change":"2024-02-10T08:28:28.331854+0000","last_active":"2024-02-10T08:30:07.610811+0000","last_peered":"2024-02-10T08:30:07.610811+0000","last_clean":"2024-02-10T08:30:07.610811+0000","last_became_active":"2024-02-10T08:28:28.331529+0000","last_became_peered":"2024-02-10T08:28:28.331529+0000","last_unstale":"2024-02-10T08:30:07.610811+0000","last_undegraded":"2024-02-10T08:30:07.610811+0000","last_fullsized":"2024-02-10T08:30:07.610811+0000","mapping_epoch":256,"log_start":"268'3000","ondisk_log_start":"268'3000","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_clean_scrub_stamp":"2024-02-10T08:28:27.172648+0000","log_size":4648,"ondisk_log_size":4648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":501219328,"num_objects":7648,"num_object_clones":0,"num_object_copies":22944,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7648,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7648,"num_write_kb":489472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":268,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.259156+0000","last_change":"2024-02-10T08:28:19.044189+0000","last_active":"2024-02-10T08:30:03.259156+0000","last_peered":"2024-02-10T08:30:03.259156+0000","last_clean":"2024-02-10T08:30:03.259156+0000","last_became_active":"2024-02-10T08:28:19.022399+0000","last_became_peered":"2024-02-10T08:28:19.022399+0000","last_unstale":"2024-02-10T08:30:03.259156+0000","last_undegraded":"2024-02-10T08:30:03.259156+0000","last_fullsized":"2024-02-10T08:30:03.259156+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:09.785096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:20:09.785096+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":230,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.263941+0000","last_change":"2024-02-10T08:29:06.426493+0000","last_active":"2024-02-10T08:30:03.263941+0000","last_peered":"2024-02-10T08:30:03.263941+0000","last_clean":"2024-02-10T08:30:03.263941+0000","last_became_active":"2024-02-10T08:28:38.233974+0000","last_became_peered":"2024-02-10T08:28:38.233974+0000","last_unstale":"2024-02-10T08:30:03.263941+0000","last_undegraded":"2024-02-10T08:30:03.263941+0000","last_fullsized":"2024-02-10T08:30:03.263941+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:06.426390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:20.736224+0000","last_clean_scrub_stamp":"2024-02-10T08:29:06.426390+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":269,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.267513+0000","last_change":"2024-02-10T08:28:02.761385+0000","last_active":"2024-02-10T08:30:03.267513+0000","last_peered":"2024-02-10T08:30:03.267513+0000","last_clean":"2024-02-10T08:30:03.267513+0000","last_became_active":"2024-02-10T08:28:02.760999+0000","last_became_peered":"2024-02-10T08:28:02.760999+0000","last_unstale":"2024-02-10T08:30:03.267513+0000","last_undegraded":"2024-02-10T08:30:03.267513+0000","last_fullsized":"2024-02-10T08:30:03.267513+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:26:31.161639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:26:31.161639+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"225'24","reported_seq":198,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.260127+0000","last_change":"2024-02-10T08:28:26.505341+0000","last_active":"2024-02-10T08:30:03.260127+0000","last_peered":"2024-02-10T08:30:03.260127+0000","last_clean":"2024-02-10T08:30:03.260127+0000","last_became_active":"2024-02-10T08:23:15.077476+0000","last_became_peered":"2024-02-10T08:23:15.077476+0000","last_unstale":"2024-02-10T08:30:03.260127+0000","last_undegraded":"2024-02-10T08:30:03.260127+0000","last_fullsized":"2024-02-10T08:30:03.260127+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'24","last_scrub_stamp":"2024-02-10T08:28:26.505270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:28:26.505270+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,7],"acting":[1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":274,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.266250+0000","last_change":"2024-02-10T08:29:14.145590+0000","last_active":"2024-02-10T08:30:03.266250+0000","last_peered":"2024-02-10T08:30:03.266250+0000","last_clean":"2024-02-10T08:30:03.266250+0000","last_became_active":"2024-02-10T08:28:02.772585+0000","last_became_peered":"2024-02-10T08:28:02.772585+0000","last_unstale":"2024-02-10T08:30:03.266250+0000","last_undegraded":"2024-02-10T08:30:03.266250+0000","last_fullsized":"2024-02-10T08:30:03.266250+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:14.145493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:41.360241+0000","last_clean_scrub_stamp":"2024-02-10T08:29:14.145493+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.e","version":"283'7487","reported_seq":7522,"reported_epoch":283,"state":"active+clean","last_fresh":"2024-02-10T08:30:07.655954+0000","last_change":"2024-02-10T08:28:28.188744+0000","last_active":"2024-02-10T08:30:07.655954+0000","last_peered":"2024-02-10T08:30:07.655954+0000","last_clean":"2024-02-10T08:30:07.655954+0000","last_became_active":"2024-02-10T08:28:28.188416+0000","last_became_peered":"2024-02-10T08:28:28.188416+0000","last_unstale":"2024-02-10T08:30:07.655954+0000","last_undegraded":"2024-02-10T08:30:07.655954+0000","last_fullsized":"2024-02-10T08:30:07.655954+0000","mapping_epoch":256,"log_start":"269'3600","ondisk_log_start":"269'3600","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_clean_scrub_stamp":"2024-02-10T08:28:27.172648+0000","log_size":3887,"ondisk_log_size":3887,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":490668032,"num_objects":7487,"num_object_clones":0,"num_object_copies":22461,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7487,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7487,"num_write_kb":479168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":255,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.258669+0000","last_change":"2024-02-10T08:28:39.633777+0000","last_active":"2024-02-10T08:30:03.258669+0000","last_peered":"2024-02-10T08:30:03.258669+0000","last_clean":"2024-02-10T08:30:03.258669+0000","last_became_active":"2024-02-10T08:21:58.553966+0000","last_became_peered":"2024-02-10T08:21:58.553966+0000","last_unstale":"2024-02-10T08:30:03.258669+0000","last_undegraded":"2024-02-10T08:30:03.258669+0000","last_fullsized":"2024-02-10T08:30:03.258669+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:39.633627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:39.633627+0000","last_clean_scrub_stamp":"2024-02-10T08:28:39.633627+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":245,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.271471+0000","last_change":"2024-02-10T08:27:27.094310+0000","last_active":"2024-02-10T08:30:03.271471+0000","last_peered":"2024-02-10T08:30:03.271471+0000","last_clean":"2024-02-10T08:30:03.271471+0000","last_became_active":"2024-02-10T08:23:34.708387+0000","last_became_peered":"2024-02-10T08:23:34.708387+0000","last_unstale":"2024-02-10T08:30:03.271471+0000","last_undegraded":"2024-02-10T08:30:03.271471+0000","last_fullsized":"2024-02-10T08:30:03.271471+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:27:27.094240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:27:27.094240+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"225'37","reported_seq":348,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.263727+0000","last_change":"2024-02-10T08:28:33.205966+0000","last_active":"2024-02-10T08:30:03.263727+0000","last_peered":"2024-02-10T08:30:03.263727+0000","last_clean":"2024-02-10T08:30:03.263727+0000","last_became_active":"2024-02-10T08:28:25.951447+0000","last_became_peered":"2024-02-10T08:28:25.951447+0000","last_unstale":"2024-02-10T08:30:03.263727+0000","last_undegraded":"2024-02-10T08:30:03.263727+0000","last_fullsized":"2024-02-10T08:30:03.263727+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'37","last_scrub_stamp":"2024-02-10T08:28:33.205891+0000","last_deep_scrub":"199'27","last_deep_scrub_stamp":"2024-02-10T08:24:42.826442+0000","last_clean_scrub_stamp":"2024-02-10T08:28:33.205891+0000","log_size":37,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":53,"num_read_kb":39,"num_write":32,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":270,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.274326+0000","last_change":"2024-02-10T08:29:11.420173+0000","last_active":"2024-02-10T08:30:03.274326+0000","last_peered":"2024-02-10T08:30:03.274326+0000","last_clean":"2024-02-10T08:30:03.274326+0000","last_became_active":"2024-02-10T08:28:02.769069+0000","last_became_peered":"2024-02-10T08:28:02.769069+0000","last_unstale":"2024-02-10T08:30:03.274326+0000","last_undegraded":"2024-02-10T08:30:03.274326+0000","last_fullsized":"2024-02-10T08:30:03.274326+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:11.420031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:11.420031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.d","version":"283'7597","reported_seq":7632,"reported_epoch":283,"state":"active+clean","last_fresh":"2024-02-10T08:30:07.626955+0000","last_change":"2024-02-10T08:28:28.188686+0000","last_active":"2024-02-10T08:30:07.626955+0000","last_peered":"2024-02-10T08:30:07.626955+0000","last_clean":"2024-02-10T08:30:07.626955+0000","last_became_active":"2024-02-10T08:28:28.188347+0000","last_became_peered":"2024-02-10T08:28:28.188347+0000","last_unstale":"2024-02-10T08:30:07.626955+0000","last_undegraded":"2024-02-10T08:30:07.626955+0000","last_fullsized":"2024-02-10T08:30:07.626955+0000","mapping_epoch":256,"log_start":"269'3700","ondisk_log_start":"269'3700","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_clean_scrub_stamp":"2024-02-10T08:28:27.172648+0000","log_size":3897,"ondisk_log_size":3897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":497876992,"num_objects":7597,"num_object_clones":0,"num_object_copies":22791,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7597,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7597,"num_write_kb":486208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,5],"acting":[7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":252,"reported_epoch":283,"state":"active+clean","last_fresh":"2024-02-10T08:30:07.310859+0000","last_change":"2024-02-10T08:28:22.016781+0000","last_active":"2024-02-10T08:30:07.310859+0000","last_peered":"2024-02-10T08:30:07.310859+0000","last_clean":"2024-02-10T08:30:07.310859+0000","last_became_active":"2024-02-10T08:23:15.074239+0000","last_became_peered":"2024-02-10T08:23:15.074239+0000","last_unstale":"2024-02-10T08:30:07.310859+0000","last_undegraded":"2024-02-10T08:30:07.310859+0000","last_fullsized":"2024-02-10T08:30:07.310859+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:22.016693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:22.016693+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":267,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.259870+0000","last_change":"2024-02-10T08:29:04.701249+0000","last_active":"2024-02-10T08:30:03.259870+0000","last_peered":"2024-02-10T08:30:03.259870+0000","last_clean":"2024-02-10T08:30:03.259870+0000","last_became_active":"2024-02-10T08:20:46.407667+0000","last_became_peered":"2024-02-10T08:20:46.407667+0000","last_unstale":"2024-02-10T08:30:03.259870+0000","last_undegraded":"2024-02-10T08:30:03.259870+0000","last_fullsized":"2024-02-10T08:30:03.259870+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:04.701160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:29:04.701160+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"225'30","reported_seq":259,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.268065+0000","last_change":"2024-02-10T08:28:35.245725+0000","last_active":"2024-02-10T08:30:03.268065+0000","last_peered":"2024-02-10T08:30:03.268065+0000","last_clean":"2024-02-10T08:30:03.268065+0000","last_became_active":"2024-02-10T08:23:15.079674+0000","last_became_peered":"2024-02-10T08:23:15.079674+0000","last_unstale":"2024-02-10T08:30:03.268065+0000","last_undegraded":"2024-02-10T08:30:03.268065+0000","last_fullsized":"2024-02-10T08:30:03.268065+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'30","last_scrub_stamp":"2024-02-10T08:28:35.245660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:28:35.245660+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":51,"num_read_kb":39,"num_write":32,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,5],"acting":[7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":239,"reported_epoch":283,"state":"active+clean","last_fresh":"2024-02-10T08:30:07.310673+0000","last_change":"2024-02-10T08:29:27.021175+0000","last_active":"2024-02-10T08:30:07.310673+0000","last_peered":"2024-02-10T08:30:07.310673+0000","last_clean":"2024-02-10T08:30:07.310673+0000","last_became_active":"2024-02-10T08:23:34.706206+0000","last_became_peered":"2024-02-10T08:23:34.706206+0000","last_unstale":"2024-02-10T08:30:07.310673+0000","last_undegraded":"2024-02-10T08:30:07.310673+0000","last_fullsized":"2024-02-10T08:30:07.310673+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:27.021108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:27.021108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,5],"acting":[4,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.c","version":"284'7746","reported_seq":7782,"reported_epoch":284,"state":"active+clean","last_fresh":"2024-02-10T08:30:09.911247+0000","last_change":"2024-02-10T08:28:28.529419+0000","last_active":"2024-02-10T08:30:09.911247+0000","last_peered":"2024-02-10T08:30:09.911247+0000","last_clean":"2024-02-10T08:30:09.911247+0000","last_became_active":"2024-02-10T08:28:28.529047+0000","last_became_peered":"2024-02-10T08:28:28.529047+0000","last_unstale":"2024-02-10T08:30:09.911247+0000","last_undegraded":"2024-02-10T08:30:09.911247+0000","last_fullsized":"2024-02-10T08:30:09.911247+0000","mapping_epoch":256,"log_start":"266'2300","ondisk_log_start":"266'2300","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_clean_scrub_stamp":"2024-02-10T08:28:27.172648+0000","log_size":5446,"ondisk_log_size":5446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":491520000,"num_objects":7500,"num_object_clones":0,"num_object_copies":22500,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7500,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7746,"num_write_kb":487872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":254,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.269445+0000","last_change":"2024-02-10T08:28:17.059779+0000","last_active":"2024-02-10T08:30:03.269445+0000","last_peered":"2024-02-10T08:30:03.269445+0000","last_clean":"2024-02-10T08:30:03.269445+0000","last_became_active":"2024-02-10T08:21:58.546976+0000","last_became_peered":"2024-02-10T08:21:58.546976+0000","last_unstale":"2024-02-10T08:30:03.269445+0000","last_undegraded":"2024-02-10T08:30:03.269445+0000","last_fullsized":"2024-02-10T08:30:03.269445+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:17.059697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:17.059697+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":256,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.275458+0000","last_change":"2024-02-10T08:29:03.396846+0000","last_active":"2024-02-10T08:30:03.275458+0000","last_peered":"2024-02-10T08:30:03.275458+0000","last_clean":"2024-02-10T08:30:03.275458+0000","last_became_active":"2024-02-10T08:16:52.789020+0000","last_became_peered":"2024-02-10T08:16:52.789020+0000","last_unstale":"2024-02-10T08:30:03.275458+0000","last_undegraded":"2024-02-10T08:30:03.275458+0000","last_fullsized":"2024-02-10T08:30:03.275458+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:03.396727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:29:03.396727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"225'28","reported_seq":270,"reported_epoch":283,"state":"active+clean","last_fresh":"2024-02-10T08:30:07.310602+0000","last_change":"2024-02-10T08:29:24.036552+0000","last_active":"2024-02-10T08:30:07.310602+0000","last_peered":"2024-02-10T08:30:07.310602+0000","last_clean":"2024-02-10T08:30:07.310602+0000","last_became_active":"2024-02-10T08:20:46.400760+0000","last_became_peered":"2024-02-10T08:20:46.400760+0000","last_unstale":"2024-02-10T08:30:07.310602+0000","last_undegraded":"2024-02-10T08:30:07.310602+0000","last_fullsized":"2024-02-10T08:30:07.310602+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'28","last_scrub_stamp":"2024-02-10T08:29:24.036448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:29:24.036448+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":41,"num_read_kb":34,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"199'13","reported_seq":288,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:06.126647+0000","last_change":"2024-02-10T08:29:15.700537+0000","last_active":"2024-02-10T08:30:06.126647+0000","last_peered":"2024-02-10T08:30:06.126647+0000","last_clean":"2024-02-10T08:30:06.126647+0000","last_became_active":"2024-02-10T08:23:34.711450+0000","last_became_peered":"2024-02-10T08:23:34.711450+0000","last_unstale":"2024-02-10T08:30:06.126647+0000","last_undegraded":"2024-02-10T08:30:06.126647+0000","last_fullsized":"2024-02-10T08:30:06.126647+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"199'13","last_scrub_stamp":"2024-02-10T08:29:15.700463+0000","last_deep_scrub":"199'13","last_deep_scrub_stamp":"2024-02-10T08:24:47.529439+0000","last_clean_scrub_stamp":"2024-02-10T08:29:15.700463+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,2],"acting":[1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"283'7485","reported_seq":7520,"reported_epoch":283,"state":"active+clean","last_fresh":"2024-02-10T08:30:07.656026+0000","last_change":"2024-02-10T08:28:28.529385+0000","last_active":"2024-02-10T08:30:07.656026+0000","last_peered":"2024-02-10T08:30:07.656026+0000","last_clean":"2024-02-10T08:30:07.656026+0000","last_became_active":"2024-02-10T08:28:28.529058+0000","last_became_peered":"2024-02-10T08:28:28.529058+0000","last_unstale":"2024-02-10T08:30:07.656026+0000","last_undegraded":"2024-02-10T08:30:07.656026+0000","last_fullsized":"2024-02-10T08:30:07.656026+0000","mapping_epoch":256,"log_start":"269'3600","ondisk_log_start":"269'3600","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_clean_scrub_stamp":"2024-02-10T08:28:27.172648+0000","log_size":3885,"ondisk_log_size":3885,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":490536960,"num_objects":7485,"num_object_clones":0,"num_object_copies":22455,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7485,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7485,"num_write_kb":479040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":171,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.274697+0000","last_change":"2024-02-10T08:29:15.491820+0000","last_active":"2024-02-10T08:30:03.274697+0000","last_peered":"2024-02-10T08:30:03.274697+0000","last_clean":"2024-02-10T08:30:03.274697+0000","last_became_active":"2024-02-10T08:23:34.716306+0000","last_became_peered":"2024-02-10T08:23:34.716306+0000","last_unstale":"2024-02-10T08:30:03.274697+0000","last_undegraded":"2024-02-10T08:30:03.274697+0000","last_fullsized":"2024-02-10T08:30:03.274697+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:15.491747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:20:30.227375+0000","last_clean_scrub_stamp":"2024-02-10T08:29:15.491747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,7],"acting":[6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":312,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.266224+0000","last_change":"2024-02-10T08:28:18.284825+0000","last_active":"2024-02-10T08:30:03.266224+0000","last_peered":"2024-02-10T08:30:03.266224+0000","last_clean":"2024-02-10T08:30:03.266224+0000","last_became_active":"2024-02-10T08:20:46.400500+0000","last_became_peered":"2024-02-10T08:20:46.400500+0000","last_unstale":"2024-02-10T08:30:03.266224+0000","last_undegraded":"2024-02-10T08:30:03.266224+0000","last_fullsized":"2024-02-10T08:30:03.266224+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:18.284751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:28:18.284751+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":269,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.267699+0000","last_change":"2024-02-10T08:28:02.768983+0000","last_active":"2024-02-10T08:30:03.267699+0000","last_peered":"2024-02-10T08:30:03.267699+0000","last_clean":"2024-02-10T08:30:03.267699+0000","last_became_active":"2024-02-10T08:28:02.768633+0000","last_became_peered":"2024-02-10T08:28:02.768633+0000","last_unstale":"2024-02-10T08:30:03.267699+0000","last_undegraded":"2024-02-10T08:30:03.267699+0000","last_fullsized":"2024-02-10T08:30:03.267699+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:25:37.371542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:25:37.371542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"225'24","reported_seq":274,"reported_epoch":283,"state":"active+clean","last_fresh":"2024-02-10T08:30:07.314168+0000","last_change":"2024-02-10T08:28:18.012177+0000","last_active":"2024-02-10T08:30:07.314168+0000","last_peered":"2024-02-10T08:30:07.314168+0000","last_clean":"2024-02-10T08:30:07.314168+0000","last_became_active":"2024-02-10T08:20:46.406023+0000","last_became_peered":"2024-02-10T08:20:46.406023+0000","last_unstale":"2024-02-10T08:30:07.314168+0000","last_undegraded":"2024-02-10T08:30:07.314168+0000","last_fullsized":"2024-02-10T08:30:07.314168+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'24","last_scrub_stamp":"2024-02-10T08:28:18.012102+0000","last_deep_scrub":"76'16","last_deep_scrub_stamp":"2024-02-10T08:18:07.909782+0000","last_clean_scrub_stamp":"2024-02-10T08:28:18.012102+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"283'7601","reported_seq":7634,"reported_epoch":283,"state":"active+clean","last_fresh":"2024-02-10T08:30:07.721864+0000","last_change":"2024-02-10T08:28:28.332050+0000","last_active":"2024-02-10T08:30:07.721864+0000","last_peered":"2024-02-10T08:30:07.721864+0000","last_clean":"2024-02-10T08:30:07.721864+0000","last_became_active":"2024-02-10T08:28:28.331715+0000","last_became_peered":"2024-02-10T08:28:28.331715+0000","last_unstale":"2024-02-10T08:30:07.721864+0000","last_undegraded":"2024-02-10T08:30:07.721864+0000","last_fullsized":"2024-02-10T08:30:07.721864+0000","mapping_epoch":256,"log_start":"269'3600","ondisk_log_start":"269'3600","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_clean_scrub_stamp":"2024-02-10T08:28:27.172648+0000","log_size":4001,"ondisk_log_size":4001,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":498139136,"num_objects":7601,"num_object_clones":0,"num_object_copies":22803,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7601,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7601,"num_write_kb":486464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,7],"acting":[1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":259,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.268923+0000","last_change":"2024-02-10T08:28:36.163224+0000","last_active":"2024-02-10T08:30:03.268923+0000","last_peered":"2024-02-10T08:30:03.268923+0000","last_clean":"2024-02-10T08:30:03.268923+0000","last_became_active":"2024-02-10T08:23:15.078797+0000","last_became_peered":"2024-02-10T08:23:15.078797+0000","last_unstale":"2024-02-10T08:30:03.268923+0000","last_undegraded":"2024-02-10T08:30:03.268923+0000","last_fullsized":"2024-02-10T08:30:03.268923+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:36.163125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:36.163125+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,2],"acting":[5,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"261'13","reported_seq":124,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:06.127807+0000","last_change":"2024-02-10T08:29:13.140731+0000","last_active":"2024-02-10T08:30:06.127807+0000","last_peered":"2024-02-10T08:30:06.127807+0000","last_clean":"2024-02-10T08:30:06.127807+0000","last_became_active":"2024-02-10T08:28:38.231242+0000","last_became_peered":"2024-02-10T08:28:38.231242+0000","last_unstale":"2024-02-10T08:30:06.127807+0000","last_undegraded":"2024-02-10T08:30:06.127807+0000","last_fullsized":"2024-02-10T08:30:06.127807+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'13","last_scrub_stamp":"2024-02-10T08:29:13.140622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:13.140622+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,2],"acting":[5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":252,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.258582+0000","last_change":"2024-02-10T08:26:24.169444+0000","last_active":"2024-02-10T08:30:03.258582+0000","last_peered":"2024-02-10T08:30:03.258582+0000","last_clean":"2024-02-10T08:30:03.258582+0000","last_became_active":"2024-02-10T08:16:52.783634+0000","last_became_peered":"2024-02-10T08:16:52.783634+0000","last_unstale":"2024-02-10T08:30:03.258582+0000","last_undegraded":"2024-02-10T08:30:03.258582+0000","last_fullsized":"2024-02-10T08:30:03.258582+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:26:24.169341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:26:24.169341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"226'27","reported_seq":275,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.272441+0000","last_change":"2024-02-10T08:28:18.108820+0000","last_active":"2024-02-10T08:30:03.272441+0000","last_peered":"2024-02-10T08:30:03.272441+0000","last_clean":"2024-02-10T08:30:03.272441+0000","last_became_active":"2024-02-10T08:20:46.401777+0000","last_became_peered":"2024-02-10T08:20:46.401777+0000","last_unstale":"2024-02-10T08:30:03.272441+0000","last_undegraded":"2024-02-10T08:30:03.272441+0000","last_fullsized":"2024-02-10T08:30:03.272441+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"226'27","last_scrub_stamp":"2024-02-10T08:28:18.108712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:28:18.108712+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1","version":"283'7471","reported_seq":7506,"reported_epoch":283,"state":"active+clean","last_fresh":"2024-02-10T08:30:07.560637+0000","last_change":"2024-02-10T08:28:28.530157+0000","last_active":"2024-02-10T08:30:07.560637+0000","last_peered":"2024-02-10T08:30:07.560637+0000","last_clean":"2024-02-10T08:30:07.560637+0000","last_became_active":"2024-02-10T08:28:28.529924+0000","last_became_peered":"2024-02-10T08:28:28.529924+0000","last_unstale":"2024-02-10T08:30:07.560637+0000","last_undegraded":"2024-02-10T08:30:07.560637+0000","last_fullsized":"2024-02-10T08:30:07.560637+0000","mapping_epoch":256,"log_start":"267'2800","ondisk_log_start":"267'2800","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_clean_scrub_stamp":"2024-02-10T08:28:27.172648+0000","log_size":4671,"ondisk_log_size":4671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":489619456,"num_objects":7471,"num_object_clones":0,"num_object_copies":22413,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7471,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7471,"num_write_kb":478144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":222,"reported_epoch":283,"state":"active+clean","last_fresh":"2024-02-10T08:30:07.313938+0000","last_change":"2024-02-10T08:28:26.976109+0000","last_active":"2024-02-10T08:30:07.313938+0000","last_peered":"2024-02-10T08:30:07.313938+0000","last_clean":"2024-02-10T08:30:07.313938+0000","last_became_active":"2024-02-10T08:20:46.405578+0000","last_became_peered":"2024-02-10T08:20:46.405578+0000","last_unstale":"2024-02-10T08:30:07.313938+0000","last_undegraded":"2024-02-10T08:30:07.313938+0000","last_fullsized":"2024-02-10T08:30:07.313938+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:26.976023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:26.976023+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"62'8","reported_seq":420,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:06.127357+0000","last_change":"2024-02-10T08:29:12.429460+0000","last_active":"2024-02-10T08:30:06.127357+0000","last_peered":"2024-02-10T08:30:06.127357+0000","last_clean":"2024-02-10T08:30:06.127357+0000","last_became_active":"2024-02-10T08:16:56.858101+0000","last_became_peered":"2024-02-10T08:16:56.858101+0000","last_unstale":"2024-02-10T08:30:06.127357+0000","last_undegraded":"2024-02-10T08:30:06.127357+0000","last_fullsized":"2024-02-10T08:30:06.127357+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'8","last_scrub_stamp":"2024-02-10T08:29:12.429342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:12.429342+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":252,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.261451+0000","last_change":"2024-02-10T08:26:19.229352+0000","last_active":"2024-02-10T08:30:03.261451+0000","last_peered":"2024-02-10T08:30:03.261451+0000","last_clean":"2024-02-10T08:30:03.261451+0000","last_became_active":"2024-02-10T08:16:52.785545+0000","last_became_peered":"2024-02-10T08:16:52.785545+0000","last_unstale":"2024-02-10T08:30:03.261451+0000","last_undegraded":"2024-02-10T08:30:03.261451+0000","last_fullsized":"2024-02-10T08:30:03.261451+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:26:19.229261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:26:19.229261+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"225'20","reported_seq":267,"reported_epoch":283,"state":"active+clean","last_fresh":"2024-02-10T08:30:07.311056+0000","last_change":"2024-02-10T08:26:39.910278+0000","last_active":"2024-02-10T08:30:07.311056+0000","last_peered":"2024-02-10T08:30:07.311056+0000","last_clean":"2024-02-10T08:30:07.311056+0000","last_became_active":"2024-02-10T08:20:46.398973+0000","last_became_peered":"2024-02-10T08:20:46.398973+0000","last_unstale":"2024-02-10T08:30:07.311056+0000","last_undegraded":"2024-02-10T08:30:07.311056+0000","last_fullsized":"2024-02-10T08:30:07.311056+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'10","last_scrub_stamp":"2024-02-10T08:26:39.910195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:26:39.910195+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":24,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"283'7693","reported_seq":8480,"reported_epoch":283,"state":"active+remapped+backfilling","last_fresh":"2024-02-10T08:30:07.707842+0000","last_change":"2024-02-10T08:29:46.623364+0000","last_active":"2024-02-10T08:30:07.707842+0000","last_peered":"2024-02-10T08:30:07.707842+0000","last_clean":"2024-02-10T08:29:13.933885+0000","last_became_active":"2024-02-10T08:29:16.482526+0000","last_became_peered":"2024-02-10T08:29:16.482526+0000","last_unstale":"2024-02-10T08:30:07.707842+0000","last_undegraded":"2024-02-10T08:30:07.707842+0000","last_fullsized":"2024-02-10T08:30:07.707842+0000","mapping_epoch":272,"log_start":"269'3700","ondisk_log_start":"269'3700","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_clean_scrub_stamp":"2024-02-10T08:28:27.172648+0000","log_size":3993,"ondisk_log_size":3993,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":504168448,"num_objects":7693,"num_object_clones":0,"num_object_copies":23079,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":14860,"num_objects_unfound":0,"num_objects_dirty":7693,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7693,"num_write_kb":492352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":246,"num_bytes_recovered":16121856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,4],"acting":[1,6,2],"avail_no_missing":["1","2","6"],"object_location_counts":[{"shards":"1,2,6","objects":7693}],"blocked_by":[],"up_primary":5,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":210,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.263464+0000","last_change":"2024-02-10T08:28:34.215446+0000","last_active":"2024-02-10T08:30:03.263464+0000","last_peered":"2024-02-10T08:30:03.263464+0000","last_clean":"2024-02-10T08:30:03.263464+0000","last_became_active":"2024-02-10T08:28:26.000711+0000","last_became_peered":"2024-02-10T08:28:26.000711+0000","last_unstale":"2024-02-10T08:30:03.263464+0000","last_undegraded":"2024-02-10T08:30:03.263464+0000","last_fullsized":"2024-02-10T08:30:03.263464+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:34.215363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:34.215363+0000","last_clean_scrub_stamp":"2024-02-10T08:28:34.215363+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6],"acting":[0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":281,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.259079+0000","last_change":"2024-02-10T08:29:24.690721+0000","last_active":"2024-02-10T08:30:03.259079+0000","last_peered":"2024-02-10T08:30:03.259079+0000","last_clean":"2024-02-10T08:30:03.259079+0000","last_became_active":"2024-02-10T08:28:02.764210+0000","last_became_peered":"2024-02-10T08:28:02.764210+0000","last_unstale":"2024-02-10T08:30:03.259079+0000","last_undegraded":"2024-02-10T08:30:03.259079+0000","last_fullsized":"2024-02-10T08:30:03.259079+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:24.690623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:24.690623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":266,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.269052+0000","last_change":"2024-02-10T08:25:29.293026+0000","last_active":"2024-02-10T08:30:03.269052+0000","last_peered":"2024-02-10T08:30:03.269052+0000","last_clean":"2024-02-10T08:30:03.269052+0000","last_became_active":"2024-02-10T08:20:46.399568+0000","last_became_peered":"2024-02-10T08:20:46.399568+0000","last_unstale":"2024-02-10T08:30:03.269052+0000","last_undegraded":"2024-02-10T08:30:03.269052+0000","last_fullsized":"2024-02-10T08:30:03.269052+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:25:29.292955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:25:29.292955+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"225'31","reported_seq":300,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.271551+0000","last_change":"2024-02-10T08:28:38.271681+0000","last_active":"2024-02-10T08:30:03.271551+0000","last_peered":"2024-02-10T08:30:03.271551+0000","last_clean":"2024-02-10T08:30:03.271551+0000","last_became_active":"2024-02-10T08:28:38.237476+0000","last_became_peered":"2024-02-10T08:28:38.237476+0000","last_unstale":"2024-02-10T08:30:03.271551+0000","last_undegraded":"2024-02-10T08:30:03.271551+0000","last_fullsized":"2024-02-10T08:30:03.271551+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'31","last_scrub_stamp":"2024-02-10T08:28:14.001126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:28:14.001126+0000","log_size":31,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":48,"num_read_kb":38,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.7","version":"283'7693","reported_seq":7728,"reported_epoch":283,"state":"active+clean","last_fresh":"2024-02-10T08:30:07.622216+0000","last_change":"2024-02-10T08:28:28.331926+0000","last_active":"2024-02-10T08:30:07.622216+0000","last_peered":"2024-02-10T08:30:07.622216+0000","last_clean":"2024-02-10T08:30:07.622216+0000","last_became_active":"2024-02-10T08:28:28.331632+0000","last_became_peered":"2024-02-10T08:28:28.331632+0000","last_unstale":"2024-02-10T08:30:07.622216+0000","last_undegraded":"2024-02-10T08:30:07.622216+0000","last_fullsized":"2024-02-10T08:30:07.622216+0000","mapping_epoch":256,"log_start":"268'3300","ondisk_log_start":"268'3300","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_clean_scrub_stamp":"2024-02-10T08:28:27.172648+0000","log_size":4393,"ondisk_log_size":4393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":504168448,"num_objects":7693,"num_object_clones":0,"num_object_copies":23079,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7693,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7693,"num_write_kb":492352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2],"acting":[5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":263,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.267428+0000","last_change":"2024-02-10T08:28:22.114493+0000","last_active":"2024-02-10T08:30:03.267428+0000","last_peered":"2024-02-10T08:30:03.267428+0000","last_clean":"2024-02-10T08:30:03.267428+0000","last_became_active":"2024-02-10T08:24:18.645480+0000","last_became_peered":"2024-02-10T08:24:18.645480+0000","last_unstale":"2024-02-10T08:30:03.267428+0000","last_undegraded":"2024-02-10T08:30:03.267428+0000","last_fullsized":"2024-02-10T08:30:03.267428+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:22.114421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:22.114421+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,3],"acting":[7,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":271,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.271800+0000","last_change":"2024-02-10T08:28:19.149963+0000","last_active":"2024-02-10T08:30:03.271800+0000","last_peered":"2024-02-10T08:30:03.271800+0000","last_clean":"2024-02-10T08:30:03.271800+0000","last_became_active":"2024-02-10T08:28:02.779438+0000","last_became_peered":"2024-02-10T08:28:02.779438+0000","last_unstale":"2024-02-10T08:30:03.271800+0000","last_undegraded":"2024-02-10T08:30:03.271800+0000","last_fullsized":"2024-02-10T08:30:03.271800+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:19.149900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:28:19.149900+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":275,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.271013+0000","last_change":"2024-02-10T08:28:02.781347+0000","last_active":"2024-02-10T08:30:03.271013+0000","last_peered":"2024-02-10T08:30:03.271013+0000","last_clean":"2024-02-10T08:30:03.271013+0000","last_became_active":"2024-02-10T08:28:02.781029+0000","last_became_peered":"2024-02-10T08:28:02.781029+0000","last_unstale":"2024-02-10T08:30:03.271013+0000","last_undegraded":"2024-02-10T08:30:03.271013+0000","last_fullsized":"2024-02-10T08:30:03.271013+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:26:25.120940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:26:25.120940+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"226'35","reported_seq":309,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.274151+0000","last_change":"2024-02-10T08:29:09.404681+0000","last_active":"2024-02-10T08:30:03.274151+0000","last_peered":"2024-02-10T08:30:03.274151+0000","last_clean":"2024-02-10T08:30:03.274151+0000","last_became_active":"2024-02-10T08:16:55.203415+0000","last_became_peered":"2024-02-10T08:16:55.203415+0000","last_unstale":"2024-02-10T08:30:03.274151+0000","last_undegraded":"2024-02-10T08:30:03.274151+0000","last_fullsized":"2024-02-10T08:30:03.274151+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"226'35","last_scrub_stamp":"2024-02-10T08:29:09.404577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:29:09.404577+0000","log_size":35,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":56,"num_read_kb":45,"num_write":36,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.6","version":"283'7623","reported_seq":7658,"reported_epoch":283,"state":"active+clean","last_fresh":"2024-02-10T08:30:07.609772+0000","last_change":"2024-02-10T08:28:28.331984+0000","last_active":"2024-02-10T08:30:07.609772+0000","last_peered":"2024-02-10T08:30:07.609772+0000","last_clean":"2024-02-10T08:30:07.609772+0000","last_became_active":"2024-02-10T08:28:28.331662+0000","last_became_peered":"2024-02-10T08:28:28.331662+0000","last_unstale":"2024-02-10T08:30:07.609772+0000","last_undegraded":"2024-02-10T08:30:07.609772+0000","last_fullsized":"2024-02-10T08:30:07.609772+0000","mapping_epoch":256,"log_start":"268'3200","ondisk_log_start":"268'3200","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_clean_scrub_stamp":"2024-02-10T08:28:27.172648+0000","log_size":4423,"ondisk_log_size":4423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":499580928,"num_objects":7623,"num_object_clones":0,"num_object_copies":22869,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7623,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7623,"num_write_kb":487872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,1],"acting":[5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"76'2","reported_seq":153,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.267735+0000","last_change":"2024-02-10T08:28:20.073164+0000","last_active":"2024-02-10T08:30:03.267735+0000","last_peered":"2024-02-10T08:30:03.267735+0000","last_clean":"2024-02-10T08:30:03.267735+0000","last_became_active":"2024-02-10T08:23:34.718483+0000","last_became_peered":"2024-02-10T08:23:34.718483+0000","last_unstale":"2024-02-10T08:30:03.267735+0000","last_undegraded":"2024-02-10T08:30:03.267735+0000","last_fullsized":"2024-02-10T08:30:03.267735+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'2","last_scrub_stamp":"2024-02-10T08:28:20.073105+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2024-02-10T08:18:08.680038+0000","last_clean_scrub_stamp":"2024-02-10T08:28:20.073105+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":290,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.271257+0000","last_change":"2024-02-10T08:28:25.266206+0000","last_active":"2024-02-10T08:30:03.271257+0000","last_peered":"2024-02-10T08:30:03.271257+0000","last_clean":"2024-02-10T08:30:03.271257+0000","last_became_active":"2024-02-10T08:28:02.781897+0000","last_became_peered":"2024-02-10T08:28:02.781897+0000","last_unstale":"2024-02-10T08:30:03.271257+0000","last_undegraded":"2024-02-10T08:30:03.271257+0000","last_fullsized":"2024-02-10T08:30:03.271257+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:25.266124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:28:25.266124+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0],"acting":[2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":267,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.259498+0000","last_change":"2024-02-10T08:25:42.035602+0000","last_active":"2024-02-10T08:30:03.259498+0000","last_peered":"2024-02-10T08:30:03.259498+0000","last_clean":"2024-02-10T08:30:03.259498+0000","last_became_active":"2024-02-10T08:20:46.407311+0000","last_became_peered":"2024-02-10T08:20:46.407311+0000","last_unstale":"2024-02-10T08:30:03.259498+0000","last_undegraded":"2024-02-10T08:30:03.259498+0000","last_fullsized":"2024-02-10T08:30:03.259498+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:25:42.035497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:21.523096+0000","last_clean_scrub_stamp":"2024-02-10T08:25:42.035497+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"225'15","reported_seq":64,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.263944+0000","last_change":"2024-02-10T08:28:15.049130+0000","last_active":"2024-02-10T08:30:03.263944+0000","last_peered":"2024-02-10T08:30:03.263944+0000","last_clean":"2024-02-10T08:30:03.263944+0000","last_became_active":"2024-02-10T08:28:02.770508+0000","last_became_peered":"2024-02-10T08:28:02.770508+0000","last_unstale":"2024-02-10T08:30:03.263944+0000","last_undegraded":"2024-02-10T08:30:03.263944+0000","last_fullsized":"2024-02-10T08:30:03.263944+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'15","last_scrub_stamp":"2024-02-10T08:28:15.049059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:28:15.049059+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.5","version":"283'7726","reported_seq":7761,"reported_epoch":283,"state":"active+clean","last_fresh":"2024-02-10T08:30:08.138405+0000","last_change":"2024-02-10T08:28:28.190785+0000","last_active":"2024-02-10T08:30:08.138405+0000","last_peered":"2024-02-10T08:30:08.138405+0000","last_clean":"2024-02-10T08:30:08.138405+0000","last_became_active":"2024-02-10T08:28:28.190416+0000","last_became_peered":"2024-02-10T08:28:28.190416+0000","last_unstale":"2024-02-10T08:30:08.138405+0000","last_undegraded":"2024-02-10T08:30:08.138405+0000","last_fullsized":"2024-02-10T08:30:08.138405+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_clean_scrub_stamp":"2024-02-10T08:28:27.172648+0000","log_size":7726,"ondisk_log_size":7726,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":506331136,"num_objects":7726,"num_object_clones":0,"num_object_copies":23178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7726,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7726,"num_write_kb":494464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":268,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.265285+0000","last_change":"2024-02-10T08:28:30.227204+0000","last_active":"2024-02-10T08:30:03.265285+0000","last_peered":"2024-02-10T08:30:03.265285+0000","last_clean":"2024-02-10T08:30:03.265285+0000","last_became_active":"2024-02-10T08:28:02.776088+0000","last_became_peered":"2024-02-10T08:28:02.776088+0000","last_unstale":"2024-02-10T08:30:03.265285+0000","last_undegraded":"2024-02-10T08:30:03.265285+0000","last_fullsized":"2024-02-10T08:30:03.265285+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:30.227120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:20.392249+0000","last_clean_scrub_stamp":"2024-02-10T08:28:30.227120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":271,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.272067+0000","last_change":"2024-02-10T08:29:24.555085+0000","last_active":"2024-02-10T08:30:03.272067+0000","last_peered":"2024-02-10T08:30:03.272067+0000","last_clean":"2024-02-10T08:30:03.272067+0000","last_became_active":"2024-02-10T08:23:15.074046+0000","last_became_peered":"2024-02-10T08:23:15.074046+0000","last_unstale":"2024-02-10T08:30:03.272067+0000","last_undegraded":"2024-02-10T08:30:03.272067+0000","last_fullsized":"2024-02-10T08:30:03.272067+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:24.554978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:29:24.554978+0000","last_clean_scrub_stamp":"2024-02-10T08:29:24.554978+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,6],"acting":[2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"225'27","reported_seq":297,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:03.264879+0000","last_change":"2024-02-10T08:29:07.059712+0000","last_active":"2024-02-10T08:30:03.264879+0000","last_peered":"2024-02-10T08:30:03.264879+0000","last_clean":"2024-02-10T08:30:03.264879+0000","last_became_active":"2024-02-10T08:16:55.204597+0000","last_became_peered":"2024-02-10T08:16:55.204597+0000","last_unstale":"2024-02-10T08:30:03.264879+0000","last_undegraded":"2024-02-10T08:30:03.264879+0000","last_fullsized":"2024-02-10T08:30:03.264879+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'27","last_scrub_stamp":"2024-02-10T08:29:07.059646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:29:07.059646+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"111'10","reported_seq":447,"reported_epoch":282,"state":"active+clean","last_fresh":"2024-02-10T08:30:06.130096+0000","last_change":"2024-02-10T08:28:29.196174+0000","last_active":"2024-02-10T08:30:06.130096+0000","last_peered":"2024-02-10T08:30:06.130096+0000","last_clean":"2024-02-10T08:30:06.130096+0000","last_became_active":"2024-02-10T08:20:46.399193+0000","last_became_peered":"2024-02-10T08:20:46.399193+0000","last_unstale":"2024-02-10T08:30:06.130096+0000","last_undegraded":"2024-02-10T08:30:06.130096+0000","last_fullsized":"2024-02-10T08:30:06.130096+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'10","last_scrub_stamp":"2024-02-10T08:28:29.196109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:28:29.196109+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":7945781248,"num_objects":121243,"num_object_clones":0,"num_object_copies":363729,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":14860,"num_objects_unfound":0,"num_objects_dirty":121243,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121489,"num_write_kb":7767424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":246,"num_bytes_recovered":16121856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":23870439424,"data_stored":23870439424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":78989,"ondisk_log_size":78989,"up":48,"acting":48,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2646,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":4},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":785,"num_read_kb":780,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":9,"acting":9,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":1107,"num_read_kb":864,"num_write":703,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":127,"num_bytes_recovered":3108,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":725,"ondisk_log_size":725,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":89,"ondisk_log_size":89,"up":96,"acting":96,"num_store_stats":8},{"poolid":6,"num_pg":42,"stat_sum":{"num_bytes":376,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":26,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":126,"acting":126,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":50,"seq":214748364963,"num_pgs":78,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5620192,"kb_used_data":5322968,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":88124960,"statfs":{"total":95995035648,"available":90239959040,"internally_reserved":0,"allocated":5450719232,"data_stored":5450352284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,5,1,0,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:29:06 2024","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.524,"15min":1.1699999999999999},"min":{"1min":0.23499999999999999,"5min":0.20899999999999999,"15min":0.20300000000000001},"max":{"1min":6.8200000000000003,"5min":14.734,"15min":21.175999999999998},"last":4.8140000000000001},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.712,"15min":1.5620000000000001},"min":{"1min":0.253,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":3.6080000000000001,"5min":13.204000000000001,"15min":22.57},"last":3.831}]},{"osd":1,"last update":"Sat Feb 10 08:29:06 2024","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.429,"15min":1.169},"min":{"1min":0.26200000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":4.6470000000000002,"5min":11.779,"15min":15.476000000000001},"last":5.617},{"interface":"front","average":{"1min":1.038,"5min":1.502,"15min":1.2529999999999999},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":3.1339999999999999,"5min":12.237,"15min":12.237},"last":0.79300000000000004}]},{"osd":2,"last update":"Sat Feb 10 08:29:06 2024","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.2609999999999999,"15min":1.159},"min":{"1min":0.29199999999999998,"5min":0.255,"15min":0.251},"max":{"1min":6.2320000000000002,"5min":8.3940000000000001,"15min":8.3940000000000001},"last":2.6179999999999999},{"interface":"front","average":{"1min":0.999,"5min":1.252,"15min":1.2050000000000001},"min":{"1min":0.317,"5min":0.29599999999999999,"15min":0.25900000000000001},"max":{"1min":3.3900000000000001,"5min":6.383,"15min":12.797000000000001},"last":4.0839999999999996}]},{"osd":3,"last update":"Sat Feb 10 08:29:06 2024","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.3859999999999999,"15min":1.2230000000000001},"min":{"1min":0.32500000000000001,"5min":0.318,"15min":0.27700000000000002},"max":{"1min":13.07,"5min":13.07,"15min":18.515000000000001},"last":4.7169999999999996},{"interface":"front","average":{"1min":1.01,"5min":1.3049999999999999,"15min":1.284},"min":{"1min":0.29899999999999999,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":3.5390000000000001,"5min":8.5800000000000001,"15min":9.9969999999999999},"last":0.54100000000000004}]},{"osd":4,"last update":"Sat Feb 10 08:30:05 2024","interfaces":[{"interface":"back","average":{"1min":1.5720000000000001,"5min":1.282,"15min":0.80900000000000005},"min":{"1min":0.25700000000000001,"5min":0.22700000000000001,"15min":0.216},"max":{"1min":7.0979999999999999,"5min":9.7590000000000003,"15min":9.7590000000000003},"last":0.309},{"interface":"front","average":{"1min":1.99,"5min":1.496,"15min":0.83399999999999996},"min":{"1min":0.24099999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":6.484,"5min":12.987,"15min":12.987},"last":0.49299999999999999}]},{"osd":5,"last update":"Sat Feb 10 08:29:06 2024","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.528,"15min":0.84199999999999997},"min":{"1min":0.28999999999999998,"5min":0.24199999999999999,"15min":0.218},"max":{"1min":4.6879999999999997,"5min":11.314,"15min":11.314},"last":1.97},{"interface":"front","average":{"1min":1.012,"5min":1.296,"15min":0.81499999999999995},"min":{"1min":0.29699999999999999,"5min":0.26500000000000001,"15min":0.22600000000000001},"max":{"1min":4.1070000000000002,"5min":10.023999999999999,"15min":10.023999999999999},"last":0.39200000000000002}]},{"osd":6,"last update":"Sat Feb 10 08:29:06 2024","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":1.26,"15min":0.76500000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.26100000000000001},"max":{"1min":2.9710000000000001,"5min":7.5030000000000001,"15min":7.5030000000000001},"last":1.127},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.119,"15min":0.76100000000000001},"min":{"1min":0.33300000000000002,"5min":0.28199999999999997,"15min":0.224},"max":{"1min":2.9750000000000001,"5min":9.4290000000000003,"15min":9.4290000000000003},"last":0.48299999999999998}]}]},{"osd":6,"up_from":43,"seq":184683593896,"num_pgs":65,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1753304,"kb_used_data":1456080,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":91991848,"statfs":{"total":95995035648,"available":94199652352,"internally_reserved":0,"allocated":1491025920,"data_stored":1490660341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:29:42 2024","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.742,"15min":1.671},"min":{"1min":0.222,"5min":0.21299999999999999,"15min":0.19400000000000001},"max":{"1min":3.3740000000000001,"5min":27.611000000000001,"15min":30.509},"last":1.0189999999999999},{"interface":"front","average":{"1min":1.5249999999999999,"5min":1.5109999999999999,"15min":1.488},"min":{"1min":0.245,"5min":0.214,"15min":0.21099999999999999},"max":{"1min":7.1619999999999999,"5min":8.9559999999999995,"15min":36.090000000000003},"last":0.56100000000000005}]},{"osd":1,"last update":"Sat Feb 10 08:29:42 2024","interfaces":[{"interface":"back","average":{"1min":1.4470000000000001,"5min":1.597,"15min":1.262},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.20899999999999999},"max":{"1min":5.3120000000000003,"5min":8.9369999999999994,"15min":12.938000000000001},"last":1.071},{"interface":"front","average":{"1min":2.0539999999999998,"5min":1.73,"15min":1.349},"min":{"1min":0.26200000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":9.8829999999999991,"5min":10.441000000000001,"15min":10.441000000000001},"last":8.8879999999999999}]},{"osd":2,"last update":"Sat Feb 10 08:29:42 2024","interfaces":[{"interface":"back","average":{"1min":1.758,"5min":1.962,"15min":1.6020000000000001},"min":{"1min":0.29099999999999998,"5min":0.28499999999999998,"15min":0.24399999999999999},"max":{"1min":6.7380000000000004,"5min":25.146999999999998,"15min":35.072000000000003},"last":8.923},{"interface":"front","average":{"1min":1.647,"5min":1.8620000000000001,"15min":1.544},"min":{"1min":0.309,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":6.2809999999999997,"5min":25.135999999999999,"15min":35.103000000000002},"last":0.58699999999999997}]},{"osd":3,"last update":"Sat Feb 10 08:29:42 2024","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.827,"15min":1.3680000000000001},"min":{"1min":0.32400000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":3.3879999999999999,"5min":10.211,"15min":15.212999999999999},"last":1.111},{"interface":"front","average":{"1min":2.2160000000000002,"5min":1.7569999999999999,"15min":1.4419999999999999},"min":{"1min":0.311,"5min":0.253,"15min":0.253},"max":{"1min":6.21,"5min":10.586,"15min":17.797000000000001},"last":8.9410000000000007}]},{"osd":4,"last update":"Sat Feb 10 08:30:04 2024","interfaces":[{"interface":"back","average":{"1min":1.911,"5min":1.294,"15min":0.80700000000000005},"min":{"1min":0.28599999999999998,"5min":0.224,"15min":0.224},"max":{"1min":7.2009999999999996,"5min":9.3879999999999999,"15min":9.3879999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":1.6419999999999999,"5min":1.4419999999999999,"15min":0.872},"min":{"1min":0.33300000000000002,"5min":0.27000000000000002,"15min":0.22600000000000001},"max":{"1min":4.758,"5min":10.348000000000001,"15min":10.348000000000001},"last":1.089}]},{"osd":5,"last update":"Sat Feb 10 08:29:42 2024","interfaces":[{"interface":"back","average":{"1min":2.0539999999999998,"5min":1.556,"15min":0.85999999999999999},"min":{"1min":0.309,"5min":0.27000000000000002,"15min":0.20200000000000001},"max":{"1min":10.507,"5min":10.507,"15min":10.507},"last":3.0819999999999999},{"interface":"front","average":{"1min":1.48,"5min":1.5089999999999999,"15min":0.85899999999999999},"min":{"1min":0.27900000000000003,"5min":0.23699999999999999,"15min":0.22900000000000001},"max":{"1min":4.8840000000000003,"5min":6.7999999999999998,"15min":6.7999999999999998},"last":1.1279999999999999}]},{"osd":7,"last update":"Sat Feb 10 08:30:04 2024","interfaces":[{"interface":"back","average":{"1min":2.226,"5min":1.571,"15min":1.536},"min":{"1min":0.34599999999999997,"5min":0.26200000000000001,"15min":0.23999999999999999},"max":{"1min":8.923,"5min":8.923,"15min":194.88900000000001},"last":4.2210000000000001},{"interface":"front","average":{"1min":2.3809999999999998,"5min":1.7809999999999999,"15min":1.643},"min":{"1min":0.36199999999999999,"5min":0.33900000000000002,"15min":0.26400000000000001},"max":{"1min":8.8930000000000007,"5min":8.8930000000000007,"15min":194.74100000000001},"last":1.052}]}]},{"osd":1,"up_from":13,"seq":55834575039,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":4662572,"kb_used_data":4357156,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":89082580,"statfs":{"total":95995035648,"available":91220561920,"internally_reserved":0,"allocated":4461727744,"data_stored":4461348442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,1,2,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:29:40 2024","interfaces":[{"interface":"back","average":{"1min":2.254,"5min":1.3069999999999999,"15min":1.7030000000000001},"min":{"1min":0.186,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":19.263000000000002,"5min":19.263000000000002,"15min":29.763999999999999},"last":0.45700000000000002},{"interface":"front","average":{"1min":2.2170000000000001,"5min":1.6279999999999999,"15min":1.8799999999999999},"min":{"1min":0.23400000000000001,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":9.5289999999999999,"5min":9.5289999999999999,"15min":29.637},"last":0.27000000000000002}]},{"osd":2,"last update":"Sat Feb 10 08:29:07 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":1.333,"15min":1.7729999999999999},"min":{"1min":0.25700000000000001,"5min":0.224,"15min":0.21199999999999999},"max":{"1min":2.7679999999999998,"5min":7.5190000000000001,"15min":31.420999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.681,"15min":1.9610000000000001},"min":{"1min":0.25800000000000001,"5min":0.184,"15min":0.184},"max":{"1min":5.5279999999999996,"5min":8.9749999999999996,"15min":31.484999999999999},"last":1.448}]},{"osd":3,"last update":"Sat Feb 10 08:29:34 2024","interfaces":[{"interface":"back","average":{"1min":1.653,"5min":1.841,"15min":1.972},"min":{"1min":0.30299999999999999,"5min":0.253,"15min":0.247},"max":{"1min":5.0599999999999996,"5min":15.952999999999999,"15min":28.082000000000001},"last":0.372},{"interface":"front","average":{"1min":1.694,"5min":1.3069999999999999,"15min":1.629},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":8.7119999999999997,"5min":9.0879999999999992,"15min":29.722000000000001},"last":0.54300000000000004}]},{"osd":4,"last update":"Sat Feb 10 08:30:04 2024","interfaces":[{"interface":"back","average":{"1min":1.5389999999999999,"5min":1.5980000000000001,"15min":2.0449999999999999},"min":{"1min":0.308,"5min":0.27300000000000002,"15min":0.26100000000000001},"max":{"1min":9.0190000000000001,"5min":9.0190000000000001,"15min":14.086},"last":0.31900000000000001},{"interface":"front","average":{"1min":2.0249999999999999,"5min":1.9830000000000001,"15min":2.444},"min":{"1min":0.35499999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":9.0969999999999995,"5min":9.702,"15min":31.515000000000001},"last":3.8279999999999998}]},{"osd":5,"last update":"Sat Feb 10 08:29:13 2024","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.871,"15min":1.5669999999999999},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.26000000000000001},"max":{"1min":4.7320000000000002,"5min":40.140999999999998,"15min":40.140999999999998},"last":0.501},{"interface":"front","average":{"1min":1.4570000000000001,"5min":2.3479999999999999,"15min":1.8100000000000001},"min":{"1min":0.42399999999999999,"5min":0.30399999999999999,"15min":0.28499999999999998},"max":{"1min":3.77,"5min":40.831000000000003,"15min":40.831000000000003},"last":1.544}]},{"osd":6,"last update":"Sat Feb 10 08:29:40 2024","interfaces":[{"interface":"back","average":{"1min":2.069,"5min":1.9199999999999999,"15min":1.6519999999999999},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":9.1259999999999994,"5min":9.8550000000000004,"15min":31.27},"last":1.4890000000000001},{"interface":"front","average":{"1min":1.778,"5min":1.5249999999999999,"15min":1.335},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.27700000000000002},"max":{"1min":3.7599999999999998,"5min":9.8450000000000006,"15min":10.433},"last":2.665}]},{"osd":7,"last update":"Sat Feb 10 08:29:07 2024","interfaces":[{"interface":"back","average":{"1min":1.645,"5min":1.681,"15min":1.599},"min":{"1min":0.39100000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":9.7840000000000007,"5min":9.7840000000000007,"15min":31.344999999999999},"last":0.621},{"interface":"front","average":{"1min":1.054,"5min":1.2130000000000001,"15min":1.25},"min":{"1min":0.34200000000000003,"5min":0.32600000000000001,"15min":0.312},"max":{"1min":3.3490000000000002,"5min":5.3520000000000003,"15min":14.872},"last":4.1689999999999996}]}]},{"osd":0,"up_from":8,"seq":34359738564,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1763332,"kb_used_data":1453820,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":91981820,"statfs":{"total":95995035648,"available":94189383680,"internally_reserved":0,"allocated":1488711680,"data_stored":1488372579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 10 08:29:50 2024","interfaces":[{"interface":"back","average":{"1min":1.9259999999999999,"5min":2.0840000000000001,"15min":2.27},"min":{"1min":0.30099999999999999,"5min":0.20399999999999999,"15min":0.14399999999999999},"max":{"1min":6.4119999999999999,"5min":22.460000000000001,"15min":102.48099999999999},"last":6.2149999999999999},{"interface":"front","average":{"1min":1.208,"5min":1.768,"15min":2.0510000000000002},"min":{"1min":0.25900000000000001,"5min":0.19800000000000001,"15min":0.193},"max":{"1min":4.8630000000000004,"5min":23.27,"15min":103.38800000000001},"last":9.359}]},{"osd":2,"last update":"Sat Feb 10 08:29:06 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.738,"15min":2.2469999999999999},"min":{"1min":0.22700000000000001,"5min":0.192,"15min":0.192},"max":{"1min":5.6269999999999998,"5min":11.782,"15min":102.462},"last":5.5810000000000004},{"interface":"front","average":{"1min":1.365,"5min":1.76,"15min":2.1549999999999998},"min":{"1min":0.27600000000000002,"5min":0.222,"15min":0.20799999999999999},"max":{"1min":4.5780000000000003,"5min":19.809999999999999,"15min":102.66500000000001},"last":6.1870000000000003}]},{"osd":3,"last update":"Sat Feb 10 08:29:35 2024","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.464,"15min":1.8089999999999999},"min":{"1min":0.26800000000000002,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":4.6459999999999999,"5min":7.1550000000000002,"15min":16.495000000000001},"last":8.4849999999999994},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.7949999999999999,"15min":2.2629999999999999},"min":{"1min":0.31,"5min":0.222,"15min":0.222},"max":{"1min":3.3679999999999999,"5min":8.5419999999999998,"15min":102.64400000000001},"last":8.6430000000000007}]},{"osd":4,"last update":"Sat Feb 10 08:29:56 2024","interfaces":[{"interface":"back","average":{"1min":1.6990000000000001,"5min":1.716,"15min":3.1560000000000001},"min":{"1min":0.29699999999999999,"5min":0.26800000000000002,"15min":0.253},"max":{"1min":10.596,"5min":10.596,"15min":102.742},"last":3.0190000000000001},{"interface":"front","average":{"1min":1.5680000000000001,"5min":1.5009999999999999,"15min":1.8260000000000001},"min":{"1min":0.38100000000000001,"5min":0.31,"15min":0.26200000000000001},"max":{"1min":4.8289999999999997,"5min":7.3890000000000002,"15min":16.352},"last":5.6689999999999996}]},{"osd":5,"last update":"Sat Feb 10 08:29:25 2024","interfaces":[{"interface":"back","average":{"1min":1.5840000000000001,"5min":1.6499999999999999,"15min":1.804},"min":{"1min":0.377,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":4.6239999999999997,"5min":8.4320000000000004,"15min":102.53100000000001},"last":0.376},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.5800000000000001,"15min":1.409},"min":{"1min":0.39300000000000002,"5min":0.33900000000000002,"15min":0.22500000000000001},"max":{"1min":4.5910000000000002,"5min":9.7360000000000007,"15min":16.463999999999999},"last":5.7130000000000001}]},{"osd":6,"last update":"Sat Feb 10 08:29:50 2024","interfaces":[{"interface":"back","average":{"1min":2.0979999999999999,"5min":1.7609999999999999,"15min":1.905},"min":{"1min":0.42999999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":5.5090000000000003,"5min":8.4499999999999993,"15min":102.583},"last":6.1559999999999997},{"interface":"front","average":{"1min":1.881,"5min":1.629,"15min":1.4059999999999999},"min":{"1min":0.48899999999999999,"5min":0.372,"15min":0.308},"max":{"1min":4.7800000000000002,"5min":6.0549999999999997,"15min":16.391999999999999},"last":5.6379999999999999}]},{"osd":7,"last update":"Sat Feb 10 08:29:06 2024","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":3.9449999999999998,"15min":2.6419999999999999},"min":{"1min":0.47799999999999998,"5min":0.35299999999999998,"15min":0.34100000000000003},"max":{"1min":4.6859999999999999,"5min":255.53200000000001,"15min":255.53200000000001},"last":6.1159999999999997},{"interface":"front","average":{"1min":1.2589999999999999,"5min":3.8759999999999999,"15min":2.1560000000000001},"min":{"1min":0.499,"5min":0.39600000000000002,"15min":0.28599999999999998},"max":{"1min":4.6280000000000001,"5min":254.88800000000001,"15min":254.88800000000001},"last":5.5999999999999996}]}]},{"osd":2,"up_from":18,"seq":77309411515,"num_pgs":61,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":3226900,"kb_used_data":2917388,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":90518252,"statfs":{"total":95995035648,"available":92690690048,"internally_reserved":0,"allocated":2987405312,"data_stored":2987050088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2,3],"upper_bound":8},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:29:18 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.98999999999999999,"15min":1.5840000000000001},"min":{"1min":0.22700000000000001,"5min":0.184,"15min":0.17399999999999999},"max":{"1min":2.9089999999999998,"5min":6.7530000000000001,"15min":24.859999999999999},"last":1.3100000000000001},{"interface":"front","average":{"1min":0.85399999999999998,"5min":1.3049999999999999,"15min":1.9419999999999999},"min":{"1min":0.20999999999999999,"5min":0.20399999999999999,"15min":0.193},"max":{"1min":3.548,"5min":9.2219999999999995,"15min":28.295999999999999},"last":1.49}]},{"osd":1,"last update":"Sat Feb 10 08:29:18 2024","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.895,"15min":1.5629999999999999},"min":{"1min":0.29399999999999998,"5min":0.20999999999999999,"15min":0.19700000000000001},"max":{"1min":8.4960000000000004,"5min":13.622,"15min":15.644},"last":1.1970000000000001},{"interface":"front","average":{"1min":0.82899999999999996,"5min":1.097,"15min":1.232},"min":{"1min":0.25800000000000001,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":3.5590000000000002,"5min":6.2809999999999997,"15min":16.968},"last":0.73199999999999998}]},{"osd":3,"last update":"Sat Feb 10 08:29:35 2024","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.7290000000000001,"15min":1.7070000000000001},"min":{"1min":0.307,"5min":0.24199999999999999,"15min":0.23300000000000001},"max":{"1min":3.3599999999999999,"5min":10.734,"15min":24.946000000000002},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.90500000000000003,"5min":1.48,"15min":1.831},"min":{"1min":0.255,"5min":0.23300000000000001,"15min":0.22900000000000001},"max":{"1min":2.7269999999999999,"5min":14.282,"15min":24.905000000000001},"last":0.5}]},{"osd":4,"last update":"Sat Feb 10 08:29:59 2024","interfaces":[{"interface":"back","average":{"1min":1.548,"5min":1.639,"15min":2.0750000000000002},"min":{"1min":0.30099999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":3.4169999999999998,"5min":7.3470000000000004,"15min":13.260999999999999},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.139,"15min":1.3200000000000001},"min":{"1min":0.32500000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":2.9540000000000002,"5min":7.3150000000000004,"15min":15.696},"last":0.57399999999999995}]},{"osd":5,"last update":"Sat Feb 10 08:29:21 2024","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.726,"15min":1.4830000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.26600000000000001},"max":{"1min":3.976,"5min":9.2590000000000003,"15min":13.939},"last":1.4219999999999999},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.611,"15min":1.367},"min":{"1min":0.35399999999999998,"5min":0.33600000000000002,"15min":0.28599999999999998},"max":{"1min":5.8479999999999999,"5min":8.6890000000000001,"15min":13.317},"last":1.05}]},{"osd":6,"last update":"Sat Feb 10 08:29:55 2024","interfaces":[{"interface":"back","average":{"1min":1.478,"5min":2.004,"15min":1.5600000000000001},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":4.6029999999999998,"5min":38.177999999999997,"15min":38.177999999999997},"last":1.4590000000000001},{"interface":"front","average":{"1min":1.871,"5min":2.294,"15min":1.633},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.29099999999999998},"max":{"1min":5.1040000000000001,"5min":37.682000000000002,"15min":37.682000000000002},"last":1.1140000000000001}]},{"osd":7,"last update":"Sat Feb 10 08:29:18 2024","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.6679999999999999,"15min":1.415},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.33900000000000002},"max":{"1min":3.5150000000000001,"5min":6.7000000000000002,"15min":13.231999999999999},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.05,"5min":1.2070000000000001,"15min":1.1299999999999999},"min":{"1min":0.35099999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":2.7799999999999998,"5min":6.7800000000000002,"15min":15.714},"last":0.54600000000000004}]}]},{"osd":3,"up_from":25,"seq":107374182582,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2222380,"kb_used_data":1921060,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":91522772,"statfs":{"total":95995035648,"available":93719318528,"internally_reserved":0,"allocated":1967165440,"data_stored":1966849469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:29:34 2024","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.24,"15min":1.5129999999999999},"min":{"1min":0.20599999999999999,"5min":0.182,"15min":0.182},"max":{"1min":5.9000000000000004,"5min":7.5570000000000004,"15min":14.167},"last":2.7850000000000001},{"interface":"front","average":{"1min":1.929,"5min":1.556,"15min":1.5009999999999999},"min":{"1min":0.20200000000000001,"5min":0.185,"15min":0.185},"max":{"1min":16.155000000000001,"5min":16.155000000000001,"15min":26.643000000000001},"last":4.931}]},{"osd":1,"last update":"Sat Feb 10 08:29:34 2024","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.657,"15min":1.5149999999999999},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":6.2670000000000003,"5min":9.4179999999999993,"15min":12.782999999999999},"last":10.380000000000001},{"interface":"front","average":{"1min":1.03,"5min":2.073,"15min":1.7230000000000001},"min":{"1min":0.22900000000000001,"5min":0.214,"15min":0.191},"max":{"1min":5.5960000000000001,"5min":17.513000000000002,"15min":21.373999999999999},"last":2.4670000000000001}]},{"osd":2,"last update":"Sat Feb 10 08:29:34 2024","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":2.0169999999999999,"15min":1.675},"min":{"1min":0.255,"5min":0.24199999999999999,"15min":0.23699999999999999},"max":{"1min":3.5339999999999998,"5min":15.102,"15min":21.434000000000001},"last":2.4329999999999998},{"interface":"front","average":{"1min":1.109,"5min":1.5960000000000001,"15min":1.5089999999999999},"min":{"1min":0.26600000000000001,"5min":0.215,"15min":0.215},"max":{"1min":2.835,"5min":13.946999999999999,"15min":18.061},"last":4.9669999999999996}]},{"osd":4,"last update":"Sat Feb 10 08:29:06 2024","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.571,"15min":1.7010000000000001},"min":{"1min":0.38800000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":2.9889999999999999,"5min":10.970000000000001,"15min":12.272},"last":5.0119999999999996},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.708,"15min":2.2349999999999999},"min":{"1min":0.373,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":3.7320000000000002,"5min":9.0489999999999995,"15min":12.391999999999999},"last":2.8140000000000001}]},{"osd":5,"last update":"Sat Feb 10 08:29:29 2024","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.7809999999999999,"15min":1.208},"min":{"1min":0.41399999999999998,"5min":0.31,"15min":0.249},"max":{"1min":4.444,"5min":10.933999999999999,"15min":12.388999999999999},"last":4.992},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.718,"15min":1.4450000000000001},"min":{"1min":0.34000000000000002,"5min":0.33800000000000002,"15min":0.29699999999999999},"max":{"1min":5.9340000000000002,"5min":9.9900000000000002,"15min":12.438000000000001},"last":5.8579999999999997}]},{"osd":6,"last update":"Sat Feb 10 08:29:47 2024","interfaces":[{"interface":"back","average":{"1min":1.774,"5min":1.8049999999999999,"15min":1.4670000000000001},"min":{"1min":0.371,"5min":0.35799999999999998,"15min":0.33600000000000002},"max":{"1min":6.133,"5min":9.3740000000000006,"15min":12.477},"last":2.8380000000000001},{"interface":"front","average":{"1min":1.7849999999999999,"5min":1.774,"15min":1.23},"min":{"1min":0.36399999999999999,"5min":0.31,"15min":0.28499999999999998},"max":{"1min":6.0789999999999997,"5min":8.8640000000000008,"15min":12.324999999999999},"last":5.4450000000000003}]},{"osd":7,"last update":"Sat Feb 10 08:29:07 2024","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":1.7090000000000001,"15min":1.2030000000000001},"min":{"1min":0.41999999999999998,"5min":0.33400000000000002,"15min":0.28299999999999997},"max":{"1min":2.8599999999999999,"5min":8.9109999999999996,"15min":12.358000000000001},"last":6.1660000000000004},{"interface":"front","average":{"1min":0.89600000000000002,"5min":1.9079999999999999,"15min":1.49},"min":{"1min":0.374,"5min":0.33000000000000002,"15min":0.26500000000000001},"max":{"1min":2.335,"5min":14.587,"15min":15.702},"last":2.3980000000000001}]}]},{"osd":4,"up_from":110,"seq":472446402674,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1752524,"kb_used_data":1454660,"kb_used_omap":0,"kb_used_meta":297855,"kb_avail":91992628,"statfs":{"total":95995035648,"available":94200451072,"internally_reserved":0,"allocated":1489571840,"data_stored":1489223897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":972,"internal_metadata":305003572},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:29:10 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":1.278,"15min":1.2829999999999999},"min":{"1min":0.25,"5min":0.24099999999999999,"15min":0.19800000000000001},"max":{"1min":3.7509999999999999,"5min":6.258,"15min":11.257999999999999},"last":1.6120000000000001},{"interface":"front","average":{"1min":1.056,"5min":1.575,"15min":2.6949999999999998},"min":{"1min":0.28699999999999998,"5min":0.222,"15min":0.222},"max":{"1min":2.9239999999999999,"5min":12.84,"15min":16.524000000000001},"last":5.1580000000000004}]},{"osd":1,"last update":"Sat Feb 10 08:29:10 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":1.5609999999999999,"15min":1.9730000000000001},"min":{"1min":0.23899999999999999,"5min":0.218,"15min":0.218},"max":{"1min":2.028,"5min":12.472,"15min":12.472},"last":0.255},{"interface":"front","average":{"1min":0.77700000000000002,"5min":1.5009999999999999,"15min":1.8500000000000001},"min":{"1min":0.27400000000000002,"5min":0.217,"15min":0.217},"max":{"1min":2.5539999999999998,"5min":12.462,"15min":12.462},"last":1.6399999999999999}]},{"osd":2,"last update":"Sat Feb 10 08:29:10 2024","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.7070000000000001,"15min":1.9690000000000001},"min":{"1min":0.27400000000000002,"5min":0.218,"15min":0.218},"max":{"1min":3.5990000000000002,"5min":9.7539999999999996,"15min":9.7539999999999996},"last":6.0149999999999997},{"interface":"front","average":{"1min":0.56000000000000005,"5min":1.341,"15min":1.9059999999999999},"min":{"1min":0.27400000000000002,"5min":0.247,"15min":0.247},"max":{"1min":2,"5min":7.0490000000000004,"15min":8.9309999999999992},"last":0.70199999999999996}]},{"osd":3,"last update":"Sat Feb 10 08:29:10 2024","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":1.5229999999999999,"15min":2.0409999999999999},"min":{"1min":0.33100000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":2.9620000000000002,"5min":10.971,"15min":12.565},"last":1.72},{"interface":"front","average":{"1min":0.74399999999999999,"5min":1.244,"15min":1.6459999999999999},"min":{"1min":0.30399999999999999,"5min":0.27300000000000002,"15min":0.27200000000000002},"max":{"1min":1.9650000000000001,"5min":5.7160000000000002,"15min":11.648},"last":0.56599999999999995}]},{"osd":5,"last update":"Sat Feb 10 08:29:10 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":1.401,"15min":0.84399999999999997},"min":{"1min":0.29399999999999998,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":2.4670000000000001,"5min":41.488,"15min":41.488},"last":1.585},{"interface":"front","average":{"1min":0.98299999999999998,"5min":1.778,"15min":1.113},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":5.2140000000000004,"5min":42.527999999999999,"15min":42.527999999999999},"last":3.0779999999999998}]},{"osd":6,"last update":"Sat Feb 10 08:29:10 2024","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.6879999999999999,"15min":1.004},"min":{"1min":0.30599999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":3.734,"5min":39.554000000000002,"15min":39.554000000000002},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.624,"5min":1.427,"15min":1.038},"min":{"1min":0.33300000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":2.081,"5min":41.741999999999997,"15min":41.741999999999997},"last":0.45100000000000001}]},{"osd":7,"last update":"Sat Feb 10 08:29:10 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":1.23,"15min":0.97799999999999998},"min":{"1min":0.315,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":2.2069999999999999,"5min":11.047000000000001,"15min":11.047000000000001},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.83499999999999996,"5min":1.1359999999999999,"15min":0.73899999999999999},"min":{"1min":0.39300000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":2.5270000000000001,"5min":5.7859999999999996,"15min":5.7859999999999996},"last":1.5529999999999999}]}]},{"osd":5,"up_from":37,"seq":158913790125,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":4690112,"kb_used_data":4380600,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":89055040,"statfs":{"total":95995035648,"available":91192360960,"internally_reserved":0,"allocated":4485734400,"data_stored":4485391992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,1,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:29:15 2024","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":1.413,"15min":1.3999999999999999},"min":{"1min":0.26600000000000001,"5min":0.21299999999999999,"15min":0.20499999999999999},"max":{"1min":3.089,"5min":8.1110000000000007,"15min":22.914000000000001},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.746,"5min":1.387,"15min":1.244},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":2.4980000000000002,"5min":5.7169999999999996,"15min":23.161000000000001},"last":0.42199999999999999}]},{"osd":1,"last update":"Sat Feb 10 08:29:15 2024","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.5169999999999999,"15min":1.1000000000000001},"min":{"1min":0.307,"5min":0.20699999999999999,"15min":0.19500000000000001},"max":{"1min":5.5069999999999997,"5min":7.5730000000000004,"15min":8.1289999999999996},"last":5.5270000000000001},{"interface":"front","average":{"1min":0.94299999999999995,"5min":1.351,"15min":1.1040000000000001},"min":{"1min":0.32800000000000001,"5min":0.254,"15min":0.254},"max":{"1min":3.093,"5min":9.0579999999999998,"15min":9.0579999999999998},"last":0.501}]},{"osd":2,"last update":"Sat Feb 10 08:29:15 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":1.2310000000000001,"15min":1.3120000000000001},"min":{"1min":0.31,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":3.637,"5min":5.6740000000000004,"15min":9.5709999999999997},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.80700000000000005,"5min":1.5049999999999999,"15min":1.2170000000000001},"min":{"1min":0.33400000000000002,"5min":0.28799999999999998,"15min":0.26400000000000001},"max":{"1min":3.726,"5min":7.585,"15min":9.2810000000000006},"last":0.55700000000000005}]},{"osd":3,"last update":"Sat Feb 10 08:29:15 2024","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":1.0620000000000001,"15min":1.137},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":3.6629999999999998,"5min":5.8789999999999996,"15min":24.198},"last":2.2080000000000002},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.464,"15min":1.351},"min":{"1min":0.35399999999999998,"5min":0.29799999999999999,"15min":0.25900000000000001},"max":{"1min":3.762,"5min":6.242,"15min":22.701000000000001},"last":0.53900000000000003}]},{"osd":4,"last update":"Sat Feb 10 08:30:03 2024","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.413,"15min":0.85399999999999998},"min":{"1min":0.26600000000000001,"5min":0.248,"15min":0.23599999999999999},"max":{"1min":5.7729999999999997,"5min":6.1120000000000001,"15min":6.1120000000000001},"last":0.31900000000000001},{"interface":"front","average":{"1min":1.827,"5min":1.4590000000000001,"15min":0.82199999999999995},"min":{"1min":0.28899999999999998,"5min":0.26000000000000001,"15min":0.22500000000000001},"max":{"1min":8.0009999999999994,"5min":8.0009999999999994,"15min":8.0009999999999994},"last":0.51800000000000002}]},{"osd":6,"last update":"Sat Feb 10 08:29:43 2024","interfaces":[{"interface":"back","average":{"1min":1.4690000000000001,"5min":1.49,"15min":0.82699999999999996},"min":{"1min":0.316,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":6.3959999999999999,"5min":8.3559999999999999,"15min":8.3559999999999999},"last":0.44700000000000001},{"interface":"front","average":{"1min":1.79,"5min":1.337,"15min":0.81899999999999995},"min":{"1min":0.29999999999999999,"5min":0.26300000000000001,"15min":0.23999999999999999},"max":{"1min":5.7149999999999999,"5min":6.3840000000000003,"15min":6.3840000000000003},"last":0.39600000000000002}]},{"osd":7,"last update":"Sat Feb 10 08:29:08 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":4.7119999999999997,"15min":1.909},"min":{"1min":0.312,"5min":0.26700000000000002,"15min":0.23799999999999999},"max":{"1min":6.4100000000000001,"5min":371.87400000000002,"15min":371.87400000000002},"last":0.36399999999999999},{"interface":"front","average":{"1min":1.026,"5min":4.9000000000000004,"15min":2.0259999999999998},"min":{"1min":0.32000000000000001,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":3.8090000000000002,"5min":372.63099999999997,"15min":372.63099999999997},"last":0.65900000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":2118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1498415104,"data_stored":1498415104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4463001600,"data_stored":4463001600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3000434688,"data_stored":3000434688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1967128576,"data_stored":1967128576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1476526080,"data_stored":1476526080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4504289280,"data_stored":4504289280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1494614016,"data_stored":1494614016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":5466030080,"data_stored":5466030080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-10T08:30:14.373 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2024-02-10T08:30:14.373 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd pool set default.rgw.meta pg_num 52 2024-02-10T08:30:14.390 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:14.422 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:30:14.429 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:14.430 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:30:14.530 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:30:14.603 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:14.654 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:30:14.660 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:14.661 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:30:14.761 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:30:14.806 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:14.946 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:30:14.949 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:14.949 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:30:15.050 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:30:15.098 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:15.323 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:30:15.355 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:30:15.360 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:15.360 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:30:15.397 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:30:15.461 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:30:15.514 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:15.645 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:30:15.649 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:15.650 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:30:15.751 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:30:15.811 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:16.215 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:30:14.876361+0000 mgr.y (mgr.14505) 509 : cluster [DBG] pgmap v612: 158 pgs: 1 active+remapped+backfilling, 157 active+clean; 7.1 GiB data, 24 GiB used, 691 GiB / 715 GiB avail; 1.4 KiB/s rd, 42 MiB/s wr, 1.27k op/s; 14256/351315 objects misplaced (4.058%); 927 KiB/s, 14 objects/s recovering 2024-02-10T08:30:16.215 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:30:14.876361+0000 mgr.y (mgr.14505) 509 : cluster [DBG] pgmap v612: 158 pgs: 1 active+remapped+backfilling, 157 active+clean; 7.1 GiB data, 24 GiB used, 691 GiB / 715 GiB avail; 1.4 KiB/s rd, 42 MiB/s wr, 1.27k op/s; 14256/351315 objects misplaced (4.058%); 927 KiB/s, 14 objects/s recovering 2024-02-10T08:30:16.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:30:14.876361+0000 mgr.y (mgr.14505) 509 : cluster [DBG] pgmap v612: 158 pgs: 1 active+remapped+backfilling, 157 active+clean; 7.1 GiB data, 24 GiB used, 691 GiB / 715 GiB avail; 1.4 KiB/s rd, 42 MiB/s wr, 1.27k op/s; 14256/351315 objects misplaced (4.058%); 927 KiB/s, 14 objects/s recovering 2024-02-10T08:30:16.684 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:30:16.700 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:16.701 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:30:16.791 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:30:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:30:16] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:30:16.801 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:30:16.850 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:16.987 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:30:17.002 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:17.003 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:30:17.104 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:30:17.156 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:17.405 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:30:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:30:17] "GET /metrics HTTP/1.1" 200 176243 "" "Prometheus/2.33.4" 2024-02-10T08:30:17.856 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:30:18.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:30:16.876936+0000 mgr.y (mgr.14505) 510 : cluster [DBG] pgmap v613: 158 pgs: 1 active+remapped+backfilling, 157 active+clean; 7.1 GiB data, 24 GiB used, 691 GiB / 715 GiB avail; 1.1 KiB/s rd, 35 MiB/s wr, 1.09k op/s; 14256/350412 objects misplaced (4.068%); 775 KiB/s, 12 objects/s recovering 2024-02-10T08:30:18.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:30:16.876936+0000 mgr.y (mgr.14505) 510 : cluster [DBG] pgmap v613: 158 pgs: 1 active+remapped+backfilling, 157 active+clean; 7.1 GiB data, 24 GiB used, 691 GiB / 715 GiB avail; 1.1 KiB/s rd, 35 MiB/s wr, 1.09k op/s; 14256/350412 objects misplaced (4.068%); 775 KiB/s, 12 objects/s recovering 2024-02-10T08:30:18.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:30:16.876936+0000 mgr.y (mgr.14505) 510 : cluster [DBG] pgmap v613: 158 pgs: 1 active+remapped+backfilling, 157 active+clean; 7.1 GiB data, 24 GiB used, 691 GiB / 715 GiB avail; 1.1 KiB/s rd, 35 MiB/s wr, 1.09k op/s; 14256/350412 objects misplaced (4.068%); 775 KiB/s, 12 objects/s recovering 2024-02-10T08:30:18.420 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:30:18.425 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:18.425 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:30:18.526 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:30:18.582 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:18.793 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:30:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:30:19.251 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:30:18.303080+0000 mgr.y (mgr.14505) 511 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:30:19.253 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:30:18.303080+0000 mgr.y (mgr.14505) 511 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:30:19.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:30:18.303080+0000 mgr.y (mgr.14505) 511 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:30:19.360 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:30:19.366 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:19.367 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:30:19.468 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:30:19.500 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:19.531 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:30:19.535 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:19.535 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:30:19.636 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:30:19.678 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:19.702 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:30:19.703 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:19.704 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:30:19.805 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:30:19.859 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:19.890 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:30:19.899 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:19.900 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:30:20.001 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:30:20.012 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is unset 2024-02-10T08:30:20.074 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:20.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:30:18.877764+0000 mgr.y (mgr.14505) 512 : cluster [DBG] pgmap v614: 158 pgs: 1 active+remapped+backfilling, 157 active+clean; 6.8 GiB data, 23 GiB used, 692 GiB / 715 GiB avail; 1.1 KiB/s rd, 3.6 MiB/s wr, 1.06k op/s; 13532/335694 objects misplaced (4.031%); 748 KiB/s, 11 objects/s recovering 2024-02-10T08:30:20.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:30:19.863177+0000 mon.a (mon.0) 1366 : audit [INF] from='client.? 172.21.15.18:0/2993697320' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:30:20.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:30:18.877764+0000 mgr.y (mgr.14505) 512 : cluster [DBG] pgmap v614: 158 pgs: 1 active+remapped+backfilling, 157 active+clean; 6.8 GiB data, 23 GiB used, 692 GiB / 715 GiB avail; 1.1 KiB/s rd, 3.6 MiB/s wr, 1.06k op/s; 13532/335694 objects misplaced (4.031%); 748 KiB/s, 11 objects/s recovering 2024-02-10T08:30:20.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:30:19.863177+0000 mon.a (mon.0) 1366 : audit [INF] from='client.? 172.21.15.18:0/2993697320' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:30:20.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:30:18.877764+0000 mgr.y (mgr.14505) 512 : cluster [DBG] pgmap v614: 158 pgs: 1 active+remapped+backfilling, 157 active+clean; 6.8 GiB data, 23 GiB used, 692 GiB / 715 GiB avail; 1.1 KiB/s rd, 3.6 MiB/s wr, 1.06k op/s; 13532/335694 objects misplaced (4.031%); 748 KiB/s, 11 objects/s recovering 2024-02-10T08:30:20.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:30:19.863177+0000 mon.a (mon.0) 1366 : audit [INF] from='client.? 172.21.15.18:0/2993697320' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:30:21.048 INFO:teuthology.orchestra.run.smithi018.stderr:set pool 6 pg_num to 52 2024-02-10T08:30:21.078 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:30:19.988747+0000 mon.a (mon.0) 1367 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-10T08:30:21.078 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:30:19.988780+0000 mon.a (mon.0) 1368 : cluster [INF] Cluster is now healthy 2024-02-10T08:30:21.078 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:30:20.006724+0000 mon.a (mon.0) 1369 : audit [INF] from='client.? 172.21.15.18:0/2993697320' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-10T08:30:21.078 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:30:20.006786+0000 mon.a (mon.0) 1370 : cluster [DBG] osdmap e285: 8 total, 8 up, 8 in 2024-02-10T08:30:21.078 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:30:20.466323+0000 mon.c (mon.2) 66 : audit [INF] from='client.? 172.21.15.18:0/411908982' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num", "val": "52"}]: dispatch 2024-02-10T08:30:21.078 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:30:20.466785+0000 mon.a (mon.0) 1371 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num", "val": "52"}]: dispatch 2024-02-10T08:30:21.079 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:30:19.988747+0000 mon.a (mon.0) 1367 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-10T08:30:21.079 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:30:19.988780+0000 mon.a (mon.0) 1368 : cluster [INF] Cluster is now healthy 2024-02-10T08:30:21.079 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:30:20.006724+0000 mon.a (mon.0) 1369 : audit [INF] from='client.? 172.21.15.18:0/2993697320' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-10T08:30:21.079 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:30:20.006786+0000 mon.a (mon.0) 1370 : cluster [DBG] osdmap e285: 8 total, 8 up, 8 in 2024-02-10T08:30:21.079 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:30:20.466323+0000 mon.c (mon.2) 66 : audit [INF] from='client.? 172.21.15.18:0/411908982' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num", "val": "52"}]: dispatch 2024-02-10T08:30:21.079 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:30:20.466785+0000 mon.a (mon.0) 1371 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num", "val": "52"}]: dispatch 2024-02-10T08:30:21.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:30:19.988747+0000 mon.a (mon.0) 1367 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-10T08:30:21.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:30:19.988780+0000 mon.a (mon.0) 1368 : cluster [INF] Cluster is now healthy 2024-02-10T08:30:21.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:30:20.006724+0000 mon.a (mon.0) 1369 : audit [INF] from='client.? 172.21.15.18:0/2993697320' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-10T08:30:21.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:30:20.006786+0000 mon.a (mon.0) 1370 : cluster [DBG] osdmap e285: 8 total, 8 up, 8 in 2024-02-10T08:30:21.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:30:20.466323+0000 mon.c (mon.2) 66 : audit [INF] from='client.? 172.21.15.18:0/411908982' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num", "val": "52"}]: dispatch 2024-02-10T08:30:21.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:30:20.466785+0000 mon.a (mon.0) 1371 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num", "val": "52"}]: dispatch 2024-02-10T08:30:22.125 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-02-10T08:30:22.125 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:30:22.297 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:30:20.878170+0000 mgr.y (mgr.14505) 513 : cluster [DBG] pgmap v616: 158 pgs: 1 active+remapped+backfilling, 157 active+clean; 6.8 GiB data, 23 GiB used, 692 GiB / 715 GiB avail; 1.1 KiB/s rd, 2.3 MiB/s wr, 1.06k op/s; 13532/334689 objects misplaced (4.043%); 748 KiB/s, 11 objects/s recovering 2024-02-10T08:30:22.298 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:30:21.010549+0000 mon.a (mon.0) 1372 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num", "val": "52"}]': finished 2024-02-10T08:30:22.298 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:30:21.010621+0000 mon.a (mon.0) 1373 : cluster [DBG] osdmap e286: 8 total, 8 up, 8 in 2024-02-10T08:30:22.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:30:20.878170+0000 mgr.y (mgr.14505) 513 : cluster [DBG] pgmap v616: 158 pgs: 1 active+remapped+backfilling, 157 active+clean; 6.8 GiB data, 23 GiB used, 692 GiB / 715 GiB avail; 1.1 KiB/s rd, 2.3 MiB/s wr, 1.06k op/s; 13532/334689 objects misplaced (4.043%); 748 KiB/s, 11 objects/s recovering 2024-02-10T08:30:22.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:30:21.010549+0000 mon.a (mon.0) 1372 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num", "val": "52"}]': finished 2024-02-10T08:30:22.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:30:21.010621+0000 mon.a (mon.0) 1373 : cluster [DBG] osdmap e286: 8 total, 8 up, 8 in 2024-02-10T08:30:22.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:30:20.878170+0000 mgr.y (mgr.14505) 513 : cluster [DBG] pgmap v616: 158 pgs: 1 active+remapped+backfilling, 157 active+clean; 6.8 GiB data, 23 GiB used, 692 GiB / 715 GiB avail; 1.1 KiB/s rd, 2.3 MiB/s wr, 1.06k op/s; 13532/334689 objects misplaced (4.043%); 748 KiB/s, 11 objects/s recovering 2024-02-10T08:30:22.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:30:21.010549+0000 mon.a (mon.0) 1372 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num", "val": "52"}]': finished 2024-02-10T08:30:22.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:30:21.010621+0000 mon.a (mon.0) 1373 : cluster [DBG] osdmap e286: 8 total, 8 up, 8 in 2024-02-10T08:30:22.572 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:30:22.579 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:22.580 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:30:22.681 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:30:22.715 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:22.738 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:30:22.742 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:22.743 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:30:22.843 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:30:22.896 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:22.940 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:30:22.945 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:22.945 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:30:23.035 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:30:22.882759+0000 mon.a (mon.0) 1374 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_actual", "val": "52"}]: dispatch 2024-02-10T08:30:23.046 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:30:23.104 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:23.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:30:22.882759+0000 mon.a (mon.0) 1374 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_actual", "val": "52"}]: dispatch 2024-02-10T08:30:23.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:30:22.882759+0000 mon.a (mon.0) 1374 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_actual", "val": "52"}]: dispatch 2024-02-10T08:30:23.347 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.2 dump_historic_ops 2024-02-10T08:30:23.669 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:30:23.673 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:23.674 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:30:23.775 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:30:23.795 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:30:23.795 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:30:23.796 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:30:23.796 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:30:23.796 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:30:23.796 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:30:23.796 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:30:23.796 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:30:23.796 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-10T08:30:23.796 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-10T08:30:23.796 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-10T08:30:23.796 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-10T08:30:23.796 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-10T08:30:23.797 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-10T08:30:23.797 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-10T08:30:23.797 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-10T08:30:23.834 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:23.858 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:30:23.861 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:23.861 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:30:23.962 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:30:24.015 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:24.050 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:30:24.059 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:24.060 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:30:24.161 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:30:24.218 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:30:22.881316+0000 mgr.y (mgr.14505) 514 : cluster [DBG] pgmap v618: 158 pgs: 1 active+remapped+backfilling, 157 active+clean; 6.6 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.19k op/s; 12802/322704 objects misplaced (3.967%); 935 KiB/s, 14 objects/s recovering 2024-02-10T08:30:24.218 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:30:23.022014+0000 mon.a (mon.0) 1375 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_actual", "val": "52"}]': finished 2024-02-10T08:30:24.219 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:30:23.022088+0000 mon.a (mon.0) 1376 : cluster [DBG] osdmap e287: 8 total, 8 up, 8 in 2024-02-10T08:30:24.219 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:30:23.104014+0000 mon.a (mon.0) 1377 : audit [DBG] from='client.? 172.21.15.18:0/509103271' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:30:24.225 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:24.269 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:30:24.272 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:24.272 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:30:24.375 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:30:24.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:30:22.881316+0000 mgr.y (mgr.14505) 514 : cluster [DBG] pgmap v618: 158 pgs: 1 active+remapped+backfilling, 157 active+clean; 6.6 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.19k op/s; 12802/322704 objects misplaced (3.967%); 935 KiB/s, 14 objects/s recovering 2024-02-10T08:30:24.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:30:23.022014+0000 mon.a (mon.0) 1375 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_actual", "val": "52"}]': finished 2024-02-10T08:30:24.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:30:23.022088+0000 mon.a (mon.0) 1376 : cluster [DBG] osdmap e287: 8 total, 8 up, 8 in 2024-02-10T08:30:24.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:30:23.104014+0000 mon.a (mon.0) 1377 : audit [DBG] from='client.? 172.21.15.18:0/509103271' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:30:24.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:30:22.881316+0000 mgr.y (mgr.14505) 514 : cluster [DBG] pgmap v618: 158 pgs: 1 active+remapped+backfilling, 157 active+clean; 6.6 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.19k op/s; 12802/322704 objects misplaced (3.967%); 935 KiB/s, 14 objects/s recovering 2024-02-10T08:30:24.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:30:23.022014+0000 mon.a (mon.0) 1375 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_actual", "val": "52"}]': finished 2024-02-10T08:30:24.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:30:23.022088+0000 mon.a (mon.0) 1376 : cluster [DBG] osdmap e287: 8 total, 8 up, 8 in 2024-02-10T08:30:24.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:30:23.104014+0000 mon.a (mon.0) 1377 : audit [DBG] from='client.? 172.21.15.18:0/509103271' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:30:24.427 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:24.690 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:30:24.694 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:24.694 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:30:24.795 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:30:24.843 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:24.878 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:30:24.882 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:24.883 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:30:24.983 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:30:25.034 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:25.077 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:30:25.082 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:25.082 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:30:25.183 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:30:25.241 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:25.273 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:30:25.279 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:25.280 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:30:25.294 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:30:24.042955+0000 mon.a (mon.0) 1378 : cluster [DBG] osdmap e288: 8 total, 8 up, 8 in 2024-02-10T08:30:25.294 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:30:24.885921+0000 mon.a (mon.0) 1379 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pgp_num_actual", "val": "52"}]: dispatch 2024-02-10T08:30:25.302 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:30:24.042955+0000 mon.a (mon.0) 1378 : cluster [DBG] osdmap e288: 8 total, 8 up, 8 in 2024-02-10T08:30:25.302 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:30:24.885921+0000 mon.a (mon.0) 1379 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pgp_num_actual", "val": "52"}]: dispatch 2024-02-10T08:30:25.302 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:30:24.042955+0000 mon.a (mon.0) 1378 : cluster [DBG] osdmap e288: 8 total, 8 up, 8 in 2024-02-10T08:30:25.302 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:30:24.885921+0000 mon.a (mon.0) 1379 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pgp_num_actual", "val": "52"}]: dispatch 2024-02-10T08:30:25.380 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:30:25.431 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:25.454 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:30:25.474 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:30:25.481 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:25.482 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:30:25.583 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:30:25.633 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:25.656 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:30:25.665 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:25.666 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:30:25.767 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:30:25.832 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:25.871 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:30:25.875 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:25.875 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:30:25.976 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:30:26.034 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:26.400 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:30:26.404 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:26.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:30:24.881792+0000 mgr.y (mgr.14505) 515 : cluster [DBG] pgmap v621: 168 pgs: 2 peering, 10 unknown, 1 active+remapped+backfilling, 155 active+clean; 6.5 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 1.02k op/s; 12802/319791 objects misplaced (4.003%); 761 KiB/s, 11 objects/s recovering 2024-02-10T08:30:26.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:30:25.050288+0000 mon.a (mon.0) 1380 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pgp_num_actual", "val": "52"}]': finished 2024-02-10T08:30:26.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:30:25.050362+0000 mon.a (mon.0) 1381 : cluster [DBG] osdmap e289: 8 total, 8 up, 8 in 2024-02-10T08:30:26.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:30:24.881792+0000 mgr.y (mgr.14505) 515 : cluster [DBG] pgmap v621: 168 pgs: 2 peering, 10 unknown, 1 active+remapped+backfilling, 155 active+clean; 6.5 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 1.02k op/s; 12802/319791 objects misplaced (4.003%); 761 KiB/s, 11 objects/s recovering 2024-02-10T08:30:26.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:30:25.050288+0000 mon.a (mon.0) 1380 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pgp_num_actual", "val": "52"}]': finished 2024-02-10T08:30:26.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:30:25.050362+0000 mon.a (mon.0) 1381 : cluster [DBG] osdmap e289: 8 total, 8 up, 8 in 2024-02-10T08:30:26.405 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:30:26.506 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:30:26.521 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:30:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:30:26] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:30:26.523 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:30:24.881792+0000 mgr.y (mgr.14505) 515 : cluster [DBG] pgmap v621: 168 pgs: 2 peering, 10 unknown, 1 active+remapped+backfilling, 155 active+clean; 6.5 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 1.02k op/s; 12802/319791 objects misplaced (4.003%); 761 KiB/s, 11 objects/s recovering 2024-02-10T08:30:26.523 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:30:25.050288+0000 mon.a (mon.0) 1380 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pgp_num_actual", "val": "52"}]': finished 2024-02-10T08:30:26.523 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:30:25.050362+0000 mon.a (mon.0) 1381 : cluster [DBG] osdmap e289: 8 total, 8 up, 8 in 2024-02-10T08:30:26.560 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:26.675 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:30:26.681 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:26.681 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:30:26.696 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-10T08:30:26.782 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:30:26.861 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:27.067 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:30:26.055737+0000 mon.a (mon.0) 1382 : cluster [DBG] osdmap e290: 8 total, 8 up, 8 in 2024-02-10T08:30:27.304 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd set noscrub 2024-02-10T08:30:27.331 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:30:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:30:27] "GET /metrics HTTP/1.1" 200 176243 "" "Prometheus/2.33.4" 2024-02-10T08:30:27.331 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:30:26.055737+0000 mon.a (mon.0) 1382 : cluster [DBG] osdmap e290: 8 total, 8 up, 8 in 2024-02-10T08:30:27.546 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:30:26.055737+0000 mon.a (mon.0) 1382 : cluster [DBG] osdmap e290: 8 total, 8 up, 8 in 2024-02-10T08:30:27.638 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:30:27.644 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:27.644 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:30:27.745 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:30:27.809 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:28.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:30:26.882296+0000 mgr.y (mgr.14505) 516 : cluster [DBG] pgmap v624: 168 pgs: 2 peering, 9 unknown, 1 active+remapped+backfilling, 156 active+clean; 6.5 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 0 B/s wr, 326 op/s; 12802/318783 objects misplaced (4.016%) 2024-02-10T08:30:28.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:30:26.882296+0000 mgr.y (mgr.14505) 516 : cluster [DBG] pgmap v624: 168 pgs: 2 peering, 9 unknown, 1 active+remapped+backfilling, 156 active+clean; 6.5 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 0 B/s wr, 326 op/s; 12802/318783 objects misplaced (4.016%) 2024-02-10T08:30:28.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:30:26.882296+0000 mgr.y (mgr.14505) 516 : cluster [DBG] pgmap v624: 168 pgs: 2 peering, 9 unknown, 1 active+remapped+backfilling, 156 active+clean; 6.5 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 0 B/s wr, 326 op/s; 12802/318783 objects misplaced (4.016%) 2024-02-10T08:30:28.540 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:30:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:30:28.708 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 3, 4, 5, 6, 7, 0] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 5, 6, 7, 4] 2024-02-10T08:30:28.709 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-10T08:30:28.709 INFO:tasks.thrashosds.thrasher:Shrinking pool unique_pool_2 2024-02-10T08:30:28.709 INFO:tasks.cephadm.ceph_manager.ceph:contract_pool unique_pool_2 by 10 min 8 2024-02-10T08:30:28.709 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph pg dump --format=json 2024-02-10T08:30:29.092 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:30:28.317255+0000 mgr.y (mgr.14505) 517 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:30:29.092 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:30:28.317255+0000 mgr.y (mgr.14505) 517 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:30:29.542 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:30:28.317255+0000 mgr.y (mgr.14505) 517 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:30:29.969 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:30:29.978 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:29.978 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:30:29.980 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:30:30.080 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:30:30.129 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:30.155 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:30:30.159 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:30.160 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:30:30.261 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:30:30.312 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:30.340 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:30:30.343 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:30.343 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:30:30.386 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-02-10T08:30:30.386 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-02-10T08:30:30.386 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-02-10T08:30:30.386 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-02-10T08:30:30.386 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.386 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:157099 7.3 7:cd526bdb:::benchmark_data_smithi018_80623_object56171:head [delete] snapc 0=[] ondisk+write+known_if_redirected e151)", 2024-02-10T08:30:30.386 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:22:42.923620+0000", 2024-02-10T08:30:30.386 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 467.45638706400001, 2024-02-10T08:30:30.386 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0924102659999999, 2024-02-10T08:30:30.386 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:30:30.387 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:30:30.387 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:30:30.387 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:30:30.387 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:30:30.387 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 157099 2024-02-10T08:30:30.387 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.387 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:30:30.387 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.387 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:30:30.387 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:42.923620+0000", 2024-02-10T08:30:30.387 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:30:30.387 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.387 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.387 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:30:30.387 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:42.923620+0000", 2024-02-10T08:30:30.388 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:30:30.388 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.388 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.388 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:30:30.388 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:42.923619+0000", 2024-02-10T08:30:30.388 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.874e-06 2024-02-10T08:30:30.388 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.388 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.388 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:30:30.388 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:42.923624+0000", 2024-02-10T08:30:30.388 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4190000000000002e-06 2024-02-10T08:30:30.388 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.388 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.389 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:30:30.389 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:42.923633+0000", 2024-02-10T08:30:30.389 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0599999999999998e-06 2024-02-10T08:30:30.389 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.389 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.389 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:30:30.389 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:42.923638+0000", 2024-02-10T08:30:30.389 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.004065155 2024-02-10T08:30:30.389 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.389 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.389 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:30:30.389 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:42.927703+0000", 2024-02-10T08:30:30.389 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1509999999999993e-06 2024-02-10T08:30:30.389 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.390 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.390 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:30:30.390 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:42.927712+0000", 2024-02-10T08:30:30.390 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.072839882 2024-02-10T08:30:30.390 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.390 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.390 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:30:30.390 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.000552+0000", 2024-02-10T08:30:30.390 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011776400000000001 2024-02-10T08:30:30.390 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.390 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.390 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:30:30.390 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.000670+0000", 2024-02-10T08:30:30.390 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4479000000000002e-05 2024-02-10T08:30:30.391 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.391 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.391 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,4", 2024-02-10T08:30:30.391 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.000754+0000", 2024-02-10T08:30:30.391 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0061497440000000004 2024-02-10T08:30:30.391 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.391 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.391 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:30:30.391 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.006904+0000", 2024-02-10T08:30:30.391 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8655999999999997e-05 2024-02-10T08:30:30.391 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.391 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.391 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:30:30.391 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.006943+0000", 2024-02-10T08:30:30.391 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0090054490000000004 2024-02-10T08:30:30.392 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.392 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.392 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:30:30.392 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.015948+0000", 2024-02-10T08:30:30.392 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0065000000000003e-05 2024-02-10T08:30:30.392 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.392 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.392 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:30:30.392 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.015998+0000", 2024-02-10T08:30:30.392 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1606000000000002e-05 2024-02-10T08:30:30.392 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.392 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.392 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:30:30.392 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.016030+0000", 2024-02-10T08:30:30.393 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0924102659999999 2024-02-10T08:30:30.393 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:30:30.393 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:30:30.393 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:30:30.393 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.393 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.393 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:157103 7.3 7:c8dea79b:::benchmark_data_smithi018_80623_object56175:head [delete] snapc 0=[] ondisk+write+known_if_redirected e151)", 2024-02-10T08:30:30.393 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:22:42.927761+0000", 2024-02-10T08:30:30.393 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 467.45224561200001, 2024-02-10T08:30:30.393 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0884696, 2024-02-10T08:30:30.393 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:30:30.393 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:30:30.393 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:30:30.394 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:30:30.394 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:30:30.394 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 157103 2024-02-10T08:30:30.394 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.394 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:30:30.394 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.394 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:30:30.394 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:42.927761+0000", 2024-02-10T08:30:30.394 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:30:30.394 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.394 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.394 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:30:30.394 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:42.927761+0000", 2024-02-10T08:30:30.394 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:30:30.394 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.395 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.395 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:30:30.395 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:42.927760+0000", 2024-02-10T08:30:30.395 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7260000000000002e-06 2024-02-10T08:30:30.395 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.395 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.395 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:30:30.395 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:42.927767+0000", 2024-02-10T08:30:30.395 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5466000000000001e-05 2024-02-10T08:30:30.395 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.395 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.395 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:30:30.395 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:42.927783+0000", 2024-02-10T08:30:30.395 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4690000000000002e-06 2024-02-10T08:30:30.395 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.396 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.396 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:30:30.396 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:42.927789+0000", 2024-02-10T08:30:30.396 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6159000000000003e-05 2024-02-10T08:30:30.396 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.396 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.396 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:30:30.396 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:42.927836+0000", 2024-02-10T08:30:30.396 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9410000000000002e-06 2024-02-10T08:30:30.396 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.396 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.396 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:30:30.396 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:42.927845+0000", 2024-02-10T08:30:30.396 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.07553985 2024-02-10T08:30:30.397 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.397 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.397 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:30:30.397 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.003385+0000", 2024-02-10T08:30:30.397 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5144999999999998e-05 2024-02-10T08:30:30.397 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.397 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.397 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:30:30.397 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.003480+0000", 2024-02-10T08:30:30.397 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6260000000000005e-05 2024-02-10T08:30:30.397 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.397 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.397 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,4", 2024-02-10T08:30:30.397 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.003557+0000", 2024-02-10T08:30:30.397 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.003415979 2024-02-10T08:30:30.398 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.398 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.398 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:30:30.398 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.006973+0000", 2024-02-10T08:30:30.398 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2410000000000002e-05 2024-02-10T08:30:30.398 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.398 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.398 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:30:30.398 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.007015+0000", 2024-02-10T08:30:30.398 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0091309560000000008 2024-02-10T08:30:30.398 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.398 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.398 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:30:30.398 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.016146+0000", 2024-02-10T08:30:30.398 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3359999999999998e-05 2024-02-10T08:30:30.399 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.399 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.399 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:30:30.399 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.016189+0000", 2024-02-10T08:30:30.399 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1214999999999998e-05 2024-02-10T08:30:30.399 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.399 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.399 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:30:30.399 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.016231+0000", 2024-02-10T08:30:30.399 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0884696 2024-02-10T08:30:30.399 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:30:30.399 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:30:30.400 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:30:30.400 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.400 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.400 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:157142 7.3 7:c44444c5:::benchmark_data_smithi018_80623_object56214:head [delete] snapc 0=[] ondisk+write+known_if_redirected e151)", 2024-02-10T08:30:30.400 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:22:42.972596+0000", 2024-02-10T08:30:30.400 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 467.40741086999998, 2024-02-10T08:30:30.400 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0437792480000001, 2024-02-10T08:30:30.400 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:30:30.400 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:30:30.400 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:30:30.400 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:30:30.401 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:30:30.401 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 157142 2024-02-10T08:30:30.401 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.401 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:30:30.401 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.401 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:30:30.401 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:42.972596+0000", 2024-02-10T08:30:30.401 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:30:30.401 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.401 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.401 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:30:30.401 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:42.972596+0000", 2024-02-10T08:30:30.401 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:30:30.402 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.402 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.402 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:30:30.402 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:42.972595+0000", 2024-02-10T08:30:30.402 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4429999999999996e-06 2024-02-10T08:30:30.402 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.402 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.402 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:30:30.402 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:42.972599+0000", 2024-02-10T08:30:30.402 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7589999999999997e-06 2024-02-10T08:30:30.402 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.402 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.402 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:30:30.402 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:42.972607+0000", 2024-02-10T08:30:30.402 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1659999999999996e-06 2024-02-10T08:30:30.403 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.403 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.403 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:30:30.403 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:42.972611+0000", 2024-02-10T08:30:30.403 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7869999999999998e-05 2024-02-10T08:30:30.403 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.403 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.403 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:30:30.403 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:42.972689+0000", 2024-02-10T08:30:30.403 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7290000000000006e-06 2024-02-10T08:30:30.403 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.403 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.403 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:30:30.403 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:42.972698+0000", 2024-02-10T08:30:30.404 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0327068230000001 2024-02-10T08:30:30.404 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.404 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.404 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:30:30.404 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.005404+0000", 2024-02-10T08:30:30.404 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1199999999999997e-05 2024-02-10T08:30:30.404 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.404 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.404 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:30:30.404 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.005466+0000", 2024-02-10T08:30:30.404 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6575000000000004e-05 2024-02-10T08:30:30.404 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.404 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.404 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,4", 2024-02-10T08:30:30.404 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.005552+0000", 2024-02-10T08:30:30.405 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0040631 2024-02-10T08:30:30.405 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.405 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.405 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:30:30.405 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.009615+0000", 2024-02-10T08:30:30.405 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8640000000000003e-05 2024-02-10T08:30:30.405 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.405 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.405 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:30:30.405 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.009654+0000", 2024-02-10T08:30:30.405 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0066338339999999999 2024-02-10T08:30:30.405 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.405 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.405 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:30:30.406 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.016288+0000", 2024-02-10T08:30:30.406 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2299000000000003e-05 2024-02-10T08:30:30.406 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.406 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.406 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:30:30.406 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.016330+0000", 2024-02-10T08:30:30.406 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5065000000000003e-05 2024-02-10T08:30:30.406 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.406 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.406 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:30:30.406 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.016375+0000", 2024-02-10T08:30:30.406 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0437792480000001 2024-02-10T08:30:30.406 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:30:30.406 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:30:30.406 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:30:30.407 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.407 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.407 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:157151 7.3 7:cee2eb08:::benchmark_data_smithi018_80623_object56223:head [delete] snapc 0=[] ondisk+write+known_if_redirected e151)", 2024-02-10T08:30:30.407 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:22:42.988420+0000", 2024-02-10T08:30:30.407 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 467.39158651600002, 2024-02-10T08:30:30.407 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0280947949999999, 2024-02-10T08:30:30.407 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:30:30.407 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:30:30.407 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:30:30.407 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:30:30.407 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:30:30.407 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 157151 2024-02-10T08:30:30.407 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.407 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:30:30.407 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.408 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:30:30.408 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:42.988420+0000", 2024-02-10T08:30:30.408 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:30:30.408 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.408 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.408 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:30:30.408 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:42.988420+0000", 2024-02-10T08:30:30.408 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999981 2024-02-10T08:30:30.408 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.408 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.408 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:30:30.408 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:42.988418+0000", 2024-02-10T08:30:30.408 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0299999999999999e-06 2024-02-10T08:30:30.408 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.409 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.409 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:30:30.409 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:42.988427+0000", 2024-02-10T08:30:30.409 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2763e-05 2024-02-10T08:30:30.409 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.409 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.409 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:30:30.409 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:42.988440+0000", 2024-02-10T08:30:30.409 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1559999999999998e-06 2024-02-10T08:30:30.409 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.409 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.409 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:30:30.409 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:42.988447+0000", 2024-02-10T08:30:30.409 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010882000000000001 2024-02-10T08:30:30.409 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.410 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.410 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:30:30.410 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:42.988556+0000", 2024-02-10T08:30:30.410 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0960000000000007e-06 2024-02-10T08:30:30.410 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.410 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.410 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:30:30.410 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:42.988565+0000", 2024-02-10T08:30:30.410 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.018487914 2024-02-10T08:30:30.410 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.410 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.410 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:30:30.410 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.007053+0000", 2024-02-10T08:30:30.410 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9953e-05 2024-02-10T08:30:30.410 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.411 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.411 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:30:30.411 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.007113+0000", 2024-02-10T08:30:30.411 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4193e-05 2024-02-10T08:30:30.411 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.411 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.411 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,4", 2024-02-10T08:30:30.411 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.007177+0000", 2024-02-10T08:30:30.411 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002484904 2024-02-10T08:30:30.411 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.411 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.411 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:30:30.411 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.009662+0000", 2024-02-10T08:30:30.411 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5729000000000002e-05 2024-02-10T08:30:30.412 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.412 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.412 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:30:30.412 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.009708+0000", 2024-02-10T08:30:30.412 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0067299179999999997 2024-02-10T08:30:30.412 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.412 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.412 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:30:30.412 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.016438+0000", 2024-02-10T08:30:30.412 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3043000000000001e-05 2024-02-10T08:30:30.412 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.412 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.412 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:30:30.412 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.016481+0000", 2024-02-10T08:30:30.413 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4218999999999999e-05 2024-02-10T08:30:30.413 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.413 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.413 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:30:30.413 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.016515+0000", 2024-02-10T08:30:30.413 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0280947949999999 2024-02-10T08:30:30.413 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:30:30.413 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:30:30.413 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:30:30.413 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.413 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.413 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:157165 7.3 7:c0c1600c:::benchmark_data_smithi018_80623_object56237:head [delete] snapc 0=[] ondisk+write+known_if_redirected e151)", 2024-02-10T08:30:30.413 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:22:42.997224+0000", 2024-02-10T08:30:30.413 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 467.382782733, 2024-02-10T08:30:30.413 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0194350720000001, 2024-02-10T08:30:30.414 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:30:30.414 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:30:30.414 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:30:30.414 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:30:30.414 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:30:30.414 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 157165 2024-02-10T08:30:30.414 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.414 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:30:30.414 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.414 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:30:30.414 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:42.997224+0000", 2024-02-10T08:30:30.414 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:30:30.414 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.414 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.415 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:30:30.415 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:42.997224+0000", 2024-02-10T08:30:30.415 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:30:30.415 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.415 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.415 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:30:30.415 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:42.997223+0000", 2024-02-10T08:30:30.415 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7780000000000004e-06 2024-02-10T08:30:30.415 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.415 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.415 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:30:30.415 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:42.997228+0000", 2024-02-10T08:30:30.415 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6690000000000006e-06 2024-02-10T08:30:30.415 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.415 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.416 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:30:30.416 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:42.997236+0000", 2024-02-10T08:30:30.416 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9200000000000003e-06 2024-02-10T08:30:30.416 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.416 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.416 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:30:30.416 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:42.997241+0000", 2024-02-10T08:30:30.416 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9993000000000001e-05 2024-02-10T08:30:30.416 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.416 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.416 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:30:30.416 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:42.997281+0000", 2024-02-10T08:30:30.416 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5579999999999997e-06 2024-02-10T08:30:30.416 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.417 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.417 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:30:30.417 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:42.997288+0000", 2024-02-10T08:30:30.417 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0110483480000001 2024-02-10T08:30:30.417 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.417 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.417 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:30:30.417 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.008336+0000", 2024-02-10T08:30:30.417 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2686000000000001e-05 2024-02-10T08:30:30.417 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.417 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.417 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:30:30.417 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.008419+0000", 2024-02-10T08:30:30.417 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2162999999999994e-05 2024-02-10T08:30:30.418 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.418 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.418 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,4", 2024-02-10T08:30:30.418 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.008481+0000", 2024-02-10T08:30:30.418 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0045856969999999997 2024-02-10T08:30:30.418 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.418 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.418 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:30:30.418 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.013066+0000", 2024-02-10T08:30:30.418 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4399999999999994e-06 2024-02-10T08:30:30.418 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.418 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.418 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:30:30.418 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.013076+0000", 2024-02-10T08:30:30.418 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0034993849999999998 2024-02-10T08:30:30.419 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.419 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.419 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:30:30.419 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.016575+0000", 2024-02-10T08:30:30.419 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4719999999999999e-05 2024-02-10T08:30:30.419 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.419 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.419 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:30:30.419 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.016620+0000", 2024-02-10T08:30:30.419 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9001000000000001e-05 2024-02-10T08:30:30.419 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.419 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.419 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:30:30.419 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.016659+0000", 2024-02-10T08:30:30.420 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0194350720000001 2024-02-10T08:30:30.420 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:30:30.420 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:30:30.420 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:30:30.420 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.420 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.420 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:157170 7.3 7:cdd7d9b5:::benchmark_data_smithi018_80623_object56242:head [delete] snapc 0=[] ondisk+write+known_if_redirected e151)", 2024-02-10T08:30:30.420 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:22:43.000587+0000", 2024-02-10T08:30:30.420 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 467.37941976000002, 2024-02-10T08:30:30.420 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.016241425, 2024-02-10T08:30:30.420 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:30:30.420 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:30:30.420 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:30:30.420 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:30:30.421 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:30:30.421 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 157170 2024-02-10T08:30:30.421 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.421 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:30:30.421 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.421 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:30:30.421 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.000587+0000", 2024-02-10T08:30:30.421 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:30:30.421 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.421 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.421 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:30:30.421 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.000587+0000", 2024-02-10T08:30:30.421 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:30:30.421 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.421 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.422 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:30:30.422 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.000586+0000", 2024-02-10T08:30:30.422 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1179999999999997e-06 2024-02-10T08:30:30.422 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.422 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.422 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:30:30.422 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.000592+0000", 2024-02-10T08:30:30.422 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5119999999999997e-06 2024-02-10T08:30:30.422 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.422 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.422 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:30:30.422 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.000601+0000", 2024-02-10T08:30:30.422 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8019999999999997e-06 2024-02-10T08:30:30.422 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.423 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.423 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:30:30.423 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.000607+0000", 2024-02-10T08:30:30.423 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2259999999999999e-05 2024-02-10T08:30:30.423 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.423 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.423 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:30:30.423 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.000649+0000", 2024-02-10T08:30:30.423 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2580000000000001e-06 2024-02-10T08:30:30.423 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.423 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.423 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:30:30.423 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.000656+0000", 2024-02-10T08:30:30.423 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.009083113 2024-02-10T08:30:30.424 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.424 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.424 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:30:30.424 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.009739+0000", 2024-02-10T08:30:30.424 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0674999999999998e-05 2024-02-10T08:30:30.424 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.424 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.424 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:30:30.424 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.009799+0000", 2024-02-10T08:30:30.424 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2755999999999993e-05 2024-02-10T08:30:30.424 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.424 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.424 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,4", 2024-02-10T08:30:30.424 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.009862+0000", 2024-02-10T08:30:30.425 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.003236704 2024-02-10T08:30:30.425 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.425 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.425 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:30:30.425 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.013099+0000", 2024-02-10T08:30:30.425 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001486986 2024-02-10T08:30:30.425 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.425 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.425 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:30:30.425 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.014586+0000", 2024-02-10T08:30:30.425 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0021708930000000001 2024-02-10T08:30:30.425 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.425 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.425 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:30:30.426 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.016757+0000", 2024-02-10T08:30:30.426 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7506999999999999e-05 2024-02-10T08:30:30.426 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.426 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.426 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:30:30.426 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.016794+0000", 2024-02-10T08:30:30.426 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4118000000000001e-05 2024-02-10T08:30:30.426 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.426 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.426 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:30:30.426 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.016828+0000", 2024-02-10T08:30:30.426 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.016241425 2024-02-10T08:30:30.426 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:30:30.426 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:30:30.426 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:30:30.427 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.427 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.427 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:157197 7.3 7:c4729bc2:::benchmark_data_smithi018_80623_object56269:head [delete] snapc 0=[] ondisk+write+known_if_redirected e151)", 2024-02-10T08:30:30.427 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:22:43.040572+0000", 2024-02-10T08:30:30.427 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 467.33943470600002, 2024-02-10T08:30:30.427 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.97637103999999997, 2024-02-10T08:30:30.427 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:30:30.427 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:30:30.427 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:30:30.427 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:30:30.427 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:30:30.427 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 157197 2024-02-10T08:30:30.427 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.427 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:30:30.428 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.428 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:30:30.428 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.040572+0000", 2024-02-10T08:30:30.428 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:30:30.428 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.428 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.428 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:30:30.428 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.040572+0000", 2024-02-10T08:30:30.428 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:30:30.428 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.428 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.428 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:30:30.428 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.040571+0000", 2024-02-10T08:30:30.428 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.613e-06 2024-02-10T08:30:30.429 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.429 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.429 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:30:30.429 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.040577+0000", 2024-02-10T08:30:30.429 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1826e-05 2024-02-10T08:30:30.429 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.429 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.429 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:30:30.429 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.040589+0000", 2024-02-10T08:30:30.429 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2960000000000004e-06 2024-02-10T08:30:30.429 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.429 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.429 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:30:30.429 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.040596+0000", 2024-02-10T08:30:30.430 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9116000000000001e-05 2024-02-10T08:30:30.430 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.430 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.430 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:30:30.430 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.040655+0000", 2024-02-10T08:30:30.430 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9910000000000002e-06 2024-02-10T08:30:30.430 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.430 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.430 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:30:30.430 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:43.040663+0000", 2024-02-10T08:30:30.430 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.97090337199999999 2024-02-10T08:30:30.430 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.430 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.430 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:30:30.430 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.011566+0000", 2024-02-10T08:30:30.431 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2589000000000005e-05 2024-02-10T08:30:30.431 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.431 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.431 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:30:30.431 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.011649+0000", 2024-02-10T08:30:30.431 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8821999999999999e-05 2024-02-10T08:30:30.431 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.431 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.431 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,4", 2024-02-10T08:30:30.431 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.011717+0000", 2024-02-10T08:30:30.431 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0041765750000000001 2024-02-10T08:30:30.431 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.431 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.431 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:30:30.431 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.015894+0000", 2024-02-10T08:30:30.432 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016212 2024-02-10T08:30:30.432 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.432 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.432 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:30:30.432 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.016056+0000", 2024-02-10T08:30:30.432 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00081899299999999996 2024-02-10T08:30:30.432 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.432 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.432 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:30:30.432 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.016875+0000", 2024-02-10T08:30:30.432 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4431999999999998e-05 2024-02-10T08:30:30.432 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.432 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.432 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:30:30.433 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.016910+0000", 2024-02-10T08:30:30.433 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3476000000000003e-05 2024-02-10T08:30:30.433 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.433 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.433 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:30:30.433 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:22:44.016943+0000", 2024-02-10T08:30:30.433 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.97637103999999997 2024-02-10T08:30:30.433 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:30:30.433 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:30:30.433 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:30:30.433 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.433 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.433 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:179907 7.e 7:7231e2fb:::benchmark_data_smithi018_80623_object78979:head [delete] snapc 0=[] ondisk+write+known_if_redirected e162)", 2024-02-10T08:30:30.433 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:23:14.043336+0000", 2024-02-10T08:30:30.434 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 436.33667093700001, 2024-02-10T08:30:30.434 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6648055909999999, 2024-02-10T08:30:30.434 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:30:30.434 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-02-10T08:30:30.434 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:30:30.434 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:30:30.434 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:30:30.434 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 179907 2024-02-10T08:30:30.434 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.434 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:30:30.434 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.434 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:30:30.434 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.043336+0000", 2024-02-10T08:30:30.435 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:30:30.435 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.435 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.435 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:30:30.435 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.043336+0000", 2024-02-10T08:30:30.435 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999981 2024-02-10T08:30:30.435 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.435 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.435 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:30:30.435 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.043334+0000", 2024-02-10T08:30:30.435 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1280000000000008e-06 2024-02-10T08:30:30.435 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.435 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.435 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:30:30.436 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.043342+0000", 2024-02-10T08:30:30.436 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3698e-05 2024-02-10T08:30:30.436 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.436 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.436 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:30:30.436 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.043356+0000", 2024-02-10T08:30:30.436 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8650000000000003e-06 2024-02-10T08:30:30.436 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.436 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.436 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:30:30.436 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.043363+0000", 2024-02-10T08:30:30.436 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.003475363 2024-02-10T08:30:30.436 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.436 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.437 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:30:30.437 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.046838+0000", 2024-02-10T08:30:30.437 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011392600000000001 2024-02-10T08:30:30.437 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.437 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.437 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:30:30.437 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.046952+0000", 2024-02-10T08:30:30.437 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000146372 2024-02-10T08:30:30.437 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.437 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.437 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0,5", 2024-02-10T08:30:30.437 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.047098+0000", 2024-02-10T08:30:30.437 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.003034302 2024-02-10T08:30:30.437 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.437 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.438 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:30:30.438 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.050133+0000", 2024-02-10T08:30:30.438 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0045547590000000002 2024-02-10T08:30:30.438 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.438 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.438 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:30:30.438 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.054687+0000", 2024-02-10T08:30:30.438 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.031944001 2024-02-10T08:30:30.438 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.438 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.438 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:30:30.438 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.086631+0000", 2024-02-10T08:30:30.438 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1980000000000001e-06 2024-02-10T08:30:30.438 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.438 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.439 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:30:30.439 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.086640+0000", 2024-02-10T08:30:30.439 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.98181184200000005 2024-02-10T08:30:30.439 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.439 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.439 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:30:30.439 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.068451+0000", 2024-02-10T08:30:30.439 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0975000000000001e-05 2024-02-10T08:30:30.439 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.439 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.439 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:30:30.439 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.068462+0000", 2024-02-10T08:30:30.439 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.63960430700000004 2024-02-10T08:30:30.439 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.440 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.440 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:30:30.440 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.708067+0000", 2024-02-10T08:30:30.440 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4673999999999997e-05 2024-02-10T08:30:30.440 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.440 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.440 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:30:30.440 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.708141+0000", 2024-02-10T08:30:30.440 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6648055909999999 2024-02-10T08:30:30.440 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:30:30.440 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:30:30.440 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:30:30.440 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.440 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.441 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:179925 7.e 7:72968301:::benchmark_data_smithi018_80623_object78997:head [delete] snapc 0=[] ondisk+write+known_if_redirected e163)", 2024-02-10T08:30:30.441 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:23:14.078690+0000", 2024-02-10T08:30:30.441 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 436.30131664999999, 2024-02-10T08:30:30.441 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.677725116, 2024-02-10T08:30:30.441 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:30:30.441 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:30:30.441 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:30:30.441 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:30:30.441 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:30:30.441 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 179925 2024-02-10T08:30:30.441 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.441 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:30:30.441 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.441 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:30:30.442 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.078690+0000", 2024-02-10T08:30:30.442 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:30:30.442 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.442 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.442 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:30:30.442 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.078690+0000", 2024-02-10T08:30:30.442 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:30:30.442 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.442 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.442 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:30:30.442 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.078688+0000", 2024-02-10T08:30:30.442 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9439999999999999e-06 2024-02-10T08:30:30.442 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.442 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.442 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:30:30.443 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.078695+0000", 2024-02-10T08:30:30.443 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2506e-05 2024-02-10T08:30:30.443 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.443 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.443 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:30:30.443 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.078708+0000", 2024-02-10T08:30:30.443 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6969999999999993e-06 2024-02-10T08:30:30.443 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.443 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.443 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:30:30.443 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.078716+0000", 2024-02-10T08:30:30.443 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0079431369999999994 2024-02-10T08:30:30.443 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.444 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.444 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:30:30.444 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.086659+0000", 2024-02-10T08:30:30.444 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0859999999999998e-06 2024-02-10T08:30:30.444 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.444 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.444 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:30:30.444 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.086665+0000", 2024-02-10T08:30:30.444 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.98181665100000004 2024-02-10T08:30:30.444 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.444 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.444 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:30:30.444 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.068481+0000", 2024-02-10T08:30:30.444 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8859999999999998e-06 2024-02-10T08:30:30.444 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.445 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.445 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:30:30.445 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.068488+0000", 2024-02-10T08:30:30.445 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.64001606899999997 2024-02-10T08:30:30.445 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.445 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.445 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:30:30.445 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.708504+0000", 2024-02-10T08:30:30.445 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010408000000000001 2024-02-10T08:30:30.445 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.445 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.445 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:30:30.445 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.708608+0000", 2024-02-10T08:30:30.445 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00045112599999999999 2024-02-10T08:30:30.445 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.445 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.446 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0,3,5", 2024-02-10T08:30:30.446 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.709060+0000", 2024-02-10T08:30:30.446 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.025245005000000001 2024-02-10T08:30:30.446 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.446 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.446 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:30:30.446 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.734305+0000", 2024-02-10T08:30:30.446 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0342e-05 2024-02-10T08:30:30.446 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.446 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.446 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:30:30.446 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.734355+0000", 2024-02-10T08:30:30.446 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001417202 2024-02-10T08:30:30.446 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.446 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.447 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:30:30.447 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.735772+0000", 2024-02-10T08:30:30.447 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.020468496999999999 2024-02-10T08:30:30.447 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.447 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.447 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:30:30.447 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.756241+0000", 2024-02-10T08:30:30.447 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4324999999999999e-05 2024-02-10T08:30:30.447 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.447 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.447 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:30:30.447 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.756295+0000", 2024-02-10T08:30:30.447 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000120222 2024-02-10T08:30:30.447 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.447 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.448 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:30:30.448 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.756415+0000", 2024-02-10T08:30:30.448 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.677725116 2024-02-10T08:30:30.448 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:30:30.448 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:30:30.448 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:30:30.448 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.448 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.448 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:179928 7.e 7:72d266e4:::benchmark_data_smithi018_80623_object79000:head [delete] snapc 0=[] ondisk+write+known_if_redirected e163)", 2024-02-10T08:30:30.448 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:23:14.092649+0000", 2024-02-10T08:30:30.448 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 436.28735777100002, 2024-02-10T08:30:30.448 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.666747126, 2024-02-10T08:30:30.448 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:30:30.448 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:30:30.449 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:30:30.449 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:30:30.449 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:30:30.449 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 179928 2024-02-10T08:30:30.449 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.449 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:30:30.449 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.449 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:30:30.449 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.092649+0000", 2024-02-10T08:30:30.449 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:30:30.449 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.449 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.449 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:30:30.449 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.092649+0000", 2024-02-10T08:30:30.449 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999981 2024-02-10T08:30:30.450 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.450 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.450 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:30:30.450 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.092647+0000", 2024-02-10T08:30:30.450 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1449999999999996e-06 2024-02-10T08:30:30.450 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.450 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.450 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:30:30.450 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.092653+0000", 2024-02-10T08:30:30.450 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3961000000000001e-05 2024-02-10T08:30:30.450 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.450 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.450 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:30:30.450 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.092667+0000", 2024-02-10T08:30:30.450 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8449999999999999e-06 2024-02-10T08:30:30.451 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.451 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.451 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:30:30.451 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.092673+0000", 2024-02-10T08:30:30.451 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00056664599999999997 2024-02-10T08:30:30.451 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.451 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.451 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:30:30.451 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.093240+0000", 2024-02-10T08:30:30.451 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0120000000000005e-06 2024-02-10T08:30:30.451 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.451 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.451 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:30:30.451 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.093248+0000", 2024-02-10T08:30:30.452 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.97525832499999998 2024-02-10T08:30:30.452 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.452 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.452 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:30:30.452 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.068506+0000", 2024-02-10T08:30:30.452 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4230000000000002e-06 2024-02-10T08:30:30.452 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.452 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.452 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:30:30.452 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.068512+0000", 2024-02-10T08:30:30.452 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.65053395999999997 2024-02-10T08:30:30.452 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.452 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.452 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:30:30.452 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.719046+0000", 2024-02-10T08:30:30.453 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000114819 2024-02-10T08:30:30.453 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.453 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.453 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:30:30.453 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.719161+0000", 2024-02-10T08:30:30.453 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014697700000000001 2024-02-10T08:30:30.453 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.453 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.453 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0,3,5", 2024-02-10T08:30:30.453 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.719308+0000", 2024-02-10T08:30:30.453 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015003345 2024-02-10T08:30:30.454 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.454 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.454 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:30:30.454 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.734312+0000", 2024-02-10T08:30:30.454 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0014970579999999999 2024-02-10T08:30:30.454 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.454 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.454 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:30:30.454 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.735809+0000", 2024-02-10T08:30:30.454 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00070790299999999996 2024-02-10T08:30:30.454 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.454 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.455 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:30:30.455 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.736517+0000", 2024-02-10T08:30:30.455 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.022755646000000001 2024-02-10T08:30:30.455 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.455 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.455 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:30:30.455 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.759272+0000", 2024-02-10T08:30:30.455 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3754999999999998e-05 2024-02-10T08:30:30.455 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.455 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.456 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:30:30.456 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.759306+0000", 2024-02-10T08:30:30.456 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0101999999999999e-05 2024-02-10T08:30:30.456 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.456 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.456 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:30:30.456 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.759396+0000", 2024-02-10T08:30:30.456 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.666747126 2024-02-10T08:30:30.456 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:30:30.456 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:30:30.456 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:30:30.456 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.456 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.456 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:179945 7.e 7:73b3a950:::benchmark_data_smithi018_80623_object79017:head [delete] snapc 0=[] ondisk+write+known_if_redirected e163)", 2024-02-10T08:30:30.457 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:23:14.119145+0000", 2024-02-10T08:30:30.457 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 436.26086192999998, 2024-02-10T08:30:30.457 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6404200420000001, 2024-02-10T08:30:30.457 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:30:30.457 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:30:30.457 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:30:30.457 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:30:30.457 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:30:30.457 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 179945 2024-02-10T08:30:30.457 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.457 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:30:30.457 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.457 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:30:30.457 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.119145+0000", 2024-02-10T08:30:30.457 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:30:30.458 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.458 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.458 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:30:30.458 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.119145+0000", 2024-02-10T08:30:30.458 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:30:30.458 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.458 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.458 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:30:30.458 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.119144+0000", 2024-02-10T08:30:30.458 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0290000000000001e-06 2024-02-10T08:30:30.458 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.458 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.458 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:30:30.458 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.119147+0000", 2024-02-10T08:30:30.458 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1449999999999999e-06 2024-02-10T08:30:30.458 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.459 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.459 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:30:30.459 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.119152+0000", 2024-02-10T08:30:30.459 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.693e-06 2024-02-10T08:30:30.459 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.459 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.459 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:30:30.459 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.119156+0000", 2024-02-10T08:30:30.459 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7330000000000003e-05 2024-02-10T08:30:30.459 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.459 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.459 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:30:30.459 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.119203+0000", 2024-02-10T08:30:30.459 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3399999999999998e-06 2024-02-10T08:30:30.460 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.460 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.460 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:30:30.460 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.119212+0000", 2024-02-10T08:30:30.460 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.94931920199999997 2024-02-10T08:30:30.460 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.460 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.460 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:30:30.460 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.068531+0000", 2024-02-10T08:30:30.460 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9009999999999997e-06 2024-02-10T08:30:30.460 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.460 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.460 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:30:30.460 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.068538+0000", 2024-02-10T08:30:30.460 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.65529383500000005 2024-02-10T08:30:30.461 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.461 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.461 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:30:30.461 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.723832+0000", 2024-02-10T08:30:30.461 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000131526 2024-02-10T08:30:30.461 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.461 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.461 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:30:30.461 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.723963+0000", 2024-02-10T08:30:30.461 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016254900000000001 2024-02-10T08:30:30.461 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.461 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.461 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0,3,5", 2024-02-10T08:30:30.461 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.724126+0000", 2024-02-10T08:30:30.461 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.010192308000000001 2024-02-10T08:30:30.462 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.462 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.462 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:30:30.462 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.734318+0000", 2024-02-10T08:30:30.462 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0079136729999999995 2024-02-10T08:30:30.462 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.462 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.462 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:30:30.462 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.742232+0000", 2024-02-10T08:30:30.462 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0048784900000000001 2024-02-10T08:30:30.462 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.462 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.462 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:30:30.462 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.747110+0000", 2024-02-10T08:30:30.462 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.012339822 2024-02-10T08:30:30.463 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.463 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.463 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:30:30.463 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.759450+0000", 2024-02-10T08:30:30.463 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0015000000000001e-05 2024-02-10T08:30:30.463 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.463 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.463 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:30:30.463 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.759500+0000", 2024-02-10T08:30:30.463 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4652000000000004e-05 2024-02-10T08:30:30.463 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.463 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.463 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:30:30.463 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.759565+0000", 2024-02-10T08:30:30.463 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6404200420000001 2024-02-10T08:30:30.463 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:30:30.464 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:30:30.464 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:30:30.464 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.464 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.464 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14964.0:225109 8.e 8:74f5a327:::benchmark_data_smithi018_103312_object100677:head [delete] snapc 0=[] ondisk+write+known_if_redirected e239)", 2024-02-10T08:30:30.464 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:27:41.766578+0000", 2024-02-10T08:30:30.464 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 168.61342865200001, 2024-02-10T08:30:30.464 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.98512320799999997, 2024-02-10T08:30:30.464 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:30:30.464 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:30:30.464 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:30:30.464 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14964", 2024-02-10T08:30:30.464 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/3173131962", 2024-02-10T08:30:30.464 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 225109 2024-02-10T08:30:30.465 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.465 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:30:30.465 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.465 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:30:30.465 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:41.766578+0000", 2024-02-10T08:30:30.465 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:30:30.465 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.465 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.465 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:30:30.465 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:41.766578+0000", 2024-02-10T08:30:30.465 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:30:30.465 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.465 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.465 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:30:30.466 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:41.766577+0000", 2024-02-10T08:30:30.466 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2209999999999997e-06 2024-02-10T08:30:30.466 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.466 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.466 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:30:30.466 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:41.766585+0000", 2024-02-10T08:30:30.466 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3003000000000001e-05 2024-02-10T08:30:30.466 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.466 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.466 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:30:30.466 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:41.766598+0000", 2024-02-10T08:30:30.466 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9120000000000003e-06 2024-02-10T08:30:30.466 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.466 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.467 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:30:30.467 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:41.766604+0000", 2024-02-10T08:30:30.467 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8798999999999998e-05 2024-02-10T08:30:30.467 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.467 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.467 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:30:30.467 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:41.766652+0000", 2024-02-10T08:30:30.467 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1821000000000001e-05 2024-02-10T08:30:30.467 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.467 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.467 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:30:30.467 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:41.766664+0000", 2024-02-10T08:30:30.467 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.97798948200000002 2024-02-10T08:30:30.467 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.468 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.468 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:30:30.468 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:42.744654+0000", 2024-02-10T08:30:30.468 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000107157 2024-02-10T08:30:30.468 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.468 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.468 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:30:30.468 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:42.744761+0000", 2024-02-10T08:30:30.468 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000165821 2024-02-10T08:30:30.468 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.468 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.468 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4,7", 2024-02-10T08:30:30.468 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:42.744927+0000", 2024-02-10T08:30:30.468 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0023755880000000001 2024-02-10T08:30:30.468 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.469 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.469 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:30:30.469 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:42.747302+0000", 2024-02-10T08:30:30.469 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0032893380000000002 2024-02-10T08:30:30.469 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.469 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.469 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:30:30.469 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:42.750592+0000", 2024-02-10T08:30:30.469 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001054801 2024-02-10T08:30:30.469 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.469 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.469 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:30:30.469 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:42.751646+0000", 2024-02-10T08:30:30.469 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1126e-05 2024-02-10T08:30:30.469 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.470 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.470 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:30:30.470 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:42.751678+0000", 2024-02-10T08:30:30.470 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3614000000000001e-05 2024-02-10T08:30:30.470 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.470 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.470 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:30:30.470 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:42.751701+0000", 2024-02-10T08:30:30.470 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.98512320799999997 2024-02-10T08:30:30.470 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:30:30.470 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:30:30.470 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:30:30.471 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.471 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.471 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14964.0:225117 8.e 8:7fc43e33:::benchmark_data_smithi018_103312_object100685:head [delete] snapc 0=[] ondisk+write+known_if_redirected e239)", 2024-02-10T08:30:30.471 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:27:41.779823+0000", 2024-02-10T08:30:30.471 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 168.60018387, 2024-02-10T08:30:30.471 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.97304799099999995, 2024-02-10T08:30:30.471 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:30:30.471 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:30:30.471 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:30:30.471 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14964", 2024-02-10T08:30:30.471 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/3173131962", 2024-02-10T08:30:30.471 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 225117 2024-02-10T08:30:30.471 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.471 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:30:30.471 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.471 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:30:30.472 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:41.779823+0000", 2024-02-10T08:30:30.472 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:30:30.472 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.472 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.472 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:30:30.472 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:41.779823+0000", 2024-02-10T08:30:30.472 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:30:30.472 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.472 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.472 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:30:30.472 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:41.779821+0000", 2024-02-10T08:30:30.472 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4649999999999997e-06 2024-02-10T08:30:30.472 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.473 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.473 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:30:30.473 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:41.779829+0000", 2024-02-10T08:30:30.473 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2928000000000001e-05 2024-02-10T08:30:30.473 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.473 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.473 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:30:30.473 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:41.779842+0000", 2024-02-10T08:30:30.473 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9959999999999993e-06 2024-02-10T08:30:30.473 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.473 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.473 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:30:30.473 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:41.779850+0000", 2024-02-10T08:30:30.473 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4844e-05 2024-02-10T08:30:30.473 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.473 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.474 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:30:30.474 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:41.779894+0000", 2024-02-10T08:30:30.474 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3368e-05 2024-02-10T08:30:30.474 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.474 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.474 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:30:30.474 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:41.779908+0000", 2024-02-10T08:30:30.474 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.96742442299999998 2024-02-10T08:30:30.474 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.474 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.474 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:30:30.474 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:42.747332+0000", 2024-02-10T08:30:30.474 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000117623 2024-02-10T08:30:30.474 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.474 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.474 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:30:30.474 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:42.747450+0000", 2024-02-10T08:30:30.475 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012566000000000001 2024-02-10T08:30:30.475 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.475 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.475 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4,7", 2024-02-10T08:30:30.475 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:42.747576+0000", 2024-02-10T08:30:30.475 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0030547389999999999 2024-02-10T08:30:30.475 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.475 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.475 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:30:30.475 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:42.750630+0000", 2024-02-10T08:30:30.475 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0011378899999999999 2024-02-10T08:30:30.475 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.475 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.475 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:30:30.475 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:42.751768+0000", 2024-02-10T08:30:30.475 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010580349999999999 2024-02-10T08:30:30.475 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.476 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.476 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:30:30.476 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:42.752826+0000", 2024-02-10T08:30:30.476 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.4624e-05 2024-02-10T08:30:30.476 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.476 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.476 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:30:30.476 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:42.752851+0000", 2024-02-10T08:30:30.476 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.999e-05 2024-02-10T08:30:30.476 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.476 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.476 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:30:30.476 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:42.752871+0000", 2024-02-10T08:30:30.476 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.97304799099999995 2024-02-10T08:30:30.476 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:30:30.476 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:30:30.477 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:30:30.477 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.477 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.477 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14964.0:225143 8.e 8:73fbdeb5:::benchmark_data_smithi018_103312_object100711:head [delete] snapc 0=[] ondisk+write+known_if_redirected e239)", 2024-02-10T08:30:30.477 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:27:41.805447+0000", 2024-02-10T08:30:30.477 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 168.57456004100001, 2024-02-10T08:30:30.477 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.94755605700000001, 2024-02-10T08:30:30.477 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:30:30.477 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:30:30.477 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:30:30.477 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14964", 2024-02-10T08:30:30.477 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/3173131962", 2024-02-10T08:30:30.477 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 225143 2024-02-10T08:30:30.477 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.477 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:30:30.477 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.477 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:30:30.478 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:41.805447+0000", 2024-02-10T08:30:30.478 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:30:30.478 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.478 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.478 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:30:30.478 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:41.805447+0000", 2024-02-10T08:30:30.478 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:30:30.478 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.478 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.478 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:30:30.478 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:41.805446+0000", 2024-02-10T08:30:30.478 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6160000000000002e-06 2024-02-10T08:30:30.478 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.478 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.478 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:30:30.478 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:41.805450+0000", 2024-02-10T08:30:30.479 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8659999999999997e-06 2024-02-10T08:30:30.479 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.479 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.479 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:30:30.479 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:41.805455+0000", 2024-02-10T08:30:30.479 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7250000000000002e-06 2024-02-10T08:30:30.479 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.479 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.479 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:30:30.479 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:41.805457+0000", 2024-02-10T08:30:30.479 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0025978210000000002 2024-02-10T08:30:30.479 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.479 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.479 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:30:30.479 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:41.808055+0000", 2024-02-10T08:30:30.479 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9889999999999998e-06 2024-02-10T08:30:30.480 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.480 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.480 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:30:30.480 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:41.808064+0000", 2024-02-10T08:30:30.480 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.94135595400000005 2024-02-10T08:30:30.480 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.480 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.480 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:30:30.480 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:42.749420+0000", 2024-02-10T08:30:30.480 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6620999999999997e-05 2024-02-10T08:30:30.480 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.480 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.480 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:30:30.480 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:42.749497+0000", 2024-02-10T08:30:30.480 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8040000000000006e-05 2024-02-10T08:30:30.481 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.481 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.481 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4,7", 2024-02-10T08:30:30.481 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:42.749565+0000", 2024-02-10T08:30:30.481 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0033169789999999998 2024-02-10T08:30:30.481 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.481 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.481 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:30:30.481 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:42.752882+0000", 2024-02-10T08:30:30.481 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3149000000000003e-05 2024-02-10T08:30:30.481 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.481 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.481 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:30:30.481 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:42.752925+0000", 2024-02-10T08:30:30.481 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1560999999999998e-05 2024-02-10T08:30:30.482 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.482 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.482 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:30:30.482 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:42.752956+0000", 2024-02-10T08:30:30.482 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2648000000000001e-05 2024-02-10T08:30:30.482 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.482 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.482 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:30:30.482 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:42.752979+0000", 2024-02-10T08:30:30.482 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3674999999999999e-05 2024-02-10T08:30:30.482 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.482 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.482 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:30:30.482 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:42.753003+0000", 2024-02-10T08:30:30.483 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.94755605700000001 2024-02-10T08:30:30.483 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:30:30.483 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:30:30.483 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:30:30.483 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.483 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.483 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14964.0:225147 8.e 8:766f5920:::benchmark_data_smithi018_103312_object100715:head [delete] snapc 0=[] ondisk+write+known_if_redirected e239)", 2024-02-10T08:30:30.483 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:27:41.810244+0000", 2024-02-10T08:30:30.483 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 168.56976288800001, 2024-02-10T08:30:30.483 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.94816354800000002, 2024-02-10T08:30:30.483 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:30:30.483 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:30:30.483 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:30:30.483 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14964", 2024-02-10T08:30:30.484 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/3173131962", 2024-02-10T08:30:30.484 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 225147 2024-02-10T08:30:30.484 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.484 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:30:30.484 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.484 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:30:30.484 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:41.810244+0000", 2024-02-10T08:30:30.484 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:30:30.484 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.484 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.484 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:30:30.484 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:41.810244+0000", 2024-02-10T08:30:30.484 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:30:30.485 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.485 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.485 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:30:30.485 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:41.810242+0000", 2024-02-10T08:30:30.485 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.233e-06 2024-02-10T08:30:30.485 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.485 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.485 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:30:30.485 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:41.810249+0000", 2024-02-10T08:30:30.485 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3288000000000001e-05 2024-02-10T08:30:30.485 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.485 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.485 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:30:30.485 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:41.810263+0000", 2024-02-10T08:30:30.486 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7739999999999999e-06 2024-02-10T08:30:30.486 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.486 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.486 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:30:30.486 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:41.810270+0000", 2024-02-10T08:30:30.486 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8687000000000003e-05 2024-02-10T08:30:30.486 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.486 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.486 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:30:30.486 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:41.810318+0000", 2024-02-10T08:30:30.486 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0659999999999998e-06 2024-02-10T08:30:30.486 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.486 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.486 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:30:30.486 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:41.810325+0000", 2024-02-10T08:30:30.487 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.94033328100000002 2024-02-10T08:30:30.487 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.487 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.487 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:30:30.487 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:42.750659+0000", 2024-02-10T08:30:30.487 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8131000000000003e-05 2024-02-10T08:30:30.487 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.487 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.487 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:30:30.487 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:42.750717+0000", 2024-02-10T08:30:30.487 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1110000000000002e-05 2024-02-10T08:30:30.487 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.487 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.487 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4,7", 2024-02-10T08:30:30.487 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:42.750788+0000", 2024-02-10T08:30:30.488 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0021000490000000001 2024-02-10T08:30:30.488 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.488 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.488 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:30:30.488 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:42.752888+0000", 2024-02-10T08:30:30.488 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0054010200000000003 2024-02-10T08:30:30.488 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.488 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.488 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:30:30.488 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:42.758289+0000", 2024-02-10T08:30:30.488 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7156999999999997e-05 2024-02-10T08:30:30.488 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.488 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.488 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:30:30.489 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:42.758326+0000", 2024-02-10T08:30:30.489 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9830000000000002e-05 2024-02-10T08:30:30.489 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.489 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.489 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:30:30.489 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:42.758376+0000", 2024-02-10T08:30:30.489 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1470999999999997e-05 2024-02-10T08:30:30.489 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.489 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.489 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:30:30.489 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:42.758407+0000", 2024-02-10T08:30:30.489 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.94816354800000002 2024-02-10T08:30:30.489 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:30:30.489 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:30:30.489 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:30:30.490 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.490 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.490 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14964.0:225156 8.e 8:72ea34db:::benchmark_data_smithi018_103312_object100724:head [delete] snapc 0=[] ondisk+write+known_if_redirected e239)", 2024-02-10T08:30:30.490 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:27:41.810636+0000", 2024-02-10T08:30:30.490 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 168.56937060499999, 2024-02-10T08:30:30.490 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.94797953999999995, 2024-02-10T08:30:30.490 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:30:30.490 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:30:30.490 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:30:30.490 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14964", 2024-02-10T08:30:30.490 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/3173131962", 2024-02-10T08:30:30.490 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 225156 2024-02-10T08:30:30.490 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.490 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:30:30.490 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.491 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:30:30.491 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:41.810636+0000", 2024-02-10T08:30:30.491 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:30:30.491 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.491 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.491 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:30:30.491 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:41.810636+0000", 2024-02-10T08:30:30.491 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:30:30.491 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.491 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.491 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:30:30.491 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:41.810636+0000", 2024-02-10T08:30:30.491 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.4049999999999998e-06 2024-02-10T08:30:30.491 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.491 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.492 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:30:30.492 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:41.810638+0000", 2024-02-10T08:30:30.492 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3400000000000002e-06 2024-02-10T08:30:30.492 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.492 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.492 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:30:30.492 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:41.810641+0000", 2024-02-10T08:30:30.492 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.599e-06 2024-02-10T08:30:30.492 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.492 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.492 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:30:30.492 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:41.810644+0000", 2024-02-10T08:30:30.492 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00021018 2024-02-10T08:30:30.492 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.493 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.493 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:30:30.493 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:41.810854+0000", 2024-02-10T08:30:30.493 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4999999999999996e-06 2024-02-10T08:30:30.493 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.493 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.493 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:30:30.493 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:41.810861+0000", 2024-02-10T08:30:30.493 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.940934822 2024-02-10T08:30:30.493 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.493 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.493 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:30:30.493 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:42.751795+0000", 2024-02-10T08:30:30.493 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0098999999999993e-05 2024-02-10T08:30:30.493 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.493 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.494 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:30:30.494 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:42.751876+0000", 2024-02-10T08:30:30.494 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7089999999999996e-05 2024-02-10T08:30:30.494 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.494 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.494 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4,7", 2024-02-10T08:30:30.494 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:42.751943+0000", 2024-02-10T08:30:30.494 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010658810000000001 2024-02-10T08:30:30.494 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.494 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.494 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:30:30.494 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:42.753009+0000", 2024-02-10T08:30:30.494 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0054765029999999998 2024-02-10T08:30:30.494 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.494 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.494 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:30:30.495 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:42.758485+0000", 2024-02-10T08:30:30.495 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3057999999999999e-05 2024-02-10T08:30:30.495 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.495 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.495 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:30:30.495 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:42.758538+0000", 2024-02-10T08:30:30.495 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2664999999999999e-05 2024-02-10T08:30:30.495 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.495 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.495 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:30:30.495 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:42.758581+0000", 2024-02-10T08:30:30.495 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4873999999999998e-05 2024-02-10T08:30:30.495 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.496 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.496 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:30:30.496 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:42.758616+0000", 2024-02-10T08:30:30.496 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.94797953999999995 2024-02-10T08:30:30.496 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:30:30.496 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:30:30.496 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:30:30.496 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.496 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.496 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14964.0:225164 8.e 8:75557ac5:::benchmark_data_smithi018_103312_object100732:head [delete] snapc 0=[] ondisk+write+known_if_redirected e239)", 2024-02-10T08:30:30.496 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:27:41.821184+0000", 2024-02-10T08:30:30.496 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 168.55882278000001, 2024-02-10T08:30:30.496 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.93762354999999997, 2024-02-10T08:30:30.496 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:30:30.496 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:30:30.497 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:30:30.497 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14964", 2024-02-10T08:30:30.497 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/3173131962", 2024-02-10T08:30:30.497 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 225164 2024-02-10T08:30:30.497 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.497 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:30:30.497 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.497 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:30:30.497 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:41.821184+0000", 2024-02-10T08:30:30.497 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:30:30.497 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.497 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.497 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:30:30.497 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:41.821184+0000", 2024-02-10T08:30:30.498 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:30:30.498 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.498 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.498 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:30:30.498 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:41.821183+0000", 2024-02-10T08:30:30.498 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.02e-06 2024-02-10T08:30:30.498 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.498 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.498 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:30:30.498 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:41.821189+0000", 2024-02-10T08:30:30.498 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3589999999999997e-06 2024-02-10T08:30:30.498 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.498 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.498 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:30:30.498 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:41.821198+0000", 2024-02-10T08:30:30.499 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6069999999999998e-06 2024-02-10T08:30:30.499 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.499 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.499 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:30:30.499 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:41.821204+0000", 2024-02-10T08:30:30.499 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9514000000000001e-05 2024-02-10T08:30:30.499 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.499 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.499 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:30:30.499 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:41.821243+0000", 2024-02-10T08:30:30.499 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7239999999999992e-06 2024-02-10T08:30:30.499 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.499 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.499 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:30:30.499 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:41.821251+0000", 2024-02-10T08:30:30.500 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.93177710999999996 2024-02-10T08:30:30.500 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.500 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.500 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:30:30.500 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:42.753028+0000", 2024-02-10T08:30:30.500 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000101141 2024-02-10T08:30:30.500 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.500 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.500 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:30:30.500 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:42.753129+0000", 2024-02-10T08:30:30.500 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010703 2024-02-10T08:30:30.500 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.501 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.501 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4,7", 2024-02-10T08:30:30.501 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:42.753236+0000", 2024-02-10T08:30:30.501 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0051840999999999996 2024-02-10T08:30:30.501 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.501 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.501 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:30:30.501 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:42.758421+0000", 2024-02-10T08:30:30.501 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00026241699999999998 2024-02-10T08:30:30.501 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.501 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.501 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:30:30.501 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:42.758683+0000", 2024-02-10T08:30:30.501 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6461000000000001e-05 2024-02-10T08:30:30.501 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.501 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.501 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:30:30.502 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:42.758729+0000", 2024-02-10T08:30:30.502 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9567999999999998e-05 2024-02-10T08:30:30.502 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.502 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.502 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:30:30.502 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:42.758769+0000", 2024-02-10T08:30:30.502 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8442000000000002e-05 2024-02-10T08:30:30.502 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.502 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.502 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:30:30.502 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:42.758807+0000", 2024-02-10T08:30:30.502 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.93762354999999997 2024-02-10T08:30:30.502 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:30:30.502 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:30:30.502 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:30:30.502 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.502 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.503 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14964.0:225166 8.e 8:7460d721:::benchmark_data_smithi018_103312_object100734:head [delete] snapc 0=[] ondisk+write+known_if_redirected e239)", 2024-02-10T08:30:30.503 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:27:41.827315+0000", 2024-02-10T08:30:30.503 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 168.552691549, 2024-02-10T08:30:30.503 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.93496133999999997, 2024-02-10T08:30:30.503 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:30:30.503 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:30:30.503 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:30:30.503 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14964", 2024-02-10T08:30:30.503 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/3173131962", 2024-02-10T08:30:30.503 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 225166 2024-02-10T08:30:30.503 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.503 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:30:30.503 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.503 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:30:30.504 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:41.827315+0000", 2024-02-10T08:30:30.504 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:30:30.504 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.504 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.504 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:30:30.504 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:41.827315+0000", 2024-02-10T08:30:30.504 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:30:30.504 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.504 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.504 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:30:30.504 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:41.827314+0000", 2024-02-10T08:30:30.504 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2869999999999999e-06 2024-02-10T08:30:30.504 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.504 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.505 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:30:30.505 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:41.827321+0000", 2024-02-10T08:30:30.505 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6552999999999999e-05 2024-02-10T08:30:30.505 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.505 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.505 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:30:30.505 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:41.827337+0000", 2024-02-10T08:30:30.505 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.605e-06 2024-02-10T08:30:30.505 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.505 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.505 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:30:30.505 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:41.827345+0000", 2024-02-10T08:30:30.505 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4116999999999995e-05 2024-02-10T08:30:30.505 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.505 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.505 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:30:30.506 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:41.827419+0000", 2024-02-10T08:30:30.506 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1440000000000002e-06 2024-02-10T08:30:30.506 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.506 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.506 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:30:30.506 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:41.827424+0000", 2024-02-10T08:30:30.506 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.92753187000000004 2024-02-10T08:30:30.506 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.506 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.506 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:30:30.506 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:42.754956+0000", 2024-02-10T08:30:30.506 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011448800000000001 2024-02-10T08:30:30.506 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.506 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.506 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:30:30.506 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:42.755071+0000", 2024-02-10T08:30:30.507 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013994300000000001 2024-02-10T08:30:30.507 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.507 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.507 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4,7", 2024-02-10T08:30:30.507 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:42.755211+0000", 2024-02-10T08:30:30.507 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0034178160000000002 2024-02-10T08:30:30.507 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.507 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.507 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:30:30.507 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:42.758628+0000", 2024-02-10T08:30:30.507 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0035226799999999998 2024-02-10T08:30:30.507 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.507 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.507 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:30:30.507 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:42.762151+0000", 2024-02-10T08:30:30.507 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2381e-05 2024-02-10T08:30:30.508 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.508 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.508 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:30:30.508 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:42.762184+0000", 2024-02-10T08:30:30.508 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0309999999999998e-05 2024-02-10T08:30:30.508 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.508 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.508 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:30:30.508 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:42.762234+0000", 2024-02-10T08:30:30.508 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2645999999999998e-05 2024-02-10T08:30:30.508 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.508 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.508 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:30:30.508 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:42.762276+0000", 2024-02-10T08:30:30.508 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.93496133999999997 2024-02-10T08:30:30.508 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:30:30.509 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:30:30.509 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:30:30.509 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.509 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.509 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14964.0:225173 8.e 8:7c52c374:::benchmark_data_smithi018_103312_object100741:head [delete] snapc 0=[] ondisk+write+known_if_redirected e239)", 2024-02-10T08:30:30.509 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:27:41.832181+0000", 2024-02-10T08:30:30.509 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 168.547826168, 2024-02-10T08:30:30.509 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.93182711500000004, 2024-02-10T08:30:30.509 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:30:30.509 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:30:30.509 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:30:30.509 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14964", 2024-02-10T08:30:30.509 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/3173131962", 2024-02-10T08:30:30.509 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 225173 2024-02-10T08:30:30.509 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.509 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:30:30.510 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.510 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:30:30.510 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:41.832181+0000", 2024-02-10T08:30:30.510 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:30:30.510 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.510 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.510 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:30:30.510 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:41.832181+0000", 2024-02-10T08:30:30.510 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:30:30.510 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.510 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.510 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:30:30.510 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:41.832179+0000", 2024-02-10T08:30:30.511 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5629999999999999e-06 2024-02-10T08:30:30.511 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.511 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.511 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:30:30.511 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:41.832185+0000", 2024-02-10T08:30:30.511 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7970000000000001e-06 2024-02-10T08:30:30.511 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.511 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.511 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:30:30.511 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:41.832193+0000", 2024-02-10T08:30:30.511 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0909999999999998e-06 2024-02-10T08:30:30.511 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.511 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.511 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:30:30.512 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:41.832199+0000", 2024-02-10T08:30:30.512 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8170000000000002e-05 2024-02-10T08:30:30.512 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.512 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.512 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:30:30.512 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:41.832237+0000", 2024-02-10T08:30:30.512 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0890000000000002e-06 2024-02-10T08:30:30.512 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.512 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.512 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:30:30.512 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:41.832244+0000", 2024-02-10T08:30:30.512 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.92455965100000004 2024-02-10T08:30:30.513 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.513 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.513 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:30:30.513 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:42.756804+0000", 2024-02-10T08:30:30.513 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011343700000000001 2024-02-10T08:30:30.513 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.513 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.513 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:30:30.513 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:42.756917+0000", 2024-02-10T08:30:30.513 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000155458 2024-02-10T08:30:30.513 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.513 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.513 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4,7", 2024-02-10T08:30:30.513 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:42.757073+0000", 2024-02-10T08:30:30.513 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0015618400000000001 2024-02-10T08:30:30.514 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.514 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.514 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:30:30.514 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:42.758634+0000", 2024-02-10T08:30:30.514 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0052264649999999996 2024-02-10T08:30:30.514 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.514 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.514 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:30:30.514 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:42.763861+0000", 2024-02-10T08:30:30.514 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3515000000000003e-05 2024-02-10T08:30:30.514 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.514 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.514 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:30:30.514 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:42.763934+0000", 2024-02-10T08:30:30.514 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1263999999999997e-05 2024-02-10T08:30:30.515 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.515 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.515 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:30:30.515 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:42.763966+0000", 2024-02-10T08:30:30.515 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1884000000000001e-05 2024-02-10T08:30:30.515 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.515 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.515 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:30:30.515 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:42.764008+0000", 2024-02-10T08:30:30.515 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.93182711500000004 2024-02-10T08:30:30.515 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:30:30.515 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:30:30.515 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:30:30.515 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.515 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.516 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14964.0:225186 8.e 8:7c35897a:::benchmark_data_smithi018_103312_object100754:head [delete] snapc 0=[] ondisk+write+known_if_redirected e239)", 2024-02-10T08:30:30.516 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:27:41.845918+0000", 2024-02-10T08:30:30.516 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 168.53408882599999, 2024-02-10T08:30:30.516 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.925693608, 2024-02-10T08:30:30.516 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:30:30.516 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:30:30.516 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:30:30.516 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14964", 2024-02-10T08:30:30.516 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/3173131962", 2024-02-10T08:30:30.516 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 225186 2024-02-10T08:30:30.516 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.516 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:30:30.516 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.516 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:30:30.516 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:41.845918+0000", 2024-02-10T08:30:30.517 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:30:30.517 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.517 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.517 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:30:30.517 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:41.845918+0000", 2024-02-10T08:30:30.517 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999981 2024-02-10T08:30:30.517 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.517 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.517 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:30:30.517 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:41.845916+0000", 2024-02-10T08:30:30.517 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4810000000000006e-06 2024-02-10T08:30:30.517 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.517 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.517 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:30:30.517 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:41.845924+0000", 2024-02-10T08:30:30.518 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5841e-05 2024-02-10T08:30:30.518 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.518 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.518 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:30:30.518 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:41.845940+0000", 2024-02-10T08:30:30.518 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.391e-06 2024-02-10T08:30:30.518 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.518 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.518 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:30:30.518 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:41.845947+0000", 2024-02-10T08:30:30.518 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9370999999999999e-05 2024-02-10T08:30:30.518 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.518 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.518 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:30:30.519 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:41.845997+0000", 2024-02-10T08:30:30.519 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1088e-05 2024-02-10T08:30:30.519 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.519 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.519 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:30:30.519 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:41.846008+0000", 2024-02-10T08:30:30.519 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.91284695699999996 2024-02-10T08:30:30.519 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.519 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.519 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:30:30.519 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:42.758855+0000", 2024-02-10T08:30:30.519 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6528999999999999e-05 2024-02-10T08:30:30.519 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.519 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.519 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:30:30.520 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:42.758931+0000", 2024-02-10T08:30:30.520 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0669999999999998e-05 2024-02-10T08:30:30.520 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.520 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.520 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4,7", 2024-02-10T08:30:30.520 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:42.759012+0000", 2024-02-10T08:30:30.520 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0089976380000000005 2024-02-10T08:30:30.520 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.520 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.520 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:30:30.520 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:42.768010+0000", 2024-02-10T08:30:30.520 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0034091099999999999 2024-02-10T08:30:30.520 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.520 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.521 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:30:30.521 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:42.771419+0000", 2024-02-10T08:30:30.521 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000107038 2024-02-10T08:30:30.521 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.521 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.521 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:30:30.521 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:42.771526+0000", 2024-02-10T08:30:30.521 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7778000000000002e-05 2024-02-10T08:30:30.521 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.521 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.521 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:30:30.521 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:42.771574+0000", 2024-02-10T08:30:30.521 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7771999999999997e-05 2024-02-10T08:30:30.521 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:30:30.521 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:30:30.521 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:30:30.522 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:27:42.771611+0000", 2024-02-10T08:30:30.522 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.925693608 2024-02-10T08:30:30.522 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:30:30.522 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:30:30.522 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:30:30.522 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:30:30.522 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:30:30.522 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-02-10T08:30:30.522 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:30:30.523 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:30:28.883126+0000 mgr.y (mgr.14505) 518 : cluster [DBG] pgmap v625: 168 pgs: 1 active+remapped+backfilling, 1 unknown, 166 active+clean; 6.2 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 873 B/s rd, 0 B/s wr, 1.09k op/s; 12082/303486 objects misplaced (3.981%); 633 KiB/s, 9 objects/s recovering 2024-02-10T08:30:30.523 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:30:29.373247+0000 osd.6 (osd.6) 149 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:30:30.523 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:30:29.373299+0000 osd.6 (osd.6) 150 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:30:30.523 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:30:28.883126+0000 mgr.y (mgr.14505) 518 : cluster [DBG] pgmap v625: 168 pgs: 1 active+remapped+backfilling, 1 unknown, 166 active+clean; 6.2 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 873 B/s rd, 0 B/s wr, 1.09k op/s; 12082/303486 objects misplaced (3.981%); 633 KiB/s, 9 objects/s recovering 2024-02-10T08:30:30.523 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:30:29.373247+0000 osd.6 (osd.6) 149 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:30:30.523 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:30:29.373299+0000 osd.6 (osd.6) 150 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:30:30.523 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:30:30.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:30:28.883126+0000 mgr.y (mgr.14505) 518 : cluster [DBG] pgmap v625: 168 pgs: 1 active+remapped+backfilling, 1 unknown, 166 active+clean; 6.2 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 873 B/s rd, 0 B/s wr, 1.09k op/s; 12082/303486 objects misplaced (3.981%); 633 KiB/s, 9 objects/s recovering 2024-02-10T08:30:30.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:30:29.373247+0000 osd.6 (osd.6) 149 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:30:30.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:30:29.373299+0000 osd.6 (osd.6) 150 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:30:30.581 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:30.616 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:30:30.621 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:30.622 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:30:30.722 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:30:30.790 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:30.828 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:30:30.839 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:30.839 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:30:30.940 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:30:30.993 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:31.018 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:30:31.023 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:31.024 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:30:31.115 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:30:30.095170+0000 mon.a (mon.0) 1383 : cluster [DBG] osdmap e291: 8 total, 8 up, 8 in 2024-02-10T08:30:31.124 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:30:31.178 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:31.218 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:30:31.234 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:31.234 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:30:31.336 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:30:31.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:30:30.095170+0000 mon.a (mon.0) 1383 : cluster [DBG] osdmap e291: 8 total, 8 up, 8 in 2024-02-10T08:30:31.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:30:30.095170+0000 mon.a (mon.0) 1383 : cluster [DBG] osdmap e291: 8 total, 8 up, 8 in 2024-02-10T08:30:31.408 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:31.436 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:30:31.445 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:31.446 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:30:31.547 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:30:31.602 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:31.635 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:30:31.641 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:31.641 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:30:31.742 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:30:31.805 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:31.975 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:30:31.981 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:31.981 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:30:32.013 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.3 dump_ops_in_flight 2024-02-10T08:30:32.082 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:30:32.139 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:32.166 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:30:32.172 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:32.173 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:30:32.274 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:30:32.330 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:32.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:30:30.886361+0000 mgr.y (mgr.14505) 519 : cluster [DBG] pgmap v627: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 6.1 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 965 op/s; 12082/302418 objects misplaced (3.995%); 618 KiB/s, 9 objects/s recovering 2024-02-10T08:30:32.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:30:31.671813+0000 mon.a (mon.0) 1384 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:30:32.407 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:30:30.886361+0000 mgr.y (mgr.14505) 519 : cluster [DBG] pgmap v627: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 6.1 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 965 op/s; 12082/302418 objects misplaced (3.995%); 618 KiB/s, 9 objects/s recovering 2024-02-10T08:30:32.407 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:30:31.671813+0000 mon.a (mon.0) 1384 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:30:32.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:30:30.886361+0000 mgr.y (mgr.14505) 519 : cluster [DBG] pgmap v627: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 6.1 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 965 op/s; 12082/302418 objects misplaced (3.995%); 618 KiB/s, 9 objects/s recovering 2024-02-10T08:30:32.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:30:31.671813+0000 mon.a (mon.0) 1384 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:30:32.603 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:30:32.609 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:32.609 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:30:32.710 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:30:32.774 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:32.800 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:30:32.806 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:32.807 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:30:32.907 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:30:32.956 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:32.992 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:30:33.001 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:33.002 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:30:33.102 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:30:33.170 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:33.208 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:30:33.214 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:33.215 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:30:33.315 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:30:33.363 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:33.411 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:30:33.419 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:33.419 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:30:33.520 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:30:33.583 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:33.723 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:30:33.732 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:33.732 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:30:33.833 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:30:33.871 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:33.901 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:30:33.906 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:33.906 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:30:34.007 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:30:34.061 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:34.095 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:30:34.102 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:30:34.107 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:34.107 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:30:34.153 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is set 2024-02-10T08:30:34.172 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:30:32.887140+0000 mgr.y (mgr.14505) 520 : cluster [DBG] pgmap v628: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 5.9 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1.22k op/s; 11332/290196 objects misplaced (3.905%); 947 KiB/s, 14 objects/s recovering 2024-02-10T08:30:34.172 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:30:34.041751+0000 mon.c (mon.2) 67 : audit [INF] from='client.? 172.21.15.18:0/794403650' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:30:34.172 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:30:34.042183+0000 mon.a (mon.0) 1385 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:30:34.208 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:30:34.282 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:34.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:30:32.887140+0000 mgr.y (mgr.14505) 520 : cluster [DBG] pgmap v628: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 5.9 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1.22k op/s; 11332/290196 objects misplaced (3.905%); 947 KiB/s, 14 objects/s recovering 2024-02-10T08:30:34.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:30:34.041751+0000 mon.c (mon.2) 67 : audit [INF] from='client.? 172.21.15.18:0/794403650' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:30:34.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:30:34.042183+0000 mon.a (mon.0) 1385 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:30:34.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:30:32.887140+0000 mgr.y (mgr.14505) 520 : cluster [DBG] pgmap v628: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 5.9 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1.22k op/s; 11332/290196 objects misplaced (3.905%); 947 KiB/s, 14 objects/s recovering 2024-02-10T08:30:34.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:30:34.041751+0000 mon.c (mon.2) 67 : audit [INF] from='client.? 172.21.15.18:0/794403650' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:30:34.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:30:34.042183+0000 mon.a (mon.0) 1385 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:30:35.153 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:30:35.155 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:35.156 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:30:35.256 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:30:35.301 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:35.343 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:30:35.345 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:35.346 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:30:35.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:30:34.125927+0000 mon.a (mon.0) 1386 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:30:35.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:30:34.134834+0000 mon.a (mon.0) 1387 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-10T08:30:35.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:30:34.134897+0000 mon.a (mon.0) 1388 : cluster [DBG] osdmap e292: 8 total, 8 up, 8 in 2024-02-10T08:30:35.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:30:34.125927+0000 mon.a (mon.0) 1386 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:30:35.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:30:34.134834+0000 mon.a (mon.0) 1387 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-10T08:30:35.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:30:34.134897+0000 mon.a (mon.0) 1388 : cluster [DBG] osdmap e292: 8 total, 8 up, 8 in 2024-02-10T08:30:35.447 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:30:35.510 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:35.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:30:34.125927+0000 mon.a (mon.0) 1386 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:30:35.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:30:34.134834+0000 mon.a (mon.0) 1387 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-10T08:30:35.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:30:34.134897+0000 mon.a (mon.0) 1388 : cluster [DBG] osdmap e292: 8 total, 8 up, 8 in 2024-02-10T08:30:35.654 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:30:35.659 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:35.659 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:30:35.760 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:30:35.823 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:35.848 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:30:35.851 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:35.852 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:30:35.953 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:30:36.002 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:36.036 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:30:36.042 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:36.043 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:30:36.143 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:30:36.191 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:36.221 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:30:36.226 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:36.227 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:30:36.327 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:30:36.391 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:36.447 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:30:34.887563+0000 mgr.y (mgr.14505) 521 : cluster [DBG] pgmap v630: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 5.8 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.32k op/s; 11332/287025 objects misplaced (3.948%); 927 KiB/s, 14 objects/s recovering 2024-02-10T08:30:36.448 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:30:35.180638+0000 osd.1 (osd.1) 167 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:30:36.448 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:30:35.180688+0000 osd.1 (osd.1) 168 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:30:36.448 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:30:36.184306+0000 mon.a (mon.0) 1389 : cluster [DBG] osdmap e293: 8 total, 8 up, 8 in 2024-02-10T08:30:36.450 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:30:34.887563+0000 mgr.y (mgr.14505) 521 : cluster [DBG] pgmap v630: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 5.8 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.32k op/s; 11332/287025 objects misplaced (3.948%); 927 KiB/s, 14 objects/s recovering 2024-02-10T08:30:36.450 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:30:35.180638+0000 osd.1 (osd.1) 167 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:30:36.450 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:30:35.180688+0000 osd.1 (osd.1) 168 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:30:36.450 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:30:36.184306+0000 mon.a (mon.0) 1389 : cluster [DBG] osdmap e293: 8 total, 8 up, 8 in 2024-02-10T08:30:36.450 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:30:36.463 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:36.463 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:30:36.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:30:34.887563+0000 mgr.y (mgr.14505) 521 : cluster [DBG] pgmap v630: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 5.8 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.32k op/s; 11332/287025 objects misplaced (3.948%); 927 KiB/s, 14 objects/s recovering 2024-02-10T08:30:36.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:30:35.180638+0000 osd.1 (osd.1) 167 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:30:36.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:30:35.180688+0000 osd.1 (osd.1) 168 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:30:36.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:30:36.184306+0000 mon.a (mon.0) 1389 : cluster [DBG] osdmap e293: 8 total, 8 up, 8 in 2024-02-10T08:30:36.520 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:30:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:30:36] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:30:36.565 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:30:36.612 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:36.640 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:30:36.643 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:36.644 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:30:36.744 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:30:36.794 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:36.904 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:30:36.912 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:30:36.921 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:36.922 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:30:37.023 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:30:37.083 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:37.140 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:30:37.148 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:37.149 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:30:37.249 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:30:37.299 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:37.332 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:30:37.336 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:37.336 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:30:37.405 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:30:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:30:37] "GET /metrics HTTP/1.1" 200 176252 "" "Prometheus/2.33.4" 2024-02-10T08:30:37.437 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:30:37.503 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:37.533 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:30:37.538 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:37.539 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:30:37.640 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:30:37.720 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:37.775 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:30:37.780 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:37.781 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:30:37.881 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:30:37.945 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:37.985 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:30:37.988 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:37.988 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:30:38.089 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:30:38.121 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:30:38.127 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-02-10T08:30:38.152 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:38.220 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:30:36.887983+0000 mgr.y (mgr.14505) 522 : cluster [DBG] pgmap v632: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 5.8 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 753 B/s rd, 0 B/s wr, 804 op/s; 11332/286032 objects misplaced (3.962%); 546 KiB/s, 8 objects/s recovering 2024-02-10T08:30:38.220 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:30:37.073832+0000 osd.0 (osd.0) 144 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:30:38.220 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:30:37.073884+0000 osd.0 (osd.0) 145 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:30:38.220 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:30:37.220085+0000 mon.a (mon.0) 1390 : cluster [DBG] osdmap e294: 8 total, 8 up, 8 in 2024-02-10T08:30:38.249 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:30:38.253 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:38.254 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:30:38.354 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:30:38.396 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:30:36.887983+0000 mgr.y (mgr.14505) 522 : cluster [DBG] pgmap v632: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 5.8 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 753 B/s rd, 0 B/s wr, 804 op/s; 11332/286032 objects misplaced (3.962%); 546 KiB/s, 8 objects/s recovering 2024-02-10T08:30:38.397 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:30:37.073832+0000 osd.0 (osd.0) 144 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:30:38.397 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:30:37.073884+0000 osd.0 (osd.0) 145 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:30:38.397 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:30:37.220085+0000 mon.a (mon.0) 1390 : cluster [DBG] osdmap e294: 8 total, 8 up, 8 in 2024-02-10T08:30:38.397 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:30:36.887983+0000 mgr.y (mgr.14505) 522 : cluster [DBG] pgmap v632: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 5.8 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 753 B/s rd, 0 B/s wr, 804 op/s; 11332/286032 objects misplaced (3.962%); 546 KiB/s, 8 objects/s recovering 2024-02-10T08:30:38.397 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:30:37.073832+0000 osd.0 (osd.0) 144 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:30:38.397 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:30:37.073884+0000 osd.0 (osd.0) 145 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:30:38.397 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:30:37.220085+0000 mon.a (mon.0) 1390 : cluster [DBG] osdmap e294: 8 total, 8 up, 8 in 2024-02-10T08:30:38.404 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:38.474 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:30:38.481 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:38.481 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:30:38.547 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:30:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:30:38.582 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:30:38.633 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:38.932 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd set nodeep-scrub 2024-02-10T08:30:39.500 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:30:39.504 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:30:38.098450+0000 mgr.y (mgr.14505) 523 : audit [DBG] from='client.15303 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-10T08:30:39.504 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:30:38.327556+0000 mgr.y (mgr.14505) 524 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:30:39.505 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:39.505 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:30:39.511 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:30:38.098450+0000 mgr.y (mgr.14505) 523 : audit [DBG] from='client.15303 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-10T08:30:39.512 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:30:38.327556+0000 mgr.y (mgr.14505) 524 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:30:39.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:30:38.098450+0000 mgr.y (mgr.14505) 523 : audit [DBG] from='client.15303 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-10T08:30:39.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:30:38.327556+0000 mgr.y (mgr.14505) 524 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:30:39.606 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:30:39.660 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:40.119 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:30:40.129 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:40.129 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:30:40.230 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:30:40.273 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:40.294 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-02-10T08:30:40.294 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:30:40.308 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:30:40.319 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:40.319 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:30:40.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:30:38.888791+0000 mgr.y (mgr.14505) 525 : cluster [DBG] pgmap v634: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 5.5 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 1.08k op/s; 10586/270675 objects misplaced (3.911%); 618 KiB/s, 9 objects/s recovering 2024-02-10T08:30:40.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:30:39.355176+0000 osd.7 (osd.7) 175 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:30:40.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:30:39.355232+0000 osd.7 (osd.7) 176 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:30:40.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:30:40.121471+0000 mon.c (mon.2) 68 : audit [DBG] from='client.? 172.21.15.18:0/1832829015' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:30:40.407 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:30:38.888791+0000 mgr.y (mgr.14505) 525 : cluster [DBG] pgmap v634: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 5.5 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 1.08k op/s; 10586/270675 objects misplaced (3.911%); 618 KiB/s, 9 objects/s recovering 2024-02-10T08:30:40.407 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:30:39.355176+0000 osd.7 (osd.7) 175 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:30:40.407 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:30:39.355232+0000 osd.7 (osd.7) 176 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:30:40.407 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:30:40.121471+0000 mon.c (mon.2) 68 : audit [DBG] from='client.? 172.21.15.18:0/1832829015' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:30:40.420 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:30:40.476 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:40.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:30:38.888791+0000 mgr.y (mgr.14505) 525 : cluster [DBG] pgmap v634: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 5.5 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 1.08k op/s; 10586/270675 objects misplaced (3.911%); 618 KiB/s, 9 objects/s recovering 2024-02-10T08:30:40.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:30:39.355176+0000 osd.7 (osd.7) 175 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:30:40.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:30:39.355232+0000 osd.7 (osd.7) 176 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:30:40.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:30:40.121471+0000 mon.c (mon.2) 68 : audit [DBG] from='client.? 172.21.15.18:0/1832829015' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:30:40.842 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:30:40.850 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:40.851 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:30:40.885 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":633,"stamp":"2024-02-10T08:30:37.217832+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6235821750,"num_objects":95344,"num_object_clones":0,"num_object_copies":286032,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":11332,"num_objects_unfound":0,"num_objects_dirty":95344,"num_whiteouts":0,"num_read":1929,"num_read_kb":1681,"num_write":149036,"num_write_kb":7791146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":681,"num_bytes_recovered":35198612,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74862,"ondisk_log_size":74862,"up":504,"acting":504,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":506,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":20846360,"kb_used_data":18414360,"kb_used_omap":0,"kb_used_meta":2431615,"kb_avail":729114856,"statfs":{"total":767960285184,"available":746613612544,"internally_reserved":0,"allocated":18856304640,"data_stored":18853147276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":972,"internal_metadata":2489973812},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,4,3,14,9,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-357957632,"num_objects":-5462,"num_object_clones":0,"num_object_copies":-16386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":-750,"num_objects_unfound":0,"num_objects_dirty":-5462,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5462,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":58,"num_bytes_recovered":3801088,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.331686"},"pg_stats":[{"pgid":"6.33","version":"0'0","reported_seq":179,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.085366+0000","last_change":"2024-02-10T08:30:26.080816+0000","last_active":"2024-02-10T08:30:26.085366+0000","last_peered":"2024-02-10T08:30:26.085366+0000","last_clean":"2024-02-10T08:30:26.085366+0000","last_became_active":"2024-02-10T08:30:26.080326+0000","last_became_peered":"2024-02-10T08:30:26.080326+0000","last_unstale":"2024-02-10T08:30:26.085366+0000","last_undegraded":"2024-02-10T08:30:26.085366+0000","last_fullsized":"2024-02-10T08:30:26.085366+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:34.502781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:34.502781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2],"acting":[5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":283,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-10T08:30:30.112554+0000","last_change":"2024-02-10T08:30:26.067603+0000","last_active":"2024-02-10T08:30:30.112554+0000","last_peered":"2024-02-10T08:30:30.112554+0000","last_clean":"2024-02-10T08:30:30.112554+0000","last_became_active":"2024-02-10T08:30:26.067019+0000","last_became_peered":"2024-02-10T08:30:26.067019+0000","last_unstale":"2024-02-10T08:30:30.112554+0000","last_undegraded":"2024-02-10T08:30:30.112554+0000","last_fullsized":"2024-02-10T08:30:30.112554+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:12.421034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:27.276490+0000","last_clean_scrub_stamp":"2024-02-10T08:29:12.421034+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"111'10","reported_seq":460,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-10T08:30:30.117955+0000","last_change":"2024-02-10T08:28:29.196174+0000","last_active":"2024-02-10T08:30:30.117955+0000","last_peered":"2024-02-10T08:30:30.117955+0000","last_clean":"2024-02-10T08:30:30.117955+0000","last_became_active":"2024-02-10T08:20:46.399193+0000","last_became_peered":"2024-02-10T08:20:46.399193+0000","last_unstale":"2024-02-10T08:30:30.117955+0000","last_undegraded":"2024-02-10T08:30:30.117955+0000","last_fullsized":"2024-02-10T08:30:30.117955+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'10","last_scrub_stamp":"2024-02-10T08:28:29.196109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:28:29.196109+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"225'27","reported_seq":305,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.057706+0000","last_change":"2024-02-10T08:29:07.059712+0000","last_active":"2024-02-10T08:30:26.057706+0000","last_peered":"2024-02-10T08:30:26.057706+0000","last_clean":"2024-02-10T08:30:26.057706+0000","last_became_active":"2024-02-10T08:16:55.204597+0000","last_became_peered":"2024-02-10T08:16:55.204597+0000","last_unstale":"2024-02-10T08:30:26.057706+0000","last_undegraded":"2024-02-10T08:30:26.057706+0000","last_fullsized":"2024-02-10T08:30:26.057706+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'27","last_scrub_stamp":"2024-02-10T08:29:07.059646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:29:07.059646+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":279,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.059321+0000","last_change":"2024-02-10T08:29:24.555085+0000","last_active":"2024-02-10T08:30:26.059321+0000","last_peered":"2024-02-10T08:30:26.059321+0000","last_clean":"2024-02-10T08:30:26.059321+0000","last_became_active":"2024-02-10T08:23:15.074046+0000","last_became_peered":"2024-02-10T08:23:15.074046+0000","last_unstale":"2024-02-10T08:30:26.059321+0000","last_undegraded":"2024-02-10T08:30:26.059321+0000","last_fullsized":"2024-02-10T08:30:26.059321+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:24.554978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:29:24.554978+0000","last_clean_scrub_stamp":"2024-02-10T08:29:24.554978+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,6],"acting":[2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":285,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.055280+0000","last_change":"2024-02-10T08:30:24.063277+0000","last_active":"2024-02-10T08:30:26.055280+0000","last_peered":"2024-02-10T08:30:26.055280+0000","last_clean":"2024-02-10T08:30:26.055280+0000","last_became_active":"2024-02-10T08:30:24.062795+0000","last_became_peered":"2024-02-10T08:30:24.062795+0000","last_unstale":"2024-02-10T08:30:26.055280+0000","last_undegraded":"2024-02-10T08:30:26.055280+0000","last_fullsized":"2024-02-10T08:30:26.055280+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:30.227120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:20.392249+0000","last_clean_scrub_stamp":"2024-02-10T08:28:30.227120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"291'9385","reported_seq":9428,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-10T08:30:33.144607+0000","last_change":"2024-02-10T08:28:28.190785+0000","last_active":"2024-02-10T08:30:33.144607+0000","last_peered":"2024-02-10T08:30:33.144607+0000","last_clean":"2024-02-10T08:30:33.144607+0000","last_became_active":"2024-02-10T08:28:28.190416+0000","last_became_peered":"2024-02-10T08:28:28.190416+0000","last_unstale":"2024-02-10T08:30:33.144607+0000","last_undegraded":"2024-02-10T08:30:33.144607+0000","last_fullsized":"2024-02-10T08:30:33.144607+0000","mapping_epoch":256,"log_start":"265'2002","ondisk_log_start":"265'2002","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_clean_scrub_stamp":"2024-02-10T08:28:27.172648+0000","log_size":7383,"ondisk_log_size":7383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":397606912,"num_objects":6067,"num_object_clones":0,"num_object_copies":18201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6067,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9385,"num_write_kb":494464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"225'15","reported_seq":72,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.063082+0000","last_change":"2024-02-10T08:28:15.049130+0000","last_active":"2024-02-10T08:30:26.063082+0000","last_peered":"2024-02-10T08:30:26.063082+0000","last_clean":"2024-02-10T08:30:26.063082+0000","last_became_active":"2024-02-10T08:28:02.770508+0000","last_became_peered":"2024-02-10T08:28:02.770508+0000","last_unstale":"2024-02-10T08:30:26.063082+0000","last_undegraded":"2024-02-10T08:30:26.063082+0000","last_fullsized":"2024-02-10T08:30:26.063082+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'15","last_scrub_stamp":"2024-02-10T08:28:15.049059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:28:15.049059+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":275,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.084478+0000","last_change":"2024-02-10T08:25:42.035602+0000","last_active":"2024-02-10T08:30:26.084478+0000","last_peered":"2024-02-10T08:30:26.084478+0000","last_clean":"2024-02-10T08:30:26.084478+0000","last_became_active":"2024-02-10T08:20:46.407311+0000","last_became_peered":"2024-02-10T08:20:46.407311+0000","last_unstale":"2024-02-10T08:30:26.084478+0000","last_undegraded":"2024-02-10T08:30:26.084478+0000","last_fullsized":"2024-02-10T08:30:26.084478+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:25:42.035497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:21.523096+0000","last_clean_scrub_stamp":"2024-02-10T08:25:42.035497+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":298,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.058964+0000","last_change":"2024-02-10T08:28:25.266206+0000","last_active":"2024-02-10T08:30:26.058964+0000","last_peered":"2024-02-10T08:30:26.058964+0000","last_clean":"2024-02-10T08:30:26.058964+0000","last_became_active":"2024-02-10T08:28:02.781897+0000","last_became_peered":"2024-02-10T08:28:02.781897+0000","last_unstale":"2024-02-10T08:30:26.058964+0000","last_undegraded":"2024-02-10T08:30:26.058964+0000","last_fullsized":"2024-02-10T08:30:26.058964+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:25.266124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:28:25.266124+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0],"acting":[2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"76'2","reported_seq":161,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.071193+0000","last_change":"2024-02-10T08:28:20.073164+0000","last_active":"2024-02-10T08:30:26.071193+0000","last_peered":"2024-02-10T08:30:26.071193+0000","last_clean":"2024-02-10T08:30:26.071193+0000","last_became_active":"2024-02-10T08:23:34.718483+0000","last_became_peered":"2024-02-10T08:23:34.718483+0000","last_unstale":"2024-02-10T08:30:26.071193+0000","last_undegraded":"2024-02-10T08:30:26.071193+0000","last_fullsized":"2024-02-10T08:30:26.071193+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'2","last_scrub_stamp":"2024-02-10T08:28:20.073105+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2024-02-10T08:18:08.680038+0000","last_clean_scrub_stamp":"2024-02-10T08:28:20.073105+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.6","version":"291'9276","reported_seq":9319,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-10T08:30:32.616756+0000","last_change":"2024-02-10T08:28:28.331984+0000","last_active":"2024-02-10T08:30:32.616756+0000","last_peered":"2024-02-10T08:30:32.616756+0000","last_clean":"2024-02-10T08:30:32.616756+0000","last_became_active":"2024-02-10T08:28:28.331662+0000","last_became_peered":"2024-02-10T08:28:28.331662+0000","last_unstale":"2024-02-10T08:30:32.616756+0000","last_undegraded":"2024-02-10T08:30:32.616756+0000","last_fullsized":"2024-02-10T08:30:32.616756+0000","mapping_epoch":256,"log_start":"278'5368","ondisk_log_start":"278'5368","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_clean_scrub_stamp":"2024-02-10T08:28:27.172648+0000","log_size":3908,"ondisk_log_size":3908,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":396230656,"num_objects":6046,"num_object_clones":0,"num_object_copies":18138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6046,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9276,"num_write_kb":490304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,1],"acting":[5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"226'35","reported_seq":317,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.065011+0000","last_change":"2024-02-10T08:29:09.404681+0000","last_active":"2024-02-10T08:30:26.065011+0000","last_peered":"2024-02-10T08:30:26.065011+0000","last_clean":"2024-02-10T08:30:26.065011+0000","last_became_active":"2024-02-10T08:16:55.203415+0000","last_became_peered":"2024-02-10T08:16:55.203415+0000","last_unstale":"2024-02-10T08:30:26.065011+0000","last_undegraded":"2024-02-10T08:30:26.065011+0000","last_fullsized":"2024-02-10T08:30:26.065011+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"226'35","last_scrub_stamp":"2024-02-10T08:29:09.404577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:29:09.404577+0000","log_size":35,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":56,"num_read_kb":45,"num_write":36,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":283,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.057785+0000","last_change":"2024-02-10T08:28:02.781347+0000","last_active":"2024-02-10T08:30:26.057785+0000","last_peered":"2024-02-10T08:30:26.057785+0000","last_clean":"2024-02-10T08:30:26.057785+0000","last_became_active":"2024-02-10T08:28:02.781029+0000","last_became_peered":"2024-02-10T08:28:02.781029+0000","last_unstale":"2024-02-10T08:30:26.057785+0000","last_undegraded":"2024-02-10T08:30:26.057785+0000","last_fullsized":"2024-02-10T08:30:26.057785+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:26:25.120940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:26:25.120940+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":279,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.057597+0000","last_change":"2024-02-10T08:28:19.149963+0000","last_active":"2024-02-10T08:30:26.057597+0000","last_peered":"2024-02-10T08:30:26.057597+0000","last_clean":"2024-02-10T08:30:26.057597+0000","last_became_active":"2024-02-10T08:28:02.779438+0000","last_became_peered":"2024-02-10T08:28:02.779438+0000","last_unstale":"2024-02-10T08:30:26.057597+0000","last_undegraded":"2024-02-10T08:30:26.057597+0000","last_fullsized":"2024-02-10T08:30:26.057597+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:19.149900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:28:19.149900+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":271,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.069490+0000","last_change":"2024-02-10T08:28:22.114493+0000","last_active":"2024-02-10T08:30:26.069490+0000","last_peered":"2024-02-10T08:30:26.069490+0000","last_clean":"2024-02-10T08:30:26.069490+0000","last_became_active":"2024-02-10T08:24:18.645480+0000","last_became_peered":"2024-02-10T08:24:18.645480+0000","last_unstale":"2024-02-10T08:30:26.069490+0000","last_undegraded":"2024-02-10T08:30:26.069490+0000","last_fullsized":"2024-02-10T08:30:26.069490+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:22.114421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:22.114421+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,3],"acting":[7,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.7","version":"291'9433","reported_seq":9476,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-10T08:30:32.633209+0000","last_change":"2024-02-10T08:28:28.331926+0000","last_active":"2024-02-10T08:30:32.633209+0000","last_peered":"2024-02-10T08:30:32.633209+0000","last_clean":"2024-02-10T08:30:32.633209+0000","last_became_active":"2024-02-10T08:28:28.331632+0000","last_became_peered":"2024-02-10T08:28:28.331632+0000","last_unstale":"2024-02-10T08:30:32.633209+0000","last_undegraded":"2024-02-10T08:30:32.633209+0000","last_fullsized":"2024-02-10T08:30:32.633209+0000","mapping_epoch":256,"log_start":"278'5463","ondisk_log_start":"278'5463","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_clean_scrub_stamp":"2024-02-10T08:28:27.172648+0000","log_size":3970,"ondisk_log_size":3970,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":394723328,"num_objects":6023,"num_object_clones":0,"num_object_copies":18069,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6023,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9433,"num_write_kb":494592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2],"acting":[5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"225'31","reported_seq":308,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.057784+0000","last_change":"2024-02-10T08:28:38.271681+0000","last_active":"2024-02-10T08:30:26.057784+0000","last_peered":"2024-02-10T08:30:26.057784+0000","last_clean":"2024-02-10T08:30:26.057784+0000","last_became_active":"2024-02-10T08:28:38.237476+0000","last_became_peered":"2024-02-10T08:28:38.237476+0000","last_unstale":"2024-02-10T08:30:26.057784+0000","last_undegraded":"2024-02-10T08:30:26.057784+0000","last_fullsized":"2024-02-10T08:30:26.057784+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'31","last_scrub_stamp":"2024-02-10T08:28:14.001126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:28:14.001126+0000","log_size":31,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":48,"num_read_kb":38,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":294,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:28.373044+0000","last_change":"2024-02-10T08:30:28.373044+0000","last_active":"2024-02-10T08:30:28.373044+0000","last_peered":"2024-02-10T08:30:28.373044+0000","last_clean":"2024-02-10T08:30:28.373044+0000","last_became_active":"2024-02-10T08:20:46.399568+0000","last_became_peered":"2024-02-10T08:20:46.399568+0000","last_unstale":"2024-02-10T08:30:28.373044+0000","last_undegraded":"2024-02-10T08:30:28.373044+0000","last_fullsized":"2024-02-10T08:30:28.373044+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:25:29.292955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:25:29.292955+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":289,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.079228+0000","last_change":"2024-02-10T08:29:24.690721+0000","last_active":"2024-02-10T08:30:26.079228+0000","last_peered":"2024-02-10T08:30:26.079228+0000","last_clean":"2024-02-10T08:30:26.079228+0000","last_became_active":"2024-02-10T08:28:02.764210+0000","last_became_peered":"2024-02-10T08:28:02.764210+0000","last_unstale":"2024-02-10T08:30:26.079228+0000","last_undegraded":"2024-02-10T08:30:26.079228+0000","last_fullsized":"2024-02-10T08:30:26.079228+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:24.690623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:24.690623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":227,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.063816+0000","last_change":"2024-02-10T08:30:24.065086+0000","last_active":"2024-02-10T08:30:26.063816+0000","last_peered":"2024-02-10T08:30:26.063816+0000","last_clean":"2024-02-10T08:30:26.063816+0000","last_became_active":"2024-02-10T08:30:24.064761+0000","last_became_peered":"2024-02-10T08:30:24.064761+0000","last_unstale":"2024-02-10T08:30:26.063816+0000","last_undegraded":"2024-02-10T08:30:26.063816+0000","last_fullsized":"2024-02-10T08:30:26.063816+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:34.215363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:34.215363+0000","last_clean_scrub_stamp":"2024-02-10T08:28:34.215363+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6],"acting":[0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"291'9324","reported_seq":10992,"reported_epoch":291,"state":"active+remapped+backfilling","last_fresh":"2024-02-10T08:30:32.730085+0000","last_change":"2024-02-10T08:29:46.623364+0000","last_active":"2024-02-10T08:30:32.730085+0000","last_peered":"2024-02-10T08:30:32.730085+0000","last_clean":"2024-02-10T08:29:13.933885+0000","last_became_active":"2024-02-10T08:29:16.482526+0000","last_became_peered":"2024-02-10T08:29:16.482526+0000","last_unstale":"2024-02-10T08:30:32.730085+0000","last_undegraded":"2024-02-10T08:30:32.730085+0000","last_fullsized":"2024-02-10T08:30:32.730085+0000","mapping_epoch":272,"log_start":"278'5433","ondisk_log_start":"278'5433","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_clean_scrub_stamp":"2024-02-10T08:28:27.172648+0000","log_size":3891,"ondisk_log_size":3891,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":401735680,"num_objects":6130,"num_object_clones":0,"num_object_copies":18390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":11332,"num_objects_unfound":0,"num_objects_dirty":6130,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9324,"num_write_kb":494528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":537,"num_bytes_recovered":35192832,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,4],"acting":[1,6,2],"avail_no_missing":["1","2","6"],"object_location_counts":[{"shards":"1,2,6","objects":6130}],"blocked_by":[],"up_primary":5,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"225'20","reported_seq":275,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-10T08:30:30.115467+0000","last_change":"2024-02-10T08:26:39.910278+0000","last_active":"2024-02-10T08:30:30.115467+0000","last_peered":"2024-02-10T08:30:30.115467+0000","last_clean":"2024-02-10T08:30:30.115467+0000","last_became_active":"2024-02-10T08:20:46.398973+0000","last_became_peered":"2024-02-10T08:20:46.398973+0000","last_unstale":"2024-02-10T08:30:30.115467+0000","last_undegraded":"2024-02-10T08:30:30.115467+0000","last_fullsized":"2024-02-10T08:30:30.115467+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'10","last_scrub_stamp":"2024-02-10T08:26:39.910195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:26:39.910195+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":24,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":260,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.082108+0000","last_change":"2024-02-10T08:26:19.229352+0000","last_active":"2024-02-10T08:30:26.082108+0000","last_peered":"2024-02-10T08:30:26.082108+0000","last_clean":"2024-02-10T08:30:26.082108+0000","last_became_active":"2024-02-10T08:16:52.785545+0000","last_became_peered":"2024-02-10T08:16:52.785545+0000","last_unstale":"2024-02-10T08:30:26.082108+0000","last_undegraded":"2024-02-10T08:30:26.082108+0000","last_fullsized":"2024-02-10T08:30:26.082108+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:26:19.229261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:26:19.229261+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"62'8","reported_seq":433,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-10T08:30:30.108045+0000","last_change":"2024-02-10T08:29:12.429460+0000","last_active":"2024-02-10T08:30:30.108045+0000","last_peered":"2024-02-10T08:30:30.108045+0000","last_clean":"2024-02-10T08:30:30.108045+0000","last_became_active":"2024-02-10T08:16:56.858101+0000","last_became_peered":"2024-02-10T08:16:56.858101+0000","last_unstale":"2024-02-10T08:30:30.108045+0000","last_undegraded":"2024-02-10T08:30:30.108045+0000","last_fullsized":"2024-02-10T08:30:30.108045+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'8","last_scrub_stamp":"2024-02-10T08:29:12.429342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:12.429342+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":239,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-10T08:30:30.114941+0000","last_change":"2024-02-10T08:30:24.071630+0000","last_active":"2024-02-10T08:30:30.114941+0000","last_peered":"2024-02-10T08:30:30.114941+0000","last_clean":"2024-02-10T08:30:30.114941+0000","last_became_active":"2024-02-10T08:30:24.071020+0000","last_became_peered":"2024-02-10T08:30:24.071020+0000","last_unstale":"2024-02-10T08:30:30.114941+0000","last_undegraded":"2024-02-10T08:30:30.114941+0000","last_fullsized":"2024-02-10T08:30:30.114941+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:26.976023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:26.976023+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1","version":"291'9073","reported_seq":9116,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-10T08:30:32.633037+0000","last_change":"2024-02-10T08:28:28.530157+0000","last_active":"2024-02-10T08:30:32.633037+0000","last_peered":"2024-02-10T08:30:32.633037+0000","last_clean":"2024-02-10T08:30:32.633037+0000","last_became_active":"2024-02-10T08:28:28.529924+0000","last_became_peered":"2024-02-10T08:28:28.529924+0000","last_unstale":"2024-02-10T08:30:32.633037+0000","last_undegraded":"2024-02-10T08:30:32.633037+0000","last_fullsized":"2024-02-10T08:30:32.633037+0000","mapping_epoch":256,"log_start":"275'4575","ondisk_log_start":"275'4575","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_clean_scrub_stamp":"2024-02-10T08:28:27.172648+0000","log_size":4498,"ondisk_log_size":4498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":388825088,"num_objects":5933,"num_object_clones":0,"num_object_copies":17799,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5933,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9073,"num_write_kb":480192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.f","version":"226'27","reported_seq":283,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.066720+0000","last_change":"2024-02-10T08:28:18.108820+0000","last_active":"2024-02-10T08:30:26.066720+0000","last_peered":"2024-02-10T08:30:26.066720+0000","last_clean":"2024-02-10T08:30:26.066720+0000","last_became_active":"2024-02-10T08:20:46.401777+0000","last_became_peered":"2024-02-10T08:20:46.401777+0000","last_unstale":"2024-02-10T08:30:26.066720+0000","last_undegraded":"2024-02-10T08:30:26.066720+0000","last_fullsized":"2024-02-10T08:30:26.066720+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"226'27","last_scrub_stamp":"2024-02-10T08:28:18.108712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:28:18.108712+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":260,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.072713+0000","last_change":"2024-02-10T08:26:24.169444+0000","last_active":"2024-02-10T08:30:26.072713+0000","last_peered":"2024-02-10T08:30:26.072713+0000","last_clean":"2024-02-10T08:30:26.072713+0000","last_became_active":"2024-02-10T08:16:52.783634+0000","last_became_peered":"2024-02-10T08:16:52.783634+0000","last_unstale":"2024-02-10T08:30:26.072713+0000","last_undegraded":"2024-02-10T08:30:26.072713+0000","last_fullsized":"2024-02-10T08:30:26.072713+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:26:24.169341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:26:24.169341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"261'13","reported_seq":137,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-10T08:30:30.112017+0000","last_change":"2024-02-10T08:29:13.140731+0000","last_active":"2024-02-10T08:30:30.112017+0000","last_peered":"2024-02-10T08:30:30.112017+0000","last_clean":"2024-02-10T08:30:30.112017+0000","last_became_active":"2024-02-10T08:28:38.231242+0000","last_became_peered":"2024-02-10T08:28:38.231242+0000","last_unstale":"2024-02-10T08:30:30.112017+0000","last_undegraded":"2024-02-10T08:30:30.112017+0000","last_fullsized":"2024-02-10T08:30:30.112017+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'13","last_scrub_stamp":"2024-02-10T08:29:13.140622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:13.140622+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,2],"acting":[5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":276,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.056561+0000","last_change":"2024-02-10T08:30:24.071471+0000","last_active":"2024-02-10T08:30:26.056561+0000","last_peered":"2024-02-10T08:30:26.056561+0000","last_clean":"2024-02-10T08:30:26.056561+0000","last_became_active":"2024-02-10T08:30:24.071224+0000","last_became_peered":"2024-02-10T08:30:24.071224+0000","last_unstale":"2024-02-10T08:30:26.056561+0000","last_undegraded":"2024-02-10T08:30:26.056561+0000","last_fullsized":"2024-02-10T08:30:26.056561+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:36.163125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:36.163125+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,2],"acting":[5,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"291'9312","reported_seq":9355,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-10T08:30:32.717488+0000","last_change":"2024-02-10T08:28:28.332050+0000","last_active":"2024-02-10T08:30:32.717488+0000","last_peered":"2024-02-10T08:30:32.717488+0000","last_clean":"2024-02-10T08:30:32.717488+0000","last_became_active":"2024-02-10T08:28:28.331715+0000","last_became_peered":"2024-02-10T08:28:28.331715+0000","last_unstale":"2024-02-10T08:30:32.717488+0000","last_undegraded":"2024-02-10T08:30:32.717488+0000","last_fullsized":"2024-02-10T08:30:32.717488+0000","mapping_epoch":256,"log_start":"278'5498","ondisk_log_start":"278'5498","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_clean_scrub_stamp":"2024-02-10T08:28:27.172648+0000","log_size":3814,"ondisk_log_size":3814,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":389283840,"num_objects":5940,"num_object_clones":0,"num_object_copies":17820,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5940,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9312,"num_write_kb":488064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,7],"acting":[1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"225'24","reported_seq":282,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-10T08:30:30.115156+0000","last_change":"2024-02-10T08:28:18.012177+0000","last_active":"2024-02-10T08:30:30.115156+0000","last_peered":"2024-02-10T08:30:30.115156+0000","last_clean":"2024-02-10T08:30:30.115156+0000","last_became_active":"2024-02-10T08:20:46.406023+0000","last_became_peered":"2024-02-10T08:20:46.406023+0000","last_unstale":"2024-02-10T08:30:30.115156+0000","last_undegraded":"2024-02-10T08:30:30.115156+0000","last_fullsized":"2024-02-10T08:30:30.115156+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'24","last_scrub_stamp":"2024-02-10T08:28:18.012102+0000","last_deep_scrub":"76'16","last_deep_scrub_stamp":"2024-02-10T08:18:07.909782+0000","last_clean_scrub_stamp":"2024-02-10T08:28:18.012102+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":277,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.069759+0000","last_change":"2024-02-10T08:28:02.768983+0000","last_active":"2024-02-10T08:30:26.069759+0000","last_peered":"2024-02-10T08:30:26.069759+0000","last_clean":"2024-02-10T08:30:26.069759+0000","last_became_active":"2024-02-10T08:28:02.768633+0000","last_became_peered":"2024-02-10T08:28:02.768633+0000","last_unstale":"2024-02-10T08:30:26.069759+0000","last_undegraded":"2024-02-10T08:30:26.069759+0000","last_fullsized":"2024-02-10T08:30:26.069759+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:25:37.371542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:25:37.371542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":320,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.057149+0000","last_change":"2024-02-10T08:28:18.284825+0000","last_active":"2024-02-10T08:30:26.057149+0000","last_peered":"2024-02-10T08:30:26.057149+0000","last_clean":"2024-02-10T08:30:26.057149+0000","last_became_active":"2024-02-10T08:20:46.400500+0000","last_became_peered":"2024-02-10T08:20:46.400500+0000","last_unstale":"2024-02-10T08:30:26.057149+0000","last_undegraded":"2024-02-10T08:30:26.057149+0000","last_fullsized":"2024-02-10T08:30:26.057149+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:18.284751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:28:18.284751+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":188,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.065812+0000","last_change":"2024-02-10T08:30:24.063400+0000","last_active":"2024-02-10T08:30:26.065812+0000","last_peered":"2024-02-10T08:30:26.065812+0000","last_clean":"2024-02-10T08:30:26.065812+0000","last_became_active":"2024-02-10T08:30:24.063085+0000","last_became_peered":"2024-02-10T08:30:24.063085+0000","last_unstale":"2024-02-10T08:30:26.065812+0000","last_undegraded":"2024-02-10T08:30:26.065812+0000","last_fullsized":"2024-02-10T08:30:26.065812+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:15.491747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:20:30.227375+0000","last_clean_scrub_stamp":"2024-02-10T08:29:15.491747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,7],"acting":[6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"291'9212","reported_seq":9255,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-10T08:30:32.693279+0000","last_change":"2024-02-10T08:28:28.529385+0000","last_active":"2024-02-10T08:30:32.693279+0000","last_peered":"2024-02-10T08:30:32.693279+0000","last_clean":"2024-02-10T08:30:32.693279+0000","last_became_active":"2024-02-10T08:28:28.529058+0000","last_became_peered":"2024-02-10T08:28:28.529058+0000","last_unstale":"2024-02-10T08:30:32.693279+0000","last_undegraded":"2024-02-10T08:30:32.693279+0000","last_fullsized":"2024-02-10T08:30:32.693279+0000","mapping_epoch":256,"log_start":"278'5656","ondisk_log_start":"278'5656","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_clean_scrub_stamp":"2024-02-10T08:28:27.172648+0000","log_size":3556,"ondisk_log_size":3556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":379846656,"num_objects":5796,"num_object_clones":0,"num_object_copies":17388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5796,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9212,"num_write_kb":480256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"199'13","reported_seq":301,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-10T08:30:30.103863+0000","last_change":"2024-02-10T08:29:15.700537+0000","last_active":"2024-02-10T08:30:30.103863+0000","last_peered":"2024-02-10T08:30:30.103863+0000","last_clean":"2024-02-10T08:30:30.103863+0000","last_became_active":"2024-02-10T08:23:34.711450+0000","last_became_peered":"2024-02-10T08:23:34.711450+0000","last_unstale":"2024-02-10T08:30:30.103863+0000","last_undegraded":"2024-02-10T08:30:30.103863+0000","last_fullsized":"2024-02-10T08:30:30.103863+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"199'13","last_scrub_stamp":"2024-02-10T08:29:15.700463+0000","last_deep_scrub":"199'13","last_deep_scrub_stamp":"2024-02-10T08:24:47.529439+0000","last_clean_scrub_stamp":"2024-02-10T08:29:15.700463+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,2],"acting":[1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"225'28","reported_seq":278,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-10T08:30:30.112385+0000","last_change":"2024-02-10T08:29:24.036552+0000","last_active":"2024-02-10T08:30:30.112385+0000","last_peered":"2024-02-10T08:30:30.112385+0000","last_clean":"2024-02-10T08:30:30.112385+0000","last_became_active":"2024-02-10T08:20:46.400760+0000","last_became_peered":"2024-02-10T08:20:46.400760+0000","last_unstale":"2024-02-10T08:30:30.112385+0000","last_undegraded":"2024-02-10T08:30:30.112385+0000","last_fullsized":"2024-02-10T08:30:30.112385+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'28","last_scrub_stamp":"2024-02-10T08:29:24.036448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:29:24.036448+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":41,"num_read_kb":34,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":264,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.061662+0000","last_change":"2024-02-10T08:29:03.396846+0000","last_active":"2024-02-10T08:30:26.061662+0000","last_peered":"2024-02-10T08:30:26.061662+0000","last_clean":"2024-02-10T08:30:26.061662+0000","last_became_active":"2024-02-10T08:16:52.789020+0000","last_became_peered":"2024-02-10T08:16:52.789020+0000","last_unstale":"2024-02-10T08:30:26.061662+0000","last_undegraded":"2024-02-10T08:30:26.061662+0000","last_fullsized":"2024-02-10T08:30:26.061662+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:03.396727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:29:03.396727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":262,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.072239+0000","last_change":"2024-02-10T08:28:17.059779+0000","last_active":"2024-02-10T08:30:26.072239+0000","last_peered":"2024-02-10T08:30:26.072239+0000","last_clean":"2024-02-10T08:30:26.072239+0000","last_became_active":"2024-02-10T08:21:58.546976+0000","last_became_peered":"2024-02-10T08:21:58.546976+0000","last_unstale":"2024-02-10T08:30:26.072239+0000","last_undegraded":"2024-02-10T08:30:26.072239+0000","last_fullsized":"2024-02-10T08:30:26.072239+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:17.059697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:17.059697+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.c","version":"292'9405","reported_seq":9449,"reported_epoch":292,"state":"active+clean","last_fresh":"2024-02-10T08:30:34.906291+0000","last_change":"2024-02-10T08:28:28.529419+0000","last_active":"2024-02-10T08:30:34.906291+0000","last_peered":"2024-02-10T08:30:34.906291+0000","last_clean":"2024-02-10T08:30:34.906291+0000","last_became_active":"2024-02-10T08:28:28.529047+0000","last_became_peered":"2024-02-10T08:28:28.529047+0000","last_unstale":"2024-02-10T08:30:34.906291+0000","last_undegraded":"2024-02-10T08:30:34.906291+0000","last_fullsized":"2024-02-10T08:30:34.906291+0000","mapping_epoch":256,"log_start":"274'4307","ondisk_log_start":"274'4307","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_clean_scrub_stamp":"2024-02-10T08:28:27.172648+0000","log_size":5098,"ondisk_log_size":5098,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":382795776,"num_objects":5841,"num_object_clones":0,"num_object_copies":17523,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5841,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9405,"num_write_kb":487872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":247,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-10T08:30:30.112464+0000","last_change":"2024-02-10T08:29:27.021175+0000","last_active":"2024-02-10T08:30:30.112464+0000","last_peered":"2024-02-10T08:30:30.112464+0000","last_clean":"2024-02-10T08:30:30.112464+0000","last_became_active":"2024-02-10T08:23:34.706206+0000","last_became_peered":"2024-02-10T08:23:34.706206+0000","last_unstale":"2024-02-10T08:30:30.112464+0000","last_undegraded":"2024-02-10T08:30:30.112464+0000","last_fullsized":"2024-02-10T08:30:30.112464+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:27.021108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:27.021108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,5],"acting":[4,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"225'30","reported_seq":267,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.070089+0000","last_change":"2024-02-10T08:28:35.245725+0000","last_active":"2024-02-10T08:30:26.070089+0000","last_peered":"2024-02-10T08:30:26.070089+0000","last_clean":"2024-02-10T08:30:26.070089+0000","last_became_active":"2024-02-10T08:23:15.079674+0000","last_became_peered":"2024-02-10T08:23:15.079674+0000","last_unstale":"2024-02-10T08:30:26.070089+0000","last_undegraded":"2024-02-10T08:30:26.070089+0000","last_fullsized":"2024-02-10T08:30:26.070089+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'30","last_scrub_stamp":"2024-02-10T08:28:35.245660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:28:35.245660+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":51,"num_read_kb":39,"num_write":32,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,5],"acting":[7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":275,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.083022+0000","last_change":"2024-02-10T08:29:04.701249+0000","last_active":"2024-02-10T08:30:26.083022+0000","last_peered":"2024-02-10T08:30:26.083022+0000","last_clean":"2024-02-10T08:30:26.083022+0000","last_became_active":"2024-02-10T08:20:46.407667+0000","last_became_peered":"2024-02-10T08:20:46.407667+0000","last_unstale":"2024-02-10T08:30:26.083022+0000","last_undegraded":"2024-02-10T08:30:26.083022+0000","last_fullsized":"2024-02-10T08:30:26.083022+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:04.701160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:29:04.701160+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":260,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-10T08:30:30.112734+0000","last_change":"2024-02-10T08:28:22.016781+0000","last_active":"2024-02-10T08:30:30.112734+0000","last_peered":"2024-02-10T08:30:30.112734+0000","last_clean":"2024-02-10T08:30:30.112734+0000","last_became_active":"2024-02-10T08:23:15.074239+0000","last_became_peered":"2024-02-10T08:23:15.074239+0000","last_unstale":"2024-02-10T08:30:30.112734+0000","last_undegraded":"2024-02-10T08:30:30.112734+0000","last_fullsized":"2024-02-10T08:30:30.112734+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:22.016693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:22.016693+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"291'9317","reported_seq":9361,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-10T08:30:32.683685+0000","last_change":"2024-02-10T08:28:28.188686+0000","last_active":"2024-02-10T08:30:32.683685+0000","last_peered":"2024-02-10T08:30:32.683685+0000","last_clean":"2024-02-10T08:30:32.683685+0000","last_became_active":"2024-02-10T08:28:28.188347+0000","last_became_peered":"2024-02-10T08:28:28.188347+0000","last_unstale":"2024-02-10T08:30:32.683685+0000","last_undegraded":"2024-02-10T08:30:32.683685+0000","last_fullsized":"2024-02-10T08:30:32.683685+0000","mapping_epoch":256,"log_start":"278'5755","ondisk_log_start":"278'5755","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_clean_scrub_stamp":"2024-02-10T08:28:27.172648+0000","log_size":3562,"ondisk_log_size":3562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":388235288,"num_objects":5925,"num_object_clones":0,"num_object_copies":17775,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5925,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9317,"num_write_kb":487681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,5],"acting":[7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":278,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.065148+0000","last_change":"2024-02-10T08:29:11.420173+0000","last_active":"2024-02-10T08:30:26.065148+0000","last_peered":"2024-02-10T08:30:26.065148+0000","last_clean":"2024-02-10T08:30:26.065148+0000","last_became_active":"2024-02-10T08:28:02.769069+0000","last_became_peered":"2024-02-10T08:28:02.769069+0000","last_unstale":"2024-02-10T08:30:26.065148+0000","last_undegraded":"2024-02-10T08:30:26.065148+0000","last_fullsized":"2024-02-10T08:30:26.065148+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:11.420031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:11.420031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"225'37","reported_seq":356,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.062908+0000","last_change":"2024-02-10T08:28:33.205966+0000","last_active":"2024-02-10T08:30:26.062908+0000","last_peered":"2024-02-10T08:30:26.062908+0000","last_clean":"2024-02-10T08:30:26.062908+0000","last_became_active":"2024-02-10T08:28:25.951447+0000","last_became_peered":"2024-02-10T08:28:25.951447+0000","last_unstale":"2024-02-10T08:30:26.062908+0000","last_undegraded":"2024-02-10T08:30:26.062908+0000","last_fullsized":"2024-02-10T08:30:26.062908+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'37","last_scrub_stamp":"2024-02-10T08:28:33.205891+0000","last_deep_scrub":"199'27","last_deep_scrub_stamp":"2024-02-10T08:24:42.826442+0000","last_clean_scrub_stamp":"2024-02-10T08:28:33.205891+0000","log_size":37,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":53,"num_read_kb":39,"num_write":32,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":253,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.057697+0000","last_change":"2024-02-10T08:27:27.094310+0000","last_active":"2024-02-10T08:30:26.057697+0000","last_peered":"2024-02-10T08:30:26.057697+0000","last_clean":"2024-02-10T08:30:26.057697+0000","last_became_active":"2024-02-10T08:23:34.708387+0000","last_became_peered":"2024-02-10T08:23:34.708387+0000","last_unstale":"2024-02-10T08:30:26.057697+0000","last_undegraded":"2024-02-10T08:30:26.057697+0000","last_fullsized":"2024-02-10T08:30:26.057697+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:27:27.094240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:27:27.094240+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":263,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.072882+0000","last_change":"2024-02-10T08:28:39.633777+0000","last_active":"2024-02-10T08:30:26.072882+0000","last_peered":"2024-02-10T08:30:26.072882+0000","last_clean":"2024-02-10T08:30:26.072882+0000","last_became_active":"2024-02-10T08:21:58.553966+0000","last_became_peered":"2024-02-10T08:21:58.553966+0000","last_unstale":"2024-02-10T08:30:26.072882+0000","last_undegraded":"2024-02-10T08:30:26.072882+0000","last_fullsized":"2024-02-10T08:30:26.072882+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:39.633627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:39.633627+0000","last_clean_scrub_stamp":"2024-02-10T08:28:39.633627+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.e","version":"291'9187","reported_seq":9230,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-10T08:30:32.687263+0000","last_change":"2024-02-10T08:28:28.188744+0000","last_active":"2024-02-10T08:30:32.687263+0000","last_peered":"2024-02-10T08:30:32.687263+0000","last_clean":"2024-02-10T08:30:32.687263+0000","last_became_active":"2024-02-10T08:28:28.188416+0000","last_became_peered":"2024-02-10T08:28:28.188416+0000","last_unstale":"2024-02-10T08:30:32.687263+0000","last_undegraded":"2024-02-10T08:30:32.687263+0000","last_fullsized":"2024-02-10T08:30:32.687263+0000","mapping_epoch":256,"log_start":"278'5651","ondisk_log_start":"278'5651","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_clean_scrub_stamp":"2024-02-10T08:28:27.172648+0000","log_size":3536,"ondisk_log_size":3536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":383582208,"num_objects":5853,"num_object_clones":0,"num_object_copies":17559,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5853,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9187,"num_write_kb":481280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":282,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.057263+0000","last_change":"2024-02-10T08:29:14.145590+0000","last_active":"2024-02-10T08:30:26.057263+0000","last_peered":"2024-02-10T08:30:26.057263+0000","last_clean":"2024-02-10T08:30:26.057263+0000","last_became_active":"2024-02-10T08:28:02.772585+0000","last_became_peered":"2024-02-10T08:28:02.772585+0000","last_unstale":"2024-02-10T08:30:26.057263+0000","last_undegraded":"2024-02-10T08:30:26.057263+0000","last_fullsized":"2024-02-10T08:30:26.057263+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:14.145493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:41.360241+0000","last_clean_scrub_stamp":"2024-02-10T08:29:14.145493+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"225'24","reported_seq":206,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.083355+0000","last_change":"2024-02-10T08:28:26.505341+0000","last_active":"2024-02-10T08:30:26.083355+0000","last_peered":"2024-02-10T08:30:26.083355+0000","last_clean":"2024-02-10T08:30:26.083355+0000","last_became_active":"2024-02-10T08:23:15.077476+0000","last_became_peered":"2024-02-10T08:23:15.077476+0000","last_unstale":"2024-02-10T08:30:26.083355+0000","last_undegraded":"2024-02-10T08:30:26.083355+0000","last_fullsized":"2024-02-10T08:30:26.083355+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'24","last_scrub_stamp":"2024-02-10T08:28:26.505270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:28:26.505270+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,7],"acting":[1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":277,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.069564+0000","last_change":"2024-02-10T08:28:02.761385+0000","last_active":"2024-02-10T08:30:26.069564+0000","last_peered":"2024-02-10T08:30:26.069564+0000","last_clean":"2024-02-10T08:30:26.069564+0000","last_became_active":"2024-02-10T08:28:02.760999+0000","last_became_peered":"2024-02-10T08:28:02.760999+0000","last_unstale":"2024-02-10T08:30:26.069564+0000","last_undegraded":"2024-02-10T08:30:26.069564+0000","last_fullsized":"2024-02-10T08:30:26.069564+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:26:31.161639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:26:31.161639+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":238,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.064300+0000","last_change":"2024-02-10T08:29:06.426493+0000","last_active":"2024-02-10T08:30:26.064300+0000","last_peered":"2024-02-10T08:30:26.064300+0000","last_clean":"2024-02-10T08:30:26.064300+0000","last_became_active":"2024-02-10T08:28:38.233974+0000","last_became_peered":"2024-02-10T08:28:38.233974+0000","last_unstale":"2024-02-10T08:30:26.064300+0000","last_undegraded":"2024-02-10T08:30:26.064300+0000","last_fullsized":"2024-02-10T08:30:26.064300+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:06.426390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:20.736224+0000","last_clean_scrub_stamp":"2024-02-10T08:29:06.426390+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":276,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.079306+0000","last_change":"2024-02-10T08:28:19.044189+0000","last_active":"2024-02-10T08:30:26.079306+0000","last_peered":"2024-02-10T08:30:26.079306+0000","last_clean":"2024-02-10T08:30:26.079306+0000","last_became_active":"2024-02-10T08:28:19.022399+0000","last_became_peered":"2024-02-10T08:28:19.022399+0000","last_unstale":"2024-02-10T08:30:26.079306+0000","last_undegraded":"2024-02-10T08:30:26.079306+0000","last_fullsized":"2024-02-10T08:30:26.079306+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:20:09.785096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:20:09.785096+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"291'9336","reported_seq":9401,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-10T08:30:32.574410+0000","last_change":"2024-02-10T08:30:32.214109+0000","last_active":"2024-02-10T08:30:32.574410+0000","last_peered":"2024-02-10T08:30:32.574410+0000","last_clean":"2024-02-10T08:30:32.574410+0000","last_became_active":"2024-02-10T08:28:28.331529+0000","last_became_peered":"2024-02-10T08:28:28.331529+0000","last_unstale":"2024-02-10T08:30:32.574410+0000","last_undegraded":"2024-02-10T08:30:32.574410+0000","last_fullsized":"2024-02-10T08:30:32.574410+0000","mapping_epoch":256,"log_start":"276'4923","ondisk_log_start":"276'4923","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_clean_scrub_stamp":"2024-02-10T08:28:27.172648+0000","log_size":4413,"ondisk_log_size":4413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":395575296,"num_objects":6036,"num_object_clones":0,"num_object_copies":18108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6036,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9336,"num_write_kb":491904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":260,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.073373+0000","last_change":"2024-02-10T08:29:13.416528+0000","last_active":"2024-02-10T08:30:26.073373+0000","last_peered":"2024-02-10T08:30:26.073373+0000","last_clean":"2024-02-10T08:30:26.073373+0000","last_became_active":"2024-02-10T08:16:56.867159+0000","last_became_peered":"2024-02-10T08:16:56.867159+0000","last_unstale":"2024-02-10T08:30:26.073373+0000","last_undegraded":"2024-02-10T08:30:26.073373+0000","last_fullsized":"2024-02-10T08:30:26.073373+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:13.416461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:04.766780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:13.416461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"225'33","reported_seq":324,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.061497+0000","last_change":"2024-02-10T08:29:20.522358+0000","last_active":"2024-02-10T08:30:26.061497+0000","last_peered":"2024-02-10T08:30:26.061497+0000","last_clean":"2024-02-10T08:30:26.061497+0000","last_became_active":"2024-02-10T08:20:46.401981+0000","last_became_peered":"2024-02-10T08:20:46.401981+0000","last_unstale":"2024-02-10T08:30:26.061497+0000","last_undegraded":"2024-02-10T08:30:26.061497+0000","last_fullsized":"2024-02-10T08:30:26.061497+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'33","last_scrub_stamp":"2024-02-10T08:29:20.522259+0000","last_deep_scrub":"223'21","last_deep_scrub_stamp":"2024-02-10T08:26:33.250614+0000","last_clean_scrub_stamp":"2024-02-10T08:29:20.522259+0000","log_size":33,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":33,"num_write":25,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":279,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.069694+0000","last_change":"2024-02-10T08:26:24.214276+0000","last_active":"2024-02-10T08:30:26.069694+0000","last_peered":"2024-02-10T08:30:26.069694+0000","last_clean":"2024-02-10T08:30:26.069694+0000","last_became_active":"2024-02-10T08:23:34.717837+0000","last_became_peered":"2024-02-10T08:23:34.717837+0000","last_unstale":"2024-02-10T08:30:26.069694+0000","last_undegraded":"2024-02-10T08:30:26.069694+0000","last_fullsized":"2024-02-10T08:30:26.069694+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:26:24.214179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:14:44.584370+0000","last_clean_scrub_stamp":"2024-02-10T08:26:24.214179+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":264,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.056015+0000","last_change":"2024-02-10T08:29:06.087344+0000","last_active":"2024-02-10T08:30:26.056015+0000","last_peered":"2024-02-10T08:30:26.056015+0000","last_clean":"2024-02-10T08:30:26.056015+0000","last_became_active":"2024-02-10T08:16:52.788767+0000","last_became_peered":"2024-02-10T08:16:52.788767+0000","last_unstale":"2024-02-10T08:30:26.056015+0000","last_undegraded":"2024-02-10T08:30:26.056015+0000","last_fullsized":"2024-02-10T08:30:26.056015+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:06.087258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:29:06.087258+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":179,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.055466+0000","last_change":"2024-02-10T08:28:35.177207+0000","last_active":"2024-02-10T08:30:26.055466+0000","last_peered":"2024-02-10T08:30:26.055466+0000","last_clean":"2024-02-10T08:30:26.055466+0000","last_became_active":"2024-02-10T08:23:34.712122+0000","last_became_peered":"2024-02-10T08:23:34.712122+0000","last_unstale":"2024-02-10T08:30:26.055466+0000","last_undegraded":"2024-02-10T08:30:26.055466+0000","last_fullsized":"2024-02-10T08:30:26.055466+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:35.177138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:28:35.177138+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,4],"acting":[5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":277,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.057332+0000","last_change":"2024-02-10T08:29:25.198375+0000","last_active":"2024-02-10T08:30:26.057332+0000","last_peered":"2024-02-10T08:30:26.057332+0000","last_clean":"2024-02-10T08:30:26.057332+0000","last_became_active":"2024-02-10T08:21:58.560646+0000","last_became_peered":"2024-02-10T08:21:58.560646+0000","last_unstale":"2024-02-10T08:30:26.057332+0000","last_undegraded":"2024-02-10T08:30:26.057332+0000","last_fullsized":"2024-02-10T08:30:26.057332+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:25.198277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:26:29.921562+0000","last_clean_scrub_stamp":"2024-02-10T08:29:25.198277+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"291'9170","reported_seq":9213,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-10T08:30:33.139541+0000","last_change":"2024-02-10T08:28:28.191187+0000","last_active":"2024-02-10T08:30:33.139541+0000","last_peered":"2024-02-10T08:30:33.139541+0000","last_clean":"2024-02-10T08:30:33.139541+0000","last_became_active":"2024-02-10T08:28:28.190724+0000","last_became_peered":"2024-02-10T08:28:28.190724+0000","last_unstale":"2024-02-10T08:30:33.139541+0000","last_undegraded":"2024-02-10T08:30:33.139541+0000","last_fullsized":"2024-02-10T08:30:33.139541+0000","mapping_epoch":256,"log_start":"264'1774","ondisk_log_start":"264'1774","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_clean_scrub_stamp":"2024-02-10T08:28:27.172648+0000","log_size":7396,"ondisk_log_size":7396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":380239872,"num_objects":5802,"num_object_clones":0,"num_object_copies":17406,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5802,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9170,"num_write_kb":479104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":261,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.059453+0000","last_change":"2024-02-10T08:29:23.504992+0000","last_active":"2024-02-10T08:30:26.059453+0000","last_peered":"2024-02-10T08:30:26.059453+0000","last_clean":"2024-02-10T08:30:26.059453+0000","last_became_active":"2024-02-10T08:16:56.857856+0000","last_became_peered":"2024-02-10T08:16:56.857856+0000","last_unstale":"2024-02-10T08:30:26.059453+0000","last_undegraded":"2024-02-10T08:30:26.059453+0000","last_fullsized":"2024-02-10T08:30:26.059453+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:23.504892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:23.504892+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"225'17","reported_seq":152,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.078713+0000","last_change":"2024-02-10T08:28:38.619626+0000","last_active":"2024-02-10T08:30:26.078713+0000","last_peered":"2024-02-10T08:30:26.078713+0000","last_clean":"2024-02-10T08:30:26.078713+0000","last_became_active":"2024-02-10T08:23:34.729593+0000","last_became_peered":"2024-02-10T08:23:34.729593+0000","last_unstale":"2024-02-10T08:30:26.078713+0000","last_undegraded":"2024-02-10T08:30:26.078713+0000","last_fullsized":"2024-02-10T08:30:26.078713+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'17","last_scrub_stamp":"2024-02-10T08:28:38.619521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:28:38.619521+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":35,"num_read_kb":24,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":292,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.059155+0000","last_change":"2024-02-10T08:28:35.476480+0000","last_active":"2024-02-10T08:30:26.059155+0000","last_peered":"2024-02-10T08:30:26.059155+0000","last_clean":"2024-02-10T08:30:26.059155+0000","last_became_active":"2024-02-10T08:28:02.788789+0000","last_became_peered":"2024-02-10T08:28:02.788789+0000","last_unstale":"2024-02-10T08:30:26.059155+0000","last_undegraded":"2024-02-10T08:30:26.059155+0000","last_fullsized":"2024-02-10T08:30:26.059155+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:35.476417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:11.681169+0000","last_clean_scrub_stamp":"2024-02-10T08:28:35.476417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"63'5","reported_seq":1073,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-10T08:30:31.199832+0000","last_change":"2024-02-10T08:25:43.009500+0000","last_active":"2024-02-10T08:30:31.199832+0000","last_peered":"2024-02-10T08:30:31.199832+0000","last_clean":"2024-02-10T08:30:31.199832+0000","last_became_active":"2024-02-10T08:16:52.780989+0000","last_became_peered":"2024-02-10T08:16:52.780989+0000","last_unstale":"2024-02-10T08:30:31.199832+0000","last_undegraded":"2024-02-10T08:30:31.199832+0000","last_fullsized":"2024-02-10T08:30:31.199832+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'5","last_scrub_stamp":"2024-02-10T08:25:43.009394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:25:43.009394+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":810,"num_read_kb":805,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":268,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.072274+0000","last_change":"2024-02-10T08:28:16.113780+0000","last_active":"2024-02-10T08:30:26.072274+0000","last_peered":"2024-02-10T08:30:26.072274+0000","last_clean":"2024-02-10T08:30:26.072274+0000","last_became_active":"2024-02-10T08:21:58.549733+0000","last_became_peered":"2024-02-10T08:21:58.549733+0000","last_unstale":"2024-02-10T08:30:26.072274+0000","last_undegraded":"2024-02-10T08:30:26.072274+0000","last_fullsized":"2024-02-10T08:30:26.072274+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:16.113690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:11.750537+0000","last_clean_scrub_stamp":"2024-02-10T08:28:16.113690+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.a","version":"291'9392","reported_seq":9435,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-10T08:30:32.603275+0000","last_change":"2024-02-10T08:28:28.186010+0000","last_active":"2024-02-10T08:30:32.603275+0000","last_peered":"2024-02-10T08:30:32.603275+0000","last_clean":"2024-02-10T08:30:32.603275+0000","last_became_active":"2024-02-10T08:28:28.185721+0000","last_became_peered":"2024-02-10T08:28:28.185721+0000","last_unstale":"2024-02-10T08:30:32.603275+0000","last_undegraded":"2024-02-10T08:30:32.603275+0000","last_fullsized":"2024-02-10T08:30:32.603275+0000","mapping_epoch":256,"log_start":"278'5424","ondisk_log_start":"278'5424","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_clean_scrub_stamp":"2024-02-10T08:28:27.172648+0000","log_size":3968,"ondisk_log_size":3968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":400687104,"num_objects":6114,"num_object_clones":0,"num_object_copies":18342,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6114,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9392,"num_write_kb":496192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":220,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.084272+0000","last_change":"2024-02-10T08:29:26.703538+0000","last_active":"2024-02-10T08:30:26.084272+0000","last_peered":"2024-02-10T08:30:26.084272+0000","last_clean":"2024-02-10T08:30:26.084272+0000","last_became_active":"2024-02-10T08:23:15.081822+0000","last_became_peered":"2024-02-10T08:23:15.081822+0000","last_unstale":"2024-02-10T08:30:26.084272+0000","last_undegraded":"2024-02-10T08:30:26.084272+0000","last_fullsized":"2024-02-10T08:30:26.084272+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:26.703441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:26.703441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,6],"acting":[1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"225'41","reported_seq":524,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-10T08:30:30.101434+0000","last_change":"2024-02-10T08:28:22.455298+0000","last_active":"2024-02-10T08:30:30.101434+0000","last_peered":"2024-02-10T08:30:30.101434+0000","last_clean":"2024-02-10T08:30:30.101434+0000","last_became_active":"2024-02-10T08:23:34.709222+0000","last_became_peered":"2024-02-10T08:23:34.709222+0000","last_unstale":"2024-02-10T08:30:30.101434+0000","last_undegraded":"2024-02-10T08:30:30.101434+0000","last_fullsized":"2024-02-10T08:30:30.101434+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'41","last_scrub_stamp":"2024-02-10T08:28:22.455139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:28:22.455139+0000","log_size":41,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":66,"num_read_kb":51,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":358,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":264,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.055384+0000","last_change":"2024-02-10T08:29:11.165779+0000","last_active":"2024-02-10T08:30:26.055384+0000","last_peered":"2024-02-10T08:30:26.055384+0000","last_clean":"2024-02-10T08:30:26.055384+0000","last_became_active":"2024-02-10T08:16:52.791027+0000","last_became_peered":"2024-02-10T08:16:52.791027+0000","last_unstale":"2024-02-10T08:30:26.055384+0000","last_undegraded":"2024-02-10T08:30:26.055384+0000","last_fullsized":"2024-02-10T08:30:26.055384+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:11.165678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:29:11.165678+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":275,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-10T08:30:30.114845+0000","last_change":"2024-02-10T08:28:26.013133+0000","last_active":"2024-02-10T08:30:30.114845+0000","last_peered":"2024-02-10T08:30:30.114845+0000","last_clean":"2024-02-10T08:30:30.114845+0000","last_became_active":"2024-02-10T08:23:34.716482+0000","last_became_peered":"2024-02-10T08:23:34.716482+0000","last_unstale":"2024-02-10T08:30:30.114845+0000","last_undegraded":"2024-02-10T08:30:30.114845+0000","last_fullsized":"2024-02-10T08:30:30.114845+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:26.013060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:26.013060+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.9","version":"291'9354","reported_seq":9419,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-10T08:30:33.137214+0000","last_change":"2024-02-10T08:30:32.280301+0000","last_active":"2024-02-10T08:30:33.137214+0000","last_peered":"2024-02-10T08:30:33.137214+0000","last_clean":"2024-02-10T08:30:33.137214+0000","last_became_active":"2024-02-10T08:28:28.190530+0000","last_became_peered":"2024-02-10T08:28:28.190530+0000","last_unstale":"2024-02-10T08:30:33.137214+0000","last_undegraded":"2024-02-10T08:30:33.137214+0000","last_fullsized":"2024-02-10T08:30:33.137214+0000","mapping_epoch":256,"log_start":"265'2025","ondisk_log_start":"265'2025","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_clean_scrub_stamp":"2024-02-10T08:28:27.172648+0000","log_size":7329,"ondisk_log_size":7329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":389939200,"num_objects":5950,"num_object_clones":0,"num_object_copies":17850,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5950,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9354,"num_write_kb":489728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,5],"acting":[0,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"255'12","reported_seq":146,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-10T08:30:30.099168+0000","last_change":"2024-02-10T08:28:25.952833+0000","last_active":"2024-02-10T08:30:30.099168+0000","last_peered":"2024-02-10T08:30:30.099168+0000","last_clean":"2024-02-10T08:30:30.099168+0000","last_became_active":"2024-02-10T08:28:25.952468+0000","last_became_peered":"2024-02-10T08:28:25.952468+0000","last_unstale":"2024-02-10T08:30:30.099168+0000","last_undegraded":"2024-02-10T08:30:30.099168+0000","last_fullsized":"2024-02-10T08:30:30.099168+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"244'11","last_scrub_stamp":"2024-02-10T08:28:18.492203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:28:18.492203+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"225'20","reported_seq":303,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.082186+0000","last_change":"2024-02-10T08:29:11.695106+0000","last_active":"2024-02-10T08:30:26.082186+0000","last_peered":"2024-02-10T08:30:26.082186+0000","last_clean":"2024-02-10T08:30:26.082186+0000","last_became_active":"2024-02-10T08:20:46.408495+0000","last_became_peered":"2024-02-10T08:20:46.408495+0000","last_unstale":"2024-02-10T08:30:26.082186+0000","last_undegraded":"2024-02-10T08:30:26.082186+0000","last_fullsized":"2024-02-10T08:30:26.082186+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'20","last_scrub_stamp":"2024-02-10T08:29:11.694999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:29:11.694999+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":278,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.077894+0000","last_change":"2024-02-10T08:28:21.409185+0000","last_active":"2024-02-10T08:30:26.077894+0000","last_peered":"2024-02-10T08:30:26.077894+0000","last_clean":"2024-02-10T08:30:26.077894+0000","last_became_active":"2024-02-10T08:28:02.760784+0000","last_became_peered":"2024-02-10T08:28:02.760784+0000","last_unstale":"2024-02-10T08:30:26.077894+0000","last_undegraded":"2024-02-10T08:30:26.077894+0000","last_fullsized":"2024-02-10T08:30:26.077894+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:21.409109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:28:21.409109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":184,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.064095+0000","last_change":"2024-02-10T08:29:14.538007+0000","last_active":"2024-02-10T08:30:26.064095+0000","last_peered":"2024-02-10T08:30:26.064095+0000","last_clean":"2024-02-10T08:30:26.064095+0000","last_became_active":"2024-02-10T08:28:25.950240+0000","last_became_peered":"2024-02-10T08:28:25.950240+0000","last_unstale":"2024-02-10T08:30:26.064095+0000","last_undegraded":"2024-02-10T08:30:26.064095+0000","last_fullsized":"2024-02-10T08:30:26.064095+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:14.537940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:14.537940+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.f","version":"291'9094","reported_seq":9137,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-10T08:30:32.633117+0000","last_change":"2024-02-10T08:28:28.332012+0000","last_active":"2024-02-10T08:30:32.633117+0000","last_peered":"2024-02-10T08:30:32.633117+0000","last_clean":"2024-02-10T08:30:32.633117+0000","last_became_active":"2024-02-10T08:28:28.331729+0000","last_became_peered":"2024-02-10T08:28:28.331729+0000","last_unstale":"2024-02-10T08:30:32.633117+0000","last_undegraded":"2024-02-10T08:30:32.633117+0000","last_fullsized":"2024-02-10T08:30:32.633117+0000","mapping_epoch":256,"log_start":"278'5183","ondisk_log_start":"278'5183","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_clean_scrub_stamp":"2024-02-10T08:28:27.172648+0000","log_size":3911,"ondisk_log_size":3911,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":381026304,"num_objects":5814,"num_object_clones":0,"num_object_copies":17442,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5814,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9094,"num_write_kb":477056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,2],"acting":[5,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":279,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.058773+0000","last_change":"2024-02-10T08:29:14.447872+0000","last_active":"2024-02-10T08:30:26.058773+0000","last_peered":"2024-02-10T08:30:26.058773+0000","last_clean":"2024-02-10T08:30:26.058773+0000","last_became_active":"2024-02-10T08:28:02.777637+0000","last_became_peered":"2024-02-10T08:28:02.777637+0000","last_unstale":"2024-02-10T08:30:26.058773+0000","last_undegraded":"2024-02-10T08:30:26.058773+0000","last_fullsized":"2024-02-10T08:30:26.058773+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:14.447807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:14.447807+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"225'23","reported_seq":300,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-10T08:30:30.112237+0000","last_change":"2024-02-10T08:29:23.027325+0000","last_active":"2024-02-10T08:30:30.112237+0000","last_peered":"2024-02-10T08:30:30.112237+0000","last_clean":"2024-02-10T08:30:30.112237+0000","last_became_active":"2024-02-10T08:23:15.126133+0000","last_became_peered":"2024-02-10T08:23:15.126133+0000","last_unstale":"2024-02-10T08:30:30.112237+0000","last_undegraded":"2024-02-10T08:30:30.112237+0000","last_fullsized":"2024-02-10T08:30:30.112237+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'23","last_scrub_stamp":"2024-02-10T08:29:23.027211+0000","last_deep_scrub":"82'17","last_deep_scrub_stamp":"2024-02-10T08:18:21.015873+0000","last_clean_scrub_stamp":"2024-02-10T08:29:23.027211+0000","log_size":23,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":25,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6],"acting":[4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"55'2","reported_seq":281,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-10T08:30:30.114641+0000","last_change":"2024-02-10T08:29:22.034366+0000","last_active":"2024-02-10T08:30:30.114641+0000","last_peered":"2024-02-10T08:30:30.114641+0000","last_clean":"2024-02-10T08:30:30.114641+0000","last_became_active":"2024-02-10T08:28:02.768279+0000","last_became_peered":"2024-02-10T08:28:02.768279+0000","last_unstale":"2024-02-10T08:30:30.114641+0000","last_undegraded":"2024-02-10T08:30:30.114641+0000","last_fullsized":"2024-02-10T08:30:30.114641+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'2","last_scrub_stamp":"2024-02-10T08:29:22.034268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:29:22.034268+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":184,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":174,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.071897+0000","last_change":"2024-02-10T08:30:24.073702+0000","last_active":"2024-02-10T08:30:26.071897+0000","last_peered":"2024-02-10T08:30:26.071897+0000","last_clean":"2024-02-10T08:30:26.071897+0000","last_became_active":"2024-02-10T08:30:24.073077+0000","last_became_peered":"2024-02-10T08:30:24.073077+0000","last_unstale":"2024-02-10T08:30:26.071897+0000","last_undegraded":"2024-02-10T08:30:26.071897+0000","last_fullsized":"2024-02-10T08:30:26.071897+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:26:20.173948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:26:20.173948+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.4","version":"291'9052","reported_seq":9095,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-10T08:30:32.718563+0000","last_change":"2024-02-10T08:28:28.529619+0000","last_active":"2024-02-10T08:30:32.718563+0000","last_peered":"2024-02-10T08:30:32.718563+0000","last_clean":"2024-02-10T08:30:32.718563+0000","last_became_active":"2024-02-10T08:28:28.529130+0000","last_became_peered":"2024-02-10T08:28:28.529130+0000","last_unstale":"2024-02-10T08:30:32.718563+0000","last_undegraded":"2024-02-10T08:30:32.718563+0000","last_fullsized":"2024-02-10T08:30:32.718563+0000","mapping_epoch":256,"log_start":"278'5252","ondisk_log_start":"278'5252","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:27.172648+0000","last_clean_scrub_stamp":"2024-02-10T08:28:27.172648+0000","log_size":3800,"ondisk_log_size":3800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":385482752,"num_objects":5882,"num_object_clones":0,"num_object_copies":17646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5882,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9052,"num_write_kb":477888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"225'15","reported_seq":188,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.071999+0000","last_change":"2024-02-10T08:29:09.329280+0000","last_active":"2024-02-10T08:30:26.071999+0000","last_peered":"2024-02-10T08:30:26.071999+0000","last_clean":"2024-02-10T08:30:26.071999+0000","last_became_active":"2024-02-10T08:23:34.719714+0000","last_became_peered":"2024-02-10T08:23:34.719714+0000","last_unstale":"2024-02-10T08:30:26.071999+0000","last_undegraded":"2024-02-10T08:30:26.071999+0000","last_fullsized":"2024-02-10T08:30:26.071999+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'15","last_scrub_stamp":"2024-02-10T08:29:09.329160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:29:09.329160+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"55'1","reported_seq":312,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:27.338643+0000","last_change":"2024-02-10T08:30:27.338643+0000","last_active":"2024-02-10T08:30:27.338643+0000","last_peered":"2024-02-10T08:30:27.338643+0000","last_clean":"2024-02-10T08:30:27.338643+0000","last_became_active":"2024-02-10T08:28:02.778857+0000","last_became_peered":"2024-02-10T08:28:02.778857+0000","last_unstale":"2024-02-10T08:30:27.338643+0000","last_undegraded":"2024-02-10T08:30:27.338643+0000","last_fullsized":"2024-02-10T08:30:27.338643+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'1","last_scrub_stamp":"2024-02-10T08:25:28.166655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:25:28.166655+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":716,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":194,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.078816+0000","last_change":"2024-02-10T08:28:02.769046+0000","last_active":"2024-02-10T08:30:26.078816+0000","last_peered":"2024-02-10T08:30:26.078816+0000","last_clean":"2024-02-10T08:30:26.078816+0000","last_became_active":"2024-02-10T08:28:02.768667+0000","last_became_peered":"2024-02-10T08:28:02.768667+0000","last_unstale":"2024-02-10T08:30:26.078816+0000","last_undegraded":"2024-02-10T08:30:26.078816+0000","last_fullsized":"2024-02-10T08:30:26.078816+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:26:38.062164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:26:38.062164+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":128,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.065903+0000","last_change":"2024-02-10T08:29:24.514793+0000","last_active":"2024-02-10T08:30:26.065903+0000","last_peered":"2024-02-10T08:30:26.065903+0000","last_clean":"2024-02-10T08:30:26.065903+0000","last_became_active":"2024-02-10T08:28:25.999252+0000","last_became_peered":"2024-02-10T08:28:25.999252+0000","last_unstale":"2024-02-10T08:30:26.065903+0000","last_undegraded":"2024-02-10T08:30:26.065903+0000","last_fullsized":"2024-02-10T08:30:26.065903+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:24.514690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:24.514690+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"225'15","reported_seq":215,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.072366+0000","last_change":"2024-02-10T08:26:33.158094+0000","last_active":"2024-02-10T08:30:26.072366+0000","last_peered":"2024-02-10T08:30:26.072366+0000","last_clean":"2024-02-10T08:30:26.072366+0000","last_became_active":"2024-02-10T08:23:15.079382+0000","last_became_peered":"2024-02-10T08:23:15.079382+0000","last_unstale":"2024-02-10T08:30:26.072366+0000","last_undegraded":"2024-02-10T08:30:26.072366+0000","last_fullsized":"2024-02-10T08:30:26.072366+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'9","last_scrub_stamp":"2024-02-10T08:26:33.158025+0000","last_deep_scrub":"223'9","last_deep_scrub_stamp":"2024-02-10T08:26:33.158025+0000","last_clean_scrub_stamp":"2024-02-10T08:26:33.158025+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":317,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.061487+0000","last_change":"2024-02-10T08:28:38.232620+0000","last_active":"2024-02-10T08:30:26.061487+0000","last_peered":"2024-02-10T08:30:26.061487+0000","last_clean":"2024-02-10T08:30:26.061487+0000","last_became_active":"2024-02-10T08:28:38.232339+0000","last_became_peered":"2024-02-10T08:28:38.232339+0000","last_unstale":"2024-02-10T08:30:26.061487+0000","last_undegraded":"2024-02-10T08:30:26.061487+0000","last_fullsized":"2024-02-10T08:30:26.061487+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:25.490611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:28:25.490611+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,5],"acting":[6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":260,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.059038+0000","last_change":"2024-02-10T08:29:12.163752+0000","last_active":"2024-02-10T08:30:26.059038+0000","last_peered":"2024-02-10T08:30:26.059038+0000","last_clean":"2024-02-10T08:30:26.059038+0000","last_became_active":"2024-02-10T08:16:56.863948+0000","last_became_peered":"2024-02-10T08:16:56.863948+0000","last_unstale":"2024-02-10T08:30:26.059038+0000","last_undegraded":"2024-02-10T08:30:26.059038+0000","last_fullsized":"2024-02-10T08:30:26.059038+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:12.163638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:12.163638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":268,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.071964+0000","last_change":"2024-02-10T08:28:33.229127+0000","last_active":"2024-02-10T08:30:26.071964+0000","last_peered":"2024-02-10T08:30:26.071964+0000","last_clean":"2024-02-10T08:30:26.071964+0000","last_became_active":"2024-02-10T08:20:46.398903+0000","last_became_peered":"2024-02-10T08:20:46.398903+0000","last_unstale":"2024-02-10T08:30:26.071964+0000","last_undegraded":"2024-02-10T08:30:26.071964+0000","last_fullsized":"2024-02-10T08:30:26.071964+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:33.229018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:33.229018+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"225'20","reported_seq":207,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.079153+0000","last_change":"2024-02-10T08:26:14.189385+0000","last_active":"2024-02-10T08:30:26.079153+0000","last_peered":"2024-02-10T08:30:26.079153+0000","last_clean":"2024-02-10T08:30:26.079153+0000","last_became_active":"2024-02-10T08:22:23.534081+0000","last_became_peered":"2024-02-10T08:22:23.534081+0000","last_unstale":"2024-02-10T08:30:26.079153+0000","last_undegraded":"2024-02-10T08:30:26.079153+0000","last_fullsized":"2024-02-10T08:30:26.079153+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'10","last_scrub_stamp":"2024-02-10T08:26:14.187217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:26:14.187217+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":24,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":264,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.055349+0000","last_change":"2024-02-10T08:28:19.243016+0000","last_active":"2024-02-10T08:30:26.055349+0000","last_peered":"2024-02-10T08:30:26.055349+0000","last_clean":"2024-02-10T08:30:26.055349+0000","last_became_active":"2024-02-10T08:16:52.789834+0000","last_became_peered":"2024-02-10T08:16:52.789834+0000","last_unstale":"2024-02-10T08:30:26.055349+0000","last_undegraded":"2024-02-10T08:30:26.055349+0000","last_fullsized":"2024-02-10T08:30:26.055349+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:19.242936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:28:19.242936+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"244'12","reported_seq":473,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-10T08:30:30.109813+0000","last_change":"2024-02-10T08:28:16.291133+0000","last_active":"2024-02-10T08:30:30.109813+0000","last_peered":"2024-02-10T08:30:30.109813+0000","last_clean":"2024-02-10T08:30:30.109813+0000","last_became_active":"2024-02-10T08:28:02.776097+0000","last_became_peered":"2024-02-10T08:28:02.776097+0000","last_unstale":"2024-02-10T08:30:30.109813+0000","last_undegraded":"2024-02-10T08:30:30.109813+0000","last_fullsized":"2024-02-10T08:30:30.109813+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"244'12","last_scrub_stamp":"2024-02-10T08:28:16.291055+0000","last_deep_scrub":"89'9","last_deep_scrub_stamp":"2024-02-10T08:19:33.299671+0000","last_clean_scrub_stamp":"2024-02-10T08:28:16.291055+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":144,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.072022+0000","last_change":"2024-02-10T08:27:19.286440+0000","last_active":"2024-02-10T08:30:26.072022+0000","last_peered":"2024-02-10T08:30:26.072022+0000","last_clean":"2024-02-10T08:30:26.072022+0000","last_became_active":"2024-02-10T08:23:15.067821+0000","last_became_peered":"2024-02-10T08:23:15.067821+0000","last_unstale":"2024-02-10T08:30:26.072022+0000","last_undegraded":"2024-02-10T08:30:26.072022+0000","last_fullsized":"2024-02-10T08:30:26.072022+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:27:19.286346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:05.662947+0000","last_clean_scrub_stamp":"2024-02-10T08:27:19.286346+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"225'19","reported_seq":291,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.056321+0000","last_change":"2024-02-10T08:29:09.148326+0000","last_active":"2024-02-10T08:30:26.056321+0000","last_peered":"2024-02-10T08:30:26.056321+0000","last_clean":"2024-02-10T08:30:26.056321+0000","last_became_active":"2024-02-10T08:16:55.204734+0000","last_became_peered":"2024-02-10T08:16:55.204734+0000","last_unstale":"2024-02-10T08:30:26.056321+0000","last_undegraded":"2024-02-10T08:30:26.056321+0000","last_fullsized":"2024-02-10T08:30:26.056321+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'19","last_scrub_stamp":"2024-02-10T08:29:09.148231+0000","last_deep_scrub":"213'13","last_deep_scrub_stamp":"2024-02-10T08:25:43.713333+0000","last_clean_scrub_stamp":"2024-02-10T08:29:09.148231+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":217,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-10T08:30:30.113446+0000","last_change":"2024-02-10T08:27:18.873971+0000","last_active":"2024-02-10T08:30:30.113446+0000","last_peered":"2024-02-10T08:30:30.113446+0000","last_clean":"2024-02-10T08:30:30.113446+0000","last_became_active":"2024-02-10T08:23:34.717015+0000","last_became_peered":"2024-02-10T08:23:34.717015+0000","last_unstale":"2024-02-10T08:30:30.113446+0000","last_undegraded":"2024-02-10T08:30:30.113446+0000","last_fullsized":"2024-02-10T08:30:30.113446+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:27:18.873884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:27:18.873884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"165'10","reported_seq":295,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-10T08:30:30.112623+0000","last_change":"2024-02-10T08:26:15.114882+0000","last_active":"2024-02-10T08:30:30.112623+0000","last_peered":"2024-02-10T08:30:30.112623+0000","last_clean":"2024-02-10T08:30:30.112623+0000","last_became_active":"2024-02-10T08:23:15.080370+0000","last_became_peered":"2024-02-10T08:23:15.080370+0000","last_unstale":"2024-02-10T08:30:30.112623+0000","last_undegraded":"2024-02-10T08:30:30.112623+0000","last_fullsized":"2024-02-10T08:30:30.112623+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"165'10","last_scrub_stamp":"2024-02-10T08:26:15.114806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:26:15.114806+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,1],"acting":[7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":233,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-10T08:30:30.114369+0000","last_change":"2024-02-10T08:26:33.798697+0000","last_active":"2024-02-10T08:30:30.114369+0000","last_peered":"2024-02-10T08:30:30.114369+0000","last_clean":"2024-02-10T08:30:30.114369+0000","last_became_active":"2024-02-10T08:20:46.395788+0000","last_became_peered":"2024-02-10T08:20:46.395788+0000","last_unstale":"2024-02-10T08:30:30.114369+0000","last_undegraded":"2024-02-10T08:30:30.114369+0000","last_fullsized":"2024-02-10T08:30:30.114369+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:26:33.798586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:26:33.798586+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"225'15","reported_seq":266,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.063170+0000","last_change":"2024-02-10T08:28:25.952604+0000","last_active":"2024-02-10T08:30:26.063170+0000","last_peered":"2024-02-10T08:30:26.063170+0000","last_clean":"2024-02-10T08:30:26.063170+0000","last_became_active":"2024-02-10T08:28:25.952354+0000","last_became_peered":"2024-02-10T08:28:25.952354+0000","last_unstale":"2024-02-10T08:30:26.063170+0000","last_undegraded":"2024-02-10T08:30:26.063170+0000","last_fullsized":"2024-02-10T08:30:26.063170+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'15","last_scrub_stamp":"2024-02-10T08:28:21.454916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:28:21.454916+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":271,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.065734+0000","last_change":"2024-02-10T08:29:10.389220+0000","last_active":"2024-02-10T08:30:26.065734+0000","last_peered":"2024-02-10T08:30:26.065734+0000","last_clean":"2024-02-10T08:30:26.065734+0000","last_became_active":"2024-02-10T08:16:52.786213+0000","last_became_peered":"2024-02-10T08:16:52.786213+0000","last_unstale":"2024-02-10T08:30:26.065734+0000","last_undegraded":"2024-02-10T08:30:26.065734+0000","last_fullsized":"2024-02-10T08:30:26.065734+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:10.389138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:29:10.389138+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":93,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.063001+0000","last_change":"2024-02-10T08:29:01.325236+0000","last_active":"2024-02-10T08:30:26.063001+0000","last_peered":"2024-02-10T08:30:26.063001+0000","last_clean":"2024-02-10T08:30:26.063001+0000","last_became_active":"2024-02-10T08:28:25.950221+0000","last_became_peered":"2024-02-10T08:28:25.950221+0000","last_unstale":"2024-02-10T08:30:26.063001+0000","last_undegraded":"2024-02-10T08:30:26.063001+0000","last_fullsized":"2024-02-10T08:30:26.063001+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:01.325135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:01.325135+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":99,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.064247+0000","last_change":"2024-02-10T08:30:24.070738+0000","last_active":"2024-02-10T08:30:26.064247+0000","last_peered":"2024-02-10T08:30:26.064247+0000","last_clean":"2024-02-10T08:30:26.064247+0000","last_became_active":"2024-02-10T08:30:24.070440+0000","last_became_peered":"2024-02-10T08:30:24.070440+0000","last_unstale":"2024-02-10T08:30:26.064247+0000","last_undegraded":"2024-02-10T08:30:26.064247+0000","last_fullsized":"2024-02-10T08:30:26.064247+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:11.496105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:11.496105+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"225'24","reported_seq":300,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-10T08:30:30.113238+0000","last_change":"2024-02-10T08:28:35.984255+0000","last_active":"2024-02-10T08:30:30.113238+0000","last_peered":"2024-02-10T08:30:30.113238+0000","last_clean":"2024-02-10T08:30:30.113238+0000","last_became_active":"2024-02-10T08:20:46.396130+0000","last_became_peered":"2024-02-10T08:20:46.396130+0000","last_unstale":"2024-02-10T08:30:30.113238+0000","last_undegraded":"2024-02-10T08:30:30.113238+0000","last_fullsized":"2024-02-10T08:30:30.113238+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'24","last_scrub_stamp":"2024-02-10T08:28:35.984191+0000","last_deep_scrub":"201'16","last_deep_scrub_stamp":"2024-02-10T08:24:49.177357+0000","last_clean_scrub_stamp":"2024-02-10T08:28:35.984191+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":273,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.084400+0000","last_change":"2024-02-10T08:28:28.486997+0000","last_active":"2024-02-10T08:30:26.084400+0000","last_peered":"2024-02-10T08:30:26.084400+0000","last_clean":"2024-02-10T08:30:26.084400+0000","last_became_active":"2024-02-10T08:23:15.079635+0000","last_became_peered":"2024-02-10T08:23:15.079635+0000","last_unstale":"2024-02-10T08:30:26.084400+0000","last_undegraded":"2024-02-10T08:30:26.084400+0000","last_fullsized":"2024-02-10T08:30:26.084400+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:28.486926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:28:28.486926+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[1,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":267,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.082258+0000","last_change":"2024-02-10T08:28:20.394761+0000","last_active":"2024-02-10T08:30:26.082258+0000","last_peered":"2024-02-10T08:30:26.082258+0000","last_clean":"2024-02-10T08:30:26.082258+0000","last_became_active":"2024-02-10T08:23:15.078667+0000","last_became_peered":"2024-02-10T08:23:15.078667+0000","last_unstale":"2024-02-10T08:30:26.082258+0000","last_undegraded":"2024-02-10T08:30:26.082258+0000","last_fullsized":"2024-02-10T08:30:26.082258+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:20.394696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:28:20.394696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":183,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.059237+0000","last_change":"2024-02-10T08:30:24.063324+0000","last_active":"2024-02-10T08:30:26.059237+0000","last_peered":"2024-02-10T08:30:26.059237+0000","last_clean":"2024-02-10T08:30:26.059237+0000","last_became_active":"2024-02-10T08:30:24.063007+0000","last_became_peered":"2024-02-10T08:30:24.063007+0000","last_unstale":"2024-02-10T08:30:26.059237+0000","last_undegraded":"2024-02-10T08:30:26.059237+0000","last_fullsized":"2024-02-10T08:30:26.059237+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:27.240244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:27.240244+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"225'8","reported_seq":189,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.073288+0000","last_change":"2024-02-10T08:25:30.862232+0000","last_active":"2024-02-10T08:30:26.073288+0000","last_peered":"2024-02-10T08:30:26.073288+0000","last_clean":"2024-02-10T08:30:26.073288+0000","last_became_active":"2024-02-10T08:22:23.522936+0000","last_became_peered":"2024-02-10T08:22:23.522936+0000","last_unstale":"2024-02-10T08:30:26.073288+0000","last_undegraded":"2024-02-10T08:30:26.073288+0000","last_fullsized":"2024-02-10T08:30:26.073288+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'4","last_scrub_stamp":"2024-02-10T08:25:30.862066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:25:30.862066+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,6],"acting":[1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":269,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.059113+0000","last_change":"2024-02-10T08:29:10.131158+0000","last_active":"2024-02-10T08:30:26.059113+0000","last_peered":"2024-02-10T08:30:26.059113+0000","last_clean":"2024-02-10T08:30:26.059113+0000","last_became_active":"2024-02-10T08:16:52.788704+0000","last_became_peered":"2024-02-10T08:16:52.788704+0000","last_unstale":"2024-02-10T08:30:26.059113+0000","last_undegraded":"2024-02-10T08:30:26.059113+0000","last_fullsized":"2024-02-10T08:30:26.059113+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:10.131056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:29:10.131056+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":270,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.061410+0000","last_change":"2024-02-10T08:28:26.460262+0000","last_active":"2024-02-10T08:30:26.061410+0000","last_peered":"2024-02-10T08:30:26.061410+0000","last_clean":"2024-02-10T08:30:26.061410+0000","last_became_active":"2024-02-10T08:20:46.397495+0000","last_became_peered":"2024-02-10T08:20:46.397495+0000","last_unstale":"2024-02-10T08:30:26.061410+0000","last_undegraded":"2024-02-10T08:30:26.061410+0000","last_fullsized":"2024-02-10T08:30:26.061410+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:26.460158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:28:26.460158+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":282,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.069284+0000","last_change":"2024-02-10T08:30:24.064805+0000","last_active":"2024-02-10T08:30:26.069284+0000","last_peered":"2024-02-10T08:30:26.069284+0000","last_clean":"2024-02-10T08:30:26.069284+0000","last_became_active":"2024-02-10T08:30:24.064419+0000","last_became_peered":"2024-02-10T08:30:24.064419+0000","last_unstale":"2024-02-10T08:30:26.069284+0000","last_undegraded":"2024-02-10T08:30:26.069284+0000","last_fullsized":"2024-02-10T08:30:26.069284+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:12.421034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:27.276490+0000","last_clean_scrub_stamp":"2024-02-10T08:29:12.421034+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"225'19","reported_seq":213,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.071384+0000","last_change":"2024-02-10T08:29:22.312103+0000","last_active":"2024-02-10T08:30:26.071384+0000","last_peered":"2024-02-10T08:30:26.071384+0000","last_clean":"2024-02-10T08:30:26.071384+0000","last_became_active":"2024-02-10T08:22:23.526198+0000","last_became_peered":"2024-02-10T08:22:23.526198+0000","last_unstale":"2024-02-10T08:30:26.071384+0000","last_undegraded":"2024-02-10T08:30:26.071384+0000","last_fullsized":"2024-02-10T08:30:26.071384+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'19","last_scrub_stamp":"2024-02-10T08:29:22.312001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:29:22.312001+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":24,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":264,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.061594+0000","last_change":"2024-02-10T08:28:38.361039+0000","last_active":"2024-02-10T08:30:26.061594+0000","last_peered":"2024-02-10T08:30:26.061594+0000","last_clean":"2024-02-10T08:30:26.061594+0000","last_became_active":"2024-02-10T08:16:52.788629+0000","last_became_peered":"2024-02-10T08:16:52.788629+0000","last_unstale":"2024-02-10T08:30:26.061594+0000","last_undegraded":"2024-02-10T08:30:26.061594+0000","last_fullsized":"2024-02-10T08:30:26.061594+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:38.360929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:38.360929+0000","last_clean_scrub_stamp":"2024-02-10T08:28:38.360929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":275,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.070013+0000","last_change":"2024-02-10T08:29:19.380493+0000","last_active":"2024-02-10T08:30:26.070013+0000","last_peered":"2024-02-10T08:30:26.070013+0000","last_clean":"2024-02-10T08:30:26.070013+0000","last_became_active":"2024-02-10T08:20:46.399838+0000","last_became_peered":"2024-02-10T08:20:46.399838+0000","last_unstale":"2024-02-10T08:30:26.070013+0000","last_undegraded":"2024-02-10T08:30:26.070013+0000","last_fullsized":"2024-02-10T08:30:26.070013+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:19.380403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:19.380403+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":179,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.061701+0000","last_change":"2024-02-10T08:30:24.070253+0000","last_active":"2024-02-10T08:30:26.061701+0000","last_peered":"2024-02-10T08:30:26.061701+0000","last_clean":"2024-02-10T08:30:26.061701+0000","last_became_active":"2024-02-10T08:30:24.069665+0000","last_became_peered":"2024-02-10T08:30:24.069665+0000","last_unstale":"2024-02-10T08:30:26.061701+0000","last_undegraded":"2024-02-10T08:30:26.061701+0000","last_fullsized":"2024-02-10T08:30:26.061701+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:34.502781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:34.502781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,5],"acting":[6,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"225'25","reported_seq":349,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.063429+0000","last_change":"2024-02-10T08:28:38.118912+0000","last_active":"2024-02-10T08:30:26.063429+0000","last_peered":"2024-02-10T08:30:26.063429+0000","last_clean":"2024-02-10T08:30:26.063429+0000","last_became_active":"2024-02-10T08:28:25.951464+0000","last_became_peered":"2024-02-10T08:28:25.951464+0000","last_unstale":"2024-02-10T08:30:26.063429+0000","last_undegraded":"2024-02-10T08:30:26.063429+0000","last_fullsized":"2024-02-10T08:30:26.063429+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'25","last_scrub_stamp":"2024-02-10T08:28:38.118836+0000","last_deep_scrub":"74'15","last_deep_scrub_stamp":"2024-02-10T08:17:57.637346+0000","last_clean_scrub_stamp":"2024-02-10T08:28:38.118836+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":24,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":279,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.057854+0000","last_change":"2024-02-10T08:29:26.072110+0000","last_active":"2024-02-10T08:30:26.057854+0000","last_peered":"2024-02-10T08:30:26.057854+0000","last_clean":"2024-02-10T08:30:26.057854+0000","last_became_active":"2024-02-10T08:20:46.392466+0000","last_became_peered":"2024-02-10T08:20:46.392466+0000","last_unstale":"2024-02-10T08:30:26.057854+0000","last_undegraded":"2024-02-10T08:30:26.057854+0000","last_fullsized":"2024-02-10T08:30:26.057854+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:26.072031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:29:26.072031+0000","last_clean_scrub_stamp":"2024-02-10T08:29:26.072031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1f","version":"111'11","reported_seq":451,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-10T08:30:30.117830+0000","last_change":"2024-02-10T08:28:29.461568+0000","last_active":"2024-02-10T08:30:30.117830+0000","last_peered":"2024-02-10T08:30:30.117830+0000","last_clean":"2024-02-10T08:30:30.117830+0000","last_became_active":"2024-02-10T08:20:46.402663+0000","last_became_peered":"2024-02-10T08:20:46.402663+0000","last_unstale":"2024-02-10T08:30:30.117830+0000","last_undegraded":"2024-02-10T08:30:30.117830+0000","last_fullsized":"2024-02-10T08:30:30.117830+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'11","last_scrub_stamp":"2024-02-10T08:28:29.461499+0000","last_deep_scrub":"82'9","last_deep_scrub_stamp":"2024-02-10T08:18:36.323217+0000","last_clean_scrub_stamp":"2024-02-10T08:28:29.461499+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"87'2","reported_seq":260,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.073523+0000","last_change":"2024-02-10T08:28:37.261008+0000","last_active":"2024-02-10T08:30:26.073523+0000","last_peered":"2024-02-10T08:30:26.073523+0000","last_clean":"2024-02-10T08:30:26.073523+0000","last_became_active":"2024-02-10T08:16:58.859047+0000","last_became_peered":"2024-02-10T08:16:58.859047+0000","last_unstale":"2024-02-10T08:30:26.073523+0000","last_undegraded":"2024-02-10T08:30:26.073523+0000","last_fullsized":"2024-02-10T08:30:26.073523+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'2","last_scrub_stamp":"2024-02-10T08:28:37.260945+0000","last_deep_scrub":"87'2","last_deep_scrub_stamp":"2024-02-10T08:19:29.207531+0000","last_clean_scrub_stamp":"2024-02-10T08:28:37.260945+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"225'19","reported_seq":293,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.061864+0000","last_change":"2024-02-10T08:28:40.341710+0000","last_active":"2024-02-10T08:30:26.061864+0000","last_peered":"2024-02-10T08:30:26.061864+0000","last_clean":"2024-02-10T08:30:26.061864+0000","last_became_active":"2024-02-10T08:16:54.852665+0000","last_became_peered":"2024-02-10T08:16:54.852665+0000","last_unstale":"2024-02-10T08:30:26.061864+0000","last_undegraded":"2024-02-10T08:30:26.061864+0000","last_fullsized":"2024-02-10T08:30:26.061864+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'19","last_scrub_stamp":"2024-02-10T08:28:40.341641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:28:40.341641+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":197,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.061329+0000","last_change":"2024-02-10T08:29:14.469349+0000","last_active":"2024-02-10T08:30:26.061329+0000","last_peered":"2024-02-10T08:30:26.061329+0000","last_clean":"2024-02-10T08:30:26.061329+0000","last_became_active":"2024-02-10T08:28:02.773857+0000","last_became_peered":"2024-02-10T08:28:02.773857+0000","last_unstale":"2024-02-10T08:30:26.061329+0000","last_undegraded":"2024-02-10T08:30:26.061329+0000","last_fullsized":"2024-02-10T08:30:26.061329+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:14.469285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:25:42.124914+0000","last_clean_scrub_stamp":"2024-02-10T08:29:14.469285+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2],"acting":[6,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":90,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.063611+0000","last_change":"2024-02-10T08:28:32.177848+0000","last_active":"2024-02-10T08:30:26.063611+0000","last_peered":"2024-02-10T08:30:26.063611+0000","last_clean":"2024-02-10T08:30:26.063611+0000","last_became_active":"2024-02-10T08:28:25.951312+0000","last_became_peered":"2024-02-10T08:28:25.951312+0000","last_unstale":"2024-02-10T08:30:26.063611+0000","last_undegraded":"2024-02-10T08:30:26.063611+0000","last_fullsized":"2024-02-10T08:30:26.063611+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:32.177772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:28:32.177772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":269,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.084198+0000","last_change":"2024-02-10T08:29:20.739901+0000","last_active":"2024-02-10T08:30:26.084198+0000","last_peered":"2024-02-10T08:30:26.084198+0000","last_clean":"2024-02-10T08:30:26.084198+0000","last_became_active":"2024-02-10T08:20:46.408504+0000","last_became_peered":"2024-02-10T08:20:46.408504+0000","last_unstale":"2024-02-10T08:30:26.084198+0000","last_undegraded":"2024-02-10T08:30:26.084198+0000","last_fullsized":"2024-02-10T08:30:26.084198+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:20.739750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:22.104988+0000","last_clean_scrub_stamp":"2024-02-10T08:29:20.739750+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"225'27","reported_seq":331,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.057878+0000","last_change":"2024-02-10T08:26:28.089083+0000","last_active":"2024-02-10T08:30:26.057878+0000","last_peered":"2024-02-10T08:30:26.057878+0000","last_clean":"2024-02-10T08:30:26.057878+0000","last_became_active":"2024-02-10T08:23:34.712669+0000","last_became_peered":"2024-02-10T08:23:34.712669+0000","last_unstale":"2024-02-10T08:30:26.057878+0000","last_undegraded":"2024-02-10T08:30:26.057878+0000","last_fullsized":"2024-02-10T08:30:26.057878+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'15","last_scrub_stamp":"2024-02-10T08:26:28.088989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:26:28.088989+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4],"acting":[2,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":279,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.065077+0000","last_change":"2024-02-10T08:28:33.456849+0000","last_active":"2024-02-10T08:30:26.065077+0000","last_peered":"2024-02-10T08:30:26.065077+0000","last_clean":"2024-02-10T08:30:26.065077+0000","last_became_active":"2024-02-10T08:20:46.396303+0000","last_became_peered":"2024-02-10T08:20:46.396303+0000","last_unstale":"2024-02-10T08:30:26.065077+0000","last_undegraded":"2024-02-10T08:30:26.065077+0000","last_fullsized":"2024-02-10T08:30:26.065077+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:33.456780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:10.370746+0000","last_clean_scrub_stamp":"2024-02-10T08:28:33.456780+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":289,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.084685+0000","last_change":"2024-02-10T08:29:25.682482+0000","last_active":"2024-02-10T08:30:26.084685+0000","last_peered":"2024-02-10T08:30:26.084685+0000","last_clean":"2024-02-10T08:30:26.084685+0000","last_became_active":"2024-02-10T08:28:02.763523+0000","last_became_peered":"2024-02-10T08:28:02.763523+0000","last_unstale":"2024-02-10T08:30:26.084685+0000","last_undegraded":"2024-02-10T08:30:26.084685+0000","last_fullsized":"2024-02-10T08:30:26.084685+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:25.682383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:25.682383+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":238,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-10T08:30:30.115078+0000","last_change":"2024-02-10T08:29:00.918497+0000","last_active":"2024-02-10T08:30:30.115078+0000","last_peered":"2024-02-10T08:30:30.115078+0000","last_clean":"2024-02-10T08:30:30.115078+0000","last_became_active":"2024-02-10T08:20:46.403378+0000","last_became_peered":"2024-02-10T08:20:46.403378+0000","last_unstale":"2024-02-10T08:30:30.115078+0000","last_undegraded":"2024-02-10T08:30:30.115078+0000","last_fullsized":"2024-02-10T08:30:30.115078+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:00.918382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:00.918382+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"226'23","reported_seq":250,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.084561+0000","last_change":"2024-02-10T08:29:19.670237+0000","last_active":"2024-02-10T08:30:26.084561+0000","last_peered":"2024-02-10T08:30:26.084561+0000","last_clean":"2024-02-10T08:30:26.084561+0000","last_became_active":"2024-02-10T08:23:34.710443+0000","last_became_peered":"2024-02-10T08:23:34.710443+0000","last_unstale":"2024-02-10T08:30:26.084561+0000","last_undegraded":"2024-02-10T08:30:26.084561+0000","last_fullsized":"2024-02-10T08:30:26.084561+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"226'23","last_scrub_stamp":"2024-02-10T08:29:19.670143+0000","last_deep_scrub":"74'17","last_deep_scrub_stamp":"2024-02-10T08:18:02.949298+0000","last_clean_scrub_stamp":"2024-02-10T08:29:19.670143+0000","log_size":23,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":25,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,6],"acting":[1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":174,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.072023+0000","last_change":"2024-02-10T08:26:14.128513+0000","last_active":"2024-02-10T08:30:26.072023+0000","last_peered":"2024-02-10T08:30:26.072023+0000","last_clean":"2024-02-10T08:30:26.072023+0000","last_became_active":"2024-02-10T08:23:34.728772+0000","last_became_peered":"2024-02-10T08:23:34.728772+0000","last_unstale":"2024-02-10T08:30:26.072023+0000","last_undegraded":"2024-02-10T08:30:26.072023+0000","last_fullsized":"2024-02-10T08:30:26.072023+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:26:14.128447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:26:14.128447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":235,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-10T08:30:30.115461+0000","last_change":"2024-02-10T08:26:26.889748+0000","last_active":"2024-02-10T08:30:30.115461+0000","last_peered":"2024-02-10T08:30:30.115461+0000","last_clean":"2024-02-10T08:30:30.115461+0000","last_became_active":"2024-02-10T08:20:46.398532+0000","last_became_peered":"2024-02-10T08:20:46.398532+0000","last_unstale":"2024-02-10T08:30:30.115461+0000","last_undegraded":"2024-02-10T08:30:30.115461+0000","last_fullsized":"2024-02-10T08:30:30.115461+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:26:26.889655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:26:26.889655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":170,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.062015+0000","last_change":"2024-02-10T08:28:27.516339+0000","last_active":"2024-02-10T08:30:26.062015+0000","last_peered":"2024-02-10T08:30:26.062015+0000","last_clean":"2024-02-10T08:30:26.062015+0000","last_became_active":"2024-02-10T08:22:23.526229+0000","last_became_peered":"2024-02-10T08:22:23.526229+0000","last_unstale":"2024-02-10T08:30:26.062015+0000","last_undegraded":"2024-02-10T08:30:26.062015+0000","last_fullsized":"2024-02-10T08:30:26.062015+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:27.516251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:27.516251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1a","version":"225'15","reported_seq":287,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.062940+0000","last_change":"2024-02-10T08:29:13.500113+0000","last_active":"2024-02-10T08:30:26.062940+0000","last_peered":"2024-02-10T08:30:26.062940+0000","last_clean":"2024-02-10T08:30:26.062940+0000","last_became_active":"2024-02-10T08:28:38.226796+0000","last_became_peered":"2024-02-10T08:28:38.226796+0000","last_unstale":"2024-02-10T08:30:26.062940+0000","last_undegraded":"2024-02-10T08:30:26.062940+0000","last_fullsized":"2024-02-10T08:30:26.062940+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'15","last_scrub_stamp":"2024-02-10T08:29:13.500017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:29:13.500017+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":264,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.073249+0000","last_change":"2024-02-10T08:29:26.213501+0000","last_active":"2024-02-10T08:30:26.073249+0000","last_peered":"2024-02-10T08:30:26.073249+0000","last_clean":"2024-02-10T08:30:26.073249+0000","last_became_active":"2024-02-10T08:16:52.787865+0000","last_became_peered":"2024-02-10T08:16:52.787865+0000","last_unstale":"2024-02-10T08:30:26.073249+0000","last_undegraded":"2024-02-10T08:30:26.073249+0000","last_fullsized":"2024-02-10T08:30:26.073249+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:26.213417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:28.028556+0000","last_clean_scrub_stamp":"2024-02-10T08:29:26.213417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":292,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.055946+0000","last_change":"2024-02-10T08:29:22.172003+0000","last_active":"2024-02-10T08:30:26.055946+0000","last_peered":"2024-02-10T08:30:26.055946+0000","last_clean":"2024-02-10T08:30:26.055946+0000","last_became_active":"2024-02-10T08:28:19.065132+0000","last_became_peered":"2024-02-10T08:28:19.065132+0000","last_unstale":"2024-02-10T08:30:26.055946+0000","last_undegraded":"2024-02-10T08:30:26.055946+0000","last_fullsized":"2024-02-10T08:30:26.055946+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:22.171906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:22.171906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,7],"acting":[5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":146,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.073726+0000","last_change":"2024-02-10T08:27:19.250964+0000","last_active":"2024-02-10T08:30:26.073726+0000","last_peered":"2024-02-10T08:30:26.073726+0000","last_clean":"2024-02-10T08:30:26.073726+0000","last_became_active":"2024-02-10T08:23:15.078168+0000","last_became_peered":"2024-02-10T08:23:15.078168+0000","last_unstale":"2024-02-10T08:30:26.073726+0000","last_undegraded":"2024-02-10T08:30:26.073726+0000","last_fullsized":"2024-02-10T08:30:26.073726+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:27:19.250878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:27:19.250878+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,2],"acting":[1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"225'7","reported_seq":289,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-10T08:30:30.113371+0000","last_change":"2024-02-10T08:27:27.742734+0000","last_active":"2024-02-10T08:30:30.113371+0000","last_peered":"2024-02-10T08:30:30.113371+0000","last_clean":"2024-02-10T08:30:30.113371+0000","last_became_active":"2024-02-10T08:27:27.715306+0000","last_became_peered":"2024-02-10T08:27:27.715306+0000","last_unstale":"2024-02-10T08:30:30.113371+0000","last_undegraded":"2024-02-10T08:30:30.113371+0000","last_fullsized":"2024-02-10T08:30:30.113371+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'7","last_scrub_stamp":"2024-02-10T08:27:19.895566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:27:19.895566+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":9,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"55'1","reported_seq":292,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.072113+0000","last_change":"2024-02-10T08:28:02.870043+0000","last_active":"2024-02-10T08:30:26.072113+0000","last_peered":"2024-02-10T08:30:26.072113+0000","last_clean":"2024-02-10T08:30:26.072113+0000","last_became_active":"2024-02-10T08:28:02.761299+0000","last_became_peered":"2024-02-10T08:28:02.761299+0000","last_unstale":"2024-02-10T08:30:26.072113+0000","last_undegraded":"2024-02-10T08:30:26.072113+0000","last_fullsized":"2024-02-10T08:30:26.072113+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'1","last_scrub_stamp":"2024-02-10T08:27:18.293859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:27:18.293859+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1746,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":275,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.069097+0000","last_change":"2024-02-10T08:28:38.278860+0000","last_active":"2024-02-10T08:30:26.069097+0000","last_peered":"2024-02-10T08:30:26.069097+0000","last_clean":"2024-02-10T08:30:26.069097+0000","last_became_active":"2024-02-10T08:20:46.406783+0000","last_became_peered":"2024-02-10T08:20:46.406783+0000","last_unstale":"2024-02-10T08:30:26.069097+0000","last_undegraded":"2024-02-10T08:30:26.069097+0000","last_fullsized":"2024-02-10T08:30:26.069097+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:38.278752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:28:38.278752+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":267,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.059151+0000","last_change":"2024-02-10T08:29:08.143346+0000","last_active":"2024-02-10T08:30:26.059151+0000","last_peered":"2024-02-10T08:30:26.059151+0000","last_clean":"2024-02-10T08:30:26.059151+0000","last_became_active":"2024-02-10T08:23:15.125955+0000","last_became_peered":"2024-02-10T08:23:15.125955+0000","last_unstale":"2024-02-10T08:30:26.059151+0000","last_undegraded":"2024-02-10T08:30:26.059151+0000","last_fullsized":"2024-02-10T08:30:26.059151+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:08.143236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:08.143236+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,2],"acting":[5,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"225'15","reported_seq":262,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-10T08:30:30.117284+0000","last_change":"2024-02-10T08:29:07.977048+0000","last_active":"2024-02-10T08:30:30.117284+0000","last_peered":"2024-02-10T08:30:30.117284+0000","last_clean":"2024-02-10T08:30:30.117284+0000","last_became_active":"2024-02-10T08:20:46.404966+0000","last_became_peered":"2024-02-10T08:20:46.404966+0000","last_unstale":"2024-02-10T08:30:30.117284+0000","last_undegraded":"2024-02-10T08:30:30.117284+0000","last_fullsized":"2024-02-10T08:30:30.117284+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'15","last_scrub_stamp":"2024-02-10T08:29:07.976943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:29:07.976943+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":152,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.059308+0000","last_change":"2024-02-10T08:28:15.255199+0000","last_active":"2024-02-10T08:30:26.059308+0000","last_peered":"2024-02-10T08:30:26.059308+0000","last_clean":"2024-02-10T08:30:26.059308+0000","last_became_active":"2024-02-10T08:23:15.074301+0000","last_became_peered":"2024-02-10T08:23:15.074301+0000","last_unstale":"2024-02-10T08:30:26.059308+0000","last_undegraded":"2024-02-10T08:30:26.059308+0000","last_fullsized":"2024-02-10T08:30:26.059308+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:15.255132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:28:15.255132+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":256,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.072795+0000","last_change":"2024-02-10T08:28:24.450504+0000","last_active":"2024-02-10T08:30:26.072795+0000","last_peered":"2024-02-10T08:30:26.072795+0000","last_clean":"2024-02-10T08:30:26.072795+0000","last_became_active":"2024-02-10T08:16:56.863353+0000","last_became_peered":"2024-02-10T08:16:56.863353+0000","last_unstale":"2024-02-10T08:30:26.072795+0000","last_undegraded":"2024-02-10T08:30:26.072795+0000","last_fullsized":"2024-02-10T08:30:26.072795+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:24.450350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:28:24.450350+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":238,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-10T08:30:30.112973+0000","last_change":"2024-02-10T08:29:25.024508+0000","last_active":"2024-02-10T08:30:30.112973+0000","last_peered":"2024-02-10T08:30:30.112973+0000","last_clean":"2024-02-10T08:30:30.112973+0000","last_became_active":"2024-02-10T08:20:46.405314+0000","last_became_peered":"2024-02-10T08:20:46.405314+0000","last_unstale":"2024-02-10T08:30:30.112973+0000","last_undegraded":"2024-02-10T08:30:30.112973+0000","last_fullsized":"2024-02-10T08:30:30.112973+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:25.024412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:29:25.024412+0000","last_clean_scrub_stamp":"2024-02-10T08:29:25.024412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"225'27","reported_seq":300,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.059000+0000","last_change":"2024-02-10T08:29:18.566459+0000","last_active":"2024-02-10T08:30:26.059000+0000","last_peered":"2024-02-10T08:30:26.059000+0000","last_clean":"2024-02-10T08:30:26.059000+0000","last_became_active":"2024-02-10T08:28:02.789308+0000","last_became_peered":"2024-02-10T08:28:02.789308+0000","last_unstale":"2024-02-10T08:30:26.059000+0000","last_undegraded":"2024-02-10T08:30:26.059000+0000","last_fullsized":"2024-02-10T08:30:26.059000+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'27","last_scrub_stamp":"2024-02-10T08:29:18.566350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:29:18.566350+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":216,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.072210+0000","last_change":"2024-02-10T08:28:31.264421+0000","last_active":"2024-02-10T08:30:26.072210+0000","last_peered":"2024-02-10T08:30:26.072210+0000","last_clean":"2024-02-10T08:30:26.072210+0000","last_became_active":"2024-02-10T08:23:34.723324+0000","last_became_peered":"2024-02-10T08:23:34.723324+0000","last_unstale":"2024-02-10T08:30:26.072210+0000","last_undegraded":"2024-02-10T08:30:26.072210+0000","last_fullsized":"2024-02-10T08:30:26.072210+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:31.264352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:28:31.264352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":81,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.060888+0000","last_change":"2024-02-10T08:29:04.389674+0000","last_active":"2024-02-10T08:30:26.060888+0000","last_peered":"2024-02-10T08:30:26.060888+0000","last_clean":"2024-02-10T08:30:26.060888+0000","last_became_active":"2024-02-10T08:28:38.236371+0000","last_became_peered":"2024-02-10T08:28:38.236371+0000","last_unstale":"2024-02-10T08:30:26.060888+0000","last_undegraded":"2024-02-10T08:30:26.060888+0000","last_fullsized":"2024-02-10T08:30:26.060888+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:04.388074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:04.388074+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,2],"acting":[6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":179,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.071745+0000","last_change":"2024-02-10T08:29:06.366400+0000","last_active":"2024-02-10T08:30:26.071745+0000","last_peered":"2024-02-10T08:30:26.071745+0000","last_clean":"2024-02-10T08:30:26.071745+0000","last_became_active":"2024-02-10T08:23:15.079180+0000","last_became_peered":"2024-02-10T08:23:15.079180+0000","last_unstale":"2024-02-10T08:30:26.071745+0000","last_undegraded":"2024-02-10T08:30:26.071745+0000","last_fullsized":"2024-02-10T08:30:26.071745+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:06.366305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:06.366305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":172,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.074023+0000","last_change":"2024-02-10T08:29:01.651198+0000","last_active":"2024-02-10T08:30:26.074023+0000","last_peered":"2024-02-10T08:30:26.074023+0000","last_clean":"2024-02-10T08:30:26.074023+0000","last_became_active":"2024-02-10T08:22:00.581772+0000","last_became_peered":"2024-02-10T08:22:00.581772+0000","last_unstale":"2024-02-10T08:30:26.074023+0000","last_undegraded":"2024-02-10T08:30:26.074023+0000","last_fullsized":"2024-02-10T08:30:26.074023+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:01.651093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:01.651093+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,7],"acting":[1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":181,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.071010+0000","last_change":"2024-02-10T08:28:38.233240+0000","last_active":"2024-02-10T08:30:26.071010+0000","last_peered":"2024-02-10T08:30:26.071010+0000","last_clean":"2024-02-10T08:30:26.071010+0000","last_became_active":"2024-02-10T08:28:38.232920+0000","last_became_peered":"2024-02-10T08:28:38.232920+0000","last_unstale":"2024-02-10T08:30:26.071010+0000","last_undegraded":"2024-02-10T08:30:26.071010+0000","last_fullsized":"2024-02-10T08:30:26.071010+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:18.099177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:18.099177+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,1],"acting":[7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":177,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.064760+0000","last_change":"2024-02-10T08:29:19.512005+0000","last_active":"2024-02-10T08:30:26.064760+0000","last_peered":"2024-02-10T08:30:26.064760+0000","last_clean":"2024-02-10T08:30:26.064760+0000","last_became_active":"2024-02-10T08:22:00.600200+0000","last_became_peered":"2024-02-10T08:22:00.600200+0000","last_unstale":"2024-02-10T08:30:26.064760+0000","last_undegraded":"2024-02-10T08:30:26.064760+0000","last_fullsized":"2024-02-10T08:30:26.064760+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:19.511918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:19.511918+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1],"acting":[6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":161,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.062814+0000","last_change":"2024-02-10T08:29:22.556568+0000","last_active":"2024-02-10T08:30:26.062814+0000","last_peered":"2024-02-10T08:30:26.062814+0000","last_clean":"2024-02-10T08:30:26.062814+0000","last_became_active":"2024-02-10T08:28:25.999335+0000","last_became_peered":"2024-02-10T08:28:25.999335+0000","last_unstale":"2024-02-10T08:30:26.062814+0000","last_undegraded":"2024-02-10T08:30:26.062814+0000","last_fullsized":"2024-02-10T08:30:26.062814+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:22.556451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:22.556451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":277,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.055586+0000","last_change":"2024-02-10T08:29:19.225386+0000","last_active":"2024-02-10T08:30:26.055586+0000","last_peered":"2024-02-10T08:30:26.055586+0000","last_clean":"2024-02-10T08:30:26.055586+0000","last_became_active":"2024-02-10T08:23:15.064896+0000","last_became_peered":"2024-02-10T08:23:15.064896+0000","last_unstale":"2024-02-10T08:30:26.055586+0000","last_undegraded":"2024-02-10T08:30:26.055586+0000","last_fullsized":"2024-02-10T08:30:26.055586+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:19.225297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:19.225297+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":287,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.061572+0000","last_change":"2024-02-10T08:29:21.602049+0000","last_active":"2024-02-10T08:30:26.061572+0000","last_peered":"2024-02-10T08:30:26.061572+0000","last_clean":"2024-02-10T08:30:26.061572+0000","last_became_active":"2024-02-10T08:27:27.710587+0000","last_became_peered":"2024-02-10T08:27:27.710587+0000","last_unstale":"2024-02-10T08:30:26.061572+0000","last_undegraded":"2024-02-10T08:30:26.061572+0000","last_fullsized":"2024-02-10T08:30:26.061572+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:21.601953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:11.750537+0000","last_clean_scrub_stamp":"2024-02-10T08:29:21.601953+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,1],"acting":[6,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":181,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.083178+0000","last_change":"2024-02-10T08:29:02.618622+0000","last_active":"2024-02-10T08:30:26.083178+0000","last_peered":"2024-02-10T08:30:26.083178+0000","last_clean":"2024-02-10T08:30:26.083178+0000","last_became_active":"2024-02-10T08:23:15.077457+0000","last_became_peered":"2024-02-10T08:23:15.077457+0000","last_unstale":"2024-02-10T08:30:26.083178+0000","last_undegraded":"2024-02-10T08:30:26.083178+0000","last_fullsized":"2024-02-10T08:30:26.083178+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:02.618499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:02.618499+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":186,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.061527+0000","last_change":"2024-02-10T08:29:17.607943+0000","last_active":"2024-02-10T08:30:26.061527+0000","last_peered":"2024-02-10T08:30:26.061527+0000","last_clean":"2024-02-10T08:30:26.061527+0000","last_became_active":"2024-02-10T08:23:15.079456+0000","last_became_peered":"2024-02-10T08:23:15.079456+0000","last_unstale":"2024-02-10T08:30:26.061527+0000","last_undegraded":"2024-02-10T08:30:26.061527+0000","last_fullsized":"2024-02-10T08:30:26.061527+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:17.607818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:17.607818+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":262,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.058438+0000","last_change":"2024-02-10T08:26:32.121942+0000","last_active":"2024-02-10T08:30:26.058438+0000","last_peered":"2024-02-10T08:30:26.058438+0000","last_clean":"2024-02-10T08:30:26.058438+0000","last_became_active":"2024-02-10T08:22:00.578118+0000","last_became_peered":"2024-02-10T08:22:00.578118+0000","last_unstale":"2024-02-10T08:30:26.058438+0000","last_undegraded":"2024-02-10T08:30:26.058438+0000","last_fullsized":"2024-02-10T08:30:26.058438+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:26:32.121852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:26:32.121852+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,6],"acting":[2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.29","version":"76'2","reported_seq":220,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.071098+0000","last_change":"2024-02-10T08:28:02.797804+0000","last_active":"2024-02-10T08:30:26.071098+0000","last_peered":"2024-02-10T08:30:26.071098+0000","last_clean":"2024-02-10T08:30:26.071098+0000","last_became_active":"2024-02-10T08:28:02.767822+0000","last_became_peered":"2024-02-10T08:28:02.767822+0000","last_unstale":"2024-02-10T08:30:26.071098+0000","last_undegraded":"2024-02-10T08:30:26.071098+0000","last_fullsized":"2024-02-10T08:30:26.071098+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":6,"last_scrub":"76'2","last_scrub_stamp":"2024-02-10T08:19:28.458129+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2024-02-10T08:18:08.680038+0000","last_clean_scrub_stamp":"2024-02-10T08:19:28.458129+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":26,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,0],"acting":[7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.069823+0000","last_change":"2024-02-10T08:30:26.068131+0000","last_active":"2024-02-10T08:30:26.069823+0000","last_peered":"2024-02-10T08:30:26.069823+0000","last_clean":"2024-02-10T08:30:26.069823+0000","last_became_active":"2024-02-10T08:30:26.067777+0000","last_became_peered":"2024-02-10T08:30:26.067777+0000","last_unstale":"2024-02-10T08:30:26.069823+0000","last_undegraded":"2024-02-10T08:30:26.069823+0000","last_fullsized":"2024-02-10T08:30:26.069823+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:30.227120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:20.392249+0000","last_clean_scrub_stamp":"2024-02-10T08:28:30.227120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.085325+0000","last_change":"2024-02-10T08:30:26.080634+0000","last_active":"2024-02-10T08:30:26.085325+0000","last_peered":"2024-02-10T08:30:26.085325+0000","last_clean":"2024-02-10T08:30:26.085325+0000","last_became_active":"2024-02-10T08:30:26.079913+0000","last_became_peered":"2024-02-10T08:30:26.079913+0000","last_unstale":"2024-02-10T08:30:26.085325+0000","last_undegraded":"2024-02-10T08:30:26.085325+0000","last_fullsized":"2024-02-10T08:30:26.085325+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:26:20.173948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:26:20.173948+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":196,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.074423+0000","last_change":"2024-02-10T08:30:26.067617+0000","last_active":"2024-02-10T08:30:26.074423+0000","last_peered":"2024-02-10T08:30:26.074423+0000","last_clean":"2024-02-10T08:30:26.074423+0000","last_became_active":"2024-02-10T08:30:26.067308+0000","last_became_peered":"2024-02-10T08:30:26.067308+0000","last_unstale":"2024-02-10T08:30:26.074423+0000","last_undegraded":"2024-02-10T08:30:26.074423+0000","last_fullsized":"2024-02-10T08:30:26.074423+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:15.491747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:20:30.227375+0000","last_clean_scrub_stamp":"2024-02-10T08:29:15.491747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,5],"acting":[6,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":276,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.093614+0000","last_change":"2024-02-10T08:30:26.085599+0000","last_active":"2024-02-10T08:30:26.093614+0000","last_peered":"2024-02-10T08:30:26.093614+0000","last_clean":"2024-02-10T08:30:26.093614+0000","last_became_active":"2024-02-10T08:30:26.085360+0000","last_became_peered":"2024-02-10T08:30:26.085360+0000","last_unstale":"2024-02-10T08:30:26.093614+0000","last_undegraded":"2024-02-10T08:30:26.093614+0000","last_fullsized":"2024-02-10T08:30:26.093614+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:36.163125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:36.163125+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,5],"acting":[2,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.081670+0000","last_change":"2024-02-10T08:30:26.075782+0000","last_active":"2024-02-10T08:30:26.081670+0000","last_peered":"2024-02-10T08:30:26.081670+0000","last_clean":"2024-02-10T08:30:26.081670+0000","last_became_active":"2024-02-10T08:30:26.075472+0000","last_became_peered":"2024-02-10T08:30:26.075472+0000","last_unstale":"2024-02-10T08:30:26.081670+0000","last_undegraded":"2024-02-10T08:30:26.081670+0000","last_fullsized":"2024-02-10T08:30:26.081670+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:26.976023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:26.976023+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.084618+0000","last_change":"2024-02-10T08:30:26.080944+0000","last_active":"2024-02-10T08:30:26.084618+0000","last_peered":"2024-02-10T08:30:26.084618+0000","last_clean":"2024-02-10T08:30:26.084618+0000","last_became_active":"2024-02-10T08:30:26.080539+0000","last_became_peered":"2024-02-10T08:30:26.080539+0000","last_unstale":"2024-02-10T08:30:26.084618+0000","last_undegraded":"2024-02-10T08:30:26.084618+0000","last_fullsized":"2024-02-10T08:30:26.084618+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:34.215363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:34.215363+0000","last_clean_scrub_stamp":"2024-02-10T08:28:34.215363+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.091265+0000","last_change":"2024-02-10T08:30:26.088483+0000","last_active":"2024-02-10T08:30:26.091265+0000","last_peered":"2024-02-10T08:30:26.091265+0000","last_clean":"2024-02-10T08:30:26.091265+0000","last_became_active":"2024-02-10T08:30:26.088228+0000","last_became_peered":"2024-02-10T08:30:26.088228+0000","last_unstale":"2024-02-10T08:30:26.091265+0000","last_undegraded":"2024-02-10T08:30:26.091265+0000","last_fullsized":"2024-02-10T08:30:26.091265+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:11.496105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:11.496105+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1],"acting":[7,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":191,"reported_epoch":290,"state":"active+clean","last_fresh":"2024-02-10T08:30:26.080642+0000","last_change":"2024-02-10T08:30:26.072341+0000","last_active":"2024-02-10T08:30:26.080642+0000","last_peered":"2024-02-10T08:30:26.080642+0000","last_clean":"2024-02-10T08:30:26.080642+0000","last_became_active":"2024-02-10T08:30:26.072022+0000","last_became_peered":"2024-02-10T08:30:26.072022+0000","last_unstale":"2024-02-10T08:30:26.080642+0000","last_undegraded":"2024-02-10T08:30:26.080642+0000","last_fullsized":"2024-02-10T08:30:26.080642+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:27.240244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:27.240244+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":6235815960,"num_objects":95152,"num_object_clones":0,"num_object_copies":285456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":11332,"num_objects_unfound":0,"num_objects_dirty":95152,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":148322,"num_write_kb":7791105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":537,"num_bytes_recovered":35192832,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":18770833408,"data_stored":18770821192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74033,"ondisk_log_size":74033,"up":48,"acting":48,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2646,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":4},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":810,"num_read_kb":805,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":9,"acting":9,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":1107,"num_read_kb":864,"num_write":703,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":127,"num_bytes_recovered":3108,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":725,"ondisk_log_size":725,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":89,"ondisk_log_size":89,"up":96,"acting":96,"num_store_stats":8},{"poolid":6,"num_pg":52,"stat_sum":{"num_bytes":376,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":26,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":156,"acting":156,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":50,"seq":214748364968,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":4510340,"kb_used_data":4209020,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":89234812,"statfs":{"total":95995035648,"available":91376447488,"internally_reserved":0,"allocated":4310036480,"data_stored":4309625174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,0,2,4,2],"upper_bound":32},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:30:10 2024","interfaces":[{"interface":"back","average":{"1min":2.4279999999999999,"5min":1.9019999999999999,"15min":1.298},"min":{"1min":0.23699999999999999,"5min":0.20899999999999999,"15min":0.20300000000000001},"max":{"1min":7.8099999999999996,"5min":14.734,"15min":21.175999999999998},"last":3.0449999999999999},{"interface":"front","average":{"1min":1.6200000000000001,"5min":1.8420000000000001,"15min":1.6379999999999999},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":4.6900000000000004,"5min":13.204000000000001,"15min":22.57},"last":2.4950000000000001}]},{"osd":1,"last update":"Sat Feb 10 08:30:10 2024","interfaces":[{"interface":"back","average":{"1min":4.2949999999999999,"5min":2.1709999999999998,"15min":1.4219999999999999},"min":{"1min":0.222,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":41.539999999999999,"5min":41.539999999999999,"15min":41.539999999999999},"last":3.0870000000000002},{"interface":"front","average":{"1min":3.653,"5min":2.0129999999999999,"15min":1.462},"min":{"1min":0.27300000000000002,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":41.046999999999997,"5min":41.046999999999997,"15min":41.046999999999997},"last":2.4359999999999999}]},{"osd":2,"last update":"Sat Feb 10 08:30:10 2024","interfaces":[{"interface":"back","average":{"1min":1.9950000000000001,"5min":1.518,"15min":1.26},"min":{"1min":0.26600000000000001,"5min":0.255,"15min":0.251},"max":{"1min":7.0179999999999998,"5min":8.3940000000000001,"15min":8.3940000000000001},"last":2.948},{"interface":"front","average":{"1min":1.9950000000000001,"5min":1.5189999999999999,"15min":1.3029999999999999},"min":{"1min":0.313,"5min":0.31,"15min":0.25900000000000001},"max":{"1min":8.0229999999999997,"5min":8.0229999999999997,"15min":12.797000000000001},"last":3.0659999999999998}]},{"osd":3,"last update":"Sat Feb 10 08:30:10 2024","interfaces":[{"interface":"back","average":{"1min":1.929,"5min":1.5680000000000001,"15min":1.3169999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.27700000000000002},"max":{"1min":7.0490000000000004,"5min":13.07,"15min":18.515000000000001},"last":3.1190000000000002},{"interface":"front","average":{"1min":2.0430000000000001,"5min":1.6020000000000001,"15min":1.3859999999999999},"min":{"1min":0.30099999999999999,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":8.2409999999999997,"5min":8.5800000000000001,"15min":9.9969999999999999},"last":3.1059999999999999}]},{"osd":4,"last update":"Sat Feb 10 08:30:05 2024","interfaces":[{"interface":"back","average":{"1min":1.5720000000000001,"5min":1.282,"15min":0.80900000000000005},"min":{"1min":0.25700000000000001,"5min":0.22700000000000001,"15min":0.216},"max":{"1min":7.0979999999999999,"5min":9.7590000000000003,"15min":9.7590000000000003},"last":3.923},{"interface":"front","average":{"1min":1.99,"5min":1.496,"15min":0.83399999999999996},"min":{"1min":0.24099999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":6.484,"5min":12.987,"15min":12.987},"last":3.0230000000000001}]},{"osd":5,"last update":"Sat Feb 10 08:30:10 2024","interfaces":[{"interface":"back","average":{"1min":3.5259999999999998,"5min":2.1280000000000001,"15min":1.05},"min":{"1min":0.26400000000000001,"5min":0.24199999999999999,"15min":0.218},"max":{"1min":15.304,"5min":15.304,"15min":15.304},"last":5.1070000000000002},{"interface":"front","average":{"1min":2.5459999999999998,"5min":1.633,"15min":0.95399999999999996},"min":{"1min":0.255,"5min":0.255,"15min":0.22600000000000001},"max":{"1min":6.4329999999999998,"5min":10.023999999999999,"15min":10.023999999999999},"last":2.1739999999999999}]},{"osd":6,"last update":"Sat Feb 10 08:30:10 2024","interfaces":[{"interface":"back","average":{"1min":1.52,"5min":1.3939999999999999,"15min":0.83699999999999997},"min":{"1min":0.30199999999999999,"5min":0.27500000000000002,"15min":0.26100000000000001},"max":{"1min":6.1050000000000004,"5min":7.5030000000000001,"15min":7.5030000000000001},"last":2.0219999999999998},{"interface":"front","average":{"1min":1.6990000000000001,"5min":1.341,"15min":0.84299999999999997},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.224},"max":{"1min":7.1239999999999997,"5min":9.4290000000000003,"15min":9.4290000000000003},"last":2.976}]}]},{"osd":6,"up_from":43,"seq":184683593901,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1467012,"kb_used_data":1165692,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":92278140,"statfs":{"total":95995035648,"available":94492815360,"internally_reserved":0,"allocated":1193668608,"data_stored":1193257551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,0,3],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:29:42 2024","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.742,"15min":1.671},"min":{"1min":0.222,"5min":0.21299999999999999,"15min":0.19400000000000001},"max":{"1min":3.3740000000000001,"5min":27.611000000000001,"15min":30.509},"last":1.853},{"interface":"front","average":{"1min":1.5249999999999999,"5min":1.5109999999999999,"15min":1.488},"min":{"1min":0.245,"5min":0.214,"15min":0.21099999999999999},"max":{"1min":7.1619999999999999,"5min":8.9559999999999995,"15min":36.090000000000003},"last":0.34399999999999997}]},{"osd":1,"last update":"Sat Feb 10 08:29:42 2024","interfaces":[{"interface":"back","average":{"1min":1.4470000000000001,"5min":1.597,"15min":1.262},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.20899999999999999},"max":{"1min":5.3120000000000003,"5min":8.9369999999999994,"15min":12.938000000000001},"last":6.2910000000000004},{"interface":"front","average":{"1min":2.0539999999999998,"5min":1.73,"15min":1.349},"min":{"1min":0.26200000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":9.8829999999999991,"5min":10.441000000000001,"15min":10.441000000000001},"last":2.5609999999999999}]},{"osd":2,"last update":"Sat Feb 10 08:29:42 2024","interfaces":[{"interface":"back","average":{"1min":1.758,"5min":1.962,"15min":1.6020000000000001},"min":{"1min":0.29099999999999998,"5min":0.28499999999999998,"15min":0.24399999999999999},"max":{"1min":6.7380000000000004,"5min":25.146999999999998,"15min":35.072000000000003},"last":2.8969999999999998},{"interface":"front","average":{"1min":1.647,"5min":1.8620000000000001,"15min":1.544},"min":{"1min":0.309,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":6.2809999999999997,"5min":25.135999999999999,"15min":35.103000000000002},"last":0.39200000000000002}]},{"osd":3,"last update":"Sat Feb 10 08:29:42 2024","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.827,"15min":1.3680000000000001},"min":{"1min":0.32400000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":3.3879999999999999,"5min":10.211,"15min":15.212999999999999},"last":1.3600000000000001},{"interface":"front","average":{"1min":2.2160000000000002,"5min":1.7569999999999999,"15min":1.4419999999999999},"min":{"1min":0.311,"5min":0.253,"15min":0.253},"max":{"1min":6.21,"5min":10.586,"15min":17.797000000000001},"last":2.5950000000000002}]},{"osd":4,"last update":"Sat Feb 10 08:30:04 2024","interfaces":[{"interface":"back","average":{"1min":1.911,"5min":1.294,"15min":0.80700000000000005},"min":{"1min":0.28599999999999998,"5min":0.224,"15min":0.224},"max":{"1min":7.2009999999999996,"5min":9.3879999999999999,"15min":9.3879999999999999},"last":2.6349999999999998},{"interface":"front","average":{"1min":1.6419999999999999,"5min":1.4419999999999999,"15min":0.872},"min":{"1min":0.33300000000000002,"5min":0.27000000000000002,"15min":0.22600000000000001},"max":{"1min":4.758,"5min":10.348000000000001,"15min":10.348000000000001},"last":1.4299999999999999}]},{"osd":5,"last update":"Sat Feb 10 08:29:42 2024","interfaces":[{"interface":"back","average":{"1min":2.0539999999999998,"5min":1.556,"15min":0.85999999999999999},"min":{"1min":0.309,"5min":0.27000000000000002,"15min":0.20200000000000001},"max":{"1min":10.507,"5min":10.507,"15min":10.507},"last":1.8149999999999999},{"interface":"front","average":{"1min":1.48,"5min":1.5089999999999999,"15min":0.85899999999999999},"min":{"1min":0.27900000000000003,"5min":0.23699999999999999,"15min":0.22900000000000001},"max":{"1min":4.8840000000000003,"5min":6.7999999999999998,"15min":6.7999999999999998},"last":1.45}]},{"osd":7,"last update":"Sat Feb 10 08:30:04 2024","interfaces":[{"interface":"back","average":{"1min":2.226,"5min":1.571,"15min":1.536},"min":{"1min":0.34599999999999997,"5min":0.26200000000000001,"15min":0.23999999999999999},"max":{"1min":8.923,"5min":8.923,"15min":194.88900000000001},"last":1.3859999999999999},{"interface":"front","average":{"1min":2.3809999999999998,"5min":1.7809999999999999,"15min":1.643},"min":{"1min":0.36199999999999999,"5min":0.33900000000000002,"15min":0.26400000000000001},"max":{"1min":8.8930000000000007,"5min":8.8930000000000007,"15min":194.74100000000001},"last":1.4039999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575044,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":3728208,"kb_used_data":3422536,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":90016944,"statfs":{"total":95995035648,"available":92177350656,"internally_reserved":0,"allocated":3504676864,"data_stored":3504253204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,0,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:29:40 2024","interfaces":[{"interface":"back","average":{"1min":2.254,"5min":1.3069999999999999,"15min":1.7030000000000001},"min":{"1min":0.186,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":19.263000000000002,"5min":19.263000000000002,"15min":29.763999999999999},"last":0.623},{"interface":"front","average":{"1min":2.2170000000000001,"5min":1.6279999999999999,"15min":1.8799999999999999},"min":{"1min":0.23400000000000001,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":9.5289999999999999,"5min":9.5289999999999999,"15min":29.637},"last":8.1999999999999993}]},{"osd":2,"last update":"Sat Feb 10 08:30:10 2024","interfaces":[{"interface":"back","average":{"1min":2.3210000000000002,"5min":1.6799999999999999,"15min":1.9039999999999999},"min":{"1min":0.317,"5min":0.224,"15min":0.21199999999999999},"max":{"1min":15.347,"5min":15.347,"15min":31.420999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":2.202,"5min":1.8420000000000001,"15min":2.0840000000000001},"min":{"1min":0.28100000000000003,"5min":0.184,"15min":0.184},"max":{"1min":16.344000000000001,"5min":16.344000000000001,"15min":31.484999999999999},"last":1.0549999999999999}]},{"osd":3,"last update":"Sat Feb 10 08:29:34 2024","interfaces":[{"interface":"back","average":{"1min":1.653,"5min":1.841,"15min":1.972},"min":{"1min":0.30299999999999999,"5min":0.253,"15min":0.247},"max":{"1min":5.0599999999999996,"5min":15.952999999999999,"15min":28.082000000000001},"last":1.714},{"interface":"front","average":{"1min":1.694,"5min":1.3069999999999999,"15min":1.629},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":8.7119999999999997,"5min":9.0879999999999992,"15min":29.722000000000001},"last":0.47999999999999998}]},{"osd":4,"last update":"Sat Feb 10 08:30:04 2024","interfaces":[{"interface":"back","average":{"1min":1.5389999999999999,"5min":1.5980000000000001,"15min":2.0449999999999999},"min":{"1min":0.308,"5min":0.27300000000000002,"15min":0.26100000000000001},"max":{"1min":9.0190000000000001,"5min":9.0190000000000001,"15min":14.086},"last":0.60099999999999998},{"interface":"front","average":{"1min":2.0249999999999999,"5min":1.9830000000000001,"15min":2.444},"min":{"1min":0.35499999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":9.0969999999999995,"5min":9.702,"15min":31.515000000000001},"last":1.1000000000000001}]},{"osd":5,"last update":"Sat Feb 10 08:30:15 2024","interfaces":[{"interface":"back","average":{"1min":2.0030000000000001,"5min":2.1000000000000001,"15min":1.6619999999999999},"min":{"1min":0.34300000000000003,"5min":0.29699999999999999,"15min":0.26000000000000001},"max":{"1min":8.9619999999999997,"5min":40.140999999999998,"15min":40.140999999999998},"last":0.76300000000000001},{"interface":"front","average":{"1min":2.149,"5min":2.5019999999999998,"15min":1.9119999999999999},"min":{"1min":0.34000000000000002,"5min":0.30399999999999999,"15min":0.28499999999999998},"max":{"1min":9.0579999999999998,"5min":40.831000000000003,"15min":40.831000000000003},"last":2.8050000000000002}]},{"osd":6,"last update":"Sat Feb 10 08:29:40 2024","interfaces":[{"interface":"back","average":{"1min":2.069,"5min":1.9199999999999999,"15min":1.6519999999999999},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":9.1259999999999994,"5min":9.8550000000000004,"15min":31.27},"last":0.63200000000000001},{"interface":"front","average":{"1min":1.778,"5min":1.5249999999999999,"15min":1.335},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.27700000000000002},"max":{"1min":3.7599999999999998,"5min":9.8450000000000006,"15min":10.433},"last":0.44400000000000001}]},{"osd":7,"last update":"Sat Feb 10 08:30:10 2024","interfaces":[{"interface":"back","average":{"1min":2.1669999999999998,"5min":1.8740000000000001,"15min":1.706},"min":{"1min":0.39100000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":9.1799999999999997,"5min":9.7840000000000007,"15min":31.344999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":2.0979999999999999,"5min":1.454,"15min":1.3500000000000001},"min":{"1min":0.39500000000000002,"5min":0.34200000000000003,"15min":0.312},"max":{"1min":4.6470000000000002,"5min":5.3520000000000003,"15min":14.872},"last":0.65600000000000003}]}]},{"osd":0,"up_from":8,"seq":34359738569,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1450852,"kb_used_data":1153628,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":92294300,"statfs":{"total":95995035648,"available":94509363200,"internally_reserved":0,"allocated":1181315072,"data_stored":1180935685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 10 08:29:50 2024","interfaces":[{"interface":"back","average":{"1min":1.9259999999999999,"5min":2.0840000000000001,"15min":2.27},"min":{"1min":0.30099999999999999,"5min":0.20399999999999999,"15min":0.14399999999999999},"max":{"1min":6.4119999999999999,"5min":22.460000000000001,"15min":102.48099999999999},"last":0.25900000000000001},{"interface":"front","average":{"1min":1.208,"5min":1.768,"15min":2.0510000000000002},"min":{"1min":0.25900000000000001,"5min":0.19800000000000001,"15min":0.193},"max":{"1min":4.8630000000000004,"5min":23.27,"15min":103.38800000000001},"last":4.5039999999999996}]},{"osd":2,"last update":"Sat Feb 10 08:30:10 2024","interfaces":[{"interface":"back","average":{"1min":2.6779999999999999,"5min":2.0579999999999998,"15min":2.3999999999999999},"min":{"1min":0.315,"5min":0.192,"15min":0.192},"max":{"1min":10.849,"5min":11.782,"15min":102.462},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.4670000000000001,"5min":1.8859999999999999,"15min":2.2269999999999999},"min":{"1min":0.314,"5min":0.222,"15min":0.20799999999999999},"max":{"1min":6.1870000000000003,"5min":19.809999999999999,"15min":102.66500000000001},"last":0.442}]},{"osd":3,"last update":"Sat Feb 10 08:29:35 2024","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.464,"15min":1.8089999999999999},"min":{"1min":0.26800000000000002,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":4.6459999999999999,"5min":7.1550000000000002,"15min":16.495000000000001},"last":4.4619999999999997},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.7949999999999999,"15min":2.2629999999999999},"min":{"1min":0.31,"5min":0.222,"15min":0.222},"max":{"1min":3.3679999999999999,"5min":8.5419999999999998,"15min":102.64400000000001},"last":1.169}]},{"osd":4,"last update":"Sat Feb 10 08:29:56 2024","interfaces":[{"interface":"back","average":{"1min":1.6990000000000001,"5min":1.716,"15min":3.1560000000000001},"min":{"1min":0.29699999999999999,"5min":0.26800000000000002,"15min":0.253},"max":{"1min":10.596,"5min":10.596,"15min":102.742},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.5680000000000001,"5min":1.5009999999999999,"15min":1.8260000000000001},"min":{"1min":0.38100000000000001,"5min":0.31,"15min":0.26200000000000001},"max":{"1min":4.8289999999999997,"5min":7.3890000000000002,"15min":16.352},"last":0.40200000000000002}]},{"osd":5,"last update":"Sat Feb 10 08:30:25 2024","interfaces":[{"interface":"back","average":{"1min":1.7769999999999999,"5min":1.758,"15min":1.883},"min":{"1min":0.36399999999999999,"5min":0.32100000000000001,"15min":0.31900000000000001},"max":{"1min":6.4539999999999997,"5min":8.4320000000000004,"15min":102.53100000000001},"last":0.45900000000000002},{"interface":"front","average":{"1min":1.7669999999999999,"5min":1.706,"15min":1.488},"min":{"1min":0.317,"5min":0.317,"15min":0.22500000000000001},"max":{"1min":5.7130000000000001,"5min":9.7360000000000007,"15min":16.463999999999999},"last":0.433}]},{"osd":6,"last update":"Sat Feb 10 08:29:50 2024","interfaces":[{"interface":"back","average":{"1min":2.0979999999999999,"5min":1.7609999999999999,"15min":1.905},"min":{"1min":0.42999999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":5.5090000000000003,"5min":8.4499999999999993,"15min":102.583},"last":0.42199999999999999},{"interface":"front","average":{"1min":1.881,"5min":1.629,"15min":1.4059999999999999},"min":{"1min":0.48899999999999999,"5min":0.372,"15min":0.308},"max":{"1min":4.7800000000000002,"5min":6.0549999999999997,"15min":16.391999999999999},"last":0.47499999999999998}]},{"osd":7,"last update":"Sat Feb 10 08:30:10 2024","interfaces":[{"interface":"back","average":{"1min":1.758,"5min":1.889,"15min":2.7189999999999999},"min":{"1min":0.498,"5min":0.35299999999999998,"15min":0.34100000000000003},"max":{"1min":6.1159999999999997,"5min":15.090999999999999,"15min":255.53200000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":2.2730000000000001,"5min":1.9319999999999999,"15min":2.2669999999999999},"min":{"1min":0.52400000000000002,"5min":0.39600000000000002,"15min":0.28599999999999998},"max":{"1min":5.5999999999999996,"5min":6.8319999999999999,"15min":254.88800000000001},"last":0.51300000000000001}]}]},{"osd":2,"up_from":18,"seq":77309411520,"num_pgs":65,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2608052,"kb_used_data":2310764,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":91137100,"statfs":{"total":95995035648,"available":93324390400,"internally_reserved":0,"allocated":2366222336,"data_stored":2365826826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:30:18 2024","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.117,"15min":1.639},"min":{"1min":0.255,"5min":0.216,"15min":0.17399999999999999},"max":{"1min":6.0640000000000001,"5min":6.7530000000000001,"15min":24.859999999999999},"last":3.044},{"interface":"front","average":{"1min":2.1440000000000001,"5min":1.6120000000000001,"15min":2.0609999999999999},"min":{"1min":0.20899999999999999,"5min":0.20399999999999999,"15min":0.193},"max":{"1min":5.9379999999999997,"5min":9.2219999999999995,"15min":28.295999999999999},"last":0.217}]},{"osd":1,"last update":"Sat Feb 10 08:30:18 2024","interfaces":[{"interface":"back","average":{"1min":1.786,"5min":2.1160000000000001,"15min":1.6579999999999999},"min":{"1min":0.28499999999999998,"5min":0.21099999999999999,"15min":0.19700000000000001},"max":{"1min":7.9889999999999999,"5min":13.622,"15min":15.644},"last":1.4850000000000001},{"interface":"front","average":{"1min":0.80900000000000005,"5min":1.1080000000000001,"15min":1.2609999999999999},"min":{"1min":0.29299999999999998,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":2.1000000000000001,"5min":6.2809999999999997,"15min":16.968},"last":1.377}]},{"osd":3,"last update":"Sat Feb 10 08:29:35 2024","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.7290000000000001,"15min":1.7070000000000001},"min":{"1min":0.307,"5min":0.24199999999999999,"15min":0.23300000000000001},"max":{"1min":3.3599999999999999,"5min":10.734,"15min":24.946000000000002},"last":3.4420000000000002},{"interface":"front","average":{"1min":0.90500000000000003,"5min":1.48,"15min":1.831},"min":{"1min":0.255,"5min":0.23300000000000001,"15min":0.22900000000000001},"max":{"1min":2.7269999999999999,"5min":14.282,"15min":24.905000000000001},"last":1.742}]},{"osd":4,"last update":"Sat Feb 10 08:29:59 2024","interfaces":[{"interface":"back","average":{"1min":1.548,"5min":1.639,"15min":2.0750000000000002},"min":{"1min":0.30099999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":3.4169999999999998,"5min":7.3470000000000004,"15min":13.260999999999999},"last":2.6600000000000001},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.139,"15min":1.3200000000000001},"min":{"1min":0.32500000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":2.9540000000000002,"5min":7.3150000000000004,"15min":15.696},"last":1.046}]},{"osd":5,"last update":"Sat Feb 10 08:30:22 2024","interfaces":[{"interface":"back","average":{"1min":1.764,"5min":1.8260000000000001,"15min":1.5620000000000001},"min":{"1min":0.30299999999999999,"5min":0.29899999999999999,"15min":0.26600000000000001},"max":{"1min":7.3609999999999998,"5min":9.2590000000000003,"15min":13.939},"last":3.0209999999999999},{"interface":"front","average":{"1min":2.2320000000000002,"5min":1.8799999999999999,"15min":1.478},"min":{"1min":0.44,"5min":0.33600000000000002,"15min":0.28599999999999998},"max":{"1min":6.298,"5min":8.6890000000000001,"15min":13.317},"last":2.089}]},{"osd":6,"last update":"Sat Feb 10 08:29:55 2024","interfaces":[{"interface":"back","average":{"1min":1.478,"5min":2.004,"15min":1.5600000000000001},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":4.6029999999999998,"5min":38.177999999999997,"15min":38.177999999999997},"last":2.8149999999999999},{"interface":"front","average":{"1min":1.871,"5min":2.294,"15min":1.633},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.29099999999999998},"max":{"1min":5.1040000000000001,"5min":37.682000000000002,"15min":37.682000000000002},"last":2.1989999999999998}]},{"osd":7,"last update":"Sat Feb 10 08:30:18 2024","interfaces":[{"interface":"back","average":{"1min":1.4530000000000001,"5min":1.7649999999999999,"15min":1.4710000000000001},"min":{"1min":0.502,"5min":0.39600000000000002,"15min":0.33900000000000002},"max":{"1min":3.1419999999999999,"5min":6.7000000000000002,"15min":13.231999999999999},"last":1.1299999999999999},{"interface":"front","average":{"1min":1.609,"5min":1.377,"15min":1.1970000000000001},"min":{"1min":0.40100000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":7.6660000000000004,"5min":7.6660000000000004,"15min":15.714},"last":2.6739999999999999}]}]},{"osd":3,"up_from":25,"seq":107374182587,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1819980,"kb_used_data":1510468,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":91925172,"statfs":{"total":95995035648,"available":94131376128,"internally_reserved":0,"allocated":1546719232,"data_stored":1546362975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:29:34 2024","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.24,"15min":1.5129999999999999},"min":{"1min":0.20599999999999999,"5min":0.182,"15min":0.182},"max":{"1min":5.9000000000000004,"5min":7.5570000000000004,"15min":14.167},"last":0.26600000000000001},{"interface":"front","average":{"1min":1.929,"5min":1.556,"15min":1.5009999999999999},"min":{"1min":0.20200000000000001,"5min":0.185,"15min":0.185},"max":{"1min":16.155000000000001,"5min":16.155000000000001,"15min":26.643000000000001},"last":0.53000000000000003}]},{"osd":1,"last update":"Sat Feb 10 08:29:34 2024","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.657,"15min":1.5149999999999999},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":6.2670000000000003,"5min":9.4179999999999993,"15min":12.782999999999999},"last":1.234},{"interface":"front","average":{"1min":1.03,"5min":2.073,"15min":1.7230000000000001},"min":{"1min":0.22900000000000001,"5min":0.214,"15min":0.191},"max":{"1min":5.5960000000000001,"5min":17.513000000000002,"15min":21.373999999999999},"last":0.43099999999999999}]},{"osd":2,"last update":"Sat Feb 10 08:29:34 2024","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":2.0169999999999999,"15min":1.675},"min":{"1min":0.255,"5min":0.24199999999999999,"15min":0.23699999999999999},"max":{"1min":3.5339999999999998,"5min":15.102,"15min":21.434000000000001},"last":0.32500000000000001},{"interface":"front","average":{"1min":1.109,"5min":1.5960000000000001,"15min":1.5089999999999999},"min":{"1min":0.26600000000000001,"5min":0.215,"15min":0.215},"max":{"1min":2.835,"5min":13.946999999999999,"15min":18.061},"last":0.57899999999999996}]},{"osd":4,"last update":"Sat Feb 10 08:30:10 2024","interfaces":[{"interface":"back","average":{"1min":1.694,"5min":1.7589999999999999,"15min":1.698},"min":{"1min":0.318,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":5.0119999999999996,"5min":10.970000000000001,"15min":12.272},"last":0.49099999999999999},{"interface":"front","average":{"1min":1.899,"5min":1.923,"15min":2.1989999999999998},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":6.0700000000000003,"5min":9.0489999999999995,"15min":12.391999999999999},"last":0.65600000000000003}]},{"osd":5,"last update":"Sat Feb 10 08:30:31 2024","interfaces":[{"interface":"back","average":{"1min":1.7769999999999999,"5min":1.8999999999999999,"15min":1.286},"min":{"1min":0.35299999999999998,"5min":0.31,"15min":0.249},"max":{"1min":4.992,"5min":10.933999999999999,"15min":12.388999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":2.1000000000000001,"5min":1.8069999999999999,"15min":1.5449999999999999},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":7.2549999999999999,"5min":9.9900000000000002,"15min":12.438000000000001},"last":0.67800000000000005}]},{"osd":6,"last update":"Sat Feb 10 08:29:47 2024","interfaces":[{"interface":"back","average":{"1min":1.774,"5min":1.8049999999999999,"15min":1.4670000000000001},"min":{"1min":0.371,"5min":0.35799999999999998,"15min":0.33600000000000002},"max":{"1min":6.133,"5min":9.3740000000000006,"15min":12.477},"last":0.51300000000000001},{"interface":"front","average":{"1min":1.7849999999999999,"5min":1.774,"15min":1.23},"min":{"1min":0.36399999999999999,"5min":0.31,"15min":0.28499999999999998},"max":{"1min":6.0789999999999997,"5min":8.8640000000000008,"15min":12.324999999999999},"last":0.60399999999999998}]},{"osd":7,"last update":"Sat Feb 10 08:30:10 2024","interfaces":[{"interface":"back","average":{"1min":2.851,"5min":2.0409999999999999,"15min":1.355},"min":{"1min":0.39600000000000002,"5min":0.33400000000000002,"15min":0.28299999999999997},"max":{"1min":8.7569999999999997,"5min":8.9109999999999996,"15min":12.358000000000001},"last":0.627},{"interface":"front","average":{"1min":1.8740000000000001,"5min":2.0110000000000001,"15min":1.577},"min":{"1min":0.39600000000000002,"5min":0.33000000000000002,"15min":0.26500000000000001},"max":{"1min":5.9829999999999997,"5min":14.587,"15min":15.702},"last":0.55800000000000005}]}]},{"osd":4,"up_from":110,"seq":472446402679,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1459116,"kb_used_data":1148964,"kb_used_omap":0,"kb_used_meta":310143,"kb_avail":92286036,"statfs":{"total":95995035648,"available":94500900864,"internally_reserved":0,"allocated":1176539136,"data_stored":1176150907,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":972,"internal_metadata":317586484},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,1,0,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:30:14 2024","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.345,"15min":1.278},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.19800000000000001},"max":{"1min":4.0579999999999998,"5min":6.258,"15min":11.257999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":2.371,"5min":1.905,"15min":2.6339999999999999},"min":{"1min":0.315,"5min":0.222,"15min":0.222},"max":{"1min":7.766,"5min":12.84,"15min":16.524000000000001},"last":5.2889999999999997}]},{"osd":1,"last update":"Sat Feb 10 08:30:14 2024","interfaces":[{"interface":"back","average":{"1min":4.0800000000000001,"5min":2.2559999999999998,"15min":2.093},"min":{"1min":0.248,"5min":0.218,"15min":0.218},"max":{"1min":38.621000000000002,"5min":38.621000000000002,"15min":38.621000000000002},"last":0.315},{"interface":"front","average":{"1min":3.609,"5min":2.1099999999999999,"15min":1.95},"min":{"1min":0.248,"5min":0.217,"15min":0.217},"max":{"1min":38.430999999999997,"5min":38.430999999999997,"15min":38.430999999999997},"last":0.61799999999999999}]},{"osd":2,"last update":"Sat Feb 10 08:30:14 2024","interfaces":[{"interface":"back","average":{"1min":2.3839999999999999,"5min":2.0219999999999998,"15min":1.9890000000000001},"min":{"1min":0.26000000000000001,"5min":0.218,"15min":0.218},"max":{"1min":6.0149999999999997,"5min":9.7539999999999996,"15min":9.7539999999999996},"last":0.40699999999999997},{"interface":"front","average":{"1min":2.2679999999999998,"5min":1.6879999999999999,"15min":1.911},"min":{"1min":0.28000000000000003,"5min":0.247,"15min":0.247},"max":{"1min":8.8580000000000005,"5min":8.8580000000000005,"15min":8.9309999999999992},"last":0.34100000000000003}]},{"osd":3,"last update":"Sat Feb 10 08:30:14 2024","interfaces":[{"interface":"back","average":{"1min":2.3500000000000001,"5min":1.8420000000000001,"15min":2.0459999999999998},"min":{"1min":0.28799999999999998,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":9.5690000000000008,"5min":10.971,"15min":12.565},"last":0.437},{"interface":"front","average":{"1min":2.5830000000000002,"5min":1.627,"15min":1.6990000000000001},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":7.4450000000000003,"5min":7.4450000000000003,"15min":11.648},"last":1.1120000000000001}]},{"osd":5,"last update":"Sat Feb 10 08:30:14 2024","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.532,"15min":0.88600000000000001},"min":{"1min":0.27800000000000002,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":5.3330000000000002,"5min":41.488,"15min":41.488},"last":4.0339999999999998},{"interface":"front","average":{"1min":1.8640000000000001,"5min":2.0339999999999998,"15min":1.1859999999999999},"min":{"1min":0.28299999999999997,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":4.1769999999999996,"5min":42.527999999999999,"15min":42.527999999999999},"last":0.78100000000000003}]},{"osd":6,"last update":"Sat Feb 10 08:30:14 2024","interfaces":[{"interface":"back","average":{"1min":1.909,"5min":1.964,"15min":1.087},"min":{"1min":0.28599999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":6.867,"5min":39.554000000000002,"15min":39.554000000000002},"last":0.50800000000000001},{"interface":"front","average":{"1min":1.883,"5min":1.7010000000000001,"15min":1.1100000000000001},"min":{"1min":0.34899999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":6.8410000000000002,"5min":41.741999999999997,"15min":41.741999999999997},"last":0.36499999999999999}]},{"osd":7,"last update":"Sat Feb 10 08:30:14 2024","interfaces":[{"interface":"back","average":{"1min":2.4950000000000001,"5min":1.623,"15min":1.087},"min":{"1min":0.32800000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":6.8150000000000004,"5min":11.047000000000001,"15min":11.047000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":1.627,"5min":1.3560000000000001,"15min":0.81399999999999995},"min":{"1min":0.307,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":7.4880000000000004,"5min":7.4880000000000004,"15min":7.4880000000000004},"last":4.0039999999999996}]}]},{"osd":5,"up_from":37,"seq":158913790130,"num_pgs":77,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":3802800,"kb_used_data":3493288,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":89942352,"statfs":{"total":95995035648,"available":92100968448,"internally_reserved":0,"allocated":3577126912,"data_stored":3576734954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,1,3,6],"upper_bound":32},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:30:18 2024","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.494,"15min":1.4330000000000001},"min":{"1min":0.23200000000000001,"5min":0.21299999999999999,"15min":0.20499999999999999},"max":{"1min":4.0049999999999999,"5min":8.1110000000000007,"15min":22.914000000000001},"last":0.34399999999999997},{"interface":"front","average":{"1min":1.51,"5min":1.5269999999999999,"15min":1.3100000000000001},"min":{"1min":0.312,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":8.0099999999999998,"5min":8.0099999999999998,"15min":23.161000000000001},"last":1.0369999999999999}]},{"osd":1,"last update":"Sat Feb 10 08:30:18 2024","interfaces":[{"interface":"back","average":{"1min":1.7669999999999999,"5min":1.704,"15min":1.1799999999999999},"min":{"1min":0.26400000000000001,"5min":0.20699999999999999,"15min":0.19500000000000001},"max":{"1min":5.5270000000000001,"5min":7.5730000000000004,"15min":8.1289999999999996},"last":0.47599999999999998},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.444,"15min":1.149},"min":{"1min":0.34399999999999997,"5min":0.254,"15min":0.254},"max":{"1min":3.9239999999999999,"5min":9.0579999999999998,"15min":9.0579999999999998},"last":1.002}]},{"osd":2,"last update":"Sat Feb 10 08:30:18 2024","interfaces":[{"interface":"back","average":{"1min":2.3540000000000001,"5min":1.5469999999999999,"15min":1.431},"min":{"1min":0.29999999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":20.254999999999999,"5min":20.254999999999999,"15min":20.254999999999999},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.7669999999999999,"5min":1.702,"15min":1.294},"min":{"1min":0.309,"5min":0.28799999999999998,"15min":0.26400000000000001},"max":{"1min":5.7939999999999996,"5min":7.585,"15min":9.2810000000000006},"last":0.65000000000000002}]},{"osd":3,"last update":"Sat Feb 10 08:30:18 2024","interfaces":[{"interface":"back","average":{"1min":1.8919999999999999,"5min":1.3069999999999999,"15min":1.224},"min":{"1min":0.28499999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":5.7469999999999999,"5min":5.8789999999999996,"15min":24.198},"last":0.99199999999999999},{"interface":"front","average":{"1min":1.5169999999999999,"5min":1.581,"15min":1.415},"min":{"1min":0.31,"5min":0.29799999999999999,"15min":0.25900000000000001},"max":{"1min":4.8959999999999999,"5min":6.242,"15min":22.701000000000001},"last":0.44900000000000001}]},{"osd":4,"last update":"Sat Feb 10 08:30:03 2024","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.413,"15min":0.85399999999999998},"min":{"1min":0.26600000000000001,"5min":0.248,"15min":0.23599999999999999},"max":{"1min":5.7729999999999997,"5min":6.1120000000000001,"15min":6.1120000000000001},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.827,"5min":1.4590000000000001,"15min":0.82199999999999995},"min":{"1min":0.28899999999999998,"5min":0.26000000000000001,"15min":0.22500000000000001},"max":{"1min":8.0009999999999994,"5min":8.0009999999999994,"15min":8.0009999999999994},"last":0.375}]},{"osd":6,"last update":"Sat Feb 10 08:29:43 2024","interfaces":[{"interface":"back","average":{"1min":1.4690000000000001,"5min":1.49,"15min":0.82699999999999996},"min":{"1min":0.316,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":6.3959999999999999,"5min":8.3559999999999999,"15min":8.3559999999999999},"last":1.1200000000000001},{"interface":"front","average":{"1min":1.79,"5min":1.337,"15min":0.81899999999999995},"min":{"1min":0.29999999999999999,"5min":0.26300000000000001,"15min":0.23999999999999999},"max":{"1min":5.7149999999999999,"5min":6.3840000000000003,"15min":6.3840000000000003},"last":0.96799999999999997}]},{"osd":7,"last update":"Sat Feb 10 08:30:14 2024","interfaces":[{"interface":"back","average":{"1min":1.5489999999999999,"5min":1.1819999999999999,"15min":1.9830000000000001},"min":{"1min":0.33700000000000002,"5min":0.26700000000000002,"15min":0.23799999999999999},"max":{"1min":5.157,"5min":6.4100000000000001,"15min":371.87400000000002},"last":1.0509999999999999},{"interface":"front","average":{"1min":2.468,"5min":1.528,"15min":2.1629999999999998},"min":{"1min":0.32900000000000001,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":12.984999999999999,"5min":12.984999999999999,"15min":372.63099999999997},"last":0.39800000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":2118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1167654912,"data_stored":1167654912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3503689728,"data_stored":3503685656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2352939008,"data_stored":2352939008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1545404416,"data_stored":1545404416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1163264000,"data_stored":1163264000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":3560574976,"data_stored":3560570904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1186398208,"data_stored":1186398208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4290908160,"data_stored":4290904088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-10T08:30:40.892 INFO:tasks.cephadm.ceph_manager.ceph:would drop below min_pgs, proj 6, currently 16 2024-02-10T08:30:40.952 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:30:41.002 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:41.014 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:30:41.014 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:30:41.014 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:30:41.014 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:30:41.014 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:30:41.014 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:30:41.014 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:30:41.014 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:30:41.014 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-10T08:30:41.014 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-10T08:30:41.015 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-10T08:30:41.015 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-10T08:30:41.015 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-10T08:30:41.015 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-10T08:30:41.015 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-10T08:30:41.015 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-10T08:30:41.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:41 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:30:40.236983+0000 mon.a (mon.0) 1391 : cluster [DBG] osdmap e295: 8 total, 8 up, 8 in 2024-02-10T08:30:41.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:30:40.236983+0000 mon.a (mon.0) 1391 : cluster [DBG] osdmap e295: 8 total, 8 up, 8 in 2024-02-10T08:30:41.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:30:40.236983+0000 mon.a (mon.0) 1391 : cluster [DBG] osdmap e295: 8 total, 8 up, 8 in 2024-02-10T08:30:41.866 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:30:41.872 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:41.872 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:30:41.973 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:30:42.020 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:42.059 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:30:42.062 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:42.062 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:30:42.162 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:30:42.163 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:30:42.199 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:42.238 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:30:42.244 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:42.244 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:30:42.345 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:30:42.395 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:42.605 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:30:40.889180+0000 mgr.y (mgr.14505) 526 : cluster [DBG] pgmap v636: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 5.5 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 966 op/s; 10586/269643 objects misplaced (3.926%); 618 KiB/s, 9 objects/s recovering 2024-02-10T08:30:42.605 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:30:40.889180+0000 mgr.y (mgr.14505) 526 : cluster [DBG] pgmap v636: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 5.5 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 966 op/s; 10586/269643 objects misplaced (3.926%); 618 KiB/s, 9 objects/s recovering 2024-02-10T08:30:42.607 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:30:42.614 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:42.614 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:30:42.629 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.3 dump_blocked_ops 2024-02-10T08:30:42.715 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:30:42.752 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:30:40.889180+0000 mgr.y (mgr.14505) 526 : cluster [DBG] pgmap v636: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 5.5 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 966 op/s; 10586/269643 objects misplaced (3.926%); 618 KiB/s, 9 objects/s recovering 2024-02-10T08:30:42.754 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:42.787 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:30:42.792 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:42.792 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:30:42.893 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:30:42.936 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:42.961 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:30:42.966 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:42.967 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:30:43.067 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:30:43.120 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:43.176 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:30:43.183 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:43.183 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:30:43.284 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:30:43.341 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:43.602 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:30:43.606 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:43.607 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:30:43.708 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:30:43.758 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:43.795 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:30:43.802 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:43.803 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:30:43.901 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-10T08:30:43.903 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:30:44.028 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:44.192 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:30:44.204 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:44.204 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:30:44.305 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:30:44.356 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:44.492 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:30:44.500 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:44.500 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:30:44.501 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:30:42.889964+0000 mgr.y (mgr.14505) 527 : cluster [DBG] pgmap v637: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 5.2 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1.42k op/s; 9868/257520 objects misplaced (3.832%); 1.1 MiB/s, 17 objects/s recovering 2024-02-10T08:30:44.501 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:30:42.889964+0000 mgr.y (mgr.14505) 527 : cluster [DBG] pgmap v637: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 5.2 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1.42k op/s; 9868/257520 objects misplaced (3.832%); 1.1 MiB/s, 17 objects/s recovering 2024-02-10T08:30:44.602 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:30:44.641 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:44 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:30:42.889964+0000 mgr.y (mgr.14505) 527 : cluster [DBG] pgmap v637: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 5.2 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1.42k op/s; 9868/257520 objects misplaced (3.832%); 1.1 MiB/s, 17 objects/s recovering 2024-02-10T08:30:44.646 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:44.685 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:30:44.692 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:44.692 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:30:44.793 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:30:44.871 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:44.875 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:30:44.910 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:30:44.914 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:44.915 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:30:44.934 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:30:45.016 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:30:45.058 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:45.104 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:30:45.107 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:45.107 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:30:45.208 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:30:45.289 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:45.320 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:30:43.922420+0000 osd.5 (osd.5) 179 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:30:45.320 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:30:43.922473+0000 osd.5 (osd.5) 180 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:30:45.321 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:30:44.322208+0000 mon.a (mon.0) 1392 : cluster [DBG] osdmap e296: 8 total, 8 up, 8 in 2024-02-10T08:30:45.321 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:30:45.217544+0000 mon.c (mon.2) 69 : audit [INF] from='client.? 172.21.15.18:0/2161833527' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:30:45.321 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:30:45.219025+0000 mon.a (mon.0) 1393 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:30:45.346 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is set 2024-02-10T08:30:45.538 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:30:43.922420+0000 osd.5 (osd.5) 179 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:30:45.538 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:30:43.922473+0000 osd.5 (osd.5) 180 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:30:45.538 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:30:44.322208+0000 mon.a (mon.0) 1392 : cluster [DBG] osdmap e296: 8 total, 8 up, 8 in 2024-02-10T08:30:45.538 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:30:45.217544+0000 mon.c (mon.2) 69 : audit [INF] from='client.? 172.21.15.18:0/2161833527' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:30:45.538 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:30:45.219025+0000 mon.a (mon.0) 1393 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:30:45.539 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:30:43.922420+0000 osd.5 (osd.5) 179 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:30:45.539 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:30:43.922473+0000 osd.5 (osd.5) 180 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:30:45.539 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:30:44.322208+0000 mon.a (mon.0) 1392 : cluster [DBG] osdmap e296: 8 total, 8 up, 8 in 2024-02-10T08:30:45.539 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:30:45.217544+0000 mon.c (mon.2) 69 : audit [INF] from='client.? 172.21.15.18:0/2161833527' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:30:45.539 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:30:45.219025+0000 mon.a (mon.0) 1393 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:30:45.893 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 3, 4, 5, 6, 7, 0] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 5, 6, 7, 4] 2024-02-10T08:30:45.893 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-10T08:30:45.894 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-02-10T08:30:45.894 INFO:tasks.thrashosds.thrasher:Setting osd 5 primary_affinity to 1.000000 2024-02-10T08:30:45.894 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd primary-affinity 5 1 2024-02-10T08:30:46.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:30:44.891602+0000 mgr.y (mgr.14505) 528 : cluster [DBG] pgmap v639: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 5.2 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1.38k op/s; 9868/254301 objects misplaced (3.880%); 976 KiB/s, 15 objects/s recovering 2024-02-10T08:30:46.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:30:45.314700+0000 mon.a (mon.0) 1394 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:30:46.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:30:45.326710+0000 mon.a (mon.0) 1395 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-10T08:30:46.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:30:45.326754+0000 mon.a (mon.0) 1396 : cluster [DBG] osdmap e297: 8 total, 8 up, 8 in 2024-02-10T08:30:46.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:30:45.784747+0000 mon.a (mon.0) 1397 : cluster [DBG] osdmap e298: 8 total, 8 up, 8 in 2024-02-10T08:30:46.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:30:44.891602+0000 mgr.y (mgr.14505) 528 : cluster [DBG] pgmap v639: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 5.2 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1.38k op/s; 9868/254301 objects misplaced (3.880%); 976 KiB/s, 15 objects/s recovering 2024-02-10T08:30:46.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:30:45.314700+0000 mon.a (mon.0) 1394 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:30:46.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:30:45.326710+0000 mon.a (mon.0) 1395 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-10T08:30:46.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:30:45.326754+0000 mon.a (mon.0) 1396 : cluster [DBG] osdmap e297: 8 total, 8 up, 8 in 2024-02-10T08:30:46.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:30:45.784747+0000 mon.a (mon.0) 1397 : cluster [DBG] osdmap e298: 8 total, 8 up, 8 in 2024-02-10T08:30:46.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:30:44.891602+0000 mgr.y (mgr.14505) 528 : cluster [DBG] pgmap v639: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 5.2 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1.38k op/s; 9868/254301 objects misplaced (3.880%); 976 KiB/s, 15 objects/s recovering 2024-02-10T08:30:46.791 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:30:45.314700+0000 mon.a (mon.0) 1394 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:30:46.791 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:30:45.326710+0000 mon.a (mon.0) 1395 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-10T08:30:46.791 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:30:45.326754+0000 mon.a (mon.0) 1396 : cluster [DBG] osdmap e297: 8 total, 8 up, 8 in 2024-02-10T08:30:46.791 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:30:45.784747+0000 mon.a (mon.0) 1397 : cluster [DBG] osdmap e298: 8 total, 8 up, 8 in 2024-02-10T08:30:46.791 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:30:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:30:46] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:30:47.155 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:30:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:30:47] "GET /metrics HTTP/1.1" 200 176263 "" "Prometheus/2.33.4" 2024-02-10T08:30:48.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:30:46.675325+0000 mon.a (mon.0) 1398 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:30:48.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:30:46.893252+0000 mgr.y (mgr.14505) 529 : cluster [DBG] pgmap v642: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 5.1 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 912 op/s; 9868/253215 objects misplaced (3.897%); 629 KiB/s, 9 objects/s recovering 2024-02-10T08:30:48.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:30:46.675325+0000 mon.a (mon.0) 1398 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:30:48.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:30:46.893252+0000 mgr.y (mgr.14505) 529 : cluster [DBG] pgmap v642: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 5.1 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 912 op/s; 9868/253215 objects misplaced (3.897%); 629 KiB/s, 9 objects/s recovering 2024-02-10T08:30:48.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:30:46.675325+0000 mon.a (mon.0) 1398 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:30:48.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:30:46.893252+0000 mgr.y (mgr.14505) 529 : cluster [DBG] pgmap v642: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 5.1 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 912 op/s; 9868/253215 objects misplaced (3.897%); 629 KiB/s, 9 objects/s recovering 2024-02-10T08:30:48.695 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:30:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:30:48.697 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:30:48.338185+0000 mgr.y (mgr.14505) 530 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:30:48.806 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:30:48.813 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:48.813 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:30:48.914 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:30:48.964 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:48.987 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:30:48.989 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:48.990 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:30:49.091 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:30:49.143 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:49.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:30:48.338185+0000 mgr.y (mgr.14505) 530 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:30:49.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:30:48.338185+0000 mgr.y (mgr.14505) 530 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:30:49.179 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:30:49.185 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:49.185 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:30:49.286 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:30:49.342 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:49.376 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:30:49.381 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:49.382 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:30:49.482 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:30:49.545 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:49.573 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:30:49.576 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:49.576 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:30:49.620 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:30:49.628 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:30:49.659 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:30:49.677 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:30:49.707 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:30:49.746 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:30:49.750 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:49.778 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:30:49.816 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:30:49.839 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:30:49.869 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:30:49.873 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-10T08:30:49.873 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-10T08:30:49.873 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-10T08:30:49.873 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-10T08:30:49.873 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-10T08:30:49.873 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-10T08:30:49.873 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-10T08:30:49.873 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-10T08:30:49.897 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:30:48.894070+0000 mgr.y (mgr.14505) 531 : cluster [DBG] pgmap v643: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 4.8 GiB data, 18 GiB used, 698 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 1.08k op/s; 9106/237981 objects misplaced (3.826%); 618 KiB/s, 9 objects/s recovering 2024-02-10T08:30:49.897 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:30:49.546783+0000 mon.b (mon.1) 69 : audit [DBG] from='client.? 172.21.15.18:0/4171727519' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:30:49.897 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:30:48.894070+0000 mgr.y (mgr.14505) 531 : cluster [DBG] pgmap v643: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 4.8 GiB data, 18 GiB used, 698 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 1.08k op/s; 9106/237981 objects misplaced (3.826%); 618 KiB/s, 9 objects/s recovering 2024-02-10T08:30:49.897 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:30:49.546783+0000 mon.b (mon.1) 69 : audit [DBG] from='client.? 172.21.15.18:0/4171727519' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:30:49.916 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:30:49.920 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:49.920 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:30:50.021 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:30:50.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:49 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:30:48.894070+0000 mgr.y (mgr.14505) 531 : cluster [DBG] pgmap v643: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 4.8 GiB data, 18 GiB used, 698 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 1.08k op/s; 9106/237981 objects misplaced (3.826%); 618 KiB/s, 9 objects/s recovering 2024-02-10T08:30:50.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:49 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:30:49.546783+0000 mon.b (mon.1) 69 : audit [DBG] from='client.? 172.21.15.18:0/4171727519' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:30:50.072 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:50.288 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:30:50.291 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:50.291 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:30:50.392 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:30:50.401 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd unset noscrub 2024-02-10T08:30:50.435 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:50.466 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:30:50.472 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:50.472 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:30:50.481 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-02-10T08:30:50.481 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-02-10T08:30:50.481 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-02-10T08:30:50.481 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-02-10T08:30:50.481 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-02-10T08:30:50.573 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:30:50.629 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:50.664 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:30:50.667 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:50.667 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:30:50.768 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:30:50.831 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:50.947 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:30:50.952 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:50.953 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:30:51.054 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:30:51.096 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:51.135 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:51.135 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:30:51.136 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:30:51.236 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:30:51.301 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:51.333 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:51.334 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:30:51.334 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:30:51.435 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:30:51.486 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:51.528 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:30:51.533 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:51.534 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:30:51.635 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:30:51.698 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:51.732 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:30:51.738 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:51.738 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:30:51.790 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:30:50.784749+0000 mon.a (mon.0) 1399 : cluster [DBG] osdmap e299: 8 total, 8 up, 8 in 2024-02-10T08:30:51.790 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:30:50.894464+0000 mgr.y (mgr.14505) 532 : cluster [DBG] pgmap v645: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 4.8 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 962 op/s; 9106/236976 objects misplaced (3.843%); 618 KiB/s, 9 objects/s recovering 2024-02-10T08:30:51.839 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:30:51.890 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:51.918 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:30:51.923 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:51.923 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:30:52.024 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:30:52.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:51 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:30:50.784749+0000 mon.a (mon.0) 1399 : cluster [DBG] osdmap e299: 8 total, 8 up, 8 in 2024-02-10T08:30:52.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:51 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:30:50.894464+0000 mgr.y (mgr.14505) 532 : cluster [DBG] pgmap v645: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 4.8 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 962 op/s; 9106/236976 objects misplaced (3.843%); 618 KiB/s, 9 objects/s recovering 2024-02-10T08:30:52.073 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:30:50.784749+0000 mon.a (mon.0) 1399 : cluster [DBG] osdmap e299: 8 total, 8 up, 8 in 2024-02-10T08:30:52.073 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:30:50.894464+0000 mgr.y (mgr.14505) 532 : cluster [DBG] pgmap v645: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 4.8 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 962 op/s; 9106/236976 objects misplaced (3.843%); 618 KiB/s, 9 objects/s recovering 2024-02-10T08:30:52.078 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:52.448 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:30:52.456 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:52.457 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:30:52.558 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:30:52.610 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:52.645 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:30:52.648 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:52.648 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:30:52.749 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:30:52.805 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:52.840 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:30:52.842 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:52.843 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:30:52.944 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:30:52.998 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:53.028 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:30:53.034 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:53.034 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:30:53.135 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:30:53.189 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:53.238 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:30:53.250 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:53.250 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:30:53.351 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:30:53.400 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:53.617 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:30:53.624 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:53.625 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:30:53.628 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:30:53.661 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.3 dump_historic_ops 2024-02-10T08:30:53.725 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:30:53.850 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:53.905 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:30:53.909 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:53.910 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:30:54.011 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:30:54.058 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:54.096 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:30:54.099 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:54.100 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:30:54.169 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:30:52.895251+0000 mgr.y (mgr.14505) 533 : cluster [DBG] pgmap v646: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 4.6 GiB data, 17 GiB used, 699 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1.27k op/s; 8350/224484 objects misplaced (3.720%); 982 KiB/s, 15 objects/s recovering 2024-02-10T08:30:54.169 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:30:52.895251+0000 mgr.y (mgr.14505) 533 : cluster [DBG] pgmap v646: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 4.6 GiB data, 17 GiB used, 699 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1.27k op/s; 8350/224484 objects misplaced (3.720%); 982 KiB/s, 15 objects/s recovering 2024-02-10T08:30:54.201 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:30:54.263 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:54.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:53 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:30:52.895251+0000 mgr.y (mgr.14505) 533 : cluster [DBG] pgmap v646: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 4.6 GiB data, 17 GiB used, 699 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1.27k op/s; 8350/224484 objects misplaced (3.720%); 982 KiB/s, 15 objects/s recovering 2024-02-10T08:30:54.314 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:30:54.317 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:54.317 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:30:54.418 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:30:54.430 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-10T08:30:54.482 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:54.859 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:30:54.861 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:54.862 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:30:54.963 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:30:55.010 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:55.021 INFO:teuthology.orchestra.run.smithi018.stderr:set osd.5 primary-affinity to 1 (8655362) 2024-02-10T08:30:55.096 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:30:55.100 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:55.100 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:30:55.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:30:54.534601+0000 mon.a (mon.0) 1400 : audit [INF] from='client.? 172.21.15.18:0/1039496693' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 5, "weight": 1.0}]: dispatch 2024-02-10T08:30:55.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:30:54.534601+0000 mon.a (mon.0) 1400 : audit [INF] from='client.? 172.21.15.18:0/1039496693' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 5, "weight": 1.0}]: dispatch 2024-02-10T08:30:55.201 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:30:55.261 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:55.293 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:30:54.534601+0000 mon.a (mon.0) 1400 : audit [INF] from='client.? 172.21.15.18:0/1039496693' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 5, "weight": 1.0}]: dispatch 2024-02-10T08:30:55.301 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:30:55.305 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:55.306 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:30:55.406 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:30:55.461 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:55.570 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:30:55.584 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:55.585 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:30:55.686 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:30:55.747 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:55.804 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:30:55.808 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:55.809 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:30:55.909 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:30:55.973 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:56.030 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:30:54.896543+0000 mgr.y (mgr.14505) 534 : cluster [DBG] pgmap v647: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 4.5 GiB data, 17 GiB used, 699 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1.16k op/s; 8350/221433 objects misplaced (3.771%); 815 KiB/s, 12 objects/s recovering 2024-02-10T08:30:56.030 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:30:55.002832+0000 mon.a (mon.0) 1401 : audit [INF] from='client.? 172.21.15.18:0/1039496693' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 5, "weight": 1.0}]': finished 2024-02-10T08:30:56.030 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:30:55.002891+0000 mon.a (mon.0) 1402 : cluster [DBG] osdmap e300: 8 total, 8 up, 8 in 2024-02-10T08:30:56.030 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:30:55.802043+0000 mon.a (mon.0) 1403 : cluster [DBG] osdmap e301: 8 total, 8 up, 8 in 2024-02-10T08:30:56.180 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:30:56.190 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:30:54.896543+0000 mgr.y (mgr.14505) 534 : cluster [DBG] pgmap v647: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 4.5 GiB data, 17 GiB used, 699 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1.16k op/s; 8350/221433 objects misplaced (3.771%); 815 KiB/s, 12 objects/s recovering 2024-02-10T08:30:56.190 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:30:55.002832+0000 mon.a (mon.0) 1401 : audit [INF] from='client.? 172.21.15.18:0/1039496693' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 5, "weight": 1.0}]': finished 2024-02-10T08:30:56.190 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:30:55.002891+0000 mon.a (mon.0) 1402 : cluster [DBG] osdmap e300: 8 total, 8 up, 8 in 2024-02-10T08:30:56.190 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:30:55.802043+0000 mon.a (mon.0) 1403 : cluster [DBG] osdmap e301: 8 total, 8 up, 8 in 2024-02-10T08:30:56.190 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:30:54.896543+0000 mgr.y (mgr.14505) 534 : cluster [DBG] pgmap v647: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 4.5 GiB data, 17 GiB used, 699 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1.16k op/s; 8350/221433 objects misplaced (3.771%); 815 KiB/s, 12 objects/s recovering 2024-02-10T08:30:56.190 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:30:55.002832+0000 mon.a (mon.0) 1401 : audit [INF] from='client.? 172.21.15.18:0/1039496693' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 5, "weight": 1.0}]': finished 2024-02-10T08:30:56.190 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:30:55.002891+0000 mon.a (mon.0) 1402 : cluster [DBG] osdmap e300: 8 total, 8 up, 8 in 2024-02-10T08:30:56.190 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:30:55.802043+0000 mon.a (mon.0) 1403 : cluster [DBG] osdmap e301: 8 total, 8 up, 8 in 2024-02-10T08:30:56.191 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:56.191 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:30:56.292 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:30:56.346 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:56.404 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:30:56.412 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:30:56.413 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:30:56.514 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:30:56.555 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:30:56.791 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:30:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:30:56] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:30:57.404 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:30:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:30:57] "GET /metrics HTTP/1.1" 200 176263 "" "Prometheus/2.33.4" 2024-02-10T08:30:58.355 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:30:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:30:58.356 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:30:56.896947+0000 mgr.y (mgr.14505) 535 : cluster [DBG] pgmap v650: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 4.5 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 837 B/s rd, 0 B/s wr, 900 op/s; 8350/220491 objects misplaced (3.787%); 607 KiB/s, 9 objects/s recovering 2024-02-10T08:30:58.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:30:56.896947+0000 mgr.y (mgr.14505) 535 : cluster [DBG] pgmap v650: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 4.5 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 837 B/s rd, 0 B/s wr, 900 op/s; 8350/220491 objects misplaced (3.787%); 607 KiB/s, 9 objects/s recovering 2024-02-10T08:30:58.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:30:56.896947+0000 mgr.y (mgr.14505) 535 : cluster [DBG] pgmap v650: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 4.5 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 837 B/s rd, 0 B/s wr, 900 op/s; 8350/220491 objects misplaced (3.787%); 607 KiB/s, 9 objects/s recovering 2024-02-10T08:30:59.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:30:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:30:58.354508+0000 mgr.y (mgr.14505) 536 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:30:59.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:30:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:30:58.354508+0000 mgr.y (mgr.14505) 536 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:30:59.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:30:59 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:30:58.354508+0000 mgr.y (mgr.14505) 536 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:31:00.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:30:58.897828+0000 mgr.y (mgr.14505) 537 : cluster [DBG] pgmap v651: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 4.2 GiB data, 16 GiB used, 700 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.32k op/s; 7602/205257 objects misplaced (3.704%); 928 KiB/s, 14 objects/s recovering 2024-02-10T08:31:00.407 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:30:58.897828+0000 mgr.y (mgr.14505) 537 : cluster [DBG] pgmap v651: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 4.2 GiB data, 16 GiB used, 700 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.32k op/s; 7602/205257 objects misplaced (3.704%); 928 KiB/s, 14 objects/s recovering 2024-02-10T08:31:00.543 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:30:58.897828+0000 mgr.y (mgr.14505) 537 : cluster [DBG] pgmap v651: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 4.2 GiB data, 16 GiB used, 700 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.32k op/s; 7602/205257 objects misplaced (3.704%); 928 KiB/s, 14 objects/s recovering 2024-02-10T08:31:01.481 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:31:01.487 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:01.487 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:31:01.588 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:31:01.635 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:01.660 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:31:01.667 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:01.668 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:31:01.768 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:31:01.810 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:01.832 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:31:01.835 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:01.835 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:31:01.936 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:31:01.988 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:02.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:31:00.783317+0000 mon.a (mon.0) 1404 : cluster [DBG] osdmap e302: 8 total, 8 up, 8 in 2024-02-10T08:31:02.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:31:00.880495+0000 mon.b (mon.1) 70 : audit [INF] from='client.? 172.21.15.18:0/1375686375' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:31:02.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:31:00.881187+0000 mon.a (mon.0) 1405 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:31:02.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:31:00.898270+0000 mgr.y (mgr.14505) 538 : cluster [DBG] pgmap v653: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 4.1 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 957 op/s; 7602/204201 objects misplaced (3.723%); 618 KiB/s, 9 objects/s recovering 2024-02-10T08:31:02.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:31:00.783317+0000 mon.a (mon.0) 1404 : cluster [DBG] osdmap e302: 8 total, 8 up, 8 in 2024-02-10T08:31:02.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:31:00.880495+0000 mon.b (mon.1) 70 : audit [INF] from='client.? 172.21.15.18:0/1375686375' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:31:02.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:31:00.881187+0000 mon.a (mon.0) 1405 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:31:02.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:31:00.898270+0000 mgr.y (mgr.14505) 538 : cluster [DBG] pgmap v653: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 4.1 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 957 op/s; 7602/204201 objects misplaced (3.723%); 618 KiB/s, 9 objects/s recovering 2024-02-10T08:31:02.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:31:00.783317+0000 mon.a (mon.0) 1404 : cluster [DBG] osdmap e302: 8 total, 8 up, 8 in 2024-02-10T08:31:02.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:31:00.880495+0000 mon.b (mon.1) 70 : audit [INF] from='client.? 172.21.15.18:0/1375686375' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:31:02.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:31:00.881187+0000 mon.a (mon.0) 1405 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:31:02.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:31:00.898270+0000 mgr.y (mgr.14505) 538 : cluster [DBG] pgmap v653: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 4.1 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 957 op/s; 7602/204201 objects misplaced (3.723%); 618 KiB/s, 9 objects/s recovering 2024-02-10T08:31:02.565 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is unset 2024-02-10T08:31:03.043 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:31:01.791237+0000 mon.a (mon.0) 1406 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:31:03.043 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:31:01.804892+0000 mon.a (mon.0) 1407 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-10T08:31:03.043 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:31:01.804959+0000 mon.a (mon.0) 1408 : cluster [DBG] osdmap e303: 8 total, 8 up, 8 in 2024-02-10T08:31:03.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:31:01.791237+0000 mon.a (mon.0) 1406 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:31:03.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:31:01.804892+0000 mon.a (mon.0) 1407 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-10T08:31:03.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:31:01.804959+0000 mon.a (mon.0) 1408 : cluster [DBG] osdmap e303: 8 total, 8 up, 8 in 2024-02-10T08:31:03.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:31:01.791237+0000 mon.a (mon.0) 1406 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:31:03.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:31:01.804892+0000 mon.a (mon.0) 1407 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-10T08:31:03.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:31:01.804959+0000 mon.a (mon.0) 1408 : cluster [DBG] osdmap e303: 8 total, 8 up, 8 in 2024-02-10T08:31:04.074 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:31:02.899046+0000 mgr.y (mgr.14505) 539 : cluster [DBG] pgmap v655: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 3.9 GiB data, 15 GiB used, 701 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 1.36k op/s; 6788/191433 objects misplaced (3.546%); 1.0 MiB/s, 16 objects/s recovering 2024-02-10T08:31:04.074 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:31:02.899046+0000 mgr.y (mgr.14505) 539 : cluster [DBG] pgmap v655: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 3.9 GiB data, 15 GiB used, 701 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 1.36k op/s; 6788/191433 objects misplaced (3.546%); 1.0 MiB/s, 16 objects/s recovering 2024-02-10T08:31:04.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:31:02.899046+0000 mgr.y (mgr.14505) 539 : cluster [DBG] pgmap v655: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 3.9 GiB data, 15 GiB used, 701 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 1.36k op/s; 6788/191433 objects misplaced (3.546%); 1.0 MiB/s, 16 objects/s recovering 2024-02-10T08:31:04.314 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:31:04.322 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:31:04.807 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:31:04.490759+0000 mon.a (mon.0) 1409 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:31:05.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:31:04.490759+0000 mon.a (mon.0) 1409 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:31:05.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:31:04.490759+0000 mon.a (mon.0) 1409 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:31:06.071 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:31:06.074 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:06.074 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:31:04.899568+0000 mgr.y (mgr.14505) 540 : cluster [DBG] pgmap v656: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 3.8 GiB data, 15 GiB used, 701 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.34k op/s; 6788/188370 objects misplaced (3.604%); 928 KiB/s, 14 objects/s recovering 2024-02-10T08:31:06.074 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:31:05.176583+0000 mon.a (mon.0) 1410 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:31:06.075 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:31:05.177562+0000 mon.a (mon.0) 1411 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:31:06.075 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:31:05.183735+0000 mon.a (mon.0) 1412 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:31:06.075 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:31:05.789736+0000 mon.a (mon.0) 1413 : cluster [DBG] osdmap e304: 8 total, 8 up, 8 in 2024-02-10T08:31:06.075 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:31:06.078 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:31:04.899568+0000 mgr.y (mgr.14505) 540 : cluster [DBG] pgmap v656: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 3.8 GiB data, 15 GiB used, 701 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.34k op/s; 6788/188370 objects misplaced (3.604%); 928 KiB/s, 14 objects/s recovering 2024-02-10T08:31:06.078 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:31:05.176583+0000 mon.a (mon.0) 1410 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:31:06.078 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:31:05.177562+0000 mon.a (mon.0) 1411 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:31:06.079 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:31:05.183735+0000 mon.a (mon.0) 1412 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:31:06.079 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:31:05.789736+0000 mon.a (mon.0) 1413 : cluster [DBG] osdmap e304: 8 total, 8 up, 8 in 2024-02-10T08:31:06.176 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:31:06.224 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:06.276 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:31:06.282 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:06.282 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:31:06.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:31:04.899568+0000 mgr.y (mgr.14505) 540 : cluster [DBG] pgmap v656: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 3.8 GiB data, 15 GiB used, 701 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.34k op/s; 6788/188370 objects misplaced (3.604%); 928 KiB/s, 14 objects/s recovering 2024-02-10T08:31:06.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:31:05.176583+0000 mon.a (mon.0) 1410 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:31:06.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:31:05.177562+0000 mon.a (mon.0) 1411 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:31:06.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:31:05.183735+0000 mon.a (mon.0) 1412 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:31:06.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:31:05.789736+0000 mon.a (mon.0) 1413 : cluster [DBG] osdmap e304: 8 total, 8 up, 8 in 2024-02-10T08:31:06.383 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:31:06.442 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:06.497 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 3, 4, 5, 6, 7, 0] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 5, 6, 7, 4] 2024-02-10T08:31:06.498 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd reweight 1 1 2024-02-10T08:31:06.702 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:31:06.706 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:06.707 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:31:06.789 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:31:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:31:06] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:31:06.807 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:31:06.870 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:07.036 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd unset nodeep-scrub 2024-02-10T08:31:07.092 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:31:07.098 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:07.099 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:31:07.200 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:31:07.254 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:07.289 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:31:07.293 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:07.293 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:31:07.341 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:31:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:31:07] "GET /metrics HTTP/1.1" 200 176248 "" "Prometheus/2.33.4" 2024-02-10T08:31:07.394 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:31:07.451 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:07.581 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:31:07.585 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:07.585 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:31:07.686 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:31:07.745 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:07.746 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:31:07.790 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:31:07.824 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:31:07.862 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:31:07.890 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:31:07.899 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:31:07.911 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:07.912 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:31:07.924 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:31:07.958 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:31:07.998 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:31:08.012 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:31:08.013 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-10T08:31:08.013 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-10T08:31:08.013 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-10T08:31:08.013 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-10T08:31:08.013 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-10T08:31:08.013 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-10T08:31:08.013 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-10T08:31:08.014 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-10T08:31:08.035 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:31:06.900805+0000 mgr.y (mgr.14505) 541 : cluster [DBG] pgmap v658: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 3.8 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 836 B/s rd, 0 B/s wr, 916 op/s; 6788/187383 objects misplaced (3.623%); 607 KiB/s, 9 objects/s recovering 2024-02-10T08:31:08.035 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:31:07.704142+0000 mon.b (mon.1) 71 : audit [DBG] from='client.? 172.21.15.18:0/2541805764' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:31:08.036 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:31:06.900805+0000 mgr.y (mgr.14505) 541 : cluster [DBG] pgmap v658: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 3.8 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 836 B/s rd, 0 B/s wr, 916 op/s; 6788/187383 objects misplaced (3.623%); 607 KiB/s, 9 objects/s recovering 2024-02-10T08:31:08.037 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:31:07.704142+0000 mon.b (mon.1) 71 : audit [DBG] from='client.? 172.21.15.18:0/2541805764' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:31:08.072 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:08.283 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:31:08.289 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:08.289 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:31:08.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:31:06.900805+0000 mgr.y (mgr.14505) 541 : cluster [DBG] pgmap v658: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 3.8 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 836 B/s rd, 0 B/s wr, 916 op/s; 6788/187383 objects misplaced (3.623%); 607 KiB/s, 9 objects/s recovering 2024-02-10T08:31:08.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:31:07.704142+0000 mon.b (mon.1) 71 : audit [DBG] from='client.? 172.21.15.18:0/2541805764' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:31:08.390 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:31:08.438 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:08.525 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:31:08.529 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:08.529 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:31:08.630 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:31:08.674 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:08.789 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:31:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:31:09.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:31:08.364495+0000 mgr.y (mgr.14505) 542 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:31:09.339 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:31:09.340 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:09.340 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:31:08.364495+0000 mgr.y (mgr.14505) 542 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:31:09.341 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:31:09.342 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:31:08.364495+0000 mgr.y (mgr.14505) 542 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:31:09.442 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:31:09.492 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:09.525 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:31:09.528 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:09.529 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:31:09.629 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:31:09.702 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:09.726 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-02-10T08:31:09.727 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:31:09.739 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:31:09.740 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:31:09.743 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:31:09.746 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:09.746 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:31:09.847 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:31:09.909 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:09.965 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:31:09.969 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:09.970 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:31:10.071 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:31:10.123 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:10.152 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:31:10.155 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:10.155 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:31:10.235 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:31:08.901486+0000 mgr.y (mgr.14505) 543 : cluster [DBG] pgmap v659: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 3.5 GiB data, 14 GiB used, 702 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.33k op/s; 6126/172212 objects misplaced (3.557%); 936 KiB/s, 14 objects/s recovering 2024-02-10T08:31:10.235 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:31:08.901486+0000 mgr.y (mgr.14505) 543 : cluster [DBG] pgmap v659: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 3.5 GiB data, 14 GiB used, 702 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.33k op/s; 6126/172212 objects misplaced (3.557%); 936 KiB/s, 14 objects/s recovering 2024-02-10T08:31:10.256 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:31:10.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:31:08.901486+0000 mgr.y (mgr.14505) 543 : cluster [DBG] pgmap v659: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 3.5 GiB data, 14 GiB used, 702 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.33k op/s; 6126/172212 objects misplaced (3.557%); 936 KiB/s, 14 objects/s recovering 2024-02-10T08:31:10.306 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:10.513 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:31:10.519 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:10.520 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:31:10.621 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:31:10.693 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:10.803 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:31:10.808 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:10.809 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:31:10.910 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:31:10.958 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:10.988 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:31:10.991 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:10.992 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:31:11.086 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-10T08:31:11.093 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:31:11.147 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:11.186 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:31:11.194 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:11.194 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:31:11.295 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:31:11.334 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:11.365 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:31:11.369 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:11.370 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:31:11.470 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:31:11.554 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:11.612 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:31:11.615 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:11.615 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:31:11.716 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:31:11.764 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:11.827 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:31:11.834 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:11.835 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:31:11.936 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:31:12.007 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:31:10.901983+0000 mgr.y (mgr.14505) 544 : cluster [DBG] pgmap v660: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 3.5 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1.21k op/s; 6126/171267 objects misplaced (3.577%); 823 KiB/s, 12 objects/s recovering 2024-02-10T08:31:12.008 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:12.035 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:31:12.043 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:12.043 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:31:12.144 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:31:12.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:31:10.901983+0000 mgr.y (mgr.14505) 544 : cluster [DBG] pgmap v660: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 3.5 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1.21k op/s; 6126/171267 objects misplaced (3.577%); 823 KiB/s, 12 objects/s recovering 2024-02-10T08:31:12.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:31:10.901983+0000 mgr.y (mgr.14505) 544 : cluster [DBG] pgmap v660: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 3.5 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1.21k op/s; 6126/171267 objects misplaced (3.577%); 823 KiB/s, 12 objects/s recovering 2024-02-10T08:31:12.196 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:12.227 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:31:12.234 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:12.235 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:31:12.335 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:31:12.383 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:12.420 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:31:12.427 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:12.427 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:31:12.528 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:31:12.590 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:13.359 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:31:13.371 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:13.371 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:31:13.390 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.5 dump_ops_in_flight 2024-02-10T08:31:13.472 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:31:13.537 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:13.569 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:31:13.572 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:13.573 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:31:13.674 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:31:13.739 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:13.772 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:31:13.778 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:13.779 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:31:13.844 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:31:13.880 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:31:13.949 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:13.975 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:31:13.997 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:31:14.002 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:14.003 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:31:14.012 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is unset 2024-02-10T08:31:14.041 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:31:12.902763+0000 mgr.y (mgr.14505) 545 : cluster [DBG] pgmap v661: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 3.2 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.08k op/s; 5448/158937 objects misplaced (3.428%); 749 KiB/s, 11 objects/s recovering 2024-02-10T08:31:14.041 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:31:13.245737+0000 mon.a (mon.0) 1414 : audit [INF] from='client.? 172.21.15.18:0/3873459073' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:31:14.104 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:31:14.154 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:14.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:31:12.902763+0000 mgr.y (mgr.14505) 545 : cluster [DBG] pgmap v661: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 3.2 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.08k op/s; 5448/158937 objects misplaced (3.428%); 749 KiB/s, 11 objects/s recovering 2024-02-10T08:31:14.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:31:13.245737+0000 mon.a (mon.0) 1414 : audit [INF] from='client.? 172.21.15.18:0/3873459073' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:31:14.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:31:12.902763+0000 mgr.y (mgr.14505) 545 : cluster [DBG] pgmap v661: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 3.2 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.08k op/s; 5448/158937 objects misplaced (3.428%); 749 KiB/s, 11 objects/s recovering 2024-02-10T08:31:14.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:31:13.245737+0000 mon.a (mon.0) 1414 : audit [INF] from='client.? 172.21.15.18:0/3873459073' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:31:14.514 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:31:14.519 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:14.520 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:31:14.621 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:31:14.691 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:14.761 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:31:14.769 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:14.769 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:31:14.870 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:31:14.933 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:15.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:31:13.964887+0000 mon.a (mon.0) 1415 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-10T08:31:15.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:31:13.964922+0000 mon.a (mon.0) 1416 : cluster [INF] Cluster is now healthy 2024-02-10T08:31:15.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:31:13.987906+0000 mon.a (mon.0) 1417 : audit [INF] from='client.? 172.21.15.18:0/3873459073' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-10T08:31:15.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:31:13.988110+0000 mon.a (mon.0) 1418 : cluster [DBG] osdmap e305: 8 total, 8 up, 8 in 2024-02-10T08:31:15.047 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:31:15.053 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:15.053 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:31:15.155 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:31:15.209 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:31:13.964887+0000 mon.a (mon.0) 1415 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-10T08:31:15.210 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:31:13.964922+0000 mon.a (mon.0) 1416 : cluster [INF] Cluster is now healthy 2024-02-10T08:31:15.210 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:31:13.987906+0000 mon.a (mon.0) 1417 : audit [INF] from='client.? 172.21.15.18:0/3873459073' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-10T08:31:15.210 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:31:13.988110+0000 mon.a (mon.0) 1418 : cluster [DBG] osdmap e305: 8 total, 8 up, 8 in 2024-02-10T08:31:15.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:31:13.964887+0000 mon.a (mon.0) 1415 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-10T08:31:15.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:31:13.964922+0000 mon.a (mon.0) 1416 : cluster [INF] Cluster is now healthy 2024-02-10T08:31:15.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:31:13.987906+0000 mon.a (mon.0) 1417 : audit [INF] from='client.? 172.21.15.18:0/3873459073' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-10T08:31:15.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:31:13.988110+0000 mon.a (mon.0) 1418 : cluster [DBG] osdmap e305: 8 total, 8 up, 8 in 2024-02-10T08:31:15.217 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:15.254 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:31:15.262 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:15.263 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:31:15.363 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:31:15.419 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:15.461 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:31:15.473 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:15.473 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:31:15.574 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:31:15.627 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:15.695 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:31:15.700 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:15.701 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:31:15.801 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:31:15.859 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:16.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:31:14.909414+0000 mgr.y (mgr.14505) 546 : cluster [DBG] pgmap v663: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 3.2 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1.15k op/s; 5448/155919 objects misplaced (3.494%); 821 KiB/s, 12 objects/s recovering 2024-02-10T08:31:16.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:31:15.788086+0000 mon.a (mon.0) 1419 : cluster [DBG] osdmap e306: 8 total, 8 up, 8 in 2024-02-10T08:31:16.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:31:14.909414+0000 mgr.y (mgr.14505) 546 : cluster [DBG] pgmap v663: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 3.2 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1.15k op/s; 5448/155919 objects misplaced (3.494%); 821 KiB/s, 12 objects/s recovering 2024-02-10T08:31:16.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:31:15.788086+0000 mon.a (mon.0) 1419 : cluster [DBG] osdmap e306: 8 total, 8 up, 8 in 2024-02-10T08:31:16.347 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:31:14.909414+0000 mgr.y (mgr.14505) 546 : cluster [DBG] pgmap v663: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 3.2 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1.15k op/s; 5448/155919 objects misplaced (3.494%); 821 KiB/s, 12 objects/s recovering 2024-02-10T08:31:16.347 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:31:15.788086+0000 mon.a (mon.0) 1419 : cluster [DBG] osdmap e306: 8 total, 8 up, 8 in 2024-02-10T08:31:16.790 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:31:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:31:16] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:31:17.024 INFO:teuthology.orchestra.run.smithi018.stderr:reweighted osd.1 to 1 (10000) 2024-02-10T08:31:17.035 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:31:17.038 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:17.038 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:31:17.050 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:31:16.033348+0000 mon.c (mon.2) 70 : audit [INF] from='client.? 172.21.15.18:0/3300137260' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]: dispatch 2024-02-10T08:31:17.050 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:31:16.033687+0000 mon.a (mon.0) 1420 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]: dispatch 2024-02-10T08:31:17.050 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:31:16.678098+0000 mon.a (mon.0) 1421 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:31:17.050 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:31:16.033348+0000 mon.c (mon.2) 70 : audit [INF] from='client.? 172.21.15.18:0/3300137260' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]: dispatch 2024-02-10T08:31:17.051 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:31:16.033687+0000 mon.a (mon.0) 1420 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]: dispatch 2024-02-10T08:31:17.051 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:31:16.678098+0000 mon.a (mon.0) 1421 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:31:17.073 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd set noscrub 2024-02-10T08:31:17.139 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:31:17.189 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:17.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:31:16.033348+0000 mon.c (mon.2) 70 : audit [INF] from='client.? 172.21.15.18:0/3300137260' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]: dispatch 2024-02-10T08:31:17.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:31:16.033687+0000 mon.a (mon.0) 1420 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]: dispatch 2024-02-10T08:31:17.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:31:16.678098+0000 mon.a (mon.0) 1421 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:31:17.298 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:31:17.301 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:17.301 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:31:17.402 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:31:17.404 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:31:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:31:17] "GET /metrics HTTP/1.1" 200 176259 "" "Prometheus/2.33.4" 2024-02-10T08:31:17.463 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:17.488 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-02-10T08:31:17.488 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:31:17.512 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:31:17.518 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:17.519 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:31:17.619 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:31:17.659 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:17.762 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:31:17.769 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:17.770 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:31:17.871 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:31:17.931 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:31:17.935 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:17.968 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:31:18.000 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:31:18.033 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:31:18.078 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:31:18.112 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:31:18.153 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:31:18.193 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:31:18.202 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-10T08:31:18.202 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-10T08:31:18.202 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-10T08:31:18.202 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-10T08:31:18.202 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-10T08:31:18.202 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-10T08:31:18.203 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-10T08:31:18.203 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-10T08:31:18.226 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:31:16.911277+0000 mgr.y (mgr.14505) 547 : cluster [DBG] pgmap v665: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 3.1 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 720 op/s; 5448/154914 objects misplaced (3.517%); 463 KiB/s, 7 objects/s recovering 2024-02-10T08:31:18.226 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:31:17.005239+0000 mon.a (mon.0) 1422 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2024-02-10T08:31:18.226 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:31:17.005291+0000 mon.a (mon.0) 1423 : cluster [DBG] osdmap e307: 8 total, 8 up, 8 in 2024-02-10T08:31:18.227 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:31:17.897339+0000 mon.c (mon.2) 71 : audit [DBG] from='client.? 172.21.15.18:0/4187010560' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:31:18.227 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:31:17.916436+0000 mon.a (mon.0) 1424 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.7", "id": [5, 0]}]: dispatch 2024-02-10T08:31:18.227 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:31:16.911277+0000 mgr.y (mgr.14505) 547 : cluster [DBG] pgmap v665: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 3.1 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 720 op/s; 5448/154914 objects misplaced (3.517%); 463 KiB/s, 7 objects/s recovering 2024-02-10T08:31:18.227 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:31:17.005239+0000 mon.a (mon.0) 1422 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2024-02-10T08:31:18.227 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:31:17.005291+0000 mon.a (mon.0) 1423 : cluster [DBG] osdmap e307: 8 total, 8 up, 8 in 2024-02-10T08:31:18.227 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:31:17.897339+0000 mon.c (mon.2) 71 : audit [DBG] from='client.? 172.21.15.18:0/4187010560' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:31:18.227 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:31:17.916436+0000 mon.a (mon.0) 1424 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.7", "id": [5, 0]}]: dispatch 2024-02-10T08:31:18.264 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.5 dump_blocked_ops 2024-02-10T08:31:18.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:31:16.911277+0000 mgr.y (mgr.14505) 547 : cluster [DBG] pgmap v665: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 3.1 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 720 op/s; 5448/154914 objects misplaced (3.517%); 463 KiB/s, 7 objects/s recovering 2024-02-10T08:31:18.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:31:17.005239+0000 mon.a (mon.0) 1422 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2024-02-10T08:31:18.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:31:17.005291+0000 mon.a (mon.0) 1423 : cluster [DBG] osdmap e307: 8 total, 8 up, 8 in 2024-02-10T08:31:18.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:31:17.897339+0000 mon.c (mon.2) 71 : audit [DBG] from='client.? 172.21.15.18:0/4187010560' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:31:18.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:31:17.916436+0000 mon.a (mon.0) 1424 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.7", "id": [5, 0]}]: dispatch 2024-02-10T08:31:18.469 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd reweight 2 1 2024-02-10T08:31:18.708 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:31:18.710 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:31:18.714 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:18.715 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:31:18.789 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:31:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:31:18.816 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:31:18.869 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:19.029 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:31:19.043 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:19.043 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:31:19.144 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:31:19.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:31:18.377053+0000 mgr.y (mgr.14505) 548 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:31:19.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:31:18.689570+0000 mon.a (mon.0) 1425 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.7", "id": [5, 0]}]': finished 2024-02-10T08:31:19.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:31:18.689651+0000 mon.a (mon.0) 1426 : cluster [DBG] osdmap e308: 8 total, 8 up, 8 in 2024-02-10T08:31:19.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:31:18.377053+0000 mgr.y (mgr.14505) 548 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:31:19.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:31:18.689570+0000 mon.a (mon.0) 1425 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.7", "id": [5, 0]}]': finished 2024-02-10T08:31:19.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:31:18.689651+0000 mon.a (mon.0) 1426 : cluster [DBG] osdmap e308: 8 total, 8 up, 8 in 2024-02-10T08:31:19.202 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:31:18.377053+0000 mgr.y (mgr.14505) 548 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:31:19.203 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:31:18.689570+0000 mon.a (mon.0) 1425 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.7", "id": [5, 0]}]': finished 2024-02-10T08:31:19.203 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:31:18.689651+0000 mon.a (mon.0) 1426 : cluster [DBG] osdmap e308: 8 total, 8 up, 8 in 2024-02-10T08:31:19.206 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:19.312 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:31:19.617 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:31:19.648 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:31:19.651 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:19.651 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:31:19.752 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:31:19.797 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:19.938 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:31:19.947 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:19.947 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:31:20.048 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:31:20.101 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:20.277 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:31:20.283 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:20.283 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:31:20.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:31:18.911649+0000 mgr.y (mgr.14505) 549 : cluster [DBG] pgmap v668: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 2.8 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 1.05k op/s; 4734/140469 objects misplaced (3.370%); 754 KiB/s, 11 objects/s recovering 2024-02-10T08:31:20.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:31:18.977085+0000 osd.2 (osd.2) 135 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:31:20.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:31:18.977136+0000 osd.2 (osd.2) 136 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:31:20.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:31:19.705466+0000 mon.a (mon.0) 1427 : cluster [DBG] osdmap e309: 8 total, 8 up, 8 in 2024-02-10T08:31:20.385 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:31:20.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:31:18.911649+0000 mgr.y (mgr.14505) 549 : cluster [DBG] pgmap v668: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 2.8 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 1.05k op/s; 4734/140469 objects misplaced (3.370%); 754 KiB/s, 11 objects/s recovering 2024-02-10T08:31:20.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:31:18.977085+0000 osd.2 (osd.2) 135 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:31:20.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:31:18.977136+0000 osd.2 (osd.2) 136 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:31:20.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:31:19.705466+0000 mon.a (mon.0) 1427 : cluster [DBG] osdmap e309: 8 total, 8 up, 8 in 2024-02-10T08:31:20.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:31:18.911649+0000 mgr.y (mgr.14505) 549 : cluster [DBG] pgmap v668: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 2.8 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 1.05k op/s; 4734/140469 objects misplaced (3.370%); 754 KiB/s, 11 objects/s recovering 2024-02-10T08:31:20.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:31:18.977085+0000 osd.2 (osd.2) 135 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:31:20.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:31:18.977136+0000 osd.2 (osd.2) 136 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:31:20.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:31:19.705466+0000 mon.a (mon.0) 1427 : cluster [DBG] osdmap e309: 8 total, 8 up, 8 in 2024-02-10T08:31:20.453 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:20.549 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:31:20.554 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:20.555 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:31:20.655 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:31:20.701 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:20.913 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-02-10T08:31:20.913 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-02-10T08:31:20.913 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-02-10T08:31:20.913 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-02-10T08:31:20.913 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-02-10T08:31:21.254 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-10T08:31:21.567 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:31:21.574 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:21.575 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:31:21.675 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:31:21.722 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:21.751 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.5 dump_historic_ops 2024-02-10T08:31:21.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:31:20.796809+0000 mon.a (mon.0) 1428 : cluster [DBG] osdmap e310: 8 total, 8 up, 8 in 2024-02-10T08:31:21.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:31:20.912065+0000 mgr.y (mgr.14505) 550 : cluster [DBG] pgmap v671: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 2.8 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.28k op/s; 4734/139536 objects misplaced (3.393%); 928 KiB/s, 14 objects/s recovering 2024-02-10T08:31:21.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:31:20.796809+0000 mon.a (mon.0) 1428 : cluster [DBG] osdmap e310: 8 total, 8 up, 8 in 2024-02-10T08:31:21.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:31:20.912065+0000 mgr.y (mgr.14505) 550 : cluster [DBG] pgmap v671: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 2.8 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.28k op/s; 4734/139536 objects misplaced (3.393%); 928 KiB/s, 14 objects/s recovering 2024-02-10T08:31:22.043 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:31:20.796809+0000 mon.a (mon.0) 1428 : cluster [DBG] osdmap e310: 8 total, 8 up, 8 in 2024-02-10T08:31:22.043 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:31:20.912065+0000 mgr.y (mgr.14505) 550 : cluster [DBG] pgmap v671: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 2.8 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.28k op/s; 4734/139536 objects misplaced (3.393%); 928 KiB/s, 14 objects/s recovering 2024-02-10T08:31:22.089 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:31:22.094 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:22.094 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:31:22.195 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:31:22.197 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:31:22.250 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:22.517 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:31:22.520 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:22.520 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:31:22.621 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:31:22.678 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:22.744 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:31:22.752 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:22.753 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:31:22.854 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:31:22.911 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:23.167 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:31:23.171 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:23.171 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:31:23.272 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:31:23.304 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:31:23.312 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:23.370 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:31:23.383 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:23.383 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:31:23.484 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:31:23.539 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:23.757 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:31:23.768 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:23.769 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:31:23.870 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:31:23.939 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:24.010 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is set 2024-02-10T08:31:24.013 INFO:teuthology.orchestra.run.smithi018.stderr:reweighted osd.2 to 1 (10000) 2024-02-10T08:31:24.054 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:31:24.064 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:24.065 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:31:24.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:31:22.913075+0000 mgr.y (mgr.14505) 551 : cluster [DBG] pgmap v672: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 2.6 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 1.53k op/s; 4072/127764 objects misplaced (3.187%); 1.2 MiB/s, 19 objects/s recovering 2024-02-10T08:31:24.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:31:23.213328+0000 mon.a (mon.0) 1429 : audit [INF] from='client.? 172.21.15.18:0/2934329934' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:31:24.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:31:23.584948+0000 mon.a (mon.0) 1430 : audit [INF] from='client.? 172.21.15.18:0/1573145171' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2024-02-10T08:31:24.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:31:22.913075+0000 mgr.y (mgr.14505) 551 : cluster [DBG] pgmap v672: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 2.6 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 1.53k op/s; 4072/127764 objects misplaced (3.187%); 1.2 MiB/s, 19 objects/s recovering 2024-02-10T08:31:24.158 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:31:23.213328+0000 mon.a (mon.0) 1429 : audit [INF] from='client.? 172.21.15.18:0/2934329934' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:31:24.158 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:31:23.584948+0000 mon.a (mon.0) 1430 : audit [INF] from='client.? 172.21.15.18:0/1573145171' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2024-02-10T08:31:24.166 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:31:24.226 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:31:22.913075+0000 mgr.y (mgr.14505) 551 : cluster [DBG] pgmap v672: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 2.6 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 1.53k op/s; 4072/127764 objects misplaced (3.187%); 1.2 MiB/s, 19 objects/s recovering 2024-02-10T08:31:24.226 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:31:23.213328+0000 mon.a (mon.0) 1429 : audit [INF] from='client.? 172.21.15.18:0/2934329934' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:31:24.226 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:31:23.584948+0000 mon.a (mon.0) 1430 : audit [INF] from='client.? 172.21.15.18:0/1573145171' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2024-02-10T08:31:24.233 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:24.353 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:31:24.359 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:24.359 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:31:24.410 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-02-10T08:31:24.410 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-02-10T08:31:24.410 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-02-10T08:31:24.410 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-02-10T08:31:24.410 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.410 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14784.0:153201 7.0 7:0da3817c:::benchmark_data_smithi018_80623_object52273:head [delete] snapc 0=[] ondisk+write+known_if_redirected e149)", 2024-02-10T08:31:24.410 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:22:37.568299+0000", 2024-02-10T08:31:24.410 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 526.83787404400005, 2024-02-10T08:31:24.410 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.074004055999999999, 2024-02-10T08:31:24.410 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:31:24.410 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:31:24.410 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:31:24.411 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14784", 2024-02-10T08:31:24.411 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:31:24.411 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 153201 2024-02-10T08:31:24.411 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.411 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:31:24.411 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.411 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:31:24.411 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:37.568299+0000", 2024-02-10T08:31:24.411 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:31:24.411 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.411 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.411 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:31:24.411 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:37.568299+0000", 2024-02-10T08:31:24.411 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999981 2024-02-10T08:31:24.411 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.412 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.412 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:31:24.412 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:37.568298+0000", 2024-02-10T08:31:24.412 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8169999999999999e-06 2024-02-10T08:31:24.412 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.412 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.412 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:31:24.412 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:37.568305+0000", 2024-02-10T08:31:24.412 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3730999999999999e-05 2024-02-10T08:31:24.412 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.412 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.412 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:31:24.412 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:37.568319+0000", 2024-02-10T08:31:24.412 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5390000000000004e-06 2024-02-10T08:31:24.413 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.413 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.413 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:31:24.413 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:37.568326+0000", 2024-02-10T08:31:24.413 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8596e-05 2024-02-10T08:31:24.413 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.413 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.413 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:31:24.413 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:37.568374+0000", 2024-02-10T08:31:24.413 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011027900000000001 2024-02-10T08:31:24.413 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.413 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.413 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:31:24.413 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:37.568484+0000", 2024-02-10T08:31:24.413 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000113342 2024-02-10T08:31:24.413 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.414 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.414 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1,3", 2024-02-10T08:31:24.414 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:37.568598+0000", 2024-02-10T08:31:24.414 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0042781390000000002 2024-02-10T08:31:24.414 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.414 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.414 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:31:24.414 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:37.572876+0000", 2024-02-10T08:31:24.414 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00635405 2024-02-10T08:31:24.414 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.414 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.414 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:31:24.414 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:37.579230+0000", 2024-02-10T08:31:24.414 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062985816 2024-02-10T08:31:24.415 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.415 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.415 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:31:24.415 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:37.642216+0000", 2024-02-10T08:31:24.415 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7260999999999999e-05 2024-02-10T08:31:24.415 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.415 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.415 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:31:24.415 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:37.642273+0000", 2024-02-10T08:31:24.415 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0176e-05 2024-02-10T08:31:24.415 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.416 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.416 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:31:24.416 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:37.642303+0000", 2024-02-10T08:31:24.416 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.074004055999999999 2024-02-10T08:31:24.416 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:31:24.416 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:31:24.416 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:31:24.416 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.416 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.416 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14784.0:153202 7.0 7:02753f4a:::benchmark_data_smithi018_80623_object52274:head [delete] snapc 0=[] ondisk+write+known_if_redirected e149)", 2024-02-10T08:31:24.416 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:22:37.568340+0000", 2024-02-10T08:31:24.416 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 526.83783291899999, 2024-02-10T08:31:24.416 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.074038372000000005, 2024-02-10T08:31:24.416 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:31:24.417 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:31:24.417 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:31:24.417 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14784", 2024-02-10T08:31:24.417 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:31:24.417 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 153202 2024-02-10T08:31:24.417 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.417 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:31:24.417 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.417 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:31:24.417 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:37.568340+0000", 2024-02-10T08:31:24.417 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:31:24.417 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.417 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.417 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:31:24.417 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:37.568340+0000", 2024-02-10T08:31:24.418 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-02-10T08:31:24.418 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.418 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.418 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:31:24.418 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:37.568340+0000", 2024-02-10T08:31:24.418 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4460000000000001e-06 2024-02-10T08:31:24.418 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.418 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.418 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:31:24.418 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:37.568343+0000", 2024-02-10T08:31:24.418 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2890000000000003e-06 2024-02-10T08:31:24.418 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.418 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.418 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:31:24.419 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:37.568350+0000", 2024-02-10T08:31:24.419 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3549999999999998e-06 2024-02-10T08:31:24.419 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.419 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.419 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:31:24.419 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:37.568354+0000", 2024-02-10T08:31:24.419 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027350780000000002 2024-02-10T08:31:24.419 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.419 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.419 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:31:24.419 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:37.571089+0000", 2024-02-10T08:31:24.419 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8084999999999995e-05 2024-02-10T08:31:24.419 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.420 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.420 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:31:24.420 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:37.571167+0000", 2024-02-10T08:31:24.420 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0115e-05 2024-02-10T08:31:24.420 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.420 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.420 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1,3", 2024-02-10T08:31:24.420 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:37.571257+0000", 2024-02-10T08:31:24.420 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001757677 2024-02-10T08:31:24.420 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.420 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.420 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:31:24.420 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:37.573015+0000", 2024-02-10T08:31:24.420 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0085990879999999995 2024-02-10T08:31:24.420 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.421 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.421 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:31:24.421 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:37.581614+0000", 2024-02-10T08:31:24.421 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060711752000000001 2024-02-10T08:31:24.421 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.421 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.421 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:31:24.421 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:37.642326+0000", 2024-02-10T08:31:24.421 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0349e-05 2024-02-10T08:31:24.421 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.421 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.421 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:31:24.421 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:37.642356+0000", 2024-02-10T08:31:24.421 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2648999999999999e-05 2024-02-10T08:31:24.421 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.421 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.422 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:31:24.422 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:22:37.642379+0000", 2024-02-10T08:31:24.422 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.074038372000000005 2024-02-10T08:31:24.422 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:31:24.422 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:31:24.422 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:31:24.422 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.422 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.422 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14964.0:72451 8.0 8:0a7f45a6:::benchmark_data_smithi018_103312_object72450:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e209)", 2024-02-10T08:31:24.422 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:25:19.619621+0000", 2024-02-10T08:31:24.422 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 364.78655202700003, 2024-02-10T08:31:24.422 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.073357051000000006, 2024-02-10T08:31:24.422 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:31:24.422 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:31:24.422 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:31:24.423 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14964", 2024-02-10T08:31:24.423 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3173131962", 2024-02-10T08:31:24.423 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 72451 2024-02-10T08:31:24.423 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.423 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:31:24.423 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.423 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:31:24.423 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:19.619621+0000", 2024-02-10T08:31:24.423 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:31:24.423 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.423 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.423 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:31:24.423 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:19.619621+0000", 2024-02-10T08:31:24.423 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-02-10T08:31:24.424 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.424 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.424 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:31:24.424 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:19.619620+0000", 2024-02-10T08:31:24.424 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3828000000000001e-05 2024-02-10T08:31:24.424 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.424 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.424 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:31:24.424 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:19.619664+0000", 2024-02-10T08:31:24.424 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8104000000000001e-05 2024-02-10T08:31:24.424 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.424 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.424 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:31:24.424 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:19.619682+0000", 2024-02-10T08:31:24.424 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8029999999999996e-06 2024-02-10T08:31:24.425 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.425 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.425 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:31:24.425 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:19.619687+0000", 2024-02-10T08:31:24.425 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022875899999999999 2024-02-10T08:31:24.425 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.425 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.425 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:31:24.425 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:19.621974+0000", 2024-02-10T08:31:24.425 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011909999999999999 2024-02-10T08:31:24.425 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.425 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.425 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:31:24.425 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:19.622094+0000", 2024-02-10T08:31:24.425 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000146038 2024-02-10T08:31:24.426 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.426 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.426 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1,3", 2024-02-10T08:31:24.426 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:19.622240+0000", 2024-02-10T08:31:24.426 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026653670000000001 2024-02-10T08:31:24.426 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.426 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.426 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:31:24.426 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:19.624905+0000", 2024-02-10T08:31:24.426 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0021152850000000002 2024-02-10T08:31:24.426 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.426 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.426 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:31:24.426 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:19.627020+0000", 2024-02-10T08:31:24.426 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.065860106000000002 2024-02-10T08:31:24.427 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.427 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.427 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:31:24.427 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:19.692880+0000", 2024-02-10T08:31:24.427 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2939000000000003e-05 2024-02-10T08:31:24.427 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.427 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.427 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:31:24.427 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:19.692933+0000", 2024-02-10T08:31:24.427 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4971e-05 2024-02-10T08:31:24.427 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.427 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.427 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:31:24.427 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:19.692978+0000", 2024-02-10T08:31:24.427 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.073357051000000006 2024-02-10T08:31:24.428 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:31:24.428 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:31:24.428 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:31:24.428 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.428 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.428 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14964.0:72469 8.4 8:2db85d94:::benchmark_data_smithi018_103312_object72468:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e209)", 2024-02-10T08:31:24.428 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:25:19.634314+0000", 2024-02-10T08:31:24.428 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 364.77185921900002, 2024-02-10T08:31:24.428 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.074977730000000006, 2024-02-10T08:31:24.428 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:31:24.428 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:31:24.428 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:31:24.428 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14964", 2024-02-10T08:31:24.428 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3173131962", 2024-02-10T08:31:24.429 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 72469 2024-02-10T08:31:24.429 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.429 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:31:24.429 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.429 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:31:24.429 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:19.634314+0000", 2024-02-10T08:31:24.429 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:31:24.429 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.429 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.429 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:31:24.429 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:19.634314+0000", 2024-02-10T08:31:24.429 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-02-10T08:31:24.429 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.429 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.429 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:31:24.430 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:19.634312+0000", 2024-02-10T08:31:24.430 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3399999999999996e-05 2024-02-10T08:31:24.430 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.430 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.430 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:31:24.430 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:19.634376+0000", 2024-02-10T08:31:24.430 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9180000000000006e-06 2024-02-10T08:31:24.430 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.430 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.430 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:31:24.430 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:19.634386+0000", 2024-02-10T08:31:24.430 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0070000000000003e-06 2024-02-10T08:31:24.430 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.430 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.430 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:31:24.431 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:19.634392+0000", 2024-02-10T08:31:24.431 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2765999999999997e-05 2024-02-10T08:31:24.431 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.431 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.431 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:31:24.431 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:19.634435+0000", 2024-02-10T08:31:24.431 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.058169680000000001 2024-02-10T08:31:24.431 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.431 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.431 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:31:24.431 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:19.692604+0000", 2024-02-10T08:31:24.431 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017672599999999999 2024-02-10T08:31:24.431 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.431 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.431 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2,4", 2024-02-10T08:31:24.432 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:19.692781+0000", 2024-02-10T08:31:24.432 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0067628139999999998 2024-02-10T08:31:24.432 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.432 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.432 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:31:24.432 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:19.699544+0000", 2024-02-10T08:31:24.432 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9335999999999997e-05 2024-02-10T08:31:24.432 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.432 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.432 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:31:24.432 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:19.699583+0000", 2024-02-10T08:31:24.432 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0096261119999999992 2024-02-10T08:31:24.432 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.432 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.432 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:31:24.433 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:19.709209+0000", 2024-02-10T08:31:24.433 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5385e-05 2024-02-10T08:31:24.433 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.433 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.433 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:31:24.433 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:19.709255+0000", 2024-02-10T08:31:24.433 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7132000000000003e-05 2024-02-10T08:31:24.433 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.433 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.433 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:31:24.433 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:19.709292+0000", 2024-02-10T08:31:24.433 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.074977730000000006 2024-02-10T08:31:24.433 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:31:24.433 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:31:24.433 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:31:24.433 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.434 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.434 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14964.0:73142 8.8 8:10b853d2:::benchmark_data_smithi018_103312_object73141:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e209)", 2024-02-10T08:31:24.434 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:25:20.214731+0000", 2024-02-10T08:31:24.434 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 364.19144208300003, 2024-02-10T08:31:24.434 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.079400939000000004, 2024-02-10T08:31:24.434 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:31:24.434 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:31:24.434 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:31:24.434 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14964", 2024-02-10T08:31:24.434 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3173131962", 2024-02-10T08:31:24.434 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 73142 2024-02-10T08:31:24.434 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.434 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:31:24.434 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.434 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:31:24.435 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.214731+0000", 2024-02-10T08:31:24.435 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:31:24.435 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.435 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.435 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:31:24.435 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.214731+0000", 2024-02-10T08:31:24.435 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-02-10T08:31:24.435 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.435 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.435 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:31:24.435 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.214730+0000", 2024-02-10T08:31:24.435 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4034000000000004e-05 2024-02-10T08:31:24.435 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.435 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.435 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:31:24.436 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.214794+0000", 2024-02-10T08:31:24.436 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0648e-05 2024-02-10T08:31:24.436 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.436 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.436 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:31:24.436 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.214805+0000", 2024-02-10T08:31:24.436 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5810000000000002e-06 2024-02-10T08:31:24.436 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.436 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.436 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:31:24.436 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.214811+0000", 2024-02-10T08:31:24.436 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2089000000000003e-05 2024-02-10T08:31:24.436 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.437 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.437 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:31:24.437 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.214853+0000", 2024-02-10T08:31:24.437 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8621000000000003e-05 2024-02-10T08:31:24.437 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.437 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.437 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:31:24.437 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.214952+0000", 2024-02-10T08:31:24.437 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000120902 2024-02-10T08:31:24.437 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.437 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.437 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3,7", 2024-02-10T08:31:24.437 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.215073+0000", 2024-02-10T08:31:24.437 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0047544470000000002 2024-02-10T08:31:24.437 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.438 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.438 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:31:24.438 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.219827+0000", 2024-02-10T08:31:24.438 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0025164969999999999 2024-02-10T08:31:24.438 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.438 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.438 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:31:24.438 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.222344+0000", 2024-02-10T08:31:24.438 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.071697150000000001 2024-02-10T08:31:24.438 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.438 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.438 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:31:24.438 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.294041+0000", 2024-02-10T08:31:24.438 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1406999999999998e-05 2024-02-10T08:31:24.439 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.439 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.439 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:31:24.439 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.294092+0000", 2024-02-10T08:31:24.439 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9777000000000002e-05 2024-02-10T08:31:24.439 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.439 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.439 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:31:24.439 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.294132+0000", 2024-02-10T08:31:24.439 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.079400939000000004 2024-02-10T08:31:24.439 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:31:24.439 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:31:24.439 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:31:24.439 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.439 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.440 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14964.0:73144 8.d 8:b23bd7f6:::benchmark_data_smithi018_103312_object73143:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e209)", 2024-02-10T08:31:24.440 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:25:20.217769+0000", 2024-02-10T08:31:24.440 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 364.188404703, 2024-02-10T08:31:24.440 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.083789786000000005, 2024-02-10T08:31:24.440 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:31:24.440 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:31:24.440 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:31:24.440 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14964", 2024-02-10T08:31:24.440 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3173131962", 2024-02-10T08:31:24.440 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 73144 2024-02-10T08:31:24.440 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.440 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:31:24.440 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.440 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:31:24.441 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.217769+0000", 2024-02-10T08:31:24.441 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:31:24.441 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.441 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.441 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:31:24.441 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.217769+0000", 2024-02-10T08:31:24.441 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-02-10T08:31:24.441 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.441 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.441 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:31:24.441 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.217767+0000", 2024-02-10T08:31:24.442 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7500000000000003e-05 2024-02-10T08:31:24.442 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.442 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.442 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:31:24.442 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.217815+0000", 2024-02-10T08:31:24.442 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2299999999999996e-06 2024-02-10T08:31:24.442 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.442 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.442 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:31:24.442 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.217821+0000", 2024-02-10T08:31:24.442 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0899999999999998e-06 2024-02-10T08:31:24.442 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.442 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.442 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:31:24.443 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.217825+0000", 2024-02-10T08:31:24.443 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3590999999999997e-05 2024-02-10T08:31:24.443 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.443 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.443 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:31:24.443 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.217859+0000", 2024-02-10T08:31:24.443 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8542999999999997e-05 2024-02-10T08:31:24.443 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.443 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.443 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:31:24.443 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.217937+0000", 2024-02-10T08:31:24.443 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000143313 2024-02-10T08:31:24.443 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.443 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.443 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2,7", 2024-02-10T08:31:24.444 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.218081+0000", 2024-02-10T08:31:24.444 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.078254647999999996 2024-02-10T08:31:24.444 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.444 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.444 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:31:24.444 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.296335+0000", 2024-02-10T08:31:24.444 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6907000000000001e-05 2024-02-10T08:31:24.444 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.444 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.444 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:31:24.444 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.296412+0000", 2024-02-10T08:31:24.444 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0050549280000000002 2024-02-10T08:31:24.444 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.444 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.444 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:31:24.445 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.301467+0000", 2024-02-10T08:31:24.445 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0926e-05 2024-02-10T08:31:24.445 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.445 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.445 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:31:24.445 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.301518+0000", 2024-02-10T08:31:24.445 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0299999999999997e-05 2024-02-10T08:31:24.445 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.445 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.445 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:31:24.445 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.301558+0000", 2024-02-10T08:31:24.445 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.083789786000000005 2024-02-10T08:31:24.445 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:31:24.445 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:31:24.445 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:31:24.446 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.446 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.446 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14964.0:73150 8.4 8:27486389:::benchmark_data_smithi018_103312_object73149:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e209)", 2024-02-10T08:31:24.446 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:25:20.217947+0000", 2024-02-10T08:31:24.446 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 364.18822575500002, 2024-02-10T08:31:24.446 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.078843066000000003, 2024-02-10T08:31:24.446 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:31:24.446 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:31:24.446 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:31:24.446 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14964", 2024-02-10T08:31:24.446 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3173131962", 2024-02-10T08:31:24.446 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 73150 2024-02-10T08:31:24.446 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.446 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:31:24.446 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.447 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:31:24.447 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.217947+0000", 2024-02-10T08:31:24.447 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:31:24.447 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.447 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.447 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:31:24.447 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.217947+0000", 2024-02-10T08:31:24.447 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-02-10T08:31:24.447 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.447 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.447 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:31:24.447 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.217947+0000", 2024-02-10T08:31:24.447 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7044000000000004e-05 2024-02-10T08:31:24.447 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.447 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.447 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:31:24.448 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.218014+0000", 2024-02-10T08:31:24.448 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4660000000000002e-06 2024-02-10T08:31:24.448 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.448 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.448 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:31:24.448 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.218021+0000", 2024-02-10T08:31:24.448 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3700000000000003e-06 2024-02-10T08:31:24.448 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.448 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.448 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:31:24.448 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.218026+0000", 2024-02-10T08:31:24.448 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001206613 2024-02-10T08:31:24.448 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.448 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.449 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:31:24.449 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.219233+0000", 2024-02-10T08:31:24.449 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012368899999999999 2024-02-10T08:31:24.449 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.449 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.449 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:31:24.449 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.219357+0000", 2024-02-10T08:31:24.449 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000131433 2024-02-10T08:31:24.449 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.449 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.449 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2,4", 2024-02-10T08:31:24.449 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.219488+0000", 2024-02-10T08:31:24.449 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029227760000000002 2024-02-10T08:31:24.449 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.450 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.450 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:31:24.450 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.222411+0000", 2024-02-10T08:31:24.450 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.071538437999999996 2024-02-10T08:31:24.450 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.450 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.450 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:31:24.450 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.293949+0000", 2024-02-10T08:31:24.450 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027587649999999998 2024-02-10T08:31:24.450 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.450 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.450 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:31:24.450 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.296708+0000", 2024-02-10T08:31:24.450 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6229000000000001e-05 2024-02-10T08:31:24.450 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.451 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.451 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:31:24.451 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.296754+0000", 2024-02-10T08:31:24.451 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6137999999999999e-05 2024-02-10T08:31:24.451 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.451 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.451 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:31:24.451 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.296791+0000", 2024-02-10T08:31:24.451 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.078843066000000003 2024-02-10T08:31:24.451 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:31:24.451 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:31:24.451 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:31:24.451 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.451 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.451 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14964.0:73151 8.d 8:b408dc66:::benchmark_data_smithi018_103312_object73150:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e209)", 2024-02-10T08:31:24.452 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:25:20.218042+0000", 2024-02-10T08:31:24.452 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 364.18813129, 2024-02-10T08:31:24.452 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.083609841000000004, 2024-02-10T08:31:24.452 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:31:24.452 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:31:24.452 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:31:24.452 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14964", 2024-02-10T08:31:24.452 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3173131962", 2024-02-10T08:31:24.452 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 73151 2024-02-10T08:31:24.452 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.452 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:31:24.452 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.452 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:31:24.452 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.218042+0000", 2024-02-10T08:31:24.452 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:31:24.453 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.453 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.453 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:31:24.453 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.218042+0000", 2024-02-10T08:31:24.453 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-02-10T08:31:24.453 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.453 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.453 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:31:24.453 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.218041+0000", 2024-02-10T08:31:24.453 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5902999999999998e-05 2024-02-10T08:31:24.453 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.453 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.453 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:31:24.453 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.218077+0000", 2024-02-10T08:31:24.453 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4980000000000003e-06 2024-02-10T08:31:24.453 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.454 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.454 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:31:24.454 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.218084+0000", 2024-02-10T08:31:24.454 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7380000000000002e-06 2024-02-10T08:31:24.454 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.454 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.454 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:31:24.454 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.218088+0000", 2024-02-10T08:31:24.454 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019494899999999999 2024-02-10T08:31:24.454 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.454 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.454 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:31:24.454 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.220038+0000", 2024-02-10T08:31:24.454 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010433 2024-02-10T08:31:24.454 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.455 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.455 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:31:24.455 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.220142+0000", 2024-02-10T08:31:24.455 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013461699999999999 2024-02-10T08:31:24.455 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.455 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.455 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2,7", 2024-02-10T08:31:24.455 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.220277+0000", 2024-02-10T08:31:24.455 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.076084882000000006 2024-02-10T08:31:24.455 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.455 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.455 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:31:24.455 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.296362+0000", 2024-02-10T08:31:24.455 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8720999999999994e-05 2024-02-10T08:31:24.455 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.456 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.456 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:31:24.456 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.296440+0000", 2024-02-10T08:31:24.456 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0051284939999999999 2024-02-10T08:31:24.456 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.456 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.456 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:31:24.456 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.301569+0000", 2024-02-10T08:31:24.456 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5473999999999999e-05 2024-02-10T08:31:24.456 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.456 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.456 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:31:24.456 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.301614+0000", 2024-02-10T08:31:24.456 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7382999999999998e-05 2024-02-10T08:31:24.456 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.457 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.457 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:31:24.457 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.301652+0000", 2024-02-10T08:31:24.457 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.083609841000000004 2024-02-10T08:31:24.457 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:31:24.457 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:31:24.457 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:31:24.457 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.457 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.457 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14964.0:73152 8.d 8:b1c3d8f0:::benchmark_data_smithi018_103312_object73151:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e209)", 2024-02-10T08:31:24.457 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:25:20.218094+0000", 2024-02-10T08:31:24.457 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 364.18807881700002, 2024-02-10T08:31:24.457 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.083646370999999997, 2024-02-10T08:31:24.457 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:31:24.457 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:31:24.458 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:31:24.458 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14964", 2024-02-10T08:31:24.458 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3173131962", 2024-02-10T08:31:24.458 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 73152 2024-02-10T08:31:24.458 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.458 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:31:24.458 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.458 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:31:24.458 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.218094+0000", 2024-02-10T08:31:24.458 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:31:24.458 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.458 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.458 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:31:24.458 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.218094+0000", 2024-02-10T08:31:24.458 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-02-10T08:31:24.459 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.459 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.459 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:31:24.459 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.218094+0000", 2024-02-10T08:31:24.459 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4422999999999999e-05 2024-02-10T08:31:24.459 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.459 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.459 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:31:24.459 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.218128+0000", 2024-02-10T08:31:24.459 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8830000000000003e-06 2024-02-10T08:31:24.459 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.459 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.459 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:31:24.459 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.218134+0000", 2024-02-10T08:31:24.459 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0930000000000002e-06 2024-02-10T08:31:24.460 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.460 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.460 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:31:24.460 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.218139+0000", 2024-02-10T08:31:24.460 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0041500219999999997 2024-02-10T08:31:24.460 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.460 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.460 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:31:24.460 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.222289+0000", 2024-02-10T08:31:24.460 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011436 2024-02-10T08:31:24.460 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.460 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.460 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:31:24.460 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.222404+0000", 2024-02-10T08:31:24.460 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013335800000000001 2024-02-10T08:31:24.461 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.461 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.461 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2,7", 2024-02-10T08:31:24.461 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.222537+0000", 2024-02-10T08:31:24.461 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.073850097000000003 2024-02-10T08:31:24.461 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.461 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.461 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:31:24.461 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.296387+0000", 2024-02-10T08:31:24.461 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7664999999999996e-05 2024-02-10T08:31:24.461 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.461 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.461 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:31:24.461 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.296465+0000", 2024-02-10T08:31:24.462 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.005195903 2024-02-10T08:31:24.462 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.462 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.462 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:31:24.462 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.301661+0000", 2024-02-10T08:31:24.462 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8124999999999997e-05 2024-02-10T08:31:24.462 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.462 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.462 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:31:24.462 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.301709+0000", 2024-02-10T08:31:24.462 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2098000000000003e-05 2024-02-10T08:31:24.462 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.462 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.462 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:31:24.462 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.301741+0000", 2024-02-10T08:31:24.463 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.083646370999999997 2024-02-10T08:31:24.463 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:31:24.463 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:31:24.463 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:31:24.463 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.463 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.463 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14964.0:73153 8.8 8:14f6b5ab:::benchmark_data_smithi018_103312_object73152:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e209)", 2024-02-10T08:31:24.463 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:25:20.222870+0000", 2024-02-10T08:31:24.463 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 364.18330368800002, 2024-02-10T08:31:24.463 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.07713383, 2024-02-10T08:31:24.463 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:31:24.463 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:31:24.463 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:31:24.463 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14964", 2024-02-10T08:31:24.463 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3173131962", 2024-02-10T08:31:24.464 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 73153 2024-02-10T08:31:24.464 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.464 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:31:24.464 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.464 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:31:24.464 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.222870+0000", 2024-02-10T08:31:24.464 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:31:24.464 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.464 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.464 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:31:24.464 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.222870+0000", 2024-02-10T08:31:24.464 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-02-10T08:31:24.464 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.464 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.464 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:31:24.465 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.222868+0000", 2024-02-10T08:31:24.465 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6891000000000001e-05 2024-02-10T08:31:24.465 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.465 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.465 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:31:24.465 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.222925+0000", 2024-02-10T08:31:24.465 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.070727073000000001 2024-02-10T08:31:24.465 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.465 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.465 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:31:24.465 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.293652+0000", 2024-02-10T08:31:24.465 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.482e-05 2024-02-10T08:31:24.465 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.465 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.465 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:31:24.466 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.293667+0000", 2024-02-10T08:31:24.466 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00050296399999999995 2024-02-10T08:31:24.466 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.466 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.466 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:31:24.466 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.294170+0000", 2024-02-10T08:31:24.466 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000126415 2024-02-10T08:31:24.466 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.466 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.466 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:31:24.466 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.294296+0000", 2024-02-10T08:31:24.467 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015825999999999999 2024-02-10T08:31:24.467 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.467 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.467 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3,7", 2024-02-10T08:31:24.467 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.294455+0000", 2024-02-10T08:31:24.467 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0051255429999999998 2024-02-10T08:31:24.467 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.467 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.467 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:31:24.467 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.299580+0000", 2024-02-10T08:31:24.467 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016134 2024-02-10T08:31:24.467 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.467 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.467 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:31:24.467 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.299742+0000", 2024-02-10T08:31:24.468 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000164733 2024-02-10T08:31:24.468 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.468 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.468 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:31:24.468 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.299906+0000", 2024-02-10T08:31:24.468 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8940999999999997e-05 2024-02-10T08:31:24.468 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.468 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.468 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:31:24.468 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.299965+0000", 2024-02-10T08:31:24.468 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8121000000000003e-05 2024-02-10T08:31:24.469 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.469 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.469 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:31:24.469 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.300003+0000", 2024-02-10T08:31:24.469 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.07713383 2024-02-10T08:31:24.469 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:31:24.469 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:31:24.469 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:31:24.469 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.469 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.469 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.14964.0:73156 8.9 e209/191 8:9e41d033:::benchmark_data_smithi018_103312_object73155:head v 209'4559, mlcod=209'4557)", 2024-02-10T08:31:24.469 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:25:20.225292+0000", 2024-02-10T08:31:24.469 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 364.18088138500002, 2024-02-10T08:31:24.469 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.074292784000000001, 2024-02-10T08:31:24.469 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:31:24.470 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:31:24.470 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:31:24.470 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.470 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:31:24.470 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.225292+0000", 2024-02-10T08:31:24.470 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:31:24.470 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.470 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.470 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:31:24.470 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.225292+0000", 2024-02-10T08:31:24.470 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-02-10T08:31:24.470 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.470 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.470 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:31:24.470 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.225291+0000", 2024-02-10T08:31:24.471 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3011e-05 2024-02-10T08:31:24.471 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.471 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.471 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:31:24.471 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.225314+0000", 2024-02-10T08:31:24.471 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.068350201999999999 2024-02-10T08:31:24.471 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.471 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.471 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:31:24.471 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.293664+0000", 2024-02-10T08:31:24.471 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6290000000000001e-06 2024-02-10T08:31:24.471 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.471 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.471 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:31:24.471 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.293672+0000", 2024-02-10T08:31:24.472 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1418e-05 2024-02-10T08:31:24.472 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.472 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.472 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:31:24.472 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.293733+0000", 2024-02-10T08:31:24.472 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0085000000000002e-05 2024-02-10T08:31:24.472 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.472 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.472 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:31:24.472 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.293753+0000", 2024-02-10T08:31:24.472 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0058046299999999999 2024-02-10T08:31:24.472 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.472 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.472 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:31:24.472 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.299558+0000", 2024-02-10T08:31:24.473 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6903e-05 2024-02-10T08:31:24.473 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.473 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.473 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:31:24.473 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:20.299585+0000", 2024-02-10T08:31:24.473 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.074292784000000001 2024-02-10T08:31:24.473 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:31:24.473 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:31:24.473 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:31:24.473 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.473 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.473 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14964.0:79636 8.0 8:0d3ff637:::benchmark_data_smithi018_103312_object79635:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e209)", 2024-02-10T08:31:24.473 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:25:25.983095+0000", 2024-02-10T08:31:24.473 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 358.42307810400001, 2024-02-10T08:31:24.473 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.083324499999999996, 2024-02-10T08:31:24.474 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:31:24.474 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:31:24.474 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:31:24.474 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14964", 2024-02-10T08:31:24.474 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3173131962", 2024-02-10T08:31:24.474 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 79636 2024-02-10T08:31:24.474 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.474 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:31:24.474 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.474 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:31:24.474 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:25.983095+0000", 2024-02-10T08:31:24.474 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:31:24.474 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.474 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.474 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:31:24.475 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:25.983095+0000", 2024-02-10T08:31:24.475 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-02-10T08:31:24.475 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.475 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.475 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:31:24.475 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:25.983094+0000", 2024-02-10T08:31:24.475 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000134432 2024-02-10T08:31:24.475 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.475 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.475 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:31:24.475 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:25.983229+0000", 2024-02-10T08:31:24.475 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3559999999999993e-06 2024-02-10T08:31:24.475 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.475 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.475 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:31:24.476 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:25.983237+0000", 2024-02-10T08:31:24.476 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3800000000000002e-06 2024-02-10T08:31:24.476 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.476 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.476 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:31:24.476 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:25.983242+0000", 2024-02-10T08:31:24.476 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0025795319999999998 2024-02-10T08:31:24.476 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.476 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.476 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:31:24.476 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:25.985822+0000", 2024-02-10T08:31:24.476 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010873400000000001 2024-02-10T08:31:24.476 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.476 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.476 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:31:24.477 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:25.985931+0000", 2024-02-10T08:31:24.477 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.054865126 2024-02-10T08:31:24.477 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.477 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.477 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1,3", 2024-02-10T08:31:24.477 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:26.040796+0000", 2024-02-10T08:31:24.477 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0083604779999999993 2024-02-10T08:31:24.477 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.477 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.477 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:31:24.477 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:26.049156+0000", 2024-02-10T08:31:24.477 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6249000000000003e-05 2024-02-10T08:31:24.477 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.477 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.477 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:31:24.478 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:26.049213+0000", 2024-02-10T08:31:24.478 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017126252000000002 2024-02-10T08:31:24.478 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.478 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.478 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:31:24.478 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:26.066339+0000", 2024-02-10T08:31:24.478 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4941000000000002e-05 2024-02-10T08:31:24.478 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.478 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.478 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:31:24.478 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:26.066384+0000", 2024-02-10T08:31:24.478 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5850999999999999e-05 2024-02-10T08:31:24.478 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.478 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.478 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:31:24.479 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:26.066420+0000", 2024-02-10T08:31:24.479 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.083324499999999996 2024-02-10T08:31:24.479 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:31:24.479 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:31:24.479 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:31:24.479 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.479 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.479 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14964.0:117897 8.0 8:0a28aa18:::benchmark_data_smithi018_103312_object117896:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e216)", 2024-02-10T08:31:24.479 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:26:01.453819+0000", 2024-02-10T08:31:24.479 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 322.95235377400002, 2024-02-10T08:31:24.479 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.073608589000000002, 2024-02-10T08:31:24.479 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:31:24.479 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:31:24.479 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:31:24.479 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14964", 2024-02-10T08:31:24.480 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3173131962", 2024-02-10T08:31:24.480 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 117897 2024-02-10T08:31:24.480 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.480 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:31:24.480 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.480 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:31:24.480 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:26:01.453819+0000", 2024-02-10T08:31:24.480 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:31:24.480 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.480 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.480 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:31:24.480 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:26:01.453819+0000", 2024-02-10T08:31:24.480 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-02-10T08:31:24.480 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.480 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.481 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:31:24.481 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:26:01.453818+0000", 2024-02-10T08:31:24.481 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1209000000000003e-05 2024-02-10T08:31:24.481 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.481 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.481 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:31:24.481 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:26:01.453880+0000", 2024-02-10T08:31:24.481 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4320000000000002e-06 2024-02-10T08:31:24.481 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.481 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.481 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:31:24.481 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:26:01.453887+0000", 2024-02-10T08:31:24.481 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1289999999999998e-06 2024-02-10T08:31:24.481 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.481 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.481 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:31:24.482 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:26:01.453894+0000", 2024-02-10T08:31:24.482 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0023699179999999999 2024-02-10T08:31:24.482 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.482 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.482 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:31:24.482 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:26:01.456264+0000", 2024-02-10T08:31:24.482 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000111878 2024-02-10T08:31:24.482 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.482 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.482 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:31:24.482 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:26:01.456376+0000", 2024-02-10T08:31:24.482 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014375799999999999 2024-02-10T08:31:24.482 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.482 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.482 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1,3", 2024-02-10T08:31:24.483 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:26:01.456520+0000", 2024-02-10T08:31:24.483 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0023121550000000002 2024-02-10T08:31:24.483 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.483 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.483 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:31:24.483 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:26:01.458832+0000", 2024-02-10T08:31:24.483 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0062256150000000003 2024-02-10T08:31:24.483 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.483 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.483 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:31:24.483 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:26:01.465058+0000", 2024-02-10T08:31:24.483 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062296998999999999 2024-02-10T08:31:24.483 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.483 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.483 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:31:24.484 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:26:01.527355+0000", 2024-02-10T08:31:24.484 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9715000000000002e-05 2024-02-10T08:31:24.484 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.484 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.484 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:31:24.484 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:26:01.527394+0000", 2024-02-10T08:31:24.484 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3769999999999997e-05 2024-02-10T08:31:24.484 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.484 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.484 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:31:24.484 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:26:01.527428+0000", 2024-02-10T08:31:24.484 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.073608589000000002 2024-02-10T08:31:24.484 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:31:24.484 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:31:24.484 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:31:24.484 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.485 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.485 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.15198.0:143515 9.6 9:6686ac07:::benchmark_data_smithi018_124176_object21776:head [delete] snapc 0=[] ondisk+write+known_if_redirected e290)", 2024-02-10T08:31:24.485 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:30:28.469007+0000", 2024-02-10T08:31:24.485 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 55.937166484999999, 2024-02-10T08:31:24.485 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.086197009000000005, 2024-02-10T08:31:24.485 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:31:24.485 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:31:24.485 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:31:24.485 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.15198", 2024-02-10T08:31:24.485 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/1957604827", 2024-02-10T08:31:24.485 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 143515 2024-02-10T08:31:24.485 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.485 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:31:24.485 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.485 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:31:24.486 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.469007+0000", 2024-02-10T08:31:24.486 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:31:24.486 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.486 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.486 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:31:24.486 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.469007+0000", 2024-02-10T08:31:24.486 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-02-10T08:31:24.486 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.486 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.486 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:31:24.486 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.469005+0000", 2024-02-10T08:31:24.486 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3509999999999998e-06 2024-02-10T08:31:24.486 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.486 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.486 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:31:24.486 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.469012+0000", 2024-02-10T08:31:24.487 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0413e-05 2024-02-10T08:31:24.487 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.487 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.487 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:31:24.487 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.469022+0000", 2024-02-10T08:31:24.487 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.801e-06 2024-02-10T08:31:24.487 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.487 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.487 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:31:24.487 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.469028+0000", 2024-02-10T08:31:24.487 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0053389639999999999 2024-02-10T08:31:24.487 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.487 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.487 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:31:24.487 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.474367+0000", 2024-02-10T08:31:24.488 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2886000000000005e-05 2024-02-10T08:31:24.488 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.488 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.488 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:31:24.488 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.474460+0000", 2024-02-10T08:31:24.488 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000111221 2024-02-10T08:31:24.488 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.488 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.488 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1,2", 2024-02-10T08:31:24.488 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.474571+0000", 2024-02-10T08:31:24.488 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0042096549999999996 2024-02-10T08:31:24.488 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.488 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.488 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:31:24.489 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.478780+0000", 2024-02-10T08:31:24.489 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014980690000000001 2024-02-10T08:31:24.489 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.489 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.489 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:31:24.489 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.480279+0000", 2024-02-10T08:31:24.489 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.074817414999999998 2024-02-10T08:31:24.489 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.489 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.489 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:31:24.489 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.555096+0000", 2024-02-10T08:31:24.489 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5259000000000002e-05 2024-02-10T08:31:24.489 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.489 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.489 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:31:24.489 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.555141+0000", 2024-02-10T08:31:24.490 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2557000000000004e-05 2024-02-10T08:31:24.490 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.490 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.490 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:31:24.490 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.555204+0000", 2024-02-10T08:31:24.490 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.086197009000000005 2024-02-10T08:31:24.490 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:31:24.490 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:31:24.490 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:31:24.490 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.490 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.490 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.15198.0:143519 9.a 9:5b3c6eb8:::benchmark_data_smithi018_124176_object21780:head [delete] snapc 0=[] ondisk+write+known_if_redirected e290)", 2024-02-10T08:31:24.490 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:30:28.473226+0000", 2024-02-10T08:31:24.490 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 55.932947638000002, 2024-02-10T08:31:24.490 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.076848794999999998, 2024-02-10T08:31:24.491 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:31:24.491 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:31:24.491 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:31:24.491 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.15198", 2024-02-10T08:31:24.491 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/1957604827", 2024-02-10T08:31:24.491 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 143519 2024-02-10T08:31:24.491 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.491 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:31:24.491 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.491 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:31:24.491 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.473226+0000", 2024-02-10T08:31:24.491 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:31:24.491 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.491 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.491 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:31:24.492 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.473226+0000", 2024-02-10T08:31:24.492 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999981 2024-02-10T08:31:24.492 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.492 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.492 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:31:24.492 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.473224+0000", 2024-02-10T08:31:24.492 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9850000000000001e-06 2024-02-10T08:31:24.492 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.492 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.492 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:31:24.492 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.473234+0000", 2024-02-10T08:31:24.492 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2779000000000001e-05 2024-02-10T08:31:24.492 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.492 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.492 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:31:24.493 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.473247+0000", 2024-02-10T08:31:24.493 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9539999999999998e-06 2024-02-10T08:31:24.493 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.493 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.493 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:31:24.493 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.473254+0000", 2024-02-10T08:31:24.493 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012801300000000001 2024-02-10T08:31:24.493 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.493 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.493 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:31:24.493 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.473382+0000", 2024-02-10T08:31:24.493 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5050000000000006e-05 2024-02-10T08:31:24.493 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.493 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.493 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:31:24.493 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.473477+0000", 2024-02-10T08:31:24.494 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4492000000000003e-05 2024-02-10T08:31:24.494 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.494 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.494 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1,7", 2024-02-10T08:31:24.494 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.473571+0000", 2024-02-10T08:31:24.494 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022719749999999999 2024-02-10T08:31:24.494 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.494 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.494 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:31:24.494 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.475843+0000", 2024-02-10T08:31:24.494 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035113810000000001 2024-02-10T08:31:24.494 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.494 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.494 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:31:24.494 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.479354+0000", 2024-02-10T08:31:24.495 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.070623697999999999 2024-02-10T08:31:24.495 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.495 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.495 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:31:24.495 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.549978+0000", 2024-02-10T08:31:24.495 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2923999999999997e-05 2024-02-10T08:31:24.495 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.495 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.495 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:31:24.495 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.550031+0000", 2024-02-10T08:31:24.495 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3322000000000003e-05 2024-02-10T08:31:24.495 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.495 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.495 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:31:24.495 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.550074+0000", 2024-02-10T08:31:24.496 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.076848794999999998 2024-02-10T08:31:24.496 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:31:24.496 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:31:24.496 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:31:24.496 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.496 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.496 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.15198.0:143520 9.6 9:683128d8:::benchmark_data_smithi018_124176_object21781:head [delete] snapc 0=[] ondisk+write+known_if_redirected e290)", 2024-02-10T08:31:24.496 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:30:28.473268+0000", 2024-02-10T08:31:24.496 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 55.932904800999999, 2024-02-10T08:31:24.496 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.082049729000000002, 2024-02-10T08:31:24.496 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:31:24.496 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:31:24.496 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:31:24.496 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.15198", 2024-02-10T08:31:24.496 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/1957604827", 2024-02-10T08:31:24.497 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 143520 2024-02-10T08:31:24.497 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.497 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:31:24.497 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.497 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:31:24.497 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.473268+0000", 2024-02-10T08:31:24.497 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:31:24.497 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.497 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.497 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:31:24.497 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.473268+0000", 2024-02-10T08:31:24.497 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-02-10T08:31:24.497 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.497 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.497 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:31:24.497 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.473268+0000", 2024-02-10T08:31:24.498 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5930000000000002e-06 2024-02-10T08:31:24.498 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.498 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.498 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:31:24.498 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.473271+0000", 2024-02-10T08:31:24.498 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.541e-06 2024-02-10T08:31:24.498 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.498 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.498 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:31:24.498 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.473277+0000", 2024-02-10T08:31:24.498 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3089999999999997e-06 2024-02-10T08:31:24.498 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.498 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.498 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:31:24.498 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.473281+0000", 2024-02-10T08:31:24.499 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003377732 2024-02-10T08:31:24.499 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.499 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.499 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:31:24.499 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.476659+0000", 2024-02-10T08:31:24.499 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8808000000000007e-05 2024-02-10T08:31:24.499 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.499 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.499 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:31:24.499 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.476758+0000", 2024-02-10T08:31:24.499 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011664500000000001 2024-02-10T08:31:24.499 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.499 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.499 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1,2", 2024-02-10T08:31:24.499 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.476874+0000", 2024-02-10T08:31:24.500 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020644859999999999 2024-02-10T08:31:24.500 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.500 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.500 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:31:24.500 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.478939+0000", 2024-02-10T08:31:24.500 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014001409999999999 2024-02-10T08:31:24.500 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.500 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.500 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:31:24.500 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.480339+0000", 2024-02-10T08:31:24.500 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.074900196000000002 2024-02-10T08:31:24.500 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.500 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.500 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:31:24.500 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.555239+0000", 2024-02-10T08:31:24.501 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7219999999999999e-05 2024-02-10T08:31:24.501 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.501 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.501 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:31:24.501 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.555276+0000", 2024-02-10T08:31:24.501 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1711000000000001e-05 2024-02-10T08:31:24.501 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.501 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.501 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:31:24.501 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.555318+0000", 2024-02-10T08:31:24.501 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.082049729000000002 2024-02-10T08:31:24.501 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:31:24.501 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:31:24.501 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:31:24.501 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.502 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.502 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.15198.0:143526 9.a 9:5d53d34a:::benchmark_data_smithi018_124176_object21787:head [delete] snapc 0=[] ondisk+write+known_if_redirected e290)", 2024-02-10T08:31:24.502 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:30:28.477418+0000", 2024-02-10T08:31:24.502 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 55.928755092000003, 2024-02-10T08:31:24.502 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.072795321999999996, 2024-02-10T08:31:24.502 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:31:24.502 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:31:24.502 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:31:24.502 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.15198", 2024-02-10T08:31:24.502 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/1957604827", 2024-02-10T08:31:24.502 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 143526 2024-02-10T08:31:24.502 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.502 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:31:24.502 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.502 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:31:24.502 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.477418+0000", 2024-02-10T08:31:24.503 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:31:24.503 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.503 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.503 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:31:24.503 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.477418+0000", 2024-02-10T08:31:24.503 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-02-10T08:31:24.503 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.503 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.503 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:31:24.503 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.477417+0000", 2024-02-10T08:31:24.503 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7230000000000001e-06 2024-02-10T08:31:24.503 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.503 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.503 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:31:24.503 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.477423+0000", 2024-02-10T08:31:24.504 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9109999999999999e-06 2024-02-10T08:31:24.504 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.504 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.504 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:31:24.504 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.477432+0000", 2024-02-10T08:31:24.504 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7949999999999998e-06 2024-02-10T08:31:24.504 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.504 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.504 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:31:24.504 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.477436+0000", 2024-02-10T08:31:24.504 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5019999999999999e-05 2024-02-10T08:31:24.504 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.504 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.504 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:31:24.505 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.477481+0000", 2024-02-10T08:31:24.505 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000112798 2024-02-10T08:31:24.505 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.505 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.505 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:31:24.505 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.477594+0000", 2024-02-10T08:31:24.505 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000136322 2024-02-10T08:31:24.505 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.505 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.505 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1,7", 2024-02-10T08:31:24.505 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.477731+0000", 2024-02-10T08:31:24.505 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001690836 2024-02-10T08:31:24.505 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.505 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.505 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:31:24.506 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.479421+0000", 2024-02-10T08:31:24.506 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002118792 2024-02-10T08:31:24.506 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.506 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.506 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:31:24.506 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.481540+0000", 2024-02-10T08:31:24.506 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.068569959 2024-02-10T08:31:24.506 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.506 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.506 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:31:24.506 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.550110+0000", 2024-02-10T08:31:24.506 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4137e-05 2024-02-10T08:31:24.506 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.506 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.506 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:31:24.506 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.550164+0000", 2024-02-10T08:31:24.507 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9237999999999999e-05 2024-02-10T08:31:24.507 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.507 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.507 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:31:24.507 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.550213+0000", 2024-02-10T08:31:24.507 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.072795321999999996 2024-02-10T08:31:24.507 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:31:24.507 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:31:24.507 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:31:24.507 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.507 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.507 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.15198.0:143531 9.6 9:65460777:::benchmark_data_smithi018_124176_object21792:head [delete] snapc 0=[] ondisk+write+known_if_redirected e290)", 2024-02-10T08:31:24.507 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:30:28.481748+0000", 2024-02-10T08:31:24.507 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 55.924425151000001, 2024-02-10T08:31:24.507 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.076119154999999994, 2024-02-10T08:31:24.508 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:31:24.508 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:31:24.508 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:31:24.508 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.15198", 2024-02-10T08:31:24.508 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/1957604827", 2024-02-10T08:31:24.508 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 143531 2024-02-10T08:31:24.508 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.508 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:31:24.508 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.508 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:31:24.508 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.481748+0000", 2024-02-10T08:31:24.508 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:31:24.508 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.508 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.508 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:31:24.508 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.481748+0000", 2024-02-10T08:31:24.509 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-02-10T08:31:24.509 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.509 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.509 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:31:24.509 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.481747+0000", 2024-02-10T08:31:24.509 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2349999999999996e-06 2024-02-10T08:31:24.509 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.509 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.509 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:31:24.509 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.481753+0000", 2024-02-10T08:31:24.509 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3356000000000001e-05 2024-02-10T08:31:24.509 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.509 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.509 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:31:24.509 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.481767+0000", 2024-02-10T08:31:24.510 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7100000000000001e-06 2024-02-10T08:31:24.510 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.510 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.510 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:31:24.510 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.481773+0000", 2024-02-10T08:31:24.510 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5960999999999997e-05 2024-02-10T08:31:24.510 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.510 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.510 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:31:24.510 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.481809+0000", 2024-02-10T08:31:24.510 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7527000000000003e-05 2024-02-10T08:31:24.510 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.510 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.510 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:31:24.510 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.481907+0000", 2024-02-10T08:31:24.510 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011718 2024-02-10T08:31:24.511 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.511 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.511 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1,2", 2024-02-10T08:31:24.511 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.482024+0000", 2024-02-10T08:31:24.511 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035358730000000001 2024-02-10T08:31:24.511 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.511 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.511 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:31:24.511 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.485560+0000", 2024-02-10T08:31:24.511 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00036430799999999998 2024-02-10T08:31:24.511 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.511 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.511 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:31:24.511 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.485924+0000", 2024-02-10T08:31:24.511 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.071859492999999997 2024-02-10T08:31:24.512 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.512 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.512 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:31:24.512 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.557784+0000", 2024-02-10T08:31:24.512 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4876000000000002e-05 2024-02-10T08:31:24.512 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.512 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.512 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:31:24.512 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.557829+0000", 2024-02-10T08:31:24.512 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8708999999999998e-05 2024-02-10T08:31:24.512 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.512 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.512 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:31:24.512 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.557867+0000", 2024-02-10T08:31:24.512 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.076119154999999994 2024-02-10T08:31:24.513 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:31:24.513 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:31:24.513 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:31:24.513 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.513 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.513 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.15198.0:143532 9.6 9:698cae59:::benchmark_data_smithi018_124176_object21793:head [delete] snapc 0=[] ondisk+write+known_if_redirected e290)", 2024-02-10T08:31:24.513 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:30:28.481791+0000", 2024-02-10T08:31:24.513 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 55.924382600000001, 2024-02-10T08:31:24.513 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.076273840999999995, 2024-02-10T08:31:24.513 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:31:24.513 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:31:24.513 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:31:24.513 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.15198", 2024-02-10T08:31:24.513 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/1957604827", 2024-02-10T08:31:24.513 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 143532 2024-02-10T08:31:24.514 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.514 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:31:24.514 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.514 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:31:24.514 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.481791+0000", 2024-02-10T08:31:24.514 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:31:24.514 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.514 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.514 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:31:24.514 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.481791+0000", 2024-02-10T08:31:24.514 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-02-10T08:31:24.514 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.514 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.514 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:31:24.514 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.481790+0000", 2024-02-10T08:31:24.515 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8489999999999999e-06 2024-02-10T08:31:24.515 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.515 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.515 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:31:24.515 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.481794+0000", 2024-02-10T08:31:24.515 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4479999999999999e-06 2024-02-10T08:31:24.515 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.515 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.515 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:31:24.515 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.481800+0000", 2024-02-10T08:31:24.515 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6890000000000003e-06 2024-02-10T08:31:24.515 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.515 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.515 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:31:24.515 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.481805+0000", 2024-02-10T08:31:24.516 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022166059999999999 2024-02-10T08:31:24.516 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.516 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.516 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:31:24.516 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.484022+0000", 2024-02-10T08:31:24.516 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6477999999999995e-05 2024-02-10T08:31:24.516 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.516 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.516 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:31:24.516 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.484098+0000", 2024-02-10T08:31:24.516 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8727999999999994e-05 2024-02-10T08:31:24.516 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.516 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.516 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1,2", 2024-02-10T08:31:24.516 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.484197+0000", 2024-02-10T08:31:24.517 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001497249 2024-02-10T08:31:24.517 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.517 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.517 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:31:24.517 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.485694+0000", 2024-02-10T08:31:24.517 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0015796149999999999 2024-02-10T08:31:24.517 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.517 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.517 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:31:24.517 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.487274+0000", 2024-02-10T08:31:24.517 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.070721513 2024-02-10T08:31:24.517 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.517 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.517 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:31:24.517 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.557995+0000", 2024-02-10T08:31:24.517 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7311000000000002e-05 2024-02-10T08:31:24.518 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.518 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.518 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:31:24.518 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.558032+0000", 2024-02-10T08:31:24.518 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2045000000000002e-05 2024-02-10T08:31:24.518 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.518 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.518 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:31:24.518 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.558064+0000", 2024-02-10T08:31:24.518 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.076273840999999995 2024-02-10T08:31:24.518 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:31:24.518 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:31:24.518 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:31:24.518 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.518 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.519 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.15198.0:180027 9.a 9:573b8643:::benchmark_data_smithi018_124176_object58288:head [delete] snapc 0=[] ondisk+write+known_if_redirected e302)", 2024-02-10T08:31:24.519 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:31:01.811922+0000", 2024-02-10T08:31:24.519 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 22.594251204999999, 2024-02-10T08:31:24.519 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.11046339099999999, 2024-02-10T08:31:24.519 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:31:24.519 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:31:24.519 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:31:24.519 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.15198", 2024-02-10T08:31:24.519 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/1957604827", 2024-02-10T08:31:24.519 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 180027 2024-02-10T08:31:24.519 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.519 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:31:24.519 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.519 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:31:24.519 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:01.811922+0000", 2024-02-10T08:31:24.520 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:31:24.520 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.520 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.520 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:31:24.520 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:01.811922+0000", 2024-02-10T08:31:24.520 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-02-10T08:31:24.520 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.520 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.520 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:31:24.520 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:01.811921+0000", 2024-02-10T08:31:24.520 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.75e-06 2024-02-10T08:31:24.520 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.520 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.520 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:31:24.521 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:01.811926+0000", 2024-02-10T08:31:24.521 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.576e-06 2024-02-10T08:31:24.521 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.521 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.521 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:31:24.521 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:01.811934+0000", 2024-02-10T08:31:24.521 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4779999999999999e-06 2024-02-10T08:31:24.521 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.521 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.521 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:31:24.521 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:01.811940+0000", 2024-02-10T08:31:24.521 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5643999999999997e-05 2024-02-10T08:31:24.521 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.521 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.521 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:31:24.522 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:01.812005+0000", 2024-02-10T08:31:24.522 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000100797 2024-02-10T08:31:24.522 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.522 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.522 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:31:24.522 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:01.812106+0000", 2024-02-10T08:31:24.522 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012706600000000001 2024-02-10T08:31:24.522 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.522 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.522 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1,7", 2024-02-10T08:31:24.522 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:01.812233+0000", 2024-02-10T08:31:24.522 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0060926729999999998 2024-02-10T08:31:24.522 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.522 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.522 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:31:24.523 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:01.818326+0000", 2024-02-10T08:31:24.523 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00034234000000000001 2024-02-10T08:31:24.523 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.523 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.523 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:31:24.523 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:01.818668+0000", 2024-02-10T08:31:24.523 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.10363267399999999 2024-02-10T08:31:24.523 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.523 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.523 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:31:24.523 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:01.922301+0000", 2024-02-10T08:31:24.523 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6428999999999999e-05 2024-02-10T08:31:24.523 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.523 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.523 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:31:24.524 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:01.922347+0000", 2024-02-10T08:31:24.524 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8263000000000003e-05 2024-02-10T08:31:24.524 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:31:24.524 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:31:24.524 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:31:24.524 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:01.922385+0000", 2024-02-10T08:31:24.524 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.11046339099999999 2024-02-10T08:31:24.524 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:31:24.524 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:31:24.524 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:31:24.524 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:31:24.524 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:31:24.524 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-02-10T08:31:24.525 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:31:24.582 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:25.171 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:31:23.971336+0000 mon.a (mon.0) 1431 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:31:25.171 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:31:23.983210+0000 mon.a (mon.0) 1432 : audit [INF] from='client.? 172.21.15.18:0/2934329934' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-10T08:31:25.171 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:31:23.983277+0000 mon.a (mon.0) 1433 : audit [INF] from='client.? 172.21.15.18:0/1573145171' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2024-02-10T08:31:25.171 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:31:23.983532+0000 mon.a (mon.0) 1434 : cluster [DBG] osdmap e311: 8 total, 8 up, 8 in 2024-02-10T08:31:25.193 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.6 dump_ops_in_flight 2024-02-10T08:31:25.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:31:23.971336+0000 mon.a (mon.0) 1431 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:31:25.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:31:23.983210+0000 mon.a (mon.0) 1432 : audit [INF] from='client.? 172.21.15.18:0/2934329934' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-10T08:31:25.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:31:23.983277+0000 mon.a (mon.0) 1433 : audit [INF] from='client.? 172.21.15.18:0/1573145171' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2024-02-10T08:31:25.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:31:23.983532+0000 mon.a (mon.0) 1434 : cluster [DBG] osdmap e311: 8 total, 8 up, 8 in 2024-02-10T08:31:25.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:31:23.971336+0000 mon.a (mon.0) 1431 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:31:25.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:31:23.983210+0000 mon.a (mon.0) 1432 : audit [INF] from='client.? 172.21.15.18:0/2934329934' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-10T08:31:25.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:31:23.983277+0000 mon.a (mon.0) 1433 : audit [INF] from='client.? 172.21.15.18:0/1573145171' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2024-02-10T08:31:25.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:31:23.983532+0000 mon.a (mon.0) 1434 : cluster [DBG] osdmap e311: 8 total, 8 up, 8 in 2024-02-10T08:31:25.628 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:31:25.693 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:31:25.696 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:25.696 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:31:25.797 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:31:25.860 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:25.943 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:31:25.948 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:25.948 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:31:26.049 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:31:26.092 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:26.279 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:31:24.913492+0000 mgr.y (mgr.14505) 552 : cluster [DBG] pgmap v674: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 2.5 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 863 op/s; 4072/124935 objects misplaced (3.259%); 618 KiB/s, 9 objects/s recovering 2024-02-10T08:31:26.280 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:31:25.792396+0000 mon.a (mon.0) 1435 : cluster [DBG] osdmap e312: 8 total, 8 up, 8 in 2024-02-10T08:31:26.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:31:24.913492+0000 mgr.y (mgr.14505) 552 : cluster [DBG] pgmap v674: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 2.5 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 863 op/s; 4072/124935 objects misplaced (3.259%); 618 KiB/s, 9 objects/s recovering 2024-02-10T08:31:26.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:31:25.792396+0000 mon.a (mon.0) 1435 : cluster [DBG] osdmap e312: 8 total, 8 up, 8 in 2024-02-10T08:31:26.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:31:24.913492+0000 mgr.y (mgr.14505) 552 : cluster [DBG] pgmap v674: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 2.5 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 863 op/s; 4072/124935 objects misplaced (3.259%); 618 KiB/s, 9 objects/s recovering 2024-02-10T08:31:26.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:31:25.792396+0000 mon.a (mon.0) 1435 : cluster [DBG] osdmap e312: 8 total, 8 up, 8 in 2024-02-10T08:31:26.542 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:31:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:31:26] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:31:26.563 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:31:26.567 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:26.567 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:31:26.589 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd reweight 3 1 2024-02-10T08:31:26.668 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:31:26.728 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:27.151 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:31:25.041185+0000 osd.4 (osd.4) 82 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:31:27.152 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:31:25.041251+0000 osd.4 (osd.4) 83 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:31:27.152 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:31:25.041185+0000 osd.4 (osd.4) 82 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:31:27.152 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:31:25.041251+0000 osd.4 (osd.4) 83 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:31:27.198 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:31:27.201 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:27.201 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:31:27.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:31:25.041185+0000 osd.4 (osd.4) 82 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:31:27.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:31:25.041251+0000 osd.4 (osd.4) 83 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:31:27.302 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:31:27.366 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:27.404 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:31:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:31:27] "GET /metrics HTTP/1.1" 200 176259 "" "Prometheus/2.33.4" 2024-02-10T08:31:27.485 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:31:27.490 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:27.491 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:31:27.592 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:31:27.640 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:27.680 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd set nodeep-scrub 2024-02-10T08:31:27.802 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:31:27.812 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:27.812 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:31:27.905 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:31:27.913 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:31:27.914 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:31:27.969 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:31:27.981 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:27.992 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-02-10T08:31:27.992 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-02-10T08:31:27.993 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-02-10T08:31:27.993 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-02-10T08:31:28.000 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:31:28.007 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:31:28.009 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:28.010 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:31:28.046 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:31:26.915720+0000 mgr.y (mgr.14505) 553 : cluster [DBG] pgmap v676: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 2.5 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 836 B/s rd, 0 B/s wr, 851 op/s; 4072/123921 objects misplaced (3.286%); 606 KiB/s, 9 objects/s recovering 2024-02-10T08:31:28.046 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:31:27.876737+0000 mon.a (mon.0) 1436 : audit [DBG] from='client.? 172.21.15.18:0/272098771' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:31:28.046 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:31:26.915720+0000 mgr.y (mgr.14505) 553 : cluster [DBG] pgmap v676: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 2.5 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 836 B/s rd, 0 B/s wr, 851 op/s; 4072/123921 objects misplaced (3.286%); 606 KiB/s, 9 objects/s recovering 2024-02-10T08:31:28.046 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:31:27.876737+0000 mon.a (mon.0) 1436 : audit [DBG] from='client.? 172.21.15.18:0/272098771' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:31:28.056 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:31:28.081 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:31:28.111 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:31:28.118 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:31:28.144 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:31:28.158 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:28.190 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:31:28.211 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-10T08:31:28.211 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-10T08:31:28.211 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-10T08:31:28.211 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-10T08:31:28.211 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-10T08:31:28.211 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-10T08:31:28.211 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-10T08:31:28.212 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-10T08:31:28.216 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:31:28.220 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:28.220 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:31:28.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:31:26.915720+0000 mgr.y (mgr.14505) 553 : cluster [DBG] pgmap v676: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 2.5 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 836 B/s rd, 0 B/s wr, 851 op/s; 4072/123921 objects misplaced (3.286%); 606 KiB/s, 9 objects/s recovering 2024-02-10T08:31:28.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:31:27.876737+0000 mon.a (mon.0) 1436 : audit [DBG] from='client.? 172.21.15.18:0/272098771' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:31:28.321 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:31:28.379 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:28.434 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:31:28.451 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:28.451 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:31:28.552 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:31:28.601 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:28.789 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:31:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:31:28.837 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.6 dump_blocked_ops 2024-02-10T08:31:29.055 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:31:28.393262+0000 mgr.y (mgr.14505) 554 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:31:29.073 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:31:29.076 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:29.077 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:31:29.177 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:31:29.218 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:29.261 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:31:29.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:31:28.393262+0000 mgr.y (mgr.14505) 554 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:31:29.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:31:28.393262+0000 mgr.y (mgr.14505) 554 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:31:29.687 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:31:29.692 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:29.692 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:31:29.793 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:31:29.851 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:30.051 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:31:28.918293+0000 mgr.y (mgr.14505) 555 : cluster [DBG] pgmap v677: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 2.2 GiB data, 9.7 GiB used, 706 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.26k op/s; 3470/109221 objects misplaced (3.177%); 927 KiB/s, 14 objects/s recovering 2024-02-10T08:31:30.214 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:31:30.220 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:30.221 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:31:30.267 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:31:28.918293+0000 mgr.y (mgr.14505) 555 : cluster [DBG] pgmap v677: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 2.2 GiB data, 9.7 GiB used, 706 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.26k op/s; 3470/109221 objects misplaced (3.177%); 927 KiB/s, 14 objects/s recovering 2024-02-10T08:31:30.321 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:31:30.389 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:30.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:31:28.918293+0000 mgr.y (mgr.14505) 555 : cluster [DBG] pgmap v677: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 2.2 GiB data, 9.7 GiB used, 706 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.26k op/s; 3470/109221 objects misplaced (3.177%); 927 KiB/s, 14 objects/s recovering 2024-02-10T08:31:30.626 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:31:30.633 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:30.634 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:31:30.734 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:31:30.783 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:30.956 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:31:30.965 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:30.965 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:31:31.066 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:31:31.115 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:31.302 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-02-10T08:31:31.302 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:31:32.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:31:30.918792+0000 mgr.y (mgr.14505) 556 : cluster [DBG] pgmap v678: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 2.2 GiB data, 9.6 GiB used, 706 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 813 op/s; 3470/108237 objects misplaced (3.206%); 464 KiB/s, 7 objects/s recovering 2024-02-10T08:31:32.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:31:31.672348+0000 mon.a (mon.0) 1437 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:31:32.102 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.6 dump_historic_ops 2024-02-10T08:31:32.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:31:30.918792+0000 mgr.y (mgr.14505) 556 : cluster [DBG] pgmap v678: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 2.2 GiB data, 9.6 GiB used, 706 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 813 op/s; 3470/108237 objects misplaced (3.206%); 464 KiB/s, 7 objects/s recovering 2024-02-10T08:31:32.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:31:31.672348+0000 mon.a (mon.0) 1437 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:31:32.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:31:30.918792+0000 mgr.y (mgr.14505) 556 : cluster [DBG] pgmap v678: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 2.2 GiB data, 9.6 GiB used, 706 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 813 op/s; 3470/108237 objects misplaced (3.206%); 464 KiB/s, 7 objects/s recovering 2024-02-10T08:31:32.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:31:31.672348+0000 mon.a (mon.0) 1437 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:31:32.557 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:31:32.690 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-10T08:31:33.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:31:32.279773+0000 mon.a (mon.0) 1438 : audit [INF] from='client.? 172.21.15.18:0/1327905854' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]: dispatch 2024-02-10T08:31:33.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:31:32.279773+0000 mon.a (mon.0) 1438 : audit [INF] from='client.? 172.21.15.18:0/1327905854' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]: dispatch 2024-02-10T08:31:33.180 INFO:teuthology.orchestra.run.smithi018.stderr:reweighted osd.3 to 1 (10000) 2024-02-10T08:31:33.188 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:31:33.190 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:31:33.191 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:33.192 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:31:33.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:31:32.279773+0000 mon.a (mon.0) 1438 : audit [INF] from='client.? 172.21.15.18:0/1327905854' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]: dispatch 2024-02-10T08:31:33.293 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:31:33.319 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:34.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:31:32.313217+0000 osd.3 (osd.3) 105 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:31:34.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:31:32.313273+0000 osd.3 (osd.3) 106 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:31:34.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:31:32.838400+0000 mon.a (mon.0) 1439 : audit [INF] from='client.? 172.21.15.18:0/1327905854' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2024-02-10T08:31:34.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:31:32.838453+0000 mon.a (mon.0) 1440 : cluster [DBG] osdmap e313: 8 total, 8 up, 8 in 2024-02-10T08:31:34.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:31:32.919221+0000 mgr.y (mgr.14505) 557 : cluster [DBG] pgmap v680: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 2.0 GiB data, 9.1 GiB used, 706 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.19k op/s; 2856/96462 objects misplaced (2.961%); 935 KiB/s, 14 objects/s recovering 2024-02-10T08:31:34.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:31:32.313217+0000 osd.3 (osd.3) 105 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:31:34.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:31:32.313273+0000 osd.3 (osd.3) 106 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:31:34.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:31:32.838400+0000 mon.a (mon.0) 1439 : audit [INF] from='client.? 172.21.15.18:0/1327905854' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2024-02-10T08:31:34.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:31:32.838453+0000 mon.a (mon.0) 1440 : cluster [DBG] osdmap e313: 8 total, 8 up, 8 in 2024-02-10T08:31:34.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:31:32.919221+0000 mgr.y (mgr.14505) 557 : cluster [DBG] pgmap v680: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 2.0 GiB data, 9.1 GiB used, 706 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.19k op/s; 2856/96462 objects misplaced (2.961%); 935 KiB/s, 14 objects/s recovering 2024-02-10T08:31:34.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:31:32.313217+0000 osd.3 (osd.3) 105 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:31:34.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:31:32.313273+0000 osd.3 (osd.3) 106 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:31:34.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:31:32.838400+0000 mon.a (mon.0) 1439 : audit [INF] from='client.? 172.21.15.18:0/1327905854' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2024-02-10T08:31:34.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:31:32.838453+0000 mon.a (mon.0) 1440 : cluster [DBG] osdmap e313: 8 total, 8 up, 8 in 2024-02-10T08:31:34.191 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:31:32.919221+0000 mgr.y (mgr.14505) 557 : cluster [DBG] pgmap v680: 168 pgs: 1 active+remapped+backfilling, 167 active+clean; 2.0 GiB data, 9.1 GiB used, 706 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.19k op/s; 2856/96462 objects misplaced (2.961%); 935 KiB/s, 14 objects/s recovering 2024-02-10T08:31:34.723 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-02-10T08:31:34.724 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:31:35.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:31:33.868609+0000 mon.a (mon.0) 1441 : cluster [DBG] osdmap e314: 8 total, 8 up, 8 in 2024-02-10T08:31:35.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:31:33.868609+0000 mon.a (mon.0) 1441 : cluster [DBG] osdmap e314: 8 total, 8 up, 8 in 2024-02-10T08:31:35.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:31:33.868609+0000 mon.a (mon.0) 1441 : cluster [DBG] osdmap e314: 8 total, 8 up, 8 in 2024-02-10T08:31:35.498 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.7 dump_ops_in_flight 2024-02-10T08:31:35.954 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:31:36.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:31:34.871218+0000 osd.1 (osd.1) 169 : cluster [DBG] 9.2 starting backfill to osd.3 from (0'0,0'0] MAX to 312'13314 2024-02-10T08:31:36.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:31:34.871323+0000 mon.a (mon.0) 1442 : cluster [DBG] osdmap e315: 8 total, 8 up, 8 in 2024-02-10T08:31:36.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:31:34.872870+0000 osd.0 (osd.0) 146 : cluster [DBG] 9.8 starting backfill to osd.3 from (0'0,0'0] MAX to 312'13146 2024-02-10T08:31:36.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:31:34.878931+0000 osd.5 (osd.5) 181 : cluster [DBG] 9.f starting backfill to osd.3 from (0'0,0'0] MAX to 312'13055 2024-02-10T08:31:36.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:31:34.885292+0000 osd.5 (osd.5) 182 : cluster [DBG] 9.7 starting backfill to osd.3 from (0'0,0'0] MAX to 312'13510 2024-02-10T08:31:36.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:31:34.919566+0000 mgr.y (mgr.14505) 558 : cluster [DBG] pgmap v683: 168 pgs: 10 peering, 1 active+remapped+backfilling, 157 active+clean; 1.9 GiB data, 9.0 GiB used, 706 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 867 op/s; 2856/93621 objects misplaced (3.051%); 629 KiB/s, 9 objects/s recovering 2024-02-10T08:31:36.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:31:34.871218+0000 osd.1 (osd.1) 169 : cluster [DBG] 9.2 starting backfill to osd.3 from (0'0,0'0] MAX to 312'13314 2024-02-10T08:31:36.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:31:34.871323+0000 mon.a (mon.0) 1442 : cluster [DBG] osdmap e315: 8 total, 8 up, 8 in 2024-02-10T08:31:36.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:31:34.872870+0000 osd.0 (osd.0) 146 : cluster [DBG] 9.8 starting backfill to osd.3 from (0'0,0'0] MAX to 312'13146 2024-02-10T08:31:36.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:31:34.878931+0000 osd.5 (osd.5) 181 : cluster [DBG] 9.f starting backfill to osd.3 from (0'0,0'0] MAX to 312'13055 2024-02-10T08:31:36.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:31:34.885292+0000 osd.5 (osd.5) 182 : cluster [DBG] 9.7 starting backfill to osd.3 from (0'0,0'0] MAX to 312'13510 2024-02-10T08:31:36.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:31:34.919566+0000 mgr.y (mgr.14505) 558 : cluster [DBG] pgmap v683: 168 pgs: 10 peering, 1 active+remapped+backfilling, 157 active+clean; 1.9 GiB data, 9.0 GiB used, 706 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 867 op/s; 2856/93621 objects misplaced (3.051%); 629 KiB/s, 9 objects/s recovering 2024-02-10T08:31:36.250 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:31:34.871218+0000 osd.1 (osd.1) 169 : cluster [DBG] 9.2 starting backfill to osd.3 from (0'0,0'0] MAX to 312'13314 2024-02-10T08:31:36.251 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:31:34.871323+0000 mon.a (mon.0) 1442 : cluster [DBG] osdmap e315: 8 total, 8 up, 8 in 2024-02-10T08:31:36.251 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:31:34.872870+0000 osd.0 (osd.0) 146 : cluster [DBG] 9.8 starting backfill to osd.3 from (0'0,0'0] MAX to 312'13146 2024-02-10T08:31:36.251 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:31:34.878931+0000 osd.5 (osd.5) 181 : cluster [DBG] 9.f starting backfill to osd.3 from (0'0,0'0] MAX to 312'13055 2024-02-10T08:31:36.251 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:31:34.885292+0000 osd.5 (osd.5) 182 : cluster [DBG] 9.7 starting backfill to osd.3 from (0'0,0'0] MAX to 312'13510 2024-02-10T08:31:36.251 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:31:34.919566+0000 mgr.y (mgr.14505) 558 : cluster [DBG] pgmap v683: 168 pgs: 10 peering, 1 active+remapped+backfilling, 157 active+clean; 1.9 GiB data, 9.0 GiB used, 706 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 867 op/s; 2856/93621 objects misplaced (3.051%); 629 KiB/s, 9 objects/s recovering 2024-02-10T08:31:36.520 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:31:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:31:36] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:31:37.012 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd reweight 4 1 2024-02-10T08:31:37.030 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:31:37.034 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:37.035 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:31:37.136 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:31:37.179 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:37.258 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:31:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:31:37] "GET /metrics HTTP/1.1" 200 176259 "" "Prometheus/2.33.4" 2024-02-10T08:31:37.396 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:31:37.406 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:37.407 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:31:37.508 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:31:37.547 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:37.707 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:31:37.713 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:37.714 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:31:37.814 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:31:37.859 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:37.899 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:31:37.931 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:31:37.942 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:37.943 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:31:38.005 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:31:36.920024+0000 mgr.y (mgr.14505) 559 : cluster [DBG] pgmap v684: 168 pgs: 10 peering, 1 active+remapped+backfilling, 157 active+clean; 1.9 GiB data, 8.9 GiB used, 706 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 844 op/s; 2856/93054 objects misplaced (3.069%); 629 KiB/s, 10 objects/s recovering 2024-02-10T08:31:38.044 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:31:38.106 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-02-10T08:31:38.106 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:31:38.109 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:38.145 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:31:38.149 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:38.150 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:31:38.249 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:31:36.920024+0000 mgr.y (mgr.14505) 559 : cluster [DBG] pgmap v684: 168 pgs: 10 peering, 1 active+remapped+backfilling, 157 active+clean; 1.9 GiB data, 8.9 GiB used, 706 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 844 op/s; 2856/93054 objects misplaced (3.069%); 629 KiB/s, 10 objects/s recovering 2024-02-10T08:31:38.251 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:31:38.251 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:31:36.920024+0000 mgr.y (mgr.14505) 559 : cluster [DBG] pgmap v684: 168 pgs: 10 peering, 1 active+remapped+backfilling, 157 active+clean; 1.9 GiB data, 8.9 GiB used, 706 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 844 op/s; 2856/93054 objects misplaced (3.069%); 629 KiB/s, 10 objects/s recovering 2024-02-10T08:31:38.338 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:38.498 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:31:38.504 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:38.504 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:31:38.605 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:31:38.667 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:38.794 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:31:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:31:39.030 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:31:39.033 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:39.034 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:31:39.135 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:31:39.191 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:39.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:31:38.404474+0000 mgr.y (mgr.14505) 560 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:31:39.381 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:31:39.409 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:31:38.404474+0000 mgr.y (mgr.14505) 560 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:31:39.409 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:31:38.404474+0000 mgr.y (mgr.14505) 560 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:31:39.409 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:31:39.419 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:39.420 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:31:39.520 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:31:39.580 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:40.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:31:38.927745+0000 mgr.y (mgr.14505) 561 : cluster [DBG] pgmap v685: 168 pgs: 1 active+remapped+backfill_wait, 3 active+remapped+backfilling, 1 active+remapped+backfill_toofull, 163 active+clean; 1.7 GiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 840 B/s rd, 0 B/s wr, 564 op/s; 9537/86169 objects misplaced (11.068%); 1.0 MiB/s, 24 objects/s recovering 2024-02-10T08:31:40.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:31:38.997284+0000 mon.a (mon.0) 1443 : cluster [WRN] Health check failed: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull (PG_BACKFILL_FULL) 2024-02-10T08:31:40.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:31:38.927745+0000 mgr.y (mgr.14505) 561 : cluster [DBG] pgmap v685: 168 pgs: 1 active+remapped+backfill_wait, 3 active+remapped+backfilling, 1 active+remapped+backfill_toofull, 163 active+clean; 1.7 GiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 840 B/s rd, 0 B/s wr, 564 op/s; 9537/86169 objects misplaced (11.068%); 1.0 MiB/s, 24 objects/s recovering 2024-02-10T08:31:40.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:31:38.997284+0000 mon.a (mon.0) 1443 : cluster [WRN] Health check failed: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull (PG_BACKFILL_FULL) 2024-02-10T08:31:40.269 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:31:40.276 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:40.277 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:31:40.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:31:38.927745+0000 mgr.y (mgr.14505) 561 : cluster [DBG] pgmap v685: 168 pgs: 1 active+remapped+backfill_wait, 3 active+remapped+backfilling, 1 active+remapped+backfill_toofull, 163 active+clean; 1.7 GiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 840 B/s rd, 0 B/s wr, 564 op/s; 9537/86169 objects misplaced (11.068%); 1.0 MiB/s, 24 objects/s recovering 2024-02-10T08:31:40.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:31:38.997284+0000 mon.a (mon.0) 1443 : cluster [WRN] Health check failed: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull (PG_BACKFILL_FULL) 2024-02-10T08:31:40.378 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:31:40.428 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:40.656 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:31:40.660 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:40.660 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:31:40.761 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:31:40.811 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:40.892 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:31:40.896 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:40.896 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:31:40.997 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:31:41.044 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:31:41.060 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:41.077 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:31:41.125 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:31:41.160 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:31:41.189 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:31:41.216 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:31:41.255 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:31:41.300 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:31:41.317 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-10T08:31:41.317 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-10T08:31:41.317 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-10T08:31:41.318 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-10T08:31:41.318 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-10T08:31:41.318 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-10T08:31:41.318 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-10T08:31:41.318 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-10T08:31:42.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:31:40.928339+0000 mgr.y (mgr.14505) 562 : cluster [DBG] pgmap v686: 168 pgs: 1 active+remapped+backfill_wait, 3 active+remapped+backfilling, 1 active+remapped+backfill_toofull, 163 active+clean; 1.7 GiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 464 op/s; 9537/85305 objects misplaced (11.180%); 791 KiB/s, 18 objects/s recovering 2024-02-10T08:31:42.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:31:40.966729+0000 mon.b (mon.1) 72 : audit [DBG] from='client.? 172.21.15.18:0/1602283380' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:31:42.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:31:40.928339+0000 mgr.y (mgr.14505) 562 : cluster [DBG] pgmap v686: 168 pgs: 1 active+remapped+backfill_wait, 3 active+remapped+backfilling, 1 active+remapped+backfill_toofull, 163 active+clean; 1.7 GiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 464 op/s; 9537/85305 objects misplaced (11.180%); 791 KiB/s, 18 objects/s recovering 2024-02-10T08:31:42.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:31:40.966729+0000 mon.b (mon.1) 72 : audit [DBG] from='client.? 172.21.15.18:0/1602283380' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:31:42.240 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:41 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:31:40.928339+0000 mgr.y (mgr.14505) 562 : cluster [DBG] pgmap v686: 168 pgs: 1 active+remapped+backfill_wait, 3 active+remapped+backfilling, 1 active+remapped+backfill_toofull, 163 active+clean; 1.7 GiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 464 op/s; 9537/85305 objects misplaced (11.180%); 791 KiB/s, 18 objects/s recovering 2024-02-10T08:31:42.240 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:41 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:31:40.966729+0000 mon.b (mon.1) 72 : audit [DBG] from='client.? 172.21.15.18:0/1602283380' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:31:42.244 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:31:42.247 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:42.247 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:31:42.348 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:31:42.400 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:43.262 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:31:43.266 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:43.267 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:31:43.368 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:31:43.430 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:44.033 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is set 2024-02-10T08:31:44.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:44 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:31:42.929134+0000 mgr.y (mgr.14505) 563 : cluster [DBG] pgmap v687: 168 pgs: 1 active+remapped+backfill_wait, 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 163 active+clean; 1.5 GiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 656 op/s; 8251/75804 objects misplaced (10.885%); 1.5 MiB/s, 29 objects/s recovering 2024-02-10T08:31:44.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:44 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:31:43.720866+0000 mon.a (mon.0) 1444 : audit [INF] from='client.? 172.21.15.18:0/3617799149' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:31:44.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:31:42.929134+0000 mgr.y (mgr.14505) 563 : cluster [DBG] pgmap v687: 168 pgs: 1 active+remapped+backfill_wait, 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 163 active+clean; 1.5 GiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 656 op/s; 8251/75804 objects misplaced (10.885%); 1.5 MiB/s, 29 objects/s recovering 2024-02-10T08:31:44.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:31:43.720866+0000 mon.a (mon.0) 1444 : audit [INF] from='client.? 172.21.15.18:0/3617799149' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:31:44.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:31:42.929134+0000 mgr.y (mgr.14505) 563 : cluster [DBG] pgmap v687: 168 pgs: 1 active+remapped+backfill_wait, 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 163 active+clean; 1.5 GiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 656 op/s; 8251/75804 objects misplaced (10.885%); 1.5 MiB/s, 29 objects/s recovering 2024-02-10T08:31:44.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:31:43.720866+0000 mon.a (mon.0) 1444 : audit [INF] from='client.? 172.21.15.18:0/3617799149' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:31:44.703 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-10T08:31:45.032 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:31:43.988377+0000 mon.a (mon.0) 1445 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:31:45.033 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:31:44.002886+0000 mon.a (mon.0) 1446 : audit [INF] from='client.? 172.21.15.18:0/3617799149' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-10T08:31:45.033 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:31:44.002939+0000 mon.a (mon.0) 1447 : cluster [DBG] osdmap e316: 8 total, 8 up, 8 in 2024-02-10T08:31:45.033 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:31:44.408559+0000 mon.c (mon.2) 72 : audit [INF] from='client.? 172.21.15.18:0/791178406' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]: dispatch 2024-02-10T08:31:45.033 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:31:44.409301+0000 mon.a (mon.0) 1448 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]: dispatch 2024-02-10T08:31:45.076 INFO:teuthology.orchestra.run.smithi018.stderr:reweighted osd.4 to 1 (10000) 2024-02-10T08:31:45.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:31:43.988377+0000 mon.a (mon.0) 1445 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:31:45.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:31:44.002886+0000 mon.a (mon.0) 1446 : audit [INF] from='client.? 172.21.15.18:0/3617799149' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-10T08:31:45.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:31:44.002939+0000 mon.a (mon.0) 1447 : cluster [DBG] osdmap e316: 8 total, 8 up, 8 in 2024-02-10T08:31:45.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:31:44.408559+0000 mon.c (mon.2) 72 : audit [INF] from='client.? 172.21.15.18:0/791178406' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]: dispatch 2024-02-10T08:31:45.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:31:44.409301+0000 mon.a (mon.0) 1448 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]: dispatch 2024-02-10T08:31:45.409 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:31:43.988377+0000 mon.a (mon.0) 1445 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:31:45.409 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:31:44.002886+0000 mon.a (mon.0) 1446 : audit [INF] from='client.? 172.21.15.18:0/3617799149' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-10T08:31:45.409 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:31:44.002939+0000 mon.a (mon.0) 1447 : cluster [DBG] osdmap e316: 8 total, 8 up, 8 in 2024-02-10T08:31:45.409 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:31:44.408559+0000 mon.c (mon.2) 72 : audit [INF] from='client.? 172.21.15.18:0/791178406' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]: dispatch 2024-02-10T08:31:45.409 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:31:44.409301+0000 mon.a (mon.0) 1448 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]: dispatch 2024-02-10T08:31:45.826 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.7 dump_blocked_ops 2024-02-10T08:31:45.879 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:31:45.883 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:45.884 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:31:45.976 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd reweight 5 1 2024-02-10T08:31:45.985 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:31:46.016 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:31:46.060 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:31:44.929576+0000 mgr.y (mgr.14505) 564 : cluster [DBG] pgmap v689: 168 pgs: 1 active+remapped+backfill_wait, 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 163 active+clean; 1.5 GiB data, 7.7 GiB used, 707 GiB / 715 GiB avail; 1022 B/s rd, 0 B/s wr, 673 op/s; 7940/73434 objects misplaced (10.812%); 1.7 MiB/s, 32 objects/s recovering 2024-02-10T08:31:46.060 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:31:44.942979+0000 osd.0 (osd.0) 147 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:31:46.060 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:31:44.943020+0000 osd.0 (osd.0) 148 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:31:46.060 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:31:45.022310+0000 mon.a (mon.0) 1449 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]': finished 2024-02-10T08:31:46.061 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:31:45.022359+0000 mon.a (mon.0) 1450 : cluster [DBG] osdmap e317: 8 total, 8 up, 8 in 2024-02-10T08:31:46.079 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:46.102 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:31:46.108 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:46.108 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:31:46.209 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:31:46.275 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:46.301 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:31:46.308 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:46.308 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:31:46.314 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:31:46.377 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:31:44.929576+0000 mgr.y (mgr.14505) 564 : cluster [DBG] pgmap v689: 168 pgs: 1 active+remapped+backfill_wait, 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 163 active+clean; 1.5 GiB data, 7.7 GiB used, 707 GiB / 715 GiB avail; 1022 B/s rd, 0 B/s wr, 673 op/s; 7940/73434 objects misplaced (10.812%); 1.7 MiB/s, 32 objects/s recovering 2024-02-10T08:31:46.377 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:31:44.942979+0000 osd.0 (osd.0) 147 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:31:46.377 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:31:44.943020+0000 osd.0 (osd.0) 148 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:31:46.377 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:31:45.022310+0000 mon.a (mon.0) 1449 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]': finished 2024-02-10T08:31:46.377 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:31:45.022359+0000 mon.a (mon.0) 1450 : cluster [DBG] osdmap e317: 8 total, 8 up, 8 in 2024-02-10T08:31:46.381 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:31:44.929576+0000 mgr.y (mgr.14505) 564 : cluster [DBG] pgmap v689: 168 pgs: 1 active+remapped+backfill_wait, 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 163 active+clean; 1.5 GiB data, 7.7 GiB used, 707 GiB / 715 GiB avail; 1022 B/s rd, 0 B/s wr, 673 op/s; 7940/73434 objects misplaced (10.812%); 1.7 MiB/s, 32 objects/s recovering 2024-02-10T08:31:46.381 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:31:44.942979+0000 osd.0 (osd.0) 147 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:31:46.381 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:31:44.943020+0000 osd.0 (osd.0) 148 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:31:46.381 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:31:45.022310+0000 mon.a (mon.0) 1449 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]': finished 2024-02-10T08:31:46.381 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:31:45.022359+0000 mon.a (mon.0) 1450 : cluster [DBG] osdmap e317: 8 total, 8 up, 8 in 2024-02-10T08:31:46.409 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:31:46.487 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:46.529 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:31:46.532 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:46.533 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:31:46.634 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:31:46.685 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:46.792 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:31:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:31:46] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:31:46.915 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd unset noscrub 2024-02-10T08:31:47.225 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:31:46.029798+0000 mon.a (mon.0) 1451 : cluster [DBG] osdmap e318: 8 total, 8 up, 8 in 2024-02-10T08:31:47.225 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:31:46.680013+0000 mon.a (mon.0) 1452 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:31:47.225 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:31:46.029798+0000 mon.a (mon.0) 1451 : cluster [DBG] osdmap e318: 8 total, 8 up, 8 in 2024-02-10T08:31:47.225 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:31:46.680013+0000 mon.a (mon.0) 1452 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:31:47.225 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:31:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:31:47] "GET /metrics HTTP/1.1" 200 176242 "" "Prometheus/2.33.4" 2024-02-10T08:31:47.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:31:46.029798+0000 mon.a (mon.0) 1451 : cluster [DBG] osdmap e318: 8 total, 8 up, 8 in 2024-02-10T08:31:47.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:31:46.680013+0000 mon.a (mon.0) 1452 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:31:47.754 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:31:47.758 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:47.758 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:31:47.794 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:31:47.859 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:31:47.914 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:48.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:31:46.930127+0000 mgr.y (mgr.14505) 565 : cluster [DBG] pgmap v692: 168 pgs: 1 active+remapped+backfill_wait, 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 163 active+clean; 1.5 GiB data, 7.7 GiB used, 708 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 707 op/s; 7940/72582 objects misplaced (10.939%); 1.8 MiB/s, 28 objects/s recovering 2024-02-10T08:31:48.347 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:31:46.930127+0000 mgr.y (mgr.14505) 565 : cluster [DBG] pgmap v692: 168 pgs: 1 active+remapped+backfill_wait, 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 163 active+clean; 1.5 GiB data, 7.7 GiB used, 708 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 707 op/s; 7940/72582 objects misplaced (10.939%); 1.8 MiB/s, 28 objects/s recovering 2024-02-10T08:31:48.348 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:31:46.930127+0000 mgr.y (mgr.14505) 565 : cluster [DBG] pgmap v692: 168 pgs: 1 active+remapped+backfill_wait, 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 163 active+clean; 1.5 GiB data, 7.7 GiB used, 708 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 707 op/s; 7940/72582 objects misplaced (10.939%); 1.8 MiB/s, 28 objects/s recovering 2024-02-10T08:31:48.476 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:31:48.485 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:48.486 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:31:48.587 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:31:48.634 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:48.768 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:31:48.772 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:48.773 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:31:48.773 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:31:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:31:48.874 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:31:49.007 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:49.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:31:48.416041+0000 mgr.y (mgr.14505) 566 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:31:49.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:31:48.654390+0000 mon.b (mon.1) 73 : audit [DBG] from='client.? 172.21.15.18:0/4082069221' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:31:49.408 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:31:48.416041+0000 mgr.y (mgr.14505) 566 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:31:49.408 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:31:48.654390+0000 mon.b (mon.1) 73 : audit [DBG] from='client.? 172.21.15.18:0/4082069221' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:31:49.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:49 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:31:48.416041+0000 mgr.y (mgr.14505) 566 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:31:49.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:49 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:31:48.654390+0000 mon.b (mon.1) 73 : audit [DBG] from='client.? 172.21.15.18:0/4082069221' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:31:50.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:31:48.930995+0000 mgr.y (mgr.14505) 567 : cluster [DBG] pgmap v693: 168 pgs: 1 active+remapped+backfill_toofull, 1 active+remapped+backfill_wait, 3 active+remapped+backfilling, 163 active+clean; 1.2 GiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 843 op/s; 6450/60636 objects misplaced (10.637%); 2.2 MiB/s, 34 objects/s recovering 2024-02-10T08:31:50.306 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-02-10T08:31:50.306 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:31:50.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:31:48.930995+0000 mgr.y (mgr.14505) 567 : cluster [DBG] pgmap v693: 168 pgs: 1 active+remapped+backfill_toofull, 1 active+remapped+backfill_wait, 3 active+remapped+backfilling, 163 active+clean; 1.2 GiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 843 op/s; 6450/60636 objects misplaced (10.637%); 2.2 MiB/s, 34 objects/s recovering 2024-02-10T08:31:50.407 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:31:48.930995+0000 mgr.y (mgr.14505) 567 : cluster [DBG] pgmap v693: 168 pgs: 1 active+remapped+backfill_toofull, 1 active+remapped+backfill_wait, 3 active+remapped+backfilling, 163 active+clean; 1.2 GiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 843 op/s; 6450/60636 objects misplaced (10.637%); 2.2 MiB/s, 34 objects/s recovering 2024-02-10T08:31:50.511 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:31:50.511 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:31:50.511 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:31:50.511 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:31:50.511 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:31:50.511 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:31:50.511 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:31:50.511 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:31:50.511 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-10T08:31:50.512 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-10T08:31:50.512 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-10T08:31:50.512 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-10T08:31:50.512 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-10T08:31:50.512 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-10T08:31:50.512 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-10T08:31:50.512 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-10T08:31:51.232 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.7 dump_historic_ops 2024-02-10T08:31:51.681 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:31:52.082 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:51 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:31:50.931550+0000 mgr.y (mgr.14505) 568 : cluster [DBG] pgmap v694: 168 pgs: 1 active+remapped+backfill_toofull, 1 active+remapped+backfill_wait, 3 active+remapped+backfilling, 163 active+clean; 1.2 GiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 739 B/s rd, 0 B/s wr, 658 op/s; 6450/59766 objects misplaced (10.792%); 1.4 MiB/s, 23 objects/s recovering 2024-02-10T08:31:52.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:31:50.931550+0000 mgr.y (mgr.14505) 568 : cluster [DBG] pgmap v694: 168 pgs: 1 active+remapped+backfill_toofull, 1 active+remapped+backfill_wait, 3 active+remapped+backfilling, 163 active+clean; 1.2 GiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 739 B/s rd, 0 B/s wr, 658 op/s; 6450/59766 objects misplaced (10.792%); 1.4 MiB/s, 23 objects/s recovering 2024-02-10T08:31:52.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:31:50.931550+0000 mgr.y (mgr.14505) 568 : cluster [DBG] pgmap v694: 168 pgs: 1 active+remapped+backfill_toofull, 1 active+remapped+backfill_wait, 3 active+remapped+backfilling, 163 active+clean; 1.2 GiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 739 B/s rd, 0 B/s wr, 658 op/s; 6450/59766 objects misplaced (10.792%); 1.4 MiB/s, 23 objects/s recovering 2024-02-10T08:31:52.587 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:31:52.591 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:52.592 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:31:52.693 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:31:52.752 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:52.821 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:31:52.831 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:52.832 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:31:52.933 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:31:52.983 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:53.349 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:31:53.357 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:53.358 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:31:53.459 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:31:53.743 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:54.001 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-02-10T08:31:54.001 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:31:54.001 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:54 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:31:52.935733+0000 mgr.y (mgr.14505) 569 : cluster [DBG] pgmap v695: 168 pgs: 1 active+remapped+backfill_wait, 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 163 active+clean; 1020 MiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 996 op/s; 5117/49521 objects misplaced (10.333%); 1.6 MiB/s, 27 objects/s recovering 2024-02-10T08:31:54.007 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:31:54.295 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:31:52.935733+0000 mgr.y (mgr.14505) 569 : cluster [DBG] pgmap v695: 168 pgs: 1 active+remapped+backfill_wait, 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 163 active+clean; 1020 MiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 996 op/s; 5117/49521 objects misplaced (10.333%); 1.6 MiB/s, 27 objects/s recovering 2024-02-10T08:31:54.296 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:31:52.935733+0000 mgr.y (mgr.14505) 569 : cluster [DBG] pgmap v695: 168 pgs: 1 active+remapped+backfill_wait, 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 163 active+clean; 1020 MiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 996 op/s; 5117/49521 objects misplaced (10.333%); 1.6 MiB/s, 27 objects/s recovering 2024-02-10T08:31:54.516 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:31:54.521 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:54.522 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:31:54.622 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:31:54.694 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:54.805 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.4 dump_ops_in_flight 2024-02-10T08:31:54.835 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:31:54.841 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:54.841 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:31:54.942 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:31:55.015 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:55.047 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:31:54.628821+0000 osd.6 (osd.6) 151 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:31:55.047 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:31:54.628875+0000 osd.6 (osd.6) 152 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:31:55.080 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:31:55.090 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:55.091 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:31:55.192 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:31:55.243 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:55.291 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:31:55.428 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:31:54.628821+0000 osd.6 (osd.6) 151 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:31:55.428 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:31:54.628875+0000 osd.6 (osd.6) 152 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:31:55.428 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:31:54.628821+0000 osd.6 (osd.6) 151 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:31:55.428 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:31:54.628875+0000 osd.6 (osd.6) 152 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:31:56.039 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-10T08:31:56.070 INFO:teuthology.orchestra.run.smithi018.stderr:reweighted osd.5 to 1 (10000) 2024-02-10T08:31:56.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:31:54.936315+0000 mgr.y (mgr.14505) 570 : cluster [DBG] pgmap v696: 168 pgs: 1 active+remapped+backfill_wait, 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 163 active+clean; 966 MiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 863 op/s; 4828/46932 objects misplaced (10.287%); 1.7 MiB/s, 28 objects/s recovering 2024-02-10T08:31:56.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:31:55.011935+0000 mon.a (mon.0) 1453 : cluster [DBG] osdmap e319: 8 total, 8 up, 8 in 2024-02-10T08:31:56.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:31:55.190791+0000 mon.b (mon.1) 74 : audit [INF] from='client.? 172.21.15.18:0/316028046' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2024-02-10T08:31:56.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:31:55.191232+0000 mon.a (mon.0) 1454 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2024-02-10T08:31:56.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:31:54.936315+0000 mgr.y (mgr.14505) 570 : cluster [DBG] pgmap v696: 168 pgs: 1 active+remapped+backfill_wait, 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 163 active+clean; 966 MiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 863 op/s; 4828/46932 objects misplaced (10.287%); 1.7 MiB/s, 28 objects/s recovering 2024-02-10T08:31:56.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:31:55.011935+0000 mon.a (mon.0) 1453 : cluster [DBG] osdmap e319: 8 total, 8 up, 8 in 2024-02-10T08:31:56.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:31:55.190791+0000 mon.b (mon.1) 74 : audit [INF] from='client.? 172.21.15.18:0/316028046' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2024-02-10T08:31:56.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:31:55.191232+0000 mon.a (mon.0) 1454 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2024-02-10T08:31:56.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:31:54.936315+0000 mgr.y (mgr.14505) 570 : cluster [DBG] pgmap v696: 168 pgs: 1 active+remapped+backfill_wait, 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 163 active+clean; 966 MiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 863 op/s; 4828/46932 objects misplaced (10.287%); 1.7 MiB/s, 28 objects/s recovering 2024-02-10T08:31:56.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:31:55.011935+0000 mon.a (mon.0) 1453 : cluster [DBG] osdmap e319: 8 total, 8 up, 8 in 2024-02-10T08:31:56.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:31:55.190791+0000 mon.b (mon.1) 74 : audit [INF] from='client.? 172.21.15.18:0/316028046' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2024-02-10T08:31:56.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:31:55.191232+0000 mon.a (mon.0) 1454 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2024-02-10T08:31:56.777 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:31:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:31:56] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:31:56.810 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:31:56.813 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:56.814 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:31:56.914 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:31:56.956 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:56.991 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:31:57.011 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:57.011 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:31:57.037 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:31:55.111088+0000 osd.1 (osd.1) 170 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:31:57.037 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:31:55.111144+0000 osd.1 (osd.1) 171 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:31:57.038 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:31:56.017805+0000 mon.a (mon.0) 1455 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]': finished 2024-02-10T08:31:57.038 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:31:56.017875+0000 mon.a (mon.0) 1456 : cluster [DBG] osdmap e320: 8 total, 8 up, 8 in 2024-02-10T08:31:57.112 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:31:57.133 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:31:55.111088+0000 osd.1 (osd.1) 170 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:31:57.133 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:31:55.111144+0000 osd.1 (osd.1) 171 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:31:57.133 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:31:56.017805+0000 mon.a (mon.0) 1455 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]': finished 2024-02-10T08:31:57.133 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:31:56.017875+0000 mon.a (mon.0) 1456 : cluster [DBG] osdmap e320: 8 total, 8 up, 8 in 2024-02-10T08:31:57.133 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:31:55.111088+0000 osd.1 (osd.1) 170 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:31:57.133 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:31:55.111144+0000 osd.1 (osd.1) 171 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:31:57.133 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:31:56.017805+0000 mon.a (mon.0) 1455 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]': finished 2024-02-10T08:31:57.133 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:31:56.017875+0000 mon.a (mon.0) 1456 : cluster [DBG] osdmap e320: 8 total, 8 up, 8 in 2024-02-10T08:31:57.183 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:57.404 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:31:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:31:57] "GET /metrics HTTP/1.1" 200 176242 "" "Prometheus/2.33.4" 2024-02-10T08:31:57.433 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:31:57.442 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:57.442 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:31:57.487 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-02-10T08:31:57.487 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:31:57.543 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:31:57.584 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:57.613 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:31:57.628 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:57.628 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:31:57.648 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd reweight 6 1 2024-02-10T08:31:57.729 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:31:57.786 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:58.082 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:31:58.085 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:58.086 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:31:58.185 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:31:58.187 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:31:58.226 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:31:56.936740+0000 mgr.y (mgr.14505) 571 : cluster [DBG] pgmap v699: 168 pgs: 1 active+remapped+backfill_wait, 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 163 active+clean; 949 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 605 op/s; 4828/46119 objects misplaced (10.469%); 935 KiB/s, 16 objects/s recovering 2024-02-10T08:31:58.229 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:58.267 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:31:58.272 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:58.273 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:31:58.287 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.4 dump_blocked_ops 2024-02-10T08:31:58.374 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:31:58.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:31:56.936740+0000 mgr.y (mgr.14505) 571 : cluster [DBG] pgmap v699: 168 pgs: 1 active+remapped+backfill_wait, 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 163 active+clean; 949 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 605 op/s; 4828/46119 objects misplaced (10.469%); 935 KiB/s, 16 objects/s recovering 2024-02-10T08:31:58.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:31:56.936740+0000 mgr.y (mgr.14505) 571 : cluster [DBG] pgmap v699: 168 pgs: 1 active+remapped+backfill_wait, 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 163 active+clean; 949 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 605 op/s; 4828/46119 objects misplaced (10.469%); 935 KiB/s, 16 objects/s recovering 2024-02-10T08:31:58.427 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:58.452 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:31:58.456 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:58.457 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:31:58.543 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:31:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:31:58.558 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:31:58.604 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:58.823 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:31:58.965 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:31:58.969 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:58.970 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:31:59.071 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:31:59.123 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:31:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:31:58.434316+0000 mgr.y (mgr.14505) 572 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:31:59.123 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:31:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:31:58.434316+0000 mgr.y (mgr.14505) 572 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:31:59.132 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:31:59.436 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:31:59 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:31:58.434316+0000 mgr.y (mgr.14505) 572 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:31:59.489 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:31:59.492 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:31:59.492 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:31:59.531 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:31:59.593 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:31:59.636 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:00.125 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is unset 2024-02-10T08:32:00.247 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:31:58.937612+0000 mgr.y (mgr.14505) 573 : cluster [DBG] pgmap v700: 168 pgs: 1 active+remapped+backfill_wait, 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 163 active+clean; 684 MiB data, 5.3 GiB used, 710 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.10k op/s; 3264/33387 objects misplaced (9.776%); 1.8 MiB/s, 29 objects/s recovering 2024-02-10T08:32:00.247 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:31:59.182174+0000 mon.c (mon.2) 73 : audit [INF] from='client.? 172.21.15.18:0/3719165768' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:32:00.247 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:31:59.185918+0000 mon.a (mon.0) 1457 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:32:00.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:31:58.937612+0000 mgr.y (mgr.14505) 573 : cluster [DBG] pgmap v700: 168 pgs: 1 active+remapped+backfill_wait, 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 163 active+clean; 684 MiB data, 5.3 GiB used, 710 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.10k op/s; 3264/33387 objects misplaced (9.776%); 1.8 MiB/s, 29 objects/s recovering 2024-02-10T08:32:00.454 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:31:59.182174+0000 mon.c (mon.2) 73 : audit [INF] from='client.? 172.21.15.18:0/3719165768' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:32:00.454 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:31:59.185918+0000 mon.a (mon.0) 1457 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:32:00.454 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:31:58.937612+0000 mgr.y (mgr.14505) 573 : cluster [DBG] pgmap v700: 168 pgs: 1 active+remapped+backfill_wait, 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 163 active+clean; 684 MiB data, 5.3 GiB used, 710 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.10k op/s; 3264/33387 objects misplaced (9.776%); 1.8 MiB/s, 29 objects/s recovering 2024-02-10T08:32:00.455 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:31:59.182174+0000 mon.c (mon.2) 73 : audit [INF] from='client.? 172.21.15.18:0/3719165768' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:32:00.455 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:31:59.185918+0000 mon.a (mon.0) 1457 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:32:00.994 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-02-10T08:32:00.994 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:32:01.212 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:32:01.220 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:01.220 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:32:01.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:00.070018+0000 mon.a (mon.0) 1458 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:32:01.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:32:00.076141+0000 mon.a (mon.0) 1459 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-10T08:32:01.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:00.076186+0000 mon.a (mon.0) 1460 : cluster [DBG] osdmap e321: 8 total, 8 up, 8 in 2024-02-10T08:32:01.300 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:00.070018+0000 mon.a (mon.0) 1458 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:32:01.300 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:32:00.076141+0000 mon.a (mon.0) 1459 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-10T08:32:01.300 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:00.076186+0000 mon.a (mon.0) 1460 : cluster [DBG] osdmap e321: 8 total, 8 up, 8 in 2024-02-10T08:32:01.300 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:00.070018+0000 mon.a (mon.0) 1458 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:32:01.301 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:32:00.076141+0000 mon.a (mon.0) 1459 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-10T08:32:01.301 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:00.076186+0000 mon.a (mon.0) 1460 : cluster [DBG] osdmap e321: 8 total, 8 up, 8 in 2024-02-10T08:32:01.321 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:32:01.464 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:01.828 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.4 dump_historic_ops 2024-02-10T08:32:02.022 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:32:02.031 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:02.032 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:32:02.128 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:00.938067+0000 mgr.y (mgr.14505) 574 : cluster [DBG] pgmap v702: 168 pgs: 1 active+remapped+backfill_wait, 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 163 active+clean; 666 MiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 799 op/s; 3264/32550 objects misplaced (10.028%); 1.2 MiB/s, 19 objects/s recovering 2024-02-10T08:32:02.128 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:01.618237+0000 osd.7 (osd.7) 177 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:32:02.128 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:01.618277+0000 osd.7 (osd.7) 178 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:32:02.132 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:32:02.175 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:02.264 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:32:02.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:00.938067+0000 mgr.y (mgr.14505) 574 : cluster [DBG] pgmap v702: 168 pgs: 1 active+remapped+backfill_wait, 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 163 active+clean; 666 MiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 799 op/s; 3264/32550 objects misplaced (10.028%); 1.2 MiB/s, 19 objects/s recovering 2024-02-10T08:32:02.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:01.618237+0000 osd.7 (osd.7) 177 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:32:02.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:01.618277+0000 osd.7 (osd.7) 178 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:32:02.407 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:00.938067+0000 mgr.y (mgr.14505) 574 : cluster [DBG] pgmap v702: 168 pgs: 1 active+remapped+backfill_wait, 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 163 active+clean; 666 MiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 799 op/s; 3264/32550 objects misplaced (10.028%); 1.2 MiB/s, 19 objects/s recovering 2024-02-10T08:32:02.407 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:01.618237+0000 osd.7 (osd.7) 177 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:32:02.407 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:01.618277+0000 osd.7 (osd.7) 178 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:32:02.419 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:32:02.424 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:02.425 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:32:02.525 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:32:02.606 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:02.645 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:32:02.653 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:02.654 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:32:02.755 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:32:02.832 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:03.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:02.109891+0000 mon.a (mon.0) 1461 : cluster [DBG] osdmap e322: 8 total, 8 up, 8 in 2024-02-10T08:32:03.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:02.109891+0000 mon.a (mon.0) 1461 : cluster [DBG] osdmap e322: 8 total, 8 up, 8 in 2024-02-10T08:32:03.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:02.109891+0000 mon.a (mon.0) 1461 : cluster [DBG] osdmap e322: 8 total, 8 up, 8 in 2024-02-10T08:32:03.953 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:32:03.961 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:03.961 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:32:04.062 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:32:04.119 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:04.122 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:32:04.122 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:32:04.122 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:32:04.122 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:32:04.122 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:32:04.123 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:32:04.123 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:32:04.123 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:32:04.123 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-10T08:32:04.123 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-10T08:32:04.123 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-10T08:32:04.123 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-10T08:32:04.123 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-10T08:32:04.123 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-10T08:32:04.123 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-10T08:32:04.123 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-10T08:32:04.149 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:02.939130+0000 mgr.y (mgr.14505) 575 : cluster [DBG] pgmap v704: 168 pgs: 1 active+remapped+backfill_wait, 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 163 active+clean; 461 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 1.13k op/s; 2068/22728 objects misplaced (9.099%); 1.6 MiB/s, 25 objects/s recovering 2024-02-10T08:32:04.149 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:32:03.188691+0000 mon.a (mon.0) 1462 : audit [DBG] from='client.? 172.21.15.18:0/1151595781' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:32:04.335 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:32:04.339 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:04.340 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:32:04.340 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:02.939130+0000 mgr.y (mgr.14505) 575 : cluster [DBG] pgmap v704: 168 pgs: 1 active+remapped+backfill_wait, 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 163 active+clean; 461 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 1.13k op/s; 2068/22728 objects misplaced (9.099%); 1.6 MiB/s, 25 objects/s recovering 2024-02-10T08:32:04.340 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:32:03.188691+0000 mon.a (mon.0) 1462 : audit [DBG] from='client.? 172.21.15.18:0/1151595781' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:32:04.340 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:02.939130+0000 mgr.y (mgr.14505) 575 : cluster [DBG] pgmap v704: 168 pgs: 1 active+remapped+backfill_wait, 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 163 active+clean; 461 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 1.13k op/s; 2068/22728 objects misplaced (9.099%); 1.6 MiB/s, 25 objects/s recovering 2024-02-10T08:32:04.340 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:32:03.188691+0000 mon.a (mon.0) 1462 : audit [DBG] from='client.? 172.21.15.18:0/1151595781' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:32:04.441 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:32:04.454 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd unset nodeep-scrub 2024-02-10T08:32:04.522 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:04.599 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:32:04.608 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:04.609 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:32:04.655 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-02-10T08:32:04.655 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-02-10T08:32:04.655 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-02-10T08:32:04.655 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-02-10T08:32:04.655 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.655 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14784.0:179915 7.4 7:24d5e43a:::benchmark_data_smithi018_80623_object78987:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e163)", 2024-02-10T08:32:04.655 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:23:14.073212+0000", 2024-02-10T08:32:04.655 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 530.57618164799999, 2024-02-10T08:32:04.656 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.592447884, 2024-02-10T08:32:04.656 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:32:04.656 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-02-10T08:32:04.656 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:32:04.656 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14784", 2024-02-10T08:32:04.656 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:32:04.656 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 179915 2024-02-10T08:32:04.656 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.656 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:32:04.656 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.656 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:32:04.656 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:14.073212+0000", 2024-02-10T08:32:04.656 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:32:04.656 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.657 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.657 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:32:04.657 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:14.073212+0000", 2024-02-10T08:32:04.657 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999981 2024-02-10T08:32:04.657 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.657 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.657 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:32:04.657 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:14.073210+0000", 2024-02-10T08:32:04.657 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.174e-06 2024-02-10T08:32:04.657 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.657 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.657 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:32:04.657 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:14.073218+0000", 2024-02-10T08:32:04.657 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2557e-05 2024-02-10T08:32:04.657 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.658 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.658 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:32:04.658 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:14.073231+0000", 2024-02-10T08:32:04.658 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2590000000000003e-06 2024-02-10T08:32:04.658 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.658 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.658 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:32:04.658 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:14.073238+0000", 2024-02-10T08:32:04.658 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3290000000000001e-05 2024-02-10T08:32:04.658 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.658 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.658 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:32:04.658 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:14.073271+0000", 2024-02-10T08:32:04.658 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5659999999999997e-06 2024-02-10T08:32:04.659 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.659 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.659 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:32:04.659 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:14.073277+0000", 2024-02-10T08:32:04.659 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.99451457700000001 2024-02-10T08:32:04.659 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.659 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.659 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:32:04.659 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:15.067791+0000", 2024-02-10T08:32:04.659 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2490000000000001e-05 2024-02-10T08:32:04.659 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.659 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.659 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:32:04.659 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:15.067804+0000", 2024-02-10T08:32:04.660 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.59776341 2024-02-10T08:32:04.660 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.660 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.660 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:32:04.660 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:15.665567+0000", 2024-02-10T08:32:04.660 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2585999999999998e-05 2024-02-10T08:32:04.660 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.660 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.660 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:32:04.660 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:15.665660+0000", 2024-02-10T08:32:04.660 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.592447884 2024-02-10T08:32:04.660 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:32:04.660 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:32:04.660 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:32:04.660 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.661 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.661 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14784.0:198796 7.4 7:22684d34:::benchmark_data_smithi018_80623_object97868:head [delete] snapc 0=[] ondisk+write+known_if_redirected e173)", 2024-02-10T08:32:04.661 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:23:46.857357+0000", 2024-02-10T08:32:04.661 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 497.79203671800002, 2024-02-10T08:32:04.661 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0332809890000001, 2024-02-10T08:32:04.661 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:32:04.661 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:32:04.661 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:32:04.661 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14784", 2024-02-10T08:32:04.661 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:32:04.661 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 198796 2024-02-10T08:32:04.661 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.661 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:32:04.661 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.661 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:32:04.662 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:46.857357+0000", 2024-02-10T08:32:04.662 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:32:04.662 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.662 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.662 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:32:04.662 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:46.857357+0000", 2024-02-10T08:32:04.662 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-02-10T08:32:04.662 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.662 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.662 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:32:04.662 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:46.857355+0000", 2024-02-10T08:32:04.662 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6630000000000001e-06 2024-02-10T08:32:04.662 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.662 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.662 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:32:04.662 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:46.857360+0000", 2024-02-10T08:32:04.663 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7060000000000004e-06 2024-02-10T08:32:04.663 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.663 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.663 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:32:04.663 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:46.857368+0000", 2024-02-10T08:32:04.663 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0140000000000004e-06 2024-02-10T08:32:04.663 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.663 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.663 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:32:04.663 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:46.857374+0000", 2024-02-10T08:32:04.663 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000118694 2024-02-10T08:32:04.663 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.663 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.663 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:32:04.664 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:46.857493+0000", 2024-02-10T08:32:04.664 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7709999999999995e-06 2024-02-10T08:32:04.664 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.664 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.664 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:32:04.664 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:46.857501+0000", 2024-02-10T08:32:04.664 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.025651697 2024-02-10T08:32:04.664 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.664 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.664 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:32:04.664 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:47.883153+0000", 2024-02-10T08:32:04.664 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014673799999999999 2024-02-10T08:32:04.664 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.664 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.664 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:32:04.664 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:47.883300+0000", 2024-02-10T08:32:04.665 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000171294 2024-02-10T08:32:04.665 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.665 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.665 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1,6", 2024-02-10T08:32:04.665 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:47.883471+0000", 2024-02-10T08:32:04.665 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027453680000000002 2024-02-10T08:32:04.665 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.665 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.665 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:32:04.665 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:47.886216+0000", 2024-02-10T08:32:04.665 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0042834550000000002 2024-02-10T08:32:04.665 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.665 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.665 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:32:04.665 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:47.890500+0000", 2024-02-10T08:32:04.665 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0394000000000002e-05 2024-02-10T08:32:04.666 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.666 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.666 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:32:04.666 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:47.890590+0000", 2024-02-10T08:32:04.666 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6103000000000001e-05 2024-02-10T08:32:04.666 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.666 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.666 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:32:04.666 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:47.890616+0000", 2024-02-10T08:32:04.666 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1495e-05 2024-02-10T08:32:04.666 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.666 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.666 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:32:04.666 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:47.890638+0000", 2024-02-10T08:32:04.666 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0332809890000001 2024-02-10T08:32:04.666 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:32:04.666 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:32:04.667 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:32:04.667 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.667 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.667 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14784.0:198809 7.4 7:26595044:::benchmark_data_smithi018_80623_object97881:head [delete] snapc 0=[] ondisk+write+known_if_redirected e174)", 2024-02-10T08:32:04.667 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:23:46.875764+0000", 2024-02-10T08:32:04.667 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 497.77362985500002, 2024-02-10T08:32:04.667 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.014932765, 2024-02-10T08:32:04.667 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:32:04.667 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:32:04.667 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:32:04.667 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14784", 2024-02-10T08:32:04.667 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:32:04.667 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 198809 2024-02-10T08:32:04.667 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.667 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:32:04.667 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.668 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:32:04.668 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:46.875764+0000", 2024-02-10T08:32:04.668 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:32:04.668 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.668 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.668 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:32:04.668 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:46.875764+0000", 2024-02-10T08:32:04.668 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-02-10T08:32:04.668 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.668 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.668 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:32:04.668 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:46.875762+0000", 2024-02-10T08:32:04.668 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2409999999999998e-06 2024-02-10T08:32:04.668 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.668 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.669 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:32:04.669 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:46.875769+0000", 2024-02-10T08:32:04.669 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0829000000000001e-05 2024-02-10T08:32:04.669 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.669 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.669 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:32:04.669 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:46.875780+0000", 2024-02-10T08:32:04.669 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5010000000000001e-06 2024-02-10T08:32:04.669 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.669 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.669 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:32:04.669 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:46.875787+0000", 2024-02-10T08:32:04.669 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7899000000000003e-05 2024-02-10T08:32:04.669 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.669 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.669 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:32:04.670 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:46.875835+0000", 2024-02-10T08:32:04.670 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0390999999999999e-05 2024-02-10T08:32:04.670 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.670 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.670 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:32:04.670 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:46.875845+0000", 2024-02-10T08:32:04.670 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0104128109999999 2024-02-10T08:32:04.670 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.670 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.670 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:32:04.670 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:47.886258+0000", 2024-02-10T08:32:04.670 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6355999999999999e-05 2024-02-10T08:32:04.670 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.670 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.670 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:32:04.671 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:47.886334+0000", 2024-02-10T08:32:04.671 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2133999999999996e-05 2024-02-10T08:32:04.671 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.671 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.671 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1,6", 2024-02-10T08:32:04.671 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:47.886426+0000", 2024-02-10T08:32:04.671 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.004143463 2024-02-10T08:32:04.671 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.671 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.671 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:32:04.671 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:47.890570+0000", 2024-02-10T08:32:04.671 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6500000000000002e-06 2024-02-10T08:32:04.671 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.671 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.671 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:32:04.672 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:47.890573+0000", 2024-02-10T08:32:04.672 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5853999999999995e-05 2024-02-10T08:32:04.672 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.672 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.672 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:32:04.672 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:47.890659+0000", 2024-02-10T08:32:04.672 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9392999999999999e-05 2024-02-10T08:32:04.672 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.672 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.672 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:32:04.672 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:47.890679+0000", 2024-02-10T08:32:04.672 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7802e-05 2024-02-10T08:32:04.672 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.672 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.672 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:32:04.672 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:47.890697+0000", 2024-02-10T08:32:04.673 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.014932765 2024-02-10T08:32:04.673 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:32:04.673 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:32:04.673 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:32:04.673 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.673 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.673 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14784.0:198824 7.4 7:2c1b76cf:::benchmark_data_smithi018_80623_object97896:head [delete] snapc 0=[] ondisk+write+known_if_redirected e174)", 2024-02-10T08:32:04.673 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:23:46.903247+0000", 2024-02-10T08:32:04.673 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 497.746146458, 2024-02-10T08:32:04.673 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.99430549099999999, 2024-02-10T08:32:04.673 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:32:04.673 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:32:04.673 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:32:04.673 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14784", 2024-02-10T08:32:04.673 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:32:04.673 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 198824 2024-02-10T08:32:04.673 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.674 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:32:04.674 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.674 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:32:04.674 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:46.903247+0000", 2024-02-10T08:32:04.674 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:32:04.674 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.674 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.674 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:32:04.674 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:46.903247+0000", 2024-02-10T08:32:04.674 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999976 2024-02-10T08:32:04.674 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.674 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.674 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:32:04.674 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:46.903245+0000", 2024-02-10T08:32:04.674 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4849999999999992e-06 2024-02-10T08:32:04.674 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.675 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.675 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:32:04.675 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:46.903253+0000", 2024-02-10T08:32:04.675 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4219999999999999e-05 2024-02-10T08:32:04.675 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.675 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.675 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:32:04.675 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:46.903268+0000", 2024-02-10T08:32:04.675 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.285e-06 2024-02-10T08:32:04.675 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.675 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.675 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:32:04.675 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:46.903274+0000", 2024-02-10T08:32:04.675 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5284000000000002e-05 2024-02-10T08:32:04.675 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.675 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.675 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:32:04.676 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:46.903319+0000", 2024-02-10T08:32:04.676 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.909e-06 2024-02-10T08:32:04.676 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.676 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.676 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:32:04.676 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:46.903327+0000", 2024-02-10T08:32:04.676 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.98517790500000002 2024-02-10T08:32:04.676 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.676 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.676 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:32:04.676 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:47.888505+0000", 2024-02-10T08:32:04.676 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012267800000000001 2024-02-10T08:32:04.676 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.676 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.676 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:32:04.676 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:47.888628+0000", 2024-02-10T08:32:04.677 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000134127 2024-02-10T08:32:04.677 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.677 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.677 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1,6", 2024-02-10T08:32:04.677 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:47.888762+0000", 2024-02-10T08:32:04.677 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003291937 2024-02-10T08:32:04.677 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.677 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.677 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:32:04.677 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:47.892054+0000", 2024-02-10T08:32:04.677 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019566000000000002 2024-02-10T08:32:04.677 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.677 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.677 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:32:04.677 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:47.894010+0000", 2024-02-10T08:32:04.677 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034600880000000001 2024-02-10T08:32:04.677 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.678 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.678 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:32:04.678 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:47.897470+0000", 2024-02-10T08:32:04.678 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4291e-05 2024-02-10T08:32:04.678 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.678 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.678 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:32:04.678 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:47.897515+0000", 2024-02-10T08:32:04.678 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7947000000000001e-05 2024-02-10T08:32:04.678 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.678 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.678 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:32:04.678 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:23:47.897553+0000", 2024-02-10T08:32:04.678 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.99430549099999999 2024-02-10T08:32:04.678 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:32:04.678 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:32:04.679 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:32:04.679 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.679 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.679 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14964.0:248057 8.2 8:4e72f17a:::benchmark_data_smithi018_103312_object123625:head [delete] snapc 0=[] ondisk+write+known_if_redirected e245)", 2024-02-10T08:32:04.679 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:28:05.693964+0000", 2024-02-10T08:32:04.679 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 238.95542940199999, 2024-02-10T08:32:04.679 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.052030805, 2024-02-10T08:32:04.679 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:32:04.679 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-02-10T08:32:04.679 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:32:04.679 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14964", 2024-02-10T08:32:04.679 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3173131962", 2024-02-10T08:32:04.679 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 248057 2024-02-10T08:32:04.679 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.680 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:32:04.680 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.680 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:32:04.680 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.693964+0000", 2024-02-10T08:32:04.680 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:32:04.680 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.680 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.680 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:32:04.680 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.693964+0000", 2024-02-10T08:32:04.680 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-02-10T08:32:04.680 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.680 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.680 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:32:04.680 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.693963+0000", 2024-02-10T08:32:04.680 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3730000000000001e-06 2024-02-10T08:32:04.681 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.681 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.681 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:32:04.681 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.693968+0000", 2024-02-10T08:32:04.681 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0090000000000007e-06 2024-02-10T08:32:04.681 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.681 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.681 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:32:04.681 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.693976+0000", 2024-02-10T08:32:04.681 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5800000000000002e-06 2024-02-10T08:32:04.681 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.681 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.681 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:32:04.681 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.693981+0000", 2024-02-10T08:32:04.681 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7899999999999999e-05 2024-02-10T08:32:04.682 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.682 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.682 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:32:04.682 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.694028+0000", 2024-02-10T08:32:04.682 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7101999999999995e-05 2024-02-10T08:32:04.682 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.682 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.682 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:32:04.682 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.694106+0000", 2024-02-10T08:32:04.682 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000118226 2024-02-10T08:32:04.682 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.682 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.682 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,5,6", 2024-02-10T08:32:04.682 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.694224+0000", 2024-02-10T08:32:04.682 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002449241 2024-02-10T08:32:04.682 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.682 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.682 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:32:04.683 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.696673+0000", 2024-02-10T08:32:04.683 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00086247799999999996 2024-02-10T08:32:04.683 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.683 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.683 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:32:04.683 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.697536+0000", 2024-02-10T08:32:04.683 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0023925589999999998 2024-02-10T08:32:04.683 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.683 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.683 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:32:04.683 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.699928+0000", 2024-02-10T08:32:04.683 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.046928281000000002 2024-02-10T08:32:04.683 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.683 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.683 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:32:04.683 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.746856+0000", 2024-02-10T08:32:04.683 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9709999999999999e-06 2024-02-10T08:32:04.684 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.684 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.684 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:32:04.684 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.746866+0000", 2024-02-10T08:32:04.684 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.99905785800000002 2024-02-10T08:32:04.684 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.684 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.684 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:32:04.684 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.745924+0000", 2024-02-10T08:32:04.684 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0840000000000006e-05 2024-02-10T08:32:04.684 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.684 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.684 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:32:04.684 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.745995+0000", 2024-02-10T08:32:04.684 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.052030805 2024-02-10T08:32:04.684 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:32:04.685 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:32:04.685 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:32:04.685 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.685 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14964.0:248073 8.2 8:4ee22618:::benchmark_data_smithi018_103312_object123641:head [delete] snapc 0=[] ondisk+write+known_if_redirected e245)", 2024-02-10T08:32:04.685 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:28:05.704023+0000", 2024-02-10T08:32:04.685 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 238.94537092499999, 2024-02-10T08:32:04.685 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.042410608, 2024-02-10T08:32:04.685 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:32:04.685 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-02-10T08:32:04.685 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:32:04.685 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14964", 2024-02-10T08:32:04.685 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3173131962", 2024-02-10T08:32:04.685 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 248073 2024-02-10T08:32:04.685 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.686 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:32:04.686 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.686 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:32:04.686 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.704023+0000", 2024-02-10T08:32:04.686 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:32:04.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.686 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.686 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:32:04.686 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.704023+0000", 2024-02-10T08:32:04.686 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-02-10T08:32:04.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.686 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.686 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:32:04.686 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.704021+0000", 2024-02-10T08:32:04.686 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5389999999999998e-06 2024-02-10T08:32:04.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.687 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:32:04.687 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.704027+0000", 2024-02-10T08:32:04.687 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8890000000000008e-06 2024-02-10T08:32:04.687 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.687 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:32:04.687 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.704036+0000", 2024-02-10T08:32:04.687 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.685e-06 2024-02-10T08:32:04.687 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.687 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:32:04.687 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.704040+0000", 2024-02-10T08:32:04.687 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.769e-05 2024-02-10T08:32:04.687 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.687 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:32:04.688 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.704078+0000", 2024-02-10T08:32:04.688 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1235000000000006e-05 2024-02-10T08:32:04.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.688 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.688 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:32:04.688 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.704139+0000", 2024-02-10T08:32:04.688 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0595999999999998e-05 2024-02-10T08:32:04.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.688 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.688 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,5,6", 2024-02-10T08:32:04.688 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.704230+0000", 2024-02-10T08:32:04.688 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001779709 2024-02-10T08:32:04.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.688 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.689 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:32:04.689 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.706010+0000", 2024-02-10T08:32:04.689 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00038055700000000001 2024-02-10T08:32:04.689 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.689 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:32:04.689 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.706390+0000", 2024-02-10T08:32:04.689 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.040501199000000002 2024-02-10T08:32:04.689 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.689 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:32:04.689 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.746891+0000", 2024-02-10T08:32:04.689 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7619999999999998e-06 2024-02-10T08:32:04.689 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.689 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:32:04.689 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.746898+0000", 2024-02-10T08:32:04.690 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.99947289299999997 2024-02-10T08:32:04.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.690 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.690 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:32:04.690 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.746371+0000", 2024-02-10T08:32:04.690 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2255999999999995e-05 2024-02-10T08:32:04.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.690 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.690 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:32:04.690 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.746433+0000", 2024-02-10T08:32:04.690 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.042410608 2024-02-10T08:32:04.690 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:32:04.690 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:32:04.690 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:32:04.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.690 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.691 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14964.0:248083 8.2 8:46df8c5c:::benchmark_data_smithi018_103312_object123651:head [delete] snapc 0=[] ondisk+write+known_if_redirected e246)", 2024-02-10T08:32:04.691 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:28:05.757882+0000", 2024-02-10T08:32:04.691 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 238.891511603, 2024-02-10T08:32:04.691 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.998812272, 2024-02-10T08:32:04.691 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:32:04.691 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:32:04.691 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:32:04.691 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14964", 2024-02-10T08:32:04.691 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3173131962", 2024-02-10T08:32:04.691 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 248083 2024-02-10T08:32:04.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.691 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:32:04.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.691 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:32:04.691 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.757882+0000", 2024-02-10T08:32:04.691 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:32:04.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.692 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:32:04.692 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.757882+0000", 2024-02-10T08:32:04.692 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-02-10T08:32:04.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.692 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:32:04.692 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.757880+0000", 2024-02-10T08:32:04.692 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8690000000000004e-06 2024-02-10T08:32:04.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.692 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:32:04.692 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.757888+0000", 2024-02-10T08:32:04.692 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0769e-05 2024-02-10T08:32:04.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.692 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:32:04.693 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.757899+0000", 2024-02-10T08:32:04.693 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3820000000000001e-06 2024-02-10T08:32:04.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.693 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:32:04.693 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.757905+0000", 2024-02-10T08:32:04.693 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020590790000000001 2024-02-10T08:32:04.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.693 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:32:04.693 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.759964+0000", 2024-02-10T08:32:04.693 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4420000000000003e-06 2024-02-10T08:32:04.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.693 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:32:04.693 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.759971+0000", 2024-02-10T08:32:04.693 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.98650727599999999 2024-02-10T08:32:04.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.694 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.694 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:32:04.694 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.746478+0000", 2024-02-10T08:32:04.694 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7355999999999995e-05 2024-02-10T08:32:04.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.694 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.694 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:32:04.694 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.746566+0000", 2024-02-10T08:32:04.694 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000132349 2024-02-10T08:32:04.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.694 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.694 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,5", 2024-02-10T08:32:04.694 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.746698+0000", 2024-02-10T08:32:04.694 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.009744862 2024-02-10T08:32:04.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.694 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.695 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:32:04.695 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.756443+0000", 2024-02-10T08:32:04.695 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000110237 2024-02-10T08:32:04.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.695 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:32:04.695 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.756553+0000", 2024-02-10T08:32:04.695 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7463999999999999e-05 2024-02-10T08:32:04.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.695 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:32:04.695 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.756590+0000", 2024-02-10T08:32:04.695 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5776000000000003e-05 2024-02-10T08:32:04.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.695 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:32:04.696 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.756646+0000", 2024-02-10T08:32:04.696 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8031999999999997e-05 2024-02-10T08:32:04.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.696 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.696 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:32:04.696 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.756694+0000", 2024-02-10T08:32:04.696 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.998812272 2024-02-10T08:32:04.696 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:32:04.696 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:32:04.696 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:32:04.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.696 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.696 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14964.0:248088 8.2 8:49a01a71:::benchmark_data_smithi018_103312_object123656:head [delete] snapc 0=[] ondisk+write+known_if_redirected e246)", 2024-02-10T08:32:04.696 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:28:05.761595+0000", 2024-02-10T08:32:04.697 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 238.887798422, 2024-02-10T08:32:04.697 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0063328789999999, 2024-02-10T08:32:04.697 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:32:04.697 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:32:04.697 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:32:04.697 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14964", 2024-02-10T08:32:04.697 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3173131962", 2024-02-10T08:32:04.697 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 248088 2024-02-10T08:32:04.697 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.697 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:32:04.697 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.697 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:32:04.697 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.761595+0000", 2024-02-10T08:32:04.697 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:32:04.697 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.697 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.698 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:32:04.698 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.761595+0000", 2024-02-10T08:32:04.698 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999981 2024-02-10T08:32:04.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.698 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:32:04.698 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.761593+0000", 2024-02-10T08:32:04.698 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1060000000000002e-06 2024-02-10T08:32:04.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.698 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:32:04.698 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.761600+0000", 2024-02-10T08:32:04.698 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4027e-05 2024-02-10T08:32:04.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.698 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:32:04.699 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.761614+0000", 2024-02-10T08:32:04.699 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2310000000000001e-06 2024-02-10T08:32:04.699 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.699 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.699 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:32:04.699 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.761621+0000", 2024-02-10T08:32:04.699 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2810000000000002e-05 2024-02-10T08:32:04.699 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.699 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.699 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:32:04.699 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.761704+0000", 2024-02-10T08:32:04.699 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0910000000000004e-06 2024-02-10T08:32:04.699 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.699 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.699 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:32:04.700 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.761711+0000", 2024-02-10T08:32:04.700 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.98744357800000004 2024-02-10T08:32:04.700 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.700 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.700 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:32:04.700 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.749154+0000", 2024-02-10T08:32:04.700 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000117133 2024-02-10T08:32:04.700 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.700 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.700 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:32:04.700 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.749271+0000", 2024-02-10T08:32:04.700 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014030999999999999 2024-02-10T08:32:04.700 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.700 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.701 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,5", 2024-02-10T08:32:04.701 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.749412+0000", 2024-02-10T08:32:04.701 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0070370900000000002 2024-02-10T08:32:04.701 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.701 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.701 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:32:04.701 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.756449+0000", 2024-02-10T08:32:04.701 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00031059499999999999 2024-02-10T08:32:04.701 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.701 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.701 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:32:04.701 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.756759+0000", 2024-02-10T08:32:04.701 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011094645 2024-02-10T08:32:04.701 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.701 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.701 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:32:04.701 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.767854+0000", 2024-02-10T08:32:04.702 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3083999999999997e-05 2024-02-10T08:32:04.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.702 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.702 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:32:04.702 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.767887+0000", 2024-02-10T08:32:04.702 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1014999999999999e-05 2024-02-10T08:32:04.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.702 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.702 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:32:04.702 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.767928+0000", 2024-02-10T08:32:04.702 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0063328789999999 2024-02-10T08:32:04.702 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:32:04.702 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:32:04.702 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:32:04.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.703 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.703 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14964.0:248091 8.2 8:4c7eb95c:::benchmark_data_smithi018_103312_object123659:head [delete] snapc 0=[] ondisk+write+known_if_redirected e246)", 2024-02-10T08:32:04.703 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:28:05.761631+0000", 2024-02-10T08:32:04.703 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 238.887762442, 2024-02-10T08:32:04.703 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.00641921, 2024-02-10T08:32:04.703 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:32:04.703 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:32:04.703 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:32:04.703 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14964", 2024-02-10T08:32:04.703 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3173131962", 2024-02-10T08:32:04.703 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 248091 2024-02-10T08:32:04.703 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.703 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:32:04.703 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.703 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:32:04.703 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.761631+0000", 2024-02-10T08:32:04.703 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:32:04.704 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.704 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.704 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:32:04.704 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.761631+0000", 2024-02-10T08:32:04.704 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-02-10T08:32:04.704 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.704 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.704 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:32:04.704 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.761631+0000", 2024-02-10T08:32:04.704 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8459999999999999e-06 2024-02-10T08:32:04.704 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.704 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.704 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:32:04.704 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.761634+0000", 2024-02-10T08:32:04.705 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4830000000000001e-06 2024-02-10T08:32:04.705 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.705 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.705 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:32:04.705 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.761638+0000", 2024-02-10T08:32:04.705 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6500000000000002e-06 2024-02-10T08:32:04.705 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.705 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.705 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:32:04.705 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.761642+0000", 2024-02-10T08:32:04.705 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9600999999999998e-05 2024-02-10T08:32:04.705 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.705 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.705 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:32:04.705 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.761731+0000", 2024-02-10T08:32:04.705 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.758e-06 2024-02-10T08:32:04.706 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.706 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.706 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:32:04.706 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.761736+0000", 2024-02-10T08:32:04.706 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.98969200099999999 2024-02-10T08:32:04.706 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.706 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.706 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:32:04.706 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.751428+0000", 2024-02-10T08:32:04.706 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000120124 2024-02-10T08:32:04.706 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.706 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.706 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:32:04.706 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.751548+0000", 2024-02-10T08:32:04.706 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000141521 2024-02-10T08:32:04.706 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.707 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.707 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,5", 2024-02-10T08:32:04.707 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.751690+0000", 2024-02-10T08:32:04.707 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.005081548 2024-02-10T08:32:04.707 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.707 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.707 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:32:04.707 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.756771+0000", 2024-02-10T08:32:04.707 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0066599099999999998 2024-02-10T08:32:04.707 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.707 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.707 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:32:04.707 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.763431+0000", 2024-02-10T08:32:04.707 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0045568830000000003 2024-02-10T08:32:04.707 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.707 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.708 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:32:04.708 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.767988+0000", 2024-02-10T08:32:04.708 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7288e-05 2024-02-10T08:32:04.708 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.708 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.708 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:32:04.708 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.768015+0000", 2024-02-10T08:32:04.708 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5055999999999998e-05 2024-02-10T08:32:04.708 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.708 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.708 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:32:04.708 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.768050+0000", 2024-02-10T08:32:04.708 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.00641921 2024-02-10T08:32:04.708 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:32:04.708 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:32:04.708 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:32:04.709 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.709 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.709 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14964.0:248100 8.2 8:4b40f43c:::benchmark_data_smithi018_103312_object123668:head [delete] snapc 0=[] ondisk+write+known_if_redirected e246)", 2024-02-10T08:32:04.709 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:28:05.766872+0000", 2024-02-10T08:32:04.709 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 238.8825214, 2024-02-10T08:32:04.709 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0052526770000001, 2024-02-10T08:32:04.709 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:32:04.709 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:32:04.709 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:32:04.709 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14964", 2024-02-10T08:32:04.709 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3173131962", 2024-02-10T08:32:04.709 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 248100 2024-02-10T08:32:04.709 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.709 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:32:04.709 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.709 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:32:04.710 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.766872+0000", 2024-02-10T08:32:04.710 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:32:04.710 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.710 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.710 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:32:04.710 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.766872+0000", 2024-02-10T08:32:04.710 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999976 2024-02-10T08:32:04.710 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.710 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.710 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:32:04.710 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.766870+0000", 2024-02-10T08:32:04.710 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6980000000000004e-06 2024-02-10T08:32:04.710 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.710 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.710 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:32:04.710 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.766878+0000", 2024-02-10T08:32:04.710 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2524000000000001e-05 2024-02-10T08:32:04.711 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.711 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.711 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:32:04.711 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.766891+0000", 2024-02-10T08:32:04.711 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4880000000000004e-06 2024-02-10T08:32:04.711 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.711 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.711 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:32:04.711 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.766897+0000", 2024-02-10T08:32:04.711 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8500000000000001e-05 2024-02-10T08:32:04.711 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.711 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.711 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:32:04.711 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.766936+0000", 2024-02-10T08:32:04.711 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1559999999999995e-06 2024-02-10T08:32:04.711 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.711 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.711 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:32:04.712 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.766944+0000", 2024-02-10T08:32:04.712 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.98716463899999995 2024-02-10T08:32:04.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.712 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.712 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:32:04.712 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.754109+0000", 2024-02-10T08:32:04.712 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000117099 2024-02-10T08:32:04.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.712 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.712 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:32:04.712 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.754226+0000", 2024-02-10T08:32:04.712 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000117209 2024-02-10T08:32:04.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.712 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.712 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,5", 2024-02-10T08:32:04.712 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.754343+0000", 2024-02-10T08:32:04.712 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0090969559999999998 2024-02-10T08:32:04.713 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.713 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.713 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:32:04.713 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.763440+0000", 2024-02-10T08:32:04.713 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0575999999999997e-05 2024-02-10T08:32:04.713 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.713 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.713 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:32:04.713 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.763500+0000", 2024-02-10T08:32:04.713 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0085535490000000006 2024-02-10T08:32:04.713 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.713 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.713 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:32:04.713 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.772054+0000", 2024-02-10T08:32:04.713 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9388000000000003e-05 2024-02-10T08:32:04.713 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.713 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.714 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:32:04.714 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.772093+0000", 2024-02-10T08:32:04.714 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1488000000000001e-05 2024-02-10T08:32:04.714 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.714 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.714 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:32:04.714 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.772125+0000", 2024-02-10T08:32:04.714 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0052526770000001 2024-02-10T08:32:04.714 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:32:04.714 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:32:04.714 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:32:04.714 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.714 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.714 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14964.0:248116 8.2 8:43faa874:::benchmark_data_smithi018_103312_object123684:head [delete] snapc 0=[] ondisk+write+known_if_redirected e246)", 2024-02-10T08:32:04.714 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:28:05.779908+0000", 2024-02-10T08:32:04.714 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 238.869485766, 2024-02-10T08:32:04.715 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.99236875400000002, 2024-02-10T08:32:04.715 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:32:04.715 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:32:04.715 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:32:04.715 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14964", 2024-02-10T08:32:04.715 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3173131962", 2024-02-10T08:32:04.715 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 248116 2024-02-10T08:32:04.715 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.715 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:32:04.715 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.715 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:32:04.715 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.779908+0000", 2024-02-10T08:32:04.715 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:32:04.715 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.715 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.715 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:32:04.716 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.779908+0000", 2024-02-10T08:32:04.716 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999981 2024-02-10T08:32:04.716 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.716 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.716 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:32:04.716 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.779906+0000", 2024-02-10T08:32:04.716 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6060000000000003e-06 2024-02-10T08:32:04.716 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.716 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.716 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:32:04.716 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.779915+0000", 2024-02-10T08:32:04.716 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2882e-05 2024-02-10T08:32:04.716 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.716 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.717 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:32:04.717 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.779927+0000", 2024-02-10T08:32:04.717 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7289999999999997e-06 2024-02-10T08:32:04.717 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.717 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.717 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:32:04.717 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.779933+0000", 2024-02-10T08:32:04.717 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8353000000000003e-05 2024-02-10T08:32:04.717 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.717 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.717 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:32:04.717 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.779982+0000", 2024-02-10T08:32:04.717 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9389999999999997e-06 2024-02-10T08:32:04.717 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.717 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.717 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:32:04.717 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.779990+0000", 2024-02-10T08:32:04.718 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.97681177500000005 2024-02-10T08:32:04.718 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.718 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.718 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:32:04.718 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.756801+0000", 2024-02-10T08:32:04.718 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5612999999999995e-05 2024-02-10T08:32:04.718 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.718 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.718 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:32:04.718 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.756887+0000", 2024-02-10T08:32:04.718 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000127556 2024-02-10T08:32:04.718 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.718 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.718 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,5", 2024-02-10T08:32:04.718 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.757014+0000", 2024-02-10T08:32:04.718 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0064331609999999997 2024-02-10T08:32:04.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.719 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.719 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:32:04.719 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.763448+0000", 2024-02-10T08:32:04.719 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000101436 2024-02-10T08:32:04.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.719 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.719 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:32:04.719 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.763549+0000", 2024-02-10T08:32:04.719 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0086278940000000005 2024-02-10T08:32:04.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.719 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.719 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:32:04.719 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.772177+0000", 2024-02-10T08:32:04.719 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5106999999999999e-05 2024-02-10T08:32:04.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.720 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.720 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:32:04.720 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.772232+0000", 2024-02-10T08:32:04.720 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4549999999999999e-05 2024-02-10T08:32:04.720 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.720 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.720 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:32:04.720 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.772277+0000", 2024-02-10T08:32:04.720 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.99236875400000002 2024-02-10T08:32:04.720 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:32:04.720 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:32:04.720 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:32:04.720 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.720 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.721 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14964.0:248129 8.2 8:452c0cb6:::benchmark_data_smithi018_103312_object123697:head [delete] snapc 0=[] ondisk+write+known_if_redirected e246)", 2024-02-10T08:32:04.721 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:28:05.791081+0000", 2024-02-10T08:32:04.721 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 238.85831271199999, 2024-02-10T08:32:04.721 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.98137006800000004, 2024-02-10T08:32:04.721 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:32:04.721 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:32:04.721 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:32:04.721 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14964", 2024-02-10T08:32:04.721 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3173131962", 2024-02-10T08:32:04.721 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 248129 2024-02-10T08:32:04.721 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.721 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:32:04.721 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.721 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:32:04.721 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.791081+0000", 2024-02-10T08:32:04.721 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:32:04.721 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.722 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.722 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:32:04.722 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.791081+0000", 2024-02-10T08:32:04.722 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999981 2024-02-10T08:32:04.722 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.722 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.722 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:32:04.722 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.791079+0000", 2024-02-10T08:32:04.722 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3000000000000007e-06 2024-02-10T08:32:04.722 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.722 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.722 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:32:04.722 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.791088+0000", 2024-02-10T08:32:04.722 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5789000000000001e-05 2024-02-10T08:32:04.722 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.722 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.722 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:32:04.723 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.791104+0000", 2024-02-10T08:32:04.723 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9880000000000004e-06 2024-02-10T08:32:04.723 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.723 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.723 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:32:04.723 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.791112+0000", 2024-02-10T08:32:04.723 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9119999999999997e-05 2024-02-10T08:32:04.723 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.723 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.723 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:32:04.723 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.791161+0000", 2024-02-10T08:32:04.723 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.61e-06 2024-02-10T08:32:04.723 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.723 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.723 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:32:04.723 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.791169+0000", 2024-02-10T08:32:04.723 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.967802096 2024-02-10T08:32:04.724 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.724 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.724 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:32:04.724 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.758971+0000", 2024-02-10T08:32:04.724 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012134 2024-02-10T08:32:04.724 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.724 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.724 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:32:04.724 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.759092+0000", 2024-02-10T08:32:04.724 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000166587 2024-02-10T08:32:04.724 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.724 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.724 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,5", 2024-02-10T08:32:04.724 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.759259+0000", 2024-02-10T08:32:04.724 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0042996700000000002 2024-02-10T08:32:04.724 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.724 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.725 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:32:04.725 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.763558+0000", 2024-02-10T08:32:04.725 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0042235479999999997 2024-02-10T08:32:04.725 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.725 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.725 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:32:04.725 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.767782+0000", 2024-02-10T08:32:04.725 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00458348 2024-02-10T08:32:04.725 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.725 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.725 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:32:04.725 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.772365+0000", 2024-02-10T08:32:04.725 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2488999999999999e-05 2024-02-10T08:32:04.725 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.725 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.725 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:32:04.725 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.772408+0000", 2024-02-10T08:32:04.726 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3130999999999998e-05 2024-02-10T08:32:04.726 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.726 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.726 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:32:04.726 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.772451+0000", 2024-02-10T08:32:04.726 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.98137006800000004 2024-02-10T08:32:04.726 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:32:04.726 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:32:04.726 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:32:04.726 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.726 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.726 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14964.0:248131 8.2 8:47baaa1d:::benchmark_data_smithi018_103312_object123699:head [delete] snapc 0=[] ondisk+write+known_if_redirected e246)", 2024-02-10T08:32:04.726 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:28:05.791610+0000", 2024-02-10T08:32:04.726 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 238.85778327099999, 2024-02-10T08:32:04.726 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.980974915, 2024-02-10T08:32:04.726 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:32:04.727 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:32:04.727 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:32:04.727 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14964", 2024-02-10T08:32:04.727 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3173131962", 2024-02-10T08:32:04.727 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 248131 2024-02-10T08:32:04.727 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.727 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:32:04.727 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.727 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:32:04.727 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.791610+0000", 2024-02-10T08:32:04.727 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:32:04.727 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.727 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.727 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:32:04.727 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.791610+0000", 2024-02-10T08:32:04.727 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-02-10T08:32:04.728 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.728 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.728 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:32:04.728 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.791609+0000", 2024-02-10T08:32:04.728 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6760000000000007e-06 2024-02-10T08:32:04.728 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.728 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.728 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:32:04.728 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.791617+0000", 2024-02-10T08:32:04.728 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7079999999999992e-06 2024-02-10T08:32:04.728 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.728 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.728 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:32:04.729 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.791627+0000", 2024-02-10T08:32:04.729 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.541e-06 2024-02-10T08:32:04.729 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.729 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.729 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:32:04.729 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.791632+0000", 2024-02-10T08:32:04.729 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8720000000000002e-05 2024-02-10T08:32:04.729 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.729 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.729 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:32:04.729 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.791671+0000", 2024-02-10T08:32:04.729 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4399999999999999e-06 2024-02-10T08:32:04.729 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.729 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.729 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:32:04.730 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.791679+0000", 2024-02-10T08:32:04.730 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.96969679900000005 2024-02-10T08:32:04.730 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.730 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.730 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:32:04.730 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.761375+0000", 2024-02-10T08:32:04.730 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1136000000000004e-05 2024-02-10T08:32:04.730 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.730 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.730 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:32:04.730 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.761456+0000", 2024-02-10T08:32:04.730 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5643999999999994e-05 2024-02-10T08:32:04.730 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.730 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.730 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,5", 2024-02-10T08:32:04.730 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.761552+0000", 2024-02-10T08:32:04.731 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0062639540000000004 2024-02-10T08:32:04.731 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.731 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.731 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:32:04.731 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.767816+0000", 2024-02-10T08:32:04.731 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2410000000000003e-06 2024-02-10T08:32:04.731 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.731 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.731 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:32:04.731 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.767821+0000", 2024-02-10T08:32:04.731 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0046872989999999998 2024-02-10T08:32:04.731 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.731 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.731 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:32:04.731 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.772509+0000", 2024-02-10T08:32:04.731 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8896999999999997e-05 2024-02-10T08:32:04.732 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.732 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.732 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:32:04.732 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.772548+0000", 2024-02-10T08:32:04.732 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7755e-05 2024-02-10T08:32:04.732 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.732 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.732 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:32:04.732 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.772585+0000", 2024-02-10T08:32:04.732 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.980974915 2024-02-10T08:32:04.732 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:32:04.732 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:32:04.732 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:32:04.732 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.732 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.732 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14964.0:248132 8.2 8:466b5f6d:::benchmark_data_smithi018_103312_object123700:head [delete] snapc 0=[] ondisk+write+known_if_redirected e246)", 2024-02-10T08:32:04.733 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:28:05.792646+0000", 2024-02-10T08:32:04.733 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 238.85674711799999, 2024-02-10T08:32:04.733 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.98001702000000002, 2024-02-10T08:32:04.733 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:32:04.733 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:32:04.733 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:32:04.733 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14964", 2024-02-10T08:32:04.733 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3173131962", 2024-02-10T08:32:04.733 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 248132 2024-02-10T08:32:04.733 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.733 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:32:04.733 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.733 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:32:04.733 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.792646+0000", 2024-02-10T08:32:04.733 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:32:04.733 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.733 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.734 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:32:04.734 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.792646+0000", 2024-02-10T08:32:04.734 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-02-10T08:32:04.734 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.734 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.734 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:32:04.734 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.792645+0000", 2024-02-10T08:32:04.734 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7680000000000003e-06 2024-02-10T08:32:04.734 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.734 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.734 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:32:04.734 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.792652+0000", 2024-02-10T08:32:04.734 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4893999999999999e-05 2024-02-10T08:32:04.734 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.734 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.734 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:32:04.734 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.792677+0000", 2024-02-10T08:32:04.735 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9406999999999999e-05 2024-02-10T08:32:04.735 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.735 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.735 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:32:04.735 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.792696+0000", 2024-02-10T08:32:04.735 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2664999999999999e-05 2024-02-10T08:32:04.735 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.735 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.735 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:32:04.735 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.792739+0000", 2024-02-10T08:32:04.735 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8729999999999996e-06 2024-02-10T08:32:04.735 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.735 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.735 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:32:04.735 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.792748+0000", 2024-02-10T08:32:04.735 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.97084718299999995 2024-02-10T08:32:04.735 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.736 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.736 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:32:04.736 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.763595+0000", 2024-02-10T08:32:04.736 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000118204 2024-02-10T08:32:04.736 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.736 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.736 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:32:04.736 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.763713+0000", 2024-02-10T08:32:04.736 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000132204 2024-02-10T08:32:04.736 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.736 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.736 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,5", 2024-02-10T08:32:04.736 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.763846+0000", 2024-02-10T08:32:04.736 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0039800360000000002 2024-02-10T08:32:04.736 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.736 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.736 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:32:04.737 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.767826+0000", 2024-02-10T08:32:04.737 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013412799999999999 2024-02-10T08:32:04.737 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.737 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.737 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:32:04.737 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.767960+0000", 2024-02-10T08:32:04.737 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.004659168 2024-02-10T08:32:04.737 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.737 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.737 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:32:04.737 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.772619+0000", 2024-02-10T08:32:04.737 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2050000000000001e-05 2024-02-10T08:32:04.737 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.737 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.737 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:32:04.737 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.772641+0000", 2024-02-10T08:32:04.737 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2549999999999999e-05 2024-02-10T08:32:04.738 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.738 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.738 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:32:04.738 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.772664+0000", 2024-02-10T08:32:04.738 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.98001702000000002 2024-02-10T08:32:04.738 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:32:04.738 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:32:04.738 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:32:04.738 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.738 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.738 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14964.0:248144 8.2 8:4f90dedb:::benchmark_data_smithi018_103312_object123712:head [delete] snapc 0=[] ondisk+write+known_if_redirected e246)", 2024-02-10T08:32:04.738 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:28:05.802281+0000", 2024-02-10T08:32:04.738 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 238.847112845, 2024-02-10T08:32:04.738 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.97045722099999998, 2024-02-10T08:32:04.738 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:32:04.738 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:32:04.739 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:32:04.739 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14964", 2024-02-10T08:32:04.739 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3173131962", 2024-02-10T08:32:04.739 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 248144 2024-02-10T08:32:04.739 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.739 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:32:04.739 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.739 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:32:04.739 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.802281+0000", 2024-02-10T08:32:04.739 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:32:04.739 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.739 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.739 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:32:04.739 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.802281+0000", 2024-02-10T08:32:04.739 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-02-10T08:32:04.739 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.740 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.740 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:32:04.740 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.802280+0000", 2024-02-10T08:32:04.740 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6210000000000001e-06 2024-02-10T08:32:04.740 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.740 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.740 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:32:04.740 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.802284+0000", 2024-02-10T08:32:04.740 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1051e-05 2024-02-10T08:32:04.740 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.740 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.740 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:32:04.740 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.802295+0000", 2024-02-10T08:32:04.740 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3449999999999999e-06 2024-02-10T08:32:04.740 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.740 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.741 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:32:04.741 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.802299+0000", 2024-02-10T08:32:04.741 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4619999999999997e-05 2024-02-10T08:32:04.741 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.741 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.741 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:32:04.741 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.802334+0000", 2024-02-10T08:32:04.741 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9179999999999999e-06 2024-02-10T08:32:04.741 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.741 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.741 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:32:04.741 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.802340+0000", 2024-02-10T08:32:04.741 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.96321955400000003 2024-02-10T08:32:04.741 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.741 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.741 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:32:04.742 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.765559+0000", 2024-02-10T08:32:04.742 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010735599999999999 2024-02-10T08:32:04.742 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.742 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.742 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:32:04.742 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.765667+0000", 2024-02-10T08:32:04.742 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012933399999999999 2024-02-10T08:32:04.742 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.742 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.742 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,5", 2024-02-10T08:32:04.742 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.765796+0000", 2024-02-10T08:32:04.742 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022901380000000002 2024-02-10T08:32:04.742 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.742 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.742 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:32:04.742 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.768086+0000", 2024-02-10T08:32:04.742 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0620000000000002e-06 2024-02-10T08:32:04.743 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.743 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.743 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:32:04.743 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.768090+0000", 2024-02-10T08:32:04.743 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0046063450000000004 2024-02-10T08:32:04.743 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.743 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.743 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:32:04.743 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.772696+0000", 2024-02-10T08:32:04.743 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1688999999999999e-05 2024-02-10T08:32:04.743 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.743 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.743 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:32:04.743 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.772718+0000", 2024-02-10T08:32:04.743 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9809e-05 2024-02-10T08:32:04.743 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.743 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.744 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:32:04.744 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.772738+0000", 2024-02-10T08:32:04.744 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.97045722099999998 2024-02-10T08:32:04.744 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:32:04.744 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:32:04.744 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:32:04.744 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.744 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.744 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14964.0:248182 8.2 8:4f280a8e:::benchmark_data_smithi018_103312_object123750:head [delete] snapc 0=[] ondisk+write+known_if_redirected e246)", 2024-02-10T08:32:04.744 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:28:05.841816+0000", 2024-02-10T08:32:04.744 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 238.80757736499999, 2024-02-10T08:32:04.744 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.94176548999999998, 2024-02-10T08:32:04.744 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:32:04.744 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:32:04.745 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:32:04.745 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14964", 2024-02-10T08:32:04.745 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3173131962", 2024-02-10T08:32:04.745 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 248182 2024-02-10T08:32:04.745 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.745 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:32:04.745 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.745 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:32:04.745 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.841816+0000", 2024-02-10T08:32:04.745 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:32:04.745 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.745 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.745 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:32:04.745 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.841816+0000", 2024-02-10T08:32:04.745 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-02-10T08:32:04.745 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.745 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.746 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:32:04.746 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.841816+0000", 2024-02-10T08:32:04.746 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.805e-06 2024-02-10T08:32:04.746 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.746 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.746 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:32:04.746 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.841819+0000", 2024-02-10T08:32:04.746 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4107999999999999e-05 2024-02-10T08:32:04.746 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.746 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.746 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:32:04.746 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.841833+0000", 2024-02-10T08:32:04.746 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2329999999999997e-06 2024-02-10T08:32:04.746 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.746 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.746 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:32:04.746 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.841839+0000", 2024-02-10T08:32:04.746 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2190999999999997e-05 2024-02-10T08:32:04.747 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.747 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.747 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:32:04.747 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.841871+0000", 2024-02-10T08:32:04.747 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7100000000000004e-06 2024-02-10T08:32:04.747 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.747 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.747 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:32:04.747 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:05.841877+0000", 2024-02-10T08:32:04.747 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.92622769500000002 2024-02-10T08:32:04.747 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.747 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.747 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:32:04.747 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.768104+0000", 2024-02-10T08:32:04.747 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000116035 2024-02-10T08:32:04.748 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.748 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.748 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:32:04.748 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.768220+0000", 2024-02-10T08:32:04.748 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000117858 2024-02-10T08:32:04.748 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.748 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.748 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,5", 2024-02-10T08:32:04.748 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.768338+0000", 2024-02-10T08:32:04.748 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0039479229999999999 2024-02-10T08:32:04.748 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.748 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.748 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:32:04.748 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.772286+0000", 2024-02-10T08:32:04.749 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6256e-05 2024-02-10T08:32:04.749 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.749 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.749 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:32:04.749 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.772322+0000", 2024-02-10T08:32:04.749 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011191141 2024-02-10T08:32:04.749 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.749 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.749 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:32:04.749 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.783514+0000", 2024-02-10T08:32:04.749 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2993000000000001e-05 2024-02-10T08:32:04.749 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.749 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.749 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:32:04.749 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.783547+0000", 2024-02-10T08:32:04.749 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5218000000000001e-05 2024-02-10T08:32:04.750 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.750 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.750 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:32:04.750 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:28:06.783582+0000", 2024-02-10T08:32:04.750 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.94176548999999998 2024-02-10T08:32:04.750 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:32:04.750 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:32:04.750 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:32:04.750 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.750 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.750 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.15198.0:218359 9.c 9:3565ed86:::benchmark_data_smithi018_124176_object96620:head [delete] snapc 0=[] ondisk+write+known_if_redirected e315)", 2024-02-10T08:32:04.750 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:31:41.643234+0000", 2024-02-10T08:32:04.750 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 23.006159932999999, 2024-02-10T08:32:04.750 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.073151486000000002, 2024-02-10T08:32:04.750 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:32:04.751 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:32:04.751 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:32:04.751 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:32:04.752 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.15198", 2024-02-10T08:32:04.752 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/1957604827", 2024-02-10T08:32:04.752 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 218359 2024-02-10T08:32:04.752 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.752 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:32:04.752 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.752 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:32:04.752 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:41.643234+0000", 2024-02-10T08:32:04.752 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:32:04.752 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.752 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.752 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:32:04.753 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:41.643234+0000", 2024-02-10T08:32:04.753 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999981 2024-02-10T08:32:04.753 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.753 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.753 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:32:04.753 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:41.643232+0000", 2024-02-10T08:32:04.753 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8440000000000004e-06 2024-02-10T08:32:04.753 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.753 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.753 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:32:04.753 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:41.643240+0000", 2024-02-10T08:32:04.753 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2882e-05 2024-02-10T08:32:04.753 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.753 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.753 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:32:04.753 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:41.643253+0000", 2024-02-10T08:32:04.754 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.605e-06 2024-02-10T08:32:04.754 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.754 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.754 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:32:04.754 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:41.643261+0000", 2024-02-10T08:32:04.754 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7117999999999998e-05 2024-02-10T08:32:04.754 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.754 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.754 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:32:04.754 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:41.643308+0000", 2024-02-10T08:32:04.754 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011086099999999999 2024-02-10T08:32:04.754 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.754 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.754 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:32:04.754 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:41.643419+0000", 2024-02-10T08:32:04.754 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013967600000000001 2024-02-10T08:32:04.754 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.755 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.755 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3,7", 2024-02-10T08:32:04.755 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:41.643559+0000", 2024-02-10T08:32:04.755 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0058010140000000002 2024-02-10T08:32:04.755 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.755 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.755 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:32:04.755 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:41.649360+0000", 2024-02-10T08:32:04.755 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0076843909999999996 2024-02-10T08:32:04.755 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.755 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.755 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:32:04.755 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:41.657044+0000", 2024-02-10T08:32:04.755 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.059238818999999998 2024-02-10T08:32:04.755 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.755 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.755 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:32:04.756 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:41.716283+0000", 2024-02-10T08:32:04.756 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5353999999999999e-05 2024-02-10T08:32:04.756 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.756 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.756 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:32:04.756 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:41.716338+0000", 2024-02-10T08:32:04.756 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6978000000000003e-05 2024-02-10T08:32:04.756 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.756 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.756 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:32:04.756 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:41.716385+0000", 2024-02-10T08:32:04.756 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.073151486000000002 2024-02-10T08:32:04.756 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:32:04.756 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:32:04.756 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:32:04.756 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.757 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.757 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.15198.0:218362 9.c 9:3ac7260d:::benchmark_data_smithi018_124176_object96623:head [delete] snapc 0=[] ondisk+write+known_if_redirected e315)", 2024-02-10T08:32:04.757 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:31:41.644240+0000", 2024-02-10T08:32:04.757 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 23.005153428, 2024-02-10T08:32:04.757 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.076467283999999996, 2024-02-10T08:32:04.757 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:32:04.757 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:32:04.757 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:32:04.757 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.15198", 2024-02-10T08:32:04.757 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/1957604827", 2024-02-10T08:32:04.757 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 218362 2024-02-10T08:32:04.757 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.757 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:32:04.757 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.757 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:32:04.757 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:41.644240+0000", 2024-02-10T08:32:04.757 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:32:04.758 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.758 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.758 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:32:04.758 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:41.644240+0000", 2024-02-10T08:32:04.758 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-02-10T08:32:04.758 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.758 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.758 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:32:04.758 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:41.644239+0000", 2024-02-10T08:32:04.758 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9800000000000003e-06 2024-02-10T08:32:04.758 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.758 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.758 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:32:04.758 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:41.644245+0000", 2024-02-10T08:32:04.758 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5210000000000008e-06 2024-02-10T08:32:04.758 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.759 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.759 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:32:04.759 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:41.644255+0000", 2024-02-10T08:32:04.759 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7440000000000004e-06 2024-02-10T08:32:04.759 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.759 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.759 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:32:04.759 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:41.644260+0000", 2024-02-10T08:32:04.759 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022867249999999999 2024-02-10T08:32:04.759 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.759 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.759 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:32:04.759 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:41.646547+0000", 2024-02-10T08:32:04.759 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000110258 2024-02-10T08:32:04.759 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.760 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.760 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:32:04.760 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:41.646657+0000", 2024-02-10T08:32:04.760 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012619199999999999 2024-02-10T08:32:04.760 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.760 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.760 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3,7", 2024-02-10T08:32:04.760 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:41.646784+0000", 2024-02-10T08:32:04.760 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0055066589999999997 2024-02-10T08:32:04.760 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.760 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.760 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:32:04.760 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:41.652290+0000", 2024-02-10T08:32:04.760 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0047879369999999999 2024-02-10T08:32:04.760 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.760 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.761 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:32:04.761 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:41.657078+0000", 2024-02-10T08:32:04.761 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063532459999999999 2024-02-10T08:32:04.761 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.761 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.761 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:32:04.761 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:41.720611+0000", 2024-02-10T08:32:04.761 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4106e-05 2024-02-10T08:32:04.761 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.761 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.761 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:32:04.761 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:41.720665+0000", 2024-02-10T08:32:04.761 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2657999999999997e-05 2024-02-10T08:32:04.761 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.761 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.761 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:32:04.761 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:41.720707+0000", 2024-02-10T08:32:04.761 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.076467283999999996 2024-02-10T08:32:04.762 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:32:04.762 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:32:04.762 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:32:04.762 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.762 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.762 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.15198.0:218364 9.c 9:31e83f45:::benchmark_data_smithi018_124176_object96625:head [delete] snapc 0=[] ondisk+write+known_if_redirected e315)", 2024-02-10T08:32:04.762 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:31:41.648190+0000", 2024-02-10T08:32:04.762 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 23.001203599, 2024-02-10T08:32:04.762 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.072616310000000003, 2024-02-10T08:32:04.762 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:32:04.762 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:32:04.762 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:32:04.762 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.15198", 2024-02-10T08:32:04.762 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/1957604827", 2024-02-10T08:32:04.762 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 218364 2024-02-10T08:32:04.762 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.762 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:32:04.763 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.763 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:32:04.763 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:41.648190+0000", 2024-02-10T08:32:04.763 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:32:04.763 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.763 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.763 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:32:04.763 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:41.648190+0000", 2024-02-10T08:32:04.763 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999981 2024-02-10T08:32:04.763 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.763 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.763 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:32:04.763 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:41.648188+0000", 2024-02-10T08:32:04.763 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2090000000000005e-06 2024-02-10T08:32:04.763 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.763 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.763 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:32:04.764 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:41.648196+0000", 2024-02-10T08:32:04.764 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1276e-05 2024-02-10T08:32:04.764 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.764 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.764 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:32:04.764 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:41.648208+0000", 2024-02-10T08:32:04.764 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7039999999999997e-06 2024-02-10T08:32:04.764 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.764 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.764 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:32:04.764 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:41.648214+0000", 2024-02-10T08:32:04.764 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001169467 2024-02-10T08:32:04.764 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.764 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.764 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:32:04.765 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:41.649384+0000", 2024-02-10T08:32:04.765 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000103657 2024-02-10T08:32:04.765 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.765 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.765 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:32:04.765 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:41.649487+0000", 2024-02-10T08:32:04.765 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115807 2024-02-10T08:32:04.765 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.765 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.765 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3,7", 2024-02-10T08:32:04.765 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:41.649603+0000", 2024-02-10T08:32:04.765 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0064039170000000003 2024-02-10T08:32:04.765 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.765 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.765 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:32:04.765 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:41.656007+0000", 2024-02-10T08:32:04.765 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001107036 2024-02-10T08:32:04.766 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.766 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.766 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:32:04.766 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:41.657114+0000", 2024-02-10T08:32:04.766 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063640062999999997 2024-02-10T08:32:04.766 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.766 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.766 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:32:04.766 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:41.720754+0000", 2024-02-10T08:32:04.766 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9039000000000001e-05 2024-02-10T08:32:04.766 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.766 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.766 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:32:04.766 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:41.720783+0000", 2024-02-10T08:32:04.766 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3110999999999999e-05 2024-02-10T08:32:04.766 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.766 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.767 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:32:04.767 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:41.720806+0000", 2024-02-10T08:32:04.767 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.072616310000000003 2024-02-10T08:32:04.767 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:32:04.767 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:32:04.767 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:32:04.767 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.767 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.767 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.15198.0:220380 9.c 9:3ce344e7:::benchmark_data_smithi018_124176_object98641:head [delete] snapc 0=[] ondisk+write+known_if_redirected e315)", 2024-02-10T08:32:04.767 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:31:44.009846+0000", 2024-02-10T08:32:04.767 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 20.639547666999999, 2024-02-10T08:32:04.767 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.078732475999999996, 2024-02-10T08:32:04.767 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:32:04.767 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:32:04.767 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:32:04.767 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.15198", 2024-02-10T08:32:04.767 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/1957604827", 2024-02-10T08:32:04.768 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 220380 2024-02-10T08:32:04.768 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.768 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:32:04.768 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.768 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:32:04.768 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:44.009846+0000", 2024-02-10T08:32:04.768 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:32:04.768 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.768 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.768 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:32:04.768 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:44.009846+0000", 2024-02-10T08:32:04.768 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-02-10T08:32:04.768 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.768 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.768 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:32:04.769 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:44.009846+0000", 2024-02-10T08:32:04.769 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6529999999999998e-06 2024-02-10T08:32:04.769 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.769 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.769 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:32:04.769 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:44.009848+0000", 2024-02-10T08:32:04.769 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7400000000000004e-06 2024-02-10T08:32:04.769 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.769 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.769 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:32:04.769 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:44.009853+0000", 2024-02-10T08:32:04.769 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6459999999999999e-06 2024-02-10T08:32:04.769 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.769 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.769 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:32:04.769 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:44.009857+0000", 2024-02-10T08:32:04.769 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027694030000000001 2024-02-10T08:32:04.770 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.770 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.770 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:32:04.770 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:44.012626+0000", 2024-02-10T08:32:04.770 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000103176 2024-02-10T08:32:04.770 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.770 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.770 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:32:04.770 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:44.012729+0000", 2024-02-10T08:32:04.770 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012880500000000001 2024-02-10T08:32:04.770 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.770 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.770 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3,7", 2024-02-10T08:32:04.770 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:44.012858+0000", 2024-02-10T08:32:04.770 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0057026780000000001 2024-02-10T08:32:04.770 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.771 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.771 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:32:04.771 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:44.018561+0000", 2024-02-10T08:32:04.771 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010127280000000001 2024-02-10T08:32:04.771 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.771 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.771 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:32:04.771 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:44.028688+0000", 2024-02-10T08:32:04.771 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.059797322999999999 2024-02-10T08:32:04.771 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.771 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.771 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:32:04.771 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:44.088485+0000", 2024-02-10T08:32:04.771 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1517999999999997e-05 2024-02-10T08:32:04.771 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.771 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.771 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:32:04.772 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:44.088537+0000", 2024-02-10T08:32:04.772 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1699000000000002e-05 2024-02-10T08:32:04.772 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:32:04.772 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:32:04.772 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:32:04.772 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:44.088578+0000", 2024-02-10T08:32:04.772 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.078732475999999996 2024-02-10T08:32:04.772 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:32:04.772 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:32:04.772 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:32:04.772 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:32:04.772 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:32:04.772 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-02-10T08:32:04.823 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:04.985 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:32:04.996 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:04.997 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:32:05.098 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:32:05.150 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:05.371 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:32:05.376 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:05.377 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:32:05.477 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:32:05.518 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.0 dump_ops_in_flight 2024-02-10T08:32:05.574 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:05.610 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:32:05.622 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:05.622 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:32:05.723 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:32:05.753 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:05.783 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:32:05.786 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:05.787 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:32:05.887 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:32:05.922 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:32:05.923 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:05.949 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:32:05.955 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:05.956 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:32:06.057 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:32:06.106 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:06.221 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:32:06.225 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:06.226 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:32:06.256 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:32:06.327 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:32:06.379 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:04.942513+0000 mgr.y (mgr.14505) 576 : cluster [DBG] pgmap v705: 168 pgs: 1 active+remapped+backfill_wait, 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 163 active+clean; 410 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.08k op/s; 1823/20241 objects misplaced (9.006%); 1.8 MiB/s, 28 objects/s recovering 2024-02-10T08:32:06.379 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:32:05.191938+0000 mon.a (mon.0) 1463 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:32:06.379 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:32:05.787899+0000 mon.a (mon.0) 1464 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:32:06.379 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:32:05.789115+0000 mon.a (mon.0) 1465 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:32:06.379 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:32:05.825190+0000 mon.a (mon.0) 1466 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:32:06.380 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:05.837787+0000 mon.a (mon.0) 1467 : cluster [DBG] osdmap e323: 8 total, 8 up, 8 in 2024-02-10T08:32:06.380 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:32:06.058523+0000 mon.a (mon.0) 1468 : audit [INF] from='client.? 172.21.15.18:0/2042386732' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]: dispatch 2024-02-10T08:32:06.380 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:04.942513+0000 mgr.y (mgr.14505) 576 : cluster [DBG] pgmap v705: 168 pgs: 1 active+remapped+backfill_wait, 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 163 active+clean; 410 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.08k op/s; 1823/20241 objects misplaced (9.006%); 1.8 MiB/s, 28 objects/s recovering 2024-02-10T08:32:06.380 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:32:05.191938+0000 mon.a (mon.0) 1463 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:32:06.380 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:32:05.787899+0000 mon.a (mon.0) 1464 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:32:06.380 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:32:05.789115+0000 mon.a (mon.0) 1465 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:32:06.380 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:32:05.825190+0000 mon.a (mon.0) 1466 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:32:06.380 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:05.837787+0000 mon.a (mon.0) 1467 : cluster [DBG] osdmap e323: 8 total, 8 up, 8 in 2024-02-10T08:32:06.381 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:32:06.058523+0000 mon.a (mon.0) 1468 : audit [INF] from='client.? 172.21.15.18:0/2042386732' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]: dispatch 2024-02-10T08:32:06.384 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:06.521 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:04.942513+0000 mgr.y (mgr.14505) 576 : cluster [DBG] pgmap v705: 168 pgs: 1 active+remapped+backfill_wait, 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 163 active+clean; 410 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.08k op/s; 1823/20241 objects misplaced (9.006%); 1.8 MiB/s, 28 objects/s recovering 2024-02-10T08:32:06.521 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:32:05.191938+0000 mon.a (mon.0) 1463 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:32:06.521 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:32:05.787899+0000 mon.a (mon.0) 1464 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:32:06.522 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:32:05.789115+0000 mon.a (mon.0) 1465 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:32:06.522 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:32:05.825190+0000 mon.a (mon.0) 1466 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:32:06.522 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:05.837787+0000 mon.a (mon.0) 1467 : cluster [DBG] osdmap e323: 8 total, 8 up, 8 in 2024-02-10T08:32:06.522 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:32:06.058523+0000 mon.a (mon.0) 1468 : audit [INF] from='client.? 172.21.15.18:0/2042386732' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]: dispatch 2024-02-10T08:32:06.522 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:32:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:32:06] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:32:06.872 INFO:teuthology.orchestra.run.smithi018.stderr:reweighted osd.6 to 1 (10000) 2024-02-10T08:32:07.012 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-10T08:32:07.157 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:32:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:32:07] "GET /metrics HTTP/1.1" 200 176242 "" "Prometheus/2.33.4" 2024-02-10T08:32:08.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:32:06.850029+0000 mon.a (mon.0) 1469 : audit [INF] from='client.? 172.21.15.18:0/2042386732' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]': finished 2024-02-10T08:32:08.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:06.850083+0000 mon.a (mon.0) 1470 : cluster [DBG] osdmap e324: 8 total, 8 up, 8 in 2024-02-10T08:32:08.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:06.942958+0000 mgr.y (mgr.14505) 577 : cluster [DBG] pgmap v708: 168 pgs: 1 active+remapped+backfill_wait, 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 163 active+clean; 390 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 735 op/s; 1823/19314 objects misplaced (9.439%); 1.2 MiB/s, 19 objects/s recovering 2024-02-10T08:32:08.160 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:32:06.850029+0000 mon.a (mon.0) 1469 : audit [INF] from='client.? 172.21.15.18:0/2042386732' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]': finished 2024-02-10T08:32:08.160 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:06.850083+0000 mon.a (mon.0) 1470 : cluster [DBG] osdmap e324: 8 total, 8 up, 8 in 2024-02-10T08:32:08.160 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:06.942958+0000 mgr.y (mgr.14505) 577 : cluster [DBG] pgmap v708: 168 pgs: 1 active+remapped+backfill_wait, 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 163 active+clean; 390 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 735 op/s; 1823/19314 objects misplaced (9.439%); 1.2 MiB/s, 19 objects/s recovering 2024-02-10T08:32:08.164 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:32:08.172 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:08.172 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:32:08.273 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:32:08.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:32:06.850029+0000 mon.a (mon.0) 1469 : audit [INF] from='client.? 172.21.15.18:0/2042386732' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]': finished 2024-02-10T08:32:08.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:06.850083+0000 mon.a (mon.0) 1470 : cluster [DBG] osdmap e324: 8 total, 8 up, 8 in 2024-02-10T08:32:08.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:06.942958+0000 mgr.y (mgr.14505) 577 : cluster [DBG] pgmap v708: 168 pgs: 1 active+remapped+backfill_wait, 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 163 active+clean; 390 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 735 op/s; 1823/19314 objects misplaced (9.439%); 1.2 MiB/s, 19 objects/s recovering 2024-02-10T08:32:08.305 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:08.333 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:32:08.336 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:08.337 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:32:08.437 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:32:08.489 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:08.534 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:32:08.536 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:08.537 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:32:08.637 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:32:08.712 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:08.789 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:32:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:32:08.817 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:32:08.826 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:08.826 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:32:08.927 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:32:08.997 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:09.030 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:32:09.036 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:09.036 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:32:09.137 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:32:09.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:32:08.444527+0000 mgr.y (mgr.14505) 578 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:32:09.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:32:08.444527+0000 mgr.y (mgr.14505) 578 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:32:09.188 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:09.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:32:08.444527+0000 mgr.y (mgr.14505) 578 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:32:10.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:08.943722+0000 mgr.y (mgr.14505) 579 : cluster [DBG] pgmap v709: 168 pgs: 1 active+remapped+backfill_wait, 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 163 active+clean; 130 MiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1.26k op/s; 523/6807 objects misplaced (7.683%); 2.1 MiB/s, 34 objects/s recovering 2024-02-10T08:32:10.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:08.943722+0000 mgr.y (mgr.14505) 579 : cluster [DBG] pgmap v709: 168 pgs: 1 active+remapped+backfill_wait, 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 163 active+clean; 130 MiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1.26k op/s; 523/6807 objects misplaced (7.683%); 2.1 MiB/s, 34 objects/s recovering 2024-02-10T08:32:10.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:08.943722+0000 mgr.y (mgr.14505) 579 : cluster [DBG] pgmap v709: 168 pgs: 1 active+remapped+backfill_wait, 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 163 active+clean; 130 MiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1.26k op/s; 523/6807 objects misplaced (7.683%); 2.1 MiB/s, 34 objects/s recovering 2024-02-10T08:32:10.870 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Removed 121736 objects 2024-02-10T08:32:10.871 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Clean up completed and total clean up time :122.693 2024-02-10T08:32:11.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:09.881774+0000 mon.a (mon.0) 1471 : cluster [DBG] osdmap e325: 8 total, 8 up, 8 in 2024-02-10T08:32:11.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:10.808488+0000 mon.a (mon.0) 1472 : cluster [DBG] osdmap e326: 8 total, 8 up, 8 in 2024-02-10T08:32:11.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:09.881774+0000 mon.a (mon.0) 1471 : cluster [DBG] osdmap e325: 8 total, 8 up, 8 in 2024-02-10T08:32:11.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:10.808488+0000 mon.a (mon.0) 1472 : cluster [DBG] osdmap e326: 8 total, 8 up, 8 in 2024-02-10T08:32:11.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:09.881774+0000 mon.a (mon.0) 1471 : cluster [DBG] osdmap e325: 8 total, 8 up, 8 in 2024-02-10T08:32:11.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:10.808488+0000 mon.a (mon.0) 1472 : cluster [DBG] osdmap e326: 8 total, 8 up, 8 in 2024-02-10T08:32:11.630 INFO:tasks.cephadm.ceph_manager.ceph:removing pool_name unique_pool_2 2024-02-10T08:32:11.630 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd pool rm unique_pool_2 unique_pool_2 --yes-i-really-really-mean-it 2024-02-10T08:32:11.940 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:10.498957+0000 osd.0 (osd.0) 149 : cluster [DBG] 9.9 scrub starts 2024-02-10T08:32:11.940 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:10.514951+0000 osd.0 (osd.0) 150 : cluster [DBG] 9.9 scrub ok 2024-02-10T08:32:11.940 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:10.944248+0000 mgr.y (mgr.14505) 580 : cluster [DBG] pgmap v712: 168 pgs: 1 active+remapped+backfill_wait, 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 163 active+clean; 113 MiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 1002 B/s rd, 0 B/s wr, 870 op/s; 523/6003 objects misplaced (8.712%); 1.4 MiB/s, 22 objects/s recovering 2024-02-10T08:32:11.940 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:11.138956+0000 osd.5 (osd.5) 183 : cluster [DBG] 5.15 scrub starts 2024-02-10T08:32:11.940 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:11.142506+0000 osd.5 (osd.5) 184 : cluster [DBG] 5.15 scrub ok 2024-02-10T08:32:11.940 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:11.200782+0000 osd.6 (osd.6) 153 : cluster [DBG] 9.b scrub starts 2024-02-10T08:32:11.940 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:11.212459+0000 osd.6 (osd.6) 154 : cluster [DBG] 9.b scrub ok 2024-02-10T08:32:11.940 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:11.281124+0000 osd.7 (osd.7) 179 : cluster [DBG] 2.b scrub starts 2024-02-10T08:32:11.940 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:11.282039+0000 osd.7 (osd.7) 180 : cluster [DBG] 2.b scrub ok 2024-02-10T08:32:11.940 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:11.817414+0000 mon.a (mon.0) 1473 : cluster [DBG] osdmap e327: 8 total, 8 up, 8 in 2024-02-10T08:32:11.941 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:10.498957+0000 osd.0 (osd.0) 149 : cluster [DBG] 9.9 scrub starts 2024-02-10T08:32:11.941 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:10.514951+0000 osd.0 (osd.0) 150 : cluster [DBG] 9.9 scrub ok 2024-02-10T08:32:11.941 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:10.944248+0000 mgr.y (mgr.14505) 580 : cluster [DBG] pgmap v712: 168 pgs: 1 active+remapped+backfill_wait, 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 163 active+clean; 113 MiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 1002 B/s rd, 0 B/s wr, 870 op/s; 523/6003 objects misplaced (8.712%); 1.4 MiB/s, 22 objects/s recovering 2024-02-10T08:32:11.941 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:11.138956+0000 osd.5 (osd.5) 183 : cluster [DBG] 5.15 scrub starts 2024-02-10T08:32:11.941 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:11.142506+0000 osd.5 (osd.5) 184 : cluster [DBG] 5.15 scrub ok 2024-02-10T08:32:11.941 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:11.200782+0000 osd.6 (osd.6) 153 : cluster [DBG] 9.b scrub starts 2024-02-10T08:32:11.941 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:11.212459+0000 osd.6 (osd.6) 154 : cluster [DBG] 9.b scrub ok 2024-02-10T08:32:11.941 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:11.281124+0000 osd.7 (osd.7) 179 : cluster [DBG] 2.b scrub starts 2024-02-10T08:32:11.941 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:11.282039+0000 osd.7 (osd.7) 180 : cluster [DBG] 2.b scrub ok 2024-02-10T08:32:11.941 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:11.817414+0000 mon.a (mon.0) 1473 : cluster [DBG] osdmap e327: 8 total, 8 up, 8 in 2024-02-10T08:32:11.952 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:32:11.955 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:11.955 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:32:11.966 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd reweight 7 1 2024-02-10T08:32:12.056 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:32:12.086 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:12.210 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:32:12.220 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:12.220 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:32:12.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:10.498957+0000 osd.0 (osd.0) 149 : cluster [DBG] 9.9 scrub starts 2024-02-10T08:32:12.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:10.514951+0000 osd.0 (osd.0) 150 : cluster [DBG] 9.9 scrub ok 2024-02-10T08:32:12.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:10.944248+0000 mgr.y (mgr.14505) 580 : cluster [DBG] pgmap v712: 168 pgs: 1 active+remapped+backfill_wait, 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 163 active+clean; 113 MiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 1002 B/s rd, 0 B/s wr, 870 op/s; 523/6003 objects misplaced (8.712%); 1.4 MiB/s, 22 objects/s recovering 2024-02-10T08:32:12.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:11.138956+0000 osd.5 (osd.5) 183 : cluster [DBG] 5.15 scrub starts 2024-02-10T08:32:12.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:11.142506+0000 osd.5 (osd.5) 184 : cluster [DBG] 5.15 scrub ok 2024-02-10T08:32:12.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:11.200782+0000 osd.6 (osd.6) 153 : cluster [DBG] 9.b scrub starts 2024-02-10T08:32:12.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:11.212459+0000 osd.6 (osd.6) 154 : cluster [DBG] 9.b scrub ok 2024-02-10T08:32:12.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:11.281124+0000 osd.7 (osd.7) 179 : cluster [DBG] 2.b scrub starts 2024-02-10T08:32:12.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:11.282039+0000 osd.7 (osd.7) 180 : cluster [DBG] 2.b scrub ok 2024-02-10T08:32:12.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:11.817414+0000 mon.a (mon.0) 1473 : cluster [DBG] osdmap e327: 8 total, 8 up, 8 in 2024-02-10T08:32:12.321 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:32:12.349 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:12.369 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:32:12.372 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:12.372 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:32:12.473 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:32:12.502 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:12.653 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:32:12.656 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:12.656 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:32:12.757 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:32:12.785 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:12.983 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:32:12.986 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:12.986 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:32:13.087 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:32:13.119 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:13.140 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:32:13.142 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:11.523217+0000 osd.2 (osd.2) 137 : cluster [DBG] 2.10 scrub starts 2024-02-10T08:32:13.142 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:11.524767+0000 osd.2 (osd.2) 138 : cluster [DBG] 2.10 scrub ok 2024-02-10T08:32:13.143 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:13.143 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:32:13.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:11.523217+0000 osd.2 (osd.2) 137 : cluster [DBG] 2.10 scrub starts 2024-02-10T08:32:13.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:11.524767+0000 osd.2 (osd.2) 138 : cluster [DBG] 2.10 scrub ok 2024-02-10T08:32:13.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:11.523217+0000 osd.2 (osd.2) 137 : cluster [DBG] 2.10 scrub starts 2024-02-10T08:32:13.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:11.524767+0000 osd.2 (osd.2) 138 : cluster [DBG] 2.10 scrub ok 2024-02-10T08:32:13.244 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:32:13.273 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:13.278 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-02-10T08:32:13.278 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-02-10T08:32:13.278 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-02-10T08:32:13.278 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-02-10T08:32:13.293 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:32:13.296 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:13.296 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:32:13.397 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:32:13.425 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:13.445 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:32:13.447 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:13.448 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:32:13.549 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:32:13.561 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:32:13.595 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:13.900 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is unset 2024-02-10T08:32:14.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:12.283290+0000 osd.4 (osd.4) 84 : cluster [DBG] 6.17 scrub starts 2024-02-10T08:32:14.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:12.342016+0000 osd.4 (osd.4) 85 : cluster [DBG] 6.17 scrub ok 2024-02-10T08:32:14.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:12.479697+0000 osd.2 (osd.2) 139 : cluster [DBG] 2.c scrub starts 2024-02-10T08:32:14.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:12.480856+0000 osd.2 (osd.2) 140 : cluster [DBG] 2.c scrub ok 2024-02-10T08:32:14.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:12.944878+0000 mgr.y (mgr.14505) 581 : cluster [DBG] pgmap v714: 168 pgs: 1 active+remapped+backfill_toofull, 1 active+remapped+backfilling, 166 active+clean; 18 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 994 op/s; 39/1434 objects misplaced (2.720%); 1.5 MiB/s, 23 objects/s recovering 2024-02-10T08:32:14.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:13.214950+0000 osd.7 (osd.7) 181 : cluster [DBG] 2.8 scrub starts 2024-02-10T08:32:14.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:13.217839+0000 osd.7 (osd.7) 182 : cluster [DBG] 2.8 scrub ok 2024-02-10T08:32:14.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:32:13.719574+0000 mon.a (mon.0) 1474 : audit [INF] from='client.? 172.21.15.18:0/898738599' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:32:14.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:12.283290+0000 osd.4 (osd.4) 84 : cluster [DBG] 6.17 scrub starts 2024-02-10T08:32:14.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:12.342016+0000 osd.4 (osd.4) 85 : cluster [DBG] 6.17 scrub ok 2024-02-10T08:32:14.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:12.479697+0000 osd.2 (osd.2) 139 : cluster [DBG] 2.c scrub starts 2024-02-10T08:32:14.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:12.480856+0000 osd.2 (osd.2) 140 : cluster [DBG] 2.c scrub ok 2024-02-10T08:32:14.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:12.944878+0000 mgr.y (mgr.14505) 581 : cluster [DBG] pgmap v714: 168 pgs: 1 active+remapped+backfill_toofull, 1 active+remapped+backfilling, 166 active+clean; 18 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 994 op/s; 39/1434 objects misplaced (2.720%); 1.5 MiB/s, 23 objects/s recovering 2024-02-10T08:32:14.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:13.214950+0000 osd.7 (osd.7) 181 : cluster [DBG] 2.8 scrub starts 2024-02-10T08:32:14.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:13.217839+0000 osd.7 (osd.7) 182 : cluster [DBG] 2.8 scrub ok 2024-02-10T08:32:14.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:32:13.719574+0000 mon.a (mon.0) 1474 : audit [INF] from='client.? 172.21.15.18:0/898738599' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:32:14.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:12.283290+0000 osd.4 (osd.4) 84 : cluster [DBG] 6.17 scrub starts 2024-02-10T08:32:14.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:12.342016+0000 osd.4 (osd.4) 85 : cluster [DBG] 6.17 scrub ok 2024-02-10T08:32:14.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:12.479697+0000 osd.2 (osd.2) 139 : cluster [DBG] 2.c scrub starts 2024-02-10T08:32:14.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:12.480856+0000 osd.2 (osd.2) 140 : cluster [DBG] 2.c scrub ok 2024-02-10T08:32:14.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:12.944878+0000 mgr.y (mgr.14505) 581 : cluster [DBG] pgmap v714: 168 pgs: 1 active+remapped+backfill_toofull, 1 active+remapped+backfilling, 166 active+clean; 18 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 994 op/s; 39/1434 objects misplaced (2.720%); 1.5 MiB/s, 23 objects/s recovering 2024-02-10T08:32:14.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:13.214950+0000 osd.7 (osd.7) 181 : cluster [DBG] 2.8 scrub starts 2024-02-10T08:32:14.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:13.217839+0000 osd.7 (osd.7) 182 : cluster [DBG] 2.8 scrub ok 2024-02-10T08:32:14.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:32:13.719574+0000 mon.a (mon.0) 1474 : audit [INF] from='client.? 172.21.15.18:0/898738599' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:32:14.851 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:32:14.853 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:14.854 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:32:14.955 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:32:14.985 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:15.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:13.527930+0000 osd.0 (osd.0) 151 : cluster [DBG] 4.12 scrub starts 2024-02-10T08:32:15.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:13.529280+0000 osd.0 (osd.0) 152 : cluster [DBG] 4.12 scrub ok 2024-02-10T08:32:15.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:13.885894+0000 mon.a (mon.0) 1475 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-10T08:32:15.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:32:13.894389+0000 mon.a (mon.0) 1476 : audit [INF] from='client.? 172.21.15.18:0/898738599' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-10T08:32:15.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:13.894459+0000 mon.a (mon.0) 1477 : cluster [DBG] osdmap e328: 8 total, 8 up, 8 in 2024-02-10T08:32:15.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:13.941910+0000 osd.5 (osd.5) 185 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:32:15.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:13.941998+0000 osd.5 (osd.5) 186 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:32:15.137 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:14.081452+0000 osd.5 (osd.5) 187 : cluster [DBG] 2.1e scrub starts 2024-02-10T08:32:15.137 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:14.084348+0000 osd.5 (osd.5) 188 : cluster [DBG] 2.1e scrub ok 2024-02-10T08:32:15.137 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:13.527930+0000 osd.0 (osd.0) 151 : cluster [DBG] 4.12 scrub starts 2024-02-10T08:32:15.137 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:13.529280+0000 osd.0 (osd.0) 152 : cluster [DBG] 4.12 scrub ok 2024-02-10T08:32:15.137 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:13.885894+0000 mon.a (mon.0) 1475 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-10T08:32:15.137 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:32:13.894389+0000 mon.a (mon.0) 1476 : audit [INF] from='client.? 172.21.15.18:0/898738599' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-10T08:32:15.137 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:13.894459+0000 mon.a (mon.0) 1477 : cluster [DBG] osdmap e328: 8 total, 8 up, 8 in 2024-02-10T08:32:15.137 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:13.941910+0000 osd.5 (osd.5) 185 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:32:15.137 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:13.941998+0000 osd.5 (osd.5) 186 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:32:15.137 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:14.081452+0000 osd.5 (osd.5) 187 : cluster [DBG] 2.1e scrub starts 2024-02-10T08:32:15.137 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:14.084348+0000 osd.5 (osd.5) 188 : cluster [DBG] 2.1e scrub ok 2024-02-10T08:32:15.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:13.527930+0000 osd.0 (osd.0) 151 : cluster [DBG] 4.12 scrub starts 2024-02-10T08:32:15.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:13.529280+0000 osd.0 (osd.0) 152 : cluster [DBG] 4.12 scrub ok 2024-02-10T08:32:15.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:13.885894+0000 mon.a (mon.0) 1475 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-10T08:32:15.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:32:13.894389+0000 mon.a (mon.0) 1476 : audit [INF] from='client.? 172.21.15.18:0/898738599' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-10T08:32:15.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:13.894459+0000 mon.a (mon.0) 1477 : cluster [DBG] osdmap e328: 8 total, 8 up, 8 in 2024-02-10T08:32:15.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:13.941910+0000 osd.5 (osd.5) 185 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:32:15.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:13.941998+0000 osd.5 (osd.5) 186 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:32:15.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:14.081452+0000 osd.5 (osd.5) 187 : cluster [DBG] 2.1e scrub starts 2024-02-10T08:32:15.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:14.084348+0000 osd.5 (osd.5) 188 : cluster [DBG] 2.1e scrub ok 2024-02-10T08:32:15.913 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:32:15.914 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:32:16.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:14.524229+0000 osd.0 (osd.0) 153 : cluster [DBG] 9.8 scrub starts 2024-02-10T08:32:16.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:14.546841+0000 osd.0 (osd.0) 154 : cluster [DBG] 9.8 scrub ok 2024-02-10T08:32:16.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:14.900636+0000 mon.a (mon.0) 1478 : cluster [DBG] osdmap e329: 8 total, 8 up, 8 in 2024-02-10T08:32:16.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:14.945299+0000 mgr.y (mgr.14505) 582 : cluster [DBG] pgmap v717: 168 pgs: 1 active+remapped+backfill_toofull, 167 active+clean; 5.7 KiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 438 op/s; 680 KiB/s, 10 objects/s recovering 2024-02-10T08:32:16.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:15.207579+0000 osd.7 (osd.7) 183 : cluster [DBG] 5.14 scrub starts 2024-02-10T08:32:16.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:15.210215+0000 osd.7 (osd.7) 184 : cluster [DBG] 5.14 scrub ok 2024-02-10T08:32:16.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:15.238007+0000 osd.6 (osd.6) 155 : cluster [DBG] 6.1f scrub starts 2024-02-10T08:32:16.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:15.313389+0000 osd.6 (osd.6) 156 : cluster [DBG] 6.1f scrub ok 2024-02-10T08:32:16.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:15.810071+0000 mon.a (mon.0) 1479 : cluster [DBG] osdmap e330: 8 total, 8 up, 8 in 2024-02-10T08:32:16.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:14.524229+0000 osd.0 (osd.0) 153 : cluster [DBG] 9.8 scrub starts 2024-02-10T08:32:16.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:14.546841+0000 osd.0 (osd.0) 154 : cluster [DBG] 9.8 scrub ok 2024-02-10T08:32:16.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:14.900636+0000 mon.a (mon.0) 1478 : cluster [DBG] osdmap e329: 8 total, 8 up, 8 in 2024-02-10T08:32:16.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:14.945299+0000 mgr.y (mgr.14505) 582 : cluster [DBG] pgmap v717: 168 pgs: 1 active+remapped+backfill_toofull, 167 active+clean; 5.7 KiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 438 op/s; 680 KiB/s, 10 objects/s recovering 2024-02-10T08:32:16.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:15.207579+0000 osd.7 (osd.7) 183 : cluster [DBG] 5.14 scrub starts 2024-02-10T08:32:16.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:15.210215+0000 osd.7 (osd.7) 184 : cluster [DBG] 5.14 scrub ok 2024-02-10T08:32:16.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:15.238007+0000 osd.6 (osd.6) 155 : cluster [DBG] 6.1f scrub starts 2024-02-10T08:32:16.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:15.313389+0000 osd.6 (osd.6) 156 : cluster [DBG] 6.1f scrub ok 2024-02-10T08:32:16.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:15.810071+0000 mon.a (mon.0) 1479 : cluster [DBG] osdmap e330: 8 total, 8 up, 8 in 2024-02-10T08:32:16.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:14.524229+0000 osd.0 (osd.0) 153 : cluster [DBG] 9.8 scrub starts 2024-02-10T08:32:16.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:14.546841+0000 osd.0 (osd.0) 154 : cluster [DBG] 9.8 scrub ok 2024-02-10T08:32:16.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:14.900636+0000 mon.a (mon.0) 1478 : cluster [DBG] osdmap e329: 8 total, 8 up, 8 in 2024-02-10T08:32:16.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:14.945299+0000 mgr.y (mgr.14505) 582 : cluster [DBG] pgmap v717: 168 pgs: 1 active+remapped+backfill_toofull, 167 active+clean; 5.7 KiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 438 op/s; 680 KiB/s, 10 objects/s recovering 2024-02-10T08:32:16.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:15.207579+0000 osd.7 (osd.7) 183 : cluster [DBG] 5.14 scrub starts 2024-02-10T08:32:16.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:15.210215+0000 osd.7 (osd.7) 184 : cluster [DBG] 5.14 scrub ok 2024-02-10T08:32:16.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:15.238007+0000 osd.6 (osd.6) 155 : cluster [DBG] 6.1f scrub starts 2024-02-10T08:32:16.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:15.313389+0000 osd.6 (osd.6) 156 : cluster [DBG] 6.1f scrub ok 2024-02-10T08:32:16.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:15.810071+0000 mon.a (mon.0) 1479 : cluster [DBG] osdmap e330: 8 total, 8 up, 8 in 2024-02-10T08:32:16.337 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:32:16.340 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:16.341 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:32:16.363 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.0 dump_blocked_ops 2024-02-10T08:32:16.441 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:32:16.474 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:16.494 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:32:16.497 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:16.497 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:32:16.598 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:32:16.631 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:16.652 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:32:16.654 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:16.655 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:32:16.756 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:32:16.782 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:32:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:32:16] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:32:16.784 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:16.804 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:32:16.807 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:16.807 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:32:16.908 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:32:16.935 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:15.355488+0000 osd.4 (osd.4) 86 : cluster [DBG] 4.c scrub starts 2024-02-10T08:32:16.936 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:15.357334+0000 osd.4 (osd.4) 87 : cluster [DBG] 4.c scrub ok 2024-02-10T08:32:16.936 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:15.623928+0000 osd.1 (osd.1) 172 : cluster [DBG] 4.10 scrub starts 2024-02-10T08:32:16.936 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:15.627705+0000 osd.1 (osd.1) 173 : cluster [DBG] 4.10 scrub ok 2024-02-10T08:32:16.936 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:16.106625+0000 osd.5 (osd.5) 189 : cluster [DBG] 2.12 scrub starts 2024-02-10T08:32:16.936 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:16.109953+0000 osd.5 (osd.5) 190 : cluster [DBG] 2.12 scrub ok 2024-02-10T08:32:16.936 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:16.184813+0000 osd.7 (osd.7) 185 : cluster [DBG] 1.0 scrub starts 2024-02-10T08:32:16.936 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:16.187700+0000 osd.7 (osd.7) 186 : cluster [DBG] 1.0 scrub ok 2024-02-10T08:32:16.936 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:32:16.672238+0000 mon.a (mon.0) 1480 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:32:16.936 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:15.355488+0000 osd.4 (osd.4) 86 : cluster [DBG] 4.c scrub starts 2024-02-10T08:32:16.936 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:15.357334+0000 osd.4 (osd.4) 87 : cluster [DBG] 4.c scrub ok 2024-02-10T08:32:16.937 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:15.623928+0000 osd.1 (osd.1) 172 : cluster [DBG] 4.10 scrub starts 2024-02-10T08:32:16.937 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:15.627705+0000 osd.1 (osd.1) 173 : cluster [DBG] 4.10 scrub ok 2024-02-10T08:32:16.937 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:16.106625+0000 osd.5 (osd.5) 189 : cluster [DBG] 2.12 scrub starts 2024-02-10T08:32:16.937 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:16.109953+0000 osd.5 (osd.5) 190 : cluster [DBG] 2.12 scrub ok 2024-02-10T08:32:16.937 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:16.184813+0000 osd.7 (osd.7) 185 : cluster [DBG] 1.0 scrub starts 2024-02-10T08:32:16.937 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:16.187700+0000 osd.7 (osd.7) 186 : cluster [DBG] 1.0 scrub ok 2024-02-10T08:32:16.937 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:32:16.672238+0000 mon.a (mon.0) 1480 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:32:16.938 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:17.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:15.355488+0000 osd.4 (osd.4) 86 : cluster [DBG] 4.c scrub starts 2024-02-10T08:32:17.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:15.357334+0000 osd.4 (osd.4) 87 : cluster [DBG] 4.c scrub ok 2024-02-10T08:32:17.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:15.623928+0000 osd.1 (osd.1) 172 : cluster [DBG] 4.10 scrub starts 2024-02-10T08:32:17.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:15.627705+0000 osd.1 (osd.1) 173 : cluster [DBG] 4.10 scrub ok 2024-02-10T08:32:17.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:16.106625+0000 osd.5 (osd.5) 189 : cluster [DBG] 2.12 scrub starts 2024-02-10T08:32:17.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:16.109953+0000 osd.5 (osd.5) 190 : cluster [DBG] 2.12 scrub ok 2024-02-10T08:32:17.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:16.184813+0000 osd.7 (osd.7) 185 : cluster [DBG] 1.0 scrub starts 2024-02-10T08:32:17.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:16.187700+0000 osd.7 (osd.7) 186 : cluster [DBG] 1.0 scrub ok 2024-02-10T08:32:17.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:32:16.672238+0000 mon.a (mon.0) 1480 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:32:17.095 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:32:17.099 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:17.099 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:32:17.200 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:32:17.229 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:17.249 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:32:17.252 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:17.252 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:32:17.259 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:32:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:32:17] "GET /metrics HTTP/1.1" 200 176191 "" "Prometheus/2.33.4" 2024-02-10T08:32:17.353 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:32:17.380 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:17.400 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:32:17.402 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:17.402 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:32:17.503 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:32:17.529 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:17.548 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:32:17.550 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:17.551 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:32:17.597 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd set noscrub 2024-02-10T08:32:17.651 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:32:17.678 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:17.696 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:32:17.699 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:17.700 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:32:17.800 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:32:17.829 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:18.244 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:16.518106+0000 osd.2 (osd.2) 141 : cluster [DBG] 6.28 scrub starts 2024-02-10T08:32:18.244 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:16.518942+0000 osd.2 (osd.2) 142 : cluster [DBG] 6.28 scrub ok 2024-02-10T08:32:18.244 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:16.945646+0000 mgr.y (mgr.14505) 583 : cluster [DBG] pgmap v719: 168 pgs: 1 active+remapped+backfill_toofull, 167 active+clean; 5.7 KiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 997 B/s rd, 0 B/s wr, 353 op/s; 549 KiB/s, 8 objects/s recovering 2024-02-10T08:32:18.244 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:17.093549+0000 osd.5 (osd.5) 191 : cluster [DBG] 9.6 deep-scrub starts 2024-02-10T08:32:18.244 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:17.116910+0000 osd.5 (osd.5) 192 : cluster [DBG] 9.6 deep-scrub ok 2024-02-10T08:32:18.244 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:17.246200+0000 osd.6 (osd.6) 157 : cluster [DBG] 5.1f deep-scrub starts 2024-02-10T08:32:18.244 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:17.249713+0000 osd.6 (osd.6) 158 : cluster [DBG] 5.1f deep-scrub ok 2024-02-10T08:32:18.244 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:16.518106+0000 osd.2 (osd.2) 141 : cluster [DBG] 6.28 scrub starts 2024-02-10T08:32:18.244 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:16.518942+0000 osd.2 (osd.2) 142 : cluster [DBG] 6.28 scrub ok 2024-02-10T08:32:18.245 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:16.945646+0000 mgr.y (mgr.14505) 583 : cluster [DBG] pgmap v719: 168 pgs: 1 active+remapped+backfill_toofull, 167 active+clean; 5.7 KiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 997 B/s rd, 0 B/s wr, 353 op/s; 549 KiB/s, 8 objects/s recovering 2024-02-10T08:32:18.245 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:17.093549+0000 osd.5 (osd.5) 191 : cluster [DBG] 9.6 deep-scrub starts 2024-02-10T08:32:18.245 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:17.116910+0000 osd.5 (osd.5) 192 : cluster [DBG] 9.6 deep-scrub ok 2024-02-10T08:32:18.245 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:17.246200+0000 osd.6 (osd.6) 157 : cluster [DBG] 5.1f deep-scrub starts 2024-02-10T08:32:18.245 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:17.249713+0000 osd.6 (osd.6) 158 : cluster [DBG] 5.1f deep-scrub ok 2024-02-10T08:32:18.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:16.518106+0000 osd.2 (osd.2) 141 : cluster [DBG] 6.28 scrub starts 2024-02-10T08:32:18.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:16.518942+0000 osd.2 (osd.2) 142 : cluster [DBG] 6.28 scrub ok 2024-02-10T08:32:18.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:16.945646+0000 mgr.y (mgr.14505) 583 : cluster [DBG] pgmap v719: 168 pgs: 1 active+remapped+backfill_toofull, 167 active+clean; 5.7 KiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 997 B/s rd, 0 B/s wr, 353 op/s; 549 KiB/s, 8 objects/s recovering 2024-02-10T08:32:18.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:17.093549+0000 osd.5 (osd.5) 191 : cluster [DBG] 9.6 deep-scrub starts 2024-02-10T08:32:18.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:17.116910+0000 osd.5 (osd.5) 192 : cluster [DBG] 9.6 deep-scrub ok 2024-02-10T08:32:18.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:17.246200+0000 osd.6 (osd.6) 157 : cluster [DBG] 5.1f deep-scrub starts 2024-02-10T08:32:18.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:17.249713+0000 osd.6 (osd.6) 158 : cluster [DBG] 5.1f deep-scrub ok 2024-02-10T08:32:18.487 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:32:18.505 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:32:18.525 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:32:18.543 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:32:18.561 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:32:18.579 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:32:18.598 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:32:18.616 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:32:18.618 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-10T08:32:18.618 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-10T08:32:18.618 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-10T08:32:18.618 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-10T08:32:18.618 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-10T08:32:18.618 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-10T08:32:18.618 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-10T08:32:18.618 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-10T08:32:18.789 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:32:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:32:19.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:17.351577+0000 osd.4 (osd.4) 88 : cluster [DBG] 5.1c scrub starts 2024-02-10T08:32:19.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:17.352793+0000 osd.4 (osd.4) 89 : cluster [DBG] 5.1c scrub ok 2024-02-10T08:32:19.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:17.476712+0000 osd.2 (osd.2) 143 : cluster [DBG] 4.1c deep-scrub starts 2024-02-10T08:32:19.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:17.481828+0000 osd.2 (osd.2) 144 : cluster [DBG] 4.1c deep-scrub ok 2024-02-10T08:32:19.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:17.557982+0000 osd.0 (osd.0) 155 : cluster [DBG] 9.5 scrub starts 2024-02-10T08:32:19.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:17.570327+0000 osd.0 (osd.0) 156 : cluster [DBG] 9.5 scrub ok 2024-02-10T08:32:19.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:17.668714+0000 osd.1 (osd.1) 174 : cluster [DBG] 2.d scrub starts 2024-02-10T08:32:19.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:17.671614+0000 osd.1 (osd.1) 175 : cluster [DBG] 2.d scrub ok 2024-02-10T08:32:19.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:32:18.455262+0000 mgr.y (mgr.14505) 584 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:32:19.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:32:18.469489+0000 mon.c (mon.2) 74 : audit [DBG] from='client.? 172.21.15.18:0/2988379726' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:32:19.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:32:18.693022+0000 mon.a (mon.0) 1481 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2024-02-10T08:32:19.353 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:17.351577+0000 osd.4 (osd.4) 88 : cluster [DBG] 5.1c scrub starts 2024-02-10T08:32:19.353 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:17.352793+0000 osd.4 (osd.4) 89 : cluster [DBG] 5.1c scrub ok 2024-02-10T08:32:19.353 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:17.476712+0000 osd.2 (osd.2) 143 : cluster [DBG] 4.1c deep-scrub starts 2024-02-10T08:32:19.353 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:17.481828+0000 osd.2 (osd.2) 144 : cluster [DBG] 4.1c deep-scrub ok 2024-02-10T08:32:19.353 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:17.557982+0000 osd.0 (osd.0) 155 : cluster [DBG] 9.5 scrub starts 2024-02-10T08:32:19.353 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:17.570327+0000 osd.0 (osd.0) 156 : cluster [DBG] 9.5 scrub ok 2024-02-10T08:32:19.353 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:17.668714+0000 osd.1 (osd.1) 174 : cluster [DBG] 2.d scrub starts 2024-02-10T08:32:19.353 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:17.671614+0000 osd.1 (osd.1) 175 : cluster [DBG] 2.d scrub ok 2024-02-10T08:32:19.353 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:32:18.455262+0000 mgr.y (mgr.14505) 584 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:32:19.353 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:32:18.469489+0000 mon.c (mon.2) 74 : audit [DBG] from='client.? 172.21.15.18:0/2988379726' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:32:19.354 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:32:18.693022+0000 mon.a (mon.0) 1481 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2024-02-10T08:32:19.354 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:17.351577+0000 osd.4 (osd.4) 88 : cluster [DBG] 5.1c scrub starts 2024-02-10T08:32:19.354 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:17.352793+0000 osd.4 (osd.4) 89 : cluster [DBG] 5.1c scrub ok 2024-02-10T08:32:19.354 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:17.476712+0000 osd.2 (osd.2) 143 : cluster [DBG] 4.1c deep-scrub starts 2024-02-10T08:32:19.354 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:17.481828+0000 osd.2 (osd.2) 144 : cluster [DBG] 4.1c deep-scrub ok 2024-02-10T08:32:19.354 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:17.557982+0000 osd.0 (osd.0) 155 : cluster [DBG] 9.5 scrub starts 2024-02-10T08:32:19.354 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:17.570327+0000 osd.0 (osd.0) 156 : cluster [DBG] 9.5 scrub ok 2024-02-10T08:32:19.354 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:17.668714+0000 osd.1 (osd.1) 174 : cluster [DBG] 2.d scrub starts 2024-02-10T08:32:19.354 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:17.671614+0000 osd.1 (osd.1) 175 : cluster [DBG] 2.d scrub ok 2024-02-10T08:32:19.354 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:32:18.455262+0000 mgr.y (mgr.14505) 584 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:32:19.354 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:32:18.469489+0000 mon.c (mon.2) 74 : audit [DBG] from='client.? 172.21.15.18:0/2988379726' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:32:19.354 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:32:18.693022+0000 mon.a (mon.0) 1481 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2024-02-10T08:32:19.379 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:32:19.384 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:19.384 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:32:19.485 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:32:19.517 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:19.538 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:32:19.541 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:19.541 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:32:19.642 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:32:19.671 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:19.691 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:32:19.693 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:19.693 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:32:19.794 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:32:19.823 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:19.842 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:32:19.844 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:19.845 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:32:19.945 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:32:19.967 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'unique_pool_2' removed 2024-02-10T08:32:20.021 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:20.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:18.528828+0000 osd.0 (osd.0) 157 : cluster [DBG] 4.b scrub starts 2024-02-10T08:32:20.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:18.530420+0000 osd.0 (osd.0) 158 : cluster [DBG] 4.b scrub ok 2024-02-10T08:32:20.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:32:18.916427+0000 mon.a (mon.0) 1482 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]': finished 2024-02-10T08:32:20.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:18.916496+0000 mon.a (mon.0) 1483 : cluster [DBG] osdmap e331: 8 total, 8 up, 8 in 2024-02-10T08:32:20.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:18.946015+0000 mgr.y (mgr.14505) 585 : cluster [DBG] pgmap v721: 168 pgs: 1 active+remapped+backfill_toofull, 167 active+clean; 5.7 KiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 1012 B/s rd, 0 op/s 2024-02-10T08:32:20.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:19.067961+0000 osd.5 (osd.5) 193 : cluster [DBG] 9.a scrub starts 2024-02-10T08:32:20.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:19.096856+0000 osd.5 (osd.5) 194 : cluster [DBG] 9.a scrub ok 2024-02-10T08:32:20.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:32:19.415861+0000 mon.c (mon.2) 75 : audit [INF] from='client.? 172.21.15.18:0/2603900138' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_2", "pool2": "unique_pool_2", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-10T08:32:20.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:32:19.416208+0000 mon.a (mon.0) 1484 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_2", "pool2": "unique_pool_2", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-10T08:32:20.401 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:18.528828+0000 osd.0 (osd.0) 157 : cluster [DBG] 4.b scrub starts 2024-02-10T08:32:20.401 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:18.530420+0000 osd.0 (osd.0) 158 : cluster [DBG] 4.b scrub ok 2024-02-10T08:32:20.401 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:32:18.916427+0000 mon.a (mon.0) 1482 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]': finished 2024-02-10T08:32:20.401 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:18.916496+0000 mon.a (mon.0) 1483 : cluster [DBG] osdmap e331: 8 total, 8 up, 8 in 2024-02-10T08:32:20.401 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:18.946015+0000 mgr.y (mgr.14505) 585 : cluster [DBG] pgmap v721: 168 pgs: 1 active+remapped+backfill_toofull, 167 active+clean; 5.7 KiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 1012 B/s rd, 0 op/s 2024-02-10T08:32:20.401 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:19.067961+0000 osd.5 (osd.5) 193 : cluster [DBG] 9.a scrub starts 2024-02-10T08:32:20.401 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:19.096856+0000 osd.5 (osd.5) 194 : cluster [DBG] 9.a scrub ok 2024-02-10T08:32:20.401 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:32:19.415861+0000 mon.c (mon.2) 75 : audit [INF] from='client.? 172.21.15.18:0/2603900138' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_2", "pool2": "unique_pool_2", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-10T08:32:20.402 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:32:19.416208+0000 mon.a (mon.0) 1484 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_2", "pool2": "unique_pool_2", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-10T08:32:20.402 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:18.528828+0000 osd.0 (osd.0) 157 : cluster [DBG] 4.b scrub starts 2024-02-10T08:32:20.402 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:18.530420+0000 osd.0 (osd.0) 158 : cluster [DBG] 4.b scrub ok 2024-02-10T08:32:20.402 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:32:18.916427+0000 mon.a (mon.0) 1482 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]': finished 2024-02-10T08:32:20.402 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:18.916496+0000 mon.a (mon.0) 1483 : cluster [DBG] osdmap e331: 8 total, 8 up, 8 in 2024-02-10T08:32:20.402 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:18.946015+0000 mgr.y (mgr.14505) 585 : cluster [DBG] pgmap v721: 168 pgs: 1 active+remapped+backfill_toofull, 167 active+clean; 5.7 KiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 1012 B/s rd, 0 op/s 2024-02-10T08:32:20.402 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:19.067961+0000 osd.5 (osd.5) 193 : cluster [DBG] 9.a scrub starts 2024-02-10T08:32:20.402 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:19.096856+0000 osd.5 (osd.5) 194 : cluster [DBG] 9.a scrub ok 2024-02-10T08:32:20.402 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:32:19.415861+0000 mon.c (mon.2) 75 : audit [INF] from='client.? 172.21.15.18:0/2603900138' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_2", "pool2": "unique_pool_2", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-10T08:32:20.402 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:32:19.416208+0000 mon.a (mon.0) 1484 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_2", "pool2": "unique_pool_2", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-10T08:32:20.475 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:32:20.477 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:20.478 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:32:20.579 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:32:20.605 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:20.624 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:32:20.627 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:20.627 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:32:20.693 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:32:20.693 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:32:20.728 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:32:20.754 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:20.772 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:32:20.774 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:20.775 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:32:20.876 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:32:20.901 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:20.920 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:32:20.923 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:20.923 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:32:21.024 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:32:21.050 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:21.069 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:32:21.071 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:21.072 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:32:21.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:19.663782+0000 osd.1 (osd.1) 176 : cluster [DBG] 3.0 scrub starts 2024-02-10T08:32:21.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:19.667247+0000 osd.1 (osd.1) 177 : cluster [DBG] 3.0 scrub ok 2024-02-10T08:32:21.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:32:19.922395+0000 mon.a (mon.0) 1485 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_2", "pool2": "unique_pool_2", "yes_i_really_really_mean_it": true}]': finished 2024-02-10T08:32:21.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:19.922464+0000 mon.a (mon.0) 1486 : cluster [DBG] osdmap e332: 8 total, 8 up, 8 in 2024-02-10T08:32:21.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:19.663782+0000 osd.1 (osd.1) 176 : cluster [DBG] 3.0 scrub starts 2024-02-10T08:32:21.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:19.667247+0000 osd.1 (osd.1) 177 : cluster [DBG] 3.0 scrub ok 2024-02-10T08:32:21.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:32:19.922395+0000 mon.a (mon.0) 1485 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_2", "pool2": "unique_pool_2", "yes_i_really_really_mean_it": true}]': finished 2024-02-10T08:32:21.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:19.922464+0000 mon.a (mon.0) 1486 : cluster [DBG] osdmap e332: 8 total, 8 up, 8 in 2024-02-10T08:32:21.172 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:32:21.196 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:19.663782+0000 osd.1 (osd.1) 176 : cluster [DBG] 3.0 scrub starts 2024-02-10T08:32:21.196 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:19.667247+0000 osd.1 (osd.1) 177 : cluster [DBG] 3.0 scrub ok 2024-02-10T08:32:21.196 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:32:19.922395+0000 mon.a (mon.0) 1485 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_2", "pool2": "unique_pool_2", "yes_i_really_really_mean_it": true}]': finished 2024-02-10T08:32:21.197 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:19.922464+0000 mon.a (mon.0) 1486 : cluster [DBG] osdmap e332: 8 total, 8 up, 8 in 2024-02-10T08:32:21.198 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:21.216 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:32:21.219 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:21.219 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:32:21.246 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2024-02-10T08:32:21.247 INFO:tasks.radosbench:Beginning radosbench... 2024-02-10T08:32:21.247 INFO:tasks.cephadm.ceph_manager.ceph:creating pool_name unique_pool_3 2024-02-10T08:32:21.247 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd pool create unique_pool_3 16 2024-02-10T08:32:21.321 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:32:21.346 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:21.364 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:32:21.367 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:21.368 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:32:21.469 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:32:21.499 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:22.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:20.456555+0000 osd.2 (osd.2) 145 : cluster [DBG] 2.5 scrub starts 2024-02-10T08:32:22.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:20.457377+0000 osd.2 (osd.2) 146 : cluster [DBG] 2.5 scrub ok 2024-02-10T08:32:22.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:20.946409+0000 mgr.y (mgr.14505) 586 : cluster [DBG] pgmap v723: 152 pgs: 152 active+clean; 5.7 KiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 682 B/s rd, 0 op/s 2024-02-10T08:32:22.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:20.456555+0000 osd.2 (osd.2) 145 : cluster [DBG] 2.5 scrub starts 2024-02-10T08:32:22.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:20.457377+0000 osd.2 (osd.2) 146 : cluster [DBG] 2.5 scrub ok 2024-02-10T08:32:22.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:20.946409+0000 mgr.y (mgr.14505) 586 : cluster [DBG] pgmap v723: 152 pgs: 152 active+clean; 5.7 KiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 682 B/s rd, 0 op/s 2024-02-10T08:32:22.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:20.456555+0000 osd.2 (osd.2) 145 : cluster [DBG] 2.5 scrub starts 2024-02-10T08:32:22.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:20.457377+0000 osd.2 (osd.2) 146 : cluster [DBG] 2.5 scrub ok 2024-02-10T08:32:22.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:20.946409+0000 mgr.y (mgr.14505) 586 : cluster [DBG] pgmap v723: 152 pgs: 152 active+clean; 5.7 KiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 682 B/s rd, 0 op/s 2024-02-10T08:32:22.430 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-10T08:32:22.549 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:32:22.552 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:22.552 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:32:22.595 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:32:22.653 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:32:22.685 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:22.707 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:32:22.710 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:22.710 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:32:22.811 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:32:22.841 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:22.862 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:32:22.867 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:22.867 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:32:22.968 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:32:22.998 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:23.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:21.298634+0000 osd.4 (osd.4) 90 : cluster [DBG] 2.13 scrub starts 2024-02-10T08:32:23.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:21.299444+0000 osd.4 (osd.4) 91 : cluster [DBG] 2.13 scrub ok 2024-02-10T08:32:23.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:21.481189+0000 osd.2 (osd.2) 147 : cluster [DBG] 5.a scrub starts 2024-02-10T08:32:23.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:21.482530+0000 osd.2 (osd.2) 148 : cluster [DBG] 5.a scrub ok 2024-02-10T08:32:23.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:21.919810+0000 mon.a (mon.0) 1487 : cluster [INF] Health check cleared: PG_BACKFILL_FULL (was: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull) 2024-02-10T08:32:23.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:21.919836+0000 mon.a (mon.0) 1488 : cluster [INF] Cluster is now healthy 2024-02-10T08:32:23.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:22.274634+0000 osd.7 (osd.7) 187 : cluster [DBG] 2.1b scrub starts 2024-02-10T08:32:23.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:22.275674+0000 osd.7 (osd.7) 188 : cluster [DBG] 2.1b scrub ok 2024-02-10T08:32:23.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:22.292856+0000 osd.6 (osd.6) 159 : cluster [DBG] 2.11 scrub starts 2024-02-10T08:32:23.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:22.293901+0000 osd.6 (osd.6) 160 : cluster [DBG] 2.11 scrub ok 2024-02-10T08:32:23.108 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:21.298634+0000 osd.4 (osd.4) 90 : cluster [DBG] 2.13 scrub starts 2024-02-10T08:32:23.108 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:21.299444+0000 osd.4 (osd.4) 91 : cluster [DBG] 2.13 scrub ok 2024-02-10T08:32:23.108 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:21.481189+0000 osd.2 (osd.2) 147 : cluster [DBG] 5.a scrub starts 2024-02-10T08:32:23.108 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:21.482530+0000 osd.2 (osd.2) 148 : cluster [DBG] 5.a scrub ok 2024-02-10T08:32:23.108 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:21.919810+0000 mon.a (mon.0) 1487 : cluster [INF] Health check cleared: PG_BACKFILL_FULL (was: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull) 2024-02-10T08:32:23.108 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:21.919836+0000 mon.a (mon.0) 1488 : cluster [INF] Cluster is now healthy 2024-02-10T08:32:23.108 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:22.274634+0000 osd.7 (osd.7) 187 : cluster [DBG] 2.1b scrub starts 2024-02-10T08:32:23.108 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:22.275674+0000 osd.7 (osd.7) 188 : cluster [DBG] 2.1b scrub ok 2024-02-10T08:32:23.109 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:22.292856+0000 osd.6 (osd.6) 159 : cluster [DBG] 2.11 scrub starts 2024-02-10T08:32:23.109 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:22.293901+0000 osd.6 (osd.6) 160 : cluster [DBG] 2.11 scrub ok 2024-02-10T08:32:23.109 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:21.298634+0000 osd.4 (osd.4) 90 : cluster [DBG] 2.13 scrub starts 2024-02-10T08:32:23.109 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:21.299444+0000 osd.4 (osd.4) 91 : cluster [DBG] 2.13 scrub ok 2024-02-10T08:32:23.109 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:21.481189+0000 osd.2 (osd.2) 147 : cluster [DBG] 5.a scrub starts 2024-02-10T08:32:23.109 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:21.482530+0000 osd.2 (osd.2) 148 : cluster [DBG] 5.a scrub ok 2024-02-10T08:32:23.109 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:21.919810+0000 mon.a (mon.0) 1487 : cluster [INF] Health check cleared: PG_BACKFILL_FULL (was: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull) 2024-02-10T08:32:23.109 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:21.919836+0000 mon.a (mon.0) 1488 : cluster [INF] Cluster is now healthy 2024-02-10T08:32:23.109 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:22.274634+0000 osd.7 (osd.7) 187 : cluster [DBG] 2.1b scrub starts 2024-02-10T08:32:23.110 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:22.275674+0000 osd.7 (osd.7) 188 : cluster [DBG] 2.1b scrub ok 2024-02-10T08:32:23.110 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:22.292856+0000 osd.6 (osd.6) 159 : cluster [DBG] 2.11 scrub starts 2024-02-10T08:32:23.110 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:22.293901+0000 osd.6 (osd.6) 160 : cluster [DBG] 2.11 scrub ok 2024-02-10T08:32:24.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:22.338407+0000 osd.4 (osd.4) 92 : cluster [DBG] 4.1b scrub starts 2024-02-10T08:32:24.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:22.340179+0000 osd.4 (osd.4) 93 : cluster [DBG] 4.1b scrub ok 2024-02-10T08:32:24.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:22.618010+0000 osd.1 (osd.1) 178 : cluster [DBG] 2.9 scrub starts 2024-02-10T08:32:24.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:22.621002+0000 osd.1 (osd.1) 179 : cluster [DBG] 2.9 scrub ok 2024-02-10T08:32:24.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:22.946964+0000 mgr.y (mgr.14505) 587 : cluster [DBG] pgmap v724: 152 pgs: 152 active+clean; 5.7 KiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-02-10T08:32:24.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:23.307004+0000 osd.7 (osd.7) 189 : cluster [DBG] 4.17 scrub starts 2024-02-10T08:32:24.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:23.310484+0000 osd.7 (osd.7) 190 : cluster [DBG] 4.17 scrub ok 2024-02-10T08:32:24.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:32:23.535181+0000 mon.a (mon.0) 1489 : audit [INF] from='client.? 172.21.15.18:0/798792505' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]: dispatch 2024-02-10T08:32:24.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:22.338407+0000 osd.4 (osd.4) 92 : cluster [DBG] 4.1b scrub starts 2024-02-10T08:32:24.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:22.340179+0000 osd.4 (osd.4) 93 : cluster [DBG] 4.1b scrub ok 2024-02-10T08:32:24.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:22.618010+0000 osd.1 (osd.1) 178 : cluster [DBG] 2.9 scrub starts 2024-02-10T08:32:24.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:22.621002+0000 osd.1 (osd.1) 179 : cluster [DBG] 2.9 scrub ok 2024-02-10T08:32:24.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:22.946964+0000 mgr.y (mgr.14505) 587 : cluster [DBG] pgmap v724: 152 pgs: 152 active+clean; 5.7 KiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-02-10T08:32:24.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:23.307004+0000 osd.7 (osd.7) 189 : cluster [DBG] 4.17 scrub starts 2024-02-10T08:32:24.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:23.310484+0000 osd.7 (osd.7) 190 : cluster [DBG] 4.17 scrub ok 2024-02-10T08:32:24.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:32:23.535181+0000 mon.a (mon.0) 1489 : audit [INF] from='client.? 172.21.15.18:0/798792505' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]: dispatch 2024-02-10T08:32:24.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:22.338407+0000 osd.4 (osd.4) 92 : cluster [DBG] 4.1b scrub starts 2024-02-10T08:32:24.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:22.340179+0000 osd.4 (osd.4) 93 : cluster [DBG] 4.1b scrub ok 2024-02-10T08:32:24.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:22.618010+0000 osd.1 (osd.1) 178 : cluster [DBG] 2.9 scrub starts 2024-02-10T08:32:24.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:22.621002+0000 osd.1 (osd.1) 179 : cluster [DBG] 2.9 scrub ok 2024-02-10T08:32:24.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:22.946964+0000 mgr.y (mgr.14505) 587 : cluster [DBG] pgmap v724: 152 pgs: 152 active+clean; 5.7 KiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-02-10T08:32:24.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:23.307004+0000 osd.7 (osd.7) 189 : cluster [DBG] 4.17 scrub starts 2024-02-10T08:32:24.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:23.310484+0000 osd.7 (osd.7) 190 : cluster [DBG] 4.17 scrub ok 2024-02-10T08:32:24.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:32:23.535181+0000 mon.a (mon.0) 1489 : audit [INF] from='client.? 172.21.15.18:0/798792505' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]: dispatch 2024-02-10T08:32:24.769 INFO:teuthology.orchestra.run.smithi018.stderr:reweighted osd.7 to 1 (10000) 2024-02-10T08:32:25.214 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:23.323335+0000 osd.4 (osd.4) 94 : cluster [DBG] 4.e scrub starts 2024-02-10T08:32:25.214 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:23.326940+0000 osd.4 (osd.4) 95 : cluster [DBG] 4.e scrub ok 2024-02-10T08:32:25.215 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:23.471821+0000 osd.2 (osd.2) 149 : cluster [DBG] 4.f scrub starts 2024-02-10T08:32:25.215 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:23.473930+0000 osd.2 (osd.2) 150 : cluster [DBG] 4.f scrub ok 2024-02-10T08:32:25.215 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:23.657563+0000 osd.1 (osd.1) 180 : cluster [DBG] 4.14 scrub starts 2024-02-10T08:32:25.215 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:23.661027+0000 osd.1 (osd.1) 181 : cluster [DBG] 4.14 scrub ok 2024-02-10T08:32:25.215 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:32:23.929938+0000 mon.a (mon.0) 1490 : audit [INF] from='client.? 172.21.15.18:0/798792505' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]': finished 2024-02-10T08:32:25.215 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:23.930045+0000 mon.a (mon.0) 1491 : cluster [DBG] osdmap e333: 8 total, 8 up, 8 in 2024-02-10T08:32:25.215 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:23.323335+0000 osd.4 (osd.4) 94 : cluster [DBG] 4.e scrub starts 2024-02-10T08:32:25.215 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:23.326940+0000 osd.4 (osd.4) 95 : cluster [DBG] 4.e scrub ok 2024-02-10T08:32:25.215 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:23.471821+0000 osd.2 (osd.2) 149 : cluster [DBG] 4.f scrub starts 2024-02-10T08:32:25.215 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:23.473930+0000 osd.2 (osd.2) 150 : cluster [DBG] 4.f scrub ok 2024-02-10T08:32:25.215 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:23.657563+0000 osd.1 (osd.1) 180 : cluster [DBG] 4.14 scrub starts 2024-02-10T08:32:25.215 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:23.661027+0000 osd.1 (osd.1) 181 : cluster [DBG] 4.14 scrub ok 2024-02-10T08:32:25.215 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:32:23.929938+0000 mon.a (mon.0) 1490 : audit [INF] from='client.? 172.21.15.18:0/798792505' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]': finished 2024-02-10T08:32:25.215 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:23.930045+0000 mon.a (mon.0) 1491 : cluster [DBG] osdmap e333: 8 total, 8 up, 8 in 2024-02-10T08:32:25.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:23.323335+0000 osd.4 (osd.4) 94 : cluster [DBG] 4.e scrub starts 2024-02-10T08:32:25.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:23.326940+0000 osd.4 (osd.4) 95 : cluster [DBG] 4.e scrub ok 2024-02-10T08:32:25.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:23.471821+0000 osd.2 (osd.2) 149 : cluster [DBG] 4.f scrub starts 2024-02-10T08:32:25.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:23.473930+0000 osd.2 (osd.2) 150 : cluster [DBG] 4.f scrub ok 2024-02-10T08:32:25.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:23.657563+0000 osd.1 (osd.1) 180 : cluster [DBG] 4.14 scrub starts 2024-02-10T08:32:25.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:23.661027+0000 osd.1 (osd.1) 181 : cluster [DBG] 4.14 scrub ok 2024-02-10T08:32:25.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:32:23.929938+0000 mon.a (mon.0) 1490 : audit [INF] from='client.? 172.21.15.18:0/798792505' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]': finished 2024-02-10T08:32:25.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:23.930045+0000 mon.a (mon.0) 1491 : cluster [DBG] osdmap e333: 8 total, 8 up, 8 in 2024-02-10T08:32:26.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:24.668959+0000 osd.1 (osd.1) 182 : cluster [DBG] 5.17 scrub starts 2024-02-10T08:32:26.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:24.672025+0000 osd.1 (osd.1) 183 : cluster [DBG] 5.17 scrub ok 2024-02-10T08:32:26.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:24.947485+0000 mgr.y (mgr.14505) 588 : cluster [DBG] pgmap v726: 152 pgs: 152 active+clean; 5.7 KiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 678 B/s rd, 0 op/s 2024-02-10T08:32:26.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:25.813636+0000 mon.a (mon.0) 1492 : cluster [DBG] osdmap e334: 8 total, 8 up, 8 in 2024-02-10T08:32:26.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:24.668959+0000 osd.1 (osd.1) 182 : cluster [DBG] 5.17 scrub starts 2024-02-10T08:32:26.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:24.672025+0000 osd.1 (osd.1) 183 : cluster [DBG] 5.17 scrub ok 2024-02-10T08:32:26.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:24.947485+0000 mgr.y (mgr.14505) 588 : cluster [DBG] pgmap v726: 152 pgs: 152 active+clean; 5.7 KiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 678 B/s rd, 0 op/s 2024-02-10T08:32:26.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:25.813636+0000 mon.a (mon.0) 1492 : cluster [DBG] osdmap e334: 8 total, 8 up, 8 in 2024-02-10T08:32:26.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:24.668959+0000 osd.1 (osd.1) 182 : cluster [DBG] 5.17 scrub starts 2024-02-10T08:32:26.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:24.672025+0000 osd.1 (osd.1) 183 : cluster [DBG] 5.17 scrub ok 2024-02-10T08:32:26.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:24.947485+0000 mgr.y (mgr.14505) 588 : cluster [DBG] pgmap v726: 152 pgs: 152 active+clean; 5.7 KiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 678 B/s rd, 0 op/s 2024-02-10T08:32:26.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:25.813636+0000 mon.a (mon.0) 1492 : cluster [DBG] osdmap e334: 8 total, 8 up, 8 in 2024-02-10T08:32:26.789 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:32:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:32:26] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:32:27.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:25.357107+0000 osd.4 (osd.4) 96 : cluster [DBG] 6.2 deep-scrub starts 2024-02-10T08:32:27.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:25.358309+0000 osd.4 (osd.4) 97 : cluster [DBG] 6.2 deep-scrub ok 2024-02-10T08:32:27.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:25.569490+0000 osd.0 (osd.0) 159 : cluster [DBG] 5.3 scrub starts 2024-02-10T08:32:27.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:25.571383+0000 osd.0 (osd.0) 160 : cluster [DBG] 5.3 scrub ok 2024-02-10T08:32:27.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:26.089884+0000 osd.5 (osd.5) 195 : cluster [DBG] 5.f scrub starts 2024-02-10T08:32:27.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:26.092890+0000 osd.5 (osd.5) 196 : cluster [DBG] 5.f scrub ok 2024-02-10T08:32:27.158 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:25.357107+0000 osd.4 (osd.4) 96 : cluster [DBG] 6.2 deep-scrub starts 2024-02-10T08:32:27.158 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:25.358309+0000 osd.4 (osd.4) 97 : cluster [DBG] 6.2 deep-scrub ok 2024-02-10T08:32:27.158 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:25.569490+0000 osd.0 (osd.0) 159 : cluster [DBG] 5.3 scrub starts 2024-02-10T08:32:27.158 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:25.571383+0000 osd.0 (osd.0) 160 : cluster [DBG] 5.3 scrub ok 2024-02-10T08:32:27.159 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:26.089884+0000 osd.5 (osd.5) 195 : cluster [DBG] 5.f scrub starts 2024-02-10T08:32:27.159 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:26.092890+0000 osd.5 (osd.5) 196 : cluster [DBG] 5.f scrub ok 2024-02-10T08:32:27.159 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:27.160 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:32:27.160 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:32:27.166 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-02-10T08:32:27.167 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:32:27.261 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:32:27.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:25.357107+0000 osd.4 (osd.4) 96 : cluster [DBG] 6.2 deep-scrub starts 2024-02-10T08:32:27.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:25.358309+0000 osd.4 (osd.4) 97 : cluster [DBG] 6.2 deep-scrub ok 2024-02-10T08:32:27.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:25.569490+0000 osd.0 (osd.0) 159 : cluster [DBG] 5.3 scrub starts 2024-02-10T08:32:27.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:25.571383+0000 osd.0 (osd.0) 160 : cluster [DBG] 5.3 scrub ok 2024-02-10T08:32:27.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:26.089884+0000 osd.5 (osd.5) 195 : cluster [DBG] 5.f scrub starts 2024-02-10T08:32:27.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:26.092890+0000 osd.5 (osd.5) 196 : cluster [DBG] 5.f scrub ok 2024-02-10T08:32:27.295 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:27.317 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:32:27.319 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:27.320 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:32:27.404 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:32:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:32:27] "GET /metrics HTTP/1.1" 200 176191 "" "Prometheus/2.33.4" 2024-02-10T08:32:27.420 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:32:27.450 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:27.471 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:32:27.474 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:27.474 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:32:27.575 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:32:27.605 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:27.625 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:32:27.628 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:27.629 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:32:27.729 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:32:27.757 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:27.776 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:32:27.778 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:27.779 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:32:27.780 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd reweight 0 1 2024-02-10T08:32:27.880 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:32:27.906 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:27.925 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:32:27.927 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:27.928 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:32:28.029 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:32:28.055 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:26.528241+0000 osd.2 (osd.2) 151 : cluster [DBG] 2.1 scrub starts 2024-02-10T08:32:28.055 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:26.529309+0000 osd.2 (osd.2) 152 : cluster [DBG] 2.1 scrub ok 2024-02-10T08:32:28.055 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:26.586129+0000 osd.0 (osd.0) 161 : cluster [DBG] 5.1e scrub starts 2024-02-10T08:32:28.055 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:26.589077+0000 osd.0 (osd.0) 162 : cluster [DBG] 5.1e scrub ok 2024-02-10T08:32:28.055 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:26.947816+0000 mgr.y (mgr.14505) 589 : cluster [DBG] pgmap v728: 152 pgs: 152 active+clean; 5.7 KiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 728 B/s rd, 0 op/s 2024-02-10T08:32:28.055 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:27.228191+0000 osd.6 (osd.6) 161 : cluster [DBG] 5.11 scrub starts 2024-02-10T08:32:28.055 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:27.229138+0000 osd.6 (osd.6) 162 : cluster [DBG] 5.11 scrub ok 2024-02-10T08:32:28.055 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:26.528241+0000 osd.2 (osd.2) 151 : cluster [DBG] 2.1 scrub starts 2024-02-10T08:32:28.056 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:26.529309+0000 osd.2 (osd.2) 152 : cluster [DBG] 2.1 scrub ok 2024-02-10T08:32:28.056 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:26.586129+0000 osd.0 (osd.0) 161 : cluster [DBG] 5.1e scrub starts 2024-02-10T08:32:28.056 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:26.589077+0000 osd.0 (osd.0) 162 : cluster [DBG] 5.1e scrub ok 2024-02-10T08:32:28.056 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:26.947816+0000 mgr.y (mgr.14505) 589 : cluster [DBG] pgmap v728: 152 pgs: 152 active+clean; 5.7 KiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 728 B/s rd, 0 op/s 2024-02-10T08:32:28.056 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:27.228191+0000 osd.6 (osd.6) 161 : cluster [DBG] 5.11 scrub starts 2024-02-10T08:32:28.056 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:27.229138+0000 osd.6 (osd.6) 162 : cluster [DBG] 5.11 scrub ok 2024-02-10T08:32:28.057 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:28.131 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:32:28.136 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:28.136 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:32:28.237 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:32:28.262 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:26.528241+0000 osd.2 (osd.2) 151 : cluster [DBG] 2.1 scrub starts 2024-02-10T08:32:28.262 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:26.529309+0000 osd.2 (osd.2) 152 : cluster [DBG] 2.1 scrub ok 2024-02-10T08:32:28.262 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:26.586129+0000 osd.0 (osd.0) 161 : cluster [DBG] 5.1e scrub starts 2024-02-10T08:32:28.262 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:26.589077+0000 osd.0 (osd.0) 162 : cluster [DBG] 5.1e scrub ok 2024-02-10T08:32:28.262 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:26.947816+0000 mgr.y (mgr.14505) 589 : cluster [DBG] pgmap v728: 152 pgs: 152 active+clean; 5.7 KiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 728 B/s rd, 0 op/s 2024-02-10T08:32:28.262 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:27.228191+0000 osd.6 (osd.6) 161 : cluster [DBG] 5.11 scrub starts 2024-02-10T08:32:28.262 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:27.229138+0000 osd.6 (osd.6) 162 : cluster [DBG] 5.11 scrub ok 2024-02-10T08:32:28.264 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:28.282 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:32:28.285 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:28.286 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:32:28.386 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:32:28.414 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:28.433 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:32:28.435 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:28.436 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:32:28.537 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:32:28.539 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:32:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:32:28.566 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:28.953 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.0 dump_historic_ops 2024-02-10T08:32:29.243 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:32:29.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:27.708129+0000 osd.1 (osd.1) 184 : cluster [DBG] 2.a scrub starts 2024-02-10T08:32:29.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:27.711048+0000 osd.1 (osd.1) 185 : cluster [DBG] 2.a scrub ok 2024-02-10T08:32:29.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:28.398824+0000 osd.7 (osd.7) 191 : cluster [DBG] 2.0 deep-scrub starts 2024-02-10T08:32:29.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:28.401956+0000 osd.7 (osd.7) 192 : cluster [DBG] 2.0 deep-scrub ok 2024-02-10T08:32:29.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:32:28.465592+0000 mgr.y (mgr.14505) 590 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:32:29.293 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:32:29.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:27.708129+0000 osd.1 (osd.1) 184 : cluster [DBG] 2.a scrub starts 2024-02-10T08:32:29.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:27.711048+0000 osd.1 (osd.1) 185 : cluster [DBG] 2.a scrub ok 2024-02-10T08:32:29.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:28.398824+0000 osd.7 (osd.7) 191 : cluster [DBG] 2.0 deep-scrub starts 2024-02-10T08:32:29.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:28.401956+0000 osd.7 (osd.7) 192 : cluster [DBG] 2.0 deep-scrub ok 2024-02-10T08:32:29.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:32:28.465592+0000 mgr.y (mgr.14505) 590 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:32:29.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:27.708129+0000 osd.1 (osd.1) 184 : cluster [DBG] 2.a scrub starts 2024-02-10T08:32:29.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:27.711048+0000 osd.1 (osd.1) 185 : cluster [DBG] 2.a scrub ok 2024-02-10T08:32:29.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:28.398824+0000 osd.7 (osd.7) 191 : cluster [DBG] 2.0 deep-scrub starts 2024-02-10T08:32:29.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:28.401956+0000 osd.7 (osd.7) 192 : cluster [DBG] 2.0 deep-scrub ok 2024-02-10T08:32:29.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:32:28.465592+0000 mgr.y (mgr.14505) 590 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:32:29.963 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'unique_pool_3' created 2024-02-10T08:32:30.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:28.948654+0000 mgr.y (mgr.14505) 591 : cluster [DBG] pgmap v729: 152 pgs: 152 active+clean; 5.7 KiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:32:30.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:29.016927+0000 osd.5 (osd.5) 197 : cluster [DBG] 3.2 deep-scrub starts 2024-02-10T08:32:30.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:29.019814+0000 osd.5 (osd.5) 198 : cluster [DBG] 3.2 deep-scrub ok 2024-02-10T08:32:30.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:32:29.464811+0000 mon.c (mon.2) 76 : audit [INF] from='client.? 172.21.15.18:0/1321991389' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_3", "pg_num": 16}]: dispatch 2024-02-10T08:32:30.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:32:29.465158+0000 mon.a (mon.0) 1493 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_3", "pg_num": 16}]: dispatch 2024-02-10T08:32:30.102 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:28.948654+0000 mgr.y (mgr.14505) 591 : cluster [DBG] pgmap v729: 152 pgs: 152 active+clean; 5.7 KiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:32:30.102 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:29.016927+0000 osd.5 (osd.5) 197 : cluster [DBG] 3.2 deep-scrub starts 2024-02-10T08:32:30.102 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:29.019814+0000 osd.5 (osd.5) 198 : cluster [DBG] 3.2 deep-scrub ok 2024-02-10T08:32:30.102 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:32:29.464811+0000 mon.c (mon.2) 76 : audit [INF] from='client.? 172.21.15.18:0/1321991389' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_3", "pg_num": 16}]: dispatch 2024-02-10T08:32:30.102 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:32:29.465158+0000 mon.a (mon.0) 1493 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_3", "pg_num": 16}]: dispatch 2024-02-10T08:32:30.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:28.948654+0000 mgr.y (mgr.14505) 591 : cluster [DBG] pgmap v729: 152 pgs: 152 active+clean; 5.7 KiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:32:30.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:29.016927+0000 osd.5 (osd.5) 197 : cluster [DBG] 3.2 deep-scrub starts 2024-02-10T08:32:30.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:29.019814+0000 osd.5 (osd.5) 198 : cluster [DBG] 3.2 deep-scrub ok 2024-02-10T08:32:30.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:32:29.464811+0000 mon.c (mon.2) 76 : audit [INF] from='client.? 172.21.15.18:0/1321991389' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_3", "pg_num": 16}]: dispatch 2024-02-10T08:32:30.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:32:29.465158+0000 mon.a (mon.0) 1493 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_3", "pg_num": 16}]: dispatch 2024-02-10T08:32:30.598 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:32:30.617 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:32:30.621 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:30.622 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:32:30.722 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:32:30.754 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:30.776 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:32:30.779 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:30.779 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:32:30.880 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:32:30.907 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:30.926 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:32:30.928 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:30.929 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:32:31.030 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:32:31.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:29.592915+0000 osd.2 (osd.2) 153 : cluster [DBG] 5.b deep-scrub starts 2024-02-10T08:32:31.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:29.593845+0000 osd.2 (osd.2) 154 : cluster [DBG] 5.b deep-scrub ok 2024-02-10T08:32:31.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:32:29.955362+0000 mon.a (mon.0) 1494 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_3", "pg_num": 16}]': finished 2024-02-10T08:32:31.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:29.955434+0000 mon.a (mon.0) 1495 : cluster [DBG] osdmap e335: 8 total, 8 up, 8 in 2024-02-10T08:32:31.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:30.238690+0000 osd.6 (osd.6) 163 : cluster [DBG] 2.17 scrub starts 2024-02-10T08:32:31.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:30.241588+0000 osd.6 (osd.6) 164 : cluster [DBG] 2.17 scrub ok 2024-02-10T08:32:31.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:30.815281+0000 mon.a (mon.0) 1496 : cluster [DBG] osdmap e336: 8 total, 8 up, 8 in 2024-02-10T08:32:31.056 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:31.075 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:32:31.077 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:31.078 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:32:31.179 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:32:31.205 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:31.223 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:32:31.225 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:31.225 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:32:31.326 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:32:31.356 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:29.592915+0000 osd.2 (osd.2) 153 : cluster [DBG] 5.b deep-scrub starts 2024-02-10T08:32:31.356 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:29.593845+0000 osd.2 (osd.2) 154 : cluster [DBG] 5.b deep-scrub ok 2024-02-10T08:32:31.356 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:32:29.955362+0000 mon.a (mon.0) 1494 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_3", "pg_num": 16}]': finished 2024-02-10T08:32:31.356 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:29.955434+0000 mon.a (mon.0) 1495 : cluster [DBG] osdmap e335: 8 total, 8 up, 8 in 2024-02-10T08:32:31.357 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:30.238690+0000 osd.6 (osd.6) 163 : cluster [DBG] 2.17 scrub starts 2024-02-10T08:32:31.357 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:30.241588+0000 osd.6 (osd.6) 164 : cluster [DBG] 2.17 scrub ok 2024-02-10T08:32:31.357 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:30.815281+0000 mon.a (mon.0) 1496 : cluster [DBG] osdmap e336: 8 total, 8 up, 8 in 2024-02-10T08:32:31.357 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:29.592915+0000 osd.2 (osd.2) 153 : cluster [DBG] 5.b deep-scrub starts 2024-02-10T08:32:31.357 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:29.593845+0000 osd.2 (osd.2) 154 : cluster [DBG] 5.b deep-scrub ok 2024-02-10T08:32:31.357 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:32:29.955362+0000 mon.a (mon.0) 1494 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_3", "pg_num": 16}]': finished 2024-02-10T08:32:31.357 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:29.955434+0000 mon.a (mon.0) 1495 : cluster [DBG] osdmap e335: 8 total, 8 up, 8 in 2024-02-10T08:32:31.357 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:30.238690+0000 osd.6 (osd.6) 163 : cluster [DBG] 2.17 scrub starts 2024-02-10T08:32:31.357 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:30.241588+0000 osd.6 (osd.6) 164 : cluster [DBG] 2.17 scrub ok 2024-02-10T08:32:31.357 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:30.815281+0000 mon.a (mon.0) 1496 : cluster [DBG] osdmap e336: 8 total, 8 up, 8 in 2024-02-10T08:32:31.360 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:31.613 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:31.677 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:32:31.678 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:32:31.778 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:32:31.808 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:31.829 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:32:31.831 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:31.832 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:32:31.933 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:32:31.962 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:31.981 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:32:31.983 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:31.984 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:32:32.085 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:32:32.110 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:30.949206+0000 mgr.y (mgr.14505) 592 : cluster [DBG] pgmap v732: 168 pgs: 3 creating+peering, 13 unknown, 152 active+clean; 5.7 KiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:32:32.110 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:31.022286+0000 osd.2 (osd.2) 155 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:32:32.110 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:31.022346+0000 osd.2 (osd.2) 156 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:32:32.110 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:31.446803+0000 osd.7 (osd.7) 193 : cluster [DBG] 6.29 scrub starts 2024-02-10T08:32:32.110 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:31.459847+0000 osd.7 (osd.7) 194 : cluster [DBG] 6.29 scrub ok 2024-02-10T08:32:32.110 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:32:31.672667+0000 mon.a (mon.0) 1497 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:32:32.110 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:31.816343+0000 mon.a (mon.0) 1498 : cluster [DBG] osdmap e337: 8 total, 8 up, 8 in 2024-02-10T08:32:32.112 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:32.131 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:32:32.133 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:32.133 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:32:32.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:30.949206+0000 mgr.y (mgr.14505) 592 : cluster [DBG] pgmap v732: 168 pgs: 3 creating+peering, 13 unknown, 152 active+clean; 5.7 KiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:32:32.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:31.022286+0000 osd.2 (osd.2) 155 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:32:32.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:31.022346+0000 osd.2 (osd.2) 156 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:32:32.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:31.446803+0000 osd.7 (osd.7) 193 : cluster [DBG] 6.29 scrub starts 2024-02-10T08:32:32.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:31.459847+0000 osd.7 (osd.7) 194 : cluster [DBG] 6.29 scrub ok 2024-02-10T08:32:32.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:32:31.672667+0000 mon.a (mon.0) 1497 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:32:32.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:31.816343+0000 mon.a (mon.0) 1498 : cluster [DBG] osdmap e337: 8 total, 8 up, 8 in 2024-02-10T08:32:32.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:30.949206+0000 mgr.y (mgr.14505) 592 : cluster [DBG] pgmap v732: 168 pgs: 3 creating+peering, 13 unknown, 152 active+clean; 5.7 KiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:32:32.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:31.022286+0000 osd.2 (osd.2) 155 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:32:32.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:31.022346+0000 osd.2 (osd.2) 156 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:32:32.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:31.446803+0000 osd.7 (osd.7) 193 : cluster [DBG] 6.29 scrub starts 2024-02-10T08:32:32.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:31.459847+0000 osd.7 (osd.7) 194 : cluster [DBG] 6.29 scrub ok 2024-02-10T08:32:32.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:32:31.672667+0000 mon.a (mon.0) 1497 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:32:32.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:31.816343+0000 mon.a (mon.0) 1498 : cluster [DBG] osdmap e337: 8 total, 8 up, 8 in 2024-02-10T08:32:32.235 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:32:32.268 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:32.366 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:32:32.369 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:32.369 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:32:32.470 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:32:32.497 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:32.515 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:32:32.517 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:32.518 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:32:32.619 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:32:32.647 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:32.896 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:32:32.899 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:32.899 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:32:32.966 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is set 2024-02-10T08:32:33.000 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:32:33.029 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:33.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:31.307589+0000 osd.4 (osd.4) 98 : cluster [DBG] 4.d scrub starts 2024-02-10T08:32:33.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:31.309359+0000 osd.4 (osd.4) 99 : cluster [DBG] 4.d scrub ok 2024-02-10T08:32:33.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:32:32.564200+0000 mon.a (mon.0) 1499 : audit [INF] from='client.? 172.21.15.18:0/3531031816' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:32:33.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:31.307589+0000 osd.4 (osd.4) 98 : cluster [DBG] 4.d scrub starts 2024-02-10T08:32:33.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:31.309359+0000 osd.4 (osd.4) 99 : cluster [DBG] 4.d scrub ok 2024-02-10T08:32:33.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:32:32.564200+0000 mon.a (mon.0) 1499 : audit [INF] from='client.? 172.21.15.18:0/3531031816' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:32:33.179 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:32:33.182 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:33.183 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:32:33.283 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:32:33.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:31.307589+0000 osd.4 (osd.4) 98 : cluster [DBG] 4.d scrub starts 2024-02-10T08:32:33.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:31.309359+0000 osd.4 (osd.4) 99 : cluster [DBG] 4.d scrub ok 2024-02-10T08:32:33.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:32:32.564200+0000 mon.a (mon.0) 1499 : audit [INF] from='client.? 172.21.15.18:0/3531031816' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:32:33.313 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:33.334 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:32:33.337 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:33.337 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:32:33.438 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:32:33.467 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:33.485 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:32:33.488 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:33.489 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:32:33.589 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:32:33.619 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:33.641 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:32:33.644 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:33.644 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:32:33.745 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:32:33.774 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:33.793 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:32:33.795 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:33.796 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:32:33.805 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:32:33.805 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:32:33.805 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:32:33.805 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:32:33.805 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:32:33.805 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:32:33.805 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:32:33.805 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:32:33.805 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-10T08:32:33.806 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-10T08:32:33.806 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-10T08:32:33.806 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-10T08:32:33.806 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-10T08:32:33.806 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-10T08:32:33.806 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-10T08:32:33.806 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-10T08:32:33.896 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:32:33.925 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:34.024 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:32:34.026 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:34.027 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:32:34.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:32.313920+0000 osd.4 (osd.4) 100 : cluster [DBG] 6.6 scrub starts 2024-02-10T08:32:34.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:32.331282+0000 osd.4 (osd.4) 101 : cluster [DBG] 6.6 scrub ok 2024-02-10T08:32:34.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:32.556607+0000 osd.2 (osd.2) 157 : cluster [DBG] 5.d scrub starts 2024-02-10T08:32:34.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:32.558111+0000 osd.2 (osd.2) 158 : cluster [DBG] 5.d scrub ok 2024-02-10T08:32:34.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:32.562802+0000 osd.0 (osd.0) 163 : cluster [DBG] 4.1e scrub starts 2024-02-10T08:32:34.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:32.566433+0000 osd.0 (osd.0) 164 : cluster [DBG] 4.1e scrub ok 2024-02-10T08:32:34.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:32.710930+0000 osd.1 (osd.1) 186 : cluster [DBG] 6.4 scrub starts 2024-02-10T08:32:34.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:32.713912+0000 osd.1 (osd.1) 187 : cluster [DBG] 6.4 scrub ok 2024-02-10T08:32:34.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:32.949773+0000 mgr.y (mgr.14505) 593 : cluster [DBG] pgmap v734: 168 pgs: 3 creating+peering, 3 unknown, 162 active+clean; 5.7 KiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-02-10T08:32:34.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:32.955119+0000 mon.a (mon.0) 1500 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:32:34.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:32:32.961940+0000 mon.a (mon.0) 1501 : audit [INF] from='client.? 172.21.15.18:0/3531031816' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-10T08:32:34.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:32.962008+0000 mon.a (mon.0) 1502 : cluster [DBG] osdmap e338: 8 total, 8 up, 8 in 2024-02-10T08:32:34.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:33.266867+0000 osd.6 (osd.6) 165 : cluster [DBG] 4.1f scrub starts 2024-02-10T08:32:34.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:32:33.562301+0000 mon.a (mon.0) 1503 : audit [DBG] from='client.? 172.21.15.18:0/895409582' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:32:34.128 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:32:34.157 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:34.178 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:32:34.181 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:34.181 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:32:34.191 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:32.313920+0000 osd.4 (osd.4) 100 : cluster [DBG] 6.6 scrub starts 2024-02-10T08:32:34.192 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:32.331282+0000 osd.4 (osd.4) 101 : cluster [DBG] 6.6 scrub ok 2024-02-10T08:32:34.192 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:32.556607+0000 osd.2 (osd.2) 157 : cluster [DBG] 5.d scrub starts 2024-02-10T08:32:34.192 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:32.558111+0000 osd.2 (osd.2) 158 : cluster [DBG] 5.d scrub ok 2024-02-10T08:32:34.192 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:32.562802+0000 osd.0 (osd.0) 163 : cluster [DBG] 4.1e scrub starts 2024-02-10T08:32:34.192 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:32.566433+0000 osd.0 (osd.0) 164 : cluster [DBG] 4.1e scrub ok 2024-02-10T08:32:34.192 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:32.710930+0000 osd.1 (osd.1) 186 : cluster [DBG] 6.4 scrub starts 2024-02-10T08:32:34.192 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:32.713912+0000 osd.1 (osd.1) 187 : cluster [DBG] 6.4 scrub ok 2024-02-10T08:32:34.192 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:32.949773+0000 mgr.y (mgr.14505) 593 : cluster [DBG] pgmap v734: 168 pgs: 3 creating+peering, 3 unknown, 162 active+clean; 5.7 KiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-02-10T08:32:34.192 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:32.955119+0000 mon.a (mon.0) 1500 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:32:34.192 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:32:32.961940+0000 mon.a (mon.0) 1501 : audit [INF] from='client.? 172.21.15.18:0/3531031816' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-10T08:32:34.192 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:32.962008+0000 mon.a (mon.0) 1502 : cluster [DBG] osdmap e338: 8 total, 8 up, 8 in 2024-02-10T08:32:34.192 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:33.266867+0000 osd.6 (osd.6) 165 : cluster [DBG] 4.1f scrub starts 2024-02-10T08:32:34.192 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:32:33.562301+0000 mon.a (mon.0) 1503 : audit [DBG] from='client.? 172.21.15.18:0/895409582' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:32:34.193 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:32.313920+0000 osd.4 (osd.4) 100 : cluster [DBG] 6.6 scrub starts 2024-02-10T08:32:34.193 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:32.331282+0000 osd.4 (osd.4) 101 : cluster [DBG] 6.6 scrub ok 2024-02-10T08:32:34.193 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:32.556607+0000 osd.2 (osd.2) 157 : cluster [DBG] 5.d scrub starts 2024-02-10T08:32:34.193 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:32.558111+0000 osd.2 (osd.2) 158 : cluster [DBG] 5.d scrub ok 2024-02-10T08:32:34.193 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:32.562802+0000 osd.0 (osd.0) 163 : cluster [DBG] 4.1e scrub starts 2024-02-10T08:32:34.193 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:32.566433+0000 osd.0 (osd.0) 164 : cluster [DBG] 4.1e scrub ok 2024-02-10T08:32:34.193 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:32.710930+0000 osd.1 (osd.1) 186 : cluster [DBG] 6.4 scrub starts 2024-02-10T08:32:34.193 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:32.713912+0000 osd.1 (osd.1) 187 : cluster [DBG] 6.4 scrub ok 2024-02-10T08:32:34.193 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:32.949773+0000 mgr.y (mgr.14505) 593 : cluster [DBG] pgmap v734: 168 pgs: 3 creating+peering, 3 unknown, 162 active+clean; 5.7 KiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-02-10T08:32:34.193 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:32.955119+0000 mon.a (mon.0) 1500 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:32:34.193 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:32:32.961940+0000 mon.a (mon.0) 1501 : audit [INF] from='client.? 172.21.15.18:0/3531031816' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-10T08:32:34.193 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:32.962008+0000 mon.a (mon.0) 1502 : cluster [DBG] osdmap e338: 8 total, 8 up, 8 in 2024-02-10T08:32:34.193 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:33.266867+0000 osd.6 (osd.6) 165 : cluster [DBG] 4.1f scrub starts 2024-02-10T08:32:34.193 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:32:33.562301+0000 mon.a (mon.0) 1503 : audit [DBG] from='client.? 172.21.15.18:0/895409582' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:32:34.282 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:32:34.311 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:34.329 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:32:34.332 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:34.332 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:32:34.433 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:32:34.462 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:34.560 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:32:34.564 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:34.564 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:32:34.665 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:32:34.692 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:34.711 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:32:34.714 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:34.714 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:32:34.815 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:32:34.846 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:34.885 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:32:34.888 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:34.888 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:32:34.904 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd pool application enable unique_pool_3 rados --yes-i-really-mean-it || true 2024-02-10T08:32:34.989 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:32:35.016 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:35.035 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:32:35.038 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:35.038 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:32:35.139 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:32:35.165 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:35.184 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:32:35.186 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:35.187 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:32:35.287 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:32:35.315 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:35.521 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:32:35.524 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:35.524 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:32:35.625 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:32:35.652 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:35.670 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:32:35.673 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:35.673 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:32:35.774 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:32:35.804 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:35.981 INFO:teuthology.orchestra.run.smithi018.stderr:reweighted osd.0 to 1 (10000) 2024-02-10T08:32:36.056 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:34.950194+0000 mgr.y (mgr.14505) 594 : cluster [DBG] pgmap v736: 168 pgs: 3 creating+peering, 165 active+clean; 5.7 KiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 1 KiB/s rd, 1 op/s 2024-02-10T08:32:36.056 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:32:35.473875+0000 mon.c (mon.2) 77 : audit [INF] from='client.? 172.21.15.18:0/3256533763' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2024-02-10T08:32:36.056 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:32:35.474213+0000 mon.a (mon.0) 1504 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2024-02-10T08:32:36.056 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:34.950194+0000 mgr.y (mgr.14505) 594 : cluster [DBG] pgmap v736: 168 pgs: 3 creating+peering, 165 active+clean; 5.7 KiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 1 KiB/s rd, 1 op/s 2024-02-10T08:32:36.056 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:32:35.473875+0000 mon.c (mon.2) 77 : audit [INF] from='client.? 172.21.15.18:0/3256533763' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2024-02-10T08:32:36.056 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:32:35.474213+0000 mon.a (mon.0) 1504 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2024-02-10T08:32:36.256 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:32:36.258 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:36.259 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:32:36.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:34.950194+0000 mgr.y (mgr.14505) 594 : cluster [DBG] pgmap v736: 168 pgs: 3 creating+peering, 165 active+clean; 5.7 KiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 1 KiB/s rd, 1 op/s 2024-02-10T08:32:36.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:32:35.473875+0000 mon.c (mon.2) 77 : audit [INF] from='client.? 172.21.15.18:0/3256533763' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2024-02-10T08:32:36.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:32:35.474213+0000 mon.a (mon.0) 1504 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2024-02-10T08:32:36.360 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:32:36.389 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:36.408 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:32:36.410 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:36.411 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:32:36.512 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:32:36.539 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:36.558 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:32:36.560 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:36.561 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:32:36.586 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-10T08:32:36.661 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:32:36.686 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:32:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:32:36] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:32:36.688 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:36.706 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:32:36.709 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:36.710 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:32:36.811 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:32:36.836 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:36.855 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:32:36.858 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:36.858 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:32:36.959 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:32:36.987 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:35.656500+0000 osd.4 (osd.4) 102 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:32:36.987 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:35.656553+0000 osd.4 (osd.4) 103 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:32:36.987 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:32:35.966098+0000 mon.a (mon.0) 1505 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2024-02-10T08:32:36.994 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:37.015 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:32:37.018 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:37.018 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:32:37.119 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:32:37.131 INFO:tasks.cephadm.ceph_manager.ceph:waiting for recovery to complete 2024-02-10T08:32:37.132 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph pg dump --format=json 2024-02-10T08:32:37.146 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:37.168 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:32:37.170 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:32:37.175 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:37.175 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:32:37.276 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:32:37.284 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:32:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:32:37] "GET /metrics HTTP/1.1" 200 176322 "" "Prometheus/2.33.4" 2024-02-10T08:32:37.284 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:35.656500+0000 osd.4 (osd.4) 102 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:32:37.285 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:35.656553+0000 osd.4 (osd.4) 103 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:32:37.285 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:32:35.966098+0000 mon.a (mon.0) 1505 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2024-02-10T08:32:37.285 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:35.966182+0000 mon.a (mon.0) 1506 : cluster [DBG] osdmap e339: 8 total, 8 up, 8 in 2024-02-10T08:32:37.285 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:36.967488+0000 mon.a (mon.0) 1507 : cluster [DBG] osdmap e340: 8 total, 8 up, 8 in 2024-02-10T08:32:37.285 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:35.656500+0000 osd.4 (osd.4) 102 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:32:37.285 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:35.656553+0000 osd.4 (osd.4) 103 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:32:37.285 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:32:35.966098+0000 mon.a (mon.0) 1505 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2024-02-10T08:32:37.285 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:35.966182+0000 mon.a (mon.0) 1506 : cluster [DBG] osdmap e339: 8 total, 8 up, 8 in 2024-02-10T08:32:37.285 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:36.967488+0000 mon.a (mon.0) 1507 : cluster [DBG] osdmap e340: 8 total, 8 up, 8 in 2024-02-10T08:32:37.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:35.966182+0000 mon.a (mon.0) 1506 : cluster [DBG] osdmap e339: 8 total, 8 up, 8 in 2024-02-10T08:32:37.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:36.967488+0000 mon.a (mon.0) 1507 : cluster [DBG] osdmap e340: 8 total, 8 up, 8 in 2024-02-10T08:32:37.300 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:37.319 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:32:37.321 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:37.322 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:32:37.423 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:32:37.448 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:37.467 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:32:37.470 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:37.470 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:32:37.533 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd set nodeep-scrub 2024-02-10T08:32:37.571 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:32:37.597 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:37.615 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:32:37.618 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:37.618 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:32:37.719 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:32:37.762 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:38.091 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:32:38.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:36.950582+0000 mgr.y (mgr.14505) 595 : cluster [DBG] pgmap v738: 168 pgs: 168 active+clean; 5.7 KiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:32:38.350 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:36.950582+0000 mgr.y (mgr.14505) 595 : cluster [DBG] pgmap v738: 168 pgs: 168 active+clean; 5.7 KiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:32:38.350 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:36.950582+0000 mgr.y (mgr.14505) 595 : cluster [DBG] pgmap v738: 168 pgs: 168 active+clean; 5.7 KiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:32:38.710 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:32:38.713 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:38.713 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:32:38.789 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:32:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:32:38.813 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:32:38.842 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:39.236 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:32:38.475564+0000 mgr.y (mgr.14505) 596 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:32:39.236 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:32:38.475564+0000 mgr.y (mgr.14505) 596 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:32:39.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:32:38.475564+0000 mgr.y (mgr.14505) 596 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:32:39.296 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:32:39.299 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:39.300 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:32:39.400 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:32:39.421 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-02-10T08:32:39.421 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-02-10T08:32:39.421 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-02-10T08:32:39.421 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-02-10T08:32:39.421 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.421 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:179932 7.6 7:622bb803:::benchmark_data_smithi018_80623_object79004:head [delete] snapc 0=[] ondisk+write+known_if_redirected e163)", 2024-02-10T08:32:39.421 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:23:14.099878+0000", 2024-02-10T08:32:39.421 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 565.31844642700003, 2024-02-10T08:32:39.422 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.593618239, 2024-02-10T08:32:39.422 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:32:39.422 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:32:39.422 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:32:39.422 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:32:39.422 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:32:39.422 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 179932 2024-02-10T08:32:39.422 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.422 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:32:39.422 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.422 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:32:39.422 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.099878+0000", 2024-02-10T08:32:39.422 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:32:39.422 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.422 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.423 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:32:39.423 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.099878+0000", 2024-02-10T08:32:39.423 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999981 2024-02-10T08:32:39.423 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.423 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.423 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:32:39.423 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.099876+0000", 2024-02-10T08:32:39.423 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0070000000000003e-06 2024-02-10T08:32:39.423 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.423 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.423 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:32:39.423 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.099882+0000", 2024-02-10T08:32:39.423 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.208e-06 2024-02-10T08:32:39.423 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.423 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.424 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:32:39.424 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.099890+0000", 2024-02-10T08:32:39.424 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1850000000000001e-06 2024-02-10T08:32:39.424 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.424 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.424 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:32:39.424 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.099896+0000", 2024-02-10T08:32:39.424 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0044118309999999997 2024-02-10T08:32:39.424 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.425 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.425 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:32:39.425 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.104308+0000", 2024-02-10T08:32:39.425 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1224e-05 2024-02-10T08:32:39.425 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.425 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.425 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:32:39.425 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.104319+0000", 2024-02-10T08:32:39.425 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.95846239700000002 2024-02-10T08:32:39.425 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.425 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.425 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:32:39.425 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.062782+0000", 2024-02-10T08:32:39.426 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.134e-05 2024-02-10T08:32:39.426 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.426 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.426 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:32:39.426 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.062793+0000", 2024-02-10T08:32:39.426 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.60692910600000005 2024-02-10T08:32:39.426 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.426 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.426 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:32:39.426 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.669722+0000", 2024-02-10T08:32:39.427 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015991399999999999 2024-02-10T08:32:39.427 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.427 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.427 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:32:39.427 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.669882+0000", 2024-02-10T08:32:39.427 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018509 2024-02-10T08:32:39.427 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.427 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.427 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,5,7", 2024-02-10T08:32:39.427 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.670067+0000", 2024-02-10T08:32:39.427 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0099177139999999993 2024-02-10T08:32:39.428 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.428 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.428 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:32:39.428 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.679985+0000", 2024-02-10T08:32:39.428 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9059e-05 2024-02-10T08:32:39.428 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.428 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.428 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:32:39.428 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.680024+0000", 2024-02-10T08:32:39.428 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000251067 2024-02-10T08:32:39.428 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.428 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.429 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:32:39.429 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.680275+0000", 2024-02-10T08:32:39.429 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013023241 2024-02-10T08:32:39.429 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.429 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.429 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:32:39.429 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.693298+0000", 2024-02-10T08:32:39.429 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4793000000000002e-05 2024-02-10T08:32:39.429 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.429 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.429 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:32:39.429 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.693353+0000", 2024-02-10T08:32:39.429 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000142869 2024-02-10T08:32:39.430 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.430 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.430 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:32:39.430 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.693496+0000", 2024-02-10T08:32:39.430 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.593618239 2024-02-10T08:32:39.430 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:32:39.430 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:32:39.430 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:32:39.430 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.430 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.430 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:179935 7.6 7:612ee4b2:::benchmark_data_smithi018_80623_object79007:head [delete] snapc 0=[] ondisk+write+known_if_redirected e163)", 2024-02-10T08:32:39.430 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:23:14.105897+0000", 2024-02-10T08:32:39.430 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 565.31242710000004, 2024-02-10T08:32:39.430 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5878203129999999, 2024-02-10T08:32:39.431 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:32:39.431 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:32:39.431 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:32:39.431 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:32:39.431 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:32:39.431 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 179935 2024-02-10T08:32:39.431 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.431 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:32:39.431 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.431 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:32:39.431 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.105897+0000", 2024-02-10T08:32:39.431 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:32:39.431 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.431 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.431 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:32:39.432 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.105897+0000", 2024-02-10T08:32:39.432 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:32:39.432 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.432 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.432 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:32:39.432 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.105896+0000", 2024-02-10T08:32:39.432 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6050000000000003e-06 2024-02-10T08:32:39.432 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.432 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.432 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:32:39.432 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.105902+0000", 2024-02-10T08:32:39.432 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.011e-06 2024-02-10T08:32:39.432 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.433 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.433 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:32:39.433 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.105910+0000", 2024-02-10T08:32:39.433 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6529999999999997e-06 2024-02-10T08:32:39.433 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.433 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.433 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:32:39.433 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.105917+0000", 2024-02-10T08:32:39.433 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000154303 2024-02-10T08:32:39.434 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.435 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.435 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:32:39.435 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.106071+0000", 2024-02-10T08:32:39.435 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7540000000000003e-06 2024-02-10T08:32:39.435 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.435 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.435 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:32:39.435 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.106077+0000", 2024-02-10T08:32:39.435 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.95673804200000001 2024-02-10T08:32:39.435 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.435 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.435 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:32:39.435 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.062815+0000", 2024-02-10T08:32:39.436 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9240000000000007e-06 2024-02-10T08:32:39.436 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.436 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.436 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:32:39.436 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.062823+0000", 2024-02-10T08:32:39.436 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.60969109200000005 2024-02-10T08:32:39.436 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.436 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.436 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:32:39.436 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.672514+0000", 2024-02-10T08:32:39.437 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014302799999999999 2024-02-10T08:32:39.437 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.437 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.437 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:32:39.437 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.672657+0000", 2024-02-10T08:32:39.437 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017783 2024-02-10T08:32:39.437 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.437 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.437 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,5,7", 2024-02-10T08:32:39.437 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.672835+0000", 2024-02-10T08:32:39.438 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0073871930000000002 2024-02-10T08:32:39.438 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.438 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.438 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:32:39.438 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.680222+0000", 2024-02-10T08:32:39.438 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9824000000000002e-05 2024-02-10T08:32:39.438 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.438 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.438 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:32:39.438 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.680282+0000", 2024-02-10T08:32:39.438 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6982000000000001e-05 2024-02-10T08:32:39.438 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.438 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.438 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:32:39.439 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.680379+0000", 2024-02-10T08:32:39.439 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013162759 2024-02-10T08:32:39.439 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.439 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.439 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:32:39.439 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.693542+0000", 2024-02-10T08:32:39.439 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8619999999999999e-05 2024-02-10T08:32:39.439 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.439 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.439 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:32:39.440 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.693590+0000", 2024-02-10T08:32:39.440 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000127262 2024-02-10T08:32:39.440 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.440 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.440 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:32:39.440 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.693717+0000", 2024-02-10T08:32:39.440 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5878203129999999 2024-02-10T08:32:39.440 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:32:39.440 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:32:39.440 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:32:39.440 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.440 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.440 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:179936 7.6 7:6740eab7:::benchmark_data_smithi018_80623_object79008:head [delete] snapc 0=[] ondisk+write+known_if_redirected e163)", 2024-02-10T08:32:39.441 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:23:14.108981+0000", 2024-02-10T08:32:39.441 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 565.30934299299997, 2024-02-10T08:32:39.441 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5852249789999999, 2024-02-10T08:32:39.441 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:32:39.441 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:32:39.441 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:32:39.441 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:32:39.441 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:32:39.441 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 179936 2024-02-10T08:32:39.441 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.441 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:32:39.442 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.442 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:32:39.442 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.108981+0000", 2024-02-10T08:32:39.442 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:32:39.442 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.442 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.442 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:32:39.442 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.108981+0000", 2024-02-10T08:32:39.442 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999981 2024-02-10T08:32:39.442 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.442 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.442 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:32:39.442 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.108979+0000", 2024-02-10T08:32:39.442 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0089999999999996e-06 2024-02-10T08:32:39.442 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.443 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.443 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:32:39.443 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.108988+0000", 2024-02-10T08:32:39.443 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2675e-05 2024-02-10T08:32:39.443 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.443 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.443 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:32:39.443 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.109001+0000", 2024-02-10T08:32:39.443 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5170000000000002e-06 2024-02-10T08:32:39.443 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.443 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.443 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:32:39.443 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.109009+0000", 2024-02-10T08:32:39.443 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7682000000000001e-05 2024-02-10T08:32:39.443 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.443 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.444 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:32:39.444 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.109066+0000", 2024-02-10T08:32:39.444 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2139999999999999e-06 2024-02-10T08:32:39.444 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.444 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.444 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:32:39.444 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:14.109073+0000", 2024-02-10T08:32:39.444 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.95377067599999998 2024-02-10T08:32:39.444 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.444 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.444 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:32:39.444 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.062844+0000", 2024-02-10T08:32:39.444 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.678e-06 2024-02-10T08:32:39.445 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.445 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.445 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:32:39.445 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.062852+0000", 2024-02-10T08:32:39.445 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.61274752899999996 2024-02-10T08:32:39.445 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.445 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.445 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:32:39.445 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.675599+0000", 2024-02-10T08:32:39.445 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000113472 2024-02-10T08:32:39.445 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.445 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.445 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:32:39.445 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.675713+0000", 2024-02-10T08:32:39.446 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000138596 2024-02-10T08:32:39.446 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.446 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.446 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,5,7", 2024-02-10T08:32:39.446 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.675851+0000", 2024-02-10T08:32:39.446 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0044139050000000001 2024-02-10T08:32:39.446 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.446 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.446 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:32:39.446 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.680265+0000", 2024-02-10T08:32:39.446 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012036699999999999 2024-02-10T08:32:39.446 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.447 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.447 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:32:39.447 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.680386+0000", 2024-02-10T08:32:39.447 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012687000000000001 2024-02-10T08:32:39.447 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.447 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.447 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:32:39.447 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.680513+0000", 2024-02-10T08:32:39.447 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013500929 2024-02-10T08:32:39.447 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.447 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.447 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:32:39.447 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.694013+0000", 2024-02-10T08:32:39.448 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9317999999999997e-05 2024-02-10T08:32:39.448 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.448 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.448 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:32:39.448 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.694073+0000", 2024-02-10T08:32:39.448 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000133421 2024-02-10T08:32:39.448 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.448 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.449 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:32:39.449 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:15.694206+0000", 2024-02-10T08:32:39.449 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5852249789999999 2024-02-10T08:32:39.449 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:32:39.449 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:32:39.449 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:32:39.449 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.449 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.449 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:185679 7.9 7:9dfa0d6b:::benchmark_data_smithi018_80623_object84751:head [delete] snapc 0=[] ondisk+write+known_if_redirected e167)", 2024-02-10T08:32:39.449 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:23:24.331633+0000", 2024-02-10T08:32:39.449 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 555.08669111300003, 2024-02-10T08:32:39.450 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.131336863, 2024-02-10T08:32:39.450 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:32:39.450 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:32:39.450 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:32:39.450 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:32:39.450 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:32:39.450 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 185679 2024-02-10T08:32:39.450 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.450 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:32:39.450 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.450 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:32:39.450 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.331633+0000", 2024-02-10T08:32:39.451 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:32:39.451 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.451 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.451 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:32:39.451 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.331633+0000", 2024-02-10T08:32:39.451 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999976 2024-02-10T08:32:39.451 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.451 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.451 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:32:39.451 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.331631+0000", 2024-02-10T08:32:39.451 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5499999999999995e-06 2024-02-10T08:32:39.451 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.451 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.451 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:32:39.452 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.331639+0000", 2024-02-10T08:32:39.452 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1477e-05 2024-02-10T08:32:39.452 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.452 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.452 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:32:39.452 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.331651+0000", 2024-02-10T08:32:39.452 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7909999999999999e-06 2024-02-10T08:32:39.452 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.452 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.452 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:32:39.452 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.331658+0000", 2024-02-10T08:32:39.452 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0092112500000000007 2024-02-10T08:32:39.452 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.452 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.453 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:32:39.453 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.340869+0000", 2024-02-10T08:32:39.453 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9961000000000001e-05 2024-02-10T08:32:39.453 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.453 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.453 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:32:39.453 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.340959+0000", 2024-02-10T08:32:39.453 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000144389 2024-02-10T08:32:39.453 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.453 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.453 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1,4", 2024-02-10T08:32:39.453 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.341103+0000", 2024-02-10T08:32:39.453 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.010862764 2024-02-10T08:32:39.453 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.454 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.454 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:32:39.454 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.351966+0000", 2024-02-10T08:32:39.454 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3222e-05 2024-02-10T08:32:39.454 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.454 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.454 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:32:39.454 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.351979+0000", 2024-02-10T08:32:39.454 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.01040195 2024-02-10T08:32:39.454 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.454 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.454 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:32:39.454 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.362381+0000", 2024-02-10T08:32:39.454 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1693000000000001e-05 2024-02-10T08:32:39.455 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.455 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.455 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:32:39.455 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.362433+0000", 2024-02-10T08:32:39.455 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.100537026 2024-02-10T08:32:39.455 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.455 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.455 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:32:39.455 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.462970+0000", 2024-02-10T08:32:39.455 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.131336863 2024-02-10T08:32:39.455 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:32:39.455 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:32:39.455 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:32:39.455 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.455 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.456 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:185687 7.9 7:9ee476f1:::benchmark_data_smithi018_80623_object84759:head [delete] snapc 0=[] ondisk+write+known_if_redirected e167)", 2024-02-10T08:32:39.456 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:23:24.340882+0000", 2024-02-10T08:32:39.456 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 555.07744208500003, 2024-02-10T08:32:39.456 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.123437612, 2024-02-10T08:32:39.456 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:32:39.456 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:32:39.456 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:32:39.456 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:32:39.456 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:32:39.456 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 185687 2024-02-10T08:32:39.456 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.456 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:32:39.456 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.457 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:32:39.457 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.340882+0000", 2024-02-10T08:32:39.457 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:32:39.457 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.457 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.457 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:32:39.457 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.340882+0000", 2024-02-10T08:32:39.457 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:32:39.457 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.457 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.458 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:32:39.458 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.340882+0000", 2024-02-10T08:32:39.458 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0520000000000002e-06 2024-02-10T08:32:39.458 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.458 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.458 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:32:39.458 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.340885+0000", 2024-02-10T08:32:39.458 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2100000000000003e-06 2024-02-10T08:32:39.458 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.458 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.459 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:32:39.459 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.340889+0000", 2024-02-10T08:32:39.459 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4410000000000002e-06 2024-02-10T08:32:39.459 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.459 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.459 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:32:39.459 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.340892+0000", 2024-02-10T08:32:39.459 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0024863340000000002 2024-02-10T08:32:39.459 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.459 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.459 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:32:39.459 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.343379+0000", 2024-02-10T08:32:39.460 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3487999999999998e-05 2024-02-10T08:32:39.460 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.460 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.460 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:32:39.460 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.343462+0000", 2024-02-10T08:32:39.460 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9333999999999995e-05 2024-02-10T08:32:39.460 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.460 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.460 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1,4", 2024-02-10T08:32:39.460 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.343561+0000", 2024-02-10T08:32:39.460 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.014180066999999999 2024-02-10T08:32:39.460 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.460 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.460 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:32:39.461 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.357741+0000", 2024-02-10T08:32:39.461 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7206000000000001e-05 2024-02-10T08:32:39.461 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.461 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.461 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:32:39.461 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.357799+0000", 2024-02-10T08:32:39.461 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.105230039 2024-02-10T08:32:39.461 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.461 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.461 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:32:39.461 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.463029+0000", 2024-02-10T08:32:39.461 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8053000000000001e-05 2024-02-10T08:32:39.461 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.461 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.461 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:32:39.462 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.463087+0000", 2024-02-10T08:32:39.462 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001233025 2024-02-10T08:32:39.462 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.462 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.462 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:32:39.462 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.464320+0000", 2024-02-10T08:32:39.462 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.123437612 2024-02-10T08:32:39.462 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:32:39.462 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:32:39.462 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:32:39.462 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.462 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.462 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:185688 7.9 7:99430034:::benchmark_data_smithi018_80623_object84760:head [delete] snapc 0=[] ondisk+write+known_if_redirected e167)", 2024-02-10T08:32:39.462 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:23:24.340914+0000", 2024-02-10T08:32:39.463 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 555.07740976100001, 2024-02-10T08:32:39.463 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.124567673, 2024-02-10T08:32:39.463 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:32:39.463 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:32:39.463 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:32:39.463 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:32:39.463 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:32:39.463 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 185688 2024-02-10T08:32:39.463 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.463 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:32:39.463 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.463 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:32:39.463 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.340914+0000", 2024-02-10T08:32:39.463 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:32:39.464 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.464 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.464 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:32:39.464 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.340914+0000", 2024-02-10T08:32:39.464 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:32:39.464 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.464 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.464 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:32:39.464 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.340914+0000", 2024-02-10T08:32:39.464 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.384e-06 2024-02-10T08:32:39.464 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.464 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.464 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:32:39.465 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.340916+0000", 2024-02-10T08:32:39.465 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.631e-06 2024-02-10T08:32:39.465 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.465 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.465 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:32:39.465 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.340920+0000", 2024-02-10T08:32:39.465 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0900000000000001e-06 2024-02-10T08:32:39.465 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.465 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.465 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:32:39.465 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.340923+0000", 2024-02-10T08:32:39.465 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0052687360000000004 2024-02-10T08:32:39.465 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.465 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.465 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:32:39.466 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.346192+0000", 2024-02-10T08:32:39.466 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011723 2024-02-10T08:32:39.466 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.466 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.466 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:32:39.466 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.346309+0000", 2024-02-10T08:32:39.466 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013480400000000001 2024-02-10T08:32:39.466 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.466 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.466 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1,4", 2024-02-10T08:32:39.466 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.346444+0000", 2024-02-10T08:32:39.466 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011310209999999999 2024-02-10T08:32:39.466 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.466 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.466 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:32:39.467 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.357754+0000", 2024-02-10T08:32:39.467 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3480999999999995e-05 2024-02-10T08:32:39.467 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.467 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.467 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:32:39.467 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.357848+0000", 2024-02-10T08:32:39.467 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.106515707 2024-02-10T08:32:39.467 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.467 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.467 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:32:39.468 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.464363+0000", 2024-02-10T08:32:39.468 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0077000000000002e-05 2024-02-10T08:32:39.468 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.468 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.468 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:32:39.468 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.464413+0000", 2024-02-10T08:32:39.468 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010688480000000001 2024-02-10T08:32:39.468 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.468 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.468 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:32:39.468 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.465482+0000", 2024-02-10T08:32:39.469 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.124567673 2024-02-10T08:32:39.469 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:32:39.469 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:32:39.469 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:32:39.469 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.469 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.469 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:185689 7.9 7:9c498ea9:::benchmark_data_smithi018_80623_object84761:head [delete] snapc 0=[] ondisk+write+known_if_redirected e167)", 2024-02-10T08:32:39.469 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:23:24.340944+0000", 2024-02-10T08:32:39.469 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 555.077380404, 2024-02-10T08:32:39.469 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.12545147800000001, 2024-02-10T08:32:39.469 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:32:39.469 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:32:39.469 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:32:39.470 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:32:39.470 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:32:39.470 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 185689 2024-02-10T08:32:39.470 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.470 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:32:39.470 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.470 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:32:39.470 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.340944+0000", 2024-02-10T08:32:39.470 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:32:39.470 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.470 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.470 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:32:39.470 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.340944+0000", 2024-02-10T08:32:39.470 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:32:39.471 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.471 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.471 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:32:39.471 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.340943+0000", 2024-02-10T08:32:39.471 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5339999999999998e-06 2024-02-10T08:32:39.471 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.471 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.471 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:32:39.471 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.340946+0000", 2024-02-10T08:32:39.471 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8060000000000001e-06 2024-02-10T08:32:39.471 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.471 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.471 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:32:39.471 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.340950+0000", 2024-02-10T08:32:39.471 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5720000000000001e-06 2024-02-10T08:32:39.472 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.472 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.472 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:32:39.472 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.340952+0000", 2024-02-10T08:32:39.472 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0084502299999999995 2024-02-10T08:32:39.472 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.472 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.472 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:32:39.472 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.349403+0000", 2024-02-10T08:32:39.472 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013141100000000001 2024-02-10T08:32:39.472 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.472 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.472 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:32:39.472 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.349534+0000", 2024-02-10T08:32:39.473 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012961400000000001 2024-02-10T08:32:39.473 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.473 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.473 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1,4", 2024-02-10T08:32:39.473 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.349664+0000", 2024-02-10T08:32:39.473 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0081434149999999993 2024-02-10T08:32:39.473 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.473 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.473 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:32:39.473 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.357807+0000", 2024-02-10T08:32:39.473 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.10771916400000001 2024-02-10T08:32:39.473 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.473 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.474 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:32:39.474 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.465526+0000", 2024-02-10T08:32:39.474 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5643999999999997e-05 2024-02-10T08:32:39.474 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.474 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.474 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:32:39.474 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.465592+0000", 2024-02-10T08:32:39.474 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5314e-05 2024-02-10T08:32:39.474 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.474 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.474 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:32:39.474 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.465637+0000", 2024-02-10T08:32:39.474 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000758193 2024-02-10T08:32:39.475 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.475 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.475 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:32:39.475 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.466395+0000", 2024-02-10T08:32:39.475 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.12545147800000001 2024-02-10T08:32:39.475 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:32:39.475 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:32:39.475 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:32:39.475 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.475 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.475 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.14784.0:185695 7.9 7:951ad5ff:::benchmark_data_smithi018_80623_object84767:head [delete] snapc 0=[] ondisk+write+known_if_redirected e167)", 2024-02-10T08:32:39.475 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:23:24.355809+0000", 2024-02-10T08:32:39.475 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 555.06251519499995, 2024-02-10T08:32:39.475 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.127651502, 2024-02-10T08:32:39.475 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:32:39.476 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:32:39.476 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:32:39.476 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.14784", 2024-02-10T08:32:39.476 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/517934807", 2024-02-10T08:32:39.476 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 185695 2024-02-10T08:32:39.476 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.476 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:32:39.476 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.476 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:32:39.476 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.355809+0000", 2024-02-10T08:32:39.476 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:32:39.476 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.476 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.477 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:32:39.477 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.355809+0000", 2024-02-10T08:32:39.477 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:32:39.477 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.477 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.477 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:32:39.477 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.355808+0000", 2024-02-10T08:32:39.477 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8369999999999996e-06 2024-02-10T08:32:39.477 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.477 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.477 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:32:39.477 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.355812+0000", 2024-02-10T08:32:39.477 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7840000000000004e-06 2024-02-10T08:32:39.477 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.478 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.478 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:32:39.478 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.355820+0000", 2024-02-10T08:32:39.478 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8180000000000003e-06 2024-02-10T08:32:39.478 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.478 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.478 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:32:39.478 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.355825+0000", 2024-02-10T08:32:39.478 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0021991039999999999 2024-02-10T08:32:39.478 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.478 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.478 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:32:39.479 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.358024+0000", 2024-02-10T08:32:39.479 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013111000000000001 2024-02-10T08:32:39.479 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.479 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.479 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:32:39.479 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.358155+0000", 2024-02-10T08:32:39.479 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014176799999999999 2024-02-10T08:32:39.479 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.479 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.479 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1,4", 2024-02-10T08:32:39.479 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.358297+0000", 2024-02-10T08:32:39.480 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.10726297899999999 2024-02-10T08:32:39.480 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.480 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.480 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:32:39.480 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.465560+0000", 2024-02-10T08:32:39.480 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00088626600000000003 2024-02-10T08:32:39.480 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.480 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.480 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:32:39.480 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.466446+0000", 2024-02-10T08:32:39.480 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015808071 2024-02-10T08:32:39.480 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.480 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.480 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:32:39.481 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.482254+0000", 2024-02-10T08:32:39.481 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6811000000000002e-05 2024-02-10T08:32:39.481 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.481 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.481 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:32:39.481 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.482311+0000", 2024-02-10T08:32:39.481 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001149377 2024-02-10T08:32:39.481 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.481 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.481 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:32:39.481 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.483461+0000", 2024-02-10T08:32:39.481 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.127651502 2024-02-10T08:32:39.481 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:32:39.481 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:32:39.481 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:32:39.482 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.482 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.482 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.14784.0:185697 7.e e167/164 7:7ae1591d:::benchmark_data_smithi018_80623_object84769:head v 167'11600, mlcod=167'11597)", 2024-02-10T08:32:39.482 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:23:24.358293+0000", 2024-02-10T08:32:39.482 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 555.06003171500004, 2024-02-10T08:32:39.482 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.104620729, 2024-02-10T08:32:39.482 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:32:39.482 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:32:39.482 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:32:39.482 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.482 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:32:39.482 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.358293+0000", 2024-02-10T08:32:39.482 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:32:39.482 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.482 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.482 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:32:39.483 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.358293+0000", 2024-02-10T08:32:39.483 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:32:39.483 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.483 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.483 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:32:39.483 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.358292+0000", 2024-02-10T08:32:39.483 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6159999999999996e-06 2024-02-10T08:32:39.483 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.483 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.483 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:32:39.483 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.358299+0000", 2024-02-10T08:32:39.483 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8279999999999998e-06 2024-02-10T08:32:39.483 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.483 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.483 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:32:39.484 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.358309+0000", 2024-02-10T08:32:39.484 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0039999999999996e-06 2024-02-10T08:32:39.484 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.484 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.484 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:32:39.484 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.358315+0000", 2024-02-10T08:32:39.484 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9883999999999995e-05 2024-02-10T08:32:39.485 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.485 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.485 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:32:39.485 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.358405+0000", 2024-02-10T08:32:39.485 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1214000000000001e-05 2024-02-10T08:32:39.485 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.485 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.485 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:32:39.485 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.358426+0000", 2024-02-10T08:32:39.485 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0057889780000000002 2024-02-10T08:32:39.485 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.485 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.485 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:32:39.486 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.364215+0000", 2024-02-10T08:32:39.486 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.098697931000000003 2024-02-10T08:32:39.486 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.486 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.486 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:32:39.486 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.462913+0000", 2024-02-10T08:32:39.486 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.104620729 2024-02-10T08:32:39.486 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:32:39.486 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:32:39.486 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:32:39.486 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.486 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.486 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.14784.0:185699 7.f e167/164 7:f1a29ca9:::benchmark_data_smithi018_80623_object84771:head v 167'11542, mlcod=167'11540)", 2024-02-10T08:32:39.486 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:23:24.361663+0000", 2024-02-10T08:32:39.487 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 555.05666093900004, 2024-02-10T08:32:39.487 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.101331583, 2024-02-10T08:32:39.487 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:32:39.487 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:32:39.487 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:32:39.487 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.487 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:32:39.487 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.361663+0000", 2024-02-10T08:32:39.487 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:32:39.487 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.487 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.487 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:32:39.487 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.361663+0000", 2024-02-10T08:32:39.487 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:32:39.488 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.488 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.488 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:32:39.488 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.361662+0000", 2024-02-10T08:32:39.488 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4540000000000001e-06 2024-02-10T08:32:39.488 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.488 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.488 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:32:39.488 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.361670+0000", 2024-02-10T08:32:39.489 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6155999999999999e-05 2024-02-10T08:32:39.489 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.489 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.489 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:32:39.489 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.361686+0000", 2024-02-10T08:32:39.489 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2229999999999998e-06 2024-02-10T08:32:39.489 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.489 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.489 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:32:39.489 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.361691+0000", 2024-02-10T08:32:39.490 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8482000000000002e-05 2024-02-10T08:32:39.490 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.490 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.490 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:32:39.490 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.361730+0000", 2024-02-10T08:32:39.490 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.658e-05 2024-02-10T08:32:39.490 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.490 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.490 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:32:39.490 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.361756+0000", 2024-02-10T08:32:39.490 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.10120646599999999 2024-02-10T08:32:39.491 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.491 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.491 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:32:39.491 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.462963+0000", 2024-02-10T08:32:39.491 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2165999999999997e-05 2024-02-10T08:32:39.491 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.491 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.491 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:32:39.491 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.462995+0000", 2024-02-10T08:32:39.491 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.101331583 2024-02-10T08:32:39.491 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:32:39.491 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:32:39.492 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:32:39.492 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.492 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.492 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.14784.0:185700 7.f e167/164 7:fa9fb72e:::benchmark_data_smithi018_80623_object84772:head v 167'11543, mlcod=167'11540)", 2024-02-10T08:32:39.492 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:23:24.361704+0000", 2024-02-10T08:32:39.492 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 555.05662006900002, 2024-02-10T08:32:39.492 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.103814714, 2024-02-10T08:32:39.492 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:32:39.493 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:32:39.493 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:32:39.493 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.493 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:32:39.493 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.361704+0000", 2024-02-10T08:32:39.493 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:32:39.493 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.493 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.493 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:32:39.493 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.361704+0000", 2024-02-10T08:32:39.493 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:32:39.493 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.493 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.493 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:32:39.494 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.361704+0000", 2024-02-10T08:32:39.494 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.374e-06 2024-02-10T08:32:39.494 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.494 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.494 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:32:39.494 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.361708+0000", 2024-02-10T08:32:39.494 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5970000000000002e-06 2024-02-10T08:32:39.494 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.494 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.494 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:32:39.494 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.361713+0000", 2024-02-10T08:32:39.494 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.019e-06 2024-02-10T08:32:39.494 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.494 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.494 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:32:39.495 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.361717+0000", 2024-02-10T08:32:39.495 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.101305982 2024-02-10T08:32:39.495 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.495 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.495 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:32:39.495 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.463023+0000", 2024-02-10T08:32:39.495 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9838000000000001e-05 2024-02-10T08:32:39.495 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.495 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.495 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:32:39.495 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.463053+0000", 2024-02-10T08:32:39.495 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0024393349999999999 2024-02-10T08:32:39.495 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.495 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.495 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:32:39.495 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.465492+0000", 2024-02-10T08:32:39.496 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.692e-05 2024-02-10T08:32:39.496 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.496 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.496 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:32:39.496 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.465519+0000", 2024-02-10T08:32:39.496 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.103814714 2024-02-10T08:32:39.496 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:32:39.496 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:32:39.496 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:32:39.496 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.496 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.496 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop_reply(client.14784.0:185687 7.9 e167/111 ondisk, result = 0)", 2024-02-10T08:32:39.496 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:23:24.362330+0000", 2024-02-10T08:32:39.497 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 555.05599434999999, 2024-02-10T08:32:39.497 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.10199463, 2024-02-10T08:32:39.497 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:32:39.497 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-02-10T08:32:39.497 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:32:39.497 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.497 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:32:39.497 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.362330+0000", 2024-02-10T08:32:39.497 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:32:39.497 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.497 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.497 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:32:39.497 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.362330+0000", 2024-02-10T08:32:39.497 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:32:39.497 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.498 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.498 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:32:39.498 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.362330+0000", 2024-02-10T08:32:39.498 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.565e-06 2024-02-10T08:32:39.498 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.498 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.498 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:32:39.498 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.362332+0000", 2024-02-10T08:32:39.498 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8539999999999996e-06 2024-02-10T08:32:39.498 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.498 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.499 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:32:39.499 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.362337+0000", 2024-02-10T08:32:39.499 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.641e-06 2024-02-10T08:32:39.499 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.499 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.499 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:32:39.499 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.362341+0000", 2024-02-10T08:32:39.499 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.10066953300000001 2024-02-10T08:32:39.499 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.499 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.499 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:32:39.499 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.463010+0000", 2024-02-10T08:32:39.499 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6970000000000005e-06 2024-02-10T08:32:39.500 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.500 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.500 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:32:39.500 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.463020+0000", 2024-02-10T08:32:39.500 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001304609 2024-02-10T08:32:39.500 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.500 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.500 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:32:39.500 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.464325+0000", 2024-02-10T08:32:39.500 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.10199463 2024-02-10T08:32:39.501 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:32:39.501 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:32:39.501 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:32:39.501 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.501 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.501 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop_reply(client.14784.0:185688 7.9 e167/111 ondisk, result = 0)", 2024-02-10T08:32:39.501 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:23:24.363840+0000", 2024-02-10T08:32:39.501 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 555.05448399099998, 2024-02-10T08:32:39.501 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.101645918, 2024-02-10T08:32:39.501 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:32:39.501 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-02-10T08:32:39.501 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:32:39.501 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.501 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:32:39.501 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.363840+0000", 2024-02-10T08:32:39.502 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:32:39.502 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.502 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.502 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:32:39.502 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.363840+0000", 2024-02-10T08:32:39.502 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:32:39.502 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.502 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.502 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:32:39.502 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.363840+0000", 2024-02-10T08:32:39.502 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6849999999999998e-06 2024-02-10T08:32:39.502 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.502 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.502 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:32:39.502 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.363845+0000", 2024-02-10T08:32:39.502 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.098908898999999995 2024-02-10T08:32:39.503 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.503 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.503 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:32:39.503 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.462754+0000", 2024-02-10T08:32:39.503 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3319000000000001e-05 2024-02-10T08:32:39.503 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.503 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.503 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:32:39.503 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.462767+0000", 2024-02-10T08:32:39.503 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0015808529999999999 2024-02-10T08:32:39.503 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.503 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.504 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:32:39.504 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.464348+0000", 2024-02-10T08:32:39.504 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5100000000000001e-06 2024-02-10T08:32:39.504 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.504 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.504 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:32:39.504 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.464356+0000", 2024-02-10T08:32:39.504 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001130381 2024-02-10T08:32:39.504 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.504 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.504 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:32:39.504 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.465486+0000", 2024-02-10T08:32:39.504 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.101645918 2024-02-10T08:32:39.505 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:32:39.505 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:32:39.505 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:32:39.505 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.505 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.505 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.14784.0:185704 7.4 e167/164 7:2ed1b197:::benchmark_data_smithi018_80623_object84776:head v 167'11593, mlcod=167'11590)", 2024-02-10T08:32:39.505 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:23:24.366203+0000", 2024-02-10T08:32:39.505 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 555.05212125399999, 2024-02-10T08:32:39.505 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.103812249, 2024-02-10T08:32:39.505 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:32:39.505 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:32:39.505 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:32:39.505 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.505 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:32:39.505 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.366203+0000", 2024-02-10T08:32:39.505 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:32:39.505 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.506 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.506 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:32:39.506 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.366203+0000", 2024-02-10T08:32:39.506 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:32:39.506 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.506 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.506 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:32:39.506 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.366202+0000", 2024-02-10T08:32:39.506 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4850000000000003e-06 2024-02-10T08:32:39.506 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.506 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.506 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:32:39.506 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.366210+0000", 2024-02-10T08:32:39.506 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.097461556000000005 2024-02-10T08:32:39.506 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.507 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.507 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:32:39.507 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.463671+0000", 2024-02-10T08:32:39.507 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1309999999999995e-06 2024-02-10T08:32:39.507 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.507 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.507 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:32:39.507 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.463680+0000", 2024-02-10T08:32:39.507 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001691609 2024-02-10T08:32:39.507 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.507 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.507 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:32:39.507 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.465372+0000", 2024-02-10T08:32:39.508 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.4521000000000001e-05 2024-02-10T08:32:39.508 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.508 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.508 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:32:39.508 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.465397+0000", 2024-02-10T08:32:39.508 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0045736479999999996 2024-02-10T08:32:39.508 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.508 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.508 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:32:39.508 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.469970+0000", 2024-02-10T08:32:39.508 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5059999999999999e-05 2024-02-10T08:32:39.508 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.509 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.509 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:32:39.509 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:23:24.470015+0000", 2024-02-10T08:32:39.509 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.103812249 2024-02-10T08:32:39.509 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:32:39.509 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:32:39.509 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:32:39.509 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.509 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.510 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.15198.0:180014 9.5 9:aa5e1fbc:::benchmark_data_smithi018_124176_object58275:head [delete] snapc 0=[] ondisk+write+known_if_redirected e302)", 2024-02-10T08:32:39.510 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:31:01.800368+0000", 2024-02-10T08:32:39.510 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 97.617956144000004, 2024-02-10T08:32:39.510 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.095267273, 2024-02-10T08:32:39.510 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:32:39.510 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:32:39.510 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:32:39.510 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.15198", 2024-02-10T08:32:39.510 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/1957604827", 2024-02-10T08:32:39.510 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 180014 2024-02-10T08:32:39.510 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.510 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:32:39.510 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.511 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:32:39.511 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:31:01.800368+0000", 2024-02-10T08:32:39.511 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:32:39.511 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.511 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.511 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:32:39.511 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:31:01.800368+0000", 2024-02-10T08:32:39.511 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999981 2024-02-10T08:32:39.511 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.511 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.511 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:32:39.511 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:31:01.800366+0000", 2024-02-10T08:32:39.511 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0900000000000005e-06 2024-02-10T08:32:39.511 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.511 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.511 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:32:39.512 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:31:01.800374+0000", 2024-02-10T08:32:39.512 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1144999999999999e-05 2024-02-10T08:32:39.512 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.512 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.512 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:32:39.512 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:31:01.800386+0000", 2024-02-10T08:32:39.512 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1970000000000001e-06 2024-02-10T08:32:39.512 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.512 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.512 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:32:39.512 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:31:01.800392+0000", 2024-02-10T08:32:39.512 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0602999999999997e-05 2024-02-10T08:32:39.512 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.513 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.513 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:32:39.513 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:31:01.800432+0000", 2024-02-10T08:32:39.513 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000119116 2024-02-10T08:32:39.513 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.513 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.513 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:32:39.513 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:31:01.800551+0000", 2024-02-10T08:32:39.513 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013693200000000001 2024-02-10T08:32:39.513 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.513 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.513 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 5,7", 2024-02-10T08:32:39.513 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:31:01.800688+0000", 2024-02-10T08:32:39.513 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.007361037 2024-02-10T08:32:39.513 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.514 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.514 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:32:39.514 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:31:01.808049+0000", 2024-02-10T08:32:39.514 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001302681 2024-02-10T08:32:39.514 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.514 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.514 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:32:39.514 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:31:01.809352+0000", 2024-02-10T08:32:39.514 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086229701000000006 2024-02-10T08:32:39.514 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.514 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.514 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:32:39.514 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:31:01.895582+0000", 2024-02-10T08:32:39.514 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9998999999999999e-05 2024-02-10T08:32:39.514 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.514 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.515 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:32:39.515 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:31:01.895612+0000", 2024-02-10T08:32:39.515 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3592999999999999e-05 2024-02-10T08:32:39.515 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.515 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.515 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:32:39.515 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:31:01.895635+0000", 2024-02-10T08:32:39.515 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.095267273 2024-02-10T08:32:39.515 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:32:39.515 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:32:39.515 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:32:39.515 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.515 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.515 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.15198.0:180017 9.5 9:a44766b7:::benchmark_data_smithi018_124176_object58278:head [delete] snapc 0=[] ondisk+write+known_if_redirected e302)", 2024-02-10T08:32:39.516 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:31:01.800457+0000", 2024-02-10T08:32:39.516 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 97.617867595000007, 2024-02-10T08:32:39.516 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.095326307999999998, 2024-02-10T08:32:39.516 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:32:39.516 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:32:39.516 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:32:39.516 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.15198", 2024-02-10T08:32:39.516 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/1957604827", 2024-02-10T08:32:39.516 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 180017 2024-02-10T08:32:39.516 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.516 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:32:39.516 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.516 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:32:39.516 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:31:01.800457+0000", 2024-02-10T08:32:39.517 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:32:39.517 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.517 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.517 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:32:39.517 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:31:01.800457+0000", 2024-02-10T08:32:39.517 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:32:39.517 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.517 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.517 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:32:39.517 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:31:01.800456+0000", 2024-02-10T08:32:39.517 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9669999999999998e-06 2024-02-10T08:32:39.518 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.518 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.518 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:32:39.518 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:31:01.800462+0000", 2024-02-10T08:32:39.518 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3149999999999992e-06 2024-02-10T08:32:39.518 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.518 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.518 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:32:39.518 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:31:01.800470+0000", 2024-02-10T08:32:39.518 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8899999999999998e-06 2024-02-10T08:32:39.518 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.518 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.518 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:32:39.518 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:31:01.800475+0000", 2024-02-10T08:32:39.518 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0039457299999999997 2024-02-10T08:32:39.519 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.519 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.519 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:32:39.519 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:31:01.804420+0000", 2024-02-10T08:32:39.519 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011741800000000001 2024-02-10T08:32:39.519 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.519 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.519 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:32:39.519 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:31:01.804538+0000", 2024-02-10T08:32:39.519 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014030600000000001 2024-02-10T08:32:39.520 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.520 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.520 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 5,7", 2024-02-10T08:32:39.520 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:31:01.804678+0000", 2024-02-10T08:32:39.520 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0039335300000000002 2024-02-10T08:32:39.520 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.520 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.520 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:32:39.520 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:31:01.808612+0000", 2024-02-10T08:32:39.520 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00075519599999999997 2024-02-10T08:32:39.521 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.521 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.521 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:32:39.521 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:31:01.809367+0000", 2024-02-10T08:32:39.521 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086363124999999999 2024-02-10T08:32:39.521 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.521 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.521 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:32:39.521 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:31:01.895730+0000", 2024-02-10T08:32:39.521 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7212e-05 2024-02-10T08:32:39.521 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.521 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.521 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:32:39.522 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:31:01.895757+0000", 2024-02-10T08:32:39.522 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5675999999999999e-05 2024-02-10T08:32:39.522 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.522 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.522 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:32:39.522 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:31:01.895783+0000", 2024-02-10T08:32:39.522 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.095326307999999998 2024-02-10T08:32:39.522 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:32:39.522 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:32:39.522 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:32:39.522 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.522 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.522 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.15198.0:243428 9.8 9:1b62a820:::benchmark_data_smithi018_124176_object121689:head [delete] snapc 0=[] ondisk+write+known_if_redirected e324)", 2024-02-10T08:32:39.522 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:32:09.866902+0000", 2024-02-10T08:32:39.522 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 29.551421946000001, 2024-02-10T08:32:39.523 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.99183100000000002, 2024-02-10T08:32:39.523 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:32:39.523 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-02-10T08:32:39.523 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:32:39.523 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.15198", 2024-02-10T08:32:39.523 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/1957604827", 2024-02-10T08:32:39.523 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 243428 2024-02-10T08:32:39.523 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.523 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:32:39.523 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.523 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:32:39.523 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:09.866902+0000", 2024-02-10T08:32:39.523 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:32:39.523 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.524 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.524 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:32:39.524 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:09.866902+0000", 2024-02-10T08:32:39.524 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:32:39.524 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.524 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.524 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:32:39.524 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:09.866902+0000", 2024-02-10T08:32:39.524 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8039999999999999e-06 2024-02-10T08:32:39.524 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.524 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.524 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:32:39.524 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:09.866905+0000", 2024-02-10T08:32:39.524 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4400000000000005e-06 2024-02-10T08:32:39.525 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.525 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.525 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:32:39.525 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:09.866914+0000", 2024-02-10T08:32:39.525 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3640000000000001e-06 2024-02-10T08:32:39.525 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.525 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.525 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:32:39.525 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:09.866918+0000", 2024-02-10T08:32:39.525 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1046e-05 2024-02-10T08:32:39.525 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.525 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.525 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:32:39.526 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:09.866959+0000", 2024-02-10T08:32:39.526 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5783000000000002e-05 2024-02-10T08:32:39.526 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.526 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.526 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:32:39.526 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:09.867045+0000", 2024-02-10T08:32:39.526 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013255 2024-02-10T08:32:39.526 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.526 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.526 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,5,7", 2024-02-10T08:32:39.526 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:09.867178+0000", 2024-02-10T08:32:39.526 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.006038145 2024-02-10T08:32:39.526 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.527 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.527 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:32:39.527 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:09.873216+0000", 2024-02-10T08:32:39.527 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000135427 2024-02-10T08:32:39.527 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.527 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.527 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:32:39.527 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:09.873351+0000", 2024-02-10T08:32:39.527 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0022027470000000001 2024-02-10T08:32:39.527 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.527 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.527 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:32:39.528 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:09.875554+0000", 2024-02-10T08:32:39.528 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.016118260999999998 2024-02-10T08:32:39.528 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.528 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.528 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:32:39.528 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:09.891672+0000", 2024-02-10T08:32:39.528 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7929999999999992e-06 2024-02-10T08:32:39.528 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.528 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.528 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:32:39.528 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:09.891682+0000", 2024-02-10T08:32:39.528 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.96698300599999998 2024-02-10T08:32:39.528 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.528 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.529 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:32:39.529 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:10.858665+0000", 2024-02-10T08:32:39.529 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8236000000000002e-05 2024-02-10T08:32:39.529 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.529 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.529 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:32:39.529 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:10.858733+0000", 2024-02-10T08:32:39.529 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.99183100000000002 2024-02-10T08:32:39.529 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:32:39.529 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:32:39.529 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:32:39.529 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.529 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.529 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.15198.0:243448 9.8 9:13b9afa0:::benchmark_data_smithi018_124176_object121709:head [delete] snapc 0=[] ondisk+write+known_if_redirected e325)", 2024-02-10T08:32:39.530 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:32:09.894768+0000", 2024-02-10T08:32:39.530 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 29.523555787999999, 2024-02-10T08:32:39.530 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.97583826699999998, 2024-02-10T08:32:39.530 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:32:39.530 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:32:39.530 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:32:39.530 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.15198", 2024-02-10T08:32:39.530 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/1957604827", 2024-02-10T08:32:39.530 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 243448 2024-02-10T08:32:39.530 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.530 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:32:39.530 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.531 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:32:39.531 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:09.894768+0000", 2024-02-10T08:32:39.531 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:32:39.531 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.531 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.531 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:32:39.531 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:09.894768+0000", 2024-02-10T08:32:39.531 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:32:39.531 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.531 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.531 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:32:39.532 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:09.894767+0000", 2024-02-10T08:32:39.532 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6890000000000001e-06 2024-02-10T08:32:39.532 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.532 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.532 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:32:39.532 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:09.894773+0000", 2024-02-10T08:32:39.532 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2559999999999996e-06 2024-02-10T08:32:39.532 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.532 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.532 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:32:39.532 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:09.894780+0000", 2024-02-10T08:32:39.532 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5480000000000001e-06 2024-02-10T08:32:39.532 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.532 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.533 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:32:39.533 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:09.894785+0000", 2024-02-10T08:32:39.533 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8230000000000002e-05 2024-02-10T08:32:39.533 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.533 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.533 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:32:39.533 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:09.894854+0000", 2024-02-10T08:32:39.533 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8369999999999996e-06 2024-02-10T08:32:39.533 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.533 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.533 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:32:39.533 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:09.894858+0000", 2024-02-10T08:32:39.533 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.96391036399999996 2024-02-10T08:32:39.533 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.534 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.534 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:32:39.534 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:10.858769+0000", 2024-02-10T08:32:39.534 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0735999999999994e-05 2024-02-10T08:32:39.534 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.534 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.534 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:32:39.534 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:10.858850+0000", 2024-02-10T08:32:39.534 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4689000000000001e-05 2024-02-10T08:32:39.534 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.534 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.534 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,5", 2024-02-10T08:32:39.534 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:10.858944+0000", 2024-02-10T08:32:39.534 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011207072 2024-02-10T08:32:39.535 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.535 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.535 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:32:39.535 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:10.870151+0000", 2024-02-10T08:32:39.535 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00030170099999999998 2024-02-10T08:32:39.535 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.535 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.535 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:32:39.535 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:10.870453+0000", 2024-02-10T08:32:39.535 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5429999999999999e-05 2024-02-10T08:32:39.535 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.535 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.536 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:32:39.536 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:10.870548+0000", 2024-02-10T08:32:39.536 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1998000000000001e-05 2024-02-10T08:32:39.536 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.536 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.536 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:32:39.536 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:10.870580+0000", 2024-02-10T08:32:39.536 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.6271999999999999e-05 2024-02-10T08:32:39.536 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.536 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.536 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:32:39.536 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:10.870607+0000", 2024-02-10T08:32:39.536 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.97583826699999998 2024-02-10T08:32:39.537 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:32:39.537 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:32:39.537 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:32:39.537 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.537 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.537 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.15198.0:243455 9.8 9:1ae4817e:::benchmark_data_smithi018_124176_object121716:head [delete] snapc 0=[] ondisk+write+known_if_redirected e325)", 2024-02-10T08:32:39.537 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:32:09.896717+0000", 2024-02-10T08:32:39.537 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 29.521606738999999, 2024-02-10T08:32:39.537 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.97400673999999998, 2024-02-10T08:32:39.537 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:32:39.537 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:32:39.537 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:32:39.537 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.15198", 2024-02-10T08:32:39.537 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/1957604827", 2024-02-10T08:32:39.537 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 243455 2024-02-10T08:32:39.538 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.538 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:32:39.538 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.538 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:32:39.538 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:09.896717+0000", 2024-02-10T08:32:39.538 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:32:39.538 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.538 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.538 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:32:39.538 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:09.896717+0000", 2024-02-10T08:32:39.538 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:32:39.538 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.538 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.538 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:32:39.539 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:09.896716+0000", 2024-02-10T08:32:39.539 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7170000000000002e-06 2024-02-10T08:32:39.539 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.539 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.539 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:32:39.539 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:09.896723+0000", 2024-02-10T08:32:39.539 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4833e-05 2024-02-10T08:32:39.539 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.539 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.539 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:32:39.539 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:09.896738+0000", 2024-02-10T08:32:39.539 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0639999999999996e-06 2024-02-10T08:32:39.539 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.539 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.540 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:32:39.540 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:09.896745+0000", 2024-02-10T08:32:39.540 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0671999999999999e-05 2024-02-10T08:32:39.540 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.540 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.540 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:32:39.540 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:09.896796+0000", 2024-02-10T08:32:39.540 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1279999999999997e-06 2024-02-10T08:32:39.541 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.541 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.541 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:32:39.541 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:09.896805+0000", 2024-02-10T08:32:39.541 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.96549583400000005 2024-02-10T08:32:39.541 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.541 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.541 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:32:39.541 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:10.862301+0000", 2024-02-10T08:32:39.541 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6865000000000003e-05 2024-02-10T08:32:39.541 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.541 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.542 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:32:39.542 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:10.862387+0000", 2024-02-10T08:32:39.542 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9131999999999999e-05 2024-02-10T08:32:39.542 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.542 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.542 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,5", 2024-02-10T08:32:39.542 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:10.862487+0000", 2024-02-10T08:32:39.542 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0079165209999999993 2024-02-10T08:32:39.542 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.542 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.542 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:32:39.542 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:10.870403+0000", 2024-02-10T08:32:39.542 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010823300000000001 2024-02-10T08:32:39.543 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.543 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.543 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:32:39.543 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:10.870511+0000", 2024-02-10T08:32:39.543 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000151201 2024-02-10T08:32:39.543 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.543 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.543 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:32:39.543 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:10.870662+0000", 2024-02-10T08:32:39.543 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9747000000000002e-05 2024-02-10T08:32:39.543 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.543 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.543 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:32:39.543 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:10.870692+0000", 2024-02-10T08:32:39.543 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1996000000000003e-05 2024-02-10T08:32:39.544 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.544 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.544 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:32:39.544 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:10.870724+0000", 2024-02-10T08:32:39.544 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.97400673999999998 2024-02-10T08:32:39.544 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:32:39.544 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:32:39.544 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:32:39.544 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.544 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.544 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.15198.0:243464 9.8 9:1b97ec94:::benchmark_data_smithi018_124176_object121725:head [delete] snapc 0=[] ondisk+write+known_if_redirected e325)", 2024-02-10T08:32:39.544 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:32:09.909392+0000", 2024-02-10T08:32:39.544 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 29.508932089999998, 2024-02-10T08:32:39.544 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.96150460900000001, 2024-02-10T08:32:39.545 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:32:39.545 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:32:39.545 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:32:39.545 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.15198", 2024-02-10T08:32:39.545 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/1957604827", 2024-02-10T08:32:39.545 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 243464 2024-02-10T08:32:39.545 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.545 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:32:39.545 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.545 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:32:39.545 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:09.909392+0000", 2024-02-10T08:32:39.545 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:32:39.545 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.545 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.545 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:32:39.545 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:09.909392+0000", 2024-02-10T08:32:39.546 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:32:39.546 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.546 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.546 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:32:39.546 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:09.909391+0000", 2024-02-10T08:32:39.546 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3550000000000004e-06 2024-02-10T08:32:39.546 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.546 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.546 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:32:39.546 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:09.909397+0000", 2024-02-10T08:32:39.546 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0166999999999999e-05 2024-02-10T08:32:39.546 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.546 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.546 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:32:39.546 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:09.909407+0000", 2024-02-10T08:32:39.546 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8189999999999999e-06 2024-02-10T08:32:39.547 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.547 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.547 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:32:39.547 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:09.909412+0000", 2024-02-10T08:32:39.547 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3338999999999999e-05 2024-02-10T08:32:39.547 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.547 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.547 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:32:39.547 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:09.909465+0000", 2024-02-10T08:32:39.547 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0485e-05 2024-02-10T08:32:39.547 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.547 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.547 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:32:39.547 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:09.909475+0000", 2024-02-10T08:32:39.548 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.95721933400000003 2024-02-10T08:32:39.548 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.548 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.548 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:32:39.548 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:10.866695+0000", 2024-02-10T08:32:39.548 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4287000000000001e-05 2024-02-10T08:32:39.548 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.548 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.548 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:32:39.548 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:10.866779+0000", 2024-02-10T08:32:39.548 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2991000000000005e-05 2024-02-10T08:32:39.549 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.549 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.549 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,5", 2024-02-10T08:32:39.549 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:10.866872+0000", 2024-02-10T08:32:39.549 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0035403259999999999 2024-02-10T08:32:39.549 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.549 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.549 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:32:39.549 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:10.870412+0000", 2024-02-10T08:32:39.549 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00036614699999999999 2024-02-10T08:32:39.550 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.550 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.550 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:32:39.550 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:10.870778+0000", 2024-02-10T08:32:39.550 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2281999999999997e-05 2024-02-10T08:32:39.550 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.550 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.550 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:32:39.550 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:10.870851+0000", 2024-02-10T08:32:39.550 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.4898000000000001e-05 2024-02-10T08:32:39.550 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.550 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.550 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:32:39.550 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:10.870876+0000", 2024-02-10T08:32:39.551 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1135999999999999e-05 2024-02-10T08:32:39.551 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:32:39.551 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:32:39.551 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:32:39.551 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:10.870897+0000", 2024-02-10T08:32:39.551 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.96150460900000001 2024-02-10T08:32:39.551 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:32:39.551 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:32:39.551 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:32:39.551 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:32:39.551 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:32:39.551 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-02-10T08:32:39.552 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:40.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:38.951252+0000 mgr.y (mgr.14505) 597 : cluster [DBG] pgmap v740: 168 pgs: 2 active+recovering, 166 active+clean; 5.7 KiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 511 B/s rd, 0 op/s; 2/576 objects misplaced (0.347%); 109 B/s, 3 objects/s recovering 2024-02-10T08:32:40.369 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:38.951252+0000 mgr.y (mgr.14505) 597 : cluster [DBG] pgmap v740: 168 pgs: 2 active+recovering, 166 active+clean; 5.7 KiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 511 B/s rd, 0 op/s; 2/576 objects misplaced (0.347%); 109 B/s, 3 objects/s recovering 2024-02-10T08:32:40.369 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:38.951252+0000 mgr.y (mgr.14505) 597 : cluster [DBG] pgmap v740: 168 pgs: 2 active+recovering, 166 active+clean; 5.7 KiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 511 B/s rd, 0 op/s; 2/576 objects misplaced (0.347%); 109 B/s, 3 objects/s recovering 2024-02-10T08:32:40.806 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.1 dump_ops_in_flight 2024-02-10T08:32:40.863 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:32:40.867 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:40.868 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:32:40.968 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:32:40.995 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:41.451 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:32:41.454 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:41.455 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:32:41.556 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:32:41.586 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:41.736 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:32:41.739 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:41.739 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:32:41.811 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:32:41.840 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:32:41.870 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:42.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:40.951664+0000 mgr.y (mgr.14505) 598 : cluster [DBG] pgmap v741: 168 pgs: 2 active+recovering, 166 active+clean; 5.7 KiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 384 B/s rd, 0 op/s; 2/576 objects misplaced (0.347%); 82 B/s, 2 objects/s recovering 2024-02-10T08:32:42.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:40.951664+0000 mgr.y (mgr.14505) 598 : cluster [DBG] pgmap v741: 168 pgs: 2 active+recovering, 166 active+clean; 5.7 KiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 384 B/s rd, 0 op/s; 2/576 objects misplaced (0.347%); 82 B/s, 2 objects/s recovering 2024-02-10T08:32:42.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:41 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:40.951664+0000 mgr.y (mgr.14505) 598 : cluster [DBG] pgmap v741: 168 pgs: 2 active+recovering, 166 active+clean; 5.7 KiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 384 B/s rd, 0 op/s; 2/576 objects misplaced (0.347%); 82 B/s, 2 objects/s recovering 2024-02-10T08:32:43.015 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:32:43.020 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:32:43.023 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:43.024 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:32:43.124 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:32:43.155 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:43.733 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:32:44.018 INFO:teuthology.orchestra.run.smithi018.stderr:enabled application 'rados' on pool 'unique_pool_3' 2024-02-10T08:32:44.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:42.952264+0000 mgr.y (mgr.14505) 599 : cluster [DBG] pgmap v742: 168 pgs: 2 active+recovering, 166 active+clean; 5.7 KiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 2/576 objects misplaced (0.347%); 82 B/s, 2 objects/s recovering 2024-02-10T08:32:44.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:32:43.221884+0000 mon.c (mon.2) 78 : audit [INF] from='client.? 172.21.15.18:0/1375149527' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_3", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-02-10T08:32:44.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:32:43.222231+0000 mon.a (mon.0) 1508 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_3", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-02-10T08:32:44.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:42.952264+0000 mgr.y (mgr.14505) 599 : cluster [DBG] pgmap v742: 168 pgs: 2 active+recovering, 166 active+clean; 5.7 KiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 2/576 objects misplaced (0.347%); 82 B/s, 2 objects/s recovering 2024-02-10T08:32:44.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:32:43.221884+0000 mon.c (mon.2) 78 : audit [INF] from='client.? 172.21.15.18:0/1375149527' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_3", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-02-10T08:32:44.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:32:43.222231+0000 mon.a (mon.0) 1508 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_3", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-02-10T08:32:44.210 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:32:44.214 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:44.214 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:32:44.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:44 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:42.952264+0000 mgr.y (mgr.14505) 599 : cluster [DBG] pgmap v742: 168 pgs: 2 active+recovering, 166 active+clean; 5.7 KiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 2/576 objects misplaced (0.347%); 82 B/s, 2 objects/s recovering 2024-02-10T08:32:44.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:44 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:32:43.221884+0000 mon.c (mon.2) 78 : audit [INF] from='client.? 172.21.15.18:0/1375149527' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_3", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-02-10T08:32:44.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:44 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:32:43.222231+0000 mon.a (mon.0) 1508 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_3", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-02-10T08:32:44.315 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:32:44.344 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:44.364 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:32:44.366 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:44.366 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:32:44.467 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:32:44.497 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:45.047 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:32:45.051 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:45.052 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:32:45.152 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:32:45.184 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:45.206 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:32:45.208 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:45.209 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:32:45.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:32:44.013811+0000 mon.a (mon.0) 1509 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_3", "app": "rados", "yes_i_really_mean_it": true}]': finished 2024-02-10T08:32:45.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:44.013896+0000 mon.a (mon.0) 1510 : cluster [DBG] osdmap e341: 8 total, 8 up, 8 in 2024-02-10T08:32:45.310 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:32:45.339 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:32:44.013811+0000 mon.a (mon.0) 1509 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_3", "app": "rados", "yes_i_really_mean_it": true}]': finished 2024-02-10T08:32:45.339 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:44.013896+0000 mon.a (mon.0) 1510 : cluster [DBG] osdmap e341: 8 total, 8 up, 8 in 2024-02-10T08:32:45.339 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:32:44.013811+0000 mon.a (mon.0) 1509 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_3", "app": "rados", "yes_i_really_mean_it": true}]': finished 2024-02-10T08:32:45.339 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:44.013896+0000 mon.a (mon.0) 1510 : cluster [DBG] osdmap e341: 8 total, 8 up, 8 in 2024-02-10T08:32:45.341 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:45.891 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:32:45.894 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:45.895 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:32:45.995 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:32:46.026 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:46.145 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:44.952597+0000 mgr.y (mgr.14505) 600 : cluster [DBG] pgmap v744: 168 pgs: 168 active+clean; 5.7 KiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 82 B/s, 2 objects/s recovering 2024-02-10T08:32:46.146 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:45.818704+0000 mon.a (mon.0) 1511 : cluster [DBG] osdmap e342: 8 total, 8 up, 8 in 2024-02-10T08:32:46.146 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:44.952597+0000 mgr.y (mgr.14505) 600 : cluster [DBG] pgmap v744: 168 pgs: 168 active+clean; 5.7 KiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 82 B/s, 2 objects/s recovering 2024-02-10T08:32:46.146 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:45.818704+0000 mon.a (mon.0) 1511 : cluster [DBG] osdmap e342: 8 total, 8 up, 8 in 2024-02-10T08:32:46.151 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:32:46.153 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:46.154 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:32:46.255 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:32:46.285 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:44.952597+0000 mgr.y (mgr.14505) 600 : cluster [DBG] pgmap v744: 168 pgs: 168 active+clean; 5.7 KiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 82 B/s, 2 objects/s recovering 2024-02-10T08:32:46.285 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:45.818704+0000 mon.a (mon.0) 1511 : cluster [DBG] osdmap e342: 8 total, 8 up, 8 in 2024-02-10T08:32:46.287 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:46.308 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:32:46.310 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:46.311 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:32:46.411 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:32:46.442 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:46.455 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:32:46.462 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:32:46.465 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:46.465 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:32:46.472 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:32:46.489 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:32:46.508 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:32:46.526 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:32:46.539 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:32:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:32:46] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:32:46.544 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:32:46.562 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:32:46.566 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:32:46.580 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:32:46.581 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-10T08:32:46.581 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-10T08:32:46.581 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-10T08:32:46.581 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-10T08:32:46.581 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-10T08:32:46.581 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-10T08:32:46.582 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-10T08:32:46.582 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-10T08:32:46.598 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:46.650 DEBUG:teuthology.orchestra.run.smithi018:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 65536 --object-size 65536 -p unique_pool_3 bench 90 write' 2024-02-10T08:32:46.652 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2024-02-10T08:32:46.653 INFO:teuthology.orchestra.run:waiting for 3000 2024-02-10T08:32:46.703 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:hints = 1 2024-02-10T08:32:46.704 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Maintaining 16 concurrent writes of 65536 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2024-02-10T08:32:46.704 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Object prefix: benchmark_data_smithi018_146618 2024-02-10T08:32:46.704 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-02-10T08:32:46.704 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 0 0 0 0 0 0 - 0 2024-02-10T08:32:47.047 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is set 2024-02-10T08:32:47.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:32:46.063864+0000 mon.c (mon.2) 79 : audit [INF] from='client.? 172.21.15.18:0/322590830' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:32:47.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:32:46.064207+0000 mon.a (mon.0) 1512 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:32:47.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:32:46.437366+0000 mon.a (mon.0) 1513 : audit [DBG] from='client.? 172.21.15.18:0/1867180714' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:32:47.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:32:46.672516+0000 mon.a (mon.0) 1514 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:32:47.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:32:46.063864+0000 mon.c (mon.2) 79 : audit [INF] from='client.? 172.21.15.18:0/322590830' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:32:47.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:32:46.064207+0000 mon.a (mon.0) 1512 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:32:47.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:32:46.437366+0000 mon.a (mon.0) 1513 : audit [DBG] from='client.? 172.21.15.18:0/1867180714' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:32:47.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:32:46.672516+0000 mon.a (mon.0) 1514 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:32:47.406 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:32:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:32:47] "GET /metrics HTTP/1.1" 200 176306 "" "Prometheus/2.33.4" 2024-02-10T08:32:47.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:32:46.063864+0000 mon.c (mon.2) 79 : audit [INF] from='client.? 172.21.15.18:0/322590830' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:32:47.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:32:46.064207+0000 mon.a (mon.0) 1512 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:32:47.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:32:46.437366+0000 mon.a (mon.0) 1513 : audit [DBG] from='client.? 172.21.15.18:0/1867180714' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:32:47.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:32:46.672516+0000 mon.a (mon.0) 1514 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:32:47.705 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 1 15 3580 3565 222.652 222.812 0.00982529 0.00445239 2024-02-10T08:32:48.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:46.953235+0000 mgr.y (mgr.14505) 601 : cluster [DBG] pgmap v746: 168 pgs: 168 active+clean; 5.7 KiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 0 B/s, 0 objects/s recovering 2024-02-10T08:32:48.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:47.018520+0000 mon.a (mon.0) 1515 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:32:48.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:32:47.032600+0000 mon.a (mon.0) 1516 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-10T08:32:48.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:47.032660+0000 mon.a (mon.0) 1517 : cluster [DBG] osdmap e343: 8 total, 8 up, 8 in 2024-02-10T08:32:48.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:46.953235+0000 mgr.y (mgr.14505) 601 : cluster [DBG] pgmap v746: 168 pgs: 168 active+clean; 5.7 KiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 0 B/s, 0 objects/s recovering 2024-02-10T08:32:48.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:47.018520+0000 mon.a (mon.0) 1515 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:32:48.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:32:47.032600+0000 mon.a (mon.0) 1516 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-10T08:32:48.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:47.032660+0000 mon.a (mon.0) 1517 : cluster [DBG] osdmap e343: 8 total, 8 up, 8 in 2024-02-10T08:32:48.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:46.953235+0000 mgr.y (mgr.14505) 601 : cluster [DBG] pgmap v746: 168 pgs: 168 active+clean; 5.7 KiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 0 B/s, 0 objects/s recovering 2024-02-10T08:32:48.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:47.018520+0000 mon.a (mon.0) 1515 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:32:48.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:32:47.032600+0000 mon.a (mon.0) 1516 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-10T08:32:48.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:47.032660+0000 mon.a (mon.0) 1517 : cluster [DBG] osdmap e343: 8 total, 8 up, 8 in 2024-02-10T08:32:48.705 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 2 16 7018 7002 218.705 214.812 0.00300503 0.00456521 2024-02-10T08:32:48.789 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:32:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:32:49.650 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:32:49.654 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:49.655 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:32:49.705 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 3 16 10258 10242 213.298 202.5 0.00361211 0.00468138 2024-02-10T08:32:49.755 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:32:49.801 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:49.824 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:32:49.830 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:49.830 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:32:49.931 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:32:49.985 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:50.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:32:48.485563+0000 mgr.y (mgr.14505) 602 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:32:50.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:48.954092+0000 mgr.y (mgr.14505) 603 : cluster [DBG] pgmap v748: 168 pgs: 168 active+clean; 218 MiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 853 B/s rd, 36 MiB/s wr, 582 op/s; 0 B/s, 0 objects/s recovering 2024-02-10T08:32:50.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:32:48.485563+0000 mgr.y (mgr.14505) 602 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:32:50.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:48.954092+0000 mgr.y (mgr.14505) 603 : cluster [DBG] pgmap v748: 168 pgs: 168 active+clean; 218 MiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 853 B/s rd, 36 MiB/s wr, 582 op/s; 0 B/s, 0 objects/s recovering 2024-02-10T08:32:50.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:32:48.485563+0000 mgr.y (mgr.14505) 602 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:32:50.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:48.954092+0000 mgr.y (mgr.14505) 603 : cluster [DBG] pgmap v748: 168 pgs: 168 active+clean; 218 MiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 853 B/s rd, 36 MiB/s wr, 582 op/s; 0 B/s, 0 objects/s recovering 2024-02-10T08:32:50.644 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:32:50.649 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:50.649 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:32:50.705 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 4 16 13019 13003 203.113 172.562 0.00471463 0.00491542 2024-02-10T08:32:50.751 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:32:50.793 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:50.829 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:32:50.834 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:50.834 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:32:50.935 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:32:50.986 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:51.040 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-10T08:32:51.580 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-02-10T08:32:51.580 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:32:51.645 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd unset noscrub 2024-02-10T08:32:51.705 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 5 16 15589 15573 194.611 160.625 0.00495098 0.00513303 2024-02-10T08:32:52.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:50.821523+0000 mon.a (mon.0) 1518 : cluster [DBG] osdmap e344: 8 total, 8 up, 8 in 2024-02-10T08:32:52.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:50.954576+0000 mgr.y (mgr.14505) 604 : cluster [DBG] pgmap v750: 168 pgs: 168 active+clean; 306 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 853 B/s rd, 51 MiB/s wr, 816 op/s 2024-02-10T08:32:52.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:50.821523+0000 mon.a (mon.0) 1518 : cluster [DBG] osdmap e344: 8 total, 8 up, 8 in 2024-02-10T08:32:52.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:50.954576+0000 mgr.y (mgr.14505) 604 : cluster [DBG] pgmap v750: 168 pgs: 168 active+clean; 306 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 853 B/s rd, 51 MiB/s wr, 816 op/s 2024-02-10T08:32:52.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:51 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:50.821523+0000 mon.a (mon.0) 1518 : cluster [DBG] osdmap e344: 8 total, 8 up, 8 in 2024-02-10T08:32:52.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:51 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:50.954576+0000 mgr.y (mgr.14505) 604 : cluster [DBG] pgmap v750: 168 pgs: 168 active+clean; 306 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 853 B/s rd, 51 MiB/s wr, 816 op/s 2024-02-10T08:32:52.705 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 6 16 18144 18128 188.789 159.688 0.00443514 0.00529012 2024-02-10T08:32:53.705 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 7 15 20547 20532 183.283 150.25 0.00533975 0.00544902 2024-02-10T08:32:54.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:54 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:52.955754+0000 mgr.y (mgr.14505) 605 : cluster [DBG] pgmap v751: 168 pgs: 168 active+clean; 875 MiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 1.4 KiB/s rd, 123 MiB/s wr, 1.96k op/s 2024-02-10T08:32:54.491 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:52.955754+0000 mgr.y (mgr.14505) 605 : cluster [DBG] pgmap v751: 168 pgs: 168 active+clean; 875 MiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 1.4 KiB/s rd, 123 MiB/s wr, 1.96k op/s 2024-02-10T08:32:54.491 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:52.955754+0000 mgr.y (mgr.14505) 605 : cluster [DBG] pgmap v751: 168 pgs: 168 active+clean; 875 MiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 1.4 KiB/s rd, 123 MiB/s wr, 1.96k op/s 2024-02-10T08:32:54.706 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 8 16 22751 22735 177.565 137.688 0.00626679 0.00562629 2024-02-10T08:32:55.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:53.874578+0000 osd.0 (osd.0) 165 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:32:55.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:53.874628+0000 osd.0 (osd.0) 166 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:32:55.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:32:53.992995+0000 mgr.y (mgr.14505) 606 : audit [DBG] from='client.25375 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-10T08:32:55.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:54.031923+0000 mon.a (mon.0) 1519 : cluster [DBG] osdmap e345: 8 total, 8 up, 8 in 2024-02-10T08:32:55.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:53.874578+0000 osd.0 (osd.0) 165 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:32:55.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:53.874628+0000 osd.0 (osd.0) 166 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:32:55.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:32:53.992995+0000 mgr.y (mgr.14505) 606 : audit [DBG] from='client.25375 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-10T08:32:55.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:54.031923+0000 mon.a (mon.0) 1519 : cluster [DBG] osdmap e345: 8 total, 8 up, 8 in 2024-02-10T08:32:55.472 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:32:55.478 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-02-10T08:32:55.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:53.874578+0000 osd.0 (osd.0) 165 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:32:55.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:53.874628+0000 osd.0 (osd.0) 166 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:32:55.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:32:53.992995+0000 mgr.y (mgr.14505) 606 : audit [DBG] from='client.25375 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-10T08:32:55.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:54.031923+0000 mon.a (mon.0) 1519 : cluster [DBG] osdmap e345: 8 total, 8 up, 8 in 2024-02-10T08:32:55.706 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 9 16 24995 24979 173.418 140.25 0.0071193 0.00576111 2024-02-10T08:32:56.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:54.956182+0000 mgr.y (mgr.14505) 607 : cluster [DBG] pgmap v753: 168 pgs: 168 active+clean; 1.1 GiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 1.3 KiB/s rd, 138 MiB/s wr, 2.21k op/s 2024-02-10T08:32:56.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:55.825058+0000 mon.a (mon.0) 1520 : cluster [DBG] osdmap e346: 8 total, 8 up, 8 in 2024-02-10T08:32:56.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:54.956182+0000 mgr.y (mgr.14505) 607 : cluster [DBG] pgmap v753: 168 pgs: 168 active+clean; 1.1 GiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 1.3 KiB/s rd, 138 MiB/s wr, 2.21k op/s 2024-02-10T08:32:56.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:55.825058+0000 mon.a (mon.0) 1520 : cluster [DBG] osdmap e346: 8 total, 8 up, 8 in 2024-02-10T08:32:56.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:54.956182+0000 mgr.y (mgr.14505) 607 : cluster [DBG] pgmap v753: 168 pgs: 168 active+clean; 1.1 GiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 1.3 KiB/s rd, 138 MiB/s wr, 2.21k op/s 2024-02-10T08:32:56.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:55.825058+0000 mon.a (mon.0) 1520 : cluster [DBG] osdmap e346: 8 total, 8 up, 8 in 2024-02-10T08:32:56.520 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:32:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:32:56] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:32:56.706 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 10 16 26588 26572 166.033 99.5625 0.00462227 0.00601678 2024-02-10T08:32:57.467 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:32:57.474 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:32:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:32:57] "GET /metrics HTTP/1.1" 200 176306 "" "Prometheus/2.33.4" 2024-02-10T08:32:57.499 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:57.500 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:32:57.506 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":751,"stamp":"2024-02-10T08:32:52.955158+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":917706410,"num_objects":14195,"num_object_clones":0,"num_object_copies":42585,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14195,"num_whiteouts":0,"num_read":2066,"num_read_kb":1818,"num_write":14716,"num_write_kb":896232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":230,"num_bytes_recovered":7872,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14843,"ondisk_log_size":14843,"up":504,"acting":504,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":504,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":6048424,"kb_used_data":2142056,"kb_used_omap":0,"kb_used_meta":3906303,"kb_avail":743912792,"statfs":{"total":767960285184,"available":761766699008,"internally_reserved":0,"allocated":2193465344,"data_stored":2189238355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":972,"internal_metadata":4000054324},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":917700608,"num_objects":14003,"num_object_clones":0,"num_object_copies":42009,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14003,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":14003,"num_write_kb":896192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.139235"},"pg_stats":[{"pgid":"6.33","version":"0'0","reported_seq":232,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.034625+0000","last_change":"2024-02-10T08:30:26.080816+0000","last_active":"2024-02-10T08:32:47.034625+0000","last_peered":"2024-02-10T08:32:47.034625+0000","last_clean":"2024-02-10T08:32:47.034625+0000","last_became_active":"2024-02-10T08:30:26.080326+0000","last_became_peered":"2024-02-10T08:30:26.080326+0000","last_unstale":"2024-02-10T08:32:47.034625+0000","last_undegraded":"2024-02-10T08:32:47.034625+0000","last_fullsized":"2024-02-10T08:32:47.034625+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:34.502781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:34.502781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2],"acting":[5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":334,"reported_epoch":342,"state":"active+clean","last_fresh":"2024-02-10T08:32:45.818791+0000","last_change":"2024-02-10T08:30:26.067603+0000","last_active":"2024-02-10T08:32:45.818791+0000","last_peered":"2024-02-10T08:32:45.818791+0000","last_clean":"2024-02-10T08:32:45.818791+0000","last_became_active":"2024-02-10T08:30:26.067019+0000","last_became_peered":"2024-02-10T08:30:26.067019+0000","last_unstale":"2024-02-10T08:32:45.818791+0000","last_undegraded":"2024-02-10T08:32:45.818791+0000","last_fullsized":"2024-02-10T08:32:45.818791+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:12.421034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:27.276490+0000","last_clean_scrub_stamp":"2024-02-10T08:29:12.421034+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.6","version":"344'1155","reported_seq":1172,"reported_epoch":344,"state":"active+clean","last_fresh":"2024-02-10T08:32:52.715654+0000","last_change":"2024-02-10T08:32:30.821933+0000","last_active":"2024-02-10T08:32:52.715654+0000","last_peered":"2024-02-10T08:32:52.715654+0000","last_clean":"2024-02-10T08:32:52.715654+0000","last_became_active":"2024-02-10T08:32:30.821631+0000","last_became_peered":"2024-02-10T08:32:30.821631+0000","last_unstale":"2024-02-10T08:32:52.715654+0000","last_undegraded":"2024-02-10T08:32:52.715654+0000","last_fullsized":"2024-02-10T08:32:52.715654+0000","mapping_epoch":335,"log_start":"0'0","ondisk_log_start":"0'0","created":335,"last_epoch_clean":336,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.947585+0000","log_size":1155,"ondisk_log_size":1155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":75694080,"num_objects":1155,"num_object_clones":0,"num_object_copies":3465,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1155,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1155,"num_write_kb":73920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4],"acting":[5,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"111'10","reported_seq":541,"reported_epoch":344,"state":"active+clean","last_fresh":"2024-02-10T08:32:50.835422+0000","last_change":"2024-02-10T08:28:29.196174+0000","last_active":"2024-02-10T08:32:50.835422+0000","last_peered":"2024-02-10T08:32:50.835422+0000","last_clean":"2024-02-10T08:32:50.835422+0000","last_became_active":"2024-02-10T08:20:46.399193+0000","last_became_peered":"2024-02-10T08:20:46.399193+0000","last_unstale":"2024-02-10T08:32:50.835422+0000","last_undegraded":"2024-02-10T08:32:50.835422+0000","last_fullsized":"2024-02-10T08:32:50.835422+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'10","last_scrub_stamp":"2024-02-10T08:28:29.196109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:28:29.196109+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"225'27","reported_seq":358,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.034018+0000","last_change":"2024-02-10T08:29:07.059712+0000","last_active":"2024-02-10T08:32:47.034018+0000","last_peered":"2024-02-10T08:32:47.034018+0000","last_clean":"2024-02-10T08:32:47.034018+0000","last_became_active":"2024-02-10T08:16:55.204597+0000","last_became_peered":"2024-02-10T08:16:55.204597+0000","last_unstale":"2024-02-10T08:32:47.034018+0000","last_undegraded":"2024-02-10T08:32:47.034018+0000","last_fullsized":"2024-02-10T08:32:47.034018+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'27","last_scrub_stamp":"2024-02-10T08:29:07.059646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:29:07.059646+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":349,"reported_epoch":342,"state":"active+clean","last_fresh":"2024-02-10T08:32:46.508364+0000","last_change":"2024-02-10T08:32:20.331056+0000","last_active":"2024-02-10T08:32:46.508364+0000","last_peered":"2024-02-10T08:32:46.508364+0000","last_clean":"2024-02-10T08:32:46.508364+0000","last_became_active":"2024-02-10T08:32:20.330612+0000","last_became_peered":"2024-02-10T08:32:20.330612+0000","last_unstale":"2024-02-10T08:32:46.508364+0000","last_undegraded":"2024-02-10T08:32:46.508364+0000","last_fullsized":"2024-02-10T08:32:46.508364+0000","mapping_epoch":331,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":332,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:24.554978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:29:24.554978+0000","last_clean_scrub_stamp":"2024-02-10T08:29:24.554978+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":338,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.035174+0000","last_change":"2024-02-10T08:30:24.063277+0000","last_active":"2024-02-10T08:32:47.035174+0000","last_peered":"2024-02-10T08:32:47.035174+0000","last_clean":"2024-02-10T08:32:47.035174+0000","last_became_active":"2024-02-10T08:30:24.062795+0000","last_became_peered":"2024-02-10T08:30:24.062795+0000","last_unstale":"2024-02-10T08:32:47.035174+0000","last_undegraded":"2024-02-10T08:32:47.035174+0000","last_fullsized":"2024-02-10T08:32:47.035174+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:30.227120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:20.392249+0000","last_clean_scrub_stamp":"2024-02-10T08:28:30.227120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"343'296","reported_seq":312,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.966673+0000","last_change":"2024-02-10T08:32:30.826128+0000","last_active":"2024-02-10T08:32:47.966673+0000","last_peered":"2024-02-10T08:32:47.966673+0000","last_clean":"2024-02-10T08:32:47.966673+0000","last_became_active":"2024-02-10T08:32:30.825592+0000","last_became_peered":"2024-02-10T08:32:30.825592+0000","last_unstale":"2024-02-10T08:32:47.966673+0000","last_undegraded":"2024-02-10T08:32:47.966673+0000","last_fullsized":"2024-02-10T08:32:47.966673+0000","mapping_epoch":335,"log_start":"0'0","ondisk_log_start":"0'0","created":335,"last_epoch_clean":336,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.947585+0000","log_size":296,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19398656,"num_objects":296,"num_object_clones":0,"num_object_copies":888,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":296,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":296,"num_write_kb":18944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"225'15","reported_seq":129,"reported_epoch":342,"state":"active+clean","last_fresh":"2024-02-10T08:32:46.506100+0000","last_change":"2024-02-10T08:32:18.530490+0000","last_active":"2024-02-10T08:32:46.506100+0000","last_peered":"2024-02-10T08:32:46.506100+0000","last_clean":"2024-02-10T08:32:46.506100+0000","last_became_active":"2024-02-10T08:28:02.770508+0000","last_became_peered":"2024-02-10T08:28:02.770508+0000","last_unstale":"2024-02-10T08:32:46.506100+0000","last_undegraded":"2024-02-10T08:32:46.506100+0000","last_fullsized":"2024-02-10T08:32:46.506100+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'15","last_scrub_stamp":"2024-02-10T08:32:18.530424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:32:18.530424+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":333,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.034496+0000","last_change":"2024-02-10T08:32:17.671792+0000","last_active":"2024-02-10T08:32:47.034496+0000","last_peered":"2024-02-10T08:32:47.034496+0000","last_clean":"2024-02-10T08:32:47.034496+0000","last_became_active":"2024-02-10T08:20:46.407311+0000","last_became_peered":"2024-02-10T08:20:46.407311+0000","last_unstale":"2024-02-10T08:32:47.034496+0000","last_undegraded":"2024-02-10T08:32:47.034496+0000","last_fullsized":"2024-02-10T08:32:47.034496+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:17.671622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:21.523096+0000","last_clean_scrub_stamp":"2024-02-10T08:32:17.671622+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":364,"reported_epoch":342,"state":"active+clean","last_fresh":"2024-02-10T08:32:46.507053+0000","last_change":"2024-02-10T08:32:21.483917+0000","last_active":"2024-02-10T08:32:46.507053+0000","last_peered":"2024-02-10T08:32:46.507053+0000","last_clean":"2024-02-10T08:32:46.507053+0000","last_became_active":"2024-02-10T08:31:33.882809+0000","last_became_peered":"2024-02-10T08:31:33.882809+0000","last_unstale":"2024-02-10T08:32:46.507053+0000","last_undegraded":"2024-02-10T08:32:46.507053+0000","last_fullsized":"2024-02-10T08:32:46.507053+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:21.482538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:32:21.482538+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"76'2","reported_seq":13,"reported_epoch":342,"state":"active+clean","last_fresh":"2024-02-10T08:32:46.504858+0000","last_change":"2024-02-10T08:32:36.979463+0000","last_active":"2024-02-10T08:32:46.504858+0000","last_peered":"2024-02-10T08:32:46.504858+0000","last_clean":"2024-02-10T08:32:46.504858+0000","last_became_active":"2024-02-10T08:32:36.979100+0000","last_became_peered":"2024-02-10T08:32:36.979100+0000","last_unstale":"2024-02-10T08:32:46.504858+0000","last_undegraded":"2024-02-10T08:32:46.504858+0000","last_fullsized":"2024-02-10T08:32:46.504858+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'2","last_scrub_stamp":"2024-02-10T08:28:20.073105+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2024-02-10T08:18:08.680038+0000","last_clean_scrub_stamp":"2024-02-10T08:28:20.073105+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":6,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"343'321","reported_seq":334,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:48.240442+0000","last_change":"2024-02-10T08:32:36.986316+0000","last_active":"2024-02-10T08:32:48.240442+0000","last_peered":"2024-02-10T08:32:48.240442+0000","last_clean":"2024-02-10T08:32:48.240442+0000","last_became_active":"2024-02-10T08:32:36.985786+0000","last_became_peered":"2024-02-10T08:32:36.985786+0000","last_unstale":"2024-02-10T08:32:48.240442+0000","last_undegraded":"2024-02-10T08:32:48.240442+0000","last_fullsized":"2024-02-10T08:32:48.240442+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":335,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.947585+0000","log_size":321,"ondisk_log_size":321,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":21037056,"num_objects":321,"num_object_clones":0,"num_object_copies":963,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":321,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":321,"num_write_kb":20544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"226'35","reported_seq":370,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.039750+0000","last_change":"2024-02-10T08:29:09.404681+0000","last_active":"2024-02-10T08:32:47.039750+0000","last_peered":"2024-02-10T08:32:47.039750+0000","last_clean":"2024-02-10T08:32:47.039750+0000","last_became_active":"2024-02-10T08:16:55.203415+0000","last_became_peered":"2024-02-10T08:16:55.203415+0000","last_unstale":"2024-02-10T08:32:47.039750+0000","last_undegraded":"2024-02-10T08:32:47.039750+0000","last_fullsized":"2024-02-10T08:32:47.039750+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"226'35","last_scrub_stamp":"2024-02-10T08:29:09.404577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:29:09.404577+0000","log_size":35,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":56,"num_read_kb":45,"num_write":36,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":340,"reported_epoch":342,"state":"active+clean","last_fresh":"2024-02-10T08:32:46.508049+0000","last_change":"2024-02-10T08:32:12.480970+0000","last_active":"2024-02-10T08:32:46.508049+0000","last_peered":"2024-02-10T08:32:46.508049+0000","last_clean":"2024-02-10T08:32:46.508049+0000","last_became_active":"2024-02-10T08:28:02.781029+0000","last_became_peered":"2024-02-10T08:28:02.781029+0000","last_unstale":"2024-02-10T08:32:46.508049+0000","last_undegraded":"2024-02-10T08:32:46.508049+0000","last_fullsized":"2024-02-10T08:32:46.508049+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:12.480865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:32:12.480865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":336,"reported_epoch":342,"state":"active+clean","last_fresh":"2024-02-10T08:32:46.508112+0000","last_change":"2024-02-10T08:32:29.593920+0000","last_active":"2024-02-10T08:32:46.508112+0000","last_peered":"2024-02-10T08:32:46.508112+0000","last_clean":"2024-02-10T08:32:46.508112+0000","last_became_active":"2024-02-10T08:28:02.779438+0000","last_became_peered":"2024-02-10T08:28:02.779438+0000","last_unstale":"2024-02-10T08:32:46.508112+0000","last_undegraded":"2024-02-10T08:32:46.508112+0000","last_fullsized":"2024-02-10T08:32:46.508112+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.593849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.593849+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.593849+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":324,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.039648+0000","last_change":"2024-02-10T08:28:22.114493+0000","last_active":"2024-02-10T08:32:47.039648+0000","last_peered":"2024-02-10T08:32:47.039648+0000","last_clean":"2024-02-10T08:32:47.039648+0000","last_became_active":"2024-02-10T08:24:18.645480+0000","last_became_peered":"2024-02-10T08:24:18.645480+0000","last_unstale":"2024-02-10T08:32:47.039648+0000","last_undegraded":"2024-02-10T08:32:47.039648+0000","last_fullsized":"2024-02-10T08:32:47.039648+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:22.114421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:22.114421+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,3],"acting":[7,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3","version":"343'279","reported_seq":294,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.968763+0000","last_change":"2024-02-10T08:32:30.825931+0000","last_active":"2024-02-10T08:32:47.968763+0000","last_peered":"2024-02-10T08:32:47.968763+0000","last_clean":"2024-02-10T08:32:47.968763+0000","last_became_active":"2024-02-10T08:32:30.825621+0000","last_became_peered":"2024-02-10T08:32:30.825621+0000","last_unstale":"2024-02-10T08:32:47.968763+0000","last_undegraded":"2024-02-10T08:32:47.968763+0000","last_fullsized":"2024-02-10T08:32:47.968763+0000","mapping_epoch":335,"log_start":"0'0","ondisk_log_start":"0'0","created":335,"last_epoch_clean":336,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.947585+0000","log_size":279,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":18284544,"num_objects":279,"num_object_clones":0,"num_object_copies":837,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":279,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":279,"num_write_kb":17856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"225'31","reported_seq":58,"reported_epoch":342,"state":"active+clean","last_fresh":"2024-02-10T08:32:45.819694+0000","last_change":"2024-02-10T08:32:31.309431+0000","last_active":"2024-02-10T08:32:45.819694+0000","last_peered":"2024-02-10T08:32:45.819694+0000","last_clean":"2024-02-10T08:32:45.819694+0000","last_became_active":"2024-02-10T08:31:46.070488+0000","last_became_peered":"2024-02-10T08:31:46.070488+0000","last_unstale":"2024-02-10T08:32:45.819694+0000","last_undegraded":"2024-02-10T08:32:45.819694+0000","last_fullsized":"2024-02-10T08:32:45.819694+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'31","last_scrub_stamp":"2024-02-10T08:32:31.309364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:32:31.309364+0000","log_size":31,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":48,"num_read_kb":38,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":374,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.040737+0000","last_change":"2024-02-10T08:32:11.282121+0000","last_active":"2024-02-10T08:32:47.040737+0000","last_peered":"2024-02-10T08:32:47.040737+0000","last_clean":"2024-02-10T08:32:47.040737+0000","last_became_active":"2024-02-10T08:20:46.399568+0000","last_became_peered":"2024-02-10T08:20:46.399568+0000","last_unstale":"2024-02-10T08:32:47.040737+0000","last_undegraded":"2024-02-10T08:32:47.040737+0000","last_fullsized":"2024-02-10T08:32:47.040737+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:11.282042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:32:11.282042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":342,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.033938+0000","last_change":"2024-02-10T08:29:24.690721+0000","last_active":"2024-02-10T08:32:47.033938+0000","last_peered":"2024-02-10T08:32:47.033938+0000","last_clean":"2024-02-10T08:32:47.033938+0000","last_became_active":"2024-02-10T08:28:02.764210+0000","last_became_peered":"2024-02-10T08:28:02.764210+0000","last_unstale":"2024-02-10T08:32:47.033938+0000","last_undegraded":"2024-02-10T08:32:47.033938+0000","last_fullsized":"2024-02-10T08:32:47.033938+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:24.690623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:24.690623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":288,"reported_epoch":342,"state":"active+clean","last_fresh":"2024-02-10T08:32:46.504764+0000","last_change":"2024-02-10T08:31:33.883772+0000","last_active":"2024-02-10T08:32:46.504764+0000","last_peered":"2024-02-10T08:32:46.504764+0000","last_clean":"2024-02-10T08:32:46.504764+0000","last_became_active":"2024-02-10T08:31:33.883457+0000","last_became_peered":"2024-02-10T08:31:33.883457+0000","last_unstale":"2024-02-10T08:32:46.504764+0000","last_undegraded":"2024-02-10T08:32:46.504764+0000","last_fullsized":"2024-02-10T08:32:46.504764+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:34.215363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:34.215363+0000","last_clean_scrub_stamp":"2024-02-10T08:28:34.215363+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2","version":"344'1179","reported_seq":1196,"reported_epoch":344,"state":"active+clean","last_fresh":"2024-02-10T08:32:52.807967+0000","last_change":"2024-02-10T08:32:30.822810+0000","last_active":"2024-02-10T08:32:52.807967+0000","last_peered":"2024-02-10T08:32:52.807967+0000","last_clean":"2024-02-10T08:32:52.807967+0000","last_became_active":"2024-02-10T08:32:30.822464+0000","last_became_peered":"2024-02-10T08:32:30.822464+0000","last_unstale":"2024-02-10T08:32:52.807967+0000","last_undegraded":"2024-02-10T08:32:52.807967+0000","last_fullsized":"2024-02-10T08:32:52.807967+0000","mapping_epoch":335,"log_start":"0'0","ondisk_log_start":"0'0","created":335,"last_epoch_clean":336,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.947585+0000","log_size":1179,"ondisk_log_size":1179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":77266944,"num_objects":1179,"num_object_clones":0,"num_object_copies":3537,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1179,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1179,"num_write_kb":75456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"225'20","reported_seq":331,"reported_epoch":342,"state":"active+clean","last_fresh":"2024-02-10T08:32:45.818598+0000","last_change":"2024-02-10T08:32:15.357432+0000","last_active":"2024-02-10T08:32:45.818598+0000","last_peered":"2024-02-10T08:32:45.818598+0000","last_clean":"2024-02-10T08:32:45.818598+0000","last_became_active":"2024-02-10T08:20:46.398973+0000","last_became_peered":"2024-02-10T08:20:46.398973+0000","last_unstale":"2024-02-10T08:32:45.818598+0000","last_undegraded":"2024-02-10T08:32:45.818598+0000","last_fullsized":"2024-02-10T08:32:45.818598+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'20","last_scrub_stamp":"2024-02-10T08:32:15.357342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:32:15.357342+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":24,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":318,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.035985+0000","last_change":"2024-02-10T08:32:27.711245+0000","last_active":"2024-02-10T08:32:47.035985+0000","last_peered":"2024-02-10T08:32:47.035985+0000","last_clean":"2024-02-10T08:32:47.035985+0000","last_became_active":"2024-02-10T08:16:52.785545+0000","last_became_peered":"2024-02-10T08:16:52.785545+0000","last_unstale":"2024-02-10T08:32:47.035985+0000","last_undegraded":"2024-02-10T08:32:47.035985+0000","last_fullsized":"2024-02-10T08:32:47.035985+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:27.711059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:32:27.711059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"62'8","reported_seq":517,"reported_epoch":342,"state":"active+clean","last_fresh":"2024-02-10T08:32:46.508768+0000","last_change":"2024-02-10T08:32:32.558184+0000","last_active":"2024-02-10T08:32:46.508768+0000","last_peered":"2024-02-10T08:32:46.508768+0000","last_clean":"2024-02-10T08:32:46.508768+0000","last_became_active":"2024-02-10T08:16:56.858101+0000","last_became_peered":"2024-02-10T08:16:56.858101+0000","last_unstale":"2024-02-10T08:32:46.508768+0000","last_undegraded":"2024-02-10T08:32:46.508768+0000","last_fullsized":"2024-02-10T08:32:46.508768+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'8","last_scrub_stamp":"2024-02-10T08:32:32.558115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:32:32.558115+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":290,"reported_epoch":342,"state":"active+clean","last_fresh":"2024-02-10T08:32:45.820191+0000","last_change":"2024-02-10T08:30:24.071630+0000","last_active":"2024-02-10T08:32:45.820191+0000","last_peered":"2024-02-10T08:32:45.820191+0000","last_clean":"2024-02-10T08:32:45.820191+0000","last_became_active":"2024-02-10T08:30:24.071020+0000","last_became_peered":"2024-02-10T08:30:24.071020+0000","last_unstale":"2024-02-10T08:32:45.820191+0000","last_undegraded":"2024-02-10T08:32:45.820191+0000","last_fullsized":"2024-02-10T08:32:45.820191+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:26.976023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:26.976023+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1","version":"343'698","reported_seq":714,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:49.928501+0000","last_change":"2024-02-10T08:32:30.824324+0000","last_active":"2024-02-10T08:32:49.928501+0000","last_peered":"2024-02-10T08:32:49.928501+0000","last_clean":"2024-02-10T08:32:49.928501+0000","last_became_active":"2024-02-10T08:32:30.823874+0000","last_became_peered":"2024-02-10T08:32:30.823874+0000","last_unstale":"2024-02-10T08:32:49.928501+0000","last_undegraded":"2024-02-10T08:32:49.928501+0000","last_fullsized":"2024-02-10T08:32:49.928501+0000","mapping_epoch":335,"log_start":"0'0","ondisk_log_start":"0'0","created":335,"last_epoch_clean":336,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.947585+0000","log_size":698,"ondisk_log_size":698,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":45744128,"num_objects":698,"num_object_clones":0,"num_object_copies":2094,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":698,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":698,"num_write_kb":44672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,0],"acting":[4,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"226'27","reported_seq":340,"reported_epoch":342,"state":"active+clean","last_fresh":"2024-02-10T08:32:46.508271+0000","last_change":"2024-02-10T08:32:23.474007+0000","last_active":"2024-02-10T08:32:46.508271+0000","last_peered":"2024-02-10T08:32:46.508271+0000","last_clean":"2024-02-10T08:32:46.508271+0000","last_became_active":"2024-02-10T08:20:46.401777+0000","last_became_peered":"2024-02-10T08:20:46.401777+0000","last_unstale":"2024-02-10T08:32:46.508271+0000","last_undegraded":"2024-02-10T08:32:46.508271+0000","last_fullsized":"2024-02-10T08:32:46.508271+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"226'27","last_scrub_stamp":"2024-02-10T08:32:23.473934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:32:23.473934+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":318,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.032858+0000","last_change":"2024-02-10T08:32:22.621095+0000","last_active":"2024-02-10T08:32:47.032858+0000","last_peered":"2024-02-10T08:32:47.032858+0000","last_clean":"2024-02-10T08:32:47.032858+0000","last_became_active":"2024-02-10T08:16:52.783634+0000","last_became_peered":"2024-02-10T08:16:52.783634+0000","last_unstale":"2024-02-10T08:32:47.032858+0000","last_undegraded":"2024-02-10T08:32:47.032858+0000","last_fullsized":"2024-02-10T08:32:47.032858+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:22.621006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:32:22.621006+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"318'14","reported_seq":52,"reported_epoch":342,"state":"active+clean","last_fresh":"2024-02-10T08:32:46.160853+0000","last_change":"2024-02-10T08:31:46.262891+0000","last_active":"2024-02-10T08:32:46.160853+0000","last_peered":"2024-02-10T08:32:46.160853+0000","last_clean":"2024-02-10T08:32:46.160853+0000","last_became_active":"2024-02-10T08:31:46.073265+0000","last_became_peered":"2024-02-10T08:31:46.073265+0000","last_unstale":"2024-02-10T08:32:46.160853+0000","last_undegraded":"2024-02-10T08:32:46.160853+0000","last_fullsized":"2024-02-10T08:32:46.160853+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'13","last_scrub_stamp":"2024-02-10T08:29:13.140622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:13.140622+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":338,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.037030+0000","last_change":"2024-02-10T08:32:36.979257+0000","last_active":"2024-02-10T08:32:47.037030+0000","last_peered":"2024-02-10T08:32:47.037030+0000","last_clean":"2024-02-10T08:32:47.037030+0000","last_became_active":"2024-02-10T08:32:36.978932+0000","last_became_peered":"2024-02-10T08:32:36.978932+0000","last_unstale":"2024-02-10T08:32:47.037030+0000","last_undegraded":"2024-02-10T08:32:47.037030+0000","last_fullsized":"2024-02-10T08:32:47.037030+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:36.163125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:36.163125+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.0","version":"344'1119","reported_seq":1136,"reported_epoch":344,"state":"active+clean","last_fresh":"2024-02-10T08:32:52.692084+0000","last_change":"2024-02-10T08:32:30.821784+0000","last_active":"2024-02-10T08:32:52.692084+0000","last_peered":"2024-02-10T08:32:52.692084+0000","last_clean":"2024-02-10T08:32:52.692084+0000","last_became_active":"2024-02-10T08:32:30.821494+0000","last_became_peered":"2024-02-10T08:32:30.821494+0000","last_unstale":"2024-02-10T08:32:52.692084+0000","last_undegraded":"2024-02-10T08:32:52.692084+0000","last_fullsized":"2024-02-10T08:32:52.692084+0000","mapping_epoch":335,"log_start":"0'0","ondisk_log_start":"0'0","created":335,"last_epoch_clean":336,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.947585+0000","log_size":1119,"ondisk_log_size":1119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":73334784,"num_objects":1119,"num_object_clones":0,"num_object_copies":3357,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1119,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1119,"num_write_kb":71616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,4],"acting":[6,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"225'24","reported_seq":338,"reported_epoch":342,"state":"active+clean","last_fresh":"2024-02-10T08:32:45.820293+0000","last_change":"2024-02-10T08:32:23.327031+0000","last_active":"2024-02-10T08:32:45.820293+0000","last_peered":"2024-02-10T08:32:45.820293+0000","last_clean":"2024-02-10T08:32:45.820293+0000","last_became_active":"2024-02-10T08:20:46.406023+0000","last_became_peered":"2024-02-10T08:20:46.406023+0000","last_unstale":"2024-02-10T08:32:45.820293+0000","last_undegraded":"2024-02-10T08:32:45.820293+0000","last_fullsized":"2024-02-10T08:32:45.820293+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'24","last_scrub_stamp":"2024-02-10T08:32:23.326944+0000","last_deep_scrub":"76'16","last_deep_scrub_stamp":"2024-02-10T08:18:07.909782+0000","last_clean_scrub_stamp":"2024-02-10T08:32:23.326944+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":335,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.040002+0000","last_change":"2024-02-10T08:32:13.217936+0000","last_active":"2024-02-10T08:32:47.040002+0000","last_peered":"2024-02-10T08:32:47.040002+0000","last_clean":"2024-02-10T08:32:47.040002+0000","last_became_active":"2024-02-10T08:28:02.768633+0000","last_became_peered":"2024-02-10T08:28:02.768633+0000","last_unstale":"2024-02-10T08:32:47.040002+0000","last_undegraded":"2024-02-10T08:32:47.040002+0000","last_fullsized":"2024-02-10T08:32:47.040002+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:13.217844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:32:13.217844+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":380,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.036597+0000","last_change":"2024-02-10T08:32:26.093026+0000","last_active":"2024-02-10T08:32:47.036597+0000","last_peered":"2024-02-10T08:32:47.036597+0000","last_clean":"2024-02-10T08:32:47.036597+0000","last_became_active":"2024-02-10T08:20:46.400500+0000","last_became_peered":"2024-02-10T08:20:46.400500+0000","last_unstale":"2024-02-10T08:32:47.036597+0000","last_undegraded":"2024-02-10T08:32:47.036597+0000","last_fullsized":"2024-02-10T08:32:47.036597+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:26.092899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:32:26.092899+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":250,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.039661+0000","last_change":"2024-02-10T08:31:33.881318+0000","last_active":"2024-02-10T08:32:47.039661+0000","last_peered":"2024-02-10T08:32:47.039661+0000","last_clean":"2024-02-10T08:32:47.039661+0000","last_became_active":"2024-02-10T08:31:33.880969+0000","last_became_peered":"2024-02-10T08:31:33.880969+0000","last_unstale":"2024-02-10T08:32:47.039661+0000","last_undegraded":"2024-02-10T08:32:47.039661+0000","last_fullsized":"2024-02-10T08:32:47.039661+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:15.491747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:20:30.227375+0000","last_clean_scrub_stamp":"2024-02-10T08:29:15.491747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.f","version":"344'1157","reported_seq":1174,"reported_epoch":344,"state":"active+clean","last_fresh":"2024-02-10T08:32:52.688598+0000","last_change":"2024-02-10T08:32:30.825662+0000","last_active":"2024-02-10T08:32:52.688598+0000","last_peered":"2024-02-10T08:32:52.688598+0000","last_clean":"2024-02-10T08:32:52.688598+0000","last_became_active":"2024-02-10T08:32:30.825140+0000","last_became_peered":"2024-02-10T08:32:30.825140+0000","last_unstale":"2024-02-10T08:32:52.688598+0000","last_undegraded":"2024-02-10T08:32:52.688598+0000","last_fullsized":"2024-02-10T08:32:52.688598+0000","mapping_epoch":335,"log_start":"0'0","ondisk_log_start":"0'0","created":335,"last_epoch_clean":336,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.947585+0000","log_size":1157,"ondisk_log_size":1157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":75825152,"num_objects":1157,"num_object_clones":0,"num_object_copies":3471,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1157,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1157,"num_write_kb":74048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"314'14","reported_seq":396,"reported_epoch":344,"state":"active+clean","last_fresh":"2024-02-10T08:32:50.835600+0000","last_change":"2024-02-10T08:31:33.979699+0000","last_active":"2024-02-10T08:32:50.835600+0000","last_peered":"2024-02-10T08:32:50.835600+0000","last_clean":"2024-02-10T08:32:50.835600+0000","last_became_active":"2024-02-10T08:31:33.890120+0000","last_became_peered":"2024-02-10T08:31:33.890120+0000","last_unstale":"2024-02-10T08:32:50.835600+0000","last_undegraded":"2024-02-10T08:32:50.835600+0000","last_fullsized":"2024-02-10T08:32:50.835600+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"199'13","last_scrub_stamp":"2024-02-10T08:29:15.700463+0000","last_deep_scrub":"199'13","last_deep_scrub_stamp":"2024-02-10T08:24:47.529439+0000","last_clean_scrub_stamp":"2024-02-10T08:29:15.700463+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"225'28","reported_seq":329,"reported_epoch":342,"state":"active+clean","last_fresh":"2024-02-10T08:32:45.818368+0000","last_change":"2024-02-10T08:29:24.036552+0000","last_active":"2024-02-10T08:32:45.818368+0000","last_peered":"2024-02-10T08:32:45.818368+0000","last_clean":"2024-02-10T08:32:45.818368+0000","last_became_active":"2024-02-10T08:20:46.400760+0000","last_became_peered":"2024-02-10T08:20:46.400760+0000","last_unstale":"2024-02-10T08:32:45.818368+0000","last_undegraded":"2024-02-10T08:32:45.818368+0000","last_fullsized":"2024-02-10T08:32:45.818368+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'28","last_scrub_stamp":"2024-02-10T08:29:24.036448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:29:24.036448+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":41,"num_read_kb":34,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":317,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.040149+0000","last_change":"2024-02-10T08:29:03.396846+0000","last_active":"2024-02-10T08:32:47.040149+0000","last_peered":"2024-02-10T08:32:47.040149+0000","last_clean":"2024-02-10T08:32:47.040149+0000","last_became_active":"2024-02-10T08:16:52.789020+0000","last_became_peered":"2024-02-10T08:16:52.789020+0000","last_unstale":"2024-02-10T08:32:47.040149+0000","last_undegraded":"2024-02-10T08:32:47.040149+0000","last_fullsized":"2024-02-10T08:32:47.040149+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:03.396727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:29:03.396727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":315,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.041029+0000","last_change":"2024-02-10T08:28:17.059779+0000","last_active":"2024-02-10T08:32:47.041029+0000","last_peered":"2024-02-10T08:32:47.041029+0000","last_clean":"2024-02-10T08:32:47.041029+0000","last_became_active":"2024-02-10T08:21:58.546976+0000","last_became_peered":"2024-02-10T08:21:58.546976+0000","last_unstale":"2024-02-10T08:32:47.041029+0000","last_undegraded":"2024-02-10T08:32:47.041029+0000","last_fullsized":"2024-02-10T08:32:47.041029+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:17.059697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:17.059697+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"343'705","reported_seq":721,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:49.964431+0000","last_change":"2024-02-10T08:32:30.825453+0000","last_active":"2024-02-10T08:32:49.964431+0000","last_peered":"2024-02-10T08:32:49.964431+0000","last_clean":"2024-02-10T08:32:49.964431+0000","last_became_active":"2024-02-10T08:32:30.825144+0000","last_became_peered":"2024-02-10T08:32:30.825144+0000","last_unstale":"2024-02-10T08:32:49.964431+0000","last_undegraded":"2024-02-10T08:32:49.964431+0000","last_fullsized":"2024-02-10T08:32:49.964431+0000","mapping_epoch":335,"log_start":"0'0","ondisk_log_start":"0'0","created":335,"last_epoch_clean":336,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.947585+0000","log_size":705,"ondisk_log_size":705,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":46202880,"num_objects":705,"num_object_clones":0,"num_object_copies":2115,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":705,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":705,"num_write_kb":45120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":307,"reported_epoch":342,"state":"active+clean","last_fresh":"2024-02-10T08:32:45.818465+0000","last_change":"2024-02-10T08:31:33.883835+0000","last_active":"2024-02-10T08:32:45.818465+0000","last_peered":"2024-02-10T08:32:45.818465+0000","last_clean":"2024-02-10T08:32:45.818465+0000","last_became_active":"2024-02-10T08:31:33.883569+0000","last_became_peered":"2024-02-10T08:31:33.883569+0000","last_unstale":"2024-02-10T08:32:45.818465+0000","last_undegraded":"2024-02-10T08:32:45.818465+0000","last_fullsized":"2024-02-10T08:32:45.818465+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:27.021108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:27.021108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"225'30","reported_seq":374,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.040314+0000","last_change":"2024-02-10T08:32:37.709766+0000","last_active":"2024-02-10T08:32:47.040314+0000","last_peered":"2024-02-10T08:32:47.040314+0000","last_clean":"2024-02-10T08:32:47.040314+0000","last_became_active":"2024-02-10T08:32:36.979685+0000","last_became_peered":"2024-02-10T08:32:36.979685+0000","last_unstale":"2024-02-10T08:32:47.040314+0000","last_undegraded":"2024-02-10T08:32:47.040314+0000","last_fullsized":"2024-02-10T08:32:47.040314+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'30","last_scrub_stamp":"2024-02-10T08:28:35.245660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:28:35.245660+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":51,"num_read_kb":39,"num_write":32,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,0],"acting":[7,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":328,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.035214+0000","last_change":"2024-02-10T08:29:04.701249+0000","last_active":"2024-02-10T08:32:47.035214+0000","last_peered":"2024-02-10T08:32:47.035214+0000","last_clean":"2024-02-10T08:32:47.035214+0000","last_became_active":"2024-02-10T08:20:46.407667+0000","last_became_peered":"2024-02-10T08:20:46.407667+0000","last_unstale":"2024-02-10T08:32:47.035214+0000","last_undegraded":"2024-02-10T08:32:47.035214+0000","last_fullsized":"2024-02-10T08:32:47.035214+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:04.701160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:29:04.701160+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":325,"reported_epoch":342,"state":"active+clean","last_fresh":"2024-02-10T08:32:45.818864+0000","last_change":"2024-02-10T08:32:25.358402+0000","last_active":"2024-02-10T08:32:45.818864+0000","last_peered":"2024-02-10T08:32:45.818864+0000","last_clean":"2024-02-10T08:32:45.818864+0000","last_became_active":"2024-02-10T08:31:33.882582+0000","last_became_peered":"2024-02-10T08:31:33.882582+0000","last_unstale":"2024-02-10T08:32:45.818864+0000","last_undegraded":"2024-02-10T08:32:45.818864+0000","last_fullsized":"2024-02-10T08:32:45.818864+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:25.358315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:25.358315+0000","last_clean_scrub_stamp":"2024-02-10T08:32:25.358315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.d","version":"344'1096","reported_seq":1122,"reported_epoch":344,"state":"active+clean","last_fresh":"2024-02-10T08:32:52.688714+0000","last_change":"2024-02-10T08:32:36.979514+0000","last_active":"2024-02-10T08:32:52.688714+0000","last_peered":"2024-02-10T08:32:52.688714+0000","last_clean":"2024-02-10T08:32:52.688714+0000","last_became_active":"2024-02-10T08:32:36.979091+0000","last_became_peered":"2024-02-10T08:32:36.979091+0000","last_unstale":"2024-02-10T08:32:52.688714+0000","last_undegraded":"2024-02-10T08:32:52.688714+0000","last_fullsized":"2024-02-10T08:32:52.688714+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":335,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.947585+0000","log_size":1096,"ondisk_log_size":1096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":71827456,"num_objects":1096,"num_object_clones":0,"num_object_copies":3288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1096,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1096,"num_write_kb":70144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":331,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.039896+0000","last_change":"2024-02-10T08:29:11.420173+0000","last_active":"2024-02-10T08:32:47.039896+0000","last_peered":"2024-02-10T08:32:47.039896+0000","last_clean":"2024-02-10T08:32:47.039896+0000","last_became_active":"2024-02-10T08:28:02.769069+0000","last_became_peered":"2024-02-10T08:28:02.769069+0000","last_unstale":"2024-02-10T08:32:47.039896+0000","last_undegraded":"2024-02-10T08:32:47.039896+0000","last_fullsized":"2024-02-10T08:32:47.039896+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:11.420031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:11.420031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"225'37","reported_seq":408,"reported_epoch":342,"state":"active+clean","last_fresh":"2024-02-10T08:32:46.505979+0000","last_change":"2024-02-10T08:28:33.205966+0000","last_active":"2024-02-10T08:32:46.505979+0000","last_peered":"2024-02-10T08:32:46.505979+0000","last_clean":"2024-02-10T08:32:46.505979+0000","last_became_active":"2024-02-10T08:28:25.951447+0000","last_became_peered":"2024-02-10T08:28:25.951447+0000","last_unstale":"2024-02-10T08:32:46.505979+0000","last_undegraded":"2024-02-10T08:32:46.505979+0000","last_fullsized":"2024-02-10T08:32:46.505979+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'37","last_scrub_stamp":"2024-02-10T08:28:33.205891+0000","last_deep_scrub":"199'27","last_deep_scrub_stamp":"2024-02-10T08:24:42.826442+0000","last_clean_scrub_stamp":"2024-02-10T08:28:33.205891+0000","log_size":37,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":53,"num_read_kb":39,"num_write":32,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":319,"reported_epoch":342,"state":"active+clean","last_fresh":"2024-02-10T08:32:46.508906+0000","last_change":"2024-02-10T08:32:36.972580+0000","last_active":"2024-02-10T08:32:46.508906+0000","last_peered":"2024-02-10T08:32:46.508906+0000","last_clean":"2024-02-10T08:32:46.508906+0000","last_became_active":"2024-02-10T08:32:36.972224+0000","last_became_peered":"2024-02-10T08:32:36.972224+0000","last_unstale":"2024-02-10T08:32:46.508906+0000","last_undegraded":"2024-02-10T08:32:46.508906+0000","last_fullsized":"2024-02-10T08:32:46.508906+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:20.457380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:32:20.457380+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4],"acting":[2,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":316,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.033028+0000","last_change":"2024-02-10T08:28:39.633777+0000","last_active":"2024-02-10T08:32:47.033028+0000","last_peered":"2024-02-10T08:32:47.033028+0000","last_clean":"2024-02-10T08:32:47.033028+0000","last_became_active":"2024-02-10T08:21:58.553966+0000","last_became_peered":"2024-02-10T08:21:58.553966+0000","last_unstale":"2024-02-10T08:32:47.033028+0000","last_undegraded":"2024-02-10T08:32:47.033028+0000","last_fullsized":"2024-02-10T08:32:47.033028+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:39.633627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:39.633627+0000","last_clean_scrub_stamp":"2024-02-10T08:28:39.633627+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.8","version":"343'328","reported_seq":344,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:48.233926+0000","last_change":"2024-02-10T08:32:30.824983+0000","last_active":"2024-02-10T08:32:48.233926+0000","last_peered":"2024-02-10T08:32:48.233926+0000","last_clean":"2024-02-10T08:32:48.233926+0000","last_became_active":"2024-02-10T08:32:30.824620+0000","last_became_peered":"2024-02-10T08:32:30.824620+0000","last_unstale":"2024-02-10T08:32:48.233926+0000","last_undegraded":"2024-02-10T08:32:48.233926+0000","last_fullsized":"2024-02-10T08:32:48.233926+0000","mapping_epoch":335,"log_start":"0'0","ondisk_log_start":"0'0","created":335,"last_epoch_clean":336,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.947585+0000","log_size":328,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":21495808,"num_objects":328,"num_object_clones":0,"num_object_copies":984,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":328,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":20992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7],"acting":[0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":335,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.036669+0000","last_change":"2024-02-10T08:29:14.145590+0000","last_active":"2024-02-10T08:32:47.036669+0000","last_peered":"2024-02-10T08:32:47.036669+0000","last_clean":"2024-02-10T08:32:47.036669+0000","last_became_active":"2024-02-10T08:28:02.772585+0000","last_became_peered":"2024-02-10T08:28:02.772585+0000","last_unstale":"2024-02-10T08:32:47.036669+0000","last_undegraded":"2024-02-10T08:32:47.036669+0000","last_fullsized":"2024-02-10T08:32:47.036669+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:14.145493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:41.360241+0000","last_clean_scrub_stamp":"2024-02-10T08:29:14.145493+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"225'24","reported_seq":27,"reported_epoch":342,"state":"active+clean","last_fresh":"2024-02-10T08:32:46.505572+0000","last_change":"2024-02-10T08:32:38.788491+0000","last_active":"2024-02-10T08:32:46.505572+0000","last_peered":"2024-02-10T08:32:46.505572+0000","last_clean":"2024-02-10T08:32:46.505572+0000","last_became_active":"2024-02-10T08:32:36.975366+0000","last_became_peered":"2024-02-10T08:32:36.975366+0000","last_unstale":"2024-02-10T08:32:46.505572+0000","last_undegraded":"2024-02-10T08:32:46.505572+0000","last_fullsized":"2024-02-10T08:32:46.505572+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'24","last_scrub_stamp":"2024-02-10T08:28:26.505270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:28:26.505270+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":335,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.039788+0000","last_change":"2024-02-10T08:32:28.402029+0000","last_active":"2024-02-10T08:32:47.039788+0000","last_peered":"2024-02-10T08:32:47.039788+0000","last_clean":"2024-02-10T08:32:47.039788+0000","last_became_active":"2024-02-10T08:28:02.760999+0000","last_became_peered":"2024-02-10T08:28:02.760999+0000","last_unstale":"2024-02-10T08:32:47.039788+0000","last_undegraded":"2024-02-10T08:32:47.039788+0000","last_fullsized":"2024-02-10T08:32:47.039788+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:28.401960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:28.401960+0000","last_clean_scrub_stamp":"2024-02-10T08:32:28.401960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":308,"reported_epoch":342,"state":"active+clean","last_fresh":"2024-02-10T08:32:46.505443+0000","last_change":"2024-02-10T08:31:46.063634+0000","last_active":"2024-02-10T08:32:46.505443+0000","last_peered":"2024-02-10T08:32:46.505443+0000","last_clean":"2024-02-10T08:32:46.505443+0000","last_became_active":"2024-02-10T08:31:46.063039+0000","last_became_peered":"2024-02-10T08:31:46.063039+0000","last_unstale":"2024-02-10T08:32:46.505443+0000","last_undegraded":"2024-02-10T08:32:46.505443+0000","last_fullsized":"2024-02-10T08:32:46.505443+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:06.426390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:20.736224+0000","last_clean_scrub_stamp":"2024-02-10T08:29:06.426390+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":334,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.033967+0000","last_change":"2024-02-10T08:32:32.713980+0000","last_active":"2024-02-10T08:32:47.033967+0000","last_peered":"2024-02-10T08:32:47.033967+0000","last_clean":"2024-02-10T08:32:47.033967+0000","last_became_active":"2024-02-10T08:28:19.022399+0000","last_became_peered":"2024-02-10T08:28:19.022399+0000","last_unstale":"2024-02-10T08:32:47.033967+0000","last_undegraded":"2024-02-10T08:32:47.033967+0000","last_fullsized":"2024-02-10T08:32:47.033967+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:32.713921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:32:32.713921+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"344'1162","reported_seq":1179,"reported_epoch":344,"state":"active+clean","last_fresh":"2024-02-10T08:32:52.670938+0000","last_change":"2024-02-10T08:32:30.823934+0000","last_active":"2024-02-10T08:32:52.670938+0000","last_peered":"2024-02-10T08:32:52.670938+0000","last_clean":"2024-02-10T08:32:52.670938+0000","last_became_active":"2024-02-10T08:32:30.823591+0000","last_became_peered":"2024-02-10T08:32:30.823591+0000","last_unstale":"2024-02-10T08:32:52.670938+0000","last_undegraded":"2024-02-10T08:32:52.670938+0000","last_fullsized":"2024-02-10T08:32:52.670938+0000","mapping_epoch":335,"log_start":"0'0","ondisk_log_start":"0'0","created":335,"last_epoch_clean":336,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.947585+0000","log_size":1162,"ondisk_log_size":1162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":76152832,"num_objects":1162,"num_object_clones":0,"num_object_copies":3486,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1162,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1162,"num_write_kb":74368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,0],"acting":[6,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":313,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.040745+0000","last_change":"2024-02-10T08:29:13.416528+0000","last_active":"2024-02-10T08:32:47.040745+0000","last_peered":"2024-02-10T08:32:47.040745+0000","last_clean":"2024-02-10T08:32:47.040745+0000","last_became_active":"2024-02-10T08:16:56.867159+0000","last_became_peered":"2024-02-10T08:16:56.867159+0000","last_unstale":"2024-02-10T08:32:47.040745+0000","last_undegraded":"2024-02-10T08:32:47.040745+0000","last_fullsized":"2024-02-10T08:32:47.040745+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:13.416461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:04.766780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:13.416461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"225'33","reported_seq":377,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.040017+0000","last_change":"2024-02-10T08:29:20.522358+0000","last_active":"2024-02-10T08:32:47.040017+0000","last_peered":"2024-02-10T08:32:47.040017+0000","last_clean":"2024-02-10T08:32:47.040017+0000","last_became_active":"2024-02-10T08:20:46.401981+0000","last_became_peered":"2024-02-10T08:20:46.401981+0000","last_unstale":"2024-02-10T08:32:47.040017+0000","last_undegraded":"2024-02-10T08:32:47.040017+0000","last_fullsized":"2024-02-10T08:32:47.040017+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'33","last_scrub_stamp":"2024-02-10T08:29:20.522259+0000","last_deep_scrub":"223'21","last_deep_scrub_stamp":"2024-02-10T08:26:33.250614+0000","last_clean_scrub_stamp":"2024-02-10T08:29:20.522259+0000","log_size":33,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":33,"num_write":25,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":346,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.039870+0000","last_change":"2024-02-10T08:32:36.980106+0000","last_active":"2024-02-10T08:32:47.039870+0000","last_peered":"2024-02-10T08:32:47.039870+0000","last_clean":"2024-02-10T08:32:47.039870+0000","last_became_active":"2024-02-10T08:32:36.979237+0000","last_became_peered":"2024-02-10T08:32:36.979237+0000","last_unstale":"2024-02-10T08:32:47.039870+0000","last_undegraded":"2024-02-10T08:32:47.039870+0000","last_fullsized":"2024-02-10T08:32:47.039870+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:16.187704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:14:44.584370+0000","last_clean_scrub_stamp":"2024-02-10T08:32:16.187704+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":317,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.034880+0000","last_change":"2024-02-10T08:29:06.087344+0000","last_active":"2024-02-10T08:32:47.034880+0000","last_peered":"2024-02-10T08:32:47.034880+0000","last_clean":"2024-02-10T08:32:47.034880+0000","last_became_active":"2024-02-10T08:16:52.788767+0000","last_became_peered":"2024-02-10T08:16:52.788767+0000","last_unstale":"2024-02-10T08:32:47.034880+0000","last_undegraded":"2024-02-10T08:32:47.034880+0000","last_fullsized":"2024-02-10T08:32:47.034880+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:06.087258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:29:06.087258+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":246,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.035519+0000","last_change":"2024-02-10T08:32:29.019898+0000","last_active":"2024-02-10T08:32:47.035519+0000","last_peered":"2024-02-10T08:32:47.035519+0000","last_clean":"2024-02-10T08:32:47.035519+0000","last_became_active":"2024-02-10T08:31:33.878588+0000","last_became_peered":"2024-02-10T08:31:33.878588+0000","last_unstale":"2024-02-10T08:32:47.035519+0000","last_undegraded":"2024-02-10T08:32:47.035519+0000","last_fullsized":"2024-02-10T08:32:47.035519+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.019819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.019819+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.019819+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":44,"reported_epoch":342,"state":"active+clean","last_fresh":"2024-02-10T08:32:46.505881+0000","last_change":"2024-02-10T08:31:19.726867+0000","last_active":"2024-02-10T08:32:46.505881+0000","last_peered":"2024-02-10T08:32:46.505881+0000","last_clean":"2024-02-10T08:32:46.505881+0000","last_became_active":"2024-02-10T08:31:19.726561+0000","last_became_peered":"2024-02-10T08:31:19.726561+0000","last_unstale":"2024-02-10T08:32:46.505881+0000","last_undegraded":"2024-02-10T08:32:46.505881+0000","last_fullsized":"2024-02-10T08:32:46.505881+0000","mapping_epoch":308,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":309,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:25.198277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:26:29.921562+0000","last_clean_scrub_stamp":"2024-02-10T08:29:25.198277+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"344'1154","reported_seq":1171,"reported_epoch":344,"state":"active+clean","last_fresh":"2024-02-10T08:32:52.731784+0000","last_change":"2024-02-10T08:32:30.825343+0000","last_active":"2024-02-10T08:32:52.731784+0000","last_peered":"2024-02-10T08:32:52.731784+0000","last_clean":"2024-02-10T08:32:52.731784+0000","last_became_active":"2024-02-10T08:32:30.824975+0000","last_became_peered":"2024-02-10T08:32:30.824975+0000","last_unstale":"2024-02-10T08:32:52.731784+0000","last_undegraded":"2024-02-10T08:32:52.731784+0000","last_fullsized":"2024-02-10T08:32:52.731784+0000","mapping_epoch":335,"log_start":"0'0","ondisk_log_start":"0'0","created":335,"last_epoch_clean":336,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.947585+0000","log_size":1154,"ondisk_log_size":1154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":75628544,"num_objects":1154,"num_object_clones":0,"num_object_copies":3462,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1154,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1154,"num_write_kb":73856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":313,"reported_epoch":342,"state":"active+clean","last_fresh":"2024-02-10T08:32:46.508549+0000","last_change":"2024-02-10T08:29:23.504992+0000","last_active":"2024-02-10T08:32:46.508549+0000","last_peered":"2024-02-10T08:32:46.508549+0000","last_clean":"2024-02-10T08:32:46.508549+0000","last_became_active":"2024-02-10T08:16:56.857856+0000","last_became_peered":"2024-02-10T08:16:56.857856+0000","last_unstale":"2024-02-10T08:32:46.508549+0000","last_undegraded":"2024-02-10T08:32:46.508549+0000","last_fullsized":"2024-02-10T08:32:46.508549+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:23.504892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:23.504892+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"225'17","reported_seq":107,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.041296+0000","last_change":"2024-02-10T08:32:37.438518+0000","last_active":"2024-02-10T08:32:47.041296+0000","last_peered":"2024-02-10T08:32:47.041296+0000","last_clean":"2024-02-10T08:32:47.041296+0000","last_became_active":"2024-02-10T08:32:36.984195+0000","last_became_peered":"2024-02-10T08:32:36.984195+0000","last_unstale":"2024-02-10T08:32:47.041296+0000","last_undegraded":"2024-02-10T08:32:47.041296+0000","last_fullsized":"2024-02-10T08:32:47.041296+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'17","last_scrub_stamp":"2024-02-10T08:28:38.619521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:28:38.619521+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":23,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":358,"reported_epoch":342,"state":"active+clean","last_fresh":"2024-02-10T08:32:46.506780+0000","last_change":"2024-02-10T08:32:26.529397+0000","last_active":"2024-02-10T08:32:46.506780+0000","last_peered":"2024-02-10T08:32:46.506780+0000","last_clean":"2024-02-10T08:32:46.506780+0000","last_became_active":"2024-02-10T08:31:33.884021+0000","last_became_peered":"2024-02-10T08:31:33.884021+0000","last_unstale":"2024-02-10T08:32:46.506780+0000","last_undegraded":"2024-02-10T08:32:46.506780+0000","last_fullsized":"2024-02-10T08:32:46.506780+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:26.529314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:11.681169+0000","last_clean_scrub_stamp":"2024-02-10T08:32:26.529314+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"63'5","reported_seq":1271,"reported_epoch":344,"state":"active+clean","last_fresh":"2024-02-10T08:32:51.605579+0000","last_change":"2024-02-10T08:32:19.667323+0000","last_active":"2024-02-10T08:32:51.605579+0000","last_peered":"2024-02-10T08:32:51.605579+0000","last_clean":"2024-02-10T08:32:51.605579+0000","last_became_active":"2024-02-10T08:16:52.780989+0000","last_became_peered":"2024-02-10T08:16:52.780989+0000","last_unstale":"2024-02-10T08:32:51.605579+0000","last_undegraded":"2024-02-10T08:32:51.605579+0000","last_fullsized":"2024-02-10T08:32:51.605579+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'5","last_scrub_stamp":"2024-02-10T08:32:19.667251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:32:19.667251+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":950,"num_read_kb":945,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":321,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.040824+0000","last_change":"2024-02-10T08:28:16.113780+0000","last_active":"2024-02-10T08:32:47.040824+0000","last_peered":"2024-02-10T08:32:47.040824+0000","last_clean":"2024-02-10T08:32:47.040824+0000","last_became_active":"2024-02-10T08:21:58.549733+0000","last_became_peered":"2024-02-10T08:21:58.549733+0000","last_unstale":"2024-02-10T08:32:47.040824+0000","last_undegraded":"2024-02-10T08:32:47.040824+0000","last_fullsized":"2024-02-10T08:32:47.040824+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:16.113690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:11.750537+0000","last_clean_scrub_stamp":"2024-02-10T08:28:16.113690+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.a","version":"344'1094","reported_seq":1120,"reported_epoch":344,"state":"active+clean","last_fresh":"2024-02-10T08:32:52.670573+0000","last_change":"2024-02-10T08:32:36.979236+0000","last_active":"2024-02-10T08:32:52.670573+0000","last_peered":"2024-02-10T08:32:52.670573+0000","last_clean":"2024-02-10T08:32:52.670573+0000","last_became_active":"2024-02-10T08:32:36.978852+0000","last_became_peered":"2024-02-10T08:32:36.978852+0000","last_unstale":"2024-02-10T08:32:52.670573+0000","last_undegraded":"2024-02-10T08:32:52.670573+0000","last_fullsized":"2024-02-10T08:32:52.670573+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":335,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.947585+0000","log_size":1094,"ondisk_log_size":1094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":71696384,"num_objects":1094,"num_object_clones":0,"num_object_copies":3282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1094,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1094,"num_write_kb":70016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":342,"state":"active+clean","last_fresh":"2024-02-10T08:32:46.505398+0000","last_change":"2024-02-10T08:32:36.976472+0000","last_active":"2024-02-10T08:32:46.505398+0000","last_peered":"2024-02-10T08:32:46.505398+0000","last_clean":"2024-02-10T08:32:46.505398+0000","last_became_active":"2024-02-10T08:32:36.976141+0000","last_became_peered":"2024-02-10T08:32:36.976141+0000","last_unstale":"2024-02-10T08:32:46.505398+0000","last_undegraded":"2024-02-10T08:32:46.505398+0000","last_fullsized":"2024-02-10T08:32:46.505398+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:26.703441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:26.703441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"314'42","reported_seq":637,"reported_epoch":344,"state":"active+clean","last_fresh":"2024-02-10T08:32:50.836186+0000","last_change":"2024-02-10T08:31:35.086145+0000","last_active":"2024-02-10T08:32:50.836186+0000","last_peered":"2024-02-10T08:32:50.836186+0000","last_clean":"2024-02-10T08:32:50.836186+0000","last_became_active":"2024-02-10T08:31:33.904487+0000","last_became_peered":"2024-02-10T08:31:33.904487+0000","last_unstale":"2024-02-10T08:32:50.836186+0000","last_undegraded":"2024-02-10T08:32:50.836186+0000","last_fullsized":"2024-02-10T08:32:50.836186+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":315,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'41","last_scrub_stamp":"2024-02-10T08:28:22.455139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:28:22.455139+0000","log_size":42,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":66,"num_read_kb":51,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":716,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":317,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.035388+0000","last_change":"2024-02-10T08:29:11.165779+0000","last_active":"2024-02-10T08:32:47.035388+0000","last_peered":"2024-02-10T08:32:47.035388+0000","last_clean":"2024-02-10T08:32:47.035388+0000","last_became_active":"2024-02-10T08:16:52.791027+0000","last_became_peered":"2024-02-10T08:16:52.791027+0000","last_unstale":"2024-02-10T08:32:47.035388+0000","last_undegraded":"2024-02-10T08:32:47.035388+0000","last_fullsized":"2024-02-10T08:32:47.035388+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:11.165678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:29:11.165678+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":340,"reported_epoch":342,"state":"active+clean","last_fresh":"2024-02-10T08:32:45.820141+0000","last_change":"2024-02-10T08:32:32.331364+0000","last_active":"2024-02-10T08:32:45.820141+0000","last_peered":"2024-02-10T08:32:45.820141+0000","last_clean":"2024-02-10T08:32:45.820141+0000","last_became_active":"2024-02-10T08:31:33.884295+0000","last_became_peered":"2024-02-10T08:31:33.884295+0000","last_unstale":"2024-02-10T08:32:45.820141+0000","last_undegraded":"2024-02-10T08:32:45.820141+0000","last_fullsized":"2024-02-10T08:32:45.820141+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:32.331286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:32:32.331286+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"344'1174","reported_seq":1191,"reported_epoch":344,"state":"active+clean","last_fresh":"2024-02-10T08:32:52.775913+0000","last_change":"2024-02-10T08:32:30.823074+0000","last_active":"2024-02-10T08:32:52.775913+0000","last_peered":"2024-02-10T08:32:52.775913+0000","last_clean":"2024-02-10T08:32:52.775913+0000","last_became_active":"2024-02-10T08:32:30.822769+0000","last_became_peered":"2024-02-10T08:32:30.822769+0000","last_unstale":"2024-02-10T08:32:52.775913+0000","last_undegraded":"2024-02-10T08:32:52.775913+0000","last_fullsized":"2024-02-10T08:32:52.775913+0000","mapping_epoch":335,"log_start":"0'0","ondisk_log_start":"0'0","created":335,"last_epoch_clean":336,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.947585+0000","log_size":1174,"ondisk_log_size":1174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":76939264,"num_objects":1174,"num_object_clones":0,"num_object_copies":3522,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1174,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1174,"num_write_kb":75136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"255'12","reported_seq":230,"reported_epoch":342,"state":"active+clean","last_fresh":"2024-02-10T08:32:46.505995+0000","last_change":"2024-02-10T08:32:25.571469+0000","last_active":"2024-02-10T08:32:46.505995+0000","last_peered":"2024-02-10T08:32:46.505995+0000","last_clean":"2024-02-10T08:32:46.505995+0000","last_became_active":"2024-02-10T08:28:25.952468+0000","last_became_peered":"2024-02-10T08:28:25.952468+0000","last_unstale":"2024-02-10T08:32:46.505995+0000","last_undegraded":"2024-02-10T08:32:46.505995+0000","last_fullsized":"2024-02-10T08:32:46.505995+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'12","last_scrub_stamp":"2024-02-10T08:32:25.571388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:32:25.571388+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"225'20","reported_seq":356,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.036088+0000","last_change":"2024-02-10T08:29:11.695106+0000","last_active":"2024-02-10T08:32:47.036088+0000","last_peered":"2024-02-10T08:32:47.036088+0000","last_clean":"2024-02-10T08:32:47.036088+0000","last_became_active":"2024-02-10T08:20:46.408495+0000","last_became_peered":"2024-02-10T08:20:46.408495+0000","last_unstale":"2024-02-10T08:32:47.036088+0000","last_undegraded":"2024-02-10T08:32:47.036088+0000","last_fullsized":"2024-02-10T08:32:47.036088+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'20","last_scrub_stamp":"2024-02-10T08:29:11.694999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:29:11.694999+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":331,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.033788+0000","last_change":"2024-02-10T08:28:21.409185+0000","last_active":"2024-02-10T08:32:47.033788+0000","last_peered":"2024-02-10T08:32:47.033788+0000","last_clean":"2024-02-10T08:32:47.033788+0000","last_became_active":"2024-02-10T08:28:02.760784+0000","last_became_peered":"2024-02-10T08:28:02.760784+0000","last_unstale":"2024-02-10T08:32:47.033788+0000","last_undegraded":"2024-02-10T08:32:47.033788+0000","last_fullsized":"2024-02-10T08:32:47.033788+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:21.409109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:28:21.409109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":236,"reported_epoch":342,"state":"active+clean","last_fresh":"2024-02-10T08:32:46.504794+0000","last_change":"2024-02-10T08:29:14.538007+0000","last_active":"2024-02-10T08:32:46.504794+0000","last_peered":"2024-02-10T08:32:46.504794+0000","last_clean":"2024-02-10T08:32:46.504794+0000","last_became_active":"2024-02-10T08:28:25.950240+0000","last_became_peered":"2024-02-10T08:28:25.950240+0000","last_unstale":"2024-02-10T08:32:46.504794+0000","last_undegraded":"2024-02-10T08:32:46.504794+0000","last_fullsized":"2024-02-10T08:32:46.504794+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:14.537940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:14.537940+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"344'1086","reported_seq":1103,"reported_epoch":344,"state":"active+clean","last_fresh":"2024-02-10T08:32:52.681339+0000","last_change":"2024-02-10T08:32:30.825465+0000","last_active":"2024-02-10T08:32:52.681339+0000","last_peered":"2024-02-10T08:32:52.681339+0000","last_clean":"2024-02-10T08:32:52.681339+0000","last_became_active":"2024-02-10T08:32:30.824733+0000","last_became_peered":"2024-02-10T08:32:30.824733+0000","last_unstale":"2024-02-10T08:32:52.681339+0000","last_undegraded":"2024-02-10T08:32:52.681339+0000","last_fullsized":"2024-02-10T08:32:52.681339+0000","mapping_epoch":335,"log_start":"0'0","ondisk_log_start":"0'0","created":335,"last_epoch_clean":336,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.947585+0000","log_size":1086,"ondisk_log_size":1086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":71172096,"num_objects":1086,"num_object_clones":0,"num_object_copies":3258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1086,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1086,"num_write_kb":69504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":331,"reported_epoch":342,"state":"active+clean","last_fresh":"2024-02-10T08:32:46.507690+0000","last_change":"2024-02-10T08:29:14.447872+0000","last_active":"2024-02-10T08:32:46.507690+0000","last_peered":"2024-02-10T08:32:46.507690+0000","last_clean":"2024-02-10T08:32:46.507690+0000","last_became_active":"2024-02-10T08:28:02.777637+0000","last_became_peered":"2024-02-10T08:28:02.777637+0000","last_unstale":"2024-02-10T08:32:46.507690+0000","last_undegraded":"2024-02-10T08:32:46.507690+0000","last_fullsized":"2024-02-10T08:32:46.507690+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:14.447807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:14.447807+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"225'23","reported_seq":372,"reported_epoch":342,"state":"active+clean","last_fresh":"2024-02-10T08:32:45.818150+0000","last_change":"2024-02-10T08:31:34.242669+0000","last_active":"2024-02-10T08:32:45.818150+0000","last_peered":"2024-02-10T08:32:45.818150+0000","last_clean":"2024-02-10T08:32:45.818150+0000","last_became_active":"2024-02-10T08:31:33.884516+0000","last_became_peered":"2024-02-10T08:31:33.884516+0000","last_unstale":"2024-02-10T08:32:45.818150+0000","last_undegraded":"2024-02-10T08:32:45.818150+0000","last_fullsized":"2024-02-10T08:32:45.818150+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'23","last_scrub_stamp":"2024-02-10T08:29:23.027211+0000","last_deep_scrub":"82'17","last_deep_scrub_stamp":"2024-02-10T08:18:21.015873+0000","last_clean_scrub_stamp":"2024-02-10T08:29:23.027211+0000","log_size":23,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":25,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"55'2","reported_seq":332,"reported_epoch":342,"state":"active+clean","last_fresh":"2024-02-10T08:32:45.818431+0000","last_change":"2024-02-10T08:29:22.034366+0000","last_active":"2024-02-10T08:32:45.818431+0000","last_peered":"2024-02-10T08:32:45.818431+0000","last_clean":"2024-02-10T08:32:45.818431+0000","last_became_active":"2024-02-10T08:28:02.768279+0000","last_became_peered":"2024-02-10T08:28:02.768279+0000","last_unstale":"2024-02-10T08:32:45.818431+0000","last_undegraded":"2024-02-10T08:32:45.818431+0000","last_fullsized":"2024-02-10T08:32:45.818431+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'2","last_scrub_stamp":"2024-02-10T08:29:22.034268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:29:22.034268+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":184,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":227,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.040780+0000","last_change":"2024-02-10T08:30:24.073702+0000","last_active":"2024-02-10T08:32:47.040780+0000","last_peered":"2024-02-10T08:32:47.040780+0000","last_clean":"2024-02-10T08:32:47.040780+0000","last_became_active":"2024-02-10T08:30:24.073077+0000","last_became_peered":"2024-02-10T08:30:24.073077+0000","last_unstale":"2024-02-10T08:32:47.040780+0000","last_undegraded":"2024-02-10T08:32:47.040780+0000","last_fullsized":"2024-02-10T08:32:47.040780+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:26:20.173948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:26:20.173948+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"225'15","reported_seq":23,"reported_epoch":342,"state":"active+clean","last_fresh":"2024-02-10T08:32:46.505373+0000","last_change":"2024-02-10T08:32:38.444804+0000","last_active":"2024-02-10T08:32:46.505373+0000","last_peered":"2024-02-10T08:32:46.505373+0000","last_clean":"2024-02-10T08:32:46.505373+0000","last_became_active":"2024-02-10T08:32:36.982716+0000","last_became_peered":"2024-02-10T08:32:36.982716+0000","last_unstale":"2024-02-10T08:32:46.505373+0000","last_undegraded":"2024-02-10T08:32:46.505373+0000","last_fullsized":"2024-02-10T08:32:46.505373+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'15","last_scrub_stamp":"2024-02-10T08:29:09.329160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:29:09.329160+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"55'1","reported_seq":387,"reported_epoch":342,"state":"active+clean","last_fresh":"2024-02-10T08:32:46.507650+0000","last_change":"2024-02-10T08:32:11.524846+0000","last_active":"2024-02-10T08:32:46.507650+0000","last_peered":"2024-02-10T08:32:46.507650+0000","last_clean":"2024-02-10T08:32:46.507650+0000","last_became_active":"2024-02-10T08:28:02.778857+0000","last_became_peered":"2024-02-10T08:28:02.778857+0000","last_unstale":"2024-02-10T08:32:46.507650+0000","last_undegraded":"2024-02-10T08:32:46.507650+0000","last_fullsized":"2024-02-10T08:32:46.507650+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'1","last_scrub_stamp":"2024-02-10T08:32:11.524771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:32:11.524771+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":716,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":261,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.034756+0000","last_change":"2024-02-10T08:32:24.674330+0000","last_active":"2024-02-10T08:32:47.034756+0000","last_peered":"2024-02-10T08:32:47.034756+0000","last_clean":"2024-02-10T08:32:47.034756+0000","last_became_active":"2024-02-10T08:31:33.891489+0000","last_became_peered":"2024-02-10T08:31:33.891489+0000","last_unstale":"2024-02-10T08:32:47.034756+0000","last_undegraded":"2024-02-10T08:32:47.034756+0000","last_fullsized":"2024-02-10T08:32:47.034756+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:24.672029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:32:24.672029+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":180,"reported_epoch":342,"state":"active+clean","last_fresh":"2024-02-10T08:32:46.505326+0000","last_change":"2024-02-10T08:29:24.514793+0000","last_active":"2024-02-10T08:32:46.505326+0000","last_peered":"2024-02-10T08:32:46.505326+0000","last_clean":"2024-02-10T08:32:46.505326+0000","last_became_active":"2024-02-10T08:28:25.999252+0000","last_became_peered":"2024-02-10T08:28:25.999252+0000","last_unstale":"2024-02-10T08:32:46.505326+0000","last_undegraded":"2024-02-10T08:32:46.505326+0000","last_fullsized":"2024-02-10T08:32:46.505326+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:24.514690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:24.514690+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"225'15","reported_seq":290,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.041540+0000","last_change":"2024-02-10T08:32:23.310599+0000","last_active":"2024-02-10T08:32:47.041540+0000","last_peered":"2024-02-10T08:32:47.041540+0000","last_clean":"2024-02-10T08:32:47.041540+0000","last_became_active":"2024-02-10T08:31:33.891813+0000","last_became_peered":"2024-02-10T08:31:33.891813+0000","last_unstale":"2024-02-10T08:32:47.041540+0000","last_undegraded":"2024-02-10T08:32:47.041540+0000","last_fullsized":"2024-02-10T08:32:47.041540+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'15","last_scrub_stamp":"2024-02-10T08:32:23.310489+0000","last_deep_scrub":"223'9","last_deep_scrub_stamp":"2024-02-10T08:26:33.158025+0000","last_clean_scrub_stamp":"2024-02-10T08:32:23.310489+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":384,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.039129+0000","last_change":"2024-02-10T08:32:22.293976+0000","last_active":"2024-02-10T08:32:47.039129+0000","last_peered":"2024-02-10T08:32:47.039129+0000","last_clean":"2024-02-10T08:32:47.039129+0000","last_became_active":"2024-02-10T08:31:46.053553+0000","last_became_peered":"2024-02-10T08:31:46.053553+0000","last_unstale":"2024-02-10T08:32:47.039129+0000","last_undegraded":"2024-02-10T08:32:47.039129+0000","last_fullsized":"2024-02-10T08:32:47.039129+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:22.293905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:32:22.293905+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":313,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.036273+0000","last_change":"2024-02-10T08:29:12.163752+0000","last_active":"2024-02-10T08:32:47.036273+0000","last_peered":"2024-02-10T08:32:47.036273+0000","last_clean":"2024-02-10T08:32:47.036273+0000","last_became_active":"2024-02-10T08:16:56.863948+0000","last_became_peered":"2024-02-10T08:16:56.863948+0000","last_unstale":"2024-02-10T08:32:47.036273+0000","last_undegraded":"2024-02-10T08:32:47.036273+0000","last_fullsized":"2024-02-10T08:32:47.036273+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:12.163638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:12.163638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":321,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.040646+0000","last_change":"2024-02-10T08:28:33.229127+0000","last_active":"2024-02-10T08:32:47.040646+0000","last_peered":"2024-02-10T08:32:47.040646+0000","last_clean":"2024-02-10T08:32:47.040646+0000","last_became_active":"2024-02-10T08:20:46.398903+0000","last_became_peered":"2024-02-10T08:20:46.398903+0000","last_unstale":"2024-02-10T08:32:47.040646+0000","last_undegraded":"2024-02-10T08:32:47.040646+0000","last_fullsized":"2024-02-10T08:32:47.040646+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:33.229018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:33.229018+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"225'20","reported_seq":265,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.033880+0000","last_change":"2024-02-10T08:32:23.661124+0000","last_active":"2024-02-10T08:32:47.033880+0000","last_peered":"2024-02-10T08:32:47.033880+0000","last_clean":"2024-02-10T08:32:47.033880+0000","last_became_active":"2024-02-10T08:22:23.534081+0000","last_became_peered":"2024-02-10T08:22:23.534081+0000","last_unstale":"2024-02-10T08:32:47.033880+0000","last_undegraded":"2024-02-10T08:32:47.033880+0000","last_fullsized":"2024-02-10T08:32:47.033880+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'20","last_scrub_stamp":"2024-02-10T08:32:23.661032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:32:23.661032+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":24,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":322,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.035253+0000","last_change":"2024-02-10T08:32:16.110041+0000","last_active":"2024-02-10T08:32:47.035253+0000","last_peered":"2024-02-10T08:32:47.035253+0000","last_clean":"2024-02-10T08:32:47.035253+0000","last_became_active":"2024-02-10T08:16:52.789834+0000","last_became_peered":"2024-02-10T08:16:52.789834+0000","last_unstale":"2024-02-10T08:32:47.035253+0000","last_undegraded":"2024-02-10T08:32:47.035253+0000","last_fullsized":"2024-02-10T08:32:47.035253+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:16.109957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:32:16.109957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"244'12","reported_seq":559,"reported_epoch":344,"state":"active+clean","last_fresh":"2024-02-10T08:32:50.829558+0000","last_change":"2024-02-10T08:32:11.142599+0000","last_active":"2024-02-10T08:32:50.829558+0000","last_peered":"2024-02-10T08:32:50.829558+0000","last_clean":"2024-02-10T08:32:50.829558+0000","last_became_active":"2024-02-10T08:28:02.776097+0000","last_became_peered":"2024-02-10T08:28:02.776097+0000","last_unstale":"2024-02-10T08:32:50.829558+0000","last_undegraded":"2024-02-10T08:32:50.829558+0000","last_fullsized":"2024-02-10T08:32:50.829558+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"244'12","last_scrub_stamp":"2024-02-10T08:32:11.142513+0000","last_deep_scrub":"89'9","last_deep_scrub_stamp":"2024-02-10T08:19:33.299671+0000","last_clean_scrub_stamp":"2024-02-10T08:32:11.142513+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":13,"reported_epoch":342,"state":"active+clean","last_fresh":"2024-02-10T08:32:46.505487+0000","last_change":"2024-02-10T08:32:36.987261+0000","last_active":"2024-02-10T08:32:46.505487+0000","last_peered":"2024-02-10T08:32:46.505487+0000","last_clean":"2024-02-10T08:32:46.505487+0000","last_became_active":"2024-02-10T08:32:36.983153+0000","last_became_peered":"2024-02-10T08:32:36.983153+0000","last_unstale":"2024-02-10T08:32:46.505487+0000","last_undegraded":"2024-02-10T08:32:46.505487+0000","last_fullsized":"2024-02-10T08:32:46.505487+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:27:19.286346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:05.662947+0000","last_clean_scrub_stamp":"2024-02-10T08:27:19.286346+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"225'19","reported_seq":344,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.037163+0000","last_change":"2024-02-10T08:29:09.148326+0000","last_active":"2024-02-10T08:32:47.037163+0000","last_peered":"2024-02-10T08:32:47.037163+0000","last_clean":"2024-02-10T08:32:47.037163+0000","last_became_active":"2024-02-10T08:16:55.204734+0000","last_became_peered":"2024-02-10T08:16:55.204734+0000","last_unstale":"2024-02-10T08:32:47.037163+0000","last_undegraded":"2024-02-10T08:32:47.037163+0000","last_fullsized":"2024-02-10T08:32:47.037163+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'19","last_scrub_stamp":"2024-02-10T08:29:09.148231+0000","last_deep_scrub":"213'13","last_deep_scrub_stamp":"2024-02-10T08:25:43.713333+0000","last_clean_scrub_stamp":"2024-02-10T08:29:09.148231+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":13,"reported_epoch":342,"state":"active+clean","last_fresh":"2024-02-10T08:32:46.504966+0000","last_change":"2024-02-10T08:32:36.981055+0000","last_active":"2024-02-10T08:32:46.504966+0000","last_peered":"2024-02-10T08:32:46.504966+0000","last_clean":"2024-02-10T08:32:46.504966+0000","last_became_active":"2024-02-10T08:32:36.980715+0000","last_became_peered":"2024-02-10T08:32:36.980715+0000","last_unstale":"2024-02-10T08:32:46.504966+0000","last_undegraded":"2024-02-10T08:32:46.504966+0000","last_fullsized":"2024-02-10T08:32:46.504966+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:21.299448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:32:21.299448+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"314'11","reported_seq":395,"reported_epoch":344,"state":"active+clean","last_fresh":"2024-02-10T08:32:50.834945+0000","last_change":"2024-02-10T08:32:15.210339+0000","last_active":"2024-02-10T08:32:50.834945+0000","last_peered":"2024-02-10T08:32:50.834945+0000","last_clean":"2024-02-10T08:32:50.834945+0000","last_became_active":"2024-02-10T08:31:33.885840+0000","last_became_peered":"2024-02-10T08:31:33.885840+0000","last_unstale":"2024-02-10T08:32:50.834945+0000","last_undegraded":"2024-02-10T08:32:50.834945+0000","last_fullsized":"2024-02-10T08:32:50.834945+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"314'11","last_scrub_stamp":"2024-02-10T08:32:15.210224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:32:15.210224+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":297,"reported_epoch":342,"state":"active+clean","last_fresh":"2024-02-10T08:32:45.818062+0000","last_change":"2024-02-10T08:32:12.342121+0000","last_active":"2024-02-10T08:32:45.818062+0000","last_peered":"2024-02-10T08:32:45.818062+0000","last_clean":"2024-02-10T08:32:45.818062+0000","last_became_active":"2024-02-10T08:20:46.395788+0000","last_became_peered":"2024-02-10T08:20:46.395788+0000","last_unstale":"2024-02-10T08:32:45.818062+0000","last_undegraded":"2024-02-10T08:32:45.818062+0000","last_fullsized":"2024-02-10T08:32:45.818062+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:12.342020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:32:12.342020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"225'15","reported_seq":323,"reported_epoch":342,"state":"active+clean","last_fresh":"2024-02-10T08:32:46.505678+0000","last_change":"2024-02-10T08:32:13.529400+0000","last_active":"2024-02-10T08:32:46.505678+0000","last_peered":"2024-02-10T08:32:46.505678+0000","last_clean":"2024-02-10T08:32:46.505678+0000","last_became_active":"2024-02-10T08:28:25.952354+0000","last_became_peered":"2024-02-10T08:28:25.952354+0000","last_unstale":"2024-02-10T08:32:46.505678+0000","last_undegraded":"2024-02-10T08:32:46.505678+0000","last_fullsized":"2024-02-10T08:32:46.505678+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'15","last_scrub_stamp":"2024-02-10T08:32:13.529289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:32:13.529289+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":324,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.039589+0000","last_change":"2024-02-10T08:29:10.389220+0000","last_active":"2024-02-10T08:32:47.039589+0000","last_peered":"2024-02-10T08:32:47.039589+0000","last_clean":"2024-02-10T08:32:47.039589+0000","last_became_active":"2024-02-10T08:16:52.786213+0000","last_became_peered":"2024-02-10T08:16:52.786213+0000","last_unstale":"2024-02-10T08:32:47.039589+0000","last_undegraded":"2024-02-10T08:32:47.039589+0000","last_fullsized":"2024-02-10T08:32:47.039589+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:10.389138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:29:10.389138+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":145,"reported_epoch":342,"state":"active+clean","last_fresh":"2024-02-10T08:32:46.506108+0000","last_change":"2024-02-10T08:29:01.325236+0000","last_active":"2024-02-10T08:32:46.506108+0000","last_peered":"2024-02-10T08:32:46.506108+0000","last_clean":"2024-02-10T08:32:46.506108+0000","last_became_active":"2024-02-10T08:28:25.950221+0000","last_became_peered":"2024-02-10T08:28:25.950221+0000","last_unstale":"2024-02-10T08:32:46.506108+0000","last_undegraded":"2024-02-10T08:32:46.506108+0000","last_fullsized":"2024-02-10T08:32:46.506108+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:01.325135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:01.325135+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":151,"reported_epoch":342,"state":"active+clean","last_fresh":"2024-02-10T08:32:46.505017+0000","last_change":"2024-02-10T08:30:24.070738+0000","last_active":"2024-02-10T08:32:46.505017+0000","last_peered":"2024-02-10T08:32:46.505017+0000","last_clean":"2024-02-10T08:32:46.505017+0000","last_became_active":"2024-02-10T08:30:24.070440+0000","last_became_peered":"2024-02-10T08:30:24.070440+0000","last_unstale":"2024-02-10T08:32:46.505017+0000","last_undegraded":"2024-02-10T08:32:46.505017+0000","last_fullsized":"2024-02-10T08:32:46.505017+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:11.496105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:11.496105+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"225'24","reported_seq":351,"reported_epoch":342,"state":"active+clean","last_fresh":"2024-02-10T08:32:45.819278+0000","last_change":"2024-02-10T08:28:35.984255+0000","last_active":"2024-02-10T08:32:45.819278+0000","last_peered":"2024-02-10T08:32:45.819278+0000","last_clean":"2024-02-10T08:32:45.819278+0000","last_became_active":"2024-02-10T08:20:46.396130+0000","last_became_peered":"2024-02-10T08:20:46.396130+0000","last_unstale":"2024-02-10T08:32:45.819278+0000","last_undegraded":"2024-02-10T08:32:45.819278+0000","last_fullsized":"2024-02-10T08:32:45.819278+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'24","last_scrub_stamp":"2024-02-10T08:28:35.984191+0000","last_deep_scrub":"201'16","last_deep_scrub_stamp":"2024-02-10T08:24:49.177357+0000","last_clean_scrub_stamp":"2024-02-10T08:28:35.984191+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":335,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.034422+0000","last_change":"2024-02-10T08:32:36.974676+0000","last_active":"2024-02-10T08:32:47.034422+0000","last_peered":"2024-02-10T08:32:47.034422+0000","last_clean":"2024-02-10T08:32:47.034422+0000","last_became_active":"2024-02-10T08:32:36.974379+0000","last_became_peered":"2024-02-10T08:32:36.974379+0000","last_unstale":"2024-02-10T08:32:47.034422+0000","last_undegraded":"2024-02-10T08:32:47.034422+0000","last_fullsized":"2024-02-10T08:32:47.034422+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:28.486926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:28:28.486926+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":329,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.036163+0000","last_change":"2024-02-10T08:31:33.894292+0000","last_active":"2024-02-10T08:32:47.036163+0000","last_peered":"2024-02-10T08:32:47.036163+0000","last_clean":"2024-02-10T08:32:47.036163+0000","last_became_active":"2024-02-10T08:31:33.893973+0000","last_became_peered":"2024-02-10T08:31:33.893973+0000","last_unstale":"2024-02-10T08:32:47.036163+0000","last_undegraded":"2024-02-10T08:32:47.036163+0000","last_fullsized":"2024-02-10T08:32:47.036163+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:20.394696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:28:20.394696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":342,"state":"active+clean","last_fresh":"2024-02-10T08:32:46.504902+0000","last_change":"2024-02-10T08:32:36.979428+0000","last_active":"2024-02-10T08:32:46.504902+0000","last_peered":"2024-02-10T08:32:46.504902+0000","last_clean":"2024-02-10T08:32:46.504902+0000","last_became_active":"2024-02-10T08:32:36.979093+0000","last_became_peered":"2024-02-10T08:32:36.979093+0000","last_unstale":"2024-02-10T08:32:46.504902+0000","last_undegraded":"2024-02-10T08:32:46.504902+0000","last_fullsized":"2024-02-10T08:32:46.504902+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:27.240244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:27.240244+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,5],"acting":[0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"225'8","reported_seq":247,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.032649+0000","last_change":"2024-02-10T08:32:15.627778+0000","last_active":"2024-02-10T08:32:47.032649+0000","last_peered":"2024-02-10T08:32:47.032649+0000","last_clean":"2024-02-10T08:32:47.032649+0000","last_became_active":"2024-02-10T08:22:23.522936+0000","last_became_peered":"2024-02-10T08:22:23.522936+0000","last_unstale":"2024-02-10T08:32:47.032649+0000","last_undegraded":"2024-02-10T08:32:47.032649+0000","last_fullsized":"2024-02-10T08:32:47.032649+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'8","last_scrub_stamp":"2024-02-10T08:32:15.627709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:32:15.627709+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,6],"acting":[1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":322,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.036340+0000","last_change":"2024-02-10T08:29:10.131158+0000","last_active":"2024-02-10T08:32:47.036340+0000","last_peered":"2024-02-10T08:32:47.036340+0000","last_clean":"2024-02-10T08:32:47.036340+0000","last_became_active":"2024-02-10T08:16:52.788704+0000","last_became_peered":"2024-02-10T08:16:52.788704+0000","last_unstale":"2024-02-10T08:32:47.036340+0000","last_undegraded":"2024-02-10T08:32:47.036340+0000","last_fullsized":"2024-02-10T08:32:47.036340+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:10.131056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:29:10.131056+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":328,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.039087+0000","last_change":"2024-02-10T08:32:27.229239+0000","last_active":"2024-02-10T08:32:47.039087+0000","last_peered":"2024-02-10T08:32:47.039087+0000","last_clean":"2024-02-10T08:32:47.039087+0000","last_became_active":"2024-02-10T08:20:46.397495+0000","last_became_peered":"2024-02-10T08:20:46.397495+0000","last_unstale":"2024-02-10T08:32:47.039087+0000","last_undegraded":"2024-02-10T08:32:47.039087+0000","last_fullsized":"2024-02-10T08:32:47.039087+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:27.229143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:32:27.229143+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":335,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.040516+0000","last_change":"2024-02-10T08:30:24.064805+0000","last_active":"2024-02-10T08:32:47.040516+0000","last_peered":"2024-02-10T08:32:47.040516+0000","last_clean":"2024-02-10T08:32:47.040516+0000","last_became_active":"2024-02-10T08:30:24.064419+0000","last_became_peered":"2024-02-10T08:30:24.064419+0000","last_unstale":"2024-02-10T08:32:47.040516+0000","last_undegraded":"2024-02-10T08:32:47.040516+0000","last_fullsized":"2024-02-10T08:32:47.040516+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:12.421034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:27.276490+0000","last_clean_scrub_stamp":"2024-02-10T08:29:12.421034+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"225'19","reported_seq":266,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.040330+0000","last_change":"2024-02-10T08:29:22.312103+0000","last_active":"2024-02-10T08:32:47.040330+0000","last_peered":"2024-02-10T08:32:47.040330+0000","last_clean":"2024-02-10T08:32:47.040330+0000","last_became_active":"2024-02-10T08:22:23.526198+0000","last_became_peered":"2024-02-10T08:22:23.526198+0000","last_unstale":"2024-02-10T08:32:47.040330+0000","last_undegraded":"2024-02-10T08:32:47.040330+0000","last_fullsized":"2024-02-10T08:32:47.040330+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'19","last_scrub_stamp":"2024-02-10T08:29:22.312001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:29:22.312001+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":24,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":322,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.040079+0000","last_change":"2024-02-10T08:32:30.241685+0000","last_active":"2024-02-10T08:32:47.040079+0000","last_peered":"2024-02-10T08:32:47.040079+0000","last_clean":"2024-02-10T08:32:47.040079+0000","last_became_active":"2024-02-10T08:16:52.788629+0000","last_became_peered":"2024-02-10T08:16:52.788629+0000","last_unstale":"2024-02-10T08:32:47.040079+0000","last_undegraded":"2024-02-10T08:32:47.040079+0000","last_fullsized":"2024-02-10T08:32:47.040079+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:30.241592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:38.360929+0000","last_clean_scrub_stamp":"2024-02-10T08:32:30.241592+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":328,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.040273+0000","last_change":"2024-02-10T08:29:19.380493+0000","last_active":"2024-02-10T08:32:47.040273+0000","last_peered":"2024-02-10T08:32:47.040273+0000","last_clean":"2024-02-10T08:32:47.040273+0000","last_became_active":"2024-02-10T08:20:46.399838+0000","last_became_peered":"2024-02-10T08:20:46.399838+0000","last_unstale":"2024-02-10T08:32:47.040273+0000","last_undegraded":"2024-02-10T08:32:47.040273+0000","last_fullsized":"2024-02-10T08:32:47.040273+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:19.380403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:19.380403+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":13,"reported_epoch":342,"state":"active+clean","last_fresh":"2024-02-10T08:32:46.505607+0000","last_change":"2024-02-10T08:32:36.984329+0000","last_active":"2024-02-10T08:32:46.505607+0000","last_peered":"2024-02-10T08:32:46.505607+0000","last_clean":"2024-02-10T08:32:46.505607+0000","last_became_active":"2024-02-10T08:32:36.982778+0000","last_became_peered":"2024-02-10T08:32:36.982778+0000","last_unstale":"2024-02-10T08:32:46.505607+0000","last_undegraded":"2024-02-10T08:32:46.505607+0000","last_fullsized":"2024-02-10T08:32:46.505607+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:34.502781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:34.502781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"225'25","reported_seq":427,"reported_epoch":342,"state":"active+clean","last_fresh":"2024-02-10T08:32:46.504763+0000","last_change":"2024-02-10T08:32:32.566504+0000","last_active":"2024-02-10T08:32:46.504763+0000","last_peered":"2024-02-10T08:32:46.504763+0000","last_clean":"2024-02-10T08:32:46.504763+0000","last_became_active":"2024-02-10T08:31:33.879680+0000","last_became_peered":"2024-02-10T08:31:33.879680+0000","last_unstale":"2024-02-10T08:32:46.504763+0000","last_undegraded":"2024-02-10T08:32:46.504763+0000","last_fullsized":"2024-02-10T08:32:46.504763+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'25","last_scrub_stamp":"2024-02-10T08:32:32.566437+0000","last_deep_scrub":"74'15","last_deep_scrub_stamp":"2024-02-10T08:17:57.637346+0000","last_clean_scrub_stamp":"2024-02-10T08:32:32.566437+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":24,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":332,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.034098+0000","last_change":"2024-02-10T08:29:26.072110+0000","last_active":"2024-02-10T08:32:47.034098+0000","last_peered":"2024-02-10T08:32:47.034098+0000","last_clean":"2024-02-10T08:32:47.034098+0000","last_became_active":"2024-02-10T08:20:46.392466+0000","last_became_peered":"2024-02-10T08:20:46.392466+0000","last_unstale":"2024-02-10T08:32:47.034098+0000","last_undegraded":"2024-02-10T08:32:47.034098+0000","last_fullsized":"2024-02-10T08:32:47.034098+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:26.072031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:29:26.072031+0000","last_clean_scrub_stamp":"2024-02-10T08:29:26.072031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1f","version":"111'11","reported_seq":537,"reported_epoch":344,"state":"active+clean","last_fresh":"2024-02-10T08:32:50.835814+0000","last_change":"2024-02-10T08:32:17.249799+0000","last_active":"2024-02-10T08:32:50.835814+0000","last_peered":"2024-02-10T08:32:50.835814+0000","last_clean":"2024-02-10T08:32:50.835814+0000","last_became_active":"2024-02-10T08:20:46.402663+0000","last_became_peered":"2024-02-10T08:20:46.402663+0000","last_unstale":"2024-02-10T08:32:50.835814+0000","last_undegraded":"2024-02-10T08:32:50.835814+0000","last_fullsized":"2024-02-10T08:32:50.835814+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'11","last_scrub_stamp":"2024-02-10T08:32:17.249718+0000","last_deep_scrub":"111'11","last_deep_scrub_stamp":"2024-02-10T08:32:17.249718+0000","last_clean_scrub_stamp":"2024-02-10T08:32:17.249718+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"87'2","reported_seq":313,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.040927+0000","last_change":"2024-02-10T08:28:37.261008+0000","last_active":"2024-02-10T08:32:47.040927+0000","last_peered":"2024-02-10T08:32:47.040927+0000","last_clean":"2024-02-10T08:32:47.040927+0000","last_became_active":"2024-02-10T08:16:58.859047+0000","last_became_peered":"2024-02-10T08:16:58.859047+0000","last_unstale":"2024-02-10T08:32:47.040927+0000","last_undegraded":"2024-02-10T08:32:47.040927+0000","last_fullsized":"2024-02-10T08:32:47.040927+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'2","last_scrub_stamp":"2024-02-10T08:28:37.260945+0000","last_deep_scrub":"87'2","last_deep_scrub_stamp":"2024-02-10T08:19:29.207531+0000","last_clean_scrub_stamp":"2024-02-10T08:28:37.260945+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"225'19","reported_seq":349,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.040233+0000","last_change":"2024-02-10T08:32:33.268773+0000","last_active":"2024-02-10T08:32:47.040233+0000","last_peered":"2024-02-10T08:32:47.040233+0000","last_clean":"2024-02-10T08:32:47.040233+0000","last_became_active":"2024-02-10T08:16:54.852665+0000","last_became_peered":"2024-02-10T08:16:54.852665+0000","last_unstale":"2024-02-10T08:32:47.040233+0000","last_undegraded":"2024-02-10T08:32:47.040233+0000","last_fullsized":"2024-02-10T08:32:47.040233+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'19","last_scrub_stamp":"2024-02-10T08:28:40.341641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:28:40.341641+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":259,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.039044+0000","last_change":"2024-02-10T08:31:33.878792+0000","last_active":"2024-02-10T08:32:47.039044+0000","last_peered":"2024-02-10T08:32:47.039044+0000","last_clean":"2024-02-10T08:32:47.039044+0000","last_became_active":"2024-02-10T08:31:33.878473+0000","last_became_peered":"2024-02-10T08:31:33.878473+0000","last_unstale":"2024-02-10T08:32:47.039044+0000","last_undegraded":"2024-02-10T08:32:47.039044+0000","last_fullsized":"2024-02-10T08:32:47.039044+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:14.469285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:25:42.124914+0000","last_clean_scrub_stamp":"2024-02-10T08:29:14.469285+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":147,"reported_epoch":342,"state":"active+clean","last_fresh":"2024-02-10T08:32:46.505786+0000","last_change":"2024-02-10T08:32:26.589167+0000","last_active":"2024-02-10T08:32:46.505786+0000","last_peered":"2024-02-10T08:32:46.505786+0000","last_clean":"2024-02-10T08:32:46.505786+0000","last_became_active":"2024-02-10T08:28:25.951312+0000","last_became_peered":"2024-02-10T08:28:25.951312+0000","last_unstale":"2024-02-10T08:32:46.505786+0000","last_undegraded":"2024-02-10T08:32:46.505786+0000","last_fullsized":"2024-02-10T08:32:46.505786+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:26.589082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:32:26.589082+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":322,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.034235+0000","last_change":"2024-02-10T08:29:20.739901+0000","last_active":"2024-02-10T08:32:47.034235+0000","last_peered":"2024-02-10T08:32:47.034235+0000","last_clean":"2024-02-10T08:32:47.034235+0000","last_became_active":"2024-02-10T08:20:46.408504+0000","last_became_peered":"2024-02-10T08:20:46.408504+0000","last_unstale":"2024-02-10T08:32:47.034235+0000","last_undegraded":"2024-02-10T08:32:47.034235+0000","last_fullsized":"2024-02-10T08:32:47.034235+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:20.739750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:22.104988+0000","last_clean_scrub_stamp":"2024-02-10T08:29:20.739750+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"330'34","reported_seq":420,"reported_epoch":342,"state":"active+clean","last_fresh":"2024-02-10T08:32:46.507308+0000","last_change":"2024-02-10T08:32:17.481894+0000","last_active":"2024-02-10T08:32:46.507308+0000","last_peered":"2024-02-10T08:32:46.507308+0000","last_clean":"2024-02-10T08:32:46.507308+0000","last_became_active":"2024-02-10T08:31:33.894960+0000","last_became_peered":"2024-02-10T08:31:33.894960+0000","last_unstale":"2024-02-10T08:32:46.507308+0000","last_undegraded":"2024-02-10T08:32:46.507308+0000","last_fullsized":"2024-02-10T08:32:46.507308+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"330'34","last_scrub_stamp":"2024-02-10T08:32:17.481832+0000","last_deep_scrub":"330'34","last_deep_scrub_stamp":"2024-02-10T08:32:17.481832+0000","last_clean_scrub_stamp":"2024-02-10T08:32:17.481832+0000","log_size":34,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":332,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.039826+0000","last_change":"2024-02-10T08:28:33.456849+0000","last_active":"2024-02-10T08:32:47.039826+0000","last_peered":"2024-02-10T08:32:47.039826+0000","last_clean":"2024-02-10T08:32:47.039826+0000","last_became_active":"2024-02-10T08:20:46.396303+0000","last_became_peered":"2024-02-10T08:20:46.396303+0000","last_unstale":"2024-02-10T08:32:47.039826+0000","last_undegraded":"2024-02-10T08:32:47.039826+0000","last_fullsized":"2024-02-10T08:32:47.039826+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:33.456780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:10.370746+0000","last_clean_scrub_stamp":"2024-02-10T08:28:33.456780+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":342,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.034657+0000","last_change":"2024-02-10T08:29:25.682482+0000","last_active":"2024-02-10T08:32:47.034657+0000","last_peered":"2024-02-10T08:32:47.034657+0000","last_clean":"2024-02-10T08:32:47.034657+0000","last_became_active":"2024-02-10T08:28:02.763523+0000","last_became_peered":"2024-02-10T08:28:02.763523+0000","last_unstale":"2024-02-10T08:32:47.034657+0000","last_undegraded":"2024-02-10T08:32:47.034657+0000","last_fullsized":"2024-02-10T08:32:47.034657+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:25.682383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:25.682383+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":289,"reported_epoch":342,"state":"active+clean","last_fresh":"2024-02-10T08:32:45.820252+0000","last_change":"2024-02-10T08:29:00.918497+0000","last_active":"2024-02-10T08:32:45.820252+0000","last_peered":"2024-02-10T08:32:45.820252+0000","last_clean":"2024-02-10T08:32:45.820252+0000","last_became_active":"2024-02-10T08:20:46.403378+0000","last_became_peered":"2024-02-10T08:20:46.403378+0000","last_unstale":"2024-02-10T08:32:45.820252+0000","last_undegraded":"2024-02-10T08:32:45.820252+0000","last_fullsized":"2024-02-10T08:32:45.820252+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:00.918382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:00.918382+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"226'23","reported_seq":324,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.034579+0000","last_change":"2024-02-10T08:31:34.341047+0000","last_active":"2024-02-10T08:32:47.034579+0000","last_peered":"2024-02-10T08:32:47.034579+0000","last_clean":"2024-02-10T08:32:47.034579+0000","last_became_active":"2024-02-10T08:31:33.891562+0000","last_became_peered":"2024-02-10T08:31:33.891562+0000","last_unstale":"2024-02-10T08:32:47.034579+0000","last_undegraded":"2024-02-10T08:32:47.034579+0000","last_fullsized":"2024-02-10T08:32:47.034579+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"226'23","last_scrub_stamp":"2024-02-10T08:29:19.670143+0000","last_deep_scrub":"74'17","last_deep_scrub_stamp":"2024-02-10T08:18:02.949298+0000","last_clean_scrub_stamp":"2024-02-10T08:29:19.670143+0000","log_size":23,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":25,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":241,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.040880+0000","last_change":"2024-02-10T08:32:22.275761+0000","last_active":"2024-02-10T08:32:47.040880+0000","last_peered":"2024-02-10T08:32:47.040880+0000","last_clean":"2024-02-10T08:32:47.040880+0000","last_became_active":"2024-02-10T08:31:33.879918+0000","last_became_peered":"2024-02-10T08:31:33.879918+0000","last_unstale":"2024-02-10T08:32:47.040880+0000","last_undegraded":"2024-02-10T08:32:47.040880+0000","last_fullsized":"2024-02-10T08:32:47.040880+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:22.275679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:32:22.275679+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":291,"reported_epoch":342,"state":"active+clean","last_fresh":"2024-02-10T08:32:45.818551+0000","last_change":"2024-02-10T08:32:17.352870+0000","last_active":"2024-02-10T08:32:45.818551+0000","last_peered":"2024-02-10T08:32:45.818551+0000","last_clean":"2024-02-10T08:32:45.818551+0000","last_became_active":"2024-02-10T08:20:46.398532+0000","last_became_peered":"2024-02-10T08:20:46.398532+0000","last_unstale":"2024-02-10T08:32:45.818551+0000","last_undegraded":"2024-02-10T08:32:45.818551+0000","last_fullsized":"2024-02-10T08:32:45.818551+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:17.352797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:32:17.352797+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":228,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.040411+0000","last_change":"2024-02-10T08:32:15.313492+0000","last_active":"2024-02-10T08:32:47.040411+0000","last_peered":"2024-02-10T08:32:47.040411+0000","last_clean":"2024-02-10T08:32:47.040411+0000","last_became_active":"2024-02-10T08:22:23.526229+0000","last_became_peered":"2024-02-10T08:22:23.526229+0000","last_unstale":"2024-02-10T08:32:47.040411+0000","last_undegraded":"2024-02-10T08:32:47.040411+0000","last_fullsized":"2024-02-10T08:32:47.040411+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:15.313394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:32:15.313394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1a","version":"225'15","reported_seq":45,"reported_epoch":342,"state":"active+clean","last_fresh":"2024-02-10T08:32:45.818695+0000","last_change":"2024-02-10T08:31:46.145013+0000","last_active":"2024-02-10T08:32:45.818695+0000","last_peered":"2024-02-10T08:32:45.818695+0000","last_clean":"2024-02-10T08:32:45.818695+0000","last_became_active":"2024-02-10T08:31:46.069680+0000","last_became_peered":"2024-02-10T08:31:46.069680+0000","last_unstale":"2024-02-10T08:32:45.818695+0000","last_undegraded":"2024-02-10T08:32:45.818695+0000","last_fullsized":"2024-02-10T08:32:45.818695+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'15","last_scrub_stamp":"2024-02-10T08:29:13.500017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:29:13.500017+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":317,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.040666+0000","last_change":"2024-02-10T08:29:26.213501+0000","last_active":"2024-02-10T08:32:47.040666+0000","last_peered":"2024-02-10T08:32:47.040666+0000","last_clean":"2024-02-10T08:32:47.040666+0000","last_became_active":"2024-02-10T08:16:52.787865+0000","last_became_peered":"2024-02-10T08:16:52.787865+0000","last_unstale":"2024-02-10T08:32:47.040666+0000","last_undegraded":"2024-02-10T08:32:47.040666+0000","last_fullsized":"2024-02-10T08:32:47.040666+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:26.213417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:28.028556+0000","last_clean_scrub_stamp":"2024-02-10T08:29:26.213417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":345,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.034808+0000","last_change":"2024-02-10T08:29:22.172003+0000","last_active":"2024-02-10T08:32:47.034808+0000","last_peered":"2024-02-10T08:32:47.034808+0000","last_clean":"2024-02-10T08:32:47.034808+0000","last_became_active":"2024-02-10T08:28:19.065132+0000","last_became_peered":"2024-02-10T08:28:19.065132+0000","last_unstale":"2024-02-10T08:32:47.034808+0000","last_undegraded":"2024-02-10T08:32:47.034808+0000","last_fullsized":"2024-02-10T08:32:47.034808+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:22.171906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:22.171906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,7],"acting":[5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":13,"reported_epoch":342,"state":"active+clean","last_fresh":"2024-02-10T08:32:46.504919+0000","last_change":"2024-02-10T08:32:36.979316+0000","last_active":"2024-02-10T08:32:46.504919+0000","last_peered":"2024-02-10T08:32:46.504919+0000","last_clean":"2024-02-10T08:32:46.504919+0000","last_became_active":"2024-02-10T08:32:36.978752+0000","last_became_peered":"2024-02-10T08:32:36.978752+0000","last_unstale":"2024-02-10T08:32:46.504919+0000","last_undegraded":"2024-02-10T08:32:46.504919+0000","last_fullsized":"2024-02-10T08:32:46.504919+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:27:19.250878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:27:19.250878+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"225'7","reported_seq":345,"reported_epoch":342,"state":"active+clean","last_fresh":"2024-02-10T08:32:45.819444+0000","last_change":"2024-02-10T08:32:22.340287+0000","last_active":"2024-02-10T08:32:45.819444+0000","last_peered":"2024-02-10T08:32:45.819444+0000","last_clean":"2024-02-10T08:32:45.819444+0000","last_became_active":"2024-02-10T08:27:27.715306+0000","last_became_peered":"2024-02-10T08:27:27.715306+0000","last_unstale":"2024-02-10T08:32:45.819444+0000","last_undegraded":"2024-02-10T08:32:45.819444+0000","last_fullsized":"2024-02-10T08:32:45.819444+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'7","last_scrub_stamp":"2024-02-10T08:32:22.340191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:32:22.340191+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":9,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"55'1","reported_seq":345,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.040714+0000","last_change":"2024-02-10T08:28:02.870043+0000","last_active":"2024-02-10T08:32:47.040714+0000","last_peered":"2024-02-10T08:32:47.040714+0000","last_clean":"2024-02-10T08:32:47.040714+0000","last_became_active":"2024-02-10T08:28:02.761299+0000","last_became_peered":"2024-02-10T08:28:02.761299+0000","last_unstale":"2024-02-10T08:32:47.040714+0000","last_undegraded":"2024-02-10T08:32:47.040714+0000","last_fullsized":"2024-02-10T08:32:47.040714+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'1","last_scrub_stamp":"2024-02-10T08:27:18.293859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:27:18.293859+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1746,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":328,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.040416+0000","last_change":"2024-02-10T08:28:38.278860+0000","last_active":"2024-02-10T08:32:47.040416+0000","last_peered":"2024-02-10T08:32:47.040416+0000","last_clean":"2024-02-10T08:32:47.040416+0000","last_became_active":"2024-02-10T08:20:46.406783+0000","last_became_peered":"2024-02-10T08:20:46.406783+0000","last_unstale":"2024-02-10T08:32:47.040416+0000","last_undegraded":"2024-02-10T08:32:47.040416+0000","last_fullsized":"2024-02-10T08:32:47.040416+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:38.278752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:28:38.278752+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":329,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.037380+0000","last_change":"2024-02-10T08:31:33.886939+0000","last_active":"2024-02-10T08:32:47.037380+0000","last_peered":"2024-02-10T08:32:47.037380+0000","last_clean":"2024-02-10T08:32:47.037380+0000","last_became_active":"2024-02-10T08:31:33.886617+0000","last_became_peered":"2024-02-10T08:31:33.886617+0000","last_unstale":"2024-02-10T08:32:47.037380+0000","last_undegraded":"2024-02-10T08:32:47.037380+0000","last_fullsized":"2024-02-10T08:32:47.037380+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:08.143236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:08.143236+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"225'15","reported_seq":313,"reported_epoch":342,"state":"active+clean","last_fresh":"2024-02-10T08:32:45.817879+0000","last_change":"2024-02-10T08:29:07.977048+0000","last_active":"2024-02-10T08:32:45.817879+0000","last_peered":"2024-02-10T08:32:45.817879+0000","last_clean":"2024-02-10T08:32:45.817879+0000","last_became_active":"2024-02-10T08:20:46.404966+0000","last_became_peered":"2024-02-10T08:20:46.404966+0000","last_unstale":"2024-02-10T08:32:45.817879+0000","last_undegraded":"2024-02-10T08:32:45.817879+0000","last_fullsized":"2024-02-10T08:32:45.817879+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'15","last_scrub_stamp":"2024-02-10T08:29:07.976943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:29:07.976943+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":13,"reported_epoch":342,"state":"active+clean","last_fresh":"2024-02-10T08:32:46.505816+0000","last_change":"2024-02-10T08:32:36.983082+0000","last_active":"2024-02-10T08:32:46.505816+0000","last_peered":"2024-02-10T08:32:46.505816+0000","last_clean":"2024-02-10T08:32:46.505816+0000","last_became_active":"2024-02-10T08:32:36.982675+0000","last_became_peered":"2024-02-10T08:32:36.982675+0000","last_unstale":"2024-02-10T08:32:46.505816+0000","last_undegraded":"2024-02-10T08:32:46.505816+0000","last_fullsized":"2024-02-10T08:32:46.505816+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:14.084352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:32:14.084352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,5],"acting":[0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":309,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.032941+0000","last_change":"2024-02-10T08:28:24.450504+0000","last_active":"2024-02-10T08:32:47.032941+0000","last_peered":"2024-02-10T08:32:47.032941+0000","last_clean":"2024-02-10T08:32:47.032941+0000","last_became_active":"2024-02-10T08:16:56.863353+0000","last_became_peered":"2024-02-10T08:16:56.863353+0000","last_unstale":"2024-02-10T08:32:47.032941+0000","last_undegraded":"2024-02-10T08:32:47.032941+0000","last_fullsized":"2024-02-10T08:32:47.032941+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:24.450350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:28:24.450350+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":289,"reported_epoch":342,"state":"active+clean","last_fresh":"2024-02-10T08:32:45.819041+0000","last_change":"2024-02-10T08:29:25.024508+0000","last_active":"2024-02-10T08:32:45.819041+0000","last_peered":"2024-02-10T08:32:45.819041+0000","last_clean":"2024-02-10T08:32:45.819041+0000","last_became_active":"2024-02-10T08:20:46.405314+0000","last_became_peered":"2024-02-10T08:20:46.405314+0000","last_unstale":"2024-02-10T08:32:45.819041+0000","last_undegraded":"2024-02-10T08:32:45.819041+0000","last_fullsized":"2024-02-10T08:32:45.819041+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:25.024412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:29:25.024412+0000","last_clean_scrub_stamp":"2024-02-10T08:29:25.024412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"225'27","reported_seq":377,"reported_epoch":342,"state":"active+clean","last_fresh":"2024-02-10T08:32:46.506801+0000","last_change":"2024-02-10T08:31:34.248681+0000","last_active":"2024-02-10T08:32:46.506801+0000","last_peered":"2024-02-10T08:32:46.506801+0000","last_clean":"2024-02-10T08:32:46.506801+0000","last_became_active":"2024-02-10T08:31:33.883535+0000","last_became_peered":"2024-02-10T08:31:33.883535+0000","last_unstale":"2024-02-10T08:32:46.506801+0000","last_undegraded":"2024-02-10T08:32:46.506801+0000","last_fullsized":"2024-02-10T08:32:46.506801+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'27","last_scrub_stamp":"2024-02-10T08:29:18.566350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:29:18.566350+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":13,"reported_epoch":342,"state":"active+clean","last_fresh":"2024-02-10T08:32:46.505581+0000","last_change":"2024-02-10T08:32:36.978215+0000","last_active":"2024-02-10T08:32:46.505581+0000","last_peered":"2024-02-10T08:32:46.505581+0000","last_clean":"2024-02-10T08:32:46.505581+0000","last_became_active":"2024-02-10T08:32:36.977972+0000","last_became_peered":"2024-02-10T08:32:36.977972+0000","last_unstale":"2024-02-10T08:32:46.505581+0000","last_undegraded":"2024-02-10T08:32:46.505581+0000","last_fullsized":"2024-02-10T08:32:46.505581+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:31.264352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:28:31.264352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":35,"reported_epoch":342,"state":"active+clean","last_fresh":"2024-02-10T08:32:45.817524+0000","last_change":"2024-02-10T08:31:46.058167+0000","last_active":"2024-02-10T08:32:45.817524+0000","last_peered":"2024-02-10T08:32:45.817524+0000","last_clean":"2024-02-10T08:32:45.817524+0000","last_became_active":"2024-02-10T08:31:46.057858+0000","last_became_peered":"2024-02-10T08:31:46.057858+0000","last_unstale":"2024-02-10T08:32:45.817524+0000","last_undegraded":"2024-02-10T08:32:45.817524+0000","last_fullsized":"2024-02-10T08:32:45.817524+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:04.388074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:04.388074+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":241,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.040624+0000","last_change":"2024-02-10T08:31:33.880687+0000","last_active":"2024-02-10T08:32:47.040624+0000","last_peered":"2024-02-10T08:32:47.040624+0000","last_clean":"2024-02-10T08:32:47.040624+0000","last_became_active":"2024-02-10T08:31:33.880328+0000","last_became_peered":"2024-02-10T08:31:33.880328+0000","last_unstale":"2024-02-10T08:32:47.040624+0000","last_undegraded":"2024-02-10T08:32:47.040624+0000","last_fullsized":"2024-02-10T08:32:47.040624+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:06.366305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:06.366305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":225,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.033393+0000","last_change":"2024-02-10T08:29:01.651198+0000","last_active":"2024-02-10T08:32:47.033393+0000","last_peered":"2024-02-10T08:32:47.033393+0000","last_clean":"2024-02-10T08:32:47.033393+0000","last_became_active":"2024-02-10T08:22:00.581772+0000","last_became_peered":"2024-02-10T08:22:00.581772+0000","last_unstale":"2024-02-10T08:32:47.033393+0000","last_undegraded":"2024-02-10T08:32:47.033393+0000","last_fullsized":"2024-02-10T08:32:47.033393+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:01.651093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:01.651093+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,7],"acting":[1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":243,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.039841+0000","last_change":"2024-02-10T08:31:46.055053+0000","last_active":"2024-02-10T08:32:47.039841+0000","last_peered":"2024-02-10T08:32:47.039841+0000","last_clean":"2024-02-10T08:32:47.039841+0000","last_became_active":"2024-02-10T08:31:46.054713+0000","last_became_peered":"2024-02-10T08:31:46.054713+0000","last_unstale":"2024-02-10T08:32:47.039841+0000","last_undegraded":"2024-02-10T08:32:47.039841+0000","last_fullsized":"2024-02-10T08:32:47.039841+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:18.099177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:18.099177+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":230,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.039330+0000","last_change":"2024-02-10T08:29:19.512005+0000","last_active":"2024-02-10T08:32:47.039330+0000","last_peered":"2024-02-10T08:32:47.039330+0000","last_clean":"2024-02-10T08:32:47.039330+0000","last_became_active":"2024-02-10T08:22:00.600200+0000","last_became_peered":"2024-02-10T08:22:00.600200+0000","last_unstale":"2024-02-10T08:32:47.039330+0000","last_undegraded":"2024-02-10T08:32:47.039330+0000","last_fullsized":"2024-02-10T08:32:47.039330+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:19.511918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:19.511918+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1],"acting":[6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":213,"reported_epoch":342,"state":"active+clean","last_fresh":"2024-02-10T08:32:46.505770+0000","last_change":"2024-02-10T08:29:22.556568+0000","last_active":"2024-02-10T08:32:46.505770+0000","last_peered":"2024-02-10T08:32:46.505770+0000","last_clean":"2024-02-10T08:32:46.505770+0000","last_became_active":"2024-02-10T08:28:25.999335+0000","last_became_peered":"2024-02-10T08:28:25.999335+0000","last_unstale":"2024-02-10T08:32:46.505770+0000","last_undegraded":"2024-02-10T08:32:46.505770+0000","last_fullsized":"2024-02-10T08:32:46.505770+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:22.556451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:22.556451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":339,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.034462+0000","last_change":"2024-02-10T08:31:33.879761+0000","last_active":"2024-02-10T08:32:47.034462+0000","last_peered":"2024-02-10T08:32:47.034462+0000","last_clean":"2024-02-10T08:32:47.034462+0000","last_became_active":"2024-02-10T08:31:33.879440+0000","last_became_peered":"2024-02-10T08:31:33.879440+0000","last_unstale":"2024-02-10T08:32:47.034462+0000","last_undegraded":"2024-02-10T08:32:47.034462+0000","last_fullsized":"2024-02-10T08:32:47.034462+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:19.225297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:19.225297+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":340,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.040136+0000","last_change":"2024-02-10T08:29:21.602049+0000","last_active":"2024-02-10T08:32:47.040136+0000","last_peered":"2024-02-10T08:32:47.040136+0000","last_clean":"2024-02-10T08:32:47.040136+0000","last_became_active":"2024-02-10T08:27:27.710587+0000","last_became_peered":"2024-02-10T08:27:27.710587+0000","last_unstale":"2024-02-10T08:32:47.040136+0000","last_undegraded":"2024-02-10T08:32:47.040136+0000","last_fullsized":"2024-02-10T08:32:47.040136+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:21.601953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:11.750537+0000","last_clean_scrub_stamp":"2024-02-10T08:29:21.601953+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,1],"acting":[6,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":243,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.035293+0000","last_change":"2024-02-10T08:32:36.974499+0000","last_active":"2024-02-10T08:32:47.035293+0000","last_peered":"2024-02-10T08:32:47.035293+0000","last_clean":"2024-02-10T08:32:47.035293+0000","last_became_active":"2024-02-10T08:32:36.974142+0000","last_became_peered":"2024-02-10T08:32:36.974142+0000","last_unstale":"2024-02-10T08:32:47.035293+0000","last_undegraded":"2024-02-10T08:32:47.035293+0000","last_fullsized":"2024-02-10T08:32:47.035293+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:02.618499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:02.618499+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":248,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.040043+0000","last_change":"2024-02-10T08:32:36.979965+0000","last_active":"2024-02-10T08:32:47.040043+0000","last_peered":"2024-02-10T08:32:47.040043+0000","last_clean":"2024-02-10T08:32:47.040043+0000","last_became_active":"2024-02-10T08:32:36.979412+0000","last_became_peered":"2024-02-10T08:32:36.979412+0000","last_unstale":"2024-02-10T08:32:47.040043+0000","last_undegraded":"2024-02-10T08:32:47.040043+0000","last_fullsized":"2024-02-10T08:32:47.040043+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:17.607818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:17.607818+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1],"acting":[6,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":319,"reported_epoch":342,"state":"active+clean","last_fresh":"2024-02-10T08:32:46.507540+0000","last_change":"2024-02-10T08:32:16.519014+0000","last_active":"2024-02-10T08:32:46.507540+0000","last_peered":"2024-02-10T08:32:46.507540+0000","last_clean":"2024-02-10T08:32:46.507540+0000","last_became_active":"2024-02-10T08:22:00.578118+0000","last_became_peered":"2024-02-10T08:22:00.578118+0000","last_unstale":"2024-02-10T08:32:46.507540+0000","last_undegraded":"2024-02-10T08:32:46.507540+0000","last_fullsized":"2024-02-10T08:32:46.507540+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:16.518945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:32:16.518945+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,6],"acting":[2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.29","version":"76'2","reported_seq":278,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.039941+0000","last_change":"2024-02-10T08:32:31.459909+0000","last_active":"2024-02-10T08:32:47.039941+0000","last_peered":"2024-02-10T08:32:47.039941+0000","last_clean":"2024-02-10T08:32:47.039941+0000","last_became_active":"2024-02-10T08:28:02.767822+0000","last_became_peered":"2024-02-10T08:28:02.767822+0000","last_unstale":"2024-02-10T08:32:47.039941+0000","last_undegraded":"2024-02-10T08:32:47.039941+0000","last_fullsized":"2024-02-10T08:32:47.039941+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":6,"last_scrub":"76'2","last_scrub_stamp":"2024-02-10T08:32:31.459851+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2024-02-10T08:18:08.680038+0000","last_clean_scrub_stamp":"2024-02-10T08:32:31.459851+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,0],"acting":[7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":44,"reported_epoch":342,"state":"active+clean","last_fresh":"2024-02-10T08:32:45.818745+0000","last_change":"2024-02-10T08:32:36.975485+0000","last_active":"2024-02-10T08:32:45.818745+0000","last_peered":"2024-02-10T08:32:45.818745+0000","last_clean":"2024-02-10T08:32:45.818745+0000","last_became_active":"2024-02-10T08:32:36.975213+0000","last_became_peered":"2024-02-10T08:32:36.975213+0000","last_unstale":"2024-02-10T08:32:45.818745+0000","last_undegraded":"2024-02-10T08:32:45.818745+0000","last_fullsized":"2024-02-10T08:32:45.818745+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:30.227120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:20.392249+0000","last_clean_scrub_stamp":"2024-02-10T08:28:30.227120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0],"acting":[4,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":64,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.034548+0000","last_change":"2024-02-10T08:30:26.080634+0000","last_active":"2024-02-10T08:32:47.034548+0000","last_peered":"2024-02-10T08:32:47.034548+0000","last_clean":"2024-02-10T08:32:47.034548+0000","last_became_active":"2024-02-10T08:30:26.079913+0000","last_became_peered":"2024-02-10T08:30:26.079913+0000","last_unstale":"2024-02-10T08:32:47.034548+0000","last_undegraded":"2024-02-10T08:32:47.034548+0000","last_fullsized":"2024-02-10T08:32:47.034548+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:26:20.173948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:26:20.173948+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":249,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.039457+0000","last_change":"2024-02-10T08:30:26.067617+0000","last_active":"2024-02-10T08:32:47.039457+0000","last_peered":"2024-02-10T08:32:47.039457+0000","last_clean":"2024-02-10T08:32:47.039457+0000","last_became_active":"2024-02-10T08:30:26.067308+0000","last_became_peered":"2024-02-10T08:30:26.067308+0000","last_unstale":"2024-02-10T08:32:47.039457+0000","last_undegraded":"2024-02-10T08:32:47.039457+0000","last_fullsized":"2024-02-10T08:32:47.039457+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:15.491747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:20:30.227375+0000","last_clean_scrub_stamp":"2024-02-10T08:29:15.491747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,5],"acting":[6,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":328,"reported_epoch":342,"state":"active+clean","last_fresh":"2024-02-10T08:32:46.508833+0000","last_change":"2024-02-10T08:30:26.085599+0000","last_active":"2024-02-10T08:32:46.508833+0000","last_peered":"2024-02-10T08:32:46.508833+0000","last_clean":"2024-02-10T08:32:46.508833+0000","last_became_active":"2024-02-10T08:30:26.085360+0000","last_became_peered":"2024-02-10T08:30:26.085360+0000","last_unstale":"2024-02-10T08:32:46.508833+0000","last_undegraded":"2024-02-10T08:32:46.508833+0000","last_fullsized":"2024-02-10T08:32:46.508833+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:36.163125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:36.163125+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,5],"acting":[2,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":64,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.039460+0000","last_change":"2024-02-10T08:30:26.075782+0000","last_active":"2024-02-10T08:32:47.039460+0000","last_peered":"2024-02-10T08:32:47.039460+0000","last_clean":"2024-02-10T08:32:47.039460+0000","last_became_active":"2024-02-10T08:30:26.075472+0000","last_became_peered":"2024-02-10T08:30:26.075472+0000","last_unstale":"2024-02-10T08:32:47.039460+0000","last_undegraded":"2024-02-10T08:32:47.039460+0000","last_fullsized":"2024-02-10T08:32:47.039460+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:26.976023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:26.976023+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":64,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.041188+0000","last_change":"2024-02-10T08:30:26.080944+0000","last_active":"2024-02-10T08:32:47.041188+0000","last_peered":"2024-02-10T08:32:47.041188+0000","last_clean":"2024-02-10T08:32:47.041188+0000","last_became_active":"2024-02-10T08:30:26.080539+0000","last_became_peered":"2024-02-10T08:30:26.080539+0000","last_unstale":"2024-02-10T08:32:47.041188+0000","last_undegraded":"2024-02-10T08:32:47.041188+0000","last_fullsized":"2024-02-10T08:32:47.041188+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:34.215363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:34.215363+0000","last_clean_scrub_stamp":"2024-02-10T08:28:34.215363+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":64,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.039508+0000","last_change":"2024-02-10T08:30:26.088483+0000","last_active":"2024-02-10T08:32:47.039508+0000","last_peered":"2024-02-10T08:32:47.039508+0000","last_clean":"2024-02-10T08:32:47.039508+0000","last_became_active":"2024-02-10T08:30:26.088228+0000","last_became_peered":"2024-02-10T08:30:26.088228+0000","last_unstale":"2024-02-10T08:32:47.039508+0000","last_undegraded":"2024-02-10T08:32:47.039508+0000","last_fullsized":"2024-02-10T08:32:47.039508+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:11.496105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:11.496105+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1],"acting":[7,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":244,"reported_epoch":343,"state":"active+clean","last_fresh":"2024-02-10T08:32:47.034172+0000","last_change":"2024-02-10T08:30:26.072341+0000","last_active":"2024-02-10T08:32:47.034172+0000","last_peered":"2024-02-10T08:32:47.034172+0000","last_clean":"2024-02-10T08:32:47.034172+0000","last_became_active":"2024-02-10T08:30:26.072022+0000","last_became_peered":"2024-02-10T08:30:26.072022+0000","last_unstale":"2024-02-10T08:32:47.034172+0000","last_undegraded":"2024-02-10T08:32:47.034172+0000","last_fullsized":"2024-02-10T08:32:47.034172+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:27.240244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:27.240244+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":16,"stat_sum":{"num_bytes":917700608,"num_objects":14003,"num_object_clones":0,"num_object_copies":42009,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14003,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14003,"num_write_kb":896192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2493186048,"data_stored":2493186048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14003,"ondisk_log_size":14003,"up":48,"acting":48,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2646,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":4},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":950,"num_read_kb":945,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":9,"acting":9,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":1105,"num_read_kb":862,"num_write":703,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":212,"num_bytes_recovered":5226,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":733,"ondisk_log_size":733,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":96,"acting":96,"num_store_stats":8},{"poolid":6,"num_pg":52,"stat_sum":{"num_bytes":388,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":156,"acting":156,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":50,"seq":214748364996,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":884104,"kb_used_data":282112,"kb_used_omap":0,"kb_used_meta":601984,"kb_avail":92861048,"statfs":{"total":95995035648,"available":95089713152,"internally_reserved":0,"allocated":288882688,"data_stored":288338263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":616431616},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:32:13 2024","interfaces":[{"interface":"back","average":{"1min":2.7429999999999999,"5min":2.085,"15min":1.5860000000000001},"min":{"1min":0.23000000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":8.6869999999999994,"5min":8.6869999999999994,"15min":21.175999999999998},"last":1.054},{"interface":"front","average":{"1min":3.323,"5min":2.258,"15min":1.99},"min":{"1min":0.30299999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":10.013,"5min":10.013,"15min":22.57},"last":0.38}]},{"osd":1,"last update":"Sat Feb 10 08:32:13 2024","interfaces":[{"interface":"back","average":{"1min":2.7810000000000001,"5min":2.4340000000000002,"15min":1.72},"min":{"1min":0.23799999999999999,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":8.7530000000000001,"5min":41.539999999999999,"15min":41.539999999999999},"last":1.02},{"interface":"front","average":{"1min":3.2749999999999999,"5min":2.411,"15min":1.7609999999999999},"min":{"1min":0.42199999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":10.053000000000001,"5min":41.046999999999997,"15min":41.046999999999997},"last":0.69599999999999995}]},{"osd":2,"last update":"Sat Feb 10 08:32:13 2024","interfaces":[{"interface":"back","average":{"1min":3.161,"5min":1.974,"15min":1.5429999999999999},"min":{"1min":0.25700000000000001,"5min":0.255,"15min":0.251},"max":{"1min":12.599,"5min":12.599,"15min":12.599},"last":0.621},{"interface":"front","average":{"1min":2.7730000000000001,"5min":1.978,"15min":1.607},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.25900000000000001},"max":{"1min":8.7300000000000004,"5min":8.7300000000000004,"15min":12.797000000000001},"last":0.93000000000000005}]},{"osd":3,"last update":"Sat Feb 10 08:32:13 2024","interfaces":[{"interface":"back","average":{"1min":2.754,"5min":1.9159999999999999,"15min":1.5580000000000001},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.27700000000000002},"max":{"1min":12.686,"5min":13.07,"15min":18.515000000000001},"last":1.0069999999999999},{"interface":"front","average":{"1min":4.1020000000000003,"5min":2.109,"15min":1.7150000000000001},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":10.960000000000001,"5min":10.960000000000001,"15min":10.960000000000001},"last":0.96499999999999997}]},{"osd":4,"last update":"Sat Feb 10 08:32:13 2024","interfaces":[{"interface":"back","average":{"1min":2.7280000000000002,"5min":1.599,"15min":1.036},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.216},"max":{"1min":12.574999999999999,"5min":12.574999999999999,"15min":12.574999999999999},"last":1.4179999999999999},{"interface":"front","average":{"1min":2.2080000000000002,"5min":1.587,"15min":1.0389999999999999},"min":{"1min":0.29699999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":8.8170000000000002,"5min":8.8170000000000002,"15min":12.987},"last":1.3149999999999999}]},{"osd":5,"last update":"Sat Feb 10 08:32:13 2024","interfaces":[{"interface":"back","average":{"1min":4.1479999999999997,"5min":2.5259999999999998,"15min":1.456},"min":{"1min":0.28199999999999997,"5min":0.24199999999999999,"15min":0.218},"max":{"1min":12.882,"5min":15.304,"15min":15.304},"last":2.2029999999999998},{"interface":"front","average":{"1min":2.9199999999999999,"5min":2.0350000000000001,"15min":1.23},"min":{"1min":0.307,"5min":0.255,"15min":0.22600000000000001},"max":{"1min":13.129,"5min":13.129,"15min":13.129},"last":0.41699999999999998}]},{"osd":6,"last update":"Sat Feb 10 08:32:13 2024","interfaces":[{"interface":"back","average":{"1min":2.694,"5min":1.7370000000000001,"15min":1.0840000000000001},"min":{"1min":0.33600000000000002,"5min":0.27500000000000002,"15min":0.26100000000000001},"max":{"1min":10.101000000000001,"5min":10.101000000000001,"15min":10.101000000000001},"last":0.89900000000000002},{"interface":"front","average":{"1min":3.0750000000000002,"5min":1.8149999999999999,"15min":1.0940000000000001},"min":{"1min":0.308,"5min":0.27000000000000002,"15min":0.224},"max":{"1min":12.654,"5min":12.654,"15min":12.654},"last":1.458}]}]},{"osd":6,"up_from":43,"seq":184683593929,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":786280,"kb_used_data":480864,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":92958872,"statfs":{"total":95995035648,"available":95189884928,"internally_reserved":0,"allocated":492404736,"data_stored":491892444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:32:49 2024","interfaces":[{"interface":"back","average":{"1min":1.4870000000000001,"5min":1.7709999999999999,"15min":2.012},"min":{"1min":0.28999999999999998,"5min":0.222,"15min":0.19400000000000001},"max":{"1min":6.4420000000000002,"5min":7.9909999999999997,"15min":30.509},"last":0.80800000000000005},{"interface":"front","average":{"1min":1.603,"5min":1.516,"15min":1.732},"min":{"1min":0.377,"5min":0.245,"15min":0.21099999999999999},"max":{"1min":7.375,"5min":7.673,"15min":36.090000000000003},"last":1.105}]},{"osd":1,"last update":"Sat Feb 10 08:32:49 2024","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.784,"15min":1.5580000000000001},"min":{"1min":0.28599999999999998,"5min":0.223,"15min":0.20899999999999999},"max":{"1min":4.8099999999999996,"5min":6.3780000000000001,"15min":12.938000000000001},"last":0.42299999999999999},{"interface":"front","average":{"1min":1.7090000000000001,"5min":1.9630000000000001,"15min":1.6899999999999999},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":7.2990000000000004,"5min":9.8829999999999991,"15min":10.441000000000001},"last":1.5800000000000001}]},{"osd":2,"last update":"Sat Feb 10 08:32:49 2024","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":2.0369999999999999,"15min":1.9019999999999999},"min":{"1min":0.33200000000000002,"5min":0.25900000000000001,"15min":0.24399999999999999},"max":{"1min":6,"5min":25.146999999999998,"15min":35.072000000000003},"last":1.345},{"interface":"front","average":{"1min":1.5840000000000001,"5min":1.7170000000000001,"15min":1.768},"min":{"1min":0.34999999999999998,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":10.837999999999999,"5min":25.135999999999999,"15min":35.103000000000002},"last":0.97699999999999998}]},{"osd":3,"last update":"Sat Feb 10 08:32:49 2024","interfaces":[{"interface":"back","average":{"1min":1.7789999999999999,"5min":1.9990000000000001,"15min":1.73},"min":{"1min":0.32700000000000001,"5min":0.32400000000000001,"15min":0.26600000000000001},"max":{"1min":8.2780000000000005,"5min":8.2780000000000005,"15min":15.212999999999999},"last":0.32700000000000001},{"interface":"front","average":{"1min":1.548,"5min":1.9179999999999999,"15min":1.7509999999999999},"min":{"1min":0.29399999999999998,"5min":0.26300000000000001,"15min":0.253},"max":{"1min":7.3300000000000001,"5min":8.9410000000000007,"15min":17.797000000000001},"last":1.4950000000000001}]},{"osd":4,"last update":"Sat Feb 10 08:32:10 2024","interfaces":[{"interface":"back","average":{"1min":2.3660000000000001,"5min":1.5940000000000001,"15min":1.022},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":7.5860000000000003,"5min":7.5860000000000003,"15min":9.3879999999999999},"last":1.7370000000000001},{"interface":"front","average":{"1min":1.8089999999999999,"5min":1.821,"15min":1.133},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.22600000000000001},"max":{"1min":8.3140000000000001,"5min":8.3140000000000001,"15min":10.348000000000001},"last":1.012}]},{"osd":5,"last update":"Sat Feb 10 08:32:49 2024","interfaces":[{"interface":"back","average":{"1min":2.4100000000000001,"5min":2.2349999999999999,"15min":1.3300000000000001},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.20200000000000001},"max":{"1min":10.300000000000001,"5min":29.631,"15min":29.631},"last":0.753},{"interface":"front","average":{"1min":1.1890000000000001,"5min":2.1139999999999999,"15min":1.288},"min":{"1min":0.29699999999999999,"5min":0.23699999999999999,"15min":0.22900000000000001},"max":{"1min":8.3369999999999997,"5min":29.419,"15min":29.419},"last":0.29699999999999999}]},{"osd":7,"last update":"Sat Feb 10 08:32:10 2024","interfaces":[{"interface":"back","average":{"1min":2.7440000000000002,"5min":2.1280000000000001,"15min":1.8899999999999999},"min":{"1min":0.30599999999999999,"5min":0.29299999999999998,"15min":0.23999999999999999},"max":{"1min":7.0259999999999998,"5min":13.298999999999999,"15min":194.88900000000001},"last":0.34999999999999998},{"interface":"front","average":{"1min":3.089,"5min":2.3109999999999999,"15min":2.0219999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.26400000000000001},"max":{"1min":14.128,"5min":14.128,"15min":194.74100000000001},"last":0.39100000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575072,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":822080,"kb_used_data":224184,"kb_used_omap":0,"kb_used_meta":597888,"kb_avail":92923072,"statfs":{"total":95995035648,"available":95153225728,"internally_reserved":0,"allocated":229564416,"data_stored":229027567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":612237312},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:32:49 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":1.603,"15min":1.972},"min":{"1min":0.215,"5min":0.186,"15min":0.17100000000000001},"max":{"1min":3.8010000000000002,"5min":19.263000000000002,"15min":29.763999999999999},"last":1.429},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.516,"15min":2.109},"min":{"1min":0.20799999999999999,"5min":0.20100000000000001,"15min":0.17899999999999999},"max":{"1min":9.3290000000000006,"5min":9.5289999999999999,"15min":29.637},"last":0.30399999999999999}]},{"osd":2,"last update":"Sat Feb 10 08:32:17 2024","interfaces":[{"interface":"back","average":{"1min":2.5259999999999998,"5min":1.774,"15min":2.1309999999999998},"min":{"1min":0.24399999999999999,"5min":0.22,"15min":0.21199999999999999},"max":{"1min":9.3610000000000007,"5min":15.347,"15min":31.420999999999999},"last":0.34499999999999997},{"interface":"front","average":{"1min":1.9159999999999999,"5min":1.754,"15min":2.3069999999999999},"min":{"1min":0.23400000000000001,"5min":0.184,"15min":0.184},"max":{"1min":7.2679999999999998,"5min":16.344000000000001,"15min":31.484999999999999},"last":0.39300000000000002}]},{"osd":3,"last update":"Sat Feb 10 08:32:42 2024","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.7150000000000001,"15min":2.2719999999999998},"min":{"1min":0.30399999999999999,"5min":0.253,"15min":0.247},"max":{"1min":4.8150000000000004,"5min":12.228999999999999,"15min":28.082000000000001},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.4430000000000001,"5min":1.7989999999999999,"15min":1.952},"min":{"1min":0.25600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":6.9450000000000003,"5min":19.303999999999998,"15min":29.722000000000001},"last":1.466}]},{"osd":4,"last update":"Sat Feb 10 08:32:06 2024","interfaces":[{"interface":"back","average":{"1min":2.2480000000000002,"5min":1.8180000000000001,"15min":2.0449999999999999},"min":{"1min":0.29499999999999998,"5min":0.29099999999999998,"15min":0.26100000000000001},"max":{"1min":13.515000000000001,"5min":13.515000000000001,"15min":14.086},"last":0.40699999999999997},{"interface":"front","average":{"1min":2.3580000000000001,"5min":1.8759999999999999,"15min":2.3889999999999998},"min":{"1min":0.34200000000000003,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":8.0289999999999999,"5min":9.0969999999999995,"15min":31.515000000000001},"last":0.437}]},{"osd":5,"last update":"Sat Feb 10 08:32:17 2024","interfaces":[{"interface":"back","average":{"1min":2.2490000000000001,"5min":2.1019999999999999,"15min":1.9670000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.26000000000000001},"max":{"1min":10.605,"5min":21.751000000000001,"15min":40.140999999999998},"last":0.45100000000000001},{"interface":"front","average":{"1min":2.3730000000000002,"5min":2.2629999999999999,"15min":2.2290000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.28499999999999998},"max":{"1min":6.5810000000000004,"5min":16.324000000000002,"15min":40.831000000000003},"last":0.47499999999999998}]},{"osd":6,"last update":"Sat Feb 10 08:32:49 2024","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.7709999999999999,"15min":1.9199999999999999},"min":{"1min":0.37,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":3.359,"5min":9.1259999999999994,"15min":31.27},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.667,"15min":1.5760000000000001},"min":{"1min":0.35299999999999998,"5min":0.309,"15min":0.27700000000000002},"max":{"1min":3.742,"5min":6.8700000000000001,"15min":10.433},"last":1.494}]},{"osd":7,"last update":"Sat Feb 10 08:32:17 2024","interfaces":[{"interface":"back","average":{"1min":3.5070000000000001,"5min":2.1349999999999998,"15min":2.008},"min":{"1min":0.436,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":19.692,"5min":19.692,"15min":31.344999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":3.3919999999999999,"5min":2.0920000000000001,"15min":1.661},"min":{"1min":0.377,"5min":0.34200000000000003,"15min":0.312},"max":{"1min":15.91,"5min":15.91,"15min":15.91},"last":1.5149999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738596,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":424952,"kb_used_data":119536,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93320200,"statfs":{"total":95995035648,"available":95559884800,"internally_reserved":0,"allocated":122404864,"data_stored":121869599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 10 08:31:54 2024","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":1.758,"15min":2.456},"min":{"1min":0.16300000000000001,"5min":0.16300000000000001,"15min":0.14399999999999999},"max":{"1min":5.9000000000000004,"5min":11.058,"15min":102.48099999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":1.8140000000000001,"5min":1.8009999999999999,"15min":2.3090000000000002},"min":{"1min":0.28199999999999997,"5min":0.20300000000000001,"15min":0.193},"max":{"1min":9.1010000000000009,"5min":11.367000000000001,"15min":103.38800000000001},"last":0.71899999999999997}]},{"osd":2,"last update":"Sat Feb 10 08:32:15 2024","interfaces":[{"interface":"back","average":{"1min":3.4540000000000002,"5min":2.5059999999999998,"15min":2.7959999999999998},"min":{"1min":0.25700000000000001,"5min":0.192,"15min":0.192},"max":{"1min":12.276,"5min":21.331,"15min":102.462},"last":0.41199999999999998},{"interface":"front","average":{"1min":1.4550000000000001,"5min":1.599,"15min":2.395},"min":{"1min":0.216,"5min":0.216,"15min":0.20799999999999999},"max":{"1min":5.5490000000000004,"5min":6.1870000000000003,"15min":102.66500000000001},"last":0.63200000000000001}]},{"osd":3,"last update":"Sat Feb 10 08:32:39 2024","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.577,"15min":2.0640000000000001},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.22600000000000001},"max":{"1min":8.0399999999999991,"5min":8.4849999999999994,"15min":16.495000000000001},"last":0.69499999999999995},{"interface":"front","average":{"1min":2.9049999999999998,"5min":1.948,"15min":2.6669999999999998},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.222},"max":{"1min":9.1449999999999996,"5min":10.56,"15min":102.64400000000001},"last":0.44600000000000001}]},{"osd":4,"last update":"Sat Feb 10 08:32:03 2024","interfaces":[{"interface":"back","average":{"1min":2.6819999999999999,"5min":2.0299999999999998,"15min":2.9750000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.253},"max":{"1min":8.7119999999999997,"5min":10.596,"15min":102.742},"last":0.48199999999999998},{"interface":"front","average":{"1min":1.345,"5min":1.5429999999999999,"15min":1.772},"min":{"1min":0.39500000000000002,"5min":0.28100000000000003,"15min":0.26200000000000001},"max":{"1min":6.452,"5min":7.3890000000000002,"15min":16.352},"last":0.39300000000000002}]},{"osd":5,"last update":"Sat Feb 10 08:32:31 2024","interfaces":[{"interface":"back","average":{"1min":2.6080000000000001,"5min":1.919,"15min":2.101},"min":{"1min":0.36499999999999999,"5min":0.34499999999999997,"15min":0.31900000000000001},"max":{"1min":17.321000000000002,"5min":17.321000000000002,"15min":102.53100000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":1.794,"5min":1.79,"15min":1.6639999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.22500000000000001},"max":{"1min":6.4390000000000001,"5min":9.7360000000000007,"15min":16.463999999999999},"last":0.61899999999999999}]},{"osd":6,"last update":"Sat Feb 10 08:31:54 2024","interfaces":[{"interface":"back","average":{"1min":1.6220000000000001,"5min":1.704,"15min":2.0449999999999999},"min":{"1min":0.35799999999999998,"5min":0.30199999999999999,"15min":0.28599999999999998},"max":{"1min":6.2590000000000003,"5min":7.5810000000000004,"15min":102.583},"last":0.68500000000000005},{"interface":"front","average":{"1min":2.2280000000000002,"5min":1.6399999999999999,"15min":1.5489999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.308},"max":{"1min":9.0259999999999998,"5min":9.0259999999999998,"15min":16.391999999999999},"last":0.66800000000000004}]},{"osd":7,"last update":"Sat Feb 10 08:32:15 2024","interfaces":[{"interface":"back","average":{"1min":1.9059999999999999,"5min":1.819,"15min":2.8929999999999998},"min":{"1min":0.39300000000000002,"5min":0.36299999999999999,"15min":0.34100000000000003},"max":{"1min":6.4889999999999999,"5min":6.6130000000000004,"15min":255.53200000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":2.1360000000000001,"5min":1.8129999999999999,"15min":2.4079999999999999},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.28599999999999998},"max":{"1min":9.0719999999999992,"5min":9.0719999999999992,"15min":254.88800000000001},"last":0.56999999999999995}]}]},{"osd":2,"up_from":18,"seq":77309411547,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":680360,"kb_used_data":94752,"kb_used_omap":0,"kb_used_meta":585600,"kb_avail":93064792,"statfs":{"total":95995035648,"available":95298347008,"internally_reserved":0,"allocated":97026048,"data_stored":96506548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":599654400},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":1.022,"15min":1.7110000000000001},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.17399999999999999},"max":{"1min":4.202,"5min":6.1369999999999996,"15min":24.859999999999999},"last":2.0619999999999998},{"interface":"front","average":{"1min":2.8559999999999999,"5min":1.962,"15min":2.3500000000000001},"min":{"1min":0.252,"5min":0.20499999999999999,"15min":0.193},"max":{"1min":15.15,"5min":15.15,"15min":28.295999999999999},"last":2.4910000000000001}]},{"osd":1,"last update":"Sat Feb 10 08:32:20 2024","interfaces":[{"interface":"back","average":{"1min":2.1899999999999999,"5min":1.9099999999999999,"15min":1.861},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.19700000000000001},"max":{"1min":7.7169999999999996,"5min":13.622,"15min":15.644},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.91700000000000004,"5min":1.0169999999999999,"15min":1.3480000000000001},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":4.2389999999999999,"5min":5.9000000000000004,"15min":16.968},"last":0.68600000000000005}]},{"osd":3,"last update":"Sat Feb 10 08:32:42 2024","interfaces":[{"interface":"back","average":{"1min":1.899,"5min":1.4910000000000001,"15min":1.952},"min":{"1min":0.29299999999999998,"5min":0.26300000000000001,"15min":0.23300000000000001},"max":{"1min":8.6679999999999993,"5min":8.6679999999999993,"15min":24.946000000000002},"last":0.315},{"interface":"front","average":{"1min":1.036,"5min":1.228,"15min":2.0289999999999999},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":4.8449999999999998,"5min":6.3310000000000004,"15min":24.905000000000001},"last":0.70699999999999996}]},{"osd":4,"last update":"Sat Feb 10 08:32:02 2024","interfaces":[{"interface":"back","average":{"1min":2.7229999999999999,"5min":1.784,"15min":2.0529999999999999},"min":{"1min":0.315,"5min":0.30099999999999999,"15min":0.27400000000000002},"max":{"1min":10.573,"5min":10.573,"15min":13.260999999999999},"last":0.39900000000000002},{"interface":"front","average":{"1min":1.224,"5min":1.3069999999999999,"15min":1.3180000000000001},"min":{"1min":0.29699999999999999,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":3.8420000000000001,"5min":6.7060000000000004,"15min":15.696},"last":0.749}]},{"osd":5,"last update":"Sat Feb 10 08:32:26 2024","interfaces":[{"interface":"back","average":{"1min":3.0840000000000001,"5min":2.2650000000000001,"15min":1.885},"min":{"1min":0.41599999999999998,"5min":0.29899999999999999,"15min":0.26600000000000001},"max":{"1min":13.201000000000001,"5min":13.201000000000001,"15min":13.939},"last":0.77400000000000002},{"interface":"front","average":{"1min":2.6190000000000002,"5min":2.0750000000000002,"15min":1.7490000000000001},"min":{"1min":0.34399999999999997,"5min":0.29199999999999998,"15min":0.28599999999999998},"max":{"1min":9.5030000000000001,"5min":9.5709999999999997,"15min":13.317},"last":0.35199999999999998}]},{"osd":6,"last update":"Sat Feb 10 08:31:57 2024","interfaces":[{"interface":"back","average":{"1min":2.0489999999999999,"5min":1.819,"15min":1.7909999999999999},"min":{"1min":0.33200000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":5.7720000000000002,"5min":10.481999999999999,"15min":38.177999999999997},"last":0.72999999999999998},{"interface":"front","average":{"1min":2.5329999999999999,"5min":2.008,"15min":1.8520000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.29099999999999998},"max":{"1min":7.0919999999999996,"5min":13.567,"15min":37.682000000000002},"last":0.45500000000000002}]},{"osd":7,"last update":"Sat Feb 10 08:32:20 2024","interfaces":[{"interface":"back","average":{"1min":2.915,"5min":1.95,"15min":1.7410000000000001},"min":{"1min":0.45500000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":9.6869999999999994,"5min":9.6869999999999994,"15min":13.231999999999999},"last":0.42699999999999999},{"interface":"front","average":{"1min":1.5429999999999999,"5min":1.6319999999999999,"15min":1.353},"min":{"1min":0.374,"5min":0.30399999999999999,"15min":0.29199999999999998},"max":{"1min":8.1110000000000007,"5min":8.1110000000000007,"15min":15.714},"last":0.65200000000000002}]}]},{"osd":3,"up_from":25,"seq":107374182615,"num_pgs":62,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":920132,"kb_used_data":322236,"kb_used_omap":0,"kb_used_meta":597888,"kb_avail":92825020,"statfs":{"total":95995035648,"available":95052820480,"internally_reserved":0,"allocated":329969664,"data_stored":329428302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":612237312},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:32:38 2024","interfaces":[{"interface":"back","average":{"1min":1.4890000000000001,"5min":1.5449999999999999,"15min":1.8100000000000001},"min":{"1min":0.20399999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":10.795,"5min":10.795,"15min":14.167},"last":0.63500000000000001},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.585,"15min":1.776},"min":{"1min":0.222,"5min":0.184,"15min":0.184},"max":{"1min":5.5369999999999999,"5min":16.155000000000001,"15min":26.643000000000001},"last":0.52600000000000002}]},{"osd":1,"last update":"Sat Feb 10 08:32:38 2024","interfaces":[{"interface":"back","average":{"1min":2.3690000000000002,"5min":1.964,"15min":1.9059999999999999},"min":{"1min":0.23699999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":13.371,"5min":13.371,"15min":13.371},"last":0.27800000000000002},{"interface":"front","average":{"1min":2.677,"5min":2.02,"15min":2.1429999999999998},"min":{"1min":0.27900000000000003,"5min":0.20599999999999999,"15min":0.191},"max":{"1min":10.67,"5min":19.344000000000001,"15min":21.373999999999999},"last":0.47899999999999998}]},{"osd":2,"last update":"Sat Feb 10 08:32:38 2024","interfaces":[{"interface":"back","average":{"1min":1.754,"5min":1.821,"15min":2.0259999999999998},"min":{"1min":0.27600000000000002,"5min":0.214,"15min":0.214},"max":{"1min":7.5369999999999999,"5min":14.631,"15min":21.434000000000001},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.784,"5min":1.3999999999999999,"15min":1.75},"min":{"1min":0.30099999999999999,"5min":0.23400000000000001,"15min":0.215},"max":{"1min":12.289,"5min":12.289,"15min":18.061},"last":0.38600000000000001}]},{"osd":4,"last update":"Sat Feb 10 08:32:11 2024","interfaces":[{"interface":"back","average":{"1min":2.093,"5min":1.5740000000000001,"15min":1.6970000000000001},"min":{"1min":0.35799999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":6.6299999999999999,"5min":8.8379999999999992,"15min":12.272},"last":0.81000000000000005},{"interface":"front","average":{"1min":1.786,"5min":1.77,"15min":2.1339999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":10.754,"5min":10.754,"15min":12.391999999999999},"last":0.81999999999999995}]},{"osd":5,"last update":"Sat Feb 10 08:32:33 2024","interfaces":[{"interface":"back","average":{"1min":3.2919999999999998,"5min":2.1680000000000001,"15min":1.5940000000000001},"min":{"1min":0.39400000000000002,"5min":0.316,"15min":0.249},"max":{"1min":19.832000000000001,"5min":19.832000000000001,"15min":19.832000000000001},"last":0.495},{"interface":"front","average":{"1min":3.0739999999999998,"5min":2.077,"15min":1.8180000000000001},"min":{"1min":0.30099999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":19.712,"5min":19.712,"15min":19.712},"last":0.755}]},{"osd":6,"last update":"Sat Feb 10 08:31:51 2024","interfaces":[{"interface":"back","average":{"1min":2.4710000000000001,"5min":2.028,"15min":1.7},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":16.423999999999999,"5min":16.423999999999999,"15min":16.423999999999999},"last":0.60199999999999998},{"interface":"front","average":{"1min":2.6429999999999998,"5min":2.0150000000000001,"15min":1.516},"min":{"1min":0.35999999999999999,"5min":0.31,"15min":0.28499999999999998},"max":{"1min":5.8630000000000004,"5min":9.7010000000000005,"15min":12.324999999999999},"last":0.438}]},{"osd":7,"last update":"Sat Feb 10 08:32:11 2024","interfaces":[{"interface":"back","average":{"1min":2.302,"5min":1.8500000000000001,"15min":1.536},"min":{"1min":0.33500000000000002,"5min":0.33400000000000002,"15min":0.28299999999999997},"max":{"1min":5.8869999999999996,"5min":8.9109999999999996,"15min":12.358000000000001},"last":1.198},{"interface":"front","average":{"1min":1.8460000000000001,"5min":1.964,"15min":1.8149999999999999},"min":{"1min":0.41799999999999998,"5min":0.33000000000000002,"15min":0.26500000000000001},"max":{"1min":4.7610000000000001,"5min":14.587,"15min":15.702},"last":1.2909999999999999}]}]},{"osd":4,"up_from":110,"seq":472446402706,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":617196,"kb_used_data":302948,"kb_used_omap":0,"kb_used_meta":314239,"kb_avail":93127956,"statfs":{"total":95995035648,"available":95363026944,"internally_reserved":0,"allocated":310218752,"data_stored":309694575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":972,"internal_metadata":321780788},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:32:22 2024","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":1.327,"15min":1.339},"min":{"1min":0.223,"5min":0.21199999999999999,"15min":0.19800000000000001},"max":{"1min":2.5489999999999999,"5min":14.595000000000001,"15min":14.595000000000001},"last":1.069},{"interface":"front","average":{"1min":1.8380000000000001,"5min":1.895,"15min":2.4449999999999998},"min":{"1min":0.27700000000000002,"5min":0.22600000000000001,"15min":0.222},"max":{"1min":8.0820000000000007,"5min":14.446999999999999,"15min":16.524000000000001},"last":0.89500000000000002}]},{"osd":1,"last update":"Sat Feb 10 08:32:22 2024","interfaces":[{"interface":"back","average":{"1min":2.6440000000000001,"5min":2.1960000000000002,"15min":2.0449999999999999},"min":{"1min":0.44800000000000001,"5min":0.218,"15min":0.218},"max":{"1min":8.2149999999999999,"5min":38.621000000000002,"15min":38.621000000000002},"last":1.026},{"interface":"front","average":{"1min":1.5429999999999999,"5min":2.0899999999999999,"15min":1.911},"min":{"1min":0.35499999999999998,"5min":0.217,"15min":0.217},"max":{"1min":5.2530000000000001,"5min":38.430999999999997,"15min":38.430999999999997},"last":1.0449999999999999}]},{"osd":2,"last update":"Sat Feb 10 08:32:22 2024","interfaces":[{"interface":"back","average":{"1min":2.1070000000000002,"5min":2.0760000000000001,"15min":1.988},"min":{"1min":0.249,"5min":0.246,"15min":0.218},"max":{"1min":10.608000000000001,"5min":14.414,"15min":14.414},"last":0.45000000000000001},{"interface":"front","average":{"1min":2.6299999999999999,"5min":1.7130000000000001,"15min":1.8839999999999999},"min":{"1min":0.30499999999999999,"5min":0.247,"15min":0.247},"max":{"1min":11.958,"5min":11.958,"15min":11.958},"last":0.91700000000000004}]},{"osd":3,"last update":"Sat Feb 10 08:32:22 2024","interfaces":[{"interface":"back","average":{"1min":2.0430000000000001,"5min":1.8919999999999999,"15min":2.0179999999999998},"min":{"1min":0.39000000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":6.0140000000000002,"5min":14.358000000000001,"15min":14.358000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":2.5960000000000001,"5min":1.9470000000000001,"15min":1.778},"min":{"1min":0.34300000000000003,"5min":0.249,"15min":0.249},"max":{"1min":8.3360000000000003,"5min":8.3360000000000003,"15min":11.648},"last":0.40500000000000003}]},{"osd":5,"last update":"Sat Feb 10 08:32:22 2024","interfaces":[{"interface":"back","average":{"1min":1.569,"5min":1.5580000000000001,"15min":1.1040000000000001},"min":{"1min":0.26400000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":9.4550000000000001,"5min":20.355,"15min":41.488},"last":0.29099999999999998},{"interface":"front","average":{"1min":1.5700000000000001,"5min":1.7130000000000001,"15min":1.347},"min":{"1min":0.30099999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":8.2799999999999994,"5min":16.350000000000001,"15min":42.527999999999999},"last":0.27200000000000002}]},{"osd":6,"last update":"Sat Feb 10 08:32:22 2024","interfaces":[{"interface":"back","average":{"1min":2.1400000000000001,"5min":1.522,"15min":1.2190000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.26400000000000001},"max":{"1min":8.2910000000000004,"5min":8.2910000000000004,"15min":39.554000000000002},"last":0.33700000000000002},{"interface":"front","average":{"1min":2.1400000000000001,"5min":1.6160000000000001,"15min":1.2729999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":8.2539999999999996,"5min":11.342000000000001,"15min":41.741999999999997},"last":0.36399999999999999}]},{"osd":7,"last update":"Sat Feb 10 08:32:22 2024","interfaces":[{"interface":"back","average":{"1min":2.2240000000000002,"5min":1.7270000000000001,"15min":1.238},"min":{"1min":0.34799999999999998,"5min":0.29199999999999998,"15min":0.28899999999999998},"max":{"1min":8.6289999999999996,"5min":8.6289999999999996,"15min":11.047000000000001},"last":0.38500000000000001},{"interface":"front","average":{"1min":1.585,"5min":1.8160000000000001,"15min":1.0649999999999999},"min":{"1min":0.30199999999999999,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":6.2519999999999998,"5min":16.245999999999999,"15min":16.245999999999999},"last":0.34899999999999998}]}]},{"osd":5,"up_from":37,"seq":158913790158,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":913320,"kb_used_data":315424,"kb_used_omap":0,"kb_used_meta":597888,"kb_avail":92831832,"statfs":{"total":95995035648,"available":95059795968,"internally_reserved":0,"allocated":322994176,"data_stored":322481057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":612237312},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:32:27 2024","interfaces":[{"interface":"back","average":{"1min":1.4450000000000001,"5min":1.399,"15min":1.611},"min":{"1min":0.218,"5min":0.218,"15min":0.20499999999999999},"max":{"1min":7.5300000000000002,"5min":10.789,"15min":22.914000000000001},"last":0.24399999999999999},{"interface":"front","average":{"1min":2.0880000000000001,"5min":1.5780000000000001,"15min":1.51},"min":{"1min":0.22900000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":13.738,"5min":13.738,"15min":23.161000000000001},"last":0.40200000000000002}]},{"osd":1,"last update":"Sat Feb 10 08:32:27 2024","interfaces":[{"interface":"back","average":{"1min":1.77,"5min":1.738,"15min":1.3999999999999999},"min":{"1min":0.249,"5min":0.222,"15min":0.19500000000000001},"max":{"1min":8.359,"5min":8.359,"15min":8.359},"last":0.308},{"interface":"front","average":{"1min":1.304,"5min":1.276,"15min":1.29},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.254},"max":{"1min":3.7810000000000001,"5min":8.6899999999999995,"15min":9.0579999999999998},"last":0.45000000000000001}]},{"osd":2,"last update":"Sat Feb 10 08:32:27 2024","interfaces":[{"interface":"back","average":{"1min":1.6899999999999999,"5min":1.6499999999999999,"15min":1.5920000000000001},"min":{"1min":0.33100000000000002,"5min":0.248,"15min":0.24099999999999999},"max":{"1min":7.9829999999999997,"5min":20.254999999999999,"15min":20.254999999999999},"last":0.29899999999999999},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.6579999999999999,"15min":1.4630000000000001},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.26400000000000001},"max":{"1min":5.0789999999999997,"5min":6.3929999999999998,"15min":9.2810000000000006},"last":0.33700000000000002}]},{"osd":3,"last update":"Sat Feb 10 08:32:27 2024","interfaces":[{"interface":"back","average":{"1min":1.6100000000000001,"5min":1.3460000000000001,"15min":1.341},"min":{"1min":0.29399999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":8.0079999999999991,"5min":8.0079999999999991,"15min":24.198},"last":0.47099999999999997},{"interface":"front","average":{"1min":1.8089999999999999,"5min":1.649,"15min":1.605},"min":{"1min":0.375,"5min":0.27300000000000002,"15min":0.25900000000000001},"max":{"1min":9.7100000000000009,"5min":10.766,"15min":22.701000000000001},"last":0.36699999999999999}]},{"osd":4,"last update":"Sat Feb 10 08:32:08 2024","interfaces":[{"interface":"back","average":{"1min":2.165,"5min":1.3819999999999999,"15min":1},"min":{"1min":0.254,"5min":0.24099999999999999,"15min":0.23599999999999999},"max":{"1min":7.923,"5min":7.923,"15min":7.923},"last":0.66100000000000003},{"interface":"front","average":{"1min":1.988,"5min":1.7270000000000001,"15min":1.083},"min":{"1min":0.28199999999999997,"5min":0.26000000000000001,"15min":0.22500000000000001},"max":{"1min":9.0009999999999994,"5min":12.948,"15min":12.948},"last":0.61699999999999999}]},{"osd":6,"last update":"Sat Feb 10 08:32:49 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":1.1100000000000001,"15min":0.97999999999999998},"min":{"1min":0.30599999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":3.4329999999999998,"5min":6.3959999999999999,"15min":8.3559999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.2749999999999999,"15min":1.0089999999999999},"min":{"1min":0.41799999999999998,"5min":0.29299999999999998,"15min":0.23999999999999999},"max":{"1min":3.3719999999999999,"5min":7.875,"15min":7.875},"last":0.502}]},{"osd":7,"last update":"Sat Feb 10 08:32:21 2024","interfaces":[{"interface":"back","average":{"1min":2.3010000000000002,"5min":1.359,"15min":2.161},"min":{"1min":0.313,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":7.952,"5min":7.952,"15min":371.87400000000002},"last":0.42299999999999999},{"interface":"front","average":{"1min":1.409,"5min":1.657,"15min":2.367},"min":{"1min":0.35799999999999998,"5min":0.32000000000000001,"15min":0.23499999999999999},"max":{"1min":3.8679999999999999,"5min":12.984999999999999,"15min":372.63099999999997},"last":0.39000000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":223805440,"data_stored":223805440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":229769216,"data_stored":229769216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":111804416,"data_stored":111804416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":377683968,"data_stored":377683968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":364380160,"data_stored":364380160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":369164288,"data_stored":369164288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":514785280,"data_stored":514785280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":301793280,"data_stored":301793280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-10T08:32:57.514 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph pg dump --format=json 2024-02-10T08:32:57.600 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:32:57.655 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:57.706 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 11 16 28564 28548 162.167 123.5 0.00623576 0.00615907 2024-02-10T08:32:58.182 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.1 dump_blocked_ops 2024-02-10T08:32:58.227 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:32:58.230 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:58.231 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:32:58.290 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:32:58.310 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:32:58.332 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:32:58.334 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:32:58.380 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:56.956493+0000 mgr.y (mgr.14505) 608 : cluster [DBG] pgmap v755: 168 pgs: 168 active+clean; 1.2 GiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 834 B/s rd, 144 MiB/s wr, 2.31k op/s 2024-02-10T08:32:58.380 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:57.658542+0000 osd.3 (osd.3) 107 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:32:58.380 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:57.658599+0000 osd.3 (osd.3) 108 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:32:58.380 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:56.956493+0000 mgr.y (mgr.14505) 608 : cluster [DBG] pgmap v755: 168 pgs: 168 active+clean; 1.2 GiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 834 B/s rd, 144 MiB/s wr, 2.31k op/s 2024-02-10T08:32:58.381 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:57.658542+0000 osd.3 (osd.3) 107 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:32:58.381 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:57.658599+0000 osd.3 (osd.3) 108 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:32:58.383 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:58.499 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:32:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:32:58.499 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:56.956493+0000 mgr.y (mgr.14505) 608 : cluster [DBG] pgmap v755: 168 pgs: 168 active+clean; 1.2 GiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 834 B/s rd, 144 MiB/s wr, 2.31k op/s 2024-02-10T08:32:58.499 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:57.658542+0000 osd.3 (osd.3) 107 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:32:58.499 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:57.658599+0000 osd.3 (osd.3) 108 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:32:58.647 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:32:58.654 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:32:58.654 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:32:58.706 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 12 16 30293 30277 157.657 108.062 0.0118958 0.00633781 2024-02-10T08:32:58.755 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:32:58.802 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:32:59.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:32:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:58.062939+0000 mon.a (mon.0) 1521 : cluster [DBG] osdmap e347: 8 total, 8 up, 8 in 2024-02-10T08:32:59.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:32:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:58.062939+0000 mon.a (mon.0) 1521 : cluster [DBG] osdmap e347: 8 total, 8 up, 8 in 2024-02-10T08:32:59.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:32:59 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:58.062939+0000 mon.a (mon.0) 1521 : cluster [DBG] osdmap e347: 8 total, 8 up, 8 in 2024-02-10T08:32:59.707 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 13 16 32317 32301 155.26 126.5 0.00924302 0.00643507 2024-02-10T08:33:00.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:32:58.498069+0000 mgr.y (mgr.14505) 609 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:33:00.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:32:58.956996+0000 mgr.y (mgr.14505) 610 : cluster [DBG] pgmap v757: 168 pgs: 168 active+clean; 1.7 GiB data, 8.6 GiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 148 MiB/s wr, 2.36k op/s 2024-02-10T08:33:00.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:32:58.498069+0000 mgr.y (mgr.14505) 609 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:33:00.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:32:58.956996+0000 mgr.y (mgr.14505) 610 : cluster [DBG] pgmap v757: 168 pgs: 168 active+clean; 1.7 GiB data, 8.6 GiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 148 MiB/s wr, 2.36k op/s 2024-02-10T08:33:00.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:32:58.498069+0000 mgr.y (mgr.14505) 609 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:33:00.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:32:58.956996+0000 mgr.y (mgr.14505) 610 : cluster [DBG] pgmap v757: 168 pgs: 168 active+clean; 1.7 GiB data, 8.6 GiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 148 MiB/s wr, 2.36k op/s 2024-02-10T08:33:00.707 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 14 16 34284 34268 152.947 122.938 0.00928109 0.00653323 2024-02-10T08:33:01.707 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 15 16 36162 36146 150.575 117.375 0.00550687 0.00663578 2024-02-10T08:33:02.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:00.830462+0000 mon.a (mon.0) 1522 : cluster [DBG] osdmap e348: 8 total, 8 up, 8 in 2024-02-10T08:33:02.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:00.957399+0000 mgr.y (mgr.14505) 611 : cluster [DBG] pgmap v759: 168 pgs: 168 active+clean; 1.8 GiB data, 8.9 GiB used, 706 GiB / 715 GiB avail; 853 B/s rd, 123 MiB/s wr, 1.96k op/s 2024-02-10T08:33:02.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:00.830462+0000 mon.a (mon.0) 1522 : cluster [DBG] osdmap e348: 8 total, 8 up, 8 in 2024-02-10T08:33:02.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:00.957399+0000 mgr.y (mgr.14505) 611 : cluster [DBG] pgmap v759: 168 pgs: 168 active+clean; 1.8 GiB data, 8.9 GiB used, 706 GiB / 715 GiB avail; 853 B/s rd, 123 MiB/s wr, 1.96k op/s 2024-02-10T08:33:02.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:00.830462+0000 mon.a (mon.0) 1522 : cluster [DBG] osdmap e348: 8 total, 8 up, 8 in 2024-02-10T08:33:02.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:00.957399+0000 mgr.y (mgr.14505) 611 : cluster [DBG] pgmap v759: 168 pgs: 168 active+clean; 1.8 GiB data, 8.9 GiB used, 706 GiB / 715 GiB avail; 853 B/s rd, 123 MiB/s wr, 1.96k op/s 2024-02-10T08:33:02.707 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 16 16 37982 37966 148.273 113.75 0.00646859 0.00673927 2024-02-10T08:33:03.708 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 17 16 39588 39572 145.456 100.375 0.0104114 0.00687088 2024-02-10T08:33:04.026 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:02.958076+0000 mgr.y (mgr.14505) 612 : cluster [DBG] pgmap v760: 168 pgs: 168 active+clean; 2.2 GiB data, 9.8 GiB used, 705 GiB / 715 GiB avail; 1.4 KiB/s rd, 142 MiB/s wr, 2.27k op/s 2024-02-10T08:33:04.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:02.958076+0000 mgr.y (mgr.14505) 612 : cluster [DBG] pgmap v760: 168 pgs: 168 active+clean; 2.2 GiB data, 9.8 GiB used, 705 GiB / 715 GiB avail; 1.4 KiB/s rd, 142 MiB/s wr, 2.27k op/s 2024-02-10T08:33:04.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:02.958076+0000 mgr.y (mgr.14505) 612 : cluster [DBG] pgmap v760: 168 pgs: 168 active+clean; 2.2 GiB data, 9.8 GiB used, 705 GiB / 715 GiB avail; 1.4 KiB/s rd, 142 MiB/s wr, 2.27k op/s 2024-02-10T08:33:04.441 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:33:04.444 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:04.445 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:33:04.546 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:33:04.606 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:04.638 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:33:04.646 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:04.646 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:33:04.708 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 18 16 41299 41283 143.315 106.938 0.00917238 0.00697251 2024-02-10T08:33:04.747 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:33:04.784 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:04.817 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:33:04.820 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:04.820 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:33:04.921 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:33:04.970 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:05.014 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:33:05.017 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:05.018 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:33:05.118 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:33:05.171 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:05.199 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:33:05.206 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:05.206 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:33:05.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:03.209027+0000 osd.1 (osd.1) 188 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:33:05.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:03.209089+0000 osd.1 (osd.1) 189 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:33:05.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:04.015416+0000 mon.a (mon.0) 1523 : cluster [DBG] osdmap e349: 8 total, 8 up, 8 in 2024-02-10T08:33:05.307 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:33:05.359 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:05.388 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:33:05.394 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:05.394 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:33:05.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:03.209027+0000 osd.1 (osd.1) 188 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:33:05.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:03.209089+0000 osd.1 (osd.1) 189 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:33:05.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:04.015416+0000 mon.a (mon.0) 1523 : cluster [DBG] osdmap e349: 8 total, 8 up, 8 in 2024-02-10T08:33:05.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:03.209027+0000 osd.1 (osd.1) 188 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:33:05.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:03.209089+0000 osd.1 (osd.1) 189 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:33:05.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:04.015416+0000 mon.a (mon.0) 1523 : cluster [DBG] osdmap e349: 8 total, 8 up, 8 in 2024-02-10T08:33:05.495 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:33:05.540 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:05.566 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:33:05.576 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:05.577 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:33:05.678 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:33:05.708 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 19 16 42942 42926 141.172 102.688 0.00853613 0.00707946 2024-02-10T08:33:05.742 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:05.820 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:33:05.849 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is unset 2024-02-10T08:33:06.042 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:04.958539+0000 mgr.y (mgr.14505) 613 : cluster [DBG] pgmap v762: 168 pgs: 168 active+clean; 2.3 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 742 B/s rd, 97 MiB/s wr, 1.55k op/s 2024-02-10T08:33:06.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:04.958539+0000 mgr.y (mgr.14505) 613 : cluster [DBG] pgmap v762: 168 pgs: 168 active+clean; 2.3 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 742 B/s rd, 97 MiB/s wr, 1.55k op/s 2024-02-10T08:33:06.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:33:05.053028+0000 mon.a (mon.0) 1524 : audit [INF] from='client.? 172.21.15.18:0/655801604' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:33:06.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:05.825641+0000 mon.a (mon.0) 1525 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:33:06.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:33:05.836634+0000 mon.a (mon.0) 1526 : audit [INF] from='client.? 172.21.15.18:0/655801604' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-10T08:33:06.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:05.836983+0000 mon.a (mon.0) 1527 : cluster [DBG] osdmap e350: 8 total, 8 up, 8 in 2024-02-10T08:33:06.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:33:05.837961+0000 mon.a (mon.0) 1528 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:33:06.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:33:05.053028+0000 mon.a (mon.0) 1524 : audit [INF] from='client.? 172.21.15.18:0/655801604' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:33:06.407 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:05.825641+0000 mon.a (mon.0) 1525 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:33:06.407 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:33:05.836634+0000 mon.a (mon.0) 1526 : audit [INF] from='client.? 172.21.15.18:0/655801604' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-10T08:33:06.407 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:05.836983+0000 mon.a (mon.0) 1527 : cluster [DBG] osdmap e350: 8 total, 8 up, 8 in 2024-02-10T08:33:06.407 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:33:05.837961+0000 mon.a (mon.0) 1528 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:33:06.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:04.958539+0000 mgr.y (mgr.14505) 613 : cluster [DBG] pgmap v762: 168 pgs: 168 active+clean; 2.3 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 742 B/s rd, 97 MiB/s wr, 1.55k op/s 2024-02-10T08:33:06.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:33:05.053028+0000 mon.a (mon.0) 1524 : audit [INF] from='client.? 172.21.15.18:0/655801604' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:33:06.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:05.825641+0000 mon.a (mon.0) 1525 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:33:06.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:33:05.836634+0000 mon.a (mon.0) 1526 : audit [INF] from='client.? 172.21.15.18:0/655801604' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-10T08:33:06.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:05.836983+0000 mon.a (mon.0) 1527 : cluster [DBG] osdmap e350: 8 total, 8 up, 8 in 2024-02-10T08:33:06.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:33:05.837961+0000 mon.a (mon.0) 1528 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:33:06.518 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:33:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:33:06] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:33:06.708 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:2024-02-10T08:33:06.709055+0000 min lat: 0.00134707 max lat: 0.252504 avg lat: 0.00719751 2024-02-10T08:33:06.709 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-02-10T08:33:06.709 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 20 16 44453 44437 138.834 94.4375 0.015253 0.00719751 2024-02-10T08:33:06.807 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:33:06.811 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:06.812 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:33:06.913 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:33:06.983 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:07.049 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:06.352444+0000 osd.7 (osd.7) 195 : cluster [DBG] 2.1d scrub starts 2024-02-10T08:33:07.049 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:06.363620+0000 osd.7 (osd.7) 196 : cluster [DBG] 2.1d scrub ok 2024-02-10T08:33:07.049 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:33:06.920090+0000 mon.a (mon.0) 1529 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:33:07.049 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:06.352444+0000 osd.7 (osd.7) 195 : cluster [DBG] 2.1d scrub starts 2024-02-10T08:33:07.049 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:06.363620+0000 osd.7 (osd.7) 196 : cluster [DBG] 2.1d scrub ok 2024-02-10T08:33:07.049 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:33:06.920090+0000 mon.a (mon.0) 1529 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:33:07.128 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:33:07.132 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:07.133 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:33:07.234 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:33:07.292 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:07.405 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:33:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:33:07] "GET /metrics HTTP/1.1" 200 176397 "" "Prometheus/2.33.4" 2024-02-10T08:33:07.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:06.352444+0000 osd.7 (osd.7) 195 : cluster [DBG] 2.1d scrub starts 2024-02-10T08:33:07.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:06.363620+0000 osd.7 (osd.7) 196 : cluster [DBG] 2.1d scrub ok 2024-02-10T08:33:07.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:33:06.920090+0000 mon.a (mon.0) 1529 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:33:07.710 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 21 16 45958 45942 136.691 94.0625 0.00993185 0.00731103 2024-02-10T08:33:08.297 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:06.263536+0000 osd.4 (osd.4) 104 : cluster [DBG] 4.13 scrub starts 2024-02-10T08:33:08.297 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:06.269017+0000 osd.4 (osd.4) 105 : cluster [DBG] 4.13 scrub ok 2024-02-10T08:33:08.297 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:06.787409+0000 osd.1 (osd.1) 190 : cluster [DBG] 5.12 scrub starts 2024-02-10T08:33:08.297 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:06.791287+0000 osd.1 (osd.1) 191 : cluster [DBG] 5.12 scrub ok 2024-02-10T08:33:08.297 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:06.959975+0000 mgr.y (mgr.14505) 614 : cluster [DBG] pgmap v764: 168 pgs: 168 active+clean; 2.4 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 835 B/s rd, 95 MiB/s wr, 1.53k op/s 2024-02-10T08:33:08.300 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:06.263536+0000 osd.4 (osd.4) 104 : cluster [DBG] 4.13 scrub starts 2024-02-10T08:33:08.300 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:06.269017+0000 osd.4 (osd.4) 105 : cluster [DBG] 4.13 scrub ok 2024-02-10T08:33:08.300 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:06.787409+0000 osd.1 (osd.1) 190 : cluster [DBG] 5.12 scrub starts 2024-02-10T08:33:08.300 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:06.791287+0000 osd.1 (osd.1) 191 : cluster [DBG] 5.12 scrub ok 2024-02-10T08:33:08.300 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:06.959975+0000 mgr.y (mgr.14505) 614 : cluster [DBG] pgmap v764: 168 pgs: 168 active+clean; 2.4 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 835 B/s rd, 95 MiB/s wr, 1.53k op/s 2024-02-10T08:33:08.509 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:06.263536+0000 osd.4 (osd.4) 104 : cluster [DBG] 4.13 scrub starts 2024-02-10T08:33:08.509 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:06.269017+0000 osd.4 (osd.4) 105 : cluster [DBG] 4.13 scrub ok 2024-02-10T08:33:08.509 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:06.787409+0000 osd.1 (osd.1) 190 : cluster [DBG] 5.12 scrub starts 2024-02-10T08:33:08.510 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:06.791287+0000 osd.1 (osd.1) 191 : cluster [DBG] 5.12 scrub ok 2024-02-10T08:33:08.510 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:06.959975+0000 mgr.y (mgr.14505) 614 : cluster [DBG] pgmap v764: 168 pgs: 168 active+clean; 2.4 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 835 B/s rd, 95 MiB/s wr, 1.53k op/s 2024-02-10T08:33:08.710 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 22 16 47607 47591 135.162 103.062 0.00569033 0.00739313 2024-02-10T08:33:08.789 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:33:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:33:09.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:07.657197+0000 osd.0 (osd.0) 167 : cluster [DBG] 6.16 scrub starts 2024-02-10T08:33:09.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:07.663491+0000 osd.0 (osd.0) 168 : cluster [DBG] 6.16 scrub ok 2024-02-10T08:33:09.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:07.657197+0000 osd.0 (osd.0) 167 : cluster [DBG] 6.16 scrub starts 2024-02-10T08:33:09.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:07.663491+0000 osd.0 (osd.0) 168 : cluster [DBG] 6.16 scrub ok 2024-02-10T08:33:09.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:07.657197+0000 osd.0 (osd.0) 167 : cluster [DBG] 6.16 scrub starts 2024-02-10T08:33:09.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:07.663491+0000 osd.0 (osd.0) 168 : cluster [DBG] 6.16 scrub ok 2024-02-10T08:33:09.710 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 23 16 49191 49175 133.59 99 0.015642 0.00748014 2024-02-10T08:33:09.861 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:33:09.866 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:09.866 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:33:09.966 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:33:10.065 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:33:08.509146+0000 mgr.y (mgr.14505) 615 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:33:10.065 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:08.696123+0000 osd.0 (osd.0) 169 : cluster [DBG] 6.18 scrub starts 2024-02-10T08:33:10.065 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:08.700519+0000 osd.0 (osd.0) 170 : cluster [DBG] 6.18 scrub ok 2024-02-10T08:33:10.065 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:08.864633+0000 osd.1 (osd.1) 192 : cluster [DBG] 5.19 scrub starts 2024-02-10T08:33:10.065 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:08.870336+0000 osd.1 (osd.1) 193 : cluster [DBG] 5.19 scrub ok 2024-02-10T08:33:10.066 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:08.960858+0000 mgr.y (mgr.14505) 616 : cluster [DBG] pgmap v765: 168 pgs: 168 active+clean; 2.8 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 1.2 KiB/s rd, 127 MiB/s wr, 2.04k op/s 2024-02-10T08:33:10.073 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:10.370 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:33:08.509146+0000 mgr.y (mgr.14505) 615 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:33:10.371 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:08.696123+0000 osd.0 (osd.0) 169 : cluster [DBG] 6.18 scrub starts 2024-02-10T08:33:10.371 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:08.700519+0000 osd.0 (osd.0) 170 : cluster [DBG] 6.18 scrub ok 2024-02-10T08:33:10.371 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:08.864633+0000 osd.1 (osd.1) 192 : cluster [DBG] 5.19 scrub starts 2024-02-10T08:33:10.371 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:08.870336+0000 osd.1 (osd.1) 193 : cluster [DBG] 5.19 scrub ok 2024-02-10T08:33:10.371 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:08.960858+0000 mgr.y (mgr.14505) 616 : cluster [DBG] pgmap v765: 168 pgs: 168 active+clean; 2.8 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 1.2 KiB/s rd, 127 MiB/s wr, 2.04k op/s 2024-02-10T08:33:10.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:33:08.509146+0000 mgr.y (mgr.14505) 615 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:33:10.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:08.696123+0000 osd.0 (osd.0) 169 : cluster [DBG] 6.18 scrub starts 2024-02-10T08:33:10.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:08.700519+0000 osd.0 (osd.0) 170 : cluster [DBG] 6.18 scrub ok 2024-02-10T08:33:10.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:08.864633+0000 osd.1 (osd.1) 192 : cluster [DBG] 5.19 scrub starts 2024-02-10T08:33:10.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:08.870336+0000 osd.1 (osd.1) 193 : cluster [DBG] 5.19 scrub ok 2024-02-10T08:33:10.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:08.960858+0000 mgr.y (mgr.14505) 616 : cluster [DBG] pgmap v765: 168 pgs: 168 active+clean; 2.8 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 1.2 KiB/s rd, 127 MiB/s wr, 2.04k op/s 2024-02-10T08:33:10.711 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 24 16 50674 50658 131.884 92.6875 0.00894688 0.00757749 2024-02-10T08:33:11.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:09.655907+0000 osd.2 (osd.2) 159 : cluster [DBG] 4.19 scrub starts 2024-02-10T08:33:11.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:09.659229+0000 osd.2 (osd.2) 160 : cluster [DBG] 4.19 scrub ok 2024-02-10T08:33:11.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:09.730736+0000 osd.0 (osd.0) 171 : cluster [DBG] 4.6 scrub starts 2024-02-10T08:33:11.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:09.736687+0000 osd.0 (osd.0) 172 : cluster [DBG] 4.6 scrub ok 2024-02-10T08:33:11.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:33:10.151519+0000 mon.a (mon.0) 1530 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:33:11.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:33:10.154406+0000 mon.a (mon.0) 1531 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:33:11.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:33:10.164916+0000 mon.a (mon.0) 1532 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:33:11.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:10.318727+0000 osd.7 (osd.7) 197 : cluster [DBG] 6.21 scrub starts 2024-02-10T08:33:11.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:10.338250+0000 osd.7 (osd.7) 198 : cluster [DBG] 6.21 scrub ok 2024-02-10T08:33:11.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:10.867919+0000 osd.1 (osd.1) 194 : cluster [DBG] 2.15 scrub starts 2024-02-10T08:33:11.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:10.874010+0000 osd.1 (osd.1) 195 : cluster [DBG] 2.15 scrub ok 2024-02-10T08:33:11.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:09.655907+0000 osd.2 (osd.2) 159 : cluster [DBG] 4.19 scrub starts 2024-02-10T08:33:11.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:09.659229+0000 osd.2 (osd.2) 160 : cluster [DBG] 4.19 scrub ok 2024-02-10T08:33:11.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:09.730736+0000 osd.0 (osd.0) 171 : cluster [DBG] 4.6 scrub starts 2024-02-10T08:33:11.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:09.736687+0000 osd.0 (osd.0) 172 : cluster [DBG] 4.6 scrub ok 2024-02-10T08:33:11.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:33:10.151519+0000 mon.a (mon.0) 1530 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:33:11.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:33:10.154406+0000 mon.a (mon.0) 1531 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:33:11.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:33:10.164916+0000 mon.a (mon.0) 1532 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:33:11.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:10.318727+0000 osd.7 (osd.7) 197 : cluster [DBG] 6.21 scrub starts 2024-02-10T08:33:11.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:10.338250+0000 osd.7 (osd.7) 198 : cluster [DBG] 6.21 scrub ok 2024-02-10T08:33:11.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:10.867919+0000 osd.1 (osd.1) 194 : cluster [DBG] 2.15 scrub starts 2024-02-10T08:33:11.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:10.874010+0000 osd.1 (osd.1) 195 : cluster [DBG] 2.15 scrub ok 2024-02-10T08:33:11.506 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:33:11.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:09.655907+0000 osd.2 (osd.2) 159 : cluster [DBG] 4.19 scrub starts 2024-02-10T08:33:11.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:09.659229+0000 osd.2 (osd.2) 160 : cluster [DBG] 4.19 scrub ok 2024-02-10T08:33:11.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:09.730736+0000 osd.0 (osd.0) 171 : cluster [DBG] 4.6 scrub starts 2024-02-10T08:33:11.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:09.736687+0000 osd.0 (osd.0) 172 : cluster [DBG] 4.6 scrub ok 2024-02-10T08:33:11.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:33:10.151519+0000 mon.a (mon.0) 1530 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:33:11.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:33:10.154406+0000 mon.a (mon.0) 1531 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:33:11.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:33:10.164916+0000 mon.a (mon.0) 1532 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:33:11.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:10.318727+0000 osd.7 (osd.7) 197 : cluster [DBG] 6.21 scrub starts 2024-02-10T08:33:11.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:10.338250+0000 osd.7 (osd.7) 198 : cluster [DBG] 6.21 scrub ok 2024-02-10T08:33:11.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:10.867919+0000 osd.1 (osd.1) 194 : cluster [DBG] 2.15 scrub starts 2024-02-10T08:33:11.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:10.874010+0000 osd.1 (osd.1) 195 : cluster [DBG] 2.15 scrub ok 2024-02-10T08:33:11.547 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:33:11.584 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:33:11.629 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:33:11.666 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:33:11.705 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:33:11.713 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 25 16 52076 52060 130.103 87.625 0.0116707 0.0076803 2024-02-10T08:33:11.750 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:33:11.758 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:33:11.768 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:11.769 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:33:11.787 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:33:11.800 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-10T08:33:11.801 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-10T08:33:11.801 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-10T08:33:11.801 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-10T08:33:11.801 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-10T08:33:11.801 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-10T08:33:11.801 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-10T08:33:11.801 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-10T08:33:11.854 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd unset nodeep-scrub 2024-02-10T08:33:11.870 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:33:11.964 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:12.077 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:33:12.091 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-02-10T08:33:12.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:10.720318+0000 osd.0 (osd.0) 173 : cluster [DBG] 2.1f scrub starts 2024-02-10T08:33:12.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:10.725593+0000 osd.0 (osd.0) 174 : cluster [DBG] 2.1f scrub ok 2024-02-10T08:33:12.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:10.961380+0000 mgr.y (mgr.14505) 617 : cluster [DBG] pgmap v766: 168 pgs: 168 active+clean; 2.8 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 639 B/s rd, 88 MiB/s wr, 1.42k op/s 2024-02-10T08:33:12.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:33:11.472159+0000 mon.b (mon.1) 75 : audit [DBG] from='client.? 172.21.15.18:0/1684134931' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:33:12.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:11.865340+0000 osd.1 (osd.1) 196 : cluster [DBG] 2.4 scrub starts 2024-02-10T08:33:12.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:11.869832+0000 osd.1 (osd.1) 197 : cluster [DBG] 2.4 scrub ok 2024-02-10T08:33:12.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:10.720318+0000 osd.0 (osd.0) 173 : cluster [DBG] 2.1f scrub starts 2024-02-10T08:33:12.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:10.725593+0000 osd.0 (osd.0) 174 : cluster [DBG] 2.1f scrub ok 2024-02-10T08:33:12.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:10.961380+0000 mgr.y (mgr.14505) 617 : cluster [DBG] pgmap v766: 168 pgs: 168 active+clean; 2.8 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 639 B/s rd, 88 MiB/s wr, 1.42k op/s 2024-02-10T08:33:12.407 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:33:11.472159+0000 mon.b (mon.1) 75 : audit [DBG] from='client.? 172.21.15.18:0/1684134931' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:33:12.407 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:11.865340+0000 osd.1 (osd.1) 196 : cluster [DBG] 2.4 scrub starts 2024-02-10T08:33:12.407 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:11.869832+0000 osd.1 (osd.1) 197 : cluster [DBG] 2.4 scrub ok 2024-02-10T08:33:12.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:10.720318+0000 osd.0 (osd.0) 173 : cluster [DBG] 2.1f scrub starts 2024-02-10T08:33:12.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:10.725593+0000 osd.0 (osd.0) 174 : cluster [DBG] 2.1f scrub ok 2024-02-10T08:33:12.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:10.961380+0000 mgr.y (mgr.14505) 617 : cluster [DBG] pgmap v766: 168 pgs: 168 active+clean; 2.8 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 639 B/s rd, 88 MiB/s wr, 1.42k op/s 2024-02-10T08:33:12.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:33:11.472159+0000 mon.b (mon.1) 75 : audit [DBG] from='client.? 172.21.15.18:0/1684134931' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:33:12.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:11.865340+0000 osd.1 (osd.1) 196 : cluster [DBG] 2.4 scrub starts 2024-02-10T08:33:12.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:11.869832+0000 osd.1 (osd.1) 197 : cluster [DBG] 2.4 scrub ok 2024-02-10T08:33:12.713 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 26 16 53408 53392 128.301 83.25 0.0117374 0.00778865 2024-02-10T08:33:13.376 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:33:13.385 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:13.386 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:33:13.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:33:12.049280+0000 mgr.y (mgr.14505) 618 : audit [DBG] from='client.15471 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-10T08:33:13.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:12.213390+0000 osd.6 (osd.6) 166 : cluster [DBG] 4.1f scrub starts 2024-02-10T08:33:13.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:12.217002+0000 osd.6 (osd.6) 167 : cluster [DBG] 4.1f scrub ok 2024-02-10T08:33:13.387 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:33:12.049280+0000 mgr.y (mgr.14505) 618 : audit [DBG] from='client.15471 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-10T08:33:13.387 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:12.213390+0000 osd.6 (osd.6) 166 : cluster [DBG] 4.1f scrub starts 2024-02-10T08:33:13.387 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:12.217002+0000 osd.6 (osd.6) 167 : cluster [DBG] 4.1f scrub ok 2024-02-10T08:33:13.424 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-02-10T08:33:13.424 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-02-10T08:33:13.424 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-02-10T08:33:13.424 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-02-10T08:33:13.424 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-02-10T08:33:13.487 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:33:13.520 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:33:12.049280+0000 mgr.y (mgr.14505) 618 : audit [DBG] from='client.15471 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-10T08:33:13.520 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:12.213390+0000 osd.6 (osd.6) 166 : cluster [DBG] 4.1f scrub starts 2024-02-10T08:33:13.520 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:12.217002+0000 osd.6 (osd.6) 167 : cluster [DBG] 4.1f scrub ok 2024-02-10T08:33:13.522 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:13.550 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:33:13.555 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:13.555 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:33:13.656 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:33:13.715 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 27 16 54811 54795 126.788 87.6875 0.0152312 0.00788215 2024-02-10T08:33:13.728 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:14.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:12.962116+0000 mgr.y (mgr.14505) 619 : cluster [DBG] pgmap v767: 168 pgs: 168 active+clean; 3.1 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 1.1 KiB/s rd, 95 MiB/s wr, 1.53k op/s 2024-02-10T08:33:14.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:12.962265+0000 osd.5 (osd.5) 199 : cluster [DBG] 2.3 scrub starts 2024-02-10T08:33:14.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:12.974209+0000 osd.5 (osd.5) 200 : cluster [DBG] 2.3 scrub ok 2024-02-10T08:33:14.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:13.158667+0000 osd.6 (osd.6) 168 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:33:14.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:13.158705+0000 osd.6 (osd.6) 169 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:33:14.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:13.173174+0000 osd.6 (osd.6) 170 : cluster [DBG] 2.1a scrub starts 2024-02-10T08:33:14.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:13.175554+0000 osd.6 (osd.6) 171 : cluster [DBG] 2.1a scrub ok 2024-02-10T08:33:14.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:13.897168+0000 osd.1 (osd.1) 198 : cluster [DBG] 4.4 scrub starts 2024-02-10T08:33:14.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:13.903644+0000 osd.1 (osd.1) 199 : cluster [DBG] 4.4 scrub ok 2024-02-10T08:33:14.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:12.962116+0000 mgr.y (mgr.14505) 619 : cluster [DBG] pgmap v767: 168 pgs: 168 active+clean; 3.1 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 1.1 KiB/s rd, 95 MiB/s wr, 1.53k op/s 2024-02-10T08:33:14.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:12.962265+0000 osd.5 (osd.5) 199 : cluster [DBG] 2.3 scrub starts 2024-02-10T08:33:14.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:12.974209+0000 osd.5 (osd.5) 200 : cluster [DBG] 2.3 scrub ok 2024-02-10T08:33:14.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:13.158667+0000 osd.6 (osd.6) 168 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:33:14.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:13.158705+0000 osd.6 (osd.6) 169 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:33:14.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:13.173174+0000 osd.6 (osd.6) 170 : cluster [DBG] 2.1a scrub starts 2024-02-10T08:33:14.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:13.175554+0000 osd.6 (osd.6) 171 : cluster [DBG] 2.1a scrub ok 2024-02-10T08:33:14.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:13.897168+0000 osd.1 (osd.1) 198 : cluster [DBG] 4.4 scrub starts 2024-02-10T08:33:14.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:13.903644+0000 osd.1 (osd.1) 199 : cluster [DBG] 4.4 scrub ok 2024-02-10T08:33:14.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:12.962116+0000 mgr.y (mgr.14505) 619 : cluster [DBG] pgmap v767: 168 pgs: 168 active+clean; 3.1 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 1.1 KiB/s rd, 95 MiB/s wr, 1.53k op/s 2024-02-10T08:33:14.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:12.962265+0000 osd.5 (osd.5) 199 : cluster [DBG] 2.3 scrub starts 2024-02-10T08:33:14.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:12.974209+0000 osd.5 (osd.5) 200 : cluster [DBG] 2.3 scrub ok 2024-02-10T08:33:14.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:13.158667+0000 osd.6 (osd.6) 168 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:33:14.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:13.158705+0000 osd.6 (osd.6) 169 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:33:14.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:13.173174+0000 osd.6 (osd.6) 170 : cluster [DBG] 2.1a scrub starts 2024-02-10T08:33:14.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:13.175554+0000 osd.6 (osd.6) 171 : cluster [DBG] 2.1a scrub ok 2024-02-10T08:33:14.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:13.897168+0000 osd.1 (osd.1) 198 : cluster [DBG] 4.4 scrub starts 2024-02-10T08:33:14.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:13.903644+0000 osd.1 (osd.1) 199 : cluster [DBG] 4.4 scrub ok 2024-02-10T08:33:14.596 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:33:14.618 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:14.618 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:33:14.717 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 28 15 56159 56144 125.265 84.3125 0.0143717 0.00797839 2024-02-10T08:33:14.719 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:33:14.772 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:15.041 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:33:15.056 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:15.056 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:33:15.157 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:33:15.210 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:15.236 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:33:15.239 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:15.239 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:33:15.300 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:14.087660+0000 mon.a (mon.0) 1533 : cluster [DBG] osdmap e351: 8 total, 8 up, 8 in 2024-02-10T08:33:15.300 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:14.190770+0000 osd.6 (osd.6) 172 : cluster [DBG] 2.7 scrub starts 2024-02-10T08:33:15.300 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:14.196198+0000 osd.6 (osd.6) 173 : cluster [DBG] 2.7 scrub ok 2024-02-10T08:33:15.301 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:14.087660+0000 mon.a (mon.0) 1533 : cluster [DBG] osdmap e351: 8 total, 8 up, 8 in 2024-02-10T08:33:15.301 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:14.190770+0000 osd.6 (osd.6) 172 : cluster [DBG] 2.7 scrub starts 2024-02-10T08:33:15.301 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:14.196198+0000 osd.6 (osd.6) 173 : cluster [DBG] 2.7 scrub ok 2024-02-10T08:33:15.340 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:33:15.394 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:15.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:14.087660+0000 mon.a (mon.0) 1533 : cluster [DBG] osdmap e351: 8 total, 8 up, 8 in 2024-02-10T08:33:15.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:14.190770+0000 osd.6 (osd.6) 172 : cluster [DBG] 2.7 scrub starts 2024-02-10T08:33:15.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:14.196198+0000 osd.6 (osd.6) 173 : cluster [DBG] 2.7 scrub ok 2024-02-10T08:33:15.662 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":766,"stamp":"2024-02-10T08:33:10.961023+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3052017322,"num_objects":46762,"num_object_clones":0,"num_object_copies":140286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46762,"num_whiteouts":0,"num_read":2081,"num_read_kb":1833,"num_write":47283,"num_write_kb":2980520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":230,"num_bytes_recovered":7872,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":47410,"ondisk_log_size":47410,"up":504,"acting":504,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":504,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":12697356,"kb_used_data":8803276,"kb_used_omap":0,"kb_used_meta":3894015,"kb_avail":737263860,"statfs":{"total":767960285184,"available":754958192640,"internally_reserved":0,"allocated":9014554624,"data_stored":9010062156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":972,"internal_metadata":3987471412},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":742260736,"num_objects":11326,"num_object_clones":0,"num_object_copies":33978,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11326,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":11326,"num_write_kb":724864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.003440"},"pg_stats":[{"pgid":"6.33","version":"0'0","reported_seq":238,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.016808+0000","last_change":"2024-02-10T08:30:26.080816+0000","last_active":"2024-02-10T08:33:04.016808+0000","last_peered":"2024-02-10T08:33:04.016808+0000","last_clean":"2024-02-10T08:33:04.016808+0000","last_became_active":"2024-02-10T08:30:26.080326+0000","last_became_peered":"2024-02-10T08:30:26.080326+0000","last_unstale":"2024-02-10T08:33:04.016808+0000","last_undegraded":"2024-02-10T08:33:04.016808+0000","last_fullsized":"2024-02-10T08:33:04.016808+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:34.502781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:34.502781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2],"acting":[5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":341,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.022435+0000","last_change":"2024-02-10T08:30:26.067603+0000","last_active":"2024-02-10T08:33:04.022435+0000","last_peered":"2024-02-10T08:33:04.022435+0000","last_clean":"2024-02-10T08:33:04.022435+0000","last_became_active":"2024-02-10T08:30:26.067019+0000","last_became_peered":"2024-02-10T08:30:26.067019+0000","last_unstale":"2024-02-10T08:33:04.022435+0000","last_undegraded":"2024-02-10T08:33:04.022435+0000","last_fullsized":"2024-02-10T08:33:04.022435+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:12.421034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:27.276490+0000","last_clean_scrub_stamp":"2024-02-10T08:29:12.421034+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.6","version":"350'2895","reported_seq":2918,"reported_epoch":350,"state":"active+clean","last_fresh":"2024-02-10T08:33:07.726646+0000","last_change":"2024-02-10T08:32:30.821933+0000","last_active":"2024-02-10T08:33:07.726646+0000","last_peered":"2024-02-10T08:33:07.726646+0000","last_clean":"2024-02-10T08:33:07.726646+0000","last_became_active":"2024-02-10T08:32:30.821631+0000","last_became_peered":"2024-02-10T08:32:30.821631+0000","last_unstale":"2024-02-10T08:33:07.726646+0000","last_undegraded":"2024-02-10T08:33:07.726646+0000","last_fullsized":"2024-02-10T08:33:07.726646+0000","mapping_epoch":335,"log_start":"0'0","ondisk_log_start":"0'0","created":335,"last_epoch_clean":336,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.947585+0000","log_size":2895,"ondisk_log_size":2895,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":189726720,"num_objects":2895,"num_object_clones":0,"num_object_copies":8685,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2895,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2895,"num_write_kb":185280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4],"acting":[5,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"111'10","reported_seq":550,"reported_epoch":350,"state":"active+clean","last_fresh":"2024-02-10T08:33:05.844691+0000","last_change":"2024-02-10T08:28:29.196174+0000","last_active":"2024-02-10T08:33:05.844691+0000","last_peered":"2024-02-10T08:33:05.844691+0000","last_clean":"2024-02-10T08:33:05.844691+0000","last_became_active":"2024-02-10T08:20:46.399193+0000","last_became_peered":"2024-02-10T08:20:46.399193+0000","last_unstale":"2024-02-10T08:33:05.844691+0000","last_undegraded":"2024-02-10T08:33:05.844691+0000","last_fullsized":"2024-02-10T08:33:05.844691+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'10","last_scrub_stamp":"2024-02-10T08:28:29.196109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:28:29.196109+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"225'27","reported_seq":364,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.016243+0000","last_change":"2024-02-10T08:29:07.059712+0000","last_active":"2024-02-10T08:33:04.016243+0000","last_peered":"2024-02-10T08:33:04.016243+0000","last_clean":"2024-02-10T08:33:04.016243+0000","last_became_active":"2024-02-10T08:16:55.204597+0000","last_became_peered":"2024-02-10T08:16:55.204597+0000","last_unstale":"2024-02-10T08:33:04.016243+0000","last_undegraded":"2024-02-10T08:33:04.016243+0000","last_fullsized":"2024-02-10T08:33:04.016243+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'27","last_scrub_stamp":"2024-02-10T08:29:07.059646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:29:07.059646+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":356,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.024646+0000","last_change":"2024-02-10T08:32:20.331056+0000","last_active":"2024-02-10T08:33:04.024646+0000","last_peered":"2024-02-10T08:33:04.024646+0000","last_clean":"2024-02-10T08:33:04.024646+0000","last_became_active":"2024-02-10T08:32:20.330612+0000","last_became_peered":"2024-02-10T08:32:20.330612+0000","last_unstale":"2024-02-10T08:33:04.024646+0000","last_undegraded":"2024-02-10T08:33:04.024646+0000","last_fullsized":"2024-02-10T08:33:04.024646+0000","mapping_epoch":331,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":332,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:24.554978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:29:24.554978+0000","last_clean_scrub_stamp":"2024-02-10T08:29:24.554978+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":344,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.016714+0000","last_change":"2024-02-10T08:30:24.063277+0000","last_active":"2024-02-10T08:33:04.016714+0000","last_peered":"2024-02-10T08:33:04.016714+0000","last_clean":"2024-02-10T08:33:04.016714+0000","last_became_active":"2024-02-10T08:30:24.062795+0000","last_became_peered":"2024-02-10T08:30:24.062795+0000","last_unstale":"2024-02-10T08:33:04.016714+0000","last_undegraded":"2024-02-10T08:33:04.016714+0000","last_fullsized":"2024-02-10T08:33:04.016714+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:30.227120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:20.392249+0000","last_clean_scrub_stamp":"2024-02-10T08:28:30.227120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"350'2880","reported_seq":2903,"reported_epoch":350,"state":"active+clean","last_fresh":"2024-02-10T08:33:07.958307+0000","last_change":"2024-02-10T08:32:30.826128+0000","last_active":"2024-02-10T08:33:07.958307+0000","last_peered":"2024-02-10T08:33:07.958307+0000","last_clean":"2024-02-10T08:33:07.958307+0000","last_became_active":"2024-02-10T08:32:30.825592+0000","last_became_peered":"2024-02-10T08:32:30.825592+0000","last_unstale":"2024-02-10T08:33:07.958307+0000","last_undegraded":"2024-02-10T08:33:07.958307+0000","last_fullsized":"2024-02-10T08:33:07.958307+0000","mapping_epoch":335,"log_start":"0'0","ondisk_log_start":"0'0","created":335,"last_epoch_clean":336,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.947585+0000","log_size":2880,"ondisk_log_size":2880,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":188743680,"num_objects":2880,"num_object_clones":0,"num_object_copies":8640,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2880,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2880,"num_write_kb":184320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"225'15","reported_seq":136,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.020527+0000","last_change":"2024-02-10T08:32:18.530490+0000","last_active":"2024-02-10T08:33:04.020527+0000","last_peered":"2024-02-10T08:33:04.020527+0000","last_clean":"2024-02-10T08:33:04.020527+0000","last_became_active":"2024-02-10T08:28:02.770508+0000","last_became_peered":"2024-02-10T08:28:02.770508+0000","last_unstale":"2024-02-10T08:33:04.020527+0000","last_undegraded":"2024-02-10T08:33:04.020527+0000","last_fullsized":"2024-02-10T08:33:04.020527+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'15","last_scrub_stamp":"2024-02-10T08:32:18.530424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:32:18.530424+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":339,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.015591+0000","last_change":"2024-02-10T08:32:17.671792+0000","last_active":"2024-02-10T08:33:04.015591+0000","last_peered":"2024-02-10T08:33:04.015591+0000","last_clean":"2024-02-10T08:33:04.015591+0000","last_became_active":"2024-02-10T08:20:46.407311+0000","last_became_peered":"2024-02-10T08:20:46.407311+0000","last_unstale":"2024-02-10T08:33:04.015591+0000","last_undegraded":"2024-02-10T08:33:04.015591+0000","last_fullsized":"2024-02-10T08:33:04.015591+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:17.671622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:21.523096+0000","last_clean_scrub_stamp":"2024-02-10T08:32:17.671622+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":371,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.023250+0000","last_change":"2024-02-10T08:32:21.483917+0000","last_active":"2024-02-10T08:33:04.023250+0000","last_peered":"2024-02-10T08:33:04.023250+0000","last_clean":"2024-02-10T08:33:04.023250+0000","last_became_active":"2024-02-10T08:31:33.882809+0000","last_became_peered":"2024-02-10T08:31:33.882809+0000","last_unstale":"2024-02-10T08:33:04.023250+0000","last_undegraded":"2024-02-10T08:33:04.023250+0000","last_fullsized":"2024-02-10T08:33:04.023250+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:21.482538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:32:21.482538+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"76'2","reported_seq":20,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.019543+0000","last_change":"2024-02-10T08:32:36.979463+0000","last_active":"2024-02-10T08:33:04.019543+0000","last_peered":"2024-02-10T08:33:04.019543+0000","last_clean":"2024-02-10T08:33:04.019543+0000","last_became_active":"2024-02-10T08:32:36.979100+0000","last_became_peered":"2024-02-10T08:32:36.979100+0000","last_unstale":"2024-02-10T08:33:04.019543+0000","last_undegraded":"2024-02-10T08:33:04.019543+0000","last_fullsized":"2024-02-10T08:33:04.019543+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'2","last_scrub_stamp":"2024-02-10T08:28:20.073105+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2024-02-10T08:18:08.680038+0000","last_clean_scrub_stamp":"2024-02-10T08:28:20.073105+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":6,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"350'2953","reported_seq":2973,"reported_epoch":350,"state":"active+clean","last_fresh":"2024-02-10T08:33:08.223274+0000","last_change":"2024-02-10T08:32:36.986316+0000","last_active":"2024-02-10T08:33:08.223274+0000","last_peered":"2024-02-10T08:33:08.223274+0000","last_clean":"2024-02-10T08:33:08.223274+0000","last_became_active":"2024-02-10T08:32:36.985786+0000","last_became_peered":"2024-02-10T08:32:36.985786+0000","last_unstale":"2024-02-10T08:33:08.223274+0000","last_undegraded":"2024-02-10T08:33:08.223274+0000","last_fullsized":"2024-02-10T08:33:08.223274+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":335,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.947585+0000","log_size":2953,"ondisk_log_size":2953,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":193527808,"num_objects":2953,"num_object_clones":0,"num_object_copies":8859,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2953,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2953,"num_write_kb":188992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"226'35","reported_seq":376,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.027424+0000","last_change":"2024-02-10T08:29:09.404681+0000","last_active":"2024-02-10T08:33:04.027424+0000","last_peered":"2024-02-10T08:33:04.027424+0000","last_clean":"2024-02-10T08:33:04.027424+0000","last_became_active":"2024-02-10T08:16:55.203415+0000","last_became_peered":"2024-02-10T08:16:55.203415+0000","last_unstale":"2024-02-10T08:33:04.027424+0000","last_undegraded":"2024-02-10T08:33:04.027424+0000","last_fullsized":"2024-02-10T08:33:04.027424+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"226'35","last_scrub_stamp":"2024-02-10T08:29:09.404577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:29:09.404577+0000","log_size":35,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":56,"num_read_kb":45,"num_write":36,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":347,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.023681+0000","last_change":"2024-02-10T08:32:12.480970+0000","last_active":"2024-02-10T08:33:04.023681+0000","last_peered":"2024-02-10T08:33:04.023681+0000","last_clean":"2024-02-10T08:33:04.023681+0000","last_became_active":"2024-02-10T08:28:02.781029+0000","last_became_peered":"2024-02-10T08:28:02.781029+0000","last_unstale":"2024-02-10T08:33:04.023681+0000","last_undegraded":"2024-02-10T08:33:04.023681+0000","last_fullsized":"2024-02-10T08:33:04.023681+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:12.480865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:32:12.480865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":343,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.023789+0000","last_change":"2024-02-10T08:32:29.593920+0000","last_active":"2024-02-10T08:33:04.023789+0000","last_peered":"2024-02-10T08:33:04.023789+0000","last_clean":"2024-02-10T08:33:04.023789+0000","last_became_active":"2024-02-10T08:28:02.779438+0000","last_became_peered":"2024-02-10T08:28:02.779438+0000","last_unstale":"2024-02-10T08:33:04.023789+0000","last_undegraded":"2024-02-10T08:33:04.023789+0000","last_fullsized":"2024-02-10T08:33:04.023789+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.593849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.593849+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.593849+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":330,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.022310+0000","last_change":"2024-02-10T08:28:22.114493+0000","last_active":"2024-02-10T08:33:04.022310+0000","last_peered":"2024-02-10T08:33:04.022310+0000","last_clean":"2024-02-10T08:33:04.022310+0000","last_became_active":"2024-02-10T08:24:18.645480+0000","last_became_peered":"2024-02-10T08:24:18.645480+0000","last_unstale":"2024-02-10T08:33:04.022310+0000","last_undegraded":"2024-02-10T08:33:04.022310+0000","last_fullsized":"2024-02-10T08:33:04.022310+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:22.114421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:22.114421+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,3],"acting":[7,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3","version":"350'2865","reported_seq":2888,"reported_epoch":350,"state":"active+clean","last_fresh":"2024-02-10T08:33:07.966183+0000","last_change":"2024-02-10T08:32:30.825931+0000","last_active":"2024-02-10T08:33:07.966183+0000","last_peered":"2024-02-10T08:33:07.966183+0000","last_clean":"2024-02-10T08:33:07.966183+0000","last_became_active":"2024-02-10T08:32:30.825621+0000","last_became_peered":"2024-02-10T08:32:30.825621+0000","last_unstale":"2024-02-10T08:33:07.966183+0000","last_undegraded":"2024-02-10T08:33:07.966183+0000","last_fullsized":"2024-02-10T08:33:07.966183+0000","mapping_epoch":335,"log_start":"0'0","ondisk_log_start":"0'0","created":335,"last_epoch_clean":336,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.947585+0000","log_size":2865,"ondisk_log_size":2865,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":187760640,"num_objects":2865,"num_object_clones":0,"num_object_copies":8595,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2865,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2865,"num_write_kb":183360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"225'31","reported_seq":65,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.021205+0000","last_change":"2024-02-10T08:32:31.309431+0000","last_active":"2024-02-10T08:33:04.021205+0000","last_peered":"2024-02-10T08:33:04.021205+0000","last_clean":"2024-02-10T08:33:04.021205+0000","last_became_active":"2024-02-10T08:31:46.070488+0000","last_became_peered":"2024-02-10T08:31:46.070488+0000","last_unstale":"2024-02-10T08:33:04.021205+0000","last_undegraded":"2024-02-10T08:33:04.021205+0000","last_fullsized":"2024-02-10T08:33:04.021205+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'31","last_scrub_stamp":"2024-02-10T08:32:31.309364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:32:31.309364+0000","log_size":31,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":48,"num_read_kb":38,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":380,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.021752+0000","last_change":"2024-02-10T08:32:11.282121+0000","last_active":"2024-02-10T08:33:04.021752+0000","last_peered":"2024-02-10T08:33:04.021752+0000","last_clean":"2024-02-10T08:33:04.021752+0000","last_became_active":"2024-02-10T08:20:46.399568+0000","last_became_peered":"2024-02-10T08:20:46.399568+0000","last_unstale":"2024-02-10T08:33:04.021752+0000","last_undegraded":"2024-02-10T08:33:04.021752+0000","last_fullsized":"2024-02-10T08:33:04.021752+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:11.282042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:32:11.282042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":348,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.014452+0000","last_change":"2024-02-10T08:29:24.690721+0000","last_active":"2024-02-10T08:33:04.014452+0000","last_peered":"2024-02-10T08:33:04.014452+0000","last_clean":"2024-02-10T08:33:04.014452+0000","last_became_active":"2024-02-10T08:28:02.764210+0000","last_became_peered":"2024-02-10T08:28:02.764210+0000","last_unstale":"2024-02-10T08:33:04.014452+0000","last_undegraded":"2024-02-10T08:33:04.014452+0000","last_fullsized":"2024-02-10T08:33:04.014452+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:24.690623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:24.690623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":295,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.019465+0000","last_change":"2024-02-10T08:31:33.883772+0000","last_active":"2024-02-10T08:33:04.019465+0000","last_peered":"2024-02-10T08:33:04.019465+0000","last_clean":"2024-02-10T08:33:04.019465+0000","last_became_active":"2024-02-10T08:31:33.883457+0000","last_became_peered":"2024-02-10T08:31:33.883457+0000","last_unstale":"2024-02-10T08:33:04.019465+0000","last_undegraded":"2024-02-10T08:33:04.019465+0000","last_fullsized":"2024-02-10T08:33:04.019465+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:34.215363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:34.215363+0000","last_clean_scrub_stamp":"2024-02-10T08:28:34.215363+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2","version":"350'2901","reported_seq":2923,"reported_epoch":350,"state":"active+clean","last_fresh":"2024-02-10T08:33:07.804852+0000","last_change":"2024-02-10T08:32:30.822810+0000","last_active":"2024-02-10T08:33:07.804852+0000","last_peered":"2024-02-10T08:33:07.804852+0000","last_clean":"2024-02-10T08:33:07.804852+0000","last_became_active":"2024-02-10T08:32:30.822464+0000","last_became_peered":"2024-02-10T08:32:30.822464+0000","last_unstale":"2024-02-10T08:33:07.804852+0000","last_undegraded":"2024-02-10T08:33:07.804852+0000","last_fullsized":"2024-02-10T08:33:07.804852+0000","mapping_epoch":335,"log_start":"0'0","ondisk_log_start":"0'0","created":335,"last_epoch_clean":336,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.947585+0000","log_size":2901,"ondisk_log_size":2901,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":190119936,"num_objects":2901,"num_object_clones":0,"num_object_copies":8703,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2901,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2901,"num_write_kb":185664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"225'20","reported_seq":338,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.022373+0000","last_change":"2024-02-10T08:32:15.357432+0000","last_active":"2024-02-10T08:33:04.022373+0000","last_peered":"2024-02-10T08:33:04.022373+0000","last_clean":"2024-02-10T08:33:04.022373+0000","last_became_active":"2024-02-10T08:20:46.398973+0000","last_became_peered":"2024-02-10T08:20:46.398973+0000","last_unstale":"2024-02-10T08:33:04.022373+0000","last_undegraded":"2024-02-10T08:33:04.022373+0000","last_fullsized":"2024-02-10T08:33:04.022373+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'20","last_scrub_stamp":"2024-02-10T08:32:15.357342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:32:15.357342+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":24,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":324,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.014269+0000","last_change":"2024-02-10T08:32:27.711245+0000","last_active":"2024-02-10T08:33:04.014269+0000","last_peered":"2024-02-10T08:33:04.014269+0000","last_clean":"2024-02-10T08:33:04.014269+0000","last_became_active":"2024-02-10T08:16:52.785545+0000","last_became_peered":"2024-02-10T08:16:52.785545+0000","last_unstale":"2024-02-10T08:33:04.014269+0000","last_undegraded":"2024-02-10T08:33:04.014269+0000","last_fullsized":"2024-02-10T08:33:04.014269+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:27.711059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:32:27.711059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"62'8","reported_seq":528,"reported_epoch":350,"state":"active+clean","last_fresh":"2024-02-10T08:33:05.861646+0000","last_change":"2024-02-10T08:32:32.558184+0000","last_active":"2024-02-10T08:33:05.861646+0000","last_peered":"2024-02-10T08:33:05.861646+0000","last_clean":"2024-02-10T08:33:05.861646+0000","last_became_active":"2024-02-10T08:16:56.858101+0000","last_became_peered":"2024-02-10T08:16:56.858101+0000","last_unstale":"2024-02-10T08:33:05.861646+0000","last_undegraded":"2024-02-10T08:33:05.861646+0000","last_fullsized":"2024-02-10T08:33:05.861646+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'8","last_scrub_stamp":"2024-02-10T08:32:32.558115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:32:32.558115+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":297,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.021784+0000","last_change":"2024-02-10T08:30:24.071630+0000","last_active":"2024-02-10T08:33:04.021784+0000","last_peered":"2024-02-10T08:33:04.021784+0000","last_clean":"2024-02-10T08:33:04.021784+0000","last_became_active":"2024-02-10T08:30:24.071020+0000","last_became_peered":"2024-02-10T08:30:24.071020+0000","last_unstale":"2024-02-10T08:33:04.021784+0000","last_undegraded":"2024-02-10T08:33:04.021784+0000","last_fullsized":"2024-02-10T08:33:04.021784+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:26.976023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:26.976023+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1","version":"350'3033","reported_seq":3056,"reported_epoch":350,"state":"active+clean","last_fresh":"2024-02-10T08:33:09.966808+0000","last_change":"2024-02-10T08:32:30.824324+0000","last_active":"2024-02-10T08:33:09.966808+0000","last_peered":"2024-02-10T08:33:09.966808+0000","last_clean":"2024-02-10T08:33:09.966808+0000","last_became_active":"2024-02-10T08:32:30.823874+0000","last_became_peered":"2024-02-10T08:32:30.823874+0000","last_unstale":"2024-02-10T08:33:09.966808+0000","last_undegraded":"2024-02-10T08:33:09.966808+0000","last_fullsized":"2024-02-10T08:33:09.966808+0000","mapping_epoch":335,"log_start":"0'0","ondisk_log_start":"0'0","created":335,"last_epoch_clean":336,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.947585+0000","log_size":3033,"ondisk_log_size":3033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":198770688,"num_objects":3033,"num_object_clones":0,"num_object_copies":9099,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3033,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3033,"num_write_kb":194112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,0],"acting":[4,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"226'27","reported_seq":347,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.026939+0000","last_change":"2024-02-10T08:32:23.474007+0000","last_active":"2024-02-10T08:33:04.026939+0000","last_peered":"2024-02-10T08:33:04.026939+0000","last_clean":"2024-02-10T08:33:04.026939+0000","last_became_active":"2024-02-10T08:20:46.401777+0000","last_became_peered":"2024-02-10T08:20:46.401777+0000","last_unstale":"2024-02-10T08:33:04.026939+0000","last_undegraded":"2024-02-10T08:33:04.026939+0000","last_fullsized":"2024-02-10T08:33:04.026939+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"226'27","last_scrub_stamp":"2024-02-10T08:32:23.473934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:32:23.473934+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":324,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.016128+0000","last_change":"2024-02-10T08:32:22.621095+0000","last_active":"2024-02-10T08:33:04.016128+0000","last_peered":"2024-02-10T08:33:04.016128+0000","last_clean":"2024-02-10T08:33:04.016128+0000","last_became_active":"2024-02-10T08:16:52.783634+0000","last_became_peered":"2024-02-10T08:16:52.783634+0000","last_unstale":"2024-02-10T08:33:04.016128+0000","last_undegraded":"2024-02-10T08:33:04.016128+0000","last_fullsized":"2024-02-10T08:33:04.016128+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:22.621006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:32:22.621006+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"318'14","reported_seq":63,"reported_epoch":350,"state":"active+clean","last_fresh":"2024-02-10T08:33:05.839213+0000","last_change":"2024-02-10T08:31:46.262891+0000","last_active":"2024-02-10T08:33:05.839213+0000","last_peered":"2024-02-10T08:33:05.839213+0000","last_clean":"2024-02-10T08:33:05.839213+0000","last_became_active":"2024-02-10T08:31:46.073265+0000","last_became_peered":"2024-02-10T08:31:46.073265+0000","last_unstale":"2024-02-10T08:33:05.839213+0000","last_undegraded":"2024-02-10T08:33:05.839213+0000","last_fullsized":"2024-02-10T08:33:05.839213+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'13","last_scrub_stamp":"2024-02-10T08:29:13.140622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:13.140622+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":344,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.020010+0000","last_change":"2024-02-10T08:32:36.979257+0000","last_active":"2024-02-10T08:33:04.020010+0000","last_peered":"2024-02-10T08:33:04.020010+0000","last_clean":"2024-02-10T08:33:04.020010+0000","last_became_active":"2024-02-10T08:32:36.978932+0000","last_became_peered":"2024-02-10T08:32:36.978932+0000","last_unstale":"2024-02-10T08:33:04.020010+0000","last_undegraded":"2024-02-10T08:33:04.020010+0000","last_fullsized":"2024-02-10T08:33:04.020010+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:36.163125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:36.163125+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.0","version":"350'2865","reported_seq":2888,"reported_epoch":350,"state":"active+clean","last_fresh":"2024-02-10T08:33:07.675434+0000","last_change":"2024-02-10T08:32:30.821784+0000","last_active":"2024-02-10T08:33:07.675434+0000","last_peered":"2024-02-10T08:33:07.675434+0000","last_clean":"2024-02-10T08:33:07.675434+0000","last_became_active":"2024-02-10T08:32:30.821494+0000","last_became_peered":"2024-02-10T08:32:30.821494+0000","last_unstale":"2024-02-10T08:33:07.675434+0000","last_undegraded":"2024-02-10T08:33:07.675434+0000","last_fullsized":"2024-02-10T08:33:07.675434+0000","mapping_epoch":335,"log_start":"0'0","ondisk_log_start":"0'0","created":335,"last_epoch_clean":336,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.947585+0000","log_size":2865,"ondisk_log_size":2865,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":187760640,"num_objects":2865,"num_object_clones":0,"num_object_copies":8595,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2865,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2865,"num_write_kb":183360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,4],"acting":[6,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"225'24","reported_seq":345,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.021951+0000","last_change":"2024-02-10T08:32:23.327031+0000","last_active":"2024-02-10T08:33:04.021951+0000","last_peered":"2024-02-10T08:33:04.021951+0000","last_clean":"2024-02-10T08:33:04.021951+0000","last_became_active":"2024-02-10T08:20:46.406023+0000","last_became_peered":"2024-02-10T08:20:46.406023+0000","last_unstale":"2024-02-10T08:33:04.021951+0000","last_undegraded":"2024-02-10T08:33:04.021951+0000","last_fullsized":"2024-02-10T08:33:04.021951+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'24","last_scrub_stamp":"2024-02-10T08:32:23.326944+0000","last_deep_scrub":"76'16","last_deep_scrub_stamp":"2024-02-10T08:18:07.909782+0000","last_clean_scrub_stamp":"2024-02-10T08:32:23.326944+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":341,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.022601+0000","last_change":"2024-02-10T08:32:13.217936+0000","last_active":"2024-02-10T08:33:04.022601+0000","last_peered":"2024-02-10T08:33:04.022601+0000","last_clean":"2024-02-10T08:33:04.022601+0000","last_became_active":"2024-02-10T08:28:02.768633+0000","last_became_peered":"2024-02-10T08:28:02.768633+0000","last_unstale":"2024-02-10T08:33:04.022601+0000","last_undegraded":"2024-02-10T08:33:04.022601+0000","last_fullsized":"2024-02-10T08:33:04.022601+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:13.217844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:32:13.217844+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":386,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.020440+0000","last_change":"2024-02-10T08:32:26.093026+0000","last_active":"2024-02-10T08:33:04.020440+0000","last_peered":"2024-02-10T08:33:04.020440+0000","last_clean":"2024-02-10T08:33:04.020440+0000","last_became_active":"2024-02-10T08:20:46.400500+0000","last_became_peered":"2024-02-10T08:20:46.400500+0000","last_unstale":"2024-02-10T08:33:04.020440+0000","last_undegraded":"2024-02-10T08:33:04.020440+0000","last_fullsized":"2024-02-10T08:33:04.020440+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:26.092899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:32:26.092899+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":256,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.027538+0000","last_change":"2024-02-10T08:31:33.881318+0000","last_active":"2024-02-10T08:33:04.027538+0000","last_peered":"2024-02-10T08:33:04.027538+0000","last_clean":"2024-02-10T08:33:04.027538+0000","last_became_active":"2024-02-10T08:31:33.880969+0000","last_became_peered":"2024-02-10T08:31:33.880969+0000","last_unstale":"2024-02-10T08:33:04.027538+0000","last_undegraded":"2024-02-10T08:33:04.027538+0000","last_fullsized":"2024-02-10T08:33:04.027538+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:15.491747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:20:30.227375+0000","last_clean_scrub_stamp":"2024-02-10T08:29:15.491747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.f","version":"350'2930","reported_seq":2952,"reported_epoch":350,"state":"active+clean","last_fresh":"2024-02-10T08:33:07.666257+0000","last_change":"2024-02-10T08:32:30.825662+0000","last_active":"2024-02-10T08:33:07.666257+0000","last_peered":"2024-02-10T08:33:07.666257+0000","last_clean":"2024-02-10T08:33:07.666257+0000","last_became_active":"2024-02-10T08:32:30.825140+0000","last_became_peered":"2024-02-10T08:32:30.825140+0000","last_unstale":"2024-02-10T08:33:07.666257+0000","last_undegraded":"2024-02-10T08:33:07.666257+0000","last_fullsized":"2024-02-10T08:33:07.666257+0000","mapping_epoch":335,"log_start":"0'0","ondisk_log_start":"0'0","created":335,"last_epoch_clean":336,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.947585+0000","log_size":2930,"ondisk_log_size":2930,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":192020480,"num_objects":2930,"num_object_clones":0,"num_object_copies":8790,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2930,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2930,"num_write_kb":187520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"314'14","reported_seq":405,"reported_epoch":350,"state":"active+clean","last_fresh":"2024-02-10T08:33:05.846596+0000","last_change":"2024-02-10T08:31:33.979699+0000","last_active":"2024-02-10T08:33:05.846596+0000","last_peered":"2024-02-10T08:33:05.846596+0000","last_clean":"2024-02-10T08:33:05.846596+0000","last_became_active":"2024-02-10T08:31:33.890120+0000","last_became_peered":"2024-02-10T08:31:33.890120+0000","last_unstale":"2024-02-10T08:33:05.846596+0000","last_undegraded":"2024-02-10T08:33:05.846596+0000","last_fullsized":"2024-02-10T08:33:05.846596+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"199'13","last_scrub_stamp":"2024-02-10T08:29:15.700463+0000","last_deep_scrub":"199'13","last_deep_scrub_stamp":"2024-02-10T08:24:47.529439+0000","last_clean_scrub_stamp":"2024-02-10T08:29:15.700463+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"225'28","reported_seq":336,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.022248+0000","last_change":"2024-02-10T08:29:24.036552+0000","last_active":"2024-02-10T08:33:04.022248+0000","last_peered":"2024-02-10T08:33:04.022248+0000","last_clean":"2024-02-10T08:33:04.022248+0000","last_became_active":"2024-02-10T08:20:46.400760+0000","last_became_peered":"2024-02-10T08:20:46.400760+0000","last_unstale":"2024-02-10T08:33:04.022248+0000","last_undegraded":"2024-02-10T08:33:04.022248+0000","last_fullsized":"2024-02-10T08:33:04.022248+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'28","last_scrub_stamp":"2024-02-10T08:29:24.036448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:29:24.036448+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":41,"num_read_kb":34,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":323,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.028534+0000","last_change":"2024-02-10T08:29:03.396846+0000","last_active":"2024-02-10T08:33:04.028534+0000","last_peered":"2024-02-10T08:33:04.028534+0000","last_clean":"2024-02-10T08:33:04.028534+0000","last_became_active":"2024-02-10T08:16:52.789020+0000","last_became_peered":"2024-02-10T08:16:52.789020+0000","last_unstale":"2024-02-10T08:33:04.028534+0000","last_undegraded":"2024-02-10T08:33:04.028534+0000","last_fullsized":"2024-02-10T08:33:04.028534+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:03.396727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:29:03.396727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":321,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.022147+0000","last_change":"2024-02-10T08:28:17.059779+0000","last_active":"2024-02-10T08:33:04.022147+0000","last_peered":"2024-02-10T08:33:04.022147+0000","last_clean":"2024-02-10T08:33:04.022147+0000","last_became_active":"2024-02-10T08:21:58.546976+0000","last_became_peered":"2024-02-10T08:21:58.546976+0000","last_unstale":"2024-02-10T08:33:04.022147+0000","last_undegraded":"2024-02-10T08:33:04.022147+0000","last_fullsized":"2024-02-10T08:33:04.022147+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:17.059697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:17.059697+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"350'3080","reported_seq":3103,"reported_epoch":350,"state":"active+clean","last_fresh":"2024-02-10T08:33:09.957892+0000","last_change":"2024-02-10T08:32:30.825453+0000","last_active":"2024-02-10T08:33:09.957892+0000","last_peered":"2024-02-10T08:33:09.957892+0000","last_clean":"2024-02-10T08:33:09.957892+0000","last_became_active":"2024-02-10T08:32:30.825144+0000","last_became_peered":"2024-02-10T08:32:30.825144+0000","last_unstale":"2024-02-10T08:33:09.957892+0000","last_undegraded":"2024-02-10T08:33:09.957892+0000","last_fullsized":"2024-02-10T08:33:09.957892+0000","mapping_epoch":335,"log_start":"0'0","ondisk_log_start":"0'0","created":335,"last_epoch_clean":336,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.947585+0000","log_size":3080,"ondisk_log_size":3080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":201850880,"num_objects":3080,"num_object_clones":0,"num_object_copies":9240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3080,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3080,"num_write_kb":197120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":314,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.022278+0000","last_change":"2024-02-10T08:31:33.883835+0000","last_active":"2024-02-10T08:33:04.022278+0000","last_peered":"2024-02-10T08:33:04.022278+0000","last_clean":"2024-02-10T08:33:04.022278+0000","last_became_active":"2024-02-10T08:31:33.883569+0000","last_became_peered":"2024-02-10T08:31:33.883569+0000","last_unstale":"2024-02-10T08:33:04.022278+0000","last_undegraded":"2024-02-10T08:33:04.022278+0000","last_fullsized":"2024-02-10T08:33:04.022278+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:27.021108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:27.021108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"225'30","reported_seq":380,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.022972+0000","last_change":"2024-02-10T08:32:37.709766+0000","last_active":"2024-02-10T08:33:04.022972+0000","last_peered":"2024-02-10T08:33:04.022972+0000","last_clean":"2024-02-10T08:33:04.022972+0000","last_became_active":"2024-02-10T08:32:36.979685+0000","last_became_peered":"2024-02-10T08:32:36.979685+0000","last_unstale":"2024-02-10T08:33:04.022972+0000","last_undegraded":"2024-02-10T08:33:04.022972+0000","last_fullsized":"2024-02-10T08:33:04.022972+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'30","last_scrub_stamp":"2024-02-10T08:28:35.245660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:28:35.245660+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":51,"num_read_kb":39,"num_write":32,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,0],"acting":[7,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":334,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.015221+0000","last_change":"2024-02-10T08:29:04.701249+0000","last_active":"2024-02-10T08:33:04.015221+0000","last_peered":"2024-02-10T08:33:04.015221+0000","last_clean":"2024-02-10T08:33:04.015221+0000","last_became_active":"2024-02-10T08:20:46.407667+0000","last_became_peered":"2024-02-10T08:20:46.407667+0000","last_unstale":"2024-02-10T08:33:04.015221+0000","last_undegraded":"2024-02-10T08:33:04.015221+0000","last_fullsized":"2024-02-10T08:33:04.015221+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:04.701160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:29:04.701160+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":332,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.022587+0000","last_change":"2024-02-10T08:32:25.358402+0000","last_active":"2024-02-10T08:33:04.022587+0000","last_peered":"2024-02-10T08:33:04.022587+0000","last_clean":"2024-02-10T08:33:04.022587+0000","last_became_active":"2024-02-10T08:31:33.882582+0000","last_became_peered":"2024-02-10T08:31:33.882582+0000","last_unstale":"2024-02-10T08:33:04.022587+0000","last_undegraded":"2024-02-10T08:33:04.022587+0000","last_fullsized":"2024-02-10T08:33:04.022587+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:25.358315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:25.358315+0000","last_clean_scrub_stamp":"2024-02-10T08:32:25.358315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.d","version":"350'2824","reported_seq":2856,"reported_epoch":350,"state":"active+clean","last_fresh":"2024-02-10T08:33:07.675620+0000","last_change":"2024-02-10T08:32:36.979514+0000","last_active":"2024-02-10T08:33:07.675620+0000","last_peered":"2024-02-10T08:33:07.675620+0000","last_clean":"2024-02-10T08:33:07.675620+0000","last_became_active":"2024-02-10T08:32:36.979091+0000","last_became_peered":"2024-02-10T08:32:36.979091+0000","last_unstale":"2024-02-10T08:33:07.675620+0000","last_undegraded":"2024-02-10T08:33:07.675620+0000","last_fullsized":"2024-02-10T08:33:07.675620+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":335,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.947585+0000","log_size":2824,"ondisk_log_size":2824,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":185073664,"num_objects":2824,"num_object_clones":0,"num_object_copies":8472,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2824,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2824,"num_write_kb":180736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":337,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.027576+0000","last_change":"2024-02-10T08:29:11.420173+0000","last_active":"2024-02-10T08:33:04.027576+0000","last_peered":"2024-02-10T08:33:04.027576+0000","last_clean":"2024-02-10T08:33:04.027576+0000","last_became_active":"2024-02-10T08:28:02.769069+0000","last_became_peered":"2024-02-10T08:28:02.769069+0000","last_unstale":"2024-02-10T08:33:04.027576+0000","last_undegraded":"2024-02-10T08:33:04.027576+0000","last_fullsized":"2024-02-10T08:33:04.027576+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:11.420031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:11.420031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"225'37","reported_seq":415,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.020291+0000","last_change":"2024-02-10T08:28:33.205966+0000","last_active":"2024-02-10T08:33:04.020291+0000","last_peered":"2024-02-10T08:33:04.020291+0000","last_clean":"2024-02-10T08:33:04.020291+0000","last_became_active":"2024-02-10T08:28:25.951447+0000","last_became_peered":"2024-02-10T08:28:25.951447+0000","last_unstale":"2024-02-10T08:33:04.020291+0000","last_undegraded":"2024-02-10T08:33:04.020291+0000","last_fullsized":"2024-02-10T08:33:04.020291+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'37","last_scrub_stamp":"2024-02-10T08:28:33.205891+0000","last_deep_scrub":"199'27","last_deep_scrub_stamp":"2024-02-10T08:24:42.826442+0000","last_clean_scrub_stamp":"2024-02-10T08:28:33.205891+0000","log_size":37,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":53,"num_read_kb":39,"num_write":32,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":326,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.024351+0000","last_change":"2024-02-10T08:32:36.972580+0000","last_active":"2024-02-10T08:33:04.024351+0000","last_peered":"2024-02-10T08:33:04.024351+0000","last_clean":"2024-02-10T08:33:04.024351+0000","last_became_active":"2024-02-10T08:32:36.972224+0000","last_became_peered":"2024-02-10T08:32:36.972224+0000","last_unstale":"2024-02-10T08:33:04.024351+0000","last_undegraded":"2024-02-10T08:33:04.024351+0000","last_fullsized":"2024-02-10T08:33:04.024351+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:20.457380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:32:20.457380+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4],"acting":[2,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":322,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.016265+0000","last_change":"2024-02-10T08:28:39.633777+0000","last_active":"2024-02-10T08:33:04.016265+0000","last_peered":"2024-02-10T08:33:04.016265+0000","last_clean":"2024-02-10T08:33:04.016265+0000","last_became_active":"2024-02-10T08:21:58.553966+0000","last_became_peered":"2024-02-10T08:21:58.553966+0000","last_unstale":"2024-02-10T08:33:04.016265+0000","last_undegraded":"2024-02-10T08:33:04.016265+0000","last_fullsized":"2024-02-10T08:33:04.016265+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:39.633627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:39.633627+0000","last_clean_scrub_stamp":"2024-02-10T08:28:39.633627+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.8","version":"350'2937","reported_seq":2960,"reported_epoch":350,"state":"active+clean","last_fresh":"2024-02-10T08:33:08.231016+0000","last_change":"2024-02-10T08:32:30.824983+0000","last_active":"2024-02-10T08:33:08.231016+0000","last_peered":"2024-02-10T08:33:08.231016+0000","last_clean":"2024-02-10T08:33:08.231016+0000","last_became_active":"2024-02-10T08:32:30.824620+0000","last_became_peered":"2024-02-10T08:32:30.824620+0000","last_unstale":"2024-02-10T08:33:08.231016+0000","last_undegraded":"2024-02-10T08:33:08.231016+0000","last_fullsized":"2024-02-10T08:33:08.231016+0000","mapping_epoch":335,"log_start":"0'0","ondisk_log_start":"0'0","created":335,"last_epoch_clean":336,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.947585+0000","log_size":2937,"ondisk_log_size":2937,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":192479232,"num_objects":2937,"num_object_clones":0,"num_object_copies":8811,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2937,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2937,"num_write_kb":187968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7],"acting":[0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":341,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.020518+0000","last_change":"2024-02-10T08:29:14.145590+0000","last_active":"2024-02-10T08:33:04.020518+0000","last_peered":"2024-02-10T08:33:04.020518+0000","last_clean":"2024-02-10T08:33:04.020518+0000","last_became_active":"2024-02-10T08:28:02.772585+0000","last_became_peered":"2024-02-10T08:28:02.772585+0000","last_unstale":"2024-02-10T08:33:04.020518+0000","last_undegraded":"2024-02-10T08:33:04.020518+0000","last_fullsized":"2024-02-10T08:33:04.020518+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:14.145493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:41.360241+0000","last_clean_scrub_stamp":"2024-02-10T08:29:14.145493+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"225'24","reported_seq":34,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.019889+0000","last_change":"2024-02-10T08:32:38.788491+0000","last_active":"2024-02-10T08:33:04.019889+0000","last_peered":"2024-02-10T08:33:04.019889+0000","last_clean":"2024-02-10T08:33:04.019889+0000","last_became_active":"2024-02-10T08:32:36.975366+0000","last_became_peered":"2024-02-10T08:32:36.975366+0000","last_unstale":"2024-02-10T08:33:04.019889+0000","last_undegraded":"2024-02-10T08:33:04.019889+0000","last_fullsized":"2024-02-10T08:33:04.019889+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'24","last_scrub_stamp":"2024-02-10T08:28:26.505270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:28:26.505270+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":341,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.022441+0000","last_change":"2024-02-10T08:32:28.402029+0000","last_active":"2024-02-10T08:33:04.022441+0000","last_peered":"2024-02-10T08:33:04.022441+0000","last_clean":"2024-02-10T08:33:04.022441+0000","last_became_active":"2024-02-10T08:28:02.760999+0000","last_became_peered":"2024-02-10T08:28:02.760999+0000","last_unstale":"2024-02-10T08:33:04.022441+0000","last_undegraded":"2024-02-10T08:33:04.022441+0000","last_fullsized":"2024-02-10T08:33:04.022441+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:28.401960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:28.401960+0000","last_clean_scrub_stamp":"2024-02-10T08:32:28.401960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":315,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.020122+0000","last_change":"2024-02-10T08:31:46.063634+0000","last_active":"2024-02-10T08:33:04.020122+0000","last_peered":"2024-02-10T08:33:04.020122+0000","last_clean":"2024-02-10T08:33:04.020122+0000","last_became_active":"2024-02-10T08:31:46.063039+0000","last_became_peered":"2024-02-10T08:31:46.063039+0000","last_unstale":"2024-02-10T08:33:04.020122+0000","last_undegraded":"2024-02-10T08:33:04.020122+0000","last_fullsized":"2024-02-10T08:33:04.020122+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:06.426390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:20.736224+0000","last_clean_scrub_stamp":"2024-02-10T08:29:06.426390+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":340,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.014535+0000","last_change":"2024-02-10T08:32:32.713980+0000","last_active":"2024-02-10T08:33:04.014535+0000","last_peered":"2024-02-10T08:33:04.014535+0000","last_clean":"2024-02-10T08:33:04.014535+0000","last_became_active":"2024-02-10T08:28:19.022399+0000","last_became_peered":"2024-02-10T08:28:19.022399+0000","last_unstale":"2024-02-10T08:33:04.014535+0000","last_undegraded":"2024-02-10T08:33:04.014535+0000","last_fullsized":"2024-02-10T08:33:04.014535+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:32.713921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:32:32.713921+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"350'2838","reported_seq":2861,"reported_epoch":350,"state":"active+clean","last_fresh":"2024-02-10T08:33:07.666843+0000","last_change":"2024-02-10T08:32:30.823934+0000","last_active":"2024-02-10T08:33:07.666843+0000","last_peered":"2024-02-10T08:33:07.666843+0000","last_clean":"2024-02-10T08:33:07.666843+0000","last_became_active":"2024-02-10T08:32:30.823591+0000","last_became_peered":"2024-02-10T08:32:30.823591+0000","last_unstale":"2024-02-10T08:33:07.666843+0000","last_undegraded":"2024-02-10T08:33:07.666843+0000","last_fullsized":"2024-02-10T08:33:07.666843+0000","mapping_epoch":335,"log_start":"0'0","ondisk_log_start":"0'0","created":335,"last_epoch_clean":336,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.947585+0000","log_size":2838,"ondisk_log_size":2838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":185991168,"num_objects":2838,"num_object_clones":0,"num_object_copies":8514,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2838,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2838,"num_write_kb":181632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,0],"acting":[6,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":319,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.023495+0000","last_change":"2024-02-10T08:29:13.416528+0000","last_active":"2024-02-10T08:33:04.023495+0000","last_peered":"2024-02-10T08:33:04.023495+0000","last_clean":"2024-02-10T08:33:04.023495+0000","last_became_active":"2024-02-10T08:16:56.867159+0000","last_became_peered":"2024-02-10T08:16:56.867159+0000","last_unstale":"2024-02-10T08:33:04.023495+0000","last_undegraded":"2024-02-10T08:33:04.023495+0000","last_fullsized":"2024-02-10T08:33:04.023495+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:13.416461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:04.766780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:13.416461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"225'33","reported_seq":383,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.027723+0000","last_change":"2024-02-10T08:29:20.522358+0000","last_active":"2024-02-10T08:33:04.027723+0000","last_peered":"2024-02-10T08:33:04.027723+0000","last_clean":"2024-02-10T08:33:04.027723+0000","last_became_active":"2024-02-10T08:20:46.401981+0000","last_became_peered":"2024-02-10T08:20:46.401981+0000","last_unstale":"2024-02-10T08:33:04.027723+0000","last_undegraded":"2024-02-10T08:33:04.027723+0000","last_fullsized":"2024-02-10T08:33:04.027723+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'33","last_scrub_stamp":"2024-02-10T08:29:20.522259+0000","last_deep_scrub":"223'21","last_deep_scrub_stamp":"2024-02-10T08:26:33.250614+0000","last_clean_scrub_stamp":"2024-02-10T08:29:20.522259+0000","log_size":33,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":33,"num_write":25,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":352,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.022520+0000","last_change":"2024-02-10T08:32:36.980106+0000","last_active":"2024-02-10T08:33:04.022520+0000","last_peered":"2024-02-10T08:33:04.022520+0000","last_clean":"2024-02-10T08:33:04.022520+0000","last_became_active":"2024-02-10T08:32:36.979237+0000","last_became_peered":"2024-02-10T08:32:36.979237+0000","last_unstale":"2024-02-10T08:33:04.022520+0000","last_undegraded":"2024-02-10T08:33:04.022520+0000","last_fullsized":"2024-02-10T08:33:04.022520+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:16.187704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:14:44.584370+0000","last_clean_scrub_stamp":"2024-02-10T08:32:16.187704+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":323,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.019390+0000","last_change":"2024-02-10T08:29:06.087344+0000","last_active":"2024-02-10T08:33:04.019390+0000","last_peered":"2024-02-10T08:33:04.019390+0000","last_clean":"2024-02-10T08:33:04.019390+0000","last_became_active":"2024-02-10T08:16:52.788767+0000","last_became_peered":"2024-02-10T08:16:52.788767+0000","last_unstale":"2024-02-10T08:33:04.019390+0000","last_undegraded":"2024-02-10T08:33:04.019390+0000","last_fullsized":"2024-02-10T08:33:04.019390+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:06.087258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:29:06.087258+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":252,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.017020+0000","last_change":"2024-02-10T08:32:29.019898+0000","last_active":"2024-02-10T08:33:04.017020+0000","last_peered":"2024-02-10T08:33:04.017020+0000","last_clean":"2024-02-10T08:33:04.017020+0000","last_became_active":"2024-02-10T08:31:33.878588+0000","last_became_peered":"2024-02-10T08:31:33.878588+0000","last_unstale":"2024-02-10T08:33:04.017020+0000","last_undegraded":"2024-02-10T08:33:04.017020+0000","last_fullsized":"2024-02-10T08:33:04.017020+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.019819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.019819+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.019819+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":51,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.019584+0000","last_change":"2024-02-10T08:31:19.726867+0000","last_active":"2024-02-10T08:33:04.019584+0000","last_peered":"2024-02-10T08:33:04.019584+0000","last_clean":"2024-02-10T08:33:04.019584+0000","last_became_active":"2024-02-10T08:31:19.726561+0000","last_became_peered":"2024-02-10T08:31:19.726561+0000","last_unstale":"2024-02-10T08:33:04.019584+0000","last_undegraded":"2024-02-10T08:33:04.019584+0000","last_fullsized":"2024-02-10T08:33:04.019584+0000","mapping_epoch":308,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":309,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:25.198277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:26:29.921562+0000","last_clean_scrub_stamp":"2024-02-10T08:29:25.198277+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"350'2933","reported_seq":2956,"reported_epoch":350,"state":"active+clean","last_fresh":"2024-02-10T08:33:07.717700+0000","last_change":"2024-02-10T08:32:30.825343+0000","last_active":"2024-02-10T08:33:07.717700+0000","last_peered":"2024-02-10T08:33:07.717700+0000","last_clean":"2024-02-10T08:33:07.717700+0000","last_became_active":"2024-02-10T08:32:30.824975+0000","last_became_peered":"2024-02-10T08:32:30.824975+0000","last_unstale":"2024-02-10T08:33:07.717700+0000","last_undegraded":"2024-02-10T08:33:07.717700+0000","last_fullsized":"2024-02-10T08:33:07.717700+0000","mapping_epoch":335,"log_start":"0'0","ondisk_log_start":"0'0","created":335,"last_epoch_clean":336,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.947585+0000","log_size":2933,"ondisk_log_size":2933,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":192217088,"num_objects":2933,"num_object_clones":0,"num_object_copies":8799,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2933,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2933,"num_write_kb":187712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":320,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.024774+0000","last_change":"2024-02-10T08:29:23.504992+0000","last_active":"2024-02-10T08:33:04.024774+0000","last_peered":"2024-02-10T08:33:04.024774+0000","last_clean":"2024-02-10T08:33:04.024774+0000","last_became_active":"2024-02-10T08:16:56.857856+0000","last_became_peered":"2024-02-10T08:16:56.857856+0000","last_unstale":"2024-02-10T08:33:04.024774+0000","last_undegraded":"2024-02-10T08:33:04.024774+0000","last_fullsized":"2024-02-10T08:33:04.024774+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:23.504892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:23.504892+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"225'17","reported_seq":113,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.023203+0000","last_change":"2024-02-10T08:32:37.438518+0000","last_active":"2024-02-10T08:33:04.023203+0000","last_peered":"2024-02-10T08:33:04.023203+0000","last_clean":"2024-02-10T08:33:04.023203+0000","last_became_active":"2024-02-10T08:32:36.984195+0000","last_became_peered":"2024-02-10T08:32:36.984195+0000","last_unstale":"2024-02-10T08:33:04.023203+0000","last_undegraded":"2024-02-10T08:33:04.023203+0000","last_fullsized":"2024-02-10T08:33:04.023203+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'17","last_scrub_stamp":"2024-02-10T08:28:38.619521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:28:38.619521+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":23,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":365,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.023475+0000","last_change":"2024-02-10T08:32:26.529397+0000","last_active":"2024-02-10T08:33:04.023475+0000","last_peered":"2024-02-10T08:33:04.023475+0000","last_clean":"2024-02-10T08:33:04.023475+0000","last_became_active":"2024-02-10T08:31:33.884021+0000","last_became_peered":"2024-02-10T08:31:33.884021+0000","last_unstale":"2024-02-10T08:33:04.023475+0000","last_undegraded":"2024-02-10T08:33:04.023475+0000","last_fullsized":"2024-02-10T08:33:04.023475+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:26.529314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:11.681169+0000","last_clean_scrub_stamp":"2024-02-10T08:32:26.529314+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"63'5","reported_seq":1292,"reported_epoch":350,"state":"active+clean","last_fresh":"2024-02-10T08:33:06.638020+0000","last_change":"2024-02-10T08:32:19.667323+0000","last_active":"2024-02-10T08:33:06.638020+0000","last_peered":"2024-02-10T08:33:06.638020+0000","last_clean":"2024-02-10T08:33:06.638020+0000","last_became_active":"2024-02-10T08:16:52.780989+0000","last_became_peered":"2024-02-10T08:16:52.780989+0000","last_unstale":"2024-02-10T08:33:06.638020+0000","last_undegraded":"2024-02-10T08:33:06.638020+0000","last_fullsized":"2024-02-10T08:33:06.638020+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'5","last_scrub_stamp":"2024-02-10T08:32:19.667251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:32:19.667251+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":965,"num_read_kb":960,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":327,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.022490+0000","last_change":"2024-02-10T08:28:16.113780+0000","last_active":"2024-02-10T08:33:04.022490+0000","last_peered":"2024-02-10T08:33:04.022490+0000","last_clean":"2024-02-10T08:33:04.022490+0000","last_became_active":"2024-02-10T08:21:58.549733+0000","last_became_peered":"2024-02-10T08:21:58.549733+0000","last_unstale":"2024-02-10T08:33:04.022490+0000","last_undegraded":"2024-02-10T08:33:04.022490+0000","last_fullsized":"2024-02-10T08:33:04.022490+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:16.113690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:11.750537+0000","last_clean_scrub_stamp":"2024-02-10T08:28:16.113690+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.a","version":"350'2831","reported_seq":2863,"reported_epoch":350,"state":"active+clean","last_fresh":"2024-02-10T08:33:07.680409+0000","last_change":"2024-02-10T08:32:36.979236+0000","last_active":"2024-02-10T08:33:07.680409+0000","last_peered":"2024-02-10T08:33:07.680409+0000","last_clean":"2024-02-10T08:33:07.680409+0000","last_became_active":"2024-02-10T08:32:36.978852+0000","last_became_peered":"2024-02-10T08:32:36.978852+0000","last_unstale":"2024-02-10T08:33:07.680409+0000","last_undegraded":"2024-02-10T08:33:07.680409+0000","last_fullsized":"2024-02-10T08:33:07.680409+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":335,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.947585+0000","log_size":2831,"ondisk_log_size":2831,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":185532416,"num_objects":2831,"num_object_clones":0,"num_object_copies":8493,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2831,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2831,"num_write_kb":181184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":20,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.019940+0000","last_change":"2024-02-10T08:32:36.976472+0000","last_active":"2024-02-10T08:33:04.019940+0000","last_peered":"2024-02-10T08:33:04.019940+0000","last_clean":"2024-02-10T08:33:04.019940+0000","last_became_active":"2024-02-10T08:32:36.976141+0000","last_became_peered":"2024-02-10T08:32:36.976141+0000","last_unstale":"2024-02-10T08:33:04.019940+0000","last_undegraded":"2024-02-10T08:33:04.019940+0000","last_fullsized":"2024-02-10T08:33:04.019940+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:26.703441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:26.703441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"314'42","reported_seq":646,"reported_epoch":350,"state":"active+clean","last_fresh":"2024-02-10T08:33:05.850215+0000","last_change":"2024-02-10T08:31:35.086145+0000","last_active":"2024-02-10T08:33:05.850215+0000","last_peered":"2024-02-10T08:33:05.850215+0000","last_clean":"2024-02-10T08:33:05.850215+0000","last_became_active":"2024-02-10T08:31:33.904487+0000","last_became_peered":"2024-02-10T08:31:33.904487+0000","last_unstale":"2024-02-10T08:33:05.850215+0000","last_undegraded":"2024-02-10T08:33:05.850215+0000","last_fullsized":"2024-02-10T08:33:05.850215+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":315,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'41","last_scrub_stamp":"2024-02-10T08:28:22.455139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:28:22.455139+0000","log_size":42,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":66,"num_read_kb":51,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":716,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":323,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.016914+0000","last_change":"2024-02-10T08:29:11.165779+0000","last_active":"2024-02-10T08:33:04.016914+0000","last_peered":"2024-02-10T08:33:04.016914+0000","last_clean":"2024-02-10T08:33:04.016914+0000","last_became_active":"2024-02-10T08:16:52.791027+0000","last_became_peered":"2024-02-10T08:16:52.791027+0000","last_unstale":"2024-02-10T08:33:04.016914+0000","last_undegraded":"2024-02-10T08:33:04.016914+0000","last_fullsized":"2024-02-10T08:33:04.016914+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:11.165678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:29:11.165678+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":347,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.021704+0000","last_change":"2024-02-10T08:32:32.331364+0000","last_active":"2024-02-10T08:33:04.021704+0000","last_peered":"2024-02-10T08:33:04.021704+0000","last_clean":"2024-02-10T08:33:04.021704+0000","last_became_active":"2024-02-10T08:31:33.884295+0000","last_became_peered":"2024-02-10T08:31:33.884295+0000","last_unstale":"2024-02-10T08:33:04.021704+0000","last_undegraded":"2024-02-10T08:33:04.021704+0000","last_fullsized":"2024-02-10T08:33:04.021704+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:32.331286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:32:32.331286+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"350'2921","reported_seq":2944,"reported_epoch":350,"state":"active+clean","last_fresh":"2024-02-10T08:33:07.758058+0000","last_change":"2024-02-10T08:32:30.823074+0000","last_active":"2024-02-10T08:33:07.758058+0000","last_peered":"2024-02-10T08:33:07.758058+0000","last_clean":"2024-02-10T08:33:07.758058+0000","last_became_active":"2024-02-10T08:32:30.822769+0000","last_became_peered":"2024-02-10T08:32:30.822769+0000","last_unstale":"2024-02-10T08:33:07.758058+0000","last_undegraded":"2024-02-10T08:33:07.758058+0000","last_fullsized":"2024-02-10T08:33:07.758058+0000","mapping_epoch":335,"log_start":"0'0","ondisk_log_start":"0'0","created":335,"last_epoch_clean":336,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.947585+0000","log_size":2921,"ondisk_log_size":2921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":191430656,"num_objects":2921,"num_object_clones":0,"num_object_copies":8763,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2921,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2921,"num_write_kb":186944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"255'12","reported_seq":241,"reported_epoch":350,"state":"active+clean","last_fresh":"2024-02-10T08:33:05.862912+0000","last_change":"2024-02-10T08:32:25.571469+0000","last_active":"2024-02-10T08:33:05.862912+0000","last_peered":"2024-02-10T08:33:05.862912+0000","last_clean":"2024-02-10T08:33:05.862912+0000","last_became_active":"2024-02-10T08:28:25.952468+0000","last_became_peered":"2024-02-10T08:28:25.952468+0000","last_unstale":"2024-02-10T08:33:05.862912+0000","last_undegraded":"2024-02-10T08:33:05.862912+0000","last_fullsized":"2024-02-10T08:33:05.862912+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'12","last_scrub_stamp":"2024-02-10T08:32:25.571388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:32:25.571388+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"225'20","reported_seq":362,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.014344+0000","last_change":"2024-02-10T08:29:11.695106+0000","last_active":"2024-02-10T08:33:04.014344+0000","last_peered":"2024-02-10T08:33:04.014344+0000","last_clean":"2024-02-10T08:33:04.014344+0000","last_became_active":"2024-02-10T08:20:46.408495+0000","last_became_peered":"2024-02-10T08:20:46.408495+0000","last_unstale":"2024-02-10T08:33:04.014344+0000","last_undegraded":"2024-02-10T08:33:04.014344+0000","last_fullsized":"2024-02-10T08:33:04.014344+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'20","last_scrub_stamp":"2024-02-10T08:29:11.694999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:29:11.694999+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":337,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.014213+0000","last_change":"2024-02-10T08:28:21.409185+0000","last_active":"2024-02-10T08:33:04.014213+0000","last_peered":"2024-02-10T08:33:04.014213+0000","last_clean":"2024-02-10T08:33:04.014213+0000","last_became_active":"2024-02-10T08:28:02.760784+0000","last_became_peered":"2024-02-10T08:28:02.760784+0000","last_unstale":"2024-02-10T08:33:04.014213+0000","last_undegraded":"2024-02-10T08:33:04.014213+0000","last_fullsized":"2024-02-10T08:33:04.014213+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:21.409109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:28:21.409109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":243,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.019060+0000","last_change":"2024-02-10T08:29:14.538007+0000","last_active":"2024-02-10T08:33:04.019060+0000","last_peered":"2024-02-10T08:33:04.019060+0000","last_clean":"2024-02-10T08:33:04.019060+0000","last_became_active":"2024-02-10T08:28:25.950240+0000","last_became_peered":"2024-02-10T08:28:25.950240+0000","last_unstale":"2024-02-10T08:33:04.019060+0000","last_undegraded":"2024-02-10T08:33:04.019060+0000","last_fullsized":"2024-02-10T08:33:04.019060+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:14.537940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:14.537940+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"350'2884","reported_seq":2907,"reported_epoch":350,"state":"active+clean","last_fresh":"2024-02-10T08:33:07.687870+0000","last_change":"2024-02-10T08:32:30.825465+0000","last_active":"2024-02-10T08:33:07.687870+0000","last_peered":"2024-02-10T08:33:07.687870+0000","last_clean":"2024-02-10T08:33:07.687870+0000","last_became_active":"2024-02-10T08:32:30.824733+0000","last_became_peered":"2024-02-10T08:32:30.824733+0000","last_unstale":"2024-02-10T08:33:07.687870+0000","last_undegraded":"2024-02-10T08:33:07.687870+0000","last_fullsized":"2024-02-10T08:33:07.687870+0000","mapping_epoch":335,"log_start":"0'0","ondisk_log_start":"0'0","created":335,"last_epoch_clean":336,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.947585+0000","log_size":2884,"ondisk_log_size":2884,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":189005824,"num_objects":2884,"num_object_clones":0,"num_object_copies":8652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2884,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2884,"num_write_kb":184576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":338,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.023456+0000","last_change":"2024-02-10T08:29:14.447872+0000","last_active":"2024-02-10T08:33:04.023456+0000","last_peered":"2024-02-10T08:33:04.023456+0000","last_clean":"2024-02-10T08:33:04.023456+0000","last_became_active":"2024-02-10T08:28:02.777637+0000","last_became_peered":"2024-02-10T08:28:02.777637+0000","last_unstale":"2024-02-10T08:33:04.023456+0000","last_undegraded":"2024-02-10T08:33:04.023456+0000","last_fullsized":"2024-02-10T08:33:04.023456+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:14.447807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:14.447807+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"225'23","reported_seq":379,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.022150+0000","last_change":"2024-02-10T08:31:34.242669+0000","last_active":"2024-02-10T08:33:04.022150+0000","last_peered":"2024-02-10T08:33:04.022150+0000","last_clean":"2024-02-10T08:33:04.022150+0000","last_became_active":"2024-02-10T08:31:33.884516+0000","last_became_peered":"2024-02-10T08:31:33.884516+0000","last_unstale":"2024-02-10T08:33:04.022150+0000","last_undegraded":"2024-02-10T08:33:04.022150+0000","last_fullsized":"2024-02-10T08:33:04.022150+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'23","last_scrub_stamp":"2024-02-10T08:29:23.027211+0000","last_deep_scrub":"82'17","last_deep_scrub_stamp":"2024-02-10T08:18:21.015873+0000","last_clean_scrub_stamp":"2024-02-10T08:29:23.027211+0000","log_size":23,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":25,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"55'2","reported_seq":339,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.021561+0000","last_change":"2024-02-10T08:29:22.034366+0000","last_active":"2024-02-10T08:33:04.021561+0000","last_peered":"2024-02-10T08:33:04.021561+0000","last_clean":"2024-02-10T08:33:04.021561+0000","last_became_active":"2024-02-10T08:28:02.768279+0000","last_became_peered":"2024-02-10T08:28:02.768279+0000","last_unstale":"2024-02-10T08:33:04.021561+0000","last_undegraded":"2024-02-10T08:33:04.021561+0000","last_fullsized":"2024-02-10T08:33:04.021561+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'2","last_scrub_stamp":"2024-02-10T08:29:22.034268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:29:22.034268+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":184,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":233,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.021835+0000","last_change":"2024-02-10T08:30:24.073702+0000","last_active":"2024-02-10T08:33:04.021835+0000","last_peered":"2024-02-10T08:33:04.021835+0000","last_clean":"2024-02-10T08:33:04.021835+0000","last_became_active":"2024-02-10T08:30:24.073077+0000","last_became_peered":"2024-02-10T08:30:24.073077+0000","last_unstale":"2024-02-10T08:33:04.021835+0000","last_undegraded":"2024-02-10T08:33:04.021835+0000","last_fullsized":"2024-02-10T08:33:04.021835+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:26:20.173948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:26:20.173948+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"225'15","reported_seq":30,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.019737+0000","last_change":"2024-02-10T08:32:38.444804+0000","last_active":"2024-02-10T08:33:04.019737+0000","last_peered":"2024-02-10T08:33:04.019737+0000","last_clean":"2024-02-10T08:33:04.019737+0000","last_became_active":"2024-02-10T08:32:36.982716+0000","last_became_peered":"2024-02-10T08:32:36.982716+0000","last_unstale":"2024-02-10T08:33:04.019737+0000","last_undegraded":"2024-02-10T08:33:04.019737+0000","last_fullsized":"2024-02-10T08:33:04.019737+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'15","last_scrub_stamp":"2024-02-10T08:29:09.329160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:29:09.329160+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"55'1","reported_seq":394,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.023380+0000","last_change":"2024-02-10T08:32:11.524846+0000","last_active":"2024-02-10T08:33:04.023380+0000","last_peered":"2024-02-10T08:33:04.023380+0000","last_clean":"2024-02-10T08:33:04.023380+0000","last_became_active":"2024-02-10T08:28:02.778857+0000","last_became_peered":"2024-02-10T08:28:02.778857+0000","last_unstale":"2024-02-10T08:33:04.023380+0000","last_undegraded":"2024-02-10T08:33:04.023380+0000","last_fullsized":"2024-02-10T08:33:04.023380+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'1","last_scrub_stamp":"2024-02-10T08:32:11.524771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:32:11.524771+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":716,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":267,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.016403+0000","last_change":"2024-02-10T08:32:24.674330+0000","last_active":"2024-02-10T08:33:04.016403+0000","last_peered":"2024-02-10T08:33:04.016403+0000","last_clean":"2024-02-10T08:33:04.016403+0000","last_became_active":"2024-02-10T08:31:33.891489+0000","last_became_peered":"2024-02-10T08:31:33.891489+0000","last_unstale":"2024-02-10T08:33:04.016403+0000","last_undegraded":"2024-02-10T08:33:04.016403+0000","last_fullsized":"2024-02-10T08:33:04.016403+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:24.672029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:32:24.672029+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":187,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.020645+0000","last_change":"2024-02-10T08:29:24.514793+0000","last_active":"2024-02-10T08:33:04.020645+0000","last_peered":"2024-02-10T08:33:04.020645+0000","last_clean":"2024-02-10T08:33:04.020645+0000","last_became_active":"2024-02-10T08:28:25.999252+0000","last_became_peered":"2024-02-10T08:28:25.999252+0000","last_unstale":"2024-02-10T08:33:04.020645+0000","last_undegraded":"2024-02-10T08:33:04.020645+0000","last_fullsized":"2024-02-10T08:33:04.020645+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:24.514690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:24.514690+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"225'15","reported_seq":296,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.023700+0000","last_change":"2024-02-10T08:32:23.310599+0000","last_active":"2024-02-10T08:33:04.023700+0000","last_peered":"2024-02-10T08:33:04.023700+0000","last_clean":"2024-02-10T08:33:04.023700+0000","last_became_active":"2024-02-10T08:31:33.891813+0000","last_became_peered":"2024-02-10T08:31:33.891813+0000","last_unstale":"2024-02-10T08:33:04.023700+0000","last_undegraded":"2024-02-10T08:33:04.023700+0000","last_fullsized":"2024-02-10T08:33:04.023700+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'15","last_scrub_stamp":"2024-02-10T08:32:23.310489+0000","last_deep_scrub":"223'9","last_deep_scrub_stamp":"2024-02-10T08:26:33.158025+0000","last_clean_scrub_stamp":"2024-02-10T08:32:23.310489+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":390,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.027014+0000","last_change":"2024-02-10T08:32:22.293976+0000","last_active":"2024-02-10T08:33:04.027014+0000","last_peered":"2024-02-10T08:33:04.027014+0000","last_clean":"2024-02-10T08:33:04.027014+0000","last_became_active":"2024-02-10T08:31:46.053553+0000","last_became_peered":"2024-02-10T08:31:46.053553+0000","last_unstale":"2024-02-10T08:33:04.027014+0000","last_undegraded":"2024-02-10T08:33:04.027014+0000","last_fullsized":"2024-02-10T08:33:04.027014+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:22.293905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:32:22.293905+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":319,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.020785+0000","last_change":"2024-02-10T08:29:12.163752+0000","last_active":"2024-02-10T08:33:04.020785+0000","last_peered":"2024-02-10T08:33:04.020785+0000","last_clean":"2024-02-10T08:33:04.020785+0000","last_became_active":"2024-02-10T08:16:56.863948+0000","last_became_peered":"2024-02-10T08:16:56.863948+0000","last_unstale":"2024-02-10T08:33:04.020785+0000","last_undegraded":"2024-02-10T08:33:04.020785+0000","last_fullsized":"2024-02-10T08:33:04.020785+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:12.163638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:12.163638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":327,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.022252+0000","last_change":"2024-02-10T08:28:33.229127+0000","last_active":"2024-02-10T08:33:04.022252+0000","last_peered":"2024-02-10T08:33:04.022252+0000","last_clean":"2024-02-10T08:33:04.022252+0000","last_became_active":"2024-02-10T08:20:46.398903+0000","last_became_peered":"2024-02-10T08:20:46.398903+0000","last_unstale":"2024-02-10T08:33:04.022252+0000","last_undegraded":"2024-02-10T08:33:04.022252+0000","last_fullsized":"2024-02-10T08:33:04.022252+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:33.229018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:33.229018+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"225'20","reported_seq":271,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.014368+0000","last_change":"2024-02-10T08:32:23.661124+0000","last_active":"2024-02-10T08:33:04.014368+0000","last_peered":"2024-02-10T08:33:04.014368+0000","last_clean":"2024-02-10T08:33:04.014368+0000","last_became_active":"2024-02-10T08:22:23.534081+0000","last_became_peered":"2024-02-10T08:22:23.534081+0000","last_unstale":"2024-02-10T08:33:04.014368+0000","last_undegraded":"2024-02-10T08:33:04.014368+0000","last_fullsized":"2024-02-10T08:33:04.014368+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'20","last_scrub_stamp":"2024-02-10T08:32:23.661032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:32:23.661032+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":24,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":328,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.016789+0000","last_change":"2024-02-10T08:32:16.110041+0000","last_active":"2024-02-10T08:33:04.016789+0000","last_peered":"2024-02-10T08:33:04.016789+0000","last_clean":"2024-02-10T08:33:04.016789+0000","last_became_active":"2024-02-10T08:16:52.789834+0000","last_became_peered":"2024-02-10T08:16:52.789834+0000","last_unstale":"2024-02-10T08:33:04.016789+0000","last_undegraded":"2024-02-10T08:33:04.016789+0000","last_fullsized":"2024-02-10T08:33:04.016789+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:16.109957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:32:16.109957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"244'12","reported_seq":568,"reported_epoch":350,"state":"active+clean","last_fresh":"2024-02-10T08:33:05.837313+0000","last_change":"2024-02-10T08:32:11.142599+0000","last_active":"2024-02-10T08:33:05.837313+0000","last_peered":"2024-02-10T08:33:05.837313+0000","last_clean":"2024-02-10T08:33:05.837313+0000","last_became_active":"2024-02-10T08:28:02.776097+0000","last_became_peered":"2024-02-10T08:28:02.776097+0000","last_unstale":"2024-02-10T08:33:05.837313+0000","last_undegraded":"2024-02-10T08:33:05.837313+0000","last_fullsized":"2024-02-10T08:33:05.837313+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"244'12","last_scrub_stamp":"2024-02-10T08:32:11.142513+0000","last_deep_scrub":"89'9","last_deep_scrub_stamp":"2024-02-10T08:19:33.299671+0000","last_clean_scrub_stamp":"2024-02-10T08:32:11.142513+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":25,"reported_epoch":350,"state":"active+clean","last_fresh":"2024-02-10T08:33:07.663592+0000","last_change":"2024-02-10T08:33:07.663592+0000","last_active":"2024-02-10T08:33:07.663592+0000","last_peered":"2024-02-10T08:33:07.663592+0000","last_clean":"2024-02-10T08:33:07.663592+0000","last_became_active":"2024-02-10T08:32:36.983153+0000","last_became_peered":"2024-02-10T08:32:36.983153+0000","last_unstale":"2024-02-10T08:33:07.663592+0000","last_undegraded":"2024-02-10T08:33:07.663592+0000","last_fullsized":"2024-02-10T08:33:07.663592+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:07.663498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:05.662947+0000","last_clean_scrub_stamp":"2024-02-10T08:33:07.663498+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"225'19","reported_seq":350,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.019761+0000","last_change":"2024-02-10T08:29:09.148326+0000","last_active":"2024-02-10T08:33:04.019761+0000","last_peered":"2024-02-10T08:33:04.019761+0000","last_clean":"2024-02-10T08:33:04.019761+0000","last_became_active":"2024-02-10T08:16:55.204734+0000","last_became_peered":"2024-02-10T08:16:55.204734+0000","last_unstale":"2024-02-10T08:33:04.019761+0000","last_undegraded":"2024-02-10T08:33:04.019761+0000","last_fullsized":"2024-02-10T08:33:04.019761+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'19","last_scrub_stamp":"2024-02-10T08:29:09.148231+0000","last_deep_scrub":"213'13","last_deep_scrub_stamp":"2024-02-10T08:25:43.713333+0000","last_clean_scrub_stamp":"2024-02-10T08:29:09.148231+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":20,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.019899+0000","last_change":"2024-02-10T08:32:36.981055+0000","last_active":"2024-02-10T08:33:04.019899+0000","last_peered":"2024-02-10T08:33:04.019899+0000","last_clean":"2024-02-10T08:33:04.019899+0000","last_became_active":"2024-02-10T08:32:36.980715+0000","last_became_peered":"2024-02-10T08:32:36.980715+0000","last_unstale":"2024-02-10T08:33:04.019899+0000","last_undegraded":"2024-02-10T08:33:04.019899+0000","last_fullsized":"2024-02-10T08:33:04.019899+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:21.299448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:32:21.299448+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"314'11","reported_seq":404,"reported_epoch":350,"state":"active+clean","last_fresh":"2024-02-10T08:33:05.846228+0000","last_change":"2024-02-10T08:32:15.210339+0000","last_active":"2024-02-10T08:33:05.846228+0000","last_peered":"2024-02-10T08:33:05.846228+0000","last_clean":"2024-02-10T08:33:05.846228+0000","last_became_active":"2024-02-10T08:31:33.885840+0000","last_became_peered":"2024-02-10T08:31:33.885840+0000","last_unstale":"2024-02-10T08:33:05.846228+0000","last_undegraded":"2024-02-10T08:33:05.846228+0000","last_fullsized":"2024-02-10T08:33:05.846228+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"314'11","last_scrub_stamp":"2024-02-10T08:32:15.210224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:32:15.210224+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":304,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.021246+0000","last_change":"2024-02-10T08:32:12.342121+0000","last_active":"2024-02-10T08:33:04.021246+0000","last_peered":"2024-02-10T08:33:04.021246+0000","last_clean":"2024-02-10T08:33:04.021246+0000","last_became_active":"2024-02-10T08:20:46.395788+0000","last_became_peered":"2024-02-10T08:20:46.395788+0000","last_unstale":"2024-02-10T08:33:04.021246+0000","last_undegraded":"2024-02-10T08:33:04.021246+0000","last_fullsized":"2024-02-10T08:33:04.021246+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:12.342020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:32:12.342020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"225'15","reported_seq":330,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.020972+0000","last_change":"2024-02-10T08:32:13.529400+0000","last_active":"2024-02-10T08:33:04.020972+0000","last_peered":"2024-02-10T08:33:04.020972+0000","last_clean":"2024-02-10T08:33:04.020972+0000","last_became_active":"2024-02-10T08:28:25.952354+0000","last_became_peered":"2024-02-10T08:28:25.952354+0000","last_unstale":"2024-02-10T08:33:04.020972+0000","last_undegraded":"2024-02-10T08:33:04.020972+0000","last_fullsized":"2024-02-10T08:33:04.020972+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'15","last_scrub_stamp":"2024-02-10T08:32:13.529289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:32:13.529289+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":330,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.027460+0000","last_change":"2024-02-10T08:29:10.389220+0000","last_active":"2024-02-10T08:33:04.027460+0000","last_peered":"2024-02-10T08:33:04.027460+0000","last_clean":"2024-02-10T08:33:04.027460+0000","last_became_active":"2024-02-10T08:16:52.786213+0000","last_became_peered":"2024-02-10T08:16:52.786213+0000","last_unstale":"2024-02-10T08:33:04.027460+0000","last_undegraded":"2024-02-10T08:33:04.027460+0000","last_fullsized":"2024-02-10T08:33:04.027460+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:10.389138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:29:10.389138+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":152,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.020448+0000","last_change":"2024-02-10T08:29:01.325236+0000","last_active":"2024-02-10T08:33:04.020448+0000","last_peered":"2024-02-10T08:33:04.020448+0000","last_clean":"2024-02-10T08:33:04.020448+0000","last_became_active":"2024-02-10T08:28:25.950221+0000","last_became_peered":"2024-02-10T08:28:25.950221+0000","last_unstale":"2024-02-10T08:33:04.020448+0000","last_undegraded":"2024-02-10T08:33:04.020448+0000","last_fullsized":"2024-02-10T08:33:04.020448+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:01.325135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:01.325135+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":158,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.019390+0000","last_change":"2024-02-10T08:30:24.070738+0000","last_active":"2024-02-10T08:33:04.019390+0000","last_peered":"2024-02-10T08:33:04.019390+0000","last_clean":"2024-02-10T08:33:04.019390+0000","last_became_active":"2024-02-10T08:30:24.070440+0000","last_became_peered":"2024-02-10T08:30:24.070440+0000","last_unstale":"2024-02-10T08:33:04.019390+0000","last_undegraded":"2024-02-10T08:33:04.019390+0000","last_fullsized":"2024-02-10T08:33:04.019390+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:11.496105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:11.496105+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"225'24","reported_seq":363,"reported_epoch":350,"state":"active+clean","last_fresh":"2024-02-10T08:33:06.269127+0000","last_change":"2024-02-10T08:33:06.269127+0000","last_active":"2024-02-10T08:33:06.269127+0000","last_peered":"2024-02-10T08:33:06.269127+0000","last_clean":"2024-02-10T08:33:06.269127+0000","last_became_active":"2024-02-10T08:20:46.396130+0000","last_became_peered":"2024-02-10T08:20:46.396130+0000","last_unstale":"2024-02-10T08:33:06.269127+0000","last_undegraded":"2024-02-10T08:33:06.269127+0000","last_fullsized":"2024-02-10T08:33:06.269127+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'24","last_scrub_stamp":"2024-02-10T08:33:06.269024+0000","last_deep_scrub":"201'16","last_deep_scrub_stamp":"2024-02-10T08:24:49.177357+0000","last_clean_scrub_stamp":"2024-02-10T08:33:06.269024+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":341,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.015762+0000","last_change":"2024-02-10T08:32:36.974676+0000","last_active":"2024-02-10T08:33:04.015762+0000","last_peered":"2024-02-10T08:33:04.015762+0000","last_clean":"2024-02-10T08:33:04.015762+0000","last_became_active":"2024-02-10T08:32:36.974379+0000","last_became_peered":"2024-02-10T08:32:36.974379+0000","last_unstale":"2024-02-10T08:33:04.015762+0000","last_undegraded":"2024-02-10T08:33:04.015762+0000","last_fullsized":"2024-02-10T08:33:04.015762+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:28.486926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:28:28.486926+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":340,"reported_epoch":350,"state":"active+clean","last_fresh":"2024-02-10T08:33:06.791408+0000","last_change":"2024-02-10T08:33:06.791408+0000","last_active":"2024-02-10T08:33:06.791408+0000","last_peered":"2024-02-10T08:33:06.791408+0000","last_clean":"2024-02-10T08:33:06.791408+0000","last_became_active":"2024-02-10T08:31:33.893973+0000","last_became_peered":"2024-02-10T08:31:33.893973+0000","last_unstale":"2024-02-10T08:33:06.791408+0000","last_undegraded":"2024-02-10T08:33:06.791408+0000","last_fullsized":"2024-02-10T08:33:06.791408+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:06.791295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:33:06.791295+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":20,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.019622+0000","last_change":"2024-02-10T08:32:36.979428+0000","last_active":"2024-02-10T08:33:04.019622+0000","last_peered":"2024-02-10T08:33:04.019622+0000","last_clean":"2024-02-10T08:33:04.019622+0000","last_became_active":"2024-02-10T08:32:36.979093+0000","last_became_peered":"2024-02-10T08:32:36.979093+0000","last_unstale":"2024-02-10T08:33:04.019622+0000","last_undegraded":"2024-02-10T08:33:04.019622+0000","last_fullsized":"2024-02-10T08:33:04.019622+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:27.240244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:27.240244+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,5],"acting":[0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"225'8","reported_seq":253,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.014562+0000","last_change":"2024-02-10T08:32:15.627778+0000","last_active":"2024-02-10T08:33:04.014562+0000","last_peered":"2024-02-10T08:33:04.014562+0000","last_clean":"2024-02-10T08:33:04.014562+0000","last_became_active":"2024-02-10T08:22:23.522936+0000","last_became_peered":"2024-02-10T08:22:23.522936+0000","last_unstale":"2024-02-10T08:33:04.014562+0000","last_undegraded":"2024-02-10T08:33:04.014562+0000","last_fullsized":"2024-02-10T08:33:04.014562+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'8","last_scrub_stamp":"2024-02-10T08:32:15.627709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:32:15.627709+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,6],"acting":[1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":328,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.020856+0000","last_change":"2024-02-10T08:29:10.131158+0000","last_active":"2024-02-10T08:33:04.020856+0000","last_peered":"2024-02-10T08:33:04.020856+0000","last_clean":"2024-02-10T08:33:04.020856+0000","last_became_active":"2024-02-10T08:16:52.788704+0000","last_became_peered":"2024-02-10T08:16:52.788704+0000","last_unstale":"2024-02-10T08:33:04.020856+0000","last_undegraded":"2024-02-10T08:33:04.020856+0000","last_fullsized":"2024-02-10T08:33:04.020856+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:10.131056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:29:10.131056+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":334,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.026932+0000","last_change":"2024-02-10T08:32:27.229239+0000","last_active":"2024-02-10T08:33:04.026932+0000","last_peered":"2024-02-10T08:33:04.026932+0000","last_clean":"2024-02-10T08:33:04.026932+0000","last_became_active":"2024-02-10T08:20:46.397495+0000","last_became_peered":"2024-02-10T08:20:46.397495+0000","last_unstale":"2024-02-10T08:33:04.026932+0000","last_undegraded":"2024-02-10T08:33:04.026932+0000","last_fullsized":"2024-02-10T08:33:04.026932+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:27.229143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:32:27.229143+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":341,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.021469+0000","last_change":"2024-02-10T08:30:24.064805+0000","last_active":"2024-02-10T08:33:04.021469+0000","last_peered":"2024-02-10T08:33:04.021469+0000","last_clean":"2024-02-10T08:33:04.021469+0000","last_became_active":"2024-02-10T08:30:24.064419+0000","last_became_peered":"2024-02-10T08:30:24.064419+0000","last_unstale":"2024-02-10T08:33:04.021469+0000","last_undegraded":"2024-02-10T08:33:04.021469+0000","last_fullsized":"2024-02-10T08:33:04.021469+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:12.421034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:27.276490+0000","last_clean_scrub_stamp":"2024-02-10T08:29:12.421034+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"225'19","reported_seq":272,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.024796+0000","last_change":"2024-02-10T08:29:22.312103+0000","last_active":"2024-02-10T08:33:04.024796+0000","last_peered":"2024-02-10T08:33:04.024796+0000","last_clean":"2024-02-10T08:33:04.024796+0000","last_became_active":"2024-02-10T08:22:23.526198+0000","last_became_peered":"2024-02-10T08:22:23.526198+0000","last_unstale":"2024-02-10T08:33:04.024796+0000","last_undegraded":"2024-02-10T08:33:04.024796+0000","last_fullsized":"2024-02-10T08:33:04.024796+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'19","last_scrub_stamp":"2024-02-10T08:29:22.312001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:29:22.312001+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":24,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":328,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.028446+0000","last_change":"2024-02-10T08:32:30.241685+0000","last_active":"2024-02-10T08:33:04.028446+0000","last_peered":"2024-02-10T08:33:04.028446+0000","last_clean":"2024-02-10T08:33:04.028446+0000","last_became_active":"2024-02-10T08:16:52.788629+0000","last_became_peered":"2024-02-10T08:16:52.788629+0000","last_unstale":"2024-02-10T08:33:04.028446+0000","last_undegraded":"2024-02-10T08:33:04.028446+0000","last_fullsized":"2024-02-10T08:33:04.028446+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:30.241592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:38.360929+0000","last_clean_scrub_stamp":"2024-02-10T08:32:30.241592+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":334,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.022893+0000","last_change":"2024-02-10T08:29:19.380493+0000","last_active":"2024-02-10T08:33:04.022893+0000","last_peered":"2024-02-10T08:33:04.022893+0000","last_clean":"2024-02-10T08:33:04.022893+0000","last_became_active":"2024-02-10T08:20:46.399838+0000","last_became_peered":"2024-02-10T08:20:46.399838+0000","last_unstale":"2024-02-10T08:33:04.022893+0000","last_undegraded":"2024-02-10T08:33:04.022893+0000","last_fullsized":"2024-02-10T08:33:04.022893+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:19.380403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:19.380403+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":20,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.019991+0000","last_change":"2024-02-10T08:32:36.984329+0000","last_active":"2024-02-10T08:33:04.019991+0000","last_peered":"2024-02-10T08:33:04.019991+0000","last_clean":"2024-02-10T08:33:04.019991+0000","last_became_active":"2024-02-10T08:32:36.982778+0000","last_became_peered":"2024-02-10T08:32:36.982778+0000","last_unstale":"2024-02-10T08:33:04.019991+0000","last_undegraded":"2024-02-10T08:33:04.019991+0000","last_fullsized":"2024-02-10T08:33:04.019991+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:34.502781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:34.502781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"225'25","reported_seq":434,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.020096+0000","last_change":"2024-02-10T08:32:32.566504+0000","last_active":"2024-02-10T08:33:04.020096+0000","last_peered":"2024-02-10T08:33:04.020096+0000","last_clean":"2024-02-10T08:33:04.020096+0000","last_became_active":"2024-02-10T08:31:33.879680+0000","last_became_peered":"2024-02-10T08:31:33.879680+0000","last_unstale":"2024-02-10T08:33:04.020096+0000","last_undegraded":"2024-02-10T08:33:04.020096+0000","last_fullsized":"2024-02-10T08:33:04.020096+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'25","last_scrub_stamp":"2024-02-10T08:32:32.566437+0000","last_deep_scrub":"74'15","last_deep_scrub_stamp":"2024-02-10T08:17:57.637346+0000","last_clean_scrub_stamp":"2024-02-10T08:32:32.566437+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":24,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":338,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.016316+0000","last_change":"2024-02-10T08:29:26.072110+0000","last_active":"2024-02-10T08:33:04.016316+0000","last_peered":"2024-02-10T08:33:04.016316+0000","last_clean":"2024-02-10T08:33:04.016316+0000","last_became_active":"2024-02-10T08:20:46.392466+0000","last_became_peered":"2024-02-10T08:20:46.392466+0000","last_unstale":"2024-02-10T08:33:04.016316+0000","last_undegraded":"2024-02-10T08:33:04.016316+0000","last_fullsized":"2024-02-10T08:33:04.016316+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:26.072031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:29:26.072031+0000","last_clean_scrub_stamp":"2024-02-10T08:29:26.072031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1f","version":"111'11","reported_seq":546,"reported_epoch":350,"state":"active+clean","last_fresh":"2024-02-10T08:33:05.842187+0000","last_change":"2024-02-10T08:32:17.249799+0000","last_active":"2024-02-10T08:33:05.842187+0000","last_peered":"2024-02-10T08:33:05.842187+0000","last_clean":"2024-02-10T08:33:05.842187+0000","last_became_active":"2024-02-10T08:20:46.402663+0000","last_became_peered":"2024-02-10T08:20:46.402663+0000","last_unstale":"2024-02-10T08:33:05.842187+0000","last_undegraded":"2024-02-10T08:33:05.842187+0000","last_fullsized":"2024-02-10T08:33:05.842187+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'11","last_scrub_stamp":"2024-02-10T08:32:17.249718+0000","last_deep_scrub":"111'11","last_deep_scrub_stamp":"2024-02-10T08:32:17.249718+0000","last_clean_scrub_stamp":"2024-02-10T08:32:17.249718+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"87'2","reported_seq":319,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.023663+0000","last_change":"2024-02-10T08:28:37.261008+0000","last_active":"2024-02-10T08:33:04.023663+0000","last_peered":"2024-02-10T08:33:04.023663+0000","last_clean":"2024-02-10T08:33:04.023663+0000","last_became_active":"2024-02-10T08:16:58.859047+0000","last_became_peered":"2024-02-10T08:16:58.859047+0000","last_unstale":"2024-02-10T08:33:04.023663+0000","last_undegraded":"2024-02-10T08:33:04.023663+0000","last_fullsized":"2024-02-10T08:33:04.023663+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'2","last_scrub_stamp":"2024-02-10T08:28:37.260945+0000","last_deep_scrub":"87'2","last_deep_scrub_stamp":"2024-02-10T08:19:29.207531+0000","last_clean_scrub_stamp":"2024-02-10T08:28:37.260945+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"225'19","reported_seq":355,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.028619+0000","last_change":"2024-02-10T08:32:33.268773+0000","last_active":"2024-02-10T08:33:04.028619+0000","last_peered":"2024-02-10T08:33:04.028619+0000","last_clean":"2024-02-10T08:33:04.028619+0000","last_became_active":"2024-02-10T08:16:54.852665+0000","last_became_peered":"2024-02-10T08:16:54.852665+0000","last_unstale":"2024-02-10T08:33:04.028619+0000","last_undegraded":"2024-02-10T08:33:04.028619+0000","last_fullsized":"2024-02-10T08:33:04.028619+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'19","last_scrub_stamp":"2024-02-10T08:28:40.341641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:28:40.341641+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":265,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.026934+0000","last_change":"2024-02-10T08:31:33.878792+0000","last_active":"2024-02-10T08:33:04.026934+0000","last_peered":"2024-02-10T08:33:04.026934+0000","last_clean":"2024-02-10T08:33:04.026934+0000","last_became_active":"2024-02-10T08:31:33.878473+0000","last_became_peered":"2024-02-10T08:31:33.878473+0000","last_unstale":"2024-02-10T08:33:04.026934+0000","last_undegraded":"2024-02-10T08:33:04.026934+0000","last_fullsized":"2024-02-10T08:33:04.026934+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:14.469285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:25:42.124914+0000","last_clean_scrub_stamp":"2024-02-10T08:29:14.469285+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":154,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.020175+0000","last_change":"2024-02-10T08:32:26.589167+0000","last_active":"2024-02-10T08:33:04.020175+0000","last_peered":"2024-02-10T08:33:04.020175+0000","last_clean":"2024-02-10T08:33:04.020175+0000","last_became_active":"2024-02-10T08:28:25.951312+0000","last_became_peered":"2024-02-10T08:28:25.951312+0000","last_unstale":"2024-02-10T08:33:04.020175+0000","last_undegraded":"2024-02-10T08:33:04.020175+0000","last_fullsized":"2024-02-10T08:33:04.020175+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:26.589082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:32:26.589082+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":328,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.014888+0000","last_change":"2024-02-10T08:29:20.739901+0000","last_active":"2024-02-10T08:33:04.014888+0000","last_peered":"2024-02-10T08:33:04.014888+0000","last_clean":"2024-02-10T08:33:04.014888+0000","last_became_active":"2024-02-10T08:20:46.408504+0000","last_became_peered":"2024-02-10T08:20:46.408504+0000","last_unstale":"2024-02-10T08:33:04.014888+0000","last_undegraded":"2024-02-10T08:33:04.014888+0000","last_fullsized":"2024-02-10T08:33:04.014888+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:20.739750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:22.104988+0000","last_clean_scrub_stamp":"2024-02-10T08:29:20.739750+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"330'34","reported_seq":427,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.023768+0000","last_change":"2024-02-10T08:32:17.481894+0000","last_active":"2024-02-10T08:33:04.023768+0000","last_peered":"2024-02-10T08:33:04.023768+0000","last_clean":"2024-02-10T08:33:04.023768+0000","last_became_active":"2024-02-10T08:31:33.894960+0000","last_became_peered":"2024-02-10T08:31:33.894960+0000","last_unstale":"2024-02-10T08:33:04.023768+0000","last_undegraded":"2024-02-10T08:33:04.023768+0000","last_fullsized":"2024-02-10T08:33:04.023768+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"330'34","last_scrub_stamp":"2024-02-10T08:32:17.481832+0000","last_deep_scrub":"330'34","last_deep_scrub_stamp":"2024-02-10T08:32:17.481832+0000","last_clean_scrub_stamp":"2024-02-10T08:32:17.481832+0000","log_size":34,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":338,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.027504+0000","last_change":"2024-02-10T08:28:33.456849+0000","last_active":"2024-02-10T08:33:04.027504+0000","last_peered":"2024-02-10T08:33:04.027504+0000","last_clean":"2024-02-10T08:33:04.027504+0000","last_became_active":"2024-02-10T08:20:46.396303+0000","last_became_peered":"2024-02-10T08:20:46.396303+0000","last_unstale":"2024-02-10T08:33:04.027504+0000","last_undegraded":"2024-02-10T08:33:04.027504+0000","last_fullsized":"2024-02-10T08:33:04.027504+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:33.456780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:10.370746+0000","last_clean_scrub_stamp":"2024-02-10T08:28:33.456780+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":348,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.015738+0000","last_change":"2024-02-10T08:29:25.682482+0000","last_active":"2024-02-10T08:33:04.015738+0000","last_peered":"2024-02-10T08:33:04.015738+0000","last_clean":"2024-02-10T08:33:04.015738+0000","last_became_active":"2024-02-10T08:28:02.763523+0000","last_became_peered":"2024-02-10T08:28:02.763523+0000","last_unstale":"2024-02-10T08:33:04.015738+0000","last_undegraded":"2024-02-10T08:33:04.015738+0000","last_fullsized":"2024-02-10T08:33:04.015738+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:25.682383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:25.682383+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":296,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.021866+0000","last_change":"2024-02-10T08:29:00.918497+0000","last_active":"2024-02-10T08:33:04.021866+0000","last_peered":"2024-02-10T08:33:04.021866+0000","last_clean":"2024-02-10T08:33:04.021866+0000","last_became_active":"2024-02-10T08:20:46.403378+0000","last_became_peered":"2024-02-10T08:20:46.403378+0000","last_unstale":"2024-02-10T08:33:04.021866+0000","last_undegraded":"2024-02-10T08:33:04.021866+0000","last_fullsized":"2024-02-10T08:33:04.021866+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:00.918382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:00.918382+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"226'23","reported_seq":330,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.015667+0000","last_change":"2024-02-10T08:31:34.341047+0000","last_active":"2024-02-10T08:33:04.015667+0000","last_peered":"2024-02-10T08:33:04.015667+0000","last_clean":"2024-02-10T08:33:04.015667+0000","last_became_active":"2024-02-10T08:31:33.891562+0000","last_became_peered":"2024-02-10T08:31:33.891562+0000","last_unstale":"2024-02-10T08:33:04.015667+0000","last_undegraded":"2024-02-10T08:33:04.015667+0000","last_fullsized":"2024-02-10T08:33:04.015667+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"226'23","last_scrub_stamp":"2024-02-10T08:29:19.670143+0000","last_deep_scrub":"74'17","last_deep_scrub_stamp":"2024-02-10T08:18:02.949298+0000","last_clean_scrub_stamp":"2024-02-10T08:29:19.670143+0000","log_size":23,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":25,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":247,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.021959+0000","last_change":"2024-02-10T08:32:22.275761+0000","last_active":"2024-02-10T08:33:04.021959+0000","last_peered":"2024-02-10T08:33:04.021959+0000","last_clean":"2024-02-10T08:33:04.021959+0000","last_became_active":"2024-02-10T08:31:33.879918+0000","last_became_peered":"2024-02-10T08:31:33.879918+0000","last_unstale":"2024-02-10T08:33:04.021959+0000","last_undegraded":"2024-02-10T08:33:04.021959+0000","last_fullsized":"2024-02-10T08:33:04.021959+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:22.275679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:32:22.275679+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":298,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.022283+0000","last_change":"2024-02-10T08:32:17.352870+0000","last_active":"2024-02-10T08:33:04.022283+0000","last_peered":"2024-02-10T08:33:04.022283+0000","last_clean":"2024-02-10T08:33:04.022283+0000","last_became_active":"2024-02-10T08:20:46.398532+0000","last_became_peered":"2024-02-10T08:20:46.398532+0000","last_unstale":"2024-02-10T08:33:04.022283+0000","last_undegraded":"2024-02-10T08:33:04.022283+0000","last_fullsized":"2024-02-10T08:33:04.022283+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:17.352797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:32:17.352797+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":234,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.028688+0000","last_change":"2024-02-10T08:32:15.313492+0000","last_active":"2024-02-10T08:33:04.028688+0000","last_peered":"2024-02-10T08:33:04.028688+0000","last_clean":"2024-02-10T08:33:04.028688+0000","last_became_active":"2024-02-10T08:22:23.526229+0000","last_became_peered":"2024-02-10T08:22:23.526229+0000","last_unstale":"2024-02-10T08:33:04.028688+0000","last_undegraded":"2024-02-10T08:33:04.028688+0000","last_fullsized":"2024-02-10T08:33:04.028688+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:15.313394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:32:15.313394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1a","version":"225'15","reported_seq":52,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.022261+0000","last_change":"2024-02-10T08:31:46.145013+0000","last_active":"2024-02-10T08:33:04.022261+0000","last_peered":"2024-02-10T08:33:04.022261+0000","last_clean":"2024-02-10T08:33:04.022261+0000","last_became_active":"2024-02-10T08:31:46.069680+0000","last_became_peered":"2024-02-10T08:31:46.069680+0000","last_unstale":"2024-02-10T08:33:04.022261+0000","last_undegraded":"2024-02-10T08:33:04.022261+0000","last_fullsized":"2024-02-10T08:33:04.022261+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'15","last_scrub_stamp":"2024-02-10T08:29:13.500017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:29:13.500017+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":323,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.023208+0000","last_change":"2024-02-10T08:29:26.213501+0000","last_active":"2024-02-10T08:33:04.023208+0000","last_peered":"2024-02-10T08:33:04.023208+0000","last_clean":"2024-02-10T08:33:04.023208+0000","last_became_active":"2024-02-10T08:16:52.787865+0000","last_became_peered":"2024-02-10T08:16:52.787865+0000","last_unstale":"2024-02-10T08:33:04.023208+0000","last_undegraded":"2024-02-10T08:33:04.023208+0000","last_fullsized":"2024-02-10T08:33:04.023208+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:26.213417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:28.028556+0000","last_clean_scrub_stamp":"2024-02-10T08:29:26.213417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":351,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.019321+0000","last_change":"2024-02-10T08:29:22.172003+0000","last_active":"2024-02-10T08:33:04.019321+0000","last_peered":"2024-02-10T08:33:04.019321+0000","last_clean":"2024-02-10T08:33:04.019321+0000","last_became_active":"2024-02-10T08:28:19.065132+0000","last_became_peered":"2024-02-10T08:28:19.065132+0000","last_unstale":"2024-02-10T08:33:04.019321+0000","last_undegraded":"2024-02-10T08:33:04.019321+0000","last_fullsized":"2024-02-10T08:33:04.019321+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:22.171906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:22.171906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,7],"acting":[5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":20,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.019263+0000","last_change":"2024-02-10T08:32:36.979316+0000","last_active":"2024-02-10T08:33:04.019263+0000","last_peered":"2024-02-10T08:33:04.019263+0000","last_clean":"2024-02-10T08:33:04.019263+0000","last_became_active":"2024-02-10T08:32:36.978752+0000","last_became_peered":"2024-02-10T08:32:36.978752+0000","last_unstale":"2024-02-10T08:33:04.019263+0000","last_undegraded":"2024-02-10T08:33:04.019263+0000","last_fullsized":"2024-02-10T08:33:04.019263+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:27:19.250878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:27:19.250878+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"225'7","reported_seq":352,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.021172+0000","last_change":"2024-02-10T08:32:22.340287+0000","last_active":"2024-02-10T08:33:04.021172+0000","last_peered":"2024-02-10T08:33:04.021172+0000","last_clean":"2024-02-10T08:33:04.021172+0000","last_became_active":"2024-02-10T08:27:27.715306+0000","last_became_peered":"2024-02-10T08:27:27.715306+0000","last_unstale":"2024-02-10T08:33:04.021172+0000","last_undegraded":"2024-02-10T08:33:04.021172+0000","last_fullsized":"2024-02-10T08:33:04.021172+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'7","last_scrub_stamp":"2024-02-10T08:32:22.340191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:32:22.340191+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":9,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"55'1","reported_seq":356,"reported_epoch":350,"state":"active+clean","last_fresh":"2024-02-10T08:33:06.363742+0000","last_change":"2024-02-10T08:33:06.363742+0000","last_active":"2024-02-10T08:33:06.363742+0000","last_peered":"2024-02-10T08:33:06.363742+0000","last_clean":"2024-02-10T08:33:06.363742+0000","last_became_active":"2024-02-10T08:28:02.761299+0000","last_became_peered":"2024-02-10T08:28:02.761299+0000","last_unstale":"2024-02-10T08:33:06.363742+0000","last_undegraded":"2024-02-10T08:33:06.363742+0000","last_fullsized":"2024-02-10T08:33:06.363742+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'1","last_scrub_stamp":"2024-02-10T08:33:06.363627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:33:06.363627+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1746,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":334,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.021291+0000","last_change":"2024-02-10T08:28:38.278860+0000","last_active":"2024-02-10T08:33:04.021291+0000","last_peered":"2024-02-10T08:33:04.021291+0000","last_clean":"2024-02-10T08:33:04.021291+0000","last_became_active":"2024-02-10T08:20:46.406783+0000","last_became_peered":"2024-02-10T08:20:46.406783+0000","last_unstale":"2024-02-10T08:33:04.021291+0000","last_undegraded":"2024-02-10T08:33:04.021291+0000","last_fullsized":"2024-02-10T08:33:04.021291+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:38.278752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:28:38.278752+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":335,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.016426+0000","last_change":"2024-02-10T08:31:33.886939+0000","last_active":"2024-02-10T08:33:04.016426+0000","last_peered":"2024-02-10T08:33:04.016426+0000","last_clean":"2024-02-10T08:33:04.016426+0000","last_became_active":"2024-02-10T08:31:33.886617+0000","last_became_peered":"2024-02-10T08:31:33.886617+0000","last_unstale":"2024-02-10T08:33:04.016426+0000","last_undegraded":"2024-02-10T08:33:04.016426+0000","last_fullsized":"2024-02-10T08:33:04.016426+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:08.143236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:08.143236+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"225'15","reported_seq":320,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.021936+0000","last_change":"2024-02-10T08:29:07.977048+0000","last_active":"2024-02-10T08:33:04.021936+0000","last_peered":"2024-02-10T08:33:04.021936+0000","last_clean":"2024-02-10T08:33:04.021936+0000","last_became_active":"2024-02-10T08:20:46.404966+0000","last_became_peered":"2024-02-10T08:20:46.404966+0000","last_unstale":"2024-02-10T08:33:04.021936+0000","last_undegraded":"2024-02-10T08:33:04.021936+0000","last_fullsized":"2024-02-10T08:33:04.021936+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'15","last_scrub_stamp":"2024-02-10T08:29:07.976943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:29:07.976943+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":20,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.020253+0000","last_change":"2024-02-10T08:32:36.983082+0000","last_active":"2024-02-10T08:33:04.020253+0000","last_peered":"2024-02-10T08:33:04.020253+0000","last_clean":"2024-02-10T08:33:04.020253+0000","last_became_active":"2024-02-10T08:32:36.982675+0000","last_became_peered":"2024-02-10T08:32:36.982675+0000","last_unstale":"2024-02-10T08:33:04.020253+0000","last_undegraded":"2024-02-10T08:33:04.020253+0000","last_fullsized":"2024-02-10T08:33:04.020253+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:14.084352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:32:14.084352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,5],"acting":[0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":315,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.016195+0000","last_change":"2024-02-10T08:28:24.450504+0000","last_active":"2024-02-10T08:33:04.016195+0000","last_peered":"2024-02-10T08:33:04.016195+0000","last_clean":"2024-02-10T08:33:04.016195+0000","last_became_active":"2024-02-10T08:16:56.863353+0000","last_became_peered":"2024-02-10T08:16:56.863353+0000","last_unstale":"2024-02-10T08:33:04.016195+0000","last_undegraded":"2024-02-10T08:33:04.016195+0000","last_fullsized":"2024-02-10T08:33:04.016195+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:24.450350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:28:24.450350+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":296,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.022850+0000","last_change":"2024-02-10T08:29:25.024508+0000","last_active":"2024-02-10T08:33:04.022850+0000","last_peered":"2024-02-10T08:33:04.022850+0000","last_clean":"2024-02-10T08:33:04.022850+0000","last_became_active":"2024-02-10T08:20:46.405314+0000","last_became_peered":"2024-02-10T08:20:46.405314+0000","last_unstale":"2024-02-10T08:33:04.022850+0000","last_undegraded":"2024-02-10T08:33:04.022850+0000","last_fullsized":"2024-02-10T08:33:04.022850+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:25.024412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:29:25.024412+0000","last_clean_scrub_stamp":"2024-02-10T08:29:25.024412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"225'27","reported_seq":384,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.023259+0000","last_change":"2024-02-10T08:31:34.248681+0000","last_active":"2024-02-10T08:33:04.023259+0000","last_peered":"2024-02-10T08:33:04.023259+0000","last_clean":"2024-02-10T08:33:04.023259+0000","last_became_active":"2024-02-10T08:31:33.883535+0000","last_became_peered":"2024-02-10T08:31:33.883535+0000","last_unstale":"2024-02-10T08:33:04.023259+0000","last_undegraded":"2024-02-10T08:33:04.023259+0000","last_fullsized":"2024-02-10T08:33:04.023259+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'27","last_scrub_stamp":"2024-02-10T08:29:18.566350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:29:18.566350+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":20,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.019345+0000","last_change":"2024-02-10T08:32:36.978215+0000","last_active":"2024-02-10T08:33:04.019345+0000","last_peered":"2024-02-10T08:33:04.019345+0000","last_clean":"2024-02-10T08:33:04.019345+0000","last_became_active":"2024-02-10T08:32:36.977972+0000","last_became_peered":"2024-02-10T08:32:36.977972+0000","last_unstale":"2024-02-10T08:33:04.019345+0000","last_undegraded":"2024-02-10T08:33:04.019345+0000","last_fullsized":"2024-02-10T08:33:04.019345+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:31.264352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:28:31.264352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":42,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.021525+0000","last_change":"2024-02-10T08:31:46.058167+0000","last_active":"2024-02-10T08:33:04.021525+0000","last_peered":"2024-02-10T08:33:04.021525+0000","last_clean":"2024-02-10T08:33:04.021525+0000","last_became_active":"2024-02-10T08:31:46.057858+0000","last_became_peered":"2024-02-10T08:31:46.057858+0000","last_unstale":"2024-02-10T08:33:04.021525+0000","last_undegraded":"2024-02-10T08:33:04.021525+0000","last_fullsized":"2024-02-10T08:33:04.021525+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:04.388074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:04.388074+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":247,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.021673+0000","last_change":"2024-02-10T08:31:33.880687+0000","last_active":"2024-02-10T08:33:04.021673+0000","last_peered":"2024-02-10T08:33:04.021673+0000","last_clean":"2024-02-10T08:33:04.021673+0000","last_became_active":"2024-02-10T08:31:33.880328+0000","last_became_peered":"2024-02-10T08:31:33.880328+0000","last_unstale":"2024-02-10T08:33:04.021673+0000","last_undegraded":"2024-02-10T08:33:04.021673+0000","last_fullsized":"2024-02-10T08:33:04.021673+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:06.366305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:06.366305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":231,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.016533+0000","last_change":"2024-02-10T08:29:01.651198+0000","last_active":"2024-02-10T08:33:04.016533+0000","last_peered":"2024-02-10T08:33:04.016533+0000","last_clean":"2024-02-10T08:33:04.016533+0000","last_became_active":"2024-02-10T08:22:00.581772+0000","last_became_peered":"2024-02-10T08:22:00.581772+0000","last_unstale":"2024-02-10T08:33:04.016533+0000","last_undegraded":"2024-02-10T08:33:04.016533+0000","last_fullsized":"2024-02-10T08:33:04.016533+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:01.651093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:01.651093+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,7],"acting":[1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":249,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.021708+0000","last_change":"2024-02-10T08:31:46.055053+0000","last_active":"2024-02-10T08:33:04.021708+0000","last_peered":"2024-02-10T08:33:04.021708+0000","last_clean":"2024-02-10T08:33:04.021708+0000","last_became_active":"2024-02-10T08:31:46.054713+0000","last_became_peered":"2024-02-10T08:31:46.054713+0000","last_unstale":"2024-02-10T08:33:04.021708+0000","last_undegraded":"2024-02-10T08:33:04.021708+0000","last_fullsized":"2024-02-10T08:33:04.021708+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:18.099177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:18.099177+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":236,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.026898+0000","last_change":"2024-02-10T08:29:19.512005+0000","last_active":"2024-02-10T08:33:04.026898+0000","last_peered":"2024-02-10T08:33:04.026898+0000","last_clean":"2024-02-10T08:33:04.026898+0000","last_became_active":"2024-02-10T08:22:00.600200+0000","last_became_peered":"2024-02-10T08:22:00.600200+0000","last_unstale":"2024-02-10T08:33:04.026898+0000","last_undegraded":"2024-02-10T08:33:04.026898+0000","last_fullsized":"2024-02-10T08:33:04.026898+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:19.511918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:19.511918+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1],"acting":[6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":220,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.020154+0000","last_change":"2024-02-10T08:29:22.556568+0000","last_active":"2024-02-10T08:33:04.020154+0000","last_peered":"2024-02-10T08:33:04.020154+0000","last_clean":"2024-02-10T08:33:04.020154+0000","last_became_active":"2024-02-10T08:28:25.999335+0000","last_became_peered":"2024-02-10T08:28:25.999335+0000","last_unstale":"2024-02-10T08:33:04.020154+0000","last_undegraded":"2024-02-10T08:33:04.020154+0000","last_fullsized":"2024-02-10T08:33:04.020154+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:22.556451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:22.556451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":345,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.019369+0000","last_change":"2024-02-10T08:31:33.879761+0000","last_active":"2024-02-10T08:33:04.019369+0000","last_peered":"2024-02-10T08:33:04.019369+0000","last_clean":"2024-02-10T08:33:04.019369+0000","last_became_active":"2024-02-10T08:31:33.879440+0000","last_became_peered":"2024-02-10T08:31:33.879440+0000","last_unstale":"2024-02-10T08:33:04.019369+0000","last_undegraded":"2024-02-10T08:33:04.019369+0000","last_fullsized":"2024-02-10T08:33:04.019369+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:19.225297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:19.225297+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":346,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.027782+0000","last_change":"2024-02-10T08:29:21.602049+0000","last_active":"2024-02-10T08:33:04.027782+0000","last_peered":"2024-02-10T08:33:04.027782+0000","last_clean":"2024-02-10T08:33:04.027782+0000","last_became_active":"2024-02-10T08:27:27.710587+0000","last_became_peered":"2024-02-10T08:27:27.710587+0000","last_unstale":"2024-02-10T08:33:04.027782+0000","last_undegraded":"2024-02-10T08:33:04.027782+0000","last_fullsized":"2024-02-10T08:33:04.027782+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:21.601953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:11.750537+0000","last_clean_scrub_stamp":"2024-02-10T08:29:21.601953+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,1],"acting":[6,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":249,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.015300+0000","last_change":"2024-02-10T08:32:36.974499+0000","last_active":"2024-02-10T08:33:04.015300+0000","last_peered":"2024-02-10T08:33:04.015300+0000","last_clean":"2024-02-10T08:33:04.015300+0000","last_became_active":"2024-02-10T08:32:36.974142+0000","last_became_peered":"2024-02-10T08:32:36.974142+0000","last_unstale":"2024-02-10T08:33:04.015300+0000","last_undegraded":"2024-02-10T08:33:04.015300+0000","last_fullsized":"2024-02-10T08:33:04.015300+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:02.618499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:02.618499+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":254,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.028391+0000","last_change":"2024-02-10T08:32:36.979965+0000","last_active":"2024-02-10T08:33:04.028391+0000","last_peered":"2024-02-10T08:33:04.028391+0000","last_clean":"2024-02-10T08:33:04.028391+0000","last_became_active":"2024-02-10T08:32:36.979412+0000","last_became_peered":"2024-02-10T08:32:36.979412+0000","last_unstale":"2024-02-10T08:33:04.028391+0000","last_undegraded":"2024-02-10T08:33:04.028391+0000","last_fullsized":"2024-02-10T08:33:04.028391+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:17.607818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:17.607818+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1],"acting":[6,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":326,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.023187+0000","last_change":"2024-02-10T08:32:16.519014+0000","last_active":"2024-02-10T08:33:04.023187+0000","last_peered":"2024-02-10T08:33:04.023187+0000","last_clean":"2024-02-10T08:33:04.023187+0000","last_became_active":"2024-02-10T08:22:00.578118+0000","last_became_peered":"2024-02-10T08:22:00.578118+0000","last_unstale":"2024-02-10T08:33:04.023187+0000","last_undegraded":"2024-02-10T08:33:04.023187+0000","last_fullsized":"2024-02-10T08:33:04.023187+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:16.518945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:32:16.518945+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,6],"acting":[2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.29","version":"76'2","reported_seq":284,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.024418+0000","last_change":"2024-02-10T08:32:31.459909+0000","last_active":"2024-02-10T08:33:04.024418+0000","last_peered":"2024-02-10T08:33:04.024418+0000","last_clean":"2024-02-10T08:33:04.024418+0000","last_became_active":"2024-02-10T08:28:02.767822+0000","last_became_peered":"2024-02-10T08:28:02.767822+0000","last_unstale":"2024-02-10T08:33:04.024418+0000","last_undegraded":"2024-02-10T08:33:04.024418+0000","last_fullsized":"2024-02-10T08:33:04.024418+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":6,"last_scrub":"76'2","last_scrub_stamp":"2024-02-10T08:32:31.459851+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2024-02-10T08:18:08.680038+0000","last_clean_scrub_stamp":"2024-02-10T08:32:31.459851+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,0],"acting":[7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":51,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.022355+0000","last_change":"2024-02-10T08:32:36.975485+0000","last_active":"2024-02-10T08:33:04.022355+0000","last_peered":"2024-02-10T08:33:04.022355+0000","last_clean":"2024-02-10T08:33:04.022355+0000","last_became_active":"2024-02-10T08:32:36.975213+0000","last_became_peered":"2024-02-10T08:32:36.975213+0000","last_unstale":"2024-02-10T08:33:04.022355+0000","last_undegraded":"2024-02-10T08:33:04.022355+0000","last_fullsized":"2024-02-10T08:33:04.022355+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:30.227120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:20.392249+0000","last_clean_scrub_stamp":"2024-02-10T08:28:30.227120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0],"acting":[4,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":70,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.016724+0000","last_change":"2024-02-10T08:30:26.080634+0000","last_active":"2024-02-10T08:33:04.016724+0000","last_peered":"2024-02-10T08:33:04.016724+0000","last_clean":"2024-02-10T08:33:04.016724+0000","last_became_active":"2024-02-10T08:30:26.079913+0000","last_became_peered":"2024-02-10T08:30:26.079913+0000","last_unstale":"2024-02-10T08:33:04.016724+0000","last_undegraded":"2024-02-10T08:33:04.016724+0000","last_fullsized":"2024-02-10T08:33:04.016724+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:26:20.173948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:26:20.173948+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":255,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.027321+0000","last_change":"2024-02-10T08:30:26.067617+0000","last_active":"2024-02-10T08:33:04.027321+0000","last_peered":"2024-02-10T08:33:04.027321+0000","last_clean":"2024-02-10T08:33:04.027321+0000","last_became_active":"2024-02-10T08:30:26.067308+0000","last_became_peered":"2024-02-10T08:30:26.067308+0000","last_unstale":"2024-02-10T08:33:04.027321+0000","last_undegraded":"2024-02-10T08:33:04.027321+0000","last_fullsized":"2024-02-10T08:33:04.027321+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:15.491747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:20:30.227375+0000","last_clean_scrub_stamp":"2024-02-10T08:29:15.491747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,5],"acting":[6,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":335,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.024215+0000","last_change":"2024-02-10T08:30:26.085599+0000","last_active":"2024-02-10T08:33:04.024215+0000","last_peered":"2024-02-10T08:33:04.024215+0000","last_clean":"2024-02-10T08:33:04.024215+0000","last_became_active":"2024-02-10T08:30:26.085360+0000","last_became_peered":"2024-02-10T08:30:26.085360+0000","last_unstale":"2024-02-10T08:33:04.024215+0000","last_undegraded":"2024-02-10T08:33:04.024215+0000","last_fullsized":"2024-02-10T08:33:04.024215+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:36.163125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:36.163125+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,5],"acting":[2,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":70,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.027636+0000","last_change":"2024-02-10T08:30:26.075782+0000","last_active":"2024-02-10T08:33:04.027636+0000","last_peered":"2024-02-10T08:33:04.027636+0000","last_clean":"2024-02-10T08:33:04.027636+0000","last_became_active":"2024-02-10T08:30:26.075472+0000","last_became_peered":"2024-02-10T08:30:26.075472+0000","last_unstale":"2024-02-10T08:33:04.027636+0000","last_undegraded":"2024-02-10T08:33:04.027636+0000","last_fullsized":"2024-02-10T08:33:04.027636+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:26.976023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:26.976023+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":70,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.023121+0000","last_change":"2024-02-10T08:30:26.080944+0000","last_active":"2024-02-10T08:33:04.023121+0000","last_peered":"2024-02-10T08:33:04.023121+0000","last_clean":"2024-02-10T08:33:04.023121+0000","last_became_active":"2024-02-10T08:30:26.080539+0000","last_became_peered":"2024-02-10T08:30:26.080539+0000","last_unstale":"2024-02-10T08:33:04.023121+0000","last_undegraded":"2024-02-10T08:33:04.023121+0000","last_fullsized":"2024-02-10T08:33:04.023121+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:34.215363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:34.215363+0000","last_clean_scrub_stamp":"2024-02-10T08:28:34.215363+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":70,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.022160+0000","last_change":"2024-02-10T08:30:26.088483+0000","last_active":"2024-02-10T08:33:04.022160+0000","last_peered":"2024-02-10T08:33:04.022160+0000","last_clean":"2024-02-10T08:33:04.022160+0000","last_became_active":"2024-02-10T08:30:26.088228+0000","last_became_peered":"2024-02-10T08:30:26.088228+0000","last_unstale":"2024-02-10T08:33:04.022160+0000","last_undegraded":"2024-02-10T08:33:04.022160+0000","last_fullsized":"2024-02-10T08:33:04.022160+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:11.496105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:11.496105+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1],"acting":[7,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":250,"reported_epoch":349,"state":"active+clean","last_fresh":"2024-02-10T08:33:04.016249+0000","last_change":"2024-02-10T08:30:26.072341+0000","last_active":"2024-02-10T08:33:04.016249+0000","last_peered":"2024-02-10T08:33:04.016249+0000","last_clean":"2024-02-10T08:33:04.016249+0000","last_became_active":"2024-02-10T08:30:26.072022+0000","last_became_peered":"2024-02-10T08:30:26.072022+0000","last_unstale":"2024-02-10T08:33:04.016249+0000","last_undegraded":"2024-02-10T08:33:04.016249+0000","last_fullsized":"2024-02-10T08:33:04.016249+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:27.240244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:27.240244+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":16,"stat_sum":{"num_bytes":3052011520,"num_objects":46570,"num_object_clones":0,"num_object_copies":139710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46570,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46570,"num_write_kb":2980480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":9211740160,"data_stored":9211740160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":46570,"ondisk_log_size":46570,"up":48,"acting":48,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2646,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":4},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":965,"num_read_kb":960,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":9,"acting":9,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":1105,"num_read_kb":862,"num_write":703,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":212,"num_bytes_recovered":5226,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":733,"ondisk_log_size":733,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":96,"acting":96,"num_store_stats":8},{"poolid":6,"num_pg":52,"stat_sum":{"num_bytes":388,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":156,"acting":156,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":50,"seq":214748364999,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1323728,"kb_used_data":729928,"kb_used_omap":0,"kb_used_meta":593792,"kb_avail":92421424,"statfs":{"total":95995035648,"available":94639538176,"internally_reserved":0,"allocated":747446272,"data_stored":746870623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":608043008},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:32:13 2024","interfaces":[{"interface":"back","average":{"1min":2.7429999999999999,"5min":2.085,"15min":1.5860000000000001},"min":{"1min":0.23000000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":8.6869999999999994,"5min":8.6869999999999994,"15min":21.175999999999998},"last":0.38100000000000001},{"interface":"front","average":{"1min":3.323,"5min":2.258,"15min":1.99},"min":{"1min":0.30299999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":10.013,"5min":10.013,"15min":22.57},"last":1.3460000000000001}]},{"osd":1,"last update":"Sat Feb 10 08:32:13 2024","interfaces":[{"interface":"back","average":{"1min":2.7810000000000001,"5min":2.4340000000000002,"15min":1.72},"min":{"1min":0.23799999999999999,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":8.7530000000000001,"5min":41.539999999999999,"15min":41.539999999999999},"last":0.40200000000000002},{"interface":"front","average":{"1min":3.2749999999999999,"5min":2.411,"15min":1.7609999999999999},"min":{"1min":0.42199999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":10.053000000000001,"5min":41.046999999999997,"15min":41.046999999999997},"last":1.383}]},{"osd":2,"last update":"Sat Feb 10 08:32:13 2024","interfaces":[{"interface":"back","average":{"1min":3.161,"5min":1.974,"15min":1.5429999999999999},"min":{"1min":0.25700000000000001,"5min":0.255,"15min":0.251},"max":{"1min":12.599,"5min":12.599,"15min":12.599},"last":0.34300000000000003},{"interface":"front","average":{"1min":2.7730000000000001,"5min":1.978,"15min":1.607},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.25900000000000001},"max":{"1min":8.7300000000000004,"5min":8.7300000000000004,"15min":12.797000000000001},"last":0.35299999999999998}]},{"osd":3,"last update":"Sat Feb 10 08:32:13 2024","interfaces":[{"interface":"back","average":{"1min":2.754,"5min":1.9159999999999999,"15min":1.5580000000000001},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.27700000000000002},"max":{"1min":12.686,"5min":13.07,"15min":18.515000000000001},"last":0.28699999999999998},{"interface":"front","average":{"1min":4.1020000000000003,"5min":2.109,"15min":1.7150000000000001},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":10.960000000000001,"5min":10.960000000000001,"15min":10.960000000000001},"last":2.718}]},{"osd":4,"last update":"Sat Feb 10 08:32:13 2024","interfaces":[{"interface":"back","average":{"1min":2.7280000000000002,"5min":1.599,"15min":1.036},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.216},"max":{"1min":12.574999999999999,"5min":12.574999999999999,"15min":12.574999999999999},"last":1.135},{"interface":"front","average":{"1min":2.2080000000000002,"5min":1.587,"15min":1.0389999999999999},"min":{"1min":0.29699999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":8.8170000000000002,"5min":8.8170000000000002,"15min":12.987},"last":2.7610000000000001}]},{"osd":5,"last update":"Sat Feb 10 08:32:13 2024","interfaces":[{"interface":"back","average":{"1min":4.1479999999999997,"5min":2.5259999999999998,"15min":1.456},"min":{"1min":0.28199999999999997,"5min":0.24199999999999999,"15min":0.218},"max":{"1min":12.882,"5min":15.304,"15min":15.304},"last":0.92000000000000004},{"interface":"front","average":{"1min":2.9199999999999999,"5min":2.0350000000000001,"15min":1.23},"min":{"1min":0.307,"5min":0.255,"15min":0.22600000000000001},"max":{"1min":13.129,"5min":13.129,"15min":13.129},"last":2.8279999999999998}]},{"osd":6,"last update":"Sat Feb 10 08:32:13 2024","interfaces":[{"interface":"back","average":{"1min":2.694,"5min":1.7370000000000001,"15min":1.0840000000000001},"min":{"1min":0.33600000000000002,"5min":0.27500000000000002,"15min":0.26100000000000001},"max":{"1min":10.101000000000001,"5min":10.101000000000001,"15min":10.101000000000001},"last":2.6880000000000002},{"interface":"front","average":{"1min":3.0750000000000002,"5min":1.8149999999999999,"15min":1.0940000000000001},"min":{"1min":0.308,"5min":0.27000000000000002,"15min":0.224},"max":{"1min":12.654,"5min":12.654,"15min":12.654},"last":0.315}]}]},{"osd":6,"up_from":43,"seq":184683593932,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1574960,"kb_used_data":1261352,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":92170192,"statfs":{"total":95995035648,"available":94382276608,"internally_reserved":0,"allocated":1291624448,"data_stored":1291080932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:32:49 2024","interfaces":[{"interface":"back","average":{"1min":1.4870000000000001,"5min":1.7709999999999999,"15min":2.012},"min":{"1min":0.28999999999999998,"5min":0.222,"15min":0.19400000000000001},"max":{"1min":6.4420000000000002,"5min":7.9909999999999997,"15min":30.509},"last":0.24299999999999999},{"interface":"front","average":{"1min":1.603,"5min":1.516,"15min":1.732},"min":{"1min":0.377,"5min":0.245,"15min":0.21099999999999999},"max":{"1min":7.375,"5min":7.673,"15min":36.090000000000003},"last":1.9410000000000001}]},{"osd":1,"last update":"Sat Feb 10 08:32:49 2024","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.784,"15min":1.5580000000000001},"min":{"1min":0.28599999999999998,"5min":0.223,"15min":0.20899999999999999},"max":{"1min":4.8099999999999996,"5min":6.3780000000000001,"15min":12.938000000000001},"last":0.26300000000000001},{"interface":"front","average":{"1min":1.7090000000000001,"5min":1.9630000000000001,"15min":1.6899999999999999},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":7.2990000000000004,"5min":9.8829999999999991,"15min":10.441000000000001},"last":0.54300000000000004}]},{"osd":2,"last update":"Sat Feb 10 08:32:49 2024","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":2.0369999999999999,"15min":1.9019999999999999},"min":{"1min":0.33200000000000002,"5min":0.25900000000000001,"15min":0.24399999999999999},"max":{"1min":6,"5min":25.146999999999998,"15min":35.072000000000003},"last":0.57199999999999995},{"interface":"front","average":{"1min":1.5840000000000001,"5min":1.7170000000000001,"15min":1.768},"min":{"1min":0.34999999999999998,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":10.837999999999999,"5min":25.135999999999999,"15min":35.103000000000002},"last":0.249}]},{"osd":3,"last update":"Sat Feb 10 08:32:49 2024","interfaces":[{"interface":"back","average":{"1min":1.7789999999999999,"5min":1.9990000000000001,"15min":1.73},"min":{"1min":0.32700000000000001,"5min":0.32400000000000001,"15min":0.26600000000000001},"max":{"1min":8.2780000000000005,"5min":8.2780000000000005,"15min":15.212999999999999},"last":2.165},{"interface":"front","average":{"1min":1.548,"5min":1.9179999999999999,"15min":1.7509999999999999},"min":{"1min":0.29399999999999998,"5min":0.26300000000000001,"15min":0.253},"max":{"1min":7.3300000000000001,"5min":8.9410000000000007,"15min":17.797000000000001},"last":0.59199999999999997}]},{"osd":4,"last update":"Sat Feb 10 08:32:10 2024","interfaces":[{"interface":"back","average":{"1min":2.3660000000000001,"5min":1.5940000000000001,"15min":1.022},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":7.5860000000000003,"5min":7.5860000000000003,"15min":9.3879999999999999},"last":0.27400000000000002},{"interface":"front","average":{"1min":1.8089999999999999,"5min":1.821,"15min":1.133},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.22600000000000001},"max":{"1min":8.3140000000000001,"5min":8.3140000000000001,"15min":10.348000000000001},"last":0.28399999999999997}]},{"osd":5,"last update":"Sat Feb 10 08:32:49 2024","interfaces":[{"interface":"back","average":{"1min":2.4100000000000001,"5min":2.2349999999999999,"15min":1.3300000000000001},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.20200000000000001},"max":{"1min":10.300000000000001,"5min":29.631,"15min":29.631},"last":1.23},{"interface":"front","average":{"1min":1.1890000000000001,"5min":2.1139999999999999,"15min":1.288},"min":{"1min":0.29699999999999999,"5min":0.23699999999999999,"15min":0.22900000000000001},"max":{"1min":8.3369999999999997,"5min":29.419,"15min":29.419},"last":0.41999999999999998}]},{"osd":7,"last update":"Sat Feb 10 08:32:10 2024","interfaces":[{"interface":"back","average":{"1min":2.7440000000000002,"5min":2.1280000000000001,"15min":1.8899999999999999},"min":{"1min":0.30599999999999999,"5min":0.29299999999999998,"15min":0.23999999999999999},"max":{"1min":7.0259999999999998,"5min":13.298999999999999,"15min":194.88900000000001},"last":2.1000000000000001},{"interface":"front","average":{"1min":3.089,"5min":2.3109999999999999,"15min":2.0219999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.26400000000000001},"max":{"1min":14.128,"5min":14.128,"15min":194.74100000000001},"last":2.1269999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575075,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1132424,"kb_used_data":534528,"kb_used_omap":0,"kb_used_meta":597888,"kb_avail":92612728,"statfs":{"total":95995035648,"available":94835433472,"internally_reserved":0,"allocated":547356672,"data_stored":546788599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":612237312},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:32:49 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":1.603,"15min":1.972},"min":{"1min":0.215,"5min":0.186,"15min":0.17100000000000001},"max":{"1min":3.8010000000000002,"5min":19.263000000000002,"15min":29.763999999999999},"last":1.6970000000000001},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.516,"15min":2.109},"min":{"1min":0.20799999999999999,"5min":0.20100000000000001,"15min":0.17899999999999999},"max":{"1min":9.3290000000000006,"5min":9.5289999999999999,"15min":29.637},"last":2.355}]},{"osd":2,"last update":"Sat Feb 10 08:32:17 2024","interfaces":[{"interface":"back","average":{"1min":2.5259999999999998,"5min":1.774,"15min":2.1309999999999998},"min":{"1min":0.24399999999999999,"5min":0.22,"15min":0.21199999999999999},"max":{"1min":9.3610000000000007,"5min":15.347,"15min":31.420999999999999},"last":2.3319999999999999},{"interface":"front","average":{"1min":1.9159999999999999,"5min":1.754,"15min":2.3069999999999999},"min":{"1min":0.23400000000000001,"5min":0.184,"15min":0.184},"max":{"1min":7.2679999999999998,"5min":16.344000000000001,"15min":31.484999999999999},"last":2.6869999999999998}]},{"osd":3,"last update":"Sat Feb 10 08:32:42 2024","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.7150000000000001,"15min":2.2719999999999998},"min":{"1min":0.30399999999999999,"5min":0.253,"15min":0.247},"max":{"1min":4.8150000000000004,"5min":12.228999999999999,"15min":28.082000000000001},"last":2.6480000000000001},{"interface":"front","average":{"1min":1.4430000000000001,"5min":1.7989999999999999,"15min":1.952},"min":{"1min":0.25600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":6.9450000000000003,"5min":19.303999999999998,"15min":29.722000000000001},"last":0.25900000000000001}]},{"osd":4,"last update":"Sat Feb 10 08:32:06 2024","interfaces":[{"interface":"back","average":{"1min":2.2480000000000002,"5min":1.8180000000000001,"15min":2.0449999999999999},"min":{"1min":0.29499999999999998,"5min":0.29099999999999998,"15min":0.26100000000000001},"max":{"1min":13.515000000000001,"5min":13.515000000000001,"15min":14.086},"last":2.2970000000000002},{"interface":"front","average":{"1min":2.3580000000000001,"5min":1.8759999999999999,"15min":2.3889999999999998},"min":{"1min":0.34200000000000003,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":8.0289999999999999,"5min":9.0969999999999995,"15min":31.515000000000001},"last":2.1110000000000002}]},{"osd":5,"last update":"Sat Feb 10 08:32:17 2024","interfaces":[{"interface":"back","average":{"1min":2.2490000000000001,"5min":2.1019999999999999,"15min":1.9670000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.26000000000000001},"max":{"1min":10.605,"5min":21.751000000000001,"15min":40.140999999999998},"last":2.3780000000000001},{"interface":"front","average":{"1min":2.3730000000000002,"5min":2.2629999999999999,"15min":2.2290000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.28499999999999998},"max":{"1min":6.5810000000000004,"5min":16.324000000000002,"15min":40.831000000000003},"last":4.0469999999999997}]},{"osd":6,"last update":"Sat Feb 10 08:32:49 2024","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.7709999999999999,"15min":1.9199999999999999},"min":{"1min":0.37,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":3.359,"5min":9.1259999999999994,"15min":31.27},"last":2.1389999999999998},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.667,"15min":1.5760000000000001},"min":{"1min":0.35299999999999998,"5min":0.309,"15min":0.27700000000000002},"max":{"1min":3.742,"5min":6.8700000000000001,"15min":10.433},"last":0.29499999999999998}]},{"osd":7,"last update":"Sat Feb 10 08:32:17 2024","interfaces":[{"interface":"back","average":{"1min":3.5070000000000001,"5min":2.1349999999999998,"15min":2.008},"min":{"1min":0.436,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":19.692,"5min":19.692,"15min":31.344999999999999},"last":2.169},{"interface":"front","average":{"1min":3.3919999999999999,"5min":2.0920000000000001,"15min":1.661},"min":{"1min":0.377,"5min":0.34200000000000003,"15min":0.312},"max":{"1min":15.91,"5min":15.91,"15min":15.91},"last":0.32500000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738600,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2128076,"kb_used_data":1830852,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":91617076,"statfs":{"total":95995035648,"available":93815885824,"internally_reserved":0,"allocated":1874792448,"data_stored":1874220730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 10 08:32:56 2024","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.617,"15min":2.5019999999999998},"min":{"1min":0.217,"5min":0.16300000000000001,"15min":0.14399999999999999},"max":{"1min":5.5270000000000001,"5min":11.058,"15min":102.48099999999999},"last":0.182},{"interface":"front","average":{"1min":1.214,"5min":1.7350000000000001,"15min":2.3650000000000002},"min":{"1min":0.25700000000000001,"5min":0.20300000000000001,"15min":0.193},"max":{"1min":7.9509999999999996,"5min":11.367000000000001,"15min":103.38800000000001},"last":0.216}]},{"osd":2,"last update":"Sat Feb 10 08:32:15 2024","interfaces":[{"interface":"back","average":{"1min":3.4540000000000002,"5min":2.5059999999999998,"15min":2.7959999999999998},"min":{"1min":0.25700000000000001,"5min":0.192,"15min":0.192},"max":{"1min":12.276,"5min":21.331,"15min":102.462},"last":0.19700000000000001},{"interface":"front","average":{"1min":1.4550000000000001,"5min":1.599,"15min":2.395},"min":{"1min":0.216,"5min":0.216,"15min":0.20799999999999999},"max":{"1min":5.5490000000000004,"5min":6.1870000000000003,"15min":102.66500000000001},"last":0.26800000000000002}]},{"osd":3,"last update":"Sat Feb 10 08:32:39 2024","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.577,"15min":2.0640000000000001},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.22600000000000001},"max":{"1min":8.0399999999999991,"5min":8.4849999999999994,"15min":16.495000000000001},"last":0.34999999999999998},{"interface":"front","average":{"1min":2.9049999999999998,"5min":1.948,"15min":2.6669999999999998},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.222},"max":{"1min":9.1449999999999996,"5min":10.56,"15min":102.64400000000001},"last":0.245}]},{"osd":4,"last update":"Sat Feb 10 08:33:05 2024","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.7829999999999999,"15min":2.794},"min":{"1min":0.38300000000000001,"5min":0.26000000000000001,"15min":0.253},"max":{"1min":4.3140000000000001,"5min":10.596,"15min":102.742},"last":0.80900000000000005},{"interface":"front","average":{"1min":1.143,"5min":1.4039999999999999,"15min":1.716},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.26200000000000001},"max":{"1min":6.5830000000000002,"5min":6.5830000000000002,"15min":16.352},"last":0.44600000000000001}]},{"osd":5,"last update":"Sat Feb 10 08:32:31 2024","interfaces":[{"interface":"back","average":{"1min":2.6080000000000001,"5min":1.919,"15min":2.101},"min":{"1min":0.36499999999999999,"5min":0.34499999999999997,"15min":0.31900000000000001},"max":{"1min":17.321000000000002,"5min":17.321000000000002,"15min":102.53100000000001},"last":2.3780000000000001},{"interface":"front","average":{"1min":1.794,"5min":1.79,"15min":1.6639999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.22500000000000001},"max":{"1min":6.4390000000000001,"5min":9.7360000000000007,"15min":16.463999999999999},"last":0.82299999999999995}]},{"osd":6,"last update":"Sat Feb 10 08:32:56 2024","interfaces":[{"interface":"back","average":{"1min":1.7989999999999999,"5min":1.7430000000000001,"15min":2.125},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.28599999999999998},"max":{"1min":7.0149999999999997,"5min":7.5810000000000004,"15min":102.583},"last":0.61699999999999999},{"interface":"front","average":{"1min":1.6319999999999999,"5min":1.6359999999999999,"15min":1.615},"min":{"1min":0.37,"5min":0.37,"15min":0.308},"max":{"1min":6.3979999999999997,"5min":9.0259999999999998,"15min":16.391999999999999},"last":0.623}]},{"osd":7,"last update":"Sat Feb 10 08:32:15 2024","interfaces":[{"interface":"back","average":{"1min":1.9059999999999999,"5min":1.819,"15min":2.8929999999999998},"min":{"1min":0.39300000000000002,"5min":0.36299999999999999,"15min":0.34100000000000003},"max":{"1min":6.4889999999999999,"5min":6.6130000000000004,"15min":255.53200000000001},"last":0.39900000000000002},{"interface":"front","average":{"1min":2.1360000000000001,"5min":1.8129999999999999,"15min":2.4079999999999999},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.28599999999999998},"max":{"1min":9.0719999999999992,"5min":9.0719999999999992,"15min":254.88800000000001},"last":0.41899999999999998}]}]},{"osd":2,"up_from":18,"seq":77309411551,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1693564,"kb_used_data":1103860,"kb_used_omap":0,"kb_used_meta":589696,"kb_avail":92051588,"statfs":{"total":95995035648,"available":94260826112,"internally_reserved":0,"allocated":1130352640,"data_stored":1129796687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":603848704},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":1.022,"15min":1.7110000000000001},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.17399999999999999},"max":{"1min":4.202,"5min":6.1369999999999996,"15min":24.859999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":2.8559999999999999,"5min":1.962,"15min":2.3500000000000001},"min":{"1min":0.252,"5min":0.20499999999999999,"15min":0.193},"max":{"1min":15.15,"5min":15.15,"15min":28.295999999999999},"last":1.2010000000000001}]},{"osd":1,"last update":"Sat Feb 10 08:32:20 2024","interfaces":[{"interface":"back","average":{"1min":2.1899999999999999,"5min":1.9099999999999999,"15min":1.861},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.19700000000000001},"max":{"1min":7.7169999999999996,"5min":13.622,"15min":15.644},"last":1.425},{"interface":"front","average":{"1min":0.91700000000000004,"5min":1.0169999999999999,"15min":1.3480000000000001},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":4.2389999999999999,"5min":5.9000000000000004,"15min":16.968},"last":3.3330000000000002}]},{"osd":3,"last update":"Sat Feb 10 08:32:42 2024","interfaces":[{"interface":"back","average":{"1min":1.899,"5min":1.4910000000000001,"15min":1.952},"min":{"1min":0.29299999999999998,"5min":0.26300000000000001,"15min":0.23300000000000001},"max":{"1min":8.6679999999999993,"5min":8.6679999999999993,"15min":24.946000000000002},"last":1.2949999999999999},{"interface":"front","average":{"1min":1.036,"5min":1.228,"15min":2.0289999999999999},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":4.8449999999999998,"5min":6.3310000000000004,"15min":24.905000000000001},"last":3.4180000000000001}]},{"osd":4,"last update":"Sat Feb 10 08:33:02 2024","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.631,"15min":1.962},"min":{"1min":0.36899999999999999,"5min":0.30099999999999999,"15min":0.27400000000000002},"max":{"1min":5.6310000000000002,"5min":10.573,"15min":13.260999999999999},"last":1.829},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.1439999999999999,"15min":1.3009999999999999},"min":{"1min":0.38700000000000001,"5min":0.29699999999999999,"15min":0.25700000000000001},"max":{"1min":2.911,"5min":3.8420000000000001,"15min":15.696},"last":3.3759999999999999}]},{"osd":5,"last update":"Sat Feb 10 08:32:26 2024","interfaces":[{"interface":"back","average":{"1min":3.0840000000000001,"5min":2.2650000000000001,"15min":1.885},"min":{"1min":0.41599999999999998,"5min":0.29899999999999999,"15min":0.26600000000000001},"max":{"1min":13.201000000000001,"5min":13.201000000000001,"15min":13.939},"last":1.734},{"interface":"front","average":{"1min":2.6190000000000002,"5min":2.0750000000000002,"15min":1.7490000000000001},"min":{"1min":0.34399999999999997,"5min":0.29199999999999998,"15min":0.28599999999999998},"max":{"1min":9.5030000000000001,"5min":9.5709999999999997,"15min":13.317},"last":2.4750000000000001}]},{"osd":6,"last update":"Sat Feb 10 08:33:01 2024","interfaces":[{"interface":"back","average":{"1min":2.0009999999999999,"5min":1.855,"15min":1.8859999999999999},"min":{"1min":0.41699999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":13.233000000000001,"5min":13.233000000000001,"15min":38.177999999999997},"last":1.3260000000000001},{"interface":"front","average":{"1min":1.5509999999999999,"5min":1.8740000000000001,"15min":1.9139999999999999},"min":{"1min":0.39000000000000001,"5min":0.32200000000000001,"15min":0.29099999999999998},"max":{"1min":9.0879999999999992,"5min":13.567,"15min":37.682000000000002},"last":1.5529999999999999}]},{"osd":7,"last update":"Sat Feb 10 08:32:20 2024","interfaces":[{"interface":"back","average":{"1min":2.915,"5min":1.95,"15min":1.7410000000000001},"min":{"1min":0.45500000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":9.6869999999999994,"5min":9.6869999999999994,"15min":13.231999999999999},"last":2.6269999999999998},{"interface":"front","average":{"1min":1.5429999999999999,"5min":1.6319999999999999,"15min":1.353},"min":{"1min":0.374,"5min":0.30399999999999999,"15min":0.29199999999999998},"max":{"1min":8.1110000000000007,"5min":8.1110000000000007,"15min":15.714},"last":3.4009999999999998}]}]},{"osd":3,"up_from":25,"seq":107374182618,"num_pgs":62,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1495948,"kb_used_data":898052,"kb_used_omap":0,"kb_used_meta":597888,"kb_avail":92249204,"statfs":{"total":95995035648,"available":94463184896,"internally_reserved":0,"allocated":919605248,"data_stored":919032662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":612237312},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:32:38 2024","interfaces":[{"interface":"back","average":{"1min":1.4890000000000001,"5min":1.5449999999999999,"15min":1.8100000000000001},"min":{"1min":0.20399999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":10.795,"5min":10.795,"15min":14.167},"last":0.46500000000000002},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.585,"15min":1.776},"min":{"1min":0.222,"5min":0.184,"15min":0.184},"max":{"1min":5.5369999999999999,"5min":16.155000000000001,"15min":26.643000000000001},"last":0.67700000000000005}]},{"osd":1,"last update":"Sat Feb 10 08:32:38 2024","interfaces":[{"interface":"back","average":{"1min":2.3690000000000002,"5min":1.964,"15min":1.9059999999999999},"min":{"1min":0.23699999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":13.371,"5min":13.371,"15min":13.371},"last":0.498},{"interface":"front","average":{"1min":2.677,"5min":2.02,"15min":2.1429999999999998},"min":{"1min":0.27900000000000003,"5min":0.20599999999999999,"15min":0.191},"max":{"1min":10.67,"5min":19.344000000000001,"15min":21.373999999999999},"last":1.2829999999999999}]},{"osd":2,"last update":"Sat Feb 10 08:32:38 2024","interfaces":[{"interface":"back","average":{"1min":1.754,"5min":1.821,"15min":2.0259999999999998},"min":{"1min":0.27600000000000002,"5min":0.214,"15min":0.214},"max":{"1min":7.5369999999999999,"5min":14.631,"15min":21.434000000000001},"last":2.819},{"interface":"front","average":{"1min":1.784,"5min":1.3999999999999999,"15min":1.75},"min":{"1min":0.30099999999999999,"5min":0.23400000000000001,"15min":0.215},"max":{"1min":12.289,"5min":12.289,"15min":18.061},"last":0.374}]},{"osd":4,"last update":"Sat Feb 10 08:32:11 2024","interfaces":[{"interface":"back","average":{"1min":2.093,"5min":1.5740000000000001,"15min":1.6970000000000001},"min":{"1min":0.35799999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":6.6299999999999999,"5min":8.8379999999999992,"15min":12.272},"last":0.43099999999999999},{"interface":"front","average":{"1min":1.786,"5min":1.77,"15min":2.1339999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":10.754,"5min":10.754,"15min":12.391999999999999},"last":0.70499999999999996}]},{"osd":5,"last update":"Sat Feb 10 08:32:33 2024","interfaces":[{"interface":"back","average":{"1min":3.2919999999999998,"5min":2.1680000000000001,"15min":1.5940000000000001},"min":{"1min":0.39400000000000002,"5min":0.316,"15min":0.249},"max":{"1min":19.832000000000001,"5min":19.832000000000001,"15min":19.832000000000001},"last":0.40200000000000002},{"interface":"front","average":{"1min":3.0739999999999998,"5min":2.077,"15min":1.8180000000000001},"min":{"1min":0.30099999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":19.712,"5min":19.712,"15min":19.712},"last":0.76900000000000002}]},{"osd":6,"last update":"Sat Feb 10 08:32:53 2024","interfaces":[{"interface":"back","average":{"1min":1.331,"5min":1.8149999999999999,"15min":1.7509999999999999},"min":{"1min":0.38100000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":6.7699999999999996,"5min":16.423999999999999,"15min":16.423999999999999},"last":2.6360000000000001},{"interface":"front","average":{"1min":0.876,"5min":1.8540000000000001,"15min":1.5349999999999999},"min":{"1min":0.40000000000000002,"5min":0.35099999999999998,"15min":0.28499999999999998},"max":{"1min":2.7210000000000001,"5min":9.7010000000000005,"15min":12.324999999999999},"last":2.3420000000000001}]},{"osd":7,"last update":"Sat Feb 10 08:32:11 2024","interfaces":[{"interface":"back","average":{"1min":2.302,"5min":1.8500000000000001,"15min":1.536},"min":{"1min":0.33500000000000002,"5min":0.33400000000000002,"15min":0.28299999999999997},"max":{"1min":5.8869999999999996,"5min":8.9109999999999996,"15min":12.358000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":1.8460000000000001,"5min":1.964,"15min":1.8149999999999999},"min":{"1min":0.41799999999999998,"5min":0.33000000000000002,"15min":0.26500000000000001},"max":{"1min":4.7610000000000001,"5min":14.587,"15min":15.702},"last":1.3200000000000001}]}]},{"osd":4,"up_from":110,"seq":472446402710,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1858816,"kb_used_data":1548664,"kb_used_omap":0,"kb_used_meta":310143,"kb_avail":91886336,"statfs":{"total":95995035648,"available":94091608064,"internally_reserved":0,"allocated":1585831936,"data_stored":1585271306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":972,"internal_metadata":317586484},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:32:22 2024","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":1.327,"15min":1.339},"min":{"1min":0.223,"5min":0.21199999999999999,"15min":0.19800000000000001},"max":{"1min":2.5489999999999999,"5min":14.595000000000001,"15min":14.595000000000001},"last":3.2559999999999998},{"interface":"front","average":{"1min":1.8380000000000001,"5min":1.895,"15min":2.4449999999999998},"min":{"1min":0.27700000000000002,"5min":0.22600000000000001,"15min":0.222},"max":{"1min":8.0820000000000007,"5min":14.446999999999999,"15min":16.524000000000001},"last":0.34799999999999998}]},{"osd":1,"last update":"Sat Feb 10 08:32:22 2024","interfaces":[{"interface":"back","average":{"1min":2.6440000000000001,"5min":2.1960000000000002,"15min":2.0449999999999999},"min":{"1min":0.44800000000000001,"5min":0.218,"15min":0.218},"max":{"1min":8.2149999999999999,"5min":38.621000000000002,"15min":38.621000000000002},"last":0.27000000000000002},{"interface":"front","average":{"1min":1.5429999999999999,"5min":2.0899999999999999,"15min":1.911},"min":{"1min":0.35499999999999998,"5min":0.217,"15min":0.217},"max":{"1min":5.2530000000000001,"5min":38.430999999999997,"15min":38.430999999999997},"last":2.742}]},{"osd":2,"last update":"Sat Feb 10 08:32:22 2024","interfaces":[{"interface":"back","average":{"1min":2.1070000000000002,"5min":2.0760000000000001,"15min":1.988},"min":{"1min":0.249,"5min":0.246,"15min":0.218},"max":{"1min":10.608000000000001,"5min":14.414,"15min":14.414},"last":0.36599999999999999},{"interface":"front","average":{"1min":2.6299999999999999,"5min":1.7130000000000001,"15min":1.8839999999999999},"min":{"1min":0.30499999999999999,"5min":0.247,"15min":0.247},"max":{"1min":11.958,"5min":11.958,"15min":11.958},"last":0.30199999999999999}]},{"osd":3,"last update":"Sat Feb 10 08:32:22 2024","interfaces":[{"interface":"back","average":{"1min":2.0430000000000001,"5min":1.8919999999999999,"15min":2.0179999999999998},"min":{"1min":0.39000000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":6.0140000000000002,"5min":14.358000000000001,"15min":14.358000000000001},"last":1.8879999999999999},{"interface":"front","average":{"1min":2.5960000000000001,"5min":1.9470000000000001,"15min":1.778},"min":{"1min":0.34300000000000003,"5min":0.249,"15min":0.249},"max":{"1min":8.3360000000000003,"5min":8.3360000000000003,"15min":11.648},"last":0.41399999999999998}]},{"osd":5,"last update":"Sat Feb 10 08:32:22 2024","interfaces":[{"interface":"back","average":{"1min":1.569,"5min":1.5580000000000001,"15min":1.1040000000000001},"min":{"1min":0.26400000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":9.4550000000000001,"5min":20.355,"15min":41.488},"last":1.5269999999999999},{"interface":"front","average":{"1min":1.5700000000000001,"5min":1.7130000000000001,"15min":1.347},"min":{"1min":0.30099999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":8.2799999999999994,"5min":16.350000000000001,"15min":42.527999999999999},"last":0.56599999999999995}]},{"osd":6,"last update":"Sat Feb 10 08:32:22 2024","interfaces":[{"interface":"back","average":{"1min":2.1400000000000001,"5min":1.522,"15min":1.2190000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.26400000000000001},"max":{"1min":8.2910000000000004,"5min":8.2910000000000004,"15min":39.554000000000002},"last":0.32200000000000001},{"interface":"front","average":{"1min":2.1400000000000001,"5min":1.6160000000000001,"15min":1.2729999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":8.2539999999999996,"5min":11.342000000000001,"15min":41.741999999999997},"last":0.53500000000000003}]},{"osd":7,"last update":"Sat Feb 10 08:32:22 2024","interfaces":[{"interface":"back","average":{"1min":2.2240000000000002,"5min":1.7270000000000001,"15min":1.238},"min":{"1min":0.34799999999999998,"5min":0.29199999999999998,"15min":0.28899999999999998},"max":{"1min":8.6289999999999996,"5min":8.6289999999999996,"15min":11.047000000000001},"last":0.39400000000000002},{"interface":"front","average":{"1min":1.585,"5min":1.8160000000000001,"15min":1.0649999999999999},"min":{"1min":0.30199999999999999,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":6.2519999999999998,"5min":16.245999999999999,"15min":16.245999999999999},"last":1.5600000000000001}]}]},{"osd":5,"up_from":37,"seq":158913790161,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1489840,"kb_used_data":896040,"kb_used_omap":0,"kb_used_meta":593792,"kb_avail":92255312,"statfs":{"total":95995035648,"available":94469439488,"internally_reserved":0,"allocated":917544960,"data_stored":917000617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":608043008},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:32:27 2024","interfaces":[{"interface":"back","average":{"1min":1.4450000000000001,"5min":1.399,"15min":1.611},"min":{"1min":0.218,"5min":0.218,"15min":0.20499999999999999},"max":{"1min":7.5300000000000002,"5min":10.789,"15min":22.914000000000001},"last":0.311},{"interface":"front","average":{"1min":2.0880000000000001,"5min":1.5780000000000001,"15min":1.51},"min":{"1min":0.22900000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":13.738,"5min":13.738,"15min":23.161000000000001},"last":3.4289999999999998}]},{"osd":1,"last update":"Sat Feb 10 08:32:27 2024","interfaces":[{"interface":"back","average":{"1min":1.77,"5min":1.738,"15min":1.3999999999999999},"min":{"1min":0.249,"5min":0.222,"15min":0.19500000000000001},"max":{"1min":8.359,"5min":8.359,"15min":8.359},"last":0.34200000000000003},{"interface":"front","average":{"1min":1.304,"5min":1.276,"15min":1.29},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.254},"max":{"1min":3.7810000000000001,"5min":8.6899999999999995,"15min":9.0579999999999998},"last":3.4620000000000002}]},{"osd":2,"last update":"Sat Feb 10 08:32:27 2024","interfaces":[{"interface":"back","average":{"1min":1.6899999999999999,"5min":1.6499999999999999,"15min":1.5920000000000001},"min":{"1min":0.33100000000000002,"5min":0.248,"15min":0.24099999999999999},"max":{"1min":7.9829999999999997,"5min":20.254999999999999,"15min":20.254999999999999},"last":6.1609999999999996},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.6579999999999999,"15min":1.4630000000000001},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.26400000000000001},"max":{"1min":5.0789999999999997,"5min":6.3929999999999998,"15min":9.2810000000000006},"last":0.40400000000000003}]},{"osd":3,"last update":"Sat Feb 10 08:32:27 2024","interfaces":[{"interface":"back","average":{"1min":1.6100000000000001,"5min":1.3460000000000001,"15min":1.341},"min":{"1min":0.29399999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":8.0079999999999991,"5min":8.0079999999999991,"15min":24.198},"last":6.2320000000000002},{"interface":"front","average":{"1min":1.8089999999999999,"5min":1.649,"15min":1.605},"min":{"1min":0.375,"5min":0.27300000000000002,"15min":0.25900000000000001},"max":{"1min":9.7100000000000009,"5min":10.766,"15min":22.701000000000001},"last":0.38300000000000001}]},{"osd":4,"last update":"Sat Feb 10 08:32:08 2024","interfaces":[{"interface":"back","average":{"1min":2.165,"5min":1.3819999999999999,"15min":1},"min":{"1min":0.254,"5min":0.24099999999999999,"15min":0.23599999999999999},"max":{"1min":7.923,"5min":7.923,"15min":7.923},"last":6.3120000000000003},{"interface":"front","average":{"1min":1.988,"5min":1.7270000000000001,"15min":1.083},"min":{"1min":0.28199999999999997,"5min":0.26000000000000001,"15min":0.22500000000000001},"max":{"1min":9.0009999999999994,"5min":12.948,"15min":12.948},"last":0.73399999999999999}]},{"osd":6,"last update":"Sat Feb 10 08:32:49 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":1.1100000000000001,"15min":0.97999999999999998},"min":{"1min":0.30599999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":3.4329999999999998,"5min":6.3959999999999999,"15min":8.3559999999999999},"last":7.0259999999999998},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.2749999999999999,"15min":1.0089999999999999},"min":{"1min":0.41799999999999998,"5min":0.29299999999999998,"15min":0.23999999999999999},"max":{"1min":3.3719999999999999,"5min":7.875,"15min":7.875},"last":6.8499999999999996}]},{"osd":7,"last update":"Sat Feb 10 08:32:21 2024","interfaces":[{"interface":"back","average":{"1min":2.3010000000000002,"5min":1.359,"15min":2.161},"min":{"1min":0.313,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":7.952,"5min":7.952,"15min":371.87400000000002},"last":6.2779999999999996},{"interface":"front","average":{"1min":1.409,"5min":1.657,"15min":2.367},"min":{"1min":0.35799999999999998,"5min":0.32000000000000001,"15min":0.23499999999999999},"max":{"1min":3.8679999999999999,"5min":12.984999999999999,"15min":372.63099999999997},"last":2.9510000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1915551744,"data_stored":1915551744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":565837824,"data_stored":565837824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1143472128,"data_stored":1143472128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":948568064,"data_stored":948568064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1623392256,"data_stored":1623392256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":943128576,"data_stored":943128576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1312358400,"data_stored":1312358400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":759431168,"data_stored":759431168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-10T08:33:15.669 INFO:tasks.cephadm.ceph_manager.ceph:recovered! 2024-02-10T08:33:15.669 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-10T08:33:15.670 INFO:tasks.thrashosds.thrasher:Shrinking pool unique_pool_3 2024-02-10T08:33:15.670 INFO:tasks.cephadm.ceph_manager.ceph:contract_pool unique_pool_3 by 10 min 8 2024-02-10T08:33:15.670 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph pg dump --format=json 2024-02-10T08:33:15.716 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 29 16 57525 57509 123.887 85.3125 0.00945978 0.00806663 2024-02-10T08:33:16.006 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.1 dump_historic_ops 2024-02-10T08:33:16.062 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:33:16.065 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:16.065 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:33:16.103 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:33:16.143 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:33:16.166 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:33:16.227 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:14.962482+0000 mgr.y (mgr.14505) 620 : cluster [DBG] pgmap v769: 168 pgs: 168 active+clean; 3.2 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 1.1 KiB/s rd, 99 MiB/s wr, 1.58k op/s 2024-02-10T08:33:16.227 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:15.408508+0000 osd.7 (osd.7) 199 : cluster [DBG] 6.3 scrub starts 2024-02-10T08:33:16.227 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:15.455331+0000 osd.7 (osd.7) 200 : cluster [DBG] 6.3 scrub ok 2024-02-10T08:33:16.227 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:15.836488+0000 mon.a (mon.0) 1534 : cluster [DBG] osdmap e352: 8 total, 8 up, 8 in 2024-02-10T08:33:16.227 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:15.869324+0000 osd.1 (osd.1) 200 : cluster [DBG] 6.1 scrub starts 2024-02-10T08:33:16.227 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:15.884735+0000 osd.1 (osd.1) 201 : cluster [DBG] 6.1 scrub ok 2024-02-10T08:33:16.227 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:14.962482+0000 mgr.y (mgr.14505) 620 : cluster [DBG] pgmap v769: 168 pgs: 168 active+clean; 3.2 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 1.1 KiB/s rd, 99 MiB/s wr, 1.58k op/s 2024-02-10T08:33:16.227 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:15.408508+0000 osd.7 (osd.7) 199 : cluster [DBG] 6.3 scrub starts 2024-02-10T08:33:16.228 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:15.455331+0000 osd.7 (osd.7) 200 : cluster [DBG] 6.3 scrub ok 2024-02-10T08:33:16.228 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:15.836488+0000 mon.a (mon.0) 1534 : cluster [DBG] osdmap e352: 8 total, 8 up, 8 in 2024-02-10T08:33:16.228 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:15.869324+0000 osd.1 (osd.1) 200 : cluster [DBG] 6.1 scrub starts 2024-02-10T08:33:16.228 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:15.884735+0000 osd.1 (osd.1) 201 : cluster [DBG] 6.1 scrub ok 2024-02-10T08:33:16.235 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:16.339 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:33:16.343 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:16.343 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:33:16.444 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:33:16.502 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:16.516 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:14.962482+0000 mgr.y (mgr.14505) 620 : cluster [DBG] pgmap v769: 168 pgs: 168 active+clean; 3.2 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 1.1 KiB/s rd, 99 MiB/s wr, 1.58k op/s 2024-02-10T08:33:16.516 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:15.408508+0000 osd.7 (osd.7) 199 : cluster [DBG] 6.3 scrub starts 2024-02-10T08:33:16.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:15.455331+0000 osd.7 (osd.7) 200 : cluster [DBG] 6.3 scrub ok 2024-02-10T08:33:16.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:15.836488+0000 mon.a (mon.0) 1534 : cluster [DBG] osdmap e352: 8 total, 8 up, 8 in 2024-02-10T08:33:16.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:15.869324+0000 osd.1 (osd.1) 200 : cluster [DBG] 6.1 scrub starts 2024-02-10T08:33:16.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:15.884735+0000 osd.1 (osd.1) 201 : cluster [DBG] 6.1 scrub ok 2024-02-10T08:33:16.517 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:33:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:33:16] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:33:16.717 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 30 16 58672 58656 122.148 71.6875 0.0120193 0.00818209 2024-02-10T08:33:16.720 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:33:16.725 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:16.725 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:33:16.826 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:33:16.889 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:16.975 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:33:16.976 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:16.977 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:33:17.077 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-10T08:33:17.078 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:33:17.119 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:17.154 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:33:17.160 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:17.160 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:33:17.261 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:33:17.306 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:17.340 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:33:17.344 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:17.345 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:33:17.350 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:15.697052+0000 osd.0 (osd.0) 175 : cluster [DBG] 4.3 scrub starts 2024-02-10T08:33:17.350 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:15.706959+0000 osd.0 (osd.0) 176 : cluster [DBG] 4.3 scrub ok 2024-02-10T08:33:17.350 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:15.949250+0000 osd.5 (osd.5) 201 : cluster [DBG] 2.2 scrub starts 2024-02-10T08:33:17.350 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:15.952574+0000 osd.5 (osd.5) 202 : cluster [DBG] 2.2 scrub ok 2024-02-10T08:33:17.350 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:16.200979+0000 osd.6 (osd.6) 174 : cluster [DBG] 2.14 scrub starts 2024-02-10T08:33:17.350 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:16.205597+0000 osd.6 (osd.6) 175 : cluster [DBG] 2.14 scrub ok 2024-02-10T08:33:17.350 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:16.821813+0000 osd.1 (osd.1) 202 : cluster [DBG] 2.6 scrub starts 2024-02-10T08:33:17.350 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:16.825359+0000 osd.1 (osd.1) 203 : cluster [DBG] 2.6 scrub ok 2024-02-10T08:33:17.351 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:33:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:33:17] "GET /metrics HTTP/1.1" 200 176409 "" "Prometheus/2.33.4" 2024-02-10T08:33:17.351 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:15.697052+0000 osd.0 (osd.0) 175 : cluster [DBG] 4.3 scrub starts 2024-02-10T08:33:17.351 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:15.706959+0000 osd.0 (osd.0) 176 : cluster [DBG] 4.3 scrub ok 2024-02-10T08:33:17.351 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:15.949250+0000 osd.5 (osd.5) 201 : cluster [DBG] 2.2 scrub starts 2024-02-10T08:33:17.351 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:15.952574+0000 osd.5 (osd.5) 202 : cluster [DBG] 2.2 scrub ok 2024-02-10T08:33:17.351 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:16.200979+0000 osd.6 (osd.6) 174 : cluster [DBG] 2.14 scrub starts 2024-02-10T08:33:17.351 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:16.205597+0000 osd.6 (osd.6) 175 : cluster [DBG] 2.14 scrub ok 2024-02-10T08:33:17.351 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:16.821813+0000 osd.1 (osd.1) 202 : cluster [DBG] 2.6 scrub starts 2024-02-10T08:33:17.352 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:16.825359+0000 osd.1 (osd.1) 203 : cluster [DBG] 2.6 scrub ok 2024-02-10T08:33:17.445 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:33:17.492 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:15.697052+0000 osd.0 (osd.0) 175 : cluster [DBG] 4.3 scrub starts 2024-02-10T08:33:17.492 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:15.706959+0000 osd.0 (osd.0) 176 : cluster [DBG] 4.3 scrub ok 2024-02-10T08:33:17.492 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:15.949250+0000 osd.5 (osd.5) 201 : cluster [DBG] 2.2 scrub starts 2024-02-10T08:33:17.492 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:15.952574+0000 osd.5 (osd.5) 202 : cluster [DBG] 2.2 scrub ok 2024-02-10T08:33:17.493 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:16.200979+0000 osd.6 (osd.6) 174 : cluster [DBG] 2.14 scrub starts 2024-02-10T08:33:17.493 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:16.205597+0000 osd.6 (osd.6) 175 : cluster [DBG] 2.14 scrub ok 2024-02-10T08:33:17.493 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:16.821813+0000 osd.1 (osd.1) 202 : cluster [DBG] 2.6 scrub starts 2024-02-10T08:33:17.493 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:16.825359+0000 osd.1 (osd.1) 203 : cluster [DBG] 2.6 scrub ok 2024-02-10T08:33:17.493 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:17.534 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:33:17.541 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:17.542 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:33:17.642 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:33:17.695 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:17.717 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 31 16 59872 59856 120.627 75 0.0131914 0.0082848 2024-02-10T08:33:17.732 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:33:17.739 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:17.740 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:33:17.840 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:33:17.898 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:17.925 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:33:17.932 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:17.932 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:33:18.033 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:33:18.089 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:18.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:16.962846+0000 mgr.y (mgr.14505) 621 : cluster [DBG] pgmap v771: 168 pgs: 168 active+clean; 3.3 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 639 B/s rd, 65 MiB/s wr, 1.04k op/s 2024-02-10T08:33:18.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:17.417335+0000 osd.7 (osd.7) 201 : cluster [DBG] 6.5 scrub starts 2024-02-10T08:33:18.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:17.442255+0000 osd.7 (osd.7) 202 : cluster [DBG] 6.5 scrub ok 2024-02-10T08:33:18.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:16.962846+0000 mgr.y (mgr.14505) 621 : cluster [DBG] pgmap v771: 168 pgs: 168 active+clean; 3.3 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 639 B/s rd, 65 MiB/s wr, 1.04k op/s 2024-02-10T08:33:18.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:17.417335+0000 osd.7 (osd.7) 201 : cluster [DBG] 6.5 scrub starts 2024-02-10T08:33:18.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:17.442255+0000 osd.7 (osd.7) 202 : cluster [DBG] 6.5 scrub ok 2024-02-10T08:33:18.524 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:16.962846+0000 mgr.y (mgr.14505) 621 : cluster [DBG] pgmap v771: 168 pgs: 168 active+clean; 3.3 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 639 B/s rd, 65 MiB/s wr, 1.04k op/s 2024-02-10T08:33:18.524 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:17.417335+0000 osd.7 (osd.7) 201 : cluster [DBG] 6.5 scrub starts 2024-02-10T08:33:18.524 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:17.442255+0000 osd.7 (osd.7) 202 : cluster [DBG] 6.5 scrub ok 2024-02-10T08:33:18.525 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:33:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:33:18.717 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 32 16 61222 61206 119.494 84.375 0.0124742 0.00836388 2024-02-10T08:33:19.028 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:33:19.035 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:19.035 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:33:19.136 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:33:19.191 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:19.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:17.687703+0000 osd.5 (osd.5) 203 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:33:19.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:17.687750+0000 osd.5 (osd.5) 204 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:33:19.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:17.742464+0000 osd.2 (osd.2) 161 : cluster [DBG] 6.2d scrub starts 2024-02-10T08:33:19.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:17.824024+0000 osd.2 (osd.2) 162 : cluster [DBG] 6.2d scrub ok 2024-02-10T08:33:19.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:18.153357+0000 mon.a (mon.0) 1535 : cluster [DBG] osdmap e353: 8 total, 8 up, 8 in 2024-02-10T08:33:19.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:17.687703+0000 osd.5 (osd.5) 203 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:33:19.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:17.687750+0000 osd.5 (osd.5) 204 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:33:19.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:17.742464+0000 osd.2 (osd.2) 161 : cluster [DBG] 6.2d scrub starts 2024-02-10T08:33:19.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:17.824024+0000 osd.2 (osd.2) 162 : cluster [DBG] 6.2d scrub ok 2024-02-10T08:33:19.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:18.153357+0000 mon.a (mon.0) 1535 : cluster [DBG] osdmap e353: 8 total, 8 up, 8 in 2024-02-10T08:33:19.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:17.687703+0000 osd.5 (osd.5) 203 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:33:19.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:17.687750+0000 osd.5 (osd.5) 204 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:33:19.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:17.742464+0000 osd.2 (osd.2) 161 : cluster [DBG] 6.2d scrub starts 2024-02-10T08:33:19.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:17.824024+0000 osd.2 (osd.2) 162 : cluster [DBG] 6.2d scrub ok 2024-02-10T08:33:19.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:18.153357+0000 mon.a (mon.0) 1535 : cluster [DBG] osdmap e353: 8 total, 8 up, 8 in 2024-02-10T08:33:19.717 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 33 16 62580 62564 118.445 84.875 0.00951583 0.00843763 2024-02-10T08:33:20.052 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:33:20.057 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:20.057 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:33:20.158 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:33:20.213 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:20.250 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:33:20.257 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:20.257 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:33:20.326 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:33:18.519894+0000 mgr.y (mgr.14505) 622 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:33:20.326 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:18.704576+0000 osd.2 (osd.2) 163 : cluster [DBG] 2.e scrub starts 2024-02-10T08:33:20.326 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:18.706420+0000 osd.2 (osd.2) 164 : cluster [DBG] 2.e scrub ok 2024-02-10T08:33:20.326 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:18.963992+0000 mgr.y (mgr.14505) 623 : cluster [DBG] pgmap v773: 168 pgs: 168 active+clean; 3.6 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 853 B/s rd, 87 MiB/s wr, 1.39k op/s 2024-02-10T08:33:20.326 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:18.979340+0000 osd.5 (osd.5) 205 : cluster [DBG] 4.15 scrub starts 2024-02-10T08:33:20.326 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:18.984498+0000 osd.5 (osd.5) 206 : cluster [DBG] 4.15 scrub ok 2024-02-10T08:33:20.326 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:19.182785+0000 osd.6 (osd.6) 176 : cluster [DBG] 4.5 scrub starts 2024-02-10T08:33:20.326 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:19.194664+0000 osd.6 (osd.6) 177 : cluster [DBG] 4.5 scrub ok 2024-02-10T08:33:20.326 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:19.328956+0000 osd.4 (osd.4) 106 : cluster [DBG] 6.1e scrub starts 2024-02-10T08:33:20.326 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:19.356034+0000 osd.4 (osd.4) 107 : cluster [DBG] 6.1e scrub ok 2024-02-10T08:33:20.326 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:19.390402+0000 osd.7 (osd.7) 203 : cluster [DBG] 6.8 scrub starts 2024-02-10T08:33:20.326 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:19.398408+0000 osd.7 (osd.7) 204 : cluster [DBG] 6.8 scrub ok 2024-02-10T08:33:20.326 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:19.774368+0000 osd.1 (osd.1) 204 : cluster [DBG] 6.20 scrub starts 2024-02-10T08:33:20.327 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:19.782513+0000 osd.1 (osd.1) 205 : cluster [DBG] 6.20 scrub ok 2024-02-10T08:33:20.327 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:33:18.519894+0000 mgr.y (mgr.14505) 622 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:33:20.327 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:18.704576+0000 osd.2 (osd.2) 163 : cluster [DBG] 2.e scrub starts 2024-02-10T08:33:20.327 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:18.706420+0000 osd.2 (osd.2) 164 : cluster [DBG] 2.e scrub ok 2024-02-10T08:33:20.327 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:18.963992+0000 mgr.y (mgr.14505) 623 : cluster [DBG] pgmap v773: 168 pgs: 168 active+clean; 3.6 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 853 B/s rd, 87 MiB/s wr, 1.39k op/s 2024-02-10T08:33:20.327 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:18.979340+0000 osd.5 (osd.5) 205 : cluster [DBG] 4.15 scrub starts 2024-02-10T08:33:20.327 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:18.984498+0000 osd.5 (osd.5) 206 : cluster [DBG] 4.15 scrub ok 2024-02-10T08:33:20.327 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:19.182785+0000 osd.6 (osd.6) 176 : cluster [DBG] 4.5 scrub starts 2024-02-10T08:33:20.327 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:19.194664+0000 osd.6 (osd.6) 177 : cluster [DBG] 4.5 scrub ok 2024-02-10T08:33:20.327 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:19.328956+0000 osd.4 (osd.4) 106 : cluster [DBG] 6.1e scrub starts 2024-02-10T08:33:20.327 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:19.356034+0000 osd.4 (osd.4) 107 : cluster [DBG] 6.1e scrub ok 2024-02-10T08:33:20.327 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:19.390402+0000 osd.7 (osd.7) 203 : cluster [DBG] 6.8 scrub starts 2024-02-10T08:33:20.328 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:19.398408+0000 osd.7 (osd.7) 204 : cluster [DBG] 6.8 scrub ok 2024-02-10T08:33:20.328 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:19.774368+0000 osd.1 (osd.1) 204 : cluster [DBG] 6.20 scrub starts 2024-02-10T08:33:20.328 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:19.782513+0000 osd.1 (osd.1) 205 : cluster [DBG] 6.20 scrub ok 2024-02-10T08:33:20.358 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:33:20.408 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:20.448 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:33:20.451 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:33:18.519894+0000 mgr.y (mgr.14505) 622 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:33:20.451 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:18.704576+0000 osd.2 (osd.2) 163 : cluster [DBG] 2.e scrub starts 2024-02-10T08:33:20.451 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:18.706420+0000 osd.2 (osd.2) 164 : cluster [DBG] 2.e scrub ok 2024-02-10T08:33:20.451 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:18.963992+0000 mgr.y (mgr.14505) 623 : cluster [DBG] pgmap v773: 168 pgs: 168 active+clean; 3.6 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 853 B/s rd, 87 MiB/s wr, 1.39k op/s 2024-02-10T08:33:20.451 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:18.979340+0000 osd.5 (osd.5) 205 : cluster [DBG] 4.15 scrub starts 2024-02-10T08:33:20.451 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:18.984498+0000 osd.5 (osd.5) 206 : cluster [DBG] 4.15 scrub ok 2024-02-10T08:33:20.451 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:19.182785+0000 osd.6 (osd.6) 176 : cluster [DBG] 4.5 scrub starts 2024-02-10T08:33:20.451 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:19.194664+0000 osd.6 (osd.6) 177 : cluster [DBG] 4.5 scrub ok 2024-02-10T08:33:20.451 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:19.328956+0000 osd.4 (osd.4) 106 : cluster [DBG] 6.1e scrub starts 2024-02-10T08:33:20.452 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:19.356034+0000 osd.4 (osd.4) 107 : cluster [DBG] 6.1e scrub ok 2024-02-10T08:33:20.452 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:19.390402+0000 osd.7 (osd.7) 203 : cluster [DBG] 6.8 scrub starts 2024-02-10T08:33:20.452 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:19.398408+0000 osd.7 (osd.7) 204 : cluster [DBG] 6.8 scrub ok 2024-02-10T08:33:20.452 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:19.774368+0000 osd.1 (osd.1) 204 : cluster [DBG] 6.20 scrub starts 2024-02-10T08:33:20.452 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:19.782513+0000 osd.1 (osd.1) 205 : cluster [DBG] 6.20 scrub ok 2024-02-10T08:33:20.452 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:20.453 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:33:20.553 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:33:20.626 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:20.717 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 34 16 63847 63831 117.291 79.1875 0.00968087 0.00852083 2024-02-10T08:33:21.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:19.668630+0000 osd.2 (osd.2) 165 : cluster [DBG] 5.8 scrub starts 2024-02-10T08:33:21.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:19.671620+0000 osd.2 (osd.2) 166 : cluster [DBG] 5.8 scrub ok 2024-02-10T08:33:21.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:19.716642+0000 osd.0 (osd.0) 177 : cluster [DBG] 4.16 scrub starts 2024-02-10T08:33:21.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:19.722076+0000 osd.0 (osd.0) 178 : cluster [DBG] 4.16 scrub ok 2024-02-10T08:33:21.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:20.197451+0000 osd.6 (osd.6) 178 : cluster [DBG] 6.2e scrub starts 2024-02-10T08:33:21.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:20.217819+0000 osd.6 (osd.6) 179 : cluster [DBG] 6.2e scrub ok 2024-02-10T08:33:21.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:20.845625+0000 mon.a (mon.0) 1536 : cluster [DBG] osdmap e354: 8 total, 8 up, 8 in 2024-02-10T08:33:21.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:19.668630+0000 osd.2 (osd.2) 165 : cluster [DBG] 5.8 scrub starts 2024-02-10T08:33:21.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:19.671620+0000 osd.2 (osd.2) 166 : cluster [DBG] 5.8 scrub ok 2024-02-10T08:33:21.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:19.716642+0000 osd.0 (osd.0) 177 : cluster [DBG] 4.16 scrub starts 2024-02-10T08:33:21.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:19.722076+0000 osd.0 (osd.0) 178 : cluster [DBG] 4.16 scrub ok 2024-02-10T08:33:21.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:20.197451+0000 osd.6 (osd.6) 178 : cluster [DBG] 6.2e scrub starts 2024-02-10T08:33:21.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:20.217819+0000 osd.6 (osd.6) 179 : cluster [DBG] 6.2e scrub ok 2024-02-10T08:33:21.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:20.845625+0000 mon.a (mon.0) 1536 : cluster [DBG] osdmap e354: 8 total, 8 up, 8 in 2024-02-10T08:33:21.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:19.668630+0000 osd.2 (osd.2) 165 : cluster [DBG] 5.8 scrub starts 2024-02-10T08:33:21.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:19.671620+0000 osd.2 (osd.2) 166 : cluster [DBG] 5.8 scrub ok 2024-02-10T08:33:21.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:19.716642+0000 osd.0 (osd.0) 177 : cluster [DBG] 4.16 scrub starts 2024-02-10T08:33:21.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:19.722076+0000 osd.0 (osd.0) 178 : cluster [DBG] 4.16 scrub ok 2024-02-10T08:33:21.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:20.197451+0000 osd.6 (osd.6) 178 : cluster [DBG] 6.2e scrub starts 2024-02-10T08:33:21.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:20.217819+0000 osd.6 (osd.6) 179 : cluster [DBG] 6.2e scrub ok 2024-02-10T08:33:21.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:20.845625+0000 mon.a (mon.0) 1536 : cluster [DBG] osdmap e354: 8 total, 8 up, 8 in 2024-02-10T08:33:21.689 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:33:21.695 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:21.696 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:33:21.707 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:33:21.717 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 35 16 65005 64989 116.008 72.375 0.0155274 0.00861532 2024-02-10T08:33:21.800 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:33:21.801 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:33:21.810 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-02-10T08:33:21.834 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:33:21.842 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:21.870 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:33:21.874 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:21.874 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:33:21.975 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:33:22.023 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:22.235 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:33:22.240 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:22.241 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:33:22.342 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:33:22.348 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:20.964394+0000 mgr.y (mgr.14505) 624 : cluster [DBG] pgmap v775: 168 pgs: 168 active+clean; 3.7 GiB data, 15 GiB used, 701 GiB / 715 GiB avail; 853 B/s rd, 75 MiB/s wr, 1.21k op/s 2024-02-10T08:33:22.348 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:33:21.088796+0000 mgr.y (mgr.14505) 625 : audit [DBG] from='client.15477 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-10T08:33:22.348 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:21.206132+0000 osd.6 (osd.6) 180 : cluster [DBG] 6.2c scrub starts 2024-02-10T08:33:22.349 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:21.209037+0000 osd.6 (osd.6) 181 : cluster [DBG] 6.2c scrub ok 2024-02-10T08:33:22.350 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:20.964394+0000 mgr.y (mgr.14505) 624 : cluster [DBG] pgmap v775: 168 pgs: 168 active+clean; 3.7 GiB data, 15 GiB used, 701 GiB / 715 GiB avail; 853 B/s rd, 75 MiB/s wr, 1.21k op/s 2024-02-10T08:33:22.350 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:33:21.088796+0000 mgr.y (mgr.14505) 625 : audit [DBG] from='client.15477 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-10T08:33:22.350 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:21.206132+0000 osd.6 (osd.6) 180 : cluster [DBG] 6.2c scrub starts 2024-02-10T08:33:22.350 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:21.209037+0000 osd.6 (osd.6) 181 : cluster [DBG] 6.2c scrub ok 2024-02-10T08:33:22.389 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:22.414 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:33:22.419 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:22.420 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:33:22.521 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:33:22.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:20.964394+0000 mgr.y (mgr.14505) 624 : cluster [DBG] pgmap v775: 168 pgs: 168 active+clean; 3.7 GiB data, 15 GiB used, 701 GiB / 715 GiB avail; 853 B/s rd, 75 MiB/s wr, 1.21k op/s 2024-02-10T08:33:22.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:33:21.088796+0000 mgr.y (mgr.14505) 625 : audit [DBG] from='client.15477 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-10T08:33:22.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:21.206132+0000 osd.6 (osd.6) 180 : cluster [DBG] 6.2c scrub starts 2024-02-10T08:33:22.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:21.209037+0000 osd.6 (osd.6) 181 : cluster [DBG] 6.2c scrub ok 2024-02-10T08:33:22.573 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:22.717 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 36 16 66159 66143 114.788 72.125 0.00992448 0.00870714 2024-02-10T08:33:23.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:22.020329+0000 osd.5 (osd.5) 207 : cluster [DBG] 2.16 scrub starts 2024-02-10T08:33:23.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:22.025765+0000 osd.5 (osd.5) 208 : cluster [DBG] 2.16 scrub ok 2024-02-10T08:33:23.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:22.476139+0000 osd.7 (osd.7) 205 : cluster [DBG] 4.0 scrub starts 2024-02-10T08:33:23.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:22.481374+0000 osd.7 (osd.7) 206 : cluster [DBG] 4.0 scrub ok 2024-02-10T08:33:23.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:22.020329+0000 osd.5 (osd.5) 207 : cluster [DBG] 2.16 scrub starts 2024-02-10T08:33:23.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:22.025765+0000 osd.5 (osd.5) 208 : cluster [DBG] 2.16 scrub ok 2024-02-10T08:33:23.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:22.476139+0000 osd.7 (osd.7) 205 : cluster [DBG] 4.0 scrub starts 2024-02-10T08:33:23.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:22.481374+0000 osd.7 (osd.7) 206 : cluster [DBG] 4.0 scrub ok 2024-02-10T08:33:23.546 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:22.020329+0000 osd.5 (osd.5) 207 : cluster [DBG] 2.16 scrub starts 2024-02-10T08:33:23.546 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:22.025765+0000 osd.5 (osd.5) 208 : cluster [DBG] 2.16 scrub ok 2024-02-10T08:33:23.546 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:22.476139+0000 osd.7 (osd.7) 205 : cluster [DBG] 4.0 scrub starts 2024-02-10T08:33:23.546 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:22.481374+0000 osd.7 (osd.7) 206 : cluster [DBG] 4.0 scrub ok 2024-02-10T08:33:23.718 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 37 16 67352 67336 113.701 74.5625 0.00896918 0.00878982 2024-02-10T08:33:24.264 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is unset 2024-02-10T08:33:24.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:22.760110+0000 osd.0 (osd.0) 179 : cluster [DBG] 6.10 scrub starts 2024-02-10T08:33:24.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:22.771124+0000 osd.0 (osd.0) 180 : cluster [DBG] 6.10 scrub ok 2024-02-10T08:33:24.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:22.969498+0000 mgr.y (mgr.14505) 626 : cluster [DBG] pgmap v776: 168 pgs: 168 active+clean; 3.9 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1.4 KiB/s rd, 91 MiB/s wr, 1.46k op/s 2024-02-10T08:33:24.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:23.046112+0000 osd.5 (osd.5) 209 : cluster [DBG] 4.8 scrub starts 2024-02-10T08:33:24.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:23.049697+0000 osd.5 (osd.5) 210 : cluster [DBG] 4.8 scrub ok 2024-02-10T08:33:24.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:33:23.230686+0000 mon.a (mon.0) 1537 : audit [INF] from='client.? 172.21.15.18:0/436618501' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:33:24.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:23.431761+0000 osd.4 (osd.4) 108 : cluster [DBG] 5.18 scrub starts 2024-02-10T08:33:24.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:23.437389+0000 osd.4 (osd.4) 109 : cluster [DBG] 5.18 scrub ok 2024-02-10T08:33:24.548 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:33:24.563 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:24.564 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:22.760110+0000 osd.0 (osd.0) 179 : cluster [DBG] 6.10 scrub starts 2024-02-10T08:33:24.564 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:22.771124+0000 osd.0 (osd.0) 180 : cluster [DBG] 6.10 scrub ok 2024-02-10T08:33:24.564 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:22.969498+0000 mgr.y (mgr.14505) 626 : cluster [DBG] pgmap v776: 168 pgs: 168 active+clean; 3.9 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1.4 KiB/s rd, 91 MiB/s wr, 1.46k op/s 2024-02-10T08:33:24.564 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:23.046112+0000 osd.5 (osd.5) 209 : cluster [DBG] 4.8 scrub starts 2024-02-10T08:33:24.564 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:23.049697+0000 osd.5 (osd.5) 210 : cluster [DBG] 4.8 scrub ok 2024-02-10T08:33:24.564 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:33:23.230686+0000 mon.a (mon.0) 1537 : audit [INF] from='client.? 172.21.15.18:0/436618501' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:33:24.564 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:23.431761+0000 osd.4 (osd.4) 108 : cluster [DBG] 5.18 scrub starts 2024-02-10T08:33:24.564 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:23.437389+0000 osd.4 (osd.4) 109 : cluster [DBG] 5.18 scrub ok 2024-02-10T08:33:24.564 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:22.760110+0000 osd.0 (osd.0) 179 : cluster [DBG] 6.10 scrub starts 2024-02-10T08:33:24.565 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:22.771124+0000 osd.0 (osd.0) 180 : cluster [DBG] 6.10 scrub ok 2024-02-10T08:33:24.565 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:22.969498+0000 mgr.y (mgr.14505) 626 : cluster [DBG] pgmap v776: 168 pgs: 168 active+clean; 3.9 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1.4 KiB/s rd, 91 MiB/s wr, 1.46k op/s 2024-02-10T08:33:24.565 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:23.046112+0000 osd.5 (osd.5) 209 : cluster [DBG] 4.8 scrub starts 2024-02-10T08:33:24.565 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:23.049697+0000 osd.5 (osd.5) 210 : cluster [DBG] 4.8 scrub ok 2024-02-10T08:33:24.565 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:33:23.230686+0000 mon.a (mon.0) 1537 : audit [INF] from='client.? 172.21.15.18:0/436618501' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:33:24.565 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:23.431761+0000 osd.4 (osd.4) 108 : cluster [DBG] 5.18 scrub starts 2024-02-10T08:33:24.565 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:23.437389+0000 osd.4 (osd.4) 109 : cluster [DBG] 5.18 scrub ok 2024-02-10T08:33:24.565 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:33:24.666 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:33:24.718 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 38 16 68502 68486 112.601 71.875 0.0112315 0.00887598 2024-02-10T08:33:24.763 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:25.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:24.008698+0000 osd.5 (osd.5) 211 : cluster [DBG] 6.24 scrub starts 2024-02-10T08:33:25.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:24.018268+0000 osd.5 (osd.5) 212 : cluster [DBG] 6.24 scrub ok 2024-02-10T08:33:25.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:24.215776+0000 mon.a (mon.0) 1538 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-10T08:33:25.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:24.215808+0000 mon.a (mon.0) 1539 : cluster [INF] Cluster is now healthy 2024-02-10T08:33:25.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:33:24.236624+0000 mon.a (mon.0) 1540 : audit [INF] from='client.? 172.21.15.18:0/436618501' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-10T08:33:25.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:24.236680+0000 mon.a (mon.0) 1541 : cluster [DBG] osdmap e355: 8 total, 8 up, 8 in 2024-02-10T08:33:25.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:24.008698+0000 osd.5 (osd.5) 211 : cluster [DBG] 6.24 scrub starts 2024-02-10T08:33:25.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:24.018268+0000 osd.5 (osd.5) 212 : cluster [DBG] 6.24 scrub ok 2024-02-10T08:33:25.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:24.215776+0000 mon.a (mon.0) 1538 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-10T08:33:25.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:24.215808+0000 mon.a (mon.0) 1539 : cluster [INF] Cluster is now healthy 2024-02-10T08:33:25.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:33:24.236624+0000 mon.a (mon.0) 1540 : audit [INF] from='client.? 172.21.15.18:0/436618501' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-10T08:33:25.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:24.236680+0000 mon.a (mon.0) 1541 : cluster [DBG] osdmap e355: 8 total, 8 up, 8 in 2024-02-10T08:33:25.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:24.008698+0000 osd.5 (osd.5) 211 : cluster [DBG] 6.24 scrub starts 2024-02-10T08:33:25.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:24.018268+0000 osd.5 (osd.5) 212 : cluster [DBG] 6.24 scrub ok 2024-02-10T08:33:25.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:24.215776+0000 mon.a (mon.0) 1538 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-10T08:33:25.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:24.215808+0000 mon.a (mon.0) 1539 : cluster [INF] Cluster is now healthy 2024-02-10T08:33:25.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:33:24.236624+0000 mon.a (mon.0) 1540 : audit [INF] from='client.? 172.21.15.18:0/436618501' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-10T08:33:25.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:24.236680+0000 mon.a (mon.0) 1541 : cluster [DBG] osdmap e355: 8 total, 8 up, 8 in 2024-02-10T08:33:25.718 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 39 16 69751 69735 111.715 78.0625 0.00904648 0.00894633 2024-02-10T08:33:26.523 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:33:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:33:26] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:33:26.524 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:24.745751+0000 osd.0 (osd.0) 181 : cluster [DBG] 6.23 scrub starts 2024-02-10T08:33:26.524 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:24.802717+0000 osd.0 (osd.0) 182 : cluster [DBG] 6.23 scrub ok 2024-02-10T08:33:26.524 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:24.971788+0000 mgr.y (mgr.14505) 627 : cluster [DBG] pgmap v778: 168 pgs: 168 active+clean; 4.0 GiB data, 16 GiB used, 700 GiB / 715 GiB avail; 750 B/s rd, 65 MiB/s wr, 1.04k op/s 2024-02-10T08:33:26.524 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:25.259224+0000 osd.6 (osd.6) 182 : cluster [DBG] 6.25 scrub starts 2024-02-10T08:33:26.524 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:25.314773+0000 osd.6 (osd.6) 183 : cluster [DBG] 6.25 scrub ok 2024-02-10T08:33:26.525 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:25.842927+0000 mon.a (mon.0) 1542 : cluster [DBG] osdmap e356: 8 total, 8 up, 8 in 2024-02-10T08:33:26.531 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:24.745751+0000 osd.0 (osd.0) 181 : cluster [DBG] 6.23 scrub starts 2024-02-10T08:33:26.532 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:24.802717+0000 osd.0 (osd.0) 182 : cluster [DBG] 6.23 scrub ok 2024-02-10T08:33:26.532 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:24.971788+0000 mgr.y (mgr.14505) 627 : cluster [DBG] pgmap v778: 168 pgs: 168 active+clean; 4.0 GiB data, 16 GiB used, 700 GiB / 715 GiB avail; 750 B/s rd, 65 MiB/s wr, 1.04k op/s 2024-02-10T08:33:26.532 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:25.259224+0000 osd.6 (osd.6) 182 : cluster [DBG] 6.25 scrub starts 2024-02-10T08:33:26.532 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:25.314773+0000 osd.6 (osd.6) 183 : cluster [DBG] 6.25 scrub ok 2024-02-10T08:33:26.532 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:25.842927+0000 mon.a (mon.0) 1542 : cluster [DBG] osdmap e356: 8 total, 8 up, 8 in 2024-02-10T08:33:26.532 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:24.745751+0000 osd.0 (osd.0) 181 : cluster [DBG] 6.23 scrub starts 2024-02-10T08:33:26.532 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:24.802717+0000 osd.0 (osd.0) 182 : cluster [DBG] 6.23 scrub ok 2024-02-10T08:33:26.532 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:24.971788+0000 mgr.y (mgr.14505) 627 : cluster [DBG] pgmap v778: 168 pgs: 168 active+clean; 4.0 GiB data, 16 GiB used, 700 GiB / 715 GiB avail; 750 B/s rd, 65 MiB/s wr, 1.04k op/s 2024-02-10T08:33:26.532 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:25.259224+0000 osd.6 (osd.6) 182 : cluster [DBG] 6.25 scrub starts 2024-02-10T08:33:26.532 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:25.314773+0000 osd.6 (osd.6) 183 : cluster [DBG] 6.25 scrub ok 2024-02-10T08:33:26.533 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:25.842927+0000 mon.a (mon.0) 1542 : cluster [DBG] osdmap e356: 8 total, 8 up, 8 in 2024-02-10T08:33:26.718 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:2024-02-10T08:33:26.718394+0000 min lat: 0.00134707 max lat: 0.252504 avg lat: 0.00901843 2024-02-10T08:33:26.718 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-02-10T08:33:26.718 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 40 16 70970 70954 110.827 76.1875 0.0167446 0.00901843 2024-02-10T08:33:27.406 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:33:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:33:27] "GET /metrics HTTP/1.1" 200 176409 "" "Prometheus/2.33.4" 2024-02-10T08:33:27.434 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:33:27.438 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:27.439 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:33:27.540 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:33:27.595 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:27.636 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:33:27.640 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:27.640 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:33:27.718 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 41 16 72177 72161 109.963 75.4375 0.0121845 0.0090895 2024-02-10T08:33:27.741 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:33:27.799 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:28.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:26.784325+0000 osd.0 (osd.0) 183 : cluster [DBG] 3.1 scrub starts 2024-02-10T08:33:28.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:26.787770+0000 osd.0 (osd.0) 184 : cluster [DBG] 3.1 scrub ok 2024-02-10T08:33:28.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:26.972179+0000 mgr.y (mgr.14505) 628 : cluster [DBG] pgmap v780: 168 pgs: 168 active+clean; 4.1 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 835 B/s rd, 64 MiB/s wr, 1.02k op/s 2024-02-10T08:33:28.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:27.418281+0000 osd.4 (osd.4) 110 : cluster [DBG] 5.e scrub starts 2024-02-10T08:33:28.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:27.430942+0000 osd.4 (osd.4) 111 : cluster [DBG] 5.e scrub ok 2024-02-10T08:33:28.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:26.784325+0000 osd.0 (osd.0) 183 : cluster [DBG] 3.1 scrub starts 2024-02-10T08:33:28.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:26.787770+0000 osd.0 (osd.0) 184 : cluster [DBG] 3.1 scrub ok 2024-02-10T08:33:28.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:26.972179+0000 mgr.y (mgr.14505) 628 : cluster [DBG] pgmap v780: 168 pgs: 168 active+clean; 4.1 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 835 B/s rd, 64 MiB/s wr, 1.02k op/s 2024-02-10T08:33:28.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:27.418281+0000 osd.4 (osd.4) 110 : cluster [DBG] 5.e scrub starts 2024-02-10T08:33:28.407 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:27.430942+0000 osd.4 (osd.4) 111 : cluster [DBG] 5.e scrub ok 2024-02-10T08:33:28.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:26.784325+0000 osd.0 (osd.0) 183 : cluster [DBG] 3.1 scrub starts 2024-02-10T08:33:28.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:26.787770+0000 osd.0 (osd.0) 184 : cluster [DBG] 3.1 scrub ok 2024-02-10T08:33:28.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:26.972179+0000 mgr.y (mgr.14505) 628 : cluster [DBG] pgmap v780: 168 pgs: 168 active+clean; 4.1 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 835 B/s rd, 64 MiB/s wr, 1.02k op/s 2024-02-10T08:33:28.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:27.418281+0000 osd.4 (osd.4) 110 : cluster [DBG] 5.e scrub starts 2024-02-10T08:33:28.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:27.430942+0000 osd.4 (osd.4) 111 : cluster [DBG] 5.e scrub ok 2024-02-10T08:33:28.661 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":775,"stamp":"2024-02-10T08:33:20.964148+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3954841258,"num_objects":60538,"num_object_clones":0,"num_object_copies":181614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60538,"num_whiteouts":0,"num_read":2091,"num_read_kb":1843,"num_write":61059,"num_write_kb":3862184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":230,"num_bytes_recovered":7872,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":61186,"ondisk_log_size":61186,"up":504,"acting":504,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":504,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":15393432,"kb_used_data":11532120,"kb_used_omap":0,"kb_used_meta":3861247,"kb_avail":734567784,"statfs":{"total":767960285184,"available":752197410816,"internally_reserved":0,"allocated":11808890880,"data_stored":11804309969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":972,"internal_metadata":3953916980},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,4,7,3,1,8,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":473759744,"num_objects":7229,"num_object_clones":0,"num_object_copies":21687,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7229,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":7229,"num_write_kb":462656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001875"},"pg_stats":[{"pgid":"6.33","version":"0'0","reported_seq":240,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.091053+0000","last_change":"2024-02-10T08:30:26.080816+0000","last_active":"2024-02-10T08:33:14.091053+0000","last_peered":"2024-02-10T08:33:14.091053+0000","last_clean":"2024-02-10T08:33:14.091053+0000","last_became_active":"2024-02-10T08:30:26.080326+0000","last_became_peered":"2024-02-10T08:30:26.080326+0000","last_unstale":"2024-02-10T08:33:14.091053+0000","last_undegraded":"2024-02-10T08:33:14.091053+0000","last_fullsized":"2024-02-10T08:33:14.091053+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:34.502781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:34.502781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2],"acting":[5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":344,"reported_epoch":352,"state":"active+clean","last_fresh":"2024-02-10T08:33:15.841913+0000","last_change":"2024-02-10T08:30:26.067603+0000","last_active":"2024-02-10T08:33:15.841913+0000","last_peered":"2024-02-10T08:33:15.841913+0000","last_clean":"2024-02-10T08:33:15.841913+0000","last_became_active":"2024-02-10T08:30:26.067019+0000","last_became_peered":"2024-02-10T08:30:26.067019+0000","last_unstale":"2024-02-10T08:33:15.841913+0000","last_undegraded":"2024-02-10T08:33:15.841913+0000","last_fullsized":"2024-02-10T08:33:15.841913+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:12.421034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:27.276490+0000","last_clean_scrub_stamp":"2024-02-10T08:29:12.421034+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.6","version":"352'3816","reported_seq":3841,"reported_epoch":352,"state":"active+clean","last_fresh":"2024-02-10T08:33:17.719376+0000","last_change":"2024-02-10T08:32:30.821933+0000","last_active":"2024-02-10T08:33:17.719376+0000","last_peered":"2024-02-10T08:33:17.719376+0000","last_clean":"2024-02-10T08:33:17.719376+0000","last_became_active":"2024-02-10T08:32:30.821631+0000","last_became_peered":"2024-02-10T08:32:30.821631+0000","last_unstale":"2024-02-10T08:33:17.719376+0000","last_undegraded":"2024-02-10T08:33:17.719376+0000","last_fullsized":"2024-02-10T08:33:17.719376+0000","mapping_epoch":335,"log_start":"0'0","ondisk_log_start":"0'0","created":335,"last_epoch_clean":336,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.947585+0000","log_size":3816,"ondisk_log_size":3816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":250085376,"num_objects":3816,"num_object_clones":0,"num_object_copies":11448,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3816,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3816,"num_write_kb":244224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4],"acting":[5,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"111'10","reported_seq":554,"reported_epoch":352,"state":"active+clean","last_fresh":"2024-02-10T08:33:15.836509+0000","last_change":"2024-02-10T08:28:29.196174+0000","last_active":"2024-02-10T08:33:15.836509+0000","last_peered":"2024-02-10T08:33:15.836509+0000","last_clean":"2024-02-10T08:33:15.836509+0000","last_became_active":"2024-02-10T08:20:46.399193+0000","last_became_peered":"2024-02-10T08:20:46.399193+0000","last_unstale":"2024-02-10T08:33:15.836509+0000","last_undegraded":"2024-02-10T08:33:15.836509+0000","last_fullsized":"2024-02-10T08:33:15.836509+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'10","last_scrub_stamp":"2024-02-10T08:28:29.196109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:28:29.196109+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"225'27","reported_seq":366,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.090718+0000","last_change":"2024-02-10T08:29:07.059712+0000","last_active":"2024-02-10T08:33:14.090718+0000","last_peered":"2024-02-10T08:33:14.090718+0000","last_clean":"2024-02-10T08:33:14.090718+0000","last_became_active":"2024-02-10T08:16:55.204597+0000","last_became_peered":"2024-02-10T08:16:55.204597+0000","last_unstale":"2024-02-10T08:33:14.090718+0000","last_undegraded":"2024-02-10T08:33:14.090718+0000","last_fullsized":"2024-02-10T08:33:14.090718+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'27","last_scrub_stamp":"2024-02-10T08:29:07.059646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:29:07.059646+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":358,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.108018+0000","last_change":"2024-02-10T08:32:20.331056+0000","last_active":"2024-02-10T08:33:14.108018+0000","last_peered":"2024-02-10T08:33:14.108018+0000","last_clean":"2024-02-10T08:33:14.108018+0000","last_became_active":"2024-02-10T08:32:20.330612+0000","last_became_peered":"2024-02-10T08:32:20.330612+0000","last_unstale":"2024-02-10T08:33:14.108018+0000","last_undegraded":"2024-02-10T08:33:14.108018+0000","last_fullsized":"2024-02-10T08:33:14.108018+0000","mapping_epoch":331,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":332,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:24.554978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:29:24.554978+0000","last_clean_scrub_stamp":"2024-02-10T08:29:24.554978+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":346,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.090714+0000","last_change":"2024-02-10T08:30:24.063277+0000","last_active":"2024-02-10T08:33:14.090714+0000","last_peered":"2024-02-10T08:33:14.090714+0000","last_clean":"2024-02-10T08:33:14.090714+0000","last_became_active":"2024-02-10T08:30:24.062795+0000","last_became_peered":"2024-02-10T08:30:24.062795+0000","last_unstale":"2024-02-10T08:33:14.090714+0000","last_undegraded":"2024-02-10T08:33:14.090714+0000","last_fullsized":"2024-02-10T08:33:14.090714+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:30.227120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:20.392249+0000","last_clean_scrub_stamp":"2024-02-10T08:28:30.227120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"352'3736","reported_seq":3761,"reported_epoch":352,"state":"active+clean","last_fresh":"2024-02-10T08:33:17.955183+0000","last_change":"2024-02-10T08:32:30.826128+0000","last_active":"2024-02-10T08:33:17.955183+0000","last_peered":"2024-02-10T08:33:17.955183+0000","last_clean":"2024-02-10T08:33:17.955183+0000","last_became_active":"2024-02-10T08:32:30.825592+0000","last_became_peered":"2024-02-10T08:32:30.825592+0000","last_unstale":"2024-02-10T08:33:17.955183+0000","last_undegraded":"2024-02-10T08:33:17.955183+0000","last_fullsized":"2024-02-10T08:33:17.955183+0000","mapping_epoch":335,"log_start":"0'0","ondisk_log_start":"0'0","created":335,"last_epoch_clean":336,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.947585+0000","log_size":3736,"ondisk_log_size":3736,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":244842496,"num_objects":3736,"num_object_clones":0,"num_object_copies":11208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3736,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3736,"num_write_kb":239104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"225'15","reported_seq":139,"reported_epoch":352,"state":"active+clean","last_fresh":"2024-02-10T08:33:15.845735+0000","last_change":"2024-02-10T08:32:18.530490+0000","last_active":"2024-02-10T08:33:15.845735+0000","last_peered":"2024-02-10T08:33:15.845735+0000","last_clean":"2024-02-10T08:33:15.845735+0000","last_became_active":"2024-02-10T08:28:02.770508+0000","last_became_peered":"2024-02-10T08:28:02.770508+0000","last_unstale":"2024-02-10T08:33:15.845735+0000","last_undegraded":"2024-02-10T08:33:15.845735+0000","last_fullsized":"2024-02-10T08:33:15.845735+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'15","last_scrub_stamp":"2024-02-10T08:32:18.530424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:32:18.530424+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":341,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.091391+0000","last_change":"2024-02-10T08:32:17.671792+0000","last_active":"2024-02-10T08:33:14.091391+0000","last_peered":"2024-02-10T08:33:14.091391+0000","last_clean":"2024-02-10T08:33:14.091391+0000","last_became_active":"2024-02-10T08:20:46.407311+0000","last_became_peered":"2024-02-10T08:20:46.407311+0000","last_unstale":"2024-02-10T08:33:14.091391+0000","last_undegraded":"2024-02-10T08:33:14.091391+0000","last_fullsized":"2024-02-10T08:33:14.091391+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:17.671622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:21.523096+0000","last_clean_scrub_stamp":"2024-02-10T08:32:17.671622+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":373,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.101228+0000","last_change":"2024-02-10T08:32:21.483917+0000","last_active":"2024-02-10T08:33:14.101228+0000","last_peered":"2024-02-10T08:33:14.101228+0000","last_clean":"2024-02-10T08:33:14.101228+0000","last_became_active":"2024-02-10T08:31:33.882809+0000","last_became_peered":"2024-02-10T08:31:33.882809+0000","last_unstale":"2024-02-10T08:33:14.101228+0000","last_undegraded":"2024-02-10T08:33:14.101228+0000","last_fullsized":"2024-02-10T08:33:14.101228+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:21.482538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:32:21.482538+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"76'2","reported_seq":23,"reported_epoch":352,"state":"active+clean","last_fresh":"2024-02-10T08:33:15.844456+0000","last_change":"2024-02-10T08:32:36.979463+0000","last_active":"2024-02-10T08:33:15.844456+0000","last_peered":"2024-02-10T08:33:15.844456+0000","last_clean":"2024-02-10T08:33:15.844456+0000","last_became_active":"2024-02-10T08:32:36.979100+0000","last_became_peered":"2024-02-10T08:32:36.979100+0000","last_unstale":"2024-02-10T08:33:15.844456+0000","last_undegraded":"2024-02-10T08:33:15.844456+0000","last_fullsized":"2024-02-10T08:33:15.844456+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'2","last_scrub_stamp":"2024-02-10T08:28:20.073105+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2024-02-10T08:18:08.680038+0000","last_clean_scrub_stamp":"2024-02-10T08:28:20.073105+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":6,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"353'3799","reported_seq":3822,"reported_epoch":353,"state":"active+clean","last_fresh":"2024-02-10T08:33:18.229712+0000","last_change":"2024-02-10T08:32:36.986316+0000","last_active":"2024-02-10T08:33:18.229712+0000","last_peered":"2024-02-10T08:33:18.229712+0000","last_clean":"2024-02-10T08:33:18.229712+0000","last_became_active":"2024-02-10T08:32:36.985786+0000","last_became_peered":"2024-02-10T08:32:36.985786+0000","last_unstale":"2024-02-10T08:33:18.229712+0000","last_undegraded":"2024-02-10T08:33:18.229712+0000","last_fullsized":"2024-02-10T08:33:18.229712+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":335,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.947585+0000","log_size":3799,"ondisk_log_size":3799,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":248971264,"num_objects":3799,"num_object_clones":0,"num_object_copies":11397,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3799,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3799,"num_write_kb":243136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"226'35","reported_seq":378,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.099044+0000","last_change":"2024-02-10T08:29:09.404681+0000","last_active":"2024-02-10T08:33:14.099044+0000","last_peered":"2024-02-10T08:33:14.099044+0000","last_clean":"2024-02-10T08:33:14.099044+0000","last_became_active":"2024-02-10T08:16:55.203415+0000","last_became_peered":"2024-02-10T08:16:55.203415+0000","last_unstale":"2024-02-10T08:33:14.099044+0000","last_undegraded":"2024-02-10T08:33:14.099044+0000","last_fullsized":"2024-02-10T08:33:14.099044+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"226'35","last_scrub_stamp":"2024-02-10T08:29:09.404577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:29:09.404577+0000","log_size":35,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":56,"num_read_kb":45,"num_write":36,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":349,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.106716+0000","last_change":"2024-02-10T08:32:12.480970+0000","last_active":"2024-02-10T08:33:14.106716+0000","last_peered":"2024-02-10T08:33:14.106716+0000","last_clean":"2024-02-10T08:33:14.106716+0000","last_became_active":"2024-02-10T08:28:02.781029+0000","last_became_peered":"2024-02-10T08:28:02.781029+0000","last_unstale":"2024-02-10T08:33:14.106716+0000","last_undegraded":"2024-02-10T08:33:14.106716+0000","last_fullsized":"2024-02-10T08:33:14.106716+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:12.480865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:32:12.480865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":345,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.106371+0000","last_change":"2024-02-10T08:32:29.593920+0000","last_active":"2024-02-10T08:33:14.106371+0000","last_peered":"2024-02-10T08:33:14.106371+0000","last_clean":"2024-02-10T08:33:14.106371+0000","last_became_active":"2024-02-10T08:28:02.779438+0000","last_became_peered":"2024-02-10T08:28:02.779438+0000","last_unstale":"2024-02-10T08:33:14.106371+0000","last_undegraded":"2024-02-10T08:33:14.106371+0000","last_fullsized":"2024-02-10T08:33:14.106371+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.593849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.593849+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.593849+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":332,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.101946+0000","last_change":"2024-02-10T08:28:22.114493+0000","last_active":"2024-02-10T08:33:14.101946+0000","last_peered":"2024-02-10T08:33:14.101946+0000","last_clean":"2024-02-10T08:33:14.101946+0000","last_became_active":"2024-02-10T08:24:18.645480+0000","last_became_peered":"2024-02-10T08:24:18.645480+0000","last_unstale":"2024-02-10T08:33:14.101946+0000","last_undegraded":"2024-02-10T08:33:14.101946+0000","last_fullsized":"2024-02-10T08:33:14.101946+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:22.114421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:22.114421+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,3],"acting":[7,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3","version":"352'3746","reported_seq":3771,"reported_epoch":352,"state":"active+clean","last_fresh":"2024-02-10T08:33:17.951831+0000","last_change":"2024-02-10T08:32:30.825931+0000","last_active":"2024-02-10T08:33:17.951831+0000","last_peered":"2024-02-10T08:33:17.951831+0000","last_clean":"2024-02-10T08:33:17.951831+0000","last_became_active":"2024-02-10T08:32:30.825621+0000","last_became_peered":"2024-02-10T08:32:30.825621+0000","last_unstale":"2024-02-10T08:33:17.951831+0000","last_undegraded":"2024-02-10T08:33:17.951831+0000","last_fullsized":"2024-02-10T08:33:17.951831+0000","mapping_epoch":335,"log_start":"0'0","ondisk_log_start":"0'0","created":335,"last_epoch_clean":336,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.947585+0000","log_size":3746,"ondisk_log_size":3746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":245497856,"num_objects":3746,"num_object_clones":0,"num_object_copies":11238,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3746,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3746,"num_write_kb":239744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"225'31","reported_seq":68,"reported_epoch":352,"state":"active+clean","last_fresh":"2024-02-10T08:33:15.840250+0000","last_change":"2024-02-10T08:32:31.309431+0000","last_active":"2024-02-10T08:33:15.840250+0000","last_peered":"2024-02-10T08:33:15.840250+0000","last_clean":"2024-02-10T08:33:15.840250+0000","last_became_active":"2024-02-10T08:31:46.070488+0000","last_became_peered":"2024-02-10T08:31:46.070488+0000","last_unstale":"2024-02-10T08:33:15.840250+0000","last_undegraded":"2024-02-10T08:33:15.840250+0000","last_fullsized":"2024-02-10T08:33:15.840250+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'31","last_scrub_stamp":"2024-02-10T08:32:31.309364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:32:31.309364+0000","log_size":31,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":48,"num_read_kb":38,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":382,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.101806+0000","last_change":"2024-02-10T08:32:11.282121+0000","last_active":"2024-02-10T08:33:14.101806+0000","last_peered":"2024-02-10T08:33:14.101806+0000","last_clean":"2024-02-10T08:33:14.101806+0000","last_became_active":"2024-02-10T08:20:46.399568+0000","last_became_peered":"2024-02-10T08:20:46.399568+0000","last_unstale":"2024-02-10T08:33:14.101806+0000","last_undegraded":"2024-02-10T08:33:14.101806+0000","last_fullsized":"2024-02-10T08:33:14.101806+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:11.282042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:32:11.282042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":350,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.088004+0000","last_change":"2024-02-10T08:29:24.690721+0000","last_active":"2024-02-10T08:33:14.088004+0000","last_peered":"2024-02-10T08:33:14.088004+0000","last_clean":"2024-02-10T08:33:14.088004+0000","last_became_active":"2024-02-10T08:28:02.764210+0000","last_became_peered":"2024-02-10T08:28:02.764210+0000","last_unstale":"2024-02-10T08:33:14.088004+0000","last_undegraded":"2024-02-10T08:33:14.088004+0000","last_fullsized":"2024-02-10T08:33:14.088004+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:24.690623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:24.690623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":298,"reported_epoch":352,"state":"active+clean","last_fresh":"2024-02-10T08:33:15.846470+0000","last_change":"2024-02-10T08:31:33.883772+0000","last_active":"2024-02-10T08:33:15.846470+0000","last_peered":"2024-02-10T08:33:15.846470+0000","last_clean":"2024-02-10T08:33:15.846470+0000","last_became_active":"2024-02-10T08:31:33.883457+0000","last_became_peered":"2024-02-10T08:31:33.883457+0000","last_unstale":"2024-02-10T08:33:15.846470+0000","last_undegraded":"2024-02-10T08:33:15.846470+0000","last_fullsized":"2024-02-10T08:33:15.846470+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:34.215363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:34.215363+0000","last_clean_scrub_stamp":"2024-02-10T08:28:34.215363+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2","version":"352'3776","reported_seq":3801,"reported_epoch":352,"state":"active+clean","last_fresh":"2024-02-10T08:33:17.814067+0000","last_change":"2024-02-10T08:32:30.822810+0000","last_active":"2024-02-10T08:33:17.814067+0000","last_peered":"2024-02-10T08:33:17.814067+0000","last_clean":"2024-02-10T08:33:17.814067+0000","last_became_active":"2024-02-10T08:32:30.822464+0000","last_became_peered":"2024-02-10T08:32:30.822464+0000","last_unstale":"2024-02-10T08:33:17.814067+0000","last_undegraded":"2024-02-10T08:33:17.814067+0000","last_fullsized":"2024-02-10T08:33:17.814067+0000","mapping_epoch":335,"log_start":"0'0","ondisk_log_start":"0'0","created":335,"last_epoch_clean":336,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.947585+0000","log_size":3776,"ondisk_log_size":3776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":247463936,"num_objects":3776,"num_object_clones":0,"num_object_copies":11328,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3776,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3776,"num_write_kb":241664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"225'20","reported_seq":341,"reported_epoch":352,"state":"active+clean","last_fresh":"2024-02-10T08:33:15.841105+0000","last_change":"2024-02-10T08:32:15.357432+0000","last_active":"2024-02-10T08:33:15.841105+0000","last_peered":"2024-02-10T08:33:15.841105+0000","last_clean":"2024-02-10T08:33:15.841105+0000","last_became_active":"2024-02-10T08:20:46.398973+0000","last_became_peered":"2024-02-10T08:20:46.398973+0000","last_unstale":"2024-02-10T08:33:15.841105+0000","last_undegraded":"2024-02-10T08:33:15.841105+0000","last_fullsized":"2024-02-10T08:33:15.841105+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'20","last_scrub_stamp":"2024-02-10T08:32:15.357342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:32:15.357342+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":24,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":326,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.089565+0000","last_change":"2024-02-10T08:32:27.711245+0000","last_active":"2024-02-10T08:33:14.089565+0000","last_peered":"2024-02-10T08:33:14.089565+0000","last_clean":"2024-02-10T08:33:14.089565+0000","last_became_active":"2024-02-10T08:16:52.785545+0000","last_became_peered":"2024-02-10T08:16:52.785545+0000","last_unstale":"2024-02-10T08:33:14.089565+0000","last_undegraded":"2024-02-10T08:33:14.089565+0000","last_fullsized":"2024-02-10T08:33:14.089565+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:27.711059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:32:27.711059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"62'8","reported_seq":532,"reported_epoch":352,"state":"active+clean","last_fresh":"2024-02-10T08:33:15.847576+0000","last_change":"2024-02-10T08:32:32.558184+0000","last_active":"2024-02-10T08:33:15.847576+0000","last_peered":"2024-02-10T08:33:15.847576+0000","last_clean":"2024-02-10T08:33:15.847576+0000","last_became_active":"2024-02-10T08:16:56.858101+0000","last_became_peered":"2024-02-10T08:16:56.858101+0000","last_unstale":"2024-02-10T08:33:15.847576+0000","last_undegraded":"2024-02-10T08:33:15.847576+0000","last_fullsized":"2024-02-10T08:33:15.847576+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'8","last_scrub_stamp":"2024-02-10T08:32:32.558115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:32:32.558115+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":300,"reported_epoch":352,"state":"active+clean","last_fresh":"2024-02-10T08:33:15.841344+0000","last_change":"2024-02-10T08:30:24.071630+0000","last_active":"2024-02-10T08:33:15.841344+0000","last_peered":"2024-02-10T08:33:15.841344+0000","last_clean":"2024-02-10T08:33:15.841344+0000","last_became_active":"2024-02-10T08:30:24.071020+0000","last_became_peered":"2024-02-10T08:30:24.071020+0000","last_unstale":"2024-02-10T08:33:15.841344+0000","last_undegraded":"2024-02-10T08:33:15.841344+0000","last_fullsized":"2024-02-10T08:33:15.841344+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:26.976023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:26.976023+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1","version":"353'3803","reported_seq":3829,"reported_epoch":353,"state":"active+clean","last_fresh":"2024-02-10T08:33:19.958481+0000","last_change":"2024-02-10T08:32:30.824324+0000","last_active":"2024-02-10T08:33:19.958481+0000","last_peered":"2024-02-10T08:33:19.958481+0000","last_clean":"2024-02-10T08:33:19.958481+0000","last_became_active":"2024-02-10T08:32:30.823874+0000","last_became_peered":"2024-02-10T08:32:30.823874+0000","last_unstale":"2024-02-10T08:33:19.958481+0000","last_undegraded":"2024-02-10T08:33:19.958481+0000","last_fullsized":"2024-02-10T08:33:19.958481+0000","mapping_epoch":335,"log_start":"0'0","ondisk_log_start":"0'0","created":335,"last_epoch_clean":336,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.947585+0000","log_size":3803,"ondisk_log_size":3803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":249233408,"num_objects":3803,"num_object_clones":0,"num_object_copies":11409,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3803,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3803,"num_write_kb":243392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,0],"acting":[4,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"226'27","reported_seq":349,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.108534+0000","last_change":"2024-02-10T08:32:23.474007+0000","last_active":"2024-02-10T08:33:14.108534+0000","last_peered":"2024-02-10T08:33:14.108534+0000","last_clean":"2024-02-10T08:33:14.108534+0000","last_became_active":"2024-02-10T08:20:46.401777+0000","last_became_peered":"2024-02-10T08:20:46.401777+0000","last_unstale":"2024-02-10T08:33:14.108534+0000","last_undegraded":"2024-02-10T08:33:14.108534+0000","last_fullsized":"2024-02-10T08:33:14.108534+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"226'27","last_scrub_stamp":"2024-02-10T08:32:23.473934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:32:23.473934+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":326,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.087720+0000","last_change":"2024-02-10T08:32:22.621095+0000","last_active":"2024-02-10T08:33:14.087720+0000","last_peered":"2024-02-10T08:33:14.087720+0000","last_clean":"2024-02-10T08:33:14.087720+0000","last_became_active":"2024-02-10T08:16:52.783634+0000","last_became_peered":"2024-02-10T08:16:52.783634+0000","last_unstale":"2024-02-10T08:33:14.087720+0000","last_undegraded":"2024-02-10T08:33:14.087720+0000","last_fullsized":"2024-02-10T08:33:14.087720+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:22.621006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:32:22.621006+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"318'14","reported_seq":68,"reported_epoch":352,"state":"active+clean","last_fresh":"2024-02-10T08:33:16.177654+0000","last_change":"2024-02-10T08:31:46.262891+0000","last_active":"2024-02-10T08:33:16.177654+0000","last_peered":"2024-02-10T08:33:16.177654+0000","last_clean":"2024-02-10T08:33:16.177654+0000","last_became_active":"2024-02-10T08:31:46.073265+0000","last_became_peered":"2024-02-10T08:31:46.073265+0000","last_unstale":"2024-02-10T08:33:16.177654+0000","last_undegraded":"2024-02-10T08:33:16.177654+0000","last_fullsized":"2024-02-10T08:33:16.177654+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'13","last_scrub_stamp":"2024-02-10T08:29:13.140622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:13.140622+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":346,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.090984+0000","last_change":"2024-02-10T08:32:36.979257+0000","last_active":"2024-02-10T08:33:14.090984+0000","last_peered":"2024-02-10T08:33:14.090984+0000","last_clean":"2024-02-10T08:33:14.090984+0000","last_became_active":"2024-02-10T08:32:36.978932+0000","last_became_peered":"2024-02-10T08:32:36.978932+0000","last_unstale":"2024-02-10T08:33:14.090984+0000","last_undegraded":"2024-02-10T08:33:14.090984+0000","last_fullsized":"2024-02-10T08:33:14.090984+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:36.163125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:36.163125+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.0","version":"352'3727","reported_seq":3752,"reported_epoch":352,"state":"active+clean","last_fresh":"2024-02-10T08:33:17.686577+0000","last_change":"2024-02-10T08:32:30.821784+0000","last_active":"2024-02-10T08:33:17.686577+0000","last_peered":"2024-02-10T08:33:17.686577+0000","last_clean":"2024-02-10T08:33:17.686577+0000","last_became_active":"2024-02-10T08:32:30.821494+0000","last_became_peered":"2024-02-10T08:32:30.821494+0000","last_unstale":"2024-02-10T08:33:17.686577+0000","last_undegraded":"2024-02-10T08:33:17.686577+0000","last_fullsized":"2024-02-10T08:33:17.686577+0000","mapping_epoch":335,"log_start":"0'0","ondisk_log_start":"0'0","created":335,"last_epoch_clean":336,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.947585+0000","log_size":3727,"ondisk_log_size":3727,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":244252672,"num_objects":3727,"num_object_clones":0,"num_object_copies":11181,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3727,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3727,"num_write_kb":238528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,4],"acting":[6,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"225'24","reported_seq":348,"reported_epoch":352,"state":"active+clean","last_fresh":"2024-02-10T08:33:15.841499+0000","last_change":"2024-02-10T08:32:23.327031+0000","last_active":"2024-02-10T08:33:15.841499+0000","last_peered":"2024-02-10T08:33:15.841499+0000","last_clean":"2024-02-10T08:33:15.841499+0000","last_became_active":"2024-02-10T08:20:46.406023+0000","last_became_peered":"2024-02-10T08:20:46.406023+0000","last_unstale":"2024-02-10T08:33:15.841499+0000","last_undegraded":"2024-02-10T08:33:15.841499+0000","last_fullsized":"2024-02-10T08:33:15.841499+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'24","last_scrub_stamp":"2024-02-10T08:32:23.326944+0000","last_deep_scrub":"76'16","last_deep_scrub_stamp":"2024-02-10T08:18:07.909782+0000","last_clean_scrub_stamp":"2024-02-10T08:32:23.326944+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":343,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.102245+0000","last_change":"2024-02-10T08:32:13.217936+0000","last_active":"2024-02-10T08:33:14.102245+0000","last_peered":"2024-02-10T08:33:14.102245+0000","last_clean":"2024-02-10T08:33:14.102245+0000","last_became_active":"2024-02-10T08:28:02.768633+0000","last_became_peered":"2024-02-10T08:28:02.768633+0000","last_unstale":"2024-02-10T08:33:14.102245+0000","last_undegraded":"2024-02-10T08:33:14.102245+0000","last_fullsized":"2024-02-10T08:33:14.102245+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:13.217844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:32:13.217844+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":388,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.093300+0000","last_change":"2024-02-10T08:32:26.093026+0000","last_active":"2024-02-10T08:33:14.093300+0000","last_peered":"2024-02-10T08:33:14.093300+0000","last_clean":"2024-02-10T08:33:14.093300+0000","last_became_active":"2024-02-10T08:20:46.400500+0000","last_became_peered":"2024-02-10T08:20:46.400500+0000","last_unstale":"2024-02-10T08:33:14.093300+0000","last_undegraded":"2024-02-10T08:33:14.093300+0000","last_fullsized":"2024-02-10T08:33:14.093300+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:26.092899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:32:26.092899+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":258,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.097761+0000","last_change":"2024-02-10T08:31:33.881318+0000","last_active":"2024-02-10T08:33:14.097761+0000","last_peered":"2024-02-10T08:33:14.097761+0000","last_clean":"2024-02-10T08:33:14.097761+0000","last_became_active":"2024-02-10T08:31:33.880969+0000","last_became_peered":"2024-02-10T08:31:33.880969+0000","last_unstale":"2024-02-10T08:33:14.097761+0000","last_undegraded":"2024-02-10T08:33:14.097761+0000","last_fullsized":"2024-02-10T08:33:14.097761+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:15.491747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:20:30.227375+0000","last_clean_scrub_stamp":"2024-02-10T08:29:15.491747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.f","version":"352'3806","reported_seq":3831,"reported_epoch":352,"state":"active+clean","last_fresh":"2024-02-10T08:33:17.688306+0000","last_change":"2024-02-10T08:32:30.825662+0000","last_active":"2024-02-10T08:33:17.688306+0000","last_peered":"2024-02-10T08:33:17.688306+0000","last_clean":"2024-02-10T08:33:17.688306+0000","last_became_active":"2024-02-10T08:32:30.825140+0000","last_became_peered":"2024-02-10T08:32:30.825140+0000","last_unstale":"2024-02-10T08:33:17.688306+0000","last_undegraded":"2024-02-10T08:33:17.688306+0000","last_fullsized":"2024-02-10T08:33:17.688306+0000","mapping_epoch":335,"log_start":"0'0","ondisk_log_start":"0'0","created":335,"last_epoch_clean":336,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.947585+0000","log_size":3806,"ondisk_log_size":3806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":249430016,"num_objects":3806,"num_object_clones":0,"num_object_copies":11418,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3806,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3806,"num_write_kb":243584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"314'14","reported_seq":409,"reported_epoch":352,"state":"active+clean","last_fresh":"2024-02-10T08:33:15.847282+0000","last_change":"2024-02-10T08:31:33.979699+0000","last_active":"2024-02-10T08:33:15.847282+0000","last_peered":"2024-02-10T08:33:15.847282+0000","last_clean":"2024-02-10T08:33:15.847282+0000","last_became_active":"2024-02-10T08:31:33.890120+0000","last_became_peered":"2024-02-10T08:31:33.890120+0000","last_unstale":"2024-02-10T08:33:15.847282+0000","last_undegraded":"2024-02-10T08:33:15.847282+0000","last_fullsized":"2024-02-10T08:33:15.847282+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"199'13","last_scrub_stamp":"2024-02-10T08:29:15.700463+0000","last_deep_scrub":"199'13","last_deep_scrub_stamp":"2024-02-10T08:24:47.529439+0000","last_clean_scrub_stamp":"2024-02-10T08:29:15.700463+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"225'28","reported_seq":339,"reported_epoch":352,"state":"active+clean","last_fresh":"2024-02-10T08:33:15.841057+0000","last_change":"2024-02-10T08:29:24.036552+0000","last_active":"2024-02-10T08:33:15.841057+0000","last_peered":"2024-02-10T08:33:15.841057+0000","last_clean":"2024-02-10T08:33:15.841057+0000","last_became_active":"2024-02-10T08:20:46.400760+0000","last_became_peered":"2024-02-10T08:20:46.400760+0000","last_unstale":"2024-02-10T08:33:15.841057+0000","last_undegraded":"2024-02-10T08:33:15.841057+0000","last_fullsized":"2024-02-10T08:33:15.841057+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'28","last_scrub_stamp":"2024-02-10T08:29:24.036448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:29:24.036448+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":41,"num_read_kb":34,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":330,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.196347+0000","last_change":"2024-02-10T08:33:14.196309+0000","last_active":"2024-02-10T08:33:14.196347+0000","last_peered":"2024-02-10T08:33:14.196347+0000","last_clean":"2024-02-10T08:33:14.196347+0000","last_became_active":"2024-02-10T08:16:52.789020+0000","last_became_peered":"2024-02-10T08:16:52.789020+0000","last_unstale":"2024-02-10T08:33:14.196347+0000","last_undegraded":"2024-02-10T08:33:14.196347+0000","last_fullsized":"2024-02-10T08:33:14.196347+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:14.196205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:33:14.196205+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":328,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:15.455512+0000","last_change":"2024-02-10T08:33:15.455469+0000","last_active":"2024-02-10T08:33:15.455512+0000","last_peered":"2024-02-10T08:33:15.455512+0000","last_clean":"2024-02-10T08:33:15.455512+0000","last_became_active":"2024-02-10T08:21:58.546976+0000","last_became_peered":"2024-02-10T08:21:58.546976+0000","last_unstale":"2024-02-10T08:33:15.455512+0000","last_undegraded":"2024-02-10T08:33:15.455512+0000","last_fullsized":"2024-02-10T08:33:15.455512+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:15.455337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:33:15.455337+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"353'3884","reported_seq":3910,"reported_epoch":353,"state":"active+clean","last_fresh":"2024-02-10T08:33:19.936247+0000","last_change":"2024-02-10T08:32:30.825453+0000","last_active":"2024-02-10T08:33:19.936247+0000","last_peered":"2024-02-10T08:33:19.936247+0000","last_clean":"2024-02-10T08:33:19.936247+0000","last_became_active":"2024-02-10T08:32:30.825144+0000","last_became_peered":"2024-02-10T08:32:30.825144+0000","last_unstale":"2024-02-10T08:33:19.936247+0000","last_undegraded":"2024-02-10T08:33:19.936247+0000","last_fullsized":"2024-02-10T08:33:19.936247+0000","mapping_epoch":335,"log_start":"0'0","ondisk_log_start":"0'0","created":335,"last_epoch_clean":336,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.947585+0000","log_size":3884,"ondisk_log_size":3884,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":254541824,"num_objects":3884,"num_object_clones":0,"num_object_copies":11652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3884,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3884,"num_write_kb":248576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":317,"reported_epoch":352,"state":"active+clean","last_fresh":"2024-02-10T08:33:15.841138+0000","last_change":"2024-02-10T08:31:33.883835+0000","last_active":"2024-02-10T08:33:15.841138+0000","last_peered":"2024-02-10T08:33:15.841138+0000","last_clean":"2024-02-10T08:33:15.841138+0000","last_became_active":"2024-02-10T08:31:33.883569+0000","last_became_peered":"2024-02-10T08:31:33.883569+0000","last_unstale":"2024-02-10T08:33:15.841138+0000","last_undegraded":"2024-02-10T08:33:15.841138+0000","last_fullsized":"2024-02-10T08:33:15.841138+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:27.021108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:27.021108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"225'30","reported_seq":382,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.102639+0000","last_change":"2024-02-10T08:32:37.709766+0000","last_active":"2024-02-10T08:33:14.102639+0000","last_peered":"2024-02-10T08:33:14.102639+0000","last_clean":"2024-02-10T08:33:14.102639+0000","last_became_active":"2024-02-10T08:32:36.979685+0000","last_became_peered":"2024-02-10T08:32:36.979685+0000","last_unstale":"2024-02-10T08:33:14.102639+0000","last_undegraded":"2024-02-10T08:33:14.102639+0000","last_fullsized":"2024-02-10T08:33:14.102639+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'30","last_scrub_stamp":"2024-02-10T08:28:35.245660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:28:35.245660+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":51,"num_read_kb":39,"num_write":32,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,0],"acting":[7,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":341,"reported_epoch":352,"state":"active+clean","last_fresh":"2024-02-10T08:33:16.825530+0000","last_change":"2024-02-10T08:33:16.825530+0000","last_active":"2024-02-10T08:33:16.825530+0000","last_peered":"2024-02-10T08:33:16.825530+0000","last_clean":"2024-02-10T08:33:16.825530+0000","last_became_active":"2024-02-10T08:20:46.407667+0000","last_became_peered":"2024-02-10T08:20:46.407667+0000","last_unstale":"2024-02-10T08:33:16.825530+0000","last_undegraded":"2024-02-10T08:33:16.825530+0000","last_fullsized":"2024-02-10T08:33:16.825530+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:16.825366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:33:16.825366+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":335,"reported_epoch":352,"state":"active+clean","last_fresh":"2024-02-10T08:33:15.841981+0000","last_change":"2024-02-10T08:32:25.358402+0000","last_active":"2024-02-10T08:33:15.841981+0000","last_peered":"2024-02-10T08:33:15.841981+0000","last_clean":"2024-02-10T08:33:15.841981+0000","last_became_active":"2024-02-10T08:31:33.882582+0000","last_became_peered":"2024-02-10T08:31:33.882582+0000","last_unstale":"2024-02-10T08:33:15.841981+0000","last_undegraded":"2024-02-10T08:33:15.841981+0000","last_fullsized":"2024-02-10T08:33:15.841981+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:25.358315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:25.358315+0000","last_clean_scrub_stamp":"2024-02-10T08:32:25.358315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.d","version":"352'3665","reported_seq":3699,"reported_epoch":352,"state":"active+clean","last_fresh":"2024-02-10T08:33:17.661663+0000","last_change":"2024-02-10T08:32:36.979514+0000","last_active":"2024-02-10T08:33:17.661663+0000","last_peered":"2024-02-10T08:33:17.661663+0000","last_clean":"2024-02-10T08:33:17.661663+0000","last_became_active":"2024-02-10T08:32:36.979091+0000","last_became_peered":"2024-02-10T08:32:36.979091+0000","last_unstale":"2024-02-10T08:33:17.661663+0000","last_undegraded":"2024-02-10T08:33:17.661663+0000","last_fullsized":"2024-02-10T08:33:17.661663+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":335,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.947585+0000","log_size":3665,"ondisk_log_size":3665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":240189440,"num_objects":3665,"num_object_clones":0,"num_object_copies":10995,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3665,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3665,"num_write_kb":234560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":339,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.099263+0000","last_change":"2024-02-10T08:29:11.420173+0000","last_active":"2024-02-10T08:33:14.099263+0000","last_peered":"2024-02-10T08:33:14.099263+0000","last_clean":"2024-02-10T08:33:14.099263+0000","last_became_active":"2024-02-10T08:28:02.769069+0000","last_became_peered":"2024-02-10T08:28:02.769069+0000","last_unstale":"2024-02-10T08:33:14.099263+0000","last_undegraded":"2024-02-10T08:33:14.099263+0000","last_fullsized":"2024-02-10T08:33:14.099263+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:11.420031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:11.420031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"225'37","reported_seq":423,"reported_epoch":352,"state":"active+clean","last_fresh":"2024-02-10T08:33:15.845824+0000","last_change":"2024-02-10T08:33:15.707082+0000","last_active":"2024-02-10T08:33:15.845824+0000","last_peered":"2024-02-10T08:33:15.845824+0000","last_clean":"2024-02-10T08:33:15.845824+0000","last_became_active":"2024-02-10T08:28:25.951447+0000","last_became_peered":"2024-02-10T08:28:25.951447+0000","last_unstale":"2024-02-10T08:33:15.845824+0000","last_undegraded":"2024-02-10T08:33:15.845824+0000","last_fullsized":"2024-02-10T08:33:15.845824+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'37","last_scrub_stamp":"2024-02-10T08:33:15.706967+0000","last_deep_scrub":"199'27","last_deep_scrub_stamp":"2024-02-10T08:24:42.826442+0000","last_clean_scrub_stamp":"2024-02-10T08:33:15.706967+0000","log_size":37,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":53,"num_read_kb":39,"num_write":32,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":328,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.107925+0000","last_change":"2024-02-10T08:32:36.972580+0000","last_active":"2024-02-10T08:33:14.107925+0000","last_peered":"2024-02-10T08:33:14.107925+0000","last_clean":"2024-02-10T08:33:14.107925+0000","last_became_active":"2024-02-10T08:32:36.972224+0000","last_became_peered":"2024-02-10T08:32:36.972224+0000","last_unstale":"2024-02-10T08:33:14.107925+0000","last_undegraded":"2024-02-10T08:33:14.107925+0000","last_fullsized":"2024-02-10T08:33:14.107925+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:20.457380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:32:20.457380+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4],"acting":[2,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":329,"reported_epoch":352,"state":"active+clean","last_fresh":"2024-02-10T08:33:15.884926+0000","last_change":"2024-02-10T08:33:15.884926+0000","last_active":"2024-02-10T08:33:15.884926+0000","last_peered":"2024-02-10T08:33:15.884926+0000","last_clean":"2024-02-10T08:33:15.884926+0000","last_became_active":"2024-02-10T08:21:58.553966+0000","last_became_peered":"2024-02-10T08:21:58.553966+0000","last_unstale":"2024-02-10T08:33:15.884926+0000","last_undegraded":"2024-02-10T08:33:15.884926+0000","last_fullsized":"2024-02-10T08:33:15.884926+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:15.884742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:39.633627+0000","last_clean_scrub_stamp":"2024-02-10T08:33:15.884742+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.8","version":"353'3824","reported_seq":3850,"reported_epoch":353,"state":"active+clean","last_fresh":"2024-02-10T08:33:18.229549+0000","last_change":"2024-02-10T08:32:30.824983+0000","last_active":"2024-02-10T08:33:18.229549+0000","last_peered":"2024-02-10T08:33:18.229549+0000","last_clean":"2024-02-10T08:33:18.229549+0000","last_became_active":"2024-02-10T08:32:30.824620+0000","last_became_peered":"2024-02-10T08:32:30.824620+0000","last_unstale":"2024-02-10T08:33:18.229549+0000","last_undegraded":"2024-02-10T08:33:18.229549+0000","last_fullsized":"2024-02-10T08:33:18.229549+0000","mapping_epoch":335,"log_start":"0'0","ondisk_log_start":"0'0","created":335,"last_epoch_clean":336,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.947585+0000","log_size":3824,"ondisk_log_size":3824,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":250609664,"num_objects":3824,"num_object_clones":0,"num_object_copies":11472,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3824,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3824,"num_write_kb":244736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7],"acting":[0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":343,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.093374+0000","last_change":"2024-02-10T08:29:14.145590+0000","last_active":"2024-02-10T08:33:14.093374+0000","last_peered":"2024-02-10T08:33:14.093374+0000","last_clean":"2024-02-10T08:33:14.093374+0000","last_became_active":"2024-02-10T08:28:02.772585+0000","last_became_peered":"2024-02-10T08:28:02.772585+0000","last_unstale":"2024-02-10T08:33:14.093374+0000","last_undegraded":"2024-02-10T08:33:14.093374+0000","last_fullsized":"2024-02-10T08:33:14.093374+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:14.145493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:41.360241+0000","last_clean_scrub_stamp":"2024-02-10T08:29:14.145493+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"225'24","reported_seq":42,"reported_epoch":352,"state":"active+clean","last_fresh":"2024-02-10T08:33:15.846374+0000","last_change":"2024-02-10T08:33:09.736783+0000","last_active":"2024-02-10T08:33:15.846374+0000","last_peered":"2024-02-10T08:33:15.846374+0000","last_clean":"2024-02-10T08:33:15.846374+0000","last_became_active":"2024-02-10T08:32:36.975366+0000","last_became_peered":"2024-02-10T08:32:36.975366+0000","last_unstale":"2024-02-10T08:33:15.846374+0000","last_undegraded":"2024-02-10T08:33:15.846374+0000","last_fullsized":"2024-02-10T08:33:15.846374+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'24","last_scrub_stamp":"2024-02-10T08:33:09.736694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:33:09.736694+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":343,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.102086+0000","last_change":"2024-02-10T08:32:28.402029+0000","last_active":"2024-02-10T08:33:14.102086+0000","last_peered":"2024-02-10T08:33:14.102086+0000","last_clean":"2024-02-10T08:33:14.102086+0000","last_became_active":"2024-02-10T08:28:02.760999+0000","last_became_peered":"2024-02-10T08:28:02.760999+0000","last_unstale":"2024-02-10T08:33:14.102086+0000","last_undegraded":"2024-02-10T08:33:14.102086+0000","last_fullsized":"2024-02-10T08:33:14.102086+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:28.401960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:28.401960+0000","last_clean_scrub_stamp":"2024-02-10T08:32:28.401960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":318,"reported_epoch":352,"state":"active+clean","last_fresh":"2024-02-10T08:33:15.844851+0000","last_change":"2024-02-10T08:31:46.063634+0000","last_active":"2024-02-10T08:33:15.844851+0000","last_peered":"2024-02-10T08:33:15.844851+0000","last_clean":"2024-02-10T08:33:15.844851+0000","last_became_active":"2024-02-10T08:31:46.063039+0000","last_became_peered":"2024-02-10T08:31:46.063039+0000","last_unstale":"2024-02-10T08:33:15.844851+0000","last_undegraded":"2024-02-10T08:33:15.844851+0000","last_fullsized":"2024-02-10T08:33:15.844851+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:06.426390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:20.736224+0000","last_clean_scrub_stamp":"2024-02-10T08:29:06.426390+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":342,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.088813+0000","last_change":"2024-02-10T08:32:32.713980+0000","last_active":"2024-02-10T08:33:14.088813+0000","last_peered":"2024-02-10T08:33:14.088813+0000","last_clean":"2024-02-10T08:33:14.088813+0000","last_became_active":"2024-02-10T08:28:19.022399+0000","last_became_peered":"2024-02-10T08:28:19.022399+0000","last_unstale":"2024-02-10T08:33:14.088813+0000","last_undegraded":"2024-02-10T08:33:14.088813+0000","last_fullsized":"2024-02-10T08:33:14.088813+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:32.713921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:32:32.713921+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"352'3680","reported_seq":3705,"reported_epoch":352,"state":"active+clean","last_fresh":"2024-02-10T08:33:17.686483+0000","last_change":"2024-02-10T08:32:30.823934+0000","last_active":"2024-02-10T08:33:17.686483+0000","last_peered":"2024-02-10T08:33:17.686483+0000","last_clean":"2024-02-10T08:33:17.686483+0000","last_became_active":"2024-02-10T08:32:30.823591+0000","last_became_peered":"2024-02-10T08:32:30.823591+0000","last_unstale":"2024-02-10T08:33:17.686483+0000","last_undegraded":"2024-02-10T08:33:17.686483+0000","last_fullsized":"2024-02-10T08:33:17.686483+0000","mapping_epoch":335,"log_start":"0'0","ondisk_log_start":"0'0","created":335,"last_epoch_clean":336,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.947585+0000","log_size":3680,"ondisk_log_size":3680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":241172480,"num_objects":3680,"num_object_clones":0,"num_object_copies":11040,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3680,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3680,"num_write_kb":235520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,0],"acting":[6,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":321,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.107033+0000","last_change":"2024-02-10T08:29:13.416528+0000","last_active":"2024-02-10T08:33:14.107033+0000","last_peered":"2024-02-10T08:33:14.107033+0000","last_clean":"2024-02-10T08:33:14.107033+0000","last_became_active":"2024-02-10T08:16:56.867159+0000","last_became_peered":"2024-02-10T08:16:56.867159+0000","last_unstale":"2024-02-10T08:33:14.107033+0000","last_undegraded":"2024-02-10T08:33:14.107033+0000","last_fullsized":"2024-02-10T08:33:14.107033+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:13.416461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:04.766780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:13.416461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"225'33","reported_seq":385,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.098143+0000","last_change":"2024-02-10T08:29:20.522358+0000","last_active":"2024-02-10T08:33:14.098143+0000","last_peered":"2024-02-10T08:33:14.098143+0000","last_clean":"2024-02-10T08:33:14.098143+0000","last_became_active":"2024-02-10T08:20:46.401981+0000","last_became_peered":"2024-02-10T08:20:46.401981+0000","last_unstale":"2024-02-10T08:33:14.098143+0000","last_undegraded":"2024-02-10T08:33:14.098143+0000","last_fullsized":"2024-02-10T08:33:14.098143+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'33","last_scrub_stamp":"2024-02-10T08:29:20.522259+0000","last_deep_scrub":"223'21","last_deep_scrub_stamp":"2024-02-10T08:26:33.250614+0000","last_clean_scrub_stamp":"2024-02-10T08:29:20.522259+0000","log_size":33,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":33,"num_write":25,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":354,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.102160+0000","last_change":"2024-02-10T08:32:36.980106+0000","last_active":"2024-02-10T08:33:14.102160+0000","last_peered":"2024-02-10T08:33:14.102160+0000","last_clean":"2024-02-10T08:33:14.102160+0000","last_became_active":"2024-02-10T08:32:36.979237+0000","last_became_peered":"2024-02-10T08:32:36.979237+0000","last_unstale":"2024-02-10T08:33:14.102160+0000","last_undegraded":"2024-02-10T08:33:14.102160+0000","last_fullsized":"2024-02-10T08:33:14.102160+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:16.187704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:14:44.584370+0000","last_clean_scrub_stamp":"2024-02-10T08:32:16.187704+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":330,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.091322+0000","last_change":"2024-02-10T08:33:12.974304+0000","last_active":"2024-02-10T08:33:14.091322+0000","last_peered":"2024-02-10T08:33:14.091322+0000","last_clean":"2024-02-10T08:33:14.091322+0000","last_became_active":"2024-02-10T08:16:52.788767+0000","last_became_peered":"2024-02-10T08:16:52.788767+0000","last_unstale":"2024-02-10T08:33:14.091322+0000","last_undegraded":"2024-02-10T08:33:14.091322+0000","last_fullsized":"2024-02-10T08:33:14.091322+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:12.974215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:33:12.974215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":254,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.091186+0000","last_change":"2024-02-10T08:32:29.019898+0000","last_active":"2024-02-10T08:33:14.091186+0000","last_peered":"2024-02-10T08:33:14.091186+0000","last_clean":"2024-02-10T08:33:14.091186+0000","last_became_active":"2024-02-10T08:31:33.878588+0000","last_became_peered":"2024-02-10T08:31:33.878588+0000","last_unstale":"2024-02-10T08:33:14.091186+0000","last_undegraded":"2024-02-10T08:33:14.091186+0000","last_fullsized":"2024-02-10T08:33:14.091186+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.019819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.019819+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.019819+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":54,"reported_epoch":352,"state":"active+clean","last_fresh":"2024-02-10T08:33:15.846600+0000","last_change":"2024-02-10T08:31:19.726867+0000","last_active":"2024-02-10T08:33:15.846600+0000","last_peered":"2024-02-10T08:33:15.846600+0000","last_clean":"2024-02-10T08:33:15.846600+0000","last_became_active":"2024-02-10T08:31:19.726561+0000","last_became_peered":"2024-02-10T08:31:19.726561+0000","last_unstale":"2024-02-10T08:33:15.846600+0000","last_undegraded":"2024-02-10T08:33:15.846600+0000","last_fullsized":"2024-02-10T08:33:15.846600+0000","mapping_epoch":308,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":309,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:25.198277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:26:29.921562+0000","last_clean_scrub_stamp":"2024-02-10T08:29:25.198277+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"352'3798","reported_seq":3823,"reported_epoch":352,"state":"active+clean","last_fresh":"2024-02-10T08:33:17.712837+0000","last_change":"2024-02-10T08:32:30.825343+0000","last_active":"2024-02-10T08:33:17.712837+0000","last_peered":"2024-02-10T08:33:17.712837+0000","last_clean":"2024-02-10T08:33:17.712837+0000","last_became_active":"2024-02-10T08:32:30.824975+0000","last_became_peered":"2024-02-10T08:32:30.824975+0000","last_unstale":"2024-02-10T08:33:17.712837+0000","last_undegraded":"2024-02-10T08:33:17.712837+0000","last_fullsized":"2024-02-10T08:33:17.712837+0000","mapping_epoch":335,"log_start":"0'0","ondisk_log_start":"0'0","created":335,"last_epoch_clean":336,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.947585+0000","log_size":3798,"ondisk_log_size":3798,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":248905728,"num_objects":3798,"num_object_clones":0,"num_object_copies":11394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3798,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3798,"num_write_kb":243072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":322,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.108245+0000","last_change":"2024-02-10T08:29:23.504992+0000","last_active":"2024-02-10T08:33:14.108245+0000","last_peered":"2024-02-10T08:33:14.108245+0000","last_clean":"2024-02-10T08:33:14.108245+0000","last_became_active":"2024-02-10T08:16:56.857856+0000","last_became_peered":"2024-02-10T08:16:56.857856+0000","last_unstale":"2024-02-10T08:33:14.108245+0000","last_undegraded":"2024-02-10T08:33:14.108245+0000","last_fullsized":"2024-02-10T08:33:14.108245+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:23.504892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:23.504892+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"225'17","reported_seq":115,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.105480+0000","last_change":"2024-02-10T08:32:37.438518+0000","last_active":"2024-02-10T08:33:14.105480+0000","last_peered":"2024-02-10T08:33:14.105480+0000","last_clean":"2024-02-10T08:33:14.105480+0000","last_became_active":"2024-02-10T08:32:36.984195+0000","last_became_peered":"2024-02-10T08:32:36.984195+0000","last_unstale":"2024-02-10T08:33:14.105480+0000","last_undegraded":"2024-02-10T08:33:14.105480+0000","last_fullsized":"2024-02-10T08:33:14.105480+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'17","last_scrub_stamp":"2024-02-10T08:28:38.619521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:28:38.619521+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":23,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":367,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.100145+0000","last_change":"2024-02-10T08:32:26.529397+0000","last_active":"2024-02-10T08:33:14.100145+0000","last_peered":"2024-02-10T08:33:14.100145+0000","last_clean":"2024-02-10T08:33:14.100145+0000","last_became_active":"2024-02-10T08:31:33.884021+0000","last_became_peered":"2024-02-10T08:31:33.884021+0000","last_unstale":"2024-02-10T08:33:14.100145+0000","last_undegraded":"2024-02-10T08:33:14.100145+0000","last_fullsized":"2024-02-10T08:33:14.100145+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:26.529314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:11.681169+0000","last_clean_scrub_stamp":"2024-02-10T08:32:26.529314+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"63'5","reported_seq":1304,"reported_epoch":352,"state":"active+clean","last_fresh":"2024-02-10T08:33:16.659605+0000","last_change":"2024-02-10T08:32:19.667323+0000","last_active":"2024-02-10T08:33:16.659605+0000","last_peered":"2024-02-10T08:33:16.659605+0000","last_clean":"2024-02-10T08:33:16.659605+0000","last_became_active":"2024-02-10T08:16:52.780989+0000","last_became_peered":"2024-02-10T08:16:52.780989+0000","last_unstale":"2024-02-10T08:33:16.659605+0000","last_undegraded":"2024-02-10T08:33:16.659605+0000","last_fullsized":"2024-02-10T08:33:16.659605+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'5","last_scrub_stamp":"2024-02-10T08:32:19.667251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:32:19.667251+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":975,"num_read_kb":970,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":334,"reported_epoch":352,"state":"active+clean","last_fresh":"2024-02-10T08:33:17.442371+0000","last_change":"2024-02-10T08:33:17.442371+0000","last_active":"2024-02-10T08:33:17.442371+0000","last_peered":"2024-02-10T08:33:17.442371+0000","last_clean":"2024-02-10T08:33:17.442371+0000","last_became_active":"2024-02-10T08:21:58.549733+0000","last_became_peered":"2024-02-10T08:21:58.549733+0000","last_unstale":"2024-02-10T08:33:17.442371+0000","last_undegraded":"2024-02-10T08:33:17.442371+0000","last_fullsized":"2024-02-10T08:33:17.442371+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:17.442264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:11.750537+0000","last_clean_scrub_stamp":"2024-02-10T08:33:17.442264+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.a","version":"352'3709","reported_seq":3743,"reported_epoch":352,"state":"active+clean","last_fresh":"2024-02-10T08:33:17.620429+0000","last_change":"2024-02-10T08:32:36.979236+0000","last_active":"2024-02-10T08:33:17.620429+0000","last_peered":"2024-02-10T08:33:17.620429+0000","last_clean":"2024-02-10T08:33:17.620429+0000","last_became_active":"2024-02-10T08:32:36.978852+0000","last_became_peered":"2024-02-10T08:32:36.978852+0000","last_unstale":"2024-02-10T08:33:17.620429+0000","last_undegraded":"2024-02-10T08:33:17.620429+0000","last_fullsized":"2024-02-10T08:33:17.620429+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":335,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.947585+0000","log_size":3709,"ondisk_log_size":3709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":243073024,"num_objects":3709,"num_object_clones":0,"num_object_copies":11127,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3709,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3709,"num_write_kb":237376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":23,"reported_epoch":352,"state":"active+clean","last_fresh":"2024-02-10T08:33:15.845421+0000","last_change":"2024-02-10T08:32:36.976472+0000","last_active":"2024-02-10T08:33:15.845421+0000","last_peered":"2024-02-10T08:33:15.845421+0000","last_clean":"2024-02-10T08:33:15.845421+0000","last_became_active":"2024-02-10T08:32:36.976141+0000","last_became_peered":"2024-02-10T08:32:36.976141+0000","last_unstale":"2024-02-10T08:33:15.845421+0000","last_undegraded":"2024-02-10T08:33:15.845421+0000","last_fullsized":"2024-02-10T08:33:15.845421+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:26.703441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:26.703441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"314'42","reported_seq":655,"reported_epoch":352,"state":"active+clean","last_fresh":"2024-02-10T08:33:15.842139+0000","last_change":"2024-02-10T08:33:13.903831+0000","last_active":"2024-02-10T08:33:15.842139+0000","last_peered":"2024-02-10T08:33:15.842139+0000","last_clean":"2024-02-10T08:33:15.842139+0000","last_became_active":"2024-02-10T08:31:33.904487+0000","last_became_peered":"2024-02-10T08:31:33.904487+0000","last_unstale":"2024-02-10T08:33:15.842139+0000","last_undegraded":"2024-02-10T08:33:15.842139+0000","last_fullsized":"2024-02-10T08:33:15.842139+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":315,"parent":"0.0","parent_split_bits":0,"last_scrub":"314'42","last_scrub_stamp":"2024-02-10T08:33:13.903652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:33:13.903652+0000","log_size":42,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":66,"num_read_kb":51,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":716,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":330,"reported_epoch":352,"state":"active+clean","last_fresh":"2024-02-10T08:33:15.952668+0000","last_change":"2024-02-10T08:33:15.952668+0000","last_active":"2024-02-10T08:33:15.952668+0000","last_peered":"2024-02-10T08:33:15.952668+0000","last_clean":"2024-02-10T08:33:15.952668+0000","last_became_active":"2024-02-10T08:16:52.791027+0000","last_became_peered":"2024-02-10T08:16:52.791027+0000","last_unstale":"2024-02-10T08:33:15.952668+0000","last_undegraded":"2024-02-10T08:33:15.952668+0000","last_fullsized":"2024-02-10T08:33:15.952668+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:15.952580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:33:15.952580+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":350,"reported_epoch":352,"state":"active+clean","last_fresh":"2024-02-10T08:33:15.841268+0000","last_change":"2024-02-10T08:32:32.331364+0000","last_active":"2024-02-10T08:33:15.841268+0000","last_peered":"2024-02-10T08:33:15.841268+0000","last_clean":"2024-02-10T08:33:15.841268+0000","last_became_active":"2024-02-10T08:31:33.884295+0000","last_became_peered":"2024-02-10T08:31:33.884295+0000","last_unstale":"2024-02-10T08:33:15.841268+0000","last_undegraded":"2024-02-10T08:33:15.841268+0000","last_fullsized":"2024-02-10T08:33:15.841268+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:32.331286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:32:32.331286+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"352'3803","reported_seq":3828,"reported_epoch":352,"state":"active+clean","last_fresh":"2024-02-10T08:33:17.738780+0000","last_change":"2024-02-10T08:32:30.823074+0000","last_active":"2024-02-10T08:33:17.738780+0000","last_peered":"2024-02-10T08:33:17.738780+0000","last_clean":"2024-02-10T08:33:17.738780+0000","last_became_active":"2024-02-10T08:32:30.822769+0000","last_became_peered":"2024-02-10T08:32:30.822769+0000","last_unstale":"2024-02-10T08:33:17.738780+0000","last_undegraded":"2024-02-10T08:33:17.738780+0000","last_fullsized":"2024-02-10T08:33:17.738780+0000","mapping_epoch":335,"log_start":"0'0","ondisk_log_start":"0'0","created":335,"last_epoch_clean":336,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.947585+0000","log_size":3803,"ondisk_log_size":3803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":249233408,"num_objects":3803,"num_object_clones":0,"num_object_copies":11409,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3803,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3803,"num_write_kb":243392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"255'12","reported_seq":246,"reported_epoch":352,"state":"active+clean","last_fresh":"2024-02-10T08:33:16.178122+0000","last_change":"2024-02-10T08:32:25.571469+0000","last_active":"2024-02-10T08:33:16.178122+0000","last_peered":"2024-02-10T08:33:16.178122+0000","last_clean":"2024-02-10T08:33:16.178122+0000","last_became_active":"2024-02-10T08:28:25.952468+0000","last_became_peered":"2024-02-10T08:28:25.952468+0000","last_unstale":"2024-02-10T08:33:16.178122+0000","last_undegraded":"2024-02-10T08:33:16.178122+0000","last_fullsized":"2024-02-10T08:33:16.178122+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'12","last_scrub_stamp":"2024-02-10T08:32:25.571388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:32:25.571388+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"225'20","reported_seq":364,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.089646+0000","last_change":"2024-02-10T08:29:11.695106+0000","last_active":"2024-02-10T08:33:14.089646+0000","last_peered":"2024-02-10T08:33:14.089646+0000","last_clean":"2024-02-10T08:33:14.089646+0000","last_became_active":"2024-02-10T08:20:46.408495+0000","last_became_peered":"2024-02-10T08:20:46.408495+0000","last_unstale":"2024-02-10T08:33:14.089646+0000","last_undegraded":"2024-02-10T08:33:14.089646+0000","last_fullsized":"2024-02-10T08:33:14.089646+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'20","last_scrub_stamp":"2024-02-10T08:29:11.694999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:29:11.694999+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":344,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.087720+0000","last_change":"2024-02-10T08:33:11.869960+0000","last_active":"2024-02-10T08:33:14.087720+0000","last_peered":"2024-02-10T08:33:14.087720+0000","last_clean":"2024-02-10T08:33:14.087720+0000","last_became_active":"2024-02-10T08:28:02.760784+0000","last_became_peered":"2024-02-10T08:28:02.760784+0000","last_unstale":"2024-02-10T08:33:14.087720+0000","last_undegraded":"2024-02-10T08:33:14.087720+0000","last_fullsized":"2024-02-10T08:33:14.087720+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:11.869839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:33:11.869839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":246,"reported_epoch":352,"state":"active+clean","last_fresh":"2024-02-10T08:33:15.844962+0000","last_change":"2024-02-10T08:29:14.538007+0000","last_active":"2024-02-10T08:33:15.844962+0000","last_peered":"2024-02-10T08:33:15.844962+0000","last_clean":"2024-02-10T08:33:15.844962+0000","last_became_active":"2024-02-10T08:28:25.950240+0000","last_became_peered":"2024-02-10T08:28:25.950240+0000","last_unstale":"2024-02-10T08:33:15.844962+0000","last_undegraded":"2024-02-10T08:33:15.844962+0000","last_fullsized":"2024-02-10T08:33:15.844962+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:14.537940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:14.537940+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"352'3774","reported_seq":3799,"reported_epoch":352,"state":"active+clean","last_fresh":"2024-02-10T08:33:17.688267+0000","last_change":"2024-02-10T08:32:30.825465+0000","last_active":"2024-02-10T08:33:17.688267+0000","last_peered":"2024-02-10T08:33:17.688267+0000","last_clean":"2024-02-10T08:33:17.688267+0000","last_became_active":"2024-02-10T08:32:30.824733+0000","last_became_peered":"2024-02-10T08:32:30.824733+0000","last_unstale":"2024-02-10T08:33:17.688267+0000","last_undegraded":"2024-02-10T08:33:17.688267+0000","last_fullsized":"2024-02-10T08:33:17.688267+0000","mapping_epoch":335,"log_start":"0'0","ondisk_log_start":"0'0","created":335,"last_epoch_clean":336,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.947585+0000","log_size":3774,"ondisk_log_size":3774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":247332864,"num_objects":3774,"num_object_clones":0,"num_object_copies":11322,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3774,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3774,"num_write_kb":241536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":340,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.098220+0000","last_change":"2024-02-10T08:29:14.447872+0000","last_active":"2024-02-10T08:33:14.098220+0000","last_peered":"2024-02-10T08:33:14.098220+0000","last_clean":"2024-02-10T08:33:14.098220+0000","last_became_active":"2024-02-10T08:28:02.777637+0000","last_became_peered":"2024-02-10T08:28:02.777637+0000","last_unstale":"2024-02-10T08:33:14.098220+0000","last_undegraded":"2024-02-10T08:33:14.098220+0000","last_fullsized":"2024-02-10T08:33:14.098220+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:14.447807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:14.447807+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"225'23","reported_seq":382,"reported_epoch":352,"state":"active+clean","last_fresh":"2024-02-10T08:33:15.840841+0000","last_change":"2024-02-10T08:31:34.242669+0000","last_active":"2024-02-10T08:33:15.840841+0000","last_peered":"2024-02-10T08:33:15.840841+0000","last_clean":"2024-02-10T08:33:15.840841+0000","last_became_active":"2024-02-10T08:31:33.884516+0000","last_became_peered":"2024-02-10T08:31:33.884516+0000","last_unstale":"2024-02-10T08:33:15.840841+0000","last_undegraded":"2024-02-10T08:33:15.840841+0000","last_fullsized":"2024-02-10T08:33:15.840841+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'23","last_scrub_stamp":"2024-02-10T08:29:23.027211+0000","last_deep_scrub":"82'17","last_deep_scrub_stamp":"2024-02-10T08:18:21.015873+0000","last_clean_scrub_stamp":"2024-02-10T08:29:23.027211+0000","log_size":23,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":25,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"55'2","reported_seq":342,"reported_epoch":352,"state":"active+clean","last_fresh":"2024-02-10T08:33:15.840852+0000","last_change":"2024-02-10T08:29:22.034366+0000","last_active":"2024-02-10T08:33:15.840852+0000","last_peered":"2024-02-10T08:33:15.840852+0000","last_clean":"2024-02-10T08:33:15.840852+0000","last_became_active":"2024-02-10T08:28:02.768279+0000","last_became_peered":"2024-02-10T08:28:02.768279+0000","last_unstale":"2024-02-10T08:33:15.840852+0000","last_undegraded":"2024-02-10T08:33:15.840852+0000","last_fullsized":"2024-02-10T08:33:15.840852+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'2","last_scrub_stamp":"2024-02-10T08:29:22.034268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:29:22.034268+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":184,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":235,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.101883+0000","last_change":"2024-02-10T08:30:24.073702+0000","last_active":"2024-02-10T08:33:14.101883+0000","last_peered":"2024-02-10T08:33:14.101883+0000","last_clean":"2024-02-10T08:33:14.101883+0000","last_became_active":"2024-02-10T08:30:24.073077+0000","last_became_peered":"2024-02-10T08:30:24.073077+0000","last_unstale":"2024-02-10T08:33:14.101883+0000","last_undegraded":"2024-02-10T08:33:14.101883+0000","last_fullsized":"2024-02-10T08:33:14.101883+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:26:20.173948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:26:20.173948+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"225'15","reported_seq":33,"reported_epoch":352,"state":"active+clean","last_fresh":"2024-02-10T08:33:15.846196+0000","last_change":"2024-02-10T08:32:38.444804+0000","last_active":"2024-02-10T08:33:15.846196+0000","last_peered":"2024-02-10T08:33:15.846196+0000","last_clean":"2024-02-10T08:33:15.846196+0000","last_became_active":"2024-02-10T08:32:36.982716+0000","last_became_peered":"2024-02-10T08:32:36.982716+0000","last_unstale":"2024-02-10T08:33:15.846196+0000","last_undegraded":"2024-02-10T08:33:15.846196+0000","last_fullsized":"2024-02-10T08:33:15.846196+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'15","last_scrub_stamp":"2024-02-10T08:29:09.329160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:29:09.329160+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"55'1","reported_seq":396,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.098132+0000","last_change":"2024-02-10T08:32:11.524846+0000","last_active":"2024-02-10T08:33:14.098132+0000","last_peered":"2024-02-10T08:33:14.098132+0000","last_clean":"2024-02-10T08:33:14.098132+0000","last_became_active":"2024-02-10T08:28:02.778857+0000","last_became_peered":"2024-02-10T08:28:02.778857+0000","last_unstale":"2024-02-10T08:33:14.098132+0000","last_undegraded":"2024-02-10T08:33:14.098132+0000","last_fullsized":"2024-02-10T08:33:14.098132+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'1","last_scrub_stamp":"2024-02-10T08:32:11.524771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:32:11.524771+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":716,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":269,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.088827+0000","last_change":"2024-02-10T08:32:24.674330+0000","last_active":"2024-02-10T08:33:14.088827+0000","last_peered":"2024-02-10T08:33:14.088827+0000","last_clean":"2024-02-10T08:33:14.088827+0000","last_became_active":"2024-02-10T08:31:33.891489+0000","last_became_peered":"2024-02-10T08:31:33.891489+0000","last_unstale":"2024-02-10T08:33:14.088827+0000","last_undegraded":"2024-02-10T08:33:14.088827+0000","last_fullsized":"2024-02-10T08:33:14.088827+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:24.672029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:32:24.672029+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":190,"reported_epoch":352,"state":"active+clean","last_fresh":"2024-02-10T08:33:15.845535+0000","last_change":"2024-02-10T08:29:24.514793+0000","last_active":"2024-02-10T08:33:15.845535+0000","last_peered":"2024-02-10T08:33:15.845535+0000","last_clean":"2024-02-10T08:33:15.845535+0000","last_became_active":"2024-02-10T08:28:25.999252+0000","last_became_peered":"2024-02-10T08:28:25.999252+0000","last_unstale":"2024-02-10T08:33:15.845535+0000","last_undegraded":"2024-02-10T08:33:15.845535+0000","last_fullsized":"2024-02-10T08:33:15.845535+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:24.514690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:24.514690+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"225'15","reported_seq":298,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.105715+0000","last_change":"2024-02-10T08:32:23.310599+0000","last_active":"2024-02-10T08:33:14.105715+0000","last_peered":"2024-02-10T08:33:14.105715+0000","last_clean":"2024-02-10T08:33:14.105715+0000","last_became_active":"2024-02-10T08:31:33.891813+0000","last_became_peered":"2024-02-10T08:31:33.891813+0000","last_unstale":"2024-02-10T08:33:14.105715+0000","last_undegraded":"2024-02-10T08:33:14.105715+0000","last_fullsized":"2024-02-10T08:33:14.105715+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'15","last_scrub_stamp":"2024-02-10T08:32:23.310489+0000","last_deep_scrub":"223'9","last_deep_scrub_stamp":"2024-02-10T08:26:33.158025+0000","last_clean_scrub_stamp":"2024-02-10T08:32:23.310489+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":392,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.095822+0000","last_change":"2024-02-10T08:32:22.293976+0000","last_active":"2024-02-10T08:33:14.095822+0000","last_peered":"2024-02-10T08:33:14.095822+0000","last_clean":"2024-02-10T08:33:14.095822+0000","last_became_active":"2024-02-10T08:31:46.053553+0000","last_became_peered":"2024-02-10T08:31:46.053553+0000","last_unstale":"2024-02-10T08:33:14.095822+0000","last_undegraded":"2024-02-10T08:33:14.095822+0000","last_fullsized":"2024-02-10T08:33:14.095822+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:22.293905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:32:22.293905+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":321,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.091814+0000","last_change":"2024-02-10T08:29:12.163752+0000","last_active":"2024-02-10T08:33:14.091814+0000","last_peered":"2024-02-10T08:33:14.091814+0000","last_clean":"2024-02-10T08:33:14.091814+0000","last_became_active":"2024-02-10T08:16:56.863948+0000","last_became_peered":"2024-02-10T08:16:56.863948+0000","last_unstale":"2024-02-10T08:33:14.091814+0000","last_undegraded":"2024-02-10T08:33:14.091814+0000","last_fullsized":"2024-02-10T08:33:14.091814+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:12.163638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:12.163638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":329,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.104445+0000","last_change":"2024-02-10T08:28:33.229127+0000","last_active":"2024-02-10T08:33:14.104445+0000","last_peered":"2024-02-10T08:33:14.104445+0000","last_clean":"2024-02-10T08:33:14.104445+0000","last_became_active":"2024-02-10T08:20:46.398903+0000","last_became_peered":"2024-02-10T08:20:46.398903+0000","last_unstale":"2024-02-10T08:33:14.104445+0000","last_undegraded":"2024-02-10T08:33:14.104445+0000","last_fullsized":"2024-02-10T08:33:14.104445+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:33.229018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:33.229018+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"225'20","reported_seq":273,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.087893+0000","last_change":"2024-02-10T08:32:23.661124+0000","last_active":"2024-02-10T08:33:14.087893+0000","last_peered":"2024-02-10T08:33:14.087893+0000","last_clean":"2024-02-10T08:33:14.087893+0000","last_became_active":"2024-02-10T08:22:23.534081+0000","last_became_peered":"2024-02-10T08:22:23.534081+0000","last_unstale":"2024-02-10T08:33:14.087893+0000","last_undegraded":"2024-02-10T08:33:14.087893+0000","last_fullsized":"2024-02-10T08:33:14.087893+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'20","last_scrub_stamp":"2024-02-10T08:32:23.661032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:32:23.661032+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":24,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":330,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.090795+0000","last_change":"2024-02-10T08:32:16.110041+0000","last_active":"2024-02-10T08:33:14.090795+0000","last_peered":"2024-02-10T08:33:14.090795+0000","last_clean":"2024-02-10T08:33:14.090795+0000","last_became_active":"2024-02-10T08:16:52.789834+0000","last_became_peered":"2024-02-10T08:16:52.789834+0000","last_unstale":"2024-02-10T08:33:14.090795+0000","last_undegraded":"2024-02-10T08:33:14.090795+0000","last_fullsized":"2024-02-10T08:33:14.090795+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:16.109957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:32:16.109957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"244'12","reported_seq":572,"reported_epoch":352,"state":"active+clean","last_fresh":"2024-02-10T08:33:15.843814+0000","last_change":"2024-02-10T08:32:11.142599+0000","last_active":"2024-02-10T08:33:15.843814+0000","last_peered":"2024-02-10T08:33:15.843814+0000","last_clean":"2024-02-10T08:33:15.843814+0000","last_became_active":"2024-02-10T08:28:02.776097+0000","last_became_peered":"2024-02-10T08:28:02.776097+0000","last_unstale":"2024-02-10T08:33:15.843814+0000","last_undegraded":"2024-02-10T08:33:15.843814+0000","last_fullsized":"2024-02-10T08:33:15.843814+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"244'12","last_scrub_stamp":"2024-02-10T08:32:11.142513+0000","last_deep_scrub":"89'9","last_deep_scrub_stamp":"2024-02-10T08:19:33.299671+0000","last_clean_scrub_stamp":"2024-02-10T08:32:11.142513+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":28,"reported_epoch":352,"state":"active+clean","last_fresh":"2024-02-10T08:33:15.846284+0000","last_change":"2024-02-10T08:33:07.663592+0000","last_active":"2024-02-10T08:33:15.846284+0000","last_peered":"2024-02-10T08:33:15.846284+0000","last_clean":"2024-02-10T08:33:15.846284+0000","last_became_active":"2024-02-10T08:32:36.983153+0000","last_became_peered":"2024-02-10T08:32:36.983153+0000","last_unstale":"2024-02-10T08:33:15.846284+0000","last_undegraded":"2024-02-10T08:33:15.846284+0000","last_fullsized":"2024-02-10T08:33:15.846284+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:07.663498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:05.662947+0000","last_clean_scrub_stamp":"2024-02-10T08:33:07.663498+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"225'19","reported_seq":352,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.090744+0000","last_change":"2024-02-10T08:29:09.148326+0000","last_active":"2024-02-10T08:33:14.090744+0000","last_peered":"2024-02-10T08:33:14.090744+0000","last_clean":"2024-02-10T08:33:14.090744+0000","last_became_active":"2024-02-10T08:16:55.204734+0000","last_became_peered":"2024-02-10T08:16:55.204734+0000","last_unstale":"2024-02-10T08:33:14.090744+0000","last_undegraded":"2024-02-10T08:33:14.090744+0000","last_fullsized":"2024-02-10T08:33:14.090744+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'19","last_scrub_stamp":"2024-02-10T08:29:09.148231+0000","last_deep_scrub":"213'13","last_deep_scrub_stamp":"2024-02-10T08:25:43.713333+0000","last_clean_scrub_stamp":"2024-02-10T08:29:09.148231+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":23,"reported_epoch":352,"state":"active+clean","last_fresh":"2024-02-10T08:33:15.845324+0000","last_change":"2024-02-10T08:32:36.981055+0000","last_active":"2024-02-10T08:33:15.845324+0000","last_peered":"2024-02-10T08:33:15.845324+0000","last_clean":"2024-02-10T08:33:15.845324+0000","last_became_active":"2024-02-10T08:32:36.980715+0000","last_became_peered":"2024-02-10T08:32:36.980715+0000","last_unstale":"2024-02-10T08:33:15.845324+0000","last_undegraded":"2024-02-10T08:33:15.845324+0000","last_fullsized":"2024-02-10T08:33:15.845324+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:21.299448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:32:21.299448+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"314'11","reported_seq":408,"reported_epoch":352,"state":"active+clean","last_fresh":"2024-02-10T08:33:15.836597+0000","last_change":"2024-02-10T08:32:15.210339+0000","last_active":"2024-02-10T08:33:15.836597+0000","last_peered":"2024-02-10T08:33:15.836597+0000","last_clean":"2024-02-10T08:33:15.836597+0000","last_became_active":"2024-02-10T08:31:33.885840+0000","last_became_peered":"2024-02-10T08:31:33.885840+0000","last_unstale":"2024-02-10T08:33:15.836597+0000","last_undegraded":"2024-02-10T08:33:15.836597+0000","last_fullsized":"2024-02-10T08:33:15.836597+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"314'11","last_scrub_stamp":"2024-02-10T08:32:15.210224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:32:15.210224+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":307,"reported_epoch":352,"state":"active+clean","last_fresh":"2024-02-10T08:33:15.840574+0000","last_change":"2024-02-10T08:32:12.342121+0000","last_active":"2024-02-10T08:33:15.840574+0000","last_peered":"2024-02-10T08:33:15.840574+0000","last_clean":"2024-02-10T08:33:15.840574+0000","last_became_active":"2024-02-10T08:20:46.395788+0000","last_became_peered":"2024-02-10T08:20:46.395788+0000","last_unstale":"2024-02-10T08:33:15.840574+0000","last_undegraded":"2024-02-10T08:33:15.840574+0000","last_fullsized":"2024-02-10T08:33:15.840574+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:12.342020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:32:12.342020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"225'15","reported_seq":333,"reported_epoch":352,"state":"active+clean","last_fresh":"2024-02-10T08:33:15.846305+0000","last_change":"2024-02-10T08:32:13.529400+0000","last_active":"2024-02-10T08:33:15.846305+0000","last_peered":"2024-02-10T08:33:15.846305+0000","last_clean":"2024-02-10T08:33:15.846305+0000","last_became_active":"2024-02-10T08:28:25.952354+0000","last_became_peered":"2024-02-10T08:28:25.952354+0000","last_unstale":"2024-02-10T08:33:15.846305+0000","last_undegraded":"2024-02-10T08:33:15.846305+0000","last_fullsized":"2024-02-10T08:33:15.846305+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'15","last_scrub_stamp":"2024-02-10T08:32:13.529289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:32:13.529289+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":337,"reported_epoch":352,"state":"active+clean","last_fresh":"2024-02-10T08:33:16.205688+0000","last_change":"2024-02-10T08:33:16.205688+0000","last_active":"2024-02-10T08:33:16.205688+0000","last_peered":"2024-02-10T08:33:16.205688+0000","last_clean":"2024-02-10T08:33:16.205688+0000","last_became_active":"2024-02-10T08:16:52.786213+0000","last_became_peered":"2024-02-10T08:16:52.786213+0000","last_unstale":"2024-02-10T08:33:16.205688+0000","last_undegraded":"2024-02-10T08:33:16.205688+0000","last_fullsized":"2024-02-10T08:33:16.205688+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:16.205603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:33:16.205603+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":155,"reported_epoch":352,"state":"active+clean","last_fresh":"2024-02-10T08:33:15.845645+0000","last_change":"2024-02-10T08:29:01.325236+0000","last_active":"2024-02-10T08:33:15.845645+0000","last_peered":"2024-02-10T08:33:15.845645+0000","last_clean":"2024-02-10T08:33:15.845645+0000","last_became_active":"2024-02-10T08:28:25.950221+0000","last_became_peered":"2024-02-10T08:28:25.950221+0000","last_unstale":"2024-02-10T08:33:15.845645+0000","last_undegraded":"2024-02-10T08:33:15.845645+0000","last_fullsized":"2024-02-10T08:33:15.845645+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:01.325135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:01.325135+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":161,"reported_epoch":352,"state":"active+clean","last_fresh":"2024-02-10T08:33:15.845176+0000","last_change":"2024-02-10T08:30:24.070738+0000","last_active":"2024-02-10T08:33:15.845176+0000","last_peered":"2024-02-10T08:33:15.845176+0000","last_clean":"2024-02-10T08:33:15.845176+0000","last_became_active":"2024-02-10T08:30:24.070440+0000","last_became_peered":"2024-02-10T08:30:24.070440+0000","last_unstale":"2024-02-10T08:33:15.845176+0000","last_undegraded":"2024-02-10T08:33:15.845176+0000","last_fullsized":"2024-02-10T08:33:15.845176+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:11.496105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:11.496105+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"225'24","reported_seq":366,"reported_epoch":352,"state":"active+clean","last_fresh":"2024-02-10T08:33:15.840166+0000","last_change":"2024-02-10T08:33:06.269127+0000","last_active":"2024-02-10T08:33:15.840166+0000","last_peered":"2024-02-10T08:33:15.840166+0000","last_clean":"2024-02-10T08:33:15.840166+0000","last_became_active":"2024-02-10T08:20:46.396130+0000","last_became_peered":"2024-02-10T08:20:46.396130+0000","last_unstale":"2024-02-10T08:33:15.840166+0000","last_undegraded":"2024-02-10T08:33:15.840166+0000","last_fullsized":"2024-02-10T08:33:15.840166+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'24","last_scrub_stamp":"2024-02-10T08:33:06.269024+0000","last_deep_scrub":"201'16","last_deep_scrub_stamp":"2024-02-10T08:24:49.177357+0000","last_clean_scrub_stamp":"2024-02-10T08:33:06.269024+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":348,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.091352+0000","last_change":"2024-02-10T08:33:10.874200+0000","last_active":"2024-02-10T08:33:14.091352+0000","last_peered":"2024-02-10T08:33:14.091352+0000","last_clean":"2024-02-10T08:33:14.091352+0000","last_became_active":"2024-02-10T08:32:36.974379+0000","last_became_peered":"2024-02-10T08:32:36.974379+0000","last_unstale":"2024-02-10T08:33:14.091352+0000","last_undegraded":"2024-02-10T08:33:14.091352+0000","last_fullsized":"2024-02-10T08:33:14.091352+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:10.874017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:33:10.874017+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":342,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.089721+0000","last_change":"2024-02-10T08:33:06.791408+0000","last_active":"2024-02-10T08:33:14.089721+0000","last_peered":"2024-02-10T08:33:14.089721+0000","last_clean":"2024-02-10T08:33:14.089721+0000","last_became_active":"2024-02-10T08:31:33.893973+0000","last_became_peered":"2024-02-10T08:31:33.893973+0000","last_unstale":"2024-02-10T08:33:14.089721+0000","last_undegraded":"2024-02-10T08:33:14.089721+0000","last_fullsized":"2024-02-10T08:33:14.089721+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:06.791295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:33:06.791295+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":23,"reported_epoch":352,"state":"active+clean","last_fresh":"2024-02-10T08:33:15.844938+0000","last_change":"2024-02-10T08:32:36.979428+0000","last_active":"2024-02-10T08:33:15.844938+0000","last_peered":"2024-02-10T08:33:15.844938+0000","last_clean":"2024-02-10T08:33:15.844938+0000","last_became_active":"2024-02-10T08:32:36.979093+0000","last_became_peered":"2024-02-10T08:32:36.979093+0000","last_unstale":"2024-02-10T08:33:15.844938+0000","last_undegraded":"2024-02-10T08:33:15.844938+0000","last_fullsized":"2024-02-10T08:33:15.844938+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:27.240244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:27.240244+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,5],"acting":[0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"225'8","reported_seq":255,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.087187+0000","last_change":"2024-02-10T08:32:15.627778+0000","last_active":"2024-02-10T08:33:14.087187+0000","last_peered":"2024-02-10T08:33:14.087187+0000","last_clean":"2024-02-10T08:33:14.087187+0000","last_became_active":"2024-02-10T08:22:23.522936+0000","last_became_peered":"2024-02-10T08:22:23.522936+0000","last_unstale":"2024-02-10T08:33:14.087187+0000","last_undegraded":"2024-02-10T08:33:14.087187+0000","last_fullsized":"2024-02-10T08:33:14.087187+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'8","last_scrub_stamp":"2024-02-10T08:32:15.627709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:32:15.627709+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,6],"acting":[1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":330,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.091875+0000","last_change":"2024-02-10T08:29:10.131158+0000","last_active":"2024-02-10T08:33:14.091875+0000","last_peered":"2024-02-10T08:33:14.091875+0000","last_clean":"2024-02-10T08:33:14.091875+0000","last_became_active":"2024-02-10T08:16:52.788704+0000","last_became_peered":"2024-02-10T08:16:52.788704+0000","last_unstale":"2024-02-10T08:33:14.091875+0000","last_undegraded":"2024-02-10T08:33:14.091875+0000","last_fullsized":"2024-02-10T08:33:14.091875+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:10.131056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:29:10.131056+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":336,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.095743+0000","last_change":"2024-02-10T08:32:27.229239+0000","last_active":"2024-02-10T08:33:14.095743+0000","last_peered":"2024-02-10T08:33:14.095743+0000","last_clean":"2024-02-10T08:33:14.095743+0000","last_became_active":"2024-02-10T08:20:46.397495+0000","last_became_peered":"2024-02-10T08:20:46.397495+0000","last_unstale":"2024-02-10T08:33:14.095743+0000","last_undegraded":"2024-02-10T08:33:14.095743+0000","last_fullsized":"2024-02-10T08:33:14.095743+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:27.229143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:32:27.229143+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":343,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.101361+0000","last_change":"2024-02-10T08:30:24.064805+0000","last_active":"2024-02-10T08:33:14.101361+0000","last_peered":"2024-02-10T08:33:14.101361+0000","last_clean":"2024-02-10T08:33:14.101361+0000","last_became_active":"2024-02-10T08:30:24.064419+0000","last_became_peered":"2024-02-10T08:30:24.064419+0000","last_unstale":"2024-02-10T08:33:14.101361+0000","last_undegraded":"2024-02-10T08:33:14.101361+0000","last_fullsized":"2024-02-10T08:33:14.101361+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:12.421034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:27.276490+0000","last_clean_scrub_stamp":"2024-02-10T08:29:12.421034+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"225'19","reported_seq":274,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.101364+0000","last_change":"2024-02-10T08:29:22.312103+0000","last_active":"2024-02-10T08:33:14.101364+0000","last_peered":"2024-02-10T08:33:14.101364+0000","last_clean":"2024-02-10T08:33:14.101364+0000","last_became_active":"2024-02-10T08:22:23.526198+0000","last_became_peered":"2024-02-10T08:22:23.526198+0000","last_unstale":"2024-02-10T08:33:14.101364+0000","last_undegraded":"2024-02-10T08:33:14.101364+0000","last_fullsized":"2024-02-10T08:33:14.101364+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'19","last_scrub_stamp":"2024-02-10T08:29:22.312001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:29:22.312001+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":24,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":330,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.098595+0000","last_change":"2024-02-10T08:32:30.241685+0000","last_active":"2024-02-10T08:33:14.098595+0000","last_peered":"2024-02-10T08:33:14.098595+0000","last_clean":"2024-02-10T08:33:14.098595+0000","last_became_active":"2024-02-10T08:16:52.788629+0000","last_became_peered":"2024-02-10T08:16:52.788629+0000","last_unstale":"2024-02-10T08:33:14.098595+0000","last_undegraded":"2024-02-10T08:33:14.098595+0000","last_fullsized":"2024-02-10T08:33:14.098595+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:30.241592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:38.360929+0000","last_clean_scrub_stamp":"2024-02-10T08:32:30.241592+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":336,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.102557+0000","last_change":"2024-02-10T08:29:19.380493+0000","last_active":"2024-02-10T08:33:14.102557+0000","last_peered":"2024-02-10T08:33:14.102557+0000","last_clean":"2024-02-10T08:33:14.102557+0000","last_became_active":"2024-02-10T08:20:46.399838+0000","last_became_peered":"2024-02-10T08:20:46.399838+0000","last_unstale":"2024-02-10T08:33:14.102557+0000","last_undegraded":"2024-02-10T08:33:14.102557+0000","last_fullsized":"2024-02-10T08:33:14.102557+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:19.380403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:19.380403+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":23,"reported_epoch":352,"state":"active+clean","last_fresh":"2024-02-10T08:33:15.845352+0000","last_change":"2024-02-10T08:32:36.984329+0000","last_active":"2024-02-10T08:33:15.845352+0000","last_peered":"2024-02-10T08:33:15.845352+0000","last_clean":"2024-02-10T08:33:15.845352+0000","last_became_active":"2024-02-10T08:32:36.982778+0000","last_became_peered":"2024-02-10T08:32:36.982778+0000","last_unstale":"2024-02-10T08:33:15.845352+0000","last_undegraded":"2024-02-10T08:33:15.845352+0000","last_fullsized":"2024-02-10T08:33:15.845352+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:34.502781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:34.502781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"225'25","reported_seq":437,"reported_epoch":352,"state":"active+clean","last_fresh":"2024-02-10T08:33:15.846609+0000","last_change":"2024-02-10T08:32:32.566504+0000","last_active":"2024-02-10T08:33:15.846609+0000","last_peered":"2024-02-10T08:33:15.846609+0000","last_clean":"2024-02-10T08:33:15.846609+0000","last_became_active":"2024-02-10T08:31:33.879680+0000","last_became_peered":"2024-02-10T08:31:33.879680+0000","last_unstale":"2024-02-10T08:33:15.846609+0000","last_undegraded":"2024-02-10T08:33:15.846609+0000","last_fullsized":"2024-02-10T08:33:15.846609+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'25","last_scrub_stamp":"2024-02-10T08:32:32.566437+0000","last_deep_scrub":"74'15","last_deep_scrub_stamp":"2024-02-10T08:17:57.637346+0000","last_clean_scrub_stamp":"2024-02-10T08:32:32.566437+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":24,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":340,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.090800+0000","last_change":"2024-02-10T08:29:26.072110+0000","last_active":"2024-02-10T08:33:14.090800+0000","last_peered":"2024-02-10T08:33:14.090800+0000","last_clean":"2024-02-10T08:33:14.090800+0000","last_became_active":"2024-02-10T08:20:46.392466+0000","last_became_peered":"2024-02-10T08:20:46.392466+0000","last_unstale":"2024-02-10T08:33:14.090800+0000","last_undegraded":"2024-02-10T08:33:14.090800+0000","last_fullsized":"2024-02-10T08:33:14.090800+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:26.072031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:29:26.072031+0000","last_clean_scrub_stamp":"2024-02-10T08:29:26.072031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1f","version":"111'11","reported_seq":550,"reported_epoch":352,"state":"active+clean","last_fresh":"2024-02-10T08:33:15.845899+0000","last_change":"2024-02-10T08:32:17.249799+0000","last_active":"2024-02-10T08:33:15.845899+0000","last_peered":"2024-02-10T08:33:15.845899+0000","last_clean":"2024-02-10T08:33:15.845899+0000","last_became_active":"2024-02-10T08:20:46.402663+0000","last_became_peered":"2024-02-10T08:20:46.402663+0000","last_unstale":"2024-02-10T08:33:15.845899+0000","last_undegraded":"2024-02-10T08:33:15.845899+0000","last_fullsized":"2024-02-10T08:33:15.845899+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'11","last_scrub_stamp":"2024-02-10T08:32:17.249718+0000","last_deep_scrub":"111'11","last_deep_scrub_stamp":"2024-02-10T08:32:17.249718+0000","last_clean_scrub_stamp":"2024-02-10T08:32:17.249718+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"87'2","reported_seq":321,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.107218+0000","last_change":"2024-02-10T08:28:37.261008+0000","last_active":"2024-02-10T08:33:14.107218+0000","last_peered":"2024-02-10T08:33:14.107218+0000","last_clean":"2024-02-10T08:33:14.107218+0000","last_became_active":"2024-02-10T08:16:58.859047+0000","last_became_peered":"2024-02-10T08:16:58.859047+0000","last_unstale":"2024-02-10T08:33:14.107218+0000","last_undegraded":"2024-02-10T08:33:14.107218+0000","last_fullsized":"2024-02-10T08:33:14.107218+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'2","last_scrub_stamp":"2024-02-10T08:28:37.260945+0000","last_deep_scrub":"87'2","last_deep_scrub_stamp":"2024-02-10T08:19:29.207531+0000","last_clean_scrub_stamp":"2024-02-10T08:28:37.260945+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"225'19","reported_seq":362,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.098818+0000","last_change":"2024-02-10T08:33:12.217164+0000","last_active":"2024-02-10T08:33:14.098818+0000","last_peered":"2024-02-10T08:33:14.098818+0000","last_clean":"2024-02-10T08:33:14.098818+0000","last_became_active":"2024-02-10T08:16:54.852665+0000","last_became_peered":"2024-02-10T08:16:54.852665+0000","last_unstale":"2024-02-10T08:33:14.098818+0000","last_undegraded":"2024-02-10T08:33:14.098818+0000","last_fullsized":"2024-02-10T08:33:14.098818+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'19","last_scrub_stamp":"2024-02-10T08:33:12.217009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:33:12.217009+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":267,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.095667+0000","last_change":"2024-02-10T08:31:33.878792+0000","last_active":"2024-02-10T08:33:14.095667+0000","last_peered":"2024-02-10T08:33:14.095667+0000","last_clean":"2024-02-10T08:33:14.095667+0000","last_became_active":"2024-02-10T08:31:33.878473+0000","last_became_peered":"2024-02-10T08:31:33.878473+0000","last_unstale":"2024-02-10T08:33:14.095667+0000","last_undegraded":"2024-02-10T08:33:14.095667+0000","last_fullsized":"2024-02-10T08:33:14.095667+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:14.469285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:25:42.124914+0000","last_clean_scrub_stamp":"2024-02-10T08:29:14.469285+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":157,"reported_epoch":352,"state":"active+clean","last_fresh":"2024-02-10T08:33:15.846702+0000","last_change":"2024-02-10T08:32:26.589167+0000","last_active":"2024-02-10T08:33:15.846702+0000","last_peered":"2024-02-10T08:33:15.846702+0000","last_clean":"2024-02-10T08:33:15.846702+0000","last_became_active":"2024-02-10T08:28:25.951312+0000","last_became_peered":"2024-02-10T08:28:25.951312+0000","last_unstale":"2024-02-10T08:33:15.846702+0000","last_undegraded":"2024-02-10T08:33:15.846702+0000","last_fullsized":"2024-02-10T08:33:15.846702+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:26.589082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:32:26.589082+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":330,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.091242+0000","last_change":"2024-02-10T08:29:20.739901+0000","last_active":"2024-02-10T08:33:14.091242+0000","last_peered":"2024-02-10T08:33:14.091242+0000","last_clean":"2024-02-10T08:33:14.091242+0000","last_became_active":"2024-02-10T08:20:46.408504+0000","last_became_peered":"2024-02-10T08:20:46.408504+0000","last_unstale":"2024-02-10T08:33:14.091242+0000","last_undegraded":"2024-02-10T08:33:14.091242+0000","last_fullsized":"2024-02-10T08:33:14.091242+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:20.739750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:22.104988+0000","last_clean_scrub_stamp":"2024-02-10T08:29:20.739750+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"330'34","reported_seq":429,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.106792+0000","last_change":"2024-02-10T08:32:17.481894+0000","last_active":"2024-02-10T08:33:14.106792+0000","last_peered":"2024-02-10T08:33:14.106792+0000","last_clean":"2024-02-10T08:33:14.106792+0000","last_became_active":"2024-02-10T08:31:33.894960+0000","last_became_peered":"2024-02-10T08:31:33.894960+0000","last_unstale":"2024-02-10T08:33:14.106792+0000","last_undegraded":"2024-02-10T08:33:14.106792+0000","last_fullsized":"2024-02-10T08:33:14.106792+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"330'34","last_scrub_stamp":"2024-02-10T08:32:17.481832+0000","last_deep_scrub":"330'34","last_deep_scrub_stamp":"2024-02-10T08:32:17.481832+0000","last_clean_scrub_stamp":"2024-02-10T08:32:17.481832+0000","log_size":34,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":345,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.099170+0000","last_change":"2024-02-10T08:33:13.175633+0000","last_active":"2024-02-10T08:33:14.099170+0000","last_peered":"2024-02-10T08:33:14.099170+0000","last_clean":"2024-02-10T08:33:14.099170+0000","last_became_active":"2024-02-10T08:20:46.396303+0000","last_became_peered":"2024-02-10T08:20:46.396303+0000","last_unstale":"2024-02-10T08:33:14.099170+0000","last_undegraded":"2024-02-10T08:33:14.099170+0000","last_fullsized":"2024-02-10T08:33:14.099170+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:13.175559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:10.370746+0000","last_clean_scrub_stamp":"2024-02-10T08:33:13.175559+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":350,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.091475+0000","last_change":"2024-02-10T08:29:25.682482+0000","last_active":"2024-02-10T08:33:14.091475+0000","last_peered":"2024-02-10T08:33:14.091475+0000","last_clean":"2024-02-10T08:33:14.091475+0000","last_became_active":"2024-02-10T08:28:02.763523+0000","last_became_peered":"2024-02-10T08:28:02.763523+0000","last_unstale":"2024-02-10T08:33:14.091475+0000","last_undegraded":"2024-02-10T08:33:14.091475+0000","last_fullsized":"2024-02-10T08:33:14.091475+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:25.682383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:25.682383+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":304,"reported_epoch":353,"state":"active+clean","last_fresh":"2024-02-10T08:33:19.356128+0000","last_change":"2024-02-10T08:33:19.356128+0000","last_active":"2024-02-10T08:33:19.356128+0000","last_peered":"2024-02-10T08:33:19.356128+0000","last_clean":"2024-02-10T08:33:19.356128+0000","last_became_active":"2024-02-10T08:20:46.403378+0000","last_became_peered":"2024-02-10T08:20:46.403378+0000","last_unstale":"2024-02-10T08:33:19.356128+0000","last_undegraded":"2024-02-10T08:33:19.356128+0000","last_fullsized":"2024-02-10T08:33:19.356128+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:19.356038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:33:19.356038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"226'23","reported_seq":332,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.091434+0000","last_change":"2024-02-10T08:31:34.341047+0000","last_active":"2024-02-10T08:33:14.091434+0000","last_peered":"2024-02-10T08:33:14.091434+0000","last_clean":"2024-02-10T08:33:14.091434+0000","last_became_active":"2024-02-10T08:31:33.891562+0000","last_became_peered":"2024-02-10T08:31:33.891562+0000","last_unstale":"2024-02-10T08:33:14.091434+0000","last_undegraded":"2024-02-10T08:33:14.091434+0000","last_fullsized":"2024-02-10T08:33:14.091434+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"226'23","last_scrub_stamp":"2024-02-10T08:29:19.670143+0000","last_deep_scrub":"74'17","last_deep_scrub_stamp":"2024-02-10T08:18:02.949298+0000","last_clean_scrub_stamp":"2024-02-10T08:29:19.670143+0000","log_size":23,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":25,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":249,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.102015+0000","last_change":"2024-02-10T08:32:22.275761+0000","last_active":"2024-02-10T08:33:14.102015+0000","last_peered":"2024-02-10T08:33:14.102015+0000","last_clean":"2024-02-10T08:33:14.102015+0000","last_became_active":"2024-02-10T08:31:33.879918+0000","last_became_peered":"2024-02-10T08:31:33.879918+0000","last_unstale":"2024-02-10T08:33:14.102015+0000","last_undegraded":"2024-02-10T08:33:14.102015+0000","last_fullsized":"2024-02-10T08:33:14.102015+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:22.275679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:32:22.275679+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":301,"reported_epoch":352,"state":"active+clean","last_fresh":"2024-02-10T08:33:15.841015+0000","last_change":"2024-02-10T08:32:17.352870+0000","last_active":"2024-02-10T08:33:15.841015+0000","last_peered":"2024-02-10T08:33:15.841015+0000","last_clean":"2024-02-10T08:33:15.841015+0000","last_became_active":"2024-02-10T08:20:46.398532+0000","last_became_peered":"2024-02-10T08:20:46.398532+0000","last_unstale":"2024-02-10T08:33:15.841015+0000","last_undegraded":"2024-02-10T08:33:15.841015+0000","last_fullsized":"2024-02-10T08:33:15.841015+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:17.352797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:32:17.352797+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":236,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.098953+0000","last_change":"2024-02-10T08:32:15.313492+0000","last_active":"2024-02-10T08:33:14.098953+0000","last_peered":"2024-02-10T08:33:14.098953+0000","last_clean":"2024-02-10T08:33:14.098953+0000","last_became_active":"2024-02-10T08:22:23.526229+0000","last_became_peered":"2024-02-10T08:22:23.526229+0000","last_unstale":"2024-02-10T08:33:14.098953+0000","last_undegraded":"2024-02-10T08:33:14.098953+0000","last_fullsized":"2024-02-10T08:33:14.098953+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:15.313394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:32:15.313394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1a","version":"225'15","reported_seq":55,"reported_epoch":352,"state":"active+clean","last_fresh":"2024-02-10T08:33:15.841825+0000","last_change":"2024-02-10T08:31:46.145013+0000","last_active":"2024-02-10T08:33:15.841825+0000","last_peered":"2024-02-10T08:33:15.841825+0000","last_clean":"2024-02-10T08:33:15.841825+0000","last_became_active":"2024-02-10T08:31:46.069680+0000","last_became_peered":"2024-02-10T08:31:46.069680+0000","last_unstale":"2024-02-10T08:33:15.841825+0000","last_undegraded":"2024-02-10T08:33:15.841825+0000","last_fullsized":"2024-02-10T08:33:15.841825+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'15","last_scrub_stamp":"2024-02-10T08:29:13.500017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:29:13.500017+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":325,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.106871+0000","last_change":"2024-02-10T08:29:26.213501+0000","last_active":"2024-02-10T08:33:14.106871+0000","last_peered":"2024-02-10T08:33:14.106871+0000","last_clean":"2024-02-10T08:33:14.106871+0000","last_became_active":"2024-02-10T08:16:52.787865+0000","last_became_peered":"2024-02-10T08:16:52.787865+0000","last_unstale":"2024-02-10T08:33:14.106871+0000","last_undegraded":"2024-02-10T08:33:14.106871+0000","last_fullsized":"2024-02-10T08:33:14.106871+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:26.213417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:28.028556+0000","last_clean_scrub_stamp":"2024-02-10T08:29:26.213417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":353,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.091253+0000","last_change":"2024-02-10T08:29:22.172003+0000","last_active":"2024-02-10T08:33:14.091253+0000","last_peered":"2024-02-10T08:33:14.091253+0000","last_clean":"2024-02-10T08:33:14.091253+0000","last_became_active":"2024-02-10T08:28:19.065132+0000","last_became_peered":"2024-02-10T08:28:19.065132+0000","last_unstale":"2024-02-10T08:33:14.091253+0000","last_undegraded":"2024-02-10T08:33:14.091253+0000","last_fullsized":"2024-02-10T08:33:14.091253+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:22.171906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:22.171906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,7],"acting":[5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":28,"reported_epoch":352,"state":"active+clean","last_fresh":"2024-02-10T08:33:15.845094+0000","last_change":"2024-02-10T08:33:08.700632+0000","last_active":"2024-02-10T08:33:15.845094+0000","last_peered":"2024-02-10T08:33:15.845094+0000","last_clean":"2024-02-10T08:33:15.845094+0000","last_became_active":"2024-02-10T08:32:36.978752+0000","last_became_peered":"2024-02-10T08:32:36.978752+0000","last_unstale":"2024-02-10T08:33:15.845094+0000","last_undegraded":"2024-02-10T08:33:15.845094+0000","last_fullsized":"2024-02-10T08:33:15.845094+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:08.700527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:33:08.700527+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"225'7","reported_seq":355,"reported_epoch":352,"state":"active+clean","last_fresh":"2024-02-10T08:33:15.840306+0000","last_change":"2024-02-10T08:32:22.340287+0000","last_active":"2024-02-10T08:33:15.840306+0000","last_peered":"2024-02-10T08:33:15.840306+0000","last_clean":"2024-02-10T08:33:15.840306+0000","last_became_active":"2024-02-10T08:27:27.715306+0000","last_became_peered":"2024-02-10T08:27:27.715306+0000","last_unstale":"2024-02-10T08:33:15.840306+0000","last_undegraded":"2024-02-10T08:33:15.840306+0000","last_fullsized":"2024-02-10T08:33:15.840306+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'7","last_scrub_stamp":"2024-02-10T08:32:22.340191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:32:22.340191+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":9,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"55'1","reported_seq":358,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.104520+0000","last_change":"2024-02-10T08:33:06.363742+0000","last_active":"2024-02-10T08:33:14.104520+0000","last_peered":"2024-02-10T08:33:14.104520+0000","last_clean":"2024-02-10T08:33:14.104520+0000","last_became_active":"2024-02-10T08:28:02.761299+0000","last_became_peered":"2024-02-10T08:28:02.761299+0000","last_unstale":"2024-02-10T08:33:14.104520+0000","last_undegraded":"2024-02-10T08:33:14.104520+0000","last_fullsized":"2024-02-10T08:33:14.104520+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'1","last_scrub_stamp":"2024-02-10T08:33:06.363627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:33:06.363627+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1746,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":336,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.101178+0000","last_change":"2024-02-10T08:28:38.278860+0000","last_active":"2024-02-10T08:33:14.101178+0000","last_peered":"2024-02-10T08:33:14.101178+0000","last_clean":"2024-02-10T08:33:14.101178+0000","last_became_active":"2024-02-10T08:20:46.406783+0000","last_became_peered":"2024-02-10T08:20:46.406783+0000","last_unstale":"2024-02-10T08:33:14.101178+0000","last_undegraded":"2024-02-10T08:33:14.101178+0000","last_fullsized":"2024-02-10T08:33:14.101178+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:38.278752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:28:38.278752+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":337,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.092550+0000","last_change":"2024-02-10T08:31:33.886939+0000","last_active":"2024-02-10T08:33:14.092550+0000","last_peered":"2024-02-10T08:33:14.092550+0000","last_clean":"2024-02-10T08:33:14.092550+0000","last_became_active":"2024-02-10T08:31:33.886617+0000","last_became_peered":"2024-02-10T08:31:33.886617+0000","last_unstale":"2024-02-10T08:33:14.092550+0000","last_undegraded":"2024-02-10T08:33:14.092550+0000","last_fullsized":"2024-02-10T08:33:14.092550+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:08.143236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:08.143236+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"225'15","reported_seq":323,"reported_epoch":352,"state":"active+clean","last_fresh":"2024-02-10T08:33:15.839956+0000","last_change":"2024-02-10T08:29:07.977048+0000","last_active":"2024-02-10T08:33:15.839956+0000","last_peered":"2024-02-10T08:33:15.839956+0000","last_clean":"2024-02-10T08:33:15.839956+0000","last_became_active":"2024-02-10T08:20:46.404966+0000","last_became_peered":"2024-02-10T08:20:46.404966+0000","last_unstale":"2024-02-10T08:33:15.839956+0000","last_undegraded":"2024-02-10T08:33:15.839956+0000","last_fullsized":"2024-02-10T08:33:15.839956+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'15","last_scrub_stamp":"2024-02-10T08:29:07.976943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:29:07.976943+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":23,"reported_epoch":352,"state":"active+clean","last_fresh":"2024-02-10T08:33:15.846760+0000","last_change":"2024-02-10T08:32:36.983082+0000","last_active":"2024-02-10T08:33:15.846760+0000","last_peered":"2024-02-10T08:33:15.846760+0000","last_clean":"2024-02-10T08:33:15.846760+0000","last_became_active":"2024-02-10T08:32:36.982675+0000","last_became_peered":"2024-02-10T08:32:36.982675+0000","last_unstale":"2024-02-10T08:33:15.846760+0000","last_undegraded":"2024-02-10T08:33:15.846760+0000","last_fullsized":"2024-02-10T08:33:15.846760+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:14.084352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:32:14.084352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,5],"acting":[0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":322,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.087752+0000","last_change":"2024-02-10T08:33:08.870508+0000","last_active":"2024-02-10T08:33:14.087752+0000","last_peered":"2024-02-10T08:33:14.087752+0000","last_clean":"2024-02-10T08:33:14.087752+0000","last_became_active":"2024-02-10T08:16:56.863353+0000","last_became_peered":"2024-02-10T08:16:56.863353+0000","last_unstale":"2024-02-10T08:33:14.087752+0000","last_undegraded":"2024-02-10T08:33:14.087752+0000","last_fullsized":"2024-02-10T08:33:14.087752+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:08.870342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:33:08.870342+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":299,"reported_epoch":352,"state":"active+clean","last_fresh":"2024-02-10T08:33:15.842280+0000","last_change":"2024-02-10T08:29:25.024508+0000","last_active":"2024-02-10T08:33:15.842280+0000","last_peered":"2024-02-10T08:33:15.842280+0000","last_clean":"2024-02-10T08:33:15.842280+0000","last_became_active":"2024-02-10T08:20:46.405314+0000","last_became_peered":"2024-02-10T08:20:46.405314+0000","last_unstale":"2024-02-10T08:33:15.842280+0000","last_undegraded":"2024-02-10T08:33:15.842280+0000","last_fullsized":"2024-02-10T08:33:15.842280+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:25.024412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:29:25.024412+0000","last_clean_scrub_stamp":"2024-02-10T08:29:25.024412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"225'27","reported_seq":391,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.097871+0000","last_change":"2024-02-10T08:33:09.659351+0000","last_active":"2024-02-10T08:33:14.097871+0000","last_peered":"2024-02-10T08:33:14.097871+0000","last_clean":"2024-02-10T08:33:14.097871+0000","last_became_active":"2024-02-10T08:31:33.883535+0000","last_became_peered":"2024-02-10T08:31:33.883535+0000","last_unstale":"2024-02-10T08:33:14.097871+0000","last_undegraded":"2024-02-10T08:33:14.097871+0000","last_fullsized":"2024-02-10T08:33:14.097871+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'27","last_scrub_stamp":"2024-02-10T08:33:09.659240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:33:09.659240+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":28,"reported_epoch":352,"state":"active+clean","last_fresh":"2024-02-10T08:33:15.846334+0000","last_change":"2024-02-10T08:33:10.725696+0000","last_active":"2024-02-10T08:33:15.846334+0000","last_peered":"2024-02-10T08:33:15.846334+0000","last_clean":"2024-02-10T08:33:15.846334+0000","last_became_active":"2024-02-10T08:32:36.977972+0000","last_became_peered":"2024-02-10T08:32:36.977972+0000","last_unstale":"2024-02-10T08:33:15.846334+0000","last_undegraded":"2024-02-10T08:33:15.846334+0000","last_fullsized":"2024-02-10T08:33:15.846334+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:10.725600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:33:10.725600+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":45,"reported_epoch":352,"state":"active+clean","last_fresh":"2024-02-10T08:33:15.839877+0000","last_change":"2024-02-10T08:31:46.058167+0000","last_active":"2024-02-10T08:33:15.839877+0000","last_peered":"2024-02-10T08:33:15.839877+0000","last_clean":"2024-02-10T08:33:15.839877+0000","last_became_active":"2024-02-10T08:31:46.057858+0000","last_became_peered":"2024-02-10T08:31:46.057858+0000","last_unstale":"2024-02-10T08:33:15.839877+0000","last_undegraded":"2024-02-10T08:33:15.839877+0000","last_fullsized":"2024-02-10T08:33:15.839877+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:04.388074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:04.388074+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":249,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.101722+0000","last_change":"2024-02-10T08:31:33.880687+0000","last_active":"2024-02-10T08:33:14.101722+0000","last_peered":"2024-02-10T08:33:14.101722+0000","last_clean":"2024-02-10T08:33:14.101722+0000","last_became_active":"2024-02-10T08:31:33.880328+0000","last_became_peered":"2024-02-10T08:31:33.880328+0000","last_unstale":"2024-02-10T08:33:14.101722+0000","last_undegraded":"2024-02-10T08:33:14.101722+0000","last_fullsized":"2024-02-10T08:33:14.101722+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:06.366305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:06.366305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":233,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.088104+0000","last_change":"2024-02-10T08:29:01.651198+0000","last_active":"2024-02-10T08:33:14.088104+0000","last_peered":"2024-02-10T08:33:14.088104+0000","last_clean":"2024-02-10T08:33:14.088104+0000","last_became_active":"2024-02-10T08:22:00.581772+0000","last_became_peered":"2024-02-10T08:22:00.581772+0000","last_unstale":"2024-02-10T08:33:14.088104+0000","last_undegraded":"2024-02-10T08:33:14.088104+0000","last_fullsized":"2024-02-10T08:33:14.088104+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:01.651093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:01.651093+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,7],"acting":[1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":256,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.100940+0000","last_change":"2024-02-10T08:33:10.338393+0000","last_active":"2024-02-10T08:33:14.100940+0000","last_peered":"2024-02-10T08:33:14.100940+0000","last_clean":"2024-02-10T08:33:14.100940+0000","last_became_active":"2024-02-10T08:31:46.054713+0000","last_became_peered":"2024-02-10T08:31:46.054713+0000","last_unstale":"2024-02-10T08:33:14.100940+0000","last_undegraded":"2024-02-10T08:33:14.100940+0000","last_fullsized":"2024-02-10T08:33:14.100940+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:10.338257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:33:10.338257+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":238,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.095599+0000","last_change":"2024-02-10T08:29:19.512005+0000","last_active":"2024-02-10T08:33:14.095599+0000","last_peered":"2024-02-10T08:33:14.095599+0000","last_clean":"2024-02-10T08:33:14.095599+0000","last_became_active":"2024-02-10T08:22:00.600200+0000","last_became_peered":"2024-02-10T08:22:00.600200+0000","last_unstale":"2024-02-10T08:33:14.095599+0000","last_undegraded":"2024-02-10T08:33:14.095599+0000","last_fullsized":"2024-02-10T08:33:14.095599+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:19.511918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:19.511918+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1],"acting":[6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":223,"reported_epoch":352,"state":"active+clean","last_fresh":"2024-02-10T08:33:15.845442+0000","last_change":"2024-02-10T08:29:22.556568+0000","last_active":"2024-02-10T08:33:15.845442+0000","last_peered":"2024-02-10T08:33:15.845442+0000","last_clean":"2024-02-10T08:33:15.845442+0000","last_became_active":"2024-02-10T08:28:25.999335+0000","last_became_peered":"2024-02-10T08:28:25.999335+0000","last_unstale":"2024-02-10T08:33:15.845442+0000","last_undegraded":"2024-02-10T08:33:15.845442+0000","last_fullsized":"2024-02-10T08:33:15.845442+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:22.556451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:22.556451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":347,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.091126+0000","last_change":"2024-02-10T08:31:33.879761+0000","last_active":"2024-02-10T08:33:14.091126+0000","last_peered":"2024-02-10T08:33:14.091126+0000","last_clean":"2024-02-10T08:33:14.091126+0000","last_became_active":"2024-02-10T08:31:33.879440+0000","last_became_peered":"2024-02-10T08:31:33.879440+0000","last_unstale":"2024-02-10T08:33:14.091126+0000","last_undegraded":"2024-02-10T08:33:14.091126+0000","last_fullsized":"2024-02-10T08:33:14.091126+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:19.225297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:19.225297+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":348,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.098230+0000","last_change":"2024-02-10T08:29:21.602049+0000","last_active":"2024-02-10T08:33:14.098230+0000","last_peered":"2024-02-10T08:33:14.098230+0000","last_clean":"2024-02-10T08:33:14.098230+0000","last_became_active":"2024-02-10T08:27:27.710587+0000","last_became_peered":"2024-02-10T08:27:27.710587+0000","last_unstale":"2024-02-10T08:33:14.098230+0000","last_undegraded":"2024-02-10T08:33:14.098230+0000","last_fullsized":"2024-02-10T08:33:14.098230+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:21.601953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:11.750537+0000","last_clean_scrub_stamp":"2024-02-10T08:29:21.601953+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,1],"acting":[6,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":251,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.091060+0000","last_change":"2024-02-10T08:32:36.974499+0000","last_active":"2024-02-10T08:33:14.091060+0000","last_peered":"2024-02-10T08:33:14.091060+0000","last_clean":"2024-02-10T08:33:14.091060+0000","last_became_active":"2024-02-10T08:32:36.974142+0000","last_became_peered":"2024-02-10T08:32:36.974142+0000","last_unstale":"2024-02-10T08:33:14.091060+0000","last_undegraded":"2024-02-10T08:33:14.091060+0000","last_fullsized":"2024-02-10T08:33:14.091060+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:02.618499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:02.618499+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":256,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.098448+0000","last_change":"2024-02-10T08:32:36.979965+0000","last_active":"2024-02-10T08:33:14.098448+0000","last_peered":"2024-02-10T08:33:14.098448+0000","last_clean":"2024-02-10T08:33:14.098448+0000","last_became_active":"2024-02-10T08:32:36.979412+0000","last_became_peered":"2024-02-10T08:32:36.979412+0000","last_unstale":"2024-02-10T08:33:14.098448+0000","last_undegraded":"2024-02-10T08:33:14.098448+0000","last_fullsized":"2024-02-10T08:33:14.098448+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:17.607818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:17.607818+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1],"acting":[6,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":328,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.097930+0000","last_change":"2024-02-10T08:32:16.519014+0000","last_active":"2024-02-10T08:33:14.097930+0000","last_peered":"2024-02-10T08:33:14.097930+0000","last_clean":"2024-02-10T08:33:14.097930+0000","last_became_active":"2024-02-10T08:22:00.578118+0000","last_became_peered":"2024-02-10T08:22:00.578118+0000","last_unstale":"2024-02-10T08:33:14.097930+0000","last_undegraded":"2024-02-10T08:33:14.097930+0000","last_fullsized":"2024-02-10T08:33:14.097930+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:16.518945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:32:16.518945+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,6],"acting":[2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.29","version":"76'2","reported_seq":286,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.101023+0000","last_change":"2024-02-10T08:32:31.459909+0000","last_active":"2024-02-10T08:33:14.101023+0000","last_peered":"2024-02-10T08:33:14.101023+0000","last_clean":"2024-02-10T08:33:14.101023+0000","last_became_active":"2024-02-10T08:28:02.767822+0000","last_became_peered":"2024-02-10T08:28:02.767822+0000","last_unstale":"2024-02-10T08:33:14.101023+0000","last_undegraded":"2024-02-10T08:33:14.101023+0000","last_fullsized":"2024-02-10T08:33:14.101023+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":6,"last_scrub":"76'2","last_scrub_stamp":"2024-02-10T08:32:31.459851+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2024-02-10T08:18:08.680038+0000","last_clean_scrub_stamp":"2024-02-10T08:32:31.459851+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,0],"acting":[7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":54,"reported_epoch":352,"state":"active+clean","last_fresh":"2024-02-10T08:33:15.841872+0000","last_change":"2024-02-10T08:32:36.975485+0000","last_active":"2024-02-10T08:33:15.841872+0000","last_peered":"2024-02-10T08:33:15.841872+0000","last_clean":"2024-02-10T08:33:15.841872+0000","last_became_active":"2024-02-10T08:32:36.975213+0000","last_became_peered":"2024-02-10T08:32:36.975213+0000","last_unstale":"2024-02-10T08:33:15.841872+0000","last_undegraded":"2024-02-10T08:33:15.841872+0000","last_fullsized":"2024-02-10T08:33:15.841872+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:30.227120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:20.392249+0000","last_clean_scrub_stamp":"2024-02-10T08:28:30.227120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0],"acting":[4,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":72,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.090958+0000","last_change":"2024-02-10T08:30:26.080634+0000","last_active":"2024-02-10T08:33:14.090958+0000","last_peered":"2024-02-10T08:33:14.090958+0000","last_clean":"2024-02-10T08:33:14.090958+0000","last_became_active":"2024-02-10T08:30:26.079913+0000","last_became_peered":"2024-02-10T08:30:26.079913+0000","last_unstale":"2024-02-10T08:33:14.090958+0000","last_undegraded":"2024-02-10T08:33:14.090958+0000","last_fullsized":"2024-02-10T08:33:14.090958+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:26:20.173948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:26:20.173948+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":257,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.096054+0000","last_change":"2024-02-10T08:30:26.067617+0000","last_active":"2024-02-10T08:33:14.096054+0000","last_peered":"2024-02-10T08:33:14.096054+0000","last_clean":"2024-02-10T08:33:14.096054+0000","last_became_active":"2024-02-10T08:30:26.067308+0000","last_became_peered":"2024-02-10T08:30:26.067308+0000","last_unstale":"2024-02-10T08:33:14.096054+0000","last_undegraded":"2024-02-10T08:33:14.096054+0000","last_fullsized":"2024-02-10T08:33:14.096054+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:15.491747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:20:30.227375+0000","last_clean_scrub_stamp":"2024-02-10T08:29:15.491747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,5],"acting":[6,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":342,"reported_epoch":352,"state":"active+clean","last_fresh":"2024-02-10T08:33:17.824141+0000","last_change":"2024-02-10T08:33:17.824141+0000","last_active":"2024-02-10T08:33:17.824141+0000","last_peered":"2024-02-10T08:33:17.824141+0000","last_clean":"2024-02-10T08:33:17.824141+0000","last_became_active":"2024-02-10T08:30:26.085360+0000","last_became_peered":"2024-02-10T08:30:26.085360+0000","last_unstale":"2024-02-10T08:33:17.824141+0000","last_undegraded":"2024-02-10T08:33:17.824141+0000","last_fullsized":"2024-02-10T08:33:17.824141+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:17.824030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:33:17.824030+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,5],"acting":[2,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":72,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.098066+0000","last_change":"2024-02-10T08:30:26.075782+0000","last_active":"2024-02-10T08:33:14.098066+0000","last_peered":"2024-02-10T08:33:14.098066+0000","last_clean":"2024-02-10T08:33:14.098066+0000","last_became_active":"2024-02-10T08:30:26.075472+0000","last_became_peered":"2024-02-10T08:30:26.075472+0000","last_unstale":"2024-02-10T08:33:14.098066+0000","last_undegraded":"2024-02-10T08:33:14.098066+0000","last_fullsized":"2024-02-10T08:33:14.098066+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:26.976023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:26.976023+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":72,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.105394+0000","last_change":"2024-02-10T08:30:26.080944+0000","last_active":"2024-02-10T08:33:14.105394+0000","last_peered":"2024-02-10T08:33:14.105394+0000","last_clean":"2024-02-10T08:33:14.105394+0000","last_became_active":"2024-02-10T08:30:26.080539+0000","last_became_peered":"2024-02-10T08:30:26.080539+0000","last_unstale":"2024-02-10T08:33:14.105394+0000","last_undegraded":"2024-02-10T08:33:14.105394+0000","last_fullsized":"2024-02-10T08:33:14.105394+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:34.215363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:34.215363+0000","last_clean_scrub_stamp":"2024-02-10T08:28:34.215363+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":72,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.101807+0000","last_change":"2024-02-10T08:30:26.088483+0000","last_active":"2024-02-10T08:33:14.101807+0000","last_peered":"2024-02-10T08:33:14.101807+0000","last_clean":"2024-02-10T08:33:14.101807+0000","last_became_active":"2024-02-10T08:30:26.088228+0000","last_became_peered":"2024-02-10T08:30:26.088228+0000","last_unstale":"2024-02-10T08:33:14.101807+0000","last_undegraded":"2024-02-10T08:33:14.101807+0000","last_fullsized":"2024-02-10T08:33:14.101807+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:11.496105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:11.496105+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1],"acting":[7,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":252,"reported_epoch":351,"state":"active+clean","last_fresh":"2024-02-10T08:33:14.092371+0000","last_change":"2024-02-10T08:30:26.072341+0000","last_active":"2024-02-10T08:33:14.092371+0000","last_peered":"2024-02-10T08:33:14.092371+0000","last_clean":"2024-02-10T08:33:14.092371+0000","last_became_active":"2024-02-10T08:30:26.072022+0000","last_became_peered":"2024-02-10T08:30:26.072022+0000","last_unstale":"2024-02-10T08:33:14.092371+0000","last_undegraded":"2024-02-10T08:33:14.092371+0000","last_fullsized":"2024-02-10T08:33:14.092371+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:27.240244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:27.240244+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":16,"stat_sum":{"num_bytes":3954835456,"num_objects":60346,"num_object_clones":0,"num_object_copies":181038,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60346,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60346,"num_write_kb":3862144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":11912085504,"data_stored":11912085504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":60346,"ondisk_log_size":60346,"up":48,"acting":48,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2646,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":4},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":975,"num_read_kb":970,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":9,"acting":9,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":1105,"num_read_kb":862,"num_write":703,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":212,"num_bytes_recovered":5226,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":733,"ondisk_log_size":733,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":96,"acting":96,"num_store_stats":8},{"poolid":6,"num_pg":52,"stat_sum":{"num_bytes":388,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":156,"acting":156,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":50,"seq":214748365001,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1545000,"kb_used_data":955296,"kb_used_omap":0,"kb_used_meta":589696,"kb_avail":92200152,"statfs":{"total":95995035648,"available":94412955648,"internally_reserved":0,"allocated":978223104,"data_stored":977637047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":603848704},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2,2,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:33:14 2024","interfaces":[{"interface":"back","average":{"1min":7.0460000000000003,"5min":3.1920000000000002,"15min":2.0230000000000001},"min":{"1min":0.26900000000000002,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":107.95699999999999,"5min":107.95699999999999,"15min":107.95699999999999},"last":0.629},{"interface":"front","average":{"1min":7.4029999999999996,"5min":3.3090000000000002,"15min":2.4500000000000002},"min":{"1min":0.32100000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":108.33499999999999,"5min":108.33499999999999,"15min":108.33499999999999},"last":6.2759999999999998}]},{"osd":1,"last update":"Sat Feb 10 08:33:14 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":2.335,"15min":1.726},"min":{"1min":0.23200000000000001,"5min":0.222,"15min":0.20000000000000001},"max":{"1min":1.266,"5min":41.539999999999999,"15min":41.539999999999999},"last":0.23200000000000001},{"interface":"front","average":{"1min":1.5129999999999999,"5min":2.3450000000000002,"15min":1.827},"min":{"1min":0.28499999999999998,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":10.099,"5min":41.046999999999997,"15min":41.046999999999997},"last":10.099}]},{"osd":2,"last update":"Sat Feb 10 08:33:14 2024","interfaces":[{"interface":"back","average":{"1min":3.0019999999999998,"5min":2.2650000000000001,"15min":1.7110000000000001},"min":{"1min":0.34300000000000003,"5min":0.25700000000000001,"15min":0.251},"max":{"1min":36.308999999999997,"5min":36.308999999999997,"15min":36.308999999999997},"last":3.101},{"interface":"front","average":{"1min":2.7610000000000001,"5min":2.2770000000000001,"15min":1.756},"min":{"1min":0.27800000000000002,"5min":0.26000000000000001,"15min":0.25900000000000001},"max":{"1min":36.268000000000001,"5min":36.268000000000001,"15min":36.268000000000001},"last":0.27800000000000002}]},{"osd":3,"last update":"Sat Feb 10 08:33:14 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":1.748,"15min":1.573},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.27700000000000002},"max":{"1min":3.0590000000000002,"5min":13.07,"15min":18.515000000000001},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.91300000000000003,"5min":1.9890000000000001,"15min":1.7410000000000001},"min":{"1min":0.30599999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":3.5649999999999999,"5min":10.960000000000001,"15min":10.960000000000001},"last":0.33000000000000002}]},{"osd":4,"last update":"Sat Feb 10 08:33:14 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":1.554,"15min":1.0669999999999999},"min":{"1min":0.28399999999999997,"5min":0.23400000000000001,"15min":0.216},"max":{"1min":2.9990000000000001,"5min":12.574999999999999,"15min":12.574999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.88500000000000001,"5min":1.5760000000000001,"15min":1.0700000000000001},"min":{"1min":0.29599999999999999,"5min":0.24099999999999999,"15min":0.22700000000000001},"max":{"1min":2.996,"5min":8.8170000000000002,"15min":12.987},"last":2.996}]},{"osd":5,"last update":"Sat Feb 10 08:33:14 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":2.504,"15min":1.5009999999999999},"min":{"1min":0.33000000000000002,"5min":0.26400000000000001,"15min":0.218},"max":{"1min":3.5979999999999999,"5min":15.304,"15min":15.304},"last":3.0579999999999998},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.962,"15min":1.2789999999999999},"min":{"1min":0.33500000000000002,"5min":0.255,"15min":0.22600000000000001},"max":{"1min":6.2370000000000001,"5min":13.129,"15min":13.129},"last":6.2370000000000001}]},{"osd":6,"last update":"Sat Feb 10 08:33:14 2024","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.663,"15min":1.139},"min":{"1min":0.34499999999999997,"5min":0.27500000000000002,"15min":0.26100000000000001},"max":{"1min":6.4969999999999999,"5min":10.101000000000001,"15min":10.101000000000001},"last":6.4969999999999999},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.732,"15min":1.143},"min":{"1min":0.315,"5min":0.27000000000000002,"15min":0.224},"max":{"1min":3.149,"5min":12.654,"15min":12.654},"last":3.149}]}]},{"osd":6,"up_from":43,"seq":184683593934,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1949576,"kb_used_data":1652352,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":91795576,"statfs":{"total":95995035648,"available":93998669824,"internally_reserved":0,"allocated":1692008448,"data_stored":1691454524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,8,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:32:49 2024","interfaces":[{"interface":"back","average":{"1min":1.4870000000000001,"5min":1.7709999999999999,"15min":2.012},"min":{"1min":0.28999999999999998,"5min":0.222,"15min":0.19400000000000001},"max":{"1min":6.4420000000000002,"5min":7.9909999999999997,"15min":30.509},"last":2.3420000000000001},{"interface":"front","average":{"1min":1.603,"5min":1.516,"15min":1.732},"min":{"1min":0.377,"5min":0.245,"15min":0.21099999999999999},"max":{"1min":7.375,"5min":7.673,"15min":36.090000000000003},"last":2.637}]},{"osd":1,"last update":"Sat Feb 10 08:32:49 2024","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.784,"15min":1.5580000000000001},"min":{"1min":0.28599999999999998,"5min":0.223,"15min":0.20899999999999999},"max":{"1min":4.8099999999999996,"5min":6.3780000000000001,"15min":12.938000000000001},"last":2.1429999999999998},{"interface":"front","average":{"1min":1.7090000000000001,"5min":1.9630000000000001,"15min":1.6899999999999999},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":7.2990000000000004,"5min":9.8829999999999991,"15min":10.441000000000001},"last":5.0910000000000002}]},{"osd":2,"last update":"Sat Feb 10 08:32:49 2024","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":2.0369999999999999,"15min":1.9019999999999999},"min":{"1min":0.33200000000000002,"5min":0.25900000000000001,"15min":0.24399999999999999},"max":{"1min":6,"5min":25.146999999999998,"15min":35.072000000000003},"last":5.1310000000000002},{"interface":"front","average":{"1min":1.5840000000000001,"5min":1.7170000000000001,"15min":1.768},"min":{"1min":0.34999999999999998,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":10.837999999999999,"5min":25.135999999999999,"15min":35.103000000000002},"last":2.7000000000000002}]},{"osd":3,"last update":"Sat Feb 10 08:32:49 2024","interfaces":[{"interface":"back","average":{"1min":1.7789999999999999,"5min":1.9990000000000001,"15min":1.73},"min":{"1min":0.32700000000000001,"5min":0.32400000000000001,"15min":0.26600000000000001},"max":{"1min":8.2780000000000005,"5min":8.2780000000000005,"15min":15.212999999999999},"last":4.9400000000000004},{"interface":"front","average":{"1min":1.548,"5min":1.9179999999999999,"15min":1.7509999999999999},"min":{"1min":0.29399999999999998,"5min":0.26300000000000001,"15min":0.253},"max":{"1min":7.3300000000000001,"5min":8.9410000000000007,"15min":17.797000000000001},"last":5.0599999999999996}]},{"osd":4,"last update":"Sat Feb 10 08:33:12 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":1.4410000000000001,"15min":1.0209999999999999},"min":{"1min":0.27400000000000002,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":1.7370000000000001,"5min":7.5860000000000003,"15min":9.3879999999999999},"last":2.6709999999999998},{"interface":"front","average":{"1min":0.51500000000000001,"5min":1.609,"15min":1.1279999999999999},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.22600000000000001},"max":{"1min":1.012,"5min":8.3140000000000001,"15min":10.348000000000001},"last":4.9020000000000001}]},{"osd":5,"last update":"Sat Feb 10 08:32:49 2024","interfaces":[{"interface":"back","average":{"1min":2.4100000000000001,"5min":2.2349999999999999,"15min":1.3300000000000001},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.20200000000000001},"max":{"1min":10.300000000000001,"5min":29.631,"15min":29.631},"last":4.5300000000000002},{"interface":"front","average":{"1min":1.1890000000000001,"5min":2.1139999999999999,"15min":1.288},"min":{"1min":0.29699999999999999,"5min":0.23699999999999999,"15min":0.22900000000000001},"max":{"1min":8.3369999999999997,"5min":29.419,"15min":29.419},"last":4.9640000000000004}]},{"osd":7,"last update":"Sat Feb 10 08:33:12 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":1.974,"15min":1.897},"min":{"1min":0.31900000000000001,"5min":0.30599999999999999,"15min":0.23999999999999999},"max":{"1min":2.1000000000000001,"5min":13.298999999999999,"15min":194.88900000000001},"last":2.4860000000000002},{"interface":"front","average":{"1min":0.61599999999999999,"5min":2.1219999999999999,"15min":2.0249999999999999},"min":{"1min":0.33600000000000002,"5min":0.32600000000000001,"15min":0.26400000000000001},"max":{"1min":2.1269999999999998,"5min":14.128,"15min":194.74100000000001},"last":2.1720000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575077,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1307488,"kb_used_data":717784,"kb_used_omap":0,"kb_used_meta":589696,"kb_avail":92437664,"statfs":{"total":95995035648,"available":94656167936,"internally_reserved":0,"allocated":735010816,"data_stored":734432335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":603848704},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:32:49 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":1.603,"15min":1.972},"min":{"1min":0.215,"5min":0.186,"15min":0.17100000000000001},"max":{"1min":3.8010000000000002,"5min":19.263000000000002,"15min":29.763999999999999},"last":0.27500000000000002},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.516,"15min":2.109},"min":{"1min":0.20799999999999999,"5min":0.20100000000000001,"15min":0.17899999999999999},"max":{"1min":9.3290000000000006,"5min":9.5289999999999999,"15min":29.637},"last":0.32400000000000001}]},{"osd":2,"last update":"Sat Feb 10 08:33:17 2024","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":1.623,"15min":2.1619999999999999},"min":{"1min":0.27900000000000003,"5min":0.22,"15min":0.21199999999999999},"max":{"1min":3.4540000000000002,"5min":15.347,"15min":31.420999999999999},"last":0.28899999999999998},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.7669999999999999,"15min":2.3580000000000001},"min":{"1min":0.28599999999999998,"5min":0.23400000000000001,"15min":0.184},"max":{"1min":5.6680000000000001,"5min":16.344000000000001,"15min":31.484999999999999},"last":0.30399999999999999}]},{"osd":3,"last update":"Sat Feb 10 08:32:42 2024","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.7150000000000001,"15min":2.2719999999999998},"min":{"1min":0.30399999999999999,"5min":0.253,"15min":0.247},"max":{"1min":4.8150000000000004,"5min":12.228999999999999,"15min":28.082000000000001},"last":0.439},{"interface":"front","average":{"1min":1.4430000000000001,"5min":1.7989999999999999,"15min":1.952},"min":{"1min":0.25600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":6.9450000000000003,"5min":19.303999999999998,"15min":29.722000000000001},"last":0.33300000000000002}]},{"osd":4,"last update":"Sat Feb 10 08:33:09 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":1.5740000000000001,"15min":1.9399999999999999},"min":{"1min":0.35599999999999998,"5min":0.29099999999999998,"15min":0.26100000000000001},"max":{"1min":2.2970000000000002,"5min":13.515000000000001,"15min":14.086},"last":23.218},{"interface":"front","average":{"1min":0.76800000000000002,"5min":1.647,"15min":2.2650000000000001},"min":{"1min":0.32000000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":3.2080000000000002,"5min":9.0969999999999995,"15min":31.515000000000001},"last":23.274000000000001}]},{"osd":5,"last update":"Sat Feb 10 08:33:17 2024","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":1.9750000000000001,"15min":1.988},"min":{"1min":0.34499999999999997,"5min":0.29699999999999999,"15min":0.26000000000000001},"max":{"1min":2.4990000000000001,"5min":21.751000000000001,"15min":40.140999999999998},"last":0.35899999999999999},{"interface":"front","average":{"1min":1.05,"5min":2.1299999999999999,"15min":2.2589999999999999},"min":{"1min":0.36899999999999999,"5min":0.317,"15min":0.28499999999999998},"max":{"1min":4.4029999999999996,"5min":16.324000000000002,"15min":40.831000000000003},"last":0.38400000000000001}]},{"osd":6,"last update":"Sat Feb 10 08:32:49 2024","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.7709999999999999,"15min":1.9199999999999999},"min":{"1min":0.37,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":3.359,"5min":9.1259999999999994,"15min":31.27},"last":26.071999999999999},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.667,"15min":1.5760000000000001},"min":{"1min":0.35299999999999998,"5min":0.309,"15min":0.27700000000000002},"max":{"1min":3.742,"5min":6.8700000000000001,"15min":10.433},"last":25.937000000000001}]},{"osd":7,"last update":"Sat Feb 10 08:33:17 2024","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":2.1139999999999999,"15min":2.044},"min":{"1min":0.39300000000000002,"5min":0.374,"15min":0.29099999999999998},"max":{"1min":4.4690000000000003,"5min":19.692,"15min":31.344999999999999},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.96999999999999997,"5min":1.9890000000000001,"15min":1.6859999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.312},"max":{"1min":3.3660000000000001,"5min":15.91,"15min":15.91},"last":0.36899999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738602,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2693540,"kb_used_data":2388124,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":91051612,"statfs":{"total":95995035648,"available":93236850688,"internally_reserved":0,"allocated":2445438976,"data_stored":2444856850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 10 08:32:56 2024","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.617,"15min":2.5019999999999998},"min":{"1min":0.217,"5min":0.16300000000000001,"15min":0.14399999999999999},"max":{"1min":5.5270000000000001,"5min":11.058,"15min":102.48099999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":1.214,"5min":1.7350000000000001,"15min":2.3650000000000002},"min":{"1min":0.25700000000000001,"5min":0.20300000000000001,"15min":0.193},"max":{"1min":7.9509999999999996,"5min":11.367000000000001,"15min":103.38800000000001},"last":2.8159999999999998}]},{"osd":2,"last update":"Sat Feb 10 08:33:16 2024","interfaces":[{"interface":"back","average":{"1min":1.9039999999999999,"5min":2.4790000000000001,"15min":2.8980000000000001},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.192},"max":{"1min":19.411999999999999,"5min":21.331,"15min":102.462},"last":3.895},{"interface":"front","average":{"1min":0.64300000000000002,"5min":1.3680000000000001,"15min":2.4119999999999999},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.20799999999999999},"max":{"1min":2.3639999999999999,"5min":6.1870000000000003,"15min":102.66500000000001},"last":2.617}]},{"osd":3,"last update":"Sat Feb 10 08:32:39 2024","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.577,"15min":2.0640000000000001},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.22600000000000001},"max":{"1min":8.0399999999999991,"5min":8.4849999999999994,"15min":16.495000000000001},"last":2.7309999999999999},{"interface":"front","average":{"1min":2.9049999999999998,"5min":1.948,"15min":2.6669999999999998},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.222},"max":{"1min":9.1449999999999996,"5min":10.56,"15min":102.64400000000001},"last":0.67800000000000005}]},{"osd":4,"last update":"Sat Feb 10 08:33:05 2024","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.7829999999999999,"15min":2.794},"min":{"1min":0.38300000000000001,"5min":0.26000000000000001,"15min":0.253},"max":{"1min":4.3140000000000001,"5min":10.596,"15min":102.742},"last":0.70299999999999996},{"interface":"front","average":{"1min":1.143,"5min":1.4039999999999999,"15min":1.716},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.26200000000000001},"max":{"1min":6.5830000000000002,"5min":6.5830000000000002,"15min":16.352},"last":2.6669999999999998}]},{"osd":5,"last update":"Sat Feb 10 08:32:31 2024","interfaces":[{"interface":"back","average":{"1min":2.6080000000000001,"5min":1.919,"15min":2.101},"min":{"1min":0.36499999999999999,"5min":0.34499999999999997,"15min":0.31900000000000001},"max":{"1min":17.321000000000002,"5min":17.321000000000002,"15min":102.53100000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":1.794,"5min":1.79,"15min":1.6639999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.22500000000000001},"max":{"1min":6.4390000000000001,"5min":9.7360000000000007,"15min":16.463999999999999},"last":2.7839999999999998}]},{"osd":6,"last update":"Sat Feb 10 08:32:56 2024","interfaces":[{"interface":"back","average":{"1min":1.7989999999999999,"5min":1.7430000000000001,"15min":2.125},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.28599999999999998},"max":{"1min":7.0149999999999997,"5min":7.5810000000000004,"15min":102.583},"last":0.51900000000000002},{"interface":"front","average":{"1min":1.6319999999999999,"5min":1.6359999999999999,"15min":1.615},"min":{"1min":0.37,"5min":0.37,"15min":0.308},"max":{"1min":6.3979999999999997,"5min":9.0259999999999998,"15min":16.391999999999999},"last":2.7050000000000001}]},{"osd":7,"last update":"Sat Feb 10 08:33:16 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":1.546,"15min":2.9060000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.34100000000000003},"max":{"1min":2.4399999999999999,"5min":6.4889999999999999,"15min":255.53200000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":2.085,"5min":1.784,"15min":2.5070000000000001},"min":{"1min":0.41899999999999998,"5min":0.34599999999999997,"15min":0.28599999999999998},"max":{"1min":15.375999999999999,"5min":15.375999999999999,"15min":254.88800000000001},"last":2.7570000000000001}]}]},{"osd":2,"up_from":18,"seq":77309411553,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2034068,"kb_used_data":1444364,"kb_used_omap":0,"kb_used_meta":589696,"kb_avail":91711084,"statfs":{"total":95995035648,"available":93912150016,"internally_reserved":0,"allocated":1479028736,"data_stored":1478462375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":603848704},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,3],"upper_bound":8},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":1.022,"15min":1.7110000000000001},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.17399999999999999},"max":{"1min":4.202,"5min":6.1369999999999996,"15min":24.859999999999999},"last":0.81999999999999995},{"interface":"front","average":{"1min":2.8559999999999999,"5min":1.962,"15min":2.3500000000000001},"min":{"1min":0.252,"5min":0.20499999999999999,"15min":0.193},"max":{"1min":15.15,"5min":15.15,"15min":28.295999999999999},"last":2.1030000000000002}]},{"osd":1,"last update":"Sat Feb 10 08:32:20 2024","interfaces":[{"interface":"back","average":{"1min":2.1899999999999999,"5min":1.9099999999999999,"15min":1.861},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.19700000000000001},"max":{"1min":7.7169999999999996,"5min":13.622,"15min":15.644},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.91700000000000004,"5min":1.0169999999999999,"15min":1.3480000000000001},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":4.2389999999999999,"5min":5.9000000000000004,"15min":16.968},"last":0.439}]},{"osd":3,"last update":"Sat Feb 10 08:32:42 2024","interfaces":[{"interface":"back","average":{"1min":1.899,"5min":1.4910000000000001,"15min":1.952},"min":{"1min":0.29299999999999998,"5min":0.26300000000000001,"15min":0.23300000000000001},"max":{"1min":8.6679999999999993,"5min":8.6679999999999993,"15min":24.946000000000002},"last":0.57999999999999996},{"interface":"front","average":{"1min":1.036,"5min":1.228,"15min":2.0289999999999999},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":4.8449999999999998,"5min":6.3310000000000004,"15min":24.905000000000001},"last":0.38100000000000001}]},{"osd":4,"last update":"Sat Feb 10 08:33:02 2024","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.631,"15min":1.962},"min":{"1min":0.36899999999999999,"5min":0.30099999999999999,"15min":0.27400000000000002},"max":{"1min":5.6310000000000002,"5min":10.573,"15min":13.260999999999999},"last":0.316},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.1439999999999999,"15min":1.3009999999999999},"min":{"1min":0.38700000000000001,"5min":0.29699999999999999,"15min":0.25700000000000001},"max":{"1min":2.911,"5min":3.8420000000000001,"15min":15.696},"last":0.41099999999999998}]},{"osd":5,"last update":"Sat Feb 10 08:32:26 2024","interfaces":[{"interface":"back","average":{"1min":3.0840000000000001,"5min":2.2650000000000001,"15min":1.885},"min":{"1min":0.41599999999999998,"5min":0.29899999999999999,"15min":0.26600000000000001},"max":{"1min":13.201000000000001,"5min":13.201000000000001,"15min":13.939},"last":1.9059999999999999},{"interface":"front","average":{"1min":2.6190000000000002,"5min":2.0750000000000002,"15min":1.7490000000000001},"min":{"1min":0.34399999999999997,"5min":0.29199999999999998,"15min":0.28599999999999998},"max":{"1min":9.5030000000000001,"5min":9.5709999999999997,"15min":13.317},"last":0.36699999999999999}]},{"osd":6,"last update":"Sat Feb 10 08:33:01 2024","interfaces":[{"interface":"back","average":{"1min":2.0009999999999999,"5min":1.855,"15min":1.8859999999999999},"min":{"1min":0.41699999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":13.233000000000001,"5min":13.233000000000001,"15min":38.177999999999997},"last":1.9450000000000001},{"interface":"front","average":{"1min":1.5509999999999999,"5min":1.8740000000000001,"15min":1.9139999999999999},"min":{"1min":0.39000000000000001,"5min":0.32200000000000001,"15min":0.29099999999999998},"max":{"1min":9.0879999999999992,"5min":13.567,"15min":37.682000000000002},"last":0.61899999999999999}]},{"osd":7,"last update":"Sat Feb 10 08:32:20 2024","interfaces":[{"interface":"back","average":{"1min":2.915,"5min":1.95,"15min":1.7410000000000001},"min":{"1min":0.45500000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":9.6869999999999994,"5min":9.6869999999999994,"15min":13.231999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":1.5429999999999999,"5min":1.6319999999999999,"15min":1.353},"min":{"1min":0.374,"5min":0.30399999999999999,"15min":0.29199999999999998},"max":{"1min":8.1110000000000007,"5min":8.1110000000000007,"15min":15.714},"last":3.0499999999999998}]}]},{"osd":3,"up_from":25,"seq":107374182620,"num_pgs":62,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1804004,"kb_used_data":1206108,"kb_used_omap":0,"kb_used_meta":597888,"kb_avail":91941148,"statfs":{"total":95995035648,"available":94147735552,"internally_reserved":0,"allocated":1235054592,"data_stored":1234471598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":612237312},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:32:38 2024","interfaces":[{"interface":"back","average":{"1min":1.4890000000000001,"5min":1.5449999999999999,"15min":1.8100000000000001},"min":{"1min":0.20399999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":10.795,"5min":10.795,"15min":14.167},"last":1.391},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.585,"15min":1.776},"min":{"1min":0.222,"5min":0.184,"15min":0.184},"max":{"1min":5.5369999999999999,"5min":16.155000000000001,"15min":26.643000000000001},"last":2.867}]},{"osd":1,"last update":"Sat Feb 10 08:32:38 2024","interfaces":[{"interface":"back","average":{"1min":2.3690000000000002,"5min":1.964,"15min":1.9059999999999999},"min":{"1min":0.23699999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":13.371,"5min":13.371,"15min":13.371},"last":1.492},{"interface":"front","average":{"1min":2.677,"5min":2.02,"15min":2.1429999999999998},"min":{"1min":0.27900000000000003,"5min":0.20599999999999999,"15min":0.191},"max":{"1min":10.67,"5min":19.344000000000001,"15min":21.373999999999999},"last":0.61899999999999999}]},{"osd":2,"last update":"Sat Feb 10 08:32:38 2024","interfaces":[{"interface":"back","average":{"1min":1.754,"5min":1.821,"15min":2.0259999999999998},"min":{"1min":0.27600000000000002,"5min":0.214,"15min":0.214},"max":{"1min":7.5369999999999999,"5min":14.631,"15min":21.434000000000001},"last":0.47799999999999998},{"interface":"front","average":{"1min":1.784,"5min":1.3999999999999999,"15min":1.75},"min":{"1min":0.30099999999999999,"5min":0.23400000000000001,"15min":0.215},"max":{"1min":12.289,"5min":12.289,"15min":18.061},"last":3.0600000000000001}]},{"osd":4,"last update":"Sat Feb 10 08:33:14 2024","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":1.409,"15min":1.639},"min":{"1min":0.36599999999999999,"5min":0.318,"15min":0.25900000000000001},"max":{"1min":4.6120000000000001,"5min":6.6299999999999999,"15min":12.272},"last":3.8029999999999999},{"interface":"front","average":{"1min":1.018,"5min":1.579,"15min":2.04},"min":{"1min":0.41699999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":4.5940000000000003,"5min":10.754,"15min":12.391999999999999},"last":1.5900000000000001}]},{"osd":5,"last update":"Sat Feb 10 08:32:33 2024","interfaces":[{"interface":"back","average":{"1min":3.2919999999999998,"5min":2.1680000000000001,"15min":1.5940000000000001},"min":{"1min":0.39400000000000002,"5min":0.316,"15min":0.249},"max":{"1min":19.832000000000001,"5min":19.832000000000001,"15min":19.832000000000001},"last":4.6790000000000003},{"interface":"front","average":{"1min":3.0739999999999998,"5min":2.077,"15min":1.8180000000000001},"min":{"1min":0.30099999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":19.712,"5min":19.712,"15min":19.712},"last":1.6559999999999999}]},{"osd":6,"last update":"Sat Feb 10 08:32:53 2024","interfaces":[{"interface":"back","average":{"1min":1.331,"5min":1.8149999999999999,"15min":1.7509999999999999},"min":{"1min":0.38100000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":6.7699999999999996,"5min":16.423999999999999,"15min":16.423999999999999},"last":4.2439999999999998},{"interface":"front","average":{"1min":0.876,"5min":1.8540000000000001,"15min":1.5349999999999999},"min":{"1min":0.40000000000000002,"5min":0.35099999999999998,"15min":0.28499999999999998},"max":{"1min":2.7210000000000001,"5min":9.7010000000000005,"15min":12.324999999999999},"last":3.1030000000000002}]},{"osd":7,"last update":"Sat Feb 10 08:33:14 2024","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.7370000000000001,"15min":1.569},"min":{"1min":0.34599999999999997,"5min":0.33500000000000002,"15min":0.28299999999999997},"max":{"1min":4.4420000000000002,"5min":8.7569999999999997,"15min":12.358000000000001},"last":3.4060000000000001},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.7070000000000001,"15min":1.847},"min":{"1min":0.313,"5min":0.313,"15min":0.26500000000000001},"max":{"1min":4.3789999999999996,"5min":9.6720000000000006,"15min":15.702},"last":0.72099999999999997}]}]},{"osd":4,"up_from":110,"seq":472446402712,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2279268,"kb_used_data":1981404,"kb_used_omap":0,"kb_used_meta":297855,"kb_avail":91465884,"statfs":{"total":95995035648,"available":93661065216,"internally_reserved":0,"allocated":2028957696,"data_stored":2028381479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":972,"internal_metadata":305003572},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:32:22 2024","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":1.327,"15min":1.339},"min":{"1min":0.223,"5min":0.21199999999999999,"15min":0.19800000000000001},"max":{"1min":2.5489999999999999,"5min":14.595000000000001,"15min":14.595000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":1.8380000000000001,"5min":1.895,"15min":2.4449999999999998},"min":{"1min":0.27700000000000002,"5min":0.22600000000000001,"15min":0.222},"max":{"1min":8.0820000000000007,"5min":14.446999999999999,"15min":16.524000000000001},"last":1.4530000000000001}]},{"osd":1,"last update":"Sat Feb 10 08:32:22 2024","interfaces":[{"interface":"back","average":{"1min":2.6440000000000001,"5min":2.1960000000000002,"15min":2.0449999999999999},"min":{"1min":0.44800000000000001,"5min":0.218,"15min":0.218},"max":{"1min":8.2149999999999999,"5min":38.621000000000002,"15min":38.621000000000002},"last":2.3330000000000002},{"interface":"front","average":{"1min":1.5429999999999999,"5min":2.0899999999999999,"15min":1.911},"min":{"1min":0.35499999999999998,"5min":0.217,"15min":0.217},"max":{"1min":5.2530000000000001,"5min":38.430999999999997,"15min":38.430999999999997},"last":0.88100000000000001}]},{"osd":2,"last update":"Sat Feb 10 08:32:22 2024","interfaces":[{"interface":"back","average":{"1min":2.1070000000000002,"5min":2.0760000000000001,"15min":1.988},"min":{"1min":0.249,"5min":0.246,"15min":0.218},"max":{"1min":10.608000000000001,"5min":14.414,"15min":14.414},"last":1.349},{"interface":"front","average":{"1min":2.6299999999999999,"5min":1.7130000000000001,"15min":1.8839999999999999},"min":{"1min":0.30499999999999999,"5min":0.247,"15min":0.247},"max":{"1min":11.958,"5min":11.958,"15min":11.958},"last":2.0739999999999998}]},{"osd":3,"last update":"Sat Feb 10 08:32:22 2024","interfaces":[{"interface":"back","average":{"1min":2.0430000000000001,"5min":1.8919999999999999,"15min":2.0179999999999998},"min":{"1min":0.39000000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":6.0140000000000002,"5min":14.358000000000001,"15min":14.358000000000001},"last":1.0569999999999999},{"interface":"front","average":{"1min":2.5960000000000001,"5min":1.9470000000000001,"15min":1.778},"min":{"1min":0.34300000000000003,"5min":0.249,"15min":0.249},"max":{"1min":8.3360000000000003,"5min":8.3360000000000003,"15min":11.648},"last":2.1110000000000002}]},{"osd":5,"last update":"Sat Feb 10 08:32:22 2024","interfaces":[{"interface":"back","average":{"1min":1.569,"5min":1.5580000000000001,"15min":1.1040000000000001},"min":{"1min":0.26400000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":9.4550000000000001,"5min":20.355,"15min":41.488},"last":0.28999999999999998},{"interface":"front","average":{"1min":1.5700000000000001,"5min":1.7130000000000001,"15min":1.347},"min":{"1min":0.30099999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":8.2799999999999994,"5min":16.350000000000001,"15min":42.527999999999999},"last":0.31}]},{"osd":6,"last update":"Sat Feb 10 08:32:22 2024","interfaces":[{"interface":"back","average":{"1min":2.1400000000000001,"5min":1.522,"15min":1.2190000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.26400000000000001},"max":{"1min":8.2910000000000004,"5min":8.2910000000000004,"15min":39.554000000000002},"last":2.46},{"interface":"front","average":{"1min":2.1400000000000001,"5min":1.6160000000000001,"15min":1.2729999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":8.2539999999999996,"5min":11.342000000000001,"15min":41.741999999999997},"last":2.492}]},{"osd":7,"last update":"Sat Feb 10 08:32:22 2024","interfaces":[{"interface":"back","average":{"1min":2.2240000000000002,"5min":1.7270000000000001,"15min":1.238},"min":{"1min":0.34799999999999998,"5min":0.29199999999999998,"15min":0.28899999999999998},"max":{"1min":8.6289999999999996,"5min":8.6289999999999996,"15min":11.047000000000001},"last":2.528},{"interface":"front","average":{"1min":1.585,"5min":1.8160000000000001,"15min":1.0649999999999999},"min":{"1min":0.30199999999999999,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":6.2519999999999998,"5min":16.245999999999999,"15min":16.245999999999999},"last":0.40999999999999998}]}]},{"osd":5,"up_from":37,"seq":158913790163,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1780488,"kb_used_data":1186688,"kb_used_omap":0,"kb_used_meta":593792,"kb_avail":91964664,"statfs":{"total":95995035648,"available":94171815936,"internally_reserved":0,"allocated":1215168512,"data_stored":1214613761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":608043008},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,2,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:32:27 2024","interfaces":[{"interface":"back","average":{"1min":1.4450000000000001,"5min":1.399,"15min":1.611},"min":{"1min":0.218,"5min":0.218,"15min":0.20499999999999999},"max":{"1min":7.5300000000000002,"5min":10.789,"15min":22.914000000000001},"last":3.0539999999999998},{"interface":"front","average":{"1min":2.0880000000000001,"5min":1.5780000000000001,"15min":1.51},"min":{"1min":0.22900000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":13.738,"5min":13.738,"15min":23.161000000000001},"last":3.5590000000000002}]},{"osd":1,"last update":"Sat Feb 10 08:32:27 2024","interfaces":[{"interface":"back","average":{"1min":1.77,"5min":1.738,"15min":1.3999999999999999},"min":{"1min":0.249,"5min":0.222,"15min":0.19500000000000001},"max":{"1min":8.359,"5min":8.359,"15min":8.359},"last":0.57299999999999995},{"interface":"front","average":{"1min":1.304,"5min":1.276,"15min":1.29},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.254},"max":{"1min":3.7810000000000001,"5min":8.6899999999999995,"15min":9.0579999999999998},"last":0.878}]},{"osd":2,"last update":"Sat Feb 10 08:32:27 2024","interfaces":[{"interface":"back","average":{"1min":1.6899999999999999,"5min":1.6499999999999999,"15min":1.5920000000000001},"min":{"1min":0.33100000000000002,"5min":0.248,"15min":0.24099999999999999},"max":{"1min":7.9829999999999997,"5min":20.254999999999999,"15min":20.254999999999999},"last":3.5099999999999998},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.6579999999999999,"15min":1.4630000000000001},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.26400000000000001},"max":{"1min":5.0789999999999997,"5min":6.3929999999999998,"15min":9.2810000000000006},"last":0.497}]},{"osd":3,"last update":"Sat Feb 10 08:32:27 2024","interfaces":[{"interface":"back","average":{"1min":1.6100000000000001,"5min":1.3460000000000001,"15min":1.341},"min":{"1min":0.29399999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":8.0079999999999991,"5min":8.0079999999999991,"15min":24.198},"last":0.45500000000000002},{"interface":"front","average":{"1min":1.8089999999999999,"5min":1.649,"15min":1.605},"min":{"1min":0.375,"5min":0.27300000000000002,"15min":0.25900000000000001},"max":{"1min":9.7100000000000009,"5min":10.766,"15min":22.701000000000001},"last":0.52600000000000002}]},{"osd":4,"last update":"Sat Feb 10 08:33:09 2024","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":1.222,"15min":1.0189999999999999},"min":{"1min":0.28799999999999998,"5min":0.24099999999999999,"15min":0.23599999999999999},"max":{"1min":6.3120000000000003,"5min":7.923,"15min":7.923},"last":3.472},{"interface":"front","average":{"1min":0.54300000000000004,"5min":1.548,"15min":1.0880000000000001},"min":{"1min":0.27900000000000003,"5min":0.26000000000000001,"15min":0.22500000000000001},"max":{"1min":0.98399999999999999,"5min":12.948,"15min":12.948},"last":0.26500000000000001}]},{"osd":6,"last update":"Sat Feb 10 08:32:49 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":1.1100000000000001,"15min":0.97999999999999998},"min":{"1min":0.30599999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":3.4329999999999998,"5min":6.3959999999999999,"15min":8.3559999999999999},"last":0.92400000000000004},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.2749999999999999,"15min":1.0089999999999999},"min":{"1min":0.41799999999999998,"5min":0.29299999999999998,"15min":0.23999999999999999},"max":{"1min":3.3719999999999999,"5min":7.875,"15min":7.875},"last":0.32400000000000001}]},{"osd":7,"last update":"Sat Feb 10 08:32:21 2024","interfaces":[{"interface":"back","average":{"1min":2.3010000000000002,"5min":1.359,"15min":2.161},"min":{"1min":0.313,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":7.952,"5min":7.952,"15min":371.87400000000002},"last":0.35799999999999998},{"interface":"front","average":{"1min":1.409,"5min":1.657,"15min":2.367},"min":{"1min":0.35799999999999998,"5min":0.32000000000000001,"15min":0.23499999999999999},"max":{"1min":3.8679999999999999,"5min":12.984999999999999,"15min":372.63099999999997},"last":0.55000000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2473394176,"data_stored":2473394176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":734330880,"data_stored":734330880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1485897728,"data_stored":1485897728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1235222528,"data_stored":1235222528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":2055471104,"data_stored":2055471104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1234042880,"data_stored":1234042880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1708392448,"data_stored":1708392448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":985333760,"data_stored":985333760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-10T08:33:28.668 INFO:tasks.cephadm.ceph_manager.ceph:would drop below min_pgs, proj 6, currently 16 2024-02-10T08:33:28.718 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 42 15 73386 73371 109.146 75.625 0.014617 0.00915745 2024-02-10T08:33:28.914 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:33:28.942 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:33:28.982 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:33:29.019 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:33:29.039 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:33:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:33:29.059 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:33:29.104 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:33:29.108 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd set noscrub 2024-02-10T08:33:29.140 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:33:29.180 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:33:29.191 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:33:29.192 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:29.193 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:33:29.200 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-10T08:33:29.200 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-10T08:33:29.201 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-10T08:33:29.201 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-10T08:33:29.201 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-10T08:33:29.201 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-10T08:33:29.201 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-10T08:33:29.201 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-10T08:33:29.294 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:33:29.338 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:29.373 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:33:29.381 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:29.382 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:33:29.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:27.608485+0000 osd.2 (osd.2) 167 : cluster [DBG] 5.6 scrub starts 2024-02-10T08:33:29.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:27.613322+0000 osd.2 (osd.2) 168 : cluster [DBG] 5.6 scrub ok 2024-02-10T08:33:29.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:28.088300+0000 osd.5 (osd.5) 213 : cluster [DBG] 5.7 scrub starts 2024-02-10T08:33:29.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:28.092550+0000 osd.5 (osd.5) 214 : cluster [DBG] 5.7 scrub ok 2024-02-10T08:33:29.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:33:28.885736+0000 mon.a (mon.0) 1543 : audit [DBG] from='client.? 172.21.15.18:0/1935868188' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:33:29.408 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:27.608485+0000 osd.2 (osd.2) 167 : cluster [DBG] 5.6 scrub starts 2024-02-10T08:33:29.408 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:27.613322+0000 osd.2 (osd.2) 168 : cluster [DBG] 5.6 scrub ok 2024-02-10T08:33:29.409 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:28.088300+0000 osd.5 (osd.5) 213 : cluster [DBG] 5.7 scrub starts 2024-02-10T08:33:29.409 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:28.092550+0000 osd.5 (osd.5) 214 : cluster [DBG] 5.7 scrub ok 2024-02-10T08:33:29.409 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:33:28.885736+0000 mon.a (mon.0) 1543 : audit [DBG] from='client.? 172.21.15.18:0/1935868188' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:33:29.482 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:33:29.517 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:29.543 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:33:29.545 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:29.545 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:33:29.646 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:33:29.700 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:29.720 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 43 16 74401 74385 108.081 63.375 0.0112694 0.0092449 2024-02-10T08:33:29.729 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-02-10T08:33:29.729 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:33:29.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:27.608485+0000 osd.2 (osd.2) 167 : cluster [DBG] 5.6 scrub starts 2024-02-10T08:33:29.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:27.613322+0000 osd.2 (osd.2) 168 : cluster [DBG] 5.6 scrub ok 2024-02-10T08:33:29.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:28.088300+0000 osd.5 (osd.5) 213 : cluster [DBG] 5.7 scrub starts 2024-02-10T08:33:29.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:28.092550+0000 osd.5 (osd.5) 214 : cluster [DBG] 5.7 scrub ok 2024-02-10T08:33:29.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:33:28.885736+0000 mon.a (mon.0) 1543 : audit [DBG] from='client.? 172.21.15.18:0/1935868188' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:33:29.964 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:33:29.969 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:29.969 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:33:30.070 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:33:30.109 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:30.146 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:33:30.151 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:30.152 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:33:30.253 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:33:30.301 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:33:28.536518+0000 mgr.y (mgr.14505) 629 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:33:30.301 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:28.564501+0000 osd.2 (osd.2) 169 : cluster [DBG] 2.10 scrub starts 2024-02-10T08:33:30.301 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:28.572575+0000 osd.2 (osd.2) 170 : cluster [DBG] 2.10 scrub ok 2024-02-10T08:33:30.301 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:28.708087+0000 osd.7 (osd.7) 207 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:33:30.301 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:28.708149+0000 osd.7 (osd.7) 208 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:33:30.301 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:28.820731+0000 osd.0 (osd.0) 185 : cluster [DBG] 5.13 deep-scrub starts 2024-02-10T08:33:30.301 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:28.821921+0000 osd.0 (osd.0) 186 : cluster [DBG] 5.13 deep-scrub ok 2024-02-10T08:33:30.301 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:28.973065+0000 mgr.y (mgr.14505) 630 : cluster [DBG] pgmap v781: 168 pgs: 168 active+clean; 4.4 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1.2 KiB/s rd, 90 MiB/s wr, 1.44k op/s 2024-02-10T08:33:30.301 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:29.300319+0000 mon.a (mon.0) 1544 : cluster [DBG] osdmap e357: 8 total, 8 up, 8 in 2024-02-10T08:33:30.301 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:29.349509+0000 osd.7 (osd.7) 209 : cluster [DBG] 6.1c scrub starts 2024-02-10T08:33:30.301 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:29.353115+0000 osd.7 (osd.7) 210 : cluster [DBG] 6.1c scrub ok 2024-02-10T08:33:30.302 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:29.452651+0000 osd.4 (osd.4) 112 : cluster [DBG] 6.e deep-scrub starts 2024-02-10T08:33:30.302 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:29.477475+0000 osd.4 (osd.4) 113 : cluster [DBG] 6.e deep-scrub ok 2024-02-10T08:33:30.308 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:30.542 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:33:28.536518+0000 mgr.y (mgr.14505) 629 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:33:30.542 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:28.564501+0000 osd.2 (osd.2) 169 : cluster [DBG] 2.10 scrub starts 2024-02-10T08:33:30.542 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:28.572575+0000 osd.2 (osd.2) 170 : cluster [DBG] 2.10 scrub ok 2024-02-10T08:33:30.542 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:28.708087+0000 osd.7 (osd.7) 207 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:33:30.542 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:28.708149+0000 osd.7 (osd.7) 208 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:33:30.543 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:28.820731+0000 osd.0 (osd.0) 185 : cluster [DBG] 5.13 deep-scrub starts 2024-02-10T08:33:30.543 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:28.821921+0000 osd.0 (osd.0) 186 : cluster [DBG] 5.13 deep-scrub ok 2024-02-10T08:33:30.543 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:28.973065+0000 mgr.y (mgr.14505) 630 : cluster [DBG] pgmap v781: 168 pgs: 168 active+clean; 4.4 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1.2 KiB/s rd, 90 MiB/s wr, 1.44k op/s 2024-02-10T08:33:30.543 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:29.300319+0000 mon.a (mon.0) 1544 : cluster [DBG] osdmap e357: 8 total, 8 up, 8 in 2024-02-10T08:33:30.543 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:29.349509+0000 osd.7 (osd.7) 209 : cluster [DBG] 6.1c scrub starts 2024-02-10T08:33:30.543 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:29.353115+0000 osd.7 (osd.7) 210 : cluster [DBG] 6.1c scrub ok 2024-02-10T08:33:30.543 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:29.452651+0000 osd.4 (osd.4) 112 : cluster [DBG] 6.e deep-scrub starts 2024-02-10T08:33:30.543 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:29.477475+0000 osd.4 (osd.4) 113 : cluster [DBG] 6.e deep-scrub ok 2024-02-10T08:33:30.591 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:33:28.536518+0000 mgr.y (mgr.14505) 629 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:33:30.591 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:28.564501+0000 osd.2 (osd.2) 169 : cluster [DBG] 2.10 scrub starts 2024-02-10T08:33:30.591 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:28.572575+0000 osd.2 (osd.2) 170 : cluster [DBG] 2.10 scrub ok 2024-02-10T08:33:30.591 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:28.708087+0000 osd.7 (osd.7) 207 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:33:30.591 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:28.708149+0000 osd.7 (osd.7) 208 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:33:30.591 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:28.820731+0000 osd.0 (osd.0) 185 : cluster [DBG] 5.13 deep-scrub starts 2024-02-10T08:33:30.591 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:28.821921+0000 osd.0 (osd.0) 186 : cluster [DBG] 5.13 deep-scrub ok 2024-02-10T08:33:30.591 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:28.973065+0000 mgr.y (mgr.14505) 630 : cluster [DBG] pgmap v781: 168 pgs: 168 active+clean; 4.4 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1.2 KiB/s rd, 90 MiB/s wr, 1.44k op/s 2024-02-10T08:33:30.591 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:29.300319+0000 mon.a (mon.0) 1544 : cluster [DBG] osdmap e357: 8 total, 8 up, 8 in 2024-02-10T08:33:30.591 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:29.349509+0000 osd.7 (osd.7) 209 : cluster [DBG] 6.1c scrub starts 2024-02-10T08:33:30.591 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:29.353115+0000 osd.7 (osd.7) 210 : cluster [DBG] 6.1c scrub ok 2024-02-10T08:33:30.591 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:29.452651+0000 osd.4 (osd.4) 112 : cluster [DBG] 6.e deep-scrub starts 2024-02-10T08:33:30.591 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:29.477475+0000 osd.4 (osd.4) 113 : cluster [DBG] 6.e deep-scrub ok 2024-02-10T08:33:30.720 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 44 16 75604 75588 107.33 75.1875 0.0106414 0.0093127 2024-02-10T08:33:31.171 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:33:31.179 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:31.179 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:33:31.207 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.2 dump_ops_in_flight 2024-02-10T08:33:31.241 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:33:31.280 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:33:31.314 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:31.352 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:33:31.357 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:31.357 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:33:31.458 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:33:31.506 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:31.549 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:33:31.554 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:31.555 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:33:31.656 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:33:31.710 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:31.720 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 45 16 76688 76672 106.45 67.75 0.0121628 0.00938949 2024-02-10T08:33:31.745 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:33:31.752 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:31.752 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:33:31.853 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:33:31.861 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:30.560240+0000 osd.2 (osd.2) 171 : cluster [DBG] 5.a scrub starts 2024-02-10T08:33:31.861 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:30.565585+0000 osd.2 (osd.2) 172 : cluster [DBG] 5.a scrub ok 2024-02-10T08:33:31.862 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:30.560240+0000 osd.2 (osd.2) 171 : cluster [DBG] 5.a scrub starts 2024-02-10T08:33:31.862 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:30.565585+0000 osd.2 (osd.2) 172 : cluster [DBG] 5.a scrub ok 2024-02-10T08:33:31.862 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:30.684976+0000 osd.1 (osd.1) 206 : cluster [DBG] 6.26 scrub starts 2024-02-10T08:33:31.862 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:30.688049+0000 osd.1 (osd.1) 207 : cluster [DBG] 6.26 scrub ok 2024-02-10T08:33:31.862 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:30.849514+0000 mon.a (mon.0) 1545 : cluster [DBG] osdmap e358: 8 total, 8 up, 8 in 2024-02-10T08:33:31.862 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:30.973438+0000 mgr.y (mgr.14505) 631 : cluster [DBG] pgmap v784: 168 pgs: 168 active+clean; 4.4 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 853 B/s rd, 70 MiB/s wr, 1.12k op/s 2024-02-10T08:33:31.862 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:33:31.675342+0000 mon.a (mon.0) 1546 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:33:31.895 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:31.928 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:33:31.936 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:31.937 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:33:32.037 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:33:32.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:30.560240+0000 osd.2 (osd.2) 171 : cluster [DBG] 5.a scrub starts 2024-02-10T08:33:32.041 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:30.565585+0000 osd.2 (osd.2) 172 : cluster [DBG] 5.a scrub ok 2024-02-10T08:33:32.041 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:30.684976+0000 osd.1 (osd.1) 206 : cluster [DBG] 6.26 scrub starts 2024-02-10T08:33:32.041 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:30.688049+0000 osd.1 (osd.1) 207 : cluster [DBG] 6.26 scrub ok 2024-02-10T08:33:32.041 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:30.849514+0000 mon.a (mon.0) 1545 : cluster [DBG] osdmap e358: 8 total, 8 up, 8 in 2024-02-10T08:33:32.041 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:30.973438+0000 mgr.y (mgr.14505) 631 : cluster [DBG] pgmap v784: 168 pgs: 168 active+clean; 4.4 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 853 B/s rd, 70 MiB/s wr, 1.12k op/s 2024-02-10T08:33:32.041 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:33:31.675342+0000 mon.a (mon.0) 1546 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:33:32.075 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:32.103 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:33:32.108 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:32.108 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:33:32.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:30.684976+0000 osd.1 (osd.1) 206 : cluster [DBG] 6.26 scrub starts 2024-02-10T08:33:32.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:30.688049+0000 osd.1 (osd.1) 207 : cluster [DBG] 6.26 scrub ok 2024-02-10T08:33:32.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:30.849514+0000 mon.a (mon.0) 1545 : cluster [DBG] osdmap e358: 8 total, 8 up, 8 in 2024-02-10T08:33:32.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:30.973438+0000 mgr.y (mgr.14505) 631 : cluster [DBG] pgmap v784: 168 pgs: 168 active+clean; 4.4 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 853 B/s rd, 70 MiB/s wr, 1.12k op/s 2024-02-10T08:33:32.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:33:31.675342+0000 mon.a (mon.0) 1546 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:33:32.209 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:33:32.271 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:32.618 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-10T08:33:32.720 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 46 16 77831 77815 105.689 71.4375 0.0236196 0.00945527 2024-02-10T08:33:32.939 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:33:32.939 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:33:32.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:31.387379+0000 osd.4 (osd.4) 114 : cluster [DBG] 6.32 deep-scrub starts 2024-02-10T08:33:32.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:31.389107+0000 osd.4 (osd.4) 115 : cluster [DBG] 6.32 deep-scrub ok 2024-02-10T08:33:32.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:31.658460+0000 osd.1 (osd.1) 208 : cluster [DBG] 4.1d deep-scrub starts 2024-02-10T08:33:32.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:31.665184+0000 osd.1 (osd.1) 209 : cluster [DBG] 4.1d deep-scrub ok 2024-02-10T08:33:32.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:32.406709+0000 osd.7 (osd.7) 211 : cluster [DBG] 6.15 scrub starts 2024-02-10T08:33:32.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:32.430713+0000 osd.7 (osd.7) 212 : cluster [DBG] 6.15 scrub ok 2024-02-10T08:33:32.945 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:31.387379+0000 osd.4 (osd.4) 114 : cluster [DBG] 6.32 deep-scrub starts 2024-02-10T08:33:32.945 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:31.389107+0000 osd.4 (osd.4) 115 : cluster [DBG] 6.32 deep-scrub ok 2024-02-10T08:33:32.945 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:31.658460+0000 osd.1 (osd.1) 208 : cluster [DBG] 4.1d deep-scrub starts 2024-02-10T08:33:32.945 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:31.665184+0000 osd.1 (osd.1) 209 : cluster [DBG] 4.1d deep-scrub ok 2024-02-10T08:33:32.945 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:32.406709+0000 osd.7 (osd.7) 211 : cluster [DBG] 6.15 scrub starts 2024-02-10T08:33:32.945 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:32.430713+0000 osd.7 (osd.7) 212 : cluster [DBG] 6.15 scrub ok 2024-02-10T08:33:32.945 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:32.946 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:33:33.047 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:33:33.105 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:33.141 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:33:33.142 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:31.387379+0000 osd.4 (osd.4) 114 : cluster [DBG] 6.32 deep-scrub starts 2024-02-10T08:33:33.142 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:31.389107+0000 osd.4 (osd.4) 115 : cluster [DBG] 6.32 deep-scrub ok 2024-02-10T08:33:33.142 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:31.658460+0000 osd.1 (osd.1) 208 : cluster [DBG] 4.1d deep-scrub starts 2024-02-10T08:33:33.142 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:31.665184+0000 osd.1 (osd.1) 209 : cluster [DBG] 4.1d deep-scrub ok 2024-02-10T08:33:33.142 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:32.406709+0000 osd.7 (osd.7) 211 : cluster [DBG] 6.15 scrub starts 2024-02-10T08:33:33.142 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:32.430713+0000 osd.7 (osd.7) 212 : cluster [DBG] 6.15 scrub ok 2024-02-10T08:33:33.143 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:33.143 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:33:33.244 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:33:33.288 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:33.322 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:33:33.325 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:33.325 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:33:33.427 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:33:33.482 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:33.519 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:33:33.522 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:33.523 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:33:33.624 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:33:33.660 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:33.669 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 3, 4, 5, 6, 7, 0] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 5, 6, 7, 4] 2024-02-10T08:33:33.670 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-10T08:33:33.670 INFO:tasks.thrashosds.thrasher:inject_pause on osd.6 2024-02-10T08:33:33.670 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-02-10T08:33:33.670 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-02-10T08:33:33.670 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.6 config set filestore_inject_stall 3 2024-02-10T08:33:33.689 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:33:33.693 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:33.694 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:33:33.722 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 47 15 78895 78880 104.854 66.5625 0.0124824 0.00953189 2024-02-10T08:33:33.794 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:33:33.859 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:33.915 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:33:33.920 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:33.921 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:33:34.021 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:33:34.067 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:34.093 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:33:34.095 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:34.096 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:33:34.129 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:33:34.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:32.974414+0000 mgr.y (mgr.14505) 632 : cluster [DBG] pgmap v785: 168 pgs: 168 active+clean; 4.6 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1.4 KiB/s rd, 84 MiB/s wr, 1.35k op/s 2024-02-10T08:33:34.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:33.229241+0000 osd.6 (osd.6) 184 : cluster [DBG] 5.2 scrub starts 2024-02-10T08:33:34.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:33.234443+0000 osd.6 (osd.6) 185 : cluster [DBG] 5.2 scrub ok 2024-02-10T08:33:34.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:32.974414+0000 mgr.y (mgr.14505) 632 : cluster [DBG] pgmap v785: 168 pgs: 168 active+clean; 4.6 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1.4 KiB/s rd, 84 MiB/s wr, 1.35k op/s 2024-02-10T08:33:34.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:33.229241+0000 osd.6 (osd.6) 184 : cluster [DBG] 5.2 scrub starts 2024-02-10T08:33:34.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:33.234443+0000 osd.6 (osd.6) 185 : cluster [DBG] 5.2 scrub ok 2024-02-10T08:33:34.196 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:33:34.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:32.974414+0000 mgr.y (mgr.14505) 632 : cluster [DBG] pgmap v785: 168 pgs: 168 active+clean; 4.6 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1.4 KiB/s rd, 84 MiB/s wr, 1.35k op/s 2024-02-10T08:33:34.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:33.229241+0000 osd.6 (osd.6) 184 : cluster [DBG] 5.2 scrub starts 2024-02-10T08:33:34.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:33.234443+0000 osd.6 (osd.6) 185 : cluster [DBG] 5.2 scrub ok 2024-02-10T08:33:34.588 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:34.724 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 48 16 79941 79925 104.03 65.3125 0.017737 0.00960712 2024-02-10T08:33:34.932 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is set 2024-02-10T08:33:35.041 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:33.593857+0000 osd.2 (osd.2) 173 : cluster [DBG] 2.c scrub starts 2024-02-10T08:33:35.041 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:33.597965+0000 osd.2 (osd.2) 174 : cluster [DBG] 2.c scrub ok 2024-02-10T08:33:35.041 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:33:33.952914+0000 mon.c (mon.2) 80 : audit [INF] from='client.? 172.21.15.18:0/2959793596' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:33:35.041 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:33:33.953532+0000 mon.a (mon.0) 1547 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:33:35.041 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:34.273087+0000 osd.6 (osd.6) 186 : cluster [DBG] 4.a scrub starts 2024-02-10T08:33:35.041 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:34.284683+0000 osd.6 (osd.6) 187 : cluster [DBG] 4.a scrub ok 2024-02-10T08:33:35.048 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:33:35.054 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:35.055 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:33:35.156 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:33:35.212 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:35.229 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:33.593857+0000 osd.2 (osd.2) 173 : cluster [DBG] 2.c scrub starts 2024-02-10T08:33:35.229 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:33.597965+0000 osd.2 (osd.2) 174 : cluster [DBG] 2.c scrub ok 2024-02-10T08:33:35.230 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:33:33.952914+0000 mon.c (mon.2) 80 : audit [INF] from='client.? 172.21.15.18:0/2959793596' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:33:35.230 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:33:33.953532+0000 mon.a (mon.0) 1547 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:33:35.230 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:34.273087+0000 osd.6 (osd.6) 186 : cluster [DBG] 4.a scrub starts 2024-02-10T08:33:35.230 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:34.284683+0000 osd.6 (osd.6) 187 : cluster [DBG] 4.a scrub ok 2024-02-10T08:33:35.230 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:33.593857+0000 osd.2 (osd.2) 173 : cluster [DBG] 2.c scrub starts 2024-02-10T08:33:35.230 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:33.597965+0000 osd.2 (osd.2) 174 : cluster [DBG] 2.c scrub ok 2024-02-10T08:33:35.230 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:33:33.952914+0000 mon.c (mon.2) 80 : audit [INF] from='client.? 172.21.15.18:0/2959793596' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:33:35.230 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:33:33.953532+0000 mon.a (mon.0) 1547 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:33:35.230 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:34.273087+0000 osd.6 (osd.6) 186 : cluster [DBG] 4.a scrub starts 2024-02-10T08:33:35.230 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:34.284683+0000 osd.6 (osd.6) 187 : cluster [DBG] 4.a scrub ok 2024-02-10T08:33:35.262 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:33:35.272 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:35.273 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:33:35.374 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:33:35.424 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:35.711 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:33:35.721 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:35.722 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:33:35.722 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 49 16 81058 81042 103.332 69.8125 0.00356113 0.0096722 2024-02-10T08:33:35.823 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:33:35.906 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:36.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:34.417637+0000 osd.4 (osd.4) 116 : cluster [DBG] 4.18 deep-scrub starts 2024-02-10T08:33:36.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:34.450886+0000 osd.4 (osd.4) 117 : cluster [DBG] 4.18 deep-scrub ok 2024-02-10T08:33:36.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:34.894409+0000 mon.a (mon.0) 1548 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:33:36.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:33:34.903136+0000 mon.a (mon.0) 1549 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-10T08:33:36.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:34.903215+0000 mon.a (mon.0) 1550 : cluster [DBG] osdmap e359: 8 total, 8 up, 8 in 2024-02-10T08:33:36.041 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:34.974797+0000 mgr.y (mgr.14505) 633 : cluster [DBG] pgmap v787: 168 pgs: 168 active+clean; 4.7 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 853 B/s rd, 59 MiB/s wr, 943 op/s 2024-02-10T08:33:36.041 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:35.847346+0000 mon.a (mon.0) 1551 : cluster [DBG] osdmap e360: 8 total, 8 up, 8 in 2024-02-10T08:33:36.072 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:33:36.079 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:36.079 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:33:36.180 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:33:36.233 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:36.293 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:33:36.297 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:36.298 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:33:36.399 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:33:36.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:34.417637+0000 osd.4 (osd.4) 116 : cluster [DBG] 4.18 deep-scrub starts 2024-02-10T08:33:36.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:34.450886+0000 osd.4 (osd.4) 117 : cluster [DBG] 4.18 deep-scrub ok 2024-02-10T08:33:36.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:34.894409+0000 mon.a (mon.0) 1548 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:33:36.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:33:34.903136+0000 mon.a (mon.0) 1549 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-10T08:33:36.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:34.903215+0000 mon.a (mon.0) 1550 : cluster [DBG] osdmap e359: 8 total, 8 up, 8 in 2024-02-10T08:33:36.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:34.974797+0000 mgr.y (mgr.14505) 633 : cluster [DBG] pgmap v787: 168 pgs: 168 active+clean; 4.7 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 853 B/s rd, 59 MiB/s wr, 943 op/s 2024-02-10T08:33:36.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:35.847346+0000 mon.a (mon.0) 1551 : cluster [DBG] osdmap e360: 8 total, 8 up, 8 in 2024-02-10T08:33:36.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:34.417637+0000 osd.4 (osd.4) 116 : cluster [DBG] 4.18 deep-scrub starts 2024-02-10T08:33:36.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:34.450886+0000 osd.4 (osd.4) 117 : cluster [DBG] 4.18 deep-scrub ok 2024-02-10T08:33:36.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:34.894409+0000 mon.a (mon.0) 1548 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:33:36.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:33:34.903136+0000 mon.a (mon.0) 1549 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-10T08:33:36.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:34.903215+0000 mon.a (mon.0) 1550 : cluster [DBG] osdmap e359: 8 total, 8 up, 8 in 2024-02-10T08:33:36.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:34.974797+0000 mgr.y (mgr.14505) 633 : cluster [DBG] pgmap v787: 168 pgs: 168 active+clean; 4.7 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 853 B/s rd, 59 MiB/s wr, 943 op/s 2024-02-10T08:33:36.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:35.847346+0000 mon.a (mon.0) 1551 : cluster [DBG] osdmap e360: 8 total, 8 up, 8 in 2024-02-10T08:33:36.428 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:36.438 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-02-10T08:33:36.438 INFO:teuthology.orchestra.run.smithi071.stdout: "success": "" 2024-02-10T08:33:36.438 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-02-10T08:33:36.584 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:33:36.590 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:36.591 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:33:36.691 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:33:36.722 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 50 16 82109 82093 102.579 65.6875 0.0130304 0.00974433 2024-02-10T08:33:36.760 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:36.790 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:33:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:33:36] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:33:37.134 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:33:37.138 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:37.139 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:33:37.240 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:33:37.295 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:37.343 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:33:37.345 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:37.345 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:33:37.404 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:33:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:33:37] "GET /metrics HTTP/1.1" 200 176404 "" "Prometheus/2.33.4" 2024-02-10T08:33:37.446 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:33:37.489 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:37.722 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 51 16 83259 83243 101.977 71.875 0.0281105 0.0098013 2024-02-10T08:33:38.318 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:36.975225+0000 mgr.y (mgr.14505) 634 : cluster [DBG] pgmap v789: 168 pgs: 168 active+clean; 4.8 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 835 B/s rd, 58 MiB/s wr, 923 op/s 2024-02-10T08:33:38.318 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:36.975225+0000 mgr.y (mgr.14505) 634 : cluster [DBG] pgmap v789: 168 pgs: 168 active+clean; 4.8 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 835 B/s rd, 58 MiB/s wr, 923 op/s 2024-02-10T08:33:38.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:36.975225+0000 mgr.y (mgr.14505) 634 : cluster [DBG] pgmap v789: 168 pgs: 168 active+clean; 4.8 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 835 B/s rd, 58 MiB/s wr, 923 op/s 2024-02-10T08:33:38.722 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 52 16 84316 84300 101.287 66.0625 0.00949633 0.00986823 2024-02-10T08:33:38.865 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:33:38.866 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:33:38.871 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:38.871 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:33:38.972 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:33:39.014 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:39.039 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:33:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:33:39.173 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:33:39.177 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:39.178 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:33:39.278 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:33:39.327 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:39.371 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:33:39.375 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:39.376 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:33:39.476 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:33:39.539 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:39.631 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:33:39.645 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:39.646 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:33:39.722 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 53 16 85410 85394 100.666 68.375 0.0127856 0.00992963 2024-02-10T08:33:39.747 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:33:39.796 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:39.825 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:33:39.827 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:39.828 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:33:39.929 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:33:39.973 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:40.000 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:33:40.006 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:40.006 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:33:40.050 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:33:38.551824+0000 mgr.y (mgr.14505) 635 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:33:40.050 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:38.976131+0000 mgr.y (mgr.14505) 636 : cluster [DBG] pgmap v790: 168 pgs: 168 active+clean; 5.1 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 1.2 KiB/s rd, 81 MiB/s wr, 1.29k op/s 2024-02-10T08:33:40.107 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:33:40.153 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:40.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:33:38.551824+0000 mgr.y (mgr.14505) 635 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:33:40.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:38.976131+0000 mgr.y (mgr.14505) 636 : cluster [DBG] pgmap v790: 168 pgs: 168 active+clean; 5.1 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 1.2 KiB/s rd, 81 MiB/s wr, 1.29k op/s 2024-02-10T08:33:40.158 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:33:38.551824+0000 mgr.y (mgr.14505) 635 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:33:40.158 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:38.976131+0000 mgr.y (mgr.14505) 636 : cluster [DBG] pgmap v790: 168 pgs: 168 active+clean; 5.1 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 1.2 KiB/s rd, 81 MiB/s wr, 1.29k op/s 2024-02-10T08:33:40.188 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:40.188 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:33:40.188 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:33:40.289 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:33:40.299 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-02-10T08:33:40.299 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:33:40.355 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:40.723 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 54 16 86526 86510 100.093 69.75 0.0116937 0.00998668 2024-02-10T08:33:40.847 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd set nodeep-scrub 2024-02-10T08:33:41.126 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:33:41.131 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:41.132 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:33:41.233 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:33:41.308 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:41.725 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 55 16 87574 87558 99.4601 65.5 0.0188625 0.0100495 2024-02-10T08:33:41.866 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:40.976652+0000 mgr.y (mgr.14505) 637 : cluster [DBG] pgmap v791: 168 pgs: 168 active+clean; 5.1 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 639 B/s rd, 58 MiB/s wr, 933 op/s 2024-02-10T08:33:41.978 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:33:41.984 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:41.985 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:33:42.007 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.2 dump_blocked_ops 2024-02-10T08:33:42.087 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:33:42.153 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:40.976652+0000 mgr.y (mgr.14505) 637 : cluster [DBG] pgmap v791: 168 pgs: 168 active+clean; 5.1 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 639 B/s rd, 58 MiB/s wr, 933 op/s 2024-02-10T08:33:42.159 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:42.228 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:33:42.243 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:42.244 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:33:42.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:41 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:40.976652+0000 mgr.y (mgr.14505) 637 : cluster [DBG] pgmap v791: 168 pgs: 168 active+clean; 5.1 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 639 B/s rd, 58 MiB/s wr, 933 op/s 2024-02-10T08:33:42.330 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 3, 4, 5, 6, 7, 0] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 5, 6, 7, 4] 2024-02-10T08:33:42.330 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-10T08:33:42.330 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-02-10T08:33:42.330 INFO:tasks.thrashosds.thrasher:Setting osd 6 primary_affinity to 0.664261 2024-02-10T08:33:42.330 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd primary-affinity 6 0.6642606200466541 2024-02-10T08:33:42.344 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:33:42.379 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:42.408 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:33:42.416 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:42.416 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:33:42.517 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:33:42.568 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:42.597 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:33:42.600 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:42.600 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:33:42.701 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:33:42.714 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:33:42.725 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 56 16 88562 88546 98.7853 61.75 0.0424682 0.0101176 2024-02-10T08:33:42.732 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:42.752 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:33:42.759 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:42.759 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:33:42.860 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:33:42.880 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:41.575290+0000 osd.4 (osd.4) 118 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:33:42.880 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:41.575345+0000 osd.4 (osd.4) 119 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:33:42.880 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:41.868464+0000 mon.a (mon.0) 1552 : cluster [DBG] osdmap e361: 8 total, 8 up, 8 in 2024-02-10T08:33:42.905 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:42.995 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:33:42.999 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:43.000 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:33:43.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:41.575290+0000 osd.4 (osd.4) 118 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:33:43.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:41.575345+0000 osd.4 (osd.4) 119 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:33:43.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:41.868464+0000 mon.a (mon.0) 1552 : cluster [DBG] osdmap e361: 8 total, 8 up, 8 in 2024-02-10T08:33:43.101 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:33:43.155 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:43.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:41.575290+0000 osd.4 (osd.4) 118 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:33:43.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:41.575345+0000 osd.4 (osd.4) 119 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:33:43.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:41.868464+0000 mon.a (mon.0) 1552 : cluster [DBG] osdmap e361: 8 total, 8 up, 8 in 2024-02-10T08:33:43.190 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:33:43.196 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:43.196 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:33:43.297 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:33:43.332 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:43.366 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:33:43.371 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:43.371 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:33:43.472 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:33:43.520 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:43.560 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:33:43.564 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:43.564 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:33:43.665 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:33:43.695 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:43.725 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 57 16 89570 89554 98.1576 63 0.0100265 0.0101827 2024-02-10T08:33:43.726 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:33:43.729 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:43.729 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:33:43.830 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:33:43.874 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:43.911 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:33:43.915 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:43.916 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:33:44.016 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:33:44.044 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:42.639925+0000 osd.2 (osd.2) 175 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:33:44.044 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:42.639983+0000 osd.2 (osd.2) 176 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:33:44.044 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:42.889845+0000 mon.a (mon.0) 1553 : cluster [DBG] osdmap e362: 8 total, 8 up, 8 in 2024-02-10T08:33:44.044 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:42.978310+0000 mgr.y (mgr.14505) 638 : cluster [DBG] pgmap v794: 168 pgs: 168 active+clean; 5.3 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 1.4 KiB/s rd, 76 MiB/s wr, 1.22k op/s 2024-02-10T08:33:44.044 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:33:43.398923+0000 mon.a (mon.0) 1554 : audit [DBG] from='client.? 172.21.15.18:0/397440864' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:33:44.044 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:42.639925+0000 osd.2 (osd.2) 175 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:33:44.044 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:42.639983+0000 osd.2 (osd.2) 176 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:33:44.044 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:42.889845+0000 mon.a (mon.0) 1553 : cluster [DBG] osdmap e362: 8 total, 8 up, 8 in 2024-02-10T08:33:44.044 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:42.978310+0000 mgr.y (mgr.14505) 638 : cluster [DBG] pgmap v794: 168 pgs: 168 active+clean; 5.3 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 1.4 KiB/s rd, 76 MiB/s wr, 1.22k op/s 2024-02-10T08:33:44.044 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:33:43.398923+0000 mon.a (mon.0) 1554 : audit [DBG] from='client.? 172.21.15.18:0/397440864' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:33:44.085 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:44.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:43 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:42.639925+0000 osd.2 (osd.2) 175 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:33:44.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:43 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:42.639983+0000 osd.2 (osd.2) 176 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:33:44.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:43 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:42.889845+0000 mon.a (mon.0) 1553 : cluster [DBG] osdmap e362: 8 total, 8 up, 8 in 2024-02-10T08:33:44.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:43 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:42.978310+0000 mgr.y (mgr.14505) 638 : cluster [DBG] pgmap v794: 168 pgs: 168 active+clean; 5.3 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 1.4 KiB/s rd, 76 MiB/s wr, 1.22k op/s 2024-02-10T08:33:44.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:43 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:33:43.398923+0000 mon.a (mon.0) 1554 : audit [DBG] from='client.? 172.21.15.18:0/397440864' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:33:44.338 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:33:44.339 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:33:44.339 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:33:44.339 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:33:44.339 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:33:44.339 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:33:44.339 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:33:44.339 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:33:44.339 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-10T08:33:44.339 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-10T08:33:44.339 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-10T08:33:44.339 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-10T08:33:44.339 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-10T08:33:44.339 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-10T08:33:44.340 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-10T08:33:44.340 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-10T08:33:44.542 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:33:44.546 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:33:44.551 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:33:44.555 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:44.556 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:33:44.657 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:33:44.708 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:44.729 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 58 16 90667 90651 97.6412 68.5625 0.0212353 0.0102355 2024-02-10T08:33:44.882 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:33:44.886 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:44.886 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:33:44.987 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:33:45.054 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:45.267 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:33:45.278 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:45.278 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:33:45.379 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:33:45.425 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:45.457 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:33:45.537 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:45.537 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:33:45.638 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:33:45.687 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:45.730 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 59 16 91780 91764 97.165 69.5625 0.0174924 0.0102873 2024-02-10T08:33:46.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:44.978896+0000 mgr.y (mgr.14505) 639 : cluster [DBG] pgmap v795: 168 pgs: 168 active+clean; 5.4 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 1.2 KiB/s rd, 78 MiB/s wr, 1.26k op/s 2024-02-10T08:33:46.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:44.978896+0000 mgr.y (mgr.14505) 639 : cluster [DBG] pgmap v795: 168 pgs: 168 active+clean; 5.4 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 1.2 KiB/s rd, 78 MiB/s wr, 1.26k op/s 2024-02-10T08:33:46.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:44.978896+0000 mgr.y (mgr.14505) 639 : cluster [DBG] pgmap v795: 168 pgs: 168 active+clean; 5.4 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 1.2 KiB/s rd, 78 MiB/s wr, 1.26k op/s 2024-02-10T08:33:46.732 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:2024-02-10T08:33:46.732350+0000 min lat: 0.00134707 max lat: 0.252504 avg lat: 0.0103343 2024-02-10T08:33:46.732 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-02-10T08:33:46.732 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 60 16 92904 92888 96.7134 70.25 0.0108685 0.0103343 2024-02-10T08:33:46.790 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:33:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:33:46] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:33:47.512 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:33:47.516 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:33:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:33:47] "GET /metrics HTTP/1.1" 200 176408 "" "Prometheus/2.33.4" 2024-02-10T08:33:47.517 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:47.518 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:33:47.619 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:33:47.713 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:47.734 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 61 16 93998 93982 96.2489 68.375 0.00587607 0.0103855 2024-02-10T08:33:47.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:33:46.679010+0000 mon.a (mon.0) 1555 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:33:47.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:46.979696+0000 mgr.y (mgr.14505) 640 : cluster [DBG] pgmap v796: 168 pgs: 168 active+clean; 5.4 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 639 B/s rd, 47 MiB/s wr, 750 op/s 2024-02-10T08:33:47.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:33:46.679010+0000 mon.a (mon.0) 1555 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:33:47.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:46.979696+0000 mgr.y (mgr.14505) 640 : cluster [DBG] pgmap v796: 168 pgs: 168 active+clean; 5.4 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 639 B/s rd, 47 MiB/s wr, 750 op/s 2024-02-10T08:33:48.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:33:46.679010+0000 mon.a (mon.0) 1555 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:33:48.041 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:46.979696+0000 mgr.y (mgr.14505) 640 : cluster [DBG] pgmap v796: 168 pgs: 168 active+clean; 5.4 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 639 B/s rd, 47 MiB/s wr, 750 op/s 2024-02-10T08:33:48.274 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:33:48.295 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:48.296 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:33:48.396 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:33:48.441 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:48.480 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:33:48.487 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:48.487 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:33:48.588 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:33:48.638 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:48.670 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:48.671 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:33:48.671 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:33:48.732 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 62 16 95115 95099 95.8225 69.8125 0.0124083 0.010431 2024-02-10T08:33:48.772 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:33:48.789 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:33:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:33:48.821 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:48.853 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:33:48.857 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:48.857 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:33:48.958 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:33:48.993 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:49.025 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:33:49.027 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:49.028 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:33:49.128 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:33:49.205 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:49.379 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:33:49.383 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:49.384 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:33:49.484 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:33:49.545 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:49.578 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-02-10T08:33:49.578 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-02-10T08:33:49.578 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-02-10T08:33:49.578 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-02-10T08:33:49.578 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-02-10T08:33:49.735 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 63 16 96077 96061 95.2523 60.125 0.0173541 0.0104937 2024-02-10T08:33:50.150 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-10T08:33:50.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:33:48.562576+0000 mgr.y (mgr.14505) 641 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:33:50.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:48.980413+0000 mgr.y (mgr.14505) 642 : cluster [DBG] pgmap v797: 168 pgs: 168 active+clean; 5.7 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 1.2 KiB/s rd, 79 MiB/s wr, 1.26k op/s 2024-02-10T08:33:50.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:33:49.299619+0000 mon.b (mon.1) 76 : audit [INF] from='client.? 172.21.15.18:0/4170610450' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:33:50.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:33:49.305485+0000 mon.a (mon.0) 1556 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:33:50.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:33:48.562576+0000 mgr.y (mgr.14505) 641 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:33:50.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:48.980413+0000 mgr.y (mgr.14505) 642 : cluster [DBG] pgmap v797: 168 pgs: 168 active+clean; 5.7 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 1.2 KiB/s rd, 79 MiB/s wr, 1.26k op/s 2024-02-10T08:33:50.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:33:49.299619+0000 mon.b (mon.1) 76 : audit [INF] from='client.? 172.21.15.18:0/4170610450' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:33:50.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:33:49.305485+0000 mon.a (mon.0) 1556 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:33:50.535 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is set 2024-02-10T08:33:50.543 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:33:48.562576+0000 mgr.y (mgr.14505) 641 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:33:50.543 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:48.980413+0000 mgr.y (mgr.14505) 642 : cluster [DBG] pgmap v797: 168 pgs: 168 active+clean; 5.7 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 1.2 KiB/s rd, 79 MiB/s wr, 1.26k op/s 2024-02-10T08:33:50.543 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:33:49.299619+0000 mon.b (mon.1) 76 : audit [INF] from='client.? 172.21.15.18:0/4170610450' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:33:50.543 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:33:49.305485+0000 mon.a (mon.0) 1556 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:33:50.735 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 64 16 97161 97145 94.8217 67.75 0.0110133 0.0105416 2024-02-10T08:33:51.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:50.035665+0000 mon.a (mon.0) 1557 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:33:51.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:33:50.048052+0000 mon.a (mon.0) 1558 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-10T08:33:51.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:50.048127+0000 mon.a (mon.0) 1559 : cluster [DBG] osdmap e363: 8 total, 8 up, 8 in 2024-02-10T08:33:51.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:50.035665+0000 mon.a (mon.0) 1557 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:33:51.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:33:50.048052+0000 mon.a (mon.0) 1558 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-10T08:33:51.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:50.048127+0000 mon.a (mon.0) 1559 : cluster [DBG] osdmap e363: 8 total, 8 up, 8 in 2024-02-10T08:33:51.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:51 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:50.035665+0000 mon.a (mon.0) 1557 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:33:51.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:51 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:33:50.048052+0000 mon.a (mon.0) 1558 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-10T08:33:51.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:51 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:50.048127+0000 mon.a (mon.0) 1559 : cluster [DBG] osdmap e363: 8 total, 8 up, 8 in 2024-02-10T08:33:51.735 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 65 16 98221 98205 94.3822 66.25 0.00312377 0.0105757 2024-02-10T08:33:52.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:50.980818+0000 mgr.y (mgr.14505) 643 : cluster [DBG] pgmap v799: 168 pgs: 168 active+clean; 5.8 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 633 B/s rd, 58 MiB/s wr, 927 op/s 2024-02-10T08:33:52.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:50.980818+0000 mgr.y (mgr.14505) 643 : cluster [DBG] pgmap v799: 168 pgs: 168 active+clean; 5.8 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 633 B/s rd, 58 MiB/s wr, 927 op/s 2024-02-10T08:33:52.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:52 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:50.980818+0000 mgr.y (mgr.14505) 643 : cluster [DBG] pgmap v799: 168 pgs: 168 active+clean; 5.8 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 633 B/s rd, 58 MiB/s wr, 927 op/s 2024-02-10T08:33:52.643 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:33:52.650 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:52.650 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:33:52.666 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.2 dump_historic_ops 2024-02-10T08:33:52.735 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 66 16 99309 99293 93.9825 68 0.0133166 0.0106362 2024-02-10T08:33:52.751 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:33:52.796 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:52.821 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:33:52.826 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:52.827 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:33:52.927 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:33:52.985 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:53.009 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:33:53.012 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:53.013 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:33:53.113 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:33:53.168 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:53.207 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:33:53.212 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:53.213 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:33:53.313 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:33:53.348 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:53.373 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:33:53.383 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:53.383 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:33:53.484 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:33:53.526 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:53.570 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:33:53.576 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:53.576 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:33:53.677 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:33:53.721 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:53.735 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 67 16 100343 100327 93.5444 64.625 0.0153971 0.010686 2024-02-10T08:33:53.749 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:33:53.759 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:53.759 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:33:53.860 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:33:53.916 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:53.944 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:33:53.949 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:53.949 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:33:54.050 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:33:54.084 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:54.110 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:33:54.113 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:54.114 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:33:54.214 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:33:54.257 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:54 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:52.981497+0000 mgr.y (mgr.14505) 644 : cluster [DBG] pgmap v800: 168 pgs: 168 active+clean; 6.0 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 1023 B/s rd, 67 MiB/s wr, 1.07k op/s 2024-02-10T08:33:54.258 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:54.289 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:33:54.295 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:54.295 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:33:54.396 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:33:54.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:52.981497+0000 mgr.y (mgr.14505) 644 : cluster [DBG] pgmap v800: 168 pgs: 168 active+clean; 6.0 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 1023 B/s rd, 67 MiB/s wr, 1.07k op/s 2024-02-10T08:33:54.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:52.981497+0000 mgr.y (mgr.14505) 644 : cluster [DBG] pgmap v800: 168 pgs: 168 active+clean; 6.0 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 1023 B/s rd, 67 MiB/s wr, 1.07k op/s 2024-02-10T08:33:54.453 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:54.736 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 68 16 101388 101372 93.1293 65.3125 0.0153626 0.0107338 2024-02-10T08:33:54.924 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:33:54.931 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:54.931 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:33:55.032 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:33:55.083 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:55.118 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:33:55.122 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:55.123 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:33:55.223 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:33:55.252 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:55.272 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:33:55.277 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:55.278 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:33:55.378 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:33:55.403 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:33:54.326300+0000 mon.a (mon.0) 1560 : audit [INF] from='client.? 172.21.15.18:0/700000594' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 6, "weight": 0.6642606200466541}]: dispatch 2024-02-10T08:33:55.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:33:54.326300+0000 mon.a (mon.0) 1560 : audit [INF] from='client.? 172.21.15.18:0/700000594' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 6, "weight": 0.6642606200466541}]: dispatch 2024-02-10T08:33:55.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:33:54.326300+0000 mon.a (mon.0) 1560 : audit [INF] from='client.? 172.21.15.18:0/700000594' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 6, "weight": 0.6642606200466541}]: dispatch 2024-02-10T08:33:55.404 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:55.423 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:33:55.425 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:55.425 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:33:55.469 INFO:teuthology.orchestra.run.smithi018.stderr:set osd.6 primary-affinity to 0.664261 (8435322) 2024-02-10T08:33:55.526 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:33:55.552 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:55.570 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:33:55.572 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:55.573 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:33:55.673 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:33:55.708 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:55.735 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 69 16 101940 101924 92.2799 34.5 0.00591656 0.0107486 2024-02-10T08:33:55.808 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:33:55.817 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:55.817 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:33:55.918 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:33:55.946 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:56.176 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:33:56.188 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:56.188 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:33:56.189 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:33:56.197 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:33:56.289 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:33:56.346 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:56.377 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:33:56.378 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:56.379 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:33:56.379 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:54.981977+0000 mgr.y (mgr.14505) 645 : cluster [DBG] pgmap v801: 168 pgs: 168 active+clean; 6.0 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 1023 B/s rd, 67 MiB/s wr, 1.07k op/s 2024-02-10T08:33:56.379 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:33:55.097921+0000 mon.a (mon.0) 1561 : audit [INF] from='client.? 172.21.15.18:0/700000594' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 6, "weight": 0.6642606200466541}]': finished 2024-02-10T08:33:56.379 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:55.097998+0000 mon.a (mon.0) 1562 : cluster [DBG] osdmap e364: 8 total, 8 up, 8 in 2024-02-10T08:33:56.408 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:54.981977+0000 mgr.y (mgr.14505) 645 : cluster [DBG] pgmap v801: 168 pgs: 168 active+clean; 6.0 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 1023 B/s rd, 67 MiB/s wr, 1.07k op/s 2024-02-10T08:33:56.408 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:33:55.097921+0000 mon.a (mon.0) 1561 : audit [INF] from='client.? 172.21.15.18:0/700000594' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 6, "weight": 0.6642606200466541}]': finished 2024-02-10T08:33:56.409 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:55.097998+0000 mon.a (mon.0) 1562 : cluster [DBG] osdmap e364: 8 total, 8 up, 8 in 2024-02-10T08:33:56.409 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:54.981977+0000 mgr.y (mgr.14505) 645 : cluster [DBG] pgmap v801: 168 pgs: 168 active+clean; 6.0 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 1023 B/s rd, 67 MiB/s wr, 1.07k op/s 2024-02-10T08:33:56.409 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:33:55.097921+0000 mon.a (mon.0) 1561 : audit [INF] from='client.? 172.21.15.18:0/700000594' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 6, "weight": 0.6642606200466541}]': finished 2024-02-10T08:33:56.409 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:55.097998+0000 mon.a (mon.0) 1562 : cluster [DBG] osdmap e364: 8 total, 8 up, 8 in 2024-02-10T08:33:56.479 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:33:56.537 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:56.576 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:33:56.582 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:56.582 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:33:56.683 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:33:56.725 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:33:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:33:56] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:33:56.729 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:56.736 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 70 16 102545 102529 91.502 37.8125 0.0175013 0.0109244 2024-02-10T08:33:56.753 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:33:56.760 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:56.760 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:33:56.861 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:33:56.917 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:56.944 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd unset noscrub 2024-02-10T08:33:56.949 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:33:56.952 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:56.953 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:33:57.053 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:33:57.093 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:57.125 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:56.113196+0000 mon.a (mon.0) 1563 : cluster [DBG] osdmap e365: 8 total, 8 up, 8 in 2024-02-10T08:33:57.126 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:33:57.136 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:57.136 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:33:57.237 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:33:57.287 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:57.317 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:33:57.325 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:57.325 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:33:57.404 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:33:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:33:57] "GET /metrics HTTP/1.1" 200 176408 "" "Prometheus/2.33.4" 2024-02-10T08:33:57.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:56.113196+0000 mon.a (mon.0) 1563 : cluster [DBG] osdmap e365: 8 total, 8 up, 8 in 2024-02-10T08:33:57.426 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:33:57.482 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:56.113196+0000 mon.a (mon.0) 1563 : cluster [DBG] osdmap e365: 8 total, 8 up, 8 in 2024-02-10T08:33:57.483 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:57.517 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:33:57.522 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:57.522 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:33:57.623 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:33:57.686 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:57.736 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 71 16 103598 103582 91.1402 65.8125 0.0104814 0.0109676 2024-02-10T08:33:57.829 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:33:57.833 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:57.834 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:33:57.935 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:33:57.969 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:58.008 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:33:58.016 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:58.017 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:33:58.118 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:33:58.132 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:33:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:56.982409+0000 mgr.y (mgr.14505) 646 : cluster [DBG] pgmap v804: 168 pgs: 168 active+clean; 6.1 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 738 B/s rd, 47 MiB/s wr, 752 op/s 2024-02-10T08:33:58.167 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:58.203 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:33:58.211 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:58.211 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:33:58.293 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:33:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:56.982409+0000 mgr.y (mgr.14505) 646 : cluster [DBG] pgmap v804: 168 pgs: 168 active+clean; 6.1 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 738 B/s rd, 47 MiB/s wr, 752 op/s 2024-02-10T08:33:58.312 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:33:58.378 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:58.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:33:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:56.982409+0000 mgr.y (mgr.14505) 646 : cluster [DBG] pgmap v804: 168 pgs: 168 active+clean; 6.1 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 738 B/s rd, 47 MiB/s wr, 752 op/s 2024-02-10T08:33:58.412 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:33:58.419 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:58.419 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:33:58.520 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:33:58.577 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:58.607 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:33:58.609 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:58.610 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:33:58.711 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:33:58.736 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 72 16 104713 104697 90.8421 69.6875 0.00531465 0.0110032 2024-02-10T08:33:58.780 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:58.789 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:33:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:33:58.840 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:33:58.844 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:33:58.845 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:33:58.945 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:33:59.011 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:33:59.736 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 73 16 105837 105821 90.56 70.25 0.0209969 0.011038 2024-02-10T08:34:00.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:33:58.575121+0000 mgr.y (mgr.14505) 647 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:34:00.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:33:58.985550+0000 mgr.y (mgr.14505) 648 : cluster [DBG] pgmap v805: 168 pgs: 168 active+clean; 6.3 GiB data, 23 GiB used, 693 GiB / 715 GiB avail; 1.2 KiB/s rd, 68 MiB/s wr, 1.09k op/s 2024-02-10T08:34:00.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:33:58.575121+0000 mgr.y (mgr.14505) 647 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:34:00.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:33:58.985550+0000 mgr.y (mgr.14505) 648 : cluster [DBG] pgmap v805: 168 pgs: 168 active+clean; 6.3 GiB data, 23 GiB used, 693 GiB / 715 GiB avail; 1.2 KiB/s rd, 68 MiB/s wr, 1.09k op/s 2024-02-10T08:34:00.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:33:58.575121+0000 mgr.y (mgr.14505) 647 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:34:00.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:33:58.985550+0000 mgr.y (mgr.14505) 648 : cluster [DBG] pgmap v805: 168 pgs: 168 active+clean; 6.3 GiB data, 23 GiB used, 693 GiB / 715 GiB avail; 1.2 KiB/s rd, 68 MiB/s wr, 1.09k op/s 2024-02-10T08:34:00.737 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 74 16 106928 106912 90.2572 68.1875 0.0190347 0.0110756 2024-02-10T08:34:01.197 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:34:01.197 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:34:01.198 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:34:01.198 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:34:01.198 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:34:01.198 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:34:01.198 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:34:01.198 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:34:01.198 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-10T08:34:01.198 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-10T08:34:01.198 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-10T08:34:01.198 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-10T08:34:01.198 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-10T08:34:01.199 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-10T08:34:01.199 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-10T08:34:01.199 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-10T08:34:01.213 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 3, 4, 5, 6, 7, 0] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 5, 6, 7, 4] 2024-02-10T08:34:01.213 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-10T08:34:01.213 INFO:tasks.thrashosds.thrasher:inject_pause on osd.4 2024-02-10T08:34:01.213 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-02-10T08:34:01.213 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-02-10T08:34:01.214 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.4 config set filestore_inject_stall 3 2024-02-10T08:34:01.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:34:00.631055+0000 mon.b (mon.1) 77 : audit [DBG] from='client.? 172.21.15.18:0/2829378084' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:34:01.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:34:00.631055+0000 mon.b (mon.1) 77 : audit [DBG] from='client.? 172.21.15.18:0/2829378084' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:34:01.411 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:34:01.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:34:00.631055+0000 mon.b (mon.1) 77 : audit [DBG] from='client.? 172.21.15.18:0/2829378084' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:34:01.647 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:34:01.737 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 75 16 107923 107907 89.883 62.1875 0.0136877 0.011121 2024-02-10T08:34:01.849 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-02-10T08:34:01.849 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:34:02.080 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:34:02.086 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:02.086 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:34:02.187 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:34:02.235 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:00.985987+0000 mgr.y (mgr.14505) 649 : cluster [DBG] pgmap v806: 168 pgs: 168 active+clean; 6.4 GiB data, 23 GiB used, 693 GiB / 715 GiB avail; 639 B/s rd, 51 MiB/s wr, 815 op/s 2024-02-10T08:34:02.235 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:01.148253+0000 osd.0 (osd.0) 187 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:34:02.235 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:01.148304+0000 osd.0 (osd.0) 188 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:34:02.257 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:02.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:00.985987+0000 mgr.y (mgr.14505) 649 : cluster [DBG] pgmap v806: 168 pgs: 168 active+clean; 6.4 GiB data, 23 GiB used, 693 GiB / 715 GiB avail; 639 B/s rd, 51 MiB/s wr, 815 op/s 2024-02-10T08:34:02.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:01.148253+0000 osd.0 (osd.0) 187 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:34:02.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:01.148304+0000 osd.0 (osd.0) 188 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:34:02.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:00.985987+0000 mgr.y (mgr.14505) 649 : cluster [DBG] pgmap v806: 168 pgs: 168 active+clean; 6.4 GiB data, 23 GiB used, 693 GiB / 715 GiB avail; 639 B/s rd, 51 MiB/s wr, 815 op/s 2024-02-10T08:34:02.407 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:01.148253+0000 osd.0 (osd.0) 187 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:34:02.407 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:01.148304+0000 osd.0 (osd.0) 188 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:34:02.532 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:34:02.538 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:02.538 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:34:02.639 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:34:02.696 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:02.737 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 76 15 109017 109002 89.6009 68.4375 0.0130236 0.0111565 2024-02-10T08:34:03.067 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:34:03.071 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:03.071 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:34:03.172 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:34:03.238 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:03.271 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:34:03.276 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:03.276 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:34:03.360 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:02.174562+0000 mon.a (mon.0) 1564 : cluster [DBG] osdmap e366: 8 total, 8 up, 8 in 2024-02-10T08:34:03.362 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:02.174562+0000 mon.a (mon.0) 1564 : cluster [DBG] osdmap e366: 8 total, 8 up, 8 in 2024-02-10T08:34:03.377 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:34:03.412 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:02.174562+0000 mon.a (mon.0) 1564 : cluster [DBG] osdmap e366: 8 total, 8 up, 8 in 2024-02-10T08:34:03.434 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:03.469 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.3 dump_ops_in_flight 2024-02-10T08:34:03.737 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 77 16 110066 110050 89.2879 65.5 0.0115463 0.0111952 2024-02-10T08:34:03.747 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-02-10T08:34:03.748 INFO:teuthology.orchestra.run.smithi071.stdout: "success": "" 2024-02-10T08:34:03.748 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-02-10T08:34:03.915 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:34:03.922 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:03.922 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:34:04.023 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:34:04.077 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:04.150 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:34:04.159 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:04.160 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:34:04.260 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:34:04.321 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:04.498 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:02.986578+0000 mgr.y (mgr.14505) 650 : cluster [DBG] pgmap v808: 168 pgs: 168 active+clean; 6.5 GiB data, 23 GiB used, 692 GiB / 715 GiB avail; 1.3 KiB/s rd, 60 MiB/s wr, 964 op/s 2024-02-10T08:34:04.537 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:34:04.550 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:04.550 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:34:04.634 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:02.986578+0000 mgr.y (mgr.14505) 650 : cluster [DBG] pgmap v808: 168 pgs: 168 active+clean; 6.5 GiB data, 23 GiB used, 692 GiB / 715 GiB avail; 1.3 KiB/s rd, 60 MiB/s wr, 964 op/s 2024-02-10T08:34:04.634 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:02.986578+0000 mgr.y (mgr.14505) 650 : cluster [DBG] pgmap v808: 168 pgs: 168 active+clean; 6.5 GiB data, 23 GiB used, 692 GiB / 715 GiB avail; 1.3 KiB/s rd, 60 MiB/s wr, 964 op/s 2024-02-10T08:34:04.639 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:34:04.651 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:34:04.722 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:04.737 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 78 16 111128 111112 88.9942 66.375 0.00642886 0.0112322 2024-02-10T08:34:05.043 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:34:05.048 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:05.048 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:34:05.116 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-10T08:34:05.149 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:34:05.192 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:05.226 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:34:05.230 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:05.231 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:34:05.332 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:34:05.386 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:05.411 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:34:05.413 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:05.414 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:34:05.515 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:34:05.566 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:05.605 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:34:05.607 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:05.608 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:34:05.709 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:34:05.737 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 79 16 112200 112184 88.7158 67 0.016383 0.0112675 2024-02-10T08:34:05.761 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:05.794 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:34:05.796 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:05.797 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:34:05.898 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:34:05.966 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:06.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:04.987227+0000 mgr.y (mgr.14505) 651 : cluster [DBG] pgmap v809: 168 pgs: 168 active+clean; 6.6 GiB data, 24 GiB used, 691 GiB / 715 GiB avail; 1.1 KiB/s rd, 63 MiB/s wr, 1.00k op/s 2024-02-10T08:34:06.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:04.987227+0000 mgr.y (mgr.14505) 651 : cluster [DBG] pgmap v809: 168 pgs: 168 active+clean; 6.6 GiB data, 24 GiB used, 691 GiB / 715 GiB avail; 1.1 KiB/s rd, 63 MiB/s wr, 1.00k op/s 2024-02-10T08:34:06.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:04.987227+0000 mgr.y (mgr.14505) 651 : cluster [DBG] pgmap v809: 168 pgs: 168 active+clean; 6.6 GiB data, 24 GiB used, 691 GiB / 715 GiB avail; 1.1 KiB/s rd, 63 MiB/s wr, 1.00k op/s 2024-02-10T08:34:06.737 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:2024-02-10T08:34:06.737832+0000 min lat: 0.00134707 max lat: 1.02902 avg lat: 0.0112949 2024-02-10T08:34:06.737 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-02-10T08:34:06.737 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 80 16 113346 113330 88.5022 71.625 0.0144392 0.0112949 2024-02-10T08:34:06.791 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:34:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:34:06] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:34:07.406 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:34:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:34:07] "GET /metrics HTTP/1.1" 200 176402 "" "Prometheus/2.33.4" 2024-02-10T08:34:07.738 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 81 16 114500 114484 88.2999 72.125 0.0173262 0.0113211 2024-02-10T08:34:08.042 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:34:08.048 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:08.049 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:34:08.150 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:34:08.207 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:08.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:06.988046+0000 mgr.y (mgr.14505) 652 : cluster [DBG] pgmap v810: 168 pgs: 168 active+clean; 6.7 GiB data, 24 GiB used, 691 GiB / 715 GiB avail; 1023 B/s rd, 62 MiB/s wr, 991 op/s 2024-02-10T08:34:08.407 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:06.988046+0000 mgr.y (mgr.14505) 652 : cluster [DBG] pgmap v810: 168 pgs: 168 active+clean; 6.7 GiB data, 24 GiB used, 691 GiB / 715 GiB avail; 1023 B/s rd, 62 MiB/s wr, 991 op/s 2024-02-10T08:34:08.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:06.988046+0000 mgr.y (mgr.14505) 652 : cluster [DBG] pgmap v810: 168 pgs: 168 active+clean; 6.7 GiB data, 24 GiB used, 691 GiB / 715 GiB avail; 1023 B/s rd, 62 MiB/s wr, 991 op/s 2024-02-10T08:34:08.567 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:34:08.578 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:08.578 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:34:08.679 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:34:08.728 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:08.737 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 82 16 115588 115572 88.0524 68 0.0265482 0.0113521 2024-02-10T08:34:09.039 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:34:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:34:09.283 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is unset 2024-02-10T08:34:09.425 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-02-10T08:34:09.425 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:34:09.529 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 3, 4, 5, 6, 7, 0] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 5, 6, 7, 4] 2024-02-10T08:34:09.529 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-10T08:34:09.529 INFO:tasks.thrashosds.thrasher:inject_pause on osd.2 2024-02-10T08:34:09.530 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-02-10T08:34:09.530 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-02-10T08:34:09.530 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.2 config set filestore_inject_stall 3 2024-02-10T08:34:09.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:34:09.144836+0000 mon.b (mon.1) 78 : audit [INF] from='client.? 172.21.15.18:0/3270396467' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:34:09.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:34:09.145290+0000 mon.a (mon.0) 1565 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:34:09.577 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:34:09.144836+0000 mon.b (mon.1) 78 : audit [INF] from='client.? 172.21.15.18:0/3270396467' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:34:09.577 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:34:09.145290+0000 mon.a (mon.0) 1565 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:34:09.577 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:34:09.144836+0000 mon.b (mon.1) 78 : audit [INF] from='client.? 172.21.15.18:0/3270396467' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:34:09.577 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:34:09.145290+0000 mon.a (mon.0) 1565 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:34:09.738 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 83 16 116607 116591 87.7587 63.6875 0.014856 0.0113903 2024-02-10T08:34:10.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:34:08.585529+0000 mgr.y (mgr.14505) 653 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:34:10.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:08.991959+0000 mgr.y (mgr.14505) 654 : cluster [DBG] pgmap v811: 168 pgs: 168 active+clean; 7.0 GiB data, 25 GiB used, 690 GiB / 715 GiB avail; 1023 B/s rd, 68 MiB/s wr, 1.08k op/s 2024-02-10T08:34:10.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:09.239857+0000 mon.a (mon.0) 1566 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:34:10.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:34:09.267750+0000 mon.a (mon.0) 1567 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-10T08:34:10.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:09.267818+0000 mon.a (mon.0) 1568 : cluster [DBG] osdmap e367: 8 total, 8 up, 8 in 2024-02-10T08:34:10.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:09.291522+0000 osd.5 (osd.5) 215 : cluster [DBG] 6.a scrub starts 2024-02-10T08:34:10.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:09.307427+0000 osd.5 (osd.5) 216 : cluster [DBG] 6.a scrub ok 2024-02-10T08:34:10.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:09.350171+0000 osd.7 (osd.7) 213 : cluster [DBG] 5.9 scrub starts 2024-02-10T08:34:10.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:09.351331+0000 osd.7 (osd.7) 214 : cluster [DBG] 5.9 scrub ok 2024-02-10T08:34:10.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:34:10.171216+0000 mon.a (mon.0) 1569 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:34:10.407 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:34:08.585529+0000 mgr.y (mgr.14505) 653 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:34:10.407 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:08.991959+0000 mgr.y (mgr.14505) 654 : cluster [DBG] pgmap v811: 168 pgs: 168 active+clean; 7.0 GiB data, 25 GiB used, 690 GiB / 715 GiB avail; 1023 B/s rd, 68 MiB/s wr, 1.08k op/s 2024-02-10T08:34:10.407 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:09.239857+0000 mon.a (mon.0) 1566 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:34:10.407 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:34:09.267750+0000 mon.a (mon.0) 1567 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-10T08:34:10.407 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:09.267818+0000 mon.a (mon.0) 1568 : cluster [DBG] osdmap e367: 8 total, 8 up, 8 in 2024-02-10T08:34:10.408 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:09.291522+0000 osd.5 (osd.5) 215 : cluster [DBG] 6.a scrub starts 2024-02-10T08:34:10.408 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:09.307427+0000 osd.5 (osd.5) 216 : cluster [DBG] 6.a scrub ok 2024-02-10T08:34:10.408 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:09.350171+0000 osd.7 (osd.7) 213 : cluster [DBG] 5.9 scrub starts 2024-02-10T08:34:10.408 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:09.351331+0000 osd.7 (osd.7) 214 : cluster [DBG] 5.9 scrub ok 2024-02-10T08:34:10.408 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:34:10.171216+0000 mon.a (mon.0) 1569 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:34:10.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:34:08.585529+0000 mgr.y (mgr.14505) 653 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:34:10.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:08.991959+0000 mgr.y (mgr.14505) 654 : cluster [DBG] pgmap v811: 168 pgs: 168 active+clean; 7.0 GiB data, 25 GiB used, 690 GiB / 715 GiB avail; 1023 B/s rd, 68 MiB/s wr, 1.08k op/s 2024-02-10T08:34:10.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:09.239857+0000 mon.a (mon.0) 1566 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:34:10.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:34:09.267750+0000 mon.a (mon.0) 1567 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-10T08:34:10.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:09.267818+0000 mon.a (mon.0) 1568 : cluster [DBG] osdmap e367: 8 total, 8 up, 8 in 2024-02-10T08:34:10.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:09.291522+0000 osd.5 (osd.5) 215 : cluster [DBG] 6.a scrub starts 2024-02-10T08:34:10.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:09.307427+0000 osd.5 (osd.5) 216 : cluster [DBG] 6.a scrub ok 2024-02-10T08:34:10.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:09.350171+0000 osd.7 (osd.7) 213 : cluster [DBG] 5.9 scrub starts 2024-02-10T08:34:10.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:09.351331+0000 osd.7 (osd.7) 214 : cluster [DBG] 5.9 scrub ok 2024-02-10T08:34:10.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:34:10.171216+0000 mon.a (mon.0) 1569 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:34:10.738 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 84 16 117649 117633 87.4893 65.125 0.0282013 0.0114255 2024-02-10T08:34:11.385 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.3 dump_blocked_ops 2024-02-10T08:34:11.738 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 85 16 118707 118691 87.238 66.125 0.0114394 0.0114579 2024-02-10T08:34:11.828 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:34:11.832 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:10.164589+0000 osd.4 (osd.4) 120 : cluster [DBG] 5.1 scrub starts 2024-02-10T08:34:11.832 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:10.165701+0000 osd.4 (osd.4) 121 : cluster [DBG] 5.1 scrub ok 2024-02-10T08:34:11.832 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:10.327319+0000 osd.5 (osd.5) 217 : cluster [DBG] 6.2b scrub starts 2024-02-10T08:34:11.832 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:10.431126+0000 osd.5 (osd.5) 218 : cluster [DBG] 6.2b scrub ok 2024-02-10T08:34:11.832 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:34:10.540470+0000 mon.a (mon.0) 1570 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:34:11.832 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:10.693234+0000 osd.1 (osd.1) 210 : cluster [DBG] 6.1d scrub starts 2024-02-10T08:34:11.832 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:10.742145+0000 osd.1 (osd.1) 211 : cluster [DBG] 6.1d scrub ok 2024-02-10T08:34:11.832 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:10.801685+0000 osd.2 (osd.2) 177 : cluster [DBG] 4.1c scrub starts 2024-02-10T08:34:11.832 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:10.804105+0000 osd.2 (osd.2) 178 : cluster [DBG] 4.1c scrub ok 2024-02-10T08:34:11.833 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:10.992371+0000 mgr.y (mgr.14505) 655 : cluster [DBG] pgmap v813: 168 pgs: 168 active+clean; 7.0 GiB data, 25 GiB used, 690 GiB / 715 GiB avail; 1.1 KiB/s rd, 77 MiB/s wr, 1.23k op/s 2024-02-10T08:34:11.833 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:11.137458+0000 osd.0 (osd.0) 189 : cluster [DBG] 6.0 scrub starts 2024-02-10T08:34:11.833 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:11.145900+0000 osd.0 (osd.0) 190 : cluster [DBG] 6.0 scrub ok 2024-02-10T08:34:11.833 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:11.834 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:34:11.834 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:10.164589+0000 osd.4 (osd.4) 120 : cluster [DBG] 5.1 scrub starts 2024-02-10T08:34:11.834 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:10.165701+0000 osd.4 (osd.4) 121 : cluster [DBG] 5.1 scrub ok 2024-02-10T08:34:11.834 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:10.327319+0000 osd.5 (osd.5) 217 : cluster [DBG] 6.2b scrub starts 2024-02-10T08:34:11.834 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:10.431126+0000 osd.5 (osd.5) 218 : cluster [DBG] 6.2b scrub ok 2024-02-10T08:34:11.834 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:34:10.540470+0000 mon.a (mon.0) 1570 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:34:11.834 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:10.693234+0000 osd.1 (osd.1) 210 : cluster [DBG] 6.1d scrub starts 2024-02-10T08:34:11.834 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:10.742145+0000 osd.1 (osd.1) 211 : cluster [DBG] 6.1d scrub ok 2024-02-10T08:34:11.834 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:10.801685+0000 osd.2 (osd.2) 177 : cluster [DBG] 4.1c scrub starts 2024-02-10T08:34:11.834 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:10.804105+0000 osd.2 (osd.2) 178 : cluster [DBG] 4.1c scrub ok 2024-02-10T08:34:11.835 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:10.992371+0000 mgr.y (mgr.14505) 655 : cluster [DBG] pgmap v813: 168 pgs: 168 active+clean; 7.0 GiB data, 25 GiB used, 690 GiB / 715 GiB avail; 1.1 KiB/s rd, 77 MiB/s wr, 1.23k op/s 2024-02-10T08:34:11.835 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:11.137458+0000 osd.0 (osd.0) 189 : cluster [DBG] 6.0 scrub starts 2024-02-10T08:34:11.835 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:11.145900+0000 osd.0 (osd.0) 190 : cluster [DBG] 6.0 scrub ok 2024-02-10T08:34:11.934 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:34:11.977 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:34:11.996 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:34:12.010 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:34:12.021 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:12.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:10.164589+0000 osd.4 (osd.4) 120 : cluster [DBG] 5.1 scrub starts 2024-02-10T08:34:12.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:10.165701+0000 osd.4 (osd.4) 121 : cluster [DBG] 5.1 scrub ok 2024-02-10T08:34:12.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:10.327319+0000 osd.5 (osd.5) 217 : cluster [DBG] 6.2b scrub starts 2024-02-10T08:34:12.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:10.431126+0000 osd.5 (osd.5) 218 : cluster [DBG] 6.2b scrub ok 2024-02-10T08:34:12.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:34:10.540470+0000 mon.a (mon.0) 1570 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:34:12.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:10.693234+0000 osd.1 (osd.1) 210 : cluster [DBG] 6.1d scrub starts 2024-02-10T08:34:12.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:10.742145+0000 osd.1 (osd.1) 211 : cluster [DBG] 6.1d scrub ok 2024-02-10T08:34:12.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:10.801685+0000 osd.2 (osd.2) 177 : cluster [DBG] 4.1c scrub starts 2024-02-10T08:34:12.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:10.804105+0000 osd.2 (osd.2) 178 : cluster [DBG] 4.1c scrub ok 2024-02-10T08:34:12.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:10.992371+0000 mgr.y (mgr.14505) 655 : cluster [DBG] pgmap v813: 168 pgs: 168 active+clean; 7.0 GiB data, 25 GiB used, 690 GiB / 715 GiB avail; 1.1 KiB/s rd, 77 MiB/s wr, 1.23k op/s 2024-02-10T08:34:12.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:11.137458+0000 osd.0 (osd.0) 189 : cluster [DBG] 6.0 scrub starts 2024-02-10T08:34:12.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:11.145900+0000 osd.0 (osd.0) 190 : cluster [DBG] 6.0 scrub ok 2024-02-10T08:34:12.181 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:34:12.191 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:12.192 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:34:12.293 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:34:12.354 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:12.548 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:11.018508+0000 osd.6 (osd.6) 188 : cluster [DBG] 2.19 scrub starts 2024-02-10T08:34:12.550 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:11.018508+0000 osd.6 (osd.6) 188 : cluster [DBG] 2.19 scrub starts 2024-02-10T08:34:12.550 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:11.022349+0000 osd.6 (osd.6) 189 : cluster [DBG] 2.19 scrub ok 2024-02-10T08:34:12.550 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:11.724982+0000 osd.1 (osd.1) 212 : cluster [DBG] 4.2 scrub starts 2024-02-10T08:34:12.550 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:11.736593+0000 osd.1 (osd.1) 213 : cluster [DBG] 4.2 scrub ok 2024-02-10T08:34:12.550 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:34:11.991713+0000 mon.a (mon.0) 1571 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:34:12.550 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:34:11.992734+0000 mon.a (mon.0) 1572 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:34:12.550 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:34:12.031283+0000 mon.a (mon.0) 1573 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:34:12.550 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:12.116202+0000 osd.0 (osd.0) 191 : cluster [DBG] 6.14 scrub starts 2024-02-10T08:34:12.550 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:12.117370+0000 osd.0 (osd.0) 192 : cluster [DBG] 6.14 scrub ok 2024-02-10T08:34:12.740 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 86 16 119697 119681 86.9412 61.875 0.00544899 0.0114976 2024-02-10T08:34:12.811 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:11.022349+0000 osd.6 (osd.6) 189 : cluster [DBG] 2.19 scrub ok 2024-02-10T08:34:12.812 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:11.724982+0000 osd.1 (osd.1) 212 : cluster [DBG] 4.2 scrub starts 2024-02-10T08:34:12.812 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:11.736593+0000 osd.1 (osd.1) 213 : cluster [DBG] 4.2 scrub ok 2024-02-10T08:34:12.812 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:34:11.991713+0000 mon.a (mon.0) 1571 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:34:12.812 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:34:11.992734+0000 mon.a (mon.0) 1572 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:34:12.812 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:34:12.031283+0000 mon.a (mon.0) 1573 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:34:12.812 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:12.116202+0000 osd.0 (osd.0) 191 : cluster [DBG] 6.14 scrub starts 2024-02-10T08:34:12.812 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:12.117370+0000 osd.0 (osd.0) 192 : cluster [DBG] 6.14 scrub ok 2024-02-10T08:34:13.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:11.018508+0000 osd.6 (osd.6) 188 : cluster [DBG] 2.19 scrub starts 2024-02-10T08:34:13.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:11.022349+0000 osd.6 (osd.6) 189 : cluster [DBG] 2.19 scrub ok 2024-02-10T08:34:13.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:11.724982+0000 osd.1 (osd.1) 212 : cluster [DBG] 4.2 scrub starts 2024-02-10T08:34:13.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:11.736593+0000 osd.1 (osd.1) 213 : cluster [DBG] 4.2 scrub ok 2024-02-10T08:34:13.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:34:11.991713+0000 mon.a (mon.0) 1571 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:34:13.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:34:11.992734+0000 mon.a (mon.0) 1572 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:34:13.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:34:12.031283+0000 mon.a (mon.0) 1573 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:34:13.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:12.116202+0000 osd.0 (osd.0) 191 : cluster [DBG] 6.14 scrub starts 2024-02-10T08:34:13.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:12.117370+0000 osd.0 (osd.0) 192 : cluster [DBG] 6.14 scrub ok 2024-02-10T08:34:13.740 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 87 16 120795 120779 86.7307 68.625 0.00928709 0.0115254 2024-02-10T08:34:13.777 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd unset nodeep-scrub 2024-02-10T08:34:13.835 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:12.119246+0000 osd.4 (osd.4) 122 : cluster [DBG] 4.1 scrub starts 2024-02-10T08:34:13.835 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:12.126129+0000 osd.4 (osd.4) 123 : cluster [DBG] 4.1 scrub ok 2024-02-10T08:34:13.835 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:12.332417+0000 osd.7 (osd.7) 215 : cluster [DBG] 5.1a scrub starts 2024-02-10T08:34:13.835 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:12.333163+0000 osd.7 (osd.7) 216 : cluster [DBG] 5.1a scrub ok 2024-02-10T08:34:13.835 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:12.993759+0000 mgr.y (mgr.14505) 656 : cluster [DBG] pgmap v814: 168 pgs: 168 active+clean; 7.2 GiB data, 25 GiB used, 690 GiB / 715 GiB avail; 1023 B/s rd, 67 MiB/s wr, 1.07k op/s 2024-02-10T08:34:13.835 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:13.093374+0000 osd.0 (osd.0) 193 : cluster [DBG] 5.5 scrub starts 2024-02-10T08:34:13.835 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:13.094420+0000 osd.0 (osd.0) 194 : cluster [DBG] 5.5 scrub ok 2024-02-10T08:34:13.836 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:12.119246+0000 osd.4 (osd.4) 122 : cluster [DBG] 4.1 scrub starts 2024-02-10T08:34:13.836 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:12.126129+0000 osd.4 (osd.4) 123 : cluster [DBG] 4.1 scrub ok 2024-02-10T08:34:13.836 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:12.332417+0000 osd.7 (osd.7) 215 : cluster [DBG] 5.1a scrub starts 2024-02-10T08:34:13.836 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:12.333163+0000 osd.7 (osd.7) 216 : cluster [DBG] 5.1a scrub ok 2024-02-10T08:34:13.836 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:12.993759+0000 mgr.y (mgr.14505) 656 : cluster [DBG] pgmap v814: 168 pgs: 168 active+clean; 7.2 GiB data, 25 GiB used, 690 GiB / 715 GiB avail; 1023 B/s rd, 67 MiB/s wr, 1.07k op/s 2024-02-10T08:34:13.836 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:13.093374+0000 osd.0 (osd.0) 193 : cluster [DBG] 5.5 scrub starts 2024-02-10T08:34:13.836 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:13.094420+0000 osd.0 (osd.0) 194 : cluster [DBG] 5.5 scrub ok 2024-02-10T08:34:14.041 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:12.119246+0000 osd.4 (osd.4) 122 : cluster [DBG] 4.1 scrub starts 2024-02-10T08:34:14.041 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:12.126129+0000 osd.4 (osd.4) 123 : cluster [DBG] 4.1 scrub ok 2024-02-10T08:34:14.041 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:12.332417+0000 osd.7 (osd.7) 215 : cluster [DBG] 5.1a scrub starts 2024-02-10T08:34:14.041 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:12.333163+0000 osd.7 (osd.7) 216 : cluster [DBG] 5.1a scrub ok 2024-02-10T08:34:14.041 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:12.993759+0000 mgr.y (mgr.14505) 656 : cluster [DBG] pgmap v814: 168 pgs: 168 active+clean; 7.2 GiB data, 25 GiB used, 690 GiB / 715 GiB avail; 1023 B/s rd, 67 MiB/s wr, 1.07k op/s 2024-02-10T08:34:14.041 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:13.093374+0000 osd.0 (osd.0) 193 : cluster [DBG] 5.5 scrub starts 2024-02-10T08:34:14.041 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:13.094420+0000 osd.0 (osd.0) 194 : cluster [DBG] 5.5 scrub ok 2024-02-10T08:34:14.644 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:34:14.652 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:14.652 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:34:14.740 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 88 16 121798 121782 86.4575 62.6875 0.0128673 0.0115618 2024-02-10T08:34:14.753 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:34:14.796 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:14.822 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:34:14.823 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:13.289946+0000 osd.5 (osd.5) 219 : cluster [DBG] 6.33 scrub starts 2024-02-10T08:34:14.824 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:13.373802+0000 osd.5 (osd.5) 220 : cluster [DBG] 6.33 scrub ok 2024-02-10T08:34:14.824 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:13.770447+0000 osd.2 (osd.2) 179 : cluster [DBG] 10.5 scrub starts 2024-02-10T08:34:14.824 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:13.936635+0000 osd.1 (osd.1) 214 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:34:14.824 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:13.936683+0000 osd.1 (osd.1) 215 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:34:14.824 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:13.289946+0000 osd.5 (osd.5) 219 : cluster [DBG] 6.33 scrub starts 2024-02-10T08:34:14.824 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:13.373802+0000 osd.5 (osd.5) 220 : cluster [DBG] 6.33 scrub ok 2024-02-10T08:34:14.824 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:13.770447+0000 osd.2 (osd.2) 179 : cluster [DBG] 10.5 scrub starts 2024-02-10T08:34:14.824 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:13.936635+0000 osd.1 (osd.1) 214 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:34:14.824 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:13.936683+0000 osd.1 (osd.1) 215 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:34:14.828 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:14.828 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:13.289946+0000 osd.5 (osd.5) 219 : cluster [DBG] 6.33 scrub starts 2024-02-10T08:34:14.828 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:13.373802+0000 osd.5 (osd.5) 220 : cluster [DBG] 6.33 scrub ok 2024-02-10T08:34:14.828 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:13.770447+0000 osd.2 (osd.2) 179 : cluster [DBG] 10.5 scrub starts 2024-02-10T08:34:14.828 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:13.936635+0000 osd.1 (osd.1) 214 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:34:14.828 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:13.936683+0000 osd.1 (osd.1) 215 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:34:14.829 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:34:14.930 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:34:14.979 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:15.011 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:34:15.015 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:15.015 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:34:15.116 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:34:15.199 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:15.741 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 89 16 122832 122816 86.2115 64.625 0.0101626 0.0115956 2024-02-10T08:34:15.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:14.566586+0000 mon.a (mon.0) 1574 : cluster [DBG] osdmap e368: 8 total, 8 up, 8 in 2024-02-10T08:34:15.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:14.994160+0000 mgr.y (mgr.14505) 657 : cluster [DBG] pgmap v816: 168 pgs: 168 active+clean; 7.3 GiB data, 26 GiB used, 689 GiB / 715 GiB avail; 1.2 KiB/s rd, 76 MiB/s wr, 1.21k op/s 2024-02-10T08:34:15.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:14.566586+0000 mon.a (mon.0) 1574 : cluster [DBG] osdmap e368: 8 total, 8 up, 8 in 2024-02-10T08:34:15.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:14.994160+0000 mgr.y (mgr.14505) 657 : cluster [DBG] pgmap v816: 168 pgs: 168 active+clean; 7.3 GiB data, 26 GiB used, 689 GiB / 715 GiB avail; 1.2 KiB/s rd, 76 MiB/s wr, 1.21k op/s 2024-02-10T08:34:16.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:14.566586+0000 mon.a (mon.0) 1574 : cluster [DBG] osdmap e368: 8 total, 8 up, 8 in 2024-02-10T08:34:16.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:14.994160+0000 mgr.y (mgr.14505) 657 : cluster [DBG] pgmap v816: 168 pgs: 168 active+clean; 7.3 GiB data, 26 GiB used, 689 GiB / 715 GiB avail; 1.2 KiB/s rd, 76 MiB/s wr, 1.21k op/s 2024-02-10T08:34:16.503 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:34:16.513 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:16.514 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:34:16.615 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:34:16.647 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:16.674 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:34:16.683 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:16.683 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:34:16.742 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Total time run: 90.0091 2024-02-10T08:34:16.742 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Total writes made: 123800 2024-02-10T08:34:16.742 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Write size: 65536 2024-02-10T08:34:16.743 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Object size: 65536 2024-02-10T08:34:16.743 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Bandwidth (MB/sec): 85.9636 2024-02-10T08:34:16.743 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Stddev Bandwidth: 35.1204 2024-02-10T08:34:16.743 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Max bandwidth (MB/sec): 222.812 2024-02-10T08:34:16.743 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Min bandwidth (MB/sec): 34.5 2024-02-10T08:34:16.743 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Average IOPS: 1375 2024-02-10T08:34:16.743 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Stddev IOPS: 561.926 2024-02-10T08:34:16.743 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Max IOPS: 3565 2024-02-10T08:34:16.743 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Min IOPS: 552 2024-02-10T08:34:16.743 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Average Latency(s): 0.0116291 2024-02-10T08:34:16.743 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Stddev Latency(s): 0.0129872 2024-02-10T08:34:16.743 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Max latency(s): 1.02902 2024-02-10T08:34:16.743 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Min latency(s): 0.00134707 2024-02-10T08:34:16.746 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Cleaning up (deleting benchmark objects) 2024-02-10T08:34:16.784 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:34:16.790 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:34:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:34:16] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:34:16.844 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:17.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:15.717126+0000 osd.3 (osd.3) 109 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:34:17.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:15.717171+0000 osd.3 (osd.3) 110 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:34:17.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:34:16.019206+0000 mon.b (mon.1) 79 : audit [DBG] from='client.? 172.21.15.18:0/702958262' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:34:17.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:16.585819+0000 mon.a (mon.0) 1575 : cluster [DBG] osdmap e369: 8 total, 8 up, 8 in 2024-02-10T08:34:17.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:15.717126+0000 osd.3 (osd.3) 109 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:34:17.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:15.717171+0000 osd.3 (osd.3) 110 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:34:17.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:34:16.019206+0000 mon.b (mon.1) 79 : audit [DBG] from='client.? 172.21.15.18:0/702958262' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:34:17.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:16.585819+0000 mon.a (mon.0) 1575 : cluster [DBG] osdmap e369: 8 total, 8 up, 8 in 2024-02-10T08:34:17.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:15.717126+0000 osd.3 (osd.3) 109 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:34:17.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:15.717171+0000 osd.3 (osd.3) 110 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:34:17.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:34:16.019206+0000 mon.b (mon.1) 79 : audit [DBG] from='client.? 172.21.15.18:0/702958262' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:34:17.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:16.585819+0000 mon.a (mon.0) 1575 : cluster [DBG] osdmap e369: 8 total, 8 up, 8 in 2024-02-10T08:34:17.656 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:34:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:34:17] "GET /metrics HTTP/1.1" 200 176419 "" "Prometheus/2.33.4" 2024-02-10T08:34:17.686 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:34:17.687 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:34:17.687 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:34:17.687 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:34:17.687 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:34:17.687 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:34:17.687 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:34:17.687 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:34:17.687 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-10T08:34:17.687 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-10T08:34:17.687 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-10T08:34:17.687 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-10T08:34:17.687 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-10T08:34:17.688 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-10T08:34:17.688 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-10T08:34:17.688 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-10T08:34:18.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:16.996316+0000 mgr.y (mgr.14505) 658 : cluster [DBG] pgmap v818: 168 pgs: 168 active+clean; 7.3 GiB data, 26 GiB used, 689 GiB / 715 GiB avail; 663 B/s rd, 51 MiB/s wr, 809 op/s 2024-02-10T08:34:18.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:17.209534+0000 osd.2 (osd.2) 180 : cluster [DBG] 10.5 scrub ok 2024-02-10T08:34:18.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:17.346235+0000 osd.5 (osd.5) 221 : cluster [DBG] 6.31 scrub starts 2024-02-10T08:34:18.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:17.350400+0000 osd.5 (osd.5) 222 : cluster [DBG] 6.31 scrub ok 2024-02-10T08:34:18.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:16.996316+0000 mgr.y (mgr.14505) 658 : cluster [DBG] pgmap v818: 168 pgs: 168 active+clean; 7.3 GiB data, 26 GiB used, 689 GiB / 715 GiB avail; 663 B/s rd, 51 MiB/s wr, 809 op/s 2024-02-10T08:34:18.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:17.209534+0000 osd.2 (osd.2) 180 : cluster [DBG] 10.5 scrub ok 2024-02-10T08:34:18.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:17.346235+0000 osd.5 (osd.5) 221 : cluster [DBG] 6.31 scrub starts 2024-02-10T08:34:18.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:17.350400+0000 osd.5 (osd.5) 222 : cluster [DBG] 6.31 scrub ok 2024-02-10T08:34:18.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:16.996316+0000 mgr.y (mgr.14505) 658 : cluster [DBG] pgmap v818: 168 pgs: 168 active+clean; 7.3 GiB data, 26 GiB used, 689 GiB / 715 GiB avail; 663 B/s rd, 51 MiB/s wr, 809 op/s 2024-02-10T08:34:18.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:17.209534+0000 osd.2 (osd.2) 180 : cluster [DBG] 10.5 scrub ok 2024-02-10T08:34:18.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:17.346235+0000 osd.5 (osd.5) 221 : cluster [DBG] 6.31 scrub starts 2024-02-10T08:34:18.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:17.350400+0000 osd.5 (osd.5) 222 : cluster [DBG] 6.31 scrub ok 2024-02-10T08:34:18.903 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:18.362307+0000 osd.7 (osd.7) 217 : cluster [DBG] 4.7 scrub starts 2024-02-10T08:34:18.903 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:18.368682+0000 osd.7 (osd.7) 218 : cluster [DBG] 4.7 scrub ok 2024-02-10T08:34:18.905 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:34:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:34:18.930 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:34:18.950 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:18.951 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:34:18.953 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:34:19.051 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:34:19.109 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:19.137 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:34:19.142 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:19.142 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:34:19.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:18.362307+0000 osd.7 (osd.7) 217 : cluster [DBG] 4.7 scrub starts 2024-02-10T08:34:19.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:18.368682+0000 osd.7 (osd.7) 218 : cluster [DBG] 4.7 scrub ok 2024-02-10T08:34:19.160 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:18.362307+0000 osd.7 (osd.7) 217 : cluster [DBG] 4.7 scrub starts 2024-02-10T08:34:19.160 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:18.368682+0000 osd.7 (osd.7) 218 : cluster [DBG] 4.7 scrub ok 2024-02-10T08:34:19.243 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:34:19.285 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:19.306 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:34:19.312 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:19.313 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:34:19.413 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:34:19.455 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:19.486 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:34:19.490 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:19.491 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:34:19.592 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:34:19.637 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:19.666 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:34:19.670 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:19.671 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:34:19.772 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:34:19.806 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:19.847 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:34:19.851 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:19.852 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:34:19.919 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:34:18.596278+0000 mgr.y (mgr.14505) 659 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:34:19.919 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:18.677262+0000 osd.1 (osd.1) 216 : cluster [DBG] 5.0 scrub starts 2024-02-10T08:34:19.919 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:18.681888+0000 osd.1 (osd.1) 217 : cluster [DBG] 5.0 scrub ok 2024-02-10T08:34:19.919 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:18.901983+0000 osd.2 (osd.2) 181 : cluster [DBG] 4.f scrub starts 2024-02-10T08:34:19.919 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:18.905228+0000 osd.2 (osd.2) 182 : cluster [DBG] 4.f scrub ok 2024-02-10T08:34:19.919 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:18.997314+0000 mgr.y (mgr.14505) 660 : cluster [DBG] pgmap v819: 168 pgs: 168 active+clean; 7.5 GiB data, 26 GiB used, 689 GiB / 715 GiB avail; 1.1 KiB/s rd, 66 MiB/s wr, 1.19k op/s 2024-02-10T08:34:19.919 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:19.091085+0000 osd.0 (osd.0) 195 : cluster [DBG] 6.7 scrub starts 2024-02-10T08:34:19.919 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:19.149679+0000 osd.0 (osd.0) 196 : cluster [DBG] 6.7 scrub ok 2024-02-10T08:34:19.953 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:34:20.020 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:20.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:34:18.596278+0000 mgr.y (mgr.14505) 659 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:34:20.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:18.677262+0000 osd.1 (osd.1) 216 : cluster [DBG] 5.0 scrub starts 2024-02-10T08:34:20.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:18.681888+0000 osd.1 (osd.1) 217 : cluster [DBG] 5.0 scrub ok 2024-02-10T08:34:20.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:18.901983+0000 osd.2 (osd.2) 181 : cluster [DBG] 4.f scrub starts 2024-02-10T08:34:20.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:18.905228+0000 osd.2 (osd.2) 182 : cluster [DBG] 4.f scrub ok 2024-02-10T08:34:20.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:18.997314+0000 mgr.y (mgr.14505) 660 : cluster [DBG] pgmap v819: 168 pgs: 168 active+clean; 7.5 GiB data, 26 GiB used, 689 GiB / 715 GiB avail; 1.1 KiB/s rd, 66 MiB/s wr, 1.19k op/s 2024-02-10T08:34:20.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:19.091085+0000 osd.0 (osd.0) 195 : cluster [DBG] 6.7 scrub starts 2024-02-10T08:34:20.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:19.149679+0000 osd.0 (osd.0) 196 : cluster [DBG] 6.7 scrub ok 2024-02-10T08:34:20.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:34:18.596278+0000 mgr.y (mgr.14505) 659 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:34:20.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:18.677262+0000 osd.1 (osd.1) 216 : cluster [DBG] 5.0 scrub starts 2024-02-10T08:34:20.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:18.681888+0000 osd.1 (osd.1) 217 : cluster [DBG] 5.0 scrub ok 2024-02-10T08:34:20.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:18.901983+0000 osd.2 (osd.2) 181 : cluster [DBG] 4.f scrub starts 2024-02-10T08:34:20.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:18.905228+0000 osd.2 (osd.2) 182 : cluster [DBG] 4.f scrub ok 2024-02-10T08:34:20.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:18.997314+0000 mgr.y (mgr.14505) 660 : cluster [DBG] pgmap v819: 168 pgs: 168 active+clean; 7.5 GiB data, 26 GiB used, 689 GiB / 715 GiB avail; 1.1 KiB/s rd, 66 MiB/s wr, 1.19k op/s 2024-02-10T08:34:20.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:19.091085+0000 osd.0 (osd.0) 195 : cluster [DBG] 6.7 scrub starts 2024-02-10T08:34:20.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:19.149679+0000 osd.0 (osd.0) 196 : cluster [DBG] 6.7 scrub ok 2024-02-10T08:34:20.591 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:34:20.594 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:20.594 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:34:20.695 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:34:20.750 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:20.893 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-02-10T08:34:20.893 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-02-10T08:34:20.893 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-02-10T08:34:20.894 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-02-10T08:34:20.894 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-02-10T08:34:21.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:19.167995+0000 osd.4 (osd.4) 124 : cluster [DBG] 4.9 scrub starts 2024-02-10T08:34:21.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:19.175570+0000 osd.4 (osd.4) 125 : cluster [DBG] 4.9 scrub ok 2024-02-10T08:34:21.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:19.720573+0000 osd.1 (osd.1) 218 : cluster [DBG] 5.c scrub starts 2024-02-10T08:34:21.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:19.729177+0000 osd.1 (osd.1) 219 : cluster [DBG] 5.c scrub ok 2024-02-10T08:34:21.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:19.921779+0000 osd.2 (osd.2) 183 : cluster [DBG] 6.28 scrub starts 2024-02-10T08:34:21.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:19.933300+0000 osd.2 (osd.2) 184 : cluster [DBG] 6.28 scrub ok 2024-02-10T08:34:21.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:19.167995+0000 osd.4 (osd.4) 124 : cluster [DBG] 4.9 scrub starts 2024-02-10T08:34:21.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:19.175570+0000 osd.4 (osd.4) 125 : cluster [DBG] 4.9 scrub ok 2024-02-10T08:34:21.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:19.720573+0000 osd.1 (osd.1) 218 : cluster [DBG] 5.c scrub starts 2024-02-10T08:34:21.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:19.729177+0000 osd.1 (osd.1) 219 : cluster [DBG] 5.c scrub ok 2024-02-10T08:34:21.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:19.921779+0000 osd.2 (osd.2) 183 : cluster [DBG] 6.28 scrub starts 2024-02-10T08:34:21.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:19.933300+0000 osd.2 (osd.2) 184 : cluster [DBG] 6.28 scrub ok 2024-02-10T08:34:21.407 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:19.167995+0000 osd.4 (osd.4) 124 : cluster [DBG] 4.9 scrub starts 2024-02-10T08:34:21.407 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:19.175570+0000 osd.4 (osd.4) 125 : cluster [DBG] 4.9 scrub ok 2024-02-10T08:34:21.408 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:19.720573+0000 osd.1 (osd.1) 218 : cluster [DBG] 5.c scrub starts 2024-02-10T08:34:21.408 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:19.729177+0000 osd.1 (osd.1) 219 : cluster [DBG] 5.c scrub ok 2024-02-10T08:34:21.408 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:19.921779+0000 osd.2 (osd.2) 183 : cluster [DBG] 6.28 scrub starts 2024-02-10T08:34:21.408 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:19.933300+0000 osd.2 (osd.2) 184 : cluster [DBG] 6.28 scrub ok 2024-02-10T08:34:22.247 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:20.711801+0000 osd.1 (osd.1) 220 : cluster [DBG] 5.1d scrub starts 2024-02-10T08:34:22.247 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:20.719805+0000 osd.1 (osd.1) 221 : cluster [DBG] 5.1d scrub ok 2024-02-10T08:34:22.247 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:20.879539+0000 osd.2 (osd.2) 185 : cluster [DBG] 2.5 scrub starts 2024-02-10T08:34:22.247 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:20.889656+0000 osd.2 (osd.2) 186 : cluster [DBG] 2.5 scrub ok 2024-02-10T08:34:22.247 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:20.997838+0000 mgr.y (mgr.14505) 661 : cluster [DBG] pgmap v820: 168 pgs: 168 active+clean; 7.4 GiB data, 27 GiB used, 689 GiB / 715 GiB avail; 639 B/s rd, 45 MiB/s wr, 950 op/s 2024-02-10T08:34:22.247 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:21.108227+0000 osd.6 (osd.6) 190 : cluster [DBG] 6.22 scrub starts 2024-02-10T08:34:22.247 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:21.117191+0000 osd.6 (osd.6) 191 : cluster [DBG] 6.22 scrub ok 2024-02-10T08:34:22.248 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:20.711801+0000 osd.1 (osd.1) 220 : cluster [DBG] 5.1d scrub starts 2024-02-10T08:34:22.248 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:20.719805+0000 osd.1 (osd.1) 221 : cluster [DBG] 5.1d scrub ok 2024-02-10T08:34:22.248 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:20.879539+0000 osd.2 (osd.2) 185 : cluster [DBG] 2.5 scrub starts 2024-02-10T08:34:22.248 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:20.889656+0000 osd.2 (osd.2) 186 : cluster [DBG] 2.5 scrub ok 2024-02-10T08:34:22.248 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:20.997838+0000 mgr.y (mgr.14505) 661 : cluster [DBG] pgmap v820: 168 pgs: 168 active+clean; 7.4 GiB data, 27 GiB used, 689 GiB / 715 GiB avail; 639 B/s rd, 45 MiB/s wr, 950 op/s 2024-02-10T08:34:22.248 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:21.108227+0000 osd.6 (osd.6) 190 : cluster [DBG] 6.22 scrub starts 2024-02-10T08:34:22.248 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:21.117191+0000 osd.6 (osd.6) 191 : cluster [DBG] 6.22 scrub ok 2024-02-10T08:34:22.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:20.711801+0000 osd.1 (osd.1) 220 : cluster [DBG] 5.1d scrub starts 2024-02-10T08:34:22.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:20.719805+0000 osd.1 (osd.1) 221 : cluster [DBG] 5.1d scrub ok 2024-02-10T08:34:22.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:20.879539+0000 osd.2 (osd.2) 185 : cluster [DBG] 2.5 scrub starts 2024-02-10T08:34:22.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:20.889656+0000 osd.2 (osd.2) 186 : cluster [DBG] 2.5 scrub ok 2024-02-10T08:34:22.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:20.997838+0000 mgr.y (mgr.14505) 661 : cluster [DBG] pgmap v820: 168 pgs: 168 active+clean; 7.4 GiB data, 27 GiB used, 689 GiB / 715 GiB avail; 639 B/s rd, 45 MiB/s wr, 950 op/s 2024-02-10T08:34:22.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:21.108227+0000 osd.6 (osd.6) 190 : cluster [DBG] 6.22 scrub starts 2024-02-10T08:34:22.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:21.117191+0000 osd.6 (osd.6) 191 : cluster [DBG] 6.22 scrub ok 2024-02-10T08:34:23.211 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:22.063305+0000 osd.6 (osd.6) 192 : cluster [DBG] 6.27 scrub starts 2024-02-10T08:34:23.211 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:22.176179+0000 osd.6 (osd.6) 193 : cluster [DBG] 6.27 scrub ok 2024-02-10T08:34:23.212 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:22.063305+0000 osd.6 (osd.6) 192 : cluster [DBG] 6.27 scrub starts 2024-02-10T08:34:23.212 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:22.176179+0000 osd.6 (osd.6) 193 : cluster [DBG] 6.27 scrub ok 2024-02-10T08:34:23.217 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:34:23.226 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:23.226 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:34:23.243 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.3 dump_historic_ops 2024-02-10T08:34:23.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:22.063305+0000 osd.6 (osd.6) 192 : cluster [DBG] 6.27 scrub starts 2024-02-10T08:34:23.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:22.176179+0000 osd.6 (osd.6) 193 : cluster [DBG] 6.27 scrub ok 2024-02-10T08:34:23.327 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:34:23.399 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:23.467 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:34:23.474 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:23.474 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:34:23.575 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:34:23.613 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:23.782 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:34:23.787 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:23.788 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:34:23.889 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:34:23.927 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:23.954 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:34:23.958 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:23.959 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:34:23.959 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-02-10T08:34:23.959 INFO:teuthology.orchestra.run.smithi018.stdout: "success": "filestore_inject_stall = '3' (not observed, change may require restart) " 2024-02-10T08:34:23.960 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-02-10T08:34:24.060 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:34:24.103 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-10T08:34:24.110 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:23.000545+0000 mgr.y (mgr.14505) 662 : cluster [DBG] pgmap v821: 168 pgs: 168 active+clean; 7.2 GiB data, 26 GiB used, 689 GiB / 715 GiB avail; 1.2 KiB/s rd, 33 MiB/s wr, 1.14k op/s 2024-02-10T08:34:24.110 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:23.043047+0000 osd.6 (osd.6) 194 : cluster [DBG] 6.c scrub starts 2024-02-10T08:34:24.110 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:23.053982+0000 osd.6 (osd.6) 195 : cluster [DBG] 6.c scrub ok 2024-02-10T08:34:24.110 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:23.141433+0000 osd.0 (osd.0) 197 : cluster [DBG] 6.f scrub starts 2024-02-10T08:34:24.110 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:23.258014+0000 osd.0 (osd.0) 198 : cluster [DBG] 6.f scrub ok 2024-02-10T08:34:24.110 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:23.303407+0000 osd.7 (osd.7) 219 : cluster [DBG] 5.4 scrub starts 2024-02-10T08:34:24.110 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:23.304512+0000 osd.7 (osd.7) 220 : cluster [DBG] 5.4 scrub ok 2024-02-10T08:34:24.110 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:23.000545+0000 mgr.y (mgr.14505) 662 : cluster [DBG] pgmap v821: 168 pgs: 168 active+clean; 7.2 GiB data, 26 GiB used, 689 GiB / 715 GiB avail; 1.2 KiB/s rd, 33 MiB/s wr, 1.14k op/s 2024-02-10T08:34:24.111 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:23.043047+0000 osd.6 (osd.6) 194 : cluster [DBG] 6.c scrub starts 2024-02-10T08:34:24.111 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:23.053982+0000 osd.6 (osd.6) 195 : cluster [DBG] 6.c scrub ok 2024-02-10T08:34:24.111 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:23.141433+0000 osd.0 (osd.0) 197 : cluster [DBG] 6.f scrub starts 2024-02-10T08:34:24.111 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:23.258014+0000 osd.0 (osd.0) 198 : cluster [DBG] 6.f scrub ok 2024-02-10T08:34:24.111 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:23.303407+0000 osd.7 (osd.7) 219 : cluster [DBG] 5.4 scrub starts 2024-02-10T08:34:24.111 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:23.304512+0000 osd.7 (osd.7) 220 : cluster [DBG] 5.4 scrub ok 2024-02-10T08:34:24.112 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:24.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:23.000545+0000 mgr.y (mgr.14505) 662 : cluster [DBG] pgmap v821: 168 pgs: 168 active+clean; 7.2 GiB data, 26 GiB used, 689 GiB / 715 GiB avail; 1.2 KiB/s rd, 33 MiB/s wr, 1.14k op/s 2024-02-10T08:34:24.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:23.043047+0000 osd.6 (osd.6) 194 : cluster [DBG] 6.c scrub starts 2024-02-10T08:34:24.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:23.053982+0000 osd.6 (osd.6) 195 : cluster [DBG] 6.c scrub ok 2024-02-10T08:34:24.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:23.141433+0000 osd.0 (osd.0) 197 : cluster [DBG] 6.f scrub starts 2024-02-10T08:34:24.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:23.258014+0000 osd.0 (osd.0) 198 : cluster [DBG] 6.f scrub ok 2024-02-10T08:34:24.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:23.303407+0000 osd.7 (osd.7) 219 : cluster [DBG] 5.4 scrub starts 2024-02-10T08:34:24.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:23.304512+0000 osd.7 (osd.7) 220 : cluster [DBG] 5.4 scrub ok 2024-02-10T08:34:24.685 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:34:24.691 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:24.692 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:34:24.792 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:34:24.840 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:24.881 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:34:24.887 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:24.888 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:34:24.989 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:34:24.990 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:23.883788+0000 osd.2 (osd.2) 187 : cluster [DBG] 2.1 scrub starts 2024-02-10T08:34:24.990 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:23.885329+0000 osd.2 (osd.2) 188 : cluster [DBG] 2.1 scrub ok 2024-02-10T08:34:24.990 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:24.100901+0000 osd.0 (osd.0) 199 : cluster [DBG] 6.9 scrub starts 2024-02-10T08:34:24.990 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:24.132505+0000 osd.0 (osd.0) 200 : cluster [DBG] 6.9 scrub ok 2024-02-10T08:34:25.060 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:25.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:23.883788+0000 osd.2 (osd.2) 187 : cluster [DBG] 2.1 scrub starts 2024-02-10T08:34:25.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:23.885329+0000 osd.2 (osd.2) 188 : cluster [DBG] 2.1 scrub ok 2024-02-10T08:34:25.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:24.100901+0000 osd.0 (osd.0) 199 : cluster [DBG] 6.9 scrub starts 2024-02-10T08:34:25.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:24.132505+0000 osd.0 (osd.0) 200 : cluster [DBG] 6.9 scrub ok 2024-02-10T08:34:25.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:23.883788+0000 osd.2 (osd.2) 187 : cluster [DBG] 2.1 scrub starts 2024-02-10T08:34:25.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:23.885329+0000 osd.2 (osd.2) 188 : cluster [DBG] 2.1 scrub ok 2024-02-10T08:34:25.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:24.100901+0000 osd.0 (osd.0) 199 : cluster [DBG] 6.9 scrub starts 2024-02-10T08:34:25.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:24.132505+0000 osd.0 (osd.0) 200 : cluster [DBG] 6.9 scrub ok 2024-02-10T08:34:25.467 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:34:25.474 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:25.474 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:34:25.575 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:34:25.626 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:25.662 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:34:25.665 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:25.665 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:34:25.766 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:34:25.860 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:25.897 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:34:25.910 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:25.911 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:34:25.919 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:34:25.928 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:34:26.012 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:34:26.013 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:24.904309+0000 osd.2 (osd.2) 189 : cluster [DBG] 5.b scrub starts 2024-02-10T08:34:26.013 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:24.907951+0000 osd.2 (osd.2) 190 : cluster [DBG] 5.b scrub ok 2024-02-10T08:34:26.013 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:25.001285+0000 mgr.y (mgr.14505) 663 : cluster [DBG] pgmap v822: 168 pgs: 168 active+clean; 7.2 GiB data, 26 GiB used, 689 GiB / 715 GiB avail; 1023 B/s rd, 28 MiB/s wr, 1.11k op/s 2024-02-10T08:34:26.013 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:25.082676+0000 osd.4 (osd.4) 126 : cluster [DBG] 4.1a scrub starts 2024-02-10T08:34:26.013 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:25.085809+0000 osd.4 (osd.4) 127 : cluster [DBG] 4.1a scrub ok 2024-02-10T08:34:26.064 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:26.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:24.904309+0000 osd.2 (osd.2) 189 : cluster [DBG] 5.b scrub starts 2024-02-10T08:34:26.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:24.907951+0000 osd.2 (osd.2) 190 : cluster [DBG] 5.b scrub ok 2024-02-10T08:34:26.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:25.001285+0000 mgr.y (mgr.14505) 663 : cluster [DBG] pgmap v822: 168 pgs: 168 active+clean; 7.2 GiB data, 26 GiB used, 689 GiB / 715 GiB avail; 1023 B/s rd, 28 MiB/s wr, 1.11k op/s 2024-02-10T08:34:26.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:25.082676+0000 osd.4 (osd.4) 126 : cluster [DBG] 4.1a scrub starts 2024-02-10T08:34:26.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:25.085809+0000 osd.4 (osd.4) 127 : cluster [DBG] 4.1a scrub ok 2024-02-10T08:34:26.159 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:24.904309+0000 osd.2 (osd.2) 189 : cluster [DBG] 5.b scrub starts 2024-02-10T08:34:26.159 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:24.907951+0000 osd.2 (osd.2) 190 : cluster [DBG] 5.b scrub ok 2024-02-10T08:34:26.159 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:25.001285+0000 mgr.y (mgr.14505) 663 : cluster [DBG] pgmap v822: 168 pgs: 168 active+clean; 7.2 GiB data, 26 GiB used, 689 GiB / 715 GiB avail; 1023 B/s rd, 28 MiB/s wr, 1.11k op/s 2024-02-10T08:34:26.159 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:25.082676+0000 osd.4 (osd.4) 126 : cluster [DBG] 4.1a scrub starts 2024-02-10T08:34:26.159 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:25.085809+0000 osd.4 (osd.4) 127 : cluster [DBG] 4.1a scrub ok 2024-02-10T08:34:26.270 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:34:26.280 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:26.281 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:34:26.381 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:34:26.437 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:26.645 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:34:26.652 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:26.653 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:34:26.754 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:34:26.788 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:34:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:34:26] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:34:26.793 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:26.825 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:34:26.833 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:26.833 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:34:26.934 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:34:26.983 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:27.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:26.012581+0000 osd.6 (osd.6) 196 : cluster [DBG] 5.1f scrub starts 2024-02-10T08:34:27.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:26.020879+0000 osd.6 (osd.6) 197 : cluster [DBG] 5.1f scrub ok 2024-02-10T08:34:27.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:34:26.084329+0000 mon.c (mon.2) 81 : audit [INF] from='client.? 172.21.15.18:0/684008979' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:34:27.041 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:34:26.084797+0000 mon.a (mon.0) 1576 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:34:27.048 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is unset 2024-02-10T08:34:27.404 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:34:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:34:27] "GET /metrics HTTP/1.1" 200 176419 "" "Prometheus/2.33.4" 2024-02-10T08:34:27.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:26.012581+0000 osd.6 (osd.6) 196 : cluster [DBG] 5.1f scrub starts 2024-02-10T08:34:27.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:26.020879+0000 osd.6 (osd.6) 197 : cluster [DBG] 5.1f scrub ok 2024-02-10T08:34:27.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:34:26.084329+0000 mon.c (mon.2) 81 : audit [INF] from='client.? 172.21.15.18:0/684008979' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:34:27.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:34:26.084797+0000 mon.a (mon.0) 1576 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:34:27.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:26.012581+0000 osd.6 (osd.6) 196 : cluster [DBG] 5.1f scrub starts 2024-02-10T08:34:27.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:26.020879+0000 osd.6 (osd.6) 197 : cluster [DBG] 5.1f scrub ok 2024-02-10T08:34:27.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:34:26.084329+0000 mon.c (mon.2) 81 : audit [INF] from='client.? 172.21.15.18:0/684008979' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:34:27.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:34:26.084797+0000 mon.a (mon.0) 1576 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:34:28.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:26.989245+0000 osd.6 (osd.6) 198 : cluster [DBG] 6.1f scrub starts 2024-02-10T08:34:28.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:27.001756+0000 mgr.y (mgr.14505) 664 : cluster [DBG] pgmap v823: 168 pgs: 168 active+clean; 7.1 GiB data, 26 GiB used, 690 GiB / 715 GiB avail; 982 B/s rd, 21 MiB/s wr, 1.08k op/s 2024-02-10T08:34:28.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:27.009769+0000 mon.a (mon.0) 1577 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-10T08:34:28.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:27.009810+0000 mon.a (mon.0) 1578 : cluster [INF] Cluster is now healthy 2024-02-10T08:34:28.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:34:27.019128+0000 mon.a (mon.0) 1579 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-10T08:34:28.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:27.019194+0000 mon.a (mon.0) 1580 : cluster [DBG] osdmap e370: 8 total, 8 up, 8 in 2024-02-10T08:34:28.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:27.059421+0000 osd.4 (osd.4) 128 : cluster [DBG] 2.f scrub starts 2024-02-10T08:34:28.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:27.070319+0000 osd.4 (osd.4) 129 : cluster [DBG] 2.f scrub ok 2024-02-10T08:34:28.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:27.097259+0000 osd.6 (osd.6) 199 : cluster [DBG] 6.1f scrub ok 2024-02-10T08:34:28.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:26.989245+0000 osd.6 (osd.6) 198 : cluster [DBG] 6.1f scrub starts 2024-02-10T08:34:28.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:27.001756+0000 mgr.y (mgr.14505) 664 : cluster [DBG] pgmap v823: 168 pgs: 168 active+clean; 7.1 GiB data, 26 GiB used, 690 GiB / 715 GiB avail; 982 B/s rd, 21 MiB/s wr, 1.08k op/s 2024-02-10T08:34:28.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:27.009769+0000 mon.a (mon.0) 1577 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-10T08:34:28.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:27.009810+0000 mon.a (mon.0) 1578 : cluster [INF] Cluster is now healthy 2024-02-10T08:34:28.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:34:27.019128+0000 mon.a (mon.0) 1579 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-10T08:34:28.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:27.019194+0000 mon.a (mon.0) 1580 : cluster [DBG] osdmap e370: 8 total, 8 up, 8 in 2024-02-10T08:34:28.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:27.059421+0000 osd.4 (osd.4) 128 : cluster [DBG] 2.f scrub starts 2024-02-10T08:34:28.407 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:27.070319+0000 osd.4 (osd.4) 129 : cluster [DBG] 2.f scrub ok 2024-02-10T08:34:28.407 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:27.097259+0000 osd.6 (osd.6) 199 : cluster [DBG] 6.1f scrub ok 2024-02-10T08:34:28.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:26.989245+0000 osd.6 (osd.6) 198 : cluster [DBG] 6.1f scrub starts 2024-02-10T08:34:28.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:27.001756+0000 mgr.y (mgr.14505) 664 : cluster [DBG] pgmap v823: 168 pgs: 168 active+clean; 7.1 GiB data, 26 GiB used, 690 GiB / 715 GiB avail; 982 B/s rd, 21 MiB/s wr, 1.08k op/s 2024-02-10T08:34:28.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:27.009769+0000 mon.a (mon.0) 1577 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-10T08:34:28.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:27.009810+0000 mon.a (mon.0) 1578 : cluster [INF] Cluster is now healthy 2024-02-10T08:34:28.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:34:27.019128+0000 mon.a (mon.0) 1579 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-10T08:34:28.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:27.019194+0000 mon.a (mon.0) 1580 : cluster [DBG] osdmap e370: 8 total, 8 up, 8 in 2024-02-10T08:34:28.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:27.059421+0000 osd.4 (osd.4) 128 : cluster [DBG] 2.f scrub starts 2024-02-10T08:34:28.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:27.070319+0000 osd.4 (osd.4) 129 : cluster [DBG] 2.f scrub ok 2024-02-10T08:34:28.408 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:27.097259+0000 osd.6 (osd.6) 199 : cluster [DBG] 6.1f scrub ok 2024-02-10T08:34:29.039 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:34:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:34:29.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:27.793737+0000 osd.1 (osd.1) 222 : cluster [DBG] 2.d scrub starts 2024-02-10T08:34:29.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:27.796663+0000 osd.1 (osd.1) 223 : cluster [DBG] 2.d scrub ok 2024-02-10T08:34:29.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:28.316665+0000 osd.5 (osd.5) 223 : cluster [DBG] 5.16 deep-scrub starts 2024-02-10T08:34:29.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:28.320517+0000 osd.5 (osd.5) 224 : cluster [DBG] 5.16 deep-scrub ok 2024-02-10T08:34:29.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:28.485172+0000 osd.6 (osd.6) 200 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:34:29.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:28.485231+0000 osd.6 (osd.6) 201 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:34:29.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:27.793737+0000 osd.1 (osd.1) 222 : cluster [DBG] 2.d scrub starts 2024-02-10T08:34:29.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:27.796663+0000 osd.1 (osd.1) 223 : cluster [DBG] 2.d scrub ok 2024-02-10T08:34:29.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:28.316665+0000 osd.5 (osd.5) 223 : cluster [DBG] 5.16 deep-scrub starts 2024-02-10T08:34:29.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:28.320517+0000 osd.5 (osd.5) 224 : cluster [DBG] 5.16 deep-scrub ok 2024-02-10T08:34:29.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:28.485172+0000 osd.6 (osd.6) 200 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:34:29.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:28.485231+0000 osd.6 (osd.6) 201 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:34:29.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:27.793737+0000 osd.1 (osd.1) 222 : cluster [DBG] 2.d scrub starts 2024-02-10T08:34:29.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:27.796663+0000 osd.1 (osd.1) 223 : cluster [DBG] 2.d scrub ok 2024-02-10T08:34:29.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:28.316665+0000 osd.5 (osd.5) 223 : cluster [DBG] 5.16 deep-scrub starts 2024-02-10T08:34:29.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:28.320517+0000 osd.5 (osd.5) 224 : cluster [DBG] 5.16 deep-scrub ok 2024-02-10T08:34:29.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:28.485172+0000 osd.6 (osd.6) 200 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:34:29.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:28.485231+0000 osd.6 (osd.6) 201 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:34:30.221 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 3, 4, 5, 6, 7, 0] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 5, 6, 7, 4] 2024-02-10T08:34:30.221 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-10T08:34:30.222 INFO:tasks.thrashosds.thrasher:fixing pg num pool iscsi 2024-02-10T08:34:30.222 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph pg dump --format=json 2024-02-10T08:34:30.285 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:34:28.607734+0000 mgr.y (mgr.14505) 665 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:34:30.285 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:29.002616+0000 mgr.y (mgr.14505) 666 : cluster [DBG] pgmap v825: 168 pgs: 168 active+clean; 6.8 GiB data, 25 GiB used, 690 GiB / 715 GiB avail; 1.1 KiB/s rd, 2.0 MiB/s wr, 1.14k op/s 2024-02-10T08:34:30.285 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:29.043769+0000 mon.a (mon.0) 1581 : cluster [DBG] osdmap e371: 8 total, 8 up, 8 in 2024-02-10T08:34:30.285 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:34:28.607734+0000 mgr.y (mgr.14505) 665 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:34:30.285 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:29.002616+0000 mgr.y (mgr.14505) 666 : cluster [DBG] pgmap v825: 168 pgs: 168 active+clean; 6.8 GiB data, 25 GiB used, 690 GiB / 715 GiB avail; 1.1 KiB/s rd, 2.0 MiB/s wr, 1.14k op/s 2024-02-10T08:34:30.285 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:29.043769+0000 mon.a (mon.0) 1581 : cluster [DBG] osdmap e371: 8 total, 8 up, 8 in 2024-02-10T08:34:30.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:34:28.607734+0000 mgr.y (mgr.14505) 665 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:34:30.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:29.002616+0000 mgr.y (mgr.14505) 666 : cluster [DBG] pgmap v825: 168 pgs: 168 active+clean; 6.8 GiB data, 25 GiB used, 690 GiB / 715 GiB avail; 1.1 KiB/s rd, 2.0 MiB/s wr, 1.14k op/s 2024-02-10T08:34:30.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:29.043769+0000 mon.a (mon.0) 1581 : cluster [DBG] osdmap e371: 8 total, 8 up, 8 in 2024-02-10T08:34:31.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:30.136182+0000 osd.0 (osd.0) 201 : cluster [DBG] 6.13 deep-scrub starts 2024-02-10T08:34:31.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:30.191781+0000 osd.0 (osd.0) 202 : cluster [DBG] 6.13 deep-scrub ok 2024-02-10T08:34:31.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:30.430802+0000 osd.7 (osd.7) 221 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:34:31.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:30.430859+0000 osd.7 (osd.7) 222 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:34:31.407 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:30.136182+0000 osd.0 (osd.0) 201 : cluster [DBG] 6.13 deep-scrub starts 2024-02-10T08:34:31.407 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:30.191781+0000 osd.0 (osd.0) 202 : cluster [DBG] 6.13 deep-scrub ok 2024-02-10T08:34:31.407 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:30.430802+0000 osd.7 (osd.7) 221 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:34:31.407 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:30.430859+0000 osd.7 (osd.7) 222 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:34:31.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:30.136182+0000 osd.0 (osd.0) 201 : cluster [DBG] 6.13 deep-scrub starts 2024-02-10T08:34:31.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:30.191781+0000 osd.0 (osd.0) 202 : cluster [DBG] 6.13 deep-scrub ok 2024-02-10T08:34:31.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:30.430802+0000 osd.7 (osd.7) 221 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:34:31.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:30.430859+0000 osd.7 (osd.7) 222 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:34:31.889 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:34:31.900 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:31.901 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:34:32.002 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:34:32.052 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:32.077 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:34:32.083 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:32.084 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:34:32.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:30.777233+0000 osd.1 (osd.1) 224 : cluster [DBG] 5.17 scrub starts 2024-02-10T08:34:32.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:30.785672+0000 osd.1 (osd.1) 225 : cluster [DBG] 5.17 scrub ok 2024-02-10T08:34:32.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:31.007547+0000 mgr.y (mgr.14505) 667 : cluster [DBG] pgmap v827: 168 pgs: 168 active+clean; 6.8 GiB data, 25 GiB used, 691 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 1.00k op/s 2024-02-10T08:34:32.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:31.020409+0000 osd.6 (osd.6) 202 : cluster [DBG] 10.b scrub starts 2024-02-10T08:34:32.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:31.057793+0000 mon.a (mon.0) 1582 : cluster [DBG] osdmap e372: 8 total, 8 up, 8 in 2024-02-10T08:34:32.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:34:31.683789+0000 mon.a (mon.0) 1583 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:34:32.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:30.777233+0000 osd.1 (osd.1) 224 : cluster [DBG] 5.17 scrub starts 2024-02-10T08:34:32.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:30.785672+0000 osd.1 (osd.1) 225 : cluster [DBG] 5.17 scrub ok 2024-02-10T08:34:32.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:31.007547+0000 mgr.y (mgr.14505) 667 : cluster [DBG] pgmap v827: 168 pgs: 168 active+clean; 6.8 GiB data, 25 GiB used, 691 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 1.00k op/s 2024-02-10T08:34:32.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:31.020409+0000 osd.6 (osd.6) 202 : cluster [DBG] 10.b scrub starts 2024-02-10T08:34:32.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:31.057793+0000 mon.a (mon.0) 1582 : cluster [DBG] osdmap e372: 8 total, 8 up, 8 in 2024-02-10T08:34:32.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:34:31.683789+0000 mon.a (mon.0) 1583 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:34:32.184 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:34:32.285 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:32.337 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:34:32.339 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-02-10T08:34:32.339 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-02-10T08:34:32.339 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-02-10T08:34:32.339 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-02-10T08:34:32.339 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.339 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.15198.0:140875 9.1 e290/256 9:8dfa1120:::benchmark_data_smithi018_124176_object19136:head v 290'8644, mlcod=290'8642)", 2024-02-10T08:34:32.339 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:30:26.115834+0000", 2024-02-10T08:34:32.339 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 246.21934960300001, 2024-02-10T08:34:32.339 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.030857764999999999, 2024-02-10T08:34:32.339 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:34:32.339 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:34:32.339 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:34:32.340 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.340 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:34:32.340 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:30:26.115834+0000", 2024-02-10T08:34:32.340 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:34:32.340 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.340 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.340 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:34:32.340 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:30:26.115834+0000", 2024-02-10T08:34:32.340 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999981 2024-02-10T08:34:32.340 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.340 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.340 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:34:32.340 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:30:26.115833+0000", 2024-02-10T08:34:32.341 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2516e-05 2024-02-10T08:34:32.341 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.341 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.341 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:34:32.341 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:30:26.115845+0000", 2024-02-10T08:34:32.341 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7547999999999999e-05 2024-02-10T08:34:32.341 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.341 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.341 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:34:32.341 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:30:26.115863+0000", 2024-02-10T08:34:32.341 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2570000000000007e-06 2024-02-10T08:34:32.341 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.341 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.341 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:34:32.341 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:30:26.115871+0000", 2024-02-10T08:34:32.342 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3689999999999994e-05 2024-02-10T08:34:32.342 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.342 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.342 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:34:32.342 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:30:26.115945+0000", 2024-02-10T08:34:32.342 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.6397000000000002e-05 2024-02-10T08:34:32.342 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.342 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.342 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:34:32.342 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:30:26.115971+0000", 2024-02-10T08:34:32.342 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.030684638 2024-02-10T08:34:32.342 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.342 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.342 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:34:32.342 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:30:26.146656+0000", 2024-02-10T08:34:32.343 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6471999999999999e-05 2024-02-10T08:34:32.343 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.343 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.343 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:34:32.343 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:30:26.146692+0000", 2024-02-10T08:34:32.343 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.030857764999999999 2024-02-10T08:34:32.343 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:34:32.343 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:34:32.343 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:34:32.343 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.343 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.343 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.15198.0:171838 9.3 e299/256 9:cf361d01:::benchmark_data_smithi018_124176_object50099:head v 299'10680, mlcod=299'10676)", 2024-02-10T08:34:32.343 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:30:54.511544+0000", 2024-02-10T08:34:32.343 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 217.82363974399999, 2024-02-10T08:34:32.343 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.029915990999999999, 2024-02-10T08:34:32.344 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:34:32.344 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:34:32.344 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:34:32.344 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.344 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:34:32.344 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:30:54.511544+0000", 2024-02-10T08:34:32.344 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:34:32.344 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.344 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.344 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:34:32.344 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:30:54.511544+0000", 2024-02-10T08:34:32.344 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:34:32.344 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.344 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.345 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:34:32.345 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:30:54.511544+0000", 2024-02-10T08:34:32.345 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6540000000000005e-06 2024-02-10T08:34:32.345 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.345 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.345 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:34:32.345 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:30:54.511553+0000", 2024-02-10T08:34:32.345 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9840000000000004e-06 2024-02-10T08:34:32.345 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.345 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.345 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:34:32.345 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:30:54.511560+0000", 2024-02-10T08:34:32.345 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.07e-06 2024-02-10T08:34:32.345 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.345 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.346 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:34:32.346 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:30:54.511564+0000", 2024-02-10T08:34:32.346 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0038928069999999999 2024-02-10T08:34:32.346 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.346 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.346 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:34:32.346 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:30:54.515456+0000", 2024-02-10T08:34:32.346 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3912000000000001e-05 2024-02-10T08:34:32.346 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.346 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.346 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:34:32.346 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:30:54.515480+0000", 2024-02-10T08:34:32.346 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.025936673 2024-02-10T08:34:32.346 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.346 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.347 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:34:32.347 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:30:54.541417+0000", 2024-02-10T08:34:32.347 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3263999999999998e-05 2024-02-10T08:34:32.347 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.347 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.347 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:34:32.347 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:30:54.541460+0000", 2024-02-10T08:34:32.347 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.029915990999999999 2024-02-10T08:34:32.347 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:34:32.347 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:34:32.347 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:34:32.347 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.347 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.347 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.15198.0:173214 9.c e301/256 9:351427db:::benchmark_data_smithi018_124176_object51475:head v 301'10815, mlcod=300'10812)", 2024-02-10T08:34:32.347 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:30:55.832987+0000", 2024-02-10T08:34:32.347 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 216.50219741999999, 2024-02-10T08:34:32.347 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.033319007999999997, 2024-02-10T08:34:32.347 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:34:32.348 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:34:32.348 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:34:32.348 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.348 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:34:32.348 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:30:55.832987+0000", 2024-02-10T08:34:32.348 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:34:32.348 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.348 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.348 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:34:32.348 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:30:55.832987+0000", 2024-02-10T08:34:32.348 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:34:32.348 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.348 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.348 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:34:32.348 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:30:55.832985+0000", 2024-02-10T08:34:32.349 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2707e-05 2024-02-10T08:34:32.349 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.349 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.349 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:34:32.349 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:30:55.832998+0000", 2024-02-10T08:34:32.349 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.343e-05 2024-02-10T08:34:32.349 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.349 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.349 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:34:32.349 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:30:55.833011+0000", 2024-02-10T08:34:32.349 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.627e-06 2024-02-10T08:34:32.349 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.349 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.349 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:34:32.349 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:30:55.833019+0000", 2024-02-10T08:34:32.350 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.010106611 2024-02-10T08:34:32.350 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.350 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.350 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:34:32.350 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:30:55.843126+0000", 2024-02-10T08:34:32.350 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5463000000000002e-05 2024-02-10T08:34:32.350 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.350 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.350 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:34:32.350 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:30:55.843161+0000", 2024-02-10T08:34:32.350 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.023105291999999999 2024-02-10T08:34:32.350 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.350 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.350 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:34:32.351 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:30:55.866266+0000", 2024-02-10T08:34:32.351 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9279999999999997e-05 2024-02-10T08:34:32.351 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.351 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.351 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:34:32.351 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:30:55.866306+0000", 2024-02-10T08:34:32.351 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.033319007999999997 2024-02-10T08:34:32.351 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:34:32.351 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:34:32.351 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:34:32.351 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.351 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.351 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.15198.0:222946 9.8 e318/314 9:19496309:::benchmark_data_smithi018_124176_object101207:head v 318'13754, mlcod=318'13750)", 2024-02-10T08:34:32.351 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:31:47.127367+0000", 2024-02-10T08:34:32.352 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 165.207817194, 2024-02-10T08:34:32.352 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.030632825999999998, 2024-02-10T08:34:32.352 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:34:32.352 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:34:32.352 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:34:32.352 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.352 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:34:32.352 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:31:47.127367+0000", 2024-02-10T08:34:32.352 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:34:32.352 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.352 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.352 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:34:32.352 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:31:47.127367+0000", 2024-02-10T08:34:32.352 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:34:32.353 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.353 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.353 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:34:32.353 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:31:47.127367+0000", 2024-02-10T08:34:32.353 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5700000000000001e-06 2024-02-10T08:34:32.353 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.353 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.353 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:34:32.353 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:31:47.127370+0000", 2024-02-10T08:34:32.353 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5740000000000001e-06 2024-02-10T08:34:32.353 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.353 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.353 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:34:32.353 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:31:47.127377+0000", 2024-02-10T08:34:32.353 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4399999999999998e-06 2024-02-10T08:34:32.354 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.354 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.354 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:34:32.354 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:31:47.127381+0000", 2024-02-10T08:34:32.354 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011632187 2024-02-10T08:34:32.354 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.354 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.354 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:34:32.354 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:31:47.139013+0000", 2024-02-10T08:34:32.354 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4498000000000001e-05 2024-02-10T08:34:32.354 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.354 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.354 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:34:32.354 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:31:47.139048+0000", 2024-02-10T08:34:32.354 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.018912999999999999 2024-02-10T08:34:32.354 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.355 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.355 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:34:32.355 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:31:47.157961+0000", 2024-02-10T08:34:32.355 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8849e-05 2024-02-10T08:34:32.355 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.355 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.355 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:34:32.355 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:31:47.158000+0000", 2024-02-10T08:34:32.355 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.030632825999999998 2024-02-10T08:34:32.355 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:34:32.355 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:34:32.355 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:34:32.355 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.355 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.355 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.15198.0:239630 9.4 e322/256 9:2504619d:::benchmark_data_smithi018_124176_object117891:head v 322'14698, mlcod=322'14696)", 2024-02-10T08:34:32.356 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:32:05.712963+0000", 2024-02-10T08:34:32.356 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 146.62222080800001, 2024-02-10T08:34:32.356 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.042865024000000002, 2024-02-10T08:34:32.356 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:34:32.356 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:34:32.356 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:34:32.356 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.356 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:34:32.356 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:05.712963+0000", 2024-02-10T08:34:32.356 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:34:32.356 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.356 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.356 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:34:32.356 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:05.712963+0000", 2024-02-10T08:34:32.357 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:34:32.357 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.357 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.357 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:34:32.357 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:05.712962+0000", 2024-02-10T08:34:32.357 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1946e-05 2024-02-10T08:34:32.357 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.357 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.357 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:34:32.357 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:05.712974+0000", 2024-02-10T08:34:32.357 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9609000000000001e-05 2024-02-10T08:34:32.357 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.357 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.357 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:34:32.357 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:05.712994+0000", 2024-02-10T08:34:32.358 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7730000000000005e-06 2024-02-10T08:34:32.358 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.358 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.358 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:34:32.358 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:05.713002+0000", 2024-02-10T08:34:32.358 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0024902840000000002 2024-02-10T08:34:32.358 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.358 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.358 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:34:32.358 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:05.715493+0000", 2024-02-10T08:34:32.358 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1372000000000001e-05 2024-02-10T08:34:32.358 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.358 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.358 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:34:32.358 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:05.715514+0000", 2024-02-10T08:34:32.359 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.040275783000000002 2024-02-10T08:34:32.359 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.359 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.359 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:34:32.359 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:05.755790+0000", 2024-02-10T08:34:32.359 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8398000000000001e-05 2024-02-10T08:34:32.359 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.359 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.359 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:34:32.359 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:05.755828+0000", 2024-02-10T08:34:32.359 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.042865024000000002 2024-02-10T08:34:32.359 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:34:32.359 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:34:32.359 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:34:32.359 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.360 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.360 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.15198.0:239646 9.f e322/314 9:f89e249b:::benchmark_data_smithi018_124176_object117907:head v 322'14686, mlcod=322'14680)", 2024-02-10T08:34:32.360 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:32:05.717789+0000", 2024-02-10T08:34:32.360 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 146.61739456699999, 2024-02-10T08:34:32.360 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.031439474000000002, 2024-02-10T08:34:32.360 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:34:32.360 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:34:32.360 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:34:32.360 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.360 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:34:32.360 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:05.717789+0000", 2024-02-10T08:34:32.360 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:34:32.360 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.360 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.361 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:34:32.361 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:05.717789+0000", 2024-02-10T08:34:32.361 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999981 2024-02-10T08:34:32.361 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.361 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.361 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:34:32.361 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:05.717788+0000", 2024-02-10T08:34:32.361 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0456e-05 2024-02-10T08:34:32.361 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.361 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.361 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:34:32.362 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:05.717798+0000", 2024-02-10T08:34:32.362 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2247e-05 2024-02-10T08:34:32.362 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.362 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.362 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:34:32.362 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:05.717811+0000", 2024-02-10T08:34:32.362 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5100000000000001e-06 2024-02-10T08:34:32.362 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.362 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.362 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:34:32.362 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:05.717818+0000", 2024-02-10T08:34:32.362 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1915000000000003e-05 2024-02-10T08:34:32.363 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.363 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.363 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:34:32.363 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:05.717910+0000", 2024-02-10T08:34:32.363 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5434000000000001e-05 2024-02-10T08:34:32.363 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.363 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.363 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:34:32.363 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:05.717935+0000", 2024-02-10T08:34:32.363 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.031251096999999999 2024-02-10T08:34:32.363 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.363 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.363 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:34:32.363 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:05.749186+0000", 2024-02-10T08:34:32.363 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2490999999999997e-05 2024-02-10T08:34:32.364 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.364 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.364 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:34:32.364 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:05.749229+0000", 2024-02-10T08:34:32.364 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.031439474000000002 2024-02-10T08:34:32.364 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:34:32.364 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:34:32.364 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:34:32.364 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.364 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.364 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.15198.0:239746 9.c e323/256 9:33ddeba8:::benchmark_data_smithi018_124176_object118007:head v 323'15018, mlcod=322'15014)", 2024-02-10T08:34:32.364 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:32:05.924026+0000", 2024-02-10T08:34:32.364 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 146.411158277, 2024-02-10T08:34:32.364 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.041487994, 2024-02-10T08:34:32.364 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:34:32.365 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:34:32.365 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:34:32.365 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.365 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:34:32.365 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:05.924026+0000", 2024-02-10T08:34:32.365 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:34:32.365 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.365 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.365 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:34:32.365 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:05.924026+0000", 2024-02-10T08:34:32.365 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:34:32.365 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.365 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.365 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:34:32.365 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:05.924025+0000", 2024-02-10T08:34:32.366 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6649999999999997e-06 2024-02-10T08:34:32.366 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.366 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.366 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:34:32.366 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:05.924032+0000", 2024-02-10T08:34:32.366 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9175000000000001e-05 2024-02-10T08:34:32.366 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.366 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.366 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:34:32.366 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:05.924061+0000", 2024-02-10T08:34:32.366 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3489999999999999e-06 2024-02-10T08:34:32.366 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.366 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.366 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:34:32.366 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:05.924066+0000", 2024-02-10T08:34:32.367 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.010299468000000001 2024-02-10T08:34:32.367 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.367 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.367 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:34:32.367 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:05.934366+0000", 2024-02-10T08:34:32.367 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0296e-05 2024-02-10T08:34:32.367 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.367 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.367 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:34:32.367 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:05.934386+0000", 2024-02-10T08:34:32.367 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.031090354000000001 2024-02-10T08:34:32.367 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.367 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.367 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:34:32.367 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:05.965476+0000", 2024-02-10T08:34:32.367 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7552000000000002e-05 2024-02-10T08:34:32.368 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.368 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.368 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:34:32.368 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:05.965514+0000", 2024-02-10T08:34:32.368 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.041487994 2024-02-10T08:34:32.368 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:34:32.368 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:34:32.368 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:34:32.368 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.368 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.368 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.15198.0:239749 9.c e323/256 9:31c638d8:::benchmark_data_smithi018_124176_object118010:head v 323'15019, mlcod=322'15014)", 2024-02-10T08:34:32.368 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:32:05.924080+0000", 2024-02-10T08:34:32.368 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 146.41110454099999, 2024-02-10T08:34:32.368 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.042251575, 2024-02-10T08:34:32.369 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:34:32.369 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:34:32.369 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:34:32.369 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.369 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:34:32.369 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:05.924080+0000", 2024-02-10T08:34:32.369 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:34:32.369 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.369 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.369 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:34:32.369 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:05.924080+0000", 2024-02-10T08:34:32.369 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:34:32.369 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.369 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.370 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:34:32.370 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:05.924079+0000", 2024-02-10T08:34:32.370 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6690000000000003e-06 2024-02-10T08:34:32.370 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.370 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.370 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:34:32.370 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:05.924085+0000", 2024-02-10T08:34:32.370 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8449999999999999e-06 2024-02-10T08:34:32.370 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.370 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.370 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:34:32.370 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:05.924091+0000", 2024-02-10T08:34:32.370 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.58e-06 2024-02-10T08:34:32.370 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.370 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.371 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:34:32.371 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:05.924094+0000", 2024-02-10T08:34:32.371 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013163285 2024-02-10T08:34:32.371 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.371 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.371 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:34:32.371 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:05.937257+0000", 2024-02-10T08:34:32.371 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9783999999999999e-05 2024-02-10T08:34:32.371 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.371 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.371 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:34:32.371 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:05.937277+0000", 2024-02-10T08:34:32.371 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.029026106999999999 2024-02-10T08:34:32.371 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.371 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.372 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:34:32.372 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:05.966303+0000", 2024-02-10T08:34:32.372 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7744999999999999e-05 2024-02-10T08:34:32.372 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.372 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.372 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:34:32.372 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:05.966331+0000", 2024-02-10T08:34:32.372 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.042251575 2024-02-10T08:34:32.372 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:34:32.372 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:34:32.372 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:34:32.372 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.372 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.372 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.15198.0:239758 9.3 e323/256 9:c9894bb3:::benchmark_data_smithi018_124176_object118019:head v 323'14779, mlcod=323'14775)", 2024-02-10T08:34:32.372 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:32:05.936112+0000", 2024-02-10T08:34:32.372 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 146.399072469, 2024-02-10T08:34:32.373 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.031476122000000002, 2024-02-10T08:34:32.373 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:34:32.373 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:34:32.373 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:34:32.373 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.373 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:34:32.373 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:05.936112+0000", 2024-02-10T08:34:32.373 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:34:32.373 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.373 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.373 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:34:32.373 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:05.936112+0000", 2024-02-10T08:34:32.373 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:34:32.373 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.373 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.373 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:34:32.373 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:05.936111+0000", 2024-02-10T08:34:32.374 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4080000000000001e-06 2024-02-10T08:34:32.374 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.374 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.374 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:34:32.374 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:05.936119+0000", 2024-02-10T08:34:32.374 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6059999999999996e-06 2024-02-10T08:34:32.374 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.374 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.374 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:34:32.374 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:05.936123+0000", 2024-02-10T08:34:32.374 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2219999999999998e-06 2024-02-10T08:34:32.374 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.374 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.374 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:34:32.374 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:05.936127+0000", 2024-02-10T08:34:32.374 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.003619503 2024-02-10T08:34:32.375 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.375 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.375 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:34:32.375 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:05.939746+0000", 2024-02-10T08:34:32.375 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8612000000000001e-05 2024-02-10T08:34:32.375 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.375 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.375 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:34:32.375 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:05.939765+0000", 2024-02-10T08:34:32.375 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.027779650999999999 2024-02-10T08:34:32.375 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.375 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.375 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:34:32.375 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:05.967544+0000", 2024-02-10T08:34:32.375 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3365999999999998e-05 2024-02-10T08:34:32.375 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.375 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.376 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:34:32.376 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:05.967588+0000", 2024-02-10T08:34:32.376 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.031476122000000002 2024-02-10T08:34:32.376 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:34:32.376 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:34:32.376 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:34:32.376 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.376 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.376 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.15198.0:241294 9.4 e324/256 9:21775407:::benchmark_data_smithi018_124176_object119555:head v 324'14794, mlcod=324'14791)", 2024-02-10T08:34:32.376 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:32:07.585735+0000", 2024-02-10T08:34:32.376 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 144.74944871599999, 2024-02-10T08:34:32.376 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.028810982999999998, 2024-02-10T08:34:32.376 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:34:32.376 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:34:32.376 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:34:32.376 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.376 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:34:32.377 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:07.585735+0000", 2024-02-10T08:34:32.377 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:34:32.377 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.377 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.377 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:34:32.377 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:07.585735+0000", 2024-02-10T08:34:32.377 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:34:32.377 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.377 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.377 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:34:32.377 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:07.585735+0000", 2024-02-10T08:34:32.377 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8009999999999993e-06 2024-02-10T08:34:32.377 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.377 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.377 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:34:32.377 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:07.585743+0000", 2024-02-10T08:34:32.378 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9250000000000007e-06 2024-02-10T08:34:32.378 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.378 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.378 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:34:32.378 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:07.585753+0000", 2024-02-10T08:34:32.378 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1550000000000004e-06 2024-02-10T08:34:32.378 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.378 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.378 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:34:32.378 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:07.585760+0000", 2024-02-10T08:34:32.378 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8637000000000001e-05 2024-02-10T08:34:32.378 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.378 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.378 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:34:32.378 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:07.585818+0000", 2024-02-10T08:34:32.379 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.4241999999999999e-05 2024-02-10T08:34:32.379 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.379 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.379 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:34:32.379 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:07.585842+0000", 2024-02-10T08:34:32.379 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.028656943000000001 2024-02-10T08:34:32.379 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.379 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.379 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:34:32.379 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:07.614499+0000", 2024-02-10T08:34:32.379 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6977000000000001e-05 2024-02-10T08:34:32.379 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.380 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.380 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:34:32.380 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:07.614546+0000", 2024-02-10T08:34:32.380 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.028810982999999998 2024-02-10T08:34:32.380 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:34:32.380 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:34:32.380 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:34:32.380 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.380 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.380 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.15198.0:242258 9.7 e324/314 9:e7c9c842:::benchmark_data_smithi018_124176_object120519:head v 324'15378, mlcod=324'15376)", 2024-02-10T08:34:32.380 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:32:08.616073+0000", 2024-02-10T08:34:32.380 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 143.71911123699999, 2024-02-10T08:34:32.380 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.029133965000000001, 2024-02-10T08:34:32.380 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:34:32.381 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:34:32.381 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:34:32.381 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.381 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:34:32.381 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:08.616073+0000", 2024-02-10T08:34:32.381 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:34:32.381 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.381 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.381 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:34:32.381 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:08.616073+0000", 2024-02-10T08:34:32.381 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:34:32.381 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.381 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.381 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:34:32.381 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:08.616072+0000", 2024-02-10T08:34:32.382 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3049999999999993e-06 2024-02-10T08:34:32.382 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.382 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.382 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:34:32.382 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:08.616080+0000", 2024-02-10T08:34:32.382 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1039999999999996e-06 2024-02-10T08:34:32.382 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.382 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.382 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:34:32.382 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:08.616089+0000", 2024-02-10T08:34:32.382 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7939999999999999e-06 2024-02-10T08:34:32.382 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.382 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.382 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:34:32.382 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:08.616095+0000", 2024-02-10T08:34:32.382 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013109182 2024-02-10T08:34:32.383 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.383 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.383 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:34:32.383 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:08.629204+0000", 2024-02-10T08:34:32.383 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2169000000000001e-05 2024-02-10T08:34:32.383 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.383 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.383 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:34:32.383 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:08.629227+0000", 2024-02-10T08:34:32.383 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015948295000000001 2024-02-10T08:34:32.383 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.383 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.383 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:34:32.383 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:08.645175+0000", 2024-02-10T08:34:32.383 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1915000000000002e-05 2024-02-10T08:34:32.383 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.384 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.384 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:34:32.384 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:08.645207+0000", 2024-02-10T08:34:32.384 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.029133965000000001 2024-02-10T08:34:32.384 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:34:32.384 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:34:32.384 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:34:32.384 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.384 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.384 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.25369.0:52657 10.7 e350/335 10:e0cba22e:::benchmark_data_smithi018_146618_object52656:head v 350'3324, mlcod=350'3321)", 2024-02-10T08:34:32.384 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:33:12.204098+0000", 2024-02-10T08:34:32.384 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 80.131085827000007, 2024-02-10T08:34:32.384 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.034880381000000002, 2024-02-10T08:34:32.384 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:34:32.384 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:34:32.385 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:34:32.385 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.385 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:34:32.385 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:12.204098+0000", 2024-02-10T08:34:32.385 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:34:32.385 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.385 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.385 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:34:32.385 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:12.204098+0000", 2024-02-10T08:34:32.385 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:34:32.385 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.385 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.385 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:34:32.385 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:12.204098+0000", 2024-02-10T08:34:32.385 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.6874999999999999e-05 2024-02-10T08:34:32.385 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.386 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.386 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:34:32.386 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:12.204124+0000", 2024-02-10T08:34:32.386 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8690000000000004e-06 2024-02-10T08:34:32.386 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.386 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.386 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:34:32.386 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:12.204132+0000", 2024-02-10T08:34:32.386 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4580000000000003e-06 2024-02-10T08:34:32.386 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.386 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.386 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:34:32.386 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:12.204137+0000", 2024-02-10T08:34:32.386 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0170999999999999e-05 2024-02-10T08:34:32.386 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.386 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.387 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:34:32.387 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:12.204177+0000", 2024-02-10T08:34:32.387 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9519999999999999e-05 2024-02-10T08:34:32.387 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.387 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.387 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:34:32.387 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:12.204196+0000", 2024-02-10T08:34:32.387 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.034743348 2024-02-10T08:34:32.387 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.387 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.387 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:34:32.387 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:12.238940+0000", 2024-02-10T08:34:32.387 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8810999999999998e-05 2024-02-10T08:34:32.387 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.387 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.388 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:34:32.388 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:12.238979+0000", 2024-02-10T08:34:32.388 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.034880381000000002 2024-02-10T08:34:32.388 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:34:32.388 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:34:32.388 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:34:32.388 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.388 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.388 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.25369.0:52661 10.7 e350/335 10:e7746916:::benchmark_data_smithi018_146618_object52660:head v 350'3325, mlcod=350'3321)", 2024-02-10T08:34:32.388 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:33:12.204145+0000", 2024-02-10T08:34:32.388 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 80.131039087999994, 2024-02-10T08:34:32.388 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.034934953999999997, 2024-02-10T08:34:32.388 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:34:32.388 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:34:32.388 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:34:32.388 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.389 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:34:32.389 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:12.204145+0000", 2024-02-10T08:34:32.389 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:34:32.389 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.389 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.389 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:34:32.389 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:12.204145+0000", 2024-02-10T08:34:32.389 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:34:32.389 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.389 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.389 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:34:32.389 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:12.204145+0000", 2024-02-10T08:34:32.389 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5588999999999998e-05 2024-02-10T08:34:32.389 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.390 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.390 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:34:32.390 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:12.204170+0000", 2024-02-10T08:34:32.390 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0220000000000001e-06 2024-02-10T08:34:32.390 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.390 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.390 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:34:32.390 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:12.204176+0000", 2024-02-10T08:34:32.390 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1479999999999999e-06 2024-02-10T08:34:32.390 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.390 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.390 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:34:32.390 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:12.204180+0000", 2024-02-10T08:34:32.390 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001753913 2024-02-10T08:34:32.390 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.391 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.391 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:34:32.391 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:12.205934+0000", 2024-02-10T08:34:32.391 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7635e-05 2024-02-10T08:34:32.391 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.391 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.391 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:34:32.391 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:12.205952+0000", 2024-02-10T08:34:32.391 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.033101490999999997 2024-02-10T08:34:32.391 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.391 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.391 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:34:32.391 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:12.239053+0000", 2024-02-10T08:34:32.391 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.6431000000000002e-05 2024-02-10T08:34:32.391 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.391 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.392 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:34:32.392 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:12.239080+0000", 2024-02-10T08:34:32.392 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.034934953999999997 2024-02-10T08:34:32.392 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:34:32.392 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:34:32.392 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:34:32.392 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.392 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.392 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.25369.0:52660 10.5 e350/335 10:a85e774b:::benchmark_data_smithi018_146618_object52659:head v 350'3274, mlcod=350'3271)", 2024-02-10T08:34:32.392 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:33:12.204420+0000", 2024-02-10T08:34:32.392 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 80.130763940999998, 2024-02-10T08:34:32.392 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.031131071, 2024-02-10T08:34:32.392 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:34:32.392 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:34:32.392 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:34:32.393 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.393 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:34:32.393 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:12.204420+0000", 2024-02-10T08:34:32.393 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:34:32.393 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.393 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.393 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:34:32.393 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:12.204420+0000", 2024-02-10T08:34:32.393 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:34:32.393 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.393 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.393 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:34:32.393 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:12.204419+0000", 2024-02-10T08:34:32.393 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3608000000000002e-05 2024-02-10T08:34:32.393 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.394 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.394 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:34:32.394 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:12.204443+0000", 2024-02-10T08:34:32.394 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0018e-05 2024-02-10T08:34:32.394 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.394 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.394 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:34:32.394 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:12.204453+0000", 2024-02-10T08:34:32.394 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6300000000000003e-06 2024-02-10T08:34:32.394 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.394 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.394 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:34:32.394 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:12.204459+0000", 2024-02-10T08:34:32.394 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6100000000000003e-05 2024-02-10T08:34:32.394 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.395 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.395 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:34:32.395 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:12.204495+0000", 2024-02-10T08:34:32.395 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7693000000000002e-05 2024-02-10T08:34:32.395 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.395 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.395 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:34:32.395 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:12.204512+0000", 2024-02-10T08:34:32.395 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.030995416000000001 2024-02-10T08:34:32.395 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.395 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.395 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:34:32.395 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:12.235508+0000", 2024-02-10T08:34:32.395 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.337e-05 2024-02-10T08:34:32.395 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.396 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.396 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:34:32.396 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:12.235551+0000", 2024-02-10T08:34:32.396 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.031131071 2024-02-10T08:34:32.396 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:34:32.396 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:34:32.396 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:34:32.396 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.396 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.396 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.25369.0:52667 10.3 e350/335 10:c4d7b14b:::benchmark_data_smithi018_146618_object52666:head v 350'3277, mlcod=350'3275)", 2024-02-10T08:34:32.396 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:33:12.207798+0000", 2024-02-10T08:34:32.396 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 80.127386307999998, 2024-02-10T08:34:32.396 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.034274309000000003, 2024-02-10T08:34:32.396 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:34:32.396 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:34:32.397 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:34:32.397 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.397 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:34:32.397 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:12.207798+0000", 2024-02-10T08:34:32.397 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:34:32.397 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.397 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.397 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:34:32.397 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:12.207798+0000", 2024-02-10T08:34:32.397 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:34:32.397 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.397 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.397 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:34:32.397 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:12.207797+0000", 2024-02-10T08:34:32.397 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5655000000000001e-05 2024-02-10T08:34:32.398 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.398 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.398 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:34:32.398 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:12.207822+0000", 2024-02-10T08:34:32.398 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.028590279999999999 2024-02-10T08:34:32.398 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.398 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.398 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:34:32.398 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:12.236413+0000", 2024-02-10T08:34:32.398 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0069e-05 2024-02-10T08:34:32.398 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.398 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.398 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:34:32.398 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:12.236423+0000", 2024-02-10T08:34:32.398 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8451999999999997e-05 2024-02-10T08:34:32.398 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.399 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.399 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:34:32.399 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:12.236461+0000", 2024-02-10T08:34:32.399 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5045000000000001e-05 2024-02-10T08:34:32.399 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.399 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.399 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:34:32.399 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:12.236476+0000", 2024-02-10T08:34:32.399 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.005565347 2024-02-10T08:34:32.399 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.399 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.399 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:34:32.399 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:12.242042+0000", 2024-02-10T08:34:32.399 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.042e-05 2024-02-10T08:34:32.399 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.400 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.400 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:34:32.400 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:12.242072+0000", 2024-02-10T08:34:32.400 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.034274309000000003 2024-02-10T08:34:32.400 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:34:32.400 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:34:32.400 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:34:32.400 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.400 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.400 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.25369.0:52672 10.7 e350/335 10:e265db83:::benchmark_data_smithi018_146618_object52671:head v 350'3326, mlcod=350'3322)", 2024-02-10T08:34:32.400 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:33:12.210966+0000", 2024-02-10T08:34:32.400 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 80.124217950000002, 2024-02-10T08:34:32.400 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.028229839, 2024-02-10T08:34:32.400 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:34:32.400 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:34:32.401 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:34:32.401 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.401 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:34:32.401 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:12.210966+0000", 2024-02-10T08:34:32.401 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:34:32.401 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.401 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.401 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:34:32.401 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:12.210966+0000", 2024-02-10T08:34:32.401 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:34:32.401 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.401 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.401 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:34:32.401 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:12.210965+0000", 2024-02-10T08:34:32.401 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.604e-05 2024-02-10T08:34:32.401 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.402 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.402 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:34:32.402 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:12.211011+0000", 2024-02-10T08:34:32.402 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.024876308 2024-02-10T08:34:32.402 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.402 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.402 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:34:32.402 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:12.235888+0000", 2024-02-10T08:34:32.402 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4869999999999996e-06 2024-02-10T08:34:32.402 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.402 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.402 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:34:32.402 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:12.235895+0000", 2024-02-10T08:34:32.402 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0013589800000000001 2024-02-10T08:34:32.402 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.403 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.403 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:34:32.403 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:12.237254+0000", 2024-02-10T08:34:32.403 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1569999999999998e-05 2024-02-10T08:34:32.403 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.403 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.403 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:34:32.403 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:12.237276+0000", 2024-02-10T08:34:32.403 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0018993359999999999 2024-02-10T08:34:32.403 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.404 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.404 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:34:32.404 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:12.239175+0000", 2024-02-10T08:34:32.404 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1039999999999998e-05 2024-02-10T08:34:32.404 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.404 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.404 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:34:32.404 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:12.239196+0000", 2024-02-10T08:34:32.404 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.028229839 2024-02-10T08:34:32.404 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:34:32.404 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:34:32.404 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:34:32.404 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.404 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.405 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.25369.0:103531 10.f e365/335 10:f7770f2a:::benchmark_data_smithi018_146618_object103530:head v 365'6514, mlcod=365'6512)", 2024-02-10T08:34:32.405 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:33:57.675370+0000", 2024-02-10T08:34:32.405 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 34.659813945000003, 2024-02-10T08:34:32.405 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.030614915999999999, 2024-02-10T08:34:32.405 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:34:32.405 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:34:32.405 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:34:32.405 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.405 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:34:32.405 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:57.675370+0000", 2024-02-10T08:34:32.405 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:34:32.405 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.405 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.405 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:34:32.405 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:57.675370+0000", 2024-02-10T08:34:32.406 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:34:32.406 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.406 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.406 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:34:32.406 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:57.675369+0000", 2024-02-10T08:34:32.406 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5507999999999997e-05 2024-02-10T08:34:32.406 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.406 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.406 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:34:32.406 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:57.675435+0000", 2024-02-10T08:34:32.406 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4126e-05 2024-02-10T08:34:32.406 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.406 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.406 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:34:32.407 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:57.675449+0000", 2024-02-10T08:34:32.407 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3640000000000004e-06 2024-02-10T08:34:32.407 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.407 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.407 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:34:32.407 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:57.675455+0000", 2024-02-10T08:34:32.407 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0646e-05 2024-02-10T08:34:32.407 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.407 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.407 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:34:32.407 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:57.675536+0000", 2024-02-10T08:34:32.407 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0721999999999999e-05 2024-02-10T08:34:32.407 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.407 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.407 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:34:32.407 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:57.675557+0000", 2024-02-10T08:34:32.408 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.030381927 2024-02-10T08:34:32.408 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.408 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.408 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:34:32.408 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:57.705939+0000", 2024-02-10T08:34:32.408 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6344000000000002e-05 2024-02-10T08:34:32.408 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.408 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.408 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:34:32.408 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:57.705985+0000", 2024-02-10T08:34:32.408 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.030614915999999999 2024-02-10T08:34:32.408 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:34:32.408 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:34:32.408 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:34:32.408 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.409 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.409 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.25369.0:103529 10.7 e365/364 10:e61c4d24:::benchmark_data_smithi018_146618_object103528:head v 365'6627, mlcod=365'6624)", 2024-02-10T08:34:32.409 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:33:57.676651+0000", 2024-02-10T08:34:32.409 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 34.658532696000002, 2024-02-10T08:34:32.409 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.029361254999999999, 2024-02-10T08:34:32.409 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:34:32.409 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:34:32.409 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:34:32.409 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.409 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:34:32.409 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:57.676651+0000", 2024-02-10T08:34:32.409 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:34:32.409 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.409 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.409 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:34:32.410 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:57.676651+0000", 2024-02-10T08:34:32.410 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:34:32.410 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.410 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.410 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:34:32.410 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:57.676650+0000", 2024-02-10T08:34:32.410 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3245000000000003e-05 2024-02-10T08:34:32.410 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.410 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.410 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:34:32.410 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:57.676704+0000", 2024-02-10T08:34:32.410 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2687000000000001e-05 2024-02-10T08:34:32.410 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.410 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.410 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:34:32.411 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:57.676716+0000", 2024-02-10T08:34:32.411 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3759999999999996e-06 2024-02-10T08:34:32.411 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.411 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.411 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:34:32.411 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:57.676723+0000", 2024-02-10T08:34:32.411 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010669550000000001 2024-02-10T08:34:32.411 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.411 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.411 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:34:32.411 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:57.677790+0000", 2024-02-10T08:34:32.411 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0401999999999999e-05 2024-02-10T08:34:32.411 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.411 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.411 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:34:32.411 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:57.677810+0000", 2024-02-10T08:34:32.412 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.028178664999999999 2024-02-10T08:34:32.412 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.412 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.412 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:34:32.412 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:57.705989+0000", 2024-02-10T08:34:32.412 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3941e-05 2024-02-10T08:34:32.412 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.412 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.412 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:34:32.412 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:57.706013+0000", 2024-02-10T08:34:32.412 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.029361254999999999 2024-02-10T08:34:32.412 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:34:32.412 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:34:32.412 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:34:32.413 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.413 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.413 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.25369.0:126620 10.7 e369/364 10:ebe999c8:::benchmark_data_smithi018_146618_object2817:head v 369'8053, mlcod=369'8050)", 2024-02-10T08:34:32.413 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:34:19.107800+0000", 2024-02-10T08:34:32.413 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 13.2273844, 2024-02-10T08:34:32.413 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039171373000000002, 2024-02-10T08:34:32.413 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:34:32.413 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:34:32.413 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:34:32.413 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.413 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:34:32.413 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:19.107800+0000", 2024-02-10T08:34:32.413 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:34:32.413 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.414 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.414 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:34:32.414 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:19.107800+0000", 2024-02-10T08:34:32.414 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:34:32.414 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.414 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.414 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:34:32.414 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:19.107799+0000", 2024-02-10T08:34:32.414 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8600000000000004e-06 2024-02-10T08:34:32.414 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.414 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.414 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:34:32.414 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:19.107806+0000", 2024-02-10T08:34:32.414 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8590000000000005e-06 2024-02-10T08:34:32.414 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.415 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.415 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:34:32.415 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:19.107813+0000", 2024-02-10T08:34:32.415 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2490000000000003e-06 2024-02-10T08:34:32.415 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.415 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.415 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:34:32.415 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:19.107818+0000", 2024-02-10T08:34:32.415 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00082835700000000005 2024-02-10T08:34:32.415 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.415 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.415 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:34:32.415 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:19.108646+0000", 2024-02-10T08:34:32.415 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8255000000000001e-05 2024-02-10T08:34:32.415 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.416 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.416 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:34:32.416 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:19.108664+0000", 2024-02-10T08:34:32.416 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.038276730000000002 2024-02-10T08:34:32.416 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.416 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.416 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:34:32.416 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:19.146941+0000", 2024-02-10T08:34:32.416 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9938999999999999e-05 2024-02-10T08:34:32.416 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.416 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.416 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:34:32.416 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:19.146971+0000", 2024-02-10T08:34:32.416 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039171373000000002 2024-02-10T08:34:32.417 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:34:32.417 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:34:32.417 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:34:32.417 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.417 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.417 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.25369.0:126630 10.7 e369/364 10:e4cd7b2c:::benchmark_data_smithi018_146618_object2827:head v 369'8054, mlcod=369'8050)", 2024-02-10T08:34:32.417 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:34:19.108625+0000", 2024-02-10T08:34:32.417 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 13.226559524000001, 2024-02-10T08:34:32.417 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.038367591999999999, 2024-02-10T08:34:32.417 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:34:32.417 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:34:32.417 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:34:32.417 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.417 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:34:32.417 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:19.108625+0000", 2024-02-10T08:34:32.417 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:34:32.418 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.418 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.418 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:34:32.418 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:19.108625+0000", 2024-02-10T08:34:32.418 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:34:32.418 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.418 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.418 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:34:32.418 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:19.108624+0000", 2024-02-10T08:34:32.418 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.472e-06 2024-02-10T08:34:32.418 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.418 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.418 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:34:32.418 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:19.108630+0000", 2024-02-10T08:34:32.418 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0081000000000001e-05 2024-02-10T08:34:32.418 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.418 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.419 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:34:32.419 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:19.108640+0000", 2024-02-10T08:34:32.419 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2149999999999998e-06 2024-02-10T08:34:32.419 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.419 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.419 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:34:32.419 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:19.108647+0000", 2024-02-10T08:34:32.419 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0019908030000000002 2024-02-10T08:34:32.419 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.419 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.419 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:34:32.419 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:19.110637+0000", 2024-02-10T08:34:32.419 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8982000000000001e-05 2024-02-10T08:34:32.419 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.419 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.419 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:34:32.419 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:19.110666+0000", 2024-02-10T08:34:32.420 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.036307522000000002 2024-02-10T08:34:32.420 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.420 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.420 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:34:32.420 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:19.146974+0000", 2024-02-10T08:34:32.420 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8170999999999999e-05 2024-02-10T08:34:32.420 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:34:32.420 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:34:32.420 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:34:32.420 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:19.146992+0000", 2024-02-10T08:34:32.420 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.038367591999999999 2024-02-10T08:34:32.420 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:34:32.420 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:34:32.420 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:34:32.420 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:34:32.421 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:34:32.421 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-02-10T08:34:32.421 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:32.422 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:34:32.522 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:34:32.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:30.777233+0000 osd.1 (osd.1) 224 : cluster [DBG] 5.17 scrub starts 2024-02-10T08:34:32.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:30.785672+0000 osd.1 (osd.1) 225 : cluster [DBG] 5.17 scrub ok 2024-02-10T08:34:32.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:31.007547+0000 mgr.y (mgr.14505) 667 : cluster [DBG] pgmap v827: 168 pgs: 168 active+clean; 6.8 GiB data, 25 GiB used, 691 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 1.00k op/s 2024-02-10T08:34:32.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:31.020409+0000 osd.6 (osd.6) 202 : cluster [DBG] 10.b scrub starts 2024-02-10T08:34:32.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:31.057793+0000 mon.a (mon.0) 1582 : cluster [DBG] osdmap e372: 8 total, 8 up, 8 in 2024-02-10T08:34:32.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:34:31.683789+0000 mon.a (mon.0) 1583 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:34:32.566 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:32.600 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:34:32.606 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:32.606 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:34:32.707 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:34:32.766 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:32.808 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:34:32.819 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:32.819 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:34:32.920 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:34:32.959 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:32.998 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:34:33.010 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:33.011 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:34:33.081 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:34:32.207786+0000 mon.a (mon.0) 1584 : audit [DBG] from='client.? 172.21.15.18:0/981451906' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:34:33.112 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:34:33.174 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:33.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:34:32.207786+0000 mon.a (mon.0) 1584 : audit [DBG] from='client.? 172.21.15.18:0/981451906' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:34:33.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:34:32.207786+0000 mon.a (mon.0) 1584 : audit [DBG] from='client.? 172.21.15.18:0/981451906' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:34:34.137 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:34:34.145 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:34.145 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:34:34.246 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:34:34.296 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:34.329 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:34:34.330 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:34:34.330 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:34:34.330 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:34:34.330 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:34:34.330 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:34:34.330 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:34:34.330 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:34:34.330 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-10T08:34:34.330 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-10T08:34:34.330 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-10T08:34:34.331 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-10T08:34:34.331 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-10T08:34:34.331 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-10T08:34:34.331 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-10T08:34:34.331 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-10T08:34:34.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:33.008275+0000 mgr.y (mgr.14505) 668 : cluster [DBG] pgmap v829: 168 pgs: 1 active+clean+scrubbing, 167 active+clean; 6.6 GiB data, 24 GiB used, 691 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 1.45k op/s 2024-02-10T08:34:34.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:33.403471+0000 osd.6 (osd.6) 203 : cluster [DBG] 10.b scrub ok 2024-02-10T08:34:34.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:33.008275+0000 mgr.y (mgr.14505) 668 : cluster [DBG] pgmap v829: 168 pgs: 1 active+clean+scrubbing, 167 active+clean; 6.6 GiB data, 24 GiB used, 691 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 1.45k op/s 2024-02-10T08:34:34.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:33.403471+0000 osd.6 (osd.6) 203 : cluster [DBG] 10.b scrub ok 2024-02-10T08:34:34.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:33.008275+0000 mgr.y (mgr.14505) 668 : cluster [DBG] pgmap v829: 168 pgs: 1 active+clean+scrubbing, 167 active+clean; 6.6 GiB data, 24 GiB used, 691 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 1.45k op/s 2024-02-10T08:34:34.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:33.403471+0000 osd.6 (osd.6) 203 : cluster [DBG] 10.b scrub ok 2024-02-10T08:34:34.565 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:34:34.570 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:34.571 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:34:34.671 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:34:34.728 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:35.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:34.283430+0000 osd.5 (osd.5) 225 : cluster [DBG] 6.19 deep-scrub starts 2024-02-10T08:34:35.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:34.307152+0000 osd.5 (osd.5) 226 : cluster [DBG] 6.19 deep-scrub ok 2024-02-10T08:34:35.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:34.283430+0000 osd.5 (osd.5) 225 : cluster [DBG] 6.19 deep-scrub starts 2024-02-10T08:34:35.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:34.307152+0000 osd.5 (osd.5) 226 : cluster [DBG] 6.19 deep-scrub ok 2024-02-10T08:34:35.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:34.283430+0000 osd.5 (osd.5) 225 : cluster [DBG] 6.19 deep-scrub starts 2024-02-10T08:34:35.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:34.307152+0000 osd.5 (osd.5) 226 : cluster [DBG] 6.19 deep-scrub ok 2024-02-10T08:34:35.641 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.5 dump_ops_in_flight 2024-02-10T08:34:35.671 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:34:35.693 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:34:35.699 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:35.699 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:34:35.800 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:34:35.870 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:35.900 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:34:35.906 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:35.907 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:34:36.007 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:34:36.041 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:34:36.079 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:36.109 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:34:36.115 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:36.116 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:34:36.160 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd set noscrub 2024-02-10T08:34:36.218 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:34:36.268 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:36.375 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:34.926986+0000 osd.2 (osd.2) 191 : cluster [DBG] 10.3 scrub starts 2024-02-10T08:34:36.375 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:35.006533+0000 osd.6 (osd.6) 204 : cluster [DBG] 2.11 scrub starts 2024-02-10T08:34:36.375 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:35.008853+0000 mgr.y (mgr.14505) 669 : cluster [DBG] pgmap v830: 168 pgs: 1 active+clean+scrubbing, 167 active+clean; 6.5 GiB data, 24 GiB used, 692 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1.27k op/s 2024-02-10T08:34:36.375 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:35.009776+0000 osd.6 (osd.6) 205 : cluster [DBG] 2.11 scrub ok 2024-02-10T08:34:36.376 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:34:36.379 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:36.379 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:34:36.384 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:34.926986+0000 osd.2 (osd.2) 191 : cluster [DBG] 10.3 scrub starts 2024-02-10T08:34:36.384 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:35.006533+0000 osd.6 (osd.6) 204 : cluster [DBG] 2.11 scrub starts 2024-02-10T08:34:36.384 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:35.008853+0000 mgr.y (mgr.14505) 669 : cluster [DBG] pgmap v830: 168 pgs: 1 active+clean+scrubbing, 167 active+clean; 6.5 GiB data, 24 GiB used, 692 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1.27k op/s 2024-02-10T08:34:36.384 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:35.009776+0000 osd.6 (osd.6) 205 : cluster [DBG] 2.11 scrub ok 2024-02-10T08:34:36.385 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:34.926986+0000 osd.2 (osd.2) 191 : cluster [DBG] 10.3 scrub starts 2024-02-10T08:34:36.385 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:35.006533+0000 osd.6 (osd.6) 204 : cluster [DBG] 2.11 scrub starts 2024-02-10T08:34:36.385 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:35.008853+0000 mgr.y (mgr.14505) 669 : cluster [DBG] pgmap v830: 168 pgs: 1 active+clean+scrubbing, 167 active+clean; 6.5 GiB data, 24 GiB used, 692 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1.27k op/s 2024-02-10T08:34:36.385 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:35.009776+0000 osd.6 (osd.6) 205 : cluster [DBG] 2.11 scrub ok 2024-02-10T08:34:36.481 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:34:36.535 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:36.620 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:34:36.624 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:36.625 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:34:36.656 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:34:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:34:36] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:34:36.726 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:34:36.777 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:37.011 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:34:37.016 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:37.016 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:34:37.117 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:34:37.151 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-10T08:34:37.167 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:37.404 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:34:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:34:37] "GET /metrics HTTP/1.1" 200 176419 "" "Prometheus/2.33.4" 2024-02-10T08:34:38.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:37.009390+0000 mgr.y (mgr.14505) 670 : cluster [DBG] pgmap v831: 168 pgs: 1 active+clean+scrubbing, 167 active+clean; 6.4 GiB data, 24 GiB used, 692 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 837 op/s 2024-02-10T08:34:38.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:37.264678+0000 osd.2 (osd.2) 192 : cluster [DBG] 10.3 scrub ok 2024-02-10T08:34:38.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:37.278047+0000 osd.7 (osd.7) 223 : cluster [DBG] 5.10 scrub starts 2024-02-10T08:34:38.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:37.281755+0000 osd.7 (osd.7) 224 : cluster [DBG] 5.10 scrub ok 2024-02-10T08:34:38.305 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-02-10T08:34:38.306 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:34:38.362 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:34:38.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:37.009390+0000 mgr.y (mgr.14505) 670 : cluster [DBG] pgmap v831: 168 pgs: 1 active+clean+scrubbing, 167 active+clean; 6.4 GiB data, 24 GiB used, 692 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 837 op/s 2024-02-10T08:34:38.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:37.264678+0000 osd.2 (osd.2) 192 : cluster [DBG] 10.3 scrub ok 2024-02-10T08:34:38.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:37.278047+0000 osd.7 (osd.7) 223 : cluster [DBG] 5.10 scrub starts 2024-02-10T08:34:38.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:37.281755+0000 osd.7 (osd.7) 224 : cluster [DBG] 5.10 scrub ok 2024-02-10T08:34:38.408 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:37.009390+0000 mgr.y (mgr.14505) 670 : cluster [DBG] pgmap v831: 168 pgs: 1 active+clean+scrubbing, 167 active+clean; 6.4 GiB data, 24 GiB used, 692 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 837 op/s 2024-02-10T08:34:38.408 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:37.264678+0000 osd.2 (osd.2) 192 : cluster [DBG] 10.3 scrub ok 2024-02-10T08:34:38.408 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:37.278047+0000 osd.7 (osd.7) 223 : cluster [DBG] 5.10 scrub starts 2024-02-10T08:34:38.408 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:37.281755+0000 osd.7 (osd.7) 224 : cluster [DBG] 5.10 scrub ok 2024-02-10T08:34:38.455 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:34:38.455 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:38.456 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:34:38.557 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:34:38.620 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:39.041 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:34:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:34:39.086 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:34:39.092 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:39.093 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:34:39.099 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.5 dump_blocked_ops 2024-02-10T08:34:39.165 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:37.919547+0000 osd.2 (osd.2) 193 : cluster [DBG] 5.d scrub starts 2024-02-10T08:34:39.166 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:37.926914+0000 osd.2 (osd.2) 194 : cluster [DBG] 5.d scrub ok 2024-02-10T08:34:39.166 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:38.005457+0000 osd.0 (osd.0) 203 : cluster [DBG] 6.11 scrub starts 2024-02-10T08:34:39.166 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:38.015510+0000 osd.0 (osd.0) 204 : cluster [DBG] 6.11 scrub ok 2024-02-10T08:34:39.166 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:38.327154+0000 osd.7 (osd.7) 225 : cluster [DBG] 6.12 scrub starts 2024-02-10T08:34:39.166 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:38.328635+0000 osd.7 (osd.7) 226 : cluster [DBG] 6.12 scrub ok 2024-02-10T08:34:39.166 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:39.004328+0000 osd.4 (osd.4) 130 : cluster [DBG] 6.1a scrub starts 2024-02-10T08:34:39.166 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:39.027277+0000 osd.4 (osd.4) 131 : cluster [DBG] 6.1a scrub ok 2024-02-10T08:34:39.166 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:37.919547+0000 osd.2 (osd.2) 193 : cluster [DBG] 5.d scrub starts 2024-02-10T08:34:39.166 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:37.926914+0000 osd.2 (osd.2) 194 : cluster [DBG] 5.d scrub ok 2024-02-10T08:34:39.167 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:38.005457+0000 osd.0 (osd.0) 203 : cluster [DBG] 6.11 scrub starts 2024-02-10T08:34:39.167 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:38.015510+0000 osd.0 (osd.0) 204 : cluster [DBG] 6.11 scrub ok 2024-02-10T08:34:39.167 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:38.327154+0000 osd.7 (osd.7) 225 : cluster [DBG] 6.12 scrub starts 2024-02-10T08:34:39.167 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:38.328635+0000 osd.7 (osd.7) 226 : cluster [DBG] 6.12 scrub ok 2024-02-10T08:34:39.167 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:39.004328+0000 osd.4 (osd.4) 130 : cluster [DBG] 6.1a scrub starts 2024-02-10T08:34:39.167 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:39.027277+0000 osd.4 (osd.4) 131 : cluster [DBG] 6.1a scrub ok 2024-02-10T08:34:39.193 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:34:39.287 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:39.537 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:34:39.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:37.919547+0000 osd.2 (osd.2) 193 : cluster [DBG] 5.d scrub starts 2024-02-10T08:34:39.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:37.926914+0000 osd.2 (osd.2) 194 : cluster [DBG] 5.d scrub ok 2024-02-10T08:34:39.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:38.005457+0000 osd.0 (osd.0) 203 : cluster [DBG] 6.11 scrub starts 2024-02-10T08:34:39.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:38.015510+0000 osd.0 (osd.0) 204 : cluster [DBG] 6.11 scrub ok 2024-02-10T08:34:39.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:38.327154+0000 osd.7 (osd.7) 225 : cluster [DBG] 6.12 scrub starts 2024-02-10T08:34:39.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:38.328635+0000 osd.7 (osd.7) 226 : cluster [DBG] 6.12 scrub ok 2024-02-10T08:34:39.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:39.004328+0000 osd.4 (osd.4) 130 : cluster [DBG] 6.1a scrub starts 2024-02-10T08:34:39.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:39.027277+0000 osd.4 (osd.4) 131 : cluster [DBG] 6.1a scrub ok 2024-02-10T08:34:39.560 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:34:39.565 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:39.566 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:34:39.666 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:34:39.723 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:39.935 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:34:39.939 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:39.940 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:34:40.040 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:34:40.059 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:34:40.086 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-02-10T08:34:40.104 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:40.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:34:38.617531+0000 mgr.y (mgr.14505) 671 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:34:40.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:38.952781+0000 osd.6 (osd.6) 206 : cluster [DBG] 10.f deep-scrub starts 2024-02-10T08:34:40.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:39.010177+0000 mgr.y (mgr.14505) 672 : cluster [DBG] pgmap v832: 168 pgs: 168 active+clean; 6.1 GiB data, 23 GiB used, 693 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 1.13k op/s 2024-02-10T08:34:40.407 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:34:38.617531+0000 mgr.y (mgr.14505) 671 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:34:40.407 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:38.952781+0000 osd.6 (osd.6) 206 : cluster [DBG] 10.f deep-scrub starts 2024-02-10T08:34:40.407 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:39.010177+0000 mgr.y (mgr.14505) 672 : cluster [DBG] pgmap v832: 168 pgs: 168 active+clean; 6.1 GiB data, 23 GiB used, 693 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 1.13k op/s 2024-02-10T08:34:40.481 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:34:40.488 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:40.489 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:34:40.525 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:34:38.617531+0000 mgr.y (mgr.14505) 671 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:34:40.525 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:38.952781+0000 osd.6 (osd.6) 206 : cluster [DBG] 10.f deep-scrub starts 2024-02-10T08:34:40.525 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:39.010177+0000 mgr.y (mgr.14505) 672 : cluster [DBG] pgmap v832: 168 pgs: 168 active+clean; 6.1 GiB data, 23 GiB used, 693 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 1.13k op/s 2024-02-10T08:34:40.590 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:34:40.652 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:40.867 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:34:40.873 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:40.873 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:34:40.974 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:34:41.009 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:41.223 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:34:41.227 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:41.227 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:34:41.328 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:34:41.400 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:41.544 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:41 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:34:40.034735+0000 mgr.y (mgr.14505) 673 : audit [DBG] from='client.25523 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-10T08:34:41.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:34:40.034735+0000 mgr.y (mgr.14505) 673 : audit [DBG] from='client.25523 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-10T08:34:41.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:34:40.034735+0000 mgr.y (mgr.14505) 673 : audit [DBG] from='client.25523 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-10T08:34:41.714 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:34:41.727 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:41.728 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:34:41.733 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":832,"stamp":"2024-02-10T08:34:39.009576+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6583948988,"num_objects":100656,"num_object_clones":0,"num_object_copies":301968,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100656,"num_whiteouts":0,"num_read":2171,"num_read_kb":1923,"num_write":147851,"num_write_kb":7923241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":230,"num_bytes_recovered":7872,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":78855,"ondisk_log_size":78855,"up":504,"acting":504,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":504,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":23779192,"kb_used_data":19344952,"kb_used_omap":0,"kb_used_meta":4433919,"kb_avail":726182024,"statfs":{"total":767960285184,"available":743610392576,"internally_reserved":0,"allocated":19809230848,"data_stored":19806074220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":972,"internal_metadata":4540333108},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,1,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-734658560,"num_objects":-11210,"num_object_clones":0,"num_object_copies":-33630,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-11210,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11210,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.960426"},"pg_stats":[{"pgid":"6.33","version":"0'0","reported_seq":265,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.052800+0000","last_change":"2024-02-10T08:34:13.373898+0000","last_active":"2024-02-10T08:34:29.052800+0000","last_peered":"2024-02-10T08:34:29.052800+0000","last_clean":"2024-02-10T08:34:29.052800+0000","last_became_active":"2024-02-10T08:30:26.080326+0000","last_became_peered":"2024-02-10T08:30:26.080326+0000","last_unstale":"2024-02-10T08:34:29.052800+0000","last_undegraded":"2024-02-10T08:34:29.052800+0000","last_fullsized":"2024-02-10T08:34:29.052800+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:13.373809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:34:13.373809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2],"acting":[5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":368,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.050398+0000","last_change":"2024-02-10T08:33:31.389209+0000","last_active":"2024-02-10T08:34:29.050398+0000","last_peered":"2024-02-10T08:34:29.050398+0000","last_clean":"2024-02-10T08:34:29.050398+0000","last_became_active":"2024-02-10T08:30:26.067019+0000","last_became_peered":"2024-02-10T08:30:26.067019+0000","last_unstale":"2024-02-10T08:34:29.050398+0000","last_undegraded":"2024-02-10T08:34:29.050398+0000","last_fullsized":"2024-02-10T08:34:29.050398+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:31.389113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:33:31.389113+0000","last_clean_scrub_stamp":"2024-02-10T08:33:31.389113+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.6","version":"372'9354","reported_seq":9399,"reported_epoch":372,"state":"active+clean","last_fresh":"2024-02-10T08:34:37.772344+0000","last_change":"2024-02-10T08:32:30.821933+0000","last_active":"2024-02-10T08:34:37.772344+0000","last_peered":"2024-02-10T08:34:37.772344+0000","last_clean":"2024-02-10T08:34:37.772344+0000","last_became_active":"2024-02-10T08:32:30.821631+0000","last_became_peered":"2024-02-10T08:32:30.821631+0000","last_unstale":"2024-02-10T08:34:37.772344+0000","last_undegraded":"2024-02-10T08:34:37.772344+0000","last_fullsized":"2024-02-10T08:34:37.772344+0000","mapping_epoch":335,"log_start":"356'4500","ondisk_log_start":"356'4500","created":335,"last_epoch_clean":336,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.947585+0000","log_size":4854,"ondisk_log_size":4854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":416415744,"num_objects":6354,"num_object_clones":0,"num_object_copies":19062,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6354,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9354,"num_write_kb":502656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4],"acting":[5,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"111'10","reported_seq":595,"reported_epoch":372,"state":"active+clean","last_fresh":"2024-02-10T08:34:31.212860+0000","last_change":"2024-02-10T08:34:09.351432+0000","last_active":"2024-02-10T08:34:31.212860+0000","last_peered":"2024-02-10T08:34:31.212860+0000","last_clean":"2024-02-10T08:34:31.212860+0000","last_became_active":"2024-02-10T08:20:46.399193+0000","last_became_peered":"2024-02-10T08:20:46.399193+0000","last_unstale":"2024-02-10T08:34:31.212860+0000","last_undegraded":"2024-02-10T08:34:31.212860+0000","last_fullsized":"2024-02-10T08:34:31.212860+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'10","last_scrub_stamp":"2024-02-10T08:34:09.351338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:34:09.351338+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"225'27","reported_seq":391,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.050778+0000","last_change":"2024-02-10T08:33:23.049805+0000","last_active":"2024-02-10T08:34:29.050778+0000","last_peered":"2024-02-10T08:34:29.050778+0000","last_clean":"2024-02-10T08:34:29.050778+0000","last_became_active":"2024-02-10T08:16:55.204597+0000","last_became_peered":"2024-02-10T08:16:55.204597+0000","last_unstale":"2024-02-10T08:34:29.050778+0000","last_undegraded":"2024-02-10T08:34:29.050778+0000","last_fullsized":"2024-02-10T08:34:29.050778+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'27","last_scrub_stamp":"2024-02-10T08:33:23.049704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:33:23.049704+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":383,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.064853+0000","last_change":"2024-02-10T08:33:18.706517+0000","last_active":"2024-02-10T08:34:29.064853+0000","last_peered":"2024-02-10T08:34:29.064853+0000","last_clean":"2024-02-10T08:34:29.064853+0000","last_became_active":"2024-02-10T08:32:20.330612+0000","last_became_peered":"2024-02-10T08:32:20.330612+0000","last_unstale":"2024-02-10T08:34:29.064853+0000","last_undegraded":"2024-02-10T08:34:29.064853+0000","last_fullsized":"2024-02-10T08:34:29.064853+0000","mapping_epoch":331,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":332,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:18.706426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:29:24.554978+0000","last_clean_scrub_stamp":"2024-02-10T08:33:18.706426+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":371,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.051569+0000","last_change":"2024-02-10T08:34:09.307523+0000","last_active":"2024-02-10T08:34:29.051569+0000","last_peered":"2024-02-10T08:34:29.051569+0000","last_clean":"2024-02-10T08:34:29.051569+0000","last_became_active":"2024-02-10T08:30:24.062795+0000","last_became_peered":"2024-02-10T08:30:24.062795+0000","last_unstale":"2024-02-10T08:34:29.051569+0000","last_undegraded":"2024-02-10T08:34:29.051569+0000","last_fullsized":"2024-02-10T08:34:29.051569+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:09.307434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:20.392249+0000","last_clean_scrub_stamp":"2024-02-10T08:34:09.307434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"372'9095","reported_seq":9145,"reported_epoch":372,"state":"active+clean","last_fresh":"2024-02-10T08:34:37.996378+0000","last_change":"2024-02-10T08:34:17.209648+0000","last_active":"2024-02-10T08:34:37.996378+0000","last_peered":"2024-02-10T08:34:37.996378+0000","last_clean":"2024-02-10T08:34:37.996378+0000","last_became_active":"2024-02-10T08:32:30.825592+0000","last_became_peered":"2024-02-10T08:32:30.825592+0000","last_unstale":"2024-02-10T08:34:37.996378+0000","last_undegraded":"2024-02-10T08:34:37.996378+0000","last_fullsized":"2024-02-10T08:34:37.996378+0000","mapping_epoch":335,"log_start":"350'3300","ondisk_log_start":"350'3300","created":335,"last_epoch_clean":336,"parent":"0.0","parent_split_bits":0,"last_scrub":"369'7613","last_scrub_stamp":"2024-02-10T08:34:17.209542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:34:17.209542+0000","log_size":5795,"ondisk_log_size":5795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":397082624,"num_objects":6059,"num_object_clones":0,"num_object_copies":18177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6059,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9095,"num_write_kb":484928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"225'15","reported_seq":158,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.062184+0000","last_change":"2024-02-10T08:32:18.530490+0000","last_active":"2024-02-10T08:34:29.062184+0000","last_peered":"2024-02-10T08:34:29.062184+0000","last_clean":"2024-02-10T08:34:29.062184+0000","last_became_active":"2024-02-10T08:28:02.770508+0000","last_became_peered":"2024-02-10T08:28:02.770508+0000","last_unstale":"2024-02-10T08:34:29.062184+0000","last_undegraded":"2024-02-10T08:34:29.062184+0000","last_fullsized":"2024-02-10T08:34:29.062184+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'15","last_scrub_stamp":"2024-02-10T08:32:18.530424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:32:18.530424+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":366,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.056586+0000","last_change":"2024-02-10T08:34:27.796767+0000","last_active":"2024-02-10T08:34:29.056586+0000","last_peered":"2024-02-10T08:34:29.056586+0000","last_clean":"2024-02-10T08:34:29.056586+0000","last_became_active":"2024-02-10T08:20:46.407311+0000","last_became_peered":"2024-02-10T08:20:46.407311+0000","last_unstale":"2024-02-10T08:34:29.056586+0000","last_undegraded":"2024-02-10T08:34:29.056586+0000","last_fullsized":"2024-02-10T08:34:29.056586+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:27.796670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:21.523096+0000","last_clean_scrub_stamp":"2024-02-10T08:34:27.796670+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":398,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.059450+0000","last_change":"2024-02-10T08:33:30.565679+0000","last_active":"2024-02-10T08:34:29.059450+0000","last_peered":"2024-02-10T08:34:29.059450+0000","last_clean":"2024-02-10T08:34:29.059450+0000","last_became_active":"2024-02-10T08:31:33.882809+0000","last_became_peered":"2024-02-10T08:31:33.882809+0000","last_unstale":"2024-02-10T08:34:29.059450+0000","last_undegraded":"2024-02-10T08:34:29.059450+0000","last_fullsized":"2024-02-10T08:34:29.059450+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:30.565591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:33:30.565591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"76'2","reported_seq":47,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.059600+0000","last_change":"2024-02-10T08:34:24.132606+0000","last_active":"2024-02-10T08:34:29.059600+0000","last_peered":"2024-02-10T08:34:29.059600+0000","last_clean":"2024-02-10T08:34:29.059600+0000","last_became_active":"2024-02-10T08:32:36.979100+0000","last_became_peered":"2024-02-10T08:32:36.979100+0000","last_unstale":"2024-02-10T08:34:29.059600+0000","last_undegraded":"2024-02-10T08:34:29.059600+0000","last_fullsized":"2024-02-10T08:34:29.059600+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'2","last_scrub_stamp":"2024-02-10T08:34:24.132513+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2024-02-10T08:18:08.680038+0000","last_clean_scrub_stamp":"2024-02-10T08:34:24.132513+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"372'9238","reported_seq":9280,"reported_epoch":372,"state":"active+clean","last_fresh":"2024-02-10T08:34:38.252404+0000","last_change":"2024-02-10T08:32:36.986316+0000","last_active":"2024-02-10T08:34:38.252404+0000","last_peered":"2024-02-10T08:34:38.252404+0000","last_clean":"2024-02-10T08:34:38.252404+0000","last_became_active":"2024-02-10T08:32:36.985786+0000","last_became_peered":"2024-02-10T08:32:36.985786+0000","last_unstale":"2024-02-10T08:34:38.252404+0000","last_undegraded":"2024-02-10T08:34:38.252404+0000","last_fullsized":"2024-02-10T08:34:38.252404+0000","mapping_epoch":339,"log_start":"357'4700","ondisk_log_start":"357'4700","created":335,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.947585+0000","log_size":4538,"ondisk_log_size":4538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":405405696,"num_objects":6186,"num_object_clones":0,"num_object_copies":18558,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6186,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9238,"num_write_kb":493568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"226'35","reported_seq":403,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.062502+0000","last_change":"2024-02-10T08:33:34.284782+0000","last_active":"2024-02-10T08:34:29.062502+0000","last_peered":"2024-02-10T08:34:29.062502+0000","last_clean":"2024-02-10T08:34:29.062502+0000","last_became_active":"2024-02-10T08:16:55.203415+0000","last_became_peered":"2024-02-10T08:16:55.203415+0000","last_unstale":"2024-02-10T08:34:29.062502+0000","last_undegraded":"2024-02-10T08:34:29.062502+0000","last_fullsized":"2024-02-10T08:34:29.062502+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"226'35","last_scrub_stamp":"2024-02-10T08:33:34.284690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:33:34.284690+0000","log_size":35,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":56,"num_read_kb":45,"num_write":36,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":374,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.063154+0000","last_change":"2024-02-10T08:33:33.598098+0000","last_active":"2024-02-10T08:34:29.063154+0000","last_peered":"2024-02-10T08:34:29.063154+0000","last_clean":"2024-02-10T08:34:29.063154+0000","last_became_active":"2024-02-10T08:28:02.781029+0000","last_became_peered":"2024-02-10T08:28:02.781029+0000","last_unstale":"2024-02-10T08:34:29.063154+0000","last_undegraded":"2024-02-10T08:34:29.063154+0000","last_fullsized":"2024-02-10T08:34:29.063154+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:33.597972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:33:33.597972+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":370,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.062915+0000","last_change":"2024-02-10T08:34:24.908075+0000","last_active":"2024-02-10T08:34:29.062915+0000","last_peered":"2024-02-10T08:34:29.062915+0000","last_clean":"2024-02-10T08:34:29.062915+0000","last_became_active":"2024-02-10T08:28:02.779438+0000","last_became_peered":"2024-02-10T08:28:02.779438+0000","last_unstale":"2024-02-10T08:34:29.062915+0000","last_undegraded":"2024-02-10T08:34:29.062915+0000","last_fullsized":"2024-02-10T08:34:29.062915+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:24.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.593849+0000","last_clean_scrub_stamp":"2024-02-10T08:34:24.907958+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":357,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.058024+0000","last_change":"2024-02-10T08:33:19.398482+0000","last_active":"2024-02-10T08:34:29.058024+0000","last_peered":"2024-02-10T08:34:29.058024+0000","last_clean":"2024-02-10T08:34:29.058024+0000","last_became_active":"2024-02-10T08:24:18.645480+0000","last_became_peered":"2024-02-10T08:24:18.645480+0000","last_unstale":"2024-02-10T08:34:29.058024+0000","last_undegraded":"2024-02-10T08:34:29.058024+0000","last_fullsized":"2024-02-10T08:34:29.058024+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:19.398412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:33:19.398412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,3],"acting":[7,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3","version":"372'9275","reported_seq":9325,"reported_epoch":372,"state":"active+clean","last_fresh":"2024-02-10T08:34:38.006245+0000","last_change":"2024-02-10T08:34:37.264784+0000","last_active":"2024-02-10T08:34:38.006245+0000","last_peered":"2024-02-10T08:34:38.006245+0000","last_clean":"2024-02-10T08:34:38.006245+0000","last_became_active":"2024-02-10T08:32:30.825621+0000","last_became_peered":"2024-02-10T08:32:30.825621+0000","last_unstale":"2024-02-10T08:34:38.006245+0000","last_undegraded":"2024-02-10T08:34:38.006245+0000","last_fullsized":"2024-02-10T08:34:38.006245+0000","mapping_epoch":335,"log_start":"351'3500","ondisk_log_start":"351'3500","created":335,"last_epoch_clean":336,"parent":"0.0","parent_split_bits":0,"last_scrub":"372'9223","last_scrub_stamp":"2024-02-10T08:34:37.264686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:34:37.264686+0000","log_size":5775,"ondisk_log_size":5775,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":412418048,"num_objects":6293,"num_object_clones":0,"num_object_copies":18879,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6293,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9275,"num_write_kb":498176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"225'31","reported_seq":87,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.050685+0000","last_change":"2024-02-10T08:32:31.309431+0000","last_active":"2024-02-10T08:34:29.050685+0000","last_peered":"2024-02-10T08:34:29.050685+0000","last_clean":"2024-02-10T08:34:29.050685+0000","last_became_active":"2024-02-10T08:31:46.070488+0000","last_became_peered":"2024-02-10T08:31:46.070488+0000","last_unstale":"2024-02-10T08:34:29.050685+0000","last_undegraded":"2024-02-10T08:34:29.050685+0000","last_fullsized":"2024-02-10T08:34:29.050685+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'31","last_scrub_stamp":"2024-02-10T08:32:31.309364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:32:31.309364+0000","log_size":31,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":48,"num_read_kb":38,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":402,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.058774+0000","last_change":"2024-02-10T08:32:11.282121+0000","last_active":"2024-02-10T08:34:29.058774+0000","last_peered":"2024-02-10T08:34:29.058774+0000","last_clean":"2024-02-10T08:34:29.058774+0000","last_became_active":"2024-02-10T08:20:46.399568+0000","last_became_peered":"2024-02-10T08:20:46.399568+0000","last_unstale":"2024-02-10T08:34:29.058774+0000","last_undegraded":"2024-02-10T08:34:29.058774+0000","last_fullsized":"2024-02-10T08:34:29.058774+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:11.282042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:32:11.282042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":375,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.056012+0000","last_change":"2024-02-10T08:34:19.729292+0000","last_active":"2024-02-10T08:34:29.056012+0000","last_peered":"2024-02-10T08:34:29.056012+0000","last_clean":"2024-02-10T08:34:29.056012+0000","last_became_active":"2024-02-10T08:28:02.764210+0000","last_became_peered":"2024-02-10T08:28:02.764210+0000","last_unstale":"2024-02-10T08:34:29.056012+0000","last_undegraded":"2024-02-10T08:34:29.056012+0000","last_fullsized":"2024-02-10T08:34:29.056012+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:19.729185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:34:19.729185+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":322,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.060744+0000","last_change":"2024-02-10T08:34:23.258089+0000","last_active":"2024-02-10T08:34:29.060744+0000","last_peered":"2024-02-10T08:34:29.060744+0000","last_clean":"2024-02-10T08:34:29.060744+0000","last_became_active":"2024-02-10T08:31:33.883457+0000","last_became_peered":"2024-02-10T08:31:33.883457+0000","last_unstale":"2024-02-10T08:34:29.060744+0000","last_undegraded":"2024-02-10T08:34:29.060744+0000","last_fullsized":"2024-02-10T08:34:29.060744+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:23.258018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:34.215363+0000","last_clean_scrub_stamp":"2024-02-10T08:34:23.258018+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2","version":"372'9456","reported_seq":9501,"reported_epoch":372,"state":"active+clean","last_fresh":"2024-02-10T08:34:37.825102+0000","last_change":"2024-02-10T08:32:30.822810+0000","last_active":"2024-02-10T08:34:37.825102+0000","last_peered":"2024-02-10T08:34:37.825102+0000","last_clean":"2024-02-10T08:34:37.825102+0000","last_became_active":"2024-02-10T08:32:30.822464+0000","last_became_peered":"2024-02-10T08:32:30.822464+0000","last_unstale":"2024-02-10T08:34:37.825102+0000","last_undegraded":"2024-02-10T08:34:37.825102+0000","last_fullsized":"2024-02-10T08:34:37.825102+0000","mapping_epoch":335,"log_start":"357'4700","ondisk_log_start":"357'4700","created":335,"last_epoch_clean":336,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.947585+0000","log_size":4756,"ondisk_log_size":4756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":420085760,"num_objects":6410,"num_object_clones":0,"num_object_copies":19230,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6410,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9456,"num_write_kb":507712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"225'20","reported_seq":360,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.051372+0000","last_change":"2024-02-10T08:32:15.357432+0000","last_active":"2024-02-10T08:34:29.051372+0000","last_peered":"2024-02-10T08:34:29.051372+0000","last_clean":"2024-02-10T08:34:29.051372+0000","last_became_active":"2024-02-10T08:20:46.398973+0000","last_became_peered":"2024-02-10T08:20:46.398973+0000","last_unstale":"2024-02-10T08:34:29.051372+0000","last_undegraded":"2024-02-10T08:34:29.051372+0000","last_fullsized":"2024-02-10T08:34:29.051372+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'20","last_scrub_stamp":"2024-02-10T08:32:15.357342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:32:15.357342+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":24,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":346,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.055641+0000","last_change":"2024-02-10T08:32:27.711245+0000","last_active":"2024-02-10T08:34:29.055641+0000","last_peered":"2024-02-10T08:34:29.055641+0000","last_clean":"2024-02-10T08:34:29.055641+0000","last_became_active":"2024-02-10T08:16:52.785545+0000","last_became_peered":"2024-02-10T08:16:52.785545+0000","last_unstale":"2024-02-10T08:34:29.055641+0000","last_undegraded":"2024-02-10T08:34:29.055641+0000","last_fullsized":"2024-02-10T08:34:29.055641+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:27.711059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:32:27.711059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"62'8","reported_seq":573,"reported_epoch":372,"state":"active+clean","last_fresh":"2024-02-10T08:34:37.927018+0000","last_change":"2024-02-10T08:34:37.927018+0000","last_active":"2024-02-10T08:34:37.927018+0000","last_peered":"2024-02-10T08:34:37.927018+0000","last_clean":"2024-02-10T08:34:37.927018+0000","last_became_active":"2024-02-10T08:16:56.858101+0000","last_became_peered":"2024-02-10T08:16:56.858101+0000","last_unstale":"2024-02-10T08:34:37.927018+0000","last_undegraded":"2024-02-10T08:34:37.927018+0000","last_fullsized":"2024-02-10T08:34:37.927018+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'8","last_scrub_stamp":"2024-02-10T08:34:37.926921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:34:37.926921+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":324,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.053496+0000","last_change":"2024-02-10T08:33:29.477537+0000","last_active":"2024-02-10T08:34:29.053496+0000","last_peered":"2024-02-10T08:34:29.053496+0000","last_clean":"2024-02-10T08:34:29.053496+0000","last_became_active":"2024-02-10T08:30:24.071020+0000","last_became_peered":"2024-02-10T08:30:24.071020+0000","last_unstale":"2024-02-10T08:34:29.053496+0000","last_undegraded":"2024-02-10T08:34:29.053496+0000","last_fullsized":"2024-02-10T08:34:29.053496+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:29.477480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:33:29.477480+0000","last_clean_scrub_stamp":"2024-02-10T08:33:29.477480+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1","version":"372'8944","reported_seq":8989,"reported_epoch":372,"state":"active+clean","last_fresh":"2024-02-10T08:34:34.976367+0000","last_change":"2024-02-10T08:32:30.824324+0000","last_active":"2024-02-10T08:34:34.976367+0000","last_peered":"2024-02-10T08:34:34.976367+0000","last_clean":"2024-02-10T08:34:34.976367+0000","last_became_active":"2024-02-10T08:32:30.823874+0000","last_became_peered":"2024-02-10T08:32:30.823874+0000","last_unstale":"2024-02-10T08:34:34.976367+0000","last_undegraded":"2024-02-10T08:34:34.976367+0000","last_fullsized":"2024-02-10T08:34:34.976367+0000","mapping_epoch":335,"log_start":"357'4500","ondisk_log_start":"357'4500","created":335,"last_epoch_clean":336,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.947585+0000","log_size":4444,"ondisk_log_size":4444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":414449664,"num_objects":6324,"num_object_clones":0,"num_object_copies":18972,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6324,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8944,"num_write_kb":488576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,0],"acting":[4,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"226'27","reported_seq":374,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.063865+0000","last_change":"2024-02-10T08:34:18.905332+0000","last_active":"2024-02-10T08:34:29.063865+0000","last_peered":"2024-02-10T08:34:29.063865+0000","last_clean":"2024-02-10T08:34:29.063865+0000","last_became_active":"2024-02-10T08:20:46.401777+0000","last_became_peered":"2024-02-10T08:20:46.401777+0000","last_unstale":"2024-02-10T08:34:29.063865+0000","last_undegraded":"2024-02-10T08:34:29.063865+0000","last_fullsized":"2024-02-10T08:34:29.063865+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"226'27","last_scrub_stamp":"2024-02-10T08:34:18.905235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:34:18.905235+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":346,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.052288+0000","last_change":"2024-02-10T08:32:22.621095+0000","last_active":"2024-02-10T08:34:29.052288+0000","last_peered":"2024-02-10T08:34:29.052288+0000","last_clean":"2024-02-10T08:34:29.052288+0000","last_became_active":"2024-02-10T08:16:52.783634+0000","last_became_peered":"2024-02-10T08:16:52.783634+0000","last_unstale":"2024-02-10T08:34:29.052288+0000","last_undegraded":"2024-02-10T08:34:29.052288+0000","last_fullsized":"2024-02-10T08:34:29.052288+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:22.621006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:32:22.621006+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"318'14","reported_seq":107,"reported_epoch":372,"state":"active+clean","last_fresh":"2024-02-10T08:34:31.077496+0000","last_change":"2024-02-10T08:33:27.431016+0000","last_active":"2024-02-10T08:34:31.077496+0000","last_peered":"2024-02-10T08:34:31.077496+0000","last_clean":"2024-02-10T08:34:31.077496+0000","last_became_active":"2024-02-10T08:31:46.073265+0000","last_became_peered":"2024-02-10T08:31:46.073265+0000","last_unstale":"2024-02-10T08:34:31.077496+0000","last_undegraded":"2024-02-10T08:34:31.077496+0000","last_fullsized":"2024-02-10T08:34:31.077496+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"318'14","last_scrub_stamp":"2024-02-10T08:33:27.430946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:33:27.430946+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":366,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.051685+0000","last_change":"2024-02-10T08:32:36.979257+0000","last_active":"2024-02-10T08:34:29.051685+0000","last_peered":"2024-02-10T08:34:29.051685+0000","last_clean":"2024-02-10T08:34:29.051685+0000","last_became_active":"2024-02-10T08:32:36.978932+0000","last_became_peered":"2024-02-10T08:32:36.978932+0000","last_unstale":"2024-02-10T08:34:29.051685+0000","last_undegraded":"2024-02-10T08:34:29.051685+0000","last_fullsized":"2024-02-10T08:34:29.051685+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:36.163125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:28:36.163125+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.0","version":"372'9123","reported_seq":9167,"reported_epoch":372,"state":"active+clean","last_fresh":"2024-02-10T08:34:37.745553+0000","last_change":"2024-02-10T08:32:30.821784+0000","last_active":"2024-02-10T08:34:37.745553+0000","last_peered":"2024-02-10T08:34:37.745553+0000","last_clean":"2024-02-10T08:34:37.745553+0000","last_became_active":"2024-02-10T08:32:30.821494+0000","last_became_peered":"2024-02-10T08:32:30.821494+0000","last_unstale":"2024-02-10T08:34:37.745553+0000","last_undegraded":"2024-02-10T08:34:37.745553+0000","last_fullsized":"2024-02-10T08:34:37.745553+0000","mapping_epoch":335,"log_start":"354'4000","ondisk_log_start":"354'4000","created":335,"last_epoch_clean":336,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.947585+0000","log_size":5123,"ondisk_log_size":5123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":406257664,"num_objects":6199,"num_object_clones":0,"num_object_copies":18597,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6199,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9123,"num_write_kb":490304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,4],"acting":[6,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"225'24","reported_seq":367,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.053633+0000","last_change":"2024-02-10T08:32:23.327031+0000","last_active":"2024-02-10T08:34:29.053633+0000","last_peered":"2024-02-10T08:34:29.053633+0000","last_clean":"2024-02-10T08:34:29.053633+0000","last_became_active":"2024-02-10T08:20:46.406023+0000","last_became_peered":"2024-02-10T08:20:46.406023+0000","last_unstale":"2024-02-10T08:34:29.053633+0000","last_undegraded":"2024-02-10T08:34:29.053633+0000","last_fullsized":"2024-02-10T08:34:29.053633+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'24","last_scrub_stamp":"2024-02-10T08:32:23.326944+0000","last_deep_scrub":"76'16","last_deep_scrub_stamp":"2024-02-10T08:18:07.909782+0000","last_clean_scrub_stamp":"2024-02-10T08:32:23.326944+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":363,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.058306+0000","last_change":"2024-02-10T08:32:13.217936+0000","last_active":"2024-02-10T08:34:29.058306+0000","last_peered":"2024-02-10T08:34:29.058306+0000","last_clean":"2024-02-10T08:34:29.058306+0000","last_became_active":"2024-02-10T08:28:02.768633+0000","last_became_peered":"2024-02-10T08:28:02.768633+0000","last_unstale":"2024-02-10T08:34:29.058306+0000","last_undegraded":"2024-02-10T08:34:29.058306+0000","last_fullsized":"2024-02-10T08:34:29.058306+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:13.217844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:32:13.217844+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":408,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.052592+0000","last_change":"2024-02-10T08:32:26.093026+0000","last_active":"2024-02-10T08:34:29.052592+0000","last_peered":"2024-02-10T08:34:29.052592+0000","last_clean":"2024-02-10T08:34:29.052592+0000","last_became_active":"2024-02-10T08:20:46.400500+0000","last_became_peered":"2024-02-10T08:20:46.400500+0000","last_unstale":"2024-02-10T08:34:29.052592+0000","last_undegraded":"2024-02-10T08:34:29.052592+0000","last_fullsized":"2024-02-10T08:34:29.052592+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:26.092899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:32:26.092899+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":283,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.063555+0000","last_change":"2024-02-10T08:34:23.054084+0000","last_active":"2024-02-10T08:34:29.063555+0000","last_peered":"2024-02-10T08:34:29.063555+0000","last_clean":"2024-02-10T08:34:29.063555+0000","last_became_active":"2024-02-10T08:31:33.880969+0000","last_became_peered":"2024-02-10T08:31:33.880969+0000","last_unstale":"2024-02-10T08:34:29.063555+0000","last_undegraded":"2024-02-10T08:34:29.063555+0000","last_fullsized":"2024-02-10T08:34:29.063555+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:23.053989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:20:30.227375+0000","last_clean_scrub_stamp":"2024-02-10T08:34:23.053989+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.f","version":"372'9277","reported_seq":9322,"reported_epoch":372,"state":"active+clean","last_fresh":"2024-02-10T08:34:37.725723+0000","last_change":"2024-02-10T08:32:30.825662+0000","last_active":"2024-02-10T08:34:37.725723+0000","last_peered":"2024-02-10T08:34:37.725723+0000","last_clean":"2024-02-10T08:34:37.725723+0000","last_became_active":"2024-02-10T08:32:30.825140+0000","last_became_peered":"2024-02-10T08:32:30.825140+0000","last_unstale":"2024-02-10T08:34:37.725723+0000","last_undegraded":"2024-02-10T08:34:37.725723+0000","last_fullsized":"2024-02-10T08:34:37.725723+0000","mapping_epoch":335,"log_start":"354'4100","ondisk_log_start":"354'4100","created":335,"last_epoch_clean":336,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.947585+0000","log_size":5177,"ondisk_log_size":5177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":409534464,"num_objects":6249,"num_object_clones":0,"num_object_copies":18747,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6249,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9277,"num_write_kb":496832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"314'14","reported_seq":450,"reported_epoch":372,"state":"active+clean","last_fresh":"2024-02-10T08:34:31.213213+0000","last_change":"2024-02-10T08:34:18.681979+0000","last_active":"2024-02-10T08:34:31.213213+0000","last_peered":"2024-02-10T08:34:31.213213+0000","last_clean":"2024-02-10T08:34:31.213213+0000","last_became_active":"2024-02-10T08:31:33.890120+0000","last_became_peered":"2024-02-10T08:31:33.890120+0000","last_unstale":"2024-02-10T08:34:31.213213+0000","last_undegraded":"2024-02-10T08:34:31.213213+0000","last_fullsized":"2024-02-10T08:34:31.213213+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"314'14","last_scrub_stamp":"2024-02-10T08:34:18.681893+0000","last_deep_scrub":"199'13","last_deep_scrub_stamp":"2024-02-10T08:24:47.529439+0000","last_clean_scrub_stamp":"2024-02-10T08:34:18.681893+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"225'28","reported_seq":363,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.050120+0000","last_change":"2024-02-10T08:34:12.126228+0000","last_active":"2024-02-10T08:34:29.050120+0000","last_peered":"2024-02-10T08:34:29.050120+0000","last_clean":"2024-02-10T08:34:29.050120+0000","last_became_active":"2024-02-10T08:20:46.400760+0000","last_became_peered":"2024-02-10T08:20:46.400760+0000","last_unstale":"2024-02-10T08:34:29.050120+0000","last_undegraded":"2024-02-10T08:34:29.050120+0000","last_fullsized":"2024-02-10T08:34:29.050120+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'28","last_scrub_stamp":"2024-02-10T08:34:12.126133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:34:12.126133+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":41,"num_read_kb":34,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":350,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.067278+0000","last_change":"2024-02-10T08:33:14.196309+0000","last_active":"2024-02-10T08:34:29.067278+0000","last_peered":"2024-02-10T08:34:29.067278+0000","last_clean":"2024-02-10T08:34:29.067278+0000","last_became_active":"2024-02-10T08:16:52.789020+0000","last_became_peered":"2024-02-10T08:16:52.789020+0000","last_unstale":"2024-02-10T08:34:29.067278+0000","last_undegraded":"2024-02-10T08:34:29.067278+0000","last_fullsized":"2024-02-10T08:34:29.067278+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:14.196205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:33:14.196205+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":348,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.059107+0000","last_change":"2024-02-10T08:33:15.455469+0000","last_active":"2024-02-10T08:34:29.059107+0000","last_peered":"2024-02-10T08:34:29.059107+0000","last_clean":"2024-02-10T08:34:29.059107+0000","last_became_active":"2024-02-10T08:21:58.546976+0000","last_became_peered":"2024-02-10T08:21:58.546976+0000","last_unstale":"2024-02-10T08:34:29.059107+0000","last_undegraded":"2024-02-10T08:34:29.059107+0000","last_fullsized":"2024-02-10T08:34:29.059107+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:15.455337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:33:15.455337+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"372'9056","reported_seq":9101,"reported_epoch":372,"state":"active+clean","last_fresh":"2024-02-10T08:34:34.999876+0000","last_change":"2024-02-10T08:32:30.825453+0000","last_active":"2024-02-10T08:34:34.999876+0000","last_peered":"2024-02-10T08:34:34.999876+0000","last_clean":"2024-02-10T08:34:34.999876+0000","last_became_active":"2024-02-10T08:32:30.825144+0000","last_became_peered":"2024-02-10T08:32:30.825144+0000","last_unstale":"2024-02-10T08:34:34.999876+0000","last_undegraded":"2024-02-10T08:34:34.999876+0000","last_fullsized":"2024-02-10T08:34:34.999876+0000","mapping_epoch":335,"log_start":"357'4600","ondisk_log_start":"357'4600","created":335,"last_epoch_clean":336,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.947585+0000","log_size":4456,"ondisk_log_size":4456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":422576128,"num_objects":6448,"num_object_clones":0,"num_object_copies":19344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6448,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9056,"num_write_kb":496128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":341,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.050195+0000","last_change":"2024-02-10T08:34:10.165771+0000","last_active":"2024-02-10T08:34:29.050195+0000","last_peered":"2024-02-10T08:34:29.050195+0000","last_clean":"2024-02-10T08:34:29.050195+0000","last_became_active":"2024-02-10T08:31:33.883569+0000","last_became_peered":"2024-02-10T08:31:33.883569+0000","last_unstale":"2024-02-10T08:34:29.050195+0000","last_undegraded":"2024-02-10T08:34:29.050195+0000","last_fullsized":"2024-02-10T08:34:29.050195+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:10.165705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:34:10.165705+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"225'30","reported_seq":407,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.058656+0000","last_change":"2024-02-10T08:33:22.481486+0000","last_active":"2024-02-10T08:34:29.058656+0000","last_peered":"2024-02-10T08:34:29.058656+0000","last_clean":"2024-02-10T08:34:29.058656+0000","last_became_active":"2024-02-10T08:32:36.979685+0000","last_became_peered":"2024-02-10T08:32:36.979685+0000","last_unstale":"2024-02-10T08:34:29.058656+0000","last_undegraded":"2024-02-10T08:34:29.058656+0000","last_fullsized":"2024-02-10T08:34:29.058656+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'30","last_scrub_stamp":"2024-02-10T08:33:22.481382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:33:22.481382+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":51,"num_read_kb":39,"num_write":32,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,0],"acting":[7,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":361,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.056814+0000","last_change":"2024-02-10T08:33:16.825530+0000","last_active":"2024-02-10T08:34:29.056814+0000","last_peered":"2024-02-10T08:34:29.056814+0000","last_clean":"2024-02-10T08:34:29.056814+0000","last_became_active":"2024-02-10T08:20:46.407667+0000","last_became_peered":"2024-02-10T08:20:46.407667+0000","last_unstale":"2024-02-10T08:34:29.056814+0000","last_undegraded":"2024-02-10T08:34:29.056814+0000","last_fullsized":"2024-02-10T08:34:29.056814+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:16.825366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:33:16.825366+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":354,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.050478+0000","last_change":"2024-02-10T08:32:25.358402+0000","last_active":"2024-02-10T08:34:29.050478+0000","last_peered":"2024-02-10T08:34:29.050478+0000","last_clean":"2024-02-10T08:34:29.050478+0000","last_became_active":"2024-02-10T08:31:33.882582+0000","last_became_peered":"2024-02-10T08:31:33.882582+0000","last_unstale":"2024-02-10T08:34:29.050478+0000","last_undegraded":"2024-02-10T08:34:29.050478+0000","last_fullsized":"2024-02-10T08:34:29.050478+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:25.358315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:25.358315+0000","last_clean_scrub_stamp":"2024-02-10T08:32:25.358315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.d","version":"372'8914","reported_seq":8977,"reported_epoch":372,"state":"active+clean","last_fresh":"2024-02-10T08:34:34.976016+0000","last_change":"2024-02-10T08:33:56.130464+0000","last_active":"2024-02-10T08:34:34.976016+0000","last_peered":"2024-02-10T08:34:34.976016+0000","last_clean":"2024-02-10T08:34:34.976016+0000","last_became_active":"2024-02-10T08:33:56.117412+0000","last_became_peered":"2024-02-10T08:33:56.117412+0000","last_unstale":"2024-02-10T08:34:34.976016+0000","last_undegraded":"2024-02-10T08:34:34.976016+0000","last_fullsized":"2024-02-10T08:34:34.976016+0000","mapping_epoch":364,"log_start":"356'4490","ondisk_log_start":"356'4490","created":335,"last_epoch_clean":365,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.947585+0000","log_size":4424,"ondisk_log_size":4424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":418578456,"num_objects":6388,"num_object_clones":0,"num_object_copies":19164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6388,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":8914,"num_write_kb":489601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":236,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.062400+0000","last_change":"2024-02-10T08:33:56.117476+0000","last_active":"2024-02-10T08:34:29.062400+0000","last_peered":"2024-02-10T08:34:29.062400+0000","last_clean":"2024-02-10T08:34:29.062400+0000","last_became_active":"2024-02-10T08:33:56.117216+0000","last_became_peered":"2024-02-10T08:33:56.117216+0000","last_unstale":"2024-02-10T08:34:29.062400+0000","last_undegraded":"2024-02-10T08:34:29.062400+0000","last_fullsized":"2024-02-10T08:34:29.062400+0000","mapping_epoch":364,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":365,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:33.234450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:33:33.234450+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"225'37","reported_seq":442,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.060627+0000","last_change":"2024-02-10T08:33:15.707082+0000","last_active":"2024-02-10T08:34:29.060627+0000","last_peered":"2024-02-10T08:34:29.060627+0000","last_clean":"2024-02-10T08:34:29.060627+0000","last_became_active":"2024-02-10T08:28:25.951447+0000","last_became_peered":"2024-02-10T08:28:25.951447+0000","last_unstale":"2024-02-10T08:34:29.060627+0000","last_undegraded":"2024-02-10T08:34:29.060627+0000","last_fullsized":"2024-02-10T08:34:29.060627+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'37","last_scrub_stamp":"2024-02-10T08:33:15.706967+0000","last_deep_scrub":"199'27","last_deep_scrub_stamp":"2024-02-10T08:24:42.826442+0000","last_clean_scrub_stamp":"2024-02-10T08:33:15.706967+0000","log_size":37,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":53,"num_read_kb":39,"num_write":32,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":353,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.063480+0000","last_change":"2024-02-10T08:34:20.889754+0000","last_active":"2024-02-10T08:34:29.063480+0000","last_peered":"2024-02-10T08:34:29.063480+0000","last_clean":"2024-02-10T08:34:29.063480+0000","last_became_active":"2024-02-10T08:32:36.972224+0000","last_became_peered":"2024-02-10T08:32:36.972224+0000","last_unstale":"2024-02-10T08:34:29.063480+0000","last_undegraded":"2024-02-10T08:34:29.063480+0000","last_fullsized":"2024-02-10T08:34:29.063480+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:20.889663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:34:20.889663+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4],"acting":[2,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":349,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.052429+0000","last_change":"2024-02-10T08:33:15.884926+0000","last_active":"2024-02-10T08:34:29.052429+0000","last_peered":"2024-02-10T08:34:29.052429+0000","last_clean":"2024-02-10T08:34:29.052429+0000","last_became_active":"2024-02-10T08:21:58.553966+0000","last_became_peered":"2024-02-10T08:21:58.553966+0000","last_unstale":"2024-02-10T08:34:29.052429+0000","last_undegraded":"2024-02-10T08:34:29.052429+0000","last_fullsized":"2024-02-10T08:34:29.052429+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:15.884742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:39.633627+0000","last_clean_scrub_stamp":"2024-02-10T08:33:15.884742+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.8","version":"372'9108","reported_seq":9153,"reported_epoch":372,"state":"active+clean","last_fresh":"2024-02-10T08:34:38.304823+0000","last_change":"2024-02-10T08:32:30.824983+0000","last_active":"2024-02-10T08:34:38.304823+0000","last_peered":"2024-02-10T08:34:38.304823+0000","last_clean":"2024-02-10T08:34:38.304823+0000","last_became_active":"2024-02-10T08:32:30.824620+0000","last_became_peered":"2024-02-10T08:32:30.824620+0000","last_unstale":"2024-02-10T08:34:38.304823+0000","last_undegraded":"2024-02-10T08:34:38.304823+0000","last_fullsized":"2024-02-10T08:34:38.304823+0000","mapping_epoch":335,"log_start":"356'4600","ondisk_log_start":"356'4600","created":335,"last_epoch_clean":336,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.947585+0000","log_size":4508,"ondisk_log_size":4508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":398852096,"num_objects":6086,"num_object_clones":0,"num_object_copies":18258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6086,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9108,"num_write_kb":486208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7],"acting":[0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":368,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.052657+0000","last_change":"2024-02-10T08:33:28.092624+0000","last_active":"2024-02-10T08:34:29.052657+0000","last_peered":"2024-02-10T08:34:29.052657+0000","last_clean":"2024-02-10T08:34:29.052657+0000","last_became_active":"2024-02-10T08:28:02.772585+0000","last_became_peered":"2024-02-10T08:28:02.772585+0000","last_unstale":"2024-02-10T08:34:29.052657+0000","last_undegraded":"2024-02-10T08:34:29.052657+0000","last_fullsized":"2024-02-10T08:34:29.052657+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:28.092554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:41.360241+0000","last_clean_scrub_stamp":"2024-02-10T08:33:28.092554+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"225'24","reported_seq":61,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.061365+0000","last_change":"2024-02-10T08:33:09.736783+0000","last_active":"2024-02-10T08:34:29.061365+0000","last_peered":"2024-02-10T08:34:29.061365+0000","last_clean":"2024-02-10T08:34:29.061365+0000","last_became_active":"2024-02-10T08:32:36.975366+0000","last_became_peered":"2024-02-10T08:32:36.975366+0000","last_unstale":"2024-02-10T08:34:29.061365+0000","last_undegraded":"2024-02-10T08:34:29.061365+0000","last_fullsized":"2024-02-10T08:34:29.061365+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'24","last_scrub_stamp":"2024-02-10T08:33:09.736694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:33:09.736694+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":363,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.058152+0000","last_change":"2024-02-10T08:32:28.402029+0000","last_active":"2024-02-10T08:34:29.058152+0000","last_peered":"2024-02-10T08:34:29.058152+0000","last_clean":"2024-02-10T08:34:29.058152+0000","last_became_active":"2024-02-10T08:28:02.760999+0000","last_became_peered":"2024-02-10T08:28:02.760999+0000","last_unstale":"2024-02-10T08:34:29.058152+0000","last_undegraded":"2024-02-10T08:34:29.058152+0000","last_fullsized":"2024-02-10T08:34:29.058152+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:28.401960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:28.401960+0000","last_clean_scrub_stamp":"2024-02-10T08:32:28.401960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":342,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.060435+0000","last_change":"2024-02-10T08:33:26.788214+0000","last_active":"2024-02-10T08:34:29.060435+0000","last_peered":"2024-02-10T08:34:29.060435+0000","last_clean":"2024-02-10T08:34:29.060435+0000","last_became_active":"2024-02-10T08:31:46.063039+0000","last_became_peered":"2024-02-10T08:31:46.063039+0000","last_unstale":"2024-02-10T08:34:29.060435+0000","last_undegraded":"2024-02-10T08:34:29.060435+0000","last_fullsized":"2024-02-10T08:34:29.060435+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:26.787778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:20.736224+0000","last_clean_scrub_stamp":"2024-02-10T08:33:26.787778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":362,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.056103+0000","last_change":"2024-02-10T08:32:32.713980+0000","last_active":"2024-02-10T08:34:29.056103+0000","last_peered":"2024-02-10T08:34:29.056103+0000","last_clean":"2024-02-10T08:34:29.056103+0000","last_became_active":"2024-02-10T08:28:19.022399+0000","last_became_peered":"2024-02-10T08:28:19.022399+0000","last_unstale":"2024-02-10T08:34:29.056103+0000","last_undegraded":"2024-02-10T08:34:29.056103+0000","last_fullsized":"2024-02-10T08:34:29.056103+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:32.713921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:32:32.713921+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"372'9189","reported_seq":9239,"reported_epoch":372,"state":"active+clean","last_fresh":"2024-02-10T08:34:37.728836+0000","last_change":"2024-02-10T08:34:33.403560+0000","last_active":"2024-02-10T08:34:37.728836+0000","last_peered":"2024-02-10T08:34:37.728836+0000","last_clean":"2024-02-10T08:34:37.728836+0000","last_became_active":"2024-02-10T08:32:30.823591+0000","last_became_peered":"2024-02-10T08:32:30.823591+0000","last_unstale":"2024-02-10T08:34:37.728836+0000","last_undegraded":"2024-02-10T08:34:37.728836+0000","last_fullsized":"2024-02-10T08:34:37.728836+0000","mapping_epoch":335,"log_start":"354'4100","ondisk_log_start":"354'4100","created":335,"last_epoch_clean":336,"parent":"0.0","parent_split_bits":0,"last_scrub":"372'8897","last_scrub_stamp":"2024-02-10T08:34:33.403477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:34:33.403477+0000","log_size":5089,"ondisk_log_size":5089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":404160512,"num_objects":6167,"num_object_clones":0,"num_object_copies":18501,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6167,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9189,"num_write_kb":491392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,0],"acting":[6,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":346,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.059649+0000","last_change":"2024-02-10T08:34:23.304609+0000","last_active":"2024-02-10T08:34:29.059649+0000","last_peered":"2024-02-10T08:34:29.059649+0000","last_clean":"2024-02-10T08:34:29.059649+0000","last_became_active":"2024-02-10T08:16:56.867159+0000","last_became_peered":"2024-02-10T08:16:56.867159+0000","last_unstale":"2024-02-10T08:34:29.059649+0000","last_undegraded":"2024-02-10T08:34:29.059649+0000","last_fullsized":"2024-02-10T08:34:29.059649+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:23.304519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:04.766780+0000","last_clean_scrub_stamp":"2024-02-10T08:34:23.304519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"225'33","reported_seq":410,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.063742+0000","last_change":"2024-02-10T08:33:19.194771+0000","last_active":"2024-02-10T08:34:29.063742+0000","last_peered":"2024-02-10T08:34:29.063742+0000","last_clean":"2024-02-10T08:34:29.063742+0000","last_became_active":"2024-02-10T08:20:46.401981+0000","last_became_peered":"2024-02-10T08:20:46.401981+0000","last_unstale":"2024-02-10T08:34:29.063742+0000","last_undegraded":"2024-02-10T08:34:29.063742+0000","last_fullsized":"2024-02-10T08:34:29.063742+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'33","last_scrub_stamp":"2024-02-10T08:33:19.194672+0000","last_deep_scrub":"223'21","last_deep_scrub_stamp":"2024-02-10T08:26:33.250614+0000","last_clean_scrub_stamp":"2024-02-10T08:33:19.194672+0000","log_size":33,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":33,"num_write":25,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":374,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.058235+0000","last_change":"2024-02-10T08:32:36.980106+0000","last_active":"2024-02-10T08:34:29.058235+0000","last_peered":"2024-02-10T08:34:29.058235+0000","last_clean":"2024-02-10T08:34:29.058235+0000","last_became_active":"2024-02-10T08:32:36.979237+0000","last_became_peered":"2024-02-10T08:32:36.979237+0000","last_unstale":"2024-02-10T08:34:29.058235+0000","last_undegraded":"2024-02-10T08:34:29.058235+0000","last_fullsized":"2024-02-10T08:34:29.058235+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:16.187704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:14:44.584370+0000","last_clean_scrub_stamp":"2024-02-10T08:32:16.187704+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":350,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.053018+0000","last_change":"2024-02-10T08:33:12.974304+0000","last_active":"2024-02-10T08:34:29.053018+0000","last_peered":"2024-02-10T08:34:29.053018+0000","last_clean":"2024-02-10T08:34:29.053018+0000","last_became_active":"2024-02-10T08:16:52.788767+0000","last_became_peered":"2024-02-10T08:16:52.788767+0000","last_unstale":"2024-02-10T08:34:29.053018+0000","last_undegraded":"2024-02-10T08:34:29.053018+0000","last_fullsized":"2024-02-10T08:34:29.053018+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:12.974215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:33:12.974215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":274,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.052016+0000","last_change":"2024-02-10T08:32:29.019898+0000","last_active":"2024-02-10T08:34:29.052016+0000","last_peered":"2024-02-10T08:34:29.052016+0000","last_clean":"2024-02-10T08:34:29.052016+0000","last_became_active":"2024-02-10T08:31:33.878588+0000","last_became_peered":"2024-02-10T08:31:33.878588+0000","last_unstale":"2024-02-10T08:34:29.052016+0000","last_undegraded":"2024-02-10T08:34:29.052016+0000","last_fullsized":"2024-02-10T08:34:29.052016+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.019819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.019819+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.019819+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":78,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.061252+0000","last_change":"2024-02-10T08:34:19.149776+0000","last_active":"2024-02-10T08:34:29.061252+0000","last_peered":"2024-02-10T08:34:29.061252+0000","last_clean":"2024-02-10T08:34:29.061252+0000","last_became_active":"2024-02-10T08:31:19.726561+0000","last_became_peered":"2024-02-10T08:31:19.726561+0000","last_unstale":"2024-02-10T08:34:29.061252+0000","last_undegraded":"2024-02-10T08:34:29.061252+0000","last_fullsized":"2024-02-10T08:34:29.061252+0000","mapping_epoch":308,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":309,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:19.149688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:26:29.921562+0000","last_clean_scrub_stamp":"2024-02-10T08:34:19.149688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"372'9398","reported_seq":9443,"reported_epoch":372,"state":"active+clean","last_fresh":"2024-02-10T08:34:37.754521+0000","last_change":"2024-02-10T08:32:30.825343+0000","last_active":"2024-02-10T08:34:37.754521+0000","last_peered":"2024-02-10T08:34:37.754521+0000","last_clean":"2024-02-10T08:34:37.754521+0000","last_became_active":"2024-02-10T08:32:30.824975+0000","last_became_peered":"2024-02-10T08:32:30.824975+0000","last_unstale":"2024-02-10T08:34:37.754521+0000","last_undegraded":"2024-02-10T08:34:37.754521+0000","last_fullsized":"2024-02-10T08:34:37.754521+0000","mapping_epoch":335,"log_start":"356'4600","ondisk_log_start":"356'4600","created":335,"last_epoch_clean":336,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.947585+0000","log_size":4798,"ondisk_log_size":4798,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":419299328,"num_objects":6398,"num_object_clones":0,"num_object_copies":19194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6398,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9398,"num_write_kb":505472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":347,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.065014+0000","last_change":"2024-02-10T08:33:27.613405+0000","last_active":"2024-02-10T08:34:29.065014+0000","last_peered":"2024-02-10T08:34:29.065014+0000","last_clean":"2024-02-10T08:34:29.065014+0000","last_became_active":"2024-02-10T08:16:56.857856+0000","last_became_peered":"2024-02-10T08:16:56.857856+0000","last_unstale":"2024-02-10T08:34:29.065014+0000","last_undegraded":"2024-02-10T08:34:29.065014+0000","last_fullsized":"2024-02-10T08:34:29.065014+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:27.613326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:33:27.613326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"225'17","reported_seq":142,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.060124+0000","last_change":"2024-02-10T08:34:18.368803+0000","last_active":"2024-02-10T08:34:29.060124+0000","last_peered":"2024-02-10T08:34:29.060124+0000","last_clean":"2024-02-10T08:34:29.060124+0000","last_became_active":"2024-02-10T08:32:36.984195+0000","last_became_peered":"2024-02-10T08:32:36.984195+0000","last_unstale":"2024-02-10T08:34:29.060124+0000","last_undegraded":"2024-02-10T08:34:29.060124+0000","last_fullsized":"2024-02-10T08:34:29.060124+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'17","last_scrub_stamp":"2024-02-10T08:34:18.368690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:34:18.368690+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":23,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":392,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.059765+0000","last_change":"2024-02-10T08:34:23.885476+0000","last_active":"2024-02-10T08:34:29.059765+0000","last_peered":"2024-02-10T08:34:29.059765+0000","last_clean":"2024-02-10T08:34:29.059765+0000","last_became_active":"2024-02-10T08:31:33.884021+0000","last_became_peered":"2024-02-10T08:31:33.884021+0000","last_unstale":"2024-02-10T08:34:29.059765+0000","last_undegraded":"2024-02-10T08:34:29.059765+0000","last_fullsized":"2024-02-10T08:34:29.059765+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:23.885336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:11.681169+0000","last_clean_scrub_stamp":"2024-02-10T08:34:23.885336+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"63'5","reported_seq":1405,"reported_epoch":372,"state":"active+clean","last_fresh":"2024-02-10T08:34:35.912027+0000","last_change":"2024-02-10T08:34:35.736338+0000","last_active":"2024-02-10T08:34:35.912027+0000","last_peered":"2024-02-10T08:34:35.912027+0000","last_clean":"2024-02-10T08:34:35.912027+0000","last_became_active":"2024-02-10T08:16:52.780989+0000","last_became_peered":"2024-02-10T08:16:52.780989+0000","last_unstale":"2024-02-10T08:34:35.912027+0000","last_undegraded":"2024-02-10T08:34:35.912027+0000","last_fullsized":"2024-02-10T08:34:35.912027+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'5","last_scrub_stamp":"2024-02-10T08:32:19.667251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:32:19.667251+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1054,"num_read_kb":1049,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":354,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.059422+0000","last_change":"2024-02-10T08:33:17.442371+0000","last_active":"2024-02-10T08:34:29.059422+0000","last_peered":"2024-02-10T08:34:29.059422+0000","last_clean":"2024-02-10T08:34:29.059422+0000","last_became_active":"2024-02-10T08:21:58.549733+0000","last_became_peered":"2024-02-10T08:21:58.549733+0000","last_unstale":"2024-02-10T08:34:29.059422+0000","last_undegraded":"2024-02-10T08:34:29.059422+0000","last_fullsized":"2024-02-10T08:34:29.059422+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:17.442264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:11.750537+0000","last_clean_scrub_stamp":"2024-02-10T08:33:17.442264+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.a","version":"372'9087","reported_seq":9141,"reported_epoch":372,"state":"active+clean","last_fresh":"2024-02-10T08:34:37.745435+0000","last_change":"2024-02-10T08:32:36.979236+0000","last_active":"2024-02-10T08:34:37.745435+0000","last_peered":"2024-02-10T08:34:37.745435+0000","last_clean":"2024-02-10T08:34:37.745435+0000","last_became_active":"2024-02-10T08:32:36.978852+0000","last_became_peered":"2024-02-10T08:32:36.978852+0000","last_unstale":"2024-02-10T08:34:37.745435+0000","last_undegraded":"2024-02-10T08:34:37.745435+0000","last_fullsized":"2024-02-10T08:34:37.745435+0000","mapping_epoch":339,"log_start":"354'4000","ondisk_log_start":"354'4000","created":335,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.947585+0000","log_size":5087,"ondisk_log_size":5087,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":405471232,"num_objects":6187,"num_object_clones":0,"num_object_copies":18561,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6187,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9087,"num_write_kb":488768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":47,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.060561+0000","last_change":"2024-02-10T08:34:13.094510+0000","last_active":"2024-02-10T08:34:29.060561+0000","last_peered":"2024-02-10T08:34:29.060561+0000","last_clean":"2024-02-10T08:34:29.060561+0000","last_became_active":"2024-02-10T08:32:36.976141+0000","last_became_peered":"2024-02-10T08:32:36.976141+0000","last_unstale":"2024-02-10T08:34:29.060561+0000","last_undegraded":"2024-02-10T08:34:29.060561+0000","last_fullsized":"2024-02-10T08:34:29.060561+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:13.094426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:34:13.094426+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"314'42","reported_seq":691,"reported_epoch":372,"state":"active+clean","last_fresh":"2024-02-10T08:34:31.219263+0000","last_change":"2024-02-10T08:33:13.903831+0000","last_active":"2024-02-10T08:34:31.219263+0000","last_peered":"2024-02-10T08:34:31.219263+0000","last_clean":"2024-02-10T08:34:31.219263+0000","last_became_active":"2024-02-10T08:31:33.904487+0000","last_became_peered":"2024-02-10T08:31:33.904487+0000","last_unstale":"2024-02-10T08:34:31.219263+0000","last_undegraded":"2024-02-10T08:34:31.219263+0000","last_fullsized":"2024-02-10T08:34:31.219263+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":315,"parent":"0.0","parent_split_bits":0,"last_scrub":"314'42","last_scrub_stamp":"2024-02-10T08:33:13.903652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:33:13.903652+0000","log_size":42,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":66,"num_read_kb":51,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":716,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":350,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.051806+0000","last_change":"2024-02-10T08:33:15.952668+0000","last_active":"2024-02-10T08:34:29.051806+0000","last_peered":"2024-02-10T08:34:29.051806+0000","last_clean":"2024-02-10T08:34:29.051806+0000","last_became_active":"2024-02-10T08:16:52.791027+0000","last_became_peered":"2024-02-10T08:16:52.791027+0000","last_unstale":"2024-02-10T08:34:29.051806+0000","last_undegraded":"2024-02-10T08:34:29.051806+0000","last_fullsized":"2024-02-10T08:34:29.051806+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:15.952580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:33:15.952580+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":369,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.053428+0000","last_change":"2024-02-10T08:32:32.331364+0000","last_active":"2024-02-10T08:34:29.053428+0000","last_peered":"2024-02-10T08:34:29.053428+0000","last_clean":"2024-02-10T08:34:29.053428+0000","last_became_active":"2024-02-10T08:31:33.884295+0000","last_became_peered":"2024-02-10T08:31:33.884295+0000","last_unstale":"2024-02-10T08:34:29.053428+0000","last_undegraded":"2024-02-10T08:34:29.053428+0000","last_fullsized":"2024-02-10T08:34:29.053428+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:32.331286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:32:32.331286+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"372'9306","reported_seq":9351,"reported_epoch":372,"state":"active+clean","last_fresh":"2024-02-10T08:34:37.755911+0000","last_change":"2024-02-10T08:32:30.823074+0000","last_active":"2024-02-10T08:34:37.755911+0000","last_peered":"2024-02-10T08:34:37.755911+0000","last_clean":"2024-02-10T08:34:37.755911+0000","last_became_active":"2024-02-10T08:32:30.822769+0000","last_became_peered":"2024-02-10T08:32:30.822769+0000","last_unstale":"2024-02-10T08:34:37.755911+0000","last_undegraded":"2024-02-10T08:34:37.755911+0000","last_fullsized":"2024-02-10T08:34:37.755911+0000","mapping_epoch":335,"log_start":"358'4900","ondisk_log_start":"358'4900","created":335,"last_epoch_clean":336,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.947585+0000","log_size":4406,"ondisk_log_size":4406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":409862144,"num_objects":6254,"num_object_clones":0,"num_object_copies":18762,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6254,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9306,"num_write_kb":497920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"255'12","reported_seq":281,"reported_epoch":372,"state":"active+clean","last_fresh":"2024-02-10T08:34:31.211920+0000","last_change":"2024-02-10T08:32:25.571469+0000","last_active":"2024-02-10T08:34:31.211920+0000","last_peered":"2024-02-10T08:34:31.211920+0000","last_clean":"2024-02-10T08:34:31.211920+0000","last_became_active":"2024-02-10T08:28:25.952468+0000","last_became_peered":"2024-02-10T08:28:25.952468+0000","last_unstale":"2024-02-10T08:34:31.211920+0000","last_undegraded":"2024-02-10T08:34:31.211920+0000","last_fullsized":"2024-02-10T08:34:31.211920+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'12","last_scrub_stamp":"2024-02-10T08:32:25.571388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:32:25.571388+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"225'20","reported_seq":389,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.055720+0000","last_change":"2024-02-10T08:34:11.736768+0000","last_active":"2024-02-10T08:34:29.055720+0000","last_peered":"2024-02-10T08:34:29.055720+0000","last_clean":"2024-02-10T08:34:29.055720+0000","last_became_active":"2024-02-10T08:20:46.408495+0000","last_became_peered":"2024-02-10T08:20:46.408495+0000","last_unstale":"2024-02-10T08:34:29.055720+0000","last_undegraded":"2024-02-10T08:34:29.055720+0000","last_fullsized":"2024-02-10T08:34:29.055720+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'20","last_scrub_stamp":"2024-02-10T08:34:11.736600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:34:11.736600+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":364,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.055800+0000","last_change":"2024-02-10T08:33:11.869960+0000","last_active":"2024-02-10T08:34:29.055800+0000","last_peered":"2024-02-10T08:34:29.055800+0000","last_clean":"2024-02-10T08:34:29.055800+0000","last_became_active":"2024-02-10T08:28:02.760784+0000","last_became_peered":"2024-02-10T08:28:02.760784+0000","last_unstale":"2024-02-10T08:34:29.055800+0000","last_undegraded":"2024-02-10T08:34:29.055800+0000","last_fullsized":"2024-02-10T08:34:29.055800+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:11.869839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:33:11.869839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":270,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.059650+0000","last_change":"2024-02-10T08:34:11.146000+0000","last_active":"2024-02-10T08:34:29.059650+0000","last_peered":"2024-02-10T08:34:29.059650+0000","last_clean":"2024-02-10T08:34:29.059650+0000","last_became_active":"2024-02-10T08:28:25.950240+0000","last_became_peered":"2024-02-10T08:28:25.950240+0000","last_unstale":"2024-02-10T08:34:29.059650+0000","last_undegraded":"2024-02-10T08:34:29.059650+0000","last_fullsized":"2024-02-10T08:34:29.059650+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:11.145907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:34:11.145907+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"372'9318","reported_seq":9371,"reported_epoch":372,"state":"active+clean","last_fresh":"2024-02-10T08:34:37.754532+0000","last_change":"2024-02-10T08:33:56.159846+0000","last_active":"2024-02-10T08:34:37.754532+0000","last_peered":"2024-02-10T08:34:37.754532+0000","last_clean":"2024-02-10T08:34:37.754532+0000","last_became_active":"2024-02-10T08:33:56.120673+0000","last_became_peered":"2024-02-10T08:33:56.120673+0000","last_unstale":"2024-02-10T08:34:37.754532+0000","last_undegraded":"2024-02-10T08:34:37.754532+0000","last_fullsized":"2024-02-10T08:34:37.754532+0000","mapping_epoch":364,"log_start":"356'4537","ondisk_log_start":"356'4537","created":335,"last_epoch_clean":365,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.947585+0000","log_size":4781,"ondisk_log_size":4781,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":423493632,"num_objects":6462,"num_object_clones":0,"num_object_copies":19386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6462,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9318,"num_write_kb":504960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":365,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.059839+0000","last_change":"2024-02-10T08:33:19.671725+0000","last_active":"2024-02-10T08:34:29.059839+0000","last_peered":"2024-02-10T08:34:29.059839+0000","last_clean":"2024-02-10T08:34:29.059839+0000","last_became_active":"2024-02-10T08:28:02.777637+0000","last_became_peered":"2024-02-10T08:28:02.777637+0000","last_unstale":"2024-02-10T08:34:29.059839+0000","last_undegraded":"2024-02-10T08:34:29.059839+0000","last_fullsized":"2024-02-10T08:34:29.059839+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:19.671626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:33:19.671626+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"225'23","reported_seq":410,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.049934+0000","last_change":"2024-02-10T08:34:19.175648+0000","last_active":"2024-02-10T08:34:29.049934+0000","last_peered":"2024-02-10T08:34:29.049934+0000","last_clean":"2024-02-10T08:34:29.049934+0000","last_became_active":"2024-02-10T08:31:33.884516+0000","last_became_peered":"2024-02-10T08:31:33.884516+0000","last_unstale":"2024-02-10T08:34:29.049934+0000","last_undegraded":"2024-02-10T08:34:29.049934+0000","last_fullsized":"2024-02-10T08:34:29.049934+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'23","last_scrub_stamp":"2024-02-10T08:34:19.175575+0000","last_deep_scrub":"82'17","last_deep_scrub_stamp":"2024-02-10T08:18:21.015873+0000","last_clean_scrub_stamp":"2024-02-10T08:34:19.175575+0000","log_size":23,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":25,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"55'2","reported_seq":366,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.050852+0000","last_change":"2024-02-10T08:34:27.070443+0000","last_active":"2024-02-10T08:34:29.050852+0000","last_peered":"2024-02-10T08:34:29.050852+0000","last_clean":"2024-02-10T08:34:29.050852+0000","last_became_active":"2024-02-10T08:28:02.768279+0000","last_became_peered":"2024-02-10T08:28:02.768279+0000","last_unstale":"2024-02-10T08:34:29.050852+0000","last_undegraded":"2024-02-10T08:34:29.050852+0000","last_fullsized":"2024-02-10T08:34:29.050852+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'2","last_scrub_stamp":"2024-02-10T08:34:27.070328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:34:27.070328+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":184,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":255,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.058839+0000","last_change":"2024-02-10T08:30:24.073702+0000","last_active":"2024-02-10T08:34:29.058839+0000","last_peered":"2024-02-10T08:34:29.058839+0000","last_clean":"2024-02-10T08:34:29.058839+0000","last_became_active":"2024-02-10T08:30:24.073077+0000","last_became_peered":"2024-02-10T08:30:24.073077+0000","last_unstale":"2024-02-10T08:34:29.058839+0000","last_undegraded":"2024-02-10T08:34:29.058839+0000","last_fullsized":"2024-02-10T08:34:29.058839+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:26:20.173948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:26:20.173948+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"225'15","reported_seq":57,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.061203+0000","last_change":"2024-02-10T08:33:19.722178+0000","last_active":"2024-02-10T08:34:29.061203+0000","last_peered":"2024-02-10T08:34:29.061203+0000","last_clean":"2024-02-10T08:34:29.061203+0000","last_became_active":"2024-02-10T08:32:36.982716+0000","last_became_peered":"2024-02-10T08:32:36.982716+0000","last_unstale":"2024-02-10T08:34:29.061203+0000","last_undegraded":"2024-02-10T08:34:29.061203+0000","last_fullsized":"2024-02-10T08:34:29.061203+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'15","last_scrub_stamp":"2024-02-10T08:33:19.722084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:33:19.722084+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"55'1","reported_seq":421,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.059795+0000","last_change":"2024-02-10T08:33:28.572672+0000","last_active":"2024-02-10T08:34:29.059795+0000","last_peered":"2024-02-10T08:34:29.059795+0000","last_clean":"2024-02-10T08:34:29.059795+0000","last_became_active":"2024-02-10T08:28:02.778857+0000","last_became_peered":"2024-02-10T08:28:02.778857+0000","last_unstale":"2024-02-10T08:34:29.059795+0000","last_undegraded":"2024-02-10T08:34:29.059795+0000","last_fullsized":"2024-02-10T08:34:29.059795+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'1","last_scrub_stamp":"2024-02-10T08:33:28.572582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:33:28.572582+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":716,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":294,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:30.785819+0000","last_change":"2024-02-10T08:34:30.785782+0000","last_active":"2024-02-10T08:34:30.785819+0000","last_peered":"2024-02-10T08:34:30.785819+0000","last_clean":"2024-02-10T08:34:30.785819+0000","last_became_active":"2024-02-10T08:31:33.891489+0000","last_became_peered":"2024-02-10T08:31:33.891489+0000","last_unstale":"2024-02-10T08:34:30.785819+0000","last_undegraded":"2024-02-10T08:34:30.785819+0000","last_fullsized":"2024-02-10T08:34:30.785819+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:30.785679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:34:30.785679+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":214,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.060395+0000","last_change":"2024-02-10T08:34:12.117475+0000","last_active":"2024-02-10T08:34:29.060395+0000","last_peered":"2024-02-10T08:34:29.060395+0000","last_clean":"2024-02-10T08:34:29.060395+0000","last_became_active":"2024-02-10T08:28:25.999252+0000","last_became_peered":"2024-02-10T08:28:25.999252+0000","last_unstale":"2024-02-10T08:34:29.060395+0000","last_undegraded":"2024-02-10T08:34:29.060395+0000","last_fullsized":"2024-02-10T08:34:29.060395+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:12.117379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:34:12.117379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"225'15","reported_seq":318,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.060379+0000","last_change":"2024-02-10T08:32:23.310599+0000","last_active":"2024-02-10T08:34:29.060379+0000","last_peered":"2024-02-10T08:34:29.060379+0000","last_clean":"2024-02-10T08:34:29.060379+0000","last_became_active":"2024-02-10T08:31:33.891813+0000","last_became_peered":"2024-02-10T08:31:33.891813+0000","last_unstale":"2024-02-10T08:34:29.060379+0000","last_undegraded":"2024-02-10T08:34:29.060379+0000","last_fullsized":"2024-02-10T08:34:29.060379+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'15","last_scrub_stamp":"2024-02-10T08:32:23.310489+0000","last_deep_scrub":"223'9","last_deep_scrub_stamp":"2024-02-10T08:26:33.158025+0000","last_clean_scrub_stamp":"2024-02-10T08:32:23.310489+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":417,"reported_epoch":372,"state":"active+clean","last_fresh":"2024-02-10T08:34:35.009855+0000","last_change":"2024-02-10T08:34:35.009855+0000","last_active":"2024-02-10T08:34:35.009855+0000","last_peered":"2024-02-10T08:34:35.009855+0000","last_clean":"2024-02-10T08:34:35.009855+0000","last_became_active":"2024-02-10T08:31:46.053553+0000","last_became_peered":"2024-02-10T08:31:46.053553+0000","last_unstale":"2024-02-10T08:34:35.009855+0000","last_undegraded":"2024-02-10T08:34:35.009855+0000","last_fullsized":"2024-02-10T08:34:35.009855+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:35.009784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:34:35.009784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":346,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.052359+0000","last_change":"2024-02-10T08:34:28.320611+0000","last_active":"2024-02-10T08:34:29.052359+0000","last_peered":"2024-02-10T08:34:29.052359+0000","last_clean":"2024-02-10T08:34:29.052359+0000","last_became_active":"2024-02-10T08:16:56.863948+0000","last_became_peered":"2024-02-10T08:16:56.863948+0000","last_unstale":"2024-02-10T08:34:29.052359+0000","last_undegraded":"2024-02-10T08:34:29.052359+0000","last_fullsized":"2024-02-10T08:34:29.052359+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:28.320524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:34:28.320524+0000","last_clean_scrub_stamp":"2024-02-10T08:34:28.320524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":354,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.059203+0000","last_change":"2024-02-10T08:33:32.430824+0000","last_active":"2024-02-10T08:34:29.059203+0000","last_peered":"2024-02-10T08:34:29.059203+0000","last_clean":"2024-02-10T08:34:29.059203+0000","last_became_active":"2024-02-10T08:20:46.398903+0000","last_became_peered":"2024-02-10T08:20:46.398903+0000","last_unstale":"2024-02-10T08:34:29.059203+0000","last_undegraded":"2024-02-10T08:34:29.059203+0000","last_fullsized":"2024-02-10T08:34:29.059203+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:32.430721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:33:32.430721+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"225'20","reported_seq":293,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.055932+0000","last_change":"2024-02-10T08:32:23.661124+0000","last_active":"2024-02-10T08:34:29.055932+0000","last_peered":"2024-02-10T08:34:29.055932+0000","last_clean":"2024-02-10T08:34:29.055932+0000","last_became_active":"2024-02-10T08:22:23.534081+0000","last_became_peered":"2024-02-10T08:22:23.534081+0000","last_unstale":"2024-02-10T08:34:29.055932+0000","last_undegraded":"2024-02-10T08:34:29.055932+0000","last_fullsized":"2024-02-10T08:34:29.055932+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'20","last_scrub_stamp":"2024-02-10T08:32:23.661032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:32:23.661032+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":24,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":350,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.051641+0000","last_change":"2024-02-10T08:32:16.110041+0000","last_active":"2024-02-10T08:34:29.051641+0000","last_peered":"2024-02-10T08:34:29.051641+0000","last_clean":"2024-02-10T08:34:29.051641+0000","last_became_active":"2024-02-10T08:16:52.789834+0000","last_became_peered":"2024-02-10T08:16:52.789834+0000","last_unstale":"2024-02-10T08:34:29.051641+0000","last_undegraded":"2024-02-10T08:34:29.051641+0000","last_fullsized":"2024-02-10T08:34:29.051641+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:16.109957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:32:16.109957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"244'12","reported_seq":608,"reported_epoch":372,"state":"active+clean","last_fresh":"2024-02-10T08:34:31.212770+0000","last_change":"2024-02-10T08:32:11.142599+0000","last_active":"2024-02-10T08:34:31.212770+0000","last_peered":"2024-02-10T08:34:31.212770+0000","last_clean":"2024-02-10T08:34:31.212770+0000","last_became_active":"2024-02-10T08:28:02.776097+0000","last_became_peered":"2024-02-10T08:28:02.776097+0000","last_unstale":"2024-02-10T08:34:31.212770+0000","last_undegraded":"2024-02-10T08:34:31.212770+0000","last_fullsized":"2024-02-10T08:34:31.212770+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"244'12","last_scrub_stamp":"2024-02-10T08:32:11.142513+0000","last_deep_scrub":"89'9","last_deep_scrub_stamp":"2024-02-10T08:19:33.299671+0000","last_clean_scrub_stamp":"2024-02-10T08:32:11.142513+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":47,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.061290+0000","last_change":"2024-02-10T08:33:07.663592+0000","last_active":"2024-02-10T08:34:29.061290+0000","last_peered":"2024-02-10T08:34:29.061290+0000","last_clean":"2024-02-10T08:34:29.061290+0000","last_became_active":"2024-02-10T08:32:36.983153+0000","last_became_peered":"2024-02-10T08:32:36.983153+0000","last_unstale":"2024-02-10T08:34:29.061290+0000","last_undegraded":"2024-02-10T08:34:29.061290+0000","last_fullsized":"2024-02-10T08:34:29.061290+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:07.663498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:05.662947+0000","last_clean_scrub_stamp":"2024-02-10T08:33:07.663498+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"225'19","reported_seq":377,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.051286+0000","last_change":"2024-02-10T08:33:18.984602+0000","last_active":"2024-02-10T08:34:29.051286+0000","last_peered":"2024-02-10T08:34:29.051286+0000","last_clean":"2024-02-10T08:34:29.051286+0000","last_became_active":"2024-02-10T08:16:55.204734+0000","last_became_peered":"2024-02-10T08:16:55.204734+0000","last_unstale":"2024-02-10T08:34:29.051286+0000","last_undegraded":"2024-02-10T08:34:29.051286+0000","last_fullsized":"2024-02-10T08:34:29.051286+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'19","last_scrub_stamp":"2024-02-10T08:33:18.984505+0000","last_deep_scrub":"213'13","last_deep_scrub_stamp":"2024-02-10T08:25:43.713333+0000","last_clean_scrub_stamp":"2024-02-10T08:33:18.984505+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":42,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.060278+0000","last_change":"2024-02-10T08:32:36.981055+0000","last_active":"2024-02-10T08:34:29.060278+0000","last_peered":"2024-02-10T08:34:29.060278+0000","last_clean":"2024-02-10T08:34:29.060278+0000","last_became_active":"2024-02-10T08:32:36.980715+0000","last_became_peered":"2024-02-10T08:32:36.980715+0000","last_unstale":"2024-02-10T08:34:29.060278+0000","last_undegraded":"2024-02-10T08:34:29.060278+0000","last_fullsized":"2024-02-10T08:34:29.060278+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:21.299448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:32:21.299448+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"314'11","reported_seq":444,"reported_epoch":372,"state":"active+clean","last_fresh":"2024-02-10T08:34:31.210580+0000","last_change":"2024-02-10T08:32:15.210339+0000","last_active":"2024-02-10T08:34:31.210580+0000","last_peered":"2024-02-10T08:34:31.210580+0000","last_clean":"2024-02-10T08:34:31.210580+0000","last_became_active":"2024-02-10T08:31:33.885840+0000","last_became_peered":"2024-02-10T08:31:33.885840+0000","last_unstale":"2024-02-10T08:34:31.210580+0000","last_undegraded":"2024-02-10T08:34:31.210580+0000","last_fullsized":"2024-02-10T08:34:31.210580+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"314'11","last_scrub_stamp":"2024-02-10T08:32:15.210224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:32:15.210224+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":326,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.050549+0000","last_change":"2024-02-10T08:32:12.342121+0000","last_active":"2024-02-10T08:34:29.050549+0000","last_peered":"2024-02-10T08:34:29.050549+0000","last_clean":"2024-02-10T08:34:29.050549+0000","last_became_active":"2024-02-10T08:20:46.395788+0000","last_became_peered":"2024-02-10T08:20:46.395788+0000","last_unstale":"2024-02-10T08:34:29.050549+0000","last_undegraded":"2024-02-10T08:34:29.050549+0000","last_fullsized":"2024-02-10T08:34:29.050549+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:12.342020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:32:12.342020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"225'15","reported_seq":352,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.062595+0000","last_change":"2024-02-10T08:32:13.529400+0000","last_active":"2024-02-10T08:34:29.062595+0000","last_peered":"2024-02-10T08:34:29.062595+0000","last_clean":"2024-02-10T08:34:29.062595+0000","last_became_active":"2024-02-10T08:28:25.952354+0000","last_became_peered":"2024-02-10T08:28:25.952354+0000","last_unstale":"2024-02-10T08:34:29.062595+0000","last_undegraded":"2024-02-10T08:34:29.062595+0000","last_fullsized":"2024-02-10T08:34:29.062595+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'15","last_scrub_stamp":"2024-02-10T08:32:13.529289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:32:13.529289+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":357,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.063511+0000","last_change":"2024-02-10T08:33:16.205688+0000","last_active":"2024-02-10T08:34:29.063511+0000","last_peered":"2024-02-10T08:34:29.063511+0000","last_clean":"2024-02-10T08:34:29.063511+0000","last_became_active":"2024-02-10T08:16:52.786213+0000","last_became_peered":"2024-02-10T08:16:52.786213+0000","last_unstale":"2024-02-10T08:34:29.063511+0000","last_undegraded":"2024-02-10T08:34:29.063511+0000","last_fullsized":"2024-02-10T08:34:29.063511+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:16.205603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:33:16.205603+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":179,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.061419+0000","last_change":"2024-02-10T08:33:28.822022+0000","last_active":"2024-02-10T08:34:29.061419+0000","last_peered":"2024-02-10T08:34:29.061419+0000","last_clean":"2024-02-10T08:34:29.061419+0000","last_became_active":"2024-02-10T08:28:25.950221+0000","last_became_peered":"2024-02-10T08:28:25.950221+0000","last_unstale":"2024-02-10T08:34:29.061419+0000","last_undegraded":"2024-02-10T08:34:29.061419+0000","last_fullsized":"2024-02-10T08:34:29.061419+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:28.821928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:33:28.821928+0000","last_clean_scrub_stamp":"2024-02-10T08:33:28.821928+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":185,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.059970+0000","last_change":"2024-02-10T08:33:22.771214+0000","last_active":"2024-02-10T08:34:29.059970+0000","last_peered":"2024-02-10T08:34:29.059970+0000","last_clean":"2024-02-10T08:34:29.059970+0000","last_became_active":"2024-02-10T08:30:24.070440+0000","last_became_peered":"2024-02-10T08:30:24.070440+0000","last_unstale":"2024-02-10T08:34:29.059970+0000","last_undegraded":"2024-02-10T08:34:29.059970+0000","last_fullsized":"2024-02-10T08:34:29.059970+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:22.771132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:33:22.771132+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"225'24","reported_seq":385,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.050034+0000","last_change":"2024-02-10T08:33:06.269127+0000","last_active":"2024-02-10T08:34:29.050034+0000","last_peered":"2024-02-10T08:34:29.050034+0000","last_clean":"2024-02-10T08:34:29.050034+0000","last_became_active":"2024-02-10T08:20:46.396130+0000","last_became_peered":"2024-02-10T08:20:46.396130+0000","last_unstale":"2024-02-10T08:34:29.050034+0000","last_undegraded":"2024-02-10T08:34:29.050034+0000","last_fullsized":"2024-02-10T08:34:29.050034+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'24","last_scrub_stamp":"2024-02-10T08:33:06.269024+0000","last_deep_scrub":"201'16","last_deep_scrub_stamp":"2024-02-10T08:24:49.177357+0000","last_clean_scrub_stamp":"2024-02-10T08:33:06.269024+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":368,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.056520+0000","last_change":"2024-02-10T08:33:10.874200+0000","last_active":"2024-02-10T08:34:29.056520+0000","last_peered":"2024-02-10T08:34:29.056520+0000","last_clean":"2024-02-10T08:34:29.056520+0000","last_became_active":"2024-02-10T08:32:36.974379+0000","last_became_peered":"2024-02-10T08:32:36.974379+0000","last_unstale":"2024-02-10T08:34:29.056520+0000","last_undegraded":"2024-02-10T08:34:29.056520+0000","last_fullsized":"2024-02-10T08:34:29.056520+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:10.874017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:33:10.874017+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":362,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.055794+0000","last_change":"2024-02-10T08:33:06.791408+0000","last_active":"2024-02-10T08:34:29.055794+0000","last_peered":"2024-02-10T08:34:29.055794+0000","last_clean":"2024-02-10T08:34:29.055794+0000","last_became_active":"2024-02-10T08:31:33.893973+0000","last_became_peered":"2024-02-10T08:31:33.893973+0000","last_unstale":"2024-02-10T08:34:29.055794+0000","last_undegraded":"2024-02-10T08:34:29.055794+0000","last_fullsized":"2024-02-10T08:34:29.055794+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:06.791295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:33:06.791295+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":47,"reported_epoch":372,"state":"active+clean","last_fresh":"2024-02-10T08:34:38.015567+0000","last_change":"2024-02-10T08:34:38.015567+0000","last_active":"2024-02-10T08:34:38.015567+0000","last_peered":"2024-02-10T08:34:38.015567+0000","last_clean":"2024-02-10T08:34:38.015567+0000","last_became_active":"2024-02-10T08:32:36.979093+0000","last_became_peered":"2024-02-10T08:32:36.979093+0000","last_unstale":"2024-02-10T08:34:38.015567+0000","last_undegraded":"2024-02-10T08:34:38.015567+0000","last_fullsized":"2024-02-10T08:34:38.015567+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:38.015515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:34:38.015515+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,5],"acting":[0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"225'8","reported_seq":275,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.053395+0000","last_change":"2024-02-10T08:32:15.627778+0000","last_active":"2024-02-10T08:34:29.053395+0000","last_peered":"2024-02-10T08:34:29.053395+0000","last_clean":"2024-02-10T08:34:29.053395+0000","last_became_active":"2024-02-10T08:22:23.522936+0000","last_became_peered":"2024-02-10T08:22:23.522936+0000","last_unstale":"2024-02-10T08:34:29.053395+0000","last_undegraded":"2024-02-10T08:34:29.053395+0000","last_fullsized":"2024-02-10T08:34:29.053395+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'8","last_scrub_stamp":"2024-02-10T08:32:15.627709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:32:15.627709+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,6],"acting":[1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":355,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.052425+0000","last_change":"2024-02-10T08:33:22.025841+0000","last_active":"2024-02-10T08:34:29.052425+0000","last_peered":"2024-02-10T08:34:29.052425+0000","last_clean":"2024-02-10T08:34:29.052425+0000","last_became_active":"2024-02-10T08:16:52.788704+0000","last_became_peered":"2024-02-10T08:16:52.788704+0000","last_unstale":"2024-02-10T08:34:29.052425+0000","last_undegraded":"2024-02-10T08:34:29.052425+0000","last_fullsized":"2024-02-10T08:34:29.052425+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:22.025769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:33:22.025769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":356,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.056132+0000","last_change":"2024-02-10T08:32:27.229239+0000","last_active":"2024-02-10T08:34:29.056132+0000","last_peered":"2024-02-10T08:34:29.056132+0000","last_clean":"2024-02-10T08:34:29.056132+0000","last_became_active":"2024-02-10T08:20:46.397495+0000","last_became_peered":"2024-02-10T08:20:46.397495+0000","last_unstale":"2024-02-10T08:34:29.056132+0000","last_undegraded":"2024-02-10T08:34:29.056132+0000","last_fullsized":"2024-02-10T08:34:29.056132+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:27.229143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:32:27.229143+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":363,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.058533+0000","last_change":"2024-02-10T08:30:24.064805+0000","last_active":"2024-02-10T08:34:29.058533+0000","last_peered":"2024-02-10T08:34:29.058533+0000","last_clean":"2024-02-10T08:34:29.058533+0000","last_became_active":"2024-02-10T08:30:24.064419+0000","last_became_peered":"2024-02-10T08:30:24.064419+0000","last_unstale":"2024-02-10T08:34:29.058533+0000","last_undegraded":"2024-02-10T08:34:29.058533+0000","last_fullsized":"2024-02-10T08:34:29.058533+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:12.421034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:27.276490+0000","last_clean_scrub_stamp":"2024-02-10T08:29:12.421034+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"225'19","reported_seq":294,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.060329+0000","last_change":"2024-02-10T08:29:22.312103+0000","last_active":"2024-02-10T08:34:29.060329+0000","last_peered":"2024-02-10T08:34:29.060329+0000","last_clean":"2024-02-10T08:34:29.060329+0000","last_became_active":"2024-02-10T08:22:23.526198+0000","last_became_peered":"2024-02-10T08:22:23.526198+0000","last_unstale":"2024-02-10T08:34:29.060329+0000","last_undegraded":"2024-02-10T08:34:29.060329+0000","last_fullsized":"2024-02-10T08:34:29.060329+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'19","last_scrub_stamp":"2024-02-10T08:29:22.312001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:29:22.312001+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":24,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":350,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.063863+0000","last_change":"2024-02-10T08:32:30.241685+0000","last_active":"2024-02-10T08:34:29.063863+0000","last_peered":"2024-02-10T08:34:29.063863+0000","last_clean":"2024-02-10T08:34:29.063863+0000","last_became_active":"2024-02-10T08:16:52.788629+0000","last_became_peered":"2024-02-10T08:16:52.788629+0000","last_unstale":"2024-02-10T08:34:29.063863+0000","last_undegraded":"2024-02-10T08:34:29.063863+0000","last_fullsized":"2024-02-10T08:34:29.063863+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:30.241592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:38.360929+0000","last_clean_scrub_stamp":"2024-02-10T08:32:30.241592+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":361,"reported_epoch":372,"state":"active+clean","last_fresh":"2024-02-10T08:34:37.281857+0000","last_change":"2024-02-10T08:34:37.281857+0000","last_active":"2024-02-10T08:34:37.281857+0000","last_peered":"2024-02-10T08:34:37.281857+0000","last_clean":"2024-02-10T08:34:37.281857+0000","last_became_active":"2024-02-10T08:20:46.399838+0000","last_became_peered":"2024-02-10T08:20:46.399838+0000","last_unstale":"2024-02-10T08:34:37.281857+0000","last_undegraded":"2024-02-10T08:34:37.281857+0000","last_fullsized":"2024-02-10T08:34:37.281857+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:37.281763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:34:37.281763+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":47,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:30.191937+0000","last_change":"2024-02-10T08:34:30.191894+0000","last_active":"2024-02-10T08:34:30.191937+0000","last_peered":"2024-02-10T08:34:30.191937+0000","last_clean":"2024-02-10T08:34:30.191937+0000","last_became_active":"2024-02-10T08:32:36.982778+0000","last_became_peered":"2024-02-10T08:32:36.982778+0000","last_unstale":"2024-02-10T08:34:30.191937+0000","last_undegraded":"2024-02-10T08:34:30.191937+0000","last_fullsized":"2024-02-10T08:34:30.191937+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:30.191790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:34:30.191790+0000","last_clean_scrub_stamp":"2024-02-10T08:34:30.191790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"225'25","reported_seq":456,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.061916+0000","last_change":"2024-02-10T08:32:32.566504+0000","last_active":"2024-02-10T08:34:29.061916+0000","last_peered":"2024-02-10T08:34:29.061916+0000","last_clean":"2024-02-10T08:34:29.061916+0000","last_became_active":"2024-02-10T08:31:33.879680+0000","last_became_peered":"2024-02-10T08:31:33.879680+0000","last_unstale":"2024-02-10T08:34:29.061916+0000","last_undegraded":"2024-02-10T08:34:29.061916+0000","last_fullsized":"2024-02-10T08:34:29.061916+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'25","last_scrub_stamp":"2024-02-10T08:32:32.566437+0000","last_deep_scrub":"74'15","last_deep_scrub_stamp":"2024-02-10T08:17:57.637346+0000","last_clean_scrub_stamp":"2024-02-10T08:32:32.566437+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":24,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":360,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.050858+0000","last_change":"2024-02-10T08:29:26.072110+0000","last_active":"2024-02-10T08:34:29.050858+0000","last_peered":"2024-02-10T08:34:29.050858+0000","last_clean":"2024-02-10T08:34:29.050858+0000","last_became_active":"2024-02-10T08:20:46.392466+0000","last_became_peered":"2024-02-10T08:20:46.392466+0000","last_unstale":"2024-02-10T08:34:29.050858+0000","last_undegraded":"2024-02-10T08:34:29.050858+0000","last_fullsized":"2024-02-10T08:34:29.050858+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:26.072031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:29:26.072031+0000","last_clean_scrub_stamp":"2024-02-10T08:29:26.072031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1f","version":"111'11","reported_seq":591,"reported_epoch":372,"state":"active+clean","last_fresh":"2024-02-10T08:34:31.213012+0000","last_change":"2024-02-10T08:34:26.020988+0000","last_active":"2024-02-10T08:34:31.213012+0000","last_peered":"2024-02-10T08:34:31.213012+0000","last_clean":"2024-02-10T08:34:31.213012+0000","last_became_active":"2024-02-10T08:20:46.402663+0000","last_became_peered":"2024-02-10T08:20:46.402663+0000","last_unstale":"2024-02-10T08:34:31.213012+0000","last_undegraded":"2024-02-10T08:34:31.213012+0000","last_fullsized":"2024-02-10T08:34:31.213012+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'11","last_scrub_stamp":"2024-02-10T08:34:26.020887+0000","last_deep_scrub":"111'11","last_deep_scrub_stamp":"2024-02-10T08:32:17.249718+0000","last_clean_scrub_stamp":"2024-02-10T08:34:26.020887+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"87'2","reported_seq":346,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.059815+0000","last_change":"2024-02-10T08:33:29.353243+0000","last_active":"2024-02-10T08:34:29.059815+0000","last_peered":"2024-02-10T08:34:29.059815+0000","last_clean":"2024-02-10T08:34:29.059815+0000","last_became_active":"2024-02-10T08:16:58.859047+0000","last_became_peered":"2024-02-10T08:16:58.859047+0000","last_unstale":"2024-02-10T08:34:29.059815+0000","last_undegraded":"2024-02-10T08:34:29.059815+0000","last_fullsized":"2024-02-10T08:34:29.059815+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'2","last_scrub_stamp":"2024-02-10T08:33:29.353122+0000","last_deep_scrub":"87'2","last_deep_scrub_stamp":"2024-02-10T08:19:29.207531+0000","last_clean_scrub_stamp":"2024-02-10T08:33:29.353122+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"225'19","reported_seq":382,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.067449+0000","last_change":"2024-02-10T08:33:12.217164+0000","last_active":"2024-02-10T08:34:29.067449+0000","last_peered":"2024-02-10T08:34:29.067449+0000","last_clean":"2024-02-10T08:34:29.067449+0000","last_became_active":"2024-02-10T08:16:54.852665+0000","last_became_peered":"2024-02-10T08:16:54.852665+0000","last_unstale":"2024-02-10T08:34:29.067449+0000","last_undegraded":"2024-02-10T08:34:29.067449+0000","last_fullsized":"2024-02-10T08:34:29.067449+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'19","last_scrub_stamp":"2024-02-10T08:33:12.217009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:33:12.217009+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":292,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.056029+0000","last_change":"2024-02-10T08:34:11.022449+0000","last_active":"2024-02-10T08:34:29.056029+0000","last_peered":"2024-02-10T08:34:29.056029+0000","last_clean":"2024-02-10T08:34:29.056029+0000","last_became_active":"2024-02-10T08:31:33.878473+0000","last_became_peered":"2024-02-10T08:31:33.878473+0000","last_unstale":"2024-02-10T08:34:29.056029+0000","last_undegraded":"2024-02-10T08:34:29.056029+0000","last_fullsized":"2024-02-10T08:34:29.056029+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:11.022357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:25:42.124914+0000","last_clean_scrub_stamp":"2024-02-10T08:34:11.022357+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":176,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.061968+0000","last_change":"2024-02-10T08:32:26.589167+0000","last_active":"2024-02-10T08:34:29.061968+0000","last_peered":"2024-02-10T08:34:29.061968+0000","last_clean":"2024-02-10T08:34:29.061968+0000","last_became_active":"2024-02-10T08:28:25.951312+0000","last_became_peered":"2024-02-10T08:28:25.951312+0000","last_unstale":"2024-02-10T08:34:29.061968+0000","last_undegraded":"2024-02-10T08:34:29.061968+0000","last_fullsized":"2024-02-10T08:34:29.061968+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:26.589082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:32:26.589082+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":355,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.056329+0000","last_change":"2024-02-10T08:34:10.742336+0000","last_active":"2024-02-10T08:34:29.056329+0000","last_peered":"2024-02-10T08:34:29.056329+0000","last_clean":"2024-02-10T08:34:29.056329+0000","last_became_active":"2024-02-10T08:20:46.408504+0000","last_became_peered":"2024-02-10T08:20:46.408504+0000","last_unstale":"2024-02-10T08:34:29.056329+0000","last_undegraded":"2024-02-10T08:34:29.056329+0000","last_fullsized":"2024-02-10T08:34:29.056329+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:10.742154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:22.104988+0000","last_clean_scrub_stamp":"2024-02-10T08:34:10.742154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"330'34","reported_seq":454,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.063255+0000","last_change":"2024-02-10T08:34:10.804210+0000","last_active":"2024-02-10T08:34:29.063255+0000","last_peered":"2024-02-10T08:34:29.063255+0000","last_clean":"2024-02-10T08:34:29.063255+0000","last_became_active":"2024-02-10T08:31:33.894960+0000","last_became_peered":"2024-02-10T08:31:33.894960+0000","last_unstale":"2024-02-10T08:34:29.063255+0000","last_undegraded":"2024-02-10T08:34:29.063255+0000","last_fullsized":"2024-02-10T08:34:29.063255+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"330'34","last_scrub_stamp":"2024-02-10T08:34:10.804112+0000","last_deep_scrub":"330'34","last_deep_scrub_stamp":"2024-02-10T08:32:17.481832+0000","last_clean_scrub_stamp":"2024-02-10T08:34:10.804112+0000","log_size":34,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":365,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.062533+0000","last_change":"2024-02-10T08:33:13.175633+0000","last_active":"2024-02-10T08:34:29.062533+0000","last_peered":"2024-02-10T08:34:29.062533+0000","last_clean":"2024-02-10T08:34:29.062533+0000","last_became_active":"2024-02-10T08:20:46.396303+0000","last_became_peered":"2024-02-10T08:20:46.396303+0000","last_unstale":"2024-02-10T08:34:29.062533+0000","last_undegraded":"2024-02-10T08:34:29.062533+0000","last_fullsized":"2024-02-10T08:34:29.062533+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:13.175559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:10.370746+0000","last_clean_scrub_stamp":"2024-02-10T08:33:13.175559+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":375,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.056730+0000","last_change":"2024-02-10T08:34:20.720576+0000","last_active":"2024-02-10T08:34:29.056730+0000","last_peered":"2024-02-10T08:34:29.056730+0000","last_clean":"2024-02-10T08:34:29.056730+0000","last_became_active":"2024-02-10T08:28:02.763523+0000","last_became_peered":"2024-02-10T08:28:02.763523+0000","last_unstale":"2024-02-10T08:34:29.056730+0000","last_undegraded":"2024-02-10T08:34:29.056730+0000","last_fullsized":"2024-02-10T08:34:29.056730+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:20.719812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:34:20.719812+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":323,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.053562+0000","last_change":"2024-02-10T08:33:19.356128+0000","last_active":"2024-02-10T08:34:29.053562+0000","last_peered":"2024-02-10T08:34:29.053562+0000","last_clean":"2024-02-10T08:34:29.053562+0000","last_became_active":"2024-02-10T08:20:46.403378+0000","last_became_peered":"2024-02-10T08:20:46.403378+0000","last_unstale":"2024-02-10T08:34:29.053562+0000","last_undegraded":"2024-02-10T08:34:29.053562+0000","last_fullsized":"2024-02-10T08:34:29.053562+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:19.356038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:33:19.356038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"226'23","reported_seq":357,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.056661+0000","last_change":"2024-02-10T08:33:31.665259+0000","last_active":"2024-02-10T08:34:29.056661+0000","last_peered":"2024-02-10T08:34:29.056661+0000","last_clean":"2024-02-10T08:34:29.056661+0000","last_became_active":"2024-02-10T08:31:33.891562+0000","last_became_peered":"2024-02-10T08:31:33.891562+0000","last_unstale":"2024-02-10T08:34:29.056661+0000","last_undegraded":"2024-02-10T08:34:29.056661+0000","last_fullsized":"2024-02-10T08:34:29.056661+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"226'23","last_scrub_stamp":"2024-02-10T08:33:31.665189+0000","last_deep_scrub":"226'23","last_deep_scrub_stamp":"2024-02-10T08:33:31.665189+0000","last_clean_scrub_stamp":"2024-02-10T08:33:31.665189+0000","log_size":23,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":25,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":269,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.058946+0000","last_change":"2024-02-10T08:32:22.275761+0000","last_active":"2024-02-10T08:34:29.058946+0000","last_peered":"2024-02-10T08:34:29.058946+0000","last_clean":"2024-02-10T08:34:29.058946+0000","last_became_active":"2024-02-10T08:31:33.879918+0000","last_became_peered":"2024-02-10T08:31:33.879918+0000","last_unstale":"2024-02-10T08:34:29.058946+0000","last_undegraded":"2024-02-10T08:34:29.058946+0000","last_fullsized":"2024-02-10T08:34:29.058946+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:22.275679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:32:22.275679+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":320,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.051271+0000","last_change":"2024-02-10T08:32:17.352870+0000","last_active":"2024-02-10T08:34:29.051271+0000","last_peered":"2024-02-10T08:34:29.051271+0000","last_clean":"2024-02-10T08:34:29.051271+0000","last_became_active":"2024-02-10T08:20:46.398532+0000","last_became_peered":"2024-02-10T08:20:46.398532+0000","last_unstale":"2024-02-10T08:34:29.051271+0000","last_undegraded":"2024-02-10T08:34:29.051271+0000","last_fullsized":"2024-02-10T08:34:29.051271+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:17.352797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:32:17.352797+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":261,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.067572+0000","last_change":"2024-02-10T08:34:27.097346+0000","last_active":"2024-02-10T08:34:29.067572+0000","last_peered":"2024-02-10T08:34:29.067572+0000","last_clean":"2024-02-10T08:34:29.067572+0000","last_became_active":"2024-02-10T08:22:23.526229+0000","last_became_peered":"2024-02-10T08:22:23.526229+0000","last_unstale":"2024-02-10T08:34:29.067572+0000","last_undegraded":"2024-02-10T08:34:29.067572+0000","last_fullsized":"2024-02-10T08:34:29.067572+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:27.097266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:34:27.097266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1a","version":"225'15","reported_seq":79,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.050310+0000","last_change":"2024-02-10T08:34:25.085877+0000","last_active":"2024-02-10T08:34:29.050310+0000","last_peered":"2024-02-10T08:34:29.050310+0000","last_clean":"2024-02-10T08:34:29.050310+0000","last_became_active":"2024-02-10T08:31:46.069680+0000","last_became_peered":"2024-02-10T08:31:46.069680+0000","last_unstale":"2024-02-10T08:34:29.050310+0000","last_undegraded":"2024-02-10T08:34:29.050310+0000","last_fullsized":"2024-02-10T08:34:29.050310+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'15","last_scrub_stamp":"2024-02-10T08:34:25.085814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:34:25.085814+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":345,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.059508+0000","last_change":"2024-02-10T08:29:26.213501+0000","last_active":"2024-02-10T08:34:29.059508+0000","last_peered":"2024-02-10T08:34:29.059508+0000","last_clean":"2024-02-10T08:34:29.059508+0000","last_became_active":"2024-02-10T08:16:52.787865+0000","last_became_peered":"2024-02-10T08:16:52.787865+0000","last_unstale":"2024-02-10T08:34:29.059508+0000","last_undegraded":"2024-02-10T08:34:29.059508+0000","last_fullsized":"2024-02-10T08:34:29.059508+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:26.213417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:28.028556+0000","last_clean_scrub_stamp":"2024-02-10T08:29:26.213417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":373,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.052956+0000","last_change":"2024-02-10T08:29:22.172003+0000","last_active":"2024-02-10T08:34:29.052956+0000","last_peered":"2024-02-10T08:34:29.052956+0000","last_clean":"2024-02-10T08:34:29.052956+0000","last_became_active":"2024-02-10T08:28:19.065132+0000","last_became_peered":"2024-02-10T08:28:19.065132+0000","last_unstale":"2024-02-10T08:34:29.052956+0000","last_undegraded":"2024-02-10T08:34:29.052956+0000","last_fullsized":"2024-02-10T08:34:29.052956+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:22.171906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:29:22.171906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,7],"acting":[5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":47,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.059845+0000","last_change":"2024-02-10T08:33:08.700632+0000","last_active":"2024-02-10T08:34:29.059845+0000","last_peered":"2024-02-10T08:34:29.059845+0000","last_clean":"2024-02-10T08:34:29.059845+0000","last_became_active":"2024-02-10T08:32:36.978752+0000","last_became_peered":"2024-02-10T08:32:36.978752+0000","last_unstale":"2024-02-10T08:34:29.059845+0000","last_undegraded":"2024-02-10T08:34:29.059845+0000","last_fullsized":"2024-02-10T08:34:29.059845+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:08.700527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:33:08.700527+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"225'7","reported_seq":374,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.050176+0000","last_change":"2024-02-10T08:32:22.340287+0000","last_active":"2024-02-10T08:34:29.050176+0000","last_peered":"2024-02-10T08:34:29.050176+0000","last_clean":"2024-02-10T08:34:29.050176+0000","last_became_active":"2024-02-10T08:27:27.715306+0000","last_became_peered":"2024-02-10T08:27:27.715306+0000","last_unstale":"2024-02-10T08:34:29.050176+0000","last_undegraded":"2024-02-10T08:34:29.050176+0000","last_fullsized":"2024-02-10T08:34:29.050176+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'7","last_scrub_stamp":"2024-02-10T08:32:22.340191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:32:22.340191+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":9,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"55'1","reported_seq":378,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.059279+0000","last_change":"2024-02-10T08:33:06.363742+0000","last_active":"2024-02-10T08:34:29.059279+0000","last_peered":"2024-02-10T08:34:29.059279+0000","last_clean":"2024-02-10T08:34:29.059279+0000","last_became_active":"2024-02-10T08:28:02.761299+0000","last_became_peered":"2024-02-10T08:28:02.761299+0000","last_unstale":"2024-02-10T08:34:29.059279+0000","last_undegraded":"2024-02-10T08:34:29.059279+0000","last_fullsized":"2024-02-10T08:34:29.059279+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'1","last_scrub_stamp":"2024-02-10T08:33:06.363627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:33:06.363627+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1746,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":361,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.058396+0000","last_change":"2024-02-10T08:34:12.333244+0000","last_active":"2024-02-10T08:34:29.058396+0000","last_peered":"2024-02-10T08:34:29.058396+0000","last_clean":"2024-02-10T08:34:29.058396+0000","last_became_active":"2024-02-10T08:20:46.406783+0000","last_became_peered":"2024-02-10T08:20:46.406783+0000","last_unstale":"2024-02-10T08:34:29.058396+0000","last_undegraded":"2024-02-10T08:34:29.058396+0000","last_fullsized":"2024-02-10T08:34:29.058396+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:12.333167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:34:12.333167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":362,"reported_epoch":372,"state":"active+clean","last_fresh":"2024-02-10T08:34:34.307258+0000","last_change":"2024-02-10T08:34:34.307258+0000","last_active":"2024-02-10T08:34:34.307258+0000","last_peered":"2024-02-10T08:34:34.307258+0000","last_clean":"2024-02-10T08:34:34.307258+0000","last_became_active":"2024-02-10T08:31:33.886617+0000","last_became_peered":"2024-02-10T08:31:33.886617+0000","last_unstale":"2024-02-10T08:34:34.307258+0000","last_undegraded":"2024-02-10T08:34:34.307258+0000","last_fullsized":"2024-02-10T08:34:34.307258+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:34.307158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:34:34.307158+0000","last_clean_scrub_stamp":"2024-02-10T08:34:34.307158+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"358'19","reported_seq":351,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.049978+0000","last_change":"2024-02-10T08:33:34.450999+0000","last_active":"2024-02-10T08:34:29.049978+0000","last_peered":"2024-02-10T08:34:29.049978+0000","last_clean":"2024-02-10T08:34:29.049978+0000","last_became_active":"2024-02-10T08:20:46.404966+0000","last_became_peered":"2024-02-10T08:20:46.404966+0000","last_unstale":"2024-02-10T08:34:29.049978+0000","last_undegraded":"2024-02-10T08:34:29.049978+0000","last_fullsized":"2024-02-10T08:34:29.049978+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"358'19","last_scrub_stamp":"2024-02-10T08:33:34.450897+0000","last_deep_scrub":"358'19","last_deep_scrub_stamp":"2024-02-10T08:33:34.450897+0000","last_clean_scrub_stamp":"2024-02-10T08:33:34.450897+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":42,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.062002+0000","last_change":"2024-02-10T08:32:36.983082+0000","last_active":"2024-02-10T08:34:29.062002+0000","last_peered":"2024-02-10T08:34:29.062002+0000","last_clean":"2024-02-10T08:34:29.062002+0000","last_became_active":"2024-02-10T08:32:36.982675+0000","last_became_peered":"2024-02-10T08:32:36.982675+0000","last_unstale":"2024-02-10T08:34:29.062002+0000","last_undegraded":"2024-02-10T08:34:29.062002+0000","last_fullsized":"2024-02-10T08:34:29.062002+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:14.084352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:32:14.084352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,5],"acting":[0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":342,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.052357+0000","last_change":"2024-02-10T08:33:08.870508+0000","last_active":"2024-02-10T08:34:29.052357+0000","last_peered":"2024-02-10T08:34:29.052357+0000","last_clean":"2024-02-10T08:34:29.052357+0000","last_became_active":"2024-02-10T08:16:56.863353+0000","last_became_peered":"2024-02-10T08:16:56.863353+0000","last_unstale":"2024-02-10T08:34:29.052357+0000","last_undegraded":"2024-02-10T08:34:29.052357+0000","last_fullsized":"2024-02-10T08:34:29.052357+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:08.870342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:33:08.870342+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":322,"reported_epoch":372,"state":"active+clean","last_fresh":"2024-02-10T08:34:34.935044+0000","last_change":"2024-02-10T08:34:34.946684+0000","last_active":"2024-02-10T08:34:34.935044+0000","last_peered":"2024-02-10T08:34:34.935044+0000","last_clean":"2024-02-10T08:34:34.935044+0000","last_became_active":"2024-02-10T08:20:46.405314+0000","last_became_peered":"2024-02-10T08:20:46.405314+0000","last_unstale":"2024-02-10T08:34:34.935044+0000","last_undegraded":"2024-02-10T08:34:34.935044+0000","last_fullsized":"2024-02-10T08:34:34.935044+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:25.024412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:29:25.024412+0000","last_clean_scrub_stamp":"2024-02-10T08:29:25.024412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"225'27","reported_seq":411,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.059551+0000","last_change":"2024-02-10T08:33:09.659351+0000","last_active":"2024-02-10T08:34:29.059551+0000","last_peered":"2024-02-10T08:34:29.059551+0000","last_clean":"2024-02-10T08:34:29.059551+0000","last_became_active":"2024-02-10T08:31:33.883535+0000","last_became_peered":"2024-02-10T08:31:33.883535+0000","last_unstale":"2024-02-10T08:34:29.059551+0000","last_undegraded":"2024-02-10T08:34:29.059551+0000","last_fullsized":"2024-02-10T08:34:29.059551+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'27","last_scrub_stamp":"2024-02-10T08:33:09.659240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:33:09.659240+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":47,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.060596+0000","last_change":"2024-02-10T08:33:10.725696+0000","last_active":"2024-02-10T08:34:29.060596+0000","last_peered":"2024-02-10T08:34:29.060596+0000","last_clean":"2024-02-10T08:34:29.060596+0000","last_became_active":"2024-02-10T08:32:36.977972+0000","last_became_peered":"2024-02-10T08:32:36.977972+0000","last_unstale":"2024-02-10T08:34:29.060596+0000","last_undegraded":"2024-02-10T08:34:29.060596+0000","last_fullsized":"2024-02-10T08:34:29.060596+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:10.725600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:33:10.725600+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":69,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.049899+0000","last_change":"2024-02-10T08:33:23.437506+0000","last_active":"2024-02-10T08:34:29.049899+0000","last_peered":"2024-02-10T08:34:29.049899+0000","last_clean":"2024-02-10T08:34:29.049899+0000","last_became_active":"2024-02-10T08:31:46.057858+0000","last_became_peered":"2024-02-10T08:31:46.057858+0000","last_unstale":"2024-02-10T08:34:29.049899+0000","last_undegraded":"2024-02-10T08:34:29.049899+0000","last_fullsized":"2024-02-10T08:34:29.049899+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:23.437405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:33:23.437405+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":269,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.058710+0000","last_change":"2024-02-10T08:31:33.880687+0000","last_active":"2024-02-10T08:34:29.058710+0000","last_peered":"2024-02-10T08:34:29.058710+0000","last_clean":"2024-02-10T08:34:29.058710+0000","last_became_active":"2024-02-10T08:31:33.880328+0000","last_became_peered":"2024-02-10T08:31:33.880328+0000","last_unstale":"2024-02-10T08:34:29.058710+0000","last_undegraded":"2024-02-10T08:34:29.058710+0000","last_fullsized":"2024-02-10T08:34:29.058710+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:06.366305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:06.366305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":258,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.054074+0000","last_change":"2024-02-10T08:33:19.782701+0000","last_active":"2024-02-10T08:34:29.054074+0000","last_peered":"2024-02-10T08:34:29.054074+0000","last_clean":"2024-02-10T08:34:29.054074+0000","last_became_active":"2024-02-10T08:22:00.581772+0000","last_became_peered":"2024-02-10T08:22:00.581772+0000","last_unstale":"2024-02-10T08:34:29.054074+0000","last_undegraded":"2024-02-10T08:34:29.054074+0000","last_fullsized":"2024-02-10T08:34:29.054074+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:19.782523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:33:19.782523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,7],"acting":[1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":276,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.059909+0000","last_change":"2024-02-10T08:33:10.338393+0000","last_active":"2024-02-10T08:34:29.059909+0000","last_peered":"2024-02-10T08:34:29.059909+0000","last_clean":"2024-02-10T08:34:29.059909+0000","last_became_active":"2024-02-10T08:31:46.054713+0000","last_became_peered":"2024-02-10T08:31:46.054713+0000","last_unstale":"2024-02-10T08:34:29.059909+0000","last_undegraded":"2024-02-10T08:34:29.059909+0000","last_fullsized":"2024-02-10T08:34:29.059909+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:10.338257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:33:10.338257+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":265,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.062264+0000","last_change":"2024-02-10T08:34:21.117300+0000","last_active":"2024-02-10T08:34:29.062264+0000","last_peered":"2024-02-10T08:34:29.062264+0000","last_clean":"2024-02-10T08:34:29.062264+0000","last_became_active":"2024-02-10T08:22:00.600200+0000","last_became_peered":"2024-02-10T08:22:00.600200+0000","last_unstale":"2024-02-10T08:34:29.062264+0000","last_undegraded":"2024-02-10T08:34:29.062264+0000","last_fullsized":"2024-02-10T08:34:29.062264+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:21.117198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:34:21.117198+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1],"acting":[6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":247,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.060505+0000","last_change":"2024-02-10T08:33:24.802823+0000","last_active":"2024-02-10T08:34:29.060505+0000","last_peered":"2024-02-10T08:34:29.060505+0000","last_clean":"2024-02-10T08:34:29.060505+0000","last_became_active":"2024-02-10T08:28:25.999335+0000","last_became_peered":"2024-02-10T08:28:25.999335+0000","last_unstale":"2024-02-10T08:34:29.060505+0000","last_undegraded":"2024-02-10T08:34:29.060505+0000","last_fullsized":"2024-02-10T08:34:29.060505+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:24.802724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:33:24.802724+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":372,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.051017+0000","last_change":"2024-02-10T08:33:24.018372+0000","last_active":"2024-02-10T08:34:29.051017+0000","last_peered":"2024-02-10T08:34:29.051017+0000","last_clean":"2024-02-10T08:34:29.051017+0000","last_became_active":"2024-02-10T08:31:33.879440+0000","last_became_peered":"2024-02-10T08:31:33.879440+0000","last_unstale":"2024-02-10T08:34:29.051017+0000","last_undegraded":"2024-02-10T08:34:29.051017+0000","last_fullsized":"2024-02-10T08:34:29.051017+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:24.018273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:33:24.018273+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":373,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.063785+0000","last_change":"2024-02-10T08:33:25.314878+0000","last_active":"2024-02-10T08:34:29.063785+0000","last_peered":"2024-02-10T08:34:29.063785+0000","last_clean":"2024-02-10T08:34:29.063785+0000","last_became_active":"2024-02-10T08:27:27.710587+0000","last_became_peered":"2024-02-10T08:27:27.710587+0000","last_unstale":"2024-02-10T08:34:29.063785+0000","last_undegraded":"2024-02-10T08:34:29.063785+0000","last_fullsized":"2024-02-10T08:34:29.063785+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:25.314779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:11.750537+0000","last_clean_scrub_stamp":"2024-02-10T08:33:25.314779+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,1],"acting":[6,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":276,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.056893+0000","last_change":"2024-02-10T08:33:30.688162+0000","last_active":"2024-02-10T08:34:29.056893+0000","last_peered":"2024-02-10T08:34:29.056893+0000","last_clean":"2024-02-10T08:34:29.056893+0000","last_became_active":"2024-02-10T08:32:36.974142+0000","last_became_peered":"2024-02-10T08:32:36.974142+0000","last_unstale":"2024-02-10T08:34:29.056893+0000","last_undegraded":"2024-02-10T08:34:29.056893+0000","last_fullsized":"2024-02-10T08:34:29.056893+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:30.688056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:33:30.688056+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":281,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.063476+0000","last_change":"2024-02-10T08:34:22.176269+0000","last_active":"2024-02-10T08:34:29.063476+0000","last_peered":"2024-02-10T08:34:29.063476+0000","last_clean":"2024-02-10T08:34:29.063476+0000","last_became_active":"2024-02-10T08:32:36.979412+0000","last_became_peered":"2024-02-10T08:32:36.979412+0000","last_unstale":"2024-02-10T08:34:29.063476+0000","last_undegraded":"2024-02-10T08:34:29.063476+0000","last_fullsized":"2024-02-10T08:34:29.063476+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:22.176191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:34:22.176191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1],"acting":[6,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":353,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.059641+0000","last_change":"2024-02-10T08:34:19.933437+0000","last_active":"2024-02-10T08:34:29.059641+0000","last_peered":"2024-02-10T08:34:29.059641+0000","last_clean":"2024-02-10T08:34:29.059641+0000","last_became_active":"2024-02-10T08:22:00.578118+0000","last_became_peered":"2024-02-10T08:22:00.578118+0000","last_unstale":"2024-02-10T08:34:29.059641+0000","last_undegraded":"2024-02-10T08:34:29.059641+0000","last_fullsized":"2024-02-10T08:34:29.059641+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:19.933309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:34:19.933309+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,6],"acting":[2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.29","version":"76'2","reported_seq":306,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.059987+0000","last_change":"2024-02-10T08:32:31.459909+0000","last_active":"2024-02-10T08:34:29.059987+0000","last_peered":"2024-02-10T08:34:29.059987+0000","last_clean":"2024-02-10T08:34:29.059987+0000","last_became_active":"2024-02-10T08:28:02.767822+0000","last_became_peered":"2024-02-10T08:28:02.767822+0000","last_unstale":"2024-02-10T08:34:29.059987+0000","last_undegraded":"2024-02-10T08:34:29.059987+0000","last_fullsized":"2024-02-10T08:34:29.059987+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":6,"last_scrub":"76'2","last_scrub_stamp":"2024-02-10T08:32:31.459851+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2024-02-10T08:18:08.680038+0000","last_clean_scrub_stamp":"2024-02-10T08:32:31.459851+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,0],"acting":[7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":73,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.050354+0000","last_change":"2024-02-10T08:32:36.975485+0000","last_active":"2024-02-10T08:34:29.050354+0000","last_peered":"2024-02-10T08:34:29.050354+0000","last_clean":"2024-02-10T08:34:29.050354+0000","last_became_active":"2024-02-10T08:32:36.975213+0000","last_became_peered":"2024-02-10T08:32:36.975213+0000","last_unstale":"2024-02-10T08:34:29.050354+0000","last_undegraded":"2024-02-10T08:34:29.050354+0000","last_fullsized":"2024-02-10T08:34:29.050354+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:30.227120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:20.392249+0000","last_clean_scrub_stamp":"2024-02-10T08:28:30.227120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0],"acting":[4,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":97,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.052735+0000","last_change":"2024-02-10T08:34:10.431223+0000","last_active":"2024-02-10T08:34:29.052735+0000","last_peered":"2024-02-10T08:34:29.052735+0000","last_clean":"2024-02-10T08:34:29.052735+0000","last_became_active":"2024-02-10T08:30:26.079913+0000","last_became_peered":"2024-02-10T08:30:26.079913+0000","last_unstale":"2024-02-10T08:34:29.052735+0000","last_undegraded":"2024-02-10T08:34:29.052735+0000","last_fullsized":"2024-02-10T08:34:29.052735+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:10.431134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:34:10.431134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":205,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.051207+0000","last_change":"2024-02-10T08:33:56.117758+0000","last_active":"2024-02-10T08:34:29.051207+0000","last_peered":"2024-02-10T08:34:29.051207+0000","last_clean":"2024-02-10T08:34:29.051207+0000","last_became_active":"2024-02-10T08:33:56.117425+0000","last_became_peered":"2024-02-10T08:33:56.117425+0000","last_unstale":"2024-02-10T08:34:29.051207+0000","last_undegraded":"2024-02-10T08:34:29.051207+0000","last_fullsized":"2024-02-10T08:34:29.051207+0000","mapping_epoch":364,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":365,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:21.209041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:20:30.227375+0000","last_clean_scrub_stamp":"2024-02-10T08:33:21.209041+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":362,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.063370+0000","last_change":"2024-02-10T08:33:17.824141+0000","last_active":"2024-02-10T08:34:29.063370+0000","last_peered":"2024-02-10T08:34:29.063370+0000","last_clean":"2024-02-10T08:34:29.063370+0000","last_became_active":"2024-02-10T08:30:26.085360+0000","last_became_peered":"2024-02-10T08:30:26.085360+0000","last_unstale":"2024-02-10T08:34:29.063370+0000","last_undegraded":"2024-02-10T08:34:29.063370+0000","last_fullsized":"2024-02-10T08:34:29.063370+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:17.824030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:33:17.824030+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,5],"acting":[2,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":97,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.063972+0000","last_change":"2024-02-10T08:33:20.217875+0000","last_active":"2024-02-10T08:34:29.063972+0000","last_peered":"2024-02-10T08:34:29.063972+0000","last_clean":"2024-02-10T08:34:29.063972+0000","last_became_active":"2024-02-10T08:30:26.075472+0000","last_became_peered":"2024-02-10T08:30:26.075472+0000","last_unstale":"2024-02-10T08:34:29.063972+0000","last_undegraded":"2024-02-10T08:34:29.063972+0000","last_fullsized":"2024-02-10T08:34:29.063972+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:20.217823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:33:20.217823+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":92,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.060040+0000","last_change":"2024-02-10T08:30:26.080944+0000","last_active":"2024-02-10T08:34:29.060040+0000","last_peered":"2024-02-10T08:34:29.060040+0000","last_clean":"2024-02-10T08:34:29.060040+0000","last_became_active":"2024-02-10T08:30:26.080539+0000","last_became_peered":"2024-02-10T08:30:26.080539+0000","last_unstale":"2024-02-10T08:34:29.060040+0000","last_undegraded":"2024-02-10T08:34:29.060040+0000","last_fullsized":"2024-02-10T08:34:29.060040+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:34.215363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:34.215363+0000","last_clean_scrub_stamp":"2024-02-10T08:28:34.215363+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":92,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.057889+0000","last_change":"2024-02-10T08:30:26.088483+0000","last_active":"2024-02-10T08:34:29.057889+0000","last_peered":"2024-02-10T08:34:29.057889+0000","last_clean":"2024-02-10T08:34:29.057889+0000","last_became_active":"2024-02-10T08:30:26.088228+0000","last_became_peered":"2024-02-10T08:30:26.088228+0000","last_unstale":"2024-02-10T08:34:29.057889+0000","last_undegraded":"2024-02-10T08:34:29.057889+0000","last_fullsized":"2024-02-10T08:34:29.057889+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:11.496105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:11.496105+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1],"acting":[7,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":279,"reported_epoch":371,"state":"active+clean","last_fresh":"2024-02-10T08:34:29.051501+0000","last_change":"2024-02-10T08:34:17.350483+0000","last_active":"2024-02-10T08:34:29.051501+0000","last_peered":"2024-02-10T08:34:29.051501+0000","last_clean":"2024-02-10T08:34:29.051501+0000","last_became_active":"2024-02-10T08:30:26.072022+0000","last_became_peered":"2024-02-10T08:30:26.072022+0000","last_unstale":"2024-02-10T08:34:29.051501+0000","last_undegraded":"2024-02-10T08:34:29.051501+0000","last_fullsized":"2024-02-10T08:34:29.051501+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:17.350406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:34:17.350406+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":16,"stat_sum":{"num_bytes":6583943192,"num_objects":100464,"num_object_clones":0,"num_object_copies":301392,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100464,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":147138,"num_write_kb":7923201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":19729887232,"data_stored":19729875016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":78011,"ondisk_log_size":78011,"up":48,"acting":48,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2646,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":4},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1054,"num_read_kb":1049,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":9,"acting":9,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":1105,"num_read_kb":862,"num_write":703,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":212,"num_bytes_recovered":5226,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":737,"ondisk_log_size":737,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":96,"acting":96,"num_store_stats":8},{"poolid":6,"num_pg":52,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":156,"acting":156,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":50,"seq":214748365017,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2190020,"kb_used_data":1604412,"kb_used_omap":0,"kb_used_meta":585600,"kb_avail":91555132,"statfs":{"total":95995035648,"available":93752455168,"internally_reserved":0,"allocated":1642917888,"data_stored":1642510746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":599654400},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:34:16 2024","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":3.1760000000000002,"15min":2.0649999999999999},"min":{"1min":0.24199999999999999,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":6.0599999999999996,"5min":107.95699999999999,"15min":107.95699999999999},"last":0.24099999999999999},{"interface":"front","average":{"1min":1.633,"5min":3.3820000000000001,"15min":2.5259999999999998},"min":{"1min":0.24299999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":4.9950000000000001,"5min":108.33499999999999,"15min":108.33499999999999},"last":2.4350000000000001}]},{"osd":1,"last update":"Sat Feb 10 08:34:16 2024","interfaces":[{"interface":"back","average":{"1min":1.5509999999999999,"5min":2.3839999999999999,"15min":1.7969999999999999},"min":{"1min":0.23300000000000001,"5min":0.222,"15min":0.20000000000000001},"max":{"1min":6.1790000000000003,"5min":41.539999999999999,"15min":41.539999999999999},"last":0.317},{"interface":"front","average":{"1min":1.286,"5min":2.395,"15min":1.883},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.22700000000000001},"max":{"1min":4.5910000000000002,"5min":41.046999999999997,"15min":41.046999999999997},"last":2.4079999999999999}]},{"osd":2,"last update":"Sat Feb 10 08:34:16 2024","interfaces":[{"interface":"back","average":{"1min":1.5980000000000001,"5min":2.3650000000000002,"15min":1.7849999999999999},"min":{"1min":0.29099999999999998,"5min":0.25700000000000001,"15min":0.251},"max":{"1min":8.6820000000000004,"5min":36.308999999999997,"15min":36.308999999999997},"last":1.879},{"interface":"front","average":{"1min":2.3100000000000001,"5min":2.5390000000000001,"15min":1.8759999999999999},"min":{"1min":0.29199999999999998,"5min":0.26000000000000001,"15min":0.25900000000000001},"max":{"1min":10.128,"5min":36.268000000000001,"15min":36.268000000000001},"last":0.27000000000000002}]},{"osd":3,"last update":"Sat Feb 10 08:34:16 2024","interfaces":[{"interface":"back","average":{"1min":2.1040000000000001,"5min":1.885,"15min":1.681},"min":{"1min":0.34599999999999997,"5min":0.28699999999999998,"15min":0.27700000000000002},"max":{"1min":8.6560000000000006,"5min":12.686,"15min":18.515000000000001},"last":1.915},{"interface":"front","average":{"1min":2.0979999999999999,"5min":2.2069999999999999,"15min":1.8480000000000001},"min":{"1min":0.29299999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":6.9139999999999997,"5min":10.960000000000001,"15min":10.960000000000001},"last":0.57899999999999996}]},{"osd":4,"last update":"Sat Feb 10 08:34:16 2024","interfaces":[{"interface":"back","average":{"1min":2.0710000000000002,"5min":1.742,"15min":1.179},"min":{"1min":0.27800000000000002,"5min":0.23400000000000001,"15min":0.216},"max":{"1min":8.6189999999999998,"5min":12.574999999999999,"15min":12.574999999999999},"last":6.9050000000000002},{"interface":"front","average":{"1min":1.8160000000000001,"5min":1.722,"15min":1.163},"min":{"1min":0.26800000000000002,"5min":0.24099999999999999,"15min":0.22700000000000001},"max":{"1min":6.9409999999999998,"5min":8.8170000000000002,"15min":12.987},"last":3.665}]},{"osd":5,"last update":"Sat Feb 10 08:34:16 2024","interfaces":[{"interface":"back","average":{"1min":1.4059999999999999,"5min":2.585,"15min":1.5629999999999999},"min":{"1min":0.317,"5min":0.26400000000000001,"15min":0.218},"max":{"1min":6.1479999999999997,"5min":15.304,"15min":15.304},"last":5.8659999999999997},{"interface":"front","average":{"1min":1.601,"5min":2.0790000000000002,"15min":1.355},"min":{"1min":0.32600000000000001,"5min":0.255,"15min":0.22600000000000001},"max":{"1min":8.1069999999999993,"5min":13.129,"15min":13.129},"last":2.4569999999999999}]},{"osd":6,"last update":"Sat Feb 10 08:34:16 2024","interfaces":[{"interface":"back","average":{"1min":1.7569999999999999,"5min":1.823,"15min":1.222},"min":{"1min":0.313,"5min":0.30199999999999999,"15min":0.26100000000000001},"max":{"1min":8.1470000000000002,"5min":10.101000000000001,"15min":10.101000000000001},"last":2.375},{"interface":"front","average":{"1min":2.0859999999999999,"5min":1.9359999999999999,"15min":1.248},"min":{"1min":0.32100000000000001,"5min":0.27000000000000002,"15min":0.224},"max":{"1min":8.9160000000000004,"5min":12.654,"15min":12.654},"last":2.532}]}]},{"osd":6,"up_from":43,"seq":184683593950,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":3125032,"kb_used_data":2823712,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":90620120,"statfs":{"total":95995035648,"available":92795002880,"internally_reserved":0,"allocated":2891481088,"data_stored":2891102007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:33:50 2024","interfaces":[{"interface":"back","average":{"1min":1.514,"5min":1.883,"15min":2.0779999999999998},"min":{"1min":0.23100000000000001,"5min":0.222,"15min":0.19400000000000001},"max":{"1min":4.3419999999999996,"5min":7.9909999999999997,"15min":30.509},"last":0.20300000000000001},{"interface":"front","average":{"1min":1.9330000000000001,"5min":1.758,"15min":1.825},"min":{"1min":0.311,"5min":0.245,"15min":0.21099999999999999},"max":{"1min":6.2069999999999999,"5min":7.673,"15min":36.090000000000003},"last":0.39200000000000002}]},{"osd":1,"last update":"Sat Feb 10 08:33:50 2024","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.758,"15min":1.6060000000000001},"min":{"1min":0.254,"5min":0.223,"15min":0.20899999999999999},"max":{"1min":3.262,"5min":6.3780000000000001,"15min":12.938000000000001},"last":0.316},{"interface":"front","average":{"1min":1.6439999999999999,"5min":2.105,"15min":1.766},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":5.0910000000000002,"5min":9.8829999999999991,"15min":10.441000000000001},"last":3.7330000000000001}]},{"osd":2,"last update":"Sat Feb 10 08:33:50 2024","interfaces":[{"interface":"back","average":{"1min":2.1339999999999999,"5min":2.028,"15min":2.008},"min":{"1min":0.32800000000000001,"5min":0.25900000000000001,"15min":0.24399999999999999},"max":{"1min":5.1310000000000002,"5min":8.923,"15min":35.072000000000003},"last":0.42299999999999999},{"interface":"front","average":{"1min":1.806,"5min":1.71,"15min":1.851},"min":{"1min":0.249,"5min":0.249,"15min":0.23100000000000001},"max":{"1min":6.3099999999999996,"5min":10.837999999999999,"15min":35.103000000000002},"last":0.24399999999999999}]},{"osd":3,"last update":"Sat Feb 10 08:33:50 2024","interfaces":[{"interface":"back","average":{"1min":1.4259999999999999,"5min":1.9850000000000001,"15min":1.7889999999999999},"min":{"1min":0.313,"5min":0.313,"15min":0.26600000000000001},"max":{"1min":4.9400000000000004,"5min":8.2780000000000005,"15min":15.212999999999999},"last":2.8460000000000001},{"interface":"front","average":{"1min":2.1520000000000001,"5min":2.1339999999999999,"15min":1.857},"min":{"1min":0.30299999999999999,"5min":0.29099999999999998,"15min":0.253},"max":{"1min":5.0599999999999996,"5min":8.9410000000000007,"15min":17.797000000000001},"last":0.51300000000000001}]},{"osd":4,"last update":"Sat Feb 10 08:34:12 2024","interfaces":[{"interface":"back","average":{"1min":1.9910000000000001,"5min":1.7210000000000001,"15min":1.121},"min":{"1min":0.22500000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":6.2619999999999996,"5min":7.5860000000000003,"15min":9.3879999999999999},"last":0.34399999999999997},{"interface":"front","average":{"1min":1.8879999999999999,"5min":1.8240000000000001,"15min":1.2150000000000001},"min":{"1min":0.27900000000000003,"5min":0.26100000000000001,"15min":0.22600000000000001},"max":{"1min":4.9020000000000001,"5min":8.3140000000000001,"15min":10.348000000000001},"last":0.29799999999999999}]},{"osd":5,"last update":"Sat Feb 10 08:33:50 2024","interfaces":[{"interface":"back","average":{"1min":1.7689999999999999,"5min":2.444,"15min":1.4159999999999999},"min":{"1min":0.25600000000000001,"5min":0.24099999999999999,"15min":0.20200000000000001},"max":{"1min":6.2869999999999999,"5min":29.631,"15min":29.631},"last":0.37},{"interface":"front","average":{"1min":1.4179999999999999,"5min":2.137,"15min":1.351},"min":{"1min":0.35599999999999998,"5min":0.27900000000000003,"15min":0.22900000000000001},"max":{"1min":4.9640000000000004,"5min":29.419,"15min":29.419},"last":0.42899999999999999}]},{"osd":7,"last update":"Sat Feb 10 08:34:12 2024","interfaces":[{"interface":"back","average":{"1min":2.1459999999999999,"5min":2.2749999999999999,"15min":2.004},"min":{"1min":0.317,"5min":0.30599999999999999,"15min":0.23999999999999999},"max":{"1min":5.1040000000000001,"5min":13.298999999999999,"15min":194.88900000000001},"last":0.501},{"interface":"front","average":{"1min":1.5580000000000001,"5min":2.2789999999999999,"15min":2.089},"min":{"1min":0.35799999999999998,"5min":0.32600000000000001,"15min":0.26400000000000001},"max":{"1min":3.8239999999999998,"5min":14.128,"15min":194.74100000000001},"last":0.40600000000000003}]}]},{"osd":1,"up_from":13,"seq":55834575093,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1788412,"kb_used_data":1202804,"kb_used_omap":0,"kb_used_meta":585600,"kb_avail":91956740,"statfs":{"total":95995035648,"available":94163701760,"internally_reserved":0,"allocated":1231671296,"data_stored":1231271730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":599654400},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,1,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:33:52 2024","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.758,"15min":2.04},"min":{"1min":0.22600000000000001,"5min":0.186,"15min":0.17100000000000001},"max":{"1min":8.5820000000000007,"5min":19.263000000000002,"15min":29.763999999999999},"last":0.35499999999999998},{"interface":"front","average":{"1min":2.7730000000000001,"5min":1.915,"15min":2.2669999999999999},"min":{"1min":0.23899999999999999,"5min":0.20100000000000001,"15min":0.17899999999999999},"max":{"1min":19.928999999999998,"5min":19.928999999999998,"15min":29.637},"last":0.60599999999999998}]},{"osd":2,"last update":"Sat Feb 10 08:34:19 2024","interfaces":[{"interface":"back","average":{"1min":2.847,"5min":2.0499999999999998,"15min":2.327},"min":{"1min":0.23499999999999999,"5min":0.22,"15min":0.21199999999999999},"max":{"1min":12.202,"5min":15.347,"15min":31.420999999999999},"last":4.0609999999999999},{"interface":"front","average":{"1min":3.2029999999999998,"5min":2.1480000000000001,"15min":2.548},"min":{"1min":0.26700000000000002,"5min":0.23400000000000001,"15min":0.184},"max":{"1min":12.314,"5min":16.344000000000001,"15min":31.484999999999999},"last":1.7569999999999999}]},{"osd":3,"last update":"Sat Feb 10 08:33:42 2024","interfaces":[{"interface":"back","average":{"1min":1.673,"5min":1.843,"15min":2.3540000000000001},"min":{"1min":0.40100000000000002,"5min":0.26400000000000001,"15min":0.247},"max":{"1min":12.369999999999999,"5min":12.369999999999999,"15min":28.082000000000001},"last":2.6989999999999998},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.821,"15min":2.0070000000000001},"min":{"1min":0.25900000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":3.6179999999999999,"5min":19.303999999999998,"15min":29.722000000000001},"last":0.47599999999999998}]},{"osd":4,"last update":"Sat Feb 10 08:34:13 2024","interfaces":[{"interface":"back","average":{"1min":3.0750000000000002,"5min":2.0030000000000001,"15min":1.9890000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.26100000000000001},"max":{"1min":23.218,"5min":23.218,"15min":23.218},"last":0.66000000000000003},{"interface":"front","average":{"1min":2.7970000000000002,"5min":2.004,"15min":2.2759999999999998},"min":{"1min":0.35899999999999999,"5min":0.32000000000000001,"15min":0.25900000000000001},"max":{"1min":23.274000000000001,"5min":23.274000000000001,"15min":31.515000000000001},"last":1.847}]},{"osd":5,"last update":"Sat Feb 10 08:34:19 2024","interfaces":[{"interface":"back","average":{"1min":2.5939999999999999,"5min":2.2410000000000001,"15min":2.1230000000000002},"min":{"1min":0.32700000000000001,"5min":0.29699999999999999,"15min":0.26000000000000001},"max":{"1min":8.4920000000000009,"5min":21.751000000000001,"15min":40.140999999999998},"last":0.68400000000000005},{"interface":"front","average":{"1min":2.5209999999999999,"5min":2.343,"15min":2.3879999999999999},"min":{"1min":0.40799999999999997,"5min":0.317,"15min":0.28499999999999998},"max":{"1min":7.593,"5min":16.324000000000002,"15min":40.831000000000003},"last":1.8080000000000001}]},{"osd":6,"last update":"Sat Feb 10 08:33:52 2024","interfaces":[{"interface":"back","average":{"1min":2.7669999999999999,"5min":2.1280000000000001,"15min":2.0640000000000001},"min":{"1min":0.34599999999999997,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":26.071999999999999,"5min":26.071999999999999,"15min":31.27},"last":1.831},{"interface":"front","average":{"1min":2.504,"5min":1.95,"15min":1.7030000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.27700000000000002},"max":{"1min":25.937000000000001,"5min":25.937000000000001,"15min":25.937000000000001},"last":0.41499999999999998}]},{"osd":7,"last update":"Sat Feb 10 08:34:19 2024","interfaces":[{"interface":"back","average":{"1min":2.8999999999999999,"5min":2.3650000000000002,"15min":2.1970000000000001},"min":{"1min":0.46400000000000002,"5min":0.374,"15min":0.29099999999999998},"max":{"1min":7.6200000000000001,"5min":19.692,"15min":31.344999999999999},"last":1.8640000000000001},{"interface":"front","average":{"1min":2.0329999999999999,"5min":2.1850000000000001,"15min":1.78},"min":{"1min":0.434,"5min":0.32500000000000001,"15min":0.312},"max":{"1min":4.5990000000000002,"5min":15.91,"15min":15.91},"last":0.44700000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738618,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":4559044,"kb_used_data":3969148,"kb_used_omap":0,"kb_used_meta":589696,"kb_avail":89186108,"statfs":{"total":95995035648,"available":91326574592,"internally_reserved":0,"allocated":4064407552,"data_stored":4064000269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":603848704},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 10 08:33:57 2024","interfaces":[{"interface":"back","average":{"1min":1.5840000000000001,"5min":1.6160000000000001,"15min":2.5830000000000002},"min":{"1min":0.182,"5min":0.16300000000000001,"15min":0.14399999999999999},"max":{"1min":5.5220000000000002,"5min":11.058,"15min":102.48099999999999},"last":0.41599999999999998},{"interface":"front","average":{"1min":2.6890000000000001,"5min":1.9470000000000001,"15min":2.5190000000000001},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.193},"max":{"1min":15.550000000000001,"5min":15.550000000000001,"15min":103.38800000000001},"last":0.39300000000000002}]},{"osd":2,"last update":"Sat Feb 10 08:34:19 2024","interfaces":[{"interface":"back","average":{"1min":2.0270000000000001,"5min":2.6749999999999998,"15min":3.0099999999999998},"min":{"1min":0.20000000000000001,"5min":0.19700000000000001,"15min":0.192},"max":{"1min":5.141,"5min":21.331,"15min":102.462},"last":0.433},{"interface":"front","average":{"1min":1.6579999999999999,"5min":1.4259999999999999,"15min":2.4980000000000002},"min":{"1min":0.23599999999999999,"5min":0.21099999999999999,"15min":0.20799999999999999},"max":{"1min":5.4390000000000001,"5min":6.1870000000000003,"15min":102.66500000000001},"last":0.35799999999999998}]},{"osd":3,"last update":"Sat Feb 10 08:33:40 2024","interfaces":[{"interface":"back","average":{"1min":2.29,"5min":1.764,"15min":2.1899999999999999},"min":{"1min":0.26600000000000001,"5min":0.23400000000000001,"15min":0.22600000000000001},"max":{"1min":15.585000000000001,"5min":15.585000000000001,"15min":16.495000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":2.5470000000000002,"5min":2.2109999999999999,"15min":2.8100000000000001},"min":{"1min":0.245,"5min":0.23000000000000001,"15min":0.222},"max":{"1min":19.504000000000001,"5min":19.504000000000001,"15min":102.64400000000001},"last":2.548}]},{"osd":4,"last update":"Sat Feb 10 08:34:07 2024","interfaces":[{"interface":"back","average":{"1min":2.6230000000000002,"5min":2.0710000000000002,"15min":2.714},"min":{"1min":0.33900000000000002,"5min":0.26000000000000001,"15min":0.253},"max":{"1min":19.359999999999999,"5min":19.359999999999999,"15min":102.742},"last":2.512},{"interface":"front","average":{"1min":2.3599999999999999,"5min":1.647,"15min":1.7410000000000001},"min":{"1min":0.28399999999999997,"5min":0.27000000000000002,"15min":0.26200000000000001},"max":{"1min":15.343,"5min":15.343,"15min":16.352},"last":3.2509999999999999}]},{"osd":5,"last update":"Sat Feb 10 08:34:32 2024","interfaces":[{"interface":"back","average":{"1min":1.6220000000000001,"5min":1.8440000000000001,"15min":2.2240000000000002},"min":{"1min":0.30399999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":6.8719999999999999,"5min":17.321000000000002,"15min":102.53100000000001},"last":0.79200000000000004},{"interface":"front","average":{"1min":1.6870000000000001,"5min":1.849,"15min":1.8340000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.22500000000000001},"max":{"1min":6.1269999999999998,"5min":15.302,"15min":16.463999999999999},"last":0.49099999999999999}]},{"osd":6,"last update":"Sat Feb 10 08:33:57 2024","interfaces":[{"interface":"back","average":{"1min":1.6539999999999999,"5min":1.766,"15min":2.1949999999999998},"min":{"1min":0.375,"5min":0.34599999999999997,"15min":0.28599999999999998},"max":{"1min":6.9080000000000004,"5min":7.0149999999999997,"15min":102.583},"last":0.61499999999999999},{"interface":"front","average":{"1min":2.6960000000000002,"5min":1.931,"15min":1.754},"min":{"1min":0.378,"5min":0.37,"15min":0.308},"max":{"1min":15.359,"5min":15.359,"15min":16.391999999999999},"last":0.46400000000000002}]},{"osd":7,"last update":"Sat Feb 10 08:34:19 2024","interfaces":[{"interface":"back","average":{"1min":1.54,"5min":1.579,"15min":2.9689999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":5.3419999999999996,"5min":6.4889999999999999,"15min":255.53200000000001},"last":1.827},{"interface":"front","average":{"1min":2.1299999999999999,"5min":1.958,"15min":2.6080000000000001},"min":{"1min":0.34899999999999998,"5min":0.34599999999999997,"15min":0.28599999999999998},"max":{"1min":8.3000000000000007,"5min":15.375999999999999,"15min":254.88800000000001},"last":0.58699999999999997}]}]},{"osd":2,"up_from":18,"seq":77309411569,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2989296,"kb_used_data":2391400,"kb_used_omap":0,"kb_used_meta":597888,"kb_avail":90755856,"statfs":{"total":95995035648,"available":92933996544,"internally_reserved":0,"allocated":2448793600,"data_stored":2448406154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":612237312},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:34:23 2024","interfaces":[{"interface":"back","average":{"1min":3.7589999999999999,"5min":1.5700000000000001,"15min":1.988},"min":{"1min":0.255,"5min":0.19400000000000001,"15min":0.17399999999999999},"max":{"1min":27.934999999999999,"5min":27.934999999999999,"15min":27.934999999999999},"last":0.50600000000000001},{"interface":"front","average":{"1min":2.714,"5min":2.194,"15min":2.5470000000000002},"min":{"1min":0.20999999999999999,"5min":0.19600000000000001,"15min":0.193},"max":{"1min":9.2690000000000001,"5min":15.15,"15min":28.295999999999999},"last":5.609}]},{"osd":1,"last update":"Sat Feb 10 08:34:23 2024","interfaces":[{"interface":"back","average":{"1min":1.8819999999999999,"5min":1.6890000000000001,"15min":2.0009999999999999},"min":{"1min":0.27800000000000002,"5min":0.20999999999999999,"15min":0.19700000000000001},"max":{"1min":9.9469999999999992,"5min":9.9469999999999992,"15min":15.644},"last":3.5630000000000002},{"interface":"front","average":{"1min":1.474,"5min":1.2090000000000001,"15min":1.5029999999999999},"min":{"1min":0.221,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":6.5060000000000002,"5min":7.6829999999999998,"15min":16.968},"last":12.132999999999999}]},{"osd":3,"last update":"Sat Feb 10 08:33:44 2024","interfaces":[{"interface":"back","average":{"1min":2.2559999999999998,"5min":1.6819999999999999,"15min":2.073},"min":{"1min":0.25,"5min":0.25,"15min":0.23300000000000001},"max":{"1min":9.7870000000000008,"5min":9.7870000000000008,"15min":24.946000000000002},"last":0.53000000000000003},{"interface":"front","average":{"1min":1.5920000000000001,"5min":1.3680000000000001,"15min":2.1070000000000002},"min":{"1min":0.30599999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":9.1150000000000002,"5min":9.1150000000000002,"15min":24.905000000000001},"last":0.56399999999999995}]},{"osd":4,"last update":"Sat Feb 10 08:34:04 2024","interfaces":[{"interface":"back","average":{"1min":1.968,"5min":1.8280000000000001,"15min":1.931},"min":{"1min":0.316,"5min":0.30099999999999999,"15min":0.27400000000000002},"max":{"1min":4.7809999999999997,"5min":10.573,"15min":13.260999999999999},"last":3.302},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.248,"15min":1.3009999999999999},"min":{"1min":0.32300000000000001,"5min":0.29699999999999999,"15min":0.25700000000000001},"max":{"1min":3.4729999999999999,"5min":3.8420000000000001,"15min":15.696},"last":3.3279999999999998}]},{"osd":5,"last update":"Sat Feb 10 08:34:30 2024","interfaces":[{"interface":"back","average":{"1min":2.302,"5min":2.2530000000000001,"15min":2.0449999999999999},"min":{"1min":0.308,"5min":0.30299999999999999,"15min":0.26600000000000001},"max":{"1min":7.5700000000000003,"5min":13.201000000000001,"15min":13.939},"last":5.6399999999999997},{"interface":"front","average":{"1min":2.0329999999999999,"5min":2.1320000000000001,"15min":1.8879999999999999},"min":{"1min":0.38300000000000001,"5min":0.29199999999999998,"15min":0.28599999999999998},"max":{"1min":6.3440000000000003,"5min":9.5709999999999997,"15min":13.317},"last":3.6349999999999998}]},{"osd":6,"last update":"Sat Feb 10 08:34:04 2024","interfaces":[{"interface":"back","average":{"1min":2.169,"5min":2.0569999999999999,"15min":1.9930000000000001},"min":{"1min":0.33100000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":4.7619999999999996,"5min":13.233000000000001,"15min":38.177999999999997},"last":2.835},{"interface":"front","average":{"1min":2.3479999999999999,"5min":2.052,"15min":2.0329999999999999},"min":{"1min":0.45900000000000002,"5min":0.32200000000000001,"15min":0.29099999999999998},"max":{"1min":7.0010000000000003,"5min":9.0879999999999992,"15min":37.682000000000002},"last":3.4849999999999999}]},{"osd":7,"last update":"Sat Feb 10 08:34:23 2024","interfaces":[{"interface":"back","average":{"1min":1.821,"5min":1.968,"15min":1.8700000000000001},"min":{"1min":0.377,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":4.601,"5min":9.6869999999999994,"15min":13.231999999999999},"last":3.4009999999999998},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.5680000000000001,"15min":1.4490000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.29199999999999998},"max":{"1min":3.508,"5min":8.1110000000000007,"15min":15.714},"last":0.53800000000000003}]}]},{"osd":3,"up_from":25,"seq":107374182636,"num_pgs":62,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2603008,"kb_used_data":2009208,"kb_used_omap":0,"kb_used_meta":593792,"kb_avail":91142144,"statfs":{"total":95995035648,"available":93329555456,"internally_reserved":0,"allocated":2057428992,"data_stored":2057024913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":608043008},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:33:39 2024","interfaces":[{"interface":"back","average":{"1min":4.9059999999999997,"5min":2.3490000000000002,"15min":2.109},"min":{"1min":0.20799999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":66.605000000000004,"5min":66.605000000000004,"15min":66.605000000000004},"last":4.3289999999999997},{"interface":"front","average":{"1min":5.319,"5min":2.5339999999999998,"15min":2.1040000000000001},"min":{"1min":0.192,"5min":0.184,"15min":0.184},"max":{"1min":66.828000000000003,"5min":66.828000000000003,"15min":66.828000000000003},"last":2.6600000000000001}]},{"osd":1,"last update":"Sat Feb 10 08:33:39 2024","interfaces":[{"interface":"back","average":{"1min":1.591,"5min":2.0169999999999999,"15min":1.9850000000000001},"min":{"1min":0.27800000000000002,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":7.5419999999999998,"5min":13.371,"15min":13.371},"last":4.3620000000000001},{"interface":"front","average":{"1min":1.242,"5min":1.9930000000000001,"15min":2.198},"min":{"1min":0.23999999999999999,"5min":0.20599999999999999,"15min":0.191},"max":{"1min":6.7210000000000001,"5min":19.344000000000001,"15min":21.373999999999999},"last":0.23999999999999999}]},{"osd":2,"last update":"Sat Feb 10 08:33:39 2024","interfaces":[{"interface":"back","average":{"1min":5.5869999999999997,"5min":2.645,"15min":2.371},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":65.998999999999995,"5min":65.998999999999995,"15min":65.998999999999995},"last":1.677},{"interface":"front","average":{"1min":5.4569999999999999,"5min":2.3220000000000001,"15min":2.0859999999999999},"min":{"1min":0.255,"5min":0.23400000000000001,"15min":0.215},"max":{"1min":68.721000000000004,"5min":68.721000000000004,"15min":68.721000000000004},"last":0.33900000000000002}]},{"osd":4,"last update":"Sat Feb 10 08:34:14 2024","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":1.492,"15min":1.617},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.25900000000000001},"max":{"1min":3.8029999999999999,"5min":6.6299999999999999,"15min":12.272},"last":0.39300000000000002},{"interface":"front","average":{"1min":1.7649999999999999,"5min":1.716,"15min":1.9950000000000001},"min":{"1min":0.29799999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":6.0069999999999997,"5min":10.754,"15min":12.391999999999999},"last":4.2229999999999999}]},{"osd":5,"last update":"Sat Feb 10 08:33:37 2024","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":2.0720000000000001,"15min":1.641},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.249},"max":{"1min":4.6790000000000003,"5min":19.832000000000001,"15min":19.832000000000001},"last":0.36899999999999999},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.9910000000000001,"15min":1.865},"min":{"1min":0.371,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":4.1639999999999997,"5min":19.712,"15min":19.712},"last":4.2619999999999996}]},{"osd":6,"last update":"Sat Feb 10 08:33:56 2024","interfaces":[{"interface":"back","average":{"1min":1.746,"5min":1.899,"15min":1.829},"min":{"1min":0.372,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":4.2439999999999998,"5min":16.423999999999999,"15min":16.423999999999999},"last":4.2969999999999997},{"interface":"front","average":{"1min":1.859,"5min":1.9930000000000001,"15min":1.619},"min":{"1min":0.38600000000000001,"5min":0.35099999999999998,"15min":0.28499999999999998},"max":{"1min":5.7450000000000001,"5min":9.7010000000000005,"15min":12.324999999999999},"last":0.41399999999999998}]},{"osd":7,"last update":"Sat Feb 10 08:34:14 2024","interfaces":[{"interface":"back","average":{"1min":1.7310000000000001,"5min":1.9059999999999999,"15min":1.6459999999999999},"min":{"1min":0.497,"5min":0.33500000000000002,"15min":0.28299999999999997},"max":{"1min":5.673,"5min":8.7569999999999997,"15min":12.358000000000001},"last":0.437},{"interface":"front","average":{"1min":2.5219999999999998,"5min":2.032,"15min":1.976},"min":{"1min":0.45200000000000001,"5min":0.313,"15min":0.26500000000000001},"max":{"1min":6.657,"5min":9.6720000000000006,"15min":15.702},"last":1.806}]}]},{"osd":4,"up_from":110,"seq":472446402727,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":3893240,"kb_used_data":3302832,"kb_used_omap":0,"kb_used_meta":590335,"kb_avail":89851912,"statfs":{"total":95995035648,"available":92008357888,"internally_reserved":0,"allocated":3382099968,"data_stored":3381703773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":972,"internal_metadata":604503092},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:34:25 2024","interfaces":[{"interface":"back","average":{"1min":2.036,"5min":1.4299999999999999,"15min":1.401},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.19800000000000001},"max":{"1min":7.3659999999999997,"5min":14.595000000000001,"15min":14.595000000000001},"last":6.6630000000000003},{"interface":"front","average":{"1min":2.1680000000000001,"5min":1.911,"15min":2.2330000000000001},"min":{"1min":0.24299999999999999,"5min":0.23100000000000001,"15min":0.222},"max":{"1min":7.4009999999999998,"5min":14.446999999999999,"15min":16.524000000000001},"last":3.6629999999999998}]},{"osd":1,"last update":"Sat Feb 10 08:34:25 2024","interfaces":[{"interface":"back","average":{"1min":1.772,"5min":2.0680000000000001,"15min":1.903},"min":{"1min":0.27300000000000002,"5min":0.23899999999999999,"15min":0.218},"max":{"1min":6.3849999999999998,"5min":38.621000000000002,"15min":38.621000000000002},"last":2.7970000000000002},{"interface":"front","average":{"1min":1.605,"5min":1.976,"15min":1.804},"min":{"1min":0.32000000000000001,"5min":0.248,"15min":0.217},"max":{"1min":7.0209999999999999,"5min":38.430999999999997,"15min":38.430999999999997},"last":6.6260000000000003}]},{"osd":2,"last update":"Sat Feb 10 08:34:25 2024","interfaces":[{"interface":"back","average":{"1min":2.2090000000000001,"5min":1.9359999999999999,"15min":1.9199999999999999},"min":{"1min":0.28599999999999998,"5min":0.246,"15min":0.218},"max":{"1min":7.6699999999999999,"5min":14.414,"15min":14.414},"last":0.308},{"interface":"front","average":{"1min":2.0430000000000001,"5min":1.819,"15min":1.78},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.247},"max":{"1min":6.8710000000000004,"5min":11.958,"15min":11.958},"last":0.73999999999999999}]},{"osd":3,"last update":"Sat Feb 10 08:34:25 2024","interfaces":[{"interface":"back","average":{"1min":2.23,"5min":1.9470000000000001,"15min":1.9330000000000001},"min":{"1min":0.30099999999999999,"5min":0.27200000000000002,"15min":0.23200000000000001},"max":{"1min":5.6159999999999997,"5min":14.358000000000001,"15min":14.358000000000001},"last":2.6930000000000001},{"interface":"front","average":{"1min":2.1269999999999998,"5min":2.0499999999999998,"15min":1.7330000000000001},"min":{"1min":0.32700000000000001,"5min":0.249,"15min":0.249},"max":{"1min":6.4020000000000001,"5min":8.3360000000000003,"15min":11.648},"last":3.5259999999999998}]},{"osd":5,"last update":"Sat Feb 10 08:34:25 2024","interfaces":[{"interface":"back","average":{"1min":2.4199999999999999,"5min":1.8029999999999999,"15min":1.254},"min":{"1min":0.247,"5min":0.247,"15min":0.21299999999999999},"max":{"1min":7.9560000000000004,"5min":20.355,"15min":41.488},"last":1.8919999999999999},{"interface":"front","average":{"1min":1.972,"5min":1.74,"15min":1.4359999999999999},"min":{"1min":0.29299999999999998,"5min":0.27200000000000002,"15min":0.23699999999999999},"max":{"1min":7.3920000000000003,"5min":16.350000000000001,"15min":42.527999999999999},"last":1.2130000000000001}]},{"osd":6,"last update":"Sat Feb 10 08:34:25 2024","interfaces":[{"interface":"back","average":{"1min":2.0459999999999998,"5min":1.6559999999999999,"15min":1.3360000000000001},"min":{"1min":0.29799999999999999,"5min":0.27400000000000002,"15min":0.26400000000000001},"max":{"1min":6.3600000000000003,"5min":8.2910000000000004,"15min":39.554000000000002},"last":0.79100000000000004},{"interface":"front","average":{"1min":2.2930000000000001,"5min":1.8740000000000001,"15min":1.3919999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":6.5220000000000002,"5min":11.342000000000001,"15min":41.741999999999997},"last":2.274}]},{"osd":7,"last update":"Sat Feb 10 08:34:25 2024","interfaces":[{"interface":"back","average":{"1min":1.6220000000000001,"5min":1.843,"15min":1.3049999999999999},"min":{"1min":0.32200000000000001,"5min":0.29799999999999999,"15min":0.28899999999999998},"max":{"1min":6.3310000000000004,"5min":8.6289999999999996,"15min":11.047000000000001},"last":0.81599999999999995},{"interface":"front","average":{"1min":1.7450000000000001,"5min":1.8280000000000001,"15min":1.181},"min":{"1min":0.32100000000000001,"5min":0.29099999999999998,"15min":0.26300000000000001},"max":{"1min":7.9889999999999999,"5min":16.245999999999999,"15min":16.245999999999999},"last":2.0369999999999999}]}]},{"osd":5,"up_from":37,"seq":158913790179,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2631140,"kb_used_data":2041436,"kb_used_omap":0,"kb_used_meta":589696,"kb_avail":91114012,"statfs":{"total":95995035648,"available":93300748288,"internally_reserved":0,"allocated":2090430464,"data_stored":2090054628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":603848704},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:34:29 2024","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.427,"15min":1.6879999999999999},"min":{"1min":0.218,"5min":0.218,"15min":0.20499999999999999},"max":{"1min":4.7699999999999996,"5min":10.789,"15min":22.914000000000001},"last":0.27900000000000003},{"interface":"front","average":{"1min":2.677,"5min":1.8959999999999999,"15min":1.706},"min":{"1min":0.23000000000000001,"5min":0.22900000000000001,"15min":0.21299999999999999},"max":{"1min":7.2050000000000001,"5min":13.738,"15min":23.161000000000001},"last":2.9100000000000001}]},{"osd":1,"last update":"Sat Feb 10 08:34:29 2024","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.7529999999999999,"15min":1.504},"min":{"1min":0.245,"5min":0.222,"15min":0.19500000000000001},"max":{"1min":4.3689999999999998,"5min":8.359,"15min":8.359},"last":0.315},{"interface":"front","average":{"1min":2.4359999999999999,"5min":1.583,"15min":1.456},"min":{"1min":0.29099999999999998,"5min":0.27300000000000002,"15min":0.254},"max":{"1min":7.085,"5min":8.6899999999999995,"15min":9.0579999999999998},"last":3.2269999999999999}]},{"osd":2,"last update":"Sat Feb 10 08:34:29 2024","interfaces":[{"interface":"back","average":{"1min":2.02,"5min":1.9199999999999999,"15min":1.768},"min":{"1min":0.251,"5min":0.251,"15min":0.24099999999999999},"max":{"1min":4.4829999999999997,"5min":20.254999999999999,"15min":20.254999999999999},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.611,"5min":1.635,"15min":1.573},"min":{"1min":0.29599999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":5.1150000000000002,"5min":6.3929999999999998,"15min":9.2810000000000006},"last":0.39900000000000002}]},{"osd":3,"last update":"Sat Feb 10 08:34:29 2024","interfaces":[{"interface":"back","average":{"1min":1.8460000000000001,"5min":1.5409999999999999,"15min":1.464},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.26100000000000001},"max":{"1min":7.234,"5min":8.0079999999999991,"15min":24.198},"last":5.3609999999999998},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.534,"15min":1.6739999999999999},"min":{"1min":0.309,"5min":0.27300000000000002,"15min":0.25900000000000001},"max":{"1min":4.2919999999999998,"5min":10.766,"15min":22.701000000000001},"last":0.42999999999999999}]},{"osd":4,"last update":"Sat Feb 10 08:34:13 2024","interfaces":[{"interface":"back","average":{"1min":1.5109999999999999,"5min":1.381,"15min":1.0820000000000001},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":4.1360000000000001,"5min":7.923,"15min":7.923},"last":2.7629999999999999},{"interface":"front","average":{"1min":0.94099999999999995,"5min":1.633,"15min":1.1200000000000001},"min":{"1min":0.254,"5min":0.254,"15min":0.22500000000000001},"max":{"1min":5.1040000000000001,"5min":12.948,"15min":12.948},"last":0.34300000000000003}]},{"osd":6,"last update":"Sat Feb 10 08:33:54 2024","interfaces":[{"interface":"back","average":{"1min":1.6419999999999999,"5min":1.3049999999999999,"15min":1.0600000000000001},"min":{"1min":0.27800000000000002,"5min":0.253,"15min":0.23100000000000001},"max":{"1min":7.0259999999999998,"5min":7.0259999999999998,"15min":8.3559999999999999},"last":2.6499999999999999},{"interface":"front","average":{"1min":1.4259999999999999,"5min":1.466,"15min":1.071},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.23999999999999999},"max":{"1min":6.8499999999999996,"5min":7.875,"15min":7.875},"last":1.077}]},{"osd":7,"last update":"Sat Feb 10 08:34:26 2024","interfaces":[{"interface":"back","average":{"1min":1.7789999999999999,"5min":1.5329999999999999,"15min":2.274},"min":{"1min":0.30499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":7.2599999999999998,"5min":7.952,"15min":371.87400000000002},"last":1.109},{"interface":"front","average":{"1min":1.157,"5min":1.631,"15min":2.4260000000000002},"min":{"1min":0.32800000000000001,"5min":0.318,"15min":0.23499999999999999},"max":{"1min":5.2089999999999996,"5min":12.984999999999999,"15min":372.63099999999997},"last":0.46800000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4049539072,"data_stored":4049535000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1229717504,"data_stored":1229717504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2444820480,"data_stored":2444820480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2049114112,"data_stored":2049114112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":3378122752,"data_stored":3378118680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":2078015488,"data_stored":2078015488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":2867531776,"data_stored":2867527704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1633026048,"data_stored":1633026048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-10T08:34:41.741 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd pool set iscsi pgp_num 3 2024-02-10T08:34:41.829 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:34:41.874 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:41.960 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-02-10T08:34:41.960 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:34:41.984 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:34:42.000 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:42.000 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:34:42.101 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:34:42.147 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:42.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:41.010693+0000 mgr.y (mgr.14505) 674 : cluster [DBG] pgmap v833: 168 pgs: 168 active+clean; 6.1 GiB data, 23 GiB used, 693 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.11k op/s 2024-02-10T08:34:42.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:41.672243+0000 osd.5 (osd.5) 227 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:34:42.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:41.672293+0000 osd.5 (osd.5) 228 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:34:42.408 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:41.010693+0000 mgr.y (mgr.14505) 674 : cluster [DBG] pgmap v833: 168 pgs: 168 active+clean; 6.1 GiB data, 23 GiB used, 693 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.11k op/s 2024-02-10T08:34:42.409 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:41.672243+0000 osd.5 (osd.5) 227 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:34:42.409 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:41.672293+0000 osd.5 (osd.5) 228 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:34:42.467 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:34:42.515 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:34:42.529 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:42.530 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:34:42.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:41.010693+0000 mgr.y (mgr.14505) 674 : cluster [DBG] pgmap v833: 168 pgs: 168 active+clean; 6.1 GiB data, 23 GiB used, 693 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.11k op/s 2024-02-10T08:34:42.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:41.672243+0000 osd.5 (osd.5) 227 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:34:42.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:41.672293+0000 osd.5 (osd.5) 228 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:34:42.631 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:34:42.666 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:42.668 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.5 dump_historic_ops 2024-02-10T08:34:42.703 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:34:42.712 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:42.712 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:34:42.814 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:34:42.872 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:42.909 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:34:42.916 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:42.917 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:34:43.018 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:34:43.072 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:43.096 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:34:43.192 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:43 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:42.177983+0000 mon.a (mon.0) 1585 : cluster [DBG] osdmap e373: 8 total, 8 up, 8 in 2024-02-10T08:34:43.643 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:34:43.644 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:42.177983+0000 mon.a (mon.0) 1585 : cluster [DBG] osdmap e373: 8 total, 8 up, 8 in 2024-02-10T08:34:43.645 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:42.177983+0000 mon.a (mon.0) 1585 : cluster [DBG] osdmap e373: 8 total, 8 up, 8 in 2024-02-10T08:34:43.645 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:43.646 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:34:43.746 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:34:43.783 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:43.922 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:34:43.926 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:43.927 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:34:44.027 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:34:44.073 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:44.246 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is set 2024-02-10T08:34:44.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:43.011434+0000 mgr.y (mgr.14505) 675 : cluster [DBG] pgmap v835: 168 pgs: 1 active+clean+scrubbing+deep, 167 active+clean; 5.9 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.05k op/s 2024-02-10T08:34:44.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:34:43.947739+0000 mon.b (mon.1) 80 : audit [INF] from='client.? 172.21.15.18:0/1146023108' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:34:44.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:34:43.948884+0000 mon.a (mon.0) 1586 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:34:44.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:43.011434+0000 mgr.y (mgr.14505) 675 : cluster [DBG] pgmap v835: 168 pgs: 1 active+clean+scrubbing+deep, 167 active+clean; 5.9 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.05k op/s 2024-02-10T08:34:44.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:34:43.947739+0000 mon.b (mon.1) 80 : audit [INF] from='client.? 172.21.15.18:0/1146023108' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:34:44.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:34:43.948884+0000 mon.a (mon.0) 1586 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:34:44.542 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:44 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:43.011434+0000 mgr.y (mgr.14505) 675 : cluster [DBG] pgmap v835: 168 pgs: 1 active+clean+scrubbing+deep, 167 active+clean; 5.9 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.05k op/s 2024-02-10T08:34:44.542 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:44 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:34:43.947739+0000 mon.b (mon.1) 80 : audit [INF] from='client.? 172.21.15.18:0/1146023108' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:34:44.542 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:44 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:34:43.948884+0000 mon.a (mon.0) 1586 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:34:44.635 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:34:44.641 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:44.642 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:34:44.742 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:34:44.783 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:44.818 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:34:44.821 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:44.822 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:34:44.923 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:34:44.938 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:34:44.971 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:44.974 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-02-10T08:34:44.974 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:34:45.000 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:34:45.003 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:45.004 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:34:45.104 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:34:45.157 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:45.250 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:34:45.256 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:45.257 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:34:45.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:44.193748+0000 mon.a (mon.0) 1587 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:34:45.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:34:44.215911+0000 mon.a (mon.0) 1588 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-10T08:34:45.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:44.215971+0000 mon.a (mon.0) 1589 : cluster [DBG] osdmap e374: 8 total, 8 up, 8 in 2024-02-10T08:34:45.358 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:34:45.410 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:45.469 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:44.193748+0000 mon.a (mon.0) 1587 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:34:45.469 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:34:44.215911+0000 mon.a (mon.0) 1588 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-10T08:34:45.469 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:44.215971+0000 mon.a (mon.0) 1589 : cluster [DBG] osdmap e374: 8 total, 8 up, 8 in 2024-02-10T08:34:45.471 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:44.193748+0000 mon.a (mon.0) 1587 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:34:45.471 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:34:44.215911+0000 mon.a (mon.0) 1588 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-10T08:34:45.471 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:44.215971+0000 mon.a (mon.0) 1589 : cluster [DBG] osdmap e374: 8 total, 8 up, 8 in 2024-02-10T08:34:45.756 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:34:45.760 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:45.760 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:34:45.784 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.6 dump_ops_in_flight 2024-02-10T08:34:45.861 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:34:45.921 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:45.963 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:34:45.968 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:45.969 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:34:46.070 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:34:46.125 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:46.237 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:45.012354+0000 mgr.y (mgr.14505) 676 : cluster [DBG] pgmap v837: 168 pgs: 1 active+clean+scrubbing+deep, 167 active+clean; 5.8 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.17k op/s 2024-02-10T08:34:46.238 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:45.012354+0000 mgr.y (mgr.14505) 676 : cluster [DBG] pgmap v837: 168 pgs: 1 active+clean+scrubbing+deep, 167 active+clean; 5.8 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.17k op/s 2024-02-10T08:34:46.249 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:34:46.516 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:45.012354+0000 mgr.y (mgr.14505) 676 : cluster [DBG] pgmap v837: 168 pgs: 1 active+clean+scrubbing+deep, 167 active+clean; 5.8 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.17k op/s 2024-02-10T08:34:46.517 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:34:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:34:46] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:34:47.384 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:34:47.391 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:47.391 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:34:47.414 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:34:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:34:47] "GET /metrics HTTP/1.1" 200 176425 "" "Prometheus/2.33.4" 2024-02-10T08:34:47.492 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:34:47.554 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:47.599 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:34:47.600 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:34:47.600 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:34:47.600 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:34:47.600 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:34:47.600 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:34:47.600 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:34:47.600 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:34:47.602 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:34:47.607 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:47.607 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:34:47.608 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-10T08:34:47.608 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-10T08:34:47.608 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-10T08:34:47.609 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-10T08:34:47.609 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-10T08:34:47.609 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-10T08:34:47.609 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-10T08:34:47.609 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-10T08:34:47.709 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:34:47.750 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:47.960 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd set nodeep-scrub 2024-02-10T08:34:48.017 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:34:46.683982+0000 mon.a (mon.0) 1590 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:34:48.017 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:47.012996+0000 mgr.y (mgr.14505) 677 : cluster [DBG] pgmap v838: 168 pgs: 1 active+clean+scrubbing+deep, 167 active+clean; 5.8 GiB data, 22 GiB used, 694 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 696 op/s 2024-02-10T08:34:48.017 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:34:47.298695+0000 mon.c (mon.2) 82 : audit [DBG] from='client.? 172.21.15.18:0/370648006' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:34:48.018 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:34:46.683982+0000 mon.a (mon.0) 1590 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:34:48.019 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:47.012996+0000 mgr.y (mgr.14505) 677 : cluster [DBG] pgmap v838: 168 pgs: 1 active+clean+scrubbing+deep, 167 active+clean; 5.8 GiB data, 22 GiB used, 694 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 696 op/s 2024-02-10T08:34:48.019 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:34:47.298695+0000 mon.c (mon.2) 82 : audit [DBG] from='client.? 172.21.15.18:0/370648006' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:34:48.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:34:46.683982+0000 mon.a (mon.0) 1590 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:34:48.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:47.012996+0000 mgr.y (mgr.14505) 677 : cluster [DBG] pgmap v838: 168 pgs: 1 active+clean+scrubbing+deep, 167 active+clean; 5.8 GiB data, 22 GiB used, 694 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 696 op/s 2024-02-10T08:34:48.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:34:47.298695+0000 mon.c (mon.2) 82 : audit [DBG] from='client.? 172.21.15.18:0/370648006' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:34:49.040 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:34:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:34:49.963 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:34:50.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:34:48.627533+0000 mgr.y (mgr.14505) 678 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:34:50.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:49.013782+0000 mgr.y (mgr.14505) 679 : cluster [DBG] pgmap v839: 168 pgs: 1 active+clean+scrubbing+deep, 167 active+clean; 5.6 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.02k op/s 2024-02-10T08:34:50.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:34:48.627533+0000 mgr.y (mgr.14505) 678 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:34:50.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:49.013782+0000 mgr.y (mgr.14505) 679 : cluster [DBG] pgmap v839: 168 pgs: 1 active+clean+scrubbing+deep, 167 active+clean; 5.6 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.02k op/s 2024-02-10T08:34:50.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:34:48.627533+0000 mgr.y (mgr.14505) 678 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:34:50.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:49.013782+0000 mgr.y (mgr.14505) 679 : cluster [DBG] pgmap v839: 168 pgs: 1 active+clean+scrubbing+deep, 167 active+clean; 5.6 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.02k op/s 2024-02-10T08:34:51.538 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-10T08:34:51.935 INFO:teuthology.orchestra.run.smithi018.stderr:set pool 3 pgp_num to 3 2024-02-10T08:34:52.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:51 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:51.014304+0000 mgr.y (mgr.14505) 680 : cluster [DBG] pgmap v840: 168 pgs: 1 active+clean+scrubbing+deep, 167 active+clean; 5.5 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1.02k op/s 2024-02-10T08:34:52.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:51 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:34:51.093721+0000 mon.b (mon.1) 81 : audit [INF] from='client.? 172.21.15.18:0/1507782713' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "iscsi", "var": "pgp_num", "val": "3"}]: dispatch 2024-02-10T08:34:52.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:51 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:34:51.094438+0000 mon.a (mon.0) 1591 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "iscsi", "var": "pgp_num", "val": "3"}]: dispatch 2024-02-10T08:34:52.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:51.014304+0000 mgr.y (mgr.14505) 680 : cluster [DBG] pgmap v840: 168 pgs: 1 active+clean+scrubbing+deep, 167 active+clean; 5.5 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1.02k op/s 2024-02-10T08:34:52.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:34:51.093721+0000 mon.b (mon.1) 81 : audit [INF] from='client.? 172.21.15.18:0/1507782713' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "iscsi", "var": "pgp_num", "val": "3"}]: dispatch 2024-02-10T08:34:52.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:34:51.094438+0000 mon.a (mon.0) 1591 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "iscsi", "var": "pgp_num", "val": "3"}]: dispatch 2024-02-10T08:34:52.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:51.014304+0000 mgr.y (mgr.14505) 680 : cluster [DBG] pgmap v840: 168 pgs: 1 active+clean+scrubbing+deep, 167 active+clean; 5.5 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1.02k op/s 2024-02-10T08:34:52.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:34:51.093721+0000 mon.b (mon.1) 81 : audit [INF] from='client.? 172.21.15.18:0/1507782713' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "iscsi", "var": "pgp_num", "val": "3"}]: dispatch 2024-02-10T08:34:52.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:34:51.094438+0000 mon.a (mon.0) 1591 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "iscsi", "var": "pgp_num", "val": "3"}]: dispatch 2024-02-10T08:34:52.967 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:34:52.971 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:52.971 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:34:53.072 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:34:53.107 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:53.200 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:34:51.915143+0000 mon.a (mon.0) 1592 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "iscsi", "var": "pgp_num", "val": "3"}]': finished 2024-02-10T08:34:53.200 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:51.915199+0000 mon.a (mon.0) 1593 : cluster [DBG] osdmap e375: 8 total, 8 up, 8 in 2024-02-10T08:34:53.201 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:34:51.915143+0000 mon.a (mon.0) 1592 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "iscsi", "var": "pgp_num", "val": "3"}]': finished 2024-02-10T08:34:53.201 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:51.915199+0000 mon.a (mon.0) 1593 : cluster [DBG] osdmap e375: 8 total, 8 up, 8 in 2024-02-10T08:34:53.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:52 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:34:51.915143+0000 mon.a (mon.0) 1592 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "iscsi", "var": "pgp_num", "val": "3"}]': finished 2024-02-10T08:34:53.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:52 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:51.915199+0000 mon.a (mon.0) 1593 : cluster [DBG] osdmap e375: 8 total, 8 up, 8 in 2024-02-10T08:34:53.464 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:34:53.468 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:53.468 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:34:53.569 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:34:53.648 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:53.792 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-02-10T08:34:53.792 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-02-10T08:34:53.792 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:34:53.792 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.25369.0:161656 10.f 10:fe8a3ae1:::benchmark_data_smithi018_146618_object37853:head [delete] snapc 0=[] ondisk+write+known_if_redirected e375)", 2024-02-10T08:34:53.793 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:34:53.766268+0000", 2024-02-10T08:34:53.793 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.016011338999999999, 2024-02-10T08:34:53.793 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016040959, 2024-02-10T08:34:53.793 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:34:53.793 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "waiting for sub ops", 2024-02-10T08:34:53.793 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:34:53.793 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.25369", 2024-02-10T08:34:53.793 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3974730810", 2024-02-10T08:34:53.793 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 161656 2024-02-10T08:34:53.793 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:34:53.793 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:34:53.793 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:34:53.793 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:34:53.793 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:53.766268+0000", 2024-02-10T08:34:53.793 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:34:53.794 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:34:53.794 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:34:53.794 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:34:53.794 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:53.766268+0000", 2024-02-10T08:34:53.794 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-02-10T08:34:53.794 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:34:53.794 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:34:53.794 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:34:53.794 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:53.766267+0000", 2024-02-10T08:34:53.794 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9759999999999998e-06 2024-02-10T08:34:53.794 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:34:53.794 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:34:53.794 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:34:53.794 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:53.766273+0000", 2024-02-10T08:34:53.795 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1046999999999999e-05 2024-02-10T08:34:53.795 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:34:53.795 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:34:53.795 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:34:53.795 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:53.766285+0000", 2024-02-10T08:34:53.795 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5880000000000003e-06 2024-02-10T08:34:53.795 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:34:53.795 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:34:53.795 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:34:53.795 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:53.766291+0000", 2024-02-10T08:34:53.795 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00027203299999999998 2024-02-10T08:34:53.795 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:34:53.795 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:34:53.795 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:34:53.796 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:53.766563+0000", 2024-02-10T08:34:53.796 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7782000000000007e-05 2024-02-10T08:34:53.796 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:34:53.796 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:34:53.796 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:34:53.796 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:53.766661+0000", 2024-02-10T08:34:53.796 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000117089 2024-02-10T08:34:53.796 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:34:53.796 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:34:53.796 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2,3", 2024-02-10T08:34:53.796 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:53.766778+0000", 2024-02-10T08:34:53.796 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0021189529999999998 2024-02-10T08:34:53.796 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:34:53.796 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:34:53.797 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:34:53.797 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:53.768897+0000", 2024-02-10T08:34:53.797 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026290649999999999 2024-02-10T08:34:53.797 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:34:53.797 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:34:53.797 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:34:53.797 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:34:53.797 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:34:53.797 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.25369.0:161667 10.a 10:5f4ecb6b:::benchmark_data_smithi018_146618_object37864:head [delete] snapc 0=[] ondisk+write+known_if_redirected e375)", 2024-02-10T08:34:53.797 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:34:53.766530+0000", 2024-02-10T08:34:53.797 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.015748966, 2024-02-10T08:34:53.797 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015871172999999999, 2024-02-10T08:34:53.797 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:34:53.797 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "waiting for sub ops", 2024-02-10T08:34:53.798 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:34:53.798 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.25369", 2024-02-10T08:34:53.798 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3974730810", 2024-02-10T08:34:53.798 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 161667 2024-02-10T08:34:53.798 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:34:53.798 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:34:53.798 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:34:53.798 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:34:53.798 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:53.766530+0000", 2024-02-10T08:34:53.798 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:34:53.798 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:34:53.798 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:34:53.798 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:34:53.799 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:53.766530+0000", 2024-02-10T08:34:53.799 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-02-10T08:34:53.799 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:34:53.799 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:34:53.799 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:34:53.799 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:53.766530+0000", 2024-02-10T08:34:53.799 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2470000000000002e-06 2024-02-10T08:34:53.799 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:34:53.799 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:34:53.799 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:34:53.799 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:53.766534+0000", 2024-02-10T08:34:53.799 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7989999999999996e-06 2024-02-10T08:34:53.799 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:34:53.800 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:34:53.800 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:34:53.800 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:53.766541+0000", 2024-02-10T08:34:53.800 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0320000000000003e-06 2024-02-10T08:34:53.800 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:34:53.800 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:34:53.800 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:34:53.800 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:53.766546+0000", 2024-02-10T08:34:53.800 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0056187429999999998 2024-02-10T08:34:53.800 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:34:53.800 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:34:53.800 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:34:53.800 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:53.772164+0000", 2024-02-10T08:34:53.800 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000120281 2024-02-10T08:34:53.801 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:34:53.801 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:34:53.801 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:34:53.801 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:53.772285+0000", 2024-02-10T08:34:53.801 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000119647 2024-02-10T08:34:53.801 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:34:53.801 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:34:53.801 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,5", 2024-02-10T08:34:53.801 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:53.772404+0000", 2024-02-10T08:34:53.801 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028142779999999999 2024-02-10T08:34:53.801 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:34:53.801 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:34:53.801 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:34:53.801 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:53.775219+0000", 2024-02-10T08:34:53.802 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0086882599999999997 2024-02-10T08:34:53.802 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:34:53.802 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:34:53.802 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:34:53.802 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:34:53.802 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:34:53.802 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.25369.0:161663 10.7 e375/364 10:e2aa5c87:::benchmark_data_smithi018_146618_object37860:head v 375'10244, mlcod=375'10242)", 2024-02-10T08:34:53.802 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:34:53.772197+0000", 2024-02-10T08:34:53.802 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.010082093, 2024-02-10T08:34:53.802 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.01029483, 2024-02-10T08:34:53.802 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:34:53.802 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-02-10T08:34:53.802 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:34:53.802 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:34:53.803 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:34:53.803 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:53.772197+0000", 2024-02-10T08:34:53.803 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:34:53.803 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:34:53.803 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:34:53.803 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:34:53.803 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:53.772197+0000", 2024-02-10T08:34:53.803 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-02-10T08:34:53.803 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:34:53.803 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:34:53.803 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:34:53.803 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:53.772197+0000", 2024-02-10T08:34:53.803 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4469999999999999e-06 2024-02-10T08:34:53.803 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:34:53.803 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:34:53.804 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:34:53.804 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:53.772201+0000", 2024-02-10T08:34:53.804 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3499999999999996e-06 2024-02-10T08:34:53.804 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:34:53.804 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:34:53.804 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:34:53.804 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:53.772207+0000", 2024-02-10T08:34:53.804 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8500000000000002e-06 2024-02-10T08:34:53.804 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:34:53.804 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:34:53.804 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:34:53.804 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:53.772211+0000", 2024-02-10T08:34:53.804 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5546999999999997e-05 2024-02-10T08:34:53.804 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:34:53.805 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:34:53.805 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:34:53.805 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:53.772247+0000", 2024-02-10T08:34:53.805 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8966000000000001e-05 2024-02-10T08:34:53.805 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:34:53.805 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:34:53.805 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:34:53.805 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:53.772266+0000", 2024-02-10T08:34:53.805 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8732999999999994e-05 2024-02-10T08:34:53.805 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:34:53.805 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:34:53.805 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:34:53.805 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:34:53.805 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:34:53.806 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.25369.0:161672 10.a 10:54a33f15:::benchmark_data_smithi018_146618_object37869:head [delete] snapc 0=[] ondisk+write+known_if_redirected e375)", 2024-02-10T08:34:53.806 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:34:53.778909+0000", 2024-02-10T08:34:53.806 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0033699250000000002, 2024-02-10T08:34:53.806 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003651049, 2024-02-10T08:34:53.806 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:34:53.806 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "waiting for sub ops", 2024-02-10T08:34:53.806 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:34:53.806 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.25369", 2024-02-10T08:34:53.806 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3974730810", 2024-02-10T08:34:53.806 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 161672 2024-02-10T08:34:53.806 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:34:53.806 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:34:53.806 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:34:53.806 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:34:53.806 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:53.778909+0000", 2024-02-10T08:34:53.807 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:34:53.807 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:34:53.807 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:34:53.807 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:34:53.807 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:53.778909+0000", 2024-02-10T08:34:53.807 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-02-10T08:34:53.807 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:34:53.807 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:34:53.807 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:34:53.807 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:53.778908+0000", 2024-02-10T08:34:53.807 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6220000000000003e-06 2024-02-10T08:34:53.807 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:34:53.807 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:34:53.807 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:34:53.807 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:53.778915+0000", 2024-02-10T08:34:53.808 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4335000000000001e-05 2024-02-10T08:34:53.808 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:34:53.808 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:34:53.808 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:34:53.808 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:53.778929+0000", 2024-02-10T08:34:53.808 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2840000000000001e-06 2024-02-10T08:34:53.808 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:34:53.808 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:34:53.808 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:34:53.808 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:53.778936+0000", 2024-02-10T08:34:53.808 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7904000000000002e-05 2024-02-10T08:34:53.808 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:34:53.808 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:34:53.808 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:34:53.808 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:53.778974+0000", 2024-02-10T08:34:53.809 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011243099999999999 2024-02-10T08:34:53.809 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:34:53.809 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:34:53.809 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:34:53.809 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:53.779087+0000", 2024-02-10T08:34:53.809 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015022500000000001 2024-02-10T08:34:53.809 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:34:53.809 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:34:53.809 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,5", 2024-02-10T08:34:53.809 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:53.779237+0000", 2024-02-10T08:34:53.809 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00032750100000000001 2024-02-10T08:34:53.809 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:34:53.809 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:34:53.809 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:34:53.809 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:34:53.810 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:34:53.810 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.25369.0:161677 10.0 10:047828f2:::benchmark_data_smithi018_146618_object37874:head [delete] snapc 0=[] ondisk+write+known_if_redirected e375)", 2024-02-10T08:34:53.810 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:34:53.779122+0000", 2024-02-10T08:34:53.810 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0031570809999999999, 2024-02-10T08:34:53.810 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003530947, 2024-02-10T08:34:53.810 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:34:53.810 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "waiting for sub ops", 2024-02-10T08:34:53.810 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:34:53.810 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.25369", 2024-02-10T08:34:53.810 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3974730810", 2024-02-10T08:34:53.810 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 161677 2024-02-10T08:34:53.810 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:34:53.810 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:34:53.810 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:34:53.811 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:34:53.811 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:53.779122+0000", 2024-02-10T08:34:53.811 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:34:53.811 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:34:53.811 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:34:53.811 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:34:53.811 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:53.779122+0000", 2024-02-10T08:34:53.811 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-02-10T08:34:53.811 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:34:53.811 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:34:53.811 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:34:53.811 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:53.779121+0000", 2024-02-10T08:34:53.811 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5370000000000003e-06 2024-02-10T08:34:53.811 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:34:53.811 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:34:53.811 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:34:53.812 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:53.779128+0000", 2024-02-10T08:34:53.812 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0118e-05 2024-02-10T08:34:53.812 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:34:53.812 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:34:53.812 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:34:53.812 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:53.779138+0000", 2024-02-10T08:34:53.812 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6560000000000003e-06 2024-02-10T08:34:53.812 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:34:53.812 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:34:53.812 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:34:53.812 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:53.779144+0000", 2024-02-10T08:34:53.812 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4858999999999998e-05 2024-02-10T08:34:53.812 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:34:53.812 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:34:53.813 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:34:53.813 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:53.779199+0000", 2024-02-10T08:34:53.813 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000132008 2024-02-10T08:34:53.813 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:34:53.813 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:34:53.813 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:34:53.813 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:53.779331+0000", 2024-02-10T08:34:53.813 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000131987 2024-02-10T08:34:53.813 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:34:53.813 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:34:53.813 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1,4", 2024-02-10T08:34:53.813 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:53.779463+0000", 2024-02-10T08:34:53.813 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0031604210000000001 2024-02-10T08:34:53.813 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:34:53.813 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:34:53.814 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:34:53.814 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:53.782624+0000", 2024-02-10T08:34:53.814 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035014690000000001 2024-02-10T08:34:53.814 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:34:53.814 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:34:53.814 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:34:53.814 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:34:53.814 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:34:53.814 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop_reply(client.25369.0:161656 10.f e375/335)", 2024-02-10T08:34:53.814 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:34:53.782703+0000", 2024-02-10T08:34:53.814 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4294967295.9995766, 2024-02-10T08:34:53.814 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0429e-05, 2024-02-10T08:34:53.814 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:34:53.814 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-02-10T08:34:53.814 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:34:53.815 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:34:53.815 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:34:53.815 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:53.782703+0000", 2024-02-10T08:34:53.815 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:34:53.815 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:34:53.815 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:34:53.815 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:34:53.815 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:53.782703+0000", 2024-02-10T08:34:53.815 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-02-10T08:34:53.815 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:34:53.815 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:34:53.815 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:34:53.815 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:53.782702+0000", 2024-02-10T08:34:53.815 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4280000000000001e-06 2024-02-10T08:34:53.815 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:34:53.816 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:34:53.816 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:34:53.816 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:53.782708+0000", 2024-02-10T08:34:53.816 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1773999999999999e-05 2024-02-10T08:34:53.816 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:34:53.816 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:34:53.816 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:34:53.816 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:53.782720+0000", 2024-02-10T08:34:53.816 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2559999999999999e-06 2024-02-10T08:34:53.816 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:34:53.816 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:34:53.816 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:34:53.816 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:53.782727+0000", 2024-02-10T08:34:53.816 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3743e-05 2024-02-10T08:34:53.817 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:34:53.817 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:34:53.817 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:34:53.817 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:34:53.817 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:34:53.817 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "rep_scrubmap(10.f e335 from shard 2)", 2024-02-10T08:34:53.817 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:34:53.782735+0000", 2024-02-10T08:34:53.817 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4294967295.9995441, 2024-02-10T08:34:53.817 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5955999999999998e-05, 2024-02-10T08:34:53.817 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:34:53.817 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-02-10T08:34:53.817 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:34:53.817 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:34:53.817 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:34:53.817 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:53.782735+0000", 2024-02-10T08:34:53.817 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:34:53.818 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:34:53.818 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:34:53.818 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:34:53.818 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:53.782735+0000", 2024-02-10T08:34:53.818 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-02-10T08:34:53.818 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:34:53.818 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:34:53.818 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:34:53.818 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:53.782735+0000", 2024-02-10T08:34:53.818 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4583000000000001e-05 2024-02-10T08:34:53.818 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:34:53.818 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:34:53.818 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:34:53.818 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:53.782749+0000", 2024-02-10T08:34:53.818 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4919999999999998e-06 2024-02-10T08:34:53.819 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:34:53.819 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:34:53.819 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:34:53.819 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:53.782756+0000", 2024-02-10T08:34:53.819 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0339999999999998e-06 2024-02-10T08:34:53.819 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:34:53.819 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:34:53.819 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:34:53.819 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:53.782760+0000", 2024-02-10T08:34:53.819 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4692e-05 2024-02-10T08:34:53.819 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:34:53.819 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:34:53.819 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:34:53.819 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:34:53.820 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:34:53.820 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.25369.0:161679 10.7 e375/364)", 2024-02-10T08:34:53.820 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:34:53.782775+0000", 2024-02-10T08:34:53.820 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4294967295.9995046, 2024-02-10T08:34:53.820 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6853999999999994e-05, 2024-02-10T08:34:53.820 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:34:53.820 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-02-10T08:34:53.820 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:34:53.820 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:34:53.820 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:34:53.820 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:53.782775+0000", 2024-02-10T08:34:53.820 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:34:53.820 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:34:53.820 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:34:53.820 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:34:53.821 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:53.782775+0000", 2024-02-10T08:34:53.821 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-02-10T08:34:53.821 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:34:53.821 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:34:53.821 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:34:53.821 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:53.782774+0000", 2024-02-10T08:34:53.821 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6600000000000003e-06 2024-02-10T08:34:53.821 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:34:53.821 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:34:53.821 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:34:53.821 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:53.782779+0000", 2024-02-10T08:34:53.821 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0379999999999996e-06 2024-02-10T08:34:53.821 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:34:53.821 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:34:53.822 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:34:53.822 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:53.782785+0000", 2024-02-10T08:34:53.822 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.493e-06 2024-02-10T08:34:53.822 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:34:53.822 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:34:53.822 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:34:53.822 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:53.782789+0000", 2024-02-10T08:34:53.822 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4793e-05 2024-02-10T08:34:53.822 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:34:53.822 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:34:53.822 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:34:53.822 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:34:53.822 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-02-10T08:34:53.822 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 8 2024-02-10T08:34:53.822 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-02-10T08:34:53.873 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:34:53.881 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:53.882 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:34:53.982 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:34:54.037 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:54.072 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:34:54.076 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:54.076 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:53 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:53.014960+0000 mgr.y (mgr.14505) 681 : cluster [DBG] pgmap v842: 168 pgs: 1 active+clean+scrubbing+deep, 167 active+clean; 5.4 GiB data, 21 GiB used, 695 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 853 op/s 2024-02-10T08:34:54.077 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:34:54.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:53.014960+0000 mgr.y (mgr.14505) 681 : cluster [DBG] pgmap v842: 168 pgs: 1 active+clean+scrubbing+deep, 167 active+clean; 5.4 GiB data, 21 GiB used, 695 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 853 op/s 2024-02-10T08:34:54.158 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:53.014960+0000 mgr.y (mgr.14505) 681 : cluster [DBG] pgmap v842: 168 pgs: 1 active+clean+scrubbing+deep, 167 active+clean; 5.4 GiB data, 21 GiB used, 695 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 853 op/s 2024-02-10T08:34:54.178 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:34:54.179 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:34:54.212 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:54.549 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.6 dump_blocked_ops 2024-02-10T08:34:54.564 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:34:54.568 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:54.568 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:34:54.669 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:34:54.731 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:54.761 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:34:54.767 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:54.767 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:34:54.868 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:34:54.942 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:54.978 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is set 2024-02-10T08:34:54.979 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:34:54.988 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:54.989 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:34:54.990 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:34:55.090 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:34:55.149 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:34:54.481302+0000 mon.a (mon.0) 1594 : audit [INF] from='client.? 172.21.15.18:0/1765388446' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:34:55.151 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:34:54.481302+0000 mon.a (mon.0) 1594 : audit [INF] from='client.? 172.21.15.18:0/1765388446' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:34:55.153 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:55.276 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:54 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:34:54.481302+0000 mon.a (mon.0) 1594 : audit [INF] from='client.? 172.21.15.18:0/1765388446' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:34:56.122 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:34:56.125 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:56.126 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:34:56.227 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:34:56.265 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:54.764296+0000 osd.2 (osd.2) 195 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:34:56.265 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:54.764348+0000 osd.2 (osd.2) 196 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:34:56.265 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:54.942264+0000 mon.a (mon.0) 1595 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:34:56.265 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:34:54.958715+0000 mon.a (mon.0) 1596 : audit [INF] from='client.? 172.21.15.18:0/1765388446' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-10T08:34:56.265 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:54.958775+0000 mon.a (mon.0) 1597 : cluster [DBG] osdmap e376: 8 total, 8 up, 8 in 2024-02-10T08:34:56.265 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:55.016782+0000 mgr.y (mgr.14505) 682 : cluster [DBG] pgmap v844: 168 pgs: 1 active+clean+scrubbing+deep, 167 active+clean; 5.3 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 969 op/s 2024-02-10T08:34:56.265 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:54.764296+0000 osd.2 (osd.2) 195 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:34:56.266 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:54.764348+0000 osd.2 (osd.2) 196 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:34:56.266 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:54.942264+0000 mon.a (mon.0) 1595 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:34:56.266 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:34:54.958715+0000 mon.a (mon.0) 1596 : audit [INF] from='client.? 172.21.15.18:0/1765388446' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-10T08:34:56.266 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:54.958775+0000 mon.a (mon.0) 1597 : cluster [DBG] osdmap e376: 8 total, 8 up, 8 in 2024-02-10T08:34:56.266 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:55.016782+0000 mgr.y (mgr.14505) 682 : cluster [DBG] pgmap v844: 168 pgs: 1 active+clean+scrubbing+deep, 167 active+clean; 5.3 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 969 op/s 2024-02-10T08:34:56.274 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:56.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:54.764296+0000 osd.2 (osd.2) 195 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:34:56.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:54.764348+0000 osd.2 (osd.2) 196 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:34:56.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:54.942264+0000 mon.a (mon.0) 1595 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:34:56.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:34:54.958715+0000 mon.a (mon.0) 1596 : audit [INF] from='client.? 172.21.15.18:0/1765388446' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-10T08:34:56.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:54.958775+0000 mon.a (mon.0) 1597 : cluster [DBG] osdmap e376: 8 total, 8 up, 8 in 2024-02-10T08:34:56.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:55.016782+0000 mgr.y (mgr.14505) 682 : cluster [DBG] pgmap v844: 168 pgs: 1 active+clean+scrubbing+deep, 167 active+clean; 5.3 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 969 op/s 2024-02-10T08:34:56.772 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:34:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:34:56] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:34:57.139 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-02-10T08:34:57.139 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-02-10T08:34:57.139 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-02-10T08:34:57.139 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-02-10T08:34:57.139 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-02-10T08:34:57.169 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:34:57.173 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:57.174 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:34:57.275 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:34:57.326 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:57.408 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:34:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:34:57] "GET /metrics HTTP/1.1" 200 176425 "" "Prometheus/2.33.4" 2024-02-10T08:34:57.478 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:34:57.484 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:57.484 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:34:57.539 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:34:57.568 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:34:57.585 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:34:57.614 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:34:57.642 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:57.663 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:34:57.665 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:34:57.668 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:57.669 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:34:57.700 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:34:57.733 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:34:57.768 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:34:57.769 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:34:57.798 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:34:57.812 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-10T08:34:57.812 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-10T08:34:57.812 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-10T08:34:57.813 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-10T08:34:57.813 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-10T08:34:57.813 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-10T08:34:57.813 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-10T08:34:57.813 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-10T08:34:57.827 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:57.870 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:34:57.878 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:57.878 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:34:57.904 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.6 dump_historic_ops 2024-02-10T08:34:57.980 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:34:58.053 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:58.074 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd unset noscrub 2024-02-10T08:34:58.104 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:34:58.114 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:34:58.115 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:34:58.215 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:34:58.268 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:34:58.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:57.017435+0000 mgr.y (mgr.14505) 683 : cluster [DBG] pgmap v845: 168 pgs: 1 active+clean+scrubbing+deep, 167 active+clean; 5.3 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 623 op/s 2024-02-10T08:34:58.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:34:57.497287+0000 mon.c (mon.2) 83 : audit [DBG] from='client.? 172.21.15.18:0/698302774' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:34:58.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:57.017435+0000 mgr.y (mgr.14505) 683 : cluster [DBG] pgmap v845: 168 pgs: 1 active+clean+scrubbing+deep, 167 active+clean; 5.3 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 623 op/s 2024-02-10T08:34:58.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:34:57.497287+0000 mon.c (mon.2) 83 : audit [DBG] from='client.? 172.21.15.18:0/698302774' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:34:58.418 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:34:58.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:57.017435+0000 mgr.y (mgr.14505) 683 : cluster [DBG] pgmap v845: 168 pgs: 1 active+clean+scrubbing+deep, 167 active+clean; 5.3 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 623 op/s 2024-02-10T08:34:58.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:34:57.497287+0000 mon.c (mon.2) 83 : audit [DBG] from='client.? 172.21.15.18:0/698302774' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:34:58.604 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 3, 4, 5, 6, 7, 0] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 5, 6, 7, 4] 2024-02-10T08:34:58.604 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-10T08:34:58.604 INFO:tasks.thrashosds.thrasher:inject_pause on osd.2 2024-02-10T08:34:58.604 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-02-10T08:34:58.604 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-02-10T08:34:58.605 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.2 config set filestore_inject_stall 3 2024-02-10T08:34:58.992 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:34:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:34:59.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:59 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:57.682144+0000 osd.4 (osd.4) 132 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:34:59.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:59 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:57.682212+0000 osd.4 (osd.4) 133 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:34:59.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:34:59 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:58.084180+0000 mon.a (mon.0) 1598 : cluster [DBG] osdmap e377: 8 total, 8 up, 8 in 2024-02-10T08:34:59.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:57.682144+0000 osd.4 (osd.4) 132 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:34:59.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:57.682212+0000 osd.4 (osd.4) 133 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:34:59.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:34:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:58.084180+0000 mon.a (mon.0) 1598 : cluster [DBG] osdmap e377: 8 total, 8 up, 8 in 2024-02-10T08:34:59.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:57.682144+0000 osd.4 (osd.4) 132 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:34:59.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:57.682212+0000 osd.4 (osd.4) 133 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:34:59.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:34:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:58.084180+0000 mon.a (mon.0) 1598 : cluster [DBG] osdmap e377: 8 total, 8 up, 8 in 2024-02-10T08:35:00.190 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:34:58.637532+0000 mgr.y (mgr.14505) 684 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:35:00.190 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:34:59.017898+0000 mgr.y (mgr.14505) 685 : cluster [DBG] pgmap v847: 168 pgs: 168 active+clean; 5.0 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 1.17k op/s 2024-02-10T08:35:00.235 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:35:00.245 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:00.245 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:35:00.347 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:35:00.351 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:35:00.376 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:35:00.398 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:34:58.637532+0000 mgr.y (mgr.14505) 684 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:35:00.398 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:34:59.017898+0000 mgr.y (mgr.14505) 685 : cluster [DBG] pgmap v847: 168 pgs: 168 active+clean; 5.0 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 1.17k op/s 2024-02-10T08:35:00.398 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:34:58.637532+0000 mgr.y (mgr.14505) 684 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:35:00.398 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:34:59.017898+0000 mgr.y (mgr.14505) 685 : cluster [DBG] pgmap v847: 168 pgs: 168 active+clean; 5.0 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 1.17k op/s 2024-02-10T08:35:00.403 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:00.443 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:35:00.444 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:00.445 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:35:00.495 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-02-10T08:35:00.495 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:35:00.546 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:35:00.611 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:01.267 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:35:01.270 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:01.271 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:35:01.297 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.7 dump_ops_in_flight 2024-02-10T08:35:01.372 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:35:01.426 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:01.772 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:35:02.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:01.018361+0000 mgr.y (mgr.14505) 686 : cluster [DBG] pgmap v848: 168 pgs: 168 active+clean; 5.0 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 875 op/s 2024-02-10T08:35:02.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:01.018361+0000 mgr.y (mgr.14505) 686 : cluster [DBG] pgmap v848: 168 pgs: 168 active+clean; 5.0 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 875 op/s 2024-02-10T08:35:02.181 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:01.018361+0000 mgr.y (mgr.14505) 686 : cluster [DBG] pgmap v848: 168 pgs: 168 active+clean; 5.0 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 875 op/s 2024-02-10T08:35:02.256 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-10T08:35:03.698 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:35:03.704 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:03.704 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:35:03.805 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:35:03.872 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:03.876 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-02-10T08:35:03.877 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:35:03.907 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:35:03.910 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:03.911 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:35:04.011 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:35:04.063 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:04.270 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:03.019109+0000 mgr.y (mgr.14505) 687 : cluster [DBG] pgmap v849: 168 pgs: 168 active+clean; 4.8 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.14k op/s 2024-02-10T08:35:04.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:03.019109+0000 mgr.y (mgr.14505) 687 : cluster [DBG] pgmap v849: 168 pgs: 168 active+clean; 4.8 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.14k op/s 2024-02-10T08:35:04.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:03.019109+0000 mgr.y (mgr.14505) 687 : cluster [DBG] pgmap v849: 168 pgs: 168 active+clean; 4.8 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.14k op/s 2024-02-10T08:35:04.491 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-02-10T08:35:04.491 INFO:teuthology.orchestra.run.smithi018.stdout: "success": "" 2024-02-10T08:35:04.491 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-02-10T08:35:04.658 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.7 dump_blocked_ops 2024-02-10T08:35:04.877 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:35:04.881 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:04.882 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:35:04.982 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:35:05.035 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:05.087 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:35:05.095 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:05.095 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:35:05.142 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:35:05.167 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:35:05.197 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:35:05.261 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:05.477 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:35:05.489 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:05.490 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:35:05.590 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:35:05.655 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:05.735 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:35:05.738 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:05.739 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:35:05.839 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:35:05.885 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:06.023 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:35:06.027 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:06.028 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:35:06.118 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:05.019582+0000 mgr.y (mgr.14505) 688 : cluster [DBG] pgmap v850: 168 pgs: 168 active+clean; 4.7 GiB data, 19 GiB used, 697 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.05k op/s 2024-02-10T08:35:06.129 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:35:06.185 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:06.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:05.019582+0000 mgr.y (mgr.14505) 688 : cluster [DBG] pgmap v850: 168 pgs: 168 active+clean; 4.7 GiB data, 19 GiB used, 697 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.05k op/s 2024-02-10T08:35:06.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:05.019582+0000 mgr.y (mgr.14505) 688 : cluster [DBG] pgmap v850: 168 pgs: 168 active+clean; 4.7 GiB data, 19 GiB used, 697 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.05k op/s 2024-02-10T08:35:06.789 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:35:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:35:06] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:35:07.277 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is unset 2024-02-10T08:35:07.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:35:06.391230+0000 mon.a (mon.0) 1599 : audit [INF] from='client.? 172.21.15.18:0/2376513930' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:35:07.302 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-02-10T08:35:07.302 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:35:07.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:35:06.391230+0000 mon.a (mon.0) 1599 : audit [INF] from='client.? 172.21.15.18:0/2376513930' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:35:07.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:35:06.391230+0000 mon.a (mon.0) 1599 : audit [INF] from='client.? 172.21.15.18:0/2376513930' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:35:07.407 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:35:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:35:07] "GET /metrics HTTP/1.1" 200 176417 "" "Prometheus/2.33.4" 2024-02-10T08:35:07.553 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:35:07.557 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:07.557 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:35:07.658 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:35:07.704 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:08.071 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:35:08.074 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:08.074 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:35:08.084 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.7 dump_historic_ops 2024-02-10T08:35:08.175 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:35:08.255 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:08.285 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:35:08.287 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:08.288 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:35:08.389 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:35:08.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:07.020232+0000 mgr.y (mgr.14505) 689 : cluster [DBG] pgmap v851: 168 pgs: 168 active+clean; 4.6 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.08k op/s 2024-02-10T08:35:08.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:07.108975+0000 mon.a (mon.0) 1600 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:35:08.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:35:07.124267+0000 mon.a (mon.0) 1601 : audit [INF] from='client.? 172.21.15.18:0/2376513930' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-10T08:35:08.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:07.124397+0000 mon.a (mon.0) 1602 : cluster [DBG] osdmap e378: 8 total, 8 up, 8 in 2024-02-10T08:35:08.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:07.246727+0000 osd.0 (osd.0) 205 : cluster [DBG] 2.1e scrub starts 2024-02-10T08:35:08.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:07.249964+0000 osd.0 (osd.0) 206 : cluster [DBG] 2.1e scrub ok 2024-02-10T08:35:08.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:07.020232+0000 mgr.y (mgr.14505) 689 : cluster [DBG] pgmap v851: 168 pgs: 168 active+clean; 4.6 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.08k op/s 2024-02-10T08:35:08.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:07.108975+0000 mon.a (mon.0) 1600 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:35:08.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:35:07.124267+0000 mon.a (mon.0) 1601 : audit [INF] from='client.? 172.21.15.18:0/2376513930' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-10T08:35:08.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:07.124397+0000 mon.a (mon.0) 1602 : cluster [DBG] osdmap e378: 8 total, 8 up, 8 in 2024-02-10T08:35:08.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:07.246727+0000 osd.0 (osd.0) 205 : cluster [DBG] 2.1e scrub starts 2024-02-10T08:35:08.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:07.249964+0000 osd.0 (osd.0) 206 : cluster [DBG] 2.1e scrub ok 2024-02-10T08:35:08.443 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:07.020232+0000 mgr.y (mgr.14505) 689 : cluster [DBG] pgmap v851: 168 pgs: 168 active+clean; 4.6 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.08k op/s 2024-02-10T08:35:08.443 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:07.108975+0000 mon.a (mon.0) 1600 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:35:08.443 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:35:07.124267+0000 mon.a (mon.0) 1601 : audit [INF] from='client.? 172.21.15.18:0/2376513930' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-10T08:35:08.443 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:07.124397+0000 mon.a (mon.0) 1602 : cluster [DBG] osdmap e378: 8 total, 8 up, 8 in 2024-02-10T08:35:08.444 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:07.246727+0000 osd.0 (osd.0) 205 : cluster [DBG] 2.1e scrub starts 2024-02-10T08:35:08.444 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:07.249964+0000 osd.0 (osd.0) 206 : cluster [DBG] 2.1e scrub ok 2024-02-10T08:35:08.446 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:08.479 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:35:08.486 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:08.487 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:35:08.582 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:35:08.587 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:35:08.658 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:08.794 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:35:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:35:08.874 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:35:08.877 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:08.878 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:35:08.979 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:35:09.029 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:09.149 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:07.732601+0000 osd.1 (osd.1) 226 : cluster [DBG] 3.0 scrub starts 2024-02-10T08:35:09.150 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:07.739612+0000 osd.1 (osd.1) 227 : cluster [DBG] 3.0 scrub ok 2024-02-10T08:35:09.150 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:08.178568+0000 osd.5 (osd.5) 229 : cluster [DBG] 5.1b scrub starts 2024-02-10T08:35:09.150 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:08.193498+0000 osd.5 (osd.5) 230 : cluster [DBG] 5.1b scrub ok 2024-02-10T08:35:09.150 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:09.014641+0000 osd.4 (osd.4) 134 : cluster [DBG] 6.2a scrub starts 2024-02-10T08:35:09.150 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:09.039920+0000 osd.4 (osd.4) 135 : cluster [DBG] 6.2a scrub ok 2024-02-10T08:35:09.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:07.732601+0000 osd.1 (osd.1) 226 : cluster [DBG] 3.0 scrub starts 2024-02-10T08:35:09.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:07.739612+0000 osd.1 (osd.1) 227 : cluster [DBG] 3.0 scrub ok 2024-02-10T08:35:09.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:08.178568+0000 osd.5 (osd.5) 229 : cluster [DBG] 5.1b scrub starts 2024-02-10T08:35:09.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:08.193498+0000 osd.5 (osd.5) 230 : cluster [DBG] 5.1b scrub ok 2024-02-10T08:35:09.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:09.014641+0000 osd.4 (osd.4) 134 : cluster [DBG] 6.2a scrub starts 2024-02-10T08:35:09.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:09.039920+0000 osd.4 (osd.4) 135 : cluster [DBG] 6.2a scrub ok 2024-02-10T08:35:09.407 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:07.732601+0000 osd.1 (osd.1) 226 : cluster [DBG] 3.0 scrub starts 2024-02-10T08:35:09.407 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:07.739612+0000 osd.1 (osd.1) 227 : cluster [DBG] 3.0 scrub ok 2024-02-10T08:35:09.407 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:08.178568+0000 osd.5 (osd.5) 229 : cluster [DBG] 5.1b scrub starts 2024-02-10T08:35:09.407 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:08.193498+0000 osd.5 (osd.5) 230 : cluster [DBG] 5.1b scrub ok 2024-02-10T08:35:09.407 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:09.014641+0000 osd.4 (osd.4) 134 : cluster [DBG] 6.2a scrub starts 2024-02-10T08:35:09.407 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:09.039920+0000 osd.4 (osd.4) 135 : cluster [DBG] 6.2a scrub ok 2024-02-10T08:35:09.609 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:35:09.614 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:09.615 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:35:09.716 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:35:09.782 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:09.894 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:35:09.901 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:09.901 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:35:10.002 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:35:10.067 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:10.267 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:35:08.650271+0000 mgr.y (mgr.14505) 690 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:35:10.267 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:08.710179+0000 osd.1 (osd.1) 228 : cluster [DBG] 4.10 scrub starts 2024-02-10T08:35:10.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:08.720328+0000 osd.1 (osd.1) 229 : cluster [DBG] 4.10 scrub ok 2024-02-10T08:35:10.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:09.021106+0000 mgr.y (mgr.14505) 691 : cluster [DBG] pgmap v853: 168 pgs: 168 active+clean; 4.3 GiB data, 18 GiB used, 698 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.12k op/s 2024-02-10T08:35:10.291 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:35:10.296 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:10.297 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:35:10.308 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:35:10.336 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:35:10.369 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:35:10.396 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:35:10.398 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:35:10.429 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:35:10.453 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:35:08.650271+0000 mgr.y (mgr.14505) 690 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:35:10.453 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:08.710179+0000 osd.1 (osd.1) 228 : cluster [DBG] 4.10 scrub starts 2024-02-10T08:35:10.453 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:08.720328+0000 osd.1 (osd.1) 229 : cluster [DBG] 4.10 scrub ok 2024-02-10T08:35:10.453 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:09.021106+0000 mgr.y (mgr.14505) 691 : cluster [DBG] pgmap v853: 168 pgs: 168 active+clean; 4.3 GiB data, 18 GiB used, 698 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.12k op/s 2024-02-10T08:35:10.453 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:35:08.650271+0000 mgr.y (mgr.14505) 690 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:35:10.453 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:08.710179+0000 osd.1 (osd.1) 228 : cluster [DBG] 4.10 scrub starts 2024-02-10T08:35:10.453 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:08.720328+0000 osd.1 (osd.1) 229 : cluster [DBG] 4.10 scrub ok 2024-02-10T08:35:10.453 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:09.021106+0000 mgr.y (mgr.14505) 691 : cluster [DBG] pgmap v853: 168 pgs: 168 active+clean; 4.3 GiB data, 18 GiB used, 698 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.12k op/s 2024-02-10T08:35:10.459 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:10.463 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:35:10.498 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:35:10.501 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:35:10.504 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:10.505 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:35:10.536 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:35:10.539 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-10T08:35:10.539 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-10T08:35:10.539 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-10T08:35:10.540 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-10T08:35:10.540 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-10T08:35:10.540 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-10T08:35:10.540 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-10T08:35:10.540 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-10T08:35:10.605 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:35:10.656 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:10.678 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-02-10T08:35:10.678 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-02-10T08:35:10.678 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-02-10T08:35:10.678 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-02-10T08:35:10.678 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.678 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.14964.0:79645 8.c 8:36e194de:::benchmark_data_smithi018_103312_object79644:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e209)", 2024-02-10T08:35:10.678 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:25:25.988449+0000", 2024-02-10T08:35:10.679 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 584.67890288800004, 2024-02-10T08:35:10.679 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.075749432000000005, 2024-02-10T08:35:10.679 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:35:10.679 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:35:10.679 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:35:10.679 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.14964", 2024-02-10T08:35:10.679 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3173131962", 2024-02-10T08:35:10.679 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 79645 2024-02-10T08:35:10.679 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.679 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:35:10.679 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.679 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:35:10.679 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:25.988449+0000", 2024-02-10T08:35:10.680 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:35:10.680 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.680 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.680 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:35:10.680 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:25.988449+0000", 2024-02-10T08:35:10.680 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-02-10T08:35:10.680 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.680 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.680 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:35:10.680 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:25.988448+0000", 2024-02-10T08:35:10.680 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5306000000000001e-05 2024-02-10T08:35:10.680 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.681 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.681 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:35:10.681 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:25.988513+0000", 2024-02-10T08:35:10.681 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5170000000000002e-06 2024-02-10T08:35:10.681 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.681 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.681 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:35:10.681 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:25.988521+0000", 2024-02-10T08:35:10.681 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2259999999999999e-06 2024-02-10T08:35:10.681 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.681 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.681 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:35:10.681 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:25.988525+0000", 2024-02-10T08:35:10.681 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7772999999999999e-05 2024-02-10T08:35:10.681 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.682 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.682 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:35:10.682 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:25.988563+0000", 2024-02-10T08:35:10.682 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000111649 2024-02-10T08:35:10.682 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.682 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.682 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:35:10.682 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:25.988674+0000", 2024-02-10T08:35:10.682 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014434699999999999 2024-02-10T08:35:10.682 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.682 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.682 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3,5", 2024-02-10T08:35:10.682 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:25.988819+0000", 2024-02-10T08:35:10.682 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020879190000000001 2024-02-10T08:35:10.682 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.683 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.683 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:35:10.683 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:25.990907+0000", 2024-02-10T08:35:10.683 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001657585 2024-02-10T08:35:10.683 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.683 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.683 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:35:10.683 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:25.992564+0000", 2024-02-10T08:35:10.683 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.071539987999999999 2024-02-10T08:35:10.683 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.683 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.683 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:35:10.683 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:26.064104+0000", 2024-02-10T08:35:10.683 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7286000000000001e-05 2024-02-10T08:35:10.683 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.684 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.684 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:35:10.684 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:26.064151+0000", 2024-02-10T08:35:10.684 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7021999999999998e-05 2024-02-10T08:35:10.684 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.684 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.684 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:35:10.684 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:25:26.064198+0000", 2024-02-10T08:35:10.684 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.075749432000000005 2024-02-10T08:35:10.684 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:35:10.684 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:35:10.684 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:35:10.684 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.684 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.685 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.15198.0:143514 9.e 9:7972adfa:::benchmark_data_smithi018_124176_object21775:head [delete] snapc 0=[] ondisk+write+known_if_redirected e290)", 2024-02-10T08:35:10.685 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:30:28.471892+0000", 2024-02-10T08:35:10.685 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 282.19545997799997, 2024-02-10T08:35:10.685 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.077509830000000002, 2024-02-10T08:35:10.685 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:35:10.685 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:35:10.685 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:35:10.685 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.15198", 2024-02-10T08:35:10.685 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/1957604827", 2024-02-10T08:35:10.685 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 143514 2024-02-10T08:35:10.685 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.685 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:35:10.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.685 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:35:10.685 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.471892+0000", 2024-02-10T08:35:10.686 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:35:10.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.686 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.686 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:35:10.686 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.471892+0000", 2024-02-10T08:35:10.686 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999981 2024-02-10T08:35:10.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.686 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.686 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:35:10.686 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.471890+0000", 2024-02-10T08:35:10.686 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1789e-05 2024-02-10T08:35:10.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.687 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:35:10.687 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.471902+0000", 2024-02-10T08:35:10.687 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6011e-05 2024-02-10T08:35:10.687 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.687 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:35:10.687 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.471918+0000", 2024-02-10T08:35:10.687 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4250000000000001e-06 2024-02-10T08:35:10.687 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.687 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:35:10.687 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.471925+0000", 2024-02-10T08:35:10.687 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021123499999999999 2024-02-10T08:35:10.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.688 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.688 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:35:10.688 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.472137+0000", 2024-02-10T08:35:10.688 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0021797679999999999 2024-02-10T08:35:10.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.688 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.688 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:35:10.688 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.474316+0000", 2024-02-10T08:35:10.688 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012536700000000001 2024-02-10T08:35:10.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.688 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.688 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1,4", 2024-02-10T08:35:10.688 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.474442+0000", 2024-02-10T08:35:10.689 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0044317719999999996 2024-02-10T08:35:10.689 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.689 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:35:10.689 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.478874+0000", 2024-02-10T08:35:10.689 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022042189999999999 2024-02-10T08:35:10.689 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.689 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:35:10.689 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.481078+0000", 2024-02-10T08:35:10.689 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.068233639999999998 2024-02-10T08:35:10.689 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.689 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:35:10.689 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.549311+0000", 2024-02-10T08:35:10.690 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1298999999999998e-05 2024-02-10T08:35:10.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.690 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.690 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:35:10.690 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.549363+0000", 2024-02-10T08:35:10.690 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9091000000000002e-05 2024-02-10T08:35:10.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.690 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.690 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:35:10.690 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.549402+0000", 2024-02-10T08:35:10.690 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.077509830000000002 2024-02-10T08:35:10.690 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:35:10.690 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:35:10.690 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:35:10.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.691 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.15198.0:143522 9.3 9:c88a4df0:::benchmark_data_smithi018_124176_object21783:head [delete] snapc 0=[] ondisk+write+known_if_redirected e290)", 2024-02-10T08:35:10.691 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:30:28.472171+0000", 2024-02-10T08:35:10.691 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 282.19518135200002, 2024-02-10T08:35:10.691 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.073413009000000001, 2024-02-10T08:35:10.691 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:35:10.691 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:35:10.691 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:35:10.691 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.15198", 2024-02-10T08:35:10.691 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/1957604827", 2024-02-10T08:35:10.691 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 143522 2024-02-10T08:35:10.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.691 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:35:10.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.692 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:35:10.692 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.472171+0000", 2024-02-10T08:35:10.692 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:35:10.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.692 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:35:10.692 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.472171+0000", 2024-02-10T08:35:10.692 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-02-10T08:35:10.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.692 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:35:10.692 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.472170+0000", 2024-02-10T08:35:10.692 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6590000000000004e-06 2024-02-10T08:35:10.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.693 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:35:10.693 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.472175+0000", 2024-02-10T08:35:10.693 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5480999999999999e-05 2024-02-10T08:35:10.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.693 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:35:10.693 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.472201+0000", 2024-02-10T08:35:10.693 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9410000000000004e-06 2024-02-10T08:35:10.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.693 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:35:10.693 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.472207+0000", 2024-02-10T08:35:10.693 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8554999999999998e-05 2024-02-10T08:35:10.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.694 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.694 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:35:10.694 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.472265+0000", 2024-02-10T08:35:10.694 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000107817 2024-02-10T08:35:10.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.694 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.694 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:35:10.694 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.472373+0000", 2024-02-10T08:35:10.694 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014940900000000001 2024-02-10T08:35:10.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.694 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.694 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1,3", 2024-02-10T08:35:10.694 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.472522+0000", 2024-02-10T08:35:10.694 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028071509999999999 2024-02-10T08:35:10.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.695 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:35:10.695 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.475330+0000", 2024-02-10T08:35:10.695 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033079530000000002 2024-02-10T08:35:10.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.695 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:35:10.695 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.478638+0000", 2024-02-10T08:35:10.695 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.066886249999999994 2024-02-10T08:35:10.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.695 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:35:10.695 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.545524+0000", 2024-02-10T08:35:10.696 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4598000000000003e-05 2024-02-10T08:35:10.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.696 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.696 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:35:10.696 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.545558+0000", 2024-02-10T08:35:10.696 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5202999999999999e-05 2024-02-10T08:35:10.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.696 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.696 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:35:10.696 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.545584+0000", 2024-02-10T08:35:10.696 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.073413009000000001 2024-02-10T08:35:10.696 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:35:10.696 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:35:10.696 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:35:10.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.697 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.697 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.15198.0:180020 9.e 9:74420e8b:::benchmark_data_smithi018_124176_object58281:head [delete] snapc 0=[] ondisk+write+known_if_redirected e302)", 2024-02-10T08:35:10.697 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:31:01.806284+0000", 2024-02-10T08:35:10.697 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 248.86106745500001, 2024-02-10T08:35:10.697 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.10681077, 2024-02-10T08:35:10.697 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:35:10.697 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:35:10.697 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:35:10.697 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.15198", 2024-02-10T08:35:10.697 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/1957604827", 2024-02-10T08:35:10.697 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 180020 2024-02-10T08:35:10.697 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.697 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:35:10.697 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.698 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:35:10.698 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:01.806284+0000", 2024-02-10T08:35:10.698 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:35:10.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.698 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:35:10.698 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:01.806284+0000", 2024-02-10T08:35:10.698 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999981 2024-02-10T08:35:10.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.698 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:35:10.698 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:01.806283+0000", 2024-02-10T08:35:10.698 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1589999999999993e-06 2024-02-10T08:35:10.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.699 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:35:10.699 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:01.806291+0000", 2024-02-10T08:35:10.699 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1745e-05 2024-02-10T08:35:10.699 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.699 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.699 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:35:10.699 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:01.806303+0000", 2024-02-10T08:35:10.699 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0800000000000002e-06 2024-02-10T08:35:10.699 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.699 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.699 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:35:10.699 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:01.806309+0000", 2024-02-10T08:35:10.699 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0442000000000003e-05 2024-02-10T08:35:10.699 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.699 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.700 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:35:10.700 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:01.806359+0000", 2024-02-10T08:35:10.700 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000126067 2024-02-10T08:35:10.700 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.700 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.700 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:35:10.700 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:01.806485+0000", 2024-02-10T08:35:10.700 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000133051 2024-02-10T08:35:10.700 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.700 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.700 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1,4", 2024-02-10T08:35:10.700 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:01.806618+0000", 2024-02-10T08:35:10.700 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0021364420000000001 2024-02-10T08:35:10.700 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.701 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.701 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:35:10.701 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:01.808755+0000", 2024-02-10T08:35:10.701 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029590150000000002 2024-02-10T08:35:10.701 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.701 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.701 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:35:10.701 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:01.811714+0000", 2024-02-10T08:35:10.701 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.101322127 2024-02-10T08:35:10.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.702 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.702 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:35:10.702 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:01.913036+0000", 2024-02-10T08:35:10.702 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4730999999999997e-05 2024-02-10T08:35:10.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.702 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.702 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:35:10.702 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:01.913071+0000", 2024-02-10T08:35:10.702 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4630999999999998e-05 2024-02-10T08:35:10.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.702 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.702 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:35:10.702 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:01.913095+0000", 2024-02-10T08:35:10.702 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.10681077 2024-02-10T08:35:10.703 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:35:10.703 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:35:10.703 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:35:10.703 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.703 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.703 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.15198.0:218365 9.e 9:7fdf02a1:::benchmark_data_smithi018_124176_object96626:head [delete] snapc 0=[] ondisk+write+known_if_redirected e315)", 2024-02-10T08:35:10.703 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:31:41.648238+0000", 2024-02-10T08:35:10.703 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 209.019114016, 2024-02-10T08:35:10.703 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.070499681999999994, 2024-02-10T08:35:10.703 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:35:10.704 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:35:10.704 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:35:10.704 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.15198", 2024-02-10T08:35:10.704 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/1957604827", 2024-02-10T08:35:10.704 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 218365 2024-02-10T08:35:10.704 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.704 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:35:10.704 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.704 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:35:10.704 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:41.648238+0000", 2024-02-10T08:35:10.704 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:35:10.704 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.704 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.704 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:35:10.705 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:41.648238+0000", 2024-02-10T08:35:10.705 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-02-10T08:35:10.705 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.705 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.705 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:35:10.705 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:41.648237+0000", 2024-02-10T08:35:10.705 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4300000000000002e-06 2024-02-10T08:35:10.705 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.705 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.705 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:35:10.705 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:41.648241+0000", 2024-02-10T08:35:10.705 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7910000000000001e-06 2024-02-10T08:35:10.706 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.706 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.706 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:35:10.706 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:41.648247+0000", 2024-02-10T08:35:10.706 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0280000000000002e-06 2024-02-10T08:35:10.706 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.706 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.706 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:35:10.706 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:41.648251+0000", 2024-02-10T08:35:10.706 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8238000000000006e-05 2024-02-10T08:35:10.706 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.706 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.707 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:35:10.707 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:41.648319+0000", 2024-02-10T08:35:10.707 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061165655999999999 2024-02-10T08:35:10.707 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.707 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.707 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:35:10.707 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:41.709484+0000", 2024-02-10T08:35:10.707 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014914400000000001 2024-02-10T08:35:10.707 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.707 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.707 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1,4", 2024-02-10T08:35:10.708 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:41.709634+0000", 2024-02-10T08:35:10.708 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0077337270000000001 2024-02-10T08:35:10.708 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.708 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.708 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:35:10.708 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:41.717367+0000", 2024-02-10T08:35:10.708 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5006999999999998e-05 2024-02-10T08:35:10.708 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.708 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.708 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:35:10.708 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:41.717412+0000", 2024-02-10T08:35:10.709 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001237672 2024-02-10T08:35:10.709 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.709 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.709 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:35:10.709 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:41.718650+0000", 2024-02-10T08:35:10.709 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9499000000000002e-05 2024-02-10T08:35:10.709 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.709 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.709 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:35:10.709 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:41.718699+0000", 2024-02-10T08:35:10.710 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8127999999999998e-05 2024-02-10T08:35:10.710 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.710 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.710 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:35:10.710 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:41.718738+0000", 2024-02-10T08:35:10.710 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.070499681999999994 2024-02-10T08:35:10.710 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:35:10.710 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:35:10.710 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:35:10.710 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.710 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.710 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.15198.0:218366 9.d 9:bcc7fa54:::benchmark_data_smithi018_124176_object96627:head [delete] snapc 0=[] ondisk+write+known_if_redirected e315)", 2024-02-10T08:35:10.710 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:31:41.648266+0000", 2024-02-10T08:35:10.710 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 209.019086284, 2024-02-10T08:35:10.711 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.072948006999999995, 2024-02-10T08:35:10.711 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:35:10.711 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:35:10.711 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:35:10.711 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.15198", 2024-02-10T08:35:10.711 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/1957604827", 2024-02-10T08:35:10.711 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 218366 2024-02-10T08:35:10.711 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.711 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:35:10.711 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.712 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:35:10.712 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:41.648266+0000", 2024-02-10T08:35:10.712 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:35:10.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.712 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.712 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:35:10.712 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:41.648266+0000", 2024-02-10T08:35:10.712 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-02-10T08:35:10.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.712 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.713 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:35:10.713 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:41.648265+0000", 2024-02-10T08:35:10.713 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4899999999999999e-06 2024-02-10T08:35:10.713 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.713 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.713 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:35:10.713 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:41.648268+0000", 2024-02-10T08:35:10.713 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.853e-06 2024-02-10T08:35:10.713 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.713 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.714 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:35:10.714 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:41.648273+0000", 2024-02-10T08:35:10.714 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5360000000000001e-06 2024-02-10T08:35:10.714 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.714 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.714 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:35:10.714 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:41.648276+0000", 2024-02-10T08:35:10.714 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3779999999999998e-05 2024-02-10T08:35:10.714 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.714 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.714 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:35:10.714 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:41.648320+0000", 2024-02-10T08:35:10.715 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063147839999999997 2024-02-10T08:35:10.715 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.715 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.715 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:35:10.715 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:41.711468+0000", 2024-02-10T08:35:10.715 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015301900000000001 2024-02-10T08:35:10.715 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.715 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.715 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1,5", 2024-02-10T08:35:10.715 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:41.711621+0000", 2024-02-10T08:35:10.715 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0061845609999999999 2024-02-10T08:35:10.715 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.715 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.715 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:35:10.716 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:41.717805+0000", 2024-02-10T08:35:10.716 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00067687800000000001 2024-02-10T08:35:10.716 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.716 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.716 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:35:10.716 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:41.718482+0000", 2024-02-10T08:35:10.716 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026315510000000002 2024-02-10T08:35:10.716 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.716 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.716 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:35:10.716 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:41.721114+0000", 2024-02-10T08:35:10.716 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7602999999999998e-05 2024-02-10T08:35:10.716 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.716 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.716 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:35:10.717 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:41.721161+0000", 2024-02-10T08:35:10.717 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2320000000000001e-05 2024-02-10T08:35:10.717 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.717 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.717 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:35:10.717 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:41.721214+0000", 2024-02-10T08:35:10.717 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.072948006999999995 2024-02-10T08:35:10.717 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:35:10.717 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:35:10.717 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:35:10.717 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.717 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.717 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.15198.0:218362 9.c e315/256 9:3ac7260d:::benchmark_data_smithi018_124176_object96623:head v 315'13650, mlcod=315'13647)", 2024-02-10T08:35:10.717 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:31:41.648913+0000", 2024-02-10T08:35:10.717 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 209.018438608, 2024-02-10T08:35:10.718 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.071592780999999994, 2024-02-10T08:35:10.718 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:35:10.718 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:35:10.718 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:35:10.718 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.718 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:35:10.718 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:41.648913+0000", 2024-02-10T08:35:10.718 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:35:10.718 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.718 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.718 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:35:10.718 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:41.648913+0000", 2024-02-10T08:35:10.718 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-02-10T08:35:10.718 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.719 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.719 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:35:10.719 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:41.648912+0000", 2024-02-10T08:35:10.719 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.52e-06 2024-02-10T08:35:10.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.719 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.719 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:35:10.719 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:41.648920+0000", 2024-02-10T08:35:10.719 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060577840000000001 2024-02-10T08:35:10.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.719 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.719 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:35:10.719 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:41.709498+0000", 2024-02-10T08:35:10.720 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0229e-05 2024-02-10T08:35:10.720 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.720 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.720 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:35:10.720 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:41.709508+0000", 2024-02-10T08:35:10.720 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00040876699999999998 2024-02-10T08:35:10.720 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.720 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.720 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:35:10.720 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:41.709917+0000", 2024-02-10T08:35:10.720 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3366e-05 2024-02-10T08:35:10.720 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.720 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.720 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:35:10.721 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:41.709940+0000", 2024-02-10T08:35:10.721 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010534913 2024-02-10T08:35:10.721 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.721 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.721 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:35:10.721 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:41.720475+0000", 2024-02-10T08:35:10.721 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1015e-05 2024-02-10T08:35:10.721 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.721 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.721 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:35:10.721 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:41.720506+0000", 2024-02-10T08:35:10.721 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.071592780999999994 2024-02-10T08:35:10.721 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:35:10.721 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:35:10.721 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:35:10.722 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.722 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.722 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.15198.0:220383 9.d 9:b537cac2:::benchmark_data_smithi018_124176_object98644:head [delete] snapc 0=[] ondisk+write+known_if_redirected e316)", 2024-02-10T08:35:10.722 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:31:44.011631+0000", 2024-02-10T08:35:10.722 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 206.65572138300001, 2024-02-10T08:35:10.722 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.080527913000000007, 2024-02-10T08:35:10.722 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:35:10.722 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:35:10.722 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:35:10.722 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.15198", 2024-02-10T08:35:10.722 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/1957604827", 2024-02-10T08:35:10.722 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 220383 2024-02-10T08:35:10.722 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.722 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:35:10.723 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.723 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:35:10.723 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:44.011631+0000", 2024-02-10T08:35:10.723 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:35:10.723 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.723 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.723 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:35:10.723 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:44.011631+0000", 2024-02-10T08:35:10.723 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999981 2024-02-10T08:35:10.723 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.723 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.723 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:35:10.723 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:44.011628+0000", 2024-02-10T08:35:10.723 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9519999999999994e-06 2024-02-10T08:35:10.724 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.724 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.724 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:35:10.724 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:44.011636+0000", 2024-02-10T08:35:10.724 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2149e-05 2024-02-10T08:35:10.724 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.724 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.724 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:35:10.724 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:44.011649+0000", 2024-02-10T08:35:10.724 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5609999999999998e-06 2024-02-10T08:35:10.724 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.724 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.724 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:35:10.724 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:44.011654+0000", 2024-02-10T08:35:10.725 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9227000000000001e-05 2024-02-10T08:35:10.725 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.725 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.725 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:35:10.725 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:44.011703+0000", 2024-02-10T08:35:10.725 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2700000000000001e-06 2024-02-10T08:35:10.725 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.725 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.725 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-02-10T08:35:10.725 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:44.011710+0000", 2024-02-10T08:35:10.725 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0078775749999999995 2024-02-10T08:35:10.725 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.725 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.726 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:35:10.726 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:44.019587+0000", 2024-02-10T08:35:10.726 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012922899999999999 2024-02-10T08:35:10.726 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.726 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.726 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:35:10.726 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:44.019716+0000", 2024-02-10T08:35:10.726 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.058136195000000002 2024-02-10T08:35:10.726 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.726 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.726 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1,5", 2024-02-10T08:35:10.726 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:44.077853+0000", 2024-02-10T08:35:10.726 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0093539030000000002 2024-02-10T08:35:10.727 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.727 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.727 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:35:10.727 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:44.087206+0000", 2024-02-10T08:35:10.727 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00085107300000000004 2024-02-10T08:35:10.727 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.727 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.727 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:35:10.727 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:44.088058+0000", 2024-02-10T08:35:10.727 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040201760000000003 2024-02-10T08:35:10.727 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.727 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.727 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:35:10.727 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:44.092078+0000", 2024-02-10T08:35:10.727 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5340999999999998e-05 2024-02-10T08:35:10.728 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.728 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.728 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:35:10.728 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:44.092123+0000", 2024-02-10T08:35:10.728 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5403e-05 2024-02-10T08:35:10.728 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.728 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.728 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:35:10.728 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:44.092158+0000", 2024-02-10T08:35:10.728 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.080527913000000007 2024-02-10T08:35:10.728 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:35:10.728 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:35:10.728 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:35:10.728 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.728 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.729 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.15198.0:220384 9.3 9:c66e6db4:::benchmark_data_smithi018_124176_object98645:head [delete] snapc 0=[] ondisk+write+known_if_redirected e316)", 2024-02-10T08:35:10.729 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:31:44.020337+0000", 2024-02-10T08:35:10.729 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 206.647014501, 2024-02-10T08:35:10.729 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.071568319000000005, 2024-02-10T08:35:10.729 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:35:10.729 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:35:10.729 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:35:10.729 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.15198", 2024-02-10T08:35:10.729 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/1957604827", 2024-02-10T08:35:10.729 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 220384 2024-02-10T08:35:10.729 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.729 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:35:10.729 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.729 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:35:10.729 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:44.020337+0000", 2024-02-10T08:35:10.730 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:35:10.730 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.730 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.730 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:35:10.730 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:44.020337+0000", 2024-02-10T08:35:10.730 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-02-10T08:35:10.730 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.730 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.730 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:35:10.730 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:44.020336+0000", 2024-02-10T08:35:10.730 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0440000000000001e-06 2024-02-10T08:35:10.730 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.730 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.730 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:35:10.730 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:44.020342+0000", 2024-02-10T08:35:10.731 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.058213726 2024-02-10T08:35:10.731 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.731 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.731 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:35:10.731 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:44.078556+0000", 2024-02-10T08:35:10.731 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7780000000000007e-06 2024-02-10T08:35:10.731 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.731 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.731 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:35:10.731 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:44.078564+0000", 2024-02-10T08:35:10.731 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00029949300000000001 2024-02-10T08:35:10.731 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.731 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.731 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:35:10.731 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:44.078863+0000", 2024-02-10T08:35:10.732 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014536099999999999 2024-02-10T08:35:10.732 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.732 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.732 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:35:10.732 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:44.079009+0000", 2024-02-10T08:35:10.732 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000125599 2024-02-10T08:35:10.732 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.732 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.732 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1,3", 2024-02-10T08:35:10.732 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:44.079134+0000", 2024-02-10T08:35:10.732 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0071443779999999998 2024-02-10T08:35:10.732 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.732 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.732 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:35:10.732 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:44.086279+0000", 2024-02-10T08:35:10.733 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020867519999999999 2024-02-10T08:35:10.733 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.733 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.733 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:35:10.733 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:44.088365+0000", 2024-02-10T08:35:10.733 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034579929999999999 2024-02-10T08:35:10.733 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.733 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.733 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:35:10.733 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:44.091823+0000", 2024-02-10T08:35:10.733 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5426000000000002e-05 2024-02-10T08:35:10.733 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.733 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.733 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:35:10.733 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:44.091869+0000", 2024-02-10T08:35:10.734 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7011000000000002e-05 2024-02-10T08:35:10.734 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.734 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.734 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:35:10.734 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:44.091906+0000", 2024-02-10T08:35:10.734 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.071568319000000005 2024-02-10T08:35:10.734 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:35:10.734 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:35:10.734 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:35:10.734 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.734 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.734 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.25369.0:55560 10.c 10:35ec2c86:::benchmark_data_smithi018_146618_object55559:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e351)", 2024-02-10T08:35:10.734 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:33:14.240360+0000", 2024-02-10T08:35:10.734 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 116.426991906, 2024-02-10T08:35:10.735 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.075037662000000005, 2024-02-10T08:35:10.735 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:35:10.735 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:35:10.735 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:35:10.735 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.25369", 2024-02-10T08:35:10.735 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3974730810", 2024-02-10T08:35:10.735 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 55560 2024-02-10T08:35:10.735 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.735 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:35:10.735 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.735 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:35:10.735 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:14.240360+0000", 2024-02-10T08:35:10.735 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:35:10.735 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.735 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.736 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:35:10.736 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:14.240360+0000", 2024-02-10T08:35:10.736 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999981 2024-02-10T08:35:10.736 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.736 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.736 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:35:10.736 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:14.240358+0000", 2024-02-10T08:35:10.736 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7661000000000003e-05 2024-02-10T08:35:10.736 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.736 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.736 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:35:10.737 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:14.240406+0000", 2024-02-10T08:35:10.737 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4328000000000001e-05 2024-02-10T08:35:10.737 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.737 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.737 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:35:10.737 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:14.240420+0000", 2024-02-10T08:35:10.737 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7669999999999998e-06 2024-02-10T08:35:10.737 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.737 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.737 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:35:10.737 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:14.240427+0000", 2024-02-10T08:35:10.738 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1771999999999999e-05 2024-02-10T08:35:10.738 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.738 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.738 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:35:10.738 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:14.240469+0000", 2024-02-10T08:35:10.738 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000117738 2024-02-10T08:35:10.738 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.738 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.738 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:35:10.738 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:14.240586+0000", 2024-02-10T08:35:10.738 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014056800000000001 2024-02-10T08:35:10.738 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.738 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.738 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,4", 2024-02-10T08:35:10.739 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:14.240727+0000", 2024-02-10T08:35:10.739 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033229380000000001 2024-02-10T08:35:10.739 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.739 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.739 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:35:10.739 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:14.244050+0000", 2024-02-10T08:35:10.739 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0037047690000000001 2024-02-10T08:35:10.739 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.739 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.740 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:35:10.740 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:14.247755+0000", 2024-02-10T08:35:10.740 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.067549397999999997 2024-02-10T08:35:10.740 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.740 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.740 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:35:10.740 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:14.315304+0000", 2024-02-10T08:35:10.740 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3520000000000003e-05 2024-02-10T08:35:10.740 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.740 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.740 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:35:10.740 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:14.315358+0000", 2024-02-10T08:35:10.740 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0182000000000003e-05 2024-02-10T08:35:10.741 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.741 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.741 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:35:10.741 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:14.315398+0000", 2024-02-10T08:35:10.741 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.075037662000000005 2024-02-10T08:35:10.741 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:35:10.741 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:35:10.741 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:35:10.741 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.741 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.741 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.25369.0:67819 10.c 10:3b9737dc:::benchmark_data_smithi018_146618_object67818:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e354)", 2024-02-10T08:35:10.741 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:33:24.077786+0000", 2024-02-10T08:35:10.742 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 106.58956591099999, 2024-02-10T08:35:10.742 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.116609987, 2024-02-10T08:35:10.742 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:35:10.742 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:35:10.742 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:35:10.742 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.25369", 2024-02-10T08:35:10.742 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3974730810", 2024-02-10T08:35:10.742 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 67819 2024-02-10T08:35:10.742 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.742 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:35:10.742 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.742 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:35:10.742 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:24.077786+0000", 2024-02-10T08:35:10.742 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:35:10.742 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.743 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.743 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:35:10.743 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:24.077786+0000", 2024-02-10T08:35:10.743 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999971 2024-02-10T08:35:10.743 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.743 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.743 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:35:10.743 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:24.077783+0000", 2024-02-10T08:35:10.743 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012986900000000001 2024-02-10T08:35:10.743 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.743 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.743 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:35:10.743 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:24.077913+0000", 2024-02-10T08:35:10.743 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6338000000000001e-05 2024-02-10T08:35:10.744 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.744 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.744 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:35:10.744 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:24.077939+0000", 2024-02-10T08:35:10.744 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5301000000000001e-05 2024-02-10T08:35:10.744 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.744 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.744 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:35:10.744 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:24.077955+0000", 2024-02-10T08:35:10.744 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1236000000000003e-05 2024-02-10T08:35:10.744 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.745 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.745 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:35:10.745 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:24.077996+0000", 2024-02-10T08:35:10.745 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115784 2024-02-10T08:35:10.745 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.745 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.745 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:35:10.745 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:24.078112+0000", 2024-02-10T08:35:10.745 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000157023 2024-02-10T08:35:10.745 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.745 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.745 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,4", 2024-02-10T08:35:10.745 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:24.078269+0000", 2024-02-10T08:35:10.745 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0050535099999999998 2024-02-10T08:35:10.745 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.746 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.746 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:35:10.746 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:24.083322+0000", 2024-02-10T08:35:10.746 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016583200000000001 2024-02-10T08:35:10.746 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.746 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.746 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:35:10.746 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:24.083488+0000", 2024-02-10T08:35:10.746 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.110808144 2024-02-10T08:35:10.746 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.746 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.746 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:35:10.746 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:24.194296+0000", 2024-02-10T08:35:10.746 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7620000000000001e-05 2024-02-10T08:35:10.747 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.747 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.747 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:35:10.747 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:24.194354+0000", 2024-02-10T08:35:10.747 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2169999999999998e-05 2024-02-10T08:35:10.747 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.747 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.747 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:35:10.747 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:24.194396+0000", 2024-02-10T08:35:10.747 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.116609987 2024-02-10T08:35:10.748 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:35:10.748 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:35:10.748 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:35:10.748 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.748 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.748 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.25369.0:67833 10.c 10:3f1f2fbc:::benchmark_data_smithi018_146618_object67832:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e354)", 2024-02-10T08:35:10.748 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:33:24.089879+0000", 2024-02-10T08:35:10.748 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 106.57747256, 2024-02-10T08:35:10.748 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.10478575599999999, 2024-02-10T08:35:10.748 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:35:10.748 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:35:10.749 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:35:10.749 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.25369", 2024-02-10T08:35:10.749 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3974730810", 2024-02-10T08:35:10.749 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 67833 2024-02-10T08:35:10.749 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.749 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:35:10.749 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.749 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:35:10.749 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:24.089879+0000", 2024-02-10T08:35:10.749 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:35:10.749 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.749 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.750 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:35:10.750 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:24.089879+0000", 2024-02-10T08:35:10.750 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-02-10T08:35:10.750 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.750 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.750 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:35:10.750 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:24.089878+0000", 2024-02-10T08:35:10.750 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6257e-05 2024-02-10T08:35:10.750 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.750 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.750 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:35:10.751 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:24.089934+0000", 2024-02-10T08:35:10.751 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0183999999999999e-05 2024-02-10T08:35:10.751 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.751 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.751 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:35:10.751 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:24.089944+0000", 2024-02-10T08:35:10.751 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6020000000000002e-06 2024-02-10T08:35:10.751 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.751 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.751 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:35:10.752 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:24.089949+0000", 2024-02-10T08:35:10.752 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3540000000000001e-05 2024-02-10T08:35:10.752 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.752 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.752 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:35:10.752 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:24.089983+0000", 2024-02-10T08:35:10.752 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0477999999999997e-05 2024-02-10T08:35:10.752 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.752 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.752 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:35:10.752 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:24.090073+0000", 2024-02-10T08:35:10.753 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000102823 2024-02-10T08:35:10.753 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.753 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.753 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,4", 2024-02-10T08:35:10.753 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:24.090176+0000", 2024-02-10T08:35:10.753 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001870841 2024-02-10T08:35:10.753 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.753 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.753 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:35:10.753 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:24.092047+0000", 2024-02-10T08:35:10.753 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00043074399999999999 2024-02-10T08:35:10.754 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.754 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.754 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:35:10.754 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:24.092477+0000", 2024-02-10T08:35:10.754 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.10211165799999999 2024-02-10T08:35:10.754 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.754 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.754 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:35:10.754 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:24.194589+0000", 2024-02-10T08:35:10.754 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4604000000000002e-05 2024-02-10T08:35:10.754 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.754 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.754 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:35:10.754 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:24.194634+0000", 2024-02-10T08:35:10.755 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1405999999999997e-05 2024-02-10T08:35:10.755 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.755 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.755 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:35:10.755 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:24.194665+0000", 2024-02-10T08:35:10.755 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.10478575599999999 2024-02-10T08:35:10.755 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:35:10.755 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:35:10.755 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:35:10.755 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.755 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.755 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.25369.0:125293 10.c 10:3c9a8046:::benchmark_data_smithi018_146618_object1490:head [delete] snapc 0=[] ondisk+write+known_if_redirected e369)", 2024-02-10T08:35:10.755 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:34:17.976514+0000", 2024-02-10T08:35:10.755 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 52.690837617, 2024-02-10T08:35:10.756 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.043210607999999998, 2024-02-10T08:35:10.756 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:35:10.756 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:35:10.756 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:35:10.756 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.25369", 2024-02-10T08:35:10.756 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3974730810", 2024-02-10T08:35:10.756 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 125293 2024-02-10T08:35:10.756 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.756 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:35:10.756 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.756 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:35:10.756 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:17.976514+0000", 2024-02-10T08:35:10.756 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:35:10.756 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.757 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.757 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:35:10.757 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:17.976514+0000", 2024-02-10T08:35:10.757 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999981 2024-02-10T08:35:10.757 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.757 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.757 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:35:10.757 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:17.976513+0000", 2024-02-10T08:35:10.757 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.413e-06 2024-02-10T08:35:10.757 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.757 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.757 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:35:10.757 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:17.976520+0000", 2024-02-10T08:35:10.757 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3481e-05 2024-02-10T08:35:10.757 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.758 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.758 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:35:10.758 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:17.976533+0000", 2024-02-10T08:35:10.758 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8340000000000001e-06 2024-02-10T08:35:10.758 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.758 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.758 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:35:10.758 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:17.976540+0000", 2024-02-10T08:35:10.758 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7330999999999998e-05 2024-02-10T08:35:10.758 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.758 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.758 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:35:10.758 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:17.976588+0000", 2024-02-10T08:35:10.758 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011204099999999999 2024-02-10T08:35:10.759 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.759 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.759 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:35:10.759 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:17.976700+0000", 2024-02-10T08:35:10.759 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000119051 2024-02-10T08:35:10.759 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.759 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.759 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,4", 2024-02-10T08:35:10.759 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:17.976819+0000", 2024-02-10T08:35:10.759 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029470579999999998 2024-02-10T08:35:10.759 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.759 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.759 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:35:10.759 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:17.979766+0000", 2024-02-10T08:35:10.759 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2689999999999996e-06 2024-02-10T08:35:10.759 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.760 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.760 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:35:10.760 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:17.979772+0000", 2024-02-10T08:35:10.760 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.039868310999999997 2024-02-10T08:35:10.760 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.760 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.760 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:35:10.760 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:18.019640+0000", 2024-02-10T08:35:10.760 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7550999999999999e-05 2024-02-10T08:35:10.760 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.760 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.760 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:35:10.760 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:18.019688+0000", 2024-02-10T08:35:10.760 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7048999999999997e-05 2024-02-10T08:35:10.761 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.761 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.761 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:35:10.761 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:18.019725+0000", 2024-02-10T08:35:10.761 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.043210607999999998 2024-02-10T08:35:10.761 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:35:10.761 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:35:10.761 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:35:10.761 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.761 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.761 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.25369.0:126463 10.c 10:339d2ed2:::benchmark_data_smithi018_146618_object2660:head [delete] snapc 0=[] ondisk+write+known_if_redirected e369)", 2024-02-10T08:35:10.761 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:34:18.953641+0000", 2024-02-10T08:35:10.761 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 51.713710896000002, 2024-02-10T08:35:10.761 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.042316087000000002, 2024-02-10T08:35:10.761 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:35:10.762 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:35:10.762 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:35:10.762 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.25369", 2024-02-10T08:35:10.762 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3974730810", 2024-02-10T08:35:10.762 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 126463 2024-02-10T08:35:10.762 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.762 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:35:10.762 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.762 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:35:10.762 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:18.953641+0000", 2024-02-10T08:35:10.762 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:35:10.762 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.762 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.762 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:35:10.762 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:18.953641+0000", 2024-02-10T08:35:10.762 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-02-10T08:35:10.763 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.763 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.763 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:35:10.763 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:18.953640+0000", 2024-02-10T08:35:10.763 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2169999999999997e-06 2024-02-10T08:35:10.763 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.763 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.763 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:35:10.763 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:18.953647+0000", 2024-02-10T08:35:10.763 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1990999999999999e-05 2024-02-10T08:35:10.763 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.763 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.763 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:35:10.763 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:18.953659+0000", 2024-02-10T08:35:10.764 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7800000000000003e-06 2024-02-10T08:35:10.764 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.764 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.764 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:35:10.764 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:18.953666+0000", 2024-02-10T08:35:10.764 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2669000000000001e-05 2024-02-10T08:35:10.764 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.764 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.764 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:35:10.764 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:18.953708+0000", 2024-02-10T08:35:10.764 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6203000000000001e-05 2024-02-10T08:35:10.764 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.764 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.765 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:35:10.765 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:18.953795+0000", 2024-02-10T08:35:10.765 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0797999999999994e-05 2024-02-10T08:35:10.765 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.765 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.765 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,4", 2024-02-10T08:35:10.765 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:18.953875+0000", 2024-02-10T08:35:10.765 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019368079999999999 2024-02-10T08:35:10.765 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.765 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.765 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:35:10.765 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:18.955812+0000", 2024-02-10T08:35:10.765 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000170574 2024-02-10T08:35:10.765 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.766 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.766 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:35:10.766 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:18.955983+0000", 2024-02-10T08:35:10.766 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.039875290000000001 2024-02-10T08:35:10.766 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.766 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.766 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:35:10.766 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:18.995858+0000", 2024-02-10T08:35:10.766 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6418000000000002e-05 2024-02-10T08:35:10.766 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.766 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.766 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:35:10.766 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:18.995905+0000", 2024-02-10T08:35:10.766 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2630000000000003e-05 2024-02-10T08:35:10.767 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.767 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.767 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:35:10.767 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:18.995957+0000", 2024-02-10T08:35:10.767 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.042316087000000002 2024-02-10T08:35:10.767 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:35:10.767 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:35:10.767 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:35:10.767 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.767 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.767 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.25369.0:132362 10.c 10:3ac72e95:::benchmark_data_smithi018_146618_object8559:head [delete] snapc 0=[] ondisk+write+known_if_redirected e369)", 2024-02-10T08:35:10.767 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:34:24.106099+0000", 2024-02-10T08:35:10.767 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 46.561252819000003, 2024-02-10T08:35:10.767 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.043261948000000001, 2024-02-10T08:35:10.768 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:35:10.768 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:35:10.768 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:35:10.768 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.25369", 2024-02-10T08:35:10.768 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3974730810", 2024-02-10T08:35:10.768 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 132362 2024-02-10T08:35:10.768 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.768 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:35:10.768 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.768 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:35:10.768 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:24.106099+0000", 2024-02-10T08:35:10.768 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:35:10.769 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.769 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.769 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:35:10.769 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:24.106099+0000", 2024-02-10T08:35:10.769 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999981 2024-02-10T08:35:10.769 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.769 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.769 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:35:10.769 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:24.106097+0000", 2024-02-10T08:35:10.769 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.755e-06 2024-02-10T08:35:10.769 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.769 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.769 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:35:10.769 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:24.106106+0000", 2024-02-10T08:35:10.769 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4354e-05 2024-02-10T08:35:10.770 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.770 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.770 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:35:10.770 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:24.106120+0000", 2024-02-10T08:35:10.770 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8499999999999996e-06 2024-02-10T08:35:10.770 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.770 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.770 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:35:10.770 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:24.106127+0000", 2024-02-10T08:35:10.770 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8804000000000002e-05 2024-02-10T08:35:10.770 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.770 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.770 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:35:10.770 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:24.106176+0000", 2024-02-10T08:35:10.770 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013830299999999999 2024-02-10T08:35:10.771 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.771 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.771 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:35:10.771 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:24.106314+0000", 2024-02-10T08:35:10.771 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014024799999999999 2024-02-10T08:35:10.771 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.771 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.771 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,4", 2024-02-10T08:35:10.771 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:24.106454+0000", 2024-02-10T08:35:10.771 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0044524350000000002 2024-02-10T08:35:10.771 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.771 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.771 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:35:10.771 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:24.110907+0000", 2024-02-10T08:35:10.772 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027249610000000001 2024-02-10T08:35:10.772 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.772 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.772 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:35:10.772 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:24.113632+0000", 2024-02-10T08:35:10.772 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.035655629000000001 2024-02-10T08:35:10.772 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.772 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.772 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:35:10.772 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:24.149287+0000", 2024-02-10T08:35:10.772 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3392000000000001e-05 2024-02-10T08:35:10.772 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.772 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.772 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:35:10.773 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:24.149331+0000", 2024-02-10T08:35:10.773 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0321999999999999e-05 2024-02-10T08:35:10.773 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.773 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.773 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:35:10.773 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:24.149361+0000", 2024-02-10T08:35:10.773 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.043261948000000001 2024-02-10T08:35:10.773 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:35:10.773 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:35:10.773 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:35:10.773 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.773 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.773 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.25369.0:132365 10.c 10:3e57e103:::benchmark_data_smithi018_146618_object8562:head [delete] snapc 0=[] ondisk+write+known_if_redirected e369)", 2024-02-10T08:35:10.773 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:34:24.106141+0000", 2024-02-10T08:35:10.773 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 46.561211137000001, 2024-02-10T08:35:10.774 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.043346469999999998, 2024-02-10T08:35:10.774 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:35:10.774 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:35:10.774 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:35:10.774 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.25369", 2024-02-10T08:35:10.774 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3974730810", 2024-02-10T08:35:10.774 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 132365 2024-02-10T08:35:10.774 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.774 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:35:10.774 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.774 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:35:10.774 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:24.106141+0000", 2024-02-10T08:35:10.774 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:35:10.774 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.774 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.775 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:35:10.775 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:24.106141+0000", 2024-02-10T08:35:10.775 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-02-10T08:35:10.775 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.775 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.775 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:35:10.775 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:24.106140+0000", 2024-02-10T08:35:10.775 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5949999999999999e-06 2024-02-10T08:35:10.775 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.775 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.775 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:35:10.775 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:24.106144+0000", 2024-02-10T08:35:10.775 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9490000000000001e-06 2024-02-10T08:35:10.775 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.775 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.776 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:35:10.776 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:24.106150+0000", 2024-02-10T08:35:10.776 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8109999999999999e-06 2024-02-10T08:35:10.776 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.776 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.776 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:35:10.776 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:24.106153+0000", 2024-02-10T08:35:10.776 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027614570000000001 2024-02-10T08:35:10.776 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.776 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.777 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:35:10.777 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:24.108914+0000", 2024-02-10T08:35:10.777 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9371999999999997e-05 2024-02-10T08:35:10.777 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.777 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.777 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:35:10.777 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:24.109013+0000", 2024-02-10T08:35:10.777 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6932000000000001e-05 2024-02-10T08:35:10.777 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.777 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.777 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,4", 2024-02-10T08:35:10.777 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:24.109090+0000", 2024-02-10T08:35:10.777 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0045482500000000002 2024-02-10T08:35:10.777 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.778 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.778 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:35:10.778 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:24.113639+0000", 2024-02-10T08:35:10.778 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0021027530000000002 2024-02-10T08:35:10.778 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.778 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.778 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:35:10.778 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:24.115741+0000", 2024-02-10T08:35:10.778 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.033661829999999997 2024-02-10T08:35:10.778 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.778 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.778 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:35:10.778 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:24.149403+0000", 2024-02-10T08:35:10.778 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0198999999999998e-05 2024-02-10T08:35:10.779 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.779 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.779 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:35:10.779 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:24.149453+0000", 2024-02-10T08:35:10.779 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3945000000000001e-05 2024-02-10T08:35:10.779 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.779 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.779 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:35:10.779 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:24.149487+0000", 2024-02-10T08:35:10.779 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.043346469999999998 2024-02-10T08:35:10.780 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:35:10.780 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:35:10.780 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:35:10.780 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.780 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.780 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.25369.0:156554 10.c 10:3e5194ae:::benchmark_data_smithi018_146618_object32751:head [delete] snapc 0=[] ondisk+write+known_if_redirected e374)", 2024-02-10T08:35:10.780 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:34:47.675442+0000", 2024-02-10T08:35:10.780 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 22.991909623000002, 2024-02-10T08:35:10.780 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0438558, 2024-02-10T08:35:10.780 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:35:10.780 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:35:10.780 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:35:10.780 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.25369", 2024-02-10T08:35:10.781 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3974730810", 2024-02-10T08:35:10.781 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 156554 2024-02-10T08:35:10.781 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.781 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:35:10.781 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.781 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:35:10.781 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:47.675442+0000", 2024-02-10T08:35:10.781 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:35:10.781 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.781 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.781 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:35:10.782 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:47.675442+0000", 2024-02-10T08:35:10.782 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999971 2024-02-10T08:35:10.782 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.782 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.782 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:35:10.782 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:47.675440+0000", 2024-02-10T08:35:10.782 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4246999999999999e-05 2024-02-10T08:35:10.782 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.782 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.782 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:35:10.782 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:47.675454+0000", 2024-02-10T08:35:10.782 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3683e-05 2024-02-10T08:35:10.782 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.782 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.783 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:35:10.783 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:47.675478+0000", 2024-02-10T08:35:10.783 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2183e-05 2024-02-10T08:35:10.783 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.783 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.783 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:35:10.783 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:47.675490+0000", 2024-02-10T08:35:10.783 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3258999999999997e-05 2024-02-10T08:35:10.783 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.783 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.783 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:35:10.783 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:47.675573+0000", 2024-02-10T08:35:10.783 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000170767 2024-02-10T08:35:10.783 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.784 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.784 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:35:10.784 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:47.675744+0000", 2024-02-10T08:35:10.784 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6454999999999999e-05 2024-02-10T08:35:10.784 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.784 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.784 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,4", 2024-02-10T08:35:10.784 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:47.675820+0000", 2024-02-10T08:35:10.784 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020041350000000002 2024-02-10T08:35:10.784 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.784 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.784 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:35:10.784 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:47.677824+0000", 2024-02-10T08:35:10.784 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00049712699999999999 2024-02-10T08:35:10.785 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.785 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.785 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:35:10.785 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:47.678322+0000", 2024-02-10T08:35:10.785 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.040889277000000002 2024-02-10T08:35:10.785 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.785 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.785 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:35:10.785 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:47.719211+0000", 2024-02-10T08:35:10.785 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9758e-05 2024-02-10T08:35:10.785 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.785 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.785 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:35:10.785 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:47.719261+0000", 2024-02-10T08:35:10.786 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7583000000000003e-05 2024-02-10T08:35:10.786 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.786 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.786 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:35:10.786 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:47.719298+0000", 2024-02-10T08:35:10.786 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0438558 2024-02-10T08:35:10.786 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:35:10.786 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:35:10.786 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:35:10.786 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.786 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.786 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.25369.0:160184 10.c 10:3cf5cfa1:::benchmark_data_smithi018_146618_object36381:head [delete] snapc 0=[] ondisk+write+known_if_redirected e375)", 2024-02-10T08:35:10.786 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:34:52.121703+0000", 2024-02-10T08:35:10.786 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.545649385000001, 2024-02-10T08:35:10.787 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.071438518000000006, 2024-02-10T08:35:10.787 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:35:10.787 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:35:10.787 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:35:10.787 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.25369", 2024-02-10T08:35:10.787 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3974730810", 2024-02-10T08:35:10.787 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 160184 2024-02-10T08:35:10.787 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.787 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:35:10.787 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.787 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:35:10.787 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:52.121703+0000", 2024-02-10T08:35:10.787 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:35:10.787 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.788 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.788 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:35:10.788 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:52.121703+0000", 2024-02-10T08:35:10.788 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-02-10T08:35:10.788 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.788 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.788 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:35:10.788 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:52.121701+0000", 2024-02-10T08:35:10.788 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8889999999999996e-06 2024-02-10T08:35:10.788 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.788 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.788 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:35:10.788 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:52.121708+0000", 2024-02-10T08:35:10.789 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0507e-05 2024-02-10T08:35:10.789 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.789 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.789 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:35:10.789 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:52.121718+0000", 2024-02-10T08:35:10.789 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4339999999999997e-06 2024-02-10T08:35:10.789 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.789 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.789 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:35:10.789 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:52.121725+0000", 2024-02-10T08:35:10.789 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5871000000000002e-05 2024-02-10T08:35:10.789 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.789 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.789 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:35:10.790 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:52.121771+0000", 2024-02-10T08:35:10.790 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8197999999999997e-05 2024-02-10T08:35:10.790 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.790 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.790 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:35:10.790 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:52.121869+0000", 2024-02-10T08:35:10.790 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012447200000000001 2024-02-10T08:35:10.790 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.790 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.790 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,4", 2024-02-10T08:35:10.790 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:52.121993+0000", 2024-02-10T08:35:10.790 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.006498495 2024-02-10T08:35:10.790 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.790 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.791 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:35:10.791 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:52.128492+0000", 2024-02-10T08:35:10.791 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2325000000000001e-05 2024-02-10T08:35:10.791 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.791 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.791 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:35:10.792 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:35:10.792 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:52.128514+0000", 2024-02-10T08:35:10.792 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.064540809000000005 2024-02-10T08:35:10.792 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.792 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.792 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:35:10.792 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:52.193055+0000", 2024-02-10T08:35:10.792 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6006e-05 2024-02-10T08:35:10.792 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.793 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.793 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:35:10.793 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:52.193101+0000", 2024-02-10T08:35:10.793 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9981999999999998e-05 2024-02-10T08:35:10.793 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.793 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.793 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:35:10.793 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:52.193141+0000", 2024-02-10T08:35:10.793 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.071438518000000006 2024-02-10T08:35:10.793 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:35:10.793 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:35:10.793 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:35:10.793 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.794 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.794 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.25369.0:160189 10.c 10:3b4cdfd6:::benchmark_data_smithi018_146618_object36386:head [delete] snapc 0=[] ondisk+write+known_if_redirected e375)", 2024-02-10T08:35:10.794 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:34:52.124503+0000", 2024-02-10T08:35:10.794 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.542849433000001, 2024-02-10T08:35:10.794 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.068743998000000001, 2024-02-10T08:35:10.794 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:35:10.794 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:35:10.794 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:35:10.794 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.25369", 2024-02-10T08:35:10.794 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3974730810", 2024-02-10T08:35:10.794 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 160189 2024-02-10T08:35:10.794 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.794 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:35:10.794 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.795 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:35:10.795 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:52.124503+0000", 2024-02-10T08:35:10.795 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:35:10.795 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.795 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.795 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:35:10.795 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:52.124503+0000", 2024-02-10T08:35:10.795 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999981 2024-02-10T08:35:10.795 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.795 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.795 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:35:10.795 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:52.124501+0000", 2024-02-10T08:35:10.795 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9640000000000003e-06 2024-02-10T08:35:10.796 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.796 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.796 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:35:10.796 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:52.124509+0000", 2024-02-10T08:35:10.796 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.173e-05 2024-02-10T08:35:10.796 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.796 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.796 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:35:10.796 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:52.124520+0000", 2024-02-10T08:35:10.796 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0390000000000001e-06 2024-02-10T08:35:10.796 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.797 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.797 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:35:10.797 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:52.124527+0000", 2024-02-10T08:35:10.797 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2387999999999998e-05 2024-02-10T08:35:10.797 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.797 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.797 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:35:10.797 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:52.124609+0000", 2024-02-10T08:35:10.797 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000120016 2024-02-10T08:35:10.797 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.798 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.798 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:35:10.798 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:52.124729+0000", 2024-02-10T08:35:10.798 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013787200000000001 2024-02-10T08:35:10.798 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.798 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.798 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,4", 2024-02-10T08:35:10.798 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:52.124867+0000", 2024-02-10T08:35:10.798 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0036540029999999999 2024-02-10T08:35:10.798 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.798 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.799 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:35:10.799 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:52.128521+0000", 2024-02-10T08:35:10.799 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026763960000000002 2024-02-10T08:35:10.799 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.799 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.799 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:35:10.799 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:52.131197+0000", 2024-02-10T08:35:10.799 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061975173000000001 2024-02-10T08:35:10.799 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.800 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.800 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:35:10.800 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:52.193172+0000", 2024-02-10T08:35:10.800 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2966000000000002e-05 2024-02-10T08:35:10.800 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.800 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.800 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:35:10.800 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:52.193215+0000", 2024-02-10T08:35:10.800 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1170000000000001e-05 2024-02-10T08:35:10.800 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.801 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.801 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:35:10.801 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:52.193247+0000", 2024-02-10T08:35:10.801 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.068743998000000001 2024-02-10T08:35:10.801 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:35:10.801 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:35:10.801 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:35:10.801 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.801 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.801 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.25369.0:160191 10.c 10:3635a165:::benchmark_data_smithi018_146618_object36388:head [delete] snapc 0=[] ondisk+write+known_if_redirected e375)", 2024-02-10T08:35:10.801 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:34:52.124553+0000", 2024-02-10T08:35:10.802 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.542798509000001, 2024-02-10T08:35:10.802 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.071520128000000002, 2024-02-10T08:35:10.802 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:35:10.802 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:35:10.802 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:35:10.802 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.25369", 2024-02-10T08:35:10.802 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3974730810", 2024-02-10T08:35:10.802 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 160191 2024-02-10T08:35:10.802 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.802 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:35:10.802 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.802 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:35:10.802 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:52.124553+0000", 2024-02-10T08:35:10.803 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:35:10.803 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.803 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.803 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:35:10.803 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:52.124553+0000", 2024-02-10T08:35:10.803 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-02-10T08:35:10.803 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.803 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.803 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:35:10.803 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:52.124552+0000", 2024-02-10T08:35:10.803 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5720000000000002e-06 2024-02-10T08:35:10.803 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.804 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.804 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:35:10.804 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:52.124558+0000", 2024-02-10T08:35:10.804 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7149999999999993e-06 2024-02-10T08:35:10.804 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.804 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.804 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:35:10.804 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:52.124568+0000", 2024-02-10T08:35:10.804 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9120000000000003e-06 2024-02-10T08:35:10.804 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.804 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.804 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:35:10.804 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:52.124574+0000", 2024-02-10T08:35:10.805 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020279310000000002 2024-02-10T08:35:10.805 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.805 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.805 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:35:10.805 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:52.126602+0000", 2024-02-10T08:35:10.805 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5599999999999994e-05 2024-02-10T08:35:10.805 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.805 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.805 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:35:10.805 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:52.126687+0000", 2024-02-10T08:35:10.805 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000105173 2024-02-10T08:35:10.805 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.805 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.805 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,4", 2024-02-10T08:35:10.805 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:52.126792+0000", 2024-02-10T08:35:10.806 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0018121529999999999 2024-02-10T08:35:10.806 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.806 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.806 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:35:10.806 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:52.128604+0000", 2024-02-10T08:35:10.806 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026299600000000002 2024-02-10T08:35:10.806 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.806 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.806 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:35:10.806 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:52.131234+0000", 2024-02-10T08:35:10.806 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.064750906999999996 2024-02-10T08:35:10.806 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.806 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.806 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:35:10.806 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:52.195985+0000", 2024-02-10T08:35:10.807 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8785000000000001e-05 2024-02-10T08:35:10.807 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.807 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.807 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:35:10.807 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:52.196034+0000", 2024-02-10T08:35:10.807 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9452000000000001e-05 2024-02-10T08:35:10.807 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:35:10.807 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:35:10.807 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:35:10.807 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:52.196074+0000", 2024-02-10T08:35:10.807 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.071520128000000002 2024-02-10T08:35:10.807 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:35:10.807 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:35:10.807 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:35:10.808 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:35:10.808 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:35:10.808 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-02-10T08:35:10.808 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:10.809 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:35:10.910 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:35:10.946 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd unset nodeep-scrub 2024-02-10T08:35:10.951 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:10.983 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:35:10.986 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:10.987 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:35:11.087 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:35:11.154 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:11.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:09.761940+0000 osd.6 (osd.6) 207 : cluster [DBG] 10.f scrub starts 2024-02-10T08:35:11.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:10.162865+0000 osd.5 (osd.5) 231 : cluster [DBG] 2.18 scrub starts 2024-02-10T08:35:11.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:10.165747+0000 osd.5 (osd.5) 232 : cluster [DBG] 2.18 scrub ok 2024-02-10T08:35:11.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:10.241543+0000 osd.0 (osd.0) 207 : cluster [DBG] 4.b scrub starts 2024-02-10T08:35:11.293 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:10.248275+0000 osd.0 (osd.0) 208 : cluster [DBG] 4.b scrub ok 2024-02-10T08:35:11.293 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:35:10.278551+0000 mon.c (mon.2) 84 : audit [DBG] from='client.? 172.21.15.18:0/1149330691' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:35:11.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:09.761940+0000 osd.6 (osd.6) 207 : cluster [DBG] 10.f scrub starts 2024-02-10T08:35:11.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:10.162865+0000 osd.5 (osd.5) 231 : cluster [DBG] 2.18 scrub starts 2024-02-10T08:35:11.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:10.165747+0000 osd.5 (osd.5) 232 : cluster [DBG] 2.18 scrub ok 2024-02-10T08:35:11.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:10.241543+0000 osd.0 (osd.0) 207 : cluster [DBG] 4.b scrub starts 2024-02-10T08:35:11.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:10.248275+0000 osd.0 (osd.0) 208 : cluster [DBG] 4.b scrub ok 2024-02-10T08:35:11.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:35:10.278551+0000 mon.c (mon.2) 84 : audit [DBG] from='client.? 172.21.15.18:0/1149330691' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:35:11.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:09.761940+0000 osd.6 (osd.6) 207 : cluster [DBG] 10.f scrub starts 2024-02-10T08:35:11.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:10.162865+0000 osd.5 (osd.5) 231 : cluster [DBG] 2.18 scrub starts 2024-02-10T08:35:11.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:10.165747+0000 osd.5 (osd.5) 232 : cluster [DBG] 2.18 scrub ok 2024-02-10T08:35:11.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:10.241543+0000 osd.0 (osd.0) 207 : cluster [DBG] 4.b scrub starts 2024-02-10T08:35:11.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:10.248275+0000 osd.0 (osd.0) 208 : cluster [DBG] 4.b scrub ok 2024-02-10T08:35:11.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:35:10.278551+0000 mon.c (mon.2) 84 : audit [DBG] from='client.? 172.21.15.18:0/1149330691' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:35:11.464 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.4 dump_ops_in_flight 2024-02-10T08:35:11.633 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:35:11.637 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:11.638 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:35:11.738 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:35:11.748 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:35:11.798 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:11.828 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:35:11.833 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:11.834 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:35:11.910 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:35:11.935 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:35:12.011 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:12.176 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:11.021549+0000 mgr.y (mgr.14505) 692 : cluster [DBG] pgmap v854: 168 pgs: 168 active+clean; 4.3 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.10k op/s 2024-02-10T08:35:12.176 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:11.605096+0000 osd.6 (osd.6) 208 : cluster [DBG] 10.f scrub ok 2024-02-10T08:35:12.176 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:35:12.038918+0000 mon.a (mon.0) 1603 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:35:12.176 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:12.078304+0000 osd.4 (osd.4) 136 : cluster [DBG] 6.17 scrub starts 2024-02-10T08:35:12.224 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:35:12.230 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:12.230 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:35:12.331 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:35:12.393 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:12.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:11.021549+0000 mgr.y (mgr.14505) 692 : cluster [DBG] pgmap v854: 168 pgs: 168 active+clean; 4.3 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.10k op/s 2024-02-10T08:35:12.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:11.605096+0000 osd.6 (osd.6) 208 : cluster [DBG] 10.f scrub ok 2024-02-10T08:35:12.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:35:12.038918+0000 mon.a (mon.0) 1603 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:35:12.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:12.078304+0000 osd.4 (osd.4) 136 : cluster [DBG] 6.17 scrub starts 2024-02-10T08:35:12.410 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:11.021549+0000 mgr.y (mgr.14505) 692 : cluster [DBG] pgmap v854: 168 pgs: 168 active+clean; 4.3 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.10k op/s 2024-02-10T08:35:12.411 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:11.605096+0000 osd.6 (osd.6) 208 : cluster [DBG] 10.f scrub ok 2024-02-10T08:35:12.411 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:35:12.038918+0000 mon.a (mon.0) 1603 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:35:12.411 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:12.078304+0000 osd.4 (osd.4) 136 : cluster [DBG] 6.17 scrub starts 2024-02-10T08:35:12.463 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:35:12.465 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:12.466 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:35:12.566 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:35:12.619 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:12.792 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:35:12.795 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:12.795 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:35:12.896 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:35:12.966 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:13.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:11.831107+0000 osd.6 (osd.6) 209 : cluster [DBG] 2.17 scrub starts 2024-02-10T08:35:13.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:11.849766+0000 osd.6 (osd.6) 210 : cluster [DBG] 2.17 scrub ok 2024-02-10T08:35:13.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:12.180804+0000 osd.4 (osd.4) 137 : cluster [DBG] 6.17 scrub ok 2024-02-10T08:35:13.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:12.358490+0000 osd.7 (osd.7) 227 : cluster [DBG] 6.b scrub starts 2024-02-10T08:35:13.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:12.451072+0000 osd.7 (osd.7) 228 : cluster [DBG] 6.b scrub ok 2024-02-10T08:35:13.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:35:12.551788+0000 mon.a (mon.0) 1604 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:35:13.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:35:12.552854+0000 mon.a (mon.0) 1605 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:35:13.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:35:12.565594+0000 mon.a (mon.0) 1606 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:35:13.344 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:35:13.354 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:13.354 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:35:13.455 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:35:13.486 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 3, 4, 5, 6, 7, 0] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 5, 6, 7, 4] 2024-02-10T08:35:13.487 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-10T08:35:13.487 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-02-10T08:35:13.487 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd dump -f json-pretty 2024-02-10T08:35:13.498 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:13.528 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:11.831107+0000 osd.6 (osd.6) 209 : cluster [DBG] 2.17 scrub starts 2024-02-10T08:35:13.528 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:11.849766+0000 osd.6 (osd.6) 210 : cluster [DBG] 2.17 scrub ok 2024-02-10T08:35:13.528 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:12.180804+0000 osd.4 (osd.4) 137 : cluster [DBG] 6.17 scrub ok 2024-02-10T08:35:13.528 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:12.358490+0000 osd.7 (osd.7) 227 : cluster [DBG] 6.b scrub starts 2024-02-10T08:35:13.529 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:12.451072+0000 osd.7 (osd.7) 228 : cluster [DBG] 6.b scrub ok 2024-02-10T08:35:13.529 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:35:12.551788+0000 mon.a (mon.0) 1604 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:35:13.529 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:35:12.552854+0000 mon.a (mon.0) 1605 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:35:13.529 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:35:12.565594+0000 mon.a (mon.0) 1606 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:35:13.531 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:11.831107+0000 osd.6 (osd.6) 209 : cluster [DBG] 2.17 scrub starts 2024-02-10T08:35:13.531 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:11.849766+0000 osd.6 (osd.6) 210 : cluster [DBG] 2.17 scrub ok 2024-02-10T08:35:13.531 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:12.180804+0000 osd.4 (osd.4) 137 : cluster [DBG] 6.17 scrub ok 2024-02-10T08:35:13.531 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:12.358490+0000 osd.7 (osd.7) 227 : cluster [DBG] 6.b scrub starts 2024-02-10T08:35:13.531 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:12.451072+0000 osd.7 (osd.7) 228 : cluster [DBG] 6.b scrub ok 2024-02-10T08:35:13.531 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:35:12.551788+0000 mon.a (mon.0) 1604 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:35:13.531 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:35:12.552854+0000 mon.a (mon.0) 1605 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:35:13.531 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:35:12.565594+0000 mon.a (mon.0) 1606 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:35:13.623 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:35:13.629 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:13.630 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:35:13.644 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-10T08:35:13.730 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:35:13.835 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:13.884 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:35:13.888 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:13.889 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:35:13.990 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:35:14.062 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:14.204 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-02-10T08:35:14.204 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-02-10T08:35:14.204 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-02-10T08:35:14.204 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-02-10T08:35:14.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:12.862254+0000 osd.6 (osd.6) 211 : cluster [DBG] 10.0 scrub starts 2024-02-10T08:35:14.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:13.024978+0000 mgr.y (mgr.14505) 693 : cluster [DBG] pgmap v855: 168 pgs: 1 active+clean+scrubbing, 167 active+clean; 4.1 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.09k op/s 2024-02-10T08:35:14.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:12.862254+0000 osd.6 (osd.6) 211 : cluster [DBG] 10.0 scrub starts 2024-02-10T08:35:14.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:13.024978+0000 mgr.y (mgr.14505) 693 : cluster [DBG] pgmap v855: 168 pgs: 1 active+clean+scrubbing, 167 active+clean; 4.1 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.09k op/s 2024-02-10T08:35:14.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:12.862254+0000 osd.6 (osd.6) 211 : cluster [DBG] 10.0 scrub starts 2024-02-10T08:35:14.542 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:13.024978+0000 mgr.y (mgr.14505) 693 : cluster [DBG] pgmap v855: 168 pgs: 1 active+clean+scrubbing, 167 active+clean; 4.1 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.09k op/s 2024-02-10T08:35:14.623 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:35:14.633 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:35:14.641 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:14.642 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:35:14.657 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:35:14.743 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:35:14.794 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:14.938 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:35:14.944 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:14.946 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:35:14.961 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.4 dump_blocked_ops 2024-02-10T08:35:15.047 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:35:15.083 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:15.117 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:35:15.123 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:15.123 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:35:15.199 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is unset 2024-02-10T08:35:15.223 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:35:15.279 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:14.194538+0000 osd.6 (osd.6) 212 : cluster [DBG] 10.0 scrub ok 2024-02-10T08:35:15.279 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:14.719141+0000 osd.1 (osd.1) 230 : cluster [DBG] 2.9 scrub starts 2024-02-10T08:35:15.279 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:14.724411+0000 osd.1 (osd.1) 231 : cluster [DBG] 2.9 scrub ok 2024-02-10T08:35:15.279 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:35:14.911545+0000 mon.c (mon.2) 85 : audit [INF] from='client.? 172.21.15.18:0/2742796694' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:35:15.279 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:35:14.912221+0000 mon.a (mon.0) 1607 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:35:15.280 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:14.194538+0000 osd.6 (osd.6) 212 : cluster [DBG] 10.0 scrub ok 2024-02-10T08:35:15.280 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:14.719141+0000 osd.1 (osd.1) 230 : cluster [DBG] 2.9 scrub starts 2024-02-10T08:35:15.281 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:14.724411+0000 osd.1 (osd.1) 231 : cluster [DBG] 2.9 scrub ok 2024-02-10T08:35:15.281 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:35:14.911545+0000 mon.c (mon.2) 85 : audit [INF] from='client.? 172.21.15.18:0/2742796694' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:35:15.281 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:35:14.912221+0000 mon.a (mon.0) 1607 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:35:15.284 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:15.456 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:35:15.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:14.194538+0000 osd.6 (osd.6) 212 : cluster [DBG] 10.0 scrub ok 2024-02-10T08:35:15.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:14.719141+0000 osd.1 (osd.1) 230 : cluster [DBG] 2.9 scrub starts 2024-02-10T08:35:15.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:14.724411+0000 osd.1 (osd.1) 231 : cluster [DBG] 2.9 scrub ok 2024-02-10T08:35:15.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:35:14.911545+0000 mon.c (mon.2) 85 : audit [INF] from='client.? 172.21.15.18:0/2742796694' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:35:15.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:35:14.912221+0000 mon.a (mon.0) 1607 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:35:15.547 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:35:15.550 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:15.551 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:35:15.652 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:35:15.702 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:15.774 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:35:15.779 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:15.779 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:35:15.880 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:35:15.954 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:16.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:15.026368+0000 mgr.y (mgr.14505) 694 : cluster [DBG] pgmap v856: 168 pgs: 1 active+clean+scrubbing, 167 active+clean; 4.0 GiB data, 17 GiB used, 699 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.09k op/s 2024-02-10T08:35:16.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:15.180612+0000 mon.a (mon.0) 1608 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-10T08:35:16.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:15.180642+0000 mon.a (mon.0) 1609 : cluster [INF] Cluster is now healthy 2024-02-10T08:35:16.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:35:15.186961+0000 mon.a (mon.0) 1610 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-10T08:35:16.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:15.187010+0000 mon.a (mon.0) 1611 : cluster [DBG] osdmap e379: 8 total, 8 up, 8 in 2024-02-10T08:35:16.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:15.026368+0000 mgr.y (mgr.14505) 694 : cluster [DBG] pgmap v856: 168 pgs: 1 active+clean+scrubbing, 167 active+clean; 4.0 GiB data, 17 GiB used, 699 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.09k op/s 2024-02-10T08:35:16.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:15.180612+0000 mon.a (mon.0) 1608 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-10T08:35:16.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:15.180642+0000 mon.a (mon.0) 1609 : cluster [INF] Cluster is now healthy 2024-02-10T08:35:16.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:35:15.186961+0000 mon.a (mon.0) 1610 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-10T08:35:16.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:15.187010+0000 mon.a (mon.0) 1611 : cluster [DBG] osdmap e379: 8 total, 8 up, 8 in 2024-02-10T08:35:16.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:15.026368+0000 mgr.y (mgr.14505) 694 : cluster [DBG] pgmap v856: 168 pgs: 1 active+clean+scrubbing, 167 active+clean; 4.0 GiB data, 17 GiB used, 699 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.09k op/s 2024-02-10T08:35:16.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:15.180612+0000 mon.a (mon.0) 1608 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-10T08:35:16.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:15.180642+0000 mon.a (mon.0) 1609 : cluster [INF] Cluster is now healthy 2024-02-10T08:35:16.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:35:15.186961+0000 mon.a (mon.0) 1610 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-10T08:35:16.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:15.187010+0000 mon.a (mon.0) 1611 : cluster [DBG] osdmap e379: 8 total, 8 up, 8 in 2024-02-10T08:35:16.789 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:35:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:35:16] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:35:17.404 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:35:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:35:17] "GET /metrics HTTP/1.1" 200 176440 "" "Prometheus/2.33.4" 2024-02-10T08:35:17.520 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-02-10T08:35:17.521 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-02-10T08:35:17.521 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-02-10T08:35:17.521 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-02-10T08:35:17.521 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-02-10T08:35:17.969 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:15.868472+0000 osd.6 (osd.6) 213 : cluster [DBG] 5.11 scrub starts 2024-02-10T08:35:17.969 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:15.872970+0000 osd.6 (osd.6) 214 : cluster [DBG] 5.11 scrub ok 2024-02-10T08:35:17.969 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:35:16.685811+0000 mon.a (mon.0) 1612 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:35:17.969 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:17.027341+0000 mgr.y (mgr.14505) 695 : cluster [DBG] pgmap v858: 168 pgs: 1 active+clean+scrubbing, 167 active+clean; 4.0 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 1.09k op/s 2024-02-10T08:35:18.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:15.868472+0000 osd.6 (osd.6) 213 : cluster [DBG] 5.11 scrub starts 2024-02-10T08:35:18.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:15.872970+0000 osd.6 (osd.6) 214 : cluster [DBG] 5.11 scrub ok 2024-02-10T08:35:18.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:35:16.685811+0000 mon.a (mon.0) 1612 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:35:18.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:17.027341+0000 mgr.y (mgr.14505) 695 : cluster [DBG] pgmap v858: 168 pgs: 1 active+clean+scrubbing, 167 active+clean; 4.0 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 1.09k op/s 2024-02-10T08:35:18.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:15.868472+0000 osd.6 (osd.6) 213 : cluster [DBG] 5.11 scrub starts 2024-02-10T08:35:18.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:15.872970+0000 osd.6 (osd.6) 214 : cluster [DBG] 5.11 scrub ok 2024-02-10T08:35:18.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:35:16.685811+0000 mon.a (mon.0) 1612 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:35:18.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:17.027341+0000 mgr.y (mgr.14505) 695 : cluster [DBG] pgmap v858: 168 pgs: 1 active+clean+scrubbing, 167 active+clean; 4.0 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 1.09k op/s 2024-02-10T08:35:18.335 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.4 dump_historic_ops 2024-02-10T08:35:18.671 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:35:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:35:18.763 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:35:19.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:17.740427+0000 osd.1 (osd.1) 232 : cluster [DBG] 4.14 scrub starts 2024-02-10T08:35:19.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:17.746546+0000 osd.1 (osd.1) 233 : cluster [DBG] 4.14 scrub ok 2024-02-10T08:35:19.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:17.740427+0000 osd.1 (osd.1) 232 : cluster [DBG] 4.14 scrub starts 2024-02-10T08:35:19.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:17.746546+0000 osd.1 (osd.1) 233 : cluster [DBG] 4.14 scrub ok 2024-02-10T08:35:19.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:17.740427+0000 osd.1 (osd.1) 232 : cluster [DBG] 4.14 scrub starts 2024-02-10T08:35:19.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:17.746546+0000 osd.1 (osd.1) 233 : cluster [DBG] 4.14 scrub ok 2024-02-10T08:35:19.426 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:35:19.429 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:19.429 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:35:19.530 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:35:19.558 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:19.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:17.874075+0000 osd.6 (osd.6) 215 : cluster [DBG] 10.a scrub starts 2024-02-10T08:35:19.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:35:18.668518+0000 mgr.y (mgr.14505) 696 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:35:19.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:19.028071+0000 mgr.y (mgr.14505) 697 : cluster [DBG] pgmap v859: 168 pgs: 168 active+clean; 3.7 GiB data, 16 GiB used, 700 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.06k op/s 2024-02-10T08:35:19.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:19.049118+0000 osd.4 (osd.4) 138 : cluster [DBG] 5.1c scrub starts 2024-02-10T08:35:19.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:19.051795+0000 osd.4 (osd.4) 139 : cluster [DBG] 5.1c scrub ok 2024-02-10T08:35:19.995 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:17.874075+0000 osd.6 (osd.6) 215 : cluster [DBG] 10.a scrub starts 2024-02-10T08:35:19.995 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:35:18.668518+0000 mgr.y (mgr.14505) 696 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:35:19.995 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:19.028071+0000 mgr.y (mgr.14505) 697 : cluster [DBG] pgmap v859: 168 pgs: 168 active+clean; 3.7 GiB data, 16 GiB used, 700 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.06k op/s 2024-02-10T08:35:19.995 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:19.049118+0000 osd.4 (osd.4) 138 : cluster [DBG] 5.1c scrub starts 2024-02-10T08:35:19.996 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:19.051795+0000 osd.4 (osd.4) 139 : cluster [DBG] 5.1c scrub ok 2024-02-10T08:35:19.996 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:17.874075+0000 osd.6 (osd.6) 215 : cluster [DBG] 10.a scrub starts 2024-02-10T08:35:19.996 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:35:18.668518+0000 mgr.y (mgr.14505) 696 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:35:19.996 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:19.028071+0000 mgr.y (mgr.14505) 697 : cluster [DBG] pgmap v859: 168 pgs: 168 active+clean; 3.7 GiB data, 16 GiB used, 700 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.06k op/s 2024-02-10T08:35:19.996 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:19.049118+0000 osd.4 (osd.4) 138 : cluster [DBG] 5.1c scrub starts 2024-02-10T08:35:19.996 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:19.051795+0000 osd.4 (osd.4) 139 : cluster [DBG] 5.1c scrub ok 2024-02-10T08:35:20.749 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:19.311577+0000 osd.6 (osd.6) 216 : cluster [DBG] 10.a scrub ok 2024-02-10T08:35:20.749 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:19.410510+0000 osd.7 (osd.7) 229 : cluster [DBG] 6.1b deep-scrub starts 2024-02-10T08:35:20.749 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:19.525663+0000 osd.7 (osd.7) 230 : cluster [DBG] 6.1b deep-scrub ok 2024-02-10T08:35:20.749 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:19.719690+0000 osd.1 (osd.1) 234 : cluster [DBG] 10.2 scrub starts 2024-02-10T08:35:20.749 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:19.311577+0000 osd.6 (osd.6) 216 : cluster [DBG] 10.a scrub ok 2024-02-10T08:35:20.750 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:19.410510+0000 osd.7 (osd.7) 229 : cluster [DBG] 6.1b deep-scrub starts 2024-02-10T08:35:20.750 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:19.525663+0000 osd.7 (osd.7) 230 : cluster [DBG] 6.1b deep-scrub ok 2024-02-10T08:35:20.750 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:19.719690+0000 osd.1 (osd.1) 234 : cluster [DBG] 10.2 scrub starts 2024-02-10T08:35:21.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:19.311577+0000 osd.6 (osd.6) 216 : cluster [DBG] 10.a scrub ok 2024-02-10T08:35:21.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:19.410510+0000 osd.7 (osd.7) 229 : cluster [DBG] 6.1b deep-scrub starts 2024-02-10T08:35:21.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:19.525663+0000 osd.7 (osd.7) 230 : cluster [DBG] 6.1b deep-scrub ok 2024-02-10T08:35:21.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:19.719690+0000 osd.1 (osd.1) 234 : cluster [DBG] 10.2 scrub starts 2024-02-10T08:35:21.485 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:35:21.485 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-02-10T08:35:21.485 INFO:teuthology.orchestra.run.smithi018.stdout: "epoch": 380, 2024-02-10T08:35:21.485 INFO:teuthology.orchestra.run.smithi018.stdout: "fsid": "d46257c8-c7eb-11ee-95b8-87774f69a715", 2024-02-10T08:35:21.485 INFO:teuthology.orchestra.run.smithi018.stdout: "created": "2024-02-10T08:10:57.425061+0000", 2024-02-10T08:35:21.485 INFO:teuthology.orchestra.run.smithi018.stdout: "modified": "2024-02-10T08:35:20.717196+0000", 2024-02-10T08:35:21.485 INFO:teuthology.orchestra.run.smithi018.stdout: "last_up_change": "2024-02-10T08:20:45.372678+0000", 2024-02-10T08:35:21.485 INFO:teuthology.orchestra.run.smithi018.stdout: "last_in_change": "2024-02-10T08:28:01.734588+0000", 2024-02-10T08:35:21.485 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-02-10T08:35:21.486 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_num": 5799936, 2024-02-10T08:35:21.486 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_set": [ 2024-02-10T08:35:21.486 INFO:teuthology.orchestra.run.smithi018.stdout: "pglog_hardlimit", 2024-02-10T08:35:21.486 INFO:teuthology.orchestra.run.smithi018.stdout: "purged_snapdirs", 2024-02-10T08:35:21.486 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_deletes", 2024-02-10T08:35:21.486 INFO:teuthology.orchestra.run.smithi018.stdout: "sortbitwise" 2024-02-10T08:35:21.486 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-02-10T08:35:21.486 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_version": 19, 2024-02-10T08:35:21.486 INFO:teuthology.orchestra.run.smithi018.stdout: "full_ratio": 0.94999998807907104, 2024-02-10T08:35:21.486 INFO:teuthology.orchestra.run.smithi018.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-02-10T08:35:21.486 INFO:teuthology.orchestra.run.smithi018.stdout: "nearfull_ratio": 0.85000002384185791, 2024-02-10T08:35:21.486 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_snapshot": "", 2024-02-10T08:35:21.486 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_max": 10, 2024-02-10T08:35:21.486 INFO:teuthology.orchestra.run.smithi018.stdout: "max_osd": 8, 2024-02-10T08:35:21.487 INFO:teuthology.orchestra.run.smithi018.stdout: "require_min_compat_client": "luminous", 2024-02-10T08:35:21.487 INFO:teuthology.orchestra.run.smithi018.stdout: "min_compat_client": "luminous", 2024-02-10T08:35:21.487 INFO:teuthology.orchestra.run.smithi018.stdout: "require_osd_release": "pacific", 2024-02-10T08:35:21.487 INFO:teuthology.orchestra.run.smithi018.stdout: "pools": [ 2024-02-10T08:35:21.487 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.487 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 1, 2024-02-10T08:35:21.487 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "device_health_metrics", 2024-02-10T08:35:21.487 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-02-10T08:14:44.034966+0000", 2024-02-10T08:35:21.487 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-02-10T08:35:21.487 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-02-10T08:35:21.487 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-02-10T08:35:21.487 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 3, 2024-02-10T08:35:21.487 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 2, 2024-02-10T08:35:21.488 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-02-10T08:35:21.488 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-02-10T08:35:21.488 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-02-10T08:35:21.488 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-02-10T08:35:21.488 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-10T08:35:21.488 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-02-10T08:35:21.488 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-02-10T08:35:21.488 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 1, 2024-02-10T08:35:21.488 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 1, 2024-02-10T08:35:21.488 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 1, 2024-02-10T08:35:21.488 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 1, 2024-02-10T08:35:21.488 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 1, 2024-02-10T08:35:21.488 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-02-10T08:35:21.489 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-02-10T08:35:21.489 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-02-10T08:35:21.489 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-02-10T08:35:21.489 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-02-10T08:35:21.489 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-02-10T08:35:21.489 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-02-10T08:35:21.489 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.489 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "66", 2024-02-10T08:35:21.489 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-02-10T08:35:21.489 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-10T08:35:21.489 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-02-10T08:35:21.489 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-02-10T08:35:21.489 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-02-10T08:35:21.489 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-02-10T08:35:21.490 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-02-10T08:35:21.490 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-02-10T08:35:21.490 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-02-10T08:35:21.490 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-02-10T08:35:21.490 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-02-10T08:35:21.490 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-02-10T08:35:21.490 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-02-10T08:35:21.490 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-02-10T08:35:21.490 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-02-10T08:35:21.490 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-02-10T08:35:21.490 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-02-10T08:35:21.490 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-02-10T08:35:21.490 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-10T08:35:21.491 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-10T08:35:21.491 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-10T08:35:21.491 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-02-10T08:35:21.491 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-02-10T08:35:21.491 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-02-10T08:35:21.491 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-02-10T08:35:21.491 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-02-10T08:35:21.491 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.491 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-02-10T08:35:21.491 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-02-10T08:35:21.491 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-02-10T08:35:21.491 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-02-10T08:35:21.491 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-02-10T08:35:21.492 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-02-10T08:35:21.492 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-02-10T08:35:21.492 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-02-10T08:35:21.492 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-02-10T08:35:21.492 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-02-10T08:35:21.492 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-02-10T08:35:21.492 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-02-10T08:35:21.492 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_max": 32, 2024-02-10T08:35:21.492 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 1 2024-02-10T08:35:21.492 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.492 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-02-10T08:35:21.492 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_devicehealth": {} 2024-02-10T08:35:21.492 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:35:21.493 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.493 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.493 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 2, 2024-02-10T08:35:21.493 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": ".rgw.root", 2024-02-10T08:35:21.493 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-02-10T08:16:51.334631+0000", 2024-02-10T08:35:21.493 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-02-10T08:35:21.493 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-02-10T08:35:21.493 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-02-10T08:35:21.493 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 3, 2024-02-10T08:35:21.493 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 2, 2024-02-10T08:35:21.493 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-02-10T08:35:21.493 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-02-10T08:35:21.493 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-02-10T08:35:21.493 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-02-10T08:35:21.494 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-10T08:35:21.494 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-02-10T08:35:21.494 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-02-10T08:35:21.494 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 32, 2024-02-10T08:35:21.494 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 32, 2024-02-10T08:35:21.494 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 32, 2024-02-10T08:35:21.494 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 32, 2024-02-10T08:35:21.494 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 32, 2024-02-10T08:35:21.494 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-02-10T08:35:21.494 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-02-10T08:35:21.494 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-02-10T08:35:21.494 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-02-10T08:35:21.494 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-02-10T08:35:21.494 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-02-10T08:35:21.494 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-02-10T08:35:21.495 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.495 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "56", 2024-02-10T08:35:21.495 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-02-10T08:35:21.495 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-10T08:35:21.495 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-02-10T08:35:21.495 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-02-10T08:35:21.495 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-02-10T08:35:21.495 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-02-10T08:35:21.495 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-02-10T08:35:21.495 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-02-10T08:35:21.495 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-02-10T08:35:21.495 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-02-10T08:35:21.495 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-02-10T08:35:21.495 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-02-10T08:35:21.496 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-02-10T08:35:21.496 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-02-10T08:35:21.496 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-02-10T08:35:21.496 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-02-10T08:35:21.496 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-02-10T08:35:21.496 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-02-10T08:35:21.496 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-10T08:35:21.496 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-10T08:35:21.496 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-10T08:35:21.496 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-02-10T08:35:21.496 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-02-10T08:35:21.496 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-02-10T08:35:21.496 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-02-10T08:35:21.496 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-02-10T08:35:21.497 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.497 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-02-10T08:35:21.497 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-02-10T08:35:21.497 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-02-10T08:35:21.497 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-02-10T08:35:21.497 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-02-10T08:35:21.497 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-02-10T08:35:21.497 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-02-10T08:35:21.497 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-02-10T08:35:21.497 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-02-10T08:35:21.497 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-02-10T08:35:21.497 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-02-10T08:35:21.497 INFO:teuthology.orchestra.run.smithi018.stdout: "options": {}, 2024-02-10T08:35:21.497 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-02-10T08:35:21.498 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw": {} 2024-02-10T08:35:21.498 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:35:21.498 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.498 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.498 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 3, 2024-02-10T08:35:21.498 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "iscsi", 2024-02-10T08:35:21.498 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-02-10T08:16:51.762963+0000", 2024-02-10T08:35:21.498 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-02-10T08:35:21.498 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-02-10T08:35:21.498 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-02-10T08:35:21.498 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 3, 2024-02-10T08:35:21.498 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 2, 2024-02-10T08:35:21.498 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-02-10T08:35:21.498 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-02-10T08:35:21.498 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-02-10T08:35:21.499 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-02-10T08:35:21.499 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-10T08:35:21.499 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-02-10T08:35:21.499 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-02-10T08:35:21.499 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 3, 2024-02-10T08:35:21.499 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 3, 2024-02-10T08:35:21.499 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 3, 2024-02-10T08:35:21.499 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 3, 2024-02-10T08:35:21.499 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 3, 2024-02-10T08:35:21.499 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-02-10T08:35:21.499 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-02-10T08:35:21.499 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-02-10T08:35:21.499 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-02-10T08:35:21.499 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-02-10T08:35:21.500 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-02-10T08:35:21.500 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-02-10T08:35:21.500 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.500 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "375", 2024-02-10T08:35:21.500 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-02-10T08:35:21.500 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-10T08:35:21.500 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-02-10T08:35:21.500 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-02-10T08:35:21.500 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-02-10T08:35:21.500 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-02-10T08:35:21.500 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-02-10T08:35:21.500 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-02-10T08:35:21.500 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-02-10T08:35:21.500 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-02-10T08:35:21.501 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-02-10T08:35:21.501 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-02-10T08:35:21.501 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-02-10T08:35:21.501 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-02-10T08:35:21.501 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-02-10T08:35:21.501 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-02-10T08:35:21.501 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-02-10T08:35:21.501 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-02-10T08:35:21.501 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-10T08:35:21.501 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-10T08:35:21.501 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-10T08:35:21.501 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-02-10T08:35:21.501 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-02-10T08:35:21.501 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-02-10T08:35:21.501 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-02-10T08:35:21.502 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-02-10T08:35:21.502 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.502 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-02-10T08:35:21.502 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-02-10T08:35:21.502 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-02-10T08:35:21.502 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-02-10T08:35:21.502 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-02-10T08:35:21.502 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-02-10T08:35:21.502 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-02-10T08:35:21.502 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-02-10T08:35:21.502 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-02-10T08:35:21.502 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-02-10T08:35:21.502 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-02-10T08:35:21.502 INFO:teuthology.orchestra.run.smithi018.stdout: "options": {}, 2024-02-10T08:35:21.502 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-02-10T08:35:21.503 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd": {} 2024-02-10T08:35:21.503 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:35:21.503 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.503 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.503 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 4, 2024-02-10T08:35:21.503 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "default.rgw.log", 2024-02-10T08:35:21.503 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-02-10T08:16:53.258098+0000", 2024-02-10T08:35:21.503 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-02-10T08:35:21.503 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-02-10T08:35:21.503 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-02-10T08:35:21.503 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 3, 2024-02-10T08:35:21.503 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 2, 2024-02-10T08:35:21.503 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-02-10T08:35:21.503 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-02-10T08:35:21.504 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-02-10T08:35:21.504 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-02-10T08:35:21.504 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-10T08:35:21.504 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-02-10T08:35:21.504 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-02-10T08:35:21.504 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 32, 2024-02-10T08:35:21.504 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 32, 2024-02-10T08:35:21.504 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 32, 2024-02-10T08:35:21.504 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 32, 2024-02-10T08:35:21.504 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 32, 2024-02-10T08:35:21.504 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-02-10T08:35:21.504 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-02-10T08:35:21.504 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-02-10T08:35:21.504 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-02-10T08:35:21.505 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-02-10T08:35:21.505 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-02-10T08:35:21.505 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-02-10T08:35:21.505 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.505 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "205", 2024-02-10T08:35:21.505 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-02-10T08:35:21.505 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-10T08:35:21.505 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-02-10T08:35:21.505 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-02-10T08:35:21.505 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-02-10T08:35:21.505 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-02-10T08:35:21.505 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-02-10T08:35:21.505 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-02-10T08:35:21.505 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-02-10T08:35:21.506 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-02-10T08:35:21.506 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-02-10T08:35:21.506 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-02-10T08:35:21.506 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-02-10T08:35:21.506 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-02-10T08:35:21.506 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-02-10T08:35:21.506 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-02-10T08:35:21.506 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-02-10T08:35:21.506 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-02-10T08:35:21.506 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-10T08:35:21.506 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-10T08:35:21.506 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-10T08:35:21.506 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-02-10T08:35:21.506 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-02-10T08:35:21.507 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-02-10T08:35:21.507 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-02-10T08:35:21.507 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-02-10T08:35:21.507 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.507 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-02-10T08:35:21.507 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-02-10T08:35:21.507 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-02-10T08:35:21.507 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-02-10T08:35:21.507 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-02-10T08:35:21.507 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-02-10T08:35:21.507 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-02-10T08:35:21.507 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-02-10T08:35:21.507 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-02-10T08:35:21.507 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-02-10T08:35:21.508 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-02-10T08:35:21.508 INFO:teuthology.orchestra.run.smithi018.stdout: "options": {}, 2024-02-10T08:35:21.508 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-02-10T08:35:21.508 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw": {} 2024-02-10T08:35:21.508 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:35:21.508 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.508 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.508 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 5, 2024-02-10T08:35:21.508 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "default.rgw.control", 2024-02-10T08:35:21.508 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-02-10T08:16:55.289300+0000", 2024-02-10T08:35:21.508 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-02-10T08:35:21.508 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-02-10T08:35:21.509 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-02-10T08:35:21.509 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 3, 2024-02-10T08:35:21.509 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 2, 2024-02-10T08:35:21.509 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-02-10T08:35:21.509 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-02-10T08:35:21.509 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-02-10T08:35:21.509 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-02-10T08:35:21.509 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-10T08:35:21.509 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-02-10T08:35:21.509 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-02-10T08:35:21.509 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 32, 2024-02-10T08:35:21.509 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 32, 2024-02-10T08:35:21.509 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 32, 2024-02-10T08:35:21.509 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 32, 2024-02-10T08:35:21.510 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 32, 2024-02-10T08:35:21.510 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-02-10T08:35:21.510 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-02-10T08:35:21.510 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-02-10T08:35:21.510 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-02-10T08:35:21.510 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-02-10T08:35:21.510 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-02-10T08:35:21.510 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-02-10T08:35:21.510 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.510 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "60", 2024-02-10T08:35:21.510 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-02-10T08:35:21.510 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-10T08:35:21.510 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-02-10T08:35:21.510 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-02-10T08:35:21.511 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-02-10T08:35:21.511 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-02-10T08:35:21.511 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-02-10T08:35:21.511 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-02-10T08:35:21.511 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-02-10T08:35:21.511 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-02-10T08:35:21.511 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-02-10T08:35:21.511 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-02-10T08:35:21.511 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-02-10T08:35:21.511 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-02-10T08:35:21.511 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-02-10T08:35:21.511 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-02-10T08:35:21.512 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-02-10T08:35:21.512 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-02-10T08:35:21.512 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-10T08:35:21.512 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-10T08:35:21.512 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-10T08:35:21.512 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-02-10T08:35:21.512 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-02-10T08:35:21.512 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-02-10T08:35:21.512 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-02-10T08:35:21.513 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-02-10T08:35:21.513 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.513 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-02-10T08:35:21.513 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-02-10T08:35:21.513 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-02-10T08:35:21.513 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-02-10T08:35:21.513 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-02-10T08:35:21.513 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-02-10T08:35:21.513 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-02-10T08:35:21.513 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-02-10T08:35:21.513 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-02-10T08:35:21.513 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-02-10T08:35:21.513 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-02-10T08:35:21.513 INFO:teuthology.orchestra.run.smithi018.stdout: "options": {}, 2024-02-10T08:35:21.513 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-02-10T08:35:21.514 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw": {} 2024-02-10T08:35:21.514 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:35:21.514 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.514 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.514 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 6, 2024-02-10T08:35:21.514 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "default.rgw.meta", 2024-02-10T08:35:21.514 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-02-10T08:16:57.354868+0000", 2024-02-10T08:35:21.514 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-02-10T08:35:21.514 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-02-10T08:35:21.514 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-02-10T08:35:21.515 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 3, 2024-02-10T08:35:21.515 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 2, 2024-02-10T08:35:21.515 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-02-10T08:35:21.515 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-02-10T08:35:21.515 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-02-10T08:35:21.515 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-02-10T08:35:21.515 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-10T08:35:21.515 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-02-10T08:35:21.515 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-02-10T08:35:21.515 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 52, 2024-02-10T08:35:21.515 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 52, 2024-02-10T08:35:21.515 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 52, 2024-02-10T08:35:21.516 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 52, 2024-02-10T08:35:21.516 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 52, 2024-02-10T08:35:21.516 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-02-10T08:35:21.516 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-02-10T08:35:21.516 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-02-10T08:35:21.516 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-02-10T08:35:21.516 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-02-10T08:35:21.516 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-02-10T08:35:21.516 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-02-10T08:35:21.516 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.516 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "289", 2024-02-10T08:35:21.516 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-02-10T08:35:21.517 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-10T08:35:21.517 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "287", 2024-02-10T08:35:21.517 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-02-10T08:35:21.517 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-02-10T08:35:21.517 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-02-10T08:35:21.517 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-02-10T08:35:21.517 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-02-10T08:35:21.517 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-02-10T08:35:21.517 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-02-10T08:35:21.517 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-02-10T08:35:21.517 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-02-10T08:35:21.517 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-02-10T08:35:21.517 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-02-10T08:35:21.518 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-02-10T08:35:21.518 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-02-10T08:35:21.518 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-02-10T08:35:21.518 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-02-10T08:35:21.518 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-10T08:35:21.518 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-10T08:35:21.518 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-10T08:35:21.518 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-02-10T08:35:21.518 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-02-10T08:35:21.518 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-02-10T08:35:21.519 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-02-10T08:35:21.519 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-02-10T08:35:21.519 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.519 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-02-10T08:35:21.519 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-02-10T08:35:21.519 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-02-10T08:35:21.519 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-02-10T08:35:21.519 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-02-10T08:35:21.519 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-02-10T08:35:21.519 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-02-10T08:35:21.519 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-02-10T08:35:21.519 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-02-10T08:35:21.519 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-02-10T08:35:21.520 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-02-10T08:35:21.520 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-02-10T08:35:21.520 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_bias": 4 2024-02-10T08:35:21.520 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.520 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-02-10T08:35:21.520 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw": {} 2024-02-10T08:35:21.520 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:35:21.520 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.520 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.520 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 10, 2024-02-10T08:35:21.520 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "unique_pool_3", 2024-02-10T08:35:21.521 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-02-10T08:32:29.906015+0000", 2024-02-10T08:35:21.521 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-02-10T08:35:21.521 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-02-10T08:35:21.521 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-02-10T08:35:21.521 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 3, 2024-02-10T08:35:21.521 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 2, 2024-02-10T08:35:21.521 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-02-10T08:35:21.521 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-02-10T08:35:21.521 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-02-10T08:35:21.521 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-02-10T08:35:21.522 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-10T08:35:21.522 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-02-10T08:35:21.522 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-02-10T08:35:21.522 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 16, 2024-02-10T08:35:21.522 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 16, 2024-02-10T08:35:21.522 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 16, 2024-02-10T08:35:21.522 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 16, 2024-02-10T08:35:21.522 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 16, 2024-02-10T08:35:21.522 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-02-10T08:35:21.522 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-02-10T08:35:21.522 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-02-10T08:35:21.523 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-02-10T08:35:21.523 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-02-10T08:35:21.523 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-02-10T08:35:21.523 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-02-10T08:35:21.523 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.523 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "341", 2024-02-10T08:35:21.523 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-02-10T08:35:21.523 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-10T08:35:21.523 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-02-10T08:35:21.523 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-02-10T08:35:21.523 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-02-10T08:35:21.523 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-02-10T08:35:21.524 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-02-10T08:35:21.524 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-02-10T08:35:21.524 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-02-10T08:35:21.524 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-02-10T08:35:21.524 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-02-10T08:35:21.524 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-02-10T08:35:21.524 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-02-10T08:35:21.524 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-02-10T08:35:21.524 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-02-10T08:35:21.524 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-02-10T08:35:21.525 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-02-10T08:35:21.525 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-02-10T08:35:21.525 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-10T08:35:21.525 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-10T08:35:21.525 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-10T08:35:21.525 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-02-10T08:35:21.525 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-02-10T08:35:21.526 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-02-10T08:35:21.526 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-02-10T08:35:21.526 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-02-10T08:35:21.526 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.526 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-02-10T08:35:21.526 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-02-10T08:35:21.526 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-02-10T08:35:21.526 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-02-10T08:35:21.526 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-02-10T08:35:21.526 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-02-10T08:35:21.526 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-02-10T08:35:21.527 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-02-10T08:35:21.527 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-02-10T08:35:21.527 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-02-10T08:35:21.527 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-02-10T08:35:21.527 INFO:teuthology.orchestra.run.smithi018.stdout: "options": {}, 2024-02-10T08:35:21.527 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-02-10T08:35:21.527 INFO:teuthology.orchestra.run.smithi018.stdout: "rados": {} 2024-02-10T08:35:21.527 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:35:21.527 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:35:21.527 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-02-10T08:35:21.527 INFO:teuthology.orchestra.run.smithi018.stdout: "osds": [ 2024-02-10T08:35:21.527 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.528 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-02-10T08:35:21.528 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "f9043fee-a3ed-4e16-921d-bb86756d0c48", 2024-02-10T08:35:21.528 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-02-10T08:35:21.528 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-02-10T08:35:21.528 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-02-10T08:35:21.528 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-02-10T08:35:21.528 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-02-10T08:35:21.528 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-02-10T08:35:21.528 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 8, 2024-02-10T08:35:21.528 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 364, 2024-02-10T08:35:21.528 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-02-10T08:35:21.528 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-02-10T08:35:21.528 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-02-10T08:35:21.529 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:35:21.529 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.529 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:35:21.529 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6801", 2024-02-10T08:35:21.529 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 276034406 2024-02-10T08:35:21.529 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:35:21.529 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:35:21.529 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.529 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-02-10T08:35:21.529 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:35:21.529 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.529 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:35:21.529 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6802", 2024-02-10T08:35:21.530 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 276034406 2024-02-10T08:35:21.530 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:35:21.530 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:35:21.530 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.530 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-02-10T08:35:21.530 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:35:21.530 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.530 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:35:21.530 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6804", 2024-02-10T08:35:21.530 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 276034406 2024-02-10T08:35:21.530 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:35:21.530 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:35:21.530 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.530 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-02-10T08:35:21.530 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:35:21.531 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.531 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:35:21.531 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6803", 2024-02-10T08:35:21.531 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 276034406 2024-02-10T08:35:21.531 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:35:21.531 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:35:21.531 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.531 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6801/276034406", 2024-02-10T08:35:21.531 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6802/276034406", 2024-02-10T08:35:21.531 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6804/276034406", 2024-02-10T08:35:21.531 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6803/276034406", 2024-02-10T08:35:21.531 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-02-10T08:35:21.531 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-02-10T08:35:21.531 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-02-10T08:35:21.531 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:35:21.532 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.532 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.532 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-02-10T08:35:21.532 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "ff958272-ce6b-4162-959a-6da9729e537b", 2024-02-10T08:35:21.532 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-02-10T08:35:21.532 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-02-10T08:35:21.532 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-02-10T08:35:21.532 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-02-10T08:35:21.532 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-02-10T08:35:21.532 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-02-10T08:35:21.532 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-02-10T08:35:21.532 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 339, 2024-02-10T08:35:21.532 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-02-10T08:35:21.533 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-02-10T08:35:21.533 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-02-10T08:35:21.533 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:35:21.533 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.533 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:35:21.533 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6805", 2024-02-10T08:35:21.533 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1941014296 2024-02-10T08:35:21.533 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:35:21.533 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:35:21.533 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.533 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-02-10T08:35:21.533 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:35:21.533 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.533 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:35:21.533 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6806", 2024-02-10T08:35:21.534 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1941014296 2024-02-10T08:35:21.534 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:35:21.534 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:35:21.534 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.534 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-02-10T08:35:21.534 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:35:21.534 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.534 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:35:21.534 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6808", 2024-02-10T08:35:21.534 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1941014296 2024-02-10T08:35:21.534 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:35:21.534 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:35:21.534 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.534 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-02-10T08:35:21.534 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:35:21.535 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.535 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:35:21.535 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6807", 2024-02-10T08:35:21.535 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1941014296 2024-02-10T08:35:21.535 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:35:21.535 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:35:21.535 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.535 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6805/1941014296", 2024-02-10T08:35:21.535 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6806/1941014296", 2024-02-10T08:35:21.535 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6808/1941014296", 2024-02-10T08:35:21.535 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6807/1941014296", 2024-02-10T08:35:21.535 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-02-10T08:35:21.535 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-02-10T08:35:21.535 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-02-10T08:35:21.536 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:35:21.536 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.536 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.536 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-02-10T08:35:21.536 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "29bb47e2-5c81-4ae8-bb9f-d1b02ea01d3f", 2024-02-10T08:35:21.536 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-02-10T08:35:21.536 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-02-10T08:35:21.536 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-02-10T08:35:21.536 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-02-10T08:35:21.536 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-02-10T08:35:21.536 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-02-10T08:35:21.536 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 18, 2024-02-10T08:35:21.536 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 339, 2024-02-10T08:35:21.536 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-02-10T08:35:21.536 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-02-10T08:35:21.537 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-02-10T08:35:21.537 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:35:21.537 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.537 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:35:21.537 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6809", 2024-02-10T08:35:21.537 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3122474567 2024-02-10T08:35:21.537 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:35:21.537 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:35:21.537 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.537 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-02-10T08:35:21.537 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:35:21.537 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.537 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:35:21.537 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6810", 2024-02-10T08:35:21.537 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3122474567 2024-02-10T08:35:21.538 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:35:21.538 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:35:21.538 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.538 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-02-10T08:35:21.538 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:35:21.538 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.538 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:35:21.538 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6812", 2024-02-10T08:35:21.538 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3122474567 2024-02-10T08:35:21.538 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:35:21.538 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:35:21.538 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.538 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-02-10T08:35:21.538 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:35:21.539 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.539 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:35:21.539 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6811", 2024-02-10T08:35:21.539 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3122474567 2024-02-10T08:35:21.539 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:35:21.539 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:35:21.539 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.539 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6809/3122474567", 2024-02-10T08:35:21.539 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6810/3122474567", 2024-02-10T08:35:21.539 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6812/3122474567", 2024-02-10T08:35:21.539 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6811/3122474567", 2024-02-10T08:35:21.539 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-02-10T08:35:21.539 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-02-10T08:35:21.539 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-02-10T08:35:21.539 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:35:21.540 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.540 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.540 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-02-10T08:35:21.540 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "87ad37de-5f49-4e5b-9683-3bb9c3e33907", 2024-02-10T08:35:21.540 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-02-10T08:35:21.540 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-02-10T08:35:21.540 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-02-10T08:35:21.540 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 0, 2024-02-10T08:35:21.540 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-02-10T08:35:21.540 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-02-10T08:35:21.540 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 25, 2024-02-10T08:35:21.540 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 175, 2024-02-10T08:35:21.540 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-02-10T08:35:21.541 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-02-10T08:35:21.541 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-02-10T08:35:21.541 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:35:21.541 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.541 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:35:21.541 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6813", 2024-02-10T08:35:21.541 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3484706437 2024-02-10T08:35:21.541 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:35:21.541 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:35:21.541 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.541 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-02-10T08:35:21.541 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:35:21.541 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.541 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:35:21.541 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6814", 2024-02-10T08:35:21.542 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3484706437 2024-02-10T08:35:21.542 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:35:21.542 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:35:21.542 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.542 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-02-10T08:35:21.542 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:35:21.542 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.542 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:35:21.542 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6816", 2024-02-10T08:35:21.542 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3484706437 2024-02-10T08:35:21.542 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:35:21.542 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:35:21.542 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.542 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-02-10T08:35:21.543 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:35:21.543 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.543 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:35:21.543 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6815", 2024-02-10T08:35:21.543 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3484706437 2024-02-10T08:35:21.543 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:35:21.543 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:35:21.543 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.543 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6813/3484706437", 2024-02-10T08:35:21.543 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6814/3484706437", 2024-02-10T08:35:21.543 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6816/3484706437", 2024-02-10T08:35:21.543 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6815/3484706437", 2024-02-10T08:35:21.543 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-02-10T08:35:21.544 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-02-10T08:35:21.545 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-02-10T08:35:21.545 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:35:21.545 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.545 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.545 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-02-10T08:35:21.545 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "f5708f20-f98d-4d12-b8ae-71a5049a14cc", 2024-02-10T08:35:21.545 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-02-10T08:35:21.545 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-02-10T08:35:21.545 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-02-10T08:35:21.545 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-02-10T08:35:21.545 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 30, 2024-02-10T08:35:21.546 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 87, 2024-02-10T08:35:21.546 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 110, 2024-02-10T08:35:21.546 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 364, 2024-02-10T08:35:21.546 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 88, 2024-02-10T08:35:21.546 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-02-10T08:35:21.546 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-02-10T08:35:21.546 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:35:21.546 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.546 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:35:21.546 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6800", 2024-02-10T08:35:21.546 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3888817642 2024-02-10T08:35:21.546 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:35:21.546 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:35:21.546 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.547 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-02-10T08:35:21.547 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:35:21.547 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.547 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:35:21.547 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6801", 2024-02-10T08:35:21.547 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3888817642 2024-02-10T08:35:21.547 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:35:21.547 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:35:21.547 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.547 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-02-10T08:35:21.547 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:35:21.547 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.547 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:35:21.547 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6803", 2024-02-10T08:35:21.548 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3888817642 2024-02-10T08:35:21.548 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:35:21.548 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:35:21.548 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.548 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-02-10T08:35:21.548 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:35:21.548 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.548 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:35:21.548 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6802", 2024-02-10T08:35:21.548 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3888817642 2024-02-10T08:35:21.548 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:35:21.548 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:35:21.548 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.548 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.71:6800/3888817642", 2024-02-10T08:35:21.549 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.71:6801/3888817642", 2024-02-10T08:35:21.549 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.71:6803/3888817642", 2024-02-10T08:35:21.549 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.71:6802/3888817642", 2024-02-10T08:35:21.549 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-02-10T08:35:21.549 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-02-10T08:35:21.549 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-02-10T08:35:21.549 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:35:21.549 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.549 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.549 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-02-10T08:35:21.549 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "e36a71dd-5088-4bff-965e-7dc8708ef7e3", 2024-02-10T08:35:21.549 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-02-10T08:35:21.549 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-02-10T08:35:21.550 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-02-10T08:35:21.550 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-02-10T08:35:21.550 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-02-10T08:35:21.550 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-02-10T08:35:21.550 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 37, 2024-02-10T08:35:21.550 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 364, 2024-02-10T08:35:21.550 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-02-10T08:35:21.550 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-02-10T08:35:21.550 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-02-10T08:35:21.550 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:35:21.550 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.551 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:35:21.551 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6804", 2024-02-10T08:35:21.551 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1932648316 2024-02-10T08:35:21.551 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:35:21.551 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:35:21.551 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.551 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-02-10T08:35:21.551 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:35:21.551 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.551 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:35:21.551 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6805", 2024-02-10T08:35:21.551 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1932648316 2024-02-10T08:35:21.551 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:35:21.551 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:35:21.552 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.552 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-02-10T08:35:21.552 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:35:21.552 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.552 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:35:21.552 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6807", 2024-02-10T08:35:21.552 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1932648316 2024-02-10T08:35:21.552 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:35:21.552 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:35:21.552 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.553 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-02-10T08:35:21.553 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:35:21.553 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.553 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:35:21.553 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6806", 2024-02-10T08:35:21.553 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1932648316 2024-02-10T08:35:21.553 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:35:21.553 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:35:21.553 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.553 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.71:6804/1932648316", 2024-02-10T08:35:21.553 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.71:6805/1932648316", 2024-02-10T08:35:21.553 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.71:6807/1932648316", 2024-02-10T08:35:21.553 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.71:6806/1932648316", 2024-02-10T08:35:21.553 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-02-10T08:35:21.554 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-02-10T08:35:21.554 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-02-10T08:35:21.554 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:35:21.554 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.554 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.554 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-02-10T08:35:21.554 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "210a8790-78b6-4efa-a969-17efb17e9c0b", 2024-02-10T08:35:21.554 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-02-10T08:35:21.554 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-02-10T08:35:21.554 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-02-10T08:35:21.554 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 0.66424560546875, 2024-02-10T08:35:21.555 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-02-10T08:35:21.555 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-02-10T08:35:21.555 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 43, 2024-02-10T08:35:21.555 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 339, 2024-02-10T08:35:21.555 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-02-10T08:35:21.555 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-02-10T08:35:21.555 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-02-10T08:35:21.555 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:35:21.555 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.555 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:35:21.555 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6808", 2024-02-10T08:35:21.555 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3724399458 2024-02-10T08:35:21.555 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:35:21.555 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:35:21.556 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.556 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-02-10T08:35:21.556 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:35:21.556 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.556 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:35:21.556 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6809", 2024-02-10T08:35:21.556 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3724399458 2024-02-10T08:35:21.556 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:35:21.556 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:35:21.556 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.557 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-02-10T08:35:21.557 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:35:21.557 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.557 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:35:21.557 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6811", 2024-02-10T08:35:21.557 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3724399458 2024-02-10T08:35:21.557 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:35:21.557 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:35:21.557 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.557 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-02-10T08:35:21.557 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:35:21.557 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.557 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:35:21.557 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6810", 2024-02-10T08:35:21.558 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3724399458 2024-02-10T08:35:21.558 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:35:21.558 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:35:21.558 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.558 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.71:6808/3724399458", 2024-02-10T08:35:21.558 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.71:6809/3724399458", 2024-02-10T08:35:21.558 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.71:6811/3724399458", 2024-02-10T08:35:21.558 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.71:6810/3724399458", 2024-02-10T08:35:21.558 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-02-10T08:35:21.558 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-02-10T08:35:21.558 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-02-10T08:35:21.559 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:35:21.559 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.559 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.559 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-02-10T08:35:21.559 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "9778a0e9-2ff3-4700-bf2a-675edaba630b", 2024-02-10T08:35:21.559 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-02-10T08:35:21.559 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-02-10T08:35:21.559 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-02-10T08:35:21.559 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-02-10T08:35:21.559 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-02-10T08:35:21.559 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-02-10T08:35:21.560 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 50, 2024-02-10T08:35:21.560 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 339, 2024-02-10T08:35:21.560 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-02-10T08:35:21.560 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-02-10T08:35:21.560 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-02-10T08:35:21.560 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:35:21.560 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.560 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:35:21.560 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6812", 2024-02-10T08:35:21.560 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 163573852 2024-02-10T08:35:21.561 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:35:21.561 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:35:21.561 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.561 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-02-10T08:35:21.561 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:35:21.561 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.561 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:35:21.561 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6813", 2024-02-10T08:35:21.561 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 163573852 2024-02-10T08:35:21.561 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:35:21.562 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:35:21.562 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.562 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-02-10T08:35:21.562 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:35:21.562 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.562 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:35:21.562 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6815", 2024-02-10T08:35:21.562 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 163573852 2024-02-10T08:35:21.562 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:35:21.562 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:35:21.563 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.563 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-02-10T08:35:21.563 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:35:21.563 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.563 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:35:21.563 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6814", 2024-02-10T08:35:21.563 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 163573852 2024-02-10T08:35:21.563 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:35:21.563 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:35:21.563 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.563 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.71:6812/163573852", 2024-02-10T08:35:21.563 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.71:6813/163573852", 2024-02-10T08:35:21.563 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.71:6815/163573852", 2024-02-10T08:35:21.563 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.71:6814/163573852", 2024-02-10T08:35:21.564 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-02-10T08:35:21.564 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-02-10T08:35:21.564 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-02-10T08:35:21.564 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:35:21.564 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:35:21.564 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-02-10T08:35:21.564 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_xinfo": [ 2024-02-10T08:35:21.564 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.564 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-02-10T08:35:21.564 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-02-10T08:35:21.564 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-02-10T08:35:21.564 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-02-10T08:35:21.564 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540138314316775423, 2024-02-10T08:35:21.565 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-02-10T08:35:21.565 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-02-10T08:34:01.148307+0000", 2024-02-10T08:35:21.565 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-02-10T08:35:21.565 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.565 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.565 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-02-10T08:35:21.565 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-02-10T08:35:21.565 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-02-10T08:35:21.565 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-02-10T08:35:21.565 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540138314316775423, 2024-02-10T08:35:21.565 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-02-10T08:35:21.565 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-02-10T08:35:20.212761+0000", 2024-02-10T08:35:21.565 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-02-10T08:35:21.566 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.566 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.566 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-02-10T08:35:21.566 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-02-10T08:35:21.566 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-02-10T08:35:21.566 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-02-10T08:35:21.566 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540138314316775423, 2024-02-10T08:35:21.566 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-02-10T08:35:21.566 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-02-10T08:34:54.764350+0000", 2024-02-10T08:35:21.566 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-02-10T08:35:21.566 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.566 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.566 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-02-10T08:35:21.566 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-02-10T08:35:21.566 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-02-10T08:35:21.567 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-02-10T08:35:21.567 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540138314316775423, 2024-02-10T08:35:21.567 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-02-10T08:35:21.567 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-02-10T08:34:15.717173+0000", 2024-02-10T08:35:21.567 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-02-10T08:35:21.567 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.567 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.567 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-02-10T08:35:21.567 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-02-10T08:35:21.567 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-02-10T08:35:21.567 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-02-10T08:35:21.567 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540138314316775423, 2024-02-10T08:35:21.567 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-02-10T08:35:21.568 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-02-10T08:34:57.682215+0000", 2024-02-10T08:35:21.568 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 87 2024-02-10T08:35:21.568 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.568 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.568 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-02-10T08:35:21.568 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-02-10T08:35:21.568 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-02-10T08:35:21.568 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-02-10T08:35:21.568 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540138314316775423, 2024-02-10T08:35:21.568 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-02-10T08:35:21.568 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-02-10T08:34:41.672295+0000", 2024-02-10T08:35:21.568 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-02-10T08:35:21.568 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.569 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.569 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-02-10T08:35:21.569 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-02-10T08:35:21.569 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-02-10T08:35:21.569 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-02-10T08:35:21.569 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540138314316775423, 2024-02-10T08:35:21.569 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-02-10T08:35:21.569 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-02-10T08:34:28.485233+0000", 2024-02-10T08:35:21.569 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-02-10T08:35:21.569 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.569 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.569 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-02-10T08:35:21.569 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-02-10T08:35:21.569 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-02-10T08:35:21.570 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-02-10T08:35:21.570 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540138314316775423, 2024-02-10T08:35:21.570 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-02-10T08:35:21.570 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-02-10T08:34:30.430861+0000", 2024-02-10T08:35:21.570 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-02-10T08:35:21.570 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:35:21.570 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-02-10T08:35:21.570 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap": [], 2024-02-10T08:35:21.570 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_items": [ 2024-02-10T08:35:21.570 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.570 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "2.5", 2024-02-10T08:35:21.570 INFO:teuthology.orchestra.run.smithi018.stdout: "mappings": [ 2024-02-10T08:35:21.570 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.570 INFO:teuthology.orchestra.run.smithi018.stdout: "from": 7, 2024-02-10T08:35:21.571 INFO:teuthology.orchestra.run.smithi018.stdout: "to": 2 2024-02-10T08:35:21.571 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:35:21.571 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:35:21.571 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.571 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.571 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "2.e", 2024-02-10T08:35:21.571 INFO:teuthology.orchestra.run.smithi018.stdout: "mappings": [ 2024-02-10T08:35:21.571 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.571 INFO:teuthology.orchestra.run.smithi018.stdout: "from": 7, 2024-02-10T08:35:21.571 INFO:teuthology.orchestra.run.smithi018.stdout: "to": 4 2024-02-10T08:35:21.571 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:35:21.571 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:35:21.571 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.571 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.571 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "4.7", 2024-02-10T08:35:21.572 INFO:teuthology.orchestra.run.smithi018.stdout: "mappings": [ 2024-02-10T08:35:21.572 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.572 INFO:teuthology.orchestra.run.smithi018.stdout: "from": 1, 2024-02-10T08:35:21.572 INFO:teuthology.orchestra.run.smithi018.stdout: "to": 7 2024-02-10T08:35:21.572 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:35:21.572 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:35:21.572 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.572 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.572 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "4.d", 2024-02-10T08:35:21.572 INFO:teuthology.orchestra.run.smithi018.stdout: "mappings": [ 2024-02-10T08:35:21.572 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.572 INFO:teuthology.orchestra.run.smithi018.stdout: "from": 1, 2024-02-10T08:35:21.572 INFO:teuthology.orchestra.run.smithi018.stdout: "to": 5 2024-02-10T08:35:21.572 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:35:21.573 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:35:21.573 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.573 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.573 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "4.f", 2024-02-10T08:35:21.573 INFO:teuthology.orchestra.run.smithi018.stdout: "mappings": [ 2024-02-10T08:35:21.573 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.573 INFO:teuthology.orchestra.run.smithi018.stdout: "from": 1, 2024-02-10T08:35:21.573 INFO:teuthology.orchestra.run.smithi018.stdout: "to": 2 2024-02-10T08:35:21.573 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:35:21.573 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:35:21.573 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.573 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.573 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "4.12", 2024-02-10T08:35:21.573 INFO:teuthology.orchestra.run.smithi018.stdout: "mappings": [ 2024-02-10T08:35:21.574 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.574 INFO:teuthology.orchestra.run.smithi018.stdout: "from": 1, 2024-02-10T08:35:21.574 INFO:teuthology.orchestra.run.smithi018.stdout: "to": 0 2024-02-10T08:35:21.574 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:35:21.574 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:35:21.574 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.574 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.574 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "4.13", 2024-02-10T08:35:21.574 INFO:teuthology.orchestra.run.smithi018.stdout: "mappings": [ 2024-02-10T08:35:21.574 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.574 INFO:teuthology.orchestra.run.smithi018.stdout: "from": 1, 2024-02-10T08:35:21.574 INFO:teuthology.orchestra.run.smithi018.stdout: "to": 2 2024-02-10T08:35:21.574 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:35:21.574 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:35:21.574 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.575 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.575 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "5.1b", 2024-02-10T08:35:21.575 INFO:teuthology.orchestra.run.smithi018.stdout: "mappings": [ 2024-02-10T08:35:21.575 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.575 INFO:teuthology.orchestra.run.smithi018.stdout: "from": 0, 2024-02-10T08:35:21.575 INFO:teuthology.orchestra.run.smithi018.stdout: "to": 6 2024-02-10T08:35:21.575 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:35:21.575 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:35:21.575 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.575 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.575 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "6.0", 2024-02-10T08:35:21.575 INFO:teuthology.orchestra.run.smithi018.stdout: "mappings": [ 2024-02-10T08:35:21.575 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.575 INFO:teuthology.orchestra.run.smithi018.stdout: "from": 2, 2024-02-10T08:35:21.575 INFO:teuthology.orchestra.run.smithi018.stdout: "to": 1 2024-02-10T08:35:21.576 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:35:21.576 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:35:21.576 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.576 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.576 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "6.7", 2024-02-10T08:35:21.576 INFO:teuthology.orchestra.run.smithi018.stdout: "mappings": [ 2024-02-10T08:35:21.576 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.576 INFO:teuthology.orchestra.run.smithi018.stdout: "from": 5, 2024-02-10T08:35:21.576 INFO:teuthology.orchestra.run.smithi018.stdout: "to": 0 2024-02-10T08:35:21.576 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:35:21.576 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:35:21.576 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.576 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.576 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "6.8", 2024-02-10T08:35:21.576 INFO:teuthology.orchestra.run.smithi018.stdout: "mappings": [ 2024-02-10T08:35:21.577 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.577 INFO:teuthology.orchestra.run.smithi018.stdout: "from": 2, 2024-02-10T08:35:21.577 INFO:teuthology.orchestra.run.smithi018.stdout: "to": 4 2024-02-10T08:35:21.577 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:35:21.577 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:35:21.577 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.577 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.577 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "6.f", 2024-02-10T08:35:21.577 INFO:teuthology.orchestra.run.smithi018.stdout: "mappings": [ 2024-02-10T08:35:21.577 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.577 INFO:teuthology.orchestra.run.smithi018.stdout: "from": 2, 2024-02-10T08:35:21.577 INFO:teuthology.orchestra.run.smithi018.stdout: "to": 0 2024-02-10T08:35:21.577 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:35:21.577 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:35:21.578 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.578 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.578 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "6.14", 2024-02-10T08:35:21.578 INFO:teuthology.orchestra.run.smithi018.stdout: "mappings": [ 2024-02-10T08:35:21.578 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.578 INFO:teuthology.orchestra.run.smithi018.stdout: "from": 2, 2024-02-10T08:35:21.578 INFO:teuthology.orchestra.run.smithi018.stdout: "to": 0 2024-02-10T08:35:21.578 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.578 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.578 INFO:teuthology.orchestra.run.smithi018.stdout: "from": 7, 2024-02-10T08:35:21.578 INFO:teuthology.orchestra.run.smithi018.stdout: "to": 5 2024-02-10T08:35:21.578 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:35:21.578 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:35:21.578 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.579 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.579 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "6.23", 2024-02-10T08:35:21.579 INFO:teuthology.orchestra.run.smithi018.stdout: "mappings": [ 2024-02-10T08:35:21.579 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:21.579 INFO:teuthology.orchestra.run.smithi018.stdout: "from": 6, 2024-02-10T08:35:21.579 INFO:teuthology.orchestra.run.smithi018.stdout: "to": 0 2024-02-10T08:35:21.579 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:35:21.579 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:35:21.579 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:35:21.579 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-02-10T08:35:21.579 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_temp": [], 2024-02-10T08:35:21.579 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_temp": [], 2024-02-10T08:35:21.579 INFO:teuthology.orchestra.run.smithi018.stdout: "blocklist": { 2024-02-10T08:35:21.579 INFO:teuthology.orchestra.run.smithi018.stdout: "172.21.15.18:6800/542054629": "2024-02-11T08:17:16.433947+0000", 2024-02-10T08:35:21.579 INFO:teuthology.orchestra.run.smithi018.stdout: "172.21.15.18:0/491217791": "2024-02-11T08:17:16.433947+0000", 2024-02-10T08:35:21.580 INFO:teuthology.orchestra.run.smithi018.stdout: "172.21.15.18:0/781076548": "2024-02-11T08:17:16.433947+0000", 2024-02-10T08:35:21.580 INFO:teuthology.orchestra.run.smithi018.stdout: "172.21.15.18:0/957318754": "2024-02-11T08:17:16.433947+0000", 2024-02-10T08:35:21.580 INFO:teuthology.orchestra.run.smithi018.stdout: "172.21.15.18:0/2662732452": "2024-02-11T08:11:55.105124+0000", 2024-02-10T08:35:21.580 INFO:teuthology.orchestra.run.smithi018.stdout: "172.21.15.18:0/1407788916": "2024-02-11T08:11:55.105124+0000", 2024-02-10T08:35:21.580 INFO:teuthology.orchestra.run.smithi018.stdout: "172.21.15.18:6800/3798687064": "2024-02-11T08:11:55.105124+0000", 2024-02-10T08:35:21.580 INFO:teuthology.orchestra.run.smithi018.stdout: "172.21.15.18:6800/3570839557": "2024-02-11T08:11:31.445897+0000", 2024-02-10T08:35:21.580 INFO:teuthology.orchestra.run.smithi018.stdout: "172.21.15.18:0/541168116": "2024-02-11T08:11:31.445897+0000", 2024-02-10T08:35:21.580 INFO:teuthology.orchestra.run.smithi018.stdout: "172.21.15.18:0/806236095": "2024-02-11T08:11:31.445897+0000" 2024-02-10T08:35:21.580 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.580 INFO:teuthology.orchestra.run.smithi018.stdout: "range_blocklist": {}, 2024-02-10T08:35:21.580 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profiles": { 2024-02-10T08:35:21.580 INFO:teuthology.orchestra.run.smithi018.stdout: "default": { 2024-02-10T08:35:21.580 INFO:teuthology.orchestra.run.smithi018.stdout: "crush-failure-domain": "osd", 2024-02-10T08:35:21.580 INFO:teuthology.orchestra.run.smithi018.stdout: "k": "2", 2024-02-10T08:35:21.581 INFO:teuthology.orchestra.run.smithi018.stdout: "m": "1", 2024-02-10T08:35:21.581 INFO:teuthology.orchestra.run.smithi018.stdout: "plugin": "jerasure", 2024-02-10T08:35:21.581 INFO:teuthology.orchestra.run.smithi018.stdout: "ruleset-failure-domain": "osd", 2024-02-10T08:35:21.581 INFO:teuthology.orchestra.run.smithi018.stdout: "technique": "reed_sol_van" 2024-02-10T08:35:21.581 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:35:21.581 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:21.581 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps_queue": [], 2024-02-10T08:35:21.581 INFO:teuthology.orchestra.run.smithi018.stdout: "new_removed_snaps": [], 2024-02-10T08:35:21.581 INFO:teuthology.orchestra.run.smithi018.stdout: "new_purged_snaps": [], 2024-02-10T08:35:21.581 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_node_flags": {}, 2024-02-10T08:35:21.581 INFO:teuthology.orchestra.run.smithi018.stdout: "device_class_flags": {}, 2024-02-10T08:35:21.581 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode": { 2024-02-10T08:35:21.581 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_enabled": false, 2024-02-10T08:35:21.581 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_bucket_count": 0, 2024-02-10T08:35:21.581 INFO:teuthology.orchestra.run.smithi018.stdout: "degraded_stretch_mode": 0, 2024-02-10T08:35:21.582 INFO:teuthology.orchestra.run.smithi018.stdout: "recovering_stretch_mode": 0, 2024-02-10T08:35:21.582 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_bucket": 0 2024-02-10T08:35:21.582 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:35:21.582 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-02-10T08:35:21.600 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:35:21.649 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:35:21.693 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:35:21.720 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:35:21.750 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:35:21.775 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:35:21.853 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:35:21.872 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd set noscrub 2024-02-10T08:35:21.886 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:35:21.892 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-10T08:35:21.892 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-10T08:35:21.892 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-10T08:35:21.892 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-10T08:35:21.892 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-10T08:35:21.892 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-10T08:35:21.893 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-10T08:35:21.893 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-10T08:35:22.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:19.802793+0000 osd.6 (osd.6) 217 : cluster [DBG] 2.7 scrub starts 2024-02-10T08:35:22.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:19.808717+0000 osd.6 (osd.6) 218 : cluster [DBG] 2.7 scrub ok 2024-02-10T08:35:22.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:20.212716+0000 osd.1 (osd.1) 235 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:35:22.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:20.212758+0000 osd.1 (osd.1) 236 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:35:22.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:20.804960+0000 mon.a (mon.0) 1613 : cluster [DBG] osdmap e380: 8 total, 8 up, 8 in 2024-02-10T08:35:22.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:21.028499+0000 mgr.y (mgr.14505) 698 : cluster [DBG] pgmap v861: 168 pgs: 168 active+clean; 3.6 GiB data, 16 GiB used, 700 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 957 op/s 2024-02-10T08:35:22.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:35:21.479226+0000 mon.b (mon.1) 82 : audit [DBG] from='client.? 172.21.15.18:0/2147977760' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2024-02-10T08:35:22.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:35:21.523163+0000 mon.b (mon.1) 83 : audit [DBG] from='client.? 172.21.15.18:0/716990571' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:35:22.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:19.802793+0000 osd.6 (osd.6) 217 : cluster [DBG] 2.7 scrub starts 2024-02-10T08:35:22.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:19.808717+0000 osd.6 (osd.6) 218 : cluster [DBG] 2.7 scrub ok 2024-02-10T08:35:22.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:20.212716+0000 osd.1 (osd.1) 235 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:35:22.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:20.212758+0000 osd.1 (osd.1) 236 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:35:22.158 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:20.804960+0000 mon.a (mon.0) 1613 : cluster [DBG] osdmap e380: 8 total, 8 up, 8 in 2024-02-10T08:35:22.158 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:21.028499+0000 mgr.y (mgr.14505) 698 : cluster [DBG] pgmap v861: 168 pgs: 168 active+clean; 3.6 GiB data, 16 GiB used, 700 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 957 op/s 2024-02-10T08:35:22.158 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:35:21.479226+0000 mon.b (mon.1) 82 : audit [DBG] from='client.? 172.21.15.18:0/2147977760' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2024-02-10T08:35:22.158 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:35:21.523163+0000 mon.b (mon.1) 83 : audit [DBG] from='client.? 172.21.15.18:0/716990571' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:35:22.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:19.802793+0000 osd.6 (osd.6) 217 : cluster [DBG] 2.7 scrub starts 2024-02-10T08:35:22.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:19.808717+0000 osd.6 (osd.6) 218 : cluster [DBG] 2.7 scrub ok 2024-02-10T08:35:22.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:20.212716+0000 osd.1 (osd.1) 235 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:35:22.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:20.212758+0000 osd.1 (osd.1) 236 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:35:22.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:20.804960+0000 mon.a (mon.0) 1613 : cluster [DBG] osdmap e380: 8 total, 8 up, 8 in 2024-02-10T08:35:22.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:21.028499+0000 mgr.y (mgr.14505) 698 : cluster [DBG] pgmap v861: 168 pgs: 168 active+clean; 3.6 GiB data, 16 GiB used, 700 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 957 op/s 2024-02-10T08:35:22.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:35:21.479226+0000 mon.b (mon.1) 82 : audit [DBG] from='client.? 172.21.15.18:0/2147977760' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2024-02-10T08:35:22.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:35:21.523163+0000 mon.b (mon.1) 83 : audit [DBG] from='client.? 172.21.15.18:0/716990571' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:35:23.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:21.549213+0000 osd.1 (osd.1) 237 : cluster [DBG] 10.2 scrub ok 2024-02-10T08:35:23.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:21.843901+0000 osd.2 (osd.2) 197 : cluster [DBG] 6.2d scrub starts 2024-02-10T08:35:23.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:21.921578+0000 osd.2 (osd.2) 198 : cluster [DBG] 6.2d scrub ok 2024-02-10T08:35:23.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:21.549213+0000 osd.1 (osd.1) 237 : cluster [DBG] 10.2 scrub ok 2024-02-10T08:35:23.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:21.843901+0000 osd.2 (osd.2) 197 : cluster [DBG] 6.2d scrub starts 2024-02-10T08:35:23.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:21.921578+0000 osd.2 (osd.2) 198 : cluster [DBG] 6.2d scrub ok 2024-02-10T08:35:23.237 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:35:23.240 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:23.241 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:35:23.241 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:21.549213+0000 osd.1 (osd.1) 237 : cluster [DBG] 10.2 scrub ok 2024-02-10T08:35:23.241 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:21.843901+0000 osd.2 (osd.2) 197 : cluster [DBG] 6.2d scrub starts 2024-02-10T08:35:23.241 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:21.921578+0000 osd.2 (osd.2) 198 : cluster [DBG] 6.2d scrub ok 2024-02-10T08:35:23.342 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:35:23.392 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:23.599 INFO:tasks.thrashosds.thrasher:j is {'epoch': 380, 'fsid': 'd46257c8-c7eb-11ee-95b8-87774f69a715', 'created': '2024-02-10T08:10:57.425061+0000', 'modified': '2024-02-10T08:35:20.717196+0000', 'last_up_change': '2024-02-10T08:20:45.372678+0000', 'last_in_change': '2024-02-10T08:28:01.734588+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 19, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 10, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'pacific', 'pools': [{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-02-10T08:14:44.034966+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': '.rgw.root', 'create_time': '2024-02-10T08:16:51.334631+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 3, 'pool_name': 'iscsi', 'create_time': '2024-02-10T08:16:51.762963+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 3, 'pg_placement_num': 3, 'pg_placement_num_target': 3, 'pg_num_target': 3, 'pg_num_pending': 3, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '375', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 4, 'pool_name': 'default.rgw.log', 'create_time': '2024-02-10T08:16:53.258098+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '205', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 5, 'pool_name': 'default.rgw.control', 'create_time': '2024-02-10T08:16:55.289300+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 6, 'pool_name': 'default.rgw.meta', 'create_time': '2024-02-10T08:16:57.354868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 52, 'pg_placement_num': 52, 'pg_placement_num_target': 52, 'pg_num_target': 52, 'pg_num_pending': 52, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '289', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '287', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4}, 'application_metadata': {'rgw': {}}}, {'pool': 10, 'pool_name': 'unique_pool_3', 'create_time': '2024-02-10T08:32:29.906015+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '341', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}], 'osds': [{'osd': 0, 'uuid': 'f9043fee-a3ed-4e16-921d-bb86756d0c48', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 364, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6801', 'nonce': 276034406}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6802', 'nonce': 276034406}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6804', 'nonce': 276034406}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6803', 'nonce': 276034406}]}, 'public_addr': '172.21.15.18:6801/276034406', 'cluster_addr': '172.21.15.18:6802/276034406', 'heartbeat_back_addr': '172.21.15.18:6804/276034406', 'heartbeat_front_addr': '172.21.15.18:6803/276034406', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'ff958272-ce6b-4162-959a-6da9729e537b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 339, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6805', 'nonce': 1941014296}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6806', 'nonce': 1941014296}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6808', 'nonce': 1941014296}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6807', 'nonce': 1941014296}]}, 'public_addr': '172.21.15.18:6805/1941014296', 'cluster_addr': '172.21.15.18:6806/1941014296', 'heartbeat_back_addr': '172.21.15.18:6808/1941014296', 'heartbeat_front_addr': '172.21.15.18:6807/1941014296', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '29bb47e2-5c81-4ae8-bb9f-d1b02ea01d3f', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 18, 'up_thru': 339, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6809', 'nonce': 3122474567}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6810', 'nonce': 3122474567}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6812', 'nonce': 3122474567}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6811', 'nonce': 3122474567}]}, 'public_addr': '172.21.15.18:6809/3122474567', 'cluster_addr': '172.21.15.18:6810/3122474567', 'heartbeat_back_addr': '172.21.15.18:6812/3122474567', 'heartbeat_front_addr': '172.21.15.18:6811/3122474567', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '87ad37de-5f49-4e5b-9683-3bb9c3e33907', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 25, 'up_thru': 175, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6813', 'nonce': 3484706437}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6814', 'nonce': 3484706437}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6816', 'nonce': 3484706437}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6815', 'nonce': 3484706437}]}, 'public_addr': '172.21.15.18:6813/3484706437', 'cluster_addr': '172.21.15.18:6814/3484706437', 'heartbeat_back_addr': '172.21.15.18:6816/3484706437', 'heartbeat_front_addr': '172.21.15.18:6815/3484706437', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': 'f5708f20-f98d-4d12-b8ae-71a5049a14cc', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 30, 'last_clean_end': 87, 'up_from': 110, 'up_thru': 364, 'down_at': 88, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6800', 'nonce': 3888817642}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6801', 'nonce': 3888817642}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6803', 'nonce': 3888817642}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6802', 'nonce': 3888817642}]}, 'public_addr': '172.21.15.71:6800/3888817642', 'cluster_addr': '172.21.15.71:6801/3888817642', 'heartbeat_back_addr': '172.21.15.71:6803/3888817642', 'heartbeat_front_addr': '172.21.15.71:6802/3888817642', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'e36a71dd-5088-4bff-965e-7dc8708ef7e3', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 37, 'up_thru': 364, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6804', 'nonce': 1932648316}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6805', 'nonce': 1932648316}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6807', 'nonce': 1932648316}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6806', 'nonce': 1932648316}]}, 'public_addr': '172.21.15.71:6804/1932648316', 'cluster_addr': '172.21.15.71:6805/1932648316', 'heartbeat_back_addr': '172.21.15.71:6807/1932648316', 'heartbeat_front_addr': '172.21.15.71:6806/1932648316', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '210a8790-78b6-4efa-a969-17efb17e9c0b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.66424560546875, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 43, 'up_thru': 339, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6808', 'nonce': 3724399458}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6809', 'nonce': 3724399458}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6811', 'nonce': 3724399458}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6810', 'nonce': 3724399458}]}, 'public_addr': '172.21.15.71:6808/3724399458', 'cluster_addr': '172.21.15.71:6809/3724399458', 'heartbeat_back_addr': '172.21.15.71:6811/3724399458', 'heartbeat_front_addr': '172.21.15.71:6810/3724399458', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '9778a0e9-2ff3-4700-bf2a-675edaba630b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 50, 'up_thru': 339, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6812', 'nonce': 163573852}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6813', 'nonce': 163573852}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6815', 'nonce': 163573852}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6814', 'nonce': 163573852}]}, 'public_addr': '172.21.15.71:6812/163573852', 'cluster_addr': '172.21.15.71:6813/163573852', 'heartbeat_back_addr': '172.21.15.71:6815/163573852', 'heartbeat_front_addr': '172.21.15.71:6814/163573852', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-10T08:34:01.148307+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-10T08:35:20.212761+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-10T08:34:54.764350+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-10T08:34:15.717173+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-10T08:34:57.682215+0000', 'dead_epoch': 87}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-10T08:34:41.672295+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-10T08:34:28.485233+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-10T08:34:30.430861+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [{'pgid': '2.5', 'mappings': [{'from': 7, 'to': 2}]}, {'pgid': '2.e', 'mappings': [{'from': 7, 'to': 4}]}, {'pgid': '4.7', 'mappings': [{'from': 1, 'to': 7}]}, {'pgid': '4.d', 'mappings': [{'from': 1, 'to': 5}]}, {'pgid': '4.f', 'mappings': [{'from': 1, 'to': 2}]}, {'pgid': '4.12', 'mappings': [{'from': 1, 'to': 0}]}, {'pgid': '4.13', 'mappings': [{'from': 1, 'to': 2}]}, {'pgid': '5.1b', 'mappings': [{'from': 0, 'to': 6}]}, {'pgid': '6.0', 'mappings': [{'from': 2, 'to': 1}]}, {'pgid': '6.7', 'mappings': [{'from': 5, 'to': 0}]}, {'pgid': '6.8', 'mappings': [{'from': 2, 'to': 4}]}, {'pgid': '6.f', 'mappings': [{'from': 2, 'to': 0}]}, {'pgid': '6.14', 'mappings': [{'from': 2, 'to': 0}, {'from': 7, 'to': 5}]}, {'pgid': '6.23', 'mappings': [{'from': 6, 'to': 0}]}], 'pg_temp': [], 'primary_temp': [], 'blocklist': {'172.21.15.18:6800/542054629': '2024-02-11T08:17:16.433947+0000', '172.21.15.18:0/491217791': '2024-02-11T08:17:16.433947+0000', '172.21.15.18:0/781076548': '2024-02-11T08:17:16.433947+0000', '172.21.15.18:0/957318754': '2024-02-11T08:17:16.433947+0000', '172.21.15.18:0/2662732452': '2024-02-11T08:11:55.105124+0000', '172.21.15.18:0/1407788916': '2024-02-11T08:11:55.105124+0000', '172.21.15.18:6800/3798687064': '2024-02-11T08:11:55.105124+0000', '172.21.15.18:6800/3570839557': '2024-02-11T08:11:31.445897+0000', '172.21.15.18:0/541168116': '2024-02-11T08:11:31.445897+0000', '172.21.15.18:0/806236095': '2024-02-11T08:11:31.445897+0000'}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'ruleset-failure-domain': 'osd', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-02-10T08:35:23.600 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph pg dump --format=json 2024-02-10T08:35:23.601 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:35:23.609 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:23.610 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:35:23.711 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:35:23.987 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:24.381 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:23.031707+0000 mgr.y (mgr.14505) 699 : cluster [DBG] pgmap v862: 168 pgs: 168 active+clean; 3.4 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.15k op/s 2024-02-10T08:35:24.381 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:23.075821+0000 osd.5 (osd.5) 233 : cluster [DBG] 6.d scrub starts 2024-02-10T08:35:24.381 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:23.093365+0000 osd.5 (osd.5) 234 : cluster [DBG] 6.d scrub ok 2024-02-10T08:35:24.381 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:23.116729+0000 osd.4 (osd.4) 140 : cluster [DBG] 4.c scrub starts 2024-02-10T08:35:24.381 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:23.121155+0000 osd.4 (osd.4) 141 : cluster [DBG] 4.c scrub ok 2024-02-10T08:35:24.390 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:23.031707+0000 mgr.y (mgr.14505) 699 : cluster [DBG] pgmap v862: 168 pgs: 168 active+clean; 3.4 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.15k op/s 2024-02-10T08:35:24.390 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:23.075821+0000 osd.5 (osd.5) 233 : cluster [DBG] 6.d scrub starts 2024-02-10T08:35:24.390 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:23.093365+0000 osd.5 (osd.5) 234 : cluster [DBG] 6.d scrub ok 2024-02-10T08:35:24.390 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:23.116729+0000 osd.4 (osd.4) 140 : cluster [DBG] 4.c scrub starts 2024-02-10T08:35:24.390 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:23.121155+0000 osd.4 (osd.4) 141 : cluster [DBG] 4.c scrub ok 2024-02-10T08:35:24.394 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:23.031707+0000 mgr.y (mgr.14505) 699 : cluster [DBG] pgmap v862: 168 pgs: 168 active+clean; 3.4 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.15k op/s 2024-02-10T08:35:24.394 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:23.075821+0000 osd.5 (osd.5) 233 : cluster [DBG] 6.d scrub starts 2024-02-10T08:35:24.395 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:23.093365+0000 osd.5 (osd.5) 234 : cluster [DBG] 6.d scrub ok 2024-02-10T08:35:24.395 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:23.116729+0000 osd.4 (osd.4) 140 : cluster [DBG] 4.c scrub starts 2024-02-10T08:35:24.395 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:23.121155+0000 osd.4 (osd.4) 141 : cluster [DBG] 4.c scrub ok 2024-02-10T08:35:24.483 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:35:24.519 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:35:24.532 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:35:24.569 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:24.569 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:35:24.670 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:35:24.731 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:24.772 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:35:24.775 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:24.776 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:35:24.877 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:35:24.927 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:25.040 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:23.598928+0000 osd.3 (osd.3) 111 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:35:25.040 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:23.598990+0000 osd.3 (osd.3) 112 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:35:25.040 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:23.949365+0000 mon.a (mon.0) 1614 : cluster [DBG] osdmap e381: 8 total, 8 up, 8 in 2024-02-10T08:35:25.040 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:24.065678+0000 osd.5 (osd.5) 235 : cluster [DBG] 5.15 deep-scrub starts 2024-02-10T08:35:25.040 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:24.069220+0000 osd.5 (osd.5) 236 : cluster [DBG] 5.15 deep-scrub ok 2024-02-10T08:35:25.040 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:23.598928+0000 osd.3 (osd.3) 111 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:35:25.040 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:23.598990+0000 osd.3 (osd.3) 112 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:35:25.040 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:23.949365+0000 mon.a (mon.0) 1614 : cluster [DBG] osdmap e381: 8 total, 8 up, 8 in 2024-02-10T08:35:25.040 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:24.065678+0000 osd.5 (osd.5) 235 : cluster [DBG] 5.15 deep-scrub starts 2024-02-10T08:35:25.041 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:24.069220+0000 osd.5 (osd.5) 236 : cluster [DBG] 5.15 deep-scrub ok 2024-02-10T08:35:25.287 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:35:25.290 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:25.290 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:35:25.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:23.598928+0000 osd.3 (osd.3) 111 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:35:25.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:23.598990+0000 osd.3 (osd.3) 112 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:35:25.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:23.949365+0000 mon.a (mon.0) 1614 : cluster [DBG] osdmap e381: 8 total, 8 up, 8 in 2024-02-10T08:35:25.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:24.065678+0000 osd.5 (osd.5) 235 : cluster [DBG] 5.15 deep-scrub starts 2024-02-10T08:35:25.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:24.069220+0000 osd.5 (osd.5) 236 : cluster [DBG] 5.15 deep-scrub ok 2024-02-10T08:35:25.391 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:35:26.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:24.125601+0000 osd.4 (osd.4) 142 : cluster [DBG] 10.1 deep-scrub starts 2024-02-10T08:35:26.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:25.032060+0000 mgr.y (mgr.14505) 700 : cluster [DBG] pgmap v864: 168 pgs: 168 active+clean; 3.4 GiB data, 15 GiB used, 701 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.20k op/s 2024-02-10T08:35:26.306 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:26.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:24.125601+0000 osd.4 (osd.4) 142 : cluster [DBG] 10.1 deep-scrub starts 2024-02-10T08:35:26.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:25.032060+0000 mgr.y (mgr.14505) 700 : cluster [DBG] pgmap v864: 168 pgs: 168 active+clean; 3.4 GiB data, 15 GiB used, 701 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.20k op/s 2024-02-10T08:35:26.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:24.125601+0000 osd.4 (osd.4) 142 : cluster [DBG] 10.1 deep-scrub starts 2024-02-10T08:35:26.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:25.032060+0000 mgr.y (mgr.14505) 700 : cluster [DBG] pgmap v864: 168 pgs: 168 active+clean; 3.4 GiB data, 15 GiB used, 701 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.20k op/s 2024-02-10T08:35:26.420 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-10T08:35:26.790 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:35:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:35:26] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:35:27.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:25.768381+0000 osd.0 (osd.0) 209 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:35:27.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:25.768419+0000 osd.0 (osd.0) 210 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:35:27.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:25.808403+0000 osd.6 (osd.6) 219 : cluster [DBG] 2.14 scrub starts 2024-02-10T08:35:27.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:25.826805+0000 osd.6 (osd.6) 220 : cluster [DBG] 2.14 scrub ok 2024-02-10T08:35:27.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:25.971023+0000 mon.a (mon.0) 1615 : cluster [DBG] osdmap e382: 8 total, 8 up, 8 in 2024-02-10T08:35:27.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:25.768381+0000 osd.0 (osd.0) 209 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:35:27.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:25.768419+0000 osd.0 (osd.0) 210 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:35:27.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:25.808403+0000 osd.6 (osd.6) 219 : cluster [DBG] 2.14 scrub starts 2024-02-10T08:35:27.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:25.826805+0000 osd.6 (osd.6) 220 : cluster [DBG] 2.14 scrub ok 2024-02-10T08:35:27.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:25.971023+0000 mon.a (mon.0) 1615 : cluster [DBG] osdmap e382: 8 total, 8 up, 8 in 2024-02-10T08:35:27.405 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:35:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:35:27] "GET /metrics HTTP/1.1" 200 176440 "" "Prometheus/2.33.4" 2024-02-10T08:35:27.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:25.768381+0000 osd.0 (osd.0) 209 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:35:27.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:25.768419+0000 osd.0 (osd.0) 210 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:35:27.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:25.808403+0000 osd.6 (osd.6) 219 : cluster [DBG] 2.14 scrub starts 2024-02-10T08:35:27.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:25.826805+0000 osd.6 (osd.6) 220 : cluster [DBG] 2.14 scrub ok 2024-02-10T08:35:27.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:25.971023+0000 mon.a (mon.0) 1615 : cluster [DBG] osdmap e382: 8 total, 8 up, 8 in 2024-02-10T08:35:27.717 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:35:27.720 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:27.721 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:35:27.822 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:35:27.893 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:28.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:26.768980+0000 osd.6 (osd.6) 221 : cluster [DBG] 4.1f scrub starts 2024-02-10T08:35:28.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:26.779871+0000 osd.6 (osd.6) 222 : cluster [DBG] 4.1f scrub ok 2024-02-10T08:35:28.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:27.032498+0000 mgr.y (mgr.14505) 701 : cluster [DBG] pgmap v866: 168 pgs: 1 active+clean+scrubbing+deep, 167 active+clean; 3.3 GiB data, 15 GiB used, 701 GiB / 715 GiB avail; 822 B/s rd, 0 B/s wr, 828 op/s 2024-02-10T08:35:28.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:26.768980+0000 osd.6 (osd.6) 221 : cluster [DBG] 4.1f scrub starts 2024-02-10T08:35:28.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:26.779871+0000 osd.6 (osd.6) 222 : cluster [DBG] 4.1f scrub ok 2024-02-10T08:35:28.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:27.032498+0000 mgr.y (mgr.14505) 701 : cluster [DBG] pgmap v866: 168 pgs: 1 active+clean+scrubbing+deep, 167 active+clean; 3.3 GiB data, 15 GiB used, 701 GiB / 715 GiB avail; 822 B/s rd, 0 B/s wr, 828 op/s 2024-02-10T08:35:28.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:26.768980+0000 osd.6 (osd.6) 221 : cluster [DBG] 4.1f scrub starts 2024-02-10T08:35:28.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:26.779871+0000 osd.6 (osd.6) 222 : cluster [DBG] 4.1f scrub ok 2024-02-10T08:35:28.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:27.032498+0000 mgr.y (mgr.14505) 701 : cluster [DBG] pgmap v866: 168 pgs: 1 active+clean+scrubbing+deep, 167 active+clean; 3.3 GiB data, 15 GiB used, 701 GiB / 715 GiB avail; 822 B/s rd, 0 B/s wr, 828 op/s 2024-02-10T08:35:28.993 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:35:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:35:29.026 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is set 2024-02-10T08:35:29.286 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:35:28.109562+0000 mon.b (mon.1) 84 : audit [INF] from='client.? 172.21.15.18:0/3754370598' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:35:29.287 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:35:28.110014+0000 mon.a (mon.0) 1616 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:35:29.287 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:35:28.109562+0000 mon.b (mon.1) 84 : audit [INF] from='client.? 172.21.15.18:0/3754370598' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:35:29.287 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:35:28.110014+0000 mon.a (mon.0) 1616 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:35:29.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:35:28.109562+0000 mon.b (mon.1) 84 : audit [INF] from='client.? 172.21.15.18:0/3754370598' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:35:29.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:35:28.110014+0000 mon.a (mon.0) 1616 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:35:30.018 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-02-10T08:35:30.018 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:35:30.194 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:35:30.203 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-02-10T08:35:30.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:35:28.678532+0000 mgr.y (mgr.14505) 702 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:35:30.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:28.986636+0000 mon.a (mon.0) 1617 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:35:30.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:35:28.999127+0000 mon.a (mon.0) 1618 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-10T08:35:30.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:28.999188+0000 mon.a (mon.0) 1619 : cluster [DBG] osdmap e383: 8 total, 8 up, 8 in 2024-02-10T08:35:30.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:29.032925+0000 mgr.y (mgr.14505) 703 : cluster [DBG] pgmap v868: 168 pgs: 1 active+clean+scrubbing+deep, 167 active+clean; 3.1 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 1.01k op/s 2024-02-10T08:35:30.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:35:28.678532+0000 mgr.y (mgr.14505) 702 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:35:30.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:28.986636+0000 mon.a (mon.0) 1617 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:35:30.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:35:28.999127+0000 mon.a (mon.0) 1618 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-10T08:35:30.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:28.999188+0000 mon.a (mon.0) 1619 : cluster [DBG] osdmap e383: 8 total, 8 up, 8 in 2024-02-10T08:35:30.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:29.032925+0000 mgr.y (mgr.14505) 703 : cluster [DBG] pgmap v868: 168 pgs: 1 active+clean+scrubbing+deep, 167 active+clean; 3.1 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 1.01k op/s 2024-02-10T08:35:30.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:35:28.678532+0000 mgr.y (mgr.14505) 702 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:35:30.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:28.986636+0000 mon.a (mon.0) 1617 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:35:30.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:35:28.999127+0000 mon.a (mon.0) 1618 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-10T08:35:30.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:28.999188+0000 mon.a (mon.0) 1619 : cluster [DBG] osdmap e383: 8 total, 8 up, 8 in 2024-02-10T08:35:30.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:29.032925+0000 mgr.y (mgr.14505) 703 : cluster [DBG] pgmap v868: 168 pgs: 1 active+clean+scrubbing+deep, 167 active+clean; 3.1 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 1.01k op/s 2024-02-10T08:35:31.216 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:35:31.216 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:35:31.220 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:35:30.172736+0000 mgr.y (mgr.14505) 704 : audit [DBG] from='client.15588 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-10T08:35:31.221 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:31.221 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:35:31.222 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:35:30.172736+0000 mgr.y (mgr.14505) 704 : audit [DBG] from='client.15588 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-10T08:35:31.321 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:35:30.172736+0000 mgr.y (mgr.14505) 704 : audit [DBG] from='client.15588 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-10T08:35:31.322 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:35:31.528 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.0 dump_ops_in_flight 2024-02-10T08:35:31.544 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:31.586 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:35:31.593 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:31.593 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:35:31.694 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:35:31.740 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:31.775 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:35:31.781 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:31.782 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:35:31.883 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:35:31.936 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:32.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:31.033452+0000 mgr.y (mgr.14505) 705 : cluster [DBG] pgmap v869: 168 pgs: 1 active+clean+scrubbing+deep, 167 active+clean; 3.0 GiB data, 14 GiB used, 702 GiB / 715 GiB avail; 722 B/s rd, 0 B/s wr, 787 op/s 2024-02-10T08:35:32.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:35:31.698374+0000 mon.a (mon.0) 1620 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:35:32.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:31.033452+0000 mgr.y (mgr.14505) 705 : cluster [DBG] pgmap v869: 168 pgs: 1 active+clean+scrubbing+deep, 167 active+clean; 3.0 GiB data, 14 GiB used, 702 GiB / 715 GiB avail; 722 B/s rd, 0 B/s wr, 787 op/s 2024-02-10T08:35:32.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:35:31.698374+0000 mon.a (mon.0) 1620 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:35:32.154 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:35:32.161 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:32.162 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:35:32.262 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:35:32.301 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:31.033452+0000 mgr.y (mgr.14505) 705 : cluster [DBG] pgmap v869: 168 pgs: 1 active+clean+scrubbing+deep, 167 active+clean; 3.0 GiB data, 14 GiB used, 702 GiB / 715 GiB avail; 722 B/s rd, 0 B/s wr, 787 op/s 2024-02-10T08:35:32.302 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:35:31.698374+0000 mon.a (mon.0) 1620 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:35:32.302 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:32.339 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:35:32.343 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:32.343 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:35:32.444 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:35:32.498 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:32.543 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:35:32.547 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:32.548 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:35:32.648 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:35:32.705 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:32.713 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":868,"stamp":"2024-02-10T08:35:29.032660+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3304330940,"num_objects":50613,"num_object_clones":0,"num_object_copies":151839,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50613,"num_whiteouts":0,"num_read":2221,"num_read_kb":1973,"num_write":197894,"num_write_kb":7923241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":230,"num_bytes_recovered":7872,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79132,"ondisk_log_size":79132,"up":504,"acting":504,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":504,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":14491820,"kb_used_data":9731628,"kb_used_omap":0,"kb_used_meta":4759807,"kb_avail":735469396,"statfs":{"total":767960285184,"available":753120661504,"internally_reserved":0,"allocated":9965187072,"data_stored":9962017583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":972,"internal_metadata":4874042420},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-398655488,"num_objects":-6083,"num_object_clones":0,"num_object_copies":-18249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-6083,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6083,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001502"},"pg_stats":[{"pgid":"6.33","version":"0'0","reported_seq":275,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.956953+0000","last_change":"2024-02-10T08:34:13.373898+0000","last_active":"2024-02-10T08:35:23.956953+0000","last_peered":"2024-02-10T08:35:23.956953+0000","last_clean":"2024-02-10T08:35:23.956953+0000","last_became_active":"2024-02-10T08:30:26.080326+0000","last_became_peered":"2024-02-10T08:30:26.080326+0000","last_unstale":"2024-02-10T08:35:23.956953+0000","last_undegraded":"2024-02-10T08:35:23.956953+0000","last_fullsized":"2024-02-10T08:35:23.956953+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:13.373809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:34:13.373809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2],"acting":[5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":377,"reported_epoch":380,"state":"active+clean","last_fresh":"2024-02-10T08:35:20.810147+0000","last_change":"2024-02-10T08:33:31.389209+0000","last_active":"2024-02-10T08:35:20.810147+0000","last_peered":"2024-02-10T08:35:20.810147+0000","last_clean":"2024-02-10T08:35:20.810147+0000","last_became_active":"2024-02-10T08:30:26.067019+0000","last_became_peered":"2024-02-10T08:30:26.067019+0000","last_unstale":"2024-02-10T08:35:20.810147+0000","last_undegraded":"2024-02-10T08:35:20.810147+0000","last_fullsized":"2024-02-10T08:35:20.810147+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:31.389113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:33:31.389113+0000","last_clean_scrub_stamp":"2024-02-10T08:33:31.389113+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.6","version":"382'12538","reported_seq":12593,"reported_epoch":382,"state":"active+clean","last_fresh":"2024-02-10T08:35:27.776413+0000","last_change":"2024-02-10T08:32:30.821933+0000","last_active":"2024-02-10T08:35:27.776413+0000","last_peered":"2024-02-10T08:35:27.776413+0000","last_clean":"2024-02-10T08:35:27.776413+0000","last_became_active":"2024-02-10T08:32:30.821631+0000","last_became_peered":"2024-02-10T08:32:30.821631+0000","last_unstale":"2024-02-10T08:35:27.776413+0000","last_undegraded":"2024-02-10T08:35:27.776413+0000","last_fullsized":"2024-02-10T08:35:27.776413+0000","mapping_epoch":335,"log_start":"367'7700","ondisk_log_start":"367'7700","created":335,"last_epoch_clean":336,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.947585+0000","log_size":4838,"ondisk_log_size":4838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":207749120,"num_objects":3170,"num_object_clones":0,"num_object_copies":9510,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3170,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12538,"num_write_kb":502656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4],"acting":[5,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"111'10","reported_seq":615,"reported_epoch":382,"state":"active+clean","last_fresh":"2024-02-10T08:35:26.026881+0000","last_change":"2024-02-10T08:34:09.351432+0000","last_active":"2024-02-10T08:35:26.026881+0000","last_peered":"2024-02-10T08:35:26.026881+0000","last_clean":"2024-02-10T08:35:26.026881+0000","last_became_active":"2024-02-10T08:20:46.399193+0000","last_became_peered":"2024-02-10T08:20:46.399193+0000","last_unstale":"2024-02-10T08:35:26.026881+0000","last_undegraded":"2024-02-10T08:35:26.026881+0000","last_fullsized":"2024-02-10T08:35:26.026881+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'10","last_scrub_stamp":"2024-02-10T08:34:09.351338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:34:09.351338+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"225'27","reported_seq":401,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.956301+0000","last_change":"2024-02-10T08:33:23.049805+0000","last_active":"2024-02-10T08:35:23.956301+0000","last_peered":"2024-02-10T08:35:23.956301+0000","last_clean":"2024-02-10T08:35:23.956301+0000","last_became_active":"2024-02-10T08:16:55.204597+0000","last_became_peered":"2024-02-10T08:16:55.204597+0000","last_unstale":"2024-02-10T08:35:23.956301+0000","last_undegraded":"2024-02-10T08:35:23.956301+0000","last_fullsized":"2024-02-10T08:35:23.956301+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'27","last_scrub_stamp":"2024-02-10T08:33:23.049704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:33:23.049704+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":395,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:25.853406+0000","last_change":"2024-02-10T08:35:25.853406+0000","last_active":"2024-02-10T08:35:25.853406+0000","last_peered":"2024-02-10T08:35:25.853406+0000","last_clean":"2024-02-10T08:35:25.853406+0000","last_became_active":"2024-02-10T08:32:20.330612+0000","last_became_peered":"2024-02-10T08:32:20.330612+0000","last_unstale":"2024-02-10T08:35:25.853406+0000","last_undegraded":"2024-02-10T08:35:25.853406+0000","last_fullsized":"2024-02-10T08:35:25.853406+0000","mapping_epoch":331,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":332,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:18.706426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:29:24.554978+0000","last_clean_scrub_stamp":"2024-02-10T08:33:18.706426+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":381,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.956577+0000","last_change":"2024-02-10T08:34:09.307523+0000","last_active":"2024-02-10T08:35:23.956577+0000","last_peered":"2024-02-10T08:35:23.956577+0000","last_clean":"2024-02-10T08:35:23.956577+0000","last_became_active":"2024-02-10T08:30:24.062795+0000","last_became_peered":"2024-02-10T08:30:24.062795+0000","last_unstale":"2024-02-10T08:35:23.956577+0000","last_undegraded":"2024-02-10T08:35:23.956577+0000","last_fullsized":"2024-02-10T08:35:23.956577+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:09.307434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:20.392249+0000","last_clean_scrub_stamp":"2024-02-10T08:34:09.307434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"382'12132","reported_seq":12192,"reported_epoch":382,"state":"active+clean","last_fresh":"2024-02-10T08:35:27.990768+0000","last_change":"2024-02-10T08:34:17.209648+0000","last_active":"2024-02-10T08:35:27.990768+0000","last_peered":"2024-02-10T08:35:27.990768+0000","last_clean":"2024-02-10T08:35:27.990768+0000","last_became_active":"2024-02-10T08:32:30.825592+0000","last_became_peered":"2024-02-10T08:32:30.825592+0000","last_unstale":"2024-02-10T08:35:27.990768+0000","last_undegraded":"2024-02-10T08:35:27.990768+0000","last_fullsized":"2024-02-10T08:35:27.990768+0000","mapping_epoch":335,"log_start":"365'6300","ondisk_log_start":"365'6300","created":335,"last_epoch_clean":336,"parent":"0.0","parent_split_bits":0,"last_scrub":"369'7613","last_scrub_stamp":"2024-02-10T08:34:17.209542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:34:17.209542+0000","log_size":5832,"ondisk_log_size":5832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":198049792,"num_objects":3022,"num_object_clones":0,"num_object_copies":9066,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3022,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12132,"num_write_kb":484928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"225'15","reported_seq":173,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.969292+0000","last_change":"2024-02-10T08:35:10.248379+0000","last_active":"2024-02-10T08:35:23.969292+0000","last_peered":"2024-02-10T08:35:23.969292+0000","last_clean":"2024-02-10T08:35:23.969292+0000","last_became_active":"2024-02-10T08:28:02.770508+0000","last_became_peered":"2024-02-10T08:28:02.770508+0000","last_unstale":"2024-02-10T08:35:23.969292+0000","last_undegraded":"2024-02-10T08:35:23.969292+0000","last_fullsized":"2024-02-10T08:35:23.969292+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'15","last_scrub_stamp":"2024-02-10T08:35:10.248283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:35:10.248283+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":376,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.962227+0000","last_change":"2024-02-10T08:34:27.796767+0000","last_active":"2024-02-10T08:35:23.962227+0000","last_peered":"2024-02-10T08:35:23.962227+0000","last_clean":"2024-02-10T08:35:23.962227+0000","last_became_active":"2024-02-10T08:20:46.407311+0000","last_became_peered":"2024-02-10T08:20:46.407311+0000","last_unstale":"2024-02-10T08:35:23.962227+0000","last_undegraded":"2024-02-10T08:35:23.962227+0000","last_fullsized":"2024-02-10T08:35:23.962227+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:27.796670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:21.523096+0000","last_clean_scrub_stamp":"2024-02-10T08:34:27.796670+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":408,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.963495+0000","last_change":"2024-02-10T08:33:30.565679+0000","last_active":"2024-02-10T08:35:23.963495+0000","last_peered":"2024-02-10T08:35:23.963495+0000","last_clean":"2024-02-10T08:35:23.963495+0000","last_became_active":"2024-02-10T08:31:33.882809+0000","last_became_peered":"2024-02-10T08:31:33.882809+0000","last_unstale":"2024-02-10T08:35:23.963495+0000","last_undegraded":"2024-02-10T08:35:23.963495+0000","last_fullsized":"2024-02-10T08:35:23.963495+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:30.565591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:33:30.565591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"76'2","reported_seq":57,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.961552+0000","last_change":"2024-02-10T08:34:24.132606+0000","last_active":"2024-02-10T08:35:23.961552+0000","last_peered":"2024-02-10T08:35:23.961552+0000","last_clean":"2024-02-10T08:35:23.961552+0000","last_became_active":"2024-02-10T08:32:36.979100+0000","last_became_peered":"2024-02-10T08:32:36.979100+0000","last_unstale":"2024-02-10T08:35:23.961552+0000","last_undegraded":"2024-02-10T08:35:23.961552+0000","last_fullsized":"2024-02-10T08:35:23.961552+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'2","last_scrub_stamp":"2024-02-10T08:34:24.132513+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2024-02-10T08:18:08.680038+0000","last_clean_scrub_stamp":"2024-02-10T08:34:24.132513+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"382'12338","reported_seq":12390,"reported_epoch":382,"state":"active+clean","last_fresh":"2024-02-10T08:35:28.352142+0000","last_change":"2024-02-10T08:32:36.986316+0000","last_active":"2024-02-10T08:35:28.352142+0000","last_peered":"2024-02-10T08:35:28.352142+0000","last_clean":"2024-02-10T08:35:28.352142+0000","last_became_active":"2024-02-10T08:32:36.985786+0000","last_became_peered":"2024-02-10T08:32:36.985786+0000","last_unstale":"2024-02-10T08:35:28.352142+0000","last_undegraded":"2024-02-10T08:35:28.352142+0000","last_fullsized":"2024-02-10T08:35:28.352142+0000","mapping_epoch":339,"log_start":"369'7800","ondisk_log_start":"369'7800","created":335,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.947585+0000","log_size":4538,"ondisk_log_size":4538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":202244096,"num_objects":3086,"num_object_clones":0,"num_object_copies":9258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3086,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12338,"num_write_kb":493568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"226'35","reported_seq":413,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.949429+0000","last_change":"2024-02-10T08:33:34.284782+0000","last_active":"2024-02-10T08:35:23.949429+0000","last_peered":"2024-02-10T08:35:23.949429+0000","last_clean":"2024-02-10T08:35:23.949429+0000","last_became_active":"2024-02-10T08:16:55.203415+0000","last_became_peered":"2024-02-10T08:16:55.203415+0000","last_unstale":"2024-02-10T08:35:23.949429+0000","last_undegraded":"2024-02-10T08:35:23.949429+0000","last_fullsized":"2024-02-10T08:35:23.949429+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"226'35","last_scrub_stamp":"2024-02-10T08:33:34.284690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:33:34.284690+0000","log_size":35,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":56,"num_read_kb":45,"num_write":36,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":384,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.964003+0000","last_change":"2024-02-10T08:33:33.598098+0000","last_active":"2024-02-10T08:35:23.964003+0000","last_peered":"2024-02-10T08:35:23.964003+0000","last_clean":"2024-02-10T08:35:23.964003+0000","last_became_active":"2024-02-10T08:28:02.781029+0000","last_became_peered":"2024-02-10T08:28:02.781029+0000","last_unstale":"2024-02-10T08:35:23.964003+0000","last_undegraded":"2024-02-10T08:35:23.964003+0000","last_fullsized":"2024-02-10T08:35:23.964003+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:33.597972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:33:33.597972+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":380,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.964382+0000","last_change":"2024-02-10T08:34:24.908075+0000","last_active":"2024-02-10T08:35:23.964382+0000","last_peered":"2024-02-10T08:35:23.964382+0000","last_clean":"2024-02-10T08:35:23.964382+0000","last_became_active":"2024-02-10T08:28:02.779438+0000","last_became_peered":"2024-02-10T08:28:02.779438+0000","last_unstale":"2024-02-10T08:35:23.964382+0000","last_undegraded":"2024-02-10T08:35:23.964382+0000","last_fullsized":"2024-02-10T08:35:23.964382+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:24.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.593849+0000","last_clean_scrub_stamp":"2024-02-10T08:34:24.907958+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":367,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.961754+0000","last_change":"2024-02-10T08:33:19.398482+0000","last_active":"2024-02-10T08:35:23.961754+0000","last_peered":"2024-02-10T08:35:23.961754+0000","last_clean":"2024-02-10T08:35:23.961754+0000","last_became_active":"2024-02-10T08:24:18.645480+0000","last_became_peered":"2024-02-10T08:24:18.645480+0000","last_unstale":"2024-02-10T08:35:23.961754+0000","last_undegraded":"2024-02-10T08:35:23.961754+0000","last_fullsized":"2024-02-10T08:35:23.961754+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:19.398412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:33:19.398412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,3],"acting":[7,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3","version":"382'12387","reported_seq":12447,"reported_epoch":382,"state":"active+clean","last_fresh":"2024-02-10T08:35:28.011797+0000","last_change":"2024-02-10T08:34:37.264784+0000","last_active":"2024-02-10T08:35:28.011797+0000","last_peered":"2024-02-10T08:35:28.011797+0000","last_clean":"2024-02-10T08:35:28.011797+0000","last_became_active":"2024-02-10T08:32:30.825621+0000","last_became_peered":"2024-02-10T08:32:30.825621+0000","last_unstale":"2024-02-10T08:35:28.011797+0000","last_undegraded":"2024-02-10T08:35:28.011797+0000","last_fullsized":"2024-02-10T08:35:28.011797+0000","mapping_epoch":335,"log_start":"365'6600","ondisk_log_start":"365'6600","created":335,"last_epoch_clean":336,"parent":"0.0","parent_split_bits":0,"last_scrub":"372'9223","last_scrub_stamp":"2024-02-10T08:34:37.264686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:34:37.264686+0000","log_size":5787,"ondisk_log_size":5787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":208470016,"num_objects":3181,"num_object_clones":0,"num_object_copies":9543,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3181,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12387,"num_write_kb":498176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"225'31","reported_seq":96,"reported_epoch":380,"state":"active+clean","last_fresh":"2024-02-10T08:35:20.812209+0000","last_change":"2024-02-10T08:32:31.309431+0000","last_active":"2024-02-10T08:35:20.812209+0000","last_peered":"2024-02-10T08:35:20.812209+0000","last_clean":"2024-02-10T08:35:20.812209+0000","last_became_active":"2024-02-10T08:31:46.070488+0000","last_became_peered":"2024-02-10T08:31:46.070488+0000","last_unstale":"2024-02-10T08:35:20.812209+0000","last_undegraded":"2024-02-10T08:35:20.812209+0000","last_fullsized":"2024-02-10T08:35:20.812209+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'31","last_scrub_stamp":"2024-02-10T08:32:31.309364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:32:31.309364+0000","log_size":31,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":48,"num_read_kb":38,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":412,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.962484+0000","last_change":"2024-02-10T08:32:11.282121+0000","last_active":"2024-02-10T08:35:23.962484+0000","last_peered":"2024-02-10T08:35:23.962484+0000","last_clean":"2024-02-10T08:35:23.962484+0000","last_became_active":"2024-02-10T08:20:46.399568+0000","last_became_peered":"2024-02-10T08:20:46.399568+0000","last_unstale":"2024-02-10T08:35:23.962484+0000","last_undegraded":"2024-02-10T08:35:23.962484+0000","last_fullsized":"2024-02-10T08:35:23.962484+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:11.282042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:32:11.282042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":385,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.961819+0000","last_change":"2024-02-10T08:34:19.729292+0000","last_active":"2024-02-10T08:35:23.961819+0000","last_peered":"2024-02-10T08:35:23.961819+0000","last_clean":"2024-02-10T08:35:23.961819+0000","last_became_active":"2024-02-10T08:28:02.764210+0000","last_became_peered":"2024-02-10T08:28:02.764210+0000","last_unstale":"2024-02-10T08:35:23.961819+0000","last_undegraded":"2024-02-10T08:35:23.961819+0000","last_fullsized":"2024-02-10T08:35:23.961819+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:19.729185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:34:19.729185+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":332,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.967082+0000","last_change":"2024-02-10T08:34:23.258089+0000","last_active":"2024-02-10T08:35:23.967082+0000","last_peered":"2024-02-10T08:35:23.967082+0000","last_clean":"2024-02-10T08:35:23.967082+0000","last_became_active":"2024-02-10T08:31:33.883457+0000","last_became_peered":"2024-02-10T08:31:33.883457+0000","last_unstale":"2024-02-10T08:35:23.967082+0000","last_undegraded":"2024-02-10T08:35:23.967082+0000","last_fullsized":"2024-02-10T08:35:23.967082+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:23.258018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:34.215363+0000","last_clean_scrub_stamp":"2024-02-10T08:34:23.258018+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2","version":"382'12599","reported_seq":12659,"reported_epoch":382,"state":"active+clean","last_fresh":"2024-02-10T08:35:27.828549+0000","last_change":"2024-02-10T08:35:21.549328+0000","last_active":"2024-02-10T08:35:27.828549+0000","last_peered":"2024-02-10T08:35:27.828549+0000","last_clean":"2024-02-10T08:35:27.828549+0000","last_became_active":"2024-02-10T08:32:30.822464+0000","last_became_peered":"2024-02-10T08:32:30.822464+0000","last_unstale":"2024-02-10T08:35:27.828549+0000","last_undegraded":"2024-02-10T08:35:27.828549+0000","last_fullsized":"2024-02-10T08:35:27.828549+0000","mapping_epoch":335,"log_start":"368'7900","ondisk_log_start":"368'7900","created":335,"last_epoch_clean":336,"parent":"0.0","parent_split_bits":0,"last_scrub":"380'12202","last_scrub_stamp":"2024-02-10T08:35:21.549221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:35:21.549221+0000","log_size":4699,"ondisk_log_size":4699,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":214106112,"num_objects":3267,"num_object_clones":0,"num_object_copies":9801,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3267,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12599,"num_write_kb":507712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"225'20","reported_seq":374,"reported_epoch":380,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.121317+0000","last_change":"2024-02-10T08:35:23.121276+0000","last_active":"2024-02-10T08:35:23.121317+0000","last_peered":"2024-02-10T08:35:23.121317+0000","last_clean":"2024-02-10T08:35:23.121317+0000","last_became_active":"2024-02-10T08:20:46.398973+0000","last_became_peered":"2024-02-10T08:20:46.398973+0000","last_unstale":"2024-02-10T08:35:23.121317+0000","last_undegraded":"2024-02-10T08:35:23.121317+0000","last_fullsized":"2024-02-10T08:35:23.121317+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'20","last_scrub_stamp":"2024-02-10T08:35:23.121164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:35:23.121164+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":24,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":356,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.962021+0000","last_change":"2024-02-10T08:32:27.711245+0000","last_active":"2024-02-10T08:35:23.962021+0000","last_peered":"2024-02-10T08:35:23.962021+0000","last_clean":"2024-02-10T08:35:23.962021+0000","last_became_active":"2024-02-10T08:16:52.785545+0000","last_became_peered":"2024-02-10T08:16:52.785545+0000","last_unstale":"2024-02-10T08:35:23.962021+0000","last_undegraded":"2024-02-10T08:35:23.962021+0000","last_fullsized":"2024-02-10T08:35:23.962021+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:27.711059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:32:27.711059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"62'8","reported_seq":593,"reported_epoch":382,"state":"active+clean","last_fresh":"2024-02-10T08:35:25.983749+0000","last_change":"2024-02-10T08:34:37.927018+0000","last_active":"2024-02-10T08:35:25.983749+0000","last_peered":"2024-02-10T08:35:25.983749+0000","last_clean":"2024-02-10T08:35:25.983749+0000","last_became_active":"2024-02-10T08:16:56.858101+0000","last_became_peered":"2024-02-10T08:16:56.858101+0000","last_unstale":"2024-02-10T08:35:25.983749+0000","last_undegraded":"2024-02-10T08:35:25.983749+0000","last_fullsized":"2024-02-10T08:35:25.983749+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'8","last_scrub_stamp":"2024-02-10T08:34:37.926921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:34:37.926921+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":333,"reported_epoch":380,"state":"active+clean","last_fresh":"2024-02-10T08:35:20.811330+0000","last_change":"2024-02-10T08:33:29.477537+0000","last_active":"2024-02-10T08:35:20.811330+0000","last_peered":"2024-02-10T08:35:20.811330+0000","last_clean":"2024-02-10T08:35:20.811330+0000","last_became_active":"2024-02-10T08:30:24.071020+0000","last_became_peered":"2024-02-10T08:30:24.071020+0000","last_unstale":"2024-02-10T08:35:20.811330+0000","last_undegraded":"2024-02-10T08:35:20.811330+0000","last_fullsized":"2024-02-10T08:35:20.811330+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:29.477480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:33:29.477480+0000","last_clean_scrub_stamp":"2024-02-10T08:33:29.477480+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1","version":"381'12179","reported_seq":12219,"reported_epoch":381,"state":"active+clean+scrubbing+deep","last_fresh":"2024-02-10T08:35:25.055678+0000","last_change":"2024-02-10T08:35:24.111574+0000","last_active":"2024-02-10T08:35:25.055678+0000","last_peered":"2024-02-10T08:35:25.055678+0000","last_clean":"2024-02-10T08:35:25.055678+0000","last_became_active":"2024-02-10T08:32:30.823874+0000","last_became_peered":"2024-02-10T08:32:30.823874+0000","last_unstale":"2024-02-10T08:35:25.055678+0000","last_undegraded":"2024-02-10T08:35:25.055678+0000","last_fullsized":"2024-02-10T08:35:25.055678+0000","mapping_epoch":335,"log_start":"369'7700","ondisk_log_start":"369'7700","created":335,"last_epoch_clean":336,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.947585+0000","log_size":4479,"ondisk_log_size":4479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":217120768,"num_objects":3313,"num_object_clones":0,"num_object_copies":9939,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3313,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11955,"num_write_kb":488576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,0],"acting":[4,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"226'27","reported_seq":384,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.966002+0000","last_change":"2024-02-10T08:34:18.905332+0000","last_active":"2024-02-10T08:35:23.966002+0000","last_peered":"2024-02-10T08:35:23.966002+0000","last_clean":"2024-02-10T08:35:23.966002+0000","last_became_active":"2024-02-10T08:20:46.401777+0000","last_became_peered":"2024-02-10T08:20:46.401777+0000","last_unstale":"2024-02-10T08:35:23.966002+0000","last_undegraded":"2024-02-10T08:35:23.966002+0000","last_fullsized":"2024-02-10T08:35:23.966002+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"226'27","last_scrub_stamp":"2024-02-10T08:34:18.905235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:34:18.905235+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":361,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.961288+0000","last_change":"2024-02-10T08:35:14.724519+0000","last_active":"2024-02-10T08:35:23.961288+0000","last_peered":"2024-02-10T08:35:23.961288+0000","last_clean":"2024-02-10T08:35:23.961288+0000","last_became_active":"2024-02-10T08:16:52.783634+0000","last_became_peered":"2024-02-10T08:16:52.783634+0000","last_unstale":"2024-02-10T08:35:23.961288+0000","last_undegraded":"2024-02-10T08:35:23.961288+0000","last_fullsized":"2024-02-10T08:35:23.961288+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:35:14.724417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:35:14.724417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"318'14","reported_seq":126,"reported_epoch":380,"state":"active+clean","last_fresh":"2024-02-10T08:35:21.219611+0000","last_change":"2024-02-10T08:33:27.431016+0000","last_active":"2024-02-10T08:35:21.219611+0000","last_peered":"2024-02-10T08:35:21.219611+0000","last_clean":"2024-02-10T08:35:21.219611+0000","last_became_active":"2024-02-10T08:31:46.073265+0000","last_became_peered":"2024-02-10T08:31:46.073265+0000","last_unstale":"2024-02-10T08:35:21.219611+0000","last_undegraded":"2024-02-10T08:35:21.219611+0000","last_fullsized":"2024-02-10T08:35:21.219611+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"318'14","last_scrub_stamp":"2024-02-10T08:33:27.430946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:33:27.430946+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":381,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.957698+0000","last_change":"2024-02-10T08:35:23.093480+0000","last_active":"2024-02-10T08:35:23.957698+0000","last_peered":"2024-02-10T08:35:23.957698+0000","last_clean":"2024-02-10T08:35:23.957698+0000","last_became_active":"2024-02-10T08:32:36.978932+0000","last_became_peered":"2024-02-10T08:32:36.978932+0000","last_unstale":"2024-02-10T08:35:23.957698+0000","last_undegraded":"2024-02-10T08:35:23.957698+0000","last_fullsized":"2024-02-10T08:35:23.957698+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:35:23.093373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:35:23.093373+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.0","version":"382'12242","reported_seq":12302,"reported_epoch":382,"state":"active+clean","last_fresh":"2024-02-10T08:35:27.861846+0000","last_change":"2024-02-10T08:35:14.194604+0000","last_active":"2024-02-10T08:35:27.861846+0000","last_peered":"2024-02-10T08:35:27.861846+0000","last_clean":"2024-02-10T08:35:27.861846+0000","last_became_active":"2024-02-10T08:32:30.821494+0000","last_became_peered":"2024-02-10T08:32:30.821494+0000","last_unstale":"2024-02-10T08:35:27.861846+0000","last_undegraded":"2024-02-10T08:35:27.861846+0000","last_fullsized":"2024-02-10T08:35:27.861846+0000","mapping_epoch":335,"log_start":"366'7100","ondisk_log_start":"366'7100","created":335,"last_epoch_clean":336,"parent":"0.0","parent_split_bits":0,"last_scrub":"378'11388","last_scrub_stamp":"2024-02-10T08:35:14.194542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:35:14.194542+0000","log_size":5142,"ondisk_log_size":5142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":201850880,"num_objects":3080,"num_object_clones":0,"num_object_copies":9240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3080,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12242,"num_write_kb":490304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,4],"acting":[6,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"225'24","reported_seq":376,"reported_epoch":380,"state":"active+clean","last_fresh":"2024-02-10T08:35:20.811428+0000","last_change":"2024-02-10T08:32:23.327031+0000","last_active":"2024-02-10T08:35:20.811428+0000","last_peered":"2024-02-10T08:35:20.811428+0000","last_clean":"2024-02-10T08:35:20.811428+0000","last_became_active":"2024-02-10T08:20:46.406023+0000","last_became_peered":"2024-02-10T08:20:46.406023+0000","last_unstale":"2024-02-10T08:35:20.811428+0000","last_undegraded":"2024-02-10T08:35:20.811428+0000","last_fullsized":"2024-02-10T08:35:20.811428+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'24","last_scrub_stamp":"2024-02-10T08:32:23.326944+0000","last_deep_scrub":"76'16","last_deep_scrub_stamp":"2024-02-10T08:18:07.909782+0000","last_clean_scrub_stamp":"2024-02-10T08:32:23.326944+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":373,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.961951+0000","last_change":"2024-02-10T08:32:13.217936+0000","last_active":"2024-02-10T08:35:23.961951+0000","last_peered":"2024-02-10T08:35:23.961951+0000","last_clean":"2024-02-10T08:35:23.961951+0000","last_became_active":"2024-02-10T08:28:02.768633+0000","last_became_peered":"2024-02-10T08:28:02.768633+0000","last_unstale":"2024-02-10T08:35:23.961951+0000","last_undegraded":"2024-02-10T08:35:23.961951+0000","last_fullsized":"2024-02-10T08:35:23.961951+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:13.217844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:32:13.217844+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":420,"reported_epoch":382,"state":"active+clean","last_fresh":"2024-02-10T08:35:27.078355+0000","last_change":"2024-02-10T08:35:27.079330+0000","last_active":"2024-02-10T08:35:27.078355+0000","last_peered":"2024-02-10T08:35:27.078355+0000","last_clean":"2024-02-10T08:35:27.078355+0000","last_became_active":"2024-02-10T08:20:46.400500+0000","last_became_peered":"2024-02-10T08:20:46.400500+0000","last_unstale":"2024-02-10T08:35:27.078355+0000","last_undegraded":"2024-02-10T08:35:27.078355+0000","last_fullsized":"2024-02-10T08:35:27.078355+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:26.092899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:32:26.092899+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":293,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.949189+0000","last_change":"2024-02-10T08:34:23.054084+0000","last_active":"2024-02-10T08:35:23.949189+0000","last_peered":"2024-02-10T08:35:23.949189+0000","last_clean":"2024-02-10T08:35:23.949189+0000","last_became_active":"2024-02-10T08:31:33.880969+0000","last_became_peered":"2024-02-10T08:31:33.880969+0000","last_unstale":"2024-02-10T08:35:23.949189+0000","last_undegraded":"2024-02-10T08:35:23.949189+0000","last_fullsized":"2024-02-10T08:35:23.949189+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:23.053989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:20:30.227375+0000","last_clean_scrub_stamp":"2024-02-10T08:34:23.053989+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.f","version":"382'15754","reported_seq":15817,"reported_epoch":382,"state":"active+clean","last_fresh":"2024-02-10T08:35:27.850449+0000","last_change":"2024-02-10T08:35:11.605210+0000","last_active":"2024-02-10T08:35:27.850449+0000","last_peered":"2024-02-10T08:35:27.850449+0000","last_clean":"2024-02-10T08:35:27.850449+0000","last_became_active":"2024-02-10T08:32:30.825140+0000","last_became_peered":"2024-02-10T08:32:30.825140+0000","last_unstale":"2024-02-10T08:35:27.850449+0000","last_undegraded":"2024-02-10T08:35:27.850449+0000","last_fullsized":"2024-02-10T08:35:27.850449+0000","mapping_epoch":335,"log_start":"373'10601","ondisk_log_start":"373'10601","created":335,"last_epoch_clean":336,"parent":"0.0","parent_split_bits":0,"last_scrub":"378'14728","last_scrub_stamp":"2024-02-10T08:35:11.605104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:35:11.605104+0000","log_size":5153,"ondisk_log_size":5153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":202047488,"num_objects":3083,"num_object_clones":0,"num_object_copies":9249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3083,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12443,"num_write_kb":496832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"314'14","reported_seq":470,"reported_epoch":382,"state":"active+clean","last_fresh":"2024-02-10T08:35:25.975001+0000","last_change":"2024-02-10T08:34:18.681979+0000","last_active":"2024-02-10T08:35:25.975001+0000","last_peered":"2024-02-10T08:35:25.975001+0000","last_clean":"2024-02-10T08:35:25.975001+0000","last_became_active":"2024-02-10T08:31:33.890120+0000","last_became_peered":"2024-02-10T08:31:33.890120+0000","last_unstale":"2024-02-10T08:35:25.975001+0000","last_undegraded":"2024-02-10T08:35:25.975001+0000","last_fullsized":"2024-02-10T08:35:25.975001+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"314'14","last_scrub_stamp":"2024-02-10T08:34:18.681893+0000","last_deep_scrub":"199'13","last_deep_scrub_stamp":"2024-02-10T08:24:47.529439+0000","last_clean_scrub_stamp":"2024-02-10T08:34:18.681893+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"225'28","reported_seq":372,"reported_epoch":380,"state":"active+clean","last_fresh":"2024-02-10T08:35:20.810425+0000","last_change":"2024-02-10T08:34:12.126228+0000","last_active":"2024-02-10T08:35:20.810425+0000","last_peered":"2024-02-10T08:35:20.810425+0000","last_clean":"2024-02-10T08:35:20.810425+0000","last_became_active":"2024-02-10T08:20:46.400760+0000","last_became_peered":"2024-02-10T08:20:46.400760+0000","last_unstale":"2024-02-10T08:35:20.810425+0000","last_undegraded":"2024-02-10T08:35:20.810425+0000","last_fullsized":"2024-02-10T08:35:20.810425+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'28","last_scrub_stamp":"2024-02-10T08:34:12.126133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:34:12.126133+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":41,"num_read_kb":34,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":365,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.950254+0000","last_change":"2024-02-10T08:35:19.808816+0000","last_active":"2024-02-10T08:35:23.950254+0000","last_peered":"2024-02-10T08:35:23.950254+0000","last_clean":"2024-02-10T08:35:23.950254+0000","last_became_active":"2024-02-10T08:16:52.789020+0000","last_became_peered":"2024-02-10T08:16:52.789020+0000","last_unstale":"2024-02-10T08:35:23.950254+0000","last_undegraded":"2024-02-10T08:35:23.950254+0000","last_fullsized":"2024-02-10T08:35:23.950254+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:35:19.808724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:35:19.808724+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":358,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.962724+0000","last_change":"2024-02-10T08:33:15.455469+0000","last_active":"2024-02-10T08:35:23.962724+0000","last_peered":"2024-02-10T08:35:23.962724+0000","last_clean":"2024-02-10T08:35:23.962724+0000","last_became_active":"2024-02-10T08:21:58.546976+0000","last_became_peered":"2024-02-10T08:21:58.546976+0000","last_unstale":"2024-02-10T08:35:23.962724+0000","last_undegraded":"2024-02-10T08:35:23.962724+0000","last_fullsized":"2024-02-10T08:35:23.962724+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:15.455337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:33:15.455337+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"381'12125","reported_seq":12179,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:25.035716+0000","last_change":"2024-02-10T08:32:30.825453+0000","last_active":"2024-02-10T08:35:25.035716+0000","last_peered":"2024-02-10T08:35:25.035716+0000","last_clean":"2024-02-10T08:35:25.035716+0000","last_became_active":"2024-02-10T08:32:30.825144+0000","last_became_peered":"2024-02-10T08:32:30.825144+0000","last_unstale":"2024-02-10T08:35:25.035716+0000","last_undegraded":"2024-02-10T08:35:25.035716+0000","last_fullsized":"2024-02-10T08:35:25.035716+0000","mapping_epoch":335,"log_start":"368'7700","ondisk_log_start":"368'7700","created":335,"last_epoch_clean":336,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.947585+0000","log_size":4425,"ondisk_log_size":4425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":221446144,"num_objects":3379,"num_object_clones":0,"num_object_copies":10137,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3379,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12125,"num_write_kb":496128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":350,"reported_epoch":380,"state":"active+clean","last_fresh":"2024-02-10T08:35:20.810505+0000","last_change":"2024-02-10T08:34:10.165771+0000","last_active":"2024-02-10T08:35:20.810505+0000","last_peered":"2024-02-10T08:35:20.810505+0000","last_clean":"2024-02-10T08:35:20.810505+0000","last_became_active":"2024-02-10T08:31:33.883569+0000","last_became_peered":"2024-02-10T08:31:33.883569+0000","last_unstale":"2024-02-10T08:35:20.810505+0000","last_undegraded":"2024-02-10T08:35:20.810505+0000","last_fullsized":"2024-02-10T08:35:20.810505+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:10.165705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:34:10.165705+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"225'30","reported_seq":417,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.962323+0000","last_change":"2024-02-10T08:33:22.481486+0000","last_active":"2024-02-10T08:35:23.962323+0000","last_peered":"2024-02-10T08:35:23.962323+0000","last_clean":"2024-02-10T08:35:23.962323+0000","last_became_active":"2024-02-10T08:32:36.979685+0000","last_became_peered":"2024-02-10T08:32:36.979685+0000","last_unstale":"2024-02-10T08:35:23.962323+0000","last_undegraded":"2024-02-10T08:35:23.962323+0000","last_fullsized":"2024-02-10T08:35:23.962323+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'30","last_scrub_stamp":"2024-02-10T08:33:22.481382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:33:22.481382+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":51,"num_read_kb":39,"num_write":32,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,0],"acting":[7,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":371,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.961690+0000","last_change":"2024-02-10T08:33:16.825530+0000","last_active":"2024-02-10T08:35:23.961690+0000","last_peered":"2024-02-10T08:35:23.961690+0000","last_clean":"2024-02-10T08:35:23.961690+0000","last_became_active":"2024-02-10T08:20:46.407667+0000","last_became_peered":"2024-02-10T08:20:46.407667+0000","last_unstale":"2024-02-10T08:35:23.961690+0000","last_undegraded":"2024-02-10T08:35:23.961690+0000","last_fullsized":"2024-02-10T08:35:23.961690+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:16.825366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:33:16.825366+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":363,"reported_epoch":380,"state":"active+clean","last_fresh":"2024-02-10T08:35:20.810288+0000","last_change":"2024-02-10T08:32:25.358402+0000","last_active":"2024-02-10T08:35:20.810288+0000","last_peered":"2024-02-10T08:35:20.810288+0000","last_clean":"2024-02-10T08:35:20.810288+0000","last_became_active":"2024-02-10T08:31:33.882582+0000","last_became_peered":"2024-02-10T08:31:33.882582+0000","last_unstale":"2024-02-10T08:35:20.810288+0000","last_undegraded":"2024-02-10T08:35:20.810288+0000","last_fullsized":"2024-02-10T08:35:20.810288+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:25.358315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:25.358315+0000","last_clean_scrub_stamp":"2024-02-10T08:32:25.358315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.d","version":"381'12062","reported_seq":12134,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:25.028224+0000","last_change":"2024-02-10T08:33:56.130464+0000","last_active":"2024-02-10T08:35:25.028224+0000","last_peered":"2024-02-10T08:35:25.028224+0000","last_clean":"2024-02-10T08:35:25.028224+0000","last_became_active":"2024-02-10T08:33:56.117412+0000","last_became_peered":"2024-02-10T08:33:56.117412+0000","last_unstale":"2024-02-10T08:35:25.028224+0000","last_undegraded":"2024-02-10T08:35:25.028224+0000","last_fullsized":"2024-02-10T08:35:25.028224+0000","mapping_epoch":364,"log_start":"368'7590","ondisk_log_start":"368'7590","created":335,"last_epoch_clean":365,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.947585+0000","log_size":4472,"ondisk_log_size":4472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":212271128,"num_objects":3240,"num_object_clones":0,"num_object_copies":9720,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3240,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":12062,"num_write_kb":489601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":246,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.963653+0000","last_change":"2024-02-10T08:33:56.117476+0000","last_active":"2024-02-10T08:35:23.963653+0000","last_peered":"2024-02-10T08:35:23.963653+0000","last_clean":"2024-02-10T08:35:23.963653+0000","last_became_active":"2024-02-10T08:33:56.117216+0000","last_became_peered":"2024-02-10T08:33:56.117216+0000","last_unstale":"2024-02-10T08:35:23.963653+0000","last_undegraded":"2024-02-10T08:35:23.963653+0000","last_fullsized":"2024-02-10T08:35:23.963653+0000","mapping_epoch":364,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":365,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:33.234450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:33:33.234450+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"225'37","reported_seq":452,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.969163+0000","last_change":"2024-02-10T08:33:15.707082+0000","last_active":"2024-02-10T08:35:23.969163+0000","last_peered":"2024-02-10T08:35:23.969163+0000","last_clean":"2024-02-10T08:35:23.969163+0000","last_became_active":"2024-02-10T08:28:25.951447+0000","last_became_peered":"2024-02-10T08:28:25.951447+0000","last_unstale":"2024-02-10T08:35:23.969163+0000","last_undegraded":"2024-02-10T08:35:23.969163+0000","last_fullsized":"2024-02-10T08:35:23.969163+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'37","last_scrub_stamp":"2024-02-10T08:33:15.706967+0000","last_deep_scrub":"199'27","last_deep_scrub_stamp":"2024-02-10T08:24:42.826442+0000","last_clean_scrub_stamp":"2024-02-10T08:33:15.706967+0000","log_size":37,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":53,"num_read_kb":39,"num_write":32,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":363,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.964159+0000","last_change":"2024-02-10T08:34:20.889754+0000","last_active":"2024-02-10T08:35:23.964159+0000","last_peered":"2024-02-10T08:35:23.964159+0000","last_clean":"2024-02-10T08:35:23.964159+0000","last_became_active":"2024-02-10T08:32:36.972224+0000","last_became_peered":"2024-02-10T08:32:36.972224+0000","last_unstale":"2024-02-10T08:35:23.964159+0000","last_undegraded":"2024-02-10T08:35:23.964159+0000","last_fullsized":"2024-02-10T08:35:23.964159+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:20.889663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:34:20.889663+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4],"acting":[2,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":359,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.961454+0000","last_change":"2024-02-10T08:33:15.884926+0000","last_active":"2024-02-10T08:35:23.961454+0000","last_peered":"2024-02-10T08:35:23.961454+0000","last_clean":"2024-02-10T08:35:23.961454+0000","last_became_active":"2024-02-10T08:21:58.553966+0000","last_became_peered":"2024-02-10T08:21:58.553966+0000","last_unstale":"2024-02-10T08:35:23.961454+0000","last_undegraded":"2024-02-10T08:35:23.961454+0000","last_fullsized":"2024-02-10T08:35:23.961454+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:15.884742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:39.633627+0000","last_clean_scrub_stamp":"2024-02-10T08:33:15.884742+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.8","version":"382'12255","reported_seq":12310,"reported_epoch":382,"state":"active+clean","last_fresh":"2024-02-10T08:35:28.230221+0000","last_change":"2024-02-10T08:32:30.824983+0000","last_active":"2024-02-10T08:35:28.230221+0000","last_peered":"2024-02-10T08:35:28.230221+0000","last_clean":"2024-02-10T08:35:28.230221+0000","last_became_active":"2024-02-10T08:32:30.824620+0000","last_became_peered":"2024-02-10T08:32:30.824620+0000","last_unstale":"2024-02-10T08:35:28.230221+0000","last_undegraded":"2024-02-10T08:35:28.230221+0000","last_fullsized":"2024-02-10T08:35:28.230221+0000","mapping_epoch":335,"log_start":"369'7700","ondisk_log_start":"369'7700","created":335,"last_epoch_clean":336,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.947585+0000","log_size":4555,"ondisk_log_size":4555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":192610304,"num_objects":2939,"num_object_clones":0,"num_object_copies":8817,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2939,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12255,"num_write_kb":486208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7],"acting":[0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":378,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.957449+0000","last_change":"2024-02-10T08:33:28.092624+0000","last_active":"2024-02-10T08:35:23.957449+0000","last_peered":"2024-02-10T08:35:23.957449+0000","last_clean":"2024-02-10T08:35:23.957449+0000","last_became_active":"2024-02-10T08:28:02.772585+0000","last_became_peered":"2024-02-10T08:28:02.772585+0000","last_unstale":"2024-02-10T08:35:23.957449+0000","last_undegraded":"2024-02-10T08:35:23.957449+0000","last_fullsized":"2024-02-10T08:35:23.957449+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:28.092554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:41.360241+0000","last_clean_scrub_stamp":"2024-02-10T08:33:28.092554+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"225'24","reported_seq":71,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.967001+0000","last_change":"2024-02-10T08:33:09.736783+0000","last_active":"2024-02-10T08:35:23.967001+0000","last_peered":"2024-02-10T08:35:23.967001+0000","last_clean":"2024-02-10T08:35:23.967001+0000","last_became_active":"2024-02-10T08:32:36.975366+0000","last_became_peered":"2024-02-10T08:32:36.975366+0000","last_unstale":"2024-02-10T08:35:23.967001+0000","last_undegraded":"2024-02-10T08:35:23.967001+0000","last_fullsized":"2024-02-10T08:35:23.967001+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'24","last_scrub_stamp":"2024-02-10T08:33:09.736694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:33:09.736694+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":373,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.961848+0000","last_change":"2024-02-10T08:32:28.402029+0000","last_active":"2024-02-10T08:35:23.961848+0000","last_peered":"2024-02-10T08:35:23.961848+0000","last_clean":"2024-02-10T08:35:23.961848+0000","last_became_active":"2024-02-10T08:28:02.760999+0000","last_became_peered":"2024-02-10T08:28:02.760999+0000","last_unstale":"2024-02-10T08:35:23.961848+0000","last_undegraded":"2024-02-10T08:35:23.961848+0000","last_fullsized":"2024-02-10T08:35:23.961848+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:28.401960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:28.401960+0000","last_clean_scrub_stamp":"2024-02-10T08:32:28.401960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":352,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.962072+0000","last_change":"2024-02-10T08:33:26.788214+0000","last_active":"2024-02-10T08:35:23.962072+0000","last_peered":"2024-02-10T08:35:23.962072+0000","last_clean":"2024-02-10T08:35:23.962072+0000","last_became_active":"2024-02-10T08:31:46.063039+0000","last_became_peered":"2024-02-10T08:31:46.063039+0000","last_unstale":"2024-02-10T08:35:23.962072+0000","last_undegraded":"2024-02-10T08:35:23.962072+0000","last_fullsized":"2024-02-10T08:35:23.962072+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:26.787778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:20.736224+0000","last_clean_scrub_stamp":"2024-02-10T08:33:26.787778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":372,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.961908+0000","last_change":"2024-02-10T08:32:32.713980+0000","last_active":"2024-02-10T08:35:23.961908+0000","last_peered":"2024-02-10T08:35:23.961908+0000","last_clean":"2024-02-10T08:35:23.961908+0000","last_became_active":"2024-02-10T08:28:19.022399+0000","last_became_peered":"2024-02-10T08:28:19.022399+0000","last_unstale":"2024-02-10T08:35:23.961908+0000","last_undegraded":"2024-02-10T08:35:23.961908+0000","last_fullsized":"2024-02-10T08:35:23.961908+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:32.713921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:32:32.713921+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"382'12278","reported_seq":12338,"reported_epoch":382,"state":"active+clean","last_fresh":"2024-02-10T08:35:27.863254+0000","last_change":"2024-02-10T08:34:33.403560+0000","last_active":"2024-02-10T08:35:27.863254+0000","last_peered":"2024-02-10T08:35:27.863254+0000","last_clean":"2024-02-10T08:35:27.863254+0000","last_became_active":"2024-02-10T08:32:30.823591+0000","last_became_peered":"2024-02-10T08:32:30.823591+0000","last_unstale":"2024-02-10T08:35:27.863254+0000","last_undegraded":"2024-02-10T08:35:27.863254+0000","last_fullsized":"2024-02-10T08:35:27.863254+0000","mapping_epoch":335,"log_start":"366'7100","ondisk_log_start":"366'7100","created":335,"last_epoch_clean":336,"parent":"0.0","parent_split_bits":0,"last_scrub":"372'8897","last_scrub_stamp":"2024-02-10T08:34:33.403477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:34:33.403477+0000","log_size":5178,"ondisk_log_size":5178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":201719808,"num_objects":3078,"num_object_clones":0,"num_object_copies":9234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3078,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12278,"num_write_kb":491392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,0],"acting":[6,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":356,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.962270+0000","last_change":"2024-02-10T08:34:23.304609+0000","last_active":"2024-02-10T08:35:23.962270+0000","last_peered":"2024-02-10T08:35:23.962270+0000","last_clean":"2024-02-10T08:35:23.962270+0000","last_became_active":"2024-02-10T08:16:56.867159+0000","last_became_peered":"2024-02-10T08:16:56.867159+0000","last_unstale":"2024-02-10T08:35:23.962270+0000","last_undegraded":"2024-02-10T08:35:23.962270+0000","last_fullsized":"2024-02-10T08:35:23.962270+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:23.304519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:04.766780+0000","last_clean_scrub_stamp":"2024-02-10T08:34:23.304519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"225'33","reported_seq":420,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.953082+0000","last_change":"2024-02-10T08:33:19.194771+0000","last_active":"2024-02-10T08:35:23.953082+0000","last_peered":"2024-02-10T08:35:23.953082+0000","last_clean":"2024-02-10T08:35:23.953082+0000","last_became_active":"2024-02-10T08:20:46.401981+0000","last_became_peered":"2024-02-10T08:20:46.401981+0000","last_unstale":"2024-02-10T08:35:23.953082+0000","last_undegraded":"2024-02-10T08:35:23.953082+0000","last_fullsized":"2024-02-10T08:35:23.953082+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'33","last_scrub_stamp":"2024-02-10T08:33:19.194672+0000","last_deep_scrub":"223'21","last_deep_scrub_stamp":"2024-02-10T08:26:33.250614+0000","last_clean_scrub_stamp":"2024-02-10T08:33:19.194672+0000","log_size":33,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":33,"num_write":25,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":384,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.961928+0000","last_change":"2024-02-10T08:32:36.980106+0000","last_active":"2024-02-10T08:35:23.961928+0000","last_peered":"2024-02-10T08:35:23.961928+0000","last_clean":"2024-02-10T08:35:23.961928+0000","last_became_active":"2024-02-10T08:32:36.979237+0000","last_became_peered":"2024-02-10T08:32:36.979237+0000","last_unstale":"2024-02-10T08:35:23.961928+0000","last_undegraded":"2024-02-10T08:35:23.961928+0000","last_fullsized":"2024-02-10T08:35:23.961928+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:16.187704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:14:44.584370+0000","last_clean_scrub_stamp":"2024-02-10T08:32:16.187704+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":360,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.957203+0000","last_change":"2024-02-10T08:33:12.974304+0000","last_active":"2024-02-10T08:35:23.957203+0000","last_peered":"2024-02-10T08:35:23.957203+0000","last_clean":"2024-02-10T08:35:23.957203+0000","last_became_active":"2024-02-10T08:16:52.788767+0000","last_became_peered":"2024-02-10T08:16:52.788767+0000","last_unstale":"2024-02-10T08:35:23.957203+0000","last_undegraded":"2024-02-10T08:35:23.957203+0000","last_fullsized":"2024-02-10T08:35:23.957203+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:12.974215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:33:12.974215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":284,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.956879+0000","last_change":"2024-02-10T08:32:29.019898+0000","last_active":"2024-02-10T08:35:23.956879+0000","last_peered":"2024-02-10T08:35:23.956879+0000","last_clean":"2024-02-10T08:35:23.956879+0000","last_became_active":"2024-02-10T08:31:33.878588+0000","last_became_peered":"2024-02-10T08:31:33.878588+0000","last_unstale":"2024-02-10T08:35:23.956879+0000","last_undegraded":"2024-02-10T08:35:23.956879+0000","last_fullsized":"2024-02-10T08:35:23.956879+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.019819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.019819+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.019819+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":88,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.967139+0000","last_change":"2024-02-10T08:34:19.149776+0000","last_active":"2024-02-10T08:35:23.967139+0000","last_peered":"2024-02-10T08:35:23.967139+0000","last_clean":"2024-02-10T08:35:23.967139+0000","last_became_active":"2024-02-10T08:31:19.726561+0000","last_became_peered":"2024-02-10T08:31:19.726561+0000","last_unstale":"2024-02-10T08:35:23.967139+0000","last_undegraded":"2024-02-10T08:35:23.967139+0000","last_fullsized":"2024-02-10T08:35:23.967139+0000","mapping_epoch":308,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":309,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:19.149688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:26:29.921562+0000","last_clean_scrub_stamp":"2024-02-10T08:34:19.149688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"382'12631","reported_seq":12686,"reported_epoch":382,"state":"active+clean","last_fresh":"2024-02-10T08:35:27.785068+0000","last_change":"2024-02-10T08:32:30.825343+0000","last_active":"2024-02-10T08:35:27.785068+0000","last_peered":"2024-02-10T08:35:27.785068+0000","last_clean":"2024-02-10T08:35:27.785068+0000","last_became_active":"2024-02-10T08:32:30.824975+0000","last_became_peered":"2024-02-10T08:32:30.824975+0000","last_unstale":"2024-02-10T08:35:27.785068+0000","last_undegraded":"2024-02-10T08:35:27.785068+0000","last_fullsized":"2024-02-10T08:35:27.785068+0000","mapping_epoch":335,"log_start":"368'7800","ondisk_log_start":"368'7800","created":335,"last_epoch_clean":336,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.947585+0000","log_size":4831,"ondisk_log_size":4831,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":207421440,"num_objects":3165,"num_object_clones":0,"num_object_copies":9495,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3165,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12631,"num_write_kb":505472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":357,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.964894+0000","last_change":"2024-02-10T08:33:27.613405+0000","last_active":"2024-02-10T08:35:23.964894+0000","last_peered":"2024-02-10T08:35:23.964894+0000","last_clean":"2024-02-10T08:35:23.964894+0000","last_became_active":"2024-02-10T08:16:56.857856+0000","last_became_peered":"2024-02-10T08:16:56.857856+0000","last_unstale":"2024-02-10T08:35:23.964894+0000","last_undegraded":"2024-02-10T08:35:23.964894+0000","last_fullsized":"2024-02-10T08:35:23.964894+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:27.613326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:33:27.613326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"225'17","reported_seq":152,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.963057+0000","last_change":"2024-02-10T08:34:18.368803+0000","last_active":"2024-02-10T08:35:23.963057+0000","last_peered":"2024-02-10T08:35:23.963057+0000","last_clean":"2024-02-10T08:35:23.963057+0000","last_became_active":"2024-02-10T08:32:36.984195+0000","last_became_peered":"2024-02-10T08:32:36.984195+0000","last_unstale":"2024-02-10T08:35:23.963057+0000","last_undegraded":"2024-02-10T08:35:23.963057+0000","last_fullsized":"2024-02-10T08:35:23.963057+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'17","last_scrub_stamp":"2024-02-10T08:34:18.368690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:34:18.368690+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":23,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":402,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.964631+0000","last_change":"2024-02-10T08:34:23.885476+0000","last_active":"2024-02-10T08:35:23.964631+0000","last_peered":"2024-02-10T08:35:23.964631+0000","last_clean":"2024-02-10T08:35:23.964631+0000","last_became_active":"2024-02-10T08:31:33.884021+0000","last_became_peered":"2024-02-10T08:31:33.884021+0000","last_unstale":"2024-02-10T08:35:23.964631+0000","last_undegraded":"2024-02-10T08:35:23.964631+0000","last_fullsized":"2024-02-10T08:35:23.964631+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:23.885336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:11.681169+0000","last_clean_scrub_stamp":"2024-02-10T08:34:23.885336+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"63'5","reported_seq":1472,"reported_epoch":382,"state":"active+clean","last_fresh":"2024-02-10T08:35:26.067225+0000","last_change":"2024-02-10T08:35:07.739783+0000","last_active":"2024-02-10T08:35:26.067225+0000","last_peered":"2024-02-10T08:35:26.067225+0000","last_clean":"2024-02-10T08:35:26.067225+0000","last_became_active":"2024-02-10T08:16:52.780989+0000","last_became_peered":"2024-02-10T08:16:52.780989+0000","last_unstale":"2024-02-10T08:35:26.067225+0000","last_undegraded":"2024-02-10T08:35:26.067225+0000","last_fullsized":"2024-02-10T08:35:26.067225+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'5","last_scrub_stamp":"2024-02-10T08:35:07.739620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:35:07.739620+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1104,"num_read_kb":1099,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":364,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.963022+0000","last_change":"2024-02-10T08:33:17.442371+0000","last_active":"2024-02-10T08:35:23.963022+0000","last_peered":"2024-02-10T08:35:23.963022+0000","last_clean":"2024-02-10T08:35:23.963022+0000","last_became_active":"2024-02-10T08:21:58.549733+0000","last_became_peered":"2024-02-10T08:21:58.549733+0000","last_unstale":"2024-02-10T08:35:23.963022+0000","last_undegraded":"2024-02-10T08:35:23.963022+0000","last_fullsized":"2024-02-10T08:35:23.963022+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:17.442264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:11.750537+0000","last_clean_scrub_stamp":"2024-02-10T08:33:17.442264+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.a","version":"382'12195","reported_seq":12264,"reported_epoch":382,"state":"active+clean","last_fresh":"2024-02-10T08:35:27.856370+0000","last_change":"2024-02-10T08:35:19.311656+0000","last_active":"2024-02-10T08:35:27.856370+0000","last_peered":"2024-02-10T08:35:27.856370+0000","last_clean":"2024-02-10T08:35:27.856370+0000","last_became_active":"2024-02-10T08:32:36.978852+0000","last_became_peered":"2024-02-10T08:32:36.978852+0000","last_unstale":"2024-02-10T08:35:27.856370+0000","last_undegraded":"2024-02-10T08:35:27.856370+0000","last_fullsized":"2024-02-10T08:35:27.856370+0000","mapping_epoch":339,"log_start":"366'7100","ondisk_log_start":"366'7100","created":335,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"379'11717","last_scrub_stamp":"2024-02-10T08:35:19.311581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:35:19.311581+0000","log_size":5095,"ondisk_log_size":5095,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":201785344,"num_objects":3079,"num_object_clones":0,"num_object_copies":9237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3079,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12195,"num_write_kb":488768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":57,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.967293+0000","last_change":"2024-02-10T08:34:13.094510+0000","last_active":"2024-02-10T08:35:23.967293+0000","last_peered":"2024-02-10T08:35:23.967293+0000","last_clean":"2024-02-10T08:35:23.967293+0000","last_became_active":"2024-02-10T08:32:36.976141+0000","last_became_peered":"2024-02-10T08:32:36.976141+0000","last_unstale":"2024-02-10T08:35:23.967293+0000","last_undegraded":"2024-02-10T08:35:23.967293+0000","last_fullsized":"2024-02-10T08:35:23.967293+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:13.094426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:34:13.094426+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"314'42","reported_seq":711,"reported_epoch":382,"state":"active+clean","last_fresh":"2024-02-10T08:35:25.981529+0000","last_change":"2024-02-10T08:33:13.903831+0000","last_active":"2024-02-10T08:35:25.981529+0000","last_peered":"2024-02-10T08:35:25.981529+0000","last_clean":"2024-02-10T08:35:25.981529+0000","last_became_active":"2024-02-10T08:31:33.904487+0000","last_became_peered":"2024-02-10T08:31:33.904487+0000","last_unstale":"2024-02-10T08:35:25.981529+0000","last_undegraded":"2024-02-10T08:35:25.981529+0000","last_fullsized":"2024-02-10T08:35:25.981529+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":315,"parent":"0.0","parent_split_bits":0,"last_scrub":"314'42","last_scrub_stamp":"2024-02-10T08:33:13.903652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:33:13.903652+0000","log_size":42,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":66,"num_read_kb":51,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":716,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":360,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.956788+0000","last_change":"2024-02-10T08:33:15.952668+0000","last_active":"2024-02-10T08:35:23.956788+0000","last_peered":"2024-02-10T08:35:23.956788+0000","last_clean":"2024-02-10T08:35:23.956788+0000","last_became_active":"2024-02-10T08:16:52.791027+0000","last_became_peered":"2024-02-10T08:16:52.791027+0000","last_unstale":"2024-02-10T08:35:23.956788+0000","last_undegraded":"2024-02-10T08:35:23.956788+0000","last_fullsized":"2024-02-10T08:35:23.956788+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:15.952580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:33:15.952580+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":378,"reported_epoch":380,"state":"active+clean","last_fresh":"2024-02-10T08:35:20.811229+0000","last_change":"2024-02-10T08:32:32.331364+0000","last_active":"2024-02-10T08:35:20.811229+0000","last_peered":"2024-02-10T08:35:20.811229+0000","last_clean":"2024-02-10T08:35:20.811229+0000","last_became_active":"2024-02-10T08:31:33.884295+0000","last_became_peered":"2024-02-10T08:31:33.884295+0000","last_unstale":"2024-02-10T08:35:20.811229+0000","last_undegraded":"2024-02-10T08:35:20.811229+0000","last_fullsized":"2024-02-10T08:35:20.811229+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:32.331286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:32:32.331286+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"382'12416","reported_seq":12471,"reported_epoch":382,"state":"active+clean","last_fresh":"2024-02-10T08:35:27.748470+0000","last_change":"2024-02-10T08:32:30.823074+0000","last_active":"2024-02-10T08:35:27.748470+0000","last_peered":"2024-02-10T08:35:27.748470+0000","last_clean":"2024-02-10T08:35:27.748470+0000","last_became_active":"2024-02-10T08:32:30.822769+0000","last_became_peered":"2024-02-10T08:32:30.822769+0000","last_unstale":"2024-02-10T08:35:27.748470+0000","last_undegraded":"2024-02-10T08:35:27.748470+0000","last_fullsized":"2024-02-10T08:35:27.748470+0000","mapping_epoch":335,"log_start":"369'8000","ondisk_log_start":"369'8000","created":335,"last_epoch_clean":336,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.947585+0000","log_size":4416,"ondisk_log_size":4416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":206045184,"num_objects":3144,"num_object_clones":0,"num_object_copies":9432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3144,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12416,"num_write_kb":497920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"255'12","reported_seq":301,"reported_epoch":382,"state":"active+clean","last_fresh":"2024-02-10T08:35:25.992864+0000","last_change":"2024-02-10T08:32:25.571469+0000","last_active":"2024-02-10T08:35:25.992864+0000","last_peered":"2024-02-10T08:35:25.992864+0000","last_clean":"2024-02-10T08:35:25.992864+0000","last_became_active":"2024-02-10T08:28:25.952468+0000","last_became_peered":"2024-02-10T08:28:25.952468+0000","last_unstale":"2024-02-10T08:35:25.992864+0000","last_undegraded":"2024-02-10T08:35:25.992864+0000","last_fullsized":"2024-02-10T08:35:25.992864+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'12","last_scrub_stamp":"2024-02-10T08:32:25.571388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:32:25.571388+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"225'20","reported_seq":399,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.962117+0000","last_change":"2024-02-10T08:34:11.736768+0000","last_active":"2024-02-10T08:35:23.962117+0000","last_peered":"2024-02-10T08:35:23.962117+0000","last_clean":"2024-02-10T08:35:23.962117+0000","last_became_active":"2024-02-10T08:20:46.408495+0000","last_became_peered":"2024-02-10T08:20:46.408495+0000","last_unstale":"2024-02-10T08:35:23.962117+0000","last_undegraded":"2024-02-10T08:35:23.962117+0000","last_fullsized":"2024-02-10T08:35:23.962117+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'20","last_scrub_stamp":"2024-02-10T08:34:11.736600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:34:11.736600+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":374,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.961605+0000","last_change":"2024-02-10T08:33:11.869960+0000","last_active":"2024-02-10T08:35:23.961605+0000","last_peered":"2024-02-10T08:35:23.961605+0000","last_clean":"2024-02-10T08:35:23.961605+0000","last_became_active":"2024-02-10T08:28:02.760784+0000","last_became_peered":"2024-02-10T08:28:02.760784+0000","last_unstale":"2024-02-10T08:35:23.961605+0000","last_undegraded":"2024-02-10T08:35:23.961605+0000","last_fullsized":"2024-02-10T08:35:23.961605+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:11.869839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:33:11.869839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":280,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.962372+0000","last_change":"2024-02-10T08:34:11.146000+0000","last_active":"2024-02-10T08:35:23.962372+0000","last_peered":"2024-02-10T08:35:23.962372+0000","last_clean":"2024-02-10T08:35:23.962372+0000","last_became_active":"2024-02-10T08:28:25.950240+0000","last_became_peered":"2024-02-10T08:28:25.950240+0000","last_unstale":"2024-02-10T08:35:23.962372+0000","last_undegraded":"2024-02-10T08:35:23.962372+0000","last_fullsized":"2024-02-10T08:35:23.962372+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:11.145907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:34:11.145907+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"382'12585","reported_seq":12648,"reported_epoch":382,"state":"active+clean","last_fresh":"2024-02-10T08:35:27.761774+0000","last_change":"2024-02-10T08:33:56.159846+0000","last_active":"2024-02-10T08:35:27.761774+0000","last_peered":"2024-02-10T08:35:27.761774+0000","last_clean":"2024-02-10T08:35:27.761774+0000","last_became_active":"2024-02-10T08:33:56.120673+0000","last_became_peered":"2024-02-10T08:33:56.120673+0000","last_unstale":"2024-02-10T08:35:27.761774+0000","last_undegraded":"2024-02-10T08:35:27.761774+0000","last_fullsized":"2024-02-10T08:35:27.761774+0000","mapping_epoch":364,"log_start":"367'7737","ondisk_log_start":"367'7737","created":335,"last_epoch_clean":365,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.947585+0000","log_size":4848,"ondisk_log_size":4848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":209387520,"num_objects":3195,"num_object_clones":0,"num_object_copies":9585,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3195,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12585,"num_write_kb":504960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":375,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.964975+0000","last_change":"2024-02-10T08:33:19.671725+0000","last_active":"2024-02-10T08:35:23.964975+0000","last_peered":"2024-02-10T08:35:23.964975+0000","last_clean":"2024-02-10T08:35:23.964975+0000","last_became_active":"2024-02-10T08:28:02.777637+0000","last_became_peered":"2024-02-10T08:28:02.777637+0000","last_unstale":"2024-02-10T08:35:23.964975+0000","last_undegraded":"2024-02-10T08:35:23.964975+0000","last_fullsized":"2024-02-10T08:35:23.964975+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:19.671626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:33:19.671626+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"225'23","reported_seq":419,"reported_epoch":380,"state":"active+clean","last_fresh":"2024-02-10T08:35:20.810124+0000","last_change":"2024-02-10T08:34:19.175648+0000","last_active":"2024-02-10T08:35:20.810124+0000","last_peered":"2024-02-10T08:35:20.810124+0000","last_clean":"2024-02-10T08:35:20.810124+0000","last_became_active":"2024-02-10T08:31:33.884516+0000","last_became_peered":"2024-02-10T08:31:33.884516+0000","last_unstale":"2024-02-10T08:35:20.810124+0000","last_undegraded":"2024-02-10T08:35:20.810124+0000","last_fullsized":"2024-02-10T08:35:20.810124+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'23","last_scrub_stamp":"2024-02-10T08:34:19.175575+0000","last_deep_scrub":"82'17","last_deep_scrub_stamp":"2024-02-10T08:18:21.015873+0000","last_clean_scrub_stamp":"2024-02-10T08:34:19.175575+0000","log_size":23,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":25,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"55'2","reported_seq":375,"reported_epoch":380,"state":"active+clean","last_fresh":"2024-02-10T08:35:20.811594+0000","last_change":"2024-02-10T08:34:27.070443+0000","last_active":"2024-02-10T08:35:20.811594+0000","last_peered":"2024-02-10T08:35:20.811594+0000","last_clean":"2024-02-10T08:35:20.811594+0000","last_became_active":"2024-02-10T08:28:02.768279+0000","last_became_peered":"2024-02-10T08:28:02.768279+0000","last_unstale":"2024-02-10T08:35:20.811594+0000","last_undegraded":"2024-02-10T08:35:20.811594+0000","last_fullsized":"2024-02-10T08:35:20.811594+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'2","last_scrub_stamp":"2024-02-10T08:34:27.070328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:34:27.070328+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":184,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":272,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.962529+0000","last_change":"2024-02-10T08:35:12.451166+0000","last_active":"2024-02-10T08:35:23.962529+0000","last_peered":"2024-02-10T08:35:23.962529+0000","last_clean":"2024-02-10T08:35:23.962529+0000","last_became_active":"2024-02-10T08:30:24.073077+0000","last_became_peered":"2024-02-10T08:30:24.073077+0000","last_unstale":"2024-02-10T08:35:23.962529+0000","last_undegraded":"2024-02-10T08:35:23.962529+0000","last_fullsized":"2024-02-10T08:35:23.962529+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:35:12.451079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:35:12.451079+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"225'15","reported_seq":67,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.966869+0000","last_change":"2024-02-10T08:33:19.722178+0000","last_active":"2024-02-10T08:35:23.966869+0000","last_peered":"2024-02-10T08:35:23.966869+0000","last_clean":"2024-02-10T08:35:23.966869+0000","last_became_active":"2024-02-10T08:32:36.982716+0000","last_became_peered":"2024-02-10T08:32:36.982716+0000","last_unstale":"2024-02-10T08:35:23.966869+0000","last_undegraded":"2024-02-10T08:35:23.966869+0000","last_fullsized":"2024-02-10T08:35:23.966869+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'15","last_scrub_stamp":"2024-02-10T08:33:19.722084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:33:19.722084+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"55'1","reported_seq":431,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.964935+0000","last_change":"2024-02-10T08:33:28.572672+0000","last_active":"2024-02-10T08:35:23.964935+0000","last_peered":"2024-02-10T08:35:23.964935+0000","last_clean":"2024-02-10T08:35:23.964935+0000","last_became_active":"2024-02-10T08:28:02.778857+0000","last_became_peered":"2024-02-10T08:28:02.778857+0000","last_unstale":"2024-02-10T08:35:23.964935+0000","last_undegraded":"2024-02-10T08:35:23.964935+0000","last_fullsized":"2024-02-10T08:35:23.964935+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'1","last_scrub_stamp":"2024-02-10T08:33:28.572582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:33:28.572582+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":716,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":304,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.962096+0000","last_change":"2024-02-10T08:34:30.785782+0000","last_active":"2024-02-10T08:35:23.962096+0000","last_peered":"2024-02-10T08:35:23.962096+0000","last_clean":"2024-02-10T08:35:23.962096+0000","last_became_active":"2024-02-10T08:31:33.891489+0000","last_became_peered":"2024-02-10T08:31:33.891489+0000","last_unstale":"2024-02-10T08:35:23.962096+0000","last_undegraded":"2024-02-10T08:35:23.962096+0000","last_fullsized":"2024-02-10T08:35:23.962096+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:30.785679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:34:30.785679+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":224,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.966640+0000","last_change":"2024-02-10T08:34:12.117475+0000","last_active":"2024-02-10T08:35:23.966640+0000","last_peered":"2024-02-10T08:35:23.966640+0000","last_clean":"2024-02-10T08:35:23.966640+0000","last_became_active":"2024-02-10T08:28:25.999252+0000","last_became_peered":"2024-02-10T08:28:25.999252+0000","last_unstale":"2024-02-10T08:35:23.966640+0000","last_undegraded":"2024-02-10T08:35:23.966640+0000","last_fullsized":"2024-02-10T08:35:23.966640+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:12.117379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:34:12.117379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"225'15","reported_seq":328,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.963405+0000","last_change":"2024-02-10T08:32:23.310599+0000","last_active":"2024-02-10T08:35:23.963405+0000","last_peered":"2024-02-10T08:35:23.963405+0000","last_clean":"2024-02-10T08:35:23.963405+0000","last_became_active":"2024-02-10T08:31:33.891813+0000","last_became_peered":"2024-02-10T08:31:33.891813+0000","last_unstale":"2024-02-10T08:35:23.963405+0000","last_undegraded":"2024-02-10T08:35:23.963405+0000","last_fullsized":"2024-02-10T08:35:23.963405+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'15","last_scrub_stamp":"2024-02-10T08:32:23.310489+0000","last_deep_scrub":"223'9","last_deep_scrub_stamp":"2024-02-10T08:26:33.158025+0000","last_clean_scrub_stamp":"2024-02-10T08:32:23.310489+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":427,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.948747+0000","last_change":"2024-02-10T08:34:35.009855+0000","last_active":"2024-02-10T08:35:23.948747+0000","last_peered":"2024-02-10T08:35:23.948747+0000","last_clean":"2024-02-10T08:35:23.948747+0000","last_became_active":"2024-02-10T08:31:46.053553+0000","last_became_peered":"2024-02-10T08:31:46.053553+0000","last_unstale":"2024-02-10T08:35:23.948747+0000","last_undegraded":"2024-02-10T08:35:23.948747+0000","last_fullsized":"2024-02-10T08:35:23.948747+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:35.009784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:34:35.009784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":356,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.957609+0000","last_change":"2024-02-10T08:34:28.320611+0000","last_active":"2024-02-10T08:35:23.957609+0000","last_peered":"2024-02-10T08:35:23.957609+0000","last_clean":"2024-02-10T08:35:23.957609+0000","last_became_active":"2024-02-10T08:16:56.863948+0000","last_became_peered":"2024-02-10T08:16:56.863948+0000","last_unstale":"2024-02-10T08:35:23.957609+0000","last_undegraded":"2024-02-10T08:35:23.957609+0000","last_fullsized":"2024-02-10T08:35:23.957609+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:28.320524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:34:28.320524+0000","last_clean_scrub_stamp":"2024-02-10T08:34:28.320524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":364,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.963235+0000","last_change":"2024-02-10T08:33:32.430824+0000","last_active":"2024-02-10T08:35:23.963235+0000","last_peered":"2024-02-10T08:35:23.963235+0000","last_clean":"2024-02-10T08:35:23.963235+0000","last_became_active":"2024-02-10T08:20:46.398903+0000","last_became_peered":"2024-02-10T08:20:46.398903+0000","last_unstale":"2024-02-10T08:35:23.963235+0000","last_undegraded":"2024-02-10T08:35:23.963235+0000","last_fullsized":"2024-02-10T08:35:23.963235+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:32.430721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:33:32.430721+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"225'20","reported_seq":308,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.961741+0000","last_change":"2024-02-10T08:35:17.746698+0000","last_active":"2024-02-10T08:35:23.961741+0000","last_peered":"2024-02-10T08:35:23.961741+0000","last_clean":"2024-02-10T08:35:23.961741+0000","last_became_active":"2024-02-10T08:22:23.534081+0000","last_became_peered":"2024-02-10T08:22:23.534081+0000","last_unstale":"2024-02-10T08:35:23.961741+0000","last_undegraded":"2024-02-10T08:35:23.961741+0000","last_fullsized":"2024-02-10T08:35:23.961741+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'20","last_scrub_stamp":"2024-02-10T08:35:17.746555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:35:17.746555+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":24,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":360,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.956649+0000","last_change":"2024-02-10T08:32:16.110041+0000","last_active":"2024-02-10T08:35:23.956649+0000","last_peered":"2024-02-10T08:35:23.956649+0000","last_clean":"2024-02-10T08:35:23.956649+0000","last_became_active":"2024-02-10T08:16:52.789834+0000","last_became_peered":"2024-02-10T08:16:52.789834+0000","last_unstale":"2024-02-10T08:35:23.956649+0000","last_undegraded":"2024-02-10T08:35:23.956649+0000","last_fullsized":"2024-02-10T08:35:23.956649+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:16.109957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:32:16.109957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"244'12","reported_seq":633,"reported_epoch":382,"state":"active+clean","last_fresh":"2024-02-10T08:35:26.021551+0000","last_change":"2024-02-10T08:35:24.069288+0000","last_active":"2024-02-10T08:35:26.021551+0000","last_peered":"2024-02-10T08:35:26.021551+0000","last_clean":"2024-02-10T08:35:26.021551+0000","last_became_active":"2024-02-10T08:28:02.776097+0000","last_became_peered":"2024-02-10T08:28:02.776097+0000","last_unstale":"2024-02-10T08:35:26.021551+0000","last_undegraded":"2024-02-10T08:35:26.021551+0000","last_fullsized":"2024-02-10T08:35:26.021551+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"244'12","last_scrub_stamp":"2024-02-10T08:35:24.069224+0000","last_deep_scrub":"244'12","last_deep_scrub_stamp":"2024-02-10T08:35:24.069224+0000","last_clean_scrub_stamp":"2024-02-10T08:35:24.069224+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":57,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.966986+0000","last_change":"2024-02-10T08:33:07.663592+0000","last_active":"2024-02-10T08:35:23.966986+0000","last_peered":"2024-02-10T08:35:23.966986+0000","last_clean":"2024-02-10T08:35:23.966986+0000","last_became_active":"2024-02-10T08:32:36.983153+0000","last_became_peered":"2024-02-10T08:32:36.983153+0000","last_unstale":"2024-02-10T08:35:23.966986+0000","last_undegraded":"2024-02-10T08:35:23.966986+0000","last_fullsized":"2024-02-10T08:35:23.966986+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:07.663498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:05.662947+0000","last_clean_scrub_stamp":"2024-02-10T08:33:07.663498+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"225'19","reported_seq":387,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.957389+0000","last_change":"2024-02-10T08:33:18.984602+0000","last_active":"2024-02-10T08:35:23.957389+0000","last_peered":"2024-02-10T08:35:23.957389+0000","last_clean":"2024-02-10T08:35:23.957389+0000","last_became_active":"2024-02-10T08:16:55.204734+0000","last_became_peered":"2024-02-10T08:16:55.204734+0000","last_unstale":"2024-02-10T08:35:23.957389+0000","last_undegraded":"2024-02-10T08:35:23.957389+0000","last_fullsized":"2024-02-10T08:35:23.957389+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'19","last_scrub_stamp":"2024-02-10T08:33:18.984505+0000","last_deep_scrub":"213'13","last_deep_scrub_stamp":"2024-02-10T08:25:43.713333+0000","last_clean_scrub_stamp":"2024-02-10T08:33:18.984505+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":52,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.966298+0000","last_change":"2024-02-10T08:32:36.981055+0000","last_active":"2024-02-10T08:35:23.966298+0000","last_peered":"2024-02-10T08:35:23.966298+0000","last_clean":"2024-02-10T08:35:23.966298+0000","last_became_active":"2024-02-10T08:32:36.980715+0000","last_became_peered":"2024-02-10T08:32:36.980715+0000","last_unstale":"2024-02-10T08:35:23.966298+0000","last_undegraded":"2024-02-10T08:35:23.966298+0000","last_fullsized":"2024-02-10T08:35:23.966298+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:21.299448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:32:21.299448+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"314'11","reported_seq":464,"reported_epoch":382,"state":"active+clean","last_fresh":"2024-02-10T08:35:26.026564+0000","last_change":"2024-02-10T08:32:15.210339+0000","last_active":"2024-02-10T08:35:26.026564+0000","last_peered":"2024-02-10T08:35:26.026564+0000","last_clean":"2024-02-10T08:35:26.026564+0000","last_became_active":"2024-02-10T08:31:33.885840+0000","last_became_peered":"2024-02-10T08:31:33.885840+0000","last_unstale":"2024-02-10T08:35:26.026564+0000","last_undegraded":"2024-02-10T08:35:26.026564+0000","last_fullsized":"2024-02-10T08:35:26.026564+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"314'11","last_scrub_stamp":"2024-02-10T08:32:15.210224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:32:15.210224+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":342,"reported_epoch":380,"state":"active+clean","last_fresh":"2024-02-10T08:35:20.811310+0000","last_change":"2024-02-10T08:35:12.180908+0000","last_active":"2024-02-10T08:35:20.811310+0000","last_peered":"2024-02-10T08:35:20.811310+0000","last_clean":"2024-02-10T08:35:20.811310+0000","last_became_active":"2024-02-10T08:20:46.395788+0000","last_became_peered":"2024-02-10T08:20:46.395788+0000","last_unstale":"2024-02-10T08:35:20.811310+0000","last_undegraded":"2024-02-10T08:35:20.811310+0000","last_fullsized":"2024-02-10T08:35:20.811310+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:35:12.180812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:35:12.180812+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"225'15","reported_seq":364,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.963869+0000","last_change":"2024-02-10T08:35:13.255320+0000","last_active":"2024-02-10T08:35:23.963869+0000","last_peered":"2024-02-10T08:35:23.963869+0000","last_clean":"2024-02-10T08:35:23.963869+0000","last_became_active":"2024-02-10T08:28:25.952354+0000","last_became_peered":"2024-02-10T08:28:25.952354+0000","last_unstale":"2024-02-10T08:35:23.963869+0000","last_undegraded":"2024-02-10T08:35:23.963869+0000","last_fullsized":"2024-02-10T08:35:23.963869+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'15","last_scrub_stamp":"2024-02-10T08:32:13.529289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:32:13.529289+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":372,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:25.826928+0000","last_change":"2024-02-10T08:35:25.826895+0000","last_active":"2024-02-10T08:35:25.826928+0000","last_peered":"2024-02-10T08:35:25.826928+0000","last_clean":"2024-02-10T08:35:25.826928+0000","last_became_active":"2024-02-10T08:16:52.786213+0000","last_became_peered":"2024-02-10T08:16:52.786213+0000","last_unstale":"2024-02-10T08:35:25.826928+0000","last_undegraded":"2024-02-10T08:35:25.826928+0000","last_fullsized":"2024-02-10T08:35:25.826928+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:35:25.826812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:35:25.826812+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":189,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.969248+0000","last_change":"2024-02-10T08:33:28.822022+0000","last_active":"2024-02-10T08:35:23.969248+0000","last_peered":"2024-02-10T08:35:23.969248+0000","last_clean":"2024-02-10T08:35:23.969248+0000","last_became_active":"2024-02-10T08:28:25.950221+0000","last_became_peered":"2024-02-10T08:28:25.950221+0000","last_unstale":"2024-02-10T08:35:23.969248+0000","last_undegraded":"2024-02-10T08:35:23.969248+0000","last_fullsized":"2024-02-10T08:35:23.969248+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:28.821928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:33:28.821928+0000","last_clean_scrub_stamp":"2024-02-10T08:33:28.821928+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":195,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.962739+0000","last_change":"2024-02-10T08:33:22.771214+0000","last_active":"2024-02-10T08:35:23.962739+0000","last_peered":"2024-02-10T08:35:23.962739+0000","last_clean":"2024-02-10T08:35:23.962739+0000","last_became_active":"2024-02-10T08:30:24.070440+0000","last_became_peered":"2024-02-10T08:30:24.070440+0000","last_unstale":"2024-02-10T08:35:23.962739+0000","last_undegraded":"2024-02-10T08:35:23.962739+0000","last_fullsized":"2024-02-10T08:35:23.962739+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:22.771132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:33:22.771132+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"225'24","reported_seq":394,"reported_epoch":380,"state":"active+clean","last_fresh":"2024-02-10T08:35:20.810191+0000","last_change":"2024-02-10T08:33:06.269127+0000","last_active":"2024-02-10T08:35:20.810191+0000","last_peered":"2024-02-10T08:35:20.810191+0000","last_clean":"2024-02-10T08:35:20.810191+0000","last_became_active":"2024-02-10T08:20:46.396130+0000","last_became_peered":"2024-02-10T08:20:46.396130+0000","last_unstale":"2024-02-10T08:35:20.810191+0000","last_undegraded":"2024-02-10T08:35:20.810191+0000","last_fullsized":"2024-02-10T08:35:20.810191+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'24","last_scrub_stamp":"2024-02-10T08:33:06.269024+0000","last_deep_scrub":"201'16","last_deep_scrub_stamp":"2024-02-10T08:24:49.177357+0000","last_clean_scrub_stamp":"2024-02-10T08:33:06.269024+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":378,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.962148+0000","last_change":"2024-02-10T08:33:10.874200+0000","last_active":"2024-02-10T08:35:23.962148+0000","last_peered":"2024-02-10T08:35:23.962148+0000","last_clean":"2024-02-10T08:35:23.962148+0000","last_became_active":"2024-02-10T08:32:36.974379+0000","last_became_peered":"2024-02-10T08:32:36.974379+0000","last_unstale":"2024-02-10T08:35:23.962148+0000","last_undegraded":"2024-02-10T08:35:23.962148+0000","last_fullsized":"2024-02-10T08:35:23.962148+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:10.874017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:33:10.874017+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":372,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.962150+0000","last_change":"2024-02-10T08:33:06.791408+0000","last_active":"2024-02-10T08:35:23.962150+0000","last_peered":"2024-02-10T08:35:23.962150+0000","last_clean":"2024-02-10T08:35:23.962150+0000","last_became_active":"2024-02-10T08:31:33.893973+0000","last_became_peered":"2024-02-10T08:31:33.893973+0000","last_unstale":"2024-02-10T08:35:23.962150+0000","last_undegraded":"2024-02-10T08:35:23.962150+0000","last_fullsized":"2024-02-10T08:35:23.962150+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:06.791295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:33:06.791295+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":57,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.961638+0000","last_change":"2024-02-10T08:34:38.015567+0000","last_active":"2024-02-10T08:35:23.961638+0000","last_peered":"2024-02-10T08:35:23.961638+0000","last_clean":"2024-02-10T08:35:23.961638+0000","last_became_active":"2024-02-10T08:32:36.979093+0000","last_became_peered":"2024-02-10T08:32:36.979093+0000","last_unstale":"2024-02-10T08:35:23.961638+0000","last_undegraded":"2024-02-10T08:35:23.961638+0000","last_fullsized":"2024-02-10T08:35:23.961638+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:38.015515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:34:38.015515+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,5],"acting":[0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"225'8","reported_seq":290,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.960907+0000","last_change":"2024-02-10T08:35:08.720411+0000","last_active":"2024-02-10T08:35:23.960907+0000","last_peered":"2024-02-10T08:35:23.960907+0000","last_clean":"2024-02-10T08:35:23.960907+0000","last_became_active":"2024-02-10T08:22:23.522936+0000","last_became_peered":"2024-02-10T08:22:23.522936+0000","last_unstale":"2024-02-10T08:35:23.960907+0000","last_undegraded":"2024-02-10T08:35:23.960907+0000","last_fullsized":"2024-02-10T08:35:23.960907+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'8","last_scrub_stamp":"2024-02-10T08:35:08.720332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:35:08.720332+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,6],"acting":[1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":365,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.957679+0000","last_change":"2024-02-10T08:33:22.025841+0000","last_active":"2024-02-10T08:35:23.957679+0000","last_peered":"2024-02-10T08:35:23.957679+0000","last_clean":"2024-02-10T08:35:23.957679+0000","last_became_active":"2024-02-10T08:16:52.788704+0000","last_became_peered":"2024-02-10T08:16:52.788704+0000","last_unstale":"2024-02-10T08:35:23.957679+0000","last_undegraded":"2024-02-10T08:35:23.957679+0000","last_fullsized":"2024-02-10T08:35:23.957679+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:22.025769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:33:22.025769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":371,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.948680+0000","last_change":"2024-02-10T08:35:15.873051+0000","last_active":"2024-02-10T08:35:23.948680+0000","last_peered":"2024-02-10T08:35:23.948680+0000","last_clean":"2024-02-10T08:35:23.948680+0000","last_became_active":"2024-02-10T08:20:46.397495+0000","last_became_peered":"2024-02-10T08:20:46.397495+0000","last_unstale":"2024-02-10T08:35:23.948680+0000","last_undegraded":"2024-02-10T08:35:23.948680+0000","last_fullsized":"2024-02-10T08:35:23.948680+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:35:15.872974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:35:15.872974+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":378,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.962317+0000","last_change":"2024-02-10T08:34:38.328749+0000","last_active":"2024-02-10T08:35:23.962317+0000","last_peered":"2024-02-10T08:35:23.962317+0000","last_clean":"2024-02-10T08:35:23.962317+0000","last_became_active":"2024-02-10T08:30:24.064419+0000","last_became_peered":"2024-02-10T08:30:24.064419+0000","last_unstale":"2024-02-10T08:35:23.962317+0000","last_undegraded":"2024-02-10T08:35:23.962317+0000","last_fullsized":"2024-02-10T08:35:23.962317+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:38.328641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:27.276490+0000","last_clean_scrub_stamp":"2024-02-10T08:34:38.328641+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"225'19","reported_seq":304,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.962122+0000","last_change":"2024-02-10T08:29:22.312103+0000","last_active":"2024-02-10T08:35:23.962122+0000","last_peered":"2024-02-10T08:35:23.962122+0000","last_clean":"2024-02-10T08:35:23.962122+0000","last_became_active":"2024-02-10T08:22:23.526198+0000","last_became_peered":"2024-02-10T08:22:23.526198+0000","last_unstale":"2024-02-10T08:35:23.962122+0000","last_undegraded":"2024-02-10T08:35:23.962122+0000","last_fullsized":"2024-02-10T08:35:23.962122+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'19","last_scrub_stamp":"2024-02-10T08:29:22.312001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:29:22.312001+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":24,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":365,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.950092+0000","last_change":"2024-02-10T08:35:11.849852+0000","last_active":"2024-02-10T08:35:23.950092+0000","last_peered":"2024-02-10T08:35:23.950092+0000","last_clean":"2024-02-10T08:35:23.950092+0000","last_became_active":"2024-02-10T08:16:52.788629+0000","last_became_peered":"2024-02-10T08:16:52.788629+0000","last_unstale":"2024-02-10T08:35:23.950092+0000","last_undegraded":"2024-02-10T08:35:23.950092+0000","last_fullsized":"2024-02-10T08:35:23.950092+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:35:11.849772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:38.360929+0000","last_clean_scrub_stamp":"2024-02-10T08:35:11.849772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":371,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.962369+0000","last_change":"2024-02-10T08:34:37.281857+0000","last_active":"2024-02-10T08:35:23.962369+0000","last_peered":"2024-02-10T08:35:23.962369+0000","last_clean":"2024-02-10T08:35:23.962369+0000","last_became_active":"2024-02-10T08:20:46.399838+0000","last_became_peered":"2024-02-10T08:20:46.399838+0000","last_unstale":"2024-02-10T08:35:23.962369+0000","last_undegraded":"2024-02-10T08:35:23.962369+0000","last_fullsized":"2024-02-10T08:35:23.962369+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:37.281763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:34:37.281763+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":57,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.967285+0000","last_change":"2024-02-10T08:34:30.191894+0000","last_active":"2024-02-10T08:35:23.967285+0000","last_peered":"2024-02-10T08:35:23.967285+0000","last_clean":"2024-02-10T08:35:23.967285+0000","last_became_active":"2024-02-10T08:32:36.982778+0000","last_became_peered":"2024-02-10T08:32:36.982778+0000","last_unstale":"2024-02-10T08:35:23.967285+0000","last_undegraded":"2024-02-10T08:35:23.967285+0000","last_fullsized":"2024-02-10T08:35:23.967285+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:30.191790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:34:30.191790+0000","last_clean_scrub_stamp":"2024-02-10T08:34:30.191790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"225'25","reported_seq":466,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.967151+0000","last_change":"2024-02-10T08:32:32.566504+0000","last_active":"2024-02-10T08:35:23.967151+0000","last_peered":"2024-02-10T08:35:23.967151+0000","last_clean":"2024-02-10T08:35:23.967151+0000","last_became_active":"2024-02-10T08:31:33.879680+0000","last_became_peered":"2024-02-10T08:31:33.879680+0000","last_unstale":"2024-02-10T08:35:23.967151+0000","last_undegraded":"2024-02-10T08:35:23.967151+0000","last_fullsized":"2024-02-10T08:35:23.967151+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'25","last_scrub_stamp":"2024-02-10T08:32:32.566437+0000","last_deep_scrub":"74'15","last_deep_scrub_stamp":"2024-02-10T08:17:57.637346+0000","last_clean_scrub_stamp":"2024-02-10T08:32:32.566437+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":24,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":375,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.956397+0000","last_change":"2024-02-10T08:35:10.165815+0000","last_active":"2024-02-10T08:35:23.956397+0000","last_peered":"2024-02-10T08:35:23.956397+0000","last_clean":"2024-02-10T08:35:23.956397+0000","last_became_active":"2024-02-10T08:20:46.392466+0000","last_became_peered":"2024-02-10T08:20:46.392466+0000","last_unstale":"2024-02-10T08:35:23.956397+0000","last_undegraded":"2024-02-10T08:35:23.956397+0000","last_fullsized":"2024-02-10T08:35:23.956397+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:35:10.165751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:29:26.072031+0000","last_clean_scrub_stamp":"2024-02-10T08:35:10.165751+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1f","version":"111'11","reported_seq":611,"reported_epoch":382,"state":"active+clean","last_fresh":"2024-02-10T08:35:26.018178+0000","last_change":"2024-02-10T08:34:26.020988+0000","last_active":"2024-02-10T08:35:26.018178+0000","last_peered":"2024-02-10T08:35:26.018178+0000","last_clean":"2024-02-10T08:35:26.018178+0000","last_became_active":"2024-02-10T08:20:46.402663+0000","last_became_peered":"2024-02-10T08:20:46.402663+0000","last_unstale":"2024-02-10T08:35:26.018178+0000","last_undegraded":"2024-02-10T08:35:26.018178+0000","last_fullsized":"2024-02-10T08:35:26.018178+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'11","last_scrub_stamp":"2024-02-10T08:34:26.020887+0000","last_deep_scrub":"111'11","last_deep_scrub_stamp":"2024-02-10T08:32:17.249718+0000","last_clean_scrub_stamp":"2024-02-10T08:34:26.020887+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"87'2","reported_seq":356,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.962893+0000","last_change":"2024-02-10T08:33:29.353243+0000","last_active":"2024-02-10T08:35:23.962893+0000","last_peered":"2024-02-10T08:35:23.962893+0000","last_clean":"2024-02-10T08:35:23.962893+0000","last_became_active":"2024-02-10T08:16:58.859047+0000","last_became_peered":"2024-02-10T08:16:58.859047+0000","last_unstale":"2024-02-10T08:35:23.962893+0000","last_undegraded":"2024-02-10T08:35:23.962893+0000","last_fullsized":"2024-02-10T08:35:23.962893+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'2","last_scrub_stamp":"2024-02-10T08:33:29.353122+0000","last_deep_scrub":"87'2","last_deep_scrub_stamp":"2024-02-10T08:19:29.207531+0000","last_clean_scrub_stamp":"2024-02-10T08:33:29.353122+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"225'19","reported_seq":397,"reported_epoch":382,"state":"active+clean","last_fresh":"2024-02-10T08:35:26.779936+0000","last_change":"2024-02-10T08:35:26.779936+0000","last_active":"2024-02-10T08:35:26.779936+0000","last_peered":"2024-02-10T08:35:26.779936+0000","last_clean":"2024-02-10T08:35:26.779936+0000","last_became_active":"2024-02-10T08:16:54.852665+0000","last_became_peered":"2024-02-10T08:16:54.852665+0000","last_unstale":"2024-02-10T08:35:26.779936+0000","last_undegraded":"2024-02-10T08:35:26.779936+0000","last_fullsized":"2024-02-10T08:35:26.779936+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'19","last_scrub_stamp":"2024-02-10T08:35:26.779875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:35:26.779875+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":302,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.948612+0000","last_change":"2024-02-10T08:34:11.022449+0000","last_active":"2024-02-10T08:35:23.948612+0000","last_peered":"2024-02-10T08:35:23.948612+0000","last_clean":"2024-02-10T08:35:23.948612+0000","last_became_active":"2024-02-10T08:31:33.878473+0000","last_became_peered":"2024-02-10T08:31:33.878473+0000","last_unstale":"2024-02-10T08:35:23.948612+0000","last_undegraded":"2024-02-10T08:35:23.948612+0000","last_fullsized":"2024-02-10T08:35:23.948612+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:11.022357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:25:42.124914+0000","last_clean_scrub_stamp":"2024-02-10T08:34:11.022357+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":186,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.967171+0000","last_change":"2024-02-10T08:32:26.589167+0000","last_active":"2024-02-10T08:35:23.967171+0000","last_peered":"2024-02-10T08:35:23.967171+0000","last_clean":"2024-02-10T08:35:23.967171+0000","last_became_active":"2024-02-10T08:28:25.951312+0000","last_became_peered":"2024-02-10T08:28:25.951312+0000","last_unstale":"2024-02-10T08:35:23.967171+0000","last_undegraded":"2024-02-10T08:35:23.967171+0000","last_fullsized":"2024-02-10T08:35:23.967171+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:26.589082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:32:26.589082+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":365,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.961989+0000","last_change":"2024-02-10T08:34:10.742336+0000","last_active":"2024-02-10T08:35:23.961989+0000","last_peered":"2024-02-10T08:35:23.961989+0000","last_clean":"2024-02-10T08:35:23.961989+0000","last_became_active":"2024-02-10T08:20:46.408504+0000","last_became_peered":"2024-02-10T08:20:46.408504+0000","last_unstale":"2024-02-10T08:35:23.961989+0000","last_undegraded":"2024-02-10T08:35:23.961989+0000","last_fullsized":"2024-02-10T08:35:23.961989+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:10.742154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:22.104988+0000","last_clean_scrub_stamp":"2024-02-10T08:34:10.742154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"330'34","reported_seq":464,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.964096+0000","last_change":"2024-02-10T08:34:10.804210+0000","last_active":"2024-02-10T08:35:23.964096+0000","last_peered":"2024-02-10T08:35:23.964096+0000","last_clean":"2024-02-10T08:35:23.964096+0000","last_became_active":"2024-02-10T08:31:33.894960+0000","last_became_peered":"2024-02-10T08:31:33.894960+0000","last_unstale":"2024-02-10T08:35:23.964096+0000","last_undegraded":"2024-02-10T08:35:23.964096+0000","last_fullsized":"2024-02-10T08:35:23.964096+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"330'34","last_scrub_stamp":"2024-02-10T08:34:10.804112+0000","last_deep_scrub":"330'34","last_deep_scrub_stamp":"2024-02-10T08:32:17.481832+0000","last_clean_scrub_stamp":"2024-02-10T08:34:10.804112+0000","log_size":34,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":375,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.949497+0000","last_change":"2024-02-10T08:33:13.175633+0000","last_active":"2024-02-10T08:35:23.949497+0000","last_peered":"2024-02-10T08:35:23.949497+0000","last_clean":"2024-02-10T08:35:23.949497+0000","last_became_active":"2024-02-10T08:20:46.396303+0000","last_became_peered":"2024-02-10T08:20:46.396303+0000","last_unstale":"2024-02-10T08:35:23.949497+0000","last_undegraded":"2024-02-10T08:35:23.949497+0000","last_fullsized":"2024-02-10T08:35:23.949497+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:13.175559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:10.370746+0000","last_clean_scrub_stamp":"2024-02-10T08:33:13.175559+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":385,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.962408+0000","last_change":"2024-02-10T08:34:20.720576+0000","last_active":"2024-02-10T08:35:23.962408+0000","last_peered":"2024-02-10T08:35:23.962408+0000","last_clean":"2024-02-10T08:35:23.962408+0000","last_became_active":"2024-02-10T08:28:02.763523+0000","last_became_peered":"2024-02-10T08:28:02.763523+0000","last_unstale":"2024-02-10T08:35:23.962408+0000","last_undegraded":"2024-02-10T08:35:23.962408+0000","last_fullsized":"2024-02-10T08:35:23.962408+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:20.719812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:34:20.719812+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":332,"reported_epoch":380,"state":"active+clean","last_fresh":"2024-02-10T08:35:20.811417+0000","last_change":"2024-02-10T08:33:19.356128+0000","last_active":"2024-02-10T08:35:20.811417+0000","last_peered":"2024-02-10T08:35:20.811417+0000","last_clean":"2024-02-10T08:35:20.811417+0000","last_became_active":"2024-02-10T08:20:46.403378+0000","last_became_peered":"2024-02-10T08:20:46.403378+0000","last_unstale":"2024-02-10T08:35:20.811417+0000","last_undegraded":"2024-02-10T08:35:20.811417+0000","last_fullsized":"2024-02-10T08:35:20.811417+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:19.356038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:33:19.356038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"226'23","reported_seq":367,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.962318+0000","last_change":"2024-02-10T08:33:31.665259+0000","last_active":"2024-02-10T08:35:23.962318+0000","last_peered":"2024-02-10T08:35:23.962318+0000","last_clean":"2024-02-10T08:35:23.962318+0000","last_became_active":"2024-02-10T08:31:33.891562+0000","last_became_peered":"2024-02-10T08:31:33.891562+0000","last_unstale":"2024-02-10T08:35:23.962318+0000","last_undegraded":"2024-02-10T08:35:23.962318+0000","last_fullsized":"2024-02-10T08:35:23.962318+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"226'23","last_scrub_stamp":"2024-02-10T08:33:31.665189+0000","last_deep_scrub":"226'23","last_deep_scrub_stamp":"2024-02-10T08:33:31.665189+0000","last_clean_scrub_stamp":"2024-02-10T08:33:31.665189+0000","log_size":23,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":25,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":279,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.962617+0000","last_change":"2024-02-10T08:32:22.275761+0000","last_active":"2024-02-10T08:35:23.962617+0000","last_peered":"2024-02-10T08:35:23.962617+0000","last_clean":"2024-02-10T08:35:23.962617+0000","last_became_active":"2024-02-10T08:31:33.879918+0000","last_became_peered":"2024-02-10T08:31:33.879918+0000","last_unstale":"2024-02-10T08:35:23.962617+0000","last_undegraded":"2024-02-10T08:35:23.962617+0000","last_fullsized":"2024-02-10T08:35:23.962617+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:22.275679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:32:22.275679+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":334,"reported_epoch":380,"state":"active+clean","last_fresh":"2024-02-10T08:35:20.810937+0000","last_change":"2024-02-10T08:35:19.051893+0000","last_active":"2024-02-10T08:35:20.810937+0000","last_peered":"2024-02-10T08:35:20.810937+0000","last_clean":"2024-02-10T08:35:20.810937+0000","last_became_active":"2024-02-10T08:20:46.398532+0000","last_became_peered":"2024-02-10T08:20:46.398532+0000","last_unstale":"2024-02-10T08:35:20.810937+0000","last_undegraded":"2024-02-10T08:35:20.810937+0000","last_fullsized":"2024-02-10T08:35:20.810937+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:35:19.051801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:35:19.051801+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":271,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.950563+0000","last_change":"2024-02-10T08:34:27.097346+0000","last_active":"2024-02-10T08:35:23.950563+0000","last_peered":"2024-02-10T08:35:23.950563+0000","last_clean":"2024-02-10T08:35:23.950563+0000","last_became_active":"2024-02-10T08:22:23.526229+0000","last_became_peered":"2024-02-10T08:22:23.526229+0000","last_unstale":"2024-02-10T08:35:23.950563+0000","last_undegraded":"2024-02-10T08:35:23.950563+0000","last_fullsized":"2024-02-10T08:35:23.950563+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:27.097266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:34:27.097266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1a","version":"225'15","reported_seq":88,"reported_epoch":380,"state":"active+clean","last_fresh":"2024-02-10T08:35:20.809925+0000","last_change":"2024-02-10T08:34:25.085877+0000","last_active":"2024-02-10T08:35:20.809925+0000","last_peered":"2024-02-10T08:35:20.809925+0000","last_clean":"2024-02-10T08:35:20.809925+0000","last_became_active":"2024-02-10T08:31:46.069680+0000","last_became_peered":"2024-02-10T08:31:46.069680+0000","last_unstale":"2024-02-10T08:35:20.809925+0000","last_undegraded":"2024-02-10T08:35:20.809925+0000","last_fullsized":"2024-02-10T08:35:20.809925+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'15","last_scrub_stamp":"2024-02-10T08:34:25.085814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:34:25.085814+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":355,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.962129+0000","last_change":"2024-02-10T08:29:26.213501+0000","last_active":"2024-02-10T08:35:23.962129+0000","last_peered":"2024-02-10T08:35:23.962129+0000","last_clean":"2024-02-10T08:35:23.962129+0000","last_became_active":"2024-02-10T08:16:52.787865+0000","last_became_peered":"2024-02-10T08:16:52.787865+0000","last_unstale":"2024-02-10T08:35:23.962129+0000","last_undegraded":"2024-02-10T08:35:23.962129+0000","last_fullsized":"2024-02-10T08:35:23.962129+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:26.213417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:28.028556+0000","last_clean_scrub_stamp":"2024-02-10T08:29:26.213417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":392,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.957127+0000","last_change":"2024-02-10T08:35:08.193565+0000","last_active":"2024-02-10T08:35:23.957127+0000","last_peered":"2024-02-10T08:35:23.957127+0000","last_clean":"2024-02-10T08:35:23.957127+0000","last_became_active":"2024-02-10T08:28:19.065132+0000","last_became_peered":"2024-02-10T08:28:19.065132+0000","last_unstale":"2024-02-10T08:35:23.957127+0000","last_undegraded":"2024-02-10T08:35:23.957127+0000","last_fullsized":"2024-02-10T08:35:23.957127+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:35:08.193502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:35:08.193502+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,7],"acting":[5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":57,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.962613+0000","last_change":"2024-02-10T08:33:08.700632+0000","last_active":"2024-02-10T08:35:23.962613+0000","last_peered":"2024-02-10T08:35:23.962613+0000","last_clean":"2024-02-10T08:35:23.962613+0000","last_became_active":"2024-02-10T08:32:36.978752+0000","last_became_peered":"2024-02-10T08:32:36.978752+0000","last_unstale":"2024-02-10T08:35:23.962613+0000","last_undegraded":"2024-02-10T08:35:23.962613+0000","last_fullsized":"2024-02-10T08:35:23.962613+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:08.700527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:33:08.700527+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"225'7","reported_seq":383,"reported_epoch":380,"state":"active+clean","last_fresh":"2024-02-10T08:35:20.810587+0000","last_change":"2024-02-10T08:32:22.340287+0000","last_active":"2024-02-10T08:35:20.810587+0000","last_peered":"2024-02-10T08:35:20.810587+0000","last_clean":"2024-02-10T08:35:20.810587+0000","last_became_active":"2024-02-10T08:27:27.715306+0000","last_became_peered":"2024-02-10T08:27:27.715306+0000","last_unstale":"2024-02-10T08:35:20.810587+0000","last_undegraded":"2024-02-10T08:35:20.810587+0000","last_fullsized":"2024-02-10T08:35:20.810587+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'7","last_scrub_stamp":"2024-02-10T08:32:22.340191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:32:22.340191+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":9,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"55'1","reported_seq":388,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.962889+0000","last_change":"2024-02-10T08:33:06.363742+0000","last_active":"2024-02-10T08:35:23.962889+0000","last_peered":"2024-02-10T08:35:23.962889+0000","last_clean":"2024-02-10T08:35:23.962889+0000","last_became_active":"2024-02-10T08:28:02.761299+0000","last_became_peered":"2024-02-10T08:28:02.761299+0000","last_unstale":"2024-02-10T08:35:23.962889+0000","last_undegraded":"2024-02-10T08:35:23.962889+0000","last_fullsized":"2024-02-10T08:35:23.962889+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'1","last_scrub_stamp":"2024-02-10T08:33:06.363627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:33:06.363627+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1746,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":371,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.962271+0000","last_change":"2024-02-10T08:34:12.333244+0000","last_active":"2024-02-10T08:35:23.962271+0000","last_peered":"2024-02-10T08:35:23.962271+0000","last_clean":"2024-02-10T08:35:23.962271+0000","last_became_active":"2024-02-10T08:20:46.406783+0000","last_became_peered":"2024-02-10T08:20:46.406783+0000","last_unstale":"2024-02-10T08:35:23.962271+0000","last_undegraded":"2024-02-10T08:35:23.962271+0000","last_fullsized":"2024-02-10T08:35:23.962271+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:12.333167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:34:12.333167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":372,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.956725+0000","last_change":"2024-02-10T08:34:34.307258+0000","last_active":"2024-02-10T08:35:23.956725+0000","last_peered":"2024-02-10T08:35:23.956725+0000","last_clean":"2024-02-10T08:35:23.956725+0000","last_became_active":"2024-02-10T08:31:33.886617+0000","last_became_peered":"2024-02-10T08:31:33.886617+0000","last_unstale":"2024-02-10T08:35:23.956725+0000","last_undegraded":"2024-02-10T08:35:23.956725+0000","last_fullsized":"2024-02-10T08:35:23.956725+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:34.307158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:34:34.307158+0000","last_clean_scrub_stamp":"2024-02-10T08:34:34.307158+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"358'19","reported_seq":360,"reported_epoch":380,"state":"active+clean","last_fresh":"2024-02-10T08:35:20.810529+0000","last_change":"2024-02-10T08:33:34.450999+0000","last_active":"2024-02-10T08:35:20.810529+0000","last_peered":"2024-02-10T08:35:20.810529+0000","last_clean":"2024-02-10T08:35:20.810529+0000","last_became_active":"2024-02-10T08:20:46.404966+0000","last_became_peered":"2024-02-10T08:20:46.404966+0000","last_unstale":"2024-02-10T08:35:20.810529+0000","last_undegraded":"2024-02-10T08:35:20.810529+0000","last_fullsized":"2024-02-10T08:35:20.810529+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"358'19","last_scrub_stamp":"2024-02-10T08:33:34.450897+0000","last_deep_scrub":"358'19","last_deep_scrub_stamp":"2024-02-10T08:33:34.450897+0000","last_clean_scrub_stamp":"2024-02-10T08:33:34.450897+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":63,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.967601+0000","last_change":"2024-02-10T08:35:07.250085+0000","last_active":"2024-02-10T08:35:23.967601+0000","last_peered":"2024-02-10T08:35:23.967601+0000","last_clean":"2024-02-10T08:35:23.967601+0000","last_became_active":"2024-02-10T08:32:36.982675+0000","last_became_peered":"2024-02-10T08:32:36.982675+0000","last_unstale":"2024-02-10T08:35:23.967601+0000","last_undegraded":"2024-02-10T08:35:23.967601+0000","last_fullsized":"2024-02-10T08:35:23.967601+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:35:07.249972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:35:07.249972+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,5],"acting":[0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":352,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.961371+0000","last_change":"2024-02-10T08:33:08.870508+0000","last_active":"2024-02-10T08:35:23.961371+0000","last_peered":"2024-02-10T08:35:23.961371+0000","last_clean":"2024-02-10T08:35:23.961371+0000","last_became_active":"2024-02-10T08:16:56.863353+0000","last_became_peered":"2024-02-10T08:16:56.863353+0000","last_unstale":"2024-02-10T08:35:23.961371+0000","last_undegraded":"2024-02-10T08:35:23.961371+0000","last_fullsized":"2024-02-10T08:35:23.961371+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:08.870342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:33:08.870342+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":338,"reported_epoch":380,"state":"active+clean","last_fresh":"2024-02-10T08:35:20.810541+0000","last_change":"2024-02-10T08:34:39.027380+0000","last_active":"2024-02-10T08:35:20.810541+0000","last_peered":"2024-02-10T08:35:20.810541+0000","last_clean":"2024-02-10T08:35:20.810541+0000","last_became_active":"2024-02-10T08:20:46.405314+0000","last_became_peered":"2024-02-10T08:20:46.405314+0000","last_unstale":"2024-02-10T08:35:20.810541+0000","last_undegraded":"2024-02-10T08:35:20.810541+0000","last_fullsized":"2024-02-10T08:35:20.810541+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:39.027284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:29:25.024412+0000","last_clean_scrub_stamp":"2024-02-10T08:34:39.027284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"225'27","reported_seq":421,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.964428+0000","last_change":"2024-02-10T08:33:09.659351+0000","last_active":"2024-02-10T08:35:23.964428+0000","last_peered":"2024-02-10T08:35:23.964428+0000","last_clean":"2024-02-10T08:35:23.964428+0000","last_became_active":"2024-02-10T08:31:33.883535+0000","last_became_peered":"2024-02-10T08:31:33.883535+0000","last_unstale":"2024-02-10T08:35:23.964428+0000","last_undegraded":"2024-02-10T08:35:23.964428+0000","last_fullsized":"2024-02-10T08:35:23.964428+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'27","last_scrub_stamp":"2024-02-10T08:33:09.659240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:33:09.659240+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":57,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.966891+0000","last_change":"2024-02-10T08:33:10.725696+0000","last_active":"2024-02-10T08:35:23.966891+0000","last_peered":"2024-02-10T08:35:23.966891+0000","last_clean":"2024-02-10T08:35:23.966891+0000","last_became_active":"2024-02-10T08:32:36.977972+0000","last_became_peered":"2024-02-10T08:32:36.977972+0000","last_unstale":"2024-02-10T08:35:23.966891+0000","last_undegraded":"2024-02-10T08:35:23.966891+0000","last_fullsized":"2024-02-10T08:35:23.966891+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:10.725600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:33:10.725600+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":78,"reported_epoch":380,"state":"active+clean","last_fresh":"2024-02-10T08:35:20.810441+0000","last_change":"2024-02-10T08:33:23.437506+0000","last_active":"2024-02-10T08:35:20.810441+0000","last_peered":"2024-02-10T08:35:20.810441+0000","last_clean":"2024-02-10T08:35:20.810441+0000","last_became_active":"2024-02-10T08:31:46.057858+0000","last_became_peered":"2024-02-10T08:31:46.057858+0000","last_unstale":"2024-02-10T08:35:20.810441+0000","last_undegraded":"2024-02-10T08:35:20.810441+0000","last_fullsized":"2024-02-10T08:35:20.810441+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:23.437405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:33:23.437405+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":284,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.962422+0000","last_change":"2024-02-10T08:35:19.525731+0000","last_active":"2024-02-10T08:35:23.962422+0000","last_peered":"2024-02-10T08:35:23.962422+0000","last_clean":"2024-02-10T08:35:23.962422+0000","last_became_active":"2024-02-10T08:31:33.880328+0000","last_became_peered":"2024-02-10T08:31:33.880328+0000","last_unstale":"2024-02-10T08:35:23.962422+0000","last_undegraded":"2024-02-10T08:35:23.962422+0000","last_fullsized":"2024-02-10T08:35:23.962422+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:35:19.525667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:35:19.525667+0000","last_clean_scrub_stamp":"2024-02-10T08:35:19.525667+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":268,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.961544+0000","last_change":"2024-02-10T08:33:19.782701+0000","last_active":"2024-02-10T08:35:23.961544+0000","last_peered":"2024-02-10T08:35:23.961544+0000","last_clean":"2024-02-10T08:35:23.961544+0000","last_became_active":"2024-02-10T08:22:00.581772+0000","last_became_peered":"2024-02-10T08:22:00.581772+0000","last_unstale":"2024-02-10T08:35:23.961544+0000","last_undegraded":"2024-02-10T08:35:23.961544+0000","last_fullsized":"2024-02-10T08:35:23.961544+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:19.782523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:33:19.782523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,7],"acting":[1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":286,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.961786+0000","last_change":"2024-02-10T08:33:10.338393+0000","last_active":"2024-02-10T08:35:23.961786+0000","last_peered":"2024-02-10T08:35:23.961786+0000","last_clean":"2024-02-10T08:35:23.961786+0000","last_became_active":"2024-02-10T08:31:46.054713+0000","last_became_peered":"2024-02-10T08:31:46.054713+0000","last_unstale":"2024-02-10T08:35:23.961786+0000","last_undegraded":"2024-02-10T08:35:23.961786+0000","last_fullsized":"2024-02-10T08:35:23.961786+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:10.338257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:33:10.338257+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":275,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.949025+0000","last_change":"2024-02-10T08:34:21.117300+0000","last_active":"2024-02-10T08:35:23.949025+0000","last_peered":"2024-02-10T08:35:23.949025+0000","last_clean":"2024-02-10T08:35:23.949025+0000","last_became_active":"2024-02-10T08:22:00.600200+0000","last_became_peered":"2024-02-10T08:22:00.600200+0000","last_unstale":"2024-02-10T08:35:23.949025+0000","last_undegraded":"2024-02-10T08:35:23.949025+0000","last_fullsized":"2024-02-10T08:35:23.949025+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:21.117198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:34:21.117198+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1],"acting":[6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":257,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.969059+0000","last_change":"2024-02-10T08:33:24.802823+0000","last_active":"2024-02-10T08:35:23.969059+0000","last_peered":"2024-02-10T08:35:23.969059+0000","last_clean":"2024-02-10T08:35:23.969059+0000","last_became_active":"2024-02-10T08:28:25.999335+0000","last_became_peered":"2024-02-10T08:28:25.999335+0000","last_unstale":"2024-02-10T08:35:23.969059+0000","last_undegraded":"2024-02-10T08:35:23.969059+0000","last_fullsized":"2024-02-10T08:35:23.969059+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:24.802724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:33:24.802724+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":382,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.956847+0000","last_change":"2024-02-10T08:33:24.018372+0000","last_active":"2024-02-10T08:35:23.956847+0000","last_peered":"2024-02-10T08:35:23.956847+0000","last_clean":"2024-02-10T08:35:23.956847+0000","last_became_active":"2024-02-10T08:31:33.879440+0000","last_became_peered":"2024-02-10T08:31:33.879440+0000","last_unstale":"2024-02-10T08:35:23.956847+0000","last_undegraded":"2024-02-10T08:35:23.956847+0000","last_fullsized":"2024-02-10T08:35:23.956847+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:24.018273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:33:24.018273+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":383,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.953155+0000","last_change":"2024-02-10T08:33:25.314878+0000","last_active":"2024-02-10T08:35:23.953155+0000","last_peered":"2024-02-10T08:35:23.953155+0000","last_clean":"2024-02-10T08:35:23.953155+0000","last_became_active":"2024-02-10T08:27:27.710587+0000","last_became_peered":"2024-02-10T08:27:27.710587+0000","last_unstale":"2024-02-10T08:35:23.953155+0000","last_undegraded":"2024-02-10T08:35:23.953155+0000","last_fullsized":"2024-02-10T08:35:23.953155+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:25.314779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:11.750537+0000","last_clean_scrub_stamp":"2024-02-10T08:33:25.314779+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,1],"acting":[6,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":286,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.961774+0000","last_change":"2024-02-10T08:33:30.688162+0000","last_active":"2024-02-10T08:35:23.961774+0000","last_peered":"2024-02-10T08:35:23.961774+0000","last_clean":"2024-02-10T08:35:23.961774+0000","last_became_active":"2024-02-10T08:32:36.974142+0000","last_became_peered":"2024-02-10T08:32:36.974142+0000","last_unstale":"2024-02-10T08:35:23.961774+0000","last_undegraded":"2024-02-10T08:35:23.961774+0000","last_fullsized":"2024-02-10T08:35:23.961774+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:30.688056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:33:30.688056+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":291,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.950027+0000","last_change":"2024-02-10T08:34:22.176269+0000","last_active":"2024-02-10T08:35:23.950027+0000","last_peered":"2024-02-10T08:35:23.950027+0000","last_clean":"2024-02-10T08:35:23.950027+0000","last_became_active":"2024-02-10T08:32:36.979412+0000","last_became_peered":"2024-02-10T08:32:36.979412+0000","last_unstale":"2024-02-10T08:35:23.950027+0000","last_undegraded":"2024-02-10T08:35:23.950027+0000","last_fullsized":"2024-02-10T08:35:23.950027+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:22.176191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:34:22.176191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1],"acting":[6,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":363,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.964827+0000","last_change":"2024-02-10T08:34:19.933437+0000","last_active":"2024-02-10T08:35:23.964827+0000","last_peered":"2024-02-10T08:35:23.964827+0000","last_clean":"2024-02-10T08:35:23.964827+0000","last_became_active":"2024-02-10T08:22:00.578118+0000","last_became_peered":"2024-02-10T08:22:00.578118+0000","last_unstale":"2024-02-10T08:35:23.964827+0000","last_undegraded":"2024-02-10T08:35:23.964827+0000","last_fullsized":"2024-02-10T08:35:23.964827+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:19.933309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:34:19.933309+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,6],"acting":[2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.29","version":"76'2","reported_seq":316,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.961814+0000","last_change":"2024-02-10T08:32:31.459909+0000","last_active":"2024-02-10T08:35:23.961814+0000","last_peered":"2024-02-10T08:35:23.961814+0000","last_clean":"2024-02-10T08:35:23.961814+0000","last_became_active":"2024-02-10T08:28:02.767822+0000","last_became_peered":"2024-02-10T08:28:02.767822+0000","last_unstale":"2024-02-10T08:35:23.961814+0000","last_undegraded":"2024-02-10T08:35:23.961814+0000","last_fullsized":"2024-02-10T08:35:23.961814+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":6,"last_scrub":"76'2","last_scrub_stamp":"2024-02-10T08:32:31.459851+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2024-02-10T08:18:08.680038+0000","last_clean_scrub_stamp":"2024-02-10T08:32:31.459851+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,0],"acting":[7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":89,"reported_epoch":380,"state":"active+clean","last_fresh":"2024-02-10T08:35:20.810054+0000","last_change":"2024-02-10T08:35:09.039987+0000","last_active":"2024-02-10T08:35:20.810054+0000","last_peered":"2024-02-10T08:35:20.810054+0000","last_clean":"2024-02-10T08:35:20.810054+0000","last_became_active":"2024-02-10T08:32:36.975213+0000","last_became_peered":"2024-02-10T08:32:36.975213+0000","last_unstale":"2024-02-10T08:35:20.810054+0000","last_undegraded":"2024-02-10T08:35:20.810054+0000","last_fullsized":"2024-02-10T08:35:20.810054+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:35:09.039924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:20.392249+0000","last_clean_scrub_stamp":"2024-02-10T08:35:09.039924+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0],"acting":[4,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":107,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.956881+0000","last_change":"2024-02-10T08:34:10.431223+0000","last_active":"2024-02-10T08:35:23.956881+0000","last_peered":"2024-02-10T08:35:23.956881+0000","last_clean":"2024-02-10T08:35:23.956881+0000","last_became_active":"2024-02-10T08:30:26.079913+0000","last_became_peered":"2024-02-10T08:30:26.079913+0000","last_unstale":"2024-02-10T08:35:23.956881+0000","last_undegraded":"2024-02-10T08:35:23.956881+0000","last_fullsized":"2024-02-10T08:35:23.956881+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:10.431134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:34:10.431134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":214,"reported_epoch":380,"state":"active+clean","last_fresh":"2024-02-10T08:35:20.810890+0000","last_change":"2024-02-10T08:33:56.117758+0000","last_active":"2024-02-10T08:35:20.810890+0000","last_peered":"2024-02-10T08:35:20.810890+0000","last_clean":"2024-02-10T08:35:20.810890+0000","last_became_active":"2024-02-10T08:33:56.117425+0000","last_became_peered":"2024-02-10T08:33:56.117425+0000","last_unstale":"2024-02-10T08:35:20.810890+0000","last_undegraded":"2024-02-10T08:35:20.810890+0000","last_fullsized":"2024-02-10T08:35:20.810890+0000","mapping_epoch":364,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":365,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:21.209041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:20:30.227375+0000","last_clean_scrub_stamp":"2024-02-10T08:33:21.209041+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":379,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.964008+0000","last_change":"2024-02-10T08:35:21.921686+0000","last_active":"2024-02-10T08:35:23.964008+0000","last_peered":"2024-02-10T08:35:23.964008+0000","last_clean":"2024-02-10T08:35:23.964008+0000","last_became_active":"2024-02-10T08:30:26.085360+0000","last_became_peered":"2024-02-10T08:30:26.085360+0000","last_unstale":"2024-02-10T08:35:23.964008+0000","last_undegraded":"2024-02-10T08:35:23.964008+0000","last_fullsized":"2024-02-10T08:35:23.964008+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:35:21.921586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:35:21.921586+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,5],"acting":[2,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":107,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.949286+0000","last_change":"2024-02-10T08:33:20.217875+0000","last_active":"2024-02-10T08:35:23.949286+0000","last_peered":"2024-02-10T08:35:23.949286+0000","last_clean":"2024-02-10T08:35:23.949286+0000","last_became_active":"2024-02-10T08:30:26.075472+0000","last_became_peered":"2024-02-10T08:30:26.075472+0000","last_unstale":"2024-02-10T08:35:23.949286+0000","last_undegraded":"2024-02-10T08:35:23.949286+0000","last_fullsized":"2024-02-10T08:35:23.949286+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:20.217823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:33:20.217823+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":106,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.962968+0000","last_change":"2024-02-10T08:35:21.343961+0000","last_active":"2024-02-10T08:35:23.962968+0000","last_peered":"2024-02-10T08:35:23.962968+0000","last_clean":"2024-02-10T08:35:23.962968+0000","last_became_active":"2024-02-10T08:30:26.080539+0000","last_became_peered":"2024-02-10T08:30:26.080539+0000","last_unstale":"2024-02-10T08:35:23.962968+0000","last_undegraded":"2024-02-10T08:35:23.962968+0000","last_fullsized":"2024-02-10T08:35:23.962968+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:34.215363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:34.215363+0000","last_clean_scrub_stamp":"2024-02-10T08:28:34.215363+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":102,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.961698+0000","last_change":"2024-02-10T08:30:26.088483+0000","last_active":"2024-02-10T08:35:23.961698+0000","last_peered":"2024-02-10T08:35:23.961698+0000","last_clean":"2024-02-10T08:35:23.961698+0000","last_became_active":"2024-02-10T08:30:26.088228+0000","last_became_peered":"2024-02-10T08:30:26.088228+0000","last_unstale":"2024-02-10T08:35:23.961698+0000","last_undegraded":"2024-02-10T08:35:23.961698+0000","last_fullsized":"2024-02-10T08:35:23.961698+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:11.496105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:11.496105+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1],"acting":[7,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":289,"reported_epoch":381,"state":"active+clean","last_fresh":"2024-02-10T08:35:23.956540+0000","last_change":"2024-02-10T08:34:17.350483+0000","last_active":"2024-02-10T08:35:23.956540+0000","last_peered":"2024-02-10T08:35:23.956540+0000","last_clean":"2024-02-10T08:35:23.956540+0000","last_became_active":"2024-02-10T08:30:26.072022+0000","last_became_peered":"2024-02-10T08:30:26.072022+0000","last_unstale":"2024-02-10T08:35:23.956540+0000","last_undegraded":"2024-02-10T08:35:23.956540+0000","last_fullsized":"2024-02-10T08:35:23.956540+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:17.350406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:34:17.350406+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":16,"stat_sum":{"num_bytes":3304325144,"num_objects":50421,"num_object_clones":0,"num_object_copies":151263,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50421,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":197181,"num_write_kb":7923201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":9893851136,"data_stored":9893838920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":78288,"ondisk_log_size":78288,"up":48,"acting":48,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2646,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":4},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1104,"num_read_kb":1099,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":9,"acting":9,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":1105,"num_read_kb":862,"num_write":703,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":212,"num_bytes_recovered":5226,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":737,"ondisk_log_size":737,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":96,"acting":96,"num_store_stats":8},{"poolid":6,"num_pg":52,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":156,"acting":156,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":50,"seq":214748365027,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1403268,"kb_used_data":801276,"kb_used_omap":0,"kb_used_meta":601984,"kb_avail":92341884,"statfs":{"total":95995035648,"available":94558089216,"internally_reserved":0,"allocated":820506624,"data_stored":820097227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":616431616},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:35:18 2024","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":2.9460000000000002,"15min":2.1139999999999999},"min":{"1min":0.20899999999999999,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":4.6180000000000003,"5min":107.95699999999999,"15min":107.95699999999999},"last":0.40699999999999997},{"interface":"front","average":{"1min":1.415,"5min":3.3410000000000002,"15min":2.5800000000000001},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.20999999999999999},"max":{"1min":5.1369999999999996,"5min":108.33499999999999,"15min":108.33499999999999},"last":0.39200000000000002}]},{"osd":1,"last update":"Sat Feb 10 08:35:18 2024","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.7490000000000001,"15min":1.8320000000000001},"min":{"1min":0.23100000000000001,"5min":0.224,"15min":0.20000000000000001},"max":{"1min":4.6479999999999997,"5min":8.7530000000000001,"15min":41.539999999999999},"last":0.434},{"interface":"front","average":{"1min":2.056,"5min":2.0760000000000001,"15min":1.9810000000000001},"min":{"1min":0.27200000000000002,"5min":0.25700000000000001,"15min":0.22700000000000001},"max":{"1min":9.3439999999999994,"5min":10.099,"15min":41.046999999999997},"last":0.41599999999999998}]},{"osd":2,"last update":"Sat Feb 10 08:35:18 2024","interfaces":[{"interface":"back","average":{"1min":2.6800000000000002,"5min":2.5019999999999998,"15min":1.9259999999999999},"min":{"1min":0.26500000000000001,"5min":0.25700000000000001,"15min":0.251},"max":{"1min":7.8159999999999998,"5min":36.308999999999997,"15min":36.308999999999997},"last":0.39800000000000002},{"interface":"front","average":{"1min":1.417,"5min":2.423,"15min":1.9319999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":5.8280000000000003,"5min":36.268000000000001,"15min":36.268000000000001},"last":0.35899999999999999}]},{"osd":3,"last update":"Sat Feb 10 08:35:18 2024","interfaces":[{"interface":"back","average":{"1min":1.4830000000000001,"5min":1.796,"15min":1.7410000000000001},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":4.2590000000000003,"5min":12.686,"15min":18.515000000000001},"last":0.377},{"interface":"front","average":{"1min":1.7150000000000001,"5min":2.141,"15min":1.9219999999999999},"min":{"1min":0.317,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":5.1289999999999996,"5min":10.960000000000001,"15min":10.960000000000001},"last":0.45100000000000001}]},{"osd":4,"last update":"Sat Feb 10 08:35:18 2024","interfaces":[{"interface":"back","average":{"1min":1.8620000000000001,"5min":1.8,"15min":1.276},"min":{"1min":0.254,"5min":0.23400000000000001,"15min":0.216},"max":{"1min":6.9050000000000002,"5min":12.574999999999999,"15min":12.574999999999999},"last":23.797999999999998},{"interface":"front","average":{"1min":1.4850000000000001,"5min":1.621,"15min":1.2330000000000001},"min":{"1min":0.28699999999999998,"5min":0.254,"15min":0.22700000000000001},"max":{"1min":6.1550000000000002,"5min":8.8170000000000002,"15min":12.987},"last":26.303000000000001}]},{"osd":5,"last update":"Sat Feb 10 08:35:18 2024","interfaces":[{"interface":"back","average":{"1min":1.6850000000000001,"5min":2.2170000000000001,"15min":1.6419999999999999},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.218},"max":{"1min":6.7839999999999998,"5min":12.882,"15min":15.304},"last":0.29399999999999998},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.8300000000000001,"15min":1.407},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":5.4359999999999999,"5min":13.129,"15min":13.129},"last":0.33500000000000002}]},{"osd":6,"last update":"Sat Feb 10 08:35:18 2024","interfaces":[{"interface":"back","average":{"1min":1.97,"5min":1.913,"15min":1.3160000000000001},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":5.3129999999999997,"5min":10.101000000000001,"15min":10.101000000000001},"last":0.36699999999999999},{"interface":"front","average":{"1min":2.2480000000000002,"5min":2.0459999999999998,"15min":1.361},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.224},"max":{"1min":5.4960000000000004,"5min":12.654,"15min":12.654},"last":0.34799999999999998}]}]},{"osd":6,"up_from":43,"seq":184683593960,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1702568,"kb_used_data":1397024,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":92042584,"statfs":{"total":95995035648,"available":94251606016,"internally_reserved":0,"allocated":1430552576,"data_stored":1430171240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:34:51 2024","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.879,"15min":2.1190000000000002},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.19400000000000001},"max":{"1min":4.0279999999999996,"5min":7.9909999999999997,"15min":30.509},"last":6.0949999999999998},{"interface":"front","average":{"1min":1.266,"5min":1.706,"15min":1.875},"min":{"1min":0.217,"5min":0.217,"15min":0.21099999999999999},"max":{"1min":8.1590000000000007,"5min":8.1590000000000007,"15min":36.090000000000003},"last":2.5299999999999998}]},{"osd":1,"last update":"Sat Feb 10 08:34:51 2024","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.728,"15min":1.655},"min":{"1min":0.23400000000000001,"5min":0.223,"15min":0.20899999999999999},"max":{"1min":6.2119999999999997,"5min":6.3780000000000001,"15min":12.938000000000001},"last":2.2629999999999999},{"interface":"front","average":{"1min":2.8730000000000002,"5min":2.2690000000000001,"15min":1.9219999999999999},"min":{"1min":0.309,"5min":0.215,"15min":0.215},"max":{"1min":11.976000000000001,"5min":11.976000000000001,"15min":11.976000000000001},"last":2.6469999999999998}]},{"osd":2,"last update":"Sat Feb 10 08:34:51 2024","interfaces":[{"interface":"back","average":{"1min":1.6419999999999999,"5min":2.0049999999999999,"15min":2.0800000000000001},"min":{"1min":0.33500000000000002,"5min":0.25900000000000001,"15min":0.24399999999999999},"max":{"1min":7.4989999999999997,"5min":8.923,"15min":35.072000000000003},"last":2.7010000000000001},{"interface":"front","average":{"1min":1.714,"5min":1.7230000000000001,"15min":1.9279999999999999},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23100000000000001},"max":{"1min":14.867000000000001,"5min":14.867000000000001,"15min":35.103000000000002},"last":2.6040000000000001}]},{"osd":3,"last update":"Sat Feb 10 08:34:51 2024","interfaces":[{"interface":"back","average":{"1min":7.2590000000000003,"5min":3.165,"15min":2.2349999999999999},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26600000000000001},"max":{"1min":103.94199999999999,"5min":103.94199999999999,"15min":103.94199999999999},"last":2.2829999999999999},{"interface":"front","average":{"1min":7.3819999999999997,"5min":3.1669999999999998,"15min":2.3119999999999998},"min":{"1min":0.32400000000000001,"5min":0.29099999999999998,"15min":0.253},"max":{"1min":103.79600000000001,"5min":103.79600000000001,"15min":103.79600000000001},"last":2.6779999999999999}]},{"osd":4,"last update":"Sat Feb 10 08:35:13 2024","interfaces":[{"interface":"back","average":{"1min":1.9430000000000001,"5min":1.7270000000000001,"15min":1.2170000000000001},"min":{"1min":0.28799999999999998,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":14.789,"5min":14.789,"15min":14.789},"last":2.5710000000000002},{"interface":"front","average":{"1min":0.996,"5min":1.6950000000000001,"15min":1.242},"min":{"1min":0.29799999999999999,"5min":0.26100000000000001,"15min":0.22600000000000001},"max":{"1min":3.7000000000000002,"5min":8.3140000000000001,"15min":10.348000000000001},"last":2.411}]},{"osd":5,"last update":"Sat Feb 10 08:34:51 2024","interfaces":[{"interface":"back","average":{"1min":1.7110000000000001,"5min":2.3759999999999999,"15min":1.494},"min":{"1min":0.29899999999999999,"5min":0.24099999999999999,"15min":0.20200000000000001},"max":{"1min":14.834,"5min":29.631,"15min":29.631},"last":5.7220000000000004},{"interface":"front","average":{"1min":1.3160000000000001,"5min":2.1040000000000001,"15min":1.399},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.22900000000000001},"max":{"1min":4.9630000000000001,"5min":29.419,"15min":29.419},"last":2.4390000000000001}]},{"osd":7,"last update":"Sat Feb 10 08:35:13 2024","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":2.0289999999999999,"15min":2.0390000000000001},"min":{"1min":0.35499999999999998,"5min":0.30599999999999999,"15min":0.23999999999999999},"max":{"1min":3.665,"5min":13.298999999999999,"15min":194.88900000000001},"last":2.7970000000000002},{"interface":"front","average":{"1min":1.294,"5min":2.0619999999999998,"15min":2.1419999999999999},"min":{"1min":0.36399999999999999,"5min":0.32600000000000001,"15min":0.28799999999999998},"max":{"1min":4.0350000000000001,"5min":14.128,"15min":194.74100000000001},"last":2.923}]}]},{"osd":1,"up_from":13,"seq":55834575103,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1192508,"kb_used_data":606900,"kb_used_omap":0,"kb_used_meta":585600,"kb_avail":92552644,"statfs":{"total":95995035648,"available":94773907456,"internally_reserved":0,"allocated":621465600,"data_stored":621063779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":599654400},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:34:53 2024","interfaces":[{"interface":"back","average":{"1min":1.8280000000000001,"5min":1.673,"15min":2.1360000000000001},"min":{"1min":0.23300000000000001,"5min":0.189,"15min":0.17100000000000001},"max":{"1min":5.9550000000000001,"5min":8.9510000000000005,"15min":29.763999999999999},"last":1.8120000000000001},{"interface":"front","average":{"1min":1.3779999999999999,"5min":1.7470000000000001,"15min":2.335},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.17899999999999999},"max":{"1min":5.9880000000000004,"5min":19.928999999999998,"15min":29.637},"last":1.667}]},{"osd":2,"last update":"Sat Feb 10 08:35:20 2024","interfaces":[{"interface":"back","average":{"1min":1.506,"5min":1.887,"15min":2.3639999999999999},"min":{"1min":0.23799999999999999,"5min":0.22,"15min":0.21199999999999999},"max":{"1min":4.0609999999999999,"5min":12.202,"15min":31.420999999999999},"last":1.8580000000000001},{"interface":"front","average":{"1min":1.5620000000000001,"5min":2.02,"15min":2.5950000000000002},"min":{"1min":0.28699999999999998,"5min":0.23400000000000001,"15min":0.184},"max":{"1min":4.6299999999999999,"5min":12.314,"15min":31.484999999999999},"last":1.956}]},{"osd":3,"last update":"Sat Feb 10 08:34:43 2024","interfaces":[{"interface":"back","average":{"1min":2.177,"5min":1.948,"15min":2.4729999999999999},"min":{"1min":0.29299999999999998,"5min":0.26400000000000001,"15min":0.247},"max":{"1min":6.4139999999999997,"5min":12.369999999999999,"15min":28.082000000000001},"last":0.318},{"interface":"front","average":{"1min":2.1589999999999998,"5min":1.9139999999999999,"15min":2.1259999999999999},"min":{"1min":0.374,"5min":0.24099999999999999,"15min":0.19600000000000001},"max":{"1min":7.3339999999999996,"5min":19.303999999999998,"15min":29.722000000000001},"last":0.35499999999999998}]},{"osd":4,"last update":"Sat Feb 10 08:35:15 2024","interfaces":[{"interface":"back","average":{"1min":1.5569999999999999,"5min":2.0070000000000001,"15min":1.9379999999999999},"min":{"1min":0.309,"5min":0.28599999999999998,"15min":0.26100000000000001},"max":{"1min":4.1619999999999999,"5min":23.218,"15min":23.218},"last":0.40200000000000002},{"interface":"front","average":{"1min":1.7989999999999999,"5min":1.9590000000000001,"15min":2.2210000000000001},"min":{"1min":0.32100000000000001,"5min":0.32000000000000001,"15min":0.25900000000000001},"max":{"1min":4.7169999999999996,"5min":23.274000000000001,"15min":31.515000000000001},"last":0.47199999999999998}]},{"osd":5,"last update":"Sat Feb 10 08:35:20 2024","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":2.0579999999999998,"15min":2.1309999999999998},"min":{"1min":0.33400000000000002,"5min":0.29699999999999999,"15min":0.26000000000000001},"max":{"1min":3.6970000000000001,"5min":21.751000000000001,"15min":40.140999999999998},"last":0.43099999999999999},{"interface":"front","average":{"1min":1.976,"5min":2.3079999999999998,"15min":2.4500000000000002},"min":{"1min":0.32200000000000001,"5min":0.317,"15min":0.28499999999999998},"max":{"1min":4.7350000000000003,"5min":16.324000000000002,"15min":40.831000000000003},"last":4.7889999999999997}]},{"osd":6,"last update":"Sat Feb 10 08:34:53 2024","interfaces":[{"interface":"back","average":{"1min":2.294,"5min":2.173,"15min":2.177},"min":{"1min":0.376,"5min":0.34599999999999997,"15min":0.30199999999999999},"max":{"1min":5.3609999999999998,"5min":26.071999999999999,"15min":31.27},"last":3.4500000000000002},{"interface":"front","average":{"1min":1.6040000000000001,"5min":1.915,"15min":1.768},"min":{"1min":0.371,"5min":0.29499999999999998,"15min":0.27700000000000002},"max":{"1min":5.5510000000000002,"5min":25.937000000000001,"15min":25.937000000000001},"last":3.4390000000000001}]},{"osd":7,"last update":"Sat Feb 10 08:35:20 2024","interfaces":[{"interface":"back","average":{"1min":2.1429999999999998,"5min":2.3599999999999999,"15min":2.302},"min":{"1min":0.41599999999999998,"5min":0.374,"15min":0.29099999999999998},"max":{"1min":4.7919999999999998,"5min":19.692,"15min":31.344999999999999},"last":2.1349999999999998},{"interface":"front","average":{"1min":1.573,"5min":2.0800000000000001,"15min":1.847},"min":{"1min":0.40999999999999998,"5min":0.32500000000000001,"15min":0.312},"max":{"1min":5.4569999999999999,"5min":15.91,"15min":15.91},"last":2.0209999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738628,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2573764,"kb_used_data":1979900,"kb_used_omap":0,"kb_used_meta":593792,"kb_avail":91171388,"statfs":{"total":95995035648,"available":93359501312,"internally_reserved":0,"allocated":2027417600,"data_stored":2027008062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":608043008},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 10 08:35:00 2024","interfaces":[{"interface":"back","average":{"1min":1.4279999999999999,"5min":1.516,"15min":2.6520000000000001},"min":{"1min":0.19800000000000001,"5min":0.16300000000000001,"15min":0.14399999999999999},"max":{"1min":5.2990000000000004,"5min":11.058,"15min":102.48099999999999},"last":0.20499999999999999},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.968,"15min":2.5800000000000001},"min":{"1min":0.215,"5min":0.19400000000000001,"15min":0.193},"max":{"1min":4.4640000000000004,"5min":15.550000000000001,"15min":103.38800000000001},"last":3.1970000000000001}]},{"osd":2,"last update":"Sat Feb 10 08:35:19 2024","interfaces":[{"interface":"back","average":{"1min":2.0270000000000001,"5min":2.5449999999999999,"15min":3.1160000000000001},"min":{"1min":0.23699999999999999,"5min":0.19700000000000001,"15min":0.192},"max":{"1min":10.002000000000001,"5min":21.331,"15min":102.462},"last":2.3260000000000001},{"interface":"front","average":{"1min":2.6640000000000001,"5min":1.6659999999999999,"15min":2.645},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":10.369,"5min":10.369,"15min":102.66500000000001},"last":2.6059999999999999}]},{"osd":3,"last update":"Sat Feb 10 08:34:40 2024","interfaces":[{"interface":"back","average":{"1min":2.444,"5min":1.976,"15min":2.327},"min":{"1min":0.246,"5min":0.23400000000000001,"15min":0.22600000000000001},"max":{"1min":9.8539999999999992,"5min":15.585000000000001,"15min":16.495000000000001},"last":4.1559999999999997},{"interface":"front","average":{"1min":1.6160000000000001,"5min":2.3159999999999998,"15min":2.891},"min":{"1min":0.25900000000000001,"5min":0.23000000000000001,"15min":0.222},"max":{"1min":5.2190000000000003,"5min":19.504000000000001,"15min":102.64400000000001},"last":2.3570000000000002}]},{"osd":4,"last update":"Sat Feb 10 08:35:08 2024","interfaces":[{"interface":"back","average":{"1min":1.8160000000000001,"5min":2.0950000000000002,"15min":2.5800000000000001},"min":{"1min":0.28199999999999997,"5min":0.26000000000000001,"15min":0.253},"max":{"1min":4.4100000000000001,"5min":19.359999999999999,"15min":102.742},"last":2.79},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.621,"15min":1.7050000000000001},"min":{"1min":0.30599999999999999,"5min":0.27000000000000002,"15min":0.26200000000000001},"max":{"1min":4.1429999999999998,"5min":15.343,"15min":16.352},"last":4.4729999999999999}]},{"osd":5,"last update":"Sat Feb 10 08:34:32 2024","interfaces":[{"interface":"back","average":{"1min":1.6220000000000001,"5min":1.8440000000000001,"15min":2.2240000000000002},"min":{"1min":0.30399999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":6.8719999999999999,"5min":17.321000000000002,"15min":102.53100000000001},"last":2.5720000000000001},{"interface":"front","average":{"1min":1.6870000000000001,"5min":1.849,"15min":1.8340000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.22500000000000001},"max":{"1min":6.1269999999999998,"5min":15.302,"15min":16.463999999999999},"last":3.6989999999999998}]},{"osd":6,"last update":"Sat Feb 10 08:35:00 2024","interfaces":[{"interface":"back","average":{"1min":2.2320000000000002,"5min":1.7929999999999999,"15min":2.302},"min":{"1min":0.36899999999999999,"5min":0.34599999999999997,"15min":0.28599999999999998},"max":{"1min":5.3739999999999997,"5min":7.0149999999999997,"15min":102.583},"last":2.5390000000000001},{"interface":"front","average":{"1min":1.7909999999999999,"5min":1.913,"15min":1.8320000000000001},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.308},"max":{"1min":4.9640000000000004,"5min":15.359,"15min":16.391999999999999},"last":4.3460000000000001}]},{"osd":7,"last update":"Sat Feb 10 08:35:19 2024","interfaces":[{"interface":"back","average":{"1min":2.2229999999999999,"5min":1.6719999999999999,"15min":3.0760000000000001},"min":{"1min":0.39600000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":5.6849999999999996,"5min":6.4889999999999999,"15min":255.53200000000001},"last":0.54500000000000004},{"interface":"front","average":{"1min":1.742,"5min":1.8520000000000001,"15min":2.6850000000000001},"min":{"1min":0.35699999999999998,"5min":0.34599999999999997,"15min":0.28599999999999998},"max":{"1min":4.4900000000000002,"5min":15.375999999999999,"15min":254.88800000000001},"last":4.383}]}]},{"osd":2,"up_from":18,"seq":77309411579,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1782704,"kb_used_data":1192936,"kb_used_omap":0,"kb_used_meta":589696,"kb_avail":91962448,"statfs":{"total":95995035648,"available":94169546752,"internally_reserved":0,"allocated":1221566464,"data_stored":1221176763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":603848704},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:35:23 2024","interfaces":[{"interface":"back","average":{"1min":1.4510000000000001,"5min":1.6259999999999999,"15min":2.0630000000000002},"min":{"1min":0.22600000000000001,"5min":0.19400000000000001,"15min":0.17399999999999999},"max":{"1min":7.6059999999999999,"5min":27.934999999999999,"15min":27.934999999999999},"last":0.19700000000000001},{"interface":"front","average":{"1min":2.794,"5min":2.3239999999999998,"15min":2.71},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":8.5350000000000001,"5min":15.15,"15min":28.295999999999999},"last":0.24399999999999999}]},{"osd":1,"last update":"Sat Feb 10 08:35:23 2024","interfaces":[{"interface":"back","average":{"1min":2.5209999999999999,"5min":1.8360000000000001,"15min":2.141},"min":{"1min":0.22900000000000001,"5min":0.20999999999999999,"15min":0.19700000000000001},"max":{"1min":6.1509999999999998,"5min":9.9469999999999992,"15min":15.644},"last":0.51900000000000002},{"interface":"front","average":{"1min":2.0419999999999998,"5min":1.456,"15min":1.6140000000000001},"min":{"1min":0.22,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":12.132999999999999,"5min":12.132999999999999,"15min":16.968},"last":0.39200000000000002}]},{"osd":3,"last update":"Sat Feb 10 08:34:47 2024","interfaces":[{"interface":"back","average":{"1min":1.484,"5min":1.762,"15min":2.145},"min":{"1min":0.29599999999999999,"5min":0.25,"15min":0.23300000000000001},"max":{"1min":4.3869999999999996,"5min":9.7870000000000008,"15min":24.946000000000002},"last":0.32900000000000001},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.4710000000000001,"15min":2.1760000000000002},"min":{"1min":0.25,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":8.6989999999999998,"5min":9.1150000000000002,"15min":24.905000000000001},"last":0.34799999999999998}]},{"osd":4,"last update":"Sat Feb 10 08:35:06 2024","interfaces":[{"interface":"back","average":{"1min":1.8129999999999999,"5min":1.881,"15min":1.8899999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":6.4459999999999997,"5min":10.573,"15min":13.260999999999999},"last":19.231000000000002},{"interface":"front","average":{"1min":0.97399999999999998,"5min":1.181,"15min":1.2789999999999999},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.25700000000000001},"max":{"1min":6.4720000000000004,"5min":6.4720000000000004,"15min":15.696},"last":19.256}]},{"osd":5,"last update":"Sat Feb 10 08:34:30 2024","interfaces":[{"interface":"back","average":{"1min":2.302,"5min":2.2530000000000001,"15min":2.0449999999999999},"min":{"1min":0.308,"5min":0.30299999999999999,"15min":0.26600000000000001},"max":{"1min":7.5700000000000003,"5min":13.201000000000001,"15min":13.939},"last":0.40600000000000003},{"interface":"front","average":{"1min":2.0329999999999999,"5min":2.1320000000000001,"15min":1.8879999999999999},"min":{"1min":0.38300000000000001,"5min":0.29199999999999998,"15min":0.28599999999999998},"max":{"1min":6.3440000000000003,"5min":9.5709999999999997,"15min":13.317},"last":0.377}]},{"osd":6,"last update":"Sat Feb 10 08:35:06 2024","interfaces":[{"interface":"back","average":{"1min":1.8149999999999999,"5min":2.125,"15min":2.0739999999999998},"min":{"1min":0.34100000000000003,"5min":0.32200000000000001,"15min":0.27300000000000002},"max":{"1min":5.3579999999999997,"5min":13.233000000000001,"15min":38.177999999999997},"last":20.815999999999999},{"interface":"front","average":{"1min":1.9239999999999999,"5min":2.0630000000000002,"15min":2.121},"min":{"1min":0.32500000000000001,"5min":0.32200000000000001,"15min":0.29099999999999998},"max":{"1min":4.3869999999999996,"5min":9.0879999999999992,"15min":37.682000000000002},"last":20.268999999999998}]},{"osd":7,"last update":"Sat Feb 10 08:35:23 2024","interfaces":[{"interface":"back","average":{"1min":2.2890000000000001,"5min":2.1349999999999998,"15min":1.9790000000000001},"min":{"1min":0.38,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":5.4509999999999996,"5min":9.6869999999999994,"15min":13.231999999999999},"last":0.43099999999999999},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.4650000000000001,"15min":1.484},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":3.9049999999999998,"5min":8.1110000000000007,"15min":15.714},"last":0.41899999999999998}]}]},{"osd":3,"up_from":25,"seq":107374182646,"num_pgs":62,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1598912,"kb_used_data":1005112,"kb_used_omap":0,"kb_used_meta":593792,"kb_avail":92146240,"statfs":{"total":95995035648,"available":94357749760,"internally_reserved":0,"allocated":1029234688,"data_stored":1028828354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":608043008},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:34:40 2024","interfaces":[{"interface":"back","average":{"1min":1.8400000000000001,"5min":2.4710000000000001,"15min":2.21},"min":{"1min":0.188,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":6.1150000000000002,"5min":66.605000000000004,"15min":66.605000000000004},"last":0.873},{"interface":"front","average":{"1min":1.5189999999999999,"5min":2.452,"15min":2.1829999999999998},"min":{"1min":0.27300000000000002,"5min":0.184,"15min":0.184},"max":{"1min":8.0749999999999993,"5min":66.828000000000003,"15min":66.828000000000003},"last":0.45700000000000002}]},{"osd":1,"last update":"Sat Feb 10 08:34:40 2024","interfaces":[{"interface":"back","average":{"1min":1.6120000000000001,"5min":2.0819999999999999,"15min":2.0680000000000001},"min":{"1min":0.187,"5min":0.187,"15min":0.187},"max":{"1min":6.0880000000000001,"5min":13.371,"15min":13.371},"last":0.41199999999999998},{"interface":"front","average":{"1min":1.994,"5min":2.1859999999999999,"15min":2.3069999999999999},"min":{"1min":0.23999999999999999,"5min":0.20599999999999999,"15min":0.191},"max":{"1min":6.2649999999999997,"5min":19.344000000000001,"15min":21.373999999999999},"last":0.76300000000000001}]},{"osd":2,"last update":"Sat Feb 10 08:34:40 2024","interfaces":[{"interface":"back","average":{"1min":1.962,"5min":2.8420000000000001,"15min":2.476},"min":{"1min":0.255,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":10.532999999999999,"5min":65.998999999999995,"15min":65.998999999999995},"last":0.34499999999999997},{"interface":"front","average":{"1min":1.5620000000000001,"5min":2.4129999999999998,"15min":2.165},"min":{"1min":0.27600000000000002,"5min":0.23400000000000001,"15min":0.215},"max":{"1min":8.0470000000000006,"5min":68.721000000000004,"15min":68.721000000000004},"last":1.329}]},{"osd":4,"last update":"Sat Feb 10 08:35:18 2024","interfaces":[{"interface":"back","average":{"1min":1.6299999999999999,"5min":1.4790000000000001,"15min":1.6100000000000001},"min":{"1min":0.313,"5min":0.29199999999999998,"15min":0.25900000000000001},"max":{"1min":8.1010000000000009,"5min":8.1010000000000009,"15min":12.272},"last":1.0660000000000001},{"interface":"front","average":{"1min":2.1789999999999998,"5min":1.772,"15min":1.978},"min":{"1min":0.34000000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":7.8849999999999998,"5min":10.754,"15min":12.391999999999999},"last":1.0760000000000001}]},{"osd":5,"last update":"Sat Feb 10 08:34:38 2024","interfaces":[{"interface":"back","average":{"1min":1.893,"5min":2.1549999999999998,"15min":1.73},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.249},"max":{"1min":8.7119999999999997,"5min":19.832000000000001,"15min":19.832000000000001},"last":0.48699999999999999},{"interface":"front","average":{"1min":1.627,"5min":2.0659999999999998,"15min":1.9359999999999999},"min":{"1min":0.33500000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":6.0430000000000001,"5min":19.712,"15min":19.712},"last":0.44900000000000001}]},{"osd":6,"last update":"Sat Feb 10 08:34:57 2024","interfaces":[{"interface":"back","average":{"1min":2.452,"5min":2.0339999999999998,"15min":1.9550000000000001},"min":{"1min":0.47599999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":7.976,"5min":16.423999999999999,"15min":16.423999999999999},"last":0.5},{"interface":"front","average":{"1min":1.54,"5min":1.944,"15min":1.681},"min":{"1min":0.375,"5min":0.35099999999999998,"15min":0.28499999999999998},"max":{"1min":7.9960000000000004,"5min":9.7010000000000005,"15min":12.324999999999999},"last":2.0299999999999998}]},{"osd":7,"last update":"Sat Feb 10 08:35:18 2024","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.619,"15min":1.7},"min":{"1min":0.41899999999999998,"5min":0.33500000000000002,"15min":0.28299999999999997},"max":{"1min":7.9470000000000001,"5min":7.9470000000000001,"15min":12.358000000000001},"last":4.2309999999999999},{"interface":"front","average":{"1min":1.956,"5min":2.0489999999999999,"15min":2.0659999999999998},"min":{"1min":0.38400000000000001,"5min":0.313,"15min":0.26500000000000001},"max":{"1min":5.0590000000000002,"5min":9.6720000000000006,"15min":15.702},"last":3.0070000000000001}]}]},{"osd":4,"up_from":110,"seq":472446402737,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2313516,"kb_used_data":1723108,"kb_used_omap":0,"kb_used_meta":590335,"kb_avail":91431636,"statfs":{"total":95995035648,"available":93625995264,"internally_reserved":0,"allocated":1764462592,"data_stored":1764069321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":972,"internal_metadata":604503092},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:34:25 2024","interfaces":[{"interface":"back","average":{"1min":2.036,"5min":1.4299999999999999,"15min":1.401},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.19800000000000001},"max":{"1min":7.3659999999999997,"5min":14.595000000000001,"15min":14.595000000000001},"last":0.251},{"interface":"front","average":{"1min":2.1680000000000001,"5min":1.911,"15min":2.2330000000000001},"min":{"1min":0.24299999999999999,"5min":0.23100000000000001,"15min":0.222},"max":{"1min":7.4009999999999998,"5min":14.446999999999999,"15min":16.524000000000001},"last":6.1230000000000002}]},{"osd":1,"last update":"Sat Feb 10 08:34:25 2024","interfaces":[{"interface":"back","average":{"1min":1.772,"5min":2.0680000000000001,"15min":1.903},"min":{"1min":0.27300000000000002,"5min":0.23899999999999999,"15min":0.218},"max":{"1min":6.3849999999999998,"5min":38.621000000000002,"15min":38.621000000000002},"last":1.3879999999999999},{"interface":"front","average":{"1min":1.605,"5min":1.976,"15min":1.804},"min":{"1min":0.32000000000000001,"5min":0.248,"15min":0.217},"max":{"1min":7.0209999999999999,"5min":38.430999999999997,"15min":38.430999999999997},"last":1.3819999999999999}]},{"osd":2,"last update":"Sat Feb 10 08:34:25 2024","interfaces":[{"interface":"back","average":{"1min":2.2090000000000001,"5min":1.9359999999999999,"15min":1.9199999999999999},"min":{"1min":0.28599999999999998,"5min":0.246,"15min":0.218},"max":{"1min":7.6699999999999999,"5min":14.414,"15min":14.414},"last":2.1110000000000002},{"interface":"front","average":{"1min":2.0430000000000001,"5min":1.819,"15min":1.78},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.247},"max":{"1min":6.8710000000000004,"5min":11.958,"15min":11.958},"last":0.307}]},{"osd":3,"last update":"Sat Feb 10 08:34:25 2024","interfaces":[{"interface":"back","average":{"1min":2.23,"5min":1.9470000000000001,"15min":1.9330000000000001},"min":{"1min":0.30099999999999999,"5min":0.27200000000000002,"15min":0.23200000000000001},"max":{"1min":5.6159999999999997,"5min":14.358000000000001,"15min":14.358000000000001},"last":1.198},{"interface":"front","average":{"1min":2.1269999999999998,"5min":2.0499999999999998,"15min":1.7330000000000001},"min":{"1min":0.32700000000000001,"5min":0.249,"15min":0.249},"max":{"1min":6.4020000000000001,"5min":8.3360000000000003,"15min":11.648},"last":0.48899999999999999}]},{"osd":5,"last update":"Sat Feb 10 08:34:25 2024","interfaces":[{"interface":"back","average":{"1min":2.4199999999999999,"5min":1.8029999999999999,"15min":1.254},"min":{"1min":0.247,"5min":0.247,"15min":0.21299999999999999},"max":{"1min":7.9560000000000004,"5min":20.355,"15min":41.488},"last":0.27900000000000003},{"interface":"front","average":{"1min":1.972,"5min":1.74,"15min":1.4359999999999999},"min":{"1min":0.29299999999999998,"5min":0.27200000000000002,"15min":0.23699999999999999},"max":{"1min":7.3920000000000003,"5min":16.350000000000001,"15min":42.527999999999999},"last":0.40600000000000003}]},{"osd":6,"last update":"Sat Feb 10 08:34:25 2024","interfaces":[{"interface":"back","average":{"1min":2.0459999999999998,"5min":1.6559999999999999,"15min":1.3360000000000001},"min":{"1min":0.29799999999999999,"5min":0.27400000000000002,"15min":0.26400000000000001},"max":{"1min":6.3600000000000003,"5min":8.2910000000000004,"15min":39.554000000000002},"last":0.33800000000000002},{"interface":"front","average":{"1min":2.2930000000000001,"5min":1.8740000000000001,"15min":1.3919999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":6.5220000000000002,"5min":11.342000000000001,"15min":41.741999999999997},"last":0.80100000000000005}]},{"osd":7,"last update":"Sat Feb 10 08:34:25 2024","interfaces":[{"interface":"back","average":{"1min":1.6220000000000001,"5min":1.843,"15min":1.3049999999999999},"min":{"1min":0.32200000000000001,"5min":0.29799999999999999,"15min":0.28899999999999998},"max":{"1min":6.3310000000000004,"5min":8.6289999999999996,"15min":11.047000000000001},"last":0.40100000000000002},{"interface":"front","average":{"1min":1.7450000000000001,"5min":1.8280000000000001,"15min":1.181},"min":{"1min":0.32100000000000001,"5min":0.29099999999999998,"15min":0.26300000000000001},"max":{"1min":7.9889999999999999,"5min":16.245999999999999,"15min":16.245999999999999},"last":0.73599999999999999}]}]},{"osd":5,"up_from":37,"seq":158913790189,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1924580,"kb_used_data":1025372,"kb_used_omap":0,"kb_used_meta":899200,"kb_avail":91820572,"statfs":{"total":95995035648,"available":94024265728,"internally_reserved":0,"allocated":1049980928,"data_stored":1049602837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":920780800},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:34:29 2024","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.427,"15min":1.6879999999999999},"min":{"1min":0.218,"5min":0.218,"15min":0.20499999999999999},"max":{"1min":4.7699999999999996,"5min":10.789,"15min":22.914000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":2.677,"5min":1.8959999999999999,"15min":1.706},"min":{"1min":0.23000000000000001,"5min":0.22900000000000001,"15min":0.21299999999999999},"max":{"1min":7.2050000000000001,"5min":13.738,"15min":23.161000000000001},"last":0.30499999999999999}]},{"osd":1,"last update":"Sat Feb 10 08:34:29 2024","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.7529999999999999,"15min":1.504},"min":{"1min":0.245,"5min":0.222,"15min":0.19500000000000001},"max":{"1min":4.3689999999999998,"5min":8.359,"15min":8.359},"last":8.5210000000000008},{"interface":"front","average":{"1min":2.4359999999999999,"5min":1.583,"15min":1.456},"min":{"1min":0.29099999999999998,"5min":0.27300000000000002,"15min":0.254},"max":{"1min":7.085,"5min":8.6899999999999995,"15min":9.0579999999999998},"last":0.38900000000000001}]},{"osd":2,"last update":"Sat Feb 10 08:34:29 2024","interfaces":[{"interface":"back","average":{"1min":2.02,"5min":1.9199999999999999,"15min":1.768},"min":{"1min":0.251,"5min":0.251,"15min":0.24099999999999999},"max":{"1min":4.4829999999999997,"5min":20.254999999999999,"15min":20.254999999999999},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.611,"5min":1.635,"15min":1.573},"min":{"1min":0.29599999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":5.1150000000000002,"5min":6.3929999999999998,"15min":9.2810000000000006},"last":0.41399999999999998}]},{"osd":3,"last update":"Sat Feb 10 08:34:29 2024","interfaces":[{"interface":"back","average":{"1min":1.8460000000000001,"5min":1.5409999999999999,"15min":1.464},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.26100000000000001},"max":{"1min":7.234,"5min":8.0079999999999991,"15min":24.198},"last":0.92300000000000004},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.534,"15min":1.6739999999999999},"min":{"1min":0.309,"5min":0.27300000000000002,"15min":0.25900000000000001},"max":{"1min":4.2919999999999998,"5min":10.766,"15min":22.701000000000001},"last":1.03}]},{"osd":4,"last update":"Sat Feb 10 08:35:14 2024","interfaces":[{"interface":"back","average":{"1min":1.554,"5min":1.4490000000000001,"15min":1.1479999999999999},"min":{"1min":0.26500000000000001,"5min":0.223,"15min":0.223},"max":{"1min":4.7290000000000001,"5min":7.923,"15min":7.923},"last":0.89100000000000001},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.5069999999999999,"15min":1.1679999999999999},"min":{"1min":0.28999999999999998,"5min":0.254,"15min":0.22500000000000001},"max":{"1min":5.4169999999999998,"5min":12.948,"15min":12.948},"last":0.33900000000000002}]},{"osd":6,"last update":"Sat Feb 10 08:34:58 2024","interfaces":[{"interface":"back","average":{"1min":2.355,"5min":1.482,"15min":1.1819999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.23100000000000001},"max":{"1min":7.2779999999999996,"5min":7.2779999999999996,"15min":8.3559999999999999},"last":0.42299999999999999},{"interface":"front","average":{"1min":1.361,"5min":1.3799999999999999,"15min":1.1240000000000001},"min":{"1min":0.32100000000000001,"5min":0.27800000000000002,"15min":0.23999999999999999},"max":{"1min":4.6340000000000003,"5min":7.875,"15min":7.875},"last":0.79300000000000004}]},{"osd":7,"last update":"Sat Feb 10 08:34:26 2024","interfaces":[{"interface":"back","average":{"1min":1.7789999999999999,"5min":1.5329999999999999,"15min":2.274},"min":{"1min":0.30499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":7.2599999999999998,"5min":7.952,"15min":371.87400000000002},"last":0.58999999999999997},{"interface":"front","average":{"1min":1.157,"5min":1.631,"15min":2.4260000000000002},"min":{"1min":0.32800000000000001,"5min":0.318,"15min":0.23499999999999999},"max":{"1min":5.2089999999999996,"5min":12.984999999999999,"15min":372.63099999999997},"last":0.44500000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2021855232,"data_stored":2021851160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":617676800,"data_stored":617676800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1217789952,"data_stored":1217789952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1021050880,"data_stored":1021050880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1736052736,"data_stored":1736048664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1036124160,"data_stored":1036124160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1428099072,"data_stored":1428095000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":815202304,"data_stored":815202304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-10T08:35:32.754 INFO:tasks.thrashosds.thrasher:Setting 6.0 to [4, 5, 7, 0, 2, 1] 2024-02-10T08:35:32.755 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '6.0', '4', '5', '7', '0', '2', '1'] 2024-02-10T08:35:32.755 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd pg-upmap-items 6.0 4 5 7 0 2 1 2024-02-10T08:35:32.756 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:32.756 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:35:32.757 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:35:32.858 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:35:32.909 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:32.943 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:35:32.949 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:32.949 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:35:33.000 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd set nodeep-scrub 2024-02-10T08:35:33.050 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:35:33.149 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:33.190 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:35:33.196 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:33.196 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:35:33.297 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:35:33.340 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:33.376 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:35:33.380 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:33.380 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:35:33.481 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:35:33.515 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:33.541 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:35:33.543 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:33.544 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:35:33.645 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:35:33.696 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:33.730 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:35:33.733 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:33.734 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:35:33.834 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:35:33.870 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:34.142 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:35:34.144 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:35:34.146 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:35:34.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:33.034186+0000 mgr.y (mgr.14505) 706 : cluster [DBG] pgmap v870: 168 pgs: 1 active+clean+scrubbing+deep, 167 active+clean; 2.9 GiB data, 14 GiB used, 702 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.01k op/s 2024-02-10T08:35:34.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:33.034186+0000 mgr.y (mgr.14505) 706 : cluster [DBG] pgmap v870: 168 pgs: 1 active+clean+scrubbing+deep, 167 active+clean; 2.9 GiB data, 14 GiB used, 702 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.01k op/s 2024-02-10T08:35:34.227 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:35:34.264 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:35:34.300 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:35:34.325 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:35:34.355 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:35:34.385 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:35:34.422 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:35:34.452 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:35:34.454 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-10T08:35:34.454 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-10T08:35:34.454 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-10T08:35:34.454 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-10T08:35:34.454 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-10T08:35:34.454 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-10T08:35:34.454 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-10T08:35:34.454 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-10T08:35:34.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:33.034186+0000 mgr.y (mgr.14505) 706 : cluster [DBG] pgmap v870: 168 pgs: 1 active+clean+scrubbing+deep, 167 active+clean; 2.9 GiB data, 14 GiB used, 702 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.01k op/s 2024-02-10T08:35:34.859 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:35:34.864 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:34.865 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:35:34.965 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:35:35.028 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:35.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:35:34.179433+0000 mon.a (mon.0) 1621 : audit [DBG] from='client.? 172.21.15.18:0/3403973394' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:35:35.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:35:34.179433+0000 mon.a (mon.0) 1621 : audit [DBG] from='client.? 172.21.15.18:0/3403973394' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:35:35.251 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:35:35.258 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:35.259 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:35:35.359 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:35:35.409 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:35.416 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:35:34.179433+0000 mon.a (mon.0) 1621 : audit [DBG] from='client.? 172.21.15.18:0/3403973394' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:35:35.437 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:35:35.440 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:35.441 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:35:35.542 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:35:35.592 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:35.633 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:35:35.635 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:35.635 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:35:35.736 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:35:35.783 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:36.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:35.036241+0000 mgr.y (mgr.14505) 707 : cluster [DBG] pgmap v871: 168 pgs: 1 active+clean+scrubbing+deep, 167 active+clean; 2.8 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 912 op/s 2024-02-10T08:35:36.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:35.036241+0000 mgr.y (mgr.14505) 707 : cluster [DBG] pgmap v871: 168 pgs: 1 active+clean+scrubbing+deep, 167 active+clean; 2.8 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 912 op/s 2024-02-10T08:35:36.520 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:35.036241+0000 mgr.y (mgr.14505) 707 : cluster [DBG] pgmap v871: 168 pgs: 1 active+clean+scrubbing+deep, 167 active+clean; 2.8 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 912 op/s 2024-02-10T08:35:36.789 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:35:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:35:36] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:35:37.404 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:35:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:35:37] "GET /metrics HTTP/1.1" 200 176436 "" "Prometheus/2.33.4" 2024-02-10T08:35:37.574 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:35:37.579 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:37.580 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:35:37.681 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:35:37.736 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:37.783 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:35:37.790 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:37.790 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:35:37.891 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:35:37.952 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:38.249 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:37.036658+0000 mgr.y (mgr.14505) 708 : cluster [DBG] pgmap v872: 168 pgs: 1 active+clean+scrubbing+deep, 167 active+clean; 2.8 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 915 op/s 2024-02-10T08:35:38.250 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:37.036658+0000 mgr.y (mgr.14505) 708 : cluster [DBG] pgmap v872: 168 pgs: 1 active+clean+scrubbing+deep, 167 active+clean; 2.8 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 915 op/s 2024-02-10T08:35:38.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:37.036658+0000 mgr.y (mgr.14505) 708 : cluster [DBG] pgmap v872: 168 pgs: 1 active+clean+scrubbing+deep, 167 active+clean; 2.8 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 915 op/s 2024-02-10T08:35:39.039 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:35:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:35:39.397 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:37.497679+0000 osd.4 (osd.4) 143 : cluster [DBG] 10.1 deep-scrub ok 2024-02-10T08:35:39.399 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:37.497679+0000 osd.4 (osd.4) 143 : cluster [DBG] 10.1 deep-scrub ok 2024-02-10T08:35:39.542 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:37.497679+0000 osd.4 (osd.4) 143 : cluster [DBG] 10.1 deep-scrub ok 2024-02-10T08:35:39.569 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-10T08:35:39.968 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:35:39.973 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:39.974 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:35:40.075 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:35:40.141 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:40.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:35:38.688536+0000 mgr.y (mgr.14505) 709 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:35:40.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:39.037418+0000 mgr.y (mgr.14505) 710 : cluster [DBG] pgmap v873: 168 pgs: 1 active+clean+scrubbing+deep, 167 active+clean; 2.5 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 1020 B/s rd, 0 B/s wr, 916 op/s 2024-02-10T08:35:40.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:35:38.688536+0000 mgr.y (mgr.14505) 709 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:35:40.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:39.037418+0000 mgr.y (mgr.14505) 710 : cluster [DBG] pgmap v873: 168 pgs: 1 active+clean+scrubbing+deep, 167 active+clean; 2.5 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 1020 B/s rd, 0 B/s wr, 916 op/s 2024-02-10T08:35:40.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:35:38.688536+0000 mgr.y (mgr.14505) 709 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:35:40.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:39.037418+0000 mgr.y (mgr.14505) 710 : cluster [DBG] pgmap v873: 168 pgs: 1 active+clean+scrubbing+deep, 167 active+clean; 2.5 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 1020 B/s rd, 0 B/s wr, 916 op/s 2024-02-10T08:35:41.008 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:35:41.014 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:41.014 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:35:41.115 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:35:41.152 INFO:teuthology.orchestra.run.smithi018.stderr:set 6.0 pg_upmap_items mapping to [4->5,7->0,2->1] 2024-02-10T08:35:41.184 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:41.240 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:35:41.244 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:41.244 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:35:41.345 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:35:41.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:35:40.465351+0000 mon.b (mon.1) 85 : audit [INF] from='client.? 172.21.15.18:0/386473690' entity='client.admin' cmd=[{"prefix": "osd pg-upmap-items", "pgid": "6.0", "id": [4, 5, 7, 0, 2, 1]}]: dispatch 2024-02-10T08:35:41.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:35:40.465862+0000 mon.a (mon.0) 1622 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pg-upmap-items", "pgid": "6.0", "id": [4, 5, 7, 0, 2, 1]}]: dispatch 2024-02-10T08:35:41.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:35:40.465351+0000 mon.b (mon.1) 85 : audit [INF] from='client.? 172.21.15.18:0/386473690' entity='client.admin' cmd=[{"prefix": "osd pg-upmap-items", "pgid": "6.0", "id": [4, 5, 7, 0, 2, 1]}]: dispatch 2024-02-10T08:35:41.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:35:40.465862+0000 mon.a (mon.0) 1622 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pg-upmap-items", "pgid": "6.0", "id": [4, 5, 7, 0, 2, 1]}]: dispatch 2024-02-10T08:35:41.406 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:41 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:35:40.465351+0000 mon.b (mon.1) 85 : audit [INF] from='client.? 172.21.15.18:0/386473690' entity='client.admin' cmd=[{"prefix": "osd pg-upmap-items", "pgid": "6.0", "id": [4, 5, 7, 0, 2, 1]}]: dispatch 2024-02-10T08:35:41.406 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:41 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:35:40.465862+0000 mon.a (mon.0) 1622 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pg-upmap-items", "pgid": "6.0", "id": [4, 5, 7, 0, 2, 1]}]: dispatch 2024-02-10T08:35:41.408 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:41.439 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:35:41.448 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:41.449 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:35:41.549 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:35:41.609 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:41.752 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:35:41.759 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:41.760 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:35:41.861 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:35:41.912 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:41.948 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:35:41.957 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:41.958 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:35:42.059 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:35:42.114 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:42.157 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:35:42.162 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:41.038593+0000 mgr.y (mgr.14505) 711 : cluster [DBG] pgmap v874: 168 pgs: 168 active+clean; 2.5 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 853 op/s 2024-02-10T08:35:42.162 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:35:41.139526+0000 mon.a (mon.0) 1623 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pg-upmap-items", "pgid": "6.0", "id": [4, 5, 7, 0, 2, 1]}]': finished 2024-02-10T08:35:42.162 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:41.139612+0000 mon.a (mon.0) 1624 : cluster [DBG] osdmap e384: 8 total, 8 up, 8 in 2024-02-10T08:35:42.162 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:42.163 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:35:42.263 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:35:42.349 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:42.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:41.038593+0000 mgr.y (mgr.14505) 711 : cluster [DBG] pgmap v874: 168 pgs: 168 active+clean; 2.5 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 853 op/s 2024-02-10T08:35:42.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:35:41.139526+0000 mon.a (mon.0) 1623 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pg-upmap-items", "pgid": "6.0", "id": [4, 5, 7, 0, 2, 1]}]': finished 2024-02-10T08:35:42.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:41.139612+0000 mon.a (mon.0) 1624 : cluster [DBG] osdmap e384: 8 total, 8 up, 8 in 2024-02-10T08:35:42.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:41.038593+0000 mgr.y (mgr.14505) 711 : cluster [DBG] pgmap v874: 168 pgs: 168 active+clean; 2.5 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 853 op/s 2024-02-10T08:35:42.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:35:41.139526+0000 mon.a (mon.0) 1623 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pg-upmap-items", "pgid": "6.0", "id": [4, 5, 7, 0, 2, 1]}]': finished 2024-02-10T08:35:42.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:41.139612+0000 mon.a (mon.0) 1624 : cluster [DBG] osdmap e384: 8 total, 8 up, 8 in 2024-02-10T08:35:43.110 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:35:43.119 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:43.119 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:35:43.220 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:35:43.277 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:43.313 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:43.313 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:35:43.313 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:35:43.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:35:43.043822+0000 mon.b (mon.1) 86 : audit [INF] from='client.? 172.21.15.18:0/623726647' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:35:43.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:35:43.044271+0000 mon.a (mon.0) 1625 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:35:43.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:35:43.043822+0000 mon.b (mon.1) 86 : audit [INF] from='client.? 172.21.15.18:0/623726647' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:35:43.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:35:43.044271+0000 mon.a (mon.0) 1625 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:35:43.414 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:35:43.464 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:43.465 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:43 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:35:43.043822+0000 mon.b (mon.1) 86 : audit [INF] from='client.? 172.21.15.18:0/623726647' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:35:43.465 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:43 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:35:43.044271+0000 mon.a (mon.0) 1625 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:35:43.492 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:35:43.496 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:43.496 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:35:43.597 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:35:43.656 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:43.738 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is set 2024-02-10T08:35:43.979 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:35:44.321 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:35:44.326 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:44.326 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:35:44.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:43.040324+0000 mgr.y (mgr.14505) 712 : cluster [DBG] pgmap v876: 168 pgs: 168 active+clean; 2.3 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 999 op/s 2024-02-10T08:35:44.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:43.140313+0000 mon.a (mon.0) 1626 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:35:44.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:35:43.158370+0000 mon.a (mon.0) 1627 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-10T08:35:44.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:43.158440+0000 mon.a (mon.0) 1628 : cluster [DBG] osdmap e385: 8 total, 8 up, 8 in 2024-02-10T08:35:44.407 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:43.040324+0000 mgr.y (mgr.14505) 712 : cluster [DBG] pgmap v876: 168 pgs: 168 active+clean; 2.3 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 999 op/s 2024-02-10T08:35:44.407 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:43.140313+0000 mon.a (mon.0) 1626 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:35:44.407 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:35:43.158370+0000 mon.a (mon.0) 1627 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-10T08:35:44.408 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:43.158440+0000 mon.a (mon.0) 1628 : cluster [DBG] osdmap e385: 8 total, 8 up, 8 in 2024-02-10T08:35:44.427 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:35:44.469 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:44 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:43.040324+0000 mgr.y (mgr.14505) 712 : cluster [DBG] pgmap v876: 168 pgs: 168 active+clean; 2.3 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 999 op/s 2024-02-10T08:35:44.469 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:44 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:43.140313+0000 mon.a (mon.0) 1626 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:35:44.469 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:44 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:35:43.158370+0000 mon.a (mon.0) 1627 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-10T08:35:44.469 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:44 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:43.158440+0000 mon.a (mon.0) 1628 : cluster [DBG] osdmap e385: 8 total, 8 up, 8 in 2024-02-10T08:35:44.474 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:44.523 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:35:44.529 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:44.529 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:35:44.630 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:35:44.671 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:44.699 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:35:44.703 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:44.704 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:35:44.805 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:35:44.857 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:44.889 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:35:44.895 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:44.896 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:35:44.997 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:35:45.066 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:45.147 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-02-10T08:35:45.147 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-02-10T08:35:45.147 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:45.148 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.25369.0:214428 10.4 10:2b78473d:::benchmark_data_smithi018_146618_object90625:head [delete] snapc 0=[] ondisk+write+known_if_redirected e385)", 2024-02-10T08:35:45.148 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:35:44.751481+0000", 2024-02-10T08:35:45.148 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.004536259, 2024-02-10T08:35:45.148 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0045732699999999999, 2024-02-10T08:35:45.148 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:35:45.148 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "waiting for sub ops", 2024-02-10T08:35:45.148 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:35:45.148 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.25369", 2024-02-10T08:35:45.148 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/3974730810", 2024-02-10T08:35:45.148 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 214428 2024-02-10T08:35:45.148 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:45.148 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:35:45.148 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:45.148 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:35:45.149 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:44.751481+0000", 2024-02-10T08:35:45.149 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:35:45.149 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:45.149 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:45.149 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:35:45.149 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:44.751481+0000", 2024-02-10T08:35:45.149 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999981 2024-02-10T08:35:45.149 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:45.149 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:45.149 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:35:45.149 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:44.751479+0000", 2024-02-10T08:35:45.149 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9379999999999992e-06 2024-02-10T08:35:45.149 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:45.149 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:45.150 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:35:45.150 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:44.751487+0000", 2024-02-10T08:35:45.150 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3263e-05 2024-02-10T08:35:45.150 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:45.150 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:45.150 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:35:45.150 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:44.751501+0000", 2024-02-10T08:35:45.150 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2119999999999992e-06 2024-02-10T08:35:45.150 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:45.150 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:45.150 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:35:45.150 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:44.751510+0000", 2024-02-10T08:35:45.150 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3553999999999997e-05 2024-02-10T08:35:45.150 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:45.150 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:45.151 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:35:45.151 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:44.751553+0000", 2024-02-10T08:35:45.151 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012449499999999999 2024-02-10T08:35:45.151 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:45.151 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:45.151 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:35:45.151 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:44.751678+0000", 2024-02-10T08:35:45.151 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010558800000000001 2024-02-10T08:35:45.151 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:45.151 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:45.151 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,4", 2024-02-10T08:35:45.151 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:44.751783+0000", 2024-02-10T08:35:45.151 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00030209099999999999 2024-02-10T08:35:45.151 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:35:45.151 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:35:45.152 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:35:45.152 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:45.152 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:45.152 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.25369.0:214421 10.5 e385/335 10:a1dd50c8:::benchmark_data_smithi018_146618_object90618:head v 385'13116, mlcod=385'13114)", 2024-02-10T08:35:45.152 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:35:44.751688+0000", 2024-02-10T08:35:45.152 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.0043291919999999999, 2024-02-10T08:35:45.152 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0044596219999999999, 2024-02-10T08:35:45.152 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:35:45.152 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-02-10T08:35:45.152 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:35:45.152 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:45.156 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:35:45.156 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:44.751688+0000", 2024-02-10T08:35:45.156 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:35:45.156 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:45.156 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:45.157 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:35:45.157 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:44.751688+0000", 2024-02-10T08:35:45.157 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:35:45.157 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:45.157 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:45.157 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:35:45.157 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:44.751688+0000", 2024-02-10T08:35:45.157 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2300000000000002e-06 2024-02-10T08:35:45.157 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:45.157 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:45.157 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:35:45.157 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:44.751695+0000", 2024-02-10T08:35:45.157 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6320000000000003e-06 2024-02-10T08:35:45.157 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:45.157 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:45.158 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:35:45.158 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:44.751704+0000", 2024-02-10T08:35:45.158 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0379999999999996e-06 2024-02-10T08:35:45.158 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:45.158 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:45.158 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:35:45.158 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:44.751710+0000", 2024-02-10T08:35:45.158 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6019000000000002e-05 2024-02-10T08:35:45.158 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:45.158 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:45.158 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:35:45.158 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:44.751747+0000", 2024-02-10T08:35:45.158 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.753e-05 2024-02-10T08:35:45.158 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:45.158 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:45.159 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:35:45.159 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:44.751764+0000", 2024-02-10T08:35:45.159 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5698999999999995e-05 2024-02-10T08:35:45.159 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:35:45.159 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:35:45.159 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:35:45.159 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:45.159 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:45.159 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.25369.0:214425 10.a e385/339 10:59b14d19:::benchmark_data_smithi018_146618_object90622:head v 385'13246, mlcod=385'13241)", 2024-02-10T08:35:45.159 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:35:44.753318+0000", 2024-02-10T08:35:45.159 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.0026995420000000001, 2024-02-10T08:35:45.159 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0029044790000000002, 2024-02-10T08:35:45.159 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:35:45.159 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-02-10T08:35:45.160 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:35:45.160 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:45.160 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:35:45.160 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:44.753318+0000", 2024-02-10T08:35:45.160 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:35:45.160 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:45.160 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:45.160 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:35:45.160 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:44.753318+0000", 2024-02-10T08:35:45.160 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:35:45.160 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:45.160 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:45.160 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:35:45.160 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:44.753317+0000", 2024-02-10T08:35:45.160 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.994e-06 2024-02-10T08:35:45.161 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:45.161 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:45.161 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:35:45.161 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:44.753325+0000", 2024-02-10T08:35:45.161 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0173999999999999e-05 2024-02-10T08:35:45.161 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:45.161 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:45.161 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:35:45.161 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:44.753335+0000", 2024-02-10T08:35:45.161 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7980000000000002e-06 2024-02-10T08:35:45.161 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:45.161 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:45.161 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:35:45.161 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:44.753341+0000", 2024-02-10T08:35:45.161 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010111499999999999 2024-02-10T08:35:45.162 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:45.162 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:45.162 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:35:45.162 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:44.754352+0000", 2024-02-10T08:35:45.162 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9313999999999998e-05 2024-02-10T08:35:45.162 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:45.162 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:45.162 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:35:45.162 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:44.754372+0000", 2024-02-10T08:35:45.162 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00105361 2024-02-10T08:35:45.162 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:35:45.162 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:35:45.162 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:35:45.162 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:45.162 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:45.162 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.25369.0:214427 10.d e385/364 10:b0795d47:::benchmark_data_smithi018_146618_object90624:head v 385'13285, mlcod=385'13282)", 2024-02-10T08:35:45.163 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:35:44.755030+0000", 2024-02-10T08:35:45.163 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.00098769999999999999, 2024-02-10T08:35:45.163 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001283633, 2024-02-10T08:35:45.163 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:35:45.163 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-02-10T08:35:45.163 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:35:45.163 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:45.163 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:35:45.163 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:44.755030+0000", 2024-02-10T08:35:45.163 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:35:45.163 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:45.163 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:45.163 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:35:45.163 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:44.755030+0000", 2024-02-10T08:35:45.163 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:35:45.164 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:45.164 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:45.164 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:35:45.164 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:44.755029+0000", 2024-02-10T08:35:45.164 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0681e-05 2024-02-10T08:35:45.164 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:45.164 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:45.164 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:35:45.164 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:44.755040+0000", 2024-02-10T08:35:45.164 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0451999999999999e-05 2024-02-10T08:35:45.164 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:45.164 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:45.164 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:35:45.164 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:44.755050+0000", 2024-02-10T08:35:45.165 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2489999999999998e-06 2024-02-10T08:35:45.165 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:45.165 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:45.165 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:35:45.165 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:44.755057+0000", 2024-02-10T08:35:45.165 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5844000000000001e-05 2024-02-10T08:35:45.165 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:45.165 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:45.165 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:35:45.165 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:44.755132+0000", 2024-02-10T08:35:45.165 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2525e-05 2024-02-10T08:35:45.166 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:45.166 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:45.166 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:35:45.166 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:44.755145+0000", 2024-02-10T08:35:45.167 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011514999999999999 2024-02-10T08:35:45.167 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:35:45.167 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:35:45.167 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:35:45.167 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:45.167 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:45.167 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.25369.0:214429 10.d e385/364)", 2024-02-10T08:35:45.167 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:35:44.755069+0000", 2024-02-10T08:35:45.167 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.00094841299999999995, 2024-02-10T08:35:45.168 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001296579, 2024-02-10T08:35:45.168 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:35:45.168 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "queued for pg", 2024-02-10T08:35:45.168 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:35:45.168 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:45.168 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:35:45.168 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:44.755069+0000", 2024-02-10T08:35:45.168 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:35:45.168 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:45.168 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:45.168 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:35:45.168 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:44.755069+0000", 2024-02-10T08:35:45.168 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:35:45.168 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:45.169 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:45.169 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:35:45.169 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:44.755069+0000", 2024-02-10T08:35:45.169 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7400000000000004e-06 2024-02-10T08:35:45.169 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:45.169 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:45.169 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:35:45.169 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:44.755073+0000", 2024-02-10T08:35:45.169 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2279999999999998e-06 2024-02-10T08:35:45.169 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:45.169 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:45.169 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:35:45.169 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:44.755079+0000", 2024-02-10T08:35:45.169 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.963e-06 2024-02-10T08:35:45.169 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:45.170 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:45.170 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:35:45.170 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:44.755083+0000", 2024-02-10T08:35:45.170 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3541e-05 2024-02-10T08:35:45.170 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:35:45.170 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:35:45.170 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:35:45.170 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:45.170 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:45.170 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.25369.0:214430 10.b e385/335 10:d88e7b56:::benchmark_data_smithi018_146618_object90627:head v 385'13341, mlcod=385'13338)", 2024-02-10T08:35:45.170 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:35:44.755276+0000", 2024-02-10T08:35:45.170 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.00074170599999999996, 2024-02-10T08:35:45.170 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0011200610000000001, 2024-02-10T08:35:45.170 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:35:45.170 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-02-10T08:35:45.171 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:35:45.171 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:45.171 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:35:45.171 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:44.755276+0000", 2024-02-10T08:35:45.171 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:35:45.171 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:45.171 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:45.171 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:35:45.171 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:44.755276+0000", 2024-02-10T08:35:45.171 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:35:45.171 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:45.171 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:45.171 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:35:45.171 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:44.755275+0000", 2024-02-10T08:35:45.171 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.34e-06 2024-02-10T08:35:45.172 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:45.172 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:45.172 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:35:45.172 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:44.755282+0000", 2024-02-10T08:35:45.172 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0655999999999999e-05 2024-02-10T08:35:45.172 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:45.172 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:45.172 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:35:45.172 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:44.755293+0000", 2024-02-10T08:35:45.172 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.489e-06 2024-02-10T08:35:45.172 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:45.172 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:45.172 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:35:45.172 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:44.755300+0000", 2024-02-10T08:35:45.172 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8080999999999997e-05 2024-02-10T08:35:45.173 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:45.173 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:45.173 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:35:45.173 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:44.755338+0000", 2024-02-10T08:35:45.173 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7186000000000001e-05 2024-02-10T08:35:45.173 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:45.173 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:45.173 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:35:45.173 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:44.755355+0000", 2024-02-10T08:35:45.173 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9058000000000001e-05 2024-02-10T08:35:45.173 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:35:45.173 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:35:45.173 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:35:45.173 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:45.173 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:45.174 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.25369.0:214432 10.2 e385/335)", 2024-02-10T08:35:45.174 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:35:44.755454+0000", 2024-02-10T08:35:45.174 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.00056311499999999999, 2024-02-10T08:35:45.174 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00097503900000000003, 2024-02-10T08:35:45.174 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:35:45.174 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "queued for pg", 2024-02-10T08:35:45.174 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:35:45.174 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:45.174 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:35:45.174 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:44.755454+0000", 2024-02-10T08:35:45.174 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:35:45.174 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:45.174 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:45.174 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:35:45.174 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:44.755454+0000", 2024-02-10T08:35:45.175 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:35:45.175 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:45.175 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:45.175 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:35:45.175 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:44.755454+0000", 2024-02-10T08:35:45.175 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.221e-06 2024-02-10T08:35:45.175 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:45.175 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:45.175 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:35:45.175 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:44.755461+0000", 2024-02-10T08:35:45.175 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5920000000000007e-06 2024-02-10T08:35:45.175 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:45.175 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:45.175 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:35:45.175 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:44.755470+0000", 2024-02-10T08:35:45.176 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0970000000000002e-06 2024-02-10T08:35:45.176 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:35:45.176 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:35:45.176 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:35:45.176 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:44.755477+0000", 2024-02-10T08:35:45.176 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2149000000000001e-05 2024-02-10T08:35:45.176 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:35:45.176 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:35:45.176 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:35:45.176 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:35:45.176 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-02-10T08:35:45.176 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 7 2024-02-10T08:35:45.176 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-02-10T08:35:46.038 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:35:46.040 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:46.041 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:35:46.069 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.0 dump_blocked_ops 2024-02-10T08:35:46.142 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:35:46.257 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:46.327 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:35:46.333 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:46.333 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:35:46.338 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:45.044571+0000 mgr.y (mgr.14505) 713 : cluster [DBG] pgmap v878: 168 pgs: 168 active+clean; 2.1 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.28k op/s 2024-02-10T08:35:46.339 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:45.044571+0000 mgr.y (mgr.14505) 713 : cluster [DBG] pgmap v878: 168 pgs: 168 active+clean; 2.1 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.28k op/s 2024-02-10T08:35:46.434 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:35:46.481 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:45.044571+0000 mgr.y (mgr.14505) 713 : cluster [DBG] pgmap v878: 168 pgs: 168 active+clean; 2.1 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.28k op/s 2024-02-10T08:35:46.485 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:46.526 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:35:46.529 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:46.529 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:35:46.630 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:35:46.702 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:46.789 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:35:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:35:46] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:35:46.983 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:35:46.986 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:46.986 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:35:46.995 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd unset noscrub 2024-02-10T08:35:47.042 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:35:47.087 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:35:47.123 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:47.149 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:35:47.157 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:47.158 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:35:47.259 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:35:47.324 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:35:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:35:47] "GET /metrics HTTP/1.1" 200 176443 "" "Prometheus/2.33.4" 2024-02-10T08:35:47.336 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:47.728 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:35:47.731 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:47.731 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:35:47.832 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:35:47.876 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:47.905 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:35:47.913 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:47.914 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:35:47.986 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 3, 4, 5, 6, 7, 0] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 5, 6, 7, 4] 2024-02-10T08:35:47.986 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-10T08:35:47.987 INFO:tasks.thrashosds.thrasher:Shrinking pool iscsi 2024-02-10T08:35:47.987 INFO:tasks.cephadm.ceph_manager.ceph:contract_pool iscsi by 10 min 8 2024-02-10T08:35:47.987 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph pg dump --format=json 2024-02-10T08:35:48.015 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:35:48.057 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:48.082 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:35:48.088 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:48.089 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:35:48.190 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:35:48.255 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:48.301 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:35:48.304 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:48.305 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:47.044982+0000 mgr.y (mgr.14505) 714 : cluster [DBG] pgmap v879: 168 pgs: 168 active+clean; 2.1 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 794 op/s 2024-02-10T08:35:48.305 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:47.044982+0000 mgr.y (mgr.14505) 714 : cluster [DBG] pgmap v879: 168 pgs: 168 active+clean; 2.1 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 794 op/s 2024-02-10T08:35:48.306 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:35:48.407 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:35:48.479 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:48.542 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:47.044982+0000 mgr.y (mgr.14505) 714 : cluster [DBG] pgmap v879: 168 pgs: 168 active+clean; 2.1 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 794 op/s 2024-02-10T08:35:48.620 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:35:48.630 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:48.631 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:35:48.732 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:35:48.798 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:49.039 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:35:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:35:49.241 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:35:49.262 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:35:49.264 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:49.265 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:35:49.366 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:35:49.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:35:48.775853+0000 mon.c (mon.2) 86 : audit [DBG] from='client.? 172.21.15.18:0/2516578987' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:35:49.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:35:48.775853+0000 mon.c (mon.2) 86 : audit [DBG] from='client.? 172.21.15.18:0/2516578987' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:35:49.420 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:49.453 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:35:49.466 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:49 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:35:48.775853+0000 mon.c (mon.2) 86 : audit [DBG] from='client.? 172.21.15.18:0/2516578987' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:35:49.467 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:49.467 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:35:49.568 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:35:49.626 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:49.675 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:35:49.679 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:49.679 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:35:49.780 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:35:49.822 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:49.857 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:35:49.860 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:49.864 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:35:49.964 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:35:50.029 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:50.199 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:35:48.699151+0000 mgr.y (mgr.14505) 715 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:35:50.199 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:48.990270+0000 osd.5 (osd.5) 237 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:35:50.199 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:48.990323+0000 osd.5 (osd.5) 238 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:35:50.199 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:49.046706+0000 mgr.y (mgr.14505) 716 : cluster [DBG] pgmap v880: 168 pgs: 168 active+clean; 1.9 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.23k op/s 2024-02-10T08:35:50.199 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:49.189401+0000 mon.a (mon.0) 1629 : cluster [DBG] osdmap e386: 8 total, 8 up, 8 in 2024-02-10T08:35:50.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:35:48.699151+0000 mgr.y (mgr.14505) 715 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:35:50.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:48.990270+0000 osd.5 (osd.5) 237 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:35:50.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:48.990323+0000 osd.5 (osd.5) 238 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:35:50.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:49.046706+0000 mgr.y (mgr.14505) 716 : cluster [DBG] pgmap v880: 168 pgs: 168 active+clean; 1.9 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.23k op/s 2024-02-10T08:35:50.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:49.189401+0000 mon.a (mon.0) 1629 : cluster [DBG] osdmap e386: 8 total, 8 up, 8 in 2024-02-10T08:35:50.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:35:48.699151+0000 mgr.y (mgr.14505) 715 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:35:50.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:48.990270+0000 osd.5 (osd.5) 237 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:35:50.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:48.990323+0000 osd.5 (osd.5) 238 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:35:50.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:49.046706+0000 mgr.y (mgr.14505) 716 : cluster [DBG] pgmap v880: 168 pgs: 168 active+clean; 1.9 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.23k op/s 2024-02-10T08:35:50.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:49.189401+0000 mon.a (mon.0) 1629 : cluster [DBG] osdmap e386: 8 total, 8 up, 8 in 2024-02-10T08:35:50.520 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:35:50.521 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:35:50.521 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:35:50.521 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:35:50.521 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:35:50.521 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:35:50.521 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:35:50.521 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:35:50.521 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-10T08:35:50.521 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-10T08:35:50.521 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-10T08:35:50.522 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-10T08:35:50.522 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-10T08:35:50.522 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-10T08:35:50.522 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-10T08:35:50.522 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-10T08:35:51.303 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:35:51.309 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:51.309 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:35:51.410 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:35:51.448 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:51.496 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:35:51.499 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:51.500 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:35:51.601 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:35:51.636 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:51.668 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:35:51.674 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:51.674 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:35:51.775 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:35:51.831 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:51.889 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:35:51.900 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:51.901 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:35:52.001 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:35:52.050 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:52.089 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:35:52.097 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:52.098 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:35:52.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:51.047409+0000 mgr.y (mgr.14505) 717 : cluster [DBG] pgmap v882: 168 pgs: 168 active+clean; 1.8 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 976 op/s 2024-02-10T08:35:52.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:51.047409+0000 mgr.y (mgr.14505) 717 : cluster [DBG] pgmap v882: 168 pgs: 168 active+clean; 1.8 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 976 op/s 2024-02-10T08:35:52.198 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:35:52.253 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:52.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:51 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:51.047409+0000 mgr.y (mgr.14505) 717 : cluster [DBG] pgmap v882: 168 pgs: 168 active+clean; 1.8 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 976 op/s 2024-02-10T08:35:52.390 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:35:52.401 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:52.401 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:35:52.502 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:35:52.556 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:52.775 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:35:52.780 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:52.781 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:35:52.882 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:35:52.928 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:53.292 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:35:53.300 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:53.300 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:35:53.310 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:35:53.401 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:35:53.463 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:53.827 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:35:53.832 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:53.832 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:35:53.933 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:35:53.990 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:54.111 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:53.048642+0000 mgr.y (mgr.14505) 718 : cluster [DBG] pgmap v883: 168 pgs: 168 active+clean; 1.6 GiB data, 9.7 GiB used, 705 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 1.04k op/s 2024-02-10T08:35:54.159 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:35:54.166 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:54.167 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:35:54.268 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:35:54.324 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:54.362 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:35:54.371 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:54 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:53.048642+0000 mgr.y (mgr.14505) 718 : cluster [DBG] pgmap v883: 168 pgs: 168 active+clean; 1.6 GiB data, 9.7 GiB used, 705 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 1.04k op/s 2024-02-10T08:35:54.373 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:54.374 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:35:54.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:53.048642+0000 mgr.y (mgr.14505) 718 : cluster [DBG] pgmap v883: 168 pgs: 168 active+clean; 1.6 GiB data, 9.7 GiB used, 705 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 1.04k op/s 2024-02-10T08:35:54.474 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:35:54.523 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:54.990 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-10T08:35:56.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:55.049243+0000 mgr.y (mgr.14505) 719 : cluster [DBG] pgmap v884: 168 pgs: 168 active+clean; 1.4 GiB data, 9.2 GiB used, 706 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.12k op/s 2024-02-10T08:35:56.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:55.049243+0000 mgr.y (mgr.14505) 719 : cluster [DBG] pgmap v884: 168 pgs: 168 active+clean; 1.4 GiB data, 9.2 GiB used, 706 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.12k op/s 2024-02-10T08:35:56.521 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:55.049243+0000 mgr.y (mgr.14505) 719 : cluster [DBG] pgmap v884: 168 pgs: 168 active+clean; 1.4 GiB data, 9.2 GiB used, 706 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.12k op/s 2024-02-10T08:35:56.789 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:35:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:35:56] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:35:57.405 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:35:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:35:57] "GET /metrics HTTP/1.1" 200 176443 "" "Prometheus/2.33.4" 2024-02-10T08:35:57.596 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:35:57.600 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:57.600 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:35:57.701 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:35:57.748 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:57.772 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:35:57.774 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:57.774 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:35:57.875 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:35:57.939 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:57.974 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-02-10T08:35:57.975 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:35:58.207 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:35:58.210 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:58.211 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:35:58.312 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:35:58.364 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:58.392 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:35:58.399 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:57.049645+0000 mgr.y (mgr.14505) 720 : cluster [DBG] pgmap v885: 168 pgs: 168 active+clean; 1.4 GiB data, 9.2 GiB used, 706 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.12k op/s 2024-02-10T08:35:58.399 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:57.418829+0000 osd.6 (osd.6) 223 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:35:58.399 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:57.418884+0000 osd.6 (osd.6) 224 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:35:58.400 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:58.400 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:35:58.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:57.049645+0000 mgr.y (mgr.14505) 720 : cluster [DBG] pgmap v885: 168 pgs: 168 active+clean; 1.4 GiB data, 9.2 GiB used, 706 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.12k op/s 2024-02-10T08:35:58.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:57.418829+0000 osd.6 (osd.6) 223 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:35:58.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:57.418884+0000 osd.6 (osd.6) 224 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:35:58.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:57.049645+0000 mgr.y (mgr.14505) 720 : cluster [DBG] pgmap v885: 168 pgs: 168 active+clean; 1.4 GiB data, 9.2 GiB used, 706 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.12k op/s 2024-02-10T08:35:58.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:57.418829+0000 osd.6 (osd.6) 223 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:35:58.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:57.418884+0000 osd.6 (osd.6) 224 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:35:58.501 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:35:58.541 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:58.569 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:35:58.574 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:58.574 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:35:58.675 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:35:58.710 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:58.748 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:35:58.753 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:58.753 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:35:58.854 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:35:58.898 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:58.926 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:35:58.926 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:35:58.930 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:58.930 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-02-10T08:35:58.931 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:35:59.031 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:35:59.042 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:35:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:35:59.070 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:59.102 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:35:59.107 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:35:59.108 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:35:59.208 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:35:59.259 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:35:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:58.154475+0000 mon.a (mon.0) 1630 : cluster [DBG] osdmap e387: 8 total, 8 up, 8 in 2024-02-10T08:35:59.259 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:35:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:58.154475+0000 mon.a (mon.0) 1630 : cluster [DBG] osdmap e387: 8 total, 8 up, 8 in 2024-02-10T08:35:59.263 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:35:59.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:35:59 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:58.154475+0000 mon.a (mon.0) 1630 : cluster [DBG] osdmap e387: 8 total, 8 up, 8 in 2024-02-10T08:35:59.704 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.0 dump_historic_ops 2024-02-10T08:36:00.039 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:36:00.051 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:00.052 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:36:00.153 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:36:00.235 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:00.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:35:58.716284+0000 mgr.y (mgr.14505) 721 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:36:00.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:35:58.903210+0000 mgr.y (mgr.14505) 722 : audit [DBG] from='client.15609 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-10T08:36:00.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:59.050056+0000 mgr.y (mgr.14505) 723 : cluster [DBG] pgmap v887: 168 pgs: 168 active+clean; 1.2 GiB data, 8.4 GiB used, 707 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 1.15k op/s 2024-02-10T08:36:00.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:59.151330+0000 osd.7 (osd.7) 231 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:36:00.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:35:59.151385+0000 osd.7 (osd.7) 232 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:36:00.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:00.166267+0000 mon.a (mon.0) 1631 : cluster [DBG] osdmap e388: 8 total, 8 up, 8 in 2024-02-10T08:36:00.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:35:58.716284+0000 mgr.y (mgr.14505) 721 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:36:00.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:35:58.903210+0000 mgr.y (mgr.14505) 722 : audit [DBG] from='client.15609 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-10T08:36:00.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:59.050056+0000 mgr.y (mgr.14505) 723 : cluster [DBG] pgmap v887: 168 pgs: 168 active+clean; 1.2 GiB data, 8.4 GiB used, 707 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 1.15k op/s 2024-02-10T08:36:00.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:59.151330+0000 osd.7 (osd.7) 231 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:36:00.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:35:59.151385+0000 osd.7 (osd.7) 232 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:36:00.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:00.166267+0000 mon.a (mon.0) 1631 : cluster [DBG] osdmap e388: 8 total, 8 up, 8 in 2024-02-10T08:36:00.542 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:35:58.716284+0000 mgr.y (mgr.14505) 721 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:36:00.542 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:35:58.903210+0000 mgr.y (mgr.14505) 722 : audit [DBG] from='client.15609 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-10T08:36:00.542 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:59.050056+0000 mgr.y (mgr.14505) 723 : cluster [DBG] pgmap v887: 168 pgs: 168 active+clean; 1.2 GiB data, 8.4 GiB used, 707 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 1.15k op/s 2024-02-10T08:36:00.542 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:59.151330+0000 osd.7 (osd.7) 231 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:36:00.542 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:35:59.151385+0000 osd.7 (osd.7) 232 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:36:00.542 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:00.166267+0000 mon.a (mon.0) 1631 : cluster [DBG] osdmap e388: 8 total, 8 up, 8 in 2024-02-10T08:36:01.098 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:36:01.109 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:01.109 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:36:01.139 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":886,"stamp":"2024-02-10T08:35:58.153335+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1289492156,"num_objects":19869,"num_object_clones":0,"num_object_copies":59607,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19869,"num_whiteouts":0,"num_read":2251,"num_read_kb":2003,"num_write":228638,"num_write_kb":7923241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":230,"num_bytes_recovered":7872,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79066,"ondisk_log_size":79066,"up":504,"acting":504,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":504,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":8995224,"kb_used_data":3930264,"kb_used_omap":0,"kb_used_meta":5064575,"kb_avail":740965992,"statfs":{"total":767960285184,"available":758749175808,"internally_reserved":0,"allocated":4024590336,"data_stored":4021702308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":972,"internal_metadata":5186124852},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-699465728,"num_objects":-10673,"num_object_clones":0,"num_object_copies":-32019,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-10673,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":10673,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.107227"},"pg_stats":[{"pgid":"6.33","version":"0'0","reported_seq":279,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.160993+0000","last_change":"2024-02-10T08:34:13.373898+0000","last_active":"2024-02-10T08:35:43.160993+0000","last_peered":"2024-02-10T08:35:43.160993+0000","last_clean":"2024-02-10T08:35:43.160993+0000","last_became_active":"2024-02-10T08:30:26.080326+0000","last_became_peered":"2024-02-10T08:30:26.080326+0000","last_unstale":"2024-02-10T08:35:43.160993+0000","last_undegraded":"2024-02-10T08:35:43.160993+0000","last_fullsized":"2024-02-10T08:35:43.160993+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:13.373809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:34:13.373809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2],"acting":[5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":382,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.173445+0000","last_change":"2024-02-10T08:33:31.389209+0000","last_active":"2024-02-10T08:35:43.173445+0000","last_peered":"2024-02-10T08:35:43.173445+0000","last_clean":"2024-02-10T08:35:43.173445+0000","last_became_active":"2024-02-10T08:30:26.067019+0000","last_became_peered":"2024-02-10T08:30:26.067019+0000","last_unstale":"2024-02-10T08:35:43.173445+0000","last_undegraded":"2024-02-10T08:35:43.173445+0000","last_fullsized":"2024-02-10T08:35:43.173445+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:31.389113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:33:31.389113+0000","last_clean_scrub_stamp":"2024-02-10T08:33:31.389113+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.6","version":"386'14535","reported_seq":14594,"reported_epoch":386,"state":"active+clean","last_fresh":"2024-02-10T08:35:57.800765+0000","last_change":"2024-02-10T08:32:30.821933+0000","last_active":"2024-02-10T08:35:57.800765+0000","last_peered":"2024-02-10T08:35:57.800765+0000","last_clean":"2024-02-10T08:35:57.800765+0000","last_became_active":"2024-02-10T08:32:30.821631+0000","last_became_peered":"2024-02-10T08:32:30.821631+0000","last_unstale":"2024-02-10T08:35:57.800765+0000","last_undegraded":"2024-02-10T08:35:57.800765+0000","last_fullsized":"2024-02-10T08:35:57.800765+0000","mapping_epoch":335,"log_start":"373'9700","ondisk_log_start":"373'9700","created":335,"last_epoch_clean":336,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.947585+0000","log_size":4835,"ondisk_log_size":4835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":76873728,"num_objects":1173,"num_object_clones":0,"num_object_copies":3519,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1173,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14535,"num_write_kb":502656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4],"acting":[5,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"111'10","reported_seq":625,"reported_epoch":386,"state":"active+clean","last_fresh":"2024-02-10T08:35:51.232220+0000","last_change":"2024-02-10T08:34:09.351432+0000","last_active":"2024-02-10T08:35:51.232220+0000","last_peered":"2024-02-10T08:35:51.232220+0000","last_clean":"2024-02-10T08:35:51.232220+0000","last_became_active":"2024-02-10T08:20:46.399193+0000","last_became_peered":"2024-02-10T08:20:46.399193+0000","last_unstale":"2024-02-10T08:35:51.232220+0000","last_undegraded":"2024-02-10T08:35:51.232220+0000","last_fullsized":"2024-02-10T08:35:51.232220+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'10","last_scrub_stamp":"2024-02-10T08:34:09.351338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:34:09.351338+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"225'27","reported_seq":405,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.160649+0000","last_change":"2024-02-10T08:33:23.049805+0000","last_active":"2024-02-10T08:35:43.160649+0000","last_peered":"2024-02-10T08:35:43.160649+0000","last_clean":"2024-02-10T08:35:43.160649+0000","last_became_active":"2024-02-10T08:16:55.204597+0000","last_became_peered":"2024-02-10T08:16:55.204597+0000","last_unstale":"2024-02-10T08:35:43.160649+0000","last_undegraded":"2024-02-10T08:35:43.160649+0000","last_fullsized":"2024-02-10T08:35:43.160649+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'27","last_scrub_stamp":"2024-02-10T08:33:23.049704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:33:23.049704+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":399,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.168399+0000","last_change":"2024-02-10T08:35:25.853406+0000","last_active":"2024-02-10T08:35:43.168399+0000","last_peered":"2024-02-10T08:35:43.168399+0000","last_clean":"2024-02-10T08:35:43.168399+0000","last_became_active":"2024-02-10T08:32:20.330612+0000","last_became_peered":"2024-02-10T08:32:20.330612+0000","last_unstale":"2024-02-10T08:35:43.168399+0000","last_undegraded":"2024-02-10T08:35:43.168399+0000","last_fullsized":"2024-02-10T08:35:43.168399+0000","mapping_epoch":331,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":332,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:18.706426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:29:24.554978+0000","last_clean_scrub_stamp":"2024-02-10T08:33:18.706426+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":385,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.160983+0000","last_change":"2024-02-10T08:34:09.307523+0000","last_active":"2024-02-10T08:35:43.160983+0000","last_peered":"2024-02-10T08:35:43.160983+0000","last_clean":"2024-02-10T08:35:43.160983+0000","last_became_active":"2024-02-10T08:30:24.062795+0000","last_became_peered":"2024-02-10T08:30:24.062795+0000","last_unstale":"2024-02-10T08:35:43.160983+0000","last_undegraded":"2024-02-10T08:35:43.160983+0000","last_fullsized":"2024-02-10T08:35:43.160983+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:09.307434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:20.392249+0000","last_clean_scrub_stamp":"2024-02-10T08:34:09.307434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"386'14035","reported_seq":14099,"reported_epoch":386,"state":"active+clean","last_fresh":"2024-02-10T08:35:58.064609+0000","last_change":"2024-02-10T08:34:17.209648+0000","last_active":"2024-02-10T08:35:58.064609+0000","last_peered":"2024-02-10T08:35:58.064609+0000","last_clean":"2024-02-10T08:35:58.064609+0000","last_became_active":"2024-02-10T08:32:30.825592+0000","last_became_peered":"2024-02-10T08:32:30.825592+0000","last_unstale":"2024-02-10T08:35:58.064609+0000","last_undegraded":"2024-02-10T08:35:58.064609+0000","last_fullsized":"2024-02-10T08:35:58.064609+0000","mapping_epoch":335,"log_start":"369'8200","ondisk_log_start":"369'8200","created":335,"last_epoch_clean":336,"parent":"0.0","parent_split_bits":0,"last_scrub":"369'7613","last_scrub_stamp":"2024-02-10T08:34:17.209542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:34:17.209542+0000","log_size":5835,"ondisk_log_size":5835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":73334784,"num_objects":1119,"num_object_clones":0,"num_object_copies":3357,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1119,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14035,"num_write_kb":484928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"225'15","reported_seq":177,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.165673+0000","last_change":"2024-02-10T08:35:10.248379+0000","last_active":"2024-02-10T08:35:43.165673+0000","last_peered":"2024-02-10T08:35:43.165673+0000","last_clean":"2024-02-10T08:35:43.165673+0000","last_became_active":"2024-02-10T08:28:02.770508+0000","last_became_peered":"2024-02-10T08:28:02.770508+0000","last_unstale":"2024-02-10T08:35:43.165673+0000","last_undegraded":"2024-02-10T08:35:43.165673+0000","last_fullsized":"2024-02-10T08:35:43.165673+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'15","last_scrub_stamp":"2024-02-10T08:35:10.248283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:35:10.248283+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":380,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.162044+0000","last_change":"2024-02-10T08:34:27.796767+0000","last_active":"2024-02-10T08:35:43.162044+0000","last_peered":"2024-02-10T08:35:43.162044+0000","last_clean":"2024-02-10T08:35:43.162044+0000","last_became_active":"2024-02-10T08:20:46.407311+0000","last_became_peered":"2024-02-10T08:20:46.407311+0000","last_unstale":"2024-02-10T08:35:43.162044+0000","last_undegraded":"2024-02-10T08:35:43.162044+0000","last_fullsized":"2024-02-10T08:35:43.162044+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:27.796670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:21.523096+0000","last_clean_scrub_stamp":"2024-02-10T08:34:27.796670+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":412,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.167165+0000","last_change":"2024-02-10T08:33:30.565679+0000","last_active":"2024-02-10T08:35:43.167165+0000","last_peered":"2024-02-10T08:35:43.167165+0000","last_clean":"2024-02-10T08:35:43.167165+0000","last_became_active":"2024-02-10T08:31:33.882809+0000","last_became_peered":"2024-02-10T08:31:33.882809+0000","last_unstale":"2024-02-10T08:35:43.167165+0000","last_undegraded":"2024-02-10T08:35:43.167165+0000","last_fullsized":"2024-02-10T08:35:43.167165+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:30.565591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:33:30.565591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"76'2","reported_seq":61,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.163770+0000","last_change":"2024-02-10T08:34:24.132606+0000","last_active":"2024-02-10T08:35:43.163770+0000","last_peered":"2024-02-10T08:35:43.163770+0000","last_clean":"2024-02-10T08:35:43.163770+0000","last_became_active":"2024-02-10T08:32:36.979100+0000","last_became_peered":"2024-02-10T08:32:36.979100+0000","last_unstale":"2024-02-10T08:35:43.163770+0000","last_undegraded":"2024-02-10T08:35:43.163770+0000","last_fullsized":"2024-02-10T08:35:43.163770+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'2","last_scrub_stamp":"2024-02-10T08:34:24.132513+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2024-02-10T08:18:08.680038+0000","last_clean_scrub_stamp":"2024-02-10T08:34:24.132513+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"386'13947","reported_seq":14003,"reported_epoch":386,"state":"active+clean","last_fresh":"2024-02-10T08:35:53.347269+0000","last_change":"2024-02-10T08:32:36.986316+0000","last_active":"2024-02-10T08:35:53.347269+0000","last_peered":"2024-02-10T08:35:53.347269+0000","last_clean":"2024-02-10T08:35:53.347269+0000","last_became_active":"2024-02-10T08:32:36.985786+0000","last_became_peered":"2024-02-10T08:32:36.985786+0000","last_unstale":"2024-02-10T08:35:53.347269+0000","last_undegraded":"2024-02-10T08:35:53.347269+0000","last_fullsized":"2024-02-10T08:35:53.347269+0000","mapping_epoch":339,"log_start":"372'9400","ondisk_log_start":"372'9400","created":335,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.947585+0000","log_size":4547,"ondisk_log_size":4547,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":96796672,"num_objects":1477,"num_object_clones":0,"num_object_copies":4431,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1477,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13947,"num_write_kb":493568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"226'35","reported_seq":417,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.168454+0000","last_change":"2024-02-10T08:33:34.284782+0000","last_active":"2024-02-10T08:35:43.168454+0000","last_peered":"2024-02-10T08:35:43.168454+0000","last_clean":"2024-02-10T08:35:43.168454+0000","last_became_active":"2024-02-10T08:16:55.203415+0000","last_became_peered":"2024-02-10T08:16:55.203415+0000","last_unstale":"2024-02-10T08:35:43.168454+0000","last_undegraded":"2024-02-10T08:35:43.168454+0000","last_fullsized":"2024-02-10T08:35:43.168454+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"226'35","last_scrub_stamp":"2024-02-10T08:33:34.284690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:33:34.284690+0000","log_size":35,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":56,"num_read_kb":45,"num_write":36,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":388,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.167457+0000","last_change":"2024-02-10T08:33:33.598098+0000","last_active":"2024-02-10T08:35:43.167457+0000","last_peered":"2024-02-10T08:35:43.167457+0000","last_clean":"2024-02-10T08:35:43.167457+0000","last_became_active":"2024-02-10T08:28:02.781029+0000","last_became_peered":"2024-02-10T08:28:02.781029+0000","last_unstale":"2024-02-10T08:35:43.167457+0000","last_undegraded":"2024-02-10T08:35:43.167457+0000","last_fullsized":"2024-02-10T08:35:43.167457+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:33.597972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:33:33.597972+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":384,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.167120+0000","last_change":"2024-02-10T08:34:24.908075+0000","last_active":"2024-02-10T08:35:43.167120+0000","last_peered":"2024-02-10T08:35:43.167120+0000","last_clean":"2024-02-10T08:35:43.167120+0000","last_became_active":"2024-02-10T08:28:02.779438+0000","last_became_peered":"2024-02-10T08:28:02.779438+0000","last_unstale":"2024-02-10T08:35:43.167120+0000","last_undegraded":"2024-02-10T08:35:43.167120+0000","last_fullsized":"2024-02-10T08:35:43.167120+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:24.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.593849+0000","last_clean_scrub_stamp":"2024-02-10T08:34:24.907958+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":371,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.166106+0000","last_change":"2024-02-10T08:33:19.398482+0000","last_active":"2024-02-10T08:35:43.166106+0000","last_peered":"2024-02-10T08:35:43.166106+0000","last_clean":"2024-02-10T08:35:43.166106+0000","last_became_active":"2024-02-10T08:24:18.645480+0000","last_became_peered":"2024-02-10T08:24:18.645480+0000","last_unstale":"2024-02-10T08:35:43.166106+0000","last_undegraded":"2024-02-10T08:35:43.166106+0000","last_fullsized":"2024-02-10T08:35:43.166106+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:19.398412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:33:19.398412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,3],"acting":[7,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3","version":"386'14407","reported_seq":14471,"reported_epoch":386,"state":"active+clean","last_fresh":"2024-02-10T08:35:58.041782+0000","last_change":"2024-02-10T08:34:37.264784+0000","last_active":"2024-02-10T08:35:58.041782+0000","last_peered":"2024-02-10T08:35:58.041782+0000","last_clean":"2024-02-10T08:35:58.041782+0000","last_became_active":"2024-02-10T08:32:30.825621+0000","last_became_peered":"2024-02-10T08:32:30.825621+0000","last_unstale":"2024-02-10T08:35:58.041782+0000","last_undegraded":"2024-02-10T08:35:58.041782+0000","last_fullsized":"2024-02-10T08:35:58.041782+0000","mapping_epoch":335,"log_start":"370'8600","ondisk_log_start":"370'8600","created":335,"last_epoch_clean":336,"parent":"0.0","parent_split_bits":0,"last_scrub":"372'9223","last_scrub_stamp":"2024-02-10T08:34:37.264686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:34:37.264686+0000","log_size":5807,"ondisk_log_size":5807,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":76087296,"num_objects":1161,"num_object_clones":0,"num_object_copies":3483,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1161,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14407,"num_write_kb":498176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"225'31","reported_seq":101,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.173363+0000","last_change":"2024-02-10T08:32:31.309431+0000","last_active":"2024-02-10T08:35:43.173363+0000","last_peered":"2024-02-10T08:35:43.173363+0000","last_clean":"2024-02-10T08:35:43.173363+0000","last_became_active":"2024-02-10T08:31:46.070488+0000","last_became_peered":"2024-02-10T08:31:46.070488+0000","last_unstale":"2024-02-10T08:35:43.173363+0000","last_undegraded":"2024-02-10T08:35:43.173363+0000","last_fullsized":"2024-02-10T08:35:43.173363+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'31","last_scrub_stamp":"2024-02-10T08:32:31.309364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:32:31.309364+0000","log_size":31,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":48,"num_read_kb":38,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":416,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.164427+0000","last_change":"2024-02-10T08:32:11.282121+0000","last_active":"2024-02-10T08:35:43.164427+0000","last_peered":"2024-02-10T08:35:43.164427+0000","last_clean":"2024-02-10T08:35:43.164427+0000","last_became_active":"2024-02-10T08:20:46.399568+0000","last_became_peered":"2024-02-10T08:20:46.399568+0000","last_unstale":"2024-02-10T08:35:43.164427+0000","last_undegraded":"2024-02-10T08:35:43.164427+0000","last_fullsized":"2024-02-10T08:35:43.164427+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:11.282042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:32:11.282042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":389,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.162455+0000","last_change":"2024-02-10T08:34:19.729292+0000","last_active":"2024-02-10T08:35:43.162455+0000","last_peered":"2024-02-10T08:35:43.162455+0000","last_clean":"2024-02-10T08:35:43.162455+0000","last_became_active":"2024-02-10T08:28:02.764210+0000","last_became_peered":"2024-02-10T08:28:02.764210+0000","last_unstale":"2024-02-10T08:35:43.162455+0000","last_undegraded":"2024-02-10T08:35:43.162455+0000","last_fullsized":"2024-02-10T08:35:43.162455+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:19.729185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:34:19.729185+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":336,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.164459+0000","last_change":"2024-02-10T08:34:23.258089+0000","last_active":"2024-02-10T08:35:43.164459+0000","last_peered":"2024-02-10T08:35:43.164459+0000","last_clean":"2024-02-10T08:35:43.164459+0000","last_became_active":"2024-02-10T08:31:33.883457+0000","last_became_peered":"2024-02-10T08:31:33.883457+0000","last_unstale":"2024-02-10T08:35:43.164459+0000","last_undegraded":"2024-02-10T08:35:43.164459+0000","last_fullsized":"2024-02-10T08:35:43.164459+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:23.258018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:34.215363+0000","last_clean_scrub_stamp":"2024-02-10T08:34:23.258018+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2","version":"386'14647","reported_seq":14711,"reported_epoch":386,"state":"active+clean","last_fresh":"2024-02-10T08:35:57.861217+0000","last_change":"2024-02-10T08:35:21.549328+0000","last_active":"2024-02-10T08:35:57.861217+0000","last_peered":"2024-02-10T08:35:57.861217+0000","last_clean":"2024-02-10T08:35:57.861217+0000","last_became_active":"2024-02-10T08:32:30.822464+0000","last_became_peered":"2024-02-10T08:32:30.822464+0000","last_unstale":"2024-02-10T08:35:57.861217+0000","last_undegraded":"2024-02-10T08:35:57.861217+0000","last_fullsized":"2024-02-10T08:35:57.861217+0000","mapping_epoch":335,"log_start":"374'9900","ondisk_log_start":"374'9900","created":335,"last_epoch_clean":336,"parent":"0.0","parent_split_bits":0,"last_scrub":"380'12202","last_scrub_stamp":"2024-02-10T08:35:21.549221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:35:21.549221+0000","log_size":4747,"ondisk_log_size":4747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":79888384,"num_objects":1219,"num_object_clones":0,"num_object_copies":3657,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1219,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14647,"num_write_kb":507712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"225'20","reported_seq":379,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.174753+0000","last_change":"2024-02-10T08:35:23.121276+0000","last_active":"2024-02-10T08:35:43.174753+0000","last_peered":"2024-02-10T08:35:43.174753+0000","last_clean":"2024-02-10T08:35:43.174753+0000","last_became_active":"2024-02-10T08:20:46.398973+0000","last_became_peered":"2024-02-10T08:20:46.398973+0000","last_unstale":"2024-02-10T08:35:43.174753+0000","last_undegraded":"2024-02-10T08:35:43.174753+0000","last_fullsized":"2024-02-10T08:35:43.174753+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'20","last_scrub_stamp":"2024-02-10T08:35:23.121164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:35:23.121164+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":24,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":360,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.161899+0000","last_change":"2024-02-10T08:32:27.711245+0000","last_active":"2024-02-10T08:35:43.161899+0000","last_peered":"2024-02-10T08:35:43.161899+0000","last_clean":"2024-02-10T08:35:43.161899+0000","last_became_active":"2024-02-10T08:16:52.785545+0000","last_became_peered":"2024-02-10T08:16:52.785545+0000","last_unstale":"2024-02-10T08:35:43.161899+0000","last_undegraded":"2024-02-10T08:35:43.161899+0000","last_fullsized":"2024-02-10T08:35:43.161899+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:27.711059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:32:27.711059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"62'8","reported_seq":603,"reported_epoch":386,"state":"active+clean","last_fresh":"2024-02-10T08:35:51.231376+0000","last_change":"2024-02-10T08:34:37.927018+0000","last_active":"2024-02-10T08:35:51.231376+0000","last_peered":"2024-02-10T08:35:51.231376+0000","last_clean":"2024-02-10T08:35:51.231376+0000","last_became_active":"2024-02-10T08:16:56.858101+0000","last_became_peered":"2024-02-10T08:16:56.858101+0000","last_unstale":"2024-02-10T08:35:51.231376+0000","last_undegraded":"2024-02-10T08:35:51.231376+0000","last_fullsized":"2024-02-10T08:35:51.231376+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'8","last_scrub_stamp":"2024-02-10T08:34:37.926921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:34:37.926921+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":338,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.178667+0000","last_change":"2024-02-10T08:33:29.477537+0000","last_active":"2024-02-10T08:35:43.178667+0000","last_peered":"2024-02-10T08:35:43.178667+0000","last_clean":"2024-02-10T08:35:43.178667+0000","last_became_active":"2024-02-10T08:30:24.071020+0000","last_became_peered":"2024-02-10T08:30:24.071020+0000","last_unstale":"2024-02-10T08:35:43.178667+0000","last_undegraded":"2024-02-10T08:35:43.178667+0000","last_fullsized":"2024-02-10T08:35:43.178667+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:29.477480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:33:29.477480+0000","last_clean_scrub_stamp":"2024-02-10T08:33:29.477480+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1","version":"386'16844","reported_seq":16907,"reported_epoch":386,"state":"active+clean","last_fresh":"2024-02-10T08:35:54.620969+0000","last_change":"2024-02-10T08:35:37.497787+0000","last_active":"2024-02-10T08:35:54.620969+0000","last_peered":"2024-02-10T08:35:54.620969+0000","last_clean":"2024-02-10T08:35:54.620969+0000","last_became_active":"2024-02-10T08:32:30.823874+0000","last_became_peered":"2024-02-10T08:32:30.823874+0000","last_unstale":"2024-02-10T08:35:54.620969+0000","last_undegraded":"2024-02-10T08:35:54.620969+0000","last_fullsized":"2024-02-10T08:35:54.620969+0000","mapping_epoch":335,"log_start":"381'12400","ondisk_log_start":"381'12400","created":335,"last_epoch_clean":336,"parent":"0.0","parent_split_bits":0,"last_scrub":"383'15651","last_scrub_stamp":"2024-02-10T08:35:37.497688+0000","last_deep_scrub":"383'15651","last_deep_scrub_stamp":"2024-02-10T08:35:37.497688+0000","last_clean_scrub_stamp":"2024-02-10T08:35:37.497688+0000","log_size":4444,"ondisk_log_size":4444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":94240768,"num_objects":1438,"num_object_clones":0,"num_object_copies":4314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1438,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13830,"num_write_kb":488576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,0],"acting":[4,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"226'27","reported_seq":388,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.168808+0000","last_change":"2024-02-10T08:34:18.905332+0000","last_active":"2024-02-10T08:35:43.168808+0000","last_peered":"2024-02-10T08:35:43.168808+0000","last_clean":"2024-02-10T08:35:43.168808+0000","last_became_active":"2024-02-10T08:20:46.401777+0000","last_became_peered":"2024-02-10T08:20:46.401777+0000","last_unstale":"2024-02-10T08:35:43.168808+0000","last_undegraded":"2024-02-10T08:35:43.168808+0000","last_fullsized":"2024-02-10T08:35:43.168808+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"226'27","last_scrub_stamp":"2024-02-10T08:34:18.905235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:34:18.905235+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":365,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.161052+0000","last_change":"2024-02-10T08:35:14.724519+0000","last_active":"2024-02-10T08:35:43.161052+0000","last_peered":"2024-02-10T08:35:43.161052+0000","last_clean":"2024-02-10T08:35:43.161052+0000","last_became_active":"2024-02-10T08:16:52.783634+0000","last_became_peered":"2024-02-10T08:16:52.783634+0000","last_unstale":"2024-02-10T08:35:43.161052+0000","last_undegraded":"2024-02-10T08:35:43.161052+0000","last_fullsized":"2024-02-10T08:35:43.161052+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:35:14.724417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:35:14.724417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"318'14","reported_seq":137,"reported_epoch":386,"state":"active+clean","last_fresh":"2024-02-10T08:35:49.193884+0000","last_change":"2024-02-10T08:33:27.431016+0000","last_active":"2024-02-10T08:35:49.193884+0000","last_peered":"2024-02-10T08:35:49.193884+0000","last_clean":"2024-02-10T08:35:49.193884+0000","last_became_active":"2024-02-10T08:31:46.073265+0000","last_became_peered":"2024-02-10T08:31:46.073265+0000","last_unstale":"2024-02-10T08:35:49.193884+0000","last_undegraded":"2024-02-10T08:35:49.193884+0000","last_fullsized":"2024-02-10T08:35:49.193884+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"318'14","last_scrub_stamp":"2024-02-10T08:33:27.430946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:33:27.430946+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":385,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.162888+0000","last_change":"2024-02-10T08:35:23.093480+0000","last_active":"2024-02-10T08:35:43.162888+0000","last_peered":"2024-02-10T08:35:43.162888+0000","last_clean":"2024-02-10T08:35:43.162888+0000","last_became_active":"2024-02-10T08:32:36.978932+0000","last_became_peered":"2024-02-10T08:32:36.978932+0000","last_unstale":"2024-02-10T08:35:43.162888+0000","last_undegraded":"2024-02-10T08:35:43.162888+0000","last_fullsized":"2024-02-10T08:35:43.162888+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:35:23.093373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:35:23.093373+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.0","version":"386'14178","reported_seq":14242,"reported_epoch":386,"state":"active+clean","last_fresh":"2024-02-10T08:35:57.861977+0000","last_change":"2024-02-10T08:35:14.194604+0000","last_active":"2024-02-10T08:35:57.861977+0000","last_peered":"2024-02-10T08:35:57.861977+0000","last_clean":"2024-02-10T08:35:57.861977+0000","last_became_active":"2024-02-10T08:32:30.821494+0000","last_became_peered":"2024-02-10T08:32:30.821494+0000","last_unstale":"2024-02-10T08:35:57.861977+0000","last_undegraded":"2024-02-10T08:35:57.861977+0000","last_fullsized":"2024-02-10T08:35:57.861977+0000","mapping_epoch":335,"log_start":"372'9000","ondisk_log_start":"372'9000","created":335,"last_epoch_clean":336,"parent":"0.0","parent_split_bits":0,"last_scrub":"378'11388","last_scrub_stamp":"2024-02-10T08:35:14.194542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:35:14.194542+0000","log_size":5178,"ondisk_log_size":5178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":74973184,"num_objects":1144,"num_object_clones":0,"num_object_copies":3432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1144,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14178,"num_write_kb":490304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,4],"acting":[6,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"225'24","reported_seq":381,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.178777+0000","last_change":"2024-02-10T08:32:23.327031+0000","last_active":"2024-02-10T08:35:43.178777+0000","last_peered":"2024-02-10T08:35:43.178777+0000","last_clean":"2024-02-10T08:35:43.178777+0000","last_became_active":"2024-02-10T08:20:46.406023+0000","last_became_peered":"2024-02-10T08:20:46.406023+0000","last_unstale":"2024-02-10T08:35:43.178777+0000","last_undegraded":"2024-02-10T08:35:43.178777+0000","last_fullsized":"2024-02-10T08:35:43.178777+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'24","last_scrub_stamp":"2024-02-10T08:32:23.326944+0000","last_deep_scrub":"76'16","last_deep_scrub_stamp":"2024-02-10T08:18:07.909782+0000","last_clean_scrub_stamp":"2024-02-10T08:32:23.326944+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":377,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.166399+0000","last_change":"2024-02-10T08:32:13.217936+0000","last_active":"2024-02-10T08:35:43.166399+0000","last_peered":"2024-02-10T08:35:43.166399+0000","last_clean":"2024-02-10T08:35:43.166399+0000","last_became_active":"2024-02-10T08:28:02.768633+0000","last_became_peered":"2024-02-10T08:28:02.768633+0000","last_unstale":"2024-02-10T08:35:43.166399+0000","last_undegraded":"2024-02-10T08:35:43.166399+0000","last_fullsized":"2024-02-10T08:35:43.166399+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:13.217844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:32:13.217844+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":424,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.172065+0000","last_change":"2024-02-10T08:35:27.079330+0000","last_active":"2024-02-10T08:35:43.172065+0000","last_peered":"2024-02-10T08:35:43.172065+0000","last_clean":"2024-02-10T08:35:43.172065+0000","last_became_active":"2024-02-10T08:20:46.400500+0000","last_became_peered":"2024-02-10T08:20:46.400500+0000","last_unstale":"2024-02-10T08:35:43.172065+0000","last_undegraded":"2024-02-10T08:35:43.172065+0000","last_fullsized":"2024-02-10T08:35:43.172065+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:26.092899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:32:26.092899+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":297,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.167330+0000","last_change":"2024-02-10T08:34:23.054084+0000","last_active":"2024-02-10T08:35:43.167330+0000","last_peered":"2024-02-10T08:35:43.167330+0000","last_clean":"2024-02-10T08:35:43.167330+0000","last_became_active":"2024-02-10T08:31:33.880969+0000","last_became_peered":"2024-02-10T08:31:33.880969+0000","last_unstale":"2024-02-10T08:35:43.167330+0000","last_undegraded":"2024-02-10T08:35:43.167330+0000","last_fullsized":"2024-02-10T08:35:43.167330+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:23.053989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:20:30.227375+0000","last_clean_scrub_stamp":"2024-02-10T08:34:23.053989+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.f","version":"386'17689","reported_seq":17756,"reported_epoch":386,"state":"active+clean","last_fresh":"2024-02-10T08:35:57.871617+0000","last_change":"2024-02-10T08:35:11.605210+0000","last_active":"2024-02-10T08:35:57.871617+0000","last_peered":"2024-02-10T08:35:57.871617+0000","last_clean":"2024-02-10T08:35:57.871617+0000","last_became_active":"2024-02-10T08:32:30.825140+0000","last_became_peered":"2024-02-10T08:32:30.825140+0000","last_unstale":"2024-02-10T08:35:57.871617+0000","last_undegraded":"2024-02-10T08:35:57.871617+0000","last_fullsized":"2024-02-10T08:35:57.871617+0000","mapping_epoch":335,"log_start":"374'12601","ondisk_log_start":"374'12601","created":335,"last_epoch_clean":336,"parent":"0.0","parent_split_bits":0,"last_scrub":"378'14728","last_scrub_stamp":"2024-02-10T08:35:11.605104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:35:11.605104+0000","log_size":5088,"ondisk_log_size":5088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":75235328,"num_objects":1148,"num_object_clones":0,"num_object_copies":3444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1148,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14378,"num_write_kb":496832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"314'14","reported_seq":480,"reported_epoch":386,"state":"active+clean","last_fresh":"2024-02-10T08:35:51.232358+0000","last_change":"2024-02-10T08:34:18.681979+0000","last_active":"2024-02-10T08:35:51.232358+0000","last_peered":"2024-02-10T08:35:51.232358+0000","last_clean":"2024-02-10T08:35:51.232358+0000","last_became_active":"2024-02-10T08:31:33.890120+0000","last_became_peered":"2024-02-10T08:31:33.890120+0000","last_unstale":"2024-02-10T08:35:51.232358+0000","last_undegraded":"2024-02-10T08:35:51.232358+0000","last_fullsized":"2024-02-10T08:35:51.232358+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"314'14","last_scrub_stamp":"2024-02-10T08:34:18.681893+0000","last_deep_scrub":"199'13","last_deep_scrub_stamp":"2024-02-10T08:24:47.529439+0000","last_clean_scrub_stamp":"2024-02-10T08:34:18.681893+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"225'28","reported_seq":377,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.171736+0000","last_change":"2024-02-10T08:34:12.126228+0000","last_active":"2024-02-10T08:35:43.171736+0000","last_peered":"2024-02-10T08:35:43.171736+0000","last_clean":"2024-02-10T08:35:43.171736+0000","last_became_active":"2024-02-10T08:20:46.400760+0000","last_became_peered":"2024-02-10T08:20:46.400760+0000","last_unstale":"2024-02-10T08:35:43.171736+0000","last_undegraded":"2024-02-10T08:35:43.171736+0000","last_fullsized":"2024-02-10T08:35:43.171736+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'28","last_scrub_stamp":"2024-02-10T08:34:12.126133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:34:12.126133+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":41,"num_read_kb":34,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":369,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.169916+0000","last_change":"2024-02-10T08:35:19.808816+0000","last_active":"2024-02-10T08:35:43.169916+0000","last_peered":"2024-02-10T08:35:43.169916+0000","last_clean":"2024-02-10T08:35:43.169916+0000","last_became_active":"2024-02-10T08:16:52.789020+0000","last_became_peered":"2024-02-10T08:16:52.789020+0000","last_unstale":"2024-02-10T08:35:43.169916+0000","last_undegraded":"2024-02-10T08:35:43.169916+0000","last_fullsized":"2024-02-10T08:35:43.169916+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:35:19.808724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:35:19.808724+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":362,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.164753+0000","last_change":"2024-02-10T08:33:15.455469+0000","last_active":"2024-02-10T08:35:43.164753+0000","last_peered":"2024-02-10T08:35:43.164753+0000","last_clean":"2024-02-10T08:35:43.164753+0000","last_became_active":"2024-02-10T08:21:58.546976+0000","last_became_peered":"2024-02-10T08:21:58.546976+0000","last_unstale":"2024-02-10T08:35:43.164753+0000","last_undegraded":"2024-02-10T08:35:43.164753+0000","last_fullsized":"2024-02-10T08:35:43.164753+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:15.455337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:33:15.455337+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"386'14110","reported_seq":14168,"reported_epoch":386,"state":"active+clean","last_fresh":"2024-02-10T08:35:54.630504+0000","last_change":"2024-02-10T08:32:30.825453+0000","last_active":"2024-02-10T08:35:54.630504+0000","last_peered":"2024-02-10T08:35:54.630504+0000","last_clean":"2024-02-10T08:35:54.630504+0000","last_became_active":"2024-02-10T08:32:30.825144+0000","last_became_peered":"2024-02-10T08:32:30.825144+0000","last_unstale":"2024-02-10T08:35:54.630504+0000","last_undegraded":"2024-02-10T08:35:54.630504+0000","last_fullsized":"2024-02-10T08:35:54.630504+0000","mapping_epoch":335,"log_start":"374'9600","ondisk_log_start":"374'9600","created":335,"last_epoch_clean":336,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.947585+0000","log_size":4510,"ondisk_log_size":4510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":91357184,"num_objects":1394,"num_object_clones":0,"num_object_copies":4182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1394,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14110,"num_write_kb":496128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":355,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.171810+0000","last_change":"2024-02-10T08:34:10.165771+0000","last_active":"2024-02-10T08:35:43.171810+0000","last_peered":"2024-02-10T08:35:43.171810+0000","last_clean":"2024-02-10T08:35:43.171810+0000","last_became_active":"2024-02-10T08:31:33.883569+0000","last_became_peered":"2024-02-10T08:31:33.883569+0000","last_unstale":"2024-02-10T08:35:43.171810+0000","last_undegraded":"2024-02-10T08:35:43.171810+0000","last_fullsized":"2024-02-10T08:35:43.171810+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:10.165705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:34:10.165705+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"225'30","reported_seq":421,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.166748+0000","last_change":"2024-02-10T08:33:22.481486+0000","last_active":"2024-02-10T08:35:43.166748+0000","last_peered":"2024-02-10T08:35:43.166748+0000","last_clean":"2024-02-10T08:35:43.166748+0000","last_became_active":"2024-02-10T08:32:36.979685+0000","last_became_peered":"2024-02-10T08:32:36.979685+0000","last_unstale":"2024-02-10T08:35:43.166748+0000","last_undegraded":"2024-02-10T08:35:43.166748+0000","last_fullsized":"2024-02-10T08:35:43.166748+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'30","last_scrub_stamp":"2024-02-10T08:33:22.481382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:33:22.481382+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":51,"num_read_kb":39,"num_write":32,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,0],"acting":[7,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":375,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.162614+0000","last_change":"2024-02-10T08:33:16.825530+0000","last_active":"2024-02-10T08:35:43.162614+0000","last_peered":"2024-02-10T08:35:43.162614+0000","last_clean":"2024-02-10T08:35:43.162614+0000","last_became_active":"2024-02-10T08:20:46.407667+0000","last_became_peered":"2024-02-10T08:20:46.407667+0000","last_unstale":"2024-02-10T08:35:43.162614+0000","last_undegraded":"2024-02-10T08:35:43.162614+0000","last_fullsized":"2024-02-10T08:35:43.162614+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:16.825366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:33:16.825366+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":368,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.173536+0000","last_change":"2024-02-10T08:32:25.358402+0000","last_active":"2024-02-10T08:35:43.173536+0000","last_peered":"2024-02-10T08:35:43.173536+0000","last_clean":"2024-02-10T08:35:43.173536+0000","last_became_active":"2024-02-10T08:31:33.882582+0000","last_became_peered":"2024-02-10T08:31:33.882582+0000","last_unstale":"2024-02-10T08:35:43.173536+0000","last_undegraded":"2024-02-10T08:35:43.173536+0000","last_fullsized":"2024-02-10T08:35:43.173536+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:25.358315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:25.358315+0000","last_clean_scrub_stamp":"2024-02-10T08:32:25.358315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.d","version":"386'13946","reported_seq":14023,"reported_epoch":386,"state":"active+clean","last_fresh":"2024-02-10T08:35:54.610731+0000","last_change":"2024-02-10T08:33:56.130464+0000","last_active":"2024-02-10T08:35:54.610731+0000","last_peered":"2024-02-10T08:35:54.610731+0000","last_clean":"2024-02-10T08:35:54.610731+0000","last_became_active":"2024-02-10T08:33:56.117412+0000","last_became_peered":"2024-02-10T08:33:56.117412+0000","last_unstale":"2024-02-10T08:35:54.610731+0000","last_undegraded":"2024-02-10T08:35:54.610731+0000","last_fullsized":"2024-02-10T08:35:54.610731+0000","mapping_epoch":364,"log_start":"374'9490","ondisk_log_start":"374'9490","created":335,"last_epoch_clean":365,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.947585+0000","log_size":4456,"ondisk_log_size":4456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":88801304,"num_objects":1356,"num_object_clones":0,"num_object_copies":4068,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1356,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":13946,"num_write_kb":489601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":250,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.165929+0000","last_change":"2024-02-10T08:33:56.117476+0000","last_active":"2024-02-10T08:35:43.165929+0000","last_peered":"2024-02-10T08:35:43.165929+0000","last_clean":"2024-02-10T08:35:43.165929+0000","last_became_active":"2024-02-10T08:33:56.117216+0000","last_became_peered":"2024-02-10T08:33:56.117216+0000","last_unstale":"2024-02-10T08:35:43.165929+0000","last_undegraded":"2024-02-10T08:35:43.165929+0000","last_fullsized":"2024-02-10T08:35:43.165929+0000","mapping_epoch":364,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":365,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:33.234450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:33:33.234450+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"225'37","reported_seq":456,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.165238+0000","last_change":"2024-02-10T08:33:15.707082+0000","last_active":"2024-02-10T08:35:43.165238+0000","last_peered":"2024-02-10T08:35:43.165238+0000","last_clean":"2024-02-10T08:35:43.165238+0000","last_became_active":"2024-02-10T08:28:25.951447+0000","last_became_peered":"2024-02-10T08:28:25.951447+0000","last_unstale":"2024-02-10T08:35:43.165238+0000","last_undegraded":"2024-02-10T08:35:43.165238+0000","last_fullsized":"2024-02-10T08:35:43.165238+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'37","last_scrub_stamp":"2024-02-10T08:33:15.706967+0000","last_deep_scrub":"199'27","last_deep_scrub_stamp":"2024-02-10T08:24:42.826442+0000","last_clean_scrub_stamp":"2024-02-10T08:33:15.706967+0000","log_size":37,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":53,"num_read_kb":39,"num_write":32,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":367,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.168910+0000","last_change":"2024-02-10T08:34:20.889754+0000","last_active":"2024-02-10T08:35:43.168910+0000","last_peered":"2024-02-10T08:35:43.168910+0000","last_clean":"2024-02-10T08:35:43.168910+0000","last_became_active":"2024-02-10T08:32:36.972224+0000","last_became_peered":"2024-02-10T08:32:36.972224+0000","last_unstale":"2024-02-10T08:35:43.168910+0000","last_undegraded":"2024-02-10T08:35:43.168910+0000","last_fullsized":"2024-02-10T08:35:43.168910+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:20.889663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:34:20.889663+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4],"acting":[2,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":363,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.161129+0000","last_change":"2024-02-10T08:33:15.884926+0000","last_active":"2024-02-10T08:35:43.161129+0000","last_peered":"2024-02-10T08:35:43.161129+0000","last_clean":"2024-02-10T08:35:43.161129+0000","last_became_active":"2024-02-10T08:21:58.553966+0000","last_became_peered":"2024-02-10T08:21:58.553966+0000","last_unstale":"2024-02-10T08:35:43.161129+0000","last_undegraded":"2024-02-10T08:35:43.161129+0000","last_fullsized":"2024-02-10T08:35:43.161129+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:15.884742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:39.633627+0000","last_clean_scrub_stamp":"2024-02-10T08:33:15.884742+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.8","version":"386'13823","reported_seq":13882,"reported_epoch":386,"state":"active+clean","last_fresh":"2024-02-10T08:35:53.313782+0000","last_change":"2024-02-10T08:32:30.824983+0000","last_active":"2024-02-10T08:35:53.313782+0000","last_peered":"2024-02-10T08:35:53.313782+0000","last_clean":"2024-02-10T08:35:53.313782+0000","last_became_active":"2024-02-10T08:32:30.824620+0000","last_became_peered":"2024-02-10T08:32:30.824620+0000","last_unstale":"2024-02-10T08:35:53.313782+0000","last_undegraded":"2024-02-10T08:35:53.313782+0000","last_fullsized":"2024-02-10T08:35:53.313782+0000","mapping_epoch":335,"log_start":"372'9300","ondisk_log_start":"372'9300","created":335,"last_epoch_clean":336,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.947585+0000","log_size":4523,"ondisk_log_size":4523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":89849856,"num_objects":1371,"num_object_clones":0,"num_object_copies":4113,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1371,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13823,"num_write_kb":486208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7],"acting":[0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":382,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.172092+0000","last_change":"2024-02-10T08:33:28.092624+0000","last_active":"2024-02-10T08:35:43.172092+0000","last_peered":"2024-02-10T08:35:43.172092+0000","last_clean":"2024-02-10T08:35:43.172092+0000","last_became_active":"2024-02-10T08:28:02.772585+0000","last_became_peered":"2024-02-10T08:28:02.772585+0000","last_unstale":"2024-02-10T08:35:43.172092+0000","last_undegraded":"2024-02-10T08:35:43.172092+0000","last_fullsized":"2024-02-10T08:35:43.172092+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:28.092554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:41.360241+0000","last_clean_scrub_stamp":"2024-02-10T08:33:28.092554+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"225'24","reported_seq":75,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.164362+0000","last_change":"2024-02-10T08:33:09.736783+0000","last_active":"2024-02-10T08:35:43.164362+0000","last_peered":"2024-02-10T08:35:43.164362+0000","last_clean":"2024-02-10T08:35:43.164362+0000","last_became_active":"2024-02-10T08:32:36.975366+0000","last_became_peered":"2024-02-10T08:32:36.975366+0000","last_unstale":"2024-02-10T08:35:43.164362+0000","last_undegraded":"2024-02-10T08:35:43.164362+0000","last_fullsized":"2024-02-10T08:35:43.164362+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'24","last_scrub_stamp":"2024-02-10T08:33:09.736694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:33:09.736694+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":377,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.166254+0000","last_change":"2024-02-10T08:32:28.402029+0000","last_active":"2024-02-10T08:35:43.166254+0000","last_peered":"2024-02-10T08:35:43.166254+0000","last_clean":"2024-02-10T08:35:43.166254+0000","last_became_active":"2024-02-10T08:28:02.760999+0000","last_became_peered":"2024-02-10T08:28:02.760999+0000","last_unstale":"2024-02-10T08:35:43.166254+0000","last_undegraded":"2024-02-10T08:35:43.166254+0000","last_fullsized":"2024-02-10T08:35:43.166254+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:28.401960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:28.401960+0000","last_clean_scrub_stamp":"2024-02-10T08:32:28.401960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":356,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.165712+0000","last_change":"2024-02-10T08:33:26.788214+0000","last_active":"2024-02-10T08:35:43.165712+0000","last_peered":"2024-02-10T08:35:43.165712+0000","last_clean":"2024-02-10T08:35:43.165712+0000","last_became_active":"2024-02-10T08:31:46.063039+0000","last_became_peered":"2024-02-10T08:31:46.063039+0000","last_unstale":"2024-02-10T08:35:43.165712+0000","last_undegraded":"2024-02-10T08:35:43.165712+0000","last_fullsized":"2024-02-10T08:35:43.165712+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:26.787778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:20.736224+0000","last_clean_scrub_stamp":"2024-02-10T08:33:26.787778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":376,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.162501+0000","last_change":"2024-02-10T08:32:32.713980+0000","last_active":"2024-02-10T08:35:43.162501+0000","last_peered":"2024-02-10T08:35:43.162501+0000","last_clean":"2024-02-10T08:35:43.162501+0000","last_became_active":"2024-02-10T08:28:19.022399+0000","last_became_peered":"2024-02-10T08:28:19.022399+0000","last_unstale":"2024-02-10T08:35:43.162501+0000","last_undegraded":"2024-02-10T08:35:43.162501+0000","last_fullsized":"2024-02-10T08:35:43.162501+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:32.713921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:32:32.713921+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"386'14214","reported_seq":14278,"reported_epoch":386,"state":"active+clean","last_fresh":"2024-02-10T08:35:57.855365+0000","last_change":"2024-02-10T08:34:33.403560+0000","last_active":"2024-02-10T08:35:57.855365+0000","last_peered":"2024-02-10T08:35:57.855365+0000","last_clean":"2024-02-10T08:35:57.855365+0000","last_became_active":"2024-02-10T08:32:30.823591+0000","last_became_peered":"2024-02-10T08:32:30.823591+0000","last_unstale":"2024-02-10T08:35:57.855365+0000","last_undegraded":"2024-02-10T08:35:57.855365+0000","last_fullsized":"2024-02-10T08:35:57.855365+0000","mapping_epoch":335,"log_start":"372'9100","ondisk_log_start":"372'9100","created":335,"last_epoch_clean":336,"parent":"0.0","parent_split_bits":0,"last_scrub":"372'8897","last_scrub_stamp":"2024-02-10T08:34:33.403477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:34:33.403477+0000","log_size":5114,"ondisk_log_size":5114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":74842112,"num_objects":1142,"num_object_clones":0,"num_object_copies":3426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1142,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14214,"num_write_kb":491392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,0],"acting":[6,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":360,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.165071+0000","last_change":"2024-02-10T08:34:23.304609+0000","last_active":"2024-02-10T08:35:43.165071+0000","last_peered":"2024-02-10T08:35:43.165071+0000","last_clean":"2024-02-10T08:35:43.165071+0000","last_became_active":"2024-02-10T08:16:56.867159+0000","last_became_peered":"2024-02-10T08:16:56.867159+0000","last_unstale":"2024-02-10T08:35:43.165071+0000","last_undegraded":"2024-02-10T08:35:43.165071+0000","last_fullsized":"2024-02-10T08:35:43.165071+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:23.304519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:04.766780+0000","last_clean_scrub_stamp":"2024-02-10T08:34:23.304519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"225'33","reported_seq":424,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.171273+0000","last_change":"2024-02-10T08:33:19.194771+0000","last_active":"2024-02-10T08:35:43.171273+0000","last_peered":"2024-02-10T08:35:43.171273+0000","last_clean":"2024-02-10T08:35:43.171273+0000","last_became_active":"2024-02-10T08:20:46.401981+0000","last_became_peered":"2024-02-10T08:20:46.401981+0000","last_unstale":"2024-02-10T08:35:43.171273+0000","last_undegraded":"2024-02-10T08:35:43.171273+0000","last_fullsized":"2024-02-10T08:35:43.171273+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'33","last_scrub_stamp":"2024-02-10T08:33:19.194672+0000","last_deep_scrub":"223'21","last_deep_scrub_stamp":"2024-02-10T08:26:33.250614+0000","last_clean_scrub_stamp":"2024-02-10T08:33:19.194672+0000","log_size":33,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":33,"num_write":25,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":388,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.166327+0000","last_change":"2024-02-10T08:32:36.980106+0000","last_active":"2024-02-10T08:35:43.166327+0000","last_peered":"2024-02-10T08:35:43.166327+0000","last_clean":"2024-02-10T08:35:43.166327+0000","last_became_active":"2024-02-10T08:32:36.979237+0000","last_became_peered":"2024-02-10T08:32:36.979237+0000","last_unstale":"2024-02-10T08:35:43.166327+0000","last_undegraded":"2024-02-10T08:35:43.166327+0000","last_fullsized":"2024-02-10T08:35:43.166327+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:16.187704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:14:44.584370+0000","last_clean_scrub_stamp":"2024-02-10T08:32:16.187704+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":364,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.162329+0000","last_change":"2024-02-10T08:33:12.974304+0000","last_active":"2024-02-10T08:35:43.162329+0000","last_peered":"2024-02-10T08:35:43.162329+0000","last_clean":"2024-02-10T08:35:43.162329+0000","last_became_active":"2024-02-10T08:16:52.788767+0000","last_became_peered":"2024-02-10T08:16:52.788767+0000","last_unstale":"2024-02-10T08:35:43.162329+0000","last_undegraded":"2024-02-10T08:35:43.162329+0000","last_fullsized":"2024-02-10T08:35:43.162329+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:12.974215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:33:12.974215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":288,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.161296+0000","last_change":"2024-02-10T08:32:29.019898+0000","last_active":"2024-02-10T08:35:43.161296+0000","last_peered":"2024-02-10T08:35:43.161296+0000","last_clean":"2024-02-10T08:35:43.161296+0000","last_became_active":"2024-02-10T08:31:33.878588+0000","last_became_peered":"2024-02-10T08:31:33.878588+0000","last_unstale":"2024-02-10T08:35:43.161296+0000","last_undegraded":"2024-02-10T08:35:43.161296+0000","last_fullsized":"2024-02-10T08:35:43.161296+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.019819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.019819+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.019819+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":92,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.165522+0000","last_change":"2024-02-10T08:34:19.149776+0000","last_active":"2024-02-10T08:35:43.165522+0000","last_peered":"2024-02-10T08:35:43.165522+0000","last_clean":"2024-02-10T08:35:43.165522+0000","last_became_active":"2024-02-10T08:31:19.726561+0000","last_became_peered":"2024-02-10T08:31:19.726561+0000","last_unstale":"2024-02-10T08:35:43.165522+0000","last_undegraded":"2024-02-10T08:35:43.165522+0000","last_fullsized":"2024-02-10T08:35:43.165522+0000","mapping_epoch":308,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":309,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:19.149688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:26:29.921562+0000","last_clean_scrub_stamp":"2024-02-10T08:34:19.149688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"386'14683","reported_seq":14741,"reported_epoch":386,"state":"active+clean","last_fresh":"2024-02-10T08:35:57.820035+0000","last_change":"2024-02-10T08:32:30.825343+0000","last_active":"2024-02-10T08:35:57.820035+0000","last_peered":"2024-02-10T08:35:57.820035+0000","last_clean":"2024-02-10T08:35:57.820035+0000","last_became_active":"2024-02-10T08:32:30.824975+0000","last_became_peered":"2024-02-10T08:32:30.824975+0000","last_unstale":"2024-02-10T08:35:57.820035+0000","last_undegraded":"2024-02-10T08:35:57.820035+0000","last_fullsized":"2024-02-10T08:35:57.820035+0000","mapping_epoch":335,"log_start":"374'9900","ondisk_log_start":"374'9900","created":335,"last_epoch_clean":336,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.947585+0000","log_size":4783,"ondisk_log_size":4783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72941568,"num_objects":1113,"num_object_clones":0,"num_object_copies":3339,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1113,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14683,"num_write_kb":505472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":361,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.168585+0000","last_change":"2024-02-10T08:33:27.613405+0000","last_active":"2024-02-10T08:35:43.168585+0000","last_peered":"2024-02-10T08:35:43.168585+0000","last_clean":"2024-02-10T08:35:43.168585+0000","last_became_active":"2024-02-10T08:16:56.857856+0000","last_became_peered":"2024-02-10T08:16:56.857856+0000","last_unstale":"2024-02-10T08:35:43.168585+0000","last_undegraded":"2024-02-10T08:35:43.168585+0000","last_fullsized":"2024-02-10T08:35:43.168585+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:27.613326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:33:27.613326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"225'17","reported_seq":156,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.166290+0000","last_change":"2024-02-10T08:34:18.368803+0000","last_active":"2024-02-10T08:35:43.166290+0000","last_peered":"2024-02-10T08:35:43.166290+0000","last_clean":"2024-02-10T08:35:43.166290+0000","last_became_active":"2024-02-10T08:32:36.984195+0000","last_became_peered":"2024-02-10T08:32:36.984195+0000","last_unstale":"2024-02-10T08:35:43.166290+0000","last_undegraded":"2024-02-10T08:35:43.166290+0000","last_fullsized":"2024-02-10T08:35:43.166290+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'17","last_scrub_stamp":"2024-02-10T08:34:18.368690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:34:18.368690+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":23,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":406,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.169561+0000","last_change":"2024-02-10T08:34:23.885476+0000","last_active":"2024-02-10T08:35:43.169561+0000","last_peered":"2024-02-10T08:35:43.169561+0000","last_clean":"2024-02-10T08:35:43.169561+0000","last_became_active":"2024-02-10T08:31:33.884021+0000","last_became_peered":"2024-02-10T08:31:33.884021+0000","last_unstale":"2024-02-10T08:35:43.169561+0000","last_undegraded":"2024-02-10T08:35:43.169561+0000","last_fullsized":"2024-02-10T08:35:43.169561+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:23.885336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:11.681169+0000","last_clean_scrub_stamp":"2024-02-10T08:34:23.885336+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"63'5","reported_seq":1506,"reported_epoch":386,"state":"active+clean","last_fresh":"2024-02-10T08:35:56.168606+0000","last_change":"2024-02-10T08:35:07.739783+0000","last_active":"2024-02-10T08:35:56.168606+0000","last_peered":"2024-02-10T08:35:56.168606+0000","last_clean":"2024-02-10T08:35:56.168606+0000","last_became_active":"2024-02-10T08:16:52.780989+0000","last_became_peered":"2024-02-10T08:16:52.780989+0000","last_unstale":"2024-02-10T08:35:56.168606+0000","last_undegraded":"2024-02-10T08:35:56.168606+0000","last_fullsized":"2024-02-10T08:35:56.168606+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'5","last_scrub_stamp":"2024-02-10T08:35:07.739620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:35:07.739620+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1134,"num_read_kb":1129,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":368,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.165196+0000","last_change":"2024-02-10T08:33:17.442371+0000","last_active":"2024-02-10T08:35:43.165196+0000","last_peered":"2024-02-10T08:35:43.165196+0000","last_clean":"2024-02-10T08:35:43.165196+0000","last_became_active":"2024-02-10T08:21:58.549733+0000","last_became_peered":"2024-02-10T08:21:58.549733+0000","last_unstale":"2024-02-10T08:35:43.165196+0000","last_undegraded":"2024-02-10T08:35:43.165196+0000","last_fullsized":"2024-02-10T08:35:43.165196+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:17.442264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:11.750537+0000","last_clean_scrub_stamp":"2024-02-10T08:33:17.442264+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.a","version":"386'14142","reported_seq":14215,"reported_epoch":386,"state":"active+clean","last_fresh":"2024-02-10T08:35:57.879449+0000","last_change":"2024-02-10T08:35:19.311656+0000","last_active":"2024-02-10T08:35:57.879449+0000","last_peered":"2024-02-10T08:35:57.879449+0000","last_clean":"2024-02-10T08:35:57.879449+0000","last_became_active":"2024-02-10T08:32:36.978852+0000","last_became_peered":"2024-02-10T08:32:36.978852+0000","last_unstale":"2024-02-10T08:35:57.879449+0000","last_undegraded":"2024-02-10T08:35:57.879449+0000","last_fullsized":"2024-02-10T08:35:57.879449+0000","mapping_epoch":339,"log_start":"372'9000","ondisk_log_start":"372'9000","created":335,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"379'11717","last_scrub_stamp":"2024-02-10T08:35:19.311581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:35:19.311581+0000","log_size":5142,"ondisk_log_size":5142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":74186752,"num_objects":1132,"num_object_clones":0,"num_object_copies":3396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1132,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14142,"num_write_kb":488768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":61,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.165937+0000","last_change":"2024-02-10T08:34:13.094510+0000","last_active":"2024-02-10T08:35:43.165937+0000","last_peered":"2024-02-10T08:35:43.165937+0000","last_clean":"2024-02-10T08:35:43.165937+0000","last_became_active":"2024-02-10T08:32:36.976141+0000","last_became_peered":"2024-02-10T08:32:36.976141+0000","last_unstale":"2024-02-10T08:35:43.165937+0000","last_undegraded":"2024-02-10T08:35:43.165937+0000","last_fullsized":"2024-02-10T08:35:43.165937+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:13.094426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:34:13.094426+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"314'42","reported_seq":721,"reported_epoch":386,"state":"active+clean","last_fresh":"2024-02-10T08:35:51.232679+0000","last_change":"2024-02-10T08:33:13.903831+0000","last_active":"2024-02-10T08:35:51.232679+0000","last_peered":"2024-02-10T08:35:51.232679+0000","last_clean":"2024-02-10T08:35:51.232679+0000","last_became_active":"2024-02-10T08:31:33.904487+0000","last_became_peered":"2024-02-10T08:31:33.904487+0000","last_unstale":"2024-02-10T08:35:51.232679+0000","last_undegraded":"2024-02-10T08:35:51.232679+0000","last_fullsized":"2024-02-10T08:35:51.232679+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":315,"parent":"0.0","parent_split_bits":0,"last_scrub":"314'42","last_scrub_stamp":"2024-02-10T08:33:13.903652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:33:13.903652+0000","log_size":42,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":66,"num_read_kb":51,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":716,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":364,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.161170+0000","last_change":"2024-02-10T08:33:15.952668+0000","last_active":"2024-02-10T08:35:43.161170+0000","last_peered":"2024-02-10T08:35:43.161170+0000","last_clean":"2024-02-10T08:35:43.161170+0000","last_became_active":"2024-02-10T08:16:52.791027+0000","last_became_peered":"2024-02-10T08:16:52.791027+0000","last_unstale":"2024-02-10T08:35:43.161170+0000","last_undegraded":"2024-02-10T08:35:43.161170+0000","last_fullsized":"2024-02-10T08:35:43.161170+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:15.952580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:33:15.952580+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":383,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.178582+0000","last_change":"2024-02-10T08:32:32.331364+0000","last_active":"2024-02-10T08:35:43.178582+0000","last_peered":"2024-02-10T08:35:43.178582+0000","last_clean":"2024-02-10T08:35:43.178582+0000","last_became_active":"2024-02-10T08:31:33.884295+0000","last_became_peered":"2024-02-10T08:31:33.884295+0000","last_unstale":"2024-02-10T08:35:43.178582+0000","last_undegraded":"2024-02-10T08:35:43.178582+0000","last_fullsized":"2024-02-10T08:35:43.178582+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:32.331286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:32:32.331286+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"386'14409","reported_seq":14468,"reported_epoch":386,"state":"active+clean","last_fresh":"2024-02-10T08:35:57.841270+0000","last_change":"2024-02-10T08:32:30.823074+0000","last_active":"2024-02-10T08:35:57.841270+0000","last_peered":"2024-02-10T08:35:57.841270+0000","last_clean":"2024-02-10T08:35:57.841270+0000","last_became_active":"2024-02-10T08:32:30.822769+0000","last_became_peered":"2024-02-10T08:32:30.822769+0000","last_unstale":"2024-02-10T08:35:57.841270+0000","last_undegraded":"2024-02-10T08:35:57.841270+0000","last_fullsized":"2024-02-10T08:35:57.841270+0000","mapping_epoch":335,"log_start":"374'10000","ondisk_log_start":"374'10000","created":335,"last_epoch_clean":336,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.947585+0000","log_size":4409,"ondisk_log_size":4409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":75431936,"num_objects":1151,"num_object_clones":0,"num_object_copies":3453,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1151,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14409,"num_write_kb":497920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"255'12","reported_seq":310,"reported_epoch":386,"state":"active+clean","last_fresh":"2024-02-10T08:35:49.198002+0000","last_change":"2024-02-10T08:32:25.571469+0000","last_active":"2024-02-10T08:35:49.198002+0000","last_peered":"2024-02-10T08:35:49.198002+0000","last_clean":"2024-02-10T08:35:49.198002+0000","last_became_active":"2024-02-10T08:28:25.952468+0000","last_became_peered":"2024-02-10T08:28:25.952468+0000","last_unstale":"2024-02-10T08:35:49.198002+0000","last_undegraded":"2024-02-10T08:35:49.198002+0000","last_fullsized":"2024-02-10T08:35:49.198002+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'12","last_scrub_stamp":"2024-02-10T08:32:25.571388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:32:25.571388+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"225'20","reported_seq":403,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.162002+0000","last_change":"2024-02-10T08:34:11.736768+0000","last_active":"2024-02-10T08:35:43.162002+0000","last_peered":"2024-02-10T08:35:43.162002+0000","last_clean":"2024-02-10T08:35:43.162002+0000","last_became_active":"2024-02-10T08:20:46.408495+0000","last_became_peered":"2024-02-10T08:20:46.408495+0000","last_unstale":"2024-02-10T08:35:43.162002+0000","last_undegraded":"2024-02-10T08:35:43.162002+0000","last_fullsized":"2024-02-10T08:35:43.162002+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'20","last_scrub_stamp":"2024-02-10T08:34:11.736600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:34:11.736600+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":378,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.162329+0000","last_change":"2024-02-10T08:33:11.869960+0000","last_active":"2024-02-10T08:35:43.162329+0000","last_peered":"2024-02-10T08:35:43.162329+0000","last_clean":"2024-02-10T08:35:43.162329+0000","last_became_active":"2024-02-10T08:28:02.760784+0000","last_became_peered":"2024-02-10T08:28:02.760784+0000","last_unstale":"2024-02-10T08:35:43.162329+0000","last_undegraded":"2024-02-10T08:35:43.162329+0000","last_fullsized":"2024-02-10T08:35:43.162329+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:11.869839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:33:11.869839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":284,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.163773+0000","last_change":"2024-02-10T08:34:11.146000+0000","last_active":"2024-02-10T08:35:43.163773+0000","last_peered":"2024-02-10T08:35:43.163773+0000","last_clean":"2024-02-10T08:35:43.163773+0000","last_became_active":"2024-02-10T08:28:25.950240+0000","last_became_peered":"2024-02-10T08:28:25.950240+0000","last_unstale":"2024-02-10T08:35:43.163773+0000","last_undegraded":"2024-02-10T08:35:43.163773+0000","last_fullsized":"2024-02-10T08:35:43.163773+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:11.145907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:34:11.145907+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"386'14641","reported_seq":14707,"reported_epoch":386,"state":"active+clean","last_fresh":"2024-02-10T08:35:57.821780+0000","last_change":"2024-02-10T08:33:56.159846+0000","last_active":"2024-02-10T08:35:57.821780+0000","last_peered":"2024-02-10T08:35:57.821780+0000","last_clean":"2024-02-10T08:35:57.821780+0000","last_became_active":"2024-02-10T08:33:56.120673+0000","last_became_peered":"2024-02-10T08:33:56.120673+0000","last_unstale":"2024-02-10T08:35:57.821780+0000","last_undegraded":"2024-02-10T08:35:57.821780+0000","last_fullsized":"2024-02-10T08:35:57.821780+0000","mapping_epoch":364,"log_start":"374'9837","ondisk_log_start":"374'9837","created":335,"last_epoch_clean":365,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.947585+0000","last_clean_scrub_stamp":"2024-02-10T08:32:29.947585+0000","log_size":4804,"ondisk_log_size":4804,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":74645504,"num_objects":1139,"num_object_clones":0,"num_object_copies":3417,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1139,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14641,"num_write_kb":504960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":379,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.167127+0000","last_change":"2024-02-10T08:33:19.671725+0000","last_active":"2024-02-10T08:35:43.167127+0000","last_peered":"2024-02-10T08:35:43.167127+0000","last_clean":"2024-02-10T08:35:43.167127+0000","last_became_active":"2024-02-10T08:28:02.777637+0000","last_became_peered":"2024-02-10T08:28:02.777637+0000","last_unstale":"2024-02-10T08:35:43.167127+0000","last_undegraded":"2024-02-10T08:35:43.167127+0000","last_fullsized":"2024-02-10T08:35:43.167127+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:19.671626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:33:19.671626+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"225'23","reported_seq":424,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.171560+0000","last_change":"2024-02-10T08:34:19.175648+0000","last_active":"2024-02-10T08:35:43.171560+0000","last_peered":"2024-02-10T08:35:43.171560+0000","last_clean":"2024-02-10T08:35:43.171560+0000","last_became_active":"2024-02-10T08:31:33.884516+0000","last_became_peered":"2024-02-10T08:31:33.884516+0000","last_unstale":"2024-02-10T08:35:43.171560+0000","last_undegraded":"2024-02-10T08:35:43.171560+0000","last_fullsized":"2024-02-10T08:35:43.171560+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'23","last_scrub_stamp":"2024-02-10T08:34:19.175575+0000","last_deep_scrub":"82'17","last_deep_scrub_stamp":"2024-02-10T08:18:21.015873+0000","last_clean_scrub_stamp":"2024-02-10T08:34:19.175575+0000","log_size":23,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":25,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"55'2","reported_seq":380,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.178678+0000","last_change":"2024-02-10T08:34:27.070443+0000","last_active":"2024-02-10T08:35:43.178678+0000","last_peered":"2024-02-10T08:35:43.178678+0000","last_clean":"2024-02-10T08:35:43.178678+0000","last_became_active":"2024-02-10T08:28:02.768279+0000","last_became_peered":"2024-02-10T08:28:02.768279+0000","last_unstale":"2024-02-10T08:35:43.178678+0000","last_undegraded":"2024-02-10T08:35:43.178678+0000","last_fullsized":"2024-02-10T08:35:43.178678+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'2","last_scrub_stamp":"2024-02-10T08:34:27.070328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:34:27.070328+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":184,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":276,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.164491+0000","last_change":"2024-02-10T08:35:12.451166+0000","last_active":"2024-02-10T08:35:43.164491+0000","last_peered":"2024-02-10T08:35:43.164491+0000","last_clean":"2024-02-10T08:35:43.164491+0000","last_became_active":"2024-02-10T08:30:24.073077+0000","last_became_peered":"2024-02-10T08:30:24.073077+0000","last_unstale":"2024-02-10T08:35:43.164491+0000","last_undegraded":"2024-02-10T08:35:43.164491+0000","last_fullsized":"2024-02-10T08:35:43.164491+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:35:12.451079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:35:12.451079+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"225'15","reported_seq":71,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.164168+0000","last_change":"2024-02-10T08:33:19.722178+0000","last_active":"2024-02-10T08:35:43.164168+0000","last_peered":"2024-02-10T08:35:43.164168+0000","last_clean":"2024-02-10T08:35:43.164168+0000","last_became_active":"2024-02-10T08:32:36.982716+0000","last_became_peered":"2024-02-10T08:32:36.982716+0000","last_unstale":"2024-02-10T08:35:43.164168+0000","last_undegraded":"2024-02-10T08:35:43.164168+0000","last_fullsized":"2024-02-10T08:35:43.164168+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'15","last_scrub_stamp":"2024-02-10T08:33:19.722084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:33:19.722084+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"55'1","reported_seq":435,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.167052+0000","last_change":"2024-02-10T08:33:28.572672+0000","last_active":"2024-02-10T08:35:43.167052+0000","last_peered":"2024-02-10T08:35:43.167052+0000","last_clean":"2024-02-10T08:35:43.167052+0000","last_became_active":"2024-02-10T08:28:02.778857+0000","last_became_peered":"2024-02-10T08:28:02.778857+0000","last_unstale":"2024-02-10T08:35:43.167052+0000","last_undegraded":"2024-02-10T08:35:43.167052+0000","last_fullsized":"2024-02-10T08:35:43.167052+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'1","last_scrub_stamp":"2024-02-10T08:33:28.572582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:33:28.572582+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":716,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":308,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.161502+0000","last_change":"2024-02-10T08:34:30.785782+0000","last_active":"2024-02-10T08:35:43.161502+0000","last_peered":"2024-02-10T08:35:43.161502+0000","last_clean":"2024-02-10T08:35:43.161502+0000","last_became_active":"2024-02-10T08:31:33.891489+0000","last_became_peered":"2024-02-10T08:31:33.891489+0000","last_unstale":"2024-02-10T08:35:43.161502+0000","last_undegraded":"2024-02-10T08:35:43.161502+0000","last_fullsized":"2024-02-10T08:35:43.161502+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:30.785679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:34:30.785679+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":228,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.165460+0000","last_change":"2024-02-10T08:34:12.117475+0000","last_active":"2024-02-10T08:35:43.165460+0000","last_peered":"2024-02-10T08:35:43.165460+0000","last_clean":"2024-02-10T08:35:43.165460+0000","last_became_active":"2024-02-10T08:28:25.999252+0000","last_became_peered":"2024-02-10T08:28:25.999252+0000","last_unstale":"2024-02-10T08:35:43.165460+0000","last_undegraded":"2024-02-10T08:35:43.165460+0000","last_fullsized":"2024-02-10T08:35:43.165460+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:12.117379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:34:12.117379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"225'15","reported_seq":332,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.166502+0000","last_change":"2024-02-10T08:32:23.310599+0000","last_active":"2024-02-10T08:35:43.166502+0000","last_peered":"2024-02-10T08:35:43.166502+0000","last_clean":"2024-02-10T08:35:43.166502+0000","last_became_active":"2024-02-10T08:31:33.891813+0000","last_became_peered":"2024-02-10T08:31:33.891813+0000","last_unstale":"2024-02-10T08:35:43.166502+0000","last_undegraded":"2024-02-10T08:35:43.166502+0000","last_fullsized":"2024-02-10T08:35:43.166502+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'15","last_scrub_stamp":"2024-02-10T08:32:23.310489+0000","last_deep_scrub":"223'9","last_deep_scrub_stamp":"2024-02-10T08:26:33.158025+0000","last_clean_scrub_stamp":"2024-02-10T08:32:23.310489+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":431,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.166991+0000","last_change":"2024-02-10T08:34:35.009855+0000","last_active":"2024-02-10T08:35:43.166991+0000","last_peered":"2024-02-10T08:35:43.166991+0000","last_clean":"2024-02-10T08:35:43.166991+0000","last_became_active":"2024-02-10T08:31:46.053553+0000","last_became_peered":"2024-02-10T08:31:46.053553+0000","last_unstale":"2024-02-10T08:35:43.166991+0000","last_undegraded":"2024-02-10T08:35:43.166991+0000","last_fullsized":"2024-02-10T08:35:43.166991+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:35.009784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:34:35.009784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":360,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.163020+0000","last_change":"2024-02-10T08:34:28.320611+0000","last_active":"2024-02-10T08:35:43.163020+0000","last_peered":"2024-02-10T08:35:43.163020+0000","last_clean":"2024-02-10T08:35:43.163020+0000","last_became_active":"2024-02-10T08:16:56.863948+0000","last_became_peered":"2024-02-10T08:16:56.863948+0000","last_unstale":"2024-02-10T08:35:43.163020+0000","last_undegraded":"2024-02-10T08:35:43.163020+0000","last_fullsized":"2024-02-10T08:35:43.163020+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:28.320524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:34:28.320524+0000","last_clean_scrub_stamp":"2024-02-10T08:34:28.320524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":368,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.164995+0000","last_change":"2024-02-10T08:33:32.430824+0000","last_active":"2024-02-10T08:35:43.164995+0000","last_peered":"2024-02-10T08:35:43.164995+0000","last_clean":"2024-02-10T08:35:43.164995+0000","last_became_active":"2024-02-10T08:20:46.398903+0000","last_became_peered":"2024-02-10T08:20:46.398903+0000","last_unstale":"2024-02-10T08:35:43.164995+0000","last_undegraded":"2024-02-10T08:35:43.164995+0000","last_fullsized":"2024-02-10T08:35:43.164995+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:32.430721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:33:32.430721+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"225'20","reported_seq":312,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.162405+0000","last_change":"2024-02-10T08:35:17.746698+0000","last_active":"2024-02-10T08:35:43.162405+0000","last_peered":"2024-02-10T08:35:43.162405+0000","last_clean":"2024-02-10T08:35:43.162405+0000","last_became_active":"2024-02-10T08:22:23.534081+0000","last_became_peered":"2024-02-10T08:22:23.534081+0000","last_unstale":"2024-02-10T08:35:43.162405+0000","last_undegraded":"2024-02-10T08:35:43.162405+0000","last_fullsized":"2024-02-10T08:35:43.162405+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'20","last_scrub_stamp":"2024-02-10T08:35:17.746555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:35:17.746555+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":24,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":364,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.161051+0000","last_change":"2024-02-10T08:32:16.110041+0000","last_active":"2024-02-10T08:35:43.161051+0000","last_peered":"2024-02-10T08:35:43.161051+0000","last_clean":"2024-02-10T08:35:43.161051+0000","last_became_active":"2024-02-10T08:16:52.789834+0000","last_became_peered":"2024-02-10T08:16:52.789834+0000","last_unstale":"2024-02-10T08:35:43.161051+0000","last_undegraded":"2024-02-10T08:35:43.161051+0000","last_fullsized":"2024-02-10T08:35:43.161051+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:16.109957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:32:16.109957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"244'12","reported_seq":643,"reported_epoch":386,"state":"active+clean","last_fresh":"2024-02-10T08:35:51.231389+0000","last_change":"2024-02-10T08:35:24.069288+0000","last_active":"2024-02-10T08:35:51.231389+0000","last_peered":"2024-02-10T08:35:51.231389+0000","last_clean":"2024-02-10T08:35:51.231389+0000","last_became_active":"2024-02-10T08:28:02.776097+0000","last_became_peered":"2024-02-10T08:28:02.776097+0000","last_unstale":"2024-02-10T08:35:51.231389+0000","last_undegraded":"2024-02-10T08:35:51.231389+0000","last_fullsized":"2024-02-10T08:35:51.231389+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"244'12","last_scrub_stamp":"2024-02-10T08:35:24.069224+0000","last_deep_scrub":"244'12","last_deep_scrub_stamp":"2024-02-10T08:35:24.069224+0000","last_clean_scrub_stamp":"2024-02-10T08:35:24.069224+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":61,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.164265+0000","last_change":"2024-02-10T08:33:07.663592+0000","last_active":"2024-02-10T08:35:43.164265+0000","last_peered":"2024-02-10T08:35:43.164265+0000","last_clean":"2024-02-10T08:35:43.164265+0000","last_became_active":"2024-02-10T08:32:36.983153+0000","last_became_peered":"2024-02-10T08:32:36.983153+0000","last_unstale":"2024-02-10T08:35:43.164265+0000","last_undegraded":"2024-02-10T08:35:43.164265+0000","last_fullsized":"2024-02-10T08:35:43.164265+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:07.663498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:05.662947+0000","last_clean_scrub_stamp":"2024-02-10T08:33:07.663498+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"225'19","reported_seq":391,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.162611+0000","last_change":"2024-02-10T08:33:18.984602+0000","last_active":"2024-02-10T08:35:43.162611+0000","last_peered":"2024-02-10T08:35:43.162611+0000","last_clean":"2024-02-10T08:35:43.162611+0000","last_became_active":"2024-02-10T08:16:55.204734+0000","last_became_peered":"2024-02-10T08:16:55.204734+0000","last_unstale":"2024-02-10T08:35:43.162611+0000","last_undegraded":"2024-02-10T08:35:43.162611+0000","last_fullsized":"2024-02-10T08:35:43.162611+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'19","last_scrub_stamp":"2024-02-10T08:33:18.984505+0000","last_deep_scrub":"213'13","last_deep_scrub_stamp":"2024-02-10T08:25:43.713333+0000","last_clean_scrub_stamp":"2024-02-10T08:33:18.984505+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":56,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.164205+0000","last_change":"2024-02-10T08:32:36.981055+0000","last_active":"2024-02-10T08:35:43.164205+0000","last_peered":"2024-02-10T08:35:43.164205+0000","last_clean":"2024-02-10T08:35:43.164205+0000","last_became_active":"2024-02-10T08:32:36.980715+0000","last_became_peered":"2024-02-10T08:32:36.980715+0000","last_unstale":"2024-02-10T08:35:43.164205+0000","last_undegraded":"2024-02-10T08:35:43.164205+0000","last_fullsized":"2024-02-10T08:35:43.164205+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:21.299448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:32:21.299448+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"314'11","reported_seq":474,"reported_epoch":386,"state":"active+clean","last_fresh":"2024-02-10T08:35:51.232454+0000","last_change":"2024-02-10T08:32:15.210339+0000","last_active":"2024-02-10T08:35:51.232454+0000","last_peered":"2024-02-10T08:35:51.232454+0000","last_clean":"2024-02-10T08:35:51.232454+0000","last_became_active":"2024-02-10T08:31:33.885840+0000","last_became_peered":"2024-02-10T08:31:33.885840+0000","last_unstale":"2024-02-10T08:35:51.232454+0000","last_undegraded":"2024-02-10T08:35:51.232454+0000","last_fullsized":"2024-02-10T08:35:51.232454+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"314'11","last_scrub_stamp":"2024-02-10T08:32:15.210224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:32:15.210224+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":347,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.178482+0000","last_change":"2024-02-10T08:35:12.180908+0000","last_active":"2024-02-10T08:35:43.178482+0000","last_peered":"2024-02-10T08:35:43.178482+0000","last_clean":"2024-02-10T08:35:43.178482+0000","last_became_active":"2024-02-10T08:20:46.395788+0000","last_became_peered":"2024-02-10T08:20:46.395788+0000","last_unstale":"2024-02-10T08:35:43.178482+0000","last_undegraded":"2024-02-10T08:35:43.178482+0000","last_fullsized":"2024-02-10T08:35:43.178482+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:35:12.180812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:35:12.180812+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"225'15","reported_seq":368,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.166026+0000","last_change":"2024-02-10T08:35:13.255320+0000","last_active":"2024-02-10T08:35:43.166026+0000","last_peered":"2024-02-10T08:35:43.166026+0000","last_clean":"2024-02-10T08:35:43.166026+0000","last_became_active":"2024-02-10T08:28:25.952354+0000","last_became_peered":"2024-02-10T08:28:25.952354+0000","last_unstale":"2024-02-10T08:35:43.166026+0000","last_undegraded":"2024-02-10T08:35:43.166026+0000","last_fullsized":"2024-02-10T08:35:43.166026+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'15","last_scrub_stamp":"2024-02-10T08:32:13.529289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:32:13.529289+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":376,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.169227+0000","last_change":"2024-02-10T08:35:25.826895+0000","last_active":"2024-02-10T08:35:43.169227+0000","last_peered":"2024-02-10T08:35:43.169227+0000","last_clean":"2024-02-10T08:35:43.169227+0000","last_became_active":"2024-02-10T08:16:52.786213+0000","last_became_peered":"2024-02-10T08:16:52.786213+0000","last_unstale":"2024-02-10T08:35:43.169227+0000","last_undegraded":"2024-02-10T08:35:43.169227+0000","last_fullsized":"2024-02-10T08:35:43.169227+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:35:25.826812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:35:25.826812+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":193,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.165410+0000","last_change":"2024-02-10T08:33:28.822022+0000","last_active":"2024-02-10T08:35:43.165410+0000","last_peered":"2024-02-10T08:35:43.165410+0000","last_clean":"2024-02-10T08:35:43.165410+0000","last_became_active":"2024-02-10T08:28:25.950221+0000","last_became_peered":"2024-02-10T08:28:25.950221+0000","last_unstale":"2024-02-10T08:35:43.165410+0000","last_undegraded":"2024-02-10T08:35:43.165410+0000","last_fullsized":"2024-02-10T08:35:43.165410+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:28.821928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:33:28.821928+0000","last_clean_scrub_stamp":"2024-02-10T08:33:28.821928+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":199,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.164163+0000","last_change":"2024-02-10T08:33:22.771214+0000","last_active":"2024-02-10T08:35:43.164163+0000","last_peered":"2024-02-10T08:35:43.164163+0000","last_clean":"2024-02-10T08:35:43.164163+0000","last_became_active":"2024-02-10T08:30:24.070440+0000","last_became_peered":"2024-02-10T08:30:24.070440+0000","last_unstale":"2024-02-10T08:35:43.164163+0000","last_undegraded":"2024-02-10T08:35:43.164163+0000","last_fullsized":"2024-02-10T08:35:43.164163+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:22.771132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:33:22.771132+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"225'24","reported_seq":399,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.173895+0000","last_change":"2024-02-10T08:33:06.269127+0000","last_active":"2024-02-10T08:35:43.173895+0000","last_peered":"2024-02-10T08:35:43.173895+0000","last_clean":"2024-02-10T08:35:43.173895+0000","last_became_active":"2024-02-10T08:20:46.396130+0000","last_became_peered":"2024-02-10T08:20:46.396130+0000","last_unstale":"2024-02-10T08:35:43.173895+0000","last_undegraded":"2024-02-10T08:35:43.173895+0000","last_fullsized":"2024-02-10T08:35:43.173895+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'24","last_scrub_stamp":"2024-02-10T08:33:06.269024+0000","last_deep_scrub":"201'16","last_deep_scrub_stamp":"2024-02-10T08:24:49.177357+0000","last_clean_scrub_stamp":"2024-02-10T08:33:06.269024+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":382,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.161963+0000","last_change":"2024-02-10T08:33:10.874200+0000","last_active":"2024-02-10T08:35:43.161963+0000","last_peered":"2024-02-10T08:35:43.161963+0000","last_clean":"2024-02-10T08:35:43.161963+0000","last_became_active":"2024-02-10T08:32:36.974379+0000","last_became_peered":"2024-02-10T08:32:36.974379+0000","last_unstale":"2024-02-10T08:35:43.161963+0000","last_undegraded":"2024-02-10T08:35:43.161963+0000","last_fullsized":"2024-02-10T08:35:43.161963+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:10.874017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:33:10.874017+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":376,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.162092+0000","last_change":"2024-02-10T08:33:06.791408+0000","last_active":"2024-02-10T08:35:43.162092+0000","last_peered":"2024-02-10T08:35:43.162092+0000","last_clean":"2024-02-10T08:35:43.162092+0000","last_became_active":"2024-02-10T08:31:33.893973+0000","last_became_peered":"2024-02-10T08:31:33.893973+0000","last_unstale":"2024-02-10T08:35:43.162092+0000","last_undegraded":"2024-02-10T08:35:43.162092+0000","last_fullsized":"2024-02-10T08:35:43.162092+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:06.791295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:33:06.791295+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":61,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.163862+0000","last_change":"2024-02-10T08:34:38.015567+0000","last_active":"2024-02-10T08:35:43.163862+0000","last_peered":"2024-02-10T08:35:43.163862+0000","last_clean":"2024-02-10T08:35:43.163862+0000","last_became_active":"2024-02-10T08:32:36.979093+0000","last_became_peered":"2024-02-10T08:32:36.979093+0000","last_unstale":"2024-02-10T08:35:43.163862+0000","last_undegraded":"2024-02-10T08:35:43.163862+0000","last_fullsized":"2024-02-10T08:35:43.163862+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:38.015515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:34:38.015515+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,5],"acting":[0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"225'8","reported_seq":294,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.160486+0000","last_change":"2024-02-10T08:35:08.720411+0000","last_active":"2024-02-10T08:35:43.160486+0000","last_peered":"2024-02-10T08:35:43.160486+0000","last_clean":"2024-02-10T08:35:43.160486+0000","last_became_active":"2024-02-10T08:22:23.522936+0000","last_became_peered":"2024-02-10T08:22:23.522936+0000","last_unstale":"2024-02-10T08:35:43.160486+0000","last_undegraded":"2024-02-10T08:35:43.160486+0000","last_fullsized":"2024-02-10T08:35:43.160486+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'8","last_scrub_stamp":"2024-02-10T08:35:08.720332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:35:08.720332+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,6],"acting":[1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":369,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.163089+0000","last_change":"2024-02-10T08:33:22.025841+0000","last_active":"2024-02-10T08:35:43.163089+0000","last_peered":"2024-02-10T08:35:43.163089+0000","last_clean":"2024-02-10T08:35:43.163089+0000","last_became_active":"2024-02-10T08:16:52.788704+0000","last_became_peered":"2024-02-10T08:16:52.788704+0000","last_unstale":"2024-02-10T08:35:43.163089+0000","last_undegraded":"2024-02-10T08:35:43.163089+0000","last_fullsized":"2024-02-10T08:35:43.163089+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:22.025769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:33:22.025769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":375,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.166956+0000","last_change":"2024-02-10T08:35:15.873051+0000","last_active":"2024-02-10T08:35:43.166956+0000","last_peered":"2024-02-10T08:35:43.166956+0000","last_clean":"2024-02-10T08:35:43.166956+0000","last_became_active":"2024-02-10T08:20:46.397495+0000","last_became_peered":"2024-02-10T08:20:46.397495+0000","last_unstale":"2024-02-10T08:35:43.166956+0000","last_undegraded":"2024-02-10T08:35:43.166956+0000","last_fullsized":"2024-02-10T08:35:43.166956+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:35:15.872974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:35:15.872974+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":382,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.164194+0000","last_change":"2024-02-10T08:34:38.328749+0000","last_active":"2024-02-10T08:35:43.164194+0000","last_peered":"2024-02-10T08:35:43.164194+0000","last_clean":"2024-02-10T08:35:43.164194+0000","last_became_active":"2024-02-10T08:30:24.064419+0000","last_became_peered":"2024-02-10T08:30:24.064419+0000","last_unstale":"2024-02-10T08:35:43.164194+0000","last_undegraded":"2024-02-10T08:35:43.164194+0000","last_fullsized":"2024-02-10T08:35:43.164194+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:38.328641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:27.276490+0000","last_clean_scrub_stamp":"2024-02-10T08:34:38.328641+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"225'19","reported_seq":308,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.164111+0000","last_change":"2024-02-10T08:29:22.312103+0000","last_active":"2024-02-10T08:35:43.164111+0000","last_peered":"2024-02-10T08:35:43.164111+0000","last_clean":"2024-02-10T08:35:43.164111+0000","last_became_active":"2024-02-10T08:22:23.526198+0000","last_became_peered":"2024-02-10T08:22:23.526198+0000","last_unstale":"2024-02-10T08:35:43.164111+0000","last_undegraded":"2024-02-10T08:35:43.164111+0000","last_fullsized":"2024-02-10T08:35:43.164111+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'19","last_scrub_stamp":"2024-02-10T08:29:22.312001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:29:22.312001+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":24,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":369,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.169793+0000","last_change":"2024-02-10T08:35:11.849852+0000","last_active":"2024-02-10T08:35:43.169793+0000","last_peered":"2024-02-10T08:35:43.169793+0000","last_clean":"2024-02-10T08:35:43.169793+0000","last_became_active":"2024-02-10T08:16:52.788629+0000","last_became_peered":"2024-02-10T08:16:52.788629+0000","last_unstale":"2024-02-10T08:35:43.169793+0000","last_undegraded":"2024-02-10T08:35:43.169793+0000","last_fullsized":"2024-02-10T08:35:43.169793+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:35:11.849772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:38.360929+0000","last_clean_scrub_stamp":"2024-02-10T08:35:11.849772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":375,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.166676+0000","last_change":"2024-02-10T08:34:37.281857+0000","last_active":"2024-02-10T08:35:43.166676+0000","last_peered":"2024-02-10T08:35:43.166676+0000","last_clean":"2024-02-10T08:35:43.166676+0000","last_became_active":"2024-02-10T08:20:46.399838+0000","last_became_peered":"2024-02-10T08:20:46.399838+0000","last_unstale":"2024-02-10T08:35:43.166676+0000","last_undegraded":"2024-02-10T08:35:43.166676+0000","last_fullsized":"2024-02-10T08:35:43.166676+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:37.281763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:34:37.281763+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":61,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.164289+0000","last_change":"2024-02-10T08:34:30.191894+0000","last_active":"2024-02-10T08:35:43.164289+0000","last_peered":"2024-02-10T08:35:43.164289+0000","last_clean":"2024-02-10T08:35:43.164289+0000","last_became_active":"2024-02-10T08:32:36.982778+0000","last_became_peered":"2024-02-10T08:32:36.982778+0000","last_unstale":"2024-02-10T08:35:43.164289+0000","last_undegraded":"2024-02-10T08:35:43.164289+0000","last_fullsized":"2024-02-10T08:35:43.164289+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:30.191790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:34:30.191790+0000","last_clean_scrub_stamp":"2024-02-10T08:34:30.191790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"225'25","reported_seq":470,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.164560+0000","last_change":"2024-02-10T08:32:32.566504+0000","last_active":"2024-02-10T08:35:43.164560+0000","last_peered":"2024-02-10T08:35:43.164560+0000","last_clean":"2024-02-10T08:35:43.164560+0000","last_became_active":"2024-02-10T08:31:33.879680+0000","last_became_peered":"2024-02-10T08:31:33.879680+0000","last_unstale":"2024-02-10T08:35:43.164560+0000","last_undegraded":"2024-02-10T08:35:43.164560+0000","last_fullsized":"2024-02-10T08:35:43.164560+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'25","last_scrub_stamp":"2024-02-10T08:32:32.566437+0000","last_deep_scrub":"74'15","last_deep_scrub_stamp":"2024-02-10T08:17:57.637346+0000","last_clean_scrub_stamp":"2024-02-10T08:32:32.566437+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":24,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":379,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.160710+0000","last_change":"2024-02-10T08:35:10.165815+0000","last_active":"2024-02-10T08:35:43.160710+0000","last_peered":"2024-02-10T08:35:43.160710+0000","last_clean":"2024-02-10T08:35:43.160710+0000","last_became_active":"2024-02-10T08:20:46.392466+0000","last_became_peered":"2024-02-10T08:20:46.392466+0000","last_unstale":"2024-02-10T08:35:43.160710+0000","last_undegraded":"2024-02-10T08:35:43.160710+0000","last_fullsized":"2024-02-10T08:35:43.160710+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:35:10.165751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:29:26.072031+0000","last_clean_scrub_stamp":"2024-02-10T08:35:10.165751+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1f","version":"111'11","reported_seq":621,"reported_epoch":386,"state":"active+clean","last_fresh":"2024-02-10T08:35:51.232251+0000","last_change":"2024-02-10T08:34:26.020988+0000","last_active":"2024-02-10T08:35:51.232251+0000","last_peered":"2024-02-10T08:35:51.232251+0000","last_clean":"2024-02-10T08:35:51.232251+0000","last_became_active":"2024-02-10T08:20:46.402663+0000","last_became_peered":"2024-02-10T08:20:46.402663+0000","last_unstale":"2024-02-10T08:35:51.232251+0000","last_undegraded":"2024-02-10T08:35:51.232251+0000","last_fullsized":"2024-02-10T08:35:51.232251+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'11","last_scrub_stamp":"2024-02-10T08:34:26.020887+0000","last_deep_scrub":"111'11","last_deep_scrub_stamp":"2024-02-10T08:32:17.249718+0000","last_clean_scrub_stamp":"2024-02-10T08:34:26.020887+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"87'2","reported_seq":360,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.165032+0000","last_change":"2024-02-10T08:33:29.353243+0000","last_active":"2024-02-10T08:35:43.165032+0000","last_peered":"2024-02-10T08:35:43.165032+0000","last_clean":"2024-02-10T08:35:43.165032+0000","last_became_active":"2024-02-10T08:16:58.859047+0000","last_became_peered":"2024-02-10T08:16:58.859047+0000","last_unstale":"2024-02-10T08:35:43.165032+0000","last_undegraded":"2024-02-10T08:35:43.165032+0000","last_fullsized":"2024-02-10T08:35:43.165032+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'2","last_scrub_stamp":"2024-02-10T08:33:29.353122+0000","last_deep_scrub":"87'2","last_deep_scrub_stamp":"2024-02-10T08:19:29.207531+0000","last_clean_scrub_stamp":"2024-02-10T08:33:29.353122+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"225'19","reported_seq":401,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.170049+0000","last_change":"2024-02-10T08:35:26.779936+0000","last_active":"2024-02-10T08:35:43.170049+0000","last_peered":"2024-02-10T08:35:43.170049+0000","last_clean":"2024-02-10T08:35:43.170049+0000","last_became_active":"2024-02-10T08:16:54.852665+0000","last_became_peered":"2024-02-10T08:16:54.852665+0000","last_unstale":"2024-02-10T08:35:43.170049+0000","last_undegraded":"2024-02-10T08:35:43.170049+0000","last_fullsized":"2024-02-10T08:35:43.170049+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'19","last_scrub_stamp":"2024-02-10T08:35:26.779875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:35:26.779875+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":306,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.166904+0000","last_change":"2024-02-10T08:34:11.022449+0000","last_active":"2024-02-10T08:35:43.166904+0000","last_peered":"2024-02-10T08:35:43.166904+0000","last_clean":"2024-02-10T08:35:43.166904+0000","last_became_active":"2024-02-10T08:31:33.878473+0000","last_became_peered":"2024-02-10T08:31:33.878473+0000","last_unstale":"2024-02-10T08:35:43.166904+0000","last_undegraded":"2024-02-10T08:35:43.166904+0000","last_fullsized":"2024-02-10T08:35:43.166904+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:11.022357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:25:42.124914+0000","last_clean_scrub_stamp":"2024-02-10T08:34:11.022357+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":190,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.164550+0000","last_change":"2024-02-10T08:32:26.589167+0000","last_active":"2024-02-10T08:35:43.164550+0000","last_peered":"2024-02-10T08:35:43.164550+0000","last_clean":"2024-02-10T08:35:43.164550+0000","last_became_active":"2024-02-10T08:28:25.951312+0000","last_became_peered":"2024-02-10T08:28:25.951312+0000","last_unstale":"2024-02-10T08:35:43.164550+0000","last_undegraded":"2024-02-10T08:35:43.164550+0000","last_fullsized":"2024-02-10T08:35:43.164550+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:26.589082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:32:26.589082+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":369,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.161773+0000","last_change":"2024-02-10T08:34:10.742336+0000","last_active":"2024-02-10T08:35:43.161773+0000","last_peered":"2024-02-10T08:35:43.161773+0000","last_clean":"2024-02-10T08:35:43.161773+0000","last_became_active":"2024-02-10T08:20:46.408504+0000","last_became_peered":"2024-02-10T08:20:46.408504+0000","last_unstale":"2024-02-10T08:35:43.161773+0000","last_undegraded":"2024-02-10T08:35:43.161773+0000","last_fullsized":"2024-02-10T08:35:43.161773+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:10.742154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:22.104988+0000","last_clean_scrub_stamp":"2024-02-10T08:34:10.742154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"330'34","reported_seq":468,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.167504+0000","last_change":"2024-02-10T08:34:10.804210+0000","last_active":"2024-02-10T08:35:43.167504+0000","last_peered":"2024-02-10T08:35:43.167504+0000","last_clean":"2024-02-10T08:35:43.167504+0000","last_became_active":"2024-02-10T08:31:33.894960+0000","last_became_peered":"2024-02-10T08:31:33.894960+0000","last_unstale":"2024-02-10T08:35:43.167504+0000","last_undegraded":"2024-02-10T08:35:43.167504+0000","last_fullsized":"2024-02-10T08:35:43.167504+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"330'34","last_scrub_stamp":"2024-02-10T08:34:10.804112+0000","last_deep_scrub":"330'34","last_deep_scrub_stamp":"2024-02-10T08:32:17.481832+0000","last_clean_scrub_stamp":"2024-02-10T08:34:10.804112+0000","log_size":34,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":379,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.168526+0000","last_change":"2024-02-10T08:33:13.175633+0000","last_active":"2024-02-10T08:35:43.168526+0000","last_peered":"2024-02-10T08:35:43.168526+0000","last_clean":"2024-02-10T08:35:43.168526+0000","last_became_active":"2024-02-10T08:20:46.396303+0000","last_became_peered":"2024-02-10T08:20:46.396303+0000","last_unstale":"2024-02-10T08:35:43.168526+0000","last_undegraded":"2024-02-10T08:35:43.168526+0000","last_fullsized":"2024-02-10T08:35:43.168526+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:13.175559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:10.370746+0000","last_clean_scrub_stamp":"2024-02-10T08:33:13.175559+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":389,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.162196+0000","last_change":"2024-02-10T08:34:20.720576+0000","last_active":"2024-02-10T08:35:43.162196+0000","last_peered":"2024-02-10T08:35:43.162196+0000","last_clean":"2024-02-10T08:35:43.162196+0000","last_became_active":"2024-02-10T08:28:02.763523+0000","last_became_peered":"2024-02-10T08:28:02.763523+0000","last_unstale":"2024-02-10T08:35:43.162196+0000","last_undegraded":"2024-02-10T08:35:43.162196+0000","last_fullsized":"2024-02-10T08:35:43.162196+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:20.719812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:34:20.719812+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":337,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.178731+0000","last_change":"2024-02-10T08:33:19.356128+0000","last_active":"2024-02-10T08:35:43.178731+0000","last_peered":"2024-02-10T08:35:43.178731+0000","last_clean":"2024-02-10T08:35:43.178731+0000","last_became_active":"2024-02-10T08:20:46.403378+0000","last_became_peered":"2024-02-10T08:20:46.403378+0000","last_unstale":"2024-02-10T08:35:43.178731+0000","last_undegraded":"2024-02-10T08:35:43.178731+0000","last_fullsized":"2024-02-10T08:35:43.178731+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:19.356038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:33:19.356038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"226'23","reported_seq":371,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.162126+0000","last_change":"2024-02-10T08:33:31.665259+0000","last_active":"2024-02-10T08:35:43.162126+0000","last_peered":"2024-02-10T08:35:43.162126+0000","last_clean":"2024-02-10T08:35:43.162126+0000","last_became_active":"2024-02-10T08:31:33.891562+0000","last_became_peered":"2024-02-10T08:31:33.891562+0000","last_unstale":"2024-02-10T08:35:43.162126+0000","last_undegraded":"2024-02-10T08:35:43.162126+0000","last_fullsized":"2024-02-10T08:35:43.162126+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"226'23","last_scrub_stamp":"2024-02-10T08:33:31.665189+0000","last_deep_scrub":"226'23","last_deep_scrub_stamp":"2024-02-10T08:33:31.665189+0000","last_clean_scrub_stamp":"2024-02-10T08:33:31.665189+0000","log_size":23,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":25,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":283,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.164596+0000","last_change":"2024-02-10T08:32:22.275761+0000","last_active":"2024-02-10T08:35:43.164596+0000","last_peered":"2024-02-10T08:35:43.164596+0000","last_clean":"2024-02-10T08:35:43.164596+0000","last_became_active":"2024-02-10T08:31:33.879918+0000","last_became_peered":"2024-02-10T08:31:33.879918+0000","last_unstale":"2024-02-10T08:35:43.164596+0000","last_undegraded":"2024-02-10T08:35:43.164596+0000","last_fullsized":"2024-02-10T08:35:43.164596+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:22.275679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:32:22.275679+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":339,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.174708+0000","last_change":"2024-02-10T08:35:19.051893+0000","last_active":"2024-02-10T08:35:43.174708+0000","last_peered":"2024-02-10T08:35:43.174708+0000","last_clean":"2024-02-10T08:35:43.174708+0000","last_became_active":"2024-02-10T08:20:46.398532+0000","last_became_peered":"2024-02-10T08:20:46.398532+0000","last_unstale":"2024-02-10T08:35:43.174708+0000","last_undegraded":"2024-02-10T08:35:43.174708+0000","last_fullsized":"2024-02-10T08:35:43.174708+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:35:19.051801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:35:19.051801+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":275,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.170170+0000","last_change":"2024-02-10T08:34:27.097346+0000","last_active":"2024-02-10T08:35:43.170170+0000","last_peered":"2024-02-10T08:35:43.170170+0000","last_clean":"2024-02-10T08:35:43.170170+0000","last_became_active":"2024-02-10T08:22:23.526229+0000","last_became_peered":"2024-02-10T08:22:23.526229+0000","last_unstale":"2024-02-10T08:35:43.170170+0000","last_undegraded":"2024-02-10T08:35:43.170170+0000","last_fullsized":"2024-02-10T08:35:43.170170+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:27.097266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:34:27.097266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1a","version":"225'15","reported_seq":93,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.171078+0000","last_change":"2024-02-10T08:34:25.085877+0000","last_active":"2024-02-10T08:35:43.171078+0000","last_peered":"2024-02-10T08:35:43.171078+0000","last_clean":"2024-02-10T08:35:43.171078+0000","last_became_active":"2024-02-10T08:31:46.069680+0000","last_became_peered":"2024-02-10T08:31:46.069680+0000","last_unstale":"2024-02-10T08:35:43.171078+0000","last_undegraded":"2024-02-10T08:35:43.171078+0000","last_fullsized":"2024-02-10T08:35:43.171078+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'15","last_scrub_stamp":"2024-02-10T08:34:25.085814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:34:25.085814+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":359,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.164849+0000","last_change":"2024-02-10T08:29:26.213501+0000","last_active":"2024-02-10T08:35:43.164849+0000","last_peered":"2024-02-10T08:35:43.164849+0000","last_clean":"2024-02-10T08:35:43.164849+0000","last_became_active":"2024-02-10T08:16:52.787865+0000","last_became_peered":"2024-02-10T08:16:52.787865+0000","last_unstale":"2024-02-10T08:35:43.164849+0000","last_undegraded":"2024-02-10T08:35:43.164849+0000","last_fullsized":"2024-02-10T08:35:43.164849+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:26.213417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:28.028556+0000","last_clean_scrub_stamp":"2024-02-10T08:29:26.213417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":396,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.162289+0000","last_change":"2024-02-10T08:35:08.193565+0000","last_active":"2024-02-10T08:35:43.162289+0000","last_peered":"2024-02-10T08:35:43.162289+0000","last_clean":"2024-02-10T08:35:43.162289+0000","last_became_active":"2024-02-10T08:28:19.065132+0000","last_became_peered":"2024-02-10T08:28:19.065132+0000","last_unstale":"2024-02-10T08:35:43.162289+0000","last_undegraded":"2024-02-10T08:35:43.162289+0000","last_fullsized":"2024-02-10T08:35:43.162289+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:35:08.193502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:35:08.193502+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,7],"acting":[5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":61,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.163998+0000","last_change":"2024-02-10T08:33:08.700632+0000","last_active":"2024-02-10T08:35:43.163998+0000","last_peered":"2024-02-10T08:35:43.163998+0000","last_clean":"2024-02-10T08:35:43.163998+0000","last_became_active":"2024-02-10T08:32:36.978752+0000","last_became_peered":"2024-02-10T08:32:36.978752+0000","last_unstale":"2024-02-10T08:35:43.163998+0000","last_undegraded":"2024-02-10T08:35:43.163998+0000","last_fullsized":"2024-02-10T08:35:43.163998+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:08.700527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:33:08.700527+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"225'7","reported_seq":388,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.174016+0000","last_change":"2024-02-10T08:32:22.340287+0000","last_active":"2024-02-10T08:35:43.174016+0000","last_peered":"2024-02-10T08:35:43.174016+0000","last_clean":"2024-02-10T08:35:43.174016+0000","last_became_active":"2024-02-10T08:27:27.715306+0000","last_became_peered":"2024-02-10T08:27:27.715306+0000","last_unstale":"2024-02-10T08:35:43.174016+0000","last_undegraded":"2024-02-10T08:35:43.174016+0000","last_fullsized":"2024-02-10T08:35:43.174016+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'7","last_scrub_stamp":"2024-02-10T08:32:22.340191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:32:22.340191+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":9,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"55'1","reported_seq":392,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.165070+0000","last_change":"2024-02-10T08:33:06.363742+0000","last_active":"2024-02-10T08:35:43.165070+0000","last_peered":"2024-02-10T08:35:43.165070+0000","last_clean":"2024-02-10T08:35:43.165070+0000","last_became_active":"2024-02-10T08:28:02.761299+0000","last_became_peered":"2024-02-10T08:28:02.761299+0000","last_unstale":"2024-02-10T08:35:43.165070+0000","last_undegraded":"2024-02-10T08:35:43.165070+0000","last_fullsized":"2024-02-10T08:35:43.165070+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'1","last_scrub_stamp":"2024-02-10T08:33:06.363627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:33:06.363627+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1746,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":375,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.164059+0000","last_change":"2024-02-10T08:34:12.333244+0000","last_active":"2024-02-10T08:35:43.164059+0000","last_peered":"2024-02-10T08:35:43.164059+0000","last_clean":"2024-02-10T08:35:43.164059+0000","last_became_active":"2024-02-10T08:20:46.406783+0000","last_became_peered":"2024-02-10T08:20:46.406783+0000","last_unstale":"2024-02-10T08:35:43.164059+0000","last_undegraded":"2024-02-10T08:35:43.164059+0000","last_fullsized":"2024-02-10T08:35:43.164059+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:12.333167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:34:12.333167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":376,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.160953+0000","last_change":"2024-02-10T08:34:34.307258+0000","last_active":"2024-02-10T08:35:43.160953+0000","last_peered":"2024-02-10T08:35:43.160953+0000","last_clean":"2024-02-10T08:35:43.160953+0000","last_became_active":"2024-02-10T08:31:33.886617+0000","last_became_peered":"2024-02-10T08:31:33.886617+0000","last_unstale":"2024-02-10T08:35:43.160953+0000","last_undegraded":"2024-02-10T08:35:43.160953+0000","last_fullsized":"2024-02-10T08:35:43.160953+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:34.307158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:34:34.307158+0000","last_clean_scrub_stamp":"2024-02-10T08:34:34.307158+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"358'19","reported_seq":365,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.171083+0000","last_change":"2024-02-10T08:33:34.450999+0000","last_active":"2024-02-10T08:35:43.171083+0000","last_peered":"2024-02-10T08:35:43.171083+0000","last_clean":"2024-02-10T08:35:43.171083+0000","last_became_active":"2024-02-10T08:20:46.404966+0000","last_became_peered":"2024-02-10T08:20:46.404966+0000","last_unstale":"2024-02-10T08:35:43.171083+0000","last_undegraded":"2024-02-10T08:35:43.171083+0000","last_fullsized":"2024-02-10T08:35:43.171083+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"358'19","last_scrub_stamp":"2024-02-10T08:33:34.450897+0000","last_deep_scrub":"358'19","last_deep_scrub_stamp":"2024-02-10T08:33:34.450897+0000","last_clean_scrub_stamp":"2024-02-10T08:33:34.450897+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":67,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.165192+0000","last_change":"2024-02-10T08:35:07.250085+0000","last_active":"2024-02-10T08:35:43.165192+0000","last_peered":"2024-02-10T08:35:43.165192+0000","last_clean":"2024-02-10T08:35:43.165192+0000","last_became_active":"2024-02-10T08:32:36.982675+0000","last_became_peered":"2024-02-10T08:32:36.982675+0000","last_unstale":"2024-02-10T08:35:43.165192+0000","last_undegraded":"2024-02-10T08:35:43.165192+0000","last_fullsized":"2024-02-10T08:35:43.165192+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:35:07.249972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:35:07.249972+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,5],"acting":[0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":356,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.161121+0000","last_change":"2024-02-10T08:33:08.870508+0000","last_active":"2024-02-10T08:35:43.161121+0000","last_peered":"2024-02-10T08:35:43.161121+0000","last_clean":"2024-02-10T08:35:43.161121+0000","last_became_active":"2024-02-10T08:16:56.863353+0000","last_became_peered":"2024-02-10T08:16:56.863353+0000","last_unstale":"2024-02-10T08:35:43.161121+0000","last_undegraded":"2024-02-10T08:35:43.161121+0000","last_fullsized":"2024-02-10T08:35:43.161121+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:08.870342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:33:08.870342+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":343,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.173664+0000","last_change":"2024-02-10T08:34:39.027380+0000","last_active":"2024-02-10T08:35:43.173664+0000","last_peered":"2024-02-10T08:35:43.173664+0000","last_clean":"2024-02-10T08:35:43.173664+0000","last_became_active":"2024-02-10T08:20:46.405314+0000","last_became_peered":"2024-02-10T08:20:46.405314+0000","last_unstale":"2024-02-10T08:35:43.173664+0000","last_undegraded":"2024-02-10T08:35:43.173664+0000","last_fullsized":"2024-02-10T08:35:43.173664+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:39.027284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:29:25.024412+0000","last_clean_scrub_stamp":"2024-02-10T08:34:39.027284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"225'27","reported_seq":425,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.169371+0000","last_change":"2024-02-10T08:33:09.659351+0000","last_active":"2024-02-10T08:35:43.169371+0000","last_peered":"2024-02-10T08:35:43.169371+0000","last_clean":"2024-02-10T08:35:43.169371+0000","last_became_active":"2024-02-10T08:31:33.883535+0000","last_became_peered":"2024-02-10T08:31:33.883535+0000","last_unstale":"2024-02-10T08:35:43.169371+0000","last_undegraded":"2024-02-10T08:35:43.169371+0000","last_fullsized":"2024-02-10T08:35:43.169371+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'27","last_scrub_stamp":"2024-02-10T08:33:09.659240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:33:09.659240+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":61,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.164301+0000","last_change":"2024-02-10T08:33:10.725696+0000","last_active":"2024-02-10T08:35:43.164301+0000","last_peered":"2024-02-10T08:35:43.164301+0000","last_clean":"2024-02-10T08:35:43.164301+0000","last_became_active":"2024-02-10T08:32:36.977972+0000","last_became_peered":"2024-02-10T08:32:36.977972+0000","last_unstale":"2024-02-10T08:35:43.164301+0000","last_undegraded":"2024-02-10T08:35:43.164301+0000","last_fullsized":"2024-02-10T08:35:43.164301+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:10.725600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:33:10.725600+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":83,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.171014+0000","last_change":"2024-02-10T08:33:23.437506+0000","last_active":"2024-02-10T08:35:43.171014+0000","last_peered":"2024-02-10T08:35:43.171014+0000","last_clean":"2024-02-10T08:35:43.171014+0000","last_became_active":"2024-02-10T08:31:46.057858+0000","last_became_peered":"2024-02-10T08:31:46.057858+0000","last_unstale":"2024-02-10T08:35:43.171014+0000","last_undegraded":"2024-02-10T08:35:43.171014+0000","last_fullsized":"2024-02-10T08:35:43.171014+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:23.437405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:33:23.437405+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":288,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.164364+0000","last_change":"2024-02-10T08:35:19.525731+0000","last_active":"2024-02-10T08:35:43.164364+0000","last_peered":"2024-02-10T08:35:43.164364+0000","last_clean":"2024-02-10T08:35:43.164364+0000","last_became_active":"2024-02-10T08:31:33.880328+0000","last_became_peered":"2024-02-10T08:31:33.880328+0000","last_unstale":"2024-02-10T08:35:43.164364+0000","last_undegraded":"2024-02-10T08:35:43.164364+0000","last_fullsized":"2024-02-10T08:35:43.164364+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:35:19.525667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:35:19.525667+0000","last_clean_scrub_stamp":"2024-02-10T08:35:19.525667+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":272,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.160901+0000","last_change":"2024-02-10T08:33:19.782701+0000","last_active":"2024-02-10T08:35:43.160901+0000","last_peered":"2024-02-10T08:35:43.160901+0000","last_clean":"2024-02-10T08:35:43.160901+0000","last_became_active":"2024-02-10T08:22:00.581772+0000","last_became_peered":"2024-02-10T08:22:00.581772+0000","last_unstale":"2024-02-10T08:35:43.160901+0000","last_undegraded":"2024-02-10T08:35:43.160901+0000","last_fullsized":"2024-02-10T08:35:43.160901+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:19.782523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:33:19.782523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,7],"acting":[1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":290,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.163767+0000","last_change":"2024-02-10T08:33:10.338393+0000","last_active":"2024-02-10T08:35:43.163767+0000","last_peered":"2024-02-10T08:35:43.163767+0000","last_clean":"2024-02-10T08:35:43.163767+0000","last_became_active":"2024-02-10T08:31:46.054713+0000","last_became_peered":"2024-02-10T08:31:46.054713+0000","last_unstale":"2024-02-10T08:35:43.163767+0000","last_undegraded":"2024-02-10T08:35:43.163767+0000","last_fullsized":"2024-02-10T08:35:43.163767+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:10.338257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:33:10.338257+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":279,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.166958+0000","last_change":"2024-02-10T08:34:21.117300+0000","last_active":"2024-02-10T08:35:43.166958+0000","last_peered":"2024-02-10T08:35:43.166958+0000","last_clean":"2024-02-10T08:35:43.166958+0000","last_became_active":"2024-02-10T08:22:00.600200+0000","last_became_peered":"2024-02-10T08:22:00.600200+0000","last_unstale":"2024-02-10T08:35:43.166958+0000","last_undegraded":"2024-02-10T08:35:43.166958+0000","last_fullsized":"2024-02-10T08:35:43.166958+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:21.117198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:34:21.117198+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1],"acting":[6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":261,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.164444+0000","last_change":"2024-02-10T08:33:24.802823+0000","last_active":"2024-02-10T08:35:43.164444+0000","last_peered":"2024-02-10T08:35:43.164444+0000","last_clean":"2024-02-10T08:35:43.164444+0000","last_became_active":"2024-02-10T08:28:25.999335+0000","last_became_peered":"2024-02-10T08:28:25.999335+0000","last_unstale":"2024-02-10T08:35:43.164444+0000","last_undegraded":"2024-02-10T08:35:43.164444+0000","last_fullsized":"2024-02-10T08:35:43.164444+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:24.802724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:33:24.802724+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":386,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.162384+0000","last_change":"2024-02-10T08:33:24.018372+0000","last_active":"2024-02-10T08:35:43.162384+0000","last_peered":"2024-02-10T08:35:43.162384+0000","last_clean":"2024-02-10T08:35:43.162384+0000","last_became_active":"2024-02-10T08:31:33.879440+0000","last_became_peered":"2024-02-10T08:31:33.879440+0000","last_unstale":"2024-02-10T08:35:43.162384+0000","last_undegraded":"2024-02-10T08:35:43.162384+0000","last_fullsized":"2024-02-10T08:35:43.162384+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:24.018273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:33:24.018273+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":387,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.170768+0000","last_change":"2024-02-10T08:33:25.314878+0000","last_active":"2024-02-10T08:35:43.170768+0000","last_peered":"2024-02-10T08:35:43.170768+0000","last_clean":"2024-02-10T08:35:43.170768+0000","last_became_active":"2024-02-10T08:27:27.710587+0000","last_became_peered":"2024-02-10T08:27:27.710587+0000","last_unstale":"2024-02-10T08:35:43.170768+0000","last_undegraded":"2024-02-10T08:35:43.170768+0000","last_fullsized":"2024-02-10T08:35:43.170768+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:25.314779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:11.750537+0000","last_clean_scrub_stamp":"2024-02-10T08:33:25.314779+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,1],"acting":[6,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":290,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.162299+0000","last_change":"2024-02-10T08:33:30.688162+0000","last_active":"2024-02-10T08:35:43.162299+0000","last_peered":"2024-02-10T08:35:43.162299+0000","last_clean":"2024-02-10T08:35:43.162299+0000","last_became_active":"2024-02-10T08:32:36.974142+0000","last_became_peered":"2024-02-10T08:32:36.974142+0000","last_unstale":"2024-02-10T08:35:43.162299+0000","last_undegraded":"2024-02-10T08:35:43.162299+0000","last_fullsized":"2024-02-10T08:35:43.162299+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:30.688056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:33:30.688056+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":295,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.169718+0000","last_change":"2024-02-10T08:34:22.176269+0000","last_active":"2024-02-10T08:35:43.169718+0000","last_peered":"2024-02-10T08:35:43.169718+0000","last_clean":"2024-02-10T08:35:43.169718+0000","last_became_active":"2024-02-10T08:32:36.979412+0000","last_became_peered":"2024-02-10T08:32:36.979412+0000","last_unstale":"2024-02-10T08:35:43.169718+0000","last_undegraded":"2024-02-10T08:35:43.169718+0000","last_fullsized":"2024-02-10T08:35:43.169718+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:22.176191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:34:22.176191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1],"acting":[6,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":367,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.166957+0000","last_change":"2024-02-10T08:34:19.933437+0000","last_active":"2024-02-10T08:35:43.166957+0000","last_peered":"2024-02-10T08:35:43.166957+0000","last_clean":"2024-02-10T08:35:43.166957+0000","last_became_active":"2024-02-10T08:22:00.578118+0000","last_became_peered":"2024-02-10T08:22:00.578118+0000","last_unstale":"2024-02-10T08:35:43.166957+0000","last_undegraded":"2024-02-10T08:35:43.166957+0000","last_fullsized":"2024-02-10T08:35:43.166957+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:19.933309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:34:19.933309+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,6],"acting":[2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.29","version":"76'2","reported_seq":320,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.163826+0000","last_change":"2024-02-10T08:32:31.459909+0000","last_active":"2024-02-10T08:35:43.163826+0000","last_peered":"2024-02-10T08:35:43.163826+0000","last_clean":"2024-02-10T08:35:43.163826+0000","last_became_active":"2024-02-10T08:28:02.767822+0000","last_became_peered":"2024-02-10T08:28:02.767822+0000","last_unstale":"2024-02-10T08:35:43.163826+0000","last_undegraded":"2024-02-10T08:35:43.163826+0000","last_fullsized":"2024-02-10T08:35:43.163826+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":6,"last_scrub":"76'2","last_scrub_stamp":"2024-02-10T08:32:31.459851+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2024-02-10T08:18:08.680038+0000","last_clean_scrub_stamp":"2024-02-10T08:32:31.459851+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,0],"acting":[7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":94,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.173363+0000","last_change":"2024-02-10T08:35:09.039987+0000","last_active":"2024-02-10T08:35:43.173363+0000","last_peered":"2024-02-10T08:35:43.173363+0000","last_clean":"2024-02-10T08:35:43.173363+0000","last_became_active":"2024-02-10T08:32:36.975213+0000","last_became_peered":"2024-02-10T08:32:36.975213+0000","last_unstale":"2024-02-10T08:35:43.173363+0000","last_undegraded":"2024-02-10T08:35:43.173363+0000","last_fullsized":"2024-02-10T08:35:43.173363+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:35:09.039924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:20.392249+0000","last_clean_scrub_stamp":"2024-02-10T08:35:09.039924+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0],"acting":[4,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":111,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.160926+0000","last_change":"2024-02-10T08:34:10.431223+0000","last_active":"2024-02-10T08:35:43.160926+0000","last_peered":"2024-02-10T08:35:43.160926+0000","last_clean":"2024-02-10T08:35:43.160926+0000","last_became_active":"2024-02-10T08:30:26.079913+0000","last_became_peered":"2024-02-10T08:30:26.079913+0000","last_unstale":"2024-02-10T08:35:43.160926+0000","last_undegraded":"2024-02-10T08:35:43.160926+0000","last_fullsized":"2024-02-10T08:35:43.160926+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:10.431134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:34:10.431134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":219,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.174666+0000","last_change":"2024-02-10T08:33:56.117758+0000","last_active":"2024-02-10T08:35:43.174666+0000","last_peered":"2024-02-10T08:35:43.174666+0000","last_clean":"2024-02-10T08:35:43.174666+0000","last_became_active":"2024-02-10T08:33:56.117425+0000","last_became_peered":"2024-02-10T08:33:56.117425+0000","last_unstale":"2024-02-10T08:35:43.174666+0000","last_undegraded":"2024-02-10T08:35:43.174666+0000","last_fullsized":"2024-02-10T08:35:43.174666+0000","mapping_epoch":364,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":365,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:21.209041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:20:30.227375+0000","last_clean_scrub_stamp":"2024-02-10T08:33:21.209041+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":383,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.168837+0000","last_change":"2024-02-10T08:35:21.921686+0000","last_active":"2024-02-10T08:35:43.168837+0000","last_peered":"2024-02-10T08:35:43.168837+0000","last_clean":"2024-02-10T08:35:43.168837+0000","last_became_active":"2024-02-10T08:30:26.085360+0000","last_became_peered":"2024-02-10T08:30:26.085360+0000","last_unstale":"2024-02-10T08:35:43.168837+0000","last_undegraded":"2024-02-10T08:35:43.168837+0000","last_fullsized":"2024-02-10T08:35:43.168837+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:35:21.921586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:35:21.921586+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,5],"acting":[2,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":111,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.167276+0000","last_change":"2024-02-10T08:33:20.217875+0000","last_active":"2024-02-10T08:35:43.167276+0000","last_peered":"2024-02-10T08:35:43.167276+0000","last_clean":"2024-02-10T08:35:43.167276+0000","last_became_active":"2024-02-10T08:30:26.075472+0000","last_became_peered":"2024-02-10T08:30:26.075472+0000","last_unstale":"2024-02-10T08:35:43.167276+0000","last_undegraded":"2024-02-10T08:35:43.167276+0000","last_fullsized":"2024-02-10T08:35:43.167276+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:20.217823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:33:20.217823+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":110,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.166202+0000","last_change":"2024-02-10T08:35:21.343961+0000","last_active":"2024-02-10T08:35:43.166202+0000","last_peered":"2024-02-10T08:35:43.166202+0000","last_clean":"2024-02-10T08:35:43.166202+0000","last_became_active":"2024-02-10T08:30:26.080539+0000","last_became_peered":"2024-02-10T08:30:26.080539+0000","last_unstale":"2024-02-10T08:35:43.166202+0000","last_undegraded":"2024-02-10T08:35:43.166202+0000","last_fullsized":"2024-02-10T08:35:43.166202+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:28:34.215363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:34.215363+0000","last_clean_scrub_stamp":"2024-02-10T08:28:34.215363+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":106,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.165979+0000","last_change":"2024-02-10T08:30:26.088483+0000","last_active":"2024-02-10T08:35:43.165979+0000","last_peered":"2024-02-10T08:35:43.165979+0000","last_clean":"2024-02-10T08:35:43.165979+0000","last_became_active":"2024-02-10T08:30:26.088228+0000","last_became_peered":"2024-02-10T08:30:26.088228+0000","last_unstale":"2024-02-10T08:35:43.165979+0000","last_undegraded":"2024-02-10T08:35:43.165979+0000","last_fullsized":"2024-02-10T08:35:43.165979+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:29:11.496105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:29:11.496105+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1],"acting":[7,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":293,"reported_epoch":385,"state":"active+clean","last_fresh":"2024-02-10T08:35:43.160831+0000","last_change":"2024-02-10T08:34:17.350483+0000","last_active":"2024-02-10T08:35:43.160831+0000","last_peered":"2024-02-10T08:35:43.160831+0000","last_clean":"2024-02-10T08:35:43.160831+0000","last_became_active":"2024-02-10T08:30:26.072022+0000","last_became_peered":"2024-02-10T08:30:26.072022+0000","last_unstale":"2024-02-10T08:35:43.160831+0000","last_undegraded":"2024-02-10T08:35:43.160831+0000","last_fullsized":"2024-02-10T08:35:43.160831+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:17.350406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:34:17.350406+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":16,"stat_sum":{"num_bytes":1289486360,"num_objects":19677,"num_object_clones":0,"num_object_copies":59031,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19677,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":227925,"num_write_kb":7923201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3939184640,"data_stored":3939172424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":78222,"ondisk_log_size":78222,"up":48,"acting":48,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2646,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":4},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1134,"num_read_kb":1129,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":9,"acting":9,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":1105,"num_read_kb":862,"num_write":703,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":212,"num_bytes_recovered":5226,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":737,"ondisk_log_size":737,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":96,"acting":96,"num_store_stats":8},{"poolid":6,"num_pg":52,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":156,"acting":156,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":50,"seq":214748365033,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":886192,"kb_used_data":300520,"kb_used_omap":0,"kb_used_meta":585600,"kb_avail":92858960,"statfs":{"total":95995035648,"available":95087575040,"internally_reserved":0,"allocated":307732480,"data_stored":307358913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":599654400},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:35:18 2024","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":2.9460000000000002,"15min":2.1139999999999999},"min":{"1min":0.20899999999999999,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":4.6180000000000003,"5min":107.95699999999999,"15min":107.95699999999999},"last":0.42799999999999999},{"interface":"front","average":{"1min":1.415,"5min":3.3410000000000002,"15min":2.5800000000000001},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.20999999999999999},"max":{"1min":5.1369999999999996,"5min":108.33499999999999,"15min":108.33499999999999},"last":1.2270000000000001}]},{"osd":1,"last update":"Sat Feb 10 08:35:18 2024","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.7490000000000001,"15min":1.8320000000000001},"min":{"1min":0.23100000000000001,"5min":0.224,"15min":0.20000000000000001},"max":{"1min":4.6479999999999997,"5min":8.7530000000000001,"15min":41.539999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":2.056,"5min":2.0760000000000001,"15min":1.9810000000000001},"min":{"1min":0.27200000000000002,"5min":0.25700000000000001,"15min":0.22700000000000001},"max":{"1min":9.3439999999999994,"5min":10.099,"15min":41.046999999999997},"last":1.2050000000000001}]},{"osd":2,"last update":"Sat Feb 10 08:35:18 2024","interfaces":[{"interface":"back","average":{"1min":2.6800000000000002,"5min":2.5019999999999998,"15min":1.9259999999999999},"min":{"1min":0.26500000000000001,"5min":0.25700000000000001,"15min":0.251},"max":{"1min":7.8159999999999998,"5min":36.308999999999997,"15min":36.308999999999997},"last":0.495},{"interface":"front","average":{"1min":1.417,"5min":2.423,"15min":1.9319999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":5.8280000000000003,"5min":36.268000000000001,"15min":36.268000000000001},"last":0.53700000000000003}]},{"osd":3,"last update":"Sat Feb 10 08:35:18 2024","interfaces":[{"interface":"back","average":{"1min":1.4830000000000001,"5min":1.796,"15min":1.7410000000000001},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":4.2590000000000003,"5min":12.686,"15min":18.515000000000001},"last":0.47499999999999998},{"interface":"front","average":{"1min":1.7150000000000001,"5min":2.141,"15min":1.9219999999999999},"min":{"1min":0.317,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":5.1289999999999996,"5min":10.960000000000001,"15min":10.960000000000001},"last":1.5529999999999999}]},{"osd":4,"last update":"Sat Feb 10 08:35:18 2024","interfaces":[{"interface":"back","average":{"1min":1.8620000000000001,"5min":1.8,"15min":1.276},"min":{"1min":0.254,"5min":0.23400000000000001,"15min":0.216},"max":{"1min":6.9050000000000002,"5min":12.574999999999999,"15min":12.574999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":1.4850000000000001,"5min":1.621,"15min":1.2330000000000001},"min":{"1min":0.28699999999999998,"5min":0.254,"15min":0.22700000000000001},"max":{"1min":6.1550000000000002,"5min":8.8170000000000002,"15min":12.987},"last":3.7400000000000002}]},{"osd":5,"last update":"Sat Feb 10 08:35:18 2024","interfaces":[{"interface":"back","average":{"1min":1.6850000000000001,"5min":2.2170000000000001,"15min":1.6419999999999999},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.218},"max":{"1min":6.7839999999999998,"5min":12.882,"15min":15.304},"last":0.503},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.8300000000000001,"15min":1.407},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":5.4359999999999999,"5min":13.129,"15min":13.129},"last":1.1479999999999999}]},{"osd":6,"last update":"Sat Feb 10 08:35:18 2024","interfaces":[{"interface":"back","average":{"1min":1.97,"5min":1.913,"15min":1.3160000000000001},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":5.3129999999999997,"5min":10.101000000000001,"15min":10.101000000000001},"last":1.1819999999999999},{"interface":"front","average":{"1min":2.2480000000000002,"5min":2.0459999999999998,"15min":1.361},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.224},"max":{"1min":5.4960000000000004,"5min":12.654,"15min":12.654},"last":0.65800000000000003}]}]},{"osd":6,"up_from":43,"seq":184683593966,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1105620,"kb_used_data":511820,"kb_used_omap":0,"kb_used_meta":593792,"kb_avail":92639532,"statfs":{"total":95995035648,"available":94862880768,"internally_reserved":0,"allocated":524103680,"data_stored":523758174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":608043008},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:35:53 2024","interfaces":[{"interface":"back","average":{"1min":2.3159999999999998,"5min":1.762,"15min":2.1880000000000002},"min":{"1min":0.215,"5min":0.20300000000000001,"15min":0.19400000000000001},"max":{"1min":6.452,"5min":6.452,"15min":30.509},"last":3.1800000000000002},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.595,"15min":1.8959999999999999},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":3.6960000000000002,"5min":8.1590000000000007,"15min":36.090000000000003},"last":3.6960000000000002}]},{"osd":1,"last update":"Sat Feb 10 08:35:53 2024","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.47,"15min":1.698},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":6.4219999999999997,"5min":6.4219999999999997,"15min":12.938000000000001},"last":6.4219999999999997},{"interface":"front","average":{"1min":1.8160000000000001,"5min":1.9850000000000001,"15min":1.9850000000000001},"min":{"1min":0.254,"5min":0.215,"15min":0.215},"max":{"1min":4.1429999999999998,"5min":11.976000000000001,"15min":11.976000000000001},"last":3.79}]},{"osd":2,"last update":"Sat Feb 10 08:35:53 2024","interfaces":[{"interface":"back","average":{"1min":1.774,"5min":1.7430000000000001,"15min":2.1240000000000001},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.24399999999999999},"max":{"1min":5.8259999999999996,"5min":7.4989999999999997,"15min":35.072000000000003},"last":0.51000000000000001},{"interface":"front","average":{"1min":1.4650000000000001,"5min":1.627,"15min":1.952},"min":{"1min":0.30399999999999999,"5min":0.23799999999999999,"15min":0.23100000000000001},"max":{"1min":5.8339999999999996,"5min":14.867000000000001,"15min":35.103000000000002},"last":0.51800000000000002}]},{"osd":3,"last update":"Sat Feb 10 08:35:53 2024","interfaces":[{"interface":"back","average":{"1min":1.835,"5min":3.048,"15min":2.2989999999999999},"min":{"1min":0.28699999999999998,"5min":0.26800000000000002,"15min":0.26600000000000001},"max":{"1min":6.1689999999999996,"5min":103.94199999999999,"15min":103.94199999999999},"last":2.8220000000000001},{"interface":"front","average":{"1min":2.5800000000000001,"5min":3.1619999999999999,"15min":2.4129999999999998},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.253},"max":{"1min":8.1920000000000002,"5min":103.79600000000001,"15min":103.79600000000001},"last":3.8090000000000002}]},{"osd":4,"last update":"Sat Feb 10 08:35:13 2024","interfaces":[{"interface":"back","average":{"1min":1.9430000000000001,"5min":1.7270000000000001,"15min":1.2170000000000001},"min":{"1min":0.28799999999999998,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":14.789,"5min":14.789,"15min":14.789},"last":2.4119999999999999},{"interface":"front","average":{"1min":0.996,"5min":1.6950000000000001,"15min":1.242},"min":{"1min":0.29799999999999999,"5min":0.26100000000000001,"15min":0.22600000000000001},"max":{"1min":3.7000000000000002,"5min":8.3140000000000001,"15min":10.348000000000001},"last":6.3499999999999996}]},{"osd":5,"last update":"Sat Feb 10 08:35:53 2024","interfaces":[{"interface":"back","average":{"1min":1.5800000000000001,"5min":2.1800000000000002,"15min":1.579},"min":{"1min":0.29299999999999998,"5min":0.24099999999999999,"15min":0.21299999999999999},"max":{"1min":5.7220000000000004,"5min":29.631,"15min":29.631},"last":0.34300000000000003},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.722,"15min":1.4530000000000001},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.23699999999999999},"max":{"1min":3.9350000000000001,"5min":29.419,"15min":29.419},"last":2.9220000000000002}]},{"osd":7,"last update":"Sat Feb 10 08:35:13 2024","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":2.0289999999999999,"15min":2.0390000000000001},"min":{"1min":0.35499999999999998,"5min":0.30599999999999999,"15min":0.23999999999999999},"max":{"1min":3.665,"5min":13.298999999999999,"15min":194.88900000000001},"last":6.4630000000000001},{"interface":"front","average":{"1min":1.294,"5min":2.0619999999999998,"15min":2.1419999999999999},"min":{"1min":0.36399999999999999,"5min":0.32600000000000001,"15min":0.28799999999999998},"max":{"1min":4.0350000000000001,"5min":14.128,"15min":194.74100000000001},"last":6.3949999999999996}]}]},{"osd":1,"up_from":13,"seq":55834575109,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":820712,"kb_used_data":226912,"kb_used_omap":0,"kb_used_meta":593792,"kb_avail":92924440,"statfs":{"total":95995035648,"available":95154626560,"internally_reserved":0,"allocated":232357888,"data_stored":231991897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":608043008},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:35:54 2024","interfaces":[{"interface":"back","average":{"1min":1.9219999999999999,"5min":1.681,"15min":2.1829999999999998},"min":{"1min":0.19400000000000001,"5min":0.189,"15min":0.17100000000000001},"max":{"1min":5.9109999999999996,"5min":8.5820000000000007,"15min":29.763999999999999},"last":4.7590000000000003},{"interface":"front","average":{"1min":2.1850000000000001,"5min":1.8320000000000001,"15min":2.3479999999999999},"min":{"1min":0.183,"5min":0.183,"15min":0.17899999999999999},"max":{"1min":7.9429999999999996,"5min":19.928999999999998,"15min":29.637},"last":0.183}]},{"osd":2,"last update":"Sat Feb 10 08:35:20 2024","interfaces":[{"interface":"back","average":{"1min":1.506,"5min":1.887,"15min":2.3639999999999999},"min":{"1min":0.23799999999999999,"5min":0.22,"15min":0.21199999999999999},"max":{"1min":4.0609999999999999,"5min":12.202,"15min":31.420999999999999},"last":0.5},{"interface":"front","average":{"1min":1.5620000000000001,"5min":2.02,"15min":2.5950000000000002},"min":{"1min":0.28699999999999998,"5min":0.23400000000000001,"15min":0.184},"max":{"1min":4.6299999999999999,"5min":12.314,"15min":31.484999999999999},"last":0.60899999999999999}]},{"osd":3,"last update":"Sat Feb 10 08:35:43 2024","interfaces":[{"interface":"back","average":{"1min":1.5509999999999999,"5min":1.7729999999999999,"15min":2.4649999999999999},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":5.2549999999999999,"5min":12.369999999999999,"15min":28.082000000000001},"last":5.016},{"interface":"front","average":{"1min":2.0390000000000001,"5min":1.861,"15min":2.1880000000000002},"min":{"1min":0.25800000000000001,"5min":0.25600000000000001,"15min":0.19600000000000001},"max":{"1min":9.2699999999999996,"5min":9.6869999999999994,"15min":29.722000000000001},"last":4.7999999999999998}]},{"osd":4,"last update":"Sat Feb 10 08:35:15 2024","interfaces":[{"interface":"back","average":{"1min":1.5569999999999999,"5min":2.0070000000000001,"15min":1.9379999999999999},"min":{"1min":0.309,"5min":0.28599999999999998,"15min":0.26100000000000001},"max":{"1min":4.1619999999999999,"5min":23.218,"15min":23.218},"last":0.42999999999999999},{"interface":"front","average":{"1min":1.7989999999999999,"5min":1.9590000000000001,"15min":2.2210000000000001},"min":{"1min":0.32100000000000001,"5min":0.32000000000000001,"15min":0.25900000000000001},"max":{"1min":4.7169999999999996,"5min":23.274000000000001,"15min":31.515000000000001},"last":0.51200000000000001}]},{"osd":5,"last update":"Sat Feb 10 08:35:20 2024","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":2.0579999999999998,"15min":2.1309999999999998},"min":{"1min":0.33400000000000002,"5min":0.29699999999999999,"15min":0.26000000000000001},"max":{"1min":3.6970000000000001,"5min":21.751000000000001,"15min":40.140999999999998},"last":0.46700000000000003},{"interface":"front","average":{"1min":1.976,"5min":2.3079999999999998,"15min":2.4500000000000002},"min":{"1min":0.32200000000000001,"5min":0.317,"15min":0.28499999999999998},"max":{"1min":4.7350000000000003,"5min":16.324000000000002,"15min":40.831000000000003},"last":0.54500000000000004}]},{"osd":6,"last update":"Sat Feb 10 08:35:54 2024","interfaces":[{"interface":"back","average":{"1min":1.6519999999999999,"5min":2.1469999999999998,"15min":2.214},"min":{"1min":0.379,"5min":0.34599999999999997,"15min":0.30199999999999999},"max":{"1min":4.6900000000000004,"5min":26.071999999999999,"15min":31.27},"last":0.56799999999999995},{"interface":"front","average":{"1min":1.9330000000000001,"5min":1.897,"15min":1.835},"min":{"1min":0.38300000000000001,"5min":0.29499999999999998,"15min":0.27700000000000002},"max":{"1min":4.8250000000000002,"5min":25.937000000000001,"15min":25.937000000000001},"last":4.8250000000000002}]},{"osd":7,"last update":"Sat Feb 10 08:35:20 2024","interfaces":[{"interface":"back","average":{"1min":2.1429999999999998,"5min":2.3599999999999999,"15min":2.302},"min":{"1min":0.41599999999999998,"5min":0.374,"15min":0.29099999999999998},"max":{"1min":4.7919999999999998,"5min":19.692,"15min":31.344999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":1.573,"5min":2.0800000000000001,"15min":1.847},"min":{"1min":0.40999999999999998,"5min":0.32500000000000001,"15min":0.312},"max":{"1min":5.4569999999999999,"5min":15.91,"15min":15.91},"last":4.8520000000000003}]}]},{"osd":0,"up_from":8,"seq":34359738633,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1554288,"kb_used_data":956264,"kb_used_omap":0,"kb_used_meta":597888,"kb_avail":92190864,"statfs":{"total":95995035648,"available":94403444736,"internally_reserved":0,"allocated":979214336,"data_stored":978840628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":612237312},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 10 08:35:00 2024","interfaces":[{"interface":"back","average":{"1min":1.4279999999999999,"5min":1.516,"15min":2.6520000000000001},"min":{"1min":0.19800000000000001,"5min":0.16300000000000001,"15min":0.14399999999999999},"max":{"1min":5.2990000000000004,"5min":11.058,"15min":102.48099999999999},"last":2.7069999999999999},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.968,"15min":2.5800000000000001},"min":{"1min":0.215,"5min":0.19400000000000001,"15min":0.193},"max":{"1min":4.4640000000000004,"5min":15.550000000000001,"15min":103.38800000000001},"last":2.0609999999999999}]},{"osd":2,"last update":"Sat Feb 10 08:35:19 2024","interfaces":[{"interface":"back","average":{"1min":2.0270000000000001,"5min":2.5449999999999999,"15min":3.1160000000000001},"min":{"1min":0.23699999999999999,"5min":0.19700000000000001,"15min":0.192},"max":{"1min":10.002000000000001,"5min":21.331,"15min":102.462},"last":5.9539999999999997},{"interface":"front","average":{"1min":2.6640000000000001,"5min":1.6659999999999999,"15min":2.645},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":10.369,"5min":10.369,"15min":102.66500000000001},"last":2.746}]},{"osd":3,"last update":"Sat Feb 10 08:35:42 2024","interfaces":[{"interface":"back","average":{"1min":1.786,"5min":1.857,"15min":2.3570000000000002},"min":{"1min":0.32000000000000001,"5min":0.23400000000000001,"15min":0.22600000000000001},"max":{"1min":6.2750000000000004,"5min":15.585000000000001,"15min":16.495000000000001},"last":2.7000000000000002},{"interface":"front","average":{"1min":3.3700000000000001,"5min":2.4340000000000002,"15min":3.0249999999999999},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":13.303000000000001,"5min":19.504000000000001,"15min":102.64400000000001},"last":2.6190000000000002}]},{"osd":4,"last update":"Sat Feb 10 08:35:08 2024","interfaces":[{"interface":"back","average":{"1min":1.8160000000000001,"5min":2.0950000000000002,"15min":2.5800000000000001},"min":{"1min":0.28199999999999997,"5min":0.26000000000000001,"15min":0.253},"max":{"1min":4.4100000000000001,"5min":19.359999999999999,"15min":102.742},"last":2.585},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.621,"15min":1.7050000000000001},"min":{"1min":0.30599999999999999,"5min":0.27000000000000002,"15min":0.26200000000000001},"max":{"1min":4.1429999999999998,"5min":15.343,"15min":16.352},"last":1.4119999999999999}]},{"osd":5,"last update":"Sat Feb 10 08:35:34 2024","interfaces":[{"interface":"back","average":{"1min":2.0640000000000001,"5min":1.9019999999999999,"15min":2.3180000000000001},"min":{"1min":0.36499999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":5.2880000000000003,"5min":17.321000000000002,"15min":102.53100000000001},"last":3.056},{"interface":"front","average":{"1min":1.716,"5min":1.839,"15min":1.915},"min":{"1min":0.31900000000000001,"5min":0.313,"15min":0.29599999999999999},"max":{"1min":4.4279999999999999,"5min":15.302,"15min":16.463999999999999},"last":0.28599999999999998}]},{"osd":6,"last update":"Sat Feb 10 08:35:00 2024","interfaces":[{"interface":"back","average":{"1min":2.2320000000000002,"5min":1.7929999999999999,"15min":2.302},"min":{"1min":0.36899999999999999,"5min":0.34599999999999997,"15min":0.28599999999999998},"max":{"1min":5.3739999999999997,"5min":7.0149999999999997,"15min":102.583},"last":2.7749999999999999},{"interface":"front","average":{"1min":1.7909999999999999,"5min":1.913,"15min":1.8320000000000001},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.308},"max":{"1min":4.9640000000000004,"5min":15.359,"15min":16.391999999999999},"last":1.9099999999999999}]},{"osd":7,"last update":"Sat Feb 10 08:35:19 2024","interfaces":[{"interface":"back","average":{"1min":2.2229999999999999,"5min":1.6719999999999999,"15min":3.0760000000000001},"min":{"1min":0.39600000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":5.6849999999999996,"5min":6.4889999999999999,"15min":255.53200000000001},"last":2.8029999999999999},{"interface":"front","average":{"1min":1.742,"5min":1.8520000000000001,"15min":2.6850000000000001},"min":{"1min":0.35699999999999998,"5min":0.34599999999999997,"15min":0.28599999999999998},"max":{"1min":4.4900000000000002,"5min":15.375999999999999,"15min":254.88800000000001},"last":1.736}]}]},{"osd":2,"up_from":18,"seq":77309411585,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1040092,"kb_used_data":442196,"kb_used_omap":0,"kb_used_meta":597888,"kb_avail":92705060,"statfs":{"total":95995035648,"available":94929981440,"internally_reserved":0,"allocated":452808704,"data_stored":452454833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":612237312},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:35:23 2024","interfaces":[{"interface":"back","average":{"1min":1.4510000000000001,"5min":1.6259999999999999,"15min":2.0630000000000002},"min":{"1min":0.22600000000000001,"5min":0.19400000000000001,"15min":0.17399999999999999},"max":{"1min":7.6059999999999999,"5min":27.934999999999999,"15min":27.934999999999999},"last":2.6579999999999999},{"interface":"front","average":{"1min":2.794,"5min":2.3239999999999998,"15min":2.71},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":8.5350000000000001,"5min":15.15,"15min":28.295999999999999},"last":3.8210000000000002}]},{"osd":1,"last update":"Sat Feb 10 08:35:23 2024","interfaces":[{"interface":"back","average":{"1min":2.5209999999999999,"5min":1.8360000000000001,"15min":2.141},"min":{"1min":0.22900000000000001,"5min":0.20999999999999999,"15min":0.19700000000000001},"max":{"1min":6.1509999999999998,"5min":9.9469999999999992,"15min":15.644},"last":1.9159999999999999},{"interface":"front","average":{"1min":2.0419999999999998,"5min":1.456,"15min":1.6140000000000001},"min":{"1min":0.22,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":12.132999999999999,"5min":12.132999999999999,"15min":16.968},"last":2.367}]},{"osd":3,"last update":"Sat Feb 10 08:35:50 2024","interfaces":[{"interface":"back","average":{"1min":2.0830000000000002,"5min":1.9099999999999999,"15min":2.226},"min":{"1min":0.245,"5min":0.245,"15min":0.23300000000000001},"max":{"1min":6.21,"5min":9.7870000000000008,"15min":24.946000000000002},"last":0.33600000000000002},{"interface":"front","average":{"1min":1.208,"5min":1.409,"15min":2.1890000000000001},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":4.0510000000000002,"5min":9.1150000000000002,"15min":24.905000000000001},"last":2.0779999999999998}]},{"osd":4,"last update":"Sat Feb 10 08:35:06 2024","interfaces":[{"interface":"back","average":{"1min":1.8129999999999999,"5min":1.881,"15min":1.8899999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":6.4459999999999997,"5min":10.573,"15min":13.260999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.97399999999999998,"5min":1.181,"15min":1.2789999999999999},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.25700000000000001},"max":{"1min":6.4720000000000004,"5min":6.4720000000000004,"15min":15.696},"last":1.8460000000000001}]},{"osd":5,"last update":"Sat Feb 10 08:35:35 2024","interfaces":[{"interface":"back","average":{"1min":2.4860000000000002,"5min":2.3969999999999998,"15min":2.1720000000000002},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":7.0650000000000004,"5min":13.201000000000001,"15min":13.939},"last":2.706},{"interface":"front","average":{"1min":2.2869999999999999,"5min":2.1429999999999998,"15min":1.9910000000000001},"min":{"1min":0.33100000000000002,"5min":0.29199999999999998,"15min":0.28599999999999998},"max":{"1min":8.2799999999999994,"5min":9.5709999999999997,"15min":13.317},"last":0.29999999999999999}]},{"osd":6,"last update":"Sat Feb 10 08:35:06 2024","interfaces":[{"interface":"back","average":{"1min":1.8149999999999999,"5min":2.125,"15min":2.0739999999999998},"min":{"1min":0.34100000000000003,"5min":0.32200000000000001,"15min":0.27300000000000002},"max":{"1min":5.3579999999999997,"5min":13.233000000000001,"15min":38.177999999999997},"last":2.742},{"interface":"front","average":{"1min":1.9239999999999999,"5min":2.0630000000000002,"15min":2.121},"min":{"1min":0.32500000000000001,"5min":0.32200000000000001,"15min":0.29099999999999998},"max":{"1min":4.3869999999999996,"5min":9.0879999999999992,"15min":37.682000000000002},"last":1.9470000000000001}]},{"osd":7,"last update":"Sat Feb 10 08:35:23 2024","interfaces":[{"interface":"back","average":{"1min":2.2890000000000001,"5min":2.1349999999999998,"15min":1.9790000000000001},"min":{"1min":0.38,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":5.4509999999999996,"5min":9.6869999999999994,"15min":13.231999999999999},"last":5.7039999999999997},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.4650000000000001,"15min":1.484},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":3.9049999999999998,"5min":8.1110000000000007,"15min":15.714},"last":1.8819999999999999}]}]},{"osd":3,"up_from":25,"seq":107374182652,"num_pgs":62,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":965100,"kb_used_data":371300,"kb_used_omap":0,"kb_used_meta":593792,"kb_avail":92780052,"statfs":{"total":95995035648,"available":95006773248,"internally_reserved":0,"allocated":380211200,"data_stored":379840696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":608043008},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:35:42 2024","interfaces":[{"interface":"back","average":{"1min":2.1850000000000001,"5min":2.6200000000000001,"15min":2.2879999999999998},"min":{"1min":0.21099999999999999,"5min":0.187,"15min":0.18099999999999999},"max":{"1min":8.8870000000000005,"5min":66.605000000000004,"15min":66.605000000000004},"last":2.1989999999999998},{"interface":"front","average":{"1min":1.6100000000000001,"5min":2.3730000000000002,"15min":2.2360000000000002},"min":{"1min":0.19700000000000001,"5min":0.184,"15min":0.184},"max":{"1min":12.641999999999999,"5min":66.828000000000003,"15min":66.828000000000003},"last":0.19800000000000001}]},{"osd":1,"last update":"Sat Feb 10 08:35:42 2024","interfaces":[{"interface":"back","average":{"1min":1.415,"5min":1.8089999999999999,"15min":2.1160000000000001},"min":{"1min":0.19700000000000001,"5min":0.187,"15min":0.187},"max":{"1min":7.8440000000000003,"5min":13.371,"15min":13.371},"last":2.367},{"interface":"front","average":{"1min":1.8220000000000001,"5min":2.0760000000000001,"15min":2.3769999999999998},"min":{"1min":0.22900000000000001,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":4.3799999999999999,"5min":19.344000000000001,"15min":21.373999999999999},"last":0.30199999999999999}]},{"osd":2,"last update":"Sat Feb 10 08:35:42 2024","interfaces":[{"interface":"back","average":{"1min":2.3559999999999999,"5min":2.8889999999999998,"15min":2.5609999999999999},"min":{"1min":0.34499999999999997,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":13.057,"5min":65.998999999999995,"15min":65.998999999999995},"last":0.33500000000000002},{"interface":"front","average":{"1min":2.2349999999999999,"5min":2.4009999999999998,"15min":2.25},"min":{"1min":0.316,"5min":0.23400000000000001,"15min":0.215},"max":{"1min":12.768000000000001,"5min":68.721000000000004,"15min":68.721000000000004},"last":0.45000000000000001}]},{"osd":4,"last update":"Sat Feb 10 08:35:18 2024","interfaces":[{"interface":"back","average":{"1min":1.6299999999999999,"5min":1.4790000000000001,"15min":1.6100000000000001},"min":{"1min":0.313,"5min":0.29199999999999998,"15min":0.25900000000000001},"max":{"1min":8.1010000000000009,"5min":8.1010000000000009,"15min":12.272},"last":0.32700000000000001},{"interface":"front","average":{"1min":2.1789999999999998,"5min":1.772,"15min":1.978},"min":{"1min":0.34000000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":7.8849999999999998,"5min":10.754,"15min":12.391999999999999},"last":2.2690000000000001}]},{"osd":5,"last update":"Sat Feb 10 08:35:42 2024","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":2.0640000000000001,"15min":1.776},"min":{"1min":0.34499999999999997,"5min":0.27500000000000002,"15min":0.249},"max":{"1min":4.7469999999999999,"5min":19.832000000000001,"15min":19.832000000000001},"last":0.35599999999999998},{"interface":"front","average":{"1min":2.5680000000000001,"5min":2.1589999999999998,"15min":2.0670000000000002},"min":{"1min":0.33100000000000002,"5min":0.30099999999999999,"15min":0.27800000000000002},"max":{"1min":8.8200000000000003,"5min":19.712,"15min":19.712},"last":2.3069999999999999}]},{"osd":6,"last update":"Sat Feb 10 08:34:57 2024","interfaces":[{"interface":"back","average":{"1min":2.452,"5min":2.0339999999999998,"15min":1.9550000000000001},"min":{"1min":0.47599999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":7.976,"5min":16.423999999999999,"15min":16.423999999999999},"last":2.3359999999999999},{"interface":"front","average":{"1min":1.54,"5min":1.944,"15min":1.681},"min":{"1min":0.375,"5min":0.35099999999999998,"15min":0.28499999999999998},"max":{"1min":7.9960000000000004,"5min":9.7010000000000005,"15min":12.324999999999999},"last":0.40799999999999997}]},{"osd":7,"last update":"Sat Feb 10 08:35:18 2024","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.619,"15min":1.7},"min":{"1min":0.41899999999999998,"5min":0.33500000000000002,"15min":0.28299999999999997},"max":{"1min":7.9470000000000001,"5min":7.9470000000000001,"15min":12.358000000000001},"last":0.379},{"interface":"front","average":{"1min":1.956,"5min":2.0489999999999999,"15min":2.0659999999999998},"min":{"1min":0.38400000000000001,"5min":0.313,"15min":0.26500000000000001},"max":{"1min":5.0590000000000002,"5min":9.6720000000000006,"15min":15.702},"last":0.36599999999999999}]}]},{"osd":4,"up_from":110,"seq":472446402743,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1336292,"kb_used_data":737628,"kb_used_omap":0,"kb_used_meta":598527,"kb_avail":92408860,"statfs":{"total":95995035648,"available":94626672640,"internally_reserved":0,"allocated":755331072,"data_stored":754968452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":972,"internal_metadata":612891700},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:35:29 2024","interfaces":[{"interface":"back","average":{"1min":2.0899999999999999,"5min":1.647,"15min":1.4690000000000001},"min":{"1min":0.23300000000000001,"5min":0.20499999999999999,"15min":0.19800000000000001},"max":{"1min":10.932,"5min":14.595000000000001,"15min":14.595000000000001},"last":3.6619999999999999},{"interface":"front","average":{"1min":2.9940000000000002,"5min":2.0350000000000001,"15min":2.2130000000000001},"min":{"1min":0.34899999999999998,"5min":0.23100000000000001,"15min":0.222},"max":{"1min":7.1929999999999996,"5min":14.446999999999999,"15min":16.524000000000001},"last":1.1459999999999999}]},{"osd":1,"last update":"Sat Feb 10 08:35:29 2024","interfaces":[{"interface":"back","average":{"1min":2.3650000000000002,"5min":1.7250000000000001,"15min":1.9079999999999999},"min":{"1min":0.27300000000000002,"5min":0.23899999999999999,"15min":0.218},"max":{"1min":5.5990000000000002,"5min":8.2149999999999999,"15min":38.621000000000002},"last":0.80600000000000005},{"interface":"front","average":{"1min":2.3250000000000002,"5min":1.7190000000000001,"15min":1.8180000000000001},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.217},"max":{"1min":11.964,"5min":14.561999999999999,"15min":38.430999999999997},"last":3.6920000000000002}]},{"osd":2,"last update":"Sat Feb 10 08:35:29 2024","interfaces":[{"interface":"back","average":{"1min":2.3860000000000001,"5min":1.9359999999999999,"15min":1.9399999999999999},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":8.6219999999999999,"5min":14.414,"15min":14.414},"last":1.175},{"interface":"front","average":{"1min":2.0499999999999998,"5min":1.7749999999999999,"15min":1.77},"min":{"1min":0.28299999999999997,"5min":0.26100000000000001,"15min":0.247},"max":{"1min":6.3739999999999997,"5min":11.958,"15min":11.958},"last":0.83499999999999996}]},{"osd":3,"last update":"Sat Feb 10 08:35:29 2024","interfaces":[{"interface":"back","average":{"1min":2.399,"5min":1.9570000000000001,"15min":1.9410000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.23200000000000001},"max":{"1min":6.3310000000000004,"5min":14.358000000000001,"15min":14.358000000000001},"last":1.202},{"interface":"front","average":{"1min":2.2010000000000001,"5min":1.974,"15min":1.7609999999999999},"min":{"1min":0.36699999999999999,"5min":0.32700000000000001,"15min":0.249},"max":{"1min":6.3289999999999997,"5min":8.3360000000000003,"15min":11.648},"last":0.85099999999999998}]},{"osd":5,"last update":"Sat Feb 10 08:35:29 2024","interfaces":[{"interface":"back","average":{"1min":1.47,"5min":1.8560000000000001,"15min":1.3129999999999999},"min":{"1min":0.25900000000000001,"5min":0.247,"15min":0.21299999999999999},"max":{"1min":7.0679999999999996,"5min":20.355,"15min":41.488},"last":0.49399999999999999},{"interface":"front","average":{"1min":2.125,"5min":1.792,"15min":1.5269999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.23699999999999999},"max":{"1min":9.4700000000000006,"5min":16.350000000000001,"15min":42.527999999999999},"last":2.9180000000000001}]},{"osd":6,"last update":"Sat Feb 10 08:35:29 2024","interfaces":[{"interface":"back","average":{"1min":3.6400000000000001,"5min":2.0019999999999998,"15min":1.5349999999999999},"min":{"1min":0.33800000000000002,"5min":0.27400000000000002,"15min":0.26400000000000001},"max":{"1min":44.816000000000003,"5min":44.816000000000003,"15min":44.816000000000003},"last":0.88600000000000001},{"interface":"front","average":{"1min":3.843,"5min":2.266,"15min":1.5940000000000001},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":43.816000000000003,"5min":43.816000000000003,"15min":43.816000000000003},"last":0.875}]},{"osd":7,"last update":"Sat Feb 10 08:35:29 2024","interfaces":[{"interface":"back","average":{"1min":1.9410000000000001,"5min":1.732,"15min":1.3759999999999999},"min":{"1min":0.30599999999999999,"5min":0.29799999999999999,"15min":0.28899999999999998},"max":{"1min":7.2229999999999999,"5min":8.6289999999999996,"15min":11.047000000000001},"last":0.86299999999999999},{"interface":"front","average":{"1min":1.7410000000000001,"5min":1.851,"15min":1.2629999999999999},"min":{"1min":0.312,"5min":0.29099999999999998,"15min":0.26300000000000001},"max":{"1min":10.971,"5min":16.245999999999999,"15min":16.245999999999999},"last":3.7130000000000001}]}]},{"osd":5,"up_from":37,"seq":158913790195,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1286928,"kb_used_data":383624,"kb_used_omap":0,"kb_used_meta":903296,"kb_avail":92458224,"statfs":{"total":95995035648,"available":94677221376,"internally_reserved":0,"allocated":392830976,"data_stored":392488715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":924975104},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:35:31 2024","interfaces":[{"interface":"back","average":{"1min":1.8360000000000001,"5min":1.579,"15min":1.774},"min":{"1min":0.27200000000000002,"5min":0.218,"15min":0.20499999999999999},"max":{"1min":6.782,"5min":10.789,"15min":22.914000000000001},"last":2.7170000000000001},{"interface":"front","average":{"1min":1.9019999999999999,"5min":1.974,"15min":1.7989999999999999},"min":{"1min":0.26600000000000001,"5min":0.22900000000000001,"15min":0.21299999999999999},"max":{"1min":5.8659999999999997,"5min":13.738,"15min":23.161000000000001},"last":0.91300000000000003}]},{"osd":1,"last update":"Sat Feb 10 08:35:31 2024","interfaces":[{"interface":"back","average":{"1min":2.1240000000000001,"5min":1.8240000000000001,"15min":1.613},"min":{"1min":0.24099999999999999,"5min":0.222,"15min":0.19500000000000001},"max":{"1min":8.5210000000000008,"5min":8.5210000000000008,"15min":8.5210000000000008},"last":2.6560000000000001},{"interface":"front","average":{"1min":2.0590000000000002,"5min":1.7470000000000001,"15min":1.5589999999999999},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":5.4189999999999996,"5min":8.6899999999999995,"15min":9.0579999999999998},"last":2.9750000000000001}]},{"osd":2,"last update":"Sat Feb 10 08:35:31 2024","interfaces":[{"interface":"back","average":{"1min":1.804,"5min":1.8100000000000001,"15min":1.8480000000000001},"min":{"1min":0.27800000000000002,"5min":0.251,"15min":0.24099999999999999},"max":{"1min":5.4169999999999998,"5min":7.9829999999999997,"15min":20.254999999999999},"last":2.218},{"interface":"front","average":{"1min":1.7929999999999999,"5min":1.641,"15min":1.653},"min":{"1min":0.32800000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":6.3449999999999998,"5min":6.3929999999999998,"15min":9.2810000000000006},"last":2.698}]},{"osd":3,"last update":"Sat Feb 10 08:35:31 2024","interfaces":[{"interface":"back","average":{"1min":1.645,"5min":1.4910000000000001,"15min":1.5369999999999999},"min":{"1min":0.308,"5min":0.28499999999999998,"15min":0.26100000000000001},"max":{"1min":5.3609999999999998,"5min":8.0079999999999991,"15min":24.198},"last":2.242},{"interface":"front","average":{"1min":2.069,"5min":1.6439999999999999,"15min":1.776},"min":{"1min":0.34899999999999998,"5min":0.27300000000000002,"15min":0.25900000000000001},"max":{"1min":5.4939999999999998,"5min":10.766,"15min":22.701000000000001},"last":2.6760000000000002}]},{"osd":4,"last update":"Sat Feb 10 08:35:14 2024","interfaces":[{"interface":"back","average":{"1min":1.554,"5min":1.4490000000000001,"15min":1.1479999999999999},"min":{"1min":0.26500000000000001,"5min":0.223,"15min":0.223},"max":{"1min":4.7290000000000001,"5min":7.923,"15min":7.923},"last":2.149},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.5069999999999999,"15min":1.1679999999999999},"min":{"1min":0.28999999999999998,"5min":0.254,"15min":0.22500000000000001},"max":{"1min":5.4169999999999998,"5min":12.948,"15min":12.948},"last":3.4300000000000002}]},{"osd":6,"last update":"Sat Feb 10 08:34:58 2024","interfaces":[{"interface":"back","average":{"1min":2.355,"5min":1.482,"15min":1.1819999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.23100000000000001},"max":{"1min":7.2779999999999996,"5min":7.2779999999999996,"15min":8.3559999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":1.361,"5min":1.3799999999999999,"15min":1.1240000000000001},"min":{"1min":0.32100000000000001,"5min":0.27800000000000002,"15min":0.23999999999999999},"max":{"1min":4.6340000000000003,"5min":7.875,"15min":7.875},"last":3.4039999999999999}]},{"osd":7,"last update":"Sat Feb 10 08:35:27 2024","interfaces":[{"interface":"back","average":{"1min":1.71,"5min":1.5649999999999999,"15min":2.355},"min":{"1min":0.32000000000000001,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":4.6749999999999998,"5min":7.952,"15min":371.87400000000002},"last":2.1859999999999999},{"interface":"front","average":{"1min":1.744,"5min":1.4870000000000001,"15min":2.5089999999999999},"min":{"1min":0.36099999999999999,"5min":0.318,"15min":0.23499999999999999},"max":{"1min":5.5190000000000001,"5min":10.726000000000001,"15min":372.63099999999997},"last":3.3399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":964694016,"data_stored":964689944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":229441536,"data_stored":229441536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":439615488,"data_stored":439615488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":374407168,"data_stored":374407168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":734859264,"data_stored":734855192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":376832000,"data_stored":376832000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":522850304,"data_stored":522846232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":296484864,"data_stored":296484864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-10T08:36:01.149 INFO:tasks.cephadm.ceph_manager.ceph:would drop below min_pgs, proj -7, currently 3 2024-02-10T08:36:01.175 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:36:01.253 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:36:01.254 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:36:01.254 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is unset 2024-02-10T08:36:01.302 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:01.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:36:00.576698+0000 mon.c (mon.2) 87 : audit [INF] from='client.? 172.21.15.18:0/2543302837' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:36:01.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:36:00.577143+0000 mon.a (mon.0) 1632 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:36:01.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:36:00.576698+0000 mon.c (mon.2) 87 : audit [INF] from='client.? 172.21.15.18:0/2543302837' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:36:01.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:36:00.577143+0000 mon.a (mon.0) 1632 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:36:01.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:36:00.576698+0000 mon.c (mon.2) 87 : audit [INF] from='client.? 172.21.15.18:0/2543302837' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:36:01.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:36:00.577143+0000 mon.a (mon.0) 1632 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:36:02.312 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:36:02.316 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:02.317 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:36:02.317 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:01.050444+0000 mgr.y (mgr.14505) 724 : cluster [DBG] pgmap v889: 168 pgs: 168 active+clean; 1.1 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 1.03k op/s 2024-02-10T08:36:02.317 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:01.189635+0000 mon.a (mon.0) 1633 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:36:02.317 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:36:01.209516+0000 mon.a (mon.0) 1634 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-10T08:36:02.317 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:01.209561+0000 mon.a (mon.0) 1635 : cluster [DBG] osdmap e389: 8 total, 8 up, 8 in 2024-02-10T08:36:02.317 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:01.050444+0000 mgr.y (mgr.14505) 724 : cluster [DBG] pgmap v889: 168 pgs: 168 active+clean; 1.1 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 1.03k op/s 2024-02-10T08:36:02.317 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:01.189635+0000 mon.a (mon.0) 1633 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:36:02.318 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:36:01.209516+0000 mon.a (mon.0) 1634 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-10T08:36:02.318 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:01.209561+0000 mon.a (mon.0) 1635 : cluster [DBG] osdmap e389: 8 total, 8 up, 8 in 2024-02-10T08:36:02.417 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:36:02.463 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:02.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:01.050444+0000 mgr.y (mgr.14505) 724 : cluster [DBG] pgmap v889: 168 pgs: 168 active+clean; 1.1 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 1.03k op/s 2024-02-10T08:36:02.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:01.189635+0000 mon.a (mon.0) 1633 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:36:02.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:36:01.209516+0000 mon.a (mon.0) 1634 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-10T08:36:02.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:01.209561+0000 mon.a (mon.0) 1635 : cluster [DBG] osdmap e389: 8 total, 8 up, 8 in 2024-02-10T08:36:03.424 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:36:03.427 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:03.427 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:36:03.528 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:36:03.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:01.687346+0000 osd.2 (osd.2) 199 : cluster [DBG] 2.e scrub starts 2024-02-10T08:36:03.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:01.698447+0000 osd.2 (osd.2) 200 : cluster [DBG] 2.e scrub ok 2024-02-10T08:36:03.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:02.058577+0000 osd.5 (osd.5) 239 : cluster [DBG] 5.f scrub starts 2024-02-10T08:36:03.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:02.062888+0000 osd.5 (osd.5) 240 : cluster [DBG] 5.f scrub ok 2024-02-10T08:36:03.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:02.757565+0000 osd.1 (osd.1) 238 : cluster [DBG] 6.4 scrub starts 2024-02-10T08:36:03.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:02.765440+0000 osd.1 (osd.1) 239 : cluster [DBG] 6.4 scrub ok 2024-02-10T08:36:03.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:03.141198+0000 osd.4 (osd.4) 144 : cluster [DBG] 4.1b scrub starts 2024-02-10T08:36:03.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:03.143506+0000 osd.4 (osd.4) 145 : cluster [DBG] 4.1b scrub ok 2024-02-10T08:36:03.570 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:01.687346+0000 osd.2 (osd.2) 199 : cluster [DBG] 2.e scrub starts 2024-02-10T08:36:03.570 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:01.698447+0000 osd.2 (osd.2) 200 : cluster [DBG] 2.e scrub ok 2024-02-10T08:36:03.570 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:02.058577+0000 osd.5 (osd.5) 239 : cluster [DBG] 5.f scrub starts 2024-02-10T08:36:03.570 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:02.062888+0000 osd.5 (osd.5) 240 : cluster [DBG] 5.f scrub ok 2024-02-10T08:36:03.570 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:02.757565+0000 osd.1 (osd.1) 238 : cluster [DBG] 6.4 scrub starts 2024-02-10T08:36:03.570 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:02.765440+0000 osd.1 (osd.1) 239 : cluster [DBG] 6.4 scrub ok 2024-02-10T08:36:03.570 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:03.141198+0000 osd.4 (osd.4) 144 : cluster [DBG] 4.1b scrub starts 2024-02-10T08:36:03.570 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:03.143506+0000 osd.4 (osd.4) 145 : cluster [DBG] 4.1b scrub ok 2024-02-10T08:36:03.571 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:01.687346+0000 osd.2 (osd.2) 199 : cluster [DBG] 2.e scrub starts 2024-02-10T08:36:03.571 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:01.698447+0000 osd.2 (osd.2) 200 : cluster [DBG] 2.e scrub ok 2024-02-10T08:36:03.571 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:02.058577+0000 osd.5 (osd.5) 239 : cluster [DBG] 5.f scrub starts 2024-02-10T08:36:03.571 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:02.062888+0000 osd.5 (osd.5) 240 : cluster [DBG] 5.f scrub ok 2024-02-10T08:36:03.571 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:02.757565+0000 osd.1 (osd.1) 238 : cluster [DBG] 6.4 scrub starts 2024-02-10T08:36:03.571 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:02.765440+0000 osd.1 (osd.1) 239 : cluster [DBG] 6.4 scrub ok 2024-02-10T08:36:03.571 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:03.141198+0000 osd.4 (osd.4) 144 : cluster [DBG] 4.1b scrub starts 2024-02-10T08:36:03.571 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:03.143506+0000 osd.4 (osd.4) 145 : cluster [DBG] 4.1b scrub ok 2024-02-10T08:36:03.583 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:03.697 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:36:03.703 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:03.703 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:36:03.804 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:36:03.859 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:03.895 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:36:03.899 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:03.899 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:36:04.000 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:36:04.052 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:04.094 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:36:04.095 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:04.095 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:36:04.196 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:36:04.229 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:02.647304+0000 osd.2 (osd.2) 201 : cluster [DBG] 5.8 scrub starts 2024-02-10T08:36:04.229 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:02.649168+0000 osd.2 (osd.2) 202 : cluster [DBG] 5.8 scrub ok 2024-02-10T08:36:04.229 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:03.051175+0000 mgr.y (mgr.14505) 725 : cluster [DBG] pgmap v891: 168 pgs: 168 active+clean; 924 MiB data, 7.7 GiB used, 708 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 1.48k op/s 2024-02-10T08:36:04.229 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:03.076139+0000 osd.5 (osd.5) 241 : cluster [DBG] 2.12 scrub starts 2024-02-10T08:36:04.229 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:03.081534+0000 osd.5 (osd.5) 242 : cluster [DBG] 2.12 scrub ok 2024-02-10T08:36:04.229 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:03.125098+0000 osd.0 (osd.0) 211 : cluster [DBG] 4.12 scrub starts 2024-02-10T08:36:04.229 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:03.126893+0000 osd.0 (osd.0) 212 : cluster [DBG] 4.12 scrub ok 2024-02-10T08:36:04.229 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:04.165967+0000 osd.4 (osd.4) 146 : cluster [DBG] 6.6 scrub starts 2024-02-10T08:36:04.254 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:04.300 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:36:04.306 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:04.307 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:36:04.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:02.647304+0000 osd.2 (osd.2) 201 : cluster [DBG] 5.8 scrub starts 2024-02-10T08:36:04.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:02.649168+0000 osd.2 (osd.2) 202 : cluster [DBG] 5.8 scrub ok 2024-02-10T08:36:04.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:03.051175+0000 mgr.y (mgr.14505) 725 : cluster [DBG] pgmap v891: 168 pgs: 168 active+clean; 924 MiB data, 7.7 GiB used, 708 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 1.48k op/s 2024-02-10T08:36:04.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:03.076139+0000 osd.5 (osd.5) 241 : cluster [DBG] 2.12 scrub starts 2024-02-10T08:36:04.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:03.081534+0000 osd.5 (osd.5) 242 : cluster [DBG] 2.12 scrub ok 2024-02-10T08:36:04.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:03.125098+0000 osd.0 (osd.0) 211 : cluster [DBG] 4.12 scrub starts 2024-02-10T08:36:04.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:03.126893+0000 osd.0 (osd.0) 212 : cluster [DBG] 4.12 scrub ok 2024-02-10T08:36:04.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:04.165967+0000 osd.4 (osd.4) 146 : cluster [DBG] 6.6 scrub starts 2024-02-10T08:36:04.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:02.647304+0000 osd.2 (osd.2) 201 : cluster [DBG] 5.8 scrub starts 2024-02-10T08:36:04.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:02.649168+0000 osd.2 (osd.2) 202 : cluster [DBG] 5.8 scrub ok 2024-02-10T08:36:04.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:03.051175+0000 mgr.y (mgr.14505) 725 : cluster [DBG] pgmap v891: 168 pgs: 168 active+clean; 924 MiB data, 7.7 GiB used, 708 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 1.48k op/s 2024-02-10T08:36:04.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:03.076139+0000 osd.5 (osd.5) 241 : cluster [DBG] 2.12 scrub starts 2024-02-10T08:36:04.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:03.081534+0000 osd.5 (osd.5) 242 : cluster [DBG] 2.12 scrub ok 2024-02-10T08:36:04.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:03.125098+0000 osd.0 (osd.0) 211 : cluster [DBG] 4.12 scrub starts 2024-02-10T08:36:04.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:03.126893+0000 osd.0 (osd.0) 212 : cluster [DBG] 4.12 scrub ok 2024-02-10T08:36:04.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:04.165967+0000 osd.4 (osd.4) 146 : cluster [DBG] 6.6 scrub starts 2024-02-10T08:36:04.407 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:36:04.471 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:04.921 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd unset nodeep-scrub 2024-02-10T08:36:05.008 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:36:05.031 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:36:05.037 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:05.038 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:36:05.047 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:36:05.083 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:36:05.123 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:36:05.140 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:36:05.168 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:36:05.179 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:05.192 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:36:05.214 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:36:05.215 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:05.216 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:36:05.231 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:36:05.248 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:04.197136+0000 osd.4 (osd.4) 147 : cluster [DBG] 6.6 scrub ok 2024-02-10T08:36:05.248 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:04.354556+0000 osd.7 (osd.7) 233 : cluster [DBG] 6.2f scrub starts 2024-02-10T08:36:05.249 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:04.485178+0000 osd.7 (osd.7) 234 : cluster [DBG] 6.2f scrub ok 2024-02-10T08:36:05.249 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:04.754314+0000 osd.1 (osd.1) 240 : cluster [DBG] 2.a scrub starts 2024-02-10T08:36:05.249 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:04.760889+0000 osd.1 (osd.1) 241 : cluster [DBG] 2.a scrub ok 2024-02-10T08:36:05.249 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:36:04.975974+0000 mon.c (mon.2) 88 : audit [DBG] from='client.? 172.21.15.18:0/1416968230' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:36:05.249 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:04.197136+0000 osd.4 (osd.4) 147 : cluster [DBG] 6.6 scrub ok 2024-02-10T08:36:05.249 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:04.354556+0000 osd.7 (osd.7) 233 : cluster [DBG] 6.2f scrub starts 2024-02-10T08:36:05.249 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:04.485178+0000 osd.7 (osd.7) 234 : cluster [DBG] 6.2f scrub ok 2024-02-10T08:36:05.249 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:04.754314+0000 osd.1 (osd.1) 240 : cluster [DBG] 2.a scrub starts 2024-02-10T08:36:05.249 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:04.760889+0000 osd.1 (osd.1) 241 : cluster [DBG] 2.a scrub ok 2024-02-10T08:36:05.249 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:36:04.975974+0000 mon.c (mon.2) 88 : audit [DBG] from='client.? 172.21.15.18:0/1416968230' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:36:05.263 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:36:05.287 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-10T08:36:05.287 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-10T08:36:05.287 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-10T08:36:05.287 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-10T08:36:05.287 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-10T08:36:05.287 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-10T08:36:05.287 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-10T08:36:05.287 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-10T08:36:05.317 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:36:05.366 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:05.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:04.197136+0000 osd.4 (osd.4) 147 : cluster [DBG] 6.6 scrub ok 2024-02-10T08:36:05.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:04.354556+0000 osd.7 (osd.7) 233 : cluster [DBG] 6.2f scrub starts 2024-02-10T08:36:05.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:04.485178+0000 osd.7 (osd.7) 234 : cluster [DBG] 6.2f scrub ok 2024-02-10T08:36:05.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:04.754314+0000 osd.1 (osd.1) 240 : cluster [DBG] 2.a scrub starts 2024-02-10T08:36:05.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:04.760889+0000 osd.1 (osd.1) 241 : cluster [DBG] 2.a scrub ok 2024-02-10T08:36:05.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:36:04.975974+0000 mon.c (mon.2) 88 : audit [DBG] from='client.? 172.21.15.18:0/1416968230' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:36:05.584 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:36:05.590 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:05.591 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:36:05.692 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:36:05.741 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:05.856 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:36:05.867 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:05.868 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:36:05.969 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:36:06.029 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:06.143 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:36:06.147 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:06.147 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:36:06.150 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 3, 4, 5, 6, 7, 0] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 5, 6, 7, 4] 2024-02-10T08:36:06.150 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-10T08:36:06.151 INFO:tasks.thrashosds.thrasher:inject_pause on osd.5 2024-02-10T08:36:06.151 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-02-10T08:36:06.151 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-02-10T08:36:06.151 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.5 config set filestore_inject_stall 3 2024-02-10T08:36:06.248 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:36:06.295 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:06.339 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:36:06.355 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:06.356 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:36:06.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:04.663100+0000 osd.2 (osd.2) 203 : cluster [DBG] 4.19 scrub starts 2024-02-10T08:36:06.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:04.674998+0000 osd.2 (osd.2) 204 : cluster [DBG] 4.19 scrub ok 2024-02-10T08:36:06.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:05.051743+0000 mgr.y (mgr.14505) 726 : cluster [DBG] pgmap v892: 168 pgs: 168 active+clean; 772 MiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 742 B/s rd, 0 B/s wr, 1.06k op/s 2024-02-10T08:36:06.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:05.133952+0000 osd.0 (osd.0) 213 : cluster [DBG] 5.3 scrub starts 2024-02-10T08:36:06.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:05.139225+0000 osd.0 (osd.0) 214 : cluster [DBG] 5.3 scrub ok 2024-02-10T08:36:06.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:05.710271+0000 osd.1 (osd.1) 242 : cluster [DBG] 5.12 scrub starts 2024-02-10T08:36:06.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:05.715959+0000 osd.1 (osd.1) 243 : cluster [DBG] 5.12 scrub ok 2024-02-10T08:36:06.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:04.663100+0000 osd.2 (osd.2) 203 : cluster [DBG] 4.19 scrub starts 2024-02-10T08:36:06.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:04.674998+0000 osd.2 (osd.2) 204 : cluster [DBG] 4.19 scrub ok 2024-02-10T08:36:06.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:05.051743+0000 mgr.y (mgr.14505) 726 : cluster [DBG] pgmap v892: 168 pgs: 168 active+clean; 772 MiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 742 B/s rd, 0 B/s wr, 1.06k op/s 2024-02-10T08:36:06.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:05.133952+0000 osd.0 (osd.0) 213 : cluster [DBG] 5.3 scrub starts 2024-02-10T08:36:06.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:05.139225+0000 osd.0 (osd.0) 214 : cluster [DBG] 5.3 scrub ok 2024-02-10T08:36:06.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:05.710271+0000 osd.1 (osd.1) 242 : cluster [DBG] 5.12 scrub starts 2024-02-10T08:36:06.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:05.715959+0000 osd.1 (osd.1) 243 : cluster [DBG] 5.12 scrub ok 2024-02-10T08:36:06.457 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:36:06.518 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:06.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:04.663100+0000 osd.2 (osd.2) 203 : cluster [DBG] 4.19 scrub starts 2024-02-10T08:36:06.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:04.674998+0000 osd.2 (osd.2) 204 : cluster [DBG] 4.19 scrub ok 2024-02-10T08:36:06.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:05.051743+0000 mgr.y (mgr.14505) 726 : cluster [DBG] pgmap v892: 168 pgs: 168 active+clean; 772 MiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 742 B/s rd, 0 B/s wr, 1.06k op/s 2024-02-10T08:36:06.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:05.133952+0000 osd.0 (osd.0) 213 : cluster [DBG] 5.3 scrub starts 2024-02-10T08:36:06.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:05.139225+0000 osd.0 (osd.0) 214 : cluster [DBG] 5.3 scrub ok 2024-02-10T08:36:06.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:05.710271+0000 osd.1 (osd.1) 242 : cluster [DBG] 5.12 scrub starts 2024-02-10T08:36:06.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:05.715959+0000 osd.1 (osd.1) 243 : cluster [DBG] 5.12 scrub ok 2024-02-10T08:36:06.519 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:36:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:36:06] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:36:06.832 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:36:07.129 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-02-10T08:36:07.129 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-02-10T08:36:07.129 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-02-10T08:36:07.129 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-02-10T08:36:07.129 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.129 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.15198.0:243428 9.8 9:1b62a820:::benchmark_data_smithi018_124176_object121689:head [delete] snapc 0=[] ondisk+write+known_if_redirected e324)", 2024-02-10T08:36:07.129 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:32:09.866902+0000", 2024-02-10T08:36:07.130 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 236.800016911, 2024-02-10T08:36:07.130 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.99183100000000002, 2024-02-10T08:36:07.130 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:36:07.130 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-02-10T08:36:07.130 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:36:07.130 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.15198", 2024-02-10T08:36:07.130 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/1957604827", 2024-02-10T08:36:07.130 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 243428 2024-02-10T08:36:07.130 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.130 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:36:07.130 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.130 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:36:07.130 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:09.866902+0000", 2024-02-10T08:36:07.130 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:36:07.131 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.131 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.131 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:36:07.131 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:09.866902+0000", 2024-02-10T08:36:07.131 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:36:07.131 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.131 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.131 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:36:07.131 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:09.866902+0000", 2024-02-10T08:36:07.131 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8039999999999999e-06 2024-02-10T08:36:07.131 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.131 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.131 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:36:07.131 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:09.866905+0000", 2024-02-10T08:36:07.131 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4400000000000005e-06 2024-02-10T08:36:07.132 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.132 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.132 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:36:07.132 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:09.866914+0000", 2024-02-10T08:36:07.132 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3640000000000001e-06 2024-02-10T08:36:07.132 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.132 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.132 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:36:07.132 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:09.866918+0000", 2024-02-10T08:36:07.132 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1046e-05 2024-02-10T08:36:07.132 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.132 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.132 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:36:07.133 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:09.866959+0000", 2024-02-10T08:36:07.133 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5783000000000002e-05 2024-02-10T08:36:07.133 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.133 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.133 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:36:07.133 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:09.867045+0000", 2024-02-10T08:36:07.133 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013255 2024-02-10T08:36:07.133 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.133 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.133 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,5,7", 2024-02-10T08:36:07.133 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:09.867178+0000", 2024-02-10T08:36:07.133 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.006038145 2024-02-10T08:36:07.133 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.133 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.134 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:36:07.134 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:09.873216+0000", 2024-02-10T08:36:07.134 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000135427 2024-02-10T08:36:07.134 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.134 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.134 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:36:07.134 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:09.873351+0000", 2024-02-10T08:36:07.134 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0022027470000000001 2024-02-10T08:36:07.134 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.134 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.134 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:36:07.134 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:09.875554+0000", 2024-02-10T08:36:07.134 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.016118260999999998 2024-02-10T08:36:07.134 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.134 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.135 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:36:07.135 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:09.891672+0000", 2024-02-10T08:36:07.135 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7929999999999992e-06 2024-02-10T08:36:07.135 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.135 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.135 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:36:07.135 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:09.891682+0000", 2024-02-10T08:36:07.135 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.96698300599999998 2024-02-10T08:36:07.135 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.135 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.135 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:36:07.135 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:10.858665+0000", 2024-02-10T08:36:07.135 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8236000000000002e-05 2024-02-10T08:36:07.135 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.135 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.136 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:36:07.136 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:10.858733+0000", 2024-02-10T08:36:07.136 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.99183100000000002 2024-02-10T08:36:07.136 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:36:07.136 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:36:07.136 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:36:07.136 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.136 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.136 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.15198.0:243448 9.8 9:13b9afa0:::benchmark_data_smithi018_124176_object121709:head [delete] snapc 0=[] ondisk+write+known_if_redirected e325)", 2024-02-10T08:36:07.136 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:32:09.894768+0000", 2024-02-10T08:36:07.137 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 236.77215075300001, 2024-02-10T08:36:07.137 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.97583826699999998, 2024-02-10T08:36:07.137 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:36:07.137 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:36:07.137 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:36:07.137 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.15198", 2024-02-10T08:36:07.137 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/1957604827", 2024-02-10T08:36:07.137 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 243448 2024-02-10T08:36:07.137 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.137 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:36:07.137 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.137 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:36:07.137 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:09.894768+0000", 2024-02-10T08:36:07.138 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:36:07.138 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.138 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.138 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:36:07.138 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:09.894768+0000", 2024-02-10T08:36:07.138 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:36:07.138 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.138 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.138 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:36:07.138 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:09.894767+0000", 2024-02-10T08:36:07.138 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6890000000000001e-06 2024-02-10T08:36:07.138 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.138 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.139 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:36:07.139 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:09.894773+0000", 2024-02-10T08:36:07.139 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2559999999999996e-06 2024-02-10T08:36:07.139 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.139 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.139 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:36:07.139 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:09.894780+0000", 2024-02-10T08:36:07.139 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5480000000000001e-06 2024-02-10T08:36:07.139 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.139 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.139 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:36:07.139 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:09.894785+0000", 2024-02-10T08:36:07.139 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8230000000000002e-05 2024-02-10T08:36:07.140 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.140 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.140 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:36:07.140 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:09.894854+0000", 2024-02-10T08:36:07.140 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8369999999999996e-06 2024-02-10T08:36:07.140 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.140 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.140 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:36:07.140 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:09.894858+0000", 2024-02-10T08:36:07.140 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.96391036399999996 2024-02-10T08:36:07.141 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.141 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.141 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:36:07.141 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:10.858769+0000", 2024-02-10T08:36:07.141 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0735999999999994e-05 2024-02-10T08:36:07.141 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.141 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.141 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:36:07.141 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:10.858850+0000", 2024-02-10T08:36:07.141 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4689000000000001e-05 2024-02-10T08:36:07.141 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.141 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.141 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,5", 2024-02-10T08:36:07.141 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:10.858944+0000", 2024-02-10T08:36:07.142 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011207072 2024-02-10T08:36:07.142 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.142 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.142 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:36:07.142 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:10.870151+0000", 2024-02-10T08:36:07.142 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00030170099999999998 2024-02-10T08:36:07.142 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.142 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.142 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:36:07.142 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:10.870453+0000", 2024-02-10T08:36:07.142 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5429999999999999e-05 2024-02-10T08:36:07.142 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.142 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.143 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:36:07.143 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:10.870548+0000", 2024-02-10T08:36:07.143 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1998000000000001e-05 2024-02-10T08:36:07.143 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.143 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.143 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:36:07.143 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:10.870580+0000", 2024-02-10T08:36:07.143 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.6271999999999999e-05 2024-02-10T08:36:07.143 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.143 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.143 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:36:07.143 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:10.870607+0000", 2024-02-10T08:36:07.143 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.97583826699999998 2024-02-10T08:36:07.143 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:36:07.143 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:36:07.144 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:36:07.144 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.144 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.144 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.15198.0:243455 9.8 9:1ae4817e:::benchmark_data_smithi018_124176_object121716:head [delete] snapc 0=[] ondisk+write+known_if_redirected e325)", 2024-02-10T08:36:07.144 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:32:09.896717+0000", 2024-02-10T08:36:07.144 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 236.77020170399999, 2024-02-10T08:36:07.145 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.97400673999999998, 2024-02-10T08:36:07.145 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:36:07.145 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:36:07.145 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:36:07.145 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.15198", 2024-02-10T08:36:07.145 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/1957604827", 2024-02-10T08:36:07.145 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 243455 2024-02-10T08:36:07.145 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.145 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:36:07.145 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.145 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:36:07.145 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:09.896717+0000", 2024-02-10T08:36:07.145 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:36:07.145 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.145 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.145 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:36:07.146 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:09.896717+0000", 2024-02-10T08:36:07.146 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:36:07.146 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.146 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.146 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:36:07.146 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:09.896716+0000", 2024-02-10T08:36:07.146 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7170000000000002e-06 2024-02-10T08:36:07.146 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.146 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.146 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:36:07.146 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:09.896723+0000", 2024-02-10T08:36:07.146 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4833e-05 2024-02-10T08:36:07.146 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.146 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.146 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:36:07.146 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:09.896738+0000", 2024-02-10T08:36:07.147 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0639999999999996e-06 2024-02-10T08:36:07.147 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.147 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.147 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:36:07.147 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:09.896745+0000", 2024-02-10T08:36:07.147 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0671999999999999e-05 2024-02-10T08:36:07.147 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.147 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.147 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:36:07.147 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:09.896796+0000", 2024-02-10T08:36:07.147 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1279999999999997e-06 2024-02-10T08:36:07.147 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.147 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.147 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:36:07.147 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:09.896805+0000", 2024-02-10T08:36:07.147 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.96549583400000005 2024-02-10T08:36:07.147 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.148 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.148 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:36:07.148 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:10.862301+0000", 2024-02-10T08:36:07.148 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6865000000000003e-05 2024-02-10T08:36:07.148 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.148 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.148 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:36:07.148 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:10.862387+0000", 2024-02-10T08:36:07.148 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9131999999999999e-05 2024-02-10T08:36:07.149 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.149 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.149 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,5", 2024-02-10T08:36:07.149 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:10.862487+0000", 2024-02-10T08:36:07.149 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0079165209999999993 2024-02-10T08:36:07.149 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.149 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.149 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:36:07.149 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:10.870403+0000", 2024-02-10T08:36:07.149 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010823300000000001 2024-02-10T08:36:07.149 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.149 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.149 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:36:07.149 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:10.870511+0000", 2024-02-10T08:36:07.150 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000151201 2024-02-10T08:36:07.150 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.150 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.150 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:36:07.150 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:10.870662+0000", 2024-02-10T08:36:07.150 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9747000000000002e-05 2024-02-10T08:36:07.150 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.150 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.150 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:36:07.150 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:10.870692+0000", 2024-02-10T08:36:07.150 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1996000000000003e-05 2024-02-10T08:36:07.150 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.150 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.150 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:36:07.150 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:10.870724+0000", 2024-02-10T08:36:07.150 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.97400673999999998 2024-02-10T08:36:07.151 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:36:07.151 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:36:07.151 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:36:07.151 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.151 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.151 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.15198.0:243464 9.8 9:1b97ec94:::benchmark_data_smithi018_124176_object121725:head [delete] snapc 0=[] ondisk+write+known_if_redirected e325)", 2024-02-10T08:36:07.151 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:32:09.909392+0000", 2024-02-10T08:36:07.151 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 236.757527055, 2024-02-10T08:36:07.151 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.96150460900000001, 2024-02-10T08:36:07.151 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:36:07.151 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:36:07.151 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:36:07.151 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.15198", 2024-02-10T08:36:07.151 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/1957604827", 2024-02-10T08:36:07.151 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 243464 2024-02-10T08:36:07.151 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.152 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:36:07.152 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.152 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:36:07.152 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:09.909392+0000", 2024-02-10T08:36:07.152 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:36:07.152 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.152 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.152 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:36:07.152 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:09.909392+0000", 2024-02-10T08:36:07.152 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:36:07.152 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.152 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.152 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:36:07.152 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:09.909391+0000", 2024-02-10T08:36:07.152 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3550000000000004e-06 2024-02-10T08:36:07.153 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.153 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.153 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:36:07.153 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:09.909397+0000", 2024-02-10T08:36:07.153 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0166999999999999e-05 2024-02-10T08:36:07.153 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.153 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.153 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:36:07.153 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:09.909407+0000", 2024-02-10T08:36:07.153 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8189999999999999e-06 2024-02-10T08:36:07.153 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.153 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.153 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:36:07.153 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:09.909412+0000", 2024-02-10T08:36:07.153 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3338999999999999e-05 2024-02-10T08:36:07.154 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.154 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.154 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:36:07.154 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:09.909465+0000", 2024-02-10T08:36:07.154 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0485e-05 2024-02-10T08:36:07.154 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.154 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.154 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:36:07.154 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:09.909475+0000", 2024-02-10T08:36:07.154 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.95721933400000003 2024-02-10T08:36:07.154 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.154 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.154 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:36:07.154 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:10.866695+0000", 2024-02-10T08:36:07.154 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4287000000000001e-05 2024-02-10T08:36:07.155 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.155 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.155 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:36:07.155 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:10.866779+0000", 2024-02-10T08:36:07.155 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2991000000000005e-05 2024-02-10T08:36:07.155 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.155 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.155 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,5", 2024-02-10T08:36:07.155 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:10.866872+0000", 2024-02-10T08:36:07.155 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0035403259999999999 2024-02-10T08:36:07.155 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.155 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.155 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:36:07.155 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:10.870412+0000", 2024-02-10T08:36:07.156 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00036614699999999999 2024-02-10T08:36:07.156 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.156 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.156 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:36:07.156 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:10.870778+0000", 2024-02-10T08:36:07.156 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2281999999999997e-05 2024-02-10T08:36:07.156 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.156 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.156 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:36:07.156 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:10.870851+0000", 2024-02-10T08:36:07.156 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.4898000000000001e-05 2024-02-10T08:36:07.156 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.157 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.157 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:36:07.157 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:10.870876+0000", 2024-02-10T08:36:07.157 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1135999999999999e-05 2024-02-10T08:36:07.157 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.157 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.157 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:36:07.157 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:32:10.870897+0000", 2024-02-10T08:36:07.157 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.96150460900000001 2024-02-10T08:36:07.157 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:36:07.157 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:36:07.157 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:36:07.157 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.157 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.158 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.25369.0:98193 10.8 10:16b8e223:::benchmark_data_smithi018_146618_object98192:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e363)", 2024-02-10T08:36:07.158 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:33:51.624548+0000", 2024-02-10T08:36:07.158 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 135.04237114099999, 2024-02-10T08:36:07.158 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.15263146599999999, 2024-02-10T08:36:07.158 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:36:07.158 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:36:07.158 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:36:07.158 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.25369", 2024-02-10T08:36:07.158 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/3974730810", 2024-02-10T08:36:07.158 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 98193 2024-02-10T08:36:07.158 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.158 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:36:07.158 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.158 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:36:07.159 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.624548+0000", 2024-02-10T08:36:07.159 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:36:07.159 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.159 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.159 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:36:07.159 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.624548+0000", 2024-02-10T08:36:07.159 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:36:07.159 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.159 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.159 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:36:07.159 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.624546+0000", 2024-02-10T08:36:07.159 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.4958000000000001e-05 2024-02-10T08:36:07.159 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.159 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.160 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:36:07.160 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.624571+0000", 2024-02-10T08:36:07.160 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.136e-05 2024-02-10T08:36:07.160 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.160 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.160 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:36:07.160 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.624583+0000", 2024-02-10T08:36:07.160 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9249999999999998e-06 2024-02-10T08:36:07.160 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.160 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.160 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:36:07.160 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.624590+0000", 2024-02-10T08:36:07.160 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7588e-05 2024-02-10T08:36:07.160 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.160 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.161 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:36:07.161 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.624627+0000", 2024-02-10T08:36:07.161 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011616900000000001 2024-02-10T08:36:07.161 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.161 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.161 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:36:07.161 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.624743+0000", 2024-02-10T08:36:07.161 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017667 2024-02-10T08:36:07.161 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.161 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.161 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 2,7", 2024-02-10T08:36:07.161 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.624920+0000", 2024-02-10T08:36:07.161 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0059279600000000003 2024-02-10T08:36:07.161 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.161 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.162 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:36:07.162 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.630848+0000", 2024-02-10T08:36:07.162 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0029835909999999998 2024-02-10T08:36:07.162 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.162 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.162 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:36:07.162 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.633832+0000", 2024-02-10T08:36:07.162 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.143262151 2024-02-10T08:36:07.162 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.162 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.162 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:36:07.162 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.777094+0000", 2024-02-10T08:36:07.162 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4650000000000001e-05 2024-02-10T08:36:07.162 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.163 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.163 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:36:07.163 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.777138+0000", 2024-02-10T08:36:07.163 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1065000000000001e-05 2024-02-10T08:36:07.163 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.163 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.163 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:36:07.163 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.777180+0000", 2024-02-10T08:36:07.163 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.15263146599999999 2024-02-10T08:36:07.163 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:36:07.163 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:36:07.163 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:36:07.163 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.163 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.164 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.25369.0:98195 10.8 10:160be2ae:::benchmark_data_smithi018_146618_object98194:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e363)", 2024-02-10T08:36:07.164 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:33:51.630885+0000", 2024-02-10T08:36:07.164 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 135.03603470100001, 2024-02-10T08:36:07.164 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.14642250500000001, 2024-02-10T08:36:07.164 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:36:07.164 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:36:07.164 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:36:07.164 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.25369", 2024-02-10T08:36:07.164 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/3974730810", 2024-02-10T08:36:07.164 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 98195 2024-02-10T08:36:07.164 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.164 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:36:07.164 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.165 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:36:07.165 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.630885+0000", 2024-02-10T08:36:07.165 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:36:07.165 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.165 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.165 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:36:07.165 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.630885+0000", 2024-02-10T08:36:07.165 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:36:07.165 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.165 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.165 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:36:07.165 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.630883+0000", 2024-02-10T08:36:07.165 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0871999999999999e-05 2024-02-10T08:36:07.165 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.166 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.166 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:36:07.166 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.630904+0000", 2024-02-10T08:36:07.166 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5789999999999993e-06 2024-02-10T08:36:07.166 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.166 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.166 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:36:07.166 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.630913+0000", 2024-02-10T08:36:07.166 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5319999999999997e-06 2024-02-10T08:36:07.166 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.166 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.166 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:36:07.166 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.630919+0000", 2024-02-10T08:36:07.166 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2120000000000003e-05 2024-02-10T08:36:07.166 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.167 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.167 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:36:07.167 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.630961+0000", 2024-02-10T08:36:07.167 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016120500000000001 2024-02-10T08:36:07.167 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.167 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.167 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:36:07.167 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.631122+0000", 2024-02-10T08:36:07.167 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018272699999999999 2024-02-10T08:36:07.167 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.167 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.167 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 2,7", 2024-02-10T08:36:07.167 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.631305+0000", 2024-02-10T08:36:07.167 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0025335100000000001 2024-02-10T08:36:07.167 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.168 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.168 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:36:07.168 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.633838+0000", 2024-02-10T08:36:07.168 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0035675540000000001 2024-02-10T08:36:07.168 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.168 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.168 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:36:07.168 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.637406+0000", 2024-02-10T08:36:07.168 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.13981596299999999 2024-02-10T08:36:07.168 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.168 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.168 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:36:07.168 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.777222+0000", 2024-02-10T08:36:07.168 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8788000000000001e-05 2024-02-10T08:36:07.169 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.169 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.169 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:36:07.169 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.777271+0000", 2024-02-10T08:36:07.169 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6226999999999997e-05 2024-02-10T08:36:07.169 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.169 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.169 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:36:07.169 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.777307+0000", 2024-02-10T08:36:07.169 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.14642250500000001 2024-02-10T08:36:07.169 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:36:07.169 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:36:07.169 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:36:07.169 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.169 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.170 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.25369.0:98209 10.8 10:1259d961:::benchmark_data_smithi018_146618_object98208:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e363)", 2024-02-10T08:36:07.170 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:33:51.638130+0000", 2024-02-10T08:36:07.170 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 135.02878875600001, 2024-02-10T08:36:07.170 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.14706446400000001, 2024-02-10T08:36:07.170 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:36:07.170 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:36:07.170 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:36:07.170 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.25369", 2024-02-10T08:36:07.170 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/3974730810", 2024-02-10T08:36:07.170 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 98209 2024-02-10T08:36:07.170 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.170 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:36:07.170 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.170 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:36:07.171 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.638130+0000", 2024-02-10T08:36:07.171 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:36:07.171 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.171 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.171 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:36:07.171 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.638130+0000", 2024-02-10T08:36:07.171 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:36:07.171 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.171 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.171 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:36:07.171 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.638129+0000", 2024-02-10T08:36:07.171 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8929999999999999e-05 2024-02-10T08:36:07.171 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.171 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.172 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:36:07.172 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.638158+0000", 2024-02-10T08:36:07.172 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0638999999999999e-05 2024-02-10T08:36:07.172 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.172 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.172 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:36:07.172 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.638169+0000", 2024-02-10T08:36:07.172 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.353e-06 2024-02-10T08:36:07.172 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.172 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.172 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:36:07.172 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.638175+0000", 2024-02-10T08:36:07.172 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.004000651 2024-02-10T08:36:07.172 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.173 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.173 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:36:07.173 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.642176+0000", 2024-02-10T08:36:07.173 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000114628 2024-02-10T08:36:07.173 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.173 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.173 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:36:07.173 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.642290+0000", 2024-02-10T08:36:07.173 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017068500000000001 2024-02-10T08:36:07.173 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.173 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.173 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 2,7", 2024-02-10T08:36:07.173 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.642461+0000", 2024-02-10T08:36:07.173 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.003751655 2024-02-10T08:36:07.173 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.174 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.174 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:36:07.174 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.646213+0000", 2024-02-10T08:36:07.174 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6110000000000004e-06 2024-02-10T08:36:07.174 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.174 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.174 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:36:07.174 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.646217+0000", 2024-02-10T08:36:07.174 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.138877743 2024-02-10T08:36:07.174 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.174 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.174 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:36:07.174 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.785095+0000", 2024-02-10T08:36:07.174 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6465999999999998e-05 2024-02-10T08:36:07.174 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.175 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.175 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:36:07.175 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.785151+0000", 2024-02-10T08:36:07.175 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3569000000000002e-05 2024-02-10T08:36:07.175 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.175 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.175 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:36:07.175 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.785195+0000", 2024-02-10T08:36:07.175 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.14706446400000001 2024-02-10T08:36:07.175 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:36:07.175 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:36:07.175 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:36:07.175 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.175 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.175 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.25369.0:98211 10.8 10:19c248a9:::benchmark_data_smithi018_146618_object98210:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e363)", 2024-02-10T08:36:07.176 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:33:51.639387+0000", 2024-02-10T08:36:07.176 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 135.027532264, 2024-02-10T08:36:07.176 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.14592148599999999, 2024-02-10T08:36:07.176 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:36:07.176 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:36:07.176 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:36:07.176 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.25369", 2024-02-10T08:36:07.176 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/3974730810", 2024-02-10T08:36:07.176 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 98211 2024-02-10T08:36:07.176 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.176 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:36:07.176 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.176 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:36:07.176 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.639387+0000", 2024-02-10T08:36:07.177 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:36:07.177 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.177 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.177 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:36:07.177 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.639387+0000", 2024-02-10T08:36:07.177 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:36:07.177 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.177 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.177 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:36:07.177 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.639386+0000", 2024-02-10T08:36:07.177 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3731e-05 2024-02-10T08:36:07.177 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.177 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.177 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:36:07.177 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.639410+0000", 2024-02-10T08:36:07.178 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2649e-05 2024-02-10T08:36:07.178 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.178 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.178 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:36:07.178 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.639422+0000", 2024-02-10T08:36:07.178 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0120000000000002e-06 2024-02-10T08:36:07.178 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.178 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.178 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:36:07.178 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.639428+0000", 2024-02-10T08:36:07.178 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0049067850000000003 2024-02-10T08:36:07.178 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.178 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.178 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:36:07.178 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.644335+0000", 2024-02-10T08:36:07.179 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2435000000000006e-05 2024-02-10T08:36:07.179 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.179 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.179 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:36:07.179 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.644417+0000", 2024-02-10T08:36:07.179 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011334 2024-02-10T08:36:07.179 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.179 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.179 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 2,7", 2024-02-10T08:36:07.179 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.644531+0000", 2024-02-10T08:36:07.179 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0034819389999999999 2024-02-10T08:36:07.179 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.179 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.179 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:36:07.179 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.648013+0000", 2024-02-10T08:36:07.179 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010757780000000001 2024-02-10T08:36:07.180 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.180 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.180 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:36:07.180 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.649088+0000", 2024-02-10T08:36:07.180 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.13614343400000001 2024-02-10T08:36:07.180 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.180 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.180 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:36:07.180 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.785232+0000", 2024-02-10T08:36:07.180 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3262e-05 2024-02-10T08:36:07.180 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.180 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.180 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:36:07.180 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.785275+0000", 2024-02-10T08:36:07.181 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3272999999999998e-05 2024-02-10T08:36:07.181 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.181 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.181 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:36:07.181 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.785308+0000", 2024-02-10T08:36:07.181 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.14592148599999999 2024-02-10T08:36:07.181 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:36:07.181 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:36:07.181 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:36:07.181 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.181 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.181 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.25369.0:98212 10.8 10:155cebfd:::benchmark_data_smithi018_146618_object98211:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e363)", 2024-02-10T08:36:07.181 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:33:51.640957+0000", 2024-02-10T08:36:07.181 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 135.02596181600001, 2024-02-10T08:36:07.181 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.14446103099999999, 2024-02-10T08:36:07.181 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:36:07.182 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:36:07.182 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:36:07.182 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.25369", 2024-02-10T08:36:07.182 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/3974730810", 2024-02-10T08:36:07.182 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 98212 2024-02-10T08:36:07.182 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.182 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:36:07.182 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.182 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:36:07.182 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.640957+0000", 2024-02-10T08:36:07.182 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:36:07.182 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.182 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.182 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:36:07.183 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.640957+0000", 2024-02-10T08:36:07.183 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:36:07.183 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.183 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.183 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:36:07.183 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.640957+0000", 2024-02-10T08:36:07.183 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8277999999999999e-05 2024-02-10T08:36:07.183 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.183 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.183 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:36:07.183 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.640985+0000", 2024-02-10T08:36:07.183 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8740000000000007e-06 2024-02-10T08:36:07.183 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.183 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.183 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:36:07.184 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.640995+0000", 2024-02-10T08:36:07.184 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6759999999999998e-06 2024-02-10T08:36:07.184 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.184 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.184 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:36:07.184 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.640999+0000", 2024-02-10T08:36:07.184 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0052365800000000002 2024-02-10T08:36:07.184 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.184 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.184 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:36:07.184 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.646236+0000", 2024-02-10T08:36:07.184 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013624899999999999 2024-02-10T08:36:07.184 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.184 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.185 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:36:07.185 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.646372+0000", 2024-02-10T08:36:07.185 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00019440200000000001 2024-02-10T08:36:07.185 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.185 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.185 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 2,7", 2024-02-10T08:36:07.185 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.646567+0000", 2024-02-10T08:36:07.185 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001605151 2024-02-10T08:36:07.185 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.185 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.185 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:36:07.185 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.648172+0000", 2024-02-10T08:36:07.185 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010132520000000001 2024-02-10T08:36:07.185 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.185 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.186 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:36:07.186 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.649185+0000", 2024-02-10T08:36:07.186 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.13615548599999999 2024-02-10T08:36:07.186 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.186 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.186 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:36:07.186 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.785340+0000", 2024-02-10T08:36:07.186 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5328999999999999e-05 2024-02-10T08:36:07.186 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.186 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.186 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:36:07.186 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.785386+0000", 2024-02-10T08:36:07.186 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2617999999999998e-05 2024-02-10T08:36:07.186 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.186 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.187 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:36:07.187 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.785418+0000", 2024-02-10T08:36:07.187 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.14446103099999999 2024-02-10T08:36:07.187 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:36:07.187 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:36:07.187 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:36:07.187 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.187 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.187 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.25369.0:159393 10.4 10:2e7e7da5:::benchmark_data_smithi018_146618_object35590:head [delete] snapc 0=[] ondisk+write+known_if_redirected e374)", 2024-02-10T08:36:07.187 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:34:51.052221+0000", 2024-02-10T08:36:07.187 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 75.614697961000005, 2024-02-10T08:36:07.187 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.20778881599999999, 2024-02-10T08:36:07.187 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:36:07.187 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:36:07.187 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:36:07.188 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.25369", 2024-02-10T08:36:07.188 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/3974730810", 2024-02-10T08:36:07.188 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 159393 2024-02-10T08:36:07.188 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.188 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:36:07.188 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.188 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:36:07.188 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.052221+0000", 2024-02-10T08:36:07.188 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:36:07.188 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.188 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.188 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:36:07.188 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.052221+0000", 2024-02-10T08:36:07.188 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:36:07.189 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.189 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.189 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:36:07.189 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.052220+0000", 2024-02-10T08:36:07.189 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3509999999999998e-06 2024-02-10T08:36:07.189 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.189 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.189 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:36:07.189 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.052226+0000", 2024-02-10T08:36:07.189 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7000000000000003e-06 2024-02-10T08:36:07.189 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.189 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.189 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:36:07.189 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.052236+0000", 2024-02-10T08:36:07.189 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7507999999999999e-05 2024-02-10T08:36:07.190 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.190 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.190 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:36:07.190 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.052253+0000", 2024-02-10T08:36:07.190 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.006708131 2024-02-10T08:36:07.190 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.190 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.190 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:36:07.190 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.058962+0000", 2024-02-10T08:36:07.190 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013712899999999999 2024-02-10T08:36:07.190 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.190 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.190 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:36:07.190 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.059099+0000", 2024-02-10T08:36:07.190 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000139553 2024-02-10T08:36:07.191 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.191 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.191 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,4", 2024-02-10T08:36:07.191 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.059238+0000", 2024-02-10T08:36:07.191 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0025945090000000001 2024-02-10T08:36:07.191 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.191 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.191 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:36:07.191 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.061833+0000", 2024-02-10T08:36:07.191 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00025010199999999998 2024-02-10T08:36:07.191 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.191 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.191 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:36:07.191 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.062083+0000", 2024-02-10T08:36:07.191 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.19781836 2024-02-10T08:36:07.192 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.192 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.192 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:36:07.192 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.259901+0000", 2024-02-10T08:36:07.192 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1081999999999996e-05 2024-02-10T08:36:07.192 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.192 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.192 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:36:07.192 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.259962+0000", 2024-02-10T08:36:07.192 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7726999999999999e-05 2024-02-10T08:36:07.192 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.192 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.192 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:36:07.192 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.260010+0000", 2024-02-10T08:36:07.193 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.20778881599999999 2024-02-10T08:36:07.193 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:36:07.193 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:36:07.193 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:36:07.193 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.193 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.193 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.25369.0:159399 10.4 10:2e35471b:::benchmark_data_smithi018_146618_object35596:head [delete] snapc 0=[] ondisk+write+known_if_redirected e374)", 2024-02-10T08:36:07.193 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:34:51.065718+0000", 2024-02-10T08:36:07.193 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 75.601201111999998, 2024-02-10T08:36:07.193 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.19443265500000001, 2024-02-10T08:36:07.193 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:36:07.193 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:36:07.193 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:36:07.193 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.25369", 2024-02-10T08:36:07.193 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/3974730810", 2024-02-10T08:36:07.194 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 159399 2024-02-10T08:36:07.194 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.194 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:36:07.194 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.194 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:36:07.194 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.065718+0000", 2024-02-10T08:36:07.194 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:36:07.194 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.194 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.194 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:36:07.194 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.065718+0000", 2024-02-10T08:36:07.194 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999981 2024-02-10T08:36:07.194 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.194 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.194 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:36:07.195 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.065716+0000", 2024-02-10T08:36:07.195 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1450000000000008e-06 2024-02-10T08:36:07.195 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.195 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.195 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:36:07.195 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.065724+0000", 2024-02-10T08:36:07.195 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1545999999999999e-05 2024-02-10T08:36:07.195 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.195 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.195 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:36:07.195 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.065736+0000", 2024-02-10T08:36:07.196 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4869999999999999e-06 2024-02-10T08:36:07.196 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.196 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.196 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:36:07.196 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.065742+0000", 2024-02-10T08:36:07.196 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3248999999999999e-05 2024-02-10T08:36:07.196 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.196 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.196 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:36:07.196 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.065786+0000", 2024-02-10T08:36:07.196 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011302999999999999 2024-02-10T08:36:07.196 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.196 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.196 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:36:07.197 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.065899+0000", 2024-02-10T08:36:07.197 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014998600000000001 2024-02-10T08:36:07.197 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.197 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.197 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,4", 2024-02-10T08:36:07.197 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.066049+0000", 2024-02-10T08:36:07.197 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0025656870000000001 2024-02-10T08:36:07.197 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.197 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.197 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:36:07.197 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.068614+0000", 2024-02-10T08:36:07.197 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0016981640000000001 2024-02-10T08:36:07.197 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.197 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.198 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:36:07.198 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.070312+0000", 2024-02-10T08:36:07.198 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.18974960599999999 2024-02-10T08:36:07.198 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.198 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.198 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:36:07.198 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.260062+0000", 2024-02-10T08:36:07.198 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7126000000000002e-05 2024-02-10T08:36:07.198 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.198 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.198 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:36:07.198 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.260109+0000", 2024-02-10T08:36:07.198 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1545000000000003e-05 2024-02-10T08:36:07.198 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.198 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.199 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:36:07.199 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.260151+0000", 2024-02-10T08:36:07.199 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.19443265500000001 2024-02-10T08:36:07.199 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:36:07.199 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:36:07.199 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:36:07.199 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.199 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.199 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.25369.0:210139 10.4 10:26992f3e:::benchmark_data_smithi018_146618_object86336:head [delete] snapc 0=[] ondisk+write+known_if_redirected e383)", 2024-02-10T08:36:07.199 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:35:40.790815+0000", 2024-02-10T08:36:07.199 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 25.876103963999999, 2024-02-10T08:36:07.199 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.166047791, 2024-02-10T08:36:07.199 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:36:07.199 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:36:07.199 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:36:07.200 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.25369", 2024-02-10T08:36:07.200 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/3974730810", 2024-02-10T08:36:07.200 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 210139 2024-02-10T08:36:07.200 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.200 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:36:07.200 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.200 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:36:07.200 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.790815+0000", 2024-02-10T08:36:07.200 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:36:07.200 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.200 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.200 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:36:07.200 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.790815+0000", 2024-02-10T08:36:07.200 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:36:07.200 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.201 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.201 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:36:07.201 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.790815+0000", 2024-02-10T08:36:07.201 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9550000000000001e-06 2024-02-10T08:36:07.201 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.201 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.201 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:36:07.201 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.790818+0000", 2024-02-10T08:36:07.201 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.254e-06 2024-02-10T08:36:07.201 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.201 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.201 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:36:07.201 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.790823+0000", 2024-02-10T08:36:07.201 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1309999999999999e-06 2024-02-10T08:36:07.201 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.202 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.202 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:36:07.202 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.790827+0000", 2024-02-10T08:36:07.202 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.014137024 2024-02-10T08:36:07.202 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.202 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.202 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:36:07.202 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.804964+0000", 2024-02-10T08:36:07.202 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000110711 2024-02-10T08:36:07.202 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.202 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.202 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:36:07.202 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.805075+0000", 2024-02-10T08:36:07.202 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000122836 2024-02-10T08:36:07.202 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.203 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.203 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,4", 2024-02-10T08:36:07.203 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.805198+0000", 2024-02-10T08:36:07.203 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0049969790000000004 2024-02-10T08:36:07.203 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.203 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.203 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:36:07.203 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.810195+0000", 2024-02-10T08:36:07.203 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0036067149999999999 2024-02-10T08:36:07.203 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.203 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.203 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:36:07.203 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.813801+0000", 2024-02-10T08:36:07.203 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.14298723799999999 2024-02-10T08:36:07.203 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.204 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.204 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:36:07.204 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.956789+0000", 2024-02-10T08:36:07.204 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6962000000000003e-05 2024-02-10T08:36:07.204 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.204 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.204 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:36:07.204 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.956826+0000", 2024-02-10T08:36:07.204 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7453999999999997e-05 2024-02-10T08:36:07.204 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.204 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.204 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:36:07.204 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.956863+0000", 2024-02-10T08:36:07.204 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.166047791 2024-02-10T08:36:07.205 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:36:07.205 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:36:07.205 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:36:07.205 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.205 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.205 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.25369.0:210143 10.4 10:2a4fa298:::benchmark_data_smithi018_146618_object86340:head [delete] snapc 0=[] ondisk+write+known_if_redirected e383)", 2024-02-10T08:36:07.205 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:35:40.790848+0000", 2024-02-10T08:36:07.205 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 25.876071013000001, 2024-02-10T08:36:07.205 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.16609917499999999, 2024-02-10T08:36:07.205 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:36:07.205 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:36:07.205 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:36:07.205 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.25369", 2024-02-10T08:36:07.205 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/3974730810", 2024-02-10T08:36:07.205 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 210143 2024-02-10T08:36:07.205 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.206 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:36:07.206 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.206 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:36:07.206 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.790848+0000", 2024-02-10T08:36:07.206 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:36:07.206 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.206 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.206 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:36:07.206 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.790848+0000", 2024-02-10T08:36:07.206 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:36:07.206 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.206 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.206 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:36:07.206 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.790848+0000", 2024-02-10T08:36:07.206 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.768e-06 2024-02-10T08:36:07.207 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.207 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.207 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:36:07.207 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.790851+0000", 2024-02-10T08:36:07.207 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0340000000000004e-06 2024-02-10T08:36:07.207 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.207 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.207 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:36:07.207 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.790856+0000", 2024-02-10T08:36:07.207 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0069999999999999e-06 2024-02-10T08:36:07.207 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.207 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.207 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:36:07.207 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.790860+0000", 2024-02-10T08:36:07.207 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.016823298 2024-02-10T08:36:07.208 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.208 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.208 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:36:07.208 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.807683+0000", 2024-02-10T08:36:07.208 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8519999999999999e-05 2024-02-10T08:36:07.208 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.208 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.208 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:36:07.208 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.807781+0000", 2024-02-10T08:36:07.208 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011924 2024-02-10T08:36:07.208 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.208 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.208 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,4", 2024-02-10T08:36:07.208 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.807901+0000", 2024-02-10T08:36:07.209 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.148843746 2024-02-10T08:36:07.209 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.209 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.210 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:36:07.210 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.956744+0000", 2024-02-10T08:36:07.210 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2950000000000001e-05 2024-02-10T08:36:07.210 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.210 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.210 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:36:07.210 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.956777+0000", 2024-02-10T08:36:07.210 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2244999999999995e-05 2024-02-10T08:36:07.210 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.210 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.210 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:36:07.210 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.956870+0000", 2024-02-10T08:36:07.210 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7919000000000001e-05 2024-02-10T08:36:07.211 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.211 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.211 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:36:07.211 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.956908+0000", 2024-02-10T08:36:07.211 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9847e-05 2024-02-10T08:36:07.211 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.211 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.211 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:36:07.211 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.956947+0000", 2024-02-10T08:36:07.211 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.16609917499999999 2024-02-10T08:36:07.211 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:36:07.211 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:36:07.211 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:36:07.211 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.212 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.212 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.25369.0:210136 10.c e383/335 10:35f16003:::benchmark_data_smithi018_146618_object86333:head v 383'13223, mlcod=383'13217)", 2024-02-10T08:36:07.212 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:35:40.790937+0000", 2024-02-10T08:36:07.212 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 25.875981973999998, 2024-02-10T08:36:07.212 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.165842247, 2024-02-10T08:36:07.212 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:36:07.212 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:36:07.212 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:36:07.212 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.212 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:36:07.212 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.790937+0000", 2024-02-10T08:36:07.212 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:36:07.212 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.212 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.213 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:36:07.213 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.790937+0000", 2024-02-10T08:36:07.213 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967296 2024-02-10T08:36:07.213 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.213 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.213 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:36:07.213 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.790937+0000", 2024-02-10T08:36:07.213 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1700000000000001e-06 2024-02-10T08:36:07.213 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.213 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.213 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:36:07.213 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.790940+0000", 2024-02-10T08:36:07.213 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7900000000000001e-06 2024-02-10T08:36:07.213 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.213 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.214 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:36:07.214 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.790944+0000", 2024-02-10T08:36:07.214 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.118e-06 2024-02-10T08:36:07.214 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.214 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.214 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:36:07.214 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.790947+0000", 2024-02-10T08:36:07.214 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011702789 2024-02-10T08:36:07.214 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.214 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.214 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:36:07.214 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.802650+0000", 2024-02-10T08:36:07.214 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9556999999999999e-05 2024-02-10T08:36:07.214 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.214 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.215 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:36:07.215 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.802669+0000", 2024-02-10T08:36:07.215 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.15408055100000001 2024-02-10T08:36:07.215 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.215 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.215 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:36:07.215 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.956750+0000", 2024-02-10T08:36:07.215 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9451999999999999e-05 2024-02-10T08:36:07.215 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.215 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.215 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:36:07.215 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.956779+0000", 2024-02-10T08:36:07.215 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.165842247 2024-02-10T08:36:07.215 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:36:07.215 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:36:07.216 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:36:07.216 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.216 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.216 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.25369.0:210154 10.8 10:1e4e360d:::benchmark_data_smithi018_146618_object86351:head [delete] snapc 0=[] ondisk+write+known_if_redirected e383)", 2024-02-10T08:36:07.216 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:35:40.806119+0000", 2024-02-10T08:36:07.216 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 25.860800658999999, 2024-02-10T08:36:07.216 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.15071758199999999, 2024-02-10T08:36:07.216 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:36:07.216 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:36:07.216 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:36:07.216 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.25369", 2024-02-10T08:36:07.216 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/3974730810", 2024-02-10T08:36:07.216 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 210154 2024-02-10T08:36:07.216 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.217 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:36:07.217 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.217 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:36:07.217 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.806119+0000", 2024-02-10T08:36:07.217 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:36:07.217 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.217 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.217 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:36:07.217 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.806119+0000", 2024-02-10T08:36:07.217 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:36:07.217 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.217 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.217 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:36:07.217 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.806117+0000", 2024-02-10T08:36:07.217 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6750000000000002e-06 2024-02-10T08:36:07.217 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.218 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.218 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:36:07.218 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.806125+0000", 2024-02-10T08:36:07.218 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0706e-05 2024-02-10T08:36:07.218 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.218 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.218 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:36:07.218 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.806135+0000", 2024-02-10T08:36:07.218 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1299999999999998e-06 2024-02-10T08:36:07.218 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.218 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.218 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:36:07.218 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.806141+0000", 2024-02-10T08:36:07.218 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00055454099999999997 2024-02-10T08:36:07.218 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.219 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.219 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:36:07.219 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.806696+0000", 2024-02-10T08:36:07.219 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000110158 2024-02-10T08:36:07.219 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.219 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.219 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:36:07.219 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.806806+0000", 2024-02-10T08:36:07.219 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000121513 2024-02-10T08:36:07.219 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.219 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.219 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 2,7", 2024-02-10T08:36:07.219 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.806928+0000", 2024-02-10T08:36:07.219 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0035177419999999999 2024-02-10T08:36:07.219 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.220 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.220 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:36:07.220 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.810445+0000", 2024-02-10T08:36:07.220 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0032908830000000001 2024-02-10T08:36:07.220 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.220 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.220 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:36:07.220 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.813736+0000", 2024-02-10T08:36:07.220 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.14300777100000001 2024-02-10T08:36:07.220 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.220 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.220 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:36:07.220 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.956744+0000", 2024-02-10T08:36:07.220 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7309999999999999e-05 2024-02-10T08:36:07.221 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.221 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.221 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:36:07.221 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.956791+0000", 2024-02-10T08:36:07.221 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4781999999999999e-05 2024-02-10T08:36:07.221 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.221 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.221 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:36:07.221 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.956836+0000", 2024-02-10T08:36:07.221 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.15071758199999999 2024-02-10T08:36:07.221 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:36:07.221 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:36:07.221 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:36:07.221 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.221 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.221 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.25369.0:210157 10.b e383/335 10:d09f7b86:::benchmark_data_smithi018_146618_object86354:head v 383'13039, mlcod=383'13036)", 2024-02-10T08:36:07.222 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:35:40.810608+0000", 2024-02-10T08:36:07.222 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 25.856311081000001, 2024-02-10T08:36:07.222 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.14609915700000001, 2024-02-10T08:36:07.222 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:36:07.222 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:36:07.222 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:36:07.222 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.222 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:36:07.222 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.810608+0000", 2024-02-10T08:36:07.222 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:36:07.222 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.222 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.222 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:36:07.222 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.810608+0000", 2024-02-10T08:36:07.223 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:36:07.223 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.223 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.223 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:36:07.223 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.810607+0000", 2024-02-10T08:36:07.223 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8740000000000007e-06 2024-02-10T08:36:07.223 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.223 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.223 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:36:07.223 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.810617+0000", 2024-02-10T08:36:07.223 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1020000000000003e-06 2024-02-10T08:36:07.223 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.223 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.223 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:36:07.223 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.810626+0000", 2024-02-10T08:36:07.224 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4330000000000003e-06 2024-02-10T08:36:07.224 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.224 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.224 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:36:07.224 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.810632+0000", 2024-02-10T08:36:07.224 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010389030000000001 2024-02-10T08:36:07.224 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.224 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.224 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:36:07.224 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.811671+0000", 2024-02-10T08:36:07.224 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1282999999999999e-05 2024-02-10T08:36:07.224 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.224 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.224 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:36:07.225 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.811692+0000", 2024-02-10T08:36:07.225 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.14497665300000001 2024-02-10T08:36:07.225 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.225 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.225 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:36:07.225 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.956669+0000", 2024-02-10T08:36:07.225 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8664000000000001e-05 2024-02-10T08:36:07.225 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.225 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.225 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:36:07.225 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.956707+0000", 2024-02-10T08:36:07.225 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.14609915700000001 2024-02-10T08:36:07.225 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:36:07.225 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:36:07.225 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:36:07.226 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.226 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.226 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.25369.0:210163 10.4 10:2c0399a1:::benchmark_data_smithi018_146618_object86360:head [delete] snapc 0=[] ondisk+write+known_if_redirected e383)", 2024-02-10T08:36:07.226 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:35:40.811551+0000", 2024-02-10T08:36:07.226 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 25.855368104, 2024-02-10T08:36:07.226 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.14565631200000001, 2024-02-10T08:36:07.226 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:36:07.226 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:36:07.226 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:36:07.226 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.25369", 2024-02-10T08:36:07.226 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/3974730810", 2024-02-10T08:36:07.226 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 210163 2024-02-10T08:36:07.226 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.226 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:36:07.226 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.227 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:36:07.227 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.811551+0000", 2024-02-10T08:36:07.227 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:36:07.227 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.227 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.227 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:36:07.227 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.811551+0000", 2024-02-10T08:36:07.227 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:36:07.227 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.227 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.227 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:36:07.227 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.811550+0000", 2024-02-10T08:36:07.227 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0210000000000002e-06 2024-02-10T08:36:07.227 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.227 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.228 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:36:07.228 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.811557+0000", 2024-02-10T08:36:07.228 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1674e-05 2024-02-10T08:36:07.228 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.228 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.228 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:36:07.228 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.811568+0000", 2024-02-10T08:36:07.228 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.674e-06 2024-02-10T08:36:07.228 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.228 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.228 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:36:07.228 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.811575+0000", 2024-02-10T08:36:07.228 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0022513260000000001 2024-02-10T08:36:07.228 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.229 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.229 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:36:07.229 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.813826+0000", 2024-02-10T08:36:07.229 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012608399999999999 2024-02-10T08:36:07.229 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.229 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.229 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:36:07.229 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.813952+0000", 2024-02-10T08:36:07.229 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014953199999999999 2024-02-10T08:36:07.229 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.229 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.229 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,4", 2024-02-10T08:36:07.229 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.814102+0000", 2024-02-10T08:36:07.229 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.14285421300000001 2024-02-10T08:36:07.229 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.230 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.230 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:36:07.230 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.956956+0000", 2024-02-10T08:36:07.230 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0278000000000005e-05 2024-02-10T08:36:07.230 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.230 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.230 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:36:07.230 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.957046+0000", 2024-02-10T08:36:07.230 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0205999999999997e-05 2024-02-10T08:36:07.230 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.230 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.230 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:36:07.230 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.957127+0000", 2024-02-10T08:36:07.230 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.528e-05 2024-02-10T08:36:07.230 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.231 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.231 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:36:07.231 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.957172+0000", 2024-02-10T08:36:07.231 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5621000000000003e-05 2024-02-10T08:36:07.231 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.231 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.231 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:36:07.231 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.957207+0000", 2024-02-10T08:36:07.231 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.14565631200000001 2024-02-10T08:36:07.231 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:36:07.231 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:36:07.231 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:36:07.231 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.231 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.231 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.25369.0:210165 10.8 10:13d064dc:::benchmark_data_smithi018_146618_object86362:head [delete] snapc 0=[] ondisk+write+known_if_redirected e383)", 2024-02-10T08:36:07.231 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:35:40.813774+0000", 2024-02-10T08:36:07.232 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 25.853144943, 2024-02-10T08:36:07.232 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.14320369899999999, 2024-02-10T08:36:07.232 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:36:07.232 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:36:07.232 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:36:07.232 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.25369", 2024-02-10T08:36:07.232 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/3974730810", 2024-02-10T08:36:07.232 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 210165 2024-02-10T08:36:07.232 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.232 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:36:07.232 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.232 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:36:07.232 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.813774+0000", 2024-02-10T08:36:07.232 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:36:07.233 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.233 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.233 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:36:07.233 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.813774+0000", 2024-02-10T08:36:07.233 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:36:07.233 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.233 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.233 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:36:07.233 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.813773+0000", 2024-02-10T08:36:07.233 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1249999999999998e-06 2024-02-10T08:36:07.233 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.233 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.233 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:36:07.233 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.813779+0000", 2024-02-10T08:36:07.233 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0720000000000001e-05 2024-02-10T08:36:07.234 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.234 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.234 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:36:07.234 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.813790+0000", 2024-02-10T08:36:07.234 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7710000000000003e-06 2024-02-10T08:36:07.234 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.234 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.234 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:36:07.234 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.813796+0000", 2024-02-10T08:36:07.234 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2741000000000003e-05 2024-02-10T08:36:07.234 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.234 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.234 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:36:07.234 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.813838+0000", 2024-02-10T08:36:07.234 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011662099999999999 2024-02-10T08:36:07.235 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.235 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.235 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:36:07.235 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.813955+0000", 2024-02-10T08:36:07.235 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000146871 2024-02-10T08:36:07.235 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.235 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.235 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 2,7", 2024-02-10T08:36:07.235 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.814102+0000", 2024-02-10T08:36:07.235 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.14277261699999999 2024-02-10T08:36:07.235 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.235 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.235 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:36:07.235 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.956874+0000", 2024-02-10T08:36:07.236 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4060000000000002e-06 2024-02-10T08:36:07.236 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.236 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.236 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:36:07.236 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.956881+0000", 2024-02-10T08:36:07.236 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8549000000000001e-05 2024-02-10T08:36:07.236 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.236 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.236 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:36:07.236 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.956909+0000", 2024-02-10T08:36:07.236 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5525999999999998e-05 2024-02-10T08:36:07.236 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.236 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.237 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:36:07.237 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.956945+0000", 2024-02-10T08:36:07.237 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2981000000000002e-05 2024-02-10T08:36:07.237 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.237 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.237 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:36:07.237 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.956978+0000", 2024-02-10T08:36:07.237 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.14320369899999999 2024-02-10T08:36:07.237 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:36:07.237 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:36:07.237 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:36:07.237 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.237 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.237 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.25369.0:210161 10.a e383/339 10:569e3dac:::benchmark_data_smithi018_146618_object86358:head v 383'12981, mlcod=383'12979)", 2024-02-10T08:36:07.237 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:35:40.813823+0000", 2024-02-10T08:36:07.238 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 25.853096041000001, 2024-02-10T08:36:07.238 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.14356995, 2024-02-10T08:36:07.238 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:36:07.238 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:36:07.238 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:36:07.238 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.238 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:36:07.238 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.813823+0000", 2024-02-10T08:36:07.238 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:36:07.238 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.238 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.238 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:36:07.238 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.813823+0000", 2024-02-10T08:36:07.238 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:36:07.238 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.239 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.239 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:36:07.239 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.813823+0000", 2024-02-10T08:36:07.239 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.818e-06 2024-02-10T08:36:07.239 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.239 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.239 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:36:07.239 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.813828+0000", 2024-02-10T08:36:07.239 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.579e-06 2024-02-10T08:36:07.239 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.239 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.239 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:36:07.239 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.813835+0000", 2024-02-10T08:36:07.239 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2490000000000003e-06 2024-02-10T08:36:07.240 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.240 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.240 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:36:07.240 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.813839+0000", 2024-02-10T08:36:07.240 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016490100000000001 2024-02-10T08:36:07.240 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.240 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.240 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:36:07.240 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.814004+0000", 2024-02-10T08:36:07.240 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0182000000000001e-05 2024-02-10T08:36:07.240 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.240 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.240 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:36:07.240 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.814024+0000", 2024-02-10T08:36:07.241 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.14333737899999999 2024-02-10T08:36:07.241 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.241 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.241 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:36:07.241 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.957362+0000", 2024-02-10T08:36:07.241 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1404e-05 2024-02-10T08:36:07.241 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.241 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.241 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:36:07.241 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.957393+0000", 2024-02-10T08:36:07.241 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.14356995 2024-02-10T08:36:07.241 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:36:07.241 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:36:07.241 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:36:07.241 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.242 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.242 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.25369.0:210167 10.b e383/335 10:d52ca3e7:::benchmark_data_smithi018_146618_object86364:head v 383'13040, mlcod=383'13037)", 2024-02-10T08:36:07.242 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:35:40.818082+0000", 2024-02-10T08:36:07.242 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 25.848837172, 2024-02-10T08:36:07.242 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.147218285, 2024-02-10T08:36:07.242 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:36:07.242 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:36:07.242 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:36:07.242 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.242 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:36:07.242 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.818082+0000", 2024-02-10T08:36:07.242 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:36:07.242 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.242 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.242 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:36:07.243 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.818082+0000", 2024-02-10T08:36:07.243 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:36:07.243 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.243 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.243 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:36:07.243 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.818081+0000", 2024-02-10T08:36:07.243 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9850000000000006e-06 2024-02-10T08:36:07.243 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.243 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.243 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:36:07.243 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.818089+0000", 2024-02-10T08:36:07.243 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.138566628 2024-02-10T08:36:07.243 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.243 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.243 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:36:07.244 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.956656+0000", 2024-02-10T08:36:07.244 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7683e-05 2024-02-10T08:36:07.244 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.244 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.244 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:36:07.244 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.956673+0000", 2024-02-10T08:36:07.244 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2158999999999999e-05 2024-02-10T08:36:07.244 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.244 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.244 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:36:07.244 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.956736+0000", 2024-02-10T08:36:07.244 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1168000000000001e-05 2024-02-10T08:36:07.244 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.244 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.244 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:36:07.245 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.956757+0000", 2024-02-10T08:36:07.245 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0085135490000000005 2024-02-10T08:36:07.245 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.245 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.245 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:36:07.245 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.965270+0000", 2024-02-10T08:36:07.245 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0052e-05 2024-02-10T08:36:07.245 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:36:07.245 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:36:07.245 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:36:07.245 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.965300+0000", 2024-02-10T08:36:07.245 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.147218285 2024-02-10T08:36:07.245 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:36:07.245 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:36:07.245 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:36:07.245 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:36:07.246 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:36:07.246 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-02-10T08:36:07.401 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:36:07.404 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:36:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:36:07] "GET /metrics HTTP/1.1" 200 176441 "" "Prometheus/2.33.4" 2024-02-10T08:36:07.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:06.683662+0000 osd.4 (osd.4) 148 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:36:07.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:06.683713+0000 osd.4 (osd.4) 149 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:36:07.405 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:07.406 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:36:07.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:06.683662+0000 osd.4 (osd.4) 148 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:36:07.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:06.683713+0000 osd.4 (osd.4) 149 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:36:07.496 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:06.683662+0000 osd.4 (osd.4) 148 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:36:07.496 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:06.683713+0000 osd.4 (osd.4) 149 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:36:07.507 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:36:07.566 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:07.922 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.1 dump_ops_in_flight 2024-02-10T08:36:08.035 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:36:08.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:06.669518+0000 osd.2 (osd.2) 205 : cluster [DBG] 2.c scrub starts 2024-02-10T08:36:08.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:06.679165+0000 osd.2 (osd.2) 206 : cluster [DBG] 2.c scrub ok 2024-02-10T08:36:08.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:07.052112+0000 mgr.y (mgr.14505) 727 : cluster [DBG] pgmap v893: 168 pgs: 168 active+clean; 772 MiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 829 op/s 2024-02-10T08:36:08.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:07.265563+0000 mon.a (mon.0) 1636 : cluster [DBG] osdmap e390: 8 total, 8 up, 8 in 2024-02-10T08:36:08.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:07.781223+0000 osd.1 (osd.1) 244 : cluster [DBG] 2.15 scrub starts 2024-02-10T08:36:08.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:07.788924+0000 osd.1 (osd.1) 245 : cluster [DBG] 2.15 scrub ok 2024-02-10T08:36:08.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:06.669518+0000 osd.2 (osd.2) 205 : cluster [DBG] 2.c scrub starts 2024-02-10T08:36:08.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:06.679165+0000 osd.2 (osd.2) 206 : cluster [DBG] 2.c scrub ok 2024-02-10T08:36:08.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:07.052112+0000 mgr.y (mgr.14505) 727 : cluster [DBG] pgmap v893: 168 pgs: 168 active+clean; 772 MiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 829 op/s 2024-02-10T08:36:08.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:07.265563+0000 mon.a (mon.0) 1636 : cluster [DBG] osdmap e390: 8 total, 8 up, 8 in 2024-02-10T08:36:08.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:07.781223+0000 osd.1 (osd.1) 244 : cluster [DBG] 2.15 scrub starts 2024-02-10T08:36:08.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:07.788924+0000 osd.1 (osd.1) 245 : cluster [DBG] 2.15 scrub ok 2024-02-10T08:36:08.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:06.669518+0000 osd.2 (osd.2) 205 : cluster [DBG] 2.c scrub starts 2024-02-10T08:36:08.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:06.679165+0000 osd.2 (osd.2) 206 : cluster [DBG] 2.c scrub ok 2024-02-10T08:36:08.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:07.052112+0000 mgr.y (mgr.14505) 727 : cluster [DBG] pgmap v893: 168 pgs: 168 active+clean; 772 MiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 829 op/s 2024-02-10T08:36:08.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:07.265563+0000 mon.a (mon.0) 1636 : cluster [DBG] osdmap e390: 8 total, 8 up, 8 in 2024-02-10T08:36:08.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:07.781223+0000 osd.1 (osd.1) 244 : cluster [DBG] 2.15 scrub starts 2024-02-10T08:36:08.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:07.788924+0000 osd.1 (osd.1) 245 : cluster [DBG] 2.15 scrub ok 2024-02-10T08:36:09.041 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:36:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:36:09.643 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:08.026829+0000 osd.6 (osd.6) 225 : cluster [DBG] 2.1a scrub starts 2024-02-10T08:36:09.643 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:08.027628+0000 osd.6 (osd.6) 226 : cluster [DBG] 2.1a scrub ok 2024-02-10T08:36:09.643 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:08.228433+0000 osd.4 (osd.4) 150 : cluster [DBG] 10.d scrub starts 2024-02-10T08:36:09.643 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:08.390286+0000 osd.4 (osd.4) 151 : cluster [DBG] 10.d scrub ok 2024-02-10T08:36:09.644 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:08.026829+0000 osd.6 (osd.6) 225 : cluster [DBG] 2.1a scrub starts 2024-02-10T08:36:09.644 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:08.027628+0000 osd.6 (osd.6) 226 : cluster [DBG] 2.1a scrub ok 2024-02-10T08:36:09.644 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:08.228433+0000 osd.4 (osd.4) 150 : cluster [DBG] 10.d scrub starts 2024-02-10T08:36:09.644 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:08.390286+0000 osd.4 (osd.4) 151 : cluster [DBG] 10.d scrub ok 2024-02-10T08:36:09.651 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:36:09.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:08.026829+0000 osd.6 (osd.6) 225 : cluster [DBG] 2.1a scrub starts 2024-02-10T08:36:09.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:08.027628+0000 osd.6 (osd.6) 226 : cluster [DBG] 2.1a scrub ok 2024-02-10T08:36:09.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:08.228433+0000 osd.4 (osd.4) 150 : cluster [DBG] 10.d scrub starts 2024-02-10T08:36:09.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:08.390286+0000 osd.4 (osd.4) 151 : cluster [DBG] 10.d scrub ok 2024-02-10T08:36:10.013 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-10T08:36:10.131 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:36:10.136 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:10.137 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:36:10.238 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:36:10.280 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:10.298 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:08.679475+0000 osd.2 (osd.2) 207 : cluster [DBG] 5.a scrub starts 2024-02-10T08:36:10.299 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:08.684639+0000 osd.2 (osd.2) 208 : cluster [DBG] 5.a scrub ok 2024-02-10T08:36:10.299 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:36:08.727286+0000 mgr.y (mgr.14505) 728 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:36:10.299 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:09.052943+0000 mgr.y (mgr.14505) 729 : cluster [DBG] pgmap v895: 168 pgs: 168 active+clean; 492 MiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.25k op/s 2024-02-10T08:36:10.299 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:09.205153+0000 osd.4 (osd.4) 152 : cluster [DBG] 6.2 scrub starts 2024-02-10T08:36:10.299 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:09.213489+0000 osd.4 (osd.4) 153 : cluster [DBG] 6.2 scrub ok 2024-02-10T08:36:10.306 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:36:10.310 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:10.310 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:36:10.411 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:36:10.454 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:08.679475+0000 osd.2 (osd.2) 207 : cluster [DBG] 5.a scrub starts 2024-02-10T08:36:10.455 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:08.684639+0000 osd.2 (osd.2) 208 : cluster [DBG] 5.a scrub ok 2024-02-10T08:36:10.455 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:36:08.727286+0000 mgr.y (mgr.14505) 728 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:36:10.455 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:09.052943+0000 mgr.y (mgr.14505) 729 : cluster [DBG] pgmap v895: 168 pgs: 168 active+clean; 492 MiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.25k op/s 2024-02-10T08:36:10.455 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:09.205153+0000 osd.4 (osd.4) 152 : cluster [DBG] 6.2 scrub starts 2024-02-10T08:36:10.455 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:09.213489+0000 osd.4 (osd.4) 153 : cluster [DBG] 6.2 scrub ok 2024-02-10T08:36:10.461 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:10.657 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:08.679475+0000 osd.2 (osd.2) 207 : cluster [DBG] 5.a scrub starts 2024-02-10T08:36:10.657 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:08.684639+0000 osd.2 (osd.2) 208 : cluster [DBG] 5.a scrub ok 2024-02-10T08:36:10.657 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:36:08.727286+0000 mgr.y (mgr.14505) 728 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:36:10.657 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:09.052943+0000 mgr.y (mgr.14505) 729 : cluster [DBG] pgmap v895: 168 pgs: 168 active+clean; 492 MiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.25k op/s 2024-02-10T08:36:10.657 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:09.205153+0000 osd.4 (osd.4) 152 : cluster [DBG] 6.2 scrub starts 2024-02-10T08:36:10.657 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:09.213489+0000 osd.4 (osd.4) 153 : cluster [DBG] 6.2 scrub ok 2024-02-10T08:36:11.236 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:36:11.240 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:11.240 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:36:11.341 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:36:11.402 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:11.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:09.969448+0000 osd.6 (osd.6) 227 : cluster [DBG] 6.25 scrub starts 2024-02-10T08:36:11.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:10.035163+0000 osd.6 (osd.6) 228 : cluster [DBG] 6.25 scrub ok 2024-02-10T08:36:11.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:09.969448+0000 osd.6 (osd.6) 227 : cluster [DBG] 6.25 scrub starts 2024-02-10T08:36:11.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:10.035163+0000 osd.6 (osd.6) 228 : cluster [DBG] 6.25 scrub ok 2024-02-10T08:36:11.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:09.969448+0000 osd.6 (osd.6) 227 : cluster [DBG] 6.25 scrub starts 2024-02-10T08:36:11.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:10.035163+0000 osd.6 (osd.6) 228 : cluster [DBG] 6.25 scrub ok 2024-02-10T08:36:12.068 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-02-10T08:36:12.068 INFO:teuthology.orchestra.run.smithi071.stdout: "success": "filestore_inject_stall = '3' (not observed, change may require restart) " 2024-02-10T08:36:12.068 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-02-10T08:36:12.430 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:10.977666+0000 osd.6 (osd.6) 229 : cluster [DBG] 4.5 scrub starts 2024-02-10T08:36:12.430 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:10.987600+0000 osd.6 (osd.6) 230 : cluster [DBG] 4.5 scrub ok 2024-02-10T08:36:12.430 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:11.046560+0000 osd.0 (osd.0) 215 : cluster [DBG] 2.13 scrub starts 2024-02-10T08:36:12.430 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:11.051910+0000 osd.0 (osd.0) 216 : cluster [DBG] 2.13 scrub ok 2024-02-10T08:36:12.430 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:11.053453+0000 mgr.y (mgr.14505) 730 : cluster [DBG] pgmap v896: 168 pgs: 168 active+clean; 428 MiB data, 6.2 GiB used, 709 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 1.12k op/s 2024-02-10T08:36:12.430 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:11.303943+0000 osd.4 (osd.4) 154 : cluster [DBG] 10.e scrub starts 2024-02-10T08:36:12.431 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:11.421035+0000 osd.4 (osd.4) 155 : cluster [DBG] 10.e scrub ok 2024-02-10T08:36:12.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:10.977666+0000 osd.6 (osd.6) 229 : cluster [DBG] 4.5 scrub starts 2024-02-10T08:36:12.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:10.987600+0000 osd.6 (osd.6) 230 : cluster [DBG] 4.5 scrub ok 2024-02-10T08:36:12.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:11.046560+0000 osd.0 (osd.0) 215 : cluster [DBG] 2.13 scrub starts 2024-02-10T08:36:12.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:11.051910+0000 osd.0 (osd.0) 216 : cluster [DBG] 2.13 scrub ok 2024-02-10T08:36:12.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:11.053453+0000 mgr.y (mgr.14505) 730 : cluster [DBG] pgmap v896: 168 pgs: 168 active+clean; 428 MiB data, 6.2 GiB used, 709 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 1.12k op/s 2024-02-10T08:36:12.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:11.303943+0000 osd.4 (osd.4) 154 : cluster [DBG] 10.e scrub starts 2024-02-10T08:36:12.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:11.421035+0000 osd.4 (osd.4) 155 : cluster [DBG] 10.e scrub ok 2024-02-10T08:36:12.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:10.977666+0000 osd.6 (osd.6) 229 : cluster [DBG] 4.5 scrub starts 2024-02-10T08:36:12.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:10.987600+0000 osd.6 (osd.6) 230 : cluster [DBG] 4.5 scrub ok 2024-02-10T08:36:12.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:11.046560+0000 osd.0 (osd.0) 215 : cluster [DBG] 2.13 scrub starts 2024-02-10T08:36:12.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:11.051910+0000 osd.0 (osd.0) 216 : cluster [DBG] 2.13 scrub ok 2024-02-10T08:36:12.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:11.053453+0000 mgr.y (mgr.14505) 730 : cluster [DBG] pgmap v896: 168 pgs: 168 active+clean; 428 MiB data, 6.2 GiB used, 709 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 1.12k op/s 2024-02-10T08:36:12.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:11.303943+0000 osd.4 (osd.4) 154 : cluster [DBG] 10.e scrub starts 2024-02-10T08:36:12.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:11.421035+0000 osd.4 (osd.4) 155 : cluster [DBG] 10.e scrub ok 2024-02-10T08:36:13.085 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:36:13.107 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:13.108 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:36:13.209 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:36:13.274 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:13.301 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:36:13.305 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:13.306 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:36:13.407 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:36:13.445 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:13.473 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:36:13.479 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:13.480 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:36:13.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:11.762643+0000 osd.2 (osd.2) 209 : cluster [DBG] 2.10 scrub starts 2024-02-10T08:36:13.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:11.767193+0000 osd.2 (osd.2) 210 : cluster [DBG] 2.10 scrub ok 2024-02-10T08:36:13.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:36:12.572242+0000 mon.a (mon.0) 1637 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:36:13.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:36:13.161807+0000 mon.a (mon.0) 1638 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:36:13.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:36:13.166805+0000 mon.a (mon.0) 1639 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:36:13.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:36:13.191965+0000 mon.a (mon.0) 1640 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:36:13.580 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:36:13.620 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:13.646 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:36:13.654 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:13.655 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:36:13.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:11.762643+0000 osd.2 (osd.2) 209 : cluster [DBG] 2.10 scrub starts 2024-02-10T08:36:13.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:11.767193+0000 osd.2 (osd.2) 210 : cluster [DBG] 2.10 scrub ok 2024-02-10T08:36:13.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:36:12.572242+0000 mon.a (mon.0) 1637 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:36:13.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:36:13.161807+0000 mon.a (mon.0) 1638 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:36:13.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:36:13.166805+0000 mon.a (mon.0) 1639 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:36:13.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:36:13.191965+0000 mon.a (mon.0) 1640 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:36:13.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:11.762643+0000 osd.2 (osd.2) 209 : cluster [DBG] 2.10 scrub starts 2024-02-10T08:36:13.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:11.767193+0000 osd.2 (osd.2) 210 : cluster [DBG] 2.10 scrub ok 2024-02-10T08:36:13.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:36:12.572242+0000 mon.a (mon.0) 1637 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:36:13.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:36:13.161807+0000 mon.a (mon.0) 1638 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:36:13.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:36:13.166805+0000 mon.a (mon.0) 1639 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:36:13.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:36:13.191965+0000 mon.a (mon.0) 1640 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:36:13.756 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:36:13.807 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:13.839 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:36:13.845 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:13.845 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:36:13.946 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:36:14.000 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:14.112 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:36:14.118 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:14.118 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:36:14.188 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:36:14.219 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:36:14.274 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:14.299 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:36:14.304 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:14.305 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:36:14.357 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is unset 2024-02-10T08:36:14.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:13.054196+0000 mgr.y (mgr.14505) 731 : cluster [DBG] pgmap v897: 168 pgs: 168 active+clean; 238 MiB data, 5.7 GiB used, 710 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.10k op/s 2024-02-10T08:36:14.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:36:13.912980+0000 mon.b (mon.1) 87 : audit [INF] from='client.? 172.21.15.18:0/3930532113' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:36:14.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:36:13.913809+0000 mon.a (mon.0) 1641 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:36:14.386 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:13.054196+0000 mgr.y (mgr.14505) 731 : cluster [DBG] pgmap v897: 168 pgs: 168 active+clean; 238 MiB data, 5.7 GiB used, 710 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.10k op/s 2024-02-10T08:36:14.386 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:36:13.912980+0000 mon.b (mon.1) 87 : audit [INF] from='client.? 172.21.15.18:0/3930532113' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:36:14.386 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:36:13.913809+0000 mon.a (mon.0) 1641 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:36:14.406 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:36:14.466 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:14.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:13.054196+0000 mgr.y (mgr.14505) 731 : cluster [DBG] pgmap v897: 168 pgs: 168 active+clean; 238 MiB data, 5.7 GiB used, 710 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.10k op/s 2024-02-10T08:36:14.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:36:13.912980+0000 mon.b (mon.1) 87 : audit [INF] from='client.? 172.21.15.18:0/3930532113' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:36:14.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:36:13.913809+0000 mon.a (mon.0) 1641 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:36:14.683 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Removed 123800 objects 2024-02-10T08:36:14.683 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Clean up completed and total clean up time :117.937 2024-02-10T08:36:15.614 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:13.961354+0000 osd.0 (osd.0) 217 : cluster [DBG] 5.1e scrub starts 2024-02-10T08:36:15.615 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:13.964281+0000 osd.0 (osd.0) 218 : cluster [DBG] 5.1e scrub ok 2024-02-10T08:36:15.615 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:14.326509+0000 mon.a (mon.0) 1642 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-10T08:36:15.615 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:14.326541+0000 mon.a (mon.0) 1643 : cluster [INF] Cluster is now healthy 2024-02-10T08:36:15.615 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:36:14.330908+0000 mon.a (mon.0) 1644 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-10T08:36:15.615 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:14.330983+0000 mon.a (mon.0) 1645 : cluster [DBG] osdmap e391: 8 total, 8 up, 8 in 2024-02-10T08:36:15.615 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:14.403905+0000 osd.7 (osd.7) 235 : cluster [DBG] 6.30 deep-scrub starts 2024-02-10T08:36:15.615 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:14.408296+0000 osd.7 (osd.7) 236 : cluster [DBG] 6.30 deep-scrub ok 2024-02-10T08:36:15.615 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:13.961354+0000 osd.0 (osd.0) 217 : cluster [DBG] 5.1e scrub starts 2024-02-10T08:36:15.615 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:13.964281+0000 osd.0 (osd.0) 218 : cluster [DBG] 5.1e scrub ok 2024-02-10T08:36:15.616 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:14.326509+0000 mon.a (mon.0) 1642 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-10T08:36:15.616 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:14.326541+0000 mon.a (mon.0) 1643 : cluster [INF] Cluster is now healthy 2024-02-10T08:36:15.616 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:36:14.330908+0000 mon.a (mon.0) 1644 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-10T08:36:15.616 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:14.330983+0000 mon.a (mon.0) 1645 : cluster [DBG] osdmap e391: 8 total, 8 up, 8 in 2024-02-10T08:36:15.616 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:14.403905+0000 osd.7 (osd.7) 235 : cluster [DBG] 6.30 deep-scrub starts 2024-02-10T08:36:15.616 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:14.408296+0000 osd.7 (osd.7) 236 : cluster [DBG] 6.30 deep-scrub ok 2024-02-10T08:36:15.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:13.961354+0000 osd.0 (osd.0) 217 : cluster [DBG] 5.1e scrub starts 2024-02-10T08:36:15.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:13.964281+0000 osd.0 (osd.0) 218 : cluster [DBG] 5.1e scrub ok 2024-02-10T08:36:15.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:14.326509+0000 mon.a (mon.0) 1642 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-10T08:36:15.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:14.326541+0000 mon.a (mon.0) 1643 : cluster [INF] Cluster is now healthy 2024-02-10T08:36:15.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:36:14.330908+0000 mon.a (mon.0) 1644 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-10T08:36:15.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:14.330983+0000 mon.a (mon.0) 1645 : cluster [DBG] osdmap e391: 8 total, 8 up, 8 in 2024-02-10T08:36:15.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:14.403905+0000 osd.7 (osd.7) 235 : cluster [DBG] 6.30 deep-scrub starts 2024-02-10T08:36:15.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:14.408296+0000 osd.7 (osd.7) 236 : cluster [DBG] 6.30 deep-scrub ok 2024-02-10T08:36:16.538 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:36:16.541 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:16.542 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:36:16.642 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:36:16.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:14.733016+0000 osd.2 (osd.2) 211 : cluster [DBG] 5.6 scrub starts 2024-02-10T08:36:16.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:14.733835+0000 osd.2 (osd.2) 212 : cluster [DBG] 5.6 scrub ok 2024-02-10T08:36:16.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:14.967489+0000 osd.6 (osd.6) 231 : cluster [DBG] 6.2e scrub starts 2024-02-10T08:36:16.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:14.985300+0000 osd.6 (osd.6) 232 : cluster [DBG] 6.2e scrub ok 2024-02-10T08:36:16.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:15.054721+0000 mgr.y (mgr.14505) 732 : cluster [DBG] pgmap v899: 168 pgs: 168 active+clean; 90 MiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.36k op/s 2024-02-10T08:36:16.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:14.733016+0000 osd.2 (osd.2) 211 : cluster [DBG] 5.6 scrub starts 2024-02-10T08:36:16.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:14.733835+0000 osd.2 (osd.2) 212 : cluster [DBG] 5.6 scrub ok 2024-02-10T08:36:16.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:14.967489+0000 osd.6 (osd.6) 231 : cluster [DBG] 6.2e scrub starts 2024-02-10T08:36:16.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:14.985300+0000 osd.6 (osd.6) 232 : cluster [DBG] 6.2e scrub ok 2024-02-10T08:36:16.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:15.054721+0000 mgr.y (mgr.14505) 732 : cluster [DBG] pgmap v899: 168 pgs: 168 active+clean; 90 MiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.36k op/s 2024-02-10T08:36:16.673 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:36:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:36:16] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:36:16.673 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:14.733016+0000 osd.2 (osd.2) 211 : cluster [DBG] 5.6 scrub starts 2024-02-10T08:36:16.673 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:14.733835+0000 osd.2 (osd.2) 212 : cluster [DBG] 5.6 scrub ok 2024-02-10T08:36:16.673 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:14.967489+0000 osd.6 (osd.6) 231 : cluster [DBG] 6.2e scrub starts 2024-02-10T08:36:16.673 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:14.985300+0000 osd.6 (osd.6) 232 : cluster [DBG] 6.2e scrub ok 2024-02-10T08:36:16.673 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:15.054721+0000 mgr.y (mgr.14505) 732 : cluster [DBG] pgmap v899: 168 pgs: 168 active+clean; 90 MiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.36k op/s 2024-02-10T08:36:16.675 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:16.698 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:36:16.700 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:16.701 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:36:16.717 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-02-10T08:36:16.718 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-02-10T08:36:16.718 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-02-10T08:36:16.718 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-02-10T08:36:16.801 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:36:16.831 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:16.853 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:36:16.856 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:16.857 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:36:16.958 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:36:16.987 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:17.236 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:36:17.238 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:36:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:36:17] "GET /metrics HTTP/1.1" 200 176420 "" "Prometheus/2.33.4" 2024-02-10T08:36:17.238 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:17.239 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:36:17.340 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:36:17.370 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:17.493 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:36:17.496 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:15.955326+0000 osd.5 (osd.5) 243 : cluster [DBG] 10.6 scrub starts 2024-02-10T08:36:17.496 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:15.970840+0000 osd.6 (osd.6) 233 : cluster [DBG] 4.a deep-scrub starts 2024-02-10T08:36:17.496 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:15.977916+0000 osd.5 (osd.5) 244 : cluster [DBG] 10.6 scrub ok 2024-02-10T08:36:17.496 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:15.980527+0000 osd.6 (osd.6) 234 : cluster [DBG] 4.a deep-scrub ok 2024-02-10T08:36:17.496 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:15.982856+0000 osd.0 (osd.0) 219 : cluster [DBG] 10.4 scrub starts 2024-02-10T08:36:17.496 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:16.003500+0000 osd.0 (osd.0) 220 : cluster [DBG] 10.4 scrub ok 2024-02-10T08:36:17.496 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:16.408071+0000 osd.7 (osd.7) 237 : cluster [DBG] 4.11 scrub starts 2024-02-10T08:36:17.497 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:16.410122+0000 osd.7 (osd.7) 238 : cluster [DBG] 4.11 scrub ok 2024-02-10T08:36:17.497 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:36:16.687172+0000 mon.a (mon.0) 1646 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:36:17.497 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:15.955326+0000 osd.5 (osd.5) 243 : cluster [DBG] 10.6 scrub starts 2024-02-10T08:36:17.497 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:15.970840+0000 osd.6 (osd.6) 233 : cluster [DBG] 4.a deep-scrub starts 2024-02-10T08:36:17.497 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:15.977916+0000 osd.5 (osd.5) 244 : cluster [DBG] 10.6 scrub ok 2024-02-10T08:36:17.497 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:15.980527+0000 osd.6 (osd.6) 234 : cluster [DBG] 4.a deep-scrub ok 2024-02-10T08:36:17.497 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:15.982856+0000 osd.0 (osd.0) 219 : cluster [DBG] 10.4 scrub starts 2024-02-10T08:36:17.497 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:16.003500+0000 osd.0 (osd.0) 220 : cluster [DBG] 10.4 scrub ok 2024-02-10T08:36:17.497 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:16.408071+0000 osd.7 (osd.7) 237 : cluster [DBG] 4.11 scrub starts 2024-02-10T08:36:17.497 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:16.410122+0000 osd.7 (osd.7) 238 : cluster [DBG] 4.11 scrub ok 2024-02-10T08:36:17.497 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:36:16.687172+0000 mon.a (mon.0) 1646 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:36:17.498 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:17.498 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:36:17.599 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:36:17.627 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:17.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:15.955326+0000 osd.5 (osd.5) 243 : cluster [DBG] 10.6 scrub starts 2024-02-10T08:36:17.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:15.970840+0000 osd.6 (osd.6) 233 : cluster [DBG] 4.a deep-scrub starts 2024-02-10T08:36:17.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:15.977916+0000 osd.5 (osd.5) 244 : cluster [DBG] 10.6 scrub ok 2024-02-10T08:36:17.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:15.980527+0000 osd.6 (osd.6) 234 : cluster [DBG] 4.a deep-scrub ok 2024-02-10T08:36:17.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:15.982856+0000 osd.0 (osd.0) 219 : cluster [DBG] 10.4 scrub starts 2024-02-10T08:36:17.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:16.003500+0000 osd.0 (osd.0) 220 : cluster [DBG] 10.4 scrub ok 2024-02-10T08:36:17.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:16.408071+0000 osd.7 (osd.7) 237 : cluster [DBG] 4.11 scrub starts 2024-02-10T08:36:17.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:16.410122+0000 osd.7 (osd.7) 238 : cluster [DBG] 4.11 scrub ok 2024-02-10T08:36:17.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:36:16.687172+0000 mon.a (mon.0) 1646 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:36:17.814 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 3, 4, 5, 6, 7, 0] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 5, 6, 7, 4] 2024-02-10T08:36:17.814 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-10T08:36:17.814 INFO:tasks.thrashosds.thrasher:inject_pause on osd.1 2024-02-10T08:36:17.815 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-02-10T08:36:17.815 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-02-10T08:36:17.815 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.1 config set filestore_inject_stall 3 2024-02-10T08:36:18.136 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.1 dump_blocked_ops 2024-02-10T08:36:18.176 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:36:18.179 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:18.180 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:36:18.281 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:36:18.313 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:18.334 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:36:18.337 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:18.338 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:36:18.380 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd set noscrub 2024-02-10T08:36:18.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:17.055116+0000 mgr.y (mgr.14505) 733 : cluster [DBG] pgmap v900: 168 pgs: 168 active+clean; 90 MiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 1.11k op/s 2024-02-10T08:36:18.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:17.237505+0000 osd.4 (osd.4) 156 : cluster [DBG] 4.e scrub starts 2024-02-10T08:36:18.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:17.241052+0000 osd.4 (osd.4) 157 : cluster [DBG] 4.e scrub ok 2024-02-10T08:36:18.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:17.422678+0000 osd.7 (osd.7) 239 : cluster [DBG] 2.1c scrub starts 2024-02-10T08:36:18.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:17.423737+0000 osd.7 (osd.7) 240 : cluster [DBG] 2.1c scrub ok 2024-02-10T08:36:18.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:17.763426+0000 osd.1 (osd.1) 246 : cluster [DBG] 5.19 scrub starts 2024-02-10T08:36:18.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:17.766643+0000 osd.1 (osd.1) 247 : cluster [DBG] 5.19 scrub ok 2024-02-10T08:36:18.386 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:17.055116+0000 mgr.y (mgr.14505) 733 : cluster [DBG] pgmap v900: 168 pgs: 168 active+clean; 90 MiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 1.11k op/s 2024-02-10T08:36:18.386 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:17.237505+0000 osd.4 (osd.4) 156 : cluster [DBG] 4.e scrub starts 2024-02-10T08:36:18.386 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:17.241052+0000 osd.4 (osd.4) 157 : cluster [DBG] 4.e scrub ok 2024-02-10T08:36:18.386 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:17.422678+0000 osd.7 (osd.7) 239 : cluster [DBG] 2.1c scrub starts 2024-02-10T08:36:18.386 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:17.423737+0000 osd.7 (osd.7) 240 : cluster [DBG] 2.1c scrub ok 2024-02-10T08:36:18.387 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:17.763426+0000 osd.1 (osd.1) 246 : cluster [DBG] 5.19 scrub starts 2024-02-10T08:36:18.387 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:17.766643+0000 osd.1 (osd.1) 247 : cluster [DBG] 5.19 scrub ok 2024-02-10T08:36:18.439 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:36:18.468 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:18.488 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:36:18.491 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:18.491 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:36:18.592 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:36:18.619 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:18.738 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:17.055116+0000 mgr.y (mgr.14505) 733 : cluster [DBG] pgmap v900: 168 pgs: 168 active+clean; 90 MiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 1.11k op/s 2024-02-10T08:36:18.738 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:17.237505+0000 osd.4 (osd.4) 156 : cluster [DBG] 4.e scrub starts 2024-02-10T08:36:18.738 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:17.241052+0000 osd.4 (osd.4) 157 : cluster [DBG] 4.e scrub ok 2024-02-10T08:36:18.738 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:17.422678+0000 osd.7 (osd.7) 239 : cluster [DBG] 2.1c scrub starts 2024-02-10T08:36:18.738 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:17.423737+0000 osd.7 (osd.7) 240 : cluster [DBG] 2.1c scrub ok 2024-02-10T08:36:18.738 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:17.763426+0000 osd.1 (osd.1) 246 : cluster [DBG] 5.19 scrub starts 2024-02-10T08:36:18.738 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:17.766643+0000 osd.1 (osd.1) 247 : cluster [DBG] 5.19 scrub ok 2024-02-10T08:36:19.039 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:36:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:36:19.168 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:36:19.170 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:19.170 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:36:19.271 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:36:19.300 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:19.319 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:36:19.322 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:19.323 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:36:19.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:17.676675+0000 osd.2 (osd.2) 213 : cluster [DBG] 4.1c scrub starts 2024-02-10T08:36:19.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:17.678485+0000 osd.2 (osd.2) 214 : cluster [DBG] 4.1c scrub ok 2024-02-10T08:36:19.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:18.222970+0000 osd.4 (osd.4) 158 : cluster [DBG] 4.d scrub starts 2024-02-10T08:36:19.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:18.225209+0000 osd.4 (osd.4) 159 : cluster [DBG] 4.d scrub ok 2024-02-10T08:36:19.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:18.734029+0000 osd.1 (osd.1) 248 : cluster [DBG] 2.4 scrub starts 2024-02-10T08:36:19.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:18.737163+0000 osd.1 (osd.1) 249 : cluster [DBG] 2.4 scrub ok 2024-02-10T08:36:19.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:17.676675+0000 osd.2 (osd.2) 213 : cluster [DBG] 4.1c scrub starts 2024-02-10T08:36:19.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:17.678485+0000 osd.2 (osd.2) 214 : cluster [DBG] 4.1c scrub ok 2024-02-10T08:36:19.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:18.222970+0000 osd.4 (osd.4) 158 : cluster [DBG] 4.d scrub starts 2024-02-10T08:36:19.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:18.225209+0000 osd.4 (osd.4) 159 : cluster [DBG] 4.d scrub ok 2024-02-10T08:36:19.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:18.734029+0000 osd.1 (osd.1) 248 : cluster [DBG] 2.4 scrub starts 2024-02-10T08:36:19.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:18.737163+0000 osd.1 (osd.1) 249 : cluster [DBG] 2.4 scrub ok 2024-02-10T08:36:19.424 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:36:19.439 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:36:19.453 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:19.457 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:36:19.472 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:36:19.475 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:19.475 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:36:19.477 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:36:19.495 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:36:19.517 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:36:19.518 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:36:19.518 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:36:19.539 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:36:19.564 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:36:19.569 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:36:19.576 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:36:19.594 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:36:19.596 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-10T08:36:19.596 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-10T08:36:19.596 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-10T08:36:19.596 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-10T08:36:19.596 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-10T08:36:19.596 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-10T08:36:19.596 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-10T08:36:19.596 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-10T08:36:19.606 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:17.676675+0000 osd.2 (osd.2) 213 : cluster [DBG] 4.1c scrub starts 2024-02-10T08:36:19.606 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:17.678485+0000 osd.2 (osd.2) 214 : cluster [DBG] 4.1c scrub ok 2024-02-10T08:36:19.606 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:18.222970+0000 osd.4 (osd.4) 158 : cluster [DBG] 4.d scrub starts 2024-02-10T08:36:19.607 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:18.225209+0000 osd.4 (osd.4) 159 : cluster [DBG] 4.d scrub ok 2024-02-10T08:36:19.607 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:18.734029+0000 osd.1 (osd.1) 248 : cluster [DBG] 2.4 scrub starts 2024-02-10T08:36:19.607 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:18.737163+0000 osd.1 (osd.1) 249 : cluster [DBG] 2.4 scrub ok 2024-02-10T08:36:19.608 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:19.630 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:36:19.633 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:19.634 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:36:19.735 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:36:19.768 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:19.785 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:36:19.788 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:19.788 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:36:19.889 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:36:19.918 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:20.200 INFO:tasks.cephadm.ceph_manager.ceph:removing pool_name unique_pool_3 2024-02-10T08:36:20.200 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd pool rm unique_pool_3 unique_pool_3 --yes-i-really-really-mean-it 2024-02-10T08:36:20.586 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:36:18.737703+0000 mgr.y (mgr.14505) 734 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:36:20.586 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:18.908665+0000 osd.5 (osd.5) 245 : cluster [DBG] 3.2 scrub starts 2024-02-10T08:36:20.586 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:18.911555+0000 osd.5 (osd.5) 246 : cluster [DBG] 3.2 scrub ok 2024-02-10T08:36:20.586 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:19.027773+0000 osd.0 (osd.0) 221 : cluster [DBG] 10.8 scrub starts 2024-02-10T08:36:20.586 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:19.048330+0000 osd.0 (osd.0) 222 : cluster [DBG] 10.8 scrub ok 2024-02-10T08:36:20.586 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:19.055809+0000 mgr.y (mgr.14505) 735 : cluster [DBG] pgmap v901: 168 pgs: 168 active+clean; 262 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 788 op/s 2024-02-10T08:36:20.586 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:36:19.420447+0000 mon.a (mon.0) 1647 : audit [DBG] from='client.? 172.21.15.18:0/2383151163' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:36:20.586 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:19.769217+0000 osd.1 (osd.1) 250 : cluster [DBG] 6.20 deep-scrub starts 2024-02-10T08:36:20.586 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:19.772112+0000 osd.1 (osd.1) 251 : cluster [DBG] 6.20 deep-scrub ok 2024-02-10T08:36:20.587 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:36:18.737703+0000 mgr.y (mgr.14505) 734 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:36:20.587 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:18.908665+0000 osd.5 (osd.5) 245 : cluster [DBG] 3.2 scrub starts 2024-02-10T08:36:20.587 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:18.911555+0000 osd.5 (osd.5) 246 : cluster [DBG] 3.2 scrub ok 2024-02-10T08:36:20.587 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:19.027773+0000 osd.0 (osd.0) 221 : cluster [DBG] 10.8 scrub starts 2024-02-10T08:36:20.587 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:19.048330+0000 osd.0 (osd.0) 222 : cluster [DBG] 10.8 scrub ok 2024-02-10T08:36:20.587 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:19.055809+0000 mgr.y (mgr.14505) 735 : cluster [DBG] pgmap v901: 168 pgs: 168 active+clean; 262 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 788 op/s 2024-02-10T08:36:20.587 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:36:19.420447+0000 mon.a (mon.0) 1647 : audit [DBG] from='client.? 172.21.15.18:0/2383151163' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:36:20.587 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:19.769217+0000 osd.1 (osd.1) 250 : cluster [DBG] 6.20 deep-scrub starts 2024-02-10T08:36:20.587 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:19.772112+0000 osd.1 (osd.1) 251 : cluster [DBG] 6.20 deep-scrub ok 2024-02-10T08:36:20.793 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:36:18.737703+0000 mgr.y (mgr.14505) 734 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:36:20.793 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:18.908665+0000 osd.5 (osd.5) 245 : cluster [DBG] 3.2 scrub starts 2024-02-10T08:36:20.793 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:18.911555+0000 osd.5 (osd.5) 246 : cluster [DBG] 3.2 scrub ok 2024-02-10T08:36:20.794 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:19.027773+0000 osd.0 (osd.0) 221 : cluster [DBG] 10.8 scrub starts 2024-02-10T08:36:20.794 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:19.048330+0000 osd.0 (osd.0) 222 : cluster [DBG] 10.8 scrub ok 2024-02-10T08:36:20.794 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:19.055809+0000 mgr.y (mgr.14505) 735 : cluster [DBG] pgmap v901: 168 pgs: 168 active+clean; 262 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 788 op/s 2024-02-10T08:36:20.794 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:36:19.420447+0000 mon.a (mon.0) 1647 : audit [DBG] from='client.? 172.21.15.18:0/2383151163' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:36:20.794 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:19.769217+0000 osd.1 (osd.1) 250 : cluster [DBG] 6.20 deep-scrub starts 2024-02-10T08:36:20.794 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:19.772112+0000 osd.1 (osd.1) 251 : cluster [DBG] 6.20 deep-scrub ok 2024-02-10T08:36:21.468 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:36:21.472 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:21.472 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:36:21.573 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:36:21.602 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:21.701 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:36:21.707 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:21.708 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:36:21.809 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:36:21.837 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:22.134 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:20.263868+0000 osd.4 (osd.4) 160 : cluster [DBG] 6.2c scrub starts 2024-02-10T08:36:22.134 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:20.264955+0000 osd.4 (osd.4) 161 : cluster [DBG] 6.2c scrub ok 2024-02-10T08:36:22.134 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:20.793406+0000 osd.1 (osd.1) 252 : cluster [DBG] 6.1 deep-scrub starts 2024-02-10T08:36:22.134 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:20.807486+0000 osd.1 (osd.1) 253 : cluster [DBG] 6.1 deep-scrub ok 2024-02-10T08:36:22.134 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:20.954706+0000 osd.6 (osd.6) 235 : cluster [DBG] 2.19 scrub starts 2024-02-10T08:36:22.134 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:20.955579+0000 osd.6 (osd.6) 236 : cluster [DBG] 2.19 scrub ok 2024-02-10T08:36:22.134 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:21.056469+0000 mgr.y (mgr.14505) 736 : cluster [DBG] pgmap v902: 168 pgs: 168 active+clean; 5.7 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 685 op/s 2024-02-10T08:36:22.134 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:21.436105+0000 osd.7 (osd.7) 241 : cluster [DBG] 2.8 scrub starts 2024-02-10T08:36:22.134 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:21.439156+0000 osd.7 (osd.7) 242 : cluster [DBG] 2.8 scrub ok 2024-02-10T08:36:22.135 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:20.263868+0000 osd.4 (osd.4) 160 : cluster [DBG] 6.2c scrub starts 2024-02-10T08:36:22.135 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:20.264955+0000 osd.4 (osd.4) 161 : cluster [DBG] 6.2c scrub ok 2024-02-10T08:36:22.135 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:20.793406+0000 osd.1 (osd.1) 252 : cluster [DBG] 6.1 deep-scrub starts 2024-02-10T08:36:22.135 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:20.807486+0000 osd.1 (osd.1) 253 : cluster [DBG] 6.1 deep-scrub ok 2024-02-10T08:36:22.135 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:20.954706+0000 osd.6 (osd.6) 235 : cluster [DBG] 2.19 scrub starts 2024-02-10T08:36:22.135 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:20.955579+0000 osd.6 (osd.6) 236 : cluster [DBG] 2.19 scrub ok 2024-02-10T08:36:22.135 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:21.056469+0000 mgr.y (mgr.14505) 736 : cluster [DBG] pgmap v902: 168 pgs: 168 active+clean; 5.7 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 685 op/s 2024-02-10T08:36:22.135 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:21.436105+0000 osd.7 (osd.7) 241 : cluster [DBG] 2.8 scrub starts 2024-02-10T08:36:22.135 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:21.439156+0000 osd.7 (osd.7) 242 : cluster [DBG] 2.8 scrub ok 2024-02-10T08:36:22.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:20.263868+0000 osd.4 (osd.4) 160 : cluster [DBG] 6.2c scrub starts 2024-02-10T08:36:22.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:20.264955+0000 osd.4 (osd.4) 161 : cluster [DBG] 6.2c scrub ok 2024-02-10T08:36:22.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:20.793406+0000 osd.1 (osd.1) 252 : cluster [DBG] 6.1 deep-scrub starts 2024-02-10T08:36:22.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:20.807486+0000 osd.1 (osd.1) 253 : cluster [DBG] 6.1 deep-scrub ok 2024-02-10T08:36:22.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:20.954706+0000 osd.6 (osd.6) 235 : cluster [DBG] 2.19 scrub starts 2024-02-10T08:36:22.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:20.955579+0000 osd.6 (osd.6) 236 : cluster [DBG] 2.19 scrub ok 2024-02-10T08:36:22.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:21.056469+0000 mgr.y (mgr.14505) 736 : cluster [DBG] pgmap v902: 168 pgs: 168 active+clean; 5.7 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 685 op/s 2024-02-10T08:36:22.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:21.436105+0000 osd.7 (osd.7) 241 : cluster [DBG] 2.8 scrub starts 2024-02-10T08:36:22.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:21.439156+0000 osd.7 (osd.7) 242 : cluster [DBG] 2.8 scrub ok 2024-02-10T08:36:22.386 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:36:22.390 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:22.390 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:36:22.491 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:36:22.523 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:22.544 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:36:22.546 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:22.547 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:36:22.648 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:36:22.679 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:22.804 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:36:22.807 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:22.807 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:36:22.908 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:36:22.938 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:22.958 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:36:22.961 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:22.961 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:36:23.062 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:36:23.095 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:23.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:21.770726+0000 osd.1 (osd.1) 254 : cluster [DBG] 4.1d scrub starts 2024-02-10T08:36:23.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:21.774218+0000 osd.1 (osd.1) 255 : cluster [DBG] 4.1d scrub ok 2024-02-10T08:36:23.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:21.912921+0000 osd.5 (osd.5) 247 : cluster [DBG] 10.9 scrub starts 2024-02-10T08:36:23.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:21.930486+0000 osd.5 (osd.5) 248 : cluster [DBG] 10.9 scrub ok 2024-02-10T08:36:23.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:22.025480+0000 osd.0 (osd.0) 223 : cluster [DBG] 4.1e deep-scrub starts 2024-02-10T08:36:23.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:22.029269+0000 osd.0 (osd.0) 224 : cluster [DBG] 4.1e deep-scrub ok 2024-02-10T08:36:23.344 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:36:23.347 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:21.770726+0000 osd.1 (osd.1) 254 : cluster [DBG] 4.1d scrub starts 2024-02-10T08:36:23.347 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:21.774218+0000 osd.1 (osd.1) 255 : cluster [DBG] 4.1d scrub ok 2024-02-10T08:36:23.347 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:21.912921+0000 osd.5 (osd.5) 247 : cluster [DBG] 10.9 scrub starts 2024-02-10T08:36:23.347 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:21.930486+0000 osd.5 (osd.5) 248 : cluster [DBG] 10.9 scrub ok 2024-02-10T08:36:23.347 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:22.025480+0000 osd.0 (osd.0) 223 : cluster [DBG] 4.1e deep-scrub starts 2024-02-10T08:36:23.347 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:22.029269+0000 osd.0 (osd.0) 224 : cluster [DBG] 4.1e deep-scrub ok 2024-02-10T08:36:23.347 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:21.770726+0000 osd.1 (osd.1) 254 : cluster [DBG] 4.1d scrub starts 2024-02-10T08:36:23.347 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:21.774218+0000 osd.1 (osd.1) 255 : cluster [DBG] 4.1d scrub ok 2024-02-10T08:36:23.348 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:21.912921+0000 osd.5 (osd.5) 247 : cluster [DBG] 10.9 scrub starts 2024-02-10T08:36:23.348 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:21.930486+0000 osd.5 (osd.5) 248 : cluster [DBG] 10.9 scrub ok 2024-02-10T08:36:23.348 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:22.025480+0000 osd.0 (osd.0) 223 : cluster [DBG] 4.1e deep-scrub starts 2024-02-10T08:36:23.348 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:22.029269+0000 osd.0 (osd.0) 224 : cluster [DBG] 4.1e deep-scrub ok 2024-02-10T08:36:23.348 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:23.349 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:36:23.453 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:36:23.485 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:23.508 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:36:23.510 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:23.511 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:36:23.612 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:36:23.641 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:23.661 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:36:23.664 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:23.664 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:36:23.765 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:36:23.794 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:23.814 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:36:23.816 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:23.817 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:36:23.918 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:36:23.946 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:23.964 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:36:23.966 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:23.967 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:36:24.068 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:36:24.098 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:22.693899+0000 osd.2 (osd.2) 215 : cluster [DBG] 6.28 scrub starts 2024-02-10T08:36:24.098 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:22.694924+0000 osd.2 (osd.2) 216 : cluster [DBG] 6.28 scrub ok 2024-02-10T08:36:24.098 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:22.780866+0000 osd.1 (osd.1) 256 : cluster [DBG] 6.26 deep-scrub starts 2024-02-10T08:36:24.098 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:22.783765+0000 osd.1 (osd.1) 257 : cluster [DBG] 6.26 deep-scrub ok 2024-02-10T08:36:24.098 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:22.988438+0000 osd.2 (osd.2) 217 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:36:24.098 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:22.988486+0000 osd.2 (osd.2) 218 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:36:24.098 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:23.006737+0000 osd.0 (osd.0) 225 : cluster [DBG] 6.18 deep-scrub starts 2024-02-10T08:36:24.098 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:23.009697+0000 osd.0 (osd.0) 226 : cluster [DBG] 6.18 deep-scrub ok 2024-02-10T08:36:24.098 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:23.057019+0000 mgr.y (mgr.14505) 737 : cluster [DBG] pgmap v903: 168 pgs: 168 active+clean; 5.7 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 382 op/s 2024-02-10T08:36:24.098 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:23.461014+0000 osd.7 (osd.7) 243 : cluster [DBG] 5.14 scrub starts 2024-02-10T08:36:24.098 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:23.462209+0000 osd.7 (osd.7) 244 : cluster [DBG] 5.14 scrub ok 2024-02-10T08:36:24.099 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:22.693899+0000 osd.2 (osd.2) 215 : cluster [DBG] 6.28 scrub starts 2024-02-10T08:36:24.099 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:22.694924+0000 osd.2 (osd.2) 216 : cluster [DBG] 6.28 scrub ok 2024-02-10T08:36:24.099 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:22.780866+0000 osd.1 (osd.1) 256 : cluster [DBG] 6.26 deep-scrub starts 2024-02-10T08:36:24.099 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:22.783765+0000 osd.1 (osd.1) 257 : cluster [DBG] 6.26 deep-scrub ok 2024-02-10T08:36:24.099 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:22.988438+0000 osd.2 (osd.2) 217 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:36:24.099 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:22.988486+0000 osd.2 (osd.2) 218 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:36:24.099 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:23.006737+0000 osd.0 (osd.0) 225 : cluster [DBG] 6.18 deep-scrub starts 2024-02-10T08:36:24.099 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:23.009697+0000 osd.0 (osd.0) 226 : cluster [DBG] 6.18 deep-scrub ok 2024-02-10T08:36:24.099 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:23.057019+0000 mgr.y (mgr.14505) 737 : cluster [DBG] pgmap v903: 168 pgs: 168 active+clean; 5.7 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 382 op/s 2024-02-10T08:36:24.099 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:23.461014+0000 osd.7 (osd.7) 243 : cluster [DBG] 5.14 scrub starts 2024-02-10T08:36:24.099 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:23.462209+0000 osd.7 (osd.7) 244 : cluster [DBG] 5.14 scrub ok 2024-02-10T08:36:24.100 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:24.121 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:36:24.124 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:24.125 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:36:24.226 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:36:24.252 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:22.693899+0000 osd.2 (osd.2) 215 : cluster [DBG] 6.28 scrub starts 2024-02-10T08:36:24.252 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:22.694924+0000 osd.2 (osd.2) 216 : cluster [DBG] 6.28 scrub ok 2024-02-10T08:36:24.252 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:22.780866+0000 osd.1 (osd.1) 256 : cluster [DBG] 6.26 deep-scrub starts 2024-02-10T08:36:24.252 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:22.783765+0000 osd.1 (osd.1) 257 : cluster [DBG] 6.26 deep-scrub ok 2024-02-10T08:36:24.252 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:22.988438+0000 osd.2 (osd.2) 217 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:36:24.252 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:22.988486+0000 osd.2 (osd.2) 218 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:36:24.252 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:23.006737+0000 osd.0 (osd.0) 225 : cluster [DBG] 6.18 deep-scrub starts 2024-02-10T08:36:24.252 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:23.009697+0000 osd.0 (osd.0) 226 : cluster [DBG] 6.18 deep-scrub ok 2024-02-10T08:36:24.252 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:23.057019+0000 mgr.y (mgr.14505) 737 : cluster [DBG] pgmap v903: 168 pgs: 168 active+clean; 5.7 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 382 op/s 2024-02-10T08:36:24.252 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:23.461014+0000 osd.7 (osd.7) 243 : cluster [DBG] 5.14 scrub starts 2024-02-10T08:36:24.252 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:23.462209+0000 osd.7 (osd.7) 244 : cluster [DBG] 5.14 scrub ok 2024-02-10T08:36:24.253 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:24.272 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:36:24.276 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:24.276 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:36:24.377 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:36:24.408 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:25.078 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-02-10T08:36:25.079 INFO:teuthology.orchestra.run.smithi018.stdout: "success": "filestore_inject_stall = '3' (not observed, change may require restart) " 2024-02-10T08:36:25.079 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-02-10T08:36:25.097 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:23.219494+0000 osd.4 (osd.4) 162 : cluster [DBG] 4.13 scrub starts 2024-02-10T08:36:25.097 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:23.220914+0000 osd.4 (osd.4) 163 : cluster [DBG] 4.13 scrub ok 2024-02-10T08:36:25.097 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:23.941441+0000 mon.a (mon.0) 1648 : cluster [DBG] osdmap e392: 8 total, 8 up, 8 in 2024-02-10T08:36:25.097 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:24.506073+0000 osd.7 (osd.7) 245 : cluster [DBG] 4.17 scrub starts 2024-02-10T08:36:25.097 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:24.509576+0000 osd.7 (osd.7) 246 : cluster [DBG] 4.17 scrub ok 2024-02-10T08:36:25.098 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:23.219494+0000 osd.4 (osd.4) 162 : cluster [DBG] 4.13 scrub starts 2024-02-10T08:36:25.098 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:23.220914+0000 osd.4 (osd.4) 163 : cluster [DBG] 4.13 scrub ok 2024-02-10T08:36:25.098 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:23.941441+0000 mon.a (mon.0) 1648 : cluster [DBG] osdmap e392: 8 total, 8 up, 8 in 2024-02-10T08:36:25.098 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:24.506073+0000 osd.7 (osd.7) 245 : cluster [DBG] 4.17 scrub starts 2024-02-10T08:36:25.098 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:24.509576+0000 osd.7 (osd.7) 246 : cluster [DBG] 4.17 scrub ok 2024-02-10T08:36:25.179 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-02-10T08:36:25.179 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:36:25.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:23.219494+0000 osd.4 (osd.4) 162 : cluster [DBG] 4.13 scrub starts 2024-02-10T08:36:25.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:23.220914+0000 osd.4 (osd.4) 163 : cluster [DBG] 4.13 scrub ok 2024-02-10T08:36:25.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:23.941441+0000 mon.a (mon.0) 1648 : cluster [DBG] osdmap e392: 8 total, 8 up, 8 in 2024-02-10T08:36:25.293 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:24.506073+0000 osd.7 (osd.7) 245 : cluster [DBG] 4.17 scrub starts 2024-02-10T08:36:25.293 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:24.509576+0000 osd.7 (osd.7) 246 : cluster [DBG] 4.17 scrub ok 2024-02-10T08:36:25.919 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.1 dump_historic_ops 2024-02-10T08:36:26.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:24.204170+0000 osd.4 (osd.4) 164 : cluster [DBG] 5.18 deep-scrub starts 2024-02-10T08:36:26.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:24.205216+0000 osd.4 (osd.4) 165 : cluster [DBG] 5.18 deep-scrub ok 2024-02-10T08:36:26.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:25.057557+0000 mgr.y (mgr.14505) 738 : cluster [DBG] pgmap v905: 168 pgs: 168 active+clean; 5.7 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 145 op/s 2024-02-10T08:36:26.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:24.204170+0000 osd.4 (osd.4) 164 : cluster [DBG] 5.18 deep-scrub starts 2024-02-10T08:36:26.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:24.205216+0000 osd.4 (osd.4) 165 : cluster [DBG] 5.18 deep-scrub ok 2024-02-10T08:36:26.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:25.057557+0000 mgr.y (mgr.14505) 738 : cluster [DBG] pgmap v905: 168 pgs: 168 active+clean; 5.7 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 145 op/s 2024-02-10T08:36:26.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:24.204170+0000 osd.4 (osd.4) 164 : cluster [DBG] 5.18 deep-scrub starts 2024-02-10T08:36:26.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:24.205216+0000 osd.4 (osd.4) 165 : cluster [DBG] 5.18 deep-scrub ok 2024-02-10T08:36:26.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:25.057557+0000 mgr.y (mgr.14505) 738 : cluster [DBG] pgmap v905: 168 pgs: 168 active+clean; 5.7 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 145 op/s 2024-02-10T08:36:26.327 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:36:26.789 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:36:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:36:26] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:36:26.829 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-10T08:36:27.153 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:25.671158+0000 osd.2 (osd.2) 219 : cluster [DBG] 4.f scrub starts 2024-02-10T08:36:27.153 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:25.673368+0000 osd.2 (osd.2) 220 : cluster [DBG] 4.f scrub ok 2024-02-10T08:36:27.153 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:25.689575+0000 osd.3 (osd.3) 113 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:36:27.153 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:25.689610+0000 osd.3 (osd.3) 114 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:36:27.153 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:25.795581+0000 osd.5 (osd.5) 249 : cluster [DBG] 10.7 scrub starts 2024-02-10T08:36:27.153 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:25.808122+0000 osd.5 (osd.5) 250 : cluster [DBG] 10.7 scrub ok 2024-02-10T08:36:27.153 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:25.948753+0000 mon.a (mon.0) 1649 : cluster [DBG] osdmap e393: 8 total, 8 up, 8 in 2024-02-10T08:36:27.153 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:25.966380+0000 osd.0 (osd.0) 227 : cluster [DBG] 2.1f scrub starts 2024-02-10T08:36:27.153 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:25.970132+0000 osd.0 (osd.0) 228 : cluster [DBG] 2.1f scrub ok 2024-02-10T08:36:27.153 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:26.538101+0000 osd.7 (osd.7) 247 : cluster [DBG] 2.0 scrub starts 2024-02-10T08:36:27.153 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:26.541373+0000 osd.7 (osd.7) 248 : cluster [DBG] 2.0 scrub ok 2024-02-10T08:36:27.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:25.671158+0000 osd.2 (osd.2) 219 : cluster [DBG] 4.f scrub starts 2024-02-10T08:36:27.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:25.673368+0000 osd.2 (osd.2) 220 : cluster [DBG] 4.f scrub ok 2024-02-10T08:36:27.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:25.689575+0000 osd.3 (osd.3) 113 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:36:27.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:25.689610+0000 osd.3 (osd.3) 114 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:36:27.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:25.795581+0000 osd.5 (osd.5) 249 : cluster [DBG] 10.7 scrub starts 2024-02-10T08:36:27.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:25.808122+0000 osd.5 (osd.5) 250 : cluster [DBG] 10.7 scrub ok 2024-02-10T08:36:27.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:25.948753+0000 mon.a (mon.0) 1649 : cluster [DBG] osdmap e393: 8 total, 8 up, 8 in 2024-02-10T08:36:27.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:25.966380+0000 osd.0 (osd.0) 227 : cluster [DBG] 2.1f scrub starts 2024-02-10T08:36:27.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:25.970132+0000 osd.0 (osd.0) 228 : cluster [DBG] 2.1f scrub ok 2024-02-10T08:36:27.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:26.538101+0000 osd.7 (osd.7) 247 : cluster [DBG] 2.0 scrub starts 2024-02-10T08:36:27.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:26.541373+0000 osd.7 (osd.7) 248 : cluster [DBG] 2.0 scrub ok 2024-02-10T08:36:27.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:25.671158+0000 osd.2 (osd.2) 219 : cluster [DBG] 4.f scrub starts 2024-02-10T08:36:27.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:25.673368+0000 osd.2 (osd.2) 220 : cluster [DBG] 4.f scrub ok 2024-02-10T08:36:27.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:25.689575+0000 osd.3 (osd.3) 113 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:36:27.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:25.689610+0000 osd.3 (osd.3) 114 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:36:27.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:25.795581+0000 osd.5 (osd.5) 249 : cluster [DBG] 10.7 scrub starts 2024-02-10T08:36:27.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:25.808122+0000 osd.5 (osd.5) 250 : cluster [DBG] 10.7 scrub ok 2024-02-10T08:36:27.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:25.948753+0000 mon.a (mon.0) 1649 : cluster [DBG] osdmap e393: 8 total, 8 up, 8 in 2024-02-10T08:36:27.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:25.966380+0000 osd.0 (osd.0) 227 : cluster [DBG] 2.1f scrub starts 2024-02-10T08:36:27.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:25.970132+0000 osd.0 (osd.0) 228 : cluster [DBG] 2.1f scrub ok 2024-02-10T08:36:27.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:26.538101+0000 osd.7 (osd.7) 247 : cluster [DBG] 2.0 scrub starts 2024-02-10T08:36:27.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:26.541373+0000 osd.7 (osd.7) 248 : cluster [DBG] 2.0 scrub ok 2024-02-10T08:36:27.404 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:36:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:36:27] "GET /metrics HTTP/1.1" 200 176420 "" "Prometheus/2.33.4" 2024-02-10T08:36:27.460 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:36:27.464 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:27.464 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:36:27.565 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:36:27.595 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:27.616 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:36:27.619 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:27.619 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:36:27.720 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:36:27.754 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:28.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:26.216159+0000 osd.4 (osd.4) 166 : cluster [DBG] 6.1e scrub starts 2024-02-10T08:36:28.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:26.255227+0000 osd.4 (osd.4) 167 : cluster [DBG] 6.1e scrub ok 2024-02-10T08:36:28.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:26.666606+0000 osd.2 (osd.2) 221 : cluster [DBG] 10.5 scrub starts 2024-02-10T08:36:28.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:26.684764+0000 osd.2 (osd.2) 222 : cluster [DBG] 10.5 scrub ok 2024-02-10T08:36:28.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:26.878954+0000 osd.6 (osd.6) 237 : cluster [DBG] 5.1f deep-scrub starts 2024-02-10T08:36:28.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:26.882504+0000 osd.6 (osd.6) 238 : cluster [DBG] 5.1f deep-scrub ok 2024-02-10T08:36:28.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:26.944503+0000 osd.1 (osd.1) 258 : cluster [DBG] 4.4 scrub starts 2024-02-10T08:36:28.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:26.947994+0000 osd.1 (osd.1) 259 : cluster [DBG] 4.4 scrub ok 2024-02-10T08:36:28.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:27.057978+0000 mgr.y (mgr.14505) 739 : cluster [DBG] pgmap v907: 168 pgs: 168 active+clean; 5.7 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 1 op/s 2024-02-10T08:36:28.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:27.549101+0000 osd.7 (osd.7) 249 : cluster [DBG] 10.c scrub starts 2024-02-10T08:36:28.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:27.571062+0000 osd.7 (osd.7) 250 : cluster [DBG] 10.c scrub ok 2024-02-10T08:36:28.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:26.216159+0000 osd.4 (osd.4) 166 : cluster [DBG] 6.1e scrub starts 2024-02-10T08:36:28.158 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:26.255227+0000 osd.4 (osd.4) 167 : cluster [DBG] 6.1e scrub ok 2024-02-10T08:36:28.158 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:26.666606+0000 osd.2 (osd.2) 221 : cluster [DBG] 10.5 scrub starts 2024-02-10T08:36:28.158 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:26.684764+0000 osd.2 (osd.2) 222 : cluster [DBG] 10.5 scrub ok 2024-02-10T08:36:28.158 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:26.878954+0000 osd.6 (osd.6) 237 : cluster [DBG] 5.1f deep-scrub starts 2024-02-10T08:36:28.158 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:26.882504+0000 osd.6 (osd.6) 238 : cluster [DBG] 5.1f deep-scrub ok 2024-02-10T08:36:28.158 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:26.944503+0000 osd.1 (osd.1) 258 : cluster [DBG] 4.4 scrub starts 2024-02-10T08:36:28.158 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:26.947994+0000 osd.1 (osd.1) 259 : cluster [DBG] 4.4 scrub ok 2024-02-10T08:36:28.158 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:27.057978+0000 mgr.y (mgr.14505) 739 : cluster [DBG] pgmap v907: 168 pgs: 168 active+clean; 5.7 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 1 op/s 2024-02-10T08:36:28.158 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:27.549101+0000 osd.7 (osd.7) 249 : cluster [DBG] 10.c scrub starts 2024-02-10T08:36:28.158 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:27.571062+0000 osd.7 (osd.7) 250 : cluster [DBG] 10.c scrub ok 2024-02-10T08:36:28.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:26.216159+0000 osd.4 (osd.4) 166 : cluster [DBG] 6.1e scrub starts 2024-02-10T08:36:28.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:26.255227+0000 osd.4 (osd.4) 167 : cluster [DBG] 6.1e scrub ok 2024-02-10T08:36:28.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:26.666606+0000 osd.2 (osd.2) 221 : cluster [DBG] 10.5 scrub starts 2024-02-10T08:36:28.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:26.684764+0000 osd.2 (osd.2) 222 : cluster [DBG] 10.5 scrub ok 2024-02-10T08:36:28.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:26.878954+0000 osd.6 (osd.6) 237 : cluster [DBG] 5.1f deep-scrub starts 2024-02-10T08:36:28.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:26.882504+0000 osd.6 (osd.6) 238 : cluster [DBG] 5.1f deep-scrub ok 2024-02-10T08:36:28.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:26.944503+0000 osd.1 (osd.1) 258 : cluster [DBG] 4.4 scrub starts 2024-02-10T08:36:28.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:26.947994+0000 osd.1 (osd.1) 259 : cluster [DBG] 4.4 scrub ok 2024-02-10T08:36:28.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:27.057978+0000 mgr.y (mgr.14505) 739 : cluster [DBG] pgmap v907: 168 pgs: 168 active+clean; 5.7 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 1 op/s 2024-02-10T08:36:28.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:27.549101+0000 osd.7 (osd.7) 249 : cluster [DBG] 10.c scrub starts 2024-02-10T08:36:28.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:27.571062+0000 osd.7 (osd.7) 250 : cluster [DBG] 10.c scrub ok 2024-02-10T08:36:28.305 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:36:28.308 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:28.309 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:36:28.409 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:36:28.441 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:28.463 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:36:28.466 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:28.466 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:36:28.567 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:36:28.589 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:36:28.598 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:28.618 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:36:28.621 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:28.622 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:36:28.723 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:36:28.751 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:28.907 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:36:28.910 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:28.911 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:36:28.963 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is set 2024-02-10T08:36:29.012 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:36:29.039 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:36:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:36:29.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:27.214245+0000 osd.4 (osd.4) 168 : cluster [DBG] 6.e scrub starts 2024-02-10T08:36:29.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:27.252705+0000 osd.4 (osd.4) 169 : cluster [DBG] 6.e scrub ok 2024-02-10T08:36:29.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:27.909318+0000 osd.1 (osd.1) 260 : cluster [DBG] 2.6 scrub starts 2024-02-10T08:36:29.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:27.912310+0000 osd.1 (osd.1) 261 : cluster [DBG] 2.6 scrub ok 2024-02-10T08:36:29.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:28.349576+0000 osd.0 (osd.0) 229 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:36:29.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:28.349657+0000 osd.0 (osd.0) 230 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:36:29.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:36:28.791721+0000 mon.a (mon.0) 1650 : audit [INF] from='client.? 172.21.15.18:0/2435433851' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:36:29.044 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:29.065 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:36:29.068 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:29.069 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:36:29.086 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:27.214245+0000 osd.4 (osd.4) 168 : cluster [DBG] 6.e scrub starts 2024-02-10T08:36:29.086 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:27.252705+0000 osd.4 (osd.4) 169 : cluster [DBG] 6.e scrub ok 2024-02-10T08:36:29.086 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:27.909318+0000 osd.1 (osd.1) 260 : cluster [DBG] 2.6 scrub starts 2024-02-10T08:36:29.086 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:27.912310+0000 osd.1 (osd.1) 261 : cluster [DBG] 2.6 scrub ok 2024-02-10T08:36:29.086 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:28.349576+0000 osd.0 (osd.0) 229 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:36:29.086 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:28.349657+0000 osd.0 (osd.0) 230 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:36:29.086 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:36:28.791721+0000 mon.a (mon.0) 1650 : audit [INF] from='client.? 172.21.15.18:0/2435433851' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:36:29.087 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:27.214245+0000 osd.4 (osd.4) 168 : cluster [DBG] 6.e scrub starts 2024-02-10T08:36:29.087 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:27.252705+0000 osd.4 (osd.4) 169 : cluster [DBG] 6.e scrub ok 2024-02-10T08:36:29.087 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:27.909318+0000 osd.1 (osd.1) 260 : cluster [DBG] 2.6 scrub starts 2024-02-10T08:36:29.087 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:27.912310+0000 osd.1 (osd.1) 261 : cluster [DBG] 2.6 scrub ok 2024-02-10T08:36:29.087 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:28.349576+0000 osd.0 (osd.0) 229 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:36:29.087 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:28.349657+0000 osd.0 (osd.0) 230 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:36:29.087 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:36:28.791721+0000 mon.a (mon.0) 1650 : audit [INF] from='client.? 172.21.15.18:0/2435433851' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:36:29.170 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:36:29.200 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:29.253 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:36:29.255 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:29.256 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:36:29.357 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:36:29.385 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:30.036 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:36:30.039 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:30.039 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:36:30.140 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:36:30.172 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:30.196 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:30.197 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:36:30.197 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:36:30.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:28.644872+0000 osd.2 (osd.2) 223 : cluster [DBG] 10.3 scrub starts 2024-02-10T08:36:30.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:28.660346+0000 osd.2 (osd.2) 224 : cluster [DBG] 10.3 scrub ok 2024-02-10T08:36:30.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:36:28.748403+0000 mgr.y (mgr.14505) 740 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:36:30.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:28.926925+0000 osd.1 (osd.1) 262 : cluster [DBG] 5.c scrub starts 2024-02-10T08:36:30.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:28.929991+0000 osd.1 (osd.1) 263 : cluster [DBG] 5.c scrub ok 2024-02-10T08:36:30.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:28.952985+0000 mon.a (mon.0) 1651 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:36:30.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:36:28.960409+0000 mon.a (mon.0) 1652 : audit [INF] from='client.? 172.21.15.18:0/2435433851' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-10T08:36:30.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:28.960454+0000 mon.a (mon.0) 1653 : cluster [DBG] osdmap e394: 8 total, 8 up, 8 in 2024-02-10T08:36:30.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:29.055715+0000 osd.0 (osd.0) 231 : cluster [DBG] 6.23 scrub starts 2024-02-10T08:36:30.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:29.058295+0000 mgr.y (mgr.14505) 741 : cluster [DBG] pgmap v909: 168 pgs: 168 active+clean; 5.7 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:36:30.297 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:36:30.328 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:30.348 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:36:30.350 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:30.351 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:36:30.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:28.644872+0000 osd.2 (osd.2) 223 : cluster [DBG] 10.3 scrub starts 2024-02-10T08:36:30.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:28.660346+0000 osd.2 (osd.2) 224 : cluster [DBG] 10.3 scrub ok 2024-02-10T08:36:30.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:36:28.748403+0000 mgr.y (mgr.14505) 740 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:36:30.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:28.926925+0000 osd.1 (osd.1) 262 : cluster [DBG] 5.c scrub starts 2024-02-10T08:36:30.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:28.929991+0000 osd.1 (osd.1) 263 : cluster [DBG] 5.c scrub ok 2024-02-10T08:36:30.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:28.952985+0000 mon.a (mon.0) 1651 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:36:30.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:36:28.960409+0000 mon.a (mon.0) 1652 : audit [INF] from='client.? 172.21.15.18:0/2435433851' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-10T08:36:30.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:28.960454+0000 mon.a (mon.0) 1653 : cluster [DBG] osdmap e394: 8 total, 8 up, 8 in 2024-02-10T08:36:30.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:29.055715+0000 osd.0 (osd.0) 231 : cluster [DBG] 6.23 scrub starts 2024-02-10T08:36:30.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:29.058295+0000 mgr.y (mgr.14505) 741 : cluster [DBG] pgmap v909: 168 pgs: 168 active+clean; 5.7 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:36:30.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:28.644872+0000 osd.2 (osd.2) 223 : cluster [DBG] 10.3 scrub starts 2024-02-10T08:36:30.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:28.660346+0000 osd.2 (osd.2) 224 : cluster [DBG] 10.3 scrub ok 2024-02-10T08:36:30.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:36:28.748403+0000 mgr.y (mgr.14505) 740 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:36:30.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:28.926925+0000 osd.1 (osd.1) 262 : cluster [DBG] 5.c scrub starts 2024-02-10T08:36:30.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:28.929991+0000 osd.1 (osd.1) 263 : cluster [DBG] 5.c scrub ok 2024-02-10T08:36:30.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:28.952985+0000 mon.a (mon.0) 1651 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:36:30.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:36:28.960409+0000 mon.a (mon.0) 1652 : audit [INF] from='client.? 172.21.15.18:0/2435433851' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-10T08:36:30.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:28.960454+0000 mon.a (mon.0) 1653 : cluster [DBG] osdmap e394: 8 total, 8 up, 8 in 2024-02-10T08:36:30.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:29.055715+0000 osd.0 (osd.0) 231 : cluster [DBG] 6.23 scrub starts 2024-02-10T08:36:30.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:29.058295+0000 mgr.y (mgr.14505) 741 : cluster [DBG] pgmap v909: 168 pgs: 168 active+clean; 5.7 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:36:30.451 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:36:30.482 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:31.033 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:36:31.035 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:31.036 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:36:31.136 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:36:31.165 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:31.187 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:36:31.189 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:31.190 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:36:31.290 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:36:31.322 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:31.343 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:36:31.345 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:31.346 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:36:31.447 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:36:31.476 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:31.805 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 3, 4, 5, 6, 7, 0] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 5, 6, 7, 4] 2024-02-10T08:36:31.805 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-10T08:36:31.857 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:36:31.967 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'unique_pool_3' removed 2024-02-10T08:36:32.124 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:36:32.131 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:32.131 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:36:32.132 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:31.058723+0000 mgr.y (mgr.14505) 742 : cluster [DBG] pgmap v910: 168 pgs: 168 active+clean; 5.7 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 719 B/s rd, 0 op/s 2024-02-10T08:36:32.132 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:36:31.469306+0000 mon.a (mon.0) 1654 : audit [INF] from='client.? 172.21.15.18:0/2805352113' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_3", "pool2": "unique_pool_3", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-10T08:36:32.132 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:36:31.687029+0000 mon.a (mon.0) 1655 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:36:32.133 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:31.058723+0000 mgr.y (mgr.14505) 742 : cluster [DBG] pgmap v910: 168 pgs: 168 active+clean; 5.7 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 719 B/s rd, 0 op/s 2024-02-10T08:36:32.133 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:36:31.469306+0000 mon.a (mon.0) 1654 : audit [INF] from='client.? 172.21.15.18:0/2805352113' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_3", "pool2": "unique_pool_3", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-10T08:36:32.133 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:36:31.687029+0000 mon.a (mon.0) 1655 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:36:32.232 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:36:32.257 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:31.058723+0000 mgr.y (mgr.14505) 742 : cluster [DBG] pgmap v910: 168 pgs: 168 active+clean; 5.7 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 719 B/s rd, 0 op/s 2024-02-10T08:36:32.257 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:36:31.469306+0000 mon.a (mon.0) 1654 : audit [INF] from='client.? 172.21.15.18:0/2805352113' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_3", "pool2": "unique_pool_3", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-10T08:36:32.257 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:36:31.687029+0000 mon.a (mon.0) 1655 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:36:32.259 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:32.277 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:36:32.280 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:32.280 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:36:32.381 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:36:32.410 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:32.794 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2024-02-10T08:36:32.795 INFO:tasks.radosbench:Beginning radosbench... 2024-02-10T08:36:32.795 INFO:tasks.cephadm.ceph_manager.ceph:creating pool_name unique_pool_4 2024-02-10T08:36:32.795 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd pool create unique_pool_4 16 2024-02-10T08:36:33.028 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd set nodeep-scrub 2024-02-10T08:36:33.056 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:36:31.937385+0000 mon.a (mon.0) 1656 : audit [INF] from='client.? 172.21.15.18:0/2805352113' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_3", "pool2": "unique_pool_3", "yes_i_really_really_mean_it": true}]': finished 2024-02-10T08:36:33.056 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:31.937461+0000 mon.a (mon.0) 1657 : cluster [DBG] osdmap e395: 8 total, 8 up, 8 in 2024-02-10T08:36:33.056 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:36:31.937385+0000 mon.a (mon.0) 1656 : audit [INF] from='client.? 172.21.15.18:0/2805352113' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_3", "pool2": "unique_pool_3", "yes_i_really_really_mean_it": true}]': finished 2024-02-10T08:36:33.056 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:31.937461+0000 mon.a (mon.0) 1657 : cluster [DBG] osdmap e395: 8 total, 8 up, 8 in 2024-02-10T08:36:33.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:36:31.937385+0000 mon.a (mon.0) 1656 : audit [INF] from='client.? 172.21.15.18:0/2805352113' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_3", "pool2": "unique_pool_3", "yes_i_really_really_mean_it": true}]': finished 2024-02-10T08:36:33.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:31.937461+0000 mon.a (mon.0) 1657 : cluster [DBG] osdmap e395: 8 total, 8 up, 8 in 2024-02-10T08:36:33.833 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-02-10T08:36:33.833 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:36:34.091 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:36:34.093 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:34.093 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:36:34.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:32.492120+0000 osd.1 (osd.1) 264 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:36:34.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:32.492168+0000 osd.1 (osd.1) 265 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:36:34.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:32.943344+0000 mon.a (mon.0) 1658 : cluster [DBG] osdmap e396: 8 total, 8 up, 8 in 2024-02-10T08:36:34.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:33.059055+0000 mgr.y (mgr.14505) 743 : cluster [DBG] pgmap v913: 152 pgs: 152 active+clean; 5.7 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-02-10T08:36:34.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:32.492120+0000 osd.1 (osd.1) 264 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:36:34.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:32.492168+0000 osd.1 (osd.1) 265 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:36:34.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:32.943344+0000 mon.a (mon.0) 1658 : cluster [DBG] osdmap e396: 8 total, 8 up, 8 in 2024-02-10T08:36:34.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:33.059055+0000 mgr.y (mgr.14505) 743 : cluster [DBG] pgmap v913: 152 pgs: 152 active+clean; 5.7 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-02-10T08:36:34.194 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:36:34.224 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:32.492120+0000 osd.1 (osd.1) 264 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:36:34.224 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:32.492168+0000 osd.1 (osd.1) 265 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:36:34.225 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:32.943344+0000 mon.a (mon.0) 1658 : cluster [DBG] osdmap e396: 8 total, 8 up, 8 in 2024-02-10T08:36:34.225 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:33.059055+0000 mgr.y (mgr.14505) 743 : cluster [DBG] pgmap v913: 152 pgs: 152 active+clean; 5.7 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-02-10T08:36:34.226 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:34.247 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:36:34.250 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:34.250 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:36:34.351 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:36:34.381 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:34.713 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.2 dump_ops_in_flight 2024-02-10T08:36:34.731 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:36:34.734 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:34.734 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:36:34.835 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:36:34.904 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:34.943 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:36:34.954 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:34.954 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:36:35.055 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:36:35.087 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:35.112 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:35.113 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:36:35.113 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:36:35.214 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:36:35.245 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:35.318 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:36:35.318 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:36:35.319 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:36:35.321 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:35.322 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:36:35.423 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:36:35.455 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:35.476 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:36:35.479 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:35.479 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:36:35.580 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:36:35.609 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:35.629 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:36:35.632 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:35.633 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:36:35.734 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:36:35.767 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:36.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:35.059516+0000 mgr.y (mgr.14505) 744 : cluster [DBG] pgmap v914: 152 pgs: 152 active+clean; 5.7 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 671 B/s rd, 0 op/s 2024-02-10T08:36:36.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:35.059516+0000 mgr.y (mgr.14505) 744 : cluster [DBG] pgmap v914: 152 pgs: 152 active+clean; 5.7 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 671 B/s rd, 0 op/s 2024-02-10T08:36:36.417 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:36:36.422 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:36.423 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:36:36.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:35.059516+0000 mgr.y (mgr.14505) 744 : cluster [DBG] pgmap v914: 152 pgs: 152 active+clean; 5.7 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 671 B/s rd, 0 op/s 2024-02-10T08:36:36.524 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:36:36.556 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:36.577 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:36:36.580 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:36.580 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:36:36.681 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:36:36.710 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:36.730 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:36:36.732 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:36.733 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:36:36.762 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:36:36.789 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:36:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:36:36] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:36:36.834 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:36:36.864 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:37.404 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:36:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:36:37] "GET /metrics HTTP/1.1" 200 176386 "" "Prometheus/2.33.4" 2024-02-10T08:36:38.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:37.059835+0000 mgr.y (mgr.14505) 745 : cluster [DBG] pgmap v915: 152 pgs: 152 active+clean; 5.7 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-02-10T08:36:38.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:36:37.962608+0000 mon.c (mon.2) 89 : audit [DBG] from='client.? 172.21.15.18:0/366515727' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:36:38.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:37.059835+0000 mgr.y (mgr.14505) 745 : cluster [DBG] pgmap v915: 152 pgs: 152 active+clean; 5.7 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-02-10T08:36:38.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:36:37.962608+0000 mon.c (mon.2) 89 : audit [DBG] from='client.? 172.21.15.18:0/366515727' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:36:38.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:37.059835+0000 mgr.y (mgr.14505) 745 : cluster [DBG] pgmap v915: 152 pgs: 152 active+clean; 5.7 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-02-10T08:36:38.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:36:37.962608+0000 mon.c (mon.2) 89 : audit [DBG] from='client.? 172.21.15.18:0/366515727' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:36:38.585 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:36:38.585 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:36:38.586 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:36:38.586 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:36:38.586 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:36:38.586 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:36:38.586 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:36:38.586 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:36:38.586 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-10T08:36:38.586 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-10T08:36:38.586 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-10T08:36:38.586 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-10T08:36:38.586 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-10T08:36:38.586 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-10T08:36:38.586 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-10T08:36:38.587 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-10T08:36:38.816 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:36:38.821 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:38.821 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:36:38.922 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:36:38.954 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:39.039 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:36:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:36:39.705 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:36:39.708 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:39.709 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:36:39.809 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:36:39.841 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:40.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:36:38.759288+0000 mgr.y (mgr.14505) 746 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:36:40.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:39.060572+0000 mgr.y (mgr.14505) 747 : cluster [DBG] pgmap v916: 152 pgs: 152 active+clean; 5.7 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-02-10T08:36:40.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:36:38.759288+0000 mgr.y (mgr.14505) 746 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:36:40.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:39.060572+0000 mgr.y (mgr.14505) 747 : cluster [DBG] pgmap v916: 152 pgs: 152 active+clean; 5.7 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-02-10T08:36:40.493 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:36:40.496 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:40.497 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:36:40.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:36:38.759288+0000 mgr.y (mgr.14505) 746 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:36:40.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:39.060572+0000 mgr.y (mgr.14505) 747 : cluster [DBG] pgmap v916: 152 pgs: 152 active+clean; 5.7 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-02-10T08:36:40.598 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:36:40.633 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:40.654 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:36:40.656 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:40.657 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:36:40.758 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:36:40.790 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:40.811 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:36:40.814 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:40.814 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:36:40.915 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:36:40.946 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:40.966 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:36:40.968 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:40.969 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:36:41.070 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:36:41.101 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:41.121 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:36:41.127 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:41.128 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:36:41.130 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is set 2024-02-10T08:36:41.228 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:36:41.257 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:41.276 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:36:41.279 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:41.279 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:36:41.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:41 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:36:40.260896+0000 mon.c (mon.2) 90 : audit [INF] from='client.? 172.21.15.18:0/823563396' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:36:41.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:41 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:36:40.261201+0000 mon.a (mon.0) 1659 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:36:41.380 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:36:41.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:36:40.260896+0000 mon.c (mon.2) 90 : audit [INF] from='client.? 172.21.15.18:0/823563396' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:36:41.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:36:40.261201+0000 mon.a (mon.0) 1659 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:36:41.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:36:40.260896+0000 mon.c (mon.2) 90 : audit [INF] from='client.? 172.21.15.18:0/823563396' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:36:41.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:36:40.261201+0000 mon.a (mon.0) 1659 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:36:41.410 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:41.416 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-10T08:36:41.586 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-02-10T08:36:41.586 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-02-10T08:36:41.586 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-02-10T08:36:41.586 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-02-10T08:36:42.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:41.060955+0000 mgr.y (mgr.14505) 748 : cluster [DBG] pgmap v917: 152 pgs: 152 active+clean; 5.7 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-02-10T08:36:42.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:41.118619+0000 mon.a (mon.0) 1660 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:36:42.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:36:41.126920+0000 mon.a (mon.0) 1661 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-10T08:36:42.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:41.126992+0000 mon.a (mon.0) 1662 : cluster [DBG] osdmap e397: 8 total, 8 up, 8 in 2024-02-10T08:36:42.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:41.060955+0000 mgr.y (mgr.14505) 748 : cluster [DBG] pgmap v917: 152 pgs: 152 active+clean; 5.7 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-02-10T08:36:42.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:41.118619+0000 mon.a (mon.0) 1660 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:36:42.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:36:41.126920+0000 mon.a (mon.0) 1661 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-10T08:36:42.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:41.126992+0000 mon.a (mon.0) 1662 : cluster [DBG] osdmap e397: 8 total, 8 up, 8 in 2024-02-10T08:36:42.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:41.060955+0000 mgr.y (mgr.14505) 748 : cluster [DBG] pgmap v917: 152 pgs: 152 active+clean; 5.7 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-02-10T08:36:42.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:41.118619+0000 mon.a (mon.0) 1660 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:36:42.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:36:41.126920+0000 mon.a (mon.0) 1661 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-10T08:36:42.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:41.126992+0000 mon.a (mon.0) 1662 : cluster [DBG] osdmap e397: 8 total, 8 up, 8 in 2024-02-10T08:36:42.611 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.2 dump_blocked_ops 2024-02-10T08:36:43.161 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:36:43.165 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:43.166 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:36:43.266 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:36:43.298 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:43.319 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:36:43.322 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:43.323 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:36:43.423 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:36:43.453 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:43.468 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:36:43.473 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:36:43.476 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:43.476 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:36:43.487 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:36:43.577 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:36:43.606 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:43.625 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:36:43.628 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:43.629 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:36:43.730 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:36:43.758 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:43.776 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:36:43.778 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:43.779 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:36:43.879 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:36:43.906 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:43.924 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:36:43.927 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:43.927 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:36:44.028 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:36:44.058 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:44.137 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'unique_pool_4' created 2024-02-10T08:36:44.157 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:36:44.160 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:44.161 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:36:44.262 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:36:44.288 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:44 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:43.061542+0000 mgr.y (mgr.14505) 749 : cluster [DBG] pgmap v919: 152 pgs: 152 active+clean; 5.7 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-10T08:36:44.288 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:44 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:36:43.625902+0000 mon.a (mon.0) 1663 : audit [INF] from='client.? 172.21.15.18:0/123439657' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_4", "pg_num": 16}]: dispatch 2024-02-10T08:36:44.290 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:44.309 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:36:44.311 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:44.312 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:36:44.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:43.061542+0000 mgr.y (mgr.14505) 749 : cluster [DBG] pgmap v919: 152 pgs: 152 active+clean; 5.7 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-10T08:36:44.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:36:43.625902+0000 mon.a (mon.0) 1663 : audit [INF] from='client.? 172.21.15.18:0/123439657' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_4", "pg_num": 16}]: dispatch 2024-02-10T08:36:44.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:43.061542+0000 mgr.y (mgr.14505) 749 : cluster [DBG] pgmap v919: 152 pgs: 152 active+clean; 5.7 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-10T08:36:44.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:36:43.625902+0000 mon.a (mon.0) 1663 : audit [INF] from='client.? 172.21.15.18:0/123439657' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_4", "pg_num": 16}]: dispatch 2024-02-10T08:36:44.413 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:36:44.439 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:44.457 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:36:44.459 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:44.460 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:36:44.561 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:36:44.587 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:44.605 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:36:44.608 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:44.608 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:36:44.709 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:36:44.739 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:44.759 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:36:44.761 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:44.761 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:36:44.862 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:36:44.890 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:45.162 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd unset noscrub 2024-02-10T08:36:45.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:36:44.129533+0000 mon.a (mon.0) 1664 : audit [INF] from='client.? 172.21.15.18:0/123439657' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_4", "pg_num": 16}]': finished 2024-02-10T08:36:45.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:44.129593+0000 mon.a (mon.0) 1665 : cluster [DBG] osdmap e398: 8 total, 8 up, 8 in 2024-02-10T08:36:45.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:36:44.129533+0000 mon.a (mon.0) 1664 : audit [INF] from='client.? 172.21.15.18:0/123439657' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_4", "pg_num": 16}]': finished 2024-02-10T08:36:45.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:44.129593+0000 mon.a (mon.0) 1665 : cluster [DBG] osdmap e398: 8 total, 8 up, 8 in 2024-02-10T08:36:45.439 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:36:45.442 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:45.443 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:36:45.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:36:44.129533+0000 mon.a (mon.0) 1664 : audit [INF] from='client.? 172.21.15.18:0/123439657' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_4", "pg_num": 16}]': finished 2024-02-10T08:36:45.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:44.129593+0000 mon.a (mon.0) 1665 : cluster [DBG] osdmap e398: 8 total, 8 up, 8 in 2024-02-10T08:36:45.544 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:36:45.572 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:46.286 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd pool application enable unique_pool_4 rados --yes-i-really-mean-it || true 2024-02-10T08:36:46.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:45.062041+0000 mgr.y (mgr.14505) 750 : cluster [DBG] pgmap v921: 168 pgs: 1 creating+peering, 15 unknown, 152 active+clean; 5.7 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:36:46.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:45.134340+0000 mon.a (mon.0) 1666 : cluster [DBG] osdmap e399: 8 total, 8 up, 8 in 2024-02-10T08:36:46.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:45.062041+0000 mgr.y (mgr.14505) 750 : cluster [DBG] pgmap v921: 168 pgs: 1 creating+peering, 15 unknown, 152 active+clean; 5.7 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:36:46.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:45.134340+0000 mon.a (mon.0) 1666 : cluster [DBG] osdmap e399: 8 total, 8 up, 8 in 2024-02-10T08:36:46.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:45.062041+0000 mgr.y (mgr.14505) 750 : cluster [DBG] pgmap v921: 168 pgs: 1 creating+peering, 15 unknown, 152 active+clean; 5.7 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:36:46.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:45.134340+0000 mon.a (mon.0) 1666 : cluster [DBG] osdmap e399: 8 total, 8 up, 8 in 2024-02-10T08:36:46.542 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:36:46.546 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:46.546 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:36:46.647 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:36:46.678 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:46.789 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:36:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:36:46] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:36:46.862 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:36:46.880 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:36:46.881 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:36:46.883 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:46.884 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:36:46.898 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:36:46.915 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:36:46.934 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:36:46.952 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:36:46.970 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:36:46.984 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:36:46.988 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:36:46.988 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-10T08:36:46.988 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-10T08:36:46.989 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-10T08:36:46.989 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-10T08:36:46.989 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-10T08:36:46.989 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-10T08:36:46.989 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-10T08:36:46.989 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-10T08:36:47.014 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:47.042 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:36:47.051 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:47.052 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:36:47.142 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:46.139526+0000 mon.a (mon.0) 1667 : cluster [DBG] osdmap e400: 8 total, 8 up, 8 in 2024-02-10T08:36:47.142 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:36:46.842614+0000 mon.a (mon.0) 1668 : audit [DBG] from='client.? 172.21.15.18:0/3195957279' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:36:47.153 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:36:47.181 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:47.380 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:36:47.383 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:47.383 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:36:47.404 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:36:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:36:47] "GET /metrics HTTP/1.1" 200 176479 "" "Prometheus/2.33.4" 2024-02-10T08:36:47.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:46.139526+0000 mon.a (mon.0) 1667 : cluster [DBG] osdmap e400: 8 total, 8 up, 8 in 2024-02-10T08:36:47.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:36:46.842614+0000 mon.a (mon.0) 1668 : audit [DBG] from='client.? 172.21.15.18:0/3195957279' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:36:47.485 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:36:47.515 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:46.139526+0000 mon.a (mon.0) 1667 : cluster [DBG] osdmap e400: 8 total, 8 up, 8 in 2024-02-10T08:36:47.515 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:36:46.842614+0000 mon.a (mon.0) 1668 : audit [DBG] from='client.? 172.21.15.18:0/3195957279' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:36:47.517 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:47.538 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:36:47.540 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:47.541 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:36:47.641 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:36:47.672 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:47.684 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:36:47.687 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:36:47.692 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:36:47.695 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:47.696 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:36:47.797 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:36:47.825 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:47.843 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:36:47.846 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:47.847 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:36:47.947 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:36:47.976 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:47.995 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:36:47.997 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:47.998 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:36:48.098 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:36:48.126 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:48.146 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:36:48.148 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:48.149 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:36:48.250 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:36:48.275 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:47.062366+0000 mgr.y (mgr.14505) 751 : cluster [DBG] pgmap v924: 168 pgs: 1 creating+peering, 15 unknown, 152 active+clean; 5.7 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 862 B/s rd, 0 op/s 2024-02-10T08:36:48.275 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:47.062366+0000 mgr.y (mgr.14505) 751 : cluster [DBG] pgmap v924: 168 pgs: 1 creating+peering, 15 unknown, 152 active+clean; 5.7 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 862 B/s rd, 0 op/s 2024-02-10T08:36:48.278 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:48.529 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:36:48.531 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:48.531 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:36:48.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:47.062366+0000 mgr.y (mgr.14505) 751 : cluster [DBG] pgmap v924: 168 pgs: 1 creating+peering, 15 unknown, 152 active+clean; 5.7 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 862 B/s rd, 0 op/s 2024-02-10T08:36:48.632 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:36:48.660 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:48.680 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:36:48.682 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:48.683 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:36:48.783 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:36:48.810 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:48.828 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:36:48.830 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:48.831 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:36:48.932 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:36:48.956 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:36:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:36:48.958 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:48.976 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:36:48.979 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:48.979 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:36:49.080 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:36:49.106 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:49.124 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:36:49.127 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:49.127 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:36:49.231 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:36:49.262 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:49.712 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:36:49.715 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:49.716 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:36:49.817 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:36:49.848 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:49.872 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-02-10T08:36:49.872 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:36:50.147 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:36:48.770304+0000 mgr.y (mgr.14505) 752 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:36:50.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:36:48.770304+0000 mgr.y (mgr.14505) 752 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:36:50.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:49.062985+0000 mgr.y (mgr.14505) 753 : cluster [DBG] pgmap v925: 168 pgs: 1 creating+peering, 167 active+clean; 5.7 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:36:50.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:49.062985+0000 mgr.y (mgr.14505) 753 : cluster [DBG] pgmap v925: 168 pgs: 1 creating+peering, 167 active+clean; 5.7 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:36:50.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:36:48.770304+0000 mgr.y (mgr.14505) 752 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:36:50.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:49.062985+0000 mgr.y (mgr.14505) 753 : cluster [DBG] pgmap v925: 168 pgs: 1 creating+peering, 167 active+clean; 5.7 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:36:51.327 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:36:51.331 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:51.332 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:36:51.433 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:36:51.465 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:51.486 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:36:51.492 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:51.492 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:36:51.593 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:36:51.622 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:51.635 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.2 dump_historic_ops 2024-02-10T08:36:51.641 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:36:51.643 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:51.644 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:36:51.745 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:36:51.774 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:51.812 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:36:51.820 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:51.821 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:36:51.921 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:36:51.951 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:52.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:51 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:51.063627+0000 mgr.y (mgr.14505) 754 : cluster [DBG] pgmap v926: 168 pgs: 168 active+clean; 5.7 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 738 B/s rd, 0 op/s 2024-02-10T08:36:52.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:51.063627+0000 mgr.y (mgr.14505) 754 : cluster [DBG] pgmap v926: 168 pgs: 168 active+clean; 5.7 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 738 B/s rd, 0 op/s 2024-02-10T08:36:52.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:51.063627+0000 mgr.y (mgr.14505) 754 : cluster [DBG] pgmap v926: 168 pgs: 168 active+clean; 5.7 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 738 B/s rd, 0 op/s 2024-02-10T08:36:52.641 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-10T08:36:52.800 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:36:52.803 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:52.803 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:36:52.904 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:36:52.936 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:52.957 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:36:52.960 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:52.961 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:36:53.061 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:36:53.090 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:53.109 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:36:53.112 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:53.113 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:36:53.213 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:36:53.244 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:53.343 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:36:53.345 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:53.346 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:36:53.447 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:36:53.476 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:53.503 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:36:53.506 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:53.506 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:36:53.607 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:36:53.639 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:53.660 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:36:53.662 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:53.663 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:36:53.764 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:36:53.780 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:36:53.785 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:36:53.797 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:53.824 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:36:53.837 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:53.838 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:36:53.939 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:36:53.966 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:54.089 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:36:54.092 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:54.093 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:36:54.128 INFO:teuthology.orchestra.run.smithi018.stderr:enabled application 'rados' on pool 'unique_pool_4' 2024-02-10T08:36:54.128 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is unset 2024-02-10T08:36:54.194 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:36:54.225 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:54.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:53.064206+0000 mgr.y (mgr.14505) 755 : cluster [DBG] pgmap v927: 168 pgs: 168 active+clean; 5.7 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:36:54.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:36:53.285190+0000 mon.a (mon.0) 1669 : audit [INF] from='client.? 172.21.15.18:0/1228575547' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_4", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-02-10T08:36:54.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:36:53.837254+0000 mon.c (mon.2) 91 : audit [INF] from='client.? 172.21.15.18:0/3204174134' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:36:54.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:36:53.837634+0000 mon.a (mon.0) 1670 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:36:54.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:53.064206+0000 mgr.y (mgr.14505) 755 : cluster [DBG] pgmap v927: 168 pgs: 168 active+clean; 5.7 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:36:54.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:36:53.285190+0000 mon.a (mon.0) 1669 : audit [INF] from='client.? 172.21.15.18:0/1228575547' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_4", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-02-10T08:36:54.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:36:53.837254+0000 mon.c (mon.2) 91 : audit [INF] from='client.? 172.21.15.18:0/3204174134' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:36:54.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:36:53.837634+0000 mon.a (mon.0) 1670 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:36:54.424 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:36:54.427 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:54.428 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:36:54.529 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:36:54.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:54 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:53.064206+0000 mgr.y (mgr.14505) 755 : cluster [DBG] pgmap v927: 168 pgs: 168 active+clean; 5.7 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:36:54.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:54 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:36:53.285190+0000 mon.a (mon.0) 1669 : audit [INF] from='client.? 172.21.15.18:0/1228575547' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_4", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-02-10T08:36:54.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:54 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:36:53.837254+0000 mon.c (mon.2) 91 : audit [INF] from='client.? 172.21.15.18:0/3204174134' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:36:54.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:54 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:36:53.837634+0000 mon.a (mon.0) 1670 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:36:54.557 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:54.630 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:36:54.632 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:54.633 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:36:54.733 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:36:54.761 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:55.110 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:36:55.113 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:55.113 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:36:55.214 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:36:55.247 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:55.268 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:36:55.271 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:55.271 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:36:55.372 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:36:55.399 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:53.826688+0000 osd.5 (osd.5) 251 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:36:55.399 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:53.826745+0000 osd.5 (osd.5) 252 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:36:55.399 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:54.116555+0000 mon.a (mon.0) 1671 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:36:55.399 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:36:54.123917+0000 mon.a (mon.0) 1672 : audit [INF] from='client.? 172.21.15.18:0/1228575547' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_4", "app": "rados", "yes_i_really_mean_it": true}]': finished 2024-02-10T08:36:55.399 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:36:54.123994+0000 mon.a (mon.0) 1673 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-10T08:36:55.399 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:54.124054+0000 mon.a (mon.0) 1674 : cluster [DBG] osdmap e401: 8 total, 8 up, 8 in 2024-02-10T08:36:55.401 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:55.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:53.826688+0000 osd.5 (osd.5) 251 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:36:55.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:53.826745+0000 osd.5 (osd.5) 252 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:36:55.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:54.116555+0000 mon.a (mon.0) 1671 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:36:55.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:36:54.123917+0000 mon.a (mon.0) 1672 : audit [INF] from='client.? 172.21.15.18:0/1228575547' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_4", "app": "rados", "yes_i_really_mean_it": true}]': finished 2024-02-10T08:36:55.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:36:54.123994+0000 mon.a (mon.0) 1673 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-10T08:36:55.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:54.124054+0000 mon.a (mon.0) 1674 : cluster [DBG] osdmap e401: 8 total, 8 up, 8 in 2024-02-10T08:36:55.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:53.826688+0000 osd.5 (osd.5) 251 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:36:55.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:53.826745+0000 osd.5 (osd.5) 252 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:36:55.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:54.116555+0000 mon.a (mon.0) 1671 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:36:55.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:36:54.123917+0000 mon.a (mon.0) 1672 : audit [INF] from='client.? 172.21.15.18:0/1228575547' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_4", "app": "rados", "yes_i_really_mean_it": true}]': finished 2024-02-10T08:36:55.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:36:54.123994+0000 mon.a (mon.0) 1673 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-10T08:36:55.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:54.124054+0000 mon.a (mon.0) 1674 : cluster [DBG] osdmap e401: 8 total, 8 up, 8 in 2024-02-10T08:36:55.421 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:36:55.424 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:55.424 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:36:55.525 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:36:55.552 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:55.571 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:36:55.574 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:55.574 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:36:55.675 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:36:55.710 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:56.261 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:36:56.265 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:56.265 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:36:56.367 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:36:56.393 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:54.915434+0000 osd.4 (osd.4) 170 : cluster [DBG] 6.32 scrub starts 2024-02-10T08:36:56.393 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:54.916544+0000 osd.4 (osd.4) 171 : cluster [DBG] 6.32 scrub ok 2024-02-10T08:36:56.393 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:54.987516+0000 osd.6 (osd.6) 239 : cluster [DBG] 6.22 scrub starts 2024-02-10T08:36:56.393 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:54.988555+0000 osd.6 (osd.6) 240 : cluster [DBG] 6.22 scrub ok 2024-02-10T08:36:56.393 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:55.064773+0000 mgr.y (mgr.14505) 756 : cluster [DBG] pgmap v929: 168 pgs: 168 active+clean; 5.7 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-02-10T08:36:56.393 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:55.488650+0000 osd.2 (osd.2) 225 : cluster [DBG] 2.5 scrub starts 2024-02-10T08:36:56.394 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:55.489627+0000 osd.2 (osd.2) 226 : cluster [DBG] 2.5 scrub ok 2024-02-10T08:36:56.395 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:56.408 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:54.915434+0000 osd.4 (osd.4) 170 : cluster [DBG] 6.32 scrub starts 2024-02-10T08:36:56.408 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:54.916544+0000 osd.4 (osd.4) 171 : cluster [DBG] 6.32 scrub ok 2024-02-10T08:36:56.408 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:54.987516+0000 osd.6 (osd.6) 239 : cluster [DBG] 6.22 scrub starts 2024-02-10T08:36:56.408 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:54.988555+0000 osd.6 (osd.6) 240 : cluster [DBG] 6.22 scrub ok 2024-02-10T08:36:56.408 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:55.064773+0000 mgr.y (mgr.14505) 756 : cluster [DBG] pgmap v929: 168 pgs: 168 active+clean; 5.7 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-02-10T08:36:56.408 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:55.488650+0000 osd.2 (osd.2) 225 : cluster [DBG] 2.5 scrub starts 2024-02-10T08:36:56.408 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:55.489627+0000 osd.2 (osd.2) 226 : cluster [DBG] 2.5 scrub ok 2024-02-10T08:36:56.408 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:54.915434+0000 osd.4 (osd.4) 170 : cluster [DBG] 6.32 scrub starts 2024-02-10T08:36:56.409 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:54.916544+0000 osd.4 (osd.4) 171 : cluster [DBG] 6.32 scrub ok 2024-02-10T08:36:56.409 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:54.987516+0000 osd.6 (osd.6) 239 : cluster [DBG] 6.22 scrub starts 2024-02-10T08:36:56.409 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:54.988555+0000 osd.6 (osd.6) 240 : cluster [DBG] 6.22 scrub ok 2024-02-10T08:36:56.409 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:55.064773+0000 mgr.y (mgr.14505) 756 : cluster [DBG] pgmap v929: 168 pgs: 168 active+clean; 5.7 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-02-10T08:36:56.409 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:55.488650+0000 osd.2 (osd.2) 225 : cluster [DBG] 2.5 scrub starts 2024-02-10T08:36:56.409 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:55.489627+0000 osd.2 (osd.2) 226 : cluster [DBG] 2.5 scrub ok 2024-02-10T08:36:56.413 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:36:56.416 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:56.416 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:36:56.517 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:36:56.552 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:56.608 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:36:56.621 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:56.621 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:36:56.722 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:36:56.749 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:36:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:36:56] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:36:56.751 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:56.770 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:36:56.772 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:56.773 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:36:56.874 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:36:56.875 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-02-10T08:36:56.875 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:36:56.902 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:56.920 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:36:56.923 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:56.924 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:36:57.024 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:36:57.054 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:57.153 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:55.930417+0000 osd.4 (osd.4) 172 : cluster [DBG] 5.e scrub starts 2024-02-10T08:36:57.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:55.934032+0000 osd.4 (osd.4) 173 : cluster [DBG] 5.e scrub ok 2024-02-10T08:36:57.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:56.012304+0000 osd.6 (osd.6) 241 : cluster [DBG] 6.27 scrub starts 2024-02-10T08:36:57.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:56.112885+0000 osd.6 (osd.6) 242 : cluster [DBG] 6.27 scrub ok 2024-02-10T08:36:57.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:56.516382+0000 osd.7 (osd.7) 251 : cluster [DBG] 2.b scrub starts 2024-02-10T08:36:57.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:56.517274+0000 osd.7 (osd.7) 252 : cluster [DBG] 2.b scrub ok 2024-02-10T08:36:57.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:55.930417+0000 osd.4 (osd.4) 172 : cluster [DBG] 5.e scrub starts 2024-02-10T08:36:57.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:55.934032+0000 osd.4 (osd.4) 173 : cluster [DBG] 5.e scrub ok 2024-02-10T08:36:57.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:56.012304+0000 osd.6 (osd.6) 241 : cluster [DBG] 6.27 scrub starts 2024-02-10T08:36:57.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:56.112885+0000 osd.6 (osd.6) 242 : cluster [DBG] 6.27 scrub ok 2024-02-10T08:36:57.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:56.516382+0000 osd.7 (osd.7) 251 : cluster [DBG] 2.b scrub starts 2024-02-10T08:36:57.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:56.517274+0000 osd.7 (osd.7) 252 : cluster [DBG] 2.b scrub ok 2024-02-10T08:36:57.267 DEBUG:teuthology.orchestra.run.smithi018:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 65536 --object-size 65536 -p unique_pool_4 bench 90 write' 2024-02-10T08:36:57.268 INFO:tasks.thrashosds.thrasher:Shrinking pool unique_pool_4 2024-02-10T08:36:57.268 INFO:tasks.cephadm.ceph_manager.ceph:contract_pool unique_pool_4 by 10 min 8 2024-02-10T08:36:57.269 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph pg dump --format=json 2024-02-10T08:36:57.271 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2024-02-10T08:36:57.271 INFO:teuthology.orchestra.run:waiting for 3000 2024-02-10T08:36:57.404 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:36:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:36:57] "GET /metrics HTTP/1.1" 200 176479 "" "Prometheus/2.33.4" 2024-02-10T08:36:57.503 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:hints = 1 2024-02-10T08:36:57.503 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Maintaining 16 concurrent writes of 65536 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2024-02-10T08:36:57.503 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Object prefix: benchmark_data_smithi018_166993 2024-02-10T08:36:57.503 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-02-10T08:36:57.504 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 0 0 0 0 0 0 - 0 2024-02-10T08:36:57.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:55.930417+0000 osd.4 (osd.4) 172 : cluster [DBG] 5.e scrub starts 2024-02-10T08:36:57.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:55.934032+0000 osd.4 (osd.4) 173 : cluster [DBG] 5.e scrub ok 2024-02-10T08:36:57.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:56.012304+0000 osd.6 (osd.6) 241 : cluster [DBG] 6.27 scrub starts 2024-02-10T08:36:57.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:56.112885+0000 osd.6 (osd.6) 242 : cluster [DBG] 6.27 scrub ok 2024-02-10T08:36:57.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:56.516382+0000 osd.7 (osd.7) 251 : cluster [DBG] 2.b scrub starts 2024-02-10T08:36:57.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:56.517274+0000 osd.7 (osd.7) 252 : cluster [DBG] 2.b scrub ok 2024-02-10T08:36:58.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:56.855112+0000 osd.1 (osd.1) 266 : cluster [DBG] 4.2 scrub starts 2024-02-10T08:36:58.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:56.858634+0000 osd.1 (osd.1) 267 : cluster [DBG] 4.2 scrub ok 2024-02-10T08:36:58.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:57.006214+0000 osd.6 (osd.6) 243 : cluster [DBG] 2.11 scrub starts 2024-02-10T08:36:58.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:57.006960+0000 osd.6 (osd.6) 244 : cluster [DBG] 2.11 scrub ok 2024-02-10T08:36:58.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:57.065122+0000 mgr.y (mgr.14505) 757 : cluster [DBG] pgmap v930: 168 pgs: 168 active+clean; 5.7 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-10T08:36:58.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:57.564059+0000 osd.7 (osd.7) 253 : cluster [DBG] 2.1b scrub starts 2024-02-10T08:36:58.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:57.566054+0000 osd.7 (osd.7) 254 : cluster [DBG] 2.1b scrub ok 2024-02-10T08:36:58.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:56.855112+0000 osd.1 (osd.1) 266 : cluster [DBG] 4.2 scrub starts 2024-02-10T08:36:58.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:56.858634+0000 osd.1 (osd.1) 267 : cluster [DBG] 4.2 scrub ok 2024-02-10T08:36:58.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:57.006214+0000 osd.6 (osd.6) 243 : cluster [DBG] 2.11 scrub starts 2024-02-10T08:36:58.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:57.006960+0000 osd.6 (osd.6) 244 : cluster [DBG] 2.11 scrub ok 2024-02-10T08:36:58.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:57.065122+0000 mgr.y (mgr.14505) 757 : cluster [DBG] pgmap v930: 168 pgs: 168 active+clean; 5.7 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-10T08:36:58.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:57.564059+0000 osd.7 (osd.7) 253 : cluster [DBG] 2.1b scrub starts 2024-02-10T08:36:58.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:57.566054+0000 osd.7 (osd.7) 254 : cluster [DBG] 2.1b scrub ok 2024-02-10T08:36:58.504 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 1 16 3421 3405 212.801 212.812 0.0045388 0.00467557 2024-02-10T08:36:58.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:56.855112+0000 osd.1 (osd.1) 266 : cluster [DBG] 4.2 scrub starts 2024-02-10T08:36:58.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:56.858634+0000 osd.1 (osd.1) 267 : cluster [DBG] 4.2 scrub ok 2024-02-10T08:36:58.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:57.006214+0000 osd.6 (osd.6) 243 : cluster [DBG] 2.11 scrub starts 2024-02-10T08:36:58.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:57.006960+0000 osd.6 (osd.6) 244 : cluster [DBG] 2.11 scrub ok 2024-02-10T08:36:58.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:57.065122+0000 mgr.y (mgr.14505) 757 : cluster [DBG] pgmap v930: 168 pgs: 168 active+clean; 5.7 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-10T08:36:58.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:57.564059+0000 osd.7 (osd.7) 253 : cluster [DBG] 2.1b scrub starts 2024-02-10T08:36:58.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:57.566054+0000 osd.7 (osd.7) 254 : cluster [DBG] 2.1b scrub ok 2024-02-10T08:36:58.913 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:36:58.937 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:58.938 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:36:58.946 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.3 dump_ops_in_flight 2024-02-10T08:36:59.039 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:36:59.040 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:36:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:36:59.080 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:59.109 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:36:59.112 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:59.112 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:36:59.213 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:36:59.264 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:59.294 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:36:59.299 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:59.300 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:36:59.401 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:36:59.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:57.850498+0000 osd.1 (osd.1) 268 : cluster [DBG] 5.17 scrub starts 2024-02-10T08:36:59.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:57.854162+0000 osd.1 (osd.1) 269 : cluster [DBG] 5.17 scrub ok 2024-02-10T08:36:59.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:58.002939+0000 osd.6 (osd.6) 245 : cluster [DBG] 6.c scrub starts 2024-02-10T08:36:59.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:58.006458+0000 osd.6 (osd.6) 246 : cluster [DBG] 6.c scrub ok 2024-02-10T08:36:59.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:58.068851+0000 osd.5 (osd.5) 253 : cluster [DBG] 4.15 scrub starts 2024-02-10T08:36:59.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:58.072857+0000 osd.5 (osd.5) 254 : cluster [DBG] 4.15 scrub ok 2024-02-10T08:36:59.408 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:58.450577+0000 osd.2 (osd.2) 227 : cluster [DBG] 2.1 scrub starts 2024-02-10T08:36:59.408 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:36:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:58.452130+0000 osd.2 (osd.2) 228 : cluster [DBG] 2.1 scrub ok 2024-02-10T08:36:59.408 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:57.850498+0000 osd.1 (osd.1) 268 : cluster [DBG] 5.17 scrub starts 2024-02-10T08:36:59.408 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:57.854162+0000 osd.1 (osd.1) 269 : cluster [DBG] 5.17 scrub ok 2024-02-10T08:36:59.408 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:58.002939+0000 osd.6 (osd.6) 245 : cluster [DBG] 6.c scrub starts 2024-02-10T08:36:59.409 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:58.006458+0000 osd.6 (osd.6) 246 : cluster [DBG] 6.c scrub ok 2024-02-10T08:36:59.409 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:58.068851+0000 osd.5 (osd.5) 253 : cluster [DBG] 4.15 scrub starts 2024-02-10T08:36:59.409 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:58.072857+0000 osd.5 (osd.5) 254 : cluster [DBG] 4.15 scrub ok 2024-02-10T08:36:59.409 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:58.450577+0000 osd.2 (osd.2) 227 : cluster [DBG] 2.1 scrub starts 2024-02-10T08:36:59.409 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:36:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:58.452130+0000 osd.2 (osd.2) 228 : cluster [DBG] 2.1 scrub ok 2024-02-10T08:36:59.451 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:59.504 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 2 16 6476 6460 201.804 190.938 0.00407873 0.00494636 2024-02-10T08:36:59.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:59 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:57.850498+0000 osd.1 (osd.1) 268 : cluster [DBG] 5.17 scrub starts 2024-02-10T08:36:59.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:59 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:57.854162+0000 osd.1 (osd.1) 269 : cluster [DBG] 5.17 scrub ok 2024-02-10T08:36:59.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:59 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:58.002939+0000 osd.6 (osd.6) 245 : cluster [DBG] 6.c scrub starts 2024-02-10T08:36:59.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:59 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:58.006458+0000 osd.6 (osd.6) 246 : cluster [DBG] 6.c scrub ok 2024-02-10T08:36:59.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:59 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:58.068851+0000 osd.5 (osd.5) 253 : cluster [DBG] 4.15 scrub starts 2024-02-10T08:36:59.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:59 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:58.072857+0000 osd.5 (osd.5) 254 : cluster [DBG] 4.15 scrub ok 2024-02-10T08:36:59.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:59 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:58.450577+0000 osd.2 (osd.2) 227 : cluster [DBG] 2.1 scrub starts 2024-02-10T08:36:59.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:36:59 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:58.452130+0000 osd.2 (osd.2) 228 : cluster [DBG] 2.1 scrub ok 2024-02-10T08:36:59.560 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:36:59.564 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:36:59.569 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:59.570 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:36:59.671 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:36:59.710 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:59.750 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:36:59.761 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:59.762 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:36:59.794 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd unset nodeep-scrub 2024-02-10T08:36:59.863 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:36:59.896 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:36:59.921 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:36:59.924 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:36:59.924 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:37:00.025 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:37:00.095 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:00.157 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:00.157 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:37:00.158 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:37:00.258 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:37:00.303 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:00.328 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:37:00.332 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:00.332 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:37:00.433 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:37:00.483 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:36:58.780519+0000 mgr.y (mgr.14505) 758 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:37:00.483 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:59.065890+0000 mgr.y (mgr.14505) 759 : cluster [DBG] pgmap v931: 168 pgs: 168 active+clean; 96 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 1023 B/s rd, 9.6 MiB/s wr, 154 op/s 2024-02-10T08:37:00.483 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:59.071866+0000 osd.5 (osd.5) 255 : cluster [DBG] 2.3 scrub starts 2024-02-10T08:37:00.483 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:36:59.075126+0000 osd.5 (osd.5) 256 : cluster [DBG] 2.3 scrub ok 2024-02-10T08:37:00.483 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:36:58.780519+0000 mgr.y (mgr.14505) 758 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:37:00.484 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:59.065890+0000 mgr.y (mgr.14505) 759 : cluster [DBG] pgmap v931: 168 pgs: 168 active+clean; 96 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 1023 B/s rd, 9.6 MiB/s wr, 154 op/s 2024-02-10T08:37:00.484 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:59.071866+0000 osd.5 (osd.5) 255 : cluster [DBG] 2.3 scrub starts 2024-02-10T08:37:00.484 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:36:59.075126+0000 osd.5 (osd.5) 256 : cluster [DBG] 2.3 scrub ok 2024-02-10T08:37:00.488 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:00.505 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 3 15 8837 8822 183.682 147.625 0.00957958 0.00543407 2024-02-10T08:37:00.532 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:37:00.535 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:00.535 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:37:00.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:36:58.780519+0000 mgr.y (mgr.14505) 758 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:37:00.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:59.065890+0000 mgr.y (mgr.14505) 759 : cluster [DBG] pgmap v931: 168 pgs: 168 active+clean; 96 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 1023 B/s rd, 9.6 MiB/s wr, 154 op/s 2024-02-10T08:37:00.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:59.071866+0000 osd.5 (osd.5) 255 : cluster [DBG] 2.3 scrub starts 2024-02-10T08:37:00.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:36:59.075126+0000 osd.5 (osd.5) 256 : cluster [DBG] 2.3 scrub ok 2024-02-10T08:37:00.565 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:37:00.598 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:37:00.635 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:37:00.636 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:37:00.665 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:37:00.690 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:00.701 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:37:00.739 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:37:00.764 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:37:00.793 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:37:00.800 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-10T08:37:00.800 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-10T08:37:00.800 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-10T08:37:00.800 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-10T08:37:00.800 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-10T08:37:00.801 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-10T08:37:00.801 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-10T08:37:00.801 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-10T08:37:01.505 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 4 16 11314 11298 176.448 154.75 0.00361633 0.00565903 2024-02-10T08:37:01.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:00.184074+0000 osd.7 (osd.7) 255 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:37:01.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:00.184112+0000 osd.7 (osd.7) 256 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:37:01.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:37:00.539733+0000 mon.a (mon.0) 1675 : audit [DBG] from='client.? 172.21.15.18:0/2742086492' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:37:01.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:00.184074+0000 osd.7 (osd.7) 255 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:37:01.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:00.184112+0000 osd.7 (osd.7) 256 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:37:01.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:37:00.539733+0000 mon.a (mon.0) 1675 : audit [DBG] from='client.? 172.21.15.18:0/2742086492' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:37:01.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:00.184074+0000 osd.7 (osd.7) 255 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:37:01.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:00.184112+0000 osd.7 (osd.7) 256 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:37:01.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:37:00.539733+0000 mon.a (mon.0) 1675 : audit [DBG] from='client.? 172.21.15.18:0/2742086492' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:37:01.758 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:37:01.763 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:01.763 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:37:01.864 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:37:01.913 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:02.355 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:37:02.505 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 5 16 13716 13700 171.183 150.125 0.00469433 0.00582812 2024-02-10T08:37:02.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:00.939245+0000 osd.4 (osd.4) 174 : cluster [DBG] 4.18 scrub starts 2024-02-10T08:37:02.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:00.943027+0000 osd.4 (osd.4) 175 : cluster [DBG] 4.18 scrub ok 2024-02-10T08:37:02.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:01.067352+0000 mgr.y (mgr.14505) 760 : cluster [DBG] pgmap v932: 168 pgs: 168 active+clean; 125 MiB data, 5.0 GiB used, 710 GiB / 715 GiB avail; 1023 B/s rd, 12 MiB/s wr, 200 op/s 2024-02-10T08:37:02.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:01.085756+0000 osd.0 (osd.0) 232 : cluster [DBG] 6.23 scrub starts 2024-02-10T08:37:02.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:01.145501+0000 osd.0 (osd.0) 233 : cluster [DBG] 6.23 scrub ok 2024-02-10T08:37:02.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:01.177900+0000 mon.a (mon.0) 1676 : cluster [DBG] osdmap e402: 8 total, 8 up, 8 in 2024-02-10T08:37:02.622 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:00.939245+0000 osd.4 (osd.4) 174 : cluster [DBG] 4.18 scrub starts 2024-02-10T08:37:02.622 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:00.943027+0000 osd.4 (osd.4) 175 : cluster [DBG] 4.18 scrub ok 2024-02-10T08:37:02.622 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:01.067352+0000 mgr.y (mgr.14505) 760 : cluster [DBG] pgmap v932: 168 pgs: 168 active+clean; 125 MiB data, 5.0 GiB used, 710 GiB / 715 GiB avail; 1023 B/s rd, 12 MiB/s wr, 200 op/s 2024-02-10T08:37:02.622 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:01.085756+0000 osd.0 (osd.0) 232 : cluster [DBG] 6.23 scrub starts 2024-02-10T08:37:02.622 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:01.145501+0000 osd.0 (osd.0) 233 : cluster [DBG] 6.23 scrub ok 2024-02-10T08:37:02.622 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:01.177900+0000 mon.a (mon.0) 1676 : cluster [DBG] osdmap e402: 8 total, 8 up, 8 in 2024-02-10T08:37:02.622 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:00.939245+0000 osd.4 (osd.4) 174 : cluster [DBG] 4.18 scrub starts 2024-02-10T08:37:02.622 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:00.943027+0000 osd.4 (osd.4) 175 : cluster [DBG] 4.18 scrub ok 2024-02-10T08:37:02.623 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:01.067352+0000 mgr.y (mgr.14505) 760 : cluster [DBG] pgmap v932: 168 pgs: 168 active+clean; 125 MiB data, 5.0 GiB used, 710 GiB / 715 GiB avail; 1023 B/s rd, 12 MiB/s wr, 200 op/s 2024-02-10T08:37:02.623 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:01.085756+0000 osd.0 (osd.0) 232 : cluster [DBG] 6.23 scrub starts 2024-02-10T08:37:02.623 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:01.145501+0000 osd.0 (osd.0) 233 : cluster [DBG] 6.23 scrub ok 2024-02-10T08:37:02.623 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:01.177900+0000 mon.a (mon.0) 1676 : cluster [DBG] osdmap e402: 8 total, 8 up, 8 in 2024-02-10T08:37:02.975 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:37:02.981 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:02.982 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:37:03.083 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:37:03.142 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:03.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:01.962046+0000 osd.6 (osd.6) 247 : cluster [DBG] 6.1f scrub starts 2024-02-10T08:37:03.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:02.097514+0000 osd.6 (osd.6) 248 : cluster [DBG] 6.1f scrub ok 2024-02-10T08:37:03.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:02.344403+0000 osd.2 (osd.2) 229 : cluster [DBG] 5.b scrub starts 2024-02-10T08:37:03.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:02.347272+0000 osd.2 (osd.2) 230 : cluster [DBG] 5.b scrub ok 2024-02-10T08:37:03.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:01.962046+0000 osd.6 (osd.6) 247 : cluster [DBG] 6.1f scrub starts 2024-02-10T08:37:03.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:02.097514+0000 osd.6 (osd.6) 248 : cluster [DBG] 6.1f scrub ok 2024-02-10T08:37:03.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:02.344403+0000 osd.2 (osd.2) 229 : cluster [DBG] 5.b scrub starts 2024-02-10T08:37:03.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:02.347272+0000 osd.2 (osd.2) 230 : cluster [DBG] 5.b scrub ok 2024-02-10T08:37:03.506 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 6 16 15988 15972 166.305 142 0.0104938 0.00600676 2024-02-10T08:37:03.538 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:37:03.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:01.962046+0000 osd.6 (osd.6) 247 : cluster [DBG] 6.1f scrub starts 2024-02-10T08:37:03.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:02.097514+0000 osd.6 (osd.6) 248 : cluster [DBG] 6.1f scrub ok 2024-02-10T08:37:03.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:02.344403+0000 osd.2 (osd.2) 229 : cluster [DBG] 5.b scrub starts 2024-02-10T08:37:03.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:02.347272+0000 osd.2 (osd.2) 230 : cluster [DBG] 5.b scrub ok 2024-02-10T08:37:03.543 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:03.544 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:37:03.645 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:37:03.703 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:03.901 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:37:03.911 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-02-10T08:37:04.197 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:02.898619+0000 osd.1 (osd.1) 270 : cluster [DBG] 6.1d scrub starts 2024-02-10T08:37:04.197 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:02.966802+0000 osd.1 (osd.1) 271 : cluster [DBG] 6.1d scrub ok 2024-02-10T08:37:04.197 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:03.018713+0000 osd.0 (osd.0) 234 : cluster [DBG] 6.16 scrub starts 2024-02-10T08:37:04.197 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:03.029399+0000 osd.0 (osd.0) 235 : cluster [DBG] 6.16 scrub ok 2024-02-10T08:37:04.197 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:03.069141+0000 mgr.y (mgr.14505) 761 : cluster [DBG] pgmap v934: 168 pgs: 1 active+clean+scrubbing, 167 active+clean; 696 MiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 22 KiB/s rd, 78 MiB/s wr, 1.28k op/s 2024-02-10T08:37:04.327 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-10T08:37:04.475 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:37:04.478 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:02.898619+0000 osd.1 (osd.1) 270 : cluster [DBG] 6.1d scrub starts 2024-02-10T08:37:04.478 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:02.966802+0000 osd.1 (osd.1) 271 : cluster [DBG] 6.1d scrub ok 2024-02-10T08:37:04.478 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:03.018713+0000 osd.0 (osd.0) 234 : cluster [DBG] 6.16 scrub starts 2024-02-10T08:37:04.478 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:03.029399+0000 osd.0 (osd.0) 235 : cluster [DBG] 6.16 scrub ok 2024-02-10T08:37:04.478 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:03.069141+0000 mgr.y (mgr.14505) 761 : cluster [DBG] pgmap v934: 168 pgs: 1 active+clean+scrubbing, 167 active+clean; 696 MiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 22 KiB/s rd, 78 MiB/s wr, 1.28k op/s 2024-02-10T08:37:04.486 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:04.487 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:37:04.506 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 7 15 18139 18124 161.758 134.5 0.00951862 0.00617429 2024-02-10T08:37:04.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:02.898619+0000 osd.1 (osd.1) 270 : cluster [DBG] 6.1d scrub starts 2024-02-10T08:37:04.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:02.966802+0000 osd.1 (osd.1) 271 : cluster [DBG] 6.1d scrub ok 2024-02-10T08:37:04.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:03.018713+0000 osd.0 (osd.0) 234 : cluster [DBG] 6.16 scrub starts 2024-02-10T08:37:04.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:03.029399+0000 osd.0 (osd.0) 235 : cluster [DBG] 6.16 scrub ok 2024-02-10T08:37:04.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:03.069141+0000 mgr.y (mgr.14505) 761 : cluster [DBG] pgmap v934: 168 pgs: 1 active+clean+scrubbing, 167 active+clean; 696 MiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 22 KiB/s rd, 78 MiB/s wr, 1.28k op/s 2024-02-10T08:37:04.589 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:37:04.661 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:05.506 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 8 16 20409 20393 159.263 141.812 0.007297 0.00627354 2024-02-10T08:37:05.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:37:03.877364+0000 mgr.y (mgr.14505) 762 : audit [DBG] from='client.15693 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-10T08:37:05.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:03.932803+0000 osd.4 (osd.4) 176 : cluster [DBG] 4.1 scrub starts 2024-02-10T08:37:05.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:03.934966+0000 osd.4 (osd.4) 177 : cluster [DBG] 4.1 scrub ok 2024-02-10T08:37:05.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:04.311733+0000 osd.2 (osd.2) 231 : cluster [DBG] 5.d scrub starts 2024-02-10T08:37:05.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:04.315481+0000 osd.2 (osd.2) 232 : cluster [DBG] 5.d scrub ok 2024-02-10T08:37:05.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:04.573763+0000 osd.7 (osd.7) 257 : cluster [DBG] 1.0 scrub starts 2024-02-10T08:37:05.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:04.577161+0000 osd.7 (osd.7) 258 : cluster [DBG] 1.0 scrub ok 2024-02-10T08:37:05.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:37:03.877364+0000 mgr.y (mgr.14505) 762 : audit [DBG] from='client.15693 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-10T08:37:05.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:03.932803+0000 osd.4 (osd.4) 176 : cluster [DBG] 4.1 scrub starts 2024-02-10T08:37:05.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:03.934966+0000 osd.4 (osd.4) 177 : cluster [DBG] 4.1 scrub ok 2024-02-10T08:37:05.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:04.311733+0000 osd.2 (osd.2) 231 : cluster [DBG] 5.d scrub starts 2024-02-10T08:37:05.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:04.315481+0000 osd.2 (osd.2) 232 : cluster [DBG] 5.d scrub ok 2024-02-10T08:37:05.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:04.573763+0000 osd.7 (osd.7) 257 : cluster [DBG] 1.0 scrub starts 2024-02-10T08:37:05.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:04.577161+0000 osd.7 (osd.7) 258 : cluster [DBG] 1.0 scrub ok 2024-02-10T08:37:05.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:37:03.877364+0000 mgr.y (mgr.14505) 762 : audit [DBG] from='client.15693 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-10T08:37:05.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:03.932803+0000 osd.4 (osd.4) 176 : cluster [DBG] 4.1 scrub starts 2024-02-10T08:37:05.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:03.934966+0000 osd.4 (osd.4) 177 : cluster [DBG] 4.1 scrub ok 2024-02-10T08:37:05.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:04.311733+0000 osd.2 (osd.2) 231 : cluster [DBG] 5.d scrub starts 2024-02-10T08:37:05.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:04.315481+0000 osd.2 (osd.2) 232 : cluster [DBG] 5.d scrub ok 2024-02-10T08:37:05.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:04.573763+0000 osd.7 (osd.7) 257 : cluster [DBG] 1.0 scrub starts 2024-02-10T08:37:05.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:04.577161+0000 osd.7 (osd.7) 258 : cluster [DBG] 1.0 scrub ok 2024-02-10T08:37:06.506 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 9 16 22473 22457 155.9 129 0.00796983 0.0064088 2024-02-10T08:37:06.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:04.897376+0000 osd.4 (osd.4) 178 : cluster [DBG] 2.f scrub starts 2024-02-10T08:37:06.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:04.901787+0000 osd.4 (osd.4) 179 : cluster [DBG] 2.f scrub ok 2024-02-10T08:37:06.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:04.946046+0000 osd.6 (osd.6) 249 : cluster [DBG] 5.11 scrub starts 2024-02-10T08:37:06.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:04.950110+0000 osd.6 (osd.6) 250 : cluster [DBG] 5.11 scrub ok 2024-02-10T08:37:06.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:05.022682+0000 osd.0 (osd.0) 236 : cluster [DBG] 6.10 scrub starts 2024-02-10T08:37:06.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:05.034408+0000 osd.0 (osd.0) 237 : cluster [DBG] 6.10 scrub ok 2024-02-10T08:37:06.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:05.075132+0000 mgr.y (mgr.14505) 763 : cluster [DBG] pgmap v935: 168 pgs: 1 active+clean+scrubbing, 167 active+clean; 940 MiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 44 KiB/s rd, 94 MiB/s wr, 1.57k op/s 2024-02-10T08:37:06.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:05.619062+0000 osd.7 (osd.7) 259 : cluster [DBG] 6.29 scrub starts 2024-02-10T08:37:06.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:05.646703+0000 osd.7 (osd.7) 260 : cluster [DBG] 6.29 scrub ok 2024-02-10T08:37:06.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:05.880615+0000 osd.4 (osd.4) 180 : cluster [DBG] 5.1 scrub starts 2024-02-10T08:37:06.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:05.882020+0000 osd.4 (osd.4) 181 : cluster [DBG] 5.1 scrub ok 2024-02-10T08:37:06.519 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:37:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:37:06] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:37:06.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:04.897376+0000 osd.4 (osd.4) 178 : cluster [DBG] 2.f scrub starts 2024-02-10T08:37:06.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:04.901787+0000 osd.4 (osd.4) 179 : cluster [DBG] 2.f scrub ok 2024-02-10T08:37:06.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:04.946046+0000 osd.6 (osd.6) 249 : cluster [DBG] 5.11 scrub starts 2024-02-10T08:37:06.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:04.950110+0000 osd.6 (osd.6) 250 : cluster [DBG] 5.11 scrub ok 2024-02-10T08:37:06.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:05.022682+0000 osd.0 (osd.0) 236 : cluster [DBG] 6.10 scrub starts 2024-02-10T08:37:06.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:05.034408+0000 osd.0 (osd.0) 237 : cluster [DBG] 6.10 scrub ok 2024-02-10T08:37:06.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:05.075132+0000 mgr.y (mgr.14505) 763 : cluster [DBG] pgmap v935: 168 pgs: 1 active+clean+scrubbing, 167 active+clean; 940 MiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 44 KiB/s rd, 94 MiB/s wr, 1.57k op/s 2024-02-10T08:37:06.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:05.619062+0000 osd.7 (osd.7) 259 : cluster [DBG] 6.29 scrub starts 2024-02-10T08:37:06.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:05.646703+0000 osd.7 (osd.7) 260 : cluster [DBG] 6.29 scrub ok 2024-02-10T08:37:06.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:05.880615+0000 osd.4 (osd.4) 180 : cluster [DBG] 5.1 scrub starts 2024-02-10T08:37:06.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:05.882020+0000 osd.4 (osd.4) 181 : cluster [DBG] 5.1 scrub ok 2024-02-10T08:37:06.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:04.897376+0000 osd.4 (osd.4) 178 : cluster [DBG] 2.f scrub starts 2024-02-10T08:37:06.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:04.901787+0000 osd.4 (osd.4) 179 : cluster [DBG] 2.f scrub ok 2024-02-10T08:37:06.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:04.946046+0000 osd.6 (osd.6) 249 : cluster [DBG] 5.11 scrub starts 2024-02-10T08:37:06.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:04.950110+0000 osd.6 (osd.6) 250 : cluster [DBG] 5.11 scrub ok 2024-02-10T08:37:06.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:05.022682+0000 osd.0 (osd.0) 236 : cluster [DBG] 6.10 scrub starts 2024-02-10T08:37:06.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:05.034408+0000 osd.0 (osd.0) 237 : cluster [DBG] 6.10 scrub ok 2024-02-10T08:37:06.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:05.075132+0000 mgr.y (mgr.14505) 763 : cluster [DBG] pgmap v935: 168 pgs: 1 active+clean+scrubbing, 167 active+clean; 940 MiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 44 KiB/s rd, 94 MiB/s wr, 1.57k op/s 2024-02-10T08:37:06.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:05.619062+0000 osd.7 (osd.7) 259 : cluster [DBG] 6.29 scrub starts 2024-02-10T08:37:06.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:05.646703+0000 osd.7 (osd.7) 260 : cluster [DBG] 6.29 scrub ok 2024-02-10T08:37:06.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:05.880615+0000 osd.4 (osd.4) 180 : cluster [DBG] 5.1 scrub starts 2024-02-10T08:37:06.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:05.882020+0000 osd.4 (osd.4) 181 : cluster [DBG] 5.1 scrub ok 2024-02-10T08:37:07.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:06.896303+0000 osd.4 (osd.4) 182 : cluster [DBG] 4.1a scrub starts 2024-02-10T08:37:07.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:06.900693+0000 osd.4 (osd.4) 183 : cluster [DBG] 4.1a scrub ok 2024-02-10T08:37:07.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:06.937800+0000 osd.1 (osd.1) 272 : cluster [DBG] 5.1d scrub starts 2024-02-10T08:37:07.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:06.943637+0000 osd.1 (osd.1) 273 : cluster [DBG] 5.1d scrub ok 2024-02-10T08:37:07.407 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:37:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:37:07] "GET /metrics HTTP/1.1" 200 176536 "" "Prometheus/2.33.4" 2024-02-10T08:37:07.407 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:06.896303+0000 osd.4 (osd.4) 182 : cluster [DBG] 4.1a scrub starts 2024-02-10T08:37:07.408 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:06.900693+0000 osd.4 (osd.4) 183 : cluster [DBG] 4.1a scrub ok 2024-02-10T08:37:07.408 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:06.937800+0000 osd.1 (osd.1) 272 : cluster [DBG] 5.1d scrub starts 2024-02-10T08:37:07.408 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:06.943637+0000 osd.1 (osd.1) 273 : cluster [DBG] 5.1d scrub ok 2024-02-10T08:37:07.506 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 10 16 24602 24586 153.616 133.062 0.0016926 0.00649847 2024-02-10T08:37:07.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:06.896303+0000 osd.4 (osd.4) 182 : cluster [DBG] 4.1a scrub starts 2024-02-10T08:37:07.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:06.900693+0000 osd.4 (osd.4) 183 : cluster [DBG] 4.1a scrub ok 2024-02-10T08:37:07.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:06.937800+0000 osd.1 (osd.1) 272 : cluster [DBG] 5.1d scrub starts 2024-02-10T08:37:07.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:06.943637+0000 osd.1 (osd.1) 273 : cluster [DBG] 5.1d scrub ok 2024-02-10T08:37:08.507 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 11 16 26651 26635 151.292 128.062 0.00643592 0.00660515 2024-02-10T08:37:08.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:07.076455+0000 mgr.y (mgr.14505) 764 : cluster [DBG] pgmap v936: 168 pgs: 1 active+clean+scrubbing, 167 active+clean; 940 MiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 44 KiB/s rd, 94 MiB/s wr, 1.57k op/s 2024-02-10T08:37:08.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:07.395304+0000 osd.2 (osd.2) 233 : cluster [DBG] 6.2d scrub starts 2024-02-10T08:37:08.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:07.530121+0000 osd.2 (osd.2) 234 : cluster [DBG] 6.2d scrub ok 2024-02-10T08:37:08.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:07.608188+0000 osd.7 (osd.7) 261 : cluster [DBG] 6.8 scrub starts 2024-02-10T08:37:08.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:07.611377+0000 osd.7 (osd.7) 262 : cluster [DBG] 6.8 scrub ok 2024-02-10T08:37:08.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:07.076455+0000 mgr.y (mgr.14505) 764 : cluster [DBG] pgmap v936: 168 pgs: 1 active+clean+scrubbing, 167 active+clean; 940 MiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 44 KiB/s rd, 94 MiB/s wr, 1.57k op/s 2024-02-10T08:37:08.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:07.395304+0000 osd.2 (osd.2) 233 : cluster [DBG] 6.2d scrub starts 2024-02-10T08:37:08.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:07.530121+0000 osd.2 (osd.2) 234 : cluster [DBG] 6.2d scrub ok 2024-02-10T08:37:08.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:07.608188+0000 osd.7 (osd.7) 261 : cluster [DBG] 6.8 scrub starts 2024-02-10T08:37:08.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:07.611377+0000 osd.7 (osd.7) 262 : cluster [DBG] 6.8 scrub ok 2024-02-10T08:37:08.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:07.076455+0000 mgr.y (mgr.14505) 764 : cluster [DBG] pgmap v936: 168 pgs: 1 active+clean+scrubbing, 167 active+clean; 940 MiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 44 KiB/s rd, 94 MiB/s wr, 1.57k op/s 2024-02-10T08:37:08.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:07.395304+0000 osd.2 (osd.2) 233 : cluster [DBG] 6.2d scrub starts 2024-02-10T08:37:08.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:07.530121+0000 osd.2 (osd.2) 234 : cluster [DBG] 6.2d scrub ok 2024-02-10T08:37:08.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:07.608188+0000 osd.7 (osd.7) 261 : cluster [DBG] 6.8 scrub starts 2024-02-10T08:37:08.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:07.611377+0000 osd.7 (osd.7) 262 : cluster [DBG] 6.8 scrub ok 2024-02-10T08:37:09.243 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:08.032096+0000 osd.0 (osd.0) 238 : cluster [DBG] 3.1 scrub starts 2024-02-10T08:37:09.243 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:08.038196+0000 osd.0 (osd.0) 239 : cluster [DBG] 3.1 scrub ok 2024-02-10T08:37:09.243 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:37:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:37:09.507 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 12 16 28701 28685 149.361 128.125 0.00554027 0.00669046 2024-02-10T08:37:09.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:08.904965+0000 osd.4 (osd.4) 184 : cluster [DBG] 6.1a scrub starts 2024-02-10T08:37:09.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:08.945281+0000 osd.4 (osd.4) 185 : cluster [DBG] 6.1a scrub ok 2024-02-10T08:37:09.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:08.032096+0000 osd.0 (osd.0) 238 : cluster [DBG] 3.1 scrub starts 2024-02-10T08:37:09.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:08.038196+0000 osd.0 (osd.0) 239 : cluster [DBG] 3.1 scrub ok 2024-02-10T08:37:09.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:08.904965+0000 osd.4 (osd.4) 184 : cluster [DBG] 6.1a scrub starts 2024-02-10T08:37:09.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:08.945281+0000 osd.4 (osd.4) 185 : cluster [DBG] 6.1a scrub ok 2024-02-10T08:37:09.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:08.032096+0000 osd.0 (osd.0) 238 : cluster [DBG] 3.1 scrub starts 2024-02-10T08:37:09.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:08.038196+0000 osd.0 (osd.0) 239 : cluster [DBG] 3.1 scrub ok 2024-02-10T08:37:09.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:08.904965+0000 osd.4 (osd.4) 184 : cluster [DBG] 6.1a scrub starts 2024-02-10T08:37:09.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:08.945281+0000 osd.4 (osd.4) 185 : cluster [DBG] 6.1a scrub ok 2024-02-10T08:37:09.806 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:37:09.848 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:09.849 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:37:09.949 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:37:10.046 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:10.503 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:37:10.507 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 13 16 30433 30417 146.198 108.25 0.00533387 0.00683345 2024-02-10T08:37:10.508 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:10.509 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:37:10.509 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:37:08.790839+0000 mgr.y (mgr.14505) 765 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:37:10.509 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:08.999282+0000 osd.0 (osd.0) 240 : cluster [DBG] 4.6 scrub starts 2024-02-10T08:37:10.509 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:09.007647+0000 osd.0 (osd.0) 241 : cluster [DBG] 4.6 scrub ok 2024-02-10T08:37:10.509 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:09.024872+0000 osd.5 (osd.5) 257 : cluster [DBG] 2.2 scrub starts 2024-02-10T08:37:10.509 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:09.029760+0000 osd.5 (osd.5) 258 : cluster [DBG] 2.2 scrub ok 2024-02-10T08:37:10.509 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:09.078550+0000 mgr.y (mgr.14505) 766 : cluster [DBG] pgmap v937: 168 pgs: 168 active+clean; 1.5 GiB data, 9.7 GiB used, 706 GiB / 715 GiB avail; 44 KiB/s rd, 147 MiB/s wr, 2.43k op/s 2024-02-10T08:37:10.509 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:09.463004+0000 osd.2 (osd.2) 235 : cluster [DBG] 2.e scrub starts 2024-02-10T08:37:10.509 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:09.465947+0000 osd.2 (osd.2) 236 : cluster [DBG] 2.e scrub ok 2024-02-10T08:37:10.509 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:09.560730+0000 osd.7 (osd.7) 263 : cluster [DBG] 6.21 scrub starts 2024-02-10T08:37:10.509 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:09.583092+0000 osd.7 (osd.7) 264 : cluster [DBG] 6.21 scrub ok 2024-02-10T08:37:10.510 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:09.945322+0000 osd.1 (osd.1) 274 : cluster [DBG] 5.0 scrub starts 2024-02-10T08:37:10.510 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:09.977363+0000 osd.1 (osd.1) 275 : cluster [DBG] 5.0 scrub ok 2024-02-10T08:37:10.609 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:37:10.647 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:10.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:37:08.790839+0000 mgr.y (mgr.14505) 765 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:37:10.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:08.999282+0000 osd.0 (osd.0) 240 : cluster [DBG] 4.6 scrub starts 2024-02-10T08:37:10.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:09.007647+0000 osd.0 (osd.0) 241 : cluster [DBG] 4.6 scrub ok 2024-02-10T08:37:10.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:09.024872+0000 osd.5 (osd.5) 257 : cluster [DBG] 2.2 scrub starts 2024-02-10T08:37:10.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:09.029760+0000 osd.5 (osd.5) 258 : cluster [DBG] 2.2 scrub ok 2024-02-10T08:37:10.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:09.078550+0000 mgr.y (mgr.14505) 766 : cluster [DBG] pgmap v937: 168 pgs: 168 active+clean; 1.5 GiB data, 9.7 GiB used, 706 GiB / 715 GiB avail; 44 KiB/s rd, 147 MiB/s wr, 2.43k op/s 2024-02-10T08:37:10.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:09.463004+0000 osd.2 (osd.2) 235 : cluster [DBG] 2.e scrub starts 2024-02-10T08:37:10.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:09.465947+0000 osd.2 (osd.2) 236 : cluster [DBG] 2.e scrub ok 2024-02-10T08:37:10.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:09.560730+0000 osd.7 (osd.7) 263 : cluster [DBG] 6.21 scrub starts 2024-02-10T08:37:10.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:09.583092+0000 osd.7 (osd.7) 264 : cluster [DBG] 6.21 scrub ok 2024-02-10T08:37:10.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:09.945322+0000 osd.1 (osd.1) 274 : cluster [DBG] 5.0 scrub starts 2024-02-10T08:37:10.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:09.977363+0000 osd.1 (osd.1) 275 : cluster [DBG] 5.0 scrub ok 2024-02-10T08:37:10.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:37:08.790839+0000 mgr.y (mgr.14505) 765 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:37:10.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:08.999282+0000 osd.0 (osd.0) 240 : cluster [DBG] 4.6 scrub starts 2024-02-10T08:37:10.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:09.007647+0000 osd.0 (osd.0) 241 : cluster [DBG] 4.6 scrub ok 2024-02-10T08:37:10.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:09.024872+0000 osd.5 (osd.5) 257 : cluster [DBG] 2.2 scrub starts 2024-02-10T08:37:10.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:09.029760+0000 osd.5 (osd.5) 258 : cluster [DBG] 2.2 scrub ok 2024-02-10T08:37:10.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:09.078550+0000 mgr.y (mgr.14505) 766 : cluster [DBG] pgmap v937: 168 pgs: 168 active+clean; 1.5 GiB data, 9.7 GiB used, 706 GiB / 715 GiB avail; 44 KiB/s rd, 147 MiB/s wr, 2.43k op/s 2024-02-10T08:37:10.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:09.463004+0000 osd.2 (osd.2) 235 : cluster [DBG] 2.e scrub starts 2024-02-10T08:37:10.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:09.465947+0000 osd.2 (osd.2) 236 : cluster [DBG] 2.e scrub ok 2024-02-10T08:37:10.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:09.560730+0000 osd.7 (osd.7) 263 : cluster [DBG] 6.21 scrub starts 2024-02-10T08:37:10.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:09.583092+0000 osd.7 (osd.7) 264 : cluster [DBG] 6.21 scrub ok 2024-02-10T08:37:10.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:09.945322+0000 osd.1 (osd.1) 274 : cluster [DBG] 5.0 scrub starts 2024-02-10T08:37:10.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:09.977363+0000 osd.1 (osd.1) 275 : cluster [DBG] 5.0 scrub ok 2024-02-10T08:37:10.673 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:37:10.678 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:10.678 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:37:10.778 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:37:10.815 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:10.845 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:37:10.848 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:10.848 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:37:10.949 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:37:10.951 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":934,"stamp":"2024-02-10T08:37:03.068498+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":729749156,"num_objects":11327,"num_object_clones":0,"num_object_copies":33981,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11327,"num_whiteouts":0,"num_read":2504,"num_read_kb":2256,"num_write":11974,"num_write_kb":712680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":230,"num_bytes_recovered":7872,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12114,"ondisk_log_size":12114,"up":504,"acting":504,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":504,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":7235112,"kb_used_data":1886504,"kb_used_omap":0,"kb_used_meta":5348543,"kb_avail":742726104,"statfs":{"total":767960285184,"available":760551530496,"internally_reserved":0,"allocated":1931780096,"data_stored":1928676533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":972,"internal_metadata":5476908084},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,1,0,0,0,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":729743360,"num_objects":11135,"num_object_clones":0,"num_object_copies":33405,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11135,"num_whiteouts":0,"num_read":199,"num_read_kb":199,"num_write":11261,"num_write_kb":712640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.947169"},"pg_stats":[{"pgid":"6.33","version":"0'0","reported_seq":295,"reported_epoch":401,"state":"active+clean","last_fresh":"2024-02-10T08:36:54.122961+0000","last_change":"2024-02-10T08:34:13.373898+0000","last_active":"2024-02-10T08:36:54.122961+0000","last_peered":"2024-02-10T08:36:54.122961+0000","last_clean":"2024-02-10T08:36:54.122961+0000","last_became_active":"2024-02-10T08:30:26.080326+0000","last_became_peered":"2024-02-10T08:30:26.080326+0000","last_unstale":"2024-02-10T08:36:54.122961+0000","last_undegraded":"2024-02-10T08:36:54.122961+0000","last_fullsized":"2024-02-10T08:36:54.122961+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:13.373809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:34:13.373809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2],"acting":[5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":402,"reported_epoch":401,"state":"active+clean","last_fresh":"2024-02-10T08:36:54.916630+0000","last_change":"2024-02-10T08:36:54.916630+0000","last_active":"2024-02-10T08:36:54.916630+0000","last_peered":"2024-02-10T08:36:54.916630+0000","last_clean":"2024-02-10T08:36:54.916630+0000","last_became_active":"2024-02-10T08:30:26.067019+0000","last_became_peered":"2024-02-10T08:30:26.067019+0000","last_unstale":"2024-02-10T08:36:54.916630+0000","last_undegraded":"2024-02-10T08:36:54.916630+0000","last_fullsized":"2024-02-10T08:36:54.916630+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:54.916549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:33:31.389113+0000","last_clean_scrub_stamp":"2024-02-10T08:36:54.916549+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"402'879","reported_seq":891,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:02.838767+0000","last_change":"2024-02-10T08:36:45.138604+0000","last_active":"2024-02-10T08:37:02.838767+0000","last_peered":"2024-02-10T08:37:02.838767+0000","last_clean":"2024-02-10T08:37:02.838767+0000","last_became_active":"2024-02-10T08:36:45.138356+0000","last_became_peered":"2024-02-10T08:36:45.138356+0000","last_unstale":"2024-02-10T08:37:02.838767+0000","last_undegraded":"2024-02-10T08:37:02.838767+0000","last_fullsized":"2024-02-10T08:37:02.838767+0000","mapping_epoch":398,"log_start":"0'0","ondisk_log_start":"0'0","created":398,"last_epoch_clean":399,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_clean_scrub_stamp":"2024-02-10T08:36:44.122988+0000","log_size":879,"ondisk_log_size":879,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":57606144,"num_objects":879,"num_object_clones":0,"num_object_copies":2637,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":879,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":879,"num_write_kb":56256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,4],"acting":[5,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"111'10","reported_seq":654,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.183550+0000","last_change":"2024-02-10T08:34:09.351432+0000","last_active":"2024-02-10T08:37:01.183550+0000","last_peered":"2024-02-10T08:37:01.183550+0000","last_clean":"2024-02-10T08:37:01.183550+0000","last_became_active":"2024-02-10T08:20:46.399193+0000","last_became_peered":"2024-02-10T08:20:46.399193+0000","last_unstale":"2024-02-10T08:37:01.183550+0000","last_undegraded":"2024-02-10T08:37:01.183550+0000","last_fullsized":"2024-02-10T08:37:01.183550+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'10","last_scrub_stamp":"2024-02-10T08:34:09.351338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:34:09.351338+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"402'39","reported_seq":439,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.773098+0000","last_change":"2024-02-10T08:33:23.049805+0000","last_active":"2024-02-10T08:37:01.773098+0000","last_peered":"2024-02-10T08:37:01.773098+0000","last_clean":"2024-02-10T08:37:01.773098+0000","last_became_active":"2024-02-10T08:16:55.204597+0000","last_became_peered":"2024-02-10T08:16:55.204597+0000","last_unstale":"2024-02-10T08:37:01.773098+0000","last_undegraded":"2024-02-10T08:37:01.773098+0000","last_fullsized":"2024-02-10T08:37:01.773098+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'27","last_scrub_stamp":"2024-02-10T08:33:23.049704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:33:23.049704+0000","log_size":39,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":62,"num_read_kb":53,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":419,"reported_epoch":400,"state":"active+clean","last_fresh":"2024-02-10T08:36:46.140847+0000","last_change":"2024-02-10T08:36:01.698561+0000","last_active":"2024-02-10T08:36:46.140847+0000","last_peered":"2024-02-10T08:36:46.140847+0000","last_clean":"2024-02-10T08:36:46.140847+0000","last_became_active":"2024-02-10T08:32:20.330612+0000","last_became_peered":"2024-02-10T08:32:20.330612+0000","last_unstale":"2024-02-10T08:36:46.140847+0000","last_undegraded":"2024-02-10T08:36:46.140847+0000","last_fullsized":"2024-02-10T08:36:46.140847+0000","mapping_epoch":331,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":332,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:01.698455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:29:24.554978+0000","last_clean_scrub_stamp":"2024-02-10T08:36:01.698455+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":401,"reported_epoch":401,"state":"active+clean","last_fresh":"2024-02-10T08:36:54.122897+0000","last_change":"2024-02-10T08:34:09.307523+0000","last_active":"2024-02-10T08:36:54.122897+0000","last_peered":"2024-02-10T08:36:54.122897+0000","last_clean":"2024-02-10T08:36:54.122897+0000","last_became_active":"2024-02-10T08:30:24.062795+0000","last_became_peered":"2024-02-10T08:30:24.062795+0000","last_unstale":"2024-02-10T08:36:54.122897+0000","last_undegraded":"2024-02-10T08:36:54.122897+0000","last_fullsized":"2024-02-10T08:36:54.122897+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:09.307434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:20.392249+0000","last_clean_scrub_stamp":"2024-02-10T08:34:09.307434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"402'879","reported_seq":891,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:02.840616+0000","last_change":"2024-02-10T08:36:45.141649+0000","last_active":"2024-02-10T08:37:02.840616+0000","last_peered":"2024-02-10T08:37:02.840616+0000","last_clean":"2024-02-10T08:37:02.840616+0000","last_became_active":"2024-02-10T08:36:45.141344+0000","last_became_peered":"2024-02-10T08:36:45.141344+0000","last_unstale":"2024-02-10T08:37:02.840616+0000","last_undegraded":"2024-02-10T08:37:02.840616+0000","last_fullsized":"2024-02-10T08:37:02.840616+0000","mapping_epoch":398,"log_start":"0'0","ondisk_log_start":"0'0","created":398,"last_epoch_clean":399,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_clean_scrub_stamp":"2024-02-10T08:36:44.122988+0000","log_size":879,"ondisk_log_size":879,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":57606144,"num_objects":879,"num_object_clones":0,"num_object_copies":2637,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":879,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":879,"num_write_kb":56256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"225'15","reported_seq":192,"reported_epoch":400,"state":"active+clean","last_fresh":"2024-02-10T08:36:46.862763+0000","last_change":"2024-02-10T08:35:10.248379+0000","last_active":"2024-02-10T08:36:46.862763+0000","last_peered":"2024-02-10T08:36:46.862763+0000","last_clean":"2024-02-10T08:36:46.862763+0000","last_became_active":"2024-02-10T08:28:02.770508+0000","last_became_peered":"2024-02-10T08:28:02.770508+0000","last_unstale":"2024-02-10T08:36:46.862763+0000","last_undegraded":"2024-02-10T08:36:46.862763+0000","last_fullsized":"2024-02-10T08:36:46.862763+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'15","last_scrub_stamp":"2024-02-10T08:35:10.248283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:35:10.248283+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":396,"reported_epoch":401,"state":"active+clean","last_fresh":"2024-02-10T08:36:54.820111+0000","last_change":"2024-02-10T08:34:27.796767+0000","last_active":"2024-02-10T08:36:54.820111+0000","last_peered":"2024-02-10T08:36:54.820111+0000","last_clean":"2024-02-10T08:36:54.820111+0000","last_became_active":"2024-02-10T08:20:46.407311+0000","last_became_peered":"2024-02-10T08:20:46.407311+0000","last_unstale":"2024-02-10T08:36:54.820111+0000","last_undegraded":"2024-02-10T08:36:54.820111+0000","last_fullsized":"2024-02-10T08:36:54.820111+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:27.796670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:21.523096+0000","last_clean_scrub_stamp":"2024-02-10T08:34:27.796670+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":432,"reported_epoch":400,"state":"active+clean","last_fresh":"2024-02-10T08:36:46.140173+0000","last_change":"2024-02-10T08:36:08.684752+0000","last_active":"2024-02-10T08:36:46.140173+0000","last_peered":"2024-02-10T08:36:46.140173+0000","last_clean":"2024-02-10T08:36:46.140173+0000","last_became_active":"2024-02-10T08:31:33.882809+0000","last_became_peered":"2024-02-10T08:31:33.882809+0000","last_unstale":"2024-02-10T08:36:46.140173+0000","last_undegraded":"2024-02-10T08:36:46.140173+0000","last_fullsized":"2024-02-10T08:36:46.140173+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:08.684646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:36:08.684646+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"76'2","reported_seq":76,"reported_epoch":400,"state":"active+clean","last_fresh":"2024-02-10T08:36:46.861550+0000","last_change":"2024-02-10T08:34:24.132606+0000","last_active":"2024-02-10T08:36:46.861550+0000","last_peered":"2024-02-10T08:36:46.861550+0000","last_clean":"2024-02-10T08:36:46.861550+0000","last_became_active":"2024-02-10T08:32:36.979100+0000","last_became_peered":"2024-02-10T08:32:36.979100+0000","last_unstale":"2024-02-10T08:36:46.861550+0000","last_undegraded":"2024-02-10T08:36:46.861550+0000","last_fullsized":"2024-02-10T08:36:46.861550+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'2","last_scrub_stamp":"2024-02-10T08:34:24.132513+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2024-02-10T08:18:08.680038+0000","last_clean_scrub_stamp":"2024-02-10T08:34:24.132513+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.5","version":"402'901","reported_seq":913,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:02.849801+0000","last_change":"2024-02-10T08:36:45.141686+0000","last_active":"2024-02-10T08:37:02.849801+0000","last_peered":"2024-02-10T08:37:02.849801+0000","last_clean":"2024-02-10T08:37:02.849801+0000","last_became_active":"2024-02-10T08:36:45.141444+0000","last_became_peered":"2024-02-10T08:36:45.141444+0000","last_unstale":"2024-02-10T08:37:02.849801+0000","last_undegraded":"2024-02-10T08:37:02.849801+0000","last_fullsized":"2024-02-10T08:37:02.849801+0000","mapping_epoch":398,"log_start":"0'0","ondisk_log_start":"0'0","created":398,"last_epoch_clean":399,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_clean_scrub_stamp":"2024-02-10T08:36:44.122988+0000","log_size":901,"ondisk_log_size":901,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":59047936,"num_objects":901,"num_object_clones":0,"num_object_copies":2703,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":901,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":901,"num_write_kb":57664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"402'60","reported_seq":471,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:02.148580+0000","last_change":"2024-02-10T08:36:15.980603+0000","last_active":"2024-02-10T08:37:02.148580+0000","last_peered":"2024-02-10T08:37:02.148580+0000","last_clean":"2024-02-10T08:37:02.148580+0000","last_became_active":"2024-02-10T08:16:55.203415+0000","last_became_peered":"2024-02-10T08:16:55.203415+0000","last_unstale":"2024-02-10T08:37:02.148580+0000","last_undegraded":"2024-02-10T08:37:02.148580+0000","last_fullsized":"2024-02-10T08:37:02.148580+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"391'44","last_scrub_stamp":"2024-02-10T08:36:15.980533+0000","last_deep_scrub":"391'44","last_deep_scrub_stamp":"2024-02-10T08:36:15.980533+0000","last_clean_scrub_stamp":"2024-02-10T08:36:15.980533+0000","log_size":60,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":80,"num_read_kb":69,"num_write":52,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":408,"reported_epoch":400,"state":"active+clean","last_fresh":"2024-02-10T08:36:46.140511+0000","last_change":"2024-02-10T08:36:06.679301+0000","last_active":"2024-02-10T08:36:46.140511+0000","last_peered":"2024-02-10T08:36:46.140511+0000","last_clean":"2024-02-10T08:36:46.140511+0000","last_became_active":"2024-02-10T08:28:02.781029+0000","last_became_peered":"2024-02-10T08:28:02.781029+0000","last_unstale":"2024-02-10T08:36:46.140511+0000","last_undegraded":"2024-02-10T08:36:46.140511+0000","last_fullsized":"2024-02-10T08:36:46.140511+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:06.679173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:36:06.679173+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":399,"reported_epoch":400,"state":"active+clean","last_fresh":"2024-02-10T08:36:46.140542+0000","last_change":"2024-02-10T08:34:24.908075+0000","last_active":"2024-02-10T08:36:46.140542+0000","last_peered":"2024-02-10T08:36:46.140542+0000","last_clean":"2024-02-10T08:36:46.140542+0000","last_became_active":"2024-02-10T08:28:02.779438+0000","last_became_peered":"2024-02-10T08:28:02.779438+0000","last_unstale":"2024-02-10T08:36:46.140542+0000","last_undegraded":"2024-02-10T08:36:46.140542+0000","last_fullsized":"2024-02-10T08:36:46.140542+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:24.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.593849+0000","last_clean_scrub_stamp":"2024-02-10T08:34:24.907958+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":387,"reported_epoch":401,"state":"active+clean","last_fresh":"2024-02-10T08:36:54.261126+0000","last_change":"2024-02-10T08:33:19.398482+0000","last_active":"2024-02-10T08:36:54.261126+0000","last_peered":"2024-02-10T08:36:54.261126+0000","last_clean":"2024-02-10T08:36:54.261126+0000","last_became_active":"2024-02-10T08:24:18.645480+0000","last_became_peered":"2024-02-10T08:24:18.645480+0000","last_unstale":"2024-02-10T08:36:54.261126+0000","last_undegraded":"2024-02-10T08:36:54.261126+0000","last_fullsized":"2024-02-10T08:36:54.261126+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:19.398412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:33:19.398412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,3],"acting":[7,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2","version":"401'123","reported_seq":134,"reported_epoch":401,"state":"active+clean","last_fresh":"2024-02-10T08:36:58.063107+0000","last_change":"2024-02-10T08:36:45.372419+0000","last_active":"2024-02-10T08:36:58.063107+0000","last_peered":"2024-02-10T08:36:58.063107+0000","last_clean":"2024-02-10T08:36:58.063107+0000","last_became_active":"2024-02-10T08:36:45.372098+0000","last_became_peered":"2024-02-10T08:36:45.372098+0000","last_unstale":"2024-02-10T08:36:58.063107+0000","last_undegraded":"2024-02-10T08:36:58.063107+0000","last_fullsized":"2024-02-10T08:36:58.063107+0000","mapping_epoch":398,"log_start":"0'0","ondisk_log_start":"0'0","created":398,"last_epoch_clean":399,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_clean_scrub_stamp":"2024-02-10T08:36:44.122988+0000","log_size":123,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8060928,"num_objects":123,"num_object_clones":0,"num_object_copies":369,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":123,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":7872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"225'31","reported_seq":121,"reported_epoch":400,"state":"active+clean","last_fresh":"2024-02-10T08:36:46.863283+0000","last_change":"2024-02-10T08:36:18.225301+0000","last_active":"2024-02-10T08:36:46.863283+0000","last_peered":"2024-02-10T08:36:46.863283+0000","last_clean":"2024-02-10T08:36:46.863283+0000","last_became_active":"2024-02-10T08:31:46.070488+0000","last_became_peered":"2024-02-10T08:31:46.070488+0000","last_unstale":"2024-02-10T08:36:46.863283+0000","last_undegraded":"2024-02-10T08:36:46.863283+0000","last_fullsized":"2024-02-10T08:36:46.863283+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'31","last_scrub_stamp":"2024-02-10T08:36:18.225215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:36:18.225215+0000","log_size":31,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":48,"num_read_kb":38,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":437,"reported_epoch":401,"state":"active+clean","last_fresh":"2024-02-10T08:36:56.517371+0000","last_change":"2024-02-10T08:36:56.517345+0000","last_active":"2024-02-10T08:36:56.517371+0000","last_peered":"2024-02-10T08:36:56.517371+0000","last_clean":"2024-02-10T08:36:56.517371+0000","last_became_active":"2024-02-10T08:20:46.399568+0000","last_became_peered":"2024-02-10T08:20:46.399568+0000","last_unstale":"2024-02-10T08:36:56.517371+0000","last_undegraded":"2024-02-10T08:36:56.517371+0000","last_fullsized":"2024-02-10T08:36:56.517371+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:56.517278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:36:56.517278+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":410,"reported_epoch":401,"state":"active+clean","last_fresh":"2024-02-10T08:36:54.820749+0000","last_change":"2024-02-10T08:36:28.930123+0000","last_active":"2024-02-10T08:36:54.820749+0000","last_peered":"2024-02-10T08:36:54.820749+0000","last_clean":"2024-02-10T08:36:54.820749+0000","last_became_active":"2024-02-10T08:28:02.764210+0000","last_became_peered":"2024-02-10T08:28:02.764210+0000","last_unstale":"2024-02-10T08:36:54.820749+0000","last_undegraded":"2024-02-10T08:36:54.820749+0000","last_fullsized":"2024-02-10T08:36:54.820749+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:28.929999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:36:28.929999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":351,"reported_epoch":400,"state":"active+clean","last_fresh":"2024-02-10T08:36:46.863225+0000","last_change":"2024-02-10T08:34:23.258089+0000","last_active":"2024-02-10T08:36:46.863225+0000","last_peered":"2024-02-10T08:36:46.863225+0000","last_clean":"2024-02-10T08:36:46.863225+0000","last_became_active":"2024-02-10T08:31:33.883457+0000","last_became_peered":"2024-02-10T08:31:33.883457+0000","last_unstale":"2024-02-10T08:36:46.863225+0000","last_undegraded":"2024-02-10T08:36:46.863225+0000","last_fullsized":"2024-02-10T08:36:46.863225+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:23.258018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:34.215363+0000","last_clean_scrub_stamp":"2024-02-10T08:34:23.258018+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3","version":"402'904","reported_seq":916,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:02.883031+0000","last_change":"2024-02-10T08:36:45.142338+0000","last_active":"2024-02-10T08:37:02.883031+0000","last_peered":"2024-02-10T08:37:02.883031+0000","last_clean":"2024-02-10T08:37:02.883031+0000","last_became_active":"2024-02-10T08:36:45.141955+0000","last_became_peered":"2024-02-10T08:36:45.141955+0000","last_unstale":"2024-02-10T08:37:02.883031+0000","last_undegraded":"2024-02-10T08:37:02.883031+0000","last_fullsized":"2024-02-10T08:37:02.883031+0000","mapping_epoch":398,"log_start":"0'0","ondisk_log_start":"0'0","created":398,"last_epoch_clean":399,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_clean_scrub_stamp":"2024-02-10T08:36:44.122988+0000","log_size":904,"ondisk_log_size":904,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":59244544,"num_objects":904,"num_object_clones":0,"num_object_copies":2712,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":904,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":904,"num_write_kb":57856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1],"acting":[6,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"225'20","reported_seq":394,"reported_epoch":400,"state":"active+clean","last_fresh":"2024-02-10T08:36:46.861075+0000","last_change":"2024-02-10T08:35:23.121276+0000","last_active":"2024-02-10T08:36:46.861075+0000","last_peered":"2024-02-10T08:36:46.861075+0000","last_clean":"2024-02-10T08:36:46.861075+0000","last_became_active":"2024-02-10T08:20:46.398973+0000","last_became_peered":"2024-02-10T08:20:46.398973+0000","last_unstale":"2024-02-10T08:36:46.861075+0000","last_undegraded":"2024-02-10T08:36:46.861075+0000","last_fullsized":"2024-02-10T08:36:46.861075+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'20","last_scrub_stamp":"2024-02-10T08:35:23.121164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:35:23.121164+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":24,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":381,"reported_epoch":401,"state":"active+clean","last_fresh":"2024-02-10T08:36:54.822137+0000","last_change":"2024-02-10T08:36:04.761005+0000","last_active":"2024-02-10T08:36:54.822137+0000","last_peered":"2024-02-10T08:36:54.822137+0000","last_clean":"2024-02-10T08:36:54.822137+0000","last_became_active":"2024-02-10T08:16:52.785545+0000","last_became_peered":"2024-02-10T08:16:52.785545+0000","last_unstale":"2024-02-10T08:36:54.822137+0000","last_undegraded":"2024-02-10T08:36:54.822137+0000","last_fullsized":"2024-02-10T08:36:54.822137+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:04.760903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:36:04.760903+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"62'8","reported_seq":630,"reported_epoch":401,"state":"active+clean","last_fresh":"2024-02-10T08:36:54.124703+0000","last_change":"2024-02-10T08:34:37.927018+0000","last_active":"2024-02-10T08:36:54.124703+0000","last_peered":"2024-02-10T08:36:54.124703+0000","last_clean":"2024-02-10T08:36:54.124703+0000","last_became_active":"2024-02-10T08:16:56.858101+0000","last_became_peered":"2024-02-10T08:16:56.858101+0000","last_unstale":"2024-02-10T08:36:54.124703+0000","last_undegraded":"2024-02-10T08:36:54.124703+0000","last_fullsized":"2024-02-10T08:36:54.124703+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'8","last_scrub_stamp":"2024-02-10T08:34:37.926921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:34:37.926921+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":358,"reported_epoch":400,"state":"active+clean","last_fresh":"2024-02-10T08:36:46.863576+0000","last_change":"2024-02-10T08:36:27.252813+0000","last_active":"2024-02-10T08:36:46.863576+0000","last_peered":"2024-02-10T08:36:46.863576+0000","last_clean":"2024-02-10T08:36:46.863576+0000","last_became_active":"2024-02-10T08:30:24.071020+0000","last_became_peered":"2024-02-10T08:30:24.071020+0000","last_unstale":"2024-02-10T08:36:46.863576+0000","last_undegraded":"2024-02-10T08:36:46.863576+0000","last_fullsized":"2024-02-10T08:36:46.863576+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:27.252710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:33:29.477480+0000","last_clean_scrub_stamp":"2024-02-10T08:36:27.252710+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.0","version":"402'931","reported_seq":943,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:02.919838+0000","last_change":"2024-02-10T08:36:45.373529+0000","last_active":"2024-02-10T08:37:02.919838+0000","last_peered":"2024-02-10T08:37:02.919838+0000","last_clean":"2024-02-10T08:37:02.919838+0000","last_became_active":"2024-02-10T08:36:45.373241+0000","last_became_peered":"2024-02-10T08:36:45.373241+0000","last_unstale":"2024-02-10T08:37:02.919838+0000","last_undegraded":"2024-02-10T08:37:02.919838+0000","last_fullsized":"2024-02-10T08:37:02.919838+0000","mapping_epoch":398,"log_start":"0'0","ondisk_log_start":"0'0","created":398,"last_epoch_clean":399,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_clean_scrub_stamp":"2024-02-10T08:36:44.122988+0000","log_size":931,"ondisk_log_size":931,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":61014016,"num_objects":931,"num_object_clones":0,"num_object_copies":2793,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":931,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":931,"num_write_kb":59584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"226'27","reported_seq":408,"reported_epoch":400,"state":"active+clean","last_fresh":"2024-02-10T08:36:46.140893+0000","last_change":"2024-02-10T08:36:25.673449+0000","last_active":"2024-02-10T08:36:46.140893+0000","last_peered":"2024-02-10T08:36:46.140893+0000","last_clean":"2024-02-10T08:36:46.140893+0000","last_became_active":"2024-02-10T08:20:46.401777+0000","last_became_peered":"2024-02-10T08:20:46.401777+0000","last_unstale":"2024-02-10T08:36:46.140893+0000","last_undegraded":"2024-02-10T08:36:46.140893+0000","last_fullsized":"2024-02-10T08:36:46.140893+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"226'27","last_scrub_stamp":"2024-02-10T08:36:25.673374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:36:25.673374+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":381,"reported_epoch":401,"state":"active+clean","last_fresh":"2024-02-10T08:36:54.821467+0000","last_change":"2024-02-10T08:35:14.724519+0000","last_active":"2024-02-10T08:36:54.821467+0000","last_peered":"2024-02-10T08:36:54.821467+0000","last_clean":"2024-02-10T08:36:54.821467+0000","last_became_active":"2024-02-10T08:16:52.783634+0000","last_became_peered":"2024-02-10T08:16:52.783634+0000","last_unstale":"2024-02-10T08:36:54.821467+0000","last_undegraded":"2024-02-10T08:36:54.821467+0000","last_fullsized":"2024-02-10T08:36:54.821467+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:35:14.724417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:35:14.724417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"318'14","reported_seq":170,"reported_epoch":401,"state":"active+clean","last_fresh":"2024-02-10T08:36:55.934134+0000","last_change":"2024-02-10T08:36:55.934111+0000","last_active":"2024-02-10T08:36:55.934134+0000","last_peered":"2024-02-10T08:36:55.934134+0000","last_clean":"2024-02-10T08:36:55.934134+0000","last_became_active":"2024-02-10T08:31:46.073265+0000","last_became_peered":"2024-02-10T08:31:46.073265+0000","last_unstale":"2024-02-10T08:36:55.934134+0000","last_undegraded":"2024-02-10T08:36:55.934134+0000","last_fullsized":"2024-02-10T08:36:55.934134+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"318'14","last_scrub_stamp":"2024-02-10T08:36:55.934036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:36:55.934036+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":401,"reported_epoch":401,"state":"active+clean","last_fresh":"2024-02-10T08:36:54.123668+0000","last_change":"2024-02-10T08:35:23.093480+0000","last_active":"2024-02-10T08:36:54.123668+0000","last_peered":"2024-02-10T08:36:54.123668+0000","last_clean":"2024-02-10T08:36:54.123668+0000","last_became_active":"2024-02-10T08:32:36.978932+0000","last_became_peered":"2024-02-10T08:32:36.978932+0000","last_unstale":"2024-02-10T08:36:54.123668+0000","last_undegraded":"2024-02-10T08:36:54.123668+0000","last_fullsized":"2024-02-10T08:36:54.123668+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:35:23.093373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:35:23.093373+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1","version":"402'952","reported_seq":964,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:02.833166+0000","last_change":"2024-02-10T08:36:45.373702+0000","last_active":"2024-02-10T08:37:02.833166+0000","last_peered":"2024-02-10T08:37:02.833166+0000","last_clean":"2024-02-10T08:37:02.833166+0000","last_became_active":"2024-02-10T08:36:45.373418+0000","last_became_peered":"2024-02-10T08:36:45.373418+0000","last_unstale":"2024-02-10T08:37:02.833166+0000","last_undegraded":"2024-02-10T08:37:02.833166+0000","last_fullsized":"2024-02-10T08:37:02.833166+0000","mapping_epoch":398,"log_start":"0'0","ondisk_log_start":"0'0","created":398,"last_epoch_clean":399,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_clean_scrub_stamp":"2024-02-10T08:36:44.122988+0000","log_size":952,"ondisk_log_size":952,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":62390272,"num_objects":952,"num_object_clones":0,"num_object_copies":2856,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":952,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":952,"num_write_kb":60928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"225'24","reported_seq":401,"reported_epoch":400,"state":"active+clean","last_fresh":"2024-02-10T08:36:46.863643+0000","last_change":"2024-02-10T08:36:17.241143+0000","last_active":"2024-02-10T08:36:46.863643+0000","last_peered":"2024-02-10T08:36:46.863643+0000","last_clean":"2024-02-10T08:36:46.863643+0000","last_became_active":"2024-02-10T08:20:46.406023+0000","last_became_peered":"2024-02-10T08:20:46.406023+0000","last_unstale":"2024-02-10T08:36:46.863643+0000","last_undegraded":"2024-02-10T08:36:46.863643+0000","last_fullsized":"2024-02-10T08:36:46.863643+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'24","last_scrub_stamp":"2024-02-10T08:36:17.241057+0000","last_deep_scrub":"76'16","last_deep_scrub_stamp":"2024-02-10T08:18:07.909782+0000","last_clean_scrub_stamp":"2024-02-10T08:36:17.241057+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":398,"reported_epoch":401,"state":"active+clean","last_fresh":"2024-02-10T08:36:54.261346+0000","last_change":"2024-02-10T08:36:21.439261+0000","last_active":"2024-02-10T08:36:54.261346+0000","last_peered":"2024-02-10T08:36:54.261346+0000","last_clean":"2024-02-10T08:36:54.261346+0000","last_became_active":"2024-02-10T08:28:02.768633+0000","last_became_peered":"2024-02-10T08:28:02.768633+0000","last_unstale":"2024-02-10T08:36:54.261346+0000","last_undegraded":"2024-02-10T08:36:54.261346+0000","last_fullsized":"2024-02-10T08:36:54.261346+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:21.439160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:36:21.439160+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":445,"reported_epoch":401,"state":"active+clean","last_fresh":"2024-02-10T08:36:54.123879+0000","last_change":"2024-02-10T08:36:02.062993+0000","last_active":"2024-02-10T08:36:54.123879+0000","last_peered":"2024-02-10T08:36:54.123879+0000","last_clean":"2024-02-10T08:36:54.123879+0000","last_became_active":"2024-02-10T08:20:46.400500+0000","last_became_peered":"2024-02-10T08:20:46.400500+0000","last_unstale":"2024-02-10T08:36:54.123879+0000","last_undegraded":"2024-02-10T08:36:54.123879+0000","last_fullsized":"2024-02-10T08:36:54.123879+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:02.062895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:36:02.062895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":318,"reported_epoch":401,"state":"active+clean","last_fresh":"2024-02-10T08:36:58.006580+0000","last_change":"2024-02-10T08:36:58.006547+0000","last_active":"2024-02-10T08:36:58.006580+0000","last_peered":"2024-02-10T08:36:58.006580+0000","last_clean":"2024-02-10T08:36:58.006580+0000","last_became_active":"2024-02-10T08:31:33.880969+0000","last_became_peered":"2024-02-10T08:31:33.880969+0000","last_unstale":"2024-02-10T08:36:58.006580+0000","last_undegraded":"2024-02-10T08:36:58.006580+0000","last_fullsized":"2024-02-10T08:36:58.006580+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:58.006464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:20:30.227375+0000","last_clean_scrub_stamp":"2024-02-10T08:36:58.006464+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.e","version":"401'453","reported_seq":464,"reported_epoch":401,"state":"active+clean","last_fresh":"2024-02-10T08:36:59.640647+0000","last_change":"2024-02-10T08:36:45.140660+0000","last_active":"2024-02-10T08:36:59.640647+0000","last_peered":"2024-02-10T08:36:59.640647+0000","last_clean":"2024-02-10T08:36:59.640647+0000","last_became_active":"2024-02-10T08:36:45.140350+0000","last_became_peered":"2024-02-10T08:36:45.140350+0000","last_unstale":"2024-02-10T08:36:59.640647+0000","last_undegraded":"2024-02-10T08:36:59.640647+0000","last_fullsized":"2024-02-10T08:36:59.640647+0000","mapping_epoch":398,"log_start":"0'0","ondisk_log_start":"0'0","created":398,"last_epoch_clean":399,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_clean_scrub_stamp":"2024-02-10T08:36:44.122988+0000","log_size":453,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":29687808,"num_objects":453,"num_object_clones":0,"num_object_copies":1359,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":453,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":453,"num_write_kb":28992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7],"acting":[4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"314'14","reported_seq":509,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.198157+0000","last_change":"2024-02-10T08:34:18.681979+0000","last_active":"2024-02-10T08:37:01.198157+0000","last_peered":"2024-02-10T08:37:01.198157+0000","last_clean":"2024-02-10T08:37:01.198157+0000","last_became_active":"2024-02-10T08:31:33.890120+0000","last_became_peered":"2024-02-10T08:31:33.890120+0000","last_unstale":"2024-02-10T08:37:01.198157+0000","last_undegraded":"2024-02-10T08:37:01.198157+0000","last_fullsized":"2024-02-10T08:37:01.198157+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"314'14","last_scrub_stamp":"2024-02-10T08:34:18.681893+0000","last_deep_scrub":"199'13","last_deep_scrub_stamp":"2024-02-10T08:24:47.529439+0000","last_clean_scrub_stamp":"2024-02-10T08:34:18.681893+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"225'28","reported_seq":392,"reported_epoch":400,"state":"active+clean","last_fresh":"2024-02-10T08:36:46.860913+0000","last_change":"2024-02-10T08:34:12.126228+0000","last_active":"2024-02-10T08:36:46.860913+0000","last_peered":"2024-02-10T08:36:46.860913+0000","last_clean":"2024-02-10T08:36:46.860913+0000","last_became_active":"2024-02-10T08:20:46.400760+0000","last_became_peered":"2024-02-10T08:20:46.400760+0000","last_unstale":"2024-02-10T08:36:46.860913+0000","last_undegraded":"2024-02-10T08:36:46.860913+0000","last_fullsized":"2024-02-10T08:36:46.860913+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'28","last_scrub_stamp":"2024-02-10T08:34:12.126133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:34:12.126133+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":41,"num_read_kb":34,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":385,"reported_epoch":401,"state":"active+clean","last_fresh":"2024-02-10T08:36:54.574316+0000","last_change":"2024-02-10T08:35:19.808816+0000","last_active":"2024-02-10T08:36:54.574316+0000","last_peered":"2024-02-10T08:36:54.574316+0000","last_clean":"2024-02-10T08:36:54.574316+0000","last_became_active":"2024-02-10T08:16:52.789020+0000","last_became_peered":"2024-02-10T08:16:52.789020+0000","last_unstale":"2024-02-10T08:36:54.574316+0000","last_undegraded":"2024-02-10T08:36:54.574316+0000","last_fullsized":"2024-02-10T08:36:54.574316+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:35:19.808724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:35:19.808724+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":378,"reported_epoch":401,"state":"active+clean","last_fresh":"2024-02-10T08:36:54.262140+0000","last_change":"2024-02-10T08:33:15.455469+0000","last_active":"2024-02-10T08:36:54.262140+0000","last_peered":"2024-02-10T08:36:54.262140+0000","last_clean":"2024-02-10T08:36:54.262140+0000","last_became_active":"2024-02-10T08:21:58.546976+0000","last_became_peered":"2024-02-10T08:21:58.546976+0000","last_unstale":"2024-02-10T08:36:54.262140+0000","last_undegraded":"2024-02-10T08:36:54.262140+0000","last_fullsized":"2024-02-10T08:36:54.262140+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:15.455337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:33:15.455337+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.f","version":"402'904","reported_seq":916,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:02.851921+0000","last_change":"2024-02-10T08:36:45.141212+0000","last_active":"2024-02-10T08:37:02.851921+0000","last_peered":"2024-02-10T08:37:02.851921+0000","last_clean":"2024-02-10T08:37:02.851921+0000","last_became_active":"2024-02-10T08:36:45.140934+0000","last_became_peered":"2024-02-10T08:36:45.140934+0000","last_unstale":"2024-02-10T08:37:02.851921+0000","last_undegraded":"2024-02-10T08:37:02.851921+0000","last_fullsized":"2024-02-10T08:37:02.851921+0000","mapping_epoch":398,"log_start":"0'0","ondisk_log_start":"0'0","created":398,"last_epoch_clean":399,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_clean_scrub_stamp":"2024-02-10T08:36:44.122988+0000","log_size":904,"ondisk_log_size":904,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":59244544,"num_objects":904,"num_object_clones":0,"num_object_copies":2712,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":904,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":904,"num_write_kb":57856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":370,"reported_epoch":400,"state":"active+clean","last_fresh":"2024-02-10T08:36:46.862414+0000","last_change":"2024-02-10T08:34:10.165771+0000","last_active":"2024-02-10T08:36:46.862414+0000","last_peered":"2024-02-10T08:36:46.862414+0000","last_clean":"2024-02-10T08:36:46.862414+0000","last_became_active":"2024-02-10T08:31:33.883569+0000","last_became_peered":"2024-02-10T08:31:33.883569+0000","last_unstale":"2024-02-10T08:36:46.862414+0000","last_undegraded":"2024-02-10T08:36:46.862414+0000","last_fullsized":"2024-02-10T08:36:46.862414+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:10.165705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:34:10.165705+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"402'42","reported_seq":455,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.857209+0000","last_change":"2024-02-10T08:33:22.481486+0000","last_active":"2024-02-10T08:37:01.857209+0000","last_peered":"2024-02-10T08:37:01.857209+0000","last_clean":"2024-02-10T08:37:01.857209+0000","last_became_active":"2024-02-10T08:32:36.979685+0000","last_became_peered":"2024-02-10T08:32:36.979685+0000","last_unstale":"2024-02-10T08:37:01.857209+0000","last_undegraded":"2024-02-10T08:37:01.857209+0000","last_fullsized":"2024-02-10T08:37:01.857209+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'30","last_scrub_stamp":"2024-02-10T08:33:22.481382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:33:22.481382+0000","log_size":42,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":69,"num_read_kb":57,"num_write":44,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,0],"acting":[7,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":396,"reported_epoch":401,"state":"active+clean","last_fresh":"2024-02-10T08:36:54.820342+0000","last_change":"2024-02-10T08:36:27.912388+0000","last_active":"2024-02-10T08:36:54.820342+0000","last_peered":"2024-02-10T08:36:54.820342+0000","last_clean":"2024-02-10T08:36:54.820342+0000","last_became_active":"2024-02-10T08:20:46.407667+0000","last_became_peered":"2024-02-10T08:20:46.407667+0000","last_unstale":"2024-02-10T08:36:54.820342+0000","last_undegraded":"2024-02-10T08:36:54.820342+0000","last_fullsized":"2024-02-10T08:36:54.820342+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:27.912314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:36:27.912314+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":388,"reported_epoch":400,"state":"active+clean","last_fresh":"2024-02-10T08:36:46.862508+0000","last_change":"2024-02-10T08:36:09.213565+0000","last_active":"2024-02-10T08:36:46.862508+0000","last_peered":"2024-02-10T08:36:46.862508+0000","last_clean":"2024-02-10T08:36:46.862508+0000","last_became_active":"2024-02-10T08:31:33.882582+0000","last_became_peered":"2024-02-10T08:31:33.882582+0000","last_unstale":"2024-02-10T08:36:46.862508+0000","last_undegraded":"2024-02-10T08:36:46.862508+0000","last_fullsized":"2024-02-10T08:36:46.862508+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:09.213493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:25.358315+0000","last_clean_scrub_stamp":"2024-02-10T08:36:09.213493+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"402'952","reported_seq":964,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:02.926123+0000","last_change":"2024-02-10T08:36:45.138862+0000","last_active":"2024-02-10T08:37:02.926123+0000","last_peered":"2024-02-10T08:37:02.926123+0000","last_clean":"2024-02-10T08:37:02.926123+0000","last_became_active":"2024-02-10T08:36:45.138544+0000","last_became_peered":"2024-02-10T08:36:45.138544+0000","last_unstale":"2024-02-10T08:37:02.926123+0000","last_undegraded":"2024-02-10T08:37:02.926123+0000","last_fullsized":"2024-02-10T08:37:02.926123+0000","mapping_epoch":398,"log_start":"0'0","ondisk_log_start":"0'0","created":398,"last_epoch_clean":399,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_clean_scrub_stamp":"2024-02-10T08:36:44.122988+0000","log_size":952,"ondisk_log_size":952,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":62390272,"num_objects":952,"num_object_clones":0,"num_object_copies":2856,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":952,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":952,"num_write_kb":60928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,4],"acting":[1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":265,"reported_epoch":400,"state":"active+clean","last_fresh":"2024-02-10T08:36:46.862150+0000","last_change":"2024-02-10T08:33:56.117476+0000","last_active":"2024-02-10T08:36:46.862150+0000","last_peered":"2024-02-10T08:36:46.862150+0000","last_clean":"2024-02-10T08:36:46.862150+0000","last_became_active":"2024-02-10T08:33:56.117216+0000","last_became_peered":"2024-02-10T08:33:56.117216+0000","last_unstale":"2024-02-10T08:36:46.862150+0000","last_undegraded":"2024-02-10T08:36:46.862150+0000","last_fullsized":"2024-02-10T08:36:46.862150+0000","mapping_epoch":364,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":365,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:33.234450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:33:33.234450+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"225'37","reported_seq":471,"reported_epoch":400,"state":"active+clean","last_fresh":"2024-02-10T08:36:46.862561+0000","last_change":"2024-02-10T08:33:15.707082+0000","last_active":"2024-02-10T08:36:46.862561+0000","last_peered":"2024-02-10T08:36:46.862561+0000","last_clean":"2024-02-10T08:36:46.862561+0000","last_became_active":"2024-02-10T08:28:25.951447+0000","last_became_peered":"2024-02-10T08:28:25.951447+0000","last_unstale":"2024-02-10T08:36:46.862561+0000","last_undegraded":"2024-02-10T08:36:46.862561+0000","last_fullsized":"2024-02-10T08:36:46.862561+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'37","last_scrub_stamp":"2024-02-10T08:33:15.706967+0000","last_deep_scrub":"199'27","last_deep_scrub_stamp":"2024-02-10T08:24:42.826442+0000","last_clean_scrub_stamp":"2024-02-10T08:33:15.706967+0000","log_size":37,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":53,"num_read_kb":39,"num_write":32,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":387,"reported_epoch":401,"state":"active+clean","last_fresh":"2024-02-10T08:36:55.489706+0000","last_change":"2024-02-10T08:36:55.489706+0000","last_active":"2024-02-10T08:36:55.489706+0000","last_peered":"2024-02-10T08:36:55.489706+0000","last_clean":"2024-02-10T08:36:55.489706+0000","last_became_active":"2024-02-10T08:32:36.972224+0000","last_became_peered":"2024-02-10T08:32:36.972224+0000","last_unstale":"2024-02-10T08:36:55.489706+0000","last_undegraded":"2024-02-10T08:36:55.489706+0000","last_fullsized":"2024-02-10T08:36:55.489706+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:55.489632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:36:55.489632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4],"acting":[2,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":384,"reported_epoch":401,"state":"active+clean","last_fresh":"2024-02-10T08:36:54.819779+0000","last_change":"2024-02-10T08:36:20.807555+0000","last_active":"2024-02-10T08:36:54.819779+0000","last_peered":"2024-02-10T08:36:54.819779+0000","last_clean":"2024-02-10T08:36:54.819779+0000","last_became_active":"2024-02-10T08:21:58.553966+0000","last_became_peered":"2024-02-10T08:21:58.553966+0000","last_unstale":"2024-02-10T08:36:54.819779+0000","last_undegraded":"2024-02-10T08:36:54.819779+0000","last_fullsized":"2024-02-10T08:36:54.819779+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:20.807490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:36:20.807490+0000","last_clean_scrub_stamp":"2024-02-10T08:36:20.807490+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.9","version":"401'185","reported_seq":196,"reported_epoch":401,"state":"active+clean","last_fresh":"2024-02-10T08:36:58.387150+0000","last_change":"2024-02-10T08:36:45.373889+0000","last_active":"2024-02-10T08:36:58.387150+0000","last_peered":"2024-02-10T08:36:58.387150+0000","last_clean":"2024-02-10T08:36:58.387150+0000","last_became_active":"2024-02-10T08:36:45.373522+0000","last_became_peered":"2024-02-10T08:36:45.373522+0000","last_unstale":"2024-02-10T08:36:58.387150+0000","last_undegraded":"2024-02-10T08:36:58.387150+0000","last_fullsized":"2024-02-10T08:36:58.387150+0000","mapping_epoch":398,"log_start":"0'0","ondisk_log_start":"0'0","created":398,"last_epoch_clean":399,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_clean_scrub_stamp":"2024-02-10T08:36:44.122988+0000","log_size":185,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12124160,"num_objects":185,"num_object_clones":0,"num_object_copies":555,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":185,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":185,"num_write_kb":11840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":398,"reported_epoch":401,"state":"active+clean","last_fresh":"2024-02-10T08:36:54.123923+0000","last_change":"2024-02-10T08:33:28.092624+0000","last_active":"2024-02-10T08:36:54.123923+0000","last_peered":"2024-02-10T08:36:54.123923+0000","last_clean":"2024-02-10T08:36:54.123923+0000","last_became_active":"2024-02-10T08:28:02.772585+0000","last_became_peered":"2024-02-10T08:28:02.772585+0000","last_unstale":"2024-02-10T08:36:54.123923+0000","last_undegraded":"2024-02-10T08:36:54.123923+0000","last_fullsized":"2024-02-10T08:36:54.123923+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:28.092554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:41.360241+0000","last_clean_scrub_stamp":"2024-02-10T08:33:28.092554+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"225'24","reported_seq":90,"reported_epoch":400,"state":"active+clean","last_fresh":"2024-02-10T08:36:46.863538+0000","last_change":"2024-02-10T08:33:09.736783+0000","last_active":"2024-02-10T08:36:46.863538+0000","last_peered":"2024-02-10T08:36:46.863538+0000","last_clean":"2024-02-10T08:36:46.863538+0000","last_became_active":"2024-02-10T08:32:36.975366+0000","last_became_peered":"2024-02-10T08:32:36.975366+0000","last_unstale":"2024-02-10T08:36:46.863538+0000","last_undegraded":"2024-02-10T08:36:46.863538+0000","last_fullsized":"2024-02-10T08:36:46.863538+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'24","last_scrub_stamp":"2024-02-10T08:33:09.736694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:33:09.736694+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":398,"reported_epoch":401,"state":"active+clean","last_fresh":"2024-02-10T08:36:54.261217+0000","last_change":"2024-02-10T08:36:26.541530+0000","last_active":"2024-02-10T08:36:54.261217+0000","last_peered":"2024-02-10T08:36:54.261217+0000","last_clean":"2024-02-10T08:36:54.261217+0000","last_became_active":"2024-02-10T08:28:02.760999+0000","last_became_peered":"2024-02-10T08:28:02.760999+0000","last_unstale":"2024-02-10T08:36:54.261217+0000","last_undegraded":"2024-02-10T08:36:54.261217+0000","last_fullsized":"2024-02-10T08:36:54.261217+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:26.541382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:28.401960+0000","last_clean_scrub_stamp":"2024-02-10T08:36:26.541382+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":371,"reported_epoch":400,"state":"active+clean","last_fresh":"2024-02-10T08:36:46.861963+0000","last_change":"2024-02-10T08:33:26.788214+0000","last_active":"2024-02-10T08:36:46.861963+0000","last_peered":"2024-02-10T08:36:46.861963+0000","last_clean":"2024-02-10T08:36:46.861963+0000","last_became_active":"2024-02-10T08:31:46.063039+0000","last_became_peered":"2024-02-10T08:31:46.063039+0000","last_unstale":"2024-02-10T08:36:46.861963+0000","last_undegraded":"2024-02-10T08:36:46.861963+0000","last_fullsized":"2024-02-10T08:36:46.861963+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:26.787778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:20.736224+0000","last_clean_scrub_stamp":"2024-02-10T08:33:26.787778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":397,"reported_epoch":401,"state":"active+clean","last_fresh":"2024-02-10T08:36:54.820828+0000","last_change":"2024-02-10T08:36:02.765582+0000","last_active":"2024-02-10T08:36:54.820828+0000","last_peered":"2024-02-10T08:36:54.820828+0000","last_clean":"2024-02-10T08:36:54.820828+0000","last_became_active":"2024-02-10T08:28:19.022399+0000","last_became_peered":"2024-02-10T08:28:19.022399+0000","last_unstale":"2024-02-10T08:36:54.820828+0000","last_undegraded":"2024-02-10T08:36:54.820828+0000","last_fullsized":"2024-02-10T08:36:54.820828+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:02.765446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:36:02.765446+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.a","version":"402'871","reported_seq":883,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:02.812689+0000","last_change":"2024-02-10T08:36:45.371929+0000","last_active":"2024-02-10T08:37:02.812689+0000","last_peered":"2024-02-10T08:37:02.812689+0000","last_clean":"2024-02-10T08:37:02.812689+0000","last_became_active":"2024-02-10T08:36:45.371664+0000","last_became_peered":"2024-02-10T08:36:45.371664+0000","last_unstale":"2024-02-10T08:37:02.812689+0000","last_undegraded":"2024-02-10T08:37:02.812689+0000","last_fullsized":"2024-02-10T08:37:02.812689+0000","mapping_epoch":398,"log_start":"0'0","ondisk_log_start":"0'0","created":398,"last_epoch_clean":399,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_clean_scrub_stamp":"2024-02-10T08:36:44.122988+0000","log_size":871,"ondisk_log_size":871,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":57081856,"num_objects":871,"num_object_clones":0,"num_object_copies":2613,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":871,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":871,"num_write_kb":55744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":376,"reported_epoch":401,"state":"active+clean","last_fresh":"2024-02-10T08:36:54.261921+0000","last_change":"2024-02-10T08:34:23.304609+0000","last_active":"2024-02-10T08:36:54.261921+0000","last_peered":"2024-02-10T08:36:54.261921+0000","last_clean":"2024-02-10T08:36:54.261921+0000","last_became_active":"2024-02-10T08:16:56.867159+0000","last_became_peered":"2024-02-10T08:16:56.867159+0000","last_unstale":"2024-02-10T08:36:54.261921+0000","last_undegraded":"2024-02-10T08:36:54.261921+0000","last_fullsized":"2024-02-10T08:36:54.261921+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:23.304519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:04.766780+0000","last_clean_scrub_stamp":"2024-02-10T08:34:23.304519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"402'45","reported_seq":463,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.986692+0000","last_change":"2024-02-10T08:36:10.987701+0000","last_active":"2024-02-10T08:37:01.986692+0000","last_peered":"2024-02-10T08:37:01.986692+0000","last_clean":"2024-02-10T08:37:01.986692+0000","last_became_active":"2024-02-10T08:20:46.401981+0000","last_became_peered":"2024-02-10T08:20:46.401981+0000","last_unstale":"2024-02-10T08:37:01.986692+0000","last_undegraded":"2024-02-10T08:37:01.986692+0000","last_fullsized":"2024-02-10T08:37:01.986692+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'33","last_scrub_stamp":"2024-02-10T08:36:10.987607+0000","last_deep_scrub":"223'21","last_deep_scrub_stamp":"2024-02-10T08:26:33.250614+0000","last_clean_scrub_stamp":"2024-02-10T08:36:10.987607+0000","log_size":45,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":61,"num_read_kb":51,"num_write":37,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":404,"reported_epoch":401,"state":"active+clean","last_fresh":"2024-02-10T08:36:54.261219+0000","last_change":"2024-02-10T08:32:36.980106+0000","last_active":"2024-02-10T08:36:54.261219+0000","last_peered":"2024-02-10T08:36:54.261219+0000","last_clean":"2024-02-10T08:36:54.261219+0000","last_became_active":"2024-02-10T08:32:36.979237+0000","last_became_peered":"2024-02-10T08:32:36.979237+0000","last_unstale":"2024-02-10T08:36:54.261219+0000","last_undegraded":"2024-02-10T08:36:54.261219+0000","last_fullsized":"2024-02-10T08:36:54.261219+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:32:16.187704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:14:44.584370+0000","last_clean_scrub_stamp":"2024-02-10T08:32:16.187704+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":385,"reported_epoch":401,"state":"active+clean","last_fresh":"2024-02-10T08:36:59.075284+0000","last_change":"2024-02-10T08:36:59.075246+0000","last_active":"2024-02-10T08:36:59.075284+0000","last_peered":"2024-02-10T08:36:59.075284+0000","last_clean":"2024-02-10T08:36:59.075284+0000","last_became_active":"2024-02-10T08:16:52.788767+0000","last_became_peered":"2024-02-10T08:16:52.788767+0000","last_unstale":"2024-02-10T08:36:59.075284+0000","last_undegraded":"2024-02-10T08:36:59.075284+0000","last_fullsized":"2024-02-10T08:36:59.075284+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:59.075134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:36:59.075134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":309,"reported_epoch":401,"state":"active+clean","last_fresh":"2024-02-10T08:36:54.123331+0000","last_change":"2024-02-10T08:36:18.911642+0000","last_active":"2024-02-10T08:36:54.123331+0000","last_peered":"2024-02-10T08:36:54.123331+0000","last_clean":"2024-02-10T08:36:54.123331+0000","last_became_active":"2024-02-10T08:31:33.878588+0000","last_became_peered":"2024-02-10T08:31:33.878588+0000","last_unstale":"2024-02-10T08:36:54.123331+0000","last_undegraded":"2024-02-10T08:36:54.123331+0000","last_fullsized":"2024-02-10T08:36:54.123331+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:18.911559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.019819+0000","last_clean_scrub_stamp":"2024-02-10T08:36:18.911559+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":107,"reported_epoch":400,"state":"active+clean","last_fresh":"2024-02-10T08:36:46.863364+0000","last_change":"2024-02-10T08:34:19.149776+0000","last_active":"2024-02-10T08:36:46.863364+0000","last_peered":"2024-02-10T08:36:46.863364+0000","last_clean":"2024-02-10T08:36:46.863364+0000","last_became_active":"2024-02-10T08:31:19.726561+0000","last_became_peered":"2024-02-10T08:31:19.726561+0000","last_unstale":"2024-02-10T08:36:46.863364+0000","last_undegraded":"2024-02-10T08:36:46.863364+0000","last_fullsized":"2024-02-10T08:36:46.863364+0000","mapping_epoch":308,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":309,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:19.149688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:26:29.921562+0000","last_clean_scrub_stamp":"2024-02-10T08:34:19.149688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.8","version":"402'916","reported_seq":928,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:02.882955+0000","last_change":"2024-02-10T08:36:45.373548+0000","last_active":"2024-02-10T08:37:02.882955+0000","last_peered":"2024-02-10T08:37:02.882955+0000","last_clean":"2024-02-10T08:37:02.882955+0000","last_became_active":"2024-02-10T08:36:45.373282+0000","last_became_peered":"2024-02-10T08:36:45.373282+0000","last_unstale":"2024-02-10T08:37:02.882955+0000","last_undegraded":"2024-02-10T08:37:02.882955+0000","last_fullsized":"2024-02-10T08:37:02.882955+0000","mapping_epoch":398,"log_start":"0'0","ondisk_log_start":"0'0","created":398,"last_epoch_clean":399,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_clean_scrub_stamp":"2024-02-10T08:36:44.122988+0000","log_size":916,"ondisk_log_size":916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":60030976,"num_objects":916,"num_object_clones":0,"num_object_copies":2748,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":916,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":916,"num_write_kb":58624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":381,"reported_epoch":400,"state":"active+clean","last_fresh":"2024-02-10T08:36:46.140995+0000","last_change":"2024-02-10T08:36:14.733903+0000","last_active":"2024-02-10T08:36:46.140995+0000","last_peered":"2024-02-10T08:36:46.140995+0000","last_clean":"2024-02-10T08:36:46.140995+0000","last_became_active":"2024-02-10T08:16:56.857856+0000","last_became_peered":"2024-02-10T08:16:56.857856+0000","last_unstale":"2024-02-10T08:36:46.140995+0000","last_undegraded":"2024-02-10T08:36:46.140995+0000","last_fullsized":"2024-02-10T08:36:46.140995+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:14.733839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:36:14.733839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"402'21","reported_seq":178,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.658870+0000","last_change":"2024-02-10T08:34:18.368803+0000","last_active":"2024-02-10T08:37:01.658870+0000","last_peered":"2024-02-10T08:37:01.658870+0000","last_clean":"2024-02-10T08:37:01.658870+0000","last_became_active":"2024-02-10T08:32:36.984195+0000","last_became_peered":"2024-02-10T08:32:36.984195+0000","last_unstale":"2024-02-10T08:37:01.658870+0000","last_undegraded":"2024-02-10T08:37:01.658870+0000","last_fullsized":"2024-02-10T08:37:01.658870+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'17","last_scrub_stamp":"2024-02-10T08:34:18.368690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:34:18.368690+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":29,"num_write":24,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":421,"reported_epoch":400,"state":"active+clean","last_fresh":"2024-02-10T08:36:46.139847+0000","last_change":"2024-02-10T08:34:23.885476+0000","last_active":"2024-02-10T08:36:46.139847+0000","last_peered":"2024-02-10T08:36:46.139847+0000","last_clean":"2024-02-10T08:36:46.139847+0000","last_became_active":"2024-02-10T08:31:33.884021+0000","last_became_peered":"2024-02-10T08:31:33.884021+0000","last_unstale":"2024-02-10T08:36:46.139847+0000","last_undegraded":"2024-02-10T08:36:46.139847+0000","last_fullsized":"2024-02-10T08:36:46.139847+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:23.885336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:11.681169+0000","last_clean_scrub_stamp":"2024-02-10T08:34:23.885336+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"63'5","reported_seq":1587,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.292561+0000","last_change":"2024-02-10T08:35:07.739783+0000","last_active":"2024-02-10T08:37:01.292561+0000","last_peered":"2024-02-10T08:37:01.292561+0000","last_clean":"2024-02-10T08:37:01.292561+0000","last_became_active":"2024-02-10T08:16:52.780989+0000","last_became_peered":"2024-02-10T08:16:52.780989+0000","last_unstale":"2024-02-10T08:37:01.292561+0000","last_undegraded":"2024-02-10T08:37:01.292561+0000","last_fullsized":"2024-02-10T08:37:01.292561+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'5","last_scrub_stamp":"2024-02-10T08:35:07.739620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:35:07.739620+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1199,"num_read_kb":1194,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":384,"reported_epoch":401,"state":"active+clean","last_fresh":"2024-02-10T08:36:54.262108+0000","last_change":"2024-02-10T08:33:17.442371+0000","last_active":"2024-02-10T08:36:54.262108+0000","last_peered":"2024-02-10T08:36:54.262108+0000","last_clean":"2024-02-10T08:36:54.262108+0000","last_became_active":"2024-02-10T08:21:58.549733+0000","last_became_peered":"2024-02-10T08:21:58.549733+0000","last_unstale":"2024-02-10T08:36:54.262108+0000","last_undegraded":"2024-02-10T08:36:54.262108+0000","last_fullsized":"2024-02-10T08:36:54.262108+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:17.442264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:11.750537+0000","last_clean_scrub_stamp":"2024-02-10T08:33:17.442264+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"402'950","reported_seq":961,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:02.920113+0000","last_change":"2024-02-10T08:36:45.372323+0000","last_active":"2024-02-10T08:37:02.920113+0000","last_peered":"2024-02-10T08:37:02.920113+0000","last_clean":"2024-02-10T08:37:02.920113+0000","last_became_active":"2024-02-10T08:36:45.371942+0000","last_became_peered":"2024-02-10T08:36:45.371942+0000","last_unstale":"2024-02-10T08:37:02.920113+0000","last_undegraded":"2024-02-10T08:37:02.920113+0000","last_fullsized":"2024-02-10T08:37:02.920113+0000","mapping_epoch":398,"log_start":"0'0","ondisk_log_start":"0'0","created":398,"last_epoch_clean":399,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_clean_scrub_stamp":"2024-02-10T08:36:44.122988+0000","log_size":950,"ondisk_log_size":950,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":62259200,"num_objects":950,"num_object_clones":0,"num_object_copies":2850,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":950,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":950,"num_write_kb":60800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":76,"reported_epoch":400,"state":"active+clean","last_fresh":"2024-02-10T08:36:46.862668+0000","last_change":"2024-02-10T08:34:13.094510+0000","last_active":"2024-02-10T08:36:46.862668+0000","last_peered":"2024-02-10T08:36:46.862668+0000","last_clean":"2024-02-10T08:36:46.862668+0000","last_became_active":"2024-02-10T08:32:36.976141+0000","last_became_peered":"2024-02-10T08:32:36.976141+0000","last_unstale":"2024-02-10T08:36:46.862668+0000","last_undegraded":"2024-02-10T08:36:46.862668+0000","last_fullsized":"2024-02-10T08:36:46.862668+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:13.094426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:34:13.094426+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"402'54","reported_seq":773,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.973414+0000","last_change":"2024-02-10T08:36:26.948186+0000","last_active":"2024-02-10T08:37:01.973414+0000","last_peered":"2024-02-10T08:37:01.973414+0000","last_clean":"2024-02-10T08:37:01.973414+0000","last_became_active":"2024-02-10T08:31:33.904487+0000","last_became_peered":"2024-02-10T08:31:33.904487+0000","last_unstale":"2024-02-10T08:37:01.973414+0000","last_undegraded":"2024-02-10T08:37:01.973414+0000","last_fullsized":"2024-02-10T08:37:01.973414+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":315,"parent":"0.0","parent_split_bits":0,"last_scrub":"314'42","last_scrub_stamp":"2024-02-10T08:36:26.948002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:36:26.948002+0000","log_size":54,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":84,"num_read_kb":69,"num_write":50,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":716,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":380,"reported_epoch":401,"state":"active+clean","last_fresh":"2024-02-10T08:36:54.123021+0000","last_change":"2024-02-10T08:33:15.952668+0000","last_active":"2024-02-10T08:36:54.123021+0000","last_peered":"2024-02-10T08:36:54.123021+0000","last_clean":"2024-02-10T08:36:54.123021+0000","last_became_active":"2024-02-10T08:16:52.791027+0000","last_became_peered":"2024-02-10T08:16:52.791027+0000","last_unstale":"2024-02-10T08:36:54.123021+0000","last_undegraded":"2024-02-10T08:36:54.123021+0000","last_fullsized":"2024-02-10T08:36:54.123021+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:15.952580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:33:15.952580+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":403,"reported_epoch":400,"state":"active+clean","last_fresh":"2024-02-10T08:36:46.863557+0000","last_change":"2024-02-10T08:36:04.197245+0000","last_active":"2024-02-10T08:36:46.863557+0000","last_peered":"2024-02-10T08:36:46.863557+0000","last_clean":"2024-02-10T08:36:46.863557+0000","last_became_active":"2024-02-10T08:31:33.884295+0000","last_became_peered":"2024-02-10T08:31:33.884295+0000","last_unstale":"2024-02-10T08:36:46.863557+0000","last_undegraded":"2024-02-10T08:36:46.863557+0000","last_fullsized":"2024-02-10T08:36:46.863557+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:04.197143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:36:04.197143+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.d","version":"401'131","reported_seq":142,"reported_epoch":401,"state":"active+clean","last_fresh":"2024-02-10T08:36:58.071693+0000","last_change":"2024-02-10T08:36:45.142141+0000","last_active":"2024-02-10T08:36:58.071693+0000","last_peered":"2024-02-10T08:36:58.071693+0000","last_clean":"2024-02-10T08:36:58.071693+0000","last_became_active":"2024-02-10T08:36:45.141858+0000","last_became_peered":"2024-02-10T08:36:45.141858+0000","last_unstale":"2024-02-10T08:36:58.071693+0000","last_undegraded":"2024-02-10T08:36:58.071693+0000","last_fullsized":"2024-02-10T08:36:58.071693+0000","mapping_epoch":398,"log_start":"0'0","ondisk_log_start":"0'0","created":398,"last_epoch_clean":399,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_clean_scrub_stamp":"2024-02-10T08:36:44.122988+0000","log_size":131,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8585216,"num_objects":131,"num_object_clones":0,"num_object_copies":393,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":131,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":8384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,6],"acting":[2,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"255'12","reported_seq":343,"reported_epoch":401,"state":"active+clean","last_fresh":"2024-02-10T08:36:54.820962+0000","last_change":"2024-02-10T08:36:05.139333+0000","last_active":"2024-02-10T08:36:54.820962+0000","last_peered":"2024-02-10T08:36:54.820962+0000","last_clean":"2024-02-10T08:36:54.820962+0000","last_became_active":"2024-02-10T08:28:25.952468+0000","last_became_peered":"2024-02-10T08:28:25.952468+0000","last_unstale":"2024-02-10T08:36:54.820962+0000","last_undegraded":"2024-02-10T08:36:54.820962+0000","last_fullsized":"2024-02-10T08:36:54.820962+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'12","last_scrub_stamp":"2024-02-10T08:36:05.139231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:36:05.139231+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"402'30","reported_seq":439,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.968577+0000","last_change":"2024-02-10T08:36:56.858833+0000","last_active":"2024-02-10T08:37:01.968577+0000","last_peered":"2024-02-10T08:37:01.968577+0000","last_clean":"2024-02-10T08:37:01.968577+0000","last_became_active":"2024-02-10T08:20:46.408495+0000","last_became_peered":"2024-02-10T08:20:46.408495+0000","last_unstale":"2024-02-10T08:37:01.968577+0000","last_undegraded":"2024-02-10T08:37:01.968577+0000","last_fullsized":"2024-02-10T08:37:01.968577+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'20","last_scrub_stamp":"2024-02-10T08:36:56.858641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:36:56.858641+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":45,"num_read_kb":40,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":399,"reported_epoch":401,"state":"active+clean","last_fresh":"2024-02-10T08:36:54.820434+0000","last_change":"2024-02-10T08:36:18.737230+0000","last_active":"2024-02-10T08:36:54.820434+0000","last_peered":"2024-02-10T08:36:54.820434+0000","last_clean":"2024-02-10T08:36:54.820434+0000","last_became_active":"2024-02-10T08:28:02.760784+0000","last_became_peered":"2024-02-10T08:28:02.760784+0000","last_unstale":"2024-02-10T08:36:54.820434+0000","last_undegraded":"2024-02-10T08:36:54.820434+0000","last_fullsized":"2024-02-10T08:36:54.820434+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:18.737167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:36:18.737167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":299,"reported_epoch":400,"state":"active+clean","last_fresh":"2024-02-10T08:36:46.860992+0000","last_change":"2024-02-10T08:34:11.146000+0000","last_active":"2024-02-10T08:36:46.860992+0000","last_peered":"2024-02-10T08:36:46.860992+0000","last_clean":"2024-02-10T08:36:46.860992+0000","last_became_active":"2024-02-10T08:28:25.950240+0000","last_became_peered":"2024-02-10T08:28:25.950240+0000","last_unstale":"2024-02-10T08:36:46.860992+0000","last_undegraded":"2024-02-10T08:36:46.860992+0000","last_fullsized":"2024-02-10T08:36:46.860992+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:11.145907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:34:11.145907+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"401'204","reported_seq":215,"reported_epoch":401,"state":"active+clean","last_fresh":"2024-02-10T08:36:58.385933+0000","last_change":"2024-02-10T08:36:45.141266+0000","last_active":"2024-02-10T08:36:58.385933+0000","last_peered":"2024-02-10T08:36:58.385933+0000","last_clean":"2024-02-10T08:36:58.385933+0000","last_became_active":"2024-02-10T08:36:45.140961+0000","last_became_peered":"2024-02-10T08:36:45.140961+0000","last_unstale":"2024-02-10T08:36:58.385933+0000","last_undegraded":"2024-02-10T08:36:58.385933+0000","last_fullsized":"2024-02-10T08:36:58.385933+0000","mapping_epoch":398,"log_start":"0'0","ondisk_log_start":"0'0","created":398,"last_epoch_clean":399,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_clean_scrub_stamp":"2024-02-10T08:36:44.122988+0000","log_size":204,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13369344,"num_objects":204,"num_object_clones":0,"num_object_copies":612,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":204,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":204,"num_write_kb":13056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":399,"reported_epoch":400,"state":"active+clean","last_fresh":"2024-02-10T08:36:46.139617+0000","last_change":"2024-02-10T08:36:02.649289+0000","last_active":"2024-02-10T08:36:46.139617+0000","last_peered":"2024-02-10T08:36:46.139617+0000","last_clean":"2024-02-10T08:36:46.139617+0000","last_became_active":"2024-02-10T08:28:02.777637+0000","last_became_peered":"2024-02-10T08:28:02.777637+0000","last_unstale":"2024-02-10T08:36:46.139617+0000","last_undegraded":"2024-02-10T08:36:46.139617+0000","last_fullsized":"2024-02-10T08:36:46.139617+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:02.649176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:36:02.649176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"225'23","reported_seq":439,"reported_epoch":400,"state":"active+clean","last_fresh":"2024-02-10T08:36:46.862216+0000","last_change":"2024-02-10T08:34:19.175648+0000","last_active":"2024-02-10T08:36:46.862216+0000","last_peered":"2024-02-10T08:36:46.862216+0000","last_clean":"2024-02-10T08:36:46.862216+0000","last_became_active":"2024-02-10T08:31:33.884516+0000","last_became_peered":"2024-02-10T08:31:33.884516+0000","last_unstale":"2024-02-10T08:36:46.862216+0000","last_undegraded":"2024-02-10T08:36:46.862216+0000","last_fullsized":"2024-02-10T08:36:46.862216+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'23","last_scrub_stamp":"2024-02-10T08:34:19.175575+0000","last_deep_scrub":"82'17","last_deep_scrub_stamp":"2024-02-10T08:18:21.015873+0000","last_clean_scrub_stamp":"2024-02-10T08:34:19.175575+0000","log_size":23,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":25,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"55'2","reported_seq":395,"reported_epoch":400,"state":"active+clean","last_fresh":"2024-02-10T08:36:46.863496+0000","last_change":"2024-02-10T08:34:27.070443+0000","last_active":"2024-02-10T08:36:46.863496+0000","last_peered":"2024-02-10T08:36:46.863496+0000","last_clean":"2024-02-10T08:36:46.863496+0000","last_became_active":"2024-02-10T08:28:02.768279+0000","last_became_peered":"2024-02-10T08:28:02.768279+0000","last_unstale":"2024-02-10T08:36:46.863496+0000","last_undegraded":"2024-02-10T08:36:46.863496+0000","last_fullsized":"2024-02-10T08:36:46.863496+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'2","last_scrub_stamp":"2024-02-10T08:34:27.070328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:34:27.070328+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":184,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":292,"reported_epoch":401,"state":"active+clean","last_fresh":"2024-02-10T08:36:54.261928+0000","last_change":"2024-02-10T08:35:12.451166+0000","last_active":"2024-02-10T08:36:54.261928+0000","last_peered":"2024-02-10T08:36:54.261928+0000","last_clean":"2024-02-10T08:36:54.261928+0000","last_became_active":"2024-02-10T08:30:24.073077+0000","last_became_peered":"2024-02-10T08:30:24.073077+0000","last_unstale":"2024-02-10T08:36:54.261928+0000","last_undegraded":"2024-02-10T08:36:54.261928+0000","last_fullsized":"2024-02-10T08:36:54.261928+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:35:12.451079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:35:12.451079+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"225'15","reported_seq":86,"reported_epoch":400,"state":"active+clean","last_fresh":"2024-02-10T08:36:46.863425+0000","last_change":"2024-02-10T08:33:19.722178+0000","last_active":"2024-02-10T08:36:46.863425+0000","last_peered":"2024-02-10T08:36:46.863425+0000","last_clean":"2024-02-10T08:36:46.863425+0000","last_became_active":"2024-02-10T08:32:36.982716+0000","last_became_peered":"2024-02-10T08:32:36.982716+0000","last_unstale":"2024-02-10T08:36:46.863425+0000","last_undegraded":"2024-02-10T08:36:46.863425+0000","last_fullsized":"2024-02-10T08:36:46.863425+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'15","last_scrub_stamp":"2024-02-10T08:33:19.722084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:33:19.722084+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"55'1","reported_seq":455,"reported_epoch":400,"state":"active+clean","last_fresh":"2024-02-10T08:36:46.139532+0000","last_change":"2024-02-10T08:36:11.767288+0000","last_active":"2024-02-10T08:36:46.139532+0000","last_peered":"2024-02-10T08:36:46.139532+0000","last_clean":"2024-02-10T08:36:46.139532+0000","last_became_active":"2024-02-10T08:28:02.778857+0000","last_became_peered":"2024-02-10T08:28:02.778857+0000","last_unstale":"2024-02-10T08:36:46.139532+0000","last_undegraded":"2024-02-10T08:36:46.139532+0000","last_fullsized":"2024-02-10T08:36:46.139532+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'1","last_scrub_stamp":"2024-02-10T08:36:11.767200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:36:11.767200+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":716,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":329,"reported_epoch":401,"state":"active+clean","last_fresh":"2024-02-10T08:36:57.854289+0000","last_change":"2024-02-10T08:36:57.854254+0000","last_active":"2024-02-10T08:36:57.854289+0000","last_peered":"2024-02-10T08:36:57.854289+0000","last_clean":"2024-02-10T08:36:57.854289+0000","last_became_active":"2024-02-10T08:31:33.891489+0000","last_became_peered":"2024-02-10T08:31:33.891489+0000","last_unstale":"2024-02-10T08:36:57.854289+0000","last_undegraded":"2024-02-10T08:36:57.854289+0000","last_fullsized":"2024-02-10T08:36:57.854289+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:57.854170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:36:57.854170+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":243,"reported_epoch":400,"state":"active+clean","last_fresh":"2024-02-10T08:36:46.863132+0000","last_change":"2024-02-10T08:34:12.117475+0000","last_active":"2024-02-10T08:36:46.863132+0000","last_peered":"2024-02-10T08:36:46.863132+0000","last_clean":"2024-02-10T08:36:46.863132+0000","last_became_active":"2024-02-10T08:28:25.999252+0000","last_became_peered":"2024-02-10T08:28:25.999252+0000","last_unstale":"2024-02-10T08:36:46.863132+0000","last_undegraded":"2024-02-10T08:36:46.863132+0000","last_fullsized":"2024-02-10T08:36:46.863132+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:12.117379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:34:12.117379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"402'21","reported_seq":362,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.835894+0000","last_change":"2024-02-10T08:36:24.509690+0000","last_active":"2024-02-10T08:37:01.835894+0000","last_peered":"2024-02-10T08:37:01.835894+0000","last_clean":"2024-02-10T08:37:01.835894+0000","last_became_active":"2024-02-10T08:31:33.891813+0000","last_became_peered":"2024-02-10T08:31:33.891813+0000","last_unstale":"2024-02-10T08:37:01.835894+0000","last_undegraded":"2024-02-10T08:37:01.835894+0000","last_fullsized":"2024-02-10T08:37:01.835894+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'15","last_scrub_stamp":"2024-02-10T08:36:24.509584+0000","last_deep_scrub":"223'9","last_deep_scrub_stamp":"2024-02-10T08:26:33.158025+0000","last_clean_scrub_stamp":"2024-02-10T08:36:24.509584+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":26,"num_read_kb":23,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":452,"reported_epoch":401,"state":"active+clean","last_fresh":"2024-02-10T08:36:57.007067+0000","last_change":"2024-02-10T08:36:57.007034+0000","last_active":"2024-02-10T08:36:57.007067+0000","last_peered":"2024-02-10T08:36:57.007067+0000","last_clean":"2024-02-10T08:36:57.007067+0000","last_became_active":"2024-02-10T08:31:46.053553+0000","last_became_peered":"2024-02-10T08:31:46.053553+0000","last_unstale":"2024-02-10T08:36:57.007067+0000","last_undegraded":"2024-02-10T08:36:57.007067+0000","last_fullsized":"2024-02-10T08:36:57.007067+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:57.006964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:36:57.006964+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":376,"reported_epoch":401,"state":"active+clean","last_fresh":"2024-02-10T08:36:54.123576+0000","last_change":"2024-02-10T08:34:28.320611+0000","last_active":"2024-02-10T08:36:54.123576+0000","last_peered":"2024-02-10T08:36:54.123576+0000","last_clean":"2024-02-10T08:36:54.123576+0000","last_became_active":"2024-02-10T08:16:56.863948+0000","last_became_peered":"2024-02-10T08:16:56.863948+0000","last_unstale":"2024-02-10T08:36:54.123576+0000","last_undegraded":"2024-02-10T08:36:54.123576+0000","last_fullsized":"2024-02-10T08:36:54.123576+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:28.320524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:34:28.320524+0000","last_clean_scrub_stamp":"2024-02-10T08:34:28.320524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":384,"reported_epoch":401,"state":"active+clean","last_fresh":"2024-02-10T08:36:54.261817+0000","last_change":"2024-02-10T08:33:32.430824+0000","last_active":"2024-02-10T08:36:54.261817+0000","last_peered":"2024-02-10T08:36:54.261817+0000","last_clean":"2024-02-10T08:36:54.261817+0000","last_became_active":"2024-02-10T08:20:46.398903+0000","last_became_peered":"2024-02-10T08:20:46.398903+0000","last_unstale":"2024-02-10T08:36:54.261817+0000","last_undegraded":"2024-02-10T08:36:54.261817+0000","last_fullsized":"2024-02-10T08:36:54.261817+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:32.430721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:33:32.430721+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"402'30","reported_seq":343,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.929450+0000","last_change":"2024-02-10T08:35:17.746698+0000","last_active":"2024-02-10T08:37:01.929450+0000","last_peered":"2024-02-10T08:37:01.929450+0000","last_clean":"2024-02-10T08:37:01.929450+0000","last_became_active":"2024-02-10T08:22:23.534081+0000","last_became_peered":"2024-02-10T08:22:23.534081+0000","last_unstale":"2024-02-10T08:37:01.929450+0000","last_undegraded":"2024-02-10T08:37:01.929450+0000","last_fullsized":"2024-02-10T08:37:01.929450+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'20","last_scrub_stamp":"2024-02-10T08:35:17.746555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:35:17.746555+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":39,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":385,"reported_epoch":401,"state":"active+clean","last_fresh":"2024-02-10T08:36:54.123164+0000","last_change":"2024-02-10T08:36:03.081631+0000","last_active":"2024-02-10T08:36:54.123164+0000","last_peered":"2024-02-10T08:36:54.123164+0000","last_clean":"2024-02-10T08:36:54.123164+0000","last_became_active":"2024-02-10T08:16:52.789834+0000","last_became_peered":"2024-02-10T08:16:52.789834+0000","last_unstale":"2024-02-10T08:36:54.123164+0000","last_undegraded":"2024-02-10T08:36:54.123164+0000","last_fullsized":"2024-02-10T08:36:54.123164+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:03.081540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:36:03.081540+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"244'12","reported_seq":672,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.178629+0000","last_change":"2024-02-10T08:35:24.069288+0000","last_active":"2024-02-10T08:37:01.178629+0000","last_peered":"2024-02-10T08:37:01.178629+0000","last_clean":"2024-02-10T08:37:01.178629+0000","last_became_active":"2024-02-10T08:28:02.776097+0000","last_became_peered":"2024-02-10T08:28:02.776097+0000","last_unstale":"2024-02-10T08:37:01.178629+0000","last_undegraded":"2024-02-10T08:37:01.178629+0000","last_fullsized":"2024-02-10T08:37:01.178629+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"244'12","last_scrub_stamp":"2024-02-10T08:35:24.069224+0000","last_deep_scrub":"244'12","last_deep_scrub_stamp":"2024-02-10T08:35:24.069224+0000","last_clean_scrub_stamp":"2024-02-10T08:35:24.069224+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":76,"reported_epoch":400,"state":"active+clean","last_fresh":"2024-02-10T08:36:46.863482+0000","last_change":"2024-02-10T08:33:07.663592+0000","last_active":"2024-02-10T08:36:46.863482+0000","last_peered":"2024-02-10T08:36:46.863482+0000","last_clean":"2024-02-10T08:36:46.863482+0000","last_became_active":"2024-02-10T08:32:36.983153+0000","last_became_peered":"2024-02-10T08:32:36.983153+0000","last_unstale":"2024-02-10T08:36:46.863482+0000","last_undegraded":"2024-02-10T08:36:46.863482+0000","last_fullsized":"2024-02-10T08:36:46.863482+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:07.663498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:05.662947+0000","last_clean_scrub_stamp":"2024-02-10T08:33:07.663498+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"402'25","reported_seq":421,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.957390+0000","last_change":"2024-02-10T08:36:58.072950+0000","last_active":"2024-02-10T08:37:01.957390+0000","last_peered":"2024-02-10T08:37:01.957390+0000","last_clean":"2024-02-10T08:37:01.957390+0000","last_became_active":"2024-02-10T08:16:55.204734+0000","last_became_peered":"2024-02-10T08:16:55.204734+0000","last_unstale":"2024-02-10T08:37:01.957390+0000","last_undegraded":"2024-02-10T08:37:01.957390+0000","last_fullsized":"2024-02-10T08:37:01.957390+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'19","last_scrub_stamp":"2024-02-10T08:36:58.072861+0000","last_deep_scrub":"213'13","last_deep_scrub_stamp":"2024-02-10T08:25:43.713333+0000","last_clean_scrub_stamp":"2024-02-10T08:36:58.072861+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":76,"reported_epoch":400,"state":"active+clean","last_fresh":"2024-02-10T08:36:46.862321+0000","last_change":"2024-02-10T08:36:11.052018+0000","last_active":"2024-02-10T08:36:46.862321+0000","last_peered":"2024-02-10T08:36:46.862321+0000","last_clean":"2024-02-10T08:36:46.862321+0000","last_became_active":"2024-02-10T08:32:36.980715+0000","last_became_peered":"2024-02-10T08:32:36.980715+0000","last_unstale":"2024-02-10T08:36:46.862321+0000","last_undegraded":"2024-02-10T08:36:46.862321+0000","last_fullsized":"2024-02-10T08:36:46.862321+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:11.051916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:36:11.051916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"314'11","reported_seq":508,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.184898+0000","last_change":"2024-02-10T08:36:23.462351+0000","last_active":"2024-02-10T08:37:01.184898+0000","last_peered":"2024-02-10T08:37:01.184898+0000","last_clean":"2024-02-10T08:37:01.184898+0000","last_became_active":"2024-02-10T08:31:33.885840+0000","last_became_peered":"2024-02-10T08:31:33.885840+0000","last_unstale":"2024-02-10T08:37:01.184898+0000","last_undegraded":"2024-02-10T08:37:01.184898+0000","last_fullsized":"2024-02-10T08:37:01.184898+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"314'11","last_scrub_stamp":"2024-02-10T08:36:23.462220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:36:23.462220+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":362,"reported_epoch":400,"state":"active+clean","last_fresh":"2024-02-10T08:36:46.861156+0000","last_change":"2024-02-10T08:35:12.180908+0000","last_active":"2024-02-10T08:36:46.861156+0000","last_peered":"2024-02-10T08:36:46.861156+0000","last_clean":"2024-02-10T08:36:46.861156+0000","last_became_active":"2024-02-10T08:20:46.395788+0000","last_became_peered":"2024-02-10T08:20:46.395788+0000","last_unstale":"2024-02-10T08:36:46.861156+0000","last_undegraded":"2024-02-10T08:36:46.861156+0000","last_fullsized":"2024-02-10T08:36:46.861156+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:35:12.180812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:35:12.180812+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"225'15","reported_seq":388,"reported_epoch":400,"state":"active+clean","last_fresh":"2024-02-10T08:36:46.862271+0000","last_change":"2024-02-10T08:36:03.126980+0000","last_active":"2024-02-10T08:36:46.862271+0000","last_peered":"2024-02-10T08:36:46.862271+0000","last_clean":"2024-02-10T08:36:46.862271+0000","last_became_active":"2024-02-10T08:28:25.952354+0000","last_became_peered":"2024-02-10T08:28:25.952354+0000","last_unstale":"2024-02-10T08:36:46.862271+0000","last_undegraded":"2024-02-10T08:36:46.862271+0000","last_fullsized":"2024-02-10T08:36:46.862271+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'15","last_scrub_stamp":"2024-02-10T08:36:03.126898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:36:03.126898+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":392,"reported_epoch":401,"state":"active+clean","last_fresh":"2024-02-10T08:36:54.574117+0000","last_change":"2024-02-10T08:35:25.826895+0000","last_active":"2024-02-10T08:36:54.574117+0000","last_peered":"2024-02-10T08:36:54.574117+0000","last_clean":"2024-02-10T08:36:54.574117+0000","last_became_active":"2024-02-10T08:16:52.786213+0000","last_became_peered":"2024-02-10T08:16:52.786213+0000","last_unstale":"2024-02-10T08:36:54.574117+0000","last_undegraded":"2024-02-10T08:36:54.574117+0000","last_fullsized":"2024-02-10T08:36:54.574117+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:35:25.826812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:35:25.826812+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":208,"reported_epoch":400,"state":"active+clean","last_fresh":"2024-02-10T08:36:46.862694+0000","last_change":"2024-02-10T08:33:28.822022+0000","last_active":"2024-02-10T08:36:46.862694+0000","last_peered":"2024-02-10T08:36:46.862694+0000","last_clean":"2024-02-10T08:36:46.862694+0000","last_became_active":"2024-02-10T08:28:25.950221+0000","last_became_peered":"2024-02-10T08:28:25.950221+0000","last_unstale":"2024-02-10T08:36:46.862694+0000","last_undegraded":"2024-02-10T08:36:46.862694+0000","last_fullsized":"2024-02-10T08:36:46.862694+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:28.821928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:33:28.821928+0000","last_clean_scrub_stamp":"2024-02-10T08:33:28.821928+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":214,"reported_epoch":400,"state":"active+clean","last_fresh":"2024-02-10T08:36:46.861345+0000","last_change":"2024-02-10T08:33:22.771214+0000","last_active":"2024-02-10T08:36:46.861345+0000","last_peered":"2024-02-10T08:36:46.861345+0000","last_clean":"2024-02-10T08:36:46.861345+0000","last_became_active":"2024-02-10T08:30:24.070440+0000","last_became_peered":"2024-02-10T08:30:24.070440+0000","last_unstale":"2024-02-10T08:36:46.861345+0000","last_undegraded":"2024-02-10T08:36:46.861345+0000","last_fullsized":"2024-02-10T08:36:46.861345+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:22.771132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:33:22.771132+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"225'24","reported_seq":419,"reported_epoch":400,"state":"active+clean","last_fresh":"2024-02-10T08:36:46.860922+0000","last_change":"2024-02-10T08:36:23.221000+0000","last_active":"2024-02-10T08:36:46.860922+0000","last_peered":"2024-02-10T08:36:46.860922+0000","last_clean":"2024-02-10T08:36:46.860922+0000","last_became_active":"2024-02-10T08:20:46.396130+0000","last_became_peered":"2024-02-10T08:20:46.396130+0000","last_unstale":"2024-02-10T08:36:46.860922+0000","last_undegraded":"2024-02-10T08:36:46.860922+0000","last_fullsized":"2024-02-10T08:36:46.860922+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'24","last_scrub_stamp":"2024-02-10T08:36:23.220919+0000","last_deep_scrub":"201'16","last_deep_scrub_stamp":"2024-02-10T08:24:49.177357+0000","last_clean_scrub_stamp":"2024-02-10T08:36:23.220919+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":403,"reported_epoch":401,"state":"active+clean","last_fresh":"2024-02-10T08:36:54.821826+0000","last_change":"2024-02-10T08:36:07.789097+0000","last_active":"2024-02-10T08:36:54.821826+0000","last_peered":"2024-02-10T08:36:54.821826+0000","last_clean":"2024-02-10T08:36:54.821826+0000","last_became_active":"2024-02-10T08:32:36.974379+0000","last_became_peered":"2024-02-10T08:32:36.974379+0000","last_unstale":"2024-02-10T08:36:54.821826+0000","last_undegraded":"2024-02-10T08:36:54.821826+0000","last_fullsized":"2024-02-10T08:36:54.821826+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:07.788932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:36:07.788932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":397,"reported_epoch":401,"state":"active+clean","last_fresh":"2024-02-10T08:36:54.822227+0000","last_change":"2024-02-10T08:36:05.716136+0000","last_active":"2024-02-10T08:36:54.822227+0000","last_peered":"2024-02-10T08:36:54.822227+0000","last_clean":"2024-02-10T08:36:54.822227+0000","last_became_active":"2024-02-10T08:31:33.893973+0000","last_became_peered":"2024-02-10T08:31:33.893973+0000","last_unstale":"2024-02-10T08:36:54.822227+0000","last_undegraded":"2024-02-10T08:36:54.822227+0000","last_fullsized":"2024-02-10T08:36:54.822227+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:05.715963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:36:05.715963+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":76,"reported_epoch":400,"state":"active+clean","last_fresh":"2024-02-10T08:36:46.861628+0000","last_change":"2024-02-10T08:34:38.015567+0000","last_active":"2024-02-10T08:36:46.861628+0000","last_peered":"2024-02-10T08:36:46.861628+0000","last_clean":"2024-02-10T08:36:46.861628+0000","last_became_active":"2024-02-10T08:32:36.979093+0000","last_became_peered":"2024-02-10T08:32:36.979093+0000","last_unstale":"2024-02-10T08:36:46.861628+0000","last_undegraded":"2024-02-10T08:36:46.861628+0000","last_fullsized":"2024-02-10T08:36:46.861628+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:38.015515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:34:38.015515+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,5],"acting":[0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"402'12","reported_seq":316,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.245001+0000","last_change":"2024-02-10T08:35:08.720411+0000","last_active":"2024-02-10T08:37:01.245001+0000","last_peered":"2024-02-10T08:37:01.245001+0000","last_clean":"2024-02-10T08:37:01.245001+0000","last_became_active":"2024-02-10T08:22:23.522936+0000","last_became_peered":"2024-02-10T08:22:23.522936+0000","last_unstale":"2024-02-10T08:37:01.245001+0000","last_undegraded":"2024-02-10T08:37:01.245001+0000","last_fullsized":"2024-02-10T08:37:01.245001+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'8","last_scrub_stamp":"2024-02-10T08:35:08.720332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:35:08.720332+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,6],"acting":[1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":385,"reported_epoch":401,"state":"active+clean","last_fresh":"2024-02-10T08:36:54.123656+0000","last_change":"2024-02-10T08:33:22.025841+0000","last_active":"2024-02-10T08:36:54.123656+0000","last_peered":"2024-02-10T08:36:54.123656+0000","last_clean":"2024-02-10T08:36:54.123656+0000","last_became_active":"2024-02-10T08:16:52.788704+0000","last_became_peered":"2024-02-10T08:16:52.788704+0000","last_unstale":"2024-02-10T08:36:54.123656+0000","last_undegraded":"2024-02-10T08:36:54.123656+0000","last_fullsized":"2024-02-10T08:36:54.123656+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:22.025769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:33:22.025769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":391,"reported_epoch":401,"state":"active+clean","last_fresh":"2024-02-10T08:36:54.572835+0000","last_change":"2024-02-10T08:35:15.873051+0000","last_active":"2024-02-10T08:36:54.572835+0000","last_peered":"2024-02-10T08:36:54.572835+0000","last_clean":"2024-02-10T08:36:54.572835+0000","last_became_active":"2024-02-10T08:20:46.397495+0000","last_became_peered":"2024-02-10T08:20:46.397495+0000","last_unstale":"2024-02-10T08:36:54.572835+0000","last_undegraded":"2024-02-10T08:36:54.572835+0000","last_fullsized":"2024-02-10T08:36:54.572835+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:35:15.872974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:35:15.872974+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":398,"reported_epoch":401,"state":"active+clean","last_fresh":"2024-02-10T08:36:54.261639+0000","last_change":"2024-02-10T08:34:38.328749+0000","last_active":"2024-02-10T08:36:54.261639+0000","last_peered":"2024-02-10T08:36:54.261639+0000","last_clean":"2024-02-10T08:36:54.261639+0000","last_became_active":"2024-02-10T08:30:24.064419+0000","last_became_peered":"2024-02-10T08:30:24.064419+0000","last_unstale":"2024-02-10T08:36:54.261639+0000","last_undegraded":"2024-02-10T08:36:54.261639+0000","last_fullsized":"2024-02-10T08:36:54.261639+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:38.328641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:27.276490+0000","last_clean_scrub_stamp":"2024-02-10T08:34:38.328641+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"402'27","reported_seq":341,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:02.048911+0000","last_change":"2024-02-10T08:36:16.410241+0000","last_active":"2024-02-10T08:37:02.048911+0000","last_peered":"2024-02-10T08:37:02.048911+0000","last_clean":"2024-02-10T08:37:02.048911+0000","last_became_active":"2024-02-10T08:22:23.526198+0000","last_became_peered":"2024-02-10T08:22:23.526198+0000","last_unstale":"2024-02-10T08:37:02.048911+0000","last_undegraded":"2024-02-10T08:37:02.048911+0000","last_fullsized":"2024-02-10T08:37:02.048911+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'19","last_scrub_stamp":"2024-02-10T08:36:16.410126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:36:16.410126+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":36,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":385,"reported_epoch":401,"state":"active+clean","last_fresh":"2024-02-10T08:36:54.574242+0000","last_change":"2024-02-10T08:35:11.849852+0000","last_active":"2024-02-10T08:36:54.574242+0000","last_peered":"2024-02-10T08:36:54.574242+0000","last_clean":"2024-02-10T08:36:54.574242+0000","last_became_active":"2024-02-10T08:16:52.788629+0000","last_became_peered":"2024-02-10T08:16:52.788629+0000","last_unstale":"2024-02-10T08:36:54.574242+0000","last_undegraded":"2024-02-10T08:36:54.574242+0000","last_fullsized":"2024-02-10T08:36:54.574242+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:35:11.849772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:38.360929+0000","last_clean_scrub_stamp":"2024-02-10T08:35:11.849772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":391,"reported_epoch":401,"state":"active+clean","last_fresh":"2024-02-10T08:36:54.261820+0000","last_change":"2024-02-10T08:34:37.281857+0000","last_active":"2024-02-10T08:36:54.261820+0000","last_peered":"2024-02-10T08:36:54.261820+0000","last_clean":"2024-02-10T08:36:54.261820+0000","last_became_active":"2024-02-10T08:20:46.399838+0000","last_became_peered":"2024-02-10T08:20:46.399838+0000","last_unstale":"2024-02-10T08:36:54.261820+0000","last_undegraded":"2024-02-10T08:36:54.261820+0000","last_fullsized":"2024-02-10T08:36:54.261820+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:37.281763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:34:37.281763+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":76,"reported_epoch":400,"state":"active+clean","last_fresh":"2024-02-10T08:36:46.862415+0000","last_change":"2024-02-10T08:34:30.191894+0000","last_active":"2024-02-10T08:36:46.862415+0000","last_peered":"2024-02-10T08:36:46.862415+0000","last_clean":"2024-02-10T08:36:46.862415+0000","last_became_active":"2024-02-10T08:32:36.982778+0000","last_became_peered":"2024-02-10T08:32:36.982778+0000","last_unstale":"2024-02-10T08:36:46.862415+0000","last_undegraded":"2024-02-10T08:36:46.862415+0000","last_fullsized":"2024-02-10T08:36:46.862415+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:30.191790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:34:30.191790+0000","last_clean_scrub_stamp":"2024-02-10T08:34:30.191790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"225'25","reported_seq":490,"reported_epoch":400,"state":"active+clean","last_fresh":"2024-02-10T08:36:46.863578+0000","last_change":"2024-02-10T08:36:22.029398+0000","last_active":"2024-02-10T08:36:46.863578+0000","last_peered":"2024-02-10T08:36:46.863578+0000","last_clean":"2024-02-10T08:36:46.863578+0000","last_became_active":"2024-02-10T08:31:33.879680+0000","last_became_peered":"2024-02-10T08:31:33.879680+0000","last_unstale":"2024-02-10T08:36:46.863578+0000","last_undegraded":"2024-02-10T08:36:46.863578+0000","last_fullsized":"2024-02-10T08:36:46.863578+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'25","last_scrub_stamp":"2024-02-10T08:36:22.029278+0000","last_deep_scrub":"225'25","last_deep_scrub_stamp":"2024-02-10T08:36:22.029278+0000","last_clean_scrub_stamp":"2024-02-10T08:36:22.029278+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":24,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":395,"reported_epoch":401,"state":"active+clean","last_fresh":"2024-02-10T08:36:54.122754+0000","last_change":"2024-02-10T08:35:10.165815+0000","last_active":"2024-02-10T08:36:54.122754+0000","last_peered":"2024-02-10T08:36:54.122754+0000","last_clean":"2024-02-10T08:36:54.122754+0000","last_became_active":"2024-02-10T08:20:46.392466+0000","last_became_peered":"2024-02-10T08:20:46.392466+0000","last_unstale":"2024-02-10T08:36:54.122754+0000","last_undegraded":"2024-02-10T08:36:54.122754+0000","last_fullsized":"2024-02-10T08:36:54.122754+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:35:10.165751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:29:26.072031+0000","last_clean_scrub_stamp":"2024-02-10T08:35:10.165751+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1f","version":"111'11","reported_seq":655,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.184720+0000","last_change":"2024-02-10T08:36:26.882591+0000","last_active":"2024-02-10T08:37:01.184720+0000","last_peered":"2024-02-10T08:37:01.184720+0000","last_clean":"2024-02-10T08:37:01.184720+0000","last_became_active":"2024-02-10T08:20:46.402663+0000","last_became_peered":"2024-02-10T08:20:46.402663+0000","last_unstale":"2024-02-10T08:37:01.184720+0000","last_undegraded":"2024-02-10T08:37:01.184720+0000","last_fullsized":"2024-02-10T08:37:01.184720+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'11","last_scrub_stamp":"2024-02-10T08:36:26.882513+0000","last_deep_scrub":"111'11","last_deep_scrub_stamp":"2024-02-10T08:36:26.882513+0000","last_clean_scrub_stamp":"2024-02-10T08:36:26.882513+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"87'2","reported_seq":376,"reported_epoch":401,"state":"active+clean","last_fresh":"2024-02-10T08:36:54.262037+0000","last_change":"2024-02-10T08:33:29.353243+0000","last_active":"2024-02-10T08:36:54.262037+0000","last_peered":"2024-02-10T08:36:54.262037+0000","last_clean":"2024-02-10T08:36:54.262037+0000","last_became_active":"2024-02-10T08:16:58.859047+0000","last_became_peered":"2024-02-10T08:16:58.859047+0000","last_unstale":"2024-02-10T08:36:54.262037+0000","last_undegraded":"2024-02-10T08:36:54.262037+0000","last_fullsized":"2024-02-10T08:36:54.262037+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'2","last_scrub_stamp":"2024-02-10T08:33:29.353122+0000","last_deep_scrub":"87'2","last_deep_scrub_stamp":"2024-02-10T08:19:29.207531+0000","last_clean_scrub_stamp":"2024-02-10T08:33:29.353122+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"402'27","reported_seq":429,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:02.097349+0000","last_change":"2024-02-10T08:35:26.779936+0000","last_active":"2024-02-10T08:37:02.097349+0000","last_peered":"2024-02-10T08:37:02.097349+0000","last_clean":"2024-02-10T08:37:02.097349+0000","last_became_active":"2024-02-10T08:16:54.852665+0000","last_became_peered":"2024-02-10T08:16:54.852665+0000","last_unstale":"2024-02-10T08:37:02.097349+0000","last_undegraded":"2024-02-10T08:37:02.097349+0000","last_fullsized":"2024-02-10T08:37:02.097349+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'19","last_scrub_stamp":"2024-02-10T08:35:26.779875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:35:26.779875+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":327,"reported_epoch":401,"state":"active+clean","last_fresh":"2024-02-10T08:36:54.573568+0000","last_change":"2024-02-10T08:36:20.955661+0000","last_active":"2024-02-10T08:36:54.573568+0000","last_peered":"2024-02-10T08:36:54.573568+0000","last_clean":"2024-02-10T08:36:54.573568+0000","last_became_active":"2024-02-10T08:31:33.878473+0000","last_became_peered":"2024-02-10T08:31:33.878473+0000","last_unstale":"2024-02-10T08:36:54.573568+0000","last_undegraded":"2024-02-10T08:36:54.573568+0000","last_fullsized":"2024-02-10T08:36:54.573568+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:20.955583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:25:42.124914+0000","last_clean_scrub_stamp":"2024-02-10T08:36:20.955583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":210,"reported_epoch":400,"state":"active+clean","last_fresh":"2024-02-10T08:36:46.863623+0000","last_change":"2024-02-10T08:36:13.964373+0000","last_active":"2024-02-10T08:36:46.863623+0000","last_peered":"2024-02-10T08:36:46.863623+0000","last_clean":"2024-02-10T08:36:46.863623+0000","last_became_active":"2024-02-10T08:28:25.951312+0000","last_became_peered":"2024-02-10T08:28:25.951312+0000","last_unstale":"2024-02-10T08:36:46.863623+0000","last_undegraded":"2024-02-10T08:36:46.863623+0000","last_fullsized":"2024-02-10T08:36:46.863623+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:13.964287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:36:13.964287+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":387,"reported_epoch":402,"state":"active+clean+scrubbing","last_fresh":"2024-02-10T08:37:02.896327+0000","last_change":"2024-02-10T08:37:02.896327+0000","last_active":"2024-02-10T08:37:02.896327+0000","last_peered":"2024-02-10T08:37:02.896327+0000","last_clean":"2024-02-10T08:37:02.896327+0000","last_became_active":"2024-02-10T08:20:46.408504+0000","last_became_peered":"2024-02-10T08:20:46.408504+0000","last_unstale":"2024-02-10T08:37:02.896327+0000","last_undegraded":"2024-02-10T08:37:02.896327+0000","last_fullsized":"2024-02-10T08:37:02.896327+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:10.742154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:22.104988+0000","last_clean_scrub_stamp":"2024-02-10T08:34:10.742154+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"330'34","reported_seq":488,"reported_epoch":400,"state":"active+clean","last_fresh":"2024-02-10T08:36:46.140633+0000","last_change":"2024-02-10T08:36:17.678558+0000","last_active":"2024-02-10T08:36:46.140633+0000","last_peered":"2024-02-10T08:36:46.140633+0000","last_clean":"2024-02-10T08:36:46.140633+0000","last_became_active":"2024-02-10T08:31:33.894960+0000","last_became_peered":"2024-02-10T08:31:33.894960+0000","last_unstale":"2024-02-10T08:36:46.140633+0000","last_undegraded":"2024-02-10T08:36:46.140633+0000","last_fullsized":"2024-02-10T08:36:46.140633+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"330'34","last_scrub_stamp":"2024-02-10T08:36:17.678489+0000","last_deep_scrub":"330'34","last_deep_scrub_stamp":"2024-02-10T08:32:17.481832+0000","last_clean_scrub_stamp":"2024-02-10T08:36:17.678489+0000","log_size":34,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":400,"reported_epoch":401,"state":"active+clean","last_fresh":"2024-02-10T08:36:54.572675+0000","last_change":"2024-02-10T08:36:08.027692+0000","last_active":"2024-02-10T08:36:54.572675+0000","last_peered":"2024-02-10T08:36:54.572675+0000","last_clean":"2024-02-10T08:36:54.572675+0000","last_became_active":"2024-02-10T08:20:46.396303+0000","last_became_peered":"2024-02-10T08:20:46.396303+0000","last_unstale":"2024-02-10T08:36:54.572675+0000","last_undegraded":"2024-02-10T08:36:54.572675+0000","last_fullsized":"2024-02-10T08:36:54.572675+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:08.027632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:10.370746+0000","last_clean_scrub_stamp":"2024-02-10T08:36:08.027632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":405,"reported_epoch":401,"state":"active+clean","last_fresh":"2024-02-10T08:36:54.821956+0000","last_change":"2024-02-10T08:34:20.720576+0000","last_active":"2024-02-10T08:36:54.821956+0000","last_peered":"2024-02-10T08:36:54.821956+0000","last_clean":"2024-02-10T08:36:54.821956+0000","last_became_active":"2024-02-10T08:28:02.763523+0000","last_became_peered":"2024-02-10T08:28:02.763523+0000","last_unstale":"2024-02-10T08:36:54.821956+0000","last_undegraded":"2024-02-10T08:36:54.821956+0000","last_fullsized":"2024-02-10T08:36:54.821956+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:20.719812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:34:20.719812+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":357,"reported_epoch":400,"state":"active+clean","last_fresh":"2024-02-10T08:36:46.861673+0000","last_change":"2024-02-10T08:36:26.255325+0000","last_active":"2024-02-10T08:36:46.861673+0000","last_peered":"2024-02-10T08:36:46.861673+0000","last_clean":"2024-02-10T08:36:46.861673+0000","last_became_active":"2024-02-10T08:20:46.403378+0000","last_became_peered":"2024-02-10T08:20:46.403378+0000","last_unstale":"2024-02-10T08:36:46.861673+0000","last_undegraded":"2024-02-10T08:36:46.861673+0000","last_fullsized":"2024-02-10T08:36:46.861673+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:26.255232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:36:26.255232+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"402'29","reported_seq":401,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:02.129378+0000","last_change":"2024-02-10T08:36:21.774391+0000","last_active":"2024-02-10T08:37:02.129378+0000","last_peered":"2024-02-10T08:37:02.129378+0000","last_clean":"2024-02-10T08:37:02.129378+0000","last_became_active":"2024-02-10T08:31:33.891562+0000","last_became_peered":"2024-02-10T08:31:33.891562+0000","last_unstale":"2024-02-10T08:37:02.129378+0000","last_undegraded":"2024-02-10T08:37:02.129378+0000","last_fullsized":"2024-02-10T08:37:02.129378+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"226'23","last_scrub_stamp":"2024-02-10T08:36:21.774228+0000","last_deep_scrub":"226'23","last_deep_scrub_stamp":"2024-02-10T08:33:31.665189+0000","last_clean_scrub_stamp":"2024-02-10T08:36:21.774228+0000","log_size":29,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":304,"reported_epoch":401,"state":"active+clean","last_fresh":"2024-02-10T08:36:57.566196+0000","last_change":"2024-02-10T08:36:57.566152+0000","last_active":"2024-02-10T08:36:57.566196+0000","last_peered":"2024-02-10T08:36:57.566196+0000","last_clean":"2024-02-10T08:36:57.566196+0000","last_became_active":"2024-02-10T08:31:33.879918+0000","last_became_peered":"2024-02-10T08:31:33.879918+0000","last_unstale":"2024-02-10T08:36:57.566196+0000","last_undegraded":"2024-02-10T08:36:57.566196+0000","last_fullsized":"2024-02-10T08:36:57.566196+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:57.566061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:36:57.566061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":354,"reported_epoch":400,"state":"active+clean","last_fresh":"2024-02-10T08:36:46.861205+0000","last_change":"2024-02-10T08:35:19.051893+0000","last_active":"2024-02-10T08:36:46.861205+0000","last_peered":"2024-02-10T08:36:46.861205+0000","last_clean":"2024-02-10T08:36:46.861205+0000","last_became_active":"2024-02-10T08:20:46.398532+0000","last_became_peered":"2024-02-10T08:20:46.398532+0000","last_unstale":"2024-02-10T08:36:46.861205+0000","last_undegraded":"2024-02-10T08:36:46.861205+0000","last_fullsized":"2024-02-10T08:36:46.861205+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:35:19.051801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:35:19.051801+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":296,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:02.097619+0000","last_change":"2024-02-10T08:37:02.097619+0000","last_active":"2024-02-10T08:37:02.097619+0000","last_peered":"2024-02-10T08:37:02.097619+0000","last_clean":"2024-02-10T08:37:02.097619+0000","last_became_active":"2024-02-10T08:22:23.526229+0000","last_became_peered":"2024-02-10T08:22:23.526229+0000","last_unstale":"2024-02-10T08:37:02.097619+0000","last_undegraded":"2024-02-10T08:37:02.097619+0000","last_fullsized":"2024-02-10T08:37:02.097619+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:02.097524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:37:02.097524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1a","version":"225'15","reported_seq":108,"reported_epoch":400,"state":"active+clean","last_fresh":"2024-02-10T08:36:46.862020+0000","last_change":"2024-02-10T08:34:25.085877+0000","last_active":"2024-02-10T08:36:46.862020+0000","last_peered":"2024-02-10T08:36:46.862020+0000","last_clean":"2024-02-10T08:36:46.862020+0000","last_became_active":"2024-02-10T08:31:46.069680+0000","last_became_peered":"2024-02-10T08:31:46.069680+0000","last_unstale":"2024-02-10T08:36:46.862020+0000","last_undegraded":"2024-02-10T08:36:46.862020+0000","last_fullsized":"2024-02-10T08:36:46.862020+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'15","last_scrub_stamp":"2024-02-10T08:34:25.085814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:34:25.085814+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":380,"reported_epoch":401,"state":"active+clean","last_fresh":"2024-02-10T08:36:54.261751+0000","last_change":"2024-02-10T08:36:17.423852+0000","last_active":"2024-02-10T08:36:54.261751+0000","last_peered":"2024-02-10T08:36:54.261751+0000","last_clean":"2024-02-10T08:36:54.261751+0000","last_became_active":"2024-02-10T08:16:52.787865+0000","last_became_peered":"2024-02-10T08:16:52.787865+0000","last_unstale":"2024-02-10T08:36:54.261751+0000","last_undegraded":"2024-02-10T08:36:54.261751+0000","last_fullsized":"2024-02-10T08:36:54.261751+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:17.423742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:28.028556+0000","last_clean_scrub_stamp":"2024-02-10T08:36:17.423742+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":412,"reported_epoch":401,"state":"active+clean","last_fresh":"2024-02-10T08:36:54.123105+0000","last_change":"2024-02-10T08:35:08.193565+0000","last_active":"2024-02-10T08:36:54.123105+0000","last_peered":"2024-02-10T08:36:54.123105+0000","last_clean":"2024-02-10T08:36:54.123105+0000","last_became_active":"2024-02-10T08:28:19.065132+0000","last_became_peered":"2024-02-10T08:28:19.065132+0000","last_unstale":"2024-02-10T08:36:54.123105+0000","last_undegraded":"2024-02-10T08:36:54.123105+0000","last_fullsized":"2024-02-10T08:36:54.123105+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:35:08.193502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:35:08.193502+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,7],"acting":[5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":81,"reported_epoch":400,"state":"active+clean","last_fresh":"2024-02-10T08:36:46.861212+0000","last_change":"2024-02-10T08:36:23.009770+0000","last_active":"2024-02-10T08:36:46.861212+0000","last_peered":"2024-02-10T08:36:46.861212+0000","last_clean":"2024-02-10T08:36:46.861212+0000","last_became_active":"2024-02-10T08:32:36.978752+0000","last_became_peered":"2024-02-10T08:32:36.978752+0000","last_unstale":"2024-02-10T08:36:46.861212+0000","last_undegraded":"2024-02-10T08:36:46.861212+0000","last_fullsized":"2024-02-10T08:36:46.861212+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:23.009704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:36:23.009704+0000","last_clean_scrub_stamp":"2024-02-10T08:36:23.009704+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"225'7","reported_seq":408,"reported_epoch":400,"state":"active+clean","last_fresh":"2024-02-10T08:36:46.862982+0000","last_change":"2024-02-10T08:36:03.143607+0000","last_active":"2024-02-10T08:36:46.862982+0000","last_peered":"2024-02-10T08:36:46.862982+0000","last_clean":"2024-02-10T08:36:46.862982+0000","last_became_active":"2024-02-10T08:27:27.715306+0000","last_became_peered":"2024-02-10T08:27:27.715306+0000","last_unstale":"2024-02-10T08:36:46.862982+0000","last_undegraded":"2024-02-10T08:36:46.862982+0000","last_fullsized":"2024-02-10T08:36:46.862982+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'7","last_scrub_stamp":"2024-02-10T08:36:03.143512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:36:03.143512+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":9,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"55'1","reported_seq":408,"reported_epoch":401,"state":"active+clean","last_fresh":"2024-02-10T08:36:54.261991+0000","last_change":"2024-02-10T08:33:06.363742+0000","last_active":"2024-02-10T08:36:54.261991+0000","last_peered":"2024-02-10T08:36:54.261991+0000","last_clean":"2024-02-10T08:36:54.261991+0000","last_became_active":"2024-02-10T08:28:02.761299+0000","last_became_peered":"2024-02-10T08:28:02.761299+0000","last_unstale":"2024-02-10T08:36:54.261991+0000","last_undegraded":"2024-02-10T08:36:54.261991+0000","last_fullsized":"2024-02-10T08:36:54.261991+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'1","last_scrub_stamp":"2024-02-10T08:33:06.363627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:33:06.363627+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1746,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":391,"reported_epoch":401,"state":"active+clean","last_fresh":"2024-02-10T08:36:54.261551+0000","last_change":"2024-02-10T08:34:12.333244+0000","last_active":"2024-02-10T08:36:54.261551+0000","last_peered":"2024-02-10T08:36:54.261551+0000","last_clean":"2024-02-10T08:36:54.261551+0000","last_became_active":"2024-02-10T08:20:46.406783+0000","last_became_peered":"2024-02-10T08:20:46.406783+0000","last_unstale":"2024-02-10T08:36:54.261551+0000","last_undegraded":"2024-02-10T08:36:54.261551+0000","last_fullsized":"2024-02-10T08:36:54.261551+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:12.333167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:34:12.333167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":392,"reported_epoch":401,"state":"active+clean","last_fresh":"2024-02-10T08:36:54.122865+0000","last_change":"2024-02-10T08:34:34.307258+0000","last_active":"2024-02-10T08:36:54.122865+0000","last_peered":"2024-02-10T08:36:54.122865+0000","last_clean":"2024-02-10T08:36:54.122865+0000","last_became_active":"2024-02-10T08:31:33.886617+0000","last_became_peered":"2024-02-10T08:31:33.886617+0000","last_unstale":"2024-02-10T08:36:54.122865+0000","last_undegraded":"2024-02-10T08:36:54.122865+0000","last_fullsized":"2024-02-10T08:36:54.122865+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:34.307158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:34:34.307158+0000","last_clean_scrub_stamp":"2024-02-10T08:34:34.307158+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"358'19","reported_seq":380,"reported_epoch":400,"state":"active+clean","last_fresh":"2024-02-10T08:36:46.861701+0000","last_change":"2024-02-10T08:33:34.450999+0000","last_active":"2024-02-10T08:36:46.861701+0000","last_peered":"2024-02-10T08:36:46.861701+0000","last_clean":"2024-02-10T08:36:46.861701+0000","last_became_active":"2024-02-10T08:20:46.404966+0000","last_became_peered":"2024-02-10T08:20:46.404966+0000","last_unstale":"2024-02-10T08:36:46.861701+0000","last_undegraded":"2024-02-10T08:36:46.861701+0000","last_fullsized":"2024-02-10T08:36:46.861701+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"358'19","last_scrub_stamp":"2024-02-10T08:33:34.450897+0000","last_deep_scrub":"358'19","last_deep_scrub_stamp":"2024-02-10T08:33:34.450897+0000","last_clean_scrub_stamp":"2024-02-10T08:33:34.450897+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":82,"reported_epoch":400,"state":"active+clean","last_fresh":"2024-02-10T08:36:46.863622+0000","last_change":"2024-02-10T08:35:07.250085+0000","last_active":"2024-02-10T08:36:46.863622+0000","last_peered":"2024-02-10T08:36:46.863622+0000","last_clean":"2024-02-10T08:36:46.863622+0000","last_became_active":"2024-02-10T08:32:36.982675+0000","last_became_peered":"2024-02-10T08:32:36.982675+0000","last_unstale":"2024-02-10T08:36:46.863622+0000","last_undegraded":"2024-02-10T08:36:46.863622+0000","last_fullsized":"2024-02-10T08:36:46.863622+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:35:07.249972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:35:07.249972+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,5],"acting":[0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":377,"reported_epoch":401,"state":"active+clean","last_fresh":"2024-02-10T08:36:54.821510+0000","last_change":"2024-02-10T08:36:17.766707+0000","last_active":"2024-02-10T08:36:54.821510+0000","last_peered":"2024-02-10T08:36:54.821510+0000","last_clean":"2024-02-10T08:36:54.821510+0000","last_became_active":"2024-02-10T08:16:56.863353+0000","last_became_peered":"2024-02-10T08:16:56.863353+0000","last_unstale":"2024-02-10T08:36:54.821510+0000","last_undegraded":"2024-02-10T08:36:54.821510+0000","last_fullsized":"2024-02-10T08:36:54.821510+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:17.766647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:36:17.766647+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":358,"reported_epoch":400,"state":"active+clean","last_fresh":"2024-02-10T08:36:46.860917+0000","last_change":"2024-02-10T08:34:39.027380+0000","last_active":"2024-02-10T08:36:46.860917+0000","last_peered":"2024-02-10T08:36:46.860917+0000","last_clean":"2024-02-10T08:36:46.860917+0000","last_became_active":"2024-02-10T08:20:46.405314+0000","last_became_peered":"2024-02-10T08:20:46.405314+0000","last_unstale":"2024-02-10T08:36:46.860917+0000","last_undegraded":"2024-02-10T08:36:46.860917+0000","last_fullsized":"2024-02-10T08:36:46.860917+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:39.027284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:29:25.024412+0000","last_clean_scrub_stamp":"2024-02-10T08:34:39.027284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"225'27","reported_seq":445,"reported_epoch":400,"state":"active+clean","last_fresh":"2024-02-10T08:36:46.139470+0000","last_change":"2024-02-10T08:36:04.675100+0000","last_active":"2024-02-10T08:36:46.139470+0000","last_peered":"2024-02-10T08:36:46.139470+0000","last_clean":"2024-02-10T08:36:46.139470+0000","last_became_active":"2024-02-10T08:31:33.883535+0000","last_became_peered":"2024-02-10T08:31:33.883535+0000","last_unstale":"2024-02-10T08:36:46.139470+0000","last_undegraded":"2024-02-10T08:36:46.139470+0000","last_fullsized":"2024-02-10T08:36:46.139470+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'27","last_scrub_stamp":"2024-02-10T08:36:04.675002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:36:04.675002+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":81,"reported_epoch":400,"state":"active+clean","last_fresh":"2024-02-10T08:36:46.863082+0000","last_change":"2024-02-10T08:36:25.970207+0000","last_active":"2024-02-10T08:36:46.863082+0000","last_peered":"2024-02-10T08:36:46.863082+0000","last_clean":"2024-02-10T08:36:46.863082+0000","last_became_active":"2024-02-10T08:32:36.977972+0000","last_became_peered":"2024-02-10T08:32:36.977972+0000","last_unstale":"2024-02-10T08:36:46.863082+0000","last_undegraded":"2024-02-10T08:36:46.863082+0000","last_fullsized":"2024-02-10T08:36:46.863082+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:25.970136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:36:25.970136+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":103,"reported_epoch":400,"state":"active+clean","last_fresh":"2024-02-10T08:36:46.861605+0000","last_change":"2024-02-10T08:36:24.205289+0000","last_active":"2024-02-10T08:36:46.861605+0000","last_peered":"2024-02-10T08:36:46.861605+0000","last_clean":"2024-02-10T08:36:46.861605+0000","last_became_active":"2024-02-10T08:31:46.057858+0000","last_became_peered":"2024-02-10T08:31:46.057858+0000","last_unstale":"2024-02-10T08:36:46.861605+0000","last_undegraded":"2024-02-10T08:36:46.861605+0000","last_fullsized":"2024-02-10T08:36:46.861605+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:24.205221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:36:24.205221+0000","last_clean_scrub_stamp":"2024-02-10T08:36:24.205221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":304,"reported_epoch":401,"state":"active+clean","last_fresh":"2024-02-10T08:36:54.261757+0000","last_change":"2024-02-10T08:35:19.525731+0000","last_active":"2024-02-10T08:36:54.261757+0000","last_peered":"2024-02-10T08:36:54.261757+0000","last_clean":"2024-02-10T08:36:54.261757+0000","last_became_active":"2024-02-10T08:31:33.880328+0000","last_became_peered":"2024-02-10T08:31:33.880328+0000","last_unstale":"2024-02-10T08:36:54.261757+0000","last_undegraded":"2024-02-10T08:36:54.261757+0000","last_fullsized":"2024-02-10T08:36:54.261757+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:35:19.525667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:35:19.525667+0000","last_clean_scrub_stamp":"2024-02-10T08:35:19.525667+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":293,"reported_epoch":401,"state":"active+clean","last_fresh":"2024-02-10T08:36:54.820750+0000","last_change":"2024-02-10T08:36:19.772188+0000","last_active":"2024-02-10T08:36:54.820750+0000","last_peered":"2024-02-10T08:36:54.820750+0000","last_clean":"2024-02-10T08:36:54.820750+0000","last_became_active":"2024-02-10T08:22:00.581772+0000","last_became_peered":"2024-02-10T08:22:00.581772+0000","last_unstale":"2024-02-10T08:36:54.820750+0000","last_undegraded":"2024-02-10T08:36:54.820750+0000","last_fullsized":"2024-02-10T08:36:54.820750+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:19.772116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:36:19.772116+0000","last_clean_scrub_stamp":"2024-02-10T08:36:19.772116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,7],"acting":[1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":306,"reported_epoch":401,"state":"active+clean","last_fresh":"2024-02-10T08:36:54.261153+0000","last_change":"2024-02-10T08:33:10.338393+0000","last_active":"2024-02-10T08:36:54.261153+0000","last_peered":"2024-02-10T08:36:54.261153+0000","last_clean":"2024-02-10T08:36:54.261153+0000","last_became_active":"2024-02-10T08:31:46.054713+0000","last_became_peered":"2024-02-10T08:31:46.054713+0000","last_unstale":"2024-02-10T08:36:54.261153+0000","last_undegraded":"2024-02-10T08:36:54.261153+0000","last_fullsized":"2024-02-10T08:36:54.261153+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:10.338257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:33:10.338257+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":300,"reported_epoch":401,"state":"active+clean","last_fresh":"2024-02-10T08:36:54.988683+0000","last_change":"2024-02-10T08:36:54.988639+0000","last_active":"2024-02-10T08:36:54.988683+0000","last_peered":"2024-02-10T08:36:54.988683+0000","last_clean":"2024-02-10T08:36:54.988683+0000","last_became_active":"2024-02-10T08:22:00.600200+0000","last_became_peered":"2024-02-10T08:22:00.600200+0000","last_unstale":"2024-02-10T08:36:54.988683+0000","last_undegraded":"2024-02-10T08:36:54.988683+0000","last_fullsized":"2024-02-10T08:36:54.988683+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:54.988559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:36:54.988559+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1],"acting":[6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":279,"reported_epoch":400,"state":"active+clean","last_fresh":"2024-02-10T08:36:46.862416+0000","last_change":"2024-02-10T08:36:29.086443+0000","last_active":"2024-02-10T08:36:46.862416+0000","last_peered":"2024-02-10T08:36:46.862416+0000","last_clean":"2024-02-10T08:36:46.862416+0000","last_became_active":"2024-02-10T08:28:25.999335+0000","last_became_peered":"2024-02-10T08:28:25.999335+0000","last_unstale":"2024-02-10T08:36:46.862416+0000","last_undegraded":"2024-02-10T08:36:46.862416+0000","last_fullsized":"2024-02-10T08:36:46.862416+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:24.802724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:33:24.802724+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":402,"reported_epoch":401,"state":"active+clean","last_fresh":"2024-02-10T08:36:54.123026+0000","last_change":"2024-02-10T08:33:24.018372+0000","last_active":"2024-02-10T08:36:54.123026+0000","last_peered":"2024-02-10T08:36:54.123026+0000","last_clean":"2024-02-10T08:36:54.123026+0000","last_became_active":"2024-02-10T08:31:33.879440+0000","last_became_peered":"2024-02-10T08:31:33.879440+0000","last_unstale":"2024-02-10T08:36:54.123026+0000","last_undegraded":"2024-02-10T08:36:54.123026+0000","last_fullsized":"2024-02-10T08:36:54.123026+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:24.018273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:33:24.018273+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":408,"reported_epoch":401,"state":"active+clean","last_fresh":"2024-02-10T08:36:54.574262+0000","last_change":"2024-02-10T08:36:10.035263+0000","last_active":"2024-02-10T08:36:54.574262+0000","last_peered":"2024-02-10T08:36:54.574262+0000","last_clean":"2024-02-10T08:36:54.574262+0000","last_became_active":"2024-02-10T08:27:27.710587+0000","last_became_peered":"2024-02-10T08:27:27.710587+0000","last_unstale":"2024-02-10T08:36:54.574262+0000","last_undegraded":"2024-02-10T08:36:54.574262+0000","last_fullsized":"2024-02-10T08:36:54.574262+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:10.035169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:11.750537+0000","last_clean_scrub_stamp":"2024-02-10T08:36:10.035169+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,1],"acting":[6,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":311,"reported_epoch":401,"state":"active+clean","last_fresh":"2024-02-10T08:36:54.821662+0000","last_change":"2024-02-10T08:36:22.783889+0000","last_active":"2024-02-10T08:36:54.821662+0000","last_peered":"2024-02-10T08:36:54.821662+0000","last_clean":"2024-02-10T08:36:54.821662+0000","last_became_active":"2024-02-10T08:32:36.974142+0000","last_became_peered":"2024-02-10T08:32:36.974142+0000","last_unstale":"2024-02-10T08:36:54.821662+0000","last_undegraded":"2024-02-10T08:36:54.821662+0000","last_fullsized":"2024-02-10T08:36:54.821662+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:22.783769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:36:22.783769+0000","last_clean_scrub_stamp":"2024-02-10T08:36:22.783769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":316,"reported_epoch":401,"state":"active+clean","last_fresh":"2024-02-10T08:36:56.113011+0000","last_change":"2024-02-10T08:36:56.112985+0000","last_active":"2024-02-10T08:36:56.113011+0000","last_peered":"2024-02-10T08:36:56.113011+0000","last_clean":"2024-02-10T08:36:56.113011+0000","last_became_active":"2024-02-10T08:32:36.979412+0000","last_became_peered":"2024-02-10T08:32:36.979412+0000","last_unstale":"2024-02-10T08:36:56.113011+0000","last_undegraded":"2024-02-10T08:36:56.113011+0000","last_fullsized":"2024-02-10T08:36:56.113011+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:56.112889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:36:56.112889+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1],"acting":[6,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":387,"reported_epoch":400,"state":"active+clean","last_fresh":"2024-02-10T08:36:46.138902+0000","last_change":"2024-02-10T08:36:22.695059+0000","last_active":"2024-02-10T08:36:46.138902+0000","last_peered":"2024-02-10T08:36:46.138902+0000","last_clean":"2024-02-10T08:36:46.138902+0000","last_became_active":"2024-02-10T08:22:00.578118+0000","last_became_peered":"2024-02-10T08:22:00.578118+0000","last_unstale":"2024-02-10T08:36:46.138902+0000","last_undegraded":"2024-02-10T08:36:46.138902+0000","last_fullsized":"2024-02-10T08:36:46.138902+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:22.694931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:36:22.694931+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,6],"acting":[2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.29","version":"76'2","reported_seq":336,"reported_epoch":401,"state":"active+clean","last_fresh":"2024-02-10T08:36:54.261243+0000","last_change":"2024-02-10T08:32:31.459909+0000","last_active":"2024-02-10T08:36:54.261243+0000","last_peered":"2024-02-10T08:36:54.261243+0000","last_clean":"2024-02-10T08:36:54.261243+0000","last_became_active":"2024-02-10T08:28:02.767822+0000","last_became_peered":"2024-02-10T08:28:02.767822+0000","last_unstale":"2024-02-10T08:36:54.261243+0000","last_undegraded":"2024-02-10T08:36:54.261243+0000","last_fullsized":"2024-02-10T08:36:54.261243+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":6,"last_scrub":"76'2","last_scrub_stamp":"2024-02-10T08:32:31.459851+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2024-02-10T08:18:08.680038+0000","last_clean_scrub_stamp":"2024-02-10T08:32:31.459851+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,0],"acting":[7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":109,"reported_epoch":400,"state":"active+clean","last_fresh":"2024-02-10T08:36:46.862112+0000","last_change":"2024-02-10T08:35:09.039987+0000","last_active":"2024-02-10T08:36:46.862112+0000","last_peered":"2024-02-10T08:36:46.862112+0000","last_clean":"2024-02-10T08:36:46.862112+0000","last_became_active":"2024-02-10T08:32:36.975213+0000","last_became_peered":"2024-02-10T08:32:36.975213+0000","last_unstale":"2024-02-10T08:36:46.862112+0000","last_undegraded":"2024-02-10T08:36:46.862112+0000","last_fullsized":"2024-02-10T08:36:46.862112+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:35:09.039924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:20.392249+0000","last_clean_scrub_stamp":"2024-02-10T08:35:09.039924+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0],"acting":[4,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":127,"reported_epoch":401,"state":"active+clean","last_fresh":"2024-02-10T08:36:54.122945+0000","last_change":"2024-02-10T08:34:10.431223+0000","last_active":"2024-02-10T08:36:54.122945+0000","last_peered":"2024-02-10T08:36:54.122945+0000","last_clean":"2024-02-10T08:36:54.122945+0000","last_became_active":"2024-02-10T08:30:26.079913+0000","last_became_peered":"2024-02-10T08:30:26.079913+0000","last_unstale":"2024-02-10T08:36:54.122945+0000","last_undegraded":"2024-02-10T08:36:54.122945+0000","last_fullsized":"2024-02-10T08:36:54.122945+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:10.431134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:34:10.431134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":239,"reported_epoch":400,"state":"active+clean","last_fresh":"2024-02-10T08:36:46.863232+0000","last_change":"2024-02-10T08:36:20.265038+0000","last_active":"2024-02-10T08:36:46.863232+0000","last_peered":"2024-02-10T08:36:46.863232+0000","last_clean":"2024-02-10T08:36:46.863232+0000","last_became_active":"2024-02-10T08:33:56.117425+0000","last_became_peered":"2024-02-10T08:33:56.117425+0000","last_unstale":"2024-02-10T08:36:46.863232+0000","last_undegraded":"2024-02-10T08:36:46.863232+0000","last_fullsized":"2024-02-10T08:36:46.863232+0000","mapping_epoch":364,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":365,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:20.264960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:20:30.227375+0000","last_clean_scrub_stamp":"2024-02-10T08:36:20.264960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":398,"reported_epoch":400,"state":"active+clean","last_fresh":"2024-02-10T08:36:46.140648+0000","last_change":"2024-02-10T08:35:21.921686+0000","last_active":"2024-02-10T08:36:46.140648+0000","last_peered":"2024-02-10T08:36:46.140648+0000","last_clean":"2024-02-10T08:36:46.140648+0000","last_became_active":"2024-02-10T08:30:26.085360+0000","last_became_peered":"2024-02-10T08:30:26.085360+0000","last_unstale":"2024-02-10T08:36:46.140648+0000","last_undegraded":"2024-02-10T08:36:46.140648+0000","last_fullsized":"2024-02-10T08:36:46.140648+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:35:21.921586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:35:21.921586+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,5],"acting":[2,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":132,"reported_epoch":401,"state":"active+clean","last_fresh":"2024-02-10T08:36:54.574103+0000","last_change":"2024-02-10T08:36:14.985405+0000","last_active":"2024-02-10T08:36:54.574103+0000","last_peered":"2024-02-10T08:36:54.574103+0000","last_clean":"2024-02-10T08:36:54.574103+0000","last_became_active":"2024-02-10T08:30:26.075472+0000","last_became_peered":"2024-02-10T08:30:26.075472+0000","last_unstale":"2024-02-10T08:36:54.574103+0000","last_undegraded":"2024-02-10T08:36:54.574103+0000","last_fullsized":"2024-02-10T08:36:54.574103+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:14.985304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:36:14.985304+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":131,"reported_epoch":401,"state":"active+clean","last_fresh":"2024-02-10T08:36:54.262314+0000","last_change":"2024-02-10T08:36:04.485289+0000","last_active":"2024-02-10T08:36:54.262314+0000","last_peered":"2024-02-10T08:36:54.262314+0000","last_clean":"2024-02-10T08:36:54.262314+0000","last_became_active":"2024-02-10T08:30:26.080539+0000","last_became_peered":"2024-02-10T08:30:26.080539+0000","last_unstale":"2024-02-10T08:36:54.262314+0000","last_undegraded":"2024-02-10T08:36:54.262314+0000","last_fullsized":"2024-02-10T08:36:54.262314+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:04.485194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:34.215363+0000","last_clean_scrub_stamp":"2024-02-10T08:36:04.485194+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":127,"reported_epoch":401,"state":"active+clean","last_fresh":"2024-02-10T08:36:54.261040+0000","last_change":"2024-02-10T08:36:14.408397+0000","last_active":"2024-02-10T08:36:54.261040+0000","last_peered":"2024-02-10T08:36:54.261040+0000","last_clean":"2024-02-10T08:36:54.261040+0000","last_became_active":"2024-02-10T08:30:26.088228+0000","last_became_peered":"2024-02-10T08:30:26.088228+0000","last_unstale":"2024-02-10T08:36:54.261040+0000","last_undegraded":"2024-02-10T08:36:54.261040+0000","last_fullsized":"2024-02-10T08:36:54.261040+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:14.408305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:36:14.408305+0000","last_clean_scrub_stamp":"2024-02-10T08:36:14.408305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1],"acting":[7,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":309,"reported_epoch":401,"state":"active+clean","last_fresh":"2024-02-10T08:36:54.122736+0000","last_change":"2024-02-10T08:34:17.350483+0000","last_active":"2024-02-10T08:36:54.122736+0000","last_peered":"2024-02-10T08:36:54.122736+0000","last_clean":"2024-02-10T08:36:54.122736+0000","last_became_active":"2024-02-10T08:30:26.072022+0000","last_became_peered":"2024-02-10T08:30:26.072022+0000","last_unstale":"2024-02-10T08:36:54.122736+0000","last_undegraded":"2024-02-10T08:36:54.122736+0000","last_fullsized":"2024-02-10T08:36:54.122736+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:17.350406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:34:17.350406+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":16,"stat_sum":{"num_bytes":729743360,"num_objects":11135,"num_object_clones":0,"num_object_copies":33405,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11135,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11135,"num_write_kb":712640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2203451392,"data_stored":2203451392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11135,"ondisk_log_size":11135,"up":48,"acting":48,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2646,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":4},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1199,"num_read_kb":1194,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":9,"acting":9,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":1294,"num_read_kb":1051,"num_write":829,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":212,"num_bytes_recovered":5226,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":872,"ondisk_log_size":872,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":96,"acting":96,"num_store_stats":8},{"poolid":6,"num_pg":52,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":156,"acting":156,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":50,"seq":214748365046,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":926256,"kb_used_data":336552,"kb_used_omap":0,"kb_used_meta":589696,"kb_avail":92818896,"statfs":{"total":95995035648,"available":95046549504,"internally_reserved":0,"allocated":344629248,"data_stored":344225270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":603848704},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:36:18 2024","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":2.6160000000000001,"15min":2.089},"min":{"1min":0.23400000000000001,"5min":0.20899999999999999,"15min":0.19600000000000001},"max":{"1min":3.8210000000000002,"5min":107.95699999999999,"15min":107.95699999999999},"last":1.512},{"interface":"front","average":{"1min":0.99099999999999999,"5min":2.9529999999999998,"15min":2.528},"min":{"1min":0.27100000000000002,"5min":0.23499999999999999,"15min":0.20999999999999999},"max":{"1min":5.0880000000000001,"5min":108.33499999999999,"15min":108.33499999999999},"last":0.22800000000000001}]},{"osd":1,"last update":"Sat Feb 10 08:36:18 2024","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":1.387,"15min":1.7849999999999999},"min":{"1min":0.26800000000000002,"5min":0.23100000000000001,"15min":0.20000000000000001},"max":{"1min":3.8879999999999999,"5min":8.7530000000000001,"15min":41.539999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":1.153,"5min":1.8560000000000001,"15min":1.956},"min":{"1min":0.39000000000000001,"5min":0.25700000000000001,"15min":0.22700000000000001},"max":{"1min":3.7909999999999999,"5min":10.099,"15min":41.046999999999997},"last":0.255}]},{"osd":2,"last update":"Sat Feb 10 08:36:18 2024","interfaces":[{"interface":"back","average":{"1min":1.6990000000000001,"5min":2.4279999999999999,"15min":1.9650000000000001},"min":{"1min":0.27400000000000002,"5min":0.25700000000000001,"15min":0.251},"max":{"1min":6.8019999999999996,"5min":36.308999999999997,"15min":36.308999999999997},"last":0.41899999999999998},{"interface":"front","average":{"1min":1.095,"5min":2.0710000000000002,"15min":1.9019999999999999},"min":{"1min":0.29599999999999999,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":3.952,"5min":36.268000000000001,"15min":36.268000000000001},"last":0.312}]},{"osd":3,"last update":"Sat Feb 10 08:36:18 2024","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.679,"15min":1.74},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":4.9630000000000001,"5min":12.686,"15min":18.515000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":1.3600000000000001,"5min":2.0369999999999999,"15min":1.8500000000000001},"min":{"1min":0.34499999999999997,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":4.0789999999999997,"5min":10.960000000000001,"15min":10.960000000000001},"last":0.58499999999999996}]},{"osd":4,"last update":"Sat Feb 10 08:36:18 2024","interfaces":[{"interface":"back","average":{"1min":1.839,"5min":1.8720000000000001,"15min":1.3720000000000001},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":23.797999999999998,"5min":23.797999999999998,"15min":23.797999999999998},"last":0.371},{"interface":"front","average":{"1min":2.5899999999999999,"5min":1.796,"15min":1.3779999999999999},"min":{"1min":0.28599999999999998,"5min":0.26800000000000002,"15min":0.22700000000000001},"max":{"1min":26.303000000000001,"5min":26.303000000000001,"15min":26.303000000000001},"last":0.33700000000000002}]},{"osd":5,"last update":"Sat Feb 10 08:36:18 2024","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.931,"15min":1.706},"min":{"1min":0.29399999999999998,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":8.4580000000000002,"5min":12.882,"15min":15.304},"last":0.432},{"interface":"front","average":{"1min":0.95499999999999996,"5min":1.5940000000000001,"15min":1.4490000000000001},"min":{"1min":0.33500000000000002,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":4.5789999999999997,"5min":13.129,"15min":13.129},"last":0.53400000000000003}]},{"osd":6,"last update":"Sat Feb 10 08:36:18 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":1.718,"15min":1.3540000000000001},"min":{"1min":0.312,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":2.8889999999999998,"5min":10.101000000000001,"15min":10.101000000000001},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.89500000000000002,"5min":1.8999999999999999,"15min":1.3959999999999999},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":6.8330000000000002,"5min":12.654,"15min":12.654},"last":0.57299999999999995}]}]},{"osd":6,"up_from":43,"seq":184683593979,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":985936,"kb_used_data":396232,"kb_used_omap":0,"kb_used_meta":589696,"kb_avail":92759216,"statfs":{"total":95995035648,"available":94985437184,"internally_reserved":0,"allocated":405741568,"data_stored":405369723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":603848704},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,0,0,0,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:36:54 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":1.472,"15min":1.895},"min":{"1min":0.23200000000000001,"5min":0.20300000000000001,"15min":0.19400000000000001},"max":{"1min":3.448,"5min":6.452,"15min":30.509},"last":0.36299999999999999},{"interface":"front","average":{"1min":1.393,"5min":1.508,"15min":1.776},"min":{"1min":0.36299999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":7.0830000000000002,"5min":8.1590000000000007,"15min":36.090000000000003},"last":0.253}]},{"osd":1,"last update":"Sat Feb 10 08:36:54 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":1.171,"15min":1.6220000000000001},"min":{"1min":0.25900000000000001,"5min":0.223,"15min":0.223},"max":{"1min":2.532,"5min":6.4219999999999997,"15min":12.938000000000001},"last":0.316},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.8180000000000001,"15min":1.859},"min":{"1min":0.36099999999999999,"5min":0.215,"15min":0.215},"max":{"1min":3.742,"5min":11.976000000000001,"15min":11.976000000000001},"last":0.66400000000000003}]},{"osd":2,"last update":"Sat Feb 10 08:36:54 2024","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.6220000000000001,"15min":2.048},"min":{"1min":0.46000000000000002,"5min":0.27700000000000002,"15min":0.24399999999999999},"max":{"1min":4.9729999999999999,"5min":7.4989999999999997,"15min":35.072000000000003},"last":0.71599999999999997},{"interface":"front","average":{"1min":1.2,"5min":1.5529999999999999,"15min":1.8740000000000001},"min":{"1min":0.36499999999999999,"5min":0.23799999999999999,"15min":0.23100000000000001},"max":{"1min":4.9800000000000004,"5min":14.867000000000001,"15min":35.103000000000002},"last":0.42799999999999999}]},{"osd":3,"last update":"Sat Feb 10 08:36:54 2024","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":2.7130000000000001,"15min":2.27},"min":{"1min":0.29399999999999998,"5min":0.26800000000000002,"15min":0.26600000000000001},"max":{"1min":9.1359999999999992,"5min":103.94199999999999,"15min":103.94199999999999},"last":0.34499999999999997},{"interface":"front","average":{"1min":1.262,"5min":2.984,"15min":2.3799999999999999},"min":{"1min":0.34000000000000002,"5min":0.28000000000000003,"15min":0.253},"max":{"1min":8.0340000000000007,"5min":103.79600000000001,"15min":103.79600000000001},"last":0.755}]},{"osd":4,"last update":"Sat Feb 10 08:36:17 2024","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.597,"15min":1.2649999999999999},"min":{"1min":0.25600000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":3.8410000000000002,"5min":14.789,"15min":14.789},"last":0.27200000000000002},{"interface":"front","average":{"1min":1.6870000000000001,"5min":1.379,"15min":1.3160000000000001},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.22600000000000001},"max":{"1min":6.3499999999999996,"5min":8.3140000000000001,"15min":10.348000000000001},"last":0.38600000000000001}]},{"osd":5,"last update":"Sat Feb 10 08:36:54 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":1.667,"15min":1.6100000000000001},"min":{"1min":0.29899999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":3.9319999999999999,"5min":14.834,"15min":29.631},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.81000000000000005,"5min":1.173,"15min":1.4550000000000001},"min":{"1min":0.316,"5min":0.28799999999999998,"15min":0.23699999999999999},"max":{"1min":4.4299999999999997,"5min":8.3369999999999997,"15min":29.419},"last":0.67700000000000005}]},{"osd":7,"last update":"Sat Feb 10 08:36:17 2024","interfaces":[{"interface":"back","average":{"1min":1.365,"5min":1.5760000000000001,"15min":2.1030000000000002},"min":{"1min":0.33400000000000002,"5min":0.30599999999999999,"15min":0.26200000000000001},"max":{"1min":6.4630000000000001,"5min":7.0259999999999998,"15min":194.88900000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":1.665,"5min":1.6439999999999999,"15min":2.2240000000000002},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":6.3949999999999996,"5min":14.128,"15min":194.74100000000001},"last":0.70699999999999996}]}]},{"osd":1,"up_from":13,"seq":55834575122,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1365288,"kb_used_data":475232,"kb_used_omap":0,"kb_used_meta":890048,"kb_avail":92379864,"statfs":{"total":95995035648,"available":94596980736,"internally_reserved":0,"allocated":486637568,"data_stored":486241166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":911409152},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:36:55 2024","interfaces":[{"interface":"back","average":{"1min":1.0349999999999999,"5min":1.405,"15min":1.9550000000000001},"min":{"1min":0.187,"5min":0.187,"15min":0.17100000000000001},"max":{"1min":5.891,"5min":8.5820000000000007,"15min":29.763999999999999},"last":6.4429999999999996},{"interface":"front","average":{"1min":0.78000000000000003,"5min":1.679,"15min":2.0459999999999998},"min":{"1min":0.20100000000000001,"5min":0.183,"15min":0.17899999999999999},"max":{"1min":3.6400000000000001,"5min":19.928999999999998,"15min":29.637},"last":1.407}]},{"osd":2,"last update":"Sat Feb 10 08:36:24 2024","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.8440000000000001,"15min":2.1709999999999998},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.21199999999999999},"max":{"1min":4.8579999999999997,"5min":12.202,"15min":31.420999999999999},"last":1.4490000000000001},{"interface":"front","average":{"1min":1.512,"5min":1.873,"15min":2.444},"min":{"1min":0.246,"5min":0.23400000000000001,"15min":0.184},"max":{"1min":4.343,"5min":12.314,"15min":31.484999999999999},"last":0.83399999999999996}]},{"osd":3,"last update":"Sat Feb 10 08:36:43 2024","interfaces":[{"interface":"back","average":{"1min":1.6899999999999999,"5min":1.6859999999999999,"15min":2.2869999999999999},"min":{"1min":0.309,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":5.101,"5min":12.369999999999999,"15min":28.082000000000001},"last":0.54500000000000004},{"interface":"front","average":{"1min":1.96,"5min":1.7709999999999999,"15min":2.0739999999999998},"min":{"1min":0.311,"5min":0.25600000000000001,"15min":0.19600000000000001},"max":{"1min":8.2129999999999992,"5min":9.2699999999999996,"15min":29.722000000000001},"last":3.524}]},{"osd":4,"last update":"Sat Feb 10 08:36:15 2024","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":1.8120000000000001,"15min":1.8779999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26100000000000001},"max":{"1min":4.8840000000000003,"5min":23.218,"15min":23.218},"last":1.488},{"interface":"front","average":{"1min":1.258,"5min":1.796,"15min":2.129},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.25900000000000001},"max":{"1min":3.3359999999999999,"5min":23.274000000000001,"15min":31.515000000000001},"last":0.373}]},{"osd":5,"last update":"Sat Feb 10 08:36:24 2024","interfaces":[{"interface":"back","average":{"1min":1.6819999999999999,"5min":1.7,"15min":2.0699999999999998},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":8.2550000000000008,"5min":10.605,"15min":40.140999999999998},"last":1.516},{"interface":"front","average":{"1min":1.486,"5min":1.881,"15min":2.4119999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.28499999999999998},"max":{"1min":5.3470000000000004,"5min":7.593,"15min":40.831000000000003},"last":0.60399999999999998}]},{"osd":6,"last update":"Sat Feb 10 08:36:55 2024","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.8,"15min":2.113},"min":{"1min":0.40000000000000002,"5min":0.34599999999999997,"15min":0.30199999999999999},"max":{"1min":5.056,"5min":26.071999999999999,"15min":31.27},"last":0.625},{"interface":"front","average":{"1min":0.80700000000000005,"5min":1.579,"15min":1.7310000000000001},"min":{"1min":0.39300000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":2.5089999999999999,"5min":25.937000000000001,"15min":25.937000000000001},"last":2.0379999999999998}]},{"osd":7,"last update":"Sat Feb 10 08:36:24 2024","interfaces":[{"interface":"back","average":{"1min":4.7770000000000001,"5min":2.8860000000000001,"15min":2.5070000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.29099999999999998},"max":{"1min":64.405000000000001,"5min":64.405000000000001,"15min":64.405000000000001},"last":0.58099999999999996},{"interface":"front","average":{"1min":5.2030000000000003,"5min":2.6339999999999999,"15min":2.0779999999999998},"min":{"1min":0.40400000000000003,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":64.510999999999996,"5min":64.510999999999996,"15min":64.510999999999996},"last":2.0680000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738646,"num_pgs":62,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":646880,"kb_used_data":48984,"kb_used_omap":0,"kb_used_meta":597888,"kb_avail":93098272,"statfs":{"total":95995035648,"available":95332630528,"internally_reserved":0,"allocated":50159616,"data_stored":49764748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":612237312},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 10 08:36:05 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":1.224,"15min":2.6110000000000002},"min":{"1min":0.20499999999999999,"5min":0.16300000000000001,"15min":0.14399999999999999},"max":{"1min":3.0539999999999998,"5min":5.9000000000000004,"15min":102.48099999999999},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.681,"15min":2.6059999999999999},"min":{"1min":0.20699999999999999,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":4.4729999999999999,"5min":15.550000000000001,"15min":103.38800000000001},"last":0.28299999999999997}]},{"osd":2,"last update":"Sat Feb 10 08:36:22 2024","interfaces":[{"interface":"back","average":{"1min":1.7410000000000001,"5min":2.23,"15min":3.0019999999999998},"min":{"1min":0.252,"5min":0.19700000000000001,"15min":0.192},"max":{"1min":5.9539999999999997,"5min":19.411999999999999,"15min":102.462},"last":0.72599999999999998},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.53,"15min":2.5659999999999998},"min":{"1min":0.23000000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":6.5199999999999996,"5min":10.369,"15min":102.66500000000001},"last":1.077}]},{"osd":3,"last update":"Sat Feb 10 08:36:42 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":1.7370000000000001,"15min":2.1280000000000001},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":4.4169999999999998,"5min":15.585000000000001,"15min":16.495000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":1.157,"5min":2.319,"15min":2.7909999999999999},"min":{"1min":0.24299999999999999,"5min":0.216,"15min":0.216},"max":{"1min":4.9459999999999997,"5min":19.504000000000001,"15min":102.64400000000001},"last":0.80800000000000005}]},{"osd":4,"last update":"Sat Feb 10 08:36:09 2024","interfaces":[{"interface":"back","average":{"1min":2.2130000000000001,"5min":2.0870000000000002,"15min":2.472},"min":{"1min":0.28599999999999998,"5min":0.26000000000000001,"15min":0.253},"max":{"1min":10.042999999999999,"5min":19.359999999999999,"15min":102.742},"last":0.77800000000000002},{"interface":"front","average":{"1min":1.571,"5min":1.571,"15min":1.677},"min":{"1min":0.28799999999999998,"5min":0.27000000000000002,"15min":0.26200000000000001},"max":{"1min":4.4729999999999999,"5min":15.343,"15min":16.352},"last":0.32300000000000001}]},{"osd":5,"last update":"Sat Feb 10 08:36:34 2024","interfaces":[{"interface":"back","average":{"1min":2.3540000000000001,"5min":1.9990000000000001,"15min":2.3140000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":28.123999999999999,"5min":28.123999999999999,"15min":102.53100000000001},"last":1.175},{"interface":"front","average":{"1min":2.5030000000000001,"5min":1.9359999999999999,"15min":1.9630000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":28.350000000000001,"5min":28.350000000000001,"15min":28.350000000000001},"last":0.35699999999999998}]},{"osd":6,"last update":"Sat Feb 10 08:36:05 2024","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.716,"15min":2.3300000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.28599999999999998},"max":{"1min":2.835,"5min":7.0149999999999997,"15min":102.583},"last":1.117},{"interface":"front","average":{"1min":1.5189999999999999,"5min":1.9730000000000001,"15min":1.885},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.308},"max":{"1min":4.3460000000000001,"5min":15.359,"15min":16.391999999999999},"last":0.56699999999999995}]},{"osd":7,"last update":"Sat Feb 10 08:36:22 2024","interfaces":[{"interface":"back","average":{"1min":1.4059999999999999,"5min":1.573,"15min":3.073},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":2.9969999999999999,"5min":6.4889999999999999,"15min":255.53200000000001},"last":1.151},{"interface":"front","average":{"1min":1.6479999999999999,"5min":1.948,"15min":2.7170000000000001},"min":{"1min":0.38900000000000001,"5min":0.34599999999999997,"15min":0.33100000000000002},"max":{"1min":4.4980000000000002,"5min":15.375999999999999,"15min":254.88800000000001},"last":0.67900000000000005}]}]},{"osd":2,"up_from":18,"seq":77309411597,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":590480,"kb_used_data":776,"kb_used_omap":0,"kb_used_meta":589696,"kb_avail":93154672,"statfs":{"total":95995035648,"available":95390384128,"internally_reserved":0,"allocated":794624,"data_stored":415521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":603848704},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:36:25 2024","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.6359999999999999,"15min":1.9379999999999999},"min":{"1min":0.19700000000000001,"5min":0.19400000000000001,"15min":0.184},"max":{"1min":4.0250000000000004,"5min":27.934999999999999,"15min":27.934999999999999},"last":0.435},{"interface":"front","average":{"1min":2.5329999999999999,"5min":2.3769999999999998,"15min":2.6600000000000001},"min":{"1min":0.20399999999999999,"5min":0.191,"15min":0.191},"max":{"1min":11.815,"5min":15.15,"15min":28.295999999999999},"last":0.44800000000000001}]},{"osd":1,"last update":"Sat Feb 10 08:36:25 2024","interfaces":[{"interface":"back","average":{"1min":2.4500000000000002,"5min":1.9990000000000001,"15min":2.194},"min":{"1min":0.24399999999999999,"5min":0.20999999999999999,"15min":0.20599999999999999},"max":{"1min":10.385,"5min":10.385,"15min":15.644},"last":0.48999999999999999},{"interface":"front","average":{"1min":1.585,"5min":1.532,"15min":1.615},"min":{"1min":0.24099999999999999,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":7.5490000000000004,"5min":12.132999999999999,"15min":16.968},"last":0.54400000000000004}]},{"osd":3,"last update":"Sat Feb 10 08:36:52 2024","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.7669999999999999,"15min":2.0910000000000002},"min":{"1min":0.255,"5min":0.245,"15min":0.24199999999999999},"max":{"1min":5.0019999999999998,"5min":9.7870000000000008,"15min":24.946000000000002},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.64900000000000002,"5min":1.1799999999999999,"15min":2.0369999999999999},"min":{"1min":0.28100000000000003,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":2.0779999999999998,"5min":9.1150000000000002,"15min":24.905000000000001},"last":0.66300000000000003}]},{"osd":4,"last update":"Sat Feb 10 08:36:08 2024","interfaces":[{"interface":"back","average":{"1min":4.3840000000000003,"5min":2.3940000000000001,"15min":2.0190000000000001},"min":{"1min":0.47299999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":19.231000000000002,"5min":19.231000000000002,"15min":19.231000000000002},"last":0.65000000000000002},{"interface":"front","average":{"1min":2.3490000000000002,"5min":1.381,"15min":1.349},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.25700000000000001},"max":{"1min":19.256,"5min":19.256,"15min":19.256},"last":0.70399999999999996}]},{"osd":5,"last update":"Sat Feb 10 08:36:36 2024","interfaces":[{"interface":"back","average":{"1min":1.474,"5min":2.113,"15min":2.125},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":5.0860000000000003,"5min":13.201000000000001,"15min":13.939},"last":0.60499999999999998},{"interface":"front","average":{"1min":1.802,"5min":1.988,"15min":2.004},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.28599999999999998},"max":{"1min":4.6420000000000003,"5min":9.5030000000000001,"15min":13.317},"last":0.73199999999999998}]},{"osd":6,"last update":"Sat Feb 10 08:36:08 2024","interfaces":[{"interface":"back","average":{"1min":3.6619999999999999,"5min":2.339,"15min":2.2629999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.27300000000000002},"max":{"1min":20.815999999999999,"5min":20.815999999999999,"15min":38.177999999999997},"last":0.63100000000000001},{"interface":"front","average":{"1min":4.5570000000000004,"5min":2.5819999999999999,"15min":2.355},"min":{"1min":0.51900000000000002,"5min":0.32200000000000001,"15min":0.308},"max":{"1min":20.268999999999998,"5min":20.268999999999998,"15min":37.682000000000002},"last":0.79800000000000004}]},{"osd":7,"last update":"Sat Feb 10 08:36:25 2024","interfaces":[{"interface":"back","average":{"1min":3.2509999999999999,"5min":2.3140000000000001,"15min":2.1070000000000002},"min":{"1min":0.43099999999999999,"5min":0.377,"15min":0.33400000000000002},"max":{"1min":8.5440000000000005,"5min":9.6869999999999994,"15min":13.231999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":1.8129999999999999,"5min":1.4219999999999999,"15min":1.492},"min":{"1min":0.38200000000000001,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":8.5310000000000006,"5min":8.5310000000000006,"15min":15.714},"last":0.75}]}]},{"osd":3,"up_from":25,"seq":107374182665,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":946668,"kb_used_data":348772,"kb_used_omap":0,"kb_used_meta":597888,"kb_avail":92798484,"statfs":{"total":95995035648,"available":95025647616,"internally_reserved":0,"allocated":357142528,"data_stored":356741613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":612237312},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:36:44 2024","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":2.2850000000000001,"15min":2.1829999999999998},"min":{"1min":0.17699999999999999,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":5.6500000000000004,"5min":66.605000000000004,"15min":66.605000000000004},"last":0.21199999999999999},{"interface":"front","average":{"1min":1.6579999999999999,"5min":2.2679999999999998,"15min":2.1469999999999998},"min":{"1min":0.19800000000000001,"5min":0.192,"15min":0.184},"max":{"1min":10.970000000000001,"5min":66.828000000000003,"15min":66.828000000000003},"last":1.3440000000000001}]},{"osd":1,"last update":"Sat Feb 10 08:36:44 2024","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.6220000000000001,"15min":2.0270000000000001},"min":{"1min":0.25,"5min":0.187,"15min":0.187},"max":{"1min":3.133,"5min":13.371,"15min":13.371},"last":0.34200000000000003},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.7789999999999999,"15min":2.262},"min":{"1min":0.24099999999999999,"5min":0.22900000000000001,"15min":0.20599999999999999},"max":{"1min":5.3159999999999998,"5min":10.67,"15min":21.373999999999999},"last":0.27800000000000002}]},{"osd":2,"last update":"Sat Feb 10 08:36:44 2024","interfaces":[{"interface":"back","average":{"1min":2.105,"5min":2.7519999999999998,"15min":2.452},"min":{"1min":0.27800000000000002,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":11.308,"5min":65.998999999999995,"15min":65.998999999999995},"last":2.298},{"interface":"front","average":{"1min":1.8120000000000001,"5min":2.5699999999999998,"15min":2.1070000000000002},"min":{"1min":0.27200000000000002,"5min":0.255,"15min":0.215},"max":{"1min":11.012,"5min":68.721000000000004,"15min":68.721000000000004},"last":1.601}]},{"osd":4,"last update":"Sat Feb 10 08:36:19 2024","interfaces":[{"interface":"back","average":{"1min":2.7559999999999998,"5min":1.7549999999999999,"15min":1.677},"min":{"1min":0.32700000000000001,"5min":0.29199999999999998,"15min":0.25900000000000001},"max":{"1min":11.061999999999999,"5min":11.061999999999999,"15min":12.272},"last":1.379},{"interface":"front","average":{"1min":2.169,"5min":1.7829999999999999,"15min":1.9610000000000001},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":8.9109999999999996,"5min":10.754,"15min":12.391999999999999},"last":0.374}]},{"osd":5,"last update":"Sat Feb 10 08:36:44 2024","interfaces":[{"interface":"back","average":{"1min":1.9930000000000001,"5min":1.9590000000000001,"15min":1.831},"min":{"1min":0.35599999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":11.159000000000001,"5min":19.832000000000001,"15min":19.832000000000001},"last":1.5760000000000001},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.95,"15min":2.0209999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.27800000000000002},"max":{"1min":4.5209999999999999,"5min":19.712,"15min":19.712},"last":0.88800000000000001}]},{"osd":6,"last update":"Sat Feb 10 08:37:00 2024","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":1.669,"15min":1.9379999999999999},"min":{"1min":0.35899999999999999,"5min":0.31,"15min":0.31},"max":{"1min":4.5999999999999996,"5min":8.8610000000000007,"15min":16.423999999999999},"last":0.503},{"interface":"front","average":{"1min":1.429,"5min":1.4950000000000001,"15min":1.764},"min":{"1min":0.46899999999999997,"5min":0.375,"15min":0.31},"max":{"1min":11.127000000000001,"5min":11.127000000000001,"15min":11.127000000000001},"last":1.4239999999999999}]},{"osd":7,"last update":"Sat Feb 10 08:36:19 2024","interfaces":[{"interface":"back","average":{"1min":2.718,"5min":1.847,"15min":1.8320000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":11.904,"5min":11.904,"15min":12.358000000000001},"last":1.4019999999999999},{"interface":"front","average":{"1min":2.4740000000000002,"5min":1.97,"15min":2.1179999999999999},"min":{"1min":0.36599999999999999,"5min":0.313,"15min":0.313},"max":{"1min":11.986000000000001,"5min":11.986000000000001,"15min":15.702},"last":0.47199999999999998}]}]},{"osd":4,"up_from":110,"seq":472446402756,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":672724,"kb_used_data":82380,"kb_used_omap":0,"kb_used_meta":590335,"kb_avail":93072428,"statfs":{"total":95995035648,"available":95306166272,"internally_reserved":0,"allocated":84357120,"data_stored":83973340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":972,"internal_metadata":604503092},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:36:30 2024","interfaces":[{"interface":"back","average":{"1min":1.331,"5min":1.47,"15min":1.486},"min":{"1min":0.23100000000000001,"5min":0.20499999999999999,"15min":0.19800000000000001},"max":{"1min":4.9969999999999999,"5min":10.932,"15min":14.595000000000001},"last":0.34000000000000002},{"interface":"front","average":{"1min":2.5529999999999999,"5min":2.1600000000000001,"15min":2.1640000000000001},"min":{"1min":0.40500000000000003,"5min":0.23799999999999999,"15min":0.222},"max":{"1min":11.109,"5min":11.109,"15min":16.524000000000001},"last":0.47599999999999998}]},{"osd":1,"last update":"Sat Feb 10 08:36:30 2024","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.71,"15min":1.831},"min":{"1min":0.38800000000000001,"5min":0.24099999999999999,"15min":0.218},"max":{"1min":4.6539999999999999,"5min":8.2149999999999999,"15min":38.621000000000002},"last":0.49299999999999999},{"interface":"front","average":{"1min":1.4470000000000001,"5min":1.587,"15min":1.774},"min":{"1min":0.34300000000000003,"5min":0.29799999999999999,"15min":0.217},"max":{"1min":4.6619999999999999,"5min":11.964,"15min":38.430999999999997},"last":0.38100000000000001}]},{"osd":2,"last update":"Sat Feb 10 08:36:30 2024","interfaces":[{"interface":"back","average":{"1min":1.863,"5min":1.899,"15min":1.9259999999999999},"min":{"1min":0.32200000000000001,"5min":0.217,"15min":0.217},"max":{"1min":6.8620000000000001,"5min":10.608000000000001,"15min":14.414},"last":0.44},{"interface":"front","average":{"1min":0.77400000000000002,"5min":1.657,"15min":1.675},"min":{"1min":0.29999999999999999,"5min":0.26100000000000001,"15min":0.247},"max":{"1min":2.9540000000000002,"5min":11.958,"15min":11.958},"last":0.32300000000000001}]},{"osd":3,"last update":"Sat Feb 10 08:36:30 2024","interfaces":[{"interface":"back","average":{"1min":1.871,"5min":1.915,"15min":1.9139999999999999},"min":{"1min":0.33700000000000002,"5min":0.27100000000000002,"15min":0.23200000000000001},"max":{"1min":7.0380000000000003,"5min":7.0380000000000003,"15min":14.358000000000001},"last":0.40000000000000002},{"interface":"front","average":{"1min":1.125,"5min":1.766,"15min":1.716},"min":{"1min":0.38300000000000001,"5min":0.32700000000000001,"15min":0.249},"max":{"1min":2.8969999999999998,"5min":8.3360000000000003,"15min":11.648},"last":0.46600000000000003}]},{"osd":5,"last update":"Sat Feb 10 08:36:30 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":1.486,"15min":1.341},"min":{"1min":0.27400000000000002,"5min":0.247,"15min":0.21299999999999999},"max":{"1min":4.1509999999999998,"5min":9.4550000000000001,"15min":41.488},"last":0.41199999999999998},{"interface":"front","average":{"1min":1.331,"5min":1.581,"15min":1.5640000000000001},"min":{"1min":0.28499999999999998,"5min":0.245,"15min":0.23699999999999999},"max":{"1min":5.4160000000000004,"5min":9.4700000000000006,"15min":42.527999999999999},"last":0.36899999999999999}]},{"osd":6,"last update":"Sat Feb 10 08:36:30 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":1.9079999999999999,"15min":1.5369999999999999},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":2.597,"5min":44.816000000000003,"15min":44.816000000000003},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.66700000000000004,"5min":2.0110000000000001,"15min":1.5840000000000001},"min":{"1min":0.32200000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":3.1379999999999999,"5min":43.816000000000003,"15min":43.816000000000003},"last":0.42899999999999999}]},{"osd":7,"last update":"Sat Feb 10 08:36:30 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":1.5369999999999999,"15min":1.3720000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.28899999999999998},"max":{"1min":5.3789999999999996,"5min":8.6289999999999996,"15min":11.047000000000001},"last":0.39300000000000002},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.462,"15min":1.3129999999999999},"min":{"1min":0.318,"5min":0.30199999999999999,"15min":0.26300000000000001},"max":{"1min":4.4470000000000001,"5min":10.971,"15min":16.245999999999999},"last":0.45200000000000001}]}]},{"osd":5,"up_from":37,"seq":158913790208,"num_pgs":62,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1100880,"kb_used_data":197576,"kb_used_omap":0,"kb_used_meta":903296,"kb_avail":92644272,"statfs":{"total":95995035648,"available":94867734528,"internally_reserved":0,"allocated":202317824,"data_stored":201945152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":924975104},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:36:31 2024","interfaces":[{"interface":"back","average":{"1min":2.169,"5min":1.5289999999999999,"15min":1.7230000000000001},"min":{"1min":0.25900000000000001,"5min":0.218,"15min":0.20499999999999999},"max":{"1min":7.7110000000000003,"5min":7.7110000000000003,"15min":19.300000000000001},"last":1.167},{"interface":"front","average":{"1min":1.554,"5min":1.8939999999999999,"15min":1.7070000000000001},"min":{"1min":0.253,"5min":0.22900000000000001,"15min":0.21299999999999999},"max":{"1min":8.048,"5min":13.738,"15min":17.024000000000001},"last":0.76200000000000001}]},{"osd":1,"last update":"Sat Feb 10 08:36:31 2024","interfaces":[{"interface":"back","average":{"1min":1.6220000000000001,"5min":1.615,"15min":1.647},"min":{"1min":0.27300000000000002,"5min":0.24099999999999999,"15min":0.19500000000000001},"max":{"1min":5.1509999999999998,"5min":8.5210000000000008,"15min":8.5210000000000008},"last":0.32500000000000001},{"interface":"front","average":{"1min":1.645,"5min":1.6919999999999999,"15min":1.581},"min":{"1min":0.40200000000000002,"5min":0.25,"15min":0.25},"max":{"1min":6.1200000000000001,"5min":7.085,"15min":9.0579999999999998},"last":2.653}]},{"osd":2,"last update":"Sat Feb 10 08:36:31 2024","interfaces":[{"interface":"back","average":{"1min":1.462,"5min":1.724,"15min":1.784},"min":{"1min":0.28399999999999997,"5min":0.251,"15min":0.24099999999999999},"max":{"1min":4.9740000000000002,"5min":7.9829999999999997,"15min":20.254999999999999},"last":1.857},{"interface":"front","average":{"1min":1.536,"5min":1.4790000000000001,"15min":1.623},"min":{"1min":0.27800000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":5.0389999999999997,"5min":6.3449999999999998,"15min":7.585},"last":1.113}]},{"osd":3,"last update":"Sat Feb 10 08:36:31 2024","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.4610000000000001,"15min":1.409},"min":{"1min":0.308,"5min":0.28499999999999998,"15min":0.26100000000000001},"max":{"1min":4.327,"5min":8.0079999999999991,"15min":8.2539999999999996},"last":2.6779999999999999},{"interface":"front","average":{"1min":1.911,"5min":1.591,"15min":1.6519999999999999},"min":{"1min":0.36199999999999999,"5min":0.309,"15min":0.27300000000000002},"max":{"1min":8.7940000000000005,"5min":9.7100000000000009,"15min":12.387},"last":0.40699999999999997}]},{"osd":4,"last update":"Sat Feb 10 08:36:16 2024","interfaces":[{"interface":"back","average":{"1min":2.0529999999999999,"5min":1.6259999999999999,"15min":1.246},"min":{"1min":0.27100000000000002,"5min":0.223,"15min":0.223},"max":{"1min":9.7080000000000002,"5min":9.7080000000000002,"15min":9.7080000000000002},"last":1.069},{"interface":"front","average":{"1min":1.944,"5min":1.3220000000000001,"15min":1.2669999999999999},"min":{"1min":0.309,"5min":0.254,"15min":0.22500000000000001},"max":{"1min":7.5220000000000002,"5min":9.0009999999999994,"15min":12.948},"last":0.36199999999999999}]},{"osd":6,"last update":"Sat Feb 10 08:37:02 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":1.452,"15min":1.28},"min":{"1min":0.30499999999999999,"5min":0.245,"15min":0.23100000000000001},"max":{"1min":2.0129999999999999,"5min":7.2779999999999996,"15min":8.3559999999999999},"last":0.434},{"interface":"front","average":{"1min":0.53800000000000003,"5min":1.2470000000000001,"15min":1.2090000000000001},"min":{"1min":0.312,"5min":0.27800000000000002,"15min":0.26300000000000001},"max":{"1min":1.0369999999999999,"5min":6.8499999999999996,"15min":7.875},"last":1.0369999999999999}]},{"osd":7,"last update":"Sat Feb 10 08:36:29 2024","interfaces":[{"interface":"back","average":{"1min":1.444,"5min":1.6080000000000001,"15min":2.4159999999999999},"min":{"1min":0.31900000000000001,"5min":0.30499999999999999,"15min":0.23499999999999999},"max":{"1min":5.5,"5min":7.952,"15min":371.87400000000002},"last":1.008},{"interface":"front","average":{"1min":1.714,"5min":1.329,"15min":2.5800000000000001},"min":{"1min":0.35499999999999998,"5min":0.318,"15min":0.23499999999999999},"max":{"1min":5.0759999999999996,"5min":5.5190000000000001,"15min":372.63099999999997},"last":1.1379999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":62783488,"data_stored":62783488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":488112128,"data_stored":488112128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":50397184,"data_stored":50397184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":423165952,"data_stored":423165952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":114688000,"data_stored":114688000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":233177088,"data_stored":233177088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":474087424,"data_stored":474087424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":357040128,"data_stored":357040128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-10T08:37:10.959 INFO:tasks.cephadm.ceph_manager.ceph:would drop below min_pgs, proj 6, currently 16 2024-02-10T08:37:10.971 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:37:10.982 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:11.008 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:37:11.012 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:11.012 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:37:11.113 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:37:11.165 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:11.191 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:37:11.199 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:11.200 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:37:11.300 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:37:11.362 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:11.507 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 14 16 32150 32134 143.415 107.312 0.00470195 0.00696759 2024-02-10T08:37:11.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:10.028194+0000 osd.6 (osd.6) 251 : cluster [DBG] 2.17 scrub starts 2024-02-10T08:37:11.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:10.034495+0000 osd.6 (osd.6) 252 : cluster [DBG] 2.17 scrub ok 2024-02-10T08:37:11.645 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:10.028194+0000 osd.6 (osd.6) 251 : cluster [DBG] 2.17 scrub starts 2024-02-10T08:37:11.645 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:10.034495+0000 osd.6 (osd.6) 252 : cluster [DBG] 2.17 scrub ok 2024-02-10T08:37:11.645 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:10.028194+0000 osd.6 (osd.6) 251 : cluster [DBG] 2.17 scrub starts 2024-02-10T08:37:11.645 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:10.034495+0000 osd.6 (osd.6) 252 : cluster [DBG] 2.17 scrub ok 2024-02-10T08:37:12.055 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-02-10T08:37:12.055 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-02-10T08:37:12.055 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:12.055 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.25664.0:33037 11.8 e402/398 11:15f13a9c:::benchmark_data_smithi018_166993_object33036:head v 402'2098, mlcod=402'2096)", 2024-02-10T08:37:12.055 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:37:12.025081+0000", 2024-02-10T08:37:12.055 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.0041601160000000002, 2024-02-10T08:37:12.055 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0041913819999999996, 2024-02-10T08:37:12.055 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:37:12.055 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-02-10T08:37:12.056 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:37:12.056 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:12.056 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:37:12.056 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:37:12.025081+0000", 2024-02-10T08:37:12.056 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:37:12.056 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:12.056 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:12.056 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:37:12.056 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:37:12.025081+0000", 2024-02-10T08:37:12.056 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:37:12.056 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:12.057 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:12.057 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:37:12.057 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:37:12.025080+0000", 2024-02-10T08:37:12.057 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7915e-05 2024-02-10T08:37:12.057 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:12.057 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:12.057 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:37:12.057 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:37:12.025107+0000", 2024-02-10T08:37:12.057 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4909000000000001e-05 2024-02-10T08:37:12.057 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:12.058 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:12.058 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:37:12.058 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:37:12.025122+0000", 2024-02-10T08:37:12.058 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7700000000000001e-06 2024-02-10T08:37:12.058 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:12.058 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:12.059 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:37:12.059 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:37:12.025130+0000", 2024-02-10T08:37:12.059 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010058800000000001 2024-02-10T08:37:12.059 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:12.059 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:12.059 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:37:12.059 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:37:12.025231+0000", 2024-02-10T08:37:12.059 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4882000000000001e-05 2024-02-10T08:37:12.059 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:12.059 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:12.059 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:37:12.059 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:37:12.025246+0000", 2024-02-10T08:37:12.059 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016510099999999999 2024-02-10T08:37:12.059 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:37:12.060 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:37:12.060 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:37:12.060 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:12.060 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:12.060 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.25664.0:33038 11.8 e402/398 11:1534a2da:::benchmark_data_smithi018_166993_object33037:head v 402'2099, mlcod=402'2096)", 2024-02-10T08:37:12.060 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:37:12.026534+0000", 2024-02-10T08:37:12.060 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.0027065370000000002, 2024-02-10T08:37:12.060 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0028148980000000001, 2024-02-10T08:37:12.060 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:37:12.060 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-02-10T08:37:12.060 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:37:12.060 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:12.060 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:37:12.060 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:37:12.026534+0000", 2024-02-10T08:37:12.061 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:37:12.061 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:12.061 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:12.061 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:37:12.061 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:37:12.026534+0000", 2024-02-10T08:37:12.061 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:37:12.061 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:12.061 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:12.061 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:37:12.061 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:37:12.026533+0000", 2024-02-10T08:37:12.061 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2734000000000002e-05 2024-02-10T08:37:12.062 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:12.062 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:12.062 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:37:12.062 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:37:12.026566+0000", 2024-02-10T08:37:12.062 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.098e-05 2024-02-10T08:37:12.062 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:12.062 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:12.062 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:37:12.062 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:37:12.026577+0000", 2024-02-10T08:37:12.062 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0440000000000001e-06 2024-02-10T08:37:12.062 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:12.062 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:12.062 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:37:12.062 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:37:12.026583+0000", 2024-02-10T08:37:12.063 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00027877199999999999 2024-02-10T08:37:12.063 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:12.063 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:12.063 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:37:12.063 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:37:12.026862+0000", 2024-02-10T08:37:12.063 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0550000000000001e-05 2024-02-10T08:37:12.063 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:12.063 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:12.063 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:37:12.063 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:37:12.026882+0000", 2024-02-10T08:37:12.063 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00034815999999999997 2024-02-10T08:37:12.063 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:37:12.063 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:37:12.063 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:37:12.063 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:12.064 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:12.064 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.25664.0:33040 11.8 e402/398 11:1e115bf4:::benchmark_data_smithi018_166993_object33039:head v 402'2100, mlcod=402'2096)", 2024-02-10T08:37:12.064 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:37:12.028060+0000", 2024-02-10T08:37:12.064 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.0011801940000000001, 2024-02-10T08:37:12.064 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001354959, 2024-02-10T08:37:12.064 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:37:12.064 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-02-10T08:37:12.064 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:37:12.064 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:12.064 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:37:12.064 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:37:12.028060+0000", 2024-02-10T08:37:12.064 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:37:12.064 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:12.065 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:12.065 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:37:12.065 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:37:12.028060+0000", 2024-02-10T08:37:12.065 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:37:12.065 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:12.065 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:12.065 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:37:12.065 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:37:12.028060+0000", 2024-02-10T08:37:12.065 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4032999999999998e-05 2024-02-10T08:37:12.065 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:12.065 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:12.065 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:37:12.065 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:37:12.028094+0000", 2024-02-10T08:37:12.065 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5149999999999995e-06 2024-02-10T08:37:12.066 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:12.066 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:12.066 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:37:12.066 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:37:12.028103+0000", 2024-02-10T08:37:12.066 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8030000000000002e-06 2024-02-10T08:37:12.066 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:12.066 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:12.066 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:37:12.066 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:37:12.028109+0000", 2024-02-10T08:37:12.066 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00026432499999999999 2024-02-10T08:37:12.066 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:12.066 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:12.066 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:37:12.066 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:37:12.028373+0000", 2024-02-10T08:37:12.066 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9360000000000001e-05 2024-02-10T08:37:12.067 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:12.067 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:12.067 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:37:12.067 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:37:12.028393+0000", 2024-02-10T08:37:12.067 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00033229400000000001 2024-02-10T08:37:12.067 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:37:12.067 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:37:12.067 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:37:12.067 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:12.067 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:12.067 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.25664.0:33039 11.a e402/398 11:53a24c63:::benchmark_data_smithi018_166993_object33038:head v 402'2027, mlcod=402'2025)", 2024-02-10T08:37:12.067 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:37:12.028933+0000", 2024-02-10T08:37:12.067 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.000307824, 2024-02-10T08:37:12.067 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00054502499999999998, 2024-02-10T08:37:12.067 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:37:12.068 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-02-10T08:37:12.068 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:37:12.068 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:12.068 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:37:12.068 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:37:12.028933+0000", 2024-02-10T08:37:12.068 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:37:12.068 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:12.068 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:12.068 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:37:12.068 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:37:12.028933+0000", 2024-02-10T08:37:12.068 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:37:12.068 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:12.068 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:12.069 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:37:12.069 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:37:12.028932+0000", 2024-02-10T08:37:12.069 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4075999999999997e-05 2024-02-10T08:37:12.069 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:12.069 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:12.069 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:37:12.069 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:37:12.028966+0000", 2024-02-10T08:37:12.069 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0834e-05 2024-02-10T08:37:12.069 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:12.069 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:12.069 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:37:12.069 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:37:12.028977+0000", 2024-02-10T08:37:12.069 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1630000000000001e-06 2024-02-10T08:37:12.069 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:12.070 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:12.070 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:37:12.070 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:37:12.028983+0000", 2024-02-10T08:37:12.070 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6138999999999998e-05 2024-02-10T08:37:12.070 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:12.070 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:12.070 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:37:12.070 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:37:12.029049+0000", 2024-02-10T08:37:12.070 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9018999999999999e-05 2024-02-10T08:37:12.070 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:12.070 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:12.070 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:37:12.070 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:37:12.029068+0000", 2024-02-10T08:37:12.070 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013533100000000001 2024-02-10T08:37:12.071 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:37:12.071 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:37:12.071 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:37:12.071 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:37:12.071 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-02-10T08:37:12.071 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 4 2024-02-10T08:37:12.071 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-02-10T08:37:12.262 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:10.997990+0000 osd.6 (osd.6) 253 : cluster [DBG] 2.7 scrub starts 2024-02-10T08:37:12.508 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 15 15 33897 33882 141.137 109.25 0.00717941 0.00708034 2024-02-10T08:37:12.521 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:11.000940+0000 osd.6 (osd.6) 254 : cluster [DBG] 2.7 scrub ok 2024-02-10T08:37:12.521 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:11.079360+0000 mgr.y (mgr.14505) 767 : cluster [DBG] pgmap v938: 168 pgs: 168 active+clean; 1.6 GiB data, 9.8 GiB used, 705 GiB / 715 GiB avail; 44 KiB/s rd, 149 MiB/s wr, 2.45k op/s 2024-02-10T08:37:12.521 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:10.997990+0000 osd.6 (osd.6) 253 : cluster [DBG] 2.7 scrub starts 2024-02-10T08:37:12.521 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:11.000940+0000 osd.6 (osd.6) 254 : cluster [DBG] 2.7 scrub ok 2024-02-10T08:37:12.521 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:11.079360+0000 mgr.y (mgr.14505) 767 : cluster [DBG] pgmap v938: 168 pgs: 168 active+clean; 1.6 GiB data, 9.8 GiB used, 705 GiB / 715 GiB avail; 44 KiB/s rd, 149 MiB/s wr, 2.45k op/s 2024-02-10T08:37:12.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:10.997990+0000 osd.6 (osd.6) 253 : cluster [DBG] 2.7 scrub starts 2024-02-10T08:37:12.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:11.000940+0000 osd.6 (osd.6) 254 : cluster [DBG] 2.7 scrub ok 2024-02-10T08:37:12.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:11.079360+0000 mgr.y (mgr.14505) 767 : cluster [DBG] pgmap v938: 168 pgs: 168 active+clean; 1.6 GiB data, 9.8 GiB used, 705 GiB / 715 GiB avail; 44 KiB/s rd, 149 MiB/s wr, 2.45k op/s 2024-02-10T08:37:13.036 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:37:13.041 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:13.042 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:37:13.143 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:37:13.184 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:13.223 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:37:13.226 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:13.227 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:37:13.271 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:37:13.280 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:12.512126+0000 osd.7 (osd.7) 265 : cluster [DBG] 2.1d scrub starts 2024-02-10T08:37:13.280 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:12.516720+0000 osd.7 (osd.7) 266 : cluster [DBG] 2.1d scrub ok 2024-02-10T08:37:13.280 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:12.998692+0000 osd.1 (osd.1) 276 : cluster [DBG] 2.d scrub starts 2024-02-10T08:37:13.280 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:13.004983+0000 osd.1 (osd.1) 277 : cluster [DBG] 2.d scrub ok 2024-02-10T08:37:13.280 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:37:13.198431+0000 mon.a (mon.0) 1677 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:37:13.280 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:12.512126+0000 osd.7 (osd.7) 265 : cluster [DBG] 2.1d scrub starts 2024-02-10T08:37:13.280 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:12.516720+0000 osd.7 (osd.7) 266 : cluster [DBG] 2.1d scrub ok 2024-02-10T08:37:13.280 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:12.998692+0000 osd.1 (osd.1) 276 : cluster [DBG] 2.d scrub starts 2024-02-10T08:37:13.280 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:13.004983+0000 osd.1 (osd.1) 277 : cluster [DBG] 2.d scrub ok 2024-02-10T08:37:13.280 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:37:13.198431+0000 mon.a (mon.0) 1677 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:37:13.328 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:37:13.385 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:13.418 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:37:13.423 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:13.423 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:37:13.509 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 16 15 35590 35575 138.919 105.812 0.00666347 0.00719277 2024-02-10T08:37:13.524 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:37:13.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:12.512126+0000 osd.7 (osd.7) 265 : cluster [DBG] 2.1d scrub starts 2024-02-10T08:37:13.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:12.516720+0000 osd.7 (osd.7) 266 : cluster [DBG] 2.1d scrub ok 2024-02-10T08:37:13.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:12.998692+0000 osd.1 (osd.1) 276 : cluster [DBG] 2.d scrub starts 2024-02-10T08:37:13.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:13.004983+0000 osd.1 (osd.1) 277 : cluster [DBG] 2.d scrub ok 2024-02-10T08:37:13.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:37:13.198431+0000 mon.a (mon.0) 1677 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:37:13.569 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:13.600 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:37:13.604 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:13.605 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:37:13.706 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:37:13.761 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:14.097 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.3 dump_blocked_ops 2024-02-10T08:37:14.321 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:37:14.324 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:13.080912+0000 mgr.y (mgr.14505) 768 : cluster [DBG] pgmap v939: 168 pgs: 168 active+clean; 2.0 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 37 KiB/s rd, 164 MiB/s wr, 2.69k op/s 2024-02-10T08:37:14.324 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:13.897055+0000 osd.4 (osd.4) 186 : cluster [DBG] 4.9 scrub starts 2024-02-10T08:37:14.324 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:13.904373+0000 osd.4 (osd.4) 187 : cluster [DBG] 4.9 scrub ok 2024-02-10T08:37:14.324 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:14.031189+0000 osd.1 (osd.1) 278 : cluster [DBG] 2.9 scrub starts 2024-02-10T08:37:14.324 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:14.034551+0000 osd.1 (osd.1) 279 : cluster [DBG] 2.9 scrub ok 2024-02-10T08:37:14.324 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:13.080912+0000 mgr.y (mgr.14505) 768 : cluster [DBG] pgmap v939: 168 pgs: 168 active+clean; 2.0 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 37 KiB/s rd, 164 MiB/s wr, 2.69k op/s 2024-02-10T08:37:14.325 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:13.897055+0000 osd.4 (osd.4) 186 : cluster [DBG] 4.9 scrub starts 2024-02-10T08:37:14.325 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:13.904373+0000 osd.4 (osd.4) 187 : cluster [DBG] 4.9 scrub ok 2024-02-10T08:37:14.325 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:14.031189+0000 osd.1 (osd.1) 278 : cluster [DBG] 2.9 scrub starts 2024-02-10T08:37:14.325 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:14.034551+0000 osd.1 (osd.1) 279 : cluster [DBG] 2.9 scrub ok 2024-02-10T08:37:14.325 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:14.326 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:37:14.427 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:37:14.489 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:14.509 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 17 16 37169 37153 136.544 98.625 0.00488011 0.00731738 2024-02-10T08:37:14.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:13.080912+0000 mgr.y (mgr.14505) 768 : cluster [DBG] pgmap v939: 168 pgs: 168 active+clean; 2.0 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 37 KiB/s rd, 164 MiB/s wr, 2.69k op/s 2024-02-10T08:37:14.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:13.897055+0000 osd.4 (osd.4) 186 : cluster [DBG] 4.9 scrub starts 2024-02-10T08:37:14.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:13.904373+0000 osd.4 (osd.4) 187 : cluster [DBG] 4.9 scrub ok 2024-02-10T08:37:14.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:14.031189+0000 osd.1 (osd.1) 278 : cluster [DBG] 2.9 scrub starts 2024-02-10T08:37:14.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:14.034551+0000 osd.1 (osd.1) 279 : cluster [DBG] 2.9 scrub ok 2024-02-10T08:37:15.158 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:37:15.163 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:15.163 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:37:15.264 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:37:15.326 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:15.334 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is unset 2024-02-10T08:37:15.420 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:14.613114+0000 osd.7 (osd.7) 267 : cluster [DBG] 4.0 scrub starts 2024-02-10T08:37:15.421 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:14.617475+0000 osd.7 (osd.7) 268 : cluster [DBG] 4.0 scrub ok 2024-02-10T08:37:15.421 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:37:14.992826+0000 mon.c (mon.2) 92 : audit [INF] from='client.? 172.21.15.18:0/2153173038' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:37:15.421 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:37:14.993255+0000 mon.a (mon.0) 1678 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:37:15.421 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:15.032670+0000 osd.1 (osd.1) 280 : cluster [DBG] 3.0 scrub starts 2024-02-10T08:37:15.421 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:15.040022+0000 osd.1 (osd.1) 281 : cluster [DBG] 3.0 scrub ok 2024-02-10T08:37:15.421 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:14.613114+0000 osd.7 (osd.7) 267 : cluster [DBG] 4.0 scrub starts 2024-02-10T08:37:15.421 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:14.617475+0000 osd.7 (osd.7) 268 : cluster [DBG] 4.0 scrub ok 2024-02-10T08:37:15.421 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:37:14.992826+0000 mon.c (mon.2) 92 : audit [INF] from='client.? 172.21.15.18:0/2153173038' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:37:15.421 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:37:14.993255+0000 mon.a (mon.0) 1678 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:37:15.421 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:15.032670+0000 osd.1 (osd.1) 280 : cluster [DBG] 3.0 scrub starts 2024-02-10T08:37:15.421 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:15.040022+0000 osd.1 (osd.1) 281 : cluster [DBG] 3.0 scrub ok 2024-02-10T08:37:15.510 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 18 16 38615 38599 133.975 90.375 0.0138506 0.00745867 2024-02-10T08:37:15.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:14.613114+0000 osd.7 (osd.7) 267 : cluster [DBG] 4.0 scrub starts 2024-02-10T08:37:15.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:14.617475+0000 osd.7 (osd.7) 268 : cluster [DBG] 4.0 scrub ok 2024-02-10T08:37:15.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:37:14.992826+0000 mon.c (mon.2) 92 : audit [INF] from='client.? 172.21.15.18:0/2153173038' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:37:15.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:37:14.993255+0000 mon.a (mon.0) 1678 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:37:15.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:15.032670+0000 osd.1 (osd.1) 280 : cluster [DBG] 3.0 scrub starts 2024-02-10T08:37:15.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:15.040022+0000 osd.1 (osd.1) 281 : cluster [DBG] 3.0 scrub ok 2024-02-10T08:37:15.960 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 3, 4, 5, 6, 7, 0] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 5, 6, 7, 4] 2024-02-10T08:37:15.960 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-10T08:37:15.960 INFO:tasks.thrashosds.thrasher:Growing pool device_health_metrics 2024-02-10T08:37:15.961 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph pg dump --format=json 2024-02-10T08:37:16.088 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:37:16.100 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:16.101 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:37:16.201 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:37:16.243 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:16.272 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:37:16.274 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:16.275 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:37:16.375 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:37:16.432 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:16.510 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 19 16 40157 40141 131.996 96.375 0.0135042 0.00757163 2024-02-10T08:37:16.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:14.931370+0000 osd.0 (osd.0) 242 : cluster [DBG] 4.16 scrub starts 2024-02-10T08:37:16.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:14.936445+0000 osd.0 (osd.0) 243 : cluster [DBG] 4.16 scrub ok 2024-02-10T08:37:16.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:15.081527+0000 mgr.y (mgr.14505) 769 : cluster [DBG] pgmap v940: 168 pgs: 168 active+clean; 2.1 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 21 KiB/s rd, 124 MiB/s wr, 2.01k op/s 2024-02-10T08:37:16.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:15.177275+0000 osd.5 (osd.5) 259 : cluster [DBG] 6.24 scrub starts 2024-02-10T08:37:16.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:15.183777+0000 osd.5 (osd.5) 260 : cluster [DBG] 6.24 scrub ok 2024-02-10T08:37:16.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:15.278891+0000 mon.a (mon.0) 1679 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-10T08:37:16.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:15.278917+0000 mon.a (mon.0) 1680 : cluster [INF] Cluster is now healthy 2024-02-10T08:37:16.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:37:15.300627+0000 mon.a (mon.0) 1681 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-10T08:37:16.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:15.300691+0000 mon.a (mon.0) 1682 : cluster [DBG] osdmap e403: 8 total, 8 up, 8 in 2024-02-10T08:37:16.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:37:15.320701+0000 mon.a (mon.0) 1683 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:37:16.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:37:15.321528+0000 mon.a (mon.0) 1684 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:37:16.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:37:15.329942+0000 mon.a (mon.0) 1685 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:37:16.626 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:14.931370+0000 osd.0 (osd.0) 242 : cluster [DBG] 4.16 scrub starts 2024-02-10T08:37:16.627 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:14.936445+0000 osd.0 (osd.0) 243 : cluster [DBG] 4.16 scrub ok 2024-02-10T08:37:16.627 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:15.081527+0000 mgr.y (mgr.14505) 769 : cluster [DBG] pgmap v940: 168 pgs: 168 active+clean; 2.1 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 21 KiB/s rd, 124 MiB/s wr, 2.01k op/s 2024-02-10T08:37:16.627 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:15.177275+0000 osd.5 (osd.5) 259 : cluster [DBG] 6.24 scrub starts 2024-02-10T08:37:16.627 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:15.183777+0000 osd.5 (osd.5) 260 : cluster [DBG] 6.24 scrub ok 2024-02-10T08:37:16.627 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:15.278891+0000 mon.a (mon.0) 1679 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-10T08:37:16.627 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:15.278917+0000 mon.a (mon.0) 1680 : cluster [INF] Cluster is now healthy 2024-02-10T08:37:16.627 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:37:15.300627+0000 mon.a (mon.0) 1681 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-10T08:37:16.627 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:15.300691+0000 mon.a (mon.0) 1682 : cluster [DBG] osdmap e403: 8 total, 8 up, 8 in 2024-02-10T08:37:16.627 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:37:15.320701+0000 mon.a (mon.0) 1683 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:37:16.627 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:37:15.321528+0000 mon.a (mon.0) 1684 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:37:16.627 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:37:15.329942+0000 mon.a (mon.0) 1685 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:37:16.627 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:14.931370+0000 osd.0 (osd.0) 242 : cluster [DBG] 4.16 scrub starts 2024-02-10T08:37:16.628 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:14.936445+0000 osd.0 (osd.0) 243 : cluster [DBG] 4.16 scrub ok 2024-02-10T08:37:16.628 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:15.081527+0000 mgr.y (mgr.14505) 769 : cluster [DBG] pgmap v940: 168 pgs: 168 active+clean; 2.1 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 21 KiB/s rd, 124 MiB/s wr, 2.01k op/s 2024-02-10T08:37:16.628 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:15.177275+0000 osd.5 (osd.5) 259 : cluster [DBG] 6.24 scrub starts 2024-02-10T08:37:16.628 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:15.183777+0000 osd.5 (osd.5) 260 : cluster [DBG] 6.24 scrub ok 2024-02-10T08:37:16.628 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:15.278891+0000 mon.a (mon.0) 1679 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-10T08:37:16.628 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:15.278917+0000 mon.a (mon.0) 1680 : cluster [INF] Cluster is now healthy 2024-02-10T08:37:16.628 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:37:15.300627+0000 mon.a (mon.0) 1681 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-10T08:37:16.628 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:15.300691+0000 mon.a (mon.0) 1682 : cluster [DBG] osdmap e403: 8 total, 8 up, 8 in 2024-02-10T08:37:16.628 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:37:15.320701+0000 mon.a (mon.0) 1683 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:37:16.628 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:37:15.321528+0000 mon.a (mon.0) 1684 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:37:16.628 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:37:15.329942+0000 mon.a (mon.0) 1685 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:37:16.629 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:37:16.653 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:37:16.658 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:16.658 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:37:16.759 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:37:16.789 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:37:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:37:16] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:37:16.797 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:16.831 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:37:16.834 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:16.834 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:37:16.935 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:37:16.979 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:17.002 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:37:17.005 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:17.005 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:37:17.106 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:37:17.165 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:17.227 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:37:17.232 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:17.232 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:37:17.304 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:37:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:37:17] "GET /metrics HTTP/1.1" 200 176617 "" "Prometheus/2.33.4" 2024-02-10T08:37:17.306 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:15.937133+0000 osd.6 (osd.6) 255 : cluster [DBG] 4.1f scrub starts 2024-02-10T08:37:17.306 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:15.944326+0000 osd.6 (osd.6) 256 : cluster [DBG] 4.1f scrub ok 2024-02-10T08:37:17.306 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:15.964174+0000 osd.0 (osd.0) 244 : cluster [DBG] 5.2 scrub starts 2024-02-10T08:37:17.306 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:15.967422+0000 osd.0 (osd.0) 245 : cluster [DBG] 5.2 scrub ok 2024-02-10T08:37:17.306 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:16.561316+0000 osd.2 (osd.2) 237 : cluster [DBG] 2.10 scrub starts 2024-02-10T08:37:17.306 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:16.598477+0000 osd.7 (osd.7) 269 : cluster [DBG] 6.3 deep-scrub starts 2024-02-10T08:37:17.306 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:16.647638+0000 osd.7 (osd.7) 270 : cluster [DBG] 6.3 deep-scrub ok 2024-02-10T08:37:17.306 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:37:16.696812+0000 mon.a (mon.0) 1686 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:37:17.306 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:16.856880+0000 osd.4 (osd.4) 188 : cluster [DBG] 6.17 scrub starts 2024-02-10T08:37:17.306 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:16.999481+0000 osd.4 (osd.4) 189 : cluster [DBG] 6.17 scrub ok 2024-02-10T08:37:17.333 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:37:17.400 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:17.510 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:2024-02-10T08:37:17.510926+0000 min lat: 0.00122517 max lat: 0.0884812 avg lat: 0.007711 2024-02-10T08:37:17.510 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-02-10T08:37:17.510 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 20 16 41506 41490 129.612 84.3125 0.0121861 0.007711 2024-02-10T08:37:17.531 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:37:17.531 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:37:17.534 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:37:17.547 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:37:17.556 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:37:17.565 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:17.566 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:37:17.570 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:15.937133+0000 osd.6 (osd.6) 255 : cluster [DBG] 4.1f scrub starts 2024-02-10T08:37:17.570 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:15.944326+0000 osd.6 (osd.6) 256 : cluster [DBG] 4.1f scrub ok 2024-02-10T08:37:17.570 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:15.964174+0000 osd.0 (osd.0) 244 : cluster [DBG] 5.2 scrub starts 2024-02-10T08:37:17.570 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:15.967422+0000 osd.0 (osd.0) 245 : cluster [DBG] 5.2 scrub ok 2024-02-10T08:37:17.570 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:16.561316+0000 osd.2 (osd.2) 237 : cluster [DBG] 2.10 scrub starts 2024-02-10T08:37:17.570 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:16.598477+0000 osd.7 (osd.7) 269 : cluster [DBG] 6.3 deep-scrub starts 2024-02-10T08:37:17.571 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:16.647638+0000 osd.7 (osd.7) 270 : cluster [DBG] 6.3 deep-scrub ok 2024-02-10T08:37:17.571 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:37:16.696812+0000 mon.a (mon.0) 1686 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:37:17.571 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:16.856880+0000 osd.4 (osd.4) 188 : cluster [DBG] 6.17 scrub starts 2024-02-10T08:37:17.571 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:16.999481+0000 osd.4 (osd.4) 189 : cluster [DBG] 6.17 scrub ok 2024-02-10T08:37:17.577 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:37:17.598 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:37:17.629 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:37:17.663 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:37:17.666 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:37:17.695 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:37:17.709 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:15.937133+0000 osd.6 (osd.6) 255 : cluster [DBG] 4.1f scrub starts 2024-02-10T08:37:17.709 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:15.944326+0000 osd.6 (osd.6) 256 : cluster [DBG] 4.1f scrub ok 2024-02-10T08:37:17.709 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:15.964174+0000 osd.0 (osd.0) 244 : cluster [DBG] 5.2 scrub starts 2024-02-10T08:37:17.709 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:15.967422+0000 osd.0 (osd.0) 245 : cluster [DBG] 5.2 scrub ok 2024-02-10T08:37:17.709 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:16.561316+0000 osd.2 (osd.2) 237 : cluster [DBG] 2.10 scrub starts 2024-02-10T08:37:17.709 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:16.598477+0000 osd.7 (osd.7) 269 : cluster [DBG] 6.3 deep-scrub starts 2024-02-10T08:37:17.709 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:16.647638+0000 osd.7 (osd.7) 270 : cluster [DBG] 6.3 deep-scrub ok 2024-02-10T08:37:17.709 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:37:16.696812+0000 mon.a (mon.0) 1686 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:37:17.709 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:16.856880+0000 osd.4 (osd.4) 188 : cluster [DBG] 6.17 scrub starts 2024-02-10T08:37:17.709 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:16.999481+0000 osd.4 (osd.4) 189 : cluster [DBG] 6.17 scrub ok 2024-02-10T08:37:17.710 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:17.712 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-10T08:37:17.712 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-10T08:37:17.712 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-10T08:37:17.712 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-10T08:37:17.712 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-10T08:37:17.712 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-10T08:37:17.712 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-10T08:37:17.712 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-10T08:37:17.740 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:37:17.743 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:17.744 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:37:17.845 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:37:17.904 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:18.086 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:37:18.090 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:18.091 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:37:18.191 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:37:18.237 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:18.271 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:37:18.274 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:18.275 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:37:18.375 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:37:18.425 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:18.510 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 21 16 42972 42956 127.802 91.625 0.00863896 0.00781953 2024-02-10T08:37:18.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:16.569086+0000 osd.2 (osd.2) 238 : cluster [DBG] 2.10 scrub ok 2024-02-10T08:37:18.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:16.972498+0000 osd.0 (osd.0) 246 : cluster [DBG] 5.13 scrub starts 2024-02-10T08:37:18.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:16.974727+0000 osd.0 (osd.0) 247 : cluster [DBG] 5.13 scrub ok 2024-02-10T08:37:18.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:17.081947+0000 mgr.y (mgr.14505) 770 : cluster [DBG] pgmap v942: 168 pgs: 168 active+clean; 2.1 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 1023 B/s rd, 124 MiB/s wr, 1.99k op/s 2024-02-10T08:37:18.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:37:17.413629+0000 mon.b (mon.1) 88 : audit [DBG] from='client.? 172.21.15.18:0/3169596276' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:37:18.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:17.818432+0000 osd.4 (osd.4) 190 : cluster [DBG] 5.1c deep-scrub starts 2024-02-10T08:37:18.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:17.819648+0000 osd.4 (osd.4) 191 : cluster [DBG] 5.1c deep-scrub ok 2024-02-10T08:37:18.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:16.569086+0000 osd.2 (osd.2) 238 : cluster [DBG] 2.10 scrub ok 2024-02-10T08:37:18.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:16.972498+0000 osd.0 (osd.0) 246 : cluster [DBG] 5.13 scrub starts 2024-02-10T08:37:18.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:16.974727+0000 osd.0 (osd.0) 247 : cluster [DBG] 5.13 scrub ok 2024-02-10T08:37:18.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:17.081947+0000 mgr.y (mgr.14505) 770 : cluster [DBG] pgmap v942: 168 pgs: 168 active+clean; 2.1 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 1023 B/s rd, 124 MiB/s wr, 1.99k op/s 2024-02-10T08:37:18.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:37:17.413629+0000 mon.b (mon.1) 88 : audit [DBG] from='client.? 172.21.15.18:0/3169596276' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:37:18.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:17.818432+0000 osd.4 (osd.4) 190 : cluster [DBG] 5.1c deep-scrub starts 2024-02-10T08:37:18.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:17.819648+0000 osd.4 (osd.4) 191 : cluster [DBG] 5.1c deep-scrub ok 2024-02-10T08:37:18.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:16.569086+0000 osd.2 (osd.2) 238 : cluster [DBG] 2.10 scrub ok 2024-02-10T08:37:18.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:16.972498+0000 osd.0 (osd.0) 246 : cluster [DBG] 5.13 scrub starts 2024-02-10T08:37:18.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:16.974727+0000 osd.0 (osd.0) 247 : cluster [DBG] 5.13 scrub ok 2024-02-10T08:37:18.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:17.081947+0000 mgr.y (mgr.14505) 770 : cluster [DBG] pgmap v942: 168 pgs: 168 active+clean; 2.1 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 1023 B/s rd, 124 MiB/s wr, 1.99k op/s 2024-02-10T08:37:18.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:37:17.413629+0000 mon.b (mon.1) 88 : audit [DBG] from='client.? 172.21.15.18:0/3169596276' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:37:18.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:17.818432+0000 osd.4 (osd.4) 190 : cluster [DBG] 5.1c deep-scrub starts 2024-02-10T08:37:18.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:17.819648+0000 osd.4 (osd.4) 191 : cluster [DBG] 5.1c deep-scrub ok 2024-02-10T08:37:18.662 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd set noscrub 2024-02-10T08:37:19.289 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:37:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:37:19.324 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:18.007365+0000 osd.0 (osd.0) 248 : cluster [DBG] 4.3 scrub starts 2024-02-10T08:37:19.324 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:18.013929+0000 osd.0 (osd.0) 249 : cluster [DBG] 4.3 scrub ok 2024-02-10T08:37:19.324 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:18.594468+0000 osd.7 (osd.7) 271 : cluster [DBG] 6.5 scrub starts 2024-02-10T08:37:19.325 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:18.625613+0000 osd.7 (osd.7) 272 : cluster [DBG] 6.5 scrub ok 2024-02-10T08:37:19.511 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 22 16 44439 44423 126.161 91.6875 0.0120386 0.00792158 2024-02-10T08:37:19.579 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:18.007365+0000 osd.0 (osd.0) 248 : cluster [DBG] 4.3 scrub starts 2024-02-10T08:37:19.580 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:18.013929+0000 osd.0 (osd.0) 249 : cluster [DBG] 4.3 scrub ok 2024-02-10T08:37:19.580 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:18.594468+0000 osd.7 (osd.7) 271 : cluster [DBG] 6.5 scrub starts 2024-02-10T08:37:19.580 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:18.625613+0000 osd.7 (osd.7) 272 : cluster [DBG] 6.5 scrub ok 2024-02-10T08:37:19.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:18.007365+0000 osd.0 (osd.0) 248 : cluster [DBG] 4.3 scrub starts 2024-02-10T08:37:19.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:18.013929+0000 osd.0 (osd.0) 249 : cluster [DBG] 4.3 scrub ok 2024-02-10T08:37:19.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:18.594468+0000 osd.7 (osd.7) 271 : cluster [DBG] 6.5 scrub starts 2024-02-10T08:37:19.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:18.625613+0000 osd.7 (osd.7) 272 : cluster [DBG] 6.5 scrub ok 2024-02-10T08:37:20.196 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:37:20.203 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:20.204 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:37:20.304 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:37:20.343 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:20.374 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:37:20.379 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:20.380 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:37:20.481 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:37:20.511 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 23 16 45915 45899 124.686 92.25 0.0130316 0.00801479 2024-02-10T08:37:20.518 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:20.547 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:37:20.553 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:20.553 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:37:20.654 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:37:20.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:37:18.802881+0000 mgr.y (mgr.14505) 771 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:37:20.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:19.020957+0000 osd.0 (osd.0) 250 : cluster [DBG] 5.5 scrub starts 2024-02-10T08:37:20.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:19.026543+0000 osd.0 (osd.0) 251 : cluster [DBG] 5.5 scrub ok 2024-02-10T08:37:20.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:19.082807+0000 mgr.y (mgr.14505) 772 : cluster [DBG] pgmap v943: 168 pgs: 168 active+clean; 2.6 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 1023 B/s rd, 105 MiB/s wr, 1.67k op/s 2024-02-10T08:37:20.658 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:37:18.802881+0000 mgr.y (mgr.14505) 771 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:37:20.659 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:19.020957+0000 osd.0 (osd.0) 250 : cluster [DBG] 5.5 scrub starts 2024-02-10T08:37:20.659 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:19.026543+0000 osd.0 (osd.0) 251 : cluster [DBG] 5.5 scrub ok 2024-02-10T08:37:20.659 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:19.082807+0000 mgr.y (mgr.14505) 772 : cluster [DBG] pgmap v943: 168 pgs: 168 active+clean; 2.6 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 1023 B/s rd, 105 MiB/s wr, 1.67k op/s 2024-02-10T08:37:20.703 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:37:18.802881+0000 mgr.y (mgr.14505) 771 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:37:20.704 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:19.020957+0000 osd.0 (osd.0) 250 : cluster [DBG] 5.5 scrub starts 2024-02-10T08:37:20.704 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:19.026543+0000 osd.0 (osd.0) 251 : cluster [DBG] 5.5 scrub ok 2024-02-10T08:37:20.704 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:19.082807+0000 mgr.y (mgr.14505) 772 : cluster [DBG] pgmap v943: 168 pgs: 168 active+clean; 2.6 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 1023 B/s rd, 105 MiB/s wr, 1.67k op/s 2024-02-10T08:37:20.706 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:20.745 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:37:20.749 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:20.749 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:37:20.850 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:37:20.885 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:20.923 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:37:20.928 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:20.929 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:37:21.001 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-02-10T08:37:21.001 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:37:21.029 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:37:21.074 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:21.100 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:37:21.105 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:21.106 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:37:21.207 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:37:21.261 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:21.326 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:19.968438+0000 osd.6 (osd.6) 257 : cluster [DBG] 2.14 scrub starts 2024-02-10T08:37:21.326 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:19.973751+0000 osd.6 (osd.6) 258 : cluster [DBG] 2.14 scrub ok 2024-02-10T08:37:21.327 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:37:21.335 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:21.336 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:37:21.437 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:37:21.482 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:21.511 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 24 16 47380 47364 123.305 91.5625 0.00770839 0.00810448 2024-02-10T08:37:21.515 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:37:21.520 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:21.521 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:37:21.621 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:37:21.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:19.968438+0000 osd.6 (osd.6) 257 : cluster [DBG] 2.14 scrub starts 2024-02-10T08:37:21.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:19.973751+0000 osd.6 (osd.6) 258 : cluster [DBG] 2.14 scrub ok 2024-02-10T08:37:21.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:19.968438+0000 osd.6 (osd.6) 257 : cluster [DBG] 2.14 scrub starts 2024-02-10T08:37:21.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:19.973751+0000 osd.6 (osd.6) 258 : cluster [DBG] 2.14 scrub ok 2024-02-10T08:37:21.666 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:21.690 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:37:21.696 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:21.696 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:37:21.797 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:37:21.863 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:21.906 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:37:21.911 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:21.912 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:37:21.921 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:37:22.013 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:37:22.073 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:22.234 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-10T08:37:22.513 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 25 16 48748 48732 121.786 85.5 0.0101249 0.00820581 2024-02-10T08:37:22.608 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:21.083837+0000 mgr.y (mgr.14505) 773 : cluster [DBG] pgmap v944: 168 pgs: 168 active+clean; 2.6 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 1023 B/s rd, 103 MiB/s wr, 1.65k op/s 2024-02-10T08:37:22.608 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:21.095151+0000 osd.0 (osd.0) 252 : cluster [DBG] 6.0 scrub starts 2024-02-10T08:37:22.608 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:21.098294+0000 osd.0 (osd.0) 253 : cluster [DBG] 6.0 scrub ok 2024-02-10T08:37:22.609 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:21.511656+0000 osd.6 (osd.6) 259 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:37:22.609 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:21.511708+0000 osd.6 (osd.6) 260 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:37:22.609 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:22.103677+0000 osd.1 (osd.1) 282 : cluster [DBG] 4.14 scrub starts 2024-02-10T08:37:22.609 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:22.110927+0000 osd.1 (osd.1) 283 : cluster [DBG] 4.14 scrub ok 2024-02-10T08:37:22.610 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:21.083837+0000 mgr.y (mgr.14505) 773 : cluster [DBG] pgmap v944: 168 pgs: 168 active+clean; 2.6 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 1023 B/s rd, 103 MiB/s wr, 1.65k op/s 2024-02-10T08:37:22.610 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:21.095151+0000 osd.0 (osd.0) 252 : cluster [DBG] 6.0 scrub starts 2024-02-10T08:37:22.610 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:21.098294+0000 osd.0 (osd.0) 253 : cluster [DBG] 6.0 scrub ok 2024-02-10T08:37:22.610 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:21.511656+0000 osd.6 (osd.6) 259 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:37:22.610 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:21.511708+0000 osd.6 (osd.6) 260 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:37:22.610 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:22.103677+0000 osd.1 (osd.1) 282 : cluster [DBG] 4.14 scrub starts 2024-02-10T08:37:22.610 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:22.110927+0000 osd.1 (osd.1) 283 : cluster [DBG] 4.14 scrub ok 2024-02-10T08:37:22.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:21.083837+0000 mgr.y (mgr.14505) 773 : cluster [DBG] pgmap v944: 168 pgs: 168 active+clean; 2.6 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 1023 B/s rd, 103 MiB/s wr, 1.65k op/s 2024-02-10T08:37:22.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:21.095151+0000 osd.0 (osd.0) 252 : cluster [DBG] 6.0 scrub starts 2024-02-10T08:37:22.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:21.098294+0000 osd.0 (osd.0) 253 : cluster [DBG] 6.0 scrub ok 2024-02-10T08:37:22.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:21.511656+0000 osd.6 (osd.6) 259 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:37:22.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:21.511708+0000 osd.6 (osd.6) 260 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:37:22.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:22.103677+0000 osd.1 (osd.1) 282 : cluster [DBG] 4.14 scrub starts 2024-02-10T08:37:22.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:22.110927+0000 osd.1 (osd.1) 283 : cluster [DBG] 4.14 scrub ok 2024-02-10T08:37:22.947 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:37:22.953 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-02-10T08:37:23.181 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.3 dump_historic_ops 2024-02-10T08:37:23.436 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:37:23.442 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:23.442 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:37:23.513 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 26 16 49977 49961 120.052 76.8125 0.0108189 0.00832406 2024-02-10T08:37:23.543 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:37:23.564 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:22.351174+0000 mon.a (mon.0) 1687 : cluster [DBG] osdmap e404: 8 total, 8 up, 8 in 2024-02-10T08:37:23.564 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:22.351174+0000 mon.a (mon.0) 1687 : cluster [DBG] osdmap e404: 8 total, 8 up, 8 in 2024-02-10T08:37:23.576 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:23.605 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:37:23.609 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:23.609 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:37:23.710 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:37:23.773 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:23.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:22.351174+0000 mon.a (mon.0) 1687 : cluster [DBG] osdmap e404: 8 total, 8 up, 8 in 2024-02-10T08:37:24.086 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":945,"stamp":"2024-02-10T08:37:22.358375+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2772965028,"num_objects":42504,"num_object_clones":0,"num_object_copies":127512,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42504,"num_whiteouts":0,"num_read":2759,"num_read_kb":2511,"num_write":43311,"num_write_kb":2708008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":230,"num_bytes_recovered":7872,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43451,"ondisk_log_size":43451,"up":504,"acting":504,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":504,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":13582828,"kb_used_data":7954092,"kb_used_omap":0,"kb_used_meta":5628671,"kb_avail":736378388,"statfs":{"total":767960285184,"available":754051469312,"internally_reserved":0,"allocated":8144990208,"data_stored":8141829276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":972,"internal_metadata":5763759156},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,4,3,3,2],"upper_bound":64},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":594411520,"num_objects":9070,"num_object_clones":0,"num_object_copies":27210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9070,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":9070,"num_write_kb":580480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.278118"},"pg_stats":[{"pgid":"6.33","version":"0'0","reported_seq":296,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.178339+0000","last_change":"2024-02-10T08:34:13.373898+0000","last_active":"2024-02-10T08:37:01.178339+0000","last_peered":"2024-02-10T08:37:01.178339+0000","last_clean":"2024-02-10T08:37:01.178339+0000","last_became_active":"2024-02-10T08:30:26.080326+0000","last_became_peered":"2024-02-10T08:30:26.080326+0000","last_unstale":"2024-02-10T08:37:01.178339+0000","last_undegraded":"2024-02-10T08:37:01.178339+0000","last_fullsized":"2024-02-10T08:37:01.178339+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:13.373809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:34:13.373809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2],"acting":[5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":404,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.186817+0000","last_change":"2024-02-10T08:36:54.916630+0000","last_active":"2024-02-10T08:37:01.186817+0000","last_peered":"2024-02-10T08:37:01.186817+0000","last_clean":"2024-02-10T08:37:01.186817+0000","last_became_active":"2024-02-10T08:30:26.067019+0000","last_became_peered":"2024-02-10T08:30:26.067019+0000","last_unstale":"2024-02-10T08:37:01.186817+0000","last_undegraded":"2024-02-10T08:37:01.186817+0000","last_fullsized":"2024-02-10T08:37:01.186817+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:54.916549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:33:31.389113+0000","last_clean_scrub_stamp":"2024-02-10T08:36:54.916549+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"403'2610","reported_seq":2623,"reported_epoch":403,"state":"active+clean","last_fresh":"2024-02-10T08:37:17.791771+0000","last_change":"2024-02-10T08:36:45.138604+0000","last_active":"2024-02-10T08:37:17.791771+0000","last_peered":"2024-02-10T08:37:17.791771+0000","last_clean":"2024-02-10T08:37:17.791771+0000","last_became_active":"2024-02-10T08:36:45.138356+0000","last_became_peered":"2024-02-10T08:36:45.138356+0000","last_unstale":"2024-02-10T08:37:17.791771+0000","last_undegraded":"2024-02-10T08:37:17.791771+0000","last_fullsized":"2024-02-10T08:37:17.791771+0000","mapping_epoch":398,"log_start":"0'0","ondisk_log_start":"0'0","created":398,"last_epoch_clean":399,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_clean_scrub_stamp":"2024-02-10T08:36:44.122988+0000","log_size":2610,"ondisk_log_size":2610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":171048960,"num_objects":2610,"num_object_clones":0,"num_object_copies":7830,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2610,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2610,"num_write_kb":167040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,4],"acting":[5,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"111'10","reported_seq":658,"reported_epoch":403,"state":"active+clean","last_fresh":"2024-02-10T08:37:15.313779+0000","last_change":"2024-02-10T08:34:09.351432+0000","last_active":"2024-02-10T08:37:15.313779+0000","last_peered":"2024-02-10T08:37:15.313779+0000","last_clean":"2024-02-10T08:37:15.313779+0000","last_became_active":"2024-02-10T08:20:46.399193+0000","last_became_peered":"2024-02-10T08:20:46.399193+0000","last_unstale":"2024-02-10T08:37:15.313779+0000","last_undegraded":"2024-02-10T08:37:15.313779+0000","last_fullsized":"2024-02-10T08:37:15.313779+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'10","last_scrub_stamp":"2024-02-10T08:34:09.351338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:34:09.351338+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"402'39","reported_seq":440,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.775238+0000","last_change":"2024-02-10T08:33:23.049805+0000","last_active":"2024-02-10T08:37:01.775238+0000","last_peered":"2024-02-10T08:37:01.775238+0000","last_clean":"2024-02-10T08:37:01.775238+0000","last_became_active":"2024-02-10T08:16:55.204597+0000","last_became_peered":"2024-02-10T08:16:55.204597+0000","last_unstale":"2024-02-10T08:37:01.775238+0000","last_undegraded":"2024-02-10T08:37:01.775238+0000","last_fullsized":"2024-02-10T08:37:01.775238+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'27","last_scrub_stamp":"2024-02-10T08:33:23.049704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:33:23.049704+0000","log_size":39,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":62,"num_read_kb":53,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":426,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:09.466084+0000","last_change":"2024-02-10T08:37:09.466048+0000","last_active":"2024-02-10T08:37:09.466084+0000","last_peered":"2024-02-10T08:37:09.466084+0000","last_clean":"2024-02-10T08:37:09.466084+0000","last_became_active":"2024-02-10T08:32:20.330612+0000","last_became_peered":"2024-02-10T08:32:20.330612+0000","last_unstale":"2024-02-10T08:37:09.466084+0000","last_undegraded":"2024-02-10T08:37:09.466084+0000","last_fullsized":"2024-02-10T08:37:09.466084+0000","mapping_epoch":331,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":332,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:09.465954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:29:24.554978+0000","last_clean_scrub_stamp":"2024-02-10T08:37:09.465954+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":402,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.178283+0000","last_change":"2024-02-10T08:34:09.307523+0000","last_active":"2024-02-10T08:37:01.178283+0000","last_peered":"2024-02-10T08:37:01.178283+0000","last_clean":"2024-02-10T08:37:01.178283+0000","last_became_active":"2024-02-10T08:30:24.062795+0000","last_became_peered":"2024-02-10T08:30:24.062795+0000","last_unstale":"2024-02-10T08:37:01.178283+0000","last_undegraded":"2024-02-10T08:37:01.178283+0000","last_fullsized":"2024-02-10T08:37:01.178283+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:09.307434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:20.392249+0000","last_clean_scrub_stamp":"2024-02-10T08:34:09.307434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"403'2564","reported_seq":2575,"reported_epoch":403,"state":"active+clean","last_fresh":"2024-02-10T08:37:17.857249+0000","last_change":"2024-02-10T08:36:45.141649+0000","last_active":"2024-02-10T08:37:17.857249+0000","last_peered":"2024-02-10T08:37:17.857249+0000","last_clean":"2024-02-10T08:37:17.857249+0000","last_became_active":"2024-02-10T08:36:45.141344+0000","last_became_peered":"2024-02-10T08:36:45.141344+0000","last_unstale":"2024-02-10T08:37:17.857249+0000","last_undegraded":"2024-02-10T08:37:17.857249+0000","last_fullsized":"2024-02-10T08:37:17.857249+0000","mapping_epoch":398,"log_start":"0'0","ondisk_log_start":"0'0","created":398,"last_epoch_clean":399,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_clean_scrub_stamp":"2024-02-10T08:36:44.122988+0000","log_size":2564,"ondisk_log_size":2564,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":168034304,"num_objects":2564,"num_object_clones":0,"num_object_copies":7692,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2564,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2564,"num_write_kb":164096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"402'21","reported_seq":203,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.886281+0000","last_change":"2024-02-10T08:35:10.248379+0000","last_active":"2024-02-10T08:37:01.886281+0000","last_peered":"2024-02-10T08:37:01.886281+0000","last_clean":"2024-02-10T08:37:01.886281+0000","last_became_active":"2024-02-10T08:28:02.770508+0000","last_became_peered":"2024-02-10T08:28:02.770508+0000","last_unstale":"2024-02-10T08:37:01.886281+0000","last_undegraded":"2024-02-10T08:37:01.886281+0000","last_fullsized":"2024-02-10T08:37:01.886281+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'15","last_scrub_stamp":"2024-02-10T08:35:10.248283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:35:10.248283+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":34,"num_read_kb":28,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":402,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:13.005143+0000","last_change":"2024-02-10T08:37:13.005099+0000","last_active":"2024-02-10T08:37:13.005143+0000","last_peered":"2024-02-10T08:37:13.005143+0000","last_clean":"2024-02-10T08:37:13.005143+0000","last_became_active":"2024-02-10T08:20:46.407311+0000","last_became_peered":"2024-02-10T08:20:46.407311+0000","last_unstale":"2024-02-10T08:37:13.005143+0000","last_undegraded":"2024-02-10T08:37:13.005143+0000","last_fullsized":"2024-02-10T08:37:13.005143+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:13.004991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:21.523096+0000","last_clean_scrub_stamp":"2024-02-10T08:37:13.004991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":434,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.185834+0000","last_change":"2024-02-10T08:36:08.684752+0000","last_active":"2024-02-10T08:37:01.185834+0000","last_peered":"2024-02-10T08:37:01.185834+0000","last_clean":"2024-02-10T08:37:01.185834+0000","last_became_active":"2024-02-10T08:31:33.882809+0000","last_became_peered":"2024-02-10T08:31:33.882809+0000","last_unstale":"2024-02-10T08:37:01.185834+0000","last_undegraded":"2024-02-10T08:37:01.185834+0000","last_fullsized":"2024-02-10T08:37:01.185834+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:08.684646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:36:08.684646+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"76'2","reported_seq":78,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.190242+0000","last_change":"2024-02-10T08:34:24.132606+0000","last_active":"2024-02-10T08:37:01.190242+0000","last_peered":"2024-02-10T08:37:01.190242+0000","last_clean":"2024-02-10T08:37:01.190242+0000","last_became_active":"2024-02-10T08:32:36.979100+0000","last_became_peered":"2024-02-10T08:32:36.979100+0000","last_unstale":"2024-02-10T08:37:01.190242+0000","last_undegraded":"2024-02-10T08:37:01.190242+0000","last_fullsized":"2024-02-10T08:37:01.190242+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'2","last_scrub_stamp":"2024-02-10T08:34:24.132513+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2024-02-10T08:18:08.680038+0000","last_clean_scrub_stamp":"2024-02-10T08:34:24.132513+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.5","version":"403'2582","reported_seq":2595,"reported_epoch":403,"state":"active+clean","last_fresh":"2024-02-10T08:37:17.857832+0000","last_change":"2024-02-10T08:36:45.141686+0000","last_active":"2024-02-10T08:37:17.857832+0000","last_peered":"2024-02-10T08:37:17.857832+0000","last_clean":"2024-02-10T08:37:17.857832+0000","last_became_active":"2024-02-10T08:36:45.141444+0000","last_became_peered":"2024-02-10T08:36:45.141444+0000","last_unstale":"2024-02-10T08:37:17.857832+0000","last_undegraded":"2024-02-10T08:37:17.857832+0000","last_fullsized":"2024-02-10T08:37:17.857832+0000","mapping_epoch":398,"log_start":"0'0","ondisk_log_start":"0'0","created":398,"last_epoch_clean":399,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_clean_scrub_stamp":"2024-02-10T08:36:44.122988+0000","log_size":2582,"ondisk_log_size":2582,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":169213952,"num_objects":2582,"num_object_clones":0,"num_object_copies":7746,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2582,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2582,"num_write_kb":165248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"402'60","reported_seq":472,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:02.152831+0000","last_change":"2024-02-10T08:36:15.980603+0000","last_active":"2024-02-10T08:37:02.152831+0000","last_peered":"2024-02-10T08:37:02.152831+0000","last_clean":"2024-02-10T08:37:02.152831+0000","last_became_active":"2024-02-10T08:16:55.203415+0000","last_became_peered":"2024-02-10T08:16:55.203415+0000","last_unstale":"2024-02-10T08:37:02.152831+0000","last_undegraded":"2024-02-10T08:37:02.152831+0000","last_fullsized":"2024-02-10T08:37:02.152831+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"391'44","last_scrub_stamp":"2024-02-10T08:36:15.980533+0000","last_deep_scrub":"391'44","last_deep_scrub_stamp":"2024-02-10T08:36:15.980533+0000","last_clean_scrub_stamp":"2024-02-10T08:36:15.980533+0000","log_size":60,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":80,"num_read_kb":69,"num_write":52,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":410,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.187174+0000","last_change":"2024-02-10T08:36:06.679301+0000","last_active":"2024-02-10T08:37:01.187174+0000","last_peered":"2024-02-10T08:37:01.187174+0000","last_clean":"2024-02-10T08:37:01.187174+0000","last_became_active":"2024-02-10T08:28:02.781029+0000","last_became_peered":"2024-02-10T08:28:02.781029+0000","last_unstale":"2024-02-10T08:37:01.187174+0000","last_undegraded":"2024-02-10T08:37:01.187174+0000","last_fullsized":"2024-02-10T08:37:01.187174+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:06.679173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:36:06.679173+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":406,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:02.347461+0000","last_change":"2024-02-10T08:37:02.347418+0000","last_active":"2024-02-10T08:37:02.347461+0000","last_peered":"2024-02-10T08:37:02.347461+0000","last_clean":"2024-02-10T08:37:02.347461+0000","last_became_active":"2024-02-10T08:28:02.779438+0000","last_became_peered":"2024-02-10T08:28:02.779438+0000","last_unstale":"2024-02-10T08:37:02.347461+0000","last_undegraded":"2024-02-10T08:37:02.347461+0000","last_fullsized":"2024-02-10T08:37:02.347461+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:02.347279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.593849+0000","last_clean_scrub_stamp":"2024-02-10T08:37:02.347279+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":393,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:07.611503+0000","last_change":"2024-02-10T08:37:07.611471+0000","last_active":"2024-02-10T08:37:07.611503+0000","last_peered":"2024-02-10T08:37:07.611503+0000","last_clean":"2024-02-10T08:37:07.611503+0000","last_became_active":"2024-02-10T08:24:18.645480+0000","last_became_peered":"2024-02-10T08:24:18.645480+0000","last_unstale":"2024-02-10T08:37:07.611503+0000","last_undegraded":"2024-02-10T08:37:07.611503+0000","last_fullsized":"2024-02-10T08:37:07.611503+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:07.611383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:37:07.611383+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,3],"acting":[7,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2","version":"403'2638","reported_seq":2651,"reported_epoch":403,"state":"active+clean","last_fresh":"2024-02-10T08:37:18.069632+0000","last_change":"2024-02-10T08:36:45.372419+0000","last_active":"2024-02-10T08:37:18.069632+0000","last_peered":"2024-02-10T08:37:18.069632+0000","last_clean":"2024-02-10T08:37:18.069632+0000","last_became_active":"2024-02-10T08:36:45.372098+0000","last_became_peered":"2024-02-10T08:36:45.372098+0000","last_unstale":"2024-02-10T08:37:18.069632+0000","last_undegraded":"2024-02-10T08:37:18.069632+0000","last_fullsized":"2024-02-10T08:37:18.069632+0000","mapping_epoch":398,"log_start":"0'0","ondisk_log_start":"0'0","created":398,"last_epoch_clean":399,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_clean_scrub_stamp":"2024-02-10T08:36:44.122988+0000","log_size":2638,"ondisk_log_size":2638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":172883968,"num_objects":2638,"num_object_clones":0,"num_object_copies":7914,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2638,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2638,"num_write_kb":168832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"402'45","reported_seq":144,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:02.003649+0000","last_change":"2024-02-10T08:36:18.225301+0000","last_active":"2024-02-10T08:37:02.003649+0000","last_peered":"2024-02-10T08:37:02.003649+0000","last_clean":"2024-02-10T08:37:02.003649+0000","last_became_active":"2024-02-10T08:31:46.070488+0000","last_became_peered":"2024-02-10T08:31:46.070488+0000","last_unstale":"2024-02-10T08:37:02.003649+0000","last_undegraded":"2024-02-10T08:37:02.003649+0000","last_fullsized":"2024-02-10T08:37:02.003649+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'31","last_scrub_stamp":"2024-02-10T08:36:18.225215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:36:18.225215+0000","log_size":45,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":69,"num_read_kb":59,"num_write":46,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":438,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.184016+0000","last_change":"2024-02-10T08:36:56.517345+0000","last_active":"2024-02-10T08:37:01.184016+0000","last_peered":"2024-02-10T08:37:01.184016+0000","last_clean":"2024-02-10T08:37:01.184016+0000","last_became_active":"2024-02-10T08:20:46.399568+0000","last_became_peered":"2024-02-10T08:20:46.399568+0000","last_unstale":"2024-02-10T08:37:01.184016+0000","last_undegraded":"2024-02-10T08:37:01.184016+0000","last_fullsized":"2024-02-10T08:37:01.184016+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:56.517278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:36:56.517278+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":411,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.197472+0000","last_change":"2024-02-10T08:36:28.930123+0000","last_active":"2024-02-10T08:37:01.197472+0000","last_peered":"2024-02-10T08:37:01.197472+0000","last_clean":"2024-02-10T08:37:01.197472+0000","last_became_active":"2024-02-10T08:28:02.764210+0000","last_became_peered":"2024-02-10T08:28:02.764210+0000","last_unstale":"2024-02-10T08:37:01.197472+0000","last_undegraded":"2024-02-10T08:37:01.197472+0000","last_fullsized":"2024-02-10T08:37:01.197472+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:28.929999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:36:28.929999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":353,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.190855+0000","last_change":"2024-02-10T08:34:23.258089+0000","last_active":"2024-02-10T08:37:01.190855+0000","last_peered":"2024-02-10T08:37:01.190855+0000","last_clean":"2024-02-10T08:37:01.190855+0000","last_became_active":"2024-02-10T08:31:33.883457+0000","last_became_peered":"2024-02-10T08:31:33.883457+0000","last_unstale":"2024-02-10T08:37:01.190855+0000","last_undegraded":"2024-02-10T08:37:01.190855+0000","last_fullsized":"2024-02-10T08:37:01.190855+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:23.258018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:34.215363+0000","last_clean_scrub_stamp":"2024-02-10T08:34:23.258018+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3","version":"403'2619","reported_seq":2632,"reported_epoch":403,"state":"active+clean","last_fresh":"2024-02-10T08:37:17.882354+0000","last_change":"2024-02-10T08:36:45.142338+0000","last_active":"2024-02-10T08:37:17.882354+0000","last_peered":"2024-02-10T08:37:17.882354+0000","last_clean":"2024-02-10T08:37:17.882354+0000","last_became_active":"2024-02-10T08:36:45.141955+0000","last_became_peered":"2024-02-10T08:36:45.141955+0000","last_unstale":"2024-02-10T08:37:17.882354+0000","last_undegraded":"2024-02-10T08:37:17.882354+0000","last_fullsized":"2024-02-10T08:37:17.882354+0000","mapping_epoch":398,"log_start":"0'0","ondisk_log_start":"0'0","created":398,"last_epoch_clean":399,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_clean_scrub_stamp":"2024-02-10T08:36:44.122988+0000","log_size":2619,"ondisk_log_size":2619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":171638784,"num_objects":2619,"num_object_clones":0,"num_object_copies":7857,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2619,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2619,"num_write_kb":167616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1],"acting":[6,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"402'30","reported_seq":411,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.780996+0000","last_change":"2024-02-10T08:35:23.121276+0000","last_active":"2024-02-10T08:37:01.780996+0000","last_peered":"2024-02-10T08:37:01.780996+0000","last_clean":"2024-02-10T08:37:01.780996+0000","last_became_active":"2024-02-10T08:20:46.398973+0000","last_became_peered":"2024-02-10T08:20:46.398973+0000","last_unstale":"2024-02-10T08:37:01.780996+0000","last_undegraded":"2024-02-10T08:37:01.780996+0000","last_fullsized":"2024-02-10T08:37:01.780996+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'20","last_scrub_stamp":"2024-02-10T08:35:23.121164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:35:23.121164+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":39,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":382,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.195183+0000","last_change":"2024-02-10T08:36:04.761005+0000","last_active":"2024-02-10T08:37:01.195183+0000","last_peered":"2024-02-10T08:37:01.195183+0000","last_clean":"2024-02-10T08:37:01.195183+0000","last_became_active":"2024-02-10T08:16:52.785545+0000","last_became_peered":"2024-02-10T08:16:52.785545+0000","last_unstale":"2024-02-10T08:37:01.195183+0000","last_undegraded":"2024-02-10T08:37:01.195183+0000","last_fullsized":"2024-02-10T08:37:01.195183+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:04.760903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:36:04.760903+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"62'8","reported_seq":641,"reported_epoch":403,"state":"active+clean","last_fresh":"2024-02-10T08:37:15.304285+0000","last_change":"2024-02-10T08:37:04.315586+0000","last_active":"2024-02-10T08:37:15.304285+0000","last_peered":"2024-02-10T08:37:15.304285+0000","last_clean":"2024-02-10T08:37:15.304285+0000","last_became_active":"2024-02-10T08:16:56.858101+0000","last_became_peered":"2024-02-10T08:16:56.858101+0000","last_unstale":"2024-02-10T08:37:15.304285+0000","last_undegraded":"2024-02-10T08:37:15.304285+0000","last_fullsized":"2024-02-10T08:37:15.304285+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'8","last_scrub_stamp":"2024-02-10T08:37:04.315488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:37:04.315488+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":360,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.188064+0000","last_change":"2024-02-10T08:36:27.252813+0000","last_active":"2024-02-10T08:37:01.188064+0000","last_peered":"2024-02-10T08:37:01.188064+0000","last_clean":"2024-02-10T08:37:01.188064+0000","last_became_active":"2024-02-10T08:30:24.071020+0000","last_became_peered":"2024-02-10T08:30:24.071020+0000","last_unstale":"2024-02-10T08:37:01.188064+0000","last_undegraded":"2024-02-10T08:37:01.188064+0000","last_fullsized":"2024-02-10T08:37:01.188064+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:27.252710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:33:29.477480+0000","last_clean_scrub_stamp":"2024-02-10T08:36:27.252710+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.0","version":"403'2593","reported_seq":2606,"reported_epoch":403,"state":"active+clean","last_fresh":"2024-02-10T08:37:17.928129+0000","last_change":"2024-02-10T08:36:45.373529+0000","last_active":"2024-02-10T08:37:17.928129+0000","last_peered":"2024-02-10T08:37:17.928129+0000","last_clean":"2024-02-10T08:37:17.928129+0000","last_became_active":"2024-02-10T08:36:45.373241+0000","last_became_peered":"2024-02-10T08:36:45.373241+0000","last_unstale":"2024-02-10T08:37:17.928129+0000","last_undegraded":"2024-02-10T08:37:17.928129+0000","last_fullsized":"2024-02-10T08:37:17.928129+0000","mapping_epoch":398,"log_start":"0'0","ondisk_log_start":"0'0","created":398,"last_epoch_clean":399,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_clean_scrub_stamp":"2024-02-10T08:36:44.122988+0000","log_size":2593,"ondisk_log_size":2593,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":169934848,"num_objects":2593,"num_object_clones":0,"num_object_copies":7779,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2593,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2593,"num_write_kb":165952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"402'39","reported_seq":428,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:02.160371+0000","last_change":"2024-02-10T08:36:25.673449+0000","last_active":"2024-02-10T08:37:02.160371+0000","last_peered":"2024-02-10T08:37:02.160371+0000","last_clean":"2024-02-10T08:37:02.160371+0000","last_became_active":"2024-02-10T08:20:46.401777+0000","last_became_peered":"2024-02-10T08:20:46.401777+0000","last_unstale":"2024-02-10T08:37:02.160371+0000","last_undegraded":"2024-02-10T08:37:02.160371+0000","last_fullsized":"2024-02-10T08:37:02.160371+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"226'27","last_scrub_stamp":"2024-02-10T08:36:25.673374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:36:25.673374+0000","log_size":39,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":62,"num_read_kb":53,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":387,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:14.034665+0000","last_change":"2024-02-10T08:37:14.034628+0000","last_active":"2024-02-10T08:37:14.034665+0000","last_peered":"2024-02-10T08:37:14.034665+0000","last_clean":"2024-02-10T08:37:14.034665+0000","last_became_active":"2024-02-10T08:16:52.783634+0000","last_became_peered":"2024-02-10T08:16:52.783634+0000","last_unstale":"2024-02-10T08:37:14.034665+0000","last_undegraded":"2024-02-10T08:37:14.034665+0000","last_fullsized":"2024-02-10T08:37:14.034665+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:14.034555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:37:14.034555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"318'14","reported_seq":176,"reported_epoch":403,"state":"active+clean","last_fresh":"2024-02-10T08:37:15.299639+0000","last_change":"2024-02-10T08:36:55.934111+0000","last_active":"2024-02-10T08:37:15.299639+0000","last_peered":"2024-02-10T08:37:15.299639+0000","last_clean":"2024-02-10T08:37:15.299639+0000","last_became_active":"2024-02-10T08:31:46.073265+0000","last_became_peered":"2024-02-10T08:31:46.073265+0000","last_unstale":"2024-02-10T08:37:15.299639+0000","last_undegraded":"2024-02-10T08:37:15.299639+0000","last_fullsized":"2024-02-10T08:37:15.299639+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"318'14","last_scrub_stamp":"2024-02-10T08:36:55.934036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:36:55.934036+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":402,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.178856+0000","last_change":"2024-02-10T08:35:23.093480+0000","last_active":"2024-02-10T08:37:01.178856+0000","last_peered":"2024-02-10T08:37:01.178856+0000","last_clean":"2024-02-10T08:37:01.178856+0000","last_became_active":"2024-02-10T08:32:36.978932+0000","last_became_peered":"2024-02-10T08:32:36.978932+0000","last_unstale":"2024-02-10T08:37:01.178856+0000","last_undegraded":"2024-02-10T08:37:01.178856+0000","last_fullsized":"2024-02-10T08:37:01.178856+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:35:23.093373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:35:23.093373+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1","version":"403'2610","reported_seq":2623,"reported_epoch":403,"state":"active+clean","last_fresh":"2024-02-10T08:37:17.831117+0000","last_change":"2024-02-10T08:36:45.373702+0000","last_active":"2024-02-10T08:37:17.831117+0000","last_peered":"2024-02-10T08:37:17.831117+0000","last_clean":"2024-02-10T08:37:17.831117+0000","last_became_active":"2024-02-10T08:36:45.373418+0000","last_became_peered":"2024-02-10T08:36:45.373418+0000","last_unstale":"2024-02-10T08:37:17.831117+0000","last_undegraded":"2024-02-10T08:37:17.831117+0000","last_fullsized":"2024-02-10T08:37:17.831117+0000","mapping_epoch":398,"log_start":"0'0","ondisk_log_start":"0'0","created":398,"last_epoch_clean":399,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_clean_scrub_stamp":"2024-02-10T08:36:44.122988+0000","log_size":2610,"ondisk_log_size":2610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":171048960,"num_objects":2610,"num_object_clones":0,"num_object_copies":7830,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2610,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2610,"num_write_kb":167040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"402'32","reported_seq":415,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:02.014340+0000","last_change":"2024-02-10T08:36:17.241143+0000","last_active":"2024-02-10T08:37:02.014340+0000","last_peered":"2024-02-10T08:37:02.014340+0000","last_clean":"2024-02-10T08:37:02.014340+0000","last_became_active":"2024-02-10T08:20:46.406023+0000","last_became_peered":"2024-02-10T08:20:46.406023+0000","last_unstale":"2024-02-10T08:37:02.014340+0000","last_undegraded":"2024-02-10T08:37:02.014340+0000","last_fullsized":"2024-02-10T08:37:02.014340+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'24","last_scrub_stamp":"2024-02-10T08:36:17.241057+0000","last_deep_scrub":"76'16","last_deep_scrub_stamp":"2024-02-10T08:18:07.909782+0000","last_clean_scrub_stamp":"2024-02-10T08:36:17.241057+0000","log_size":32,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":399,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.183346+0000","last_change":"2024-02-10T08:36:21.439261+0000","last_active":"2024-02-10T08:37:01.183346+0000","last_peered":"2024-02-10T08:37:01.183346+0000","last_clean":"2024-02-10T08:37:01.183346+0000","last_became_active":"2024-02-10T08:28:02.768633+0000","last_became_peered":"2024-02-10T08:28:02.768633+0000","last_unstale":"2024-02-10T08:37:01.183346+0000","last_undegraded":"2024-02-10T08:37:01.183346+0000","last_fullsized":"2024-02-10T08:37:01.183346+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:21.439160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:36:21.439160+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":446,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.180537+0000","last_change":"2024-02-10T08:36:02.062993+0000","last_active":"2024-02-10T08:37:01.180537+0000","last_peered":"2024-02-10T08:37:01.180537+0000","last_clean":"2024-02-10T08:37:01.180537+0000","last_became_active":"2024-02-10T08:20:46.400500+0000","last_became_peered":"2024-02-10T08:20:46.400500+0000","last_unstale":"2024-02-10T08:37:01.180537+0000","last_undegraded":"2024-02-10T08:37:01.180537+0000","last_fullsized":"2024-02-10T08:37:01.180537+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:02.062895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:36:02.062895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":319,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.185116+0000","last_change":"2024-02-10T08:36:58.006547+0000","last_active":"2024-02-10T08:37:01.185116+0000","last_peered":"2024-02-10T08:37:01.185116+0000","last_clean":"2024-02-10T08:37:01.185116+0000","last_became_active":"2024-02-10T08:31:33.880969+0000","last_became_peered":"2024-02-10T08:31:33.880969+0000","last_unstale":"2024-02-10T08:37:01.185116+0000","last_undegraded":"2024-02-10T08:37:01.185116+0000","last_fullsized":"2024-02-10T08:37:01.185116+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:58.006464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:20:30.227375+0000","last_clean_scrub_stamp":"2024-02-10T08:36:58.006464+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.e","version":"403'2837","reported_seq":2850,"reported_epoch":403,"state":"active+clean","last_fresh":"2024-02-10T08:37:19.647306+0000","last_change":"2024-02-10T08:36:45.140660+0000","last_active":"2024-02-10T08:37:19.647306+0000","last_peered":"2024-02-10T08:37:19.647306+0000","last_clean":"2024-02-10T08:37:19.647306+0000","last_became_active":"2024-02-10T08:36:45.140350+0000","last_became_peered":"2024-02-10T08:36:45.140350+0000","last_unstale":"2024-02-10T08:37:19.647306+0000","last_undegraded":"2024-02-10T08:37:19.647306+0000","last_fullsized":"2024-02-10T08:37:19.647306+0000","mapping_epoch":398,"log_start":"0'0","ondisk_log_start":"0'0","created":398,"last_epoch_clean":399,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_clean_scrub_stamp":"2024-02-10T08:36:44.122988+0000","log_size":2837,"ondisk_log_size":2837,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":185925632,"num_objects":2837,"num_object_clones":0,"num_object_copies":8511,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2837,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2837,"num_write_kb":181568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7],"acting":[4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"314'14","reported_seq":518,"reported_epoch":403,"state":"active+clean","last_fresh":"2024-02-10T08:37:15.312226+0000","last_change":"2024-02-10T08:37:09.977486+0000","last_active":"2024-02-10T08:37:15.312226+0000","last_peered":"2024-02-10T08:37:15.312226+0000","last_clean":"2024-02-10T08:37:15.312226+0000","last_became_active":"2024-02-10T08:31:33.890120+0000","last_became_peered":"2024-02-10T08:31:33.890120+0000","last_unstale":"2024-02-10T08:37:15.312226+0000","last_undegraded":"2024-02-10T08:37:15.312226+0000","last_fullsized":"2024-02-10T08:37:15.312226+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"314'14","last_scrub_stamp":"2024-02-10T08:37:09.977369+0000","last_deep_scrub":"199'13","last_deep_scrub_stamp":"2024-02-10T08:24:47.529439+0000","last_clean_scrub_stamp":"2024-02-10T08:37:09.977369+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"402'42","reported_seq":422,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:03.935061+0000","last_change":"2024-02-10T08:37:03.935036+0000","last_active":"2024-02-10T08:37:03.935061+0000","last_peered":"2024-02-10T08:37:03.935061+0000","last_clean":"2024-02-10T08:37:03.935061+0000","last_became_active":"2024-02-10T08:20:46.400760+0000","last_became_peered":"2024-02-10T08:20:46.400760+0000","last_unstale":"2024-02-10T08:37:03.935061+0000","last_undegraded":"2024-02-10T08:37:03.935061+0000","last_fullsized":"2024-02-10T08:37:03.935061+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'42","last_scrub_stamp":"2024-02-10T08:37:03.934971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:37:03.934971+0000","log_size":42,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":62,"num_read_kb":55,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":391,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:11.001094+0000","last_change":"2024-02-10T08:37:11.001055+0000","last_active":"2024-02-10T08:37:11.001094+0000","last_peered":"2024-02-10T08:37:11.001094+0000","last_clean":"2024-02-10T08:37:11.001094+0000","last_became_active":"2024-02-10T08:16:52.789020+0000","last_became_peered":"2024-02-10T08:16:52.789020+0000","last_unstale":"2024-02-10T08:37:11.001094+0000","last_undegraded":"2024-02-10T08:37:11.001094+0000","last_fullsized":"2024-02-10T08:37:11.001094+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:11.000947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:37:11.000947+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":384,"reported_epoch":403,"state":"active+clean","last_fresh":"2024-02-10T08:37:16.647716+0000","last_change":"2024-02-10T08:37:16.647716+0000","last_active":"2024-02-10T08:37:16.647716+0000","last_peered":"2024-02-10T08:37:16.647716+0000","last_clean":"2024-02-10T08:37:16.647716+0000","last_became_active":"2024-02-10T08:21:58.546976+0000","last_became_peered":"2024-02-10T08:21:58.546976+0000","last_unstale":"2024-02-10T08:37:16.647716+0000","last_undegraded":"2024-02-10T08:37:16.647716+0000","last_fullsized":"2024-02-10T08:37:16.647716+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:16.647643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:37:16.647643+0000","last_clean_scrub_stamp":"2024-02-10T08:37:16.647643+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.f","version":"403'2591","reported_seq":2604,"reported_epoch":403,"state":"active+clean","last_fresh":"2024-02-10T08:37:17.830235+0000","last_change":"2024-02-10T08:36:45.141212+0000","last_active":"2024-02-10T08:37:17.830235+0000","last_peered":"2024-02-10T08:37:17.830235+0000","last_clean":"2024-02-10T08:37:17.830235+0000","last_became_active":"2024-02-10T08:36:45.140934+0000","last_became_peered":"2024-02-10T08:36:45.140934+0000","last_unstale":"2024-02-10T08:37:17.830235+0000","last_undegraded":"2024-02-10T08:37:17.830235+0000","last_fullsized":"2024-02-10T08:37:17.830235+0000","mapping_epoch":398,"log_start":"0'0","ondisk_log_start":"0'0","created":398,"last_epoch_clean":399,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_clean_scrub_stamp":"2024-02-10T08:36:44.122988+0000","log_size":2591,"ondisk_log_size":2591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":169803776,"num_objects":2591,"num_object_clones":0,"num_object_copies":7773,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2591,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2591,"num_write_kb":165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":377,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:05.882163+0000","last_change":"2024-02-10T08:37:05.882132+0000","last_active":"2024-02-10T08:37:05.882163+0000","last_peered":"2024-02-10T08:37:05.882163+0000","last_clean":"2024-02-10T08:37:05.882163+0000","last_became_active":"2024-02-10T08:31:33.883569+0000","last_became_peered":"2024-02-10T08:31:33.883569+0000","last_unstale":"2024-02-10T08:37:05.882163+0000","last_undegraded":"2024-02-10T08:37:05.882163+0000","last_fullsized":"2024-02-10T08:37:05.882163+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:05.882027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:37:05.882027+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"402'42","reported_seq":461,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:14.617589+0000","last_change":"2024-02-10T08:37:14.617564+0000","last_active":"2024-02-10T08:37:14.617589+0000","last_peered":"2024-02-10T08:37:14.617589+0000","last_clean":"2024-02-10T08:37:14.617589+0000","last_became_active":"2024-02-10T08:32:36.979685+0000","last_became_peered":"2024-02-10T08:32:36.979685+0000","last_unstale":"2024-02-10T08:37:14.617589+0000","last_undegraded":"2024-02-10T08:37:14.617589+0000","last_fullsized":"2024-02-10T08:37:14.617589+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'42","last_scrub_stamp":"2024-02-10T08:37:14.617481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:37:14.617481+0000","log_size":42,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":69,"num_read_kb":57,"num_write":44,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,0],"acting":[7,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":397,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.195716+0000","last_change":"2024-02-10T08:36:27.912388+0000","last_active":"2024-02-10T08:37:01.195716+0000","last_peered":"2024-02-10T08:37:01.195716+0000","last_clean":"2024-02-10T08:37:01.195716+0000","last_became_active":"2024-02-10T08:20:46.407667+0000","last_became_peered":"2024-02-10T08:20:46.407667+0000","last_unstale":"2024-02-10T08:37:01.195716+0000","last_undegraded":"2024-02-10T08:37:01.195716+0000","last_fullsized":"2024-02-10T08:37:01.195716+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:27.912314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:36:27.912314+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":390,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.187039+0000","last_change":"2024-02-10T08:36:09.213565+0000","last_active":"2024-02-10T08:37:01.187039+0000","last_peered":"2024-02-10T08:37:01.187039+0000","last_clean":"2024-02-10T08:37:01.187039+0000","last_became_active":"2024-02-10T08:31:33.882582+0000","last_became_peered":"2024-02-10T08:31:33.882582+0000","last_unstale":"2024-02-10T08:37:01.187039+0000","last_undegraded":"2024-02-10T08:37:01.187039+0000","last_fullsized":"2024-02-10T08:37:01.187039+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:09.213493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:25.358315+0000","last_clean_scrub_stamp":"2024-02-10T08:36:09.213493+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"403'2678","reported_seq":2691,"reported_epoch":403,"state":"active+clean","last_fresh":"2024-02-10T08:37:17.915263+0000","last_change":"2024-02-10T08:36:45.138862+0000","last_active":"2024-02-10T08:37:17.915263+0000","last_peered":"2024-02-10T08:37:17.915263+0000","last_clean":"2024-02-10T08:37:17.915263+0000","last_became_active":"2024-02-10T08:36:45.138544+0000","last_became_peered":"2024-02-10T08:36:45.138544+0000","last_unstale":"2024-02-10T08:37:17.915263+0000","last_undegraded":"2024-02-10T08:37:17.915263+0000","last_fullsized":"2024-02-10T08:37:17.915263+0000","mapping_epoch":398,"log_start":"0'0","ondisk_log_start":"0'0","created":398,"last_epoch_clean":399,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_clean_scrub_stamp":"2024-02-10T08:36:44.122988+0000","log_size":2678,"ondisk_log_size":2678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":175505408,"num_objects":2678,"num_object_clones":0,"num_object_copies":8034,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2678,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2678,"num_write_kb":171392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,4],"acting":[1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":272,"reported_epoch":403,"state":"active+clean","last_fresh":"2024-02-10T08:37:15.967513+0000","last_change":"2024-02-10T08:37:15.967513+0000","last_active":"2024-02-10T08:37:15.967513+0000","last_peered":"2024-02-10T08:37:15.967513+0000","last_clean":"2024-02-10T08:37:15.967513+0000","last_became_active":"2024-02-10T08:33:56.117216+0000","last_became_peered":"2024-02-10T08:33:56.117216+0000","last_unstale":"2024-02-10T08:37:15.967513+0000","last_undegraded":"2024-02-10T08:37:15.967513+0000","last_fullsized":"2024-02-10T08:37:15.967513+0000","mapping_epoch":364,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":365,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:15.967427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:37:15.967427+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"402'47","reported_seq":493,"reported_epoch":403,"state":"active+clean","last_fresh":"2024-02-10T08:37:18.014050+0000","last_change":"2024-02-10T08:37:18.014050+0000","last_active":"2024-02-10T08:37:18.014050+0000","last_peered":"2024-02-10T08:37:18.014050+0000","last_clean":"2024-02-10T08:37:18.014050+0000","last_became_active":"2024-02-10T08:28:25.951447+0000","last_became_peered":"2024-02-10T08:28:25.951447+0000","last_unstale":"2024-02-10T08:37:18.014050+0000","last_undegraded":"2024-02-10T08:37:18.014050+0000","last_fullsized":"2024-02-10T08:37:18.014050+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'47","last_scrub_stamp":"2024-02-10T08:37:18.013937+0000","last_deep_scrub":"199'27","last_deep_scrub_stamp":"2024-02-10T08:24:42.826442+0000","last_clean_scrub_stamp":"2024-02-10T08:37:18.013937+0000","log_size":47,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":68,"num_read_kb":54,"num_write":42,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":389,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.186738+0000","last_change":"2024-02-10T08:36:55.489706+0000","last_active":"2024-02-10T08:37:01.186738+0000","last_peered":"2024-02-10T08:37:01.186738+0000","last_clean":"2024-02-10T08:37:01.186738+0000","last_became_active":"2024-02-10T08:32:36.972224+0000","last_became_peered":"2024-02-10T08:32:36.972224+0000","last_unstale":"2024-02-10T08:37:01.186738+0000","last_undegraded":"2024-02-10T08:37:01.186738+0000","last_fullsized":"2024-02-10T08:37:01.186738+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:55.489632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:36:55.489632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4],"acting":[2,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":385,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.195009+0000","last_change":"2024-02-10T08:36:20.807555+0000","last_active":"2024-02-10T08:37:01.195009+0000","last_peered":"2024-02-10T08:37:01.195009+0000","last_clean":"2024-02-10T08:37:01.195009+0000","last_became_active":"2024-02-10T08:21:58.553966+0000","last_became_peered":"2024-02-10T08:21:58.553966+0000","last_unstale":"2024-02-10T08:37:01.195009+0000","last_undegraded":"2024-02-10T08:37:01.195009+0000","last_fullsized":"2024-02-10T08:37:01.195009+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:20.807490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:36:20.807490+0000","last_clean_scrub_stamp":"2024-02-10T08:36:20.807490+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.9","version":"403'2670","reported_seq":2683,"reported_epoch":403,"state":"active+clean","last_fresh":"2024-02-10T08:37:18.398382+0000","last_change":"2024-02-10T08:36:45.373889+0000","last_active":"2024-02-10T08:37:18.398382+0000","last_peered":"2024-02-10T08:37:18.398382+0000","last_clean":"2024-02-10T08:37:18.398382+0000","last_became_active":"2024-02-10T08:36:45.373522+0000","last_became_peered":"2024-02-10T08:36:45.373522+0000","last_unstale":"2024-02-10T08:37:18.398382+0000","last_undegraded":"2024-02-10T08:37:18.398382+0000","last_fullsized":"2024-02-10T08:37:18.398382+0000","mapping_epoch":398,"log_start":"0'0","ondisk_log_start":"0'0","created":398,"last_epoch_clean":399,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_clean_scrub_stamp":"2024-02-10T08:36:44.122988+0000","log_size":2670,"ondisk_log_size":2670,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":174981120,"num_objects":2670,"num_object_clones":0,"num_object_copies":8010,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2670,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2670,"num_write_kb":170880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":399,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.180597+0000","last_change":"2024-02-10T08:33:28.092624+0000","last_active":"2024-02-10T08:37:01.180597+0000","last_peered":"2024-02-10T08:37:01.180597+0000","last_clean":"2024-02-10T08:37:01.180597+0000","last_became_active":"2024-02-10T08:28:02.772585+0000","last_became_peered":"2024-02-10T08:28:02.772585+0000","last_unstale":"2024-02-10T08:37:01.180597+0000","last_undegraded":"2024-02-10T08:37:01.180597+0000","last_fullsized":"2024-02-10T08:37:01.180597+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:28.092554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:41.360241+0000","last_clean_scrub_stamp":"2024-02-10T08:33:28.092554+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"402'36","reported_seq":115,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:09.007793+0000","last_change":"2024-02-10T08:37:09.007756+0000","last_active":"2024-02-10T08:37:09.007793+0000","last_peered":"2024-02-10T08:37:09.007793+0000","last_clean":"2024-02-10T08:37:09.007793+0000","last_became_active":"2024-02-10T08:32:36.975366+0000","last_became_peered":"2024-02-10T08:32:36.975366+0000","last_unstale":"2024-02-10T08:37:09.007793+0000","last_undegraded":"2024-02-10T08:37:09.007793+0000","last_fullsized":"2024-02-10T08:37:09.007793+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'36","last_scrub_stamp":"2024-02-10T08:37:09.007654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:37:09.007654+0000","log_size":36,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":47,"num_write":36,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":399,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.183205+0000","last_change":"2024-02-10T08:36:26.541530+0000","last_active":"2024-02-10T08:37:01.183205+0000","last_peered":"2024-02-10T08:37:01.183205+0000","last_clean":"2024-02-10T08:37:01.183205+0000","last_became_active":"2024-02-10T08:28:02.760999+0000","last_became_peered":"2024-02-10T08:28:02.760999+0000","last_unstale":"2024-02-10T08:37:01.183205+0000","last_undegraded":"2024-02-10T08:37:01.183205+0000","last_fullsized":"2024-02-10T08:37:01.183205+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:26.541382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:28.401960+0000","last_clean_scrub_stamp":"2024-02-10T08:36:26.541382+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":378,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:08.038310+0000","last_change":"2024-02-10T08:37:08.038282+0000","last_active":"2024-02-10T08:37:08.038310+0000","last_peered":"2024-02-10T08:37:08.038310+0000","last_clean":"2024-02-10T08:37:08.038310+0000","last_became_active":"2024-02-10T08:31:46.063039+0000","last_became_peered":"2024-02-10T08:31:46.063039+0000","last_unstale":"2024-02-10T08:37:08.038310+0000","last_undegraded":"2024-02-10T08:37:08.038310+0000","last_fullsized":"2024-02-10T08:37:08.038310+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:08.038201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:20.736224+0000","last_clean_scrub_stamp":"2024-02-10T08:37:08.038201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":398,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.197547+0000","last_change":"2024-02-10T08:36:02.765582+0000","last_active":"2024-02-10T08:37:01.197547+0000","last_peered":"2024-02-10T08:37:01.197547+0000","last_clean":"2024-02-10T08:37:01.197547+0000","last_became_active":"2024-02-10T08:28:19.022399+0000","last_became_peered":"2024-02-10T08:28:19.022399+0000","last_unstale":"2024-02-10T08:37:01.197547+0000","last_undegraded":"2024-02-10T08:37:01.197547+0000","last_fullsized":"2024-02-10T08:37:01.197547+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:02.765446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:36:02.765446+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.a","version":"403'2577","reported_seq":2590,"reported_epoch":403,"state":"active+clean","last_fresh":"2024-02-10T08:37:17.804819+0000","last_change":"2024-02-10T08:36:45.371929+0000","last_active":"2024-02-10T08:37:17.804819+0000","last_peered":"2024-02-10T08:37:17.804819+0000","last_clean":"2024-02-10T08:37:17.804819+0000","last_became_active":"2024-02-10T08:36:45.371664+0000","last_became_peered":"2024-02-10T08:36:45.371664+0000","last_unstale":"2024-02-10T08:37:17.804819+0000","last_undegraded":"2024-02-10T08:37:17.804819+0000","last_fullsized":"2024-02-10T08:37:17.804819+0000","mapping_epoch":398,"log_start":"0'0","ondisk_log_start":"0'0","created":398,"last_epoch_clean":399,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_clean_scrub_stamp":"2024-02-10T08:36:44.122988+0000","log_size":2577,"ondisk_log_size":2577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":168886272,"num_objects":2577,"num_object_clones":0,"num_object_copies":7731,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2577,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2577,"num_write_kb":164928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":377,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.184324+0000","last_change":"2024-02-10T08:34:23.304609+0000","last_active":"2024-02-10T08:37:01.184324+0000","last_peered":"2024-02-10T08:37:01.184324+0000","last_clean":"2024-02-10T08:37:01.184324+0000","last_became_active":"2024-02-10T08:16:56.867159+0000","last_became_peered":"2024-02-10T08:16:56.867159+0000","last_unstale":"2024-02-10T08:37:01.184324+0000","last_undegraded":"2024-02-10T08:37:01.184324+0000","last_fullsized":"2024-02-10T08:37:01.184324+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:23.304519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:04.766780+0000","last_clean_scrub_stamp":"2024-02-10T08:34:23.304519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"402'45","reported_seq":464,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.988158+0000","last_change":"2024-02-10T08:36:10.987701+0000","last_active":"2024-02-10T08:37:01.988158+0000","last_peered":"2024-02-10T08:37:01.988158+0000","last_clean":"2024-02-10T08:37:01.988158+0000","last_became_active":"2024-02-10T08:20:46.401981+0000","last_became_peered":"2024-02-10T08:20:46.401981+0000","last_unstale":"2024-02-10T08:37:01.988158+0000","last_undegraded":"2024-02-10T08:37:01.988158+0000","last_fullsized":"2024-02-10T08:37:01.988158+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'33","last_scrub_stamp":"2024-02-10T08:36:10.987607+0000","last_deep_scrub":"223'21","last_deep_scrub_stamp":"2024-02-10T08:26:33.250614+0000","last_clean_scrub_stamp":"2024-02-10T08:36:10.987607+0000","log_size":45,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":61,"num_read_kb":51,"num_write":37,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":410,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:04.577317+0000","last_change":"2024-02-10T08:37:04.577281+0000","last_active":"2024-02-10T08:37:04.577317+0000","last_peered":"2024-02-10T08:37:04.577317+0000","last_clean":"2024-02-10T08:37:04.577317+0000","last_became_active":"2024-02-10T08:32:36.979237+0000","last_became_peered":"2024-02-10T08:32:36.979237+0000","last_unstale":"2024-02-10T08:37:04.577317+0000","last_undegraded":"2024-02-10T08:37:04.577317+0000","last_fullsized":"2024-02-10T08:37:04.577317+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:04.577168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:14:44.584370+0000","last_clean_scrub_stamp":"2024-02-10T08:37:04.577168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":386,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.179531+0000","last_change":"2024-02-10T08:36:59.075246+0000","last_active":"2024-02-10T08:37:01.179531+0000","last_peered":"2024-02-10T08:37:01.179531+0000","last_clean":"2024-02-10T08:37:01.179531+0000","last_became_active":"2024-02-10T08:16:52.788767+0000","last_became_peered":"2024-02-10T08:16:52.788767+0000","last_unstale":"2024-02-10T08:37:01.179531+0000","last_undegraded":"2024-02-10T08:37:01.179531+0000","last_fullsized":"2024-02-10T08:37:01.179531+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:59.075134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:36:59.075134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":310,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.178736+0000","last_change":"2024-02-10T08:36:18.911642+0000","last_active":"2024-02-10T08:37:01.178736+0000","last_peered":"2024-02-10T08:37:01.178736+0000","last_clean":"2024-02-10T08:37:01.178736+0000","last_became_active":"2024-02-10T08:31:33.878588+0000","last_became_peered":"2024-02-10T08:31:33.878588+0000","last_unstale":"2024-02-10T08:37:01.178736+0000","last_undegraded":"2024-02-10T08:37:01.178736+0000","last_fullsized":"2024-02-10T08:37:01.178736+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:18.911559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.019819+0000","last_clean_scrub_stamp":"2024-02-10T08:36:18.911559+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":109,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.190981+0000","last_change":"2024-02-10T08:34:19.149776+0000","last_active":"2024-02-10T08:37:01.190981+0000","last_peered":"2024-02-10T08:37:01.190981+0000","last_clean":"2024-02-10T08:37:01.190981+0000","last_became_active":"2024-02-10T08:31:19.726561+0000","last_became_peered":"2024-02-10T08:31:19.726561+0000","last_unstale":"2024-02-10T08:37:01.190981+0000","last_undegraded":"2024-02-10T08:37:01.190981+0000","last_fullsized":"2024-02-10T08:37:01.190981+0000","mapping_epoch":308,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":309,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:19.149688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:26:29.921562+0000","last_clean_scrub_stamp":"2024-02-10T08:34:19.149688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.8","version":"403'2683","reported_seq":2696,"reported_epoch":403,"state":"active+clean","last_fresh":"2024-02-10T08:37:17.854445+0000","last_change":"2024-02-10T08:36:45.373548+0000","last_active":"2024-02-10T08:37:17.854445+0000","last_peered":"2024-02-10T08:37:17.854445+0000","last_clean":"2024-02-10T08:37:17.854445+0000","last_became_active":"2024-02-10T08:36:45.373282+0000","last_became_peered":"2024-02-10T08:36:45.373282+0000","last_unstale":"2024-02-10T08:37:17.854445+0000","last_undegraded":"2024-02-10T08:37:17.854445+0000","last_fullsized":"2024-02-10T08:37:17.854445+0000","mapping_epoch":398,"log_start":"0'0","ondisk_log_start":"0'0","created":398,"last_epoch_clean":399,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_clean_scrub_stamp":"2024-02-10T08:36:44.122988+0000","log_size":2683,"ondisk_log_size":2683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":175833088,"num_objects":2683,"num_object_clones":0,"num_object_copies":8049,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2683,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2683,"num_write_kb":171712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":383,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.186706+0000","last_change":"2024-02-10T08:36:14.733903+0000","last_active":"2024-02-10T08:37:01.186706+0000","last_peered":"2024-02-10T08:37:01.186706+0000","last_clean":"2024-02-10T08:37:01.186706+0000","last_became_active":"2024-02-10T08:16:56.857856+0000","last_became_peered":"2024-02-10T08:16:56.857856+0000","last_unstale":"2024-02-10T08:37:01.186706+0000","last_undegraded":"2024-02-10T08:37:01.186706+0000","last_fullsized":"2024-02-10T08:37:01.186706+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:14.733839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:36:14.733839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"402'21","reported_seq":179,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.664052+0000","last_change":"2024-02-10T08:34:18.368803+0000","last_active":"2024-02-10T08:37:01.664052+0000","last_peered":"2024-02-10T08:37:01.664052+0000","last_clean":"2024-02-10T08:37:01.664052+0000","last_became_active":"2024-02-10T08:32:36.984195+0000","last_became_peered":"2024-02-10T08:32:36.984195+0000","last_unstale":"2024-02-10T08:37:01.664052+0000","last_undegraded":"2024-02-10T08:37:01.664052+0000","last_fullsized":"2024-02-10T08:37:01.664052+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'17","last_scrub_stamp":"2024-02-10T08:34:18.368690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:34:18.368690+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":29,"num_write":24,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":428,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.185417+0000","last_change":"2024-02-10T08:36:58.452213+0000","last_active":"2024-02-10T08:37:01.185417+0000","last_peered":"2024-02-10T08:37:01.185417+0000","last_clean":"2024-02-10T08:37:01.185417+0000","last_became_active":"2024-02-10T08:31:33.884021+0000","last_became_peered":"2024-02-10T08:31:33.884021+0000","last_unstale":"2024-02-10T08:37:01.185417+0000","last_undegraded":"2024-02-10T08:37:01.185417+0000","last_fullsized":"2024-02-10T08:37:01.185417+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:58.452134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:11.681169+0000","last_clean_scrub_stamp":"2024-02-10T08:36:58.452134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"63'5","reported_seq":1608,"reported_epoch":403,"state":"active+clean","last_fresh":"2024-02-10T08:37:16.322319+0000","last_change":"2024-02-10T08:37:15.040122+0000","last_active":"2024-02-10T08:37:16.322319+0000","last_peered":"2024-02-10T08:37:16.322319+0000","last_clean":"2024-02-10T08:37:16.322319+0000","last_became_active":"2024-02-10T08:16:52.780989+0000","last_became_peered":"2024-02-10T08:16:52.780989+0000","last_unstale":"2024-02-10T08:37:16.322319+0000","last_undegraded":"2024-02-10T08:37:16.322319+0000","last_fullsized":"2024-02-10T08:37:16.322319+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'5","last_scrub_stamp":"2024-02-10T08:37:15.040027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:37:15.040027+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1214,"num_read_kb":1209,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":385,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.185179+0000","last_change":"2024-02-10T08:33:17.442371+0000","last_active":"2024-02-10T08:37:01.185179+0000","last_peered":"2024-02-10T08:37:01.185179+0000","last_clean":"2024-02-10T08:37:01.185179+0000","last_became_active":"2024-02-10T08:21:58.549733+0000","last_became_peered":"2024-02-10T08:21:58.549733+0000","last_unstale":"2024-02-10T08:37:01.185179+0000","last_undegraded":"2024-02-10T08:37:01.185179+0000","last_fullsized":"2024-02-10T08:37:01.185179+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:17.442264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:11.750537+0000","last_clean_scrub_stamp":"2024-02-10T08:33:17.442264+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"403'2627","reported_seq":2640,"reported_epoch":403,"state":"active+clean","last_fresh":"2024-02-10T08:37:17.915691+0000","last_change":"2024-02-10T08:36:45.372323+0000","last_active":"2024-02-10T08:37:17.915691+0000","last_peered":"2024-02-10T08:37:17.915691+0000","last_clean":"2024-02-10T08:37:17.915691+0000","last_became_active":"2024-02-10T08:36:45.371942+0000","last_became_peered":"2024-02-10T08:36:45.371942+0000","last_unstale":"2024-02-10T08:37:17.915691+0000","last_undegraded":"2024-02-10T08:37:17.915691+0000","last_fullsized":"2024-02-10T08:37:17.915691+0000","mapping_epoch":398,"log_start":"0'0","ondisk_log_start":"0'0","created":398,"last_epoch_clean":399,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_clean_scrub_stamp":"2024-02-10T08:36:44.122988+0000","log_size":2627,"ondisk_log_size":2627,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":172163072,"num_objects":2627,"num_object_clones":0,"num_object_copies":7881,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2627,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2627,"num_write_kb":168128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":78,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.190391+0000","last_change":"2024-02-10T08:34:13.094510+0000","last_active":"2024-02-10T08:37:01.190391+0000","last_peered":"2024-02-10T08:37:01.190391+0000","last_clean":"2024-02-10T08:37:01.190391+0000","last_became_active":"2024-02-10T08:32:36.976141+0000","last_became_peered":"2024-02-10T08:32:36.976141+0000","last_unstale":"2024-02-10T08:37:01.190391+0000","last_undegraded":"2024-02-10T08:37:01.190391+0000","last_fullsized":"2024-02-10T08:37:01.190391+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:13.094426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:34:13.094426+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"402'54","reported_seq":777,"reported_epoch":403,"state":"active+clean","last_fresh":"2024-02-10T08:37:15.311135+0000","last_change":"2024-02-10T08:36:26.948186+0000","last_active":"2024-02-10T08:37:15.311135+0000","last_peered":"2024-02-10T08:37:15.311135+0000","last_clean":"2024-02-10T08:37:15.311135+0000","last_became_active":"2024-02-10T08:31:33.904487+0000","last_became_peered":"2024-02-10T08:31:33.904487+0000","last_unstale":"2024-02-10T08:37:15.311135+0000","last_undegraded":"2024-02-10T08:37:15.311135+0000","last_fullsized":"2024-02-10T08:37:15.311135+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":315,"parent":"0.0","parent_split_bits":0,"last_scrub":"314'42","last_scrub_stamp":"2024-02-10T08:36:26.948002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:36:26.948002+0000","log_size":54,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":84,"num_read_kb":69,"num_write":50,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":716,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":386,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:09.029907+0000","last_change":"2024-02-10T08:37:09.029872+0000","last_active":"2024-02-10T08:37:09.029907+0000","last_peered":"2024-02-10T08:37:09.029907+0000","last_clean":"2024-02-10T08:37:09.029907+0000","last_became_active":"2024-02-10T08:16:52.791027+0000","last_became_peered":"2024-02-10T08:16:52.791027+0000","last_unstale":"2024-02-10T08:37:09.029907+0000","last_undegraded":"2024-02-10T08:37:09.029907+0000","last_fullsized":"2024-02-10T08:37:09.029907+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:09.029768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:37:09.029768+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":405,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.187988+0000","last_change":"2024-02-10T08:36:04.197245+0000","last_active":"2024-02-10T08:37:01.187988+0000","last_peered":"2024-02-10T08:37:01.187988+0000","last_clean":"2024-02-10T08:37:01.187988+0000","last_became_active":"2024-02-10T08:31:33.884295+0000","last_became_peered":"2024-02-10T08:31:33.884295+0000","last_unstale":"2024-02-10T08:37:01.187988+0000","last_undegraded":"2024-02-10T08:37:01.187988+0000","last_fullsized":"2024-02-10T08:37:01.187988+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:04.197143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:36:04.197143+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.d","version":"403'2712","reported_seq":2725,"reported_epoch":403,"state":"active+clean","last_fresh":"2024-02-10T08:37:18.070935+0000","last_change":"2024-02-10T08:36:45.142141+0000","last_active":"2024-02-10T08:37:18.070935+0000","last_peered":"2024-02-10T08:37:18.070935+0000","last_clean":"2024-02-10T08:37:18.070935+0000","last_became_active":"2024-02-10T08:36:45.141858+0000","last_became_peered":"2024-02-10T08:36:45.141858+0000","last_unstale":"2024-02-10T08:37:18.070935+0000","last_undegraded":"2024-02-10T08:37:18.070935+0000","last_fullsized":"2024-02-10T08:37:18.070935+0000","mapping_epoch":398,"log_start":"0'0","ondisk_log_start":"0'0","created":398,"last_epoch_clean":399,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_clean_scrub_stamp":"2024-02-10T08:36:44.122988+0000","log_size":2712,"ondisk_log_size":2712,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":177733632,"num_objects":2712,"num_object_clones":0,"num_object_copies":8136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2712,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2712,"num_write_kb":173568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,6],"acting":[2,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"255'12","reported_seq":349,"reported_epoch":403,"state":"active+clean","last_fresh":"2024-02-10T08:37:15.326984+0000","last_change":"2024-02-10T08:36:05.139333+0000","last_active":"2024-02-10T08:37:15.326984+0000","last_peered":"2024-02-10T08:37:15.326984+0000","last_clean":"2024-02-10T08:37:15.326984+0000","last_became_active":"2024-02-10T08:28:25.952468+0000","last_became_peered":"2024-02-10T08:28:25.952468+0000","last_unstale":"2024-02-10T08:37:15.326984+0000","last_undegraded":"2024-02-10T08:37:15.326984+0000","last_fullsized":"2024-02-10T08:37:15.326984+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'12","last_scrub_stamp":"2024-02-10T08:36:05.139231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:36:05.139231+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"402'30","reported_seq":440,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.970755+0000","last_change":"2024-02-10T08:36:56.858833+0000","last_active":"2024-02-10T08:37:01.970755+0000","last_peered":"2024-02-10T08:37:01.970755+0000","last_clean":"2024-02-10T08:37:01.970755+0000","last_became_active":"2024-02-10T08:20:46.408495+0000","last_became_peered":"2024-02-10T08:20:46.408495+0000","last_unstale":"2024-02-10T08:37:01.970755+0000","last_undegraded":"2024-02-10T08:37:01.970755+0000","last_fullsized":"2024-02-10T08:37:01.970755+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'20","last_scrub_stamp":"2024-02-10T08:36:56.858641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:36:56.858641+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":45,"num_read_kb":40,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":400,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.195490+0000","last_change":"2024-02-10T08:36:18.737230+0000","last_active":"2024-02-10T08:37:01.195490+0000","last_peered":"2024-02-10T08:37:01.195490+0000","last_clean":"2024-02-10T08:37:01.195490+0000","last_became_active":"2024-02-10T08:28:02.760784+0000","last_became_peered":"2024-02-10T08:28:02.760784+0000","last_unstale":"2024-02-10T08:37:01.195490+0000","last_undegraded":"2024-02-10T08:37:01.195490+0000","last_fullsized":"2024-02-10T08:37:01.195490+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:18.737167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:36:18.737167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":301,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.190061+0000","last_change":"2024-02-10T08:34:11.146000+0000","last_active":"2024-02-10T08:37:01.190061+0000","last_peered":"2024-02-10T08:37:01.190061+0000","last_clean":"2024-02-10T08:37:01.190061+0000","last_became_active":"2024-02-10T08:28:25.950240+0000","last_became_peered":"2024-02-10T08:28:25.950240+0000","last_unstale":"2024-02-10T08:37:01.190061+0000","last_undegraded":"2024-02-10T08:37:01.190061+0000","last_fullsized":"2024-02-10T08:37:01.190061+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:11.145907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:34:11.145907+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"403'2721","reported_seq":2733,"reported_epoch":403,"state":"active+clean","last_fresh":"2024-02-10T08:37:18.399128+0000","last_change":"2024-02-10T08:36:45.141266+0000","last_active":"2024-02-10T08:37:18.399128+0000","last_peered":"2024-02-10T08:37:18.399128+0000","last_clean":"2024-02-10T08:37:18.399128+0000","last_became_active":"2024-02-10T08:36:45.140961+0000","last_became_peered":"2024-02-10T08:36:45.140961+0000","last_unstale":"2024-02-10T08:37:18.399128+0000","last_undegraded":"2024-02-10T08:37:18.399128+0000","last_fullsized":"2024-02-10T08:37:18.399128+0000","mapping_epoch":398,"log_start":"0'0","ondisk_log_start":"0'0","created":398,"last_epoch_clean":399,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_clean_scrub_stamp":"2024-02-10T08:36:44.122988+0000","log_size":2721,"ondisk_log_size":2721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":178323456,"num_objects":2721,"num_object_clones":0,"num_object_copies":8163,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2721,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2721,"num_write_kb":174144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":401,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.185500+0000","last_change":"2024-02-10T08:36:02.649289+0000","last_active":"2024-02-10T08:37:01.185500+0000","last_peered":"2024-02-10T08:37:01.185500+0000","last_clean":"2024-02-10T08:37:01.185500+0000","last_became_active":"2024-02-10T08:28:02.777637+0000","last_became_peered":"2024-02-10T08:28:02.777637+0000","last_unstale":"2024-02-10T08:37:01.185500+0000","last_undegraded":"2024-02-10T08:37:01.185500+0000","last_fullsized":"2024-02-10T08:37:01.185500+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:02.649176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:36:02.649176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"402'29","reported_seq":455,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:13.904512+0000","last_change":"2024-02-10T08:37:13.904474+0000","last_active":"2024-02-10T08:37:13.904512+0000","last_peered":"2024-02-10T08:37:13.904512+0000","last_clean":"2024-02-10T08:37:13.904512+0000","last_became_active":"2024-02-10T08:31:33.884516+0000","last_became_peered":"2024-02-10T08:31:33.884516+0000","last_unstale":"2024-02-10T08:37:13.904512+0000","last_undegraded":"2024-02-10T08:37:13.904512+0000","last_fullsized":"2024-02-10T08:37:13.904512+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'29","last_scrub_stamp":"2024-02-10T08:37:13.904380+0000","last_deep_scrub":"82'17","last_deep_scrub_stamp":"2024-02-10T08:18:21.015873+0000","last_clean_scrub_stamp":"2024-02-10T08:37:13.904380+0000","log_size":29,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"55'2","reported_seq":402,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:04.901918+0000","last_change":"2024-02-10T08:37:04.901887+0000","last_active":"2024-02-10T08:37:04.901918+0000","last_peered":"2024-02-10T08:37:04.901918+0000","last_clean":"2024-02-10T08:37:04.901918+0000","last_became_active":"2024-02-10T08:28:02.768279+0000","last_became_peered":"2024-02-10T08:28:02.768279+0000","last_unstale":"2024-02-10T08:37:04.901918+0000","last_undegraded":"2024-02-10T08:37:04.901918+0000","last_fullsized":"2024-02-10T08:37:04.901918+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'2","last_scrub_stamp":"2024-02-10T08:37:04.901791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:37:04.901791+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":184,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":293,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.184062+0000","last_change":"2024-02-10T08:35:12.451166+0000","last_active":"2024-02-10T08:37:01.184062+0000","last_peered":"2024-02-10T08:37:01.184062+0000","last_clean":"2024-02-10T08:37:01.184062+0000","last_became_active":"2024-02-10T08:30:24.073077+0000","last_became_peered":"2024-02-10T08:30:24.073077+0000","last_unstale":"2024-02-10T08:37:01.184062+0000","last_undegraded":"2024-02-10T08:37:01.184062+0000","last_fullsized":"2024-02-10T08:37:01.184062+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:35:12.451079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:35:12.451079+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"402'21","reported_seq":102,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:14.936606+0000","last_change":"2024-02-10T08:37:14.936564+0000","last_active":"2024-02-10T08:37:14.936606+0000","last_peered":"2024-02-10T08:37:14.936606+0000","last_clean":"2024-02-10T08:37:14.936606+0000","last_became_active":"2024-02-10T08:32:36.982716+0000","last_became_peered":"2024-02-10T08:32:36.982716+0000","last_unstale":"2024-02-10T08:37:14.936606+0000","last_undegraded":"2024-02-10T08:37:14.936606+0000","last_fullsized":"2024-02-10T08:37:14.936606+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'21","last_scrub_stamp":"2024-02-10T08:37:14.936454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:37:14.936454+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":33,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"55'1","reported_seq":462,"reported_epoch":403,"state":"active+clean","last_fresh":"2024-02-10T08:37:16.569191+0000","last_change":"2024-02-10T08:37:16.569191+0000","last_active":"2024-02-10T08:37:16.569191+0000","last_peered":"2024-02-10T08:37:16.569191+0000","last_clean":"2024-02-10T08:37:16.569191+0000","last_became_active":"2024-02-10T08:28:02.778857+0000","last_became_peered":"2024-02-10T08:28:02.778857+0000","last_unstale":"2024-02-10T08:37:16.569191+0000","last_undegraded":"2024-02-10T08:37:16.569191+0000","last_fullsized":"2024-02-10T08:37:16.569191+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'1","last_scrub_stamp":"2024-02-10T08:37:16.569094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:37:16.569094+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":716,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":330,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.196088+0000","last_change":"2024-02-10T08:36:57.854254+0000","last_active":"2024-02-10T08:37:01.196088+0000","last_peered":"2024-02-10T08:37:01.196088+0000","last_clean":"2024-02-10T08:37:01.196088+0000","last_became_active":"2024-02-10T08:31:33.891489+0000","last_became_peered":"2024-02-10T08:31:33.891489+0000","last_unstale":"2024-02-10T08:37:01.196088+0000","last_undegraded":"2024-02-10T08:37:01.196088+0000","last_fullsized":"2024-02-10T08:37:01.196088+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:57.854170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:36:57.854170+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":245,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.190382+0000","last_change":"2024-02-10T08:34:12.117475+0000","last_active":"2024-02-10T08:37:01.190382+0000","last_peered":"2024-02-10T08:37:01.190382+0000","last_clean":"2024-02-10T08:37:01.190382+0000","last_became_active":"2024-02-10T08:28:25.999252+0000","last_became_peered":"2024-02-10T08:28:25.999252+0000","last_unstale":"2024-02-10T08:37:01.190382+0000","last_undegraded":"2024-02-10T08:37:01.190382+0000","last_fullsized":"2024-02-10T08:37:01.190382+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:12.117379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:34:12.117379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"402'21","reported_seq":363,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.839552+0000","last_change":"2024-02-10T08:36:24.509690+0000","last_active":"2024-02-10T08:37:01.839552+0000","last_peered":"2024-02-10T08:37:01.839552+0000","last_clean":"2024-02-10T08:37:01.839552+0000","last_became_active":"2024-02-10T08:31:33.891813+0000","last_became_peered":"2024-02-10T08:31:33.891813+0000","last_unstale":"2024-02-10T08:37:01.839552+0000","last_undegraded":"2024-02-10T08:37:01.839552+0000","last_fullsized":"2024-02-10T08:37:01.839552+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'15","last_scrub_stamp":"2024-02-10T08:36:24.509584+0000","last_deep_scrub":"223'9","last_deep_scrub_stamp":"2024-02-10T08:26:33.158025+0000","last_clean_scrub_stamp":"2024-02-10T08:36:24.509584+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":26,"num_read_kb":23,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":453,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.185090+0000","last_change":"2024-02-10T08:36:57.007034+0000","last_active":"2024-02-10T08:37:01.185090+0000","last_peered":"2024-02-10T08:37:01.185090+0000","last_clean":"2024-02-10T08:37:01.185090+0000","last_became_active":"2024-02-10T08:31:46.053553+0000","last_became_peered":"2024-02-10T08:31:46.053553+0000","last_unstale":"2024-02-10T08:37:01.185090+0000","last_undegraded":"2024-02-10T08:37:01.185090+0000","last_fullsized":"2024-02-10T08:37:01.185090+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:57.006964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:36:57.006964+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":377,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.178489+0000","last_change":"2024-02-10T08:34:28.320611+0000","last_active":"2024-02-10T08:37:01.178489+0000","last_peered":"2024-02-10T08:37:01.178489+0000","last_clean":"2024-02-10T08:37:01.178489+0000","last_became_active":"2024-02-10T08:16:56.863948+0000","last_became_peered":"2024-02-10T08:16:56.863948+0000","last_unstale":"2024-02-10T08:37:01.178489+0000","last_undegraded":"2024-02-10T08:37:01.178489+0000","last_fullsized":"2024-02-10T08:37:01.178489+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:28.320524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:34:28.320524+0000","last_clean_scrub_stamp":"2024-02-10T08:34:28.320524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":385,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.184878+0000","last_change":"2024-02-10T08:33:32.430824+0000","last_active":"2024-02-10T08:37:01.184878+0000","last_peered":"2024-02-10T08:37:01.184878+0000","last_clean":"2024-02-10T08:37:01.184878+0000","last_became_active":"2024-02-10T08:20:46.398903+0000","last_became_peered":"2024-02-10T08:20:46.398903+0000","last_unstale":"2024-02-10T08:37:01.184878+0000","last_undegraded":"2024-02-10T08:37:01.184878+0000","last_fullsized":"2024-02-10T08:37:01.184878+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:32.430721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:33:32.430721+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"402'30","reported_seq":344,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.951832+0000","last_change":"2024-02-10T08:35:17.746698+0000","last_active":"2024-02-10T08:37:01.951832+0000","last_peered":"2024-02-10T08:37:01.951832+0000","last_clean":"2024-02-10T08:37:01.951832+0000","last_became_active":"2024-02-10T08:22:23.534081+0000","last_became_peered":"2024-02-10T08:22:23.534081+0000","last_unstale":"2024-02-10T08:37:01.951832+0000","last_undegraded":"2024-02-10T08:37:01.951832+0000","last_fullsized":"2024-02-10T08:37:01.951832+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'20","last_scrub_stamp":"2024-02-10T08:35:17.746555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:35:17.746555+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":39,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":386,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.178359+0000","last_change":"2024-02-10T08:36:03.081631+0000","last_active":"2024-02-10T08:37:01.178359+0000","last_peered":"2024-02-10T08:37:01.178359+0000","last_clean":"2024-02-10T08:37:01.178359+0000","last_became_active":"2024-02-10T08:16:52.789834+0000","last_became_peered":"2024-02-10T08:16:52.789834+0000","last_unstale":"2024-02-10T08:37:01.178359+0000","last_undegraded":"2024-02-10T08:37:01.178359+0000","last_fullsized":"2024-02-10T08:37:01.178359+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:03.081540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:36:03.081540+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"244'12","reported_seq":676,"reported_epoch":403,"state":"active+clean","last_fresh":"2024-02-10T08:37:15.302239+0000","last_change":"2024-02-10T08:35:24.069288+0000","last_active":"2024-02-10T08:37:15.302239+0000","last_peered":"2024-02-10T08:37:15.302239+0000","last_clean":"2024-02-10T08:37:15.302239+0000","last_became_active":"2024-02-10T08:28:02.776097+0000","last_became_peered":"2024-02-10T08:28:02.776097+0000","last_unstale":"2024-02-10T08:37:15.302239+0000","last_undegraded":"2024-02-10T08:37:15.302239+0000","last_fullsized":"2024-02-10T08:37:15.302239+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"244'12","last_scrub_stamp":"2024-02-10T08:35:24.069224+0000","last_deep_scrub":"244'12","last_deep_scrub_stamp":"2024-02-10T08:35:24.069224+0000","last_clean_scrub_stamp":"2024-02-10T08:35:24.069224+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":83,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:03.029519+0000","last_change":"2024-02-10T08:37:03.029492+0000","last_active":"2024-02-10T08:37:03.029519+0000","last_peered":"2024-02-10T08:37:03.029519+0000","last_clean":"2024-02-10T08:37:03.029519+0000","last_became_active":"2024-02-10T08:32:36.983153+0000","last_became_peered":"2024-02-10T08:32:36.983153+0000","last_unstale":"2024-02-10T08:37:03.029519+0000","last_undegraded":"2024-02-10T08:37:03.029519+0000","last_fullsized":"2024-02-10T08:37:03.029519+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:03.029405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:05.662947+0000","last_clean_scrub_stamp":"2024-02-10T08:37:03.029405+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"402'25","reported_seq":422,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.959700+0000","last_change":"2024-02-10T08:36:58.072950+0000","last_active":"2024-02-10T08:37:01.959700+0000","last_peered":"2024-02-10T08:37:01.959700+0000","last_clean":"2024-02-10T08:37:01.959700+0000","last_became_active":"2024-02-10T08:16:55.204734+0000","last_became_peered":"2024-02-10T08:16:55.204734+0000","last_unstale":"2024-02-10T08:37:01.959700+0000","last_undegraded":"2024-02-10T08:37:01.959700+0000","last_fullsized":"2024-02-10T08:37:01.959700+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'19","last_scrub_stamp":"2024-02-10T08:36:58.072861+0000","last_deep_scrub":"213'13","last_deep_scrub_stamp":"2024-02-10T08:25:43.713333+0000","last_clean_scrub_stamp":"2024-02-10T08:36:58.072861+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":78,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.190153+0000","last_change":"2024-02-10T08:36:11.052018+0000","last_active":"2024-02-10T08:37:01.190153+0000","last_peered":"2024-02-10T08:37:01.190153+0000","last_clean":"2024-02-10T08:37:01.190153+0000","last_became_active":"2024-02-10T08:32:36.980715+0000","last_became_peered":"2024-02-10T08:32:36.980715+0000","last_unstale":"2024-02-10T08:37:01.190153+0000","last_undegraded":"2024-02-10T08:37:01.190153+0000","last_fullsized":"2024-02-10T08:37:01.190153+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:11.051916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:36:11.051916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"314'11","reported_seq":512,"reported_epoch":403,"state":"active+clean","last_fresh":"2024-02-10T08:37:15.314127+0000","last_change":"2024-02-10T08:36:23.462351+0000","last_active":"2024-02-10T08:37:15.314127+0000","last_peered":"2024-02-10T08:37:15.314127+0000","last_clean":"2024-02-10T08:37:15.314127+0000","last_became_active":"2024-02-10T08:31:33.885840+0000","last_became_peered":"2024-02-10T08:31:33.885840+0000","last_unstale":"2024-02-10T08:37:15.314127+0000","last_undegraded":"2024-02-10T08:37:15.314127+0000","last_fullsized":"2024-02-10T08:37:15.314127+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"314'11","last_scrub_stamp":"2024-02-10T08:36:23.462220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:36:23.462220+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":369,"reported_epoch":403,"state":"active+clean","last_fresh":"2024-02-10T08:37:16.999580+0000","last_change":"2024-02-10T08:37:16.999580+0000","last_active":"2024-02-10T08:37:16.999580+0000","last_peered":"2024-02-10T08:37:16.999580+0000","last_clean":"2024-02-10T08:37:16.999580+0000","last_became_active":"2024-02-10T08:20:46.395788+0000","last_became_peered":"2024-02-10T08:20:46.395788+0000","last_unstale":"2024-02-10T08:37:16.999580+0000","last_undegraded":"2024-02-10T08:37:16.999580+0000","last_fullsized":"2024-02-10T08:37:16.999580+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:16.999487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:37:16.999487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"402'21","reported_seq":399,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.559372+0000","last_change":"2024-02-10T08:36:03.126980+0000","last_active":"2024-02-10T08:37:01.559372+0000","last_peered":"2024-02-10T08:37:01.559372+0000","last_clean":"2024-02-10T08:37:01.559372+0000","last_became_active":"2024-02-10T08:28:25.952354+0000","last_became_peered":"2024-02-10T08:28:25.952354+0000","last_unstale":"2024-02-10T08:37:01.559372+0000","last_undegraded":"2024-02-10T08:37:01.559372+0000","last_fullsized":"2024-02-10T08:37:01.559372+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'15","last_scrub_stamp":"2024-02-10T08:36:03.126898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:36:03.126898+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":34,"num_read_kb":28,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":393,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.185043+0000","last_change":"2024-02-10T08:35:25.826895+0000","last_active":"2024-02-10T08:37:01.185043+0000","last_peered":"2024-02-10T08:37:01.185043+0000","last_clean":"2024-02-10T08:37:01.185043+0000","last_became_active":"2024-02-10T08:16:52.786213+0000","last_became_peered":"2024-02-10T08:16:52.786213+0000","last_unstale":"2024-02-10T08:37:01.185043+0000","last_undegraded":"2024-02-10T08:37:01.185043+0000","last_fullsized":"2024-02-10T08:37:01.185043+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:35:25.826812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:35:25.826812+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":215,"reported_epoch":403,"state":"active+clean","last_fresh":"2024-02-10T08:37:16.974830+0000","last_change":"2024-02-10T08:37:16.974830+0000","last_active":"2024-02-10T08:37:16.974830+0000","last_peered":"2024-02-10T08:37:16.974830+0000","last_clean":"2024-02-10T08:37:16.974830+0000","last_became_active":"2024-02-10T08:28:25.950221+0000","last_became_peered":"2024-02-10T08:28:25.950221+0000","last_unstale":"2024-02-10T08:37:16.974830+0000","last_undegraded":"2024-02-10T08:37:16.974830+0000","last_fullsized":"2024-02-10T08:37:16.974830+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:16.974733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:33:28.821928+0000","last_clean_scrub_stamp":"2024-02-10T08:37:16.974733+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":221,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:05.034555+0000","last_change":"2024-02-10T08:37:05.034513+0000","last_active":"2024-02-10T08:37:05.034555+0000","last_peered":"2024-02-10T08:37:05.034555+0000","last_clean":"2024-02-10T08:37:05.034555+0000","last_became_active":"2024-02-10T08:30:24.070440+0000","last_became_peered":"2024-02-10T08:30:24.070440+0000","last_unstale":"2024-02-10T08:37:05.034555+0000","last_undegraded":"2024-02-10T08:37:05.034555+0000","last_fullsized":"2024-02-10T08:37:05.034555+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:05.034416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:37:05.034416+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"402'32","reported_seq":433,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.869679+0000","last_change":"2024-02-10T08:36:23.221000+0000","last_active":"2024-02-10T08:37:01.869679+0000","last_peered":"2024-02-10T08:37:01.869679+0000","last_clean":"2024-02-10T08:37:01.869679+0000","last_became_active":"2024-02-10T08:20:46.396130+0000","last_became_peered":"2024-02-10T08:20:46.396130+0000","last_unstale":"2024-02-10T08:37:01.869679+0000","last_undegraded":"2024-02-10T08:37:01.869679+0000","last_fullsized":"2024-02-10T08:37:01.869679+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'24","last_scrub_stamp":"2024-02-10T08:36:23.220919+0000","last_deep_scrub":"201'16","last_deep_scrub_stamp":"2024-02-10T08:24:49.177357+0000","last_clean_scrub_stamp":"2024-02-10T08:36:23.220919+0000","log_size":32,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":404,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.195716+0000","last_change":"2024-02-10T08:36:07.789097+0000","last_active":"2024-02-10T08:37:01.195716+0000","last_peered":"2024-02-10T08:37:01.195716+0000","last_clean":"2024-02-10T08:37:01.195716+0000","last_became_active":"2024-02-10T08:32:36.974379+0000","last_became_peered":"2024-02-10T08:32:36.974379+0000","last_unstale":"2024-02-10T08:37:01.195716+0000","last_undegraded":"2024-02-10T08:37:01.195716+0000","last_fullsized":"2024-02-10T08:37:01.195716+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:07.788932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:36:07.788932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":398,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.195269+0000","last_change":"2024-02-10T08:36:05.716136+0000","last_active":"2024-02-10T08:37:01.195269+0000","last_peered":"2024-02-10T08:37:01.195269+0000","last_clean":"2024-02-10T08:37:01.195269+0000","last_became_active":"2024-02-10T08:31:33.893973+0000","last_became_peered":"2024-02-10T08:31:33.893973+0000","last_unstale":"2024-02-10T08:37:01.195269+0000","last_undegraded":"2024-02-10T08:37:01.195269+0000","last_fullsized":"2024-02-10T08:37:01.195269+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:05.715963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:36:05.715963+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":78,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.192146+0000","last_change":"2024-02-10T08:34:38.015567+0000","last_active":"2024-02-10T08:37:01.192146+0000","last_peered":"2024-02-10T08:37:01.192146+0000","last_clean":"2024-02-10T08:37:01.192146+0000","last_became_active":"2024-02-10T08:32:36.979093+0000","last_became_peered":"2024-02-10T08:32:36.979093+0000","last_unstale":"2024-02-10T08:37:01.192146+0000","last_undegraded":"2024-02-10T08:37:01.192146+0000","last_fullsized":"2024-02-10T08:37:01.192146+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:38.015515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:34:38.015515+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,5],"acting":[0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"402'12","reported_seq":317,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.252128+0000","last_change":"2024-02-10T08:35:08.720411+0000","last_active":"2024-02-10T08:37:01.252128+0000","last_peered":"2024-02-10T08:37:01.252128+0000","last_clean":"2024-02-10T08:37:01.252128+0000","last_became_active":"2024-02-10T08:22:23.522936+0000","last_became_peered":"2024-02-10T08:22:23.522936+0000","last_unstale":"2024-02-10T08:37:01.252128+0000","last_undegraded":"2024-02-10T08:37:01.252128+0000","last_fullsized":"2024-02-10T08:37:01.252128+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'8","last_scrub_stamp":"2024-02-10T08:35:08.720332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:35:08.720332+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,6],"acting":[1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":386,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.178569+0000","last_change":"2024-02-10T08:33:22.025841+0000","last_active":"2024-02-10T08:37:01.178569+0000","last_peered":"2024-02-10T08:37:01.178569+0000","last_clean":"2024-02-10T08:37:01.178569+0000","last_became_active":"2024-02-10T08:16:52.788704+0000","last_became_peered":"2024-02-10T08:16:52.788704+0000","last_unstale":"2024-02-10T08:37:01.178569+0000","last_undegraded":"2024-02-10T08:37:01.178569+0000","last_fullsized":"2024-02-10T08:37:01.178569+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:33:22.025769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:33:22.025769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":397,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:04.950277+0000","last_change":"2024-02-10T08:37:04.950235+0000","last_active":"2024-02-10T08:37:04.950277+0000","last_peered":"2024-02-10T08:37:04.950277+0000","last_clean":"2024-02-10T08:37:04.950277+0000","last_became_active":"2024-02-10T08:20:46.397495+0000","last_became_peered":"2024-02-10T08:20:46.397495+0000","last_unstale":"2024-02-10T08:37:04.950277+0000","last_undegraded":"2024-02-10T08:37:04.950277+0000","last_fullsized":"2024-02-10T08:37:04.950277+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:04.950117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:37:04.950117+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":399,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.183922+0000","last_change":"2024-02-10T08:34:38.328749+0000","last_active":"2024-02-10T08:37:01.183922+0000","last_peered":"2024-02-10T08:37:01.183922+0000","last_clean":"2024-02-10T08:37:01.183922+0000","last_became_active":"2024-02-10T08:30:24.064419+0000","last_became_peered":"2024-02-10T08:30:24.064419+0000","last_unstale":"2024-02-10T08:37:01.183922+0000","last_undegraded":"2024-02-10T08:37:01.183922+0000","last_fullsized":"2024-02-10T08:37:01.183922+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:38.328641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:27.276490+0000","last_clean_scrub_stamp":"2024-02-10T08:34:38.328641+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"402'27","reported_seq":342,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:02.052331+0000","last_change":"2024-02-10T08:36:16.410241+0000","last_active":"2024-02-10T08:37:02.052331+0000","last_peered":"2024-02-10T08:37:02.052331+0000","last_clean":"2024-02-10T08:37:02.052331+0000","last_became_active":"2024-02-10T08:22:23.526198+0000","last_became_peered":"2024-02-10T08:22:23.526198+0000","last_unstale":"2024-02-10T08:37:02.052331+0000","last_undegraded":"2024-02-10T08:37:02.052331+0000","last_fullsized":"2024-02-10T08:37:02.052331+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'19","last_scrub_stamp":"2024-02-10T08:36:16.410126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:36:16.410126+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":36,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":391,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:10.034622+0000","last_change":"2024-02-10T08:37:10.034590+0000","last_active":"2024-02-10T08:37:10.034622+0000","last_peered":"2024-02-10T08:37:10.034622+0000","last_clean":"2024-02-10T08:37:10.034622+0000","last_became_active":"2024-02-10T08:16:52.788629+0000","last_became_peered":"2024-02-10T08:16:52.788629+0000","last_unstale":"2024-02-10T08:37:10.034622+0000","last_undegraded":"2024-02-10T08:37:10.034622+0000","last_fullsized":"2024-02-10T08:37:10.034622+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:10.034501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:38.360929+0000","last_clean_scrub_stamp":"2024-02-10T08:37:10.034501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":392,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.183647+0000","last_change":"2024-02-10T08:34:37.281857+0000","last_active":"2024-02-10T08:37:01.183647+0000","last_peered":"2024-02-10T08:37:01.183647+0000","last_clean":"2024-02-10T08:37:01.183647+0000","last_became_active":"2024-02-10T08:20:46.399838+0000","last_became_peered":"2024-02-10T08:20:46.399838+0000","last_unstale":"2024-02-10T08:37:01.183647+0000","last_undegraded":"2024-02-10T08:37:01.183647+0000","last_fullsized":"2024-02-10T08:37:01.183647+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:37.281763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:34:37.281763+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":78,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.190278+0000","last_change":"2024-02-10T08:34:30.191894+0000","last_active":"2024-02-10T08:37:01.190278+0000","last_peered":"2024-02-10T08:37:01.190278+0000","last_clean":"2024-02-10T08:37:01.190278+0000","last_became_active":"2024-02-10T08:32:36.982778+0000","last_became_peered":"2024-02-10T08:32:36.982778+0000","last_unstale":"2024-02-10T08:37:01.190278+0000","last_undegraded":"2024-02-10T08:37:01.190278+0000","last_fullsized":"2024-02-10T08:37:01.190278+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:30.191790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:34:30.191790+0000","last_clean_scrub_stamp":"2024-02-10T08:34:30.191790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"402'35","reported_seq":507,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:02.025474+0000","last_change":"2024-02-10T08:36:22.029398+0000","last_active":"2024-02-10T08:37:02.025474+0000","last_peered":"2024-02-10T08:37:02.025474+0000","last_clean":"2024-02-10T08:37:02.025474+0000","last_became_active":"2024-02-10T08:31:33.879680+0000","last_became_peered":"2024-02-10T08:31:33.879680+0000","last_unstale":"2024-02-10T08:37:02.025474+0000","last_undegraded":"2024-02-10T08:37:02.025474+0000","last_fullsized":"2024-02-10T08:37:02.025474+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'25","last_scrub_stamp":"2024-02-10T08:36:22.029278+0000","last_deep_scrub":"225'25","last_deep_scrub_stamp":"2024-02-10T08:36:22.029278+0000","last_clean_scrub_stamp":"2024-02-10T08:36:22.029278+0000","log_size":35,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":39,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":396,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.180519+0000","last_change":"2024-02-10T08:35:10.165815+0000","last_active":"2024-02-10T08:37:01.180519+0000","last_peered":"2024-02-10T08:37:01.180519+0000","last_clean":"2024-02-10T08:37:01.180519+0000","last_became_active":"2024-02-10T08:20:46.392466+0000","last_became_peered":"2024-02-10T08:20:46.392466+0000","last_unstale":"2024-02-10T08:37:01.180519+0000","last_undegraded":"2024-02-10T08:37:01.180519+0000","last_fullsized":"2024-02-10T08:37:01.180519+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:35:10.165751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:29:26.072031+0000","last_clean_scrub_stamp":"2024-02-10T08:35:10.165751+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1f","version":"111'11","reported_seq":659,"reported_epoch":403,"state":"active+clean","last_fresh":"2024-02-10T08:37:15.307345+0000","last_change":"2024-02-10T08:36:26.882591+0000","last_active":"2024-02-10T08:37:15.307345+0000","last_peered":"2024-02-10T08:37:15.307345+0000","last_clean":"2024-02-10T08:37:15.307345+0000","last_became_active":"2024-02-10T08:20:46.402663+0000","last_became_peered":"2024-02-10T08:20:46.402663+0000","last_unstale":"2024-02-10T08:37:15.307345+0000","last_undegraded":"2024-02-10T08:37:15.307345+0000","last_fullsized":"2024-02-10T08:37:15.307345+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'11","last_scrub_stamp":"2024-02-10T08:36:26.882513+0000","last_deep_scrub":"111'11","last_deep_scrub_stamp":"2024-02-10T08:36:26.882513+0000","last_clean_scrub_stamp":"2024-02-10T08:36:26.882513+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"87'2","reported_seq":377,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.184469+0000","last_change":"2024-02-10T08:33:29.353243+0000","last_active":"2024-02-10T08:37:01.184469+0000","last_peered":"2024-02-10T08:37:01.184469+0000","last_clean":"2024-02-10T08:37:01.184469+0000","last_became_active":"2024-02-10T08:16:58.859047+0000","last_became_peered":"2024-02-10T08:16:58.859047+0000","last_unstale":"2024-02-10T08:37:01.184469+0000","last_undegraded":"2024-02-10T08:37:01.184469+0000","last_fullsized":"2024-02-10T08:37:01.184469+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'2","last_scrub_stamp":"2024-02-10T08:33:29.353122+0000","last_deep_scrub":"87'2","last_deep_scrub_stamp":"2024-02-10T08:19:29.207531+0000","last_clean_scrub_stamp":"2024-02-10T08:33:29.353122+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"402'27","reported_seq":435,"reported_epoch":403,"state":"active+clean","last_fresh":"2024-02-10T08:37:15.944427+0000","last_change":"2024-02-10T08:37:15.944427+0000","last_active":"2024-02-10T08:37:15.944427+0000","last_peered":"2024-02-10T08:37:15.944427+0000","last_clean":"2024-02-10T08:37:15.944427+0000","last_became_active":"2024-02-10T08:16:54.852665+0000","last_became_peered":"2024-02-10T08:16:54.852665+0000","last_unstale":"2024-02-10T08:37:15.944427+0000","last_undegraded":"2024-02-10T08:37:15.944427+0000","last_fullsized":"2024-02-10T08:37:15.944427+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'27","last_scrub_stamp":"2024-02-10T08:37:15.944334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:37:15.944334+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":328,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.184869+0000","last_change":"2024-02-10T08:36:20.955661+0000","last_active":"2024-02-10T08:37:01.184869+0000","last_peered":"2024-02-10T08:37:01.184869+0000","last_clean":"2024-02-10T08:37:01.184869+0000","last_became_active":"2024-02-10T08:31:33.878473+0000","last_became_peered":"2024-02-10T08:31:33.878473+0000","last_unstale":"2024-02-10T08:37:01.184869+0000","last_undegraded":"2024-02-10T08:37:01.184869+0000","last_fullsized":"2024-02-10T08:37:01.184869+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:20.955583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:25:42.124914+0000","last_clean_scrub_stamp":"2024-02-10T08:36:20.955583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":212,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.190570+0000","last_change":"2024-02-10T08:36:13.964373+0000","last_active":"2024-02-10T08:37:01.190570+0000","last_peered":"2024-02-10T08:37:01.190570+0000","last_clean":"2024-02-10T08:37:01.190570+0000","last_became_active":"2024-02-10T08:28:25.951312+0000","last_became_peered":"2024-02-10T08:28:25.951312+0000","last_unstale":"2024-02-10T08:37:01.190570+0000","last_undegraded":"2024-02-10T08:37:01.190570+0000","last_fullsized":"2024-02-10T08:37:01.190570+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:13.964287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:36:13.964287+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":391,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:02.966889+0000","last_change":"2024-02-10T08:37:02.966867+0000","last_active":"2024-02-10T08:37:02.966889+0000","last_peered":"2024-02-10T08:37:02.966889+0000","last_clean":"2024-02-10T08:37:02.966889+0000","last_became_active":"2024-02-10T08:20:46.408504+0000","last_became_peered":"2024-02-10T08:20:46.408504+0000","last_unstale":"2024-02-10T08:37:02.966889+0000","last_undegraded":"2024-02-10T08:37:02.966889+0000","last_fullsized":"2024-02-10T08:37:02.966889+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:02.966806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:22.104988+0000","last_clean_scrub_stamp":"2024-02-10T08:37:02.966806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"402'46","reported_seq":508,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.741723+0000","last_change":"2024-02-10T08:36:17.678558+0000","last_active":"2024-02-10T08:37:01.741723+0000","last_peered":"2024-02-10T08:37:01.741723+0000","last_clean":"2024-02-10T08:37:01.741723+0000","last_became_active":"2024-02-10T08:31:33.894960+0000","last_became_peered":"2024-02-10T08:31:33.894960+0000","last_unstale":"2024-02-10T08:37:01.741723+0000","last_undegraded":"2024-02-10T08:37:01.741723+0000","last_fullsized":"2024-02-10T08:37:01.741723+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"330'34","last_scrub_stamp":"2024-02-10T08:36:17.678489+0000","last_deep_scrub":"330'34","last_deep_scrub_stamp":"2024-02-10T08:32:17.481832+0000","last_clean_scrub_stamp":"2024-02-10T08:36:17.678489+0000","log_size":46,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":62,"num_read_kb":53,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":401,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.183928+0000","last_change":"2024-02-10T08:36:08.027692+0000","last_active":"2024-02-10T08:37:01.183928+0000","last_peered":"2024-02-10T08:37:01.183928+0000","last_clean":"2024-02-10T08:37:01.183928+0000","last_became_active":"2024-02-10T08:20:46.396303+0000","last_became_peered":"2024-02-10T08:20:46.396303+0000","last_unstale":"2024-02-10T08:37:01.183928+0000","last_undegraded":"2024-02-10T08:37:01.183928+0000","last_fullsized":"2024-02-10T08:37:01.183928+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:08.027632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:10.370746+0000","last_clean_scrub_stamp":"2024-02-10T08:36:08.027632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":411,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:06.943801+0000","last_change":"2024-02-10T08:37:06.943759+0000","last_active":"2024-02-10T08:37:06.943801+0000","last_peered":"2024-02-10T08:37:06.943801+0000","last_clean":"2024-02-10T08:37:06.943801+0000","last_became_active":"2024-02-10T08:28:02.763523+0000","last_became_peered":"2024-02-10T08:28:02.763523+0000","last_unstale":"2024-02-10T08:37:06.943801+0000","last_undegraded":"2024-02-10T08:37:06.943801+0000","last_fullsized":"2024-02-10T08:37:06.943801+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:06.943647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:37:06.943647+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":359,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.188578+0000","last_change":"2024-02-10T08:36:26.255325+0000","last_active":"2024-02-10T08:37:01.188578+0000","last_peered":"2024-02-10T08:37:01.188578+0000","last_clean":"2024-02-10T08:37:01.188578+0000","last_became_active":"2024-02-10T08:20:46.403378+0000","last_became_peered":"2024-02-10T08:20:46.403378+0000","last_unstale":"2024-02-10T08:37:01.188578+0000","last_undegraded":"2024-02-10T08:37:01.188578+0000","last_fullsized":"2024-02-10T08:37:01.188578+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:26.255232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:36:26.255232+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"402'29","reported_seq":402,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:02.133177+0000","last_change":"2024-02-10T08:36:21.774391+0000","last_active":"2024-02-10T08:37:02.133177+0000","last_peered":"2024-02-10T08:37:02.133177+0000","last_clean":"2024-02-10T08:37:02.133177+0000","last_became_active":"2024-02-10T08:31:33.891562+0000","last_became_peered":"2024-02-10T08:31:33.891562+0000","last_unstale":"2024-02-10T08:37:02.133177+0000","last_undegraded":"2024-02-10T08:37:02.133177+0000","last_fullsized":"2024-02-10T08:37:02.133177+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"226'23","last_scrub_stamp":"2024-02-10T08:36:21.774228+0000","last_deep_scrub":"226'23","last_deep_scrub_stamp":"2024-02-10T08:33:31.665189+0000","last_clean_scrub_stamp":"2024-02-10T08:36:21.774228+0000","log_size":29,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":305,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.184269+0000","last_change":"2024-02-10T08:36:57.566152+0000","last_active":"2024-02-10T08:37:01.184269+0000","last_peered":"2024-02-10T08:37:01.184269+0000","last_clean":"2024-02-10T08:37:01.184269+0000","last_became_active":"2024-02-10T08:31:33.879918+0000","last_became_peered":"2024-02-10T08:31:33.879918+0000","last_unstale":"2024-02-10T08:37:01.184269+0000","last_undegraded":"2024-02-10T08:37:01.184269+0000","last_fullsized":"2024-02-10T08:37:01.184269+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:57.566061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:36:57.566061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":361,"reported_epoch":403,"state":"active+clean","last_fresh":"2024-02-10T08:37:17.819749+0000","last_change":"2024-02-10T08:37:17.819749+0000","last_active":"2024-02-10T08:37:17.819749+0000","last_peered":"2024-02-10T08:37:17.819749+0000","last_clean":"2024-02-10T08:37:17.819749+0000","last_became_active":"2024-02-10T08:20:46.398532+0000","last_became_peered":"2024-02-10T08:20:46.398532+0000","last_unstale":"2024-02-10T08:37:17.819749+0000","last_undegraded":"2024-02-10T08:37:17.819749+0000","last_fullsized":"2024-02-10T08:37:17.819749+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:17.819656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:37:17.819656+0000","last_clean_scrub_stamp":"2024-02-10T08:37:17.819656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":297,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:02.097655+0000","last_change":"2024-02-10T08:37:02.097619+0000","last_active":"2024-02-10T08:37:02.097655+0000","last_peered":"2024-02-10T08:37:02.097655+0000","last_clean":"2024-02-10T08:37:02.097655+0000","last_became_active":"2024-02-10T08:22:23.526229+0000","last_became_peered":"2024-02-10T08:22:23.526229+0000","last_unstale":"2024-02-10T08:37:02.097655+0000","last_undegraded":"2024-02-10T08:37:02.097655+0000","last_fullsized":"2024-02-10T08:37:02.097655+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:02.097524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:37:02.097524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1a","version":"402'21","reported_seq":124,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:06.900843+0000","last_change":"2024-02-10T08:37:06.900806+0000","last_active":"2024-02-10T08:37:06.900843+0000","last_peered":"2024-02-10T08:37:06.900843+0000","last_clean":"2024-02-10T08:37:06.900843+0000","last_became_active":"2024-02-10T08:31:46.069680+0000","last_became_peered":"2024-02-10T08:31:46.069680+0000","last_unstale":"2024-02-10T08:37:06.900843+0000","last_undegraded":"2024-02-10T08:37:06.900843+0000","last_fullsized":"2024-02-10T08:37:06.900843+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'21","last_scrub_stamp":"2024-02-10T08:37:06.900702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:37:06.900702+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":34,"num_read_kb":28,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":381,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.184158+0000","last_change":"2024-02-10T08:36:17.423852+0000","last_active":"2024-02-10T08:37:01.184158+0000","last_peered":"2024-02-10T08:37:01.184158+0000","last_clean":"2024-02-10T08:37:01.184158+0000","last_became_active":"2024-02-10T08:16:52.787865+0000","last_became_peered":"2024-02-10T08:16:52.787865+0000","last_unstale":"2024-02-10T08:37:01.184158+0000","last_undegraded":"2024-02-10T08:37:01.184158+0000","last_fullsized":"2024-02-10T08:37:01.184158+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:17.423742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:28.028556+0000","last_clean_scrub_stamp":"2024-02-10T08:36:17.423742+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":413,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.179490+0000","last_change":"2024-02-10T08:35:08.193565+0000","last_active":"2024-02-10T08:37:01.179490+0000","last_peered":"2024-02-10T08:37:01.179490+0000","last_clean":"2024-02-10T08:37:01.179490+0000","last_became_active":"2024-02-10T08:28:19.065132+0000","last_became_peered":"2024-02-10T08:28:19.065132+0000","last_unstale":"2024-02-10T08:37:01.179490+0000","last_undegraded":"2024-02-10T08:37:01.179490+0000","last_fullsized":"2024-02-10T08:37:01.179490+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:35:08.193502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:35:08.193502+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,7],"acting":[5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":83,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.190293+0000","last_change":"2024-02-10T08:36:23.009770+0000","last_active":"2024-02-10T08:37:01.190293+0000","last_peered":"2024-02-10T08:37:01.190293+0000","last_clean":"2024-02-10T08:37:01.190293+0000","last_became_active":"2024-02-10T08:32:36.978752+0000","last_became_peered":"2024-02-10T08:32:36.978752+0000","last_unstale":"2024-02-10T08:37:01.190293+0000","last_undegraded":"2024-02-10T08:37:01.190293+0000","last_fullsized":"2024-02-10T08:37:01.190293+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:23.009704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:36:23.009704+0000","last_clean_scrub_stamp":"2024-02-10T08:36:23.009704+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"402'9","reported_seq":413,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.508295+0000","last_change":"2024-02-10T08:36:03.143607+0000","last_active":"2024-02-10T08:37:01.508295+0000","last_peered":"2024-02-10T08:37:01.508295+0000","last_clean":"2024-02-10T08:37:01.508295+0000","last_became_active":"2024-02-10T08:27:27.715306+0000","last_became_peered":"2024-02-10T08:27:27.715306+0000","last_unstale":"2024-02-10T08:37:01.508295+0000","last_undegraded":"2024-02-10T08:37:01.508295+0000","last_fullsized":"2024-02-10T08:37:01.508295+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'7","last_scrub_stamp":"2024-02-10T08:36:03.143512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:36:03.143512+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":12,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"55'1","reported_seq":414,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:12.516875+0000","last_change":"2024-02-10T08:37:12.516833+0000","last_active":"2024-02-10T08:37:12.516875+0000","last_peered":"2024-02-10T08:37:12.516875+0000","last_clean":"2024-02-10T08:37:12.516875+0000","last_became_active":"2024-02-10T08:28:02.761299+0000","last_became_peered":"2024-02-10T08:28:02.761299+0000","last_unstale":"2024-02-10T08:37:12.516875+0000","last_undegraded":"2024-02-10T08:37:12.516875+0000","last_fullsized":"2024-02-10T08:37:12.516875+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'1","last_scrub_stamp":"2024-02-10T08:37:12.516726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:37:12.516726+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1746,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":392,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.183775+0000","last_change":"2024-02-10T08:34:12.333244+0000","last_active":"2024-02-10T08:37:01.183775+0000","last_peered":"2024-02-10T08:37:01.183775+0000","last_clean":"2024-02-10T08:37:01.183775+0000","last_became_active":"2024-02-10T08:20:46.406783+0000","last_became_peered":"2024-02-10T08:20:46.406783+0000","last_unstale":"2024-02-10T08:37:01.183775+0000","last_undegraded":"2024-02-10T08:37:01.183775+0000","last_fullsized":"2024-02-10T08:37:01.183775+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:12.333167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:34:12.333167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":393,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.178739+0000","last_change":"2024-02-10T08:34:34.307258+0000","last_active":"2024-02-10T08:37:01.178739+0000","last_peered":"2024-02-10T08:37:01.178739+0000","last_clean":"2024-02-10T08:37:01.178739+0000","last_became_active":"2024-02-10T08:31:33.886617+0000","last_became_peered":"2024-02-10T08:31:33.886617+0000","last_unstale":"2024-02-10T08:37:01.178739+0000","last_undegraded":"2024-02-10T08:37:01.178739+0000","last_fullsized":"2024-02-10T08:37:01.178739+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:34.307158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:34:34.307158+0000","last_clean_scrub_stamp":"2024-02-10T08:34:34.307158+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"401'25","reported_seq":396,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.186269+0000","last_change":"2024-02-10T08:37:00.943143+0000","last_active":"2024-02-10T08:37:01.186269+0000","last_peered":"2024-02-10T08:37:01.186269+0000","last_clean":"2024-02-10T08:37:01.186269+0000","last_became_active":"2024-02-10T08:20:46.404966+0000","last_became_peered":"2024-02-10T08:20:46.404966+0000","last_unstale":"2024-02-10T08:37:01.186269+0000","last_undegraded":"2024-02-10T08:37:01.186269+0000","last_fullsized":"2024-02-10T08:37:01.186269+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"401'21","last_scrub_stamp":"2024-02-10T08:37:00.943036+0000","last_deep_scrub":"358'19","last_deep_scrub_stamp":"2024-02-10T08:33:34.450897+0000","last_clean_scrub_stamp":"2024-02-10T08:37:00.943036+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":34,"num_read_kb":28,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":84,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.190663+0000","last_change":"2024-02-10T08:35:07.250085+0000","last_active":"2024-02-10T08:37:01.190663+0000","last_peered":"2024-02-10T08:37:01.190663+0000","last_clean":"2024-02-10T08:37:01.190663+0000","last_became_active":"2024-02-10T08:32:36.982675+0000","last_became_peered":"2024-02-10T08:32:36.982675+0000","last_unstale":"2024-02-10T08:37:01.190663+0000","last_undegraded":"2024-02-10T08:37:01.190663+0000","last_fullsized":"2024-02-10T08:37:01.190663+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:35:07.249972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:35:07.249972+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,5],"acting":[0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":378,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.194964+0000","last_change":"2024-02-10T08:36:17.766707+0000","last_active":"2024-02-10T08:37:01.194964+0000","last_peered":"2024-02-10T08:37:01.194964+0000","last_clean":"2024-02-10T08:37:01.194964+0000","last_became_active":"2024-02-10T08:16:56.863353+0000","last_became_peered":"2024-02-10T08:16:56.863353+0000","last_unstale":"2024-02-10T08:37:01.194964+0000","last_undegraded":"2024-02-10T08:37:01.194964+0000","last_fullsized":"2024-02-10T08:37:01.194964+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:17.766647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:36:17.766647+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":365,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:08.945407+0000","last_change":"2024-02-10T08:37:08.945376+0000","last_active":"2024-02-10T08:37:08.945407+0000","last_peered":"2024-02-10T08:37:08.945407+0000","last_clean":"2024-02-10T08:37:08.945407+0000","last_became_active":"2024-02-10T08:20:46.405314+0000","last_became_peered":"2024-02-10T08:20:46.405314+0000","last_unstale":"2024-02-10T08:37:08.945407+0000","last_undegraded":"2024-02-10T08:37:08.945407+0000","last_fullsized":"2024-02-10T08:37:08.945407+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:08.945287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:29:25.024412+0000","last_clean_scrub_stamp":"2024-02-10T08:37:08.945287+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"402'39","reported_seq":465,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:02.122232+0000","last_change":"2024-02-10T08:36:04.675100+0000","last_active":"2024-02-10T08:37:02.122232+0000","last_peered":"2024-02-10T08:37:02.122232+0000","last_clean":"2024-02-10T08:37:02.122232+0000","last_became_active":"2024-02-10T08:31:33.883535+0000","last_became_peered":"2024-02-10T08:31:33.883535+0000","last_unstale":"2024-02-10T08:37:02.122232+0000","last_undegraded":"2024-02-10T08:37:02.122232+0000","last_fullsized":"2024-02-10T08:37:02.122232+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'27","last_scrub_stamp":"2024-02-10T08:36:04.675002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:36:04.675002+0000","log_size":39,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":83,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.190724+0000","last_change":"2024-02-10T08:36:25.970207+0000","last_active":"2024-02-10T08:37:01.190724+0000","last_peered":"2024-02-10T08:37:01.190724+0000","last_clean":"2024-02-10T08:37:01.190724+0000","last_became_active":"2024-02-10T08:32:36.977972+0000","last_became_peered":"2024-02-10T08:32:36.977972+0000","last_unstale":"2024-02-10T08:37:01.190724+0000","last_undegraded":"2024-02-10T08:37:01.190724+0000","last_fullsized":"2024-02-10T08:37:01.190724+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:25.970136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:36:25.970136+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":105,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.186216+0000","last_change":"2024-02-10T08:36:24.205289+0000","last_active":"2024-02-10T08:37:01.186216+0000","last_peered":"2024-02-10T08:37:01.186216+0000","last_clean":"2024-02-10T08:37:01.186216+0000","last_became_active":"2024-02-10T08:31:46.057858+0000","last_became_peered":"2024-02-10T08:31:46.057858+0000","last_unstale":"2024-02-10T08:37:01.186216+0000","last_undegraded":"2024-02-10T08:37:01.186216+0000","last_fullsized":"2024-02-10T08:37:01.186216+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:24.205221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:36:24.205221+0000","last_clean_scrub_stamp":"2024-02-10T08:36:24.205221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":305,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.183945+0000","last_change":"2024-02-10T08:35:19.525731+0000","last_active":"2024-02-10T08:37:01.183945+0000","last_peered":"2024-02-10T08:37:01.183945+0000","last_clean":"2024-02-10T08:37:01.183945+0000","last_became_active":"2024-02-10T08:31:33.880328+0000","last_became_peered":"2024-02-10T08:31:33.880328+0000","last_unstale":"2024-02-10T08:37:01.183945+0000","last_undegraded":"2024-02-10T08:37:01.183945+0000","last_fullsized":"2024-02-10T08:37:01.183945+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:35:19.525667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:35:19.525667+0000","last_clean_scrub_stamp":"2024-02-10T08:35:19.525667+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":294,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.198757+0000","last_change":"2024-02-10T08:36:19.772188+0000","last_active":"2024-02-10T08:37:01.198757+0000","last_peered":"2024-02-10T08:37:01.198757+0000","last_clean":"2024-02-10T08:37:01.198757+0000","last_became_active":"2024-02-10T08:22:00.581772+0000","last_became_peered":"2024-02-10T08:22:00.581772+0000","last_unstale":"2024-02-10T08:37:01.198757+0000","last_undegraded":"2024-02-10T08:37:01.198757+0000","last_fullsized":"2024-02-10T08:37:01.198757+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:19.772116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:36:19.772116+0000","last_clean_scrub_stamp":"2024-02-10T08:36:19.772116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,7],"acting":[1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":312,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:09.583236+0000","last_change":"2024-02-10T08:37:09.583191+0000","last_active":"2024-02-10T08:37:09.583236+0000","last_peered":"2024-02-10T08:37:09.583236+0000","last_clean":"2024-02-10T08:37:09.583236+0000","last_became_active":"2024-02-10T08:31:46.054713+0000","last_became_peered":"2024-02-10T08:31:46.054713+0000","last_unstale":"2024-02-10T08:37:09.583236+0000","last_undegraded":"2024-02-10T08:37:09.583236+0000","last_fullsized":"2024-02-10T08:37:09.583236+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:09.583098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:37:09.583098+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":301,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.183445+0000","last_change":"2024-02-10T08:36:54.988639+0000","last_active":"2024-02-10T08:37:01.183445+0000","last_peered":"2024-02-10T08:37:01.183445+0000","last_clean":"2024-02-10T08:37:01.183445+0000","last_became_active":"2024-02-10T08:22:00.600200+0000","last_became_peered":"2024-02-10T08:22:00.600200+0000","last_unstale":"2024-02-10T08:37:01.183445+0000","last_undegraded":"2024-02-10T08:37:01.183445+0000","last_fullsized":"2024-02-10T08:37:01.183445+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:54.988559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:36:54.988559+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1],"acting":[6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":286,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.190391+0000","last_change":"2024-02-10T08:37:01.145599+0000","last_active":"2024-02-10T08:37:01.190391+0000","last_peered":"2024-02-10T08:37:01.190391+0000","last_clean":"2024-02-10T08:37:01.190391+0000","last_became_active":"2024-02-10T08:28:25.999335+0000","last_became_peered":"2024-02-10T08:28:25.999335+0000","last_unstale":"2024-02-10T08:37:01.190391+0000","last_undegraded":"2024-02-10T08:37:01.190391+0000","last_fullsized":"2024-02-10T08:37:01.190391+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:01.145508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:37:01.145508+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":408,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:15.183914+0000","last_change":"2024-02-10T08:37:15.183869+0000","last_active":"2024-02-10T08:37:15.183914+0000","last_peered":"2024-02-10T08:37:15.183914+0000","last_clean":"2024-02-10T08:37:15.183914+0000","last_became_active":"2024-02-10T08:31:33.879440+0000","last_became_peered":"2024-02-10T08:31:33.879440+0000","last_unstale":"2024-02-10T08:37:15.183914+0000","last_undegraded":"2024-02-10T08:37:15.183914+0000","last_fullsized":"2024-02-10T08:37:15.183914+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:15.183781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:37:15.183781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":409,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.184810+0000","last_change":"2024-02-10T08:36:10.035263+0000","last_active":"2024-02-10T08:37:01.184810+0000","last_peered":"2024-02-10T08:37:01.184810+0000","last_clean":"2024-02-10T08:37:01.184810+0000","last_became_active":"2024-02-10T08:27:27.710587+0000","last_became_peered":"2024-02-10T08:27:27.710587+0000","last_unstale":"2024-02-10T08:37:01.184810+0000","last_undegraded":"2024-02-10T08:37:01.184810+0000","last_fullsized":"2024-02-10T08:37:01.184810+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:10.035169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:11.750537+0000","last_clean_scrub_stamp":"2024-02-10T08:36:10.035169+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,1],"acting":[6,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":312,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.195764+0000","last_change":"2024-02-10T08:36:22.783889+0000","last_active":"2024-02-10T08:37:01.195764+0000","last_peered":"2024-02-10T08:37:01.195764+0000","last_clean":"2024-02-10T08:37:01.195764+0000","last_became_active":"2024-02-10T08:32:36.974142+0000","last_became_peered":"2024-02-10T08:32:36.974142+0000","last_unstale":"2024-02-10T08:37:01.195764+0000","last_undegraded":"2024-02-10T08:37:01.195764+0000","last_fullsized":"2024-02-10T08:37:01.195764+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:22.783769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:36:22.783769+0000","last_clean_scrub_stamp":"2024-02-10T08:36:22.783769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":317,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.184483+0000","last_change":"2024-02-10T08:36:56.112985+0000","last_active":"2024-02-10T08:37:01.184483+0000","last_peered":"2024-02-10T08:37:01.184483+0000","last_clean":"2024-02-10T08:37:01.184483+0000","last_became_active":"2024-02-10T08:32:36.979412+0000","last_became_peered":"2024-02-10T08:32:36.979412+0000","last_unstale":"2024-02-10T08:37:01.184483+0000","last_undegraded":"2024-02-10T08:37:01.184483+0000","last_fullsized":"2024-02-10T08:37:01.184483+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:56.112889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:36:56.112889+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1],"acting":[6,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":389,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.185207+0000","last_change":"2024-02-10T08:36:22.695059+0000","last_active":"2024-02-10T08:37:01.185207+0000","last_peered":"2024-02-10T08:37:01.185207+0000","last_clean":"2024-02-10T08:37:01.185207+0000","last_became_active":"2024-02-10T08:22:00.578118+0000","last_became_peered":"2024-02-10T08:22:00.578118+0000","last_unstale":"2024-02-10T08:37:01.185207+0000","last_undegraded":"2024-02-10T08:37:01.185207+0000","last_fullsized":"2024-02-10T08:37:01.185207+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:22.694931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:36:22.694931+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,6],"acting":[2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.29","version":"76'2","reported_seq":342,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:05.646852+0000","last_change":"2024-02-10T08:37:05.646814+0000","last_active":"2024-02-10T08:37:05.646852+0000","last_peered":"2024-02-10T08:37:05.646852+0000","last_clean":"2024-02-10T08:37:05.646852+0000","last_became_active":"2024-02-10T08:28:02.767822+0000","last_became_peered":"2024-02-10T08:28:02.767822+0000","last_unstale":"2024-02-10T08:37:05.646852+0000","last_undegraded":"2024-02-10T08:37:05.646852+0000","last_fullsized":"2024-02-10T08:37:05.646852+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":6,"last_scrub":"76'2","last_scrub_stamp":"2024-02-10T08:37:05.646710+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2024-02-10T08:18:08.680038+0000","last_clean_scrub_stamp":"2024-02-10T08:37:05.646710+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,0],"acting":[7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":111,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.186908+0000","last_change":"2024-02-10T08:35:09.039987+0000","last_active":"2024-02-10T08:37:01.186908+0000","last_peered":"2024-02-10T08:37:01.186908+0000","last_clean":"2024-02-10T08:37:01.186908+0000","last_became_active":"2024-02-10T08:32:36.975213+0000","last_became_peered":"2024-02-10T08:32:36.975213+0000","last_unstale":"2024-02-10T08:37:01.186908+0000","last_undegraded":"2024-02-10T08:37:01.186908+0000","last_fullsized":"2024-02-10T08:37:01.186908+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:35:09.039924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:20.392249+0000","last_clean_scrub_stamp":"2024-02-10T08:35:09.039924+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0],"acting":[4,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":128,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.178260+0000","last_change":"2024-02-10T08:34:10.431223+0000","last_active":"2024-02-10T08:37:01.178260+0000","last_peered":"2024-02-10T08:37:01.178260+0000","last_clean":"2024-02-10T08:37:01.178260+0000","last_became_active":"2024-02-10T08:30:26.079913+0000","last_became_peered":"2024-02-10T08:30:26.079913+0000","last_unstale":"2024-02-10T08:37:01.178260+0000","last_undegraded":"2024-02-10T08:37:01.178260+0000","last_fullsized":"2024-02-10T08:37:01.178260+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:10.431134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:34:10.431134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":241,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.187488+0000","last_change":"2024-02-10T08:36:20.265038+0000","last_active":"2024-02-10T08:37:01.187488+0000","last_peered":"2024-02-10T08:37:01.187488+0000","last_clean":"2024-02-10T08:37:01.187488+0000","last_became_active":"2024-02-10T08:33:56.117425+0000","last_became_peered":"2024-02-10T08:33:56.117425+0000","last_unstale":"2024-02-10T08:37:01.187488+0000","last_undegraded":"2024-02-10T08:37:01.187488+0000","last_fullsized":"2024-02-10T08:37:01.187488+0000","mapping_epoch":364,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":365,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:20.264960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:20:30.227375+0000","last_clean_scrub_stamp":"2024-02-10T08:36:20.264960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":405,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:07.530261+0000","last_change":"2024-02-10T08:37:07.530227+0000","last_active":"2024-02-10T08:37:07.530261+0000","last_peered":"2024-02-10T08:37:07.530261+0000","last_clean":"2024-02-10T08:37:07.530261+0000","last_became_active":"2024-02-10T08:30:26.085360+0000","last_became_peered":"2024-02-10T08:30:26.085360+0000","last_unstale":"2024-02-10T08:37:07.530261+0000","last_undegraded":"2024-02-10T08:37:07.530261+0000","last_fullsized":"2024-02-10T08:37:07.530261+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:07.530127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:37:07.530127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,5],"acting":[2,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":133,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.184434+0000","last_change":"2024-02-10T08:36:14.985405+0000","last_active":"2024-02-10T08:37:01.184434+0000","last_peered":"2024-02-10T08:37:01.184434+0000","last_clean":"2024-02-10T08:37:01.184434+0000","last_became_active":"2024-02-10T08:30:26.075472+0000","last_became_peered":"2024-02-10T08:30:26.075472+0000","last_unstale":"2024-02-10T08:37:01.184434+0000","last_undegraded":"2024-02-10T08:37:01.184434+0000","last_fullsized":"2024-02-10T08:37:01.184434+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:14.985304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:36:14.985304+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":132,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.184791+0000","last_change":"2024-02-10T08:36:04.485289+0000","last_active":"2024-02-10T08:37:01.184791+0000","last_peered":"2024-02-10T08:37:01.184791+0000","last_clean":"2024-02-10T08:37:01.184791+0000","last_became_active":"2024-02-10T08:30:26.080539+0000","last_became_peered":"2024-02-10T08:30:26.080539+0000","last_unstale":"2024-02-10T08:37:01.184791+0000","last_undegraded":"2024-02-10T08:37:01.184791+0000","last_fullsized":"2024-02-10T08:37:01.184791+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:04.485194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:34.215363+0000","last_clean_scrub_stamp":"2024-02-10T08:36:04.485194+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":128,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.182955+0000","last_change":"2024-02-10T08:36:14.408397+0000","last_active":"2024-02-10T08:37:01.182955+0000","last_peered":"2024-02-10T08:37:01.182955+0000","last_clean":"2024-02-10T08:37:01.182955+0000","last_became_active":"2024-02-10T08:30:26.088228+0000","last_became_peered":"2024-02-10T08:30:26.088228+0000","last_unstale":"2024-02-10T08:37:01.182955+0000","last_undegraded":"2024-02-10T08:37:01.182955+0000","last_fullsized":"2024-02-10T08:37:01.182955+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:14.408305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:36:14.408305+0000","last_clean_scrub_stamp":"2024-02-10T08:36:14.408305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1],"acting":[7,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":310,"reported_epoch":402,"state":"active+clean","last_fresh":"2024-02-10T08:37:01.178148+0000","last_change":"2024-02-10T08:34:17.350483+0000","last_active":"2024-02-10T08:37:01.178148+0000","last_peered":"2024-02-10T08:37:01.178148+0000","last_clean":"2024-02-10T08:37:01.178148+0000","last_became_active":"2024-02-10T08:30:26.072022+0000","last_became_peered":"2024-02-10T08:30:26.072022+0000","last_unstale":"2024-02-10T08:37:01.178148+0000","last_undegraded":"2024-02-10T08:37:01.178148+0000","last_fullsized":"2024-02-10T08:37:01.178148+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:34:17.350406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:34:17.350406+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":16,"stat_sum":{"num_bytes":2772959232,"num_objects":42312,"num_object_clones":0,"num_object_copies":126936,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42312,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42312,"num_write_kb":2707968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8330280960,"data_stored":8330280960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42312,"ondisk_log_size":42312,"up":48,"acting":48,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2646,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":4},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1214,"num_read_kb":1209,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":9,"acting":9,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":1534,"num_read_kb":1291,"num_write":989,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":212,"num_bytes_recovered":5226,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1032,"ondisk_log_size":1032,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":96,"acting":96,"num_store_stats":8},{"poolid":6,"num_pg":52,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":156,"acting":156,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":50,"seq":214748365049,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1583868,"kb_used_data":990068,"kb_used_omap":0,"kb_used_meta":593792,"kb_avail":92161284,"statfs":{"total":95995035648,"available":94373154816,"internally_reserved":0,"allocated":1013829632,"data_stored":1013420425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":608043008},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,2,2],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:36:18 2024","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":2.6160000000000001,"15min":2.089},"min":{"1min":0.23400000000000001,"5min":0.20899999999999999,"15min":0.19600000000000001},"max":{"1min":3.8210000000000002,"5min":107.95699999999999,"15min":107.95699999999999},"last":1.248},{"interface":"front","average":{"1min":0.99099999999999999,"5min":2.9529999999999998,"15min":2.528},"min":{"1min":0.27100000000000002,"5min":0.23499999999999999,"15min":0.20999999999999999},"max":{"1min":5.0880000000000001,"5min":108.33499999999999,"15min":108.33499999999999},"last":2.98}]},{"osd":1,"last update":"Sat Feb 10 08:36:18 2024","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":1.387,"15min":1.7849999999999999},"min":{"1min":0.26800000000000002,"5min":0.23100000000000001,"15min":0.20000000000000001},"max":{"1min":3.8879999999999999,"5min":8.7530000000000001,"15min":41.539999999999999},"last":2.2050000000000001},{"interface":"front","average":{"1min":1.153,"5min":1.8560000000000001,"15min":1.956},"min":{"1min":0.39000000000000001,"5min":0.25700000000000001,"15min":0.22700000000000001},"max":{"1min":3.7909999999999999,"5min":10.099,"15min":41.046999999999997},"last":0.27400000000000002}]},{"osd":2,"last update":"Sat Feb 10 08:36:18 2024","interfaces":[{"interface":"back","average":{"1min":1.6990000000000001,"5min":2.4279999999999999,"15min":1.9650000000000001},"min":{"1min":0.27400000000000002,"5min":0.25700000000000001,"15min":0.251},"max":{"1min":6.8019999999999996,"5min":36.308999999999997,"15min":36.308999999999997},"last":5.0510000000000002},{"interface":"front","average":{"1min":1.095,"5min":2.0710000000000002,"15min":1.9019999999999999},"min":{"1min":0.29599999999999999,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":3.952,"5min":36.268000000000001,"15min":36.268000000000001},"last":7.2779999999999996}]},{"osd":3,"last update":"Sat Feb 10 08:36:18 2024","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.679,"15min":1.74},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":4.9630000000000001,"5min":12.686,"15min":18.515000000000001},"last":1.369},{"interface":"front","average":{"1min":1.3600000000000001,"5min":2.0369999999999999,"15min":1.8500000000000001},"min":{"1min":0.34499999999999997,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":4.0789999999999997,"5min":10.960000000000001,"15min":10.960000000000001},"last":1.21}]},{"osd":4,"last update":"Sat Feb 10 08:36:18 2024","interfaces":[{"interface":"back","average":{"1min":1.839,"5min":1.8720000000000001,"15min":1.3720000000000001},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":23.797999999999998,"5min":23.797999999999998,"15min":23.797999999999998},"last":0.32000000000000001},{"interface":"front","average":{"1min":2.5899999999999999,"5min":1.796,"15min":1.3779999999999999},"min":{"1min":0.28599999999999998,"5min":0.26800000000000002,"15min":0.22700000000000001},"max":{"1min":26.303000000000001,"5min":26.303000000000001,"15min":26.303000000000001},"last":0.376}]},{"osd":5,"last update":"Sat Feb 10 08:36:18 2024","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.931,"15min":1.706},"min":{"1min":0.29399999999999998,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":8.4580000000000002,"5min":12.882,"15min":15.304},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.95499999999999996,"5min":1.5940000000000001,"15min":1.4490000000000001},"min":{"1min":0.33500000000000002,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":4.5789999999999997,"5min":13.129,"15min":13.129},"last":0.33200000000000002}]},{"osd":6,"last update":"Sat Feb 10 08:36:18 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":1.718,"15min":1.3540000000000001},"min":{"1min":0.312,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":2.8889999999999998,"5min":10.101000000000001,"15min":10.101000000000001},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.89500000000000002,"5min":1.8999999999999999,"15min":1.3959999999999999},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":6.8330000000000002,"5min":12.654,"15min":12.654},"last":0.35299999999999998}]}]},{"osd":6,"up_from":43,"seq":184683593982,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1889820,"kb_used_data":1300116,"kb_used_omap":0,"kb_used_meta":589696,"kb_avail":91855332,"statfs":{"total":95995035648,"available":94059859968,"internally_reserved":0,"allocated":1331318784,"data_stored":1330941710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":603848704},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,2,1,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:36:54 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":1.472,"15min":1.895},"min":{"1min":0.23200000000000001,"5min":0.20300000000000001,"15min":0.19400000000000001},"max":{"1min":3.448,"5min":6.452,"15min":30.509},"last":0.25600000000000001},{"interface":"front","average":{"1min":1.393,"5min":1.508,"15min":1.776},"min":{"1min":0.36299999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":7.0830000000000002,"5min":8.1590000000000007,"15min":36.090000000000003},"last":0.39200000000000002}]},{"osd":1,"last update":"Sat Feb 10 08:36:54 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":1.171,"15min":1.6220000000000001},"min":{"1min":0.25900000000000001,"5min":0.223,"15min":0.223},"max":{"1min":2.532,"5min":6.4219999999999997,"15min":12.938000000000001},"last":1.4390000000000001},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.8180000000000001,"15min":1.859},"min":{"1min":0.36099999999999999,"5min":0.215,"15min":0.215},"max":{"1min":3.742,"5min":11.976000000000001,"15min":11.976000000000001},"last":0.28399999999999997}]},{"osd":2,"last update":"Sat Feb 10 08:36:54 2024","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.6220000000000001,"15min":2.048},"min":{"1min":0.46000000000000002,"5min":0.27700000000000002,"15min":0.24399999999999999},"max":{"1min":4.9729999999999999,"5min":7.4989999999999997,"15min":35.072000000000003},"last":0.38400000000000001},{"interface":"front","average":{"1min":1.2,"5min":1.5529999999999999,"15min":1.8740000000000001},"min":{"1min":0.36499999999999999,"5min":0.23799999999999999,"15min":0.23100000000000001},"max":{"1min":4.9800000000000004,"5min":14.867000000000001,"15min":35.103000000000002},"last":0.42299999999999999}]},{"osd":3,"last update":"Sat Feb 10 08:36:54 2024","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":2.7130000000000001,"15min":2.27},"min":{"1min":0.29399999999999998,"5min":0.26800000000000002,"15min":0.26600000000000001},"max":{"1min":9.1359999999999992,"5min":103.94199999999999,"15min":103.94199999999999},"last":1.4910000000000001},{"interface":"front","average":{"1min":1.262,"5min":2.984,"15min":2.3799999999999999},"min":{"1min":0.34000000000000002,"5min":0.28000000000000003,"15min":0.253},"max":{"1min":8.0340000000000007,"5min":103.79600000000001,"15min":103.79600000000001},"last":0.34499999999999997}]},{"osd":4,"last update":"Sat Feb 10 08:36:17 2024","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.597,"15min":1.2649999999999999},"min":{"1min":0.25600000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":3.8410000000000002,"5min":14.789,"15min":14.789},"last":0.32000000000000001},{"interface":"front","average":{"1min":1.6870000000000001,"5min":1.379,"15min":1.3160000000000001},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.22600000000000001},"max":{"1min":6.3499999999999996,"5min":8.3140000000000001,"15min":10.348000000000001},"last":0.373}]},{"osd":5,"last update":"Sat Feb 10 08:36:54 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":1.667,"15min":1.6100000000000001},"min":{"1min":0.29899999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":3.9319999999999999,"5min":14.834,"15min":29.631},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.81000000000000005,"5min":1.173,"15min":1.4550000000000001},"min":{"1min":0.316,"5min":0.28799999999999998,"15min":0.23699999999999999},"max":{"1min":4.4299999999999997,"5min":8.3369999999999997,"15min":29.419},"last":0.40300000000000002}]},{"osd":7,"last update":"Sat Feb 10 08:36:17 2024","interfaces":[{"interface":"back","average":{"1min":1.365,"5min":1.5760000000000001,"15min":2.1030000000000002},"min":{"1min":0.33400000000000002,"5min":0.30599999999999999,"15min":0.26200000000000001},"max":{"1min":6.4630000000000001,"5min":7.0259999999999998,"15min":194.88900000000001},"last":0.33700000000000002},{"interface":"front","average":{"1min":1.665,"5min":1.6439999999999999,"15min":2.2240000000000002},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":6.3949999999999996,"5min":14.128,"15min":194.74100000000001},"last":0.432}]}]},{"osd":1,"up_from":13,"seq":55834575125,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2209332,"kb_used_data":1315180,"kb_used_omap":0,"kb_used_meta":894144,"kb_avail":91535820,"statfs":{"total":95995035648,"available":93732679680,"internally_reserved":0,"allocated":1346744320,"data_stored":1346342689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":915603456},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:36:55 2024","interfaces":[{"interface":"back","average":{"1min":1.0349999999999999,"5min":1.405,"15min":1.9550000000000001},"min":{"1min":0.187,"5min":0.187,"15min":0.17100000000000001},"max":{"1min":5.891,"5min":8.5820000000000007,"15min":29.763999999999999},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.78000000000000003,"5min":1.679,"15min":2.0459999999999998},"min":{"1min":0.20100000000000001,"5min":0.183,"15min":0.17899999999999999},"max":{"1min":3.6400000000000001,"5min":19.928999999999998,"15min":29.637},"last":1.5289999999999999}]},{"osd":2,"last update":"Sat Feb 10 08:36:24 2024","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.8440000000000001,"15min":2.1709999999999998},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.21199999999999999},"max":{"1min":4.8579999999999997,"5min":12.202,"15min":31.420999999999999},"last":1.5469999999999999},{"interface":"front","average":{"1min":1.512,"5min":1.873,"15min":2.444},"min":{"1min":0.246,"5min":0.23400000000000001,"15min":0.184},"max":{"1min":4.343,"5min":12.314,"15min":31.484999999999999},"last":1.0389999999999999}]},{"osd":3,"last update":"Sat Feb 10 08:36:43 2024","interfaces":[{"interface":"back","average":{"1min":1.6899999999999999,"5min":1.6859999999999999,"15min":2.2869999999999999},"min":{"1min":0.309,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":5.101,"5min":12.369999999999999,"15min":28.082000000000001},"last":1.506},{"interface":"front","average":{"1min":1.96,"5min":1.7709999999999999,"15min":2.0739999999999998},"min":{"1min":0.311,"5min":0.25600000000000001,"15min":0.19600000000000001},"max":{"1min":8.2129999999999992,"5min":9.2699999999999996,"15min":29.722000000000001},"last":0.89900000000000002}]},{"osd":4,"last update":"Sat Feb 10 08:37:15 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":1.4990000000000001,"15min":1.768},"min":{"1min":0.35199999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.488,"5min":23.218,"15min":23.218},"last":1.4990000000000001},{"interface":"front","average":{"1min":1.177,"5min":1.5589999999999999,"15min":2.0329999999999999},"min":{"1min":0.31900000000000001,"5min":0.27100000000000002,"15min":0.25900000000000001},"max":{"1min":5.5599999999999996,"5min":23.274000000000001,"15min":31.515000000000001},"last":1.2549999999999999}]},{"osd":5,"last update":"Sat Feb 10 08:36:24 2024","interfaces":[{"interface":"back","average":{"1min":1.6819999999999999,"5min":1.7,"15min":2.0699999999999998},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":8.2550000000000008,"5min":10.605,"15min":40.140999999999998},"last":1.466},{"interface":"front","average":{"1min":1.486,"5min":1.881,"15min":2.4119999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.28499999999999998},"max":{"1min":5.3470000000000004,"5min":7.593,"15min":40.831000000000003},"last":0.93600000000000005}]},{"osd":6,"last update":"Sat Feb 10 08:36:55 2024","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.8,"15min":2.113},"min":{"1min":0.40000000000000002,"5min":0.34599999999999997,"15min":0.30199999999999999},"max":{"1min":5.056,"5min":26.071999999999999,"15min":31.27},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.80700000000000005,"5min":1.579,"15min":1.7310000000000001},"min":{"1min":0.39300000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":2.5089999999999999,"5min":25.937000000000001,"15min":25.937000000000001},"last":0.83299999999999996}]},{"osd":7,"last update":"Sat Feb 10 08:36:24 2024","interfaces":[{"interface":"back","average":{"1min":4.7770000000000001,"5min":2.8860000000000001,"15min":2.5070000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.29099999999999998},"max":{"1min":64.405000000000001,"5min":64.405000000000001,"15min":64.405000000000001},"last":0.997},{"interface":"front","average":{"1min":5.2030000000000003,"5min":2.6339999999999999,"15min":2.0779999999999998},"min":{"1min":0.40400000000000003,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":64.510999999999996,"5min":64.510999999999996,"15min":64.510999999999996},"last":0.86099999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738650,"num_pgs":62,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1435128,"kb_used_data":845424,"kb_used_omap":0,"kb_used_meta":589696,"kb_avail":92310024,"statfs":{"total":95995035648,"available":94525464576,"internally_reserved":0,"allocated":865714176,"data_stored":865308900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":603848704},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 10 08:37:09 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":1.0840000000000001,"15min":2.3660000000000001},"min":{"1min":0.215,"5min":0.182,"15min":0.14399999999999999},"max":{"1min":2.7229999999999999,"5min":5.5270000000000001,"15min":102.48099999999999},"last":1.379},{"interface":"front","average":{"1min":0.65000000000000002,"5min":1.4490000000000001,"15min":2.3900000000000001},"min":{"1min":0.28299999999999997,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":3.9649999999999999,"5min":15.550000000000001,"15min":103.38800000000001},"last":1.704}]},{"osd":2,"last update":"Sat Feb 10 08:36:22 2024","interfaces":[{"interface":"back","average":{"1min":1.7410000000000001,"5min":2.23,"15min":3.0019999999999998},"min":{"1min":0.252,"5min":0.19700000000000001,"15min":0.192},"max":{"1min":5.9539999999999997,"5min":19.411999999999999,"15min":102.462},"last":1.419},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.53,"15min":2.5659999999999998},"min":{"1min":0.23000000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":6.5199999999999996,"5min":10.369,"15min":102.66500000000001},"last":1.4330000000000001}]},{"osd":3,"last update":"Sat Feb 10 08:36:42 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":1.7370000000000001,"15min":2.1280000000000001},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":4.4169999999999998,"5min":15.585000000000001,"15min":16.495000000000001},"last":2.7309999999999999},{"interface":"front","average":{"1min":1.157,"5min":2.319,"15min":2.7909999999999999},"min":{"1min":0.24299999999999999,"5min":0.216,"15min":0.216},"max":{"1min":4.9459999999999997,"5min":19.504000000000001,"15min":102.64400000000001},"last":3.0230000000000001}]},{"osd":4,"last update":"Sat Feb 10 08:37:14 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":1.6739999999999999,"15min":2.258},"min":{"1min":0.29499999999999998,"5min":0.28199999999999997,"15min":0.253},"max":{"1min":1.6679999999999999,"5min":19.359999999999999,"15min":102.742},"last":1.452},{"interface":"front","average":{"1min":0.63600000000000001,"5min":1.429,"15min":1.587},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26200000000000001},"max":{"1min":1.4259999999999999,"5min":15.343,"15min":16.352},"last":1.7330000000000001}]},{"osd":5,"last update":"Sat Feb 10 08:36:34 2024","interfaces":[{"interface":"back","average":{"1min":2.3540000000000001,"5min":1.9990000000000001,"15min":2.3140000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":28.123999999999999,"5min":28.123999999999999,"15min":102.53100000000001},"last":1.3169999999999999},{"interface":"front","average":{"1min":2.5030000000000001,"5min":1.9359999999999999,"15min":1.9630000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":28.350000000000001,"5min":28.350000000000001,"15min":28.350000000000001},"last":1.7849999999999999}]},{"osd":6,"last update":"Sat Feb 10 08:37:09 2024","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":1.52,"15min":2.1549999999999998},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":1.117,"5min":7.0149999999999997,"15min":102.583},"last":1.25},{"interface":"front","average":{"1min":0.73099999999999998,"5min":1.673,"15min":1.7909999999999999},"min":{"1min":0.35899999999999999,"5min":0.35699999999999998,"15min":0.308},"max":{"1min":2.4159999999999999,"5min":15.359,"15min":16.391999999999999},"last":1.7569999999999999}]},{"osd":7,"last update":"Sat Feb 10 08:36:22 2024","interfaces":[{"interface":"back","average":{"1min":1.4059999999999999,"5min":1.573,"15min":3.073},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":2.9969999999999999,"5min":6.4889999999999999,"15min":255.53200000000001},"last":1.286},{"interface":"front","average":{"1min":1.6479999999999999,"5min":1.948,"15min":2.7170000000000001},"min":{"1min":0.38900000000000001,"5min":0.34599999999999997,"15min":0.33100000000000002},"max":{"1min":4.4980000000000002,"5min":15.375999999999999,"15min":254.88800000000001},"last":1.8069999999999999}]}]},{"osd":2,"up_from":18,"seq":77309411601,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1889512,"kb_used_data":1003296,"kb_used_omap":0,"kb_used_meta":886208,"kb_avail":91855640,"statfs":{"total":95995035648,"available":94060175360,"internally_reserved":0,"allocated":1027375104,"data_stored":1026985593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":907476992},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:36:25 2024","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.6359999999999999,"15min":1.9379999999999999},"min":{"1min":0.19700000000000001,"5min":0.19400000000000001,"15min":0.184},"max":{"1min":4.0250000000000004,"5min":27.934999999999999,"15min":27.934999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":2.5329999999999999,"5min":2.3769999999999998,"15min":2.6600000000000001},"min":{"1min":0.20399999999999999,"5min":0.191,"15min":0.191},"max":{"1min":11.815,"5min":15.15,"15min":28.295999999999999},"last":1.9990000000000001}]},{"osd":1,"last update":"Sat Feb 10 08:36:25 2024","interfaces":[{"interface":"back","average":{"1min":2.4500000000000002,"5min":1.9990000000000001,"15min":2.194},"min":{"1min":0.24399999999999999,"5min":0.20999999999999999,"15min":0.20599999999999999},"max":{"1min":10.385,"5min":10.385,"15min":15.644},"last":5.4589999999999996},{"interface":"front","average":{"1min":1.585,"5min":1.532,"15min":1.615},"min":{"1min":0.24099999999999999,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":7.5490000000000004,"5min":12.132999999999999,"15min":16.968},"last":1.516}]},{"osd":3,"last update":"Sat Feb 10 08:36:52 2024","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.7669999999999999,"15min":2.0910000000000002},"min":{"1min":0.255,"5min":0.245,"15min":0.24199999999999999},"max":{"1min":5.0019999999999998,"5min":9.7870000000000008,"15min":24.946000000000002},"last":1.3109999999999999},{"interface":"front","average":{"1min":0.64900000000000002,"5min":1.1799999999999999,"15min":2.0369999999999999},"min":{"1min":0.28100000000000003,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":2.0779999999999998,"5min":9.1150000000000002,"15min":24.905000000000001},"last":0.53900000000000003}]},{"osd":4,"last update":"Sat Feb 10 08:37:08 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":1.996,"15min":1.9059999999999999},"min":{"1min":0.41999999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":2.4510000000000001,"5min":19.231000000000002,"15min":19.231000000000002},"last":1.5840000000000001},{"interface":"front","average":{"1min":0.748,"5min":1.2849999999999999,"15min":1.3120000000000001},"min":{"1min":0.28499999999999998,"5min":0.26000000000000001,"15min":0.25700000000000001},"max":{"1min":2.0259999999999998,"5min":19.256,"15min":19.256},"last":0.59999999999999998}]},{"osd":5,"last update":"Sat Feb 10 08:36:36 2024","interfaces":[{"interface":"back","average":{"1min":1.474,"5min":2.113,"15min":2.125},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":5.0860000000000003,"5min":13.201000000000001,"15min":13.939},"last":3.347},{"interface":"front","average":{"1min":1.802,"5min":1.988,"15min":2.004},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.28599999999999998},"max":{"1min":4.6420000000000003,"5min":9.5030000000000001,"15min":13.317},"last":0.51600000000000001}]},{"osd":6,"last update":"Sat Feb 10 08:37:08 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":2.1200000000000001,"15min":2.1480000000000001},"min":{"1min":0.39400000000000002,"5min":0.31900000000000001,"15min":0.27300000000000002},"max":{"1min":2.71,"5min":20.815999999999999,"15min":38.177999999999997},"last":2.2050000000000001},{"interface":"front","average":{"1min":0.81100000000000005,"5min":2.238,"15min":2.2679999999999998},"min":{"1min":0.39800000000000002,"5min":0.32500000000000001,"15min":0.32200000000000001},"max":{"1min":2.5379999999999998,"5min":20.268999999999998,"15min":37.682000000000002},"last":0.48799999999999999}]},{"osd":7,"last update":"Sat Feb 10 08:36:25 2024","interfaces":[{"interface":"back","average":{"1min":3.2509999999999999,"5min":2.3140000000000001,"15min":2.1070000000000002},"min":{"1min":0.43099999999999999,"5min":0.377,"15min":0.33400000000000002},"max":{"1min":8.5440000000000005,"5min":9.6869999999999994,"15min":13.231999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":1.8129999999999999,"5min":1.4219999999999999,"15min":1.492},"min":{"1min":0.38200000000000001,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":8.5310000000000006,"5min":8.5310000000000006,"15min":15.714},"last":1.782}]}]},{"osd":3,"up_from":25,"seq":107374182668,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1724536,"kb_used_data":1138928,"kb_used_omap":0,"kb_used_meta":585600,"kb_avail":92020616,"statfs":{"total":95995035648,"available":94229110784,"internally_reserved":0,"allocated":1166262272,"data_stored":1165856128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":599654400},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:36:44 2024","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":2.2850000000000001,"15min":2.1829999999999998},"min":{"1min":0.17699999999999999,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":5.6500000000000004,"5min":66.605000000000004,"15min":66.605000000000004},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.6579999999999999,"5min":2.2679999999999998,"15min":2.1469999999999998},"min":{"1min":0.19800000000000001,"5min":0.192,"15min":0.184},"max":{"1min":10.970000000000001,"5min":66.828000000000003,"15min":66.828000000000003},"last":1.0860000000000001}]},{"osd":1,"last update":"Sat Feb 10 08:36:44 2024","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.6220000000000001,"15min":2.0270000000000001},"min":{"1min":0.25,"5min":0.187,"15min":0.187},"max":{"1min":3.133,"5min":13.371,"15min":13.371},"last":1.397},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.7789999999999999,"15min":2.262},"min":{"1min":0.24099999999999999,"5min":0.22900000000000001,"15min":0.20599999999999999},"max":{"1min":5.3159999999999998,"5min":10.67,"15min":21.373999999999999},"last":1.696}]},{"osd":2,"last update":"Sat Feb 10 08:36:44 2024","interfaces":[{"interface":"back","average":{"1min":2.105,"5min":2.7519999999999998,"15min":2.452},"min":{"1min":0.27800000000000002,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":11.308,"5min":65.998999999999995,"15min":65.998999999999995},"last":3.7349999999999999},{"interface":"front","average":{"1min":1.8120000000000001,"5min":2.5699999999999998,"15min":2.1070000000000002},"min":{"1min":0.27200000000000002,"5min":0.255,"15min":0.215},"max":{"1min":11.012,"5min":68.721000000000004,"15min":68.721000000000004},"last":1.222}]},{"osd":4,"last update":"Sat Feb 10 08:36:19 2024","interfaces":[{"interface":"back","average":{"1min":2.7559999999999998,"5min":1.7549999999999999,"15min":1.677},"min":{"1min":0.32700000000000001,"5min":0.29199999999999998,"15min":0.25900000000000001},"max":{"1min":11.061999999999999,"5min":11.061999999999999,"15min":12.272},"last":0.35399999999999998},{"interface":"front","average":{"1min":2.169,"5min":1.7829999999999999,"15min":1.9610000000000001},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":8.9109999999999996,"5min":10.754,"15min":12.391999999999999},"last":0.36799999999999999}]},{"osd":5,"last update":"Sat Feb 10 08:36:44 2024","interfaces":[{"interface":"back","average":{"1min":1.9930000000000001,"5min":1.9590000000000001,"15min":1.831},"min":{"1min":0.35599999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":11.159000000000001,"5min":19.832000000000001,"15min":19.832000000000001},"last":0.40300000000000002},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.95,"15min":2.0209999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.27800000000000002},"max":{"1min":4.5209999999999999,"5min":19.712,"15min":19.712},"last":0.39800000000000002}]},{"osd":6,"last update":"Sat Feb 10 08:37:00 2024","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":1.669,"15min":1.9379999999999999},"min":{"1min":0.35899999999999999,"5min":0.31,"15min":0.31},"max":{"1min":4.5999999999999996,"5min":8.8610000000000007,"15min":16.423999999999999},"last":0.42199999999999999},{"interface":"front","average":{"1min":1.429,"5min":1.4950000000000001,"15min":1.764},"min":{"1min":0.46899999999999997,"5min":0.375,"15min":0.31},"max":{"1min":11.127000000000001,"5min":11.127000000000001,"15min":11.127000000000001},"last":0.45000000000000001}]},{"osd":7,"last update":"Sat Feb 10 08:36:19 2024","interfaces":[{"interface":"back","average":{"1min":2.718,"5min":1.847,"15min":1.8320000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":11.904,"5min":11.904,"15min":12.358000000000001},"last":0.47499999999999998},{"interface":"front","average":{"1min":2.4740000000000002,"5min":1.97,"15min":2.1179999999999999},"min":{"1min":0.36599999999999999,"5min":0.313,"15min":0.313},"max":{"1min":11.986000000000001,"5min":11.986000000000001,"15min":15.702},"last":1.5580000000000001}]}]},{"osd":4,"up_from":110,"seq":472446402760,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1300332,"kb_used_data":705892,"kb_used_omap":0,"kb_used_meta":594431,"kb_avail":92444820,"statfs":{"total":95995035648,"available":94663495680,"internally_reserved":0,"allocated":722833408,"data_stored":722439220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":972,"internal_metadata":608697396},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:36:30 2024","interfaces":[{"interface":"back","average":{"1min":1.331,"5min":1.47,"15min":1.486},"min":{"1min":0.23100000000000001,"5min":0.20499999999999999,"15min":0.19800000000000001},"max":{"1min":4.9969999999999999,"5min":10.932,"15min":14.595000000000001},"last":1.3440000000000001},{"interface":"front","average":{"1min":2.5529999999999999,"5min":2.1600000000000001,"15min":2.1640000000000001},"min":{"1min":0.40500000000000003,"5min":0.23799999999999999,"15min":0.222},"max":{"1min":11.109,"5min":11.109,"15min":16.524000000000001},"last":1.718}]},{"osd":1,"last update":"Sat Feb 10 08:36:30 2024","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.71,"15min":1.831},"min":{"1min":0.38800000000000001,"5min":0.24099999999999999,"15min":0.218},"max":{"1min":4.6539999999999999,"5min":8.2149999999999999,"15min":38.621000000000002},"last":1.708},{"interface":"front","average":{"1min":1.4470000000000001,"5min":1.587,"15min":1.774},"min":{"1min":0.34300000000000003,"5min":0.29799999999999999,"15min":0.217},"max":{"1min":4.6619999999999999,"5min":11.964,"15min":38.430999999999997},"last":1.6990000000000001}]},{"osd":2,"last update":"Sat Feb 10 08:36:30 2024","interfaces":[{"interface":"back","average":{"1min":1.863,"5min":1.899,"15min":1.9259999999999999},"min":{"1min":0.32200000000000001,"5min":0.217,"15min":0.217},"max":{"1min":6.8620000000000001,"5min":10.608000000000001,"15min":14.414},"last":2.0569999999999999},{"interface":"front","average":{"1min":0.77400000000000002,"5min":1.657,"15min":1.675},"min":{"1min":0.29999999999999999,"5min":0.26100000000000001,"15min":0.247},"max":{"1min":2.9540000000000002,"5min":11.958,"15min":11.958},"last":0.53600000000000003}]},{"osd":3,"last update":"Sat Feb 10 08:36:30 2024","interfaces":[{"interface":"back","average":{"1min":1.871,"5min":1.915,"15min":1.9139999999999999},"min":{"1min":0.33700000000000002,"5min":0.27100000000000002,"15min":0.23200000000000001},"max":{"1min":7.0380000000000003,"5min":7.0380000000000003,"15min":14.358000000000001},"last":0.49099999999999999},{"interface":"front","average":{"1min":1.125,"5min":1.766,"15min":1.716},"min":{"1min":0.38300000000000001,"5min":0.32700000000000001,"15min":0.249},"max":{"1min":2.8969999999999998,"5min":8.3360000000000003,"15min":11.648},"last":1.2509999999999999}]},{"osd":5,"last update":"Sat Feb 10 08:36:30 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":1.486,"15min":1.341},"min":{"1min":0.27400000000000002,"5min":0.247,"15min":0.21299999999999999},"max":{"1min":4.1509999999999998,"5min":9.4550000000000001,"15min":41.488},"last":0.56499999999999995},{"interface":"front","average":{"1min":1.331,"5min":1.581,"15min":1.5640000000000001},"min":{"1min":0.28499999999999998,"5min":0.245,"15min":0.23699999999999999},"max":{"1min":5.4160000000000004,"5min":9.4700000000000006,"15min":42.527999999999999},"last":0.63700000000000001}]},{"osd":6,"last update":"Sat Feb 10 08:36:30 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":1.9079999999999999,"15min":1.5369999999999999},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":2.597,"5min":44.816000000000003,"15min":44.816000000000003},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.66700000000000004,"5min":2.0110000000000001,"15min":1.5840000000000001},"min":{"1min":0.32200000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":3.1379999999999999,"5min":43.816000000000003,"15min":43.816000000000003},"last":0.68200000000000005}]},{"osd":7,"last update":"Sat Feb 10 08:36:30 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":1.5369999999999999,"15min":1.3720000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.28899999999999998},"max":{"1min":5.3789999999999996,"5min":8.6289999999999996,"15min":11.047000000000001},"last":1.585},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.462,"15min":1.3129999999999999},"min":{"1min":0.318,"5min":0.30199999999999999,"15min":0.26300000000000001},"max":{"1min":4.4470000000000001,"5min":10.971,"15min":16.245999999999999},"last":0.60699999999999998}]}]},{"osd":5,"up_from":37,"seq":158913790211,"num_pgs":62,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1550300,"kb_used_data":655188,"kb_used_omap":0,"kb_used_meta":895104,"kb_avail":92194852,"statfs":{"total":95995035648,"available":94407528448,"internally_reserved":0,"allocated":670912512,"data_stored":670534611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":916586496},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:36:31 2024","interfaces":[{"interface":"back","average":{"1min":2.169,"5min":1.5289999999999999,"15min":1.7230000000000001},"min":{"1min":0.25900000000000001,"5min":0.218,"15min":0.20499999999999999},"max":{"1min":7.7110000000000003,"5min":7.7110000000000003,"15min":19.300000000000001},"last":0.21099999999999999},{"interface":"front","average":{"1min":1.554,"5min":1.8939999999999999,"15min":1.7070000000000001},"min":{"1min":0.253,"5min":0.22900000000000001,"15min":0.21299999999999999},"max":{"1min":8.048,"5min":13.738,"15min":17.024000000000001},"last":0.34100000000000003}]},{"osd":1,"last update":"Sat Feb 10 08:36:31 2024","interfaces":[{"interface":"back","average":{"1min":1.6220000000000001,"5min":1.615,"15min":1.647},"min":{"1min":0.27300000000000002,"5min":0.24099999999999999,"15min":0.19500000000000001},"max":{"1min":5.1509999999999998,"5min":8.5210000000000008,"15min":8.5210000000000008},"last":0.45800000000000002},{"interface":"front","average":{"1min":1.645,"5min":1.6919999999999999,"15min":1.581},"min":{"1min":0.40200000000000002,"5min":0.25,"15min":0.25},"max":{"1min":6.1200000000000001,"5min":7.085,"15min":9.0579999999999998},"last":2.113}]},{"osd":2,"last update":"Sat Feb 10 08:36:31 2024","interfaces":[{"interface":"back","average":{"1min":1.462,"5min":1.724,"15min":1.784},"min":{"1min":0.28399999999999997,"5min":0.251,"15min":0.24099999999999999},"max":{"1min":4.9740000000000002,"5min":7.9829999999999997,"15min":20.254999999999999},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.536,"5min":1.4790000000000001,"15min":1.623},"min":{"1min":0.27800000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":5.0389999999999997,"5min":6.3449999999999998,"15min":7.585},"last":1.5940000000000001}]},{"osd":3,"last update":"Sat Feb 10 08:36:31 2024","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.4610000000000001,"15min":1.409},"min":{"1min":0.308,"5min":0.28499999999999998,"15min":0.26100000000000001},"max":{"1min":4.327,"5min":8.0079999999999991,"15min":8.2539999999999996},"last":1.6419999999999999},{"interface":"front","average":{"1min":1.911,"5min":1.591,"15min":1.6519999999999999},"min":{"1min":0.36199999999999999,"5min":0.309,"15min":0.27300000000000002},"max":{"1min":8.7940000000000005,"5min":9.7100000000000009,"15min":12.387},"last":0.439}]},{"osd":4,"last update":"Sat Feb 10 08:37:16 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":1.329,"15min":1.254},"min":{"1min":0.245,"5min":0.223,"15min":0.223},"max":{"1min":3.9910000000000001,"5min":9.7080000000000002,"15min":9.7080000000000002},"last":0.245},{"interface":"front","average":{"1min":0.59299999999999997,"5min":1.0429999999999999,"15min":1.2749999999999999},"min":{"1min":0.29599999999999999,"5min":0.254,"15min":0.22500000000000001},"max":{"1min":2.911,"5min":7.5220000000000002,"15min":12.948},"last":0.39600000000000002}]},{"osd":6,"last update":"Sat Feb 10 08:37:02 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":1.452,"15min":1.28},"min":{"1min":0.30499999999999999,"5min":0.245,"15min":0.23100000000000001},"max":{"1min":2.0129999999999999,"5min":7.2779999999999996,"15min":8.3559999999999999},"last":0.307},{"interface":"front","average":{"1min":0.53800000000000003,"5min":1.2470000000000001,"15min":1.2090000000000001},"min":{"1min":0.312,"5min":0.27800000000000002,"15min":0.26300000000000001},"max":{"1min":1.0369999999999999,"5min":6.8499999999999996,"15min":7.875},"last":0.33000000000000002}]},{"osd":7,"last update":"Sat Feb 10 08:36:29 2024","interfaces":[{"interface":"back","average":{"1min":1.444,"5min":1.6080000000000001,"15min":2.4159999999999999},"min":{"1min":0.31900000000000001,"5min":0.30499999999999999,"15min":0.23499999999999999},"max":{"1min":5.5,"5min":7.952,"15min":371.87400000000002},"last":0.36499999999999999},{"interface":"front","average":{"1min":1.714,"5min":1.329,"15min":2.5800000000000001},"min":{"1min":0.35499999999999998,"5min":0.318,"15min":0.23499999999999999},"max":{"1min":5.0759999999999996,"5min":5.5190000000000001,"15min":372.63099999999997},"last":0.35399999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":877395968,"data_stored":877395968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1382547456,"data_stored":1382547456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1043988480,"data_stored":1043988480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1205010432,"data_stored":1205010432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":740098048,"data_stored":740098048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":684851200,"data_stored":684851200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1373241344,"data_stored":1373241344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1023148032,"data_stored":1023148032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-10T08:37:24.094 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2024-02-10T08:37:24.095 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd pool set device_health_metrics pg_num 11 2024-02-10T08:37:24.338 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:37:24.343 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:24.343 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:37:24.444 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:37:24.490 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:24.515 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 27 16 51214 51198 118.463 77.3125 0.0119723 0.008436 2024-02-10T08:37:24.525 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:37:24.529 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:24.529 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:37:24.620 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:22.593514+0000 osd.2 (osd.2) 239 : cluster [DBG] 2.c scrub starts 2024-02-10T08:37:24.620 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:22.601828+0000 osd.2 (osd.2) 240 : cluster [DBG] 2.c scrub ok 2024-02-10T08:37:24.620 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:37:22.922111+0000 mgr.y (mgr.14505) 774 : audit [DBG] from='client.25576 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-10T08:37:24.620 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:22.978328+0000 osd.6 (osd.6) 261 : cluster [DBG] 2.1a scrub starts 2024-02-10T08:37:24.620 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:22.981112+0000 osd.6 (osd.6) 262 : cluster [DBG] 2.1a scrub ok 2024-02-10T08:37:24.620 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:23.084723+0000 mgr.y (mgr.14505) 775 : cluster [DBG] pgmap v946: 168 pgs: 168 active+clean; 2.9 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 1.2 KiB/s rd, 103 MiB/s wr, 1.65k op/s 2024-02-10T08:37:24.620 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:23.870380+0000 osd.4 (osd.4) 192 : cluster [DBG] 6.2a scrub starts 2024-02-10T08:37:24.620 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:23.909196+0000 osd.4 (osd.4) 193 : cluster [DBG] 6.2a scrub ok 2024-02-10T08:37:24.621 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:22.593514+0000 osd.2 (osd.2) 239 : cluster [DBG] 2.c scrub starts 2024-02-10T08:37:24.621 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:22.601828+0000 osd.2 (osd.2) 240 : cluster [DBG] 2.c scrub ok 2024-02-10T08:37:24.621 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:37:22.922111+0000 mgr.y (mgr.14505) 774 : audit [DBG] from='client.25576 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-10T08:37:24.621 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:22.978328+0000 osd.6 (osd.6) 261 : cluster [DBG] 2.1a scrub starts 2024-02-10T08:37:24.621 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:22.981112+0000 osd.6 (osd.6) 262 : cluster [DBG] 2.1a scrub ok 2024-02-10T08:37:24.621 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:23.084723+0000 mgr.y (mgr.14505) 775 : cluster [DBG] pgmap v946: 168 pgs: 168 active+clean; 2.9 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 1.2 KiB/s rd, 103 MiB/s wr, 1.65k op/s 2024-02-10T08:37:24.621 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:23.870380+0000 osd.4 (osd.4) 192 : cluster [DBG] 6.2a scrub starts 2024-02-10T08:37:24.621 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:23.909196+0000 osd.4 (osd.4) 193 : cluster [DBG] 6.2a scrub ok 2024-02-10T08:37:24.630 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:37:24.695 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:24.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:22.593514+0000 osd.2 (osd.2) 239 : cluster [DBG] 2.c scrub starts 2024-02-10T08:37:24.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:22.601828+0000 osd.2 (osd.2) 240 : cluster [DBG] 2.c scrub ok 2024-02-10T08:37:24.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:37:22.922111+0000 mgr.y (mgr.14505) 774 : audit [DBG] from='client.25576 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-10T08:37:24.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:22.978328+0000 osd.6 (osd.6) 261 : cluster [DBG] 2.1a scrub starts 2024-02-10T08:37:24.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:22.981112+0000 osd.6 (osd.6) 262 : cluster [DBG] 2.1a scrub ok 2024-02-10T08:37:24.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:23.084723+0000 mgr.y (mgr.14505) 775 : cluster [DBG] pgmap v946: 168 pgs: 168 active+clean; 2.9 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 1.2 KiB/s rd, 103 MiB/s wr, 1.65k op/s 2024-02-10T08:37:24.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:23.870380+0000 osd.4 (osd.4) 192 : cluster [DBG] 6.2a scrub starts 2024-02-10T08:37:24.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:23.909196+0000 osd.4 (osd.4) 193 : cluster [DBG] 6.2a scrub ok 2024-02-10T08:37:25.515 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 28 16 52570 52554 117.259 84.75 0.0133634 0.00852262 2024-02-10T08:37:25.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:23.625027+0000 osd.2 (osd.2) 241 : cluster [DBG] 5.a scrub starts 2024-02-10T08:37:25.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:23.627956+0000 osd.2 (osd.2) 242 : cluster [DBG] 5.a scrub ok 2024-02-10T08:37:25.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:24.098861+0000 osd.5 (osd.5) 261 : cluster [DBG] 4.8 scrub starts 2024-02-10T08:37:25.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:24.105123+0000 osd.5 (osd.5) 262 : cluster [DBG] 4.8 scrub ok 2024-02-10T08:37:25.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:24.129642+0000 osd.0 (osd.0) 254 : cluster [DBG] 6.f scrub starts 2024-02-10T08:37:25.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:24.302025+0000 osd.0 (osd.0) 255 : cluster [DBG] 6.f scrub ok 2024-02-10T08:37:25.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:24.648039+0000 osd.7 (osd.7) 273 : cluster [DBG] 6.1c scrub starts 2024-02-10T08:37:25.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:24.649518+0000 osd.7 (osd.7) 274 : cluster [DBG] 6.1c scrub ok 2024-02-10T08:37:25.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:24.868091+0000 osd.4 (osd.4) 194 : cluster [DBG] 4.c scrub starts 2024-02-10T08:37:25.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:24.873368+0000 osd.4 (osd.4) 195 : cluster [DBG] 4.c scrub ok 2024-02-10T08:37:25.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:23.625027+0000 osd.2 (osd.2) 241 : cluster [DBG] 5.a scrub starts 2024-02-10T08:37:25.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:23.627956+0000 osd.2 (osd.2) 242 : cluster [DBG] 5.a scrub ok 2024-02-10T08:37:25.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:24.098861+0000 osd.5 (osd.5) 261 : cluster [DBG] 4.8 scrub starts 2024-02-10T08:37:25.657 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:24.105123+0000 osd.5 (osd.5) 262 : cluster [DBG] 4.8 scrub ok 2024-02-10T08:37:25.657 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:24.129642+0000 osd.0 (osd.0) 254 : cluster [DBG] 6.f scrub starts 2024-02-10T08:37:25.657 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:24.302025+0000 osd.0 (osd.0) 255 : cluster [DBG] 6.f scrub ok 2024-02-10T08:37:25.657 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:24.648039+0000 osd.7 (osd.7) 273 : cluster [DBG] 6.1c scrub starts 2024-02-10T08:37:25.657 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:24.649518+0000 osd.7 (osd.7) 274 : cluster [DBG] 6.1c scrub ok 2024-02-10T08:37:25.657 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:24.868091+0000 osd.4 (osd.4) 194 : cluster [DBG] 4.c scrub starts 2024-02-10T08:37:25.657 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:24.873368+0000 osd.4 (osd.4) 195 : cluster [DBG] 4.c scrub ok 2024-02-10T08:37:25.706 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:37:25.707 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:37:25.759 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:37:25.768 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:25.769 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:37:25.787 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:37:25.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:23.625027+0000 osd.2 (osd.2) 241 : cluster [DBG] 5.a scrub starts 2024-02-10T08:37:25.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:23.627956+0000 osd.2 (osd.2) 242 : cluster [DBG] 5.a scrub ok 2024-02-10T08:37:25.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:24.098861+0000 osd.5 (osd.5) 261 : cluster [DBG] 4.8 scrub starts 2024-02-10T08:37:25.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:24.105123+0000 osd.5 (osd.5) 262 : cluster [DBG] 4.8 scrub ok 2024-02-10T08:37:25.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:24.129642+0000 osd.0 (osd.0) 254 : cluster [DBG] 6.f scrub starts 2024-02-10T08:37:25.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:24.302025+0000 osd.0 (osd.0) 255 : cluster [DBG] 6.f scrub ok 2024-02-10T08:37:25.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:24.648039+0000 osd.7 (osd.7) 273 : cluster [DBG] 6.1c scrub starts 2024-02-10T08:37:25.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:24.649518+0000 osd.7 (osd.7) 274 : cluster [DBG] 6.1c scrub ok 2024-02-10T08:37:25.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:24.868091+0000 osd.4 (osd.4) 194 : cluster [DBG] 4.c scrub starts 2024-02-10T08:37:25.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:24.873368+0000 osd.4 (osd.4) 195 : cluster [DBG] 4.c scrub ok 2024-02-10T08:37:25.869 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:37:25.928 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:26.397 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:37:26.402 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:26.402 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:37:26.503 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:37:26.515 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 29 16 53824 53808 115.919 78.375 0.00332369 0.00861963 2024-02-10T08:37:26.571 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:26.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:25.085014+0000 osd.0 (osd.0) 256 : cluster [DBG] 6.13 scrub starts 2024-02-10T08:37:26.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:25.085308+0000 mgr.y (mgr.14505) 776 : cluster [DBG] pgmap v947: 168 pgs: 168 active+clean; 3.0 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 1.0 KiB/s rd, 92 MiB/s wr, 1.48k op/s 2024-02-10T08:37:26.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:25.149836+0000 osd.0 (osd.0) 257 : cluster [DBG] 6.13 scrub ok 2024-02-10T08:37:26.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:25.618500+0000 osd.7 (osd.7) 275 : cluster [DBG] 6.15 scrub starts 2024-02-10T08:37:26.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:25.643551+0000 osd.7 (osd.7) 276 : cluster [DBG] 6.15 scrub ok 2024-02-10T08:37:26.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:25.855363+0000 osd.4 (osd.4) 196 : cluster [DBG] 6.6 scrub starts 2024-02-10T08:37:26.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:25.897597+0000 osd.4 (osd.4) 197 : cluster [DBG] 6.6 scrub ok 2024-02-10T08:37:26.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:26.109402+0000 osd.1 (osd.1) 284 : cluster [DBG] 4.10 scrub starts 2024-02-10T08:37:26.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:26.115689+0000 osd.1 (osd.1) 285 : cluster [DBG] 4.10 scrub ok 2024-02-10T08:37:26.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:25.085014+0000 osd.0 (osd.0) 256 : cluster [DBG] 6.13 scrub starts 2024-02-10T08:37:26.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:25.085308+0000 mgr.y (mgr.14505) 776 : cluster [DBG] pgmap v947: 168 pgs: 168 active+clean; 3.0 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 1.0 KiB/s rd, 92 MiB/s wr, 1.48k op/s 2024-02-10T08:37:26.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:25.149836+0000 osd.0 (osd.0) 257 : cluster [DBG] 6.13 scrub ok 2024-02-10T08:37:26.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:25.618500+0000 osd.7 (osd.7) 275 : cluster [DBG] 6.15 scrub starts 2024-02-10T08:37:26.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:25.643551+0000 osd.7 (osd.7) 276 : cluster [DBG] 6.15 scrub ok 2024-02-10T08:37:26.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:25.855363+0000 osd.4 (osd.4) 196 : cluster [DBG] 6.6 scrub starts 2024-02-10T08:37:26.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:25.897597+0000 osd.4 (osd.4) 197 : cluster [DBG] 6.6 scrub ok 2024-02-10T08:37:26.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:26.109402+0000 osd.1 (osd.1) 284 : cluster [DBG] 4.10 scrub starts 2024-02-10T08:37:26.657 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:26.115689+0000 osd.1 (osd.1) 285 : cluster [DBG] 4.10 scrub ok 2024-02-10T08:37:26.730 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:37:26.733 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:26.734 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:37:26.789 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:37:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:37:26] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:37:26.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:25.085014+0000 osd.0 (osd.0) 256 : cluster [DBG] 6.13 scrub starts 2024-02-10T08:37:26.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:25.085308+0000 mgr.y (mgr.14505) 776 : cluster [DBG] pgmap v947: 168 pgs: 168 active+clean; 3.0 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 1.0 KiB/s rd, 92 MiB/s wr, 1.48k op/s 2024-02-10T08:37:26.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:25.149836+0000 osd.0 (osd.0) 257 : cluster [DBG] 6.13 scrub ok 2024-02-10T08:37:26.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:25.618500+0000 osd.7 (osd.7) 275 : cluster [DBG] 6.15 scrub starts 2024-02-10T08:37:26.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:25.643551+0000 osd.7 (osd.7) 276 : cluster [DBG] 6.15 scrub ok 2024-02-10T08:37:26.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:25.855363+0000 osd.4 (osd.4) 196 : cluster [DBG] 6.6 scrub starts 2024-02-10T08:37:26.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:25.897597+0000 osd.4 (osd.4) 197 : cluster [DBG] 6.6 scrub ok 2024-02-10T08:37:26.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:26.109402+0000 osd.1 (osd.1) 284 : cluster [DBG] 4.10 scrub starts 2024-02-10T08:37:26.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:26.115689+0000 osd.1 (osd.1) 285 : cluster [DBG] 4.10 scrub ok 2024-02-10T08:37:26.834 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:37:26.871 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:26.904 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:37:26.909 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:26.910 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:37:27.010 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:37:27.055 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:27.079 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:37:27.084 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:27.084 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:37:27.155 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:37:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:37:27] "GET /metrics HTTP/1.1" 200 176617 "" "Prometheus/2.33.4" 2024-02-10T08:37:27.185 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:37:27.236 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:27.272 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:37:27.275 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:27.275 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:37:27.376 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:37:27.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:26.669172+0000 osd.7 (osd.7) 277 : cluster [DBG] 5.1a scrub starts 2024-02-10T08:37:27.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:26.672115+0000 osd.7 (osd.7) 278 : cluster [DBG] 5.1a scrub ok 2024-02-10T08:37:27.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:26.892662+0000 osd.4 (osd.4) 198 : cluster [DBG] 4.1b scrub starts 2024-02-10T08:37:27.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:26.907727+0000 osd.4 (osd.4) 199 : cluster [DBG] 4.1b scrub ok 2024-02-10T08:37:27.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:26.669172+0000 osd.7 (osd.7) 277 : cluster [DBG] 5.1a scrub starts 2024-02-10T08:37:27.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:26.672115+0000 osd.7 (osd.7) 278 : cluster [DBG] 5.1a scrub ok 2024-02-10T08:37:27.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:26.892662+0000 osd.4 (osd.4) 198 : cluster [DBG] 4.1b scrub starts 2024-02-10T08:37:27.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:26.907727+0000 osd.4 (osd.4) 199 : cluster [DBG] 4.1b scrub ok 2024-02-10T08:37:27.421 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:27.458 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:37:27.464 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:27.465 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:37:27.517 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 30 16 55152 55136 114.817 83 0.00863113 0.00870477 2024-02-10T08:37:27.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:26.669172+0000 osd.7 (osd.7) 277 : cluster [DBG] 5.1a scrub starts 2024-02-10T08:37:27.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:26.672115+0000 osd.7 (osd.7) 278 : cluster [DBG] 5.1a scrub ok 2024-02-10T08:37:27.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:26.892662+0000 osd.4 (osd.4) 198 : cluster [DBG] 4.1b scrub starts 2024-02-10T08:37:27.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:26.907727+0000 osd.4 (osd.4) 199 : cluster [DBG] 4.1b scrub ok 2024-02-10T08:37:27.566 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:37:27.595 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:27.628 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:37:27.631 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:27.632 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:37:27.733 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:37:27.778 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:27.809 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:37:27.813 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:27.814 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:37:27.915 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:37:27.983 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:28.018 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:37:28.025 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:28.026 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:37:28.127 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:37:28.164 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:28.186 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:37:28.191 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:28.191 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:37:28.292 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:37:28.339 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:28.439 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:37:28.445 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:28.446 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:37:28.517 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 31 16 56407 56391 113.642 78.4375 0.00868284 0.00879452 2024-02-10T08:37:28.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:27.085745+0000 mgr.y (mgr.14505) 777 : cluster [DBG] pgmap v948: 168 pgs: 168 active+clean; 3.0 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 1023 B/s rd, 90 MiB/s wr, 1.44k op/s 2024-02-10T08:37:28.547 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:37:28.596 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:28.622 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:37:28.626 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:28.627 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:37:28.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:27.085745+0000 mgr.y (mgr.14505) 777 : cluster [DBG] pgmap v948: 168 pgs: 168 active+clean; 3.0 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 1023 B/s rd, 90 MiB/s wr, 1.44k op/s 2024-02-10T08:37:28.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:27.085745+0000 mgr.y (mgr.14505) 777 : cluster [DBG] pgmap v948: 168 pgs: 168 active+clean; 3.0 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 1023 B/s rd, 90 MiB/s wr, 1.44k op/s 2024-02-10T08:37:28.728 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:37:28.781 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:28.993 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:37:28.999 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:28.999 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:37:29.039 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:37:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:37:29.100 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:37:29.149 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:29.287 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:37:29.295 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:29.296 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:37:29.397 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:37:29.435 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:29.471 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:37:29.474 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:29.475 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:37:29.478 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is set 2024-02-10T08:37:29.517 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 32 16 57608 57592 112.436 75.0625 0.0144543 0.00888937 2024-02-10T08:37:29.575 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:37:29.613 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:29.643 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:37:29.647 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:29.648 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:37:29.748 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:37:29.763 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:27.573923+0000 osd.2 (osd.2) 243 : cluster [DBG] 6.28 scrub starts 2024-02-10T08:37:29.763 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:27.575692+0000 osd.2 (osd.2) 244 : cluster [DBG] 6.28 scrub ok 2024-02-10T08:37:29.763 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:28.092690+0000 osd.0 (osd.0) 258 : cluster [DBG] 6.7 scrub starts 2024-02-10T08:37:29.763 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:28.172912+0000 osd.0 (osd.0) 259 : cluster [DBG] 6.7 scrub ok 2024-02-10T08:37:29.763 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:28.565134+0000 osd.2 (osd.2) 245 : cluster [DBG] 4.1c scrub starts 2024-02-10T08:37:29.763 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:28.570182+0000 osd.2 (osd.2) 246 : cluster [DBG] 4.1c scrub ok 2024-02-10T08:37:29.763 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:37:28.855152+0000 mon.c (mon.2) 93 : audit [INF] from='client.? 172.21.15.18:0/2183380824' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:37:29.763 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:37:28.856487+0000 mon.a (mon.0) 1688 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:37:29.764 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:27.573923+0000 osd.2 (osd.2) 243 : cluster [DBG] 6.28 scrub starts 2024-02-10T08:37:29.764 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:27.575692+0000 osd.2 (osd.2) 244 : cluster [DBG] 6.28 scrub ok 2024-02-10T08:37:29.764 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:28.092690+0000 osd.0 (osd.0) 258 : cluster [DBG] 6.7 scrub starts 2024-02-10T08:37:29.764 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:28.172912+0000 osd.0 (osd.0) 259 : cluster [DBG] 6.7 scrub ok 2024-02-10T08:37:29.764 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:28.565134+0000 osd.2 (osd.2) 245 : cluster [DBG] 4.1c scrub starts 2024-02-10T08:37:29.764 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:28.570182+0000 osd.2 (osd.2) 246 : cluster [DBG] 4.1c scrub ok 2024-02-10T08:37:29.765 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:37:28.855152+0000 mon.c (mon.2) 93 : audit [INF] from='client.? 172.21.15.18:0/2183380824' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:37:29.765 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:37:28.856487+0000 mon.a (mon.0) 1688 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:37:29.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:27.573923+0000 osd.2 (osd.2) 243 : cluster [DBG] 6.28 scrub starts 2024-02-10T08:37:29.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:27.575692+0000 osd.2 (osd.2) 244 : cluster [DBG] 6.28 scrub ok 2024-02-10T08:37:29.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:28.092690+0000 osd.0 (osd.0) 258 : cluster [DBG] 6.7 scrub starts 2024-02-10T08:37:29.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:28.172912+0000 osd.0 (osd.0) 259 : cluster [DBG] 6.7 scrub ok 2024-02-10T08:37:29.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:28.565134+0000 osd.2 (osd.2) 245 : cluster [DBG] 4.1c scrub starts 2024-02-10T08:37:29.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:28.570182+0000 osd.2 (osd.2) 246 : cluster [DBG] 4.1c scrub ok 2024-02-10T08:37:29.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:37:28.855152+0000 mon.c (mon.2) 93 : audit [INF] from='client.? 172.21.15.18:0/2183380824' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:37:29.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:37:28.856487+0000 mon.a (mon.0) 1688 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:37:29.808 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:30.302 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:37:30.336 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:37:30.373 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:37:30.406 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:37:30.440 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:37:30.475 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:37:30.513 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:37:30.517 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 33 16 58868 58852 111.416 78.75 0.0145853 0.00897031 2024-02-10T08:37:30.544 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:37:30.555 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-10T08:37:30.555 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-10T08:37:30.555 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-10T08:37:30.555 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-10T08:37:30.556 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-10T08:37:30.556 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-10T08:37:30.556 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-10T08:37:30.556 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-10T08:37:30.701 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:37:28.813541+0000 mgr.y (mgr.14505) 778 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:37:30.701 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:29.086620+0000 mgr.y (mgr.14505) 779 : cluster [DBG] pgmap v949: 168 pgs: 168 active+clean; 3.4 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1023 B/s rd, 85 MiB/s wr, 1.36k op/s 2024-02-10T08:37:30.701 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:29.402663+0000 mon.a (mon.0) 1689 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:37:30.701 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:37:29.441710+0000 mon.a (mon.0) 1690 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-10T08:37:30.701 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:29.441785+0000 mon.a (mon.0) 1691 : cluster [DBG] osdmap e405: 8 total, 8 up, 8 in 2024-02-10T08:37:30.701 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:37:30.259274+0000 mon.b (mon.1) 89 : audit [DBG] from='client.? 172.21.15.18:0/4180660728' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:37:30.702 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:37:28.813541+0000 mgr.y (mgr.14505) 778 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:37:30.702 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:29.086620+0000 mgr.y (mgr.14505) 779 : cluster [DBG] pgmap v949: 168 pgs: 168 active+clean; 3.4 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1023 B/s rd, 85 MiB/s wr, 1.36k op/s 2024-02-10T08:37:30.702 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:29.402663+0000 mon.a (mon.0) 1689 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:37:30.702 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:37:29.441710+0000 mon.a (mon.0) 1690 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-10T08:37:30.702 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:29.441785+0000 mon.a (mon.0) 1691 : cluster [DBG] osdmap e405: 8 total, 8 up, 8 in 2024-02-10T08:37:30.702 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:37:30.259274+0000 mon.b (mon.1) 89 : audit [DBG] from='client.? 172.21.15.18:0/4180660728' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:37:30.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:37:28.813541+0000 mgr.y (mgr.14505) 778 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:37:30.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:29.086620+0000 mgr.y (mgr.14505) 779 : cluster [DBG] pgmap v949: 168 pgs: 168 active+clean; 3.4 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1023 B/s rd, 85 MiB/s wr, 1.36k op/s 2024-02-10T08:37:30.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:29.402663+0000 mon.a (mon.0) 1689 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:37:30.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:37:29.441710+0000 mon.a (mon.0) 1690 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-10T08:37:30.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:29.441785+0000 mon.a (mon.0) 1691 : cluster [DBG] osdmap e405: 8 total, 8 up, 8 in 2024-02-10T08:37:30.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:37:30.259274+0000 mon.b (mon.1) 89 : audit [DBG] from='client.? 172.21.15.18:0/4180660728' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:37:31.517 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 34 16 60148 60132 110.492 80 0.00740988 0.00904507 2024-02-10T08:37:32.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:31.087433+0000 mgr.y (mgr.14505) 780 : cluster [DBG] pgmap v951: 168 pgs: 168 active+clean; 3.4 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1.1 KiB/s rd, 97 MiB/s wr, 1.55k op/s 2024-02-10T08:37:32.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:37:31.690915+0000 mon.a (mon.0) 1692 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:37:32.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:31.087433+0000 mgr.y (mgr.14505) 780 : cluster [DBG] pgmap v951: 168 pgs: 168 active+clean; 3.4 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1.1 KiB/s rd, 97 MiB/s wr, 1.55k op/s 2024-02-10T08:37:32.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:37:31.690915+0000 mon.a (mon.0) 1692 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:37:32.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:31.087433+0000 mgr.y (mgr.14505) 780 : cluster [DBG] pgmap v951: 168 pgs: 168 active+clean; 3.4 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1.1 KiB/s rd, 97 MiB/s wr, 1.55k op/s 2024-02-10T08:37:32.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:37:31.690915+0000 mon.a (mon.0) 1692 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:37:32.518 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 35 15 61491 61476 109.734 84 0.00790866 0.00910819 2024-02-10T08:37:33.472 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-10T08:37:33.519 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 36 16 62803 62787 108.958 81.9375 0.00698931 0.0091726 2024-02-10T08:37:34.519 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 37 16 63995 63979 108.027 74.5 0.0101257 0.00925203 2024-02-10T08:37:34.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:33.090502+0000 mgr.y (mgr.14505) 781 : cluster [DBG] pgmap v952: 168 pgs: 168 active+clean; 3.7 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1023 B/s rd, 81 MiB/s wr, 1.29k op/s 2024-02-10T08:37:34.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:33.407417+0000 osd.2 (osd.2) 247 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:37:34.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:33.407469+0000 osd.2 (osd.2) 248 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:37:34.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:33.090502+0000 mgr.y (mgr.14505) 781 : cluster [DBG] pgmap v952: 168 pgs: 168 active+clean; 3.7 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1023 B/s rd, 81 MiB/s wr, 1.29k op/s 2024-02-10T08:37:34.657 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:33.407417+0000 osd.2 (osd.2) 247 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:37:34.657 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:33.407469+0000 osd.2 (osd.2) 248 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:37:34.657 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:33.090502+0000 mgr.y (mgr.14505) 781 : cluster [DBG] pgmap v952: 168 pgs: 168 active+clean; 3.7 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1023 B/s rd, 81 MiB/s wr, 1.29k op/s 2024-02-10T08:37:34.657 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:33.407417+0000 osd.2 (osd.2) 247 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:37:34.657 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:33.407469+0000 osd.2 (osd.2) 248 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:37:35.521 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 38 16 65267 65251 107.27 79.5 0.0170562 0.00931724 2024-02-10T08:37:35.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:34.168025+0000 mon.a (mon.0) 1693 : cluster [DBG] osdmap e406: 8 total, 8 up, 8 in 2024-02-10T08:37:35.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:34.168025+0000 mon.a (mon.0) 1693 : cluster [DBG] osdmap e406: 8 total, 8 up, 8 in 2024-02-10T08:37:35.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:34.168025+0000 mon.a (mon.0) 1693 : cluster [DBG] osdmap e406: 8 total, 8 up, 8 in 2024-02-10T08:37:36.458 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:34.530131+0000 osd.4 (osd.4) 200 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:37:36.458 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:34.530205+0000 osd.4 (osd.4) 201 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:37:36.458 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:35.090950+0000 mgr.y (mgr.14505) 782 : cluster [DBG] pgmap v954: 168 pgs: 168 active+clean; 3.8 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1.2 KiB/s rd, 100 MiB/s wr, 1.60k op/s 2024-02-10T08:37:36.458 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:35.174236+0000 mon.a (mon.0) 1694 : cluster [DBG] osdmap e407: 8 total, 8 up, 8 in 2024-02-10T08:37:36.459 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:34.530131+0000 osd.4 (osd.4) 200 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:37:36.460 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:34.530205+0000 osd.4 (osd.4) 201 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:37:36.460 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:35.090950+0000 mgr.y (mgr.14505) 782 : cluster [DBG] pgmap v954: 168 pgs: 168 active+clean; 3.8 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1.2 KiB/s rd, 100 MiB/s wr, 1.60k op/s 2024-02-10T08:37:36.460 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:35.174236+0000 mon.a (mon.0) 1694 : cluster [DBG] osdmap e407: 8 total, 8 up, 8 in 2024-02-10T08:37:36.521 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:34.530131+0000 osd.4 (osd.4) 200 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:37:36.521 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:34.530205+0000 osd.4 (osd.4) 201 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:37:36.521 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:35.090950+0000 mgr.y (mgr.14505) 782 : cluster [DBG] pgmap v954: 168 pgs: 168 active+clean; 3.8 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1.2 KiB/s rd, 100 MiB/s wr, 1.60k op/s 2024-02-10T08:37:36.521 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:35.174236+0000 mon.a (mon.0) 1694 : cluster [DBG] osdmap e407: 8 total, 8 up, 8 in 2024-02-10T08:37:36.521 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 39 16 66518 66502 106.524 78.1875 0.00728467 0.00938283 2024-02-10T08:37:36.792 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:37:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:37:36] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:37:37.523 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:2024-02-10T08:37:37.522191+0000 min lat: 0.00122517 max lat: 0.0884812 avg lat: 0.00945252 2024-02-10T08:37:37.523 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-02-10T08:37:37.523 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 40 16 67717 67701 105.735 74.9375 0.0174876 0.00945252 2024-02-10T08:37:37.656 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:37:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:37:37] "GET /metrics HTTP/1.1" 200 176658 "" "Prometheus/2.33.4" 2024-02-10T08:37:38.429 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:37:38.435 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:38.436 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:37:38.459 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:37.093696+0000 mgr.y (mgr.14505) 783 : cluster [DBG] pgmap v956: 168 pgs: 168 active+clean; 3.8 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 669 B/s rd, 55 MiB/s wr, 881 op/s 2024-02-10T08:37:38.459 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:37.093696+0000 mgr.y (mgr.14505) 783 : cluster [DBG] pgmap v956: 168 pgs: 168 active+clean; 3.8 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 669 B/s rd, 55 MiB/s wr, 881 op/s 2024-02-10T08:37:38.522 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 41 16 68863 68847 104.903 71.625 0.0143363 0.009528 2024-02-10T08:37:38.537 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:37:38.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:37.093696+0000 mgr.y (mgr.14505) 783 : cluster [DBG] pgmap v956: 168 pgs: 168 active+clean; 3.8 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 669 B/s rd, 55 MiB/s wr, 881 op/s 2024-02-10T08:37:38.571 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:38.599 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:37:38.603 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:38.603 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:37:38.704 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:37:38.785 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:38.825 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:37:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:37:39.523 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 42 16 69973 69957 104.056 69.375 0.0122512 0.00960559 2024-02-10T08:37:40.259 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-02-10T08:37:40.259 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-02-10T08:37:40.259 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-02-10T08:37:40.259 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-02-10T08:37:40.259 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.259 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(osd.6.0:157873 10.f e374/335 10:f648bbee:::benchmark_data_smithi018_146618_object75325:head v 374'12255, mlcod=374'12249)", 2024-02-10T08:37:40.259 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:34:49.980209+0000", 2024-02-10T08:37:40.260 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 169.10091730600001, 2024-02-10T08:37:40.260 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.077802790999999996, 2024-02-10T08:37:40.260 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:37:40.260 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:37:40.260 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:37:40.260 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.260 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:37:40.260 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.980209+0000", 2024-02-10T08:37:40.260 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:37:40.260 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.260 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.260 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:37:40.261 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.980209+0000", 2024-02-10T08:37:40.261 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:37:40.261 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.261 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.261 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:37:40.261 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.980208+0000", 2024-02-10T08:37:40.261 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9840000000000007e-06 2024-02-10T08:37:40.261 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.261 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.261 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:37:40.261 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.980217+0000", 2024-02-10T08:37:40.261 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2398000000000001e-05 2024-02-10T08:37:40.261 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.261 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.261 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:37:40.262 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.980229+0000", 2024-02-10T08:37:40.262 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7510000000000002e-06 2024-02-10T08:37:40.262 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.262 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.262 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:37:40.262 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.980236+0000", 2024-02-10T08:37:40.262 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0078384059999999992 2024-02-10T08:37:40.262 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.262 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.262 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:37:40.262 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.988074+0000", 2024-02-10T08:37:40.262 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8607999999999999e-05 2024-02-10T08:37:40.262 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.262 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.262 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:37:40.263 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.988093+0000", 2024-02-10T08:37:40.263 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.069887828999999999 2024-02-10T08:37:40.263 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.263 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.263 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:37:40.263 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:50.057981+0000", 2024-02-10T08:37:40.263 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0749e-05 2024-02-10T08:37:40.263 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.263 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.263 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:37:40.263 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:50.058011+0000", 2024-02-10T08:37:40.263 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.077802790999999996 2024-02-10T08:37:40.263 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:37:40.263 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:37:40.263 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:37:40.264 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.264 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.264 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(osd.6.0:157874 10.f e374/335 10:f6494ad0:::benchmark_data_smithi018_146618_object60698:head v 374'12256, mlcod=374'12249)", 2024-02-10T08:37:40.264 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:34:49.983992+0000", 2024-02-10T08:37:40.264 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 169.097134213, 2024-02-10T08:37:40.264 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.074046534999999997, 2024-02-10T08:37:40.264 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:37:40.264 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:37:40.264 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:37:40.264 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.264 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:37:40.264 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.983992+0000", 2024-02-10T08:37:40.264 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:37:40.264 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.265 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.265 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:37:40.265 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.983992+0000", 2024-02-10T08:37:40.265 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:37:40.265 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.265 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.265 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:37:40.265 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.983991+0000", 2024-02-10T08:37:40.265 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1379999999999996e-06 2024-02-10T08:37:40.265 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.265 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.265 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:37:40.265 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.984000+0000", 2024-02-10T08:37:40.265 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9789999999999999e-06 2024-02-10T08:37:40.265 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.265 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.266 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:37:40.266 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.984009+0000", 2024-02-10T08:37:40.266 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8459999999999996e-06 2024-02-10T08:37:40.266 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.266 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.266 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:37:40.266 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.984015+0000", 2024-02-10T08:37:40.266 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0065910550000000002 2024-02-10T08:37:40.266 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.266 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.266 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:37:40.266 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.990606+0000", 2024-02-10T08:37:40.266 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9528999999999999e-05 2024-02-10T08:37:40.266 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.266 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.266 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:37:40.267 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.990625+0000", 2024-02-10T08:37:40.267 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.067391164000000003 2024-02-10T08:37:40.267 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.267 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.267 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:37:40.267 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:50.058017+0000", 2024-02-10T08:37:40.267 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1784999999999999e-05 2024-02-10T08:37:40.267 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.267 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.267 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:37:40.267 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:50.058038+0000", 2024-02-10T08:37:40.267 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.074046534999999997 2024-02-10T08:37:40.267 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:37:40.267 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:37:40.267 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:37:40.267 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.268 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.268 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(osd.6.0:157876 10.f e374/335 10:f6496769:::benchmark_data_smithi018_146618_object80757:head v 374'12257, mlcod=374'12249)", 2024-02-10T08:37:40.268 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:34:49.984021+0000", 2024-02-10T08:37:40.268 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 169.09710481299999, 2024-02-10T08:37:40.268 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.074034845000000002, 2024-02-10T08:37:40.268 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:37:40.268 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:37:40.268 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:37:40.268 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.268 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:37:40.268 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.984021+0000", 2024-02-10T08:37:40.268 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:37:40.268 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.269 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.269 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:37:40.269 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.984021+0000", 2024-02-10T08:37:40.269 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:37:40.269 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.269 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.269 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:37:40.269 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.984021+0000", 2024-02-10T08:37:40.269 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7850000000000002e-06 2024-02-10T08:37:40.269 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.269 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.269 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:37:40.269 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.984025+0000", 2024-02-10T08:37:40.269 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2300000000000002e-06 2024-02-10T08:37:40.269 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.270 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.270 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:37:40.270 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.984029+0000", 2024-02-10T08:37:40.270 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6819999999999992e-06 2024-02-10T08:37:40.270 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.270 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.270 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:37:40.270 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.984038+0000", 2024-02-10T08:37:40.270 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0086964590000000001 2024-02-10T08:37:40.270 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.270 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.270 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:37:40.270 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.992734+0000", 2024-02-10T08:37:40.270 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2128e-05 2024-02-10T08:37:40.270 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.271 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.271 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:37:40.271 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.992746+0000", 2024-02-10T08:37:40.271 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.065294454000000002 2024-02-10T08:37:40.271 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.271 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.271 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:37:40.271 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:50.058041+0000", 2024-02-10T08:37:40.271 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5384999999999999e-05 2024-02-10T08:37:40.271 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.271 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.271 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:37:40.271 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:50.058056+0000", 2024-02-10T08:37:40.271 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.074034845000000002 2024-02-10T08:37:40.271 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:37:40.271 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:37:40.272 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:37:40.272 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.272 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.272 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(osd.6.0:157877 10.f e374/335 10:f64a4c41:::benchmark_data_smithi018_146618_object39621:head v 374'12258, mlcod=374'12249)", 2024-02-10T08:37:40.272 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:34:49.985989+0000", 2024-02-10T08:37:40.272 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 169.09513716199999, 2024-02-10T08:37:40.272 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.072086775000000006, 2024-02-10T08:37:40.272 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:37:40.272 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:37:40.272 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:37:40.272 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.272 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:37:40.272 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.985989+0000", 2024-02-10T08:37:40.272 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:37:40.273 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.273 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.273 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:37:40.273 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.985989+0000", 2024-02-10T08:37:40.273 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:37:40.273 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.273 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.273 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:37:40.273 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.985988+0000", 2024-02-10T08:37:40.273 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3690000000000007e-06 2024-02-10T08:37:40.273 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.273 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.273 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:37:40.273 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.985996+0000", 2024-02-10T08:37:40.273 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0688e-05 2024-02-10T08:37:40.273 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.273 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.274 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:37:40.274 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.986007+0000", 2024-02-10T08:37:40.274 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5170000000000001e-06 2024-02-10T08:37:40.274 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.274 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.274 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:37:40.274 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.986011+0000", 2024-02-10T08:37:40.274 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0087163959999999995 2024-02-10T08:37:40.274 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.274 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.274 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:37:40.274 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.994728+0000", 2024-02-10T08:37:40.274 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9874e-05 2024-02-10T08:37:40.274 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.274 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.274 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:37:40.275 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.994748+0000", 2024-02-10T08:37:40.275 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.063313261999999995 2024-02-10T08:37:40.275 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.275 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.275 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:37:40.275 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:50.058061+0000", 2024-02-10T08:37:40.275 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4610000000000001e-05 2024-02-10T08:37:40.275 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.275 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.275 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:37:40.275 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:50.058076+0000", 2024-02-10T08:37:40.275 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.072086775000000006 2024-02-10T08:37:40.275 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:37:40.275 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:37:40.275 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:37:40.276 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.276 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.276 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(osd.6.0:157878 10.f e374/335 10:f64c574a:::benchmark_data_smithi018_146618_object98147:head v 374'12259, mlcod=374'12249)", 2024-02-10T08:37:40.276 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:34:49.987601+0000", 2024-02-10T08:37:40.276 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 169.09352514700001, 2024-02-10T08:37:40.276 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.070489711999999996, 2024-02-10T08:37:40.276 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:37:40.276 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:37:40.276 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:37:40.276 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.276 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:37:40.276 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.987601+0000", 2024-02-10T08:37:40.276 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:37:40.276 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.277 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.277 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:37:40.277 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.987601+0000", 2024-02-10T08:37:40.277 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:37:40.277 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.277 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.277 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:37:40.277 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.987600+0000", 2024-02-10T08:37:40.277 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7409999999999998e-06 2024-02-10T08:37:40.277 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.277 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.277 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:37:40.277 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.987609+0000", 2024-02-10T08:37:40.277 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1130000000000007e-06 2024-02-10T08:37:40.277 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.278 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.278 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:37:40.278 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.987618+0000", 2024-02-10T08:37:40.278 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3480000000000003e-06 2024-02-10T08:37:40.278 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.278 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.278 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:37:40.278 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.987623+0000", 2024-02-10T08:37:40.278 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0095962809999999999 2024-02-10T08:37:40.278 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.278 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.278 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:37:40.278 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.997219+0000", 2024-02-10T08:37:40.278 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7978999999999998e-05 2024-02-10T08:37:40.279 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.279 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.279 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:37:40.279 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.997237+0000", 2024-02-10T08:37:40.279 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.060840666000000002 2024-02-10T08:37:40.279 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.279 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.279 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:37:40.279 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:50.058078+0000", 2024-02-10T08:37:40.279 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2408999999999999e-05 2024-02-10T08:37:40.279 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.279 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.279 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:37:40.279 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:50.058091+0000", 2024-02-10T08:37:40.279 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.070489711999999996 2024-02-10T08:37:40.280 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:37:40.280 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:37:40.280 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:37:40.280 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.280 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.280 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(osd.6.0:157879 10.f e374/335 10:f64cb999:::benchmark_data_smithi018_146618_object93995:head v 374'12260, mlcod=374'12249)", 2024-02-10T08:37:40.280 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:34:49.989206+0000", 2024-02-10T08:37:40.280 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 169.09191995500001, 2024-02-10T08:37:40.280 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.068904799000000003, 2024-02-10T08:37:40.280 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:37:40.280 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:37:40.280 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:37:40.280 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.280 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:37:40.280 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.989206+0000", 2024-02-10T08:37:40.281 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:37:40.281 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.281 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.281 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:37:40.281 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.989206+0000", 2024-02-10T08:37:40.281 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:37:40.281 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.281 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.281 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:37:40.281 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.989205+0000", 2024-02-10T08:37:40.281 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9630000000000001e-06 2024-02-10T08:37:40.281 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.281 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.281 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:37:40.281 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.989212+0000", 2024-02-10T08:37:40.281 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6680000000000007e-06 2024-02-10T08:37:40.282 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.282 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.282 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:37:40.282 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.989221+0000", 2024-02-10T08:37:40.282 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2580000000000003e-06 2024-02-10T08:37:40.282 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.282 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.282 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:37:40.282 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.989226+0000", 2024-02-10T08:37:40.282 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.010509114 2024-02-10T08:37:40.282 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.282 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.282 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:37:40.282 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.999735+0000", 2024-02-10T08:37:40.282 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7907e-05 2024-02-10T08:37:40.283 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.283 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.283 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:37:40.283 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.999753+0000", 2024-02-10T08:37:40.283 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058339308999999999 2024-02-10T08:37:40.283 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.283 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.283 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:37:40.283 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:50.058093+0000", 2024-02-10T08:37:40.283 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.827e-05 2024-02-10T08:37:40.283 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.283 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.283 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:37:40.283 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:50.058111+0000", 2024-02-10T08:37:40.283 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.068904799000000003 2024-02-10T08:37:40.284 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:37:40.284 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:37:40.284 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:37:40.284 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.284 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.284 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(osd.6.0:157880 10.f e374/335 10:f64d2abb:::benchmark_data_smithi018_146618_object98460:head v 374'12261, mlcod=374'12249)", 2024-02-10T08:37:40.284 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:34:49.991070+0000", 2024-02-10T08:37:40.284 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 169.09005628899999, 2024-02-10T08:37:40.284 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.067057134000000004, 2024-02-10T08:37:40.284 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:37:40.284 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:37:40.284 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:37:40.284 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.284 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:37:40.284 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.991070+0000", 2024-02-10T08:37:40.285 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:37:40.285 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.285 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.285 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:37:40.285 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.991070+0000", 2024-02-10T08:37:40.285 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:37:40.285 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.285 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.285 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:37:40.285 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.991069+0000", 2024-02-10T08:37:40.285 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1174e-05 2024-02-10T08:37:40.285 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.285 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.285 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:37:40.285 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.991080+0000", 2024-02-10T08:37:40.286 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1589999999999999e-06 2024-02-10T08:37:40.286 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.286 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.286 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:37:40.286 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.991089+0000", 2024-02-10T08:37:40.286 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6999999999999996e-06 2024-02-10T08:37:40.286 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.286 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.286 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:37:40.286 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.991095+0000", 2024-02-10T08:37:40.286 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011150571 2024-02-10T08:37:40.286 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.286 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.286 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:37:40.286 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:50.002245+0000", 2024-02-10T08:37:40.287 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6753999999999999e-05 2024-02-10T08:37:40.287 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.287 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.287 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:37:40.287 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:50.002262+0000", 2024-02-10T08:37:40.287 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.055850669999999998 2024-02-10T08:37:40.287 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.287 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.287 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:37:40.287 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:50.058113+0000", 2024-02-10T08:37:40.287 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4161999999999999e-05 2024-02-10T08:37:40.287 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.287 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.287 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:37:40.288 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:50.058127+0000", 2024-02-10T08:37:40.288 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.067057134000000004 2024-02-10T08:37:40.288 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:37:40.288 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:37:40.288 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:37:40.288 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.288 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.288 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(osd.6.0:157881 10.f e374/335 10:f64dd919:::benchmark_data_smithi018_146618_object72900:head v 374'12262, mlcod=374'12249)", 2024-02-10T08:37:40.288 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:34:49.992220+0000", 2024-02-10T08:37:40.288 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 169.08890626300001, 2024-02-10T08:37:40.288 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.065943105000000002, 2024-02-10T08:37:40.288 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:37:40.288 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:37:40.288 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:37:40.288 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.289 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:37:40.289 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.992220+0000", 2024-02-10T08:37:40.289 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:37:40.289 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.289 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.289 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:37:40.289 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.992220+0000", 2024-02-10T08:37:40.289 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:37:40.289 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.289 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.289 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:37:40.289 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.992219+0000", 2024-02-10T08:37:40.289 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2299999999999997e-06 2024-02-10T08:37:40.289 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.290 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.290 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:37:40.290 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.992228+0000", 2024-02-10T08:37:40.290 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8939999999999999e-06 2024-02-10T08:37:40.290 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.290 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.290 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:37:40.290 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.992237+0000", 2024-02-10T08:37:40.290 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0069999999999997e-06 2024-02-10T08:37:40.290 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.290 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.290 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:37:40.290 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.992245+0000", 2024-02-10T08:37:40.290 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.014917869 2024-02-10T08:37:40.290 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.290 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.291 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:37:40.291 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:50.007163+0000", 2024-02-10T08:37:40.291 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7785e-05 2024-02-10T08:37:40.291 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.291 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.291 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:37:40.291 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:50.007181+0000", 2024-02-10T08:37:40.291 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.050967862000000003 2024-02-10T08:37:40.291 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.291 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.291 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:37:40.291 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:50.058149+0000", 2024-02-10T08:37:40.291 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4178e-05 2024-02-10T08:37:40.291 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.291 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.292 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:37:40.292 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:50.058163+0000", 2024-02-10T08:37:40.292 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.065943105000000002 2024-02-10T08:37:40.292 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:37:40.292 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:37:40.292 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:37:40.292 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.292 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.292 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(osd.6.0:157882 10.f e374/335 10:f6504417:::benchmark_data_smithi018_146618_object88948:head v 374'12263, mlcod=374'12249)", 2024-02-10T08:37:40.292 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:34:49.993628+0000", 2024-02-10T08:37:40.292 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 169.087498203, 2024-02-10T08:37:40.292 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.064548817999999994, 2024-02-10T08:37:40.292 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:37:40.292 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:37:40.293 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:37:40.293 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.293 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:37:40.293 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.993628+0000", 2024-02-10T08:37:40.293 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:37:40.293 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.293 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.293 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:37:40.293 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.993628+0000", 2024-02-10T08:37:40.293 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:37:40.293 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.293 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.293 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:37:40.293 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.993627+0000", 2024-02-10T08:37:40.293 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1878999999999999e-05 2024-02-10T08:37:40.294 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.294 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.294 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:37:40.294 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.993639+0000", 2024-02-10T08:37:40.294 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.064e-06 2024-02-10T08:37:40.294 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.294 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.294 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:37:40.294 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.993648+0000", 2024-02-10T08:37:40.294 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5790000000000003e-06 2024-02-10T08:37:40.294 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.294 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.294 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:37:40.294 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.993654+0000", 2024-02-10T08:37:40.294 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.016123373999999999 2024-02-10T08:37:40.295 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.295 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.295 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:37:40.295 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:50.009777+0000", 2024-02-10T08:37:40.295 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0339999999999998e-05 2024-02-10T08:37:40.295 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.295 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.295 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:37:40.295 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:50.009797+0000", 2024-02-10T08:37:40.295 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048367201999999998 2024-02-10T08:37:40.295 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.295 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.295 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:37:40.295 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:50.058165+0000", 2024-02-10T08:37:40.295 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2092999999999999e-05 2024-02-10T08:37:40.296 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.296 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.296 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:37:40.296 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:50.058177+0000", 2024-02-10T08:37:40.296 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.064548817999999994 2024-02-10T08:37:40.296 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:37:40.296 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:37:40.296 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:37:40.296 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.296 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.296 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(osd.6.0:158327 10.f e374/335 10:f6f4549f:::benchmark_data_smithi018_146618_object49471:head v 374'12540, mlcod=374'12512)", 2024-02-10T08:37:40.296 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:34:51.042826+0000", 2024-02-10T08:37:40.296 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 168.038300179, 2024-02-10T08:37:40.296 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.21192914400000001, 2024-02-10T08:37:40.297 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:37:40.297 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:37:40.297 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:37:40.297 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.297 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:37:40.297 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.042826+0000", 2024-02-10T08:37:40.297 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:37:40.297 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.297 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.297 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:37:40.297 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.042826+0000", 2024-02-10T08:37:40.297 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:37:40.297 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.297 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.298 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:37:40.298 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.042825+0000", 2024-02-10T08:37:40.298 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9719999999999997e-06 2024-02-10T08:37:40.298 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.298 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.298 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:37:40.298 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.042831+0000", 2024-02-10T08:37:40.298 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5619999999999998e-06 2024-02-10T08:37:40.298 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.298 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.298 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:37:40.298 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.042839+0000", 2024-02-10T08:37:40.298 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9840000000000003e-06 2024-02-10T08:37:40.298 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.299 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.299 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:37:40.299 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.042843+0000", 2024-02-10T08:37:40.299 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011244656 2024-02-10T08:37:40.299 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.299 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.299 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:37:40.299 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.054087+0000", 2024-02-10T08:37:40.299 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0909e-05 2024-02-10T08:37:40.299 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.299 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.299 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:37:40.299 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.054098+0000", 2024-02-10T08:37:40.299 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0042649810000000002 2024-02-10T08:37:40.300 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.300 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.300 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:37:40.300 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.058363+0000", 2024-02-10T08:37:40.300 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.19639174100000001 2024-02-10T08:37:40.300 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.300 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.300 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:37:40.300 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.254755+0000", 2024-02-10T08:37:40.300 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.21192914400000001 2024-02-10T08:37:40.300 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:37:40.300 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:37:40.300 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:37:40.300 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.301 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.301 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(osd.6.0:158329 10.f e374/335 10:f6f5d737:::benchmark_data_smithi018_146618_object92740:head v 374'12541, mlcod=374'12512)", 2024-02-10T08:37:40.301 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:34:51.046988+0000", 2024-02-10T08:37:40.301 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 168.034138356, 2024-02-10T08:37:40.301 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.21040182900000001, 2024-02-10T08:37:40.301 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:37:40.301 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:37:40.301 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:37:40.301 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.301 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:37:40.301 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.046988+0000", 2024-02-10T08:37:40.301 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:37:40.301 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.301 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.301 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:37:40.302 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.046988+0000", 2024-02-10T08:37:40.302 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:37:40.302 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.302 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.302 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:37:40.302 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.046987+0000", 2024-02-10T08:37:40.302 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9580000000000007e-06 2024-02-10T08:37:40.302 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.302 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.302 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:37:40.302 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.046995+0000", 2024-02-10T08:37:40.302 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6709999999999994e-06 2024-02-10T08:37:40.302 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.302 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.302 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:37:40.303 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.047004+0000", 2024-02-10T08:37:40.303 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9499999999999998e-06 2024-02-10T08:37:40.303 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.303 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.303 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:37:40.303 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.047010+0000", 2024-02-10T08:37:40.303 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0081189929999999997 2024-02-10T08:37:40.303 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.303 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.303 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:37:40.303 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.055129+0000", 2024-02-10T08:37:40.303 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7062999999999999e-05 2024-02-10T08:37:40.303 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.303 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.303 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:37:40.304 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.055146+0000", 2024-02-10T08:37:40.304 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.20221127699999999 2024-02-10T08:37:40.304 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.304 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.304 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:37:40.304 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.257358+0000", 2024-02-10T08:37:40.304 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1860000000000003e-05 2024-02-10T08:37:40.304 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.304 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.304 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:37:40.304 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.257389+0000", 2024-02-10T08:37:40.304 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.21040182900000001 2024-02-10T08:37:40.304 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:37:40.305 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:37:40.305 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:37:40.305 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.305 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.305 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.25369.0:159347 10.f e374/335 10:f73c317e:::benchmark_data_smithi018_146618_object35544:head v 374'12542, mlcod=374'12512)", 2024-02-10T08:37:40.305 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:34:51.049938+0000", 2024-02-10T08:37:40.305 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 168.03118777500001, 2024-02-10T08:37:40.305 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.207469867, 2024-02-10T08:37:40.305 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:37:40.305 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:37:40.305 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:37:40.305 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.305 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:37:40.305 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.049938+0000", 2024-02-10T08:37:40.305 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:37:40.306 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.306 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.306 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:37:40.306 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.049938+0000", 2024-02-10T08:37:40.306 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:37:40.306 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.306 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.306 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:37:40.306 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.049937+0000", 2024-02-10T08:37:40.306 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1179999999999992e-06 2024-02-10T08:37:40.306 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.306 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.306 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:37:40.306 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.049945+0000", 2024-02-10T08:37:40.307 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0251000000000001e-05 2024-02-10T08:37:40.307 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.307 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.307 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:37:40.307 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.049956+0000", 2024-02-10T08:37:40.307 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3759999999999996e-06 2024-02-10T08:37:40.307 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.307 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.307 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:37:40.307 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.049962+0000", 2024-02-10T08:37:40.307 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0062557200000000002 2024-02-10T08:37:40.307 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.307 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.307 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:37:40.307 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.056218+0000", 2024-02-10T08:37:40.308 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0801e-05 2024-02-10T08:37:40.308 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.308 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.308 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:37:40.308 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.056229+0000", 2024-02-10T08:37:40.308 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.201163748 2024-02-10T08:37:40.308 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.308 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.308 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:37:40.308 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.257392+0000", 2024-02-10T08:37:40.308 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5702e-05 2024-02-10T08:37:40.308 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.308 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.308 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:37:40.309 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.257408+0000", 2024-02-10T08:37:40.309 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.207469867 2024-02-10T08:37:40.309 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:37:40.309 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:37:40.309 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:37:40.309 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.309 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.309 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.25369.0:159390 10.7 e374/364 10:e0a23cc4:::benchmark_data_smithi018_146618_object35587:head v 374'10080, mlcod=374'10076)", 2024-02-10T08:37:40.309 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:34:51.055068+0000", 2024-02-10T08:37:40.309 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 168.02605764399999, 2024-02-10T08:37:40.309 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.20236198399999999, 2024-02-10T08:37:40.309 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:37:40.309 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:37:40.309 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:37:40.309 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.310 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:37:40.310 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.055068+0000", 2024-02-10T08:37:40.310 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:37:40.310 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.310 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.310 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:37:40.310 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.055068+0000", 2024-02-10T08:37:40.310 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:37:40.310 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.310 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.310 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:37:40.310 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.055067+0000", 2024-02-10T08:37:40.310 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2711000000000001e-05 2024-02-10T08:37:40.310 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.311 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.311 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:37:40.311 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.055080+0000", 2024-02-10T08:37:40.311 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7580000000000004e-06 2024-02-10T08:37:40.311 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.311 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.311 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:37:40.311 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.055089+0000", 2024-02-10T08:37:40.311 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0269999999999997e-06 2024-02-10T08:37:40.311 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.311 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.311 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:37:40.311 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.055093+0000", 2024-02-10T08:37:40.311 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010822099999999999 2024-02-10T08:37:40.311 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.312 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.312 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:37:40.312 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.056176+0000", 2024-02-10T08:37:40.312 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0899e-05 2024-02-10T08:37:40.312 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.312 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.312 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:37:40.312 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.056187+0000", 2024-02-10T08:37:40.312 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.201223438 2024-02-10T08:37:40.312 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.312 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.312 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:37:40.312 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.257410+0000", 2024-02-10T08:37:40.312 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0316e-05 2024-02-10T08:37:40.313 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.313 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.313 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:37:40.313 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.257430+0000", 2024-02-10T08:37:40.313 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.20236198399999999 2024-02-10T08:37:40.313 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:37:40.313 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:37:40.313 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:37:40.313 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.313 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.313 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.25369.0:159368 10.f e374/335 10:f0241dc0:::benchmark_data_smithi018_146618_object35565:head v 374'12543, mlcod=374'12524)", 2024-02-10T08:37:40.313 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:34:51.060562+0000", 2024-02-10T08:37:40.313 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 168.020564441, 2024-02-10T08:37:40.313 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.19941993999999999, 2024-02-10T08:37:40.313 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:37:40.314 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:37:40.314 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:37:40.314 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.314 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:37:40.314 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.060562+0000", 2024-02-10T08:37:40.314 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:37:40.314 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.314 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.314 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:37:40.314 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.060562+0000", 2024-02-10T08:37:40.314 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:37:40.314 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.314 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.314 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:37:40.314 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.060560+0000", 2024-02-10T08:37:40.315 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3298999999999999e-05 2024-02-10T08:37:40.315 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.315 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.315 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:37:40.315 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.060574+0000", 2024-02-10T08:37:40.315 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.194171652 2024-02-10T08:37:40.315 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.315 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.315 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:37:40.315 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.254745+0000", 2024-02-10T08:37:40.315 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.098e-05 2024-02-10T08:37:40.315 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.315 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.315 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:37:40.316 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.254756+0000", 2024-02-10T08:37:40.316 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2692999999999999e-05 2024-02-10T08:37:40.316 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.316 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.316 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:37:40.316 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.254799+0000", 2024-02-10T08:37:40.316 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.4176e-05 2024-02-10T08:37:40.316 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.316 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.316 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:37:40.316 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.254823+0000", 2024-02-10T08:37:40.316 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0051329469999999997 2024-02-10T08:37:40.316 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.316 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.316 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:37:40.317 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.259956+0000", 2024-02-10T08:37:40.317 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5333e-05 2024-02-10T08:37:40.317 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.317 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.317 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:37:40.317 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.259981+0000", 2024-02-10T08:37:40.317 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.19941993999999999 2024-02-10T08:37:40.317 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:37:40.317 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:37:40.317 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:37:40.317 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.317 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.317 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.25369.0:159385 10.5 e374/335 10:a2cbe603:::benchmark_data_smithi018_146618_object35582:head v 374'9807, mlcod=374'9805)", 2024-02-10T08:37:40.317 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:34:51.061990+0000", 2024-02-10T08:37:40.317 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 168.01913619600001, 2024-02-10T08:37:40.318 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.20089375700000001, 2024-02-10T08:37:40.318 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:37:40.318 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:37:40.318 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:37:40.318 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.318 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:37:40.318 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.061990+0000", 2024-02-10T08:37:40.318 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:37:40.318 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.318 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.318 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:37:40.318 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.061990+0000", 2024-02-10T08:37:40.318 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:37:40.318 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.318 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.319 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:37:40.319 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.061989+0000", 2024-02-10T08:37:40.319 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6489999999999997e-06 2024-02-10T08:37:40.319 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.319 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.319 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:37:40.319 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.061997+0000", 2024-02-10T08:37:40.319 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.192749482 2024-02-10T08:37:40.319 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.319 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.319 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:37:40.319 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.254747+0000", 2024-02-10T08:37:40.319 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0424e-05 2024-02-10T08:37:40.319 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.320 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.320 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:37:40.320 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.254757+0000", 2024-02-10T08:37:40.320 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6709000000000003e-05 2024-02-10T08:37:40.320 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.320 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.320 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:37:40.320 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.254804+0000", 2024-02-10T08:37:40.320 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.6973000000000001e-05 2024-02-10T08:37:40.320 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.320 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.320 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:37:40.320 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.254831+0000", 2024-02-10T08:37:40.320 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0080223359999999997 2024-02-10T08:37:40.320 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.320 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.321 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:37:40.321 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.262853+0000", 2024-02-10T08:37:40.321 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0209000000000002e-05 2024-02-10T08:37:40.321 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.321 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.321 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:37:40.321 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.262884+0000", 2024-02-10T08:37:40.321 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.20089375700000001 2024-02-10T08:37:40.321 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:37:40.321 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:37:40.321 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:37:40.321 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.321 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.321 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(osd.6.0:159440 10.f e375/335 10:f89948aa:::benchmark_data_smithi018_146618_object46104:head v 375'13243, mlcod=375'13223)", 2024-02-10T08:37:40.321 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:34:53.836362+0000", 2024-02-10T08:37:40.322 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 165.24476416900001, 2024-02-10T08:37:40.322 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.065421075999999995, 2024-02-10T08:37:40.322 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:37:40.322 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:37:40.322 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:37:40.322 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.322 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:37:40.322 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:53.836362+0000", 2024-02-10T08:37:40.322 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:37:40.322 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.322 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.322 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:37:40.322 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:53.836362+0000", 2024-02-10T08:37:40.322 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967296 2024-02-10T08:37:40.322 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.323 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.323 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:37:40.323 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:53.836362+0000", 2024-02-10T08:37:40.323 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5720000000000002e-06 2024-02-10T08:37:40.323 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.323 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.323 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:37:40.323 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:53.836367+0000", 2024-02-10T08:37:40.323 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6190000000000002e-06 2024-02-10T08:37:40.323 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.323 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.323 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:37:40.323 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:53.836372+0000", 2024-02-10T08:37:40.323 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.569e-06 2024-02-10T08:37:40.323 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.324 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.324 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:37:40.324 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:53.836375+0000", 2024-02-10T08:37:40.324 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011861541999999999 2024-02-10T08:37:40.324 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.324 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.324 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:37:40.324 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:53.848237+0000", 2024-02-10T08:37:40.324 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5038999999999999e-05 2024-02-10T08:37:40.324 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.324 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.324 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:37:40.324 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:53.848252+0000", 2024-02-10T08:37:40.324 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.053501711 2024-02-10T08:37:40.325 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.325 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.325 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:37:40.325 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:53.901754+0000", 2024-02-10T08:37:40.325 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9204e-05 2024-02-10T08:37:40.325 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.325 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.325 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:37:40.325 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:53.901783+0000", 2024-02-10T08:37:40.325 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.065421075999999995 2024-02-10T08:37:40.325 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:37:40.325 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:37:40.325 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:37:40.325 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.325 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.326 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(osd.6.0:159441 10.f e375/335 10:f899915c:::benchmark_data_smithi018_146618_object76532:head v 375'13244, mlcod=375'13223)", 2024-02-10T08:37:40.326 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:34:53.837890+0000", 2024-02-10T08:37:40.326 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 165.243235924, 2024-02-10T08:37:40.326 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.063943282000000004, 2024-02-10T08:37:40.326 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:37:40.326 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:37:40.326 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:37:40.326 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.326 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:37:40.326 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:53.837890+0000", 2024-02-10T08:37:40.326 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:37:40.326 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.326 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.326 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:37:40.326 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:53.837890+0000", 2024-02-10T08:37:40.326 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:37:40.327 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.327 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.327 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:37:40.327 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:53.837889+0000", 2024-02-10T08:37:40.327 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8739999999999997e-06 2024-02-10T08:37:40.327 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.327 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.327 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:37:40.327 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:53.837896+0000", 2024-02-10T08:37:40.327 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2568999999999999e-05 2024-02-10T08:37:40.327 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.327 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.327 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:37:40.327 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:53.837909+0000", 2024-02-10T08:37:40.327 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5180000000000004e-06 2024-02-10T08:37:40.328 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.328 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.328 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:37:40.328 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:53.837914+0000", 2024-02-10T08:37:40.328 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015298109000000001 2024-02-10T08:37:40.328 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.328 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.328 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:37:40.328 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:53.853212+0000", 2024-02-10T08:37:40.328 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6337e-05 2024-02-10T08:37:40.328 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.328 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.328 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:37:40.328 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:53.853229+0000", 2024-02-10T08:37:40.328 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048584651999999999 2024-02-10T08:37:40.329 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.329 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.329 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:37:40.329 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:53.901813+0000", 2024-02-10T08:37:40.329 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9953999999999999e-05 2024-02-10T08:37:40.329 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.329 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.329 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:37:40.329 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:53.901833+0000", 2024-02-10T08:37:40.329 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.063943282000000004 2024-02-10T08:37:40.329 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:37:40.329 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:37:40.329 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:37:40.329 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.330 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.330 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(osd.6.0:159676 10.f e375/335 10:f8e3aa90:::benchmark_data_smithi018_146618_object118426:head v 375'13391, mlcod=375'13374)", 2024-02-10T08:37:40.330 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:34:54.417636+0000", 2024-02-10T08:37:40.330 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 164.663490314, 2024-02-10T08:37:40.330 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.064006720000000003, 2024-02-10T08:37:40.330 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:37:40.330 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:37:40.330 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:37:40.330 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.330 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:37:40.330 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:54.417636+0000", 2024-02-10T08:37:40.330 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:37:40.330 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.330 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.330 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:37:40.331 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:54.417636+0000", 2024-02-10T08:37:40.331 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:37:40.331 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.331 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.331 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:37:40.331 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:54.417635+0000", 2024-02-10T08:37:40.331 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.85e-06 2024-02-10T08:37:40.331 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.331 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.331 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:37:40.331 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:54.417644+0000", 2024-02-10T08:37:40.331 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0577000000000001e-05 2024-02-10T08:37:40.331 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.331 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.331 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:37:40.332 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:54.417654+0000", 2024-02-10T08:37:40.332 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2539999999999998e-06 2024-02-10T08:37:40.332 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.332 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.332 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:37:40.332 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:54.417660+0000", 2024-02-10T08:37:40.332 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.012529507 2024-02-10T08:37:40.332 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.332 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.332 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:37:40.332 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:54.430190+0000", 2024-02-10T08:37:40.332 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8542999999999998e-05 2024-02-10T08:37:40.332 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.332 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.333 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:37:40.333 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:54.430208+0000", 2024-02-10T08:37:40.333 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.051405525000000001 2024-02-10T08:37:40.333 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.333 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.333 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:37:40.333 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:54.481614+0000", 2024-02-10T08:37:40.333 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8447000000000001e-05 2024-02-10T08:37:40.333 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.333 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.333 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:37:40.333 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:54.481642+0000", 2024-02-10T08:37:40.333 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.064006720000000003 2024-02-10T08:37:40.333 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:37:40.334 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:37:40.334 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:37:40.334 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.334 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.334 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(osd.6.0:159677 10.f e375/335 10:f8e5500d:::benchmark_data_smithi018_146618_object82680:head v 375'13392, mlcod=375'13374)", 2024-02-10T08:37:40.334 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:34:54.417666+0000", 2024-02-10T08:37:40.334 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 164.66345982600001, 2024-02-10T08:37:40.334 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.063990314000000006, 2024-02-10T08:37:40.334 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:37:40.334 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:37:40.334 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:37:40.334 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.334 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:37:40.334 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:54.417666+0000", 2024-02-10T08:37:40.334 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:37:40.334 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.335 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.335 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:37:40.335 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:54.417666+0000", 2024-02-10T08:37:40.335 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:37:40.335 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.335 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.335 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:37:40.335 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:54.417666+0000", 2024-02-10T08:37:40.335 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6940000000000003e-06 2024-02-10T08:37:40.335 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.335 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.335 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:37:40.335 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:54.417671+0000", 2024-02-10T08:37:40.335 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9470000000000002e-06 2024-02-10T08:37:40.335 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.336 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.336 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:37:40.336 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:54.417675+0000", 2024-02-10T08:37:40.336 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.298e-06 2024-02-10T08:37:40.336 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.336 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.336 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:37:40.336 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:54.417679+0000", 2024-02-10T08:37:40.336 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.014775599 2024-02-10T08:37:40.336 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.336 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.336 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:37:40.336 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:54.432454+0000", 2024-02-10T08:37:40.336 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2410999999999999e-05 2024-02-10T08:37:40.337 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.337 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.337 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:37:40.337 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:54.432477+0000", 2024-02-10T08:37:40.337 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.049169554999999997 2024-02-10T08:37:40.337 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.337 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.337 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:37:40.337 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:54.481646+0000", 2024-02-10T08:37:40.337 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0118999999999999e-05 2024-02-10T08:37:40.337 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.337 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.337 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:37:40.337 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:54.481656+0000", 2024-02-10T08:37:40.337 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.063990314000000006 2024-02-10T08:37:40.338 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:37:40.338 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:37:40.338 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:37:40.338 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.338 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.338 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(osd.6.0:159678 10.f e375/335 10:f8e72b7e:::benchmark_data_smithi018_146618_object99723:head v 375'13393, mlcod=375'13374)", 2024-02-10T08:37:40.338 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:34:54.417683+0000", 2024-02-10T08:37:40.338 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 164.663443306, 2024-02-10T08:37:40.338 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.063984577000000001, 2024-02-10T08:37:40.338 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:37:40.338 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:37:40.338 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:37:40.338 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.338 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:37:40.338 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:54.417683+0000", 2024-02-10T08:37:40.339 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:37:40.339 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.339 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.339 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:37:40.339 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:54.417683+0000", 2024-02-10T08:37:40.339 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:37:40.339 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.339 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.339 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:37:40.339 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:54.417682+0000", 2024-02-10T08:37:40.339 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1770000000000001e-06 2024-02-10T08:37:40.339 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.339 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.339 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:37:40.340 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:54.417690+0000", 2024-02-10T08:37:40.340 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5790000000000003e-06 2024-02-10T08:37:40.340 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.340 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.340 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:37:40.340 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:54.417695+0000", 2024-02-10T08:37:40.340 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6940000000000003e-06 2024-02-10T08:37:40.340 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.340 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.340 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:37:40.340 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:54.417700+0000", 2024-02-10T08:37:40.340 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.016949308999999999 2024-02-10T08:37:40.340 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.340 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.340 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:37:40.341 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:54.434649+0000", 2024-02-10T08:37:40.341 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7706e-05 2024-02-10T08:37:40.341 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.341 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.341 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:37:40.341 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:54.434667+0000", 2024-02-10T08:37:40.341 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.046991797000000002 2024-02-10T08:37:40.341 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.341 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.341 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:37:40.341 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:54.481659+0000", 2024-02-10T08:37:40.341 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6149999999999997e-06 2024-02-10T08:37:40.341 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:37:40.341 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:37:40.341 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:37:40.342 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:54.481667+0000", 2024-02-10T08:37:40.342 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.063984577000000001 2024-02-10T08:37:40.342 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:37:40.342 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:37:40.342 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:37:40.342 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:37:40.342 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:37:40.342 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-02-10T08:37:40.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:37:38.824220+0000 mgr.y (mgr.14505) 784 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:37:40.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:39.094566+0000 mgr.y (mgr.14505) 785 : cluster [DBG] pgmap v957: 168 pgs: 168 active+clean; 4.1 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 1.2 KiB/s rd, 95 MiB/s wr, 1.51k op/s 2024-02-10T08:37:40.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:37:38.824220+0000 mgr.y (mgr.14505) 784 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:37:40.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:39.094566+0000 mgr.y (mgr.14505) 785 : cluster [DBG] pgmap v957: 168 pgs: 168 active+clean; 4.1 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 1.2 KiB/s rd, 95 MiB/s wr, 1.51k op/s 2024-02-10T08:37:40.522 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 43 15 71109 71094 103.289 71.0625 0.0146722 0.00967611 2024-02-10T08:37:40.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:37:38.824220+0000 mgr.y (mgr.14505) 784 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:37:40.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:39.094566+0000 mgr.y (mgr.14505) 785 : cluster [DBG] pgmap v957: 168 pgs: 168 active+clean; 4.1 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 1.2 KiB/s rd, 95 MiB/s wr, 1.51k op/s 2024-02-10T08:37:40.563 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:37:40.569 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:40.570 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:37:40.671 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:37:40.718 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:40.744 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:37:40.749 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:40.750 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:37:40.789 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd set nodeep-scrub 2024-02-10T08:37:40.850 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:37:40.941 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:41.240 INFO:teuthology.orchestra.run.smithi018.stderr:set pool 1 pg_num to 11 2024-02-10T08:37:41.439 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.5 dump_ops_in_flight 2024-02-10T08:37:41.489 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:41 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:37:40.872268+0000 mon.c (mon.2) 94 : audit [INF] from='client.? 172.21.15.18:0/3720061904' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "device_health_metrics", "var": "pg_num", "val": "11"}]: dispatch 2024-02-10T08:37:41.489 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:41 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:37:40.872698+0000 mon.a (mon.0) 1695 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "device_health_metrics", "var": "pg_num", "val": "11"}]: dispatch 2024-02-10T08:37:41.524 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 44 16 72094 72078 102.336 61.5 0.0163423 0.0097668 2024-02-10T08:37:41.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:37:40.872268+0000 mon.c (mon.2) 94 : audit [INF] from='client.? 172.21.15.18:0/3720061904' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "device_health_metrics", "var": "pg_num", "val": "11"}]: dispatch 2024-02-10T08:37:41.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:37:40.872698+0000 mon.a (mon.0) 1695 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "device_health_metrics", "var": "pg_num", "val": "11"}]: dispatch 2024-02-10T08:37:41.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:37:40.872268+0000 mon.c (mon.2) 94 : audit [INF] from='client.? 172.21.15.18:0/3720061904' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "device_health_metrics", "var": "pg_num", "val": "11"}]: dispatch 2024-02-10T08:37:41.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:37:40.872698+0000 mon.a (mon.0) 1695 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "device_health_metrics", "var": "pg_num", "val": "11"}]: dispatch 2024-02-10T08:37:41.853 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:37:42.240 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:37:42.518 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:41.095090+0000 mgr.y (mgr.14505) 786 : cluster [DBG] pgmap v958: 168 pgs: 168 active+clean; 4.2 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 639 B/s rd, 57 MiB/s wr, 910 op/s 2024-02-10T08:37:42.519 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:37:41.218677+0000 mon.a (mon.0) 1696 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "device_health_metrics", "var": "pg_num", "val": "11"}]': finished 2024-02-10T08:37:42.519 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:41.218729+0000 mon.a (mon.0) 1697 : cluster [DBG] osdmap e408: 8 total, 8 up, 8 in 2024-02-10T08:37:42.519 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:41.095090+0000 mgr.y (mgr.14505) 786 : cluster [DBG] pgmap v958: 168 pgs: 168 active+clean; 4.2 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 639 B/s rd, 57 MiB/s wr, 910 op/s 2024-02-10T08:37:42.519 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:37:41.218677+0000 mon.a (mon.0) 1696 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "device_health_metrics", "var": "pg_num", "val": "11"}]': finished 2024-02-10T08:37:42.519 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:41.218729+0000 mon.a (mon.0) 1697 : cluster [DBG] osdmap e408: 8 total, 8 up, 8 in 2024-02-10T08:37:42.524 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 45 16 73204 73188 101.603 69.375 0.0135959 0.00983648 2024-02-10T08:37:42.524 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:37:42.525 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:41.095090+0000 mgr.y (mgr.14505) 786 : cluster [DBG] pgmap v958: 168 pgs: 168 active+clean; 4.2 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 639 B/s rd, 57 MiB/s wr, 910 op/s 2024-02-10T08:37:42.525 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:37:41.218677+0000 mon.a (mon.0) 1696 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "device_health_metrics", "var": "pg_num", "val": "11"}]': finished 2024-02-10T08:37:42.525 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:41.218729+0000 mon.a (mon.0) 1697 : cluster [DBG] osdmap e408: 8 total, 8 up, 8 in 2024-02-10T08:37:42.528 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:42.528 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:37:42.629 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:37:42.676 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:43.171 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:37:43.439 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:37:43.441 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:43.442 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:37:43.524 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 46 16 74233 74217 100.793 64.3125 0.0194201 0.0099161 2024-02-10T08:37:43.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:43 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:37:43.097353+0000 mon.a (mon.0) 1698 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "device_health_metrics", "var": "pg_num_actual", "val": "11"}]: dispatch 2024-02-10T08:37:43.542 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:37:43.591 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:43.619 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:37:43.630 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:43.631 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:37:43.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:37:43.097353+0000 mon.a (mon.0) 1698 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "device_health_metrics", "var": "pg_num_actual", "val": "11"}]: dispatch 2024-02-10T08:37:43.657 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:37:43.097353+0000 mon.a (mon.0) 1698 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "device_health_metrics", "var": "pg_num_actual", "val": "11"}]: dispatch 2024-02-10T08:37:43.731 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:37:43.781 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:44.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:43.095875+0000 mgr.y (mgr.14505) 787 : cluster [DBG] pgmap v960: 168 pgs: 168 active+clean; 4.4 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 1.2 KiB/s rd, 83 MiB/s wr, 1.32k op/s 2024-02-10T08:37:44.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:37:43.299589+0000 mon.a (mon.0) 1699 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "device_health_metrics", "var": "pg_num_actual", "val": "11"}]': finished 2024-02-10T08:37:44.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:43.299657+0000 mon.a (mon.0) 1700 : cluster [DBG] osdmap e409: 8 total, 8 up, 8 in 2024-02-10T08:37:44.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:43.095875+0000 mgr.y (mgr.14505) 787 : cluster [DBG] pgmap v960: 168 pgs: 168 active+clean; 4.4 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 1.2 KiB/s rd, 83 MiB/s wr, 1.32k op/s 2024-02-10T08:37:44.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:37:43.299589+0000 mon.a (mon.0) 1699 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "device_health_metrics", "var": "pg_num_actual", "val": "11"}]': finished 2024-02-10T08:37:44.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:43.299657+0000 mon.a (mon.0) 1700 : cluster [DBG] osdmap e409: 8 total, 8 up, 8 in 2024-02-10T08:37:44.524 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 47 16 75361 75345 100.148 70.5 0.0062122 0.00998049 2024-02-10T08:37:44.684 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:44 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:43.095875+0000 mgr.y (mgr.14505) 787 : cluster [DBG] pgmap v960: 168 pgs: 168 active+clean; 4.4 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 1.2 KiB/s rd, 83 MiB/s wr, 1.32k op/s 2024-02-10T08:37:44.684 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:44 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:37:43.299589+0000 mon.a (mon.0) 1699 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "device_health_metrics", "var": "pg_num_actual", "val": "11"}]': finished 2024-02-10T08:37:44.684 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:44 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:43.299657+0000 mon.a (mon.0) 1700 : cluster [DBG] osdmap e409: 8 total, 8 up, 8 in 2024-02-10T08:37:44.703 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:37:44.706 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:44.707 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:37:44.808 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:37:44.852 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:44.968 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:37:44.976 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:44.977 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:37:45.078 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:37:45.117 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:45.156 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:37:45.158 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:45.159 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:37:45.229 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:37:45.260 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:37:45.261 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:37:45.303 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:37:45.319 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-02-10T08:37:45.319 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-02-10T08:37:45.319 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:45.319 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.25664.0:76227 11.a 11:5c646fa6:::benchmark_data_smithi018_166993_object76226:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected e410)", 2024-02-10T08:37:45.319 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:37:45.308302+0000", 2024-02-10T08:37:45.319 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.01089086, 2024-02-10T08:37:45.319 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010914527, 2024-02-10T08:37:45.320 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:37:45.320 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "waiting for sub ops", 2024-02-10T08:37:45.320 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:37:45.320 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.25664", 2024-02-10T08:37:45.320 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/1087272222", 2024-02-10T08:37:45.320 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 76227 2024-02-10T08:37:45.320 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:45.320 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:37:45.320 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:45.320 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:37:45.320 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:37:45.308302+0000", 2024-02-10T08:37:45.320 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:37:45.320 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:45.320 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:45.320 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:37:45.321 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:37:45.308302+0000", 2024-02-10T08:37:45.321 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999981 2024-02-10T08:37:45.321 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:45.321 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:45.321 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:37:45.321 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:37:45.308301+0000", 2024-02-10T08:37:45.321 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0834000000000006e-05 2024-02-10T08:37:45.321 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:45.321 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:45.321 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:37:45.321 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:37:45.308381+0000", 2024-02-10T08:37:45.321 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3644e-05 2024-02-10T08:37:45.321 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:45.321 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:45.322 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:37:45.322 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:37:45.308395+0000", 2024-02-10T08:37:45.322 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8809999999999998e-06 2024-02-10T08:37:45.322 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:45.322 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:45.322 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:37:45.322 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:37:45.308402+0000", 2024-02-10T08:37:45.322 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4811000000000002e-05 2024-02-10T08:37:45.322 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:45.322 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:45.322 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:37:45.322 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:37:45.308447+0000", 2024-02-10T08:37:45.322 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000146596 2024-02-10T08:37:45.322 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:45.322 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:45.323 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:37:45.323 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:37:45.308593+0000", 2024-02-10T08:37:45.323 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000177336 2024-02-10T08:37:45.323 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:45.323 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:45.323 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3,6", 2024-02-10T08:37:45.323 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:37:45.308771+0000", 2024-02-10T08:37:45.323 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026946079999999998 2024-02-10T08:37:45.323 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:45.323 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:45.323 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:37:45.323 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:37:45.311465+0000", 2024-02-10T08:37:45.323 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00099926599999999996 2024-02-10T08:37:45.323 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:45.323 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:45.324 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:37:45.324 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:37:45.312465+0000", 2024-02-10T08:37:45.324 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0041621339999999996 2024-02-10T08:37:45.324 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:37:45.324 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:37:45.324 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:37:45.324 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:45.324 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:45.324 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.25664.0:76235 11.a 11:5768822e:::benchmark_data_smithi018_166993_object76234:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected e410)", 2024-02-10T08:37:45.324 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:37:45.315044+0000", 2024-02-10T08:37:45.324 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0041493119999999996, 2024-02-10T08:37:45.324 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00423428, 2024-02-10T08:37:45.324 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:37:45.324 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "waiting for sub ops", 2024-02-10T08:37:45.325 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:37:45.325 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.25664", 2024-02-10T08:37:45.325 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/1087272222", 2024-02-10T08:37:45.325 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 76235 2024-02-10T08:37:45.325 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:45.325 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:37:45.325 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:45.325 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:37:45.325 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:37:45.315044+0000", 2024-02-10T08:37:45.325 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:37:45.325 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:45.325 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:45.325 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:37:45.325 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:37:45.315044+0000", 2024-02-10T08:37:45.325 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-02-10T08:37:45.326 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:45.326 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:45.326 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:37:45.326 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:37:45.315043+0000", 2024-02-10T08:37:45.326 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0433999999999999e-05 2024-02-10T08:37:45.326 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:45.326 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:45.326 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:37:45.326 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:37:45.315083+0000", 2024-02-10T08:37:45.326 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7650000000000005e-06 2024-02-10T08:37:45.326 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:45.326 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:45.326 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:37:45.326 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:37:45.315093+0000", 2024-02-10T08:37:45.326 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6580000000000001e-06 2024-02-10T08:37:45.326 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:45.327 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:45.327 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:37:45.327 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:37:45.315098+0000", 2024-02-10T08:37:45.327 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0756000000000001e-05 2024-02-10T08:37:45.327 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:45.327 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:45.327 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:37:45.327 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:37:45.315139+0000", 2024-02-10T08:37:45.327 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014929 2024-02-10T08:37:45.327 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:45.327 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:45.327 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:37:45.327 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:37:45.315288+0000", 2024-02-10T08:37:45.327 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000168896 2024-02-10T08:37:45.327 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:45.327 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:45.328 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3,6", 2024-02-10T08:37:45.328 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:37:45.315457+0000", 2024-02-10T08:37:45.328 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027152919999999998 2024-02-10T08:37:45.328 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:45.328 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:45.328 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:37:45.328 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:37:45.318172+0000", 2024-02-10T08:37:45.328 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000223296 2024-02-10T08:37:45.328 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:45.328 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:45.328 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:37:45.328 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:37:45.318395+0000", 2024-02-10T08:37:45.328 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033513359999999999 2024-02-10T08:37:45.328 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:37:45.328 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:37:45.329 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:37:45.329 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:37:45.329 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-02-10T08:37:45.329 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 2 2024-02-10T08:37:45.329 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-02-10T08:37:45.329 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:45.340 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:37:45.379 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:37:45.419 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:37:45.462 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:37:45.503 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:37:45.517 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-10T08:37:45.517 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-10T08:37:45.517 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-10T08:37:45.517 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-10T08:37:45.517 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-10T08:37:45.518 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-10T08:37:45.518 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-10T08:37:45.518 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-10T08:37:45.524 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 48 16 76438 76422 99.4644 67.3125 0.0140195 0.0100491 2024-02-10T08:37:45.547 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:44.304215+0000 mon.a (mon.0) 1701 : cluster [DBG] osdmap e410: 8 total, 8 up, 8 in 2024-02-10T08:37:45.547 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:44.440308+0000 osd.1 (osd.1) 286 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:37:45.547 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:44.440364+0000 osd.1 (osd.1) 287 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:37:45.547 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:37:45.097807+0000 mon.a (mon.0) 1702 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "device_health_metrics", "var": "pgp_num_actual", "val": "11"}]: dispatch 2024-02-10T08:37:45.547 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:37:45.187257+0000 mon.b (mon.1) 90 : audit [DBG] from='client.? 172.21.15.18:0/3778926651' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:37:45.547 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:44.304215+0000 mon.a (mon.0) 1701 : cluster [DBG] osdmap e410: 8 total, 8 up, 8 in 2024-02-10T08:37:45.548 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:44.440308+0000 osd.1 (osd.1) 286 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:37:45.548 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:44.440364+0000 osd.1 (osd.1) 287 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:37:45.548 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:37:45.097807+0000 mon.a (mon.0) 1702 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "device_health_metrics", "var": "pgp_num_actual", "val": "11"}]: dispatch 2024-02-10T08:37:45.548 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:37:45.187257+0000 mon.b (mon.1) 90 : audit [DBG] from='client.? 172.21.15.18:0/3778926651' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:37:45.707 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:44.304215+0000 mon.a (mon.0) 1701 : cluster [DBG] osdmap e410: 8 total, 8 up, 8 in 2024-02-10T08:37:45.707 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:44.440308+0000 osd.1 (osd.1) 286 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:37:45.708 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:44.440364+0000 osd.1 (osd.1) 287 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:37:45.708 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:37:45.097807+0000 mon.a (mon.0) 1702 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "device_health_metrics", "var": "pgp_num_actual", "val": "11"}]: dispatch 2024-02-10T08:37:45.708 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:37:45.187257+0000 mon.b (mon.1) 90 : audit [DBG] from='client.? 172.21.15.18:0/3778926651' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:37:45.803 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:37:45.809 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:45.809 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:37:45.910 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:37:46.007 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:46.525 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 49 16 77488 77472 98.7716 65.625 0.00475338 0.0101187 2024-02-10T08:37:46.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:45.096480+0000 mgr.y (mgr.14505) 788 : cluster [DBG] pgmap v963: 178 pgs: 10 unknown, 168 active+clean; 4.5 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 853 B/s rd, 61 MiB/s wr, 975 op/s 2024-02-10T08:37:46.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:37:45.345650+0000 mon.a (mon.0) 1703 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "device_health_metrics", "var": "pgp_num_actual", "val": "11"}]': finished 2024-02-10T08:37:46.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:45.345718+0000 mon.a (mon.0) 1704 : cluster [DBG] osdmap e411: 8 total, 8 up, 8 in 2024-02-10T08:37:46.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:45.967044+0000 mon.a (mon.0) 1705 : cluster [DBG] osdmap e412: 8 total, 8 up, 8 in 2024-02-10T08:37:46.658 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:45.096480+0000 mgr.y (mgr.14505) 788 : cluster [DBG] pgmap v963: 178 pgs: 10 unknown, 168 active+clean; 4.5 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 853 B/s rd, 61 MiB/s wr, 975 op/s 2024-02-10T08:37:46.658 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:37:45.345650+0000 mon.a (mon.0) 1703 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "device_health_metrics", "var": "pgp_num_actual", "val": "11"}]': finished 2024-02-10T08:37:46.658 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:45.345718+0000 mon.a (mon.0) 1704 : cluster [DBG] osdmap e411: 8 total, 8 up, 8 in 2024-02-10T08:37:46.658 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:45.967044+0000 mon.a (mon.0) 1705 : cluster [DBG] osdmap e412: 8 total, 8 up, 8 in 2024-02-10T08:37:46.789 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:37:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:37:46] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:37:46.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:45.096480+0000 mgr.y (mgr.14505) 788 : cluster [DBG] pgmap v963: 178 pgs: 10 unknown, 168 active+clean; 4.5 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 853 B/s rd, 61 MiB/s wr, 975 op/s 2024-02-10T08:37:46.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:37:45.345650+0000 mon.a (mon.0) 1703 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "device_health_metrics", "var": "pgp_num_actual", "val": "11"}]': finished 2024-02-10T08:37:46.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:45.345718+0000 mon.a (mon.0) 1704 : cluster [DBG] osdmap e411: 8 total, 8 up, 8 in 2024-02-10T08:37:46.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:45.967044+0000 mon.a (mon.0) 1705 : cluster [DBG] osdmap e412: 8 total, 8 up, 8 in 2024-02-10T08:37:47.072 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.5 dump_blocked_ops 2024-02-10T08:37:47.081 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:37:47.084 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:47.084 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:37:47.185 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:37:47.261 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:47.275 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 3, 4, 5, 6, 7, 0] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 5, 6, 7, 4] 2024-02-10T08:37:47.275 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-10T08:37:47.276 INFO:tasks.thrashosds.thrasher:inject_pause on osd.4 2024-02-10T08:37:47.276 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-02-10T08:37:47.276 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-02-10T08:37:47.276 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.4 config set filestore_inject_stall 3 2024-02-10T08:37:47.321 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:37:47.330 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:47.331 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:37:47.404 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:37:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:37:47] "GET /metrics HTTP/1.1" 200 176668 "" "Prometheus/2.33.4" 2024-02-10T08:37:47.432 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:37:47.512 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:47.526 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 50 16 78453 78437 98.0025 60.3125 0.00429015 0.0101984 2024-02-10T08:37:47.546 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:37:47.550 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:37:47.558 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:47.559 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:37:47.660 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:37:47.696 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:47.907 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:37:47.936 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:47.937 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:37:48.038 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:37:48.084 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:48.121 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:37:48.125 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:48.126 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:37:48.227 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:37:48.269 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:48.384 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:47.096955+0000 mgr.y (mgr.14505) 789 : cluster [DBG] pgmap v966: 178 pgs: 10 unknown, 168 active+clean; 4.5 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 16 MiB/s wr, 248 op/s 2024-02-10T08:37:48.384 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:37:47.724548+0000 mon.c (mon.2) 95 : audit [INF] from='client.? 172.21.15.18:0/581377374' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:37:48.384 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:37:47.725064+0000 mon.a (mon.0) 1706 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:37:48.415 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is set 2024-02-10T08:37:48.428 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:37:48.432 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:48.432 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:37:48.526 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 51 16 79565 79549 97.4437 69.5 0.0118077 0.0102575 2024-02-10T08:37:48.533 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:37:48.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:47.096955+0000 mgr.y (mgr.14505) 789 : cluster [DBG] pgmap v966: 178 pgs: 10 unknown, 168 active+clean; 4.5 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 16 MiB/s wr, 248 op/s 2024-02-10T08:37:48.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:37:47.724548+0000 mon.c (mon.2) 95 : audit [INF] from='client.? 172.21.15.18:0/581377374' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:37:48.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:37:47.725064+0000 mon.a (mon.0) 1706 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:37:48.577 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:48.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:47.096955+0000 mgr.y (mgr.14505) 789 : cluster [DBG] pgmap v966: 178 pgs: 10 unknown, 168 active+clean; 4.5 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 16 MiB/s wr, 248 op/s 2024-02-10T08:37:48.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:37:47.724548+0000 mon.c (mon.2) 95 : audit [INF] from='client.? 172.21.15.18:0/581377374' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:37:48.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:37:47.725064+0000 mon.a (mon.0) 1706 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:37:48.701 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-10T08:37:48.797 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:37:48.803 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:48.803 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:37:48.831 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:37:48.839 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:37:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:37:48.904 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:37:48.947 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:49.399 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:37:49.405 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:49.405 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:37:49.506 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:37:49.526 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 52 16 80660 80644 96.8858 68.4375 0.0255771 0.0103169 2024-02-10T08:37:49.561 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:49.593 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:37:49.607 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:37:49.614 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:49.614 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:37:49.644 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:49 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:48.364819+0000 mon.a (mon.0) 1707 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:37:49.645 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:49 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:37:48.373346+0000 mon.a (mon.0) 1708 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-10T08:37:49.645 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:49 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:48.373410+0000 mon.a (mon.0) 1709 : cluster [DBG] osdmap e413: 8 total, 8 up, 8 in 2024-02-10T08:37:49.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:48.364819+0000 mon.a (mon.0) 1707 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:37:49.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:37:48.373346+0000 mon.a (mon.0) 1708 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-10T08:37:49.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:48.373410+0000 mon.a (mon.0) 1709 : cluster [DBG] osdmap e413: 8 total, 8 up, 8 in 2024-02-10T08:37:49.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:48.364819+0000 mon.a (mon.0) 1707 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:37:49.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:37:48.373346+0000 mon.a (mon.0) 1708 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-10T08:37:49.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:48.373410+0000 mon.a (mon.0) 1709 : cluster [DBG] osdmap e413: 8 total, 8 up, 8 in 2024-02-10T08:37:49.715 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:37:49.769 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:50.437 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:37:50.440 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:50.440 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:37:50.527 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 53 16 81776 81760 96.3725 69.75 0.00844291 0.0103716 2024-02-10T08:37:50.541 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:37:50.607 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:37:48.838152+0000 mgr.y (mgr.14505) 790 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:37:50.607 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:49.097470+0000 mgr.y (mgr.14505) 791 : cluster [DBG] pgmap v968: 178 pgs: 1 unknown, 177 active+clean; 4.8 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 1.0 KiB/s rd, 68 MiB/s wr, 1.09k op/s 2024-02-10T08:37:50.608 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:37:48.838152+0000 mgr.y (mgr.14505) 790 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:37:50.608 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:49.097470+0000 mgr.y (mgr.14505) 791 : cluster [DBG] pgmap v968: 178 pgs: 1 unknown, 177 active+clean; 4.8 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 1.0 KiB/s rd, 68 MiB/s wr, 1.09k op/s 2024-02-10T08:37:50.615 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:50.668 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:37:50.670 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:50.671 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:37:50.771 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:37:50.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:37:48.838152+0000 mgr.y (mgr.14505) 790 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:37:50.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:49.097470+0000 mgr.y (mgr.14505) 791 : cluster [DBG] pgmap v968: 178 pgs: 1 unknown, 177 active+clean; 4.8 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 1.0 KiB/s rd, 68 MiB/s wr, 1.09k op/s 2024-02-10T08:37:50.855 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:50.888 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:37:50.904 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:50.905 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:37:51.006 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:37:51.062 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:51.187 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:37:51.191 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:51.191 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:37:51.292 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:37:51.344 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:51.431 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd unset noscrub 2024-02-10T08:37:51.527 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 54 16 82847 82831 95.8275 66.9375 0.0336966 0.01043 2024-02-10T08:37:51.956 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:37:51.959 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:37:52.003 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:37:52.049 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:37:52.083 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:37:52.120 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:37:52.147 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:37:52.179 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:37:52.215 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:37:52.221 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-10T08:37:52.221 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-10T08:37:52.221 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-10T08:37:52.221 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-10T08:37:52.222 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-10T08:37:52.222 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-10T08:37:52.222 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-10T08:37:52.222 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-10T08:37:52.247 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:50.977438+0000 mon.a (mon.0) 1710 : cluster [DBG] osdmap e414: 8 total, 8 up, 8 in 2024-02-10T08:37:52.247 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:51.097811+0000 mgr.y (mgr.14505) 792 : cluster [DBG] pgmap v970: 178 pgs: 178 active+clean; 4.8 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 890 B/s rd, 57 MiB/s wr, 910 op/s 2024-02-10T08:37:52.248 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:37:51.918474+0000 mon.b (mon.1) 91 : audit [DBG] from='client.? 172.21.15.18:0/1448235205' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:37:52.248 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:50.977438+0000 mon.a (mon.0) 1710 : cluster [DBG] osdmap e414: 8 total, 8 up, 8 in 2024-02-10T08:37:52.248 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:51.097811+0000 mgr.y (mgr.14505) 792 : cluster [DBG] pgmap v970: 178 pgs: 178 active+clean; 4.8 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 890 B/s rd, 57 MiB/s wr, 910 op/s 2024-02-10T08:37:52.248 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:37:51.918474+0000 mon.b (mon.1) 91 : audit [DBG] from='client.? 172.21.15.18:0/1448235205' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:37:52.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:51 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:50.977438+0000 mon.a (mon.0) 1710 : cluster [DBG] osdmap e414: 8 total, 8 up, 8 in 2024-02-10T08:37:52.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:51 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:51.097811+0000 mgr.y (mgr.14505) 792 : cluster [DBG] pgmap v970: 178 pgs: 178 active+clean; 4.8 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 890 B/s rd, 57 MiB/s wr, 910 op/s 2024-02-10T08:37:52.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:51 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:37:51.918474+0000 mon.b (mon.1) 91 : audit [DBG] from='client.? 172.21.15.18:0/1448235205' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:37:52.414 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:37:52.417 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:52.418 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:37:52.518 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:37:52.519 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-02-10T08:37:52.519 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:37:52.527 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 55 16 83775 83759 95.1399 58 0.00486893 0.0105062 2024-02-10T08:37:52.577 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:52.715 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:37:52.727 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:52.727 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:37:52.828 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:37:52.866 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:53.527 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 56 16 84913 84897 94.7111 71.125 0.00907651 0.0105532 2024-02-10T08:37:53.580 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:37:53.589 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:53.589 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:37:53.597 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.5 dump_historic_ops 2024-02-10T08:37:53.691 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:37:53.740 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:53.781 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:37:53.788 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:53.788 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:37:53.889 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:37:53.942 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:54.159 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:37:54.165 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:54.165 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:37:54.171 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:54 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:53.100181+0000 mgr.y (mgr.14505) 793 : cluster [DBG] pgmap v971: 178 pgs: 178 active+clean; 5.1 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 1.4 KiB/s rd, 84 MiB/s wr, 1.34k op/s 2024-02-10T08:37:54.266 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:37:54.304 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-02-10T08:37:54.304 INFO:teuthology.orchestra.run.smithi071.stdout: "success": "" 2024-02-10T08:37:54.304 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-02-10T08:37:54.341 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:54.349 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:37:54.527 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 57 16 85970 85954 94.2086 66.0625 0.0156544 0.0106099 2024-02-10T08:37:54.572 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:37:54.582 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:54.582 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:37:54.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:53.100181+0000 mgr.y (mgr.14505) 793 : cluster [DBG] pgmap v971: 178 pgs: 178 active+clean; 5.1 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 1.4 KiB/s rd, 84 MiB/s wr, 1.34k op/s 2024-02-10T08:37:54.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:53.100181+0000 mgr.y (mgr.14505) 793 : cluster [DBG] pgmap v971: 178 pgs: 178 active+clean; 5.1 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 1.4 KiB/s rd, 84 MiB/s wr, 1.34k op/s 2024-02-10T08:37:54.683 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:37:54.741 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:54.882 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:37:54.888 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:54.888 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:37:54.989 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:37:55.049 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:55.082 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:37:55.089 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:55.090 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:37:55.191 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:37:55.281 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:55.312 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:37:55.316 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:55.316 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:37:55.417 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:37:55.483 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:55.517 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:37:55.527 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:55.527 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:37:55.528 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 58 16 86981 86965 93.6738 63.1875 0.0214559 0.0106707 2024-02-10T08:37:55.628 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:37:55.669 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:55.956 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:37:55.962 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:55.962 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:37:56.016 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is unset 2024-02-10T08:37:56.063 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:37:56.122 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:56.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:55.101223+0000 mgr.y (mgr.14505) 794 : cluster [DBG] pgmap v972: 178 pgs: 178 active+clean; 5.2 GiB data, 22 GiB used, 694 GiB / 715 GiB avail; 1.2 KiB/s rd, 83 MiB/s wr, 1.32k op/s 2024-02-10T08:37:56.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:37:55.371095+0000 mon.a (mon.0) 1711 : audit [INF] from='client.? 172.21.15.18:0/2790841111' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:37:56.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:55.967174+0000 mon.a (mon.0) 1712 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:37:56.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:37:55.983845+0000 mon.a (mon.0) 1713 : audit [INF] from='client.? 172.21.15.18:0/2790841111' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-10T08:37:56.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:55.983902+0000 mon.a (mon.0) 1714 : cluster [DBG] osdmap e415: 8 total, 8 up, 8 in 2024-02-10T08:37:56.349 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:37:56.354 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:56.355 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:37:56.355 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:55.101223+0000 mgr.y (mgr.14505) 794 : cluster [DBG] pgmap v972: 178 pgs: 178 active+clean; 5.2 GiB data, 22 GiB used, 694 GiB / 715 GiB avail; 1.2 KiB/s rd, 83 MiB/s wr, 1.32k op/s 2024-02-10T08:37:56.355 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:37:55.371095+0000 mon.a (mon.0) 1711 : audit [INF] from='client.? 172.21.15.18:0/2790841111' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:37:56.355 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:55.967174+0000 mon.a (mon.0) 1712 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:37:56.355 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:37:55.983845+0000 mon.a (mon.0) 1713 : audit [INF] from='client.? 172.21.15.18:0/2790841111' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-10T08:37:56.355 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:55.983902+0000 mon.a (mon.0) 1714 : cluster [DBG] osdmap e415: 8 total, 8 up, 8 in 2024-02-10T08:37:56.356 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:55.101223+0000 mgr.y (mgr.14505) 794 : cluster [DBG] pgmap v972: 178 pgs: 178 active+clean; 5.2 GiB data, 22 GiB used, 694 GiB / 715 GiB avail; 1.2 KiB/s rd, 83 MiB/s wr, 1.32k op/s 2024-02-10T08:37:56.356 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:37:55.371095+0000 mon.a (mon.0) 1711 : audit [INF] from='client.? 172.21.15.18:0/2790841111' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:37:56.356 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:55.967174+0000 mon.a (mon.0) 1712 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:37:56.356 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:37:55.983845+0000 mon.a (mon.0) 1713 : audit [INF] from='client.? 172.21.15.18:0/2790841111' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-10T08:37:56.356 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:55.983902+0000 mon.a (mon.0) 1714 : cluster [DBG] osdmap e415: 8 total, 8 up, 8 in 2024-02-10T08:37:56.456 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:37:56.506 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:56.527 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 59 16 88085 88069 93.2556 69 0.012943 0.0107184 2024-02-10T08:37:56.639 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:37:56.644 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:56.644 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:37:56.644 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:37:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:37:56] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:37:56.715 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-10T08:37:56.745 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:37:56.818 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:56.941 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:37:56.948 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:56.949 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:37:56.973 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-02-10T08:37:56.973 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-02-10T08:37:56.973 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-02-10T08:37:56.973 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-02-10T08:37:56.973 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:56.973 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.25369.0:101783 10.7 10:e4a15d79:::benchmark_data_smithi018_146618_object101782:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e364)", 2024-02-10T08:37:56.973 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:33:55.116517+0000", 2024-02-10T08:37:56.973 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 241.85130687500001, 2024-02-10T08:37:56.974 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0103348990000001, 2024-02-10T08:37:56.974 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:37:56.974 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-02-10T08:37:56.974 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:37:56.974 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.25369", 2024-02-10T08:37:56.974 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3974730810", 2024-02-10T08:37:56.974 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 101783 2024-02-10T08:37:56.974 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:56.974 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:37:56.974 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:56.974 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:37:56.974 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.116517+0000", 2024-02-10T08:37:56.974 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:37:56.974 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:56.974 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:56.974 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:37:56.975 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.116517+0000", 2024-02-10T08:37:56.975 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-02-10T08:37:56.975 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:56.975 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:56.975 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:37:56.975 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.116517+0000", 2024-02-10T08:37:56.975 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4681999999999998e-05 2024-02-10T08:37:56.975 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:56.975 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:56.975 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:37:56.975 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.116551+0000", 2024-02-10T08:37:56.975 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1040000000000003e-06 2024-02-10T08:37:56.975 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:56.975 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:56.976 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:37:56.976 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.116558+0000", 2024-02-10T08:37:56.976 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3510000000000001e-06 2024-02-10T08:37:56.976 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:56.976 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:56.976 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:37:56.976 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.116563+0000", 2024-02-10T08:37:56.976 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00085987800000000001 2024-02-10T08:37:56.976 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:56.976 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:56.976 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:37:56.976 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.117423+0000", 2024-02-10T08:37:56.976 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0278000000000001e-05 2024-02-10T08:37:56.976 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:56.977 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:56.977 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:37:56.977 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.117433+0000", 2024-02-10T08:37:56.977 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0076108349999999 2024-02-10T08:37:56.977 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:56.977 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:56.977 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:37:56.977 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.125044+0000", 2024-02-10T08:37:56.977 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0018082630000000001 2024-02-10T08:37:56.977 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:56.977 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:56.977 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:37:56.977 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.126852+0000", 2024-02-10T08:37:56.977 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0103348990000001 2024-02-10T08:37:56.977 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:37:56.977 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:37:56.978 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:37:56.978 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:56.978 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:56.978 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.25369.0:101814 10.7 10:e9db83c5:::benchmark_data_smithi018_146618_object101813:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e364)", 2024-02-10T08:37:56.978 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:33:55.145293+0000", 2024-02-10T08:37:56.978 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 241.82253113600001, 2024-02-10T08:37:56.978 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0147837390000001, 2024-02-10T08:37:56.978 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:37:56.978 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:37:56.978 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:37:56.978 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.25369", 2024-02-10T08:37:56.978 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3974730810", 2024-02-10T08:37:56.978 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 101814 2024-02-10T08:37:56.978 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:56.978 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:37:56.978 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:56.979 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:37:56.979 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.145293+0000", 2024-02-10T08:37:56.979 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:37:56.979 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:56.979 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:56.979 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:37:56.979 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.145293+0000", 2024-02-10T08:37:56.979 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999981 2024-02-10T08:37:56.979 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:56.979 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:56.979 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:37:56.979 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.145291+0000", 2024-02-10T08:37:56.979 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000101437 2024-02-10T08:37:56.979 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:56.979 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:56.979 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:37:56.979 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.145392+0000", 2024-02-10T08:37:56.980 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0837e-05 2024-02-10T08:37:56.980 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:56.980 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:56.980 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:37:56.980 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.145403+0000", 2024-02-10T08:37:56.980 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2360000000000004e-06 2024-02-10T08:37:56.980 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:56.980 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:56.980 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:37:56.980 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.145412+0000", 2024-02-10T08:37:56.980 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6314000000000003e-05 2024-02-10T08:37:56.980 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:56.980 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:56.980 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:37:56.980 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.145468+0000", 2024-02-10T08:37:56.981 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9430000000000006e-06 2024-02-10T08:37:56.981 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:56.981 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:56.981 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:37:56.981 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.145477+0000", 2024-02-10T08:37:56.981 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.98142100600000004 2024-02-10T08:37:56.981 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:56.981 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:56.981 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:37:56.981 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.126898+0000", 2024-02-10T08:37:56.981 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00046907600000000002 2024-02-10T08:37:56.981 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:56.981 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:56.981 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:37:56.981 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.127367+0000", 2024-02-10T08:37:56.981 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00031365700000000001 2024-02-10T08:37:56.981 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:56.982 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:56.982 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3,6", 2024-02-10T08:37:56.982 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.127681+0000", 2024-02-10T08:37:56.982 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.01576025 2024-02-10T08:37:56.982 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:56.982 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:56.982 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:37:56.982 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.143441+0000", 2024-02-10T08:37:56.982 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016491553999999999 2024-02-10T08:37:56.982 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:56.982 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:56.982 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:37:56.982 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.159932+0000", 2024-02-10T08:37:56.982 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5958999999999997e-05 2024-02-10T08:37:56.982 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:56.983 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:56.983 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:37:56.983 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.159988+0000", 2024-02-10T08:37:56.983 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.392e-05 2024-02-10T08:37:56.983 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:56.983 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:56.983 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:37:56.983 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.160032+0000", 2024-02-10T08:37:56.983 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4490000000000003e-05 2024-02-10T08:37:56.983 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:56.983 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:56.983 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:37:56.983 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.160077+0000", 2024-02-10T08:37:56.983 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0147837390000001 2024-02-10T08:37:56.983 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:37:56.983 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:37:56.984 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:37:56.984 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:56.984 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:56.984 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.25369.0:101815 10.7 10:ef1b4d81:::benchmark_data_smithi018_146618_object101814:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e364)", 2024-02-10T08:37:56.984 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:33:55.145429+0000", 2024-02-10T08:37:56.984 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 241.82239501000001, 2024-02-10T08:37:56.984 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.014827178, 2024-02-10T08:37:56.984 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:37:56.984 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:37:56.984 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:37:56.984 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.25369", 2024-02-10T08:37:56.984 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3974730810", 2024-02-10T08:37:56.984 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 101815 2024-02-10T08:37:56.984 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:56.985 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:37:56.985 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:56.985 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:37:56.985 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.145429+0000", 2024-02-10T08:37:56.985 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:37:56.985 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:56.985 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:56.985 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:37:56.985 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.145429+0000", 2024-02-10T08:37:56.985 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-02-10T08:37:56.985 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:56.985 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:56.985 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:37:56.985 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.145429+0000", 2024-02-10T08:37:56.985 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7679999999999998e-05 2024-02-10T08:37:56.986 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:56.986 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:56.986 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:37:56.986 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.145466+0000", 2024-02-10T08:37:56.986 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0509999999999999e-06 2024-02-10T08:37:56.986 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:56.986 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:56.986 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:37:56.986 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.145473+0000", 2024-02-10T08:37:56.986 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1989999999999997e-06 2024-02-10T08:37:56.986 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:56.986 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:56.986 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:37:56.986 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.145479+0000", 2024-02-10T08:37:56.987 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8124000000000002e-05 2024-02-10T08:37:56.987 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:56.987 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:56.987 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:37:56.987 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.145527+0000", 2024-02-10T08:37:56.987 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3070000000000008e-06 2024-02-10T08:37:56.987 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:56.987 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:56.987 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:37:56.987 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.145536+0000", 2024-02-10T08:37:56.987 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.98726820800000004 2024-02-10T08:37:56.987 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:56.987 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:56.987 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:37:56.988 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.132804+0000", 2024-02-10T08:37:56.988 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000129703 2024-02-10T08:37:56.988 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:56.988 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:56.988 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:37:56.988 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.132934+0000", 2024-02-10T08:37:56.988 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017958000000000001 2024-02-10T08:37:56.988 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:56.988 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:56.988 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3,6", 2024-02-10T08:37:56.988 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.133113+0000", 2024-02-10T08:37:56.988 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010333284999999999 2024-02-10T08:37:56.988 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:56.988 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:56.988 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:37:56.989 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.143447+0000", 2024-02-10T08:37:56.989 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.01651499 2024-02-10T08:37:56.989 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:56.989 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:56.989 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:37:56.989 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.159962+0000", 2024-02-10T08:37:56.989 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000206462 2024-02-10T08:37:56.989 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:56.989 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:56.989 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:37:56.989 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.160168+0000", 2024-02-10T08:37:56.989 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7333000000000002e-05 2024-02-10T08:37:56.989 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:56.989 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:56.990 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:37:56.990 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.160216+0000", 2024-02-10T08:37:56.990 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0768e-05 2024-02-10T08:37:56.990 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:56.990 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:56.990 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:37:56.990 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.160256+0000", 2024-02-10T08:37:56.990 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.014827178 2024-02-10T08:37:56.990 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:37:56.990 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:37:56.990 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:37:56.990 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:56.990 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:56.990 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.25369.0:101846 10.7 10:eff2007f:::benchmark_data_smithi018_146618_object101845:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e364)", 2024-02-10T08:37:56.990 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:33:55.169474+0000", 2024-02-10T08:37:56.990 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 241.79835043700001, 2024-02-10T08:37:56.991 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.99089400500000002, 2024-02-10T08:37:56.991 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:37:56.991 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:37:56.991 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:37:56.991 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.25369", 2024-02-10T08:37:56.991 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3974730810", 2024-02-10T08:37:56.991 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 101846 2024-02-10T08:37:56.991 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:56.991 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:37:56.991 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:56.991 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:37:56.991 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.169474+0000", 2024-02-10T08:37:56.991 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:37:56.991 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:56.991 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:56.992 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:37:56.992 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.169474+0000", 2024-02-10T08:37:56.992 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-02-10T08:37:56.992 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:56.992 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:56.992 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:37:56.992 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.169472+0000", 2024-02-10T08:37:56.992 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8122999999999999e-05 2024-02-10T08:37:56.992 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:56.992 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:56.992 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:37:56.992 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.169530+0000", 2024-02-10T08:37:56.992 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0489999999999993e-06 2024-02-10T08:37:56.992 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:56.993 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:56.993 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:37:56.993 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.169539+0000", 2024-02-10T08:37:56.993 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0480000000000004e-06 2024-02-10T08:37:56.993 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:56.993 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:56.993 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:37:56.993 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.169545+0000", 2024-02-10T08:37:56.993 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017094969999999999 2024-02-10T08:37:56.993 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:56.993 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:56.993 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:37:56.993 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.171255+0000", 2024-02-10T08:37:56.993 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.007e-05 2024-02-10T08:37:56.993 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:56.993 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:56.993 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:37:56.994 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.171265+0000", 2024-02-10T08:37:56.994 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.96395788400000004 2024-02-10T08:37:56.994 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:56.994 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:56.994 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:37:56.994 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.135223+0000", 2024-02-10T08:37:56.994 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013543600000000001 2024-02-10T08:37:56.994 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:56.994 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:56.994 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:37:56.994 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.135358+0000", 2024-02-10T08:37:56.994 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000169085 2024-02-10T08:37:56.994 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:56.994 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:56.994 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3,6", 2024-02-10T08:37:56.995 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.135527+0000", 2024-02-10T08:37:56.995 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010468376 2024-02-10T08:37:56.995 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:56.995 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:56.995 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:37:56.995 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.145996+0000", 2024-02-10T08:37:56.995 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014117489 2024-02-10T08:37:56.995 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:56.995 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:56.995 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:37:56.995 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.160113+0000", 2024-02-10T08:37:56.995 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017977299999999999 2024-02-10T08:37:56.995 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:56.995 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:56.996 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:37:56.996 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.160293+0000", 2024-02-10T08:37:56.996 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2746e-05 2024-02-10T08:37:56.996 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:56.996 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:56.996 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:37:56.996 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.160336+0000", 2024-02-10T08:37:56.996 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1930000000000001e-05 2024-02-10T08:37:56.996 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:56.996 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:56.996 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:37:56.996 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.160368+0000", 2024-02-10T08:37:56.996 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.99089400500000002 2024-02-10T08:37:56.996 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:37:56.996 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:37:56.997 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:37:56.997 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:56.997 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:56.997 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.25369.0:101849 10.7 10:ecb9ca2f:::benchmark_data_smithi018_146618_object101848:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e364)", 2024-02-10T08:37:56.997 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:33:55.176564+0000", 2024-02-10T08:37:56.997 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 241.79125986700001, 2024-02-10T08:37:56.997 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.98397636499999996, 2024-02-10T08:37:56.997 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:37:56.997 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:37:56.997 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:37:56.997 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.25369", 2024-02-10T08:37:56.997 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3974730810", 2024-02-10T08:37:56.997 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 101849 2024-02-10T08:37:56.997 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:56.997 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:37:56.997 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:56.998 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:37:56.998 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.176564+0000", 2024-02-10T08:37:56.998 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:37:56.998 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:56.998 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:56.998 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:37:56.998 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.176564+0000", 2024-02-10T08:37:56.998 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999981 2024-02-10T08:37:56.998 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:56.998 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:56.998 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:37:56.998 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.176562+0000", 2024-02-10T08:37:56.998 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9316e-05 2024-02-10T08:37:56.998 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:56.999 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:56.999 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:37:56.999 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.176612+0000", 2024-02-10T08:37:56.999 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0261999999999999e-05 2024-02-10T08:37:56.999 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:56.999 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:56.999 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:37:56.999 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.176622+0000", 2024-02-10T08:37:56.999 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7249999999999997e-06 2024-02-10T08:37:56.999 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:56.999 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:56.999 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:37:56.999 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.176627+0000", 2024-02-10T08:37:56.999 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2072e-05 2024-02-10T08:37:56.999 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:56.999 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.000 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:37:57.000 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.176669+0000", 2024-02-10T08:37:57.000 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6079999999999998e-06 2024-02-10T08:37:57.000 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.000 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.000 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:37:57.000 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.176676+0000", 2024-02-10T08:37:57.000 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.96144441400000002 2024-02-10T08:37:57.000 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.000 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.000 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:37:57.000 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.138121+0000", 2024-02-10T08:37:57.000 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000146508 2024-02-10T08:37:57.000 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.000 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.001 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:37:57.001 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.138267+0000", 2024-02-10T08:37:57.001 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000165878 2024-02-10T08:37:57.001 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.001 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.001 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3,6", 2024-02-10T08:37:57.001 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.138433+0000", 2024-02-10T08:37:57.001 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0075704989999999996 2024-02-10T08:37:57.001 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.001 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.001 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:37:57.001 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.146004+0000", 2024-02-10T08:37:57.001 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014137149999999999 2024-02-10T08:37:57.001 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.001 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.002 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:37:57.002 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.160141+0000", 2024-02-10T08:37:57.002 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00031616899999999999 2024-02-10T08:37:57.002 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.002 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.002 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:37:57.002 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.160457+0000", 2024-02-10T08:37:57.002 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2918999999999999e-05 2024-02-10T08:37:57.002 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.002 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.002 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:37:57.002 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.160510+0000", 2024-02-10T08:37:57.002 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0830999999999997e-05 2024-02-10T08:37:57.002 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.002 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.003 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:37:57.003 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.160541+0000", 2024-02-10T08:37:57.003 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.98397636499999996 2024-02-10T08:37:57.003 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:37:57.003 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:37:57.003 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:37:57.003 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.003 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.003 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.25369.0:101865 10.7 10:e41a1fa5:::benchmark_data_smithi018_146618_object101864:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e364)", 2024-02-10T08:37:57.003 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:33:55.190274+0000", 2024-02-10T08:37:57.003 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 241.77754994899999, 2024-02-10T08:37:57.003 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.97036537499999997, 2024-02-10T08:37:57.003 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:37:57.003 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:37:57.003 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:37:57.003 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.25369", 2024-02-10T08:37:57.004 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3974730810", 2024-02-10T08:37:57.004 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 101865 2024-02-10T08:37:57.004 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.004 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:37:57.004 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.004 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:37:57.004 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.190274+0000", 2024-02-10T08:37:57.004 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:37:57.004 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.004 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.004 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:37:57.004 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.190274+0000", 2024-02-10T08:37:57.004 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999981 2024-02-10T08:37:57.004 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.004 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.005 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:37:57.005 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.190272+0000", 2024-02-10T08:37:57.005 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7620999999999998e-05 2024-02-10T08:37:57.005 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.005 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.005 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:37:57.005 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.190310+0000", 2024-02-10T08:37:57.005 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6008e-05 2024-02-10T08:37:57.005 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.005 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.005 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:37:57.005 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.190326+0000", 2024-02-10T08:37:57.005 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6127999999999999e-05 2024-02-10T08:37:57.005 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.006 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.006 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:37:57.006 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.190342+0000", 2024-02-10T08:37:57.006 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5115999999999999e-05 2024-02-10T08:37:57.006 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.006 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.006 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:37:57.006 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.190397+0000", 2024-02-10T08:37:57.006 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5650000000000004e-06 2024-02-10T08:37:57.006 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.006 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.006 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:37:57.006 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.190405+0000", 2024-02-10T08:37:57.006 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.95029042900000005 2024-02-10T08:37:57.006 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.006 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.007 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:37:57.007 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.140695+0000", 2024-02-10T08:37:57.007 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012916699999999999 2024-02-10T08:37:57.007 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.007 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.007 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:37:57.007 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.140824+0000", 2024-02-10T08:37:57.007 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000186126 2024-02-10T08:37:57.007 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.007 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.007 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3,6", 2024-02-10T08:37:57.007 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.141010+0000", 2024-02-10T08:37:57.007 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010493817000000001 2024-02-10T08:37:57.007 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.007 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.007 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:37:57.008 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.151504+0000", 2024-02-10T08:37:57.008 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0088998270000000008 2024-02-10T08:37:57.008 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.008 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.008 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:37:57.008 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.160404+0000", 2024-02-10T08:37:57.008 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016820600000000001 2024-02-10T08:37:57.008 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.008 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.008 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:37:57.008 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.160572+0000", 2024-02-10T08:37:57.008 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7561999999999997e-05 2024-02-10T08:37:57.008 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.008 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.008 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:37:57.009 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.160610+0000", 2024-02-10T08:37:57.009 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9713000000000002e-05 2024-02-10T08:37:57.009 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.009 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.009 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:37:57.009 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.160640+0000", 2024-02-10T08:37:57.009 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.97036537499999997 2024-02-10T08:37:57.009 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:37:57.009 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:37:57.009 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:37:57.009 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.009 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.009 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.25369.0:101866 10.7 10:e17929f7:::benchmark_data_smithi018_146618_object101865:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e364)", 2024-02-10T08:37:57.009 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:33:55.191939+0000", 2024-02-10T08:37:57.009 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 241.775885354, 2024-02-10T08:37:57.009 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.96882600600000002, 2024-02-10T08:37:57.010 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:37:57.010 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:37:57.010 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:37:57.010 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.25369", 2024-02-10T08:37:57.010 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3974730810", 2024-02-10T08:37:57.010 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 101866 2024-02-10T08:37:57.010 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.010 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:37:57.010 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.010 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:37:57.010 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.191939+0000", 2024-02-10T08:37:57.010 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:37:57.010 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.010 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.010 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:37:57.010 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.191939+0000", 2024-02-10T08:37:57.011 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-02-10T08:37:57.011 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.011 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.011 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:37:57.011 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.191937+0000", 2024-02-10T08:37:57.011 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5713000000000001e-05 2024-02-10T08:37:57.011 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.011 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.011 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:37:57.011 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.191983+0000", 2024-02-10T08:37:57.011 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3045e-05 2024-02-10T08:37:57.011 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.011 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.011 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:37:57.011 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.191996+0000", 2024-02-10T08:37:57.012 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6379999999999998e-06 2024-02-10T08:37:57.012 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.012 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.012 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:37:57.012 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.192003+0000", 2024-02-10T08:37:57.012 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.206e-05 2024-02-10T08:37:57.012 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.012 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.012 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:37:57.012 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.192055+0000", 2024-02-10T08:37:57.012 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6129999999999993e-06 2024-02-10T08:37:57.012 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.012 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.012 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:37:57.013 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.192064+0000", 2024-02-10T08:37:57.013 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.95140941700000004 2024-02-10T08:37:57.013 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.013 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.013 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:37:57.013 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.143474+0000", 2024-02-10T08:37:57.013 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011635 2024-02-10T08:37:57.013 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.013 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.013 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:37:57.013 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.143590+0000", 2024-02-10T08:37:57.013 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017080099999999999 2024-02-10T08:37:57.013 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.013 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.013 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3,6", 2024-02-10T08:37:57.013 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.143761+0000", 2024-02-10T08:37:57.014 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010444281999999999 2024-02-10T08:37:57.014 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.014 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.014 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:37:57.014 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.154205+0000", 2024-02-10T08:37:57.014 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0064655820000000001 2024-02-10T08:37:57.014 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.014 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.014 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:37:57.014 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.160671+0000", 2024-02-10T08:37:57.014 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6440000000000001e-05 2024-02-10T08:37:57.014 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.014 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.014 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:37:57.014 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.160697+0000", 2024-02-10T08:37:57.014 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7379999999999998e-05 2024-02-10T08:37:57.014 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.015 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.015 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:37:57.015 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.160735+0000", 2024-02-10T08:37:57.015 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0006999999999999e-05 2024-02-10T08:37:57.015 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.015 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.015 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:37:57.015 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.160765+0000", 2024-02-10T08:37:57.015 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.96882600600000002 2024-02-10T08:37:57.015 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:37:57.015 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:37:57.015 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:37:57.015 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.015 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.016 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.25369.0:101878 10.7 10:e3fd396c:::benchmark_data_smithi018_146618_object101877:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e364)", 2024-02-10T08:37:57.016 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:33:55.203064+0000", 2024-02-10T08:37:57.016 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 241.764759658, 2024-02-10T08:37:57.016 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.95784935500000001, 2024-02-10T08:37:57.016 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:37:57.016 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:37:57.016 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:37:57.016 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.25369", 2024-02-10T08:37:57.016 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3974730810", 2024-02-10T08:37:57.016 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 101878 2024-02-10T08:37:57.016 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.016 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:37:57.016 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.016 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:37:57.017 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.203064+0000", 2024-02-10T08:37:57.017 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:37:57.017 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.017 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.017 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:37:57.017 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.203064+0000", 2024-02-10T08:37:57.017 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-02-10T08:37:57.017 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.017 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.017 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:37:57.017 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.203064+0000", 2024-02-10T08:37:57.017 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4662000000000001e-05 2024-02-10T08:37:57.017 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.017 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.017 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:37:57.017 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.203099+0000", 2024-02-10T08:37:57.017 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7190000000000001e-06 2024-02-10T08:37:57.018 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.018 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.018 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:37:57.018 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.203103+0000", 2024-02-10T08:37:57.018 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.971e-06 2024-02-10T08:37:57.018 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.018 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.018 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:37:57.018 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.203106+0000", 2024-02-10T08:37:57.018 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7176999999999999e-05 2024-02-10T08:37:57.018 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.018 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.018 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:37:57.018 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.203153+0000", 2024-02-10T08:37:57.018 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0003999999999999e-05 2024-02-10T08:37:57.018 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.019 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.019 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:37:57.019 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.203164+0000", 2024-02-10T08:37:57.019 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.94288002199999998 2024-02-10T08:37:57.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.019 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.019 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:37:57.019 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.146044+0000", 2024-02-10T08:37:57.019 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000117509 2024-02-10T08:37:57.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.019 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.019 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:37:57.019 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.146161+0000", 2024-02-10T08:37:57.019 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016699799999999999 2024-02-10T08:37:57.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.019 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.020 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3,6", 2024-02-10T08:37:57.020 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.146328+0000", 2024-02-10T08:37:57.020 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0078840939999999995 2024-02-10T08:37:57.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.020 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.020 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:37:57.020 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.154212+0000", 2024-02-10T08:37:57.020 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0065843890000000004 2024-02-10T08:37:57.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.020 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.020 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:37:57.020 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.160797+0000", 2024-02-10T08:37:57.020 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3508999999999999e-05 2024-02-10T08:37:57.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.021 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:37:57.021 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.160850+0000", 2024-02-10T08:37:57.021 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4020000000000003e-05 2024-02-10T08:37:57.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.021 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:37:57.021 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.160884+0000", 2024-02-10T08:37:57.021 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9754999999999999e-05 2024-02-10T08:37:57.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.021 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:37:57.021 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.160914+0000", 2024-02-10T08:37:57.021 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.95784935500000001 2024-02-10T08:37:57.021 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:37:57.021 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:37:57.022 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:37:57.022 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.022 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.022 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.25369.0:101894 10.7 10:ee82d9f2:::benchmark_data_smithi018_146618_object101893:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e364)", 2024-02-10T08:37:57.022 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:33:55.219082+0000", 2024-02-10T08:37:57.022 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 241.74874223899999, 2024-02-10T08:37:57.022 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.94469668399999995, 2024-02-10T08:37:57.022 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:37:57.022 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:37:57.022 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:37:57.022 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.25369", 2024-02-10T08:37:57.022 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3974730810", 2024-02-10T08:37:57.022 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 101894 2024-02-10T08:37:57.022 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.022 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:37:57.023 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.023 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:37:57.023 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.219082+0000", 2024-02-10T08:37:57.023 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:37:57.023 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.023 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.023 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:37:57.023 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.219082+0000", 2024-02-10T08:37:57.023 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-02-10T08:37:57.023 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.023 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.023 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:37:57.023 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.219080+0000", 2024-02-10T08:37:57.023 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0769000000000001e-05 2024-02-10T08:37:57.023 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.023 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.024 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:37:57.024 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.219131+0000", 2024-02-10T08:37:57.024 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0696999999999999e-05 2024-02-10T08:37:57.024 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.024 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.024 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:37:57.024 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.219142+0000", 2024-02-10T08:37:57.024 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.691e-06 2024-02-10T08:37:57.024 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.024 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.024 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:37:57.024 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.219149+0000", 2024-02-10T08:37:57.024 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3689e-05 2024-02-10T08:37:57.024 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.025 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:37:57.025 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.219202+0000", 2024-02-10T08:37:57.025 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6459999999999993e-06 2024-02-10T08:37:57.025 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.025 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:37:57.025 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.219210+0000", 2024-02-10T08:37:57.025 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.92956036399999997 2024-02-10T08:37:57.025 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.025 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:37:57.025 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.148770+0000", 2024-02-10T08:37:57.025 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000145501 2024-02-10T08:37:57.025 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.026 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:37:57.026 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.148916+0000", 2024-02-10T08:37:57.026 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000114817 2024-02-10T08:37:57.026 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.026 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.026 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3,6", 2024-02-10T08:37:57.026 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.149031+0000", 2024-02-10T08:37:57.026 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011793191 2024-02-10T08:37:57.026 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.026 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.026 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:37:57.026 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.160824+0000", 2024-02-10T08:37:57.026 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000149794 2024-02-10T08:37:57.026 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.026 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.027 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:37:57.027 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.160974+0000", 2024-02-10T08:37:57.027 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027213070000000001 2024-02-10T08:37:57.027 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.027 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.027 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:37:57.027 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.163695+0000", 2024-02-10T08:37:57.027 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5599000000000002e-05 2024-02-10T08:37:57.027 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.027 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.027 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:37:57.027 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.163740+0000", 2024-02-10T08:37:57.027 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8098e-05 2024-02-10T08:37:57.027 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.027 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.028 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:37:57.028 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.163779+0000", 2024-02-10T08:37:57.028 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.94469668399999995 2024-02-10T08:37:57.028 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:37:57.028 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:37:57.028 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:37:57.028 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.028 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.028 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.25369.0:101898 10.7 10:e020ab6a:::benchmark_data_smithi018_146618_object101897:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e364)", 2024-02-10T08:37:57.028 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:33:55.223123+0000", 2024-02-10T08:37:57.028 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 241.74470090700001, 2024-02-10T08:37:57.028 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.94077807099999999, 2024-02-10T08:37:57.028 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:37:57.029 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:37:57.029 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:37:57.029 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.25369", 2024-02-10T08:37:57.029 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3974730810", 2024-02-10T08:37:57.029 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 101898 2024-02-10T08:37:57.029 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.029 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:37:57.029 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.029 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:37:57.029 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.223123+0000", 2024-02-10T08:37:57.029 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:37:57.029 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.029 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.029 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:37:57.029 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.223123+0000", 2024-02-10T08:37:57.029 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999971 2024-02-10T08:37:57.030 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.030 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.030 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:37:57.030 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.223120+0000", 2024-02-10T08:37:57.030 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6305999999999999e-05 2024-02-10T08:37:57.030 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.030 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.030 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:37:57.030 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.223177+0000", 2024-02-10T08:37:57.030 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5791999999999998e-05 2024-02-10T08:37:57.030 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.030 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.030 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:37:57.030 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.223223+0000", 2024-02-10T08:37:57.030 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6707999999999999e-05 2024-02-10T08:37:57.030 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.031 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.031 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:37:57.031 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.223249+0000", 2024-02-10T08:37:57.031 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0163000000000002e-05 2024-02-10T08:37:57.031 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.031 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.031 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:37:57.031 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.223289+0000", 2024-02-10T08:37:57.031 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0249999999999997e-06 2024-02-10T08:37:57.031 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.031 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.031 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:37:57.031 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.223296+0000", 2024-02-10T08:37:57.031 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.92823433799999999 2024-02-10T08:37:57.031 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.031 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.032 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:37:57.032 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.151531+0000", 2024-02-10T08:37:57.032 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012535500000000001 2024-02-10T08:37:57.032 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.032 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.032 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:37:57.032 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.151656+0000", 2024-02-10T08:37:57.032 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018232799999999999 2024-02-10T08:37:57.032 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.032 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.032 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3,6", 2024-02-10T08:37:57.032 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.151838+0000", 2024-02-10T08:37:57.032 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0091084749999999996 2024-02-10T08:37:57.032 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.032 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.033 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:37:57.033 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.160947+0000", 2024-02-10T08:37:57.033 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7479999999999999e-05 2024-02-10T08:37:57.033 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.033 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.033 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:37:57.033 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.161004+0000", 2024-02-10T08:37:57.033 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028165030000000001 2024-02-10T08:37:57.033 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.033 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.033 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:37:57.033 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.163821+0000", 2024-02-10T08:37:57.033 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4243000000000003e-05 2024-02-10T08:37:57.033 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.033 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.033 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:37:57.033 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.163865+0000", 2024-02-10T08:37:57.034 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6090999999999997e-05 2024-02-10T08:37:57.034 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.034 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.034 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:37:57.034 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.163901+0000", 2024-02-10T08:37:57.034 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.94077807099999999 2024-02-10T08:37:57.034 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:37:57.034 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:37:57.034 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:37:57.034 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.034 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.034 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.25369.0:101936 10.7 10:e21ec562:::benchmark_data_smithi018_146618_object101935:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e364)", 2024-02-10T08:37:57.034 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:33:55.284689+0000", 2024-02-10T08:37:57.034 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 241.68313475799999, 2024-02-10T08:37:57.034 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.87937318600000003, 2024-02-10T08:37:57.034 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:37:57.035 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:37:57.035 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:37:57.035 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.25369", 2024-02-10T08:37:57.035 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3974730810", 2024-02-10T08:37:57.035 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 101936 2024-02-10T08:37:57.035 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.035 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:37:57.035 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.035 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:37:57.035 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.284689+0000", 2024-02-10T08:37:57.035 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:37:57.035 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.035 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.035 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:37:57.035 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.284689+0000", 2024-02-10T08:37:57.035 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999981 2024-02-10T08:37:57.035 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.036 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.036 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:37:57.036 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.284687+0000", 2024-02-10T08:37:57.036 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2449e-05 2024-02-10T08:37:57.036 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.036 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.036 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:37:57.036 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.284730+0000", 2024-02-10T08:37:57.036 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3237999999999999e-05 2024-02-10T08:37:57.036 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.036 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.036 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:37:57.036 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.284743+0000", 2024-02-10T08:37:57.036 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1509999999999998e-06 2024-02-10T08:37:57.036 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.037 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.037 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:37:57.037 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.284750+0000", 2024-02-10T08:37:57.037 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2861999999999995e-05 2024-02-10T08:37:57.037 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.037 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.037 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:37:57.037 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.284813+0000", 2024-02-10T08:37:57.037 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6369999999999999e-06 2024-02-10T08:37:57.037 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.037 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.037 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:37:57.037 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.284821+0000", 2024-02-10T08:37:57.037 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.86943136099999996 2024-02-10T08:37:57.038 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.038 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:37:57.038 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.154252+0000", 2024-02-10T08:37:57.038 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012684999999999999 2024-02-10T08:37:57.038 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.038 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:37:57.038 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.154379+0000", 2024-02-10T08:37:57.038 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000166119 2024-02-10T08:37:57.038 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.038 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3,6", 2024-02-10T08:37:57.038 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.154545+0000", 2024-02-10T08:37:57.038 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.009268989 2024-02-10T08:37:57.039 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.039 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.039 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:37:57.039 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.163814+0000", 2024-02-10T08:37:57.039 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4512000000000006e-05 2024-02-10T08:37:57.039 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.039 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.039 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:37:57.039 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.163909+0000", 2024-02-10T08:37:57.039 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6211000000000005e-05 2024-02-10T08:37:57.039 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.039 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.039 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:37:57.039 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.163995+0000", 2024-02-10T08:37:57.039 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7185999999999999e-05 2024-02-10T08:37:57.040 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.040 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.040 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:37:57.040 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.164032+0000", 2024-02-10T08:37:57.040 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0497999999999998e-05 2024-02-10T08:37:57.040 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.040 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.040 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:37:57.040 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.164063+0000", 2024-02-10T08:37:57.040 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.87937318600000003 2024-02-10T08:37:57.040 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:37:57.040 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:37:57.040 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:37:57.040 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.040 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.041 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.25369.0:101940 10.7 10:e740a410:::benchmark_data_smithi018_146618_object101939:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e364)", 2024-02-10T08:37:57.041 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:33:55.291905+0000", 2024-02-10T08:37:57.041 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 241.675918658, 2024-02-10T08:37:57.041 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.872249418, 2024-02-10T08:37:57.041 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:37:57.041 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:37:57.041 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:37:57.041 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.25369", 2024-02-10T08:37:57.041 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3974730810", 2024-02-10T08:37:57.041 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 101940 2024-02-10T08:37:57.041 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.041 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:37:57.041 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.041 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:37:57.041 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.291905+0000", 2024-02-10T08:37:57.042 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:37:57.042 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.042 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.042 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:37:57.042 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.291905+0000", 2024-02-10T08:37:57.042 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-02-10T08:37:57.042 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.042 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.042 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:37:57.042 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.291904+0000", 2024-02-10T08:37:57.042 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5670999999999999e-05 2024-02-10T08:37:57.042 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.042 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.042 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:37:57.042 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.291930+0000", 2024-02-10T08:37:57.043 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0188e-05 2024-02-10T08:37:57.043 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.043 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.043 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:37:57.043 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.291940+0000", 2024-02-10T08:37:57.043 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7979999999999996e-06 2024-02-10T08:37:57.043 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.043 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.043 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:37:57.043 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.291945+0000", 2024-02-10T08:37:57.043 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3257999999999997e-05 2024-02-10T08:37:57.043 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.043 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.043 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:37:57.043 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.291998+0000", 2024-02-10T08:37:57.044 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0494e-05 2024-02-10T08:37:57.044 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.044 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.044 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-02-10T08:37:57.044 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:55.292009+0000", 2024-02-10T08:37:57.044 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.864957478 2024-02-10T08:37:57.044 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.044 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.044 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:37:57.044 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.156966+0000", 2024-02-10T08:37:57.044 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011291299999999999 2024-02-10T08:37:57.044 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.044 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.044 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:37:57.044 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.157079+0000", 2024-02-10T08:37:57.045 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017466700000000001 2024-02-10T08:37:57.045 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.045 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.045 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3,6", 2024-02-10T08:37:57.045 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.157254+0000", 2024-02-10T08:37:57.045 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0066594039999999998 2024-02-10T08:37:57.045 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.045 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.045 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:37:57.045 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.163913+0000", 2024-02-10T08:37:57.045 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6725999999999999e-05 2024-02-10T08:37:57.045 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.045 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.045 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:37:57.045 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.163970+0000", 2024-02-10T08:37:57.046 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012032900000000001 2024-02-10T08:37:57.046 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.046 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.046 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:37:57.046 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.164090+0000", 2024-02-10T08:37:57.046 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3989999999999998e-05 2024-02-10T08:37:57.046 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.046 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.046 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:37:57.046 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.164124+0000", 2024-02-10T08:37:57.046 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0462000000000001e-05 2024-02-10T08:37:57.046 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.046 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.046 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:37:57.046 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:56.164155+0000", 2024-02-10T08:37:57.047 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.872249418 2024-02-10T08:37:57.047 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:37:57.047 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:37:57.047 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:37:57.047 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.047 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.047 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.25369.0:156812 10.7 10:e3b77a11:::benchmark_data_smithi018_146618_object33009:head [delete] snapc 0=[] ondisk+write+known_if_redirected e374)", 2024-02-10T08:37:57.047 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:34:47.986704+0000", 2024-02-10T08:37:57.047 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 188.981119855, 2024-02-10T08:37:57.047 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.13806186100000001, 2024-02-10T08:37:57.047 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:37:57.047 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:37:57.047 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:37:57.047 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.25369", 2024-02-10T08:37:57.047 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3974730810", 2024-02-10T08:37:57.047 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 156812 2024-02-10T08:37:57.048 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.048 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:37:57.048 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.048 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:37:57.048 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:47.986704+0000", 2024-02-10T08:37:57.048 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:37:57.048 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.048 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.048 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:37:57.048 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:47.986704+0000", 2024-02-10T08:37:57.048 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999981 2024-02-10T08:37:57.048 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.048 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.048 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:37:57.049 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:47.986702+0000", 2024-02-10T08:37:57.049 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5329999999999997e-06 2024-02-10T08:37:57.049 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.049 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.049 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:37:57.049 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:47.986710+0000", 2024-02-10T08:37:57.049 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3112000000000001e-05 2024-02-10T08:37:57.049 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.049 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.049 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:37:57.049 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:47.986723+0000", 2024-02-10T08:37:57.049 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6000000000000003e-06 2024-02-10T08:37:57.049 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.049 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.049 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:37:57.050 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:47.986730+0000", 2024-02-10T08:37:57.050 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0023809489999999998 2024-02-10T08:37:57.050 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.050 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.050 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:37:57.050 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:47.989111+0000", 2024-02-10T08:37:57.050 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000120417 2024-02-10T08:37:57.050 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.050 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.050 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:37:57.050 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:47.989231+0000", 2024-02-10T08:37:57.050 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012404399999999999 2024-02-10T08:37:57.050 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.050 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.050 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3,6", 2024-02-10T08:37:57.051 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:47.989355+0000", 2024-02-10T08:37:57.051 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0025598869999999998 2024-02-10T08:37:57.051 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.051 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.051 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:37:57.051 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:47.991915+0000", 2024-02-10T08:37:57.051 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0024651849999999999 2024-02-10T08:37:57.051 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.051 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.051 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:37:57.051 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:47.994380+0000", 2024-02-10T08:37:57.051 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.13028975200000001 2024-02-10T08:37:57.051 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.051 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.051 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:37:57.052 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:48.124670+0000", 2024-02-10T08:37:57.052 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6400000000000002e-05 2024-02-10T08:37:57.052 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.052 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.052 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:37:57.052 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:48.124726+0000", 2024-02-10T08:37:57.052 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9758000000000001e-05 2024-02-10T08:37:57.052 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.052 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.052 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:37:57.052 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:48.124766+0000", 2024-02-10T08:37:57.052 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.13806186100000001 2024-02-10T08:37:57.052 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:37:57.052 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:37:57.052 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:37:57.053 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.053 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.053 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.25369.0:159251 10.7 10:ef14481f:::benchmark_data_smithi018_146618_object35448:head [delete] snapc 0=[] ondisk+write+known_if_redirected e374)", 2024-02-10T08:37:57.053 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:34:50.827414+0000", 2024-02-10T08:37:57.053 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 186.14041016100001, 2024-02-10T08:37:57.053 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.130278701, 2024-02-10T08:37:57.053 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:37:57.053 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:37:57.053 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:37:57.053 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.25369", 2024-02-10T08:37:57.053 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3974730810", 2024-02-10T08:37:57.053 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 159251 2024-02-10T08:37:57.053 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.053 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:37:57.053 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.054 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:37:57.054 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:50.827414+0000", 2024-02-10T08:37:57.054 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:37:57.054 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.054 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.054 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:37:57.054 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:50.827414+0000", 2024-02-10T08:37:57.054 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999976 2024-02-10T08:37:57.054 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.054 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.054 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:37:57.054 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:50.827412+0000", 2024-02-10T08:37:57.054 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6109999999999994e-06 2024-02-10T08:37:57.054 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.054 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.054 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:37:57.055 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:50.827420+0000", 2024-02-10T08:37:57.055 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2509e-05 2024-02-10T08:37:57.055 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.055 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.055 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:37:57.055 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:50.827433+0000", 2024-02-10T08:37:57.055 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0700000000000001e-06 2024-02-10T08:37:57.055 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.055 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.055 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:37:57.055 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:50.827440+0000", 2024-02-10T08:37:57.055 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6137999999999997e-05 2024-02-10T08:37:57.055 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.055 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.055 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:37:57.055 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:50.827496+0000", 2024-02-10T08:37:57.056 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000118991 2024-02-10T08:37:57.056 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.056 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.056 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:37:57.056 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:50.827615+0000", 2024-02-10T08:37:57.056 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000130758 2024-02-10T08:37:57.056 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.056 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.056 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3,6", 2024-02-10T08:37:57.056 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:50.827746+0000", 2024-02-10T08:37:57.056 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030137229999999998 2024-02-10T08:37:57.056 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.056 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.056 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:37:57.056 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:50.830760+0000", 2024-02-10T08:37:57.057 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0053813869999999996 2024-02-10T08:37:57.057 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.057 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.057 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:37:57.057 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:50.836141+0000", 2024-02-10T08:37:57.057 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.121467898 2024-02-10T08:37:57.057 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.057 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.057 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:37:57.057 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:50.957609+0000", 2024-02-10T08:37:57.057 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6261000000000003e-05 2024-02-10T08:37:57.057 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.057 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.057 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:37:57.057 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:50.957655+0000", 2024-02-10T08:37:57.058 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7561999999999997e-05 2024-02-10T08:37:57.058 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.058 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.058 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:37:57.058 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:50.957693+0000", 2024-02-10T08:37:57.058 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.130278701 2024-02-10T08:37:57.058 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:37:57.058 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:37:57.058 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:37:57.058 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.058 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.058 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.25369.0:159386 10.7 10:e84097fc:::benchmark_data_smithi018_146618_object35583:head [delete] snapc 0=[] ondisk+write+known_if_redirected e374)", 2024-02-10T08:37:57.058 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:34:51.049093+0000", 2024-02-10T08:37:57.058 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 185.918731095, 2024-02-10T08:37:57.058 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.20611149300000001, 2024-02-10T08:37:57.058 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:37:57.058 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:37:57.059 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:37:57.059 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.25369", 2024-02-10T08:37:57.059 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3974730810", 2024-02-10T08:37:57.059 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 159386 2024-02-10T08:37:57.059 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.059 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:37:57.059 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.059 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:37:57.059 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:51.049093+0000", 2024-02-10T08:37:57.059 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:37:57.059 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.059 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.059 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:37:57.059 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:51.049093+0000", 2024-02-10T08:37:57.059 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-02-10T08:37:57.060 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.060 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.060 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:37:57.060 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:51.049091+0000", 2024-02-10T08:37:57.060 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7249999999999997e-06 2024-02-10T08:37:57.060 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.060 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.060 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:37:57.060 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:51.049099+0000", 2024-02-10T08:37:57.060 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1765e-05 2024-02-10T08:37:57.060 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.060 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.060 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:37:57.060 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:51.049111+0000", 2024-02-10T08:37:57.060 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5370000000000003e-06 2024-02-10T08:37:57.060 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.061 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.061 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:37:57.061 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:51.049117+0000", 2024-02-10T08:37:57.061 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010469800000000001 2024-02-10T08:37:57.061 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.061 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.061 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:37:57.061 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:51.049222+0000", 2024-02-10T08:37:57.061 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9557999999999998e-05 2024-02-10T08:37:57.061 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.061 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.061 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:37:57.061 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:51.049322+0000", 2024-02-10T08:37:57.061 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012657099999999999 2024-02-10T08:37:57.061 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.061 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.061 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3,6", 2024-02-10T08:37:57.062 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:51.049448+0000", 2024-02-10T08:37:57.062 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0047363939999999997 2024-02-10T08:37:57.062 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.062 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.062 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:37:57.062 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:51.054185+0000", 2024-02-10T08:37:57.062 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0055407269999999996 2024-02-10T08:37:57.062 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.062 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.062 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:37:57.062 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:51.059725+0000", 2024-02-10T08:37:57.062 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.195387903 2024-02-10T08:37:57.062 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.062 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.062 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:37:57.063 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:51.255113+0000", 2024-02-10T08:37:57.063 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9175000000000003e-05 2024-02-10T08:37:57.063 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.063 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.063 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:37:57.063 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:51.255162+0000", 2024-02-10T08:37:57.063 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2026e-05 2024-02-10T08:37:57.063 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.063 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.063 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:37:57.063 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:51.255204+0000", 2024-02-10T08:37:57.063 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.20611149300000001 2024-02-10T08:37:57.063 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:37:57.063 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:37:57.063 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:37:57.063 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.064 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.064 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.25369.0:159390 10.7 10:e0a23cc4:::benchmark_data_smithi018_146618_object35587:head [delete] snapc 0=[] ondisk+write+known_if_redirected e374)", 2024-02-10T08:37:57.064 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:34:51.050547+0000", 2024-02-10T08:37:57.064 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 185.91727679600001, 2024-02-10T08:37:57.064 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.20730405599999999, 2024-02-10T08:37:57.064 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:37:57.064 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:37:57.064 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:37:57.064 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.25369", 2024-02-10T08:37:57.064 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3974730810", 2024-02-10T08:37:57.064 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 159390 2024-02-10T08:37:57.064 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.064 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:37:57.065 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.065 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:37:57.065 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:51.050547+0000", 2024-02-10T08:37:57.065 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:37:57.065 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.065 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.065 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:37:57.065 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:51.050547+0000", 2024-02-10T08:37:57.065 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-02-10T08:37:57.065 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.065 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.065 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:37:57.065 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:51.050546+0000", 2024-02-10T08:37:57.065 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4239999999999998e-06 2024-02-10T08:37:57.065 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.065 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.066 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:37:57.066 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:51.050553+0000", 2024-02-10T08:37:57.066 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7259999999999997e-06 2024-02-10T08:37:57.066 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.066 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.066 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:37:57.066 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:51.050562+0000", 2024-02-10T08:37:57.066 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5600000000000001e-06 2024-02-10T08:37:57.066 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.066 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.066 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:37:57.066 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:51.050568+0000", 2024-02-10T08:37:57.066 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0010565609999999999 2024-02-10T08:37:57.066 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.066 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.066 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:37:57.067 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:51.051625+0000", 2024-02-10T08:37:57.067 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000111667 2024-02-10T08:37:57.067 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.067 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.067 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:37:57.067 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:51.051736+0000", 2024-02-10T08:37:57.067 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013041999999999999 2024-02-10T08:37:57.067 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.067 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.067 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3,6", 2024-02-10T08:37:57.067 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:51.051867+0000", 2024-02-10T08:37:57.067 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034796380000000002 2024-02-10T08:37:57.067 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.067 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.068 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:37:57.068 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:51.055346+0000", 2024-02-10T08:37:57.068 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0045256990000000002 2024-02-10T08:37:57.068 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.068 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.068 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:37:57.068 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:51.059872+0000", 2024-02-10T08:37:57.068 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.197924342 2024-02-10T08:37:57.068 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.068 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.068 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:37:57.068 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:51.257796+0000", 2024-02-10T08:37:57.068 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9217000000000002e-05 2024-02-10T08:37:57.068 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.068 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.069 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:37:57.069 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:51.257826+0000", 2024-02-10T08:37:57.069 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5758999999999999e-05 2024-02-10T08:37:57.069 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.069 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.069 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:37:57.069 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:51.257851+0000", 2024-02-10T08:37:57.069 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.20730405599999999 2024-02-10T08:37:57.069 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:37:57.069 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:37:57.069 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:37:57.069 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.069 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.069 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.25369.0:159398 10.7 10:ed318692:::benchmark_data_smithi018_146618_object35595:head [delete] snapc 0=[] ondisk+write+known_if_redirected e374)", 2024-02-10T08:37:57.069 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:34:51.063163+0000", 2024-02-10T08:37:57.070 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 185.904660871, 2024-02-10T08:37:57.070 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.20235341900000001, 2024-02-10T08:37:57.070 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:37:57.070 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:37:57.070 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:37:57.070 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.25369", 2024-02-10T08:37:57.070 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3974730810", 2024-02-10T08:37:57.070 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 159398 2024-02-10T08:37:57.070 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.070 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:37:57.070 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.070 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:37:57.070 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:51.063163+0000", 2024-02-10T08:37:57.070 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:37:57.070 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.070 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.071 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:37:57.071 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:51.063163+0000", 2024-02-10T08:37:57.071 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-02-10T08:37:57.071 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.071 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.071 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:37:57.071 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:51.063162+0000", 2024-02-10T08:37:57.071 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6889999999999998e-06 2024-02-10T08:37:57.071 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.071 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.071 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:37:57.071 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:51.063169+0000", 2024-02-10T08:37:57.071 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0695e-05 2024-02-10T08:37:57.071 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.071 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.072 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:37:57.072 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:51.063179+0000", 2024-02-10T08:37:57.072 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5207e-05 2024-02-10T08:37:57.072 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.072 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.072 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:37:57.072 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:51.063194+0000", 2024-02-10T08:37:57.072 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3767999999999998e-05 2024-02-10T08:37:57.072 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.072 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.072 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:37:57.072 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:51.063238+0000", 2024-02-10T08:37:57.072 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011849300000000001 2024-02-10T08:37:57.072 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.072 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.073 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:37:57.073 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:51.063357+0000", 2024-02-10T08:37:57.073 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013184500000000001 2024-02-10T08:37:57.073 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.073 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.073 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3,6", 2024-02-10T08:37:57.073 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:51.063489+0000", 2024-02-10T08:37:57.073 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022479840000000002 2024-02-10T08:37:57.073 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.073 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.073 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:37:57.073 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:51.065736+0000", 2024-02-10T08:37:57.073 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3069e-05 2024-02-10T08:37:57.073 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.073 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.074 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:37:57.074 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:51.065820+0000", 2024-02-10T08:37:57.074 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.19959426699999999 2024-02-10T08:37:57.074 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.074 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.074 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:37:57.074 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:51.265414+0000", 2024-02-10T08:37:57.074 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5624999999999998e-05 2024-02-10T08:37:57.074 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.074 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.074 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:37:57.074 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:51.265459+0000", 2024-02-10T08:37:57.074 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.719e-05 2024-02-10T08:37:57.074 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.074 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.075 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:37:57.075 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:34:51.265517+0000", 2024-02-10T08:37:57.075 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.20235341900000001 2024-02-10T08:37:57.075 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:37:57.075 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:37:57.075 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:37:57.075 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.075 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.075 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.25369.0:210166 10.6 10:661ce59d:::benchmark_data_smithi018_146618_object86363:head [delete] snapc 0=[] ondisk+write+known_if_redirected e383)", 2024-02-10T08:37:57.075 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:35:40.811609+0000", 2024-02-10T08:37:57.075 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 136.156214646, 2024-02-10T08:37:57.075 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.14568948400000001, 2024-02-10T08:37:57.075 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:37:57.075 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:37:57.075 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:37:57.076 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.25369", 2024-02-10T08:37:57.076 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3974730810", 2024-02-10T08:37:57.076 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 210166 2024-02-10T08:37:57.076 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.076 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:37:57.076 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.076 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:37:57.076 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:35:40.811609+0000", 2024-02-10T08:37:57.076 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:37:57.076 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.076 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.076 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:37:57.076 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:35:40.811609+0000", 2024-02-10T08:37:57.076 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-02-10T08:37:57.076 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.076 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.077 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:37:57.077 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:35:40.811608+0000", 2024-02-10T08:37:57.077 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2770000000000002e-06 2024-02-10T08:37:57.077 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.077 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.077 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:37:57.077 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:35:40.811615+0000", 2024-02-10T08:37:57.077 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1219999999999995e-06 2024-02-10T08:37:57.077 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.077 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.077 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:37:57.077 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:35:40.811623+0000", 2024-02-10T08:37:57.077 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5670000000000002e-06 2024-02-10T08:37:57.077 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.077 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.078 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:37:57.078 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:35:40.811628+0000", 2024-02-10T08:37:57.078 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0751999999999999e-05 2024-02-10T08:37:57.078 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.078 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.078 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:37:57.078 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:35:40.811669+0000", 2024-02-10T08:37:57.078 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9529000000000002e-05 2024-02-10T08:37:57.078 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.078 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.078 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:37:57.078 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:35:40.811769+0000", 2024-02-10T08:37:57.078 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000113202 2024-02-10T08:37:57.078 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.078 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.078 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,4", 2024-02-10T08:37:57.078 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:35:40.811882+0000", 2024-02-10T08:37:57.079 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0050716370000000004 2024-02-10T08:37:57.079 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.079 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.079 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:37:57.079 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:35:40.816953+0000", 2024-02-10T08:37:57.079 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0024305220000000001 2024-02-10T08:37:57.079 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.079 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.079 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:37:57.079 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:35:40.819384+0000", 2024-02-10T08:37:57.079 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.137721184 2024-02-10T08:37:57.079 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.079 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.079 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:37:57.079 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:35:40.957105+0000", 2024-02-10T08:37:57.079 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013034799999999999 2024-02-10T08:37:57.079 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.080 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.080 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:37:57.080 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:35:40.957235+0000", 2024-02-10T08:37:57.080 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3452000000000002e-05 2024-02-10T08:37:57.080 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.080 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.080 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:37:57.080 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:35:40.957299+0000", 2024-02-10T08:37:57.080 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.14568948400000001 2024-02-10T08:37:57.080 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:37:57.080 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:37:57.080 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:37:57.080 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.080 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.080 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.25369.0:210171 10.6 10:69323d86:::benchmark_data_smithi018_146618_object86368:head [delete] snapc 0=[] ondisk+write+known_if_redirected e383)", 2024-02-10T08:37:57.080 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:35:40.820571+0000", 2024-02-10T08:37:57.081 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 136.14725272699999, 2024-02-10T08:37:57.081 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.145627119, 2024-02-10T08:37:57.081 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:37:57.081 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:37:57.081 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:37:57.081 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.25369", 2024-02-10T08:37:57.081 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3974730810", 2024-02-10T08:37:57.081 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 210171 2024-02-10T08:37:57.081 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.081 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:37:57.081 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.081 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:37:57.081 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:35:40.820571+0000", 2024-02-10T08:37:57.081 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:37:57.081 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.081 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.082 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:37:57.082 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:35:40.820571+0000", 2024-02-10T08:37:57.082 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-02-10T08:37:57.082 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.082 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.082 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:37:57.082 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:35:40.820570+0000", 2024-02-10T08:37:57.082 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.46e-06 2024-02-10T08:37:57.082 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.082 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.082 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:37:57.082 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:35:40.820576+0000", 2024-02-10T08:37:57.082 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1516e-05 2024-02-10T08:37:57.082 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.082 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.082 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:37:57.082 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:35:40.820588+0000", 2024-02-10T08:37:57.083 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0499999999999997e-06 2024-02-10T08:37:57.083 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.083 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.083 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:37:57.083 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:35:40.820594+0000", 2024-02-10T08:37:57.083 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4891000000000001e-05 2024-02-10T08:37:57.083 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.083 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.083 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:37:57.083 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:35:40.820639+0000", 2024-02-10T08:37:57.083 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000116906 2024-02-10T08:37:57.083 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.083 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.083 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:37:57.083 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:35:40.820756+0000", 2024-02-10T08:37:57.084 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012559800000000001 2024-02-10T08:37:57.084 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.084 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.084 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,4", 2024-02-10T08:37:57.084 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:35:40.820881+0000", 2024-02-10T08:37:57.084 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026265389999999998 2024-02-10T08:37:57.084 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.084 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.084 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:37:57.084 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:35:40.823508+0000", 2024-02-10T08:37:57.084 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00088975600000000001 2024-02-10T08:37:57.084 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.084 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.084 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:37:57.085 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:35:40.824398+0000", 2024-02-10T08:37:57.085 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.14169956 2024-02-10T08:37:57.085 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.085 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.085 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:37:57.085 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:35:40.966097+0000", 2024-02-10T08:37:57.085 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8303000000000002e-05 2024-02-10T08:37:57.085 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.085 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.085 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:37:57.085 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:35:40.966145+0000", 2024-02-10T08:37:57.085 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3077e-05 2024-02-10T08:37:57.085 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.085 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.085 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:37:57.085 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:35:40.966198+0000", 2024-02-10T08:37:57.086 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.145627119 2024-02-10T08:37:57.086 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:37:57.086 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:37:57.086 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:37:57.086 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.086 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.086 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.25369.0:210175 10.6 10:6d06380e:::benchmark_data_smithi018_146618_object86372:head [delete] snapc 0=[] ondisk+write+known_if_redirected e383)", 2024-02-10T08:37:57.086 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:35:40.824313+0000", 2024-02-10T08:37:57.086 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 136.14351084500001, 2024-02-10T08:37:57.086 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.14200484999999999, 2024-02-10T08:37:57.086 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:37:57.086 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:37:57.086 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:37:57.086 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.25369", 2024-02-10T08:37:57.086 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3974730810", 2024-02-10T08:37:57.087 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 210175 2024-02-10T08:37:57.087 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.087 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:37:57.087 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.087 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:37:57.087 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:35:40.824313+0000", 2024-02-10T08:37:57.087 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:37:57.087 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.087 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.087 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:37:57.087 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:35:40.824313+0000", 2024-02-10T08:37:57.087 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999981 2024-02-10T08:37:57.087 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.087 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.087 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:37:57.088 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:35:40.824312+0000", 2024-02-10T08:37:57.088 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8850000000000001e-06 2024-02-10T08:37:57.088 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.088 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.088 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:37:57.088 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:35:40.824318+0000", 2024-02-10T08:37:57.088 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0093e-05 2024-02-10T08:37:57.088 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.088 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.088 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:37:57.088 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:35:40.824328+0000", 2024-02-10T08:37:57.088 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3069999999999997e-06 2024-02-10T08:37:57.088 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.088 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.089 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:37:57.089 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:35:40.824336+0000", 2024-02-10T08:37:57.089 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1351e-05 2024-02-10T08:37:57.089 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.089 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.089 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:37:57.089 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:35:40.824427+0000", 2024-02-10T08:37:57.089 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011767 2024-02-10T08:37:57.089 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.089 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.089 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:37:57.089 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:35:40.824545+0000", 2024-02-10T08:37:57.089 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9176e-05 2024-02-10T08:37:57.089 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.089 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.089 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,4", 2024-02-10T08:37:57.090 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:35:40.824644+0000", 2024-02-10T08:37:57.090 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019250859999999999 2024-02-10T08:37:57.090 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.090 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.090 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:37:57.090 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:35:40.826569+0000", 2024-02-10T08:37:57.090 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00028530800000000001 2024-02-10T08:37:57.090 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.090 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.090 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:37:57.090 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:35:40.826854+0000", 2024-02-10T08:37:57.090 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.13938212799999999 2024-02-10T08:37:57.090 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.090 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.090 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:37:57.091 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:35:40.966237+0000", 2024-02-10T08:37:57.091 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4546999999999999e-05 2024-02-10T08:37:57.091 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.091 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.091 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:37:57.091 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:35:40.966281+0000", 2024-02-10T08:37:57.091 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7045999999999997e-05 2024-02-10T08:37:57.091 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:37:57.091 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:37:57.091 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:37:57.091 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:35:40.966318+0000", 2024-02-10T08:37:57.091 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.14200484999999999 2024-02-10T08:37:57.091 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:37:57.091 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:37:57.091 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:37:57.091 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:37:57.092 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:37:57.092 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-02-10T08:37:57.092 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:37:57.133 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:57.172 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:37:57.237 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:37:57.244 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:57.245 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:37:57.245 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:55.473708+0000 osd.3 (osd.3) 115 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:37:57.245 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:55.473763+0000 osd.3 (osd.3) 116 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:37:57.245 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:56.079779+0000 osd.4 (osd.4) 202 : cluster [DBG] 4.d scrub starts 2024-02-10T08:37:57.245 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:56.090341+0000 osd.4 (osd.4) 203 : cluster [DBG] 4.d scrub ok 2024-02-10T08:37:57.245 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:56.411137+0000 osd.5 (osd.5) 263 : cluster [DBG] 2.16 scrub starts 2024-02-10T08:37:57.245 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:56.416748+0000 osd.5 (osd.5) 264 : cluster [DBG] 2.16 scrub ok 2024-02-10T08:37:57.245 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:56.670912+0000 osd.7 (osd.7) 279 : cluster [DBG] 5.4 scrub starts 2024-02-10T08:37:57.245 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:56.673726+0000 osd.7 (osd.7) 280 : cluster [DBG] 5.4 scrub ok 2024-02-10T08:37:57.345 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:37:57.391 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:57.527 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:2024-02-10T08:37:57.528052+0000 min lat: 0.00122517 max lat: 0.14483 avg lat: 0.0107763 2024-02-10T08:37:57.527 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-02-10T08:37:57.528 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 60 16 89093 89077 92.7515 63 0.00830646 0.0107763 2024-02-10T08:37:57.535 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:55.473708+0000 osd.3 (osd.3) 115 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:37:57.535 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:55.473763+0000 osd.3 (osd.3) 116 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:37:57.535 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:56.079779+0000 osd.4 (osd.4) 202 : cluster [DBG] 4.d scrub starts 2024-02-10T08:37:57.535 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:56.090341+0000 osd.4 (osd.4) 203 : cluster [DBG] 4.d scrub ok 2024-02-10T08:37:57.535 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:56.411137+0000 osd.5 (osd.5) 263 : cluster [DBG] 2.16 scrub starts 2024-02-10T08:37:57.535 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:56.416748+0000 osd.5 (osd.5) 264 : cluster [DBG] 2.16 scrub ok 2024-02-10T08:37:57.535 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:56.670912+0000 osd.7 (osd.7) 279 : cluster [DBG] 5.4 scrub starts 2024-02-10T08:37:57.535 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:56.673726+0000 osd.7 (osd.7) 280 : cluster [DBG] 5.4 scrub ok 2024-02-10T08:37:57.536 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:37:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:37:57] "GET /metrics HTTP/1.1" 200 176668 "" "Prometheus/2.33.4" 2024-02-10T08:37:57.536 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:55.473708+0000 osd.3 (osd.3) 115 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:37:57.536 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:55.473763+0000 osd.3 (osd.3) 116 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:37:57.536 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:56.079779+0000 osd.4 (osd.4) 202 : cluster [DBG] 4.d scrub starts 2024-02-10T08:37:57.536 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:56.090341+0000 osd.4 (osd.4) 203 : cluster [DBG] 4.d scrub ok 2024-02-10T08:37:57.536 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:56.411137+0000 osd.5 (osd.5) 263 : cluster [DBG] 2.16 scrub starts 2024-02-10T08:37:57.536 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:56.416748+0000 osd.5 (osd.5) 264 : cluster [DBG] 2.16 scrub ok 2024-02-10T08:37:57.537 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:56.670912+0000 osd.7 (osd.7) 279 : cluster [DBG] 5.4 scrub starts 2024-02-10T08:37:57.537 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:56.673726+0000 osd.7 (osd.7) 280 : cluster [DBG] 5.4 scrub ok 2024-02-10T08:37:57.724 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.6 dump_ops_in_flight 2024-02-10T08:37:57.752 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:37:57.756 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:57.757 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:37:57.857 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:37:57.918 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:57.948 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:37:57.952 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:57.953 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:37:58.054 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:37:58.144 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:58.147 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:37:58.167 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:37:58.169 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:58.170 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:37:58.241 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:56.805825+0000 osd.2 (osd.2) 249 : cluster [DBG] 4.19 scrub starts 2024-02-10T08:37:58.241 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:56.816913+0000 osd.2 (osd.2) 250 : cluster [DBG] 4.19 scrub ok 2024-02-10T08:37:58.270 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:37:58.335 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:58.395 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:37:58.404 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:58.405 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:37:58.505 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:37:58.512 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:56.945904+0000 osd.6 (osd.6) 263 : cluster [DBG] 5.1f scrub starts 2024-02-10T08:37:58.512 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:56.949397+0000 osd.6 (osd.6) 264 : cluster [DBG] 5.1f scrub ok 2024-02-10T08:37:58.513 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:57.080336+0000 osd.4 (osd.4) 204 : cluster [DBG] 6.2c scrub starts 2024-02-10T08:37:58.513 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:57.085547+0000 osd.4 (osd.4) 205 : cluster [DBG] 6.2c scrub ok 2024-02-10T08:37:58.513 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:57.103076+0000 mgr.y (mgr.14505) 795 : cluster [DBG] pgmap v974: 178 pgs: 178 active+clean; 5.2 GiB data, 22 GiB used, 694 GiB / 715 GiB avail; 639 B/s rd, 44 MiB/s wr, 707 op/s 2024-02-10T08:37:58.513 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:57.710632+0000 osd.7 (osd.7) 281 : cluster [DBG] 4.7 scrub starts 2024-02-10T08:37:58.513 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:57.716527+0000 osd.7 (osd.7) 282 : cluster [DBG] 4.7 scrub ok 2024-02-10T08:37:58.528 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 61 16 90145 90129 92.3089 65.75 0.0172959 0.0108277 2024-02-10T08:37:58.567 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:58.595 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:37:58.602 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:58.602 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:37:58.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:56.805825+0000 osd.2 (osd.2) 249 : cluster [DBG] 4.19 scrub starts 2024-02-10T08:37:58.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:56.816913+0000 osd.2 (osd.2) 250 : cluster [DBG] 4.19 scrub ok 2024-02-10T08:37:58.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:56.945904+0000 osd.6 (osd.6) 263 : cluster [DBG] 5.1f scrub starts 2024-02-10T08:37:58.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:56.949397+0000 osd.6 (osd.6) 264 : cluster [DBG] 5.1f scrub ok 2024-02-10T08:37:58.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:57.080336+0000 osd.4 (osd.4) 204 : cluster [DBG] 6.2c scrub starts 2024-02-10T08:37:58.657 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:57.085547+0000 osd.4 (osd.4) 205 : cluster [DBG] 6.2c scrub ok 2024-02-10T08:37:58.657 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:57.103076+0000 mgr.y (mgr.14505) 795 : cluster [DBG] pgmap v974: 178 pgs: 178 active+clean; 5.2 GiB data, 22 GiB used, 694 GiB / 715 GiB avail; 639 B/s rd, 44 MiB/s wr, 707 op/s 2024-02-10T08:37:58.657 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:57.710632+0000 osd.7 (osd.7) 281 : cluster [DBG] 4.7 scrub starts 2024-02-10T08:37:58.657 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:57.716527+0000 osd.7 (osd.7) 282 : cluster [DBG] 4.7 scrub ok 2024-02-10T08:37:58.657 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:56.805825+0000 osd.2 (osd.2) 249 : cluster [DBG] 4.19 scrub starts 2024-02-10T08:37:58.657 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:56.816913+0000 osd.2 (osd.2) 250 : cluster [DBG] 4.19 scrub ok 2024-02-10T08:37:58.657 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:56.945904+0000 osd.6 (osd.6) 263 : cluster [DBG] 5.1f scrub starts 2024-02-10T08:37:58.657 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:56.949397+0000 osd.6 (osd.6) 264 : cluster [DBG] 5.1f scrub ok 2024-02-10T08:37:58.657 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:57.080336+0000 osd.4 (osd.4) 204 : cluster [DBG] 6.2c scrub starts 2024-02-10T08:37:58.657 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:57.085547+0000 osd.4 (osd.4) 205 : cluster [DBG] 6.2c scrub ok 2024-02-10T08:37:58.657 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:57.103076+0000 mgr.y (mgr.14505) 795 : cluster [DBG] pgmap v974: 178 pgs: 178 active+clean; 5.2 GiB data, 22 GiB used, 694 GiB / 715 GiB avail; 639 B/s rd, 44 MiB/s wr, 707 op/s 2024-02-10T08:37:58.657 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:57.710632+0000 osd.7 (osd.7) 281 : cluster [DBG] 4.7 scrub starts 2024-02-10T08:37:58.657 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:57.716527+0000 osd.7 (osd.7) 282 : cluster [DBG] 4.7 scrub ok 2024-02-10T08:37:58.703 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:37:58.749 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:58.966 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd unset nodeep-scrub 2024-02-10T08:37:59.039 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:37:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:37:59.120 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:37:59.122 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:59.123 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:37:59.224 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:37:59.291 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:57.784069+0000 osd.2 (osd.2) 251 : cluster [DBG] 5.6 scrub starts 2024-02-10T08:37:59.291 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:57.790958+0000 osd.2 (osd.2) 252 : cluster [DBG] 5.6 scrub ok 2024-02-10T08:37:59.291 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:57.929584+0000 osd.0 (osd.0) 260 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:37:59.291 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:57.929629+0000 osd.0 (osd.0) 261 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:37:59.291 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:58.227192+0000 mon.a (mon.0) 1715 : cluster [DBG] osdmap e416: 8 total, 8 up, 8 in 2024-02-10T08:37:59.291 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:58.409353+0000 osd.5 (osd.5) 265 : cluster [DBG] 5.7 scrub starts 2024-02-10T08:37:59.292 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:58.419621+0000 osd.5 (osd.5) 266 : cluster [DBG] 5.7 scrub ok 2024-02-10T08:37:59.292 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:58.746930+0000 osd.7 (osd.7) 283 : cluster [DBG] 5.9 scrub starts 2024-02-10T08:37:59.292 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:37:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:58.751019+0000 osd.7 (osd.7) 284 : cluster [DBG] 5.9 scrub ok 2024-02-10T08:37:59.292 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:57.784069+0000 osd.2 (osd.2) 251 : cluster [DBG] 5.6 scrub starts 2024-02-10T08:37:59.292 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:57.790958+0000 osd.2 (osd.2) 252 : cluster [DBG] 5.6 scrub ok 2024-02-10T08:37:59.292 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:57.929584+0000 osd.0 (osd.0) 260 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:37:59.292 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:57.929629+0000 osd.0 (osd.0) 261 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:37:59.292 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:58.227192+0000 mon.a (mon.0) 1715 : cluster [DBG] osdmap e416: 8 total, 8 up, 8 in 2024-02-10T08:37:59.292 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:58.409353+0000 osd.5 (osd.5) 265 : cluster [DBG] 5.7 scrub starts 2024-02-10T08:37:59.292 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:58.419621+0000 osd.5 (osd.5) 266 : cluster [DBG] 5.7 scrub ok 2024-02-10T08:37:59.292 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:58.746930+0000 osd.7 (osd.7) 283 : cluster [DBG] 5.9 scrub starts 2024-02-10T08:37:59.292 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:37:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:58.751019+0000 osd.7 (osd.7) 284 : cluster [DBG] 5.9 scrub ok 2024-02-10T08:37:59.300 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:37:59.527 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 62 16 91189 91173 91.8725 65.25 0.0157394 0.0108807 2024-02-10T08:37:59.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:59 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:57.784069+0000 osd.2 (osd.2) 251 : cluster [DBG] 5.6 scrub starts 2024-02-10T08:37:59.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:59 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:57.790958+0000 osd.2 (osd.2) 252 : cluster [DBG] 5.6 scrub ok 2024-02-10T08:37:59.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:59 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:57.929584+0000 osd.0 (osd.0) 260 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:37:59.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:59 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:57.929629+0000 osd.0 (osd.0) 261 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:37:59.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:59 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:58.227192+0000 mon.a (mon.0) 1715 : cluster [DBG] osdmap e416: 8 total, 8 up, 8 in 2024-02-10T08:37:59.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:59 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:58.409353+0000 osd.5 (osd.5) 265 : cluster [DBG] 5.7 scrub starts 2024-02-10T08:37:59.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:59 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:58.419621+0000 osd.5 (osd.5) 266 : cluster [DBG] 5.7 scrub ok 2024-02-10T08:37:59.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:59 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:58.746930+0000 osd.7 (osd.7) 283 : cluster [DBG] 5.9 scrub starts 2024-02-10T08:37:59.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:37:59 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:58.751019+0000 osd.7 (osd.7) 284 : cluster [DBG] 5.9 scrub ok 2024-02-10T08:37:59.881 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:37:59.885 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:37:59.886 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:37:59.913 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:37:59.947 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:37:59.973 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:37:59.986 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:38:00.004 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:38:00.020 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:00.045 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:38:00.055 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:38:00.058 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:00.058 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:38:00.077 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:38:00.114 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:38:00.155 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:38:00.159 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:38:00.188 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:38:00.214 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-02-10T08:38:00.214 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:38:00.216 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-10T08:38:00.216 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-10T08:38:00.216 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-10T08:38:00.217 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-10T08:38:00.217 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-10T08:38:00.217 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-10T08:38:00.217 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-10T08:38:00.217 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-10T08:38:00.220 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:00.264 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:38:00.271 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:00.271 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:38:00.372 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:38:00.436 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:00.529 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:38:00.529 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 63 16 92191 92175 91.4066 62.625 0.0123014 0.0109356 2024-02-10T08:38:00.530 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:58.763658+0000 osd.2 (osd.2) 253 : cluster [DBG] 5.8 scrub starts 2024-02-10T08:38:00.530 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:58.767690+0000 osd.2 (osd.2) 254 : cluster [DBG] 5.8 scrub ok 2024-02-10T08:38:00.530 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:37:58.848583+0000 mgr.y (mgr.14505) 796 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:38:00.530 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:59.081250+0000 osd.1 (osd.1) 288 : cluster [DBG] 2.a scrub starts 2024-02-10T08:38:00.531 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:59.089612+0000 osd.1 (osd.1) 289 : cluster [DBG] 2.a scrub ok 2024-02-10T08:38:00.531 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:59.106000+0000 mgr.y (mgr.14505) 797 : cluster [DBG] pgmap v976: 178 pgs: 178 active+clean; 5.5 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 1.2 KiB/s rd, 81 MiB/s wr, 1.29k op/s 2024-02-10T08:38:00.531 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:59.411179+0000 osd.5 (osd.5) 267 : cluster [DBG] 6.33 scrub starts 2024-02-10T08:38:00.531 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:59.522401+0000 osd.5 (osd.5) 268 : cluster [DBG] 6.33 scrub ok 2024-02-10T08:38:00.531 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:37:59.878918+0000 mon.a (mon.0) 1716 : audit [DBG] from='client.? 172.21.15.18:0/3780807678' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:38:00.531 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:00.532 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:38:00.532 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:58.763658+0000 osd.2 (osd.2) 253 : cluster [DBG] 5.8 scrub starts 2024-02-10T08:38:00.532 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:58.767690+0000 osd.2 (osd.2) 254 : cluster [DBG] 5.8 scrub ok 2024-02-10T08:38:00.532 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:37:58.848583+0000 mgr.y (mgr.14505) 796 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:38:00.533 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:59.081250+0000 osd.1 (osd.1) 288 : cluster [DBG] 2.a scrub starts 2024-02-10T08:38:00.533 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:59.089612+0000 osd.1 (osd.1) 289 : cluster [DBG] 2.a scrub ok 2024-02-10T08:38:00.533 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:59.106000+0000 mgr.y (mgr.14505) 797 : cluster [DBG] pgmap v976: 178 pgs: 178 active+clean; 5.5 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 1.2 KiB/s rd, 81 MiB/s wr, 1.29k op/s 2024-02-10T08:38:00.533 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:59.411179+0000 osd.5 (osd.5) 267 : cluster [DBG] 6.33 scrub starts 2024-02-10T08:38:00.533 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:59.522401+0000 osd.5 (osd.5) 268 : cluster [DBG] 6.33 scrub ok 2024-02-10T08:38:00.533 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:37:59.878918+0000 mon.a (mon.0) 1716 : audit [DBG] from='client.? 172.21.15.18:0/3780807678' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:38:00.544 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:58.763658+0000 osd.2 (osd.2) 253 : cluster [DBG] 5.8 scrub starts 2024-02-10T08:38:00.544 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:58.767690+0000 osd.2 (osd.2) 254 : cluster [DBG] 5.8 scrub ok 2024-02-10T08:38:00.544 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:37:58.848583+0000 mgr.y (mgr.14505) 796 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:38:00.544 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:59.081250+0000 osd.1 (osd.1) 288 : cluster [DBG] 2.a scrub starts 2024-02-10T08:38:00.544 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:59.089612+0000 osd.1 (osd.1) 289 : cluster [DBG] 2.a scrub ok 2024-02-10T08:38:00.544 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:59.106000+0000 mgr.y (mgr.14505) 797 : cluster [DBG] pgmap v976: 178 pgs: 178 active+clean; 5.5 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 1.2 KiB/s rd, 81 MiB/s wr, 1.29k op/s 2024-02-10T08:38:00.544 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:59.411179+0000 osd.5 (osd.5) 267 : cluster [DBG] 6.33 scrub starts 2024-02-10T08:38:00.545 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:59.522401+0000 osd.5 (osd.5) 268 : cluster [DBG] 6.33 scrub ok 2024-02-10T08:38:00.545 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:37:59.878918+0000 mon.a (mon.0) 1716 : audit [DBG] from='client.? 172.21.15.18:0/3780807678' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:38:00.633 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:38:00.678 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:01.025 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.6 dump_blocked_ops 2024-02-10T08:38:01.036 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:38:01.039 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:01.040 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:38:01.140 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:38:01.189 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:01.273 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:59.769568+0000 osd.2 (osd.2) 255 : cluster [DBG] 4.f scrub starts 2024-02-10T08:38:01.273 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:59.784102+0000 osd.2 (osd.2) 256 : cluster [DBG] 4.f scrub ok 2024-02-10T08:38:01.273 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:59.910556+0000 osd.6 (osd.6) 265 : cluster [DBG] 4.5 scrub starts 2024-02-10T08:38:01.273 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:37:59.914956+0000 osd.6 (osd.6) 266 : cluster [DBG] 4.5 scrub ok 2024-02-10T08:38:01.273 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:00.272671+0000 osd.0 (osd.0) 262 : cluster [DBG] 6.14 scrub starts 2024-02-10T08:38:01.273 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:00.280251+0000 osd.0 (osd.0) 263 : cluster [DBG] 6.14 scrub ok 2024-02-10T08:38:01.273 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:00.980368+0000 mon.a (mon.0) 1717 : cluster [DBG] osdmap e417: 8 total, 8 up, 8 in 2024-02-10T08:38:01.332 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 3, 4, 5, 6, 7, 0] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 5, 6, 7, 4] 2024-02-10T08:38:01.332 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-10T08:38:01.332 INFO:tasks.thrashosds.thrasher:fixing pg num pool iscsi 2024-02-10T08:38:01.333 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph pg dump --format=json 2024-02-10T08:38:01.424 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:38:01.529 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 64 16 93221 93205 90.9836 64.375 0.0181116 0.0109864 2024-02-10T08:38:01.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:59.769568+0000 osd.2 (osd.2) 255 : cluster [DBG] 4.f scrub starts 2024-02-10T08:38:01.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:59.784102+0000 osd.2 (osd.2) 256 : cluster [DBG] 4.f scrub ok 2024-02-10T08:38:01.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:59.910556+0000 osd.6 (osd.6) 265 : cluster [DBG] 4.5 scrub starts 2024-02-10T08:38:01.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:37:59.914956+0000 osd.6 (osd.6) 266 : cluster [DBG] 4.5 scrub ok 2024-02-10T08:38:01.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:00.272671+0000 osd.0 (osd.0) 262 : cluster [DBG] 6.14 scrub starts 2024-02-10T08:38:01.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:00.280251+0000 osd.0 (osd.0) 263 : cluster [DBG] 6.14 scrub ok 2024-02-10T08:38:01.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:00.980368+0000 mon.a (mon.0) 1717 : cluster [DBG] osdmap e417: 8 total, 8 up, 8 in 2024-02-10T08:38:01.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:59.769568+0000 osd.2 (osd.2) 255 : cluster [DBG] 4.f scrub starts 2024-02-10T08:38:01.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:59.784102+0000 osd.2 (osd.2) 256 : cluster [DBG] 4.f scrub ok 2024-02-10T08:38:01.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:59.910556+0000 osd.6 (osd.6) 265 : cluster [DBG] 4.5 scrub starts 2024-02-10T08:38:01.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:37:59.914956+0000 osd.6 (osd.6) 266 : cluster [DBG] 4.5 scrub ok 2024-02-10T08:38:01.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:00.272671+0000 osd.0 (osd.0) 262 : cluster [DBG] 6.14 scrub starts 2024-02-10T08:38:01.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:00.280251+0000 osd.0 (osd.0) 263 : cluster [DBG] 6.14 scrub ok 2024-02-10T08:38:01.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:00.980368+0000 mon.a (mon.0) 1717 : cluster [DBG] osdmap e417: 8 total, 8 up, 8 in 2024-02-10T08:38:02.240 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:38:02.245 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:02.245 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:38:02.275 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:00.756797+0000 osd.2 (osd.2) 257 : cluster [DBG] 2.5 scrub starts 2024-02-10T08:38:02.276 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:00.759246+0000 osd.2 (osd.2) 258 : cluster [DBG] 2.5 scrub ok 2024-02-10T08:38:02.276 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:00.902784+0000 osd.6 (osd.6) 267 : cluster [DBG] 6.25 scrub starts 2024-02-10T08:38:02.276 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:00.976250+0000 osd.6 (osd.6) 268 : cluster [DBG] 6.25 scrub ok 2024-02-10T08:38:02.276 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:01.106453+0000 mgr.y (mgr.14505) 798 : cluster [DBG] pgmap v978: 178 pgs: 178 active+clean; 5.5 GiB data, 23 GiB used, 693 GiB / 715 GiB avail; 852 B/s rd, 55 MiB/s wr, 881 op/s 2024-02-10T08:38:02.276 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:01.764760+0000 osd.7 (osd.7) 285 : cluster [DBG] 6.12 scrub starts 2024-02-10T08:38:02.276 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:02.054786+0000 osd.1 (osd.1) 290 : cluster [DBG] 5.12 scrub starts 2024-02-10T08:38:02.276 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:02.063827+0000 osd.1 (osd.1) 291 : cluster [DBG] 5.12 scrub ok 2024-02-10T08:38:02.345 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:38:02.405 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:02.436 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:38:02.440 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:02.440 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:38:02.533 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 65 16 94288 94272 90.6055 66.6875 0.00797397 0.0110323 2024-02-10T08:38:02.541 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:38:02.577 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:00.756797+0000 osd.2 (osd.2) 257 : cluster [DBG] 2.5 scrub starts 2024-02-10T08:38:02.578 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:00.759246+0000 osd.2 (osd.2) 258 : cluster [DBG] 2.5 scrub ok 2024-02-10T08:38:02.578 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:00.902784+0000 osd.6 (osd.6) 267 : cluster [DBG] 6.25 scrub starts 2024-02-10T08:38:02.578 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:00.976250+0000 osd.6 (osd.6) 268 : cluster [DBG] 6.25 scrub ok 2024-02-10T08:38:02.578 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:01.106453+0000 mgr.y (mgr.14505) 798 : cluster [DBG] pgmap v978: 178 pgs: 178 active+clean; 5.5 GiB data, 23 GiB used, 693 GiB / 715 GiB avail; 852 B/s rd, 55 MiB/s wr, 881 op/s 2024-02-10T08:38:02.578 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:01.764760+0000 osd.7 (osd.7) 285 : cluster [DBG] 6.12 scrub starts 2024-02-10T08:38:02.578 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:02.054786+0000 osd.1 (osd.1) 290 : cluster [DBG] 5.12 scrub starts 2024-02-10T08:38:02.578 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:02.063827+0000 osd.1 (osd.1) 291 : cluster [DBG] 5.12 scrub ok 2024-02-10T08:38:02.580 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:00.756797+0000 osd.2 (osd.2) 257 : cluster [DBG] 2.5 scrub starts 2024-02-10T08:38:02.580 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:00.759246+0000 osd.2 (osd.2) 258 : cluster [DBG] 2.5 scrub ok 2024-02-10T08:38:02.580 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:00.902784+0000 osd.6 (osd.6) 267 : cluster [DBG] 6.25 scrub starts 2024-02-10T08:38:02.580 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:00.976250+0000 osd.6 (osd.6) 268 : cluster [DBG] 6.25 scrub ok 2024-02-10T08:38:02.580 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:01.106453+0000 mgr.y (mgr.14505) 798 : cluster [DBG] pgmap v978: 178 pgs: 178 active+clean; 5.5 GiB data, 23 GiB used, 693 GiB / 715 GiB avail; 852 B/s rd, 55 MiB/s wr, 881 op/s 2024-02-10T08:38:02.580 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:01.764760+0000 osd.7 (osd.7) 285 : cluster [DBG] 6.12 scrub starts 2024-02-10T08:38:02.580 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:02.054786+0000 osd.1 (osd.1) 290 : cluster [DBG] 5.12 scrub starts 2024-02-10T08:38:02.580 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:02.063827+0000 osd.1 (osd.1) 291 : cluster [DBG] 5.12 scrub ok 2024-02-10T08:38:02.596 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:02.780 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:38:02.785 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:02.785 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:38:02.886 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:38:02.914 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:38:02.950 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:03.208 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:38:03.212 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:03.212 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:38:03.313 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:38:03.331 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is unset 2024-02-10T08:38:03.397 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:03.531 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-02-10T08:38:03.531 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:38:03.534 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:01.767788+0000 osd.7 (osd.7) 286 : cluster [DBG] 6.12 scrub ok 2024-02-10T08:38:03.534 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:02.395780+0000 osd.5 (osd.5) 269 : cluster [DBG] 6.a scrub starts 2024-02-10T08:38:03.534 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:02.402356+0000 osd.5 (osd.5) 270 : cluster [DBG] 6.a scrub ok 2024-02-10T08:38:03.534 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:03.005275+0000 osd.1 (osd.1) 292 : cluster [DBG] 2.15 scrub starts 2024-02-10T08:38:03.534 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:03.014540+0000 osd.1 (osd.1) 293 : cluster [DBG] 2.15 scrub ok 2024-02-10T08:38:03.534 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:38:03.263918+0000 mon.a (mon.0) 1718 : audit [INF] from='client.? 172.21.15.18:0/2663618223' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:38:03.535 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:01.767788+0000 osd.7 (osd.7) 286 : cluster [DBG] 6.12 scrub ok 2024-02-10T08:38:03.535 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:02.395780+0000 osd.5 (osd.5) 269 : cluster [DBG] 6.a scrub starts 2024-02-10T08:38:03.535 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:02.402356+0000 osd.5 (osd.5) 270 : cluster [DBG] 6.a scrub ok 2024-02-10T08:38:03.535 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:03.005275+0000 osd.1 (osd.1) 292 : cluster [DBG] 2.15 scrub starts 2024-02-10T08:38:03.535 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:03.014540+0000 osd.1 (osd.1) 293 : cluster [DBG] 2.15 scrub ok 2024-02-10T08:38:03.535 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:38:03.263918+0000 mon.a (mon.0) 1718 : audit [INF] from='client.? 172.21.15.18:0/2663618223' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:38:03.535 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 66 16 95265 95249 90.1579 61.0625 0.0162383 0.0110869 2024-02-10T08:38:03.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:01.767788+0000 osd.7 (osd.7) 286 : cluster [DBG] 6.12 scrub ok 2024-02-10T08:38:03.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:02.395780+0000 osd.5 (osd.5) 269 : cluster [DBG] 6.a scrub starts 2024-02-10T08:38:03.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:02.402356+0000 osd.5 (osd.5) 270 : cluster [DBG] 6.a scrub ok 2024-02-10T08:38:03.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:03.005275+0000 osd.1 (osd.1) 292 : cluster [DBG] 2.15 scrub starts 2024-02-10T08:38:03.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:03.014540+0000 osd.1 (osd.1) 293 : cluster [DBG] 2.15 scrub ok 2024-02-10T08:38:03.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:38:03.263918+0000 mon.a (mon.0) 1718 : audit [INF] from='client.? 172.21.15.18:0/2663618223' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:38:04.236 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-10T08:38:04.255 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:38:04.262 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:04.262 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:38:04.363 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:38:04.407 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:04.533 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:03.107237+0000 mgr.y (mgr.14505) 799 : cluster [DBG] pgmap v979: 178 pgs: 178 active+clean; 5.7 GiB data, 23 GiB used, 692 GiB / 715 GiB avail; 1.4 KiB/s rd, 84 MiB/s wr, 1.34k op/s 2024-02-10T08:38:04.533 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:03.270762+0000 mon.a (mon.0) 1719 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-10T08:38:04.534 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:03.270792+0000 mon.a (mon.0) 1720 : cluster [INF] Cluster is now healthy 2024-02-10T08:38:04.534 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:38:03.302613+0000 mon.a (mon.0) 1721 : audit [INF] from='client.? 172.21.15.18:0/2663618223' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-10T08:38:04.534 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:03.302662+0000 mon.a (mon.0) 1722 : cluster [DBG] osdmap e418: 8 total, 8 up, 8 in 2024-02-10T08:38:04.534 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:04.098733+0000 osd.4 (osd.4) 206 : cluster [DBG] 6.2 scrub starts 2024-02-10T08:38:04.534 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:04.099641+0000 osd.4 (osd.4) 207 : cluster [DBG] 6.2 scrub ok 2024-02-10T08:38:04.534 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 67 16 96364 96348 89.8375 68.6875 0.0163385 0.0111259 2024-02-10T08:38:04.534 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:03.107237+0000 mgr.y (mgr.14505) 799 : cluster [DBG] pgmap v979: 178 pgs: 178 active+clean; 5.7 GiB data, 23 GiB used, 692 GiB / 715 GiB avail; 1.4 KiB/s rd, 84 MiB/s wr, 1.34k op/s 2024-02-10T08:38:04.534 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:03.270762+0000 mon.a (mon.0) 1719 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-10T08:38:04.535 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:03.270792+0000 mon.a (mon.0) 1720 : cluster [INF] Cluster is now healthy 2024-02-10T08:38:04.535 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:38:03.302613+0000 mon.a (mon.0) 1721 : audit [INF] from='client.? 172.21.15.18:0/2663618223' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-10T08:38:04.535 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:03.302662+0000 mon.a (mon.0) 1722 : cluster [DBG] osdmap e418: 8 total, 8 up, 8 in 2024-02-10T08:38:04.535 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:04.098733+0000 osd.4 (osd.4) 206 : cluster [DBG] 6.2 scrub starts 2024-02-10T08:38:04.535 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:04.099641+0000 osd.4 (osd.4) 207 : cluster [DBG] 6.2 scrub ok 2024-02-10T08:38:04.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:03.107237+0000 mgr.y (mgr.14505) 799 : cluster [DBG] pgmap v979: 178 pgs: 178 active+clean; 5.7 GiB data, 23 GiB used, 692 GiB / 715 GiB avail; 1.4 KiB/s rd, 84 MiB/s wr, 1.34k op/s 2024-02-10T08:38:04.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:03.270762+0000 mon.a (mon.0) 1719 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-10T08:38:04.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:03.270792+0000 mon.a (mon.0) 1720 : cluster [INF] Cluster is now healthy 2024-02-10T08:38:04.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:38:03.302613+0000 mon.a (mon.0) 1721 : audit [INF] from='client.? 172.21.15.18:0/2663618223' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-10T08:38:04.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:03.302662+0000 mon.a (mon.0) 1722 : cluster [DBG] osdmap e418: 8 total, 8 up, 8 in 2024-02-10T08:38:04.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:04.098733+0000 osd.4 (osd.4) 206 : cluster [DBG] 6.2 scrub starts 2024-02-10T08:38:04.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:04.099641+0000 osd.4 (osd.4) 207 : cluster [DBG] 6.2 scrub ok 2024-02-10T08:38:05.173 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:38:05.180 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:05.180 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:38:05.281 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:38:05.342 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:05.533 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 68 16 97459 97443 89.522 68.4375 0.0178775 0.0111659 2024-02-10T08:38:05.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:04.311599+0000 osd.0 (osd.0) 264 : cluster [DBG] 6.9 scrub starts 2024-02-10T08:38:05.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:04.351840+0000 osd.0 (osd.0) 265 : cluster [DBG] 6.9 scrub ok 2024-02-10T08:38:05.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:04.311599+0000 osd.0 (osd.0) 264 : cluster [DBG] 6.9 scrub starts 2024-02-10T08:38:05.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:04.351840+0000 osd.0 (osd.0) 265 : cluster [DBG] 6.9 scrub ok 2024-02-10T08:38:05.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:04.311599+0000 osd.0 (osd.0) 264 : cluster [DBG] 6.9 scrub starts 2024-02-10T08:38:05.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:04.351840+0000 osd.0 (osd.0) 265 : cluster [DBG] 6.9 scrub ok 2024-02-10T08:38:06.534 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 69 16 98573 98557 89.2336 69.625 0.0203434 0.0112022 2024-02-10T08:38:06.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:04.853811+0000 osd.7 (osd.7) 287 : cluster [DBG] 5.10 scrub starts 2024-02-10T08:38:06.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:04.866843+0000 osd.7 (osd.7) 288 : cluster [DBG] 5.10 scrub ok 2024-02-10T08:38:06.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:05.107858+0000 mgr.y (mgr.14505) 800 : cluster [DBG] pgmap v981: 178 pgs: 178 active+clean; 5.8 GiB data, 24 GiB used, 692 GiB / 715 GiB avail; 744 B/s rd, 56 MiB/s wr, 890 op/s 2024-02-10T08:38:06.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:05.321785+0000 osd.5 (osd.5) 271 : cluster [DBG] 5.16 scrub starts 2024-02-10T08:38:06.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:05.327894+0000 osd.5 (osd.5) 272 : cluster [DBG] 5.16 scrub ok 2024-02-10T08:38:06.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:05.993213+0000 mon.a (mon.0) 1723 : cluster [DBG] osdmap e419: 8 total, 8 up, 8 in 2024-02-10T08:38:06.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:06.150584+0000 osd.4 (osd.4) 208 : cluster [DBG] 4.e scrub starts 2024-02-10T08:38:06.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:06.157498+0000 osd.4 (osd.4) 209 : cluster [DBG] 4.e scrub ok 2024-02-10T08:38:06.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:04.853811+0000 osd.7 (osd.7) 287 : cluster [DBG] 5.10 scrub starts 2024-02-10T08:38:06.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:04.866843+0000 osd.7 (osd.7) 288 : cluster [DBG] 5.10 scrub ok 2024-02-10T08:38:06.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:05.107858+0000 mgr.y (mgr.14505) 800 : cluster [DBG] pgmap v981: 178 pgs: 178 active+clean; 5.8 GiB data, 24 GiB used, 692 GiB / 715 GiB avail; 744 B/s rd, 56 MiB/s wr, 890 op/s 2024-02-10T08:38:06.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:05.321785+0000 osd.5 (osd.5) 271 : cluster [DBG] 5.16 scrub starts 2024-02-10T08:38:06.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:05.327894+0000 osd.5 (osd.5) 272 : cluster [DBG] 5.16 scrub ok 2024-02-10T08:38:06.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:05.993213+0000 mon.a (mon.0) 1723 : cluster [DBG] osdmap e419: 8 total, 8 up, 8 in 2024-02-10T08:38:06.657 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:06.150584+0000 osd.4 (osd.4) 208 : cluster [DBG] 4.e scrub starts 2024-02-10T08:38:06.657 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:06.157498+0000 osd.4 (osd.4) 209 : cluster [DBG] 4.e scrub ok 2024-02-10T08:38:06.789 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:38:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:38:06] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:38:06.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:04.853811+0000 osd.7 (osd.7) 287 : cluster [DBG] 5.10 scrub starts 2024-02-10T08:38:06.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:04.866843+0000 osd.7 (osd.7) 288 : cluster [DBG] 5.10 scrub ok 2024-02-10T08:38:06.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:05.107858+0000 mgr.y (mgr.14505) 800 : cluster [DBG] pgmap v981: 178 pgs: 178 active+clean; 5.8 GiB data, 24 GiB used, 692 GiB / 715 GiB avail; 744 B/s rd, 56 MiB/s wr, 890 op/s 2024-02-10T08:38:06.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:05.321785+0000 osd.5 (osd.5) 271 : cluster [DBG] 5.16 scrub starts 2024-02-10T08:38:06.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:05.327894+0000 osd.5 (osd.5) 272 : cluster [DBG] 5.16 scrub ok 2024-02-10T08:38:06.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:05.993213+0000 mon.a (mon.0) 1723 : cluster [DBG] osdmap e419: 8 total, 8 up, 8 in 2024-02-10T08:38:06.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:06.150584+0000 osd.4 (osd.4) 208 : cluster [DBG] 4.e scrub starts 2024-02-10T08:38:06.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:06.157498+0000 osd.4 (osd.4) 209 : cluster [DBG] 4.e scrub ok 2024-02-10T08:38:07.213 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.6 dump_historic_ops 2024-02-10T08:38:07.534 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 70 16 99683 99667 88.9493 69.375 0.0186747 0.0112384 2024-02-10T08:38:07.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:05.876791+0000 osd.7 (osd.7) 289 : cluster [DBG] 6.b scrub starts 2024-02-10T08:38:07.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:05.994974+0000 osd.7 (osd.7) 290 : cluster [DBG] 6.b scrub ok 2024-02-10T08:38:07.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:06.287683+0000 osd.0 (osd.0) 266 : cluster [DBG] 6.11 scrub starts 2024-02-10T08:38:07.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:06.292766+0000 osd.0 (osd.0) 267 : cluster [DBG] 6.11 scrub ok 2024-02-10T08:38:07.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:05.876791+0000 osd.7 (osd.7) 289 : cluster [DBG] 6.b scrub starts 2024-02-10T08:38:07.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:05.994974+0000 osd.7 (osd.7) 290 : cluster [DBG] 6.b scrub ok 2024-02-10T08:38:07.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:06.287683+0000 osd.0 (osd.0) 266 : cluster [DBG] 6.11 scrub starts 2024-02-10T08:38:07.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:06.292766+0000 osd.0 (osd.0) 267 : cluster [DBG] 6.11 scrub ok 2024-02-10T08:38:07.656 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:38:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:38:07] "GET /metrics HTTP/1.1" 200 176676 "" "Prometheus/2.33.4" 2024-02-10T08:38:07.657 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:05.876791+0000 osd.7 (osd.7) 289 : cluster [DBG] 6.b scrub starts 2024-02-10T08:38:07.657 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:05.994974+0000 osd.7 (osd.7) 290 : cluster [DBG] 6.b scrub ok 2024-02-10T08:38:07.657 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:06.287683+0000 osd.0 (osd.0) 266 : cluster [DBG] 6.11 scrub starts 2024-02-10T08:38:07.657 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:06.292766+0000 osd.0 (osd.0) 267 : cluster [DBG] 6.11 scrub ok 2024-02-10T08:38:07.681 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:38:08.536 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 71 16 100809 100793 88.6877 70.375 0.0112323 0.0112711 2024-02-10T08:38:08.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:06.865500+0000 osd.7 (osd.7) 291 : cluster [DBG] 6.1b scrub starts 2024-02-10T08:38:08.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:07.012875+0000 osd.7 (osd.7) 292 : cluster [DBG] 6.1b scrub ok 2024-02-10T08:38:08.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:07.108284+0000 mgr.y (mgr.14505) 801 : cluster [DBG] pgmap v983: 178 pgs: 178 active+clean; 5.8 GiB data, 24 GiB used, 692 GiB / 715 GiB avail; 835 B/s rd, 53 MiB/s wr, 845 op/s 2024-02-10T08:38:08.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:08.136266+0000 osd.1 (osd.1) 294 : cluster [DBG] 2.4 scrub starts 2024-02-10T08:38:08.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:08.140930+0000 osd.1 (osd.1) 295 : cluster [DBG] 2.4 scrub ok 2024-02-10T08:38:08.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:06.865500+0000 osd.7 (osd.7) 291 : cluster [DBG] 6.1b scrub starts 2024-02-10T08:38:08.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:07.012875+0000 osd.7 (osd.7) 292 : cluster [DBG] 6.1b scrub ok 2024-02-10T08:38:08.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:07.108284+0000 mgr.y (mgr.14505) 801 : cluster [DBG] pgmap v983: 178 pgs: 178 active+clean; 5.8 GiB data, 24 GiB used, 692 GiB / 715 GiB avail; 835 B/s rd, 53 MiB/s wr, 845 op/s 2024-02-10T08:38:08.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:08.136266+0000 osd.1 (osd.1) 294 : cluster [DBG] 2.4 scrub starts 2024-02-10T08:38:08.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:08.140930+0000 osd.1 (osd.1) 295 : cluster [DBG] 2.4 scrub ok 2024-02-10T08:38:08.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:06.865500+0000 osd.7 (osd.7) 291 : cluster [DBG] 6.1b scrub starts 2024-02-10T08:38:08.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:07.012875+0000 osd.7 (osd.7) 292 : cluster [DBG] 6.1b scrub ok 2024-02-10T08:38:08.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:07.108284+0000 mgr.y (mgr.14505) 801 : cluster [DBG] pgmap v983: 178 pgs: 178 active+clean; 5.8 GiB data, 24 GiB used, 692 GiB / 715 GiB avail; 835 B/s rd, 53 MiB/s wr, 845 op/s 2024-02-10T08:38:08.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:08.136266+0000 osd.1 (osd.1) 294 : cluster [DBG] 2.4 scrub starts 2024-02-10T08:38:08.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:08.140930+0000 osd.1 (osd.1) 295 : cluster [DBG] 2.4 scrub ok 2024-02-10T08:38:09.289 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:38:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:38:09.534 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 72 16 101950 101934 88.4463 71.3125 0.0187022 0.0113021 2024-02-10T08:38:09.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:07.869527+0000 osd.7 (osd.7) 293 : cluster [DBG] 6.2f deep-scrub starts 2024-02-10T08:38:09.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:08.045519+0000 osd.7 (osd.7) 294 : cluster [DBG] 6.2f deep-scrub ok 2024-02-10T08:38:09.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:08.292434+0000 osd.0 (osd.0) 268 : cluster [DBG] 2.1e deep-scrub starts 2024-02-10T08:38:09.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:08.296383+0000 osd.0 (osd.0) 269 : cluster [DBG] 2.1e deep-scrub ok 2024-02-10T08:38:09.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:09.180557+0000 osd.1 (osd.1) 296 : cluster [DBG] 6.1 scrub starts 2024-02-10T08:38:09.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:09.208545+0000 osd.1 (osd.1) 297 : cluster [DBG] 6.1 scrub ok 2024-02-10T08:38:09.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:07.869527+0000 osd.7 (osd.7) 293 : cluster [DBG] 6.2f deep-scrub starts 2024-02-10T08:38:09.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:08.045519+0000 osd.7 (osd.7) 294 : cluster [DBG] 6.2f deep-scrub ok 2024-02-10T08:38:09.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:08.292434+0000 osd.0 (osd.0) 268 : cluster [DBG] 2.1e deep-scrub starts 2024-02-10T08:38:09.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:08.296383+0000 osd.0 (osd.0) 269 : cluster [DBG] 2.1e deep-scrub ok 2024-02-10T08:38:09.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:09.180557+0000 osd.1 (osd.1) 296 : cluster [DBG] 6.1 scrub starts 2024-02-10T08:38:09.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:09.208545+0000 osd.1 (osd.1) 297 : cluster [DBG] 6.1 scrub ok 2024-02-10T08:38:09.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:07.869527+0000 osd.7 (osd.7) 293 : cluster [DBG] 6.2f deep-scrub starts 2024-02-10T08:38:09.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:08.045519+0000 osd.7 (osd.7) 294 : cluster [DBG] 6.2f deep-scrub ok 2024-02-10T08:38:09.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:08.292434+0000 osd.0 (osd.0) 268 : cluster [DBG] 2.1e deep-scrub starts 2024-02-10T08:38:09.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:08.296383+0000 osd.0 (osd.0) 269 : cluster [DBG] 2.1e deep-scrub ok 2024-02-10T08:38:09.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:09.180557+0000 osd.1 (osd.1) 296 : cluster [DBG] 6.1 scrub starts 2024-02-10T08:38:09.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:09.208545+0000 osd.1 (osd.1) 297 : cluster [DBG] 6.1 scrub ok 2024-02-10T08:38:10.404 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:38:08.861214+0000 mgr.y (mgr.14505) 802 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:38:10.404 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:08.906594+0000 osd.7 (osd.7) 295 : cluster [DBG] 2.1c scrub starts 2024-02-10T08:38:10.405 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:08.908014+0000 osd.7 (osd.7) 296 : cluster [DBG] 2.1c scrub ok 2024-02-10T08:38:10.418 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:38:10.424 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:10.424 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:38:10.455 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-02-10T08:38:10.455 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:38:10.525 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:38:10.534 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 73 16 103000 102984 88.1337 65.625 0.0137784 0.0113419 2024-02-10T08:38:10.575 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:10.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:38:08.861214+0000 mgr.y (mgr.14505) 802 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:38:10.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:08.906594+0000 osd.7 (osd.7) 295 : cluster [DBG] 2.1c scrub starts 2024-02-10T08:38:10.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:08.908014+0000 osd.7 (osd.7) 296 : cluster [DBG] 2.1c scrub ok 2024-02-10T08:38:10.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:09.110700+0000 mgr.y (mgr.14505) 803 : cluster [DBG] pgmap v984: 178 pgs: 1 active+clean+scrubbing+deep, 177 active+clean; 6.1 GiB data, 24 GiB used, 691 GiB / 715 GiB avail; 1.2 KiB/s rd, 80 MiB/s wr, 1.29k op/s 2024-02-10T08:38:10.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:09.364162+0000 osd.5 (osd.5) 273 : cluster [DBG] 6.2b scrub starts 2024-02-10T08:38:10.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:09.471396+0000 osd.5 (osd.5) 274 : cluster [DBG] 6.2b scrub ok 2024-02-10T08:38:10.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:10.102327+0000 osd.4 (osd.4) 210 : cluster [DBG] 4.13 scrub starts 2024-02-10T08:38:10.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:10.106745+0000 osd.4 (osd.4) 211 : cluster [DBG] 4.13 scrub ok 2024-02-10T08:38:10.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:38:08.861214+0000 mgr.y (mgr.14505) 802 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:38:10.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:08.906594+0000 osd.7 (osd.7) 295 : cluster [DBG] 2.1c scrub starts 2024-02-10T08:38:10.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:08.908014+0000 osd.7 (osd.7) 296 : cluster [DBG] 2.1c scrub ok 2024-02-10T08:38:10.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:09.110700+0000 mgr.y (mgr.14505) 803 : cluster [DBG] pgmap v984: 178 pgs: 1 active+clean+scrubbing+deep, 177 active+clean; 6.1 GiB data, 24 GiB used, 691 GiB / 715 GiB avail; 1.2 KiB/s rd, 80 MiB/s wr, 1.29k op/s 2024-02-10T08:38:10.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:09.364162+0000 osd.5 (osd.5) 273 : cluster [DBG] 6.2b scrub starts 2024-02-10T08:38:10.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:09.471396+0000 osd.5 (osd.5) 274 : cluster [DBG] 6.2b scrub ok 2024-02-10T08:38:10.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:10.102327+0000 osd.4 (osd.4) 210 : cluster [DBG] 4.13 scrub starts 2024-02-10T08:38:10.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:10.106745+0000 osd.4 (osd.4) 211 : cluster [DBG] 4.13 scrub ok 2024-02-10T08:38:10.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:09.110700+0000 mgr.y (mgr.14505) 803 : cluster [DBG] pgmap v984: 178 pgs: 1 active+clean+scrubbing+deep, 177 active+clean; 6.1 GiB data, 24 GiB used, 691 GiB / 715 GiB avail; 1.2 KiB/s rd, 80 MiB/s wr, 1.29k op/s 2024-02-10T08:38:10.791 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:09.364162+0000 osd.5 (osd.5) 273 : cluster [DBG] 6.2b scrub starts 2024-02-10T08:38:10.791 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:09.471396+0000 osd.5 (osd.5) 274 : cluster [DBG] 6.2b scrub ok 2024-02-10T08:38:10.791 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:10.102327+0000 osd.4 (osd.4) 210 : cluster [DBG] 4.13 scrub starts 2024-02-10T08:38:10.791 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:10.106745+0000 osd.4 (osd.4) 211 : cluster [DBG] 4.13 scrub ok 2024-02-10T08:38:11.535 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 74 16 104038 104022 87.8195 64.875 0.00613351 0.0113835 2024-02-10T08:38:11.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:09.875711+0000 osd.7 (osd.7) 297 : cluster [DBG] 2.8 scrub starts 2024-02-10T08:38:11.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:09.911353+0000 osd.7 (osd.7) 298 : cluster [DBG] 2.8 scrub ok 2024-02-10T08:38:11.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:10.350109+0000 osd.5 (osd.5) 275 : cluster [DBG] 6.31 scrub starts 2024-02-10T08:38:11.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:10.361206+0000 osd.5 (osd.5) 276 : cluster [DBG] 6.31 scrub ok 2024-02-10T08:38:11.892 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.7 dump_ops_in_flight 2024-02-10T08:38:11.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:09.875711+0000 osd.7 (osd.7) 297 : cluster [DBG] 2.8 scrub starts 2024-02-10T08:38:11.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:09.911353+0000 osd.7 (osd.7) 298 : cluster [DBG] 2.8 scrub ok 2024-02-10T08:38:11.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:10.350109+0000 osd.5 (osd.5) 275 : cluster [DBG] 6.31 scrub starts 2024-02-10T08:38:11.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:10.361206+0000 osd.5 (osd.5) 276 : cluster [DBG] 6.31 scrub ok 2024-02-10T08:38:11.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:09.875711+0000 osd.7 (osd.7) 297 : cluster [DBG] 2.8 scrub starts 2024-02-10T08:38:11.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:09.911353+0000 osd.7 (osd.7) 298 : cluster [DBG] 2.8 scrub ok 2024-02-10T08:38:11.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:10.350109+0000 osd.5 (osd.5) 275 : cluster [DBG] 6.31 scrub starts 2024-02-10T08:38:11.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:10.361206+0000 osd.5 (osd.5) 276 : cluster [DBG] 6.31 scrub ok 2024-02-10T08:38:12.346 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:38:12.409 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd set noscrub 2024-02-10T08:38:12.535 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 75 16 105061 105045 87.5011 63.9375 0.0191478 0.0114235 2024-02-10T08:38:12.654 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:38:12.662 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:12.663 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:38:12.669 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:11.113611+0000 mgr.y (mgr.14505) 804 : cluster [DBG] pgmap v985: 178 pgs: 1 active+clean+scrubbing+deep, 177 active+clean; 6.1 GiB data, 25 GiB used, 691 GiB / 715 GiB avail; 639 B/s rd, 50 MiB/s wr, 802 op/s 2024-02-10T08:38:12.669 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:11.203406+0000 osd.6 (osd.6) 269 : cluster [DBG] 6.2e deep-scrub starts 2024-02-10T08:38:12.669 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:11.227471+0000 osd.6 (osd.6) 270 : cluster [DBG] 6.2e deep-scrub ok 2024-02-10T08:38:12.669 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:11.339852+0000 osd.0 (osd.0) 270 : cluster [DBG] 4.b deep-scrub starts 2024-02-10T08:38:12.669 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:11.355890+0000 osd.0 (osd.0) 271 : cluster [DBG] 4.b deep-scrub ok 2024-02-10T08:38:12.670 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:11.378196+0000 osd.5 (osd.5) 277 : cluster [DBG] 6.19 scrub starts 2024-02-10T08:38:12.670 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:11.403465+0000 osd.5 (osd.5) 278 : cluster [DBG] 6.19 scrub ok 2024-02-10T08:38:12.670 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:12.143251+0000 osd.1 (osd.1) 298 : cluster [DBG] 6.4 scrub starts 2024-02-10T08:38:12.670 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:12.151681+0000 osd.1 (osd.1) 299 : cluster [DBG] 6.4 scrub ok 2024-02-10T08:38:12.670 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:11.113611+0000 mgr.y (mgr.14505) 804 : cluster [DBG] pgmap v985: 178 pgs: 1 active+clean+scrubbing+deep, 177 active+clean; 6.1 GiB data, 25 GiB used, 691 GiB / 715 GiB avail; 639 B/s rd, 50 MiB/s wr, 802 op/s 2024-02-10T08:38:12.670 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:11.203406+0000 osd.6 (osd.6) 269 : cluster [DBG] 6.2e deep-scrub starts 2024-02-10T08:38:12.670 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:11.227471+0000 osd.6 (osd.6) 270 : cluster [DBG] 6.2e deep-scrub ok 2024-02-10T08:38:12.670 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:11.339852+0000 osd.0 (osd.0) 270 : cluster [DBG] 4.b deep-scrub starts 2024-02-10T08:38:12.670 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:11.355890+0000 osd.0 (osd.0) 271 : cluster [DBG] 4.b deep-scrub ok 2024-02-10T08:38:12.670 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:11.378196+0000 osd.5 (osd.5) 277 : cluster [DBG] 6.19 scrub starts 2024-02-10T08:38:12.671 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:11.403465+0000 osd.5 (osd.5) 278 : cluster [DBG] 6.19 scrub ok 2024-02-10T08:38:12.671 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:12.143251+0000 osd.1 (osd.1) 298 : cluster [DBG] 6.4 scrub starts 2024-02-10T08:38:12.671 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:12.151681+0000 osd.1 (osd.1) 299 : cluster [DBG] 6.4 scrub ok 2024-02-10T08:38:12.676 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:38:12.717 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:11.113611+0000 mgr.y (mgr.14505) 804 : cluster [DBG] pgmap v985: 178 pgs: 1 active+clean+scrubbing+deep, 177 active+clean; 6.1 GiB data, 25 GiB used, 691 GiB / 715 GiB avail; 639 B/s rd, 50 MiB/s wr, 802 op/s 2024-02-10T08:38:12.717 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:11.203406+0000 osd.6 (osd.6) 269 : cluster [DBG] 6.2e deep-scrub starts 2024-02-10T08:38:12.717 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:11.227471+0000 osd.6 (osd.6) 270 : cluster [DBG] 6.2e deep-scrub ok 2024-02-10T08:38:12.717 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:11.339852+0000 osd.0 (osd.0) 270 : cluster [DBG] 4.b deep-scrub starts 2024-02-10T08:38:12.718 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:11.355890+0000 osd.0 (osd.0) 271 : cluster [DBG] 4.b deep-scrub ok 2024-02-10T08:38:12.718 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:11.378196+0000 osd.5 (osd.5) 277 : cluster [DBG] 6.19 scrub starts 2024-02-10T08:38:12.718 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:11.403465+0000 osd.5 (osd.5) 278 : cluster [DBG] 6.19 scrub ok 2024-02-10T08:38:12.718 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:12.143251+0000 osd.1 (osd.1) 298 : cluster [DBG] 6.4 scrub starts 2024-02-10T08:38:12.718 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:12.151681+0000 osd.1 (osd.1) 299 : cluster [DBG] 6.4 scrub ok 2024-02-10T08:38:12.764 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:38:12.835 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:12.934 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:38:12.937 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:12.937 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:38:13.038 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:38:13.091 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:13.121 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:38:13.127 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:13.127 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:38:13.228 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:38:13.270 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:13.329 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:38:13.345 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-02-10T08:38:13.400 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:38:13.403 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:13.403 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:38:13.504 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:38:13.535 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 76 16 105922 105906 87.0579 53.8125 0.00377709 0.0114762 2024-02-10T08:38:13.537 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:11.706876+0000 osd.2 (osd.2) 259 : cluster [DBG] 11.d scrub starts 2024-02-10T08:38:13.537 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:12.156309+0000 osd.7 (osd.7) 299 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:38:13.538 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:12.156347+0000 osd.7 (osd.7) 300 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:38:13.538 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:13.012590+0000 mon.a (mon.0) 1724 : cluster [DBG] osdmap e420: 8 total, 8 up, 8 in 2024-02-10T08:38:13.540 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:13.561 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:38:13.564 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:13.565 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:38:13.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:11.706876+0000 osd.2 (osd.2) 259 : cluster [DBG] 11.d scrub starts 2024-02-10T08:38:13.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:12.156309+0000 osd.7 (osd.7) 299 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:38:13.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:12.156347+0000 osd.7 (osd.7) 300 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:38:13.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:13.012590+0000 mon.a (mon.0) 1724 : cluster [DBG] osdmap e420: 8 total, 8 up, 8 in 2024-02-10T08:38:13.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:11.706876+0000 osd.2 (osd.2) 259 : cluster [DBG] 11.d scrub starts 2024-02-10T08:38:13.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:12.156309+0000 osd.7 (osd.7) 299 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:38:13.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:12.156347+0000 osd.7 (osd.7) 300 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:38:13.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:13.012590+0000 mon.a (mon.0) 1724 : cluster [DBG] osdmap e420: 8 total, 8 up, 8 in 2024-02-10T08:38:13.665 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:38:13.697 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:14.455 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:13.115117+0000 mgr.y (mgr.14505) 805 : cluster [DBG] pgmap v987: 178 pgs: 1 active+clean+scrubbing, 177 active+clean; 6.4 GiB data, 25 GiB used, 690 GiB / 715 GiB avail; 1.2 KiB/s rd, 76 MiB/s wr, 1.22k op/s 2024-02-10T08:38:14.455 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:38:13.301754+0000 mgr.y (mgr.14505) 806 : audit [DBG] from='client.25627 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-10T08:38:14.536 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 77 16 106694 106678 86.5524 48.25 0.0174993 0.0115493 2024-02-10T08:38:14.551 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:38:14.563 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:14.564 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:38:14.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:13.115117+0000 mgr.y (mgr.14505) 805 : cluster [DBG] pgmap v987: 178 pgs: 1 active+clean+scrubbing, 177 active+clean; 6.4 GiB data, 25 GiB used, 690 GiB / 715 GiB avail; 1.2 KiB/s rd, 76 MiB/s wr, 1.22k op/s 2024-02-10T08:38:14.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:38:13.301754+0000 mgr.y (mgr.14505) 806 : audit [DBG] from='client.25627 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-10T08:38:14.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:13.115117+0000 mgr.y (mgr.14505) 805 : cluster [DBG] pgmap v987: 178 pgs: 1 active+clean+scrubbing, 177 active+clean; 6.4 GiB data, 25 GiB used, 690 GiB / 715 GiB avail; 1.2 KiB/s rd, 76 MiB/s wr, 1.22k op/s 2024-02-10T08:38:14.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:38:13.301754+0000 mgr.y (mgr.14505) 806 : audit [DBG] from='client.25627 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-10T08:38:14.664 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:38:14.732 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:14.747 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":987,"stamp":"2024-02-10T08:38:13.114848+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6852974244,"num_objects":104760,"num_object_clones":0,"num_object_copies":314280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104760,"num_whiteouts":0,"num_read":2814,"num_read_kb":2566,"num_write":105567,"num_write_kb":6692392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":230,"num_bytes_recovered":7872,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":73799,"ondisk_log_size":73799,"up":534,"acting":534,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":534,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":26539692,"kb_used_data":19993260,"kb_used_omap":0,"kb_used_meta":6546367,"kb_avail":723421524,"statfs":{"total":767960285184,"available":740783640576,"internally_reserved":0,"allocated":20473098240,"data_stored":20469279972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":972,"internal_metadata":6703479860},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":637140992,"num_objects":9722,"num_object_clones":0,"num_object_copies":29166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9722,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":9722,"num_write_kb":622208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.007443"},"pg_stats":[{"pgid":"6.33","version":"0'0","reported_seq":317,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.302485+0000","last_change":"2024-02-10T08:37:59.522504+0000","last_active":"2024-02-10T08:38:03.302485+0000","last_peered":"2024-02-10T08:38:03.302485+0000","last_clean":"2024-02-10T08:38:03.302485+0000","last_became_active":"2024-02-10T08:30:26.080326+0000","last_became_peered":"2024-02-10T08:30:26.080326+0000","last_unstale":"2024-02-10T08:38:03.302485+0000","last_undegraded":"2024-02-10T08:38:03.302485+0000","last_fullsized":"2024-02-10T08:38:03.302485+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:59.522408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:37:59.522408+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2],"acting":[5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":420,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.306238+0000","last_change":"2024-02-10T08:36:54.916630+0000","last_active":"2024-02-10T08:38:03.306238+0000","last_peered":"2024-02-10T08:38:03.306238+0000","last_clean":"2024-02-10T08:38:03.306238+0000","last_became_active":"2024-02-10T08:30:26.067019+0000","last_became_peered":"2024-02-10T08:30:26.067019+0000","last_unstale":"2024-02-10T08:38:03.306238+0000","last_undegraded":"2024-02-10T08:38:03.306238+0000","last_fullsized":"2024-02-10T08:38:03.306238+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:54.916549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:33:31.389113+0000","last_clean_scrub_stamp":"2024-02-10T08:36:54.916549+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"419'6587","reported_seq":6616,"reported_epoch":419,"state":"active+clean","last_fresh":"2024-02-10T08:38:12.791446+0000","last_change":"2024-02-10T08:36:45.138604+0000","last_active":"2024-02-10T08:38:12.791446+0000","last_peered":"2024-02-10T08:38:12.791446+0000","last_clean":"2024-02-10T08:38:12.791446+0000","last_became_active":"2024-02-10T08:36:45.138356+0000","last_became_peered":"2024-02-10T08:36:45.138356+0000","last_unstale":"2024-02-10T08:38:12.791446+0000","last_undegraded":"2024-02-10T08:38:12.791446+0000","last_fullsized":"2024-02-10T08:38:12.791446+0000","mapping_epoch":398,"log_start":"402'2023","ondisk_log_start":"402'2023","created":398,"last_epoch_clean":399,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_clean_scrub_stamp":"2024-02-10T08:36:44.122988+0000","log_size":4564,"ondisk_log_size":4564,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":431685632,"num_objects":6587,"num_object_clones":0,"num_object_copies":19761,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6587,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6587,"num_write_kb":421568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,4],"acting":[5,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"111'10","reported_seq":690,"reported_epoch":419,"state":"active+clean","last_fresh":"2024-02-10T08:38:06.264948+0000","last_change":"2024-02-10T08:37:58.751146+0000","last_active":"2024-02-10T08:38:06.264948+0000","last_peered":"2024-02-10T08:38:06.264948+0000","last_clean":"2024-02-10T08:38:06.264948+0000","last_became_active":"2024-02-10T08:20:46.399193+0000","last_became_peered":"2024-02-10T08:20:46.399193+0000","last_unstale":"2024-02-10T08:38:06.264948+0000","last_undegraded":"2024-02-10T08:38:06.264948+0000","last_fullsized":"2024-02-10T08:38:06.264948+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'10","last_scrub_stamp":"2024-02-10T08:37:58.751027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:37:58.751027+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"402'39","reported_seq":461,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.302779+0000","last_change":"2024-02-10T08:37:24.105215+0000","last_active":"2024-02-10T08:38:03.302779+0000","last_peered":"2024-02-10T08:38:03.302779+0000","last_clean":"2024-02-10T08:38:03.302779+0000","last_became_active":"2024-02-10T08:16:55.204597+0000","last_became_peered":"2024-02-10T08:16:55.204597+0000","last_unstale":"2024-02-10T08:38:03.302779+0000","last_undegraded":"2024-02-10T08:38:03.302779+0000","last_fullsized":"2024-02-10T08:38:03.302779+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'39","last_scrub_stamp":"2024-02-10T08:37:24.105128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:37:24.105128+0000","log_size":39,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":62,"num_read_kb":53,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":443,"reported_epoch":419,"state":"active+clean","last_fresh":"2024-02-10T08:38:06.007312+0000","last_change":"2024-02-10T08:37:09.466048+0000","last_active":"2024-02-10T08:38:06.007312+0000","last_peered":"2024-02-10T08:38:06.007312+0000","last_clean":"2024-02-10T08:38:06.007312+0000","last_became_active":"2024-02-10T08:32:20.330612+0000","last_became_peered":"2024-02-10T08:32:20.330612+0000","last_unstale":"2024-02-10T08:38:06.007312+0000","last_undegraded":"2024-02-10T08:38:06.007312+0000","last_fullsized":"2024-02-10T08:38:06.007312+0000","mapping_epoch":331,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":332,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:09.465954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:29:24.554978+0000","last_clean_scrub_stamp":"2024-02-10T08:37:09.465954+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":423,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.302886+0000","last_change":"2024-02-10T08:38:02.402469+0000","last_active":"2024-02-10T08:38:03.302886+0000","last_peered":"2024-02-10T08:38:03.302886+0000","last_clean":"2024-02-10T08:38:03.302886+0000","last_became_active":"2024-02-10T08:30:24.062795+0000","last_became_peered":"2024-02-10T08:30:24.062795+0000","last_unstale":"2024-02-10T08:38:03.302886+0000","last_undegraded":"2024-02-10T08:38:03.302886+0000","last_fullsized":"2024-02-10T08:38:03.302886+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:38:02.402363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:20.392249+0000","last_clean_scrub_stamp":"2024-02-10T08:38:02.402363+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"419'6620","reported_seq":6649,"reported_epoch":419,"state":"active+clean","last_fresh":"2024-02-10T08:38:12.922407+0000","last_change":"2024-02-10T08:36:45.141649+0000","last_active":"2024-02-10T08:38:12.922407+0000","last_peered":"2024-02-10T08:38:12.922407+0000","last_clean":"2024-02-10T08:38:12.922407+0000","last_became_active":"2024-02-10T08:36:45.141344+0000","last_became_peered":"2024-02-10T08:36:45.141344+0000","last_unstale":"2024-02-10T08:38:12.922407+0000","last_undegraded":"2024-02-10T08:38:12.922407+0000","last_fullsized":"2024-02-10T08:38:12.922407+0000","mapping_epoch":398,"log_start":"403'2606","ondisk_log_start":"403'2606","created":398,"last_epoch_clean":399,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_clean_scrub_stamp":"2024-02-10T08:36:44.122988+0000","log_size":4014,"ondisk_log_size":4014,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":433848320,"num_objects":6620,"num_object_clones":0,"num_object_copies":19860,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6620,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6620,"num_write_kb":423680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"402'21","reported_seq":219,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.323851+0000","last_change":"2024-02-10T08:35:10.248379+0000","last_active":"2024-02-10T08:38:03.323851+0000","last_peered":"2024-02-10T08:38:03.323851+0000","last_clean":"2024-02-10T08:38:03.323851+0000","last_became_active":"2024-02-10T08:28:02.770508+0000","last_became_peered":"2024-02-10T08:28:02.770508+0000","last_unstale":"2024-02-10T08:38:03.323851+0000","last_undegraded":"2024-02-10T08:38:03.323851+0000","last_fullsized":"2024-02-10T08:38:03.323851+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'15","last_scrub_stamp":"2024-02-10T08:35:10.248283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:35:10.248283+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":34,"num_read_kb":28,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":418,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.316245+0000","last_change":"2024-02-10T08:37:13.005099+0000","last_active":"2024-02-10T08:38:03.316245+0000","last_peered":"2024-02-10T08:38:03.316245+0000","last_clean":"2024-02-10T08:38:03.316245+0000","last_became_active":"2024-02-10T08:20:46.407311+0000","last_became_peered":"2024-02-10T08:20:46.407311+0000","last_unstale":"2024-02-10T08:38:03.316245+0000","last_undegraded":"2024-02-10T08:38:03.316245+0000","last_fullsized":"2024-02-10T08:38:03.316245+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:13.004991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:21.523096+0000","last_clean_scrub_stamp":"2024-02-10T08:37:13.004991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":456,"reported_epoch":419,"state":"active+clean","last_fresh":"2024-02-10T08:38:06.007884+0000","last_change":"2024-02-10T08:37:23.628086+0000","last_active":"2024-02-10T08:38:06.007884+0000","last_peered":"2024-02-10T08:38:06.007884+0000","last_clean":"2024-02-10T08:38:06.007884+0000","last_became_active":"2024-02-10T08:31:33.882809+0000","last_became_peered":"2024-02-10T08:31:33.882809+0000","last_unstale":"2024-02-10T08:38:06.007884+0000","last_undegraded":"2024-02-10T08:38:06.007884+0000","last_fullsized":"2024-02-10T08:38:06.007884+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:23.627965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:37:23.627965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"76'2","reported_seq":99,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:04.351970+0000","last_change":"2024-02-10T08:38:04.351942+0000","last_active":"2024-02-10T08:38:04.351970+0000","last_peered":"2024-02-10T08:38:04.351970+0000","last_clean":"2024-02-10T08:38:04.351970+0000","last_became_active":"2024-02-10T08:32:36.979100+0000","last_became_peered":"2024-02-10T08:32:36.979100+0000","last_unstale":"2024-02-10T08:38:04.351970+0000","last_undegraded":"2024-02-10T08:38:04.351970+0000","last_fullsized":"2024-02-10T08:38:04.351970+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'2","last_scrub_stamp":"2024-02-10T08:38:04.351855+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2024-02-10T08:18:08.680038+0000","last_clean_scrub_stamp":"2024-02-10T08:38:04.351855+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.5","version":"419'6471","reported_seq":6500,"reported_epoch":419,"state":"active+clean","last_fresh":"2024-02-10T08:38:12.920876+0000","last_change":"2024-02-10T08:36:45.141686+0000","last_active":"2024-02-10T08:38:12.920876+0000","last_peered":"2024-02-10T08:38:12.920876+0000","last_clean":"2024-02-10T08:38:12.920876+0000","last_became_active":"2024-02-10T08:36:45.141444+0000","last_became_peered":"2024-02-10T08:36:45.141444+0000","last_unstale":"2024-02-10T08:38:12.920876+0000","last_undegraded":"2024-02-10T08:38:12.920876+0000","last_fullsized":"2024-02-10T08:38:12.920876+0000","mapping_epoch":398,"log_start":"403'2424","ondisk_log_start":"403'2424","created":398,"last_epoch_clean":399,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_clean_scrub_stamp":"2024-02-10T08:36:44.122988+0000","log_size":4047,"ondisk_log_size":4047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":424083456,"num_objects":6471,"num_object_clones":0,"num_object_copies":19413,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6471,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6471,"num_write_kb":414144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"402'60","reported_seq":488,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.304932+0000","last_change":"2024-02-10T08:36:15.980603+0000","last_active":"2024-02-10T08:38:03.304932+0000","last_peered":"2024-02-10T08:38:03.304932+0000","last_clean":"2024-02-10T08:38:03.304932+0000","last_became_active":"2024-02-10T08:16:55.203415+0000","last_became_peered":"2024-02-10T08:16:55.203415+0000","last_unstale":"2024-02-10T08:38:03.304932+0000","last_undegraded":"2024-02-10T08:38:03.304932+0000","last_fullsized":"2024-02-10T08:38:03.304932+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"391'44","last_scrub_stamp":"2024-02-10T08:36:15.980533+0000","last_deep_scrub":"391'44","last_deep_scrub_stamp":"2024-02-10T08:36:15.980533+0000","last_clean_scrub_stamp":"2024-02-10T08:36:15.980533+0000","log_size":60,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":80,"num_read_kb":69,"num_write":52,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":432,"reported_epoch":419,"state":"active+clean","last_fresh":"2024-02-10T08:38:06.006994+0000","last_change":"2024-02-10T08:37:22.601947+0000","last_active":"2024-02-10T08:38:06.006994+0000","last_peered":"2024-02-10T08:38:06.006994+0000","last_clean":"2024-02-10T08:38:06.006994+0000","last_became_active":"2024-02-10T08:28:02.781029+0000","last_became_peered":"2024-02-10T08:28:02.781029+0000","last_unstale":"2024-02-10T08:38:06.006994+0000","last_undegraded":"2024-02-10T08:38:06.006994+0000","last_fullsized":"2024-02-10T08:38:06.006994+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:22.601837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:37:22.601837+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":423,"reported_epoch":419,"state":"active+clean","last_fresh":"2024-02-10T08:38:06.005889+0000","last_change":"2024-02-10T08:37:02.347418+0000","last_active":"2024-02-10T08:38:06.005889+0000","last_peered":"2024-02-10T08:38:06.005889+0000","last_clean":"2024-02-10T08:38:06.005889+0000","last_became_active":"2024-02-10T08:28:02.779438+0000","last_became_peered":"2024-02-10T08:28:02.779438+0000","last_unstale":"2024-02-10T08:38:06.005889+0000","last_undegraded":"2024-02-10T08:38:06.005889+0000","last_fullsized":"2024-02-10T08:38:06.005889+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:02.347279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.593849+0000","last_clean_scrub_stamp":"2024-02-10T08:37:02.347279+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":409,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.309284+0000","last_change":"2024-02-10T08:37:07.611471+0000","last_active":"2024-02-10T08:38:03.309284+0000","last_peered":"2024-02-10T08:38:03.309284+0000","last_clean":"2024-02-10T08:38:03.309284+0000","last_became_active":"2024-02-10T08:24:18.645480+0000","last_became_peered":"2024-02-10T08:24:18.645480+0000","last_unstale":"2024-02-10T08:38:03.309284+0000","last_undegraded":"2024-02-10T08:38:03.309284+0000","last_fullsized":"2024-02-10T08:38:03.309284+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:07.611383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:37:07.611383+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,3],"acting":[7,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.8","version":"0'0","reported_seq":17,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.302809+0000","last_change":"2024-02-10T08:37:45.981708+0000","last_active":"2024-02-10T08:38:03.302809+0000","last_peered":"2024-02-10T08:38:03.302809+0000","last_clean":"2024-02-10T08:38:03.302809+0000","last_became_active":"2024-02-10T08:37:45.981258+0000","last_became_peered":"2024-02-10T08:37:45.981258+0000","last_unstale":"2024-02-10T08:38:03.302809+0000","last_undegraded":"2024-02-10T08:38:03.302809+0000","last_fullsized":"2024-02-10T08:38:03.302809+0000","mapping_epoch":411,"log_start":"0'0","ondisk_log_start":"0'0","created":409,"last_epoch_clean":412,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:04.577168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:14:44.584370+0000","last_clean_scrub_stamp":"2024-02-10T08:37:04.577168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2","version":"420'6513","reported_seq":6543,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-10T08:38:13.038241+0000","last_change":"2024-02-10T08:36:45.372419+0000","last_active":"2024-02-10T08:38:13.038241+0000","last_peered":"2024-02-10T08:38:13.038241+0000","last_clean":"2024-02-10T08:38:13.038241+0000","last_became_active":"2024-02-10T08:36:45.372098+0000","last_became_peered":"2024-02-10T08:36:45.372098+0000","last_unstale":"2024-02-10T08:38:13.038241+0000","last_undegraded":"2024-02-10T08:38:13.038241+0000","last_fullsized":"2024-02-10T08:38:13.038241+0000","mapping_epoch":398,"log_start":"402'1200","ondisk_log_start":"402'1200","created":398,"last_epoch_clean":399,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_clean_scrub_stamp":"2024-02-10T08:36:44.122988+0000","log_size":5313,"ondisk_log_size":5313,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":426835968,"num_objects":6513,"num_object_clones":0,"num_object_copies":19539,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6513,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6513,"num_write_kb":416832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"402'45","reported_seq":165,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.306518+0000","last_change":"2024-02-10T08:37:56.090425+0000","last_active":"2024-02-10T08:38:03.306518+0000","last_peered":"2024-02-10T08:38:03.306518+0000","last_clean":"2024-02-10T08:38:03.306518+0000","last_became_active":"2024-02-10T08:31:46.070488+0000","last_became_peered":"2024-02-10T08:31:46.070488+0000","last_unstale":"2024-02-10T08:38:03.306518+0000","last_undegraded":"2024-02-10T08:38:03.306518+0000","last_fullsized":"2024-02-10T08:38:03.306518+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'45","last_scrub_stamp":"2024-02-10T08:37:56.090345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:37:56.090345+0000","log_size":45,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":69,"num_read_kb":59,"num_write":46,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":454,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.309668+0000","last_change":"2024-02-10T08:36:56.517345+0000","last_active":"2024-02-10T08:38:03.309668+0000","last_peered":"2024-02-10T08:38:03.309668+0000","last_clean":"2024-02-10T08:38:03.309668+0000","last_became_active":"2024-02-10T08:20:46.399568+0000","last_became_peered":"2024-02-10T08:20:46.399568+0000","last_unstale":"2024-02-10T08:38:03.309668+0000","last_undegraded":"2024-02-10T08:38:03.309668+0000","last_fullsized":"2024-02-10T08:38:03.309668+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:56.517278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:36:56.517278+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":427,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.314988+0000","last_change":"2024-02-10T08:36:28.930123+0000","last_active":"2024-02-10T08:38:03.314988+0000","last_peered":"2024-02-10T08:38:03.314988+0000","last_clean":"2024-02-10T08:38:03.314988+0000","last_became_active":"2024-02-10T08:28:02.764210+0000","last_became_peered":"2024-02-10T08:28:02.764210+0000","last_unstale":"2024-02-10T08:38:03.314988+0000","last_undegraded":"2024-02-10T08:38:03.314988+0000","last_fullsized":"2024-02-10T08:38:03.314988+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:28.929999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:36:28.929999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":374,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.325213+0000","last_change":"2024-02-10T08:37:24.302139+0000","last_active":"2024-02-10T08:38:03.325213+0000","last_peered":"2024-02-10T08:38:03.325213+0000","last_clean":"2024-02-10T08:38:03.325213+0000","last_became_active":"2024-02-10T08:31:33.883457+0000","last_became_peered":"2024-02-10T08:31:33.883457+0000","last_unstale":"2024-02-10T08:38:03.325213+0000","last_undegraded":"2024-02-10T08:38:03.325213+0000","last_fullsized":"2024-02-10T08:38:03.325213+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:24.302030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:34.215363+0000","last_clean_scrub_stamp":"2024-02-10T08:37:24.302030+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.9","version":"0'0","reported_seq":443,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.309534+0000","last_change":"2024-02-10T08:37:45.988498+0000","last_active":"2024-02-10T08:38:03.309534+0000","last_peered":"2024-02-10T08:38:03.309534+0000","last_clean":"2024-02-10T08:38:03.309534+0000","last_became_active":"2024-02-10T08:37:45.988211+0000","last_became_peered":"2024-02-10T08:37:45.988211+0000","last_unstale":"2024-02-10T08:38:03.309534+0000","last_undegraded":"2024-02-10T08:38:03.309534+0000","last_fullsized":"2024-02-10T08:38:03.309534+0000","mapping_epoch":411,"log_start":"0'0","ondisk_log_start":"0'0","created":409,"last_epoch_clean":412,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:04.577168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:14:44.584370+0000","last_clean_scrub_stamp":"2024-02-10T08:37:04.577168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3","version":"419'6541","reported_seq":6570,"reported_epoch":419,"state":"active+clean","last_fresh":"2024-02-10T08:38:12.912833+0000","last_change":"2024-02-10T08:36:45.142338+0000","last_active":"2024-02-10T08:38:12.912833+0000","last_peered":"2024-02-10T08:38:12.912833+0000","last_clean":"2024-02-10T08:38:12.912833+0000","last_became_active":"2024-02-10T08:36:45.141955+0000","last_became_peered":"2024-02-10T08:36:45.141955+0000","last_unstale":"2024-02-10T08:38:12.912833+0000","last_undegraded":"2024-02-10T08:38:12.912833+0000","last_fullsized":"2024-02-10T08:38:12.912833+0000","mapping_epoch":398,"log_start":"402'1850","ondisk_log_start":"402'1850","created":398,"last_epoch_clean":399,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_clean_scrub_stamp":"2024-02-10T08:36:44.122988+0000","log_size":4691,"ondisk_log_size":4691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":428670976,"num_objects":6541,"num_object_clones":0,"num_object_copies":19623,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6541,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6541,"num_write_kb":418624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1],"acting":[6,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"402'30","reported_seq":432,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.307122+0000","last_change":"2024-02-10T08:37:24.873474+0000","last_active":"2024-02-10T08:38:03.307122+0000","last_peered":"2024-02-10T08:38:03.307122+0000","last_clean":"2024-02-10T08:38:03.307122+0000","last_became_active":"2024-02-10T08:20:46.398973+0000","last_became_peered":"2024-02-10T08:20:46.398973+0000","last_unstale":"2024-02-10T08:38:03.307122+0000","last_undegraded":"2024-02-10T08:38:03.307122+0000","last_fullsized":"2024-02-10T08:38:03.307122+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'30","last_scrub_stamp":"2024-02-10T08:37:24.873377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:37:24.873377+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":39,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":405,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.314398+0000","last_change":"2024-02-10T08:37:59.089719+0000","last_active":"2024-02-10T08:38:03.314398+0000","last_peered":"2024-02-10T08:38:03.314398+0000","last_clean":"2024-02-10T08:38:03.314398+0000","last_became_active":"2024-02-10T08:16:52.785545+0000","last_became_peered":"2024-02-10T08:16:52.785545+0000","last_unstale":"2024-02-10T08:38:03.314398+0000","last_undegraded":"2024-02-10T08:38:03.314398+0000","last_fullsized":"2024-02-10T08:38:03.314398+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:59.089618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:37:59.089618+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"62'8","reported_seq":669,"reported_epoch":419,"state":"active+clean","last_fresh":"2024-02-10T08:38:11.266683+0000","last_change":"2024-02-10T08:37:04.315586+0000","last_active":"2024-02-10T08:38:11.266683+0000","last_peered":"2024-02-10T08:38:11.266683+0000","last_clean":"2024-02-10T08:38:11.266683+0000","last_became_active":"2024-02-10T08:16:56.858101+0000","last_became_peered":"2024-02-10T08:16:56.858101+0000","last_unstale":"2024-02-10T08:38:11.266683+0000","last_undegraded":"2024-02-10T08:38:11.266683+0000","last_fullsized":"2024-02-10T08:38:11.266683+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'8","last_scrub_stamp":"2024-02-10T08:37:04.315488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:37:04.315488+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":376,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.306742+0000","last_change":"2024-02-10T08:36:27.252813+0000","last_active":"2024-02-10T08:38:03.306742+0000","last_peered":"2024-02-10T08:38:03.306742+0000","last_clean":"2024-02-10T08:38:03.306742+0000","last_became_active":"2024-02-10T08:30:24.071020+0000","last_became_peered":"2024-02-10T08:30:24.071020+0000","last_unstale":"2024-02-10T08:38:03.306742+0000","last_undegraded":"2024-02-10T08:38:03.306742+0000","last_fullsized":"2024-02-10T08:38:03.306742+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:27.252710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:33:29.477480+0000","last_clean_scrub_stamp":"2024-02-10T08:36:27.252710+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.a","version":"0'0","reported_seq":17,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.302737+0000","last_change":"2024-02-10T08:37:45.980784+0000","last_active":"2024-02-10T08:38:03.302737+0000","last_peered":"2024-02-10T08:38:03.302737+0000","last_clean":"2024-02-10T08:38:03.302737+0000","last_became_active":"2024-02-10T08:37:45.980492+0000","last_became_peered":"2024-02-10T08:37:45.980492+0000","last_unstale":"2024-02-10T08:38:03.302737+0000","last_undegraded":"2024-02-10T08:38:03.302737+0000","last_fullsized":"2024-02-10T08:38:03.302737+0000","mapping_epoch":411,"log_start":"0'0","ondisk_log_start":"0'0","created":409,"last_epoch_clean":412,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:04.577168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:14:44.584370+0000","last_clean_scrub_stamp":"2024-02-10T08:37:04.577168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.0","version":"419'6672","reported_seq":6701,"reported_epoch":419,"state":"active+clean","last_fresh":"2024-02-10T08:38:12.949984+0000","last_change":"2024-02-10T08:36:45.373529+0000","last_active":"2024-02-10T08:38:12.949984+0000","last_peered":"2024-02-10T08:38:12.949984+0000","last_clean":"2024-02-10T08:38:12.949984+0000","last_became_active":"2024-02-10T08:36:45.373241+0000","last_became_peered":"2024-02-10T08:36:45.373241+0000","last_unstale":"2024-02-10T08:38:12.949984+0000","last_undegraded":"2024-02-10T08:38:12.949984+0000","last_fullsized":"2024-02-10T08:38:12.949984+0000","mapping_epoch":398,"log_start":"402'2305","ondisk_log_start":"402'2305","created":398,"last_epoch_clean":399,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_clean_scrub_stamp":"2024-02-10T08:36:44.122988+0000","log_size":4367,"ondisk_log_size":4367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":437256192,"num_objects":6672,"num_object_clones":0,"num_object_copies":20016,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6672,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6672,"num_write_kb":427008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"402'39","reported_seq":450,"reported_epoch":419,"state":"active+clean","last_fresh":"2024-02-10T08:38:06.017154+0000","last_change":"2024-02-10T08:37:59.784219+0000","last_active":"2024-02-10T08:38:06.017154+0000","last_peered":"2024-02-10T08:38:06.017154+0000","last_clean":"2024-02-10T08:38:06.017154+0000","last_became_active":"2024-02-10T08:20:46.401777+0000","last_became_peered":"2024-02-10T08:20:46.401777+0000","last_unstale":"2024-02-10T08:38:06.017154+0000","last_undegraded":"2024-02-10T08:38:06.017154+0000","last_fullsized":"2024-02-10T08:38:06.017154+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'39","last_scrub_stamp":"2024-02-10T08:37:59.784110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:37:59.784110+0000","log_size":39,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":62,"num_read_kb":53,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":403,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.313784+0000","last_change":"2024-02-10T08:37:14.034628+0000","last_active":"2024-02-10T08:38:03.313784+0000","last_peered":"2024-02-10T08:38:03.313784+0000","last_clean":"2024-02-10T08:38:03.313784+0000","last_became_active":"2024-02-10T08:16:52.783634+0000","last_became_peered":"2024-02-10T08:16:52.783634+0000","last_unstale":"2024-02-10T08:38:03.313784+0000","last_undegraded":"2024-02-10T08:38:03.313784+0000","last_fullsized":"2024-02-10T08:38:03.313784+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:14.034555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:37:14.034555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"318'14","reported_seq":202,"reported_epoch":419,"state":"active+clean","last_fresh":"2024-02-10T08:38:06.000633+0000","last_change":"2024-02-10T08:36:55.934111+0000","last_active":"2024-02-10T08:38:06.000633+0000","last_peered":"2024-02-10T08:38:06.000633+0000","last_clean":"2024-02-10T08:38:06.000633+0000","last_became_active":"2024-02-10T08:31:46.073265+0000","last_became_peered":"2024-02-10T08:31:46.073265+0000","last_unstale":"2024-02-10T08:38:06.000633+0000","last_undegraded":"2024-02-10T08:38:06.000633+0000","last_fullsized":"2024-02-10T08:38:06.000633+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"318'14","last_scrub_stamp":"2024-02-10T08:36:55.934036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:36:55.934036+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":418,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.303815+0000","last_change":"2024-02-10T08:35:23.093480+0000","last_active":"2024-02-10T08:38:03.303815+0000","last_peered":"2024-02-10T08:38:03.303815+0000","last_clean":"2024-02-10T08:38:03.303815+0000","last_became_active":"2024-02-10T08:32:36.978932+0000","last_became_peered":"2024-02-10T08:32:36.978932+0000","last_unstale":"2024-02-10T08:38:03.303815+0000","last_undegraded":"2024-02-10T08:38:03.303815+0000","last_fullsized":"2024-02-10T08:38:03.303815+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:35:23.093373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:35:23.093373+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1","version":"419'6602","reported_seq":6631,"reported_epoch":419,"state":"active+clean","last_fresh":"2024-02-10T08:38:12.912544+0000","last_change":"2024-02-10T08:36:45.373702+0000","last_active":"2024-02-10T08:38:12.912544+0000","last_peered":"2024-02-10T08:38:12.912544+0000","last_clean":"2024-02-10T08:38:12.912544+0000","last_became_active":"2024-02-10T08:36:45.373418+0000","last_became_peered":"2024-02-10T08:36:45.373418+0000","last_unstale":"2024-02-10T08:38:12.912544+0000","last_undegraded":"2024-02-10T08:38:12.912544+0000","last_fullsized":"2024-02-10T08:38:12.912544+0000","mapping_epoch":398,"log_start":"402'1981","ondisk_log_start":"402'1981","created":398,"last_epoch_clean":399,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_clean_scrub_stamp":"2024-02-10T08:36:44.122988+0000","log_size":4621,"ondisk_log_size":4621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":432668672,"num_objects":6602,"num_object_clones":0,"num_object_copies":19806,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6602,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6602,"num_write_kb":422528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"402'32","reported_seq":436,"reported_epoch":419,"state":"active+clean","last_fresh":"2024-02-10T08:38:06.157612+0000","last_change":"2024-02-10T08:38:06.157612+0000","last_active":"2024-02-10T08:38:06.157612+0000","last_peered":"2024-02-10T08:38:06.157612+0000","last_clean":"2024-02-10T08:38:06.157612+0000","last_became_active":"2024-02-10T08:20:46.406023+0000","last_became_peered":"2024-02-10T08:20:46.406023+0000","last_unstale":"2024-02-10T08:38:06.157612+0000","last_undegraded":"2024-02-10T08:38:06.157612+0000","last_fullsized":"2024-02-10T08:38:06.157612+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'32","last_scrub_stamp":"2024-02-10T08:38:06.157506+0000","last_deep_scrub":"76'16","last_deep_scrub_stamp":"2024-02-10T08:18:07.909782+0000","last_clean_scrub_stamp":"2024-02-10T08:38:06.157506+0000","log_size":32,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":420,"reported_epoch":419,"state":"active+clean","last_fresh":"2024-02-10T08:38:09.911459+0000","last_change":"2024-02-10T08:38:09.911459+0000","last_active":"2024-02-10T08:38:09.911459+0000","last_peered":"2024-02-10T08:38:09.911459+0000","last_clean":"2024-02-10T08:38:09.911459+0000","last_became_active":"2024-02-10T08:28:02.768633+0000","last_became_peered":"2024-02-10T08:28:02.768633+0000","last_unstale":"2024-02-10T08:38:09.911459+0000","last_undegraded":"2024-02-10T08:38:09.911459+0000","last_fullsized":"2024-02-10T08:38:09.911459+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:38:09.911361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:38:09.911361+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":462,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.303993+0000","last_change":"2024-02-10T08:36:02.062993+0000","last_active":"2024-02-10T08:38:03.303993+0000","last_peered":"2024-02-10T08:38:03.303993+0000","last_clean":"2024-02-10T08:38:03.303993+0000","last_became_active":"2024-02-10T08:20:46.400500+0000","last_became_peered":"2024-02-10T08:20:46.400500+0000","last_unstale":"2024-02-10T08:38:03.303993+0000","last_undegraded":"2024-02-10T08:38:03.303993+0000","last_fullsized":"2024-02-10T08:38:03.303993+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:02.062895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:36:02.062895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":335,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.305039+0000","last_change":"2024-02-10T08:36:58.006547+0000","last_active":"2024-02-10T08:38:03.305039+0000","last_peered":"2024-02-10T08:38:03.305039+0000","last_clean":"2024-02-10T08:38:03.305039+0000","last_became_active":"2024-02-10T08:31:33.880969+0000","last_became_peered":"2024-02-10T08:31:33.880969+0000","last_unstale":"2024-02-10T08:38:03.305039+0000","last_undegraded":"2024-02-10T08:38:03.305039+0000","last_fullsized":"2024-02-10T08:38:03.305039+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:58.006464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:20:30.227375+0000","last_clean_scrub_stamp":"2024-02-10T08:36:58.006464+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":17,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.303049+0000","last_change":"2024-02-10T08:37:45.980144+0000","last_active":"2024-02-10T08:38:03.303049+0000","last_peered":"2024-02-10T08:38:03.303049+0000","last_clean":"2024-02-10T08:38:03.303049+0000","last_became_active":"2024-02-10T08:37:45.979805+0000","last_became_peered":"2024-02-10T08:37:45.979805+0000","last_unstale":"2024-02-10T08:38:03.303049+0000","last_undegraded":"2024-02-10T08:38:03.303049+0000","last_fullsized":"2024-02-10T08:38:03.303049+0000","mapping_epoch":411,"log_start":"0'0","ondisk_log_start":"0'0","created":409,"last_epoch_clean":412,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:04.577168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:14:44.584370+0000","last_clean_scrub_stamp":"2024-02-10T08:37:04.577168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.e","version":"419'6253","reported_seq":6282,"reported_epoch":419,"state":"active+clean","last_fresh":"2024-02-10T08:38:09.561043+0000","last_change":"2024-02-10T08:36:45.140660+0000","last_active":"2024-02-10T08:38:09.561043+0000","last_peered":"2024-02-10T08:38:09.561043+0000","last_clean":"2024-02-10T08:38:09.561043+0000","last_became_active":"2024-02-10T08:36:45.140350+0000","last_became_peered":"2024-02-10T08:36:45.140350+0000","last_unstale":"2024-02-10T08:38:09.561043+0000","last_undegraded":"2024-02-10T08:38:09.561043+0000","last_fullsized":"2024-02-10T08:38:09.561043+0000","mapping_epoch":398,"log_start":"402'1772","ondisk_log_start":"402'1772","created":398,"last_epoch_clean":399,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_clean_scrub_stamp":"2024-02-10T08:36:44.122988+0000","log_size":4481,"ondisk_log_size":4481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":409796608,"num_objects":6253,"num_object_clones":0,"num_object_copies":18759,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6253,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6253,"num_write_kb":400192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7],"acting":[4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"314'14","reported_seq":545,"reported_epoch":419,"state":"active+clean","last_fresh":"2024-02-10T08:38:06.265800+0000","last_change":"2024-02-10T08:37:09.977486+0000","last_active":"2024-02-10T08:38:06.265800+0000","last_peered":"2024-02-10T08:38:06.265800+0000","last_clean":"2024-02-10T08:38:06.265800+0000","last_became_active":"2024-02-10T08:31:33.890120+0000","last_became_peered":"2024-02-10T08:31:33.890120+0000","last_unstale":"2024-02-10T08:38:06.265800+0000","last_undegraded":"2024-02-10T08:38:06.265800+0000","last_fullsized":"2024-02-10T08:38:06.265800+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"314'14","last_scrub_stamp":"2024-02-10T08:37:09.977369+0000","last_deep_scrub":"199'13","last_deep_scrub_stamp":"2024-02-10T08:24:47.529439+0000","last_clean_scrub_stamp":"2024-02-10T08:37:09.977369+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"402'42","reported_seq":438,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.306237+0000","last_change":"2024-02-10T08:37:03.935036+0000","last_active":"2024-02-10T08:38:03.306237+0000","last_peered":"2024-02-10T08:38:03.306237+0000","last_clean":"2024-02-10T08:38:03.306237+0000","last_became_active":"2024-02-10T08:20:46.400760+0000","last_became_peered":"2024-02-10T08:20:46.400760+0000","last_unstale":"2024-02-10T08:38:03.306237+0000","last_undegraded":"2024-02-10T08:38:03.306237+0000","last_fullsized":"2024-02-10T08:38:03.306237+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'42","last_scrub_stamp":"2024-02-10T08:37:03.934971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:37:03.934971+0000","log_size":42,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":62,"num_read_kb":55,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":407,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.305328+0000","last_change":"2024-02-10T08:37:11.001055+0000","last_active":"2024-02-10T08:38:03.305328+0000","last_peered":"2024-02-10T08:38:03.305328+0000","last_clean":"2024-02-10T08:38:03.305328+0000","last_became_active":"2024-02-10T08:16:52.789020+0000","last_became_peered":"2024-02-10T08:16:52.789020+0000","last_unstale":"2024-02-10T08:38:03.305328+0000","last_undegraded":"2024-02-10T08:38:03.305328+0000","last_fullsized":"2024-02-10T08:38:03.305328+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:11.000947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:37:11.000947+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":400,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.310889+0000","last_change":"2024-02-10T08:37:16.647716+0000","last_active":"2024-02-10T08:38:03.310889+0000","last_peered":"2024-02-10T08:38:03.310889+0000","last_clean":"2024-02-10T08:38:03.310889+0000","last_became_active":"2024-02-10T08:21:58.546976+0000","last_became_peered":"2024-02-10T08:21:58.546976+0000","last_unstale":"2024-02-10T08:38:03.310889+0000","last_undegraded":"2024-02-10T08:38:03.310889+0000","last_fullsized":"2024-02-10T08:38:03.310889+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:16.647643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:37:16.647643+0000","last_clean_scrub_stamp":"2024-02-10T08:37:16.647643+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":17,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.306400+0000","last_change":"2024-02-10T08:37:45.988045+0000","last_active":"2024-02-10T08:38:03.306400+0000","last_peered":"2024-02-10T08:38:03.306400+0000","last_clean":"2024-02-10T08:38:03.306400+0000","last_became_active":"2024-02-10T08:37:45.987700+0000","last_became_peered":"2024-02-10T08:37:45.987700+0000","last_unstale":"2024-02-10T08:38:03.306400+0000","last_undegraded":"2024-02-10T08:38:03.306400+0000","last_fullsized":"2024-02-10T08:38:03.306400+0000","mapping_epoch":411,"log_start":"0'0","ondisk_log_start":"0'0","created":409,"last_epoch_clean":412,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:04.577168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:14:44.584370+0000","last_clean_scrub_stamp":"2024-02-10T08:37:04.577168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.f","version":"419'6550","reported_seq":6579,"reported_epoch":419,"state":"active+clean","last_fresh":"2024-02-10T08:38:12.921602+0000","last_change":"2024-02-10T08:36:45.141212+0000","last_active":"2024-02-10T08:38:12.921602+0000","last_peered":"2024-02-10T08:38:12.921602+0000","last_clean":"2024-02-10T08:38:12.921602+0000","last_became_active":"2024-02-10T08:36:45.140934+0000","last_became_peered":"2024-02-10T08:36:45.140934+0000","last_unstale":"2024-02-10T08:38:12.921602+0000","last_undegraded":"2024-02-10T08:38:12.921602+0000","last_fullsized":"2024-02-10T08:38:12.921602+0000","mapping_epoch":398,"log_start":"403'2513","ondisk_log_start":"403'2513","created":398,"last_epoch_clean":399,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_clean_scrub_stamp":"2024-02-10T08:36:44.122988+0000","log_size":4037,"ondisk_log_size":4037,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":429260800,"num_objects":6550,"num_object_clones":0,"num_object_copies":19650,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6550,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6550,"num_write_kb":419200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":393,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.306305+0000","last_change":"2024-02-10T08:37:05.882132+0000","last_active":"2024-02-10T08:38:03.306305+0000","last_peered":"2024-02-10T08:38:03.306305+0000","last_clean":"2024-02-10T08:38:03.306305+0000","last_became_active":"2024-02-10T08:31:33.883569+0000","last_became_peered":"2024-02-10T08:31:33.883569+0000","last_unstale":"2024-02-10T08:38:03.306305+0000","last_undegraded":"2024-02-10T08:38:03.306305+0000","last_fullsized":"2024-02-10T08:38:03.306305+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:05.882027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:37:05.882027+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"402'42","reported_seq":477,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.309615+0000","last_change":"2024-02-10T08:37:14.617564+0000","last_active":"2024-02-10T08:38:03.309615+0000","last_peered":"2024-02-10T08:38:03.309615+0000","last_clean":"2024-02-10T08:38:03.309615+0000","last_became_active":"2024-02-10T08:32:36.979685+0000","last_became_peered":"2024-02-10T08:32:36.979685+0000","last_unstale":"2024-02-10T08:38:03.309615+0000","last_undegraded":"2024-02-10T08:38:03.309615+0000","last_fullsized":"2024-02-10T08:38:03.309615+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'42","last_scrub_stamp":"2024-02-10T08:37:14.617481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:37:14.617481+0000","log_size":42,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":69,"num_read_kb":57,"num_write":44,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,0],"acting":[7,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":413,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.315257+0000","last_change":"2024-02-10T08:36:27.912388+0000","last_active":"2024-02-10T08:38:03.315257+0000","last_peered":"2024-02-10T08:38:03.315257+0000","last_clean":"2024-02-10T08:38:03.315257+0000","last_became_active":"2024-02-10T08:20:46.407667+0000","last_became_peered":"2024-02-10T08:20:46.407667+0000","last_unstale":"2024-02-10T08:38:03.315257+0000","last_undegraded":"2024-02-10T08:38:03.315257+0000","last_fullsized":"2024-02-10T08:38:03.315257+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:27.912314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:36:27.912314+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":415,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:04.099727+0000","last_change":"2024-02-10T08:38:04.099707+0000","last_active":"2024-02-10T08:38:04.099727+0000","last_peered":"2024-02-10T08:38:04.099727+0000","last_clean":"2024-02-10T08:38:04.099727+0000","last_became_active":"2024-02-10T08:31:33.882582+0000","last_became_peered":"2024-02-10T08:31:33.882582+0000","last_unstale":"2024-02-10T08:38:04.099727+0000","last_undegraded":"2024-02-10T08:38:04.099727+0000","last_fullsized":"2024-02-10T08:38:04.099727+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:38:04.099645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:25.358315+0000","last_clean_scrub_stamp":"2024-02-10T08:38:04.099645+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":435,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.323263+0000","last_change":"2024-02-10T08:37:45.988246+0000","last_active":"2024-02-10T08:38:03.323263+0000","last_peered":"2024-02-10T08:38:03.323263+0000","last_clean":"2024-02-10T08:38:03.323263+0000","last_became_active":"2024-02-10T08:37:45.986957+0000","last_became_peered":"2024-02-10T08:37:45.986957+0000","last_unstale":"2024-02-10T08:38:03.323263+0000","last_undegraded":"2024-02-10T08:38:03.323263+0000","last_fullsized":"2024-02-10T08:38:03.323263+0000","mapping_epoch":411,"log_start":"0'0","ondisk_log_start":"0'0","created":409,"last_epoch_clean":412,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:04.577168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:14:44.584370+0000","last_clean_scrub_stamp":"2024-02-10T08:37:04.577168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3],"acting":[0,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.c","version":"419'6616","reported_seq":6645,"reported_epoch":419,"state":"active+clean","last_fresh":"2024-02-10T08:38:12.944363+0000","last_change":"2024-02-10T08:36:45.138862+0000","last_active":"2024-02-10T08:38:12.944363+0000","last_peered":"2024-02-10T08:38:12.944363+0000","last_clean":"2024-02-10T08:38:12.944363+0000","last_became_active":"2024-02-10T08:36:45.138544+0000","last_became_peered":"2024-02-10T08:36:45.138544+0000","last_unstale":"2024-02-10T08:38:12.944363+0000","last_undegraded":"2024-02-10T08:38:12.944363+0000","last_fullsized":"2024-02-10T08:38:12.944363+0000","mapping_epoch":398,"log_start":"402'2319","ondisk_log_start":"402'2319","created":398,"last_epoch_clean":399,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_clean_scrub_stamp":"2024-02-10T08:36:44.122988+0000","log_size":4297,"ondisk_log_size":4297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":433586176,"num_objects":6616,"num_object_clones":0,"num_object_copies":19848,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6616,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6616,"num_write_kb":423424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,4],"acting":[1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":288,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.328320+0000","last_change":"2024-02-10T08:37:15.967513+0000","last_active":"2024-02-10T08:38:03.328320+0000","last_peered":"2024-02-10T08:38:03.328320+0000","last_clean":"2024-02-10T08:38:03.328320+0000","last_became_active":"2024-02-10T08:33:56.117216+0000","last_became_peered":"2024-02-10T08:33:56.117216+0000","last_unstale":"2024-02-10T08:38:03.328320+0000","last_undegraded":"2024-02-10T08:38:03.328320+0000","last_fullsized":"2024-02-10T08:38:03.328320+0000","mapping_epoch":364,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":365,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:15.967427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:37:15.967427+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"402'47","reported_seq":509,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.323593+0000","last_change":"2024-02-10T08:37:18.014050+0000","last_active":"2024-02-10T08:38:03.323593+0000","last_peered":"2024-02-10T08:38:03.323593+0000","last_clean":"2024-02-10T08:38:03.323593+0000","last_became_active":"2024-02-10T08:28:25.951447+0000","last_became_peered":"2024-02-10T08:28:25.951447+0000","last_unstale":"2024-02-10T08:38:03.323593+0000","last_undegraded":"2024-02-10T08:38:03.323593+0000","last_fullsized":"2024-02-10T08:38:03.323593+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'47","last_scrub_stamp":"2024-02-10T08:37:18.013937+0000","last_deep_scrub":"199'27","last_deep_scrub_stamp":"2024-02-10T08:24:42.826442+0000","last_clean_scrub_stamp":"2024-02-10T08:37:18.013937+0000","log_size":47,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":68,"num_read_kb":54,"num_write":42,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":411,"reported_epoch":419,"state":"active+clean","last_fresh":"2024-02-10T08:38:06.006290+0000","last_change":"2024-02-10T08:38:00.759320+0000","last_active":"2024-02-10T08:38:06.006290+0000","last_peered":"2024-02-10T08:38:06.006290+0000","last_clean":"2024-02-10T08:38:06.006290+0000","last_became_active":"2024-02-10T08:32:36.972224+0000","last_became_peered":"2024-02-10T08:32:36.972224+0000","last_unstale":"2024-02-10T08:38:06.006290+0000","last_undegraded":"2024-02-10T08:38:06.006290+0000","last_fullsized":"2024-02-10T08:38:06.006290+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:38:00.759250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:38:00.759250+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4],"acting":[2,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":406,"reported_epoch":419,"state":"active+clean","last_fresh":"2024-02-10T08:38:09.208694+0000","last_change":"2024-02-10T08:38:09.208694+0000","last_active":"2024-02-10T08:38:09.208694+0000","last_peered":"2024-02-10T08:38:09.208694+0000","last_clean":"2024-02-10T08:38:09.208694+0000","last_became_active":"2024-02-10T08:21:58.553966+0000","last_became_peered":"2024-02-10T08:21:58.553966+0000","last_unstale":"2024-02-10T08:38:09.208694+0000","last_undegraded":"2024-02-10T08:38:09.208694+0000","last_fullsized":"2024-02-10T08:38:09.208694+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:38:09.208549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:36:20.807490+0000","last_clean_scrub_stamp":"2024-02-10T08:38:09.208549+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":17,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.313736+0000","last_change":"2024-02-10T08:37:45.989948+0000","last_active":"2024-02-10T08:38:03.313736+0000","last_peered":"2024-02-10T08:38:03.313736+0000","last_clean":"2024-02-10T08:38:03.313736+0000","last_became_active":"2024-02-10T08:37:45.989722+0000","last_became_peered":"2024-02-10T08:37:45.989722+0000","last_unstale":"2024-02-10T08:38:03.313736+0000","last_undegraded":"2024-02-10T08:38:03.313736+0000","last_fullsized":"2024-02-10T08:38:03.313736+0000","mapping_epoch":411,"log_start":"0'0","ondisk_log_start":"0'0","created":409,"last_epoch_clean":412,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:04.577168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:14:44.584370+0000","last_clean_scrub_stamp":"2024-02-10T08:37:04.577168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.9","version":"419'6283","reported_seq":6312,"reported_epoch":419,"state":"active+clean","last_fresh":"2024-02-10T08:38:08.401252+0000","last_change":"2024-02-10T08:36:45.373889+0000","last_active":"2024-02-10T08:38:08.401252+0000","last_peered":"2024-02-10T08:38:08.401252+0000","last_clean":"2024-02-10T08:38:08.401252+0000","last_became_active":"2024-02-10T08:36:45.373522+0000","last_became_peered":"2024-02-10T08:36:45.373522+0000","last_unstale":"2024-02-10T08:38:08.401252+0000","last_undegraded":"2024-02-10T08:38:08.401252+0000","last_fullsized":"2024-02-10T08:38:08.401252+0000","mapping_epoch":398,"log_start":"402'1653","ondisk_log_start":"402'1653","created":398,"last_epoch_clean":399,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_clean_scrub_stamp":"2024-02-10T08:36:44.122988+0000","log_size":4630,"ondisk_log_size":4630,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":411762688,"num_objects":6283,"num_object_clones":0,"num_object_copies":18849,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6283,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6283,"num_write_kb":402112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":420,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.303994+0000","last_change":"2024-02-10T08:37:58.419735+0000","last_active":"2024-02-10T08:38:03.303994+0000","last_peered":"2024-02-10T08:38:03.303994+0000","last_clean":"2024-02-10T08:38:03.303994+0000","last_became_active":"2024-02-10T08:28:02.772585+0000","last_became_peered":"2024-02-10T08:28:02.772585+0000","last_unstale":"2024-02-10T08:38:03.303994+0000","last_undegraded":"2024-02-10T08:38:03.303994+0000","last_fullsized":"2024-02-10T08:38:03.303994+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:58.419628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:41.360241+0000","last_clean_scrub_stamp":"2024-02-10T08:37:58.419628+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"402'36","reported_seq":131,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.324279+0000","last_change":"2024-02-10T08:37:09.007756+0000","last_active":"2024-02-10T08:38:03.324279+0000","last_peered":"2024-02-10T08:38:03.324279+0000","last_clean":"2024-02-10T08:38:03.324279+0000","last_became_active":"2024-02-10T08:32:36.975366+0000","last_became_peered":"2024-02-10T08:32:36.975366+0000","last_unstale":"2024-02-10T08:38:03.324279+0000","last_undegraded":"2024-02-10T08:38:03.324279+0000","last_fullsized":"2024-02-10T08:38:03.324279+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'36","last_scrub_stamp":"2024-02-10T08:37:09.007654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:37:09.007654+0000","log_size":36,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":47,"num_write":36,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":415,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.309278+0000","last_change":"2024-02-10T08:36:26.541530+0000","last_active":"2024-02-10T08:38:03.309278+0000","last_peered":"2024-02-10T08:38:03.309278+0000","last_clean":"2024-02-10T08:38:03.309278+0000","last_became_active":"2024-02-10T08:28:02.760999+0000","last_became_peered":"2024-02-10T08:28:02.760999+0000","last_unstale":"2024-02-10T08:38:03.309278+0000","last_undegraded":"2024-02-10T08:38:03.309278+0000","last_fullsized":"2024-02-10T08:38:03.309278+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:26.541382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:28.401960+0000","last_clean_scrub_stamp":"2024-02-10T08:36:26.541382+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":394,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.327712+0000","last_change":"2024-02-10T08:37:08.038282+0000","last_active":"2024-02-10T08:38:03.327712+0000","last_peered":"2024-02-10T08:38:03.327712+0000","last_clean":"2024-02-10T08:38:03.327712+0000","last_became_active":"2024-02-10T08:31:46.063039+0000","last_became_peered":"2024-02-10T08:31:46.063039+0000","last_unstale":"2024-02-10T08:38:03.327712+0000","last_undegraded":"2024-02-10T08:38:03.327712+0000","last_fullsized":"2024-02-10T08:38:03.327712+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:08.038201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:20.736224+0000","last_clean_scrub_stamp":"2024-02-10T08:37:08.038201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":419,"reported_epoch":419,"state":"active+clean","last_fresh":"2024-02-10T08:38:12.151843+0000","last_change":"2024-02-10T08:38:12.151843+0000","last_active":"2024-02-10T08:38:12.151843+0000","last_peered":"2024-02-10T08:38:12.151843+0000","last_clean":"2024-02-10T08:38:12.151843+0000","last_became_active":"2024-02-10T08:28:19.022399+0000","last_became_peered":"2024-02-10T08:28:19.022399+0000","last_unstale":"2024-02-10T08:38:12.151843+0000","last_undegraded":"2024-02-10T08:38:12.151843+0000","last_fullsized":"2024-02-10T08:38:12.151843+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:38:12.151687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:38:12.151687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.a","version":"419'6581","reported_seq":6610,"reported_epoch":419,"state":"active+clean","last_fresh":"2024-02-10T08:38:12.798639+0000","last_change":"2024-02-10T08:36:45.371929+0000","last_active":"2024-02-10T08:38:12.798639+0000","last_peered":"2024-02-10T08:38:12.798639+0000","last_clean":"2024-02-10T08:38:12.798639+0000","last_became_active":"2024-02-10T08:36:45.371664+0000","last_became_peered":"2024-02-10T08:36:45.371664+0000","last_unstale":"2024-02-10T08:38:12.798639+0000","last_undegraded":"2024-02-10T08:38:12.798639+0000","last_fullsized":"2024-02-10T08:38:12.798639+0000","mapping_epoch":398,"log_start":"402'1980","ondisk_log_start":"402'1980","created":398,"last_epoch_clean":399,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_clean_scrub_stamp":"2024-02-10T08:36:44.122988+0000","log_size":4601,"ondisk_log_size":4601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":431292416,"num_objects":6581,"num_object_clones":0,"num_object_copies":19743,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6581,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6581,"num_write_kb":421184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":398,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.311355+0000","last_change":"2024-02-10T08:37:56.673833+0000","last_active":"2024-02-10T08:38:03.311355+0000","last_peered":"2024-02-10T08:38:03.311355+0000","last_clean":"2024-02-10T08:38:03.311355+0000","last_became_active":"2024-02-10T08:16:56.867159+0000","last_became_peered":"2024-02-10T08:16:56.867159+0000","last_unstale":"2024-02-10T08:38:03.311355+0000","last_undegraded":"2024-02-10T08:38:03.311355+0000","last_fullsized":"2024-02-10T08:38:03.311355+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:56.673733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:04.766780+0000","last_clean_scrub_stamp":"2024-02-10T08:37:56.673733+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"402'45","reported_seq":485,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.305647+0000","last_change":"2024-02-10T08:37:59.915068+0000","last_active":"2024-02-10T08:38:03.305647+0000","last_peered":"2024-02-10T08:38:03.305647+0000","last_clean":"2024-02-10T08:38:03.305647+0000","last_became_active":"2024-02-10T08:20:46.401981+0000","last_became_peered":"2024-02-10T08:20:46.401981+0000","last_unstale":"2024-02-10T08:38:03.305647+0000","last_undegraded":"2024-02-10T08:38:03.305647+0000","last_fullsized":"2024-02-10T08:38:03.305647+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'45","last_scrub_stamp":"2024-02-10T08:37:59.914964+0000","last_deep_scrub":"223'21","last_deep_scrub_stamp":"2024-02-10T08:26:33.250614+0000","last_clean_scrub_stamp":"2024-02-10T08:37:59.914964+0000","log_size":45,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":61,"num_read_kb":51,"num_write":37,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":435,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.309351+0000","last_change":"2024-02-10T08:37:44.322835+0000","last_active":"2024-02-10T08:38:03.309351+0000","last_peered":"2024-02-10T08:38:03.309351+0000","last_clean":"2024-02-10T08:38:03.309351+0000","last_became_active":"2024-02-10T08:37:44.322508+0000","last_became_peered":"2024-02-10T08:37:44.322508+0000","last_unstale":"2024-02-10T08:38:03.309351+0000","last_undegraded":"2024-02-10T08:38:03.309351+0000","last_fullsized":"2024-02-10T08:38:03.309351+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":410,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:04.577168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:14:44.584370+0000","last_clean_scrub_stamp":"2024-02-10T08:37:04.577168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":402,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.302686+0000","last_change":"2024-02-10T08:36:59.075246+0000","last_active":"2024-02-10T08:38:03.302686+0000","last_peered":"2024-02-10T08:38:03.302686+0000","last_clean":"2024-02-10T08:38:03.302686+0000","last_became_active":"2024-02-10T08:16:52.788767+0000","last_became_peered":"2024-02-10T08:16:52.788767+0000","last_unstale":"2024-02-10T08:38:03.302686+0000","last_undegraded":"2024-02-10T08:38:03.302686+0000","last_fullsized":"2024-02-10T08:38:03.302686+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:59.075134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:36:59.075134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":326,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.303257+0000","last_change":"2024-02-10T08:36:18.911642+0000","last_active":"2024-02-10T08:38:03.303257+0000","last_peered":"2024-02-10T08:38:03.303257+0000","last_clean":"2024-02-10T08:38:03.303257+0000","last_became_active":"2024-02-10T08:31:33.878588+0000","last_became_peered":"2024-02-10T08:31:33.878588+0000","last_unstale":"2024-02-10T08:38:03.303257+0000","last_undegraded":"2024-02-10T08:38:03.303257+0000","last_fullsized":"2024-02-10T08:38:03.303257+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:18.911559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.019819+0000","last_clean_scrub_stamp":"2024-02-10T08:36:18.911559+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":130,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.325329+0000","last_change":"2024-02-10T08:37:28.172995+0000","last_active":"2024-02-10T08:38:03.325329+0000","last_peered":"2024-02-10T08:38:03.325329+0000","last_clean":"2024-02-10T08:38:03.325329+0000","last_became_active":"2024-02-10T08:31:19.726561+0000","last_became_peered":"2024-02-10T08:31:19.726561+0000","last_unstale":"2024-02-10T08:38:03.325329+0000","last_undegraded":"2024-02-10T08:38:03.325329+0000","last_fullsized":"2024-02-10T08:38:03.325329+0000","mapping_epoch":308,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":309,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:28.172918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:26:29.921562+0000","last_clean_scrub_stamp":"2024-02-10T08:37:28.172918+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":443,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.310194+0000","last_change":"2024-02-10T08:37:45.983841+0000","last_active":"2024-02-10T08:38:03.310194+0000","last_peered":"2024-02-10T08:38:03.310194+0000","last_clean":"2024-02-10T08:38:03.310194+0000","last_became_active":"2024-02-10T08:37:45.983553+0000","last_became_peered":"2024-02-10T08:37:45.983553+0000","last_unstale":"2024-02-10T08:38:03.310194+0000","last_undegraded":"2024-02-10T08:38:03.310194+0000","last_fullsized":"2024-02-10T08:38:03.310194+0000","mapping_epoch":411,"log_start":"0'0","ondisk_log_start":"0'0","created":409,"last_epoch_clean":412,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:04.577168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:14:44.584370+0000","last_clean_scrub_stamp":"2024-02-10T08:37:04.577168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.8","version":"419'6678","reported_seq":6707,"reported_epoch":419,"state":"active+clean","last_fresh":"2024-02-10T08:38:12.885021+0000","last_change":"2024-02-10T08:36:45.373548+0000","last_active":"2024-02-10T08:38:12.885021+0000","last_peered":"2024-02-10T08:38:12.885021+0000","last_clean":"2024-02-10T08:38:12.885021+0000","last_became_active":"2024-02-10T08:36:45.373282+0000","last_became_peered":"2024-02-10T08:36:45.373282+0000","last_unstale":"2024-02-10T08:38:12.885021+0000","last_undegraded":"2024-02-10T08:38:12.885021+0000","last_fullsized":"2024-02-10T08:38:12.885021+0000","mapping_epoch":398,"log_start":"402'1986","ondisk_log_start":"402'1986","created":398,"last_epoch_clean":399,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_clean_scrub_stamp":"2024-02-10T08:36:44.122988+0000","log_size":4692,"ondisk_log_size":4692,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":437649408,"num_objects":6678,"num_object_clones":0,"num_object_copies":20034,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6678,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6678,"num_write_kb":427392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":405,"reported_epoch":419,"state":"active+clean","last_fresh":"2024-02-10T08:38:06.007504+0000","last_change":"2024-02-10T08:37:57.791077+0000","last_active":"2024-02-10T08:38:06.007504+0000","last_peered":"2024-02-10T08:38:06.007504+0000","last_clean":"2024-02-10T08:38:06.007504+0000","last_became_active":"2024-02-10T08:16:56.857856+0000","last_became_peered":"2024-02-10T08:16:56.857856+0000","last_unstale":"2024-02-10T08:38:06.007504+0000","last_undegraded":"2024-02-10T08:38:06.007504+0000","last_fullsized":"2024-02-10T08:38:06.007504+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:57.790964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:37:57.790964+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"402'21","reported_seq":200,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.309913+0000","last_change":"2024-02-10T08:37:57.716636+0000","last_active":"2024-02-10T08:38:03.309913+0000","last_peered":"2024-02-10T08:38:03.309913+0000","last_clean":"2024-02-10T08:38:03.309913+0000","last_became_active":"2024-02-10T08:32:36.984195+0000","last_became_peered":"2024-02-10T08:32:36.984195+0000","last_unstale":"2024-02-10T08:38:03.309913+0000","last_undegraded":"2024-02-10T08:38:03.309913+0000","last_fullsized":"2024-02-10T08:38:03.309913+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'21","last_scrub_stamp":"2024-02-10T08:37:57.716534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:37:57.716534+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":29,"num_write":24,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":445,"reported_epoch":419,"state":"active+clean","last_fresh":"2024-02-10T08:38:06.006675+0000","last_change":"2024-02-10T08:36:58.452213+0000","last_active":"2024-02-10T08:38:06.006675+0000","last_peered":"2024-02-10T08:38:06.006675+0000","last_clean":"2024-02-10T08:38:06.006675+0000","last_became_active":"2024-02-10T08:31:33.884021+0000","last_became_peered":"2024-02-10T08:31:33.884021+0000","last_unstale":"2024-02-10T08:38:06.006675+0000","last_undegraded":"2024-02-10T08:38:06.006675+0000","last_fullsized":"2024-02-10T08:38:06.006675+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:58.452134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:11.681169+0000","last_clean_scrub_stamp":"2024-02-10T08:36:58.452134+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"63'5","reported_seq":1679,"reported_epoch":419,"state":"active+clean","last_fresh":"2024-02-10T08:38:11.530792+0000","last_change":"2024-02-10T08:37:15.040122+0000","last_active":"2024-02-10T08:38:11.530792+0000","last_peered":"2024-02-10T08:38:11.530792+0000","last_clean":"2024-02-10T08:38:11.530792+0000","last_became_active":"2024-02-10T08:16:52.780989+0000","last_became_peered":"2024-02-10T08:16:52.780989+0000","last_unstale":"2024-02-10T08:38:11.530792+0000","last_undegraded":"2024-02-10T08:38:11.530792+0000","last_fullsized":"2024-02-10T08:38:11.530792+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'5","last_scrub_stamp":"2024-02-10T08:37:15.040027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:37:15.040027+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1269,"num_read_kb":1264,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":406,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.310521+0000","last_change":"2024-02-10T08:37:18.625721+0000","last_active":"2024-02-10T08:38:03.310521+0000","last_peered":"2024-02-10T08:38:03.310521+0000","last_clean":"2024-02-10T08:38:03.310521+0000","last_became_active":"2024-02-10T08:21:58.549733+0000","last_became_peered":"2024-02-10T08:21:58.549733+0000","last_unstale":"2024-02-10T08:38:03.310521+0000","last_undegraded":"2024-02-10T08:38:03.310521+0000","last_fullsized":"2024-02-10T08:38:03.310521+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:18.625621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:11.750537+0000","last_clean_scrub_stamp":"2024-02-10T08:37:18.625621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":17,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.302098+0000","last_change":"2024-02-10T08:37:45.994918+0000","last_active":"2024-02-10T08:38:03.302098+0000","last_peered":"2024-02-10T08:38:03.302098+0000","last_clean":"2024-02-10T08:38:03.302098+0000","last_became_active":"2024-02-10T08:37:45.994472+0000","last_became_peered":"2024-02-10T08:37:45.994472+0000","last_unstale":"2024-02-10T08:38:03.302098+0000","last_undegraded":"2024-02-10T08:38:03.302098+0000","last_fullsized":"2024-02-10T08:38:03.302098+0000","mapping_epoch":411,"log_start":"0'0","ondisk_log_start":"0'0","created":409,"last_epoch_clean":412,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:04.577168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:14:44.584370+0000","last_clean_scrub_stamp":"2024-02-10T08:37:04.577168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,2],"acting":[5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.b","version":"419'6674","reported_seq":6703,"reported_epoch":419,"state":"active+clean","last_fresh":"2024-02-10T08:38:12.879741+0000","last_change":"2024-02-10T08:36:45.372323+0000","last_active":"2024-02-10T08:38:12.879741+0000","last_peered":"2024-02-10T08:38:12.879741+0000","last_clean":"2024-02-10T08:38:12.879741+0000","last_became_active":"2024-02-10T08:36:45.371942+0000","last_became_peered":"2024-02-10T08:36:45.371942+0000","last_unstale":"2024-02-10T08:38:12.879741+0000","last_undegraded":"2024-02-10T08:38:12.879741+0000","last_fullsized":"2024-02-10T08:38:12.879741+0000","mapping_epoch":398,"log_start":"402'2311","ondisk_log_start":"402'2311","created":398,"last_epoch_clean":399,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_clean_scrub_stamp":"2024-02-10T08:36:44.122988+0000","log_size":4363,"ondisk_log_size":4363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":437387264,"num_objects":6674,"num_object_clones":0,"num_object_copies":20022,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6674,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6674,"num_write_kb":427136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":99,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.322811+0000","last_change":"2024-02-10T08:37:19.026637+0000","last_active":"2024-02-10T08:38:03.322811+0000","last_peered":"2024-02-10T08:38:03.322811+0000","last_clean":"2024-02-10T08:38:03.322811+0000","last_became_active":"2024-02-10T08:32:36.976141+0000","last_became_peered":"2024-02-10T08:32:36.976141+0000","last_unstale":"2024-02-10T08:38:03.322811+0000","last_undegraded":"2024-02-10T08:38:03.322811+0000","last_fullsized":"2024-02-10T08:38:03.322811+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:19.026550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:37:19.026550+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"402'54","reported_seq":804,"reported_epoch":419,"state":"active+clean","last_fresh":"2024-02-10T08:38:06.265120+0000","last_change":"2024-02-10T08:36:26.948186+0000","last_active":"2024-02-10T08:38:06.265120+0000","last_peered":"2024-02-10T08:38:06.265120+0000","last_clean":"2024-02-10T08:38:06.265120+0000","last_became_active":"2024-02-10T08:31:33.904487+0000","last_became_peered":"2024-02-10T08:31:33.904487+0000","last_unstale":"2024-02-10T08:38:06.265120+0000","last_undegraded":"2024-02-10T08:38:06.265120+0000","last_fullsized":"2024-02-10T08:38:06.265120+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":315,"parent":"0.0","parent_split_bits":0,"last_scrub":"314'42","last_scrub_stamp":"2024-02-10T08:36:26.948002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:36:26.948002+0000","log_size":54,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":84,"num_read_kb":69,"num_write":50,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":716,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":402,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.303034+0000","last_change":"2024-02-10T08:37:09.029872+0000","last_active":"2024-02-10T08:38:03.303034+0000","last_peered":"2024-02-10T08:38:03.303034+0000","last_clean":"2024-02-10T08:38:03.303034+0000","last_became_active":"2024-02-10T08:16:52.791027+0000","last_became_peered":"2024-02-10T08:16:52.791027+0000","last_unstale":"2024-02-10T08:38:03.303034+0000","last_undegraded":"2024-02-10T08:38:03.303034+0000","last_fullsized":"2024-02-10T08:38:03.303034+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:09.029768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:37:09.029768+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":426,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.306736+0000","last_change":"2024-02-10T08:37:25.897697+0000","last_active":"2024-02-10T08:38:03.306736+0000","last_peered":"2024-02-10T08:38:03.306736+0000","last_clean":"2024-02-10T08:38:03.306736+0000","last_became_active":"2024-02-10T08:31:33.884295+0000","last_became_peered":"2024-02-10T08:31:33.884295+0000","last_unstale":"2024-02-10T08:38:03.306736+0000","last_undegraded":"2024-02-10T08:38:03.306736+0000","last_fullsized":"2024-02-10T08:38:03.306736+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:25.897602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:37:25.897602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":443,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.309735+0000","last_change":"2024-02-10T08:37:45.982328+0000","last_active":"2024-02-10T08:38:03.309735+0000","last_peered":"2024-02-10T08:38:03.309735+0000","last_clean":"2024-02-10T08:38:03.309735+0000","last_became_active":"2024-02-10T08:37:45.981960+0000","last_became_peered":"2024-02-10T08:37:45.981960+0000","last_unstale":"2024-02-10T08:38:03.309735+0000","last_undegraded":"2024-02-10T08:38:03.309735+0000","last_fullsized":"2024-02-10T08:38:03.309735+0000","mapping_epoch":411,"log_start":"0'0","ondisk_log_start":"0'0","created":409,"last_epoch_clean":412,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:04.577168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:14:44.584370+0000","last_clean_scrub_stamp":"2024-02-10T08:37:04.577168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.d","version":"420'6614","reported_seq":6646,"reported_epoch":420,"state":"active+clean+scrubbing","last_fresh":"2024-02-10T08:38:13.048306+0000","last_change":"2024-02-10T08:38:11.689543+0000","last_active":"2024-02-10T08:38:13.048306+0000","last_peered":"2024-02-10T08:38:13.048306+0000","last_clean":"2024-02-10T08:38:13.048306+0000","last_became_active":"2024-02-10T08:36:45.141858+0000","last_became_peered":"2024-02-10T08:36:45.141858+0000","last_unstale":"2024-02-10T08:38:13.048306+0000","last_undegraded":"2024-02-10T08:38:13.048306+0000","last_fullsized":"2024-02-10T08:38:13.048306+0000","mapping_epoch":398,"log_start":"402'1300","ondisk_log_start":"402'1300","created":398,"last_epoch_clean":399,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_clean_scrub_stamp":"2024-02-10T08:36:44.122988+0000","log_size":5314,"ondisk_log_size":5314,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":433455104,"num_objects":6614,"num_object_clones":0,"num_object_copies":19842,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6614,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6614,"num_write_kb":423296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,6],"acting":[2,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"255'12","reported_seq":375,"reported_epoch":419,"state":"active+clean","last_fresh":"2024-02-10T08:38:06.024439+0000","last_change":"2024-02-10T08:36:05.139333+0000","last_active":"2024-02-10T08:38:06.024439+0000","last_peered":"2024-02-10T08:38:06.024439+0000","last_clean":"2024-02-10T08:38:06.024439+0000","last_became_active":"2024-02-10T08:28:25.952468+0000","last_became_peered":"2024-02-10T08:28:25.952468+0000","last_unstale":"2024-02-10T08:38:06.024439+0000","last_undegraded":"2024-02-10T08:38:06.024439+0000","last_fullsized":"2024-02-10T08:38:06.024439+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'12","last_scrub_stamp":"2024-02-10T08:36:05.139231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:36:05.139231+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"402'30","reported_seq":456,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.317090+0000","last_change":"2024-02-10T08:36:56.858833+0000","last_active":"2024-02-10T08:38:03.317090+0000","last_peered":"2024-02-10T08:38:03.317090+0000","last_clean":"2024-02-10T08:38:03.317090+0000","last_became_active":"2024-02-10T08:20:46.408495+0000","last_became_peered":"2024-02-10T08:20:46.408495+0000","last_unstale":"2024-02-10T08:38:03.317090+0000","last_undegraded":"2024-02-10T08:38:03.317090+0000","last_fullsized":"2024-02-10T08:38:03.317090+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'20","last_scrub_stamp":"2024-02-10T08:36:56.858641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:36:56.858641+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":45,"num_read_kb":40,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":421,"reported_epoch":419,"state":"active+clean","last_fresh":"2024-02-10T08:38:08.141172+0000","last_change":"2024-02-10T08:38:08.141172+0000","last_active":"2024-02-10T08:38:08.141172+0000","last_peered":"2024-02-10T08:38:08.141172+0000","last_clean":"2024-02-10T08:38:08.141172+0000","last_became_active":"2024-02-10T08:28:02.760784+0000","last_became_peered":"2024-02-10T08:28:02.760784+0000","last_unstale":"2024-02-10T08:38:08.141172+0000","last_undegraded":"2024-02-10T08:38:08.141172+0000","last_fullsized":"2024-02-10T08:38:08.141172+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:38:08.140937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:38:08.140937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":322,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.322189+0000","last_change":"2024-02-10T08:37:21.098388+0000","last_active":"2024-02-10T08:38:03.322189+0000","last_peered":"2024-02-10T08:38:03.322189+0000","last_clean":"2024-02-10T08:38:03.322189+0000","last_became_active":"2024-02-10T08:28:25.950240+0000","last_became_peered":"2024-02-10T08:28:25.950240+0000","last_unstale":"2024-02-10T08:38:03.322189+0000","last_undegraded":"2024-02-10T08:38:03.322189+0000","last_fullsized":"2024-02-10T08:38:03.322189+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:21.098299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:37:21.098299+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"419'6313","reported_seq":6342,"reported_epoch":419,"state":"active+clean","last_fresh":"2024-02-10T08:38:08.400195+0000","last_change":"2024-02-10T08:36:45.141266+0000","last_active":"2024-02-10T08:38:08.400195+0000","last_peered":"2024-02-10T08:38:08.400195+0000","last_clean":"2024-02-10T08:38:08.400195+0000","last_became_active":"2024-02-10T08:36:45.140961+0000","last_became_peered":"2024-02-10T08:36:45.140961+0000","last_unstale":"2024-02-10T08:38:08.400195+0000","last_undegraded":"2024-02-10T08:38:08.400195+0000","last_fullsized":"2024-02-10T08:38:08.400195+0000","mapping_epoch":398,"log_start":"402'1685","ondisk_log_start":"402'1685","created":398,"last_epoch_clean":399,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:36:44.122988+0000","last_clean_scrub_stamp":"2024-02-10T08:36:44.122988+0000","log_size":4628,"ondisk_log_size":4628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":413728768,"num_objects":6313,"num_object_clones":0,"num_object_copies":18939,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6313,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6313,"num_write_kb":404032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":423,"reported_epoch":419,"state":"active+clean","last_fresh":"2024-02-10T08:38:06.006281+0000","last_change":"2024-02-10T08:37:58.767793+0000","last_active":"2024-02-10T08:38:06.006281+0000","last_peered":"2024-02-10T08:38:06.006281+0000","last_clean":"2024-02-10T08:38:06.006281+0000","last_became_active":"2024-02-10T08:28:02.777637+0000","last_became_peered":"2024-02-10T08:28:02.777637+0000","last_unstale":"2024-02-10T08:38:06.006281+0000","last_undegraded":"2024-02-10T08:38:06.006281+0000","last_fullsized":"2024-02-10T08:38:06.006281+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:58.767697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:37:58.767697+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"402'29","reported_seq":471,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.306120+0000","last_change":"2024-02-10T08:37:13.904474+0000","last_active":"2024-02-10T08:38:03.306120+0000","last_peered":"2024-02-10T08:38:03.306120+0000","last_clean":"2024-02-10T08:38:03.306120+0000","last_became_active":"2024-02-10T08:31:33.884516+0000","last_became_peered":"2024-02-10T08:31:33.884516+0000","last_unstale":"2024-02-10T08:38:03.306120+0000","last_undegraded":"2024-02-10T08:38:03.306120+0000","last_fullsized":"2024-02-10T08:38:03.306120+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'29","last_scrub_stamp":"2024-02-10T08:37:13.904380+0000","last_deep_scrub":"82'17","last_deep_scrub_stamp":"2024-02-10T08:18:21.015873+0000","last_clean_scrub_stamp":"2024-02-10T08:37:13.904380+0000","log_size":29,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"55'2","reported_seq":418,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.306892+0000","last_change":"2024-02-10T08:37:04.901887+0000","last_active":"2024-02-10T08:38:03.306892+0000","last_peered":"2024-02-10T08:38:03.306892+0000","last_clean":"2024-02-10T08:38:03.306892+0000","last_became_active":"2024-02-10T08:28:02.768279+0000","last_became_peered":"2024-02-10T08:28:02.768279+0000","last_unstale":"2024-02-10T08:38:03.306892+0000","last_undegraded":"2024-02-10T08:38:03.306892+0000","last_fullsized":"2024-02-10T08:38:03.306892+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'2","last_scrub_stamp":"2024-02-10T08:37:04.901791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:37:04.901791+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":184,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":314,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:05.995116+0000","last_change":"2024-02-10T08:38:05.995078+0000","last_active":"2024-02-10T08:38:05.995116+0000","last_peered":"2024-02-10T08:38:05.995116+0000","last_clean":"2024-02-10T08:38:05.995116+0000","last_became_active":"2024-02-10T08:30:24.073077+0000","last_became_peered":"2024-02-10T08:30:24.073077+0000","last_unstale":"2024-02-10T08:38:05.995116+0000","last_undegraded":"2024-02-10T08:38:05.995116+0000","last_fullsized":"2024-02-10T08:38:05.995116+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:38:05.994981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:38:05.994981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"402'21","reported_seq":118,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.324111+0000","last_change":"2024-02-10T08:37:14.936564+0000","last_active":"2024-02-10T08:38:03.324111+0000","last_peered":"2024-02-10T08:38:03.324111+0000","last_clean":"2024-02-10T08:38:03.324111+0000","last_became_active":"2024-02-10T08:32:36.982716+0000","last_became_peered":"2024-02-10T08:32:36.982716+0000","last_unstale":"2024-02-10T08:38:03.324111+0000","last_undegraded":"2024-02-10T08:38:03.324111+0000","last_fullsized":"2024-02-10T08:38:03.324111+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'21","last_scrub_stamp":"2024-02-10T08:37:14.936454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:37:14.936454+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":33,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"55'1","reported_seq":479,"reported_epoch":419,"state":"active+clean","last_fresh":"2024-02-10T08:38:06.006198+0000","last_change":"2024-02-10T08:37:16.569191+0000","last_active":"2024-02-10T08:38:06.006198+0000","last_peered":"2024-02-10T08:38:06.006198+0000","last_clean":"2024-02-10T08:38:06.006198+0000","last_became_active":"2024-02-10T08:28:02.778857+0000","last_became_peered":"2024-02-10T08:28:02.778857+0000","last_unstale":"2024-02-10T08:38:06.006198+0000","last_undegraded":"2024-02-10T08:38:06.006198+0000","last_fullsized":"2024-02-10T08:38:06.006198+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'1","last_scrub_stamp":"2024-02-10T08:37:16.569094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:37:16.569094+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":716,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":346,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.314287+0000","last_change":"2024-02-10T08:36:57.854254+0000","last_active":"2024-02-10T08:38:03.314287+0000","last_peered":"2024-02-10T08:38:03.314287+0000","last_clean":"2024-02-10T08:38:03.314287+0000","last_became_active":"2024-02-10T08:31:33.891489+0000","last_became_peered":"2024-02-10T08:31:33.891489+0000","last_unstale":"2024-02-10T08:38:03.314287+0000","last_undegraded":"2024-02-10T08:38:03.314287+0000","last_fullsized":"2024-02-10T08:38:03.314287+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:57.854170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:36:57.854170+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":266,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.322318+0000","last_change":"2024-02-10T08:38:00.280357+0000","last_active":"2024-02-10T08:38:03.322318+0000","last_peered":"2024-02-10T08:38:03.322318+0000","last_clean":"2024-02-10T08:38:03.322318+0000","last_became_active":"2024-02-10T08:28:25.999252+0000","last_became_peered":"2024-02-10T08:28:25.999252+0000","last_unstale":"2024-02-10T08:38:03.322318+0000","last_undegraded":"2024-02-10T08:38:03.322318+0000","last_fullsized":"2024-02-10T08:38:03.322318+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:38:00.280257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:38:00.280257+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"402'21","reported_seq":379,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.310137+0000","last_change":"2024-02-10T08:36:24.509690+0000","last_active":"2024-02-10T08:38:03.310137+0000","last_peered":"2024-02-10T08:38:03.310137+0000","last_clean":"2024-02-10T08:38:03.310137+0000","last_became_active":"2024-02-10T08:31:33.891813+0000","last_became_peered":"2024-02-10T08:31:33.891813+0000","last_unstale":"2024-02-10T08:38:03.310137+0000","last_undegraded":"2024-02-10T08:38:03.310137+0000","last_fullsized":"2024-02-10T08:38:03.310137+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'15","last_scrub_stamp":"2024-02-10T08:36:24.509584+0000","last_deep_scrub":"223'9","last_deep_scrub_stamp":"2024-02-10T08:26:33.158025+0000","last_clean_scrub_stamp":"2024-02-10T08:36:24.509584+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":26,"num_read_kb":23,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":469,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.304700+0000","last_change":"2024-02-10T08:36:57.007034+0000","last_active":"2024-02-10T08:38:03.304700+0000","last_peered":"2024-02-10T08:38:03.304700+0000","last_clean":"2024-02-10T08:38:03.304700+0000","last_became_active":"2024-02-10T08:31:46.053553+0000","last_became_peered":"2024-02-10T08:31:46.053553+0000","last_unstale":"2024-02-10T08:38:03.304700+0000","last_undegraded":"2024-02-10T08:38:03.304700+0000","last_fullsized":"2024-02-10T08:38:03.304700+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:57.006964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:36:57.006964+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":398,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:05.328029+0000","last_change":"2024-02-10T08:38:05.327994+0000","last_active":"2024-02-10T08:38:05.328029+0000","last_peered":"2024-02-10T08:38:05.328029+0000","last_clean":"2024-02-10T08:38:05.328029+0000","last_became_active":"2024-02-10T08:16:56.863948+0000","last_became_peered":"2024-02-10T08:16:56.863948+0000","last_unstale":"2024-02-10T08:38:05.328029+0000","last_undegraded":"2024-02-10T08:38:05.328029+0000","last_fullsized":"2024-02-10T08:38:05.328029+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:38:05.327900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:34:28.320524+0000","last_clean_scrub_stamp":"2024-02-10T08:38:05.327900+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":406,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.310250+0000","last_change":"2024-02-10T08:37:25.643652+0000","last_active":"2024-02-10T08:38:03.310250+0000","last_peered":"2024-02-10T08:38:03.310250+0000","last_clean":"2024-02-10T08:38:03.310250+0000","last_became_active":"2024-02-10T08:20:46.398903+0000","last_became_peered":"2024-02-10T08:20:46.398903+0000","last_unstale":"2024-02-10T08:38:03.310250+0000","last_undegraded":"2024-02-10T08:38:03.310250+0000","last_fullsized":"2024-02-10T08:38:03.310250+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:25.643558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:37:25.643558+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"402'30","reported_seq":365,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.314912+0000","last_change":"2024-02-10T08:37:22.111103+0000","last_active":"2024-02-10T08:38:03.314912+0000","last_peered":"2024-02-10T08:38:03.314912+0000","last_clean":"2024-02-10T08:38:03.314912+0000","last_became_active":"2024-02-10T08:22:23.534081+0000","last_became_peered":"2024-02-10T08:22:23.534081+0000","last_unstale":"2024-02-10T08:38:03.314912+0000","last_undegraded":"2024-02-10T08:38:03.314912+0000","last_fullsized":"2024-02-10T08:38:03.314912+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'30","last_scrub_stamp":"2024-02-10T08:37:22.110934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:37:22.110934+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":39,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":402,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.302962+0000","last_change":"2024-02-10T08:36:03.081631+0000","last_active":"2024-02-10T08:38:03.302962+0000","last_peered":"2024-02-10T08:38:03.302962+0000","last_clean":"2024-02-10T08:38:03.302962+0000","last_became_active":"2024-02-10T08:16:52.789834+0000","last_became_peered":"2024-02-10T08:16:52.789834+0000","last_unstale":"2024-02-10T08:38:03.302962+0000","last_undegraded":"2024-02-10T08:38:03.302962+0000","last_fullsized":"2024-02-10T08:38:03.302962+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:03.081540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:36:03.081540+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"244'12","reported_seq":703,"reported_epoch":419,"state":"active+clean","last_fresh":"2024-02-10T08:38:06.264711+0000","last_change":"2024-02-10T08:35:24.069288+0000","last_active":"2024-02-10T08:38:06.264711+0000","last_peered":"2024-02-10T08:38:06.264711+0000","last_clean":"2024-02-10T08:38:06.264711+0000","last_became_active":"2024-02-10T08:28:02.776097+0000","last_became_peered":"2024-02-10T08:28:02.776097+0000","last_unstale":"2024-02-10T08:38:06.264711+0000","last_undegraded":"2024-02-10T08:38:06.264711+0000","last_fullsized":"2024-02-10T08:38:06.264711+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"244'12","last_scrub_stamp":"2024-02-10T08:35:24.069224+0000","last_deep_scrub":"244'12","last_deep_scrub_stamp":"2024-02-10T08:35:24.069224+0000","last_clean_scrub_stamp":"2024-02-10T08:35:24.069224+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":99,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.324191+0000","last_change":"2024-02-10T08:37:03.029492+0000","last_active":"2024-02-10T08:38:03.324191+0000","last_peered":"2024-02-10T08:38:03.324191+0000","last_clean":"2024-02-10T08:38:03.324191+0000","last_became_active":"2024-02-10T08:32:36.983153+0000","last_became_peered":"2024-02-10T08:32:36.983153+0000","last_unstale":"2024-02-10T08:38:03.324191+0000","last_undegraded":"2024-02-10T08:38:03.324191+0000","last_fullsized":"2024-02-10T08:38:03.324191+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:03.029405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:05.662947+0000","last_clean_scrub_stamp":"2024-02-10T08:37:03.029405+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"402'25","reported_seq":438,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.303656+0000","last_change":"2024-02-10T08:36:58.072950+0000","last_active":"2024-02-10T08:38:03.303656+0000","last_peered":"2024-02-10T08:38:03.303656+0000","last_clean":"2024-02-10T08:38:03.303656+0000","last_became_active":"2024-02-10T08:16:55.204734+0000","last_became_peered":"2024-02-10T08:16:55.204734+0000","last_unstale":"2024-02-10T08:38:03.303656+0000","last_undegraded":"2024-02-10T08:38:03.303656+0000","last_fullsized":"2024-02-10T08:38:03.303656+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'19","last_scrub_stamp":"2024-02-10T08:36:58.072861+0000","last_deep_scrub":"213'13","last_deep_scrub_stamp":"2024-02-10T08:25:43.713333+0000","last_clean_scrub_stamp":"2024-02-10T08:36:58.072861+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":94,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.323303+0000","last_change":"2024-02-10T08:36:11.052018+0000","last_active":"2024-02-10T08:38:03.323303+0000","last_peered":"2024-02-10T08:38:03.323303+0000","last_clean":"2024-02-10T08:38:03.323303+0000","last_became_active":"2024-02-10T08:32:36.980715+0000","last_became_peered":"2024-02-10T08:32:36.980715+0000","last_unstale":"2024-02-10T08:38:03.323303+0000","last_undegraded":"2024-02-10T08:38:03.323303+0000","last_fullsized":"2024-02-10T08:38:03.323303+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:11.051916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:36:11.051916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"314'11","reported_seq":541,"reported_epoch":419,"state":"active+clean","last_fresh":"2024-02-10T08:38:11.839854+0000","last_change":"2024-02-10T08:38:11.843456+0000","last_active":"2024-02-10T08:38:11.839854+0000","last_peered":"2024-02-10T08:38:11.839854+0000","last_clean":"2024-02-10T08:38:11.839854+0000","last_became_active":"2024-02-10T08:31:33.885840+0000","last_became_peered":"2024-02-10T08:31:33.885840+0000","last_unstale":"2024-02-10T08:38:11.839854+0000","last_undegraded":"2024-02-10T08:38:11.839854+0000","last_fullsized":"2024-02-10T08:38:11.839854+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"314'11","last_scrub_stamp":"2024-02-10T08:36:23.462220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:36:23.462220+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":385,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.306721+0000","last_change":"2024-02-10T08:37:16.999580+0000","last_active":"2024-02-10T08:38:03.306721+0000","last_peered":"2024-02-10T08:38:03.306721+0000","last_clean":"2024-02-10T08:38:03.306721+0000","last_became_active":"2024-02-10T08:20:46.395788+0000","last_became_peered":"2024-02-10T08:20:46.395788+0000","last_unstale":"2024-02-10T08:38:03.306721+0000","last_undegraded":"2024-02-10T08:38:03.306721+0000","last_fullsized":"2024-02-10T08:38:03.306721+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:16.999487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:37:16.999487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"402'21","reported_seq":415,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.328539+0000","last_change":"2024-02-10T08:36:03.126980+0000","last_active":"2024-02-10T08:38:03.328539+0000","last_peered":"2024-02-10T08:38:03.328539+0000","last_clean":"2024-02-10T08:38:03.328539+0000","last_became_active":"2024-02-10T08:28:25.952354+0000","last_became_peered":"2024-02-10T08:28:25.952354+0000","last_unstale":"2024-02-10T08:38:03.328539+0000","last_undegraded":"2024-02-10T08:38:03.328539+0000","last_fullsized":"2024-02-10T08:38:03.328539+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'15","last_scrub_stamp":"2024-02-10T08:36:03.126898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:36:03.126898+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":34,"num_read_kb":28,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":414,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.304946+0000","last_change":"2024-02-10T08:37:19.973850+0000","last_active":"2024-02-10T08:38:03.304946+0000","last_peered":"2024-02-10T08:38:03.304946+0000","last_clean":"2024-02-10T08:38:03.304946+0000","last_became_active":"2024-02-10T08:16:52.786213+0000","last_became_peered":"2024-02-10T08:16:52.786213+0000","last_unstale":"2024-02-10T08:38:03.304946+0000","last_undegraded":"2024-02-10T08:38:03.304946+0000","last_fullsized":"2024-02-10T08:38:03.304946+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:19.973760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:37:19.973760+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":231,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.323765+0000","last_change":"2024-02-10T08:37:16.974830+0000","last_active":"2024-02-10T08:38:03.323765+0000","last_peered":"2024-02-10T08:38:03.323765+0000","last_clean":"2024-02-10T08:38:03.323765+0000","last_became_active":"2024-02-10T08:28:25.950221+0000","last_became_peered":"2024-02-10T08:28:25.950221+0000","last_unstale":"2024-02-10T08:38:03.323765+0000","last_undegraded":"2024-02-10T08:38:03.323765+0000","last_fullsized":"2024-02-10T08:38:03.323765+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:16.974733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:33:28.821928+0000","last_clean_scrub_stamp":"2024-02-10T08:37:16.974733+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":237,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.322522+0000","last_change":"2024-02-10T08:37:05.034513+0000","last_active":"2024-02-10T08:38:03.322522+0000","last_peered":"2024-02-10T08:38:03.322522+0000","last_clean":"2024-02-10T08:38:03.322522+0000","last_became_active":"2024-02-10T08:30:24.070440+0000","last_became_peered":"2024-02-10T08:30:24.070440+0000","last_unstale":"2024-02-10T08:38:03.322522+0000","last_undegraded":"2024-02-10T08:38:03.322522+0000","last_fullsized":"2024-02-10T08:38:03.322522+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:05.034416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:37:05.034416+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"402'32","reported_seq":449,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.306296+0000","last_change":"2024-02-10T08:36:23.221000+0000","last_active":"2024-02-10T08:38:03.306296+0000","last_peered":"2024-02-10T08:38:03.306296+0000","last_clean":"2024-02-10T08:38:03.306296+0000","last_became_active":"2024-02-10T08:20:46.396130+0000","last_became_peered":"2024-02-10T08:20:46.396130+0000","last_unstale":"2024-02-10T08:38:03.306296+0000","last_undegraded":"2024-02-10T08:38:03.306296+0000","last_fullsized":"2024-02-10T08:38:03.306296+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'24","last_scrub_stamp":"2024-02-10T08:36:23.220919+0000","last_deep_scrub":"201'16","last_deep_scrub_stamp":"2024-02-10T08:24:49.177357+0000","last_clean_scrub_stamp":"2024-02-10T08:36:23.220919+0000","log_size":32,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":425,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.316172+0000","last_change":"2024-02-10T08:38:03.014639+0000","last_active":"2024-02-10T08:38:03.316172+0000","last_peered":"2024-02-10T08:38:03.316172+0000","last_clean":"2024-02-10T08:38:03.316172+0000","last_became_active":"2024-02-10T08:32:36.974379+0000","last_became_peered":"2024-02-10T08:32:36.974379+0000","last_unstale":"2024-02-10T08:38:03.316172+0000","last_undegraded":"2024-02-10T08:38:03.316172+0000","last_fullsized":"2024-02-10T08:38:03.316172+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:38:03.014547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:38:03.014547+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":419,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.315025+0000","last_change":"2024-02-10T08:38:02.063980+0000","last_active":"2024-02-10T08:38:03.315025+0000","last_peered":"2024-02-10T08:38:03.315025+0000","last_clean":"2024-02-10T08:38:03.315025+0000","last_became_active":"2024-02-10T08:31:33.893973+0000","last_became_peered":"2024-02-10T08:31:33.893973+0000","last_unstale":"2024-02-10T08:38:03.315025+0000","last_undegraded":"2024-02-10T08:38:03.315025+0000","last_fullsized":"2024-02-10T08:38:03.315025+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:38:02.063832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:38:02.063832+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":99,"reported_epoch":419,"state":"active+clean","last_fresh":"2024-02-10T08:38:06.292864+0000","last_change":"2024-02-10T08:38:06.292864+0000","last_active":"2024-02-10T08:38:06.292864+0000","last_peered":"2024-02-10T08:38:06.292864+0000","last_clean":"2024-02-10T08:38:06.292864+0000","last_became_active":"2024-02-10T08:32:36.979093+0000","last_became_peered":"2024-02-10T08:32:36.979093+0000","last_unstale":"2024-02-10T08:38:06.292864+0000","last_undegraded":"2024-02-10T08:38:06.292864+0000","last_fullsized":"2024-02-10T08:38:06.292864+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:38:06.292772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:38:06.292772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,5],"acting":[0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"402'12","reported_seq":338,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.313739+0000","last_change":"2024-02-10T08:37:26.115814+0000","last_active":"2024-02-10T08:38:03.313739+0000","last_peered":"2024-02-10T08:38:03.313739+0000","last_clean":"2024-02-10T08:38:03.313739+0000","last_became_active":"2024-02-10T08:22:23.522936+0000","last_became_peered":"2024-02-10T08:22:23.522936+0000","last_unstale":"2024-02-10T08:38:03.313739+0000","last_undegraded":"2024-02-10T08:38:03.313739+0000","last_fullsized":"2024-02-10T08:38:03.313739+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'12","last_scrub_stamp":"2024-02-10T08:37:26.115699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:37:26.115699+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,6],"acting":[1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":407,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.303709+0000","last_change":"2024-02-10T08:37:56.416861+0000","last_active":"2024-02-10T08:38:03.303709+0000","last_peered":"2024-02-10T08:38:03.303709+0000","last_clean":"2024-02-10T08:38:03.303709+0000","last_became_active":"2024-02-10T08:16:52.788704+0000","last_became_peered":"2024-02-10T08:16:52.788704+0000","last_unstale":"2024-02-10T08:38:03.303709+0000","last_undegraded":"2024-02-10T08:38:03.303709+0000","last_fullsized":"2024-02-10T08:38:03.303709+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:56.416754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:37:56.416754+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":413,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.304604+0000","last_change":"2024-02-10T08:37:04.950235+0000","last_active":"2024-02-10T08:38:03.304604+0000","last_peered":"2024-02-10T08:38:03.304604+0000","last_clean":"2024-02-10T08:38:03.304604+0000","last_became_active":"2024-02-10T08:20:46.397495+0000","last_became_peered":"2024-02-10T08:20:46.397495+0000","last_unstale":"2024-02-10T08:38:03.304604+0000","last_undegraded":"2024-02-10T08:38:03.304604+0000","last_fullsized":"2024-02-10T08:38:03.304604+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:04.950117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:37:04.950117+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":420,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.310294+0000","last_change":"2024-02-10T08:38:01.767858+0000","last_active":"2024-02-10T08:38:03.310294+0000","last_peered":"2024-02-10T08:38:03.310294+0000","last_clean":"2024-02-10T08:38:03.310294+0000","last_became_active":"2024-02-10T08:30:24.064419+0000","last_became_peered":"2024-02-10T08:30:24.064419+0000","last_unstale":"2024-02-10T08:38:03.310294+0000","last_undegraded":"2024-02-10T08:38:03.310294+0000","last_fullsized":"2024-02-10T08:38:03.310294+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:38:01.767792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:27.276490+0000","last_clean_scrub_stamp":"2024-02-10T08:38:01.767792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"402'27","reported_seq":358,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.310014+0000","last_change":"2024-02-10T08:36:16.410241+0000","last_active":"2024-02-10T08:38:03.310014+0000","last_peered":"2024-02-10T08:38:03.310014+0000","last_clean":"2024-02-10T08:38:03.310014+0000","last_became_active":"2024-02-10T08:22:23.526198+0000","last_became_peered":"2024-02-10T08:22:23.526198+0000","last_unstale":"2024-02-10T08:38:03.310014+0000","last_undegraded":"2024-02-10T08:38:03.310014+0000","last_fullsized":"2024-02-10T08:38:03.310014+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'19","last_scrub_stamp":"2024-02-10T08:36:16.410126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:36:16.410126+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":36,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":407,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.305327+0000","last_change":"2024-02-10T08:37:10.034590+0000","last_active":"2024-02-10T08:38:03.305327+0000","last_peered":"2024-02-10T08:38:03.305327+0000","last_clean":"2024-02-10T08:38:03.305327+0000","last_became_active":"2024-02-10T08:16:52.788629+0000","last_became_peered":"2024-02-10T08:16:52.788629+0000","last_unstale":"2024-02-10T08:38:03.305327+0000","last_undegraded":"2024-02-10T08:38:03.305327+0000","last_fullsized":"2024-02-10T08:38:03.305327+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:10.034501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:38.360929+0000","last_clean_scrub_stamp":"2024-02-10T08:37:10.034501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":413,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:04.866980+0000","last_change":"2024-02-10T08:38:04.866944+0000","last_active":"2024-02-10T08:38:04.866980+0000","last_peered":"2024-02-10T08:38:04.866980+0000","last_clean":"2024-02-10T08:38:04.866980+0000","last_became_active":"2024-02-10T08:20:46.399838+0000","last_became_peered":"2024-02-10T08:20:46.399838+0000","last_unstale":"2024-02-10T08:38:04.866980+0000","last_undegraded":"2024-02-10T08:38:04.866980+0000","last_fullsized":"2024-02-10T08:38:04.866980+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:38:04.866853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:38:04.866853+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":99,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.323381+0000","last_change":"2024-02-10T08:37:25.149911+0000","last_active":"2024-02-10T08:38:03.323381+0000","last_peered":"2024-02-10T08:38:03.323381+0000","last_clean":"2024-02-10T08:38:03.323381+0000","last_became_active":"2024-02-10T08:32:36.982778+0000","last_became_peered":"2024-02-10T08:32:36.982778+0000","last_unstale":"2024-02-10T08:38:03.323381+0000","last_undegraded":"2024-02-10T08:38:03.323381+0000","last_fullsized":"2024-02-10T08:38:03.323381+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:25.149841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:34:30.191790+0000","last_clean_scrub_stamp":"2024-02-10T08:37:25.149841+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"402'35","reported_seq":523,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.324379+0000","last_change":"2024-02-10T08:36:22.029398+0000","last_active":"2024-02-10T08:38:03.324379+0000","last_peered":"2024-02-10T08:38:03.324379+0000","last_clean":"2024-02-10T08:38:03.324379+0000","last_became_active":"2024-02-10T08:31:33.879680+0000","last_became_peered":"2024-02-10T08:31:33.879680+0000","last_unstale":"2024-02-10T08:38:03.324379+0000","last_undegraded":"2024-02-10T08:38:03.324379+0000","last_fullsized":"2024-02-10T08:38:03.324379+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"225'25","last_scrub_stamp":"2024-02-10T08:36:22.029278+0000","last_deep_scrub":"225'25","last_deep_scrub_stamp":"2024-02-10T08:36:22.029278+0000","last_clean_scrub_stamp":"2024-02-10T08:36:22.029278+0000","log_size":35,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":39,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":412,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.302905+0000","last_change":"2024-02-10T08:35:10.165815+0000","last_active":"2024-02-10T08:38:03.302905+0000","last_peered":"2024-02-10T08:38:03.302905+0000","last_clean":"2024-02-10T08:38:03.302905+0000","last_became_active":"2024-02-10T08:20:46.392466+0000","last_became_peered":"2024-02-10T08:20:46.392466+0000","last_unstale":"2024-02-10T08:38:03.302905+0000","last_undegraded":"2024-02-10T08:38:03.302905+0000","last_fullsized":"2024-02-10T08:38:03.302905+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:35:10.165751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:29:26.072031+0000","last_clean_scrub_stamp":"2024-02-10T08:35:10.165751+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1f","version":"111'11","reported_seq":691,"reported_epoch":419,"state":"active+clean","last_fresh":"2024-02-10T08:38:06.264695+0000","last_change":"2024-02-10T08:37:56.949513+0000","last_active":"2024-02-10T08:38:06.264695+0000","last_peered":"2024-02-10T08:38:06.264695+0000","last_clean":"2024-02-10T08:38:06.264695+0000","last_became_active":"2024-02-10T08:20:46.402663+0000","last_became_peered":"2024-02-10T08:20:46.402663+0000","last_unstale":"2024-02-10T08:38:06.264695+0000","last_undegraded":"2024-02-10T08:38:06.264695+0000","last_fullsized":"2024-02-10T08:38:06.264695+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'11","last_scrub_stamp":"2024-02-10T08:37:56.949405+0000","last_deep_scrub":"111'11","last_deep_scrub_stamp":"2024-02-10T08:36:26.882513+0000","last_clean_scrub_stamp":"2024-02-10T08:37:56.949405+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"87'2","reported_seq":398,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.311411+0000","last_change":"2024-02-10T08:37:24.649594+0000","last_active":"2024-02-10T08:38:03.311411+0000","last_peered":"2024-02-10T08:38:03.311411+0000","last_clean":"2024-02-10T08:38:03.311411+0000","last_became_active":"2024-02-10T08:16:58.859047+0000","last_became_peered":"2024-02-10T08:16:58.859047+0000","last_unstale":"2024-02-10T08:38:03.311411+0000","last_undegraded":"2024-02-10T08:38:03.311411+0000","last_fullsized":"2024-02-10T08:38:03.311411+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'2","last_scrub_stamp":"2024-02-10T08:37:24.649522+0000","last_deep_scrub":"87'2","last_deep_scrub_stamp":"2024-02-10T08:19:29.207531+0000","last_clean_scrub_stamp":"2024-02-10T08:37:24.649522+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"402'27","reported_seq":451,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.305386+0000","last_change":"2024-02-10T08:37:15.944427+0000","last_active":"2024-02-10T08:38:03.305386+0000","last_peered":"2024-02-10T08:38:03.305386+0000","last_clean":"2024-02-10T08:38:03.305386+0000","last_became_active":"2024-02-10T08:16:54.852665+0000","last_became_peered":"2024-02-10T08:16:54.852665+0000","last_unstale":"2024-02-10T08:38:03.305386+0000","last_undegraded":"2024-02-10T08:38:03.305386+0000","last_fullsized":"2024-02-10T08:38:03.305386+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'27","last_scrub_stamp":"2024-02-10T08:37:15.944334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:37:15.944334+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":344,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.304561+0000","last_change":"2024-02-10T08:36:20.955661+0000","last_active":"2024-02-10T08:38:03.304561+0000","last_peered":"2024-02-10T08:38:03.304561+0000","last_clean":"2024-02-10T08:38:03.304561+0000","last_became_active":"2024-02-10T08:31:33.878473+0000","last_became_peered":"2024-02-10T08:31:33.878473+0000","last_unstale":"2024-02-10T08:38:03.304561+0000","last_undegraded":"2024-02-10T08:38:03.304561+0000","last_fullsized":"2024-02-10T08:38:03.304561+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:20.955583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:25:42.124914+0000","last_clean_scrub_stamp":"2024-02-10T08:36:20.955583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":228,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.324421+0000","last_change":"2024-02-10T08:36:13.964373+0000","last_active":"2024-02-10T08:38:03.324421+0000","last_peered":"2024-02-10T08:38:03.324421+0000","last_clean":"2024-02-10T08:38:03.324421+0000","last_became_active":"2024-02-10T08:28:25.951312+0000","last_became_peered":"2024-02-10T08:28:25.951312+0000","last_unstale":"2024-02-10T08:38:03.324421+0000","last_undegraded":"2024-02-10T08:38:03.324421+0000","last_fullsized":"2024-02-10T08:38:03.324421+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:13.964287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:36:13.964287+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":407,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.315974+0000","last_change":"2024-02-10T08:37:02.966867+0000","last_active":"2024-02-10T08:38:03.315974+0000","last_peered":"2024-02-10T08:38:03.315974+0000","last_clean":"2024-02-10T08:38:03.315974+0000","last_became_active":"2024-02-10T08:20:46.408504+0000","last_became_peered":"2024-02-10T08:20:46.408504+0000","last_unstale":"2024-02-10T08:38:03.315974+0000","last_undegraded":"2024-02-10T08:38:03.315974+0000","last_fullsized":"2024-02-10T08:38:03.315974+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:02.966806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:22.104988+0000","last_clean_scrub_stamp":"2024-02-10T08:37:02.966806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"402'46","reported_seq":530,"reported_epoch":419,"state":"active+clean","last_fresh":"2024-02-10T08:38:06.007136+0000","last_change":"2024-02-10T08:37:28.570310+0000","last_active":"2024-02-10T08:38:06.007136+0000","last_peered":"2024-02-10T08:38:06.007136+0000","last_clean":"2024-02-10T08:38:06.007136+0000","last_became_active":"2024-02-10T08:31:33.894960+0000","last_became_peered":"2024-02-10T08:31:33.894960+0000","last_unstale":"2024-02-10T08:38:06.007136+0000","last_undegraded":"2024-02-10T08:38:06.007136+0000","last_fullsized":"2024-02-10T08:38:06.007136+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'46","last_scrub_stamp":"2024-02-10T08:37:28.570191+0000","last_deep_scrub":"330'34","last_deep_scrub_stamp":"2024-02-10T08:32:17.481832+0000","last_clean_scrub_stamp":"2024-02-10T08:37:28.570191+0000","log_size":46,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":62,"num_read_kb":53,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":422,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.304943+0000","last_change":"2024-02-10T08:37:22.981217+0000","last_active":"2024-02-10T08:38:03.304943+0000","last_peered":"2024-02-10T08:38:03.304943+0000","last_clean":"2024-02-10T08:38:03.304943+0000","last_became_active":"2024-02-10T08:20:46.396303+0000","last_became_peered":"2024-02-10T08:20:46.396303+0000","last_unstale":"2024-02-10T08:38:03.304943+0000","last_undegraded":"2024-02-10T08:38:03.304943+0000","last_fullsized":"2024-02-10T08:38:03.304943+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:22.981118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:10.370746+0000","last_clean_scrub_stamp":"2024-02-10T08:37:22.981118+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":427,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.316407+0000","last_change":"2024-02-10T08:37:06.943759+0000","last_active":"2024-02-10T08:38:03.316407+0000","last_peered":"2024-02-10T08:38:03.316407+0000","last_clean":"2024-02-10T08:38:03.316407+0000","last_became_active":"2024-02-10T08:28:02.763523+0000","last_became_peered":"2024-02-10T08:28:02.763523+0000","last_unstale":"2024-02-10T08:38:03.316407+0000","last_undegraded":"2024-02-10T08:38:03.316407+0000","last_fullsized":"2024-02-10T08:38:03.316407+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:06.943647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:37:06.943647+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":375,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.306822+0000","last_change":"2024-02-10T08:36:26.255325+0000","last_active":"2024-02-10T08:38:03.306822+0000","last_peered":"2024-02-10T08:38:03.306822+0000","last_clean":"2024-02-10T08:38:03.306822+0000","last_became_active":"2024-02-10T08:20:46.403378+0000","last_became_peered":"2024-02-10T08:20:46.403378+0000","last_unstale":"2024-02-10T08:38:03.306822+0000","last_undegraded":"2024-02-10T08:38:03.306822+0000","last_fullsized":"2024-02-10T08:38:03.306822+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:26.255232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:36:26.255232+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"402'29","reported_seq":418,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.316328+0000","last_change":"2024-02-10T08:36:21.774391+0000","last_active":"2024-02-10T08:38:03.316328+0000","last_peered":"2024-02-10T08:38:03.316328+0000","last_clean":"2024-02-10T08:38:03.316328+0000","last_became_active":"2024-02-10T08:31:33.891562+0000","last_became_peered":"2024-02-10T08:31:33.891562+0000","last_unstale":"2024-02-10T08:38:03.316328+0000","last_undegraded":"2024-02-10T08:38:03.316328+0000","last_fullsized":"2024-02-10T08:38:03.316328+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"226'23","last_scrub_stamp":"2024-02-10T08:36:21.774228+0000","last_deep_scrub":"226'23","last_deep_scrub_stamp":"2024-02-10T08:33:31.665189+0000","last_clean_scrub_stamp":"2024-02-10T08:36:21.774228+0000","log_size":29,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":321,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.310715+0000","last_change":"2024-02-10T08:36:57.566152+0000","last_active":"2024-02-10T08:38:03.310715+0000","last_peered":"2024-02-10T08:38:03.310715+0000","last_clean":"2024-02-10T08:38:03.310715+0000","last_became_active":"2024-02-10T08:31:33.879918+0000","last_became_peered":"2024-02-10T08:31:33.879918+0000","last_unstale":"2024-02-10T08:38:03.310715+0000","last_undegraded":"2024-02-10T08:38:03.310715+0000","last_fullsized":"2024-02-10T08:38:03.310715+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:57.566061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:36:57.566061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":377,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.307043+0000","last_change":"2024-02-10T08:37:17.819749+0000","last_active":"2024-02-10T08:38:03.307043+0000","last_peered":"2024-02-10T08:38:03.307043+0000","last_clean":"2024-02-10T08:38:03.307043+0000","last_became_active":"2024-02-10T08:20:46.398532+0000","last_became_peered":"2024-02-10T08:20:46.398532+0000","last_unstale":"2024-02-10T08:38:03.307043+0000","last_undegraded":"2024-02-10T08:38:03.307043+0000","last_fullsized":"2024-02-10T08:38:03.307043+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:17.819656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:37:17.819656+0000","last_clean_scrub_stamp":"2024-02-10T08:37:17.819656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":313,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.305486+0000","last_change":"2024-02-10T08:37:02.097619+0000","last_active":"2024-02-10T08:38:03.305486+0000","last_peered":"2024-02-10T08:38:03.305486+0000","last_clean":"2024-02-10T08:38:03.305486+0000","last_became_active":"2024-02-10T08:22:23.526229+0000","last_became_peered":"2024-02-10T08:22:23.526229+0000","last_unstale":"2024-02-10T08:38:03.305486+0000","last_undegraded":"2024-02-10T08:38:03.305486+0000","last_fullsized":"2024-02-10T08:38:03.305486+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:02.097524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:37:02.097524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1a","version":"402'21","reported_seq":140,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.306125+0000","last_change":"2024-02-10T08:37:06.900806+0000","last_active":"2024-02-10T08:38:03.306125+0000","last_peered":"2024-02-10T08:38:03.306125+0000","last_clean":"2024-02-10T08:38:03.306125+0000","last_became_active":"2024-02-10T08:31:46.069680+0000","last_became_peered":"2024-02-10T08:31:46.069680+0000","last_unstale":"2024-02-10T08:38:03.306125+0000","last_undegraded":"2024-02-10T08:38:03.306125+0000","last_fullsized":"2024-02-10T08:38:03.306125+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'21","last_scrub_stamp":"2024-02-10T08:37:06.900702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:37:06.900702+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":34,"num_read_kb":28,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":402,"reported_epoch":419,"state":"active+clean","last_fresh":"2024-02-10T08:38:08.908119+0000","last_change":"2024-02-10T08:38:08.908119+0000","last_active":"2024-02-10T08:38:08.908119+0000","last_peered":"2024-02-10T08:38:08.908119+0000","last_clean":"2024-02-10T08:38:08.908119+0000","last_became_active":"2024-02-10T08:16:52.787865+0000","last_became_peered":"2024-02-10T08:16:52.787865+0000","last_unstale":"2024-02-10T08:38:08.908119+0000","last_undegraded":"2024-02-10T08:38:08.908119+0000","last_fullsized":"2024-02-10T08:38:08.908119+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:38:08.908022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:28.028556+0000","last_clean_scrub_stamp":"2024-02-10T08:38:08.908022+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":429,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.302609+0000","last_change":"2024-02-10T08:35:08.193565+0000","last_active":"2024-02-10T08:38:03.302609+0000","last_peered":"2024-02-10T08:38:03.302609+0000","last_clean":"2024-02-10T08:38:03.302609+0000","last_became_active":"2024-02-10T08:28:19.065132+0000","last_became_peered":"2024-02-10T08:28:19.065132+0000","last_unstale":"2024-02-10T08:38:03.302609+0000","last_undegraded":"2024-02-10T08:38:03.302609+0000","last_fullsized":"2024-02-10T08:38:03.302609+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:35:08.193502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:35:08.193502+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,7],"acting":[5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":99,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.322394+0000","last_change":"2024-02-10T08:36:23.009770+0000","last_active":"2024-02-10T08:38:03.322394+0000","last_peered":"2024-02-10T08:38:03.322394+0000","last_clean":"2024-02-10T08:38:03.322394+0000","last_became_active":"2024-02-10T08:32:36.978752+0000","last_became_peered":"2024-02-10T08:32:36.978752+0000","last_unstale":"2024-02-10T08:38:03.322394+0000","last_undegraded":"2024-02-10T08:38:03.322394+0000","last_fullsized":"2024-02-10T08:38:03.322394+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:23.009704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:36:23.009704+0000","last_clean_scrub_stamp":"2024-02-10T08:36:23.009704+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"402'9","reported_seq":434,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.306401+0000","last_change":"2024-02-10T08:37:26.907843+0000","last_active":"2024-02-10T08:38:03.306401+0000","last_peered":"2024-02-10T08:38:03.306401+0000","last_clean":"2024-02-10T08:38:03.306401+0000","last_became_active":"2024-02-10T08:27:27.715306+0000","last_became_peered":"2024-02-10T08:27:27.715306+0000","last_unstale":"2024-02-10T08:38:03.306401+0000","last_undegraded":"2024-02-10T08:38:03.306401+0000","last_fullsized":"2024-02-10T08:38:03.306401+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'9","last_scrub_stamp":"2024-02-10T08:37:26.907734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:37:26.907734+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":12,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"55'1","reported_seq":430,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.310402+0000","last_change":"2024-02-10T08:37:12.516833+0000","last_active":"2024-02-10T08:38:03.310402+0000","last_peered":"2024-02-10T08:38:03.310402+0000","last_clean":"2024-02-10T08:38:03.310402+0000","last_became_active":"2024-02-10T08:28:02.761299+0000","last_became_peered":"2024-02-10T08:28:02.761299+0000","last_unstale":"2024-02-10T08:38:03.310402+0000","last_undegraded":"2024-02-10T08:38:03.310402+0000","last_fullsized":"2024-02-10T08:38:03.310402+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'1","last_scrub_stamp":"2024-02-10T08:37:12.516726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:37:12.516726+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1746,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":413,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.310050+0000","last_change":"2024-02-10T08:37:26.672220+0000","last_active":"2024-02-10T08:38:03.310050+0000","last_peered":"2024-02-10T08:38:03.310050+0000","last_clean":"2024-02-10T08:38:03.310050+0000","last_became_active":"2024-02-10T08:20:46.406783+0000","last_became_peered":"2024-02-10T08:20:46.406783+0000","last_unstale":"2024-02-10T08:38:03.310050+0000","last_undegraded":"2024-02-10T08:38:03.310050+0000","last_fullsized":"2024-02-10T08:38:03.310050+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:26.672121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:37:26.672121+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":414,"reported_epoch":419,"state":"active+clean","last_fresh":"2024-02-10T08:38:11.403539+0000","last_change":"2024-02-10T08:38:11.403539+0000","last_active":"2024-02-10T08:38:11.403539+0000","last_peered":"2024-02-10T08:38:11.403539+0000","last_clean":"2024-02-10T08:38:11.403539+0000","last_became_active":"2024-02-10T08:31:33.886617+0000","last_became_peered":"2024-02-10T08:31:33.886617+0000","last_unstale":"2024-02-10T08:38:11.403539+0000","last_undegraded":"2024-02-10T08:38:11.403539+0000","last_fullsized":"2024-02-10T08:38:11.403539+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:38:11.403470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:34:34.307158+0000","last_clean_scrub_stamp":"2024-02-10T08:38:11.403470+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"401'25","reported_seq":412,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.305970+0000","last_change":"2024-02-10T08:37:00.943143+0000","last_active":"2024-02-10T08:38:03.305970+0000","last_peered":"2024-02-10T08:38:03.305970+0000","last_clean":"2024-02-10T08:38:03.305970+0000","last_became_active":"2024-02-10T08:20:46.404966+0000","last_became_peered":"2024-02-10T08:20:46.404966+0000","last_unstale":"2024-02-10T08:38:03.305970+0000","last_undegraded":"2024-02-10T08:38:03.305970+0000","last_fullsized":"2024-02-10T08:38:03.305970+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"401'21","last_scrub_stamp":"2024-02-10T08:37:00.943036+0000","last_deep_scrub":"358'19","last_deep_scrub_stamp":"2024-02-10T08:33:34.450897+0000","last_clean_scrub_stamp":"2024-02-10T08:37:00.943036+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":34,"num_read_kb":28,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":105,"reported_epoch":419,"state":"active+clean","last_fresh":"2024-02-10T08:38:08.296480+0000","last_change":"2024-02-10T08:38:08.296480+0000","last_active":"2024-02-10T08:38:08.296480+0000","last_peered":"2024-02-10T08:38:08.296480+0000","last_clean":"2024-02-10T08:38:08.296480+0000","last_became_active":"2024-02-10T08:32:36.982675+0000","last_became_peered":"2024-02-10T08:32:36.982675+0000","last_unstale":"2024-02-10T08:38:08.296480+0000","last_undegraded":"2024-02-10T08:38:08.296480+0000","last_fullsized":"2024-02-10T08:38:08.296480+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:38:08.296391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:38:08.296391+0000","last_clean_scrub_stamp":"2024-02-10T08:38:08.296391+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,5],"acting":[0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":394,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.313857+0000","last_change":"2024-02-10T08:36:17.766707+0000","last_active":"2024-02-10T08:38:03.313857+0000","last_peered":"2024-02-10T08:38:03.313857+0000","last_clean":"2024-02-10T08:38:03.313857+0000","last_became_active":"2024-02-10T08:16:56.863353+0000","last_became_peered":"2024-02-10T08:16:56.863353+0000","last_unstale":"2024-02-10T08:38:03.313857+0000","last_undegraded":"2024-02-10T08:38:03.313857+0000","last_fullsized":"2024-02-10T08:38:03.313857+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:17.766647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:36:17.766647+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":381,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.306465+0000","last_change":"2024-02-10T08:37:08.945376+0000","last_active":"2024-02-10T08:38:03.306465+0000","last_peered":"2024-02-10T08:38:03.306465+0000","last_clean":"2024-02-10T08:38:03.306465+0000","last_became_active":"2024-02-10T08:20:46.405314+0000","last_became_peered":"2024-02-10T08:20:46.405314+0000","last_unstale":"2024-02-10T08:38:03.306465+0000","last_undegraded":"2024-02-10T08:38:03.306465+0000","last_fullsized":"2024-02-10T08:38:03.306465+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:08.945287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:29:25.024412+0000","last_clean_scrub_stamp":"2024-02-10T08:37:08.945287+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"402'39","reported_seq":487,"reported_epoch":419,"state":"active+clean","last_fresh":"2024-02-10T08:38:06.006541+0000","last_change":"2024-02-10T08:37:56.817027+0000","last_active":"2024-02-10T08:38:06.006541+0000","last_peered":"2024-02-10T08:38:06.006541+0000","last_clean":"2024-02-10T08:38:06.006541+0000","last_became_active":"2024-02-10T08:31:33.883535+0000","last_became_peered":"2024-02-10T08:31:33.883535+0000","last_unstale":"2024-02-10T08:38:06.006541+0000","last_undegraded":"2024-02-10T08:38:06.006541+0000","last_fullsized":"2024-02-10T08:38:06.006541+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'39","last_scrub_stamp":"2024-02-10T08:37:56.816921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:37:56.816921+0000","log_size":39,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":99,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.325079+0000","last_change":"2024-02-10T08:36:25.970207+0000","last_active":"2024-02-10T08:38:03.325079+0000","last_peered":"2024-02-10T08:38:03.325079+0000","last_clean":"2024-02-10T08:38:03.325079+0000","last_became_active":"2024-02-10T08:32:36.977972+0000","last_became_peered":"2024-02-10T08:32:36.977972+0000","last_unstale":"2024-02-10T08:38:03.325079+0000","last_undegraded":"2024-02-10T08:38:03.325079+0000","last_fullsized":"2024-02-10T08:38:03.325079+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:25.970136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:36:25.970136+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":121,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.305945+0000","last_change":"2024-02-10T08:36:24.205289+0000","last_active":"2024-02-10T08:38:03.305945+0000","last_peered":"2024-02-10T08:38:03.305945+0000","last_clean":"2024-02-10T08:38:03.305945+0000","last_became_active":"2024-02-10T08:31:46.057858+0000","last_became_peered":"2024-02-10T08:31:46.057858+0000","last_unstale":"2024-02-10T08:38:03.305945+0000","last_undegraded":"2024-02-10T08:38:03.305945+0000","last_fullsized":"2024-02-10T08:38:03.305945+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:24.205221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:36:24.205221+0000","last_clean_scrub_stamp":"2024-02-10T08:36:24.205221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":326,"reported_epoch":419,"state":"active+clean","last_fresh":"2024-02-10T08:38:07.012946+0000","last_change":"2024-02-10T08:38:07.012946+0000","last_active":"2024-02-10T08:38:07.012946+0000","last_peered":"2024-02-10T08:38:07.012946+0000","last_clean":"2024-02-10T08:38:07.012946+0000","last_became_active":"2024-02-10T08:31:33.880328+0000","last_became_peered":"2024-02-10T08:31:33.880328+0000","last_unstale":"2024-02-10T08:38:07.012946+0000","last_undegraded":"2024-02-10T08:38:07.012946+0000","last_fullsized":"2024-02-10T08:38:07.012946+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:38:07.012882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:35:19.525667+0000","last_clean_scrub_stamp":"2024-02-10T08:38:07.012882+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":310,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.322663+0000","last_change":"2024-02-10T08:36:19.772188+0000","last_active":"2024-02-10T08:38:03.322663+0000","last_peered":"2024-02-10T08:38:03.322663+0000","last_clean":"2024-02-10T08:38:03.322663+0000","last_became_active":"2024-02-10T08:22:00.581772+0000","last_became_peered":"2024-02-10T08:22:00.581772+0000","last_unstale":"2024-02-10T08:38:03.322663+0000","last_undegraded":"2024-02-10T08:38:03.322663+0000","last_fullsized":"2024-02-10T08:38:03.322663+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:19.772116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:36:19.772116+0000","last_clean_scrub_stamp":"2024-02-10T08:36:19.772116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,7],"acting":[1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":328,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.309620+0000","last_change":"2024-02-10T08:37:09.583191+0000","last_active":"2024-02-10T08:38:03.309620+0000","last_peered":"2024-02-10T08:38:03.309620+0000","last_clean":"2024-02-10T08:38:03.309620+0000","last_became_active":"2024-02-10T08:31:46.054713+0000","last_became_peered":"2024-02-10T08:31:46.054713+0000","last_unstale":"2024-02-10T08:38:03.309620+0000","last_undegraded":"2024-02-10T08:38:03.309620+0000","last_fullsized":"2024-02-10T08:38:03.309620+0000","mapping_epoch":317,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":318,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:09.583098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:37:09.583098+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":317,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.304664+0000","last_change":"2024-02-10T08:36:54.988639+0000","last_active":"2024-02-10T08:38:03.304664+0000","last_peered":"2024-02-10T08:38:03.304664+0000","last_clean":"2024-02-10T08:38:03.304664+0000","last_became_active":"2024-02-10T08:22:00.600200+0000","last_became_peered":"2024-02-10T08:22:00.600200+0000","last_unstale":"2024-02-10T08:38:03.304664+0000","last_undegraded":"2024-02-10T08:38:03.304664+0000","last_fullsized":"2024-02-10T08:38:03.304664+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:54.988559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:36:54.988559+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1],"acting":[6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":302,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.323461+0000","last_change":"2024-02-10T08:37:01.145599+0000","last_active":"2024-02-10T08:38:03.323461+0000","last_peered":"2024-02-10T08:38:03.323461+0000","last_clean":"2024-02-10T08:38:03.323461+0000","last_became_active":"2024-02-10T08:28:25.999335+0000","last_became_peered":"2024-02-10T08:28:25.999335+0000","last_unstale":"2024-02-10T08:38:03.323461+0000","last_undegraded":"2024-02-10T08:38:03.323461+0000","last_fullsized":"2024-02-10T08:38:03.323461+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:01.145508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:37:01.145508+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":424,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.302437+0000","last_change":"2024-02-10T08:37:15.183869+0000","last_active":"2024-02-10T08:38:03.302437+0000","last_peered":"2024-02-10T08:38:03.302437+0000","last_clean":"2024-02-10T08:38:03.302437+0000","last_became_active":"2024-02-10T08:31:33.879440+0000","last_became_peered":"2024-02-10T08:31:33.879440+0000","last_unstale":"2024-02-10T08:38:03.302437+0000","last_undegraded":"2024-02-10T08:38:03.302437+0000","last_fullsized":"2024-02-10T08:38:03.302437+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:15.183781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:37:15.183781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":430,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.305690+0000","last_change":"2024-02-10T08:38:00.976321+0000","last_active":"2024-02-10T08:38:03.305690+0000","last_peered":"2024-02-10T08:38:03.305690+0000","last_clean":"2024-02-10T08:38:03.305690+0000","last_became_active":"2024-02-10T08:27:27.710587+0000","last_became_peered":"2024-02-10T08:27:27.710587+0000","last_unstale":"2024-02-10T08:38:03.305690+0000","last_undegraded":"2024-02-10T08:38:03.305690+0000","last_fullsized":"2024-02-10T08:38:03.305690+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:38:00.976255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:11.750537+0000","last_clean_scrub_stamp":"2024-02-10T08:38:00.976255+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,1],"acting":[6,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":328,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.315340+0000","last_change":"2024-02-10T08:36:22.783889+0000","last_active":"2024-02-10T08:38:03.315340+0000","last_peered":"2024-02-10T08:38:03.315340+0000","last_clean":"2024-02-10T08:38:03.315340+0000","last_became_active":"2024-02-10T08:32:36.974142+0000","last_became_peered":"2024-02-10T08:32:36.974142+0000","last_unstale":"2024-02-10T08:38:03.315340+0000","last_undegraded":"2024-02-10T08:38:03.315340+0000","last_fullsized":"2024-02-10T08:38:03.315340+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:22.783769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:36:22.783769+0000","last_clean_scrub_stamp":"2024-02-10T08:36:22.783769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":333,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.305287+0000","last_change":"2024-02-10T08:36:56.112985+0000","last_active":"2024-02-10T08:38:03.305287+0000","last_peered":"2024-02-10T08:38:03.305287+0000","last_clean":"2024-02-10T08:38:03.305287+0000","last_became_active":"2024-02-10T08:32:36.979412+0000","last_became_peered":"2024-02-10T08:32:36.979412+0000","last_unstale":"2024-02-10T08:38:03.305287+0000","last_undegraded":"2024-02-10T08:38:03.305287+0000","last_fullsized":"2024-02-10T08:38:03.305287+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:56.112889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:36:56.112889+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1],"acting":[6,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":411,"reported_epoch":419,"state":"active+clean","last_fresh":"2024-02-10T08:38:06.005970+0000","last_change":"2024-02-10T08:37:27.575809+0000","last_active":"2024-02-10T08:38:06.005970+0000","last_peered":"2024-02-10T08:38:06.005970+0000","last_clean":"2024-02-10T08:38:06.005970+0000","last_became_active":"2024-02-10T08:22:00.578118+0000","last_became_peered":"2024-02-10T08:22:00.578118+0000","last_unstale":"2024-02-10T08:38:06.005970+0000","last_undegraded":"2024-02-10T08:38:06.005970+0000","last_fullsized":"2024-02-10T08:38:06.005970+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:27.575701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:37:27.575701+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,6],"acting":[2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.29","version":"76'2","reported_seq":358,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.309709+0000","last_change":"2024-02-10T08:37:05.646814+0000","last_active":"2024-02-10T08:38:03.309709+0000","last_peered":"2024-02-10T08:38:03.309709+0000","last_clean":"2024-02-10T08:38:03.309709+0000","last_became_active":"2024-02-10T08:28:02.767822+0000","last_became_peered":"2024-02-10T08:28:02.767822+0000","last_unstale":"2024-02-10T08:38:03.309709+0000","last_undegraded":"2024-02-10T08:38:03.309709+0000","last_fullsized":"2024-02-10T08:38:03.309709+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":6,"last_scrub":"76'2","last_scrub_stamp":"2024-02-10T08:37:05.646710+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2024-02-10T08:18:08.680038+0000","last_clean_scrub_stamp":"2024-02-10T08:37:05.646710+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,0],"acting":[7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":132,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.306173+0000","last_change":"2024-02-10T08:37:23.909317+0000","last_active":"2024-02-10T08:38:03.306173+0000","last_peered":"2024-02-10T08:38:03.306173+0000","last_clean":"2024-02-10T08:38:03.306173+0000","last_became_active":"2024-02-10T08:32:36.975213+0000","last_became_peered":"2024-02-10T08:32:36.975213+0000","last_unstale":"2024-02-10T08:38:03.306173+0000","last_undegraded":"2024-02-10T08:38:03.306173+0000","last_fullsized":"2024-02-10T08:38:03.306173+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:23.909204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:20.392249+0000","last_clean_scrub_stamp":"2024-02-10T08:37:23.909204+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0],"acting":[4,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":149,"reported_epoch":419,"state":"active+clean","last_fresh":"2024-02-10T08:38:09.471472+0000","last_change":"2024-02-10T08:38:09.471472+0000","last_active":"2024-02-10T08:38:09.471472+0000","last_peered":"2024-02-10T08:38:09.471472+0000","last_clean":"2024-02-10T08:38:09.471472+0000","last_became_active":"2024-02-10T08:30:26.079913+0000","last_became_peered":"2024-02-10T08:30:26.079913+0000","last_unstale":"2024-02-10T08:38:09.471472+0000","last_undegraded":"2024-02-10T08:38:09.471472+0000","last_fullsized":"2024-02-10T08:38:09.471472+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:38:09.471401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:38:09.471401+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":262,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.306971+0000","last_change":"2024-02-10T08:37:57.085655+0000","last_active":"2024-02-10T08:38:03.306971+0000","last_peered":"2024-02-10T08:38:03.306971+0000","last_clean":"2024-02-10T08:38:03.306971+0000","last_became_active":"2024-02-10T08:33:56.117425+0000","last_became_peered":"2024-02-10T08:33:56.117425+0000","last_unstale":"2024-02-10T08:38:03.306971+0000","last_undegraded":"2024-02-10T08:38:03.306971+0000","last_fullsized":"2024-02-10T08:38:03.306971+0000","mapping_epoch":364,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":365,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:57.085555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:20:30.227375+0000","last_clean_scrub_stamp":"2024-02-10T08:37:57.085555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":422,"reported_epoch":419,"state":"active+clean","last_fresh":"2024-02-10T08:38:06.006146+0000","last_change":"2024-02-10T08:37:07.530227+0000","last_active":"2024-02-10T08:38:06.006146+0000","last_peered":"2024-02-10T08:38:06.006146+0000","last_clean":"2024-02-10T08:38:06.006146+0000","last_became_active":"2024-02-10T08:30:26.085360+0000","last_became_peered":"2024-02-10T08:30:26.085360+0000","last_unstale":"2024-02-10T08:38:06.006146+0000","last_undegraded":"2024-02-10T08:38:06.006146+0000","last_fullsized":"2024-02-10T08:38:06.006146+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:37:07.530127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:37:07.530127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,5],"acting":[2,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":154,"reported_epoch":419,"state":"active+clean","last_fresh":"2024-02-10T08:38:11.227564+0000","last_change":"2024-02-10T08:38:11.227564+0000","last_active":"2024-02-10T08:38:11.227564+0000","last_peered":"2024-02-10T08:38:11.227564+0000","last_clean":"2024-02-10T08:38:11.227564+0000","last_became_active":"2024-02-10T08:30:26.075472+0000","last_became_peered":"2024-02-10T08:30:26.075472+0000","last_unstale":"2024-02-10T08:38:11.227564+0000","last_undegraded":"2024-02-10T08:38:11.227564+0000","last_fullsized":"2024-02-10T08:38:11.227564+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:38:11.227477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:38:11.227477+0000","last_clean_scrub_stamp":"2024-02-10T08:38:11.227477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":153,"reported_epoch":419,"state":"active+clean","last_fresh":"2024-02-10T08:38:08.045638+0000","last_change":"2024-02-10T08:38:08.045638+0000","last_active":"2024-02-10T08:38:08.045638+0000","last_peered":"2024-02-10T08:38:08.045638+0000","last_clean":"2024-02-10T08:38:08.045638+0000","last_became_active":"2024-02-10T08:30:26.080539+0000","last_became_peered":"2024-02-10T08:30:26.080539+0000","last_unstale":"2024-02-10T08:38:08.045638+0000","last_undegraded":"2024-02-10T08:38:08.045638+0000","last_fullsized":"2024-02-10T08:38:08.045638+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:38:08.045526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:38:08.045526+0000","last_clean_scrub_stamp":"2024-02-10T08:38:08.045526+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":144,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-10T08:38:03.309159+0000","last_change":"2024-02-10T08:36:14.408397+0000","last_active":"2024-02-10T08:38:03.309159+0000","last_peered":"2024-02-10T08:38:03.309159+0000","last_clean":"2024-02-10T08:38:03.309159+0000","last_became_active":"2024-02-10T08:30:26.088228+0000","last_became_peered":"2024-02-10T08:30:26.088228+0000","last_unstale":"2024-02-10T08:38:03.309159+0000","last_undegraded":"2024-02-10T08:38:03.309159+0000","last_fullsized":"2024-02-10T08:38:03.309159+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:36:14.408305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:36:14.408305+0000","last_clean_scrub_stamp":"2024-02-10T08:36:14.408305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1],"acting":[7,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":331,"reported_epoch":419,"state":"active+clean","last_fresh":"2024-02-10T08:38:10.361299+0000","last_change":"2024-02-10T08:38:10.361299+0000","last_active":"2024-02-10T08:38:10.361299+0000","last_peered":"2024-02-10T08:38:10.361299+0000","last_clean":"2024-02-10T08:38:10.361299+0000","last_became_active":"2024-02-10T08:30:26.072022+0000","last_became_peered":"2024-02-10T08:30:26.072022+0000","last_unstale":"2024-02-10T08:38:10.361299+0000","last_undegraded":"2024-02-10T08:38:10.361299+0000","last_fullsized":"2024-02-10T08:38:10.361299+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:38:10.361213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:38:10.361213+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":16,"stat_sum":{"num_bytes":6852968448,"num_objects":104568,"num_object_clones":0,"num_object_copies":313704,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104568,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104568,"num_write_kb":6692352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20572536832,"data_stored":20572536832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72660,"ondisk_log_size":72660,"up":48,"acting":48,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2646,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":11,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":33,"acting":33,"num_store_stats":8},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1269,"num_read_kb":1264,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":9,"acting":9,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":1534,"num_read_kb":1291,"num_write":989,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":212,"num_bytes_recovered":5226,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1032,"ondisk_log_size":1032,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":96,"acting":96,"num_store_stats":8},{"poolid":6,"num_pg":52,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":156,"acting":156,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":50,"seq":214748365060,"num_pgs":75,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":3408188,"kb_used_data":2514420,"kb_used_omap":0,"kb_used_meta":893760,"kb_avail":90336964,"statfs":{"total":95995035648,"available":92505051136,"internally_reserved":0,"allocated":2574766080,"data_stored":2574274706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":915210240},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:37:21 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":2.2000000000000002,"15min":2.0630000000000002},"min":{"1min":0.248,"5min":0.20899999999999999,"15min":0.19600000000000001},"max":{"1min":1.512,"5min":107.95699999999999,"15min":107.95699999999999},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.84399999999999997,"5min":2.4569999999999999,"15min":2.3929999999999998},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.20999999999999999},"max":{"1min":2.98,"5min":108.33499999999999,"15min":108.33499999999999},"last":1.603}]},{"osd":1,"last update":"Sat Feb 10 08:37:21 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.98199999999999998,"15min":1.71},"min":{"1min":0.27300000000000002,"5min":0.23100000000000001,"15min":0.20000000000000001},"max":{"1min":2.3420000000000001,"5min":6.1790000000000003,"15min":41.539999999999999},"last":0.432},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.403,"15min":1.879},"min":{"1min":0.255,"5min":0.255,"15min":0.22700000000000001},"max":{"1min":5.6340000000000003,"5min":10.099,"15min":41.046999999999997},"last":1.974}]},{"osd":2,"last update":"Sat Feb 10 08:37:21 2024","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":1.99,"15min":1.885},"min":{"1min":0.28599999999999998,"5min":0.26500000000000001,"15min":0.251},"max":{"1min":5.0510000000000002,"5min":36.308999999999997,"15min":36.308999999999997},"last":2.7029999999999998},{"interface":"front","average":{"1min":0.98799999999999999,"5min":1.714,"15min":1.841},"min":{"1min":0.312,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":7.2779999999999996,"5min":36.268000000000001,"15min":36.268000000000001},"last":1.075}]},{"osd":3,"last update":"Sat Feb 10 08:37:21 2024","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":1.327,"15min":1.641},"min":{"1min":0.318,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":4.0149999999999997,"5min":8.6560000000000006,"15min":13.07},"last":0.311},{"interface":"front","average":{"1min":0.63300000000000001,"5min":1.343,"15min":1.766},"min":{"1min":0.379,"5min":0.29299999999999998,"15min":0.27700000000000002},"max":{"1min":1.6379999999999999,"5min":6.9139999999999997,"15min":10.960000000000001},"last":0.373}]},{"osd":4,"last update":"Sat Feb 10 08:37:21 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":1.4279999999999999,"15min":1.379},"min":{"1min":0.29299999999999998,"5min":0.215,"15min":0.215},"max":{"1min":1.887,"5min":23.797999999999998,"15min":23.797999999999998},"last":0.25800000000000001},{"interface":"front","average":{"1min":0.46700000000000003,"5min":1.448,"15min":1.381},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":1.6499999999999999,"5min":26.303000000000001,"15min":26.303000000000001},"last":0.316}]},{"osd":5,"last update":"Sat Feb 10 08:37:21 2024","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":1.1910000000000001,"15min":1.706},"min":{"1min":0.23699999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.66300000000000003,"5min":8.4580000000000002,"15min":15.304},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":1.111,"15min":1.4450000000000001},"min":{"1min":0.28100000000000003,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":1.3600000000000001,"5min":8.1069999999999993,"15min":13.129},"last":0.29399999999999998}]},{"osd":6,"last update":"Sat Feb 10 08:37:21 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":1.3220000000000001,"15min":1.363},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":2.7120000000000002,"5min":8.1470000000000002,"15min":10.101000000000001},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":1.3979999999999999,"15min":1.401},"min":{"1min":0.29499999999999998,"5min":0.246,"15min":0.246},"max":{"1min":1.9219999999999999,"5min":8.9160000000000004,"15min":12.654},"last":0.36399999999999999}]}]},{"osd":6,"up_from":43,"seq":184683593993,"num_pgs":65,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":3945884,"kb_used_data":3347988,"kb_used_omap":0,"kb_used_meta":597888,"kb_avail":89799268,"statfs":{"total":95995035648,"available":91954450432,"internally_reserved":0,"allocated":3428339712,"data_stored":3427880471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":612237312},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:37:57 2024","interfaces":[{"interface":"back","average":{"1min":1.581,"5min":1.4910000000000001,"15min":1.911},"min":{"1min":0.221,"5min":0.20300000000000001,"15min":0.19400000000000001},"max":{"1min":5.1870000000000003,"5min":6.452,"15min":30.509},"last":0.34499999999999997},{"interface":"front","average":{"1min":1.272,"5min":1.4419999999999999,"15min":1.7150000000000001},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":3.6760000000000002,"5min":8.1590000000000007,"15min":36.090000000000003},"last":0.66500000000000004}]},{"osd":1,"last update":"Sat Feb 10 08:37:57 2024","interfaces":[{"interface":"back","average":{"1min":1.986,"5min":1.329,"15min":1.611},"min":{"1min":0.26900000000000002,"5min":0.223,"15min":0.223},"max":{"1min":7.0339999999999998,"5min":7.0339999999999998,"15min":8.9369999999999994},"last":2.8900000000000001},{"interface":"front","average":{"1min":1.611,"5min":1.7989999999999999,"15min":1.821},"min":{"1min":0.28399999999999997,"5min":0.215,"15min":0.215},"max":{"1min":3.7890000000000001,"5min":11.976000000000001,"15min":11.976000000000001},"last":1.002}]},{"osd":2,"last update":"Sat Feb 10 08:37:57 2024","interfaces":[{"interface":"back","average":{"1min":1.79,"5min":1.716,"15min":2.105},"min":{"1min":0.36299999999999999,"5min":0.27700000000000002,"15min":0.25900000000000001},"max":{"1min":4.431,"5min":7.4989999999999997,"15min":35.072000000000003},"last":1.036},{"interface":"front","average":{"1min":1.512,"5min":1.5389999999999999,"15min":1.9059999999999999},"min":{"1min":0.36899999999999999,"5min":0.23799999999999999,"15min":0.23100000000000001},"max":{"1min":5.1349999999999998,"5min":14.867000000000001,"15min":35.103000000000002},"last":0.57099999999999995}]},{"osd":3,"last update":"Sat Feb 10 08:37:57 2024","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":2.5910000000000002,"15min":2.1600000000000001},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":5.29,"5min":103.94199999999999,"15min":103.94199999999999},"last":0.25900000000000001},{"interface":"front","average":{"1min":1.496,"5min":2.9740000000000002,"15min":2.234},"min":{"1min":0.29699999999999999,"5min":0.28000000000000003,"15min":0.253},"max":{"1min":6.3570000000000002,"5min":103.79600000000001,"15min":103.79600000000001},"last":1.0669999999999999}]},{"osd":4,"last update":"Sat Feb 10 08:37:19 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":1.2150000000000001,"15min":1.262},"min":{"1min":0.23799999999999999,"5min":0.22500000000000001,"15min":0.20200000000000001},"max":{"1min":1.9219999999999999,"5min":14.789,"15min":14.789},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.621,"5min":1.141,"15min":1.3180000000000001},"min":{"1min":0.251,"5min":0.251,"15min":0.22600000000000001},"max":{"1min":3.145,"5min":6.3499999999999996,"15min":10.348000000000001},"last":0.47799999999999998}]},{"osd":5,"last update":"Sat Feb 10 08:37:57 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":1.3089999999999999,"15min":1.6140000000000001},"min":{"1min":0.26100000000000001,"5min":0.25600000000000001,"15min":0.24099999999999999},"max":{"1min":2.0910000000000002,"5min":14.834,"15min":29.631},"last":0.39400000000000002},{"interface":"front","average":{"1min":1.224,"5min":1.1799999999999999,"15min":1.4930000000000001},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.23699999999999999},"max":{"1min":5.2199999999999998,"5min":5.2199999999999998,"15min":29.419},"last":1.0800000000000001}]},{"osd":7,"last update":"Sat Feb 10 08:37:19 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":1.1599999999999999,"15min":2.1190000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.26200000000000001},"max":{"1min":3.2029999999999998,"5min":6.4630000000000001,"15min":194.88900000000001},"last":1.673},{"interface":"front","average":{"1min":0.73299999999999998,"5min":1.173,"15min":2.2330000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":3.222,"5min":6.3949999999999996,"15min":194.74100000000001},"last":1.7929999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575136,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":4239220,"kb_used_data":3353260,"kb_used_omap":0,"kb_used_meta":885952,"kb_avail":89505932,"statfs":{"total":95995035648,"available":91654074368,"internally_reserved":0,"allocated":3433738240,"data_stored":3433254442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":907214848},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:37:56 2024","interfaces":[{"interface":"back","average":{"1min":3.7149999999999999,"5min":1.9830000000000001,"15min":1.8089999999999999},"min":{"1min":0.28799999999999998,"5min":0.187,"15min":0.17100000000000001},"max":{"1min":8.1739999999999995,"5min":8.5820000000000007,"15min":19.263000000000002},"last":4.5439999999999996},{"interface":"front","average":{"1min":3.4119999999999999,"5min":2.105,"15min":1.944},"min":{"1min":0.23200000000000001,"5min":0.183,"15min":0.17899999999999999},"max":{"1min":11.065,"5min":19.928999999999998,"15min":21.405000000000001},"last":6.6280000000000001}]},{"osd":2,"last update":"Sat Feb 10 08:37:25 2024","interfaces":[{"interface":"back","average":{"1min":1.637,"5min":1.6659999999999999,"15min":2.097},"min":{"1min":0.251,"5min":0.23400000000000001,"15min":0.21199999999999999},"max":{"1min":11.039,"5min":12.202,"15min":31.420999999999999},"last":6.6500000000000004},{"interface":"front","average":{"1min":2.7090000000000001,"5min":2.032,"15min":2.3580000000000001},"min":{"1min":0.25700000000000001,"5min":0.246,"15min":0.184},"max":{"1min":21.119,"5min":21.119,"15min":31.484999999999999},"last":6.508}]},{"osd":3,"last update":"Sat Feb 10 08:37:45 2024","interfaces":[{"interface":"back","average":{"1min":2.9750000000000001,"5min":2.0129999999999999,"15min":2.1339999999999999},"min":{"1min":0.39500000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":12.204000000000001,"5min":12.369999999999999,"15min":19.096},"last":0.439},{"interface":"front","average":{"1min":2.488,"5min":1.98,"15min":1.925},"min":{"1min":0.29499999999999998,"5min":0.25800000000000001,"15min":0.19600000000000001},"max":{"1min":7.3860000000000001,"5min":9.2699999999999996,"15min":21.103999999999999},"last":1.405}]},{"osd":4,"last update":"Sat Feb 10 08:37:15 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":1.4990000000000001,"15min":1.768},"min":{"1min":0.35199999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.488,"5min":23.218,"15min":23.218},"last":6.1210000000000004},{"interface":"front","average":{"1min":1.177,"5min":1.5589999999999999,"15min":2.0329999999999999},"min":{"1min":0.31900000000000001,"5min":0.27100000000000002,"15min":0.25900000000000001},"max":{"1min":5.5599999999999996,"5min":23.274000000000001,"15min":31.515000000000001},"last":0.46000000000000002}]},{"osd":5,"last update":"Sat Feb 10 08:37:25 2024","interfaces":[{"interface":"back","average":{"1min":1.728,"5min":1.5960000000000001,"15min":2.0009999999999999},"min":{"1min":0.39800000000000002,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":10.968999999999999,"5min":10.968999999999999,"15min":40.140999999999998},"last":6.0739999999999998},{"interface":"front","average":{"1min":2.2229999999999999,"5min":1.851,"15min":2.3929999999999998},"min":{"1min":0.47999999999999998,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":9.9649999999999999,"5min":9.9649999999999999,"15min":40.831000000000003},"last":0.41099999999999998}]},{"osd":6,"last update":"Sat Feb 10 08:37:56 2024","interfaces":[{"interface":"back","average":{"1min":6.1280000000000001,"5min":2.802,"15min":2.3410000000000002},"min":{"1min":0.375,"5min":0.34599999999999997,"15min":0.30199999999999999},"max":{"1min":60.279000000000003,"5min":60.279000000000003,"15min":60.279000000000003},"last":0.47999999999999998},{"interface":"front","average":{"1min":5.7750000000000004,"5min":2.524,"15min":1.944},"min":{"1min":0.33200000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":60.286000000000001,"5min":60.286000000000001,"15min":60.286000000000001},"last":1.4390000000000001}]},{"osd":7,"last update":"Sat Feb 10 08:37:25 2024","interfaces":[{"interface":"back","average":{"1min":2.0419999999999998,"5min":2.593,"15min":2.4430000000000001},"min":{"1min":0.44600000000000001,"5min":0.34200000000000003,"15min":0.29099999999999998},"max":{"1min":9.782,"5min":64.405000000000001,"15min":64.405000000000001},"last":0.502},{"interface":"front","average":{"1min":1.4650000000000001,"5min":2.2480000000000002,"15min":2.0310000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":5.2140000000000004,"5min":64.510999999999996,"15min":64.510999999999996},"last":1.466}]}]},{"osd":0,"up_from":8,"seq":34359738660,"num_pgs":65,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2612152,"kb_used_data":2014256,"kb_used_omap":0,"kb_used_meta":597888,"kb_avail":91133000,"statfs":{"total":95995035648,"available":93320192000,"internally_reserved":0,"allocated":2062598144,"data_stored":2062110701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":612237312},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 10 08:37:09 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":1.0840000000000001,"15min":2.3660000000000001},"min":{"1min":0.215,"5min":0.182,"15min":0.14399999999999999},"max":{"1min":2.7229999999999999,"5min":5.5270000000000001,"15min":102.48099999999999},"last":2.1779999999999999},{"interface":"front","average":{"1min":0.65000000000000002,"5min":1.4490000000000001,"15min":2.3900000000000001},"min":{"1min":0.28299999999999997,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":3.9649999999999999,"5min":15.550000000000001,"15min":103.38800000000001},"last":2.2599999999999998}]},{"osd":2,"last update":"Sat Feb 10 08:37:23 2024","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.754,"15min":2.7490000000000001},"min":{"1min":0.25600000000000001,"5min":0.19700000000000001,"15min":0.192},"max":{"1min":5.056,"5min":19.411999999999999,"15min":102.462},"last":0.36699999999999999},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.46,"15min":2.3420000000000001},"min":{"1min":0.252,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":7.8789999999999996,"5min":10.369,"15min":102.66500000000001},"last":0.19800000000000001}]},{"osd":3,"last update":"Sat Feb 10 08:37:45 2024","interfaces":[{"interface":"back","average":{"1min":1.536,"5min":1.786,"15min":1.9419999999999999},"min":{"1min":0.25700000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":8.923,"5min":15.585000000000001,"15min":16.495000000000001},"last":0.33400000000000002},{"interface":"front","average":{"1min":2.3839999999999999,"5min":2.214,"15min":2.5169999999999999},"min":{"1min":0.38400000000000001,"5min":0.216,"15min":0.216},"max":{"1min":8.7579999999999991,"5min":19.504000000000001,"15min":102.64400000000001},"last":0.39400000000000002}]},{"osd":4,"last update":"Sat Feb 10 08:37:14 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":1.6739999999999999,"15min":2.258},"min":{"1min":0.29499999999999998,"5min":0.28199999999999997,"15min":0.253},"max":{"1min":1.6679999999999999,"5min":19.359999999999999,"15min":102.742},"last":1.486},{"interface":"front","average":{"1min":0.63600000000000001,"5min":1.429,"15min":1.587},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26200000000000001},"max":{"1min":1.4259999999999999,"5min":15.343,"15min":16.352},"last":0.42299999999999999}]},{"osd":5,"last update":"Sat Feb 10 08:37:37 2024","interfaces":[{"interface":"back","average":{"1min":1.6619999999999999,"5min":1.8100000000000001,"15min":2.2490000000000001},"min":{"1min":0.38900000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":8.1959999999999997,"5min":28.123999999999999,"15min":102.53100000000001},"last":0.41199999999999998},{"interface":"front","average":{"1min":1.516,"5min":1.8799999999999999,"15min":1.9390000000000001},"min":{"1min":0.312,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":7.8959999999999999,"5min":28.350000000000001,"15min":28.350000000000001},"last":1.5349999999999999}]},{"osd":6,"last update":"Sat Feb 10 08:37:09 2024","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":1.52,"15min":2.1549999999999998},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":1.117,"5min":7.0149999999999997,"15min":102.583},"last":2.6840000000000002},{"interface":"front","average":{"1min":0.73099999999999998,"5min":1.673,"15min":1.7909999999999999},"min":{"1min":0.35899999999999999,"5min":0.35699999999999998,"15min":0.308},"max":{"1min":2.4159999999999999,"5min":15.359,"15min":16.391999999999999},"last":2.6720000000000002}]},{"osd":7,"last update":"Sat Feb 10 08:37:23 2024","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.411,"15min":2.9300000000000002},"min":{"1min":0.35299999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":5.3680000000000003,"5min":5.6849999999999996,"15min":255.53200000000001},"last":1.97},{"interface":"front","average":{"1min":0.78200000000000003,"5min":1.677,"15min":2.6230000000000002},"min":{"1min":0.39500000000000002,"5min":0.34899999999999998,"15min":0.33100000000000002},"max":{"1min":1.8069999999999999,"5min":15.375999999999999,"15min":254.88800000000001},"last":2.7989999999999999}]}]},{"osd":2,"up_from":18,"seq":77309411612,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":3419176,"kb_used_data":2524768,"kb_used_omap":0,"kb_used_meta":894400,"kb_avail":90325976,"statfs":{"total":95995035648,"available":92493799424,"internally_reserved":0,"allocated":2585362432,"data_stored":2584890754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":915865600},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:37:27 2024","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.708,"15min":1.7350000000000001},"min":{"1min":0.22900000000000001,"5min":0.19700000000000001,"15min":0.184},"max":{"1min":8.6799999999999997,"5min":27.934999999999999,"15min":27.934999999999999},"last":2.198},{"interface":"front","average":{"1min":1.3560000000000001,"5min":2.077,"15min":2.3500000000000001},"min":{"1min":0.26200000000000001,"5min":0.191,"15min":0.191},"max":{"1min":3.29,"5min":11.815,"15min":28.295999999999999},"last":3.3530000000000002}]},{"osd":1,"last update":"Sat Feb 10 08:37:27 2024","interfaces":[{"interface":"back","average":{"1min":1.488,"5min":1.8580000000000001,"15min":2.0600000000000001},"min":{"1min":0.246,"5min":0.20999999999999999,"15min":0.20599999999999999},"max":{"1min":5.4589999999999996,"5min":10.385,"15min":15.644},"last":1.7949999999999999},{"interface":"front","average":{"1min":1.605,"5min":1.6699999999999999,"15min":1.5409999999999999},"min":{"1min":0.317,"5min":0.22,"15min":0.20100000000000001},"max":{"1min":8.7270000000000003,"5min":12.132999999999999,"15min":16.968},"last":2.1509999999999998}]},{"osd":3,"last update":"Sat Feb 10 08:37:53 2024","interfaces":[{"interface":"back","average":{"1min":2.1200000000000001,"5min":1.8120000000000001,"15min":1.9359999999999999},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":7.569,"5min":9.7870000000000008,"15min":24.946000000000002},"last":1.772},{"interface":"front","average":{"1min":1.8149999999999999,"5min":1.3360000000000001,"15min":1.863},"min":{"1min":0.22700000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":8.8300000000000001,"5min":9.1150000000000002,"15min":24.905000000000001},"last":4.1429999999999998}]},{"osd":4,"last update":"Sat Feb 10 08:38:10 2024","interfaces":[{"interface":"back","average":{"1min":1.577,"5min":2.0950000000000002,"15min":1.8},"min":{"1min":0.30399999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":5.0430000000000001,"5min":19.231000000000002,"15min":19.231000000000002},"last":1.708},{"interface":"front","average":{"1min":1.714,"5min":1.4179999999999999,"15min":1.2470000000000001},"min":{"1min":0.34100000000000003,"5min":0.26000000000000001,"15min":0.25700000000000001},"max":{"1min":8.7569999999999997,"5min":19.256,"15min":19.256},"last":2.2509999999999999}]},{"osd":5,"last update":"Sat Feb 10 08:37:37 2024","interfaces":[{"interface":"back","average":{"1min":1.99,"5min":1.895,"15min":2.081},"min":{"1min":0.34999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":5.2240000000000002,"5min":7.5700000000000003,"15min":13.939},"last":1.6559999999999999},{"interface":"front","average":{"1min":1.177,"5min":1.6990000000000001,"15min":1.8839999999999999},"min":{"1min":0.36599999999999999,"5min":0.29999999999999999,"15min":0.29199999999999998},"max":{"1min":2.931,"5min":8.2799999999999994,"15min":9.5709999999999997},"last":1.742}]},{"osd":6,"last update":"Sat Feb 10 08:38:10 2024","interfaces":[{"interface":"back","average":{"1min":3.5299999999999998,"5min":2.4260000000000002,"15min":2.1899999999999999},"min":{"1min":0.378,"5min":0.31900000000000001,"15min":0.27300000000000002},"max":{"1min":19.815000000000001,"5min":20.815999999999999,"15min":38.177999999999997},"last":1.7010000000000001},{"interface":"front","average":{"1min":2.2559999999999998,"5min":2.379,"15min":2.1640000000000001},"min":{"1min":0.33300000000000002,"5min":0.32500000000000001,"15min":0.32200000000000001},"max":{"1min":8.1069999999999993,"5min":20.268999999999998,"15min":37.682000000000002},"last":1.8160000000000001}]},{"osd":7,"last update":"Sat Feb 10 08:37:27 2024","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.9410000000000001,"15min":1.9910000000000001},"min":{"1min":0.44900000000000001,"5min":0.377,"15min":0.33400000000000002},"max":{"1min":3.077,"5min":8.5440000000000005,"15min":13.231999999999999},"last":1.8400000000000001},{"interface":"front","average":{"1min":1.53,"5min":1.4199999999999999,"15min":1.4610000000000001},"min":{"1min":0.375,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":8.7850000000000001,"5min":8.7850000000000001,"15min":9.4900000000000002},"last":2.226}]}]},{"osd":3,"up_from":25,"seq":107374182679,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":3832376,"kb_used_data":2942320,"kb_used_omap":0,"kb_used_meta":890048,"kb_avail":89912776,"statfs":{"total":95995035648,"available":92070682624,"internally_reserved":0,"allocated":3012935680,"data_stored":3012447369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":911409152},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:37:46 2024","interfaces":[{"interface":"back","average":{"1min":2.387,"5min":2.4649999999999999,"15min":2.0419999999999998},"min":{"1min":0.21199999999999999,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":6.1619999999999999,"5min":66.605000000000004,"15min":66.605000000000004},"last":3.1779999999999999},{"interface":"front","average":{"1min":1.655,"5min":2.3519999999999999,"15min":2.0129999999999999},"min":{"1min":0.34300000000000003,"5min":0.192,"15min":0.184},"max":{"1min":4.1310000000000002,"5min":66.828000000000003,"15min":66.828000000000003},"last":3.2149999999999999}]},{"osd":1,"last update":"Sat Feb 10 08:37:46 2024","interfaces":[{"interface":"back","average":{"1min":2.1219999999999999,"5min":1.573,"15min":1.9179999999999999},"min":{"1min":0.215,"5min":0.187,"15min":0.187},"max":{"1min":7.1050000000000004,"5min":7.8440000000000003,"15min":13.371},"last":4.1269999999999998},{"interface":"front","average":{"1min":2.9449999999999998,"5min":1.833,"15min":2.2240000000000002},"min":{"1min":0.25600000000000001,"5min":0.22900000000000001,"15min":0.20599999999999999},"max":{"1min":9.6159999999999997,"5min":9.6159999999999997,"15min":21.373999999999999},"last":3.1669999999999998}]},{"osd":2,"last update":"Sat Feb 10 08:37:46 2024","interfaces":[{"interface":"back","average":{"1min":2.294,"5min":2.8599999999999999,"15min":2.4409999999999998},"min":{"1min":0.28799999999999998,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":5.649,"5min":65.998999999999995,"15min":65.998999999999995},"last":3.202},{"interface":"front","average":{"1min":2.266,"5min":2.6659999999999999,"15min":2.0510000000000002},"min":{"1min":0.30199999999999999,"5min":0.255,"15min":0.215},"max":{"1min":6.3630000000000004,"5min":68.721000000000004,"15min":68.721000000000004},"last":3.3799999999999999}]},{"osd":4,"last update":"Sat Feb 10 08:37:23 2024","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":1.5109999999999999,"15min":1.619},"min":{"1min":0.35399999999999998,"5min":0.29199999999999998,"15min":0.25900000000000001},"max":{"1min":2.9020000000000001,"5min":11.061999999999999,"15min":11.061999999999999},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.94699999999999995,"5min":1.615,"15min":1.8620000000000001},"min":{"1min":0.36799999999999999,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":4.0640000000000001,"5min":8.9109999999999996,"15min":12.391999999999999},"last":2.9510000000000001}]},{"osd":5,"last update":"Sat Feb 10 08:37:46 2024","interfaces":[{"interface":"back","average":{"1min":1.427,"5min":1.5860000000000001,"15min":1.8400000000000001},"min":{"1min":0.40300000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":4.0999999999999996,"5min":11.159000000000001,"15min":19.832000000000001},"last":0.34799999999999998},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.6200000000000001,"15min":1.97},"min":{"1min":0.35699999999999998,"5min":0.29399999999999998,"15min":0.27800000000000002},"max":{"1min":4.1050000000000004,"5min":8.8200000000000003,"15min":19.712},"last":2.871}]},{"osd":6,"last update":"Sat Feb 10 08:38:01 2024","interfaces":[{"interface":"back","average":{"1min":2.194,"5min":1.8420000000000001,"15min":1.9550000000000001},"min":{"1min":0.40999999999999998,"5min":0.31,"15min":0.31},"max":{"1min":6.1950000000000003,"5min":8.8610000000000007,"15min":16.423999999999999},"last":2.9129999999999998},{"interface":"front","average":{"1min":1.359,"5min":1.5920000000000001,"15min":1.7589999999999999},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.31},"max":{"1min":4.0289999999999999,"5min":11.127000000000001,"15min":11.127000000000001},"last":0.39100000000000001}]},{"osd":7,"last update":"Sat Feb 10 08:37:23 2024","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":1.5529999999999999,"15min":1.772},"min":{"1min":0.45800000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.899,"5min":11.904,"15min":11.904},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.99299999999999999,"5min":1.7989999999999999,"15min":2.0590000000000002},"min":{"1min":0.47199999999999998,"5min":0.313,"15min":0.313},"max":{"1min":2.0880000000000001,"5min":11.986000000000001,"15min":15.702},"last":5.5970000000000004}]}]},{"osd":4,"up_from":110,"seq":472446402770,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2518572,"kb_used_data":1619044,"kb_used_omap":0,"kb_used_meta":899519,"kb_avail":91226580,"statfs":{"total":95995035648,"available":93416017920,"internally_reserved":0,"allocated":1657901056,"data_stored":1657424701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":972,"internal_metadata":921107508},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:37:33 2024","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.5609999999999999,"15min":1.5},"min":{"1min":0.23599999999999999,"5min":0.20499999999999999,"15min":0.19800000000000001},"max":{"1min":5.9390000000000001,"5min":10.932,"15min":14.595000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":1.2470000000000001,"5min":2.0419999999999998,"15min":2.0270000000000001},"min":{"1min":0.318,"5min":0.23799999999999999,"15min":0.222},"max":{"1min":3.9079999999999999,"5min":11.109,"15min":16.524000000000001},"last":3.1800000000000002}]},{"osd":1,"last update":"Sat Feb 10 08:37:33 2024","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.4039999999999999,"15min":1.7529999999999999},"min":{"1min":0.27400000000000002,"5min":0.24099999999999999,"15min":0.218},"max":{"1min":4.4109999999999996,"5min":6.3849999999999998,"15min":38.621000000000002},"last":0.47799999999999998},{"interface":"front","average":{"1min":1.228,"5min":1.524,"15min":1.7150000000000001},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.217},"max":{"1min":4.3979999999999997,"5min":11.964,"15min":38.430999999999997},"last":0.503}]},{"osd":2,"last update":"Sat Feb 10 08:37:33 2024","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.724,"15min":1.869},"min":{"1min":0.252,"5min":0.217,"15min":0.217},"max":{"1min":5.7409999999999997,"5min":8.6219999999999999,"15min":14.414},"last":1.7709999999999999},{"interface":"front","average":{"1min":1.129,"5min":1.3560000000000001,"15min":1.6040000000000001},"min":{"1min":0.307,"5min":0.26100000000000001,"15min":0.247},"max":{"1min":6.4530000000000003,"5min":6.8710000000000004,"15min":11.958},"last":2.5640000000000001}]},{"osd":3,"last update":"Sat Feb 10 08:37:33 2024","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.734,"15min":1.839},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.23200000000000001},"max":{"1min":4.4749999999999996,"5min":7.0380000000000003,"15min":14.358000000000001},"last":9.7680000000000007},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.4730000000000001,"15min":1.6719999999999999},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.249},"max":{"1min":7.9649999999999999,"5min":7.9649999999999999,"15min":11.648},"last":7.0990000000000002}]},{"osd":5,"last update":"Sat Feb 10 08:37:33 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":1.294,"15min":1.3440000000000001},"min":{"1min":0.27400000000000002,"5min":0.247,"15min":0.21299999999999999},"max":{"1min":1.9870000000000001,"5min":7.9560000000000004,"15min":41.488},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.81399999999999995,"5min":1.4299999999999999,"15min":1.5669999999999999},"min":{"1min":0.28000000000000003,"5min":0.245,"15min":0.23699999999999999},"max":{"1min":3.7109999999999999,"5min":9.4700000000000006,"15min":42.527999999999999},"last":0.32700000000000001}]},{"osd":6,"last update":"Sat Feb 10 08:37:33 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":1.6599999999999999,"15min":1.5529999999999999},"min":{"1min":0.29099999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":4.0830000000000002,"5min":44.816000000000003,"15min":44.816000000000003},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.71699999999999997,"5min":1.726,"15min":1.5780000000000001},"min":{"1min":0.30199999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":2.5659999999999998,"5min":43.816000000000003,"15min":43.816000000000003},"last":1.2}]},{"osd":7,"last update":"Sat Feb 10 08:37:33 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":1.204,"15min":1.351},"min":{"1min":0.33900000000000002,"5min":0.30099999999999999,"15min":0.28899999999999998},"max":{"1min":1.585,"5min":7.2229999999999999,"15min":11.047000000000001},"last":1.6479999999999999},{"interface":"front","average":{"1min":0.97299999999999998,"5min":1.339,"15min":1.3440000000000001},"min":{"1min":0.33300000000000002,"5min":0.312,"15min":0.26300000000000001},"max":{"1min":2.7250000000000001,"5min":10.971,"15min":16.245999999999999},"last":0.39800000000000002}]}]},{"osd":5,"up_from":37,"seq":158913790222,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2564124,"kb_used_data":1677204,"kb_used_omap":0,"kb_used_meta":886912,"kb_avail":91181028,"statfs":{"total":95995035648,"available":93369372672,"internally_reserved":0,"allocated":1717456896,"data_stored":1716996828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":908197888},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:37:35 2024","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":1.4159999999999999,"15min":1.548},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.20499999999999999},"max":{"1min":2.3530000000000002,"5min":7.7110000000000003,"15min":15.846},"last":0.40699999999999997},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.6839999999999999,"15min":1.6519999999999999},"min":{"1min":0.34100000000000003,"5min":0.23000000000000001,"15min":0.21299999999999999},"max":{"1min":2.9660000000000002,"5min":8.048,"15min":13.738},"last":0.46600000000000003}]},{"osd":1,"last update":"Sat Feb 10 08:37:35 2024","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":1.4299999999999999,"15min":1.613},"min":{"1min":0.255,"5min":0.24099999999999999,"15min":0.20699999999999999},"max":{"1min":4.3730000000000002,"5min":8.5210000000000008,"15min":8.5210000000000008},"last":0.32100000000000001},{"interface":"front","average":{"1min":1.319,"5min":1.6950000000000001,"15min":1.528},"min":{"1min":0.32500000000000001,"5min":0.25,"15min":0.25},"max":{"1min":2.9870000000000001,"5min":7.085,"15min":9.0579999999999998},"last":0.39400000000000002}]},{"osd":2,"last update":"Sat Feb 10 08:37:35 2024","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":1.575,"15min":1.6319999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.24099999999999999},"max":{"1min":3.5089999999999999,"5min":6.1609999999999996,"15min":20.254999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":1.028,"5min":1.4059999999999999,"15min":1.5129999999999999},"min":{"1min":0.377,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":5.8810000000000002,"5min":6.3449999999999998,"15min":7.585},"last":0.34599999999999997}]},{"osd":3,"last update":"Sat Feb 10 08:37:35 2024","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.3600000000000001,"15min":1.3660000000000001},"min":{"1min":0.29599999999999999,"5min":0.28499999999999998,"15min":0.26100000000000001},"max":{"1min":3.4769999999999999,"5min":7.234,"15min":8.2539999999999996},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.77300000000000002,"5min":1.383,"15min":1.5640000000000001},"min":{"1min":0.314,"5min":0.309,"15min":0.27300000000000002},"max":{"1min":2.04,"5min":8.7940000000000005,"15min":12.387},"last":0.44700000000000001}]},{"osd":4,"last update":"Sat Feb 10 08:37:16 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":1.329,"15min":1.254},"min":{"1min":0.245,"5min":0.223,"15min":0.223},"max":{"1min":3.9910000000000001,"5min":9.7080000000000002,"15min":9.7080000000000002},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":1.0429999999999999,"15min":1.2749999999999999},"min":{"1min":0.29599999999999999,"5min":0.254,"15min":0.22500000000000001},"max":{"1min":2.911,"5min":7.5220000000000002,"15min":12.948},"last":0.371}]},{"osd":6,"last update":"Sat Feb 10 08:38:07 2024","interfaces":[{"interface":"back","average":{"1min":1.659,"5min":1.6160000000000001,"15min":1.327},"min":{"1min":0.26000000000000001,"5min":0.245,"15min":0.23100000000000001},"max":{"1min":8.0920000000000005,"5min":8.0920000000000005,"15min":8.3559999999999999},"last":0.433},{"interface":"front","average":{"1min":0.84099999999999997,"5min":1.1990000000000001,"15min":1.2050000000000001},"min":{"1min":0.308,"5min":0.27800000000000002,"15min":0.26300000000000001},"max":{"1min":3.4409999999999998,"5min":6.8499999999999996,"15min":7.875},"last":0.38300000000000001}]},{"osd":7,"last update":"Sat Feb 10 08:37:31 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":1.298,"15min":2.431},"min":{"1min":0.308,"5min":0.30499999999999999,"15min":0.23499999999999999},"max":{"1min":2.3599999999999999,"5min":7.2599999999999998,"15min":371.87400000000002},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.628,"5min":1.173,"15min":2.5859999999999999},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.23499999999999999},"max":{"1min":2.5880000000000001,"5min":5.5190000000000001,"15min":372.63099999999997},"last":0.54500000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2064646144,"data_stored":2064646144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3457875968,"data_stored":3457875968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2593521664,"data_stored":2593521664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3035758592,"data_stored":3035758592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1666711552,"data_stored":1666711552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1724252160,"data_stored":1724252160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3451977728,"data_stored":3451977728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":2577793024,"data_stored":2577793024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-10T08:38:14.755 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd pool set iscsi pgp_num 3 2024-02-10T08:38:14.776 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:38:14.783 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:14.783 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:38:14.789 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:38:14.884 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:38:14.949 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:15.194 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-02-10T08:38:15.194 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:38:15.434 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:38:15.440 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:15.440 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:38:15.536 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 78 16 107702 107686 86.2505 63 0.00491504 0.0115889 2024-02-10T08:38:15.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:14.422198+0000 osd.2 (osd.2) 260 : cluster [DBG] 11.d scrub ok 2024-02-10T08:38:15.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:38:15.339879+0000 mon.a (mon.0) 1725 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:38:15.541 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:38:15.543 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:14.422198+0000 osd.2 (osd.2) 260 : cluster [DBG] 11.d scrub ok 2024-02-10T08:38:15.543 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:38:15.339879+0000 mon.a (mon.0) 1725 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:38:15.543 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:14.422198+0000 osd.2 (osd.2) 260 : cluster [DBG] 11.d scrub ok 2024-02-10T08:38:15.543 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:38:15.339879+0000 mon.a (mon.0) 1725 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:38:15.611 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:16.269 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:38:16.275 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:16.276 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:38:16.338 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:38:16.375 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:38:16.377 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:38:16.416 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:38:16.425 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:16.460 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:38:16.502 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:38:16.536 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 79 16 108632 108616 85.8945 58.125 0.00535204 0.011637 2024-02-10T08:38:16.539 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:38:16.574 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:38:16.616 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:38:16.625 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-10T08:38:16.626 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-10T08:38:16.626 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-10T08:38:16.626 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-10T08:38:16.626 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-10T08:38:16.626 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-10T08:38:16.626 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-10T08:38:16.626 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-10T08:38:16.647 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:38:16.656 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:16.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:15.117460+0000 mgr.y (mgr.14505) 807 : cluster [DBG] pgmap v988: 178 pgs: 1 active+clean+scrubbing, 177 active+clean; 6.4 GiB data, 26 GiB used, 689 GiB / 715 GiB avail; 1.1 KiB/s rd, 73 MiB/s wr, 1.17k op/s 2024-02-10T08:38:16.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:15.263746+0000 osd.1 (osd.1) 300 : cluster [DBG] 5.19 scrub starts 2024-02-10T08:38:16.657 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:15.273213+0000 osd.1 (osd.1) 301 : cluster [DBG] 5.19 scrub ok 2024-02-10T08:38:16.657 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:15.445956+0000 osd.0 (osd.0) 272 : cluster [DBG] 4.12 scrub starts 2024-02-10T08:38:16.657 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:15.451160+0000 osd.0 (osd.0) 273 : cluster [DBG] 4.12 scrub ok 2024-02-10T08:38:16.657 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:15.995775+0000 mon.a (mon.0) 1726 : cluster [DBG] osdmap e421: 8 total, 8 up, 8 in 2024-02-10T08:38:16.657 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:38:16.293289+0000 mon.c (mon.2) 96 : audit [DBG] from='client.? 172.21.15.18:0/1481984365' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:38:16.657 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:15.117460+0000 mgr.y (mgr.14505) 807 : cluster [DBG] pgmap v988: 178 pgs: 1 active+clean+scrubbing, 177 active+clean; 6.4 GiB data, 26 GiB used, 689 GiB / 715 GiB avail; 1.1 KiB/s rd, 73 MiB/s wr, 1.17k op/s 2024-02-10T08:38:16.657 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:15.263746+0000 osd.1 (osd.1) 300 : cluster [DBG] 5.19 scrub starts 2024-02-10T08:38:16.657 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:15.273213+0000 osd.1 (osd.1) 301 : cluster [DBG] 5.19 scrub ok 2024-02-10T08:38:16.657 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:15.445956+0000 osd.0 (osd.0) 272 : cluster [DBG] 4.12 scrub starts 2024-02-10T08:38:16.657 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:15.451160+0000 osd.0 (osd.0) 273 : cluster [DBG] 4.12 scrub ok 2024-02-10T08:38:16.658 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:15.995775+0000 mon.a (mon.0) 1726 : cluster [DBG] osdmap e421: 8 total, 8 up, 8 in 2024-02-10T08:38:16.658 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:38:16.293289+0000 mon.c (mon.2) 96 : audit [DBG] from='client.? 172.21.15.18:0/1481984365' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:38:16.658 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:38:16.759 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:38:16.789 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:38:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:38:16] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:38:16.791 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:15.117460+0000 mgr.y (mgr.14505) 807 : cluster [DBG] pgmap v988: 178 pgs: 1 active+clean+scrubbing, 177 active+clean; 6.4 GiB data, 26 GiB used, 689 GiB / 715 GiB avail; 1.1 KiB/s rd, 73 MiB/s wr, 1.17k op/s 2024-02-10T08:38:16.791 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:15.263746+0000 osd.1 (osd.1) 300 : cluster [DBG] 5.19 scrub starts 2024-02-10T08:38:16.791 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:15.273213+0000 osd.1 (osd.1) 301 : cluster [DBG] 5.19 scrub ok 2024-02-10T08:38:16.791 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:15.445956+0000 osd.0 (osd.0) 272 : cluster [DBG] 4.12 scrub starts 2024-02-10T08:38:16.791 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:15.451160+0000 osd.0 (osd.0) 273 : cluster [DBG] 4.12 scrub ok 2024-02-10T08:38:16.792 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:15.995775+0000 mon.a (mon.0) 1726 : cluster [DBG] osdmap e421: 8 total, 8 up, 8 in 2024-02-10T08:38:16.792 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:38:16.293289+0000 mon.c (mon.2) 96 : audit [DBG] from='client.? 172.21.15.18:0/1481984365' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:38:16.804 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:16.889 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.7 dump_blocked_ops 2024-02-10T08:38:17.072 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:38:17.078 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:17.078 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:38:17.179 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:38:17.238 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:17.270 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:38:17.281 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:17.282 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:38:17.327 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:38:17.383 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:38:17.405 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:38:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:38:17] "GET /metrics HTTP/1.1" 200 176703 "" "Prometheus/2.33.4" 2024-02-10T08:38:17.449 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:17.537 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:2024-02-10T08:38:17.537306+0000 min lat: 0.00122517 max lat: 0.268929 avg lat: 0.0116733 2024-02-10T08:38:17.537 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-02-10T08:38:17.537 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 80 16 109673 109657 85.634 65.0625 0.00983307 0.0116733 2024-02-10T08:38:17.575 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:38:17.582 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:17.583 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:38:17.683 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:38:17.727 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:16.177404+0000 osd.6 (osd.6) 271 : cluster [DBG] 4.a scrub starts 2024-02-10T08:38:17.728 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:16.181941+0000 osd.6 (osd.6) 272 : cluster [DBG] 4.a scrub ok 2024-02-10T08:38:17.728 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:38:16.475808+0000 mon.a (mon.0) 1727 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:38:17.728 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:38:16.478760+0000 mon.a (mon.0) 1728 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:38:17.728 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:38:16.502986+0000 mon.a (mon.0) 1729 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:38:17.728 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:38:16.702983+0000 mon.a (mon.0) 1730 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:38:17.728 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:16.177404+0000 osd.6 (osd.6) 271 : cluster [DBG] 4.a scrub starts 2024-02-10T08:38:17.728 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:16.181941+0000 osd.6 (osd.6) 272 : cluster [DBG] 4.a scrub ok 2024-02-10T08:38:17.728 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:38:16.475808+0000 mon.a (mon.0) 1727 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:38:17.728 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:38:16.478760+0000 mon.a (mon.0) 1728 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:38:17.729 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:38:16.502986+0000 mon.a (mon.0) 1729 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:38:17.729 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:38:16.702983+0000 mon.a (mon.0) 1730 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:38:17.734 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:17.778 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:38:17.781 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:17.781 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:38:17.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:16.177404+0000 osd.6 (osd.6) 271 : cluster [DBG] 4.a scrub starts 2024-02-10T08:38:17.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:16.181941+0000 osd.6 (osd.6) 272 : cluster [DBG] 4.a scrub ok 2024-02-10T08:38:17.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:38:16.475808+0000 mon.a (mon.0) 1727 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:38:17.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:38:16.478760+0000 mon.a (mon.0) 1728 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:38:17.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:38:16.502986+0000 mon.a (mon.0) 1729 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:38:17.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:38:16.702983+0000 mon.a (mon.0) 1730 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:38:17.882 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:38:17.949 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:18.541 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 81 16 110751 110735 85.4036 67.375 0.00923296 0.0117047 2024-02-10T08:38:18.682 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:17.117866+0000 mgr.y (mgr.14505) 808 : cluster [DBG] pgmap v990: 178 pgs: 1 active+clean+scrubbing, 177 active+clean; 6.4 GiB data, 26 GiB used, 689 GiB / 715 GiB avail; 639 B/s rd, 43 MiB/s wr, 694 op/s 2024-02-10T08:38:18.682 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:17.196725+0000 osd.6 (osd.6) 273 : cluster [DBG] 2.19 deep-scrub starts 2024-02-10T08:38:18.682 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:17.208881+0000 osd.6 (osd.6) 274 : cluster [DBG] 2.19 deep-scrub ok 2024-02-10T08:38:18.906 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:17.117866+0000 mgr.y (mgr.14505) 808 : cluster [DBG] pgmap v990: 178 pgs: 1 active+clean+scrubbing, 177 active+clean; 6.4 GiB data, 26 GiB used, 689 GiB / 715 GiB avail; 639 B/s rd, 43 MiB/s wr, 694 op/s 2024-02-10T08:38:18.906 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:17.196725+0000 osd.6 (osd.6) 273 : cluster [DBG] 2.19 deep-scrub starts 2024-02-10T08:38:18.906 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:17.208881+0000 osd.6 (osd.6) 274 : cluster [DBG] 2.19 deep-scrub ok 2024-02-10T08:38:18.907 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:17.117866+0000 mgr.y (mgr.14505) 808 : cluster [DBG] pgmap v990: 178 pgs: 1 active+clean+scrubbing, 177 active+clean; 6.4 GiB data, 26 GiB used, 689 GiB / 715 GiB avail; 639 B/s rd, 43 MiB/s wr, 694 op/s 2024-02-10T08:38:18.907 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:17.196725+0000 osd.6 (osd.6) 273 : cluster [DBG] 2.19 deep-scrub starts 2024-02-10T08:38:18.907 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:17.208881+0000 osd.6 (osd.6) 274 : cluster [DBG] 2.19 deep-scrub ok 2024-02-10T08:38:19.015 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:38:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:38:19.370 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-02-10T08:38:19.370 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-02-10T08:38:19.370 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-02-10T08:38:19.370 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-02-10T08:38:19.370 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-02-10T08:38:19.543 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 82 15 111878 111863 85.2219 70.5 0.0169411 0.0117298 2024-02-10T08:38:19.791 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:17.767728+0000 osd.2 (osd.2) 261 : cluster [DBG] 5.d scrub starts 2024-02-10T08:38:19.791 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:17.772089+0000 osd.2 (osd.2) 262 : cluster [DBG] 5.d scrub ok 2024-02-10T08:38:19.791 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:18.184489+0000 osd.5 (osd.5) 279 : cluster [DBG] 5.1b deep-scrub starts 2024-02-10T08:38:19.791 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:18.192544+0000 osd.5 (osd.5) 280 : cluster [DBG] 5.1b deep-scrub ok 2024-02-10T08:38:19.791 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:18.288656+0000 osd.1 (osd.1) 302 : cluster [DBG] 4.1d deep-scrub starts 2024-02-10T08:38:19.791 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:18.298253+0000 osd.1 (osd.1) 303 : cluster [DBG] 4.1d deep-scrub ok 2024-02-10T08:38:19.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:17.767728+0000 osd.2 (osd.2) 261 : cluster [DBG] 5.d scrub starts 2024-02-10T08:38:19.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:17.772089+0000 osd.2 (osd.2) 262 : cluster [DBG] 5.d scrub ok 2024-02-10T08:38:19.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:18.184489+0000 osd.5 (osd.5) 279 : cluster [DBG] 5.1b deep-scrub starts 2024-02-10T08:38:19.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:18.192544+0000 osd.5 (osd.5) 280 : cluster [DBG] 5.1b deep-scrub ok 2024-02-10T08:38:19.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:18.288656+0000 osd.1 (osd.1) 302 : cluster [DBG] 4.1d deep-scrub starts 2024-02-10T08:38:19.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:18.298253+0000 osd.1 (osd.1) 303 : cluster [DBG] 4.1d deep-scrub ok 2024-02-10T08:38:19.907 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:17.767728+0000 osd.2 (osd.2) 261 : cluster [DBG] 5.d scrub starts 2024-02-10T08:38:19.908 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:17.772089+0000 osd.2 (osd.2) 262 : cluster [DBG] 5.d scrub ok 2024-02-10T08:38:19.908 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:18.184489+0000 osd.5 (osd.5) 279 : cluster [DBG] 5.1b deep-scrub starts 2024-02-10T08:38:19.908 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:18.192544+0000 osd.5 (osd.5) 280 : cluster [DBG] 5.1b deep-scrub ok 2024-02-10T08:38:19.908 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:18.288656+0000 osd.1 (osd.1) 302 : cluster [DBG] 4.1d deep-scrub starts 2024-02-10T08:38:19.908 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:18.298253+0000 osd.1 (osd.1) 303 : cluster [DBG] 4.1d deep-scrub ok 2024-02-10T08:38:20.533 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:38:20.543 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 83 16 112991 112975 85.0311 69.5 0.0148094 0.0117549 2024-02-10T08:38:20.549 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:20.550 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:38:20.651 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:38:20.700 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:20.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:18.722254+0000 osd.2 (osd.2) 263 : cluster [DBG] 2.1 scrub starts 2024-02-10T08:38:20.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:18.723143+0000 osd.2 (osd.2) 264 : cluster [DBG] 2.1 scrub ok 2024-02-10T08:38:20.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:38:18.871575+0000 mgr.y (mgr.14505) 809 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:38:20.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:19.118767+0000 mgr.y (mgr.14505) 810 : cluster [DBG] pgmap v991: 178 pgs: 178 active+clean; 6.7 GiB data, 27 GiB used, 689 GiB / 715 GiB avail; 1.2 KiB/s rd, 75 MiB/s wr, 1.20k op/s 2024-02-10T08:38:20.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:19.134757+0000 osd.5 (osd.5) 281 : cluster [DBG] 2.18 deep-scrub starts 2024-02-10T08:38:20.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:19.137639+0000 osd.5 (osd.5) 282 : cluster [DBG] 2.18 deep-scrub ok 2024-02-10T08:38:20.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:19.431232+0000 osd.0 (osd.0) 274 : cluster [DBG] 6.18 deep-scrub starts 2024-02-10T08:38:20.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:19.438169+0000 osd.0 (osd.0) 275 : cluster [DBG] 6.18 deep-scrub ok 2024-02-10T08:38:20.849 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:38:20.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:18.722254+0000 osd.2 (osd.2) 263 : cluster [DBG] 2.1 scrub starts 2024-02-10T08:38:20.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:18.723143+0000 osd.2 (osd.2) 264 : cluster [DBG] 2.1 scrub ok 2024-02-10T08:38:20.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:38:18.871575+0000 mgr.y (mgr.14505) 809 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:38:20.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:19.118767+0000 mgr.y (mgr.14505) 810 : cluster [DBG] pgmap v991: 178 pgs: 178 active+clean; 6.7 GiB data, 27 GiB used, 689 GiB / 715 GiB avail; 1.2 KiB/s rd, 75 MiB/s wr, 1.20k op/s 2024-02-10T08:38:20.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:19.134757+0000 osd.5 (osd.5) 281 : cluster [DBG] 2.18 deep-scrub starts 2024-02-10T08:38:20.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:19.137639+0000 osd.5 (osd.5) 282 : cluster [DBG] 2.18 deep-scrub ok 2024-02-10T08:38:20.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:19.431232+0000 osd.0 (osd.0) 274 : cluster [DBG] 6.18 deep-scrub starts 2024-02-10T08:38:20.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:19.438169+0000 osd.0 (osd.0) 275 : cluster [DBG] 6.18 deep-scrub ok 2024-02-10T08:38:20.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:18.722254+0000 osd.2 (osd.2) 263 : cluster [DBG] 2.1 scrub starts 2024-02-10T08:38:20.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:18.723143+0000 osd.2 (osd.2) 264 : cluster [DBG] 2.1 scrub ok 2024-02-10T08:38:20.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:38:18.871575+0000 mgr.y (mgr.14505) 809 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:38:20.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:19.118767+0000 mgr.y (mgr.14505) 810 : cluster [DBG] pgmap v991: 178 pgs: 178 active+clean; 6.7 GiB data, 27 GiB used, 689 GiB / 715 GiB avail; 1.2 KiB/s rd, 75 MiB/s wr, 1.20k op/s 2024-02-10T08:38:20.906 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:19.134757+0000 osd.5 (osd.5) 281 : cluster [DBG] 2.18 deep-scrub starts 2024-02-10T08:38:20.906 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:19.137639+0000 osd.5 (osd.5) 282 : cluster [DBG] 2.18 deep-scrub ok 2024-02-10T08:38:20.906 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:19.431232+0000 osd.0 (osd.0) 274 : cluster [DBG] 6.18 deep-scrub starts 2024-02-10T08:38:20.906 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:19.438169+0000 osd.0 (osd.0) 275 : cluster [DBG] 6.18 deep-scrub ok 2024-02-10T08:38:21.339 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.7 dump_historic_ops 2024-02-10T08:38:21.381 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:38:21.390 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:21.390 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:38:21.491 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:38:21.543 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 84 16 113817 113801 84.6335 51.625 0.0184485 0.0118099 2024-02-10T08:38:21.555 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:21.768 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:38:22.056 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is set 2024-02-10T08:38:22.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:20.236058+0000 osd.6 (osd.6) 275 : cluster [DBG] 11.8 deep-scrub starts 2024-02-10T08:38:22.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:20.289363+0000 osd.1 (osd.1) 304 : cluster [DBG] 6.20 scrub starts 2024-02-10T08:38:22.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:20.293290+0000 osd.1 (osd.1) 305 : cluster [DBG] 6.20 scrub ok 2024-02-10T08:38:22.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:21.119318+0000 mgr.y (mgr.14505) 811 : cluster [DBG] pgmap v992: 178 pgs: 178 active+clean; 6.7 GiB data, 27 GiB used, 689 GiB / 715 GiB avail; 631 B/s rd, 49 MiB/s wr, 780 op/s 2024-02-10T08:38:22.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:38:21.160619+0000 mon.c (mon.2) 97 : audit [INF] from='client.? 172.21.15.18:0/794448502' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:38:22.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:38:21.161014+0000 mon.a (mon.0) 1731 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:38:22.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:21.599768+0000 osd.5 (osd.5) 283 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:38:22.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:21.599819+0000 osd.5 (osd.5) 284 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:38:22.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:20.236058+0000 osd.6 (osd.6) 275 : cluster [DBG] 11.8 deep-scrub starts 2024-02-10T08:38:22.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:20.289363+0000 osd.1 (osd.1) 304 : cluster [DBG] 6.20 scrub starts 2024-02-10T08:38:22.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:20.293290+0000 osd.1 (osd.1) 305 : cluster [DBG] 6.20 scrub ok 2024-02-10T08:38:22.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:21.119318+0000 mgr.y (mgr.14505) 811 : cluster [DBG] pgmap v992: 178 pgs: 178 active+clean; 6.7 GiB data, 27 GiB used, 689 GiB / 715 GiB avail; 631 B/s rd, 49 MiB/s wr, 780 op/s 2024-02-10T08:38:22.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:38:21.160619+0000 mon.c (mon.2) 97 : audit [INF] from='client.? 172.21.15.18:0/794448502' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:38:22.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:38:21.161014+0000 mon.a (mon.0) 1731 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:38:22.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:21.599768+0000 osd.5 (osd.5) 283 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:38:22.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:21.599819+0000 osd.5 (osd.5) 284 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:38:22.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:20.236058+0000 osd.6 (osd.6) 275 : cluster [DBG] 11.8 deep-scrub starts 2024-02-10T08:38:22.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:20.289363+0000 osd.1 (osd.1) 304 : cluster [DBG] 6.20 scrub starts 2024-02-10T08:38:22.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:20.293290+0000 osd.1 (osd.1) 305 : cluster [DBG] 6.20 scrub ok 2024-02-10T08:38:22.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:21.119318+0000 mgr.y (mgr.14505) 811 : cluster [DBG] pgmap v992: 178 pgs: 178 active+clean; 6.7 GiB data, 27 GiB used, 689 GiB / 715 GiB avail; 631 B/s rd, 49 MiB/s wr, 780 op/s 2024-02-10T08:38:22.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:38:21.160619+0000 mon.c (mon.2) 97 : audit [INF] from='client.? 172.21.15.18:0/794448502' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:38:22.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:38:21.161014+0000 mon.a (mon.0) 1731 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:38:22.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:21.599768+0000 osd.5 (osd.5) 283 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:38:22.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:21.599819+0000 osd.5 (osd.5) 284 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:38:22.543 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 85 16 114755 114739 84.3276 58.625 0.00704585 0.011854 2024-02-10T08:38:22.570 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-10T08:38:23.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:21.999253+0000 mon.a (mon.0) 1732 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:38:23.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:38:22.032312+0000 mon.a (mon.0) 1733 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-10T08:38:23.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:22.032376+0000 mon.a (mon.0) 1734 : cluster [DBG] osdmap e422: 8 total, 8 up, 8 in 2024-02-10T08:38:23.384 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:21.999253+0000 mon.a (mon.0) 1732 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:38:23.384 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:38:22.032312+0000 mon.a (mon.0) 1733 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-10T08:38:23.384 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:22.032376+0000 mon.a (mon.0) 1734 : cluster [DBG] osdmap e422: 8 total, 8 up, 8 in 2024-02-10T08:38:23.384 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:21.999253+0000 mon.a (mon.0) 1732 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:38:23.384 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:38:22.032312+0000 mon.a (mon.0) 1733 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-10T08:38:23.384 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:22.032376+0000 mon.a (mon.0) 1734 : cluster [DBG] osdmap e422: 8 total, 8 up, 8 in 2024-02-10T08:38:23.443 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:38:23.449 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:23.449 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:38:23.543 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 86 16 115604 115588 83.9641 53.0625 0.00796487 0.0119058 2024-02-10T08:38:23.551 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:38:23.611 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:23.658 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:38:23.664 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:23.665 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:38:23.765 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:38:23.818 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:24.206 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:38:24.217 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:24.218 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:38:24.319 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:38:24.361 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:23.120666+0000 mgr.y (mgr.14505) 812 : cluster [DBG] pgmap v994: 178 pgs: 1 active+clean+scrubbing+deep, 177 active+clean; 7.0 GiB data, 27 GiB used, 688 GiB / 715 GiB avail; 1.2 KiB/s rd, 69 MiB/s wr, 1.10k op/s 2024-02-10T08:38:24.362 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:23.976235+0000 osd.6 (osd.6) 276 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:38:24.362 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:23.976287+0000 osd.6 (osd.6) 277 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:38:24.362 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:23.120666+0000 mgr.y (mgr.14505) 812 : cluster [DBG] pgmap v994: 178 pgs: 1 active+clean+scrubbing+deep, 177 active+clean; 7.0 GiB data, 27 GiB used, 688 GiB / 715 GiB avail; 1.2 KiB/s rd, 69 MiB/s wr, 1.10k op/s 2024-02-10T08:38:24.362 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:23.976235+0000 osd.6 (osd.6) 276 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:38:24.362 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:23.976287+0000 osd.6 (osd.6) 277 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:38:24.367 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:24.431 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:38:24.435 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:24.436 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:38:24.451 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:23.120666+0000 mgr.y (mgr.14505) 812 : cluster [DBG] pgmap v994: 178 pgs: 1 active+clean+scrubbing+deep, 177 active+clean; 7.0 GiB data, 27 GiB used, 688 GiB / 715 GiB avail; 1.2 KiB/s rd, 69 MiB/s wr, 1.10k op/s 2024-02-10T08:38:24.451 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:23.976235+0000 osd.6 (osd.6) 276 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:38:24.452 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:23.976287+0000 osd.6 (osd.6) 277 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:38:24.536 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:38:24.546 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 87 16 116561 116545 83.6853 59.8125 0.0173639 0.0119448 2024-02-10T08:38:24.584 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:24.730 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:38:24.735 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:24.736 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:38:24.836 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:38:24.885 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:25.070 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:24.057614+0000 mon.a (mon.0) 1735 : cluster [DBG] osdmap e423: 8 total, 8 up, 8 in 2024-02-10T08:38:25.154 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:38:25.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:24.057614+0000 mon.a (mon.0) 1735 : cluster [DBG] osdmap e423: 8 total, 8 up, 8 in 2024-02-10T08:38:25.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:24.057614+0000 mon.a (mon.0) 1735 : cluster [DBG] osdmap e423: 8 total, 8 up, 8 in 2024-02-10T08:38:25.544 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 88 16 117379 117363 83.3154 51.125 0.00726634 0.0119977 2024-02-10T08:38:25.652 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-02-10T08:38:25.652 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-02-10T08:38:25.652 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-02-10T08:38:25.652 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-02-10T08:38:25.652 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.653 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.15198.0:143514 9.e 9:7972adfa:::benchmark_data_smithi018_124176_object21775:head [delete] snapc 0=[] ondisk+write+known_if_redirected e290)", 2024-02-10T08:38:25.653 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:30:28.471892+0000", 2024-02-10T08:38:25.653 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 476.54282272400002, 2024-02-10T08:38:25.653 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.077509830000000002, 2024-02-10T08:38:25.653 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:38:25.653 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:38:25.653 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:38:25.653 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.15198", 2024-02-10T08:38:25.653 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/1957604827", 2024-02-10T08:38:25.653 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 143514 2024-02-10T08:38:25.653 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.654 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:38:25.654 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.654 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:38:25.654 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.471892+0000", 2024-02-10T08:38:25.654 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:38:25.654 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.654 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.654 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:38:25.654 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.471892+0000", 2024-02-10T08:38:25.654 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999981 2024-02-10T08:38:25.654 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.654 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.654 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:38:25.654 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.471890+0000", 2024-02-10T08:38:25.655 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1789e-05 2024-02-10T08:38:25.655 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.655 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.655 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:38:25.655 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.471902+0000", 2024-02-10T08:38:25.655 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6011e-05 2024-02-10T08:38:25.655 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.655 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.655 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:38:25.655 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.471918+0000", 2024-02-10T08:38:25.655 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4250000000000001e-06 2024-02-10T08:38:25.655 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.655 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.655 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:38:25.655 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.471925+0000", 2024-02-10T08:38:25.656 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021123499999999999 2024-02-10T08:38:25.656 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.656 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.656 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:38:25.656 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.472137+0000", 2024-02-10T08:38:25.656 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0021797679999999999 2024-02-10T08:38:25.656 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.656 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.656 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:38:25.656 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.474316+0000", 2024-02-10T08:38:25.656 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012536700000000001 2024-02-10T08:38:25.656 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.656 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.657 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1,4", 2024-02-10T08:38:25.657 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.474442+0000", 2024-02-10T08:38:25.657 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0044317719999999996 2024-02-10T08:38:25.657 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.657 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.657 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:38:25.657 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.478874+0000", 2024-02-10T08:38:25.657 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022042189999999999 2024-02-10T08:38:25.657 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.657 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.657 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:38:25.657 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.481078+0000", 2024-02-10T08:38:25.657 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.068233639999999998 2024-02-10T08:38:25.657 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.658 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.658 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:38:25.658 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.549311+0000", 2024-02-10T08:38:25.658 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1298999999999998e-05 2024-02-10T08:38:25.658 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.658 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.658 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:38:25.658 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.549363+0000", 2024-02-10T08:38:25.658 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9091000000000002e-05 2024-02-10T08:38:25.658 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.658 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.658 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:38:25.658 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.549402+0000", 2024-02-10T08:38:25.658 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.077509830000000002 2024-02-10T08:38:25.659 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:38:25.659 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:38:25.659 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:38:25.659 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.659 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.659 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.15198.0:143522 9.3 9:c88a4df0:::benchmark_data_smithi018_124176_object21783:head [delete] snapc 0=[] ondisk+write+known_if_redirected e290)", 2024-02-10T08:38:25.659 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:30:28.472171+0000", 2024-02-10T08:38:25.659 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 476.54254409800001, 2024-02-10T08:38:25.659 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.073413009000000001, 2024-02-10T08:38:25.659 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:38:25.659 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:38:25.659 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:38:25.659 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.15198", 2024-02-10T08:38:25.659 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/1957604827", 2024-02-10T08:38:25.659 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 143522 2024-02-10T08:38:25.659 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.660 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:38:25.660 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.660 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:38:25.660 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.472171+0000", 2024-02-10T08:38:25.660 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:38:25.660 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.660 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.660 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:38:25.660 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.472171+0000", 2024-02-10T08:38:25.660 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-02-10T08:38:25.660 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.660 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.660 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:38:25.661 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.472170+0000", 2024-02-10T08:38:25.661 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6590000000000004e-06 2024-02-10T08:38:25.661 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.661 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.661 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:38:25.661 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.472175+0000", 2024-02-10T08:38:25.661 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5480999999999999e-05 2024-02-10T08:38:25.661 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.661 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.661 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:38:25.661 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.472201+0000", 2024-02-10T08:38:25.661 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9410000000000004e-06 2024-02-10T08:38:25.661 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.661 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.661 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:38:25.661 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.472207+0000", 2024-02-10T08:38:25.662 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8554999999999998e-05 2024-02-10T08:38:25.662 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.662 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.662 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:38:25.662 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.472265+0000", 2024-02-10T08:38:25.662 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000107817 2024-02-10T08:38:25.662 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.662 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.662 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:38:25.662 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.472373+0000", 2024-02-10T08:38:25.662 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014940900000000001 2024-02-10T08:38:25.662 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.662 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.662 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1,3", 2024-02-10T08:38:25.662 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.472522+0000", 2024-02-10T08:38:25.662 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028071509999999999 2024-02-10T08:38:25.663 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.663 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.663 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:38:25.663 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.475330+0000", 2024-02-10T08:38:25.663 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033079530000000002 2024-02-10T08:38:25.663 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.664 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.664 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:38:25.664 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.478638+0000", 2024-02-10T08:38:25.664 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.066886249999999994 2024-02-10T08:38:25.664 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.665 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.665 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:38:25.665 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.545524+0000", 2024-02-10T08:38:25.665 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4598000000000003e-05 2024-02-10T08:38:25.665 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.665 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.666 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:38:25.666 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.545558+0000", 2024-02-10T08:38:25.666 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5202999999999999e-05 2024-02-10T08:38:25.666 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.666 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.666 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:38:25.667 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:30:28.545584+0000", 2024-02-10T08:38:25.667 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.073413009000000001 2024-02-10T08:38:25.667 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:38:25.667 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:38:25.667 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:38:25.667 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.668 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.668 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.15198.0:180020 9.e 9:74420e8b:::benchmark_data_smithi018_124176_object58281:head [delete] snapc 0=[] ondisk+write+known_if_redirected e302)", 2024-02-10T08:38:25.668 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:31:01.806284+0000", 2024-02-10T08:38:25.668 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 443.208430201, 2024-02-10T08:38:25.668 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.10681077, 2024-02-10T08:38:25.669 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:38:25.669 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:38:25.669 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:38:25.669 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.15198", 2024-02-10T08:38:25.669 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/1957604827", 2024-02-10T08:38:25.669 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 180020 2024-02-10T08:38:25.670 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.670 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:38:25.670 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.670 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:38:25.670 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:01.806284+0000", 2024-02-10T08:38:25.671 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:38:25.671 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.671 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.671 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:38:25.671 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:01.806284+0000", 2024-02-10T08:38:25.671 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999981 2024-02-10T08:38:25.671 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.671 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.671 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:38:25.672 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:01.806283+0000", 2024-02-10T08:38:25.672 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1589999999999993e-06 2024-02-10T08:38:25.672 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.672 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.672 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:38:25.672 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:01.806291+0000", 2024-02-10T08:38:25.672 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1745e-05 2024-02-10T08:38:25.672 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.672 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.672 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:38:25.672 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:01.806303+0000", 2024-02-10T08:38:25.672 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0800000000000002e-06 2024-02-10T08:38:25.672 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.673 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.673 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:38:25.673 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:01.806309+0000", 2024-02-10T08:38:25.673 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0442000000000003e-05 2024-02-10T08:38:25.673 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.673 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.673 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:38:25.673 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:01.806359+0000", 2024-02-10T08:38:25.673 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000126067 2024-02-10T08:38:25.673 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.673 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.673 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:38:25.673 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:01.806485+0000", 2024-02-10T08:38:25.673 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000133051 2024-02-10T08:38:25.674 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.674 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.674 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1,4", 2024-02-10T08:38:25.674 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:01.806618+0000", 2024-02-10T08:38:25.674 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0021364420000000001 2024-02-10T08:38:25.674 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.674 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.674 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:38:25.674 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:01.808755+0000", 2024-02-10T08:38:25.674 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029590150000000002 2024-02-10T08:38:25.674 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.674 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.674 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:38:25.675 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:01.811714+0000", 2024-02-10T08:38:25.675 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.101322127 2024-02-10T08:38:25.675 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.675 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.675 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:38:25.675 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:01.913036+0000", 2024-02-10T08:38:25.675 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4730999999999997e-05 2024-02-10T08:38:25.675 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.675 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.675 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:38:25.675 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:01.913071+0000", 2024-02-10T08:38:25.675 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4630999999999998e-05 2024-02-10T08:38:25.675 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.675 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.675 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:38:25.676 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:01.913095+0000", 2024-02-10T08:38:25.676 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.10681077 2024-02-10T08:38:25.676 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:38:25.676 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:38:25.676 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:38:25.676 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.676 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.676 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.15198.0:220383 9.d 9:b537cac2:::benchmark_data_smithi018_124176_object98644:head [delete] snapc 0=[] ondisk+write+known_if_redirected e316)", 2024-02-10T08:38:25.676 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:31:44.011631+0000", 2024-02-10T08:38:25.676 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 401.003084129, 2024-02-10T08:38:25.676 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.080527913000000007, 2024-02-10T08:38:25.676 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:38:25.677 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:38:25.677 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:38:25.677 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.15198", 2024-02-10T08:38:25.677 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/1957604827", 2024-02-10T08:38:25.677 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 220383 2024-02-10T08:38:25.677 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.677 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:38:25.677 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.677 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:38:25.677 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:44.011631+0000", 2024-02-10T08:38:25.677 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:38:25.677 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.677 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.677 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:38:25.677 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:44.011631+0000", 2024-02-10T08:38:25.678 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999981 2024-02-10T08:38:25.678 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.678 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.678 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:38:25.678 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:44.011628+0000", 2024-02-10T08:38:25.678 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9519999999999994e-06 2024-02-10T08:38:25.678 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.678 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.678 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:38:25.678 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:44.011636+0000", 2024-02-10T08:38:25.678 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2149e-05 2024-02-10T08:38:25.678 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.678 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.678 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:38:25.679 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:44.011649+0000", 2024-02-10T08:38:25.679 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5609999999999998e-06 2024-02-10T08:38:25.679 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.679 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.679 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:38:25.679 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:44.011654+0000", 2024-02-10T08:38:25.679 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9227000000000001e-05 2024-02-10T08:38:25.679 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.679 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.679 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:38:25.679 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:44.011703+0000", 2024-02-10T08:38:25.679 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2700000000000001e-06 2024-02-10T08:38:25.679 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.679 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.679 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-02-10T08:38:25.680 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:44.011710+0000", 2024-02-10T08:38:25.680 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0078775749999999995 2024-02-10T08:38:25.680 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.680 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.680 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:38:25.680 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:44.019587+0000", 2024-02-10T08:38:25.680 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012922899999999999 2024-02-10T08:38:25.680 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.680 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.680 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:38:25.680 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:44.019716+0000", 2024-02-10T08:38:25.681 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.058136195000000002 2024-02-10T08:38:25.681 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.681 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.681 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1,5", 2024-02-10T08:38:25.681 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:44.077853+0000", 2024-02-10T08:38:25.681 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0093539030000000002 2024-02-10T08:38:25.681 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.682 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.682 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:38:25.682 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:44.087206+0000", 2024-02-10T08:38:25.682 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00085107300000000004 2024-02-10T08:38:25.682 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.682 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.683 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:38:25.683 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:44.088058+0000", 2024-02-10T08:38:25.683 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040201760000000003 2024-02-10T08:38:25.683 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.683 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.683 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:38:25.684 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:44.092078+0000", 2024-02-10T08:38:25.684 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5340999999999998e-05 2024-02-10T08:38:25.684 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.684 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.684 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:38:25.685 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:44.092123+0000", 2024-02-10T08:38:25.685 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5403e-05 2024-02-10T08:38:25.685 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.685 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:38:25.685 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:31:44.092158+0000", 2024-02-10T08:38:25.686 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.080527913000000007 2024-02-10T08:38:25.686 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:38:25.686 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:38:25.686 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:38:25.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.686 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.687 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.25369.0:55560 10.c 10:35ec2c86:::benchmark_data_smithi018_146618_object55559:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e351)", 2024-02-10T08:38:25.687 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:33:14.240360+0000", 2024-02-10T08:38:25.687 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 310.774354652, 2024-02-10T08:38:25.687 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.075037662000000005, 2024-02-10T08:38:25.687 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:38:25.687 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:38:25.688 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:38:25.688 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.25369", 2024-02-10T08:38:25.688 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3974730810", 2024-02-10T08:38:25.688 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 55560 2024-02-10T08:38:25.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.688 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:38:25.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.689 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:38:25.689 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:14.240360+0000", 2024-02-10T08:38:25.689 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:38:25.689 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.689 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:38:25.689 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:14.240360+0000", 2024-02-10T08:38:25.689 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999981 2024-02-10T08:38:25.689 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.689 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:38:25.690 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:14.240358+0000", 2024-02-10T08:38:25.690 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7661000000000003e-05 2024-02-10T08:38:25.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.690 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.690 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:38:25.690 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:14.240406+0000", 2024-02-10T08:38:25.690 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4328000000000001e-05 2024-02-10T08:38:25.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.690 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.690 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:38:25.690 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:14.240420+0000", 2024-02-10T08:38:25.690 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7669999999999998e-06 2024-02-10T08:38:25.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.691 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:38:25.691 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:14.240427+0000", 2024-02-10T08:38:25.691 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1771999999999999e-05 2024-02-10T08:38:25.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.691 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:38:25.691 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:14.240469+0000", 2024-02-10T08:38:25.691 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000117738 2024-02-10T08:38:25.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.691 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:38:25.691 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:14.240586+0000", 2024-02-10T08:38:25.691 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014056800000000001 2024-02-10T08:38:25.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.692 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,4", 2024-02-10T08:38:25.692 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:14.240727+0000", 2024-02-10T08:38:25.692 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033229380000000001 2024-02-10T08:38:25.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.692 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:38:25.692 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:14.244050+0000", 2024-02-10T08:38:25.692 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0037047690000000001 2024-02-10T08:38:25.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.692 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:38:25.692 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:14.247755+0000", 2024-02-10T08:38:25.693 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.067549397999999997 2024-02-10T08:38:25.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.693 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:38:25.693 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:14.315304+0000", 2024-02-10T08:38:25.693 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3520000000000003e-05 2024-02-10T08:38:25.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.693 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:38:25.693 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:14.315358+0000", 2024-02-10T08:38:25.693 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0182000000000003e-05 2024-02-10T08:38:25.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.693 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:38:25.693 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:14.315398+0000", 2024-02-10T08:38:25.694 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.075037662000000005 2024-02-10T08:38:25.694 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:38:25.694 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:38:25.694 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:38:25.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.694 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.694 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.25369.0:67819 10.c 10:3b9737dc:::benchmark_data_smithi018_146618_object67818:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e354)", 2024-02-10T08:38:25.694 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:33:24.077786+0000", 2024-02-10T08:38:25.694 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 300.93692865700001, 2024-02-10T08:38:25.694 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.116609987, 2024-02-10T08:38:25.694 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:38:25.694 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:38:25.694 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:38:25.694 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.25369", 2024-02-10T08:38:25.695 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3974730810", 2024-02-10T08:38:25.695 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 67819 2024-02-10T08:38:25.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.695 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:38:25.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.695 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:38:25.695 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:24.077786+0000", 2024-02-10T08:38:25.695 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:38:25.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.695 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:38:25.695 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:24.077786+0000", 2024-02-10T08:38:25.695 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999971 2024-02-10T08:38:25.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.696 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:38:25.696 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:24.077783+0000", 2024-02-10T08:38:25.696 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012986900000000001 2024-02-10T08:38:25.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.696 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.696 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:38:25.696 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:24.077913+0000", 2024-02-10T08:38:25.696 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6338000000000001e-05 2024-02-10T08:38:25.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.696 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.696 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:38:25.696 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:24.077939+0000", 2024-02-10T08:38:25.696 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5301000000000001e-05 2024-02-10T08:38:25.697 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.697 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.697 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:38:25.697 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:24.077955+0000", 2024-02-10T08:38:25.697 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1236000000000003e-05 2024-02-10T08:38:25.697 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.697 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.697 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:38:25.697 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:24.077996+0000", 2024-02-10T08:38:25.697 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115784 2024-02-10T08:38:25.697 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.697 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.697 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:38:25.697 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:24.078112+0000", 2024-02-10T08:38:25.697 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000157023 2024-02-10T08:38:25.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.698 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,4", 2024-02-10T08:38:25.698 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:24.078269+0000", 2024-02-10T08:38:25.698 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0050535099999999998 2024-02-10T08:38:25.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.699 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:38:25.699 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:24.083322+0000", 2024-02-10T08:38:25.699 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016583200000000001 2024-02-10T08:38:25.699 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.699 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.699 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:38:25.700 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:24.083488+0000", 2024-02-10T08:38:25.700 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.110808144 2024-02-10T08:38:25.700 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.700 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.700 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:38:25.701 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:24.194296+0000", 2024-02-10T08:38:25.701 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7620000000000001e-05 2024-02-10T08:38:25.701 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.701 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.701 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:38:25.701 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:24.194354+0000", 2024-02-10T08:38:25.702 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2169999999999998e-05 2024-02-10T08:38:25.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.702 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.702 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:38:25.702 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:24.194396+0000", 2024-02-10T08:38:25.703 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.116609987 2024-02-10T08:38:25.703 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:38:25.703 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:38:25.703 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:38:25.703 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.703 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.704 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.25369.0:67833 10.c 10:3f1f2fbc:::benchmark_data_smithi018_146618_object67832:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e354)", 2024-02-10T08:38:25.704 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:33:24.089879+0000", 2024-02-10T08:38:25.704 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 300.92483530599998, 2024-02-10T08:38:25.704 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.10478575599999999, 2024-02-10T08:38:25.704 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:38:25.705 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:38:25.705 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:38:25.705 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.25369", 2024-02-10T08:38:25.705 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3974730810", 2024-02-10T08:38:25.705 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 67833 2024-02-10T08:38:25.705 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.706 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:38:25.706 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.706 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:38:25.706 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:24.089879+0000", 2024-02-10T08:38:25.706 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:38:25.706 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.706 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.706 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:38:25.707 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:24.089879+0000", 2024-02-10T08:38:25.707 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-02-10T08:38:25.707 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.707 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.707 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:38:25.707 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:24.089878+0000", 2024-02-10T08:38:25.707 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6257e-05 2024-02-10T08:38:25.707 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.707 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.707 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:38:25.707 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:24.089934+0000", 2024-02-10T08:38:25.707 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0183999999999999e-05 2024-02-10T08:38:25.707 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.708 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.708 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:38:25.708 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:24.089944+0000", 2024-02-10T08:38:25.708 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6020000000000002e-06 2024-02-10T08:38:25.708 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.708 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.708 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:38:25.708 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:24.089949+0000", 2024-02-10T08:38:25.708 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3540000000000001e-05 2024-02-10T08:38:25.708 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.708 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.708 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:38:25.709 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:24.089983+0000", 2024-02-10T08:38:25.709 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0477999999999997e-05 2024-02-10T08:38:25.709 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.709 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.709 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:38:25.709 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:24.090073+0000", 2024-02-10T08:38:25.709 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000102823 2024-02-10T08:38:25.709 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.709 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.709 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,4", 2024-02-10T08:38:25.709 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:24.090176+0000", 2024-02-10T08:38:25.709 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001870841 2024-02-10T08:38:25.709 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.709 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.710 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:38:25.710 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:24.092047+0000", 2024-02-10T08:38:25.710 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00043074399999999999 2024-02-10T08:38:25.710 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.710 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.710 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:38:25.710 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:24.092477+0000", 2024-02-10T08:38:25.710 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.10211165799999999 2024-02-10T08:38:25.710 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.710 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.710 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:38:25.710 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:24.194589+0000", 2024-02-10T08:38:25.710 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4604000000000002e-05 2024-02-10T08:38:25.711 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.711 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.711 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:38:25.711 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:24.194634+0000", 2024-02-10T08:38:25.711 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1405999999999997e-05 2024-02-10T08:38:25.711 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.711 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.711 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:38:25.711 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:33:24.194665+0000", 2024-02-10T08:38:25.711 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.10478575599999999 2024-02-10T08:38:25.711 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:38:25.711 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:38:25.711 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:38:25.711 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.711 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.711 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.25369.0:210136 10.c 10:35f16003:::benchmark_data_smithi018_146618_object86333:head [delete] snapc 0=[] ondisk+write+known_if_redirected e383)", 2024-02-10T08:38:25.711 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:35:40.758349+0000", 2024-02-10T08:38:25.712 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 164.256365308, 2024-02-10T08:38:25.712 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.19900879599999999, 2024-02-10T08:38:25.712 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:38:25.712 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:38:25.712 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:38:25.712 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.25369", 2024-02-10T08:38:25.712 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3974730810", 2024-02-10T08:38:25.712 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 210136 2024-02-10T08:38:25.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.712 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:38:25.712 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.712 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:38:25.712 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:35:40.758349+0000", 2024-02-10T08:38:25.712 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:38:25.713 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.713 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.713 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:38:25.713 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:35:40.758349+0000", 2024-02-10T08:38:25.713 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999981 2024-02-10T08:38:25.713 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.713 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.713 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:38:25.713 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:35:40.758347+0000", 2024-02-10T08:38:25.713 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9270000000000005e-06 2024-02-10T08:38:25.713 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.713 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.713 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:38:25.713 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:35:40.758355+0000", 2024-02-10T08:38:25.714 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2173e-05 2024-02-10T08:38:25.714 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.714 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.714 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:38:25.714 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:35:40.758367+0000", 2024-02-10T08:38:25.714 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9179999999999999e-06 2024-02-10T08:38:25.714 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.714 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.714 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:38:25.714 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:35:40.758373+0000", 2024-02-10T08:38:25.714 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7516999999999999e-05 2024-02-10T08:38:25.714 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.714 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.715 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:38:25.715 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:35:40.758421+0000", 2024-02-10T08:38:25.715 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000112328 2024-02-10T08:38:25.715 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.715 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.715 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:38:25.715 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:35:40.758533+0000", 2024-02-10T08:38:25.715 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013033899999999999 2024-02-10T08:38:25.715 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.715 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.715 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,4", 2024-02-10T08:38:25.716 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:35:40.758664+0000", 2024-02-10T08:38:25.716 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0023145430000000001 2024-02-10T08:38:25.716 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.716 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.716 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:38:25.717 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:35:40.760978+0000", 2024-02-10T08:38:25.717 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0018591020000000001 2024-02-10T08:38:25.717 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.717 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.717 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:38:25.717 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:35:40.762837+0000", 2024-02-10T08:38:25.718 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.19442220299999999 2024-02-10T08:38:25.718 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.718 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.718 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:38:25.718 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:35:40.957259+0000", 2024-02-10T08:38:25.718 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8094999999999999e-05 2024-02-10T08:38:25.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.719 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.719 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:38:25.719 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:35:40.957318+0000", 2024-02-10T08:38:25.719 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0657000000000001e-05 2024-02-10T08:38:25.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.720 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.720 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:38:25.720 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:35:40.957358+0000", 2024-02-10T08:38:25.720 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.19900879599999999 2024-02-10T08:38:25.720 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:38:25.721 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:38:25.721 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:38:25.721 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.721 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.721 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.25369.0:243752 10.c 10:37c84829:::benchmark_data_smithi018_146618_object119949:head [delete] snapc 0=[] ondisk+write+known_if_redirected e390)", 2024-02-10T08:38:25.721 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:36:11.002467+0000", 2024-02-10T08:38:25.722 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 134.01224797099999, 2024-02-10T08:38:25.722 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.16086700200000001, 2024-02-10T08:38:25.722 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:38:25.722 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:38:25.722 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:38:25.722 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.25369", 2024-02-10T08:38:25.723 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3974730810", 2024-02-10T08:38:25.723 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 243752 2024-02-10T08:38:25.723 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.723 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:38:25.723 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.724 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:38:25.724 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:36:11.002467+0000", 2024-02-10T08:38:25.724 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:38:25.724 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.724 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.724 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:38:25.725 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:36:11.002467+0000", 2024-02-10T08:38:25.725 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-02-10T08:38:25.725 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.725 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.725 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:38:25.725 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:36:11.002465+0000", 2024-02-10T08:38:25.726 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8909999999999998e-06 2024-02-10T08:38:25.726 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.726 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.726 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:38:25.726 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:36:11.002472+0000", 2024-02-10T08:38:25.726 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9700000000000005e-06 2024-02-10T08:38:25.726 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.727 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.727 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:38:25.727 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:36:11.002481+0000", 2024-02-10T08:38:25.727 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4600000000000002e-06 2024-02-10T08:38:25.727 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.727 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.728 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:38:25.728 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:36:11.002487+0000", 2024-02-10T08:38:25.728 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4956000000000002e-05 2024-02-10T08:38:25.728 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.728 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.729 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:38:25.729 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:36:11.002522+0000", 2024-02-10T08:38:25.729 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000103632 2024-02-10T08:38:25.729 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.729 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.729 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:38:25.730 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:36:11.002625+0000", 2024-02-10T08:38:25.730 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011750400000000001 2024-02-10T08:38:25.730 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.730 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.730 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,4", 2024-02-10T08:38:25.730 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:36:11.002743+0000", 2024-02-10T08:38:25.730 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.006840268 2024-02-10T08:38:25.731 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.731 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.731 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:38:25.731 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:36:11.009583+0000", 2024-02-10T08:38:25.731 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00185199 2024-02-10T08:38:25.731 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.731 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.731 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:38:25.731 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:36:11.011435+0000", 2024-02-10T08:38:25.731 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.15180949299999999 2024-02-10T08:38:25.731 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.731 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.731 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:38:25.731 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:36:11.163244+0000", 2024-02-10T08:38:25.731 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7502e-05 2024-02-10T08:38:25.732 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.732 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.732 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:38:25.732 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:36:11.163292+0000", 2024-02-10T08:38:25.732 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1768999999999999e-05 2024-02-10T08:38:25.732 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.732 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.732 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:38:25.732 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:36:11.163334+0000", 2024-02-10T08:38:25.732 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.16086700200000001 2024-02-10T08:38:25.732 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:38:25.732 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:38:25.732 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:38:25.733 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.733 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.733 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.25369.0:243757 10.c 10:31268c32:::benchmark_data_smithi018_146618_object119954:head [delete] snapc 0=[] ondisk+write+known_if_redirected e390)", 2024-02-10T08:38:25.733 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:36:11.006938+0000", 2024-02-10T08:38:25.733 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 134.007776205, 2024-02-10T08:38:25.733 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.15652856500000001, 2024-02-10T08:38:25.733 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:38:25.733 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:38:25.733 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:38:25.733 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.25369", 2024-02-10T08:38:25.733 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3974730810", 2024-02-10T08:38:25.733 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 243757 2024-02-10T08:38:25.733 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.733 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:38:25.734 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.734 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:38:25.734 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:36:11.006938+0000", 2024-02-10T08:38:25.734 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:38:25.734 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.734 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.734 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:38:25.734 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:36:11.006938+0000", 2024-02-10T08:38:25.734 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999981 2024-02-10T08:38:25.734 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.734 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.734 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:38:25.734 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:36:11.006937+0000", 2024-02-10T08:38:25.734 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6570000000000003e-06 2024-02-10T08:38:25.735 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.735 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.735 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:38:25.735 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:36:11.006945+0000", 2024-02-10T08:38:25.735 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2357e-05 2024-02-10T08:38:25.735 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.735 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.735 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:38:25.735 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:36:11.006958+0000", 2024-02-10T08:38:25.735 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9e-06 2024-02-10T08:38:25.735 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.735 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.735 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:38:25.735 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:36:11.006964+0000", 2024-02-10T08:38:25.735 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00031011 2024-02-10T08:38:25.736 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.736 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.736 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:38:25.736 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:36:11.007275+0000", 2024-02-10T08:38:25.736 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6527999999999995e-05 2024-02-10T08:38:25.736 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.736 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.736 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:38:25.736 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:36:11.007371+0000", 2024-02-10T08:38:25.736 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000109262 2024-02-10T08:38:25.736 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.736 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.736 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,4", 2024-02-10T08:38:25.736 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:36:11.007480+0000", 2024-02-10T08:38:25.736 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0021367640000000002 2024-02-10T08:38:25.737 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.737 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.737 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:38:25.737 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:36:11.009617+0000", 2024-02-10T08:38:25.737 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028242889999999998 2024-02-10T08:38:25.737 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.737 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.737 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:38:25.737 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:36:11.012441+0000", 2024-02-10T08:38:25.737 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.150945885 2024-02-10T08:38:25.737 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.737 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.737 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:38:25.737 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:36:11.163387+0000", 2024-02-10T08:38:25.737 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1789999999999998e-05 2024-02-10T08:38:25.737 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.737 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.738 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:38:25.738 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:36:11.163429+0000", 2024-02-10T08:38:25.738 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7982999999999999e-05 2024-02-10T08:38:25.738 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.738 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.738 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:38:25.738 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:36:11.163467+0000", 2024-02-10T08:38:25.738 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.15652856500000001 2024-02-10T08:38:25.738 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:38:25.738 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:38:25.738 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:38:25.738 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.738 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.738 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop_reply(client.25369.0:243752 10.c e390/335 ondisk, result = 0)", 2024-02-10T08:38:25.738 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:36:11.014524+0000", 2024-02-10T08:38:25.739 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 134.00019088499999, 2024-02-10T08:38:25.739 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.148817491, 2024-02-10T08:38:25.739 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:38:25.739 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-02-10T08:38:25.739 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:38:25.739 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.739 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:38:25.739 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:36:11.014524+0000", 2024-02-10T08:38:25.739 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:38:25.739 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.739 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.739 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:38:25.739 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:36:11.014524+0000", 2024-02-10T08:38:25.739 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-02-10T08:38:25.740 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.740 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.740 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:38:25.740 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:36:11.014523+0000", 2024-02-10T08:38:25.740 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3600000000000001e-06 2024-02-10T08:38:25.740 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.740 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.740 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:38:25.740 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:36:11.014529+0000", 2024-02-10T08:38:25.740 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9520000000000006e-06 2024-02-10T08:38:25.740 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.740 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.740 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:38:25.740 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:36:11.014539+0000", 2024-02-10T08:38:25.740 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5380000000000002e-06 2024-02-10T08:38:25.741 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.741 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.741 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:38:25.741 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:36:11.014545+0000", 2024-02-10T08:38:25.741 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.148671569 2024-02-10T08:38:25.741 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.741 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.741 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:38:25.741 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:36:11.163216+0000", 2024-02-10T08:38:25.741 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8811e-05 2024-02-10T08:38:25.741 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.741 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.741 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:38:25.741 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:36:11.163235+0000", 2024-02-10T08:38:25.741 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000106028 2024-02-10T08:38:25.741 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.742 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.742 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:38:25.742 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:36:11.163341+0000", 2024-02-10T08:38:25.742 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.148817491 2024-02-10T08:38:25.742 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:38:25.742 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:38:25.742 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:38:25.742 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.742 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.742 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop_reply(client.25369.0:243757 10.c e390/335 ondisk, result = 0)", 2024-02-10T08:38:25.742 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:36:11.014572+0000", 2024-02-10T08:38:25.742 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 134.00014225300001, 2024-02-10T08:38:25.742 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.14890287599999999, 2024-02-10T08:38:25.742 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:38:25.742 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-02-10T08:38:25.742 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:38:25.743 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.743 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:38:25.743 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:36:11.014572+0000", 2024-02-10T08:38:25.743 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:38:25.743 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.743 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.743 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:38:25.743 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:36:11.014572+0000", 2024-02-10T08:38:25.743 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-02-10T08:38:25.743 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.743 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.743 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:38:25.743 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:36:11.014572+0000", 2024-02-10T08:38:25.743 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9550000000000001e-06 2024-02-10T08:38:25.743 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.743 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.744 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:38:25.744 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:36:11.014575+0000", 2024-02-10T08:38:25.744 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.148662025 2024-02-10T08:38:25.744 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.744 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.744 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:38:25.744 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:36:11.163237+0000", 2024-02-10T08:38:25.744 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0064000000000001e-05 2024-02-10T08:38:25.744 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.744 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.744 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:38:25.744 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:36:11.163247+0000", 2024-02-10T08:38:25.744 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012557200000000001 2024-02-10T08:38:25.744 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.745 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.745 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:38:25.745 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:36:11.163373+0000", 2024-02-10T08:38:25.745 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2740000000000002e-06 2024-02-10T08:38:25.745 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.745 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.745 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:38:25.745 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:36:11.163380+0000", 2024-02-10T08:38:25.745 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5323999999999997e-05 2024-02-10T08:38:25.745 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.746 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.746 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:38:25.746 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:36:11.163475+0000", 2024-02-10T08:38:25.746 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.14890287599999999 2024-02-10T08:38:25.746 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:38:25.746 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:38:25.746 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:38:25.747 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.747 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.747 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.25369.0:243764 10.c 10:326856b4:::benchmark_data_smithi018_146618_object119961:head [delete] snapc 0=[] ondisk+write+known_if_redirected e390)", 2024-02-10T08:38:25.747 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:36:11.015702+0000", 2024-02-10T08:38:25.747 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 133.99901310800001, 2024-02-10T08:38:25.747 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.15560083199999999, 2024-02-10T08:38:25.747 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:38:25.747 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:38:25.747 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:38:25.747 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.25369", 2024-02-10T08:38:25.747 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/3974730810", 2024-02-10T08:38:25.747 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 243764 2024-02-10T08:38:25.747 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.747 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:38:25.747 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.748 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:38:25.748 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:36:11.015702+0000", 2024-02-10T08:38:25.748 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:38:25.748 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.748 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.748 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:38:25.748 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:36:11.015702+0000", 2024-02-10T08:38:25.749 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-02-10T08:38:25.749 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.749 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.749 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:38:25.749 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:36:11.015700+0000", 2024-02-10T08:38:25.749 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7920000000000004e-06 2024-02-10T08:38:25.749 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.749 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.749 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:38:25.749 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:36:11.015707+0000", 2024-02-10T08:38:25.749 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.14752826199999999 2024-02-10T08:38:25.750 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.750 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.750 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:38:25.750 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:36:11.163235+0000", 2024-02-10T08:38:25.750 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3474e-05 2024-02-10T08:38:25.750 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.750 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.750 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:38:25.750 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:36:11.163249+0000", 2024-02-10T08:38:25.750 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00025006200000000001 2024-02-10T08:38:25.750 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.750 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.750 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:38:25.750 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:36:11.163499+0000", 2024-02-10T08:38:25.750 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013248700000000001 2024-02-10T08:38:25.750 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.751 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.751 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:38:25.751 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:36:11.163631+0000", 2024-02-10T08:38:25.751 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013682500000000001 2024-02-10T08:38:25.751 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.751 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.751 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0,4", 2024-02-10T08:38:25.751 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:36:11.163768+0000", 2024-02-10T08:38:25.751 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0073670879999999999 2024-02-10T08:38:25.751 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.751 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.751 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:38:25.751 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:36:11.171135+0000", 2024-02-10T08:38:25.751 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9407999999999997e-05 2024-02-10T08:38:25.751 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.752 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.752 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:38:25.752 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:36:11.171205+0000", 2024-02-10T08:38:25.752 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0926000000000002e-05 2024-02-10T08:38:25.752 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.752 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.752 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:38:25.752 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:36:11.171235+0000", 2024-02-10T08:38:25.752 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0972000000000001e-05 2024-02-10T08:38:25.752 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.752 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.752 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:38:25.752 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:36:11.171266+0000", 2024-02-10T08:38:25.752 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5979999999999998e-05 2024-02-10T08:38:25.753 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.753 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.753 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:38:25.753 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:36:11.171302+0000", 2024-02-10T08:38:25.753 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.15560083199999999 2024-02-10T08:38:25.753 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:38:25.753 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:38:25.753 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:38:25.753 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.753 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.753 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.25664.0:40714 11.f 11:fed07240:::benchmark_data_smithi018_166993_object40713:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e403)", 2024-02-10T08:38:25.753 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:37:16.916786+0000", 2024-02-10T08:38:25.753 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 68.097928651000004, 2024-02-10T08:38:25.753 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.081258803000000004, 2024-02-10T08:38:25.753 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:38:25.753 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:38:25.754 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:38:25.754 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.25664", 2024-02-10T08:38:25.754 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/1087272222", 2024-02-10T08:38:25.754 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 40714 2024-02-10T08:38:25.754 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.754 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:38:25.754 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.754 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:38:25.754 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:37:16.916786+0000", 2024-02-10T08:38:25.754 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:38:25.754 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.754 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.754 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:38:25.754 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:37:16.916786+0000", 2024-02-10T08:38:25.755 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-02-10T08:38:25.755 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.755 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.755 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:38:25.755 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:37:16.916785+0000", 2024-02-10T08:38:25.755 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8626999999999999e-05 2024-02-10T08:38:25.755 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.755 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.755 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:38:25.755 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:37:16.916814+0000", 2024-02-10T08:38:25.755 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9260000000000003e-06 2024-02-10T08:38:25.755 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.755 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.755 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:38:25.756 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:37:16.916821+0000", 2024-02-10T08:38:25.756 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9830000000000001e-06 2024-02-10T08:38:25.756 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.756 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.756 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:38:25.756 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:37:16.916827+0000", 2024-02-10T08:38:25.756 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7342000000000003e-05 2024-02-10T08:38:25.756 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.756 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.756 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:38:25.756 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:37:16.916864+0000", 2024-02-10T08:38:25.756 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011495200000000001 2024-02-10T08:38:25.756 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.756 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.757 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:38:25.757 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:37:16.916979+0000", 2024-02-10T08:38:25.757 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017092100000000001 2024-02-10T08:38:25.757 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.757 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.757 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1,2", 2024-02-10T08:38:25.757 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:37:16.917150+0000", 2024-02-10T08:38:25.757 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001907427 2024-02-10T08:38:25.757 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.757 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.757 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:38:25.757 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:37:16.919057+0000", 2024-02-10T08:38:25.757 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0031608980000000001 2024-02-10T08:38:25.757 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.757 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.758 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:38:25.758 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:37:16.922218+0000", 2024-02-10T08:38:25.758 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.075731746000000003 2024-02-10T08:38:25.758 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.758 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.758 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:38:25.758 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:37:16.997950+0000", 2024-02-10T08:38:25.758 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0413e-05 2024-02-10T08:38:25.758 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.758 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.758 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:38:25.758 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:37:16.998000+0000", 2024-02-10T08:38:25.758 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4416999999999998e-05 2024-02-10T08:38:25.758 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.759 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.759 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:38:25.759 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:37:16.998045+0000", 2024-02-10T08:38:25.759 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.081258803000000004 2024-02-10T08:38:25.759 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:38:25.759 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:38:25.759 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:38:25.759 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.759 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.759 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.25664.0:40718 11.f 11:f69351bd:::benchmark_data_smithi018_166993_object40717:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e403)", 2024-02-10T08:38:25.759 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:37:16.921321+0000", 2024-02-10T08:38:25.759 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 68.093393414000005, 2024-02-10T08:38:25.759 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.077059119999999995, 2024-02-10T08:38:25.759 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:38:25.760 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:38:25.760 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:38:25.760 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.25664", 2024-02-10T08:38:25.760 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/1087272222", 2024-02-10T08:38:25.760 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 40718 2024-02-10T08:38:25.760 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.760 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:38:25.760 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.760 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:38:25.760 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:37:16.921321+0000", 2024-02-10T08:38:25.760 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:38:25.760 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.760 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.760 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:38:25.761 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:37:16.921321+0000", 2024-02-10T08:38:25.761 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999981 2024-02-10T08:38:25.761 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.761 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.761 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:38:25.761 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:37:16.921319+0000", 2024-02-10T08:38:25.761 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2831999999999998e-05 2024-02-10T08:38:25.761 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.761 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.761 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:38:25.761 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:37:16.921372+0000", 2024-02-10T08:38:25.761 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1011e-05 2024-02-10T08:38:25.761 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.761 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.761 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:38:25.761 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:37:16.921383+0000", 2024-02-10T08:38:25.762 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9399999999999999e-06 2024-02-10T08:38:25.762 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.762 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.762 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:38:25.762 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:37:16.921389+0000", 2024-02-10T08:38:25.762 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00085378400000000001 2024-02-10T08:38:25.762 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.762 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.762 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:38:25.762 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:37:16.922243+0000", 2024-02-10T08:38:25.762 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014926699999999999 2024-02-10T08:38:25.762 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.762 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.762 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:38:25.762 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:37:16.922392+0000", 2024-02-10T08:38:25.762 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000185899 2024-02-10T08:38:25.763 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.763 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.763 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1,2", 2024-02-10T08:38:25.763 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:37:16.922578+0000", 2024-02-10T08:38:25.763 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017369009999999999 2024-02-10T08:38:25.763 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.763 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.763 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:38:25.763 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:37:16.924315+0000", 2024-02-10T08:38:25.763 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00283841 2024-02-10T08:38:25.763 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.763 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.763 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:38:25.763 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:37:16.927154+0000", 2024-02-10T08:38:25.764 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.071144540000000006 2024-02-10T08:38:25.764 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.764 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.764 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:38:25.764 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:37:16.998298+0000", 2024-02-10T08:38:25.764 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6412999999999998e-05 2024-02-10T08:38:25.764 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.764 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.764 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:38:25.764 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:37:16.998344+0000", 2024-02-10T08:38:25.764 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5942000000000002e-05 2024-02-10T08:38:25.764 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.764 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.765 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:38:25.765 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:37:16.998380+0000", 2024-02-10T08:38:25.765 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.077059119999999995 2024-02-10T08:38:25.765 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:38:25.765 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:38:25.765 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:38:25.765 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.765 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.765 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.25664.0:113311 11.4 11:2cd90e56:::benchmark_data_smithi018_166993_object113310:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e421)", 2024-02-10T08:38:25.765 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:38:20.898766+0000", 2024-02-10T08:38:25.765 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.1159488370000004, 2024-02-10T08:38:25.765 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.106306978, 2024-02-10T08:38:25.765 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:38:25.765 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:38:25.765 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:38:25.765 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.25664", 2024-02-10T08:38:25.766 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/1087272222", 2024-02-10T08:38:25.766 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 113311 2024-02-10T08:38:25.766 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.766 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:38:25.766 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.766 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:38:25.766 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:20.898766+0000", 2024-02-10T08:38:25.766 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:38:25.766 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.766 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.766 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:38:25.766 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:20.898766+0000", 2024-02-10T08:38:25.766 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-02-10T08:38:25.766 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.766 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.767 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:38:25.767 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:20.898765+0000", 2024-02-10T08:38:25.767 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1594999999999997e-05 2024-02-10T08:38:25.767 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.767 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.767 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:38:25.767 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:20.898806+0000", 2024-02-10T08:38:25.767 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1838000000000001e-05 2024-02-10T08:38:25.767 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.767 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.767 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:38:25.767 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:20.898818+0000", 2024-02-10T08:38:25.767 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5599999999999999e-06 2024-02-10T08:38:25.767 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.767 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.767 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:38:25.767 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:20.898825+0000", 2024-02-10T08:38:25.768 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1356000000000001e-05 2024-02-10T08:38:25.768 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.768 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.768 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:38:25.768 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:20.898876+0000", 2024-02-10T08:38:25.768 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012852600000000001 2024-02-10T08:38:25.768 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.768 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.768 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:38:25.768 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:20.899005+0000", 2024-02-10T08:38:25.768 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015008400000000001 2024-02-10T08:38:25.768 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.768 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.768 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2,6", 2024-02-10T08:38:25.769 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:20.899155+0000", 2024-02-10T08:38:25.769 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0021619619999999999 2024-02-10T08:38:25.769 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.769 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.769 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:38:25.769 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:20.901317+0000", 2024-02-10T08:38:25.769 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0056558199999999998 2024-02-10T08:38:25.769 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.769 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.769 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:38:25.769 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:20.906972+0000", 2024-02-10T08:38:25.769 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.097996643999999994 2024-02-10T08:38:25.769 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.769 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.769 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:38:25.769 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:21.004969+0000", 2024-02-10T08:38:25.770 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6963999999999999e-05 2024-02-10T08:38:25.770 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.770 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.770 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:38:25.770 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:21.005026+0000", 2024-02-10T08:38:25.770 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6780000000000003e-05 2024-02-10T08:38:25.770 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.770 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.770 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:38:25.770 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:21.005073+0000", 2024-02-10T08:38:25.770 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.106306978 2024-02-10T08:38:25.770 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:38:25.770 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:38:25.770 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:38:25.770 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.770 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.771 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.25664.0:113322 11.5 11:a9b85d01:::benchmark_data_smithi018_166993_object113321:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e421)", 2024-02-10T08:38:25.771 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:38:20.912263+0000", 2024-02-10T08:38:25.771 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.1024518209999998, 2024-02-10T08:38:25.771 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.097444628000000005, 2024-02-10T08:38:25.771 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:38:25.771 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:38:25.771 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:38:25.771 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.25664", 2024-02-10T08:38:25.771 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/1087272222", 2024-02-10T08:38:25.771 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 113322 2024-02-10T08:38:25.771 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.771 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:38:25.771 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.771 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:38:25.771 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:20.912263+0000", 2024-02-10T08:38:25.771 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:38:25.772 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.772 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.772 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:38:25.772 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:20.912263+0000", 2024-02-10T08:38:25.772 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.99999 2024-02-10T08:38:25.772 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.772 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.772 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:38:25.772 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:20.912253+0000", 2024-02-10T08:38:25.772 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9392000000000003e-05 2024-02-10T08:38:25.772 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.772 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.772 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:38:25.772 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:20.912312+0000", 2024-02-10T08:38:25.772 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7183e-05 2024-02-10T08:38:25.773 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.773 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.773 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:38:25.773 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:20.912339+0000", 2024-02-10T08:38:25.773 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3900000000000001e-05 2024-02-10T08:38:25.773 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.773 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.773 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:38:25.773 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:20.912353+0000", 2024-02-10T08:38:25.773 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000108698 2024-02-10T08:38:25.773 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.773 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.773 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:38:25.773 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:20.912462+0000", 2024-02-10T08:38:25.773 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000196594 2024-02-10T08:38:25.773 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.773 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.774 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:38:25.774 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:20.912658+0000", 2024-02-10T08:38:25.774 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011469 2024-02-10T08:38:25.774 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.774 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.774 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5,6", 2024-02-10T08:38:25.774 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:20.912773+0000", 2024-02-10T08:38:25.774 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0018901460000000001 2024-02-10T08:38:25.775 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.775 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.775 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:38:25.775 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:20.914663+0000", 2024-02-10T08:38:25.775 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000240735 2024-02-10T08:38:25.775 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.775 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.775 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:38:25.775 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:20.914904+0000", 2024-02-10T08:38:25.775 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.094728473999999993 2024-02-10T08:38:25.775 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.775 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.775 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:38:25.775 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:21.009632+0000", 2024-02-10T08:38:25.775 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5135999999999997e-05 2024-02-10T08:38:25.776 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.776 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.776 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:38:25.776 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:21.009668+0000", 2024-02-10T08:38:25.776 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9863000000000001e-05 2024-02-10T08:38:25.776 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.776 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.776 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:38:25.776 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:21.009707+0000", 2024-02-10T08:38:25.776 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.097444628000000005 2024-02-10T08:38:25.776 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:38:25.776 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:38:25.776 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:38:25.776 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.777 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.777 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.25664.0:113329 11.4 11:281530dc:::benchmark_data_smithi018_166993_object113328:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e421)", 2024-02-10T08:38:25.777 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:38:20.920947+0000", 2024-02-10T08:38:25.777 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.0937673979999998, 2024-02-10T08:38:25.777 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.093399322000000007, 2024-02-10T08:38:25.777 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:38:25.777 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:38:25.777 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:38:25.777 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.25664", 2024-02-10T08:38:25.777 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/1087272222", 2024-02-10T08:38:25.777 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 113329 2024-02-10T08:38:25.777 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.777 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:38:25.777 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.777 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:38:25.778 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:20.920947+0000", 2024-02-10T08:38:25.778 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:38:25.778 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.778 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.778 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:38:25.778 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:20.920947+0000", 2024-02-10T08:38:25.778 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-02-10T08:38:25.778 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.778 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.778 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:38:25.778 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:20.920946+0000", 2024-02-10T08:38:25.778 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8548000000000003e-05 2024-02-10T08:38:25.778 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.778 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.778 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:38:25.779 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:20.921005+0000", 2024-02-10T08:38:25.779 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7760000000000003e-06 2024-02-10T08:38:25.779 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.779 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.779 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:38:25.779 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:20.921014+0000", 2024-02-10T08:38:25.779 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.668e-06 2024-02-10T08:38:25.779 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.779 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.779 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:38:25.779 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:20.921018+0000", 2024-02-10T08:38:25.779 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8315e-05 2024-02-10T08:38:25.779 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.779 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.779 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:38:25.779 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:20.921077+0000", 2024-02-10T08:38:25.780 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013002099999999999 2024-02-10T08:38:25.780 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.780 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.780 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:38:25.780 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:20.921207+0000", 2024-02-10T08:38:25.780 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000175179 2024-02-10T08:38:25.780 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.780 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.780 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2,6", 2024-02-10T08:38:25.780 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:20.921382+0000", 2024-02-10T08:38:25.780 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019199550000000001 2024-02-10T08:38:25.780 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.780 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.780 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:38:25.780 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:20.923302+0000", 2024-02-10T08:38:25.780 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0065104330000000004 2024-02-10T08:38:25.781 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.781 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.781 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:38:25.781 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:20.929812+0000", 2024-02-10T08:38:25.781 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084430852000000001 2024-02-10T08:38:25.781 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.781 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.781 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:38:25.781 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:21.014243+0000", 2024-02-10T08:38:25.781 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6907000000000003e-05 2024-02-10T08:38:25.781 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.781 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.781 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:38:25.781 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:21.014300+0000", 2024-02-10T08:38:25.781 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6678000000000003e-05 2024-02-10T08:38:25.781 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.782 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.782 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:38:25.782 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:21.014347+0000", 2024-02-10T08:38:25.782 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.093399322000000007 2024-02-10T08:38:25.782 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:38:25.782 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:38:25.782 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:38:25.782 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.782 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.782 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.25664.0:113332 11.4 11:2f7749f7:::benchmark_data_smithi018_166993_object113331:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e421)", 2024-02-10T08:38:25.782 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:38:20.928132+0000", 2024-02-10T08:38:25.782 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.0865830919999997, 2024-02-10T08:38:25.782 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.086784679000000003, 2024-02-10T08:38:25.782 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:38:25.782 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:38:25.782 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:38:25.783 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.25664", 2024-02-10T08:38:25.783 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/1087272222", 2024-02-10T08:38:25.783 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 113332 2024-02-10T08:38:25.783 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.783 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:38:25.783 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.783 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:38:25.783 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:20.928132+0000", 2024-02-10T08:38:25.783 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:38:25.783 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.783 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.783 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:38:25.783 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:20.928132+0000", 2024-02-10T08:38:25.783 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999976 2024-02-10T08:38:25.783 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.784 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.784 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:38:25.784 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:20.928129+0000", 2024-02-10T08:38:25.784 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011813500000000001 2024-02-10T08:38:25.784 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.784 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.784 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:38:25.784 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:20.928247+0000", 2024-02-10T08:38:25.784 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6177999999999999e-05 2024-02-10T08:38:25.784 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.784 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.784 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:38:25.784 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:20.928273+0000", 2024-02-10T08:38:25.785 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0919999999999997e-06 2024-02-10T08:38:25.785 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.785 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.785 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:38:25.785 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:20.928279+0000", 2024-02-10T08:38:25.785 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8376e-05 2024-02-10T08:38:25.785 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.785 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.785 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:38:25.785 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:20.928317+0000", 2024-02-10T08:38:25.785 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012416799999999999 2024-02-10T08:38:25.785 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.785 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.785 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:38:25.785 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:20.928441+0000", 2024-02-10T08:38:25.785 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000172549 2024-02-10T08:38:25.786 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.786 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.786 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2,6", 2024-02-10T08:38:25.786 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:20.928614+0000", 2024-02-10T08:38:25.786 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0024168150000000001 2024-02-10T08:38:25.786 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.786 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.786 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:38:25.786 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:20.931030+0000", 2024-02-10T08:38:25.786 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00082408500000000001 2024-02-10T08:38:25.786 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.786 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.786 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:38:25.786 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:20.931855+0000", 2024-02-10T08:38:25.786 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.082971818000000003 2024-02-10T08:38:25.787 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.787 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.787 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:38:25.787 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:21.014826+0000", 2024-02-10T08:38:25.787 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9153999999999997e-05 2024-02-10T08:38:25.787 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.787 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.787 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:38:25.787 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:21.014876+0000", 2024-02-10T08:38:25.787 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0742999999999999e-05 2024-02-10T08:38:25.787 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.787 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.787 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:38:25.787 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:21.014916+0000", 2024-02-10T08:38:25.787 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.086784679000000003 2024-02-10T08:38:25.788 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:38:25.788 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:38:25.788 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:38:25.788 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.788 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.788 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.25664.0:113333 11.4 11:27a26704:::benchmark_data_smithi018_166993_object113332:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e421)", 2024-02-10T08:38:25.788 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:38:20.929133+0000", 2024-02-10T08:38:25.788 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.0855815059999996, 2024-02-10T08:38:25.788 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.085891098999999999, 2024-02-10T08:38:25.788 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:38:25.788 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:38:25.788 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:38:25.788 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.25664", 2024-02-10T08:38:25.788 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/1087272222", 2024-02-10T08:38:25.789 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 113333 2024-02-10T08:38:25.789 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.789 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:38:25.789 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.789 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:38:25.789 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:20.929133+0000", 2024-02-10T08:38:25.789 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:38:25.789 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.789 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.789 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:38:25.789 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:20.929133+0000", 2024-02-10T08:38:25.789 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-02-10T08:38:25.789 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.789 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.789 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:38:25.789 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:20.929132+0000", 2024-02-10T08:38:25.790 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7349999999999997e-05 2024-02-10T08:38:25.790 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.790 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.790 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:38:25.790 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:20.929200+0000", 2024-02-10T08:38:25.790 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0389999999999993e-06 2024-02-10T08:38:25.790 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.790 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.790 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:38:25.790 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:20.929209+0000", 2024-02-10T08:38:25.790 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3590000000000001e-06 2024-02-10T08:38:25.790 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.790 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.790 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:38:25.790 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:20.929213+0000", 2024-02-10T08:38:25.790 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00062346500000000002 2024-02-10T08:38:25.791 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.791 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.791 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:38:25.791 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:20.929836+0000", 2024-02-10T08:38:25.791 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011563800000000001 2024-02-10T08:38:25.791 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.791 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.791 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:38:25.791 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:20.929952+0000", 2024-02-10T08:38:25.791 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015675899999999999 2024-02-10T08:38:25.791 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.791 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.791 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2,6", 2024-02-10T08:38:25.792 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:20.930109+0000", 2024-02-10T08:38:25.792 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001040397 2024-02-10T08:38:25.792 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.792 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.792 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:38:25.792 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:20.931149+0000", 2024-02-10T08:38:25.792 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00073836099999999999 2024-02-10T08:38:25.792 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.792 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.792 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:38:25.792 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:20.931888+0000", 2024-02-10T08:38:25.792 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.083063979999999996 2024-02-10T08:38:25.792 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.792 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.792 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:38:25.793 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:21.014952+0000", 2024-02-10T08:38:25.793 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9289000000000003e-05 2024-02-10T08:38:25.793 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.793 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.793 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-02-10T08:38:25.793 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:21.014991+0000", 2024-02-10T08:38:25.793 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3423000000000002e-05 2024-02-10T08:38:25.793 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:25.793 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:25.793 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:38:25.793 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:21.015024+0000", 2024-02-10T08:38:25.793 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.085891098999999999 2024-02-10T08:38:25.793 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:38:25.793 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:38:25.793 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:38:25.793 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:38:25.793 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:38:25.794 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-02-10T08:38:25.871 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:38:25.876 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:25.877 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:38:25.977 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:38:26.042 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:26.098 INFO:teuthology.orchestra.run.smithi018.stderr:set pool 3 pgp_num to 3 2024-02-10T08:38:26.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:25.121097+0000 mgr.y (mgr.14505) 813 : cluster [DBG] pgmap v996: 178 pgs: 1 active+clean+scrubbing+deep, 177 active+clean; 7.0 GiB data, 28 GiB used, 688 GiB / 715 GiB avail; 1.2 KiB/s rd, 76 MiB/s wr, 1.22k op/s 2024-02-10T08:38:26.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:38:25.427950+0000 mon.b (mon.1) 92 : audit [INF] from='client.? 172.21.15.18:0/3164222212' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "iscsi", "var": "pgp_num", "val": "3"}]: dispatch 2024-02-10T08:38:26.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:38:25.428516+0000 mon.a (mon.0) 1736 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "iscsi", "var": "pgp_num", "val": "3"}]: dispatch 2024-02-10T08:38:26.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:25.121097+0000 mgr.y (mgr.14505) 813 : cluster [DBG] pgmap v996: 178 pgs: 1 active+clean+scrubbing+deep, 177 active+clean; 7.0 GiB data, 28 GiB used, 688 GiB / 715 GiB avail; 1.2 KiB/s rd, 76 MiB/s wr, 1.22k op/s 2024-02-10T08:38:26.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:38:25.427950+0000 mon.b (mon.1) 92 : audit [INF] from='client.? 172.21.15.18:0/3164222212' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "iscsi", "var": "pgp_num", "val": "3"}]: dispatch 2024-02-10T08:38:26.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:38:25.428516+0000 mon.a (mon.0) 1736 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "iscsi", "var": "pgp_num", "val": "3"}]: dispatch 2024-02-10T08:38:26.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:25.121097+0000 mgr.y (mgr.14505) 813 : cluster [DBG] pgmap v996: 178 pgs: 1 active+clean+scrubbing+deep, 177 active+clean; 7.0 GiB data, 28 GiB used, 688 GiB / 715 GiB avail; 1.2 KiB/s rd, 76 MiB/s wr, 1.22k op/s 2024-02-10T08:38:26.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:38:25.427950+0000 mon.b (mon.1) 92 : audit [INF] from='client.? 172.21.15.18:0/3164222212' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "iscsi", "var": "pgp_num", "val": "3"}]: dispatch 2024-02-10T08:38:26.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:38:25.428516+0000 mon.a (mon.0) 1736 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "iscsi", "var": "pgp_num", "val": "3"}]: dispatch 2024-02-10T08:38:26.461 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd set nodeep-scrub 2024-02-10T08:38:26.479 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.4 dump_ops_in_flight 2024-02-10T08:38:26.545 INFO:tasks.radosbench.radosbench.0.smithi018.stdout: 89 16 118294 118278 83.0219 57.1875 0.00639222 0.0120398 2024-02-10T08:38:26.790 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:38:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:38:26] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:38:26.889 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:38:27.404 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:38:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:38:27] "GET /metrics HTTP/1.1" 200 176703 "" "Prometheus/2.33.4" 2024-02-10T08:38:27.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:38:26.089156+0000 mon.a (mon.0) 1737 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "iscsi", "var": "pgp_num", "val": "3"}]': finished 2024-02-10T08:38:27.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:26.089217+0000 mon.a (mon.0) 1738 : cluster [DBG] osdmap e424: 8 total, 8 up, 8 in 2024-02-10T08:38:27.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:38:26.089156+0000 mon.a (mon.0) 1737 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "iscsi", "var": "pgp_num", "val": "3"}]': finished 2024-02-10T08:38:27.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:26.089217+0000 mon.a (mon.0) 1738 : cluster [DBG] osdmap e424: 8 total, 8 up, 8 in 2024-02-10T08:38:27.435 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:38:27.447 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:27.447 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:38:27.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:38:26.089156+0000 mon.a (mon.0) 1737 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "iscsi", "var": "pgp_num", "val": "3"}]': finished 2024-02-10T08:38:27.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:26.089217+0000 mon.a (mon.0) 1738 : cluster [DBG] osdmap e424: 8 total, 8 up, 8 in 2024-02-10T08:38:27.545 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Total time run: 90.0255 2024-02-10T08:38:27.545 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Total writes made: 119122 2024-02-10T08:38:27.545 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Write size: 65536 2024-02-10T08:38:27.545 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Object size: 65536 2024-02-10T08:38:27.545 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Bandwidth (MB/sec): 82.7002 2024-02-10T08:38:27.545 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Stddev Bandwidth: 30.6445 2024-02-10T08:38:27.545 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Max bandwidth (MB/sec): 212.812 2024-02-10T08:38:27.545 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Min bandwidth (MB/sec): 48.25 2024-02-10T08:38:27.545 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Average IOPS: 1323 2024-02-10T08:38:27.546 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Stddev IOPS: 490.312 2024-02-10T08:38:27.546 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Max IOPS: 3405 2024-02-10T08:38:27.546 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Min IOPS: 772 2024-02-10T08:38:27.546 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Average Latency(s): 0.0120867 2024-02-10T08:38:27.546 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Stddev Latency(s): 0.0081428 2024-02-10T08:38:27.546 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Max latency(s): 0.268929 2024-02-10T08:38:27.546 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Min latency(s): 0.00122517 2024-02-10T08:38:27.548 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:38:27.549 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Cleaning up (deleting benchmark objects) 2024-02-10T08:38:27.610 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:27.879 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:38:27.882 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:27.882 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:38:27.984 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:38:28.039 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:28.182 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:38:28.184 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:27.121505+0000 mgr.y (mgr.14505) 814 : cluster [DBG] pgmap v998: 178 pgs: 1 active+clean+scrubbing+deep, 177 active+clean; 7.0 GiB data, 28 GiB used, 688 GiB / 715 GiB avail; 853 B/s rd, 52 MiB/s wr, 834 op/s 2024-02-10T08:38:28.185 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:28.185 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:38:28.286 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:38:28.323 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:27.121505+0000 mgr.y (mgr.14505) 814 : cluster [DBG] pgmap v998: 178 pgs: 1 active+clean+scrubbing+deep, 177 active+clean; 7.0 GiB data, 28 GiB used, 688 GiB / 715 GiB avail; 853 B/s rd, 52 MiB/s wr, 834 op/s 2024-02-10T08:38:28.324 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:27.121505+0000 mgr.y (mgr.14505) 814 : cluster [DBG] pgmap v998: 178 pgs: 1 active+clean+scrubbing+deep, 177 active+clean; 7.0 GiB data, 28 GiB used, 688 GiB / 715 GiB avail; 853 B/s rd, 52 MiB/s wr, 834 op/s 2024-02-10T08:38:28.332 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:28.492 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:38:28.501 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:28.502 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:38:28.545 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:38:28.603 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:38:28.664 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:28.878 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:38:28.883 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:28.884 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:38:28.985 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:38:29.043 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:29.182 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:38:29.188 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:29.189 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:38:29.289 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:38:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:38:29.290 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:38:29.291 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-02-10T08:38:29.291 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-02-10T08:38:29.291 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:29.291 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.25664.0:120818 11.c e424/398 11:37793fe3:::benchmark_data_smithi018_166993_object1693:head v 424'7582, mlcod=424'7580)", 2024-02-10T08:38:29.292 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:38:29.290002+0000", 2024-02-10T08:38:29.292 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0012251160000000001, 2024-02-10T08:38:29.292 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012451420000000001, 2024-02-10T08:38:29.292 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:38:29.292 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-02-10T08:38:29.292 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:38:29.292 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:29.292 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:38:29.292 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:29.290002+0000", 2024-02-10T08:38:29.292 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:38:29.292 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:29.292 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:29.292 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:38:29.293 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:29.290002+0000", 2024-02-10T08:38:29.293 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-02-10T08:38:29.293 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:29.293 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:29.293 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:38:29.293 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:29.290001+0000", 2024-02-10T08:38:29.293 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8499999999999996e-06 2024-02-10T08:38:29.293 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:29.293 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:29.293 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:38:29.293 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:29.290008+0000", 2024-02-10T08:38:29.293 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7240000000000004e-06 2024-02-10T08:38:29.293 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:29.293 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:29.294 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:38:29.294 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:29.290017+0000", 2024-02-10T08:38:29.294 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4400000000000002e-06 2024-02-10T08:38:29.294 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:29.294 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:29.294 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:38:29.294 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:29.290024+0000", 2024-02-10T08:38:29.294 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6604000000000003e-05 2024-02-10T08:38:29.294 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:29.294 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:29.294 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:38:29.294 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:29.290070+0000", 2024-02-10T08:38:29.294 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2050999999999999e-05 2024-02-10T08:38:29.294 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:29.294 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:29.295 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:38:29.295 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:29.290093+0000", 2024-02-10T08:38:29.295 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0855999999999999e-05 2024-02-10T08:38:29.295 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:38:29.295 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:38:29.295 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:38:29.295 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:29.295 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:29.295 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.25664.0:120802 11.e 11:7e8554e5:::benchmark_data_smithi018_166993_object1677:head [delete] snapc 0=[] ondisk+write+known_if_redirected e424)", 2024-02-10T08:38:29.295 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:38:29.274219+0000", 2024-02-10T08:38:29.295 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.017007893, 2024-02-10T08:38:29.295 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017074148000000001, 2024-02-10T08:38:29.295 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:38:29.295 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "waiting for sub ops", 2024-02-10T08:38:29.296 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:38:29.296 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.25664", 2024-02-10T08:38:29.296 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/1087272222", 2024-02-10T08:38:29.296 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 120802 2024-02-10T08:38:29.296 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:29.296 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:38:29.296 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:29.296 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:38:29.296 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:29.274219+0000", 2024-02-10T08:38:29.296 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:38:29.296 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:29.296 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:29.296 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:38:29.296 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:29.274219+0000", 2024-02-10T08:38:29.297 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999971 2024-02-10T08:38:29.297 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:29.297 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:29.297 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:38:29.297 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:29.274216+0000", 2024-02-10T08:38:29.297 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2128e-05 2024-02-10T08:38:29.297 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:29.297 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:29.297 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:38:29.297 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:29.274228+0000", 2024-02-10T08:38:29.297 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8768999999999999e-05 2024-02-10T08:38:29.297 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:29.297 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:29.297 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:38:29.298 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:29.274247+0000", 2024-02-10T08:38:29.298 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7010000000000002e-06 2024-02-10T08:38:29.298 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:29.298 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:29.298 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:38:29.298 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:29.274256+0000", 2024-02-10T08:38:29.298 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5971999999999998e-05 2024-02-10T08:38:29.298 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:29.298 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:29.298 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:38:29.298 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:29.274322+0000", 2024-02-10T08:38:29.298 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000139166 2024-02-10T08:38:29.298 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:29.298 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:29.298 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:38:29.299 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:29.274461+0000", 2024-02-10T08:38:29.299 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014307600000000001 2024-02-10T08:38:29.299 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:29.299 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:29.299 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1,7", 2024-02-10T08:38:29.299 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:29.274604+0000", 2024-02-10T08:38:29.299 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0051146610000000004 2024-02-10T08:38:29.299 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:29.299 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:29.299 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:38:29.299 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:29.279719+0000", 2024-02-10T08:38:29.299 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00030633599999999999 2024-02-10T08:38:29.299 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:29.299 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:29.300 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:38:29.300 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:29.280025+0000", 2024-02-10T08:38:29.300 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0058060020000000002 2024-02-10T08:38:29.300 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:38:29.300 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:38:29.300 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:38:29.300 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:29.300 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:29.300 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.25664.0:120810 11.e 11:7674f535:::benchmark_data_smithi018_166993_object1685:head [delete] snapc 0=[] ondisk+write+known_if_redirected e424)", 2024-02-10T08:38:29.300 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:38:29.277404+0000", 2024-02-10T08:38:29.300 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.013822371, 2024-02-10T08:38:29.300 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013990884, 2024-02-10T08:38:29.300 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:38:29.300 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "waiting for sub ops", 2024-02-10T08:38:29.300 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:38:29.301 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.25664", 2024-02-10T08:38:29.301 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/1087272222", 2024-02-10T08:38:29.301 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 120810 2024-02-10T08:38:29.301 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:29.301 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:38:29.301 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:29.301 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:38:29.301 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:29.277404+0000", 2024-02-10T08:38:29.301 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:38:29.301 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:29.301 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:29.301 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:38:29.301 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:29.277404+0000", 2024-02-10T08:38:29.301 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999981 2024-02-10T08:38:29.301 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:29.302 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:29.302 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:38:29.302 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:29.277402+0000", 2024-02-10T08:38:29.302 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.414e-06 2024-02-10T08:38:29.302 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:29.302 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:29.302 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:38:29.302 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:29.277412+0000", 2024-02-10T08:38:29.302 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2928999999999999e-05 2024-02-10T08:38:29.302 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:29.302 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:29.302 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:38:29.302 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:29.277425+0000", 2024-02-10T08:38:29.302 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6490000000000008e-06 2024-02-10T08:38:29.302 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:29.303 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:29.303 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:38:29.303 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:29.277432+0000", 2024-02-10T08:38:29.303 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0550000000000002e-05 2024-02-10T08:38:29.303 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:29.303 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:29.303 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:38:29.303 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:29.277483+0000", 2024-02-10T08:38:29.303 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000108637 2024-02-10T08:38:29.303 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:29.303 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:29.303 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:38:29.303 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:29.277591+0000", 2024-02-10T08:38:29.303 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000122237 2024-02-10T08:38:29.304 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:29.304 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:29.304 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1,7", 2024-02-10T08:38:29.304 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:29.277714+0000", 2024-02-10T08:38:29.304 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0021758659999999998 2024-02-10T08:38:29.304 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:29.304 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:29.304 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:38:29.304 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:29.279890+0000", 2024-02-10T08:38:29.304 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0024971889999999999 2024-02-10T08:38:29.304 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:29.304 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:29.304 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:38:29.304 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:29.282387+0000", 2024-02-10T08:38:29.305 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0049823799999999998 2024-02-10T08:38:29.305 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:38:29.305 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:38:29.305 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:38:29.305 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:29.305 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:29.305 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.25664.0:120815 11.e 11:73ab2f41:::benchmark_data_smithi018_166993_object1690:head [delete] snapc 0=[] ondisk+write+known_if_redirected e424)", 2024-02-10T08:38:29.305 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:38:29.283559+0000", 2024-02-10T08:38:29.305 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0076682, 2024-02-10T08:38:29.305 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0079055630000000009, 2024-02-10T08:38:29.305 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:38:29.305 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "waiting for sub ops", 2024-02-10T08:38:29.305 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:38:29.305 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.25664", 2024-02-10T08:38:29.305 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/1087272222", 2024-02-10T08:38:29.305 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 120815 2024-02-10T08:38:29.306 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:29.306 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:38:29.306 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:29.306 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:38:29.306 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:29.283559+0000", 2024-02-10T08:38:29.306 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:38:29.306 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:29.306 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:29.306 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:38:29.306 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:29.283559+0000", 2024-02-10T08:38:29.306 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999981 2024-02-10T08:38:29.306 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:29.306 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:29.306 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:38:29.306 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:29.283557+0000", 2024-02-10T08:38:29.307 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1650000000000006e-06 2024-02-10T08:38:29.307 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:29.307 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:29.307 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:38:29.307 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:29.283565+0000", 2024-02-10T08:38:29.307 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3917000000000001e-05 2024-02-10T08:38:29.307 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:29.307 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:29.307 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:38:29.307 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:29.283579+0000", 2024-02-10T08:38:29.307 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7959999999999998e-06 2024-02-10T08:38:29.307 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:29.307 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:29.307 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:38:29.308 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:29.283585+0000", 2024-02-10T08:38:29.308 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1211999999999997e-05 2024-02-10T08:38:29.308 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:29.308 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:29.308 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:38:29.308 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:29.283637+0000", 2024-02-10T08:38:29.308 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013019799999999999 2024-02-10T08:38:29.308 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:29.308 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:29.308 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:38:29.308 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:29.283767+0000", 2024-02-10T08:38:29.308 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014640700000000001 2024-02-10T08:38:29.308 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:29.308 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:29.309 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1,7", 2024-02-10T08:38:29.309 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:29.283913+0000", 2024-02-10T08:38:29.309 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002528555 2024-02-10T08:38:29.309 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:29.309 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:29.309 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:38:29.309 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:29.286442+0000", 2024-02-10T08:38:29.309 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028409759999999998 2024-02-10T08:38:29.309 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:38:29.309 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:38:29.309 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-02-10T08:38:29.309 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:38:29.289283+0000", 2024-02-10T08:38:29.309 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.005724257 2024-02-10T08:38:29.310 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:38:29.310 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:38:29.310 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:38:29.310 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:38:29.310 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-02-10T08:38:29.310 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 4 2024-02-10T08:38:29.310 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-02-10T08:38:29.365 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:29.556 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:38:29.586 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:38:29.634 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:38:29.647 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:38:29.649 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:29.650 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:38:29.668 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:38:29.705 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:38:29.738 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:38:29.750 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:38:29.767 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:38:29.804 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:38:29.812 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:29.820 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-10T08:38:29.820 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-10T08:38:29.820 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-10T08:38:29.820 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-10T08:38:29.821 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-10T08:38:29.821 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-10T08:38:29.821 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-10T08:38:29.821 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-10T08:38:30.047 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.4 dump_blocked_ops 2024-02-10T08:38:30.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:38:28.881561+0000 mgr.y (mgr.14505) 815 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:38:30.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:29.124131+0000 mgr.y (mgr.14505) 816 : cluster [DBG] pgmap v999: 178 pgs: 1 active+clean+scrubbing+deep, 177 active+clean; 7.2 GiB data, 28 GiB used, 687 GiB / 715 GiB avail; 1.6 KiB/s rd, 77 MiB/s wr, 1.30k op/s 2024-02-10T08:38:30.292 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:38:29.514942+0000 mon.b (mon.1) 93 : audit [DBG] from='client.? 172.21.15.18:0/158731249' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:38:30.464 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:38:30.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:38:28.881561+0000 mgr.y (mgr.14505) 815 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:38:30.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:29.124131+0000 mgr.y (mgr.14505) 816 : cluster [DBG] pgmap v999: 178 pgs: 1 active+clean+scrubbing+deep, 177 active+clean; 7.2 GiB data, 28 GiB used, 687 GiB / 715 GiB avail; 1.6 KiB/s rd, 77 MiB/s wr, 1.30k op/s 2024-02-10T08:38:30.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:38:29.514942+0000 mon.b (mon.1) 93 : audit [DBG] from='client.? 172.21.15.18:0/158731249' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:38:30.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:38:28.881561+0000 mgr.y (mgr.14505) 815 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:38:30.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:29.124131+0000 mgr.y (mgr.14505) 816 : cluster [DBG] pgmap v999: 178 pgs: 1 active+clean+scrubbing+deep, 177 active+clean; 7.2 GiB data, 28 GiB used, 687 GiB / 715 GiB avail; 1.6 KiB/s rd, 77 MiB/s wr, 1.30k op/s 2024-02-10T08:38:30.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:38:29.514942+0000 mon.b (mon.1) 93 : audit [DBG] from='client.? 172.21.15.18:0/158731249' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:38:31.181 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:38:31.184 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:31.184 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:38:31.285 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:38:31.329 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:31.409 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:38:31.418 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:31.419 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:38:31.520 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:38:31.577 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:32.049 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:38:32.060 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:32.061 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:38:32.162 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:38:32.198 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:32.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:31.005072+0000 mon.a (mon.0) 1739 : cluster [DBG] osdmap e425: 8 total, 8 up, 8 in 2024-02-10T08:38:32.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:31.125376+0000 mgr.y (mgr.14505) 817 : cluster [DBG] pgmap v1001: 178 pgs: 1 active+clean+scrubbing+deep, 177 active+clean; 7.2 GiB data, 28 GiB used, 687 GiB / 715 GiB avail; 870 B/s rd, 37 MiB/s wr, 678 op/s 2024-02-10T08:38:32.291 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:38:31.691514+0000 mon.a (mon.0) 1740 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:38:32.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:31.005072+0000 mon.a (mon.0) 1739 : cluster [DBG] osdmap e425: 8 total, 8 up, 8 in 2024-02-10T08:38:32.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:31.125376+0000 mgr.y (mgr.14505) 817 : cluster [DBG] pgmap v1001: 178 pgs: 1 active+clean+scrubbing+deep, 177 active+clean; 7.2 GiB data, 28 GiB used, 687 GiB / 715 GiB avail; 870 B/s rd, 37 MiB/s wr, 678 op/s 2024-02-10T08:38:32.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:38:31.691514+0000 mon.a (mon.0) 1740 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:38:32.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:31.005072+0000 mon.a (mon.0) 1739 : cluster [DBG] osdmap e425: 8 total, 8 up, 8 in 2024-02-10T08:38:32.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:31.125376+0000 mgr.y (mgr.14505) 817 : cluster [DBG] pgmap v1001: 178 pgs: 1 active+clean+scrubbing+deep, 177 active+clean; 7.2 GiB data, 28 GiB used, 687 GiB / 715 GiB avail; 870 B/s rd, 37 MiB/s wr, 678 op/s 2024-02-10T08:38:32.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:38:31.691514+0000 mon.a (mon.0) 1740 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:38:32.950 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 3, 4, 5, 6, 7, 0] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 5, 6, 7, 4] 2024-02-10T08:38:32.951 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-10T08:38:32.951 INFO:tasks.thrashosds.thrasher:Removing osd 7, in_osds are: [1, 2, 3, 4, 5, 6, 7, 0] 2024-02-10T08:38:32.951 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd out 7 2024-02-10T08:38:32.966 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:38:32.969 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:32.970 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:38:33.070 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:38:33.156 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:33.185 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:38:33.190 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:33.191 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:38:33.292 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:38:33.334 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:33.461 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:38:33.512 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:33.512 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:38:33.513 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:38:33.614 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:38:33.664 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:33.781 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:38:33.786 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:33.787 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:38:33.888 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:38:33.939 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-10T08:38:33.943 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:34.169 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-02-10T08:38:34.169 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:38:34.176 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:38:34.181 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:34.181 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:38:34.247 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is set 2024-02-10T08:38:34.283 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:38:34.329 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:33.132313+0000 mgr.y (mgr.14505) 818 : cluster [DBG] pgmap v1002: 178 pgs: 1 active+clean+scrubbing+deep, 177 active+clean; 7.0 GiB data, 28 GiB used, 688 GiB / 715 GiB avail; 1.4 KiB/s rd, 30 MiB/s wr, 1.05k op/s 2024-02-10T08:38:34.329 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:38:33.477614+0000 mon.b (mon.1) 94 : audit [INF] from='client.? 172.21.15.18:0/1216752115' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:38:34.329 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:38:33.478573+0000 mon.a (mon.0) 1741 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:38:34.331 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:33.132313+0000 mgr.y (mgr.14505) 818 : cluster [DBG] pgmap v1002: 178 pgs: 1 active+clean+scrubbing+deep, 177 active+clean; 7.0 GiB data, 28 GiB used, 688 GiB / 715 GiB avail; 1.4 KiB/s rd, 30 MiB/s wr, 1.05k op/s 2024-02-10T08:38:34.331 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:38:33.477614+0000 mon.b (mon.1) 94 : audit [INF] from='client.? 172.21.15.18:0/1216752115' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:38:34.331 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:38:33.478573+0000 mon.a (mon.0) 1741 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:38:34.332 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:34.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:33.132313+0000 mgr.y (mgr.14505) 818 : cluster [DBG] pgmap v1002: 178 pgs: 1 active+clean+scrubbing+deep, 177 active+clean; 7.0 GiB data, 28 GiB used, 688 GiB / 715 GiB avail; 1.4 KiB/s rd, 30 MiB/s wr, 1.05k op/s 2024-02-10T08:38:34.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:38:33.477614+0000 mon.b (mon.1) 94 : audit [INF] from='client.? 172.21.15.18:0/1216752115' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:38:34.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:38:33.478573+0000 mon.a (mon.0) 1741 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:38:35.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:34.194323+0000 mon.a (mon.0) 1742 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:38:35.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:38:34.213739+0000 mon.a (mon.0) 1743 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-10T08:38:35.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:34.213815+0000 mon.a (mon.0) 1744 : cluster [DBG] osdmap e426: 8 total, 8 up, 8 in 2024-02-10T08:38:35.649 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.4 dump_historic_ops 2024-02-10T08:38:35.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:34.194323+0000 mon.a (mon.0) 1742 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:38:35.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:38:34.213739+0000 mon.a (mon.0) 1743 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-10T08:38:35.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:34.213815+0000 mon.a (mon.0) 1744 : cluster [DBG] osdmap e426: 8 total, 8 up, 8 in 2024-02-10T08:38:35.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:34.194323+0000 mon.a (mon.0) 1742 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:38:35.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:38:34.213739+0000 mon.a (mon.0) 1743 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-10T08:38:35.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:34.213815+0000 mon.a (mon.0) 1744 : cluster [DBG] osdmap e426: 8 total, 8 up, 8 in 2024-02-10T08:38:36.053 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:38:36.509 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:35.132731+0000 mgr.y (mgr.14505) 819 : cluster [DBG] pgmap v1004: 178 pgs: 1 active+clean+scrubbing+deep, 177 active+clean; 6.9 GiB data, 27 GiB used, 688 GiB / 715 GiB avail; 1.4 KiB/s rd, 30 MiB/s wr, 1.16k op/s 2024-02-10T08:38:36.509 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:36.006634+0000 mon.a (mon.0) 1745 : cluster [DBG] osdmap e427: 8 total, 8 up, 8 in 2024-02-10T08:38:36.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:35.132731+0000 mgr.y (mgr.14505) 819 : cluster [DBG] pgmap v1004: 178 pgs: 1 active+clean+scrubbing+deep, 177 active+clean; 6.9 GiB data, 27 GiB used, 688 GiB / 715 GiB avail; 1.4 KiB/s rd, 30 MiB/s wr, 1.16k op/s 2024-02-10T08:38:36.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:36.006634+0000 mon.a (mon.0) 1745 : cluster [DBG] osdmap e427: 8 total, 8 up, 8 in 2024-02-10T08:38:36.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:35.132731+0000 mgr.y (mgr.14505) 819 : cluster [DBG] pgmap v1004: 178 pgs: 1 active+clean+scrubbing+deep, 177 active+clean; 6.9 GiB data, 27 GiB used, 688 GiB / 715 GiB avail; 1.4 KiB/s rd, 30 MiB/s wr, 1.16k op/s 2024-02-10T08:38:36.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:36.006634+0000 mon.a (mon.0) 1745 : cluster [DBG] osdmap e427: 8 total, 8 up, 8 in 2024-02-10T08:38:36.790 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:38:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:38:36] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:38:36.936 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:38:36.945 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:36.946 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:38:37.047 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:38:37.099 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:37.404 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:38:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:38:37] "GET /metrics HTTP/1.1" 200 176704 "" "Prometheus/2.33.4" 2024-02-10T08:38:37.504 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:38:37.514 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:37.515 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:38:37.616 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:38:37.667 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:37.797 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:38:37.805 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:37.806 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:38:37.906 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:38:37.958 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:38.094 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:38:38.097 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:38.098 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:38:38.149 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:38:38.199 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:38:38.267 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:38.458 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:38:38.469 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:38.470 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:38:38.490 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-02-10T08:38:38.490 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:38:38.497 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:37.133362+0000 mgr.y (mgr.14505) 820 : cluster [DBG] pgmap v1006: 178 pgs: 1 active+clean+scrubbing+deep, 177 active+clean; 6.9 GiB data, 27 GiB used, 688 GiB / 715 GiB avail; 835 B/s rd, 0 B/s wr, 790 op/s 2024-02-10T08:38:38.498 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:37.133362+0000 mgr.y (mgr.14505) 820 : cluster [DBG] pgmap v1006: 178 pgs: 1 active+clean+scrubbing+deep, 177 active+clean; 6.9 GiB data, 27 GiB used, 688 GiB / 715 GiB avail; 835 B/s rd, 0 B/s wr, 790 op/s 2024-02-10T08:38:38.510 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:37.133362+0000 mgr.y (mgr.14505) 820 : cluster [DBG] pgmap v1006: 178 pgs: 1 active+clean+scrubbing+deep, 177 active+clean; 6.9 GiB data, 27 GiB used, 688 GiB / 715 GiB avail; 835 B/s rd, 0 B/s wr, 790 op/s 2024-02-10T08:38:38.571 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:38:38.623 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:38.770 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:38:38.505+0000 7f97240ed700 -1 mon.a@0(leader).osd e427 definitely_dead 0 2024-02-10T08:38:39.260 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:38:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:38:39.273 INFO:teuthology.orchestra.run.smithi018.stderr:marked out osd.7. 2024-02-10T08:38:39.284 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.0 dump_ops_in_flight 2024-02-10T08:38:39.535 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd unset noscrub 2024-02-10T08:38:39.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:38:38.506324+0000 mon.b (mon.1) 95 : audit [INF] from='client.? 172.21.15.18:0/1891209821' entity='client.admin' cmd=[{"prefix": "osd out", "ids": ["7"]}]: dispatch 2024-02-10T08:38:39.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:38:38.506934+0000 mon.a (mon.0) 1746 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd out", "ids": ["7"]}]: dispatch 2024-02-10T08:38:39.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:38.507004+0000 mon.a (mon.0) 1747 : cluster [INF] Client client.admin marked osd.7 out, while it was still marked up 2024-02-10T08:38:39.562 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:38:38.506324+0000 mon.b (mon.1) 95 : audit [INF] from='client.? 172.21.15.18:0/1891209821' entity='client.admin' cmd=[{"prefix": "osd out", "ids": ["7"]}]: dispatch 2024-02-10T08:38:39.562 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:38:38.506934+0000 mon.a (mon.0) 1746 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd out", "ids": ["7"]}]: dispatch 2024-02-10T08:38:39.562 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:38.507004+0000 mon.a (mon.0) 1747 : cluster [INF] Client client.admin marked osd.7 out, while it was still marked up 2024-02-10T08:38:39.562 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:38:38.506324+0000 mon.b (mon.1) 95 : audit [INF] from='client.? 172.21.15.18:0/1891209821' entity='client.admin' cmd=[{"prefix": "osd out", "ids": ["7"]}]: dispatch 2024-02-10T08:38:39.562 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:38:38.506934+0000 mon.a (mon.0) 1746 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd out", "ids": ["7"]}]: dispatch 2024-02-10T08:38:39.562 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:38.507004+0000 mon.a (mon.0) 1747 : cluster [INF] Client client.admin marked osd.7 out, while it was still marked up 2024-02-10T08:38:40.093 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:38:40.095 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:40.096 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:38:40.197 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:38:40.227 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:40.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:38:38.894182+0000 mgr.y (mgr.14505) 821 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:38:40.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:39.134219+0000 mgr.y (mgr.14505) 822 : cluster [DBG] pgmap v1007: 178 pgs: 178 active+clean; 6.7 GiB data, 27 GiB used, 689 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.18k op/s 2024-02-10T08:38:40.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:38:39.240243+0000 mon.a (mon.0) 1748 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd out", "ids": ["7"]}]': finished 2024-02-10T08:38:40.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:39.240314+0000 mon.a (mon.0) 1749 : cluster [DBG] osdmap e428: 8 total, 8 up, 7 in 2024-02-10T08:38:40.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:40.241364+0000 mon.a (mon.0) 1750 : cluster [DBG] osdmap e429: 8 total, 8 up, 7 in 2024-02-10T08:38:40.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:38:38.894182+0000 mgr.y (mgr.14505) 821 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:38:40.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:39.134219+0000 mgr.y (mgr.14505) 822 : cluster [DBG] pgmap v1007: 178 pgs: 178 active+clean; 6.7 GiB data, 27 GiB used, 689 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.18k op/s 2024-02-10T08:38:40.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:38:39.240243+0000 mon.a (mon.0) 1748 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd out", "ids": ["7"]}]': finished 2024-02-10T08:38:40.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:39.240314+0000 mon.a (mon.0) 1749 : cluster [DBG] osdmap e428: 8 total, 8 up, 7 in 2024-02-10T08:38:40.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:40.241364+0000 mon.a (mon.0) 1750 : cluster [DBG] osdmap e429: 8 total, 8 up, 7 in 2024-02-10T08:38:40.445 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:38:40.448 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:40.448 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:38:40.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:38:38.894182+0000 mgr.y (mgr.14505) 821 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:38:40.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:39.134219+0000 mgr.y (mgr.14505) 822 : cluster [DBG] pgmap v1007: 178 pgs: 178 active+clean; 6.7 GiB data, 27 GiB used, 689 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.18k op/s 2024-02-10T08:38:40.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:38:39.240243+0000 mon.a (mon.0) 1748 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd out", "ids": ["7"]}]': finished 2024-02-10T08:38:40.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:39.240314+0000 mon.a (mon.0) 1749 : cluster [DBG] osdmap e428: 8 total, 8 up, 7 in 2024-02-10T08:38:40.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:40.241364+0000 mon.a (mon.0) 1750 : cluster [DBG] osdmap e429: 8 total, 8 up, 7 in 2024-02-10T08:38:40.549 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:38:40.584 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:40.611 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:38:40.614 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:40.614 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:38:40.715 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:38:40.745 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:41.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:41 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:40.384452+0000 osd.2 (osd.2) 265 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:38:41.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:41 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:40.384483+0000 osd.2 (osd.2) 266 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:38:41.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:41 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:41.241894+0000 mon.a (mon.0) 1751 : cluster [DBG] osdmap e430: 8 total, 8 up, 7 in 2024-02-10T08:38:41.653 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:40.384452+0000 osd.2 (osd.2) 265 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:38:41.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:40.384483+0000 osd.2 (osd.2) 266 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:38:41.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:41.241894+0000 mon.a (mon.0) 1751 : cluster [DBG] osdmap e430: 8 total, 8 up, 7 in 2024-02-10T08:38:41.659 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:40.384452+0000 osd.2 (osd.2) 265 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:38:41.659 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:40.384483+0000 osd.2 (osd.2) 266 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:38:41.659 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:41.241894+0000 mon.a (mon.0) 1751 : cluster [DBG] osdmap e430: 8 total, 8 up, 7 in 2024-02-10T08:38:42.005 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:38:42.016 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:42.016 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:38:42.118 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:38:42.182 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:42.247 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:38:42.254 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:42.254 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:38:42.355 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:38:42.427 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:42.482 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:38:42.487 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:41.134592+0000 mgr.y (mgr.14505) 823 : cluster [DBG] pgmap v1010: 178 pgs: 11 peering, 167 active+clean; 6.6 GiB data, 23 GiB used, 603 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 824 op/s 2024-02-10T08:38:42.487 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:41.240852+0000 osd.5 (osd.5) 285 : cluster [DBG] 11.5 starting backfill to osd.3 from (0'0,0'0] MAX to 427'8024 2024-02-10T08:38:42.487 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:41.243307+0000 osd.6 (osd.6) 278 : cluster [DBG] 11.4 starting backfill to osd.1 from (0'0,0'0] MAX to 427'8230 2024-02-10T08:38:42.487 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:41.243850+0000 osd.1 (osd.1) 306 : cluster [DBG] 11.f starting backfill to osd.0 from (0'0,0'0] MAX to 427'8133 2024-02-10T08:38:42.487 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:41.244018+0000 osd.1 (osd.1) 307 : cluster [DBG] 11.0 starting backfill to osd.6 from (0'0,0'0] MAX to 427'8223 2024-02-10T08:38:42.487 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:41.244075+0000 osd.6 (osd.6) 279 : cluster [DBG] 11.3 starting backfill to osd.5 from (0'0,0'0] MAX to 427'8147 2024-02-10T08:38:42.487 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:41.249582+0000 osd.4 (osd.4) 212 : cluster [DBG] 11.e starting backfill to osd.0 from (0'0,0'0] MAX to 427'8121 2024-02-10T08:38:42.487 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:42.016645+0000 mon.a (mon.0) 1752 : cluster [WRN] Health check failed: Reduced data availability: 6 pgs inactive, 6 pgs peering (PG_AVAILABILITY) 2024-02-10T08:38:42.488 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:42.488 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:38:42.589 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:38:42.646 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:41.134592+0000 mgr.y (mgr.14505) 823 : cluster [DBG] pgmap v1010: 178 pgs: 11 peering, 167 active+clean; 6.6 GiB data, 23 GiB used, 603 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 824 op/s 2024-02-10T08:38:42.647 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:41.240852+0000 osd.5 (osd.5) 285 : cluster [DBG] 11.5 starting backfill to osd.3 from (0'0,0'0] MAX to 427'8024 2024-02-10T08:38:42.647 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:41.243307+0000 osd.6 (osd.6) 278 : cluster [DBG] 11.4 starting backfill to osd.1 from (0'0,0'0] MAX to 427'8230 2024-02-10T08:38:42.647 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:41.243850+0000 osd.1 (osd.1) 306 : cluster [DBG] 11.f starting backfill to osd.0 from (0'0,0'0] MAX to 427'8133 2024-02-10T08:38:42.647 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:41.244018+0000 osd.1 (osd.1) 307 : cluster [DBG] 11.0 starting backfill to osd.6 from (0'0,0'0] MAX to 427'8223 2024-02-10T08:38:42.647 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:41.244075+0000 osd.6 (osd.6) 279 : cluster [DBG] 11.3 starting backfill to osd.5 from (0'0,0'0] MAX to 427'8147 2024-02-10T08:38:42.647 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:41.249582+0000 osd.4 (osd.4) 212 : cluster [DBG] 11.e starting backfill to osd.0 from (0'0,0'0] MAX to 427'8121 2024-02-10T08:38:42.647 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:42.016645+0000 mon.a (mon.0) 1752 : cluster [WRN] Health check failed: Reduced data availability: 6 pgs inactive, 6 pgs peering (PG_AVAILABILITY) 2024-02-10T08:38:42.648 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:41.134592+0000 mgr.y (mgr.14505) 823 : cluster [DBG] pgmap v1010: 178 pgs: 11 peering, 167 active+clean; 6.6 GiB data, 23 GiB used, 603 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 824 op/s 2024-02-10T08:38:42.648 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:41.240852+0000 osd.5 (osd.5) 285 : cluster [DBG] 11.5 starting backfill to osd.3 from (0'0,0'0] MAX to 427'8024 2024-02-10T08:38:42.648 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:41.243307+0000 osd.6 (osd.6) 278 : cluster [DBG] 11.4 starting backfill to osd.1 from (0'0,0'0] MAX to 427'8230 2024-02-10T08:38:42.648 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:41.243850+0000 osd.1 (osd.1) 306 : cluster [DBG] 11.f starting backfill to osd.0 from (0'0,0'0] MAX to 427'8133 2024-02-10T08:38:42.648 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:41.244018+0000 osd.1 (osd.1) 307 : cluster [DBG] 11.0 starting backfill to osd.6 from (0'0,0'0] MAX to 427'8223 2024-02-10T08:38:42.648 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:41.244075+0000 osd.6 (osd.6) 279 : cluster [DBG] 11.3 starting backfill to osd.5 from (0'0,0'0] MAX to 427'8147 2024-02-10T08:38:42.648 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:41.249582+0000 osd.4 (osd.4) 212 : cluster [DBG] 11.e starting backfill to osd.0 from (0'0,0'0] MAX to 427'8121 2024-02-10T08:38:42.648 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:42.016645+0000 mon.a (mon.0) 1752 : cluster [WRN] Health check failed: Reduced data availability: 6 pgs inactive, 6 pgs peering (PG_AVAILABILITY) 2024-02-10T08:38:42.651 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:42.662 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:38:42.662 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:38:42.683 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:38:42.688 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:42.689 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:38:42.721 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:38:42.753 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:38:42.771 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:38:42.788 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:38:42.789 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:38:42.827 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:42.831 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:38:42.865 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:38:42.876 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:38:42.880 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:42.880 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:38:42.935 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:38:42.977 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:38:42.979 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-10T08:38:42.979 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-10T08:38:42.979 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-10T08:38:42.979 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-10T08:38:42.979 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-10T08:38:42.979 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-10T08:38:42.980 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-10T08:38:42.980 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-10T08:38:42.981 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:38:43.017 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:43.047 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:38:43.053 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:43.053 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:38:43.154 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:38:43.228 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:43.338 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:38:43.346 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:43.346 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:38:43.447 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:38:43.490 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:38:42.683356+0000 mon.a (mon.0) 1753 : audit [DBG] from='client.? 172.21.15.18:0/3165546821' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:38:43.490 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:38:42.683356+0000 mon.a (mon.0) 1753 : audit [DBG] from='client.? 172.21.15.18:0/3165546821' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:38:43.511 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:43.598 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:38:43.605 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:43.605 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:38:43.706 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:38:43.784 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:43.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:43 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:38:42.683356+0000 mon.a (mon.0) 1753 : audit [DBG] from='client.? 172.21.15.18:0/3165546821' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:38:44.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:43.135455+0000 mgr.y (mgr.14505) 824 : cluster [DBG] pgmap v1012: 178 pgs: 5 active+remapped+backfilling, 11 peering, 162 active+clean; 6.5 GiB data, 23 GiB used, 603 GiB / 626 GiB avail; 170 B/s rd, 170 B/s wr, 1.15k op/s; 32856/320931 objects misplaced (10.238%); 4.2 MiB/s, 75 objects/s recovering 2024-02-10T08:38:44.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:43.135455+0000 mgr.y (mgr.14505) 824 : cluster [DBG] pgmap v1012: 178 pgs: 5 active+remapped+backfilling, 11 peering, 162 active+clean; 6.5 GiB data, 23 GiB used, 603 GiB / 626 GiB avail; 170 B/s rd, 170 B/s wr, 1.15k op/s; 32856/320931 objects misplaced (10.238%); 4.2 MiB/s, 75 objects/s recovering 2024-02-10T08:38:44.795 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:44 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:43.135455+0000 mgr.y (mgr.14505) 824 : cluster [DBG] pgmap v1012: 178 pgs: 5 active+remapped+backfilling, 11 peering, 162 active+clean; 6.5 GiB data, 23 GiB used, 603 GiB / 626 GiB avail; 170 B/s rd, 170 B/s wr, 1.15k op/s; 32856/320931 objects misplaced (10.238%); 4.2 MiB/s, 75 objects/s recovering 2024-02-10T08:38:45.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:45.295445+0000 mon.a (mon.0) 1754 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 6 pgs inactive, 6 pgs peering) 2024-02-10T08:38:45.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:45.295445+0000 mon.a (mon.0) 1754 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 6 pgs inactive, 6 pgs peering) 2024-02-10T08:38:45.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:45.295445+0000 mon.a (mon.0) 1754 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 6 pgs inactive, 6 pgs peering) 2024-02-10T08:38:45.954 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:38:45.959 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:45.959 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:38:46.060 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:38:46.117 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:46.166 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:38:46.170 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:46.170 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:38:46.271 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:38:46.346 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:46.520 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:45.136411+0000 mgr.y (mgr.14505) 825 : cluster [DBG] pgmap v1013: 178 pgs: 6 active+remapped+backfilling, 172 active+clean; 6.5 GiB data, 23 GiB used, 603 GiB / 626 GiB avail; 170 B/s wr, 447 op/s; 39265/319632 objects misplaced (12.284%); 4.6 MiB/s, 85 objects/s recovering 2024-02-10T08:38:46.520 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:46.015379+0000 mon.a (mon.0) 1755 : cluster [DBG] osdmap e431: 8 total, 8 up, 7 in 2024-02-10T08:38:46.520 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:38:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:38:46] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:38:46.561 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:38:46.568 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:45.136411+0000 mgr.y (mgr.14505) 825 : cluster [DBG] pgmap v1013: 178 pgs: 6 active+remapped+backfilling, 172 active+clean; 6.5 GiB data, 23 GiB used, 603 GiB / 626 GiB avail; 170 B/s wr, 447 op/s; 39265/319632 objects misplaced (12.284%); 4.6 MiB/s, 85 objects/s recovering 2024-02-10T08:38:46.568 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:46.015379+0000 mon.a (mon.0) 1755 : cluster [DBG] osdmap e431: 8 total, 8 up, 7 in 2024-02-10T08:38:46.568 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:45.136411+0000 mgr.y (mgr.14505) 825 : cluster [DBG] pgmap v1013: 178 pgs: 6 active+remapped+backfilling, 172 active+clean; 6.5 GiB data, 23 GiB used, 603 GiB / 626 GiB avail; 170 B/s wr, 447 op/s; 39265/319632 objects misplaced (12.284%); 4.6 MiB/s, 85 objects/s recovering 2024-02-10T08:38:46.569 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:46.015379+0000 mon.a (mon.0) 1755 : cluster [DBG] osdmap e431: 8 total, 8 up, 7 in 2024-02-10T08:38:46.569 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:46.569 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:38:46.670 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:38:46.763 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:46.991 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:38:46.998 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:46.998 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:38:47.043 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 3, 4, 5, 6, 0] out_osds: [7] dead_osds: [] live_osds: [0, 1, 2, 3, 5, 6, 7, 4] 2024-02-10T08:38:47.043 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-10T08:38:47.043 INFO:tasks.thrashosds.thrasher:Killing osd 7, live_osds are [0, 1, 2, 3, 5, 6, 7, 4] 2024-02-10T08:38:47.043 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-02-10T08:38:47.043 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ceph-d46257c8-c7eb-11ee-95b8-87774f69a715@osd.7 2024-02-10T08:38:47.099 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:38:47.135 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:47.180 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:38:47.184 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:47.185 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:38:47.286 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:38:47.340 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:38:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:38:47] "GET /metrics HTTP/1.1" 200 176734 "" "Prometheus/2.33.4" 2024-02-10T08:38:47.342 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:47.388 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:38:47 smithi071 systemd[1]: Stopping Ceph osd.7 for d46257c8-c7eb-11ee-95b8-87774f69a715... 2024-02-10T08:38:47.388 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:38:47 smithi071 bash[122407]: Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:38:47.398 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:45.635863+0000 osd.1 (osd.1) 308 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:38:47.398 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:45.635902+0000 osd.1 (osd.1) 309 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:38:47.398 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:38:47.088001+0000 mon.c (mon.2) 98 : audit [INF] from='client.? 172.21.15.18:0/3318931192' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:38:47.399 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:38:47.088569+0000 mon.a (mon.0) 1756 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:38:47.402 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is unset 2024-02-10T08:38:47.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:45.635863+0000 osd.1 (osd.1) 308 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:38:47.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:45.635902+0000 osd.1 (osd.1) 309 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:38:47.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:38:47.088001+0000 mon.c (mon.2) 98 : audit [INF] from='client.? 172.21.15.18:0/3318931192' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:38:47.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:38:47.088569+0000 mon.a (mon.0) 1756 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:38:47.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:45.635863+0000 osd.1 (osd.1) 308 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:38:47.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:45.635902+0000 osd.1 (osd.1) 309 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:38:47.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:38:47.088001+0000 mon.c (mon.2) 98 : audit [INF] from='client.? 172.21.15.18:0/3318931192' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:38:47.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:38:47.088569+0000 mon.a (mon.0) 1756 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:38:47.677 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:38:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[58460]: debug 2024-02-10T08:38:47.674+0000 7f8aa5cfe700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-10T08:38:47.677 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:38:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[58460]: debug 2024-02-10T08:38:47.674+0000 7f8aa5cfe700 -1 osd.7 432 *** Got signal Terminated *** 2024-02-10T08:38:47.677 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:38:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[58460]: debug 2024-02-10T08:38:47.674+0000 7f8aa5cfe700 -1 osd.7 432 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-10T08:38:47.949 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-10T08:38:48.119 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:38:48.125 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:48.126 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:38:48.227 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:38:48.272 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:48.303 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:38:48.326 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:48.327 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:38:48.427 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:38:48.468 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:48.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:47.136831+0000 mgr.y (mgr.14505) 826 : cluster [DBG] pgmap v1015: 178 pgs: 6 active+remapped+backfilling, 172 active+clean; 6.5 GiB data, 23 GiB used, 603 GiB / 626 GiB avail; 148 B/s wr, 343 op/s; 39265/319632 objects misplaced (12.284%); 4.0 MiB/s, 74 objects/s recovering 2024-02-10T08:38:48.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:47.351818+0000 mon.a (mon.0) 1757 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:38:48.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:38:47.391009+0000 mon.a (mon.0) 1758 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-10T08:38:48.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:47.391090+0000 mon.a (mon.0) 1759 : cluster [DBG] osdmap e432: 8 total, 8 up, 7 in 2024-02-10T08:38:48.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:47.686635+0000 mon.a (mon.0) 1760 : cluster [INF] osd.7 marked itself down and dead 2024-02-10T08:38:48.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:47.136831+0000 mgr.y (mgr.14505) 826 : cluster [DBG] pgmap v1015: 178 pgs: 6 active+remapped+backfilling, 172 active+clean; 6.5 GiB data, 23 GiB used, 603 GiB / 626 GiB avail; 148 B/s wr, 343 op/s; 39265/319632 objects misplaced (12.284%); 4.0 MiB/s, 74 objects/s recovering 2024-02-10T08:38:48.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:47.351818+0000 mon.a (mon.0) 1757 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:38:48.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:38:47.391009+0000 mon.a (mon.0) 1758 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-10T08:38:48.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:47.391090+0000 mon.a (mon.0) 1759 : cluster [DBG] osdmap e432: 8 total, 8 up, 7 in 2024-02-10T08:38:48.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:47.686635+0000 mon.a (mon.0) 1760 : cluster [INF] osd.7 marked itself down and dead 2024-02-10T08:38:48.635 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:47.136831+0000 mgr.y (mgr.14505) 826 : cluster [DBG] pgmap v1015: 178 pgs: 6 active+remapped+backfilling, 172 active+clean; 6.5 GiB data, 23 GiB used, 603 GiB / 626 GiB avail; 148 B/s wr, 343 op/s; 39265/319632 objects misplaced (12.284%); 4.0 MiB/s, 74 objects/s recovering 2024-02-10T08:38:48.635 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:47.351818+0000 mon.a (mon.0) 1757 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:38:48.636 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:38:47.391009+0000 mon.a (mon.0) 1758 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-10T08:38:48.636 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:47.391090+0000 mon.a (mon.0) 1759 : cluster [DBG] osdmap e432: 8 total, 8 up, 7 in 2024-02-10T08:38:48.636 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:47.686635+0000 mon.a (mon.0) 1760 : cluster [INF] osd.7 marked itself down and dead 2024-02-10T08:38:48.667 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:38:48.670 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:48.670 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:38:48.771 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:38:48.799 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:48.897 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:38:48.900 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:48.900 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:38:49.001 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:38:49.030 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:49.164 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-02-10T08:38:49.164 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-02-10T08:38:49.164 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-02-10T08:38:49.165 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-02-10T08:38:49.194 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:38:49.289 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:38:49 smithi071 bash[122439]: ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7 2024-02-10T08:38:49.289 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:38:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:38:49.304 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:38:49.307 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:49.307 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:38:49.408 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:38:49.449 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:48.415743+0000 mon.a (mon.0) 1761 : cluster [DBG] osdmap e433: 8 total, 7 up, 7 in 2024-02-10T08:38:49.450 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:48.415743+0000 mon.a (mon.0) 1761 : cluster [DBG] osdmap e433: 8 total, 7 up, 7 in 2024-02-10T08:38:49.453 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:49.497 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:38:49.508 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:49.508 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:38:49.609 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:38:49.661 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:49.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:49 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:48.415743+0000 mon.a (mon.0) 1761 : cluster [DBG] osdmap e433: 8 total, 7 up, 7 in 2024-02-10T08:38:49.831 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:38:49.836 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:49.837 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:38:49.938 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:38:49.992 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:50.033 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:38:50.042 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:50.043 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:38:50.144 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:38:50.226 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:50.267 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:38:50.278 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:50.279 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:38:50.379 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:38:50.450 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:50.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:48.713897+0000 osd.0 (osd.0) 276 : cluster [DBG] 4.1e scrub starts 2024-02-10T08:38:50.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:48.717365+0000 osd.0 (osd.0) 277 : cluster [DBG] 4.1e scrub ok 2024-02-10T08:38:50.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:48.848029+0000 osd.2 (osd.2) 267 : cluster [DBG] 5.14 scrub starts 2024-02-10T08:38:50.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:48.849435+0000 osd.2 (osd.2) 268 : cluster [DBG] 5.14 scrub ok 2024-02-10T08:38:50.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:38:48.906223+0000 mgr.y (mgr.14505) 827 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:38:50.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:49.137325+0000 mgr.y (mgr.14505) 828 : cluster [DBG] pgmap v1018: 178 pgs: 6 active+remapped+backfilling, 172 active+clean; 6.2 GiB data, 22 GiB used, 604 GiB / 626 GiB avail; 682 B/s rd, 0 B/s wr, 749 op/s; 36856/307443 objects misplaced (11.988%); 12 MiB/s, 190 objects/s recovering 2024-02-10T08:38:50.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:49.283306+0000 osd.6 (osd.6) 280 : cluster [DBG] 4.11 scrub starts 2024-02-10T08:38:50.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:49.285058+0000 osd.6 (osd.6) 281 : cluster [DBG] 4.11 scrub ok 2024-02-10T08:38:50.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:49.396708+0000 osd.1 (osd.1) 310 : cluster [DBG] 4.17 scrub starts 2024-02-10T08:38:50.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:49.400178+0000 osd.1 (osd.1) 311 : cluster [DBG] 4.17 scrub ok 2024-02-10T08:38:50.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:49.420103+0000 mon.a (mon.0) 1762 : cluster [DBG] osdmap e434: 8 total, 7 up, 7 in 2024-02-10T08:38:50.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:49.420571+0000 osd.1 (osd.1) 312 : cluster [INF] 11.0 continuing backfill to osd.6 from (412'4952,432'8590] 11:002bb98c:::benchmark_data_smithi018_166993_object56789:head to 432'8590 2024-02-10T08:38:50.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:49.421424+0000 osd.1 (osd.1) 313 : cluster [INF] 11.f continuing backfill to osd.0 from (412'4862,432'8514] 11:f030ac06:::benchmark_data_smithi018_166993_object117358:head to 432'8514 2024-02-10T08:38:50.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:49.421524+0000 osd.4 (osd.4) 213 : cluster [INF] 11.e continuing backfill to osd.0 from (407'4255,432'8489] 11:703752ff:::benchmark_data_smithi018_166993_object73330:head to 432'8489 2024-02-10T08:38:50.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:49.423292+0000 osd.5 (osd.5) 286 : cluster [INF] 11.5 continuing backfill to osd.3 from (407'4224,432'8388] 11:a03fa113:::benchmark_data_smithi018_166993_object113118:head to 432'8388 2024-02-10T08:38:50.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:49.424992+0000 osd.6 (osd.6) 282 : cluster [INF] 11.4 continuing backfill to osd.1 from (409'4684,432'8561] 11:202e88f4:::benchmark_data_smithi018_166993_object70459:head to 432'8561 2024-02-10T08:38:50.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:49.427397+0000 osd.6 (osd.6) 283 : cluster [INF] 11.3 continuing backfill to osd.5 from (408'4601,432'8484] 11:c32ad3f2:::benchmark_data_smithi018_166993_object112699:head to 432'8484 2024-02-10T08:38:50.564 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:38:50.576 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:50.577 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:38:50.593 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.0 dump_blocked_ops 2024-02-10T08:38:50.654 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd unset nodeep-scrub 2024-02-10T08:38:50.678 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:38:50.686 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:48.713897+0000 osd.0 (osd.0) 276 : cluster [DBG] 4.1e scrub starts 2024-02-10T08:38:50.686 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:48.717365+0000 osd.0 (osd.0) 277 : cluster [DBG] 4.1e scrub ok 2024-02-10T08:38:50.686 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:48.848029+0000 osd.2 (osd.2) 267 : cluster [DBG] 5.14 scrub starts 2024-02-10T08:38:50.686 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:48.849435+0000 osd.2 (osd.2) 268 : cluster [DBG] 5.14 scrub ok 2024-02-10T08:38:50.686 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:38:48.906223+0000 mgr.y (mgr.14505) 827 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:38:50.686 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:49.137325+0000 mgr.y (mgr.14505) 828 : cluster [DBG] pgmap v1018: 178 pgs: 6 active+remapped+backfilling, 172 active+clean; 6.2 GiB data, 22 GiB used, 604 GiB / 626 GiB avail; 682 B/s rd, 0 B/s wr, 749 op/s; 36856/307443 objects misplaced (11.988%); 12 MiB/s, 190 objects/s recovering 2024-02-10T08:38:50.686 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:49.283306+0000 osd.6 (osd.6) 280 : cluster [DBG] 4.11 scrub starts 2024-02-10T08:38:50.686 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:49.285058+0000 osd.6 (osd.6) 281 : cluster [DBG] 4.11 scrub ok 2024-02-10T08:38:50.686 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:49.396708+0000 osd.1 (osd.1) 310 : cluster [DBG] 4.17 scrub starts 2024-02-10T08:38:50.686 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:49.400178+0000 osd.1 (osd.1) 311 : cluster [DBG] 4.17 scrub ok 2024-02-10T08:38:50.686 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:49.420103+0000 mon.a (mon.0) 1762 : cluster [DBG] osdmap e434: 8 total, 7 up, 7 in 2024-02-10T08:38:50.687 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:49.420571+0000 osd.1 (osd.1) 312 : cluster [INF] 11.0 continuing backfill to osd.6 from (412'4952,432'8590] 11:002bb98c:::benchmark_data_smithi018_166993_object56789:head to 432'8590 2024-02-10T08:38:50.687 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:49.421424+0000 osd.1 (osd.1) 313 : cluster [INF] 11.f continuing backfill to osd.0 from (412'4862,432'8514] 11:f030ac06:::benchmark_data_smithi018_166993_object117358:head to 432'8514 2024-02-10T08:38:50.687 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:49.421524+0000 osd.4 (osd.4) 213 : cluster [INF] 11.e continuing backfill to osd.0 from (407'4255,432'8489] 11:703752ff:::benchmark_data_smithi018_166993_object73330:head to 432'8489 2024-02-10T08:38:50.687 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:49.423292+0000 osd.5 (osd.5) 286 : cluster [INF] 11.5 continuing backfill to osd.3 from (407'4224,432'8388] 11:a03fa113:::benchmark_data_smithi018_166993_object113118:head to 432'8388 2024-02-10T08:38:50.687 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:49.424992+0000 osd.6 (osd.6) 282 : cluster [INF] 11.4 continuing backfill to osd.1 from (409'4684,432'8561] 11:202e88f4:::benchmark_data_smithi018_166993_object70459:head to 432'8561 2024-02-10T08:38:50.687 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:49.427397+0000 osd.6 (osd.6) 283 : cluster [INF] 11.3 continuing backfill to osd.5 from (408'4601,432'8484] 11:c32ad3f2:::benchmark_data_smithi018_166993_object112699:head to 432'8484 2024-02-10T08:38:50.687 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:48.713897+0000 osd.0 (osd.0) 276 : cluster [DBG] 4.1e scrub starts 2024-02-10T08:38:50.687 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:48.717365+0000 osd.0 (osd.0) 277 : cluster [DBG] 4.1e scrub ok 2024-02-10T08:38:50.687 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:48.848029+0000 osd.2 (osd.2) 267 : cluster [DBG] 5.14 scrub starts 2024-02-10T08:38:50.687 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:48.849435+0000 osd.2 (osd.2) 268 : cluster [DBG] 5.14 scrub ok 2024-02-10T08:38:50.687 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:38:48.906223+0000 mgr.y (mgr.14505) 827 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:38:50.688 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:49.137325+0000 mgr.y (mgr.14505) 828 : cluster [DBG] pgmap v1018: 178 pgs: 6 active+remapped+backfilling, 172 active+clean; 6.2 GiB data, 22 GiB used, 604 GiB / 626 GiB avail; 682 B/s rd, 0 B/s wr, 749 op/s; 36856/307443 objects misplaced (11.988%); 12 MiB/s, 190 objects/s recovering 2024-02-10T08:38:50.688 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:49.283306+0000 osd.6 (osd.6) 280 : cluster [DBG] 4.11 scrub starts 2024-02-10T08:38:50.688 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:49.285058+0000 osd.6 (osd.6) 281 : cluster [DBG] 4.11 scrub ok 2024-02-10T08:38:50.688 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:49.396708+0000 osd.1 (osd.1) 310 : cluster [DBG] 4.17 scrub starts 2024-02-10T08:38:50.688 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:49.400178+0000 osd.1 (osd.1) 311 : cluster [DBG] 4.17 scrub ok 2024-02-10T08:38:50.688 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:49.420103+0000 mon.a (mon.0) 1762 : cluster [DBG] osdmap e434: 8 total, 7 up, 7 in 2024-02-10T08:38:50.688 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:49.420571+0000 osd.1 (osd.1) 312 : cluster [INF] 11.0 continuing backfill to osd.6 from (412'4952,432'8590] 11:002bb98c:::benchmark_data_smithi018_166993_object56789:head to 432'8590 2024-02-10T08:38:50.688 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:49.421424+0000 osd.1 (osd.1) 313 : cluster [INF] 11.f continuing backfill to osd.0 from (412'4862,432'8514] 11:f030ac06:::benchmark_data_smithi018_166993_object117358:head to 432'8514 2024-02-10T08:38:50.688 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:49.421524+0000 osd.4 (osd.4) 213 : cluster [INF] 11.e continuing backfill to osd.0 from (407'4255,432'8489] 11:703752ff:::benchmark_data_smithi018_166993_object73330:head to 432'8489 2024-02-10T08:38:50.688 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:49.423292+0000 osd.5 (osd.5) 286 : cluster [INF] 11.5 continuing backfill to osd.3 from (407'4224,432'8388] 11:a03fa113:::benchmark_data_smithi018_166993_object113118:head to 432'8388 2024-02-10T08:38:50.688 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:49.424992+0000 osd.6 (osd.6) 282 : cluster [INF] 11.4 continuing backfill to osd.1 from (409'4684,432'8561] 11:202e88f4:::benchmark_data_smithi018_166993_object70459:head to 432'8561 2024-02-10T08:38:50.688 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:49.427397+0000 osd.6 (osd.6) 283 : cluster [INF] 11.3 continuing backfill to osd.5 from (408'4601,432'8484] 11:c32ad3f2:::benchmark_data_smithi018_166993_object112699:head to 432'8484 2024-02-10T08:38:50.753 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:51.113 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:38:51.117 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:51.117 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:38:51.218 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:38:51.259 DEBUG:teuthology.orchestra.run.smithi071:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d46257c8-c7eb-11ee-95b8-87774f69a715@osd.7.service' 2024-02-10T08:38:51.267 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:51.322 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-10T08:38:51.322 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-02-10T08:38:51.322 INFO:tasks.thrashosds.thrasher:Testing ceph-objectstore-tool on down osd.7 2024-02-10T08:38:51.323 INFO:tasks.thrashosds.thrasher:remote for osd 7 is ubuntu@smithi071.front.sepia.ceph.com 2024-02-10T08:38:51.323 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -n osd.7 --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph-objectstore-tool --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-7 --journal-path /var/lib/ceph/osd/ceph-7/journal --op list-pgs 2024-02-10T08:38:51.758 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/osd.7/config 2024-02-10T08:38:52.026 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:38:52.033 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:52.034 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:38:52.134 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:38:52.194 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:52.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:52 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:50.818788+0000 osd.4 (osd.4) 214 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:38:52.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:52 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:50.818852+0000 osd.4 (osd.4) 215 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:38:52.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:52 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:51.021852+0000 mon.a (mon.0) 1763 : cluster [DBG] osdmap e435: 8 total, 7 up, 7 in 2024-02-10T08:38:52.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:52 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:51.137714+0000 mgr.y (mgr.14505) 829 : cluster [DBG] pgmap v1021: 178 pgs: 1 active+undersized+degraded+remapped+backfilling, 5 active+remapped+backfilling, 172 active+clean; 6.2 GiB data, 22 GiB used, 604 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.07k op/s; 6133/306735 objects degraded (1.999%); 30447/306735 objects misplaced (9.926%); 18 MiB/s, 281 objects/s recovering 2024-02-10T08:38:52.340 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:38:52.343 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:38:52.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:50.818788+0000 osd.4 (osd.4) 214 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:38:52.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:50.818852+0000 osd.4 (osd.4) 215 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:38:52.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:51.021852+0000 mon.a (mon.0) 1763 : cluster [DBG] osdmap e435: 8 total, 7 up, 7 in 2024-02-10T08:38:52.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:51.137714+0000 mgr.y (mgr.14505) 829 : cluster [DBG] pgmap v1021: 178 pgs: 1 active+undersized+degraded+remapped+backfilling, 5 active+remapped+backfilling, 172 active+clean; 6.2 GiB data, 22 GiB used, 604 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.07k op/s; 6133/306735 objects degraded (1.999%); 30447/306735 objects misplaced (9.926%); 18 MiB/s, 281 objects/s recovering 2024-02-10T08:38:52.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:50.818788+0000 osd.4 (osd.4) 214 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:38:52.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:50.818852+0000 osd.4 (osd.4) 215 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:38:52.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:51.021852+0000 mon.a (mon.0) 1763 : cluster [DBG] osdmap e435: 8 total, 7 up, 7 in 2024-02-10T08:38:52.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:51.137714+0000 mgr.y (mgr.14505) 829 : cluster [DBG] pgmap v1021: 178 pgs: 1 active+undersized+degraded+remapped+backfilling, 5 active+remapped+backfilling, 172 active+clean; 6.2 GiB data, 22 GiB used, 604 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.07k op/s; 6133/306735 objects degraded (1.999%); 30447/306735 objects misplaced (9.926%); 18 MiB/s, 281 objects/s recovering 2024-02-10T08:38:52.433 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:38:52.474 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:38:52.509 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:38:52.556 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:38:52.584 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:38:52.619 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:38:52.655 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:38:52.660 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-10T08:38:52.660 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-10T08:38:52.660 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-10T08:38:52.660 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-10T08:38:52.660 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-10T08:38:52.660 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-10T08:38:52.660 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-10T08:38:52.660 INFO:teuthology.orchestra.run.smithi018.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-02-10T08:38:52.754 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:38:52.757 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:52.758 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:38:52.858 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:38:52.911 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:53.044 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:52.039644+0000 mon.a (mon.0) 1764 : cluster [WRN] Health check failed: Degraded data redundancy: 6133/306735 objects degraded (1.999%), 1 pg degraded (PG_DEGRADED) 2024-02-10T08:38:53.044 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:38:52.384423+0000 mon.b (mon.1) 96 : audit [DBG] from='client.? 172.21.15.18:0/908235647' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:38:53.044 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:38:52.416238+0000 mon.a (mon.0) 1765 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:38:53.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:52.039644+0000 mon.a (mon.0) 1764 : cluster [WRN] Health check failed: Degraded data redundancy: 6133/306735 objects degraded (1.999%), 1 pg degraded (PG_DEGRADED) 2024-02-10T08:38:53.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:38:52.384423+0000 mon.b (mon.1) 96 : audit [DBG] from='client.? 172.21.15.18:0/908235647' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:38:53.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:38:52.416238+0000 mon.a (mon.0) 1765 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:38:53.515 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:53 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:52.039644+0000 mon.a (mon.0) 1764 : cluster [WRN] Health check failed: Degraded data redundancy: 6133/306735 objects degraded (1.999%), 1 pg degraded (PG_DEGRADED) 2024-02-10T08:38:53.515 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:53 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:38:52.384423+0000 mon.b (mon.1) 96 : audit [DBG] from='client.? 172.21.15.18:0/908235647' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:38:53.515 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:53 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:38:52.416238+0000 mon.a (mon.0) 1765 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:38:54.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:53.138560+0000 mgr.y (mgr.14505) 830 : cluster [DBG] pgmap v1022: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 5 active+undersized+degraded+remapped+backfilling, 172 active+clean; 6.0 GiB data, 22 GiB used, 604 GiB / 626 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 1.28k op/s; 34611/297537 objects degraded (11.633%); 22 MiB/s, 348 objects/s recovering 2024-02-10T08:38:54.159 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:53.138560+0000 mgr.y (mgr.14505) 830 : cluster [DBG] pgmap v1022: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 5 active+undersized+degraded+remapped+backfilling, 172 active+clean; 6.0 GiB data, 22 GiB used, 604 GiB / 626 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 1.28k op/s; 34611/297537 objects degraded (11.633%); 22 MiB/s, 348 objects/s recovering 2024-02-10T08:38:54.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:54 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:53.138560+0000 mgr.y (mgr.14505) 830 : cluster [DBG] pgmap v1022: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 5 active+undersized+degraded+remapped+backfilling, 172 active+clean; 6.0 GiB data, 22 GiB used, 604 GiB / 626 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 1.28k op/s; 34611/297537 objects degraded (11.633%); 22 MiB/s, 348 objects/s recovering 2024-02-10T08:38:55.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:54.038412+0000 mon.a (mon.0) 1766 : cluster [WRN] Health check failed: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull (PG_BACKFILL_FULL) 2024-02-10T08:38:55.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:54.038412+0000 mon.a (mon.0) 1766 : cluster [WRN] Health check failed: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull (PG_BACKFILL_FULL) 2024-02-10T08:38:55.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:54.038412+0000 mon.a (mon.0) 1766 : cluster [WRN] Health check failed: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull (PG_BACKFILL_FULL) 2024-02-10T08:38:56.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:55.139235+0000 mgr.y (mgr.14505) 831 : cluster [DBG] pgmap v1023: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 5 active+undersized+degraded+remapped+backfilling, 172 active+clean; 6.0 GiB data, 22 GiB used, 604 GiB / 626 GiB avail; 761 B/s rd, 0 B/s wr, 688 op/s; 34273/295275 objects degraded (11.607%); 9.0 MiB/s, 144 objects/s recovering 2024-02-10T08:38:56.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:55.139235+0000 mgr.y (mgr.14505) 831 : cluster [DBG] pgmap v1023: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 5 active+undersized+degraded+remapped+backfilling, 172 active+clean; 6.0 GiB data, 22 GiB used, 604 GiB / 626 GiB avail; 761 B/s rd, 0 B/s wr, 688 op/s; 34273/295275 objects degraded (11.607%); 9.0 MiB/s, 144 objects/s recovering 2024-02-10T08:38:56.421 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:38:56.425 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:56.426 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:38:56.516 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:55.139235+0000 mgr.y (mgr.14505) 831 : cluster [DBG] pgmap v1023: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 5 active+undersized+degraded+remapped+backfilling, 172 active+clean; 6.0 GiB data, 22 GiB used, 604 GiB / 626 GiB avail; 761 B/s rd, 0 B/s wr, 688 op/s; 34273/295275 objects degraded (11.607%); 9.0 MiB/s, 144 objects/s recovering 2024-02-10T08:38:56.526 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:38:56.608 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:56.652 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:38:56.660 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:56.660 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:38:56.761 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:38:56.789 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:38:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:38:56] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:38:56.802 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:56.838 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:38:56.842 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:56.843 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:38:56.943 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:38:56.999 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:57.472 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:38:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:38:57] "GET /metrics HTTP/1.1" 200 176734 "" "Prometheus/2.33.4" 2024-02-10T08:38:57.601 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:38:57.608 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:57.609 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:38:57.627 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-02-10T08:38:57.627 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-02-10T08:38:57.710 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:38:57.768 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:57.931 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:38:57.938 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:57.938 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:38:58.039 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:38:58.109 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:58.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:57.139650+0000 mgr.y (mgr.14505) 832 : cluster [DBG] pgmap v1024: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 5 active+undersized+degraded+remapped+backfilling, 172 active+clean; 6.0 GiB data, 22 GiB used, 604 GiB / 626 GiB avail; 639 B/s rd, 0 B/s wr, 507 op/s; 34273/295275 objects degraded (11.607%); 7.6 MiB/s, 121 objects/s recovering 2024-02-10T08:38:58.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:38:57.438750+0000 mon.a (mon.0) 1767 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:38:58.827 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:57.139650+0000 mgr.y (mgr.14505) 832 : cluster [DBG] pgmap v1024: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 5 active+undersized+degraded+remapped+backfilling, 172 active+clean; 6.0 GiB data, 22 GiB used, 604 GiB / 626 GiB avail; 639 B/s rd, 0 B/s wr, 507 op/s; 34273/295275 objects degraded (11.607%); 7.6 MiB/s, 121 objects/s recovering 2024-02-10T08:38:58.827 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:38:57.438750+0000 mon.a (mon.0) 1767 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:38:58.827 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:57.139650+0000 mgr.y (mgr.14505) 832 : cluster [DBG] pgmap v1024: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 5 active+undersized+degraded+remapped+backfilling, 172 active+clean; 6.0 GiB data, 22 GiB used, 604 GiB / 626 GiB avail; 639 B/s rd, 0 B/s wr, 507 op/s; 34273/295275 objects degraded (11.607%); 7.6 MiB/s, 121 objects/s recovering 2024-02-10T08:38:58.827 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:38:57.438750+0000 mon.a (mon.0) 1767 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:38:58.876 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:38:58.881 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:38:58.882 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:38:58.983 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:38:59.046 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:38:59.291 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:38:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:38:59.341 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-02-10T08:38:59.341 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:38:59.628 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-10T08:38:59.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:38:59 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:59.449803+0000 mon.a (mon.0) 1768 : cluster [WRN] Health check update: Degraded data redundancy: 31956/281292 objects degraded (11.360%), 6 pgs degraded (PG_DEGRADED) 2024-02-10T08:38:59.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:38:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:59.449803+0000 mon.a (mon.0) 1768 : cluster [WRN] Health check update: Degraded data redundancy: 31956/281292 objects degraded (11.360%), 6 pgs degraded (PG_DEGRADED) 2024-02-10T08:38:59.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:38:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:59.449803+0000 mon.a (mon.0) 1768 : cluster [WRN] Health check update: Degraded data redundancy: 31956/281292 objects degraded (11.360%), 6 pgs degraded (PG_DEGRADED) 2024-02-10T08:39:00.196 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.0 dump_historic_ops 2024-02-10T08:39:00.215 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:39:00.219 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:00.219 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:39:00.320 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:39:00.394 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:00.528 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:39:00.531 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:00.532 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:39:00.633 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:39:00.692 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:39:00.734 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:39:00.747 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:00.792 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:38:58.925399+0000 mgr.y (mgr.14505) 833 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:39:00.792 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:38:59.142246+0000 mgr.y (mgr.14505) 834 : cluster [DBG] pgmap v1025: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 5 active+undersized+degraded+remapped+backfilling, 172 active+clean; 5.7 GiB data, 21 GiB used, 605 GiB / 626 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 897 op/s; 31956/281292 objects degraded (11.360%); 12 MiB/s, 196 objects/s recovering 2024-02-10T08:39:00.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:38:58.925399+0000 mgr.y (mgr.14505) 833 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:39:00.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:38:59.142246+0000 mgr.y (mgr.14505) 834 : cluster [DBG] pgmap v1025: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 5 active+undersized+degraded+remapped+backfilling, 172 active+clean; 5.7 GiB data, 21 GiB used, 605 GiB / 626 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 897 op/s; 31956/281292 objects degraded (11.360%); 12 MiB/s, 196 objects/s recovering 2024-02-10T08:39:00.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:38:58.925399+0000 mgr.y (mgr.14505) 833 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:39:00.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:38:59.142246+0000 mgr.y (mgr.14505) 834 : cluster [DBG] pgmap v1025: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 5 active+undersized+degraded+remapped+backfilling, 172 active+clean; 5.7 GiB data, 21 GiB used, 605 GiB / 626 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 897 op/s; 31956/281292 objects degraded (11.360%); 12 MiB/s, 196 objects/s recovering 2024-02-10T08:39:01.555 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is unset 2024-02-10T08:39:01.791 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:39:00.846812+0000 mon.c (mon.2) 99 : audit [INF] from='client.? 172.21.15.18:0/3150899258' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:39:01.791 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:39:00.847232+0000 mon.a (mon.0) 1769 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:39:01.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:39:00.846812+0000 mon.c (mon.2) 99 : audit [INF] from='client.? 172.21.15.18:0/3150899258' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:39:01.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:39:00.847232+0000 mon.a (mon.0) 1769 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:39:01.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:39:00.846812+0000 mon.c (mon.2) 99 : audit [INF] from='client.? 172.21.15.18:0/3150899258' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:39:01.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:39:00.847232+0000 mon.a (mon.0) 1769 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:39:01.904 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:39:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:39:01.699+0000 7f52ba297700 -1 mgr get_metadata_python Requested missing service osd.7 2024-02-10T08:39:02.658 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:39:01.142868+0000 mgr.y (mgr.14505) 835 : cluster [DBG] pgmap v1026: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 5 active+undersized+degraded+remapped+backfilling, 172 active+clean; 5.7 GiB data, 21 GiB used, 605 GiB / 626 GiB avail; 1011 B/s rd, 0 B/s wr, 866 op/s; 31622/280437 objects degraded (11.276%); 12 MiB/s, 189 objects/s recovering 2024-02-10T08:39:02.659 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:39:01.521456+0000 mon.a (mon.0) 1770 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-10T08:39:02.659 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:39:01.535528+0000 mon.a (mon.0) 1771 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-10T08:39:02.659 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:39:01.535592+0000 mon.a (mon.0) 1772 : cluster [DBG] osdmap e436: 8 total, 7 up, 7 in 2024-02-10T08:39:02.659 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:39:01.694273+0000 mon.a (mon.0) 1773 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:39:02.659 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:39:01.142868+0000 mgr.y (mgr.14505) 835 : cluster [DBG] pgmap v1026: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 5 active+undersized+degraded+remapped+backfilling, 172 active+clean; 5.7 GiB data, 21 GiB used, 605 GiB / 626 GiB avail; 1011 B/s rd, 0 B/s wr, 866 op/s; 31622/280437 objects degraded (11.276%); 12 MiB/s, 189 objects/s recovering 2024-02-10T08:39:02.659 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:39:01.521456+0000 mon.a (mon.0) 1770 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-10T08:39:02.659 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:39:01.535528+0000 mon.a (mon.0) 1771 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-10T08:39:02.659 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:39:01.535592+0000 mon.a (mon.0) 1772 : cluster [DBG] osdmap e436: 8 total, 7 up, 7 in 2024-02-10T08:39:02.659 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:39:01.694273+0000 mon.a (mon.0) 1773 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:39:02.719 INFO:teuthology.orchestra.run.smithi071.stdout:11.3 2024-02-10T08:39:02.719 INFO:teuthology.orchestra.run.smithi071.stdout:11.f 2024-02-10T08:39:02.719 INFO:teuthology.orchestra.run.smithi071.stdout:11.0 2024-02-10T08:39:02.719 INFO:teuthology.orchestra.run.smithi071.stdout:11.4 2024-02-10T08:39:02.719 INFO:teuthology.orchestra.run.smithi071.stdout:11.5 2024-02-10T08:39:02.719 INFO:teuthology.orchestra.run.smithi071.stdout:11.e 2024-02-10T08:39:02.943 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:39:02.947 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:02.948 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:39:03.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:39:01.142868+0000 mgr.y (mgr.14505) 835 : cluster [DBG] pgmap v1026: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 5 active+undersized+degraded+remapped+backfilling, 172 active+clean; 5.7 GiB data, 21 GiB used, 605 GiB / 626 GiB avail; 1011 B/s rd, 0 B/s wr, 866 op/s; 31622/280437 objects degraded (11.276%); 12 MiB/s, 189 objects/s recovering 2024-02-10T08:39:03.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:39:01.521456+0000 mon.a (mon.0) 1770 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-10T08:39:03.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:39:01.535528+0000 mon.a (mon.0) 1771 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-10T08:39:03.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:39:01.535592+0000 mon.a (mon.0) 1772 : cluster [DBG] osdmap e436: 8 total, 7 up, 7 in 2024-02-10T08:39:03.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:39:01.694273+0000 mon.a (mon.0) 1773 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:39:03.049 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:39:03.124 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:03.212 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:39:03.217 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:03.218 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:39:03.319 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:39:03.378 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:03.418 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:39:03.427 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:03.428 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:39:03.529 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:39:03.572 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:04.052 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:39:04.054 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -n osd.7 --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph-objectstore-tool --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-7 --journal-path /var/lib/ceph/osd/ceph-7/journal --op export --pgid 11.5 --file /var/log/ceph/exp.11.5.7 2024-02-10T08:39:04.059 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:04.060 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:39:04.161 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:39:04.246 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:04.330 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:39:04.334 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:04.335 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:39:04.436 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:39:04.440 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/osd.7/config 2024-02-10T08:39:04.485 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:04.697 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:39:04.701 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:04.702 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:39:04.756 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:39:03.144187+0000 mgr.y (mgr.14505) 836 : cluster [DBG] pgmap v1028: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 5 active+undersized+degraded+remapped+backfilling, 172 active+clean; 5.5 GiB data, 20 GiB used, 605 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 952 op/s; 29352/268980 objects degraded (10.912%); 13 MiB/s, 201 objects/s recovering 2024-02-10T08:39:04.803 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:39:04.848 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:04.882 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:39:04.885 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:04.885 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:39:04.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:39:03.144187+0000 mgr.y (mgr.14505) 836 : cluster [DBG] pgmap v1028: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 5 active+undersized+degraded+remapped+backfilling, 172 active+clean; 5.5 GiB data, 20 GiB used, 605 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 952 op/s; 29352/268980 objects degraded (10.912%); 13 MiB/s, 201 objects/s recovering 2024-02-10T08:39:04.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:39:03.144187+0000 mgr.y (mgr.14505) 836 : cluster [DBG] pgmap v1028: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 5 active+undersized+degraded+remapped+backfilling, 172 active+clean; 5.5 GiB data, 20 GiB used, 605 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 952 op/s; 29352/268980 objects degraded (10.912%); 13 MiB/s, 201 objects/s recovering 2024-02-10T08:39:04.986 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:39:05.038 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:05.064 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:39:05.069 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:05.069 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:39:05.170 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:39:05.209 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:05.380 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:39:05.496 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:05.497 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:39:05.598 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:39:05.636 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:39:05.546633+0000 mon.a (mon.0) 1774 : cluster [WRN] Health check update: Degraded data redundancy: 29001/266385 objects degraded (10.887%), 6 pgs degraded (PG_DEGRADED) 2024-02-10T08:39:05.653 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:05.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:39:05.546633+0000 mon.a (mon.0) 1774 : cluster [WRN] Health check update: Degraded data redundancy: 29001/266385 objects degraded (10.887%), 6 pgs degraded (PG_DEGRADED) 2024-02-10T08:39:05.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:39:05.546633+0000 mon.a (mon.0) 1774 : cluster [WRN] Health check update: Degraded data redundancy: 29001/266385 objects degraded (10.887%), 6 pgs degraded (PG_DEGRADED) 2024-02-10T08:39:05.936 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:39:05.948 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:05.949 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:39:06.049 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:39:06.130 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:06.156 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd set noscrub 2024-02-10T08:39:06.172 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:39:06.177 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:06.177 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:39:06.278 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:39:06.379 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:06.524 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:39:06.532 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:06.532 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:39:06.633 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:39:06.734 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:06.791 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:39:05.147652+0000 mgr.y (mgr.14505) 837 : cluster [DBG] pgmap v1029: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 5 active+undersized+degraded+remapped+backfilling, 172 active+clean; 5.4 GiB data, 20 GiB used, 606 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 963 op/s; 29001/266385 objects degraded (10.887%); 13 MiB/s, 201 objects/s recovering 2024-02-10T08:39:06.791 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:39:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:39:06] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:39:06.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:39:05.147652+0000 mgr.y (mgr.14505) 837 : cluster [DBG] pgmap v1029: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 5 active+undersized+degraded+remapped+backfilling, 172 active+clean; 5.4 GiB data, 20 GiB used, 606 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 963 op/s; 29001/266385 objects degraded (10.887%); 13 MiB/s, 201 objects/s recovering 2024-02-10T08:39:06.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:39:05.147652+0000 mgr.y (mgr.14505) 837 : cluster [DBG] pgmap v1029: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 5 active+undersized+degraded+remapped+backfilling, 172 active+clean; 5.4 GiB data, 20 GiB used, 606 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 963 op/s; 29001/266385 objects degraded (10.887%); 13 MiB/s, 201 objects/s recovering 2024-02-10T08:39:07.654 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:39:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:39:07] "GET /metrics HTTP/1.1" 200 166324 "" "Prometheus/2.33.4" 2024-02-10T08:39:08.007 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:39:08.013 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:08.013 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:39:08.114 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:39:08.182 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:08.940 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:39:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:39:08.940 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:39:07.148088+0000 mgr.y (mgr.14505) 838 : cluster [DBG] pgmap v1030: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 5 active+undersized+degraded+remapped+backfilling, 172 active+clean; 5.4 GiB data, 20 GiB used, 606 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 963 op/s; 29001/266385 objects degraded (10.887%); 13 MiB/s, 201 objects/s recovering 2024-02-10T08:39:09.052 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:39:09.055 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:39:07.148088+0000 mgr.y (mgr.14505) 838 : cluster [DBG] pgmap v1030: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 5 active+undersized+degraded+remapped+backfilling, 172 active+clean; 5.4 GiB data, 20 GiB used, 606 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 963 op/s; 29001/266385 objects degraded (10.887%); 13 MiB/s, 201 objects/s recovering 2024-02-10T08:39:09.055 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:09.056 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:39:09.056 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:39:07.148088+0000 mgr.y (mgr.14505) 838 : cluster [DBG] pgmap v1030: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 5 active+undersized+degraded+remapped+backfilling, 172 active+clean; 5.4 GiB data, 20 GiB used, 606 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 963 op/s; 29001/266385 objects degraded (10.887%); 13 MiB/s, 201 objects/s recovering 2024-02-10T08:39:09.157 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:39:09.212 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:09.253 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:39:09.257 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:09.258 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:39:09.307 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-02-10T08:39:09.307 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:39:09.359 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:39:09.423 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:09.734 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:39:09.735 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:39:09.735 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:39:09.735 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:39:09.735 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:39:09.735 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:39:09.735 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:39:09.735 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-10T08:39:09.735 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-10T08:39:09.735 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-10T08:39:09.735 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-10T08:39:09.735 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-10T08:39:09.735 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-10T08:39:09.735 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-10T08:39:09.735 INFO:teuthology.orchestra.run.smithi018.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-02-10T08:39:09.801 INFO:teuthology.orchestra.run.smithi071.stderr:Exporting 11.5 info 11.5( v 432'8388 (407'4224,432'8388] local-lis/les=429/430 n=6224 ec=398/398 lis/c=429/398 les/c/f=430/399/0 sis=429) 2024-02-10T08:39:09.849 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0006de4:::benchmark_data_smithi018_166993_object67606:head# 2024-02-10T08:39:09.849 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0009d8c:::benchmark_data_smithi018_166993_object35778:head# 2024-02-10T08:39:09.849 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0032363:::benchmark_data_smithi018_166993_object62939:head# 2024-02-10T08:39:09.850 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0036558:::benchmark_data_smithi018_166993_object87311:head# 2024-02-10T08:39:09.861 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a003c562:::benchmark_data_smithi018_166993_object88676:head# 2024-02-10T08:39:09.861 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a004a81e:::benchmark_data_smithi018_166993_object104514:head# 2024-02-10T08:39:09.862 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a00619b7:::benchmark_data_smithi018_166993_object55250:head# 2024-02-10T08:39:09.862 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0096ba9:::benchmark_data_smithi018_166993_object113111:head# 2024-02-10T08:39:09.862 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a00d4a27:::benchmark_data_smithi018_166993_object36213:head# 2024-02-10T08:39:09.862 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a00e312a:::benchmark_data_smithi018_166993_object39605:head# 2024-02-10T08:39:09.862 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a00e9dce:::benchmark_data_smithi018_166993_object108589:head# 2024-02-10T08:39:09.862 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a00eaae4:::benchmark_data_smithi018_166993_object29189:head# 2024-02-10T08:39:09.862 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a00ec291:::benchmark_data_smithi018_166993_object41115:head# 2024-02-10T08:39:09.862 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a010a320:::benchmark_data_smithi018_166993_object18485:head# 2024-02-10T08:39:09.862 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a010f304:::benchmark_data_smithi018_166993_object118071:head# 2024-02-10T08:39:09.862 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a01128b1:::benchmark_data_smithi018_166993_object20573:head# 2024-02-10T08:39:09.862 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a011ba07:::benchmark_data_smithi018_166993_object39771:head# 2024-02-10T08:39:09.863 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a012345f:::benchmark_data_smithi018_166993_object25333:head# 2024-02-10T08:39:09.863 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0127eda:::benchmark_data_smithi018_166993_object95636:head# 2024-02-10T08:39:09.863 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0132081:::benchmark_data_smithi018_166993_object106092:head# 2024-02-10T08:39:09.863 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0142221:::benchmark_data_smithi018_166993_object42036:head# 2024-02-10T08:39:09.864 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0143659:::benchmark_data_smithi018_166993_object103945:head# 2024-02-10T08:39:09.864 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0158aab:::benchmark_data_smithi018_166993_object77884:head# 2024-02-10T08:39:09.864 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a017048c:::benchmark_data_smithi018_166993_object96290:head# 2024-02-10T08:39:09.865 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0170ae2:::benchmark_data_smithi018_166993_object74057:head# 2024-02-10T08:39:09.865 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a017a4e8:::benchmark_data_smithi018_166993_object68431:head# 2024-02-10T08:39:09.866 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a018259c:::benchmark_data_smithi018_166993_object20581:head# 2024-02-10T08:39:09.866 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a018eeea:::benchmark_data_smithi018_166993_object54467:head# 2024-02-10T08:39:09.867 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a01b0540:::benchmark_data_smithi018_166993_object81940:head# 2024-02-10T08:39:09.868 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a01bdcff:::benchmark_data_smithi018_166993_object113982:head# 2024-02-10T08:39:09.868 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a01c4277:::benchmark_data_smithi018_166993_object39338:head# 2024-02-10T08:39:09.868 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a01d4b9b:::benchmark_data_smithi018_166993_object21343:head# 2024-02-10T08:39:09.874 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a01db508:::benchmark_data_smithi018_166993_object42737:head# 2024-02-10T08:39:09.877 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a01e332b:::benchmark_data_smithi018_166993_object91009:head# 2024-02-10T08:39:09.880 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a01e4113:::benchmark_data_smithi018_166993_object60442:head# 2024-02-10T08:39:09.880 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a02017a3:::benchmark_data_smithi018_166993_object26981:head# 2024-02-10T08:39:09.881 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a020a11b:::benchmark_data_smithi018_166993_object102658:head# 2024-02-10T08:39:09.881 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a020c7f7:::benchmark_data_smithi018_166993_object111295:head# 2024-02-10T08:39:09.881 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0212c7e:::benchmark_data_smithi018_166993_object34276:head# 2024-02-10T08:39:09.882 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0234a04:::benchmark_data_smithi018_166993_object35158:head# 2024-02-10T08:39:09.882 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a024b49c:::benchmark_data_smithi018_166993_object45715:head# 2024-02-10T08:39:09.883 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a024ff92:::benchmark_data_smithi018_166993_object57670:head# 2024-02-10T08:39:09.883 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a025fa6e:::benchmark_data_smithi018_166993_object46463:head# 2024-02-10T08:39:09.884 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0263d01:::benchmark_data_smithi018_166993_object37403:head# 2024-02-10T08:39:09.884 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a026e2f8:::benchmark_data_smithi018_166993_object110405:head# 2024-02-10T08:39:09.886 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a02708de:::benchmark_data_smithi018_166993_object74902:head# 2024-02-10T08:39:09.888 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0274ea8:::benchmark_data_smithi018_166993_object83824:head# 2024-02-10T08:39:09.889 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a028d151:::benchmark_data_smithi018_166993_object118491:head# 2024-02-10T08:39:09.889 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a028d24f:::benchmark_data_smithi018_166993_object112600:head# 2024-02-10T08:39:09.889 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a029e1c6:::benchmark_data_smithi018_166993_object17643:head# 2024-02-10T08:39:09.890 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a02b4c42:::benchmark_data_smithi018_166993_object93260:head# 2024-02-10T08:39:09.890 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a02ce389:::benchmark_data_smithi018_166993_object116377:head# 2024-02-10T08:39:09.892 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a02d0edd:::benchmark_data_smithi018_166993_object111667:head# 2024-02-10T08:39:09.893 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a02db365:::benchmark_data_smithi018_166993_object47009:head# 2024-02-10T08:39:09.895 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a02e40a3:::benchmark_data_smithi018_166993_object89036:head# 2024-02-10T08:39:09.895 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a02fc811:::benchmark_data_smithi018_166993_object60450:head# 2024-02-10T08:39:09.896 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a032966e:::benchmark_data_smithi018_166993_object89567:head# 2024-02-10T08:39:09.896 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a03363af:::benchmark_data_smithi018_166993_object42359:head# 2024-02-10T08:39:09.899 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a03396d1:::benchmark_data_smithi018_166993_object29085:head# 2024-02-10T08:39:09.899 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a033c8c4:::benchmark_data_smithi018_166993_object29595:head# 2024-02-10T08:39:09.899 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0343b41:::benchmark_data_smithi018_166993_object44960:head# 2024-02-10T08:39:09.900 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a03452bb:::benchmark_data_smithi018_166993_object51120:head# 2024-02-10T08:39:09.900 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0353d77:::benchmark_data_smithi018_166993_object64889:head# 2024-02-10T08:39:09.901 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0369bfa:::benchmark_data_smithi018_166993_object43943:head# 2024-02-10T08:39:09.901 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a036c73e:::benchmark_data_smithi018_166993_object96437:head# 2024-02-10T08:39:09.902 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a03a524d:::benchmark_data_smithi018_166993_object99099:head# 2024-02-10T08:39:09.903 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a03a8b35:::benchmark_data_smithi018_166993_object109336:head# 2024-02-10T08:39:09.904 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a03ab221:::benchmark_data_smithi018_166993_object45901:head# 2024-02-10T08:39:09.904 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a03aff41:::benchmark_data_smithi018_166993_object38630:head# 2024-02-10T08:39:09.905 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a03b0c1e:::benchmark_data_smithi018_166993_object105514:head# 2024-02-10T08:39:09.906 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a03b1196:::benchmark_data_smithi018_166993_object40023:head# 2024-02-10T08:39:09.906 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a03b7abe:::benchmark_data_smithi018_166993_object110445:head# 2024-02-10T08:39:09.907 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a03d333c:::benchmark_data_smithi018_166993_object104215:head# 2024-02-10T08:39:09.907 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a03d6af1:::benchmark_data_smithi018_166993_object32085:head# 2024-02-10T08:39:09.908 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a03d88cd:::benchmark_data_smithi018_166993_object32345:head# 2024-02-10T08:39:09.908 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a03ef368:::benchmark_data_smithi018_166993_object94693:head# 2024-02-10T08:39:09.911 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a03f0aa1:::benchmark_data_smithi018_166993_object71945:head# 2024-02-10T08:39:09.913 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a03fa113:::benchmark_data_smithi018_166993_object113118:head# 2024-02-10T08:39:09.914 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0401d1a:::benchmark_data_smithi018_166993_object45817:head# 2024-02-10T08:39:09.916 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0406a73:::benchmark_data_smithi018_166993_object84449:head# 2024-02-10T08:39:09.917 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a040e3e6:::benchmark_data_smithi018_166993_object73365:head# 2024-02-10T08:39:09.922 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0410012:::benchmark_data_smithi018_166993_object97016:head# 2024-02-10T08:39:09.922 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a04108c4:::benchmark_data_smithi018_166993_object20938:head# 2024-02-10T08:39:09.922 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0413a63:::benchmark_data_smithi018_166993_object44356:head# 2024-02-10T08:39:09.923 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a041d4c4:::benchmark_data_smithi018_166993_object65216:head# 2024-02-10T08:39:09.923 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0429469:::benchmark_data_smithi018_166993_object33480:head# 2024-02-10T08:39:09.923 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a043331e:::benchmark_data_smithi018_166993_object92394:head# 2024-02-10T08:39:09.923 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a04489d6:::benchmark_data_smithi018_166993_object64819:head# 2024-02-10T08:39:09.923 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0454cec:::benchmark_data_smithi018_166993_object56393:head# 2024-02-10T08:39:09.923 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a045b80e:::benchmark_data_smithi018_166993_object76417:head# 2024-02-10T08:39:09.925 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0474b09:::benchmark_data_smithi018_166993_object41176:head# 2024-02-10T08:39:09.925 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a047f2b2:::benchmark_data_smithi018_166993_object41970:head# 2024-02-10T08:39:09.926 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0482acf:::benchmark_data_smithi018_166993_object89856:head# 2024-02-10T08:39:09.926 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a048663c:::benchmark_data_smithi018_166993_object48865:head# 2024-02-10T08:39:09.927 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a04868f9:::benchmark_data_smithi018_166993_object110581:head# 2024-02-10T08:39:09.927 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a048c7f0:::benchmark_data_smithi018_166993_object85152:head# 2024-02-10T08:39:09.928 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a048c9ba:::benchmark_data_smithi018_166993_object81631:head# 2024-02-10T08:39:09.928 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a04936ac:::benchmark_data_smithi018_166993_object58124:head# 2024-02-10T08:39:09.929 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0495c62:::benchmark_data_smithi018_166993_object60276:head# 2024-02-10T08:39:09.935 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a049e9cb:::benchmark_data_smithi018_166993_object51282:head# 2024-02-10T08:39:09.935 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a04a162d:::benchmark_data_smithi018_166993_object41427:head# 2024-02-10T08:39:09.936 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a04b596f:::benchmark_data_smithi018_166993_object57793:head# 2024-02-10T08:39:09.936 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a04d4e58:::benchmark_data_smithi018_166993_object39005:head# 2024-02-10T08:39:09.937 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a04d5918:::benchmark_data_smithi018_166993_object64944:head# 2024-02-10T08:39:09.937 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a04e0dc0:::benchmark_data_smithi018_166993_object21567:head# 2024-02-10T08:39:09.937 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0506942:::benchmark_data_smithi018_166993_object35569:head# 2024-02-10T08:39:09.938 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a050b274:::benchmark_data_smithi018_166993_object93692:head# 2024-02-10T08:39:09.938 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a050c53d:::benchmark_data_smithi018_166993_object19489:head# 2024-02-10T08:39:09.941 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a05132af:::benchmark_data_smithi018_166993_object30716:head# 2024-02-10T08:39:09.942 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a051d4ef:::benchmark_data_smithi018_166993_object67172:head# 2024-02-10T08:39:09.942 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0521869:::benchmark_data_smithi018_166993_object84684:head# 2024-02-10T08:39:09.944 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a052390a:::benchmark_data_smithi018_166993_object74787:head# 2024-02-10T08:39:09.945 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a052645a:::benchmark_data_smithi018_166993_object104540:head# 2024-02-10T08:39:09.945 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0526dda:::benchmark_data_smithi018_166993_object36256:head# 2024-02-10T08:39:09.946 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a052e6c3:::benchmark_data_smithi018_166993_object88089:head# 2024-02-10T08:39:09.946 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0534e15:::benchmark_data_smithi018_166993_object44054:head# 2024-02-10T08:39:09.947 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0537719:::benchmark_data_smithi018_166993_object43821:head# 2024-02-10T08:39:09.947 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a05390a3:::benchmark_data_smithi018_166993_object62259:head# 2024-02-10T08:39:09.947 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a053b112:::benchmark_data_smithi018_166993_object106940:head# 2024-02-10T08:39:09.947 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a053c063:::benchmark_data_smithi018_166993_object24232:head# 2024-02-10T08:39:09.948 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0544a37:::benchmark_data_smithi018_166993_object92689:head# 2024-02-10T08:39:09.948 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0545686:::benchmark_data_smithi018_166993_object117529:head# 2024-02-10T08:39:09.949 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a055e397:::benchmark_data_smithi018_166993_object37881:head# 2024-02-10T08:39:09.951 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a05614ce:::benchmark_data_smithi018_166993_object46514:head# 2024-02-10T08:39:09.951 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0564f22:::benchmark_data_smithi018_166993_object87545:head# 2024-02-10T08:39:09.952 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0574fae:::benchmark_data_smithi018_166993_object43972:head# 2024-02-10T08:39:09.952 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a05760b6:::benchmark_data_smithi018_166993_object104943:head# 2024-02-10T08:39:09.953 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0577d82:::benchmark_data_smithi018_166993_object69320:head# 2024-02-10T08:39:09.953 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0580450:::benchmark_data_smithi018_166993_object104192:head# 2024-02-10T08:39:09.954 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a05839b0:::benchmark_data_smithi018_166993_object41964:head# 2024-02-10T08:39:09.954 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a05897ff:::benchmark_data_smithi018_166993_object87936:head# 2024-02-10T08:39:09.956 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a05a30b3:::benchmark_data_smithi018_166993_object85996:head# 2024-02-10T08:39:09.957 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a05c1b0d:::benchmark_data_smithi018_166993_object66566:head# 2024-02-10T08:39:09.960 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a05c4ec9:::benchmark_data_smithi018_166993_object35801:head# 2024-02-10T08:39:09.960 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a05c723b:::benchmark_data_smithi018_166993_object82843:head# 2024-02-10T08:39:09.960 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a05ce0d6:::benchmark_data_smithi018_166993_object81947:head# 2024-02-10T08:39:09.961 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a05e3103:::benchmark_data_smithi018_166993_object108784:head# 2024-02-10T08:39:09.961 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a05f5ba7:::benchmark_data_smithi018_166993_object28917:head# 2024-02-10T08:39:09.962 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a05fa66c:::benchmark_data_smithi018_166993_object27424:head# 2024-02-10T08:39:09.962 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a060774e:::benchmark_data_smithi018_166993_object42724:head# 2024-02-10T08:39:09.963 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0618f83:::benchmark_data_smithi018_166993_object99007:head# 2024-02-10T08:39:09.963 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a06261eb:::benchmark_data_smithi018_166993_object97499:head# 2024-02-10T08:39:09.965 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a06385b7:::benchmark_data_smithi018_166993_object21102:head# 2024-02-10T08:39:09.965 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a063bee3:::benchmark_data_smithi018_166993_object112922:head# 2024-02-10T08:39:09.965 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0649bbb:::benchmark_data_smithi018_166993_object66730:head# 2024-02-10T08:39:09.966 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a064acc4:::benchmark_data_smithi018_166993_object45926:head# 2024-02-10T08:39:09.966 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a065b525:::benchmark_data_smithi018_166993_object65247:head# 2024-02-10T08:39:09.968 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a066076d:::benchmark_data_smithi018_166993_object82377:head# 2024-02-10T08:39:09.968 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a066308e:::benchmark_data_smithi018_166993_object74803:head# 2024-02-10T08:39:09.969 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a06643f8:::benchmark_data_smithi018_166993_object100854:head# 2024-02-10T08:39:09.970 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a067dfe9:::benchmark_data_smithi018_166993_object50442:head# 2024-02-10T08:39:09.970 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a067e55e:::benchmark_data_smithi018_166993_object21041:head# 2024-02-10T08:39:09.971 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0681e33:::benchmark_data_smithi018_166993_object99310:head# 2024-02-10T08:39:09.975 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0695e72:::benchmark_data_smithi018_166993_object45922:head# 2024-02-10T08:39:09.975 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0699dd1:::benchmark_data_smithi018_166993_object74797:head# 2024-02-10T08:39:09.975 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a069a0c3:::benchmark_data_smithi018_166993_object81801:head# 2024-02-10T08:39:09.976 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a069bcf7:::benchmark_data_smithi018_166993_object94424:head# 2024-02-10T08:39:09.976 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a069d773:::benchmark_data_smithi018_166993_object109617:head# 2024-02-10T08:39:09.976 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a06b80f2:::benchmark_data_smithi018_166993_object101722:head# 2024-02-10T08:39:09.977 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a06b86fb:::benchmark_data_smithi018_166993_object107103:head# 2024-02-10T08:39:09.983 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a06c9820:::benchmark_data_smithi018_166993_object92610:head# 2024-02-10T08:39:09.983 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a06d42a9:::benchmark_data_smithi018_166993_object37225:head# 2024-02-10T08:39:09.983 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a06e023f:::benchmark_data_smithi018_166993_object112696:head# 2024-02-10T08:39:09.983 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a06e62d5:::benchmark_data_smithi018_166993_object30375:head# 2024-02-10T08:39:09.983 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a06f00d1:::benchmark_data_smithi018_166993_object46409:head# 2024-02-10T08:39:09.983 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a06f0e55:::benchmark_data_smithi018_166993_object23756:head# 2024-02-10T08:39:09.983 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a06fe2ab:::benchmark_data_smithi018_166993_object40869:head# 2024-02-10T08:39:09.983 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a06fee80:::benchmark_data_smithi018_166993_object71391:head# 2024-02-10T08:39:09.983 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a07029e6:::benchmark_data_smithi018_166993_object65382:head# 2024-02-10T08:39:09.983 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a070e287:::benchmark_data_smithi018_166993_object74081:head# 2024-02-10T08:39:09.985 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0713a99:::benchmark_data_smithi018_166993_object101271:head# 2024-02-10T08:39:09.985 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a071503a:::benchmark_data_smithi018_166993_object83819:head# 2024-02-10T08:39:09.985 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a07208e2:::benchmark_data_smithi018_166993_object91670:head# 2024-02-10T08:39:09.985 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a07413d2:::benchmark_data_smithi018_166993_object65157:head# 2024-02-10T08:39:09.985 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0742d5b:::benchmark_data_smithi018_166993_object98926:head# 2024-02-10T08:39:09.985 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0743012:::benchmark_data_smithi018_166993_object101146:head# 2024-02-10T08:39:09.989 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0755487:::benchmark_data_smithi018_166993_object38946:head# 2024-02-10T08:39:09.990 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a075a792:::benchmark_data_smithi018_166993_object59868:head# 2024-02-10T08:39:09.990 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a075c9b4:::benchmark_data_smithi018_166993_object45991:head# 2024-02-10T08:39:09.992 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a076a749:::benchmark_data_smithi018_166993_object82737:head# 2024-02-10T08:39:09.992 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0771663:::benchmark_data_smithi018_166993_object42833:head# 2024-02-10T08:39:09.992 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0772042:::benchmark_data_smithi018_166993_object96823:head# 2024-02-10T08:39:09.992 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0778ca2:::benchmark_data_smithi018_166993_object45737:head# 2024-02-10T08:39:09.992 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a07791dd:::benchmark_data_smithi018_166993_object57736:head# 2024-02-10T08:39:09.992 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a077aa30:::benchmark_data_smithi018_166993_object27671:head# 2024-02-10T08:39:09.995 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a079130b:::benchmark_data_smithi018_166993_object24818:head# 2024-02-10T08:39:09.995 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0791bf5:::benchmark_data_smithi018_166993_object39316:head# 2024-02-10T08:39:09.995 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0795252:::benchmark_data_smithi018_166993_object41843:head# 2024-02-10T08:39:09.995 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a07958a8:::benchmark_data_smithi018_166993_object67050:head# 2024-02-10T08:39:09.997 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a07a3b0f:::benchmark_data_smithi018_166993_object67570:head# 2024-02-10T08:39:09.997 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a07a7b12:::benchmark_data_smithi018_166993_object20176:head# 2024-02-10T08:39:09.998 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a07a8ad9:::benchmark_data_smithi018_166993_object107292:head# 2024-02-10T08:39:09.998 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a07ba1cd:::benchmark_data_smithi018_166993_object63968:head# 2024-02-10T08:39:09.998 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a07be5c8:::benchmark_data_smithi018_166993_object50709:head# 2024-02-10T08:39:09.999 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a07c3a55:::benchmark_data_smithi018_166993_object47474:head# 2024-02-10T08:39:10.002 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a07c8fc1:::benchmark_data_smithi018_166993_object38570:head# 2024-02-10T08:39:10.003 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a07df34c:::benchmark_data_smithi018_166993_object34339:head# 2024-02-10T08:39:10.003 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a07e0eee:::benchmark_data_smithi018_166993_object49610:head# 2024-02-10T08:39:10.004 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a07f2779:::benchmark_data_smithi018_166993_object65628:head# 2024-02-10T08:39:10.004 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a07f91ee:::benchmark_data_smithi018_166993_object46200:head# 2024-02-10T08:39:10.008 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a08173a1:::benchmark_data_smithi018_166993_object112211:head# 2024-02-10T08:39:10.008 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0820a87:::benchmark_data_smithi018_166993_object21957:head# 2024-02-10T08:39:10.008 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0824a21:::benchmark_data_smithi018_166993_object46493:head# 2024-02-10T08:39:10.008 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a08265db:::benchmark_data_smithi018_166993_object62077:head# 2024-02-10T08:39:10.009 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0826d7a:::benchmark_data_smithi018_166993_object78271:head# 2024-02-10T08:39:10.009 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a082a188:::benchmark_data_smithi018_166993_object109899:head# 2024-02-10T08:39:10.009 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0848776:::benchmark_data_smithi018_166993_object96092:head# 2024-02-10T08:39:10.009 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a084dc2e:::benchmark_data_smithi018_166993_object117131:head# 2024-02-10T08:39:10.010 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a085ddf3:::benchmark_data_smithi018_166993_object33676:head# 2024-02-10T08:39:10.010 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a087093f:::benchmark_data_smithi018_166993_object93321:head# 2024-02-10T08:39:10.015 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0875b15:::benchmark_data_smithi018_166993_object66623:head# 2024-02-10T08:39:10.015 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0883c64:::benchmark_data_smithi018_166993_object24826:head# 2024-02-10T08:39:10.016 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a088647b:::benchmark_data_smithi018_166993_object51746:head# 2024-02-10T08:39:10.016 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a088a14e:::benchmark_data_smithi018_166993_object80782:head# 2024-02-10T08:39:10.016 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a088c681:::benchmark_data_smithi018_166993_object37885:head# 2024-02-10T08:39:10.019 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0890b9b:::benchmark_data_smithi018_166993_object103702:head# 2024-02-10T08:39:10.019 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0891db4:::benchmark_data_smithi018_166993_object86977:head# 2024-02-10T08:39:10.021 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0898dd4:::benchmark_data_smithi018_166993_object85721:head# 2024-02-10T08:39:10.022 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a089b2e1:::benchmark_data_smithi018_166993_object84791:head# 2024-02-10T08:39:10.028 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a08a444d:::benchmark_data_smithi018_166993_object68417:head# 2024-02-10T08:39:10.028 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a08b47ac:::benchmark_data_smithi018_166993_object42348:head# 2024-02-10T08:39:10.028 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a08b5ee0:::benchmark_data_smithi018_166993_object54644:head# 2024-02-10T08:39:10.029 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a08cc709:::benchmark_data_smithi018_166993_object68131:head# 2024-02-10T08:39:10.029 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a08ce448:::benchmark_data_smithi018_166993_object92743:head# 2024-02-10T08:39:10.029 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a08d9540:::benchmark_data_smithi018_166993_object92851:head# 2024-02-10T08:39:10.029 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a08f9297:::benchmark_data_smithi018_166993_object65960:head# 2024-02-10T08:39:10.030 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a08ffbcd:::benchmark_data_smithi018_166993_object43839:head# 2024-02-10T08:39:10.030 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0909e8f:::benchmark_data_smithi018_166993_object92246:head# 2024-02-10T08:39:10.031 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0925dca:::benchmark_data_smithi018_166993_object50745:head# 2024-02-10T08:39:10.031 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0946afb:::benchmark_data_smithi018_166993_object71561:head# 2024-02-10T08:39:10.031 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0965613:::benchmark_data_smithi018_166993_object104872:head# 2024-02-10T08:39:10.032 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a09706d5:::benchmark_data_smithi018_166993_object80637:head# 2024-02-10T08:39:10.032 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0973a7d:::benchmark_data_smithi018_166993_object33954:head# 2024-02-10T08:39:10.033 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0976180:::benchmark_data_smithi018_166993_object115819:head# 2024-02-10T08:39:10.036 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a097e87b:::benchmark_data_smithi018_166993_object117149:head# 2024-02-10T08:39:10.038 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a098d662:::benchmark_data_smithi018_166993_object35851:head# 2024-02-10T08:39:10.038 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0990332:::benchmark_data_smithi018_166993_object110586:head# 2024-02-10T08:39:10.038 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a099a4d7:::benchmark_data_smithi018_166993_object21241:head# 2024-02-10T08:39:10.038 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a09abe2a:::benchmark_data_smithi018_166993_object36140:head# 2024-02-10T08:39:10.038 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a09b064c:::benchmark_data_smithi018_166993_object26793:head# 2024-02-10T08:39:10.039 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a09b3b4c:::benchmark_data_smithi018_166993_object89777:head# 2024-02-10T08:39:10.039 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a09bc04a:::benchmark_data_smithi018_166993_object47128:head# 2024-02-10T08:39:10.039 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a09dbd3c:::benchmark_data_smithi018_166993_object72593:head# 2024-02-10T08:39:10.040 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a09dccb0:::benchmark_data_smithi018_166993_object69529:head# 2024-02-10T08:39:10.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:39:09.375706+0000 mon.c (mon.2) 100 : audit [DBG] from='client.? 172.21.15.18:0/199691007' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:39:10.043 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a09e3aa1:::benchmark_data_smithi018_166993_object59547:head# 2024-02-10T08:39:10.043 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0a03d29:::benchmark_data_smithi018_166993_object42239:head# 2024-02-10T08:39:10.046 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0a17079:::benchmark_data_smithi018_166993_object22050:head# 2024-02-10T08:39:10.046 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0a29189:::benchmark_data_smithi018_166993_object67074:head# 2024-02-10T08:39:10.046 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0a34736:::benchmark_data_smithi018_166993_object101107:head# 2024-02-10T08:39:10.049 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0a3ef9a:::benchmark_data_smithi018_166993_object18663:head# 2024-02-10T08:39:10.049 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0a4b515:::benchmark_data_smithi018_166993_object40662:head# 2024-02-10T08:39:10.049 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0a5013b:::benchmark_data_smithi018_166993_object61037:head# 2024-02-10T08:39:10.049 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0a72db0:::benchmark_data_smithi018_166993_object84575:head# 2024-02-10T08:39:10.053 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0a73594:::benchmark_data_smithi018_166993_object74884:head# 2024-02-10T08:39:10.053 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0a881b2:::benchmark_data_smithi018_166993_object101035:head# 2024-02-10T08:39:10.053 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0a89970:::benchmark_data_smithi018_166993_object77943:head# 2024-02-10T08:39:10.054 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0a8d1ad:::benchmark_data_smithi018_166993_object87657:head# 2024-02-10T08:39:10.054 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0a961ce:::benchmark_data_smithi018_166993_object50514:head# 2024-02-10T08:39:10.055 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0aa4bdc:::benchmark_data_smithi018_166993_object54972:head# 2024-02-10T08:39:10.057 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0ab1c86:::benchmark_data_smithi018_166993_object34102:head# 2024-02-10T08:39:10.057 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0ab6fac:::benchmark_data_smithi018_166993_object111563:head# 2024-02-10T08:39:10.058 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0ac5e00:::benchmark_data_smithi018_166993_object33965:head# 2024-02-10T08:39:10.060 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0ae01ea:::benchmark_data_smithi018_166993_object92163:head# 2024-02-10T08:39:10.060 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0af0d66:::benchmark_data_smithi018_166993_object45180:head# 2024-02-10T08:39:10.061 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0afaa7f:::benchmark_data_smithi018_166993_object53275:head# 2024-02-10T08:39:10.065 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0afb0e0:::benchmark_data_smithi018_166993_object76338:head# 2024-02-10T08:39:10.065 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0b0a8d4:::benchmark_data_smithi018_166993_object92096:head# 2024-02-10T08:39:10.066 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0b151f0:::benchmark_data_smithi018_166993_object108695:head# 2024-02-10T08:39:10.066 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0b18b04:::benchmark_data_smithi018_166993_object19679:head# 2024-02-10T08:39:10.066 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0b35a42:::benchmark_data_smithi018_166993_object38264:head# 2024-02-10T08:39:10.066 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0b3c912:::benchmark_data_smithi018_166993_object22581:head# 2024-02-10T08:39:10.069 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0b3cf32:::benchmark_data_smithi018_166993_object21364:head# 2024-02-10T08:39:10.069 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0b3da38:::benchmark_data_smithi018_166993_object100892:head# 2024-02-10T08:39:10.069 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0b45024:::benchmark_data_smithi018_166993_object76058:head# 2024-02-10T08:39:10.069 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0b4fcd0:::benchmark_data_smithi018_166993_object73300:head# 2024-02-10T08:39:10.074 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0b67a3e:::benchmark_data_smithi018_166993_object110829:head# 2024-02-10T08:39:10.074 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0b688f2:::benchmark_data_smithi018_166993_object27566:head# 2024-02-10T08:39:10.074 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0b6d52a:::benchmark_data_smithi018_166993_object100844:head# 2024-02-10T08:39:10.080 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0b789dc:::benchmark_data_smithi018_166993_object33803:head# 2024-02-10T08:39:10.081 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0b7ac52:::benchmark_data_smithi018_166993_object93650:head# 2024-02-10T08:39:10.081 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0b88149:::benchmark_data_smithi018_166993_object21464:head# 2024-02-10T08:39:10.081 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0b8cb4c:::benchmark_data_smithi018_166993_object97339:head# 2024-02-10T08:39:10.081 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0b91822:::benchmark_data_smithi018_166993_object89246:head# 2024-02-10T08:39:10.081 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0ba9f9f:::benchmark_data_smithi018_166993_object34660:head# 2024-02-10T08:39:10.081 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0bacc58:::benchmark_data_smithi018_166993_object106993:head# 2024-02-10T08:39:10.081 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0bad1b0:::benchmark_data_smithi018_166993_object52848:head# 2024-02-10T08:39:10.081 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0bba97f:::benchmark_data_smithi018_166993_object113397:head# 2024-02-10T08:39:10.081 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0bbfb1b:::benchmark_data_smithi018_166993_object66136:head# 2024-02-10T08:39:10.082 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0bd5a2a:::benchmark_data_smithi018_166993_object107872:head# 2024-02-10T08:39:10.082 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0bd76fa:::benchmark_data_smithi018_166993_object44006:head# 2024-02-10T08:39:10.082 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0bdb296:::benchmark_data_smithi018_166993_object66147:head# 2024-02-10T08:39:10.084 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0be4f5c:::benchmark_data_smithi018_166993_object52951:head# 2024-02-10T08:39:10.084 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0be7aa6:::benchmark_data_smithi018_166993_object59552:head# 2024-02-10T08:39:10.084 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0bf8d6c:::benchmark_data_smithi018_166993_object117962:head# 2024-02-10T08:39:10.085 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0bfb030:::benchmark_data_smithi018_166993_object65138:head# 2024-02-10T08:39:10.085 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0c031a5:::benchmark_data_smithi018_166993_object56671:head# 2024-02-10T08:39:10.086 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0c0fdaf:::benchmark_data_smithi018_166993_object82422:head# 2024-02-10T08:39:10.086 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0c17505:::benchmark_data_smithi018_166993_object26967:head# 2024-02-10T08:39:10.087 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0c254f6:::benchmark_data_smithi018_166993_object72990:head# 2024-02-10T08:39:10.093 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0c441f6:::benchmark_data_smithi018_166993_object79129:head# 2024-02-10T08:39:10.093 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0c5121b:::benchmark_data_smithi018_166993_object34976:head# 2024-02-10T08:39:10.093 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0c5d6fe:::benchmark_data_smithi018_166993_object87579:head# 2024-02-10T08:39:10.093 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0c5ff62:::benchmark_data_smithi018_166993_object101522:head# 2024-02-10T08:39:10.096 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0c64b6f:::benchmark_data_smithi018_166993_object46600:head# 2024-02-10T08:39:10.096 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0c76b74:::benchmark_data_smithi018_166993_object64921:head# 2024-02-10T08:39:10.096 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0c77dc0:::benchmark_data_smithi018_166993_object48934:head# 2024-02-10T08:39:10.097 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0caae08:::benchmark_data_smithi018_166993_object39970:head# 2024-02-10T08:39:10.098 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0cc14cc:::benchmark_data_smithi018_166993_object91522:head# 2024-02-10T08:39:10.098 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0cc9d08:::benchmark_data_smithi018_166993_object48879:head# 2024-02-10T08:39:10.098 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0ce7adf:::benchmark_data_smithi018_166993_object89706:head# 2024-02-10T08:39:10.100 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0ce904c:::benchmark_data_smithi018_166993_object78643:head# 2024-02-10T08:39:10.100 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0cf4b2f:::benchmark_data_smithi018_166993_object48155:head# 2024-02-10T08:39:10.101 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0cf5696:::benchmark_data_smithi018_166993_object57547:head# 2024-02-10T08:39:10.103 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0cfb562:::benchmark_data_smithi018_166993_object72508:head# 2024-02-10T08:39:10.104 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0cfc089:::benchmark_data_smithi018_166993_object104598:head# 2024-02-10T08:39:10.104 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0d0f7e6:::benchmark_data_smithi018_166993_object99866:head# 2024-02-10T08:39:10.107 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0d10968:::benchmark_data_smithi018_166993_object22170:head# 2024-02-10T08:39:10.108 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0d19225:::benchmark_data_smithi018_166993_object88029:head# 2024-02-10T08:39:10.108 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0d1926f:::benchmark_data_smithi018_166993_object117183:head# 2024-02-10T08:39:10.108 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0d1a9d3:::benchmark_data_smithi018_166993_object89357:head# 2024-02-10T08:39:10.108 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0d2435e:::benchmark_data_smithi018_166993_object38804:head# 2024-02-10T08:39:10.108 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0d24e49:::benchmark_data_smithi018_166993_object117893:head# 2024-02-10T08:39:10.108 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0d4946d:::benchmark_data_smithi018_166993_object109177:head# 2024-02-10T08:39:10.109 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0d4b119:::benchmark_data_smithi018_166993_object77987:head# 2024-02-10T08:39:10.112 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0d4b75e:::benchmark_data_smithi018_166993_object80388:head# 2024-02-10T08:39:10.114 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0d57e84:::benchmark_data_smithi018_166993_object61266:head# 2024-02-10T08:39:10.114 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0d5b16e:::benchmark_data_smithi018_166993_object93257:head# 2024-02-10T08:39:10.115 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0d5ef7f:::benchmark_data_smithi018_166993_object94836:head# 2024-02-10T08:39:10.115 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0d5f925:::benchmark_data_smithi018_166993_object96818:head# 2024-02-10T08:39:10.116 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0d6ecdb:::benchmark_data_smithi018_166993_object53904:head# 2024-02-10T08:39:10.116 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0d7a152:::benchmark_data_smithi018_166993_object33432:head# 2024-02-10T08:39:10.117 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0d7dad9:::benchmark_data_smithi018_166993_object47321:head# 2024-02-10T08:39:10.117 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0d7f56b:::benchmark_data_smithi018_166993_object67893:head# 2024-02-10T08:39:10.118 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0d84264:::benchmark_data_smithi018_166993_object58183:head# 2024-02-10T08:39:10.119 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0d86c41:::benchmark_data_smithi018_166993_object101334:head# 2024-02-10T08:39:10.119 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0d8af77:::benchmark_data_smithi018_166993_object102990:head# 2024-02-10T08:39:10.120 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0de81ef:::benchmark_data_smithi018_166993_object27892:head# 2024-02-10T08:39:10.120 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0dec9fd:::benchmark_data_smithi018_166993_object47237:head# 2024-02-10T08:39:10.122 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:39:10.124 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0e12286:::benchmark_data_smithi018_166993_object97079:head# 2024-02-10T08:39:10.124 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0e13193:::benchmark_data_smithi018_166993_object79853:head# 2024-02-10T08:39:10.124 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0e17726:::benchmark_data_smithi018_166993_object97200:head# 2024-02-10T08:39:10.125 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0e23c58:::benchmark_data_smithi018_166993_object21551:head# 2024-02-10T08:39:10.125 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0e2a479:::benchmark_data_smithi018_166993_object82049:head# 2024-02-10T08:39:10.125 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0e2d7aa:::benchmark_data_smithi018_166993_object96302:head# 2024-02-10T08:39:10.125 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0e2fd42:::benchmark_data_smithi018_166993_object118659:head# 2024-02-10T08:39:10.125 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0e41c89:::benchmark_data_smithi018_166993_object42099:head# 2024-02-10T08:39:10.125 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0e495ae:::benchmark_data_smithi018_166993_object80209:head# 2024-02-10T08:39:10.125 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0e5465e:::benchmark_data_smithi018_166993_object36808:head# 2024-02-10T08:39:10.128 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:10.128 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:39:10.129 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0e5bcf9:::benchmark_data_smithi018_166993_object50982:head# 2024-02-10T08:39:10.129 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0e6d7ce:::benchmark_data_smithi018_166993_object72582:head# 2024-02-10T08:39:10.129 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0e71a60:::benchmark_data_smithi018_166993_object61550:head# 2024-02-10T08:39:10.130 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0e74f22:::benchmark_data_smithi018_166993_object118236:head# 2024-02-10T08:39:10.130 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:39:09.375706+0000 mon.c (mon.2) 100 : audit [DBG] from='client.? 172.21.15.18:0/199691007' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:39:10.130 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0e90c40:::benchmark_data_smithi018_166993_object82221:head# 2024-02-10T08:39:10.131 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:39:09.375706+0000 mon.c (mon.2) 100 : audit [DBG] from='client.? 172.21.15.18:0/199691007' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:39:10.132 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0e9204c:::benchmark_data_smithi018_166993_object44848:head# 2024-02-10T08:39:10.135 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0e9cbcf:::benchmark_data_smithi018_166993_object102684:head# 2024-02-10T08:39:10.135 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0e9d26c:::benchmark_data_smithi018_166993_object111069:head# 2024-02-10T08:39:10.136 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0eaafab:::benchmark_data_smithi018_166993_object69244:head# 2024-02-10T08:39:10.136 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0ebf079:::benchmark_data_smithi018_166993_object96880:head# 2024-02-10T08:39:10.137 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0ecd516:::benchmark_data_smithi018_166993_object51337:head# 2024-02-10T08:39:10.138 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0ece60a:::benchmark_data_smithi018_166993_object114086:head# 2024-02-10T08:39:10.140 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0edbf58:::benchmark_data_smithi018_166993_object93700:head# 2024-02-10T08:39:10.141 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0f00597:::benchmark_data_smithi018_166993_object82104:head# 2024-02-10T08:39:10.141 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0f1eacb:::benchmark_data_smithi018_166993_object65696:head# 2024-02-10T08:39:10.141 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0f24b44:::benchmark_data_smithi018_166993_object62872:head# 2024-02-10T08:39:10.142 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0f462cd:::benchmark_data_smithi018_166993_object113869:head# 2024-02-10T08:39:10.143 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0f4e695:::benchmark_data_smithi018_166993_object47847:head# 2024-02-10T08:39:10.149 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0f5656f:::benchmark_data_smithi018_166993_object104842:head# 2024-02-10T08:39:10.149 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0f57379:::benchmark_data_smithi018_166993_object67662:head# 2024-02-10T08:39:10.149 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0f57cae:::benchmark_data_smithi018_166993_object57554:head# 2024-02-10T08:39:10.154 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0f5e7c4:::benchmark_data_smithi018_166993_object106269:head# 2024-02-10T08:39:10.154 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0f615aa:::benchmark_data_smithi018_166993_object90349:head# 2024-02-10T08:39:10.154 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0f70099:::benchmark_data_smithi018_166993_object35501:head# 2024-02-10T08:39:10.155 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0f72e51:::benchmark_data_smithi018_166993_object66722:head# 2024-02-10T08:39:10.156 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0f7b82e:::benchmark_data_smithi018_166993_object77792:head# 2024-02-10T08:39:10.156 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0f7d01e:::benchmark_data_smithi018_166993_object34508:head# 2024-02-10T08:39:10.157 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0f89805:::benchmark_data_smithi018_166993_object68002:head# 2024-02-10T08:39:10.159 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0f99f7e:::benchmark_data_smithi018_166993_object18775:head# 2024-02-10T08:39:10.160 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0f9c542:::benchmark_data_smithi018_166993_object44510:head# 2024-02-10T08:39:10.161 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0f9e9da:::benchmark_data_smithi018_166993_object90900:head# 2024-02-10T08:39:10.161 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0f9f5cc:::benchmark_data_smithi018_166993_object90793:head# 2024-02-10T08:39:10.161 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0fbb055:::benchmark_data_smithi018_166993_object39705:head# 2024-02-10T08:39:10.162 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0fc1e3d:::benchmark_data_smithi018_166993_object45351:head# 2024-02-10T08:39:10.163 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0fc9bd0:::benchmark_data_smithi018_166993_object118975:head# 2024-02-10T08:39:10.163 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0fcabb5:::benchmark_data_smithi018_166993_object37703:head# 2024-02-10T08:39:10.164 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0fd44af:::benchmark_data_smithi018_166993_object58407:head# 2024-02-10T08:39:10.165 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0fdbd2e:::benchmark_data_smithi018_166993_object116348:head# 2024-02-10T08:39:10.166 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0fec220:::benchmark_data_smithi018_166993_object91492:head# 2024-02-10T08:39:10.167 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0ff51e5:::benchmark_data_smithi018_166993_object63501:head# 2024-02-10T08:39:10.176 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a0ffa916:::benchmark_data_smithi018_166993_object27588:head# 2024-02-10T08:39:10.176 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a100cc1e:::benchmark_data_smithi018_166993_object35548:head# 2024-02-10T08:39:10.176 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a10170a4:::benchmark_data_smithi018_166993_object49556:head# 2024-02-10T08:39:10.176 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a102be6b:::benchmark_data_smithi018_166993_object35422:head# 2024-02-10T08:39:10.176 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1049bb2:::benchmark_data_smithi018_166993_object86141:head# 2024-02-10T08:39:10.179 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a104c4a9:::benchmark_data_smithi018_166993_object40334:head# 2024-02-10T08:39:10.183 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a104d68d:::benchmark_data_smithi018_166993_object75234:head# 2024-02-10T08:39:10.183 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1053742:::benchmark_data_smithi018_166993_object99820:head# 2024-02-10T08:39:10.183 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a105a156:::benchmark_data_smithi018_166993_object107837:head# 2024-02-10T08:39:10.183 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a105c933:::benchmark_data_smithi018_166993_object47718:head# 2024-02-10T08:39:10.185 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1063812:::benchmark_data_smithi018_166993_object68049:head# 2024-02-10T08:39:10.185 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1066763:::benchmark_data_smithi018_166993_object115925:head# 2024-02-10T08:39:10.185 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1090915:::benchmark_data_smithi018_166993_object110053:head# 2024-02-10T08:39:10.186 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1091dc7:::benchmark_data_smithi018_166993_object32659:head# 2024-02-10T08:39:10.186 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a10951ab:::benchmark_data_smithi018_166993_object92358:head# 2024-02-10T08:39:10.187 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1095bb7:::benchmark_data_smithi018_166993_object26772:head# 2024-02-10T08:39:10.189 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a109ae3b:::benchmark_data_smithi018_166993_object19964:head# 2024-02-10T08:39:10.189 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a109c33e:::benchmark_data_smithi018_166993_object105289:head# 2024-02-10T08:39:10.189 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a10a5c1b:::benchmark_data_smithi018_166993_object116286:head# 2024-02-10T08:39:10.193 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a10b234c:::benchmark_data_smithi018_166993_object37949:head# 2024-02-10T08:39:10.193 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a10bd020:::benchmark_data_smithi018_166993_object63843:head# 2024-02-10T08:39:10.193 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a10c74eb:::benchmark_data_smithi018_166993_object45202:head# 2024-02-10T08:39:10.193 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a10cf6fd:::benchmark_data_smithi018_166993_object67228:head# 2024-02-10T08:39:10.193 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a10d3b31:::benchmark_data_smithi018_166993_object51900:head# 2024-02-10T08:39:10.195 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a10d934e:::benchmark_data_smithi018_166993_object32826:head# 2024-02-10T08:39:10.203 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a10e6cec:::benchmark_data_smithi018_166993_object26510:head# 2024-02-10T08:39:10.203 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a10f8bdc:::benchmark_data_smithi018_166993_object61717:head# 2024-02-10T08:39:10.203 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a10fa740:::benchmark_data_smithi018_166993_object20195:head# 2024-02-10T08:39:10.203 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a110990a:::benchmark_data_smithi018_166993_object112567:head# 2024-02-10T08:39:10.203 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a110cf84:::benchmark_data_smithi018_166993_object93998:head# 2024-02-10T08:39:10.204 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1110c75:::benchmark_data_smithi018_166993_object58497:head# 2024-02-10T08:39:10.204 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a11150e8:::benchmark_data_smithi018_166993_object56563:head# 2024-02-10T08:39:10.204 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a111c986:::benchmark_data_smithi018_166993_object116171:head# 2024-02-10T08:39:10.213 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a111f3bd:::benchmark_data_smithi018_166993_object104990:head# 2024-02-10T08:39:10.213 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a11350b3:::benchmark_data_smithi018_166993_object101317:head# 2024-02-10T08:39:10.213 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1137a47:::benchmark_data_smithi018_166993_object36899:head# 2024-02-10T08:39:10.214 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1142190:::benchmark_data_smithi018_166993_object96318:head# 2024-02-10T08:39:10.214 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a114682d:::benchmark_data_smithi018_166993_object27277:head# 2024-02-10T08:39:10.214 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a11475c2:::benchmark_data_smithi018_166993_object64763:head# 2024-02-10T08:39:10.214 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a114cc92:::benchmark_data_smithi018_166993_object31074:head# 2024-02-10T08:39:10.214 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a11594a4:::benchmark_data_smithi018_166993_object49412:head# 2024-02-10T08:39:10.214 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a115ab6b:::benchmark_data_smithi018_166993_object93827:head# 2024-02-10T08:39:10.216 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1186267:::benchmark_data_smithi018_166993_object112845:head# 2024-02-10T08:39:10.216 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a11acb76:::benchmark_data_smithi018_166993_object19127:head# 2024-02-10T08:39:10.216 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a11d1030:::benchmark_data_smithi018_166993_object37708:head# 2024-02-10T08:39:10.216 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a11dff6b:::benchmark_data_smithi018_166993_object51980:head# 2024-02-10T08:39:10.216 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a11e0df2:::benchmark_data_smithi018_166993_object90057:head# 2024-02-10T08:39:10.216 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a11e12e3:::benchmark_data_smithi018_166993_object32441:head# 2024-02-10T08:39:10.216 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a11f0d6e:::benchmark_data_smithi018_166993_object86269:head# 2024-02-10T08:39:10.216 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a11f3ef7:::benchmark_data_smithi018_166993_object42531:head# 2024-02-10T08:39:10.216 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a11f5efc:::benchmark_data_smithi018_166993_object56049:head# 2024-02-10T08:39:10.217 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a11fe14b:::benchmark_data_smithi018_166993_object54717:head# 2024-02-10T08:39:10.217 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a11ffa57:::benchmark_data_smithi018_166993_object94211:head# 2024-02-10T08:39:10.223 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1200900:::benchmark_data_smithi018_166993_object69317:head# 2024-02-10T08:39:10.223 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a121b72f:::benchmark_data_smithi018_166993_object106339:head# 2024-02-10T08:39:10.223 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1220e2a:::benchmark_data_smithi018_166993_object93142:head# 2024-02-10T08:39:10.223 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1228ae6:::benchmark_data_smithi018_166993_object55151:head# 2024-02-10T08:39:10.224 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a122a91d:::benchmark_data_smithi018_166993_object39114:head# 2024-02-10T08:39:10.224 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a122aee2:::benchmark_data_smithi018_166993_object37873:head# 2024-02-10T08:39:10.224 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a122b661:::benchmark_data_smithi018_166993_object114997:head# 2024-02-10T08:39:10.224 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1233766:::benchmark_data_smithi018_166993_object76114:head# 2024-02-10T08:39:10.224 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a123b638:::benchmark_data_smithi018_166993_object76369:head# 2024-02-10T08:39:10.224 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1245afa:::benchmark_data_smithi018_166993_object96545:head# 2024-02-10T08:39:10.224 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1247fd3:::benchmark_data_smithi018_166993_object32347:head# 2024-02-10T08:39:10.228 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a12494af:::benchmark_data_smithi018_166993_object55369:head# 2024-02-10T08:39:10.228 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1250662:::benchmark_data_smithi018_166993_object44910:head# 2024-02-10T08:39:10.229 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:39:10.230 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a125e132:::benchmark_data_smithi018_166993_object104972:head# 2024-02-10T08:39:10.230 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a12705a0:::benchmark_data_smithi018_166993_object102546:head# 2024-02-10T08:39:10.230 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1278618:::benchmark_data_smithi018_166993_object27611:head# 2024-02-10T08:39:10.231 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1298461:::benchmark_data_smithi018_166993_object59653:head# 2024-02-10T08:39:10.231 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a129d231:::benchmark_data_smithi018_166993_object51063:head# 2024-02-10T08:39:10.238 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a129d2a4:::benchmark_data_smithi018_166993_object65967:head# 2024-02-10T08:39:10.239 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a129eddf:::benchmark_data_smithi018_166993_object31725:head# 2024-02-10T08:39:10.239 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a12efb89:::benchmark_data_smithi018_166993_object72642:head# 2024-02-10T08:39:10.239 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a12f26eb:::benchmark_data_smithi018_166993_object43050:head# 2024-02-10T08:39:10.239 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1302901:::benchmark_data_smithi018_166993_object51920:head# 2024-02-10T08:39:10.239 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a130e1b9:::benchmark_data_smithi018_166993_object109750:head# 2024-02-10T08:39:10.239 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a13138a6:::benchmark_data_smithi018_166993_object91235:head# 2024-02-10T08:39:10.242 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a131859c:::benchmark_data_smithi018_166993_object23220:head# 2024-02-10T08:39:10.242 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a133187d:::benchmark_data_smithi018_166993_object84485:head# 2024-02-10T08:39:10.247 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a13433ba:::benchmark_data_smithi018_166993_object49213:head# 2024-02-10T08:39:10.247 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1358083:::benchmark_data_smithi018_166993_object97247:head# 2024-02-10T08:39:10.247 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1359309:::benchmark_data_smithi018_166993_object102977:head# 2024-02-10T08:39:10.247 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a136e83e:::benchmark_data_smithi018_166993_object108075:head# 2024-02-10T08:39:10.249 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1375630:::benchmark_data_smithi018_166993_object100027:head# 2024-02-10T08:39:10.249 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1391d1b:::benchmark_data_smithi018_166993_object94011:head# 2024-02-10T08:39:10.260 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a13961ad:::benchmark_data_smithi018_166993_object82649:head# 2024-02-10T08:39:10.260 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1399ffe:::benchmark_data_smithi018_166993_object44190:head# 2024-02-10T08:39:10.261 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a13b46d7:::benchmark_data_smithi018_166993_object33895:head# 2024-02-10T08:39:10.261 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a13bb2bf:::benchmark_data_smithi018_166993_object42214:head# 2024-02-10T08:39:10.261 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a13be835:::benchmark_data_smithi018_166993_object49140:head# 2024-02-10T08:39:10.261 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a13d3e07:::benchmark_data_smithi018_166993_object53700:head# 2024-02-10T08:39:10.261 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a13d7d07:::benchmark_data_smithi018_166993_object52411:head# 2024-02-10T08:39:10.261 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a13d7f47:::benchmark_data_smithi018_166993_object66168:head# 2024-02-10T08:39:10.261 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a13d912c:::benchmark_data_smithi018_166993_object108662:head# 2024-02-10T08:39:10.268 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a13e47fc:::benchmark_data_smithi018_166993_object79675:head# 2024-02-10T08:39:10.268 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a13e61c4:::benchmark_data_smithi018_166993_object106911:head# 2024-02-10T08:39:10.268 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a13fa386:::benchmark_data_smithi018_166993_object79746:head# 2024-02-10T08:39:10.268 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a13fc757:::benchmark_data_smithi018_166993_object45378:head# 2024-02-10T08:39:10.268 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a13ffcf1:::benchmark_data_smithi018_166993_object27908:head# 2024-02-10T08:39:10.268 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a140e639:::benchmark_data_smithi018_166993_object23715:head# 2024-02-10T08:39:10.268 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1435f0e:::benchmark_data_smithi018_166993_object96998:head# 2024-02-10T08:39:10.269 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a144d20a:::benchmark_data_smithi018_166993_object76263:head# 2024-02-10T08:39:10.269 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a144e7ff:::benchmark_data_smithi018_166993_object20228:head# 2024-02-10T08:39:10.269 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a145359e:::benchmark_data_smithi018_166993_object89616:head# 2024-02-10T08:39:10.269 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a145b243:::benchmark_data_smithi018_166993_object61197:head# 2024-02-10T08:39:10.269 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a145c8d5:::benchmark_data_smithi018_166993_object111904:head# 2024-02-10T08:39:10.269 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a145d9c3:::benchmark_data_smithi018_166993_object45214:head# 2024-02-10T08:39:10.269 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a146ee43:::benchmark_data_smithi018_166993_object61617:head# 2024-02-10T08:39:10.269 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a146f015:::benchmark_data_smithi018_166993_object70820:head# 2024-02-10T08:39:10.269 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1479d04:::benchmark_data_smithi018_166993_object58660:head# 2024-02-10T08:39:10.277 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1480d1f:::benchmark_data_smithi018_166993_object48490:head# 2024-02-10T08:39:10.278 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1496fd6:::benchmark_data_smithi018_166993_object113528:head# 2024-02-10T08:39:10.278 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a149bf92:::benchmark_data_smithi018_166993_object23516:head# 2024-02-10T08:39:10.278 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a149fce8:::benchmark_data_smithi018_166993_object51985:head# 2024-02-10T08:39:10.278 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a14a4cf9:::benchmark_data_smithi018_166993_object68877:head# 2024-02-10T08:39:10.278 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a14a93b3:::benchmark_data_smithi018_166993_object84210:head# 2024-02-10T08:39:10.278 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a14bccc0:::benchmark_data_smithi018_166993_object21417:head# 2024-02-10T08:39:10.285 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a14d4d8d:::benchmark_data_smithi018_166993_object117993:head# 2024-02-10T08:39:10.285 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a14d94ca:::benchmark_data_smithi018_166993_object26658:head# 2024-02-10T08:39:10.288 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a14deee9:::benchmark_data_smithi018_166993_object33090:head# 2024-02-10T08:39:10.288 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a150965c:::benchmark_data_smithi018_166993_object110916:head# 2024-02-10T08:39:10.288 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a15125da:::benchmark_data_smithi018_166993_object80942:head# 2024-02-10T08:39:10.289 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a152889d:::benchmark_data_smithi018_166993_object80509:head# 2024-02-10T08:39:10.289 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a152ae92:::benchmark_data_smithi018_166993_object88261:head# 2024-02-10T08:39:10.289 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1530f52:::benchmark_data_smithi018_166993_object20690:head# 2024-02-10T08:39:10.292 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a153f7b7:::benchmark_data_smithi018_166993_object41285:head# 2024-02-10T08:39:10.292 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1550a21:::benchmark_data_smithi018_166993_object56635:head# 2024-02-10T08:39:10.292 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1551730:::benchmark_data_smithi018_166993_object43849:head# 2024-02-10T08:39:10.292 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a155444a:::benchmark_data_smithi018_166993_object102576:head# 2024-02-10T08:39:10.292 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a15571f6:::benchmark_data_smithi018_166993_object116671:head# 2024-02-10T08:39:10.295 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a15623f8:::benchmark_data_smithi018_166993_object74436:head# 2024-02-10T08:39:10.295 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a156d848:::benchmark_data_smithi018_166993_object19808:head# 2024-02-10T08:39:10.299 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:10.304 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a157204c:::benchmark_data_smithi018_166993_object64662:head# 2024-02-10T08:39:10.304 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a15773c2:::benchmark_data_smithi018_166993_object118675:head# 2024-02-10T08:39:10.304 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a15790f6:::benchmark_data_smithi018_166993_object23750:head# 2024-02-10T08:39:10.304 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a15857eb:::benchmark_data_smithi018_166993_object77397:head# 2024-02-10T08:39:10.304 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a159129d:::benchmark_data_smithi018_166993_object114760:head# 2024-02-10T08:39:10.304 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a15930a2:::benchmark_data_smithi018_166993_object111633:head# 2024-02-10T08:39:10.304 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a159e6ac:::benchmark_data_smithi018_166993_object109842:head# 2024-02-10T08:39:10.305 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a15a3f77:::benchmark_data_smithi018_166993_object87533:head# 2024-02-10T08:39:10.305 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a15c234e:::benchmark_data_smithi018_166993_object99432:head# 2024-02-10T08:39:10.305 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a15ca0e4:::benchmark_data_smithi018_166993_object72979:head# 2024-02-10T08:39:10.312 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a15e9672:::benchmark_data_smithi018_166993_object41372:head# 2024-02-10T08:39:10.312 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a15eb0cf:::benchmark_data_smithi018_166993_object70529:head# 2024-02-10T08:39:10.312 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a15f4473:::benchmark_data_smithi018_166993_object55503:head# 2024-02-10T08:39:10.312 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a15fc539:::benchmark_data_smithi018_166993_object36274:head# 2024-02-10T08:39:10.318 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a15fd1e3:::benchmark_data_smithi018_166993_object106260:head# 2024-02-10T08:39:10.318 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a15fd309:::benchmark_data_smithi018_166993_object62321:head# 2024-02-10T08:39:10.318 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a160ea12:::benchmark_data_smithi018_166993_object62569:head# 2024-02-10T08:39:10.318 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1615eef:::benchmark_data_smithi018_166993_object57130:head# 2024-02-10T08:39:10.318 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a162c84c:::benchmark_data_smithi018_166993_object37247:head# 2024-02-10T08:39:10.318 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1634634:::benchmark_data_smithi018_166993_object23357:head# 2024-02-10T08:39:10.318 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a16364ec:::benchmark_data_smithi018_166993_object108418:head# 2024-02-10T08:39:10.318 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a16412df:::benchmark_data_smithi018_166993_object21337:head# 2024-02-10T08:39:10.319 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a165283d:::benchmark_data_smithi018_166993_object97766:head# 2024-02-10T08:39:10.319 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1657e33:::benchmark_data_smithi018_166993_object54945:head# 2024-02-10T08:39:10.319 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a165841b:::benchmark_data_smithi018_166993_object52521:head# 2024-02-10T08:39:10.319 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a16588a6:::benchmark_data_smithi018_166993_object91373:head# 2024-02-10T08:39:10.319 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1659fd3:::benchmark_data_smithi018_166993_object26100:head# 2024-02-10T08:39:10.322 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a165f143:::benchmark_data_smithi018_166993_object86693:head# 2024-02-10T08:39:10.322 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a167b14f:::benchmark_data_smithi018_166993_object30403:head# 2024-02-10T08:39:10.324 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a16948dd:::benchmark_data_smithi018_166993_object106957:head# 2024-02-10T08:39:10.324 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a169607f:::benchmark_data_smithi018_166993_object72688:head# 2024-02-10T08:39:10.325 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a16962ca:::benchmark_data_smithi018_166993_object71066:head# 2024-02-10T08:39:10.325 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a16af627:::benchmark_data_smithi018_166993_object52179:head# 2024-02-10T08:39:10.325 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a16b34ca:::benchmark_data_smithi018_166993_object110659:head# 2024-02-10T08:39:10.326 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a16c0bca:::benchmark_data_smithi018_166993_object31326:head# 2024-02-10T08:39:10.326 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a16c8840:::benchmark_data_smithi018_166993_object94248:head# 2024-02-10T08:39:10.327 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a16f2559:::benchmark_data_smithi018_166993_object118795:head# 2024-02-10T08:39:10.327 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a16f5ba4:::benchmark_data_smithi018_166993_object92428:head# 2024-02-10T08:39:10.328 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a16fa5d8:::benchmark_data_smithi018_166993_object102080:head# 2024-02-10T08:39:10.328 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a170e1b2:::benchmark_data_smithi018_166993_object97204:head# 2024-02-10T08:39:10.328 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1717139:::benchmark_data_smithi018_166993_object71788:head# 2024-02-10T08:39:10.329 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1726d1b:::benchmark_data_smithi018_166993_object34832:head# 2024-02-10T08:39:10.329 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a172b72c:::benchmark_data_smithi018_166993_object99714:head# 2024-02-10T08:39:10.330 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a172c344:::benchmark_data_smithi018_166993_object55404:head# 2024-02-10T08:39:10.330 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a173ec36:::benchmark_data_smithi018_166993_object99259:head# 2024-02-10T08:39:10.331 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a17429a3:::benchmark_data_smithi018_166993_object18347:head# 2024-02-10T08:39:10.331 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1742eaf:::benchmark_data_smithi018_166993_object38798:head# 2024-02-10T08:39:10.333 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1744e3e:::benchmark_data_smithi018_166993_object94031:head# 2024-02-10T08:39:10.334 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a174f6a2:::benchmark_data_smithi018_166993_object28829:head# 2024-02-10T08:39:10.334 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a17557f2:::benchmark_data_smithi018_166993_object88381:head# 2024-02-10T08:39:10.340 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1760704:::benchmark_data_smithi018_166993_object63074:head# 2024-02-10T08:39:10.340 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1773852:::benchmark_data_smithi018_166993_object60874:head# 2024-02-10T08:39:10.341 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a178048c:::benchmark_data_smithi018_166993_object117780:head# 2024-02-10T08:39:10.341 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a178f4db:::benchmark_data_smithi018_166993_object59724:head# 2024-02-10T08:39:10.341 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1791ee6:::benchmark_data_smithi018_166993_object71845:head# 2024-02-10T08:39:10.341 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1792151:::benchmark_data_smithi018_166993_object80588:head# 2024-02-10T08:39:10.341 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a17c2849:::benchmark_data_smithi018_166993_object73609:head# 2024-02-10T08:39:10.341 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a17c8e78:::benchmark_data_smithi018_166993_object56377:head# 2024-02-10T08:39:10.341 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a17d102c:::benchmark_data_smithi018_166993_object94487:head# 2024-02-10T08:39:10.343 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:39:10.343 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a17ed60a:::benchmark_data_smithi018_166993_object112431:head# 2024-02-10T08:39:10.346 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a17f008c:::benchmark_data_smithi018_166993_object46500:head# 2024-02-10T08:39:10.346 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a17f2775:::benchmark_data_smithi018_166993_object31028:head# 2024-02-10T08:39:10.346 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:10.347 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:39:10.347 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a17f493b:::benchmark_data_smithi018_166993_object101797:head# 2024-02-10T08:39:10.348 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a17f534b:::benchmark_data_smithi018_166993_object47386:head# 2024-02-10T08:39:10.349 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a181129a:::benchmark_data_smithi018_166993_object116856:head# 2024-02-10T08:39:10.349 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a18361a4:::benchmark_data_smithi018_166993_object27685:head# 2024-02-10T08:39:10.350 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a18412e2:::benchmark_data_smithi018_166993_object94259:head# 2024-02-10T08:39:10.350 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1856453:::benchmark_data_smithi018_166993_object31205:head# 2024-02-10T08:39:10.350 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1870bab:::benchmark_data_smithi018_166993_object33054:head# 2024-02-10T08:39:10.351 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a18777a6:::benchmark_data_smithi018_166993_object52744:head# 2024-02-10T08:39:10.351 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1888698:::benchmark_data_smithi018_166993_object116533:head# 2024-02-10T08:39:10.352 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a188dcdb:::benchmark_data_smithi018_166993_object21322:head# 2024-02-10T08:39:10.355 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a189ed98:::benchmark_data_smithi018_166993_object105580:head# 2024-02-10T08:39:10.357 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a18a4fe1:::benchmark_data_smithi018_166993_object59072:head# 2024-02-10T08:39:10.357 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a18a6ec7:::benchmark_data_smithi018_166993_object115832:head# 2024-02-10T08:39:10.357 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a18ab1bc:::benchmark_data_smithi018_166993_object105833:head# 2024-02-10T08:39:10.357 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a18b8029:::benchmark_data_smithi018_166993_object94371:head# 2024-02-10T08:39:10.357 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a18be4ef:::benchmark_data_smithi018_166993_object99546:head# 2024-02-10T08:39:10.359 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a18c6715:::benchmark_data_smithi018_166993_object114763:head# 2024-02-10T08:39:10.359 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a18c7445:::benchmark_data_smithi018_166993_object103673:head# 2024-02-10T08:39:10.360 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a18cec0f:::benchmark_data_smithi018_166993_object42123:head# 2024-02-10T08:39:10.360 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a18d8417:::benchmark_data_smithi018_166993_object61732:head# 2024-02-10T08:39:10.361 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a18eada0:::benchmark_data_smithi018_166993_object25997:head# 2024-02-10T08:39:10.361 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a18ed449:::benchmark_data_smithi018_166993_object100298:head# 2024-02-10T08:39:10.361 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a18ed4dc:::benchmark_data_smithi018_166993_object65277:head# 2024-02-10T08:39:10.364 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a18f0ead:::benchmark_data_smithi018_166993_object30332:head# 2024-02-10T08:39:10.364 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a18f7140:::benchmark_data_smithi018_166993_object30502:head# 2024-02-10T08:39:10.364 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a18fc33c:::benchmark_data_smithi018_166993_object106305:head# 2024-02-10T08:39:10.365 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a19092a5:::benchmark_data_smithi018_166993_object91165:head# 2024-02-10T08:39:10.365 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a191f779:::benchmark_data_smithi018_166993_object66919:head# 2024-02-10T08:39:10.366 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1927796:::benchmark_data_smithi018_166993_object20644:head# 2024-02-10T08:39:10.367 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1930b3f:::benchmark_data_smithi018_166993_object92262:head# 2024-02-10T08:39:10.367 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1939292:::benchmark_data_smithi018_166993_object116245:head# 2024-02-10T08:39:10.368 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a193a150:::benchmark_data_smithi018_166993_object66706:head# 2024-02-10T08:39:10.368 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a193c2bf:::benchmark_data_smithi018_166993_object71004:head# 2024-02-10T08:39:10.368 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a194052a:::benchmark_data_smithi018_166993_object30232:head# 2024-02-10T08:39:10.373 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1945254:::benchmark_data_smithi018_166993_object107887:head# 2024-02-10T08:39:10.373 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a197fe2d:::benchmark_data_smithi018_166993_object79456:head# 2024-02-10T08:39:10.373 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1983d02:::benchmark_data_smithi018_166993_object42298:head# 2024-02-10T08:39:10.373 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a198fc2b:::benchmark_data_smithi018_166993_object118982:head# 2024-02-10T08:39:10.373 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a199f062:::benchmark_data_smithi018_166993_object34794:head# 2024-02-10T08:39:10.373 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a199f44c:::benchmark_data_smithi018_166993_object107400:head# 2024-02-10T08:39:10.373 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a19af899:::benchmark_data_smithi018_166993_object78014:head# 2024-02-10T08:39:10.376 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a19b57ee:::benchmark_data_smithi018_166993_object69242:head# 2024-02-10T08:39:10.377 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a19b96da:::benchmark_data_smithi018_166993_object19530:head# 2024-02-10T08:39:10.377 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a19c39cd:::benchmark_data_smithi018_166993_object78391:head# 2024-02-10T08:39:10.377 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a19c7561:::benchmark_data_smithi018_166993_object96878:head# 2024-02-10T08:39:10.377 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a19d63e2:::benchmark_data_smithi018_166993_object78991:head# 2024-02-10T08:39:10.377 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a19ff37e:::benchmark_data_smithi018_166993_object107757:head# 2024-02-10T08:39:10.377 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1a01ad0:::benchmark_data_smithi018_166993_object83188:head# 2024-02-10T08:39:10.381 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1a09689:::benchmark_data_smithi018_166993_object106850:head# 2024-02-10T08:39:10.382 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1a20b61:::benchmark_data_smithi018_166993_object41102:head# 2024-02-10T08:39:10.387 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1a3a45f:::benchmark_data_smithi018_166993_object93410:head# 2024-02-10T08:39:10.392 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1a3f22a:::benchmark_data_smithi018_166993_object111479:head# 2024-02-10T08:39:10.392 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1a4019d:::benchmark_data_smithi018_166993_object110690:head# 2024-02-10T08:39:10.392 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1a52651:::benchmark_data_smithi018_166993_object45560:head# 2024-02-10T08:39:10.393 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1a588b2:::benchmark_data_smithi018_166993_object58438:head# 2024-02-10T08:39:10.393 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1a59a7e:::benchmark_data_smithi018_166993_object26589:head# 2024-02-10T08:39:10.393 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1a76c00:::benchmark_data_smithi018_166993_object39372:head# 2024-02-10T08:39:10.393 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1a76c6b:::benchmark_data_smithi018_166993_object23522:head# 2024-02-10T08:39:10.393 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1a78635:::benchmark_data_smithi018_166993_object48647:head# 2024-02-10T08:39:10.393 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1a92afd:::benchmark_data_smithi018_166993_object95122:head# 2024-02-10T08:39:10.395 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1a9bd79:::benchmark_data_smithi018_166993_object94056:head# 2024-02-10T08:39:10.397 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1a9c778:::benchmark_data_smithi018_166993_object100016:head# 2024-02-10T08:39:10.397 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1aaba03:::benchmark_data_smithi018_166993_object58015:head# 2024-02-10T08:39:10.400 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1abf7f3:::benchmark_data_smithi018_166993_object64844:head# 2024-02-10T08:39:10.400 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1ac9c68:::benchmark_data_smithi018_166993_object62477:head# 2024-02-10T08:39:10.400 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1ad3ab1:::benchmark_data_smithi018_166993_object31971:head# 2024-02-10T08:39:10.401 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1ad82c3:::benchmark_data_smithi018_166993_object38174:head# 2024-02-10T08:39:10.401 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1ade9eb:::benchmark_data_smithi018_166993_object110365:head# 2024-02-10T08:39:10.403 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1adfb49:::benchmark_data_smithi018_166993_object69590:head# 2024-02-10T08:39:10.403 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1ae6285:::benchmark_data_smithi018_166993_object38430:head# 2024-02-10T08:39:10.403 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1af20da:::benchmark_data_smithi018_166993_object102927:head# 2024-02-10T08:39:10.403 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:39:10.404 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1afe746:::benchmark_data_smithi018_166993_object67910:head# 2024-02-10T08:39:10.404 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1b01cac:::benchmark_data_smithi018_166993_object66648:head# 2024-02-10T08:39:10.404 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1b035a6:::benchmark_data_smithi018_166993_object49228:head# 2024-02-10T08:39:10.404 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1b06275:::benchmark_data_smithi018_166993_object92308:head# 2024-02-10T08:39:10.405 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1b06eab:::benchmark_data_smithi018_166993_object114575:head# 2024-02-10T08:39:10.406 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1b09fbf:::benchmark_data_smithi018_166993_object79474:head# 2024-02-10T08:39:10.407 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1b17967:::benchmark_data_smithi018_166993_object29491:head# 2024-02-10T08:39:10.407 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1b23d42:::benchmark_data_smithi018_166993_object94513:head# 2024-02-10T08:39:10.408 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1b2501f:::benchmark_data_smithi018_166993_object17857:head# 2024-02-10T08:39:10.409 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1b2b77d:::benchmark_data_smithi018_166993_object26208:head# 2024-02-10T08:39:10.409 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1b32bf1:::benchmark_data_smithi018_166993_object43913:head# 2024-02-10T08:39:10.409 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1b3a948:::benchmark_data_smithi018_166993_object114265:head# 2024-02-10T08:39:10.409 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1b3e413:::benchmark_data_smithi018_166993_object65870:head# 2024-02-10T08:39:10.414 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1b43525:::benchmark_data_smithi018_166993_object41616:head# 2024-02-10T08:39:10.414 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1b5e9c9:::benchmark_data_smithi018_166993_object77606:head# 2024-02-10T08:39:10.415 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1b5fce8:::benchmark_data_smithi018_166993_object58467:head# 2024-02-10T08:39:10.417 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1b634f0:::benchmark_data_smithi018_166993_object73038:head# 2024-02-10T08:39:10.417 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1b66d81:::benchmark_data_smithi018_166993_object32602:head# 2024-02-10T08:39:10.420 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1b6e142:::benchmark_data_smithi018_166993_object117226:head# 2024-02-10T08:39:10.423 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1b75520:::benchmark_data_smithi018_166993_object22021:head# 2024-02-10T08:39:10.425 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1b918d2:::benchmark_data_smithi018_166993_object115061:head# 2024-02-10T08:39:10.425 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1b96aed:::benchmark_data_smithi018_166993_object55288:head# 2024-02-10T08:39:10.425 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1b972e2:::benchmark_data_smithi018_166993_object58899:head# 2024-02-10T08:39:10.427 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1b98757:::benchmark_data_smithi018_166993_object43415:head# 2024-02-10T08:39:10.427 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1bbe9f3:::benchmark_data_smithi018_166993_object75480:head# 2024-02-10T08:39:10.427 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1bc62f2:::benchmark_data_smithi018_166993_object118180:head# 2024-02-10T08:39:10.432 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1bcfc39:::benchmark_data_smithi018_166993_object95577:head# 2024-02-10T08:39:10.432 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1bd2c1e:::benchmark_data_smithi018_166993_object68171:head# 2024-02-10T08:39:10.432 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1be450a:::benchmark_data_smithi018_166993_object39196:head# 2024-02-10T08:39:10.432 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1bebd40:::benchmark_data_smithi018_166993_object19974:head# 2024-02-10T08:39:10.433 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1bf326d:::benchmark_data_smithi018_166993_object61196:head# 2024-02-10T08:39:10.433 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1bfa718:::benchmark_data_smithi018_166993_object106429:head# 2024-02-10T08:39:10.433 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1bfd544:::benchmark_data_smithi018_166993_object96224:head# 2024-02-10T08:39:10.433 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1bfe7b3:::benchmark_data_smithi018_166993_object109524:head# 2024-02-10T08:39:10.434 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1c012aa:::benchmark_data_smithi018_166993_object91924:head# 2024-02-10T08:39:10.434 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1c1cd10:::benchmark_data_smithi018_166993_object34114:head# 2024-02-10T08:39:10.439 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1c1e311:::benchmark_data_smithi018_166993_object36523:head# 2024-02-10T08:39:10.440 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1c2d94d:::benchmark_data_smithi018_166993_object28295:head# 2024-02-10T08:39:10.440 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1c4eec7:::benchmark_data_smithi018_166993_object98272:head# 2024-02-10T08:39:10.440 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1c5ee8e:::benchmark_data_smithi018_166993_object43351:head# 2024-02-10T08:39:10.440 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1c6f0d4:::benchmark_data_smithi018_166993_object51058:head# 2024-02-10T08:39:10.440 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1c7c3d7:::benchmark_data_smithi018_166993_object67293:head# 2024-02-10T08:39:10.440 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1c7cc64:::benchmark_data_smithi018_166993_object66924:head# 2024-02-10T08:39:10.440 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1c96169:::benchmark_data_smithi018_166993_object79366:head# 2024-02-10T08:39:10.441 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1c977b0:::benchmark_data_smithi018_166993_object49398:head# 2024-02-10T08:39:10.441 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1c98bf8:::benchmark_data_smithi018_166993_object56460:head# 2024-02-10T08:39:10.441 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1ca17d1:::benchmark_data_smithi018_166993_object117134:head# 2024-02-10T08:39:10.442 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1ca249a:::benchmark_data_smithi018_166993_object45441:head# 2024-02-10T08:39:10.442 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1cc48f3:::benchmark_data_smithi018_166993_object83645:head# 2024-02-10T08:39:10.443 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1ccbd6d:::benchmark_data_smithi018_166993_object21573:head# 2024-02-10T08:39:10.443 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1ce7ab6:::benchmark_data_smithi018_166993_object77310:head# 2024-02-10T08:39:10.444 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1ceaf93:::benchmark_data_smithi018_166993_object96844:head# 2024-02-10T08:39:10.444 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1cef1f5:::benchmark_data_smithi018_166993_object63620:head# 2024-02-10T08:39:10.445 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1cfac8f:::benchmark_data_smithi018_166993_object114994:head# 2024-02-10T08:39:10.445 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1d08e1e:::benchmark_data_smithi018_166993_object76009:head# 2024-02-10T08:39:10.445 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1d0aae1:::benchmark_data_smithi018_166993_object100662:head# 2024-02-10T08:39:10.446 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1d11f07:::benchmark_data_smithi018_166993_object116519:head# 2024-02-10T08:39:10.446 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1d1b3ed:::benchmark_data_smithi018_166993_object114123:head# 2024-02-10T08:39:10.447 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1d1edbf:::benchmark_data_smithi018_166993_object35784:head# 2024-02-10T08:39:10.447 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:39:10.448 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1d219cb:::benchmark_data_smithi018_166993_object39122:head# 2024-02-10T08:39:10.449 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1d2c75a:::benchmark_data_smithi018_166993_object104052:head# 2024-02-10T08:39:10.449 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1d4074b:::benchmark_data_smithi018_166993_object41438:head# 2024-02-10T08:39:10.450 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1d42966:::benchmark_data_smithi018_166993_object94742:head# 2024-02-10T08:39:10.450 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1d4a7ab:::benchmark_data_smithi018_166993_object84067:head# 2024-02-10T08:39:10.450 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1d54e7d:::benchmark_data_smithi018_166993_object102868:head# 2024-02-10T08:39:10.451 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1d6086a:::benchmark_data_smithi018_166993_object69897:head# 2024-02-10T08:39:10.451 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1d66dda:::benchmark_data_smithi018_166993_object42063:head# 2024-02-10T08:39:10.452 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1d748ef:::benchmark_data_smithi018_166993_object23457:head# 2024-02-10T08:39:10.452 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1d85f4b:::benchmark_data_smithi018_166993_object44408:head# 2024-02-10T08:39:10.453 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1d86cb8:::benchmark_data_smithi018_166993_object99527:head# 2024-02-10T08:39:10.459 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1d91790:::benchmark_data_smithi018_166993_object42579:head# 2024-02-10T08:39:10.459 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1d93f91:::benchmark_data_smithi018_166993_object90708:head# 2024-02-10T08:39:10.460 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1d9df9a:::benchmark_data_smithi018_166993_object60486:head# 2024-02-10T08:39:10.460 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1d9f10d:::benchmark_data_smithi018_166993_object76330:head# 2024-02-10T08:39:10.460 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1da8c2c:::benchmark_data_smithi018_166993_object41685:head# 2024-02-10T08:39:10.460 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1daf3b6:::benchmark_data_smithi018_166993_object83303:head# 2024-02-10T08:39:10.460 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1db8ca7:::benchmark_data_smithi018_166993_object88945:head# 2024-02-10T08:39:10.460 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1dce950:::benchmark_data_smithi018_166993_object81841:head# 2024-02-10T08:39:10.460 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1ddf89f:::benchmark_data_smithi018_166993_object105633:head# 2024-02-10T08:39:10.461 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1de12cf:::benchmark_data_smithi018_166993_object75922:head# 2024-02-10T08:39:10.461 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1dec93f:::benchmark_data_smithi018_166993_object81452:head# 2024-02-10T08:39:10.461 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1e187af:::benchmark_data_smithi018_166993_object48118:head# 2024-02-10T08:39:10.461 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1e1a4b5:::benchmark_data_smithi018_166993_object50799:head# 2024-02-10T08:39:10.462 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1e1d618:::benchmark_data_smithi018_166993_object76432:head# 2024-02-10T08:39:10.462 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1e3e1a0:::benchmark_data_smithi018_166993_object31095:head# 2024-02-10T08:39:10.463 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1e55316:::benchmark_data_smithi018_166993_object49613:head# 2024-02-10T08:39:10.463 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1e5dfc8:::benchmark_data_smithi018_166993_object46564:head# 2024-02-10T08:39:10.464 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1e5e25e:::benchmark_data_smithi018_166993_object95144:head# 2024-02-10T08:39:10.464 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1e64e96:::benchmark_data_smithi018_166993_object36260:head# 2024-02-10T08:39:10.465 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1e699ec:::benchmark_data_smithi018_166993_object36966:head# 2024-02-10T08:39:10.472 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1e73702:::benchmark_data_smithi018_166993_object34636:head# 2024-02-10T08:39:10.472 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1e7b303:::benchmark_data_smithi018_166993_object81300:head# 2024-02-10T08:39:10.472 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1e80a79:::benchmark_data_smithi018_166993_object76175:head# 2024-02-10T08:39:10.472 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1e891e1:::benchmark_data_smithi018_166993_object77354:head# 2024-02-10T08:39:10.472 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1e8a84b:::benchmark_data_smithi018_166993_object73732:head# 2024-02-10T08:39:10.472 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1e8bf84:::benchmark_data_smithi018_166993_object89479:head# 2024-02-10T08:39:10.472 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1e91894:::benchmark_data_smithi018_166993_object82935:head# 2024-02-10T08:39:10.472 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1e9f4c6:::benchmark_data_smithi018_166993_object31779:head# 2024-02-10T08:39:10.472 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1ea18c9:::benchmark_data_smithi018_166993_object34611:head# 2024-02-10T08:39:10.472 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1eb2e62:::benchmark_data_smithi018_166993_object51999:head# 2024-02-10T08:39:10.472 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1ebc495:::benchmark_data_smithi018_166993_object64099:head# 2024-02-10T08:39:10.472 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1ec04e8:::benchmark_data_smithi018_166993_object113976:head# 2024-02-10T08:39:10.472 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1ec2724:::benchmark_data_smithi018_166993_object25427:head# 2024-02-10T08:39:10.472 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1ec8ac8:::benchmark_data_smithi018_166993_object60747:head# 2024-02-10T08:39:10.473 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1ed8106:::benchmark_data_smithi018_166993_object117152:head# 2024-02-10T08:39:10.473 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1ee161d:::benchmark_data_smithi018_166993_object40678:head# 2024-02-10T08:39:10.473 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1eedc2b:::benchmark_data_smithi018_166993_object84662:head# 2024-02-10T08:39:10.473 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1ef0075:::benchmark_data_smithi018_166993_object113309:head# 2024-02-10T08:39:10.477 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1ef6958:::benchmark_data_smithi018_166993_object32483:head# 2024-02-10T08:39:10.485 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1efd2a6:::benchmark_data_smithi018_166993_object77811:head# 2024-02-10T08:39:10.485 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1f0ace3:::benchmark_data_smithi018_166993_object67712:head# 2024-02-10T08:39:10.485 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1f17304:::benchmark_data_smithi018_166993_object29167:head# 2024-02-10T08:39:10.486 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1f340a3:::benchmark_data_smithi018_166993_object34302:head# 2024-02-10T08:39:10.486 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1f4a219:::benchmark_data_smithi018_166993_object106966:head# 2024-02-10T08:39:10.486 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1f4d9d4:::benchmark_data_smithi018_166993_object63084:head# 2024-02-10T08:39:10.486 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1f507d2:::benchmark_data_smithi018_166993_object46253:head# 2024-02-10T08:39:10.486 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1f51283:::benchmark_data_smithi018_166993_object81065:head# 2024-02-10T08:39:10.486 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1f58898:::benchmark_data_smithi018_166993_object92943:head# 2024-02-10T08:39:10.486 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1f5cf6d:::benchmark_data_smithi018_166993_object78170:head# 2024-02-10T08:39:10.486 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1f63698:::benchmark_data_smithi018_166993_object27820:head# 2024-02-10T08:39:10.486 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1f66db9:::benchmark_data_smithi018_166993_object32074:head# 2024-02-10T08:39:10.486 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1f6737d:::benchmark_data_smithi018_166993_object118955:head# 2024-02-10T08:39:10.486 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1f76966:::benchmark_data_smithi018_166993_object24878:head# 2024-02-10T08:39:10.486 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1f868ea:::benchmark_data_smithi018_166993_object115839:head# 2024-02-10T08:39:10.486 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1f8b4d9:::benchmark_data_smithi018_166993_object88356:head# 2024-02-10T08:39:10.486 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1f9c416:::benchmark_data_smithi018_166993_object71028:head# 2024-02-10T08:39:10.487 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1fbcd87:::benchmark_data_smithi018_166993_object60786:head# 2024-02-10T08:39:10.487 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1fc1fbe:::benchmark_data_smithi018_166993_object44696:head# 2024-02-10T08:39:10.487 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1fcf2c2:::benchmark_data_smithi018_166993_object114855:head# 2024-02-10T08:39:10.487 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1fd1680:::benchmark_data_smithi018_166993_object55379:head# 2024-02-10T08:39:10.495 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1fd6fb7:::benchmark_data_smithi018_166993_object62265:head# 2024-02-10T08:39:10.495 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1fe62bb:::benchmark_data_smithi018_166993_object92425:head# 2024-02-10T08:39:10.496 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1feaa84:::benchmark_data_smithi018_166993_object37487:head# 2024-02-10T08:39:10.500 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a1ff3f09:::benchmark_data_smithi018_166993_object34188:head# 2024-02-10T08:39:10.500 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2001b67:::benchmark_data_smithi018_166993_object96815:head# 2024-02-10T08:39:10.500 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a201a673:::benchmark_data_smithi018_166993_object118573:head# 2024-02-10T08:39:10.502 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a20323b6:::benchmark_data_smithi018_166993_object18130:head# 2024-02-10T08:39:10.505 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2034ad4:::benchmark_data_smithi018_166993_object53561:head# 2024-02-10T08:39:10.505 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2036eb6:::benchmark_data_smithi018_166993_object24651:head# 2024-02-10T08:39:10.505 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2038810:::benchmark_data_smithi018_166993_object74149:head# 2024-02-10T08:39:10.506 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a203cce5:::benchmark_data_smithi018_166993_object46975:head# 2024-02-10T08:39:10.506 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2049cea:::benchmark_data_smithi018_166993_object81747:head# 2024-02-10T08:39:10.506 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2066532:::benchmark_data_smithi018_166993_object114004:head# 2024-02-10T08:39:10.506 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2068795:::benchmark_data_smithi018_166993_object117502:head# 2024-02-10T08:39:10.506 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a207cb83:::benchmark_data_smithi018_166993_object20338:head# 2024-02-10T08:39:10.507 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a207f6a2:::benchmark_data_smithi018_166993_object29655:head# 2024-02-10T08:39:10.507 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a209252f:::benchmark_data_smithi018_166993_object116969:head# 2024-02-10T08:39:10.509 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a209287b:::benchmark_data_smithi018_166993_object43248:head# 2024-02-10T08:39:10.510 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a20a8528:::benchmark_data_smithi018_166993_object74335:head# 2024-02-10T08:39:10.510 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a20ad27e:::benchmark_data_smithi018_166993_object35901:head# 2024-02-10T08:39:10.510 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a20b12f6:::benchmark_data_smithi018_166993_object60930:head# 2024-02-10T08:39:10.510 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a20b6026:::benchmark_data_smithi018_166993_object17596:head# 2024-02-10T08:39:10.510 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a20c2219:::benchmark_data_smithi018_166993_object67101:head# 2024-02-10T08:39:10.512 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a20c37ff:::benchmark_data_smithi018_166993_object74851:head# 2024-02-10T08:39:10.512 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a20d2b35:::benchmark_data_smithi018_166993_object95202:head# 2024-02-10T08:39:10.512 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a20ebcaa:::benchmark_data_smithi018_166993_object17820:head# 2024-02-10T08:39:10.513 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a20fe0e3:::benchmark_data_smithi018_166993_object30297:head# 2024-02-10T08:39:10.513 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a210df10:::benchmark_data_smithi018_166993_object53439:head# 2024-02-10T08:39:10.514 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a211a427:::benchmark_data_smithi018_166993_object103255:head# 2024-02-10T08:39:10.515 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a211cf1a:::benchmark_data_smithi018_166993_object36546:head# 2024-02-10T08:39:10.515 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2129a7f:::benchmark_data_smithi018_166993_object103421:head# 2024-02-10T08:39:10.515 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a21336ef:::benchmark_data_smithi018_166993_object85303:head# 2024-02-10T08:39:10.515 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a213da90:::benchmark_data_smithi018_166993_object45185:head# 2024-02-10T08:39:10.515 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a213e190:::benchmark_data_smithi018_166993_object64321:head# 2024-02-10T08:39:10.516 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a214956b:::benchmark_data_smithi018_166993_object106515:head# 2024-02-10T08:39:10.516 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2153df6:::benchmark_data_smithi018_166993_object42426:head# 2024-02-10T08:39:10.517 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2172a3f:::benchmark_data_smithi018_166993_object109829:head# 2024-02-10T08:39:10.517 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:10.517 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2176109:::benchmark_data_smithi018_166993_object53314:head# 2024-02-10T08:39:10.518 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2177ada:::benchmark_data_smithi018_166993_object80232:head# 2024-02-10T08:39:10.518 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a217d283:::benchmark_data_smithi018_166993_object44485:head# 2024-02-10T08:39:10.521 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2180e95:::benchmark_data_smithi018_166993_object115900:head# 2024-02-10T08:39:10.524 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a218554f:::benchmark_data_smithi018_166993_object37449:head# 2024-02-10T08:39:10.524 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a21887e8:::benchmark_data_smithi018_166993_object33961:head# 2024-02-10T08:39:10.524 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a218b079:::benchmark_data_smithi018_166993_object49319:head# 2024-02-10T08:39:10.524 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a219261c:::benchmark_data_smithi018_166993_object108433:head# 2024-02-10T08:39:10.526 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a21a0564:::benchmark_data_smithi018_166993_object110675:head# 2024-02-10T08:39:10.534 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a21a177d:::benchmark_data_smithi018_166993_object64723:head# 2024-02-10T08:39:10.534 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a21ab569:::benchmark_data_smithi018_166993_object38363:head# 2024-02-10T08:39:10.534 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a21b08a3:::benchmark_data_smithi018_166993_object89234:head# 2024-02-10T08:39:10.534 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a21b1f1c:::benchmark_data_smithi018_166993_object69239:head# 2024-02-10T08:39:10.535 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a21bc017:::benchmark_data_smithi018_166993_object64619:head# 2024-02-10T08:39:10.535 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a21bdf5c:::benchmark_data_smithi018_166993_object28087:head# 2024-02-10T08:39:10.535 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a21d0d4d:::benchmark_data_smithi018_166993_object34390:head# 2024-02-10T08:39:10.535 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a21dc2d4:::benchmark_data_smithi018_166993_object101085:head# 2024-02-10T08:39:10.535 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a21e0368:::benchmark_data_smithi018_166993_object87891:head# 2024-02-10T08:39:10.536 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a21f4f85:::benchmark_data_smithi018_166993_object94182:head# 2024-02-10T08:39:10.537 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2212d19:::benchmark_data_smithi018_166993_object48888:head# 2024-02-10T08:39:10.537 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2215643:::benchmark_data_smithi018_166993_object39652:head# 2024-02-10T08:39:10.537 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a221d664:::benchmark_data_smithi018_166993_object57260:head# 2024-02-10T08:39:10.537 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a221e05b:::benchmark_data_smithi018_166993_object98628:head# 2024-02-10T08:39:10.540 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2229f6f:::benchmark_data_smithi018_166993_object24785:head# 2024-02-10T08:39:10.540 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a222c977:::benchmark_data_smithi018_166993_object41059:head# 2024-02-10T08:39:10.540 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a223ee63:::benchmark_data_smithi018_166993_object33969:head# 2024-02-10T08:39:10.540 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a22404f8:::benchmark_data_smithi018_166993_object41775:head# 2024-02-10T08:39:10.541 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a224b414:::benchmark_data_smithi018_166993_object93990:head# 2024-02-10T08:39:10.541 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a224fcfd:::benchmark_data_smithi018_166993_object57735:head# 2024-02-10T08:39:10.541 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a225247c:::benchmark_data_smithi018_166993_object94896:head# 2024-02-10T08:39:10.541 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2257312:::benchmark_data_smithi018_166993_object36014:head# 2024-02-10T08:39:10.544 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2258acc:::benchmark_data_smithi018_166993_object73741:head# 2024-02-10T08:39:10.549 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2259157:::benchmark_data_smithi018_166993_object38232:head# 2024-02-10T08:39:10.549 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a225adf6:::benchmark_data_smithi018_166993_object27712:head# 2024-02-10T08:39:10.550 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a226480d:::benchmark_data_smithi018_166993_object46495:head# 2024-02-10T08:39:10.552 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a226ba2a:::benchmark_data_smithi018_166993_object41395:head# 2024-02-10T08:39:10.556 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a22a4cb8:::benchmark_data_smithi018_166993_object72773:head# 2024-02-10T08:39:10.559 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a22aef14:::benchmark_data_smithi018_166993_object49932:head# 2024-02-10T08:39:10.560 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a22af93c:::benchmark_data_smithi018_166993_object48077:head# 2024-02-10T08:39:10.560 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a22c7af7:::benchmark_data_smithi018_166993_object56933:head# 2024-02-10T08:39:10.560 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a22ca01b:::benchmark_data_smithi018_166993_object94116:head# 2024-02-10T08:39:10.560 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a22cad82:::benchmark_data_smithi018_166993_object79243:head# 2024-02-10T08:39:10.561 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a22d04e3:::benchmark_data_smithi018_166993_object56288:head# 2024-02-10T08:39:10.561 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a22eefe0:::benchmark_data_smithi018_166993_object92196:head# 2024-02-10T08:39:10.562 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a22f9e98:::benchmark_data_smithi018_166993_object93219:head# 2024-02-10T08:39:10.562 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a22fb019:::benchmark_data_smithi018_166993_object17617:head# 2024-02-10T08:39:10.563 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a22fd9f6:::benchmark_data_smithi018_166993_object54295:head# 2024-02-10T08:39:10.563 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a230c7ac:::benchmark_data_smithi018_166993_object48215:head# 2024-02-10T08:39:10.564 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2313ab1:::benchmark_data_smithi018_166993_object89254:head# 2024-02-10T08:39:10.564 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a23176ce:::benchmark_data_smithi018_166993_object78379:head# 2024-02-10T08:39:10.565 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2326498:::benchmark_data_smithi018_166993_object75182:head# 2024-02-10T08:39:10.568 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a233f760:::benchmark_data_smithi018_166993_object21118:head# 2024-02-10T08:39:10.568 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2340e92:::benchmark_data_smithi018_166993_object79433:head# 2024-02-10T08:39:10.568 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a23460f1:::benchmark_data_smithi018_166993_object75835:head# 2024-02-10T08:39:10.569 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2352095:::benchmark_data_smithi018_166993_object71108:head# 2024-02-10T08:39:10.569 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a23665b6:::benchmark_data_smithi018_166993_object53188:head# 2024-02-10T08:39:10.569 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a236d32c:::benchmark_data_smithi018_166993_object106871:head# 2024-02-10T08:39:10.569 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2381aae:::benchmark_data_smithi018_166993_object113762:head# 2024-02-10T08:39:10.572 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a238ace0:::benchmark_data_smithi018_166993_object111157:head# 2024-02-10T08:39:10.572 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a23a2d8e:::benchmark_data_smithi018_166993_object99817:head# 2024-02-10T08:39:10.572 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a23b6708:::benchmark_data_smithi018_166993_object68732:head# 2024-02-10T08:39:10.572 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a23c17d6:::benchmark_data_smithi018_166993_object32489:head# 2024-02-10T08:39:10.576 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:39:10.577 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a23ebe05:::benchmark_data_smithi018_166993_object105361:head# 2024-02-10T08:39:10.577 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a23ebe0c:::benchmark_data_smithi018_166993_object52039:head# 2024-02-10T08:39:10.577 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a23ebfb9:::benchmark_data_smithi018_166993_object42896:head# 2024-02-10T08:39:10.577 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a23fbd61:::benchmark_data_smithi018_166993_object107986:head# 2024-02-10T08:39:10.577 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a24062ec:::benchmark_data_smithi018_166993_object93272:head# 2024-02-10T08:39:10.577 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2415e07:::benchmark_data_smithi018_166993_object97999:head# 2024-02-10T08:39:10.577 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a241bf36:::benchmark_data_smithi018_166993_object75919:head# 2024-02-10T08:39:10.577 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2428325:::benchmark_data_smithi018_166993_object71567:head# 2024-02-10T08:39:10.577 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a24298b5:::benchmark_data_smithi018_166993_object80831:head# 2024-02-10T08:39:10.577 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a244cac1:::benchmark_data_smithi018_166993_object19703:head# 2024-02-10T08:39:10.577 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a24716db:::benchmark_data_smithi018_166993_object117949:head# 2024-02-10T08:39:10.578 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2485247:::benchmark_data_smithi018_166993_object26476:head# 2024-02-10T08:39:10.578 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2488296:::benchmark_data_smithi018_166993_object58710:head# 2024-02-10T08:39:10.578 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a248c245:::benchmark_data_smithi018_166993_object101914:head# 2024-02-10T08:39:10.585 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:10.586 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:39:10.586 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a248d6b8:::benchmark_data_smithi018_166993_object112273:head# 2024-02-10T08:39:10.586 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a248dce8:::benchmark_data_smithi018_166993_object36193:head# 2024-02-10T08:39:10.591 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a249612b:::benchmark_data_smithi018_166993_object77740:head# 2024-02-10T08:39:10.591 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a24a0c13:::benchmark_data_smithi018_166993_object41954:head# 2024-02-10T08:39:10.591 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a24a3a03:::benchmark_data_smithi018_166993_object34126:head# 2024-02-10T08:39:10.591 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a24a7503:::benchmark_data_smithi018_166993_object67568:head# 2024-02-10T08:39:10.592 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a24af615:::benchmark_data_smithi018_166993_object52418:head# 2024-02-10T08:39:10.592 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a24b2b47:::benchmark_data_smithi018_166993_object78085:head# 2024-02-10T08:39:10.595 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a24ba1ae:::benchmark_data_smithi018_166993_object27415:head# 2024-02-10T08:39:10.595 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a24bda30:::benchmark_data_smithi018_166993_object66615:head# 2024-02-10T08:39:10.596 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a24cdf7b:::benchmark_data_smithi018_166993_object77145:head# 2024-02-10T08:39:10.596 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a24cf986:::benchmark_data_smithi018_166993_object80288:head# 2024-02-10T08:39:10.596 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a24dca07:::benchmark_data_smithi018_166993_object111861:head# 2024-02-10T08:39:10.596 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a24e44d3:::benchmark_data_smithi018_166993_object55753:head# 2024-02-10T08:39:10.596 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a24f05d4:::benchmark_data_smithi018_166993_object108034:head# 2024-02-10T08:39:10.601 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a24fc286:::benchmark_data_smithi018_166993_object98856:head# 2024-02-10T08:39:10.601 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2508233:::benchmark_data_smithi018_166993_object95103:head# 2024-02-10T08:39:10.601 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a251a8ee:::benchmark_data_smithi018_166993_object38820:head# 2024-02-10T08:39:10.605 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a251f699:::benchmark_data_smithi018_166993_object70599:head# 2024-02-10T08:39:10.605 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2536234:::benchmark_data_smithi018_166993_object39535:head# 2024-02-10T08:39:10.606 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2542270:::benchmark_data_smithi018_166993_object73515:head# 2024-02-10T08:39:10.606 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a254435d:::benchmark_data_smithi018_166993_object20422:head# 2024-02-10T08:39:10.606 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2550550:::benchmark_data_smithi018_166993_object52083:head# 2024-02-10T08:39:10.606 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a255433a:::benchmark_data_smithi018_166993_object113750:head# 2024-02-10T08:39:10.606 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2559521:::benchmark_data_smithi018_166993_object27751:head# 2024-02-10T08:39:10.607 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a256d677:::benchmark_data_smithi018_166993_object115896:head# 2024-02-10T08:39:10.607 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2571e4b:::benchmark_data_smithi018_166993_object69743:head# 2024-02-10T08:39:10.609 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a25733b5:::benchmark_data_smithi018_166993_object46177:head# 2024-02-10T08:39:10.611 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2576731:::benchmark_data_smithi018_166993_object93462:head# 2024-02-10T08:39:10.611 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a25847aa:::benchmark_data_smithi018_166993_object87030:head# 2024-02-10T08:39:10.611 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2585996:::benchmark_data_smithi018_166993_object29073:head# 2024-02-10T08:39:10.612 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2588132:::benchmark_data_smithi018_166993_object57516:head# 2024-02-10T08:39:10.612 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2597b55:::benchmark_data_smithi018_166993_object69882:head# 2024-02-10T08:39:10.613 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a25a0995:::benchmark_data_smithi018_166993_object60877:head# 2024-02-10T08:39:10.615 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a25e1ded:::benchmark_data_smithi018_166993_object79327:head# 2024-02-10T08:39:10.615 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a25ee4cb:::benchmark_data_smithi018_166993_object62278:head# 2024-02-10T08:39:10.615 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a25ef3b5:::benchmark_data_smithi018_166993_object98767:head# 2024-02-10T08:39:10.615 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a260550a:::benchmark_data_smithi018_166993_object25768:head# 2024-02-10T08:39:10.615 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a261f362:::benchmark_data_smithi018_166993_object87552:head# 2024-02-10T08:39:10.625 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a26231b1:::benchmark_data_smithi018_166993_object111412:head# 2024-02-10T08:39:10.625 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a26310bc:::benchmark_data_smithi018_166993_object115740:head# 2024-02-10T08:39:10.625 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2649651:::benchmark_data_smithi018_166993_object111830:head# 2024-02-10T08:39:10.626 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a264f6f2:::benchmark_data_smithi018_166993_object56696:head# 2024-02-10T08:39:10.626 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2661247:::benchmark_data_smithi018_166993_object81798:head# 2024-02-10T08:39:10.626 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a266a4d6:::benchmark_data_smithi018_166993_object111891:head# 2024-02-10T08:39:10.626 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a26720c3:::benchmark_data_smithi018_166993_object91227:head# 2024-02-10T08:39:10.626 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2674fa9:::benchmark_data_smithi018_166993_object66961:head# 2024-02-10T08:39:10.626 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a26855a1:::benchmark_data_smithi018_166993_object85234:head# 2024-02-10T08:39:10.626 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2692a3b:::benchmark_data_smithi018_166993_object20846:head# 2024-02-10T08:39:10.626 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a269736b:::benchmark_data_smithi018_166993_object78560:head# 2024-02-10T08:39:10.626 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a26a5e16:::benchmark_data_smithi018_166993_object70576:head# 2024-02-10T08:39:10.626 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a26bc6eb:::benchmark_data_smithi018_166993_object118705:head# 2024-02-10T08:39:10.626 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a26bfcd0:::benchmark_data_smithi018_166993_object67701:head# 2024-02-10T08:39:10.626 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a26c2256:::benchmark_data_smithi018_166993_object99399:head# 2024-02-10T08:39:10.626 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a26c531f:::benchmark_data_smithi018_166993_object50791:head# 2024-02-10T08:39:10.626 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a26c939c:::benchmark_data_smithi018_166993_object47646:head# 2024-02-10T08:39:10.626 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a26cc43a:::benchmark_data_smithi018_166993_object89958:head# 2024-02-10T08:39:10.627 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a26d0f68:::benchmark_data_smithi018_166993_object37749:head# 2024-02-10T08:39:10.627 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a26e17cc:::benchmark_data_smithi018_166993_object39594:head# 2024-02-10T08:39:10.627 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a26e1c4e:::benchmark_data_smithi018_166993_object58059:head# 2024-02-10T08:39:10.627 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a26e28b9:::benchmark_data_smithi018_166993_object78786:head# 2024-02-10T08:39:10.627 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a26f71f0:::benchmark_data_smithi018_166993_object109327:head# 2024-02-10T08:39:10.627 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a27055bc:::benchmark_data_smithi018_166993_object117326:head# 2024-02-10T08:39:10.629 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a270c9d4:::benchmark_data_smithi018_166993_object110834:head# 2024-02-10T08:39:10.630 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a27102c2:::benchmark_data_smithi018_166993_object109221:head# 2024-02-10T08:39:10.635 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2713e06:::benchmark_data_smithi018_166993_object59243:head# 2024-02-10T08:39:10.635 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a271d67e:::benchmark_data_smithi018_166993_object32002:head# 2024-02-10T08:39:10.635 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a27221f2:::benchmark_data_smithi018_166993_object84926:head# 2024-02-10T08:39:10.635 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a272a00e:::benchmark_data_smithi018_166993_object118714:head# 2024-02-10T08:39:10.635 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2730bc8:::benchmark_data_smithi018_166993_object53837:head# 2024-02-10T08:39:10.635 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a273e74d:::benchmark_data_smithi018_166993_object44529:head# 2024-02-10T08:39:10.635 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2748b34:::benchmark_data_smithi018_166993_object94432:head# 2024-02-10T08:39:10.636 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a277579c:::benchmark_data_smithi018_166993_object113581:head# 2024-02-10T08:39:10.636 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a277b668:::benchmark_data_smithi018_166993_object47174:head# 2024-02-10T08:39:10.637 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a277d899:::benchmark_data_smithi018_166993_object40557:head# 2024-02-10T08:39:10.637 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a279fd35:::benchmark_data_smithi018_166993_object73648:head# 2024-02-10T08:39:10.639 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a27a10e7:::benchmark_data_smithi018_166993_object109678:head# 2024-02-10T08:39:10.639 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a27dc46b:::benchmark_data_smithi018_166993_object90535:head# 2024-02-10T08:39:10.642 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a27e269d:::benchmark_data_smithi018_166993_object84255:head# 2024-02-10T08:39:10.642 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a27f782e:::benchmark_data_smithi018_166993_object39027:head# 2024-02-10T08:39:10.642 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a27ff010:::benchmark_data_smithi018_166993_object117583:head# 2024-02-10T08:39:10.642 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2803e7d:::benchmark_data_smithi018_166993_object19321:head# 2024-02-10T08:39:10.642 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a28212fa:::benchmark_data_smithi018_166993_object117821:head# 2024-02-10T08:39:10.642 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2824a6f:::benchmark_data_smithi018_166993_object100459:head# 2024-02-10T08:39:10.643 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a282dfbc:::benchmark_data_smithi018_166993_object45384:head# 2024-02-10T08:39:10.643 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a283f6f6:::benchmark_data_smithi018_166993_object34112:head# 2024-02-10T08:39:10.643 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a284514a:::benchmark_data_smithi018_166993_object38691:head# 2024-02-10T08:39:10.644 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2850b0e:::benchmark_data_smithi018_166993_object63638:head# 2024-02-10T08:39:10.644 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a285697e:::benchmark_data_smithi018_166993_object26097:head# 2024-02-10T08:39:10.645 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a285c1d0:::benchmark_data_smithi018_166993_object115974:head# 2024-02-10T08:39:10.645 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a28705be:::benchmark_data_smithi018_166993_object112630:head# 2024-02-10T08:39:10.645 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a288a091:::benchmark_data_smithi018_166993_object44800:head# 2024-02-10T08:39:10.648 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a28930dc:::benchmark_data_smithi018_166993_object49234:head# 2024-02-10T08:39:10.648 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a28a33e3:::benchmark_data_smithi018_166993_object103206:head# 2024-02-10T08:39:10.648 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a28b8783:::benchmark_data_smithi018_166993_object107495:head# 2024-02-10T08:39:10.648 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a28c36d5:::benchmark_data_smithi018_166993_object51493:head# 2024-02-10T08:39:10.648 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a28ca243:::benchmark_data_smithi018_166993_object36209:head# 2024-02-10T08:39:10.648 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a28e3fae:::benchmark_data_smithi018_166993_object37317:head# 2024-02-10T08:39:10.652 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a28e8628:::benchmark_data_smithi018_166993_object93697:head# 2024-02-10T08:39:10.652 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a28ef23a:::benchmark_data_smithi018_166993_object78561:head# 2024-02-10T08:39:10.652 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a29050e7:::benchmark_data_smithi018_166993_object104274:head# 2024-02-10T08:39:10.652 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a29070ab:::benchmark_data_smithi018_166993_object86973:head# 2024-02-10T08:39:10.654 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a290b2fa:::benchmark_data_smithi018_166993_object58969:head# 2024-02-10T08:39:10.654 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2911977:::benchmark_data_smithi018_166993_object31586:head# 2024-02-10T08:39:10.654 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a29199c9:::benchmark_data_smithi018_166993_object81447:head# 2024-02-10T08:39:10.654 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a291cc73:::benchmark_data_smithi018_166993_object87192:head# 2024-02-10T08:39:10.655 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a29235c1:::benchmark_data_smithi018_166993_object79683:head# 2024-02-10T08:39:10.655 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a292a1ee:::benchmark_data_smithi018_166993_object43111:head# 2024-02-10T08:39:10.661 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a29432e9:::benchmark_data_smithi018_166993_object107455:head# 2024-02-10T08:39:10.661 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2946f45:::benchmark_data_smithi018_166993_object27889:head# 2024-02-10T08:39:10.661 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2951bf1:::benchmark_data_smithi018_166993_object102424:head# 2024-02-10T08:39:10.662 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2956c95:::benchmark_data_smithi018_166993_object111005:head# 2024-02-10T08:39:10.662 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2961acb:::benchmark_data_smithi018_166993_object50443:head# 2024-02-10T08:39:10.662 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2965533:::benchmark_data_smithi018_166993_object59233:head# 2024-02-10T08:39:10.663 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a296a810:::benchmark_data_smithi018_166993_object93976:head# 2024-02-10T08:39:10.663 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a298763d:::benchmark_data_smithi018_166993_object25741:head# 2024-02-10T08:39:10.664 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a29bd5b8:::benchmark_data_smithi018_166993_object88754:head# 2024-02-10T08:39:10.664 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a29d24fc:::benchmark_data_smithi018_166993_object91184:head# 2024-02-10T08:39:10.665 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a29da504:::benchmark_data_smithi018_166993_object41227:head# 2024-02-10T08:39:10.667 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a29dfce0:::benchmark_data_smithi018_166993_object112053:head# 2024-02-10T08:39:10.667 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a29e493f:::benchmark_data_smithi018_166993_object57141:head# 2024-02-10T08:39:10.667 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a29e65f8:::benchmark_data_smithi018_166993_object65885:head# 2024-02-10T08:39:10.667 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a29ea77f:::benchmark_data_smithi018_166993_object51266:head# 2024-02-10T08:39:10.667 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2a07c68:::benchmark_data_smithi018_166993_object111750:head# 2024-02-10T08:39:10.668 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2a1d79b:::benchmark_data_smithi018_166993_object73747:head# 2024-02-10T08:39:10.668 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2a1fc79:::benchmark_data_smithi018_166993_object82835:head# 2024-02-10T08:39:10.672 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2a226af:::benchmark_data_smithi018_166993_object31724:head# 2024-02-10T08:39:10.672 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2a29f3d:::benchmark_data_smithi018_166993_object61826:head# 2024-02-10T08:39:10.672 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2a3ebc6:::benchmark_data_smithi018_166993_object44266:head# 2024-02-10T08:39:10.672 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2a4de6f:::benchmark_data_smithi018_166993_object116829:head# 2024-02-10T08:39:10.673 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2a55554:::benchmark_data_smithi018_166993_object41041:head# 2024-02-10T08:39:10.673 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2a76b89:::benchmark_data_smithi018_166993_object83704:head# 2024-02-10T08:39:10.673 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2a84bf5:::benchmark_data_smithi018_166993_object84091:head# 2024-02-10T08:39:10.673 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2a89d8e:::benchmark_data_smithi018_166993_object45192:head# 2024-02-10T08:39:10.673 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2a8a87d:::benchmark_data_smithi018_166993_object41358:head# 2024-02-10T08:39:10.673 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2aa95fe:::benchmark_data_smithi018_166993_object45263:head# 2024-02-10T08:39:10.677 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2ab6a2a:::benchmark_data_smithi018_166993_object115675:head# 2024-02-10T08:39:10.677 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2ab8904:::benchmark_data_smithi018_166993_object46261:head# 2024-02-10T08:39:10.677 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2abf980:::benchmark_data_smithi018_166993_object33219:head# 2024-02-10T08:39:10.677 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2ac60b5:::benchmark_data_smithi018_166993_object105113:head# 2024-02-10T08:39:10.677 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2ac66b9:::benchmark_data_smithi018_166993_object67586:head# 2024-02-10T08:39:10.678 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2ac7d64:::benchmark_data_smithi018_166993_object59761:head# 2024-02-10T08:39:10.682 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2ad0da5:::benchmark_data_smithi018_166993_object48681:head# 2024-02-10T08:39:10.682 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2ad2881:::benchmark_data_smithi018_166993_object64976:head# 2024-02-10T08:39:10.682 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2ae867c:::benchmark_data_smithi018_166993_object39877:head# 2024-02-10T08:39:10.682 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2afc328:::benchmark_data_smithi018_166993_object50679:head# 2024-02-10T08:39:10.684 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2afce5b:::benchmark_data_smithi018_166993_object48966:head# 2024-02-10T08:39:10.684 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2b00a28:::benchmark_data_smithi018_166993_object35978:head# 2024-02-10T08:39:10.684 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2b04206:::benchmark_data_smithi018_166993_object33593:head# 2024-02-10T08:39:10.684 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2b083d7:::benchmark_data_smithi018_166993_object18537:head# 2024-02-10T08:39:10.684 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2b091e8:::benchmark_data_smithi018_166993_object50944:head# 2024-02-10T08:39:10.686 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2b126ee:::benchmark_data_smithi018_166993_object40921:head# 2024-02-10T08:39:10.686 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2b1435e:::benchmark_data_smithi018_166993_object88482:head# 2024-02-10T08:39:10.686 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2b37249:::benchmark_data_smithi018_166993_object22139:head# 2024-02-10T08:39:10.686 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2b3ba1c:::benchmark_data_smithi018_166993_object85939:head# 2024-02-10T08:39:10.686 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2b463c7:::benchmark_data_smithi018_166993_object84541:head# 2024-02-10T08:39:10.687 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2b5896b:::benchmark_data_smithi018_166993_object72923:head# 2024-02-10T08:39:10.687 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:39:10.687 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2b61d75:::benchmark_data_smithi018_166993_object66311:head# 2024-02-10T08:39:10.688 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2b66003:::benchmark_data_smithi018_166993_object102469:head# 2024-02-10T08:39:10.690 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2b6f13c:::benchmark_data_smithi018_166993_object106721:head# 2024-02-10T08:39:10.691 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2b7b2c8:::benchmark_data_smithi018_166993_object24360:head# 2024-02-10T08:39:10.691 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2b7d7f6:::benchmark_data_smithi018_166993_object101835:head# 2024-02-10T08:39:10.691 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2b8eba3:::benchmark_data_smithi018_166993_object35462:head# 2024-02-10T08:39:10.693 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2b90759:::benchmark_data_smithi018_166993_object46928:head# 2024-02-10T08:39:10.693 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2b96c62:::benchmark_data_smithi018_166993_object57033:head# 2024-02-10T08:39:10.694 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2b9c1ec:::benchmark_data_smithi018_166993_object42685:head# 2024-02-10T08:39:10.694 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2ba65d0:::benchmark_data_smithi018_166993_object92799:head# 2024-02-10T08:39:10.695 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2bb89d8:::benchmark_data_smithi018_166993_object68248:head# 2024-02-10T08:39:10.695 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2bd9dfe:::benchmark_data_smithi018_166993_object82743:head# 2024-02-10T08:39:10.704 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2bdffea:::benchmark_data_smithi018_166993_object28734:head# 2024-02-10T08:39:10.704 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2be3af9:::benchmark_data_smithi018_166993_object86218:head# 2024-02-10T08:39:10.705 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2be4be6:::benchmark_data_smithi018_166993_object78350:head# 2024-02-10T08:39:10.705 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2be6a46:::benchmark_data_smithi018_166993_object115707:head# 2024-02-10T08:39:10.710 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2be751f:::benchmark_data_smithi018_166993_object43467:head# 2024-02-10T08:39:10.710 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2bf2276:::benchmark_data_smithi018_166993_object92809:head# 2024-02-10T08:39:10.710 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2c0099d:::benchmark_data_smithi018_166993_object86084:head# 2024-02-10T08:39:10.710 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2c027c7:::benchmark_data_smithi018_166993_object103263:head# 2024-02-10T08:39:10.711 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2c108c5:::benchmark_data_smithi018_166993_object93812:head# 2024-02-10T08:39:10.712 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2c147bf:::benchmark_data_smithi018_166993_object55912:head# 2024-02-10T08:39:10.715 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2c18995:::benchmark_data_smithi018_166993_object56064:head# 2024-02-10T08:39:10.716 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2c2b775:::benchmark_data_smithi018_166993_object103277:head# 2024-02-10T08:39:10.722 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2c344a8:::benchmark_data_smithi018_166993_object100006:head# 2024-02-10T08:39:10.722 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2c3d179:::benchmark_data_smithi018_166993_object41000:head# 2024-02-10T08:39:10.723 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2c41148:::benchmark_data_smithi018_166993_object53366:head# 2024-02-10T08:39:10.723 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2c44b05:::benchmark_data_smithi018_166993_object65031:head# 2024-02-10T08:39:10.723 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2c55dad:::benchmark_data_smithi018_166993_object29874:head# 2024-02-10T08:39:10.723 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2c5b5e0:::benchmark_data_smithi018_166993_object18247:head# 2024-02-10T08:39:10.723 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2c5deff:::benchmark_data_smithi018_166993_object59046:head# 2024-02-10T08:39:10.723 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2c689b1:::benchmark_data_smithi018_166993_object38094:head# 2024-02-10T08:39:10.723 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2c6cc3a:::benchmark_data_smithi018_166993_object106150:head# 2024-02-10T08:39:10.723 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2c75a05:::benchmark_data_smithi018_166993_object32054:head# 2024-02-10T08:39:10.724 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2c780c5:::benchmark_data_smithi018_166993_object69783:head# 2024-02-10T08:39:10.724 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2c82aa1:::benchmark_data_smithi018_166993_object47343:head# 2024-02-10T08:39:10.724 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2c83419:::benchmark_data_smithi018_166993_object80429:head# 2024-02-10T08:39:10.724 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2c918ee:::benchmark_data_smithi018_166993_object98707:head# 2024-02-10T08:39:10.724 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2c9d1a9:::benchmark_data_smithi018_166993_object22668:head# 2024-02-10T08:39:10.725 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2ca8729:::benchmark_data_smithi018_166993_object39961:head# 2024-02-10T08:39:10.725 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2cae01d:::benchmark_data_smithi018_166993_object19016:head# 2024-02-10T08:39:10.726 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2cbaf4a:::benchmark_data_smithi018_166993_object65256:head# 2024-02-10T08:39:10.726 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2cc389e:::benchmark_data_smithi018_166993_object98688:head# 2024-02-10T08:39:10.727 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2ccb43d:::benchmark_data_smithi018_166993_object57809:head# 2024-02-10T08:39:10.727 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2ccf1a5:::benchmark_data_smithi018_166993_object93106:head# 2024-02-10T08:39:10.728 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2cd49f0:::benchmark_data_smithi018_166993_object18742:head# 2024-02-10T08:39:10.729 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2cd57c1:::benchmark_data_smithi018_166993_object25382:head# 2024-02-10T08:39:10.729 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2cd778f:::benchmark_data_smithi018_166993_object19015:head# 2024-02-10T08:39:10.729 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2cdf7a1:::benchmark_data_smithi018_166993_object56505:head# 2024-02-10T08:39:10.730 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2d0ef38:::benchmark_data_smithi018_166993_object105881:head# 2024-02-10T08:39:10.730 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2d13366:::benchmark_data_smithi018_166993_object38156:head# 2024-02-10T08:39:10.731 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2d16633:::benchmark_data_smithi018_166993_object115125:head# 2024-02-10T08:39:10.731 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2d1d859:::benchmark_data_smithi018_166993_object88175:head# 2024-02-10T08:39:10.731 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2d1ed70:::benchmark_data_smithi018_166993_object49040:head# 2024-02-10T08:39:10.734 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2d25e6c:::benchmark_data_smithi018_166993_object38033:head# 2024-02-10T08:39:10.734 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2d29d18:::benchmark_data_smithi018_166993_object106526:head# 2024-02-10T08:39:10.734 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2d2c3ee:::benchmark_data_smithi018_166993_object96471:head# 2024-02-10T08:39:10.734 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2d37942:::benchmark_data_smithi018_166993_object68245:head# 2024-02-10T08:39:10.734 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2d3d968:::benchmark_data_smithi018_166993_object29298:head# 2024-02-10T08:39:10.735 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2d3ec6b:::benchmark_data_smithi018_166993_object36445:head# 2024-02-10T08:39:10.735 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2d40f02:::benchmark_data_smithi018_166993_object44525:head# 2024-02-10T08:39:10.737 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2d5ccc5:::benchmark_data_smithi018_166993_object97369:head# 2024-02-10T08:39:10.738 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2d627e6:::benchmark_data_smithi018_166993_object54556:head# 2024-02-10T08:39:10.738 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2d64384:::benchmark_data_smithi018_166993_object77482:head# 2024-02-10T08:39:10.738 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2d655cd:::benchmark_data_smithi018_166993_object116722:head# 2024-02-10T08:39:10.738 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2d661fd:::benchmark_data_smithi018_166993_object107023:head# 2024-02-10T08:39:10.738 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2d6e053:::benchmark_data_smithi018_166993_object34829:head# 2024-02-10T08:39:10.739 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:10.739 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2d72b48:::benchmark_data_smithi018_166993_object112928:head# 2024-02-10T08:39:10.739 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2dac353:::benchmark_data_smithi018_166993_object88943:head# 2024-02-10T08:39:10.740 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2dc80c1:::benchmark_data_smithi018_166993_object48932:head# 2024-02-10T08:39:10.740 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2dd55c4:::benchmark_data_smithi018_166993_object39055:head# 2024-02-10T08:39:10.741 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2ddd185:::benchmark_data_smithi018_166993_object90809:head# 2024-02-10T08:39:10.741 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2deb69d:::benchmark_data_smithi018_166993_object61109:head# 2024-02-10T08:39:10.742 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2dfd871:::benchmark_data_smithi018_166993_object35762:head# 2024-02-10T08:39:10.742 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2dfdfe8:::benchmark_data_smithi018_166993_object56398:head# 2024-02-10T08:39:10.747 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2dfe3fc:::benchmark_data_smithi018_166993_object76415:head# 2024-02-10T08:39:10.748 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2e0468f:::benchmark_data_smithi018_166993_object29903:head# 2024-02-10T08:39:10.748 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2e04708:::benchmark_data_smithi018_166993_object46221:head# 2024-02-10T08:39:10.748 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2e38e6d:::benchmark_data_smithi018_166993_object62465:head# 2024-02-10T08:39:10.748 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2e3aeea:::benchmark_data_smithi018_166993_object59076:head# 2024-02-10T08:39:10.748 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2e40482:::benchmark_data_smithi018_166993_object46451:head# 2024-02-10T08:39:10.748 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2e545a3:::benchmark_data_smithi018_166993_object53958:head# 2024-02-10T08:39:10.752 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2e54d88:::benchmark_data_smithi018_166993_object104833:head# 2024-02-10T08:39:10.753 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2e58e24:::benchmark_data_smithi018_166993_object30670:head# 2024-02-10T08:39:10.753 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2e66f81:::benchmark_data_smithi018_166993_object62073:head# 2024-02-10T08:39:10.753 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2e686fc:::benchmark_data_smithi018_166993_object96156:head# 2024-02-10T08:39:10.753 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2e6d47e:::benchmark_data_smithi018_166993_object57416:head# 2024-02-10T08:39:10.753 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2e718ce:::benchmark_data_smithi018_166993_object61745:head# 2024-02-10T08:39:10.753 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2e7d712:::benchmark_data_smithi018_166993_object66092:head# 2024-02-10T08:39:10.753 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2e8eac6:::benchmark_data_smithi018_166993_object76015:head# 2024-02-10T08:39:10.753 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2e98f0c:::benchmark_data_smithi018_166993_object18554:head# 2024-02-10T08:39:10.754 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2ea17b2:::benchmark_data_smithi018_166993_object86654:head# 2024-02-10T08:39:10.754 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2ea975d:::benchmark_data_smithi018_166993_object62228:head# 2024-02-10T08:39:10.754 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2eb2852:::benchmark_data_smithi018_166993_object75694:head# 2024-02-10T08:39:10.755 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2eb842c:::benchmark_data_smithi018_166993_object79106:head# 2024-02-10T08:39:10.756 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2eb9b2a:::benchmark_data_smithi018_166993_object80121:head# 2024-02-10T08:39:10.757 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2ebe991:::benchmark_data_smithi018_166993_object45086:head# 2024-02-10T08:39:10.757 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2ebfdd6:::benchmark_data_smithi018_166993_object34453:head# 2024-02-10T08:39:10.757 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2ecf2f0:::benchmark_data_smithi018_166993_object73774:head# 2024-02-10T08:39:10.763 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2ed0ce1:::benchmark_data_smithi018_166993_object88022:head# 2024-02-10T08:39:10.763 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2ee7564:::benchmark_data_smithi018_166993_object64242:head# 2024-02-10T08:39:10.763 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2ee9a4e:::benchmark_data_smithi018_166993_object116321:head# 2024-02-10T08:39:10.763 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2eec3fe:::benchmark_data_smithi018_166993_object48524:head# 2024-02-10T08:39:10.763 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2eeece4:::benchmark_data_smithi018_166993_object103355:head# 2024-02-10T08:39:10.764 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2efb57d:::benchmark_data_smithi018_166993_object72669:head# 2024-02-10T08:39:10.765 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2efdd82:::benchmark_data_smithi018_166993_object53995:head# 2024-02-10T08:39:10.766 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2f03173:::benchmark_data_smithi018_166993_object61681:head# 2024-02-10T08:39:10.766 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2f0cd1d:::benchmark_data_smithi018_166993_object91741:head# 2024-02-10T08:39:10.767 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2f0d8e8:::benchmark_data_smithi018_166993_object48447:head# 2024-02-10T08:39:10.767 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2f1a208:::benchmark_data_smithi018_166993_object64585:head# 2024-02-10T08:39:10.768 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2f24611:::benchmark_data_smithi018_166993_object108224:head# 2024-02-10T08:39:10.768 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2f287b8:::benchmark_data_smithi018_166993_object58337:head# 2024-02-10T08:39:10.768 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2f2a2b6:::benchmark_data_smithi018_166993_object46468:head# 2024-02-10T08:39:10.769 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2f2b737:::benchmark_data_smithi018_166993_object61181:head# 2024-02-10T08:39:10.769 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2f44e3e:::benchmark_data_smithi018_166993_object99203:head# 2024-02-10T08:39:10.770 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2f4c5a3:::benchmark_data_smithi018_166993_object65868:head# 2024-02-10T08:39:10.771 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2f62424:::benchmark_data_smithi018_166993_object68253:head# 2024-02-10T08:39:10.771 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2f677f5:::benchmark_data_smithi018_166993_object35137:head# 2024-02-10T08:39:10.773 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2f743fd:::benchmark_data_smithi018_166993_object76194:head# 2024-02-10T08:39:10.774 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2f7f24b:::benchmark_data_smithi018_166993_object42703:head# 2024-02-10T08:39:10.774 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2f8855f:::benchmark_data_smithi018_166993_object98384:head# 2024-02-10T08:39:10.774 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2f8a338:::benchmark_data_smithi018_166993_object50934:head# 2024-02-10T08:39:10.774 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2f92ec3:::benchmark_data_smithi018_166993_object40423:head# 2024-02-10T08:39:10.778 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2f9d693:::benchmark_data_smithi018_166993_object60268:head# 2024-02-10T08:39:10.783 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2fa085d:::benchmark_data_smithi018_166993_object82807:head# 2024-02-10T08:39:10.784 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2fd25a4:::benchmark_data_smithi018_166993_object20498:head# 2024-02-10T08:39:10.786 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2fd294f:::benchmark_data_smithi018_166993_object98151:head# 2024-02-10T08:39:10.787 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2fd736f:::benchmark_data_smithi018_166993_object96559:head# 2024-02-10T08:39:10.787 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2fd8392:::benchmark_data_smithi018_166993_object38283:head# 2024-02-10T08:39:10.788 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a2ff7243:::benchmark_data_smithi018_166993_object104787:head# 2024-02-10T08:39:10.788 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3002856:::benchmark_data_smithi018_166993_object79157:head# 2024-02-10T08:39:10.789 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a300c274:::benchmark_data_smithi018_166993_object103186:head# 2024-02-10T08:39:10.789 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3022b4e:::benchmark_data_smithi018_166993_object20267:head# 2024-02-10T08:39:10.793 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a302beec:::benchmark_data_smithi018_166993_object107243:head# 2024-02-10T08:39:10.795 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3037df4:::benchmark_data_smithi018_166993_object73803:head# 2024-02-10T08:39:10.797 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3052393:::benchmark_data_smithi018_166993_object87838:head# 2024-02-10T08:39:10.797 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3056bed:::benchmark_data_smithi018_166993_object57963:head# 2024-02-10T08:39:10.797 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a305cea5:::benchmark_data_smithi018_166993_object93467:head# 2024-02-10T08:39:10.801 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a307e51e:::benchmark_data_smithi018_166993_object25859:head# 2024-02-10T08:39:10.801 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3087878:::benchmark_data_smithi018_166993_object102226:head# 2024-02-10T08:39:10.801 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a30aaee7:::benchmark_data_smithi018_166993_object72943:head# 2024-02-10T08:39:10.801 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a30cb911:::benchmark_data_smithi018_166993_object85102:head# 2024-02-10T08:39:10.802 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a30e1db1:::benchmark_data_smithi018_166993_object118678:head# 2024-02-10T08:39:10.802 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a30f763c:::benchmark_data_smithi018_166993_object30153:head# 2024-02-10T08:39:10.803 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a30face8:::benchmark_data_smithi018_166993_object87075:head# 2024-02-10T08:39:10.808 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a30ffae9:::benchmark_data_smithi018_166993_object50290:head# 2024-02-10T08:39:10.808 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3103381:::benchmark_data_smithi018_166993_object53905:head# 2024-02-10T08:39:10.811 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3106619:::benchmark_data_smithi018_166993_object90116:head# 2024-02-10T08:39:10.813 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3107045:::benchmark_data_smithi018_166993_object54559:head# 2024-02-10T08:39:10.814 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a310b110:::benchmark_data_smithi018_166993_object52005:head# 2024-02-10T08:39:10.816 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a310ef50:::benchmark_data_smithi018_166993_object27983:head# 2024-02-10T08:39:10.816 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a31100ee:::benchmark_data_smithi018_166993_object99378:head# 2024-02-10T08:39:10.817 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a311c8c4:::benchmark_data_smithi018_166993_object89273:head# 2024-02-10T08:39:10.817 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a311d7f1:::benchmark_data_smithi018_166993_object113821:head# 2024-02-10T08:39:10.817 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3121ce1:::benchmark_data_smithi018_166993_object21969:head# 2024-02-10T08:39:10.817 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a312af20:::benchmark_data_smithi018_166993_object85193:head# 2024-02-10T08:39:10.819 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3130292:::benchmark_data_smithi018_166993_object81964:head# 2024-02-10T08:39:10.820 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3137008:::benchmark_data_smithi018_166993_object116137:head# 2024-02-10T08:39:10.820 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a313b0fc:::benchmark_data_smithi018_166993_object55823:head# 2024-02-10T08:39:10.821 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a313e342:::benchmark_data_smithi018_166993_object33406:head# 2024-02-10T08:39:10.823 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a31676b9:::benchmark_data_smithi018_166993_object81616:head# 2024-02-10T08:39:10.824 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a316e163:::benchmark_data_smithi018_166993_object99589:head# 2024-02-10T08:39:10.824 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a31796d3:::benchmark_data_smithi018_166993_object49567:head# 2024-02-10T08:39:10.824 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a317fe4b:::benchmark_data_smithi018_166993_object80937:head# 2024-02-10T08:39:10.826 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3195cf0:::benchmark_data_smithi018_166993_object118826:head# 2024-02-10T08:39:10.827 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a31abeb2:::benchmark_data_smithi018_166993_object28008:head# 2024-02-10T08:39:10.832 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a31acf8d:::benchmark_data_smithi018_166993_object28946:head# 2024-02-10T08:39:10.832 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a31c2344:::benchmark_data_smithi018_166993_object21602:head# 2024-02-10T08:39:10.832 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a31c365b:::benchmark_data_smithi018_166993_object107229:head# 2024-02-10T08:39:10.832 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a31c8e84:::benchmark_data_smithi018_166993_object59095:head# 2024-02-10T08:39:10.832 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a31d00fa:::benchmark_data_smithi018_166993_object58596:head# 2024-02-10T08:39:10.832 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a31d0673:::benchmark_data_smithi018_166993_object80880:head# 2024-02-10T08:39:10.832 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a31e6469:::benchmark_data_smithi018_166993_object96035:head# 2024-02-10T08:39:10.832 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a31ec3eb:::benchmark_data_smithi018_166993_object116572:head# 2024-02-10T08:39:10.832 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a31f1d91:::benchmark_data_smithi018_166993_object20550:head# 2024-02-10T08:39:10.834 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a32036b6:::benchmark_data_smithi018_166993_object101203:head# 2024-02-10T08:39:10.835 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a320801b:::benchmark_data_smithi018_166993_object111224:head# 2024-02-10T08:39:10.837 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a32102e7:::benchmark_data_smithi018_166993_object91076:head# 2024-02-10T08:39:10.841 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3210d09:::benchmark_data_smithi018_166993_object19742:head# 2024-02-10T08:39:10.842 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a321caad:::benchmark_data_smithi018_166993_object38866:head# 2024-02-10T08:39:10.846 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a321df94:::benchmark_data_smithi018_166993_object107939:head# 2024-02-10T08:39:10.847 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a321e580:::benchmark_data_smithi018_166993_object110373:head# 2024-02-10T08:39:10.847 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3223d46:::benchmark_data_smithi018_166993_object110464:head# 2024-02-10T08:39:10.849 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a322c71d:::benchmark_data_smithi018_166993_object74443:head# 2024-02-10T08:39:10.849 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a323d98c:::benchmark_data_smithi018_166993_object41090:head# 2024-02-10T08:39:10.850 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a323e81c:::benchmark_data_smithi018_166993_object36696:head# 2024-02-10T08:39:10.851 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a324700f:::benchmark_data_smithi018_166993_object92054:head# 2024-02-10T08:39:10.855 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a32495f8:::benchmark_data_smithi018_166993_object51061:head# 2024-02-10T08:39:10.855 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a324aecc:::benchmark_data_smithi018_166993_object67532:head# 2024-02-10T08:39:10.855 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a325334c:::benchmark_data_smithi018_166993_object59467:head# 2024-02-10T08:39:10.855 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3279079:::benchmark_data_smithi018_166993_object34263:head# 2024-02-10T08:39:10.855 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a327b30c:::benchmark_data_smithi018_166993_object114211:head# 2024-02-10T08:39:10.857 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a329a039:::benchmark_data_smithi018_166993_object116140:head# 2024-02-10T08:39:10.858 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a32a6830:::benchmark_data_smithi018_166993_object38091:head# 2024-02-10T08:39:10.858 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a32abb71:::benchmark_data_smithi018_166993_object49825:head# 2024-02-10T08:39:10.858 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a32bad8a:::benchmark_data_smithi018_166993_object106550:head# 2024-02-10T08:39:10.859 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a32bc7a6:::benchmark_data_smithi018_166993_object44703:head# 2024-02-10T08:39:10.861 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a32c86f6:::benchmark_data_smithi018_166993_object68468:head# 2024-02-10T08:39:10.861 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a32e1d5b:::benchmark_data_smithi018_166993_object61169:head# 2024-02-10T08:39:10.861 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a32ea512:::benchmark_data_smithi018_166993_object85013:head# 2024-02-10T08:39:10.861 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a32fb7a9:::benchmark_data_smithi018_166993_object88999:head# 2024-02-10T08:39:10.862 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3300b39:::benchmark_data_smithi018_166993_object112859:head# 2024-02-10T08:39:10.863 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3304a69:::benchmark_data_smithi018_166993_object31987:head# 2024-02-10T08:39:10.863 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a33200dd:::benchmark_data_smithi018_166993_object108567:head# 2024-02-10T08:39:10.863 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a332c455:::benchmark_data_smithi018_166993_object71511:head# 2024-02-10T08:39:10.864 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3330abb:::benchmark_data_smithi018_166993_object54925:head# 2024-02-10T08:39:10.864 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3334387:::benchmark_data_smithi018_166993_object59843:head# 2024-02-10T08:39:10.865 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a33393c5:::benchmark_data_smithi018_166993_object104203:head# 2024-02-10T08:39:10.865 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a335a87e:::benchmark_data_smithi018_166993_object103754:head# 2024-02-10T08:39:10.866 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a336ed5e:::benchmark_data_smithi018_166993_object25569:head# 2024-02-10T08:39:10.866 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a337b40a:::benchmark_data_smithi018_166993_object103388:head# 2024-02-10T08:39:10.867 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a338d2a2:::benchmark_data_smithi018_166993_object24434:head# 2024-02-10T08:39:10.867 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a33952a1:::benchmark_data_smithi018_166993_object24392:head# 2024-02-10T08:39:10.870 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a339c8f8:::benchmark_data_smithi018_166993_object97566:head# 2024-02-10T08:39:10.870 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a33a030d:::benchmark_data_smithi018_166993_object81845:head# 2024-02-10T08:39:10.870 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a33a12de:::benchmark_data_smithi018_166993_object62641:head# 2024-02-10T08:39:10.870 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a33b6856:::benchmark_data_smithi018_166993_object39460:head# 2024-02-10T08:39:10.871 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a33be165:::benchmark_data_smithi018_166993_object77902:head# 2024-02-10T08:39:10.876 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a33c0fdb:::benchmark_data_smithi018_166993_object29681:head# 2024-02-10T08:39:10.876 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a33c4f39:::benchmark_data_smithi018_166993_object85381:head# 2024-02-10T08:39:10.877 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a33c60bf:::benchmark_data_smithi018_166993_object95531:head# 2024-02-10T08:39:10.877 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a33c9508:::benchmark_data_smithi018_166993_object77371:head# 2024-02-10T08:39:10.878 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a33dbca4:::benchmark_data_smithi018_166993_object61233:head# 2024-02-10T08:39:10.878 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a33eb886:::benchmark_data_smithi018_166993_object84725:head# 2024-02-10T08:39:10.879 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a33fcda8:::benchmark_data_smithi018_166993_object108020:head# 2024-02-10T08:39:10.879 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3400785:::benchmark_data_smithi018_166993_object60344:head# 2024-02-10T08:39:10.879 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3401af2:::benchmark_data_smithi018_166993_object25940:head# 2024-02-10T08:39:10.882 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3412864:::benchmark_data_smithi018_166993_object21566:head# 2024-02-10T08:39:10.883 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3414e34:::benchmark_data_smithi018_166993_object87268:head# 2024-02-10T08:39:10.883 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3418f39:::benchmark_data_smithi018_166993_object34594:head# 2024-02-10T08:39:10.883 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a34198fc:::benchmark_data_smithi018_166993_object104220:head# 2024-02-10T08:39:10.884 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a343cc8d:::benchmark_data_smithi018_166993_object40750:head# 2024-02-10T08:39:10.885 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a343d7f3:::benchmark_data_smithi018_166993_object117589:head# 2024-02-10T08:39:10.885 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3455878:::benchmark_data_smithi018_166993_object27056:head# 2024-02-10T08:39:10.887 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a345e3f5:::benchmark_data_smithi018_166993_object29688:head# 2024-02-10T08:39:10.887 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3460f23:::benchmark_data_smithi018_166993_object69487:head# 2024-02-10T08:39:10.887 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a346f8e4:::benchmark_data_smithi018_166993_object87886:head# 2024-02-10T08:39:10.887 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3471693:::benchmark_data_smithi018_166993_object61351:head# 2024-02-10T08:39:10.887 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a347b77f:::benchmark_data_smithi018_166993_object58652:head# 2024-02-10T08:39:10.888 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a347cb81:::benchmark_data_smithi018_166993_object80546:head# 2024-02-10T08:39:10.888 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a348f754:::benchmark_data_smithi018_166993_object117618:head# 2024-02-10T08:39:10.890 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3498481:::benchmark_data_smithi018_166993_object24009:head# 2024-02-10T08:39:10.890 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a349b605:::benchmark_data_smithi018_166993_object109995:head# 2024-02-10T08:39:10.890 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a349d0ed:::benchmark_data_smithi018_166993_object62309:head# 2024-02-10T08:39:10.890 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a34a0b80:::benchmark_data_smithi018_166993_object104755:head# 2024-02-10T08:39:10.891 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a34cda79:::benchmark_data_smithi018_166993_object23749:head# 2024-02-10T08:39:10.891 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a34d8411:::benchmark_data_smithi018_166993_object60495:head# 2024-02-10T08:39:10.891 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a34dd57a:::benchmark_data_smithi018_166993_object32046:head# 2024-02-10T08:39:10.892 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a34e0a6a:::benchmark_data_smithi018_166993_object26262:head# 2024-02-10T08:39:10.893 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a34e12fb:::benchmark_data_smithi018_166993_object103486:head# 2024-02-10T08:39:10.893 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a34e69fe:::benchmark_data_smithi018_166993_object102856:head# 2024-02-10T08:39:10.894 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3518b71:::benchmark_data_smithi018_166993_object30723:head# 2024-02-10T08:39:10.897 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3535355:::benchmark_data_smithi018_166993_object70454:head# 2024-02-10T08:39:10.897 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a35372d8:::benchmark_data_smithi018_166993_object31839:head# 2024-02-10T08:39:10.898 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3542406:::benchmark_data_smithi018_166993_object102127:head# 2024-02-10T08:39:10.902 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a354c5e3:::benchmark_data_smithi018_166993_object100383:head# 2024-02-10T08:39:10.902 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3559567:::benchmark_data_smithi018_166993_object117750:head# 2024-02-10T08:39:10.902 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a355efdd:::benchmark_data_smithi018_166993_object56841:head# 2024-02-10T08:39:10.903 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a357b648:::benchmark_data_smithi018_166993_object78775:head# 2024-02-10T08:39:10.903 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a358c588:::benchmark_data_smithi018_166993_object72107:head# 2024-02-10T08:39:10.904 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a358da74:::benchmark_data_smithi018_166993_object21119:head# 2024-02-10T08:39:10.905 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a358f787:::benchmark_data_smithi018_166993_object20784:head# 2024-02-10T08:39:10.906 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3597d89:::benchmark_data_smithi018_166993_object116640:head# 2024-02-10T08:39:10.907 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:39:08.937691+0000 mgr.y (mgr.14505) 839 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:39:10.907 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:39:09.148933+0000 mgr.y (mgr.14505) 840 : cluster [DBG] pgmap v1031: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 5 active+undersized+degraded+remapped+backfilling, 172 active+clean; 5.1 GiB data, 20 GiB used, 606 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 959 op/s; 26705/252519 objects degraded (10.575%); 13 MiB/s, 211 objects/s recovering 2024-02-10T08:39:10.907 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:39:08.937691+0000 mgr.y (mgr.14505) 839 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:39:10.908 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:39:09.148933+0000 mgr.y (mgr.14505) 840 : cluster [DBG] pgmap v1031: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 5 active+undersized+degraded+remapped+backfilling, 172 active+clean; 5.1 GiB data, 20 GiB used, 606 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 959 op/s; 26705/252519 objects degraded (10.575%); 13 MiB/s, 211 objects/s recovering 2024-02-10T08:39:10.909 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3599522:::benchmark_data_smithi018_166993_object63739:head# 2024-02-10T08:39:10.909 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a35a3d7d:::benchmark_data_smithi018_166993_object83872:head# 2024-02-10T08:39:10.910 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a35baf81:::benchmark_data_smithi018_166993_object86631:head# 2024-02-10T08:39:10.910 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a35bd4ab:::benchmark_data_smithi018_166993_object38838:head# 2024-02-10T08:39:10.911 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a35de0e6:::benchmark_data_smithi018_166993_object31618:head# 2024-02-10T08:39:10.911 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a35e619c:::benchmark_data_smithi018_166993_object100423:head# 2024-02-10T08:39:10.911 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a35fb71c:::benchmark_data_smithi018_166993_object35819:head# 2024-02-10T08:39:10.912 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a35fb98e:::benchmark_data_smithi018_166993_object46325:head# 2024-02-10T08:39:10.912 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a361ab2f:::benchmark_data_smithi018_166993_object38529:head# 2024-02-10T08:39:10.913 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3621746:::benchmark_data_smithi018_166993_object47954:head# 2024-02-10T08:39:10.913 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a362520a:::benchmark_data_smithi018_166993_object49586:head# 2024-02-10T08:39:10.913 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3634a3a:::benchmark_data_smithi018_166993_object75252:head# 2024-02-10T08:39:10.914 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a364649c:::benchmark_data_smithi018_166993_object62711:head# 2024-02-10T08:39:10.915 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3672381:::benchmark_data_smithi018_166993_object86580:head# 2024-02-10T08:39:10.915 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a36aa36a:::benchmark_data_smithi018_166993_object22224:head# 2024-02-10T08:39:10.915 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a36accd6:::benchmark_data_smithi018_166993_object78537:head# 2024-02-10T08:39:10.916 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a36d25bf:::benchmark_data_smithi018_166993_object25468:head# 2024-02-10T08:39:10.916 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a36d941e:::benchmark_data_smithi018_166993_object93975:head# 2024-02-10T08:39:10.917 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a36dcee4:::benchmark_data_smithi018_166993_object44943:head# 2024-02-10T08:39:10.917 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a36ddf61:::benchmark_data_smithi018_166993_object31105:head# 2024-02-10T08:39:10.918 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a36e2253:::benchmark_data_smithi018_166993_object95865:head# 2024-02-10T08:39:10.918 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a36ec786:::benchmark_data_smithi018_166993_object81052:head# 2024-02-10T08:39:10.919 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a36fb0dd:::benchmark_data_smithi018_166993_object98709:head# 2024-02-10T08:39:10.920 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a37035e5:::benchmark_data_smithi018_166993_object92091:head# 2024-02-10T08:39:10.920 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a371b343:::benchmark_data_smithi018_166993_object96744:head# 2024-02-10T08:39:10.920 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3727bc8:::benchmark_data_smithi018_166993_object33996:head# 2024-02-10T08:39:10.923 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3729525:::benchmark_data_smithi018_166993_object36011:head# 2024-02-10T08:39:10.923 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3732f3c:::benchmark_data_smithi018_166993_object77056:head# 2024-02-10T08:39:10.923 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a373ba01:::benchmark_data_smithi018_166993_object69158:head# 2024-02-10T08:39:10.924 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3747f4a:::benchmark_data_smithi018_166993_object35129:head# 2024-02-10T08:39:10.924 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3754323:::benchmark_data_smithi018_166993_object57956:head# 2024-02-10T08:39:10.924 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a375758b:::benchmark_data_smithi018_166993_object72172:head# 2024-02-10T08:39:10.925 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3759f79:::benchmark_data_smithi018_166993_object89444:head# 2024-02-10T08:39:10.925 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3768c94:::benchmark_data_smithi018_166993_object92962:head# 2024-02-10T08:39:10.925 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a376aff9:::benchmark_data_smithi018_166993_object95121:head# 2024-02-10T08:39:10.925 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a376b9de:::benchmark_data_smithi018_166993_object30515:head# 2024-02-10T08:39:10.929 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3778eff:::benchmark_data_smithi018_166993_object76638:head# 2024-02-10T08:39:10.929 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a377dcf4:::benchmark_data_smithi018_166993_object41636:head# 2024-02-10T08:39:10.929 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a37806b6:::benchmark_data_smithi018_166993_object81264:head# 2024-02-10T08:39:10.930 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3785127:::benchmark_data_smithi018_166993_object88005:head# 2024-02-10T08:39:10.930 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a378d681:::benchmark_data_smithi018_166993_object48132:head# 2024-02-10T08:39:10.930 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a37979ed:::benchmark_data_smithi018_166993_object32108:head# 2024-02-10T08:39:10.931 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a37a688b:::benchmark_data_smithi018_166993_object72621:head# 2024-02-10T08:39:10.933 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a37b1801:::benchmark_data_smithi018_166993_object49784:head# 2024-02-10T08:39:10.934 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a37b619d:::benchmark_data_smithi018_166993_object94328:head# 2024-02-10T08:39:10.934 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a37b854d:::benchmark_data_smithi018_166993_object100373:head# 2024-02-10T08:39:10.934 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a37b9395:::benchmark_data_smithi018_166993_object99863:head# 2024-02-10T08:39:10.935 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a37c0e74:::benchmark_data_smithi018_166993_object41900:head# 2024-02-10T08:39:10.936 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a37c8524:::benchmark_data_smithi018_166993_object27248:head# 2024-02-10T08:39:10.936 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a37cc492:::benchmark_data_smithi018_166993_object35132:head# 2024-02-10T08:39:10.937 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a37d0ffa:::benchmark_data_smithi018_166993_object56587:head# 2024-02-10T08:39:10.937 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a37d22ce:::benchmark_data_smithi018_166993_object43486:head# 2024-02-10T08:39:10.938 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a37f35a6:::benchmark_data_smithi018_166993_object58335:head# 2024-02-10T08:39:10.938 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a380725c:::benchmark_data_smithi018_166993_object39806:head# 2024-02-10T08:39:10.941 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a380a863:::benchmark_data_smithi018_166993_object57212:head# 2024-02-10T08:39:10.943 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3826c86:::benchmark_data_smithi018_166993_object32543:head# 2024-02-10T08:39:10.945 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a38328a4:::benchmark_data_smithi018_166993_object59223:head# 2024-02-10T08:39:10.945 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a38351a5:::benchmark_data_smithi018_166993_object108016:head# 2024-02-10T08:39:10.945 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a383580b:::benchmark_data_smithi018_166993_object60971:head# 2024-02-10T08:39:10.946 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3836a7a:::benchmark_data_smithi018_166993_object55639:head# 2024-02-10T08:39:10.946 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3836bb0:::benchmark_data_smithi018_166993_object48368:head# 2024-02-10T08:39:10.947 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a38375ef:::benchmark_data_smithi018_166993_object97721:head# 2024-02-10T08:39:10.947 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a383abb7:::benchmark_data_smithi018_166993_object102312:head# 2024-02-10T08:39:10.948 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3841eae:::benchmark_data_smithi018_166993_object105118:head# 2024-02-10T08:39:10.948 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3853eee:::benchmark_data_smithi018_166993_object63318:head# 2024-02-10T08:39:10.949 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a385cc44:::benchmark_data_smithi018_166993_object85713:head# 2024-02-10T08:39:10.951 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a387a8b3:::benchmark_data_smithi018_166993_object98868:head# 2024-02-10T08:39:10.951 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3896904:::benchmark_data_smithi018_166993_object71132:head# 2024-02-10T08:39:10.951 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a38993d5:::benchmark_data_smithi018_166993_object64359:head# 2024-02-10T08:39:10.951 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a38a3c95:::benchmark_data_smithi018_166993_object93047:head# 2024-02-10T08:39:10.951 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a38a6681:::benchmark_data_smithi018_166993_object79810:head# 2024-02-10T08:39:10.952 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a38adbe2:::benchmark_data_smithi018_166993_object36002:head# 2024-02-10T08:39:10.952 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a38ae597:::benchmark_data_smithi018_166993_object21891:head# 2024-02-10T08:39:10.952 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a38b8cfb:::benchmark_data_smithi018_166993_object114457:head# 2024-02-10T08:39:10.953 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a38bc030:::benchmark_data_smithi018_166993_object103008:head# 2024-02-10T08:39:10.953 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a38e9d63:::benchmark_data_smithi018_166993_object54674:head# 2024-02-10T08:39:10.954 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a38f8655:::benchmark_data_smithi018_166993_object103427:head# 2024-02-10T08:39:10.954 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a38fa814:::benchmark_data_smithi018_166993_object43171:head# 2024-02-10T08:39:10.955 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a38fbdc6:::benchmark_data_smithi018_166993_object69643:head# 2024-02-10T08:39:10.955 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a38ffcea:::benchmark_data_smithi018_166993_object75042:head# 2024-02-10T08:39:10.956 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3911ba4:::benchmark_data_smithi018_166993_object42967:head# 2024-02-10T08:39:10.956 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3914c85:::benchmark_data_smithi018_166993_object41347:head# 2024-02-10T08:39:10.957 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3918c3e:::benchmark_data_smithi018_166993_object64849:head# 2024-02-10T08:39:10.957 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a391a11f:::benchmark_data_smithi018_166993_object31846:head# 2024-02-10T08:39:10.958 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a393790b:::benchmark_data_smithi018_166993_object117247:head# 2024-02-10T08:39:10.958 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a395a9cc:::benchmark_data_smithi018_166993_object45946:head# 2024-02-10T08:39:10.958 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a395e75f:::benchmark_data_smithi018_166993_object63380:head# 2024-02-10T08:39:10.959 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3965726:::benchmark_data_smithi018_166993_object100096:head# 2024-02-10T08:39:10.959 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3969c29:::benchmark_data_smithi018_166993_object55198:head# 2024-02-10T08:39:10.960 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a39704bc:::benchmark_data_smithi018_166993_object84395:head# 2024-02-10T08:39:10.960 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3979118:::benchmark_data_smithi018_166993_object75046:head# 2024-02-10T08:39:10.961 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a397ca57:::benchmark_data_smithi018_166993_object85368:head# 2024-02-10T08:39:10.961 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3988ac2:::benchmark_data_smithi018_166993_object73953:head# 2024-02-10T08:39:10.962 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3988fe2:::benchmark_data_smithi018_166993_object101215:head# 2024-02-10T08:39:10.962 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3991c3a:::benchmark_data_smithi018_166993_object33502:head# 2024-02-10T08:39:10.962 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3994c0a:::benchmark_data_smithi018_166993_object79422:head# 2024-02-10T08:39:10.963 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a39a4e0a:::benchmark_data_smithi018_166993_object84755:head# 2024-02-10T08:39:10.964 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a39a73b8:::benchmark_data_smithi018_166993_object113991:head# 2024-02-10T08:39:10.964 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a39a8c5d:::benchmark_data_smithi018_166993_object102158:head# 2024-02-10T08:39:10.964 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a39ae69d:::benchmark_data_smithi018_166993_object57342:head# 2024-02-10T08:39:10.965 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a39ca4cb:::benchmark_data_smithi018_166993_object45173:head# 2024-02-10T08:39:10.967 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a39d6ffe:::benchmark_data_smithi018_166993_object22100:head# 2024-02-10T08:39:10.967 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a39dba63:::benchmark_data_smithi018_166993_object65804:head# 2024-02-10T08:39:10.967 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a39dc124:::benchmark_data_smithi018_166993_object79856:head# 2024-02-10T08:39:10.968 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a39e6d8c:::benchmark_data_smithi018_166993_object60761:head# 2024-02-10T08:39:10.968 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a39e705e:::benchmark_data_smithi018_166993_object54380:head# 2024-02-10T08:39:10.968 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a39f0291:::benchmark_data_smithi018_166993_object27574:head# 2024-02-10T08:39:10.969 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a39fae92:::benchmark_data_smithi018_166993_object43503:head# 2024-02-10T08:39:10.969 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3a0c283:::benchmark_data_smithi018_166993_object90653:head# 2024-02-10T08:39:10.973 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3a1a583:::benchmark_data_smithi018_166993_object36265:head# 2024-02-10T08:39:10.973 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3a27e25:::benchmark_data_smithi018_166993_object105062:head# 2024-02-10T08:39:10.973 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3a3621b:::benchmark_data_smithi018_166993_object109792:head# 2024-02-10T08:39:10.973 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3a38f65:::benchmark_data_smithi018_166993_object21204:head# 2024-02-10T08:39:10.973 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3a5137c:::benchmark_data_smithi018_166993_object113717:head# 2024-02-10T08:39:10.974 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3a56b31:::benchmark_data_smithi018_166993_object23152:head# 2024-02-10T08:39:10.974 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3a6b22f:::benchmark_data_smithi018_166993_object52496:head# 2024-02-10T08:39:10.974 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3a729b3:::benchmark_data_smithi018_166993_object35128:head# 2024-02-10T08:39:10.975 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3a7704c:::benchmark_data_smithi018_166993_object50104:head# 2024-02-10T08:39:10.976 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3a971d3:::benchmark_data_smithi018_166993_object48707:head# 2024-02-10T08:39:10.976 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3a98b6f:::benchmark_data_smithi018_166993_object93246:head# 2024-02-10T08:39:10.977 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3a9f680:::benchmark_data_smithi018_166993_object56522:head# 2024-02-10T08:39:10.978 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3aa2b88:::benchmark_data_smithi018_166993_object54511:head# 2024-02-10T08:39:10.978 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3ad4fa9:::benchmark_data_smithi018_166993_object64150:head# 2024-02-10T08:39:10.978 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3ada040:::benchmark_data_smithi018_166993_object92282:head# 2024-02-10T08:39:10.979 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3ae7d51:::benchmark_data_smithi018_166993_object118447:head# 2024-02-10T08:39:10.979 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3aef9dc:::benchmark_data_smithi018_166993_object37823:head# 2024-02-10T08:39:10.980 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3af0b25:::benchmark_data_smithi018_166993_object111663:head# 2024-02-10T08:39:10.980 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3af9657:::benchmark_data_smithi018_166993_object19607:head# 2024-02-10T08:39:10.981 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3b04c3f:::benchmark_data_smithi018_166993_object43791:head# 2024-02-10T08:39:10.981 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3b05a49:::benchmark_data_smithi018_166993_object82007:head# 2024-02-10T08:39:10.982 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3b07373:::benchmark_data_smithi018_166993_object51212:head# 2024-02-10T08:39:10.982 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3b0df97:::benchmark_data_smithi018_166993_object80520:head# 2024-02-10T08:39:10.983 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3b179e8:::benchmark_data_smithi018_166993_object107541:head# 2024-02-10T08:39:10.983 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3b1af4f:::benchmark_data_smithi018_166993_object84059:head# 2024-02-10T08:39:10.983 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3b23c69:::benchmark_data_smithi018_166993_object77689:head# 2024-02-10T08:39:10.984 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3b2e16b:::benchmark_data_smithi018_166993_object95364:head# 2024-02-10T08:39:10.984 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3b33283:::benchmark_data_smithi018_166993_object48084:head# 2024-02-10T08:39:10.985 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3b3fb41:::benchmark_data_smithi018_166993_object19484:head# 2024-02-10T08:39:10.985 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3b467e3:::benchmark_data_smithi018_166993_object94472:head# 2024-02-10T08:39:10.986 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3b59160:::benchmark_data_smithi018_166993_object23639:head# 2024-02-10T08:39:10.986 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3b5eb9c:::benchmark_data_smithi018_166993_object67530:head# 2024-02-10T08:39:10.987 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3b68922:::benchmark_data_smithi018_166993_object86937:head# 2024-02-10T08:39:10.987 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3b6fa6d:::benchmark_data_smithi018_166993_object83825:head# 2024-02-10T08:39:10.988 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3b89e36:::benchmark_data_smithi018_166993_object20172:head# 2024-02-10T08:39:10.988 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3b8ada2:::benchmark_data_smithi018_166993_object95821:head# 2024-02-10T08:39:10.989 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3b950ac:::benchmark_data_smithi018_166993_object102593:head# 2024-02-10T08:39:10.989 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3ba613f:::benchmark_data_smithi018_166993_object73134:head# 2024-02-10T08:39:10.992 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3ba7f2a:::benchmark_data_smithi018_166993_object96513:head# 2024-02-10T08:39:10.993 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3bab8cb:::benchmark_data_smithi018_166993_object96243:head# 2024-02-10T08:39:10.994 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3bbc275:::benchmark_data_smithi018_166993_object53256:head# 2024-02-10T08:39:10.994 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3bcdde5:::benchmark_data_smithi018_166993_object61672:head# 2024-02-10T08:39:11.004 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3be060a:::benchmark_data_smithi018_166993_object118639:head# 2024-02-10T08:39:11.005 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3be8c05:::benchmark_data_smithi018_166993_object102465:head# 2024-02-10T08:39:11.005 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3bf502d:::benchmark_data_smithi018_166993_object118350:head# 2024-02-10T08:39:11.005 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3bf861c:::benchmark_data_smithi018_166993_object47169:head# 2024-02-10T08:39:11.005 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3bfcefe:::benchmark_data_smithi018_166993_object26051:head# 2024-02-10T08:39:11.005 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3c0f6ba:::benchmark_data_smithi018_166993_object106848:head# 2024-02-10T08:39:11.005 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3c1bc47:::benchmark_data_smithi018_166993_object95200:head# 2024-02-10T08:39:11.005 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3c1d0c4:::benchmark_data_smithi018_166993_object113476:head# 2024-02-10T08:39:11.005 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3c214e3:::benchmark_data_smithi018_166993_object95480:head# 2024-02-10T08:39:11.005 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3c33a72:::benchmark_data_smithi018_166993_object86051:head# 2024-02-10T08:39:11.005 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3c428b9:::benchmark_data_smithi018_166993_object66343:head# 2024-02-10T08:39:11.005 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3c4e098:::benchmark_data_smithi018_166993_object93175:head# 2024-02-10T08:39:11.005 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3c4ea68:::benchmark_data_smithi018_166993_object63618:head# 2024-02-10T08:39:11.005 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3c56570:::benchmark_data_smithi018_166993_object71349:head# 2024-02-10T08:39:11.005 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3c61419:::benchmark_data_smithi018_166993_object49929:head# 2024-02-10T08:39:11.005 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3c64bb4:::benchmark_data_smithi018_166993_object66281:head# 2024-02-10T08:39:11.006 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3c70035:::benchmark_data_smithi018_166993_object18526:head# 2024-02-10T08:39:11.006 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3c7373b:::benchmark_data_smithi018_166993_object44179:head# 2024-02-10T08:39:11.006 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3c74011:::benchmark_data_smithi018_166993_object44788:head# 2024-02-10T08:39:11.006 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3c7967f:::benchmark_data_smithi018_166993_object72920:head# 2024-02-10T08:39:11.006 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3c7a22d:::benchmark_data_smithi018_166993_object37685:head# 2024-02-10T08:39:11.011 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3c7c790:::benchmark_data_smithi018_166993_object117922:head# 2024-02-10T08:39:11.011 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3c7d073:::benchmark_data_smithi018_166993_object61300:head# 2024-02-10T08:39:11.011 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3c7e890:::benchmark_data_smithi018_166993_object67449:head# 2024-02-10T08:39:11.011 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3c84003:::benchmark_data_smithi018_166993_object76670:head# 2024-02-10T08:39:11.011 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3c87c1d:::benchmark_data_smithi018_166993_object33696:head# 2024-02-10T08:39:11.012 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3c8869c:::benchmark_data_smithi018_166993_object22732:head# 2024-02-10T08:39:11.012 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3c89c59:::benchmark_data_smithi018_166993_object83610:head# 2024-02-10T08:39:11.013 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3c91119:::benchmark_data_smithi018_166993_object59807:head# 2024-02-10T08:39:11.014 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3c93798:::benchmark_data_smithi018_166993_object48861:head# 2024-02-10T08:39:11.014 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3c95d18:::benchmark_data_smithi018_166993_object117116:head# 2024-02-10T08:39:11.019 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3ca440a:::benchmark_data_smithi018_166993_object67576:head# 2024-02-10T08:39:11.019 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3cafc77:::benchmark_data_smithi018_166993_object102681:head# 2024-02-10T08:39:11.019 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3cb0d05:::benchmark_data_smithi018_166993_object42067:head# 2024-02-10T08:39:11.020 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3cb2b0c:::benchmark_data_smithi018_166993_object24114:head# 2024-02-10T08:39:11.020 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3cc120a:::benchmark_data_smithi018_166993_object44234:head# 2024-02-10T08:39:11.020 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3cd199a:::benchmark_data_smithi018_166993_object112998:head# 2024-02-10T08:39:11.021 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3cda09e:::benchmark_data_smithi018_166993_object94492:head# 2024-02-10T08:39:11.022 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3ce10d2:::benchmark_data_smithi018_166993_object76054:head# 2024-02-10T08:39:11.022 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3cfd83e:::benchmark_data_smithi018_166993_object83617:head# 2024-02-10T08:39:11.022 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3d02bf3:::benchmark_data_smithi018_166993_object43041:head# 2024-02-10T08:39:11.022 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3d067f8:::benchmark_data_smithi018_166993_object52010:head# 2024-02-10T08:39:11.024 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3d085da:::benchmark_data_smithi018_166993_object89407:head# 2024-02-10T08:39:11.025 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3d16976:::benchmark_data_smithi018_166993_object106074:head# 2024-02-10T08:39:11.025 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3d28e31:::benchmark_data_smithi018_166993_object71247:head# 2024-02-10T08:39:11.026 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3d2e556:::benchmark_data_smithi018_166993_object19409:head# 2024-02-10T08:39:11.028 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3d33a43:::benchmark_data_smithi018_166993_object19677:head# 2024-02-10T08:39:11.028 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3d3d279:::benchmark_data_smithi018_166993_object52231:head# 2024-02-10T08:39:11.028 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3d53d62:::benchmark_data_smithi018_166993_object63278:head# 2024-02-10T08:39:11.031 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3d69dc9:::benchmark_data_smithi018_166993_object55486:head# 2024-02-10T08:39:11.032 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3d788a4:::benchmark_data_smithi018_166993_object89190:head# 2024-02-10T08:39:11.032 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3d7b0d8:::benchmark_data_smithi018_166993_object40313:head# 2024-02-10T08:39:11.036 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3d87084:::benchmark_data_smithi018_166993_object79502:head# 2024-02-10T08:39:11.036 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3d89546:::benchmark_data_smithi018_166993_object99119:head# 2024-02-10T08:39:11.036 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3d8c52b:::benchmark_data_smithi018_166993_object21035:head# 2024-02-10T08:39:11.040 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3d959e4:::benchmark_data_smithi018_166993_object40429:head# 2024-02-10T08:39:11.040 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3da9ac9:::benchmark_data_smithi018_166993_object38955:head# 2024-02-10T08:39:11.040 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3dad00a:::benchmark_data_smithi018_166993_object55094:head# 2024-02-10T08:39:11.040 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3dbd5aa:::benchmark_data_smithi018_166993_object37675:head# 2024-02-10T08:39:11.040 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3dc3ed3:::benchmark_data_smithi018_166993_object74359:head# 2024-02-10T08:39:11.040 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3dcd3ff:::benchmark_data_smithi018_166993_object113799:head# 2024-02-10T08:39:11.041 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:39:08.937691+0000 mgr.y (mgr.14505) 839 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:39:11.041 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:39:09.148933+0000 mgr.y (mgr.14505) 840 : cluster [DBG] pgmap v1031: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 5 active+undersized+degraded+remapped+backfilling, 172 active+clean; 5.1 GiB data, 20 GiB used, 606 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 959 op/s; 26705/252519 objects degraded (10.575%); 13 MiB/s, 211 objects/s recovering 2024-02-10T08:39:11.041 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3ddbe6b:::benchmark_data_smithi018_166993_object109090:head# 2024-02-10T08:39:11.042 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3de9edf:::benchmark_data_smithi018_166993_object86709:head# 2024-02-10T08:39:11.042 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3deb4c7:::benchmark_data_smithi018_166993_object93110:head# 2024-02-10T08:39:11.042 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3deb859:::benchmark_data_smithi018_166993_object115428:head# 2024-02-10T08:39:11.043 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3dfa3fd:::benchmark_data_smithi018_166993_object71203:head# 2024-02-10T08:39:11.043 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3e03f7e:::benchmark_data_smithi018_166993_object61575:head# 2024-02-10T08:39:11.044 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3e19ca8:::benchmark_data_smithi018_166993_object96262:head# 2024-02-10T08:39:11.047 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3e1a43f:::benchmark_data_smithi018_166993_object29265:head# 2024-02-10T08:39:11.047 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3e1a753:::benchmark_data_smithi018_166993_object20230:head# 2024-02-10T08:39:11.047 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3e2e4e1:::benchmark_data_smithi018_166993_object110831:head# 2024-02-10T08:39:11.047 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3e3e142:::benchmark_data_smithi018_166993_object104346:head# 2024-02-10T08:39:11.050 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3e471f3:::benchmark_data_smithi018_166993_object78439:head# 2024-02-10T08:39:11.050 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3e4e714:::benchmark_data_smithi018_166993_object114113:head# 2024-02-10T08:39:11.051 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3e6491d:::benchmark_data_smithi018_166993_object109115:head# 2024-02-10T08:39:11.051 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3e68cf3:::benchmark_data_smithi018_166993_object102228:head# 2024-02-10T08:39:11.051 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3e80f1a:::benchmark_data_smithi018_166993_object43728:head# 2024-02-10T08:39:11.051 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3e82c3b:::benchmark_data_smithi018_166993_object101731:head# 2024-02-10T08:39:11.051 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3e83d72:::benchmark_data_smithi018_166993_object66703:head# 2024-02-10T08:39:11.051 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3e96597:::benchmark_data_smithi018_166993_object99267:head# 2024-02-10T08:39:11.052 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3eaa76f:::benchmark_data_smithi018_166993_object83714:head# 2024-02-10T08:39:11.052 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3eadb2d:::benchmark_data_smithi018_166993_object17441:head# 2024-02-10T08:39:11.052 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3eaf9e1:::benchmark_data_smithi018_166993_object50655:head# 2024-02-10T08:39:11.054 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3ec25f2:::benchmark_data_smithi018_166993_object33170:head# 2024-02-10T08:39:11.054 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3ec4136:::benchmark_data_smithi018_166993_object55836:head# 2024-02-10T08:39:11.055 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3ede25f:::benchmark_data_smithi018_166993_object39835:head# 2024-02-10T08:39:11.057 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3ee42a3:::benchmark_data_smithi018_166993_object21619:head# 2024-02-10T08:39:11.057 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3eff3ae:::benchmark_data_smithi018_166993_object77385:head# 2024-02-10T08:39:11.057 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3f0a2f1:::benchmark_data_smithi018_166993_object101249:head# 2024-02-10T08:39:11.057 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3f0c529:::benchmark_data_smithi018_166993_object20012:head# 2024-02-10T08:39:11.059 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3f1a799:::benchmark_data_smithi018_166993_object105268:head# 2024-02-10T08:39:11.059 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3f1a7cd:::benchmark_data_smithi018_166993_object110555:head# 2024-02-10T08:39:11.063 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3f436c4:::benchmark_data_smithi018_166993_object92439:head# 2024-02-10T08:39:11.063 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3f4e020:::benchmark_data_smithi018_166993_object58282:head# 2024-02-10T08:39:11.063 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3f51da0:::benchmark_data_smithi018_166993_object54793:head# 2024-02-10T08:39:11.063 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3f62cba:::benchmark_data_smithi018_166993_object114147:head# 2024-02-10T08:39:11.065 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3f6614a:::benchmark_data_smithi018_166993_object97041:head# 2024-02-10T08:39:11.065 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3f68043:::benchmark_data_smithi018_166993_object114569:head# 2024-02-10T08:39:11.070 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3f6b822:::benchmark_data_smithi018_166993_object33605:head# 2024-02-10T08:39:11.070 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3f7be88:::benchmark_data_smithi018_166993_object85342:head# 2024-02-10T08:39:11.070 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3fa0693:::benchmark_data_smithi018_166993_object53891:head# 2024-02-10T08:39:11.070 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3fa99af:::benchmark_data_smithi018_166993_object102444:head# 2024-02-10T08:39:11.070 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3fb7f5e:::benchmark_data_smithi018_166993_object98377:head# 2024-02-10T08:39:11.070 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3fc007c:::benchmark_data_smithi018_166993_object35701:head# 2024-02-10T08:39:11.070 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3fc1617:::benchmark_data_smithi018_166993_object77783:head# 2024-02-10T08:39:11.072 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3fc25a4:::benchmark_data_smithi018_166993_object28778:head# 2024-02-10T08:39:11.073 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3fd9d92:::benchmark_data_smithi018_166993_object23828:head# 2024-02-10T08:39:11.076 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3fe25ed:::benchmark_data_smithi018_166993_object23019:head# 2024-02-10T08:39:11.076 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3fe3dfb:::benchmark_data_smithi018_166993_object105009:head# 2024-02-10T08:39:11.076 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3fe3e35:::benchmark_data_smithi018_166993_object24908:head# 2024-02-10T08:39:11.076 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3fec1d7:::benchmark_data_smithi018_166993_object93066:head# 2024-02-10T08:39:11.076 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a3ff19df:::benchmark_data_smithi018_166993_object61518:head# 2024-02-10T08:39:11.076 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a40046ef:::benchmark_data_smithi018_166993_object17411:head# 2024-02-10T08:39:11.077 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a400988b:::benchmark_data_smithi018_166993_object73306:head# 2024-02-10T08:39:11.077 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4011666:::benchmark_data_smithi018_166993_object50049:head# 2024-02-10T08:39:11.077 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a40144f6:::benchmark_data_smithi018_166993_object83459:head# 2024-02-10T08:39:11.078 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4018866:::benchmark_data_smithi018_166993_object54716:head# 2024-02-10T08:39:11.078 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a402133a:::benchmark_data_smithi018_166993_object113208:head# 2024-02-10T08:39:11.078 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4024794:::benchmark_data_smithi018_166993_object88503:head# 2024-02-10T08:39:11.079 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a40256c8:::benchmark_data_smithi018_166993_object80726:head# 2024-02-10T08:39:11.079 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a402f45b:::benchmark_data_smithi018_166993_object20014:head# 2024-02-10T08:39:11.080 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a404cff8:::benchmark_data_smithi018_166993_object118052:head# 2024-02-10T08:39:11.080 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a404eb5f:::benchmark_data_smithi018_166993_object91972:head# 2024-02-10T08:39:11.082 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a40538e4:::benchmark_data_smithi018_166993_object41986:head# 2024-02-10T08:39:11.082 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4053efe:::benchmark_data_smithi018_166993_object42051:head# 2024-02-10T08:39:11.083 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4053f40:::benchmark_data_smithi018_166993_object48230:head# 2024-02-10T08:39:11.084 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a405d690:::benchmark_data_smithi018_166993_object60668:head# 2024-02-10T08:39:11.084 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4061498:::benchmark_data_smithi018_166993_object27057:head# 2024-02-10T08:39:11.085 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4061509:::benchmark_data_smithi018_166993_object30940:head# 2024-02-10T08:39:11.085 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4065710:::benchmark_data_smithi018_166993_object70958:head# 2024-02-10T08:39:11.092 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a40767f3:::benchmark_data_smithi018_166993_object48730:head# 2024-02-10T08:39:11.092 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4076c32:::benchmark_data_smithi018_166993_object82724:head# 2024-02-10T08:39:11.092 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4077c8f:::benchmark_data_smithi018_166993_object44263:head# 2024-02-10T08:39:11.092 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4082432:::benchmark_data_smithi018_166993_object56949:head# 2024-02-10T08:39:11.092 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a40827b1:::benchmark_data_smithi018_166993_object22586:head# 2024-02-10T08:39:11.092 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a40846de:::benchmark_data_smithi018_166993_object50678:head# 2024-02-10T08:39:11.092 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4085b3b:::benchmark_data_smithi018_166993_object83684:head# 2024-02-10T08:39:11.092 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a408c99e:::benchmark_data_smithi018_166993_object100003:head# 2024-02-10T08:39:11.092 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a40900db:::benchmark_data_smithi018_166993_object37754:head# 2024-02-10T08:39:11.092 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a40ac900:::benchmark_data_smithi018_166993_object59207:head# 2024-02-10T08:39:11.093 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a40c2cbe:::benchmark_data_smithi018_166993_object99248:head# 2024-02-10T08:39:11.093 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a40d0a50:::benchmark_data_smithi018_166993_object22802:head# 2024-02-10T08:39:11.093 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a40d1c22:::benchmark_data_smithi018_166993_object71912:head# 2024-02-10T08:39:11.095 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a40e2ef5:::benchmark_data_smithi018_166993_object37386:head# 2024-02-10T08:39:11.096 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a40e63a0:::benchmark_data_smithi018_166993_object33008:head# 2024-02-10T08:39:11.097 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a40e6af6:::benchmark_data_smithi018_166993_object109594:head# 2024-02-10T08:39:11.100 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4105ae1:::benchmark_data_smithi018_166993_object68848:head# 2024-02-10T08:39:11.100 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4107bba:::benchmark_data_smithi018_166993_object45813:head# 2024-02-10T08:39:11.101 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a410ee3c:::benchmark_data_smithi018_166993_object88368:head# 2024-02-10T08:39:11.102 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4113308:::benchmark_data_smithi018_166993_object22625:head# 2024-02-10T08:39:11.102 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4115662:::benchmark_data_smithi018_166993_object63451:head# 2024-02-10T08:39:11.104 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a412e2a9:::benchmark_data_smithi018_166993_object76818:head# 2024-02-10T08:39:11.105 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a413257c:::benchmark_data_smithi018_166993_object31636:head# 2024-02-10T08:39:11.106 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a413456c:::benchmark_data_smithi018_166993_object104971:head# 2024-02-10T08:39:11.106 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4134d91:::benchmark_data_smithi018_166993_object81895:head# 2024-02-10T08:39:11.107 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a41350cc:::benchmark_data_smithi018_166993_object55396:head# 2024-02-10T08:39:11.107 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a41408b8:::benchmark_data_smithi018_166993_object64515:head# 2024-02-10T08:39:11.110 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4142a85:::benchmark_data_smithi018_166993_object42447:head# 2024-02-10T08:39:11.110 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a41522df:::benchmark_data_smithi018_166993_object78029:head# 2024-02-10T08:39:11.111 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4153a2c:::benchmark_data_smithi018_166993_object21299:head# 2024-02-10T08:39:11.111 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a415a2df:::benchmark_data_smithi018_166993_object106670:head# 2024-02-10T08:39:11.114 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a415ce7f:::benchmark_data_smithi018_166993_object89531:head# 2024-02-10T08:39:11.124 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4160d7b:::benchmark_data_smithi018_166993_object111546:head# 2024-02-10T08:39:11.127 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4164c9a:::benchmark_data_smithi018_166993_object25173:head# 2024-02-10T08:39:11.128 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4170557:::benchmark_data_smithi018_166993_object107061:head# 2024-02-10T08:39:11.128 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4187341:::benchmark_data_smithi018_166993_object35418:head# 2024-02-10T08:39:11.129 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a41a09b7:::benchmark_data_smithi018_166993_object64661:head# 2024-02-10T08:39:11.134 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a41af3d7:::benchmark_data_smithi018_166993_object52041:head# 2024-02-10T08:39:11.134 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a41b2ce9:::benchmark_data_smithi018_166993_object51860:head# 2024-02-10T08:39:11.134 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a41b385d:::benchmark_data_smithi018_166993_object115677:head# 2024-02-10T08:39:11.134 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a41b53c3:::benchmark_data_smithi018_166993_object108679:head# 2024-02-10T08:39:11.134 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a41c3d1a:::benchmark_data_smithi018_166993_object18655:head# 2024-02-10T08:39:11.134 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a41dc230:::benchmark_data_smithi018_166993_object38523:head# 2024-02-10T08:39:11.134 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a41eead1:::benchmark_data_smithi018_166993_object44051:head# 2024-02-10T08:39:11.134 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a41ef722:::benchmark_data_smithi018_166993_object43762:head# 2024-02-10T08:39:11.134 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4219efa:::benchmark_data_smithi018_166993_object107903:head# 2024-02-10T08:39:11.136 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4227ced:::benchmark_data_smithi018_166993_object82613:head# 2024-02-10T08:39:11.136 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4227e09:::benchmark_data_smithi018_166993_object83373:head# 2024-02-10T08:39:11.136 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a422f0ea:::benchmark_data_smithi018_166993_object81247:head# 2024-02-10T08:39:11.136 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a422fb9a:::benchmark_data_smithi018_166993_object107295:head# 2024-02-10T08:39:11.140 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4234e37:::benchmark_data_smithi018_166993_object19287:head# 2024-02-10T08:39:11.143 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a424e4f2:::benchmark_data_smithi018_166993_object77590:head# 2024-02-10T08:39:11.143 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a42517e3:::benchmark_data_smithi018_166993_object80864:head# 2024-02-10T08:39:11.143 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4260ba2:::benchmark_data_smithi018_166993_object95303:head# 2024-02-10T08:39:11.143 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a426787e:::benchmark_data_smithi018_166993_object87229:head# 2024-02-10T08:39:11.144 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a426da28:::benchmark_data_smithi018_166993_object20125:head# 2024-02-10T08:39:11.145 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4278003:::benchmark_data_smithi018_166993_object96712:head# 2024-02-10T08:39:11.147 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a429b6e8:::benchmark_data_smithi018_166993_object115476:head# 2024-02-10T08:39:11.148 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a429f822:::benchmark_data_smithi018_166993_object45106:head# 2024-02-10T08:39:11.148 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a42a4611:::benchmark_data_smithi018_166993_object118864:head# 2024-02-10T08:39:11.148 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a42a86ec:::benchmark_data_smithi018_166993_object94929:head# 2024-02-10T08:39:11.148 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a42b21f0:::benchmark_data_smithi018_166993_object67188:head# 2024-02-10T08:39:11.148 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a42b7860:::benchmark_data_smithi018_166993_object33986:head# 2024-02-10T08:39:11.148 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a42b8a77:::benchmark_data_smithi018_166993_object49354:head# 2024-02-10T08:39:11.148 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a42cb536:::benchmark_data_smithi018_166993_object53039:head# 2024-02-10T08:39:11.150 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a42cf11a:::benchmark_data_smithi018_166993_object43826:head# 2024-02-10T08:39:11.150 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a430ea0d:::benchmark_data_smithi018_166993_object48975:head# 2024-02-10T08:39:11.156 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a431c5f5:::benchmark_data_smithi018_166993_object77798:head# 2024-02-10T08:39:11.157 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4320a6a:::benchmark_data_smithi018_166993_object100229:head# 2024-02-10T08:39:11.157 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4322840:::benchmark_data_smithi018_166993_object88828:head# 2024-02-10T08:39:11.157 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4328671:::benchmark_data_smithi018_166993_object97792:head# 2024-02-10T08:39:11.157 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4329725:::benchmark_data_smithi018_166993_object53565:head# 2024-02-10T08:39:11.157 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a432fc16:::benchmark_data_smithi018_166993_object30129:head# 2024-02-10T08:39:11.157 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4331dfd:::benchmark_data_smithi018_166993_object28027:head# 2024-02-10T08:39:11.157 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a433a57d:::benchmark_data_smithi018_166993_object93727:head# 2024-02-10T08:39:11.157 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a433b940:::benchmark_data_smithi018_166993_object57355:head# 2024-02-10T08:39:11.158 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a433c560:::benchmark_data_smithi018_166993_object80107:head# 2024-02-10T08:39:11.158 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a43529d9:::benchmark_data_smithi018_166993_object26138:head# 2024-02-10T08:39:11.158 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4352a3c:::benchmark_data_smithi018_166993_object55611:head# 2024-02-10T08:39:11.160 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4377170:::benchmark_data_smithi018_166993_object35458:head# 2024-02-10T08:39:11.160 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a43897de:::benchmark_data_smithi018_166993_object36040:head# 2024-02-10T08:39:11.160 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a438c660:::benchmark_data_smithi018_166993_object117516:head# 2024-02-10T08:39:11.161 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4396faf:::benchmark_data_smithi018_166993_object36866:head# 2024-02-10T08:39:11.161 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4398a15:::benchmark_data_smithi018_166993_object63170:head# 2024-02-10T08:39:11.161 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a43a394e:::benchmark_data_smithi018_166993_object22597:head# 2024-02-10T08:39:11.162 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a43b219d:::benchmark_data_smithi018_166993_object110639:head# 2024-02-10T08:39:11.162 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a43b42dd:::benchmark_data_smithi018_166993_object45074:head# 2024-02-10T08:39:11.162 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a43c18dd:::benchmark_data_smithi018_166993_object79461:head# 2024-02-10T08:39:11.162 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a43c7a92:::benchmark_data_smithi018_166993_object36891:head# 2024-02-10T08:39:11.163 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a43d5754:::benchmark_data_smithi018_166993_object60808:head# 2024-02-10T08:39:11.163 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a43da891:::benchmark_data_smithi018_166993_object73655:head# 2024-02-10T08:39:11.164 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a43e462f:::benchmark_data_smithi018_166993_object71857:head# 2024-02-10T08:39:11.165 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a43f47eb:::benchmark_data_smithi018_166993_object116876:head# 2024-02-10T08:39:11.170 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a43f5acf:::benchmark_data_smithi018_166993_object110499:head# 2024-02-10T08:39:11.170 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4406168:::benchmark_data_smithi018_166993_object23247:head# 2024-02-10T08:39:11.170 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4408c53:::benchmark_data_smithi018_166993_object93759:head# 2024-02-10T08:39:11.171 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a440afa4:::benchmark_data_smithi018_166993_object39201:head# 2024-02-10T08:39:11.171 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4412a41:::benchmark_data_smithi018_166993_object101822:head# 2024-02-10T08:39:11.172 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4416614:::benchmark_data_smithi018_166993_object118042:head# 2024-02-10T08:39:11.172 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4427f02:::benchmark_data_smithi018_166993_object72982:head# 2024-02-10T08:39:11.174 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4430405:::benchmark_data_smithi018_166993_object23777:head# 2024-02-10T08:39:11.174 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a44329ed:::benchmark_data_smithi018_166993_object33773:head# 2024-02-10T08:39:11.175 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4438642:::benchmark_data_smithi018_166993_object29960:head# 2024-02-10T08:39:11.175 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a443c74c:::benchmark_data_smithi018_166993_object51938:head# 2024-02-10T08:39:11.175 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a444fb23:::benchmark_data_smithi018_166993_object88055:head# 2024-02-10T08:39:11.175 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a445485e:::benchmark_data_smithi018_166993_object71175:head# 2024-02-10T08:39:11.176 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4461271:::benchmark_data_smithi018_166993_object72685:head# 2024-02-10T08:39:11.176 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a447963e:::benchmark_data_smithi018_166993_object57715:head# 2024-02-10T08:39:11.179 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a447a519:::benchmark_data_smithi018_166993_object103038:head# 2024-02-10T08:39:11.180 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4493d8e:::benchmark_data_smithi018_166993_object81263:head# 2024-02-10T08:39:11.180 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a44a13d0:::benchmark_data_smithi018_166993_object113747:head# 2024-02-10T08:39:11.183 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a44a3d61:::benchmark_data_smithi018_166993_object24292:head# 2024-02-10T08:39:11.183 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a44a5dd0:::benchmark_data_smithi018_166993_object70953:head# 2024-02-10T08:39:11.186 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a44ab726:::benchmark_data_smithi018_166993_object81273:head# 2024-02-10T08:39:11.190 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a44b2177:::benchmark_data_smithi018_166993_object35809:head# 2024-02-10T08:39:11.190 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a44b2f45:::benchmark_data_smithi018_166993_object52964:head# 2024-02-10T08:39:11.190 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a44b3d4e:::benchmark_data_smithi018_166993_object112701:head# 2024-02-10T08:39:11.191 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a44b684a:::benchmark_data_smithi018_166993_object48723:head# 2024-02-10T08:39:11.191 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a44bd5c4:::benchmark_data_smithi018_166993_object36471:head# 2024-02-10T08:39:11.192 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a44ccc17:::benchmark_data_smithi018_166993_object23381:head# 2024-02-10T08:39:11.192 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a44e0ca4:::benchmark_data_smithi018_166993_object87141:head# 2024-02-10T08:39:11.192 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a44eb10a:::benchmark_data_smithi018_166993_object78039:head# 2024-02-10T08:39:11.193 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a450ea11:::benchmark_data_smithi018_166993_object89334:head# 2024-02-10T08:39:11.195 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a451e81e:::benchmark_data_smithi018_166993_object75468:head# 2024-02-10T08:39:11.196 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4525270:::benchmark_data_smithi018_166993_object42499:head# 2024-02-10T08:39:11.196 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a452baf0:::benchmark_data_smithi018_166993_object92084:head# 2024-02-10T08:39:11.197 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a45330e6:::benchmark_data_smithi018_166993_object58715:head# 2024-02-10T08:39:11.197 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4535708:::benchmark_data_smithi018_166993_object80351:head# 2024-02-10T08:39:11.200 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4537121:::benchmark_data_smithi018_166993_object26883:head# 2024-02-10T08:39:11.200 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a453c059:::benchmark_data_smithi018_166993_object91192:head# 2024-02-10T08:39:11.200 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a453dae5:::benchmark_data_smithi018_166993_object57935:head# 2024-02-10T08:39:11.201 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4541ff7:::benchmark_data_smithi018_166993_object103367:head# 2024-02-10T08:39:11.201 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4554f70:::benchmark_data_smithi018_166993_object32393:head# 2024-02-10T08:39:11.201 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a455c50a:::benchmark_data_smithi018_166993_object55306:head# 2024-02-10T08:39:11.201 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a456069a:::benchmark_data_smithi018_166993_object54579:head# 2024-02-10T08:39:11.202 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4566783:::benchmark_data_smithi018_166993_object43669:head# 2024-02-10T08:39:11.202 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a45678c8:::benchmark_data_smithi018_166993_object34900:head# 2024-02-10T08:39:11.202 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4570d42:::benchmark_data_smithi018_166993_object75968:head# 2024-02-10T08:39:11.203 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a457f15a:::benchmark_data_smithi018_166993_object96927:head# 2024-02-10T08:39:11.204 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a45846a6:::benchmark_data_smithi018_166993_object71835:head# 2024-02-10T08:39:11.212 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4586af0:::benchmark_data_smithi018_166993_object75862:head# 2024-02-10T08:39:11.212 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4587dc8:::benchmark_data_smithi018_166993_object36778:head# 2024-02-10T08:39:11.212 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a45888eb:::benchmark_data_smithi018_166993_object34389:head# 2024-02-10T08:39:11.212 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4588f65:::benchmark_data_smithi018_166993_object64054:head# 2024-02-10T08:39:11.212 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a45915df:::benchmark_data_smithi018_166993_object92220:head# 2024-02-10T08:39:11.212 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4592654:::benchmark_data_smithi018_166993_object55999:head# 2024-02-10T08:39:11.215 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4592c7a:::benchmark_data_smithi018_166993_object96058:head# 2024-02-10T08:39:11.215 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4595b42:::benchmark_data_smithi018_166993_object85557:head# 2024-02-10T08:39:11.216 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4596d8c:::benchmark_data_smithi018_166993_object67039:head# 2024-02-10T08:39:11.216 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a459c65e:::benchmark_data_smithi018_166993_object51077:head# 2024-02-10T08:39:11.217 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a45a77c4:::benchmark_data_smithi018_166993_object71546:head# 2024-02-10T08:39:11.218 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a45c3285:::benchmark_data_smithi018_166993_object100392:head# 2024-02-10T08:39:11.218 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a45cf396:::benchmark_data_smithi018_166993_object110846:head# 2024-02-10T08:39:11.218 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a45d3cc3:::benchmark_data_smithi018_166993_object106449:head# 2024-02-10T08:39:11.219 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a45da160:::benchmark_data_smithi018_166993_object104876:head# 2024-02-10T08:39:11.219 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a45e99c6:::benchmark_data_smithi018_166993_object72999:head# 2024-02-10T08:39:11.220 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a45f4baf:::benchmark_data_smithi018_166993_object100060:head# 2024-02-10T08:39:11.222 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4607e38:::benchmark_data_smithi018_166993_object34119:head# 2024-02-10T08:39:11.223 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a461039f:::benchmark_data_smithi018_166993_object26522:head# 2024-02-10T08:39:11.224 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4612178:::benchmark_data_smithi018_166993_object69839:head# 2024-02-10T08:39:11.224 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a46207cb:::benchmark_data_smithi018_166993_object88962:head# 2024-02-10T08:39:11.225 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a46268c7:::benchmark_data_smithi018_166993_object95324:head# 2024-02-10T08:39:11.232 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4626ec0:::benchmark_data_smithi018_166993_object60345:head# 2024-02-10T08:39:11.232 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a463333f:::benchmark_data_smithi018_166993_object91791:head# 2024-02-10T08:39:11.232 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4638b0a:::benchmark_data_smithi018_166993_object102737:head# 2024-02-10T08:39:11.233 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a46634b4:::benchmark_data_smithi018_166993_object46324:head# 2024-02-10T08:39:11.233 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4676b51:::benchmark_data_smithi018_166993_object58135:head# 2024-02-10T08:39:11.236 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4682101:::benchmark_data_smithi018_166993_object92992:head# 2024-02-10T08:39:11.236 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a46841ae:::benchmark_data_smithi018_166993_object70418:head# 2024-02-10T08:39:11.236 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a468c7ae:::benchmark_data_smithi018_166993_object107883:head# 2024-02-10T08:39:11.236 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4695db6:::benchmark_data_smithi018_166993_object61649:head# 2024-02-10T08:39:11.236 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a46a000a:::benchmark_data_smithi018_166993_object37821:head# 2024-02-10T08:39:11.237 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a46a30f3:::benchmark_data_smithi018_166993_object27343:head# 2024-02-10T08:39:11.237 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a46b3481:::benchmark_data_smithi018_166993_object45562:head# 2024-02-10T08:39:11.241 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a46b4ca8:::benchmark_data_smithi018_166993_object68311:head# 2024-02-10T08:39:11.241 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a46b5cd6:::benchmark_data_smithi018_166993_object100792:head# 2024-02-10T08:39:11.243 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a46ca1ab:::benchmark_data_smithi018_166993_object87100:head# 2024-02-10T08:39:11.244 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a46e0411:::benchmark_data_smithi018_166993_object45826:head# 2024-02-10T08:39:11.244 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a46f389c:::benchmark_data_smithi018_166993_object114972:head# 2024-02-10T08:39:11.245 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a46f4a80:::benchmark_data_smithi018_166993_object115465:head# 2024-02-10T08:39:11.245 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a46f795d:::benchmark_data_smithi018_166993_object107737:head# 2024-02-10T08:39:11.245 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a47007d9:::benchmark_data_smithi018_166993_object65258:head# 2024-02-10T08:39:11.248 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4702930:::benchmark_data_smithi018_166993_object118702:head# 2024-02-10T08:39:11.248 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4707cdb:::benchmark_data_smithi018_166993_object110960:head# 2024-02-10T08:39:11.249 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a471a492:::benchmark_data_smithi018_166993_object28920:head# 2024-02-10T08:39:11.250 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4724fc1:::benchmark_data_smithi018_166993_object88208:head# 2024-02-10T08:39:11.250 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a472c4ec:::benchmark_data_smithi018_166993_object19058:head# 2024-02-10T08:39:11.250 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4734c41:::benchmark_data_smithi018_166993_object18727:head# 2024-02-10T08:39:11.257 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a47373f2:::benchmark_data_smithi018_166993_object52534:head# 2024-02-10T08:39:11.257 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a473b968:::benchmark_data_smithi018_166993_object45023:head# 2024-02-10T08:39:11.257 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4740c62:::benchmark_data_smithi018_166993_object108204:head# 2024-02-10T08:39:11.257 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4743695:::benchmark_data_smithi018_166993_object107878:head# 2024-02-10T08:39:11.257 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4746f1c:::benchmark_data_smithi018_166993_object102491:head# 2024-02-10T08:39:11.257 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4755cb8:::benchmark_data_smithi018_166993_object47865:head# 2024-02-10T08:39:11.259 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4759a32:::benchmark_data_smithi018_166993_object21404:head# 2024-02-10T08:39:11.259 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a475e600:::benchmark_data_smithi018_166993_object37461:head# 2024-02-10T08:39:11.260 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a475edd9:::benchmark_data_smithi018_166993_object61809:head# 2024-02-10T08:39:11.265 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4763c09:::benchmark_data_smithi018_166993_object105485:head# 2024-02-10T08:39:11.265 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a477da92:::benchmark_data_smithi018_166993_object40238:head# 2024-02-10T08:39:11.266 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a477f83d:::benchmark_data_smithi018_166993_object97420:head# 2024-02-10T08:39:11.272 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4794594:::benchmark_data_smithi018_166993_object97152:head# 2024-02-10T08:39:11.272 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a479d635:::benchmark_data_smithi018_166993_object66711:head# 2024-02-10T08:39:11.272 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a47b3115:::benchmark_data_smithi018_166993_object73021:head# 2024-02-10T08:39:11.272 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a47b5ee4:::benchmark_data_smithi018_166993_object31748:head# 2024-02-10T08:39:11.272 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a47c0bbc:::benchmark_data_smithi018_166993_object82598:head# 2024-02-10T08:39:11.273 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a47c0e6e:::benchmark_data_smithi018_166993_object90219:head# 2024-02-10T08:39:11.273 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a47d1fef:::benchmark_data_smithi018_166993_object71718:head# 2024-02-10T08:39:11.275 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a47d3731:::benchmark_data_smithi018_166993_object74160:head# 2024-02-10T08:39:11.281 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a47d6f9b:::benchmark_data_smithi018_166993_object49691:head# 2024-02-10T08:39:11.281 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a47d73f1:::benchmark_data_smithi018_166993_object105784:head# 2024-02-10T08:39:11.281 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a47df46a:::benchmark_data_smithi018_166993_object71209:head# 2024-02-10T08:39:11.281 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a47df5d9:::benchmark_data_smithi018_166993_object73091:head# 2024-02-10T08:39:11.281 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a47ef5ca:::benchmark_data_smithi018_166993_object40104:head# 2024-02-10T08:39:11.282 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a47eff0b:::benchmark_data_smithi018_166993_object96496:head# 2024-02-10T08:39:11.282 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a47f28fd:::benchmark_data_smithi018_166993_object45425:head# 2024-02-10T08:39:11.283 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a47fe343:::benchmark_data_smithi018_166993_object90156:head# 2024-02-10T08:39:11.285 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a480b86d:::benchmark_data_smithi018_166993_object83909:head# 2024-02-10T08:39:11.286 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4817dde:::benchmark_data_smithi018_166993_object62989:head# 2024-02-10T08:39:11.288 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a48291e6:::benchmark_data_smithi018_166993_object45995:head# 2024-02-10T08:39:11.288 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a482c51a:::benchmark_data_smithi018_166993_object76074:head# 2024-02-10T08:39:11.288 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a483016e:::benchmark_data_smithi018_166993_object86802:head# 2024-02-10T08:39:11.292 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4832170:::benchmark_data_smithi018_166993_object43066:head# 2024-02-10T08:39:11.292 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a48371f1:::benchmark_data_smithi018_166993_object104712:head# 2024-02-10T08:39:11.293 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a485538e:::benchmark_data_smithi018_166993_object61773:head# 2024-02-10T08:39:11.294 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a48579cc:::benchmark_data_smithi018_166993_object25682:head# 2024-02-10T08:39:11.297 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4861305:::benchmark_data_smithi018_166993_object112222:head# 2024-02-10T08:39:11.298 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a48843c6:::benchmark_data_smithi018_166993_object80666:head# 2024-02-10T08:39:11.298 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4888af5:::benchmark_data_smithi018_166993_object65861:head# 2024-02-10T08:39:11.298 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a48a80f3:::benchmark_data_smithi018_166993_object104087:head# 2024-02-10T08:39:11.301 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a48aa5c3:::benchmark_data_smithi018_166993_object49020:head# 2024-02-10T08:39:11.301 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a48ab9b7:::benchmark_data_smithi018_166993_object93432:head# 2024-02-10T08:39:11.301 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a48dcf62:::benchmark_data_smithi018_166993_object68365:head# 2024-02-10T08:39:11.301 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a49073e4:::benchmark_data_smithi018_166993_object41450:head# 2024-02-10T08:39:11.301 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a490ef51:::benchmark_data_smithi018_166993_object87589:head# 2024-02-10T08:39:11.306 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4913f55:::benchmark_data_smithi018_166993_object96918:head# 2024-02-10T08:39:11.306 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a49185d6:::benchmark_data_smithi018_166993_object55255:head# 2024-02-10T08:39:11.307 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a491978f:::benchmark_data_smithi018_166993_object37149:head# 2024-02-10T08:39:11.308 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a492d550:::benchmark_data_smithi018_166993_object97827:head# 2024-02-10T08:39:11.308 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4930195:::benchmark_data_smithi018_166993_object18114:head# 2024-02-10T08:39:11.308 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4932852:::benchmark_data_smithi018_166993_object78563:head# 2024-02-10T08:39:11.309 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4949d56:::benchmark_data_smithi018_166993_object38119:head# 2024-02-10T08:39:11.309 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a494c1d7:::benchmark_data_smithi018_166993_object68615:head# 2024-02-10T08:39:11.310 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a494c326:::benchmark_data_smithi018_166993_object71122:head# 2024-02-10T08:39:11.310 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4956620:::benchmark_data_smithi018_166993_object93698:head# 2024-02-10T08:39:11.314 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a495b985:::benchmark_data_smithi018_166993_object29158:head# 2024-02-10T08:39:11.314 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a496c89f:::benchmark_data_smithi018_166993_object29849:head# 2024-02-10T08:39:11.314 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a497042a:::benchmark_data_smithi018_166993_object109828:head# 2024-02-10T08:39:11.316 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a49705f3:::benchmark_data_smithi018_166993_object31173:head# 2024-02-10T08:39:11.317 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a498f7cb:::benchmark_data_smithi018_166993_object113365:head# 2024-02-10T08:39:11.318 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4991237:::benchmark_data_smithi018_166993_object91754:head# 2024-02-10T08:39:11.321 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a499660f:::benchmark_data_smithi018_166993_object75143:head# 2024-02-10T08:39:11.321 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4997e04:::benchmark_data_smithi018_166993_object65751:head# 2024-02-10T08:39:11.322 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a49a8d0c:::benchmark_data_smithi018_166993_object40640:head# 2024-02-10T08:39:11.322 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a49b331f:::benchmark_data_smithi018_166993_object23363:head# 2024-02-10T08:39:11.322 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a49b48cb:::benchmark_data_smithi018_166993_object100735:head# 2024-02-10T08:39:11.322 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a49b56ab:::benchmark_data_smithi018_166993_object32880:head# 2024-02-10T08:39:11.322 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a49cd43c:::benchmark_data_smithi018_166993_object18427:head# 2024-02-10T08:39:11.322 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a49d2554:::benchmark_data_smithi018_166993_object76016:head# 2024-02-10T08:39:11.322 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a49eb5d1:::benchmark_data_smithi018_166993_object44464:head# 2024-02-10T08:39:11.325 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a49f6c3d:::benchmark_data_smithi018_166993_object63945:head# 2024-02-10T08:39:11.325 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a49faffb:::benchmark_data_smithi018_166993_object104919:head# 2024-02-10T08:39:11.325 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4a0c72a:::benchmark_data_smithi018_166993_object42878:head# 2024-02-10T08:39:11.325 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4a145c6:::benchmark_data_smithi018_166993_object45364:head# 2024-02-10T08:39:11.326 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4a491ae:::benchmark_data_smithi018_166993_object60227:head# 2024-02-10T08:39:11.326 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4a49571:::benchmark_data_smithi018_166993_object75736:head# 2024-02-10T08:39:11.326 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4a53985:::benchmark_data_smithi018_166993_object49128:head# 2024-02-10T08:39:11.326 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4a65e62:::benchmark_data_smithi018_166993_object104847:head# 2024-02-10T08:39:11.329 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4a6b163:::benchmark_data_smithi018_166993_object54574:head# 2024-02-10T08:39:11.329 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4a6d779:::benchmark_data_smithi018_166993_object90144:head# 2024-02-10T08:39:11.329 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4a75b4a:::benchmark_data_smithi018_166993_object20534:head# 2024-02-10T08:39:11.329 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4a83984:::benchmark_data_smithi018_166993_object74410:head# 2024-02-10T08:39:11.330 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4a89262:::benchmark_data_smithi018_166993_object74379:head# 2024-02-10T08:39:11.330 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4a895a4:::benchmark_data_smithi018_166993_object83105:head# 2024-02-10T08:39:11.330 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4a9fc75:::benchmark_data_smithi018_166993_object69514:head# 2024-02-10T08:39:11.330 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4aa5489:::benchmark_data_smithi018_166993_object111590:head# 2024-02-10T08:39:11.331 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4aa5820:::benchmark_data_smithi018_166993_object65863:head# 2024-02-10T08:39:11.335 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4aa91c3:::benchmark_data_smithi018_166993_object38942:head# 2024-02-10T08:39:11.335 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4aab9e1:::benchmark_data_smithi018_166993_object23884:head# 2024-02-10T08:39:11.335 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4aaf0cc:::benchmark_data_smithi018_166993_object65631:head# 2024-02-10T08:39:11.335 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4aaf3a0:::benchmark_data_smithi018_166993_object100374:head# 2024-02-10T08:39:11.336 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4aaf56d:::benchmark_data_smithi018_166993_object117386:head# 2024-02-10T08:39:11.336 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4ac9c8c:::benchmark_data_smithi018_166993_object103778:head# 2024-02-10T08:39:11.336 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4ad2608:::benchmark_data_smithi018_166993_object40335:head# 2024-02-10T08:39:11.336 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4af2b36:::benchmark_data_smithi018_166993_object29345:head# 2024-02-10T08:39:11.339 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4af773d:::benchmark_data_smithi018_166993_object66346:head# 2024-02-10T08:39:11.339 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4aff3ad:::benchmark_data_smithi018_166993_object74133:head# 2024-02-10T08:39:11.339 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4b068c0:::benchmark_data_smithi018_166993_object95102:head# 2024-02-10T08:39:11.339 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4b16a78:::benchmark_data_smithi018_166993_object42759:head# 2024-02-10T08:39:11.339 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4b16e32:::benchmark_data_smithi018_166993_object41111:head# 2024-02-10T08:39:11.339 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4b17428:::benchmark_data_smithi018_166993_object27927:head# 2024-02-10T08:39:11.340 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4b313f1:::benchmark_data_smithi018_166993_object92286:head# 2024-02-10T08:39:11.340 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4b39f4f:::benchmark_data_smithi018_166993_object117936:head# 2024-02-10T08:39:11.340 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4b3decb:::benchmark_data_smithi018_166993_object52652:head# 2024-02-10T08:39:11.342 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4b40fcf:::benchmark_data_smithi018_166993_object24929:head# 2024-02-10T08:39:11.343 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4b4a869:::benchmark_data_smithi018_166993_object105836:head# 2024-02-10T08:39:11.344 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4b53011:::benchmark_data_smithi018_166993_object47199:head# 2024-02-10T08:39:11.346 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4b5814a:::benchmark_data_smithi018_166993_object41815:head# 2024-02-10T08:39:11.346 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4b58fae:::benchmark_data_smithi018_166993_object85010:head# 2024-02-10T08:39:11.346 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4b6261c:::benchmark_data_smithi018_166993_object102317:head# 2024-02-10T08:39:11.346 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4b657d2:::benchmark_data_smithi018_166993_object23605:head# 2024-02-10T08:39:11.346 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4b6c763:::benchmark_data_smithi018_166993_object109913:head# 2024-02-10T08:39:11.347 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4bbba54:::benchmark_data_smithi018_166993_object54779:head# 2024-02-10T08:39:11.347 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4bbbbe2:::benchmark_data_smithi018_166993_object41878:head# 2024-02-10T08:39:11.348 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4bbde80:::benchmark_data_smithi018_166993_object77031:head# 2024-02-10T08:39:11.348 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4bcd1c2:::benchmark_data_smithi018_166993_object19779:head# 2024-02-10T08:39:11.348 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4bf5f8c:::benchmark_data_smithi018_166993_object20705:head# 2024-02-10T08:39:11.349 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4bfd79f:::benchmark_data_smithi018_166993_object94250:head# 2024-02-10T08:39:11.350 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4c091a7:::benchmark_data_smithi018_166993_object38887:head# 2024-02-10T08:39:11.350 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4c16702:::benchmark_data_smithi018_166993_object58521:head# 2024-02-10T08:39:11.350 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4c1782e:::benchmark_data_smithi018_166993_object75092:head# 2024-02-10T08:39:11.352 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4c19f5f:::benchmark_data_smithi018_166993_object70257:head# 2024-02-10T08:39:11.352 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4c1ea96:::benchmark_data_smithi018_166993_object114707:head# 2024-02-10T08:39:11.352 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4c37e3d:::benchmark_data_smithi018_166993_object113002:head# 2024-02-10T08:39:11.352 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4c629ed:::benchmark_data_smithi018_166993_object53277:head# 2024-02-10T08:39:11.353 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4c6815f:::benchmark_data_smithi018_166993_object106268:head# 2024-02-10T08:39:11.354 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4c79594:::benchmark_data_smithi018_166993_object75942:head# 2024-02-10T08:39:11.357 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4c97fb6:::benchmark_data_smithi018_166993_object98636:head# 2024-02-10T08:39:11.357 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4c98507:::benchmark_data_smithi018_166993_object26994:head# 2024-02-10T08:39:11.357 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4ca9632:::benchmark_data_smithi018_166993_object107367:head# 2024-02-10T08:39:11.357 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4cb979c:::benchmark_data_smithi018_166993_object69535:head# 2024-02-10T08:39:11.357 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4cc2f65:::benchmark_data_smithi018_166993_object18377:head# 2024-02-10T08:39:11.357 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4cc89bf:::benchmark_data_smithi018_166993_object50615:head# 2024-02-10T08:39:11.357 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4ce3dab:::benchmark_data_smithi018_166993_object92378:head# 2024-02-10T08:39:11.358 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4ce865f:::benchmark_data_smithi018_166993_object57830:head# 2024-02-10T08:39:11.358 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4cf1419:::benchmark_data_smithi018_166993_object67368:head# 2024-02-10T08:39:11.358 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4d0ef18:::benchmark_data_smithi018_166993_object103491:head# 2024-02-10T08:39:11.358 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4d13a9a:::benchmark_data_smithi018_166993_object34673:head# 2024-02-10T08:39:11.359 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4d29fea:::benchmark_data_smithi018_166993_object117188:head# 2024-02-10T08:39:11.359 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4d393b3:::benchmark_data_smithi018_166993_object103874:head# 2024-02-10T08:39:11.359 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4d3c17a:::benchmark_data_smithi018_166993_object53857:head# 2024-02-10T08:39:11.361 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4d3c5fa:::benchmark_data_smithi018_166993_object72345:head# 2024-02-10T08:39:11.362 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4d4171f:::benchmark_data_smithi018_166993_object107760:head# 2024-02-10T08:39:11.362 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4d4cb8e:::benchmark_data_smithi018_166993_object103569:head# 2024-02-10T08:39:11.368 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4d5227a:::benchmark_data_smithi018_166993_object29034:head# 2024-02-10T08:39:11.369 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4d54227:::benchmark_data_smithi018_166993_object66918:head# 2024-02-10T08:39:11.369 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4d5f771:::benchmark_data_smithi018_166993_object103508:head# 2024-02-10T08:39:11.370 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4d6eeff:::benchmark_data_smithi018_166993_object62236:head# 2024-02-10T08:39:11.370 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4d75db8:::benchmark_data_smithi018_166993_object76051:head# 2024-02-10T08:39:11.372 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4d7da8e:::benchmark_data_smithi018_166993_object93704:head# 2024-02-10T08:39:11.372 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4d7ed28:::benchmark_data_smithi018_166993_object114780:head# 2024-02-10T08:39:11.373 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4d836e4:::benchmark_data_smithi018_166993_object18488:head# 2024-02-10T08:39:11.373 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4d94f90:::benchmark_data_smithi018_166993_object88604:head# 2024-02-10T08:39:11.379 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4d97a75:::benchmark_data_smithi018_166993_object57634:head# 2024-02-10T08:39:11.379 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4d9eeb0:::benchmark_data_smithi018_166993_object100514:head# 2024-02-10T08:39:11.380 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4da2782:::benchmark_data_smithi018_166993_object104612:head# 2024-02-10T08:39:11.380 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4da4e72:::benchmark_data_smithi018_166993_object43025:head# 2024-02-10T08:39:11.380 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4dbf8d6:::benchmark_data_smithi018_166993_object49245:head# 2024-02-10T08:39:11.380 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4dc247a:::benchmark_data_smithi018_166993_object26086:head# 2024-02-10T08:39:11.384 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4dd39b3:::benchmark_data_smithi018_166993_object76390:head# 2024-02-10T08:39:11.384 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4deafdf:::benchmark_data_smithi018_166993_object74681:head# 2024-02-10T08:39:11.384 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4deb8c4:::benchmark_data_smithi018_166993_object78495:head# 2024-02-10T08:39:11.384 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4dff38c:::benchmark_data_smithi018_166993_object114614:head# 2024-02-10T08:39:11.384 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4e01642:::benchmark_data_smithi018_166993_object20902:head# 2024-02-10T08:39:11.384 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4e05416:::benchmark_data_smithi018_166993_object77761:head# 2024-02-10T08:39:11.385 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4e26fb4:::benchmark_data_smithi018_166993_object82399:head# 2024-02-10T08:39:11.385 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4e36ce9:::benchmark_data_smithi018_166993_object108416:head# 2024-02-10T08:39:11.385 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4e3dc43:::benchmark_data_smithi018_166993_object60002:head# 2024-02-10T08:39:11.388 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4e44d72:::benchmark_data_smithi018_166993_object119074:head# 2024-02-10T08:39:11.388 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4e5388e:::benchmark_data_smithi018_166993_object101976:head# 2024-02-10T08:39:11.389 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4e59bc6:::benchmark_data_smithi018_166993_object23647:head# 2024-02-10T08:39:11.389 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4e69c0d:::benchmark_data_smithi018_166993_object53721:head# 2024-02-10T08:39:11.393 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4e6a0e6:::benchmark_data_smithi018_166993_object91509:head# 2024-02-10T08:39:11.393 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4e715cc:::benchmark_data_smithi018_166993_object61084:head# 2024-02-10T08:39:11.393 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4e73cd2:::benchmark_data_smithi018_166993_object33469:head# 2024-02-10T08:39:11.394 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4e79c0b:::benchmark_data_smithi018_166993_object118793:head# 2024-02-10T08:39:11.394 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4e8b17d:::benchmark_data_smithi018_166993_object80802:head# 2024-02-10T08:39:11.394 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4e8bacf:::benchmark_data_smithi018_166993_object32657:head# 2024-02-10T08:39:11.394 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4ea60bc:::benchmark_data_smithi018_166993_object91063:head# 2024-02-10T08:39:11.395 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4ebca1d:::benchmark_data_smithi018_166993_object48071:head# 2024-02-10T08:39:11.395 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4ec23b9:::benchmark_data_smithi018_166993_object85959:head# 2024-02-10T08:39:11.395 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4ec3850:::benchmark_data_smithi018_166993_object112047:head# 2024-02-10T08:39:11.395 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4ecbd35:::benchmark_data_smithi018_166993_object89168:head# 2024-02-10T08:39:11.396 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4ee09b5:::benchmark_data_smithi018_166993_object22226:head# 2024-02-10T08:39:11.397 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4ee6a58:::benchmark_data_smithi018_166993_object79483:head# 2024-02-10T08:39:11.402 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4f22d6f:::benchmark_data_smithi018_166993_object49750:head# 2024-02-10T08:39:11.402 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4f2c7c4:::benchmark_data_smithi018_166993_object71532:head# 2024-02-10T08:39:11.402 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4f2d8cc:::benchmark_data_smithi018_166993_object86265:head# 2024-02-10T08:39:11.403 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4f4467c:::benchmark_data_smithi018_166993_object30845:head# 2024-02-10T08:39:11.403 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4f4e367:::benchmark_data_smithi018_166993_object86624:head# 2024-02-10T08:39:11.405 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4f6068b:::benchmark_data_smithi018_166993_object107346:head# 2024-02-10T08:39:11.407 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4f6186b:::benchmark_data_smithi018_166993_object107020:head# 2024-02-10T08:39:11.407 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4f64033:::benchmark_data_smithi018_166993_object105668:head# 2024-02-10T08:39:11.407 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4f66f0a:::benchmark_data_smithi018_166993_object47365:head# 2024-02-10T08:39:11.408 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4f78780:::benchmark_data_smithi018_166993_object82421:head# 2024-02-10T08:39:11.409 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4f81014:::benchmark_data_smithi018_166993_object115845:head# 2024-02-10T08:39:11.409 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4f94a6a:::benchmark_data_smithi018_166993_object19151:head# 2024-02-10T08:39:11.410 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4f9634e:::benchmark_data_smithi018_166993_object112963:head# 2024-02-10T08:39:11.411 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4f96a23:::benchmark_data_smithi018_166993_object25681:head# 2024-02-10T08:39:11.411 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4faaadf:::benchmark_data_smithi018_166993_object44921:head# 2024-02-10T08:39:11.412 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4fb8b1e:::benchmark_data_smithi018_166993_object26711:head# 2024-02-10T08:39:11.426 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4fc2e0c:::benchmark_data_smithi018_166993_object57343:head# 2024-02-10T08:39:11.427 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4fc44b0:::benchmark_data_smithi018_166993_object71095:head# 2024-02-10T08:39:11.427 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4fcc87f:::benchmark_data_smithi018_166993_object31633:head# 2024-02-10T08:39:11.427 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4fcc986:::benchmark_data_smithi018_166993_object83031:head# 2024-02-10T08:39:11.427 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4fd10a0:::benchmark_data_smithi018_166993_object37079:head# 2024-02-10T08:39:11.427 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4fdc28e:::benchmark_data_smithi018_166993_object92224:head# 2024-02-10T08:39:11.427 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4fe9699:::benchmark_data_smithi018_166993_object113067:head# 2024-02-10T08:39:11.427 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4feb3a4:::benchmark_data_smithi018_166993_object110950:head# 2024-02-10T08:39:11.427 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4fef2c4:::benchmark_data_smithi018_166993_object17968:head# 2024-02-10T08:39:11.427 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a4fff154:::benchmark_data_smithi018_166993_object17458:head# 2024-02-10T08:39:11.427 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a500401c:::benchmark_data_smithi018_166993_object62319:head# 2024-02-10T08:39:11.429 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a500991b:::benchmark_data_smithi018_166993_object87406:head# 2024-02-10T08:39:11.429 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5022c62:::benchmark_data_smithi018_166993_object46892:head# 2024-02-10T08:39:11.429 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a502d4ce:::benchmark_data_smithi018_166993_object33957:head# 2024-02-10T08:39:11.430 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5033662:::benchmark_data_smithi018_166993_object30100:head# 2024-02-10T08:39:11.435 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a50347c1:::benchmark_data_smithi018_166993_object81644:head# 2024-02-10T08:39:11.435 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5038143:::benchmark_data_smithi018_166993_object103678:head# 2024-02-10T08:39:11.436 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a504957e:::benchmark_data_smithi018_166993_object51465:head# 2024-02-10T08:39:11.442 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5053cea:::benchmark_data_smithi018_166993_object53416:head# 2024-02-10T08:39:11.443 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a506c6cb:::benchmark_data_smithi018_166993_object74520:head# 2024-02-10T08:39:11.445 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a507a3a7:::benchmark_data_smithi018_166993_object97428:head# 2024-02-10T08:39:11.445 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a507fad8:::benchmark_data_smithi018_166993_object100949:head# 2024-02-10T08:39:11.445 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5082db4:::benchmark_data_smithi018_166993_object85335:head# 2024-02-10T08:39:11.445 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a50846e8:::benchmark_data_smithi018_166993_object32069:head# 2024-02-10T08:39:11.448 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5091d22:::benchmark_data_smithi018_166993_object114151:head# 2024-02-10T08:39:11.448 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a509bf4a:::benchmark_data_smithi018_166993_object44064:head# 2024-02-10T08:39:11.448 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a50b21de:::benchmark_data_smithi018_166993_object31656:head# 2024-02-10T08:39:11.448 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a50bf5f7:::benchmark_data_smithi018_166993_object77008:head# 2024-02-10T08:39:11.448 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a50ca5d1:::benchmark_data_smithi018_166993_object51078:head# 2024-02-10T08:39:11.448 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a50d09d8:::benchmark_data_smithi018_166993_object111996:head# 2024-02-10T08:39:11.449 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a50e213a:::benchmark_data_smithi018_166993_object52006:head# 2024-02-10T08:39:11.450 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a50eaf76:::benchmark_data_smithi018_166993_object87031:head# 2024-02-10T08:39:11.450 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a50fc0cf:::benchmark_data_smithi018_166993_object116460:head# 2024-02-10T08:39:11.450 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a50fde97:::benchmark_data_smithi018_166993_object81483:head# 2024-02-10T08:39:11.451 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a510501d:::benchmark_data_smithi018_166993_object114455:head# 2024-02-10T08:39:11.452 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5111104:::benchmark_data_smithi018_166993_object44545:head# 2024-02-10T08:39:11.453 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a51121ab:::benchmark_data_smithi018_166993_object113459:head# 2024-02-10T08:39:11.453 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a51204c2:::benchmark_data_smithi018_166993_object22759:head# 2024-02-10T08:39:11.454 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a51324f1:::benchmark_data_smithi018_166993_object53548:head# 2024-02-10T08:39:11.456 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5135fee:::benchmark_data_smithi018_166993_object41312:head# 2024-02-10T08:39:11.456 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5138d48:::benchmark_data_smithi018_166993_object60398:head# 2024-02-10T08:39:11.457 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a513a2b4:::benchmark_data_smithi018_166993_object27409:head# 2024-02-10T08:39:11.457 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a513b92d:::benchmark_data_smithi018_166993_object24456:head# 2024-02-10T08:39:11.460 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a515a6e5:::benchmark_data_smithi018_166993_object113054:head# 2024-02-10T08:39:11.461 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5172e8c:::benchmark_data_smithi018_166993_object42046:head# 2024-02-10T08:39:11.461 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5179d57:::benchmark_data_smithi018_166993_object26312:head# 2024-02-10T08:39:11.462 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a518111d:::benchmark_data_smithi018_166993_object93929:head# 2024-02-10T08:39:11.462 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5182290:::benchmark_data_smithi018_166993_object31017:head# 2024-02-10T08:39:11.462 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a518c41a:::benchmark_data_smithi018_166993_object49946:head# 2024-02-10T08:39:11.463 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a51a7283:::benchmark_data_smithi018_166993_object64898:head# 2024-02-10T08:39:11.463 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a51aac2d:::benchmark_data_smithi018_166993_object88910:head# 2024-02-10T08:39:11.464 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a51befdb:::benchmark_data_smithi018_166993_object23981:head# 2024-02-10T08:39:11.464 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a51c118e:::benchmark_data_smithi018_166993_object100516:head# 2024-02-10T08:39:11.464 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a51ebc09:::benchmark_data_smithi018_166993_object32857:head# 2024-02-10T08:39:11.465 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a51f218d:::benchmark_data_smithi018_166993_object70569:head# 2024-02-10T08:39:11.465 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a51f5b59:::benchmark_data_smithi018_166993_object23492:head# 2024-02-10T08:39:11.466 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a52001f2:::benchmark_data_smithi018_166993_object72848:head# 2024-02-10T08:39:11.467 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5205d31:::benchmark_data_smithi018_166993_object68730:head# 2024-02-10T08:39:11.467 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a520b94f:::benchmark_data_smithi018_166993_object61547:head# 2024-02-10T08:39:11.468 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a521baf2:::benchmark_data_smithi018_166993_object65651:head# 2024-02-10T08:39:11.468 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5223676:::benchmark_data_smithi018_166993_object95859:head# 2024-02-10T08:39:11.468 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5223c28:::benchmark_data_smithi018_166993_object39402:head# 2024-02-10T08:39:11.469 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a522ae04:::benchmark_data_smithi018_166993_object73105:head# 2024-02-10T08:39:11.469 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5234c47:::benchmark_data_smithi018_166993_object27665:head# 2024-02-10T08:39:11.472 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a523752e:::benchmark_data_smithi018_166993_object28111:head# 2024-02-10T08:39:11.472 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5238557:::benchmark_data_smithi018_166993_object105285:head# 2024-02-10T08:39:11.472 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a523a377:::benchmark_data_smithi018_166993_object26403:head# 2024-02-10T08:39:11.472 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5244a86:::benchmark_data_smithi018_166993_object70288:head# 2024-02-10T08:39:11.473 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a525730a:::benchmark_data_smithi018_166993_object97690:head# 2024-02-10T08:39:11.473 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5258426:::benchmark_data_smithi018_166993_object58428:head# 2024-02-10T08:39:11.474 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5264e5b:::benchmark_data_smithi018_166993_object70138:head# 2024-02-10T08:39:11.476 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a526c9ec:::benchmark_data_smithi018_166993_object75803:head# 2024-02-10T08:39:11.476 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a52819ec:::benchmark_data_smithi018_166993_object110588:head# 2024-02-10T08:39:11.478 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5281db2:::benchmark_data_smithi018_166993_object55337:head# 2024-02-10T08:39:11.479 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5295eb5:::benchmark_data_smithi018_166993_object64097:head# 2024-02-10T08:39:11.479 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a52a606f:::benchmark_data_smithi018_166993_object52384:head# 2024-02-10T08:39:11.480 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a52a8bc0:::benchmark_data_smithi018_166993_object37638:head# 2024-02-10T08:39:11.481 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a52b997a:::benchmark_data_smithi018_166993_object33725:head# 2024-02-10T08:39:11.481 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a52c27e7:::benchmark_data_smithi018_166993_object95740:head# 2024-02-10T08:39:11.482 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a52c9723:::benchmark_data_smithi018_166993_object108328:head# 2024-02-10T08:39:11.482 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a52d7303:::benchmark_data_smithi018_166993_object33189:head# 2024-02-10T08:39:11.485 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a52dd6a8:::benchmark_data_smithi018_166993_object100209:head# 2024-02-10T08:39:11.485 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a52e4c37:::benchmark_data_smithi018_166993_object39708:head# 2024-02-10T08:39:11.486 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a52e4cca:::benchmark_data_smithi018_166993_object60106:head# 2024-02-10T08:39:11.486 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a52f8bc8:::benchmark_data_smithi018_166993_object18017:head# 2024-02-10T08:39:11.489 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a52fbcdc:::benchmark_data_smithi018_166993_object27956:head# 2024-02-10T08:39:11.492 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5304c70:::benchmark_data_smithi018_166993_object48581:head# 2024-02-10T08:39:11.492 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a530bf69:::benchmark_data_smithi018_166993_object41923:head# 2024-02-10T08:39:11.492 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5310ade:::benchmark_data_smithi018_166993_object107539:head# 2024-02-10T08:39:11.492 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a53195a1:::benchmark_data_smithi018_166993_object34995:head# 2024-02-10T08:39:11.497 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a531a05f:::benchmark_data_smithi018_166993_object64685:head# 2024-02-10T08:39:11.497 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5327905:::benchmark_data_smithi018_166993_object101580:head# 2024-02-10T08:39:11.497 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a53339d9:::benchmark_data_smithi018_166993_object75521:head# 2024-02-10T08:39:11.500 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5334caa:::benchmark_data_smithi018_166993_object100700:head# 2024-02-10T08:39:11.501 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5339355:::benchmark_data_smithi018_166993_object28866:head# 2024-02-10T08:39:11.505 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5340846:::benchmark_data_smithi018_166993_object26971:head# 2024-02-10T08:39:11.505 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a53470bb:::benchmark_data_smithi018_166993_object73645:head# 2024-02-10T08:39:11.506 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5347b52:::benchmark_data_smithi018_166993_object96797:head# 2024-02-10T08:39:11.506 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a535aee3:::benchmark_data_smithi018_166993_object101008:head# 2024-02-10T08:39:11.508 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a53612ab:::benchmark_data_smithi018_166993_object78033:head# 2024-02-10T08:39:11.509 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a536707a:::benchmark_data_smithi018_166993_object71324:head# 2024-02-10T08:39:11.509 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5369618:::benchmark_data_smithi018_166993_object52293:head# 2024-02-10T08:39:11.509 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a53703aa:::benchmark_data_smithi018_166993_object88405:head# 2024-02-10T08:39:11.509 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5371373:::benchmark_data_smithi018_166993_object118787:head# 2024-02-10T08:39:11.510 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a53775ad:::benchmark_data_smithi018_166993_object56759:head# 2024-02-10T08:39:11.510 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5379265:::benchmark_data_smithi018_166993_object99906:head# 2024-02-10T08:39:11.510 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a537a3b5:::benchmark_data_smithi018_166993_object103079:head# 2024-02-10T08:39:11.512 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a537b018:::benchmark_data_smithi018_166993_object67981:head# 2024-02-10T08:39:11.512 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a537f3c3:::benchmark_data_smithi018_166993_object116093:head# 2024-02-10T08:39:11.512 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a537ff3e:::benchmark_data_smithi018_166993_object45916:head# 2024-02-10T08:39:11.513 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a53818c1:::benchmark_data_smithi018_166993_object95504:head# 2024-02-10T08:39:11.515 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a53958bf:::benchmark_data_smithi018_166993_object26596:head# 2024-02-10T08:39:11.518 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5397753:::benchmark_data_smithi018_166993_object76433:head# 2024-02-10T08:39:11.518 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a539c68c:::benchmark_data_smithi018_166993_object70178:head# 2024-02-10T08:39:11.519 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a53a7c64:::benchmark_data_smithi018_166993_object110175:head# 2024-02-10T08:39:11.520 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a53af273:::benchmark_data_smithi018_166993_object111992:head# 2024-02-10T08:39:11.520 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a53b8ca6:::benchmark_data_smithi018_166993_object35789:head# 2024-02-10T08:39:11.522 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a53b8eac:::benchmark_data_smithi018_166993_object80195:head# 2024-02-10T08:39:11.522 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a53ca843:::benchmark_data_smithi018_166993_object113642:head# 2024-02-10T08:39:11.522 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a53d3fbe:::benchmark_data_smithi018_166993_object45412:head# 2024-02-10T08:39:11.522 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a53ebd75:::benchmark_data_smithi018_166993_object28521:head# 2024-02-10T08:39:11.523 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a53ecae7:::benchmark_data_smithi018_166993_object25957:head# 2024-02-10T08:39:11.523 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5404995:::benchmark_data_smithi018_166993_object34090:head# 2024-02-10T08:39:11.524 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5406774:::benchmark_data_smithi018_166993_object54299:head# 2024-02-10T08:39:11.524 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a540936b:::benchmark_data_smithi018_166993_object99288:head# 2024-02-10T08:39:11.525 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5415c32:::benchmark_data_smithi018_166993_object29773:head# 2024-02-10T08:39:11.525 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a54186be:::benchmark_data_smithi018_166993_object80510:head# 2024-02-10T08:39:11.526 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a541904a:::benchmark_data_smithi018_166993_object60291:head# 2024-02-10T08:39:11.527 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5424475:::benchmark_data_smithi018_166993_object48110:head# 2024-02-10T08:39:11.527 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a542c1f4:::benchmark_data_smithi018_166993_object112379:head# 2024-02-10T08:39:11.531 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a542e03c:::benchmark_data_smithi018_166993_object84910:head# 2024-02-10T08:39:11.531 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5442853:::benchmark_data_smithi018_166993_object109413:head# 2024-02-10T08:39:11.531 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5443285:::benchmark_data_smithi018_166993_object60913:head# 2024-02-10T08:39:11.535 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5444388:::benchmark_data_smithi018_166993_object47201:head# 2024-02-10T08:39:11.535 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5453af1:::benchmark_data_smithi018_166993_object115073:head# 2024-02-10T08:39:11.535 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5459386:::benchmark_data_smithi018_166993_object31526:head# 2024-02-10T08:39:11.535 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5463251:::benchmark_data_smithi018_166993_object105592:head# 2024-02-10T08:39:11.535 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a546a1c4:::benchmark_data_smithi018_166993_object18423:head# 2024-02-10T08:39:11.535 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a546c698:::benchmark_data_smithi018_166993_object52482:head# 2024-02-10T08:39:11.537 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a546cfe1:::benchmark_data_smithi018_166993_object101168:head# 2024-02-10T08:39:11.537 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a546fb97:::benchmark_data_smithi018_166993_object91716:head# 2024-02-10T08:39:11.538 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5488d87:::benchmark_data_smithi018_166993_object23262:head# 2024-02-10T08:39:11.541 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a54a1ddb:::benchmark_data_smithi018_166993_object88418:head# 2024-02-10T08:39:11.541 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a54a87de:::benchmark_data_smithi018_166993_object28378:head# 2024-02-10T08:39:11.546 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a54b50c4:::benchmark_data_smithi018_166993_object96119:head# 2024-02-10T08:39:11.546 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a54cdf90:::benchmark_data_smithi018_166993_object86736:head# 2024-02-10T08:39:11.546 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a54d1246:::benchmark_data_smithi018_166993_object116032:head# 2024-02-10T08:39:11.546 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a54f4a0b:::benchmark_data_smithi018_166993_object110727:head# 2024-02-10T08:39:11.546 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a550f1ec:::benchmark_data_smithi018_166993_object33876:head# 2024-02-10T08:39:11.546 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a55113b2:::benchmark_data_smithi018_166993_object80108:head# 2024-02-10T08:39:11.546 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5516e3c:::benchmark_data_smithi018_166993_object80040:head# 2024-02-10T08:39:11.547 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a551c9a4:::benchmark_data_smithi018_166993_object103734:head# 2024-02-10T08:39:11.547 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a551d734:::benchmark_data_smithi018_166993_object42790:head# 2024-02-10T08:39:11.547 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a55244ef:::benchmark_data_smithi018_166993_object92004:head# 2024-02-10T08:39:11.547 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a552ded3:::benchmark_data_smithi018_166993_object21265:head# 2024-02-10T08:39:11.547 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5537f96:::benchmark_data_smithi018_166993_object18815:head# 2024-02-10T08:39:11.547 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a553e2d8:::benchmark_data_smithi018_166993_object100867:head# 2024-02-10T08:39:11.548 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a554446f:::benchmark_data_smithi018_166993_object53140:head# 2024-02-10T08:39:11.548 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5545583:::benchmark_data_smithi018_166993_object110841:head# 2024-02-10T08:39:11.548 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5546034:::benchmark_data_smithi018_166993_object74045:head# 2024-02-10T08:39:11.548 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a555485b:::benchmark_data_smithi018_166993_object71045:head# 2024-02-10T08:39:11.550 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5558d90:::benchmark_data_smithi018_166993_object60674:head# 2024-02-10T08:39:11.550 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5559738:::benchmark_data_smithi018_166993_object109250:head# 2024-02-10T08:39:11.550 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a55658e2:::benchmark_data_smithi018_166993_object48181:head# 2024-02-10T08:39:11.550 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5570d9f:::benchmark_data_smithi018_166993_object85615:head# 2024-02-10T08:39:11.552 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5571f1a:::benchmark_data_smithi018_166993_object20049:head# 2024-02-10T08:39:11.553 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a558492f:::benchmark_data_smithi018_166993_object31341:head# 2024-02-10T08:39:11.553 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a558ad02:::benchmark_data_smithi018_166993_object62737:head# 2024-02-10T08:39:11.553 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a55935a3:::benchmark_data_smithi018_166993_object60422:head# 2024-02-10T08:39:11.553 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a55a1143:::benchmark_data_smithi018_166993_object98168:head# 2024-02-10T08:39:11.553 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a55c83f0:::benchmark_data_smithi018_166993_object68360:head# 2024-02-10T08:39:11.553 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a55cbbe6:::benchmark_data_smithi018_166993_object58842:head# 2024-02-10T08:39:11.555 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a55d86c7:::benchmark_data_smithi018_166993_object66768:head# 2024-02-10T08:39:11.555 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a55e37fd:::benchmark_data_smithi018_166993_object104673:head# 2024-02-10T08:39:11.555 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a55f1705:::benchmark_data_smithi018_166993_object71055:head# 2024-02-10T08:39:11.555 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a55fc344:::benchmark_data_smithi018_166993_object35409:head# 2024-02-10T08:39:11.555 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a560d6e4:::benchmark_data_smithi018_166993_object109733:head# 2024-02-10T08:39:11.556 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a560e891:::benchmark_data_smithi018_166993_object57559:head# 2024-02-10T08:39:11.556 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5612513:::benchmark_data_smithi018_166993_object46773:head# 2024-02-10T08:39:11.557 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5619ef9:::benchmark_data_smithi018_166993_object27334:head# 2024-02-10T08:39:11.557 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a56373fd:::benchmark_data_smithi018_166993_object27165:head# 2024-02-10T08:39:11.557 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a56403ca:::benchmark_data_smithi018_166993_object62665:head# 2024-02-10T08:39:11.560 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5642a1e:::benchmark_data_smithi018_166993_object73485:head# 2024-02-10T08:39:11.561 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5644dfd:::benchmark_data_smithi018_166993_object97640:head# 2024-02-10T08:39:11.561 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a56555af:::benchmark_data_smithi018_166993_object40503:head# 2024-02-10T08:39:11.562 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5667715:::benchmark_data_smithi018_166993_object100307:head# 2024-02-10T08:39:11.562 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a566a1b1:::benchmark_data_smithi018_166993_object47151:head# 2024-02-10T08:39:11.564 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a566d124:::benchmark_data_smithi018_166993_object90597:head# 2024-02-10T08:39:11.564 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a566ee96:::benchmark_data_smithi018_166993_object93818:head# 2024-02-10T08:39:11.564 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a56998d2:::benchmark_data_smithi018_166993_object81499:head# 2024-02-10T08:39:11.564 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a569b885:::benchmark_data_smithi018_166993_object75414:head# 2024-02-10T08:39:11.566 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a56a1804:::benchmark_data_smithi018_166993_object59978:head# 2024-02-10T08:39:11.566 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a56c6b23:::benchmark_data_smithi018_166993_object27691:head# 2024-02-10T08:39:11.567 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a56c7f27:::benchmark_data_smithi018_166993_object61161:head# 2024-02-10T08:39:11.567 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a56cfdb5:::benchmark_data_smithi018_166993_object57447:head# 2024-02-10T08:39:11.567 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a56d5ec5:::benchmark_data_smithi018_166993_object89639:head# 2024-02-10T08:39:11.567 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a56d7917:::benchmark_data_smithi018_166993_object115686:head# 2024-02-10T08:39:11.567 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a56e797f:::benchmark_data_smithi018_166993_object61530:head# 2024-02-10T08:39:11.568 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a56e7e0b:::benchmark_data_smithi018_166993_object98544:head# 2024-02-10T08:39:11.568 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a56f447d:::benchmark_data_smithi018_166993_object22733:head# 2024-02-10T08:39:11.568 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a56f9109:::benchmark_data_smithi018_166993_object47638:head# 2024-02-10T08:39:11.569 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a56fbc1f:::benchmark_data_smithi018_166993_object51139:head# 2024-02-10T08:39:11.569 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5710c6f:::benchmark_data_smithi018_166993_object54054:head# 2024-02-10T08:39:11.570 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5728809:::benchmark_data_smithi018_166993_object86223:head# 2024-02-10T08:39:11.570 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a572b5b9:::benchmark_data_smithi018_166993_object84826:head# 2024-02-10T08:39:11.576 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a572dbc6:::benchmark_data_smithi018_166993_object81156:head# 2024-02-10T08:39:11.576 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a572f16a:::benchmark_data_smithi018_166993_object92287:head# 2024-02-10T08:39:11.576 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a574620c:::benchmark_data_smithi018_166993_object106718:head# 2024-02-10T08:39:11.576 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a574a7ed:::benchmark_data_smithi018_166993_object24138:head# 2024-02-10T08:39:11.576 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a575954d:::benchmark_data_smithi018_166993_object105584:head# 2024-02-10T08:39:11.576 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a578fa26:::benchmark_data_smithi018_166993_object29990:head# 2024-02-10T08:39:11.576 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a57922e5:::benchmark_data_smithi018_166993_object82146:head# 2024-02-10T08:39:11.576 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5794cf0:::benchmark_data_smithi018_166993_object94778:head# 2024-02-10T08:39:11.576 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a579a93e:::benchmark_data_smithi018_166993_object50616:head# 2024-02-10T08:39:11.576 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a57be6b1:::benchmark_data_smithi018_166993_object20808:head# 2024-02-10T08:39:11.577 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a57be862:::benchmark_data_smithi018_166993_object85843:head# 2024-02-10T08:39:11.577 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a57f2106:::benchmark_data_smithi018_166993_object73731:head# 2024-02-10T08:39:11.577 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a580c422:::benchmark_data_smithi018_166993_object67420:head# 2024-02-10T08:39:11.577 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a58230c7:::benchmark_data_smithi018_166993_object71415:head# 2024-02-10T08:39:11.578 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a583180a:::benchmark_data_smithi018_166993_object82648:head# 2024-02-10T08:39:11.578 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a584915a:::benchmark_data_smithi018_166993_object115823:head# 2024-02-10T08:39:11.578 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5849405:::benchmark_data_smithi018_166993_object98143:head# 2024-02-10T08:39:11.580 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a584c5d6:::benchmark_data_smithi018_166993_object35211:head# 2024-02-10T08:39:11.580 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5854687:::benchmark_data_smithi018_166993_object64722:head# 2024-02-10T08:39:11.580 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a585818d:::benchmark_data_smithi018_166993_object45993:head# 2024-02-10T08:39:11.583 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a585f2ea:::benchmark_data_smithi018_166993_object19043:head# 2024-02-10T08:39:11.583 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5866993:::benchmark_data_smithi018_166993_object17533:head# 2024-02-10T08:39:11.583 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a587287e:::benchmark_data_smithi018_166993_object103011:head# 2024-02-10T08:39:11.583 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a587415b:::benchmark_data_smithi018_166993_object115092:head# 2024-02-10T08:39:11.583 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5890fc9:::benchmark_data_smithi018_166993_object62874:head# 2024-02-10T08:39:11.583 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a58b7e36:::benchmark_data_smithi018_166993_object117622:head# 2024-02-10T08:39:11.585 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a58bbde3:::benchmark_data_smithi018_166993_object100349:head# 2024-02-10T08:39:11.585 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a58c5680:::benchmark_data_smithi018_166993_object82121:head# 2024-02-10T08:39:11.585 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a58c9641:::benchmark_data_smithi018_166993_object105409:head# 2024-02-10T08:39:11.586 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a58cf42b:::benchmark_data_smithi018_166993_object25536:head# 2024-02-10T08:39:11.587 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a58e07b4:::benchmark_data_smithi018_166993_object28557:head# 2024-02-10T08:39:11.587 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a58fb0a0:::benchmark_data_smithi018_166993_object61474:head# 2024-02-10T08:39:11.588 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a58fe8b5:::benchmark_data_smithi018_166993_object96314:head# 2024-02-10T08:39:11.590 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a59086d0:::benchmark_data_smithi018_166993_object29594:head# 2024-02-10T08:39:11.590 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5909b61:::benchmark_data_smithi018_166993_object101755:head# 2024-02-10T08:39:11.590 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5913431:::benchmark_data_smithi018_166993_object101388:head# 2024-02-10T08:39:11.591 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5914657:::benchmark_data_smithi018_166993_object19764:head# 2024-02-10T08:39:11.591 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a591801a:::benchmark_data_smithi018_166993_object18399:head# 2024-02-10T08:39:11.592 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a59188a7:::benchmark_data_smithi018_166993_object116906:head# 2024-02-10T08:39:11.599 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a591dbac:::benchmark_data_smithi018_166993_object58845:head# 2024-02-10T08:39:11.599 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a592179d:::benchmark_data_smithi018_166993_object85147:head# 2024-02-10T08:39:11.599 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a592d5a6:::benchmark_data_smithi018_166993_object39905:head# 2024-02-10T08:39:11.599 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a59386dc:::benchmark_data_smithi018_166993_object30444:head# 2024-02-10T08:39:11.599 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a593b57b:::benchmark_data_smithi018_166993_object68097:head# 2024-02-10T08:39:11.599 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5964ec1:::benchmark_data_smithi018_166993_object90665:head# 2024-02-10T08:39:11.599 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a596e362:::benchmark_data_smithi018_166993_object78178:head# 2024-02-10T08:39:11.599 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a59892f6:::benchmark_data_smithi018_166993_object50446:head# 2024-02-10T08:39:11.599 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a599489d:::benchmark_data_smithi018_166993_object42710:head# 2024-02-10T08:39:11.603 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5995bb3:::benchmark_data_smithi018_166993_object112195:head# 2024-02-10T08:39:11.603 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a599c11c:::benchmark_data_smithi018_166993_object40982:head# 2024-02-10T08:39:11.603 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a59a2eba:::benchmark_data_smithi018_166993_object114663:head# 2024-02-10T08:39:11.603 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a59ae916:::benchmark_data_smithi018_166993_object57907:head# 2024-02-10T08:39:11.603 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a59c3145:::benchmark_data_smithi018_166993_object74207:head# 2024-02-10T08:39:11.603 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a59d1614:::benchmark_data_smithi018_166993_object37100:head# 2024-02-10T08:39:11.604 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a59d19b4:::benchmark_data_smithi018_166993_object33536:head# 2024-02-10T08:39:11.604 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a59dda27:::benchmark_data_smithi018_166993_object75304:head# 2024-02-10T08:39:11.606 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a59eb623:::benchmark_data_smithi018_166993_object118096:head# 2024-02-10T08:39:11.611 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5a022a8:::benchmark_data_smithi018_166993_object63956:head# 2024-02-10T08:39:11.611 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5a06370:::benchmark_data_smithi018_166993_object70309:head# 2024-02-10T08:39:11.613 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5a08ff9:::benchmark_data_smithi018_166993_object89955:head# 2024-02-10T08:39:11.616 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5a0abf0:::benchmark_data_smithi018_166993_object94914:head# 2024-02-10T08:39:11.617 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5a1f7be:::benchmark_data_smithi018_166993_object73838:head# 2024-02-10T08:39:11.617 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5a2b23f:::benchmark_data_smithi018_166993_object103456:head# 2024-02-10T08:39:11.619 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5a2c3a2:::benchmark_data_smithi018_166993_object67929:head# 2024-02-10T08:39:11.620 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5a2dfbb:::benchmark_data_smithi018_166993_object100427:head# 2024-02-10T08:39:11.620 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5a3186f:::benchmark_data_smithi018_166993_object80780:head# 2024-02-10T08:39:11.621 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5a45aab:::benchmark_data_smithi018_166993_object115624:head# 2024-02-10T08:39:11.621 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5a4657c:::benchmark_data_smithi018_166993_object101735:head# 2024-02-10T08:39:11.624 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5a5b422:::benchmark_data_smithi018_166993_object55105:head# 2024-02-10T08:39:11.625 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5a7f4c3:::benchmark_data_smithi018_166993_object100049:head# 2024-02-10T08:39:11.627 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5a89057:::benchmark_data_smithi018_166993_object108593:head# 2024-02-10T08:39:11.628 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5a89550:::benchmark_data_smithi018_166993_object73308:head# 2024-02-10T08:39:11.628 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5a8d4ac:::benchmark_data_smithi018_166993_object78521:head# 2024-02-10T08:39:11.628 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5a8e29e:::benchmark_data_smithi018_166993_object39159:head# 2024-02-10T08:39:11.628 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5a990c1:::benchmark_data_smithi018_166993_object21061:head# 2024-02-10T08:39:11.633 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5aa4088:::benchmark_data_smithi018_166993_object97067:head# 2024-02-10T08:39:11.633 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5ab40ee:::benchmark_data_smithi018_166993_object80142:head# 2024-02-10T08:39:11.633 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5ab4d27:::benchmark_data_smithi018_166993_object87457:head# 2024-02-10T08:39:11.633 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5acc074:::benchmark_data_smithi018_166993_object65390:head# 2024-02-10T08:39:11.633 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5ae7a34:::benchmark_data_smithi018_166993_object74607:head# 2024-02-10T08:39:11.636 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5aecb34:::benchmark_data_smithi018_166993_object102915:head# 2024-02-10T08:39:11.636 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5af1c48:::benchmark_data_smithi018_166993_object36979:head# 2024-02-10T08:39:11.636 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5af3272:::benchmark_data_smithi018_166993_object36408:head# 2024-02-10T08:39:11.636 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5b0bd39:::benchmark_data_smithi018_166993_object31431:head# 2024-02-10T08:39:11.641 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5b0d69b:::benchmark_data_smithi018_166993_object106813:head# 2024-02-10T08:39:11.641 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5b241f8:::benchmark_data_smithi018_166993_object22611:head# 2024-02-10T08:39:11.641 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5b321c0:::benchmark_data_smithi018_166993_object46679:head# 2024-02-10T08:39:11.641 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5b54cc8:::benchmark_data_smithi018_166993_object58097:head# 2024-02-10T08:39:11.641 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5b5829f:::benchmark_data_smithi018_166993_object109642:head# 2024-02-10T08:39:11.643 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5b68e45:::benchmark_data_smithi018_166993_object37508:head# 2024-02-10T08:39:11.644 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5b7e305:::benchmark_data_smithi018_166993_object61554:head# 2024-02-10T08:39:11.644 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5b807e8:::benchmark_data_smithi018_166993_object36214:head# 2024-02-10T08:39:11.644 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5ba2178:::benchmark_data_smithi018_166993_object97388:head# 2024-02-10T08:39:11.644 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5ba3424:::benchmark_data_smithi018_166993_object54614:head# 2024-02-10T08:39:11.645 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5bb0378:::benchmark_data_smithi018_166993_object32853:head# 2024-02-10T08:39:11.645 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5bb907b:::benchmark_data_smithi018_166993_object75365:head# 2024-02-10T08:39:11.645 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5bbb2f3:::benchmark_data_smithi018_166993_object113299:head# 2024-02-10T08:39:11.645 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5bc28ce:::benchmark_data_smithi018_166993_object68750:head# 2024-02-10T08:39:11.645 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5bcb869:::benchmark_data_smithi018_166993_object81659:head# 2024-02-10T08:39:11.646 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5be641d:::benchmark_data_smithi018_166993_object96091:head# 2024-02-10T08:39:11.650 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5bea651:::benchmark_data_smithi018_166993_object77680:head# 2024-02-10T08:39:11.651 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5c014d4:::benchmark_data_smithi018_166993_object104984:head# 2024-02-10T08:39:11.655 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5c14d0f:::benchmark_data_smithi018_166993_object38637:head# 2024-02-10T08:39:11.656 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5c2eea8:::benchmark_data_smithi018_166993_object77976:head# 2024-02-10T08:39:11.656 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5c349dc:::benchmark_data_smithi018_166993_object59903:head# 2024-02-10T08:39:11.656 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5c38714:::benchmark_data_smithi018_166993_object84448:head# 2024-02-10T08:39:11.657 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5c3a7e5:::benchmark_data_smithi018_166993_object79830:head# 2024-02-10T08:39:11.660 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5c3f672:::benchmark_data_smithi018_166993_object68007:head# 2024-02-10T08:39:11.662 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5c41951:::benchmark_data_smithi018_166993_object75606:head# 2024-02-10T08:39:11.666 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5c6057c:::benchmark_data_smithi018_166993_object88218:head# 2024-02-10T08:39:11.666 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5c65479:::benchmark_data_smithi018_166993_object43509:head# 2024-02-10T08:39:11.667 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5c66f41:::benchmark_data_smithi018_166993_object101586:head# 2024-02-10T08:39:11.667 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5c68d9a:::benchmark_data_smithi018_166993_object64660:head# 2024-02-10T08:39:11.667 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5c6d2c0:::benchmark_data_smithi018_166993_object118111:head# 2024-02-10T08:39:11.667 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5c785ef:::benchmark_data_smithi018_166993_object98332:head# 2024-02-10T08:39:11.667 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5c7aaba:::benchmark_data_smithi018_166993_object63776:head# 2024-02-10T08:39:11.667 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5c893d1:::benchmark_data_smithi018_166993_object79591:head# 2024-02-10T08:39:11.667 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5c9db7b:::benchmark_data_smithi018_166993_object71641:head# 2024-02-10T08:39:11.667 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5cb44d1:::benchmark_data_smithi018_166993_object27830:head# 2024-02-10T08:39:11.667 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5cb53d9:::benchmark_data_smithi018_166993_object22304:head# 2024-02-10T08:39:11.667 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5cc8381:::benchmark_data_smithi018_166993_object78185:head# 2024-02-10T08:39:11.670 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5cd08dc:::benchmark_data_smithi018_166993_object32481:head# 2024-02-10T08:39:11.670 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5cdc6b7:::benchmark_data_smithi018_166993_object27607:head# 2024-02-10T08:39:11.670 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5ce82e5:::benchmark_data_smithi018_166993_object97948:head# 2024-02-10T08:39:11.670 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5cff8c6:::benchmark_data_smithi018_166993_object41722:head# 2024-02-10T08:39:11.670 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5d06c90:::benchmark_data_smithi018_166993_object50247:head# 2024-02-10T08:39:11.670 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5d1ed07:::benchmark_data_smithi018_166993_object104879:head# 2024-02-10T08:39:11.671 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5d268b6:::benchmark_data_smithi018_166993_object49484:head# 2024-02-10T08:39:11.671 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5d3213e:::benchmark_data_smithi018_166993_object19837:head# 2024-02-10T08:39:11.673 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5d3262f:::benchmark_data_smithi018_166993_object21206:head# 2024-02-10T08:39:11.673 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5d3c913:::benchmark_data_smithi018_166993_object52668:head# 2024-02-10T08:39:11.673 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5d518ca:::benchmark_data_smithi018_166993_object17680:head# 2024-02-10T08:39:11.673 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5d5b733:::benchmark_data_smithi018_166993_object29049:head# 2024-02-10T08:39:11.676 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5d5bc72:::benchmark_data_smithi018_166993_object74622:head# 2024-02-10T08:39:11.676 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5d60232:::benchmark_data_smithi018_166993_object64004:head# 2024-02-10T08:39:11.677 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5d66ee9:::benchmark_data_smithi018_166993_object118243:head# 2024-02-10T08:39:11.677 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5d71294:::benchmark_data_smithi018_166993_object33728:head# 2024-02-10T08:39:11.678 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5d71abd:::benchmark_data_smithi018_166993_object62823:head# 2024-02-10T08:39:11.678 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5d7ab0f:::benchmark_data_smithi018_166993_object42358:head# 2024-02-10T08:39:11.679 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5d84f79:::benchmark_data_smithi018_166993_object40877:head# 2024-02-10T08:39:11.679 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5d85109:::benchmark_data_smithi018_166993_object109320:head# 2024-02-10T08:39:11.685 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5d97b4b:::benchmark_data_smithi018_166993_object47382:head# 2024-02-10T08:39:11.685 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5d9ba15:::benchmark_data_smithi018_166993_object104645:head# 2024-02-10T08:39:11.685 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5daa823:::benchmark_data_smithi018_166993_object34923:head# 2024-02-10T08:39:11.685 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5dac172:::benchmark_data_smithi018_166993_object25338:head# 2024-02-10T08:39:11.685 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5db0c12:::benchmark_data_smithi018_166993_object26016:head# 2024-02-10T08:39:11.686 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5db385f:::benchmark_data_smithi018_166993_object20631:head# 2024-02-10T08:39:11.687 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5db6a84:::benchmark_data_smithi018_166993_object64189:head# 2024-02-10T08:39:11.687 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5db790b:::benchmark_data_smithi018_166993_object99830:head# 2024-02-10T08:39:11.690 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5db7a7d:::benchmark_data_smithi018_166993_object97723:head# 2024-02-10T08:39:11.690 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5dca0e6:::benchmark_data_smithi018_166993_object82437:head# 2024-02-10T08:39:11.693 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5ddd5fa:::benchmark_data_smithi018_166993_object29354:head# 2024-02-10T08:39:11.694 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5de78eb:::benchmark_data_smithi018_166993_object36683:head# 2024-02-10T08:39:11.696 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5de90e7:::benchmark_data_smithi018_166993_object115496:head# 2024-02-10T08:39:11.696 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5dea272:::benchmark_data_smithi018_166993_object79792:head# 2024-02-10T08:39:11.696 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5e01b1a:::benchmark_data_smithi018_166993_object113296:head# 2024-02-10T08:39:11.696 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5e289fe:::benchmark_data_smithi018_166993_object111140:head# 2024-02-10T08:39:11.698 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5e39262:::benchmark_data_smithi018_166993_object99936:head# 2024-02-10T08:39:11.698 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5e429ae:::benchmark_data_smithi018_166993_object88110:head# 2024-02-10T08:39:11.699 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5e49641:::benchmark_data_smithi018_166993_object100105:head# 2024-02-10T08:39:11.699 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5e5068e:::benchmark_data_smithi018_166993_object53992:head# 2024-02-10T08:39:11.702 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5e53127:::benchmark_data_smithi018_166993_object52491:head# 2024-02-10T08:39:11.702 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5e584eb:::benchmark_data_smithi018_166993_object26739:head# 2024-02-10T08:39:11.702 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5e5e193:::benchmark_data_smithi018_166993_object44521:head# 2024-02-10T08:39:11.703 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5e5fd6d:::benchmark_data_smithi018_166993_object116306:head# 2024-02-10T08:39:11.703 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5e64fa0:::benchmark_data_smithi018_166993_object86813:head# 2024-02-10T08:39:11.703 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5e68963:::benchmark_data_smithi018_166993_object114601:head# 2024-02-10T08:39:11.703 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5e6c05e:::benchmark_data_smithi018_166993_object114943:head# 2024-02-10T08:39:11.703 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5e778c5:::benchmark_data_smithi018_166993_object59107:head# 2024-02-10T08:39:11.704 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5e8dc9c:::benchmark_data_smithi018_166993_object97838:head# 2024-02-10T08:39:11.704 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5e951c0:::benchmark_data_smithi018_166993_object82259:head# 2024-02-10T08:39:11.704 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5eb2099:::benchmark_data_smithi018_166993_object81443:head# 2024-02-10T08:39:11.705 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5eb37fc:::benchmark_data_smithi018_166993_object116793:head# 2024-02-10T08:39:11.705 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5ebb889:::benchmark_data_smithi018_166993_object48674:head# 2024-02-10T08:39:11.706 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5ec0423:::benchmark_data_smithi018_166993_object83682:head# 2024-02-10T08:39:11.707 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5ec62c6:::benchmark_data_smithi018_166993_object65695:head# 2024-02-10T08:39:11.707 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5ecf161:::benchmark_data_smithi018_166993_object64438:head# 2024-02-10T08:39:11.708 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5ee2452:::benchmark_data_smithi018_166993_object47758:head# 2024-02-10T08:39:11.708 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5ee66ba:::benchmark_data_smithi018_166993_object23722:head# 2024-02-10T08:39:11.717 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5ee852c:::benchmark_data_smithi018_166993_object20627:head# 2024-02-10T08:39:11.717 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5eee969:::benchmark_data_smithi018_166993_object113708:head# 2024-02-10T08:39:11.717 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5ef0b05:::benchmark_data_smithi018_166993_object53896:head# 2024-02-10T08:39:11.717 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5f03867:::benchmark_data_smithi018_166993_object34150:head# 2024-02-10T08:39:11.717 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5f05556:::benchmark_data_smithi018_166993_object26821:head# 2024-02-10T08:39:11.717 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5f0f31d:::benchmark_data_smithi018_166993_object72268:head# 2024-02-10T08:39:11.718 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5f13d5e:::benchmark_data_smithi018_166993_object76739:head# 2024-02-10T08:39:11.718 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5f1fef1:::benchmark_data_smithi018_166993_object68885:head# 2024-02-10T08:39:11.720 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5f2688a:::benchmark_data_smithi018_166993_object72953:head# 2024-02-10T08:39:11.722 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5f2d54c:::benchmark_data_smithi018_166993_object118130:head# 2024-02-10T08:39:11.723 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5f2f8a8:::benchmark_data_smithi018_166993_object36571:head# 2024-02-10T08:39:11.726 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5f31cdf:::benchmark_data_smithi018_166993_object102642:head# 2024-02-10T08:39:11.726 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5f32c58:::benchmark_data_smithi018_166993_object43869:head# 2024-02-10T08:39:11.727 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5f479dd:::benchmark_data_smithi018_166993_object42765:head# 2024-02-10T08:39:11.727 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5f51f11:::benchmark_data_smithi018_166993_object98387:head# 2024-02-10T08:39:11.728 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5f6dbc2:::benchmark_data_smithi018_166993_object22636:head# 2024-02-10T08:39:11.728 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5f7700a:::benchmark_data_smithi018_166993_object21452:head# 2024-02-10T08:39:11.729 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5fb9803:::benchmark_data_smithi018_166993_object30478:head# 2024-02-10T08:39:11.729 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5fbc831:::benchmark_data_smithi018_166993_object19163:head# 2024-02-10T08:39:11.730 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5fbfff9:::benchmark_data_smithi018_166993_object69741:head# 2024-02-10T08:39:11.730 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5fcfbe1:::benchmark_data_smithi018_166993_object98738:head# 2024-02-10T08:39:11.730 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5fd5641:::benchmark_data_smithi018_166993_object69255:head# 2024-02-10T08:39:11.731 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5fe1974:::benchmark_data_smithi018_166993_object84323:head# 2024-02-10T08:39:11.732 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5fe8bd5:::benchmark_data_smithi018_166993_object98878:head# 2024-02-10T08:39:11.737 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5fed721:::benchmark_data_smithi018_166993_object97362:head# 2024-02-10T08:39:11.737 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5ff06e5:::benchmark_data_smithi018_166993_object44933:head# 2024-02-10T08:39:11.737 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5ff1cf8:::benchmark_data_smithi018_166993_object18611:head# 2024-02-10T08:39:11.740 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a5ff735a:::benchmark_data_smithi018_166993_object40122:head# 2024-02-10T08:39:11.740 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6016f5c:::benchmark_data_smithi018_166993_object50832:head# 2024-02-10T08:39:11.741 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a60194d2:::benchmark_data_smithi018_166993_object112094:head# 2024-02-10T08:39:11.741 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a601c1c0:::benchmark_data_smithi018_166993_object90799:head# 2024-02-10T08:39:11.742 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a602507b:::benchmark_data_smithi018_166993_object106487:head# 2024-02-10T08:39:11.743 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a602e0bf:::benchmark_data_smithi018_166993_object78942:head# 2024-02-10T08:39:11.743 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a603c7f2:::benchmark_data_smithi018_166993_object50962:head# 2024-02-10T08:39:11.746 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a604348d:::benchmark_data_smithi018_166993_object42427:head# 2024-02-10T08:39:11.746 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6043512:::benchmark_data_smithi018_166993_object20971:head# 2024-02-10T08:39:11.748 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6049bd8:::benchmark_data_smithi018_166993_object47815:head# 2024-02-10T08:39:11.749 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a604c54d:::benchmark_data_smithi018_166993_object81769:head# 2024-02-10T08:39:11.751 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a604d22b:::benchmark_data_smithi018_166993_object119008:head# 2024-02-10T08:39:11.751 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6050480:::benchmark_data_smithi018_166993_object38556:head# 2024-02-10T08:39:11.751 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a605478c:::benchmark_data_smithi018_166993_object18783:head# 2024-02-10T08:39:11.751 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6060147:::benchmark_data_smithi018_166993_object115244:head# 2024-02-10T08:39:11.751 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a606faeb:::benchmark_data_smithi018_166993_object118120:head# 2024-02-10T08:39:11.752 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a607809a:::benchmark_data_smithi018_166993_object19897:head# 2024-02-10T08:39:11.752 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a607db93:::benchmark_data_smithi018_166993_object60608:head# 2024-02-10T08:39:11.753 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a608a342:::benchmark_data_smithi018_166993_object27032:head# 2024-02-10T08:39:11.753 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6091f85:::benchmark_data_smithi018_166993_object71772:head# 2024-02-10T08:39:11.757 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a609e224:::benchmark_data_smithi018_166993_object66184:head# 2024-02-10T08:39:11.757 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a609f1c0:::benchmark_data_smithi018_166993_object114002:head# 2024-02-10T08:39:11.758 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a60a3d21:::benchmark_data_smithi018_166993_object80697:head# 2024-02-10T08:39:11.758 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a60ae6ef:::benchmark_data_smithi018_166993_object35878:head# 2024-02-10T08:39:11.759 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a60b0353:::benchmark_data_smithi018_166993_object38930:head# 2024-02-10T08:39:11.759 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a60bc41a:::benchmark_data_smithi018_166993_object65141:head# 2024-02-10T08:39:11.760 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a60bce93:::benchmark_data_smithi018_166993_object40339:head# 2024-02-10T08:39:11.760 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a60c4d32:::benchmark_data_smithi018_166993_object65866:head# 2024-02-10T08:39:11.761 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a60c8a84:::benchmark_data_smithi018_166993_object51538:head# 2024-02-10T08:39:11.761 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a60d5635:::benchmark_data_smithi018_166993_object71781:head# 2024-02-10T08:39:11.761 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a60f5adf:::benchmark_data_smithi018_166993_object59974:head# 2024-02-10T08:39:11.766 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a60f8c0f:::benchmark_data_smithi018_166993_object19025:head# 2024-02-10T08:39:11.767 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a61054eb:::benchmark_data_smithi018_166993_object25287:head# 2024-02-10T08:39:11.767 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a610c5ae:::benchmark_data_smithi018_166993_object68850:head# 2024-02-10T08:39:11.767 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a610d3b8:::benchmark_data_smithi018_166993_object66017:head# 2024-02-10T08:39:11.771 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a611ce86:::benchmark_data_smithi018_166993_object63182:head# 2024-02-10T08:39:11.771 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6122de2:::benchmark_data_smithi018_166993_object57817:head# 2024-02-10T08:39:11.771 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a614cca8:::benchmark_data_smithi018_166993_object111355:head# 2024-02-10T08:39:11.771 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a614dcb0:::benchmark_data_smithi018_166993_object42838:head# 2024-02-10T08:39:11.771 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a614eecd:::benchmark_data_smithi018_166993_object76314:head# 2024-02-10T08:39:11.776 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a61561da:::benchmark_data_smithi018_166993_object102538:head# 2024-02-10T08:39:11.776 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a617b3c3:::benchmark_data_smithi018_166993_object79351:head# 2024-02-10T08:39:11.777 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a617baf3:::benchmark_data_smithi018_166993_object47741:head# 2024-02-10T08:39:11.777 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a618a2e0:::benchmark_data_smithi018_166993_object98609:head# 2024-02-10T08:39:11.777 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a618db18:::benchmark_data_smithi018_166993_object97401:head# 2024-02-10T08:39:11.787 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a61baccc:::benchmark_data_smithi018_166993_object115920:head# 2024-02-10T08:39:11.787 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a61bcf62:::benchmark_data_smithi018_166993_object96945:head# 2024-02-10T08:39:11.787 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a61db4ca:::benchmark_data_smithi018_166993_object95886:head# 2024-02-10T08:39:11.787 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a61ddc0f:::benchmark_data_smithi018_166993_object105625:head# 2024-02-10T08:39:11.787 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a61e07a5:::benchmark_data_smithi018_166993_object85931:head# 2024-02-10T08:39:11.787 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a61f9f07:::benchmark_data_smithi018_166993_object107810:head# 2024-02-10T08:39:11.787 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6212287:::benchmark_data_smithi018_166993_object101720:head# 2024-02-10T08:39:11.787 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6217931:::benchmark_data_smithi018_166993_object86550:head# 2024-02-10T08:39:11.788 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a621d907:::benchmark_data_smithi018_166993_object49925:head# 2024-02-10T08:39:11.788 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6224a0d:::benchmark_data_smithi018_166993_object87182:head# 2024-02-10T08:39:11.788 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a622f014:::benchmark_data_smithi018_166993_object109749:head# 2024-02-10T08:39:11.789 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a62348b3:::benchmark_data_smithi018_166993_object44923:head# 2024-02-10T08:39:11.789 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6237b89:::benchmark_data_smithi018_166993_object91751:head# 2024-02-10T08:39:11.790 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a62387c7:::benchmark_data_smithi018_166993_object61299:head# 2024-02-10T08:39:11.790 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6248675:::benchmark_data_smithi018_166993_object59759:head# 2024-02-10T08:39:11.791 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6249523:::benchmark_data_smithi018_166993_object88780:head# 2024-02-10T08:39:11.791 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6253149:::benchmark_data_smithi018_166993_object117875:head# 2024-02-10T08:39:11.792 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6257318:::benchmark_data_smithi018_166993_object32670:head# 2024-02-10T08:39:11.793 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a62583ab:::benchmark_data_smithi018_166993_object57459:head# 2024-02-10T08:39:11.794 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6269e07:::benchmark_data_smithi018_166993_object92017:head# 2024-02-10T08:39:11.794 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a626bded:::benchmark_data_smithi018_166993_object88193:head# 2024-02-10T08:39:11.795 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a627f7b3:::benchmark_data_smithi018_166993_object40975:head# 2024-02-10T08:39:11.795 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a628aab8:::benchmark_data_smithi018_166993_object66416:head# 2024-02-10T08:39:11.796 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a628d020:::benchmark_data_smithi018_166993_object49985:head# 2024-02-10T08:39:11.796 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a628ee15:::benchmark_data_smithi018_166993_object39818:head# 2024-02-10T08:39:11.797 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a628fd79:::benchmark_data_smithi018_166993_object116343:head# 2024-02-10T08:39:11.797 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a62904f8:::benchmark_data_smithi018_166993_object32822:head# 2024-02-10T08:39:11.798 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a629d56a:::benchmark_data_smithi018_166993_object118395:head# 2024-02-10T08:39:11.798 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a62a49f6:::benchmark_data_smithi018_166993_object85798:head# 2024-02-10T08:39:11.799 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a62a9e36:::benchmark_data_smithi018_166993_object39391:head# 2024-02-10T08:39:11.799 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a62ae165:::benchmark_data_smithi018_166993_object63986:head# 2024-02-10T08:39:11.800 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a62b12f9:::benchmark_data_smithi018_166993_object117630:head# 2024-02-10T08:39:11.800 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a62b89bf:::benchmark_data_smithi018_166993_object60258:head# 2024-02-10T08:39:11.801 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a62bd278:::benchmark_data_smithi018_166993_object37947:head# 2024-02-10T08:39:11.801 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a62c4ca9:::benchmark_data_smithi018_166993_object53985:head# 2024-02-10T08:39:11.801 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a62c911f:::benchmark_data_smithi018_166993_object42658:head# 2024-02-10T08:39:11.802 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a62cb752:::benchmark_data_smithi018_166993_object72199:head# 2024-02-10T08:39:11.806 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a62cb823:::benchmark_data_smithi018_166993_object49678:head# 2024-02-10T08:39:11.806 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a62cd6f5:::benchmark_data_smithi018_166993_object25822:head# 2024-02-10T08:39:11.806 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a62d916c:::benchmark_data_smithi018_166993_object111584:head# 2024-02-10T08:39:11.807 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a62dc4ee:::benchmark_data_smithi018_166993_object77345:head# 2024-02-10T08:39:11.807 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a62dfe89:::benchmark_data_smithi018_166993_object105334:head# 2024-02-10T08:39:11.812 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6302598:::benchmark_data_smithi018_166993_object17714:head# 2024-02-10T08:39:11.812 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6308241:::benchmark_data_smithi018_166993_object87982:head# 2024-02-10T08:39:11.812 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a630ab6b:::benchmark_data_smithi018_166993_object115996:head# 2024-02-10T08:39:11.813 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a630d176:::benchmark_data_smithi018_166993_object18070:head# 2024-02-10T08:39:11.813 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a63198b8:::benchmark_data_smithi018_166993_object43100:head# 2024-02-10T08:39:11.813 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a633c361:::benchmark_data_smithi018_166993_object108792:head# 2024-02-10T08:39:11.816 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a634857f:::benchmark_data_smithi018_166993_object47115:head# 2024-02-10T08:39:11.817 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a634a9cc:::benchmark_data_smithi018_166993_object89504:head# 2024-02-10T08:39:11.818 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a634b59d:::benchmark_data_smithi018_166993_object22964:head# 2024-02-10T08:39:11.820 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a63507c2:::benchmark_data_smithi018_166993_object55520:head# 2024-02-10T08:39:11.822 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6353a6e:::benchmark_data_smithi018_166993_object56168:head# 2024-02-10T08:39:11.823 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6355d6b:::benchmark_data_smithi018_166993_object35961:head# 2024-02-10T08:39:11.823 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a63607ca:::benchmark_data_smithi018_166993_object32890:head# 2024-02-10T08:39:11.826 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a636198a:::benchmark_data_smithi018_166993_object108755:head# 2024-02-10T08:39:11.829 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a636d414:::benchmark_data_smithi018_166993_object108116:head# 2024-02-10T08:39:11.829 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6375233:::benchmark_data_smithi018_166993_object62770:head# 2024-02-10T08:39:11.830 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6397f71:::benchmark_data_smithi018_166993_object90154:head# 2024-02-10T08:39:11.833 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a63a33ea:::benchmark_data_smithi018_166993_object36686:head# 2024-02-10T08:39:11.836 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a63b7478:::benchmark_data_smithi018_166993_object66667:head# 2024-02-10T08:39:11.836 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a63bdbc1:::benchmark_data_smithi018_166993_object88019:head# 2024-02-10T08:39:11.837 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a63bf32e:::benchmark_data_smithi018_166993_object70985:head# 2024-02-10T08:39:11.841 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a63c6e24:::benchmark_data_smithi018_166993_object63174:head# 2024-02-10T08:39:11.841 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a63c82f0:::benchmark_data_smithi018_166993_object90247:head# 2024-02-10T08:39:11.841 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a63d0e54:::benchmark_data_smithi018_166993_object20033:head# 2024-02-10T08:39:11.842 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a63d4c17:::benchmark_data_smithi018_166993_object62104:head# 2024-02-10T08:39:11.842 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a63e7126:::benchmark_data_smithi018_166993_object24845:head# 2024-02-10T08:39:11.842 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a63e7365:::benchmark_data_smithi018_166993_object28255:head# 2024-02-10T08:39:11.843 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a63eee88:::benchmark_data_smithi018_166993_object82522:head# 2024-02-10T08:39:11.843 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a63fabb3:::benchmark_data_smithi018_166993_object117792:head# 2024-02-10T08:39:11.844 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a63fcb01:::benchmark_data_smithi018_166993_object53906:head# 2024-02-10T08:39:11.844 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a641297e:::benchmark_data_smithi018_166993_object77418:head# 2024-02-10T08:39:11.845 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a641611e:::benchmark_data_smithi018_166993_object34060:head# 2024-02-10T08:39:11.845 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a641f1e1:::benchmark_data_smithi018_166993_object54215:head# 2024-02-10T08:39:11.850 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6456935:::benchmark_data_smithi018_166993_object118425:head# 2024-02-10T08:39:11.850 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6457e7c:::benchmark_data_smithi018_166993_object106917:head# 2024-02-10T08:39:11.851 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a646410a:::benchmark_data_smithi018_166993_object63021:head# 2024-02-10T08:39:11.852 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6466ad4:::benchmark_data_smithi018_166993_object69012:head# 2024-02-10T08:39:11.852 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a647c0dc:::benchmark_data_smithi018_166993_object23365:head# 2024-02-10T08:39:11.852 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a64ac6d2:::benchmark_data_smithi018_166993_object115940:head# 2024-02-10T08:39:11.853 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a64af64a:::benchmark_data_smithi018_166993_object28289:head# 2024-02-10T08:39:11.853 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a64b19bc:::benchmark_data_smithi018_166993_object26470:head# 2024-02-10T08:39:11.857 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a64c4894:::benchmark_data_smithi018_166993_object40210:head# 2024-02-10T08:39:11.857 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a64d992c:::benchmark_data_smithi018_166993_object41667:head# 2024-02-10T08:39:11.857 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a64ea8eb:::benchmark_data_smithi018_166993_object65905:head# 2024-02-10T08:39:11.857 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a64f210e:::benchmark_data_smithi018_166993_object105776:head# 2024-02-10T08:39:11.857 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a64fefc5:::benchmark_data_smithi018_166993_object109236:head# 2024-02-10T08:39:11.857 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a65065bb:::benchmark_data_smithi018_166993_object39341:head# 2024-02-10T08:39:11.857 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a65092a9:::benchmark_data_smithi018_166993_object112385:head# 2024-02-10T08:39:11.858 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a651c3f4:::benchmark_data_smithi018_166993_object40307:head# 2024-02-10T08:39:11.858 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a651cd4b:::benchmark_data_smithi018_166993_object76535:head# 2024-02-10T08:39:11.858 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a653720e:::benchmark_data_smithi018_166993_object74668:head# 2024-02-10T08:39:11.859 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6539c2b:::benchmark_data_smithi018_166993_object117911:head# 2024-02-10T08:39:11.860 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a654697e:::benchmark_data_smithi018_166993_object80500:head# 2024-02-10T08:39:11.861 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a654ab14:::benchmark_data_smithi018_166993_object56388:head# 2024-02-10T08:39:11.861 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a654bb1f:::benchmark_data_smithi018_166993_object67016:head# 2024-02-10T08:39:11.862 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a65546f3:::benchmark_data_smithi018_166993_object47824:head# 2024-02-10T08:39:11.862 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a655775c:::benchmark_data_smithi018_166993_object109239:head# 2024-02-10T08:39:11.862 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a656968d:::benchmark_data_smithi018_166993_object94028:head# 2024-02-10T08:39:11.863 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a656d578:::benchmark_data_smithi018_166993_object87171:head# 2024-02-10T08:39:11.863 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a656eed9:::benchmark_data_smithi018_166993_object81639:head# 2024-02-10T08:39:11.864 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6572678:::benchmark_data_smithi018_166993_object87687:head# 2024-02-10T08:39:11.866 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6580926:::benchmark_data_smithi018_166993_object72421:head# 2024-02-10T08:39:11.867 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a65890fc:::benchmark_data_smithi018_166993_object67422:head# 2024-02-10T08:39:11.867 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6593462:::benchmark_data_smithi018_166993_object88449:head# 2024-02-10T08:39:11.870 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6594880:::benchmark_data_smithi018_166993_object74375:head# 2024-02-10T08:39:11.870 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a659c2e6:::benchmark_data_smithi018_166993_object86776:head# 2024-02-10T08:39:11.870 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a659c3ff:::benchmark_data_smithi018_166993_object52186:head# 2024-02-10T08:39:11.871 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a659e3ed:::benchmark_data_smithi018_166993_object104430:head# 2024-02-10T08:39:11.872 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a65a63a1:::benchmark_data_smithi018_166993_object54459:head# 2024-02-10T08:39:11.872 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a65b17f1:::benchmark_data_smithi018_166993_object54361:head# 2024-02-10T08:39:11.872 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a65b2876:::benchmark_data_smithi018_166993_object20435:head# 2024-02-10T08:39:11.872 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a65be236:::benchmark_data_smithi018_166993_object45196:head# 2024-02-10T08:39:11.873 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a65c0ca5:::benchmark_data_smithi018_166993_object89371:head# 2024-02-10T08:39:11.873 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a65c6b47:::benchmark_data_smithi018_166993_object67612:head# 2024-02-10T08:39:11.874 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a65db201:::benchmark_data_smithi018_166993_object27482:head# 2024-02-10T08:39:11.874 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a65ea8d7:::benchmark_data_smithi018_166993_object20537:head# 2024-02-10T08:39:11.875 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a660a0f3:::benchmark_data_smithi018_166993_object68256:head# 2024-02-10T08:39:11.875 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a660b70a:::benchmark_data_smithi018_166993_object26672:head# 2024-02-10T08:39:11.875 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6618e37:::benchmark_data_smithi018_166993_object73459:head# 2024-02-10T08:39:11.876 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6619779:::benchmark_data_smithi018_166993_object55718:head# 2024-02-10T08:39:11.876 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a661c643:::benchmark_data_smithi018_166993_object70072:head# 2024-02-10T08:39:11.879 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a662011b:::benchmark_data_smithi018_166993_object87353:head# 2024-02-10T08:39:11.880 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6622634:::benchmark_data_smithi018_166993_object24280:head# 2024-02-10T08:39:11.880 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6640169:::benchmark_data_smithi018_166993_object98182:head# 2024-02-10T08:39:11.881 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6649811:::benchmark_data_smithi018_166993_object76075:head# 2024-02-10T08:39:11.881 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a665e47b:::benchmark_data_smithi018_166993_object51769:head# 2024-02-10T08:39:11.882 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a666d92d:::benchmark_data_smithi018_166993_object36222:head# 2024-02-10T08:39:11.884 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6680249:::benchmark_data_smithi018_166993_object31624:head# 2024-02-10T08:39:11.885 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a668dd90:::benchmark_data_smithi018_166993_object33289:head# 2024-02-10T08:39:11.885 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6693936:::benchmark_data_smithi018_166993_object99065:head# 2024-02-10T08:39:11.885 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a66a2224:::benchmark_data_smithi018_166993_object110058:head# 2024-02-10T08:39:11.885 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a66ad3a6:::benchmark_data_smithi018_166993_object91402:head# 2024-02-10T08:39:11.885 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a66bac00:::benchmark_data_smithi018_166993_object52956:head# 2024-02-10T08:39:11.888 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a66c97ae:::benchmark_data_smithi018_166993_object110568:head# 2024-02-10T08:39:11.888 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a66d012a:::benchmark_data_smithi018_166993_object25253:head# 2024-02-10T08:39:11.888 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a66eb30d:::benchmark_data_smithi018_166993_object41713:head# 2024-02-10T08:39:11.888 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a66ffaad:::benchmark_data_smithi018_166993_object103840:head# 2024-02-10T08:39:11.890 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6705dcd:::benchmark_data_smithi018_166993_object82365:head# 2024-02-10T08:39:11.890 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6716656:::benchmark_data_smithi018_166993_object53589:head# 2024-02-10T08:39:11.894 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a672683b:::benchmark_data_smithi018_166993_object30944:head# 2024-02-10T08:39:11.894 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a672cb1c:::benchmark_data_smithi018_166993_object24159:head# 2024-02-10T08:39:11.895 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a672db97:::benchmark_data_smithi018_166993_object98898:head# 2024-02-10T08:39:11.895 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a67372ea:::benchmark_data_smithi018_166993_object103601:head# 2024-02-10T08:39:11.895 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a673d616:::benchmark_data_smithi018_166993_object115880:head# 2024-02-10T08:39:11.895 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6745c0c:::benchmark_data_smithi018_166993_object111559:head# 2024-02-10T08:39:11.895 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a674dd4e:::benchmark_data_smithi018_166993_object32759:head# 2024-02-10T08:39:11.898 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6752b08:::benchmark_data_smithi018_166993_object116622:head# 2024-02-10T08:39:11.898 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6759281:::benchmark_data_smithi018_166993_object111166:head# 2024-02-10T08:39:11.898 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a675b72a:::benchmark_data_smithi018_166993_object84229:head# 2024-02-10T08:39:11.899 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a675ca47:::benchmark_data_smithi018_166993_object73067:head# 2024-02-10T08:39:11.901 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a676faef:::benchmark_data_smithi018_166993_object39555:head# 2024-02-10T08:39:11.901 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a676fe03:::benchmark_data_smithi018_166993_object53736:head# 2024-02-10T08:39:11.901 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a678514d:::benchmark_data_smithi018_166993_object50039:head# 2024-02-10T08:39:11.904 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a678682c:::benchmark_data_smithi018_166993_object60709:head# 2024-02-10T08:39:11.907 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a678a04d:::benchmark_data_smithi018_166993_object109358:head# 2024-02-10T08:39:11.907 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a678c720:::benchmark_data_smithi018_166993_object97139:head# 2024-02-10T08:39:11.907 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a67a613e:::benchmark_data_smithi018_166993_object22925:head# 2024-02-10T08:39:11.907 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a67a9f3e:::benchmark_data_smithi018_166993_object56196:head# 2024-02-10T08:39:11.907 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a67ad0ce:::benchmark_data_smithi018_166993_object38806:head# 2024-02-10T08:39:11.907 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a67b6af9:::benchmark_data_smithi018_166993_object54447:head# 2024-02-10T08:39:11.908 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a67c7310:::benchmark_data_smithi018_166993_object93917:head# 2024-02-10T08:39:11.908 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a67de5d9:::benchmark_data_smithi018_166993_object115939:head# 2024-02-10T08:39:11.908 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a67f50a4:::benchmark_data_smithi018_166993_object23063:head# 2024-02-10T08:39:11.909 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a68004d1:::benchmark_data_smithi018_166993_object86540:head# 2024-02-10T08:39:11.909 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6802ea1:::benchmark_data_smithi018_166993_object67365:head# 2024-02-10T08:39:11.912 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a680911d:::benchmark_data_smithi018_166993_object109476:head# 2024-02-10T08:39:11.915 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a681bb55:::benchmark_data_smithi018_166993_object95822:head# 2024-02-10T08:39:11.915 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a681d1b3:::benchmark_data_smithi018_166993_object67952:head# 2024-02-10T08:39:11.915 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a681dbab:::benchmark_data_smithi018_166993_object33589:head# 2024-02-10T08:39:11.918 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6821865:::benchmark_data_smithi018_166993_object61652:head# 2024-02-10T08:39:11.918 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6847849:::benchmark_data_smithi018_166993_object99130:head# 2024-02-10T08:39:11.918 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6856c48:::benchmark_data_smithi018_166993_object72518:head# 2024-02-10T08:39:11.918 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a685db56:::benchmark_data_smithi018_166993_object87179:head# 2024-02-10T08:39:11.918 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a68658e2:::benchmark_data_smithi018_166993_object89674:head# 2024-02-10T08:39:11.918 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a68738d4:::benchmark_data_smithi018_166993_object26226:head# 2024-02-10T08:39:11.918 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a687d3af:::benchmark_data_smithi018_166993_object98558:head# 2024-02-10T08:39:11.918 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a68806d3:::benchmark_data_smithi018_166993_object35793:head# 2024-02-10T08:39:11.918 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a68818ff:::benchmark_data_smithi018_166993_object27788:head# 2024-02-10T08:39:11.919 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a68896e7:::benchmark_data_smithi018_166993_object35902:head# 2024-02-10T08:39:11.920 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a689fa97:::benchmark_data_smithi018_166993_object94641:head# 2024-02-10T08:39:11.920 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a68aa90a:::benchmark_data_smithi018_166993_object93151:head# 2024-02-10T08:39:11.920 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a68c620c:::benchmark_data_smithi018_166993_object61489:head# 2024-02-10T08:39:11.920 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a68f44b5:::benchmark_data_smithi018_166993_object29820:head# 2024-02-10T08:39:11.922 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a692752d:::benchmark_data_smithi018_166993_object26411:head# 2024-02-10T08:39:11.922 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a692dbd0:::benchmark_data_smithi018_166993_object100132:head# 2024-02-10T08:39:11.922 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6933379:::benchmark_data_smithi018_166993_object73049:head# 2024-02-10T08:39:11.922 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a693c253:::benchmark_data_smithi018_166993_object118624:head# 2024-02-10T08:39:11.922 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6947111:::benchmark_data_smithi018_166993_object97829:head# 2024-02-10T08:39:11.922 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a694db41:::benchmark_data_smithi018_166993_object72238:head# 2024-02-10T08:39:11.923 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6954656:::benchmark_data_smithi018_166993_object100643:head# 2024-02-10T08:39:11.923 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a695a187:::benchmark_data_smithi018_166993_object106543:head# 2024-02-10T08:39:11.924 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a696c77e:::benchmark_data_smithi018_166993_object115588:head# 2024-02-10T08:39:11.924 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6970476:::benchmark_data_smithi018_166993_object78142:head# 2024-02-10T08:39:11.924 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a697ad49:::benchmark_data_smithi018_166993_object105483:head# 2024-02-10T08:39:11.927 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6980a68:::benchmark_data_smithi018_166993_object101908:head# 2024-02-10T08:39:11.927 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a698a2f3:::benchmark_data_smithi018_166993_object58755:head# 2024-02-10T08:39:11.927 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a698b566:::benchmark_data_smithi018_166993_object22198:head# 2024-02-10T08:39:11.927 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6997a08:::benchmark_data_smithi018_166993_object114844:head# 2024-02-10T08:39:11.927 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a69a3742:::benchmark_data_smithi018_166993_object34647:head# 2024-02-10T08:39:11.928 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a69a8fe1:::benchmark_data_smithi018_166993_object26472:head# 2024-02-10T08:39:11.931 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a69b4377:::benchmark_data_smithi018_166993_object61095:head# 2024-02-10T08:39:11.931 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a69bd950:::benchmark_data_smithi018_166993_object73682:head# 2024-02-10T08:39:11.931 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a69c0bff:::benchmark_data_smithi018_166993_object55960:head# 2024-02-10T08:39:11.931 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a69cb175:::benchmark_data_smithi018_166993_object39369:head# 2024-02-10T08:39:11.932 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a69cc97c:::benchmark_data_smithi018_166993_object85936:head# 2024-02-10T08:39:11.934 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a69cd5f7:::benchmark_data_smithi018_166993_object89750:head# 2024-02-10T08:39:11.934 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a69f15e3:::benchmark_data_smithi018_166993_object40142:head# 2024-02-10T08:39:11.934 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a69f27a0:::benchmark_data_smithi018_166993_object41355:head# 2024-02-10T08:39:11.935 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a69fa3fd:::benchmark_data_smithi018_166993_object60933:head# 2024-02-10T08:39:11.936 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a69fdba0:::benchmark_data_smithi018_166993_object77296:head# 2024-02-10T08:39:11.936 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6a017ba:::benchmark_data_smithi018_166993_object107324:head# 2024-02-10T08:39:11.937 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6a041c9:::benchmark_data_smithi018_166993_object68085:head# 2024-02-10T08:39:11.940 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6a05456:::benchmark_data_smithi018_166993_object59775:head# 2024-02-10T08:39:11.940 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6a07d95:::benchmark_data_smithi018_166993_object89439:head# 2024-02-10T08:39:11.942 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6a0bf02:::benchmark_data_smithi018_166993_object57174:head# 2024-02-10T08:39:11.942 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6a0f38e:::benchmark_data_smithi018_166993_object100227:head# 2024-02-10T08:39:11.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:39:11.021943+0000 mon.a (mon.0) 1775 : cluster [WRN] Health check update: Degraded data redundancy: 26705/252519 objects degraded (10.575%), 6 pgs degraded (PG_DEGRADED) 2024-02-10T08:39:11.943 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:39:11.021943+0000 mon.a (mon.0) 1775 : cluster [WRN] Health check update: Degraded data redundancy: 26705/252519 objects degraded (10.575%), 6 pgs degraded (PG_DEGRADED) 2024-02-10T08:39:11.945 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6a12fb4:::benchmark_data_smithi018_166993_object70639:head# 2024-02-10T08:39:11.945 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6a39057:::benchmark_data_smithi018_166993_object43578:head# 2024-02-10T08:39:11.945 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6a3b5e3:::benchmark_data_smithi018_166993_object86911:head# 2024-02-10T08:39:11.945 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6a3ee08:::benchmark_data_smithi018_166993_object82297:head# 2024-02-10T08:39:11.945 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6a4b541:::benchmark_data_smithi018_166993_object59895:head# 2024-02-10T08:39:11.949 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6a50970:::benchmark_data_smithi018_166993_object56365:head# 2024-02-10T08:39:11.949 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6a5a97f:::benchmark_data_smithi018_166993_object104103:head# 2024-02-10T08:39:11.950 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6a5cdf8:::benchmark_data_smithi018_166993_object26039:head# 2024-02-10T08:39:11.950 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6a606ea:::benchmark_data_smithi018_166993_object34432:head# 2024-02-10T08:39:11.951 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6a659e1:::benchmark_data_smithi018_166993_object25133:head# 2024-02-10T08:39:11.951 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6a6d77c:::benchmark_data_smithi018_166993_object89217:head# 2024-02-10T08:39:11.952 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6a85cce:::benchmark_data_smithi018_166993_object115267:head# 2024-02-10T08:39:11.952 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6a86ea3:::benchmark_data_smithi018_166993_object75871:head# 2024-02-10T08:39:11.954 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6a90c48:::benchmark_data_smithi018_166993_object76631:head# 2024-02-10T08:39:11.954 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6aad1b4:::benchmark_data_smithi018_166993_object37603:head# 2024-02-10T08:39:11.954 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6ac796d:::benchmark_data_smithi018_166993_object52430:head# 2024-02-10T08:39:11.955 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6ad2421:::benchmark_data_smithi018_166993_object61658:head# 2024-02-10T08:39:11.955 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6ad40ab:::benchmark_data_smithi018_166993_object92767:head# 2024-02-10T08:39:11.959 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6af7e37:::benchmark_data_smithi018_166993_object18853:head# 2024-02-10T08:39:11.960 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6afa039:::benchmark_data_smithi018_166993_object74910:head# 2024-02-10T08:39:11.960 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6b1658e:::benchmark_data_smithi018_166993_object29320:head# 2024-02-10T08:39:11.960 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6b16d6f:::benchmark_data_smithi018_166993_object53023:head# 2024-02-10T08:39:11.960 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6b21398:::benchmark_data_smithi018_166993_object75165:head# 2024-02-10T08:39:11.960 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6b2edaa:::benchmark_data_smithi018_166993_object77479:head# 2024-02-10T08:39:11.961 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6b35cf6:::benchmark_data_smithi018_166993_object17802:head# 2024-02-10T08:39:11.961 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6b44c37:::benchmark_data_smithi018_166993_object53919:head# 2024-02-10T08:39:11.962 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6b76055:::benchmark_data_smithi018_166993_object19075:head# 2024-02-10T08:39:11.962 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6b8309d:::benchmark_data_smithi018_166993_object28468:head# 2024-02-10T08:39:11.962 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6b84684:::benchmark_data_smithi018_166993_object118835:head# 2024-02-10T08:39:11.963 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6b8936b:::benchmark_data_smithi018_166993_object39039:head# 2024-02-10T08:39:11.963 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6b8c6c8:::benchmark_data_smithi018_166993_object91858:head# 2024-02-10T08:39:11.964 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6b926d6:::benchmark_data_smithi018_166993_object20811:head# 2024-02-10T08:39:11.964 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6b9d1d3:::benchmark_data_smithi018_166993_object119093:head# 2024-02-10T08:39:11.965 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6ba90fe:::benchmark_data_smithi018_166993_object80230:head# 2024-02-10T08:39:11.965 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6bb6bd7:::benchmark_data_smithi018_166993_object99398:head# 2024-02-10T08:39:11.966 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6bb9b99:::benchmark_data_smithi018_166993_object35805:head# 2024-02-10T08:39:11.966 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6bbc368:::benchmark_data_smithi018_166993_object97736:head# 2024-02-10T08:39:11.969 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6bdfdbe:::benchmark_data_smithi018_166993_object40527:head# 2024-02-10T08:39:11.970 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6be19c6:::benchmark_data_smithi018_166993_object113030:head# 2024-02-10T08:39:11.972 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6be6b3e:::benchmark_data_smithi018_166993_object102694:head# 2024-02-10T08:39:11.972 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6beaf88:::benchmark_data_smithi018_166993_object50773:head# 2024-02-10T08:39:11.972 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6bf1df2:::benchmark_data_smithi018_166993_object70365:head# 2024-02-10T08:39:11.972 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6bfa95a:::benchmark_data_smithi018_166993_object52477:head# 2024-02-10T08:39:11.972 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6c03cb2:::benchmark_data_smithi018_166993_object94779:head# 2024-02-10T08:39:11.973 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6c09f05:::benchmark_data_smithi018_166993_object56157:head# 2024-02-10T08:39:11.976 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6c1229c:::benchmark_data_smithi018_166993_object51251:head# 2024-02-10T08:39:11.977 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6c2adcd:::benchmark_data_smithi018_166993_object117034:head# 2024-02-10T08:39:11.979 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6c420bc:::benchmark_data_smithi018_166993_object23024:head# 2024-02-10T08:39:11.980 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6c4fa73:::benchmark_data_smithi018_166993_object23375:head# 2024-02-10T08:39:11.980 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6c53ae8:::benchmark_data_smithi018_166993_object65360:head# 2024-02-10T08:39:11.980 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6c6effa:::benchmark_data_smithi018_166993_object111873:head# 2024-02-10T08:39:11.983 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6c6feb6:::benchmark_data_smithi018_166993_object56558:head# 2024-02-10T08:39:11.986 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6c74db1:::benchmark_data_smithi018_166993_object89257:head# 2024-02-10T08:39:11.988 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6c811f9:::benchmark_data_smithi018_166993_object93525:head# 2024-02-10T08:39:11.989 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6c87054:::benchmark_data_smithi018_166993_object85131:head# 2024-02-10T08:39:11.989 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6c89f3f:::benchmark_data_smithi018_166993_object54076:head# 2024-02-10T08:39:11.989 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6c8a3ed:::benchmark_data_smithi018_166993_object98795:head# 2024-02-10T08:39:11.989 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6c909b4:::benchmark_data_smithi018_166993_object57225:head# 2024-02-10T08:39:11.989 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6c97a6c:::benchmark_data_smithi018_166993_object90200:head# 2024-02-10T08:39:11.993 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6c9dde5:::benchmark_data_smithi018_166993_object117649:head# 2024-02-10T08:39:11.994 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6ca2fa3:::benchmark_data_smithi018_166993_object76196:head# 2024-02-10T08:39:11.995 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6ca3b07:::benchmark_data_smithi018_166993_object113848:head# 2024-02-10T08:39:11.999 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6cae58c:::benchmark_data_smithi018_166993_object69898:head# 2024-02-10T08:39:12.000 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6cd7362:::benchmark_data_smithi018_166993_object86699:head# 2024-02-10T08:39:12.004 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6cd8844:::benchmark_data_smithi018_166993_object56249:head# 2024-02-10T08:39:12.005 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6cf8eb8:::benchmark_data_smithi018_166993_object57333:head# 2024-02-10T08:39:12.005 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6d0c5ed:::benchmark_data_smithi018_166993_object69609:head# 2024-02-10T08:39:12.007 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6d0fe83:::benchmark_data_smithi018_166993_object43105:head# 2024-02-10T08:39:12.008 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6d1a36e:::benchmark_data_smithi018_166993_object89782:head# 2024-02-10T08:39:12.009 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6d23523:::benchmark_data_smithi018_166993_object51031:head# 2024-02-10T08:39:12.009 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6d251fb:::benchmark_data_smithi018_166993_object82075:head# 2024-02-10T08:39:12.010 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6d27143:::benchmark_data_smithi018_166993_object70880:head# 2024-02-10T08:39:12.010 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6d2fbba:::benchmark_data_smithi018_166993_object33760:head# 2024-02-10T08:39:12.011 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6d3825e:::benchmark_data_smithi018_166993_object70624:head# 2024-02-10T08:39:12.011 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6d435d8:::benchmark_data_smithi018_166993_object92728:head# 2024-02-10T08:39:12.012 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6d448d6:::benchmark_data_smithi018_166993_object61850:head# 2024-02-10T08:39:12.014 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6d56694:::benchmark_data_smithi018_166993_object70061:head# 2024-02-10T08:39:12.014 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6d61bce:::benchmark_data_smithi018_166993_object106741:head# 2024-02-10T08:39:12.014 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6d6299d:::benchmark_data_smithi018_166993_object22689:head# 2024-02-10T08:39:12.016 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6d6a616:::benchmark_data_smithi018_166993_object48519:head# 2024-02-10T08:39:12.016 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6d723eb:::benchmark_data_smithi018_166993_object45261:head# 2024-02-10T08:39:12.017 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6d835f1:::benchmark_data_smithi018_166993_object116301:head# 2024-02-10T08:39:12.017 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6d92d55:::benchmark_data_smithi018_166993_object35177:head# 2024-02-10T08:39:12.017 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6d93d8a:::benchmark_data_smithi018_166993_object53920:head# 2024-02-10T08:39:12.018 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6d9fce5:::benchmark_data_smithi018_166993_object105199:head# 2024-02-10T08:39:12.019 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6da09c2:::benchmark_data_smithi018_166993_object19535:head# 2024-02-10T08:39:12.022 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6daf443:::benchmark_data_smithi018_166993_object115180:head# 2024-02-10T08:39:12.023 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6dc8581:::benchmark_data_smithi018_166993_object92280:head# 2024-02-10T08:39:12.029 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6de209a:::benchmark_data_smithi018_166993_object97107:head# 2024-02-10T08:39:12.032 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6de57f8:::benchmark_data_smithi018_166993_object88006:head# 2024-02-10T08:39:12.032 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6dea78e:::benchmark_data_smithi018_166993_object59605:head# 2024-02-10T08:39:12.032 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6df7cf3:::benchmark_data_smithi018_166993_object18187:head# 2024-02-10T08:39:12.032 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6e0f9a4:::benchmark_data_smithi018_166993_object31039:head# 2024-02-10T08:39:12.034 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6e156fe:::benchmark_data_smithi018_166993_object105554:head# 2024-02-10T08:39:12.035 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6e219c5:::benchmark_data_smithi018_166993_object38282:head# 2024-02-10T08:39:12.035 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6e3abbe:::benchmark_data_smithi018_166993_object26763:head# 2024-02-10T08:39:12.035 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6e3c6cc:::benchmark_data_smithi018_166993_object55012:head# 2024-02-10T08:39:12.036 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6e41a43:::benchmark_data_smithi018_166993_object102517:head# 2024-02-10T08:39:12.037 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6e41b58:::benchmark_data_smithi018_166993_object20170:head# 2024-02-10T08:39:12.037 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6e45248:::benchmark_data_smithi018_166993_object63223:head# 2024-02-10T08:39:12.038 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6e4d632:::benchmark_data_smithi018_166993_object48212:head# 2024-02-10T08:39:12.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:39:11.021943+0000 mon.a (mon.0) 1775 : cluster [WRN] Health check update: Degraded data redundancy: 26705/252519 objects degraded (10.575%), 6 pgs degraded (PG_DEGRADED) 2024-02-10T08:39:12.039 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6e566f7:::benchmark_data_smithi018_166993_object36250:head# 2024-02-10T08:39:12.040 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6e5821f:::benchmark_data_smithi018_166993_object63298:head# 2024-02-10T08:39:12.043 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6e73393:::benchmark_data_smithi018_166993_object79037:head# 2024-02-10T08:39:12.043 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6e7f9fe:::benchmark_data_smithi018_166993_object70287:head# 2024-02-10T08:39:12.048 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6e8ba01:::benchmark_data_smithi018_166993_object23562:head# 2024-02-10T08:39:12.048 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6e8c849:::benchmark_data_smithi018_166993_object112208:head# 2024-02-10T08:39:12.048 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6e93b05:::benchmark_data_smithi018_166993_object82199:head# 2024-02-10T08:39:12.050 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6e94081:::benchmark_data_smithi018_166993_object31247:head# 2024-02-10T08:39:12.050 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6e94a29:::benchmark_data_smithi018_166993_object118600:head# 2024-02-10T08:39:12.051 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6ea8dba:::benchmark_data_smithi018_166993_object47696:head# 2024-02-10T08:39:12.051 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6eb3774:::benchmark_data_smithi018_166993_object25750:head# 2024-02-10T08:39:12.052 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6ecb1de:::benchmark_data_smithi018_166993_object22757:head# 2024-02-10T08:39:12.052 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6ecc3e4:::benchmark_data_smithi018_166993_object59630:head# 2024-02-10T08:39:12.055 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6eda921:::benchmark_data_smithi018_166993_object90210:head# 2024-02-10T08:39:12.055 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6ee7c11:::benchmark_data_smithi018_166993_object46578:head# 2024-02-10T08:39:12.056 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6f0e1d4:::benchmark_data_smithi018_166993_object58866:head# 2024-02-10T08:39:12.056 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6f18570:::benchmark_data_smithi018_166993_object65534:head# 2024-02-10T08:39:12.056 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6f276a6:::benchmark_data_smithi018_166993_object76652:head# 2024-02-10T08:39:12.059 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6f2a489:::benchmark_data_smithi018_166993_object70826:head# 2024-02-10T08:39:12.061 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6f2dd88:::benchmark_data_smithi018_166993_object42720:head# 2024-02-10T08:39:12.061 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6f3a7d1:::benchmark_data_smithi018_166993_object49309:head# 2024-02-10T08:39:12.061 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6f3bd83:::benchmark_data_smithi018_166993_object111570:head# 2024-02-10T08:39:12.061 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6f3d9b4:::benchmark_data_smithi018_166993_object47814:head# 2024-02-10T08:39:12.061 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6f41699:::benchmark_data_smithi018_166993_object53821:head# 2024-02-10T08:39:12.062 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6f44a64:::benchmark_data_smithi018_166993_object39595:head# 2024-02-10T08:39:12.062 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6f6a201:::benchmark_data_smithi018_166993_object87494:head# 2024-02-10T08:39:12.063 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6f8ddb1:::benchmark_data_smithi018_166993_object36532:head# 2024-02-10T08:39:12.063 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6fa16b4:::benchmark_data_smithi018_166993_object85950:head# 2024-02-10T08:39:12.064 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6fa5092:::benchmark_data_smithi018_166993_object83308:head# 2024-02-10T08:39:12.064 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6fa7ebd:::benchmark_data_smithi018_166993_object82295:head# 2024-02-10T08:39:12.065 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6fb6a91:::benchmark_data_smithi018_166993_object110732:head# 2024-02-10T08:39:12.066 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6fd9f84:::benchmark_data_smithi018_166993_object95118:head# 2024-02-10T08:39:12.066 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6fe117b:::benchmark_data_smithi018_166993_object70031:head# 2024-02-10T08:39:12.067 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6fe5e8e:::benchmark_data_smithi018_166993_object19230:head# 2024-02-10T08:39:12.067 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6ff7efe:::benchmark_data_smithi018_166993_object91337:head# 2024-02-10T08:39:12.067 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a6ffafd0:::benchmark_data_smithi018_166993_object43768:head# 2024-02-10T08:39:12.069 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a702dada:::benchmark_data_smithi018_166993_object113596:head# 2024-02-10T08:39:12.069 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7033cef:::benchmark_data_smithi018_166993_object56308:head# 2024-02-10T08:39:12.070 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7037242:::benchmark_data_smithi018_166993_object56842:head# 2024-02-10T08:39:12.071 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7037eed:::benchmark_data_smithi018_166993_object33277:head# 2024-02-10T08:39:12.071 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a70389f8:::benchmark_data_smithi018_166993_object82181:head# 2024-02-10T08:39:12.073 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7046f8c:::benchmark_data_smithi018_166993_object99697:head# 2024-02-10T08:39:12.074 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a704808d:::benchmark_data_smithi018_166993_object43830:head# 2024-02-10T08:39:12.074 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7054938:::benchmark_data_smithi018_166993_object70398:head# 2024-02-10T08:39:12.074 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7055954:::benchmark_data_smithi018_166993_object88768:head# 2024-02-10T08:39:12.074 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a70617b8:::benchmark_data_smithi018_166993_object86636:head# 2024-02-10T08:39:12.074 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7062787:::benchmark_data_smithi018_166993_object55087:head# 2024-02-10T08:39:12.079 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a70634db:::benchmark_data_smithi018_166993_object57256:head# 2024-02-10T08:39:12.080 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7066070:::benchmark_data_smithi018_166993_object85185:head# 2024-02-10T08:39:12.080 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a706bf82:::benchmark_data_smithi018_166993_object88930:head# 2024-02-10T08:39:12.080 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a706e98f:::benchmark_data_smithi018_166993_object44956:head# 2024-02-10T08:39:12.080 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a70758bf:::benchmark_data_smithi018_166993_object105034:head# 2024-02-10T08:39:12.080 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a70832d4:::benchmark_data_smithi018_166993_object100955:head# 2024-02-10T08:39:12.083 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7089d38:::benchmark_data_smithi018_166993_object60062:head# 2024-02-10T08:39:12.083 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a70b49f7:::benchmark_data_smithi018_166993_object26717:head# 2024-02-10T08:39:12.083 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a70bd457:::benchmark_data_smithi018_166993_object68613:head# 2024-02-10T08:39:12.083 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a70ca1b5:::benchmark_data_smithi018_166993_object34423:head# 2024-02-10T08:39:12.083 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a70da12c:::benchmark_data_smithi018_166993_object24413:head# 2024-02-10T08:39:12.083 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a70e6a6c:::benchmark_data_smithi018_166993_object80352:head# 2024-02-10T08:39:12.086 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a70eaed7:::benchmark_data_smithi018_166993_object40643:head# 2024-02-10T08:39:12.090 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a70eb310:::benchmark_data_smithi018_166993_object52826:head# 2024-02-10T08:39:12.090 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a70f0162:::benchmark_data_smithi018_166993_object101679:head# 2024-02-10T08:39:12.090 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a70f294f:::benchmark_data_smithi018_166993_object48944:head# 2024-02-10T08:39:12.090 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a70f343f:::benchmark_data_smithi018_166993_object117845:head# 2024-02-10T08:39:12.091 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a70f77c1:::benchmark_data_smithi018_166993_object47524:head# 2024-02-10T08:39:12.091 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a710e0c9:::benchmark_data_smithi018_166993_object100404:head# 2024-02-10T08:39:12.091 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7111f56:::benchmark_data_smithi018_166993_object23852:head# 2024-02-10T08:39:12.091 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a711d943:::benchmark_data_smithi018_166993_object47265:head# 2024-02-10T08:39:12.091 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a711def1:::benchmark_data_smithi018_166993_object57971:head# 2024-02-10T08:39:12.091 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a712ad2a:::benchmark_data_smithi018_166993_object27991:head# 2024-02-10T08:39:12.092 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a71310b3:::benchmark_data_smithi018_166993_object23509:head# 2024-02-10T08:39:12.092 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7145471:::benchmark_data_smithi018_166993_object79338:head# 2024-02-10T08:39:12.094 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a71479f0:::benchmark_data_smithi018_166993_object23125:head# 2024-02-10T08:39:12.094 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7157e17:::benchmark_data_smithi018_166993_object104030:head# 2024-02-10T08:39:12.098 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7176b89:::benchmark_data_smithi018_166993_object56427:head# 2024-02-10T08:39:12.100 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a717dec1:::benchmark_data_smithi018_166993_object82786:head# 2024-02-10T08:39:12.100 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a717f41a:::benchmark_data_smithi018_166993_object93840:head# 2024-02-10T08:39:12.101 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a717f6e6:::benchmark_data_smithi018_166993_object22473:head# 2024-02-10T08:39:12.101 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7180b09:::benchmark_data_smithi018_166993_object77465:head# 2024-02-10T08:39:12.101 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7185253:::benchmark_data_smithi018_166993_object83620:head# 2024-02-10T08:39:12.102 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a719005b:::benchmark_data_smithi018_166993_object22734:head# 2024-02-10T08:39:12.102 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a71a3b83:::benchmark_data_smithi018_166993_object80313:head# 2024-02-10T08:39:12.104 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a71a415a:::benchmark_data_smithi018_166993_object65825:head# 2024-02-10T08:39:12.111 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a71ae859:::benchmark_data_smithi018_166993_object49365:head# 2024-02-10T08:39:12.111 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a71bac11:::benchmark_data_smithi018_166993_object78169:head# 2024-02-10T08:39:12.111 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a71bfdcc:::benchmark_data_smithi018_166993_object57839:head# 2024-02-10T08:39:12.111 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a71c3515:::benchmark_data_smithi018_166993_object115190:head# 2024-02-10T08:39:12.111 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a71c483c:::benchmark_data_smithi018_166993_object59226:head# 2024-02-10T08:39:12.114 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a71d2328:::benchmark_data_smithi018_166993_object30340:head# 2024-02-10T08:39:12.120 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a71d52da:::benchmark_data_smithi018_166993_object94699:head# 2024-02-10T08:39:12.120 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a71dac9a:::benchmark_data_smithi018_166993_object107562:head# 2024-02-10T08:39:12.120 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a71e0332:::benchmark_data_smithi018_166993_object44644:head# 2024-02-10T08:39:12.120 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a71fab33:::benchmark_data_smithi018_166993_object24380:head# 2024-02-10T08:39:12.120 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7205c68:::benchmark_data_smithi018_166993_object36940:head# 2024-02-10T08:39:12.121 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a721ef27:::benchmark_data_smithi018_166993_object88018:head# 2024-02-10T08:39:12.121 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a72200bf:::benchmark_data_smithi018_166993_object66906:head# 2024-02-10T08:39:12.121 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7231d3d:::benchmark_data_smithi018_166993_object105866:head# 2024-02-10T08:39:12.121 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a723ede0:::benchmark_data_smithi018_166993_object115604:head# 2024-02-10T08:39:12.122 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7258703:::benchmark_data_smithi018_166993_object105376:head# 2024-02-10T08:39:12.122 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a725890e:::benchmark_data_smithi018_166993_object103320:head# 2024-02-10T08:39:12.128 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a726a98a:::benchmark_data_smithi018_166993_object49561:head# 2024-02-10T08:39:12.128 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a726c7d2:::benchmark_data_smithi018_166993_object29617:head# 2024-02-10T08:39:12.128 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7275215:::benchmark_data_smithi018_166993_object45356:head# 2024-02-10T08:39:12.128 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7287752:::benchmark_data_smithi018_166993_object110204:head# 2024-02-10T08:39:12.131 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7294fa1:::benchmark_data_smithi018_166993_object95214:head# 2024-02-10T08:39:12.132 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a72967dc:::benchmark_data_smithi018_166993_object104170:head# 2024-02-10T08:39:12.132 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a729b642:::benchmark_data_smithi018_166993_object95564:head# 2024-02-10T08:39:12.134 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a72a3cf6:::benchmark_data_smithi018_166993_object35146:head# 2024-02-10T08:39:12.134 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a72bc23d:::benchmark_data_smithi018_166993_object100910:head# 2024-02-10T08:39:12.134 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a72c0e03:::benchmark_data_smithi018_166993_object79097:head# 2024-02-10T08:39:12.135 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a72c620b:::benchmark_data_smithi018_166993_object62028:head# 2024-02-10T08:39:12.135 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a72cb30e:::benchmark_data_smithi018_166993_object33352:head# 2024-02-10T08:39:12.136 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a72ecf5c:::benchmark_data_smithi018_166993_object22191:head# 2024-02-10T08:39:12.136 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a72f6849:::benchmark_data_smithi018_166993_object24099:head# 2024-02-10T08:39:12.139 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a72fa83a:::benchmark_data_smithi018_166993_object58588:head# 2024-02-10T08:39:12.139 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a72fca97:::benchmark_data_smithi018_166993_object34874:head# 2024-02-10T08:39:12.140 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7302b8d:::benchmark_data_smithi018_166993_object48209:head# 2024-02-10T08:39:12.149 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7306c94:::benchmark_data_smithi018_166993_object26163:head# 2024-02-10T08:39:12.149 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7308643:::benchmark_data_smithi018_166993_object28883:head# 2024-02-10T08:39:12.149 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a730faf9:::benchmark_data_smithi018_166993_object52393:head# 2024-02-10T08:39:12.152 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a731905e:::benchmark_data_smithi018_166993_object101974:head# 2024-02-10T08:39:12.156 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a731e2d5:::benchmark_data_smithi018_166993_object108110:head# 2024-02-10T08:39:12.156 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7337577:::benchmark_data_smithi018_166993_object104109:head# 2024-02-10T08:39:12.157 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a733dd86:::benchmark_data_smithi018_166993_object38688:head# 2024-02-10T08:39:12.159 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7352c36:::benchmark_data_smithi018_166993_object93979:head# 2024-02-10T08:39:12.160 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a73614c7:::benchmark_data_smithi018_166993_object24816:head# 2024-02-10T08:39:12.160 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7365946:::benchmark_data_smithi018_166993_object62479:head# 2024-02-10T08:39:12.161 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a736b8c9:::benchmark_data_smithi018_166993_object97323:head# 2024-02-10T08:39:12.161 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a736d190:::benchmark_data_smithi018_166993_object94533:head# 2024-02-10T08:39:12.162 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7383004:::benchmark_data_smithi018_166993_object46621:head# 2024-02-10T08:39:12.162 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7383765:::benchmark_data_smithi018_166993_object57125:head# 2024-02-10T08:39:12.163 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a738c9a0:::benchmark_data_smithi018_166993_object82629:head# 2024-02-10T08:39:12.163 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a738d17d:::benchmark_data_smithi018_166993_object29864:head# 2024-02-10T08:39:12.165 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a739b822:::benchmark_data_smithi018_166993_object60958:head# 2024-02-10T08:39:12.165 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a73a7ced:::benchmark_data_smithi018_166993_object52424:head# 2024-02-10T08:39:12.165 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a73b80bf:::benchmark_data_smithi018_166993_object18212:head# 2024-02-10T08:39:12.165 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a73bca1a:::benchmark_data_smithi018_166993_object22269:head# 2024-02-10T08:39:12.168 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a73c8743:::benchmark_data_smithi018_166993_object26332:head# 2024-02-10T08:39:12.168 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a73ca282:::benchmark_data_smithi018_166993_object38272:head# 2024-02-10T08:39:12.168 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a73cd696:::benchmark_data_smithi018_166993_object77050:head# 2024-02-10T08:39:12.168 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a73d4bdf:::benchmark_data_smithi018_166993_object31793:head# 2024-02-10T08:39:12.169 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a73d9085:::benchmark_data_smithi018_166993_object106990:head# 2024-02-10T08:39:12.169 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a73ddb37:::benchmark_data_smithi018_166993_object51205:head# 2024-02-10T08:39:12.177 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a73e7974:::benchmark_data_smithi018_166993_object83894:head# 2024-02-10T08:39:12.177 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a73fb02a:::benchmark_data_smithi018_166993_object94317:head# 2024-02-10T08:39:12.177 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a73fc943:::benchmark_data_smithi018_166993_object72003:head# 2024-02-10T08:39:12.178 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7404929:::benchmark_data_smithi018_166993_object55029:head# 2024-02-10T08:39:12.182 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7419c7b:::benchmark_data_smithi018_166993_object116609:head# 2024-02-10T08:39:12.185 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a741ac2d:::benchmark_data_smithi018_166993_object113607:head# 2024-02-10T08:39:12.185 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a741f0c9:::benchmark_data_smithi018_166993_object90933:head# 2024-02-10T08:39:12.185 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7425c62:::benchmark_data_smithi018_166993_object20201:head# 2024-02-10T08:39:12.185 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a742ea31:::benchmark_data_smithi018_166993_object19659:head# 2024-02-10T08:39:12.185 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a74302dd:::benchmark_data_smithi018_166993_object74965:head# 2024-02-10T08:39:12.185 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7442712:::benchmark_data_smithi018_166993_object96770:head# 2024-02-10T08:39:12.186 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a744cbf9:::benchmark_data_smithi018_166993_object59297:head# 2024-02-10T08:39:12.186 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7457d1e:::benchmark_data_smithi018_166993_object41955:head# 2024-02-10T08:39:12.189 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7467ce9:::benchmark_data_smithi018_166993_object71485:head# 2024-02-10T08:39:12.189 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a748b511:::benchmark_data_smithi018_166993_object41700:head# 2024-02-10T08:39:12.190 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a749dc08:::benchmark_data_smithi018_166993_object76773:head# 2024-02-10T08:39:12.190 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a74bf92d:::benchmark_data_smithi018_166993_object117331:head# 2024-02-10T08:39:12.190 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a74c3a1d:::benchmark_data_smithi018_166993_object50152:head# 2024-02-10T08:39:12.190 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a74c6553:::benchmark_data_smithi018_166993_object34761:head# 2024-02-10T08:39:12.195 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a74c6bdd:::benchmark_data_smithi018_166993_object42706:head# 2024-02-10T08:39:12.195 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a74d4191:::benchmark_data_smithi018_166993_object73949:head# 2024-02-10T08:39:12.195 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a74d5700:::benchmark_data_smithi018_166993_object20059:head# 2024-02-10T08:39:12.196 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a74e4408:::benchmark_data_smithi018_166993_object30485:head# 2024-02-10T08:39:12.196 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a74f2223:::benchmark_data_smithi018_166993_object82312:head# 2024-02-10T08:39:12.196 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a74f84d2:::benchmark_data_smithi018_166993_object54507:head# 2024-02-10T08:39:12.197 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a74fda71:::benchmark_data_smithi018_166993_object74508:head# 2024-02-10T08:39:12.197 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7502c23:::benchmark_data_smithi018_166993_object17704:head# 2024-02-10T08:39:12.198 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a750bbe9:::benchmark_data_smithi018_166993_object62662:head# 2024-02-10T08:39:12.198 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a752229e:::benchmark_data_smithi018_166993_object71099:head# 2024-02-10T08:39:12.199 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a75585be:::benchmark_data_smithi018_166993_object51562:head# 2024-02-10T08:39:12.199 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a755f5a0:::benchmark_data_smithi018_166993_object108272:head# 2024-02-10T08:39:12.202 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a756a2ba:::benchmark_data_smithi018_166993_object110608:head# 2024-02-10T08:39:12.202 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a756d3f0:::benchmark_data_smithi018_166993_object30075:head# 2024-02-10T08:39:12.202 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7583361:::benchmark_data_smithi018_166993_object58784:head# 2024-02-10T08:39:12.202 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a75a5168:::benchmark_data_smithi018_166993_object27282:head# 2024-02-10T08:39:12.202 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a75c3bd9:::benchmark_data_smithi018_166993_object54238:head# 2024-02-10T08:39:12.203 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a75de924:::benchmark_data_smithi018_166993_object73841:head# 2024-02-10T08:39:12.204 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a75e10be:::benchmark_data_smithi018_166993_object56975:head# 2024-02-10T08:39:12.204 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a75e749e:::benchmark_data_smithi018_166993_object103862:head# 2024-02-10T08:39:12.204 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a75f37d5:::benchmark_data_smithi018_166993_object99704:head# 2024-02-10T08:39:12.205 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a76048ae:::benchmark_data_smithi018_166993_object18260:head# 2024-02-10T08:39:12.205 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7616037:::benchmark_data_smithi018_166993_object48460:head# 2024-02-10T08:39:12.205 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a761bb81:::benchmark_data_smithi018_166993_object118945:head# 2024-02-10T08:39:12.210 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a76678ec:::benchmark_data_smithi018_166993_object110320:head# 2024-02-10T08:39:12.212 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7667c7b:::benchmark_data_smithi018_166993_object52391:head# 2024-02-10T08:39:12.213 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a766a95a:::benchmark_data_smithi018_166993_object78827:head# 2024-02-10T08:39:12.216 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a76768cd:::benchmark_data_smithi018_166993_object45229:head# 2024-02-10T08:39:12.216 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a767a66a:::benchmark_data_smithi018_166993_object28854:head# 2024-02-10T08:39:12.216 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a768ebb5:::benchmark_data_smithi018_166993_object106222:head# 2024-02-10T08:39:12.216 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a768fa70:::benchmark_data_smithi018_166993_object89469:head# 2024-02-10T08:39:12.220 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7692e29:::benchmark_data_smithi018_166993_object48340:head# 2024-02-10T08:39:12.220 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7693893:::benchmark_data_smithi018_166993_object88312:head# 2024-02-10T08:39:12.223 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7697170:::benchmark_data_smithi018_166993_object55166:head# 2024-02-10T08:39:12.223 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a76a15ad:::benchmark_data_smithi018_166993_object79345:head# 2024-02-10T08:39:12.223 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a76c35a7:::benchmark_data_smithi018_166993_object28256:head# 2024-02-10T08:39:12.228 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a76e4890:::benchmark_data_smithi018_166993_object104846:head# 2024-02-10T08:39:12.229 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a76ea2b1:::benchmark_data_smithi018_166993_object21114:head# 2024-02-10T08:39:12.229 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a76f0095:::benchmark_data_smithi018_166993_object28743:head# 2024-02-10T08:39:12.229 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7706cab:::benchmark_data_smithi018_166993_object73992:head# 2024-02-10T08:39:12.233 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a771a9cc:::benchmark_data_smithi018_166993_object77181:head# 2024-02-10T08:39:12.233 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a771de52:::benchmark_data_smithi018_166993_object116489:head# 2024-02-10T08:39:12.236 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7732f1f:::benchmark_data_smithi018_166993_object39805:head# 2024-02-10T08:39:12.237 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7735cc8:::benchmark_data_smithi018_166993_object109102:head# 2024-02-10T08:39:12.238 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a77503b8:::benchmark_data_smithi018_166993_object99018:head# 2024-02-10T08:39:12.238 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7752626:::benchmark_data_smithi018_166993_object114463:head# 2024-02-10T08:39:12.238 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7758593:::benchmark_data_smithi018_166993_object52971:head# 2024-02-10T08:39:12.239 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a775f07f:::benchmark_data_smithi018_166993_object82687:head# 2024-02-10T08:39:12.240 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a775f976:::benchmark_data_smithi018_166993_object35133:head# 2024-02-10T08:39:12.242 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7764f61:::benchmark_data_smithi018_166993_object103662:head# 2024-02-10T08:39:12.242 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a776646d:::benchmark_data_smithi018_166993_object34283:head# 2024-02-10T08:39:12.242 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7774e77:::benchmark_data_smithi018_166993_object59246:head# 2024-02-10T08:39:12.242 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a778a290:::benchmark_data_smithi018_166993_object42112:head# 2024-02-10T08:39:12.244 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a77bc590:::benchmark_data_smithi018_166993_object104499:head# 2024-02-10T08:39:12.244 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a77d3b53:::benchmark_data_smithi018_166993_object96872:head# 2024-02-10T08:39:12.244 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a77f0e28:::benchmark_data_smithi018_166993_object58171:head# 2024-02-10T08:39:12.244 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a77f6c1b:::benchmark_data_smithi018_166993_object32664:head# 2024-02-10T08:39:12.244 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a780d68d:::benchmark_data_smithi018_166993_object35761:head# 2024-02-10T08:39:12.245 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a781a49b:::benchmark_data_smithi018_166993_object109912:head# 2024-02-10T08:39:12.249 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a781fcea:::benchmark_data_smithi018_166993_object81707:head# 2024-02-10T08:39:12.249 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7821e75:::benchmark_data_smithi018_166993_object75601:head# 2024-02-10T08:39:12.249 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7823d82:::benchmark_data_smithi018_166993_object98131:head# 2024-02-10T08:39:12.250 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a783f3a2:::benchmark_data_smithi018_166993_object22404:head# 2024-02-10T08:39:12.250 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a785e268:::benchmark_data_smithi018_166993_object103987:head# 2024-02-10T08:39:12.252 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a787082c:::benchmark_data_smithi018_166993_object88819:head# 2024-02-10T08:39:12.252 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a787844f:::benchmark_data_smithi018_166993_object24287:head# 2024-02-10T08:39:12.253 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a787b1ea:::benchmark_data_smithi018_166993_object49041:head# 2024-02-10T08:39:12.253 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a787c979:::benchmark_data_smithi018_166993_object74308:head# 2024-02-10T08:39:12.254 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a787e191:::benchmark_data_smithi018_166993_object84471:head# 2024-02-10T08:39:12.254 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7886831:::benchmark_data_smithi018_166993_object43630:head# 2024-02-10T08:39:12.255 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7891e9f:::benchmark_data_smithi018_166993_object57529:head# 2024-02-10T08:39:12.255 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a78920fc:::benchmark_data_smithi018_166993_object95251:head# 2024-02-10T08:39:12.255 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7898c9e:::benchmark_data_smithi018_166993_object68593:head# 2024-02-10T08:39:12.257 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a78996d7:::benchmark_data_smithi018_166993_object82137:head# 2024-02-10T08:39:12.259 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a78aa0a9:::benchmark_data_smithi018_166993_object118666:head# 2024-02-10T08:39:12.259 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a78ac120:::benchmark_data_smithi018_166993_object57363:head# 2024-02-10T08:39:12.260 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a78bc7ea:::benchmark_data_smithi018_166993_object88872:head# 2024-02-10T08:39:12.263 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a78cabcb:::benchmark_data_smithi018_166993_object75363:head# 2024-02-10T08:39:12.263 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a78d0c3b:::benchmark_data_smithi018_166993_object91567:head# 2024-02-10T08:39:12.263 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a78d36a4:::benchmark_data_smithi018_166993_object118973:head# 2024-02-10T08:39:12.275 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a78e19d6:::benchmark_data_smithi018_166993_object112156:head# 2024-02-10T08:39:12.275 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a78e669f:::benchmark_data_smithi018_166993_object45617:head# 2024-02-10T08:39:12.275 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a78f143f:::benchmark_data_smithi018_166993_object116932:head# 2024-02-10T08:39:12.275 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a78f6e1e:::benchmark_data_smithi018_166993_object85144:head# 2024-02-10T08:39:12.277 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a78fd631:::benchmark_data_smithi018_166993_object28732:head# 2024-02-10T08:39:12.277 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7922fe9:::benchmark_data_smithi018_166993_object56504:head# 2024-02-10T08:39:12.277 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a79333bb:::benchmark_data_smithi018_166993_object68557:head# 2024-02-10T08:39:12.277 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a794be2a:::benchmark_data_smithi018_166993_object81668:head# 2024-02-10T08:39:12.277 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a794dad2:::benchmark_data_smithi018_166993_object29704:head# 2024-02-10T08:39:12.277 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a79598b4:::benchmark_data_smithi018_166993_object108405:head# 2024-02-10T08:39:12.281 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7967432:::benchmark_data_smithi018_166993_object28580:head# 2024-02-10T08:39:12.283 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7973b2b:::benchmark_data_smithi018_166993_object81712:head# 2024-02-10T08:39:12.284 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7975629:::benchmark_data_smithi018_166993_object36049:head# 2024-02-10T08:39:12.284 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a797ec71:::benchmark_data_smithi018_166993_object88671:head# 2024-02-10T08:39:12.284 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a798681b:::benchmark_data_smithi018_166993_object25404:head# 2024-02-10T08:39:12.285 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7986946:::benchmark_data_smithi018_166993_object99971:head# 2024-02-10T08:39:12.286 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7992d48:::benchmark_data_smithi018_166993_object107478:head# 2024-02-10T08:39:12.286 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a79930e3:::benchmark_data_smithi018_166993_object70226:head# 2024-02-10T08:39:12.287 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a799c32a:::benchmark_data_smithi018_166993_object35799:head# 2024-02-10T08:39:12.287 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a79a87e5:::benchmark_data_smithi018_166993_object21864:head# 2024-02-10T08:39:12.288 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a79b3601:::benchmark_data_smithi018_166993_object21622:head# 2024-02-10T08:39:12.288 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a79bc1a4:::benchmark_data_smithi018_166993_object104849:head# 2024-02-10T08:39:12.288 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a79c9b41:::benchmark_data_smithi018_166993_object71131:head# 2024-02-10T08:39:12.289 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a79d0db1:::benchmark_data_smithi018_166993_object71690:head# 2024-02-10T08:39:12.290 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7a07411:::benchmark_data_smithi018_166993_object32773:head# 2024-02-10T08:39:12.291 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7a0e9ae:::benchmark_data_smithi018_166993_object51906:head# 2024-02-10T08:39:12.292 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7a0fbb4:::benchmark_data_smithi018_166993_object97133:head# 2024-02-10T08:39:12.294 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7a1c810:::benchmark_data_smithi018_166993_object72119:head# 2024-02-10T08:39:12.294 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7a1ddda:::benchmark_data_smithi018_166993_object39017:head# 2024-02-10T08:39:12.294 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7a32a6c:::benchmark_data_smithi018_166993_object31109:head# 2024-02-10T08:39:12.294 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7a33c1d:::benchmark_data_smithi018_166993_object66793:head# 2024-02-10T08:39:12.300 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7a349c6:::benchmark_data_smithi018_166993_object57122:head# 2024-02-10T08:39:12.302 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7a38ca1:::benchmark_data_smithi018_166993_object24482:head# 2024-02-10T08:39:12.302 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7a3e346:::benchmark_data_smithi018_166993_object106943:head# 2024-02-10T08:39:12.303 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7a41a0a:::benchmark_data_smithi018_166993_object114130:head# 2024-02-10T08:39:12.304 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7a597a7:::benchmark_data_smithi018_166993_object76371:head# 2024-02-10T08:39:12.304 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7a59a55:::benchmark_data_smithi018_166993_object28066:head# 2024-02-10T08:39:12.308 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7a5e1ee:::benchmark_data_smithi018_166993_object92982:head# 2024-02-10T08:39:12.309 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7a64d6c:::benchmark_data_smithi018_166993_object40214:head# 2024-02-10T08:39:12.309 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7a81b3f:::benchmark_data_smithi018_166993_object72819:head# 2024-02-10T08:39:12.310 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7a84613:::benchmark_data_smithi018_166993_object50525:head# 2024-02-10T08:39:12.310 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7a8ba4e:::benchmark_data_smithi018_166993_object77389:head# 2024-02-10T08:39:12.311 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7a8e886:::benchmark_data_smithi018_166993_object65611:head# 2024-02-10T08:39:12.311 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7a96b3a:::benchmark_data_smithi018_166993_object69840:head# 2024-02-10T08:39:12.312 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7aa67d6:::benchmark_data_smithi018_166993_object61122:head# 2024-02-10T08:39:12.312 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7ab2fec:::benchmark_data_smithi018_166993_object107974:head# 2024-02-10T08:39:12.314 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7abfcaa:::benchmark_data_smithi018_166993_object18652:head# 2024-02-10T08:39:12.315 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7ac82d4:::benchmark_data_smithi018_166993_object60643:head# 2024-02-10T08:39:12.316 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7ad546c:::benchmark_data_smithi018_166993_object19802:head# 2024-02-10T08:39:12.316 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7ada7e0:::benchmark_data_smithi018_166993_object37367:head# 2024-02-10T08:39:12.318 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7ae73fe:::benchmark_data_smithi018_166993_object91357:head# 2024-02-10T08:39:12.319 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7ae7a2e:::benchmark_data_smithi018_166993_object97131:head# 2024-02-10T08:39:12.319 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7b0167c:::benchmark_data_smithi018_166993_object32841:head# 2024-02-10T08:39:12.319 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7b032d0:::benchmark_data_smithi018_166993_object95420:head# 2024-02-10T08:39:12.320 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7b06fe0:::benchmark_data_smithi018_166993_object108011:head# 2024-02-10T08:39:12.324 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7b09b9a:::benchmark_data_smithi018_166993_object34197:head# 2024-02-10T08:39:12.324 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7b12f4a:::benchmark_data_smithi018_166993_object112829:head# 2024-02-10T08:39:12.326 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7b1f8b9:::benchmark_data_smithi018_166993_object93648:head# 2024-02-10T08:39:12.327 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7b27987:::benchmark_data_smithi018_166993_object111244:head# 2024-02-10T08:39:12.328 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7b2b901:::benchmark_data_smithi018_166993_object94488:head# 2024-02-10T08:39:12.332 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7b2c143:::benchmark_data_smithi018_166993_object97484:head# 2024-02-10T08:39:12.333 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7b33bd5:::benchmark_data_smithi018_166993_object106086:head# 2024-02-10T08:39:12.333 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7b5f2b8:::benchmark_data_smithi018_166993_object88445:head# 2024-02-10T08:39:12.334 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7b5f2bb:::benchmark_data_smithi018_166993_object21240:head# 2024-02-10T08:39:12.335 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7b5f523:::benchmark_data_smithi018_166993_object29122:head# 2024-02-10T08:39:12.335 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7b6ee66:::benchmark_data_smithi018_166993_object24981:head# 2024-02-10T08:39:12.336 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7b72e92:::benchmark_data_smithi018_166993_object91563:head# 2024-02-10T08:39:12.336 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7b74c4c:::benchmark_data_smithi018_166993_object42992:head# 2024-02-10T08:39:12.337 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7b7eeae:::benchmark_data_smithi018_166993_object79886:head# 2024-02-10T08:39:12.337 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7b8adc1:::benchmark_data_smithi018_166993_object58992:head# 2024-02-10T08:39:12.337 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7ba00a0:::benchmark_data_smithi018_166993_object114947:head# 2024-02-10T08:39:12.338 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7bb2ba3:::benchmark_data_smithi018_166993_object57057:head# 2024-02-10T08:39:12.338 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7bb704e:::benchmark_data_smithi018_166993_object64800:head# 2024-02-10T08:39:12.339 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7bc7195:::benchmark_data_smithi018_166993_object102236:head# 2024-02-10T08:39:12.344 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7bcb2bd:::benchmark_data_smithi018_166993_object68935:head# 2024-02-10T08:39:12.348 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7bd6e3f:::benchmark_data_smithi018_166993_object111627:head# 2024-02-10T08:39:12.348 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7be2612:::benchmark_data_smithi018_166993_object40607:head# 2024-02-10T08:39:12.348 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7beb62f:::benchmark_data_smithi018_166993_object91496:head# 2024-02-10T08:39:12.349 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7bf7291:::benchmark_data_smithi018_166993_object48915:head# 2024-02-10T08:39:12.349 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7c17583:::benchmark_data_smithi018_166993_object48676:head# 2024-02-10T08:39:12.354 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7c20f43:::benchmark_data_smithi018_166993_object43005:head# 2024-02-10T08:39:12.355 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7c35668:::benchmark_data_smithi018_166993_object70767:head# 2024-02-10T08:39:12.355 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7c3f89b:::benchmark_data_smithi018_166993_object23518:head# 2024-02-10T08:39:12.356 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7c50e54:::benchmark_data_smithi018_166993_object81561:head# 2024-02-10T08:39:12.358 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7c54fa5:::benchmark_data_smithi018_166993_object95656:head# 2024-02-10T08:39:12.359 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7c5722a:::benchmark_data_smithi018_166993_object51164:head# 2024-02-10T08:39:12.359 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7c5ca04:::benchmark_data_smithi018_166993_object95111:head# 2024-02-10T08:39:12.361 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7c672c9:::benchmark_data_smithi018_166993_object82154:head# 2024-02-10T08:39:12.364 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7c6743f:::benchmark_data_smithi018_166993_object73894:head# 2024-02-10T08:39:12.365 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7c88598:::benchmark_data_smithi018_166993_object118949:head# 2024-02-10T08:39:12.365 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7c973d8:::benchmark_data_smithi018_166993_object64386:head# 2024-02-10T08:39:12.365 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7ca4f0a:::benchmark_data_smithi018_166993_object81272:head# 2024-02-10T08:39:12.365 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7ca78d1:::benchmark_data_smithi018_166993_object18561:head# 2024-02-10T08:39:12.365 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7ca90fa:::benchmark_data_smithi018_166993_object76779:head# 2024-02-10T08:39:12.366 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7cab0e1:::benchmark_data_smithi018_166993_object32923:head# 2024-02-10T08:39:12.366 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7cacb1d:::benchmark_data_smithi018_166993_object60045:head# 2024-02-10T08:39:12.366 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7cb6908:::benchmark_data_smithi018_166993_object47204:head# 2024-02-10T08:39:12.367 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7cb9fdb:::benchmark_data_smithi018_166993_object69474:head# 2024-02-10T08:39:12.367 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7cbfd5e:::benchmark_data_smithi018_166993_object27653:head# 2024-02-10T08:39:12.371 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7cc8707:::benchmark_data_smithi018_166993_object38895:head# 2024-02-10T08:39:12.371 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7cdb83d:::benchmark_data_smithi018_166993_object56356:head# 2024-02-10T08:39:12.372 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7ce0770:::benchmark_data_smithi018_166993_object107432:head# 2024-02-10T08:39:12.372 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7ce2b00:::benchmark_data_smithi018_166993_object32469:head# 2024-02-10T08:39:12.373 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7ce891c:::benchmark_data_smithi018_166993_object43062:head# 2024-02-10T08:39:12.374 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7cf22eb:::benchmark_data_smithi018_166993_object57825:head# 2024-02-10T08:39:12.377 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7d143c5:::benchmark_data_smithi018_166993_object114081:head# 2024-02-10T08:39:12.377 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7d34ac9:::benchmark_data_smithi018_166993_object64996:head# 2024-02-10T08:39:12.378 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7d3510c:::benchmark_data_smithi018_166993_object49157:head# 2024-02-10T08:39:12.379 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7d3b479:::benchmark_data_smithi018_166993_object68815:head# 2024-02-10T08:39:12.379 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7d3f08f:::benchmark_data_smithi018_166993_object57398:head# 2024-02-10T08:39:12.379 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7d4520e:::benchmark_data_smithi018_166993_object27085:head# 2024-02-10T08:39:12.380 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7d4a296:::benchmark_data_smithi018_166993_object43842:head# 2024-02-10T08:39:12.380 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7d50829:::benchmark_data_smithi018_166993_object53962:head# 2024-02-10T08:39:12.381 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7d5a0ce:::benchmark_data_smithi018_166993_object61873:head# 2024-02-10T08:39:12.381 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7d60e22:::benchmark_data_smithi018_166993_object65412:head# 2024-02-10T08:39:12.382 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7d6792a:::benchmark_data_smithi018_166993_object19204:head# 2024-02-10T08:39:12.382 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7d833f5:::benchmark_data_smithi018_166993_object107991:head# 2024-02-10T08:39:12.383 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7da9a87:::benchmark_data_smithi018_166993_object106181:head# 2024-02-10T08:39:12.383 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7dad118:::benchmark_data_smithi018_166993_object103438:head# 2024-02-10T08:39:12.383 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7dbb40c:::benchmark_data_smithi018_166993_object59717:head# 2024-02-10T08:39:12.384 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7dc5f38:::benchmark_data_smithi018_166993_object90503:head# 2024-02-10T08:39:12.384 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7dd553c:::benchmark_data_smithi018_166993_object95081:head# 2024-02-10T08:39:12.385 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7dd5ec2:::benchmark_data_smithi018_166993_object55756:head# 2024-02-10T08:39:12.385 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7dd9456:::benchmark_data_smithi018_166993_object63315:head# 2024-02-10T08:39:12.386 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7de0a41:::benchmark_data_smithi018_166993_object48061:head# 2024-02-10T08:39:12.386 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7de81c7:::benchmark_data_smithi018_166993_object85466:head# 2024-02-10T08:39:12.386 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7e113c5:::benchmark_data_smithi018_166993_object100934:head# 2024-02-10T08:39:12.387 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7e15a2f:::benchmark_data_smithi018_166993_object107265:head# 2024-02-10T08:39:12.388 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7e1fee2:::benchmark_data_smithi018_166993_object112457:head# 2024-02-10T08:39:12.388 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7e2f820:::benchmark_data_smithi018_166993_object107502:head# 2024-02-10T08:39:12.389 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7e357b6:::benchmark_data_smithi018_166993_object48833:head# 2024-02-10T08:39:12.389 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7e426ce:::benchmark_data_smithi018_166993_object77801:head# 2024-02-10T08:39:12.390 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7e5ce2b:::benchmark_data_smithi018_166993_object79982:head# 2024-02-10T08:39:12.395 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7e6c219:::benchmark_data_smithi018_166993_object70461:head# 2024-02-10T08:39:12.396 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7e6e513:::benchmark_data_smithi018_166993_object100200:head# 2024-02-10T08:39:12.397 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7e74e7d:::benchmark_data_smithi018_166993_object83680:head# 2024-02-10T08:39:12.397 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7e78b1d:::benchmark_data_smithi018_166993_object26696:head# 2024-02-10T08:39:12.397 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7e9351e:::benchmark_data_smithi018_166993_object102484:head# 2024-02-10T08:39:12.397 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7eab61c:::benchmark_data_smithi018_166993_object90828:head# 2024-02-10T08:39:12.397 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7eaf861:::benchmark_data_smithi018_166993_object34465:head# 2024-02-10T08:39:12.397 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7eb39fb:::benchmark_data_smithi018_166993_object26468:head# 2024-02-10T08:39:12.397 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7eca0d4:::benchmark_data_smithi018_166993_object99692:head# 2024-02-10T08:39:12.398 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7edbc6a:::benchmark_data_smithi018_166993_object30414:head# 2024-02-10T08:39:12.401 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7edeb93:::benchmark_data_smithi018_166993_object89115:head# 2024-02-10T08:39:12.401 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7ee5280:::benchmark_data_smithi018_166993_object93635:head# 2024-02-10T08:39:12.401 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7ee6dfa:::benchmark_data_smithi018_166993_object71860:head# 2024-02-10T08:39:12.401 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7efc1a8:::benchmark_data_smithi018_166993_object69364:head# 2024-02-10T08:39:12.404 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7f0ab95:::benchmark_data_smithi018_166993_object67397:head# 2024-02-10T08:39:12.404 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7f192cf:::benchmark_data_smithi018_166993_object49562:head# 2024-02-10T08:39:12.404 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7f20b3a:::benchmark_data_smithi018_166993_object90388:head# 2024-02-10T08:39:12.405 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7f24348:::benchmark_data_smithi018_166993_object66372:head# 2024-02-10T08:39:12.409 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7f4ccb8:::benchmark_data_smithi018_166993_object69852:head# 2024-02-10T08:39:12.409 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7f54d24:::benchmark_data_smithi018_166993_object108163:head# 2024-02-10T08:39:12.409 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7f5a60c:::benchmark_data_smithi018_166993_object110384:head# 2024-02-10T08:39:12.411 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7f5fd28:::benchmark_data_smithi018_166993_object110858:head# 2024-02-10T08:39:12.411 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7f800cc:::benchmark_data_smithi018_166993_object57404:head# 2024-02-10T08:39:12.412 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7f84429:::benchmark_data_smithi018_166993_object28272:head# 2024-02-10T08:39:12.412 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7f84aad:::benchmark_data_smithi018_166993_object48828:head# 2024-02-10T08:39:12.413 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7faf047:::benchmark_data_smithi018_166993_object68166:head# 2024-02-10T08:39:12.413 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7fbd9a3:::benchmark_data_smithi018_166993_object69547:head# 2024-02-10T08:39:12.414 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7fd6df2:::benchmark_data_smithi018_166993_object40874:head# 2024-02-10T08:39:12.414 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7fdd42c:::benchmark_data_smithi018_166993_object68619:head# 2024-02-10T08:39:12.414 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7fde1de:::benchmark_data_smithi018_166993_object27898:head# 2024-02-10T08:39:12.414 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7fe75e8:::benchmark_data_smithi018_166993_object54531:head# 2024-02-10T08:39:12.417 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7febbc7:::benchmark_data_smithi018_166993_object75286:head# 2024-02-10T08:39:12.421 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7ff57a5:::benchmark_data_smithi018_166993_object100645:head# 2024-02-10T08:39:12.421 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a7ffaade:::benchmark_data_smithi018_166993_object51602:head# 2024-02-10T08:39:12.421 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a800e8bb:::benchmark_data_smithi018_166993_object116596:head# 2024-02-10T08:39:12.421 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a801b814:::benchmark_data_smithi018_166993_object59541:head# 2024-02-10T08:39:12.421 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a801fdec:::benchmark_data_smithi018_166993_object108509:head# 2024-02-10T08:39:12.421 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8029f52:::benchmark_data_smithi018_166993_object67937:head# 2024-02-10T08:39:12.422 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a802ad5a:::benchmark_data_smithi018_166993_object94013:head# 2024-02-10T08:39:12.422 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a802e4c4:::benchmark_data_smithi018_166993_object81384:head# 2024-02-10T08:39:12.422 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8032fe5:::benchmark_data_smithi018_166993_object26074:head# 2024-02-10T08:39:12.423 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8067897:::benchmark_data_smithi018_166993_object59700:head# 2024-02-10T08:39:12.423 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8074f52:::benchmark_data_smithi018_166993_object96783:head# 2024-02-10T08:39:12.425 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a807d28e:::benchmark_data_smithi018_166993_object50939:head# 2024-02-10T08:39:12.426 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a807d505:::benchmark_data_smithi018_166993_object115866:head# 2024-02-10T08:39:12.426 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8089070:::benchmark_data_smithi018_166993_object115488:head# 2024-02-10T08:39:12.428 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a80901cf:::benchmark_data_smithi018_166993_object91605:head# 2024-02-10T08:39:12.429 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8092507:::benchmark_data_smithi018_166993_object83815:head# 2024-02-10T08:39:12.443 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a80a2fe5:::benchmark_data_smithi018_166993_object27936:head# 2024-02-10T08:39:12.448 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a80ab5f6:::benchmark_data_smithi018_166993_object101644:head# 2024-02-10T08:39:12.449 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a80b559e:::benchmark_data_smithi018_166993_object52419:head# 2024-02-10T08:39:12.449 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a80cd007:::benchmark_data_smithi018_166993_object107473:head# 2024-02-10T08:39:12.449 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a80d51e4:::benchmark_data_smithi018_166993_object93241:head# 2024-02-10T08:39:12.449 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a80d5c68:::benchmark_data_smithi018_166993_object25283:head# 2024-02-10T08:39:12.451 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a80d63d6:::benchmark_data_smithi018_166993_object81177:head# 2024-02-10T08:39:12.451 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a80d6c3c:::benchmark_data_smithi018_166993_object80764:head# 2024-02-10T08:39:12.454 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a80dd735:::benchmark_data_smithi018_166993_object79660:head# 2024-02-10T08:39:12.454 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a80ddd68:::benchmark_data_smithi018_166993_object26469:head# 2024-02-10T08:39:12.457 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a80fa857:::benchmark_data_smithi018_166993_object93723:head# 2024-02-10T08:39:12.457 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a80fddfe:::benchmark_data_smithi018_166993_object85239:head# 2024-02-10T08:39:12.457 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a810b894:::benchmark_data_smithi018_166993_object44905:head# 2024-02-10T08:39:12.457 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8114a93:::benchmark_data_smithi018_166993_object47056:head# 2024-02-10T08:39:12.457 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8115b3d:::benchmark_data_smithi018_166993_object109460:head# 2024-02-10T08:39:12.458 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a812bf9a:::benchmark_data_smithi018_166993_object75946:head# 2024-02-10T08:39:12.458 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8144c89:::benchmark_data_smithi018_166993_object94246:head# 2024-02-10T08:39:12.459 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a814a1da:::benchmark_data_smithi018_166993_object113501:head# 2024-02-10T08:39:12.459 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8150562:::benchmark_data_smithi018_166993_object91127:head# 2024-02-10T08:39:12.459 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a81529f4:::benchmark_data_smithi018_166993_object46634:head# 2024-02-10T08:39:12.460 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a816ef49:::benchmark_data_smithi018_166993_object89309:head# 2024-02-10T08:39:12.460 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a817fff2:::benchmark_data_smithi018_166993_object97503:head# 2024-02-10T08:39:12.465 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a818af68:::benchmark_data_smithi018_166993_object36017:head# 2024-02-10T08:39:12.465 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a818b43a:::benchmark_data_smithi018_166993_object19481:head# 2024-02-10T08:39:12.466 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a81b393b:::benchmark_data_smithi018_166993_object82707:head# 2024-02-10T08:39:12.466 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a81b60fd:::benchmark_data_smithi018_166993_object24393:head# 2024-02-10T08:39:12.466 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a81bc2e4:::benchmark_data_smithi018_166993_object64919:head# 2024-02-10T08:39:12.466 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a81d87dd:::benchmark_data_smithi018_166993_object99879:head# 2024-02-10T08:39:12.466 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a81f2289:::benchmark_data_smithi018_166993_object60615:head# 2024-02-10T08:39:12.466 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a81f3de8:::benchmark_data_smithi018_166993_object112310:head# 2024-02-10T08:39:12.466 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8203c81:::benchmark_data_smithi018_166993_object33238:head# 2024-02-10T08:39:12.466 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8208e46:::benchmark_data_smithi018_166993_object101083:head# 2024-02-10T08:39:12.466 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a82130e7:::benchmark_data_smithi018_166993_object109466:head# 2024-02-10T08:39:12.467 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a821869d:::benchmark_data_smithi018_166993_object18784:head# 2024-02-10T08:39:12.467 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a82219f1:::benchmark_data_smithi018_166993_object79007:head# 2024-02-10T08:39:12.467 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a822875c:::benchmark_data_smithi018_166993_object53547:head# 2024-02-10T08:39:12.467 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a822ad80:::benchmark_data_smithi018_166993_object72449:head# 2024-02-10T08:39:12.468 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a823cf7a:::benchmark_data_smithi018_166993_object35606:head# 2024-02-10T08:39:12.468 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8243a0d:::benchmark_data_smithi018_166993_object38327:head# 2024-02-10T08:39:12.469 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a824643d:::benchmark_data_smithi018_166993_object101465:head# 2024-02-10T08:39:12.469 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a824f30c:::benchmark_data_smithi018_166993_object109866:head# 2024-02-10T08:39:12.473 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8253699:::benchmark_data_smithi018_166993_object75050:head# 2024-02-10T08:39:12.477 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a82667ae:::benchmark_data_smithi018_166993_object27387:head# 2024-02-10T08:39:12.477 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a826c6d2:::benchmark_data_smithi018_166993_object32552:head# 2024-02-10T08:39:12.477 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8275448:::benchmark_data_smithi018_166993_object67447:head# 2024-02-10T08:39:12.477 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a828d6fb:::benchmark_data_smithi018_166993_object54339:head# 2024-02-10T08:39:12.477 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a829f093:::benchmark_data_smithi018_166993_object37582:head# 2024-02-10T08:39:12.478 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a82abb37:::benchmark_data_smithi018_166993_object105373:head# 2024-02-10T08:39:12.478 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a82abf40:::benchmark_data_smithi018_166993_object40575:head# 2024-02-10T08:39:12.479 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a82b0a36:::benchmark_data_smithi018_166993_object36921:head# 2024-02-10T08:39:12.479 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a82b60e1:::benchmark_data_smithi018_166993_object24619:head# 2024-02-10T08:39:12.481 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a82b7074:::benchmark_data_smithi018_166993_object52064:head# 2024-02-10T08:39:12.481 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a82c7f5d:::benchmark_data_smithi018_166993_object37983:head# 2024-02-10T08:39:12.484 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a82c92ee:::benchmark_data_smithi018_166993_object86495:head# 2024-02-10T08:39:12.484 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a82da2be:::benchmark_data_smithi018_166993_object115507:head# 2024-02-10T08:39:12.485 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a82db040:::benchmark_data_smithi018_166993_object42803:head# 2024-02-10T08:39:12.485 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a82ec940:::benchmark_data_smithi018_166993_object97913:head# 2024-02-10T08:39:12.485 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a82f099c:::benchmark_data_smithi018_166993_object110318:head# 2024-02-10T08:39:12.486 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8302f48:::benchmark_data_smithi018_166993_object54134:head# 2024-02-10T08:39:12.487 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8305214:::benchmark_data_smithi018_166993_object35559:head# 2024-02-10T08:39:12.488 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a830df71:::benchmark_data_smithi018_166993_object41240:head# 2024-02-10T08:39:12.489 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a831e403:::benchmark_data_smithi018_166993_object109579:head# 2024-02-10T08:39:12.489 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8328082:::benchmark_data_smithi018_166993_object86193:head# 2024-02-10T08:39:12.489 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8329817:::benchmark_data_smithi018_166993_object59670:head# 2024-02-10T08:39:12.489 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a832ddec:::benchmark_data_smithi018_166993_object109509:head# 2024-02-10T08:39:12.490 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a834051b:::benchmark_data_smithi018_166993_object94374:head# 2024-02-10T08:39:12.491 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8351252:::benchmark_data_smithi018_166993_object42182:head# 2024-02-10T08:39:12.493 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a836130d:::benchmark_data_smithi018_166993_object88046:head# 2024-02-10T08:39:12.493 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8364ef4:::benchmark_data_smithi018_166993_object42898:head# 2024-02-10T08:39:12.493 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a836e807:::benchmark_data_smithi018_166993_object23035:head# 2024-02-10T08:39:12.494 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8370eb4:::benchmark_data_smithi018_166993_object114679:head# 2024-02-10T08:39:12.494 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8377d5c:::benchmark_data_smithi018_166993_object96725:head# 2024-02-10T08:39:12.495 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8378622:::benchmark_data_smithi018_166993_object54036:head# 2024-02-10T08:39:12.499 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a838762e:::benchmark_data_smithi018_166993_object92275:head# 2024-02-10T08:39:12.499 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a839e155:::benchmark_data_smithi018_166993_object71321:head# 2024-02-10T08:39:12.499 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a83a1091:::benchmark_data_smithi018_166993_object84123:head# 2024-02-10T08:39:12.499 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a83a18bd:::benchmark_data_smithi018_166993_object31613:head# 2024-02-10T08:39:12.499 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a83b2bdb:::benchmark_data_smithi018_166993_object17489:head# 2024-02-10T08:39:12.499 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a83b5ba4:::benchmark_data_smithi018_166993_object111601:head# 2024-02-10T08:39:12.499 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a83ba011:::benchmark_data_smithi018_166993_object98721:head# 2024-02-10T08:39:12.508 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a83ce062:::benchmark_data_smithi018_166993_object81301:head# 2024-02-10T08:39:12.508 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a83ddb13:::benchmark_data_smithi018_166993_object74270:head# 2024-02-10T08:39:12.508 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a83de751:::benchmark_data_smithi018_166993_object78115:head# 2024-02-10T08:39:12.508 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a83faa05:::benchmark_data_smithi018_166993_object113472:head# 2024-02-10T08:39:12.508 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8402475:::benchmark_data_smithi018_166993_object39386:head# 2024-02-10T08:39:12.508 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a840faa3:::benchmark_data_smithi018_166993_object57579:head# 2024-02-10T08:39:12.508 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a84122a4:::benchmark_data_smithi018_166993_object52145:head# 2024-02-10T08:39:12.508 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a841ed17:::benchmark_data_smithi018_166993_object88184:head# 2024-02-10T08:39:12.509 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a842931f:::benchmark_data_smithi018_166993_object53758:head# 2024-02-10T08:39:12.511 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a842afca:::benchmark_data_smithi018_166993_object82874:head# 2024-02-10T08:39:12.513 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a843117f:::benchmark_data_smithi018_166993_object105981:head# 2024-02-10T08:39:12.513 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8433656:::benchmark_data_smithi018_166993_object28203:head# 2024-02-10T08:39:12.513 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a843c717:::benchmark_data_smithi018_166993_object107054:head# 2024-02-10T08:39:12.514 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8440453:::benchmark_data_smithi018_166993_object117912:head# 2024-02-10T08:39:12.514 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8445a8b:::benchmark_data_smithi018_166993_object85596:head# 2024-02-10T08:39:12.515 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a844cada:::benchmark_data_smithi018_166993_object87562:head# 2024-02-10T08:39:12.515 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8450c07:::benchmark_data_smithi018_166993_object43435:head# 2024-02-10T08:39:12.516 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8460f75:::benchmark_data_smithi018_166993_object82124:head# 2024-02-10T08:39:12.516 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8470541:::benchmark_data_smithi018_166993_object85321:head# 2024-02-10T08:39:12.517 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a84819a9:::benchmark_data_smithi018_166993_object58053:head# 2024-02-10T08:39:12.517 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a849e455:::benchmark_data_smithi018_166993_object107370:head# 2024-02-10T08:39:12.518 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a84a03b0:::benchmark_data_smithi018_166993_object39681:head# 2024-02-10T08:39:12.518 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a84afb93:::benchmark_data_smithi018_166993_object98546:head# 2024-02-10T08:39:12.519 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a84b148a:::benchmark_data_smithi018_166993_object84484:head# 2024-02-10T08:39:12.519 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a84b44a7:::benchmark_data_smithi018_166993_object111164:head# 2024-02-10T08:39:12.520 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a84b574f:::benchmark_data_smithi018_166993_object32629:head# 2024-02-10T08:39:12.520 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a84b7160:::benchmark_data_smithi018_166993_object71420:head# 2024-02-10T08:39:12.520 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a84cfc75:::benchmark_data_smithi018_166993_object75675:head# 2024-02-10T08:39:12.521 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a84d2e29:::benchmark_data_smithi018_166993_object55871:head# 2024-02-10T08:39:12.521 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8507c51:::benchmark_data_smithi018_166993_object83255:head# 2024-02-10T08:39:12.522 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a850b7f2:::benchmark_data_smithi018_166993_object21531:head# 2024-02-10T08:39:12.522 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a850bf99:::benchmark_data_smithi018_166993_object76585:head# 2024-02-10T08:39:12.523 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a850c0b3:::benchmark_data_smithi018_166993_object64655:head# 2024-02-10T08:39:12.530 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a850eb23:::benchmark_data_smithi018_166993_object85032:head# 2024-02-10T08:39:12.530 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a851b28f:::benchmark_data_smithi018_166993_object83960:head# 2024-02-10T08:39:12.531 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a85404ab:::benchmark_data_smithi018_166993_object109066:head# 2024-02-10T08:39:12.531 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8545782:::benchmark_data_smithi018_166993_object111481:head# 2024-02-10T08:39:12.532 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8545c48:::benchmark_data_smithi018_166993_object80082:head# 2024-02-10T08:39:12.533 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8546ec3:::benchmark_data_smithi018_166993_object64648:head# 2024-02-10T08:39:12.533 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a854721c:::benchmark_data_smithi018_166993_object111059:head# 2024-02-10T08:39:12.534 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8548cfb:::benchmark_data_smithi018_166993_object58787:head# 2024-02-10T08:39:12.534 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a85584ec:::benchmark_data_smithi018_166993_object117308:head# 2024-02-10T08:39:12.534 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a855bfe2:::benchmark_data_smithi018_166993_object19218:head# 2024-02-10T08:39:12.535 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a85614dc:::benchmark_data_smithi018_166993_object104194:head# 2024-02-10T08:39:12.537 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8569497:::benchmark_data_smithi018_166993_object113214:head# 2024-02-10T08:39:12.537 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8570e93:::benchmark_data_smithi018_166993_object63710:head# 2024-02-10T08:39:12.537 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8574c9b:::benchmark_data_smithi018_166993_object98957:head# 2024-02-10T08:39:12.538 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8583ab2:::benchmark_data_smithi018_166993_object114473:head# 2024-02-10T08:39:12.541 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a85840aa:::benchmark_data_smithi018_166993_object62427:head# 2024-02-10T08:39:12.541 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8584fb4:::benchmark_data_smithi018_166993_object51090:head# 2024-02-10T08:39:12.542 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a85982ec:::benchmark_data_smithi018_166993_object73729:head# 2024-02-10T08:39:12.542 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a859ab52:::benchmark_data_smithi018_166993_object112825:head# 2024-02-10T08:39:12.542 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a85ae522:::benchmark_data_smithi018_166993_object25144:head# 2024-02-10T08:39:12.543 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a85c4b67:::benchmark_data_smithi018_166993_object34987:head# 2024-02-10T08:39:12.547 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a85dce3a:::benchmark_data_smithi018_166993_object42078:head# 2024-02-10T08:39:12.547 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a85e5e99:::benchmark_data_smithi018_166993_object60708:head# 2024-02-10T08:39:12.550 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a85ea519:::benchmark_data_smithi018_166993_object31976:head# 2024-02-10T08:39:12.550 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a85f1d18:::benchmark_data_smithi018_166993_object43006:head# 2024-02-10T08:39:12.551 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a85fab15:::benchmark_data_smithi018_166993_object76814:head# 2024-02-10T08:39:12.551 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a85fb197:::benchmark_data_smithi018_166993_object85626:head# 2024-02-10T08:39:12.552 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a85fd345:::benchmark_data_smithi018_166993_object21331:head# 2024-02-10T08:39:12.552 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a861017c:::benchmark_data_smithi018_166993_object106829:head# 2024-02-10T08:39:12.563 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8619003:::benchmark_data_smithi018_166993_object78709:head# 2024-02-10T08:39:12.563 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8629e3e:::benchmark_data_smithi018_166993_object77649:head# 2024-02-10T08:39:12.564 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8635888:::benchmark_data_smithi018_166993_object86113:head# 2024-02-10T08:39:12.564 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8639807:::benchmark_data_smithi018_166993_object108553:head# 2024-02-10T08:39:12.564 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8649ca0:::benchmark_data_smithi018_166993_object79689:head# 2024-02-10T08:39:12.565 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a866cd74:::benchmark_data_smithi018_166993_object40384:head# 2024-02-10T08:39:12.568 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a868055e:::benchmark_data_smithi018_166993_object46011:head# 2024-02-10T08:39:12.579 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a868564f:::benchmark_data_smithi018_166993_object43089:head# 2024-02-10T08:39:12.579 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a869bda3:::benchmark_data_smithi018_166993_object30040:head# 2024-02-10T08:39:12.580 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a869c6e2:::benchmark_data_smithi018_166993_object74183:head# 2024-02-10T08:39:12.580 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a86a52d9:::benchmark_data_smithi018_166993_object112523:head# 2024-02-10T08:39:12.581 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a86a5f0b:::benchmark_data_smithi018_166993_object106283:head# 2024-02-10T08:39:12.582 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a86a8d8d:::benchmark_data_smithi018_166993_object42516:head# 2024-02-10T08:39:12.582 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a86ca48f:::benchmark_data_smithi018_166993_object55511:head# 2024-02-10T08:39:12.582 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a86cdb0c:::benchmark_data_smithi018_166993_object74151:head# 2024-02-10T08:39:12.582 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a86d296d:::benchmark_data_smithi018_166993_object21854:head# 2024-02-10T08:39:12.583 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a86d65a8:::benchmark_data_smithi018_166993_object101322:head# 2024-02-10T08:39:12.583 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a86d9fdb:::benchmark_data_smithi018_166993_object104725:head# 2024-02-10T08:39:12.585 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a86de0c3:::benchmark_data_smithi018_166993_object21860:head# 2024-02-10T08:39:12.587 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a86ea709:::benchmark_data_smithi018_166993_object31787:head# 2024-02-10T08:39:12.597 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a86f72dc:::benchmark_data_smithi018_166993_object52402:head# 2024-02-10T08:39:12.597 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a86fca9e:::benchmark_data_smithi018_166993_object115241:head# 2024-02-10T08:39:12.597 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a870634e:::benchmark_data_smithi018_166993_object74425:head# 2024-02-10T08:39:12.598 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a870b1cf:::benchmark_data_smithi018_166993_object59416:head# 2024-02-10T08:39:12.598 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a872b900:::benchmark_data_smithi018_166993_object96631:head# 2024-02-10T08:39:12.608 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a87311f2:::benchmark_data_smithi018_166993_object31757:head# 2024-02-10T08:39:12.608 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a873fef4:::benchmark_data_smithi018_166993_object88622:head# 2024-02-10T08:39:12.609 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a876e5d6:::benchmark_data_smithi018_166993_object47755:head# 2024-02-10T08:39:12.609 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a877176a:::benchmark_data_smithi018_166993_object91175:head# 2024-02-10T08:39:12.609 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8775bf6:::benchmark_data_smithi018_166993_object114092:head# 2024-02-10T08:39:12.609 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a878beea:::benchmark_data_smithi018_166993_object105730:head# 2024-02-10T08:39:12.609 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8794879:::benchmark_data_smithi018_166993_object20449:head# 2024-02-10T08:39:12.609 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a87a5eff:::benchmark_data_smithi018_166993_object54117:head# 2024-02-10T08:39:12.609 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a87a6a2d:::benchmark_data_smithi018_166993_object114074:head# 2024-02-10T08:39:12.609 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a87b668b:::benchmark_data_smithi018_166993_object59170:head# 2024-02-10T08:39:12.609 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a87b9dec:::benchmark_data_smithi018_166993_object100968:head# 2024-02-10T08:39:12.609 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a87bc0f1:::benchmark_data_smithi018_166993_object35448:head# 2024-02-10T08:39:12.609 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a87bf96e:::benchmark_data_smithi018_166993_object93676:head# 2024-02-10T08:39:12.609 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a87c3ef8:::benchmark_data_smithi018_166993_object98366:head# 2024-02-10T08:39:12.609 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a87dd010:::benchmark_data_smithi018_166993_object117727:head# 2024-02-10T08:39:12.612 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a87de198:::benchmark_data_smithi018_166993_object75610:head# 2024-02-10T08:39:12.612 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a87e7c79:::benchmark_data_smithi018_166993_object19506:head# 2024-02-10T08:39:12.612 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a87ec012:::benchmark_data_smithi018_166993_object66440:head# 2024-02-10T08:39:12.612 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a87fbd54:::benchmark_data_smithi018_166993_object75791:head# 2024-02-10T08:39:12.612 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a87fd95e:::benchmark_data_smithi018_166993_object75249:head# 2024-02-10T08:39:12.612 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a88060f0:::benchmark_data_smithi018_166993_object33620:head# 2024-02-10T08:39:12.613 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a88104a7:::benchmark_data_smithi018_166993_object20510:head# 2024-02-10T08:39:12.613 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a88106cb:::benchmark_data_smithi018_166993_object18645:head# 2024-02-10T08:39:12.613 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a881cad5:::benchmark_data_smithi018_166993_object26091:head# 2024-02-10T08:39:12.618 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8826d54:::benchmark_data_smithi018_166993_object26131:head# 2024-02-10T08:39:12.618 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a88393c9:::benchmark_data_smithi018_166993_object91575:head# 2024-02-10T08:39:12.619 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a883b39f:::benchmark_data_smithi018_166993_object28015:head# 2024-02-10T08:39:12.619 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8843d5b:::benchmark_data_smithi018_166993_object51067:head# 2024-02-10T08:39:12.619 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a884c94d:::benchmark_data_smithi018_166993_object104613:head# 2024-02-10T08:39:12.620 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a886331f:::benchmark_data_smithi018_166993_object89728:head# 2024-02-10T08:39:12.620 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a886bdcf:::benchmark_data_smithi018_166993_object84309:head# 2024-02-10T08:39:12.621 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8870780:::benchmark_data_smithi018_166993_object74981:head# 2024-02-10T08:39:12.621 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a887b747:::benchmark_data_smithi018_166993_object101473:head# 2024-02-10T08:39:12.624 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a887dec2:::benchmark_data_smithi018_166993_object86711:head# 2024-02-10T08:39:12.625 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8884745:::benchmark_data_smithi018_166993_object87357:head# 2024-02-10T08:39:12.626 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8886db1:::benchmark_data_smithi018_166993_object31151:head# 2024-02-10T08:39:12.626 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a888adf9:::benchmark_data_smithi018_166993_object96424:head# 2024-02-10T08:39:12.628 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a888b410:::benchmark_data_smithi018_166993_object88951:head# 2024-02-10T08:39:12.630 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a88a857b:::benchmark_data_smithi018_166993_object29703:head# 2024-02-10T08:39:12.630 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a88ac9b8:::benchmark_data_smithi018_166993_object47912:head# 2024-02-10T08:39:12.630 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a88bc5a9:::benchmark_data_smithi018_166993_object93832:head# 2024-02-10T08:39:12.630 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a88bc5f0:::benchmark_data_smithi018_166993_object47882:head# 2024-02-10T08:39:12.630 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a88c382d:::benchmark_data_smithi018_166993_object79166:head# 2024-02-10T08:39:12.632 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a88d052e:::benchmark_data_smithi018_166993_object33183:head# 2024-02-10T08:39:12.632 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8901b33:::benchmark_data_smithi018_166993_object71492:head# 2024-02-10T08:39:12.632 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a89071de:::benchmark_data_smithi018_166993_object60728:head# 2024-02-10T08:39:12.632 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a890fdf1:::benchmark_data_smithi018_166993_object55051:head# 2024-02-10T08:39:12.632 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a89241df:::benchmark_data_smithi018_166993_object67844:head# 2024-02-10T08:39:12.633 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8925a1a:::benchmark_data_smithi018_166993_object51215:head# 2024-02-10T08:39:12.633 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8929dac:::benchmark_data_smithi018_166993_object89978:head# 2024-02-10T08:39:12.633 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a893b072:::benchmark_data_smithi018_166993_object45152:head# 2024-02-10T08:39:12.634 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a893c0c0:::benchmark_data_smithi018_166993_object107580:head# 2024-02-10T08:39:12.634 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a89524b0:::benchmark_data_smithi018_166993_object114555:head# 2024-02-10T08:39:12.637 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a896a3e7:::benchmark_data_smithi018_166993_object30734:head# 2024-02-10T08:39:12.637 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a896b4f8:::benchmark_data_smithi018_166993_object97866:head# 2024-02-10T08:39:12.637 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a896ebf1:::benchmark_data_smithi018_166993_object114659:head# 2024-02-10T08:39:12.637 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a896f4a0:::benchmark_data_smithi018_166993_object68435:head# 2024-02-10T08:39:12.637 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8976d3e:::benchmark_data_smithi018_166993_object56030:head# 2024-02-10T08:39:12.640 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a897a406:::benchmark_data_smithi018_166993_object51570:head# 2024-02-10T08:39:12.643 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a897a9c6:::benchmark_data_smithi018_166993_object103170:head# 2024-02-10T08:39:12.644 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a897f437:::benchmark_data_smithi018_166993_object74609:head# 2024-02-10T08:39:12.647 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a89af918:::benchmark_data_smithi018_166993_object88100:head# 2024-02-10T08:39:12.647 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a89b78d0:::benchmark_data_smithi018_166993_object26921:head# 2024-02-10T08:39:12.647 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a89b8a37:::benchmark_data_smithi018_166993_object77195:head# 2024-02-10T08:39:12.647 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a89d6a9e:::benchmark_data_smithi018_166993_object58589:head# 2024-02-10T08:39:12.649 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a89e946f:::benchmark_data_smithi018_166993_object85413:head# 2024-02-10T08:39:12.649 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a89eb753:::benchmark_data_smithi018_166993_object46401:head# 2024-02-10T08:39:12.649 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8a06078:::benchmark_data_smithi018_166993_object54301:head# 2024-02-10T08:39:12.650 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8a1334d:::benchmark_data_smithi018_166993_object95468:head# 2024-02-10T08:39:12.650 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8a18cc7:::benchmark_data_smithi018_166993_object94367:head# 2024-02-10T08:39:12.650 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8a2dbbc:::benchmark_data_smithi018_166993_object107981:head# 2024-02-10T08:39:12.650 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8a2dfbd:::benchmark_data_smithi018_166993_object39782:head# 2024-02-10T08:39:12.650 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8a4420e:::benchmark_data_smithi018_166993_object41554:head# 2024-02-10T08:39:12.651 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8a49189:::benchmark_data_smithi018_166993_object114821:head# 2024-02-10T08:39:12.651 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8a4c135:::benchmark_data_smithi018_166993_object116255:head# 2024-02-10T08:39:12.654 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8a56d52:::benchmark_data_smithi018_166993_object44270:head# 2024-02-10T08:39:12.655 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8a5c4f9:::benchmark_data_smithi018_166993_object52764:head# 2024-02-10T08:39:12.655 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8a609e0:::benchmark_data_smithi018_166993_object72801:head# 2024-02-10T08:39:12.656 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8a7642f:::benchmark_data_smithi018_166993_object61929:head# 2024-02-10T08:39:12.656 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8a845ca:::benchmark_data_smithi018_166993_object91237:head# 2024-02-10T08:39:12.657 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8a8a78d:::benchmark_data_smithi018_166993_object69548:head# 2024-02-10T08:39:12.657 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8a9a8e4:::benchmark_data_smithi018_166993_object92509:head# 2024-02-10T08:39:12.657 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8a9b846:::benchmark_data_smithi018_166993_object81327:head# 2024-02-10T08:39:12.659 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8a9dff6:::benchmark_data_smithi018_166993_object21945:head# 2024-02-10T08:39:12.659 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8aa3ce1:::benchmark_data_smithi018_166993_object28669:head# 2024-02-10T08:39:12.661 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8aa8462:::benchmark_data_smithi018_166993_object110548:head# 2024-02-10T08:39:12.662 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8ab10e0:::benchmark_data_smithi018_166993_object27906:head# 2024-02-10T08:39:12.663 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8abb6aa:::benchmark_data_smithi018_166993_object78368:head# 2024-02-10T08:39:12.665 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8ac2223:::benchmark_data_smithi018_166993_object28909:head# 2024-02-10T08:39:12.665 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8acc694:::benchmark_data_smithi018_166993_object45395:head# 2024-02-10T08:39:12.665 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8ad3d03:::benchmark_data_smithi018_166993_object116509:head# 2024-02-10T08:39:12.665 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8ad6432:::benchmark_data_smithi018_166993_object95678:head# 2024-02-10T08:39:12.665 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8ad79c0:::benchmark_data_smithi018_166993_object71052:head# 2024-02-10T08:39:12.666 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8adf817:::benchmark_data_smithi018_166993_object81303:head# 2024-02-10T08:39:12.666 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8ae0224:::benchmark_data_smithi018_166993_object96676:head# 2024-02-10T08:39:12.666 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8aebb58:::benchmark_data_smithi018_166993_object53288:head# 2024-02-10T08:39:12.667 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8afb52f:::benchmark_data_smithi018_166993_object47288:head# 2024-02-10T08:39:12.667 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8afdf8a:::benchmark_data_smithi018_166993_object116117:head# 2024-02-10T08:39:12.669 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8b00964:::benchmark_data_smithi018_166993_object68385:head# 2024-02-10T08:39:12.669 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8b0efea:::benchmark_data_smithi018_166993_object117165:head# 2024-02-10T08:39:12.670 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8b1cef8:::benchmark_data_smithi018_166993_object76993:head# 2024-02-10T08:39:12.670 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8b3b839:::benchmark_data_smithi018_166993_object38599:head# 2024-02-10T08:39:12.670 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8b40bf2:::benchmark_data_smithi018_166993_object107259:head# 2024-02-10T08:39:12.671 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8b42286:::benchmark_data_smithi018_166993_object106304:head# 2024-02-10T08:39:12.671 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8b42300:::benchmark_data_smithi018_166993_object41466:head# 2024-02-10T08:39:12.672 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8b509bb:::benchmark_data_smithi018_166993_object47789:head# 2024-02-10T08:39:12.673 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8b53ee3:::benchmark_data_smithi018_166993_object53658:head# 2024-02-10T08:39:12.673 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8b64ac2:::benchmark_data_smithi018_166993_object110348:head# 2024-02-10T08:39:12.674 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8b6a4c3:::benchmark_data_smithi018_166993_object42270:head# 2024-02-10T08:39:12.674 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8b7bf5a:::benchmark_data_smithi018_166993_object46144:head# 2024-02-10T08:39:12.674 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8b803cf:::benchmark_data_smithi018_166993_object80413:head# 2024-02-10T08:39:12.675 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8b91445:::benchmark_data_smithi018_166993_object97259:head# 2024-02-10T08:39:12.676 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8b99289:::benchmark_data_smithi018_166993_object96621:head# 2024-02-10T08:39:12.676 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8b9f192:::benchmark_data_smithi018_166993_object101612:head# 2024-02-10T08:39:12.676 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8ba3f0b:::benchmark_data_smithi018_166993_object78027:head# 2024-02-10T08:39:12.677 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8bba7e5:::benchmark_data_smithi018_166993_object28396:head# 2024-02-10T08:39:12.678 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8bbe183:::benchmark_data_smithi018_166993_object93994:head# 2024-02-10T08:39:12.678 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8bc6562:::benchmark_data_smithi018_166993_object116372:head# 2024-02-10T08:39:12.678 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8bca14f:::benchmark_data_smithi018_166993_object28316:head# 2024-02-10T08:39:12.678 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8be223a:::benchmark_data_smithi018_166993_object20434:head# 2024-02-10T08:39:12.679 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8be25c1:::benchmark_data_smithi018_166993_object48800:head# 2024-02-10T08:39:12.679 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8be521c:::benchmark_data_smithi018_166993_object74892:head# 2024-02-10T08:39:12.680 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8be6fc5:::benchmark_data_smithi018_166993_object69337:head# 2024-02-10T08:39:12.680 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8be7baa:::benchmark_data_smithi018_166993_object30229:head# 2024-02-10T08:39:12.681 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8bfa6c8:::benchmark_data_smithi018_166993_object76473:head# 2024-02-10T08:39:12.682 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8bfd26e:::benchmark_data_smithi018_166993_object39355:head# 2024-02-10T08:39:12.682 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8c08ecb:::benchmark_data_smithi018_166993_object37635:head# 2024-02-10T08:39:12.683 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8c10f37:::benchmark_data_smithi018_166993_object23319:head# 2024-02-10T08:39:12.683 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8c13926:::benchmark_data_smithi018_166993_object82919:head# 2024-02-10T08:39:12.684 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8c4622a:::benchmark_data_smithi018_166993_object24212:head# 2024-02-10T08:39:12.685 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8c52398:::benchmark_data_smithi018_166993_object26486:head# 2024-02-10T08:39:12.685 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8c55f72:::benchmark_data_smithi018_166993_object117541:head# 2024-02-10T08:39:12.685 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8c57a1d:::benchmark_data_smithi018_166993_object34687:head# 2024-02-10T08:39:12.686 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8c5e3d2:::benchmark_data_smithi018_166993_object26123:head# 2024-02-10T08:39:12.686 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8c64dd8:::benchmark_data_smithi018_166993_object77366:head# 2024-02-10T08:39:12.688 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8c6754d:::benchmark_data_smithi018_166993_object49740:head# 2024-02-10T08:39:12.688 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8c6d7d5:::benchmark_data_smithi018_166993_object48480:head# 2024-02-10T08:39:12.688 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8c706c3:::benchmark_data_smithi018_166993_object55425:head# 2024-02-10T08:39:12.689 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8c73a18:::benchmark_data_smithi018_166993_object61755:head# 2024-02-10T08:39:12.689 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8c77fb6:::benchmark_data_smithi018_166993_object42225:head# 2024-02-10T08:39:12.689 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8c7cf7b:::benchmark_data_smithi018_166993_object84462:head# 2024-02-10T08:39:12.689 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8c7f364:::benchmark_data_smithi018_166993_object88264:head# 2024-02-10T08:39:12.690 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8c832c5:::benchmark_data_smithi018_166993_object35149:head# 2024-02-10T08:39:12.691 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8c87b53:::benchmark_data_smithi018_166993_object73363:head# 2024-02-10T08:39:12.691 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8c8e4bf:::benchmark_data_smithi018_166993_object59356:head# 2024-02-10T08:39:12.692 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8c90dfd:::benchmark_data_smithi018_166993_object72070:head# 2024-02-10T08:39:12.692 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8c99f05:::benchmark_data_smithi018_166993_object112257:head# 2024-02-10T08:39:12.692 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8c9eea4:::benchmark_data_smithi018_166993_object98109:head# 2024-02-10T08:39:12.693 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8ca55cb:::benchmark_data_smithi018_166993_object62392:head# 2024-02-10T08:39:12.693 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8cc259f:::benchmark_data_smithi018_166993_object27969:head# 2024-02-10T08:39:12.694 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.1 dump_ops_in_flight 2024-02-10T08:39:12.695 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8cd3b4f:::benchmark_data_smithi018_166993_object89829:head# 2024-02-10T08:39:12.696 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8ce7c7d:::benchmark_data_smithi018_166993_object69285:head# 2024-02-10T08:39:12.696 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8cf0afa:::benchmark_data_smithi018_166993_object75399:head# 2024-02-10T08:39:12.696 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8cf59da:::benchmark_data_smithi018_166993_object84920:head# 2024-02-10T08:39:12.697 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8d0872b:::benchmark_data_smithi018_166993_object20454:head# 2024-02-10T08:39:12.697 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8d123bb:::benchmark_data_smithi018_166993_object82029:head# 2024-02-10T08:39:12.697 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8d179b5:::benchmark_data_smithi018_166993_object88821:head# 2024-02-10T08:39:12.698 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8d1e8e3:::benchmark_data_smithi018_166993_object89219:head# 2024-02-10T08:39:12.698 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8d2655b:::benchmark_data_smithi018_166993_object29845:head# 2024-02-10T08:39:12.699 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8d2cc8e:::benchmark_data_smithi018_166993_object77741:head# 2024-02-10T08:39:12.699 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8d3791e:::benchmark_data_smithi018_166993_object110769:head# 2024-02-10T08:39:12.699 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8d5e6aa:::benchmark_data_smithi018_166993_object82038:head# 2024-02-10T08:39:12.699 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8d6be1c:::benchmark_data_smithi018_166993_object82012:head# 2024-02-10T08:39:12.700 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8d7450c:::benchmark_data_smithi018_166993_object99838:head# 2024-02-10T08:39:12.700 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8d75b5d:::benchmark_data_smithi018_166993_object75253:head# 2024-02-10T08:39:12.701 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8d7c5da:::benchmark_data_smithi018_166993_object106617:head# 2024-02-10T08:39:12.701 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8d7cde5:::benchmark_data_smithi018_166993_object41527:head# 2024-02-10T08:39:12.702 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8d83eae:::benchmark_data_smithi018_166993_object42588:head# 2024-02-10T08:39:12.702 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8d8690d:::benchmark_data_smithi018_166993_object34895:head# 2024-02-10T08:39:12.702 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8da51a2:::benchmark_data_smithi018_166993_object81101:head# 2024-02-10T08:39:12.703 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8db242a:::benchmark_data_smithi018_166993_object112526:head# 2024-02-10T08:39:12.703 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8dbb003:::benchmark_data_smithi018_166993_object76845:head# 2024-02-10T08:39:12.705 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8dbc567:::benchmark_data_smithi018_166993_object82339:head# 2024-02-10T08:39:12.707 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8dc25bc:::benchmark_data_smithi018_166993_object86455:head# 2024-02-10T08:39:12.708 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8dc9e5b:::benchmark_data_smithi018_166993_object48131:head# 2024-02-10T08:39:12.708 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8dd377e:::benchmark_data_smithi018_166993_object97037:head# 2024-02-10T08:39:12.709 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8dd4acc:::benchmark_data_smithi018_166993_object117236:head# 2024-02-10T08:39:12.709 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8ddb59d:::benchmark_data_smithi018_166993_object27004:head# 2024-02-10T08:39:12.712 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8de0844:::benchmark_data_smithi018_166993_object36108:head# 2024-02-10T08:39:12.712 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8deab8f:::benchmark_data_smithi018_166993_object116008:head# 2024-02-10T08:39:12.712 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8dfe224:::benchmark_data_smithi018_166993_object107117:head# 2024-02-10T08:39:12.713 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8e03cdf:::benchmark_data_smithi018_166993_object26891:head# 2024-02-10T08:39:12.713 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8e08aac:::benchmark_data_smithi018_166993_object71649:head# 2024-02-10T08:39:12.714 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8e09ade:::benchmark_data_smithi018_166993_object28788:head# 2024-02-10T08:39:12.714 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8e288b5:::benchmark_data_smithi018_166993_object56380:head# 2024-02-10T08:39:12.714 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8e2fcf9:::benchmark_data_smithi018_166993_object29859:head# 2024-02-10T08:39:12.717 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8e30dca:::benchmark_data_smithi018_166993_object65444:head# 2024-02-10T08:39:12.717 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8e4b0f0:::benchmark_data_smithi018_166993_object46217:head# 2024-02-10T08:39:12.718 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8e51d1a:::benchmark_data_smithi018_166993_object101967:head# 2024-02-10T08:39:12.718 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8e58f95:::benchmark_data_smithi018_166993_object102130:head# 2024-02-10T08:39:12.719 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8e63141:::benchmark_data_smithi018_166993_object22053:head# 2024-02-10T08:39:12.722 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8e64d91:::benchmark_data_smithi018_166993_object99094:head# 2024-02-10T08:39:12.722 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8e6e66f:::benchmark_data_smithi018_166993_object84581:head# 2024-02-10T08:39:12.722 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8e703d1:::benchmark_data_smithi018_166993_object42892:head# 2024-02-10T08:39:12.723 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8e73ae9:::benchmark_data_smithi018_166993_object71926:head# 2024-02-10T08:39:12.723 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8e74b07:::benchmark_data_smithi018_166993_object42656:head# 2024-02-10T08:39:12.729 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8e7e52d:::benchmark_data_smithi018_166993_object115600:head# 2024-02-10T08:39:12.731 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8e7f6b9:::benchmark_data_smithi018_166993_object59244:head# 2024-02-10T08:39:12.732 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8e8a1af:::benchmark_data_smithi018_166993_object74400:head# 2024-02-10T08:39:12.732 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8e94bcc:::benchmark_data_smithi018_166993_object40158:head# 2024-02-10T08:39:12.732 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8eb009e:::benchmark_data_smithi018_166993_object43482:head# 2024-02-10T08:39:12.733 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8ebf625:::benchmark_data_smithi018_166993_object57740:head# 2024-02-10T08:39:12.733 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8eccf44:::benchmark_data_smithi018_166993_object83446:head# 2024-02-10T08:39:12.739 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8eceefd:::benchmark_data_smithi018_166993_object37210:head# 2024-02-10T08:39:12.739 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8ef1d35:::benchmark_data_smithi018_166993_object101876:head# 2024-02-10T08:39:12.739 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8ef1ebf:::benchmark_data_smithi018_166993_object75131:head# 2024-02-10T08:39:12.742 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8ef3428:::benchmark_data_smithi018_166993_object83342:head# 2024-02-10T08:39:12.742 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8f142ad:::benchmark_data_smithi018_166993_object104034:head# 2024-02-10T08:39:12.743 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8f48254:::benchmark_data_smithi018_166993_object104041:head# 2024-02-10T08:39:12.743 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8f519a9:::benchmark_data_smithi018_166993_object48162:head# 2024-02-10T08:39:12.744 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8f52670:::benchmark_data_smithi018_166993_object25571:head# 2024-02-10T08:39:12.744 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8f5fbb8:::benchmark_data_smithi018_166993_object43720:head# 2024-02-10T08:39:12.751 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8f9234f:::benchmark_data_smithi018_166993_object78794:head# 2024-02-10T08:39:12.751 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8f9a835:::benchmark_data_smithi018_166993_object23295:head# 2024-02-10T08:39:12.752 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8f9ca1e:::benchmark_data_smithi018_166993_object108727:head# 2024-02-10T08:39:12.752 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8f9d111:::benchmark_data_smithi018_166993_object43644:head# 2024-02-10T08:39:12.753 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8fa59e9:::benchmark_data_smithi018_166993_object19930:head# 2024-02-10T08:39:12.755 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8fa830c:::benchmark_data_smithi018_166993_object30594:head# 2024-02-10T08:39:12.755 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8fbcb18:::benchmark_data_smithi018_166993_object87943:head# 2024-02-10T08:39:12.755 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8fd56cd:::benchmark_data_smithi018_166993_object80771:head# 2024-02-10T08:39:12.756 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8fd93c7:::benchmark_data_smithi018_166993_object75500:head# 2024-02-10T08:39:12.756 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8fe56b8:::benchmark_data_smithi018_166993_object106597:head# 2024-02-10T08:39:12.757 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8ff5ac7:::benchmark_data_smithi018_166993_object113073:head# 2024-02-10T08:39:12.758 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8ff9d9f:::benchmark_data_smithi018_166993_object21493:head# 2024-02-10T08:39:12.758 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8ffd394:::benchmark_data_smithi018_166993_object63054:head# 2024-02-10T08:39:12.759 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a8ffe890:::benchmark_data_smithi018_166993_object28878:head# 2024-02-10T08:39:12.759 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9007982:::benchmark_data_smithi018_166993_object111003:head# 2024-02-10T08:39:12.759 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9013c47:::benchmark_data_smithi018_166993_object20156:head# 2024-02-10T08:39:12.760 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a901c170:::benchmark_data_smithi018_166993_object94561:head# 2024-02-10T08:39:12.760 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a901f5ee:::benchmark_data_smithi018_166993_object49470:head# 2024-02-10T08:39:12.761 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9020a50:::benchmark_data_smithi018_166993_object64705:head# 2024-02-10T08:39:12.761 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a90427d6:::benchmark_data_smithi018_166993_object54608:head# 2024-02-10T08:39:12.762 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a904bb99:::benchmark_data_smithi018_166993_object86727:head# 2024-02-10T08:39:12.762 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9063553:::benchmark_data_smithi018_166993_object57323:head# 2024-02-10T08:39:12.763 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9065d20:::benchmark_data_smithi018_166993_object73809:head# 2024-02-10T08:39:12.763 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a906dba1:::benchmark_data_smithi018_166993_object38993:head# 2024-02-10T08:39:12.768 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9094a5f:::benchmark_data_smithi018_166993_object62816:head# 2024-02-10T08:39:12.770 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a909ccfa:::benchmark_data_smithi018_166993_object27161:head# 2024-02-10T08:39:12.770 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a90ad5ba:::benchmark_data_smithi018_166993_object50103:head# 2024-02-10T08:39:12.771 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a90af741:::benchmark_data_smithi018_166993_object101723:head# 2024-02-10T08:39:12.772 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a90b7106:::benchmark_data_smithi018_166993_object34381:head# 2024-02-10T08:39:12.773 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a90c24f0:::benchmark_data_smithi018_166993_object22610:head# 2024-02-10T08:39:12.773 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a90ce2ad:::benchmark_data_smithi018_166993_object58619:head# 2024-02-10T08:39:12.774 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a90ea237:::benchmark_data_smithi018_166993_object109041:head# 2024-02-10T08:39:12.774 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a90f6cda:::benchmark_data_smithi018_166993_object113866:head# 2024-02-10T08:39:12.775 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9105954:::benchmark_data_smithi018_166993_object115907:head# 2024-02-10T08:39:12.777 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a910e8ea:::benchmark_data_smithi018_166993_object41376:head# 2024-02-10T08:39:12.778 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a910fb23:::benchmark_data_smithi018_166993_object110443:head# 2024-02-10T08:39:12.780 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a911939c:::benchmark_data_smithi018_166993_object53849:head# 2024-02-10T08:39:12.780 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a913a014:::benchmark_data_smithi018_166993_object102307:head# 2024-02-10T08:39:12.780 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a913ab0e:::benchmark_data_smithi018_166993_object36695:head# 2024-02-10T08:39:12.782 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9149bcd:::benchmark_data_smithi018_166993_object112086:head# 2024-02-10T08:39:12.782 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a914b85a:::benchmark_data_smithi018_166993_object50582:head# 2024-02-10T08:39:12.787 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9159c5d:::benchmark_data_smithi018_166993_object115153:head# 2024-02-10T08:39:12.787 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a915eea4:::benchmark_data_smithi018_166993_object60012:head# 2024-02-10T08:39:12.787 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9166920:::benchmark_data_smithi018_166993_object65511:head# 2024-02-10T08:39:12.788 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9174480:::benchmark_data_smithi018_166993_object18660:head# 2024-02-10T08:39:12.788 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a91828a6:::benchmark_data_smithi018_166993_object82322:head# 2024-02-10T08:39:12.788 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a918626b:::benchmark_data_smithi018_166993_object52351:head# 2024-02-10T08:39:12.788 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a918fcbe:::benchmark_data_smithi018_166993_object64524:head# 2024-02-10T08:39:12.788 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a919542c:::benchmark_data_smithi018_166993_object111236:head# 2024-02-10T08:39:12.788 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a91af482:::benchmark_data_smithi018_166993_object24612:head# 2024-02-10T08:39:12.792 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a91b011c:::benchmark_data_smithi018_166993_object85390:head# 2024-02-10T08:39:12.792 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a91b3c92:::benchmark_data_smithi018_166993_object28352:head# 2024-02-10T08:39:12.792 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a91b935c:::benchmark_data_smithi018_166993_object88393:head# 2024-02-10T08:39:12.792 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a91c9a28:::benchmark_data_smithi018_166993_object25617:head# 2024-02-10T08:39:12.792 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a91d25b6:::benchmark_data_smithi018_166993_object25784:head# 2024-02-10T08:39:12.792 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a91f47bc:::benchmark_data_smithi018_166993_object101853:head# 2024-02-10T08:39:12.793 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a920da9e:::benchmark_data_smithi018_166993_object25498:head# 2024-02-10T08:39:12.794 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a920ef5d:::benchmark_data_smithi018_166993_object52408:head# 2024-02-10T08:39:12.794 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a921212a:::benchmark_data_smithi018_166993_object51145:head# 2024-02-10T08:39:12.795 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a921b6e9:::benchmark_data_smithi018_166993_object45950:head# 2024-02-10T08:39:12.795 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a921eea2:::benchmark_data_smithi018_166993_object104159:head# 2024-02-10T08:39:12.795 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a922cdc3:::benchmark_data_smithi018_166993_object80621:head# 2024-02-10T08:39:12.796 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a922ffbd:::benchmark_data_smithi018_166993_object33233:head# 2024-02-10T08:39:12.796 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a92408d6:::benchmark_data_smithi018_166993_object93586:head# 2024-02-10T08:39:12.799 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9248e84:::benchmark_data_smithi018_166993_object82528:head# 2024-02-10T08:39:12.799 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a925607d:::benchmark_data_smithi018_166993_object79554:head# 2024-02-10T08:39:12.802 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a92592fc:::benchmark_data_smithi018_166993_object55053:head# 2024-02-10T08:39:12.802 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a925d656:::benchmark_data_smithi018_166993_object108071:head# 2024-02-10T08:39:12.802 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9265f6c:::benchmark_data_smithi018_166993_object39301:head# 2024-02-10T08:39:12.802 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9266d46:::benchmark_data_smithi018_166993_object76477:head# 2024-02-10T08:39:12.802 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9284ad9:::benchmark_data_smithi018_166993_object60188:head# 2024-02-10T08:39:12.802 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9284b3d:::benchmark_data_smithi018_166993_object90538:head# 2024-02-10T08:39:12.802 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a929cd73:::benchmark_data_smithi018_166993_object75827:head# 2024-02-10T08:39:12.805 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a92ac09c:::benchmark_data_smithi018_166993_object28141:head# 2024-02-10T08:39:12.805 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a92b9fa6:::benchmark_data_smithi018_166993_object32477:head# 2024-02-10T08:39:12.805 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a92bc125:::benchmark_data_smithi018_166993_object107152:head# 2024-02-10T08:39:12.805 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a92dcc6b:::benchmark_data_smithi018_166993_object36955:head# 2024-02-10T08:39:12.805 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a92df499:::benchmark_data_smithi018_166993_object85712:head# 2024-02-10T08:39:12.809 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a92e24fa:::benchmark_data_smithi018_166993_object55888:head# 2024-02-10T08:39:12.809 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a92f07c6:::benchmark_data_smithi018_166993_object106799:head# 2024-02-10T08:39:12.809 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a92fec2b:::benchmark_data_smithi018_166993_object48197:head# 2024-02-10T08:39:12.809 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a930254c:::benchmark_data_smithi018_166993_object33026:head# 2024-02-10T08:39:12.814 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9303740:::benchmark_data_smithi018_166993_object36644:head# 2024-02-10T08:39:12.814 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a93045c2:::benchmark_data_smithi018_166993_object92437:head# 2024-02-10T08:39:12.814 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a93056c4:::benchmark_data_smithi018_166993_object31312:head# 2024-02-10T08:39:12.814 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a93088e0:::benchmark_data_smithi018_166993_object25430:head# 2024-02-10T08:39:12.814 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9315b54:::benchmark_data_smithi018_166993_object57477:head# 2024-02-10T08:39:12.814 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9316a7e:::benchmark_data_smithi018_166993_object111233:head# 2024-02-10T08:39:12.816 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a931d7b1:::benchmark_data_smithi018_166993_object106650:head# 2024-02-10T08:39:12.816 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a932207d:::benchmark_data_smithi018_166993_object56527:head# 2024-02-10T08:39:12.817 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a93245e7:::benchmark_data_smithi018_166993_object82794:head# 2024-02-10T08:39:12.817 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a93345f6:::benchmark_data_smithi018_166993_object44528:head# 2024-02-10T08:39:12.817 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a933964c:::benchmark_data_smithi018_166993_object105751:head# 2024-02-10T08:39:12.818 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9343b73:::benchmark_data_smithi018_166993_object67130:head# 2024-02-10T08:39:12.819 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9354cca:::benchmark_data_smithi018_166993_object23826:head# 2024-02-10T08:39:12.819 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a936688f:::benchmark_data_smithi018_166993_object53656:head# 2024-02-10T08:39:12.822 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a936b382:::benchmark_data_smithi018_166993_object39867:head# 2024-02-10T08:39:12.823 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9396d7d:::benchmark_data_smithi018_166993_object57245:head# 2024-02-10T08:39:12.823 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a93a3c01:::benchmark_data_smithi018_166993_object111611:head# 2024-02-10T08:39:12.824 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a93a4096:::benchmark_data_smithi018_166993_object48548:head# 2024-02-10T08:39:12.824 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a93b9acc:::benchmark_data_smithi018_166993_object116409:head# 2024-02-10T08:39:12.825 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a93bb80f:::benchmark_data_smithi018_166993_object117814:head# 2024-02-10T08:39:12.825 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a93c19b6:::benchmark_data_smithi018_166993_object78836:head# 2024-02-10T08:39:12.826 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a93c2cfb:::benchmark_data_smithi018_166993_object48342:head# 2024-02-10T08:39:12.826 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a93ce88d:::benchmark_data_smithi018_166993_object78737:head# 2024-02-10T08:39:12.827 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a93d6650:::benchmark_data_smithi018_166993_object36829:head# 2024-02-10T08:39:12.830 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a93d76d8:::benchmark_data_smithi018_166993_object110378:head# 2024-02-10T08:39:12.830 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a93ddc55:::benchmark_data_smithi018_166993_object35969:head# 2024-02-10T08:39:12.834 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a93df456:::benchmark_data_smithi018_166993_object118759:head# 2024-02-10T08:39:12.834 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a93e1b6b:::benchmark_data_smithi018_166993_object70325:head# 2024-02-10T08:39:12.834 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a93e2ef6:::benchmark_data_smithi018_166993_object23068:head# 2024-02-10T08:39:12.834 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a93e8046:::benchmark_data_smithi018_166993_object22539:head# 2024-02-10T08:39:12.834 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a93f45f9:::benchmark_data_smithi018_166993_object48542:head# 2024-02-10T08:39:12.834 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a93f6de1:::benchmark_data_smithi018_166993_object110979:head# 2024-02-10T08:39:12.834 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a93f88a8:::benchmark_data_smithi018_166993_object17475:head# 2024-02-10T08:39:12.834 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9407c45:::benchmark_data_smithi018_166993_object76956:head# 2024-02-10T08:39:12.834 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a94105a0:::benchmark_data_smithi018_166993_object84307:head# 2024-02-10T08:39:12.835 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9410b75:::benchmark_data_smithi018_166993_object22099:head# 2024-02-10T08:39:12.835 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a942190d:::benchmark_data_smithi018_166993_object78190:head# 2024-02-10T08:39:12.837 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9422fa6:::benchmark_data_smithi018_166993_object38760:head# 2024-02-10T08:39:12.839 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a944d0b6:::benchmark_data_smithi018_166993_object71654:head# 2024-02-10T08:39:12.842 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a944f9e0:::benchmark_data_smithi018_166993_object54813:head# 2024-02-10T08:39:12.845 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a945815c:::benchmark_data_smithi018_166993_object29181:head# 2024-02-10T08:39:12.845 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9458c11:::benchmark_data_smithi018_166993_object66119:head# 2024-02-10T08:39:12.845 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9464dd0:::benchmark_data_smithi018_166993_object75569:head# 2024-02-10T08:39:12.846 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9469faf:::benchmark_data_smithi018_166993_object49047:head# 2024-02-10T08:39:12.846 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a94701b8:::benchmark_data_smithi018_166993_object115122:head# 2024-02-10T08:39:12.847 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a94866b9:::benchmark_data_smithi018_166993_object44558:head# 2024-02-10T08:39:12.848 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9490251:::benchmark_data_smithi018_166993_object26046:head# 2024-02-10T08:39:12.848 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9490df5:::benchmark_data_smithi018_166993_object62562:head# 2024-02-10T08:39:12.850 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a949873e:::benchmark_data_smithi018_166993_object28702:head# 2024-02-10T08:39:12.851 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a94a031c:::benchmark_data_smithi018_166993_object95513:head# 2024-02-10T08:39:12.851 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a94aacd2:::benchmark_data_smithi018_166993_object82738:head# 2024-02-10T08:39:12.854 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a94b0923:::benchmark_data_smithi018_166993_object67944:head# 2024-02-10T08:39:12.854 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a94b75e1:::benchmark_data_smithi018_166993_object41677:head# 2024-02-10T08:39:12.854 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a94c6a78:::benchmark_data_smithi018_166993_object99086:head# 2024-02-10T08:39:12.854 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a94c6e5d:::benchmark_data_smithi018_166993_object64767:head# 2024-02-10T08:39:12.854 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a94d563c:::benchmark_data_smithi018_166993_object68184:head# 2024-02-10T08:39:12.855 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a94dbd45:::benchmark_data_smithi018_166993_object118522:head# 2024-02-10T08:39:12.857 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a94e7f3e:::benchmark_data_smithi018_166993_object96129:head# 2024-02-10T08:39:12.857 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9501b21:::benchmark_data_smithi018_166993_object53237:head# 2024-02-10T08:39:12.857 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9504872:::benchmark_data_smithi018_166993_object75118:head# 2024-02-10T08:39:12.857 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a950628c:::benchmark_data_smithi018_166993_object38765:head# 2024-02-10T08:39:12.857 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9508ade:::benchmark_data_smithi018_166993_object92059:head# 2024-02-10T08:39:12.857 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9509592:::benchmark_data_smithi018_166993_object68465:head# 2024-02-10T08:39:12.857 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a952c564:::benchmark_data_smithi018_166993_object102146:head# 2024-02-10T08:39:12.860 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a952f8b2:::benchmark_data_smithi018_166993_object65283:head# 2024-02-10T08:39:12.860 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9534ae3:::benchmark_data_smithi018_166993_object81774:head# 2024-02-10T08:39:12.862 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a953cb9a:::benchmark_data_smithi018_166993_object117330:head# 2024-02-10T08:39:12.862 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a953f7e8:::benchmark_data_smithi018_166993_object103311:head# 2024-02-10T08:39:12.862 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9540aab:::benchmark_data_smithi018_166993_object22609:head# 2024-02-10T08:39:12.862 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9545a2c:::benchmark_data_smithi018_166993_object54376:head# 2024-02-10T08:39:12.863 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9548ad3:::benchmark_data_smithi018_166993_object22417:head# 2024-02-10T08:39:12.863 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a954b4d4:::benchmark_data_smithi018_166993_object78687:head# 2024-02-10T08:39:12.863 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9573551:::benchmark_data_smithi018_166993_object48641:head# 2024-02-10T08:39:12.863 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9578c53:::benchmark_data_smithi018_166993_object74066:head# 2024-02-10T08:39:12.863 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9582bcd:::benchmark_data_smithi018_166993_object117632:head# 2024-02-10T08:39:12.864 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a958ff1c:::benchmark_data_smithi018_166993_object84143:head# 2024-02-10T08:39:12.869 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9591bde:::benchmark_data_smithi018_166993_object69635:head# 2024-02-10T08:39:12.869 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9593b63:::benchmark_data_smithi018_166993_object107695:head# 2024-02-10T08:39:12.869 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a959d562:::benchmark_data_smithi018_166993_object113193:head# 2024-02-10T08:39:12.869 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a959da3d:::benchmark_data_smithi018_166993_object38217:head# 2024-02-10T08:39:12.869 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a95a408a:::benchmark_data_smithi018_166993_object64778:head# 2024-02-10T08:39:12.869 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a95a53c5:::benchmark_data_smithi018_166993_object48743:head# 2024-02-10T08:39:12.869 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a95ad30e:::benchmark_data_smithi018_166993_object61022:head# 2024-02-10T08:39:12.869 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a95bf09f:::benchmark_data_smithi018_166993_object42725:head# 2024-02-10T08:39:12.869 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a95cfc4d:::benchmark_data_smithi018_166993_object115177:head# 2024-02-10T08:39:12.869 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a95f01a7:::benchmark_data_smithi018_166993_object95747:head# 2024-02-10T08:39:12.870 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a95f01e9:::benchmark_data_smithi018_166993_object88944:head# 2024-02-10T08:39:12.875 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9616d31:::benchmark_data_smithi018_166993_object31256:head# 2024-02-10T08:39:12.875 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a96187fb:::benchmark_data_smithi018_166993_object36970:head# 2024-02-10T08:39:12.875 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9628ede:::benchmark_data_smithi018_166993_object92188:head# 2024-02-10T08:39:12.875 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9642ec0:::benchmark_data_smithi018_166993_object34098:head# 2024-02-10T08:39:12.875 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a964c107:::benchmark_data_smithi018_166993_object117890:head# 2024-02-10T08:39:12.875 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9650f0e:::benchmark_data_smithi018_166993_object115383:head# 2024-02-10T08:39:12.876 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9655e07:::benchmark_data_smithi018_166993_object86548:head# 2024-02-10T08:39:12.876 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a96589d2:::benchmark_data_smithi018_166993_object56052:head# 2024-02-10T08:39:12.876 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a96610eb:::benchmark_data_smithi018_166993_object103179:head# 2024-02-10T08:39:12.876 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9662186:::benchmark_data_smithi018_166993_object28922:head# 2024-02-10T08:39:12.876 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9669242:::benchmark_data_smithi018_166993_object100959:head# 2024-02-10T08:39:12.876 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a96823f2:::benchmark_data_smithi018_166993_object83134:head# 2024-02-10T08:39:12.876 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9685468:::benchmark_data_smithi018_166993_object73019:head# 2024-02-10T08:39:12.877 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a968f19d:::benchmark_data_smithi018_166993_object89384:head# 2024-02-10T08:39:12.877 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a96971a7:::benchmark_data_smithi018_166993_object89353:head# 2024-02-10T08:39:12.877 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a96a2fb1:::benchmark_data_smithi018_166993_object110519:head# 2024-02-10T08:39:12.880 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a96a858a:::benchmark_data_smithi018_166993_object30107:head# 2024-02-10T08:39:12.880 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a96b6ec7:::benchmark_data_smithi018_166993_object108761:head# 2024-02-10T08:39:12.880 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a96f3096:::benchmark_data_smithi018_166993_object88192:head# 2024-02-10T08:39:12.882 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a96ff1ea:::benchmark_data_smithi018_166993_object76919:head# 2024-02-10T08:39:12.882 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9703a80:::benchmark_data_smithi018_166993_object112434:head# 2024-02-10T08:39:12.885 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a97071ee:::benchmark_data_smithi018_166993_object54827:head# 2024-02-10T08:39:12.886 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a971ce40:::benchmark_data_smithi018_166993_object32306:head# 2024-02-10T08:39:12.886 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a972a573:::benchmark_data_smithi018_166993_object45704:head# 2024-02-10T08:39:12.886 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a974f5ad:::benchmark_data_smithi018_166993_object47737:head# 2024-02-10T08:39:12.887 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a976b6eb:::benchmark_data_smithi018_166993_object98549:head# 2024-02-10T08:39:12.887 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a978161a:::benchmark_data_smithi018_166993_object108427:head# 2024-02-10T08:39:12.887 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9787d50:::benchmark_data_smithi018_166993_object75793:head# 2024-02-10T08:39:12.887 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a978e17a:::benchmark_data_smithi018_166993_object41905:head# 2024-02-10T08:39:12.890 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a978e938:::benchmark_data_smithi018_166993_object72493:head# 2024-02-10T08:39:12.890 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9794fea:::benchmark_data_smithi018_166993_object51848:head# 2024-02-10T08:39:12.890 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9797e6e:::benchmark_data_smithi018_166993_object100998:head# 2024-02-10T08:39:12.890 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a97a7632:::benchmark_data_smithi018_166993_object30356:head# 2024-02-10T08:39:12.890 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a97a8bdc:::benchmark_data_smithi018_166993_object64095:head# 2024-02-10T08:39:12.891 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a97b474a:::benchmark_data_smithi018_166993_object85608:head# 2024-02-10T08:39:12.891 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a97b74d4:::benchmark_data_smithi018_166993_object45259:head# 2024-02-10T08:39:12.891 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a97bfef4:::benchmark_data_smithi018_166993_object96547:head# 2024-02-10T08:39:12.891 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a97c7622:::benchmark_data_smithi018_166993_object97180:head# 2024-02-10T08:39:12.891 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a97c9f52:::benchmark_data_smithi018_166993_object85953:head# 2024-02-10T08:39:12.892 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a97cd3a5:::benchmark_data_smithi018_166993_object99790:head# 2024-02-10T08:39:12.898 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a97e13ef:::benchmark_data_smithi018_166993_object67401:head# 2024-02-10T08:39:12.898 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a97e6c41:::benchmark_data_smithi018_166993_object93859:head# 2024-02-10T08:39:12.898 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a97fd3c5:::benchmark_data_smithi018_166993_object22794:head# 2024-02-10T08:39:12.898 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9804f37:::benchmark_data_smithi018_166993_object90741:head# 2024-02-10T08:39:12.899 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a980ccb0:::benchmark_data_smithi018_166993_object63305:head# 2024-02-10T08:39:12.899 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a981ae78:::benchmark_data_smithi018_166993_object69631:head# 2024-02-10T08:39:12.899 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a981efa2:::benchmark_data_smithi018_166993_object61955:head# 2024-02-10T08:39:12.899 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a981f2de:::benchmark_data_smithi018_166993_object70544:head# 2024-02-10T08:39:12.903 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9827f47:::benchmark_data_smithi018_166993_object52729:head# 2024-02-10T08:39:12.905 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a982c2db:::benchmark_data_smithi018_166993_object92393:head# 2024-02-10T08:39:12.905 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a98386f6:::benchmark_data_smithi018_166993_object51002:head# 2024-02-10T08:39:12.907 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9839121:::benchmark_data_smithi018_166993_object65241:head# 2024-02-10T08:39:12.908 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a983a425:::benchmark_data_smithi018_166993_object85236:head# 2024-02-10T08:39:12.908 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a983afa5:::benchmark_data_smithi018_166993_object34397:head# 2024-02-10T08:39:12.911 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9842cf2:::benchmark_data_smithi018_166993_object103649:head# 2024-02-10T08:39:12.911 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a984dbd9:::benchmark_data_smithi018_166993_object35516:head# 2024-02-10T08:39:12.911 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9851989:::benchmark_data_smithi018_166993_object87286:head# 2024-02-10T08:39:12.911 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a98639ed:::benchmark_data_smithi018_166993_object45140:head# 2024-02-10T08:39:12.911 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a986bb98:::benchmark_data_smithi018_166993_object32479:head# 2024-02-10T08:39:12.911 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a986c3fe:::benchmark_data_smithi018_166993_object99690:head# 2024-02-10T08:39:12.911 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9871ef8:::benchmark_data_smithi018_166993_object27652:head# 2024-02-10T08:39:12.912 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9895e54:::benchmark_data_smithi018_166993_object109848:head# 2024-02-10T08:39:12.912 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9899236:::benchmark_data_smithi018_166993_object74253:head# 2024-02-10T08:39:12.915 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a98ab80e:::benchmark_data_smithi018_166993_object56027:head# 2024-02-10T08:39:12.915 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a98ad9c3:::benchmark_data_smithi018_166993_object32731:head# 2024-02-10T08:39:12.916 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a98b9287:::benchmark_data_smithi018_166993_object116789:head# 2024-02-10T08:39:12.916 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a98ba9c1:::benchmark_data_smithi018_166993_object34888:head# 2024-02-10T08:39:12.917 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a98bf2c8:::benchmark_data_smithi018_166993_object51505:head# 2024-02-10T08:39:12.917 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a98c4efd:::benchmark_data_smithi018_166993_object37415:head# 2024-02-10T08:39:12.918 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a98d0f4e:::benchmark_data_smithi018_166993_object40200:head# 2024-02-10T08:39:12.918 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a98f38bd:::benchmark_data_smithi018_166993_object21913:head# 2024-02-10T08:39:12.919 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a98fa65b:::benchmark_data_smithi018_166993_object19239:head# 2024-02-10T08:39:12.920 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a98fb1ba:::benchmark_data_smithi018_166993_object107323:head# 2024-02-10T08:39:12.920 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a98fe235:::benchmark_data_smithi018_166993_object89691:head# 2024-02-10T08:39:12.926 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a990d0b3:::benchmark_data_smithi018_166993_object55335:head# 2024-02-10T08:39:12.927 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a992f1b4:::benchmark_data_smithi018_166993_object36475:head# 2024-02-10T08:39:12.927 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9939023:::benchmark_data_smithi018_166993_object73661:head# 2024-02-10T08:39:12.927 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a993e23a:::benchmark_data_smithi018_166993_object115313:head# 2024-02-10T08:39:12.927 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9962d07:::benchmark_data_smithi018_166993_object60136:head# 2024-02-10T08:39:12.927 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9967386:::benchmark_data_smithi018_166993_object91088:head# 2024-02-10T08:39:12.935 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9973674:::benchmark_data_smithi018_166993_object85505:head# 2024-02-10T08:39:12.936 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9973ca4:::benchmark_data_smithi018_166993_object97135:head# 2024-02-10T08:39:12.937 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a998869b:::benchmark_data_smithi018_166993_object79287:head# 2024-02-10T08:39:12.943 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a998c71a:::benchmark_data_smithi018_166993_object73117:head# 2024-02-10T08:39:12.943 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a998c98b:::benchmark_data_smithi018_166993_object116315:head# 2024-02-10T08:39:12.947 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a999e1df:::benchmark_data_smithi018_166993_object43133:head# 2024-02-10T08:39:12.947 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a99b233a:::benchmark_data_smithi018_166993_object103054:head# 2024-02-10T08:39:12.948 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a99ba70d:::benchmark_data_smithi018_166993_object89583:head# 2024-02-10T08:39:12.949 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a99be3ae:::benchmark_data_smithi018_166993_object32550:head# 2024-02-10T08:39:12.949 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a99c1e72:::benchmark_data_smithi018_166993_object30264:head# 2024-02-10T08:39:12.951 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a99d178e:::benchmark_data_smithi018_166993_object55936:head# 2024-02-10T08:39:12.952 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a99e1c4b:::benchmark_data_smithi018_166993_object61420:head# 2024-02-10T08:39:12.952 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a99ea048:::benchmark_data_smithi018_166993_object63143:head# 2024-02-10T08:39:12.952 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a99ead2f:::benchmark_data_smithi018_166993_object80785:head# 2024-02-10T08:39:12.955 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a99eda19:::benchmark_data_smithi018_166993_object32873:head# 2024-02-10T08:39:12.957 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a99f23cd:::benchmark_data_smithi018_166993_object85783:head# 2024-02-10T08:39:12.957 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9a0c18d:::benchmark_data_smithi018_166993_object65303:head# 2024-02-10T08:39:12.958 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9a0da72:::benchmark_data_smithi018_166993_object27629:head# 2024-02-10T08:39:12.958 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9a1bafe:::benchmark_data_smithi018_166993_object102071:head# 2024-02-10T08:39:12.959 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9a21f06:::benchmark_data_smithi018_166993_object58657:head# 2024-02-10T08:39:12.960 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9a21f9e:::benchmark_data_smithi018_166993_object41573:head# 2024-02-10T08:39:12.963 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9a243d9:::benchmark_data_smithi018_166993_object58977:head# 2024-02-10T08:39:12.963 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9a4e17c:::benchmark_data_smithi018_166993_object20235:head# 2024-02-10T08:39:12.963 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9a51f51:::benchmark_data_smithi018_166993_object31731:head# 2024-02-10T08:39:12.964 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9a58755:::benchmark_data_smithi018_166993_object59931:head# 2024-02-10T08:39:12.964 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9a58cb1:::benchmark_data_smithi018_166993_object17922:head# 2024-02-10T08:39:12.964 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9a67399:::benchmark_data_smithi018_166993_object87328:head# 2024-02-10T08:39:12.965 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9a6c8a9:::benchmark_data_smithi018_166993_object88045:head# 2024-02-10T08:39:12.965 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9a738d2:::benchmark_data_smithi018_166993_object74879:head# 2024-02-10T08:39:12.967 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9a7a9d7:::benchmark_data_smithi018_166993_object87074:head# 2024-02-10T08:39:12.968 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9a9dd63:::benchmark_data_smithi018_166993_object66904:head# 2024-02-10T08:39:12.969 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9aa6fa7:::benchmark_data_smithi018_166993_object78455:head# 2024-02-10T08:39:12.972 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9ad3fc4:::benchmark_data_smithi018_166993_object98281:head# 2024-02-10T08:39:12.972 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9ada2f9:::benchmark_data_smithi018_166993_object90934:head# 2024-02-10T08:39:12.975 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9af258d:::benchmark_data_smithi018_166993_object83777:head# 2024-02-10T08:39:12.975 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9afbdbf:::benchmark_data_smithi018_166993_object111864:head# 2024-02-10T08:39:12.981 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9afc3b5:::benchmark_data_smithi018_166993_object78550:head# 2024-02-10T08:39:12.981 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9b02111:::benchmark_data_smithi018_166993_object110864:head# 2024-02-10T08:39:12.981 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9b17d87:::benchmark_data_smithi018_166993_object104603:head# 2024-02-10T08:39:12.982 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9b33702:::benchmark_data_smithi018_166993_object103641:head# 2024-02-10T08:39:12.982 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9b378c4:::benchmark_data_smithi018_166993_object34889:head# 2024-02-10T08:39:12.982 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9b3ffd5:::benchmark_data_smithi018_166993_object60794:head# 2024-02-10T08:39:12.982 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9b48635:::benchmark_data_smithi018_166993_object89931:head# 2024-02-10T08:39:12.982 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9b4d16f:::benchmark_data_smithi018_166993_object84483:head# 2024-02-10T08:39:12.982 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9b57e5f:::benchmark_data_smithi018_166993_object111202:head# 2024-02-10T08:39:12.982 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9b62e1b:::benchmark_data_smithi018_166993_object76914:head# 2024-02-10T08:39:12.982 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9b67c3a:::benchmark_data_smithi018_166993_object32113:head# 2024-02-10T08:39:12.982 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9b68564:::benchmark_data_smithi018_166993_object107646:head# 2024-02-10T08:39:12.983 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9b7a026:::benchmark_data_smithi018_166993_object114279:head# 2024-02-10T08:39:12.983 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9b7d88e:::benchmark_data_smithi018_166993_object47064:head# 2024-02-10T08:39:12.984 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9b8269e:::benchmark_data_smithi018_166993_object45473:head# 2024-02-10T08:39:12.984 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9b85d01:::benchmark_data_smithi018_166993_object113321:head# 2024-02-10T08:39:12.984 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9b9b9e1:::benchmark_data_smithi018_166993_object58051:head# 2024-02-10T08:39:12.985 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9b9c5d1:::benchmark_data_smithi018_166993_object93044:head# 2024-02-10T08:39:12.985 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9bb0f69:::benchmark_data_smithi018_166993_object97535:head# 2024-02-10T08:39:12.986 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9bb872f:::benchmark_data_smithi018_166993_object55932:head# 2024-02-10T08:39:12.987 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9bc31f2:::benchmark_data_smithi018_166993_object68676:head# 2024-02-10T08:39:12.990 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9bcce9a:::benchmark_data_smithi018_166993_object35113:head# 2024-02-10T08:39:12.990 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9be362e:::benchmark_data_smithi018_166993_object60791:head# 2024-02-10T08:39:12.991 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9be3edb:::benchmark_data_smithi018_166993_object115872:head# 2024-02-10T08:39:12.991 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9be4215:::benchmark_data_smithi018_166993_object114333:head# 2024-02-10T08:39:12.991 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9bf27f1:::benchmark_data_smithi018_166993_object104586:head# 2024-02-10T08:39:12.991 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9c0e8f9:::benchmark_data_smithi018_166993_object35644:head# 2024-02-10T08:39:12.991 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9c13eb0:::benchmark_data_smithi018_166993_object54918:head# 2024-02-10T08:39:12.992 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9c2c2d8:::benchmark_data_smithi018_166993_object107482:head# 2024-02-10T08:39:12.992 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9c3aa68:::benchmark_data_smithi018_166993_object65927:head# 2024-02-10T08:39:12.992 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9c43e34:::benchmark_data_smithi018_166993_object37962:head# 2024-02-10T08:39:12.993 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9c52903:::benchmark_data_smithi018_166993_object74122:head# 2024-02-10T08:39:12.993 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9c5480b:::benchmark_data_smithi018_166993_object58432:head# 2024-02-10T08:39:12.994 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9c5962c:::benchmark_data_smithi018_166993_object38891:head# 2024-02-10T08:39:12.995 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9c5e1df:::benchmark_data_smithi018_166993_object103393:head# 2024-02-10T08:39:12.996 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9c61339:::benchmark_data_smithi018_166993_object39544:head# 2024-02-10T08:39:12.996 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9c6d697:::benchmark_data_smithi018_166993_object76848:head# 2024-02-10T08:39:12.996 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9c76d1b:::benchmark_data_smithi018_166993_object39558:head# 2024-02-10T08:39:12.996 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9c77ca8:::benchmark_data_smithi018_166993_object69401:head# 2024-02-10T08:39:12.996 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9c8b6ab:::benchmark_data_smithi018_166993_object59666:head# 2024-02-10T08:39:12.996 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9c9be74:::benchmark_data_smithi018_166993_object68843:head# 2024-02-10T08:39:12.997 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9ca9980:::benchmark_data_smithi018_166993_object18500:head# 2024-02-10T08:39:12.997 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9cae703:::benchmark_data_smithi018_166993_object68111:head# 2024-02-10T08:39:12.998 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9cb1051:::benchmark_data_smithi018_166993_object97277:head# 2024-02-10T08:39:12.998 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9cb1af5:::benchmark_data_smithi018_166993_object93401:head# 2024-02-10T08:39:12.999 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9cb9708:::benchmark_data_smithi018_166993_object86808:head# 2024-02-10T08:39:12.999 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9cd7c99:::benchmark_data_smithi018_166993_object36626:head# 2024-02-10T08:39:13.000 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9cea8d1:::benchmark_data_smithi018_166993_object56762:head# 2024-02-10T08:39:13.001 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9ceae03:::benchmark_data_smithi018_166993_object85840:head# 2024-02-10T08:39:13.003 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9d0d8c7:::benchmark_data_smithi018_166993_object83626:head# 2024-02-10T08:39:13.004 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9d0e1ca:::benchmark_data_smithi018_166993_object108201:head# 2024-02-10T08:39:13.005 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9d15f6c:::benchmark_data_smithi018_166993_object99657:head# 2024-02-10T08:39:13.005 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9d1df4e:::benchmark_data_smithi018_166993_object46898:head# 2024-02-10T08:39:13.006 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9d1f17f:::benchmark_data_smithi018_166993_object26697:head# 2024-02-10T08:39:13.007 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9d21db2:::benchmark_data_smithi018_166993_object116444:head# 2024-02-10T08:39:13.008 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9d2b550:::benchmark_data_smithi018_166993_object87732:head# 2024-02-10T08:39:13.008 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9d3546f:::benchmark_data_smithi018_166993_object25908:head# 2024-02-10T08:39:13.009 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9d3a367:::benchmark_data_smithi018_166993_object111925:head# 2024-02-10T08:39:13.009 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9d3fe05:::benchmark_data_smithi018_166993_object72064:head# 2024-02-10T08:39:13.010 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9d44480:::benchmark_data_smithi018_166993_object97833:head# 2024-02-10T08:39:13.010 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9d4fd89:::benchmark_data_smithi018_166993_object94001:head# 2024-02-10T08:39:13.011 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9d5744b:::benchmark_data_smithi018_166993_object33096:head# 2024-02-10T08:39:13.012 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9d5a2e2:::benchmark_data_smithi018_166993_object42744:head# 2024-02-10T08:39:13.012 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9d61b8a:::benchmark_data_smithi018_166993_object83611:head# 2024-02-10T08:39:13.015 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9d6cbb2:::benchmark_data_smithi018_166993_object51433:head# 2024-02-10T08:39:13.015 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9d6e9c9:::benchmark_data_smithi018_166993_object83356:head# 2024-02-10T08:39:13.015 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9d9293d:::benchmark_data_smithi018_166993_object47712:head# 2024-02-10T08:39:13.016 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9d9bd52:::benchmark_data_smithi018_166993_object35398:head# 2024-02-10T08:39:13.016 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9da8674:::benchmark_data_smithi018_166993_object65054:head# 2024-02-10T08:39:13.017 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9dac983:::benchmark_data_smithi018_166993_object118663:head# 2024-02-10T08:39:13.020 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9dbcc60:::benchmark_data_smithi018_166993_object20500:head# 2024-02-10T08:39:13.020 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9dbedfe:::benchmark_data_smithi018_166993_object42185:head# 2024-02-10T08:39:13.020 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9dc00c2:::benchmark_data_smithi018_166993_object57868:head# 2024-02-10T08:39:13.020 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9dc4ebf:::benchmark_data_smithi018_166993_object75326:head# 2024-02-10T08:39:13.020 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9dccea2:::benchmark_data_smithi018_166993_object88270:head# 2024-02-10T08:39:13.020 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9dcee60:::benchmark_data_smithi018_166993_object52232:head# 2024-02-10T08:39:13.020 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9ddae98:::benchmark_data_smithi018_166993_object111677:head# 2024-02-10T08:39:13.021 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9de39d8:::benchmark_data_smithi018_166993_object116236:head# 2024-02-10T08:39:13.021 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:39:13.022 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9dfe1cb:::benchmark_data_smithi018_166993_object95063:head# 2024-02-10T08:39:13.022 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9e0022b:::benchmark_data_smithi018_166993_object78168:head# 2024-02-10T08:39:13.022 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9e18fdb:::benchmark_data_smithi018_166993_object57618:head# 2024-02-10T08:39:13.023 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9e1924d:::benchmark_data_smithi018_166993_object20157:head# 2024-02-10T08:39:13.024 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9e1ac86:::benchmark_data_smithi018_166993_object89383:head# 2024-02-10T08:39:13.024 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9e2bf4f:::benchmark_data_smithi018_166993_object107550:head# 2024-02-10T08:39:13.025 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9e398fd:::benchmark_data_smithi018_166993_object100961:head# 2024-02-10T08:39:13.025 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9e43e7c:::benchmark_data_smithi018_166993_object80045:head# 2024-02-10T08:39:13.025 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:13.026 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:39:13.026 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:39:11.150876+0000 mgr.y (mgr.14505) 841 : cluster [DBG] pgmap v1032: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 5 active+undersized+degraded+remapped+backfilling, 172 active+clean; 5.1 GiB data, 19 GiB used, 606 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 962 op/s; 26343/251562 objects degraded (10.472%); 13 MiB/s, 211 objects/s recovering 2024-02-10T08:39:13.027 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9e53dd3:::benchmark_data_smithi018_166993_object84430:head# 2024-02-10T08:39:13.027 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9e5df2b:::benchmark_data_smithi018_166993_object90986:head# 2024-02-10T08:39:13.027 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9e62b11:::benchmark_data_smithi018_166993_object46160:head# 2024-02-10T08:39:13.027 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9e674bd:::benchmark_data_smithi018_166993_object22985:head# 2024-02-10T08:39:13.028 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:39:11.150876+0000 mgr.y (mgr.14505) 841 : cluster [DBG] pgmap v1032: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 5 active+undersized+degraded+remapped+backfilling, 172 active+clean; 5.1 GiB data, 19 GiB used, 606 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 962 op/s; 26343/251562 objects degraded (10.472%); 13 MiB/s, 211 objects/s recovering 2024-02-10T08:39:13.029 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9e6c355:::benchmark_data_smithi018_166993_object90009:head# 2024-02-10T08:39:13.029 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9e6d296:::benchmark_data_smithi018_166993_object43542:head# 2024-02-10T08:39:13.029 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9e6fbc8:::benchmark_data_smithi018_166993_object71862:head# 2024-02-10T08:39:13.030 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9e77449:::benchmark_data_smithi018_166993_object35631:head# 2024-02-10T08:39:13.030 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9e8723d:::benchmark_data_smithi018_166993_object113032:head# 2024-02-10T08:39:13.030 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9e8aafe:::benchmark_data_smithi018_166993_object79781:head# 2024-02-10T08:39:13.031 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9eaa80b:::benchmark_data_smithi018_166993_object32394:head# 2024-02-10T08:39:13.031 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9eab218:::benchmark_data_smithi018_166993_object60510:head# 2024-02-10T08:39:13.032 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9eb90b9:::benchmark_data_smithi018_166993_object79984:head# 2024-02-10T08:39:13.035 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9eba004:::benchmark_data_smithi018_166993_object26076:head# 2024-02-10T08:39:13.036 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9eba50b:::benchmark_data_smithi018_166993_object94841:head# 2024-02-10T08:39:13.036 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9ec0b34:::benchmark_data_smithi018_166993_object52478:head# 2024-02-10T08:39:13.037 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9eed4e6:::benchmark_data_smithi018_166993_object108259:head# 2024-02-10T08:39:13.038 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9ef6b3c:::benchmark_data_smithi018_166993_object80614:head# 2024-02-10T08:39:13.038 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9f03030:::benchmark_data_smithi018_166993_object75240:head# 2024-02-10T08:39:13.038 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9f258e5:::benchmark_data_smithi018_166993_object84847:head# 2024-02-10T08:39:13.040 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9f27a26:::benchmark_data_smithi018_166993_object65254:head# 2024-02-10T08:39:13.041 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9f31949:::benchmark_data_smithi018_166993_object41535:head# 2024-02-10T08:39:13.041 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9f49890:::benchmark_data_smithi018_166993_object116947:head# 2024-02-10T08:39:13.044 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:39:11.150876+0000 mgr.y (mgr.14505) 841 : cluster [DBG] pgmap v1032: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 5 active+undersized+degraded+remapped+backfilling, 172 active+clean; 5.1 GiB data, 19 GiB used, 606 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 962 op/s; 26343/251562 objects degraded (10.472%); 13 MiB/s, 211 objects/s recovering 2024-02-10T08:39:13.044 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9f5053f:::benchmark_data_smithi018_166993_object46527:head# 2024-02-10T08:39:13.044 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9f5af58:::benchmark_data_smithi018_166993_object78094:head# 2024-02-10T08:39:13.045 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9f5d2c8:::benchmark_data_smithi018_166993_object43381:head# 2024-02-10T08:39:13.046 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9f7c50d:::benchmark_data_smithi018_166993_object108331:head# 2024-02-10T08:39:13.055 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9f7f3ac:::benchmark_data_smithi018_166993_object94407:head# 2024-02-10T08:39:13.057 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9f8103a:::benchmark_data_smithi018_166993_object101689:head# 2024-02-10T08:39:13.059 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9f86b07:::benchmark_data_smithi018_166993_object96220:head# 2024-02-10T08:39:13.061 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9f86d71:::benchmark_data_smithi018_166993_object92303:head# 2024-02-10T08:39:13.061 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9f920d6:::benchmark_data_smithi018_166993_object92930:head# 2024-02-10T08:39:13.061 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9facbe1:::benchmark_data_smithi018_166993_object42487:head# 2024-02-10T08:39:13.061 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9fafac0:::benchmark_data_smithi018_166993_object99875:head# 2024-02-10T08:39:13.062 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9fb03dd:::benchmark_data_smithi018_166993_object76115:head# 2024-02-10T08:39:13.064 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9fc72ba:::benchmark_data_smithi018_166993_object27325:head# 2024-02-10T08:39:13.067 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9fc78f5:::benchmark_data_smithi018_166993_object74678:head# 2024-02-10T08:39:13.067 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9fcf302:::benchmark_data_smithi018_166993_object22183:head# 2024-02-10T08:39:13.067 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9fdaa52:::benchmark_data_smithi018_166993_object84526:head# 2024-02-10T08:39:13.068 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:a9fe635a:::benchmark_data_smithi018_166993_object110809:head# 2024-02-10T08:39:13.070 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa01be89:::benchmark_data_smithi018_166993_object60474:head# 2024-02-10T08:39:13.070 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa035c1f:::benchmark_data_smithi018_166993_object100002:head# 2024-02-10T08:39:13.071 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa03bd26:::benchmark_data_smithi018_166993_object28096:head# 2024-02-10T08:39:13.071 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa045628:::benchmark_data_smithi018_166993_object35828:head# 2024-02-10T08:39:13.071 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa045f0c:::benchmark_data_smithi018_166993_object86880:head# 2024-02-10T08:39:13.071 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa046b37:::benchmark_data_smithi018_166993_object75955:head# 2024-02-10T08:39:13.072 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa05f2c8:::benchmark_data_smithi018_166993_object106118:head# 2024-02-10T08:39:13.072 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa0667ab:::benchmark_data_smithi018_166993_object103377:head# 2024-02-10T08:39:13.073 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa077772:::benchmark_data_smithi018_166993_object45741:head# 2024-02-10T08:39:13.074 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa079bf7:::benchmark_data_smithi018_166993_object108559:head# 2024-02-10T08:39:13.074 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa088762:::benchmark_data_smithi018_166993_object34122:head# 2024-02-10T08:39:13.074 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa0a3288:::benchmark_data_smithi018_166993_object88850:head# 2024-02-10T08:39:13.075 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa0a385e:::benchmark_data_smithi018_166993_object47545:head# 2024-02-10T08:39:13.075 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa0aeae9:::benchmark_data_smithi018_166993_object91087:head# 2024-02-10T08:39:13.076 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa0b3545:::benchmark_data_smithi018_166993_object75265:head# 2024-02-10T08:39:13.076 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa0befae:::benchmark_data_smithi018_166993_object66771:head# 2024-02-10T08:39:13.077 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa0c23b1:::benchmark_data_smithi018_166993_object32829:head# 2024-02-10T08:39:13.077 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa0c362e:::benchmark_data_smithi018_166993_object29503:head# 2024-02-10T08:39:13.078 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa0d4f58:::benchmark_data_smithi018_166993_object50579:head# 2024-02-10T08:39:13.078 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa0df995:::benchmark_data_smithi018_166993_object91897:head# 2024-02-10T08:39:13.090 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa0f2e2c:::benchmark_data_smithi018_166993_object77665:head# 2024-02-10T08:39:13.090 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa0f4a5e:::benchmark_data_smithi018_166993_object60813:head# 2024-02-10T08:39:13.090 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa0ffe1b:::benchmark_data_smithi018_166993_object109397:head# 2024-02-10T08:39:13.091 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa107694:::benchmark_data_smithi018_166993_object49866:head# 2024-02-10T08:39:13.093 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa118da2:::benchmark_data_smithi018_166993_object20725:head# 2024-02-10T08:39:13.093 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa126bc6:::benchmark_data_smithi018_166993_object88355:head# 2024-02-10T08:39:13.093 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa13ff4f:::benchmark_data_smithi018_166993_object94912:head# 2024-02-10T08:39:13.093 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa1405b8:::benchmark_data_smithi018_166993_object19993:head# 2024-02-10T08:39:13.093 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa1441ea:::benchmark_data_smithi018_166993_object78609:head# 2024-02-10T08:39:13.094 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa16891b:::benchmark_data_smithi018_166993_object116904:head# 2024-02-10T08:39:13.096 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa17a7b9:::benchmark_data_smithi018_166993_object20617:head# 2024-02-10T08:39:13.096 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa17e97e:::benchmark_data_smithi018_166993_object78860:head# 2024-02-10T08:39:13.097 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa187d38:::benchmark_data_smithi018_166993_object80619:head# 2024-02-10T08:39:13.097 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa187f1c:::benchmark_data_smithi018_166993_object36150:head# 2024-02-10T08:39:13.102 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa18c380:::benchmark_data_smithi018_166993_object51091:head# 2024-02-10T08:39:13.102 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa1a0575:::benchmark_data_smithi018_166993_object17505:head# 2024-02-10T08:39:13.102 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa1a2b57:::benchmark_data_smithi018_166993_object21178:head# 2024-02-10T08:39:13.103 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa1aabcf:::benchmark_data_smithi018_166993_object100965:head# 2024-02-10T08:39:13.103 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa1ac32d:::benchmark_data_smithi018_166993_object76605:head# 2024-02-10T08:39:13.103 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa1c63f7:::benchmark_data_smithi018_166993_object67197:head# 2024-02-10T08:39:13.103 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa1da48c:::benchmark_data_smithi018_166993_object21011:head# 2024-02-10T08:39:13.107 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa1da723:::benchmark_data_smithi018_166993_object79859:head# 2024-02-10T08:39:13.107 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa1dc0f3:::benchmark_data_smithi018_166993_object46047:head# 2024-02-10T08:39:13.107 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa1e25c7:::benchmark_data_smithi018_166993_object88779:head# 2024-02-10T08:39:13.108 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa1e3e4f:::benchmark_data_smithi018_166993_object66383:head# 2024-02-10T08:39:13.108 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa1e7f5e:::benchmark_data_smithi018_166993_object27640:head# 2024-02-10T08:39:13.109 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa1e8f06:::benchmark_data_smithi018_166993_object39581:head# 2024-02-10T08:39:13.109 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa1f6a70:::benchmark_data_smithi018_166993_object41289:head# 2024-02-10T08:39:13.112 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa1fd247:::benchmark_data_smithi018_166993_object53085:head# 2024-02-10T08:39:13.113 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa2038cf:::benchmark_data_smithi018_166993_object18728:head# 2024-02-10T08:39:13.114 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa208598:::benchmark_data_smithi018_166993_object46505:head# 2024-02-10T08:39:13.114 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa210668:::benchmark_data_smithi018_166993_object38569:head# 2024-02-10T08:39:13.117 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa21b588:::benchmark_data_smithi018_166993_object87780:head# 2024-02-10T08:39:13.119 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa234555:::benchmark_data_smithi018_166993_object62000:head# 2024-02-10T08:39:13.120 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa239db5:::benchmark_data_smithi018_166993_object31659:head# 2024-02-10T08:39:13.120 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa2432b2:::benchmark_data_smithi018_166993_object24867:head# 2024-02-10T08:39:13.124 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa249076:::benchmark_data_smithi018_166993_object59380:head# 2024-02-10T08:39:13.127 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:39:13.128 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa25efa0:::benchmark_data_smithi018_166993_object107075:head# 2024-02-10T08:39:13.128 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa264186:::benchmark_data_smithi018_166993_object67162:head# 2024-02-10T08:39:13.128 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa26a824:::benchmark_data_smithi018_166993_object41550:head# 2024-02-10T08:39:13.128 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa27677d:::benchmark_data_smithi018_166993_object105905:head# 2024-02-10T08:39:13.128 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa288eb0:::benchmark_data_smithi018_166993_object81099:head# 2024-02-10T08:39:13.128 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa293b30:::benchmark_data_smithi018_166993_object112031:head# 2024-02-10T08:39:13.131 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa2c5b79:::benchmark_data_smithi018_166993_object41320:head# 2024-02-10T08:39:13.131 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa2e0187:::benchmark_data_smithi018_166993_object83925:head# 2024-02-10T08:39:13.131 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa2e65e4:::benchmark_data_smithi018_166993_object41222:head# 2024-02-10T08:39:13.131 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa2effc8:::benchmark_data_smithi018_166993_object66062:head# 2024-02-10T08:39:13.134 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa2f2ce2:::benchmark_data_smithi018_166993_object44138:head# 2024-02-10T08:39:13.134 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa2f61a3:::benchmark_data_smithi018_166993_object82639:head# 2024-02-10T08:39:13.135 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa304ba5:::benchmark_data_smithi018_166993_object86443:head# 2024-02-10T08:39:13.136 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa30613e:::benchmark_data_smithi018_166993_object29707:head# 2024-02-10T08:39:13.136 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa30c8bc:::benchmark_data_smithi018_166993_object21503:head# 2024-02-10T08:39:13.136 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa30c9b1:::benchmark_data_smithi018_166993_object46922:head# 2024-02-10T08:39:13.137 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa31500f:::benchmark_data_smithi018_166993_object111673:head# 2024-02-10T08:39:13.137 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa31f211:::benchmark_data_smithi018_166993_object73681:head# 2024-02-10T08:39:13.138 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa321243:::benchmark_data_smithi018_166993_object45026:head# 2024-02-10T08:39:13.139 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa324730:::benchmark_data_smithi018_166993_object45642:head# 2024-02-10T08:39:13.140 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa33523b:::benchmark_data_smithi018_166993_object104627:head# 2024-02-10T08:39:13.140 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa339c5f:::benchmark_data_smithi018_166993_object42153:head# 2024-02-10T08:39:13.140 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa34c00a:::benchmark_data_smithi018_166993_object76199:head# 2024-02-10T08:39:13.142 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa365fbe:::benchmark_data_smithi018_166993_object87383:head# 2024-02-10T08:39:13.142 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa36984e:::benchmark_data_smithi018_166993_object81680:head# 2024-02-10T08:39:13.142 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa36d09b:::benchmark_data_smithi018_166993_object53137:head# 2024-02-10T08:39:13.147 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa37eb82:::benchmark_data_smithi018_166993_object113176:head# 2024-02-10T08:39:13.147 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa381b54:::benchmark_data_smithi018_166993_object47484:head# 2024-02-10T08:39:13.151 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa38bc37:::benchmark_data_smithi018_166993_object72078:head# 2024-02-10T08:39:13.151 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa39159c:::benchmark_data_smithi018_166993_object70381:head# 2024-02-10T08:39:13.152 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa397589:::benchmark_data_smithi018_166993_object86864:head# 2024-02-10T08:39:13.152 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa39e03a:::benchmark_data_smithi018_166993_object106788:head# 2024-02-10T08:39:13.157 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa3a423b:::benchmark_data_smithi018_166993_object21349:head# 2024-02-10T08:39:13.158 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa3aa59e:::benchmark_data_smithi018_166993_object36530:head# 2024-02-10T08:39:13.158 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa3bbba3:::benchmark_data_smithi018_166993_object95514:head# 2024-02-10T08:39:13.158 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa3e2eb2:::benchmark_data_smithi018_166993_object107956:head# 2024-02-10T08:39:13.158 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa3ef3a4:::benchmark_data_smithi018_166993_object90854:head# 2024-02-10T08:39:13.158 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa3f571b:::benchmark_data_smithi018_166993_object19006:head# 2024-02-10T08:39:13.165 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa407609:::benchmark_data_smithi018_166993_object43295:head# 2024-02-10T08:39:13.165 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa407e8b:::benchmark_data_smithi018_166993_object42120:head# 2024-02-10T08:39:13.165 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa40cadd:::benchmark_data_smithi018_166993_object57091:head# 2024-02-10T08:39:13.166 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa40f663:::benchmark_data_smithi018_166993_object35990:head# 2024-02-10T08:39:13.166 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa4165e9:::benchmark_data_smithi018_166993_object72915:head# 2024-02-10T08:39:13.166 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa43586d:::benchmark_data_smithi018_166993_object64728:head# 2024-02-10T08:39:13.171 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa443d0c:::benchmark_data_smithi018_166993_object26597:head# 2024-02-10T08:39:13.171 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa44f121:::benchmark_data_smithi018_166993_object42574:head# 2024-02-10T08:39:13.173 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa45d07f:::benchmark_data_smithi018_166993_object51316:head# 2024-02-10T08:39:13.174 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa461904:::benchmark_data_smithi018_166993_object95334:head# 2024-02-10T08:39:13.174 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa48081c:::benchmark_data_smithi018_166993_object67294:head# 2024-02-10T08:39:13.174 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa4b3c3d:::benchmark_data_smithi018_166993_object37234:head# 2024-02-10T08:39:13.175 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa4b47da:::benchmark_data_smithi018_166993_object32112:head# 2024-02-10T08:39:13.175 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa4b4e4d:::benchmark_data_smithi018_166993_object35101:head# 2024-02-10T08:39:13.175 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa500064:::benchmark_data_smithi018_166993_object39107:head# 2024-02-10T08:39:13.176 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa502b5c:::benchmark_data_smithi018_166993_object48069:head# 2024-02-10T08:39:13.176 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa50b731:::benchmark_data_smithi018_166993_object54671:head# 2024-02-10T08:39:13.177 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa513707:::benchmark_data_smithi018_166993_object56184:head# 2024-02-10T08:39:13.177 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa5139dc:::benchmark_data_smithi018_166993_object59691:head# 2024-02-10T08:39:13.185 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa51874f:::benchmark_data_smithi018_166993_object70879:head# 2024-02-10T08:39:13.185 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa520170:::benchmark_data_smithi018_166993_object54643:head# 2024-02-10T08:39:13.185 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa531d01:::benchmark_data_smithi018_166993_object95979:head# 2024-02-10T08:39:13.185 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa53570b:::benchmark_data_smithi018_166993_object88991:head# 2024-02-10T08:39:13.185 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa53c3b9:::benchmark_data_smithi018_166993_object54429:head# 2024-02-10T08:39:13.187 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa548c9c:::benchmark_data_smithi018_166993_object89696:head# 2024-02-10T08:39:13.187 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa58b580:::benchmark_data_smithi018_166993_object47122:head# 2024-02-10T08:39:13.187 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa58fd20:::benchmark_data_smithi018_166993_object58837:head# 2024-02-10T08:39:13.188 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa595c43:::benchmark_data_smithi018_166993_object38953:head# 2024-02-10T08:39:13.188 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa59a365:::benchmark_data_smithi018_166993_object34731:head# 2024-02-10T08:39:13.188 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa5a3fcc:::benchmark_data_smithi018_166993_object56048:head# 2024-02-10T08:39:13.188 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa5a95e1:::benchmark_data_smithi018_166993_object80318:head# 2024-02-10T08:39:13.188 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa5b4148:::benchmark_data_smithi018_166993_object57796:head# 2024-02-10T08:39:13.191 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa5b8264:::benchmark_data_smithi018_166993_object22165:head# 2024-02-10T08:39:13.194 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa5bf3a8:::benchmark_data_smithi018_166993_object95987:head# 2024-02-10T08:39:13.194 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa5c7bdf:::benchmark_data_smithi018_166993_object73873:head# 2024-02-10T08:39:13.194 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa5d1366:::benchmark_data_smithi018_166993_object85158:head# 2024-02-10T08:39:13.195 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa5d1e77:::benchmark_data_smithi018_166993_object96592:head# 2024-02-10T08:39:13.195 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa5d4ec4:::benchmark_data_smithi018_166993_object17917:head# 2024-02-10T08:39:13.196 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa5d7d01:::benchmark_data_smithi018_166993_object81012:head# 2024-02-10T08:39:13.196 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa5d9310:::benchmark_data_smithi018_166993_object105749:head# 2024-02-10T08:39:13.197 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa5eb535:::benchmark_data_smithi018_166993_object40400:head# 2024-02-10T08:39:13.197 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa601ff2:::benchmark_data_smithi018_166993_object86290:head# 2024-02-10T08:39:13.198 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa60c54d:::benchmark_data_smithi018_166993_object95999:head# 2024-02-10T08:39:13.202 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:13.203 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa60f63a:::benchmark_data_smithi018_166993_object61520:head# 2024-02-10T08:39:13.203 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa60f824:::benchmark_data_smithi018_166993_object21428:head# 2024-02-10T08:39:13.203 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa615ada:::benchmark_data_smithi018_166993_object46061:head# 2024-02-10T08:39:13.203 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa618bd8:::benchmark_data_smithi018_166993_object112995:head# 2024-02-10T08:39:13.203 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa6274c7:::benchmark_data_smithi018_166993_object32707:head# 2024-02-10T08:39:13.203 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa628284:::benchmark_data_smithi018_166993_object71619:head# 2024-02-10T08:39:13.203 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa62f0d3:::benchmark_data_smithi018_166993_object102332:head# 2024-02-10T08:39:13.203 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa63ed19:::benchmark_data_smithi018_166993_object108939:head# 2024-02-10T08:39:13.204 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa65843a:::benchmark_data_smithi018_166993_object118452:head# 2024-02-10T08:39:13.205 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa6586f1:::benchmark_data_smithi018_166993_object52972:head# 2024-02-10T08:39:13.205 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa660532:::benchmark_data_smithi018_166993_object29742:head# 2024-02-10T08:39:13.205 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa662996:::benchmark_data_smithi018_166993_object111980:head# 2024-02-10T08:39:13.205 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa66ea82:::benchmark_data_smithi018_166993_object77489:head# 2024-02-10T08:39:13.206 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa67f6e4:::benchmark_data_smithi018_166993_object38928:head# 2024-02-10T08:39:13.206 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa67ffc5:::benchmark_data_smithi018_166993_object33532:head# 2024-02-10T08:39:13.206 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa681c7d:::benchmark_data_smithi018_166993_object116970:head# 2024-02-10T08:39:13.207 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa683c20:::benchmark_data_smithi018_166993_object24988:head# 2024-02-10T08:39:13.207 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa686e1a:::benchmark_data_smithi018_166993_object107483:head# 2024-02-10T08:39:13.207 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa6baad0:::benchmark_data_smithi018_166993_object90409:head# 2024-02-10T08:39:13.208 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa6c320d:::benchmark_data_smithi018_166993_object38042:head# 2024-02-10T08:39:13.208 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa6cecd8:::benchmark_data_smithi018_166993_object95518:head# 2024-02-10T08:39:13.209 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa6d3005:::benchmark_data_smithi018_166993_object49815:head# 2024-02-10T08:39:13.209 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa6d4674:::benchmark_data_smithi018_166993_object52057:head# 2024-02-10T08:39:13.209 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa6e5cba:::benchmark_data_smithi018_166993_object55218:head# 2024-02-10T08:39:13.210 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa6e723a:::benchmark_data_smithi018_166993_object38681:head# 2024-02-10T08:39:13.210 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa6fe2fa:::benchmark_data_smithi018_166993_object62945:head# 2024-02-10T08:39:13.211 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa705714:::benchmark_data_smithi018_166993_object36552:head# 2024-02-10T08:39:13.211 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa7057ba:::benchmark_data_smithi018_166993_object34826:head# 2024-02-10T08:39:13.211 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa70adf4:::benchmark_data_smithi018_166993_object35156:head# 2024-02-10T08:39:13.212 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa710b61:::benchmark_data_smithi018_166993_object28628:head# 2024-02-10T08:39:13.212 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa7135b9:::benchmark_data_smithi018_166993_object92291:head# 2024-02-10T08:39:13.213 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa7240a5:::benchmark_data_smithi018_166993_object64988:head# 2024-02-10T08:39:13.213 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa724133:::benchmark_data_smithi018_166993_object29512:head# 2024-02-10T08:39:13.213 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa724f80:::benchmark_data_smithi018_166993_object70692:head# 2024-02-10T08:39:13.214 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa725db1:::benchmark_data_smithi018_166993_object32431:head# 2024-02-10T08:39:13.214 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa731dec:::benchmark_data_smithi018_166993_object46719:head# 2024-02-10T08:39:13.215 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa7336ee:::benchmark_data_smithi018_166993_object56444:head# 2024-02-10T08:39:13.215 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa733be7:::benchmark_data_smithi018_166993_object47526:head# 2024-02-10T08:39:13.218 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa734065:::benchmark_data_smithi018_166993_object115924:head# 2024-02-10T08:39:13.218 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa73b7b4:::benchmark_data_smithi018_166993_object102995:head# 2024-02-10T08:39:13.219 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa73e681:::benchmark_data_smithi018_166993_object88251:head# 2024-02-10T08:39:13.221 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa7450b8:::benchmark_data_smithi018_166993_object90562:head# 2024-02-10T08:39:13.221 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa74d82d:::benchmark_data_smithi018_166993_object118693:head# 2024-02-10T08:39:13.222 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa756f93:::benchmark_data_smithi018_166993_object35261:head# 2024-02-10T08:39:13.222 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa765611:::benchmark_data_smithi018_166993_object94748:head# 2024-02-10T08:39:13.226 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa765bd5:::benchmark_data_smithi018_166993_object88803:head# 2024-02-10T08:39:13.228 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa777265:::benchmark_data_smithi018_166993_object41461:head# 2024-02-10T08:39:13.229 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa79f478:::benchmark_data_smithi018_166993_object27861:head# 2024-02-10T08:39:13.229 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa7af430:::benchmark_data_smithi018_166993_object110961:head# 2024-02-10T08:39:13.231 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa7b902f:::benchmark_data_smithi018_166993_object105207:head# 2024-02-10T08:39:13.231 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa7c207c:::benchmark_data_smithi018_166993_object91279:head# 2024-02-10T08:39:13.232 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa7d17f2:::benchmark_data_smithi018_166993_object108650:head# 2024-02-10T08:39:13.232 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa7f2b57:::benchmark_data_smithi018_166993_object20468:head# 2024-02-10T08:39:13.232 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa7f64c0:::benchmark_data_smithi018_166993_object30316:head# 2024-02-10T08:39:13.233 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa80022e:::benchmark_data_smithi018_166993_object36317:head# 2024-02-10T08:39:13.233 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa80c378:::benchmark_data_smithi018_166993_object31685:head# 2024-02-10T08:39:13.234 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa81c5b6:::benchmark_data_smithi018_166993_object67412:head# 2024-02-10T08:39:13.234 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa82ff0d:::benchmark_data_smithi018_166993_object86255:head# 2024-02-10T08:39:13.234 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa838a18:::benchmark_data_smithi018_166993_object76111:head# 2024-02-10T08:39:13.235 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa83f6b0:::benchmark_data_smithi018_166993_object97416:head# 2024-02-10T08:39:13.243 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa848e4c:::benchmark_data_smithi018_166993_object30155:head# 2024-02-10T08:39:13.243 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa85b192:::benchmark_data_smithi018_166993_object58022:head# 2024-02-10T08:39:13.243 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa86d554:::benchmark_data_smithi018_166993_object34953:head# 2024-02-10T08:39:13.243 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa87bae2:::benchmark_data_smithi018_166993_object114386:head# 2024-02-10T08:39:13.243 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa8a758f:::benchmark_data_smithi018_166993_object119063:head# 2024-02-10T08:39:13.243 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa8b53db:::benchmark_data_smithi018_166993_object97916:head# 2024-02-10T08:39:13.243 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa8be363:::benchmark_data_smithi018_166993_object45456:head# 2024-02-10T08:39:13.243 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa8d5496:::benchmark_data_smithi018_166993_object114413:head# 2024-02-10T08:39:13.244 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa8d76dd:::benchmark_data_smithi018_166993_object49400:head# 2024-02-10T08:39:13.244 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa921338:::benchmark_data_smithi018_166993_object115941:head# 2024-02-10T08:39:13.244 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa92770c:::benchmark_data_smithi018_166993_object70216:head# 2024-02-10T08:39:13.244 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa93b16b:::benchmark_data_smithi018_166993_object77927:head# 2024-02-10T08:39:13.244 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa942d2d:::benchmark_data_smithi018_166993_object40495:head# 2024-02-10T08:39:13.244 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa94bdf5:::benchmark_data_smithi018_166993_object31015:head# 2024-02-10T08:39:13.247 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa95660a:::benchmark_data_smithi018_166993_object39397:head# 2024-02-10T08:39:13.247 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa959f74:::benchmark_data_smithi018_166993_object67936:head# 2024-02-10T08:39:13.247 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa95b83c:::benchmark_data_smithi018_166993_object66749:head# 2024-02-10T08:39:13.248 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa95f249:::benchmark_data_smithi018_166993_object111522:head# 2024-02-10T08:39:13.248 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa96e2a0:::benchmark_data_smithi018_166993_object66578:head# 2024-02-10T08:39:13.249 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa97375e:::benchmark_data_smithi018_166993_object92581:head# 2024-02-10T08:39:13.249 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa9773d6:::benchmark_data_smithi018_166993_object105066:head# 2024-02-10T08:39:13.249 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa984d17:::benchmark_data_smithi018_166993_object46016:head# 2024-02-10T08:39:13.250 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa989211:::benchmark_data_smithi018_166993_object55617:head# 2024-02-10T08:39:13.250 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa9943e2:::benchmark_data_smithi018_166993_object87138:head# 2024-02-10T08:39:13.252 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa99d487:::benchmark_data_smithi018_166993_object52263:head# 2024-02-10T08:39:13.255 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:39:13.257 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa99e7d3:::benchmark_data_smithi018_166993_object75295:head# 2024-02-10T08:39:13.257 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa9ab36d:::benchmark_data_smithi018_166993_object23490:head# 2024-02-10T08:39:13.257 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa9ac24c:::benchmark_data_smithi018_166993_object81255:head# 2024-02-10T08:39:13.258 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa9b20d5:::benchmark_data_smithi018_166993_object27881:head# 2024-02-10T08:39:13.258 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa9cbb51:::benchmark_data_smithi018_166993_object76409:head# 2024-02-10T08:39:13.258 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa9cbf68:::benchmark_data_smithi018_166993_object109844:head# 2024-02-10T08:39:13.258 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa9dcd62:::benchmark_data_smithi018_166993_object65507:head# 2024-02-10T08:39:13.258 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa9e2465:::benchmark_data_smithi018_166993_object87956:head# 2024-02-10T08:39:13.258 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa9e4de2:::benchmark_data_smithi018_166993_object43233:head# 2024-02-10T08:39:13.259 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa9ed701:::benchmark_data_smithi018_166993_object35094:head# 2024-02-10T08:39:13.259 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aa9f1c45:::benchmark_data_smithi018_166993_object32763:head# 2024-02-10T08:39:13.259 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aaa2b189:::benchmark_data_smithi018_166993_object71414:head# 2024-02-10T08:39:13.259 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aaa2b332:::benchmark_data_smithi018_166993_object48598:head# 2024-02-10T08:39:13.260 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:13.261 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:39:13.261 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aaa304f4:::benchmark_data_smithi018_166993_object88380:head# 2024-02-10T08:39:13.263 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aaa3598e:::benchmark_data_smithi018_166993_object116119:head# 2024-02-10T08:39:13.263 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aaa38602:::benchmark_data_smithi018_166993_object111113:head# 2024-02-10T08:39:13.263 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aaa4c83f:::benchmark_data_smithi018_166993_object43249:head# 2024-02-10T08:39:13.263 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aaa53295:::benchmark_data_smithi018_166993_object106767:head# 2024-02-10T08:39:13.267 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aaa575c1:::benchmark_data_smithi018_166993_object82640:head# 2024-02-10T08:39:13.268 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aaa619d1:::benchmark_data_smithi018_166993_object57551:head# 2024-02-10T08:39:13.268 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aaa6e428:::benchmark_data_smithi018_166993_object80553:head# 2024-02-10T08:39:13.268 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aaa6ebc4:::benchmark_data_smithi018_166993_object82141:head# 2024-02-10T08:39:13.268 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aaa74fa3:::benchmark_data_smithi018_166993_object35162:head# 2024-02-10T08:39:13.268 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aaa76509:::benchmark_data_smithi018_166993_object25764:head# 2024-02-10T08:39:13.268 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aaa7a8cb:::benchmark_data_smithi018_166993_object99483:head# 2024-02-10T08:39:13.271 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aaa8ea2a:::benchmark_data_smithi018_166993_object85383:head# 2024-02-10T08:39:13.271 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aaa96046:::benchmark_data_smithi018_166993_object23891:head# 2024-02-10T08:39:13.271 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aaa9bea9:::benchmark_data_smithi018_166993_object82978:head# 2024-02-10T08:39:13.272 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aaaad634:::benchmark_data_smithi018_166993_object89107:head# 2024-02-10T08:39:13.272 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aaab3f4f:::benchmark_data_smithi018_166993_object62261:head# 2024-02-10T08:39:13.276 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aaac8779:::benchmark_data_smithi018_166993_object46945:head# 2024-02-10T08:39:13.278 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aaad4545:::benchmark_data_smithi018_166993_object28507:head# 2024-02-10T08:39:13.278 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aaae2c90:::benchmark_data_smithi018_166993_object40188:head# 2024-02-10T08:39:13.279 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aaaf90ec:::benchmark_data_smithi018_166993_object68925:head# 2024-02-10T08:39:13.279 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aab08949:::benchmark_data_smithi018_166993_object113249:head# 2024-02-10T08:39:13.280 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aab0b29c:::benchmark_data_smithi018_166993_object95736:head# 2024-02-10T08:39:13.281 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aab10f29:::benchmark_data_smithi018_166993_object99254:head# 2024-02-10T08:39:13.281 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aab112da:::benchmark_data_smithi018_166993_object49770:head# 2024-02-10T08:39:13.281 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aab20ff7:::benchmark_data_smithi018_166993_object104933:head# 2024-02-10T08:39:13.282 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aab216a0:::benchmark_data_smithi018_166993_object64084:head# 2024-02-10T08:39:13.282 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aab2dcb4:::benchmark_data_smithi018_166993_object96742:head# 2024-02-10T08:39:13.285 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aab47445:::benchmark_data_smithi018_166993_object49409:head# 2024-02-10T08:39:13.285 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aab59d55:::benchmark_data_smithi018_166993_object28566:head# 2024-02-10T08:39:13.285 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aab5a54c:::benchmark_data_smithi018_166993_object92848:head# 2024-02-10T08:39:13.287 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aab5b981:::benchmark_data_smithi018_166993_object64794:head# 2024-02-10T08:39:13.287 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aab5f1fc:::benchmark_data_smithi018_166993_object46589:head# 2024-02-10T08:39:13.287 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aab5f5c4:::benchmark_data_smithi018_166993_object60372:head# 2024-02-10T08:39:13.288 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aab61116:::benchmark_data_smithi018_166993_object87028:head# 2024-02-10T08:39:13.288 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aab6ce21:::benchmark_data_smithi018_166993_object64494:head# 2024-02-10T08:39:13.291 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aab72946:::benchmark_data_smithi018_166993_object70153:head# 2024-02-10T08:39:13.292 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aab7aef6:::benchmark_data_smithi018_166993_object67837:head# 2024-02-10T08:39:13.292 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aab7da18:::benchmark_data_smithi018_166993_object98053:head# 2024-02-10T08:39:13.295 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aab8c524:::benchmark_data_smithi018_166993_object35218:head# 2024-02-10T08:39:13.298 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aab9e682:::benchmark_data_smithi018_166993_object44387:head# 2024-02-10T08:39:13.300 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aaba6cea:::benchmark_data_smithi018_166993_object97906:head# 2024-02-10T08:39:13.300 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aabb09ae:::benchmark_data_smithi018_166993_object37226:head# 2024-02-10T08:39:13.300 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aabb62a2:::benchmark_data_smithi018_166993_object64517:head# 2024-02-10T08:39:13.301 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aabd1013:::benchmark_data_smithi018_166993_object40647:head# 2024-02-10T08:39:13.301 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aabdb159:::benchmark_data_smithi018_166993_object27614:head# 2024-02-10T08:39:13.304 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aabdca53:::benchmark_data_smithi018_166993_object33736:head# 2024-02-10T08:39:13.306 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aabe2c27:::benchmark_data_smithi018_166993_object53987:head# 2024-02-10T08:39:13.306 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aabe3fb2:::benchmark_data_smithi018_166993_object46278:head# 2024-02-10T08:39:13.312 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aabe8341:::benchmark_data_smithi018_166993_object36872:head# 2024-02-10T08:39:13.312 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aabe8bc3:::benchmark_data_smithi018_166993_object73925:head# 2024-02-10T08:39:13.312 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aac0df21:::benchmark_data_smithi018_166993_object100015:head# 2024-02-10T08:39:13.312 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aac0e47b:::benchmark_data_smithi018_166993_object59310:head# 2024-02-10T08:39:13.312 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aac10133:::benchmark_data_smithi018_166993_object68006:head# 2024-02-10T08:39:13.312 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aac19197:::benchmark_data_smithi018_166993_object101732:head# 2024-02-10T08:39:13.313 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aac19bdf:::benchmark_data_smithi018_166993_object95646:head# 2024-02-10T08:39:13.314 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aac1b399:::benchmark_data_smithi018_166993_object74488:head# 2024-02-10T08:39:13.316 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aac1c7dc:::benchmark_data_smithi018_166993_object23120:head# 2024-02-10T08:39:13.316 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aac32808:::benchmark_data_smithi018_166993_object112491:head# 2024-02-10T08:39:13.318 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aac3cf84:::benchmark_data_smithi018_166993_object107836:head# 2024-02-10T08:39:13.320 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aac44cc0:::benchmark_data_smithi018_166993_object106536:head# 2024-02-10T08:39:13.320 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aac4707c:::benchmark_data_smithi018_166993_object19201:head# 2024-02-10T08:39:13.321 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aac5ad8f:::benchmark_data_smithi018_166993_object58180:head# 2024-02-10T08:39:13.322 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aac6aa0b:::benchmark_data_smithi018_166993_object97487:head# 2024-02-10T08:39:13.322 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aac7bcfc:::benchmark_data_smithi018_166993_object77332:head# 2024-02-10T08:39:13.323 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aac83c5f:::benchmark_data_smithi018_166993_object100278:head# 2024-02-10T08:39:13.324 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aac8ab89:::benchmark_data_smithi018_166993_object44517:head# 2024-02-10T08:39:13.324 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aaca1e2b:::benchmark_data_smithi018_166993_object53669:head# 2024-02-10T08:39:13.326 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aacdd187:::benchmark_data_smithi018_166993_object109201:head# 2024-02-10T08:39:13.326 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aace39f0:::benchmark_data_smithi018_166993_object45309:head# 2024-02-10T08:39:13.327 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aacf38d3:::benchmark_data_smithi018_166993_object84469:head# 2024-02-10T08:39:13.327 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aacf5aac:::benchmark_data_smithi018_166993_object77551:head# 2024-02-10T08:39:13.327 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aad03a25:::benchmark_data_smithi018_166993_object100050:head# 2024-02-10T08:39:13.327 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aad083c3:::benchmark_data_smithi018_166993_object39842:head# 2024-02-10T08:39:13.328 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aad08628:::benchmark_data_smithi018_166993_object49975:head# 2024-02-10T08:39:13.334 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aad2db10:::benchmark_data_smithi018_166993_object88474:head# 2024-02-10T08:39:13.334 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aad33442:::benchmark_data_smithi018_166993_object34927:head# 2024-02-10T08:39:13.334 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aad3dbba:::benchmark_data_smithi018_166993_object36632:head# 2024-02-10T08:39:13.334 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aad4f824:::benchmark_data_smithi018_166993_object28808:head# 2024-02-10T08:39:13.334 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aad5163c:::benchmark_data_smithi018_166993_object92341:head# 2024-02-10T08:39:13.335 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aad51c4e:::benchmark_data_smithi018_166993_object78825:head# 2024-02-10T08:39:13.335 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aad581f1:::benchmark_data_smithi018_166993_object108184:head# 2024-02-10T08:39:13.335 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aad5bcf6:::benchmark_data_smithi018_166993_object36667:head# 2024-02-10T08:39:13.335 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aad70d5e:::benchmark_data_smithi018_166993_object55521:head# 2024-02-10T08:39:13.335 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aad77eea:::benchmark_data_smithi018_166993_object58262:head# 2024-02-10T08:39:13.335 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aad7c564:::benchmark_data_smithi018_166993_object44793:head# 2024-02-10T08:39:13.335 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aad86082:::benchmark_data_smithi018_166993_object110886:head# 2024-02-10T08:39:13.339 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aad877bb:::benchmark_data_smithi018_166993_object78113:head# 2024-02-10T08:39:13.339 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aad9408a:::benchmark_data_smithi018_166993_object95248:head# 2024-02-10T08:39:13.339 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aada0740:::benchmark_data_smithi018_166993_object30986:head# 2024-02-10T08:39:13.339 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aadb2b9c:::benchmark_data_smithi018_166993_object60875:head# 2024-02-10T08:39:13.339 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aadb8faf:::benchmark_data_smithi018_166993_object55408:head# 2024-02-10T08:39:13.339 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aadce308:::benchmark_data_smithi018_166993_object73236:head# 2024-02-10T08:39:13.339 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aaddc4d7:::benchmark_data_smithi018_166993_object32013:head# 2024-02-10T08:39:13.339 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aadebf1d:::benchmark_data_smithi018_166993_object66807:head# 2024-02-10T08:39:13.339 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aadeeff5:::benchmark_data_smithi018_166993_object70495:head# 2024-02-10T08:39:13.341 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aadf2c3e:::benchmark_data_smithi018_166993_object71596:head# 2024-02-10T08:39:13.341 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aae034b5:::benchmark_data_smithi018_166993_object63027:head# 2024-02-10T08:39:13.341 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aae0f282:::benchmark_data_smithi018_166993_object54831:head# 2024-02-10T08:39:13.341 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aae0f857:::benchmark_data_smithi018_166993_object29344:head# 2024-02-10T08:39:13.342 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aae1d703:::benchmark_data_smithi018_166993_object104062:head# 2024-02-10T08:39:13.344 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aae2147d:::benchmark_data_smithi018_166993_object68000:head# 2024-02-10T08:39:13.345 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aae27c36:::benchmark_data_smithi018_166993_object91739:head# 2024-02-10T08:39:13.345 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aae29cc7:::benchmark_data_smithi018_166993_object85728:head# 2024-02-10T08:39:13.346 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aae351b6:::benchmark_data_smithi018_166993_object23849:head# 2024-02-10T08:39:13.346 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aae4ffda:::benchmark_data_smithi018_166993_object52877:head# 2024-02-10T08:39:13.347 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aae533d6:::benchmark_data_smithi018_166993_object53385:head# 2024-02-10T08:39:13.347 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aae5be52:::benchmark_data_smithi018_166993_object70382:head# 2024-02-10T08:39:13.348 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aae76de0:::benchmark_data_smithi018_166993_object66460:head# 2024-02-10T08:39:13.348 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aae7c3fa:::benchmark_data_smithi018_166993_object48824:head# 2024-02-10T08:39:13.349 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aae8d195:::benchmark_data_smithi018_166993_object59193:head# 2024-02-10T08:39:13.349 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aae8e794:::benchmark_data_smithi018_166993_object72734:head# 2024-02-10T08:39:13.352 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aaeb087e:::benchmark_data_smithi018_166993_object102244:head# 2024-02-10T08:39:13.352 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aaeb2a71:::benchmark_data_smithi018_166993_object80100:head# 2024-02-10T08:39:13.352 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aaeb5757:::benchmark_data_smithi018_166993_object17960:head# 2024-02-10T08:39:13.352 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aaeb7f59:::benchmark_data_smithi018_166993_object83207:head# 2024-02-10T08:39:13.353 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aaed4795:::benchmark_data_smithi018_166993_object85408:head# 2024-02-10T08:39:13.353 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aaf0a57a:::benchmark_data_smithi018_166993_object40046:head# 2024-02-10T08:39:13.353 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aaf0cbe6:::benchmark_data_smithi018_166993_object78921:head# 2024-02-10T08:39:13.354 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aaf0f09c:::benchmark_data_smithi018_166993_object27421:head# 2024-02-10T08:39:13.354 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aaf13a92:::benchmark_data_smithi018_166993_object75713:head# 2024-02-10T08:39:13.355 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aaf19ed3:::benchmark_data_smithi018_166993_object33671:head# 2024-02-10T08:39:13.357 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aaf36e8a:::benchmark_data_smithi018_166993_object101619:head# 2024-02-10T08:39:13.357 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aaf44776:::benchmark_data_smithi018_166993_object53997:head# 2024-02-10T08:39:13.357 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aaf6aa7e:::benchmark_data_smithi018_166993_object49495:head# 2024-02-10T08:39:13.357 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aaf6c354:::benchmark_data_smithi018_166993_object45734:head# 2024-02-10T08:39:13.359 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aaf84bf7:::benchmark_data_smithi018_166993_object44627:head# 2024-02-10T08:39:13.359 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aaf88544:::benchmark_data_smithi018_166993_object33878:head# 2024-02-10T08:39:13.359 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aaf9be00:::benchmark_data_smithi018_166993_object40305:head# 2024-02-10T08:39:13.360 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aafb9ef8:::benchmark_data_smithi018_166993_object81933:head# 2024-02-10T08:39:13.360 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aafc8f2e:::benchmark_data_smithi018_166993_object60383:head# 2024-02-10T08:39:13.360 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aafc9c67:::benchmark_data_smithi018_166993_object97018:head# 2024-02-10T08:39:13.360 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aafcbf23:::benchmark_data_smithi018_166993_object101100:head# 2024-02-10T08:39:13.361 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aafd1425:::benchmark_data_smithi018_166993_object90680:head# 2024-02-10T08:39:13.361 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aaffd94c:::benchmark_data_smithi018_166993_object101270:head# 2024-02-10T08:39:13.361 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:39:13.366 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab01506e:::benchmark_data_smithi018_166993_object51038:head# 2024-02-10T08:39:13.366 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab016ade:::benchmark_data_smithi018_166993_object96442:head# 2024-02-10T08:39:13.368 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab039167:::benchmark_data_smithi018_166993_object28885:head# 2024-02-10T08:39:13.369 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab03f5b4:::benchmark_data_smithi018_166993_object38988:head# 2024-02-10T08:39:13.371 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab0451af:::benchmark_data_smithi018_166993_object100154:head# 2024-02-10T08:39:13.371 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab04edf2:::benchmark_data_smithi018_166993_object72176:head# 2024-02-10T08:39:13.382 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab05c766:::benchmark_data_smithi018_166993_object79533:head# 2024-02-10T08:39:13.382 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab07b261:::benchmark_data_smithi018_166993_object61138:head# 2024-02-10T08:39:13.382 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab0858d0:::benchmark_data_smithi018_166993_object78842:head# 2024-02-10T08:39:13.383 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab0925ae:::benchmark_data_smithi018_166993_object84297:head# 2024-02-10T08:39:13.383 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab098317:::benchmark_data_smithi018_166993_object63387:head# 2024-02-10T08:39:13.384 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab0a3fb8:::benchmark_data_smithi018_166993_object50251:head# 2024-02-10T08:39:13.392 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab0a9443:::benchmark_data_smithi018_166993_object107552:head# 2024-02-10T08:39:13.392 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab0b9bed:::benchmark_data_smithi018_166993_object75744:head# 2024-02-10T08:39:13.392 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab0bafda:::benchmark_data_smithi018_166993_object58190:head# 2024-02-10T08:39:13.392 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab0c04c7:::benchmark_data_smithi018_166993_object76295:head# 2024-02-10T08:39:13.392 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab0c5624:::benchmark_data_smithi018_166993_object76082:head# 2024-02-10T08:39:13.392 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab0dcbf6:::benchmark_data_smithi018_166993_object102336:head# 2024-02-10T08:39:13.392 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab0e18f7:::benchmark_data_smithi018_166993_object63362:head# 2024-02-10T08:39:13.392 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab100e1b:::benchmark_data_smithi018_166993_object88913:head# 2024-02-10T08:39:13.392 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab101137:::benchmark_data_smithi018_166993_object80314:head# 2024-02-10T08:39:13.392 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab11a872:::benchmark_data_smithi018_166993_object83028:head# 2024-02-10T08:39:13.396 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab11c2bd:::benchmark_data_smithi018_166993_object83999:head# 2024-02-10T08:39:13.396 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab12fa38:::benchmark_data_smithi018_166993_object90910:head# 2024-02-10T08:39:13.396 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab136e77:::benchmark_data_smithi018_166993_object77529:head# 2024-02-10T08:39:13.396 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab145189:::benchmark_data_smithi018_166993_object36652:head# 2024-02-10T08:39:13.397 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab154064:::benchmark_data_smithi018_166993_object73888:head# 2024-02-10T08:39:13.397 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab1613e5:::benchmark_data_smithi018_166993_object26835:head# 2024-02-10T08:39:13.398 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab16db64:::benchmark_data_smithi018_166993_object42902:head# 2024-02-10T08:39:13.399 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab18137f:::benchmark_data_smithi018_166993_object53768:head# 2024-02-10T08:39:13.399 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab181e05:::benchmark_data_smithi018_166993_object60576:head# 2024-02-10T08:39:13.399 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab186402:::benchmark_data_smithi018_166993_object32092:head# 2024-02-10T08:39:13.399 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab1891c3:::benchmark_data_smithi018_166993_object30656:head# 2024-02-10T08:39:13.399 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab18b91a:::benchmark_data_smithi018_166993_object29746:head# 2024-02-10T08:39:13.405 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab18fda5:::benchmark_data_smithi018_166993_object110415:head# 2024-02-10T08:39:13.405 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab19b4ba:::benchmark_data_smithi018_166993_object91672:head# 2024-02-10T08:39:13.405 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab1a1a83:::benchmark_data_smithi018_166993_object114750:head# 2024-02-10T08:39:13.405 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab1a9a09:::benchmark_data_smithi018_166993_object22306:head# 2024-02-10T08:39:13.406 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab1af090:::benchmark_data_smithi018_166993_object45274:head# 2024-02-10T08:39:13.406 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab1b436a:::benchmark_data_smithi018_166993_object95918:head# 2024-02-10T08:39:13.406 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab1c8a65:::benchmark_data_smithi018_166993_object67565:head# 2024-02-10T08:39:13.406 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab1d1ec1:::benchmark_data_smithi018_166993_object45417:head# 2024-02-10T08:39:13.406 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab1d988b:::benchmark_data_smithi018_166993_object106781:head# 2024-02-10T08:39:13.406 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab1da637:::benchmark_data_smithi018_166993_object34785:head# 2024-02-10T08:39:13.407 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab1dde24:::benchmark_data_smithi018_166993_object20382:head# 2024-02-10T08:39:13.414 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab1e4f49:::benchmark_data_smithi018_166993_object45710:head# 2024-02-10T08:39:13.414 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab1e4feb:::benchmark_data_smithi018_166993_object28308:head# 2024-02-10T08:39:13.415 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab1f9324:::benchmark_data_smithi018_166993_object50416:head# 2024-02-10T08:39:13.415 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab20685f:::benchmark_data_smithi018_166993_object25853:head# 2024-02-10T08:39:13.418 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:13.418 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab217edc:::benchmark_data_smithi018_166993_object75875:head# 2024-02-10T08:39:13.419 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab223f22:::benchmark_data_smithi018_166993_object106734:head# 2024-02-10T08:39:13.425 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab2265cf:::benchmark_data_smithi018_166993_object36595:head# 2024-02-10T08:39:13.425 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab22f125:::benchmark_data_smithi018_166993_object69717:head# 2024-02-10T08:39:13.425 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab232a86:::benchmark_data_smithi018_166993_object33145:head# 2024-02-10T08:39:13.425 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab234b72:::benchmark_data_smithi018_166993_object98606:head# 2024-02-10T08:39:13.425 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab237a9b:::benchmark_data_smithi018_166993_object78238:head# 2024-02-10T08:39:13.427 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab23b930:::benchmark_data_smithi018_166993_object72143:head# 2024-02-10T08:39:13.427 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab23d132:::benchmark_data_smithi018_166993_object107102:head# 2024-02-10T08:39:13.427 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab242222:::benchmark_data_smithi018_166993_object59047:head# 2024-02-10T08:39:13.428 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab257263:::benchmark_data_smithi018_166993_object62327:head# 2024-02-10T08:39:13.428 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab259dcd:::benchmark_data_smithi018_166993_object45415:head# 2024-02-10T08:39:13.428 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab26dcf1:::benchmark_data_smithi018_166993_object100704:head# 2024-02-10T08:39:13.429 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab26fc3f:::benchmark_data_smithi018_166993_object90424:head# 2024-02-10T08:39:13.429 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab275bde:::benchmark_data_smithi018_166993_object95862:head# 2024-02-10T08:39:13.429 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab29d97d:::benchmark_data_smithi018_166993_object118355:head# 2024-02-10T08:39:13.430 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab29fb6e:::benchmark_data_smithi018_166993_object66675:head# 2024-02-10T08:39:13.430 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab2a0075:::benchmark_data_smithi018_166993_object100018:head# 2024-02-10T08:39:13.431 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab2b647f:::benchmark_data_smithi018_166993_object28858:head# 2024-02-10T08:39:13.431 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab2c04d5:::benchmark_data_smithi018_166993_object20044:head# 2024-02-10T08:39:13.431 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab2c2975:::benchmark_data_smithi018_166993_object116832:head# 2024-02-10T08:39:13.432 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab2d46bd:::benchmark_data_smithi018_166993_object66470:head# 2024-02-10T08:39:13.432 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab2d6dfe:::benchmark_data_smithi018_166993_object28359:head# 2024-02-10T08:39:13.433 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab2e809d:::benchmark_data_smithi018_166993_object19436:head# 2024-02-10T08:39:13.434 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab2eac56:::benchmark_data_smithi018_166993_object29429:head# 2024-02-10T08:39:13.435 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab315a1c:::benchmark_data_smithi018_166993_object103479:head# 2024-02-10T08:39:13.436 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab31c678:::benchmark_data_smithi018_166993_object64546:head# 2024-02-10T08:39:13.437 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab31ce46:::benchmark_data_smithi018_166993_object75805:head# 2024-02-10T08:39:13.437 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab32283d:::benchmark_data_smithi018_166993_object37569:head# 2024-02-10T08:39:13.437 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab3386ab:::benchmark_data_smithi018_166993_object98877:head# 2024-02-10T08:39:13.438 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab34528f:::benchmark_data_smithi018_166993_object83905:head# 2024-02-10T08:39:13.438 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab3616c8:::benchmark_data_smithi018_166993_object27658:head# 2024-02-10T08:39:13.439 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab361b5e:::benchmark_data_smithi018_166993_object58591:head# 2024-02-10T08:39:13.442 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab375377:::benchmark_data_smithi018_166993_object95389:head# 2024-02-10T08:39:13.443 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab38522f:::benchmark_data_smithi018_166993_object45925:head# 2024-02-10T08:39:13.443 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab394a42:::benchmark_data_smithi018_166993_object79377:head# 2024-02-10T08:39:13.443 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab39ca49:::benchmark_data_smithi018_166993_object83814:head# 2024-02-10T08:39:13.444 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab39efc4:::benchmark_data_smithi018_166993_object58687:head# 2024-02-10T08:39:13.444 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab3b033c:::benchmark_data_smithi018_166993_object96983:head# 2024-02-10T08:39:13.445 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab3b3b4a:::benchmark_data_smithi018_166993_object118219:head# 2024-02-10T08:39:13.445 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab3c4417:::benchmark_data_smithi018_166993_object116220:head# 2024-02-10T08:39:13.445 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab3c9185:::benchmark_data_smithi018_166993_object105513:head# 2024-02-10T08:39:13.446 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab3c98f0:::benchmark_data_smithi018_166993_object68081:head# 2024-02-10T08:39:13.446 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab3cf5a0:::benchmark_data_smithi018_166993_object95553:head# 2024-02-10T08:39:13.447 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab3dc98f:::benchmark_data_smithi018_166993_object40648:head# 2024-02-10T08:39:13.448 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab3e4d6f:::benchmark_data_smithi018_166993_object21308:head# 2024-02-10T08:39:13.448 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab3f609f:::benchmark_data_smithi018_166993_object45481:head# 2024-02-10T08:39:13.448 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab406844:::benchmark_data_smithi018_166993_object61128:head# 2024-02-10T08:39:13.449 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab41273f:::benchmark_data_smithi018_166993_object106179:head# 2024-02-10T08:39:13.449 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab4129ab:::benchmark_data_smithi018_166993_object50092:head# 2024-02-10T08:39:13.451 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab42d073:::benchmark_data_smithi018_166993_object73024:head# 2024-02-10T08:39:13.452 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab435b63:::benchmark_data_smithi018_166993_object87432:head# 2024-02-10T08:39:13.455 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab43c71b:::benchmark_data_smithi018_166993_object94647:head# 2024-02-10T08:39:13.455 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab43fe32:::benchmark_data_smithi018_166993_object28460:head# 2024-02-10T08:39:13.456 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab443beb:::benchmark_data_smithi018_166993_object74338:head# 2024-02-10T08:39:13.457 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab44a12d:::benchmark_data_smithi018_166993_object35306:head# 2024-02-10T08:39:13.457 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab44fb06:::benchmark_data_smithi018_166993_object50165:head# 2024-02-10T08:39:13.458 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab45d94a:::benchmark_data_smithi018_166993_object75099:head# 2024-02-10T08:39:13.458 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab467442:::benchmark_data_smithi018_166993_object37027:head# 2024-02-10T08:39:13.459 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab475d4a:::benchmark_data_smithi018_166993_object29565:head# 2024-02-10T08:39:13.459 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab49a5f8:::benchmark_data_smithi018_166993_object97622:head# 2024-02-10T08:39:13.459 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab4ed5b6:::benchmark_data_smithi018_166993_object100903:head# 2024-02-10T08:39:13.460 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab5031fc:::benchmark_data_smithi018_166993_object68277:head# 2024-02-10T08:39:13.460 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab509650:::benchmark_data_smithi018_166993_object72040:head# 2024-02-10T08:39:13.461 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab50e6fd:::benchmark_data_smithi018_166993_object100216:head# 2024-02-10T08:39:13.461 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab510118:::benchmark_data_smithi018_166993_object27199:head# 2024-02-10T08:39:13.462 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab511325:::benchmark_data_smithi018_166993_object57996:head# 2024-02-10T08:39:13.462 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab534adb:::benchmark_data_smithi018_166993_object37707:head# 2024-02-10T08:39:13.462 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab534b4f:::benchmark_data_smithi018_166993_object50522:head# 2024-02-10T08:39:13.463 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab536340:::benchmark_data_smithi018_166993_object55784:head# 2024-02-10T08:39:13.463 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab5387e6:::benchmark_data_smithi018_166993_object41988:head# 2024-02-10T08:39:13.466 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab53e9d1:::benchmark_data_smithi018_166993_object103055:head# 2024-02-10T08:39:13.466 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab5433b4:::benchmark_data_smithi018_166993_object74442:head# 2024-02-10T08:39:13.467 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab54f880:::benchmark_data_smithi018_166993_object115690:head# 2024-02-10T08:39:13.467 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab55b0d3:::benchmark_data_smithi018_166993_object65411:head# 2024-02-10T08:39:13.467 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab56c9fe:::benchmark_data_smithi018_166993_object91955:head# 2024-02-10T08:39:13.468 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab5872ba:::benchmark_data_smithi018_166993_object116666:head# 2024-02-10T08:39:13.468 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab58e44d:::benchmark_data_smithi018_166993_object59101:head# 2024-02-10T08:39:13.469 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab59c4b6:::benchmark_data_smithi018_166993_object30043:head# 2024-02-10T08:39:13.469 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab59ee57:::benchmark_data_smithi018_166993_object103520:head# 2024-02-10T08:39:13.470 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab5c6e2d:::benchmark_data_smithi018_166993_object109663:head# 2024-02-10T08:39:13.470 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:39:13.470 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab5d9961:::benchmark_data_smithi018_166993_object102536:head# 2024-02-10T08:39:13.471 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab5f509c:::benchmark_data_smithi018_166993_object82087:head# 2024-02-10T08:39:13.471 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab6031bf:::benchmark_data_smithi018_166993_object98165:head# 2024-02-10T08:39:13.472 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab61a5d0:::benchmark_data_smithi018_166993_object109222:head# 2024-02-10T08:39:13.472 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab61bb90:::benchmark_data_smithi018_166993_object61527:head# 2024-02-10T08:39:13.475 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab62d0b4:::benchmark_data_smithi018_166993_object17628:head# 2024-02-10T08:39:13.476 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab62f4af:::benchmark_data_smithi018_166993_object113194:head# 2024-02-10T08:39:13.477 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab64b326:::benchmark_data_smithi018_166993_object21842:head# 2024-02-10T08:39:13.477 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab64baf0:::benchmark_data_smithi018_166993_object70477:head# 2024-02-10T08:39:13.478 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab64eccf:::benchmark_data_smithi018_166993_object55098:head# 2024-02-10T08:39:13.480 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab6699d6:::benchmark_data_smithi018_166993_object84793:head# 2024-02-10T08:39:13.481 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab670231:::benchmark_data_smithi018_166993_object107247:head# 2024-02-10T08:39:13.481 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:13.482 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:39:13.482 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab683e51:::benchmark_data_smithi018_166993_object33770:head# 2024-02-10T08:39:13.482 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab69c06d:::benchmark_data_smithi018_166993_object112328:head# 2024-02-10T08:39:13.482 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab6ac6ab:::benchmark_data_smithi018_166993_object105901:head# 2024-02-10T08:39:13.483 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab6af969:::benchmark_data_smithi018_166993_object99572:head# 2024-02-10T08:39:13.483 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab6bb639:::benchmark_data_smithi018_166993_object78370:head# 2024-02-10T08:39:13.483 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab6bbffd:::benchmark_data_smithi018_166993_object25611:head# 2024-02-10T08:39:13.484 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab6c7c36:::benchmark_data_smithi018_166993_object94012:head# 2024-02-10T08:39:13.484 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab6e55c2:::benchmark_data_smithi018_166993_object104853:head# 2024-02-10T08:39:13.487 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab6fca72:::benchmark_data_smithi018_166993_object41796:head# 2024-02-10T08:39:13.493 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab6fde8c:::benchmark_data_smithi018_166993_object52887:head# 2024-02-10T08:39:13.493 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab717b31:::benchmark_data_smithi018_166993_object119035:head# 2024-02-10T08:39:13.494 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab72fe55:::benchmark_data_smithi018_166993_object37217:head# 2024-02-10T08:39:13.494 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab737794:::benchmark_data_smithi018_166993_object77108:head# 2024-02-10T08:39:13.495 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab75862f:::benchmark_data_smithi018_166993_object78086:head# 2024-02-10T08:39:13.500 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab7637c0:::benchmark_data_smithi018_166993_object21867:head# 2024-02-10T08:39:13.500 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab768e3e:::benchmark_data_smithi018_166993_object59524:head# 2024-02-10T08:39:13.500 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab76a636:::benchmark_data_smithi018_166993_object35707:head# 2024-02-10T08:39:13.500 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab76c5c3:::benchmark_data_smithi018_166993_object26869:head# 2024-02-10T08:39:13.500 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab7703d7:::benchmark_data_smithi018_166993_object34500:head# 2024-02-10T08:39:13.503 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab77a7e6:::benchmark_data_smithi018_166993_object41792:head# 2024-02-10T08:39:13.506 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab77e650:::benchmark_data_smithi018_166993_object79199:head# 2024-02-10T08:39:13.506 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab7b41f5:::benchmark_data_smithi018_166993_object92274:head# 2024-02-10T08:39:13.506 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab7ba093:::benchmark_data_smithi018_166993_object79889:head# 2024-02-10T08:39:13.515 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab7c1efe:::benchmark_data_smithi018_166993_object49125:head# 2024-02-10T08:39:13.515 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab7c4771:::benchmark_data_smithi018_166993_object107966:head# 2024-02-10T08:39:13.516 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab7c739a:::benchmark_data_smithi018_166993_object37806:head# 2024-02-10T08:39:13.516 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab7cef64:::benchmark_data_smithi018_166993_object109804:head# 2024-02-10T08:39:13.516 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab7dbe44:::benchmark_data_smithi018_166993_object37476:head# 2024-02-10T08:39:13.516 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab7dd2aa:::benchmark_data_smithi018_166993_object92480:head# 2024-02-10T08:39:13.516 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab7eec0d:::benchmark_data_smithi018_166993_object35226:head# 2024-02-10T08:39:13.518 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab7ef3c0:::benchmark_data_smithi018_166993_object104731:head# 2024-02-10T08:39:13.519 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab7f0d1b:::benchmark_data_smithi018_166993_object101810:head# 2024-02-10T08:39:13.519 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab7f7793:::benchmark_data_smithi018_166993_object22915:head# 2024-02-10T08:39:13.519 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab7faca8:::benchmark_data_smithi018_166993_object51383:head# 2024-02-10T08:39:13.520 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab809baf:::benchmark_data_smithi018_166993_object99651:head# 2024-02-10T08:39:13.520 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab816f39:::benchmark_data_smithi018_166993_object78480:head# 2024-02-10T08:39:13.521 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab821add:::benchmark_data_smithi018_166993_object76358:head# 2024-02-10T08:39:13.521 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab82c296:::benchmark_data_smithi018_166993_object90512:head# 2024-02-10T08:39:13.522 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab82f42c:::benchmark_data_smithi018_166993_object104039:head# 2024-02-10T08:39:13.522 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab85af1a:::benchmark_data_smithi018_166993_object37833:head# 2024-02-10T08:39:13.523 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab866f88:::benchmark_data_smithi018_166993_object66004:head# 2024-02-10T08:39:13.523 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab86aaa5:::benchmark_data_smithi018_166993_object21615:head# 2024-02-10T08:39:13.524 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab873df3:::benchmark_data_smithi018_166993_object91414:head# 2024-02-10T08:39:13.524 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab87a36a:::benchmark_data_smithi018_166993_object54167:head# 2024-02-10T08:39:13.527 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab88878f:::benchmark_data_smithi018_166993_object70755:head# 2024-02-10T08:39:13.527 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab89a09c:::benchmark_data_smithi018_166993_object91584:head# 2024-02-10T08:39:13.527 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab89e8b1:::benchmark_data_smithi018_166993_object52061:head# 2024-02-10T08:39:13.528 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab8a2543:::benchmark_data_smithi018_166993_object20845:head# 2024-02-10T08:39:13.528 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab8b520f:::benchmark_data_smithi018_166993_object72398:head# 2024-02-10T08:39:13.528 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab8bbd3c:::benchmark_data_smithi018_166993_object106157:head# 2024-02-10T08:39:13.528 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab8c0f5e:::benchmark_data_smithi018_166993_object70784:head# 2024-02-10T08:39:13.530 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab8c3315:::benchmark_data_smithi018_166993_object34295:head# 2024-02-10T08:39:13.530 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab8c9932:::benchmark_data_smithi018_166993_object57293:head# 2024-02-10T08:39:13.531 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab8df167:::benchmark_data_smithi018_166993_object61321:head# 2024-02-10T08:39:13.531 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab8e020d:::benchmark_data_smithi018_166993_object25415:head# 2024-02-10T08:39:13.535 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab8f129d:::benchmark_data_smithi018_166993_object70417:head# 2024-02-10T08:39:13.535 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab8f74e6:::benchmark_data_smithi018_166993_object71233:head# 2024-02-10T08:39:13.535 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab8faf1a:::benchmark_data_smithi018_166993_object94373:head# 2024-02-10T08:39:13.536 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab8feec5:::benchmark_data_smithi018_166993_object64460:head# 2024-02-10T08:39:13.536 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab90c72f:::benchmark_data_smithi018_166993_object111716:head# 2024-02-10T08:39:13.537 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab919c37:::benchmark_data_smithi018_166993_object58408:head# 2024-02-10T08:39:13.537 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab9371fa:::benchmark_data_smithi018_166993_object55019:head# 2024-02-10T08:39:13.538 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab944f2e:::benchmark_data_smithi018_166993_object55178:head# 2024-02-10T08:39:13.538 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab94f499:::benchmark_data_smithi018_166993_object74261:head# 2024-02-10T08:39:13.541 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab96976d:::benchmark_data_smithi018_166993_object34427:head# 2024-02-10T08:39:13.541 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab96a9e9:::benchmark_data_smithi018_166993_object87995:head# 2024-02-10T08:39:13.541 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab96b019:::benchmark_data_smithi018_166993_object57467:head# 2024-02-10T08:39:13.541 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab97554b:::benchmark_data_smithi018_166993_object20460:head# 2024-02-10T08:39:13.541 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab978c5f:::benchmark_data_smithi018_166993_object48044:head# 2024-02-10T08:39:13.542 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab97f2a3:::benchmark_data_smithi018_166993_object85030:head# 2024-02-10T08:39:13.548 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab981562:::benchmark_data_smithi018_166993_object41322:head# 2024-02-10T08:39:13.548 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab98489c:::benchmark_data_smithi018_166993_object69026:head# 2024-02-10T08:39:13.548 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab986dd4:::benchmark_data_smithi018_166993_object47932:head# 2024-02-10T08:39:13.548 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab98f5a2:::benchmark_data_smithi018_166993_object104454:head# 2024-02-10T08:39:13.548 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab99011e:::benchmark_data_smithi018_166993_object30539:head# 2024-02-10T08:39:13.549 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab990932:::benchmark_data_smithi018_166993_object91561:head# 2024-02-10T08:39:13.554 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab99112c:::benchmark_data_smithi018_166993_object34224:head# 2024-02-10T08:39:13.554 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab991e82:::benchmark_data_smithi018_166993_object70789:head# 2024-02-10T08:39:13.554 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab992a14:::benchmark_data_smithi018_166993_object34788:head# 2024-02-10T08:39:13.554 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab9a4a19:::benchmark_data_smithi018_166993_object80970:head# 2024-02-10T08:39:13.554 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab9a64c0:::benchmark_data_smithi018_166993_object69770:head# 2024-02-10T08:39:13.554 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab9ac35f:::benchmark_data_smithi018_166993_object65391:head# 2024-02-10T08:39:13.561 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab9af3dc:::benchmark_data_smithi018_166993_object42764:head# 2024-02-10T08:39:13.561 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab9c0e16:::benchmark_data_smithi018_166993_object41510:head# 2024-02-10T08:39:13.561 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab9c23a0:::benchmark_data_smithi018_166993_object70218:head# 2024-02-10T08:39:13.562 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab9cb8db:::benchmark_data_smithi018_166993_object106468:head# 2024-02-10T08:39:13.562 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab9cdb8d:::benchmark_data_smithi018_166993_object33157:head# 2024-02-10T08:39:13.562 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab9d4976:::benchmark_data_smithi018_166993_object20209:head# 2024-02-10T08:39:13.564 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab9d72b9:::benchmark_data_smithi018_166993_object80104:head# 2024-02-10T08:39:13.564 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab9db24b:::benchmark_data_smithi018_166993_object57888:head# 2024-02-10T08:39:13.565 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab9e26dd:::benchmark_data_smithi018_166993_object50671:head# 2024-02-10T08:39:13.565 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ab9e91ba:::benchmark_data_smithi018_166993_object34147:head# 2024-02-10T08:39:13.565 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aba15c19:::benchmark_data_smithi018_166993_object78706:head# 2024-02-10T08:39:13.566 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aba19f36:::benchmark_data_smithi018_166993_object81864:head# 2024-02-10T08:39:13.567 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aba2067f:::benchmark_data_smithi018_166993_object40824:head# 2024-02-10T08:39:13.567 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aba23054:::benchmark_data_smithi018_166993_object92593:head# 2024-02-10T08:39:13.567 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aba4c450:::benchmark_data_smithi018_166993_object80807:head# 2024-02-10T08:39:13.568 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aba4c5ab:::benchmark_data_smithi018_166993_object37095:head# 2024-02-10T08:39:13.568 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aba51dc7:::benchmark_data_smithi018_166993_object41790:head# 2024-02-10T08:39:13.570 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aba56cff:::benchmark_data_smithi018_166993_object24756:head# 2024-02-10T08:39:13.571 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aba5758b:::benchmark_data_smithi018_166993_object64871:head# 2024-02-10T08:39:13.571 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aba59eaf:::benchmark_data_smithi018_166993_object99851:head# 2024-02-10T08:39:13.571 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aba5e079:::benchmark_data_smithi018_166993_object116384:head# 2024-02-10T08:39:13.571 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aba7344b:::benchmark_data_smithi018_166993_object43702:head# 2024-02-10T08:39:13.571 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aba73fb0:::benchmark_data_smithi018_166993_object112686:head# 2024-02-10T08:39:13.571 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aba7491b:::benchmark_data_smithi018_166993_object47359:head# 2024-02-10T08:39:13.572 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aba800a0:::benchmark_data_smithi018_166993_object117275:head# 2024-02-10T08:39:13.572 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aba96d89:::benchmark_data_smithi018_166993_object59263:head# 2024-02-10T08:39:13.573 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aba98262:::benchmark_data_smithi018_166993_object92457:head# 2024-02-10T08:39:13.573 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abaa20e1:::benchmark_data_smithi018_166993_object109664:head# 2024-02-10T08:39:13.574 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ababee75:::benchmark_data_smithi018_166993_object97289:head# 2024-02-10T08:39:13.574 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abac0cbd:::benchmark_data_smithi018_166993_object105786:head# 2024-02-10T08:39:13.575 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abac4160:::benchmark_data_smithi018_166993_object118930:head# 2024-02-10T08:39:13.575 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abac7792:::benchmark_data_smithi018_166993_object77197:head# 2024-02-10T08:39:13.578 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abacb8a7:::benchmark_data_smithi018_166993_object32595:head# 2024-02-10T08:39:13.578 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abad88da:::benchmark_data_smithi018_166993_object31078:head# 2024-02-10T08:39:13.583 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:39:13.583 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abae5dca:::benchmark_data_smithi018_166993_object67582:head# 2024-02-10T08:39:13.583 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abaf66ef:::benchmark_data_smithi018_166993_object37358:head# 2024-02-10T08:39:13.584 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abafbc44:::benchmark_data_smithi018_166993_object46225:head# 2024-02-10T08:39:13.584 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abb0498a:::benchmark_data_smithi018_166993_object21395:head# 2024-02-10T08:39:13.586 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abb0803e:::benchmark_data_smithi018_166993_object59790:head# 2024-02-10T08:39:13.587 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abb0c533:::benchmark_data_smithi018_166993_object110228:head# 2024-02-10T08:39:13.587 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abb1e568:::benchmark_data_smithi018_166993_object56033:head# 2024-02-10T08:39:13.587 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abb206c0:::benchmark_data_smithi018_166993_object70310:head# 2024-02-10T08:39:13.587 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abb24a52:::benchmark_data_smithi018_166993_object58526:head# 2024-02-10T08:39:13.587 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abb2c64a:::benchmark_data_smithi018_166993_object92024:head# 2024-02-10T08:39:13.587 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abb3e7e8:::benchmark_data_smithi018_166993_object114170:head# 2024-02-10T08:39:13.587 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abb440b1:::benchmark_data_smithi018_166993_object28453:head# 2024-02-10T08:39:13.587 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abb47559:::benchmark_data_smithi018_166993_object82309:head# 2024-02-10T08:39:13.588 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abb4cc1b:::benchmark_data_smithi018_166993_object34208:head# 2024-02-10T08:39:13.588 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abb4d777:::benchmark_data_smithi018_166993_object75292:head# 2024-02-10T08:39:13.588 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abb512b9:::benchmark_data_smithi018_166993_object28986:head# 2024-02-10T08:39:13.590 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abb58996:::benchmark_data_smithi018_166993_object44079:head# 2024-02-10T08:39:13.590 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abb74e45:::benchmark_data_smithi018_166993_object83296:head# 2024-02-10T08:39:13.591 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abba1a96:::benchmark_data_smithi018_166993_object39287:head# 2024-02-10T08:39:13.591 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abbbc43d:::benchmark_data_smithi018_166993_object35003:head# 2024-02-10T08:39:13.591 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abbd829d:::benchmark_data_smithi018_166993_object80468:head# 2024-02-10T08:39:13.591 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abbdc008:::benchmark_data_smithi018_166993_object67977:head# 2024-02-10T08:39:13.591 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abbde940:::benchmark_data_smithi018_166993_object76618:head# 2024-02-10T08:39:13.592 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abbeb0d0:::benchmark_data_smithi018_166993_object69930:head# 2024-02-10T08:39:13.594 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abbf69c2:::benchmark_data_smithi018_166993_object97523:head# 2024-02-10T08:39:13.594 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abc1353b:::benchmark_data_smithi018_166993_object111401:head# 2024-02-10T08:39:13.595 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abc18066:::benchmark_data_smithi018_166993_object90404:head# 2024-02-10T08:39:13.595 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abc21ea3:::benchmark_data_smithi018_166993_object103369:head# 2024-02-10T08:39:13.595 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abc2dac1:::benchmark_data_smithi018_166993_object95773:head# 2024-02-10T08:39:13.595 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abc327e2:::benchmark_data_smithi018_166993_object25963:head# 2024-02-10T08:39:13.595 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abc3d0d6:::benchmark_data_smithi018_166993_object17703:head# 2024-02-10T08:39:13.596 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abc3db09:::benchmark_data_smithi018_166993_object34693:head# 2024-02-10T08:39:13.596 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abc472bc:::benchmark_data_smithi018_166993_object87089:head# 2024-02-10T08:39:13.597 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abc4e65e:::benchmark_data_smithi018_166993_object40275:head# 2024-02-10T08:39:13.598 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abc4eb27:::benchmark_data_smithi018_166993_object53774:head# 2024-02-10T08:39:13.598 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abc51bb5:::benchmark_data_smithi018_166993_object37133:head# 2024-02-10T08:39:13.599 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abc7286e:::benchmark_data_smithi018_166993_object75427:head# 2024-02-10T08:39:13.599 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abc7add3:::benchmark_data_smithi018_166993_object36818:head# 2024-02-10T08:39:13.600 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abc8d0b3:::benchmark_data_smithi018_166993_object24416:head# 2024-02-10T08:39:13.601 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abca7f1c:::benchmark_data_smithi018_166993_object25982:head# 2024-02-10T08:39:13.603 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abca7fdd:::benchmark_data_smithi018_166993_object81333:head# 2024-02-10T08:39:13.603 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abcafa65:::benchmark_data_smithi018_166993_object39769:head# 2024-02-10T08:39:13.604 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abcb0e09:::benchmark_data_smithi018_166993_object21460:head# 2024-02-10T08:39:13.610 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abcc50a8:::benchmark_data_smithi018_166993_object47760:head# 2024-02-10T08:39:13.610 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abceae44:::benchmark_data_smithi018_166993_object20389:head# 2024-02-10T08:39:13.610 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abcf0525:::benchmark_data_smithi018_166993_object61018:head# 2024-02-10T08:39:13.610 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abd0631d:::benchmark_data_smithi018_166993_object93062:head# 2024-02-10T08:39:13.611 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abd0e882:::benchmark_data_smithi018_166993_object22437:head# 2024-02-10T08:39:13.611 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abd19145:::benchmark_data_smithi018_166993_object51511:head# 2024-02-10T08:39:13.611 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abd25764:::benchmark_data_smithi018_166993_object75682:head# 2024-02-10T08:39:13.611 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abd49f88:::benchmark_data_smithi018_166993_object93021:head# 2024-02-10T08:39:13.611 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abd5b54c:::benchmark_data_smithi018_166993_object98641:head# 2024-02-10T08:39:13.611 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abd5d26f:::benchmark_data_smithi018_166993_object91792:head# 2024-02-10T08:39:13.612 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abd68e58:::benchmark_data_smithi018_166993_object104232:head# 2024-02-10T08:39:13.612 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abd696f0:::benchmark_data_smithi018_166993_object91464:head# 2024-02-10T08:39:13.612 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abd98167:::benchmark_data_smithi018_166993_object86907:head# 2024-02-10T08:39:13.613 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abda9bc9:::benchmark_data_smithi018_166993_object111419:head# 2024-02-10T08:39:13.613 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abdabc14:::benchmark_data_smithi018_166993_object28165:head# 2024-02-10T08:39:13.613 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abdac154:::benchmark_data_smithi018_166993_object117151:head# 2024-02-10T08:39:13.619 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abdb1efa:::benchmark_data_smithi018_166993_object80124:head# 2024-02-10T08:39:13.619 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abdb99d5:::benchmark_data_smithi018_166993_object98863:head# 2024-02-10T08:39:13.621 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abdbc40c:::benchmark_data_smithi018_166993_object102878:head# 2024-02-10T08:39:13.621 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abdc14d5:::benchmark_data_smithi018_166993_object85554:head# 2024-02-10T08:39:13.621 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abdc7de1:::benchmark_data_smithi018_166993_object23677:head# 2024-02-10T08:39:13.621 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abdd15d9:::benchmark_data_smithi018_166993_object84444:head# 2024-02-10T08:39:13.622 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abdf0652:::benchmark_data_smithi018_166993_object104857:head# 2024-02-10T08:39:13.630 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abdf63db:::benchmark_data_smithi018_166993_object57367:head# 2024-02-10T08:39:13.630 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abe0cc7e:::benchmark_data_smithi018_166993_object69646:head# 2024-02-10T08:39:13.630 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abe1b0c6:::benchmark_data_smithi018_166993_object36253:head# 2024-02-10T08:39:13.631 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abe2caf6:::benchmark_data_smithi018_166993_object102533:head# 2024-02-10T08:39:13.631 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abe56e74:::benchmark_data_smithi018_166993_object36752:head# 2024-02-10T08:39:13.631 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abe62167:::benchmark_data_smithi018_166993_object48551:head# 2024-02-10T08:39:13.631 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abe72ae0:::benchmark_data_smithi018_166993_object44912:head# 2024-02-10T08:39:13.632 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abe77ef9:::benchmark_data_smithi018_166993_object114259:head# 2024-02-10T08:39:13.632 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abe79ef3:::benchmark_data_smithi018_166993_object60951:head# 2024-02-10T08:39:13.632 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abe802c6:::benchmark_data_smithi018_166993_object20194:head# 2024-02-10T08:39:13.633 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abe9b039:::benchmark_data_smithi018_166993_object93477:head# 2024-02-10T08:39:13.635 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abea09c1:::benchmark_data_smithi018_166993_object46474:head# 2024-02-10T08:39:13.636 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abeac497:::benchmark_data_smithi018_166993_object61073:head# 2024-02-10T08:39:13.636 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abeb0b43:::benchmark_data_smithi018_166993_object72884:head# 2024-02-10T08:39:13.636 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abec6db9:::benchmark_data_smithi018_166993_object17673:head# 2024-02-10T08:39:13.636 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abee4584:::benchmark_data_smithi018_166993_object97485:head# 2024-02-10T08:39:13.638 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:13.639 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abee7aa2:::benchmark_data_smithi018_166993_object38984:head# 2024-02-10T08:39:13.641 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abee8083:::benchmark_data_smithi018_166993_object74009:head# 2024-02-10T08:39:13.641 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abefcb49:::benchmark_data_smithi018_166993_object63540:head# 2024-02-10T08:39:13.641 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abf1210a:::benchmark_data_smithi018_166993_object61568:head# 2024-02-10T08:39:13.642 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abf252a0:::benchmark_data_smithi018_166993_object86723:head# 2024-02-10T08:39:13.643 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abf2a98e:::benchmark_data_smithi018_166993_object48629:head# 2024-02-10T08:39:13.644 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abf2bb34:::benchmark_data_smithi018_166993_object81508:head# 2024-02-10T08:39:13.644 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abf36143:::benchmark_data_smithi018_166993_object102688:head# 2024-02-10T08:39:13.648 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abf40985:::benchmark_data_smithi018_166993_object57053:head# 2024-02-10T08:39:13.648 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abf58373:::benchmark_data_smithi018_166993_object60941:head# 2024-02-10T08:39:13.648 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abf65d89:::benchmark_data_smithi018_166993_object106330:head# 2024-02-10T08:39:13.648 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abf75049:::benchmark_data_smithi018_166993_object69196:head# 2024-02-10T08:39:13.649 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abf7c126:::benchmark_data_smithi018_166993_object101759:head# 2024-02-10T08:39:13.649 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abf8ff25:::benchmark_data_smithi018_166993_object92517:head# 2024-02-10T08:39:13.651 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abfc1dba:::benchmark_data_smithi018_166993_object96714:head# 2024-02-10T08:39:13.653 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abfc3d6e:::benchmark_data_smithi018_166993_object48057:head# 2024-02-10T08:39:13.653 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abfda440:::benchmark_data_smithi018_166993_object96068:head# 2024-02-10T08:39:13.655 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abfed172:::benchmark_data_smithi018_166993_object49257:head# 2024-02-10T08:39:13.655 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abff1e12:::benchmark_data_smithi018_166993_object113734:head# 2024-02-10T08:39:13.655 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:abffa8f3:::benchmark_data_smithi018_166993_object51450:head# 2024-02-10T08:39:13.657 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac0095a0:::benchmark_data_smithi018_166993_object111066:head# 2024-02-10T08:39:13.657 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac010581:::benchmark_data_smithi018_166993_object49883:head# 2024-02-10T08:39:13.658 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac018e5e:::benchmark_data_smithi018_166993_object44141:head# 2024-02-10T08:39:13.659 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac024805:::benchmark_data_smithi018_166993_object47890:head# 2024-02-10T08:39:13.659 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac03a715:::benchmark_data_smithi018_166993_object110409:head# 2024-02-10T08:39:13.660 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac03d537:::benchmark_data_smithi018_166993_object75129:head# 2024-02-10T08:39:13.660 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac0402d2:::benchmark_data_smithi018_166993_object105233:head# 2024-02-10T08:39:13.664 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac0533c5:::benchmark_data_smithi018_166993_object107065:head# 2024-02-10T08:39:13.664 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac0557fb:::benchmark_data_smithi018_166993_object105671:head# 2024-02-10T08:39:13.664 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac05fe04:::benchmark_data_smithi018_166993_object84728:head# 2024-02-10T08:39:13.664 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac064857:::benchmark_data_smithi018_166993_object82279:head# 2024-02-10T08:39:13.664 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac075f9e:::benchmark_data_smithi018_166993_object101701:head# 2024-02-10T08:39:13.668 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac087982:::benchmark_data_smithi018_166993_object72784:head# 2024-02-10T08:39:13.668 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac0887d3:::benchmark_data_smithi018_166993_object84230:head# 2024-02-10T08:39:13.668 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac08ea65:::benchmark_data_smithi018_166993_object62042:head# 2024-02-10T08:39:13.668 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac0925e9:::benchmark_data_smithi018_166993_object51530:head# 2024-02-10T08:39:13.670 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac0964b2:::benchmark_data_smithi018_166993_object32614:head# 2024-02-10T08:39:13.672 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac0a0621:::benchmark_data_smithi018_166993_object83546:head# 2024-02-10T08:39:13.672 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac0a3c89:::benchmark_data_smithi018_166993_object91296:head# 2024-02-10T08:39:13.672 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac0b1625:::benchmark_data_smithi018_166993_object59391:head# 2024-02-10T08:39:13.673 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac0b3464:::benchmark_data_smithi018_166993_object24645:head# 2024-02-10T08:39:13.673 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac0c07d2:::benchmark_data_smithi018_166993_object101386:head# 2024-02-10T08:39:13.673 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac0c8ba7:::benchmark_data_smithi018_166993_object57403:head# 2024-02-10T08:39:13.673 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac0d4598:::benchmark_data_smithi018_166993_object22028:head# 2024-02-10T08:39:13.673 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac0dad2e:::benchmark_data_smithi018_166993_object89565:head# 2024-02-10T08:39:13.673 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac0e11e6:::benchmark_data_smithi018_166993_object56103:head# 2024-02-10T08:39:13.674 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac0f20e5:::benchmark_data_smithi018_166993_object40722:head# 2024-02-10T08:39:13.674 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac0fd77d:::benchmark_data_smithi018_166993_object45982:head# 2024-02-10T08:39:13.677 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac11bdc4:::benchmark_data_smithi018_166993_object66608:head# 2024-02-10T08:39:13.678 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac11e3cc:::benchmark_data_smithi018_166993_object23293:head# 2024-02-10T08:39:13.678 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac128014:::benchmark_data_smithi018_166993_object85679:head# 2024-02-10T08:39:13.679 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac149c80:::benchmark_data_smithi018_166993_object95208:head# 2024-02-10T08:39:13.679 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac14c72c:::benchmark_data_smithi018_166993_object54369:head# 2024-02-10T08:39:13.680 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac15d059:::benchmark_data_smithi018_166993_object61246:head# 2024-02-10T08:39:13.680 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac16c15e:::benchmark_data_smithi018_166993_object29393:head# 2024-02-10T08:39:13.681 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac16ff1a:::benchmark_data_smithi018_166993_object76855:head# 2024-02-10T08:39:13.682 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac177357:::benchmark_data_smithi018_166993_object80720:head# 2024-02-10T08:39:13.684 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac18597d:::benchmark_data_smithi018_166993_object58782:head# 2024-02-10T08:39:13.684 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac185ee1:::benchmark_data_smithi018_166993_object19873:head# 2024-02-10T08:39:13.684 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac186df8:::benchmark_data_smithi018_166993_object95975:head# 2024-02-10T08:39:13.684 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac1939ca:::benchmark_data_smithi018_166993_object73407:head# 2024-02-10T08:39:13.684 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac19b51f:::benchmark_data_smithi018_166993_object62153:head# 2024-02-10T08:39:13.687 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac19bc9f:::benchmark_data_smithi018_166993_object64450:head# 2024-02-10T08:39:13.687 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac1a925d:::benchmark_data_smithi018_166993_object86237:head# 2024-02-10T08:39:13.687 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac1b6b41:::benchmark_data_smithi018_166993_object87275:head# 2024-02-10T08:39:13.688 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac1cb582:::benchmark_data_smithi018_166993_object66179:head# 2024-02-10T08:39:13.690 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac1cfad4:::benchmark_data_smithi018_166993_object66747:head# 2024-02-10T08:39:13.690 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac1d1391:::benchmark_data_smithi018_166993_object95532:head# 2024-02-10T08:39:13.691 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac1d5350:::benchmark_data_smithi018_166993_object87616:head# 2024-02-10T08:39:13.694 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac1d58c7:::benchmark_data_smithi018_166993_object52627:head# 2024-02-10T08:39:13.694 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac1dd754:::benchmark_data_smithi018_166993_object88966:head# 2024-02-10T08:39:13.694 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac1e18b6:::benchmark_data_smithi018_166993_object48567:head# 2024-02-10T08:39:13.695 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac1ebafe:::benchmark_data_smithi018_166993_object65755:head# 2024-02-10T08:39:13.696 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac1ec21b:::benchmark_data_smithi018_166993_object104929:head# 2024-02-10T08:39:13.696 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac1fe101:::benchmark_data_smithi018_166993_object54593:head# 2024-02-10T08:39:13.698 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac1ff0ee:::benchmark_data_smithi018_166993_object29190:head# 2024-02-10T08:39:13.698 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac208da2:::benchmark_data_smithi018_166993_object24196:head# 2024-02-10T08:39:13.699 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac20a733:::benchmark_data_smithi018_166993_object49663:head# 2024-02-10T08:39:13.699 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac20edcd:::benchmark_data_smithi018_166993_object99297:head# 2024-02-10T08:39:13.701 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac2190f6:::benchmark_data_smithi018_166993_object64779:head# 2024-02-10T08:39:13.701 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac22fef2:::benchmark_data_smithi018_166993_object47249:head# 2024-02-10T08:39:13.701 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac249c2a:::benchmark_data_smithi018_166993_object90753:head# 2024-02-10T08:39:13.702 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac27a826:::benchmark_data_smithi018_166993_object48411:head# 2024-02-10T08:39:13.702 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac27b311:::benchmark_data_smithi018_166993_object48884:head# 2024-02-10T08:39:13.705 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac27ffa3:::benchmark_data_smithi018_166993_object34698:head# 2024-02-10T08:39:13.705 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac28882f:::benchmark_data_smithi018_166993_object77535:head# 2024-02-10T08:39:13.705 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac28b7bb:::benchmark_data_smithi018_166993_object41431:head# 2024-02-10T08:39:13.705 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac28ff57:::benchmark_data_smithi018_166993_object38592:head# 2024-02-10T08:39:13.705 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac2a3a71:::benchmark_data_smithi018_166993_object87465:head# 2024-02-10T08:39:13.705 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac2c49cc:::benchmark_data_smithi018_166993_object56083:head# 2024-02-10T08:39:13.705 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac2c8fbf:::benchmark_data_smithi018_166993_object94913:head# 2024-02-10T08:39:13.706 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac2d72f0:::benchmark_data_smithi018_166993_object98418:head# 2024-02-10T08:39:13.706 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac2f8b04:::benchmark_data_smithi018_166993_object117016:head# 2024-02-10T08:39:13.707 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac3045be:::benchmark_data_smithi018_166993_object95949:head# 2024-02-10T08:39:13.707 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac32bff5:::benchmark_data_smithi018_166993_object99041:head# 2024-02-10T08:39:13.707 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac32d505:::benchmark_data_smithi018_166993_object52888:head# 2024-02-10T08:39:13.708 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac3334b6:::benchmark_data_smithi018_166993_object78777:head# 2024-02-10T08:39:13.708 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac336747:::benchmark_data_smithi018_166993_object54027:head# 2024-02-10T08:39:13.709 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac337187:::benchmark_data_smithi018_166993_object84118:head# 2024-02-10T08:39:13.709 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac353b52:::benchmark_data_smithi018_166993_object102338:head# 2024-02-10T08:39:13.710 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac35a241:::benchmark_data_smithi018_166993_object111128:head# 2024-02-10T08:39:13.711 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac35d82b:::benchmark_data_smithi018_166993_object44443:head# 2024-02-10T08:39:13.711 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac3667a4:::benchmark_data_smithi018_166993_object96354:head# 2024-02-10T08:39:13.712 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac375d72:::benchmark_data_smithi018_166993_object104888:head# 2024-02-10T08:39:13.712 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac37abe4:::benchmark_data_smithi018_166993_object62201:head# 2024-02-10T08:39:13.712 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac37e243:::benchmark_data_smithi018_166993_object61353:head# 2024-02-10T08:39:13.713 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac3853a9:::benchmark_data_smithi018_166993_object84170:head# 2024-02-10T08:39:13.713 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac394e64:::benchmark_data_smithi018_166993_object100152:head# 2024-02-10T08:39:13.714 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac39902f:::benchmark_data_smithi018_166993_object40032:head# 2024-02-10T08:39:13.714 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac3a6151:::benchmark_data_smithi018_166993_object81726:head# 2024-02-10T08:39:13.715 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac3be358:::benchmark_data_smithi018_166993_object30005:head# 2024-02-10T08:39:13.715 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac3d03be:::benchmark_data_smithi018_166993_object55615:head# 2024-02-10T08:39:13.720 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac3f0773:::benchmark_data_smithi018_166993_object74064:head# 2024-02-10T08:39:13.723 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac3fad6c:::benchmark_data_smithi018_166993_object83228:head# 2024-02-10T08:39:13.724 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac3fec94:::benchmark_data_smithi018_166993_object37858:head# 2024-02-10T08:39:13.727 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac400026:::benchmark_data_smithi018_166993_object71634:head# 2024-02-10T08:39:13.728 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac40dbb5:::benchmark_data_smithi018_166993_object109566:head# 2024-02-10T08:39:13.728 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac41ffa5:::benchmark_data_smithi018_166993_object118554:head# 2024-02-10T08:39:13.728 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac4347aa:::benchmark_data_smithi018_166993_object92713:head# 2024-02-10T08:39:13.728 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac436947:::benchmark_data_smithi018_166993_object101629:head# 2024-02-10T08:39:13.728 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac43ac9d:::benchmark_data_smithi018_166993_object37197:head# 2024-02-10T08:39:13.728 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac440ca1:::benchmark_data_smithi018_166993_object41471:head# 2024-02-10T08:39:13.728 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac447c1f:::benchmark_data_smithi018_166993_object35187:head# 2024-02-10T08:39:13.730 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac45c810:::benchmark_data_smithi018_166993_object18818:head# 2024-02-10T08:39:13.733 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac46112f:::benchmark_data_smithi018_166993_object60528:head# 2024-02-10T08:39:13.734 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac46c340:::benchmark_data_smithi018_166993_object37740:head# 2024-02-10T08:39:13.734 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac46e500:::benchmark_data_smithi018_166993_object34087:head# 2024-02-10T08:39:13.735 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac474b9f:::benchmark_data_smithi018_166993_object79527:head# 2024-02-10T08:39:13.739 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac48e993:::benchmark_data_smithi018_166993_object45072:head# 2024-02-10T08:39:13.739 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac49b58b:::benchmark_data_smithi018_166993_object22637:head# 2024-02-10T08:39:13.739 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac4a553f:::benchmark_data_smithi018_166993_object81767:head# 2024-02-10T08:39:13.743 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac4a9279:::benchmark_data_smithi018_166993_object75183:head# 2024-02-10T08:39:13.744 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac4aa224:::benchmark_data_smithi018_166993_object48357:head# 2024-02-10T08:39:13.745 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac4d01f4:::benchmark_data_smithi018_166993_object82080:head# 2024-02-10T08:39:13.745 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac4e43a3:::benchmark_data_smithi018_166993_object78998:head# 2024-02-10T08:39:13.748 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac4fc1eb:::benchmark_data_smithi018_166993_object112771:head# 2024-02-10T08:39:13.748 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac510743:::benchmark_data_smithi018_166993_object74715:head# 2024-02-10T08:39:13.748 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac5179bb:::benchmark_data_smithi018_166993_object64439:head# 2024-02-10T08:39:13.754 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac52c67f:::benchmark_data_smithi018_166993_object37076:head# 2024-02-10T08:39:13.755 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac53ac7f:::benchmark_data_smithi018_166993_object63142:head# 2024-02-10T08:39:13.757 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac553991:::benchmark_data_smithi018_166993_object112930:head# 2024-02-10T08:39:13.760 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac55a3f5:::benchmark_data_smithi018_166993_object103539:head# 2024-02-10T08:39:13.763 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac577fcb:::benchmark_data_smithi018_166993_object27604:head# 2024-02-10T08:39:13.763 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac594662:::benchmark_data_smithi018_166993_object106632:head# 2024-02-10T08:39:13.763 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac59504f:::benchmark_data_smithi018_166993_object22502:head# 2024-02-10T08:39:13.764 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac59798c:::benchmark_data_smithi018_166993_object36871:head# 2024-02-10T08:39:13.764 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac598853:::benchmark_data_smithi018_166993_object82022:head# 2024-02-10T08:39:13.765 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac5990b5:::benchmark_data_smithi018_166993_object72665:head# 2024-02-10T08:39:13.765 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac59aa8c:::benchmark_data_smithi018_166993_object60325:head# 2024-02-10T08:39:13.767 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac5a2db4:::benchmark_data_smithi018_166993_object68024:head# 2024-02-10T08:39:13.768 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac5a4c29:::benchmark_data_smithi018_166993_object107685:head# 2024-02-10T08:39:13.769 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac5bbfab:::benchmark_data_smithi018_166993_object84741:head# 2024-02-10T08:39:13.769 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac5e0f76:::benchmark_data_smithi018_166993_object72569:head# 2024-02-10T08:39:13.769 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac609e26:::benchmark_data_smithi018_166993_object77620:head# 2024-02-10T08:39:13.771 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac60ff4d:::benchmark_data_smithi018_166993_object80262:head# 2024-02-10T08:39:13.772 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac61832e:::benchmark_data_smithi018_166993_object56429:head# 2024-02-10T08:39:13.773 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac61ba72:::benchmark_data_smithi018_166993_object105389:head# 2024-02-10T08:39:13.777 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac62995d:::benchmark_data_smithi018_166993_object73005:head# 2024-02-10T08:39:13.779 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac63331c:::benchmark_data_smithi018_166993_object119084:head# 2024-02-10T08:39:13.779 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac645d8a:::benchmark_data_smithi018_166993_object27108:head# 2024-02-10T08:39:13.783 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac672e51:::benchmark_data_smithi018_166993_object107889:head# 2024-02-10T08:39:13.783 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac677bf1:::benchmark_data_smithi018_166993_object90240:head# 2024-02-10T08:39:13.783 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac67a686:::benchmark_data_smithi018_166993_object50871:head# 2024-02-10T08:39:13.783 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac67b239:::benchmark_data_smithi018_166993_object18569:head# 2024-02-10T08:39:13.783 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac684b00:::benchmark_data_smithi018_166993_object82938:head# 2024-02-10T08:39:13.783 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac68d565:::benchmark_data_smithi018_166993_object35988:head# 2024-02-10T08:39:13.784 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac68e367:::benchmark_data_smithi018_166993_object110925:head# 2024-02-10T08:39:13.786 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac6b3123:::benchmark_data_smithi018_166993_object94938:head# 2024-02-10T08:39:13.786 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac6b6146:::benchmark_data_smithi018_166993_object70858:head# 2024-02-10T08:39:13.789 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac6d6ae5:::benchmark_data_smithi018_166993_object106910:head# 2024-02-10T08:39:13.789 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac6dc93c:::benchmark_data_smithi018_166993_object45390:head# 2024-02-10T08:39:13.789 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac6e2721:::benchmark_data_smithi018_166993_object26515:head# 2024-02-10T08:39:13.790 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac6eb4bc:::benchmark_data_smithi018_166993_object100635:head# 2024-02-10T08:39:13.792 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac7013ed:::benchmark_data_smithi018_166993_object117958:head# 2024-02-10T08:39:13.792 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac70a130:::benchmark_data_smithi018_166993_object23156:head# 2024-02-10T08:39:13.792 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac750bc1:::benchmark_data_smithi018_166993_object114332:head# 2024-02-10T08:39:13.792 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac7533a6:::benchmark_data_smithi018_166993_object48751:head# 2024-02-10T08:39:13.793 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac753ad0:::benchmark_data_smithi018_166993_object102654:head# 2024-02-10T08:39:13.793 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac75602e:::benchmark_data_smithi018_166993_object98132:head# 2024-02-10T08:39:13.793 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac778d5b:::benchmark_data_smithi018_166993_object59098:head# 2024-02-10T08:39:13.794 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac77aa5b:::benchmark_data_smithi018_166993_object64380:head# 2024-02-10T08:39:13.794 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac786ee5:::benchmark_data_smithi018_166993_object90563:head# 2024-02-10T08:39:13.796 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac793544:::benchmark_data_smithi018_166993_object116938:head# 2024-02-10T08:39:13.796 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac79c44d:::benchmark_data_smithi018_166993_object96096:head# 2024-02-10T08:39:13.797 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac7a206e:::benchmark_data_smithi018_166993_object117228:head# 2024-02-10T08:39:13.802 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac7a75bd:::benchmark_data_smithi018_166993_object97390:head# 2024-02-10T08:39:13.802 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac7aa329:::benchmark_data_smithi018_166993_object65704:head# 2024-02-10T08:39:13.802 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac7aa82c:::benchmark_data_smithi018_166993_object94187:head# 2024-02-10T08:39:13.802 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac7ac7dc:::benchmark_data_smithi018_166993_object99800:head# 2024-02-10T08:39:13.803 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac7ad61f:::benchmark_data_smithi018_166993_object61842:head# 2024-02-10T08:39:13.808 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac7c3b60:::benchmark_data_smithi018_166993_object41087:head# 2024-02-10T08:39:13.811 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac7c40a5:::benchmark_data_smithi018_166993_object85275:head# 2024-02-10T08:39:13.811 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac812614:::benchmark_data_smithi018_166993_object85896:head# 2024-02-10T08:39:13.811 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac8131c7:::benchmark_data_smithi018_166993_object103480:head# 2024-02-10T08:39:13.811 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac81355b:::benchmark_data_smithi018_166993_object54807:head# 2024-02-10T08:39:13.811 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac81378d:::benchmark_data_smithi018_166993_object90061:head# 2024-02-10T08:39:13.811 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac82600a:::benchmark_data_smithi018_166993_object80653:head# 2024-02-10T08:39:13.811 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac835f3f:::benchmark_data_smithi018_166993_object32313:head# 2024-02-10T08:39:13.812 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac841155:::benchmark_data_smithi018_166993_object44284:head# 2024-02-10T08:39:13.812 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac844225:::benchmark_data_smithi018_166993_object49677:head# 2024-02-10T08:39:13.812 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac86f8c7:::benchmark_data_smithi018_166993_object97617:head# 2024-02-10T08:39:13.814 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac871ccc:::benchmark_data_smithi018_166993_object63167:head# 2024-02-10T08:39:13.814 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac8737bd:::benchmark_data_smithi018_166993_object73404:head# 2024-02-10T08:39:13.815 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac873dd2:::benchmark_data_smithi018_166993_object98091:head# 2024-02-10T08:39:13.815 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac87cc29:::benchmark_data_smithi018_166993_object38387:head# 2024-02-10T08:39:13.816 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac8845ab:::benchmark_data_smithi018_166993_object36377:head# 2024-02-10T08:39:13.816 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac892ce5:::benchmark_data_smithi018_166993_object85416:head# 2024-02-10T08:39:13.816 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac8c23e7:::benchmark_data_smithi018_166993_object31489:head# 2024-02-10T08:39:13.816 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac8c4a35:::benchmark_data_smithi018_166993_object89675:head# 2024-02-10T08:39:13.822 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac8ca8c0:::benchmark_data_smithi018_166993_object39944:head# 2024-02-10T08:39:13.822 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac8d075f:::benchmark_data_smithi018_166993_object60697:head# 2024-02-10T08:39:13.823 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac8d6d93:::benchmark_data_smithi018_166993_object74070:head# 2024-02-10T08:39:13.823 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac8dab08:::benchmark_data_smithi018_166993_object54850:head# 2024-02-10T08:39:13.823 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac8dd8da:::benchmark_data_smithi018_166993_object35797:head# 2024-02-10T08:39:13.826 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac8e3b7b:::benchmark_data_smithi018_166993_object44658:head# 2024-02-10T08:39:13.827 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac8ee83d:::benchmark_data_smithi018_166993_object20084:head# 2024-02-10T08:39:13.827 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac8f7e90:::benchmark_data_smithi018_166993_object57651:head# 2024-02-10T08:39:13.831 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac8f8a4f:::benchmark_data_smithi018_166993_object38512:head# 2024-02-10T08:39:13.831 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac8ffc38:::benchmark_data_smithi018_166993_object42754:head# 2024-02-10T08:39:13.832 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac904491:::benchmark_data_smithi018_166993_object102908:head# 2024-02-10T08:39:13.832 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac92a12f:::benchmark_data_smithi018_166993_object21593:head# 2024-02-10T08:39:13.833 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac92ce9c:::benchmark_data_smithi018_166993_object54898:head# 2024-02-10T08:39:13.833 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac92d276:::benchmark_data_smithi018_166993_object24686:head# 2024-02-10T08:39:13.837 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac939cd5:::benchmark_data_smithi018_166993_object40965:head# 2024-02-10T08:39:13.837 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac93b599:::benchmark_data_smithi018_166993_object70801:head# 2024-02-10T08:39:13.843 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac94ef0c:::benchmark_data_smithi018_166993_object43448:head# 2024-02-10T08:39:13.843 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac956c78:::benchmark_data_smithi018_166993_object18676:head# 2024-02-10T08:39:13.843 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac957324:::benchmark_data_smithi018_166993_object54145:head# 2024-02-10T08:39:13.843 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac95b950:::benchmark_data_smithi018_166993_object116441:head# 2024-02-10T08:39:13.843 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac95f8e0:::benchmark_data_smithi018_166993_object80345:head# 2024-02-10T08:39:13.843 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac974e0b:::benchmark_data_smithi018_166993_object95713:head# 2024-02-10T08:39:13.843 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac97b09f:::benchmark_data_smithi018_166993_object20898:head# 2024-02-10T08:39:13.843 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac97b8fb:::benchmark_data_smithi018_166993_object106254:head# 2024-02-10T08:39:13.843 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac985292:::benchmark_data_smithi018_166993_object33654:head# 2024-02-10T08:39:13.844 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac99a874:::benchmark_data_smithi018_166993_object82249:head# 2024-02-10T08:39:13.844 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac9b4069:::benchmark_data_smithi018_166993_object84908:head# 2024-02-10T08:39:13.844 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac9bd040:::benchmark_data_smithi018_166993_object22237:head# 2024-02-10T08:39:13.844 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac9c4820:::benchmark_data_smithi018_166993_object63493:head# 2024-02-10T08:39:13.845 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac9c7cd3:::benchmark_data_smithi018_166993_object77144:head# 2024-02-10T08:39:13.845 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac9ca38c:::benchmark_data_smithi018_166993_object69033:head# 2024-02-10T08:39:13.847 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac9e5c24:::benchmark_data_smithi018_166993_object90078:head# 2024-02-10T08:39:13.847 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac9e9a67:::benchmark_data_smithi018_166993_object112806:head# 2024-02-10T08:39:13.847 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ac9ec197:::benchmark_data_smithi018_166993_object78071:head# 2024-02-10T08:39:13.847 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aca0aff4:::benchmark_data_smithi018_166993_object98256:head# 2024-02-10T08:39:13.847 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aca14c9b:::benchmark_data_smithi018_166993_object71648:head# 2024-02-10T08:39:13.849 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aca28863:::benchmark_data_smithi018_166993_object95231:head# 2024-02-10T08:39:13.852 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aca3075c:::benchmark_data_smithi018_166993_object39523:head# 2024-02-10T08:39:13.852 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aca344d2:::benchmark_data_smithi018_166993_object69627:head# 2024-02-10T08:39:13.852 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aca4e601:::benchmark_data_smithi018_166993_object63018:head# 2024-02-10T08:39:13.852 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aca6d219:::benchmark_data_smithi018_166993_object24749:head# 2024-02-10T08:39:13.852 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aca71d8f:::benchmark_data_smithi018_166993_object40298:head# 2024-02-10T08:39:13.853 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aca72ad0:::benchmark_data_smithi018_166993_object84043:head# 2024-02-10T08:39:13.853 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aca78810:::benchmark_data_smithi018_166993_object107672:head# 2024-02-10T08:39:13.854 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aca7b881:::benchmark_data_smithi018_166993_object82513:head# 2024-02-10T08:39:13.854 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aca95c1e:::benchmark_data_smithi018_166993_object113975:head# 2024-02-10T08:39:13.855 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acab2a64:::benchmark_data_smithi018_166993_object30736:head# 2024-02-10T08:39:13.855 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acab38db:::benchmark_data_smithi018_166993_object55757:head# 2024-02-10T08:39:13.856 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acabb230:::benchmark_data_smithi018_166993_object109604:head# 2024-02-10T08:39:13.857 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acae4c4f:::benchmark_data_smithi018_166993_object34614:head# 2024-02-10T08:39:13.861 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acaed272:::benchmark_data_smithi018_166993_object118025:head# 2024-02-10T08:39:13.861 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acafc311:::benchmark_data_smithi018_166993_object108484:head# 2024-02-10T08:39:13.861 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acaff6d1:::benchmark_data_smithi018_166993_object19118:head# 2024-02-10T08:39:13.861 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acb0774c:::benchmark_data_smithi018_166993_object26038:head# 2024-02-10T08:39:13.865 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acb0bd5f:::benchmark_data_smithi018_166993_object71697:head# 2024-02-10T08:39:13.865 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acb17e93:::benchmark_data_smithi018_166993_object69044:head# 2024-02-10T08:39:13.865 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acb1dec8:::benchmark_data_smithi018_166993_object22800:head# 2024-02-10T08:39:13.866 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acb1ec15:::benchmark_data_smithi018_166993_object114867:head# 2024-02-10T08:39:13.866 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acb244a6:::benchmark_data_smithi018_166993_object116612:head# 2024-02-10T08:39:13.867 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acb2b039:::benchmark_data_smithi018_166993_object112084:head# 2024-02-10T08:39:13.869 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acb2e19b:::benchmark_data_smithi018_166993_object76502:head# 2024-02-10T08:39:13.869 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acb3058a:::benchmark_data_smithi018_166993_object51271:head# 2024-02-10T08:39:13.870 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acb30e0f:::benchmark_data_smithi018_166993_object92322:head# 2024-02-10T08:39:13.872 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acb31f56:::benchmark_data_smithi018_166993_object101137:head# 2024-02-10T08:39:13.872 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acb54e79:::benchmark_data_smithi018_166993_object42673:head# 2024-02-10T08:39:13.872 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acb7b36d:::benchmark_data_smithi018_166993_object59248:head# 2024-02-10T08:39:13.872 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acb838f8:::benchmark_data_smithi018_166993_object29598:head# 2024-02-10T08:39:13.872 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acb86eb0:::benchmark_data_smithi018_166993_object96434:head# 2024-02-10T08:39:13.875 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acb9a53f:::benchmark_data_smithi018_166993_object66658:head# 2024-02-10T08:39:13.875 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acba9338:::benchmark_data_smithi018_166993_object29577:head# 2024-02-10T08:39:13.881 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acbaa912:::benchmark_data_smithi018_166993_object22881:head# 2024-02-10T08:39:13.881 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acbb1b5b:::benchmark_data_smithi018_166993_object77518:head# 2024-02-10T08:39:13.882 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acbd26c2:::benchmark_data_smithi018_166993_object76877:head# 2024-02-10T08:39:13.882 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acbea462:::benchmark_data_smithi018_166993_object38672:head# 2024-02-10T08:39:13.887 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acbf2048:::benchmark_data_smithi018_166993_object25737:head# 2024-02-10T08:39:13.887 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acc002c3:::benchmark_data_smithi018_166993_object71925:head# 2024-02-10T08:39:13.887 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acc08ae2:::benchmark_data_smithi018_166993_object45708:head# 2024-02-10T08:39:13.887 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acc17b89:::benchmark_data_smithi018_166993_object111312:head# 2024-02-10T08:39:13.887 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acc18c4e:::benchmark_data_smithi018_166993_object21161:head# 2024-02-10T08:39:13.887 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acc291c4:::benchmark_data_smithi018_166993_object31664:head# 2024-02-10T08:39:13.887 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acc3460d:::benchmark_data_smithi018_166993_object114504:head# 2024-02-10T08:39:13.887 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acc3788d:::benchmark_data_smithi018_166993_object52984:head# 2024-02-10T08:39:13.887 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acc524da:::benchmark_data_smithi018_166993_object96443:head# 2024-02-10T08:39:13.892 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acc57839:::benchmark_data_smithi018_166993_object29019:head# 2024-02-10T08:39:13.892 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acc643bd:::benchmark_data_smithi018_166993_object102501:head# 2024-02-10T08:39:13.893 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acc67f7d:::benchmark_data_smithi018_166993_object22851:head# 2024-02-10T08:39:13.893 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acc74088:::benchmark_data_smithi018_166993_object98593:head# 2024-02-10T08:39:13.893 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acc7a7bc:::benchmark_data_smithi018_166993_object71776:head# 2024-02-10T08:39:13.893 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acc7d572:::benchmark_data_smithi018_166993_object35847:head# 2024-02-10T08:39:13.893 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acc8c507:::benchmark_data_smithi018_166993_object31983:head# 2024-02-10T08:39:13.898 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acc94e9b:::benchmark_data_smithi018_166993_object80814:head# 2024-02-10T08:39:13.898 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acc99d6e:::benchmark_data_smithi018_166993_object52576:head# 2024-02-10T08:39:13.898 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acca0a62:::benchmark_data_smithi018_166993_object81921:head# 2024-02-10T08:39:13.899 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acca2c1b:::benchmark_data_smithi018_166993_object95516:head# 2024-02-10T08:39:13.900 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:accbaad6:::benchmark_data_smithi018_166993_object65766:head# 2024-02-10T08:39:13.900 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:accd20e4:::benchmark_data_smithi018_166993_object83063:head# 2024-02-10T08:39:13.901 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:accd3ee1:::benchmark_data_smithi018_166993_object48433:head# 2024-02-10T08:39:13.902 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:accd4391:::benchmark_data_smithi018_166993_object52337:head# 2024-02-10T08:39:13.902 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:accd7266:::benchmark_data_smithi018_166993_object108615:head# 2024-02-10T08:39:13.903 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:accdf441:::benchmark_data_smithi018_166993_object90960:head# 2024-02-10T08:39:13.903 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acce7d46:::benchmark_data_smithi018_166993_object29705:head# 2024-02-10T08:39:13.905 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acced59e:::benchmark_data_smithi018_166993_object93930:head# 2024-02-10T08:39:13.905 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acd02851:::benchmark_data_smithi018_166993_object46708:head# 2024-02-10T08:39:13.905 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acd1de14:::benchmark_data_smithi018_166993_object90129:head# 2024-02-10T08:39:13.908 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acd23f6f:::benchmark_data_smithi018_166993_object71952:head# 2024-02-10T08:39:13.909 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acd33c45:::benchmark_data_smithi018_166993_object22596:head# 2024-02-10T08:39:13.909 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acd36cd8:::benchmark_data_smithi018_166993_object54304:head# 2024-02-10T08:39:13.909 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acd5b499:::benchmark_data_smithi018_166993_object117553:head# 2024-02-10T08:39:13.909 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acd694a1:::benchmark_data_smithi018_166993_object116432:head# 2024-02-10T08:39:13.910 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acd6c168:::benchmark_data_smithi018_166993_object37588:head# 2024-02-10T08:39:13.910 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acd7245a:::benchmark_data_smithi018_166993_object42442:head# 2024-02-10T08:39:13.911 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acd84f92:::benchmark_data_smithi018_166993_object47232:head# 2024-02-10T08:39:13.911 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acd853a3:::benchmark_data_smithi018_166993_object32682:head# 2024-02-10T08:39:13.911 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acd92a09:::benchmark_data_smithi018_166993_object94310:head# 2024-02-10T08:39:13.911 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acd961f2:::benchmark_data_smithi018_166993_object40981:head# 2024-02-10T08:39:13.912 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acd9875a:::benchmark_data_smithi018_166993_object88021:head# 2024-02-10T08:39:13.912 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acd9e721:::benchmark_data_smithi018_166993_object21516:head# 2024-02-10T08:39:13.913 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acdb8a6f:::benchmark_data_smithi018_166993_object84881:head# 2024-02-10T08:39:13.913 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acde5c10:::benchmark_data_smithi018_166993_object118516:head# 2024-02-10T08:39:13.916 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acdfbd4c:::benchmark_data_smithi018_166993_object87678:head# 2024-02-10T08:39:13.916 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acdfe035:::benchmark_data_smithi018_166993_object51617:head# 2024-02-10T08:39:13.916 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ace0b0a6:::benchmark_data_smithi018_166993_object74802:head# 2024-02-10T08:39:13.917 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ace10adf:::benchmark_data_smithi018_166993_object108236:head# 2024-02-10T08:39:13.917 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ace1395c:::benchmark_data_smithi018_166993_object18480:head# 2024-02-10T08:39:13.921 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ace1a52f:::benchmark_data_smithi018_166993_object51148:head# 2024-02-10T08:39:13.922 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ace1bdff:::benchmark_data_smithi018_166993_object52029:head# 2024-02-10T08:39:13.922 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ace23c96:::benchmark_data_smithi018_166993_object88210:head# 2024-02-10T08:39:13.922 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ace400dd:::benchmark_data_smithi018_166993_object102556:head# 2024-02-10T08:39:13.922 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ace45b9e:::benchmark_data_smithi018_166993_object100618:head# 2024-02-10T08:39:13.923 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ace490a9:::benchmark_data_smithi018_166993_object58151:head# 2024-02-10T08:39:13.923 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ace5e786:::benchmark_data_smithi018_166993_object85096:head# 2024-02-10T08:39:13.923 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ace5fbcd:::benchmark_data_smithi018_166993_object64568:head# 2024-02-10T08:39:13.924 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ace6012c:::benchmark_data_smithi018_166993_object84688:head# 2024-02-10T08:39:13.924 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ace65ff2:::benchmark_data_smithi018_166993_object40509:head# 2024-02-10T08:39:13.925 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ace6f1f1:::benchmark_data_smithi018_166993_object35314:head# 2024-02-10T08:39:13.925 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ace6ffe6:::benchmark_data_smithi018_166993_object95426:head# 2024-02-10T08:39:13.926 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ace86155:::benchmark_data_smithi018_166993_object83466:head# 2024-02-10T08:39:13.927 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ace9b977:::benchmark_data_smithi018_166993_object54088:head# 2024-02-10T08:39:13.927 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acea7339:::benchmark_data_smithi018_166993_object103722:head# 2024-02-10T08:39:13.932 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acea7ee2:::benchmark_data_smithi018_166993_object33324:head# 2024-02-10T08:39:13.932 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aceb0c64:::benchmark_data_smithi018_166993_object118636:head# 2024-02-10T08:39:13.932 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aceb0e5d:::benchmark_data_smithi018_166993_object48694:head# 2024-02-10T08:39:13.932 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aced282a:::benchmark_data_smithi018_166993_object91526:head# 2024-02-10T08:39:13.932 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aced437b:::benchmark_data_smithi018_166993_object112125:head# 2024-02-10T08:39:13.932 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acedea65:::benchmark_data_smithi018_166993_object78638:head# 2024-02-10T08:39:13.932 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acef8408:::benchmark_data_smithi018_166993_object76274:head# 2024-02-10T08:39:13.932 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acf09edc:::benchmark_data_smithi018_166993_object18949:head# 2024-02-10T08:39:13.932 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acf0e5ad:::benchmark_data_smithi018_166993_object25344:head# 2024-02-10T08:39:13.933 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acf19ae6:::benchmark_data_smithi018_166993_object62292:head# 2024-02-10T08:39:13.933 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acf43b0a:::benchmark_data_smithi018_166993_object85606:head# 2024-02-10T08:39:13.933 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acf5ff01:::benchmark_data_smithi018_166993_object117612:head# 2024-02-10T08:39:13.934 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acf7376c:::benchmark_data_smithi018_166993_object71968:head# 2024-02-10T08:39:13.934 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acf8025b:::benchmark_data_smithi018_166993_object57124:head# 2024-02-10T08:39:13.934 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acf96c83:::benchmark_data_smithi018_166993_object51250:head# 2024-02-10T08:39:13.936 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acf97f4c:::benchmark_data_smithi018_166993_object28410:head# 2024-02-10T08:39:13.936 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acfa412e:::benchmark_data_smithi018_166993_object88890:head# 2024-02-10T08:39:13.937 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acfb18f6:::benchmark_data_smithi018_166993_object68656:head# 2024-02-10T08:39:13.937 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acfb7bca:::benchmark_data_smithi018_166993_object101196:head# 2024-02-10T08:39:13.938 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acfc1531:::benchmark_data_smithi018_166993_object38905:head# 2024-02-10T08:39:13.938 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acfd6fee:::benchmark_data_smithi018_166993_object104605:head# 2024-02-10T08:39:13.939 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acfd99f8:::benchmark_data_smithi018_166993_object90626:head# 2024-02-10T08:39:13.939 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acfe1cee:::benchmark_data_smithi018_166993_object105662:head# 2024-02-10T08:39:13.940 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:acfe3dc6:::benchmark_data_smithi018_166993_object71555:head# 2024-02-10T08:39:13.940 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad000897:::benchmark_data_smithi018_166993_object91119:head# 2024-02-10T08:39:13.941 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad010345:::benchmark_data_smithi018_166993_object58882:head# 2024-02-10T08:39:13.941 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad01158d:::benchmark_data_smithi018_166993_object51291:head# 2024-02-10T08:39:13.942 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad01c8ff:::benchmark_data_smithi018_166993_object90810:head# 2024-02-10T08:39:13.942 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad01d0db:::benchmark_data_smithi018_166993_object50933:head# 2024-02-10T08:39:13.942 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad01f0e3:::benchmark_data_smithi018_166993_object36801:head# 2024-02-10T08:39:13.943 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad027037:::benchmark_data_smithi018_166993_object107636:head# 2024-02-10T08:39:13.946 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad0394e4:::benchmark_data_smithi018_166993_object101966:head# 2024-02-10T08:39:13.946 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad04191e:::benchmark_data_smithi018_166993_object30623:head# 2024-02-10T08:39:13.947 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad045683:::benchmark_data_smithi018_166993_object84112:head# 2024-02-10T08:39:13.954 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad049193:::benchmark_data_smithi018_166993_object33280:head# 2024-02-10T08:39:13.954 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad04e854:::benchmark_data_smithi018_166993_object30866:head# 2024-02-10T08:39:13.955 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad04f609:::benchmark_data_smithi018_166993_object65645:head# 2024-02-10T08:39:13.956 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad05a58b:::benchmark_data_smithi018_166993_object34079:head# 2024-02-10T08:39:13.958 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad07aaf8:::benchmark_data_smithi018_166993_object34162:head# 2024-02-10T08:39:13.958 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad07aed8:::benchmark_data_smithi018_166993_object44392:head# 2024-02-10T08:39:13.959 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad08551b:::benchmark_data_smithi018_166993_object86366:head# 2024-02-10T08:39:13.959 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad08da7c:::benchmark_data_smithi018_166993_object25683:head# 2024-02-10T08:39:13.960 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad09c3b0:::benchmark_data_smithi018_166993_object28152:head# 2024-02-10T08:39:13.961 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad0addd5:::benchmark_data_smithi018_166993_object36520:head# 2024-02-10T08:39:13.961 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad0b6193:::benchmark_data_smithi018_166993_object110857:head# 2024-02-10T08:39:13.963 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad0bb428:::benchmark_data_smithi018_166993_object49772:head# 2024-02-10T08:39:13.963 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad0c6c27:::benchmark_data_smithi018_166993_object78625:head# 2024-02-10T08:39:13.964 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad0d1711:::benchmark_data_smithi018_166993_object28558:head# 2024-02-10T08:39:13.964 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad0e8f42:::benchmark_data_smithi018_166993_object88593:head# 2024-02-10T08:39:13.964 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad0f93b1:::benchmark_data_smithi018_166993_object99422:head# 2024-02-10T08:39:13.964 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad0fbce2:::benchmark_data_smithi018_166993_object42692:head# 2024-02-10T08:39:13.964 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad108605:::benchmark_data_smithi018_166993_object88600:head# 2024-02-10T08:39:13.965 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad113d65:::benchmark_data_smithi018_166993_object117614:head# 2024-02-10T08:39:13.966 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad12495b:::benchmark_data_smithi018_166993_object48408:head# 2024-02-10T08:39:13.966 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad141ce9:::benchmark_data_smithi018_166993_object33653:head# 2024-02-10T08:39:13.967 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad14a729:::benchmark_data_smithi018_166993_object53372:head# 2024-02-10T08:39:13.971 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad14d2fb:::benchmark_data_smithi018_166993_object28646:head# 2024-02-10T08:39:13.971 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad1503fa:::benchmark_data_smithi018_166993_object100036:head# 2024-02-10T08:39:13.973 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad15a70f:::benchmark_data_smithi018_166993_object19552:head# 2024-02-10T08:39:13.974 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad15baf2:::benchmark_data_smithi018_166993_object62626:head# 2024-02-10T08:39:13.974 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad15d3b8:::benchmark_data_smithi018_166993_object82086:head# 2024-02-10T08:39:13.975 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad15f381:::benchmark_data_smithi018_166993_object50558:head# 2024-02-10T08:39:13.977 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad17f192:::benchmark_data_smithi018_166993_object95365:head# 2024-02-10T08:39:13.978 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad18cc92:::benchmark_data_smithi018_166993_object35637:head# 2024-02-10T08:39:13.981 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad18d37c:::benchmark_data_smithi018_166993_object64581:head# 2024-02-10T08:39:13.981 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad19f591:::benchmark_data_smithi018_166993_object69218:head# 2024-02-10T08:39:13.985 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad1b41a0:::benchmark_data_smithi018_166993_object90733:head# 2024-02-10T08:39:13.985 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad1bc6dc:::benchmark_data_smithi018_166993_object33217:head# 2024-02-10T08:39:13.985 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad1d10f1:::benchmark_data_smithi018_166993_object28744:head# 2024-02-10T08:39:13.992 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad1d755a:::benchmark_data_smithi018_166993_object87975:head# 2024-02-10T08:39:13.992 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad1d825b:::benchmark_data_smithi018_166993_object66192:head# 2024-02-10T08:39:13.992 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad1df33e:::benchmark_data_smithi018_166993_object50034:head# 2024-02-10T08:39:13.992 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad1ec165:::benchmark_data_smithi018_166993_object59830:head# 2024-02-10T08:39:13.992 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad1f20ae:::benchmark_data_smithi018_166993_object24859:head# 2024-02-10T08:39:13.992 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad1f2bd3:::benchmark_data_smithi018_166993_object101562:head# 2024-02-10T08:39:13.992 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad1f6ec1:::benchmark_data_smithi018_166993_object74895:head# 2024-02-10T08:39:13.992 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad1f9ee5:::benchmark_data_smithi018_166993_object112601:head# 2024-02-10T08:39:14.001 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad209ee6:::benchmark_data_smithi018_166993_object82139:head# 2024-02-10T08:39:14.001 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad2137fc:::benchmark_data_smithi018_166993_object55929:head# 2024-02-10T08:39:14.001 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad224978:::benchmark_data_smithi018_166993_object91142:head# 2024-02-10T08:39:14.001 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad2267a6:::benchmark_data_smithi018_166993_object117459:head# 2024-02-10T08:39:14.001 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad228ec9:::benchmark_data_smithi018_166993_object97595:head# 2024-02-10T08:39:14.001 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad22948f:::benchmark_data_smithi018_166993_object65027:head# 2024-02-10T08:39:14.001 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad237dcf:::benchmark_data_smithi018_166993_object89427:head# 2024-02-10T08:39:14.001 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad265355:::benchmark_data_smithi018_166993_object63800:head# 2024-02-10T08:39:14.001 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad26752f:::benchmark_data_smithi018_166993_object85917:head# 2024-02-10T08:39:14.001 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad26daf9:::benchmark_data_smithi018_166993_object118024:head# 2024-02-10T08:39:14.001 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad26e9a2:::benchmark_data_smithi018_166993_object114550:head# 2024-02-10T08:39:14.001 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad270075:::benchmark_data_smithi018_166993_object52731:head# 2024-02-10T08:39:14.001 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad27bef9:::benchmark_data_smithi018_166993_object68909:head# 2024-02-10T08:39:14.002 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad287046:::benchmark_data_smithi018_166993_object24747:head# 2024-02-10T08:39:14.002 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad289b0d:::benchmark_data_smithi018_166993_object34242:head# 2024-02-10T08:39:14.002 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad290700:::benchmark_data_smithi018_166993_object76893:head# 2024-02-10T08:39:14.002 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad2992fb:::benchmark_data_smithi018_166993_object53533:head# 2024-02-10T08:39:14.003 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad2a137e:::benchmark_data_smithi018_166993_object38254:head# 2024-02-10T08:39:14.003 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad2cfe92:::benchmark_data_smithi018_166993_object27730:head# 2024-02-10T08:39:14.003 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad2da25c:::benchmark_data_smithi018_166993_object85179:head# 2024-02-10T08:39:14.004 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad2e172a:::benchmark_data_smithi018_166993_object62997:head# 2024-02-10T08:39:14.004 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad2eb5c2:::benchmark_data_smithi018_166993_object25680:head# 2024-02-10T08:39:14.004 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad2ec3a2:::benchmark_data_smithi018_166993_object21249:head# 2024-02-10T08:39:14.005 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad2f04fa:::benchmark_data_smithi018_166993_object49846:head# 2024-02-10T08:39:14.007 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad2f288d:::benchmark_data_smithi018_166993_object95298:head# 2024-02-10T08:39:14.007 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad30fe9a:::benchmark_data_smithi018_166993_object37001:head# 2024-02-10T08:39:14.014 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad3108a2:::benchmark_data_smithi018_166993_object83111:head# 2024-02-10T08:39:14.015 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad31d35d:::benchmark_data_smithi018_166993_object48502:head# 2024-02-10T08:39:14.015 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad32c176:::benchmark_data_smithi018_166993_object29270:head# 2024-02-10T08:39:14.015 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad32d922:::benchmark_data_smithi018_166993_object83475:head# 2024-02-10T08:39:14.015 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad3324d7:::benchmark_data_smithi018_166993_object108225:head# 2024-02-10T08:39:14.016 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad336fc1:::benchmark_data_smithi018_166993_object69881:head# 2024-02-10T08:39:14.016 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad33f2df:::benchmark_data_smithi018_166993_object58250:head# 2024-02-10T08:39:14.016 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad34236e:::benchmark_data_smithi018_166993_object100655:head# 2024-02-10T08:39:14.020 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad348222:::benchmark_data_smithi018_166993_object88093:head# 2024-02-10T08:39:14.021 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad34b760:::benchmark_data_smithi018_166993_object50829:head# 2024-02-10T08:39:14.021 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad359f82:::benchmark_data_smithi018_166993_object52169:head# 2024-02-10T08:39:14.022 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad363f85:::benchmark_data_smithi018_166993_object91981:head# 2024-02-10T08:39:14.024 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad36e078:::benchmark_data_smithi018_166993_object99031:head# 2024-02-10T08:39:14.025 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad37184b:::benchmark_data_smithi018_166993_object86715:head# 2024-02-10T08:39:14.025 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad37353c:::benchmark_data_smithi018_166993_object18413:head# 2024-02-10T08:39:14.026 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad37555e:::benchmark_data_smithi018_166993_object25869:head# 2024-02-10T08:39:14.026 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad3a75e0:::benchmark_data_smithi018_166993_object90744:head# 2024-02-10T08:39:14.034 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad3aca93:::benchmark_data_smithi018_166993_object60209:head# 2024-02-10T08:39:14.034 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad3aee5f:::benchmark_data_smithi018_166993_object97309:head# 2024-02-10T08:39:14.034 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad3b799d:::benchmark_data_smithi018_166993_object44245:head# 2024-02-10T08:39:14.034 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad3bd1df:::benchmark_data_smithi018_166993_object110231:head# 2024-02-10T08:39:14.035 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad3d16c0:::benchmark_data_smithi018_166993_object112455:head# 2024-02-10T08:39:14.035 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad3d1e9e:::benchmark_data_smithi018_166993_object52974:head# 2024-02-10T08:39:14.036 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad3e3aea:::benchmark_data_smithi018_166993_object105402:head# 2024-02-10T08:39:14.036 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad4007e8:::benchmark_data_smithi018_166993_object52895:head# 2024-02-10T08:39:14.037 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad402206:::benchmark_data_smithi018_166993_object38106:head# 2024-02-10T08:39:14.038 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad405014:::benchmark_data_smithi018_166993_object116921:head# 2024-02-10T08:39:14.043 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad41087e:::benchmark_data_smithi018_166993_object117700:head# 2024-02-10T08:39:14.043 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad42a7f8:::benchmark_data_smithi018_166993_object49395:head# 2024-02-10T08:39:14.043 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad436b13:::benchmark_data_smithi018_166993_object61080:head# 2024-02-10T08:39:14.043 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad43c45e:::benchmark_data_smithi018_166993_object28277:head# 2024-02-10T08:39:14.043 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad448098:::benchmark_data_smithi018_166993_object116914:head# 2024-02-10T08:39:14.044 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad448bd4:::benchmark_data_smithi018_166993_object102243:head# 2024-02-10T08:39:14.044 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad44e114:::benchmark_data_smithi018_166993_object70266:head# 2024-02-10T08:39:14.045 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad44f04c:::benchmark_data_smithi018_166993_object76343:head# 2024-02-10T08:39:14.045 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad45e3bd:::benchmark_data_smithi018_166993_object23587:head# 2024-02-10T08:39:14.046 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad461ba9:::benchmark_data_smithi018_166993_object104213:head# 2024-02-10T08:39:14.048 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad4717c8:::benchmark_data_smithi018_166993_object56688:head# 2024-02-10T08:39:14.053 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad47d281:::benchmark_data_smithi018_166993_object63828:head# 2024-02-10T08:39:14.053 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad47f2db:::benchmark_data_smithi018_166993_object53842:head# 2024-02-10T08:39:14.058 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad487768:::benchmark_data_smithi018_166993_object18102:head# 2024-02-10T08:39:14.058 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad48e6c4:::benchmark_data_smithi018_166993_object112013:head# 2024-02-10T08:39:14.060 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad496216:::benchmark_data_smithi018_166993_object110380:head# 2024-02-10T08:39:14.060 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad4afedf:::benchmark_data_smithi018_166993_object65518:head# 2024-02-10T08:39:14.064 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad4b5736:::benchmark_data_smithi018_166993_object104366:head# 2024-02-10T08:39:14.064 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad4c4c8c:::benchmark_data_smithi018_166993_object30310:head# 2024-02-10T08:39:14.065 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad4c98e0:::benchmark_data_smithi018_166993_object97587:head# 2024-02-10T08:39:14.065 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad4cab6d:::benchmark_data_smithi018_166993_object27815:head# 2024-02-10T08:39:14.065 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad4cd851:::benchmark_data_smithi018_166993_object98427:head# 2024-02-10T08:39:14.066 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad4d38d8:::benchmark_data_smithi018_166993_object72479:head# 2024-02-10T08:39:14.066 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad4d5269:::benchmark_data_smithi018_166993_object32333:head# 2024-02-10T08:39:14.068 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad4df648:::benchmark_data_smithi018_166993_object71103:head# 2024-02-10T08:39:14.072 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad4e1111:::benchmark_data_smithi018_166993_object66818:head# 2024-02-10T08:39:14.072 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad4f9226:::benchmark_data_smithi018_166993_object56172:head# 2024-02-10T08:39:14.072 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad5152a4:::benchmark_data_smithi018_166993_object101089:head# 2024-02-10T08:39:14.072 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad519d94:::benchmark_data_smithi018_166993_object48383:head# 2024-02-10T08:39:14.073 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad5418bd:::benchmark_data_smithi018_166993_object44303:head# 2024-02-10T08:39:14.073 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad543890:::benchmark_data_smithi018_166993_object66161:head# 2024-02-10T08:39:14.074 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad549440:::benchmark_data_smithi018_166993_object56743:head# 2024-02-10T08:39:14.075 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad54e4c5:::benchmark_data_smithi018_166993_object80594:head# 2024-02-10T08:39:14.075 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad550d19:::benchmark_data_smithi018_166993_object110695:head# 2024-02-10T08:39:14.076 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad557a44:::benchmark_data_smithi018_166993_object40272:head# 2024-02-10T08:39:14.076 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad55b280:::benchmark_data_smithi018_166993_object31600:head# 2024-02-10T08:39:14.077 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad578fe7:::benchmark_data_smithi018_166993_object86799:head# 2024-02-10T08:39:14.077 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad57e535:::benchmark_data_smithi018_166993_object92171:head# 2024-02-10T08:39:14.078 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad589d87:::benchmark_data_smithi018_166993_object81332:head# 2024-02-10T08:39:14.081 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad5a7737:::benchmark_data_smithi018_166993_object57938:head# 2024-02-10T08:39:14.081 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad5ab98f:::benchmark_data_smithi018_166993_object95127:head# 2024-02-10T08:39:14.081 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad5b1d46:::benchmark_data_smithi018_166993_object22931:head# 2024-02-10T08:39:14.081 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad5cf28d:::benchmark_data_smithi018_166993_object53887:head# 2024-02-10T08:39:14.081 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad5d20cf:::benchmark_data_smithi018_166993_object92644:head# 2024-02-10T08:39:14.081 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad5d5b29:::benchmark_data_smithi018_166993_object60735:head# 2024-02-10T08:39:14.081 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad5dd8ab:::benchmark_data_smithi018_166993_object65690:head# 2024-02-10T08:39:14.087 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad5e7bd2:::benchmark_data_smithi018_166993_object110345:head# 2024-02-10T08:39:14.087 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad5ea332:::benchmark_data_smithi018_166993_object39697:head# 2024-02-10T08:39:14.087 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad5eaabc:::benchmark_data_smithi018_166993_object106320:head# 2024-02-10T08:39:14.087 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad5ef1a7:::benchmark_data_smithi018_166993_object27978:head# 2024-02-10T08:39:14.087 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad5f385b:::benchmark_data_smithi018_166993_object44526:head# 2024-02-10T08:39:14.090 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad604164:::benchmark_data_smithi018_166993_object18421:head# 2024-02-10T08:39:14.091 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad6199d8:::benchmark_data_smithi018_166993_object81994:head# 2024-02-10T08:39:14.091 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad622bff:::benchmark_data_smithi018_166993_object117309:head# 2024-02-10T08:39:14.092 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad667364:::benchmark_data_smithi018_166993_object114834:head# 2024-02-10T08:39:14.093 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad66e59f:::benchmark_data_smithi018_166993_object112284:head# 2024-02-10T08:39:14.093 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad673675:::benchmark_data_smithi018_166993_object50951:head# 2024-02-10T08:39:14.096 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad6893a3:::benchmark_data_smithi018_166993_object83840:head# 2024-02-10T08:39:14.097 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad69b0db:::benchmark_data_smithi018_166993_object103535:head# 2024-02-10T08:39:14.097 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad6a0d8e:::benchmark_data_smithi018_166993_object28086:head# 2024-02-10T08:39:14.104 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad6b1e57:::benchmark_data_smithi018_166993_object102520:head# 2024-02-10T08:39:14.104 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad6be2f4:::benchmark_data_smithi018_166993_object111610:head# 2024-02-10T08:39:14.104 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad6c65b2:::benchmark_data_smithi018_166993_object73068:head# 2024-02-10T08:39:14.105 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad6d7147:::benchmark_data_smithi018_166993_object60240:head# 2024-02-10T08:39:14.105 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad6db8e1:::benchmark_data_smithi018_166993_object60507:head# 2024-02-10T08:39:14.105 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad701fa3:::benchmark_data_smithi018_166993_object42191:head# 2024-02-10T08:39:14.105 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad70b00e:::benchmark_data_smithi018_166993_object25026:head# 2024-02-10T08:39:14.105 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad70b245:::benchmark_data_smithi018_166993_object79690:head# 2024-02-10T08:39:14.105 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad721ebc:::benchmark_data_smithi018_166993_object30629:head# 2024-02-10T08:39:14.105 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad727a31:::benchmark_data_smithi018_166993_object117140:head# 2024-02-10T08:39:14.105 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad72a825:::benchmark_data_smithi018_166993_object103515:head# 2024-02-10T08:39:14.105 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad73b5d8:::benchmark_data_smithi018_166993_object105920:head# 2024-02-10T08:39:14.105 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad73b812:::benchmark_data_smithi018_166993_object39487:head# 2024-02-10T08:39:14.106 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad73d7d6:::benchmark_data_smithi018_166993_object35206:head# 2024-02-10T08:39:14.108 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad746f98:::benchmark_data_smithi018_166993_object33460:head# 2024-02-10T08:39:14.111 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad770356:::benchmark_data_smithi018_166993_object42399:head# 2024-02-10T08:39:14.116 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad7784dd:::benchmark_data_smithi018_166993_object59162:head# 2024-02-10T08:39:14.116 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad77dfe2:::benchmark_data_smithi018_166993_object52666:head# 2024-02-10T08:39:14.118 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad77ef48:::benchmark_data_smithi018_166993_object85060:head# 2024-02-10T08:39:14.119 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad78b095:::benchmark_data_smithi018_166993_object84756:head# 2024-02-10T08:39:14.119 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad792ffd:::benchmark_data_smithi018_166993_object40105:head# 2024-02-10T08:39:14.122 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad795c37:::benchmark_data_smithi018_166993_object64834:head# 2024-02-10T08:39:14.122 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad79c977:::benchmark_data_smithi018_166993_object21859:head# 2024-02-10T08:39:14.122 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad7a23cd:::benchmark_data_smithi018_166993_object99989:head# 2024-02-10T08:39:14.123 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad7b4915:::benchmark_data_smithi018_166993_object63342:head# 2024-02-10T08:39:14.123 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad7b89e2:::benchmark_data_smithi018_166993_object78021:head# 2024-02-10T08:39:14.123 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad7c523c:::benchmark_data_smithi018_166993_object61998:head# 2024-02-10T08:39:14.123 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad7f6726:::benchmark_data_smithi018_166993_object77970:head# 2024-02-10T08:39:14.123 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad7f7daa:::benchmark_data_smithi018_166993_object40868:head# 2024-02-10T08:39:14.123 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad801252:::benchmark_data_smithi018_166993_object74513:head# 2024-02-10T08:39:14.124 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad80f1bb:::benchmark_data_smithi018_166993_object31638:head# 2024-02-10T08:39:14.124 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad820df3:::benchmark_data_smithi018_166993_object86184:head# 2024-02-10T08:39:14.125 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad82414b:::benchmark_data_smithi018_166993_object50788:head# 2024-02-10T08:39:14.125 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad8296af:::benchmark_data_smithi018_166993_object96564:head# 2024-02-10T08:39:14.125 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad830edf:::benchmark_data_smithi018_166993_object42670:head# 2024-02-10T08:39:14.126 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad83797a:::benchmark_data_smithi018_166993_object61256:head# 2024-02-10T08:39:14.126 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad83e901:::benchmark_data_smithi018_166993_object42360:head# 2024-02-10T08:39:14.127 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad84a141:::benchmark_data_smithi018_166993_object69039:head# 2024-02-10T08:39:14.127 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad84c4b3:::benchmark_data_smithi018_166993_object66471:head# 2024-02-10T08:39:14.127 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad854743:::benchmark_data_smithi018_166993_object21949:head# 2024-02-10T08:39:14.128 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad86fcae:::benchmark_data_smithi018_166993_object43580:head# 2024-02-10T08:39:14.128 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad874618:::benchmark_data_smithi018_166993_object115239:head# 2024-02-10T08:39:14.129 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad874edd:::benchmark_data_smithi018_166993_object63999:head# 2024-02-10T08:39:14.129 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad887627:::benchmark_data_smithi018_166993_object47993:head# 2024-02-10T08:39:14.131 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad899c3f:::benchmark_data_smithi018_166993_object117173:head# 2024-02-10T08:39:14.136 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad8b7185:::benchmark_data_smithi018_166993_object24284:head# 2024-02-10T08:39:14.136 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad8bb6c6:::benchmark_data_smithi018_166993_object23791:head# 2024-02-10T08:39:14.136 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad8be744:::benchmark_data_smithi018_166993_object108986:head# 2024-02-10T08:39:14.136 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad8e2943:::benchmark_data_smithi018_166993_object80084:head# 2024-02-10T08:39:14.136 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad8e7ecb:::benchmark_data_smithi018_166993_object82420:head# 2024-02-10T08:39:14.137 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad8f2dfc:::benchmark_data_smithi018_166993_object29542:head# 2024-02-10T08:39:14.137 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad9016ca:::benchmark_data_smithi018_166993_object77237:head# 2024-02-10T08:39:14.137 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad91e659:::benchmark_data_smithi018_166993_object57278:head# 2024-02-10T08:39:14.138 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad920ba8:::benchmark_data_smithi018_166993_object98796:head# 2024-02-10T08:39:14.138 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad944168:::benchmark_data_smithi018_166993_object87863:head# 2024-02-10T08:39:14.139 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad9674ef:::benchmark_data_smithi018_166993_object43162:head# 2024-02-10T08:39:14.143 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad98668a:::benchmark_data_smithi018_166993_object89210:head# 2024-02-10T08:39:14.143 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad989c5d:::benchmark_data_smithi018_166993_object31053:head# 2024-02-10T08:39:14.143 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad995813:::benchmark_data_smithi018_166993_object34833:head# 2024-02-10T08:39:14.145 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad9a126d:::benchmark_data_smithi018_166993_object80760:head# 2024-02-10T08:39:14.145 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad9afa7f:::benchmark_data_smithi018_166993_object106239:head# 2024-02-10T08:39:14.149 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad9bad5b:::benchmark_data_smithi018_166993_object114019:head# 2024-02-10T08:39:14.149 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad9bc7ff:::benchmark_data_smithi018_166993_object89430:head# 2024-02-10T08:39:14.149 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad9c4dde:::benchmark_data_smithi018_166993_object83232:head# 2024-02-10T08:39:14.153 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad9c5cca:::benchmark_data_smithi018_166993_object25487:head# 2024-02-10T08:39:14.153 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad9c5d43:::benchmark_data_smithi018_166993_object21937:head# 2024-02-10T08:39:14.153 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad9cef53:::benchmark_data_smithi018_166993_object76146:head# 2024-02-10T08:39:14.153 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad9d15ce:::benchmark_data_smithi018_166993_object96230:head# 2024-02-10T08:39:14.153 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad9d361a:::benchmark_data_smithi018_166993_object61441:head# 2024-02-10T08:39:14.153 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad9d3ddb:::benchmark_data_smithi018_166993_object98229:head# 2024-02-10T08:39:14.153 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad9f0447:::benchmark_data_smithi018_166993_object63884:head# 2024-02-10T08:39:14.154 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ad9fa853:::benchmark_data_smithi018_166993_object17561:head# 2024-02-10T08:39:14.156 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ada0a60f:::benchmark_data_smithi018_166993_object38641:head# 2024-02-10T08:39:14.156 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ada19816:::benchmark_data_smithi018_166993_object79259:head# 2024-02-10T08:39:14.156 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ada1a54b:::benchmark_data_smithi018_166993_object106371:head# 2024-02-10T08:39:14.157 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ada1c349:::benchmark_data_smithi018_166993_object20600:head# 2024-02-10T08:39:14.161 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ada3a994:::benchmark_data_smithi018_166993_object60855:head# 2024-02-10T08:39:14.161 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ada3ae6a:::benchmark_data_smithi018_166993_object31075:head# 2024-02-10T08:39:14.161 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ada3c496:::benchmark_data_smithi018_166993_object107692:head# 2024-02-10T08:39:14.161 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ada4760d:::benchmark_data_smithi018_166993_object99111:head# 2024-02-10T08:39:14.167 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ada534a0:::benchmark_data_smithi018_166993_object116646:head# 2024-02-10T08:39:14.168 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ada590f9:::benchmark_data_smithi018_166993_object64075:head# 2024-02-10T08:39:14.168 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ada5c2c2:::benchmark_data_smithi018_166993_object84553:head# 2024-02-10T08:39:14.168 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ada719d4:::benchmark_data_smithi018_166993_object113419:head# 2024-02-10T08:39:14.170 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ada75fb8:::benchmark_data_smithi018_166993_object45330:head# 2024-02-10T08:39:14.171 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ada81582:::benchmark_data_smithi018_166993_object110136:head# 2024-02-10T08:39:14.172 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ada8711a:::benchmark_data_smithi018_166993_object30974:head# 2024-02-10T08:39:14.172 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ada8e62c:::benchmark_data_smithi018_166993_object100858:head# 2024-02-10T08:39:14.172 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adaa93eb:::benchmark_data_smithi018_166993_object92726:head# 2024-02-10T08:39:14.172 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adaaa6d5:::benchmark_data_smithi018_166993_object28267:head# 2024-02-10T08:39:14.172 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adacfa1e:::benchmark_data_smithi018_166993_object31236:head# 2024-02-10T08:39:14.175 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adadc978:::benchmark_data_smithi018_166993_object44452:head# 2024-02-10T08:39:14.175 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adae4162:::benchmark_data_smithi018_166993_object19665:head# 2024-02-10T08:39:14.177 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adae514c:::benchmark_data_smithi018_166993_object29295:head# 2024-02-10T08:39:14.177 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adae6fb5:::benchmark_data_smithi018_166993_object36376:head# 2024-02-10T08:39:14.177 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adaea92c:::benchmark_data_smithi018_166993_object30379:head# 2024-02-10T08:39:14.177 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adaeaa6f:::benchmark_data_smithi018_166993_object84877:head# 2024-02-10T08:39:14.177 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adb2a36e:::benchmark_data_smithi018_166993_object116030:head# 2024-02-10T08:39:14.179 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adb3023a:::benchmark_data_smithi018_166993_object108874:head# 2024-02-10T08:39:14.179 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adb51129:::benchmark_data_smithi018_166993_object81182:head# 2024-02-10T08:39:14.179 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adb545ce:::benchmark_data_smithi018_166993_object73354:head# 2024-02-10T08:39:14.180 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adb5a937:::benchmark_data_smithi018_166993_object94093:head# 2024-02-10T08:39:14.180 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adb5b4b5:::benchmark_data_smithi018_166993_object70957:head# 2024-02-10T08:39:14.181 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adb62405:::benchmark_data_smithi018_166993_object37451:head# 2024-02-10T08:39:14.181 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adb7a627:::benchmark_data_smithi018_166993_object114044:head# 2024-02-10T08:39:14.181 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adb82dd0:::benchmark_data_smithi018_166993_object26174:head# 2024-02-10T08:39:14.182 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adb9da32:::benchmark_data_smithi018_166993_object30661:head# 2024-02-10T08:39:14.182 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adba5f2c:::benchmark_data_smithi018_166993_object91907:head# 2024-02-10T08:39:14.183 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adba821b:::benchmark_data_smithi018_166993_object24760:head# 2024-02-10T08:39:14.183 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adbb337c:::benchmark_data_smithi018_166993_object58858:head# 2024-02-10T08:39:14.184 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adbbd052:::benchmark_data_smithi018_166993_object61971:head# 2024-02-10T08:39:14.184 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adbc4803:::benchmark_data_smithi018_166993_object36594:head# 2024-02-10T08:39:14.187 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adbc49ca:::benchmark_data_smithi018_166993_object17572:head# 2024-02-10T08:39:14.187 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adbc74a9:::benchmark_data_smithi018_166993_object112359:head# 2024-02-10T08:39:14.187 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adbcdbc7:::benchmark_data_smithi018_166993_object65910:head# 2024-02-10T08:39:14.187 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adbd5a27:::benchmark_data_smithi018_166993_object31297:head# 2024-02-10T08:39:14.187 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adbd80fc:::benchmark_data_smithi018_166993_object21147:head# 2024-02-10T08:39:14.187 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adbe059a:::benchmark_data_smithi018_166993_object85402:head# 2024-02-10T08:39:14.191 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adbe3449:::benchmark_data_smithi018_166993_object63253:head# 2024-02-10T08:39:14.191 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adbe3cd0:::benchmark_data_smithi018_166993_object91376:head# 2024-02-10T08:39:14.191 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adbe55de:::benchmark_data_smithi018_166993_object82653:head# 2024-02-10T08:39:14.194 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adbe6e05:::benchmark_data_smithi018_166993_object60987:head# 2024-02-10T08:39:14.194 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adbe7cde:::benchmark_data_smithi018_166993_object72343:head# 2024-02-10T08:39:14.194 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adbf3956:::benchmark_data_smithi018_166993_object64483:head# 2024-02-10T08:39:14.194 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adc1f226:::benchmark_data_smithi018_166993_object116002:head# 2024-02-10T08:39:14.195 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adc2066f:::benchmark_data_smithi018_166993_object113371:head# 2024-02-10T08:39:14.195 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adc2bde7:::benchmark_data_smithi018_166993_object30352:head# 2024-02-10T08:39:14.196 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adc32db0:::benchmark_data_smithi018_166993_object19975:head# 2024-02-10T08:39:14.196 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adc3caa4:::benchmark_data_smithi018_166993_object76700:head# 2024-02-10T08:39:14.197 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adc4b0d9:::benchmark_data_smithi018_166993_object106128:head# 2024-02-10T08:39:14.199 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adc4bcd9:::benchmark_data_smithi018_166993_object100580:head# 2024-02-10T08:39:14.199 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adc520e1:::benchmark_data_smithi018_166993_object109438:head# 2024-02-10T08:39:14.199 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adc57afc:::benchmark_data_smithi018_166993_object33206:head# 2024-02-10T08:39:14.199 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adc6331d:::benchmark_data_smithi018_166993_object95327:head# 2024-02-10T08:39:14.199 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adc7df6b:::benchmark_data_smithi018_166993_object38294:head# 2024-02-10T08:39:14.200 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adc83edd:::benchmark_data_smithi018_166993_object32427:head# 2024-02-10T08:39:14.201 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adc94e23:::benchmark_data_smithi018_166993_object21485:head# 2024-02-10T08:39:14.201 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adca319f:::benchmark_data_smithi018_166993_object62676:head# 2024-02-10T08:39:14.202 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adca8a15:::benchmark_data_smithi018_166993_object57190:head# 2024-02-10T08:39:14.202 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adca9ad2:::benchmark_data_smithi018_166993_object106217:head# 2024-02-10T08:39:14.204 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adcae31e:::benchmark_data_smithi018_166993_object29392:head# 2024-02-10T08:39:14.204 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adcb0bfd:::benchmark_data_smithi018_166993_object65116:head# 2024-02-10T08:39:14.205 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adcb128c:::benchmark_data_smithi018_166993_object108233:head# 2024-02-10T08:39:14.205 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adcb2c48:::benchmark_data_smithi018_166993_object95181:head# 2024-02-10T08:39:14.206 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adcc8714:::benchmark_data_smithi018_166993_object101856:head# 2024-02-10T08:39:14.206 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adce85a5:::benchmark_data_smithi018_166993_object116035:head# 2024-02-10T08:39:14.207 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adcef313:::benchmark_data_smithi018_166993_object83896:head# 2024-02-10T08:39:14.209 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adcf75dd:::benchmark_data_smithi018_166993_object79161:head# 2024-02-10T08:39:14.210 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adcfba8b:::benchmark_data_smithi018_166993_object92238:head# 2024-02-10T08:39:14.210 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adcfd397:::benchmark_data_smithi018_166993_object83843:head# 2024-02-10T08:39:14.211 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:add0032d:::benchmark_data_smithi018_166993_object107008:head# 2024-02-10T08:39:14.212 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:add0437c:::benchmark_data_smithi018_166993_object81579:head# 2024-02-10T08:39:14.212 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:add05d12:::benchmark_data_smithi018_166993_object62994:head# 2024-02-10T08:39:14.212 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:add08461:::benchmark_data_smithi018_166993_object96190:head# 2024-02-10T08:39:14.213 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:add1c0bc:::benchmark_data_smithi018_166993_object38497:head# 2024-02-10T08:39:14.220 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:add22b29:::benchmark_data_smithi018_166993_object92183:head# 2024-02-10T08:39:14.220 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:add2453e:::benchmark_data_smithi018_166993_object26892:head# 2024-02-10T08:39:14.221 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:add41687:::benchmark_data_smithi018_166993_object52038:head# 2024-02-10T08:39:14.221 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:add42127:::benchmark_data_smithi018_166993_object98104:head# 2024-02-10T08:39:14.221 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:add805bb:::benchmark_data_smithi018_166993_object26348:head# 2024-02-10T08:39:14.221 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:add80ee6:::benchmark_data_smithi018_166993_object53248:head# 2024-02-10T08:39:14.221 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:add8153d:::benchmark_data_smithi018_166993_object80683:head# 2024-02-10T08:39:14.222 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:add8674e:::benchmark_data_smithi018_166993_object30068:head# 2024-02-10T08:39:14.222 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:add8e8c4:::benchmark_data_smithi018_166993_object108310:head# 2024-02-10T08:39:14.222 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adda640b:::benchmark_data_smithi018_166993_object62537:head# 2024-02-10T08:39:14.222 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adda9e67:::benchmark_data_smithi018_166993_object21260:head# 2024-02-10T08:39:14.223 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:addac7e6:::benchmark_data_smithi018_166993_object73665:head# 2024-02-10T08:39:14.224 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:addafc40:::benchmark_data_smithi018_166993_object67748:head# 2024-02-10T08:39:14.224 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:addafeaf:::benchmark_data_smithi018_166993_object55465:head# 2024-02-10T08:39:14.224 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:addb2d69:::benchmark_data_smithi018_166993_object90234:head# 2024-02-10T08:39:14.225 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:addb80e7:::benchmark_data_smithi018_166993_object88587:head# 2024-02-10T08:39:14.227 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:addc07d0:::benchmark_data_smithi018_166993_object86667:head# 2024-02-10T08:39:14.229 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:addc4d88:::benchmark_data_smithi018_166993_object20394:head# 2024-02-10T08:39:14.229 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:addc907c:::benchmark_data_smithi018_166993_object25882:head# 2024-02-10T08:39:14.231 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:addc9ef4:::benchmark_data_smithi018_166993_object94982:head# 2024-02-10T08:39:14.233 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:addef815:::benchmark_data_smithi018_166993_object106101:head# 2024-02-10T08:39:14.236 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:addf2a04:::benchmark_data_smithi018_166993_object22564:head# 2024-02-10T08:39:14.237 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:addf3fcc:::benchmark_data_smithi018_166993_object116919:head# 2024-02-10T08:39:14.237 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ade03ad9:::benchmark_data_smithi018_166993_object79563:head# 2024-02-10T08:39:14.237 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ade2809c:::benchmark_data_smithi018_166993_object52100:head# 2024-02-10T08:39:14.237 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ade3233f:::benchmark_data_smithi018_166993_object113019:head# 2024-02-10T08:39:14.238 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ade54dd4:::benchmark_data_smithi018_166993_object53193:head# 2024-02-10T08:39:14.240 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ade573a6:::benchmark_data_smithi018_166993_object51612:head# 2024-02-10T08:39:14.241 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ade5c3bd:::benchmark_data_smithi018_166993_object117220:head# 2024-02-10T08:39:14.243 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ade5e229:::benchmark_data_smithi018_166993_object70037:head# 2024-02-10T08:39:14.248 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ade890e5:::benchmark_data_smithi018_166993_object96722:head# 2024-02-10T08:39:14.248 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adea111d:::benchmark_data_smithi018_166993_object29323:head# 2024-02-10T08:39:14.248 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adeb072d:::benchmark_data_smithi018_166993_object79805:head# 2024-02-10T08:39:14.248 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adec7afb:::benchmark_data_smithi018_166993_object45211:head# 2024-02-10T08:39:14.248 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aded6bdc:::benchmark_data_smithi018_166993_object104290:head# 2024-02-10T08:39:14.248 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adee0412:::benchmark_data_smithi018_166993_object22685:head# 2024-02-10T08:39:14.248 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adee8633:::benchmark_data_smithi018_166993_object41645:head# 2024-02-10T08:39:14.248 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adefa131:::benchmark_data_smithi018_166993_object36300:head# 2024-02-10T08:39:14.248 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adf0b88f:::benchmark_data_smithi018_166993_object64447:head# 2024-02-10T08:39:14.250 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adf12847:::benchmark_data_smithi018_166993_object55852:head# 2024-02-10T08:39:14.250 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adf1337c:::benchmark_data_smithi018_166993_object98431:head# 2024-02-10T08:39:14.251 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adf16d8d:::benchmark_data_smithi018_166993_object105070:head# 2024-02-10T08:39:14.252 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adf199ed:::benchmark_data_smithi018_166993_object28168:head# 2024-02-10T08:39:14.253 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adf19f70:::benchmark_data_smithi018_166993_object86451:head# 2024-02-10T08:39:14.253 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adf1ccbd:::benchmark_data_smithi018_166993_object82311:head# 2024-02-10T08:39:14.253 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adf29ba1:::benchmark_data_smithi018_166993_object55314:head# 2024-02-10T08:39:14.253 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adf2b7d5:::benchmark_data_smithi018_166993_object46375:head# 2024-02-10T08:39:14.253 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adf2e4ec:::benchmark_data_smithi018_166993_object60769:head# 2024-02-10T08:39:14.254 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adf4dc0b:::benchmark_data_smithi018_166993_object60851:head# 2024-02-10T08:39:14.258 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adf5230e:::benchmark_data_smithi018_166993_object41420:head# 2024-02-10T08:39:14.258 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adf5283b:::benchmark_data_smithi018_166993_object76164:head# 2024-02-10T08:39:14.264 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adf80593:::benchmark_data_smithi018_166993_object99014:head# 2024-02-10T08:39:14.264 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adf87fb0:::benchmark_data_smithi018_166993_object26862:head# 2024-02-10T08:39:14.264 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adfa2b40:::benchmark_data_smithi018_166993_object112534:head# 2024-02-10T08:39:14.264 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adfa3d08:::benchmark_data_smithi018_166993_object20979:head# 2024-02-10T08:39:14.264 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adfa9acf:::benchmark_data_smithi018_166993_object106117:head# 2024-02-10T08:39:14.265 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adfd6446:::benchmark_data_smithi018_166993_object112901:head# 2024-02-10T08:39:14.265 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adfd7543:::benchmark_data_smithi018_166993_object84890:head# 2024-02-10T08:39:14.265 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adfe245f:::benchmark_data_smithi018_166993_object74816:head# 2024-02-10T08:39:14.265 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adfe5a18:::benchmark_data_smithi018_166993_object87791:head# 2024-02-10T08:39:14.265 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:adffdcf0:::benchmark_data_smithi018_166993_object70744:head# 2024-02-10T08:39:14.266 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae003889:::benchmark_data_smithi018_166993_object49864:head# 2024-02-10T08:39:14.266 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae020580:::benchmark_data_smithi018_166993_object28319:head# 2024-02-10T08:39:14.270 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae02a536:::benchmark_data_smithi018_166993_object17482:head# 2024-02-10T08:39:14.270 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae033079:::benchmark_data_smithi018_166993_object22952:head# 2024-02-10T08:39:14.270 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae04d847:::benchmark_data_smithi018_166993_object66805:head# 2024-02-10T08:39:14.270 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae058357:::benchmark_data_smithi018_166993_object73034:head# 2024-02-10T08:39:14.270 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae05881c:::benchmark_data_smithi018_166993_object26049:head# 2024-02-10T08:39:14.270 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae06e69b:::benchmark_data_smithi018_166993_object67642:head# 2024-02-10T08:39:14.273 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae07cea9:::benchmark_data_smithi018_166993_object99895:head# 2024-02-10T08:39:14.276 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae0810cd:::benchmark_data_smithi018_166993_object111908:head# 2024-02-10T08:39:14.277 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae08664c:::benchmark_data_smithi018_166993_object105578:head# 2024-02-10T08:39:14.277 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae097834:::benchmark_data_smithi018_166993_object73766:head# 2024-02-10T08:39:14.277 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae098c74:::benchmark_data_smithi018_166993_object41518:head# 2024-02-10T08:39:14.277 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae09a57f:::benchmark_data_smithi018_166993_object90647:head# 2024-02-10T08:39:14.277 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae09c16e:::benchmark_data_smithi018_166993_object82937:head# 2024-02-10T08:39:14.278 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae0a8377:::benchmark_data_smithi018_166993_object52758:head# 2024-02-10T08:39:14.279 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae0a9fa5:::benchmark_data_smithi018_166993_object98644:head# 2024-02-10T08:39:14.279 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae0ac052:::benchmark_data_smithi018_166993_object32407:head# 2024-02-10T08:39:14.279 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae0d6044:::benchmark_data_smithi018_166993_object99555:head# 2024-02-10T08:39:14.279 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae0d7268:::benchmark_data_smithi018_166993_object103049:head# 2024-02-10T08:39:14.279 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae0db75f:::benchmark_data_smithi018_166993_object42654:head# 2024-02-10T08:39:14.279 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae0f901a:::benchmark_data_smithi018_166993_object50324:head# 2024-02-10T08:39:14.280 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae107942:::benchmark_data_smithi018_166993_object109193:head# 2024-02-10T08:39:14.280 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae115572:::benchmark_data_smithi018_166993_object26045:head# 2024-02-10T08:39:14.280 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae11ee92:::benchmark_data_smithi018_166993_object117570:head# 2024-02-10T08:39:14.284 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae1241e7:::benchmark_data_smithi018_166993_object84465:head# 2024-02-10T08:39:14.284 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae127be6:::benchmark_data_smithi018_166993_object37850:head# 2024-02-10T08:39:14.290 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae129b29:::benchmark_data_smithi018_166993_object50976:head# 2024-02-10T08:39:14.290 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae13b497:::benchmark_data_smithi018_166993_object49607:head# 2024-02-10T08:39:14.291 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae1577d9:::benchmark_data_smithi018_166993_object84492:head# 2024-02-10T08:39:14.291 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae162db0:::benchmark_data_smithi018_166993_object103636:head# 2024-02-10T08:39:14.291 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae16cefb:::benchmark_data_smithi018_166993_object103461:head# 2024-02-10T08:39:14.291 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae173ee8:::benchmark_data_smithi018_166993_object68057:head# 2024-02-10T08:39:14.291 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae184f66:::benchmark_data_smithi018_166993_object53825:head# 2024-02-10T08:39:14.291 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae1a33e1:::benchmark_data_smithi018_166993_object31314:head# 2024-02-10T08:39:14.291 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae1a5157:::benchmark_data_smithi018_166993_object32495:head# 2024-02-10T08:39:14.291 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae1a67bd:::benchmark_data_smithi018_166993_object58722:head# 2024-02-10T08:39:14.292 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae1a8c98:::benchmark_data_smithi018_166993_object64783:head# 2024-02-10T08:39:14.292 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae1add0b:::benchmark_data_smithi018_166993_object89394:head# 2024-02-10T08:39:14.292 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae1b0794:::benchmark_data_smithi018_166993_object90268:head# 2024-02-10T08:39:14.293 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae1bb0c4:::benchmark_data_smithi018_166993_object103099:head# 2024-02-10T08:39:14.301 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae1bcf6f:::benchmark_data_smithi018_166993_object118518:head# 2024-02-10T08:39:14.308 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae1bfd85:::benchmark_data_smithi018_166993_object43660:head# 2024-02-10T08:39:14.308 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae1c6a44:::benchmark_data_smithi018_166993_object92539:head# 2024-02-10T08:39:14.308 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae1cdc29:::benchmark_data_smithi018_166993_object44285:head# 2024-02-10T08:39:14.308 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae1d3b99:::benchmark_data_smithi018_166993_object84073:head# 2024-02-10T08:39:14.309 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae1e3f9d:::benchmark_data_smithi018_166993_object42962:head# 2024-02-10T08:39:14.310 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae1f0294:::benchmark_data_smithi018_166993_object25063:head# 2024-02-10T08:39:14.310 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae1f67a3:::benchmark_data_smithi018_166993_object108556:head# 2024-02-10T08:39:14.310 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae20344a:::benchmark_data_smithi018_166993_object80421:head# 2024-02-10T08:39:14.310 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae208a7d:::benchmark_data_smithi018_166993_object62348:head# 2024-02-10T08:39:14.311 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae20d8d7:::benchmark_data_smithi018_166993_object103407:head# 2024-02-10T08:39:14.311 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae218698:::benchmark_data_smithi018_166993_object34235:head# 2024-02-10T08:39:14.311 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae21de89:::benchmark_data_smithi018_166993_object20936:head# 2024-02-10T08:39:14.311 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae220b36:::benchmark_data_smithi018_166993_object109712:head# 2024-02-10T08:39:14.315 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae22b960:::benchmark_data_smithi018_166993_object35326:head# 2024-02-10T08:39:14.315 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae2424d6:::benchmark_data_smithi018_166993_object20923:head# 2024-02-10T08:39:14.315 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae244a75:::benchmark_data_smithi018_166993_object67867:head# 2024-02-10T08:39:14.316 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae246353:::benchmark_data_smithi018_166993_object85122:head# 2024-02-10T08:39:14.319 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae251de3:::benchmark_data_smithi018_166993_object109618:head# 2024-02-10T08:39:14.321 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae25a566:::benchmark_data_smithi018_166993_object35059:head# 2024-02-10T08:39:14.322 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae25dab6:::benchmark_data_smithi018_166993_object23396:head# 2024-02-10T08:39:14.322 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae25fdf8:::benchmark_data_smithi018_166993_object103611:head# 2024-02-10T08:39:14.322 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae263bc0:::benchmark_data_smithi018_166993_object62545:head# 2024-02-10T08:39:14.323 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae268af7:::benchmark_data_smithi018_166993_object84290:head# 2024-02-10T08:39:14.324 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae26964f:::benchmark_data_smithi018_166993_object107177:head# 2024-02-10T08:39:14.324 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae27130e:::benchmark_data_smithi018_166993_object86033:head# 2024-02-10T08:39:14.324 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae272511:::benchmark_data_smithi018_166993_object37081:head# 2024-02-10T08:39:14.325 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae272b32:::benchmark_data_smithi018_166993_object32283:head# 2024-02-10T08:39:14.325 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae2836b8:::benchmark_data_smithi018_166993_object26227:head# 2024-02-10T08:39:14.326 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae28b0d7:::benchmark_data_smithi018_166993_object32017:head# 2024-02-10T08:39:14.326 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae29daff:::benchmark_data_smithi018_166993_object82708:head# 2024-02-10T08:39:14.328 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae29f87e:::benchmark_data_smithi018_166993_object21351:head# 2024-02-10T08:39:14.329 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae2d7b88:::benchmark_data_smithi018_166993_object63134:head# 2024-02-10T08:39:14.330 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae2eda43:::benchmark_data_smithi018_166993_object103661:head# 2024-02-10T08:39:14.335 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae300bd8:::benchmark_data_smithi018_166993_object117310:head# 2024-02-10T08:39:14.335 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae301d63:::benchmark_data_smithi018_166993_object17690:head# 2024-02-10T08:39:14.335 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae309ac8:::benchmark_data_smithi018_166993_object85585:head# 2024-02-10T08:39:14.335 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae30da50:::benchmark_data_smithi018_166993_object97976:head# 2024-02-10T08:39:14.335 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae311d36:::benchmark_data_smithi018_166993_object105247:head# 2024-02-10T08:39:14.343 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae31a6b5:::benchmark_data_smithi018_166993_object85788:head# 2024-02-10T08:39:14.343 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae31a8d6:::benchmark_data_smithi018_166993_object49284:head# 2024-02-10T08:39:14.344 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae31da72:::benchmark_data_smithi018_166993_object60424:head# 2024-02-10T08:39:14.344 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae31f5ad:::benchmark_data_smithi018_166993_object37331:head# 2024-02-10T08:39:14.346 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae327d4f:::benchmark_data_smithi018_166993_object115089:head# 2024-02-10T08:39:14.346 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae340095:::benchmark_data_smithi018_166993_object52399:head# 2024-02-10T08:39:14.346 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae350eda:::benchmark_data_smithi018_166993_object115526:head# 2024-02-10T08:39:14.346 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae35c9b0:::benchmark_data_smithi018_166993_object57159:head# 2024-02-10T08:39:14.346 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae36d469:::benchmark_data_smithi018_166993_object25477:head# 2024-02-10T08:39:14.347 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae370828:::benchmark_data_smithi018_166993_object36307:head# 2024-02-10T08:39:14.347 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae3931cc:::benchmark_data_smithi018_166993_object22896:head# 2024-02-10T08:39:14.347 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae394c34:::benchmark_data_smithi018_166993_object73433:head# 2024-02-10T08:39:14.348 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae39fa75:::benchmark_data_smithi018_166993_object60544:head# 2024-02-10T08:39:14.348 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae3a3a7b:::benchmark_data_smithi018_166993_object100736:head# 2024-02-10T08:39:14.349 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae3a7750:::benchmark_data_smithi018_166993_object83372:head# 2024-02-10T08:39:14.349 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae3a7f9d:::benchmark_data_smithi018_166993_object106639:head# 2024-02-10T08:39:14.354 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae3aeba2:::benchmark_data_smithi018_166993_object28324:head# 2024-02-10T08:39:14.354 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae3b7c39:::benchmark_data_smithi018_166993_object88636:head# 2024-02-10T08:39:14.355 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae3bffed:::benchmark_data_smithi018_166993_object113182:head# 2024-02-10T08:39:14.355 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae3ccce3:::benchmark_data_smithi018_166993_object46519:head# 2024-02-10T08:39:14.355 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae3d2e13:::benchmark_data_smithi018_166993_object90149:head# 2024-02-10T08:39:14.356 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae3d687c:::benchmark_data_smithi018_166993_object103886:head# 2024-02-10T08:39:14.356 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae3d9278:::benchmark_data_smithi018_166993_object30336:head# 2024-02-10T08:39:14.357 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae3ec92f:::benchmark_data_smithi018_166993_object26053:head# 2024-02-10T08:39:14.357 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae3f3f16:::benchmark_data_smithi018_166993_object30581:head# 2024-02-10T08:39:14.360 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae40a6f1:::benchmark_data_smithi018_166993_object44105:head# 2024-02-10T08:39:14.362 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae40ad92:::benchmark_data_smithi018_166993_object75149:head# 2024-02-10T08:39:14.362 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae40b201:::benchmark_data_smithi018_166993_object98585:head# 2024-02-10T08:39:14.362 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae40d33d:::benchmark_data_smithi018_166993_object105921:head# 2024-02-10T08:39:14.362 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae414ca9:::benchmark_data_smithi018_166993_object77496:head# 2024-02-10T08:39:14.364 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae41de69:::benchmark_data_smithi018_166993_object85962:head# 2024-02-10T08:39:14.364 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae448b89:::benchmark_data_smithi018_166993_object71157:head# 2024-02-10T08:39:14.365 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae451548:::benchmark_data_smithi018_166993_object37252:head# 2024-02-10T08:39:14.366 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae452132:::benchmark_data_smithi018_166993_object30524:head# 2024-02-10T08:39:14.368 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae45c9a3:::benchmark_data_smithi018_166993_object77377:head# 2024-02-10T08:39:14.372 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae45ef5c:::benchmark_data_smithi018_166993_object56724:head# 2024-02-10T08:39:14.372 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae46084b:::benchmark_data_smithi018_166993_object38721:head# 2024-02-10T08:39:14.372 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae467cd7:::benchmark_data_smithi018_166993_object109680:head# 2024-02-10T08:39:14.372 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae46df95:::benchmark_data_smithi018_166993_object66574:head# 2024-02-10T08:39:14.372 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae476d01:::benchmark_data_smithi018_166993_object113772:head# 2024-02-10T08:39:14.373 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae479143:::benchmark_data_smithi018_166993_object91134:head# 2024-02-10T08:39:14.373 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae47b31e:::benchmark_data_smithi018_166993_object83893:head# 2024-02-10T08:39:14.375 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae47f930:::benchmark_data_smithi018_166993_object64472:head# 2024-02-10T08:39:14.375 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae485799:::benchmark_data_smithi018_166993_object45451:head# 2024-02-10T08:39:14.375 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae4a2c5f:::benchmark_data_smithi018_166993_object67790:head# 2024-02-10T08:39:14.375 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae4ae68f:::benchmark_data_smithi018_166993_object52960:head# 2024-02-10T08:39:14.379 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae4b195e:::benchmark_data_smithi018_166993_object57585:head# 2024-02-10T08:39:14.379 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae4b8a26:::benchmark_data_smithi018_166993_object94793:head# 2024-02-10T08:39:14.380 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae4bc390:::benchmark_data_smithi018_166993_object54417:head# 2024-02-10T08:39:14.383 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae4c1408:::benchmark_data_smithi018_166993_object95489:head# 2024-02-10T08:39:14.383 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae4d1cde:::benchmark_data_smithi018_166993_object53516:head# 2024-02-10T08:39:14.383 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae4d9673:::benchmark_data_smithi018_166993_object44496:head# 2024-02-10T08:39:14.383 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae4df0e7:::benchmark_data_smithi018_166993_object52289:head# 2024-02-10T08:39:14.385 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae4f9631:::benchmark_data_smithi018_166993_object42521:head# 2024-02-10T08:39:14.385 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae5018d3:::benchmark_data_smithi018_166993_object65522:head# 2024-02-10T08:39:14.386 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae516502:::benchmark_data_smithi018_166993_object88505:head# 2024-02-10T08:39:14.386 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae519342:::benchmark_data_smithi018_166993_object56780:head# 2024-02-10T08:39:14.389 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae51df8d:::benchmark_data_smithi018_166993_object29815:head# 2024-02-10T08:39:14.390 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae53b4bc:::benchmark_data_smithi018_166993_object115491:head# 2024-02-10T08:39:14.390 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae53cfd5:::benchmark_data_smithi018_166993_object39431:head# 2024-02-10T08:39:14.390 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae546c14:::benchmark_data_smithi018_166993_object95059:head# 2024-02-10T08:39:14.390 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae54a5dc:::benchmark_data_smithi018_166993_object100312:head# 2024-02-10T08:39:14.390 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae54b38b:::benchmark_data_smithi018_166993_object22293:head# 2024-02-10T08:39:14.393 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae550667:::benchmark_data_smithi018_166993_object51928:head# 2024-02-10T08:39:14.393 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae558dac:::benchmark_data_smithi018_166993_object105115:head# 2024-02-10T08:39:14.397 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae567549:::benchmark_data_smithi018_166993_object39138:head# 2024-02-10T08:39:14.400 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae56c15c:::benchmark_data_smithi018_166993_object36101:head# 2024-02-10T08:39:14.400 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae57393e:::benchmark_data_smithi018_166993_object116287:head# 2024-02-10T08:39:14.400 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae584030:::benchmark_data_smithi018_166993_object102941:head# 2024-02-10T08:39:14.400 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae584c43:::benchmark_data_smithi018_166993_object111474:head# 2024-02-10T08:39:14.400 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae58b2d0:::benchmark_data_smithi018_166993_object35364:head# 2024-02-10T08:39:14.401 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae591881:::benchmark_data_smithi018_166993_object36261:head# 2024-02-10T08:39:14.402 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae594fb7:::benchmark_data_smithi018_166993_object94138:head# 2024-02-10T08:39:14.402 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae596223:::benchmark_data_smithi018_166993_object113078:head# 2024-02-10T08:39:14.403 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae596aee:::benchmark_data_smithi018_166993_object19969:head# 2024-02-10T08:39:14.403 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae59f763:::benchmark_data_smithi018_166993_object33742:head# 2024-02-10T08:39:14.404 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae5a3205:::benchmark_data_smithi018_166993_object95382:head# 2024-02-10T08:39:14.404 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae5a3aa4:::benchmark_data_smithi018_166993_object40265:head# 2024-02-10T08:39:14.405 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae5ba84b:::benchmark_data_smithi018_166993_object35618:head# 2024-02-10T08:39:14.407 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae5d827d:::benchmark_data_smithi018_166993_object84945:head# 2024-02-10T08:39:14.408 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae5e16f1:::benchmark_data_smithi018_166993_object26149:head# 2024-02-10T08:39:14.409 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae5ed2d5:::benchmark_data_smithi018_166993_object61888:head# 2024-02-10T08:39:14.410 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae5f5b68:::benchmark_data_smithi018_166993_object69680:head# 2024-02-10T08:39:14.410 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae5f6673:::benchmark_data_smithi018_166993_object42448:head# 2024-02-10T08:39:14.410 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae601f04:::benchmark_data_smithi018_166993_object42511:head# 2024-02-10T08:39:14.411 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae60b901:::benchmark_data_smithi018_166993_object116559:head# 2024-02-10T08:39:14.411 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae6117c7:::benchmark_data_smithi018_166993_object55382:head# 2024-02-10T08:39:14.412 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae612890:::benchmark_data_smithi018_166993_object76179:head# 2024-02-10T08:39:14.412 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae616648:::benchmark_data_smithi018_166993_object51221:head# 2024-02-10T08:39:14.417 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae61c2fb:::benchmark_data_smithi018_166993_object118748:head# 2024-02-10T08:39:14.417 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae622e1f:::benchmark_data_smithi018_166993_object51267:head# 2024-02-10T08:39:14.420 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae6380db:::benchmark_data_smithi018_166993_object84752:head# 2024-02-10T08:39:14.420 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae64210b:::benchmark_data_smithi018_166993_object114149:head# 2024-02-10T08:39:14.421 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae643cf1:::benchmark_data_smithi018_166993_object100750:head# 2024-02-10T08:39:14.421 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae65428e:::benchmark_data_smithi018_166993_object73358:head# 2024-02-10T08:39:14.421 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae66b4e9:::benchmark_data_smithi018_166993_object75917:head# 2024-02-10T08:39:14.421 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae678bff:::benchmark_data_smithi018_166993_object71672:head# 2024-02-10T08:39:14.422 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae679886:::benchmark_data_smithi018_166993_object44313:head# 2024-02-10T08:39:14.422 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae68281c:::benchmark_data_smithi018_166993_object58993:head# 2024-02-10T08:39:14.423 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae6873ab:::benchmark_data_smithi018_166993_object106250:head# 2024-02-10T08:39:14.423 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae68a0a2:::benchmark_data_smithi018_166993_object24844:head# 2024-02-10T08:39:14.424 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae6987ca:::benchmark_data_smithi018_166993_object62151:head# 2024-02-10T08:39:14.427 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae6a4dee:::benchmark_data_smithi018_166993_object79973:head# 2024-02-10T08:39:14.427 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae6ab925:::benchmark_data_smithi018_166993_object103345:head# 2024-02-10T08:39:14.427 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae6bc7cf:::benchmark_data_smithi018_166993_object101380:head# 2024-02-10T08:39:14.427 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae6cb6bb:::benchmark_data_smithi018_166993_object60873:head# 2024-02-10T08:39:14.430 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae6d0ecb:::benchmark_data_smithi018_166993_object18051:head# 2024-02-10T08:39:14.430 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae6db19e:::benchmark_data_smithi018_166993_object33305:head# 2024-02-10T08:39:14.431 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae6f30be:::benchmark_data_smithi018_166993_object29498:head# 2024-02-10T08:39:14.431 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae6feb5f:::benchmark_data_smithi018_166993_object82454:head# 2024-02-10T08:39:14.431 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae713c66:::benchmark_data_smithi018_166993_object57195:head# 2024-02-10T08:39:14.432 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae71572b:::benchmark_data_smithi018_166993_object35270:head# 2024-02-10T08:39:14.432 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae71b7cf:::benchmark_data_smithi018_166993_object66539:head# 2024-02-10T08:39:14.433 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae7490a4:::benchmark_data_smithi018_166993_object35786:head# 2024-02-10T08:39:14.433 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae750fec:::benchmark_data_smithi018_166993_object58583:head# 2024-02-10T08:39:14.434 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae75dc0c:::benchmark_data_smithi018_166993_object68053:head# 2024-02-10T08:39:14.434 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae76365d:::benchmark_data_smithi018_166993_object105606:head# 2024-02-10T08:39:14.435 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae76dbc8:::benchmark_data_smithi018_166993_object115123:head# 2024-02-10T08:39:14.435 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae771dc2:::benchmark_data_smithi018_166993_object80734:head# 2024-02-10T08:39:14.436 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae7817c3:::benchmark_data_smithi018_166993_object42052:head# 2024-02-10T08:39:14.438 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae78776b:::benchmark_data_smithi018_166993_object62352:head# 2024-02-10T08:39:14.439 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae78b7bf:::benchmark_data_smithi018_166993_object52633:head# 2024-02-10T08:39:14.442 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae796e4d:::benchmark_data_smithi018_166993_object58347:head# 2024-02-10T08:39:14.443 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae7a5022:::benchmark_data_smithi018_166993_object101672:head# 2024-02-10T08:39:14.443 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae7ad87f:::benchmark_data_smithi018_166993_object81993:head# 2024-02-10T08:39:14.446 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae7c1ef2:::benchmark_data_smithi018_166993_object45775:head# 2024-02-10T08:39:14.446 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae7d27dc:::benchmark_data_smithi018_166993_object99600:head# 2024-02-10T08:39:14.446 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae7d8f40:::benchmark_data_smithi018_166993_object29649:head# 2024-02-10T08:39:14.447 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae7df9c7:::benchmark_data_smithi018_166993_object46435:head# 2024-02-10T08:39:14.447 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae7e22a3:::benchmark_data_smithi018_166993_object24784:head# 2024-02-10T08:39:14.457 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae7f04bf:::benchmark_data_smithi018_166993_object100760:head# 2024-02-10T08:39:14.457 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae80714b:::benchmark_data_smithi018_166993_object91763:head# 2024-02-10T08:39:14.457 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae80c08e:::benchmark_data_smithi018_166993_object77624:head# 2024-02-10T08:39:14.457 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae811442:::benchmark_data_smithi018_166993_object105319:head# 2024-02-10T08:39:14.457 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae81f756:::benchmark_data_smithi018_166993_object113511:head# 2024-02-10T08:39:14.458 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae822067:::benchmark_data_smithi018_166993_object53117:head# 2024-02-10T08:39:14.458 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae8277b8:::benchmark_data_smithi018_166993_object38296:head# 2024-02-10T08:39:14.458 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae82e606:::benchmark_data_smithi018_166993_object36522:head# 2024-02-10T08:39:14.458 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae83060e:::benchmark_data_smithi018_166993_object34943:head# 2024-02-10T08:39:14.458 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae8314fe:::benchmark_data_smithi018_166993_object34483:head# 2024-02-10T08:39:14.458 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae8385fb:::benchmark_data_smithi018_166993_object111030:head# 2024-02-10T08:39:14.458 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae848d2f:::benchmark_data_smithi018_166993_object112435:head# 2024-02-10T08:39:14.458 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae849e52:::benchmark_data_smithi018_166993_object80677:head# 2024-02-10T08:39:14.458 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae84b1aa:::benchmark_data_smithi018_166993_object118606:head# 2024-02-10T08:39:14.459 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae84c30d:::benchmark_data_smithi018_166993_object94907:head# 2024-02-10T08:39:14.459 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae84f0f2:::benchmark_data_smithi018_166993_object117505:head# 2024-02-10T08:39:14.459 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae8595c3:::benchmark_data_smithi018_166993_object41253:head# 2024-02-10T08:39:14.459 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae864be1:::benchmark_data_smithi018_166993_object59594:head# 2024-02-10T08:39:14.459 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae864ede:::benchmark_data_smithi018_166993_object79925:head# 2024-02-10T08:39:14.466 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae866c52:::benchmark_data_smithi018_166993_object33821:head# 2024-02-10T08:39:14.467 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae86e7fc:::benchmark_data_smithi018_166993_object55902:head# 2024-02-10T08:39:14.467 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae885441:::benchmark_data_smithi018_166993_object38056:head# 2024-02-10T08:39:14.467 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae8af451:::benchmark_data_smithi018_166993_object55048:head# 2024-02-10T08:39:14.467 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae8bfa82:::benchmark_data_smithi018_166993_object69902:head# 2024-02-10T08:39:14.467 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae8c73d8:::benchmark_data_smithi018_166993_object17622:head# 2024-02-10T08:39:14.467 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae8fdf1a:::benchmark_data_smithi018_166993_object17936:head# 2024-02-10T08:39:14.467 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae90c853:::benchmark_data_smithi018_166993_object48172:head# 2024-02-10T08:39:14.467 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae912c05:::benchmark_data_smithi018_166993_object82014:head# 2024-02-10T08:39:14.467 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae919f00:::benchmark_data_smithi018_166993_object112409:head# 2024-02-10T08:39:14.473 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae91c33a:::benchmark_data_smithi018_166993_object74658:head# 2024-02-10T08:39:14.473 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae92b092:::benchmark_data_smithi018_166993_object38603:head# 2024-02-10T08:39:14.473 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae932506:::benchmark_data_smithi018_166993_object72382:head# 2024-02-10T08:39:14.473 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae953506:::benchmark_data_smithi018_166993_object102739:head# 2024-02-10T08:39:14.473 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae973814:::benchmark_data_smithi018_166993_object72580:head# 2024-02-10T08:39:14.473 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae974854:::benchmark_data_smithi018_166993_object84657:head# 2024-02-10T08:39:14.474 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae98549d:::benchmark_data_smithi018_166993_object107221:head# 2024-02-10T08:39:14.474 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae996ea3:::benchmark_data_smithi018_166993_object60005:head# 2024-02-10T08:39:14.474 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae99abec:::benchmark_data_smithi018_166993_object71279:head# 2024-02-10T08:39:14.476 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae9a323e:::benchmark_data_smithi018_166993_object59053:head# 2024-02-10T08:39:14.478 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae9aea10:::benchmark_data_smithi018_166993_object56163:head# 2024-02-10T08:39:14.478 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae9b988c:::benchmark_data_smithi018_166993_object91010:head# 2024-02-10T08:39:14.478 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae9c714a:::benchmark_data_smithi018_166993_object82487:head# 2024-02-10T08:39:14.478 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae9c9696:::benchmark_data_smithi018_166993_object42590:head# 2024-02-10T08:39:14.478 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae9d3334:::benchmark_data_smithi018_166993_object82090:head# 2024-02-10T08:39:14.479 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae9d8530:::benchmark_data_smithi018_166993_object44522:head# 2024-02-10T08:39:14.483 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae9ea11e:::benchmark_data_smithi018_166993_object27210:head# 2024-02-10T08:39:14.487 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:ae9ebb1a:::benchmark_data_smithi018_166993_object55071:head# 2024-02-10T08:39:14.487 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aea0c92a:::benchmark_data_smithi018_166993_object70670:head# 2024-02-10T08:39:14.493 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aea194ad:::benchmark_data_smithi018_166993_object89077:head# 2024-02-10T08:39:14.496 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aea19eb0:::benchmark_data_smithi018_166993_object113447:head# 2024-02-10T08:39:14.496 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aea2909d:::benchmark_data_smithi018_166993_object24782:head# 2024-02-10T08:39:14.497 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aea441c8:::benchmark_data_smithi018_166993_object45476:head# 2024-02-10T08:39:14.497 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aea5a2bd:::benchmark_data_smithi018_166993_object51555:head# 2024-02-10T08:39:14.497 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aea647fa:::benchmark_data_smithi018_166993_object49494:head# 2024-02-10T08:39:14.499 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aea74586:::benchmark_data_smithi018_166993_object89695:head# 2024-02-10T08:39:14.500 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aea75708:::benchmark_data_smithi018_166993_object116855:head# 2024-02-10T08:39:14.500 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aea85591:::benchmark_data_smithi018_166993_object39607:head# 2024-02-10T08:39:14.505 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aea9a0b4:::benchmark_data_smithi018_166993_object28434:head# 2024-02-10T08:39:14.505 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aea9b985:::benchmark_data_smithi018_166993_object86488:head# 2024-02-10T08:39:14.509 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aeaa7579:::benchmark_data_smithi018_166993_object65831:head# 2024-02-10T08:39:14.509 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aeaa8422:::benchmark_data_smithi018_166993_object25431:head# 2024-02-10T08:39:14.509 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aeab0f2a:::benchmark_data_smithi018_166993_object54416:head# 2024-02-10T08:39:14.509 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aeabee9b:::benchmark_data_smithi018_166993_object47991:head# 2024-02-10T08:39:14.510 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aeabf0d1:::benchmark_data_smithi018_166993_object87889:head# 2024-02-10T08:39:14.510 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aeac7aa5:::benchmark_data_smithi018_166993_object83939:head# 2024-02-10T08:39:14.510 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aeacb495:::benchmark_data_smithi018_166993_object24421:head# 2024-02-10T08:39:14.510 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aead41c4:::benchmark_data_smithi018_166993_object103278:head# 2024-02-10T08:39:14.510 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aead5e69:::benchmark_data_smithi018_166993_object92137:head# 2024-02-10T08:39:14.510 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aeaedf90:::benchmark_data_smithi018_166993_object67629:head# 2024-02-10T08:39:14.510 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aeaf458e:::benchmark_data_smithi018_166993_object75358:head# 2024-02-10T08:39:14.510 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aeaf941a:::benchmark_data_smithi018_166993_object68725:head# 2024-02-10T08:39:14.511 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aeb1b023:::benchmark_data_smithi018_166993_object57045:head# 2024-02-10T08:39:14.511 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aeb1e44f:::benchmark_data_smithi018_166993_object96531:head# 2024-02-10T08:39:14.511 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aeb261a0:::benchmark_data_smithi018_166993_object56059:head# 2024-02-10T08:39:14.513 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aeb2aed1:::benchmark_data_smithi018_166993_object81757:head# 2024-02-10T08:39:14.513 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aeb360b3:::benchmark_data_smithi018_166993_object44232:head# 2024-02-10T08:39:14.513 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aeb4e19d:::benchmark_data_smithi018_166993_object25078:head# 2024-02-10T08:39:14.513 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aeb50dda:::benchmark_data_smithi018_166993_object98316:head# 2024-02-10T08:39:14.513 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aeb59e39:::benchmark_data_smithi018_166993_object82379:head# 2024-02-10T08:39:14.514 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aeb5c47f:::benchmark_data_smithi018_166993_object55562:head# 2024-02-10T08:39:14.515 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aeb6b4c0:::benchmark_data_smithi018_166993_object66739:head# 2024-02-10T08:39:14.516 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aeb6dd5b:::benchmark_data_smithi018_166993_object43656:head# 2024-02-10T08:39:14.519 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aeb7714e:::benchmark_data_smithi018_166993_object83780:head# 2024-02-10T08:39:14.520 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aeb7d208:::benchmark_data_smithi018_166993_object42213:head# 2024-02-10T08:39:14.522 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aeb7f475:::benchmark_data_smithi018_166993_object75766:head# 2024-02-10T08:39:14.522 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aeb829b4:::benchmark_data_smithi018_166993_object62308:head# 2024-02-10T08:39:14.522 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aeb90d50:::benchmark_data_smithi018_166993_object114921:head# 2024-02-10T08:39:14.522 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aeb94679:::benchmark_data_smithi018_166993_object105823:head# 2024-02-10T08:39:14.522 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aeb95e0b:::benchmark_data_smithi018_166993_object70054:head# 2024-02-10T08:39:14.522 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aebae893:::benchmark_data_smithi018_166993_object100264:head# 2024-02-10T08:39:14.526 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aebb7581:::benchmark_data_smithi018_166993_object19664:head# 2024-02-10T08:39:14.526 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aebb83f8:::benchmark_data_smithi018_166993_object43132:head# 2024-02-10T08:39:14.527 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aebbc4ba:::benchmark_data_smithi018_166993_object35497:head# 2024-02-10T08:39:14.529 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aebdc910:::benchmark_data_smithi018_166993_object111612:head# 2024-02-10T08:39:14.530 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aebf4893:::benchmark_data_smithi018_166993_object70073:head# 2024-02-10T08:39:14.530 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aebf6ad5:::benchmark_data_smithi018_166993_object34439:head# 2024-02-10T08:39:14.530 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aebf7d8e:::benchmark_data_smithi018_166993_object18867:head# 2024-02-10T08:39:14.530 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aebfc4e7:::benchmark_data_smithi018_166993_object85731:head# 2024-02-10T08:39:14.530 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aec27357:::benchmark_data_smithi018_166993_object102199:head# 2024-02-10T08:39:14.530 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aec2a8dc:::benchmark_data_smithi018_166993_object58047:head# 2024-02-10T08:39:14.534 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aec30971:::benchmark_data_smithi018_166993_object39640:head# 2024-02-10T08:39:14.534 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aec32f52:::benchmark_data_smithi018_166993_object102492:head# 2024-02-10T08:39:14.534 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aec37665:::benchmark_data_smithi018_166993_object96128:head# 2024-02-10T08:39:14.534 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aec3b54b:::benchmark_data_smithi018_166993_object97597:head# 2024-02-10T08:39:14.535 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aec474f6:::benchmark_data_smithi018_166993_object73002:head# 2024-02-10T08:39:14.535 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aec6e950:::benchmark_data_smithi018_166993_object53886:head# 2024-02-10T08:39:14.538 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aec7408c:::benchmark_data_smithi018_166993_object88195:head# 2024-02-10T08:39:14.538 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aeca6fe2:::benchmark_data_smithi018_166993_object33391:head# 2024-02-10T08:39:14.538 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aecb6c08:::benchmark_data_smithi018_166993_object92073:head# 2024-02-10T08:39:14.538 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aecc6eac:::benchmark_data_smithi018_166993_object82923:head# 2024-02-10T08:39:14.538 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aeccdb8a:::benchmark_data_smithi018_166993_object111560:head# 2024-02-10T08:39:14.539 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aece2604:::benchmark_data_smithi018_166993_object77890:head# 2024-02-10T08:39:14.539 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aecf0d8d:::benchmark_data_smithi018_166993_object85664:head# 2024-02-10T08:39:14.540 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aecff4a9:::benchmark_data_smithi018_166993_object91638:head# 2024-02-10T08:39:14.540 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aed06f35:::benchmark_data_smithi018_166993_object105434:head# 2024-02-10T08:39:14.540 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aed07f55:::benchmark_data_smithi018_166993_object39467:head# 2024-02-10T08:39:14.541 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aed0fd41:::benchmark_data_smithi018_166993_object114537:head# 2024-02-10T08:39:14.542 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aed1a112:::benchmark_data_smithi018_166993_object101752:head# 2024-02-10T08:39:14.542 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aed1c6e3:::benchmark_data_smithi018_166993_object19017:head# 2024-02-10T08:39:14.543 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aed258d3:::benchmark_data_smithi018_166993_object91696:head# 2024-02-10T08:39:14.543 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aed31a6f:::benchmark_data_smithi018_166993_object21586:head# 2024-02-10T08:39:14.544 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aed3dc90:::benchmark_data_smithi018_166993_object42709:head# 2024-02-10T08:39:14.544 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aed47afd:::benchmark_data_smithi018_166993_object76347:head# 2024-02-10T08:39:14.544 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aed4819e:::benchmark_data_smithi018_166993_object40353:head# 2024-02-10T08:39:14.545 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aed49f54:::benchmark_data_smithi018_166993_object33017:head# 2024-02-10T08:39:14.547 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aed4a5b5:::benchmark_data_smithi018_166993_object108216:head# 2024-02-10T08:39:14.547 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aed53919:::benchmark_data_smithi018_166993_object65627:head# 2024-02-10T08:39:14.547 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aed7f840:::benchmark_data_smithi018_166993_object94498:head# 2024-02-10T08:39:14.548 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aed95f68:::benchmark_data_smithi018_166993_object39129:head# 2024-02-10T08:39:14.549 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aed9d6e7:::benchmark_data_smithi018_166993_object76445:head# 2024-02-10T08:39:14.550 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aedab5b8:::benchmark_data_smithi018_166993_object91442:head# 2024-02-10T08:39:14.550 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aedb43a1:::benchmark_data_smithi018_166993_object28131:head# 2024-02-10T08:39:14.551 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aedc0776:::benchmark_data_smithi018_166993_object52827:head# 2024-02-10T08:39:14.551 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aedc57cb:::benchmark_data_smithi018_166993_object85320:head# 2024-02-10T08:39:14.551 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aedc5ba7:::benchmark_data_smithi018_166993_object85333:head# 2024-02-10T08:39:14.552 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aedcb2c8:::benchmark_data_smithi018_166993_object68964:head# 2024-02-10T08:39:14.556 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aedd5a6a:::benchmark_data_smithi018_166993_object116356:head# 2024-02-10T08:39:14.556 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aede1f48:::benchmark_data_smithi018_166993_object49355:head# 2024-02-10T08:39:14.556 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aede8331:::benchmark_data_smithi018_166993_object24540:head# 2024-02-10T08:39:14.557 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aedeea84:::benchmark_data_smithi018_166993_object43227:head# 2024-02-10T08:39:14.557 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aee13a28:::benchmark_data_smithi018_166993_object109166:head# 2024-02-10T08:39:14.557 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aee1432d:::benchmark_data_smithi018_166993_object32235:head# 2024-02-10T08:39:14.557 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aee14845:::benchmark_data_smithi018_166993_object73627:head# 2024-02-10T08:39:14.558 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aee1b7b2:::benchmark_data_smithi018_166993_object39488:head# 2024-02-10T08:39:14.558 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aee1c23a:::benchmark_data_smithi018_166993_object116023:head# 2024-02-10T08:39:14.559 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aee2de6e:::benchmark_data_smithi018_166993_object75159:head# 2024-02-10T08:39:14.559 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aee30f10:::benchmark_data_smithi018_166993_object25308:head# 2024-02-10T08:39:14.559 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aee31d62:::benchmark_data_smithi018_166993_object52241:head# 2024-02-10T08:39:14.562 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aee37370:::benchmark_data_smithi018_166993_object32671:head# 2024-02-10T08:39:14.562 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aee42a3b:::benchmark_data_smithi018_166993_object106500:head# 2024-02-10T08:39:14.562 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aee5b1fe:::benchmark_data_smithi018_166993_object54659:head# 2024-02-10T08:39:14.562 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aee6f815:::benchmark_data_smithi018_166993_object77362:head# 2024-02-10T08:39:14.562 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aee7aa42:::benchmark_data_smithi018_166993_object46784:head# 2024-02-10T08:39:14.563 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aee7b9c2:::benchmark_data_smithi018_166993_object76288:head# 2024-02-10T08:39:14.563 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aee7cd0e:::benchmark_data_smithi018_166993_object105414:head# 2024-02-10T08:39:14.566 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aee9f0e0:::benchmark_data_smithi018_166993_object85125:head# 2024-02-10T08:39:14.566 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aeea0257:::benchmark_data_smithi018_166993_object28755:head# 2024-02-10T08:39:14.567 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aeea3f12:::benchmark_data_smithi018_166993_object65923:head# 2024-02-10T08:39:14.567 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aeeaa53d:::benchmark_data_smithi018_166993_object68016:head# 2024-02-10T08:39:14.567 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aeecd7be:::benchmark_data_smithi018_166993_object18862:head# 2024-02-10T08:39:14.568 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aeef7f24:::benchmark_data_smithi018_166993_object25893:head# 2024-02-10T08:39:14.568 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aef0d160:::benchmark_data_smithi018_166993_object92087:head# 2024-02-10T08:39:14.572 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aef131ea:::benchmark_data_smithi018_166993_object26796:head# 2024-02-10T08:39:14.573 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aef1758e:::benchmark_data_smithi018_166993_object112570:head# 2024-02-10T08:39:14.573 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aef23979:::benchmark_data_smithi018_166993_object58328:head# 2024-02-10T08:39:14.575 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aef3ce25:::benchmark_data_smithi018_166993_object67261:head# 2024-02-10T08:39:14.575 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aef3e909:::benchmark_data_smithi018_166993_object47153:head# 2024-02-10T08:39:14.576 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aef48293:::benchmark_data_smithi018_166993_object22458:head# 2024-02-10T08:39:14.576 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aef4a939:::benchmark_data_smithi018_166993_object62672:head# 2024-02-10T08:39:14.576 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aef5e619:::benchmark_data_smithi018_166993_object57297:head# 2024-02-10T08:39:14.576 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aef6d8a3:::benchmark_data_smithi018_166993_object89581:head# 2024-02-10T08:39:14.577 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aef76c26:::benchmark_data_smithi018_166993_object31222:head# 2024-02-10T08:39:14.577 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aef7a018:::benchmark_data_smithi018_166993_object60740:head# 2024-02-10T08:39:14.577 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aef7f124:::benchmark_data_smithi018_166993_object19173:head# 2024-02-10T08:39:14.578 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aef88617:::benchmark_data_smithi018_166993_object35402:head# 2024-02-10T08:39:14.580 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aef893db:::benchmark_data_smithi018_166993_object117066:head# 2024-02-10T08:39:14.580 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aef8bb33:::benchmark_data_smithi018_166993_object54022:head# 2024-02-10T08:39:14.580 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aefbfbf5:::benchmark_data_smithi018_166993_object75293:head# 2024-02-10T08:39:14.580 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aefc3adf:::benchmark_data_smithi018_166993_object103382:head# 2024-02-10T08:39:14.580 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aefcbcf3:::benchmark_data_smithi018_166993_object80172:head# 2024-02-10T08:39:14.581 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aefced5a:::benchmark_data_smithi018_166993_object115303:head# 2024-02-10T08:39:14.581 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aefd3b98:::benchmark_data_smithi018_166993_object111937:head# 2024-02-10T08:39:14.581 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aefdf74d:::benchmark_data_smithi018_166993_object76352:head# 2024-02-10T08:39:14.581 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aefe000f:::benchmark_data_smithi018_166993_object49274:head# 2024-02-10T08:39:14.582 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aefeba3d:::benchmark_data_smithi018_166993_object94022:head# 2024-02-10T08:39:14.582 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aefeeba6:::benchmark_data_smithi018_166993_object94756:head# 2024-02-10T08:39:14.582 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aeff0075:::benchmark_data_smithi018_166993_object113587:head# 2024-02-10T08:39:14.583 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aeff255d:::benchmark_data_smithi018_166993_object50912:head# 2024-02-10T08:39:14.583 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aeff6151:::benchmark_data_smithi018_166993_object71114:head# 2024-02-10T08:39:14.584 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af008f0f:::benchmark_data_smithi018_166993_object100240:head# 2024-02-10T08:39:14.584 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af00a600:::benchmark_data_smithi018_166993_object98597:head# 2024-02-10T08:39:14.585 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af023f60:::benchmark_data_smithi018_166993_object114548:head# 2024-02-10T08:39:14.585 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af032361:::benchmark_data_smithi018_166993_object103829:head# 2024-02-10T08:39:14.586 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af032f04:::benchmark_data_smithi018_166993_object19391:head# 2024-02-10T08:39:14.586 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af03801e:::benchmark_data_smithi018_166993_object114200:head# 2024-02-10T08:39:14.587 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af03bbcf:::benchmark_data_smithi018_166993_object112510:head# 2024-02-10T08:39:14.587 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af03fcc3:::benchmark_data_smithi018_166993_object52088:head# 2024-02-10T08:39:14.588 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af0432fa:::benchmark_data_smithi018_166993_object95506:head# 2024-02-10T08:39:14.590 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af052cba:::benchmark_data_smithi018_166993_object34168:head# 2024-02-10T08:39:14.590 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af05db6e:::benchmark_data_smithi018_166993_object37477:head# 2024-02-10T08:39:14.590 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af05f51e:::benchmark_data_smithi018_166993_object60966:head# 2024-02-10T08:39:14.591 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af0621e5:::benchmark_data_smithi018_166993_object63957:head# 2024-02-10T08:39:14.593 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af069d28:::benchmark_data_smithi018_166993_object65041:head# 2024-02-10T08:39:14.594 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af06aa79:::benchmark_data_smithi018_166993_object40373:head# 2024-02-10T08:39:14.594 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af078265:::benchmark_data_smithi018_166993_object53600:head# 2024-02-10T08:39:14.594 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af07c00d:::benchmark_data_smithi018_166993_object116502:head# 2024-02-10T08:39:14.594 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af08270e:::benchmark_data_smithi018_166993_object29935:head# 2024-02-10T08:39:14.594 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af084ead:::benchmark_data_smithi018_166993_object42867:head# 2024-02-10T08:39:14.594 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af08c378:::benchmark_data_smithi018_166993_object109671:head# 2024-02-10T08:39:14.594 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af08cd9d:::benchmark_data_smithi018_166993_object108181:head# 2024-02-10T08:39:14.595 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af0995db:::benchmark_data_smithi018_166993_object69583:head# 2024-02-10T08:39:14.595 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af09e288:::benchmark_data_smithi018_166993_object19461:head# 2024-02-10T08:39:14.596 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af0abbfb:::benchmark_data_smithi018_166993_object70341:head# 2024-02-10T08:39:14.596 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af0c0fc9:::benchmark_data_smithi018_166993_object102922:head# 2024-02-10T08:39:14.597 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af1009d3:::benchmark_data_smithi018_166993_object95075:head# 2024-02-10T08:39:14.597 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af1057f4:::benchmark_data_smithi018_166993_object89253:head# 2024-02-10T08:39:14.598 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af10c810:::benchmark_data_smithi018_166993_object17853:head# 2024-02-10T08:39:14.601 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af10d0be:::benchmark_data_smithi018_166993_object21455:head# 2024-02-10T08:39:14.601 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af110822:::benchmark_data_smithi018_166993_object59151:head# 2024-02-10T08:39:14.601 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af1122a5:::benchmark_data_smithi018_166993_object83836:head# 2024-02-10T08:39:14.601 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af119aff:::benchmark_data_smithi018_166993_object50537:head# 2024-02-10T08:39:14.601 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af124f13:::benchmark_data_smithi018_166993_object90437:head# 2024-02-10T08:39:14.601 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af127e3a:::benchmark_data_smithi018_166993_object76952:head# 2024-02-10T08:39:14.602 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af1385a9:::benchmark_data_smithi018_166993_object42600:head# 2024-02-10T08:39:14.602 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af145567:::benchmark_data_smithi018_166993_object62606:head# 2024-02-10T08:39:14.605 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af14557b:::benchmark_data_smithi018_166993_object47925:head# 2024-02-10T08:39:14.605 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af18e33d:::benchmark_data_smithi018_166993_object38036:head# 2024-02-10T08:39:14.605 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af193ea1:::benchmark_data_smithi018_166993_object43615:head# 2024-02-10T08:39:14.605 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af194401:::benchmark_data_smithi018_166993_object64482:head# 2024-02-10T08:39:14.605 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af19b7f9:::benchmark_data_smithi018_166993_object65828:head# 2024-02-10T08:39:14.606 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af1aa705:::benchmark_data_smithi018_166993_object52026:head# 2024-02-10T08:39:14.607 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af1ab9f6:::benchmark_data_smithi018_166993_object116165:head# 2024-02-10T08:39:14.610 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af1b80f7:::benchmark_data_smithi018_166993_object82795:head# 2024-02-10T08:39:14.610 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af1b8250:::benchmark_data_smithi018_166993_object65199:head# 2024-02-10T08:39:14.610 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af1be0f7:::benchmark_data_smithi018_166993_object44396:head# 2024-02-10T08:39:14.611 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af1bfdbd:::benchmark_data_smithi018_166993_object108783:head# 2024-02-10T08:39:14.611 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af1d4cee:::benchmark_data_smithi018_166993_object99748:head# 2024-02-10T08:39:14.617 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af1dfe4d:::benchmark_data_smithi018_166993_object79729:head# 2024-02-10T08:39:14.617 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af1e0ccd:::benchmark_data_smithi018_166993_object59878:head# 2024-02-10T08:39:14.617 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af1ed92b:::benchmark_data_smithi018_166993_object79588:head# 2024-02-10T08:39:14.617 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af205b13:::benchmark_data_smithi018_166993_object41085:head# 2024-02-10T08:39:14.618 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af20e43b:::benchmark_data_smithi018_166993_object75147:head# 2024-02-10T08:39:14.618 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af21c39c:::benchmark_data_smithi018_166993_object53771:head# 2024-02-10T08:39:14.619 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af223374:::benchmark_data_smithi018_166993_object35755:head# 2024-02-10T08:39:14.620 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af226baa:::benchmark_data_smithi018_166993_object23472:head# 2024-02-10T08:39:14.620 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af22b7e2:::benchmark_data_smithi018_166993_object116606:head# 2024-02-10T08:39:14.620 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af22d7b7:::benchmark_data_smithi018_166993_object35460:head# 2024-02-10T08:39:14.625 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af230c19:::benchmark_data_smithi018_166993_object73918:head# 2024-02-10T08:39:14.625 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af2421e7:::benchmark_data_smithi018_166993_object96510:head# 2024-02-10T08:39:14.625 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af2458fc:::benchmark_data_smithi018_166993_object18570:head# 2024-02-10T08:39:14.626 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af24ed24:::benchmark_data_smithi018_166993_object73429:head# 2024-02-10T08:39:14.626 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af25ea4e:::benchmark_data_smithi018_166993_object56442:head# 2024-02-10T08:39:14.626 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af26cb3b:::benchmark_data_smithi018_166993_object60773:head# 2024-02-10T08:39:14.627 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af26ddf0:::benchmark_data_smithi018_166993_object17406:head# 2024-02-10T08:39:14.627 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af27abf9:::benchmark_data_smithi018_166993_object101706:head# 2024-02-10T08:39:14.628 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af280765:::benchmark_data_smithi018_166993_object98880:head# 2024-02-10T08:39:14.628 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af28df72:::benchmark_data_smithi018_166993_object23693:head# 2024-02-10T08:39:14.629 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af294e82:::benchmark_data_smithi018_166993_object76383:head# 2024-02-10T08:39:14.630 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af294eda:::benchmark_data_smithi018_166993_object82880:head# 2024-02-10T08:39:14.630 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af295965:::benchmark_data_smithi018_166993_object70905:head# 2024-02-10T08:39:14.630 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af2a3e0a:::benchmark_data_smithi018_166993_object75589:head# 2024-02-10T08:39:14.631 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af2a4308:::benchmark_data_smithi018_166993_object103975:head# 2024-02-10T08:39:14.631 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af2b39eb:::benchmark_data_smithi018_166993_object19805:head# 2024-02-10T08:39:14.632 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af2ba623:::benchmark_data_smithi018_166993_object87320:head# 2024-02-10T08:39:14.632 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af2c90d4:::benchmark_data_smithi018_166993_object91248:head# 2024-02-10T08:39:14.632 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af2d2e80:::benchmark_data_smithi018_166993_object102019:head# 2024-02-10T08:39:14.633 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af2f829e:::benchmark_data_smithi018_166993_object62344:head# 2024-02-10T08:39:14.633 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af30c9e1:::benchmark_data_smithi018_166993_object97944:head# 2024-02-10T08:39:14.634 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af30e83d:::benchmark_data_smithi018_166993_object30846:head# 2024-02-10T08:39:14.636 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af30f6eb:::benchmark_data_smithi018_166993_object53261:head# 2024-02-10T08:39:14.636 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af3295b9:::benchmark_data_smithi018_166993_object40327:head# 2024-02-10T08:39:14.636 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af330261:::benchmark_data_smithi018_166993_object70225:head# 2024-02-10T08:39:14.636 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af332a8c:::benchmark_data_smithi018_166993_object38980:head# 2024-02-10T08:39:14.639 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af33e9ab:::benchmark_data_smithi018_166993_object31495:head# 2024-02-10T08:39:14.639 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af34cc3e:::benchmark_data_smithi018_166993_object109485:head# 2024-02-10T08:39:14.643 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af3664d8:::benchmark_data_smithi018_166993_object66265:head# 2024-02-10T08:39:14.644 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af368b72:::benchmark_data_smithi018_166993_object106833:head# 2024-02-10T08:39:14.644 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af36c468:::benchmark_data_smithi018_166993_object106400:head# 2024-02-10T08:39:14.644 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af3765d9:::benchmark_data_smithi018_166993_object87147:head# 2024-02-10T08:39:14.647 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af381be4:::benchmark_data_smithi018_166993_object26109:head# 2024-02-10T08:39:14.647 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af3836e1:::benchmark_data_smithi018_166993_object21862:head# 2024-02-10T08:39:14.647 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af3a46eb:::benchmark_data_smithi018_166993_object63198:head# 2024-02-10T08:39:14.648 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af3aa672:::benchmark_data_smithi018_166993_object36564:head# 2024-02-10T08:39:14.653 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af3b5c99:::benchmark_data_smithi018_166993_object36330:head# 2024-02-10T08:39:14.668 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af3c681a:::benchmark_data_smithi018_166993_object40913:head# 2024-02-10T08:39:14.668 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af3d2198:::benchmark_data_smithi018_166993_object76778:head# 2024-02-10T08:39:14.668 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af3d4fdc:::benchmark_data_smithi018_166993_object82847:head# 2024-02-10T08:39:14.669 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af3ea6c8:::benchmark_data_smithi018_166993_object96245:head# 2024-02-10T08:39:14.669 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af3ef1be:::benchmark_data_smithi018_166993_object68858:head# 2024-02-10T08:39:14.669 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af3fbe2e:::benchmark_data_smithi018_166993_object110537:head# 2024-02-10T08:39:14.669 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af3fc6a6:::benchmark_data_smithi018_166993_object51195:head# 2024-02-10T08:39:14.669 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af41bc5e:::benchmark_data_smithi018_166993_object34680:head# 2024-02-10T08:39:14.669 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af4347bc:::benchmark_data_smithi018_166993_object34189:head# 2024-02-10T08:39:14.670 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af436891:::benchmark_data_smithi018_166993_object98510:head# 2024-02-10T08:39:14.670 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af44a760:::benchmark_data_smithi018_166993_object73478:head# 2024-02-10T08:39:14.670 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af450750:::benchmark_data_smithi018_166993_object52850:head# 2024-02-10T08:39:14.671 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af453a54:::benchmark_data_smithi018_166993_object30362:head# 2024-02-10T08:39:14.672 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af45ec2a:::benchmark_data_smithi018_166993_object79566:head# 2024-02-10T08:39:14.672 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af493a3c:::benchmark_data_smithi018_166993_object95094:head# 2024-02-10T08:39:14.672 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af4aa3cf:::benchmark_data_smithi018_166993_object50220:head# 2024-02-10T08:39:14.672 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af4b6a8d:::benchmark_data_smithi018_166993_object115022:head# 2024-02-10T08:39:14.673 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af4bdfa3:::benchmark_data_smithi018_166993_object87425:head# 2024-02-10T08:39:14.674 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af4c1b99:::benchmark_data_smithi018_166993_object47568:head# 2024-02-10T08:39:14.675 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af4d4dc7:::benchmark_data_smithi018_166993_object93259:head# 2024-02-10T08:39:14.675 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af4d77b3:::benchmark_data_smithi018_166993_object58144:head# 2024-02-10T08:39:14.678 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af4f0f23:::benchmark_data_smithi018_166993_object17632:head# 2024-02-10T08:39:14.678 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af512039:::benchmark_data_smithi018_166993_object87438:head# 2024-02-10T08:39:14.679 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af524708:::benchmark_data_smithi018_166993_object105693:head# 2024-02-10T08:39:14.679 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af52a83a:::benchmark_data_smithi018_166993_object52192:head# 2024-02-10T08:39:14.680 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af52c6c5:::benchmark_data_smithi018_166993_object82412:head# 2024-02-10T08:39:14.681 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af53a167:::benchmark_data_smithi018_166993_object23010:head# 2024-02-10T08:39:14.681 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af542772:::benchmark_data_smithi018_166993_object82230:head# 2024-02-10T08:39:14.681 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af550e52:::benchmark_data_smithi018_166993_object103304:head# 2024-02-10T08:39:14.682 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af566e7f:::benchmark_data_smithi018_166993_object42428:head# 2024-02-10T08:39:14.685 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af5671dc:::benchmark_data_smithi018_166993_object86505:head# 2024-02-10T08:39:14.686 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af577a0a:::benchmark_data_smithi018_166993_object56431:head# 2024-02-10T08:39:14.686 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af5a7995:::benchmark_data_smithi018_166993_object94785:head# 2024-02-10T08:39:14.686 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af5a8abc:::benchmark_data_smithi018_166993_object28120:head# 2024-02-10T08:39:14.687 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af5b1d51:::benchmark_data_smithi018_166993_object65758:head# 2024-02-10T08:39:14.687 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af5b4d02:::benchmark_data_smithi018_166993_object118797:head# 2024-02-10T08:39:14.687 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af5b67da:::benchmark_data_smithi018_166993_object25530:head# 2024-02-10T08:39:14.688 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af5b846a:::benchmark_data_smithi018_166993_object71177:head# 2024-02-10T08:39:14.692 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af5d9326:::benchmark_data_smithi018_166993_object43850:head# 2024-02-10T08:39:14.692 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af5e38a8:::benchmark_data_smithi018_166993_object88614:head# 2024-02-10T08:39:14.700 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af5e6f1f:::benchmark_data_smithi018_166993_object70148:head# 2024-02-10T08:39:14.700 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af5ff9b6:::benchmark_data_smithi018_166993_object39484:head# 2024-02-10T08:39:14.700 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af603cf1:::benchmark_data_smithi018_166993_object63287:head# 2024-02-10T08:39:14.700 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af6115e5:::benchmark_data_smithi018_166993_object82700:head# 2024-02-10T08:39:14.700 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af638096:::benchmark_data_smithi018_166993_object32134:head# 2024-02-10T08:39:14.700 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af639b52:::benchmark_data_smithi018_166993_object110235:head# 2024-02-10T08:39:14.701 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af642e46:::benchmark_data_smithi018_166993_object93721:head# 2024-02-10T08:39:14.701 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af66fd26:::benchmark_data_smithi018_166993_object78149:head# 2024-02-10T08:39:14.703 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af6785bb:::benchmark_data_smithi018_166993_object111363:head# 2024-02-10T08:39:14.703 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af67bf80:::benchmark_data_smithi018_166993_object82991:head# 2024-02-10T08:39:14.704 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af68dd79:::benchmark_data_smithi018_166993_object110764:head# 2024-02-10T08:39:14.706 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af6add71:::benchmark_data_smithi018_166993_object63460:head# 2024-02-10T08:39:14.706 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af6ae3bb:::benchmark_data_smithi018_166993_object118295:head# 2024-02-10T08:39:14.707 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af6c35b0:::benchmark_data_smithi018_166993_object102381:head# 2024-02-10T08:39:14.710 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af6c492f:::benchmark_data_smithi018_166993_object61411:head# 2024-02-10T08:39:14.710 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af6d8797:::benchmark_data_smithi018_166993_object43827:head# 2024-02-10T08:39:14.710 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af6db90b:::benchmark_data_smithi018_166993_object26962:head# 2024-02-10T08:39:14.710 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af6fa317:::benchmark_data_smithi018_166993_object97043:head# 2024-02-10T08:39:14.711 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af700c23:::benchmark_data_smithi018_166993_object55254:head# 2024-02-10T08:39:14.711 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af70f9fd:::benchmark_data_smithi018_166993_object44444:head# 2024-02-10T08:39:14.712 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af7140bb:::benchmark_data_smithi018_166993_object114549:head# 2024-02-10T08:39:14.714 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af716a92:::benchmark_data_smithi018_166993_object42580:head# 2024-02-10T08:39:14.714 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af71bd05:::benchmark_data_smithi018_166993_object73952:head# 2024-02-10T08:39:14.715 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af723981:::benchmark_data_smithi018_166993_object32505:head# 2024-02-10T08:39:14.717 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af7248e4:::benchmark_data_smithi018_166993_object87586:head# 2024-02-10T08:39:14.717 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af7387a5:::benchmark_data_smithi018_166993_object90429:head# 2024-02-10T08:39:14.717 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af73f087:::benchmark_data_smithi018_166993_object46198:head# 2024-02-10T08:39:14.718 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af742964:::benchmark_data_smithi018_166993_object111892:head# 2024-02-10T08:39:14.718 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:39:14.719 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af74bd02:::benchmark_data_smithi018_166993_object34323:head# 2024-02-10T08:39:14.719 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af74fa0e:::benchmark_data_smithi018_166993_object64982:head# 2024-02-10T08:39:14.719 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af756c6b:::benchmark_data_smithi018_166993_object105176:head# 2024-02-10T08:39:14.719 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af75825f:::benchmark_data_smithi018_166993_object25629:head# 2024-02-10T08:39:14.721 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:14.721 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:39:14.722 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af759c85:::benchmark_data_smithi018_166993_object109876:head# 2024-02-10T08:39:14.722 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af75a023:::benchmark_data_smithi018_166993_object69490:head# 2024-02-10T08:39:14.722 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af75ad4d:::benchmark_data_smithi018_166993_object20559:head# 2024-02-10T08:39:14.722 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af7662a7:::benchmark_data_smithi018_166993_object94204:head# 2024-02-10T08:39:14.722 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af769963:::benchmark_data_smithi018_166993_object42425:head# 2024-02-10T08:39:14.723 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af7722c1:::benchmark_data_smithi018_166993_object99767:head# 2024-02-10T08:39:14.723 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af77b7bd:::benchmark_data_smithi018_166993_object33222:head# 2024-02-10T08:39:14.724 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af796bbc:::benchmark_data_smithi018_166993_object83809:head# 2024-02-10T08:39:14.724 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af7a510f:::benchmark_data_smithi018_166993_object71314:head# 2024-02-10T08:39:14.729 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af7b7348:::benchmark_data_smithi018_166993_object106868:head# 2024-02-10T08:39:14.729 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af7b9b36:::benchmark_data_smithi018_166993_object98604:head# 2024-02-10T08:39:14.729 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af7bd8a6:::benchmark_data_smithi018_166993_object92567:head# 2024-02-10T08:39:14.730 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af7dc160:::benchmark_data_smithi018_166993_object75005:head# 2024-02-10T08:39:14.730 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af7df124:::benchmark_data_smithi018_166993_object31825:head# 2024-02-10T08:39:14.731 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af7e1132:::benchmark_data_smithi018_166993_object51634:head# 2024-02-10T08:39:14.731 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af7e1d23:::benchmark_data_smithi018_166993_object51523:head# 2024-02-10T08:39:14.732 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af7e34b2:::benchmark_data_smithi018_166993_object113260:head# 2024-02-10T08:39:14.733 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af7e675e:::benchmark_data_smithi018_166993_object96743:head# 2024-02-10T08:39:14.733 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af7faa2d:::benchmark_data_smithi018_166993_object35802:head# 2024-02-10T08:39:14.733 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af7fb3b6:::benchmark_data_smithi018_166993_object62371:head# 2024-02-10T08:39:14.734 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af7fbe7c:::benchmark_data_smithi018_166993_object60038:head# 2024-02-10T08:39:14.734 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af7fe0a7:::benchmark_data_smithi018_166993_object86846:head# 2024-02-10T08:39:14.734 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af8081a6:::benchmark_data_smithi018_166993_object109845:head# 2024-02-10T08:39:14.735 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af811cd0:::benchmark_data_smithi018_166993_object31179:head# 2024-02-10T08:39:14.735 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af81b618:::benchmark_data_smithi018_166993_object98613:head# 2024-02-10T08:39:14.736 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af82303a:::benchmark_data_smithi018_166993_object43834:head# 2024-02-10T08:39:14.736 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af823ec5:::benchmark_data_smithi018_166993_object64160:head# 2024-02-10T08:39:14.737 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af826d04:::benchmark_data_smithi018_166993_object47564:head# 2024-02-10T08:39:14.737 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af831dc8:::benchmark_data_smithi018_166993_object79179:head# 2024-02-10T08:39:14.738 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af852bf4:::benchmark_data_smithi018_166993_object86595:head# 2024-02-10T08:39:14.738 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af8644a7:::benchmark_data_smithi018_166993_object64192:head# 2024-02-10T08:39:14.738 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af86cb6d:::benchmark_data_smithi018_166993_object17376:head# 2024-02-10T08:39:14.739 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af86de6c:::benchmark_data_smithi018_166993_object114347:head# 2024-02-10T08:39:14.739 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af87be40:::benchmark_data_smithi018_166993_object28061:head# 2024-02-10T08:39:14.740 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-02-10T08:39:14.740 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-02-10T08:39:14.744 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af89e149:::benchmark_data_smithi018_166993_object80986:head# 2024-02-10T08:39:14.744 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af8ad996:::benchmark_data_smithi018_166993_object29665:head# 2024-02-10T08:39:14.744 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af8ae9e2:::benchmark_data_smithi018_166993_object77464:head# 2024-02-10T08:39:14.744 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af8c30ac:::benchmark_data_smithi018_166993_object76292:head# 2024-02-10T08:39:14.744 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af8c3748:::benchmark_data_smithi018_166993_object59863:head# 2024-02-10T08:39:14.744 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af8c57ba:::benchmark_data_smithi018_166993_object23577:head# 2024-02-10T08:39:14.744 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af8c6dc6:::benchmark_data_smithi018_166993_object31432:head# 2024-02-10T08:39:14.744 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af8d87c2:::benchmark_data_smithi018_166993_object79439:head# 2024-02-10T08:39:14.745 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af8da4b6:::benchmark_data_smithi018_166993_object102577:head# 2024-02-10T08:39:14.745 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af8f8fcf:::benchmark_data_smithi018_166993_object71110:head# 2024-02-10T08:39:14.745 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af8fb6a3:::benchmark_data_smithi018_166993_object87109:head# 2024-02-10T08:39:14.746 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af9028ba:::benchmark_data_smithi018_166993_object89837:head# 2024-02-10T08:39:14.746 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af91e051:::benchmark_data_smithi018_166993_object92915:head# 2024-02-10T08:39:14.746 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af91f4cf:::benchmark_data_smithi018_166993_object48423:head# 2024-02-10T08:39:14.746 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af9217dc:::benchmark_data_smithi018_166993_object49290:head# 2024-02-10T08:39:14.747 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af924acf:::benchmark_data_smithi018_166993_object33367:head# 2024-02-10T08:39:14.747 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af925167:::benchmark_data_smithi018_166993_object23133:head# 2024-02-10T08:39:14.748 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af936aef:::benchmark_data_smithi018_166993_object21518:head# 2024-02-10T08:39:14.748 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af93b5e3:::benchmark_data_smithi018_166993_object68489:head# 2024-02-10T08:39:14.749 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af93bdfe:::benchmark_data_smithi018_166993_object70372:head# 2024-02-10T08:39:14.754 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af95bdb3:::benchmark_data_smithi018_166993_object23936:head# 2024-02-10T08:39:14.754 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af960235:::benchmark_data_smithi018_166993_object73997:head# 2024-02-10T08:39:14.754 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af966c86:::benchmark_data_smithi018_166993_object54512:head# 2024-02-10T08:39:14.754 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af96d4f4:::benchmark_data_smithi018_166993_object82679:head# 2024-02-10T08:39:14.754 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af96e2c5:::benchmark_data_smithi018_166993_object109837:head# 2024-02-10T08:39:14.754 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af9738c3:::benchmark_data_smithi018_166993_object44338:head# 2024-02-10T08:39:14.754 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af97ab9f:::benchmark_data_smithi018_166993_object90858:head# 2024-02-10T08:39:14.754 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af980b86:::benchmark_data_smithi018_166993_object92841:head# 2024-02-10T08:39:14.754 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af9a4cd6:::benchmark_data_smithi018_166993_object18918:head# 2024-02-10T08:39:14.754 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af9aad3f:::benchmark_data_smithi018_166993_object44169:head# 2024-02-10T08:39:14.755 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af9bb5f2:::benchmark_data_smithi018_166993_object70242:head# 2024-02-10T08:39:14.755 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af9bdc5f:::benchmark_data_smithi018_166993_object29926:head# 2024-02-10T08:39:14.755 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af9c5460:::benchmark_data_smithi018_166993_object99833:head# 2024-02-10T08:39:14.756 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af9cd79e:::benchmark_data_smithi018_166993_object107643:head# 2024-02-10T08:39:14.756 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af9da3a3:::benchmark_data_smithi018_166993_object68594:head# 2024-02-10T08:39:14.756 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af9eb9c9:::benchmark_data_smithi018_166993_object71554:head# 2024-02-10T08:39:14.758 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:af9fac4b:::benchmark_data_smithi018_166993_object108741:head# 2024-02-10T08:39:14.758 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afa1ec9d:::benchmark_data_smithi018_166993_object66190:head# 2024-02-10T08:39:14.758 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afa23a59:::benchmark_data_smithi018_166993_object91249:head# 2024-02-10T08:39:14.759 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afa31ac7:::benchmark_data_smithi018_166993_object30631:head# 2024-02-10T08:39:14.759 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afa39240:::benchmark_data_smithi018_166993_object117755:head# 2024-02-10T08:39:14.759 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afa3bf2b:::benchmark_data_smithi018_166993_object95345:head# 2024-02-10T08:39:14.759 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afa43415:::benchmark_data_smithi018_166993_object54599:head# 2024-02-10T08:39:14.760 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afa45c2b:::benchmark_data_smithi018_166993_object53881:head# 2024-02-10T08:39:14.760 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afa78129:::benchmark_data_smithi018_166993_object64925:head# 2024-02-10T08:39:14.761 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afa79266:::benchmark_data_smithi018_166993_object50135:head# 2024-02-10T08:39:14.763 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afa82105:::benchmark_data_smithi018_166993_object93770:head# 2024-02-10T08:39:14.763 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afa89667:::benchmark_data_smithi018_166993_object61461:head# 2024-02-10T08:39:14.764 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afa9dec3:::benchmark_data_smithi018_166993_object28686:head# 2024-02-10T08:39:14.773 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afaa5f04:::benchmark_data_smithi018_166993_object106353:head# 2024-02-10T08:39:14.774 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afabaa77:::benchmark_data_smithi018_166993_object55860:head# 2024-02-10T08:39:14.774 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afabadbe:::benchmark_data_smithi018_166993_object38516:head# 2024-02-10T08:39:14.774 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afabc88d:::benchmark_data_smithi018_166993_object97724:head# 2024-02-10T08:39:14.774 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afac3c87:::benchmark_data_smithi018_166993_object91721:head# 2024-02-10T08:39:14.774 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afac6000:::benchmark_data_smithi018_166993_object52334:head# 2024-02-10T08:39:14.774 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afacb828:::benchmark_data_smithi018_166993_object116082:head# 2024-02-10T08:39:14.774 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afacddab:::benchmark_data_smithi018_166993_object77829:head# 2024-02-10T08:39:14.774 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afad94a5:::benchmark_data_smithi018_166993_object36206:head# 2024-02-10T08:39:14.774 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afae9187:::benchmark_data_smithi018_166993_object52714:head# 2024-02-10T08:39:14.774 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afaebf9a:::benchmark_data_smithi018_166993_object60550:head# 2024-02-10T08:39:14.774 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afaf53b7:::benchmark_data_smithi018_166993_object48669:head# 2024-02-10T08:39:14.777 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afafd5e4:::benchmark_data_smithi018_166993_object105365:head# 2024-02-10T08:39:14.777 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afb02526:::benchmark_data_smithi018_166993_object46181:head# 2024-02-10T08:39:14.777 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afb1be45:::benchmark_data_smithi018_166993_object108213:head# 2024-02-10T08:39:14.777 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afb2f485:::benchmark_data_smithi018_166993_object59003:head# 2024-02-10T08:39:14.777 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afb3d499:::benchmark_data_smithi018_166993_object87283:head# 2024-02-10T08:39:14.777 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afb4473e:::benchmark_data_smithi018_166993_object95649:head# 2024-02-10T08:39:14.777 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afb51c45:::benchmark_data_smithi018_166993_object109341:head# 2024-02-10T08:39:14.778 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afb5d417:::benchmark_data_smithi018_166993_object61379:head# 2024-02-10T08:39:14.778 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afb5f9fd:::benchmark_data_smithi018_166993_object114196:head# 2024-02-10T08:39:14.783 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afb63653:::benchmark_data_smithi018_166993_object93466:head# 2024-02-10T08:39:14.786 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afb66b71:::benchmark_data_smithi018_166993_object112583:head# 2024-02-10T08:39:14.789 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afb79823:::benchmark_data_smithi018_166993_object68814:head# 2024-02-10T08:39:14.790 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afb89947:::benchmark_data_smithi018_166993_object33666:head# 2024-02-10T08:39:14.790 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afb8d50f:::benchmark_data_smithi018_166993_object100364:head# 2024-02-10T08:39:14.790 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afb946be:::benchmark_data_smithi018_166993_object56282:head# 2024-02-10T08:39:14.790 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afba586c:::benchmark_data_smithi018_166993_object95970:head# 2024-02-10T08:39:14.792 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afbb55c2:::benchmark_data_smithi018_166993_object61203:head# 2024-02-10T08:39:14.792 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afbc004b:::benchmark_data_smithi018_166993_object57400:head# 2024-02-10T08:39:14.792 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afbd9dad:::benchmark_data_smithi018_166993_object62791:head# 2024-02-10T08:39:14.792 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afbda9b5:::benchmark_data_smithi018_166993_object28218:head# 2024-02-10T08:39:14.793 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afbdaaf8:::benchmark_data_smithi018_166993_object48772:head# 2024-02-10T08:39:14.796 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afbdb6a2:::benchmark_data_smithi018_166993_object25608:head# 2024-02-10T08:39:14.796 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afbe51a6:::benchmark_data_smithi018_166993_object32507:head# 2024-02-10T08:39:14.796 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afbe5d16:::benchmark_data_smithi018_166993_object111214:head# 2024-02-10T08:39:14.797 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afbeb16b:::benchmark_data_smithi018_166993_object94029:head# 2024-02-10T08:39:14.798 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afbec645:::benchmark_data_smithi018_166993_object55161:head# 2024-02-10T08:39:14.798 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afbfac87:::benchmark_data_smithi018_166993_object30369:head# 2024-02-10T08:39:14.798 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afbfc6a2:::benchmark_data_smithi018_166993_object74006:head# 2024-02-10T08:39:14.799 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afc152dc:::benchmark_data_smithi018_166993_object45490:head# 2024-02-10T08:39:14.799 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afc175b6:::benchmark_data_smithi018_166993_object34176:head# 2024-02-10T08:39:14.800 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afc24641:::benchmark_data_smithi018_166993_object71944:head# 2024-02-10T08:39:14.800 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afc2885e:::benchmark_data_smithi018_166993_object18572:head# 2024-02-10T08:39:14.800 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afc33817:::benchmark_data_smithi018_166993_object72364:head# 2024-02-10T08:39:14.801 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afc4999b:::benchmark_data_smithi018_166993_object88027:head# 2024-02-10T08:39:14.801 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afc4f2fc:::benchmark_data_smithi018_166993_object111167:head# 2024-02-10T08:39:14.802 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afc6cc5f:::benchmark_data_smithi018_166993_object28565:head# 2024-02-10T08:39:14.803 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afc87d88:::benchmark_data_smithi018_166993_object35563:head# 2024-02-10T08:39:14.804 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afc9ace9:::benchmark_data_smithi018_166993_object49394:head# 2024-02-10T08:39:14.809 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afc9c449:::benchmark_data_smithi018_166993_object98301:head# 2024-02-10T08:39:14.809 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afcb1337:::benchmark_data_smithi018_166993_object58908:head# 2024-02-10T08:39:14.809 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afcb5b81:::benchmark_data_smithi018_166993_object105591:head# 2024-02-10T08:39:14.809 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afcbc2da:::benchmark_data_smithi018_166993_object72522:head# 2024-02-10T08:39:14.809 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afcc3849:::benchmark_data_smithi018_166993_object102248:head# 2024-02-10T08:39:14.811 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afcc3d71:::benchmark_data_smithi018_166993_object18646:head# 2024-02-10T08:39:14.811 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afcd400e:::benchmark_data_smithi018_166993_object20243:head# 2024-02-10T08:39:14.812 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afcd8c7b:::benchmark_data_smithi018_166993_object115396:head# 2024-02-10T08:39:14.812 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afceb1b4:::benchmark_data_smithi018_166993_object105619:head# 2024-02-10T08:39:14.812 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afceb6ed:::benchmark_data_smithi018_166993_object118348:head# 2024-02-10T08:39:14.812 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afcf2357:::benchmark_data_smithi018_166993_object65736:head# 2024-02-10T08:39:14.813 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afcfc68d:::benchmark_data_smithi018_166993_object62557:head# 2024-02-10T08:39:14.814 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afd3e0c1:::benchmark_data_smithi018_166993_object20859:head# 2024-02-10T08:39:14.814 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afd593a3:::benchmark_data_smithi018_166993_object73173:head# 2024-02-10T08:39:14.819 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afd6553a:::benchmark_data_smithi018_166993_object46547:head# 2024-02-10T08:39:14.819 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afd6567e:::benchmark_data_smithi018_166993_object109251:head# 2024-02-10T08:39:14.820 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afd7f98e:::benchmark_data_smithi018_166993_object65315:head# 2024-02-10T08:39:14.822 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:39:14.824 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afd83657:::benchmark_data_smithi018_166993_object73178:head# 2024-02-10T08:39:14.825 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afd98e89:::benchmark_data_smithi018_166993_object110367:head# 2024-02-10T08:39:14.825 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afd9faf5:::benchmark_data_smithi018_166993_object102748:head# 2024-02-10T08:39:14.826 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afdb3873:::benchmark_data_smithi018_166993_object82226:head# 2024-02-10T08:39:14.826 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afdba1ae:::benchmark_data_smithi018_166993_object100797:head# 2024-02-10T08:39:14.827 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afdc4a27:::benchmark_data_smithi018_166993_object75881:head# 2024-02-10T08:39:14.830 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afdccc76:::benchmark_data_smithi018_166993_object109379:head# 2024-02-10T08:39:14.830 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afddc4a7:::benchmark_data_smithi018_166993_object91023:head# 2024-02-10T08:39:14.830 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afde1b92:::benchmark_data_smithi018_166993_object95828:head# 2024-02-10T08:39:14.830 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afdebf5a:::benchmark_data_smithi018_166993_object90602:head# 2024-02-10T08:39:14.833 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afded160:::benchmark_data_smithi018_166993_object110438:head# 2024-02-10T08:39:14.833 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afdf4616:::benchmark_data_smithi018_166993_object97582:head# 2024-02-10T08:39:14.836 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afdf6002:::benchmark_data_smithi018_166993_object72812:head# 2024-02-10T08:39:14.837 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afdf6154:::benchmark_data_smithi018_166993_object17540:head# 2024-02-10T08:39:14.837 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afe0cd6e:::benchmark_data_smithi018_166993_object87663:head# 2024-02-10T08:39:14.838 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afe0f63f:::benchmark_data_smithi018_166993_object105755:head# 2024-02-10T08:39:14.838 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afe31e94:::benchmark_data_smithi018_166993_object84437:head# 2024-02-10T08:39:14.839 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afe360e6:::benchmark_data_smithi018_166993_object38314:head# 2024-02-10T08:39:14.839 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afe547a4:::benchmark_data_smithi018_166993_object112081:head# 2024-02-10T08:39:14.842 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afe5c265:::benchmark_data_smithi018_166993_object78930:head# 2024-02-10T08:39:14.842 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afe6de18:::benchmark_data_smithi018_166993_object52193:head# 2024-02-10T08:39:14.842 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afe6f314:::benchmark_data_smithi018_166993_object68348:head# 2024-02-10T08:39:14.842 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afe71435:::benchmark_data_smithi018_166993_object83187:head# 2024-02-10T08:39:14.842 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afe735ac:::benchmark_data_smithi018_166993_object73509:head# 2024-02-10T08:39:14.842 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afe75143:::benchmark_data_smithi018_166993_object99698:head# 2024-02-10T08:39:14.845 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afe763a9:::benchmark_data_smithi018_166993_object108212:head# 2024-02-10T08:39:14.845 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afe81d0a:::benchmark_data_smithi018_166993_object103898:head# 2024-02-10T08:39:14.845 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afe929ae:::benchmark_data_smithi018_166993_object34228:head# 2024-02-10T08:39:14.845 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afe9f606:::benchmark_data_smithi018_166993_object53127:head# 2024-02-10T08:39:14.845 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afea7b76:::benchmark_data_smithi018_166993_object43032:head# 2024-02-10T08:39:14.845 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afeaed4e:::benchmark_data_smithi018_166993_object38533:head# 2024-02-10T08:39:14.848 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afeb4d03:::benchmark_data_smithi018_166993_object86791:head# 2024-02-10T08:39:14.848 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afeb60be:::benchmark_data_smithi018_166993_object18062:head# 2024-02-10T08:39:14.848 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afec92f6:::benchmark_data_smithi018_166993_object106325:head# 2024-02-10T08:39:14.848 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afecb4b2:::benchmark_data_smithi018_166993_object29749:head# 2024-02-10T08:39:14.848 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afed3e53:::benchmark_data_smithi018_166993_object70597:head# 2024-02-10T08:39:14.848 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afed943e:::benchmark_data_smithi018_166993_object44360:head# 2024-02-10T08:39:14.849 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afee19e6:::benchmark_data_smithi018_166993_object65143:head# 2024-02-10T08:39:14.849 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afee2346:::benchmark_data_smithi018_166993_object58998:head# 2024-02-10T08:39:14.849 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afee894c:::benchmark_data_smithi018_166993_object23809:head# 2024-02-10T08:39:14.850 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afef51bf:::benchmark_data_smithi018_166993_object25849:head# 2024-02-10T08:39:14.850 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afef5bca:::benchmark_data_smithi018_166993_object116555:head# 2024-02-10T08:39:14.851 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aff072d3:::benchmark_data_smithi018_166993_object83657:head# 2024-02-10T08:39:14.851 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aff0978c:::benchmark_data_smithi018_166993_object46376:head# 2024-02-10T08:39:14.851 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aff20d31:::benchmark_data_smithi018_166993_object49199:head# 2024-02-10T08:39:14.852 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aff30e5b:::benchmark_data_smithi018_166993_object117145:head# 2024-02-10T08:39:14.853 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aff31080:::benchmark_data_smithi018_166993_object49264:head# 2024-02-10T08:39:14.853 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aff33895:::benchmark_data_smithi018_166993_object48329:head# 2024-02-10T08:39:14.854 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aff39ab7:::benchmark_data_smithi018_166993_object94419:head# 2024-02-10T08:39:14.855 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aff3fc36:::benchmark_data_smithi018_166993_object107886:head# 2024-02-10T08:39:14.855 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aff5d58f:::benchmark_data_smithi018_166993_object34946:head# 2024-02-10T08:39:14.855 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aff6a482:::benchmark_data_smithi018_166993_object77687:head# 2024-02-10T08:39:14.856 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aff6f841:::benchmark_data_smithi018_166993_object35934:head# 2024-02-10T08:39:14.856 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aff70371:::benchmark_data_smithi018_166993_object60516:head# 2024-02-10T08:39:14.857 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aff796f5:::benchmark_data_smithi018_166993_object34490:head# 2024-02-10T08:39:14.857 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aff82472:::benchmark_data_smithi018_166993_object73891:head# 2024-02-10T08:39:14.858 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aff834fe:::benchmark_data_smithi018_166993_object60217:head# 2024-02-10T08:39:14.860 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aff8a7d5:::benchmark_data_smithi018_166993_object55206:head# 2024-02-10T08:39:14.860 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aff984cf:::benchmark_data_smithi018_166993_object31330:head# 2024-02-10T08:39:14.860 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aff9a97e:::benchmark_data_smithi018_166993_object85960:head# 2024-02-10T08:39:14.860 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:aff9fcf2:::benchmark_data_smithi018_166993_object62490:head# 2024-02-10T08:39:14.860 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:affa2250:::benchmark_data_smithi018_166993_object107619:head# 2024-02-10T08:39:14.861 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:affa7fd2:::benchmark_data_smithi018_166993_object18050:head# 2024-02-10T08:39:14.861 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:affc7ccb:::benchmark_data_smithi018_166993_object63953:head# 2024-02-10T08:39:14.861 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:affd52a7:::benchmark_data_smithi018_166993_object36900:head# 2024-02-10T08:39:14.862 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:affe0442:::benchmark_data_smithi018_166993_object39104:head# 2024-02-10T08:39:14.862 INFO:teuthology.orchestra.run.smithi071.stderr:Read #11:afffa6b8:::benchmark_data_smithi018_166993_object17930:head# 2024-02-10T08:39:14.865 INFO:teuthology.orchestra.run.smithi071.stderr:Export successful 2024-02-10T08:39:14.866 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:14.867 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:39:13.151620+0000 mgr.y (mgr.14505) 842 : cluster [DBG] pgmap v1033: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 5 active+undersized+degraded+remapped+backfilling, 172 active+clean; 4.9 GiB data, 19 GiB used, 607 GiB / 626 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1.17k op/s; 24187/239811 objects degraded (10.086%); 17 MiB/s, 268 objects/s recovering 2024-02-10T08:39:14.868 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:39:13.151620+0000 mgr.y (mgr.14505) 842 : cluster [DBG] pgmap v1033: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 5 active+undersized+degraded+remapped+backfilling, 172 active+clean; 4.9 GiB data, 19 GiB used, 607 GiB / 626 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1.17k op/s; 24187/239811 objects degraded (10.086%); 17 MiB/s, 268 objects/s recovering 2024-02-10T08:39:14.948 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:39:14.951 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:14.952 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:39:15.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:39:13.151620+0000 mgr.y (mgr.14505) 842 : cluster [DBG] pgmap v1033: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 5 active+undersized+degraded+remapped+backfilling, 172 active+clean; 4.9 GiB data, 19 GiB used, 607 GiB / 626 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1.17k op/s; 24187/239811 objects degraded (10.086%); 17 MiB/s, 268 objects/s recovering 2024-02-10T08:39:15.052 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:39:15.134 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:15.309 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:39:15.313 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:15.313 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:39:15.414 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:39:15.441 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:39:15.500 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:15.761 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:39:14.477129+0000 osd.3 (osd.3) 117 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:39:15.762 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:39:14.477183+0000 osd.3 (osd.3) 118 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:39:15.762 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:39:14.723929+0000 mon.a (mon.0) 1776 : cluster [DBG] osdmap e437: 8 total, 7 up, 7 in 2024-02-10T08:39:15.762 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:39:15.152984+0000 mgr.y (mgr.14505) 843 : cluster [DBG] pgmap v1035: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 5 active+undersized+degraded+remapped+backfilling, 172 active+clean; 4.8 GiB data, 19 GiB used, 607 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 979 op/s; 23846/237018 objects degraded (10.061%); 13 MiB/s, 213 objects/s recovering 2024-02-10T08:39:15.771 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:39:15.776 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:15.776 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:39:15.877 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:39:15.935 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:16.047 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:39:16.049 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:16.050 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:39:16.050 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:39:14.477129+0000 osd.3 (osd.3) 117 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:39:16.050 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:39:14.477183+0000 osd.3 (osd.3) 118 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:39:16.050 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:39:14.723929+0000 mon.a (mon.0) 1776 : cluster [DBG] osdmap e437: 8 total, 7 up, 7 in 2024-02-10T08:39:16.051 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:39:15.152984+0000 mgr.y (mgr.14505) 843 : cluster [DBG] pgmap v1035: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 5 active+undersized+degraded+remapped+backfilling, 172 active+clean; 4.8 GiB data, 19 GiB used, 607 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 979 op/s; 23846/237018 objects degraded (10.061%); 13 MiB/s, 213 objects/s recovering 2024-02-10T08:39:16.051 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:39:14.477129+0000 osd.3 (osd.3) 117 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:39:16.051 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:39:14.477183+0000 osd.3 (osd.3) 118 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:39:16.051 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:39:14.723929+0000 mon.a (mon.0) 1776 : cluster [DBG] osdmap e437: 8 total, 7 up, 7 in 2024-02-10T08:39:16.051 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:39:15.152984+0000 mgr.y (mgr.14505) 843 : cluster [DBG] pgmap v1035: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 5 active+undersized+degraded+remapped+backfilling, 172 active+clean; 4.8 GiB data, 19 GiB used, 607 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 979 op/s; 23846/237018 objects degraded (10.061%); 13 MiB/s, 213 objects/s recovering 2024-02-10T08:39:16.151 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:39:16.184 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:16.742 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-10T08:39:16.767 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:39:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:39:16] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:39:16.767 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:39:15.764078+0000 mon.a (mon.0) 1777 : cluster [DBG] osdmap e438: 8 total, 7 up, 7 in 2024-02-10T08:39:16.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:39:15.850850+0000 mon.a (mon.0) 1778 : audit [INF] from='client.? 172.21.15.18:0/2574952070' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:39:16.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:39:16.022967+0000 mon.a (mon.0) 1779 : cluster [WRN] Health check update: Degraded data redundancy: 23846/237018 objects degraded (10.061%), 6 pgs degraded (PG_DEGRADED) 2024-02-10T08:39:16.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:39:16.509884+0000 mon.a (mon.0) 1780 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:39:16.768 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is set 2024-02-10T08:39:17.153 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:39:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:39:16.692+0000 7f52ba297700 -1 mgr get_metadata_python Requested missing service osd.7 2024-02-10T08:39:17.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:39:15.764078+0000 mon.a (mon.0) 1777 : cluster [DBG] osdmap e438: 8 total, 7 up, 7 in 2024-02-10T08:39:17.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:39:15.850850+0000 mon.a (mon.0) 1778 : audit [INF] from='client.? 172.21.15.18:0/2574952070' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:39:17.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:39:16.022967+0000 mon.a (mon.0) 1779 : cluster [WRN] Health check update: Degraded data redundancy: 23846/237018 objects degraded (10.061%), 6 pgs degraded (PG_DEGRADED) 2024-02-10T08:39:17.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:39:16.509884+0000 mon.a (mon.0) 1780 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:39:17.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:39:15.764078+0000 mon.a (mon.0) 1777 : cluster [DBG] osdmap e438: 8 total, 7 up, 7 in 2024-02-10T08:39:17.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:39:15.850850+0000 mon.a (mon.0) 1778 : audit [INF] from='client.? 172.21.15.18:0/2574952070' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:39:17.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:39:16.022967+0000 mon.a (mon.0) 1779 : cluster [WRN] Health check update: Degraded data redundancy: 23846/237018 objects degraded (10.061%), 6 pgs degraded (PG_DEGRADED) 2024-02-10T08:39:17.157 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:39:16.509884+0000 mon.a (mon.0) 1780 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:39:17.407 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:39:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:39:17] "GET /metrics HTTP/1.1" 200 166352 "" "Prometheus/2.33.4" 2024-02-10T08:39:17.790 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:39:16.757543+0000 mon.a (mon.0) 1781 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:39:17.790 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:39:16.762187+0000 mon.a (mon.0) 1782 : audit [INF] from='client.? 172.21.15.18:0/2574952070' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-10T08:39:17.790 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:39:16.762250+0000 mon.a (mon.0) 1783 : cluster [DBG] osdmap e439: 8 total, 7 up, 7 in 2024-02-10T08:39:17.790 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:39:17.153479+0000 mgr.y (mgr.14505) 844 : cluster [DBG] pgmap v1038: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 5 active+undersized+degraded+remapped+backfilling, 172 active+clean; 4.8 GiB data, 19 GiB used, 607 GiB / 626 GiB avail; 852 B/s rd, 0 B/s wr, 808 op/s; 23846/237018 objects degraded (10.061%); 11 MiB/s, 176 objects/s recovering 2024-02-10T08:39:18.039 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:39:18.050 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:18.050 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:39:16.757543+0000 mon.a (mon.0) 1781 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:39:18.050 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:39:16.762187+0000 mon.a (mon.0) 1782 : audit [INF] from='client.? 172.21.15.18:0/2574952070' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-10T08:39:18.050 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:39:16.762250+0000 mon.a (mon.0) 1783 : cluster [DBG] osdmap e439: 8 total, 7 up, 7 in 2024-02-10T08:39:18.050 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:39:17.153479+0000 mgr.y (mgr.14505) 844 : cluster [DBG] pgmap v1038: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 5 active+undersized+degraded+remapped+backfilling, 172 active+clean; 4.8 GiB data, 19 GiB used, 607 GiB / 626 GiB avail; 852 B/s rd, 0 B/s wr, 808 op/s; 23846/237018 objects degraded (10.061%); 11 MiB/s, 176 objects/s recovering 2024-02-10T08:39:18.051 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:39:18.152 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:39:18.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:39:16.757543+0000 mon.a (mon.0) 1781 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:39:18.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:39:16.762187+0000 mon.a (mon.0) 1782 : audit [INF] from='client.? 172.21.15.18:0/2574952070' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-10T08:39:18.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:39:16.762250+0000 mon.a (mon.0) 1783 : cluster [DBG] osdmap e439: 8 total, 7 up, 7 in 2024-02-10T08:39:18.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:39:17.153479+0000 mgr.y (mgr.14505) 844 : cluster [DBG] pgmap v1038: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 5 active+undersized+degraded+remapped+backfilling, 172 active+clean; 4.8 GiB data, 19 GiB used, 607 GiB / 626 GiB avail; 852 B/s rd, 0 B/s wr, 808 op/s; 23846/237018 objects degraded (10.061%); 11 MiB/s, 176 objects/s recovering 2024-02-10T08:39:18.215 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:18.626 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -n osd.7 --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph-objectstore-tool --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-7 --journal-path /var/lib/ceph/osd/ceph-7/journal --force --op remove --pgid 11.5 2024-02-10T08:39:19.159 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/osd.7/config 2024-02-10T08:39:19.289 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:39:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:39:19.489 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:39:19.495 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:19.496 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:39:19.596 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:39:19.656 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:19.875 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-02-10T08:39:19.875 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-02-10T08:39:19.875 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:19.875 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.25664.0:165258 11.0 11:00f6b3a7:::benchmark_data_smithi018_166993_object46133:head [delete] snapc 0=[] ondisk+write+known_if_redirected e439)", 2024-02-10T08:39:19.875 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:39:19.861285+0000", 2024-02-10T08:39:19.875 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.012492787999999999, 2024-02-10T08:39:19.875 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.012528209, 2024-02-10T08:39:19.875 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:39:19.875 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "waiting for sub ops", 2024-02-10T08:39:19.875 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:39:19.875 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.25664", 2024-02-10T08:39:19.875 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/1087272222", 2024-02-10T08:39:19.876 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 165258 2024-02-10T08:39:19.876 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:19.876 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:39:19.876 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:19.876 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:39:19.876 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:19.861285+0000", 2024-02-10T08:39:19.876 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:39:19.876 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:19.876 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:19.876 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:39:19.876 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:19.861285+0000", 2024-02-10T08:39:19.876 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:39:19.876 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:19.876 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:19.876 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:39:19.877 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:19.861284+0000", 2024-02-10T08:39:19.877 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2150000000000004e-06 2024-02-10T08:39:19.877 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:19.877 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:19.877 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:39:19.877 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:19.861291+0000", 2024-02-10T08:39:19.877 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.491e-05 2024-02-10T08:39:19.878 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:19.878 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:19.878 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:39:19.878 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:19.861306+0000", 2024-02-10T08:39:19.878 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5169999999999996e-06 2024-02-10T08:39:19.878 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:19.878 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:19.878 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:39:19.878 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:19.861312+0000", 2024-02-10T08:39:19.878 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3529000000000002e-05 2024-02-10T08:39:19.878 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:19.878 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:19.878 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:39:19.879 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:19.861366+0000", 2024-02-10T08:39:19.879 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012602800000000001 2024-02-10T08:39:19.879 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:19.879 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:19.879 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:39:19.879 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:19.861492+0000", 2024-02-10T08:39:19.879 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000146303 2024-02-10T08:39:19.879 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:19.879 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:19.879 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,6", 2024-02-10T08:39:19.879 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:19.861638+0000", 2024-02-10T08:39:19.879 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0024124889999999999 2024-02-10T08:39:19.879 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:19.879 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:19.879 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:39:19.880 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:19.864051+0000", 2024-02-10T08:39:19.880 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00021306100000000001 2024-02-10T08:39:19.880 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:19.880 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:19.880 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:39:19.880 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:19.864264+0000", 2024-02-10T08:39:19.880 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0029787139999999999 2024-02-10T08:39:19.880 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:39:19.880 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:39:19.880 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:39:19.881 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:19.881 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:19.881 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.25664.0:165259 11.c 11:3bff1520:::benchmark_data_smithi018_166993_object46134:head [delete] snapc 0=[] ondisk+write+known_if_redirected e439)", 2024-02-10T08:39:19.881 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:39:19.864709+0000", 2024-02-10T08:39:19.881 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.0090690830000000004, 2024-02-10T08:39:19.881 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0091697840000000003, 2024-02-10T08:39:19.881 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:39:19.881 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "waiting for sub ops", 2024-02-10T08:39:19.881 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:39:19.881 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.25664", 2024-02-10T08:39:19.881 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/1087272222", 2024-02-10T08:39:19.881 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 165259 2024-02-10T08:39:19.881 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:19.881 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:39:19.882 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:19.882 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:39:19.882 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:19.864709+0000", 2024-02-10T08:39:19.882 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:39:19.882 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:19.882 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:19.882 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:39:19.882 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:19.864709+0000", 2024-02-10T08:39:19.882 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:39:19.882 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:19.882 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:19.883 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:39:19.883 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:19.864707+0000", 2024-02-10T08:39:19.883 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8420000000000005e-06 2024-02-10T08:39:19.883 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:19.883 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:19.883 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:39:19.883 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:19.864715+0000", 2024-02-10T08:39:19.883 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3488e-05 2024-02-10T08:39:19.883 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:19.883 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:19.883 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:39:19.883 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:19.864729+0000", 2024-02-10T08:39:19.883 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9090000000000003e-06 2024-02-10T08:39:19.883 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:19.883 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:19.884 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:39:19.884 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:19.864736+0000", 2024-02-10T08:39:19.884 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00086791099999999996 2024-02-10T08:39:19.884 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:19.884 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:19.884 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:39:19.884 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:19.865603+0000", 2024-02-10T08:39:19.884 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000116709 2024-02-10T08:39:19.884 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:19.885 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:19.885 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:39:19.885 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:19.865720+0000", 2024-02-10T08:39:19.885 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013237899999999999 2024-02-10T08:39:19.885 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:19.885 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:19.885 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 2,4", 2024-02-10T08:39:19.885 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:19.865853+0000", 2024-02-10T08:39:19.885 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.004967707 2024-02-10T08:39:19.885 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:19.885 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:19.885 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:39:19.885 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:19.870820+0000", 2024-02-10T08:39:19.885 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0021973460000000002 2024-02-10T08:39:19.885 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:19.885 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:19.886 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:39:19.886 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:19.873018+0000", 2024-02-10T08:39:19.886 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0083088740000000008 2024-02-10T08:39:19.886 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:39:19.886 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:39:19.886 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:39:19.886 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:19.886 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:19.886 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.25664.0:165262 11.f 11:f49faa3a:::benchmark_data_smithi018_166993_object46137:head [delete] snapc 0=[] ondisk+write+known_if_redirected e439)", 2024-02-10T08:39:19.886 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:39:19.864745+0000", 2024-02-10T08:39:19.886 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.0090332090000000004, 2024-02-10T08:39:19.886 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.009209063, 2024-02-10T08:39:19.886 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:39:19.886 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "waiting for sub ops", 2024-02-10T08:39:19.887 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:39:19.887 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.25664", 2024-02-10T08:39:19.887 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/1087272222", 2024-02-10T08:39:19.887 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 165262 2024-02-10T08:39:19.887 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:19.887 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:39:19.887 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:19.887 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:39:19.887 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:19.864745+0000", 2024-02-10T08:39:19.887 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:39:19.887 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:19.887 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:19.887 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:39:19.887 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:19.864745+0000", 2024-02-10T08:39:19.887 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:39:19.888 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:19.888 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:19.888 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:39:19.888 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:19.864744+0000", 2024-02-10T08:39:19.889 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.681e-06 2024-02-10T08:39:19.889 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:19.889 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:19.889 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:39:19.889 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:19.864748+0000", 2024-02-10T08:39:19.889 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1351e-05 2024-02-10T08:39:19.889 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:19.889 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:19.889 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:39:19.889 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:19.864759+0000", 2024-02-10T08:39:19.889 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8709999999999996e-06 2024-02-10T08:39:19.889 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:19.889 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:19.889 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:39:19.889 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:19.864764+0000", 2024-02-10T08:39:19.890 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014012200000000001 2024-02-10T08:39:19.890 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:19.890 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:19.890 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:39:19.890 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:19.864904+0000", 2024-02-10T08:39:19.890 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000182494 2024-02-10T08:39:19.890 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:19.890 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:19.890 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:39:19.890 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:19.865087+0000", 2024-02-10T08:39:19.890 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000184537 2024-02-10T08:39:19.890 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:19.890 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:19.890 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0,2", 2024-02-10T08:39:19.891 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:19.865271+0000", 2024-02-10T08:39:19.891 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0083609310000000003 2024-02-10T08:39:19.891 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:19.891 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:19.891 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:39:19.891 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:19.873632+0000", 2024-02-10T08:39:19.891 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0088874160000000004 2024-02-10T08:39:19.891 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:39:19.891 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:39:19.891 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:39:19.891 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:19.891 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:19.891 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.25664.0:165265 11.0 11:0546f4dc:::benchmark_data_smithi018_166993_object46140:head [delete] snapc 0=[] ondisk+write+known_if_redirected e439)", 2024-02-10T08:39:19.891 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:39:19.864915+0000", 2024-02-10T08:39:19.891 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.0088626920000000001, 2024-02-10T08:39:19.892 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0090887889999999999, 2024-02-10T08:39:19.892 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:39:19.892 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "waiting for sub ops", 2024-02-10T08:39:19.892 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:39:19.892 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.25664", 2024-02-10T08:39:19.892 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/1087272222", 2024-02-10T08:39:19.892 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 165265 2024-02-10T08:39:19.892 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:19.892 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:39:19.892 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:19.892 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:39:19.892 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:19.864915+0000", 2024-02-10T08:39:19.892 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:39:19.892 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:19.893 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:19.893 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:39:19.893 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:19.864915+0000", 2024-02-10T08:39:19.893 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:39:19.893 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:19.893 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:19.893 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:39:19.893 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:19.864914+0000", 2024-02-10T08:39:19.893 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8919999999999997e-06 2024-02-10T08:39:19.893 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:19.893 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:19.893 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:39:19.893 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:19.864920+0000", 2024-02-10T08:39:19.893 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0002e-05 2024-02-10T08:39:19.894 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:19.894 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:19.894 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:39:19.894 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:19.864930+0000", 2024-02-10T08:39:19.894 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7860000000000002e-06 2024-02-10T08:39:19.894 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:19.894 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:19.894 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:39:19.894 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:19.864936+0000", 2024-02-10T08:39:19.894 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7840999999999999e-05 2024-02-10T08:39:19.894 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:19.894 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:19.894 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:39:19.894 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:19.864974+0000", 2024-02-10T08:39:19.895 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013276999999999999 2024-02-10T08:39:19.895 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:19.895 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:19.895 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:39:19.895 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:19.865106+0000", 2024-02-10T08:39:19.895 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015395900000000001 2024-02-10T08:39:19.895 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:19.895 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:19.895 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,6", 2024-02-10T08:39:19.895 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:19.865260+0000", 2024-02-10T08:39:19.895 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0049140529999999998 2024-02-10T08:39:19.895 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:19.895 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:19.895 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:39:19.895 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:19.870174+0000", 2024-02-10T08:39:19.896 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0052592300000000002 2024-02-10T08:39:19.896 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:39:19.896 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:39:19.896 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:39:19.896 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:19.896 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:19.896 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.25664.0:165266 11.e e439/433 11:71ebb8c1:::benchmark_data_smithi018_166993_object46141:head v 439'10279, mlcod=439'10276)", 2024-02-10T08:39:19.896 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:39:19.865465+0000", 2024-02-10T08:39:19.896 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.0083132439999999991, 2024-02-10T08:39:19.896 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0086553949999999998, 2024-02-10T08:39:19.896 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:39:19.896 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-02-10T08:39:19.896 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:39:19.896 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:19.897 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:39:19.897 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:19.865465+0000", 2024-02-10T08:39:19.897 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:39:19.897 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:19.897 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:19.897 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:39:19.897 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:19.865465+0000", 2024-02-10T08:39:19.897 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:39:19.897 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:19.897 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:19.897 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:39:19.897 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:19.865464+0000", 2024-02-10T08:39:19.897 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8279999999999997e-06 2024-02-10T08:39:19.898 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:19.898 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:19.898 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:39:19.898 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:19.865471+0000", 2024-02-10T08:39:19.898 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5429999999999999e-06 2024-02-10T08:39:19.898 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:19.898 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:19.898 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:39:19.898 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:19.865480+0000", 2024-02-10T08:39:19.899 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9139999999999996e-06 2024-02-10T08:39:19.899 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:19.899 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:19.899 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:39:19.899 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:19.865486+0000", 2024-02-10T08:39:19.899 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0025807579999999998 2024-02-10T08:39:19.899 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:19.899 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:19.899 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:39:19.899 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:19.868067+0000", 2024-02-10T08:39:19.899 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2340999999999998e-05 2024-02-10T08:39:19.899 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:19.900 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:19.900 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:39:19.900 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:19.868089+0000", 2024-02-10T08:39:19.900 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0026246529999999998 2024-02-10T08:39:19.900 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:39:19.900 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:39:19.900 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:39:19.900 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:19.900 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:19.900 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.25664.0:165264 11.7 e439/398 11:e72e8c49:::benchmark_data_smithi018_166993_object46139:head v 439'10360, mlcod=439'10358)", 2024-02-10T08:39:19.900 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:39:19.870307+0000", 2024-02-10T08:39:19.900 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.0034709250000000001, 2024-02-10T08:39:19.900 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.003859234, 2024-02-10T08:39:19.900 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:39:19.901 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-02-10T08:39:19.901 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:39:19.901 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:19.901 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:39:19.901 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:19.870307+0000", 2024-02-10T08:39:19.901 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:39:19.901 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:19.901 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:19.901 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:39:19.901 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:19.870307+0000", 2024-02-10T08:39:19.901 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:39:19.901 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:19.901 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:19.901 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:39:19.901 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:19.870306+0000", 2024-02-10T08:39:19.901 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2360000000000004e-06 2024-02-10T08:39:19.902 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:19.902 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:19.902 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:39:19.902 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:19.870315+0000", 2024-02-10T08:39:19.902 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.968e-06 2024-02-10T08:39:19.902 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:19.902 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:19.902 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:39:19.902 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:19.870322+0000", 2024-02-10T08:39:19.902 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5530000000000003e-06 2024-02-10T08:39:19.902 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:19.902 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:19.902 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:39:19.902 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:19.870326+0000", 2024-02-10T08:39:19.903 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0032536560000000002 2024-02-10T08:39:19.903 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:19.903 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:19.903 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:39:19.903 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:19.873580+0000", 2024-02-10T08:39:19.903 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0503999999999999e-05 2024-02-10T08:39:19.903 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:19.903 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:19.903 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:39:19.903 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:19.873600+0000", 2024-02-10T08:39:19.903 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0032934420000000002 2024-02-10T08:39:19.903 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:39:19.903 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:39:19.903 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:39:19.903 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:39:19.904 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-02-10T08:39:19.904 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 6 2024-02-10T08:39:19.904 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-02-10T08:39:19.906 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:39:19.912 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:39:19.918 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:19.918 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:39:20.019 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:39:20.082 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:20.178 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:39:20.187 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:20.188 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:39:20.229 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:39:18.948148+0000 mgr.y (mgr.14505) 845 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:39:20.229 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:39:19.154437+0000 mgr.y (mgr.14505) 846 : cluster [DBG] pgmap v1039: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 4 active+undersized+degraded+remapped+backfilling, 173 active+clean; 4.6 GiB data, 18 GiB used, 607 GiB / 626 GiB avail; 852 B/s rd, 0 B/s wr, 817 op/s; 22172/225111 objects degraded (9.849%); 7.4 MiB/s, 117 objects/s recovering 2024-02-10T08:39:20.289 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:39:20.344 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:20.396 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:39:20.402 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:20.402 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:39:20.481 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:39:18.948148+0000 mgr.y (mgr.14505) 845 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:39:20.481 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:39:19.154437+0000 mgr.y (mgr.14505) 846 : cluster [DBG] pgmap v1039: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 4 active+undersized+degraded+remapped+backfilling, 173 active+clean; 4.6 GiB data, 18 GiB used, 607 GiB / 626 GiB avail; 852 B/s rd, 0 B/s wr, 817 op/s; 22172/225111 objects degraded (9.849%); 7.4 MiB/s, 117 objects/s recovering 2024-02-10T08:39:20.481 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:39:18.948148+0000 mgr.y (mgr.14505) 845 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:39:20.481 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:39:19.154437+0000 mgr.y (mgr.14505) 846 : cluster [DBG] pgmap v1039: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 4 active+undersized+degraded+remapped+backfilling, 173 active+clean; 4.6 GiB data, 18 GiB used, 607 GiB / 626 GiB avail; 852 B/s rd, 0 B/s wr, 817 op/s; 22172/225111 objects degraded (9.849%); 7.4 MiB/s, 117 objects/s recovering 2024-02-10T08:39:20.503 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:39:20.577 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:20.943 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd set nodeep-scrub 2024-02-10T08:39:21.237 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.1 dump_blocked_ops 2024-02-10T08:39:21.248 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:39:21.260 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:21.260 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:39:20.334864+0000 osd.0 (osd.0) 278 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:39:21.261 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:39:20.334919+0000 osd.0 (osd.0) 279 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:39:21.261 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:39:21.024556+0000 mon.a (mon.0) 1784 : cluster [WRN] Health check update: Degraded data redundancy: 22172/225111 objects degraded (9.849%), 5 pgs degraded (PG_DEGRADED) 2024-02-10T08:39:21.261 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:39:20.334864+0000 osd.0 (osd.0) 278 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:39:21.261 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:39:20.334919+0000 osd.0 (osd.0) 279 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:39:21.261 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:39:21.024556+0000 mon.a (mon.0) 1784 : cluster [WRN] Health check update: Degraded data redundancy: 22172/225111 objects degraded (9.849%), 5 pgs degraded (PG_DEGRADED) 2024-02-10T08:39:21.262 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:39:21.363 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:39:21.404 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:21.538 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:39:21.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:39:20.334864+0000 osd.0 (osd.0) 278 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:39:21.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:39:20.334919+0000 osd.0 (osd.0) 279 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:39:21.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:39:21.024556+0000 mon.a (mon.0) 1784 : cluster [WRN] Health check update: Degraded data redundancy: 22172/225111 objects degraded (9.849%), 5 pgs degraded (PG_DEGRADED) 2024-02-10T08:39:21.542 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:21.543 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:39:21.644 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:39:21.721 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:21.759 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:39:21.764 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:21.764 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:39:21.865 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:39:21.924 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:22.264 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:39:21.155045+0000 mgr.y (mgr.14505) 847 : cluster [DBG] pgmap v1040: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 4 active+undersized+degraded+remapped+backfilling, 173 active+clean; 4.6 GiB data, 18 GiB used, 607 GiB / 626 GiB avail; 796 B/s rd, 0 B/s wr, 655 op/s; 21903/224394 objects degraded (9.761%); 6.9 MiB/s, 110 objects/s recovering 2024-02-10T08:39:22.264 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:39:21.255181+0000 mon.a (mon.0) 1785 : cluster [DBG] osdmap e440: 8 total, 7 up, 7 in 2024-02-10T08:39:22.396 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:39:22.402 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:22.402 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:39:22.503 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:39:22.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:39:21.155045+0000 mgr.y (mgr.14505) 847 : cluster [DBG] pgmap v1040: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 4 active+undersized+degraded+remapped+backfilling, 173 active+clean; 4.6 GiB data, 18 GiB used, 607 GiB / 626 GiB avail; 796 B/s rd, 0 B/s wr, 655 op/s; 21903/224394 objects degraded (9.761%); 6.9 MiB/s, 110 objects/s recovering 2024-02-10T08:39:22.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:39:21.255181+0000 mon.a (mon.0) 1785 : cluster [DBG] osdmap e440: 8 total, 7 up, 7 in 2024-02-10T08:39:22.567 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:22.571 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:39:21.155045+0000 mgr.y (mgr.14505) 847 : cluster [DBG] pgmap v1040: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 4 active+undersized+degraded+remapped+backfilling, 173 active+clean; 4.6 GiB data, 18 GiB used, 607 GiB / 626 GiB avail; 796 B/s rd, 0 B/s wr, 655 op/s; 21903/224394 objects degraded (9.761%); 6.9 MiB/s, 110 objects/s recovering 2024-02-10T08:39:22.571 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:39:21.255181+0000 mon.a (mon.0) 1785 : cluster [DBG] osdmap e440: 8 total, 7 up, 7 in 2024-02-10T08:39:22.776 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:39:22.788 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:22.788 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:39:22.889 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:39:22.953 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:22.996 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:39:23.009 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:23.010 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:39:23.111 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:39:23.136 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:39:23.187 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:23.220 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:39:23.221 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:39:23.225 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:23.225 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:39:23.235 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:39:23.299 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:39:23.327 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:39:23.335 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:39:23.393 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:39:23.423 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:23.447 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:39:23.482 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:39:23.519 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:39:23.520 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:39:23.520 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-10T08:39:23.520 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-10T08:39:23.521 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-10T08:39:23.521 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-10T08:39:23.521 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-10T08:39:23.521 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-10T08:39:23.521 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-10T08:39:23.521 INFO:teuthology.orchestra.run.smithi018.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-02-10T08:39:23.529 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:23.530 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:39:23.531 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:39:23.180576+0000 mon.c (mon.2) 101 : audit [DBG] from='client.? 172.21.15.18:0/4056249870' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:39:23.532 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:39:23.180576+0000 mon.c (mon.2) 101 : audit [DBG] from='client.? 172.21.15.18:0/4056249870' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:39:23.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:39:23.180576+0000 mon.c (mon.2) 101 : audit [DBG] from='client.? 172.21.15.18:0/4056249870' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:39:23.631 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:39:23.698 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:24.305 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:39:23.157299+0000 mgr.y (mgr.14505) 848 : cluster [DBG] pgmap v1042: 178 pgs: 5 active+undersized+degraded+remapped+backfilling, 173 active+clean; 4.3 GiB data, 18 GiB used, 608 GiB / 626 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 1.06k op/s; 20646/213549 objects degraded (9.668%); 7.8 MiB/s, 124 objects/s recovering 2024-02-10T08:39:24.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:39:23.157299+0000 mgr.y (mgr.14505) 848 : cluster [DBG] pgmap v1042: 178 pgs: 5 active+undersized+degraded+remapped+backfilling, 173 active+clean; 4.3 GiB data, 18 GiB used, 608 GiB / 626 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 1.06k op/s; 20646/213549 objects degraded (9.668%); 7.8 MiB/s, 124 objects/s recovering 2024-02-10T08:39:24.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:39:23.258988+0000 mon.a (mon.0) 1786 : cluster [INF] Health check cleared: PG_BACKFILL_FULL (was: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull) 2024-02-10T08:39:24.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:39:23.258988+0000 mon.a (mon.0) 1786 : cluster [INF] Health check cleared: PG_BACKFILL_FULL (was: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull) 2024-02-10T08:39:24.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:39:23.157299+0000 mgr.y (mgr.14505) 848 : cluster [DBG] pgmap v1042: 178 pgs: 5 active+undersized+degraded+remapped+backfilling, 173 active+clean; 4.3 GiB data, 18 GiB used, 608 GiB / 626 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 1.06k op/s; 20646/213549 objects degraded (9.668%); 7.8 MiB/s, 124 objects/s recovering 2024-02-10T08:39:24.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:39:23.258988+0000 mon.a (mon.0) 1786 : cluster [INF] Health check cleared: PG_BACKFILL_FULL (was: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull) 2024-02-10T08:39:24.844 INFO:teuthology.orchestra.run.smithi071.stdout: marking collection for removal 2024-02-10T08:39:24.846 INFO:teuthology.orchestra.run.smithi071.stdout:setting '_remove' omap key 2024-02-10T08:39:24.846 INFO:teuthology.orchestra.run.smithi071.stdout:finish_remove_pgs 11.5_head removing 11.5 2024-02-10T08:39:25.117 INFO:teuthology.orchestra.run.smithi071.stdout:Remove successful 2024-02-10T08:39:25.649 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:39:25.653 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:25.654 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:39:25.754 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:39:25.813 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:26.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:39:25.158123+0000 mgr.y (mgr.14505) 849 : cluster [DBG] pgmap v1043: 178 pgs: 5 active+undersized+degraded+remapped+backfilling, 173 active+clean; 4.3 GiB data, 18 GiB used, 608 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.02k op/s; 20356/211233 objects degraded (9.637%); 7.2 MiB/s, 115 objects/s recovering 2024-02-10T08:39:26.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:39:25.682733+0000 mon.a (mon.0) 1787 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:39:26.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:39:26.031078+0000 mon.a (mon.0) 1788 : cluster [WRN] Health check update: Degraded data redundancy: 20356/211233 objects degraded (9.637%), 5 pgs degraded (PG_DEGRADED) 2024-02-10T08:39:26.790 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:39:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:39:26] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:39:26.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:39:25.158123+0000 mgr.y (mgr.14505) 849 : cluster [DBG] pgmap v1043: 178 pgs: 5 active+undersized+degraded+remapped+backfilling, 173 active+clean; 4.3 GiB data, 18 GiB used, 608 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.02k op/s; 20356/211233 objects degraded (9.637%); 7.2 MiB/s, 115 objects/s recovering 2024-02-10T08:39:26.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:39:25.682733+0000 mon.a (mon.0) 1787 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:39:26.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:39:26.031078+0000 mon.a (mon.0) 1788 : cluster [WRN] Health check update: Degraded data redundancy: 20356/211233 objects degraded (9.637%), 5 pgs degraded (PG_DEGRADED) 2024-02-10T08:39:26.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:39:25.158123+0000 mgr.y (mgr.14505) 849 : cluster [DBG] pgmap v1043: 178 pgs: 5 active+undersized+degraded+remapped+backfilling, 173 active+clean; 4.3 GiB data, 18 GiB used, 608 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.02k op/s; 20356/211233 objects degraded (9.637%); 7.2 MiB/s, 115 objects/s recovering 2024-02-10T08:39:26.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:39:25.682733+0000 mon.a (mon.0) 1787 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:39:26.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:39:26.031078+0000 mon.a (mon.0) 1788 : cluster [WRN] Health check update: Degraded data redundancy: 20356/211233 objects degraded (9.637%), 5 pgs degraded (PG_DEGRADED) 2024-02-10T08:39:27.404 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:39:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:39:27] "GET /metrics HTTP/1.1" 200 166352 "" "Prometheus/2.33.4" 2024-02-10T08:39:28.805 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -n osd.7 --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph-objectstore-tool --data-path /var/lib/ceph/osd/ceph-7 --journal-path /var/lib/ceph/osd/ceph-7/journal '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --op import --file /var/log/ceph/exp.11.5.7 2024-02-10T08:39:28.966 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:39:27.158554+0000 mgr.y (mgr.14505) 850 : cluster [DBG] pgmap v1044: 178 pgs: 5 active+undersized+degraded+remapped+backfilling, 173 active+clean; 4.3 GiB data, 18 GiB used, 608 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 860 op/s; 20356/211233 objects degraded (9.637%); 6.1 MiB/s, 97 objects/s recovering 2024-02-10T08:39:28.966 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:39:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:39:29.144 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/osd.7/config 2024-02-10T08:39:29.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:39:27.158554+0000 mgr.y (mgr.14505) 850 : cluster [DBG] pgmap v1044: 178 pgs: 5 active+undersized+degraded+remapped+backfilling, 173 active+clean; 4.3 GiB data, 18 GiB used, 608 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 860 op/s; 20356/211233 objects degraded (9.637%); 6.1 MiB/s, 97 objects/s recovering 2024-02-10T08:39:29.158 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:39:27.158554+0000 mgr.y (mgr.14505) 850 : cluster [DBG] pgmap v1044: 178 pgs: 5 active+undersized+degraded+remapped+backfilling, 173 active+clean; 4.3 GiB data, 18 GiB used, 608 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 860 op/s; 20356/211233 objects degraded (9.637%); 6.1 MiB/s, 97 objects/s recovering 2024-02-10T08:39:29.718 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:39:28.938382+0000 mon.a (mon.0) 1789 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:39:29.719 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:39:28.941431+0000 mon.a (mon.0) 1790 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:39:29.719 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:39:28.949411+0000 mon.a (mon.0) 1791 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:39:29.904 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:39:29.911 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:29.911 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:39:30.012 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:39:30.085 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:39:28.938382+0000 mon.a (mon.0) 1789 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:39:30.085 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:39:28.941431+0000 mon.a (mon.0) 1790 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:39:30.086 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:39:28.949411+0000 mon.a (mon.0) 1791 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:39:30.086 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:39:28.938382+0000 mon.a (mon.0) 1789 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:39:30.086 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:39:28.941431+0000 mon.a (mon.0) 1790 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:39:30.086 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:39:28.949411+0000 mon.a (mon.0) 1791 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:39:30.089 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:30.365 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-02-10T08:39:30.366 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-02-10T08:39:30.459 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:39:30.461 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:30.462 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:39:30.562 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:39:30.625 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:30.660 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:39:30.664 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:30.665 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:39:30.765 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:39:30.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:39:28.964603+0000 mgr.y (mgr.14505) 851 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:39:30.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:39:29.159451+0000 mgr.y (mgr.14505) 852 : cluster [DBG] pgmap v1045: 178 pgs: 5 active+undersized+degraded+remapped+backfilling, 173 active+clean; 4.0 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 905 op/s; 19026/197964 objects degraded (9.611%); 3.4 MiB/s, 54 objects/s recovering 2024-02-10T08:39:30.831 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:30.911 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:39:28.964603+0000 mgr.y (mgr.14505) 851 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:39:30.912 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:39:29.159451+0000 mgr.y (mgr.14505) 852 : cluster [DBG] pgmap v1045: 178 pgs: 5 active+undersized+degraded+remapped+backfilling, 173 active+clean; 4.0 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 905 op/s; 19026/197964 objects degraded (9.611%); 3.4 MiB/s, 54 objects/s recovering 2024-02-10T08:39:30.912 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:39:28.964603+0000 mgr.y (mgr.14505) 851 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:39:30.912 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:39:29.159451+0000 mgr.y (mgr.14505) 852 : cluster [DBG] pgmap v1045: 178 pgs: 5 active+undersized+degraded+remapped+backfilling, 173 active+clean; 4.0 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 905 op/s; 19026/197964 objects degraded (9.611%); 3.4 MiB/s, 54 objects/s recovering 2024-02-10T08:39:31.408 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:39:31.411 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:31.412 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:39:31.512 INFO:teuthology.orchestra.run.smithi071.stdout:get_pg_num_history pg_num_history pg_num_history(e432 pg_nums {1={19=1,409=11},2={54=32},3={54=3},4={56=32},5={58=32},6={287=52},10={335=16},11={398=16}} deleted_pools 395,10) 2024-02-10T08:39:31.512 INFO:teuthology.orchestra.run.smithi071.stdout:Importing pgid 11.5 2024-02-10T08:39:31.513 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:39:31.533 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0006de4:::benchmark_data_smithi018_166993_object67606:head# 2024-02-10T08:39:31.533 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.533 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0009d8c:::benchmark_data_smithi018_166993_object35778:head# 2024-02-10T08:39:31.533 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.533 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0032363:::benchmark_data_smithi018_166993_object62939:head# 2024-02-10T08:39:31.533 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.533 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0036558:::benchmark_data_smithi018_166993_object87311:head# 2024-02-10T08:39:31.533 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.533 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a003c562:::benchmark_data_smithi018_166993_object88676:head# 2024-02-10T08:39:31.533 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.535 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a004a81e:::benchmark_data_smithi018_166993_object104514:head# 2024-02-10T08:39:31.535 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.535 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a00619b7:::benchmark_data_smithi018_166993_object55250:head# 2024-02-10T08:39:31.535 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.535 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0096ba9:::benchmark_data_smithi018_166993_object113111:head# 2024-02-10T08:39:31.535 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.535 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a00d4a27:::benchmark_data_smithi018_166993_object36213:head# 2024-02-10T08:39:31.535 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.535 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a00e312a:::benchmark_data_smithi018_166993_object39605:head# 2024-02-10T08:39:31.536 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.536 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a00e9dce:::benchmark_data_smithi018_166993_object108589:head# 2024-02-10T08:39:31.536 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.536 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a00eaae4:::benchmark_data_smithi018_166993_object29189:head# 2024-02-10T08:39:31.536 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.536 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a00ec291:::benchmark_data_smithi018_166993_object41115:head# 2024-02-10T08:39:31.536 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.537 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a010a320:::benchmark_data_smithi018_166993_object18485:head# 2024-02-10T08:39:31.537 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.537 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a010f304:::benchmark_data_smithi018_166993_object118071:head# 2024-02-10T08:39:31.537 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.537 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a01128b1:::benchmark_data_smithi018_166993_object20573:head# 2024-02-10T08:39:31.537 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.538 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a011ba07:::benchmark_data_smithi018_166993_object39771:head# 2024-02-10T08:39:31.538 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.538 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a012345f:::benchmark_data_smithi018_166993_object25333:head# 2024-02-10T08:39:31.538 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.539 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0127eda:::benchmark_data_smithi018_166993_object95636:head# 2024-02-10T08:39:31.539 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.539 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0132081:::benchmark_data_smithi018_166993_object106092:head# 2024-02-10T08:39:31.539 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.539 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0142221:::benchmark_data_smithi018_166993_object42036:head# 2024-02-10T08:39:31.539 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.540 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0143659:::benchmark_data_smithi018_166993_object103945:head# 2024-02-10T08:39:31.540 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.540 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0158aab:::benchmark_data_smithi018_166993_object77884:head# 2024-02-10T08:39:31.541 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.541 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a017048c:::benchmark_data_smithi018_166993_object96290:head# 2024-02-10T08:39:31.541 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.541 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0170ae2:::benchmark_data_smithi018_166993_object74057:head# 2024-02-10T08:39:31.541 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.541 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a017a4e8:::benchmark_data_smithi018_166993_object68431:head# 2024-02-10T08:39:31.541 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.544 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a018259c:::benchmark_data_smithi018_166993_object20581:head# 2024-02-10T08:39:31.544 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.544 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a018eeea:::benchmark_data_smithi018_166993_object54467:head# 2024-02-10T08:39:31.544 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.544 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a01b0540:::benchmark_data_smithi018_166993_object81940:head# 2024-02-10T08:39:31.544 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.545 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a01bdcff:::benchmark_data_smithi018_166993_object113982:head# 2024-02-10T08:39:31.545 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.545 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a01c4277:::benchmark_data_smithi018_166993_object39338:head# 2024-02-10T08:39:31.545 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.545 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a01d4b9b:::benchmark_data_smithi018_166993_object21343:head# 2024-02-10T08:39:31.545 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.545 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a01db508:::benchmark_data_smithi018_166993_object42737:head# 2024-02-10T08:39:31.545 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.546 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a01e332b:::benchmark_data_smithi018_166993_object91009:head# 2024-02-10T08:39:31.546 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.546 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a01e4113:::benchmark_data_smithi018_166993_object60442:head# 2024-02-10T08:39:31.546 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.546 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a02017a3:::benchmark_data_smithi018_166993_object26981:head# 2024-02-10T08:39:31.546 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.547 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a020a11b:::benchmark_data_smithi018_166993_object102658:head# 2024-02-10T08:39:31.547 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.547 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a020c7f7:::benchmark_data_smithi018_166993_object111295:head# 2024-02-10T08:39:31.548 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.548 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0212c7e:::benchmark_data_smithi018_166993_object34276:head# 2024-02-10T08:39:31.548 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.548 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0234a04:::benchmark_data_smithi018_166993_object35158:head# 2024-02-10T08:39:31.548 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.548 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a024b49c:::benchmark_data_smithi018_166993_object45715:head# 2024-02-10T08:39:31.548 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.548 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a024ff92:::benchmark_data_smithi018_166993_object57670:head# 2024-02-10T08:39:31.548 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.549 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a025fa6e:::benchmark_data_smithi018_166993_object46463:head# 2024-02-10T08:39:31.549 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.549 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0263d01:::benchmark_data_smithi018_166993_object37403:head# 2024-02-10T08:39:31.549 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.549 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a026e2f8:::benchmark_data_smithi018_166993_object110405:head# 2024-02-10T08:39:31.549 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.549 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a02708de:::benchmark_data_smithi018_166993_object74902:head# 2024-02-10T08:39:31.550 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.551 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0274ea8:::benchmark_data_smithi018_166993_object83824:head# 2024-02-10T08:39:31.551 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.551 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a028d151:::benchmark_data_smithi018_166993_object118491:head# 2024-02-10T08:39:31.551 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.551 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a028d24f:::benchmark_data_smithi018_166993_object112600:head# 2024-02-10T08:39:31.551 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.554 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a029e1c6:::benchmark_data_smithi018_166993_object17643:head# 2024-02-10T08:39:31.554 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.554 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a02b4c42:::benchmark_data_smithi018_166993_object93260:head# 2024-02-10T08:39:31.554 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.555 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a02ce389:::benchmark_data_smithi018_166993_object116377:head# 2024-02-10T08:39:31.555 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.555 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a02d0edd:::benchmark_data_smithi018_166993_object111667:head# 2024-02-10T08:39:31.555 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.555 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a02db365:::benchmark_data_smithi018_166993_object47009:head# 2024-02-10T08:39:31.555 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.555 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a02e40a3:::benchmark_data_smithi018_166993_object89036:head# 2024-02-10T08:39:31.555 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.558 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a02fc811:::benchmark_data_smithi018_166993_object60450:head# 2024-02-10T08:39:31.559 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.559 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a032966e:::benchmark_data_smithi018_166993_object89567:head# 2024-02-10T08:39:31.559 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.559 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a03363af:::benchmark_data_smithi018_166993_object42359:head# 2024-02-10T08:39:31.559 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.559 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a03396d1:::benchmark_data_smithi018_166993_object29085:head# 2024-02-10T08:39:31.559 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.559 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a033c8c4:::benchmark_data_smithi018_166993_object29595:head# 2024-02-10T08:39:31.559 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.559 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0343b41:::benchmark_data_smithi018_166993_object44960:head# 2024-02-10T08:39:31.559 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.559 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a03452bb:::benchmark_data_smithi018_166993_object51120:head# 2024-02-10T08:39:31.559 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.559 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0353d77:::benchmark_data_smithi018_166993_object64889:head# 2024-02-10T08:39:31.560 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.560 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0369bfa:::benchmark_data_smithi018_166993_object43943:head# 2024-02-10T08:39:31.560 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.560 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a036c73e:::benchmark_data_smithi018_166993_object96437:head# 2024-02-10T08:39:31.560 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.560 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a03a524d:::benchmark_data_smithi018_166993_object99099:head# 2024-02-10T08:39:31.560 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.560 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a03a8b35:::benchmark_data_smithi018_166993_object109336:head# 2024-02-10T08:39:31.560 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.560 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a03ab221:::benchmark_data_smithi018_166993_object45901:head# 2024-02-10T08:39:31.560 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.560 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a03aff41:::benchmark_data_smithi018_166993_object38630:head# 2024-02-10T08:39:31.560 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.560 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a03b0c1e:::benchmark_data_smithi018_166993_object105514:head# 2024-02-10T08:39:31.561 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.561 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a03b1196:::benchmark_data_smithi018_166993_object40023:head# 2024-02-10T08:39:31.561 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.563 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a03b7abe:::benchmark_data_smithi018_166993_object110445:head# 2024-02-10T08:39:31.564 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.564 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a03d333c:::benchmark_data_smithi018_166993_object104215:head# 2024-02-10T08:39:31.564 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.564 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a03d6af1:::benchmark_data_smithi018_166993_object32085:head# 2024-02-10T08:39:31.564 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.564 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a03d88cd:::benchmark_data_smithi018_166993_object32345:head# 2024-02-10T08:39:31.564 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.564 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a03ef368:::benchmark_data_smithi018_166993_object94693:head# 2024-02-10T08:39:31.564 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.564 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a03f0aa1:::benchmark_data_smithi018_166993_object71945:head# 2024-02-10T08:39:31.564 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.564 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a03fa113:::benchmark_data_smithi018_166993_object113118:head# 2024-02-10T08:39:31.564 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.565 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0401d1a:::benchmark_data_smithi018_166993_object45817:head# 2024-02-10T08:39:31.565 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.565 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0406a73:::benchmark_data_smithi018_166993_object84449:head# 2024-02-10T08:39:31.565 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.565 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a040e3e6:::benchmark_data_smithi018_166993_object73365:head# 2024-02-10T08:39:31.565 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.565 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0410012:::benchmark_data_smithi018_166993_object97016:head# 2024-02-10T08:39:31.565 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.565 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a04108c4:::benchmark_data_smithi018_166993_object20938:head# 2024-02-10T08:39:31.565 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.565 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0413a63:::benchmark_data_smithi018_166993_object44356:head# 2024-02-10T08:39:31.565 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.565 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a041d4c4:::benchmark_data_smithi018_166993_object65216:head# 2024-02-10T08:39:31.565 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.565 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0429469:::benchmark_data_smithi018_166993_object33480:head# 2024-02-10T08:39:31.565 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.566 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a043331e:::benchmark_data_smithi018_166993_object92394:head# 2024-02-10T08:39:31.566 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.566 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a04489d6:::benchmark_data_smithi018_166993_object64819:head# 2024-02-10T08:39:31.566 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.566 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0454cec:::benchmark_data_smithi018_166993_object56393:head# 2024-02-10T08:39:31.566 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.566 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a045b80e:::benchmark_data_smithi018_166993_object76417:head# 2024-02-10T08:39:31.566 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.567 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0474b09:::benchmark_data_smithi018_166993_object41176:head# 2024-02-10T08:39:31.567 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.567 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a047f2b2:::benchmark_data_smithi018_166993_object41970:head# 2024-02-10T08:39:31.567 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.568 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0482acf:::benchmark_data_smithi018_166993_object89856:head# 2024-02-10T08:39:31.568 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.568 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a048663c:::benchmark_data_smithi018_166993_object48865:head# 2024-02-10T08:39:31.569 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.569 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a04868f9:::benchmark_data_smithi018_166993_object110581:head# 2024-02-10T08:39:31.569 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.569 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a048c7f0:::benchmark_data_smithi018_166993_object85152:head# 2024-02-10T08:39:31.569 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.569 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a048c9ba:::benchmark_data_smithi018_166993_object81631:head# 2024-02-10T08:39:31.569 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.569 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a04936ac:::benchmark_data_smithi018_166993_object58124:head# 2024-02-10T08:39:31.569 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.571 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0495c62:::benchmark_data_smithi018_166993_object60276:head# 2024-02-10T08:39:31.571 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.571 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a049e9cb:::benchmark_data_smithi018_166993_object51282:head# 2024-02-10T08:39:31.571 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.571 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a04a162d:::benchmark_data_smithi018_166993_object41427:head# 2024-02-10T08:39:31.571 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.571 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a04b596f:::benchmark_data_smithi018_166993_object57793:head# 2024-02-10T08:39:31.571 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.571 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a04d4e58:::benchmark_data_smithi018_166993_object39005:head# 2024-02-10T08:39:31.571 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.571 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a04d5918:::benchmark_data_smithi018_166993_object64944:head# 2024-02-10T08:39:31.571 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.571 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a04e0dc0:::benchmark_data_smithi018_166993_object21567:head# 2024-02-10T08:39:31.571 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.572 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0506942:::benchmark_data_smithi018_166993_object35569:head# 2024-02-10T08:39:31.572 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.572 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a050b274:::benchmark_data_smithi018_166993_object93692:head# 2024-02-10T08:39:31.572 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.575 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a050c53d:::benchmark_data_smithi018_166993_object19489:head# 2024-02-10T08:39:31.575 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.575 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a05132af:::benchmark_data_smithi018_166993_object30716:head# 2024-02-10T08:39:31.575 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.576 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a051d4ef:::benchmark_data_smithi018_166993_object67172:head# 2024-02-10T08:39:31.576 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.576 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0521869:::benchmark_data_smithi018_166993_object84684:head# 2024-02-10T08:39:31.576 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.576 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a052390a:::benchmark_data_smithi018_166993_object74787:head# 2024-02-10T08:39:31.576 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.576 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a052645a:::benchmark_data_smithi018_166993_object104540:head# 2024-02-10T08:39:31.576 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.576 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0526dda:::benchmark_data_smithi018_166993_object36256:head# 2024-02-10T08:39:31.576 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.576 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a052e6c3:::benchmark_data_smithi018_166993_object88089:head# 2024-02-10T08:39:31.576 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.576 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0534e15:::benchmark_data_smithi018_166993_object44054:head# 2024-02-10T08:39:31.576 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.576 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0537719:::benchmark_data_smithi018_166993_object43821:head# 2024-02-10T08:39:31.577 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.577 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a05390a3:::benchmark_data_smithi018_166993_object62259:head# 2024-02-10T08:39:31.577 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.577 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a053b112:::benchmark_data_smithi018_166993_object106940:head# 2024-02-10T08:39:31.577 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.577 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a053c063:::benchmark_data_smithi018_166993_object24232:head# 2024-02-10T08:39:31.577 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.577 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0544a37:::benchmark_data_smithi018_166993_object92689:head# 2024-02-10T08:39:31.577 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.577 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0545686:::benchmark_data_smithi018_166993_object117529:head# 2024-02-10T08:39:31.577 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.577 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a055e397:::benchmark_data_smithi018_166993_object37881:head# 2024-02-10T08:39:31.577 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.577 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a05614ce:::benchmark_data_smithi018_166993_object46514:head# 2024-02-10T08:39:31.577 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.577 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0564f22:::benchmark_data_smithi018_166993_object87545:head# 2024-02-10T08:39:31.578 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.578 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0574fae:::benchmark_data_smithi018_166993_object43972:head# 2024-02-10T08:39:31.578 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.578 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a05760b6:::benchmark_data_smithi018_166993_object104943:head# 2024-02-10T08:39:31.578 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.581 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0577d82:::benchmark_data_smithi018_166993_object69320:head# 2024-02-10T08:39:31.581 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.581 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0580450:::benchmark_data_smithi018_166993_object104192:head# 2024-02-10T08:39:31.581 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.584 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a05839b0:::benchmark_data_smithi018_166993_object41964:head# 2024-02-10T08:39:31.584 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.584 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a05897ff:::benchmark_data_smithi018_166993_object87936:head# 2024-02-10T08:39:31.584 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.584 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a05a30b3:::benchmark_data_smithi018_166993_object85996:head# 2024-02-10T08:39:31.584 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.587 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a05c1b0d:::benchmark_data_smithi018_166993_object66566:head# 2024-02-10T08:39:31.587 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.587 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a05c4ec9:::benchmark_data_smithi018_166993_object35801:head# 2024-02-10T08:39:31.587 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.588 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a05c723b:::benchmark_data_smithi018_166993_object82843:head# 2024-02-10T08:39:31.588 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.588 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a05ce0d6:::benchmark_data_smithi018_166993_object81947:head# 2024-02-10T08:39:31.588 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.588 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a05e3103:::benchmark_data_smithi018_166993_object108784:head# 2024-02-10T08:39:31.588 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.589 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a05f5ba7:::benchmark_data_smithi018_166993_object28917:head# 2024-02-10T08:39:31.589 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.589 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a05fa66c:::benchmark_data_smithi018_166993_object27424:head# 2024-02-10T08:39:31.589 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.589 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a060774e:::benchmark_data_smithi018_166993_object42724:head# 2024-02-10T08:39:31.589 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.590 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0618f83:::benchmark_data_smithi018_166993_object99007:head# 2024-02-10T08:39:31.590 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.591 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a06261eb:::benchmark_data_smithi018_166993_object97499:head# 2024-02-10T08:39:31.591 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.592 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a06385b7:::benchmark_data_smithi018_166993_object21102:head# 2024-02-10T08:39:31.592 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.592 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a063bee3:::benchmark_data_smithi018_166993_object112922:head# 2024-02-10T08:39:31.592 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.592 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0649bbb:::benchmark_data_smithi018_166993_object66730:head# 2024-02-10T08:39:31.592 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.593 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a064acc4:::benchmark_data_smithi018_166993_object45926:head# 2024-02-10T08:39:31.593 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.593 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a065b525:::benchmark_data_smithi018_166993_object65247:head# 2024-02-10T08:39:31.593 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.593 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a066076d:::benchmark_data_smithi018_166993_object82377:head# 2024-02-10T08:39:31.593 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.594 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a066308e:::benchmark_data_smithi018_166993_object74803:head# 2024-02-10T08:39:31.594 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.595 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a06643f8:::benchmark_data_smithi018_166993_object100854:head# 2024-02-10T08:39:31.595 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.595 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a067dfe9:::benchmark_data_smithi018_166993_object50442:head# 2024-02-10T08:39:31.595 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.595 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a067e55e:::benchmark_data_smithi018_166993_object21041:head# 2024-02-10T08:39:31.595 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.595 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0681e33:::benchmark_data_smithi018_166993_object99310:head# 2024-02-10T08:39:31.595 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.596 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0695e72:::benchmark_data_smithi018_166993_object45922:head# 2024-02-10T08:39:31.597 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.597 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0699dd1:::benchmark_data_smithi018_166993_object74797:head# 2024-02-10T08:39:31.597 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.597 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a069a0c3:::benchmark_data_smithi018_166993_object81801:head# 2024-02-10T08:39:31.597 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.597 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a069bcf7:::benchmark_data_smithi018_166993_object94424:head# 2024-02-10T08:39:31.597 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.597 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a069d773:::benchmark_data_smithi018_166993_object109617:head# 2024-02-10T08:39:31.597 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.597 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a06b80f2:::benchmark_data_smithi018_166993_object101722:head# 2024-02-10T08:39:31.597 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.597 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a06b86fb:::benchmark_data_smithi018_166993_object107103:head# 2024-02-10T08:39:31.597 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.597 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a06c9820:::benchmark_data_smithi018_166993_object92610:head# 2024-02-10T08:39:31.598 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.598 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a06d42a9:::benchmark_data_smithi018_166993_object37225:head# 2024-02-10T08:39:31.598 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.598 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a06e023f:::benchmark_data_smithi018_166993_object112696:head# 2024-02-10T08:39:31.598 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.598 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a06e62d5:::benchmark_data_smithi018_166993_object30375:head# 2024-02-10T08:39:31.598 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.599 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a06f00d1:::benchmark_data_smithi018_166993_object46409:head# 2024-02-10T08:39:31.599 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.603 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a06f0e55:::benchmark_data_smithi018_166993_object23756:head# 2024-02-10T08:39:31.603 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.603 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a06fe2ab:::benchmark_data_smithi018_166993_object40869:head# 2024-02-10T08:39:31.603 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.603 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a06fee80:::benchmark_data_smithi018_166993_object71391:head# 2024-02-10T08:39:31.604 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.604 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a07029e6:::benchmark_data_smithi018_166993_object65382:head# 2024-02-10T08:39:31.604 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.604 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a070e287:::benchmark_data_smithi018_166993_object74081:head# 2024-02-10T08:39:31.604 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.604 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0713a99:::benchmark_data_smithi018_166993_object101271:head# 2024-02-10T08:39:31.604 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.604 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a071503a:::benchmark_data_smithi018_166993_object83819:head# 2024-02-10T08:39:31.604 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.605 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a07208e2:::benchmark_data_smithi018_166993_object91670:head# 2024-02-10T08:39:31.605 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.605 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a07413d2:::benchmark_data_smithi018_166993_object65157:head# 2024-02-10T08:39:31.605 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.605 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0742d5b:::benchmark_data_smithi018_166993_object98926:head# 2024-02-10T08:39:31.605 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.605 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0743012:::benchmark_data_smithi018_166993_object101146:head# 2024-02-10T08:39:31.605 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.605 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0755487:::benchmark_data_smithi018_166993_object38946:head# 2024-02-10T08:39:31.605 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.605 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a075a792:::benchmark_data_smithi018_166993_object59868:head# 2024-02-10T08:39:31.606 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.606 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a075c9b4:::benchmark_data_smithi018_166993_object45991:head# 2024-02-10T08:39:31.606 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.606 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a076a749:::benchmark_data_smithi018_166993_object82737:head# 2024-02-10T08:39:31.606 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.606 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0771663:::benchmark_data_smithi018_166993_object42833:head# 2024-02-10T08:39:31.606 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.607 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0772042:::benchmark_data_smithi018_166993_object96823:head# 2024-02-10T08:39:31.607 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.607 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0778ca2:::benchmark_data_smithi018_166993_object45737:head# 2024-02-10T08:39:31.607 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.610 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a07791dd:::benchmark_data_smithi018_166993_object57736:head# 2024-02-10T08:39:31.610 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.610 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a077aa30:::benchmark_data_smithi018_166993_object27671:head# 2024-02-10T08:39:31.610 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.610 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a079130b:::benchmark_data_smithi018_166993_object24818:head# 2024-02-10T08:39:31.610 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.610 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0791bf5:::benchmark_data_smithi018_166993_object39316:head# 2024-02-10T08:39:31.611 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.611 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0795252:::benchmark_data_smithi018_166993_object41843:head# 2024-02-10T08:39:31.611 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.611 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a07958a8:::benchmark_data_smithi018_166993_object67050:head# 2024-02-10T08:39:31.611 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.611 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a07a3b0f:::benchmark_data_smithi018_166993_object67570:head# 2024-02-10T08:39:31.611 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.611 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a07a7b12:::benchmark_data_smithi018_166993_object20176:head# 2024-02-10T08:39:31.611 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.612 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a07a8ad9:::benchmark_data_smithi018_166993_object107292:head# 2024-02-10T08:39:31.612 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.613 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a07ba1cd:::benchmark_data_smithi018_166993_object63968:head# 2024-02-10T08:39:31.613 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.613 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a07be5c8:::benchmark_data_smithi018_166993_object50709:head# 2024-02-10T08:39:31.613 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.613 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a07c3a55:::benchmark_data_smithi018_166993_object47474:head# 2024-02-10T08:39:31.613 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.613 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a07c8fc1:::benchmark_data_smithi018_166993_object38570:head# 2024-02-10T08:39:31.613 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.613 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a07df34c:::benchmark_data_smithi018_166993_object34339:head# 2024-02-10T08:39:31.613 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.615 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a07e0eee:::benchmark_data_smithi018_166993_object49610:head# 2024-02-10T08:39:31.615 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.615 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a07f2779:::benchmark_data_smithi018_166993_object65628:head# 2024-02-10T08:39:31.615 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.615 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a07f91ee:::benchmark_data_smithi018_166993_object46200:head# 2024-02-10T08:39:31.615 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.616 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a08173a1:::benchmark_data_smithi018_166993_object112211:head# 2024-02-10T08:39:31.616 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.616 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0820a87:::benchmark_data_smithi018_166993_object21957:head# 2024-02-10T08:39:31.617 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.617 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0824a21:::benchmark_data_smithi018_166993_object46493:head# 2024-02-10T08:39:31.617 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.617 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a08265db:::benchmark_data_smithi018_166993_object62077:head# 2024-02-10T08:39:31.617 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.618 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0826d7a:::benchmark_data_smithi018_166993_object78271:head# 2024-02-10T08:39:31.618 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.618 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a082a188:::benchmark_data_smithi018_166993_object109899:head# 2024-02-10T08:39:31.618 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.618 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0848776:::benchmark_data_smithi018_166993_object96092:head# 2024-02-10T08:39:31.618 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.618 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a084dc2e:::benchmark_data_smithi018_166993_object117131:head# 2024-02-10T08:39:31.618 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.620 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a085ddf3:::benchmark_data_smithi018_166993_object33676:head# 2024-02-10T08:39:31.620 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.620 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a087093f:::benchmark_data_smithi018_166993_object93321:head# 2024-02-10T08:39:31.620 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.620 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0875b15:::benchmark_data_smithi018_166993_object66623:head# 2024-02-10T08:39:31.620 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.620 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0883c64:::benchmark_data_smithi018_166993_object24826:head# 2024-02-10T08:39:31.620 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.620 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a088647b:::benchmark_data_smithi018_166993_object51746:head# 2024-02-10T08:39:31.620 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.620 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a088a14e:::benchmark_data_smithi018_166993_object80782:head# 2024-02-10T08:39:31.620 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.621 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a088c681:::benchmark_data_smithi018_166993_object37885:head# 2024-02-10T08:39:31.621 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.622 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0890b9b:::benchmark_data_smithi018_166993_object103702:head# 2024-02-10T08:39:31.622 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.623 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0891db4:::benchmark_data_smithi018_166993_object86977:head# 2024-02-10T08:39:31.623 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.623 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0898dd4:::benchmark_data_smithi018_166993_object85721:head# 2024-02-10T08:39:31.623 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.623 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a089b2e1:::benchmark_data_smithi018_166993_object84791:head# 2024-02-10T08:39:31.623 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.623 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a08a444d:::benchmark_data_smithi018_166993_object68417:head# 2024-02-10T08:39:31.623 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.623 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a08b47ac:::benchmark_data_smithi018_166993_object42348:head# 2024-02-10T08:39:31.623 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.623 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a08b5ee0:::benchmark_data_smithi018_166993_object54644:head# 2024-02-10T08:39:31.623 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.623 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a08cc709:::benchmark_data_smithi018_166993_object68131:head# 2024-02-10T08:39:31.623 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.623 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a08ce448:::benchmark_data_smithi018_166993_object92743:head# 2024-02-10T08:39:31.624 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.627 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a08d9540:::benchmark_data_smithi018_166993_object92851:head# 2024-02-10T08:39:31.627 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.628 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a08f9297:::benchmark_data_smithi018_166993_object65960:head# 2024-02-10T08:39:31.628 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.628 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a08ffbcd:::benchmark_data_smithi018_166993_object43839:head# 2024-02-10T08:39:31.628 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.629 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0909e8f:::benchmark_data_smithi018_166993_object92246:head# 2024-02-10T08:39:31.629 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.629 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0925dca:::benchmark_data_smithi018_166993_object50745:head# 2024-02-10T08:39:31.629 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.629 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0946afb:::benchmark_data_smithi018_166993_object71561:head# 2024-02-10T08:39:31.630 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.630 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0965613:::benchmark_data_smithi018_166993_object104872:head# 2024-02-10T08:39:31.630 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.631 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a09706d5:::benchmark_data_smithi018_166993_object80637:head# 2024-02-10T08:39:31.631 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.631 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0973a7d:::benchmark_data_smithi018_166993_object33954:head# 2024-02-10T08:39:31.632 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.632 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0976180:::benchmark_data_smithi018_166993_object115819:head# 2024-02-10T08:39:31.632 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.632 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a097e87b:::benchmark_data_smithi018_166993_object117149:head# 2024-02-10T08:39:31.632 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.632 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a098d662:::benchmark_data_smithi018_166993_object35851:head# 2024-02-10T08:39:31.632 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.632 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0990332:::benchmark_data_smithi018_166993_object110586:head# 2024-02-10T08:39:31.632 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.632 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a099a4d7:::benchmark_data_smithi018_166993_object21241:head# 2024-02-10T08:39:31.632 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.632 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a09abe2a:::benchmark_data_smithi018_166993_object36140:head# 2024-02-10T08:39:31.632 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.633 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a09b064c:::benchmark_data_smithi018_166993_object26793:head# 2024-02-10T08:39:31.633 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.633 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a09b3b4c:::benchmark_data_smithi018_166993_object89777:head# 2024-02-10T08:39:31.633 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.633 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a09bc04a:::benchmark_data_smithi018_166993_object47128:head# 2024-02-10T08:39:31.633 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.635 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a09dbd3c:::benchmark_data_smithi018_166993_object72593:head# 2024-02-10T08:39:31.635 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.636 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a09dccb0:::benchmark_data_smithi018_166993_object69529:head# 2024-02-10T08:39:31.636 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.636 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a09e3aa1:::benchmark_data_smithi018_166993_object59547:head# 2024-02-10T08:39:31.636 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.637 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0a03d29:::benchmark_data_smithi018_166993_object42239:head# 2024-02-10T08:39:31.637 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.637 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0a17079:::benchmark_data_smithi018_166993_object22050:head# 2024-02-10T08:39:31.637 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.637 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0a29189:::benchmark_data_smithi018_166993_object67074:head# 2024-02-10T08:39:31.637 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.637 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0a34736:::benchmark_data_smithi018_166993_object101107:head# 2024-02-10T08:39:31.637 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.637 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0a3ef9a:::benchmark_data_smithi018_166993_object18663:head# 2024-02-10T08:39:31.637 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.638 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0a4b515:::benchmark_data_smithi018_166993_object40662:head# 2024-02-10T08:39:31.639 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.639 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0a5013b:::benchmark_data_smithi018_166993_object61037:head# 2024-02-10T08:39:31.639 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.639 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0a72db0:::benchmark_data_smithi018_166993_object84575:head# 2024-02-10T08:39:31.639 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.639 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0a73594:::benchmark_data_smithi018_166993_object74884:head# 2024-02-10T08:39:31.639 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.639 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0a881b2:::benchmark_data_smithi018_166993_object101035:head# 2024-02-10T08:39:31.639 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.639 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0a89970:::benchmark_data_smithi018_166993_object77943:head# 2024-02-10T08:39:31.639 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.640 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0a8d1ad:::benchmark_data_smithi018_166993_object87657:head# 2024-02-10T08:39:31.641 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.641 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0a961ce:::benchmark_data_smithi018_166993_object50514:head# 2024-02-10T08:39:31.641 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.641 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0aa4bdc:::benchmark_data_smithi018_166993_object54972:head# 2024-02-10T08:39:31.641 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.641 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0ab1c86:::benchmark_data_smithi018_166993_object34102:head# 2024-02-10T08:39:31.641 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.641 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0ab6fac:::benchmark_data_smithi018_166993_object111563:head# 2024-02-10T08:39:31.641 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.641 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0ac5e00:::benchmark_data_smithi018_166993_object33965:head# 2024-02-10T08:39:31.641 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.641 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0ae01ea:::benchmark_data_smithi018_166993_object92163:head# 2024-02-10T08:39:31.641 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.642 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0af0d66:::benchmark_data_smithi018_166993_object45180:head# 2024-02-10T08:39:31.642 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.643 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0afaa7f:::benchmark_data_smithi018_166993_object53275:head# 2024-02-10T08:39:31.643 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.643 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0afb0e0:::benchmark_data_smithi018_166993_object76338:head# 2024-02-10T08:39:31.643 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.643 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0b0a8d4:::benchmark_data_smithi018_166993_object92096:head# 2024-02-10T08:39:31.643 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.643 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0b151f0:::benchmark_data_smithi018_166993_object108695:head# 2024-02-10T08:39:31.643 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.643 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0b18b04:::benchmark_data_smithi018_166993_object19679:head# 2024-02-10T08:39:31.643 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.643 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0b35a42:::benchmark_data_smithi018_166993_object38264:head# 2024-02-10T08:39:31.643 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.645 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0b3c912:::benchmark_data_smithi018_166993_object22581:head# 2024-02-10T08:39:31.645 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.645 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0b3cf32:::benchmark_data_smithi018_166993_object21364:head# 2024-02-10T08:39:31.645 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.645 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0b3da38:::benchmark_data_smithi018_166993_object100892:head# 2024-02-10T08:39:31.646 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.646 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0b45024:::benchmark_data_smithi018_166993_object76058:head# 2024-02-10T08:39:31.646 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.646 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0b4fcd0:::benchmark_data_smithi018_166993_object73300:head# 2024-02-10T08:39:31.646 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.646 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0b67a3e:::benchmark_data_smithi018_166993_object110829:head# 2024-02-10T08:39:31.646 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.646 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0b688f2:::benchmark_data_smithi018_166993_object27566:head# 2024-02-10T08:39:31.646 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.646 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0b6d52a:::benchmark_data_smithi018_166993_object100844:head# 2024-02-10T08:39:31.646 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.646 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0b789dc:::benchmark_data_smithi018_166993_object33803:head# 2024-02-10T08:39:31.646 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.647 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0b7ac52:::benchmark_data_smithi018_166993_object93650:head# 2024-02-10T08:39:31.647 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.647 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0b88149:::benchmark_data_smithi018_166993_object21464:head# 2024-02-10T08:39:31.647 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.648 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0b8cb4c:::benchmark_data_smithi018_166993_object97339:head# 2024-02-10T08:39:31.649 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.649 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0b91822:::benchmark_data_smithi018_166993_object89246:head# 2024-02-10T08:39:31.649 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.650 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0ba9f9f:::benchmark_data_smithi018_166993_object34660:head# 2024-02-10T08:39:31.650 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.650 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0bacc58:::benchmark_data_smithi018_166993_object106993:head# 2024-02-10T08:39:31.650 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.650 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0bad1b0:::benchmark_data_smithi018_166993_object52848:head# 2024-02-10T08:39:31.650 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.650 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0bba97f:::benchmark_data_smithi018_166993_object113397:head# 2024-02-10T08:39:31.651 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.651 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0bbfb1b:::benchmark_data_smithi018_166993_object66136:head# 2024-02-10T08:39:31.651 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.651 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0bd5a2a:::benchmark_data_smithi018_166993_object107872:head# 2024-02-10T08:39:31.651 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.651 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0bd76fa:::benchmark_data_smithi018_166993_object44006:head# 2024-02-10T08:39:31.651 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.652 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0bdb296:::benchmark_data_smithi018_166993_object66147:head# 2024-02-10T08:39:31.652 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.653 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0be4f5c:::benchmark_data_smithi018_166993_object52951:head# 2024-02-10T08:39:31.653 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.653 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0be7aa6:::benchmark_data_smithi018_166993_object59552:head# 2024-02-10T08:39:31.653 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.653 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0bf8d6c:::benchmark_data_smithi018_166993_object117962:head# 2024-02-10T08:39:31.653 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.653 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0bfb030:::benchmark_data_smithi018_166993_object65138:head# 2024-02-10T08:39:31.653 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.653 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0c031a5:::benchmark_data_smithi018_166993_object56671:head# 2024-02-10T08:39:31.653 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.653 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0c0fdaf:::benchmark_data_smithi018_166993_object82422:head# 2024-02-10T08:39:31.653 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.653 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0c17505:::benchmark_data_smithi018_166993_object26967:head# 2024-02-10T08:39:31.653 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.653 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0c254f6:::benchmark_data_smithi018_166993_object72990:head# 2024-02-10T08:39:31.653 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.654 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0c441f6:::benchmark_data_smithi018_166993_object79129:head# 2024-02-10T08:39:31.654 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.655 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0c5121b:::benchmark_data_smithi018_166993_object34976:head# 2024-02-10T08:39:31.656 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.656 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0c5d6fe:::benchmark_data_smithi018_166993_object87579:head# 2024-02-10T08:39:31.656 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.656 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0c5ff62:::benchmark_data_smithi018_166993_object101522:head# 2024-02-10T08:39:31.656 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.656 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0c64b6f:::benchmark_data_smithi018_166993_object46600:head# 2024-02-10T08:39:31.656 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.656 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0c76b74:::benchmark_data_smithi018_166993_object64921:head# 2024-02-10T08:39:31.656 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.656 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0c77dc0:::benchmark_data_smithi018_166993_object48934:head# 2024-02-10T08:39:31.656 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.656 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0caae08:::benchmark_data_smithi018_166993_object39970:head# 2024-02-10T08:39:31.656 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.656 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0cc14cc:::benchmark_data_smithi018_166993_object91522:head# 2024-02-10T08:39:31.657 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.657 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0cc9d08:::benchmark_data_smithi018_166993_object48879:head# 2024-02-10T08:39:31.657 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.657 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0ce7adf:::benchmark_data_smithi018_166993_object89706:head# 2024-02-10T08:39:31.657 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.657 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0ce904c:::benchmark_data_smithi018_166993_object78643:head# 2024-02-10T08:39:31.657 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.657 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0cf4b2f:::benchmark_data_smithi018_166993_object48155:head# 2024-02-10T08:39:31.657 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.657 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0cf5696:::benchmark_data_smithi018_166993_object57547:head# 2024-02-10T08:39:31.657 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.658 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0cfb562:::benchmark_data_smithi018_166993_object72508:head# 2024-02-10T08:39:31.658 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.658 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0cfc089:::benchmark_data_smithi018_166993_object104598:head# 2024-02-10T08:39:31.658 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.658 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0d0f7e6:::benchmark_data_smithi018_166993_object99866:head# 2024-02-10T08:39:31.658 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.658 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0d10968:::benchmark_data_smithi018_166993_object22170:head# 2024-02-10T08:39:31.658 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.662 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0d19225:::benchmark_data_smithi018_166993_object88029:head# 2024-02-10T08:39:31.662 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.662 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0d1926f:::benchmark_data_smithi018_166993_object117183:head# 2024-02-10T08:39:31.662 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.663 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0d1a9d3:::benchmark_data_smithi018_166993_object89357:head# 2024-02-10T08:39:31.663 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.663 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0d2435e:::benchmark_data_smithi018_166993_object38804:head# 2024-02-10T08:39:31.663 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.663 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0d24e49:::benchmark_data_smithi018_166993_object117893:head# 2024-02-10T08:39:31.664 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.664 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0d4946d:::benchmark_data_smithi018_166993_object109177:head# 2024-02-10T08:39:31.664 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.664 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0d4b119:::benchmark_data_smithi018_166993_object77987:head# 2024-02-10T08:39:31.664 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.664 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0d4b75e:::benchmark_data_smithi018_166993_object80388:head# 2024-02-10T08:39:31.665 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.665 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0d57e84:::benchmark_data_smithi018_166993_object61266:head# 2024-02-10T08:39:31.665 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.666 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0d5b16e:::benchmark_data_smithi018_166993_object93257:head# 2024-02-10T08:39:31.666 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.666 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0d5ef7f:::benchmark_data_smithi018_166993_object94836:head# 2024-02-10T08:39:31.666 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.666 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0d5f925:::benchmark_data_smithi018_166993_object96818:head# 2024-02-10T08:39:31.666 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.666 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0d6ecdb:::benchmark_data_smithi018_166993_object53904:head# 2024-02-10T08:39:31.667 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.667 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0d7a152:::benchmark_data_smithi018_166993_object33432:head# 2024-02-10T08:39:31.667 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.667 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0d7dad9:::benchmark_data_smithi018_166993_object47321:head# 2024-02-10T08:39:31.667 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.668 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0d7f56b:::benchmark_data_smithi018_166993_object67893:head# 2024-02-10T08:39:31.668 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.668 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0d84264:::benchmark_data_smithi018_166993_object58183:head# 2024-02-10T08:39:31.668 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.668 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0d86c41:::benchmark_data_smithi018_166993_object101334:head# 2024-02-10T08:39:31.668 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.668 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0d8af77:::benchmark_data_smithi018_166993_object102990:head# 2024-02-10T08:39:31.668 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.668 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0de81ef:::benchmark_data_smithi018_166993_object27892:head# 2024-02-10T08:39:31.668 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.668 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0dec9fd:::benchmark_data_smithi018_166993_object47237:head# 2024-02-10T08:39:31.668 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.669 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0e12286:::benchmark_data_smithi018_166993_object97079:head# 2024-02-10T08:39:31.670 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.670 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0e13193:::benchmark_data_smithi018_166993_object79853:head# 2024-02-10T08:39:31.670 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.670 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0e17726:::benchmark_data_smithi018_166993_object97200:head# 2024-02-10T08:39:31.670 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.670 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0e23c58:::benchmark_data_smithi018_166993_object21551:head# 2024-02-10T08:39:31.670 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.670 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0e2a479:::benchmark_data_smithi018_166993_object82049:head# 2024-02-10T08:39:31.670 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.671 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0e2d7aa:::benchmark_data_smithi018_166993_object96302:head# 2024-02-10T08:39:31.671 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.671 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0e2fd42:::benchmark_data_smithi018_166993_object118659:head# 2024-02-10T08:39:31.671 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.671 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0e41c89:::benchmark_data_smithi018_166993_object42099:head# 2024-02-10T08:39:31.671 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.671 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0e495ae:::benchmark_data_smithi018_166993_object80209:head# 2024-02-10T08:39:31.671 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.671 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0e5465e:::benchmark_data_smithi018_166993_object36808:head# 2024-02-10T08:39:31.671 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.675 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0e5bcf9:::benchmark_data_smithi018_166993_object50982:head# 2024-02-10T08:39:31.675 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.675 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0e6d7ce:::benchmark_data_smithi018_166993_object72582:head# 2024-02-10T08:39:31.675 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.675 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0e71a60:::benchmark_data_smithi018_166993_object61550:head# 2024-02-10T08:39:31.675 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.675 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0e74f22:::benchmark_data_smithi018_166993_object118236:head# 2024-02-10T08:39:31.675 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.676 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0e90c40:::benchmark_data_smithi018_166993_object82221:head# 2024-02-10T08:39:31.676 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.676 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0e9204c:::benchmark_data_smithi018_166993_object44848:head# 2024-02-10T08:39:31.676 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.676 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0e9cbcf:::benchmark_data_smithi018_166993_object102684:head# 2024-02-10T08:39:31.676 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.677 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:31.678 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0e9d26c:::benchmark_data_smithi018_166993_object111069:head# 2024-02-10T08:39:31.678 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.678 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0eaafab:::benchmark_data_smithi018_166993_object69244:head# 2024-02-10T08:39:31.678 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.678 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0ebf079:::benchmark_data_smithi018_166993_object96880:head# 2024-02-10T08:39:31.678 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.678 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0ecd516:::benchmark_data_smithi018_166993_object51337:head# 2024-02-10T08:39:31.678 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.678 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0ece60a:::benchmark_data_smithi018_166993_object114086:head# 2024-02-10T08:39:31.678 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.678 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0edbf58:::benchmark_data_smithi018_166993_object93700:head# 2024-02-10T08:39:31.678 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.679 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0f00597:::benchmark_data_smithi018_166993_object82104:head# 2024-02-10T08:39:31.679 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.679 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0f1eacb:::benchmark_data_smithi018_166993_object65696:head# 2024-02-10T08:39:31.679 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.679 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0f24b44:::benchmark_data_smithi018_166993_object62872:head# 2024-02-10T08:39:31.679 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.681 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0f462cd:::benchmark_data_smithi018_166993_object113869:head# 2024-02-10T08:39:31.681 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.681 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0f4e695:::benchmark_data_smithi018_166993_object47847:head# 2024-02-10T08:39:31.681 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.681 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0f5656f:::benchmark_data_smithi018_166993_object104842:head# 2024-02-10T08:39:31.681 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.681 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0f57379:::benchmark_data_smithi018_166993_object67662:head# 2024-02-10T08:39:31.681 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.681 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0f57cae:::benchmark_data_smithi018_166993_object57554:head# 2024-02-10T08:39:31.681 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.682 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0f5e7c4:::benchmark_data_smithi018_166993_object106269:head# 2024-02-10T08:39:31.682 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.682 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0f615aa:::benchmark_data_smithi018_166993_object90349:head# 2024-02-10T08:39:31.682 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.683 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0f70099:::benchmark_data_smithi018_166993_object35501:head# 2024-02-10T08:39:31.683 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.683 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0f72e51:::benchmark_data_smithi018_166993_object66722:head# 2024-02-10T08:39:31.683 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.683 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0f7b82e:::benchmark_data_smithi018_166993_object77792:head# 2024-02-10T08:39:31.683 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.683 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0f7d01e:::benchmark_data_smithi018_166993_object34508:head# 2024-02-10T08:39:31.683 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.683 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0f89805:::benchmark_data_smithi018_166993_object68002:head# 2024-02-10T08:39:31.684 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.684 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0f99f7e:::benchmark_data_smithi018_166993_object18775:head# 2024-02-10T08:39:31.684 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.684 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0f9c542:::benchmark_data_smithi018_166993_object44510:head# 2024-02-10T08:39:31.684 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.684 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0f9e9da:::benchmark_data_smithi018_166993_object90900:head# 2024-02-10T08:39:31.684 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.685 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0f9f5cc:::benchmark_data_smithi018_166993_object90793:head# 2024-02-10T08:39:31.685 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.685 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0fbb055:::benchmark_data_smithi018_166993_object39705:head# 2024-02-10T08:39:31.685 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.685 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0fc1e3d:::benchmark_data_smithi018_166993_object45351:head# 2024-02-10T08:39:31.685 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.685 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0fc9bd0:::benchmark_data_smithi018_166993_object118975:head# 2024-02-10T08:39:31.686 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.686 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0fcabb5:::benchmark_data_smithi018_166993_object37703:head# 2024-02-10T08:39:31.686 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.686 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0fd44af:::benchmark_data_smithi018_166993_object58407:head# 2024-02-10T08:39:31.686 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.686 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0fdbd2e:::benchmark_data_smithi018_166993_object116348:head# 2024-02-10T08:39:31.686 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.686 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0fec220:::benchmark_data_smithi018_166993_object91492:head# 2024-02-10T08:39:31.686 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.687 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0ff51e5:::benchmark_data_smithi018_166993_object63501:head# 2024-02-10T08:39:31.687 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.687 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a0ffa916:::benchmark_data_smithi018_166993_object27588:head# 2024-02-10T08:39:31.687 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.687 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a100cc1e:::benchmark_data_smithi018_166993_object35548:head# 2024-02-10T08:39:31.687 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.687 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a10170a4:::benchmark_data_smithi018_166993_object49556:head# 2024-02-10T08:39:31.687 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.688 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a102be6b:::benchmark_data_smithi018_166993_object35422:head# 2024-02-10T08:39:31.688 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.688 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1049bb2:::benchmark_data_smithi018_166993_object86141:head# 2024-02-10T08:39:31.688 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.689 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a104c4a9:::benchmark_data_smithi018_166993_object40334:head# 2024-02-10T08:39:31.689 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.689 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a104d68d:::benchmark_data_smithi018_166993_object75234:head# 2024-02-10T08:39:31.689 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.689 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1053742:::benchmark_data_smithi018_166993_object99820:head# 2024-02-10T08:39:31.689 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.689 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a105a156:::benchmark_data_smithi018_166993_object107837:head# 2024-02-10T08:39:31.689 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.690 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a105c933:::benchmark_data_smithi018_166993_object47718:head# 2024-02-10T08:39:31.690 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.690 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1063812:::benchmark_data_smithi018_166993_object68049:head# 2024-02-10T08:39:31.690 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.693 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1066763:::benchmark_data_smithi018_166993_object115925:head# 2024-02-10T08:39:31.693 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.693 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1090915:::benchmark_data_smithi018_166993_object110053:head# 2024-02-10T08:39:31.693 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.693 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1091dc7:::benchmark_data_smithi018_166993_object32659:head# 2024-02-10T08:39:31.694 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.694 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a10951ab:::benchmark_data_smithi018_166993_object92358:head# 2024-02-10T08:39:31.694 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.694 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1095bb7:::benchmark_data_smithi018_166993_object26772:head# 2024-02-10T08:39:31.694 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.694 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a109ae3b:::benchmark_data_smithi018_166993_object19964:head# 2024-02-10T08:39:31.695 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.695 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a109c33e:::benchmark_data_smithi018_166993_object105289:head# 2024-02-10T08:39:31.695 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.695 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a10a5c1b:::benchmark_data_smithi018_166993_object116286:head# 2024-02-10T08:39:31.695 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.695 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a10b234c:::benchmark_data_smithi018_166993_object37949:head# 2024-02-10T08:39:31.695 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.695 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a10bd020:::benchmark_data_smithi018_166993_object63843:head# 2024-02-10T08:39:31.695 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.695 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a10c74eb:::benchmark_data_smithi018_166993_object45202:head# 2024-02-10T08:39:31.696 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.701 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a10cf6fd:::benchmark_data_smithi018_166993_object67228:head# 2024-02-10T08:39:31.701 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.701 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a10d3b31:::benchmark_data_smithi018_166993_object51900:head# 2024-02-10T08:39:31.701 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.701 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a10d934e:::benchmark_data_smithi018_166993_object32826:head# 2024-02-10T08:39:31.701 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.701 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a10e6cec:::benchmark_data_smithi018_166993_object26510:head# 2024-02-10T08:39:31.701 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.701 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a10f8bdc:::benchmark_data_smithi018_166993_object61717:head# 2024-02-10T08:39:31.701 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.701 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a10fa740:::benchmark_data_smithi018_166993_object20195:head# 2024-02-10T08:39:31.701 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.701 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a110990a:::benchmark_data_smithi018_166993_object112567:head# 2024-02-10T08:39:31.701 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.702 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a110cf84:::benchmark_data_smithi018_166993_object93998:head# 2024-02-10T08:39:31.702 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.702 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1110c75:::benchmark_data_smithi018_166993_object58497:head# 2024-02-10T08:39:31.702 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.702 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a11150e8:::benchmark_data_smithi018_166993_object56563:head# 2024-02-10T08:39:31.702 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.702 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a111c986:::benchmark_data_smithi018_166993_object116171:head# 2024-02-10T08:39:31.702 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.702 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a111f3bd:::benchmark_data_smithi018_166993_object104990:head# 2024-02-10T08:39:31.702 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.702 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a11350b3:::benchmark_data_smithi018_166993_object101317:head# 2024-02-10T08:39:31.702 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.702 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1137a47:::benchmark_data_smithi018_166993_object36899:head# 2024-02-10T08:39:31.702 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.702 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1142190:::benchmark_data_smithi018_166993_object96318:head# 2024-02-10T08:39:31.702 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.702 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a114682d:::benchmark_data_smithi018_166993_object27277:head# 2024-02-10T08:39:31.703 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.704 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a11475c2:::benchmark_data_smithi018_166993_object64763:head# 2024-02-10T08:39:31.704 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.704 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a114cc92:::benchmark_data_smithi018_166993_object31074:head# 2024-02-10T08:39:31.704 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.704 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a11594a4:::benchmark_data_smithi018_166993_object49412:head# 2024-02-10T08:39:31.704 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.704 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a115ab6b:::benchmark_data_smithi018_166993_object93827:head# 2024-02-10T08:39:31.704 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.704 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1186267:::benchmark_data_smithi018_166993_object112845:head# 2024-02-10T08:39:31.704 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.705 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a11acb76:::benchmark_data_smithi018_166993_object19127:head# 2024-02-10T08:39:31.705 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.705 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a11d1030:::benchmark_data_smithi018_166993_object37708:head# 2024-02-10T08:39:31.705 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.705 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a11dff6b:::benchmark_data_smithi018_166993_object51980:head# 2024-02-10T08:39:31.705 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.705 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a11e0df2:::benchmark_data_smithi018_166993_object90057:head# 2024-02-10T08:39:31.705 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.705 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a11e12e3:::benchmark_data_smithi018_166993_object32441:head# 2024-02-10T08:39:31.705 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.705 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a11f0d6e:::benchmark_data_smithi018_166993_object86269:head# 2024-02-10T08:39:31.705 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.707 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a11f3ef7:::benchmark_data_smithi018_166993_object42531:head# 2024-02-10T08:39:31.707 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.707 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a11f5efc:::benchmark_data_smithi018_166993_object56049:head# 2024-02-10T08:39:31.707 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.707 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a11fe14b:::benchmark_data_smithi018_166993_object54717:head# 2024-02-10T08:39:31.707 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.707 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a11ffa57:::benchmark_data_smithi018_166993_object94211:head# 2024-02-10T08:39:31.707 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.707 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1200900:::benchmark_data_smithi018_166993_object69317:head# 2024-02-10T08:39:31.707 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.707 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a121b72f:::benchmark_data_smithi018_166993_object106339:head# 2024-02-10T08:39:31.708 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.708 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1220e2a:::benchmark_data_smithi018_166993_object93142:head# 2024-02-10T08:39:31.708 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.708 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1228ae6:::benchmark_data_smithi018_166993_object55151:head# 2024-02-10T08:39:31.708 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.708 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a122a91d:::benchmark_data_smithi018_166993_object39114:head# 2024-02-10T08:39:31.708 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.708 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a122aee2:::benchmark_data_smithi018_166993_object37873:head# 2024-02-10T08:39:31.708 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.708 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a122b661:::benchmark_data_smithi018_166993_object114997:head# 2024-02-10T08:39:31.708 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.711 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1233766:::benchmark_data_smithi018_166993_object76114:head# 2024-02-10T08:39:31.711 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.711 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a123b638:::benchmark_data_smithi018_166993_object76369:head# 2024-02-10T08:39:31.711 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.711 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1245afa:::benchmark_data_smithi018_166993_object96545:head# 2024-02-10T08:39:31.711 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.711 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1247fd3:::benchmark_data_smithi018_166993_object32347:head# 2024-02-10T08:39:31.711 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.711 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a12494af:::benchmark_data_smithi018_166993_object55369:head# 2024-02-10T08:39:31.711 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.712 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1250662:::benchmark_data_smithi018_166993_object44910:head# 2024-02-10T08:39:31.712 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.712 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a125e132:::benchmark_data_smithi018_166993_object104972:head# 2024-02-10T08:39:31.712 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.712 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a12705a0:::benchmark_data_smithi018_166993_object102546:head# 2024-02-10T08:39:31.712 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.712 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1278618:::benchmark_data_smithi018_166993_object27611:head# 2024-02-10T08:39:31.712 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.712 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1298461:::benchmark_data_smithi018_166993_object59653:head# 2024-02-10T08:39:31.712 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.712 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a129d231:::benchmark_data_smithi018_166993_object51063:head# 2024-02-10T08:39:31.712 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.712 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a129d2a4:::benchmark_data_smithi018_166993_object65967:head# 2024-02-10T08:39:31.713 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.713 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a129eddf:::benchmark_data_smithi018_166993_object31725:head# 2024-02-10T08:39:31.713 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.713 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a12efb89:::benchmark_data_smithi018_166993_object72642:head# 2024-02-10T08:39:31.713 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.713 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a12f26eb:::benchmark_data_smithi018_166993_object43050:head# 2024-02-10T08:39:31.713 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.723 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1302901:::benchmark_data_smithi018_166993_object51920:head# 2024-02-10T08:39:31.723 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.723 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a130e1b9:::benchmark_data_smithi018_166993_object109750:head# 2024-02-10T08:39:31.723 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.723 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a13138a6:::benchmark_data_smithi018_166993_object91235:head# 2024-02-10T08:39:31.723 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.723 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a131859c:::benchmark_data_smithi018_166993_object23220:head# 2024-02-10T08:39:31.723 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.723 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a133187d:::benchmark_data_smithi018_166993_object84485:head# 2024-02-10T08:39:31.723 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.723 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a13433ba:::benchmark_data_smithi018_166993_object49213:head# 2024-02-10T08:39:31.723 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.723 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1358083:::benchmark_data_smithi018_166993_object97247:head# 2024-02-10T08:39:31.723 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.723 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1359309:::benchmark_data_smithi018_166993_object102977:head# 2024-02-10T08:39:31.724 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.724 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a136e83e:::benchmark_data_smithi018_166993_object108075:head# 2024-02-10T08:39:31.724 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.724 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1375630:::benchmark_data_smithi018_166993_object100027:head# 2024-02-10T08:39:31.724 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.724 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1391d1b:::benchmark_data_smithi018_166993_object94011:head# 2024-02-10T08:39:31.724 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.724 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a13961ad:::benchmark_data_smithi018_166993_object82649:head# 2024-02-10T08:39:31.724 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.724 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1399ffe:::benchmark_data_smithi018_166993_object44190:head# 2024-02-10T08:39:31.724 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.724 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a13b46d7:::benchmark_data_smithi018_166993_object33895:head# 2024-02-10T08:39:31.724 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.724 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a13bb2bf:::benchmark_data_smithi018_166993_object42214:head# 2024-02-10T08:39:31.724 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.725 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a13be835:::benchmark_data_smithi018_166993_object49140:head# 2024-02-10T08:39:31.725 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.725 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a13d3e07:::benchmark_data_smithi018_166993_object53700:head# 2024-02-10T08:39:31.725 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.725 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a13d7d07:::benchmark_data_smithi018_166993_object52411:head# 2024-02-10T08:39:31.725 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.725 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a13d7f47:::benchmark_data_smithi018_166993_object66168:head# 2024-02-10T08:39:31.725 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.725 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a13d912c:::benchmark_data_smithi018_166993_object108662:head# 2024-02-10T08:39:31.725 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.725 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a13e47fc:::benchmark_data_smithi018_166993_object79675:head# 2024-02-10T08:39:31.725 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.725 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a13e61c4:::benchmark_data_smithi018_166993_object106911:head# 2024-02-10T08:39:31.725 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.725 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a13fa386:::benchmark_data_smithi018_166993_object79746:head# 2024-02-10T08:39:31.725 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.726 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a13fc757:::benchmark_data_smithi018_166993_object45378:head# 2024-02-10T08:39:31.726 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.726 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a13ffcf1:::benchmark_data_smithi018_166993_object27908:head# 2024-02-10T08:39:31.727 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.727 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a140e639:::benchmark_data_smithi018_166993_object23715:head# 2024-02-10T08:39:31.727 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.727 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1435f0e:::benchmark_data_smithi018_166993_object96998:head# 2024-02-10T08:39:31.727 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.727 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a144d20a:::benchmark_data_smithi018_166993_object76263:head# 2024-02-10T08:39:31.727 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.727 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a144e7ff:::benchmark_data_smithi018_166993_object20228:head# 2024-02-10T08:39:31.727 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.728 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a145359e:::benchmark_data_smithi018_166993_object89616:head# 2024-02-10T08:39:31.729 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.729 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a145b243:::benchmark_data_smithi018_166993_object61197:head# 2024-02-10T08:39:31.729 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.729 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a145c8d5:::benchmark_data_smithi018_166993_object111904:head# 2024-02-10T08:39:31.729 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.729 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a145d9c3:::benchmark_data_smithi018_166993_object45214:head# 2024-02-10T08:39:31.729 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.729 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a146ee43:::benchmark_data_smithi018_166993_object61617:head# 2024-02-10T08:39:31.729 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.729 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a146f015:::benchmark_data_smithi018_166993_object70820:head# 2024-02-10T08:39:31.729 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.729 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1479d04:::benchmark_data_smithi018_166993_object58660:head# 2024-02-10T08:39:31.729 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.729 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1480d1f:::benchmark_data_smithi018_166993_object48490:head# 2024-02-10T08:39:31.729 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.730 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1496fd6:::benchmark_data_smithi018_166993_object113528:head# 2024-02-10T08:39:31.730 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.730 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a149bf92:::benchmark_data_smithi018_166993_object23516:head# 2024-02-10T08:39:31.730 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.730 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a149fce8:::benchmark_data_smithi018_166993_object51985:head# 2024-02-10T08:39:31.730 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.730 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a14a4cf9:::benchmark_data_smithi018_166993_object68877:head# 2024-02-10T08:39:31.730 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.733 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a14a93b3:::benchmark_data_smithi018_166993_object84210:head# 2024-02-10T08:39:31.733 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.733 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a14bccc0:::benchmark_data_smithi018_166993_object21417:head# 2024-02-10T08:39:31.733 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.737 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a14d4d8d:::benchmark_data_smithi018_166993_object117993:head# 2024-02-10T08:39:31.737 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.737 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a14d94ca:::benchmark_data_smithi018_166993_object26658:head# 2024-02-10T08:39:31.737 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.737 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a14deee9:::benchmark_data_smithi018_166993_object33090:head# 2024-02-10T08:39:31.737 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.737 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a150965c:::benchmark_data_smithi018_166993_object110916:head# 2024-02-10T08:39:31.737 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.737 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a15125da:::benchmark_data_smithi018_166993_object80942:head# 2024-02-10T08:39:31.737 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.737 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a152889d:::benchmark_data_smithi018_166993_object80509:head# 2024-02-10T08:39:31.737 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.737 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a152ae92:::benchmark_data_smithi018_166993_object88261:head# 2024-02-10T08:39:31.737 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.738 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1530f52:::benchmark_data_smithi018_166993_object20690:head# 2024-02-10T08:39:31.738 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.738 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a153f7b7:::benchmark_data_smithi018_166993_object41285:head# 2024-02-10T08:39:31.738 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.738 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1550a21:::benchmark_data_smithi018_166993_object56635:head# 2024-02-10T08:39:31.738 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.738 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1551730:::benchmark_data_smithi018_166993_object43849:head# 2024-02-10T08:39:31.738 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.739 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a155444a:::benchmark_data_smithi018_166993_object102576:head# 2024-02-10T08:39:31.739 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.739 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a15571f6:::benchmark_data_smithi018_166993_object116671:head# 2024-02-10T08:39:31.739 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.739 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a15623f8:::benchmark_data_smithi018_166993_object74436:head# 2024-02-10T08:39:31.739 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.739 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a156d848:::benchmark_data_smithi018_166993_object19808:head# 2024-02-10T08:39:31.739 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.740 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a157204c:::benchmark_data_smithi018_166993_object64662:head# 2024-02-10T08:39:31.740 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.740 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a15773c2:::benchmark_data_smithi018_166993_object118675:head# 2024-02-10T08:39:31.740 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.741 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a15790f6:::benchmark_data_smithi018_166993_object23750:head# 2024-02-10T08:39:31.741 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.741 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a15857eb:::benchmark_data_smithi018_166993_object77397:head# 2024-02-10T08:39:31.742 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.742 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a159129d:::benchmark_data_smithi018_166993_object114760:head# 2024-02-10T08:39:31.742 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.742 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a15930a2:::benchmark_data_smithi018_166993_object111633:head# 2024-02-10T08:39:31.742 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.742 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a159e6ac:::benchmark_data_smithi018_166993_object109842:head# 2024-02-10T08:39:31.742 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.742 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a15a3f77:::benchmark_data_smithi018_166993_object87533:head# 2024-02-10T08:39:31.742 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.742 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a15c234e:::benchmark_data_smithi018_166993_object99432:head# 2024-02-10T08:39:31.742 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.742 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a15ca0e4:::benchmark_data_smithi018_166993_object72979:head# 2024-02-10T08:39:31.742 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.742 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a15e9672:::benchmark_data_smithi018_166993_object41372:head# 2024-02-10T08:39:31.743 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.743 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a15eb0cf:::benchmark_data_smithi018_166993_object70529:head# 2024-02-10T08:39:31.743 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.744 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a15f4473:::benchmark_data_smithi018_166993_object55503:head# 2024-02-10T08:39:31.744 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.744 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a15fc539:::benchmark_data_smithi018_166993_object36274:head# 2024-02-10T08:39:31.744 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.744 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a15fd1e3:::benchmark_data_smithi018_166993_object106260:head# 2024-02-10T08:39:31.744 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.744 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a15fd309:::benchmark_data_smithi018_166993_object62321:head# 2024-02-10T08:39:31.744 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.744 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a160ea12:::benchmark_data_smithi018_166993_object62569:head# 2024-02-10T08:39:31.744 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.745 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1615eef:::benchmark_data_smithi018_166993_object57130:head# 2024-02-10T08:39:31.745 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.745 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a162c84c:::benchmark_data_smithi018_166993_object37247:head# 2024-02-10T08:39:31.745 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.745 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1634634:::benchmark_data_smithi018_166993_object23357:head# 2024-02-10T08:39:31.745 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.745 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a16364ec:::benchmark_data_smithi018_166993_object108418:head# 2024-02-10T08:39:31.745 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.745 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a16412df:::benchmark_data_smithi018_166993_object21337:head# 2024-02-10T08:39:31.745 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.747 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a165283d:::benchmark_data_smithi018_166993_object97766:head# 2024-02-10T08:39:31.747 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.747 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1657e33:::benchmark_data_smithi018_166993_object54945:head# 2024-02-10T08:39:31.747 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.747 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a165841b:::benchmark_data_smithi018_166993_object52521:head# 2024-02-10T08:39:31.747 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.747 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a16588a6:::benchmark_data_smithi018_166993_object91373:head# 2024-02-10T08:39:31.747 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.747 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1659fd3:::benchmark_data_smithi018_166993_object26100:head# 2024-02-10T08:39:31.747 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.747 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a165f143:::benchmark_data_smithi018_166993_object86693:head# 2024-02-10T08:39:31.747 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.748 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a167b14f:::benchmark_data_smithi018_166993_object30403:head# 2024-02-10T08:39:31.748 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.748 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a16948dd:::benchmark_data_smithi018_166993_object106957:head# 2024-02-10T08:39:31.748 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.748 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a169607f:::benchmark_data_smithi018_166993_object72688:head# 2024-02-10T08:39:31.748 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.749 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a16962ca:::benchmark_data_smithi018_166993_object71066:head# 2024-02-10T08:39:31.749 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.749 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a16af627:::benchmark_data_smithi018_166993_object52179:head# 2024-02-10T08:39:31.749 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.749 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a16b34ca:::benchmark_data_smithi018_166993_object110659:head# 2024-02-10T08:39:31.749 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.752 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a16c0bca:::benchmark_data_smithi018_166993_object31326:head# 2024-02-10T08:39:31.752 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.752 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a16c8840:::benchmark_data_smithi018_166993_object94248:head# 2024-02-10T08:39:31.752 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.761 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a16f2559:::benchmark_data_smithi018_166993_object118795:head# 2024-02-10T08:39:31.761 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.762 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a16f5ba4:::benchmark_data_smithi018_166993_object92428:head# 2024-02-10T08:39:31.762 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.762 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a16fa5d8:::benchmark_data_smithi018_166993_object102080:head# 2024-02-10T08:39:31.762 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.763 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a170e1b2:::benchmark_data_smithi018_166993_object97204:head# 2024-02-10T08:39:31.763 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.763 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1717139:::benchmark_data_smithi018_166993_object71788:head# 2024-02-10T08:39:31.763 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.764 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1726d1b:::benchmark_data_smithi018_166993_object34832:head# 2024-02-10T08:39:31.764 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.764 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a172b72c:::benchmark_data_smithi018_166993_object99714:head# 2024-02-10T08:39:31.764 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.769 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a172c344:::benchmark_data_smithi018_166993_object55404:head# 2024-02-10T08:39:31.769 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.773 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a173ec36:::benchmark_data_smithi018_166993_object99259:head# 2024-02-10T08:39:31.773 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.775 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a17429a3:::benchmark_data_smithi018_166993_object18347:head# 2024-02-10T08:39:31.775 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.777 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1742eaf:::benchmark_data_smithi018_166993_object38798:head# 2024-02-10T08:39:31.778 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.778 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1744e3e:::benchmark_data_smithi018_166993_object94031:head# 2024-02-10T08:39:31.778 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.778 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a174f6a2:::benchmark_data_smithi018_166993_object28829:head# 2024-02-10T08:39:31.778 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.779 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a17557f2:::benchmark_data_smithi018_166993_object88381:head# 2024-02-10T08:39:31.780 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.780 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1760704:::benchmark_data_smithi018_166993_object63074:head# 2024-02-10T08:39:31.780 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.780 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1773852:::benchmark_data_smithi018_166993_object60874:head# 2024-02-10T08:39:31.780 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.780 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a178048c:::benchmark_data_smithi018_166993_object117780:head# 2024-02-10T08:39:31.780 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.780 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a178f4db:::benchmark_data_smithi018_166993_object59724:head# 2024-02-10T08:39:31.780 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.780 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1791ee6:::benchmark_data_smithi018_166993_object71845:head# 2024-02-10T08:39:31.780 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.782 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1792151:::benchmark_data_smithi018_166993_object80588:head# 2024-02-10T08:39:31.782 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.782 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a17c2849:::benchmark_data_smithi018_166993_object73609:head# 2024-02-10T08:39:31.782 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.782 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a17c8e78:::benchmark_data_smithi018_166993_object56377:head# 2024-02-10T08:39:31.782 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.782 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a17d102c:::benchmark_data_smithi018_166993_object94487:head# 2024-02-10T08:39:31.783 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.783 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a17ed60a:::benchmark_data_smithi018_166993_object112431:head# 2024-02-10T08:39:31.783 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.783 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a17f008c:::benchmark_data_smithi018_166993_object46500:head# 2024-02-10T08:39:31.783 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.783 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a17f2775:::benchmark_data_smithi018_166993_object31028:head# 2024-02-10T08:39:31.783 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.783 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a17f493b:::benchmark_data_smithi018_166993_object101797:head# 2024-02-10T08:39:31.783 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.783 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a17f534b:::benchmark_data_smithi018_166993_object47386:head# 2024-02-10T08:39:31.783 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.783 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a181129a:::benchmark_data_smithi018_166993_object116856:head# 2024-02-10T08:39:31.783 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.787 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a18361a4:::benchmark_data_smithi018_166993_object27685:head# 2024-02-10T08:39:31.787 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.787 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a18412e2:::benchmark_data_smithi018_166993_object94259:head# 2024-02-10T08:39:31.787 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.787 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1856453:::benchmark_data_smithi018_166993_object31205:head# 2024-02-10T08:39:31.787 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.787 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1870bab:::benchmark_data_smithi018_166993_object33054:head# 2024-02-10T08:39:31.787 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.787 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a18777a6:::benchmark_data_smithi018_166993_object52744:head# 2024-02-10T08:39:31.787 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.787 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1888698:::benchmark_data_smithi018_166993_object116533:head# 2024-02-10T08:39:31.787 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.788 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a188dcdb:::benchmark_data_smithi018_166993_object21322:head# 2024-02-10T08:39:31.788 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.788 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a189ed98:::benchmark_data_smithi018_166993_object105580:head# 2024-02-10T08:39:31.788 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.788 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a18a4fe1:::benchmark_data_smithi018_166993_object59072:head# 2024-02-10T08:39:31.788 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.788 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a18a6ec7:::benchmark_data_smithi018_166993_object115832:head# 2024-02-10T08:39:31.788 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.788 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a18ab1bc:::benchmark_data_smithi018_166993_object105833:head# 2024-02-10T08:39:31.788 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.788 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a18b8029:::benchmark_data_smithi018_166993_object94371:head# 2024-02-10T08:39:31.788 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.788 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a18be4ef:::benchmark_data_smithi018_166993_object99546:head# 2024-02-10T08:39:31.789 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.789 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a18c6715:::benchmark_data_smithi018_166993_object114763:head# 2024-02-10T08:39:31.789 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.789 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a18c7445:::benchmark_data_smithi018_166993_object103673:head# 2024-02-10T08:39:31.789 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.789 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a18cec0f:::benchmark_data_smithi018_166993_object42123:head# 2024-02-10T08:39:31.789 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.789 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a18d8417:::benchmark_data_smithi018_166993_object61732:head# 2024-02-10T08:39:31.789 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.789 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a18eada0:::benchmark_data_smithi018_166993_object25997:head# 2024-02-10T08:39:31.789 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.791 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a18ed449:::benchmark_data_smithi018_166993_object100298:head# 2024-02-10T08:39:31.791 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.791 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a18ed4dc:::benchmark_data_smithi018_166993_object65277:head# 2024-02-10T08:39:31.791 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.791 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a18f0ead:::benchmark_data_smithi018_166993_object30332:head# 2024-02-10T08:39:31.791 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.794 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a18f7140:::benchmark_data_smithi018_166993_object30502:head# 2024-02-10T08:39:31.794 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.794 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a18fc33c:::benchmark_data_smithi018_166993_object106305:head# 2024-02-10T08:39:31.794 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.794 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a19092a5:::benchmark_data_smithi018_166993_object91165:head# 2024-02-10T08:39:31.794 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.794 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a191f779:::benchmark_data_smithi018_166993_object66919:head# 2024-02-10T08:39:31.795 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.795 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1927796:::benchmark_data_smithi018_166993_object20644:head# 2024-02-10T08:39:31.795 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.795 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1930b3f:::benchmark_data_smithi018_166993_object92262:head# 2024-02-10T08:39:31.795 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.795 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1939292:::benchmark_data_smithi018_166993_object116245:head# 2024-02-10T08:39:31.795 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.795 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a193a150:::benchmark_data_smithi018_166993_object66706:head# 2024-02-10T08:39:31.795 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.795 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a193c2bf:::benchmark_data_smithi018_166993_object71004:head# 2024-02-10T08:39:31.795 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.795 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a194052a:::benchmark_data_smithi018_166993_object30232:head# 2024-02-10T08:39:31.795 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.795 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1945254:::benchmark_data_smithi018_166993_object107887:head# 2024-02-10T08:39:31.796 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.796 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a197fe2d:::benchmark_data_smithi018_166993_object79456:head# 2024-02-10T08:39:31.796 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.799 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1983d02:::benchmark_data_smithi018_166993_object42298:head# 2024-02-10T08:39:31.799 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.799 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a198fc2b:::benchmark_data_smithi018_166993_object118982:head# 2024-02-10T08:39:31.799 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.799 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a199f062:::benchmark_data_smithi018_166993_object34794:head# 2024-02-10T08:39:31.800 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.800 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a199f44c:::benchmark_data_smithi018_166993_object107400:head# 2024-02-10T08:39:31.800 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.800 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a19af899:::benchmark_data_smithi018_166993_object78014:head# 2024-02-10T08:39:31.800 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.800 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a19b57ee:::benchmark_data_smithi018_166993_object69242:head# 2024-02-10T08:39:31.800 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.800 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a19b96da:::benchmark_data_smithi018_166993_object19530:head# 2024-02-10T08:39:31.800 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.800 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a19c39cd:::benchmark_data_smithi018_166993_object78391:head# 2024-02-10T08:39:31.800 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.800 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a19c7561:::benchmark_data_smithi018_166993_object96878:head# 2024-02-10T08:39:31.800 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.800 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a19d63e2:::benchmark_data_smithi018_166993_object78991:head# 2024-02-10T08:39:31.801 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.801 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a19ff37e:::benchmark_data_smithi018_166993_object107757:head# 2024-02-10T08:39:31.801 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.801 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1a01ad0:::benchmark_data_smithi018_166993_object83188:head# 2024-02-10T08:39:31.801 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.801 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1a09689:::benchmark_data_smithi018_166993_object106850:head# 2024-02-10T08:39:31.801 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.801 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1a20b61:::benchmark_data_smithi018_166993_object41102:head# 2024-02-10T08:39:31.801 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.801 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1a3a45f:::benchmark_data_smithi018_166993_object93410:head# 2024-02-10T08:39:31.801 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.801 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1a3f22a:::benchmark_data_smithi018_166993_object111479:head# 2024-02-10T08:39:31.801 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.801 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1a4019d:::benchmark_data_smithi018_166993_object110690:head# 2024-02-10T08:39:31.801 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.802 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1a52651:::benchmark_data_smithi018_166993_object45560:head# 2024-02-10T08:39:31.802 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.802 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1a588b2:::benchmark_data_smithi018_166993_object58438:head# 2024-02-10T08:39:31.802 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.802 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1a59a7e:::benchmark_data_smithi018_166993_object26589:head# 2024-02-10T08:39:31.802 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.803 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1a76c00:::benchmark_data_smithi018_166993_object39372:head# 2024-02-10T08:39:31.803 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.803 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1a76c6b:::benchmark_data_smithi018_166993_object23522:head# 2024-02-10T08:39:31.803 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.804 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1a78635:::benchmark_data_smithi018_166993_object48647:head# 2024-02-10T08:39:31.804 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.804 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1a92afd:::benchmark_data_smithi018_166993_object95122:head# 2024-02-10T08:39:31.804 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.804 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1a9bd79:::benchmark_data_smithi018_166993_object94056:head# 2024-02-10T08:39:31.804 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.804 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1a9c778:::benchmark_data_smithi018_166993_object100016:head# 2024-02-10T08:39:31.804 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.804 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1aaba03:::benchmark_data_smithi018_166993_object58015:head# 2024-02-10T08:39:31.804 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.804 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1abf7f3:::benchmark_data_smithi018_166993_object64844:head# 2024-02-10T08:39:31.804 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.808 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1ac9c68:::benchmark_data_smithi018_166993_object62477:head# 2024-02-10T08:39:31.809 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.809 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1ad3ab1:::benchmark_data_smithi018_166993_object31971:head# 2024-02-10T08:39:31.809 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.809 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1ad82c3:::benchmark_data_smithi018_166993_object38174:head# 2024-02-10T08:39:31.809 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.809 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1ade9eb:::benchmark_data_smithi018_166993_object110365:head# 2024-02-10T08:39:31.809 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.809 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1adfb49:::benchmark_data_smithi018_166993_object69590:head# 2024-02-10T08:39:31.809 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.809 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1ae6285:::benchmark_data_smithi018_166993_object38430:head# 2024-02-10T08:39:31.809 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.809 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1af20da:::benchmark_data_smithi018_166993_object102927:head# 2024-02-10T08:39:31.809 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.810 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1afe746:::benchmark_data_smithi018_166993_object67910:head# 2024-02-10T08:39:31.810 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.810 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1b01cac:::benchmark_data_smithi018_166993_object66648:head# 2024-02-10T08:39:31.810 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.810 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1b035a6:::benchmark_data_smithi018_166993_object49228:head# 2024-02-10T08:39:31.810 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.810 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1b06275:::benchmark_data_smithi018_166993_object92308:head# 2024-02-10T08:39:31.810 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.810 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1b06eab:::benchmark_data_smithi018_166993_object114575:head# 2024-02-10T08:39:31.810 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.812 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1b09fbf:::benchmark_data_smithi018_166993_object79474:head# 2024-02-10T08:39:31.813 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.813 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1b17967:::benchmark_data_smithi018_166993_object29491:head# 2024-02-10T08:39:31.813 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.813 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1b23d42:::benchmark_data_smithi018_166993_object94513:head# 2024-02-10T08:39:31.813 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.813 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1b2501f:::benchmark_data_smithi018_166993_object17857:head# 2024-02-10T08:39:31.813 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.813 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1b2b77d:::benchmark_data_smithi018_166993_object26208:head# 2024-02-10T08:39:31.813 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.813 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1b32bf1:::benchmark_data_smithi018_166993_object43913:head# 2024-02-10T08:39:31.813 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.813 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1b3a948:::benchmark_data_smithi018_166993_object114265:head# 2024-02-10T08:39:31.813 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.814 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1b3e413:::benchmark_data_smithi018_166993_object65870:head# 2024-02-10T08:39:31.814 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.814 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1b43525:::benchmark_data_smithi018_166993_object41616:head# 2024-02-10T08:39:31.814 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.814 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1b5e9c9:::benchmark_data_smithi018_166993_object77606:head# 2024-02-10T08:39:31.814 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.814 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1b5fce8:::benchmark_data_smithi018_166993_object58467:head# 2024-02-10T08:39:31.814 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.814 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1b634f0:::benchmark_data_smithi018_166993_object73038:head# 2024-02-10T08:39:31.814 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.814 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1b66d81:::benchmark_data_smithi018_166993_object32602:head# 2024-02-10T08:39:31.814 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.814 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1b6e142:::benchmark_data_smithi018_166993_object117226:head# 2024-02-10T08:39:31.814 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.814 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1b75520:::benchmark_data_smithi018_166993_object22021:head# 2024-02-10T08:39:31.814 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.816 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1b918d2:::benchmark_data_smithi018_166993_object115061:head# 2024-02-10T08:39:31.816 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.817 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1b96aed:::benchmark_data_smithi018_166993_object55288:head# 2024-02-10T08:39:31.817 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.818 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1b972e2:::benchmark_data_smithi018_166993_object58899:head# 2024-02-10T08:39:31.819 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.819 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1b98757:::benchmark_data_smithi018_166993_object43415:head# 2024-02-10T08:39:31.819 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.819 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1bbe9f3:::benchmark_data_smithi018_166993_object75480:head# 2024-02-10T08:39:31.819 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.819 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1bc62f2:::benchmark_data_smithi018_166993_object118180:head# 2024-02-10T08:39:31.819 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.819 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1bcfc39:::benchmark_data_smithi018_166993_object95577:head# 2024-02-10T08:39:31.819 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.819 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1bd2c1e:::benchmark_data_smithi018_166993_object68171:head# 2024-02-10T08:39:31.819 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.819 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1be450a:::benchmark_data_smithi018_166993_object39196:head# 2024-02-10T08:39:31.819 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.820 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1bebd40:::benchmark_data_smithi018_166993_object19974:head# 2024-02-10T08:39:31.820 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.820 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1bf326d:::benchmark_data_smithi018_166993_object61196:head# 2024-02-10T08:39:31.820 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.822 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1bfa718:::benchmark_data_smithi018_166993_object106429:head# 2024-02-10T08:39:31.822 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.822 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1bfd544:::benchmark_data_smithi018_166993_object96224:head# 2024-02-10T08:39:31.822 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.822 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1bfe7b3:::benchmark_data_smithi018_166993_object109524:head# 2024-02-10T08:39:31.822 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.822 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1c012aa:::benchmark_data_smithi018_166993_object91924:head# 2024-02-10T08:39:31.822 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.823 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1c1cd10:::benchmark_data_smithi018_166993_object34114:head# 2024-02-10T08:39:31.823 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.823 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1c1e311:::benchmark_data_smithi018_166993_object36523:head# 2024-02-10T08:39:31.823 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.823 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1c2d94d:::benchmark_data_smithi018_166993_object28295:head# 2024-02-10T08:39:31.823 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.823 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1c4eec7:::benchmark_data_smithi018_166993_object98272:head# 2024-02-10T08:39:31.823 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.823 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1c5ee8e:::benchmark_data_smithi018_166993_object43351:head# 2024-02-10T08:39:31.823 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.823 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1c6f0d4:::benchmark_data_smithi018_166993_object51058:head# 2024-02-10T08:39:31.823 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.823 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1c7c3d7:::benchmark_data_smithi018_166993_object67293:head# 2024-02-10T08:39:31.823 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.823 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1c7cc64:::benchmark_data_smithi018_166993_object66924:head# 2024-02-10T08:39:31.824 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.824 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1c96169:::benchmark_data_smithi018_166993_object79366:head# 2024-02-10T08:39:31.825 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.825 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1c977b0:::benchmark_data_smithi018_166993_object49398:head# 2024-02-10T08:39:31.825 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.825 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1c98bf8:::benchmark_data_smithi018_166993_object56460:head# 2024-02-10T08:39:31.825 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.825 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1ca17d1:::benchmark_data_smithi018_166993_object117134:head# 2024-02-10T08:39:31.825 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.825 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1ca249a:::benchmark_data_smithi018_166993_object45441:head# 2024-02-10T08:39:31.825 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.826 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1cc48f3:::benchmark_data_smithi018_166993_object83645:head# 2024-02-10T08:39:31.826 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.826 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1ccbd6d:::benchmark_data_smithi018_166993_object21573:head# 2024-02-10T08:39:31.826 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.826 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1ce7ab6:::benchmark_data_smithi018_166993_object77310:head# 2024-02-10T08:39:31.827 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.827 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1ceaf93:::benchmark_data_smithi018_166993_object96844:head# 2024-02-10T08:39:31.827 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.827 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1cef1f5:::benchmark_data_smithi018_166993_object63620:head# 2024-02-10T08:39:31.827 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.827 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1cfac8f:::benchmark_data_smithi018_166993_object114994:head# 2024-02-10T08:39:31.827 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.828 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1d08e1e:::benchmark_data_smithi018_166993_object76009:head# 2024-02-10T08:39:31.828 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.828 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1d0aae1:::benchmark_data_smithi018_166993_object100662:head# 2024-02-10T08:39:31.828 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.828 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1d11f07:::benchmark_data_smithi018_166993_object116519:head# 2024-02-10T08:39:31.828 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.829 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1d1b3ed:::benchmark_data_smithi018_166993_object114123:head# 2024-02-10T08:39:31.829 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.830 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1d1edbf:::benchmark_data_smithi018_166993_object35784:head# 2024-02-10T08:39:31.830 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.830 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1d219cb:::benchmark_data_smithi018_166993_object39122:head# 2024-02-10T08:39:31.830 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.830 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1d2c75a:::benchmark_data_smithi018_166993_object104052:head# 2024-02-10T08:39:31.830 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.830 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1d4074b:::benchmark_data_smithi018_166993_object41438:head# 2024-02-10T08:39:31.830 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.833 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1d42966:::benchmark_data_smithi018_166993_object94742:head# 2024-02-10T08:39:31.833 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.833 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1d4a7ab:::benchmark_data_smithi018_166993_object84067:head# 2024-02-10T08:39:31.833 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.833 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1d54e7d:::benchmark_data_smithi018_166993_object102868:head# 2024-02-10T08:39:31.833 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.833 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1d6086a:::benchmark_data_smithi018_166993_object69897:head# 2024-02-10T08:39:31.833 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.834 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1d66dda:::benchmark_data_smithi018_166993_object42063:head# 2024-02-10T08:39:31.834 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.834 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1d748ef:::benchmark_data_smithi018_166993_object23457:head# 2024-02-10T08:39:31.834 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.834 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1d85f4b:::benchmark_data_smithi018_166993_object44408:head# 2024-02-10T08:39:31.834 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.834 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1d86cb8:::benchmark_data_smithi018_166993_object99527:head# 2024-02-10T08:39:31.834 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.834 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1d91790:::benchmark_data_smithi018_166993_object42579:head# 2024-02-10T08:39:31.834 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.834 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1d93f91:::benchmark_data_smithi018_166993_object90708:head# 2024-02-10T08:39:31.834 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.834 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1d9df9a:::benchmark_data_smithi018_166993_object60486:head# 2024-02-10T08:39:31.834 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.835 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1d9f10d:::benchmark_data_smithi018_166993_object76330:head# 2024-02-10T08:39:31.835 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.835 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1da8c2c:::benchmark_data_smithi018_166993_object41685:head# 2024-02-10T08:39:31.835 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.835 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1daf3b6:::benchmark_data_smithi018_166993_object83303:head# 2024-02-10T08:39:31.835 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.835 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1db8ca7:::benchmark_data_smithi018_166993_object88945:head# 2024-02-10T08:39:31.835 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.844 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1dce950:::benchmark_data_smithi018_166993_object81841:head# 2024-02-10T08:39:31.844 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.844 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1ddf89f:::benchmark_data_smithi018_166993_object105633:head# 2024-02-10T08:39:31.844 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.844 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1de12cf:::benchmark_data_smithi018_166993_object75922:head# 2024-02-10T08:39:31.844 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.845 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1dec93f:::benchmark_data_smithi018_166993_object81452:head# 2024-02-10T08:39:31.845 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.845 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1e187af:::benchmark_data_smithi018_166993_object48118:head# 2024-02-10T08:39:31.845 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.845 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1e1a4b5:::benchmark_data_smithi018_166993_object50799:head# 2024-02-10T08:39:31.845 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.845 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1e1d618:::benchmark_data_smithi018_166993_object76432:head# 2024-02-10T08:39:31.845 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.845 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1e3e1a0:::benchmark_data_smithi018_166993_object31095:head# 2024-02-10T08:39:31.845 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.845 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1e55316:::benchmark_data_smithi018_166993_object49613:head# 2024-02-10T08:39:31.845 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.845 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1e5dfc8:::benchmark_data_smithi018_166993_object46564:head# 2024-02-10T08:39:31.845 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.845 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1e5e25e:::benchmark_data_smithi018_166993_object95144:head# 2024-02-10T08:39:31.846 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.846 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1e64e96:::benchmark_data_smithi018_166993_object36260:head# 2024-02-10T08:39:31.846 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.846 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1e699ec:::benchmark_data_smithi018_166993_object36966:head# 2024-02-10T08:39:31.846 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.846 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1e73702:::benchmark_data_smithi018_166993_object34636:head# 2024-02-10T08:39:31.846 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.846 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1e7b303:::benchmark_data_smithi018_166993_object81300:head# 2024-02-10T08:39:31.846 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.846 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1e80a79:::benchmark_data_smithi018_166993_object76175:head# 2024-02-10T08:39:31.846 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.846 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1e891e1:::benchmark_data_smithi018_166993_object77354:head# 2024-02-10T08:39:31.846 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.846 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1e8a84b:::benchmark_data_smithi018_166993_object73732:head# 2024-02-10T08:39:31.846 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.847 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1e8bf84:::benchmark_data_smithi018_166993_object89479:head# 2024-02-10T08:39:31.847 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.847 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1e91894:::benchmark_data_smithi018_166993_object82935:head# 2024-02-10T08:39:31.847 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.847 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1e9f4c6:::benchmark_data_smithi018_166993_object31779:head# 2024-02-10T08:39:31.847 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.847 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1ea18c9:::benchmark_data_smithi018_166993_object34611:head# 2024-02-10T08:39:31.847 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.847 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1eb2e62:::benchmark_data_smithi018_166993_object51999:head# 2024-02-10T08:39:31.847 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.847 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1ebc495:::benchmark_data_smithi018_166993_object64099:head# 2024-02-10T08:39:31.847 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.847 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1ec04e8:::benchmark_data_smithi018_166993_object113976:head# 2024-02-10T08:39:31.847 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.848 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1ec2724:::benchmark_data_smithi018_166993_object25427:head# 2024-02-10T08:39:31.848 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.848 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1ec8ac8:::benchmark_data_smithi018_166993_object60747:head# 2024-02-10T08:39:31.848 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.848 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1ed8106:::benchmark_data_smithi018_166993_object117152:head# 2024-02-10T08:39:31.848 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.848 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1ee161d:::benchmark_data_smithi018_166993_object40678:head# 2024-02-10T08:39:31.848 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.848 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1eedc2b:::benchmark_data_smithi018_166993_object84662:head# 2024-02-10T08:39:31.848 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.848 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1ef0075:::benchmark_data_smithi018_166993_object113309:head# 2024-02-10T08:39:31.848 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.848 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1ef6958:::benchmark_data_smithi018_166993_object32483:head# 2024-02-10T08:39:31.848 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.849 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1efd2a6:::benchmark_data_smithi018_166993_object77811:head# 2024-02-10T08:39:31.849 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.849 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1f0ace3:::benchmark_data_smithi018_166993_object67712:head# 2024-02-10T08:39:31.849 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.849 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1f17304:::benchmark_data_smithi018_166993_object29167:head# 2024-02-10T08:39:31.849 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.849 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1f340a3:::benchmark_data_smithi018_166993_object34302:head# 2024-02-10T08:39:31.849 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.849 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1f4a219:::benchmark_data_smithi018_166993_object106966:head# 2024-02-10T08:39:31.849 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.850 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1f4d9d4:::benchmark_data_smithi018_166993_object63084:head# 2024-02-10T08:39:31.850 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.850 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1f507d2:::benchmark_data_smithi018_166993_object46253:head# 2024-02-10T08:39:31.850 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.850 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1f51283:::benchmark_data_smithi018_166993_object81065:head# 2024-02-10T08:39:31.850 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.850 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1f58898:::benchmark_data_smithi018_166993_object92943:head# 2024-02-10T08:39:31.850 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.850 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1f5cf6d:::benchmark_data_smithi018_166993_object78170:head# 2024-02-10T08:39:31.850 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.850 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1f63698:::benchmark_data_smithi018_166993_object27820:head# 2024-02-10T08:39:31.850 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.850 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1f66db9:::benchmark_data_smithi018_166993_object32074:head# 2024-02-10T08:39:31.850 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.850 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1f6737d:::benchmark_data_smithi018_166993_object118955:head# 2024-02-10T08:39:31.851 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.851 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1f76966:::benchmark_data_smithi018_166993_object24878:head# 2024-02-10T08:39:31.851 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.851 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1f868ea:::benchmark_data_smithi018_166993_object115839:head# 2024-02-10T08:39:31.851 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.851 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1f8b4d9:::benchmark_data_smithi018_166993_object88356:head# 2024-02-10T08:39:31.851 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.873 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1f9c416:::benchmark_data_smithi018_166993_object71028:head# 2024-02-10T08:39:31.873 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.873 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1fbcd87:::benchmark_data_smithi018_166993_object60786:head# 2024-02-10T08:39:31.874 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.874 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1fc1fbe:::benchmark_data_smithi018_166993_object44696:head# 2024-02-10T08:39:31.874 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.874 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1fcf2c2:::benchmark_data_smithi018_166993_object114855:head# 2024-02-10T08:39:31.874 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.874 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1fd1680:::benchmark_data_smithi018_166993_object55379:head# 2024-02-10T08:39:31.874 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.874 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1fd6fb7:::benchmark_data_smithi018_166993_object62265:head# 2024-02-10T08:39:31.874 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.874 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1fe62bb:::benchmark_data_smithi018_166993_object92425:head# 2024-02-10T08:39:31.874 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.874 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1feaa84:::benchmark_data_smithi018_166993_object37487:head# 2024-02-10T08:39:31.874 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.874 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a1ff3f09:::benchmark_data_smithi018_166993_object34188:head# 2024-02-10T08:39:31.875 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.875 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2001b67:::benchmark_data_smithi018_166993_object96815:head# 2024-02-10T08:39:31.875 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.875 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a201a673:::benchmark_data_smithi018_166993_object118573:head# 2024-02-10T08:39:31.875 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.875 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a20323b6:::benchmark_data_smithi018_166993_object18130:head# 2024-02-10T08:39:31.875 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.875 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2034ad4:::benchmark_data_smithi018_166993_object53561:head# 2024-02-10T08:39:31.875 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.875 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2036eb6:::benchmark_data_smithi018_166993_object24651:head# 2024-02-10T08:39:31.875 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.875 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2038810:::benchmark_data_smithi018_166993_object74149:head# 2024-02-10T08:39:31.875 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.875 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a203cce5:::benchmark_data_smithi018_166993_object46975:head# 2024-02-10T08:39:31.875 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.876 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2049cea:::benchmark_data_smithi018_166993_object81747:head# 2024-02-10T08:39:31.876 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.876 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2066532:::benchmark_data_smithi018_166993_object114004:head# 2024-02-10T08:39:31.876 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.876 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2068795:::benchmark_data_smithi018_166993_object117502:head# 2024-02-10T08:39:31.876 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.876 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a207cb83:::benchmark_data_smithi018_166993_object20338:head# 2024-02-10T08:39:31.876 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.876 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a207f6a2:::benchmark_data_smithi018_166993_object29655:head# 2024-02-10T08:39:31.876 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.876 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a209252f:::benchmark_data_smithi018_166993_object116969:head# 2024-02-10T08:39:31.876 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.876 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a209287b:::benchmark_data_smithi018_166993_object43248:head# 2024-02-10T08:39:31.876 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.877 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a20a8528:::benchmark_data_smithi018_166993_object74335:head# 2024-02-10T08:39:31.877 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.877 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a20ad27e:::benchmark_data_smithi018_166993_object35901:head# 2024-02-10T08:39:31.877 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.877 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a20b12f6:::benchmark_data_smithi018_166993_object60930:head# 2024-02-10T08:39:31.877 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.877 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a20b6026:::benchmark_data_smithi018_166993_object17596:head# 2024-02-10T08:39:31.877 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.877 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a20c2219:::benchmark_data_smithi018_166993_object67101:head# 2024-02-10T08:39:31.877 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.877 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a20c37ff:::benchmark_data_smithi018_166993_object74851:head# 2024-02-10T08:39:31.877 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.877 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a20d2b35:::benchmark_data_smithi018_166993_object95202:head# 2024-02-10T08:39:31.877 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.878 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a20ebcaa:::benchmark_data_smithi018_166993_object17820:head# 2024-02-10T08:39:31.878 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.878 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a20fe0e3:::benchmark_data_smithi018_166993_object30297:head# 2024-02-10T08:39:31.878 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.878 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a210df10:::benchmark_data_smithi018_166993_object53439:head# 2024-02-10T08:39:31.878 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.878 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a211a427:::benchmark_data_smithi018_166993_object103255:head# 2024-02-10T08:39:31.878 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.878 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a211cf1a:::benchmark_data_smithi018_166993_object36546:head# 2024-02-10T08:39:31.878 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.878 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2129a7f:::benchmark_data_smithi018_166993_object103421:head# 2024-02-10T08:39:31.878 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.878 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a21336ef:::benchmark_data_smithi018_166993_object85303:head# 2024-02-10T08:39:31.878 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.878 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a213da90:::benchmark_data_smithi018_166993_object45185:head# 2024-02-10T08:39:31.879 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.879 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a213e190:::benchmark_data_smithi018_166993_object64321:head# 2024-02-10T08:39:31.879 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.879 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a214956b:::benchmark_data_smithi018_166993_object106515:head# 2024-02-10T08:39:31.879 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.879 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2153df6:::benchmark_data_smithi018_166993_object42426:head# 2024-02-10T08:39:31.879 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.879 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2172a3f:::benchmark_data_smithi018_166993_object109829:head# 2024-02-10T08:39:31.879 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.879 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2176109:::benchmark_data_smithi018_166993_object53314:head# 2024-02-10T08:39:31.879 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.879 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2177ada:::benchmark_data_smithi018_166993_object80232:head# 2024-02-10T08:39:31.879 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.879 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a217d283:::benchmark_data_smithi018_166993_object44485:head# 2024-02-10T08:39:31.880 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.880 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2180e95:::benchmark_data_smithi018_166993_object115900:head# 2024-02-10T08:39:31.880 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.880 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a218554f:::benchmark_data_smithi018_166993_object37449:head# 2024-02-10T08:39:31.880 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.880 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a21887e8:::benchmark_data_smithi018_166993_object33961:head# 2024-02-10T08:39:31.880 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.880 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a218b079:::benchmark_data_smithi018_166993_object49319:head# 2024-02-10T08:39:31.880 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.880 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a219261c:::benchmark_data_smithi018_166993_object108433:head# 2024-02-10T08:39:31.880 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.880 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a21a0564:::benchmark_data_smithi018_166993_object110675:head# 2024-02-10T08:39:31.880 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.880 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a21a177d:::benchmark_data_smithi018_166993_object64723:head# 2024-02-10T08:39:31.880 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.881 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a21ab569:::benchmark_data_smithi018_166993_object38363:head# 2024-02-10T08:39:31.881 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.881 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a21b08a3:::benchmark_data_smithi018_166993_object89234:head# 2024-02-10T08:39:31.881 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.881 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a21b1f1c:::benchmark_data_smithi018_166993_object69239:head# 2024-02-10T08:39:31.881 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.881 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a21bc017:::benchmark_data_smithi018_166993_object64619:head# 2024-02-10T08:39:31.881 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.881 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a21bdf5c:::benchmark_data_smithi018_166993_object28087:head# 2024-02-10T08:39:31.881 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.881 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a21d0d4d:::benchmark_data_smithi018_166993_object34390:head# 2024-02-10T08:39:31.881 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.881 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a21dc2d4:::benchmark_data_smithi018_166993_object101085:head# 2024-02-10T08:39:31.881 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.881 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a21e0368:::benchmark_data_smithi018_166993_object87891:head# 2024-02-10T08:39:31.881 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.882 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a21f4f85:::benchmark_data_smithi018_166993_object94182:head# 2024-02-10T08:39:31.882 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.882 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2212d19:::benchmark_data_smithi018_166993_object48888:head# 2024-02-10T08:39:31.882 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.882 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2215643:::benchmark_data_smithi018_166993_object39652:head# 2024-02-10T08:39:31.882 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.882 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a221d664:::benchmark_data_smithi018_166993_object57260:head# 2024-02-10T08:39:31.882 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.882 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a221e05b:::benchmark_data_smithi018_166993_object98628:head# 2024-02-10T08:39:31.882 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.882 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2229f6f:::benchmark_data_smithi018_166993_object24785:head# 2024-02-10T08:39:31.882 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.882 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a222c977:::benchmark_data_smithi018_166993_object41059:head# 2024-02-10T08:39:31.882 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.883 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a223ee63:::benchmark_data_smithi018_166993_object33969:head# 2024-02-10T08:39:31.883 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.883 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a22404f8:::benchmark_data_smithi018_166993_object41775:head# 2024-02-10T08:39:31.883 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.883 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a224b414:::benchmark_data_smithi018_166993_object93990:head# 2024-02-10T08:39:31.883 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.883 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a224fcfd:::benchmark_data_smithi018_166993_object57735:head# 2024-02-10T08:39:31.883 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.883 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a225247c:::benchmark_data_smithi018_166993_object94896:head# 2024-02-10T08:39:31.883 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.883 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2257312:::benchmark_data_smithi018_166993_object36014:head# 2024-02-10T08:39:31.883 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.883 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2258acc:::benchmark_data_smithi018_166993_object73741:head# 2024-02-10T08:39:31.883 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.883 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2259157:::benchmark_data_smithi018_166993_object38232:head# 2024-02-10T08:39:31.884 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.884 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a225adf6:::benchmark_data_smithi018_166993_object27712:head# 2024-02-10T08:39:31.884 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.884 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a226480d:::benchmark_data_smithi018_166993_object46495:head# 2024-02-10T08:39:31.884 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.884 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a226ba2a:::benchmark_data_smithi018_166993_object41395:head# 2024-02-10T08:39:31.884 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.884 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a22a4cb8:::benchmark_data_smithi018_166993_object72773:head# 2024-02-10T08:39:31.884 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.884 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a22aef14:::benchmark_data_smithi018_166993_object49932:head# 2024-02-10T08:39:31.884 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.884 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a22af93c:::benchmark_data_smithi018_166993_object48077:head# 2024-02-10T08:39:31.884 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.884 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a22c7af7:::benchmark_data_smithi018_166993_object56933:head# 2024-02-10T08:39:31.885 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.885 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a22ca01b:::benchmark_data_smithi018_166993_object94116:head# 2024-02-10T08:39:31.885 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.885 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a22cad82:::benchmark_data_smithi018_166993_object79243:head# 2024-02-10T08:39:31.885 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.885 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a22d04e3:::benchmark_data_smithi018_166993_object56288:head# 2024-02-10T08:39:31.885 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.885 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a22eefe0:::benchmark_data_smithi018_166993_object92196:head# 2024-02-10T08:39:31.885 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.885 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a22f9e98:::benchmark_data_smithi018_166993_object93219:head# 2024-02-10T08:39:31.885 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.885 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a22fb019:::benchmark_data_smithi018_166993_object17617:head# 2024-02-10T08:39:31.885 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.885 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a22fd9f6:::benchmark_data_smithi018_166993_object54295:head# 2024-02-10T08:39:31.885 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.886 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a230c7ac:::benchmark_data_smithi018_166993_object48215:head# 2024-02-10T08:39:31.886 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.886 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2313ab1:::benchmark_data_smithi018_166993_object89254:head# 2024-02-10T08:39:31.886 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.886 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a23176ce:::benchmark_data_smithi018_166993_object78379:head# 2024-02-10T08:39:31.886 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.886 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2326498:::benchmark_data_smithi018_166993_object75182:head# 2024-02-10T08:39:31.886 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.886 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a233f760:::benchmark_data_smithi018_166993_object21118:head# 2024-02-10T08:39:31.886 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.886 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2340e92:::benchmark_data_smithi018_166993_object79433:head# 2024-02-10T08:39:31.886 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.886 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a23460f1:::benchmark_data_smithi018_166993_object75835:head# 2024-02-10T08:39:31.886 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.887 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2352095:::benchmark_data_smithi018_166993_object71108:head# 2024-02-10T08:39:31.887 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.887 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a23665b6:::benchmark_data_smithi018_166993_object53188:head# 2024-02-10T08:39:31.887 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.887 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a236d32c:::benchmark_data_smithi018_166993_object106871:head# 2024-02-10T08:39:31.887 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.887 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2381aae:::benchmark_data_smithi018_166993_object113762:head# 2024-02-10T08:39:31.887 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.887 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a238ace0:::benchmark_data_smithi018_166993_object111157:head# 2024-02-10T08:39:31.887 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.887 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a23a2d8e:::benchmark_data_smithi018_166993_object99817:head# 2024-02-10T08:39:31.887 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.887 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a23b6708:::benchmark_data_smithi018_166993_object68732:head# 2024-02-10T08:39:31.887 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.887 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a23c17d6:::benchmark_data_smithi018_166993_object32489:head# 2024-02-10T08:39:31.888 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.888 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a23ebe05:::benchmark_data_smithi018_166993_object105361:head# 2024-02-10T08:39:31.888 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.888 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a23ebe0c:::benchmark_data_smithi018_166993_object52039:head# 2024-02-10T08:39:31.888 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.888 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a23ebfb9:::benchmark_data_smithi018_166993_object42896:head# 2024-02-10T08:39:31.888 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.888 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a23fbd61:::benchmark_data_smithi018_166993_object107986:head# 2024-02-10T08:39:31.888 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.888 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a24062ec:::benchmark_data_smithi018_166993_object93272:head# 2024-02-10T08:39:31.888 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.888 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2415e07:::benchmark_data_smithi018_166993_object97999:head# 2024-02-10T08:39:31.888 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.888 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a241bf36:::benchmark_data_smithi018_166993_object75919:head# 2024-02-10T08:39:31.888 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.889 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2428325:::benchmark_data_smithi018_166993_object71567:head# 2024-02-10T08:39:31.889 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.889 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a24298b5:::benchmark_data_smithi018_166993_object80831:head# 2024-02-10T08:39:31.889 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.889 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a244cac1:::benchmark_data_smithi018_166993_object19703:head# 2024-02-10T08:39:31.889 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.889 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a24716db:::benchmark_data_smithi018_166993_object117949:head# 2024-02-10T08:39:31.889 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.889 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2485247:::benchmark_data_smithi018_166993_object26476:head# 2024-02-10T08:39:31.889 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.889 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2488296:::benchmark_data_smithi018_166993_object58710:head# 2024-02-10T08:39:31.889 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.889 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a248c245:::benchmark_data_smithi018_166993_object101914:head# 2024-02-10T08:39:31.889 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.889 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a248d6b8:::benchmark_data_smithi018_166993_object112273:head# 2024-02-10T08:39:31.890 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.890 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a248dce8:::benchmark_data_smithi018_166993_object36193:head# 2024-02-10T08:39:31.890 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.890 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a249612b:::benchmark_data_smithi018_166993_object77740:head# 2024-02-10T08:39:31.890 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.890 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a24a0c13:::benchmark_data_smithi018_166993_object41954:head# 2024-02-10T08:39:31.890 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.890 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a24a3a03:::benchmark_data_smithi018_166993_object34126:head# 2024-02-10T08:39:31.890 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.890 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a24a7503:::benchmark_data_smithi018_166993_object67568:head# 2024-02-10T08:39:31.890 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.890 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a24af615:::benchmark_data_smithi018_166993_object52418:head# 2024-02-10T08:39:31.890 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.890 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a24b2b47:::benchmark_data_smithi018_166993_object78085:head# 2024-02-10T08:39:31.890 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.891 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a24ba1ae:::benchmark_data_smithi018_166993_object27415:head# 2024-02-10T08:39:31.891 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.891 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a24bda30:::benchmark_data_smithi018_166993_object66615:head# 2024-02-10T08:39:31.891 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.891 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a24cdf7b:::benchmark_data_smithi018_166993_object77145:head# 2024-02-10T08:39:31.891 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.891 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a24cf986:::benchmark_data_smithi018_166993_object80288:head# 2024-02-10T08:39:31.891 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.891 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a24dca07:::benchmark_data_smithi018_166993_object111861:head# 2024-02-10T08:39:31.891 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.903 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a24e44d3:::benchmark_data_smithi018_166993_object55753:head# 2024-02-10T08:39:31.903 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.903 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a24f05d4:::benchmark_data_smithi018_166993_object108034:head# 2024-02-10T08:39:31.903 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.903 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a24fc286:::benchmark_data_smithi018_166993_object98856:head# 2024-02-10T08:39:31.904 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.904 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2508233:::benchmark_data_smithi018_166993_object95103:head# 2024-02-10T08:39:31.904 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.904 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a251a8ee:::benchmark_data_smithi018_166993_object38820:head# 2024-02-10T08:39:31.904 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.904 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a251f699:::benchmark_data_smithi018_166993_object70599:head# 2024-02-10T08:39:31.904 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.904 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2536234:::benchmark_data_smithi018_166993_object39535:head# 2024-02-10T08:39:31.904 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.904 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2542270:::benchmark_data_smithi018_166993_object73515:head# 2024-02-10T08:39:31.904 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.904 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a254435d:::benchmark_data_smithi018_166993_object20422:head# 2024-02-10T08:39:31.904 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.904 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2550550:::benchmark_data_smithi018_166993_object52083:head# 2024-02-10T08:39:31.905 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.905 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a255433a:::benchmark_data_smithi018_166993_object113750:head# 2024-02-10T08:39:31.905 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.905 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2559521:::benchmark_data_smithi018_166993_object27751:head# 2024-02-10T08:39:31.905 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.905 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a256d677:::benchmark_data_smithi018_166993_object115896:head# 2024-02-10T08:39:31.905 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.905 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2571e4b:::benchmark_data_smithi018_166993_object69743:head# 2024-02-10T08:39:31.905 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.905 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a25733b5:::benchmark_data_smithi018_166993_object46177:head# 2024-02-10T08:39:31.905 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.905 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2576731:::benchmark_data_smithi018_166993_object93462:head# 2024-02-10T08:39:31.905 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.905 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a25847aa:::benchmark_data_smithi018_166993_object87030:head# 2024-02-10T08:39:31.905 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.906 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2585996:::benchmark_data_smithi018_166993_object29073:head# 2024-02-10T08:39:31.906 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.906 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2588132:::benchmark_data_smithi018_166993_object57516:head# 2024-02-10T08:39:31.906 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.906 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2597b55:::benchmark_data_smithi018_166993_object69882:head# 2024-02-10T08:39:31.906 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.906 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a25a0995:::benchmark_data_smithi018_166993_object60877:head# 2024-02-10T08:39:31.906 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.906 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a25e1ded:::benchmark_data_smithi018_166993_object79327:head# 2024-02-10T08:39:31.906 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.906 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a25ee4cb:::benchmark_data_smithi018_166993_object62278:head# 2024-02-10T08:39:31.906 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.906 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a25ef3b5:::benchmark_data_smithi018_166993_object98767:head# 2024-02-10T08:39:31.906 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.906 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a260550a:::benchmark_data_smithi018_166993_object25768:head# 2024-02-10T08:39:31.906 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.907 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a261f362:::benchmark_data_smithi018_166993_object87552:head# 2024-02-10T08:39:31.907 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.907 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a26231b1:::benchmark_data_smithi018_166993_object111412:head# 2024-02-10T08:39:31.907 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.907 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a26310bc:::benchmark_data_smithi018_166993_object115740:head# 2024-02-10T08:39:31.907 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.907 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2649651:::benchmark_data_smithi018_166993_object111830:head# 2024-02-10T08:39:31.907 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.907 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a264f6f2:::benchmark_data_smithi018_166993_object56696:head# 2024-02-10T08:39:31.907 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.907 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2661247:::benchmark_data_smithi018_166993_object81798:head# 2024-02-10T08:39:31.907 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.907 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a266a4d6:::benchmark_data_smithi018_166993_object111891:head# 2024-02-10T08:39:31.907 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.907 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a26720c3:::benchmark_data_smithi018_166993_object91227:head# 2024-02-10T08:39:31.908 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.908 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2674fa9:::benchmark_data_smithi018_166993_object66961:head# 2024-02-10T08:39:31.908 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.908 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a26855a1:::benchmark_data_smithi018_166993_object85234:head# 2024-02-10T08:39:31.908 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.908 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2692a3b:::benchmark_data_smithi018_166993_object20846:head# 2024-02-10T08:39:31.908 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.908 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a269736b:::benchmark_data_smithi018_166993_object78560:head# 2024-02-10T08:39:31.908 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.908 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a26a5e16:::benchmark_data_smithi018_166993_object70576:head# 2024-02-10T08:39:31.908 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.908 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a26bc6eb:::benchmark_data_smithi018_166993_object118705:head# 2024-02-10T08:39:31.908 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.908 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a26bfcd0:::benchmark_data_smithi018_166993_object67701:head# 2024-02-10T08:39:31.909 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.909 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a26c2256:::benchmark_data_smithi018_166993_object99399:head# 2024-02-10T08:39:31.909 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.909 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a26c531f:::benchmark_data_smithi018_166993_object50791:head# 2024-02-10T08:39:31.909 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.909 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a26c939c:::benchmark_data_smithi018_166993_object47646:head# 2024-02-10T08:39:31.909 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.909 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a26cc43a:::benchmark_data_smithi018_166993_object89958:head# 2024-02-10T08:39:31.909 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.909 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a26d0f68:::benchmark_data_smithi018_166993_object37749:head# 2024-02-10T08:39:31.909 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.909 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a26e17cc:::benchmark_data_smithi018_166993_object39594:head# 2024-02-10T08:39:31.909 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.909 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a26e1c4e:::benchmark_data_smithi018_166993_object58059:head# 2024-02-10T08:39:31.910 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.910 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a26e28b9:::benchmark_data_smithi018_166993_object78786:head# 2024-02-10T08:39:31.910 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.910 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a26f71f0:::benchmark_data_smithi018_166993_object109327:head# 2024-02-10T08:39:31.910 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.910 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a27055bc:::benchmark_data_smithi018_166993_object117326:head# 2024-02-10T08:39:31.910 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.910 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a270c9d4:::benchmark_data_smithi018_166993_object110834:head# 2024-02-10T08:39:31.910 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.910 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a27102c2:::benchmark_data_smithi018_166993_object109221:head# 2024-02-10T08:39:31.910 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.910 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2713e06:::benchmark_data_smithi018_166993_object59243:head# 2024-02-10T08:39:31.910 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.910 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a271d67e:::benchmark_data_smithi018_166993_object32002:head# 2024-02-10T08:39:31.910 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.910 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a27221f2:::benchmark_data_smithi018_166993_object84926:head# 2024-02-10T08:39:31.911 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.911 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a272a00e:::benchmark_data_smithi018_166993_object118714:head# 2024-02-10T08:39:31.911 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.911 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2730bc8:::benchmark_data_smithi018_166993_object53837:head# 2024-02-10T08:39:31.911 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.911 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a273e74d:::benchmark_data_smithi018_166993_object44529:head# 2024-02-10T08:39:31.911 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.911 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2748b34:::benchmark_data_smithi018_166993_object94432:head# 2024-02-10T08:39:31.911 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.911 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a277579c:::benchmark_data_smithi018_166993_object113581:head# 2024-02-10T08:39:31.911 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.911 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a277b668:::benchmark_data_smithi018_166993_object47174:head# 2024-02-10T08:39:31.911 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.911 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a277d899:::benchmark_data_smithi018_166993_object40557:head# 2024-02-10T08:39:31.911 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.911 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a279fd35:::benchmark_data_smithi018_166993_object73648:head# 2024-02-10T08:39:31.912 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.912 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a27a10e7:::benchmark_data_smithi018_166993_object109678:head# 2024-02-10T08:39:31.912 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.912 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a27dc46b:::benchmark_data_smithi018_166993_object90535:head# 2024-02-10T08:39:31.912 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.912 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a27e269d:::benchmark_data_smithi018_166993_object84255:head# 2024-02-10T08:39:31.912 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.912 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a27f782e:::benchmark_data_smithi018_166993_object39027:head# 2024-02-10T08:39:31.912 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.912 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a27ff010:::benchmark_data_smithi018_166993_object117583:head# 2024-02-10T08:39:31.912 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.912 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2803e7d:::benchmark_data_smithi018_166993_object19321:head# 2024-02-10T08:39:31.912 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.912 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a28212fa:::benchmark_data_smithi018_166993_object117821:head# 2024-02-10T08:39:31.913 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.913 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2824a6f:::benchmark_data_smithi018_166993_object100459:head# 2024-02-10T08:39:31.913 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.913 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a282dfbc:::benchmark_data_smithi018_166993_object45384:head# 2024-02-10T08:39:31.913 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.913 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a283f6f6:::benchmark_data_smithi018_166993_object34112:head# 2024-02-10T08:39:31.913 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.913 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a284514a:::benchmark_data_smithi018_166993_object38691:head# 2024-02-10T08:39:31.913 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.913 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2850b0e:::benchmark_data_smithi018_166993_object63638:head# 2024-02-10T08:39:31.913 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.913 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a285697e:::benchmark_data_smithi018_166993_object26097:head# 2024-02-10T08:39:31.913 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.913 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a285c1d0:::benchmark_data_smithi018_166993_object115974:head# 2024-02-10T08:39:31.913 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.913 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a28705be:::benchmark_data_smithi018_166993_object112630:head# 2024-02-10T08:39:31.914 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.914 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a288a091:::benchmark_data_smithi018_166993_object44800:head# 2024-02-10T08:39:31.914 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.914 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a28930dc:::benchmark_data_smithi018_166993_object49234:head# 2024-02-10T08:39:31.914 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.919 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a28a33e3:::benchmark_data_smithi018_166993_object103206:head# 2024-02-10T08:39:31.919 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.919 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a28b8783:::benchmark_data_smithi018_166993_object107495:head# 2024-02-10T08:39:31.919 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.919 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a28c36d5:::benchmark_data_smithi018_166993_object51493:head# 2024-02-10T08:39:31.919 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.919 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a28ca243:::benchmark_data_smithi018_166993_object36209:head# 2024-02-10T08:39:31.919 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.920 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a28e3fae:::benchmark_data_smithi018_166993_object37317:head# 2024-02-10T08:39:31.920 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.920 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a28e8628:::benchmark_data_smithi018_166993_object93697:head# 2024-02-10T08:39:31.920 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.920 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a28ef23a:::benchmark_data_smithi018_166993_object78561:head# 2024-02-10T08:39:31.920 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.920 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a29050e7:::benchmark_data_smithi018_166993_object104274:head# 2024-02-10T08:39:31.920 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.920 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a29070ab:::benchmark_data_smithi018_166993_object86973:head# 2024-02-10T08:39:31.920 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.920 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a290b2fa:::benchmark_data_smithi018_166993_object58969:head# 2024-02-10T08:39:31.920 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.920 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2911977:::benchmark_data_smithi018_166993_object31586:head# 2024-02-10T08:39:31.920 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.921 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a29199c9:::benchmark_data_smithi018_166993_object81447:head# 2024-02-10T08:39:31.921 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.921 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a291cc73:::benchmark_data_smithi018_166993_object87192:head# 2024-02-10T08:39:31.921 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.921 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a29235c1:::benchmark_data_smithi018_166993_object79683:head# 2024-02-10T08:39:31.921 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.921 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a292a1ee:::benchmark_data_smithi018_166993_object43111:head# 2024-02-10T08:39:31.921 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.921 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a29432e9:::benchmark_data_smithi018_166993_object107455:head# 2024-02-10T08:39:31.921 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.921 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2946f45:::benchmark_data_smithi018_166993_object27889:head# 2024-02-10T08:39:31.921 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.921 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2951bf1:::benchmark_data_smithi018_166993_object102424:head# 2024-02-10T08:39:31.921 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.922 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2956c95:::benchmark_data_smithi018_166993_object111005:head# 2024-02-10T08:39:31.922 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.922 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2961acb:::benchmark_data_smithi018_166993_object50443:head# 2024-02-10T08:39:31.922 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.922 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2965533:::benchmark_data_smithi018_166993_object59233:head# 2024-02-10T08:39:31.922 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.922 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a296a810:::benchmark_data_smithi018_166993_object93976:head# 2024-02-10T08:39:31.922 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.922 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a298763d:::benchmark_data_smithi018_166993_object25741:head# 2024-02-10T08:39:31.922 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.922 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a29bd5b8:::benchmark_data_smithi018_166993_object88754:head# 2024-02-10T08:39:31.922 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.922 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a29d24fc:::benchmark_data_smithi018_166993_object91184:head# 2024-02-10T08:39:31.922 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.922 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a29da504:::benchmark_data_smithi018_166993_object41227:head# 2024-02-10T08:39:31.923 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.923 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a29dfce0:::benchmark_data_smithi018_166993_object112053:head# 2024-02-10T08:39:31.923 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.923 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a29e493f:::benchmark_data_smithi018_166993_object57141:head# 2024-02-10T08:39:31.923 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.923 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a29e65f8:::benchmark_data_smithi018_166993_object65885:head# 2024-02-10T08:39:31.923 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.923 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a29ea77f:::benchmark_data_smithi018_166993_object51266:head# 2024-02-10T08:39:31.923 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.923 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2a07c68:::benchmark_data_smithi018_166993_object111750:head# 2024-02-10T08:39:31.923 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.923 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2a1d79b:::benchmark_data_smithi018_166993_object73747:head# 2024-02-10T08:39:31.923 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.923 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2a1fc79:::benchmark_data_smithi018_166993_object82835:head# 2024-02-10T08:39:31.923 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.924 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2a226af:::benchmark_data_smithi018_166993_object31724:head# 2024-02-10T08:39:31.924 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.924 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2a29f3d:::benchmark_data_smithi018_166993_object61826:head# 2024-02-10T08:39:31.924 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.924 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2a3ebc6:::benchmark_data_smithi018_166993_object44266:head# 2024-02-10T08:39:31.924 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.924 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2a4de6f:::benchmark_data_smithi018_166993_object116829:head# 2024-02-10T08:39:31.924 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.924 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2a55554:::benchmark_data_smithi018_166993_object41041:head# 2024-02-10T08:39:31.924 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.925 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2a76b89:::benchmark_data_smithi018_166993_object83704:head# 2024-02-10T08:39:31.925 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.925 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2a84bf5:::benchmark_data_smithi018_166993_object84091:head# 2024-02-10T08:39:31.925 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.925 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2a89d8e:::benchmark_data_smithi018_166993_object45192:head# 2024-02-10T08:39:31.926 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.926 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2a8a87d:::benchmark_data_smithi018_166993_object41358:head# 2024-02-10T08:39:31.926 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.926 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2aa95fe:::benchmark_data_smithi018_166993_object45263:head# 2024-02-10T08:39:31.926 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.926 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2ab6a2a:::benchmark_data_smithi018_166993_object115675:head# 2024-02-10T08:39:31.926 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.926 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2ab8904:::benchmark_data_smithi018_166993_object46261:head# 2024-02-10T08:39:31.926 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.927 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2abf980:::benchmark_data_smithi018_166993_object33219:head# 2024-02-10T08:39:31.927 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.927 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2ac60b5:::benchmark_data_smithi018_166993_object105113:head# 2024-02-10T08:39:31.927 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.927 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2ac66b9:::benchmark_data_smithi018_166993_object67586:head# 2024-02-10T08:39:31.927 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.928 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2ac7d64:::benchmark_data_smithi018_166993_object59761:head# 2024-02-10T08:39:31.928 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.928 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2ad0da5:::benchmark_data_smithi018_166993_object48681:head# 2024-02-10T08:39:31.928 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.928 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2ad2881:::benchmark_data_smithi018_166993_object64976:head# 2024-02-10T08:39:31.928 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.928 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2ae867c:::benchmark_data_smithi018_166993_object39877:head# 2024-02-10T08:39:31.928 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.931 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2afc328:::benchmark_data_smithi018_166993_object50679:head# 2024-02-10T08:39:31.931 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.932 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2afce5b:::benchmark_data_smithi018_166993_object48966:head# 2024-02-10T08:39:31.932 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.932 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2b00a28:::benchmark_data_smithi018_166993_object35978:head# 2024-02-10T08:39:31.932 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.932 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2b04206:::benchmark_data_smithi018_166993_object33593:head# 2024-02-10T08:39:31.933 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.933 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2b083d7:::benchmark_data_smithi018_166993_object18537:head# 2024-02-10T08:39:31.933 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.933 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2b091e8:::benchmark_data_smithi018_166993_object50944:head# 2024-02-10T08:39:31.933 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.933 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2b126ee:::benchmark_data_smithi018_166993_object40921:head# 2024-02-10T08:39:31.933 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.937 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2b1435e:::benchmark_data_smithi018_166993_object88482:head# 2024-02-10T08:39:31.937 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.937 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2b37249:::benchmark_data_smithi018_166993_object22139:head# 2024-02-10T08:39:31.937 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.937 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2b3ba1c:::benchmark_data_smithi018_166993_object85939:head# 2024-02-10T08:39:31.937 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.938 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2b463c7:::benchmark_data_smithi018_166993_object84541:head# 2024-02-10T08:39:31.938 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.938 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2b5896b:::benchmark_data_smithi018_166993_object72923:head# 2024-02-10T08:39:31.938 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.938 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-02-10T08:39:31.938 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:39:31.939 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2b61d75:::benchmark_data_smithi018_166993_object66311:head# 2024-02-10T08:39:31.939 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.941 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2b66003:::benchmark_data_smithi018_166993_object102469:head# 2024-02-10T08:39:31.941 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.941 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2b6f13c:::benchmark_data_smithi018_166993_object106721:head# 2024-02-10T08:39:31.941 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.941 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2b7b2c8:::benchmark_data_smithi018_166993_object24360:head# 2024-02-10T08:39:31.941 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.942 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2b7d7f6:::benchmark_data_smithi018_166993_object101835:head# 2024-02-10T08:39:31.942 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.942 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2b8eba3:::benchmark_data_smithi018_166993_object35462:head# 2024-02-10T08:39:31.942 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.942 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2b90759:::benchmark_data_smithi018_166993_object46928:head# 2024-02-10T08:39:31.942 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.942 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2b96c62:::benchmark_data_smithi018_166993_object57033:head# 2024-02-10T08:39:31.942 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.944 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2b9c1ec:::benchmark_data_smithi018_166993_object42685:head# 2024-02-10T08:39:31.944 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.944 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2ba65d0:::benchmark_data_smithi018_166993_object92799:head# 2024-02-10T08:39:31.944 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.944 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2bb89d8:::benchmark_data_smithi018_166993_object68248:head# 2024-02-10T08:39:31.944 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.945 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2bd9dfe:::benchmark_data_smithi018_166993_object82743:head# 2024-02-10T08:39:31.945 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.945 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2bdffea:::benchmark_data_smithi018_166993_object28734:head# 2024-02-10T08:39:31.945 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.945 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2be3af9:::benchmark_data_smithi018_166993_object86218:head# 2024-02-10T08:39:31.945 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.945 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2be4be6:::benchmark_data_smithi018_166993_object78350:head# 2024-02-10T08:39:31.945 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.945 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2be6a46:::benchmark_data_smithi018_166993_object115707:head# 2024-02-10T08:39:31.945 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.945 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2be751f:::benchmark_data_smithi018_166993_object43467:head# 2024-02-10T08:39:31.945 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.946 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2bf2276:::benchmark_data_smithi018_166993_object92809:head# 2024-02-10T08:39:31.946 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.946 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2c0099d:::benchmark_data_smithi018_166993_object86084:head# 2024-02-10T08:39:31.946 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.946 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2c027c7:::benchmark_data_smithi018_166993_object103263:head# 2024-02-10T08:39:31.946 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.946 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2c108c5:::benchmark_data_smithi018_166993_object93812:head# 2024-02-10T08:39:31.946 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.950 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2c147bf:::benchmark_data_smithi018_166993_object55912:head# 2024-02-10T08:39:31.950 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.950 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2c18995:::benchmark_data_smithi018_166993_object56064:head# 2024-02-10T08:39:31.950 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.952 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2c2b775:::benchmark_data_smithi018_166993_object103277:head# 2024-02-10T08:39:31.952 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.952 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2c344a8:::benchmark_data_smithi018_166993_object100006:head# 2024-02-10T08:39:31.952 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.953 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2c3d179:::benchmark_data_smithi018_166993_object41000:head# 2024-02-10T08:39:31.953 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.955 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2c41148:::benchmark_data_smithi018_166993_object53366:head# 2024-02-10T08:39:31.955 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.955 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2c44b05:::benchmark_data_smithi018_166993_object65031:head# 2024-02-10T08:39:31.955 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.956 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2c55dad:::benchmark_data_smithi018_166993_object29874:head# 2024-02-10T08:39:31.956 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.956 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2c5b5e0:::benchmark_data_smithi018_166993_object18247:head# 2024-02-10T08:39:31.956 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.956 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2c5deff:::benchmark_data_smithi018_166993_object59046:head# 2024-02-10T08:39:31.956 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.962 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2c689b1:::benchmark_data_smithi018_166993_object38094:head# 2024-02-10T08:39:31.962 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.962 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2c6cc3a:::benchmark_data_smithi018_166993_object106150:head# 2024-02-10T08:39:31.962 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.963 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2c75a05:::benchmark_data_smithi018_166993_object32054:head# 2024-02-10T08:39:31.963 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.963 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2c780c5:::benchmark_data_smithi018_166993_object69783:head# 2024-02-10T08:39:31.963 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.963 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2c82aa1:::benchmark_data_smithi018_166993_object47343:head# 2024-02-10T08:39:31.963 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.964 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2c83419:::benchmark_data_smithi018_166993_object80429:head# 2024-02-10T08:39:31.964 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.964 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2c918ee:::benchmark_data_smithi018_166993_object98707:head# 2024-02-10T08:39:31.964 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.964 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2c9d1a9:::benchmark_data_smithi018_166993_object22668:head# 2024-02-10T08:39:31.965 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.965 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2ca8729:::benchmark_data_smithi018_166993_object39961:head# 2024-02-10T08:39:31.965 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.965 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2cae01d:::benchmark_data_smithi018_166993_object19016:head# 2024-02-10T08:39:31.965 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.965 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2cbaf4a:::benchmark_data_smithi018_166993_object65256:head# 2024-02-10T08:39:31.965 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.965 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2cc389e:::benchmark_data_smithi018_166993_object98688:head# 2024-02-10T08:39:31.965 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.965 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2ccb43d:::benchmark_data_smithi018_166993_object57809:head# 2024-02-10T08:39:31.965 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.965 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2ccf1a5:::benchmark_data_smithi018_166993_object93106:head# 2024-02-10T08:39:31.965 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.966 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2cd49f0:::benchmark_data_smithi018_166993_object18742:head# 2024-02-10T08:39:31.966 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.966 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2cd57c1:::benchmark_data_smithi018_166993_object25382:head# 2024-02-10T08:39:31.966 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.966 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2cd778f:::benchmark_data_smithi018_166993_object19015:head# 2024-02-10T08:39:31.966 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.971 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2cdf7a1:::benchmark_data_smithi018_166993_object56505:head# 2024-02-10T08:39:31.971 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.971 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2d0ef38:::benchmark_data_smithi018_166993_object105881:head# 2024-02-10T08:39:31.971 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.971 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2d13366:::benchmark_data_smithi018_166993_object38156:head# 2024-02-10T08:39:31.971 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.971 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2d16633:::benchmark_data_smithi018_166993_object115125:head# 2024-02-10T08:39:31.971 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.971 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2d1d859:::benchmark_data_smithi018_166993_object88175:head# 2024-02-10T08:39:31.971 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.971 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2d1ed70:::benchmark_data_smithi018_166993_object49040:head# 2024-02-10T08:39:31.971 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.971 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2d25e6c:::benchmark_data_smithi018_166993_object38033:head# 2024-02-10T08:39:31.971 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.972 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2d29d18:::benchmark_data_smithi018_166993_object106526:head# 2024-02-10T08:39:31.972 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.972 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2d2c3ee:::benchmark_data_smithi018_166993_object96471:head# 2024-02-10T08:39:31.972 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.974 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2d37942:::benchmark_data_smithi018_166993_object68245:head# 2024-02-10T08:39:31.975 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.975 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2d3d968:::benchmark_data_smithi018_166993_object29298:head# 2024-02-10T08:39:31.975 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.975 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2d3ec6b:::benchmark_data_smithi018_166993_object36445:head# 2024-02-10T08:39:31.975 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.975 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2d40f02:::benchmark_data_smithi018_166993_object44525:head# 2024-02-10T08:39:31.975 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.975 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2d5ccc5:::benchmark_data_smithi018_166993_object97369:head# 2024-02-10T08:39:31.975 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.975 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2d627e6:::benchmark_data_smithi018_166993_object54556:head# 2024-02-10T08:39:31.975 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.975 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2d64384:::benchmark_data_smithi018_166993_object77482:head# 2024-02-10T08:39:31.975 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.975 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2d655cd:::benchmark_data_smithi018_166993_object116722:head# 2024-02-10T08:39:31.975 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.976 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2d661fd:::benchmark_data_smithi018_166993_object107023:head# 2024-02-10T08:39:31.976 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.976 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2d6e053:::benchmark_data_smithi018_166993_object34829:head# 2024-02-10T08:39:31.976 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.976 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2d72b48:::benchmark_data_smithi018_166993_object112928:head# 2024-02-10T08:39:31.976 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.976 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2dac353:::benchmark_data_smithi018_166993_object88943:head# 2024-02-10T08:39:31.976 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.976 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2dc80c1:::benchmark_data_smithi018_166993_object48932:head# 2024-02-10T08:39:31.976 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.976 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2dd55c4:::benchmark_data_smithi018_166993_object39055:head# 2024-02-10T08:39:31.976 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.976 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2ddd185:::benchmark_data_smithi018_166993_object90809:head# 2024-02-10T08:39:31.976 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.980 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2deb69d:::benchmark_data_smithi018_166993_object61109:head# 2024-02-10T08:39:31.980 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.981 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2dfd871:::benchmark_data_smithi018_166993_object35762:head# 2024-02-10T08:39:31.981 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.981 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2dfdfe8:::benchmark_data_smithi018_166993_object56398:head# 2024-02-10T08:39:31.981 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.981 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2dfe3fc:::benchmark_data_smithi018_166993_object76415:head# 2024-02-10T08:39:31.981 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.981 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2e0468f:::benchmark_data_smithi018_166993_object29903:head# 2024-02-10T08:39:31.981 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.981 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2e04708:::benchmark_data_smithi018_166993_object46221:head# 2024-02-10T08:39:31.981 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.981 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2e38e6d:::benchmark_data_smithi018_166993_object62465:head# 2024-02-10T08:39:31.981 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.981 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2e3aeea:::benchmark_data_smithi018_166993_object59076:head# 2024-02-10T08:39:31.981 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.981 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2e40482:::benchmark_data_smithi018_166993_object46451:head# 2024-02-10T08:39:31.982 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.982 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2e545a3:::benchmark_data_smithi018_166993_object53958:head# 2024-02-10T08:39:31.982 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.982 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2e54d88:::benchmark_data_smithi018_166993_object104833:head# 2024-02-10T08:39:31.982 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.982 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2e58e24:::benchmark_data_smithi018_166993_object30670:head# 2024-02-10T08:39:31.982 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.982 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2e66f81:::benchmark_data_smithi018_166993_object62073:head# 2024-02-10T08:39:31.982 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.982 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2e686fc:::benchmark_data_smithi018_166993_object96156:head# 2024-02-10T08:39:31.982 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.982 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2e6d47e:::benchmark_data_smithi018_166993_object57416:head# 2024-02-10T08:39:31.982 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.982 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2e718ce:::benchmark_data_smithi018_166993_object61745:head# 2024-02-10T08:39:31.982 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.982 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2e7d712:::benchmark_data_smithi018_166993_object66092:head# 2024-02-10T08:39:31.983 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.983 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2e8eac6:::benchmark_data_smithi018_166993_object76015:head# 2024-02-10T08:39:31.983 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.983 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2e98f0c:::benchmark_data_smithi018_166993_object18554:head# 2024-02-10T08:39:31.983 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.983 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2ea17b2:::benchmark_data_smithi018_166993_object86654:head# 2024-02-10T08:39:31.983 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.983 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2ea975d:::benchmark_data_smithi018_166993_object62228:head# 2024-02-10T08:39:31.983 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.983 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2eb2852:::benchmark_data_smithi018_166993_object75694:head# 2024-02-10T08:39:31.983 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.985 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2eb842c:::benchmark_data_smithi018_166993_object79106:head# 2024-02-10T08:39:31.985 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.986 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2eb9b2a:::benchmark_data_smithi018_166993_object80121:head# 2024-02-10T08:39:31.986 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.986 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2ebe991:::benchmark_data_smithi018_166993_object45086:head# 2024-02-10T08:39:31.986 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.987 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2ebfdd6:::benchmark_data_smithi018_166993_object34453:head# 2024-02-10T08:39:31.987 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.987 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2ecf2f0:::benchmark_data_smithi018_166993_object73774:head# 2024-02-10T08:39:31.987 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.987 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2ed0ce1:::benchmark_data_smithi018_166993_object88022:head# 2024-02-10T08:39:31.987 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.989 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2ee7564:::benchmark_data_smithi018_166993_object64242:head# 2024-02-10T08:39:31.989 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.992 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2ee9a4e:::benchmark_data_smithi018_166993_object116321:head# 2024-02-10T08:39:31.992 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.992 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2eec3fe:::benchmark_data_smithi018_166993_object48524:head# 2024-02-10T08:39:31.993 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.993 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2eeece4:::benchmark_data_smithi018_166993_object103355:head# 2024-02-10T08:39:31.993 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.993 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2efb57d:::benchmark_data_smithi018_166993_object72669:head# 2024-02-10T08:39:31.993 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.993 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2efdd82:::benchmark_data_smithi018_166993_object53995:head# 2024-02-10T08:39:31.993 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.993 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2f03173:::benchmark_data_smithi018_166993_object61681:head# 2024-02-10T08:39:31.993 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.996 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2f0cd1d:::benchmark_data_smithi018_166993_object91741:head# 2024-02-10T08:39:31.996 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.997 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2f0d8e8:::benchmark_data_smithi018_166993_object48447:head# 2024-02-10T08:39:31.997 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:31.999 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2f1a208:::benchmark_data_smithi018_166993_object64585:head# 2024-02-10T08:39:31.999 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.000 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2f24611:::benchmark_data_smithi018_166993_object108224:head# 2024-02-10T08:39:32.000 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.000 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2f287b8:::benchmark_data_smithi018_166993_object58337:head# 2024-02-10T08:39:32.000 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.000 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2f2a2b6:::benchmark_data_smithi018_166993_object46468:head# 2024-02-10T08:39:32.000 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.002 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2f2b737:::benchmark_data_smithi018_166993_object61181:head# 2024-02-10T08:39:32.002 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.002 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2f44e3e:::benchmark_data_smithi018_166993_object99203:head# 2024-02-10T08:39:32.002 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.002 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2f4c5a3:::benchmark_data_smithi018_166993_object65868:head# 2024-02-10T08:39:32.002 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.002 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2f62424:::benchmark_data_smithi018_166993_object68253:head# 2024-02-10T08:39:32.002 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.002 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2f677f5:::benchmark_data_smithi018_166993_object35137:head# 2024-02-10T08:39:32.002 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.003 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2f743fd:::benchmark_data_smithi018_166993_object76194:head# 2024-02-10T08:39:32.003 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.003 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2f7f24b:::benchmark_data_smithi018_166993_object42703:head# 2024-02-10T08:39:32.003 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.003 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2f8855f:::benchmark_data_smithi018_166993_object98384:head# 2024-02-10T08:39:32.003 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.004 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2f8a338:::benchmark_data_smithi018_166993_object50934:head# 2024-02-10T08:39:32.004 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.004 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2f92ec3:::benchmark_data_smithi018_166993_object40423:head# 2024-02-10T08:39:32.004 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.004 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2f9d693:::benchmark_data_smithi018_166993_object60268:head# 2024-02-10T08:39:32.004 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.004 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2fa085d:::benchmark_data_smithi018_166993_object82807:head# 2024-02-10T08:39:32.004 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.004 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2fd25a4:::benchmark_data_smithi018_166993_object20498:head# 2024-02-10T08:39:32.004 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.005 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2fd294f:::benchmark_data_smithi018_166993_object98151:head# 2024-02-10T08:39:32.006 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.006 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2fd736f:::benchmark_data_smithi018_166993_object96559:head# 2024-02-10T08:39:32.006 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.006 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2fd8392:::benchmark_data_smithi018_166993_object38283:head# 2024-02-10T08:39:32.006 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.006 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a2ff7243:::benchmark_data_smithi018_166993_object104787:head# 2024-02-10T08:39:32.006 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.006 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3002856:::benchmark_data_smithi018_166993_object79157:head# 2024-02-10T08:39:32.006 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.006 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a300c274:::benchmark_data_smithi018_166993_object103186:head# 2024-02-10T08:39:32.006 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.006 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3022b4e:::benchmark_data_smithi018_166993_object20267:head# 2024-02-10T08:39:32.006 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.006 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a302beec:::benchmark_data_smithi018_166993_object107243:head# 2024-02-10T08:39:32.007 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.008 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3037df4:::benchmark_data_smithi018_166993_object73803:head# 2024-02-10T08:39:32.008 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.008 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3052393:::benchmark_data_smithi018_166993_object87838:head# 2024-02-10T08:39:32.008 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.008 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3056bed:::benchmark_data_smithi018_166993_object57963:head# 2024-02-10T08:39:32.008 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.008 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a305cea5:::benchmark_data_smithi018_166993_object93467:head# 2024-02-10T08:39:32.009 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.009 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a307e51e:::benchmark_data_smithi018_166993_object25859:head# 2024-02-10T08:39:32.009 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.009 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3087878:::benchmark_data_smithi018_166993_object102226:head# 2024-02-10T08:39:32.009 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.009 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a30aaee7:::benchmark_data_smithi018_166993_object72943:head# 2024-02-10T08:39:32.009 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.009 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a30cb911:::benchmark_data_smithi018_166993_object85102:head# 2024-02-10T08:39:32.009 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.009 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a30e1db1:::benchmark_data_smithi018_166993_object118678:head# 2024-02-10T08:39:32.009 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.012 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a30f763c:::benchmark_data_smithi018_166993_object30153:head# 2024-02-10T08:39:32.012 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.012 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a30face8:::benchmark_data_smithi018_166993_object87075:head# 2024-02-10T08:39:32.012 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.012 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a30ffae9:::benchmark_data_smithi018_166993_object50290:head# 2024-02-10T08:39:32.012 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.012 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3103381:::benchmark_data_smithi018_166993_object53905:head# 2024-02-10T08:39:32.012 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.012 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3106619:::benchmark_data_smithi018_166993_object90116:head# 2024-02-10T08:39:32.012 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.012 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3107045:::benchmark_data_smithi018_166993_object54559:head# 2024-02-10T08:39:32.013 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.013 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a310b110:::benchmark_data_smithi018_166993_object52005:head# 2024-02-10T08:39:32.013 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.013 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a310ef50:::benchmark_data_smithi018_166993_object27983:head# 2024-02-10T08:39:32.013 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.013 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a31100ee:::benchmark_data_smithi018_166993_object99378:head# 2024-02-10T08:39:32.013 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.014 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a311c8c4:::benchmark_data_smithi018_166993_object89273:head# 2024-02-10T08:39:32.014 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.014 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a311d7f1:::benchmark_data_smithi018_166993_object113821:head# 2024-02-10T08:39:32.015 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.015 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3121ce1:::benchmark_data_smithi018_166993_object21969:head# 2024-02-10T08:39:32.015 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.015 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a312af20:::benchmark_data_smithi018_166993_object85193:head# 2024-02-10T08:39:32.015 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.015 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3130292:::benchmark_data_smithi018_166993_object81964:head# 2024-02-10T08:39:32.016 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.017 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3137008:::benchmark_data_smithi018_166993_object116137:head# 2024-02-10T08:39:32.017 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.017 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a313b0fc:::benchmark_data_smithi018_166993_object55823:head# 2024-02-10T08:39:32.017 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.017 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a313e342:::benchmark_data_smithi018_166993_object33406:head# 2024-02-10T08:39:32.017 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.017 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a31676b9:::benchmark_data_smithi018_166993_object81616:head# 2024-02-10T08:39:32.017 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.017 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a316e163:::benchmark_data_smithi018_166993_object99589:head# 2024-02-10T08:39:32.017 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.017 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a31796d3:::benchmark_data_smithi018_166993_object49567:head# 2024-02-10T08:39:32.017 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.019 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a317fe4b:::benchmark_data_smithi018_166993_object80937:head# 2024-02-10T08:39:32.019 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.019 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3195cf0:::benchmark_data_smithi018_166993_object118826:head# 2024-02-10T08:39:32.019 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.019 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a31abeb2:::benchmark_data_smithi018_166993_object28008:head# 2024-02-10T08:39:32.019 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.019 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a31acf8d:::benchmark_data_smithi018_166993_object28946:head# 2024-02-10T08:39:32.019 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.019 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a31c2344:::benchmark_data_smithi018_166993_object21602:head# 2024-02-10T08:39:32.019 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.019 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a31c365b:::benchmark_data_smithi018_166993_object107229:head# 2024-02-10T08:39:32.019 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.020 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a31c8e84:::benchmark_data_smithi018_166993_object59095:head# 2024-02-10T08:39:32.020 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.020 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a31d00fa:::benchmark_data_smithi018_166993_object58596:head# 2024-02-10T08:39:32.020 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.021 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a31d0673:::benchmark_data_smithi018_166993_object80880:head# 2024-02-10T08:39:32.021 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.021 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a31e6469:::benchmark_data_smithi018_166993_object96035:head# 2024-02-10T08:39:32.021 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.021 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a31ec3eb:::benchmark_data_smithi018_166993_object116572:head# 2024-02-10T08:39:32.021 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.021 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a31f1d91:::benchmark_data_smithi018_166993_object20550:head# 2024-02-10T08:39:32.021 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.021 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a32036b6:::benchmark_data_smithi018_166993_object101203:head# 2024-02-10T08:39:32.021 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.021 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a320801b:::benchmark_data_smithi018_166993_object111224:head# 2024-02-10T08:39:32.021 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.021 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a32102e7:::benchmark_data_smithi018_166993_object91076:head# 2024-02-10T08:39:32.022 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.023 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3210d09:::benchmark_data_smithi018_166993_object19742:head# 2024-02-10T08:39:32.023 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.023 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a321caad:::benchmark_data_smithi018_166993_object38866:head# 2024-02-10T08:39:32.023 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.023 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a321df94:::benchmark_data_smithi018_166993_object107939:head# 2024-02-10T08:39:32.023 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.023 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a321e580:::benchmark_data_smithi018_166993_object110373:head# 2024-02-10T08:39:32.023 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.023 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3223d46:::benchmark_data_smithi018_166993_object110464:head# 2024-02-10T08:39:32.023 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.023 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a322c71d:::benchmark_data_smithi018_166993_object74443:head# 2024-02-10T08:39:32.023 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.023 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a323d98c:::benchmark_data_smithi018_166993_object41090:head# 2024-02-10T08:39:32.024 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.024 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a323e81c:::benchmark_data_smithi018_166993_object36696:head# 2024-02-10T08:39:32.024 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.025 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a324700f:::benchmark_data_smithi018_166993_object92054:head# 2024-02-10T08:39:32.025 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.026 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a32495f8:::benchmark_data_smithi018_166993_object51061:head# 2024-02-10T08:39:32.026 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.026 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a324aecc:::benchmark_data_smithi018_166993_object67532:head# 2024-02-10T08:39:32.026 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.026 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a325334c:::benchmark_data_smithi018_166993_object59467:head# 2024-02-10T08:39:32.026 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.026 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3279079:::benchmark_data_smithi018_166993_object34263:head# 2024-02-10T08:39:32.026 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.027 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a327b30c:::benchmark_data_smithi018_166993_object114211:head# 2024-02-10T08:39:32.027 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.027 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a329a039:::benchmark_data_smithi018_166993_object116140:head# 2024-02-10T08:39:32.028 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.028 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a32a6830:::benchmark_data_smithi018_166993_object38091:head# 2024-02-10T08:39:32.028 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.028 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a32abb71:::benchmark_data_smithi018_166993_object49825:head# 2024-02-10T08:39:32.028 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.028 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a32bad8a:::benchmark_data_smithi018_166993_object106550:head# 2024-02-10T08:39:32.028 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.033 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a32bc7a6:::benchmark_data_smithi018_166993_object44703:head# 2024-02-10T08:39:32.033 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.033 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a32c86f6:::benchmark_data_smithi018_166993_object68468:head# 2024-02-10T08:39:32.033 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.034 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a32e1d5b:::benchmark_data_smithi018_166993_object61169:head# 2024-02-10T08:39:32.034 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.034 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a32ea512:::benchmark_data_smithi018_166993_object85013:head# 2024-02-10T08:39:32.034 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.034 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a32fb7a9:::benchmark_data_smithi018_166993_object88999:head# 2024-02-10T08:39:32.034 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.034 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3300b39:::benchmark_data_smithi018_166993_object112859:head# 2024-02-10T08:39:32.034 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.036 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3304a69:::benchmark_data_smithi018_166993_object31987:head# 2024-02-10T08:39:32.036 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.036 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a33200dd:::benchmark_data_smithi018_166993_object108567:head# 2024-02-10T08:39:32.036 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.036 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a332c455:::benchmark_data_smithi018_166993_object71511:head# 2024-02-10T08:39:32.036 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.036 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3330abb:::benchmark_data_smithi018_166993_object54925:head# 2024-02-10T08:39:32.036 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.036 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3334387:::benchmark_data_smithi018_166993_object59843:head# 2024-02-10T08:39:32.036 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.036 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a33393c5:::benchmark_data_smithi018_166993_object104203:head# 2024-02-10T08:39:32.036 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.038 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a335a87e:::benchmark_data_smithi018_166993_object103754:head# 2024-02-10T08:39:32.038 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.038 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a336ed5e:::benchmark_data_smithi018_166993_object25569:head# 2024-02-10T08:39:32.038 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.038 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a337b40a:::benchmark_data_smithi018_166993_object103388:head# 2024-02-10T08:39:32.038 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.038 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a338d2a2:::benchmark_data_smithi018_166993_object24434:head# 2024-02-10T08:39:32.038 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.038 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a33952a1:::benchmark_data_smithi018_166993_object24392:head# 2024-02-10T08:39:32.038 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.039 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a339c8f8:::benchmark_data_smithi018_166993_object97566:head# 2024-02-10T08:39:32.039 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.039 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a33a030d:::benchmark_data_smithi018_166993_object81845:head# 2024-02-10T08:39:32.039 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.039 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a33a12de:::benchmark_data_smithi018_166993_object62641:head# 2024-02-10T08:39:32.039 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.040 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a33b6856:::benchmark_data_smithi018_166993_object39460:head# 2024-02-10T08:39:32.040 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.040 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a33be165:::benchmark_data_smithi018_166993_object77902:head# 2024-02-10T08:39:32.040 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:39:31.037001+0000 mon.a (mon.0) 1792 : cluster [WRN] Health check update: Degraded data redundancy: 19026/197964 objects degraded (9.611%), 5 pgs degraded (PG_DEGRADED) 2024-02-10T08:39:32.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:39:31.165667+0000 mon.a (mon.0) 1793 : audit [INF] from='client.? 172.21.15.18:0/1107819735' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:39:32.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:39:31.704290+0000 mon.a (mon.0) 1794 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:39:32.041 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a33c0fdb:::benchmark_data_smithi018_166993_object29681:head# 2024-02-10T08:39:32.042 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.042 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a33c4f39:::benchmark_data_smithi018_166993_object85381:head# 2024-02-10T08:39:32.042 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.042 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a33c60bf:::benchmark_data_smithi018_166993_object95531:head# 2024-02-10T08:39:32.042 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.042 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a33c9508:::benchmark_data_smithi018_166993_object77371:head# 2024-02-10T08:39:32.042 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.042 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a33dbca4:::benchmark_data_smithi018_166993_object61233:head# 2024-02-10T08:39:32.042 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.042 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a33eb886:::benchmark_data_smithi018_166993_object84725:head# 2024-02-10T08:39:32.042 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.042 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a33fcda8:::benchmark_data_smithi018_166993_object108020:head# 2024-02-10T08:39:32.042 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.042 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3400785:::benchmark_data_smithi018_166993_object60344:head# 2024-02-10T08:39:32.042 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.043 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3401af2:::benchmark_data_smithi018_166993_object25940:head# 2024-02-10T08:39:32.043 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.043 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3412864:::benchmark_data_smithi018_166993_object21566:head# 2024-02-10T08:39:32.043 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.043 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3414e34:::benchmark_data_smithi018_166993_object87268:head# 2024-02-10T08:39:32.043 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.043 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3418f39:::benchmark_data_smithi018_166993_object34594:head# 2024-02-10T08:39:32.044 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.044 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a34198fc:::benchmark_data_smithi018_166993_object104220:head# 2024-02-10T08:39:32.044 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.044 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a343cc8d:::benchmark_data_smithi018_166993_object40750:head# 2024-02-10T08:39:32.044 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.047 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a343d7f3:::benchmark_data_smithi018_166993_object117589:head# 2024-02-10T08:39:32.047 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.047 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3455878:::benchmark_data_smithi018_166993_object27056:head# 2024-02-10T08:39:32.047 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.047 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a345e3f5:::benchmark_data_smithi018_166993_object29688:head# 2024-02-10T08:39:32.048 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.049 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3460f23:::benchmark_data_smithi018_166993_object69487:head# 2024-02-10T08:39:32.049 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.049 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a346f8e4:::benchmark_data_smithi018_166993_object87886:head# 2024-02-10T08:39:32.049 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.049 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3471693:::benchmark_data_smithi018_166993_object61351:head# 2024-02-10T08:39:32.049 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.049 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a347b77f:::benchmark_data_smithi018_166993_object58652:head# 2024-02-10T08:39:32.049 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.049 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a347cb81:::benchmark_data_smithi018_166993_object80546:head# 2024-02-10T08:39:32.049 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.053 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a348f754:::benchmark_data_smithi018_166993_object117618:head# 2024-02-10T08:39:32.053 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.053 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3498481:::benchmark_data_smithi018_166993_object24009:head# 2024-02-10T08:39:32.053 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.054 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a349b605:::benchmark_data_smithi018_166993_object109995:head# 2024-02-10T08:39:32.054 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.054 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a349d0ed:::benchmark_data_smithi018_166993_object62309:head# 2024-02-10T08:39:32.055 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.055 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a34a0b80:::benchmark_data_smithi018_166993_object104755:head# 2024-02-10T08:39:32.055 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.055 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a34cda79:::benchmark_data_smithi018_166993_object23749:head# 2024-02-10T08:39:32.055 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.055 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a34d8411:::benchmark_data_smithi018_166993_object60495:head# 2024-02-10T08:39:32.055 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.055 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a34dd57a:::benchmark_data_smithi018_166993_object32046:head# 2024-02-10T08:39:32.055 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.055 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a34e0a6a:::benchmark_data_smithi018_166993_object26262:head# 2024-02-10T08:39:32.056 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.057 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a34e12fb:::benchmark_data_smithi018_166993_object103486:head# 2024-02-10T08:39:32.057 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.059 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a34e69fe:::benchmark_data_smithi018_166993_object102856:head# 2024-02-10T08:39:32.059 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.059 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3518b71:::benchmark_data_smithi018_166993_object30723:head# 2024-02-10T08:39:32.059 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.059 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3535355:::benchmark_data_smithi018_166993_object70454:head# 2024-02-10T08:39:32.059 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.059 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a35372d8:::benchmark_data_smithi018_166993_object31839:head# 2024-02-10T08:39:32.059 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.059 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3542406:::benchmark_data_smithi018_166993_object102127:head# 2024-02-10T08:39:32.059 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.059 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a354c5e3:::benchmark_data_smithi018_166993_object100383:head# 2024-02-10T08:39:32.060 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.060 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3559567:::benchmark_data_smithi018_166993_object117750:head# 2024-02-10T08:39:32.060 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.060 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a355efdd:::benchmark_data_smithi018_166993_object56841:head# 2024-02-10T08:39:32.060 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.061 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a357b648:::benchmark_data_smithi018_166993_object78775:head# 2024-02-10T08:39:32.061 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.061 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a358c588:::benchmark_data_smithi018_166993_object72107:head# 2024-02-10T08:39:32.061 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.061 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a358da74:::benchmark_data_smithi018_166993_object21119:head# 2024-02-10T08:39:32.061 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.061 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a358f787:::benchmark_data_smithi018_166993_object20784:head# 2024-02-10T08:39:32.061 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.061 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3597d89:::benchmark_data_smithi018_166993_object116640:head# 2024-02-10T08:39:32.061 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.061 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3599522:::benchmark_data_smithi018_166993_object63739:head# 2024-02-10T08:39:32.061 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.061 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a35a3d7d:::benchmark_data_smithi018_166993_object83872:head# 2024-02-10T08:39:32.062 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.062 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a35baf81:::benchmark_data_smithi018_166993_object86631:head# 2024-02-10T08:39:32.062 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.062 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a35bd4ab:::benchmark_data_smithi018_166993_object38838:head# 2024-02-10T08:39:32.063 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.063 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a35de0e6:::benchmark_data_smithi018_166993_object31618:head# 2024-02-10T08:39:32.063 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.063 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a35e619c:::benchmark_data_smithi018_166993_object100423:head# 2024-02-10T08:39:32.063 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.063 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a35fb71c:::benchmark_data_smithi018_166993_object35819:head# 2024-02-10T08:39:32.063 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.063 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a35fb98e:::benchmark_data_smithi018_166993_object46325:head# 2024-02-10T08:39:32.063 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.068 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a361ab2f:::benchmark_data_smithi018_166993_object38529:head# 2024-02-10T08:39:32.068 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.071 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3621746:::benchmark_data_smithi018_166993_object47954:head# 2024-02-10T08:39:32.071 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.073 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a362520a:::benchmark_data_smithi018_166993_object49586:head# 2024-02-10T08:39:32.073 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.074 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3634a3a:::benchmark_data_smithi018_166993_object75252:head# 2024-02-10T08:39:32.074 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.074 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a364649c:::benchmark_data_smithi018_166993_object62711:head# 2024-02-10T08:39:32.074 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.075 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3672381:::benchmark_data_smithi018_166993_object86580:head# 2024-02-10T08:39:32.075 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.075 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a36aa36a:::benchmark_data_smithi018_166993_object22224:head# 2024-02-10T08:39:32.075 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.075 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a36accd6:::benchmark_data_smithi018_166993_object78537:head# 2024-02-10T08:39:32.075 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.076 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a36d25bf:::benchmark_data_smithi018_166993_object25468:head# 2024-02-10T08:39:32.076 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.076 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a36d941e:::benchmark_data_smithi018_166993_object93975:head# 2024-02-10T08:39:32.077 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.077 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a36dcee4:::benchmark_data_smithi018_166993_object44943:head# 2024-02-10T08:39:32.077 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.077 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a36ddf61:::benchmark_data_smithi018_166993_object31105:head# 2024-02-10T08:39:32.077 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.077 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a36e2253:::benchmark_data_smithi018_166993_object95865:head# 2024-02-10T08:39:32.077 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.077 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a36ec786:::benchmark_data_smithi018_166993_object81052:head# 2024-02-10T08:39:32.077 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.078 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a36fb0dd:::benchmark_data_smithi018_166993_object98709:head# 2024-02-10T08:39:32.078 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.078 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a37035e5:::benchmark_data_smithi018_166993_object92091:head# 2024-02-10T08:39:32.078 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.078 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a371b343:::benchmark_data_smithi018_166993_object96744:head# 2024-02-10T08:39:32.078 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.078 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3727bc8:::benchmark_data_smithi018_166993_object33996:head# 2024-02-10T08:39:32.078 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.078 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3729525:::benchmark_data_smithi018_166993_object36011:head# 2024-02-10T08:39:32.079 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.080 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3732f3c:::benchmark_data_smithi018_166993_object77056:head# 2024-02-10T08:39:32.080 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.080 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a373ba01:::benchmark_data_smithi018_166993_object69158:head# 2024-02-10T08:39:32.080 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.080 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3747f4a:::benchmark_data_smithi018_166993_object35129:head# 2024-02-10T08:39:32.080 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.080 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3754323:::benchmark_data_smithi018_166993_object57956:head# 2024-02-10T08:39:32.080 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.080 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a375758b:::benchmark_data_smithi018_166993_object72172:head# 2024-02-10T08:39:32.080 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.086 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3759f79:::benchmark_data_smithi018_166993_object89444:head# 2024-02-10T08:39:32.087 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.087 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3768c94:::benchmark_data_smithi018_166993_object92962:head# 2024-02-10T08:39:32.087 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.087 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a376aff9:::benchmark_data_smithi018_166993_object95121:head# 2024-02-10T08:39:32.087 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.087 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a376b9de:::benchmark_data_smithi018_166993_object30515:head# 2024-02-10T08:39:32.087 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.087 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3778eff:::benchmark_data_smithi018_166993_object76638:head# 2024-02-10T08:39:32.087 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.087 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a377dcf4:::benchmark_data_smithi018_166993_object41636:head# 2024-02-10T08:39:32.088 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.091 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a37806b6:::benchmark_data_smithi018_166993_object81264:head# 2024-02-10T08:39:32.091 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.091 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3785127:::benchmark_data_smithi018_166993_object88005:head# 2024-02-10T08:39:32.091 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.091 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a378d681:::benchmark_data_smithi018_166993_object48132:head# 2024-02-10T08:39:32.091 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.092 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a37979ed:::benchmark_data_smithi018_166993_object32108:head# 2024-02-10T08:39:32.092 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.092 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a37a688b:::benchmark_data_smithi018_166993_object72621:head# 2024-02-10T08:39:32.092 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.092 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a37b1801:::benchmark_data_smithi018_166993_object49784:head# 2024-02-10T08:39:32.092 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.092 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a37b619d:::benchmark_data_smithi018_166993_object94328:head# 2024-02-10T08:39:32.092 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.103 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a37b854d:::benchmark_data_smithi018_166993_object100373:head# 2024-02-10T08:39:32.103 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.103 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a37b9395:::benchmark_data_smithi018_166993_object99863:head# 2024-02-10T08:39:32.103 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.117 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a37c0e74:::benchmark_data_smithi018_166993_object41900:head# 2024-02-10T08:39:32.117 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.117 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a37c8524:::benchmark_data_smithi018_166993_object27248:head# 2024-02-10T08:39:32.118 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.118 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a37cc492:::benchmark_data_smithi018_166993_object35132:head# 2024-02-10T08:39:32.118 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.118 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a37d0ffa:::benchmark_data_smithi018_166993_object56587:head# 2024-02-10T08:39:32.118 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.118 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a37d22ce:::benchmark_data_smithi018_166993_object43486:head# 2024-02-10T08:39:32.118 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.118 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a37f35a6:::benchmark_data_smithi018_166993_object58335:head# 2024-02-10T08:39:32.118 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.118 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a380725c:::benchmark_data_smithi018_166993_object39806:head# 2024-02-10T08:39:32.118 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.118 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a380a863:::benchmark_data_smithi018_166993_object57212:head# 2024-02-10T08:39:32.118 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.118 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3826c86:::benchmark_data_smithi018_166993_object32543:head# 2024-02-10T08:39:32.119 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.119 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is set 2024-02-10T08:39:32.120 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a38328a4:::benchmark_data_smithi018_166993_object59223:head# 2024-02-10T08:39:32.121 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.121 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a38351a5:::benchmark_data_smithi018_166993_object108016:head# 2024-02-10T08:39:32.121 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.121 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a383580b:::benchmark_data_smithi018_166993_object60971:head# 2024-02-10T08:39:32.121 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.121 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3836a7a:::benchmark_data_smithi018_166993_object55639:head# 2024-02-10T08:39:32.121 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.121 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3836bb0:::benchmark_data_smithi018_166993_object48368:head# 2024-02-10T08:39:32.121 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.121 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a38375ef:::benchmark_data_smithi018_166993_object97721:head# 2024-02-10T08:39:32.121 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.121 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a383abb7:::benchmark_data_smithi018_166993_object102312:head# 2024-02-10T08:39:32.121 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.121 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3841eae:::benchmark_data_smithi018_166993_object105118:head# 2024-02-10T08:39:32.121 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.122 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3853eee:::benchmark_data_smithi018_166993_object63318:head# 2024-02-10T08:39:32.122 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.122 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a385cc44:::benchmark_data_smithi018_166993_object85713:head# 2024-02-10T08:39:32.122 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.123 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a387a8b3:::benchmark_data_smithi018_166993_object98868:head# 2024-02-10T08:39:32.123 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.123 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3896904:::benchmark_data_smithi018_166993_object71132:head# 2024-02-10T08:39:32.124 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.124 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a38993d5:::benchmark_data_smithi018_166993_object64359:head# 2024-02-10T08:39:32.124 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.124 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a38a3c95:::benchmark_data_smithi018_166993_object93047:head# 2024-02-10T08:39:32.124 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.124 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a38a6681:::benchmark_data_smithi018_166993_object79810:head# 2024-02-10T08:39:32.124 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.124 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a38adbe2:::benchmark_data_smithi018_166993_object36002:head# 2024-02-10T08:39:32.124 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.124 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a38ae597:::benchmark_data_smithi018_166993_object21891:head# 2024-02-10T08:39:32.124 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.127 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a38b8cfb:::benchmark_data_smithi018_166993_object114457:head# 2024-02-10T08:39:32.127 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.130 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a38bc030:::benchmark_data_smithi018_166993_object103008:head# 2024-02-10T08:39:32.130 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.130 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a38e9d63:::benchmark_data_smithi018_166993_object54674:head# 2024-02-10T08:39:32.130 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.145 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:39:31.037001+0000 mon.a (mon.0) 1792 : cluster [WRN] Health check update: Degraded data redundancy: 19026/197964 objects degraded (9.611%), 5 pgs degraded (PG_DEGRADED) 2024-02-10T08:39:32.145 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:39:31.165667+0000 mon.a (mon.0) 1793 : audit [INF] from='client.? 172.21.15.18:0/1107819735' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:39:32.145 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:39:31.704290+0000 mon.a (mon.0) 1794 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:39:32.146 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:39:31.037001+0000 mon.a (mon.0) 1792 : cluster [WRN] Health check update: Degraded data redundancy: 19026/197964 objects degraded (9.611%), 5 pgs degraded (PG_DEGRADED) 2024-02-10T08:39:32.146 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:39:31.165667+0000 mon.a (mon.0) 1793 : audit [INF] from='client.? 172.21.15.18:0/1107819735' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:39:32.146 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:39:31.704290+0000 mon.a (mon.0) 1794 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:39:32.147 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:39:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:39:31.709+0000 7f52ba297700 -1 mgr get_metadata_python Requested missing service osd.7 2024-02-10T08:39:32.152 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a38f8655:::benchmark_data_smithi018_166993_object103427:head# 2024-02-10T08:39:32.152 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.152 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a38fa814:::benchmark_data_smithi018_166993_object43171:head# 2024-02-10T08:39:32.152 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.153 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a38fbdc6:::benchmark_data_smithi018_166993_object69643:head# 2024-02-10T08:39:32.153 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.153 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a38ffcea:::benchmark_data_smithi018_166993_object75042:head# 2024-02-10T08:39:32.153 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.153 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3911ba4:::benchmark_data_smithi018_166993_object42967:head# 2024-02-10T08:39:32.154 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.154 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3914c85:::benchmark_data_smithi018_166993_object41347:head# 2024-02-10T08:39:32.154 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.154 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3918c3e:::benchmark_data_smithi018_166993_object64849:head# 2024-02-10T08:39:32.154 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.154 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a391a11f:::benchmark_data_smithi018_166993_object31846:head# 2024-02-10T08:39:32.154 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.160 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a393790b:::benchmark_data_smithi018_166993_object117247:head# 2024-02-10T08:39:32.160 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.161 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a395a9cc:::benchmark_data_smithi018_166993_object45946:head# 2024-02-10T08:39:32.161 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.161 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a395e75f:::benchmark_data_smithi018_166993_object63380:head# 2024-02-10T08:39:32.161 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.161 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3965726:::benchmark_data_smithi018_166993_object100096:head# 2024-02-10T08:39:32.161 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.161 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3969c29:::benchmark_data_smithi018_166993_object55198:head# 2024-02-10T08:39:32.161 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.161 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a39704bc:::benchmark_data_smithi018_166993_object84395:head# 2024-02-10T08:39:32.161 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.161 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3979118:::benchmark_data_smithi018_166993_object75046:head# 2024-02-10T08:39:32.161 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.161 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a397ca57:::benchmark_data_smithi018_166993_object85368:head# 2024-02-10T08:39:32.161 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.161 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3988ac2:::benchmark_data_smithi018_166993_object73953:head# 2024-02-10T08:39:32.162 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.163 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3988fe2:::benchmark_data_smithi018_166993_object101215:head# 2024-02-10T08:39:32.163 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.163 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3991c3a:::benchmark_data_smithi018_166993_object33502:head# 2024-02-10T08:39:32.163 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.163 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3994c0a:::benchmark_data_smithi018_166993_object79422:head# 2024-02-10T08:39:32.163 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.163 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a39a4e0a:::benchmark_data_smithi018_166993_object84755:head# 2024-02-10T08:39:32.163 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.163 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a39a73b8:::benchmark_data_smithi018_166993_object113991:head# 2024-02-10T08:39:32.163 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.163 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a39a8c5d:::benchmark_data_smithi018_166993_object102158:head# 2024-02-10T08:39:32.164 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.164 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a39ae69d:::benchmark_data_smithi018_166993_object57342:head# 2024-02-10T08:39:32.164 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.164 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a39ca4cb:::benchmark_data_smithi018_166993_object45173:head# 2024-02-10T08:39:32.164 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.164 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a39d6ffe:::benchmark_data_smithi018_166993_object22100:head# 2024-02-10T08:39:32.164 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.164 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a39dba63:::benchmark_data_smithi018_166993_object65804:head# 2024-02-10T08:39:32.164 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.164 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a39dc124:::benchmark_data_smithi018_166993_object79856:head# 2024-02-10T08:39:32.164 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.164 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a39e6d8c:::benchmark_data_smithi018_166993_object60761:head# 2024-02-10T08:39:32.164 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.165 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a39e705e:::benchmark_data_smithi018_166993_object54380:head# 2024-02-10T08:39:32.165 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.165 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a39f0291:::benchmark_data_smithi018_166993_object27574:head# 2024-02-10T08:39:32.165 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.165 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a39fae92:::benchmark_data_smithi018_166993_object43503:head# 2024-02-10T08:39:32.165 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.166 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3a0c283:::benchmark_data_smithi018_166993_object90653:head# 2024-02-10T08:39:32.166 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.166 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3a1a583:::benchmark_data_smithi018_166993_object36265:head# 2024-02-10T08:39:32.166 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.166 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:39:32.167 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3a27e25:::benchmark_data_smithi018_166993_object105062:head# 2024-02-10T08:39:32.167 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.167 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3a3621b:::benchmark_data_smithi018_166993_object109792:head# 2024-02-10T08:39:32.167 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.167 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3a38f65:::benchmark_data_smithi018_166993_object21204:head# 2024-02-10T08:39:32.167 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.168 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3a5137c:::benchmark_data_smithi018_166993_object113717:head# 2024-02-10T08:39:32.168 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.168 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3a56b31:::benchmark_data_smithi018_166993_object23152:head# 2024-02-10T08:39:32.168 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.168 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3a6b22f:::benchmark_data_smithi018_166993_object52496:head# 2024-02-10T08:39:32.169 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.169 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3a729b3:::benchmark_data_smithi018_166993_object35128:head# 2024-02-10T08:39:32.169 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.169 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3a7704c:::benchmark_data_smithi018_166993_object50104:head# 2024-02-10T08:39:32.169 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.170 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3a971d3:::benchmark_data_smithi018_166993_object48707:head# 2024-02-10T08:39:32.170 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.170 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3a98b6f:::benchmark_data_smithi018_166993_object93246:head# 2024-02-10T08:39:32.170 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.170 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3a9f680:::benchmark_data_smithi018_166993_object56522:head# 2024-02-10T08:39:32.170 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.170 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3aa2b88:::benchmark_data_smithi018_166993_object54511:head# 2024-02-10T08:39:32.170 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.171 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3ad4fa9:::benchmark_data_smithi018_166993_object64150:head# 2024-02-10T08:39:32.171 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.171 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3ada040:::benchmark_data_smithi018_166993_object92282:head# 2024-02-10T08:39:32.171 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.171 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3ae7d51:::benchmark_data_smithi018_166993_object118447:head# 2024-02-10T08:39:32.172 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.172 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3aef9dc:::benchmark_data_smithi018_166993_object37823:head# 2024-02-10T08:39:32.172 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.172 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3af0b25:::benchmark_data_smithi018_166993_object111663:head# 2024-02-10T08:39:32.172 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.172 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3af9657:::benchmark_data_smithi018_166993_object19607:head# 2024-02-10T08:39:32.172 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.173 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:32.174 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:39:32.175 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3b04c3f:::benchmark_data_smithi018_166993_object43791:head# 2024-02-10T08:39:32.175 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.175 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3b05a49:::benchmark_data_smithi018_166993_object82007:head# 2024-02-10T08:39:32.175 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.175 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3b07373:::benchmark_data_smithi018_166993_object51212:head# 2024-02-10T08:39:32.175 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.175 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3b0df97:::benchmark_data_smithi018_166993_object80520:head# 2024-02-10T08:39:32.175 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.175 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3b179e8:::benchmark_data_smithi018_166993_object107541:head# 2024-02-10T08:39:32.175 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.176 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3b1af4f:::benchmark_data_smithi018_166993_object84059:head# 2024-02-10T08:39:32.176 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.176 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3b23c69:::benchmark_data_smithi018_166993_object77689:head# 2024-02-10T08:39:32.176 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.176 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3b2e16b:::benchmark_data_smithi018_166993_object95364:head# 2024-02-10T08:39:32.176 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.176 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3b33283:::benchmark_data_smithi018_166993_object48084:head# 2024-02-10T08:39:32.176 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.176 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3b3fb41:::benchmark_data_smithi018_166993_object19484:head# 2024-02-10T08:39:32.176 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.176 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3b467e3:::benchmark_data_smithi018_166993_object94472:head# 2024-02-10T08:39:32.176 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.176 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3b59160:::benchmark_data_smithi018_166993_object23639:head# 2024-02-10T08:39:32.176 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.177 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3b5eb9c:::benchmark_data_smithi018_166993_object67530:head# 2024-02-10T08:39:32.177 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.179 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3b68922:::benchmark_data_smithi018_166993_object86937:head# 2024-02-10T08:39:32.179 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.181 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3b6fa6d:::benchmark_data_smithi018_166993_object83825:head# 2024-02-10T08:39:32.181 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.181 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3b89e36:::benchmark_data_smithi018_166993_object20172:head# 2024-02-10T08:39:32.181 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.181 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3b8ada2:::benchmark_data_smithi018_166993_object95821:head# 2024-02-10T08:39:32.181 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.181 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3b950ac:::benchmark_data_smithi018_166993_object102593:head# 2024-02-10T08:39:32.182 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.182 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3ba613f:::benchmark_data_smithi018_166993_object73134:head# 2024-02-10T08:39:32.182 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.182 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3ba7f2a:::benchmark_data_smithi018_166993_object96513:head# 2024-02-10T08:39:32.182 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.182 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3bab8cb:::benchmark_data_smithi018_166993_object96243:head# 2024-02-10T08:39:32.182 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.183 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3bbc275:::benchmark_data_smithi018_166993_object53256:head# 2024-02-10T08:39:32.183 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.183 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3bcdde5:::benchmark_data_smithi018_166993_object61672:head# 2024-02-10T08:39:32.183 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.183 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3be060a:::benchmark_data_smithi018_166993_object118639:head# 2024-02-10T08:39:32.183 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.183 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3be8c05:::benchmark_data_smithi018_166993_object102465:head# 2024-02-10T08:39:32.183 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.183 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3bf502d:::benchmark_data_smithi018_166993_object118350:head# 2024-02-10T08:39:32.183 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.184 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3bf861c:::benchmark_data_smithi018_166993_object47169:head# 2024-02-10T08:39:32.184 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.185 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3bfcefe:::benchmark_data_smithi018_166993_object26051:head# 2024-02-10T08:39:32.185 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.185 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3c0f6ba:::benchmark_data_smithi018_166993_object106848:head# 2024-02-10T08:39:32.185 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.185 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3c1bc47:::benchmark_data_smithi018_166993_object95200:head# 2024-02-10T08:39:32.185 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.185 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3c1d0c4:::benchmark_data_smithi018_166993_object113476:head# 2024-02-10T08:39:32.185 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.185 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3c214e3:::benchmark_data_smithi018_166993_object95480:head# 2024-02-10T08:39:32.185 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.185 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3c33a72:::benchmark_data_smithi018_166993_object86051:head# 2024-02-10T08:39:32.186 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.187 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3c428b9:::benchmark_data_smithi018_166993_object66343:head# 2024-02-10T08:39:32.187 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.192 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3c4e098:::benchmark_data_smithi018_166993_object93175:head# 2024-02-10T08:39:32.192 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.196 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3c4ea68:::benchmark_data_smithi018_166993_object63618:head# 2024-02-10T08:39:32.197 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.197 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3c56570:::benchmark_data_smithi018_166993_object71349:head# 2024-02-10T08:39:32.197 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.197 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3c61419:::benchmark_data_smithi018_166993_object49929:head# 2024-02-10T08:39:32.197 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.197 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3c64bb4:::benchmark_data_smithi018_166993_object66281:head# 2024-02-10T08:39:32.197 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.197 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3c70035:::benchmark_data_smithi018_166993_object18526:head# 2024-02-10T08:39:32.197 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.197 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3c7373b:::benchmark_data_smithi018_166993_object44179:head# 2024-02-10T08:39:32.197 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.198 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3c74011:::benchmark_data_smithi018_166993_object44788:head# 2024-02-10T08:39:32.198 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.199 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3c7967f:::benchmark_data_smithi018_166993_object72920:head# 2024-02-10T08:39:32.199 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.199 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3c7a22d:::benchmark_data_smithi018_166993_object37685:head# 2024-02-10T08:39:32.199 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.199 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3c7c790:::benchmark_data_smithi018_166993_object117922:head# 2024-02-10T08:39:32.199 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.199 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3c7d073:::benchmark_data_smithi018_166993_object61300:head# 2024-02-10T08:39:32.199 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.199 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3c7e890:::benchmark_data_smithi018_166993_object67449:head# 2024-02-10T08:39:32.199 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.199 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3c84003:::benchmark_data_smithi018_166993_object76670:head# 2024-02-10T08:39:32.199 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.201 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3c87c1d:::benchmark_data_smithi018_166993_object33696:head# 2024-02-10T08:39:32.201 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.201 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3c8869c:::benchmark_data_smithi018_166993_object22732:head# 2024-02-10T08:39:32.201 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.201 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3c89c59:::benchmark_data_smithi018_166993_object83610:head# 2024-02-10T08:39:32.201 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.201 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3c91119:::benchmark_data_smithi018_166993_object59807:head# 2024-02-10T08:39:32.201 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.201 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3c93798:::benchmark_data_smithi018_166993_object48861:head# 2024-02-10T08:39:32.201 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.201 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3c95d18:::benchmark_data_smithi018_166993_object117116:head# 2024-02-10T08:39:32.202 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.202 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3ca440a:::benchmark_data_smithi018_166993_object67576:head# 2024-02-10T08:39:32.202 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.202 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3cafc77:::benchmark_data_smithi018_166993_object102681:head# 2024-02-10T08:39:32.202 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.202 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3cb0d05:::benchmark_data_smithi018_166993_object42067:head# 2024-02-10T08:39:32.202 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.205 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3cb2b0c:::benchmark_data_smithi018_166993_object24114:head# 2024-02-10T08:39:32.205 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.205 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3cc120a:::benchmark_data_smithi018_166993_object44234:head# 2024-02-10T08:39:32.205 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.206 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3cd199a:::benchmark_data_smithi018_166993_object112998:head# 2024-02-10T08:39:32.206 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.206 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3cda09e:::benchmark_data_smithi018_166993_object94492:head# 2024-02-10T08:39:32.206 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.206 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3ce10d2:::benchmark_data_smithi018_166993_object76054:head# 2024-02-10T08:39:32.206 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.206 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3cfd83e:::benchmark_data_smithi018_166993_object83617:head# 2024-02-10T08:39:32.206 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.206 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3d02bf3:::benchmark_data_smithi018_166993_object43041:head# 2024-02-10T08:39:32.206 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.206 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3d067f8:::benchmark_data_smithi018_166993_object52010:head# 2024-02-10T08:39:32.206 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.206 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3d085da:::benchmark_data_smithi018_166993_object89407:head# 2024-02-10T08:39:32.206 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.207 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3d16976:::benchmark_data_smithi018_166993_object106074:head# 2024-02-10T08:39:32.207 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.207 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3d28e31:::benchmark_data_smithi018_166993_object71247:head# 2024-02-10T08:39:32.207 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.207 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3d2e556:::benchmark_data_smithi018_166993_object19409:head# 2024-02-10T08:39:32.207 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.207 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3d33a43:::benchmark_data_smithi018_166993_object19677:head# 2024-02-10T08:39:32.207 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.207 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3d3d279:::benchmark_data_smithi018_166993_object52231:head# 2024-02-10T08:39:32.207 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.207 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3d53d62:::benchmark_data_smithi018_166993_object63278:head# 2024-02-10T08:39:32.207 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.207 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3d69dc9:::benchmark_data_smithi018_166993_object55486:head# 2024-02-10T08:39:32.207 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.207 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3d788a4:::benchmark_data_smithi018_166993_object89190:head# 2024-02-10T08:39:32.208 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.208 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3d7b0d8:::benchmark_data_smithi018_166993_object40313:head# 2024-02-10T08:39:32.208 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.209 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3d87084:::benchmark_data_smithi018_166993_object79502:head# 2024-02-10T08:39:32.209 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.209 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3d89546:::benchmark_data_smithi018_166993_object99119:head# 2024-02-10T08:39:32.209 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.209 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3d8c52b:::benchmark_data_smithi018_166993_object21035:head# 2024-02-10T08:39:32.209 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.209 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3d959e4:::benchmark_data_smithi018_166993_object40429:head# 2024-02-10T08:39:32.209 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.209 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3da9ac9:::benchmark_data_smithi018_166993_object38955:head# 2024-02-10T08:39:32.209 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.209 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3dad00a:::benchmark_data_smithi018_166993_object55094:head# 2024-02-10T08:39:32.209 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.210 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3dbd5aa:::benchmark_data_smithi018_166993_object37675:head# 2024-02-10T08:39:32.210 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.210 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3dc3ed3:::benchmark_data_smithi018_166993_object74359:head# 2024-02-10T08:39:32.210 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.210 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3dcd3ff:::benchmark_data_smithi018_166993_object113799:head# 2024-02-10T08:39:32.210 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.211 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3ddbe6b:::benchmark_data_smithi018_166993_object109090:head# 2024-02-10T08:39:32.211 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.211 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3de9edf:::benchmark_data_smithi018_166993_object86709:head# 2024-02-10T08:39:32.211 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.211 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3deb4c7:::benchmark_data_smithi018_166993_object93110:head# 2024-02-10T08:39:32.211 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.212 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3deb859:::benchmark_data_smithi018_166993_object115428:head# 2024-02-10T08:39:32.212 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.212 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3dfa3fd:::benchmark_data_smithi018_166993_object71203:head# 2024-02-10T08:39:32.212 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.213 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3e03f7e:::benchmark_data_smithi018_166993_object61575:head# 2024-02-10T08:39:32.213 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.213 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3e19ca8:::benchmark_data_smithi018_166993_object96262:head# 2024-02-10T08:39:32.213 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.213 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3e1a43f:::benchmark_data_smithi018_166993_object29265:head# 2024-02-10T08:39:32.213 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.214 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3e1a753:::benchmark_data_smithi018_166993_object20230:head# 2024-02-10T08:39:32.214 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.214 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3e2e4e1:::benchmark_data_smithi018_166993_object110831:head# 2024-02-10T08:39:32.214 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.214 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3e3e142:::benchmark_data_smithi018_166993_object104346:head# 2024-02-10T08:39:32.214 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.214 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3e471f3:::benchmark_data_smithi018_166993_object78439:head# 2024-02-10T08:39:32.214 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.214 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3e4e714:::benchmark_data_smithi018_166993_object114113:head# 2024-02-10T08:39:32.214 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.215 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3e6491d:::benchmark_data_smithi018_166993_object109115:head# 2024-02-10T08:39:32.215 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.216 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3e68cf3:::benchmark_data_smithi018_166993_object102228:head# 2024-02-10T08:39:32.216 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.216 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3e80f1a:::benchmark_data_smithi018_166993_object43728:head# 2024-02-10T08:39:32.216 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.216 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3e82c3b:::benchmark_data_smithi018_166993_object101731:head# 2024-02-10T08:39:32.216 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.216 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3e83d72:::benchmark_data_smithi018_166993_object66703:head# 2024-02-10T08:39:32.216 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.216 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3e96597:::benchmark_data_smithi018_166993_object99267:head# 2024-02-10T08:39:32.216 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.217 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3eaa76f:::benchmark_data_smithi018_166993_object83714:head# 2024-02-10T08:39:32.217 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.217 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3eadb2d:::benchmark_data_smithi018_166993_object17441:head# 2024-02-10T08:39:32.217 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.217 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3eaf9e1:::benchmark_data_smithi018_166993_object50655:head# 2024-02-10T08:39:32.217 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.217 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3ec25f2:::benchmark_data_smithi018_166993_object33170:head# 2024-02-10T08:39:32.217 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.218 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3ec4136:::benchmark_data_smithi018_166993_object55836:head# 2024-02-10T08:39:32.218 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.218 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3ede25f:::benchmark_data_smithi018_166993_object39835:head# 2024-02-10T08:39:32.218 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.218 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3ee42a3:::benchmark_data_smithi018_166993_object21619:head# 2024-02-10T08:39:32.218 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.218 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3eff3ae:::benchmark_data_smithi018_166993_object77385:head# 2024-02-10T08:39:32.219 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.219 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3f0a2f1:::benchmark_data_smithi018_166993_object101249:head# 2024-02-10T08:39:32.219 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.219 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3f0c529:::benchmark_data_smithi018_166993_object20012:head# 2024-02-10T08:39:32.219 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.219 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3f1a799:::benchmark_data_smithi018_166993_object105268:head# 2024-02-10T08:39:32.220 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.220 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3f1a7cd:::benchmark_data_smithi018_166993_object110555:head# 2024-02-10T08:39:32.220 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.220 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3f436c4:::benchmark_data_smithi018_166993_object92439:head# 2024-02-10T08:39:32.221 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.221 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3f4e020:::benchmark_data_smithi018_166993_object58282:head# 2024-02-10T08:39:32.221 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.221 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3f51da0:::benchmark_data_smithi018_166993_object54793:head# 2024-02-10T08:39:32.221 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.221 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3f62cba:::benchmark_data_smithi018_166993_object114147:head# 2024-02-10T08:39:32.221 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.221 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3f6614a:::benchmark_data_smithi018_166993_object97041:head# 2024-02-10T08:39:32.221 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.222 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3f68043:::benchmark_data_smithi018_166993_object114569:head# 2024-02-10T08:39:32.222 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.222 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3f6b822:::benchmark_data_smithi018_166993_object33605:head# 2024-02-10T08:39:32.222 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.225 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3f7be88:::benchmark_data_smithi018_166993_object85342:head# 2024-02-10T08:39:32.225 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.225 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3fa0693:::benchmark_data_smithi018_166993_object53891:head# 2024-02-10T08:39:32.225 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.226 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3fa99af:::benchmark_data_smithi018_166993_object102444:head# 2024-02-10T08:39:32.226 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.226 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3fb7f5e:::benchmark_data_smithi018_166993_object98377:head# 2024-02-10T08:39:32.226 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.226 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3fc007c:::benchmark_data_smithi018_166993_object35701:head# 2024-02-10T08:39:32.226 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.227 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3fc1617:::benchmark_data_smithi018_166993_object77783:head# 2024-02-10T08:39:32.227 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.227 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3fc25a4:::benchmark_data_smithi018_166993_object28778:head# 2024-02-10T08:39:32.227 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.227 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3fd9d92:::benchmark_data_smithi018_166993_object23828:head# 2024-02-10T08:39:32.227 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.227 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3fe25ed:::benchmark_data_smithi018_166993_object23019:head# 2024-02-10T08:39:32.227 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.228 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3fe3dfb:::benchmark_data_smithi018_166993_object105009:head# 2024-02-10T08:39:32.228 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.228 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3fe3e35:::benchmark_data_smithi018_166993_object24908:head# 2024-02-10T08:39:32.228 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.228 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3fec1d7:::benchmark_data_smithi018_166993_object93066:head# 2024-02-10T08:39:32.228 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.228 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a3ff19df:::benchmark_data_smithi018_166993_object61518:head# 2024-02-10T08:39:32.229 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.230 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a40046ef:::benchmark_data_smithi018_166993_object17411:head# 2024-02-10T08:39:32.231 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.237 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a400988b:::benchmark_data_smithi018_166993_object73306:head# 2024-02-10T08:39:32.237 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.238 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4011666:::benchmark_data_smithi018_166993_object50049:head# 2024-02-10T08:39:32.238 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.238 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a40144f6:::benchmark_data_smithi018_166993_object83459:head# 2024-02-10T08:39:32.238 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.240 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4018866:::benchmark_data_smithi018_166993_object54716:head# 2024-02-10T08:39:32.240 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.241 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a402133a:::benchmark_data_smithi018_166993_object113208:head# 2024-02-10T08:39:32.241 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.241 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4024794:::benchmark_data_smithi018_166993_object88503:head# 2024-02-10T08:39:32.241 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.241 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a40256c8:::benchmark_data_smithi018_166993_object80726:head# 2024-02-10T08:39:32.241 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.243 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a402f45b:::benchmark_data_smithi018_166993_object20014:head# 2024-02-10T08:39:32.243 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.243 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a404cff8:::benchmark_data_smithi018_166993_object118052:head# 2024-02-10T08:39:32.243 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.243 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a404eb5f:::benchmark_data_smithi018_166993_object91972:head# 2024-02-10T08:39:32.243 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.243 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a40538e4:::benchmark_data_smithi018_166993_object41986:head# 2024-02-10T08:39:32.243 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.243 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4053efe:::benchmark_data_smithi018_166993_object42051:head# 2024-02-10T08:39:32.243 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.244 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4053f40:::benchmark_data_smithi018_166993_object48230:head# 2024-02-10T08:39:32.244 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.244 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a405d690:::benchmark_data_smithi018_166993_object60668:head# 2024-02-10T08:39:32.244 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.244 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4061498:::benchmark_data_smithi018_166993_object27057:head# 2024-02-10T08:39:32.244 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.244 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4061509:::benchmark_data_smithi018_166993_object30940:head# 2024-02-10T08:39:32.244 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.245 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4065710:::benchmark_data_smithi018_166993_object70958:head# 2024-02-10T08:39:32.245 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.245 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a40767f3:::benchmark_data_smithi018_166993_object48730:head# 2024-02-10T08:39:32.245 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.245 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4076c32:::benchmark_data_smithi018_166993_object82724:head# 2024-02-10T08:39:32.246 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.246 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4077c8f:::benchmark_data_smithi018_166993_object44263:head# 2024-02-10T08:39:32.246 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.246 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4082432:::benchmark_data_smithi018_166993_object56949:head# 2024-02-10T08:39:32.246 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.247 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a40827b1:::benchmark_data_smithi018_166993_object22586:head# 2024-02-10T08:39:32.247 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.247 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a40846de:::benchmark_data_smithi018_166993_object50678:head# 2024-02-10T08:39:32.247 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.248 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4085b3b:::benchmark_data_smithi018_166993_object83684:head# 2024-02-10T08:39:32.248 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.248 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a408c99e:::benchmark_data_smithi018_166993_object100003:head# 2024-02-10T08:39:32.248 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.248 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a40900db:::benchmark_data_smithi018_166993_object37754:head# 2024-02-10T08:39:32.248 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.249 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a40ac900:::benchmark_data_smithi018_166993_object59207:head# 2024-02-10T08:39:32.249 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.249 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a40c2cbe:::benchmark_data_smithi018_166993_object99248:head# 2024-02-10T08:39:32.249 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.251 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a40d0a50:::benchmark_data_smithi018_166993_object22802:head# 2024-02-10T08:39:32.251 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.252 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a40d1c22:::benchmark_data_smithi018_166993_object71912:head# 2024-02-10T08:39:32.252 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.252 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a40e2ef5:::benchmark_data_smithi018_166993_object37386:head# 2024-02-10T08:39:32.252 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.252 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a40e63a0:::benchmark_data_smithi018_166993_object33008:head# 2024-02-10T08:39:32.252 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.252 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a40e6af6:::benchmark_data_smithi018_166993_object109594:head# 2024-02-10T08:39:32.252 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.252 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4105ae1:::benchmark_data_smithi018_166993_object68848:head# 2024-02-10T08:39:32.252 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.252 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4107bba:::benchmark_data_smithi018_166993_object45813:head# 2024-02-10T08:39:32.252 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.252 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a410ee3c:::benchmark_data_smithi018_166993_object88368:head# 2024-02-10T08:39:32.252 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.253 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4113308:::benchmark_data_smithi018_166993_object22625:head# 2024-02-10T08:39:32.253 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.253 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4115662:::benchmark_data_smithi018_166993_object63451:head# 2024-02-10T08:39:32.253 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.253 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a412e2a9:::benchmark_data_smithi018_166993_object76818:head# 2024-02-10T08:39:32.253 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.253 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a413257c:::benchmark_data_smithi018_166993_object31636:head# 2024-02-10T08:39:32.253 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.253 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a413456c:::benchmark_data_smithi018_166993_object104971:head# 2024-02-10T08:39:32.253 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.253 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4134d91:::benchmark_data_smithi018_166993_object81895:head# 2024-02-10T08:39:32.253 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.254 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a41350cc:::benchmark_data_smithi018_166993_object55396:head# 2024-02-10T08:39:32.254 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.254 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a41408b8:::benchmark_data_smithi018_166993_object64515:head# 2024-02-10T08:39:32.254 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.254 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4142a85:::benchmark_data_smithi018_166993_object42447:head# 2024-02-10T08:39:32.254 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.257 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a41522df:::benchmark_data_smithi018_166993_object78029:head# 2024-02-10T08:39:32.257 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.257 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4153a2c:::benchmark_data_smithi018_166993_object21299:head# 2024-02-10T08:39:32.257 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.258 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a415a2df:::benchmark_data_smithi018_166993_object106670:head# 2024-02-10T08:39:32.258 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.260 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a415ce7f:::benchmark_data_smithi018_166993_object89531:head# 2024-02-10T08:39:32.260 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.260 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4160d7b:::benchmark_data_smithi018_166993_object111546:head# 2024-02-10T08:39:32.260 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.261 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4164c9a:::benchmark_data_smithi018_166993_object25173:head# 2024-02-10T08:39:32.261 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.262 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4170557:::benchmark_data_smithi018_166993_object107061:head# 2024-02-10T08:39:32.262 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.262 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4187341:::benchmark_data_smithi018_166993_object35418:head# 2024-02-10T08:39:32.262 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.262 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a41a09b7:::benchmark_data_smithi018_166993_object64661:head# 2024-02-10T08:39:32.263 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.263 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a41af3d7:::benchmark_data_smithi018_166993_object52041:head# 2024-02-10T08:39:32.263 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.263 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a41b2ce9:::benchmark_data_smithi018_166993_object51860:head# 2024-02-10T08:39:32.263 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.263 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a41b385d:::benchmark_data_smithi018_166993_object115677:head# 2024-02-10T08:39:32.264 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.264 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a41b53c3:::benchmark_data_smithi018_166993_object108679:head# 2024-02-10T08:39:32.264 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.264 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a41c3d1a:::benchmark_data_smithi018_166993_object18655:head# 2024-02-10T08:39:32.264 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.265 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a41dc230:::benchmark_data_smithi018_166993_object38523:head# 2024-02-10T08:39:32.266 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.266 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a41eead1:::benchmark_data_smithi018_166993_object44051:head# 2024-02-10T08:39:32.266 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.266 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a41ef722:::benchmark_data_smithi018_166993_object43762:head# 2024-02-10T08:39:32.266 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.266 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4219efa:::benchmark_data_smithi018_166993_object107903:head# 2024-02-10T08:39:32.266 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.266 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4227ced:::benchmark_data_smithi018_166993_object82613:head# 2024-02-10T08:39:32.266 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.266 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4227e09:::benchmark_data_smithi018_166993_object83373:head# 2024-02-10T08:39:32.266 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.266 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a422f0ea:::benchmark_data_smithi018_166993_object81247:head# 2024-02-10T08:39:32.266 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.266 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a422fb9a:::benchmark_data_smithi018_166993_object107295:head# 2024-02-10T08:39:32.266 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.269 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4234e37:::benchmark_data_smithi018_166993_object19287:head# 2024-02-10T08:39:32.269 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.269 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a424e4f2:::benchmark_data_smithi018_166993_object77590:head# 2024-02-10T08:39:32.269 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.269 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a42517e3:::benchmark_data_smithi018_166993_object80864:head# 2024-02-10T08:39:32.269 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.269 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4260ba2:::benchmark_data_smithi018_166993_object95303:head# 2024-02-10T08:39:32.269 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.269 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a426787e:::benchmark_data_smithi018_166993_object87229:head# 2024-02-10T08:39:32.270 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.270 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a426da28:::benchmark_data_smithi018_166993_object20125:head# 2024-02-10T08:39:32.270 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.270 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4278003:::benchmark_data_smithi018_166993_object96712:head# 2024-02-10T08:39:32.270 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.270 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a429b6e8:::benchmark_data_smithi018_166993_object115476:head# 2024-02-10T08:39:32.270 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.270 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a429f822:::benchmark_data_smithi018_166993_object45106:head# 2024-02-10T08:39:32.270 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.270 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a42a4611:::benchmark_data_smithi018_166993_object118864:head# 2024-02-10T08:39:32.270 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.270 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a42a86ec:::benchmark_data_smithi018_166993_object94929:head# 2024-02-10T08:39:32.270 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.270 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a42b21f0:::benchmark_data_smithi018_166993_object67188:head# 2024-02-10T08:39:32.270 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.271 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a42b7860:::benchmark_data_smithi018_166993_object33986:head# 2024-02-10T08:39:32.271 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.272 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a42b8a77:::benchmark_data_smithi018_166993_object49354:head# 2024-02-10T08:39:32.272 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.272 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a42cb536:::benchmark_data_smithi018_166993_object53039:head# 2024-02-10T08:39:32.272 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.272 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a42cf11a:::benchmark_data_smithi018_166993_object43826:head# 2024-02-10T08:39:32.272 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.272 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a430ea0d:::benchmark_data_smithi018_166993_object48975:head# 2024-02-10T08:39:32.272 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.272 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a431c5f5:::benchmark_data_smithi018_166993_object77798:head# 2024-02-10T08:39:32.272 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.275 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4320a6a:::benchmark_data_smithi018_166993_object100229:head# 2024-02-10T08:39:32.275 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.275 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4322840:::benchmark_data_smithi018_166993_object88828:head# 2024-02-10T08:39:32.275 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.275 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4328671:::benchmark_data_smithi018_166993_object97792:head# 2024-02-10T08:39:32.275 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.275 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4329725:::benchmark_data_smithi018_166993_object53565:head# 2024-02-10T08:39:32.275 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.275 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a432fc16:::benchmark_data_smithi018_166993_object30129:head# 2024-02-10T08:39:32.275 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.275 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4331dfd:::benchmark_data_smithi018_166993_object28027:head# 2024-02-10T08:39:32.275 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.275 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a433a57d:::benchmark_data_smithi018_166993_object93727:head# 2024-02-10T08:39:32.275 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.276 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a433b940:::benchmark_data_smithi018_166993_object57355:head# 2024-02-10T08:39:32.276 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.276 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a433c560:::benchmark_data_smithi018_166993_object80107:head# 2024-02-10T08:39:32.276 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.276 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:39:32.278 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a43529d9:::benchmark_data_smithi018_166993_object26138:head# 2024-02-10T08:39:32.278 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.278 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4352a3c:::benchmark_data_smithi018_166993_object55611:head# 2024-02-10T08:39:32.278 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.278 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4377170:::benchmark_data_smithi018_166993_object35458:head# 2024-02-10T08:39:32.278 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.278 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a43897de:::benchmark_data_smithi018_166993_object36040:head# 2024-02-10T08:39:32.278 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.278 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a438c660:::benchmark_data_smithi018_166993_object117516:head# 2024-02-10T08:39:32.278 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.278 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4396faf:::benchmark_data_smithi018_166993_object36866:head# 2024-02-10T08:39:32.278 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.279 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4398a15:::benchmark_data_smithi018_166993_object63170:head# 2024-02-10T08:39:32.279 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.279 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a43a394e:::benchmark_data_smithi018_166993_object22597:head# 2024-02-10T08:39:32.279 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.279 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a43b219d:::benchmark_data_smithi018_166993_object110639:head# 2024-02-10T08:39:32.279 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.279 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a43b42dd:::benchmark_data_smithi018_166993_object45074:head# 2024-02-10T08:39:32.279 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.279 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a43c18dd:::benchmark_data_smithi018_166993_object79461:head# 2024-02-10T08:39:32.279 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.281 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a43c7a92:::benchmark_data_smithi018_166993_object36891:head# 2024-02-10T08:39:32.281 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.281 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a43d5754:::benchmark_data_smithi018_166993_object60808:head# 2024-02-10T08:39:32.281 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.282 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a43da891:::benchmark_data_smithi018_166993_object73655:head# 2024-02-10T08:39:32.282 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.282 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a43e462f:::benchmark_data_smithi018_166993_object71857:head# 2024-02-10T08:39:32.282 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.282 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a43f47eb:::benchmark_data_smithi018_166993_object116876:head# 2024-02-10T08:39:32.282 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.282 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a43f5acf:::benchmark_data_smithi018_166993_object110499:head# 2024-02-10T08:39:32.282 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.282 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4406168:::benchmark_data_smithi018_166993_object23247:head# 2024-02-10T08:39:32.282 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.282 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4408c53:::benchmark_data_smithi018_166993_object93759:head# 2024-02-10T08:39:32.282 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.282 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a440afa4:::benchmark_data_smithi018_166993_object39201:head# 2024-02-10T08:39:32.282 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.282 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4412a41:::benchmark_data_smithi018_166993_object101822:head# 2024-02-10T08:39:32.283 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.283 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4416614:::benchmark_data_smithi018_166993_object118042:head# 2024-02-10T08:39:32.283 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.283 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4427f02:::benchmark_data_smithi018_166993_object72982:head# 2024-02-10T08:39:32.283 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.283 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4430405:::benchmark_data_smithi018_166993_object23777:head# 2024-02-10T08:39:32.283 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.285 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a44329ed:::benchmark_data_smithi018_166993_object33773:head# 2024-02-10T08:39:32.285 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.285 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4438642:::benchmark_data_smithi018_166993_object29960:head# 2024-02-10T08:39:32.285 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.285 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a443c74c:::benchmark_data_smithi018_166993_object51938:head# 2024-02-10T08:39:32.285 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.285 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a444fb23:::benchmark_data_smithi018_166993_object88055:head# 2024-02-10T08:39:32.285 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.285 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a445485e:::benchmark_data_smithi018_166993_object71175:head# 2024-02-10T08:39:32.286 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.286 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4461271:::benchmark_data_smithi018_166993_object72685:head# 2024-02-10T08:39:32.286 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.286 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a447963e:::benchmark_data_smithi018_166993_object57715:head# 2024-02-10T08:39:32.286 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.286 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a447a519:::benchmark_data_smithi018_166993_object103038:head# 2024-02-10T08:39:32.286 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.286 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4493d8e:::benchmark_data_smithi018_166993_object81263:head# 2024-02-10T08:39:32.286 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.286 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a44a13d0:::benchmark_data_smithi018_166993_object113747:head# 2024-02-10T08:39:32.286 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.286 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a44a3d61:::benchmark_data_smithi018_166993_object24292:head# 2024-02-10T08:39:32.286 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.286 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a44a5dd0:::benchmark_data_smithi018_166993_object70953:head# 2024-02-10T08:39:32.287 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.288 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a44ab726:::benchmark_data_smithi018_166993_object81273:head# 2024-02-10T08:39:32.288 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.288 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a44b2177:::benchmark_data_smithi018_166993_object35809:head# 2024-02-10T08:39:32.288 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.288 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a44b2f45:::benchmark_data_smithi018_166993_object52964:head# 2024-02-10T08:39:32.288 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.288 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a44b3d4e:::benchmark_data_smithi018_166993_object112701:head# 2024-02-10T08:39:32.288 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.289 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a44b684a:::benchmark_data_smithi018_166993_object48723:head# 2024-02-10T08:39:32.289 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.289 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a44bd5c4:::benchmark_data_smithi018_166993_object36471:head# 2024-02-10T08:39:32.289 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.290 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a44ccc17:::benchmark_data_smithi018_166993_object23381:head# 2024-02-10T08:39:32.290 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.290 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a44e0ca4:::benchmark_data_smithi018_166993_object87141:head# 2024-02-10T08:39:32.290 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.290 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a44eb10a:::benchmark_data_smithi018_166993_object78039:head# 2024-02-10T08:39:32.290 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.290 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a450ea11:::benchmark_data_smithi018_166993_object89334:head# 2024-02-10T08:39:32.290 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.291 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a451e81e:::benchmark_data_smithi018_166993_object75468:head# 2024-02-10T08:39:32.292 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.292 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4525270:::benchmark_data_smithi018_166993_object42499:head# 2024-02-10T08:39:32.292 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.292 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a452baf0:::benchmark_data_smithi018_166993_object92084:head# 2024-02-10T08:39:32.292 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.292 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a45330e6:::benchmark_data_smithi018_166993_object58715:head# 2024-02-10T08:39:32.292 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.292 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4535708:::benchmark_data_smithi018_166993_object80351:head# 2024-02-10T08:39:32.292 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.293 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4537121:::benchmark_data_smithi018_166993_object26883:head# 2024-02-10T08:39:32.293 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.293 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a453c059:::benchmark_data_smithi018_166993_object91192:head# 2024-02-10T08:39:32.293 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.293 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a453dae5:::benchmark_data_smithi018_166993_object57935:head# 2024-02-10T08:39:32.294 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.294 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4541ff7:::benchmark_data_smithi018_166993_object103367:head# 2024-02-10T08:39:32.294 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.294 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4554f70:::benchmark_data_smithi018_166993_object32393:head# 2024-02-10T08:39:32.294 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.294 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a455c50a:::benchmark_data_smithi018_166993_object55306:head# 2024-02-10T08:39:32.294 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.294 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a456069a:::benchmark_data_smithi018_166993_object54579:head# 2024-02-10T08:39:32.294 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.296 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4566783:::benchmark_data_smithi018_166993_object43669:head# 2024-02-10T08:39:32.296 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.297 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a45678c8:::benchmark_data_smithi018_166993_object34900:head# 2024-02-10T08:39:32.297 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.297 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4570d42:::benchmark_data_smithi018_166993_object75968:head# 2024-02-10T08:39:32.297 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.297 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a457f15a:::benchmark_data_smithi018_166993_object96927:head# 2024-02-10T08:39:32.297 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.297 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a45846a6:::benchmark_data_smithi018_166993_object71835:head# 2024-02-10T08:39:32.297 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.297 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4586af0:::benchmark_data_smithi018_166993_object75862:head# 2024-02-10T08:39:32.297 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.298 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4587dc8:::benchmark_data_smithi018_166993_object36778:head# 2024-02-10T08:39:32.298 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.299 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a45888eb:::benchmark_data_smithi018_166993_object34389:head# 2024-02-10T08:39:32.299 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.299 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4588f65:::benchmark_data_smithi018_166993_object64054:head# 2024-02-10T08:39:32.299 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.299 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a45915df:::benchmark_data_smithi018_166993_object92220:head# 2024-02-10T08:39:32.299 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.299 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4592654:::benchmark_data_smithi018_166993_object55999:head# 2024-02-10T08:39:32.299 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.300 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4592c7a:::benchmark_data_smithi018_166993_object96058:head# 2024-02-10T08:39:32.300 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.300 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4595b42:::benchmark_data_smithi018_166993_object85557:head# 2024-02-10T08:39:32.300 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.300 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4596d8c:::benchmark_data_smithi018_166993_object67039:head# 2024-02-10T08:39:32.300 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.302 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a459c65e:::benchmark_data_smithi018_166993_object51077:head# 2024-02-10T08:39:32.302 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.303 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a45a77c4:::benchmark_data_smithi018_166993_object71546:head# 2024-02-10T08:39:32.303 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.306 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a45c3285:::benchmark_data_smithi018_166993_object100392:head# 2024-02-10T08:39:32.306 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.307 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a45cf396:::benchmark_data_smithi018_166993_object110846:head# 2024-02-10T08:39:32.307 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.307 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a45d3cc3:::benchmark_data_smithi018_166993_object106449:head# 2024-02-10T08:39:32.307 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.307 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a45da160:::benchmark_data_smithi018_166993_object104876:head# 2024-02-10T08:39:32.307 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.308 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a45e99c6:::benchmark_data_smithi018_166993_object72999:head# 2024-02-10T08:39:32.308 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.308 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a45f4baf:::benchmark_data_smithi018_166993_object100060:head# 2024-02-10T08:39:32.308 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.308 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4607e38:::benchmark_data_smithi018_166993_object34119:head# 2024-02-10T08:39:32.308 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.309 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a461039f:::benchmark_data_smithi018_166993_object26522:head# 2024-02-10T08:39:32.309 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.309 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4612178:::benchmark_data_smithi018_166993_object69839:head# 2024-02-10T08:39:32.309 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.309 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a46207cb:::benchmark_data_smithi018_166993_object88962:head# 2024-02-10T08:39:32.309 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.309 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a46268c7:::benchmark_data_smithi018_166993_object95324:head# 2024-02-10T08:39:32.309 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.310 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4626ec0:::benchmark_data_smithi018_166993_object60345:head# 2024-02-10T08:39:32.310 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.310 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a463333f:::benchmark_data_smithi018_166993_object91791:head# 2024-02-10T08:39:32.310 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.312 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4638b0a:::benchmark_data_smithi018_166993_object102737:head# 2024-02-10T08:39:32.312 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.315 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a46634b4:::benchmark_data_smithi018_166993_object46324:head# 2024-02-10T08:39:32.315 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.315 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4676b51:::benchmark_data_smithi018_166993_object58135:head# 2024-02-10T08:39:32.315 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.316 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4682101:::benchmark_data_smithi018_166993_object92992:head# 2024-02-10T08:39:32.316 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.316 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a46841ae:::benchmark_data_smithi018_166993_object70418:head# 2024-02-10T08:39:32.316 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.316 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a468c7ae:::benchmark_data_smithi018_166993_object107883:head# 2024-02-10T08:39:32.316 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.316 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4695db6:::benchmark_data_smithi018_166993_object61649:head# 2024-02-10T08:39:32.316 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.317 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a46a000a:::benchmark_data_smithi018_166993_object37821:head# 2024-02-10T08:39:32.317 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.318 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a46a30f3:::benchmark_data_smithi018_166993_object27343:head# 2024-02-10T08:39:32.318 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.318 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a46b3481:::benchmark_data_smithi018_166993_object45562:head# 2024-02-10T08:39:32.318 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.318 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a46b4ca8:::benchmark_data_smithi018_166993_object68311:head# 2024-02-10T08:39:32.318 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.318 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a46b5cd6:::benchmark_data_smithi018_166993_object100792:head# 2024-02-10T08:39:32.318 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.319 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a46ca1ab:::benchmark_data_smithi018_166993_object87100:head# 2024-02-10T08:39:32.319 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.319 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a46e0411:::benchmark_data_smithi018_166993_object45826:head# 2024-02-10T08:39:32.320 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.320 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a46f389c:::benchmark_data_smithi018_166993_object114972:head# 2024-02-10T08:39:32.320 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.320 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a46f4a80:::benchmark_data_smithi018_166993_object115465:head# 2024-02-10T08:39:32.320 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.320 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a46f795d:::benchmark_data_smithi018_166993_object107737:head# 2024-02-10T08:39:32.320 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.320 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a47007d9:::benchmark_data_smithi018_166993_object65258:head# 2024-02-10T08:39:32.320 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.320 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4702930:::benchmark_data_smithi018_166993_object118702:head# 2024-02-10T08:39:32.320 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.320 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4707cdb:::benchmark_data_smithi018_166993_object110960:head# 2024-02-10T08:39:32.320 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.322 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a471a492:::benchmark_data_smithi018_166993_object28920:head# 2024-02-10T08:39:32.322 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.322 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4724fc1:::benchmark_data_smithi018_166993_object88208:head# 2024-02-10T08:39:32.322 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.322 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a472c4ec:::benchmark_data_smithi018_166993_object19058:head# 2024-02-10T08:39:32.322 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.322 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4734c41:::benchmark_data_smithi018_166993_object18727:head# 2024-02-10T08:39:32.322 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.322 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a47373f2:::benchmark_data_smithi018_166993_object52534:head# 2024-02-10T08:39:32.322 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.323 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a473b968:::benchmark_data_smithi018_166993_object45023:head# 2024-02-10T08:39:32.323 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.323 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4740c62:::benchmark_data_smithi018_166993_object108204:head# 2024-02-10T08:39:32.323 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.323 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4743695:::benchmark_data_smithi018_166993_object107878:head# 2024-02-10T08:39:32.323 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.323 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4746f1c:::benchmark_data_smithi018_166993_object102491:head# 2024-02-10T08:39:32.323 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.325 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4755cb8:::benchmark_data_smithi018_166993_object47865:head# 2024-02-10T08:39:32.325 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.325 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4759a32:::benchmark_data_smithi018_166993_object21404:head# 2024-02-10T08:39:32.325 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.325 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a475e600:::benchmark_data_smithi018_166993_object37461:head# 2024-02-10T08:39:32.325 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.325 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a475edd9:::benchmark_data_smithi018_166993_object61809:head# 2024-02-10T08:39:32.325 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.325 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4763c09:::benchmark_data_smithi018_166993_object105485:head# 2024-02-10T08:39:32.325 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.326 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a477da92:::benchmark_data_smithi018_166993_object40238:head# 2024-02-10T08:39:32.326 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.326 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a477f83d:::benchmark_data_smithi018_166993_object97420:head# 2024-02-10T08:39:32.326 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.326 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4794594:::benchmark_data_smithi018_166993_object97152:head# 2024-02-10T08:39:32.326 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.326 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a479d635:::benchmark_data_smithi018_166993_object66711:head# 2024-02-10T08:39:32.326 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.326 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a47b3115:::benchmark_data_smithi018_166993_object73021:head# 2024-02-10T08:39:32.326 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.326 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a47b5ee4:::benchmark_data_smithi018_166993_object31748:head# 2024-02-10T08:39:32.326 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.326 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a47c0bbc:::benchmark_data_smithi018_166993_object82598:head# 2024-02-10T08:39:32.326 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.327 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a47c0e6e:::benchmark_data_smithi018_166993_object90219:head# 2024-02-10T08:39:32.327 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.327 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a47d1fef:::benchmark_data_smithi018_166993_object71718:head# 2024-02-10T08:39:32.327 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.328 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a47d3731:::benchmark_data_smithi018_166993_object74160:head# 2024-02-10T08:39:32.328 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.328 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a47d6f9b:::benchmark_data_smithi018_166993_object49691:head# 2024-02-10T08:39:32.328 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.328 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a47d73f1:::benchmark_data_smithi018_166993_object105784:head# 2024-02-10T08:39:32.328 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.332 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a47df46a:::benchmark_data_smithi018_166993_object71209:head# 2024-02-10T08:39:32.332 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.332 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a47df5d9:::benchmark_data_smithi018_166993_object73091:head# 2024-02-10T08:39:32.333 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.333 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a47ef5ca:::benchmark_data_smithi018_166993_object40104:head# 2024-02-10T08:39:32.333 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.333 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a47eff0b:::benchmark_data_smithi018_166993_object96496:head# 2024-02-10T08:39:32.333 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.333 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a47f28fd:::benchmark_data_smithi018_166993_object45425:head# 2024-02-10T08:39:32.333 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.333 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a47fe343:::benchmark_data_smithi018_166993_object90156:head# 2024-02-10T08:39:32.333 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.333 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a480b86d:::benchmark_data_smithi018_166993_object83909:head# 2024-02-10T08:39:32.333 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.333 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4817dde:::benchmark_data_smithi018_166993_object62989:head# 2024-02-10T08:39:32.333 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.333 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a48291e6:::benchmark_data_smithi018_166993_object45995:head# 2024-02-10T08:39:32.333 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.333 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a482c51a:::benchmark_data_smithi018_166993_object76074:head# 2024-02-10T08:39:32.333 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.334 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a483016e:::benchmark_data_smithi018_166993_object86802:head# 2024-02-10T08:39:32.334 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.336 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4832170:::benchmark_data_smithi018_166993_object43066:head# 2024-02-10T08:39:32.336 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.336 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a48371f1:::benchmark_data_smithi018_166993_object104712:head# 2024-02-10T08:39:32.336 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.336 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a485538e:::benchmark_data_smithi018_166993_object61773:head# 2024-02-10T08:39:32.336 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.336 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a48579cc:::benchmark_data_smithi018_166993_object25682:head# 2024-02-10T08:39:32.336 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.336 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4861305:::benchmark_data_smithi018_166993_object112222:head# 2024-02-10T08:39:32.336 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.336 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a48843c6:::benchmark_data_smithi018_166993_object80666:head# 2024-02-10T08:39:32.337 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.337 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4888af5:::benchmark_data_smithi018_166993_object65861:head# 2024-02-10T08:39:32.337 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.337 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a48a80f3:::benchmark_data_smithi018_166993_object104087:head# 2024-02-10T08:39:32.337 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.337 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a48aa5c3:::benchmark_data_smithi018_166993_object49020:head# 2024-02-10T08:39:32.337 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.337 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a48ab9b7:::benchmark_data_smithi018_166993_object93432:head# 2024-02-10T08:39:32.337 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.337 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a48dcf62:::benchmark_data_smithi018_166993_object68365:head# 2024-02-10T08:39:32.337 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.337 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a49073e4:::benchmark_data_smithi018_166993_object41450:head# 2024-02-10T08:39:32.337 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.337 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a490ef51:::benchmark_data_smithi018_166993_object87589:head# 2024-02-10T08:39:32.338 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.338 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4913f55:::benchmark_data_smithi018_166993_object96918:head# 2024-02-10T08:39:32.338 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.339 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a49185d6:::benchmark_data_smithi018_166993_object55255:head# 2024-02-10T08:39:32.339 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.339 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a491978f:::benchmark_data_smithi018_166993_object37149:head# 2024-02-10T08:39:32.339 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.340 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a492d550:::benchmark_data_smithi018_166993_object97827:head# 2024-02-10T08:39:32.340 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.340 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4930195:::benchmark_data_smithi018_166993_object18114:head# 2024-02-10T08:39:32.340 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.340 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4932852:::benchmark_data_smithi018_166993_object78563:head# 2024-02-10T08:39:32.341 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.341 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4949d56:::benchmark_data_smithi018_166993_object38119:head# 2024-02-10T08:39:32.341 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.341 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:32.342 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a494c1d7:::benchmark_data_smithi018_166993_object68615:head# 2024-02-10T08:39:32.342 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.342 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a494c326:::benchmark_data_smithi018_166993_object71122:head# 2024-02-10T08:39:32.342 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.342 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4956620:::benchmark_data_smithi018_166993_object93698:head# 2024-02-10T08:39:32.342 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.343 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a495b985:::benchmark_data_smithi018_166993_object29158:head# 2024-02-10T08:39:32.343 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.343 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a496c89f:::benchmark_data_smithi018_166993_object29849:head# 2024-02-10T08:39:32.343 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.343 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a497042a:::benchmark_data_smithi018_166993_object109828:head# 2024-02-10T08:39:32.344 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.344 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a49705f3:::benchmark_data_smithi018_166993_object31173:head# 2024-02-10T08:39:32.344 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.344 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a498f7cb:::benchmark_data_smithi018_166993_object113365:head# 2024-02-10T08:39:32.344 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.344 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4991237:::benchmark_data_smithi018_166993_object91754:head# 2024-02-10T08:39:32.344 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.344 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a499660f:::benchmark_data_smithi018_166993_object75143:head# 2024-02-10T08:39:32.344 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.344 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4997e04:::benchmark_data_smithi018_166993_object65751:head# 2024-02-10T08:39:32.344 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.344 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a49a8d0c:::benchmark_data_smithi018_166993_object40640:head# 2024-02-10T08:39:32.344 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.346 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a49b331f:::benchmark_data_smithi018_166993_object23363:head# 2024-02-10T08:39:32.346 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.346 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a49b48cb:::benchmark_data_smithi018_166993_object100735:head# 2024-02-10T08:39:32.346 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.346 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a49b56ab:::benchmark_data_smithi018_166993_object32880:head# 2024-02-10T08:39:32.346 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.346 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a49cd43c:::benchmark_data_smithi018_166993_object18427:head# 2024-02-10T08:39:32.346 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.346 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a49d2554:::benchmark_data_smithi018_166993_object76016:head# 2024-02-10T08:39:32.346 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.346 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a49eb5d1:::benchmark_data_smithi018_166993_object44464:head# 2024-02-10T08:39:32.346 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.346 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a49f6c3d:::benchmark_data_smithi018_166993_object63945:head# 2024-02-10T08:39:32.347 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.347 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a49faffb:::benchmark_data_smithi018_166993_object104919:head# 2024-02-10T08:39:32.347 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.352 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4a0c72a:::benchmark_data_smithi018_166993_object42878:head# 2024-02-10T08:39:32.352 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.355 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4a145c6:::benchmark_data_smithi018_166993_object45364:head# 2024-02-10T08:39:32.355 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.356 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4a491ae:::benchmark_data_smithi018_166993_object60227:head# 2024-02-10T08:39:32.356 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.356 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4a49571:::benchmark_data_smithi018_166993_object75736:head# 2024-02-10T08:39:32.356 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.356 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4a53985:::benchmark_data_smithi018_166993_object49128:head# 2024-02-10T08:39:32.356 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.357 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4a65e62:::benchmark_data_smithi018_166993_object104847:head# 2024-02-10T08:39:32.357 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.357 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4a6b163:::benchmark_data_smithi018_166993_object54574:head# 2024-02-10T08:39:32.357 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.357 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4a6d779:::benchmark_data_smithi018_166993_object90144:head# 2024-02-10T08:39:32.358 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.358 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4a75b4a:::benchmark_data_smithi018_166993_object20534:head# 2024-02-10T08:39:32.358 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.358 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4a83984:::benchmark_data_smithi018_166993_object74410:head# 2024-02-10T08:39:32.358 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.359 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4a89262:::benchmark_data_smithi018_166993_object74379:head# 2024-02-10T08:39:32.359 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.359 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4a895a4:::benchmark_data_smithi018_166993_object83105:head# 2024-02-10T08:39:32.359 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.359 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4a9fc75:::benchmark_data_smithi018_166993_object69514:head# 2024-02-10T08:39:32.359 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.360 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4aa5489:::benchmark_data_smithi018_166993_object111590:head# 2024-02-10T08:39:32.360 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.360 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4aa5820:::benchmark_data_smithi018_166993_object65863:head# 2024-02-10T08:39:32.360 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.360 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4aa91c3:::benchmark_data_smithi018_166993_object38942:head# 2024-02-10T08:39:32.361 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.361 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4aab9e1:::benchmark_data_smithi018_166993_object23884:head# 2024-02-10T08:39:32.361 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.361 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4aaf0cc:::benchmark_data_smithi018_166993_object65631:head# 2024-02-10T08:39:32.361 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.361 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4aaf3a0:::benchmark_data_smithi018_166993_object100374:head# 2024-02-10T08:39:32.361 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.361 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4aaf56d:::benchmark_data_smithi018_166993_object117386:head# 2024-02-10T08:39:32.361 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.363 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4ac9c8c:::benchmark_data_smithi018_166993_object103778:head# 2024-02-10T08:39:32.363 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.363 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4ad2608:::benchmark_data_smithi018_166993_object40335:head# 2024-02-10T08:39:32.364 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.364 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4af2b36:::benchmark_data_smithi018_166993_object29345:head# 2024-02-10T08:39:32.364 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.364 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4af773d:::benchmark_data_smithi018_166993_object66346:head# 2024-02-10T08:39:32.364 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.364 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4aff3ad:::benchmark_data_smithi018_166993_object74133:head# 2024-02-10T08:39:32.364 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.364 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4b068c0:::benchmark_data_smithi018_166993_object95102:head# 2024-02-10T08:39:32.364 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.364 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4b16a78:::benchmark_data_smithi018_166993_object42759:head# 2024-02-10T08:39:32.364 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.364 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4b16e32:::benchmark_data_smithi018_166993_object41111:head# 2024-02-10T08:39:32.364 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.364 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4b17428:::benchmark_data_smithi018_166993_object27927:head# 2024-02-10T08:39:32.365 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.365 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4b313f1:::benchmark_data_smithi018_166993_object92286:head# 2024-02-10T08:39:32.365 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.365 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4b39f4f:::benchmark_data_smithi018_166993_object117936:head# 2024-02-10T08:39:32.365 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.365 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4b3decb:::benchmark_data_smithi018_166993_object52652:head# 2024-02-10T08:39:32.365 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.367 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4b40fcf:::benchmark_data_smithi018_166993_object24929:head# 2024-02-10T08:39:32.367 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.367 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4b4a869:::benchmark_data_smithi018_166993_object105836:head# 2024-02-10T08:39:32.367 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.367 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4b53011:::benchmark_data_smithi018_166993_object47199:head# 2024-02-10T08:39:32.367 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.367 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4b5814a:::benchmark_data_smithi018_166993_object41815:head# 2024-02-10T08:39:32.367 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.367 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4b58fae:::benchmark_data_smithi018_166993_object85010:head# 2024-02-10T08:39:32.367 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.368 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4b6261c:::benchmark_data_smithi018_166993_object102317:head# 2024-02-10T08:39:32.368 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.368 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4b657d2:::benchmark_data_smithi018_166993_object23605:head# 2024-02-10T08:39:32.368 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.368 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4b6c763:::benchmark_data_smithi018_166993_object109913:head# 2024-02-10T08:39:32.368 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.368 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4bbba54:::benchmark_data_smithi018_166993_object54779:head# 2024-02-10T08:39:32.368 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.368 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4bbbbe2:::benchmark_data_smithi018_166993_object41878:head# 2024-02-10T08:39:32.368 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.368 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-10T08:39:32.369 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4bbde80:::benchmark_data_smithi018_166993_object77031:head# 2024-02-10T08:39:32.369 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.369 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4bcd1c2:::benchmark_data_smithi018_166993_object19779:head# 2024-02-10T08:39:32.369 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.370 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4bf5f8c:::benchmark_data_smithi018_166993_object20705:head# 2024-02-10T08:39:32.370 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.370 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4bfd79f:::benchmark_data_smithi018_166993_object94250:head# 2024-02-10T08:39:32.370 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.370 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4c091a7:::benchmark_data_smithi018_166993_object38887:head# 2024-02-10T08:39:32.370 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.370 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4c16702:::benchmark_data_smithi018_166993_object58521:head# 2024-02-10T08:39:32.370 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.370 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4c1782e:::benchmark_data_smithi018_166993_object75092:head# 2024-02-10T08:39:32.370 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.370 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4c19f5f:::benchmark_data_smithi018_166993_object70257:head# 2024-02-10T08:39:32.370 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.370 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4c1ea96:::benchmark_data_smithi018_166993_object114707:head# 2024-02-10T08:39:32.370 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.370 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4c37e3d:::benchmark_data_smithi018_166993_object113002:head# 2024-02-10T08:39:32.370 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.371 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4c629ed:::benchmark_data_smithi018_166993_object53277:head# 2024-02-10T08:39:32.371 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.371 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4c6815f:::benchmark_data_smithi018_166993_object106268:head# 2024-02-10T08:39:32.371 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.374 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4c79594:::benchmark_data_smithi018_166993_object75942:head# 2024-02-10T08:39:32.375 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.375 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4c97fb6:::benchmark_data_smithi018_166993_object98636:head# 2024-02-10T08:39:32.375 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.375 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4c98507:::benchmark_data_smithi018_166993_object26994:head# 2024-02-10T08:39:32.375 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.375 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4ca9632:::benchmark_data_smithi018_166993_object107367:head# 2024-02-10T08:39:32.375 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.375 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4cb979c:::benchmark_data_smithi018_166993_object69535:head# 2024-02-10T08:39:32.375 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.375 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4cc2f65:::benchmark_data_smithi018_166993_object18377:head# 2024-02-10T08:39:32.375 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.375 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4cc89bf:::benchmark_data_smithi018_166993_object50615:head# 2024-02-10T08:39:32.375 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.375 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4ce3dab:::benchmark_data_smithi018_166993_object92378:head# 2024-02-10T08:39:32.376 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.376 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4ce865f:::benchmark_data_smithi018_166993_object57830:head# 2024-02-10T08:39:32.376 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.376 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4cf1419:::benchmark_data_smithi018_166993_object67368:head# 2024-02-10T08:39:32.376 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.376 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4d0ef18:::benchmark_data_smithi018_166993_object103491:head# 2024-02-10T08:39:32.376 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.378 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4d13a9a:::benchmark_data_smithi018_166993_object34673:head# 2024-02-10T08:39:32.378 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.378 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4d29fea:::benchmark_data_smithi018_166993_object117188:head# 2024-02-10T08:39:32.378 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.378 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4d393b3:::benchmark_data_smithi018_166993_object103874:head# 2024-02-10T08:39:32.378 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.378 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4d3c17a:::benchmark_data_smithi018_166993_object53857:head# 2024-02-10T08:39:32.378 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.378 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4d3c5fa:::benchmark_data_smithi018_166993_object72345:head# 2024-02-10T08:39:32.378 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.378 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4d4171f:::benchmark_data_smithi018_166993_object107760:head# 2024-02-10T08:39:32.378 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.379 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4d4cb8e:::benchmark_data_smithi018_166993_object103569:head# 2024-02-10T08:39:32.379 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.379 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4d5227a:::benchmark_data_smithi018_166993_object29034:head# 2024-02-10T08:39:32.379 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.379 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4d54227:::benchmark_data_smithi018_166993_object66918:head# 2024-02-10T08:39:32.379 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.379 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:39:32.383 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:32.384 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:39:32.387 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4d5f771:::benchmark_data_smithi018_166993_object103508:head# 2024-02-10T08:39:32.388 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.388 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4d6eeff:::benchmark_data_smithi018_166993_object62236:head# 2024-02-10T08:39:32.388 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.388 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4d75db8:::benchmark_data_smithi018_166993_object76051:head# 2024-02-10T08:39:32.388 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.388 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4d7da8e:::benchmark_data_smithi018_166993_object93704:head# 2024-02-10T08:39:32.388 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.388 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4d7ed28:::benchmark_data_smithi018_166993_object114780:head# 2024-02-10T08:39:32.388 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.388 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4d836e4:::benchmark_data_smithi018_166993_object18488:head# 2024-02-10T08:39:32.388 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.388 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4d94f90:::benchmark_data_smithi018_166993_object88604:head# 2024-02-10T08:39:32.388 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.388 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4d97a75:::benchmark_data_smithi018_166993_object57634:head# 2024-02-10T08:39:32.389 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.389 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4d9eeb0:::benchmark_data_smithi018_166993_object100514:head# 2024-02-10T08:39:32.389 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.389 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4da2782:::benchmark_data_smithi018_166993_object104612:head# 2024-02-10T08:39:32.389 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.389 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4da4e72:::benchmark_data_smithi018_166993_object43025:head# 2024-02-10T08:39:32.389 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.389 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4dbf8d6:::benchmark_data_smithi018_166993_object49245:head# 2024-02-10T08:39:32.389 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.389 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4dc247a:::benchmark_data_smithi018_166993_object26086:head# 2024-02-10T08:39:32.389 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.389 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4dd39b3:::benchmark_data_smithi018_166993_object76390:head# 2024-02-10T08:39:32.389 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.389 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4deafdf:::benchmark_data_smithi018_166993_object74681:head# 2024-02-10T08:39:32.390 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.390 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4deb8c4:::benchmark_data_smithi018_166993_object78495:head# 2024-02-10T08:39:32.390 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.390 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4dff38c:::benchmark_data_smithi018_166993_object114614:head# 2024-02-10T08:39:32.390 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.390 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4e01642:::benchmark_data_smithi018_166993_object20902:head# 2024-02-10T08:39:32.390 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.390 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4e05416:::benchmark_data_smithi018_166993_object77761:head# 2024-02-10T08:39:32.390 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.390 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4e26fb4:::benchmark_data_smithi018_166993_object82399:head# 2024-02-10T08:39:32.390 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.390 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4e36ce9:::benchmark_data_smithi018_166993_object108416:head# 2024-02-10T08:39:32.390 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.390 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4e3dc43:::benchmark_data_smithi018_166993_object60002:head# 2024-02-10T08:39:32.390 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.391 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4e44d72:::benchmark_data_smithi018_166993_object119074:head# 2024-02-10T08:39:32.391 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.391 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4e5388e:::benchmark_data_smithi018_166993_object101976:head# 2024-02-10T08:39:32.391 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.391 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4e59bc6:::benchmark_data_smithi018_166993_object23647:head# 2024-02-10T08:39:32.391 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.391 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4e69c0d:::benchmark_data_smithi018_166993_object53721:head# 2024-02-10T08:39:32.391 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.391 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4e6a0e6:::benchmark_data_smithi018_166993_object91509:head# 2024-02-10T08:39:32.391 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.391 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4e715cc:::benchmark_data_smithi018_166993_object61084:head# 2024-02-10T08:39:32.391 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.391 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4e73cd2:::benchmark_data_smithi018_166993_object33469:head# 2024-02-10T08:39:32.391 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.391 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4e79c0b:::benchmark_data_smithi018_166993_object118793:head# 2024-02-10T08:39:32.392 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.392 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4e8b17d:::benchmark_data_smithi018_166993_object80802:head# 2024-02-10T08:39:32.392 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.392 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4e8bacf:::benchmark_data_smithi018_166993_object32657:head# 2024-02-10T08:39:32.392 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.392 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4ea60bc:::benchmark_data_smithi018_166993_object91063:head# 2024-02-10T08:39:32.392 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.393 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4ebca1d:::benchmark_data_smithi018_166993_object48071:head# 2024-02-10T08:39:32.393 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.393 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4ec23b9:::benchmark_data_smithi018_166993_object85959:head# 2024-02-10T08:39:32.393 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.393 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4ec3850:::benchmark_data_smithi018_166993_object112047:head# 2024-02-10T08:39:32.393 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.393 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4ecbd35:::benchmark_data_smithi018_166993_object89168:head# 2024-02-10T08:39:32.393 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.393 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4ee09b5:::benchmark_data_smithi018_166993_object22226:head# 2024-02-10T08:39:32.393 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.393 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4ee6a58:::benchmark_data_smithi018_166993_object79483:head# 2024-02-10T08:39:32.393 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.395 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4f22d6f:::benchmark_data_smithi018_166993_object49750:head# 2024-02-10T08:39:32.395 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.395 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4f2c7c4:::benchmark_data_smithi018_166993_object71532:head# 2024-02-10T08:39:32.395 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.395 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4f2d8cc:::benchmark_data_smithi018_166993_object86265:head# 2024-02-10T08:39:32.395 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.395 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4f4467c:::benchmark_data_smithi018_166993_object30845:head# 2024-02-10T08:39:32.395 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.395 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4f4e367:::benchmark_data_smithi018_166993_object86624:head# 2024-02-10T08:39:32.395 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.395 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4f6068b:::benchmark_data_smithi018_166993_object107346:head# 2024-02-10T08:39:32.395 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.396 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4f6186b:::benchmark_data_smithi018_166993_object107020:head# 2024-02-10T08:39:32.396 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.396 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4f64033:::benchmark_data_smithi018_166993_object105668:head# 2024-02-10T08:39:32.396 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.396 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4f66f0a:::benchmark_data_smithi018_166993_object47365:head# 2024-02-10T08:39:32.396 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.397 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4f78780:::benchmark_data_smithi018_166993_object82421:head# 2024-02-10T08:39:32.397 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.397 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4f81014:::benchmark_data_smithi018_166993_object115845:head# 2024-02-10T08:39:32.397 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.398 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4f94a6a:::benchmark_data_smithi018_166993_object19151:head# 2024-02-10T08:39:32.398 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.398 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4f9634e:::benchmark_data_smithi018_166993_object112963:head# 2024-02-10T08:39:32.398 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.398 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4f96a23:::benchmark_data_smithi018_166993_object25681:head# 2024-02-10T08:39:32.398 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.398 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4faaadf:::benchmark_data_smithi018_166993_object44921:head# 2024-02-10T08:39:32.398 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.398 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4fb8b1e:::benchmark_data_smithi018_166993_object26711:head# 2024-02-10T08:39:32.398 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.398 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4fc2e0c:::benchmark_data_smithi018_166993_object57343:head# 2024-02-10T08:39:32.398 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.398 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4fc44b0:::benchmark_data_smithi018_166993_object71095:head# 2024-02-10T08:39:32.398 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.398 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4fcc87f:::benchmark_data_smithi018_166993_object31633:head# 2024-02-10T08:39:32.399 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.399 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4fcc986:::benchmark_data_smithi018_166993_object83031:head# 2024-02-10T08:39:32.399 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.400 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4fd10a0:::benchmark_data_smithi018_166993_object37079:head# 2024-02-10T08:39:32.400 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.400 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4fdc28e:::benchmark_data_smithi018_166993_object92224:head# 2024-02-10T08:39:32.400 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.400 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4fe9699:::benchmark_data_smithi018_166993_object113067:head# 2024-02-10T08:39:32.400 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.400 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4feb3a4:::benchmark_data_smithi018_166993_object110950:head# 2024-02-10T08:39:32.400 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.406 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4fef2c4:::benchmark_data_smithi018_166993_object17968:head# 2024-02-10T08:39:32.406 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.406 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a4fff154:::benchmark_data_smithi018_166993_object17458:head# 2024-02-10T08:39:32.406 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.406 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a500401c:::benchmark_data_smithi018_166993_object62319:head# 2024-02-10T08:39:32.407 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.410 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a500991b:::benchmark_data_smithi018_166993_object87406:head# 2024-02-10T08:39:32.410 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.410 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5022c62:::benchmark_data_smithi018_166993_object46892:head# 2024-02-10T08:39:32.410 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.410 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a502d4ce:::benchmark_data_smithi018_166993_object33957:head# 2024-02-10T08:39:32.410 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.410 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5033662:::benchmark_data_smithi018_166993_object30100:head# 2024-02-10T08:39:32.410 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.410 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a50347c1:::benchmark_data_smithi018_166993_object81644:head# 2024-02-10T08:39:32.411 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.411 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5038143:::benchmark_data_smithi018_166993_object103678:head# 2024-02-10T08:39:32.411 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.411 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a504957e:::benchmark_data_smithi018_166993_object51465:head# 2024-02-10T08:39:32.411 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.411 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5053cea:::benchmark_data_smithi018_166993_object53416:head# 2024-02-10T08:39:32.411 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.411 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a506c6cb:::benchmark_data_smithi018_166993_object74520:head# 2024-02-10T08:39:32.411 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.411 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a507a3a7:::benchmark_data_smithi018_166993_object97428:head# 2024-02-10T08:39:32.411 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.411 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a507fad8:::benchmark_data_smithi018_166993_object100949:head# 2024-02-10T08:39:32.411 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.411 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5082db4:::benchmark_data_smithi018_166993_object85335:head# 2024-02-10T08:39:32.411 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.415 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a50846e8:::benchmark_data_smithi018_166993_object32069:head# 2024-02-10T08:39:32.415 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.415 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5091d22:::benchmark_data_smithi018_166993_object114151:head# 2024-02-10T08:39:32.415 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.415 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a509bf4a:::benchmark_data_smithi018_166993_object44064:head# 2024-02-10T08:39:32.415 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.415 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a50b21de:::benchmark_data_smithi018_166993_object31656:head# 2024-02-10T08:39:32.415 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.415 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a50bf5f7:::benchmark_data_smithi018_166993_object77008:head# 2024-02-10T08:39:32.416 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.416 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a50ca5d1:::benchmark_data_smithi018_166993_object51078:head# 2024-02-10T08:39:32.416 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.416 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a50d09d8:::benchmark_data_smithi018_166993_object111996:head# 2024-02-10T08:39:32.416 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.416 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a50e213a:::benchmark_data_smithi018_166993_object52006:head# 2024-02-10T08:39:32.416 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.416 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a50eaf76:::benchmark_data_smithi018_166993_object87031:head# 2024-02-10T08:39:32.416 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.416 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a50fc0cf:::benchmark_data_smithi018_166993_object116460:head# 2024-02-10T08:39:32.419 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.419 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a50fde97:::benchmark_data_smithi018_166993_object81483:head# 2024-02-10T08:39:32.419 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.419 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a510501d:::benchmark_data_smithi018_166993_object114455:head# 2024-02-10T08:39:32.419 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.419 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5111104:::benchmark_data_smithi018_166993_object44545:head# 2024-02-10T08:39:32.419 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.419 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a51121ab:::benchmark_data_smithi018_166993_object113459:head# 2024-02-10T08:39:32.419 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.420 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a51204c2:::benchmark_data_smithi018_166993_object22759:head# 2024-02-10T08:39:32.420 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.420 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a51324f1:::benchmark_data_smithi018_166993_object53548:head# 2024-02-10T08:39:32.420 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.420 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5135fee:::benchmark_data_smithi018_166993_object41312:head# 2024-02-10T08:39:32.420 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.420 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5138d48:::benchmark_data_smithi018_166993_object60398:head# 2024-02-10T08:39:32.420 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.420 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a513a2b4:::benchmark_data_smithi018_166993_object27409:head# 2024-02-10T08:39:32.420 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.420 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a513b92d:::benchmark_data_smithi018_166993_object24456:head# 2024-02-10T08:39:32.420 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.420 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a515a6e5:::benchmark_data_smithi018_166993_object113054:head# 2024-02-10T08:39:32.420 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.423 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5172e8c:::benchmark_data_smithi018_166993_object42046:head# 2024-02-10T08:39:32.423 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.423 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5179d57:::benchmark_data_smithi018_166993_object26312:head# 2024-02-10T08:39:32.423 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.423 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a518111d:::benchmark_data_smithi018_166993_object93929:head# 2024-02-10T08:39:32.423 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.423 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5182290:::benchmark_data_smithi018_166993_object31017:head# 2024-02-10T08:39:32.424 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.424 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a518c41a:::benchmark_data_smithi018_166993_object49946:head# 2024-02-10T08:39:32.424 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.424 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a51a7283:::benchmark_data_smithi018_166993_object64898:head# 2024-02-10T08:39:32.424 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.424 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a51aac2d:::benchmark_data_smithi018_166993_object88910:head# 2024-02-10T08:39:32.424 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.424 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a51befdb:::benchmark_data_smithi018_166993_object23981:head# 2024-02-10T08:39:32.424 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.424 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a51c118e:::benchmark_data_smithi018_166993_object100516:head# 2024-02-10T08:39:32.424 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.424 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a51ebc09:::benchmark_data_smithi018_166993_object32857:head# 2024-02-10T08:39:32.424 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.424 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a51f218d:::benchmark_data_smithi018_166993_object70569:head# 2024-02-10T08:39:32.425 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.425 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a51f5b59:::benchmark_data_smithi018_166993_object23492:head# 2024-02-10T08:39:32.425 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.425 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a52001f2:::benchmark_data_smithi018_166993_object72848:head# 2024-02-10T08:39:32.425 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.425 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5205d31:::benchmark_data_smithi018_166993_object68730:head# 2024-02-10T08:39:32.425 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.425 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a520b94f:::benchmark_data_smithi018_166993_object61547:head# 2024-02-10T08:39:32.425 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.425 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a521baf2:::benchmark_data_smithi018_166993_object65651:head# 2024-02-10T08:39:32.425 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.425 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5223676:::benchmark_data_smithi018_166993_object95859:head# 2024-02-10T08:39:32.425 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.425 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5223c28:::benchmark_data_smithi018_166993_object39402:head# 2024-02-10T08:39:32.425 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.426 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a522ae04:::benchmark_data_smithi018_166993_object73105:head# 2024-02-10T08:39:32.426 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.426 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5234c47:::benchmark_data_smithi018_166993_object27665:head# 2024-02-10T08:39:32.426 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.426 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a523752e:::benchmark_data_smithi018_166993_object28111:head# 2024-02-10T08:39:32.427 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.428 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5238557:::benchmark_data_smithi018_166993_object105285:head# 2024-02-10T08:39:32.428 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.428 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a523a377:::benchmark_data_smithi018_166993_object26403:head# 2024-02-10T08:39:32.428 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.429 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5244a86:::benchmark_data_smithi018_166993_object70288:head# 2024-02-10T08:39:32.429 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.429 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a525730a:::benchmark_data_smithi018_166993_object97690:head# 2024-02-10T08:39:32.429 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.430 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5258426:::benchmark_data_smithi018_166993_object58428:head# 2024-02-10T08:39:32.430 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.430 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5264e5b:::benchmark_data_smithi018_166993_object70138:head# 2024-02-10T08:39:32.430 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.430 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a526c9ec:::benchmark_data_smithi018_166993_object75803:head# 2024-02-10T08:39:32.430 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.430 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a52819ec:::benchmark_data_smithi018_166993_object110588:head# 2024-02-10T08:39:32.430 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.431 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5281db2:::benchmark_data_smithi018_166993_object55337:head# 2024-02-10T08:39:32.431 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.431 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5295eb5:::benchmark_data_smithi018_166993_object64097:head# 2024-02-10T08:39:32.431 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.431 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a52a606f:::benchmark_data_smithi018_166993_object52384:head# 2024-02-10T08:39:32.431 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.433 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a52a8bc0:::benchmark_data_smithi018_166993_object37638:head# 2024-02-10T08:39:32.433 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.433 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a52b997a:::benchmark_data_smithi018_166993_object33725:head# 2024-02-10T08:39:32.433 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.435 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a52c27e7:::benchmark_data_smithi018_166993_object95740:head# 2024-02-10T08:39:32.436 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.436 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a52c9723:::benchmark_data_smithi018_166993_object108328:head# 2024-02-10T08:39:32.436 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.436 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a52d7303:::benchmark_data_smithi018_166993_object33189:head# 2024-02-10T08:39:32.436 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.436 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a52dd6a8:::benchmark_data_smithi018_166993_object100209:head# 2024-02-10T08:39:32.436 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.436 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a52e4c37:::benchmark_data_smithi018_166993_object39708:head# 2024-02-10T08:39:32.436 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.436 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a52e4cca:::benchmark_data_smithi018_166993_object60106:head# 2024-02-10T08:39:32.436 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.438 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a52f8bc8:::benchmark_data_smithi018_166993_object18017:head# 2024-02-10T08:39:32.438 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.438 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a52fbcdc:::benchmark_data_smithi018_166993_object27956:head# 2024-02-10T08:39:32.438 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.438 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5304c70:::benchmark_data_smithi018_166993_object48581:head# 2024-02-10T08:39:32.439 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.439 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a530bf69:::benchmark_data_smithi018_166993_object41923:head# 2024-02-10T08:39:32.439 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.439 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5310ade:::benchmark_data_smithi018_166993_object107539:head# 2024-02-10T08:39:32.439 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.439 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a53195a1:::benchmark_data_smithi018_166993_object34995:head# 2024-02-10T08:39:32.439 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.439 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a531a05f:::benchmark_data_smithi018_166993_object64685:head# 2024-02-10T08:39:32.439 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.439 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5327905:::benchmark_data_smithi018_166993_object101580:head# 2024-02-10T08:39:32.439 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.439 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a53339d9:::benchmark_data_smithi018_166993_object75521:head# 2024-02-10T08:39:32.439 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.439 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5334caa:::benchmark_data_smithi018_166993_object100700:head# 2024-02-10T08:39:32.439 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.440 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5339355:::benchmark_data_smithi018_166993_object28866:head# 2024-02-10T08:39:32.440 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.441 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5340846:::benchmark_data_smithi018_166993_object26971:head# 2024-02-10T08:39:32.441 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.441 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a53470bb:::benchmark_data_smithi018_166993_object73645:head# 2024-02-10T08:39:32.441 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.441 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5347b52:::benchmark_data_smithi018_166993_object96797:head# 2024-02-10T08:39:32.441 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.441 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a535aee3:::benchmark_data_smithi018_166993_object101008:head# 2024-02-10T08:39:32.441 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.441 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a53612ab:::benchmark_data_smithi018_166993_object78033:head# 2024-02-10T08:39:32.442 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.443 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a536707a:::benchmark_data_smithi018_166993_object71324:head# 2024-02-10T08:39:32.443 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.443 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5369618:::benchmark_data_smithi018_166993_object52293:head# 2024-02-10T08:39:32.443 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.444 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a53703aa:::benchmark_data_smithi018_166993_object88405:head# 2024-02-10T08:39:32.444 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.444 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5371373:::benchmark_data_smithi018_166993_object118787:head# 2024-02-10T08:39:32.444 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.444 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a53775ad:::benchmark_data_smithi018_166993_object56759:head# 2024-02-10T08:39:32.444 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.447 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5379265:::benchmark_data_smithi018_166993_object99906:head# 2024-02-10T08:39:32.447 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.447 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a537a3b5:::benchmark_data_smithi018_166993_object103079:head# 2024-02-10T08:39:32.447 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.447 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a537b018:::benchmark_data_smithi018_166993_object67981:head# 2024-02-10T08:39:32.447 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.447 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a537f3c3:::benchmark_data_smithi018_166993_object116093:head# 2024-02-10T08:39:32.447 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.447 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a537ff3e:::benchmark_data_smithi018_166993_object45916:head# 2024-02-10T08:39:32.447 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.448 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a53818c1:::benchmark_data_smithi018_166993_object95504:head# 2024-02-10T08:39:32.448 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.448 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a53958bf:::benchmark_data_smithi018_166993_object26596:head# 2024-02-10T08:39:32.449 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.449 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5397753:::benchmark_data_smithi018_166993_object76433:head# 2024-02-10T08:39:32.449 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.449 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a539c68c:::benchmark_data_smithi018_166993_object70178:head# 2024-02-10T08:39:32.449 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.449 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a53a7c64:::benchmark_data_smithi018_166993_object110175:head# 2024-02-10T08:39:32.449 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.451 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a53af273:::benchmark_data_smithi018_166993_object111992:head# 2024-02-10T08:39:32.451 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.451 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a53b8ca6:::benchmark_data_smithi018_166993_object35789:head# 2024-02-10T08:39:32.451 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.451 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a53b8eac:::benchmark_data_smithi018_166993_object80195:head# 2024-02-10T08:39:32.451 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.452 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a53ca843:::benchmark_data_smithi018_166993_object113642:head# 2024-02-10T08:39:32.452 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.452 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a53d3fbe:::benchmark_data_smithi018_166993_object45412:head# 2024-02-10T08:39:32.452 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.452 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a53ebd75:::benchmark_data_smithi018_166993_object28521:head# 2024-02-10T08:39:32.452 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.452 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a53ecae7:::benchmark_data_smithi018_166993_object25957:head# 2024-02-10T08:39:32.452 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.453 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5404995:::benchmark_data_smithi018_166993_object34090:head# 2024-02-10T08:39:32.453 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.453 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5406774:::benchmark_data_smithi018_166993_object54299:head# 2024-02-10T08:39:32.453 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.453 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a540936b:::benchmark_data_smithi018_166993_object99288:head# 2024-02-10T08:39:32.453 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.453 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5415c32:::benchmark_data_smithi018_166993_object29773:head# 2024-02-10T08:39:32.454 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.454 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a54186be:::benchmark_data_smithi018_166993_object80510:head# 2024-02-10T08:39:32.454 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.454 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a541904a:::benchmark_data_smithi018_166993_object60291:head# 2024-02-10T08:39:32.454 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.454 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5424475:::benchmark_data_smithi018_166993_object48110:head# 2024-02-10T08:39:32.454 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.455 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a542c1f4:::benchmark_data_smithi018_166993_object112379:head# 2024-02-10T08:39:32.455 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.455 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a542e03c:::benchmark_data_smithi018_166993_object84910:head# 2024-02-10T08:39:32.455 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.455 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5442853:::benchmark_data_smithi018_166993_object109413:head# 2024-02-10T08:39:32.455 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.455 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5443285:::benchmark_data_smithi018_166993_object60913:head# 2024-02-10T08:39:32.455 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.456 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5444388:::benchmark_data_smithi018_166993_object47201:head# 2024-02-10T08:39:32.456 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.456 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5453af1:::benchmark_data_smithi018_166993_object115073:head# 2024-02-10T08:39:32.456 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.456 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5459386:::benchmark_data_smithi018_166993_object31526:head# 2024-02-10T08:39:32.456 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.457 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5463251:::benchmark_data_smithi018_166993_object105592:head# 2024-02-10T08:39:32.457 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.457 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a546a1c4:::benchmark_data_smithi018_166993_object18423:head# 2024-02-10T08:39:32.458 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.458 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a546c698:::benchmark_data_smithi018_166993_object52482:head# 2024-02-10T08:39:32.458 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.458 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a546cfe1:::benchmark_data_smithi018_166993_object101168:head# 2024-02-10T08:39:32.458 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.458 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a546fb97:::benchmark_data_smithi018_166993_object91716:head# 2024-02-10T08:39:32.458 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.459 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5488d87:::benchmark_data_smithi018_166993_object23262:head# 2024-02-10T08:39:32.459 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.461 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a54a1ddb:::benchmark_data_smithi018_166993_object88418:head# 2024-02-10T08:39:32.462 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.462 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a54a87de:::benchmark_data_smithi018_166993_object28378:head# 2024-02-10T08:39:32.462 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.462 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a54b50c4:::benchmark_data_smithi018_166993_object96119:head# 2024-02-10T08:39:32.462 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.462 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a54cdf90:::benchmark_data_smithi018_166993_object86736:head# 2024-02-10T08:39:32.462 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.464 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a54d1246:::benchmark_data_smithi018_166993_object116032:head# 2024-02-10T08:39:32.464 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.464 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a54f4a0b:::benchmark_data_smithi018_166993_object110727:head# 2024-02-10T08:39:32.465 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.466 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a550f1ec:::benchmark_data_smithi018_166993_object33876:head# 2024-02-10T08:39:32.466 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.466 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a55113b2:::benchmark_data_smithi018_166993_object80108:head# 2024-02-10T08:39:32.466 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.468 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5516e3c:::benchmark_data_smithi018_166993_object80040:head# 2024-02-10T08:39:32.468 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.468 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a551c9a4:::benchmark_data_smithi018_166993_object103734:head# 2024-02-10T08:39:32.468 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.469 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a551d734:::benchmark_data_smithi018_166993_object42790:head# 2024-02-10T08:39:32.469 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.470 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a55244ef:::benchmark_data_smithi018_166993_object92004:head# 2024-02-10T08:39:32.470 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.471 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a552ded3:::benchmark_data_smithi018_166993_object21265:head# 2024-02-10T08:39:32.471 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.471 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5537f96:::benchmark_data_smithi018_166993_object18815:head# 2024-02-10T08:39:32.471 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.472 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a553e2d8:::benchmark_data_smithi018_166993_object100867:head# 2024-02-10T08:39:32.472 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.472 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a554446f:::benchmark_data_smithi018_166993_object53140:head# 2024-02-10T08:39:32.472 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.472 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5545583:::benchmark_data_smithi018_166993_object110841:head# 2024-02-10T08:39:32.472 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.472 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5546034:::benchmark_data_smithi018_166993_object74045:head# 2024-02-10T08:39:32.473 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.473 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a555485b:::benchmark_data_smithi018_166993_object71045:head# 2024-02-10T08:39:32.473 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.474 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5558d90:::benchmark_data_smithi018_166993_object60674:head# 2024-02-10T08:39:32.474 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.477 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5559738:::benchmark_data_smithi018_166993_object109250:head# 2024-02-10T08:39:32.477 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.477 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a55658e2:::benchmark_data_smithi018_166993_object48181:head# 2024-02-10T08:39:32.477 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.478 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5570d9f:::benchmark_data_smithi018_166993_object85615:head# 2024-02-10T08:39:32.478 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.478 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5571f1a:::benchmark_data_smithi018_166993_object20049:head# 2024-02-10T08:39:32.478 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.482 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a558492f:::benchmark_data_smithi018_166993_object31341:head# 2024-02-10T08:39:32.482 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.482 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a558ad02:::benchmark_data_smithi018_166993_object62737:head# 2024-02-10T08:39:32.482 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.482 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a55935a3:::benchmark_data_smithi018_166993_object60422:head# 2024-02-10T08:39:32.482 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.482 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a55a1143:::benchmark_data_smithi018_166993_object98168:head# 2024-02-10T08:39:32.482 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.483 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a55c83f0:::benchmark_data_smithi018_166993_object68360:head# 2024-02-10T08:39:32.483 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.484 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:39:32.485 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a55cbbe6:::benchmark_data_smithi018_166993_object58842:head# 2024-02-10T08:39:32.485 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.485 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a55d86c7:::benchmark_data_smithi018_166993_object66768:head# 2024-02-10T08:39:32.485 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.485 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a55e37fd:::benchmark_data_smithi018_166993_object104673:head# 2024-02-10T08:39:32.485 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.486 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a55f1705:::benchmark_data_smithi018_166993_object71055:head# 2024-02-10T08:39:32.486 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.486 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a55fc344:::benchmark_data_smithi018_166993_object35409:head# 2024-02-10T08:39:32.486 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.486 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a560d6e4:::benchmark_data_smithi018_166993_object109733:head# 2024-02-10T08:39:32.486 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.486 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a560e891:::benchmark_data_smithi018_166993_object57559:head# 2024-02-10T08:39:32.486 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.487 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5612513:::benchmark_data_smithi018_166993_object46773:head# 2024-02-10T08:39:32.487 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.487 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5619ef9:::benchmark_data_smithi018_166993_object27334:head# 2024-02-10T08:39:32.487 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.487 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a56373fd:::benchmark_data_smithi018_166993_object27165:head# 2024-02-10T08:39:32.487 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.487 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a56403ca:::benchmark_data_smithi018_166993_object62665:head# 2024-02-10T08:39:32.487 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.487 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5642a1e:::benchmark_data_smithi018_166993_object73485:head# 2024-02-10T08:39:32.487 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.497 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5644dfd:::benchmark_data_smithi018_166993_object97640:head# 2024-02-10T08:39:32.497 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.497 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a56555af:::benchmark_data_smithi018_166993_object40503:head# 2024-02-10T08:39:32.497 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.497 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5667715:::benchmark_data_smithi018_166993_object100307:head# 2024-02-10T08:39:32.497 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.497 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a566a1b1:::benchmark_data_smithi018_166993_object47151:head# 2024-02-10T08:39:32.497 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.498 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a566d124:::benchmark_data_smithi018_166993_object90597:head# 2024-02-10T08:39:32.498 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.498 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a566ee96:::benchmark_data_smithi018_166993_object93818:head# 2024-02-10T08:39:32.498 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.498 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a56998d2:::benchmark_data_smithi018_166993_object81499:head# 2024-02-10T08:39:32.498 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.498 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a569b885:::benchmark_data_smithi018_166993_object75414:head# 2024-02-10T08:39:32.498 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.498 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a56a1804:::benchmark_data_smithi018_166993_object59978:head# 2024-02-10T08:39:32.498 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.498 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a56c6b23:::benchmark_data_smithi018_166993_object27691:head# 2024-02-10T08:39:32.498 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.498 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a56c7f27:::benchmark_data_smithi018_166993_object61161:head# 2024-02-10T08:39:32.498 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.498 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a56cfdb5:::benchmark_data_smithi018_166993_object57447:head# 2024-02-10T08:39:32.499 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.499 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a56d5ec5:::benchmark_data_smithi018_166993_object89639:head# 2024-02-10T08:39:32.499 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.499 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a56d7917:::benchmark_data_smithi018_166993_object115686:head# 2024-02-10T08:39:32.499 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.499 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a56e797f:::benchmark_data_smithi018_166993_object61530:head# 2024-02-10T08:39:32.499 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.499 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a56e7e0b:::benchmark_data_smithi018_166993_object98544:head# 2024-02-10T08:39:32.499 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.499 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a56f447d:::benchmark_data_smithi018_166993_object22733:head# 2024-02-10T08:39:32.499 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.499 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a56f9109:::benchmark_data_smithi018_166993_object47638:head# 2024-02-10T08:39:32.499 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.500 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a56fbc1f:::benchmark_data_smithi018_166993_object51139:head# 2024-02-10T08:39:32.500 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.500 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5710c6f:::benchmark_data_smithi018_166993_object54054:head# 2024-02-10T08:39:32.500 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.500 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5728809:::benchmark_data_smithi018_166993_object86223:head# 2024-02-10T08:39:32.500 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.501 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a572b5b9:::benchmark_data_smithi018_166993_object84826:head# 2024-02-10T08:39:32.501 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.502 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a572dbc6:::benchmark_data_smithi018_166993_object81156:head# 2024-02-10T08:39:32.502 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.502 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a572f16a:::benchmark_data_smithi018_166993_object92287:head# 2024-02-10T08:39:32.502 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.503 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a574620c:::benchmark_data_smithi018_166993_object106718:head# 2024-02-10T08:39:32.503 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.503 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a574a7ed:::benchmark_data_smithi018_166993_object24138:head# 2024-02-10T08:39:32.503 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.503 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a575954d:::benchmark_data_smithi018_166993_object105584:head# 2024-02-10T08:39:32.503 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.504 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a578fa26:::benchmark_data_smithi018_166993_object29990:head# 2024-02-10T08:39:32.504 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.504 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a57922e5:::benchmark_data_smithi018_166993_object82146:head# 2024-02-10T08:39:32.504 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.504 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5794cf0:::benchmark_data_smithi018_166993_object94778:head# 2024-02-10T08:39:32.504 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.505 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a579a93e:::benchmark_data_smithi018_166993_object50616:head# 2024-02-10T08:39:32.505 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.505 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a57be6b1:::benchmark_data_smithi018_166993_object20808:head# 2024-02-10T08:39:32.505 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.505 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a57be862:::benchmark_data_smithi018_166993_object85843:head# 2024-02-10T08:39:32.505 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.505 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a57f2106:::benchmark_data_smithi018_166993_object73731:head# 2024-02-10T08:39:32.505 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.507 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a580c422:::benchmark_data_smithi018_166993_object67420:head# 2024-02-10T08:39:32.507 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.507 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a58230c7:::benchmark_data_smithi018_166993_object71415:head# 2024-02-10T08:39:32.507 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.508 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a583180a:::benchmark_data_smithi018_166993_object82648:head# 2024-02-10T08:39:32.508 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.508 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a584915a:::benchmark_data_smithi018_166993_object115823:head# 2024-02-10T08:39:32.508 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.508 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5849405:::benchmark_data_smithi018_166993_object98143:head# 2024-02-10T08:39:32.508 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.515 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a584c5d6:::benchmark_data_smithi018_166993_object35211:head# 2024-02-10T08:39:32.516 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.516 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5854687:::benchmark_data_smithi018_166993_object64722:head# 2024-02-10T08:39:32.516 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.516 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a585818d:::benchmark_data_smithi018_166993_object45993:head# 2024-02-10T08:39:32.516 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.516 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a585f2ea:::benchmark_data_smithi018_166993_object19043:head# 2024-02-10T08:39:32.516 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.516 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5866993:::benchmark_data_smithi018_166993_object17533:head# 2024-02-10T08:39:32.516 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.516 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a587287e:::benchmark_data_smithi018_166993_object103011:head# 2024-02-10T08:39:32.516 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.516 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a587415b:::benchmark_data_smithi018_166993_object115092:head# 2024-02-10T08:39:32.516 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.517 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5890fc9:::benchmark_data_smithi018_166993_object62874:head# 2024-02-10T08:39:32.517 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.517 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a58b7e36:::benchmark_data_smithi018_166993_object117622:head# 2024-02-10T08:39:32.517 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.518 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a58bbde3:::benchmark_data_smithi018_166993_object100349:head# 2024-02-10T08:39:32.518 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.518 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a58c5680:::benchmark_data_smithi018_166993_object82121:head# 2024-02-10T08:39:32.518 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.518 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a58c9641:::benchmark_data_smithi018_166993_object105409:head# 2024-02-10T08:39:32.518 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.518 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a58cf42b:::benchmark_data_smithi018_166993_object25536:head# 2024-02-10T08:39:32.519 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.519 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a58e07b4:::benchmark_data_smithi018_166993_object28557:head# 2024-02-10T08:39:32.519 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.519 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a58fb0a0:::benchmark_data_smithi018_166993_object61474:head# 2024-02-10T08:39:32.519 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.519 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a58fe8b5:::benchmark_data_smithi018_166993_object96314:head# 2024-02-10T08:39:32.519 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.519 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a59086d0:::benchmark_data_smithi018_166993_object29594:head# 2024-02-10T08:39:32.519 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.525 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5909b61:::benchmark_data_smithi018_166993_object101755:head# 2024-02-10T08:39:32.525 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.525 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5913431:::benchmark_data_smithi018_166993_object101388:head# 2024-02-10T08:39:32.525 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.526 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5914657:::benchmark_data_smithi018_166993_object19764:head# 2024-02-10T08:39:32.526 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.526 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a591801a:::benchmark_data_smithi018_166993_object18399:head# 2024-02-10T08:39:32.526 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.526 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a59188a7:::benchmark_data_smithi018_166993_object116906:head# 2024-02-10T08:39:32.526 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.526 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a591dbac:::benchmark_data_smithi018_166993_object58845:head# 2024-02-10T08:39:32.526 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.527 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a592179d:::benchmark_data_smithi018_166993_object85147:head# 2024-02-10T08:39:32.527 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.527 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a592d5a6:::benchmark_data_smithi018_166993_object39905:head# 2024-02-10T08:39:32.527 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.527 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a59386dc:::benchmark_data_smithi018_166993_object30444:head# 2024-02-10T08:39:32.527 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.527 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a593b57b:::benchmark_data_smithi018_166993_object68097:head# 2024-02-10T08:39:32.527 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.528 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5964ec1:::benchmark_data_smithi018_166993_object90665:head# 2024-02-10T08:39:32.529 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.529 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a596e362:::benchmark_data_smithi018_166993_object78178:head# 2024-02-10T08:39:32.529 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.529 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a59892f6:::benchmark_data_smithi018_166993_object50446:head# 2024-02-10T08:39:32.529 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.529 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a599489d:::benchmark_data_smithi018_166993_object42710:head# 2024-02-10T08:39:32.529 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.529 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5995bb3:::benchmark_data_smithi018_166993_object112195:head# 2024-02-10T08:39:32.529 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.529 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a599c11c:::benchmark_data_smithi018_166993_object40982:head# 2024-02-10T08:39:32.529 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.529 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a59a2eba:::benchmark_data_smithi018_166993_object114663:head# 2024-02-10T08:39:32.529 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.530 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a59ae916:::benchmark_data_smithi018_166993_object57907:head# 2024-02-10T08:39:32.530 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.537 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a59c3145:::benchmark_data_smithi018_166993_object74207:head# 2024-02-10T08:39:32.537 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.537 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a59d1614:::benchmark_data_smithi018_166993_object37100:head# 2024-02-10T08:39:32.537 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.538 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a59d19b4:::benchmark_data_smithi018_166993_object33536:head# 2024-02-10T08:39:32.538 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.538 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a59dda27:::benchmark_data_smithi018_166993_object75304:head# 2024-02-10T08:39:32.538 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.538 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a59eb623:::benchmark_data_smithi018_166993_object118096:head# 2024-02-10T08:39:32.538 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.539 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5a022a8:::benchmark_data_smithi018_166993_object63956:head# 2024-02-10T08:39:32.539 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.540 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5a06370:::benchmark_data_smithi018_166993_object70309:head# 2024-02-10T08:39:32.540 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.540 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5a08ff9:::benchmark_data_smithi018_166993_object89955:head# 2024-02-10T08:39:32.540 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.540 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5a0abf0:::benchmark_data_smithi018_166993_object94914:head# 2024-02-10T08:39:32.540 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.541 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5a1f7be:::benchmark_data_smithi018_166993_object73838:head# 2024-02-10T08:39:32.541 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.541 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5a2b23f:::benchmark_data_smithi018_166993_object103456:head# 2024-02-10T08:39:32.541 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.541 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5a2c3a2:::benchmark_data_smithi018_166993_object67929:head# 2024-02-10T08:39:32.541 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.541 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5a2dfbb:::benchmark_data_smithi018_166993_object100427:head# 2024-02-10T08:39:32.541 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.542 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5a3186f:::benchmark_data_smithi018_166993_object80780:head# 2024-02-10T08:39:32.542 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.544 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5a45aab:::benchmark_data_smithi018_166993_object115624:head# 2024-02-10T08:39:32.544 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.544 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5a4657c:::benchmark_data_smithi018_166993_object101735:head# 2024-02-10T08:39:32.544 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.544 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5a5b422:::benchmark_data_smithi018_166993_object55105:head# 2024-02-10T08:39:32.544 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.544 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5a7f4c3:::benchmark_data_smithi018_166993_object100049:head# 2024-02-10T08:39:32.544 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.544 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5a89057:::benchmark_data_smithi018_166993_object108593:head# 2024-02-10T08:39:32.544 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.544 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5a89550:::benchmark_data_smithi018_166993_object73308:head# 2024-02-10T08:39:32.545 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.545 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5a8d4ac:::benchmark_data_smithi018_166993_object78521:head# 2024-02-10T08:39:32.545 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.545 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5a8e29e:::benchmark_data_smithi018_166993_object39159:head# 2024-02-10T08:39:32.545 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.546 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5a990c1:::benchmark_data_smithi018_166993_object21061:head# 2024-02-10T08:39:32.546 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.546 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5aa4088:::benchmark_data_smithi018_166993_object97067:head# 2024-02-10T08:39:32.546 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.546 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5ab40ee:::benchmark_data_smithi018_166993_object80142:head# 2024-02-10T08:39:32.546 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.546 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5ab4d27:::benchmark_data_smithi018_166993_object87457:head# 2024-02-10T08:39:32.546 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.546 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5acc074:::benchmark_data_smithi018_166993_object65390:head# 2024-02-10T08:39:32.546 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.549 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5ae7a34:::benchmark_data_smithi018_166993_object74607:head# 2024-02-10T08:39:32.549 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.549 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5aecb34:::benchmark_data_smithi018_166993_object102915:head# 2024-02-10T08:39:32.549 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.553 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5af1c48:::benchmark_data_smithi018_166993_object36979:head# 2024-02-10T08:39:32.553 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.553 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5af3272:::benchmark_data_smithi018_166993_object36408:head# 2024-02-10T08:39:32.553 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.553 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5b0bd39:::benchmark_data_smithi018_166993_object31431:head# 2024-02-10T08:39:32.553 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.553 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5b0d69b:::benchmark_data_smithi018_166993_object106813:head# 2024-02-10T08:39:32.553 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.553 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5b241f8:::benchmark_data_smithi018_166993_object22611:head# 2024-02-10T08:39:32.553 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.553 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5b321c0:::benchmark_data_smithi018_166993_object46679:head# 2024-02-10T08:39:32.554 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.554 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5b54cc8:::benchmark_data_smithi018_166993_object58097:head# 2024-02-10T08:39:32.555 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.555 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5b5829f:::benchmark_data_smithi018_166993_object109642:head# 2024-02-10T08:39:32.555 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.556 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5b68e45:::benchmark_data_smithi018_166993_object37508:head# 2024-02-10T08:39:32.556 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.556 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5b7e305:::benchmark_data_smithi018_166993_object61554:head# 2024-02-10T08:39:32.556 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.556 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5b807e8:::benchmark_data_smithi018_166993_object36214:head# 2024-02-10T08:39:32.556 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.557 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5ba2178:::benchmark_data_smithi018_166993_object97388:head# 2024-02-10T08:39:32.557 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.557 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5ba3424:::benchmark_data_smithi018_166993_object54614:head# 2024-02-10T08:39:32.557 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.557 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5bb0378:::benchmark_data_smithi018_166993_object32853:head# 2024-02-10T08:39:32.558 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.558 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5bb907b:::benchmark_data_smithi018_166993_object75365:head# 2024-02-10T08:39:32.558 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.562 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5bbb2f3:::benchmark_data_smithi018_166993_object113299:head# 2024-02-10T08:39:32.563 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.563 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5bc28ce:::benchmark_data_smithi018_166993_object68750:head# 2024-02-10T08:39:32.563 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.563 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5bcb869:::benchmark_data_smithi018_166993_object81659:head# 2024-02-10T08:39:32.563 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.565 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5be641d:::benchmark_data_smithi018_166993_object96091:head# 2024-02-10T08:39:32.565 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.565 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5bea651:::benchmark_data_smithi018_166993_object77680:head# 2024-02-10T08:39:32.565 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.565 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5c014d4:::benchmark_data_smithi018_166993_object104984:head# 2024-02-10T08:39:32.565 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.565 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5c14d0f:::benchmark_data_smithi018_166993_object38637:head# 2024-02-10T08:39:32.565 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.565 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5c2eea8:::benchmark_data_smithi018_166993_object77976:head# 2024-02-10T08:39:32.565 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.565 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5c349dc:::benchmark_data_smithi018_166993_object59903:head# 2024-02-10T08:39:32.565 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.567 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5c38714:::benchmark_data_smithi018_166993_object84448:head# 2024-02-10T08:39:32.567 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.567 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5c3a7e5:::benchmark_data_smithi018_166993_object79830:head# 2024-02-10T08:39:32.567 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.567 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5c3f672:::benchmark_data_smithi018_166993_object68007:head# 2024-02-10T08:39:32.567 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.567 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5c41951:::benchmark_data_smithi018_166993_object75606:head# 2024-02-10T08:39:32.567 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.567 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5c6057c:::benchmark_data_smithi018_166993_object88218:head# 2024-02-10T08:39:32.568 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.568 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5c65479:::benchmark_data_smithi018_166993_object43509:head# 2024-02-10T08:39:32.568 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.568 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5c66f41:::benchmark_data_smithi018_166993_object101586:head# 2024-02-10T08:39:32.568 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.568 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5c68d9a:::benchmark_data_smithi018_166993_object64660:head# 2024-02-10T08:39:32.568 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.568 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5c6d2c0:::benchmark_data_smithi018_166993_object118111:head# 2024-02-10T08:39:32.568 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.569 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5c785ef:::benchmark_data_smithi018_166993_object98332:head# 2024-02-10T08:39:32.569 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.569 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5c7aaba:::benchmark_data_smithi018_166993_object63776:head# 2024-02-10T08:39:32.569 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.570 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5c893d1:::benchmark_data_smithi018_166993_object79591:head# 2024-02-10T08:39:32.570 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.570 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5c9db7b:::benchmark_data_smithi018_166993_object71641:head# 2024-02-10T08:39:32.570 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.570 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5cb44d1:::benchmark_data_smithi018_166993_object27830:head# 2024-02-10T08:39:32.570 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.570 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5cb53d9:::benchmark_data_smithi018_166993_object22304:head# 2024-02-10T08:39:32.570 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.570 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5cc8381:::benchmark_data_smithi018_166993_object78185:head# 2024-02-10T08:39:32.570 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.570 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5cd08dc:::benchmark_data_smithi018_166993_object32481:head# 2024-02-10T08:39:32.570 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.570 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5cdc6b7:::benchmark_data_smithi018_166993_object27607:head# 2024-02-10T08:39:32.570 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.570 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5ce82e5:::benchmark_data_smithi018_166993_object97948:head# 2024-02-10T08:39:32.570 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.572 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5cff8c6:::benchmark_data_smithi018_166993_object41722:head# 2024-02-10T08:39:32.572 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.572 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5d06c90:::benchmark_data_smithi018_166993_object50247:head# 2024-02-10T08:39:32.572 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.572 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5d1ed07:::benchmark_data_smithi018_166993_object104879:head# 2024-02-10T08:39:32.572 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.572 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5d268b6:::benchmark_data_smithi018_166993_object49484:head# 2024-02-10T08:39:32.572 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.572 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5d3213e:::benchmark_data_smithi018_166993_object19837:head# 2024-02-10T08:39:32.572 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.572 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5d3262f:::benchmark_data_smithi018_166993_object21206:head# 2024-02-10T08:39:32.573 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.573 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5d3c913:::benchmark_data_smithi018_166993_object52668:head# 2024-02-10T08:39:32.573 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.573 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5d518ca:::benchmark_data_smithi018_166993_object17680:head# 2024-02-10T08:39:32.573 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.573 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5d5b733:::benchmark_data_smithi018_166993_object29049:head# 2024-02-10T08:39:32.573 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.575 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5d5bc72:::benchmark_data_smithi018_166993_object74622:head# 2024-02-10T08:39:32.575 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.575 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5d60232:::benchmark_data_smithi018_166993_object64004:head# 2024-02-10T08:39:32.575 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.575 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5d66ee9:::benchmark_data_smithi018_166993_object118243:head# 2024-02-10T08:39:32.575 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.575 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5d71294:::benchmark_data_smithi018_166993_object33728:head# 2024-02-10T08:39:32.575 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.575 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5d71abd:::benchmark_data_smithi018_166993_object62823:head# 2024-02-10T08:39:32.575 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.575 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5d7ab0f:::benchmark_data_smithi018_166993_object42358:head# 2024-02-10T08:39:32.575 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.575 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5d84f79:::benchmark_data_smithi018_166993_object40877:head# 2024-02-10T08:39:32.575 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.576 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5d85109:::benchmark_data_smithi018_166993_object109320:head# 2024-02-10T08:39:32.576 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.576 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5d97b4b:::benchmark_data_smithi018_166993_object47382:head# 2024-02-10T08:39:32.576 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.576 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5d9ba15:::benchmark_data_smithi018_166993_object104645:head# 2024-02-10T08:39:32.576 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.576 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5daa823:::benchmark_data_smithi018_166993_object34923:head# 2024-02-10T08:39:32.576 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.577 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5dac172:::benchmark_data_smithi018_166993_object25338:head# 2024-02-10T08:39:32.578 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.578 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5db0c12:::benchmark_data_smithi018_166993_object26016:head# 2024-02-10T08:39:32.578 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.578 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5db385f:::benchmark_data_smithi018_166993_object20631:head# 2024-02-10T08:39:32.578 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.578 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5db6a84:::benchmark_data_smithi018_166993_object64189:head# 2024-02-10T08:39:32.578 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.578 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5db790b:::benchmark_data_smithi018_166993_object99830:head# 2024-02-10T08:39:32.578 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.578 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5db7a7d:::benchmark_data_smithi018_166993_object97723:head# 2024-02-10T08:39:32.578 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.578 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5dca0e6:::benchmark_data_smithi018_166993_object82437:head# 2024-02-10T08:39:32.578 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.579 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5ddd5fa:::benchmark_data_smithi018_166993_object29354:head# 2024-02-10T08:39:32.579 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.579 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5de78eb:::benchmark_data_smithi018_166993_object36683:head# 2024-02-10T08:39:32.579 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.579 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5de90e7:::benchmark_data_smithi018_166993_object115496:head# 2024-02-10T08:39:32.579 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.579 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5dea272:::benchmark_data_smithi018_166993_object79792:head# 2024-02-10T08:39:32.579 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.579 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:32.580 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5e01b1a:::benchmark_data_smithi018_166993_object113296:head# 2024-02-10T08:39:32.580 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.580 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5e289fe:::benchmark_data_smithi018_166993_object111140:head# 2024-02-10T08:39:32.580 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.580 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5e39262:::benchmark_data_smithi018_166993_object99936:head# 2024-02-10T08:39:32.581 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.583 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5e429ae:::benchmark_data_smithi018_166993_object88110:head# 2024-02-10T08:39:32.583 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.583 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5e49641:::benchmark_data_smithi018_166993_object100105:head# 2024-02-10T08:39:32.583 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.583 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5e5068e:::benchmark_data_smithi018_166993_object53992:head# 2024-02-10T08:39:32.583 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.583 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5e53127:::benchmark_data_smithi018_166993_object52491:head# 2024-02-10T08:39:32.583 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.583 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5e584eb:::benchmark_data_smithi018_166993_object26739:head# 2024-02-10T08:39:32.583 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.583 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5e5e193:::benchmark_data_smithi018_166993_object44521:head# 2024-02-10T08:39:32.583 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.583 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5e5fd6d:::benchmark_data_smithi018_166993_object116306:head# 2024-02-10T08:39:32.583 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.584 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5e64fa0:::benchmark_data_smithi018_166993_object86813:head# 2024-02-10T08:39:32.584 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.584 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5e68963:::benchmark_data_smithi018_166993_object114601:head# 2024-02-10T08:39:32.584 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.584 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5e6c05e:::benchmark_data_smithi018_166993_object114943:head# 2024-02-10T08:39:32.584 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.585 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5e778c5:::benchmark_data_smithi018_166993_object59107:head# 2024-02-10T08:39:32.585 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.585 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5e8dc9c:::benchmark_data_smithi018_166993_object97838:head# 2024-02-10T08:39:32.585 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.585 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5e951c0:::benchmark_data_smithi018_166993_object82259:head# 2024-02-10T08:39:32.585 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.586 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5eb2099:::benchmark_data_smithi018_166993_object81443:head# 2024-02-10T08:39:32.586 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.586 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5eb37fc:::benchmark_data_smithi018_166993_object116793:head# 2024-02-10T08:39:32.586 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.586 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5ebb889:::benchmark_data_smithi018_166993_object48674:head# 2024-02-10T08:39:32.586 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.586 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5ec0423:::benchmark_data_smithi018_166993_object83682:head# 2024-02-10T08:39:32.586 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.586 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5ec62c6:::benchmark_data_smithi018_166993_object65695:head# 2024-02-10T08:39:32.586 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.586 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5ecf161:::benchmark_data_smithi018_166993_object64438:head# 2024-02-10T08:39:32.586 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.587 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5ee2452:::benchmark_data_smithi018_166993_object47758:head# 2024-02-10T08:39:32.587 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.588 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5ee66ba:::benchmark_data_smithi018_166993_object23722:head# 2024-02-10T08:39:32.588 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.588 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5ee852c:::benchmark_data_smithi018_166993_object20627:head# 2024-02-10T08:39:32.588 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.588 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5eee969:::benchmark_data_smithi018_166993_object113708:head# 2024-02-10T08:39:32.588 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.588 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5ef0b05:::benchmark_data_smithi018_166993_object53896:head# 2024-02-10T08:39:32.588 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.588 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5f03867:::benchmark_data_smithi018_166993_object34150:head# 2024-02-10T08:39:32.588 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.588 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5f05556:::benchmark_data_smithi018_166993_object26821:head# 2024-02-10T08:39:32.588 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.588 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5f0f31d:::benchmark_data_smithi018_166993_object72268:head# 2024-02-10T08:39:32.589 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.590 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5f13d5e:::benchmark_data_smithi018_166993_object76739:head# 2024-02-10T08:39:32.590 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.590 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5f1fef1:::benchmark_data_smithi018_166993_object68885:head# 2024-02-10T08:39:32.590 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.590 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5f2688a:::benchmark_data_smithi018_166993_object72953:head# 2024-02-10T08:39:32.590 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.590 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5f2d54c:::benchmark_data_smithi018_166993_object118130:head# 2024-02-10T08:39:32.591 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.591 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5f2f8a8:::benchmark_data_smithi018_166993_object36571:head# 2024-02-10T08:39:32.591 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.591 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5f31cdf:::benchmark_data_smithi018_166993_object102642:head# 2024-02-10T08:39:32.591 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.591 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5f32c58:::benchmark_data_smithi018_166993_object43869:head# 2024-02-10T08:39:32.591 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.591 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5f479dd:::benchmark_data_smithi018_166993_object42765:head# 2024-02-10T08:39:32.591 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.592 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5f51f11:::benchmark_data_smithi018_166993_object98387:head# 2024-02-10T08:39:32.593 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.593 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5f6dbc2:::benchmark_data_smithi018_166993_object22636:head# 2024-02-10T08:39:32.593 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.593 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5f7700a:::benchmark_data_smithi018_166993_object21452:head# 2024-02-10T08:39:32.593 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.593 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5fb9803:::benchmark_data_smithi018_166993_object30478:head# 2024-02-10T08:39:32.593 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.593 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5fbc831:::benchmark_data_smithi018_166993_object19163:head# 2024-02-10T08:39:32.593 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.595 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5fbfff9:::benchmark_data_smithi018_166993_object69741:head# 2024-02-10T08:39:32.595 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.595 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5fcfbe1:::benchmark_data_smithi018_166993_object98738:head# 2024-02-10T08:39:32.595 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.595 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5fd5641:::benchmark_data_smithi018_166993_object69255:head# 2024-02-10T08:39:32.595 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.595 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5fe1974:::benchmark_data_smithi018_166993_object84323:head# 2024-02-10T08:39:32.595 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.595 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5fe8bd5:::benchmark_data_smithi018_166993_object98878:head# 2024-02-10T08:39:32.595 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.595 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5fed721:::benchmark_data_smithi018_166993_object97362:head# 2024-02-10T08:39:32.595 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.595 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5ff06e5:::benchmark_data_smithi018_166993_object44933:head# 2024-02-10T08:39:32.596 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.596 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5ff1cf8:::benchmark_data_smithi018_166993_object18611:head# 2024-02-10T08:39:32.596 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.597 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a5ff735a:::benchmark_data_smithi018_166993_object40122:head# 2024-02-10T08:39:32.597 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.597 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6016f5c:::benchmark_data_smithi018_166993_object50832:head# 2024-02-10T08:39:32.597 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.597 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a60194d2:::benchmark_data_smithi018_166993_object112094:head# 2024-02-10T08:39:32.597 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.597 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a601c1c0:::benchmark_data_smithi018_166993_object90799:head# 2024-02-10T08:39:32.597 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.597 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a602507b:::benchmark_data_smithi018_166993_object106487:head# 2024-02-10T08:39:32.597 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.600 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a602e0bf:::benchmark_data_smithi018_166993_object78942:head# 2024-02-10T08:39:32.600 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.601 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a603c7f2:::benchmark_data_smithi018_166993_object50962:head# 2024-02-10T08:39:32.601 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.603 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a604348d:::benchmark_data_smithi018_166993_object42427:head# 2024-02-10T08:39:32.603 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.604 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6043512:::benchmark_data_smithi018_166993_object20971:head# 2024-02-10T08:39:32.604 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.604 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6049bd8:::benchmark_data_smithi018_166993_object47815:head# 2024-02-10T08:39:32.605 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.605 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a604c54d:::benchmark_data_smithi018_166993_object81769:head# 2024-02-10T08:39:32.605 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.605 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a604d22b:::benchmark_data_smithi018_166993_object119008:head# 2024-02-10T08:39:32.605 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.606 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6050480:::benchmark_data_smithi018_166993_object38556:head# 2024-02-10T08:39:32.606 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.607 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a605478c:::benchmark_data_smithi018_166993_object18783:head# 2024-02-10T08:39:32.607 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.607 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6060147:::benchmark_data_smithi018_166993_object115244:head# 2024-02-10T08:39:32.607 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.607 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a606faeb:::benchmark_data_smithi018_166993_object118120:head# 2024-02-10T08:39:32.607 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.607 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a607809a:::benchmark_data_smithi018_166993_object19897:head# 2024-02-10T08:39:32.607 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.607 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a607db93:::benchmark_data_smithi018_166993_object60608:head# 2024-02-10T08:39:32.607 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.607 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a608a342:::benchmark_data_smithi018_166993_object27032:head# 2024-02-10T08:39:32.607 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.608 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6091f85:::benchmark_data_smithi018_166993_object71772:head# 2024-02-10T08:39:32.608 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.609 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a609e224:::benchmark_data_smithi018_166993_object66184:head# 2024-02-10T08:39:32.609 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.609 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a609f1c0:::benchmark_data_smithi018_166993_object114002:head# 2024-02-10T08:39:32.609 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.609 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a60a3d21:::benchmark_data_smithi018_166993_object80697:head# 2024-02-10T08:39:32.609 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.609 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a60ae6ef:::benchmark_data_smithi018_166993_object35878:head# 2024-02-10T08:39:32.609 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.609 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a60b0353:::benchmark_data_smithi018_166993_object38930:head# 2024-02-10T08:39:32.609 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.609 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a60bc41a:::benchmark_data_smithi018_166993_object65141:head# 2024-02-10T08:39:32.609 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.609 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a60bce93:::benchmark_data_smithi018_166993_object40339:head# 2024-02-10T08:39:32.609 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.609 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a60c4d32:::benchmark_data_smithi018_166993_object65866:head# 2024-02-10T08:39:32.610 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.611 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a60c8a84:::benchmark_data_smithi018_166993_object51538:head# 2024-02-10T08:39:32.611 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.611 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a60d5635:::benchmark_data_smithi018_166993_object71781:head# 2024-02-10T08:39:32.611 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.611 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a60f5adf:::benchmark_data_smithi018_166993_object59974:head# 2024-02-10T08:39:32.611 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.611 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a60f8c0f:::benchmark_data_smithi018_166993_object19025:head# 2024-02-10T08:39:32.611 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.611 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a61054eb:::benchmark_data_smithi018_166993_object25287:head# 2024-02-10T08:39:32.611 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.611 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a610c5ae:::benchmark_data_smithi018_166993_object68850:head# 2024-02-10T08:39:32.611 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.611 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a610d3b8:::benchmark_data_smithi018_166993_object66017:head# 2024-02-10T08:39:32.612 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.612 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a611ce86:::benchmark_data_smithi018_166993_object63182:head# 2024-02-10T08:39:32.612 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.614 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6122de2:::benchmark_data_smithi018_166993_object57817:head# 2024-02-10T08:39:32.615 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.615 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a614cca8:::benchmark_data_smithi018_166993_object111355:head# 2024-02-10T08:39:32.615 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.615 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a614dcb0:::benchmark_data_smithi018_166993_object42838:head# 2024-02-10T08:39:32.615 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.615 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a614eecd:::benchmark_data_smithi018_166993_object76314:head# 2024-02-10T08:39:32.615 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.615 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a61561da:::benchmark_data_smithi018_166993_object102538:head# 2024-02-10T08:39:32.615 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.615 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a617b3c3:::benchmark_data_smithi018_166993_object79351:head# 2024-02-10T08:39:32.615 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.615 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a617baf3:::benchmark_data_smithi018_166993_object47741:head# 2024-02-10T08:39:32.615 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.615 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a618a2e0:::benchmark_data_smithi018_166993_object98609:head# 2024-02-10T08:39:32.616 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.616 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a618db18:::benchmark_data_smithi018_166993_object97401:head# 2024-02-10T08:39:32.616 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.616 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a61baccc:::benchmark_data_smithi018_166993_object115920:head# 2024-02-10T08:39:32.616 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.616 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a61bcf62:::benchmark_data_smithi018_166993_object96945:head# 2024-02-10T08:39:32.616 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.616 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a61db4ca:::benchmark_data_smithi018_166993_object95886:head# 2024-02-10T08:39:32.616 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.616 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a61ddc0f:::benchmark_data_smithi018_166993_object105625:head# 2024-02-10T08:39:32.616 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.616 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a61e07a5:::benchmark_data_smithi018_166993_object85931:head# 2024-02-10T08:39:32.616 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.616 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a61f9f07:::benchmark_data_smithi018_166993_object107810:head# 2024-02-10T08:39:32.616 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.617 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6212287:::benchmark_data_smithi018_166993_object101720:head# 2024-02-10T08:39:32.617 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.617 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6217931:::benchmark_data_smithi018_166993_object86550:head# 2024-02-10T08:39:32.617 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.617 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a621d907:::benchmark_data_smithi018_166993_object49925:head# 2024-02-10T08:39:32.618 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.618 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6224a0d:::benchmark_data_smithi018_166993_object87182:head# 2024-02-10T08:39:32.618 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.618 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a622f014:::benchmark_data_smithi018_166993_object109749:head# 2024-02-10T08:39:32.618 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.619 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a62348b3:::benchmark_data_smithi018_166993_object44923:head# 2024-02-10T08:39:32.620 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.620 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6237b89:::benchmark_data_smithi018_166993_object91751:head# 2024-02-10T08:39:32.620 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.620 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a62387c7:::benchmark_data_smithi018_166993_object61299:head# 2024-02-10T08:39:32.620 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.620 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6248675:::benchmark_data_smithi018_166993_object59759:head# 2024-02-10T08:39:32.620 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.620 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6249523:::benchmark_data_smithi018_166993_object88780:head# 2024-02-10T08:39:32.620 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.623 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6253149:::benchmark_data_smithi018_166993_object117875:head# 2024-02-10T08:39:32.623 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.623 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6257318:::benchmark_data_smithi018_166993_object32670:head# 2024-02-10T08:39:32.624 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.624 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a62583ab:::benchmark_data_smithi018_166993_object57459:head# 2024-02-10T08:39:32.624 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.624 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6269e07:::benchmark_data_smithi018_166993_object92017:head# 2024-02-10T08:39:32.624 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.624 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a626bded:::benchmark_data_smithi018_166993_object88193:head# 2024-02-10T08:39:32.624 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.624 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a627f7b3:::benchmark_data_smithi018_166993_object40975:head# 2024-02-10T08:39:32.624 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.625 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a628aab8:::benchmark_data_smithi018_166993_object66416:head# 2024-02-10T08:39:32.626 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.626 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a628d020:::benchmark_data_smithi018_166993_object49985:head# 2024-02-10T08:39:32.626 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.626 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a628ee15:::benchmark_data_smithi018_166993_object39818:head# 2024-02-10T08:39:32.626 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.626 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a628fd79:::benchmark_data_smithi018_166993_object116343:head# 2024-02-10T08:39:32.626 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.628 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a62904f8:::benchmark_data_smithi018_166993_object32822:head# 2024-02-10T08:39:32.628 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.628 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a629d56a:::benchmark_data_smithi018_166993_object118395:head# 2024-02-10T08:39:32.628 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.628 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a62a49f6:::benchmark_data_smithi018_166993_object85798:head# 2024-02-10T08:39:32.628 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.629 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a62a9e36:::benchmark_data_smithi018_166993_object39391:head# 2024-02-10T08:39:32.629 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.629 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a62ae165:::benchmark_data_smithi018_166993_object63986:head# 2024-02-10T08:39:32.629 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.630 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a62b12f9:::benchmark_data_smithi018_166993_object117630:head# 2024-02-10T08:39:32.630 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.630 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a62b89bf:::benchmark_data_smithi018_166993_object60258:head# 2024-02-10T08:39:32.630 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.630 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a62bd278:::benchmark_data_smithi018_166993_object37947:head# 2024-02-10T08:39:32.630 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.630 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a62c4ca9:::benchmark_data_smithi018_166993_object53985:head# 2024-02-10T08:39:32.630 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.630 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a62c911f:::benchmark_data_smithi018_166993_object42658:head# 2024-02-10T08:39:32.630 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.631 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a62cb752:::benchmark_data_smithi018_166993_object72199:head# 2024-02-10T08:39:32.631 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.631 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a62cb823:::benchmark_data_smithi018_166993_object49678:head# 2024-02-10T08:39:32.631 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.633 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a62cd6f5:::benchmark_data_smithi018_166993_object25822:head# 2024-02-10T08:39:32.633 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.633 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a62d916c:::benchmark_data_smithi018_166993_object111584:head# 2024-02-10T08:39:32.633 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.633 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a62dc4ee:::benchmark_data_smithi018_166993_object77345:head# 2024-02-10T08:39:32.633 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.633 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a62dfe89:::benchmark_data_smithi018_166993_object105334:head# 2024-02-10T08:39:32.633 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.633 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6302598:::benchmark_data_smithi018_166993_object17714:head# 2024-02-10T08:39:32.633 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.634 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6308241:::benchmark_data_smithi018_166993_object87982:head# 2024-02-10T08:39:32.634 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.634 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a630ab6b:::benchmark_data_smithi018_166993_object115996:head# 2024-02-10T08:39:32.634 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.634 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a630d176:::benchmark_data_smithi018_166993_object18070:head# 2024-02-10T08:39:32.634 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.634 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a63198b8:::benchmark_data_smithi018_166993_object43100:head# 2024-02-10T08:39:32.634 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.634 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a633c361:::benchmark_data_smithi018_166993_object108792:head# 2024-02-10T08:39:32.634 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.634 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a634857f:::benchmark_data_smithi018_166993_object47115:head# 2024-02-10T08:39:32.634 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.634 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a634a9cc:::benchmark_data_smithi018_166993_object89504:head# 2024-02-10T08:39:32.634 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.636 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a634b59d:::benchmark_data_smithi018_166993_object22964:head# 2024-02-10T08:39:32.637 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.637 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a63507c2:::benchmark_data_smithi018_166993_object55520:head# 2024-02-10T08:39:32.637 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.637 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6353a6e:::benchmark_data_smithi018_166993_object56168:head# 2024-02-10T08:39:32.637 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.637 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6355d6b:::benchmark_data_smithi018_166993_object35961:head# 2024-02-10T08:39:32.637 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.637 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a63607ca:::benchmark_data_smithi018_166993_object32890:head# 2024-02-10T08:39:32.637 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.637 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a636198a:::benchmark_data_smithi018_166993_object108755:head# 2024-02-10T08:39:32.637 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.637 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a636d414:::benchmark_data_smithi018_166993_object108116:head# 2024-02-10T08:39:32.637 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.637 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6375233:::benchmark_data_smithi018_166993_object62770:head# 2024-02-10T08:39:32.638 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.638 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6397f71:::benchmark_data_smithi018_166993_object90154:head# 2024-02-10T08:39:32.638 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.638 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a63a33ea:::benchmark_data_smithi018_166993_object36686:head# 2024-02-10T08:39:32.638 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.638 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a63b7478:::benchmark_data_smithi018_166993_object66667:head# 2024-02-10T08:39:32.638 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.638 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a63bdbc1:::benchmark_data_smithi018_166993_object88019:head# 2024-02-10T08:39:32.638 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.638 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a63bf32e:::benchmark_data_smithi018_166993_object70985:head# 2024-02-10T08:39:32.638 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.639 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a63c6e24:::benchmark_data_smithi018_166993_object63174:head# 2024-02-10T08:39:32.639 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.639 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a63c82f0:::benchmark_data_smithi018_166993_object90247:head# 2024-02-10T08:39:32.639 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.639 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a63d0e54:::benchmark_data_smithi018_166993_object20033:head# 2024-02-10T08:39:32.639 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.643 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a63d4c17:::benchmark_data_smithi018_166993_object62104:head# 2024-02-10T08:39:32.643 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.643 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a63e7126:::benchmark_data_smithi018_166993_object24845:head# 2024-02-10T08:39:32.643 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.644 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a63e7365:::benchmark_data_smithi018_166993_object28255:head# 2024-02-10T08:39:32.644 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.644 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a63eee88:::benchmark_data_smithi018_166993_object82522:head# 2024-02-10T08:39:32.644 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.645 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a63fabb3:::benchmark_data_smithi018_166993_object117792:head# 2024-02-10T08:39:32.645 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.645 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a63fcb01:::benchmark_data_smithi018_166993_object53906:head# 2024-02-10T08:39:32.645 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.647 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a641297e:::benchmark_data_smithi018_166993_object77418:head# 2024-02-10T08:39:32.647 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.647 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a641611e:::benchmark_data_smithi018_166993_object34060:head# 2024-02-10T08:39:32.647 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.648 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a641f1e1:::benchmark_data_smithi018_166993_object54215:head# 2024-02-10T08:39:32.648 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.648 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6456935:::benchmark_data_smithi018_166993_object118425:head# 2024-02-10T08:39:32.648 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.648 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6457e7c:::benchmark_data_smithi018_166993_object106917:head# 2024-02-10T08:39:32.649 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.654 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a646410a:::benchmark_data_smithi018_166993_object63021:head# 2024-02-10T08:39:32.654 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.654 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6466ad4:::benchmark_data_smithi018_166993_object69012:head# 2024-02-10T08:39:32.654 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.655 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a647c0dc:::benchmark_data_smithi018_166993_object23365:head# 2024-02-10T08:39:32.655 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.655 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a64ac6d2:::benchmark_data_smithi018_166993_object115940:head# 2024-02-10T08:39:32.655 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.655 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a64af64a:::benchmark_data_smithi018_166993_object28289:head# 2024-02-10T08:39:32.655 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.656 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a64b19bc:::benchmark_data_smithi018_166993_object26470:head# 2024-02-10T08:39:32.656 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.656 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a64c4894:::benchmark_data_smithi018_166993_object40210:head# 2024-02-10T08:39:32.656 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.656 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a64d992c:::benchmark_data_smithi018_166993_object41667:head# 2024-02-10T08:39:32.656 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.656 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a64ea8eb:::benchmark_data_smithi018_166993_object65905:head# 2024-02-10T08:39:32.656 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.656 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a64f210e:::benchmark_data_smithi018_166993_object105776:head# 2024-02-10T08:39:32.657 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.658 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a64fefc5:::benchmark_data_smithi018_166993_object109236:head# 2024-02-10T08:39:32.658 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.658 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a65065bb:::benchmark_data_smithi018_166993_object39341:head# 2024-02-10T08:39:32.658 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.658 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a65092a9:::benchmark_data_smithi018_166993_object112385:head# 2024-02-10T08:39:32.658 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.658 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a651c3f4:::benchmark_data_smithi018_166993_object40307:head# 2024-02-10T08:39:32.658 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.658 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a651cd4b:::benchmark_data_smithi018_166993_object76535:head# 2024-02-10T08:39:32.658 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.658 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a653720e:::benchmark_data_smithi018_166993_object74668:head# 2024-02-10T08:39:32.658 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.660 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6539c2b:::benchmark_data_smithi018_166993_object117911:head# 2024-02-10T08:39:32.660 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.660 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a654697e:::benchmark_data_smithi018_166993_object80500:head# 2024-02-10T08:39:32.660 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.661 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a654ab14:::benchmark_data_smithi018_166993_object56388:head# 2024-02-10T08:39:32.661 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.661 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a654bb1f:::benchmark_data_smithi018_166993_object67016:head# 2024-02-10T08:39:32.661 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.661 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a65546f3:::benchmark_data_smithi018_166993_object47824:head# 2024-02-10T08:39:32.661 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.661 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a655775c:::benchmark_data_smithi018_166993_object109239:head# 2024-02-10T08:39:32.661 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.662 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a656968d:::benchmark_data_smithi018_166993_object94028:head# 2024-02-10T08:39:32.662 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.663 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a656d578:::benchmark_data_smithi018_166993_object87171:head# 2024-02-10T08:39:32.663 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.663 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a656eed9:::benchmark_data_smithi018_166993_object81639:head# 2024-02-10T08:39:32.663 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.663 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6572678:::benchmark_data_smithi018_166993_object87687:head# 2024-02-10T08:39:32.663 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.663 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6580926:::benchmark_data_smithi018_166993_object72421:head# 2024-02-10T08:39:32.663 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.665 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a65890fc:::benchmark_data_smithi018_166993_object67422:head# 2024-02-10T08:39:32.665 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.665 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6593462:::benchmark_data_smithi018_166993_object88449:head# 2024-02-10T08:39:32.665 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.665 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6594880:::benchmark_data_smithi018_166993_object74375:head# 2024-02-10T08:39:32.665 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.665 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a659c2e6:::benchmark_data_smithi018_166993_object86776:head# 2024-02-10T08:39:32.665 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.666 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a659c3ff:::benchmark_data_smithi018_166993_object52186:head# 2024-02-10T08:39:32.666 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.666 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a659e3ed:::benchmark_data_smithi018_166993_object104430:head# 2024-02-10T08:39:32.666 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.666 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a65a63a1:::benchmark_data_smithi018_166993_object54459:head# 2024-02-10T08:39:32.666 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.666 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a65b17f1:::benchmark_data_smithi018_166993_object54361:head# 2024-02-10T08:39:32.666 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.666 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a65b2876:::benchmark_data_smithi018_166993_object20435:head# 2024-02-10T08:39:32.666 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.666 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a65be236:::benchmark_data_smithi018_166993_object45196:head# 2024-02-10T08:39:32.666 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.666 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a65c0ca5:::benchmark_data_smithi018_166993_object89371:head# 2024-02-10T08:39:32.666 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.667 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a65c6b47:::benchmark_data_smithi018_166993_object67612:head# 2024-02-10T08:39:32.667 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.667 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a65db201:::benchmark_data_smithi018_166993_object27482:head# 2024-02-10T08:39:32.667 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.667 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a65ea8d7:::benchmark_data_smithi018_166993_object20537:head# 2024-02-10T08:39:32.667 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.668 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a660a0f3:::benchmark_data_smithi018_166993_object68256:head# 2024-02-10T08:39:32.668 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.668 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a660b70a:::benchmark_data_smithi018_166993_object26672:head# 2024-02-10T08:39:32.668 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.668 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6618e37:::benchmark_data_smithi018_166993_object73459:head# 2024-02-10T08:39:32.668 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.669 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6619779:::benchmark_data_smithi018_166993_object55718:head# 2024-02-10T08:39:32.669 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.669 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a661c643:::benchmark_data_smithi018_166993_object70072:head# 2024-02-10T08:39:32.669 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.669 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a662011b:::benchmark_data_smithi018_166993_object87353:head# 2024-02-10T08:39:32.670 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.670 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6622634:::benchmark_data_smithi018_166993_object24280:head# 2024-02-10T08:39:32.670 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.670 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6640169:::benchmark_data_smithi018_166993_object98182:head# 2024-02-10T08:39:32.670 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.671 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6649811:::benchmark_data_smithi018_166993_object76075:head# 2024-02-10T08:39:32.671 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.671 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a665e47b:::benchmark_data_smithi018_166993_object51769:head# 2024-02-10T08:39:32.671 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.671 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a666d92d:::benchmark_data_smithi018_166993_object36222:head# 2024-02-10T08:39:32.671 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.671 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6680249:::benchmark_data_smithi018_166993_object31624:head# 2024-02-10T08:39:32.671 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.671 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a668dd90:::benchmark_data_smithi018_166993_object33289:head# 2024-02-10T08:39:32.671 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.671 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6693936:::benchmark_data_smithi018_166993_object99065:head# 2024-02-10T08:39:32.672 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.672 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a66a2224:::benchmark_data_smithi018_166993_object110058:head# 2024-02-10T08:39:32.672 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.673 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a66ad3a6:::benchmark_data_smithi018_166993_object91402:head# 2024-02-10T08:39:32.673 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.673 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a66bac00:::benchmark_data_smithi018_166993_object52956:head# 2024-02-10T08:39:32.673 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.673 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a66c97ae:::benchmark_data_smithi018_166993_object110568:head# 2024-02-10T08:39:32.673 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.673 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a66d012a:::benchmark_data_smithi018_166993_object25253:head# 2024-02-10T08:39:32.673 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.673 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a66eb30d:::benchmark_data_smithi018_166993_object41713:head# 2024-02-10T08:39:32.673 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.673 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a66ffaad:::benchmark_data_smithi018_166993_object103840:head# 2024-02-10T08:39:32.673 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.677 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6705dcd:::benchmark_data_smithi018_166993_object82365:head# 2024-02-10T08:39:32.677 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.677 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6716656:::benchmark_data_smithi018_166993_object53589:head# 2024-02-10T08:39:32.677 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.677 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a672683b:::benchmark_data_smithi018_166993_object30944:head# 2024-02-10T08:39:32.677 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.677 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a672cb1c:::benchmark_data_smithi018_166993_object24159:head# 2024-02-10T08:39:32.678 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.678 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a672db97:::benchmark_data_smithi018_166993_object98898:head# 2024-02-10T08:39:32.678 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.678 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a67372ea:::benchmark_data_smithi018_166993_object103601:head# 2024-02-10T08:39:32.678 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.678 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a673d616:::benchmark_data_smithi018_166993_object115880:head# 2024-02-10T08:39:32.678 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.678 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6745c0c:::benchmark_data_smithi018_166993_object111559:head# 2024-02-10T08:39:32.678 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.678 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a674dd4e:::benchmark_data_smithi018_166993_object32759:head# 2024-02-10T08:39:32.678 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.678 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6752b08:::benchmark_data_smithi018_166993_object116622:head# 2024-02-10T08:39:32.678 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.678 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6759281:::benchmark_data_smithi018_166993_object111166:head# 2024-02-10T08:39:32.679 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.679 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a675b72a:::benchmark_data_smithi018_166993_object84229:head# 2024-02-10T08:39:32.679 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.679 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a675ca47:::benchmark_data_smithi018_166993_object73067:head# 2024-02-10T08:39:32.679 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.679 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a676faef:::benchmark_data_smithi018_166993_object39555:head# 2024-02-10T08:39:32.679 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.679 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a676fe03:::benchmark_data_smithi018_166993_object53736:head# 2024-02-10T08:39:32.679 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.679 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a678514d:::benchmark_data_smithi018_166993_object50039:head# 2024-02-10T08:39:32.679 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.679 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a678682c:::benchmark_data_smithi018_166993_object60709:head# 2024-02-10T08:39:32.679 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.679 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a678a04d:::benchmark_data_smithi018_166993_object109358:head# 2024-02-10T08:39:32.679 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.680 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a678c720:::benchmark_data_smithi018_166993_object97139:head# 2024-02-10T08:39:32.680 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.682 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a67a613e:::benchmark_data_smithi018_166993_object22925:head# 2024-02-10T08:39:32.682 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.682 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a67a9f3e:::benchmark_data_smithi018_166993_object56196:head# 2024-02-10T08:39:32.682 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.682 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a67ad0ce:::benchmark_data_smithi018_166993_object38806:head# 2024-02-10T08:39:32.683 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.683 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a67b6af9:::benchmark_data_smithi018_166993_object54447:head# 2024-02-10T08:39:32.683 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.683 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a67c7310:::benchmark_data_smithi018_166993_object93917:head# 2024-02-10T08:39:32.683 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.683 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a67de5d9:::benchmark_data_smithi018_166993_object115939:head# 2024-02-10T08:39:32.683 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.683 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a67f50a4:::benchmark_data_smithi018_166993_object23063:head# 2024-02-10T08:39:32.683 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.683 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a68004d1:::benchmark_data_smithi018_166993_object86540:head# 2024-02-10T08:39:32.683 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.683 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6802ea1:::benchmark_data_smithi018_166993_object67365:head# 2024-02-10T08:39:32.683 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.683 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a680911d:::benchmark_data_smithi018_166993_object109476:head# 2024-02-10T08:39:32.683 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.683 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a681bb55:::benchmark_data_smithi018_166993_object95822:head# 2024-02-10T08:39:32.684 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.684 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a681d1b3:::benchmark_data_smithi018_166993_object67952:head# 2024-02-10T08:39:32.684 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.684 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a681dbab:::benchmark_data_smithi018_166993_object33589:head# 2024-02-10T08:39:32.684 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.684 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6821865:::benchmark_data_smithi018_166993_object61652:head# 2024-02-10T08:39:32.684 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.684 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6847849:::benchmark_data_smithi018_166993_object99130:head# 2024-02-10T08:39:32.684 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.684 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6856c48:::benchmark_data_smithi018_166993_object72518:head# 2024-02-10T08:39:32.684 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.684 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a685db56:::benchmark_data_smithi018_166993_object87179:head# 2024-02-10T08:39:32.684 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.686 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a68658e2:::benchmark_data_smithi018_166993_object89674:head# 2024-02-10T08:39:32.686 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.693 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a68738d4:::benchmark_data_smithi018_166993_object26226:head# 2024-02-10T08:39:32.693 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.693 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a687d3af:::benchmark_data_smithi018_166993_object98558:head# 2024-02-10T08:39:32.693 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.693 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a68806d3:::benchmark_data_smithi018_166993_object35793:head# 2024-02-10T08:39:32.693 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.693 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a68818ff:::benchmark_data_smithi018_166993_object27788:head# 2024-02-10T08:39:32.693 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.694 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a68896e7:::benchmark_data_smithi018_166993_object35902:head# 2024-02-10T08:39:32.694 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.694 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a689fa97:::benchmark_data_smithi018_166993_object94641:head# 2024-02-10T08:39:32.694 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.698 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a68aa90a:::benchmark_data_smithi018_166993_object93151:head# 2024-02-10T08:39:32.698 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.698 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a68c620c:::benchmark_data_smithi018_166993_object61489:head# 2024-02-10T08:39:32.698 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.698 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a68f44b5:::benchmark_data_smithi018_166993_object29820:head# 2024-02-10T08:39:32.698 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.698 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a692752d:::benchmark_data_smithi018_166993_object26411:head# 2024-02-10T08:39:32.698 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.698 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a692dbd0:::benchmark_data_smithi018_166993_object100132:head# 2024-02-10T08:39:32.698 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.698 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6933379:::benchmark_data_smithi018_166993_object73049:head# 2024-02-10T08:39:32.698 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.698 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a693c253:::benchmark_data_smithi018_166993_object118624:head# 2024-02-10T08:39:32.699 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.699 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6947111:::benchmark_data_smithi018_166993_object97829:head# 2024-02-10T08:39:32.699 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.699 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a694db41:::benchmark_data_smithi018_166993_object72238:head# 2024-02-10T08:39:32.699 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.700 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6954656:::benchmark_data_smithi018_166993_object100643:head# 2024-02-10T08:39:32.700 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.700 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a695a187:::benchmark_data_smithi018_166993_object106543:head# 2024-02-10T08:39:32.700 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.704 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a696c77e:::benchmark_data_smithi018_166993_object115588:head# 2024-02-10T08:39:32.704 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.705 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6970476:::benchmark_data_smithi018_166993_object78142:head# 2024-02-10T08:39:32.705 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.706 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a697ad49:::benchmark_data_smithi018_166993_object105483:head# 2024-02-10T08:39:32.706 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.706 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6980a68:::benchmark_data_smithi018_166993_object101908:head# 2024-02-10T08:39:32.707 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.707 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a698a2f3:::benchmark_data_smithi018_166993_object58755:head# 2024-02-10T08:39:32.707 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.707 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a698b566:::benchmark_data_smithi018_166993_object22198:head# 2024-02-10T08:39:32.707 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.707 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6997a08:::benchmark_data_smithi018_166993_object114844:head# 2024-02-10T08:39:32.707 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.708 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a69a3742:::benchmark_data_smithi018_166993_object34647:head# 2024-02-10T08:39:32.708 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.708 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a69a8fe1:::benchmark_data_smithi018_166993_object26472:head# 2024-02-10T08:39:32.708 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.709 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a69b4377:::benchmark_data_smithi018_166993_object61095:head# 2024-02-10T08:39:32.709 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.709 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a69bd950:::benchmark_data_smithi018_166993_object73682:head# 2024-02-10T08:39:32.709 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.709 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a69c0bff:::benchmark_data_smithi018_166993_object55960:head# 2024-02-10T08:39:32.709 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.709 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a69cb175:::benchmark_data_smithi018_166993_object39369:head# 2024-02-10T08:39:32.709 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.709 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a69cc97c:::benchmark_data_smithi018_166993_object85936:head# 2024-02-10T08:39:32.709 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.710 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a69cd5f7:::benchmark_data_smithi018_166993_object89750:head# 2024-02-10T08:39:32.710 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.710 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a69f15e3:::benchmark_data_smithi018_166993_object40142:head# 2024-02-10T08:39:32.710 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.711 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a69f27a0:::benchmark_data_smithi018_166993_object41355:head# 2024-02-10T08:39:32.711 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.711 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a69fa3fd:::benchmark_data_smithi018_166993_object60933:head# 2024-02-10T08:39:32.711 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.711 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a69fdba0:::benchmark_data_smithi018_166993_object77296:head# 2024-02-10T08:39:32.711 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.711 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6a017ba:::benchmark_data_smithi018_166993_object107324:head# 2024-02-10T08:39:32.711 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.711 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6a041c9:::benchmark_data_smithi018_166993_object68085:head# 2024-02-10T08:39:32.711 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.712 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6a05456:::benchmark_data_smithi018_166993_object59775:head# 2024-02-10T08:39:32.712 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.712 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6a07d95:::benchmark_data_smithi018_166993_object89439:head# 2024-02-10T08:39:32.712 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.712 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6a0bf02:::benchmark_data_smithi018_166993_object57174:head# 2024-02-10T08:39:32.713 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.713 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6a0f38e:::benchmark_data_smithi018_166993_object100227:head# 2024-02-10T08:39:32.713 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.713 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6a12fb4:::benchmark_data_smithi018_166993_object70639:head# 2024-02-10T08:39:32.713 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.713 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6a39057:::benchmark_data_smithi018_166993_object43578:head# 2024-02-10T08:39:32.713 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.713 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6a3b5e3:::benchmark_data_smithi018_166993_object86911:head# 2024-02-10T08:39:32.713 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.713 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6a3ee08:::benchmark_data_smithi018_166993_object82297:head# 2024-02-10T08:39:32.713 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.714 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6a4b541:::benchmark_data_smithi018_166993_object59895:head# 2024-02-10T08:39:32.714 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.714 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6a50970:::benchmark_data_smithi018_166993_object56365:head# 2024-02-10T08:39:32.714 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.714 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6a5a97f:::benchmark_data_smithi018_166993_object104103:head# 2024-02-10T08:39:32.714 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.715 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6a5cdf8:::benchmark_data_smithi018_166993_object26039:head# 2024-02-10T08:39:32.715 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.715 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6a606ea:::benchmark_data_smithi018_166993_object34432:head# 2024-02-10T08:39:32.715 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.716 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6a659e1:::benchmark_data_smithi018_166993_object25133:head# 2024-02-10T08:39:32.716 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.716 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6a6d77c:::benchmark_data_smithi018_166993_object89217:head# 2024-02-10T08:39:32.716 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.716 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6a85cce:::benchmark_data_smithi018_166993_object115267:head# 2024-02-10T08:39:32.716 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.717 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6a86ea3:::benchmark_data_smithi018_166993_object75871:head# 2024-02-10T08:39:32.717 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.717 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6a90c48:::benchmark_data_smithi018_166993_object76631:head# 2024-02-10T08:39:32.717 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.717 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6aad1b4:::benchmark_data_smithi018_166993_object37603:head# 2024-02-10T08:39:32.717 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.717 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6ac796d:::benchmark_data_smithi018_166993_object52430:head# 2024-02-10T08:39:32.717 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.719 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6ad2421:::benchmark_data_smithi018_166993_object61658:head# 2024-02-10T08:39:32.719 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.719 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6ad40ab:::benchmark_data_smithi018_166993_object92767:head# 2024-02-10T08:39:32.719 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.719 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6af7e37:::benchmark_data_smithi018_166993_object18853:head# 2024-02-10T08:39:32.719 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.719 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6afa039:::benchmark_data_smithi018_166993_object74910:head# 2024-02-10T08:39:32.719 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.719 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6b1658e:::benchmark_data_smithi018_166993_object29320:head# 2024-02-10T08:39:32.720 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.720 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6b16d6f:::benchmark_data_smithi018_166993_object53023:head# 2024-02-10T08:39:32.720 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.720 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6b21398:::benchmark_data_smithi018_166993_object75165:head# 2024-02-10T08:39:32.720 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.720 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6b2edaa:::benchmark_data_smithi018_166993_object77479:head# 2024-02-10T08:39:32.720 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.720 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6b35cf6:::benchmark_data_smithi018_166993_object17802:head# 2024-02-10T08:39:32.720 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.720 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6b44c37:::benchmark_data_smithi018_166993_object53919:head# 2024-02-10T08:39:32.720 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.720 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6b76055:::benchmark_data_smithi018_166993_object19075:head# 2024-02-10T08:39:32.720 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.722 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6b8309d:::benchmark_data_smithi018_166993_object28468:head# 2024-02-10T08:39:32.722 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.722 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6b84684:::benchmark_data_smithi018_166993_object118835:head# 2024-02-10T08:39:32.722 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.722 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6b8936b:::benchmark_data_smithi018_166993_object39039:head# 2024-02-10T08:39:32.722 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.722 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6b8c6c8:::benchmark_data_smithi018_166993_object91858:head# 2024-02-10T08:39:32.722 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.722 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6b926d6:::benchmark_data_smithi018_166993_object20811:head# 2024-02-10T08:39:32.722 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.722 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6b9d1d3:::benchmark_data_smithi018_166993_object119093:head# 2024-02-10T08:39:32.722 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.722 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6ba90fe:::benchmark_data_smithi018_166993_object80230:head# 2024-02-10T08:39:32.723 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.723 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6bb6bd7:::benchmark_data_smithi018_166993_object99398:head# 2024-02-10T08:39:32.723 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.723 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6bb9b99:::benchmark_data_smithi018_166993_object35805:head# 2024-02-10T08:39:32.723 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.723 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6bbc368:::benchmark_data_smithi018_166993_object97736:head# 2024-02-10T08:39:32.723 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.723 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6bdfdbe:::benchmark_data_smithi018_166993_object40527:head# 2024-02-10T08:39:32.723 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.724 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6be19c6:::benchmark_data_smithi018_166993_object113030:head# 2024-02-10T08:39:32.724 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.727 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6be6b3e:::benchmark_data_smithi018_166993_object102694:head# 2024-02-10T08:39:32.727 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.727 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6beaf88:::benchmark_data_smithi018_166993_object50773:head# 2024-02-10T08:39:32.727 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.728 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6bf1df2:::benchmark_data_smithi018_166993_object70365:head# 2024-02-10T08:39:32.728 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.728 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6bfa95a:::benchmark_data_smithi018_166993_object52477:head# 2024-02-10T08:39:32.728 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.729 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6c03cb2:::benchmark_data_smithi018_166993_object94779:head# 2024-02-10T08:39:32.729 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.729 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6c09f05:::benchmark_data_smithi018_166993_object56157:head# 2024-02-10T08:39:32.729 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.729 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6c1229c:::benchmark_data_smithi018_166993_object51251:head# 2024-02-10T08:39:32.729 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.729 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6c2adcd:::benchmark_data_smithi018_166993_object117034:head# 2024-02-10T08:39:32.729 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.730 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6c420bc:::benchmark_data_smithi018_166993_object23024:head# 2024-02-10T08:39:32.730 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.730 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6c4fa73:::benchmark_data_smithi018_166993_object23375:head# 2024-02-10T08:39:32.730 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.730 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6c53ae8:::benchmark_data_smithi018_166993_object65360:head# 2024-02-10T08:39:32.730 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.731 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6c6effa:::benchmark_data_smithi018_166993_object111873:head# 2024-02-10T08:39:32.731 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.731 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6c6feb6:::benchmark_data_smithi018_166993_object56558:head# 2024-02-10T08:39:32.731 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.731 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6c74db1:::benchmark_data_smithi018_166993_object89257:head# 2024-02-10T08:39:32.732 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.732 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6c811f9:::benchmark_data_smithi018_166993_object93525:head# 2024-02-10T08:39:32.732 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.732 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6c87054:::benchmark_data_smithi018_166993_object85131:head# 2024-02-10T08:39:32.732 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.732 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6c89f3f:::benchmark_data_smithi018_166993_object54076:head# 2024-02-10T08:39:32.732 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.734 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6c8a3ed:::benchmark_data_smithi018_166993_object98795:head# 2024-02-10T08:39:32.734 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.734 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6c909b4:::benchmark_data_smithi018_166993_object57225:head# 2024-02-10T08:39:32.734 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.735 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6c97a6c:::benchmark_data_smithi018_166993_object90200:head# 2024-02-10T08:39:32.735 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.735 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6c9dde5:::benchmark_data_smithi018_166993_object117649:head# 2024-02-10T08:39:32.735 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.735 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6ca2fa3:::benchmark_data_smithi018_166993_object76196:head# 2024-02-10T08:39:32.735 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.736 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6ca3b07:::benchmark_data_smithi018_166993_object113848:head# 2024-02-10T08:39:32.736 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.737 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6cae58c:::benchmark_data_smithi018_166993_object69898:head# 2024-02-10T08:39:32.737 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.737 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6cd7362:::benchmark_data_smithi018_166993_object86699:head# 2024-02-10T08:39:32.737 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.738 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6cd8844:::benchmark_data_smithi018_166993_object56249:head# 2024-02-10T08:39:32.738 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.738 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6cf8eb8:::benchmark_data_smithi018_166993_object57333:head# 2024-02-10T08:39:32.738 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.738 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6d0c5ed:::benchmark_data_smithi018_166993_object69609:head# 2024-02-10T08:39:32.738 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.739 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6d0fe83:::benchmark_data_smithi018_166993_object43105:head# 2024-02-10T08:39:32.739 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.739 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6d1a36e:::benchmark_data_smithi018_166993_object89782:head# 2024-02-10T08:39:32.739 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.739 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6d23523:::benchmark_data_smithi018_166993_object51031:head# 2024-02-10T08:39:32.739 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.740 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6d251fb:::benchmark_data_smithi018_166993_object82075:head# 2024-02-10T08:39:32.740 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.740 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6d27143:::benchmark_data_smithi018_166993_object70880:head# 2024-02-10T08:39:32.740 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.740 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6d2fbba:::benchmark_data_smithi018_166993_object33760:head# 2024-02-10T08:39:32.740 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.740 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6d3825e:::benchmark_data_smithi018_166993_object70624:head# 2024-02-10T08:39:32.740 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.740 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6d435d8:::benchmark_data_smithi018_166993_object92728:head# 2024-02-10T08:39:32.741 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.745 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6d448d6:::benchmark_data_smithi018_166993_object61850:head# 2024-02-10T08:39:32.745 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.745 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6d56694:::benchmark_data_smithi018_166993_object70061:head# 2024-02-10T08:39:32.746 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.746 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6d61bce:::benchmark_data_smithi018_166993_object106741:head# 2024-02-10T08:39:32.746 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.746 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6d6299d:::benchmark_data_smithi018_166993_object22689:head# 2024-02-10T08:39:32.746 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.746 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6d6a616:::benchmark_data_smithi018_166993_object48519:head# 2024-02-10T08:39:32.746 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.747 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6d723eb:::benchmark_data_smithi018_166993_object45261:head# 2024-02-10T08:39:32.747 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.751 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6d835f1:::benchmark_data_smithi018_166993_object116301:head# 2024-02-10T08:39:32.751 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.751 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6d92d55:::benchmark_data_smithi018_166993_object35177:head# 2024-02-10T08:39:32.751 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.752 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6d93d8a:::benchmark_data_smithi018_166993_object53920:head# 2024-02-10T08:39:32.752 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.752 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6d9fce5:::benchmark_data_smithi018_166993_object105199:head# 2024-02-10T08:39:32.752 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.752 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6da09c2:::benchmark_data_smithi018_166993_object19535:head# 2024-02-10T08:39:32.752 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.753 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:39:31.159983+0000 mgr.y (mgr.14505) 853 : cluster [DBG] pgmap v1046: 178 pgs: 5 active+undersized+degraded+remapped+backfilling, 173 active+clean; 4.0 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 907 op/s; 18733/197175 objects degraded (9.501%); 3.4 MiB/s, 54 objects/s recovering 2024-02-10T08:39:32.753 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:39:32.076922+0000 mon.a (mon.0) 1795 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:39:32.753 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:39:32.109290+0000 mon.a (mon.0) 1796 : audit [INF] from='client.? 172.21.15.18:0/1107819735' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-10T08:39:32.753 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:39:32.109358+0000 mon.a (mon.0) 1797 : cluster [DBG] osdmap e441: 8 total, 7 up, 7 in 2024-02-10T08:39:32.753 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6daf443:::benchmark_data_smithi018_166993_object115180:head# 2024-02-10T08:39:32.753 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.753 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6dc8581:::benchmark_data_smithi018_166993_object92280:head# 2024-02-10T08:39:32.753 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.753 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6de209a:::benchmark_data_smithi018_166993_object97107:head# 2024-02-10T08:39:32.754 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.755 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6de57f8:::benchmark_data_smithi018_166993_object88006:head# 2024-02-10T08:39:32.755 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.755 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6dea78e:::benchmark_data_smithi018_166993_object59605:head# 2024-02-10T08:39:32.755 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.755 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6df7cf3:::benchmark_data_smithi018_166993_object18187:head# 2024-02-10T08:39:32.755 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.755 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6e0f9a4:::benchmark_data_smithi018_166993_object31039:head# 2024-02-10T08:39:32.755 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.755 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6e156fe:::benchmark_data_smithi018_166993_object105554:head# 2024-02-10T08:39:32.755 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.756 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6e219c5:::benchmark_data_smithi018_166993_object38282:head# 2024-02-10T08:39:32.756 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.756 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6e3abbe:::benchmark_data_smithi018_166993_object26763:head# 2024-02-10T08:39:32.756 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.756 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6e3c6cc:::benchmark_data_smithi018_166993_object55012:head# 2024-02-10T08:39:32.756 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.756 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6e41a43:::benchmark_data_smithi018_166993_object102517:head# 2024-02-10T08:39:32.756 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.757 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6e41b58:::benchmark_data_smithi018_166993_object20170:head# 2024-02-10T08:39:32.757 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.757 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6e45248:::benchmark_data_smithi018_166993_object63223:head# 2024-02-10T08:39:32.757 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.757 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6e4d632:::benchmark_data_smithi018_166993_object48212:head# 2024-02-10T08:39:32.757 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.757 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6e566f7:::benchmark_data_smithi018_166993_object36250:head# 2024-02-10T08:39:32.757 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.758 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6e5821f:::benchmark_data_smithi018_166993_object63298:head# 2024-02-10T08:39:32.758 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.758 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6e73393:::benchmark_data_smithi018_166993_object79037:head# 2024-02-10T08:39:32.759 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.759 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6e7f9fe:::benchmark_data_smithi018_166993_object70287:head# 2024-02-10T08:39:32.759 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.759 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6e8ba01:::benchmark_data_smithi018_166993_object23562:head# 2024-02-10T08:39:32.759 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.763 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6e8c849:::benchmark_data_smithi018_166993_object112208:head# 2024-02-10T08:39:32.763 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.763 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6e93b05:::benchmark_data_smithi018_166993_object82199:head# 2024-02-10T08:39:32.763 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.763 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6e94081:::benchmark_data_smithi018_166993_object31247:head# 2024-02-10T08:39:32.763 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.763 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6e94a29:::benchmark_data_smithi018_166993_object118600:head# 2024-02-10T08:39:32.764 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.764 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6ea8dba:::benchmark_data_smithi018_166993_object47696:head# 2024-02-10T08:39:32.764 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.764 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6eb3774:::benchmark_data_smithi018_166993_object25750:head# 2024-02-10T08:39:32.764 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.764 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6ecb1de:::benchmark_data_smithi018_166993_object22757:head# 2024-02-10T08:39:32.764 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.764 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6ecc3e4:::benchmark_data_smithi018_166993_object59630:head# 2024-02-10T08:39:32.764 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.764 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6eda921:::benchmark_data_smithi018_166993_object90210:head# 2024-02-10T08:39:32.764 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.764 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6ee7c11:::benchmark_data_smithi018_166993_object46578:head# 2024-02-10T08:39:32.764 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.764 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6f0e1d4:::benchmark_data_smithi018_166993_object58866:head# 2024-02-10T08:39:32.764 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.765 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6f18570:::benchmark_data_smithi018_166993_object65534:head# 2024-02-10T08:39:32.765 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.765 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6f276a6:::benchmark_data_smithi018_166993_object76652:head# 2024-02-10T08:39:32.765 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.765 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6f2a489:::benchmark_data_smithi018_166993_object70826:head# 2024-02-10T08:39:32.765 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.766 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6f2dd88:::benchmark_data_smithi018_166993_object42720:head# 2024-02-10T08:39:32.766 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.769 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6f3a7d1:::benchmark_data_smithi018_166993_object49309:head# 2024-02-10T08:39:32.769 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.769 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6f3bd83:::benchmark_data_smithi018_166993_object111570:head# 2024-02-10T08:39:32.769 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.772 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6f3d9b4:::benchmark_data_smithi018_166993_object47814:head# 2024-02-10T08:39:32.772 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.772 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6f41699:::benchmark_data_smithi018_166993_object53821:head# 2024-02-10T08:39:32.772 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.772 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6f44a64:::benchmark_data_smithi018_166993_object39595:head# 2024-02-10T08:39:32.772 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.773 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6f6a201:::benchmark_data_smithi018_166993_object87494:head# 2024-02-10T08:39:32.773 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.773 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6f8ddb1:::benchmark_data_smithi018_166993_object36532:head# 2024-02-10T08:39:32.773 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.773 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6fa16b4:::benchmark_data_smithi018_166993_object85950:head# 2024-02-10T08:39:32.773 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.774 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6fa5092:::benchmark_data_smithi018_166993_object83308:head# 2024-02-10T08:39:32.774 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.776 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6fa7ebd:::benchmark_data_smithi018_166993_object82295:head# 2024-02-10T08:39:32.776 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.776 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6fb6a91:::benchmark_data_smithi018_166993_object110732:head# 2024-02-10T08:39:32.776 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.776 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6fd9f84:::benchmark_data_smithi018_166993_object95118:head# 2024-02-10T08:39:32.776 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.776 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6fe117b:::benchmark_data_smithi018_166993_object70031:head# 2024-02-10T08:39:32.777 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.777 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6fe5e8e:::benchmark_data_smithi018_166993_object19230:head# 2024-02-10T08:39:32.777 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.777 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6ff7efe:::benchmark_data_smithi018_166993_object91337:head# 2024-02-10T08:39:32.777 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.777 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a6ffafd0:::benchmark_data_smithi018_166993_object43768:head# 2024-02-10T08:39:32.777 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.777 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a702dada:::benchmark_data_smithi018_166993_object113596:head# 2024-02-10T08:39:32.778 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.778 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7033cef:::benchmark_data_smithi018_166993_object56308:head# 2024-02-10T08:39:32.778 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.782 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7037242:::benchmark_data_smithi018_166993_object56842:head# 2024-02-10T08:39:32.782 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.782 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7037eed:::benchmark_data_smithi018_166993_object33277:head# 2024-02-10T08:39:32.782 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.783 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a70389f8:::benchmark_data_smithi018_166993_object82181:head# 2024-02-10T08:39:32.783 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.783 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7046f8c:::benchmark_data_smithi018_166993_object99697:head# 2024-02-10T08:39:32.783 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.783 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a704808d:::benchmark_data_smithi018_166993_object43830:head# 2024-02-10T08:39:32.783 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.783 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7054938:::benchmark_data_smithi018_166993_object70398:head# 2024-02-10T08:39:32.783 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.783 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7055954:::benchmark_data_smithi018_166993_object88768:head# 2024-02-10T08:39:32.783 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.783 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a70617b8:::benchmark_data_smithi018_166993_object86636:head# 2024-02-10T08:39:32.783 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.783 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7062787:::benchmark_data_smithi018_166993_object55087:head# 2024-02-10T08:39:32.783 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.792 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a70634db:::benchmark_data_smithi018_166993_object57256:head# 2024-02-10T08:39:32.792 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.798 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7066070:::benchmark_data_smithi018_166993_object85185:head# 2024-02-10T08:39:32.798 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.798 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a706bf82:::benchmark_data_smithi018_166993_object88930:head# 2024-02-10T08:39:32.798 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.799 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a706e98f:::benchmark_data_smithi018_166993_object44956:head# 2024-02-10T08:39:32.799 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.799 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a70758bf:::benchmark_data_smithi018_166993_object105034:head# 2024-02-10T08:39:32.799 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.799 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a70832d4:::benchmark_data_smithi018_166993_object100955:head# 2024-02-10T08:39:32.800 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.800 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7089d38:::benchmark_data_smithi018_166993_object60062:head# 2024-02-10T08:39:32.800 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.800 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a70b49f7:::benchmark_data_smithi018_166993_object26717:head# 2024-02-10T08:39:32.800 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.800 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a70bd457:::benchmark_data_smithi018_166993_object68613:head# 2024-02-10T08:39:32.800 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.800 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a70ca1b5:::benchmark_data_smithi018_166993_object34423:head# 2024-02-10T08:39:32.801 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.801 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a70da12c:::benchmark_data_smithi018_166993_object24413:head# 2024-02-10T08:39:32.801 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.801 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a70e6a6c:::benchmark_data_smithi018_166993_object80352:head# 2024-02-10T08:39:32.801 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.805 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a70eaed7:::benchmark_data_smithi018_166993_object40643:head# 2024-02-10T08:39:32.805 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.805 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a70eb310:::benchmark_data_smithi018_166993_object52826:head# 2024-02-10T08:39:32.806 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.806 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a70f0162:::benchmark_data_smithi018_166993_object101679:head# 2024-02-10T08:39:32.806 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.807 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a70f294f:::benchmark_data_smithi018_166993_object48944:head# 2024-02-10T08:39:32.807 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.807 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a70f343f:::benchmark_data_smithi018_166993_object117845:head# 2024-02-10T08:39:32.807 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.812 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a70f77c1:::benchmark_data_smithi018_166993_object47524:head# 2024-02-10T08:39:32.812 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.812 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a710e0c9:::benchmark_data_smithi018_166993_object100404:head# 2024-02-10T08:39:32.813 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.814 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7111f56:::benchmark_data_smithi018_166993_object23852:head# 2024-02-10T08:39:32.814 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.814 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a711d943:::benchmark_data_smithi018_166993_object47265:head# 2024-02-10T08:39:32.814 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.814 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a711def1:::benchmark_data_smithi018_166993_object57971:head# 2024-02-10T08:39:32.814 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.815 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a712ad2a:::benchmark_data_smithi018_166993_object27991:head# 2024-02-10T08:39:32.815 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.817 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a71310b3:::benchmark_data_smithi018_166993_object23509:head# 2024-02-10T08:39:32.817 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.818 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7145471:::benchmark_data_smithi018_166993_object79338:head# 2024-02-10T08:39:32.818 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.818 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a71479f0:::benchmark_data_smithi018_166993_object23125:head# 2024-02-10T08:39:32.818 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.819 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7157e17:::benchmark_data_smithi018_166993_object104030:head# 2024-02-10T08:39:32.819 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.819 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7176b89:::benchmark_data_smithi018_166993_object56427:head# 2024-02-10T08:39:32.819 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.819 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a717dec1:::benchmark_data_smithi018_166993_object82786:head# 2024-02-10T08:39:32.819 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.819 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a717f41a:::benchmark_data_smithi018_166993_object93840:head# 2024-02-10T08:39:32.820 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.820 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a717f6e6:::benchmark_data_smithi018_166993_object22473:head# 2024-02-10T08:39:32.821 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.821 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7180b09:::benchmark_data_smithi018_166993_object77465:head# 2024-02-10T08:39:32.821 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.821 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7185253:::benchmark_data_smithi018_166993_object83620:head# 2024-02-10T08:39:32.821 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.822 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a719005b:::benchmark_data_smithi018_166993_object22734:head# 2024-02-10T08:39:32.822 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.822 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a71a3b83:::benchmark_data_smithi018_166993_object80313:head# 2024-02-10T08:39:32.822 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.822 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a71a415a:::benchmark_data_smithi018_166993_object65825:head# 2024-02-10T08:39:32.822 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.822 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a71ae859:::benchmark_data_smithi018_166993_object49365:head# 2024-02-10T08:39:32.822 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.822 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a71bac11:::benchmark_data_smithi018_166993_object78169:head# 2024-02-10T08:39:32.822 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.829 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a71bfdcc:::benchmark_data_smithi018_166993_object57839:head# 2024-02-10T08:39:32.829 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.829 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a71c3515:::benchmark_data_smithi018_166993_object115190:head# 2024-02-10T08:39:32.829 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.830 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a71c483c:::benchmark_data_smithi018_166993_object59226:head# 2024-02-10T08:39:32.830 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.832 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a71d2328:::benchmark_data_smithi018_166993_object30340:head# 2024-02-10T08:39:32.832 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.832 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a71d52da:::benchmark_data_smithi018_166993_object94699:head# 2024-02-10T08:39:32.832 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.832 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a71dac9a:::benchmark_data_smithi018_166993_object107562:head# 2024-02-10T08:39:32.833 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.833 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a71e0332:::benchmark_data_smithi018_166993_object44644:head# 2024-02-10T08:39:32.833 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.833 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a71fab33:::benchmark_data_smithi018_166993_object24380:head# 2024-02-10T08:39:32.833 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.833 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7205c68:::benchmark_data_smithi018_166993_object36940:head# 2024-02-10T08:39:32.833 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.834 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a721ef27:::benchmark_data_smithi018_166993_object88018:head# 2024-02-10T08:39:32.834 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.834 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a72200bf:::benchmark_data_smithi018_166993_object66906:head# 2024-02-10T08:39:32.834 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.836 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7231d3d:::benchmark_data_smithi018_166993_object105866:head# 2024-02-10T08:39:32.836 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.838 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a723ede0:::benchmark_data_smithi018_166993_object115604:head# 2024-02-10T08:39:32.838 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.838 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7258703:::benchmark_data_smithi018_166993_object105376:head# 2024-02-10T08:39:32.838 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.838 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a725890e:::benchmark_data_smithi018_166993_object103320:head# 2024-02-10T08:39:32.839 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.839 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a726a98a:::benchmark_data_smithi018_166993_object49561:head# 2024-02-10T08:39:32.839 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.839 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a726c7d2:::benchmark_data_smithi018_166993_object29617:head# 2024-02-10T08:39:32.839 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.839 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7275215:::benchmark_data_smithi018_166993_object45356:head# 2024-02-10T08:39:32.839 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.840 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7287752:::benchmark_data_smithi018_166993_object110204:head# 2024-02-10T08:39:32.840 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.840 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7294fa1:::benchmark_data_smithi018_166993_object95214:head# 2024-02-10T08:39:32.840 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.840 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a72967dc:::benchmark_data_smithi018_166993_object104170:head# 2024-02-10T08:39:32.840 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.841 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a729b642:::benchmark_data_smithi018_166993_object95564:head# 2024-02-10T08:39:32.841 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.841 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a72a3cf6:::benchmark_data_smithi018_166993_object35146:head# 2024-02-10T08:39:32.841 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.841 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a72bc23d:::benchmark_data_smithi018_166993_object100910:head# 2024-02-10T08:39:32.842 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.842 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a72c0e03:::benchmark_data_smithi018_166993_object79097:head# 2024-02-10T08:39:32.842 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.842 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a72c620b:::benchmark_data_smithi018_166993_object62028:head# 2024-02-10T08:39:32.843 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.843 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a72cb30e:::benchmark_data_smithi018_166993_object33352:head# 2024-02-10T08:39:32.843 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.843 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a72ecf5c:::benchmark_data_smithi018_166993_object22191:head# 2024-02-10T08:39:32.843 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.843 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a72f6849:::benchmark_data_smithi018_166993_object24099:head# 2024-02-10T08:39:32.843 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.843 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a72fa83a:::benchmark_data_smithi018_166993_object58588:head# 2024-02-10T08:39:32.843 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.845 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a72fca97:::benchmark_data_smithi018_166993_object34874:head# 2024-02-10T08:39:32.845 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.845 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7302b8d:::benchmark_data_smithi018_166993_object48209:head# 2024-02-10T08:39:32.845 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.845 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7306c94:::benchmark_data_smithi018_166993_object26163:head# 2024-02-10T08:39:32.845 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.845 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7308643:::benchmark_data_smithi018_166993_object28883:head# 2024-02-10T08:39:32.846 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.846 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a730faf9:::benchmark_data_smithi018_166993_object52393:head# 2024-02-10T08:39:32.846 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.846 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a731905e:::benchmark_data_smithi018_166993_object101974:head# 2024-02-10T08:39:32.846 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.846 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a731e2d5:::benchmark_data_smithi018_166993_object108110:head# 2024-02-10T08:39:32.846 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.846 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7337577:::benchmark_data_smithi018_166993_object104109:head# 2024-02-10T08:39:32.846 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.846 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a733dd86:::benchmark_data_smithi018_166993_object38688:head# 2024-02-10T08:39:32.846 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.846 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7352c36:::benchmark_data_smithi018_166993_object93979:head# 2024-02-10T08:39:32.846 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.847 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a73614c7:::benchmark_data_smithi018_166993_object24816:head# 2024-02-10T08:39:32.847 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.847 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7365946:::benchmark_data_smithi018_166993_object62479:head# 2024-02-10T08:39:32.847 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.847 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a736b8c9:::benchmark_data_smithi018_166993_object97323:head# 2024-02-10T08:39:32.847 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.848 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a736d190:::benchmark_data_smithi018_166993_object94533:head# 2024-02-10T08:39:32.848 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.850 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7383004:::benchmark_data_smithi018_166993_object46621:head# 2024-02-10T08:39:32.850 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.850 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7383765:::benchmark_data_smithi018_166993_object57125:head# 2024-02-10T08:39:32.851 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.851 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a738c9a0:::benchmark_data_smithi018_166993_object82629:head# 2024-02-10T08:39:32.851 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.851 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a738d17d:::benchmark_data_smithi018_166993_object29864:head# 2024-02-10T08:39:32.851 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.852 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a739b822:::benchmark_data_smithi018_166993_object60958:head# 2024-02-10T08:39:32.852 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.852 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a73a7ced:::benchmark_data_smithi018_166993_object52424:head# 2024-02-10T08:39:32.852 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.853 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a73b80bf:::benchmark_data_smithi018_166993_object18212:head# 2024-02-10T08:39:32.853 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.853 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a73bca1a:::benchmark_data_smithi018_166993_object22269:head# 2024-02-10T08:39:32.854 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.854 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a73c8743:::benchmark_data_smithi018_166993_object26332:head# 2024-02-10T08:39:32.854 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.854 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a73ca282:::benchmark_data_smithi018_166993_object38272:head# 2024-02-10T08:39:32.854 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.854 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a73cd696:::benchmark_data_smithi018_166993_object77050:head# 2024-02-10T08:39:32.854 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.854 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a73d4bdf:::benchmark_data_smithi018_166993_object31793:head# 2024-02-10T08:39:32.854 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.854 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a73d9085:::benchmark_data_smithi018_166993_object106990:head# 2024-02-10T08:39:32.854 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.854 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a73ddb37:::benchmark_data_smithi018_166993_object51205:head# 2024-02-10T08:39:32.854 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.856 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a73e7974:::benchmark_data_smithi018_166993_object83894:head# 2024-02-10T08:39:32.856 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.857 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a73fb02a:::benchmark_data_smithi018_166993_object94317:head# 2024-02-10T08:39:32.857 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.857 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a73fc943:::benchmark_data_smithi018_166993_object72003:head# 2024-02-10T08:39:32.857 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.857 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7404929:::benchmark_data_smithi018_166993_object55029:head# 2024-02-10T08:39:32.857 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.857 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7419c7b:::benchmark_data_smithi018_166993_object116609:head# 2024-02-10T08:39:32.857 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.857 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a741ac2d:::benchmark_data_smithi018_166993_object113607:head# 2024-02-10T08:39:32.857 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.857 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a741f0c9:::benchmark_data_smithi018_166993_object90933:head# 2024-02-10T08:39:32.857 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.857 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7425c62:::benchmark_data_smithi018_166993_object20201:head# 2024-02-10T08:39:32.857 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.857 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a742ea31:::benchmark_data_smithi018_166993_object19659:head# 2024-02-10T08:39:32.858 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.858 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a74302dd:::benchmark_data_smithi018_166993_object74965:head# 2024-02-10T08:39:32.858 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.858 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7442712:::benchmark_data_smithi018_166993_object96770:head# 2024-02-10T08:39:32.858 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.858 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a744cbf9:::benchmark_data_smithi018_166993_object59297:head# 2024-02-10T08:39:32.858 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.858 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7457d1e:::benchmark_data_smithi018_166993_object41955:head# 2024-02-10T08:39:32.858 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.859 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7467ce9:::benchmark_data_smithi018_166993_object71485:head# 2024-02-10T08:39:32.859 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.859 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a748b511:::benchmark_data_smithi018_166993_object41700:head# 2024-02-10T08:39:32.859 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.859 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a749dc08:::benchmark_data_smithi018_166993_object76773:head# 2024-02-10T08:39:32.859 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.859 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a74bf92d:::benchmark_data_smithi018_166993_object117331:head# 2024-02-10T08:39:32.859 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.863 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a74c3a1d:::benchmark_data_smithi018_166993_object50152:head# 2024-02-10T08:39:32.863 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.863 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a74c6553:::benchmark_data_smithi018_166993_object34761:head# 2024-02-10T08:39:32.863 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.863 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a74c6bdd:::benchmark_data_smithi018_166993_object42706:head# 2024-02-10T08:39:32.863 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.863 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a74d4191:::benchmark_data_smithi018_166993_object73949:head# 2024-02-10T08:39:32.863 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.864 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a74d5700:::benchmark_data_smithi018_166993_object20059:head# 2024-02-10T08:39:32.864 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.865 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a74e4408:::benchmark_data_smithi018_166993_object30485:head# 2024-02-10T08:39:32.865 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.865 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a74f2223:::benchmark_data_smithi018_166993_object82312:head# 2024-02-10T08:39:32.865 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.865 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a74f84d2:::benchmark_data_smithi018_166993_object54507:head# 2024-02-10T08:39:32.865 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.865 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a74fda71:::benchmark_data_smithi018_166993_object74508:head# 2024-02-10T08:39:32.865 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.865 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7502c23:::benchmark_data_smithi018_166993_object17704:head# 2024-02-10T08:39:32.865 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.866 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a750bbe9:::benchmark_data_smithi018_166993_object62662:head# 2024-02-10T08:39:32.866 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.866 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a752229e:::benchmark_data_smithi018_166993_object71099:head# 2024-02-10T08:39:32.866 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.866 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a75585be:::benchmark_data_smithi018_166993_object51562:head# 2024-02-10T08:39:32.866 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.866 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a755f5a0:::benchmark_data_smithi018_166993_object108272:head# 2024-02-10T08:39:32.866 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.866 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a756a2ba:::benchmark_data_smithi018_166993_object110608:head# 2024-02-10T08:39:32.866 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.867 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a756d3f0:::benchmark_data_smithi018_166993_object30075:head# 2024-02-10T08:39:32.867 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.869 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7583361:::benchmark_data_smithi018_166993_object58784:head# 2024-02-10T08:39:32.869 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.869 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a75a5168:::benchmark_data_smithi018_166993_object27282:head# 2024-02-10T08:39:32.869 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.869 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a75c3bd9:::benchmark_data_smithi018_166993_object54238:head# 2024-02-10T08:39:32.869 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.869 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a75de924:::benchmark_data_smithi018_166993_object73841:head# 2024-02-10T08:39:32.869 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.869 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a75e10be:::benchmark_data_smithi018_166993_object56975:head# 2024-02-10T08:39:32.870 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.870 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a75e749e:::benchmark_data_smithi018_166993_object103862:head# 2024-02-10T08:39:32.870 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.870 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a75f37d5:::benchmark_data_smithi018_166993_object99704:head# 2024-02-10T08:39:32.870 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.870 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a76048ae:::benchmark_data_smithi018_166993_object18260:head# 2024-02-10T08:39:32.870 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.870 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7616037:::benchmark_data_smithi018_166993_object48460:head# 2024-02-10T08:39:32.870 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.870 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a761bb81:::benchmark_data_smithi018_166993_object118945:head# 2024-02-10T08:39:32.870 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.870 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a76678ec:::benchmark_data_smithi018_166993_object110320:head# 2024-02-10T08:39:32.870 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.871 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7667c7b:::benchmark_data_smithi018_166993_object52391:head# 2024-02-10T08:39:32.871 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.871 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a766a95a:::benchmark_data_smithi018_166993_object78827:head# 2024-02-10T08:39:32.871 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.871 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a76768cd:::benchmark_data_smithi018_166993_object45229:head# 2024-02-10T08:39:32.871 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.872 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a767a66a:::benchmark_data_smithi018_166993_object28854:head# 2024-02-10T08:39:32.872 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.872 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a768ebb5:::benchmark_data_smithi018_166993_object106222:head# 2024-02-10T08:39:32.872 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.872 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a768fa70:::benchmark_data_smithi018_166993_object89469:head# 2024-02-10T08:39:32.872 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.872 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7692e29:::benchmark_data_smithi018_166993_object48340:head# 2024-02-10T08:39:32.872 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.875 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7693893:::benchmark_data_smithi018_166993_object88312:head# 2024-02-10T08:39:32.875 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.875 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7697170:::benchmark_data_smithi018_166993_object55166:head# 2024-02-10T08:39:32.876 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.876 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a76a15ad:::benchmark_data_smithi018_166993_object79345:head# 2024-02-10T08:39:32.876 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.876 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a76c35a7:::benchmark_data_smithi018_166993_object28256:head# 2024-02-10T08:39:32.876 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.877 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a76e4890:::benchmark_data_smithi018_166993_object104846:head# 2024-02-10T08:39:32.877 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.877 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a76ea2b1:::benchmark_data_smithi018_166993_object21114:head# 2024-02-10T08:39:32.877 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.877 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a76f0095:::benchmark_data_smithi018_166993_object28743:head# 2024-02-10T08:39:32.877 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.877 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7706cab:::benchmark_data_smithi018_166993_object73992:head# 2024-02-10T08:39:32.877 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.878 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a771a9cc:::benchmark_data_smithi018_166993_object77181:head# 2024-02-10T08:39:32.878 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.878 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a771de52:::benchmark_data_smithi018_166993_object116489:head# 2024-02-10T08:39:32.878 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.878 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7732f1f:::benchmark_data_smithi018_166993_object39805:head# 2024-02-10T08:39:32.878 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.879 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7735cc8:::benchmark_data_smithi018_166993_object109102:head# 2024-02-10T08:39:32.879 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.879 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a77503b8:::benchmark_data_smithi018_166993_object99018:head# 2024-02-10T08:39:32.879 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.879 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7752626:::benchmark_data_smithi018_166993_object114463:head# 2024-02-10T08:39:32.879 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.881 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7758593:::benchmark_data_smithi018_166993_object52971:head# 2024-02-10T08:39:32.881 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.881 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a775f07f:::benchmark_data_smithi018_166993_object82687:head# 2024-02-10T08:39:32.881 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.881 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a775f976:::benchmark_data_smithi018_166993_object35133:head# 2024-02-10T08:39:32.881 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.881 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7764f61:::benchmark_data_smithi018_166993_object103662:head# 2024-02-10T08:39:32.882 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.882 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a776646d:::benchmark_data_smithi018_166993_object34283:head# 2024-02-10T08:39:32.882 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.882 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7774e77:::benchmark_data_smithi018_166993_object59246:head# 2024-02-10T08:39:32.882 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.882 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a778a290:::benchmark_data_smithi018_166993_object42112:head# 2024-02-10T08:39:32.882 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.883 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a77bc590:::benchmark_data_smithi018_166993_object104499:head# 2024-02-10T08:39:32.883 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.883 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a77d3b53:::benchmark_data_smithi018_166993_object96872:head# 2024-02-10T08:39:32.883 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.883 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a77f0e28:::benchmark_data_smithi018_166993_object58171:head# 2024-02-10T08:39:32.883 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.883 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a77f6c1b:::benchmark_data_smithi018_166993_object32664:head# 2024-02-10T08:39:32.883 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.883 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a780d68d:::benchmark_data_smithi018_166993_object35761:head# 2024-02-10T08:39:32.883 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.884 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a781a49b:::benchmark_data_smithi018_166993_object109912:head# 2024-02-10T08:39:32.884 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.884 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a781fcea:::benchmark_data_smithi018_166993_object81707:head# 2024-02-10T08:39:32.884 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.884 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7821e75:::benchmark_data_smithi018_166993_object75601:head# 2024-02-10T08:39:32.884 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.887 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7823d82:::benchmark_data_smithi018_166993_object98131:head# 2024-02-10T08:39:32.887 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.887 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a783f3a2:::benchmark_data_smithi018_166993_object22404:head# 2024-02-10T08:39:32.888 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.888 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a785e268:::benchmark_data_smithi018_166993_object103987:head# 2024-02-10T08:39:32.888 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.888 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a787082c:::benchmark_data_smithi018_166993_object88819:head# 2024-02-10T08:39:32.888 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.888 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a787844f:::benchmark_data_smithi018_166993_object24287:head# 2024-02-10T08:39:32.888 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.889 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a787b1ea:::benchmark_data_smithi018_166993_object49041:head# 2024-02-10T08:39:32.889 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.889 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a787c979:::benchmark_data_smithi018_166993_object74308:head# 2024-02-10T08:39:32.889 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.889 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a787e191:::benchmark_data_smithi018_166993_object84471:head# 2024-02-10T08:39:32.889 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.890 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7886831:::benchmark_data_smithi018_166993_object43630:head# 2024-02-10T08:39:32.890 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.890 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7891e9f:::benchmark_data_smithi018_166993_object57529:head# 2024-02-10T08:39:32.890 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.890 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a78920fc:::benchmark_data_smithi018_166993_object95251:head# 2024-02-10T08:39:32.890 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.892 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7898c9e:::benchmark_data_smithi018_166993_object68593:head# 2024-02-10T08:39:32.892 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.892 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a78996d7:::benchmark_data_smithi018_166993_object82137:head# 2024-02-10T08:39:32.892 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.892 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a78aa0a9:::benchmark_data_smithi018_166993_object118666:head# 2024-02-10T08:39:32.893 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.893 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a78ac120:::benchmark_data_smithi018_166993_object57363:head# 2024-02-10T08:39:32.893 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.899 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a78bc7ea:::benchmark_data_smithi018_166993_object88872:head# 2024-02-10T08:39:32.900 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.900 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a78cabcb:::benchmark_data_smithi018_166993_object75363:head# 2024-02-10T08:39:32.900 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.900 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a78d0c3b:::benchmark_data_smithi018_166993_object91567:head# 2024-02-10T08:39:32.900 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.901 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a78d36a4:::benchmark_data_smithi018_166993_object118973:head# 2024-02-10T08:39:32.902 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.902 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a78e19d6:::benchmark_data_smithi018_166993_object112156:head# 2024-02-10T08:39:32.902 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.902 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a78e669f:::benchmark_data_smithi018_166993_object45617:head# 2024-02-10T08:39:32.902 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.902 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a78f143f:::benchmark_data_smithi018_166993_object116932:head# 2024-02-10T08:39:32.902 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.902 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a78f6e1e:::benchmark_data_smithi018_166993_object85144:head# 2024-02-10T08:39:32.902 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.904 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a78fd631:::benchmark_data_smithi018_166993_object28732:head# 2024-02-10T08:39:32.904 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.905 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7922fe9:::benchmark_data_smithi018_166993_object56504:head# 2024-02-10T08:39:32.905 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.905 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a79333bb:::benchmark_data_smithi018_166993_object68557:head# 2024-02-10T08:39:32.905 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.905 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a794be2a:::benchmark_data_smithi018_166993_object81668:head# 2024-02-10T08:39:32.905 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.905 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a794dad2:::benchmark_data_smithi018_166993_object29704:head# 2024-02-10T08:39:32.905 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.905 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a79598b4:::benchmark_data_smithi018_166993_object108405:head# 2024-02-10T08:39:32.905 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.905 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7967432:::benchmark_data_smithi018_166993_object28580:head# 2024-02-10T08:39:32.905 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.905 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7973b2b:::benchmark_data_smithi018_166993_object81712:head# 2024-02-10T08:39:32.905 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.905 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7975629:::benchmark_data_smithi018_166993_object36049:head# 2024-02-10T08:39:32.906 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.906 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a797ec71:::benchmark_data_smithi018_166993_object88671:head# 2024-02-10T08:39:32.906 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.909 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a798681b:::benchmark_data_smithi018_166993_object25404:head# 2024-02-10T08:39:32.909 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.909 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7986946:::benchmark_data_smithi018_166993_object99971:head# 2024-02-10T08:39:32.909 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.909 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7992d48:::benchmark_data_smithi018_166993_object107478:head# 2024-02-10T08:39:32.909 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.910 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a79930e3:::benchmark_data_smithi018_166993_object70226:head# 2024-02-10T08:39:32.910 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.911 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a799c32a:::benchmark_data_smithi018_166993_object35799:head# 2024-02-10T08:39:32.911 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.911 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a79a87e5:::benchmark_data_smithi018_166993_object21864:head# 2024-02-10T08:39:32.911 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.911 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a79b3601:::benchmark_data_smithi018_166993_object21622:head# 2024-02-10T08:39:32.911 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.911 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a79bc1a4:::benchmark_data_smithi018_166993_object104849:head# 2024-02-10T08:39:32.911 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.911 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a79c9b41:::benchmark_data_smithi018_166993_object71131:head# 2024-02-10T08:39:32.911 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.913 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a79d0db1:::benchmark_data_smithi018_166993_object71690:head# 2024-02-10T08:39:32.913 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.914 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7a07411:::benchmark_data_smithi018_166993_object32773:head# 2024-02-10T08:39:32.914 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.915 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7a0e9ae:::benchmark_data_smithi018_166993_object51906:head# 2024-02-10T08:39:32.915 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.915 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7a0fbb4:::benchmark_data_smithi018_166993_object97133:head# 2024-02-10T08:39:32.915 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.917 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7a1c810:::benchmark_data_smithi018_166993_object72119:head# 2024-02-10T08:39:32.917 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.917 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7a1ddda:::benchmark_data_smithi018_166993_object39017:head# 2024-02-10T08:39:32.917 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.917 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7a32a6c:::benchmark_data_smithi018_166993_object31109:head# 2024-02-10T08:39:32.917 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.917 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7a33c1d:::benchmark_data_smithi018_166993_object66793:head# 2024-02-10T08:39:32.917 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.917 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7a349c6:::benchmark_data_smithi018_166993_object57122:head# 2024-02-10T08:39:32.918 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.918 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7a38ca1:::benchmark_data_smithi018_166993_object24482:head# 2024-02-10T08:39:32.918 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.918 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7a3e346:::benchmark_data_smithi018_166993_object106943:head# 2024-02-10T08:39:32.918 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.918 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7a41a0a:::benchmark_data_smithi018_166993_object114130:head# 2024-02-10T08:39:32.918 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.919 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7a597a7:::benchmark_data_smithi018_166993_object76371:head# 2024-02-10T08:39:32.919 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.919 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7a59a55:::benchmark_data_smithi018_166993_object28066:head# 2024-02-10T08:39:32.919 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.919 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7a5e1ee:::benchmark_data_smithi018_166993_object92982:head# 2024-02-10T08:39:32.919 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.919 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7a64d6c:::benchmark_data_smithi018_166993_object40214:head# 2024-02-10T08:39:32.919 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.919 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7a81b3f:::benchmark_data_smithi018_166993_object72819:head# 2024-02-10T08:39:32.920 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.920 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7a84613:::benchmark_data_smithi018_166993_object50525:head# 2024-02-10T08:39:32.920 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.920 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7a8ba4e:::benchmark_data_smithi018_166993_object77389:head# 2024-02-10T08:39:32.920 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.921 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7a8e886:::benchmark_data_smithi018_166993_object65611:head# 2024-02-10T08:39:32.921 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.921 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7a96b3a:::benchmark_data_smithi018_166993_object69840:head# 2024-02-10T08:39:32.921 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.921 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7aa67d6:::benchmark_data_smithi018_166993_object61122:head# 2024-02-10T08:39:32.921 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.921 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7ab2fec:::benchmark_data_smithi018_166993_object107974:head# 2024-02-10T08:39:32.921 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.921 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7abfcaa:::benchmark_data_smithi018_166993_object18652:head# 2024-02-10T08:39:32.921 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.921 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7ac82d4:::benchmark_data_smithi018_166993_object60643:head# 2024-02-10T08:39:32.921 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.922 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7ad546c:::benchmark_data_smithi018_166993_object19802:head# 2024-02-10T08:39:32.922 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.922 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7ada7e0:::benchmark_data_smithi018_166993_object37367:head# 2024-02-10T08:39:32.922 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.922 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7ae73fe:::benchmark_data_smithi018_166993_object91357:head# 2024-02-10T08:39:32.922 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.923 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7ae7a2e:::benchmark_data_smithi018_166993_object97131:head# 2024-02-10T08:39:32.923 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.923 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7b0167c:::benchmark_data_smithi018_166993_object32841:head# 2024-02-10T08:39:32.924 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.924 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7b032d0:::benchmark_data_smithi018_166993_object95420:head# 2024-02-10T08:39:32.924 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.924 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7b06fe0:::benchmark_data_smithi018_166993_object108011:head# 2024-02-10T08:39:32.924 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.924 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7b09b9a:::benchmark_data_smithi018_166993_object34197:head# 2024-02-10T08:39:32.924 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.929 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7b12f4a:::benchmark_data_smithi018_166993_object112829:head# 2024-02-10T08:39:32.930 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.930 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7b1f8b9:::benchmark_data_smithi018_166993_object93648:head# 2024-02-10T08:39:32.930 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.930 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7b27987:::benchmark_data_smithi018_166993_object111244:head# 2024-02-10T08:39:32.930 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.933 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7b2b901:::benchmark_data_smithi018_166993_object94488:head# 2024-02-10T08:39:32.933 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.934 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7b2c143:::benchmark_data_smithi018_166993_object97484:head# 2024-02-10T08:39:32.934 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.934 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7b33bd5:::benchmark_data_smithi018_166993_object106086:head# 2024-02-10T08:39:32.934 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.934 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7b5f2b8:::benchmark_data_smithi018_166993_object88445:head# 2024-02-10T08:39:32.934 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.934 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7b5f2bb:::benchmark_data_smithi018_166993_object21240:head# 2024-02-10T08:39:32.934 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.937 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7b5f523:::benchmark_data_smithi018_166993_object29122:head# 2024-02-10T08:39:32.938 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.938 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7b6ee66:::benchmark_data_smithi018_166993_object24981:head# 2024-02-10T08:39:32.938 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.938 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7b72e92:::benchmark_data_smithi018_166993_object91563:head# 2024-02-10T08:39:32.938 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.938 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7b74c4c:::benchmark_data_smithi018_166993_object42992:head# 2024-02-10T08:39:32.938 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.938 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7b7eeae:::benchmark_data_smithi018_166993_object79886:head# 2024-02-10T08:39:32.938 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.938 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7b8adc1:::benchmark_data_smithi018_166993_object58992:head# 2024-02-10T08:39:32.938 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.938 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7ba00a0:::benchmark_data_smithi018_166993_object114947:head# 2024-02-10T08:39:32.938 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.939 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7bb2ba3:::benchmark_data_smithi018_166993_object57057:head# 2024-02-10T08:39:32.939 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.939 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7bb704e:::benchmark_data_smithi018_166993_object64800:head# 2024-02-10T08:39:32.939 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.939 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7bc7195:::benchmark_data_smithi018_166993_object102236:head# 2024-02-10T08:39:32.939 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.939 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7bcb2bd:::benchmark_data_smithi018_166993_object68935:head# 2024-02-10T08:39:32.939 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.939 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7bd6e3f:::benchmark_data_smithi018_166993_object111627:head# 2024-02-10T08:39:32.939 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.939 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7be2612:::benchmark_data_smithi018_166993_object40607:head# 2024-02-10T08:39:32.939 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.939 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7beb62f:::benchmark_data_smithi018_166993_object91496:head# 2024-02-10T08:39:32.939 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.940 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7bf7291:::benchmark_data_smithi018_166993_object48915:head# 2024-02-10T08:39:32.940 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.941 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7c17583:::benchmark_data_smithi018_166993_object48676:head# 2024-02-10T08:39:32.941 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.941 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7c20f43:::benchmark_data_smithi018_166993_object43005:head# 2024-02-10T08:39:32.941 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.941 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7c35668:::benchmark_data_smithi018_166993_object70767:head# 2024-02-10T08:39:32.941 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.941 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7c3f89b:::benchmark_data_smithi018_166993_object23518:head# 2024-02-10T08:39:32.941 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.941 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7c50e54:::benchmark_data_smithi018_166993_object81561:head# 2024-02-10T08:39:32.942 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.942 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7c54fa5:::benchmark_data_smithi018_166993_object95656:head# 2024-02-10T08:39:32.942 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.943 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7c5722a:::benchmark_data_smithi018_166993_object51164:head# 2024-02-10T08:39:32.943 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.943 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7c5ca04:::benchmark_data_smithi018_166993_object95111:head# 2024-02-10T08:39:32.943 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.947 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7c672c9:::benchmark_data_smithi018_166993_object82154:head# 2024-02-10T08:39:32.947 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.947 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7c6743f:::benchmark_data_smithi018_166993_object73894:head# 2024-02-10T08:39:32.948 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.948 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7c88598:::benchmark_data_smithi018_166993_object118949:head# 2024-02-10T08:39:32.948 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.948 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7c973d8:::benchmark_data_smithi018_166993_object64386:head# 2024-02-10T08:39:32.948 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.948 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7ca4f0a:::benchmark_data_smithi018_166993_object81272:head# 2024-02-10T08:39:32.948 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.948 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7ca78d1:::benchmark_data_smithi018_166993_object18561:head# 2024-02-10T08:39:32.948 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.948 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7ca90fa:::benchmark_data_smithi018_166993_object76779:head# 2024-02-10T08:39:32.948 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.948 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7cab0e1:::benchmark_data_smithi018_166993_object32923:head# 2024-02-10T08:39:32.948 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.949 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7cacb1d:::benchmark_data_smithi018_166993_object60045:head# 2024-02-10T08:39:32.949 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.949 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7cb6908:::benchmark_data_smithi018_166993_object47204:head# 2024-02-10T08:39:32.949 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.949 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7cb9fdb:::benchmark_data_smithi018_166993_object69474:head# 2024-02-10T08:39:32.949 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.950 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7cbfd5e:::benchmark_data_smithi018_166993_object27653:head# 2024-02-10T08:39:32.950 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.950 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7cc8707:::benchmark_data_smithi018_166993_object38895:head# 2024-02-10T08:39:32.950 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.950 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7cdb83d:::benchmark_data_smithi018_166993_object56356:head# 2024-02-10T08:39:32.950 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.950 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7ce0770:::benchmark_data_smithi018_166993_object107432:head# 2024-02-10T08:39:32.950 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.950 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7ce2b00:::benchmark_data_smithi018_166993_object32469:head# 2024-02-10T08:39:32.950 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.951 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7ce891c:::benchmark_data_smithi018_166993_object43062:head# 2024-02-10T08:39:32.951 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.951 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7cf22eb:::benchmark_data_smithi018_166993_object57825:head# 2024-02-10T08:39:32.951 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.952 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7d143c5:::benchmark_data_smithi018_166993_object114081:head# 2024-02-10T08:39:32.952 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.952 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7d34ac9:::benchmark_data_smithi018_166993_object64996:head# 2024-02-10T08:39:32.952 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.952 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7d3510c:::benchmark_data_smithi018_166993_object49157:head# 2024-02-10T08:39:32.953 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.953 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7d3b479:::benchmark_data_smithi018_166993_object68815:head# 2024-02-10T08:39:32.953 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.953 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7d3f08f:::benchmark_data_smithi018_166993_object57398:head# 2024-02-10T08:39:32.954 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.954 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7d4520e:::benchmark_data_smithi018_166993_object27085:head# 2024-02-10T08:39:32.954 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.956 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7d4a296:::benchmark_data_smithi018_166993_object43842:head# 2024-02-10T08:39:32.956 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.956 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7d50829:::benchmark_data_smithi018_166993_object53962:head# 2024-02-10T08:39:32.956 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.956 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7d5a0ce:::benchmark_data_smithi018_166993_object61873:head# 2024-02-10T08:39:32.956 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.956 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7d60e22:::benchmark_data_smithi018_166993_object65412:head# 2024-02-10T08:39:32.956 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.956 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7d6792a:::benchmark_data_smithi018_166993_object19204:head# 2024-02-10T08:39:32.956 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.956 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7d833f5:::benchmark_data_smithi018_166993_object107991:head# 2024-02-10T08:39:32.957 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.957 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7da9a87:::benchmark_data_smithi018_166993_object106181:head# 2024-02-10T08:39:32.957 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.957 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7dad118:::benchmark_data_smithi018_166993_object103438:head# 2024-02-10T08:39:32.957 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.957 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7dbb40c:::benchmark_data_smithi018_166993_object59717:head# 2024-02-10T08:39:32.957 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.958 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7dc5f38:::benchmark_data_smithi018_166993_object90503:head# 2024-02-10T08:39:32.959 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.959 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7dd553c:::benchmark_data_smithi018_166993_object95081:head# 2024-02-10T08:39:32.959 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.959 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7dd5ec2:::benchmark_data_smithi018_166993_object55756:head# 2024-02-10T08:39:32.959 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.959 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7dd9456:::benchmark_data_smithi018_166993_object63315:head# 2024-02-10T08:39:32.959 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.959 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7de0a41:::benchmark_data_smithi018_166993_object48061:head# 2024-02-10T08:39:32.959 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.959 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7de81c7:::benchmark_data_smithi018_166993_object85466:head# 2024-02-10T08:39:32.959 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.959 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7e113c5:::benchmark_data_smithi018_166993_object100934:head# 2024-02-10T08:39:32.959 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.959 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7e15a2f:::benchmark_data_smithi018_166993_object107265:head# 2024-02-10T08:39:32.960 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.960 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7e1fee2:::benchmark_data_smithi018_166993_object112457:head# 2024-02-10T08:39:32.960 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.960 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7e2f820:::benchmark_data_smithi018_166993_object107502:head# 2024-02-10T08:39:32.960 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.961 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7e357b6:::benchmark_data_smithi018_166993_object48833:head# 2024-02-10T08:39:32.961 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.961 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7e426ce:::benchmark_data_smithi018_166993_object77801:head# 2024-02-10T08:39:32.961 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.961 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7e5ce2b:::benchmark_data_smithi018_166993_object79982:head# 2024-02-10T08:39:32.961 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.961 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7e6c219:::benchmark_data_smithi018_166993_object70461:head# 2024-02-10T08:39:32.961 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.961 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7e6e513:::benchmark_data_smithi018_166993_object100200:head# 2024-02-10T08:39:32.961 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.962 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7e74e7d:::benchmark_data_smithi018_166993_object83680:head# 2024-02-10T08:39:32.962 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.962 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7e78b1d:::benchmark_data_smithi018_166993_object26696:head# 2024-02-10T08:39:32.962 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.964 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7e9351e:::benchmark_data_smithi018_166993_object102484:head# 2024-02-10T08:39:32.965 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.968 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7eab61c:::benchmark_data_smithi018_166993_object90828:head# 2024-02-10T08:39:32.968 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.968 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7eaf861:::benchmark_data_smithi018_166993_object34465:head# 2024-02-10T08:39:32.968 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.969 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7eb39fb:::benchmark_data_smithi018_166993_object26468:head# 2024-02-10T08:39:32.969 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.969 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7eca0d4:::benchmark_data_smithi018_166993_object99692:head# 2024-02-10T08:39:32.969 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.972 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7edbc6a:::benchmark_data_smithi018_166993_object30414:head# 2024-02-10T08:39:32.972 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.974 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7edeb93:::benchmark_data_smithi018_166993_object89115:head# 2024-02-10T08:39:32.974 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.975 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7ee5280:::benchmark_data_smithi018_166993_object93635:head# 2024-02-10T08:39:32.975 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.976 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7ee6dfa:::benchmark_data_smithi018_166993_object71860:head# 2024-02-10T08:39:32.976 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.976 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7efc1a8:::benchmark_data_smithi018_166993_object69364:head# 2024-02-10T08:39:32.976 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.976 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7f0ab95:::benchmark_data_smithi018_166993_object67397:head# 2024-02-10T08:39:32.976 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.976 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7f192cf:::benchmark_data_smithi018_166993_object49562:head# 2024-02-10T08:39:32.977 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.978 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7f20b3a:::benchmark_data_smithi018_166993_object90388:head# 2024-02-10T08:39:32.979 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.979 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7f24348:::benchmark_data_smithi018_166993_object66372:head# 2024-02-10T08:39:32.979 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.979 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7f4ccb8:::benchmark_data_smithi018_166993_object69852:head# 2024-02-10T08:39:32.979 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.979 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7f54d24:::benchmark_data_smithi018_166993_object108163:head# 2024-02-10T08:39:32.979 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.980 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7f5a60c:::benchmark_data_smithi018_166993_object110384:head# 2024-02-10T08:39:32.980 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.980 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7f5fd28:::benchmark_data_smithi018_166993_object110858:head# 2024-02-10T08:39:32.980 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.980 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7f800cc:::benchmark_data_smithi018_166993_object57404:head# 2024-02-10T08:39:32.980 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.981 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7f84429:::benchmark_data_smithi018_166993_object28272:head# 2024-02-10T08:39:32.981 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.981 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7f84aad:::benchmark_data_smithi018_166993_object48828:head# 2024-02-10T08:39:32.981 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.981 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7faf047:::benchmark_data_smithi018_166993_object68166:head# 2024-02-10T08:39:32.981 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.982 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7fbd9a3:::benchmark_data_smithi018_166993_object69547:head# 2024-02-10T08:39:32.982 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.982 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7fd6df2:::benchmark_data_smithi018_166993_object40874:head# 2024-02-10T08:39:32.982 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.984 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7fdd42c:::benchmark_data_smithi018_166993_object68619:head# 2024-02-10T08:39:32.984 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.985 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7fde1de:::benchmark_data_smithi018_166993_object27898:head# 2024-02-10T08:39:32.985 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.985 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7fe75e8:::benchmark_data_smithi018_166993_object54531:head# 2024-02-10T08:39:32.985 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.985 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7febbc7:::benchmark_data_smithi018_166993_object75286:head# 2024-02-10T08:39:32.986 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.986 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7ff57a5:::benchmark_data_smithi018_166993_object100645:head# 2024-02-10T08:39:32.986 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.986 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a7ffaade:::benchmark_data_smithi018_166993_object51602:head# 2024-02-10T08:39:32.986 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.987 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a800e8bb:::benchmark_data_smithi018_166993_object116596:head# 2024-02-10T08:39:32.987 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.988 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a801b814:::benchmark_data_smithi018_166993_object59541:head# 2024-02-10T08:39:32.988 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.988 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a801fdec:::benchmark_data_smithi018_166993_object108509:head# 2024-02-10T08:39:32.988 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.988 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8029f52:::benchmark_data_smithi018_166993_object67937:head# 2024-02-10T08:39:32.988 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.989 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a802ad5a:::benchmark_data_smithi018_166993_object94013:head# 2024-02-10T08:39:32.990 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.990 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a802e4c4:::benchmark_data_smithi018_166993_object81384:head# 2024-02-10T08:39:32.990 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.990 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8032fe5:::benchmark_data_smithi018_166993_object26074:head# 2024-02-10T08:39:32.990 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.990 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8067897:::benchmark_data_smithi018_166993_object59700:head# 2024-02-10T08:39:32.990 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.990 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8074f52:::benchmark_data_smithi018_166993_object96783:head# 2024-02-10T08:39:32.990 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.991 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a807d28e:::benchmark_data_smithi018_166993_object50939:head# 2024-02-10T08:39:32.991 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.991 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a807d505:::benchmark_data_smithi018_166993_object115866:head# 2024-02-10T08:39:32.991 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.992 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8089070:::benchmark_data_smithi018_166993_object115488:head# 2024-02-10T08:39:32.992 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.992 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a80901cf:::benchmark_data_smithi018_166993_object91605:head# 2024-02-10T08:39:32.992 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.992 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8092507:::benchmark_data_smithi018_166993_object83815:head# 2024-02-10T08:39:32.992 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.992 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a80a2fe5:::benchmark_data_smithi018_166993_object27936:head# 2024-02-10T08:39:32.993 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.993 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a80ab5f6:::benchmark_data_smithi018_166993_object101644:head# 2024-02-10T08:39:32.993 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.994 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a80b559e:::benchmark_data_smithi018_166993_object52419:head# 2024-02-10T08:39:32.994 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.994 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a80cd007:::benchmark_data_smithi018_166993_object107473:head# 2024-02-10T08:39:32.994 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.994 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a80d51e4:::benchmark_data_smithi018_166993_object93241:head# 2024-02-10T08:39:32.994 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.994 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a80d5c68:::benchmark_data_smithi018_166993_object25283:head# 2024-02-10T08:39:32.994 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.995 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a80d63d6:::benchmark_data_smithi018_166993_object81177:head# 2024-02-10T08:39:32.995 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.995 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a80d6c3c:::benchmark_data_smithi018_166993_object80764:head# 2024-02-10T08:39:32.995 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.995 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a80dd735:::benchmark_data_smithi018_166993_object79660:head# 2024-02-10T08:39:32.995 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.995 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a80ddd68:::benchmark_data_smithi018_166993_object26469:head# 2024-02-10T08:39:32.996 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.996 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a80fa857:::benchmark_data_smithi018_166993_object93723:head# 2024-02-10T08:39:32.996 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.996 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a80fddfe:::benchmark_data_smithi018_166993_object85239:head# 2024-02-10T08:39:32.996 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.996 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a810b894:::benchmark_data_smithi018_166993_object44905:head# 2024-02-10T08:39:32.996 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.996 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8114a93:::benchmark_data_smithi018_166993_object47056:head# 2024-02-10T08:39:32.997 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.997 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8115b3d:::benchmark_data_smithi018_166993_object109460:head# 2024-02-10T08:39:32.997 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.997 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a812bf9a:::benchmark_data_smithi018_166993_object75946:head# 2024-02-10T08:39:32.997 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.998 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8144c89:::benchmark_data_smithi018_166993_object94246:head# 2024-02-10T08:39:32.998 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.998 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a814a1da:::benchmark_data_smithi018_166993_object113501:head# 2024-02-10T08:39:32.998 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.998 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8150562:::benchmark_data_smithi018_166993_object91127:head# 2024-02-10T08:39:32.998 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.998 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a81529f4:::benchmark_data_smithi018_166993_object46634:head# 2024-02-10T08:39:32.998 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.999 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a816ef49:::benchmark_data_smithi018_166993_object89309:head# 2024-02-10T08:39:32.999 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:32.999 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a817fff2:::benchmark_data_smithi018_166993_object97503:head# 2024-02-10T08:39:32.999 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.001 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a818af68:::benchmark_data_smithi018_166993_object36017:head# 2024-02-10T08:39:33.001 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.001 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a818b43a:::benchmark_data_smithi018_166993_object19481:head# 2024-02-10T08:39:33.001 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.001 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a81b393b:::benchmark_data_smithi018_166993_object82707:head# 2024-02-10T08:39:33.001 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.002 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a81b60fd:::benchmark_data_smithi018_166993_object24393:head# 2024-02-10T08:39:33.002 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.002 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a81bc2e4:::benchmark_data_smithi018_166993_object64919:head# 2024-02-10T08:39:33.002 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.003 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a81d87dd:::benchmark_data_smithi018_166993_object99879:head# 2024-02-10T08:39:33.003 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.003 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a81f2289:::benchmark_data_smithi018_166993_object60615:head# 2024-02-10T08:39:33.003 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.003 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a81f3de8:::benchmark_data_smithi018_166993_object112310:head# 2024-02-10T08:39:33.003 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.003 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8203c81:::benchmark_data_smithi018_166993_object33238:head# 2024-02-10T08:39:33.003 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.003 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8208e46:::benchmark_data_smithi018_166993_object101083:head# 2024-02-10T08:39:33.003 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.005 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a82130e7:::benchmark_data_smithi018_166993_object109466:head# 2024-02-10T08:39:33.005 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.005 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a821869d:::benchmark_data_smithi018_166993_object18784:head# 2024-02-10T08:39:33.005 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.005 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a82219f1:::benchmark_data_smithi018_166993_object79007:head# 2024-02-10T08:39:33.005 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.006 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a822875c:::benchmark_data_smithi018_166993_object53547:head# 2024-02-10T08:39:33.006 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.006 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a822ad80:::benchmark_data_smithi018_166993_object72449:head# 2024-02-10T08:39:33.007 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.007 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a823cf7a:::benchmark_data_smithi018_166993_object35606:head# 2024-02-10T08:39:33.007 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.007 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8243a0d:::benchmark_data_smithi018_166993_object38327:head# 2024-02-10T08:39:33.007 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.007 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a824643d:::benchmark_data_smithi018_166993_object101465:head# 2024-02-10T08:39:33.007 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.009 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a824f30c:::benchmark_data_smithi018_166993_object109866:head# 2024-02-10T08:39:33.009 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.010 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8253699:::benchmark_data_smithi018_166993_object75050:head# 2024-02-10T08:39:33.010 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.010 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a82667ae:::benchmark_data_smithi018_166993_object27387:head# 2024-02-10T08:39:33.010 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.010 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a826c6d2:::benchmark_data_smithi018_166993_object32552:head# 2024-02-10T08:39:33.010 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.011 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8275448:::benchmark_data_smithi018_166993_object67447:head# 2024-02-10T08:39:33.011 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.011 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a828d6fb:::benchmark_data_smithi018_166993_object54339:head# 2024-02-10T08:39:33.011 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.011 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a829f093:::benchmark_data_smithi018_166993_object37582:head# 2024-02-10T08:39:33.011 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.012 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a82abb37:::benchmark_data_smithi018_166993_object105373:head# 2024-02-10T08:39:33.012 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.012 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a82abf40:::benchmark_data_smithi018_166993_object40575:head# 2024-02-10T08:39:33.012 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.012 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a82b0a36:::benchmark_data_smithi018_166993_object36921:head# 2024-02-10T08:39:33.012 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.012 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a82b60e1:::benchmark_data_smithi018_166993_object24619:head# 2024-02-10T08:39:33.012 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.013 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a82b7074:::benchmark_data_smithi018_166993_object52064:head# 2024-02-10T08:39:33.013 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.013 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a82c7f5d:::benchmark_data_smithi018_166993_object37983:head# 2024-02-10T08:39:33.013 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.013 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a82c92ee:::benchmark_data_smithi018_166993_object86495:head# 2024-02-10T08:39:33.013 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.013 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a82da2be:::benchmark_data_smithi018_166993_object115507:head# 2024-02-10T08:39:33.014 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.014 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a82db040:::benchmark_data_smithi018_166993_object42803:head# 2024-02-10T08:39:33.014 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.014 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a82ec940:::benchmark_data_smithi018_166993_object97913:head# 2024-02-10T08:39:33.014 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.014 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a82f099c:::benchmark_data_smithi018_166993_object110318:head# 2024-02-10T08:39:33.014 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.016 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8302f48:::benchmark_data_smithi018_166993_object54134:head# 2024-02-10T08:39:33.016 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.017 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8305214:::benchmark_data_smithi018_166993_object35559:head# 2024-02-10T08:39:33.017 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.018 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a830df71:::benchmark_data_smithi018_166993_object41240:head# 2024-02-10T08:39:33.018 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.018 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a831e403:::benchmark_data_smithi018_166993_object109579:head# 2024-02-10T08:39:33.018 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.018 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8328082:::benchmark_data_smithi018_166993_object86193:head# 2024-02-10T08:39:33.018 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.019 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8329817:::benchmark_data_smithi018_166993_object59670:head# 2024-02-10T08:39:33.019 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.019 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a832ddec:::benchmark_data_smithi018_166993_object109509:head# 2024-02-10T08:39:33.019 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.019 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a834051b:::benchmark_data_smithi018_166993_object94374:head# 2024-02-10T08:39:33.019 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.021 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8351252:::benchmark_data_smithi018_166993_object42182:head# 2024-02-10T08:39:33.021 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.021 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a836130d:::benchmark_data_smithi018_166993_object88046:head# 2024-02-10T08:39:33.021 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.021 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8364ef4:::benchmark_data_smithi018_166993_object42898:head# 2024-02-10T08:39:33.021 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.023 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a836e807:::benchmark_data_smithi018_166993_object23035:head# 2024-02-10T08:39:33.023 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.023 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8370eb4:::benchmark_data_smithi018_166993_object114679:head# 2024-02-10T08:39:33.023 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.023 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8377d5c:::benchmark_data_smithi018_166993_object96725:head# 2024-02-10T08:39:33.023 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.023 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8378622:::benchmark_data_smithi018_166993_object54036:head# 2024-02-10T08:39:33.023 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.023 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a838762e:::benchmark_data_smithi018_166993_object92275:head# 2024-02-10T08:39:33.023 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.023 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a839e155:::benchmark_data_smithi018_166993_object71321:head# 2024-02-10T08:39:33.023 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.024 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a83a1091:::benchmark_data_smithi018_166993_object84123:head# 2024-02-10T08:39:33.024 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.024 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a83a18bd:::benchmark_data_smithi018_166993_object31613:head# 2024-02-10T08:39:33.024 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.025 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a83b2bdb:::benchmark_data_smithi018_166993_object17489:head# 2024-02-10T08:39:33.025 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.025 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a83b5ba4:::benchmark_data_smithi018_166993_object111601:head# 2024-02-10T08:39:33.025 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.027 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a83ba011:::benchmark_data_smithi018_166993_object98721:head# 2024-02-10T08:39:33.028 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.028 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a83ce062:::benchmark_data_smithi018_166993_object81301:head# 2024-02-10T08:39:33.028 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.028 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a83ddb13:::benchmark_data_smithi018_166993_object74270:head# 2024-02-10T08:39:33.028 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.031 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a83de751:::benchmark_data_smithi018_166993_object78115:head# 2024-02-10T08:39:33.031 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.031 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a83faa05:::benchmark_data_smithi018_166993_object113472:head# 2024-02-10T08:39:33.031 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.031 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8402475:::benchmark_data_smithi018_166993_object39386:head# 2024-02-10T08:39:33.031 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.031 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a840faa3:::benchmark_data_smithi018_166993_object57579:head# 2024-02-10T08:39:33.031 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.032 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a84122a4:::benchmark_data_smithi018_166993_object52145:head# 2024-02-10T08:39:33.032 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.037 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a841ed17:::benchmark_data_smithi018_166993_object88184:head# 2024-02-10T08:39:33.037 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.037 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a842931f:::benchmark_data_smithi018_166993_object53758:head# 2024-02-10T08:39:33.037 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.037 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a842afca:::benchmark_data_smithi018_166993_object82874:head# 2024-02-10T08:39:33.037 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.037 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a843117f:::benchmark_data_smithi018_166993_object105981:head# 2024-02-10T08:39:33.037 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.037 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8433656:::benchmark_data_smithi018_166993_object28203:head# 2024-02-10T08:39:33.037 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.037 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a843c717:::benchmark_data_smithi018_166993_object107054:head# 2024-02-10T08:39:33.037 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.038 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8440453:::benchmark_data_smithi018_166993_object117912:head# 2024-02-10T08:39:33.038 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.038 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8445a8b:::benchmark_data_smithi018_166993_object85596:head# 2024-02-10T08:39:33.038 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.038 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a844cada:::benchmark_data_smithi018_166993_object87562:head# 2024-02-10T08:39:33.038 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.038 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8450c07:::benchmark_data_smithi018_166993_object43435:head# 2024-02-10T08:39:33.038 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.038 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8460f75:::benchmark_data_smithi018_166993_object82124:head# 2024-02-10T08:39:33.038 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.038 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8470541:::benchmark_data_smithi018_166993_object85321:head# 2024-02-10T08:39:33.038 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.038 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a84819a9:::benchmark_data_smithi018_166993_object58053:head# 2024-02-10T08:39:33.038 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.038 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a849e455:::benchmark_data_smithi018_166993_object107370:head# 2024-02-10T08:39:33.038 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.039 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a84a03b0:::benchmark_data_smithi018_166993_object39681:head# 2024-02-10T08:39:33.039 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.039 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a84afb93:::benchmark_data_smithi018_166993_object98546:head# 2024-02-10T08:39:33.039 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.039 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a84b148a:::benchmark_data_smithi018_166993_object84484:head# 2024-02-10T08:39:33.039 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.039 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a84b44a7:::benchmark_data_smithi018_166993_object111164:head# 2024-02-10T08:39:33.039 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.039 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a84b574f:::benchmark_data_smithi018_166993_object32629:head# 2024-02-10T08:39:33.039 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.039 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a84b7160:::benchmark_data_smithi018_166993_object71420:head# 2024-02-10T08:39:33.039 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.040 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a84cfc75:::benchmark_data_smithi018_166993_object75675:head# 2024-02-10T08:39:33.041 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.041 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a84d2e29:::benchmark_data_smithi018_166993_object55871:head# 2024-02-10T08:39:33.041 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.041 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8507c51:::benchmark_data_smithi018_166993_object83255:head# 2024-02-10T08:39:33.041 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.041 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a850b7f2:::benchmark_data_smithi018_166993_object21531:head# 2024-02-10T08:39:33.041 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.041 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a850bf99:::benchmark_data_smithi018_166993_object76585:head# 2024-02-10T08:39:33.041 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.041 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a850c0b3:::benchmark_data_smithi018_166993_object64655:head# 2024-02-10T08:39:33.041 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.041 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:39:31.159983+0000 mgr.y (mgr.14505) 853 : cluster [DBG] pgmap v1046: 178 pgs: 5 active+undersized+degraded+remapped+backfilling, 173 active+clean; 4.0 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 907 op/s; 18733/197175 objects degraded (9.501%); 3.4 MiB/s, 54 objects/s recovering 2024-02-10T08:39:33.042 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:39:32.076922+0000 mon.a (mon.0) 1795 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:39:33.042 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:39:32.109290+0000 mon.a (mon.0) 1796 : audit [INF] from='client.? 172.21.15.18:0/1107819735' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-10T08:39:33.042 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:39:32.109358+0000 mon.a (mon.0) 1797 : cluster [DBG] osdmap e441: 8 total, 7 up, 7 in 2024-02-10T08:39:33.044 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a850eb23:::benchmark_data_smithi018_166993_object85032:head# 2024-02-10T08:39:33.044 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.044 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a851b28f:::benchmark_data_smithi018_166993_object83960:head# 2024-02-10T08:39:33.044 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.044 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a85404ab:::benchmark_data_smithi018_166993_object109066:head# 2024-02-10T08:39:33.044 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.044 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8545782:::benchmark_data_smithi018_166993_object111481:head# 2024-02-10T08:39:33.044 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.044 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8545c48:::benchmark_data_smithi018_166993_object80082:head# 2024-02-10T08:39:33.044 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.045 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8546ec3:::benchmark_data_smithi018_166993_object64648:head# 2024-02-10T08:39:33.045 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.045 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a854721c:::benchmark_data_smithi018_166993_object111059:head# 2024-02-10T08:39:33.045 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.045 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8548cfb:::benchmark_data_smithi018_166993_object58787:head# 2024-02-10T08:39:33.045 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.045 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a85584ec:::benchmark_data_smithi018_166993_object117308:head# 2024-02-10T08:39:33.045 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.045 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a855bfe2:::benchmark_data_smithi018_166993_object19218:head# 2024-02-10T08:39:33.045 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.045 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a85614dc:::benchmark_data_smithi018_166993_object104194:head# 2024-02-10T08:39:33.045 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.045 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8569497:::benchmark_data_smithi018_166993_object113214:head# 2024-02-10T08:39:33.045 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.045 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8570e93:::benchmark_data_smithi018_166993_object63710:head# 2024-02-10T08:39:33.046 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.046 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8574c9b:::benchmark_data_smithi018_166993_object98957:head# 2024-02-10T08:39:33.046 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.046 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8583ab2:::benchmark_data_smithi018_166993_object114473:head# 2024-02-10T08:39:33.047 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.047 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a85840aa:::benchmark_data_smithi018_166993_object62427:head# 2024-02-10T08:39:33.047 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.047 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8584fb4:::benchmark_data_smithi018_166993_object51090:head# 2024-02-10T08:39:33.047 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.047 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a85982ec:::benchmark_data_smithi018_166993_object73729:head# 2024-02-10T08:39:33.047 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.047 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a859ab52:::benchmark_data_smithi018_166993_object112825:head# 2024-02-10T08:39:33.047 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.048 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a85ae522:::benchmark_data_smithi018_166993_object25144:head# 2024-02-10T08:39:33.048 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.048 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a85c4b67:::benchmark_data_smithi018_166993_object34987:head# 2024-02-10T08:39:33.048 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.049 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a85dce3a:::benchmark_data_smithi018_166993_object42078:head# 2024-02-10T08:39:33.049 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.049 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a85e5e99:::benchmark_data_smithi018_166993_object60708:head# 2024-02-10T08:39:33.049 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.051 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a85ea519:::benchmark_data_smithi018_166993_object31976:head# 2024-02-10T08:39:33.051 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.052 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a85f1d18:::benchmark_data_smithi018_166993_object43006:head# 2024-02-10T08:39:33.052 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.052 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a85fab15:::benchmark_data_smithi018_166993_object76814:head# 2024-02-10T08:39:33.052 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.052 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a85fb197:::benchmark_data_smithi018_166993_object85626:head# 2024-02-10T08:39:33.052 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.052 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a85fd345:::benchmark_data_smithi018_166993_object21331:head# 2024-02-10T08:39:33.052 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.053 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a861017c:::benchmark_data_smithi018_166993_object106829:head# 2024-02-10T08:39:33.053 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.053 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8619003:::benchmark_data_smithi018_166993_object78709:head# 2024-02-10T08:39:33.053 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.056 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8629e3e:::benchmark_data_smithi018_166993_object77649:head# 2024-02-10T08:39:33.057 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.057 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8635888:::benchmark_data_smithi018_166993_object86113:head# 2024-02-10T08:39:33.057 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.058 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8639807:::benchmark_data_smithi018_166993_object108553:head# 2024-02-10T08:39:33.058 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.060 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8649ca0:::benchmark_data_smithi018_166993_object79689:head# 2024-02-10T08:39:33.060 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.060 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a866cd74:::benchmark_data_smithi018_166993_object40384:head# 2024-02-10T08:39:33.061 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.063 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a868055e:::benchmark_data_smithi018_166993_object46011:head# 2024-02-10T08:39:33.063 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.063 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a868564f:::benchmark_data_smithi018_166993_object43089:head# 2024-02-10T08:39:33.063 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.064 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a869bda3:::benchmark_data_smithi018_166993_object30040:head# 2024-02-10T08:39:33.064 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.064 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a869c6e2:::benchmark_data_smithi018_166993_object74183:head# 2024-02-10T08:39:33.064 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.065 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a86a52d9:::benchmark_data_smithi018_166993_object112523:head# 2024-02-10T08:39:33.065 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.068 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a86a5f0b:::benchmark_data_smithi018_166993_object106283:head# 2024-02-10T08:39:33.068 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.069 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a86a8d8d:::benchmark_data_smithi018_166993_object42516:head# 2024-02-10T08:39:33.069 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.069 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a86ca48f:::benchmark_data_smithi018_166993_object55511:head# 2024-02-10T08:39:33.070 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.070 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a86cdb0c:::benchmark_data_smithi018_166993_object74151:head# 2024-02-10T08:39:33.070 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.070 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a86d296d:::benchmark_data_smithi018_166993_object21854:head# 2024-02-10T08:39:33.070 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.070 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a86d65a8:::benchmark_data_smithi018_166993_object101322:head# 2024-02-10T08:39:33.070 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.073 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a86d9fdb:::benchmark_data_smithi018_166993_object104725:head# 2024-02-10T08:39:33.073 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.079 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a86de0c3:::benchmark_data_smithi018_166993_object21860:head# 2024-02-10T08:39:33.079 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.081 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a86ea709:::benchmark_data_smithi018_166993_object31787:head# 2024-02-10T08:39:33.081 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.083 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a86f72dc:::benchmark_data_smithi018_166993_object52402:head# 2024-02-10T08:39:33.083 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.083 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a86fca9e:::benchmark_data_smithi018_166993_object115241:head# 2024-02-10T08:39:33.083 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.083 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a870634e:::benchmark_data_smithi018_166993_object74425:head# 2024-02-10T08:39:33.083 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.083 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a870b1cf:::benchmark_data_smithi018_166993_object59416:head# 2024-02-10T08:39:33.083 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.083 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a872b900:::benchmark_data_smithi018_166993_object96631:head# 2024-02-10T08:39:33.083 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.083 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a87311f2:::benchmark_data_smithi018_166993_object31757:head# 2024-02-10T08:39:33.083 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.083 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a873fef4:::benchmark_data_smithi018_166993_object88622:head# 2024-02-10T08:39:33.083 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.085 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a876e5d6:::benchmark_data_smithi018_166993_object47755:head# 2024-02-10T08:39:33.085 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.085 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a877176a:::benchmark_data_smithi018_166993_object91175:head# 2024-02-10T08:39:33.085 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.085 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8775bf6:::benchmark_data_smithi018_166993_object114092:head# 2024-02-10T08:39:33.085 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.085 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a878beea:::benchmark_data_smithi018_166993_object105730:head# 2024-02-10T08:39:33.085 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.085 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8794879:::benchmark_data_smithi018_166993_object20449:head# 2024-02-10T08:39:33.085 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.086 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a87a5eff:::benchmark_data_smithi018_166993_object54117:head# 2024-02-10T08:39:33.086 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.086 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a87a6a2d:::benchmark_data_smithi018_166993_object114074:head# 2024-02-10T08:39:33.086 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.086 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a87b668b:::benchmark_data_smithi018_166993_object59170:head# 2024-02-10T08:39:33.086 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.086 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a87b9dec:::benchmark_data_smithi018_166993_object100968:head# 2024-02-10T08:39:33.086 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.088 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a87bc0f1:::benchmark_data_smithi018_166993_object35448:head# 2024-02-10T08:39:33.088 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.088 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a87bf96e:::benchmark_data_smithi018_166993_object93676:head# 2024-02-10T08:39:33.088 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.088 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a87c3ef8:::benchmark_data_smithi018_166993_object98366:head# 2024-02-10T08:39:33.088 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.088 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a87dd010:::benchmark_data_smithi018_166993_object117727:head# 2024-02-10T08:39:33.088 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.088 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a87de198:::benchmark_data_smithi018_166993_object75610:head# 2024-02-10T08:39:33.088 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.088 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a87e7c79:::benchmark_data_smithi018_166993_object19506:head# 2024-02-10T08:39:33.088 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.088 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a87ec012:::benchmark_data_smithi018_166993_object66440:head# 2024-02-10T08:39:33.089 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.089 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a87fbd54:::benchmark_data_smithi018_166993_object75791:head# 2024-02-10T08:39:33.089 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.089 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a87fd95e:::benchmark_data_smithi018_166993_object75249:head# 2024-02-10T08:39:33.089 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.089 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a88060f0:::benchmark_data_smithi018_166993_object33620:head# 2024-02-10T08:39:33.089 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.089 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a88104a7:::benchmark_data_smithi018_166993_object20510:head# 2024-02-10T08:39:33.089 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.090 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a88106cb:::benchmark_data_smithi018_166993_object18645:head# 2024-02-10T08:39:33.090 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.090 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a881cad5:::benchmark_data_smithi018_166993_object26091:head# 2024-02-10T08:39:33.090 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.090 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8826d54:::benchmark_data_smithi018_166993_object26131:head# 2024-02-10T08:39:33.091 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.091 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a88393c9:::benchmark_data_smithi018_166993_object91575:head# 2024-02-10T08:39:33.091 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.091 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a883b39f:::benchmark_data_smithi018_166993_object28015:head# 2024-02-10T08:39:33.091 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.091 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8843d5b:::benchmark_data_smithi018_166993_object51067:head# 2024-02-10T08:39:33.091 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.092 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a884c94d:::benchmark_data_smithi018_166993_object104613:head# 2024-02-10T08:39:33.092 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.092 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a886331f:::benchmark_data_smithi018_166993_object89728:head# 2024-02-10T08:39:33.092 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.092 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a886bdcf:::benchmark_data_smithi018_166993_object84309:head# 2024-02-10T08:39:33.092 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.092 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8870780:::benchmark_data_smithi018_166993_object74981:head# 2024-02-10T08:39:33.092 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.093 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a887b747:::benchmark_data_smithi018_166993_object101473:head# 2024-02-10T08:39:33.093 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.093 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a887dec2:::benchmark_data_smithi018_166993_object86711:head# 2024-02-10T08:39:33.093 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.093 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8884745:::benchmark_data_smithi018_166993_object87357:head# 2024-02-10T08:39:33.093 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.093 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8886db1:::benchmark_data_smithi018_166993_object31151:head# 2024-02-10T08:39:33.093 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.093 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a888adf9:::benchmark_data_smithi018_166993_object96424:head# 2024-02-10T08:39:33.093 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.093 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a888b410:::benchmark_data_smithi018_166993_object88951:head# 2024-02-10T08:39:33.093 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.093 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a88a857b:::benchmark_data_smithi018_166993_object29703:head# 2024-02-10T08:39:33.093 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.093 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a88ac9b8:::benchmark_data_smithi018_166993_object47912:head# 2024-02-10T08:39:33.093 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.094 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:39:31.159983+0000 mgr.y (mgr.14505) 853 : cluster [DBG] pgmap v1046: 178 pgs: 5 active+undersized+degraded+remapped+backfilling, 173 active+clean; 4.0 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 907 op/s; 18733/197175 objects degraded (9.501%); 3.4 MiB/s, 54 objects/s recovering 2024-02-10T08:39:33.094 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:39:32.076922+0000 mon.a (mon.0) 1795 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:39:33.094 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:39:32.109290+0000 mon.a (mon.0) 1796 : audit [INF] from='client.? 172.21.15.18:0/1107819735' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-10T08:39:33.094 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:39:32.109358+0000 mon.a (mon.0) 1797 : cluster [DBG] osdmap e441: 8 total, 7 up, 7 in 2024-02-10T08:39:33.096 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a88bc5a9:::benchmark_data_smithi018_166993_object93832:head# 2024-02-10T08:39:33.096 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.097 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a88bc5f0:::benchmark_data_smithi018_166993_object47882:head# 2024-02-10T08:39:33.097 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.097 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a88c382d:::benchmark_data_smithi018_166993_object79166:head# 2024-02-10T08:39:33.097 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.097 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a88d052e:::benchmark_data_smithi018_166993_object33183:head# 2024-02-10T08:39:33.097 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.097 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8901b33:::benchmark_data_smithi018_166993_object71492:head# 2024-02-10T08:39:33.097 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.097 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a89071de:::benchmark_data_smithi018_166993_object60728:head# 2024-02-10T08:39:33.097 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.097 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a890fdf1:::benchmark_data_smithi018_166993_object55051:head# 2024-02-10T08:39:33.097 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.097 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a89241df:::benchmark_data_smithi018_166993_object67844:head# 2024-02-10T08:39:33.097 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.097 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8925a1a:::benchmark_data_smithi018_166993_object51215:head# 2024-02-10T08:39:33.098 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.098 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8929dac:::benchmark_data_smithi018_166993_object89978:head# 2024-02-10T08:39:33.098 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.098 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a893b072:::benchmark_data_smithi018_166993_object45152:head# 2024-02-10T08:39:33.098 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.098 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a893c0c0:::benchmark_data_smithi018_166993_object107580:head# 2024-02-10T08:39:33.098 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.098 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a89524b0:::benchmark_data_smithi018_166993_object114555:head# 2024-02-10T08:39:33.098 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.098 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a896a3e7:::benchmark_data_smithi018_166993_object30734:head# 2024-02-10T08:39:33.098 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.098 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a896b4f8:::benchmark_data_smithi018_166993_object97866:head# 2024-02-10T08:39:33.098 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.098 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a896ebf1:::benchmark_data_smithi018_166993_object114659:head# 2024-02-10T08:39:33.099 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.099 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a896f4a0:::benchmark_data_smithi018_166993_object68435:head# 2024-02-10T08:39:33.099 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.100 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8976d3e:::benchmark_data_smithi018_166993_object56030:head# 2024-02-10T08:39:33.100 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.100 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a897a406:::benchmark_data_smithi018_166993_object51570:head# 2024-02-10T08:39:33.100 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.100 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a897a9c6:::benchmark_data_smithi018_166993_object103170:head# 2024-02-10T08:39:33.100 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.100 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a897f437:::benchmark_data_smithi018_166993_object74609:head# 2024-02-10T08:39:33.100 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.100 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a89af918:::benchmark_data_smithi018_166993_object88100:head# 2024-02-10T08:39:33.100 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.100 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a89b78d0:::benchmark_data_smithi018_166993_object26921:head# 2024-02-10T08:39:33.100 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.102 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a89b8a37:::benchmark_data_smithi018_166993_object77195:head# 2024-02-10T08:39:33.102 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.102 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a89d6a9e:::benchmark_data_smithi018_166993_object58589:head# 2024-02-10T08:39:33.102 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.102 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a89e946f:::benchmark_data_smithi018_166993_object85413:head# 2024-02-10T08:39:33.102 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.103 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a89eb753:::benchmark_data_smithi018_166993_object46401:head# 2024-02-10T08:39:33.103 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.103 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8a06078:::benchmark_data_smithi018_166993_object54301:head# 2024-02-10T08:39:33.103 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.103 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8a1334d:::benchmark_data_smithi018_166993_object95468:head# 2024-02-10T08:39:33.103 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.103 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8a18cc7:::benchmark_data_smithi018_166993_object94367:head# 2024-02-10T08:39:33.103 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.103 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8a2dbbc:::benchmark_data_smithi018_166993_object107981:head# 2024-02-10T08:39:33.103 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.103 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8a2dfbd:::benchmark_data_smithi018_166993_object39782:head# 2024-02-10T08:39:33.103 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.103 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8a4420e:::benchmark_data_smithi018_166993_object41554:head# 2024-02-10T08:39:33.103 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.104 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8a49189:::benchmark_data_smithi018_166993_object114821:head# 2024-02-10T08:39:33.104 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.104 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8a4c135:::benchmark_data_smithi018_166993_object116255:head# 2024-02-10T08:39:33.104 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.106 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8a56d52:::benchmark_data_smithi018_166993_object44270:head# 2024-02-10T08:39:33.106 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.107 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8a5c4f9:::benchmark_data_smithi018_166993_object52764:head# 2024-02-10T08:39:33.107 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.107 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8a609e0:::benchmark_data_smithi018_166993_object72801:head# 2024-02-10T08:39:33.107 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.107 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8a7642f:::benchmark_data_smithi018_166993_object61929:head# 2024-02-10T08:39:33.107 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.108 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8a845ca:::benchmark_data_smithi018_166993_object91237:head# 2024-02-10T08:39:33.108 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.109 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8a8a78d:::benchmark_data_smithi018_166993_object69548:head# 2024-02-10T08:39:33.109 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.109 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8a9a8e4:::benchmark_data_smithi018_166993_object92509:head# 2024-02-10T08:39:33.109 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.109 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8a9b846:::benchmark_data_smithi018_166993_object81327:head# 2024-02-10T08:39:33.109 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.109 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8a9dff6:::benchmark_data_smithi018_166993_object21945:head# 2024-02-10T08:39:33.109 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.109 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8aa3ce1:::benchmark_data_smithi018_166993_object28669:head# 2024-02-10T08:39:33.109 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.109 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8aa8462:::benchmark_data_smithi018_166993_object110548:head# 2024-02-10T08:39:33.110 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.110 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8ab10e0:::benchmark_data_smithi018_166993_object27906:head# 2024-02-10T08:39:33.110 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.111 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8abb6aa:::benchmark_data_smithi018_166993_object78368:head# 2024-02-10T08:39:33.111 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.111 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8ac2223:::benchmark_data_smithi018_166993_object28909:head# 2024-02-10T08:39:33.111 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.111 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8acc694:::benchmark_data_smithi018_166993_object45395:head# 2024-02-10T08:39:33.111 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.111 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8ad3d03:::benchmark_data_smithi018_166993_object116509:head# 2024-02-10T08:39:33.111 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.111 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8ad6432:::benchmark_data_smithi018_166993_object95678:head# 2024-02-10T08:39:33.111 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.112 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8ad79c0:::benchmark_data_smithi018_166993_object71052:head# 2024-02-10T08:39:33.112 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.112 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8adf817:::benchmark_data_smithi018_166993_object81303:head# 2024-02-10T08:39:33.112 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.112 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8ae0224:::benchmark_data_smithi018_166993_object96676:head# 2024-02-10T08:39:33.112 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.114 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8aebb58:::benchmark_data_smithi018_166993_object53288:head# 2024-02-10T08:39:33.114 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.114 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8afb52f:::benchmark_data_smithi018_166993_object47288:head# 2024-02-10T08:39:33.114 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.114 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8afdf8a:::benchmark_data_smithi018_166993_object116117:head# 2024-02-10T08:39:33.114 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.114 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8b00964:::benchmark_data_smithi018_166993_object68385:head# 2024-02-10T08:39:33.114 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.114 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8b0efea:::benchmark_data_smithi018_166993_object117165:head# 2024-02-10T08:39:33.114 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.114 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8b1cef8:::benchmark_data_smithi018_166993_object76993:head# 2024-02-10T08:39:33.114 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.114 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8b3b839:::benchmark_data_smithi018_166993_object38599:head# 2024-02-10T08:39:33.115 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.115 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8b40bf2:::benchmark_data_smithi018_166993_object107259:head# 2024-02-10T08:39:33.115 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.115 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8b42286:::benchmark_data_smithi018_166993_object106304:head# 2024-02-10T08:39:33.115 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.115 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8b42300:::benchmark_data_smithi018_166993_object41466:head# 2024-02-10T08:39:33.115 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.116 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8b509bb:::benchmark_data_smithi018_166993_object47789:head# 2024-02-10T08:39:33.116 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.116 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8b53ee3:::benchmark_data_smithi018_166993_object53658:head# 2024-02-10T08:39:33.116 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.117 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8b64ac2:::benchmark_data_smithi018_166993_object110348:head# 2024-02-10T08:39:33.117 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.117 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8b6a4c3:::benchmark_data_smithi018_166993_object42270:head# 2024-02-10T08:39:33.117 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.119 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8b7bf5a:::benchmark_data_smithi018_166993_object46144:head# 2024-02-10T08:39:33.119 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.119 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8b803cf:::benchmark_data_smithi018_166993_object80413:head# 2024-02-10T08:39:33.119 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.119 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8b91445:::benchmark_data_smithi018_166993_object97259:head# 2024-02-10T08:39:33.119 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.119 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8b99289:::benchmark_data_smithi018_166993_object96621:head# 2024-02-10T08:39:33.119 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.119 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8b9f192:::benchmark_data_smithi018_166993_object101612:head# 2024-02-10T08:39:33.119 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.119 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8ba3f0b:::benchmark_data_smithi018_166993_object78027:head# 2024-02-10T08:39:33.120 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.120 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8bba7e5:::benchmark_data_smithi018_166993_object28396:head# 2024-02-10T08:39:33.120 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.120 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8bbe183:::benchmark_data_smithi018_166993_object93994:head# 2024-02-10T08:39:33.120 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.120 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8bc6562:::benchmark_data_smithi018_166993_object116372:head# 2024-02-10T08:39:33.120 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.120 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8bca14f:::benchmark_data_smithi018_166993_object28316:head# 2024-02-10T08:39:33.121 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.121 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8be223a:::benchmark_data_smithi018_166993_object20434:head# 2024-02-10T08:39:33.121 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.122 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8be25c1:::benchmark_data_smithi018_166993_object48800:head# 2024-02-10T08:39:33.122 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.122 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8be521c:::benchmark_data_smithi018_166993_object74892:head# 2024-02-10T08:39:33.122 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.122 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8be6fc5:::benchmark_data_smithi018_166993_object69337:head# 2024-02-10T08:39:33.122 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.122 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8be7baa:::benchmark_data_smithi018_166993_object30229:head# 2024-02-10T08:39:33.122 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.122 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8bfa6c8:::benchmark_data_smithi018_166993_object76473:head# 2024-02-10T08:39:33.122 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.123 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8bfd26e:::benchmark_data_smithi018_166993_object39355:head# 2024-02-10T08:39:33.123 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.123 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8c08ecb:::benchmark_data_smithi018_166993_object37635:head# 2024-02-10T08:39:33.123 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.124 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.1 dump_historic_ops 2024-02-10T08:39:33.125 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8c10f37:::benchmark_data_smithi018_166993_object23319:head# 2024-02-10T08:39:33.125 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.125 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8c13926:::benchmark_data_smithi018_166993_object82919:head# 2024-02-10T08:39:33.125 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.125 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8c4622a:::benchmark_data_smithi018_166993_object24212:head# 2024-02-10T08:39:33.125 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.125 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8c52398:::benchmark_data_smithi018_166993_object26486:head# 2024-02-10T08:39:33.125 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.125 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8c55f72:::benchmark_data_smithi018_166993_object117541:head# 2024-02-10T08:39:33.125 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.125 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8c57a1d:::benchmark_data_smithi018_166993_object34687:head# 2024-02-10T08:39:33.125 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.125 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8c5e3d2:::benchmark_data_smithi018_166993_object26123:head# 2024-02-10T08:39:33.126 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.126 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8c64dd8:::benchmark_data_smithi018_166993_object77366:head# 2024-02-10T08:39:33.126 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.126 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8c6754d:::benchmark_data_smithi018_166993_object49740:head# 2024-02-10T08:39:33.126 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.126 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8c6d7d5:::benchmark_data_smithi018_166993_object48480:head# 2024-02-10T08:39:33.127 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.127 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8c706c3:::benchmark_data_smithi018_166993_object55425:head# 2024-02-10T08:39:33.127 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.127 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8c73a18:::benchmark_data_smithi018_166993_object61755:head# 2024-02-10T08:39:33.127 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.127 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8c77fb6:::benchmark_data_smithi018_166993_object42225:head# 2024-02-10T08:39:33.127 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.127 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8c7cf7b:::benchmark_data_smithi018_166993_object84462:head# 2024-02-10T08:39:33.127 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.127 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8c7f364:::benchmark_data_smithi018_166993_object88264:head# 2024-02-10T08:39:33.127 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.127 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8c832c5:::benchmark_data_smithi018_166993_object35149:head# 2024-02-10T08:39:33.127 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.128 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8c87b53:::benchmark_data_smithi018_166993_object73363:head# 2024-02-10T08:39:33.128 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.133 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8c8e4bf:::benchmark_data_smithi018_166993_object59356:head# 2024-02-10T08:39:33.133 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.134 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8c90dfd:::benchmark_data_smithi018_166993_object72070:head# 2024-02-10T08:39:33.134 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.134 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8c99f05:::benchmark_data_smithi018_166993_object112257:head# 2024-02-10T08:39:33.134 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.134 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8c9eea4:::benchmark_data_smithi018_166993_object98109:head# 2024-02-10T08:39:33.134 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.135 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8ca55cb:::benchmark_data_smithi018_166993_object62392:head# 2024-02-10T08:39:33.135 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.135 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8cc259f:::benchmark_data_smithi018_166993_object27969:head# 2024-02-10T08:39:33.135 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.135 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8cd3b4f:::benchmark_data_smithi018_166993_object89829:head# 2024-02-10T08:39:33.135 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.136 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8ce7c7d:::benchmark_data_smithi018_166993_object69285:head# 2024-02-10T08:39:33.136 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.136 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8cf0afa:::benchmark_data_smithi018_166993_object75399:head# 2024-02-10T08:39:33.136 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.136 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8cf59da:::benchmark_data_smithi018_166993_object84920:head# 2024-02-10T08:39:33.136 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.136 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8d0872b:::benchmark_data_smithi018_166993_object20454:head# 2024-02-10T08:39:33.137 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.137 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8d123bb:::benchmark_data_smithi018_166993_object82029:head# 2024-02-10T08:39:33.137 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.137 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8d179b5:::benchmark_data_smithi018_166993_object88821:head# 2024-02-10T08:39:33.137 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.138 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8d1e8e3:::benchmark_data_smithi018_166993_object89219:head# 2024-02-10T08:39:33.138 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.138 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8d2655b:::benchmark_data_smithi018_166993_object29845:head# 2024-02-10T08:39:33.138 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.138 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8d2cc8e:::benchmark_data_smithi018_166993_object77741:head# 2024-02-10T08:39:33.138 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.138 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8d3791e:::benchmark_data_smithi018_166993_object110769:head# 2024-02-10T08:39:33.138 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.138 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8d5e6aa:::benchmark_data_smithi018_166993_object82038:head# 2024-02-10T08:39:33.138 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.140 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8d6be1c:::benchmark_data_smithi018_166993_object82012:head# 2024-02-10T08:39:33.140 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.140 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8d7450c:::benchmark_data_smithi018_166993_object99838:head# 2024-02-10T08:39:33.140 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.140 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8d75b5d:::benchmark_data_smithi018_166993_object75253:head# 2024-02-10T08:39:33.140 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.140 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8d7c5da:::benchmark_data_smithi018_166993_object106617:head# 2024-02-10T08:39:33.140 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.141 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8d7cde5:::benchmark_data_smithi018_166993_object41527:head# 2024-02-10T08:39:33.141 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.141 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8d83eae:::benchmark_data_smithi018_166993_object42588:head# 2024-02-10T08:39:33.141 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.141 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8d8690d:::benchmark_data_smithi018_166993_object34895:head# 2024-02-10T08:39:33.141 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.141 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8da51a2:::benchmark_data_smithi018_166993_object81101:head# 2024-02-10T08:39:33.141 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.141 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8db242a:::benchmark_data_smithi018_166993_object112526:head# 2024-02-10T08:39:33.141 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.143 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8dbb003:::benchmark_data_smithi018_166993_object76845:head# 2024-02-10T08:39:33.143 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.143 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8dbc567:::benchmark_data_smithi018_166993_object82339:head# 2024-02-10T08:39:33.143 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.144 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8dc25bc:::benchmark_data_smithi018_166993_object86455:head# 2024-02-10T08:39:33.144 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.149 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8dc9e5b:::benchmark_data_smithi018_166993_object48131:head# 2024-02-10T08:39:33.149 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.149 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8dd377e:::benchmark_data_smithi018_166993_object97037:head# 2024-02-10T08:39:33.150 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.151 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8dd4acc:::benchmark_data_smithi018_166993_object117236:head# 2024-02-10T08:39:33.151 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.151 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8ddb59d:::benchmark_data_smithi018_166993_object27004:head# 2024-02-10T08:39:33.151 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.151 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8de0844:::benchmark_data_smithi018_166993_object36108:head# 2024-02-10T08:39:33.152 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.152 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8deab8f:::benchmark_data_smithi018_166993_object116008:head# 2024-02-10T08:39:33.152 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.152 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8dfe224:::benchmark_data_smithi018_166993_object107117:head# 2024-02-10T08:39:33.152 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.152 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8e03cdf:::benchmark_data_smithi018_166993_object26891:head# 2024-02-10T08:39:33.152 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.152 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8e08aac:::benchmark_data_smithi018_166993_object71649:head# 2024-02-10T08:39:33.152 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.152 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8e09ade:::benchmark_data_smithi018_166993_object28788:head# 2024-02-10T08:39:33.152 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.153 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8e288b5:::benchmark_data_smithi018_166993_object56380:head# 2024-02-10T08:39:33.153 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.153 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8e2fcf9:::benchmark_data_smithi018_166993_object29859:head# 2024-02-10T08:39:33.153 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.154 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8e30dca:::benchmark_data_smithi018_166993_object65444:head# 2024-02-10T08:39:33.154 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.156 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8e4b0f0:::benchmark_data_smithi018_166993_object46217:head# 2024-02-10T08:39:33.156 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.156 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8e51d1a:::benchmark_data_smithi018_166993_object101967:head# 2024-02-10T08:39:33.156 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.157 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8e58f95:::benchmark_data_smithi018_166993_object102130:head# 2024-02-10T08:39:33.157 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.157 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8e63141:::benchmark_data_smithi018_166993_object22053:head# 2024-02-10T08:39:33.157 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.157 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8e64d91:::benchmark_data_smithi018_166993_object99094:head# 2024-02-10T08:39:33.157 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.157 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8e6e66f:::benchmark_data_smithi018_166993_object84581:head# 2024-02-10T08:39:33.157 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.157 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8e703d1:::benchmark_data_smithi018_166993_object42892:head# 2024-02-10T08:39:33.157 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.161 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8e73ae9:::benchmark_data_smithi018_166993_object71926:head# 2024-02-10T08:39:33.161 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.161 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8e74b07:::benchmark_data_smithi018_166993_object42656:head# 2024-02-10T08:39:33.161 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.161 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8e7e52d:::benchmark_data_smithi018_166993_object115600:head# 2024-02-10T08:39:33.161 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.161 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8e7f6b9:::benchmark_data_smithi018_166993_object59244:head# 2024-02-10T08:39:33.161 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.161 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8e8a1af:::benchmark_data_smithi018_166993_object74400:head# 2024-02-10T08:39:33.162 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.166 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8e94bcc:::benchmark_data_smithi018_166993_object40158:head# 2024-02-10T08:39:33.166 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.166 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8eb009e:::benchmark_data_smithi018_166993_object43482:head# 2024-02-10T08:39:33.166 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.166 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8ebf625:::benchmark_data_smithi018_166993_object57740:head# 2024-02-10T08:39:33.166 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.167 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8eccf44:::benchmark_data_smithi018_166993_object83446:head# 2024-02-10T08:39:33.167 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.167 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8eceefd:::benchmark_data_smithi018_166993_object37210:head# 2024-02-10T08:39:33.167 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.167 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8ef1d35:::benchmark_data_smithi018_166993_object101876:head# 2024-02-10T08:39:33.167 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.168 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8ef1ebf:::benchmark_data_smithi018_166993_object75131:head# 2024-02-10T08:39:33.168 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.168 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8ef3428:::benchmark_data_smithi018_166993_object83342:head# 2024-02-10T08:39:33.168 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.168 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8f142ad:::benchmark_data_smithi018_166993_object104034:head# 2024-02-10T08:39:33.168 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.170 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8f48254:::benchmark_data_smithi018_166993_object104041:head# 2024-02-10T08:39:33.170 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.170 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8f519a9:::benchmark_data_smithi018_166993_object48162:head# 2024-02-10T08:39:33.170 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.170 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8f52670:::benchmark_data_smithi018_166993_object25571:head# 2024-02-10T08:39:33.170 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.170 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8f5fbb8:::benchmark_data_smithi018_166993_object43720:head# 2024-02-10T08:39:33.170 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.170 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8f9234f:::benchmark_data_smithi018_166993_object78794:head# 2024-02-10T08:39:33.170 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.170 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8f9a835:::benchmark_data_smithi018_166993_object23295:head# 2024-02-10T08:39:33.170 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.170 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8f9ca1e:::benchmark_data_smithi018_166993_object108727:head# 2024-02-10T08:39:33.170 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.171 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8f9d111:::benchmark_data_smithi018_166993_object43644:head# 2024-02-10T08:39:33.171 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.171 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8fa59e9:::benchmark_data_smithi018_166993_object19930:head# 2024-02-10T08:39:33.171 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.171 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8fa830c:::benchmark_data_smithi018_166993_object30594:head# 2024-02-10T08:39:33.171 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.173 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8fbcb18:::benchmark_data_smithi018_166993_object87943:head# 2024-02-10T08:39:33.173 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.173 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8fd56cd:::benchmark_data_smithi018_166993_object80771:head# 2024-02-10T08:39:33.173 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.173 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8fd93c7:::benchmark_data_smithi018_166993_object75500:head# 2024-02-10T08:39:33.173 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.173 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8fe56b8:::benchmark_data_smithi018_166993_object106597:head# 2024-02-10T08:39:33.173 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.174 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8ff5ac7:::benchmark_data_smithi018_166993_object113073:head# 2024-02-10T08:39:33.174 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.174 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8ff9d9f:::benchmark_data_smithi018_166993_object21493:head# 2024-02-10T08:39:33.174 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.174 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8ffd394:::benchmark_data_smithi018_166993_object63054:head# 2024-02-10T08:39:33.174 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.174 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a8ffe890:::benchmark_data_smithi018_166993_object28878:head# 2024-02-10T08:39:33.175 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.176 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9007982:::benchmark_data_smithi018_166993_object111003:head# 2024-02-10T08:39:33.176 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.176 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9013c47:::benchmark_data_smithi018_166993_object20156:head# 2024-02-10T08:39:33.176 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.176 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a901c170:::benchmark_data_smithi018_166993_object94561:head# 2024-02-10T08:39:33.176 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.176 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a901f5ee:::benchmark_data_smithi018_166993_object49470:head# 2024-02-10T08:39:33.176 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.176 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9020a50:::benchmark_data_smithi018_166993_object64705:head# 2024-02-10T08:39:33.176 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.177 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a90427d6:::benchmark_data_smithi018_166993_object54608:head# 2024-02-10T08:39:33.177 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.177 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a904bb99:::benchmark_data_smithi018_166993_object86727:head# 2024-02-10T08:39:33.177 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.177 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9063553:::benchmark_data_smithi018_166993_object57323:head# 2024-02-10T08:39:33.177 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.181 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9065d20:::benchmark_data_smithi018_166993_object73809:head# 2024-02-10T08:39:33.181 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.181 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a906dba1:::benchmark_data_smithi018_166993_object38993:head# 2024-02-10T08:39:33.182 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.182 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9094a5f:::benchmark_data_smithi018_166993_object62816:head# 2024-02-10T08:39:33.182 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.182 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a909ccfa:::benchmark_data_smithi018_166993_object27161:head# 2024-02-10T08:39:33.182 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.182 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a90ad5ba:::benchmark_data_smithi018_166993_object50103:head# 2024-02-10T08:39:33.182 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.183 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a90af741:::benchmark_data_smithi018_166993_object101723:head# 2024-02-10T08:39:33.183 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.183 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a90b7106:::benchmark_data_smithi018_166993_object34381:head# 2024-02-10T08:39:33.184 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.184 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a90c24f0:::benchmark_data_smithi018_166993_object22610:head# 2024-02-10T08:39:33.184 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.184 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a90ce2ad:::benchmark_data_smithi018_166993_object58619:head# 2024-02-10T08:39:33.184 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.184 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a90ea237:::benchmark_data_smithi018_166993_object109041:head# 2024-02-10T08:39:33.185 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.185 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a90f6cda:::benchmark_data_smithi018_166993_object113866:head# 2024-02-10T08:39:33.185 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.186 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9105954:::benchmark_data_smithi018_166993_object115907:head# 2024-02-10T08:39:33.186 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.187 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a910e8ea:::benchmark_data_smithi018_166993_object41376:head# 2024-02-10T08:39:33.187 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.187 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a910fb23:::benchmark_data_smithi018_166993_object110443:head# 2024-02-10T08:39:33.187 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.187 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a911939c:::benchmark_data_smithi018_166993_object53849:head# 2024-02-10T08:39:33.187 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.187 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a913a014:::benchmark_data_smithi018_166993_object102307:head# 2024-02-10T08:39:33.187 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.187 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a913ab0e:::benchmark_data_smithi018_166993_object36695:head# 2024-02-10T08:39:33.187 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.188 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9149bcd:::benchmark_data_smithi018_166993_object112086:head# 2024-02-10T08:39:33.189 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.189 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a914b85a:::benchmark_data_smithi018_166993_object50582:head# 2024-02-10T08:39:33.189 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.189 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9159c5d:::benchmark_data_smithi018_166993_object115153:head# 2024-02-10T08:39:33.189 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.189 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a915eea4:::benchmark_data_smithi018_166993_object60012:head# 2024-02-10T08:39:33.189 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.189 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9166920:::benchmark_data_smithi018_166993_object65511:head# 2024-02-10T08:39:33.189 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.189 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9174480:::benchmark_data_smithi018_166993_object18660:head# 2024-02-10T08:39:33.189 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.189 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a91828a6:::benchmark_data_smithi018_166993_object82322:head# 2024-02-10T08:39:33.189 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.190 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a918626b:::benchmark_data_smithi018_166993_object52351:head# 2024-02-10T08:39:33.190 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.190 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a918fcbe:::benchmark_data_smithi018_166993_object64524:head# 2024-02-10T08:39:33.190 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.193 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a919542c:::benchmark_data_smithi018_166993_object111236:head# 2024-02-10T08:39:33.193 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.193 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a91af482:::benchmark_data_smithi018_166993_object24612:head# 2024-02-10T08:39:33.193 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.193 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a91b011c:::benchmark_data_smithi018_166993_object85390:head# 2024-02-10T08:39:33.193 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.193 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a91b3c92:::benchmark_data_smithi018_166993_object28352:head# 2024-02-10T08:39:33.193 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.193 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a91b935c:::benchmark_data_smithi018_166993_object88393:head# 2024-02-10T08:39:33.193 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.193 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a91c9a28:::benchmark_data_smithi018_166993_object25617:head# 2024-02-10T08:39:33.193 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.194 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a91d25b6:::benchmark_data_smithi018_166993_object25784:head# 2024-02-10T08:39:33.194 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.194 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a91f47bc:::benchmark_data_smithi018_166993_object101853:head# 2024-02-10T08:39:33.194 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.194 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a920da9e:::benchmark_data_smithi018_166993_object25498:head# 2024-02-10T08:39:33.194 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.194 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a920ef5d:::benchmark_data_smithi018_166993_object52408:head# 2024-02-10T08:39:33.194 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.194 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a921212a:::benchmark_data_smithi018_166993_object51145:head# 2024-02-10T08:39:33.194 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.194 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a921b6e9:::benchmark_data_smithi018_166993_object45950:head# 2024-02-10T08:39:33.194 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.194 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a921eea2:::benchmark_data_smithi018_166993_object104159:head# 2024-02-10T08:39:33.194 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.194 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a922cdc3:::benchmark_data_smithi018_166993_object80621:head# 2024-02-10T08:39:33.194 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.195 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a922ffbd:::benchmark_data_smithi018_166993_object33233:head# 2024-02-10T08:39:33.195 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.195 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a92408d6:::benchmark_data_smithi018_166993_object93586:head# 2024-02-10T08:39:33.195 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.199 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9248e84:::benchmark_data_smithi018_166993_object82528:head# 2024-02-10T08:39:33.199 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.199 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a925607d:::benchmark_data_smithi018_166993_object79554:head# 2024-02-10T08:39:33.199 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.199 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a92592fc:::benchmark_data_smithi018_166993_object55053:head# 2024-02-10T08:39:33.199 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.199 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a925d656:::benchmark_data_smithi018_166993_object108071:head# 2024-02-10T08:39:33.199 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.199 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9265f6c:::benchmark_data_smithi018_166993_object39301:head# 2024-02-10T08:39:33.199 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.199 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9266d46:::benchmark_data_smithi018_166993_object76477:head# 2024-02-10T08:39:33.200 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.200 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9284ad9:::benchmark_data_smithi018_166993_object60188:head# 2024-02-10T08:39:33.200 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.200 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9284b3d:::benchmark_data_smithi018_166993_object90538:head# 2024-02-10T08:39:33.200 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.200 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a929cd73:::benchmark_data_smithi018_166993_object75827:head# 2024-02-10T08:39:33.200 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.200 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a92ac09c:::benchmark_data_smithi018_166993_object28141:head# 2024-02-10T08:39:33.200 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.200 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a92b9fa6:::benchmark_data_smithi018_166993_object32477:head# 2024-02-10T08:39:33.200 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.200 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a92bc125:::benchmark_data_smithi018_166993_object107152:head# 2024-02-10T08:39:33.200 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.200 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a92dcc6b:::benchmark_data_smithi018_166993_object36955:head# 2024-02-10T08:39:33.201 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.201 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a92df499:::benchmark_data_smithi018_166993_object85712:head# 2024-02-10T08:39:33.201 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.201 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a92e24fa:::benchmark_data_smithi018_166993_object55888:head# 2024-02-10T08:39:33.201 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.201 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a92f07c6:::benchmark_data_smithi018_166993_object106799:head# 2024-02-10T08:39:33.201 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.201 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a92fec2b:::benchmark_data_smithi018_166993_object48197:head# 2024-02-10T08:39:33.201 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.201 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a930254c:::benchmark_data_smithi018_166993_object33026:head# 2024-02-10T08:39:33.201 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.201 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9303740:::benchmark_data_smithi018_166993_object36644:head# 2024-02-10T08:39:33.201 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.201 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a93045c2:::benchmark_data_smithi018_166993_object92437:head# 2024-02-10T08:39:33.202 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.202 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a93056c4:::benchmark_data_smithi018_166993_object31312:head# 2024-02-10T08:39:33.202 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.202 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a93088e0:::benchmark_data_smithi018_166993_object25430:head# 2024-02-10T08:39:33.202 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.202 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9315b54:::benchmark_data_smithi018_166993_object57477:head# 2024-02-10T08:39:33.202 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.202 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9316a7e:::benchmark_data_smithi018_166993_object111233:head# 2024-02-10T08:39:33.202 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.203 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a931d7b1:::benchmark_data_smithi018_166993_object106650:head# 2024-02-10T08:39:33.203 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.203 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a932207d:::benchmark_data_smithi018_166993_object56527:head# 2024-02-10T08:39:33.203 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.204 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a93245e7:::benchmark_data_smithi018_166993_object82794:head# 2024-02-10T08:39:33.204 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.205 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a93345f6:::benchmark_data_smithi018_166993_object44528:head# 2024-02-10T08:39:33.205 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.205 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a933964c:::benchmark_data_smithi018_166993_object105751:head# 2024-02-10T08:39:33.205 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.205 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9343b73:::benchmark_data_smithi018_166993_object67130:head# 2024-02-10T08:39:33.205 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.205 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9354cca:::benchmark_data_smithi018_166993_object23826:head# 2024-02-10T08:39:33.205 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.205 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a936688f:::benchmark_data_smithi018_166993_object53656:head# 2024-02-10T08:39:33.205 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.205 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a936b382:::benchmark_data_smithi018_166993_object39867:head# 2024-02-10T08:39:33.205 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.206 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9396d7d:::benchmark_data_smithi018_166993_object57245:head# 2024-02-10T08:39:33.206 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.206 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a93a3c01:::benchmark_data_smithi018_166993_object111611:head# 2024-02-10T08:39:33.206 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.206 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a93a4096:::benchmark_data_smithi018_166993_object48548:head# 2024-02-10T08:39:33.207 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.207 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a93b9acc:::benchmark_data_smithi018_166993_object116409:head# 2024-02-10T08:39:33.207 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.208 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a93bb80f:::benchmark_data_smithi018_166993_object117814:head# 2024-02-10T08:39:33.208 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.209 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a93c19b6:::benchmark_data_smithi018_166993_object78836:head# 2024-02-10T08:39:33.209 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.209 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a93c2cfb:::benchmark_data_smithi018_166993_object48342:head# 2024-02-10T08:39:33.209 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.210 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a93ce88d:::benchmark_data_smithi018_166993_object78737:head# 2024-02-10T08:39:33.210 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.211 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a93d6650:::benchmark_data_smithi018_166993_object36829:head# 2024-02-10T08:39:33.211 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.211 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a93d76d8:::benchmark_data_smithi018_166993_object110378:head# 2024-02-10T08:39:33.211 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.211 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a93ddc55:::benchmark_data_smithi018_166993_object35969:head# 2024-02-10T08:39:33.211 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.212 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a93df456:::benchmark_data_smithi018_166993_object118759:head# 2024-02-10T08:39:33.212 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.212 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a93e1b6b:::benchmark_data_smithi018_166993_object70325:head# 2024-02-10T08:39:33.212 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.214 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a93e2ef6:::benchmark_data_smithi018_166993_object23068:head# 2024-02-10T08:39:33.214 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.215 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a93e8046:::benchmark_data_smithi018_166993_object22539:head# 2024-02-10T08:39:33.215 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.215 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a93f45f9:::benchmark_data_smithi018_166993_object48542:head# 2024-02-10T08:39:33.215 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.215 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a93f6de1:::benchmark_data_smithi018_166993_object110979:head# 2024-02-10T08:39:33.215 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.215 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a93f88a8:::benchmark_data_smithi018_166993_object17475:head# 2024-02-10T08:39:33.215 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.215 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9407c45:::benchmark_data_smithi018_166993_object76956:head# 2024-02-10T08:39:33.215 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.215 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a94105a0:::benchmark_data_smithi018_166993_object84307:head# 2024-02-10T08:39:33.215 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.215 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9410b75:::benchmark_data_smithi018_166993_object22099:head# 2024-02-10T08:39:33.215 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.215 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a942190d:::benchmark_data_smithi018_166993_object78190:head# 2024-02-10T08:39:33.216 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.216 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9422fa6:::benchmark_data_smithi018_166993_object38760:head# 2024-02-10T08:39:33.216 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.218 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a944d0b6:::benchmark_data_smithi018_166993_object71654:head# 2024-02-10T08:39:33.218 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.218 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a944f9e0:::benchmark_data_smithi018_166993_object54813:head# 2024-02-10T08:39:33.218 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.218 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a945815c:::benchmark_data_smithi018_166993_object29181:head# 2024-02-10T08:39:33.218 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.218 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9458c11:::benchmark_data_smithi018_166993_object66119:head# 2024-02-10T08:39:33.218 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.218 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9464dd0:::benchmark_data_smithi018_166993_object75569:head# 2024-02-10T08:39:33.218 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.218 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9469faf:::benchmark_data_smithi018_166993_object49047:head# 2024-02-10T08:39:33.219 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.219 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a94701b8:::benchmark_data_smithi018_166993_object115122:head# 2024-02-10T08:39:33.219 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.219 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a94866b9:::benchmark_data_smithi018_166993_object44558:head# 2024-02-10T08:39:33.219 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.219 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9490251:::benchmark_data_smithi018_166993_object26046:head# 2024-02-10T08:39:33.219 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.219 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9490df5:::benchmark_data_smithi018_166993_object62562:head# 2024-02-10T08:39:33.219 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.219 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a949873e:::benchmark_data_smithi018_166993_object28702:head# 2024-02-10T08:39:33.219 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.219 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a94a031c:::benchmark_data_smithi018_166993_object95513:head# 2024-02-10T08:39:33.219 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.220 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a94aacd2:::benchmark_data_smithi018_166993_object82738:head# 2024-02-10T08:39:33.220 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.220 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a94b0923:::benchmark_data_smithi018_166993_object67944:head# 2024-02-10T08:39:33.220 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.220 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a94b75e1:::benchmark_data_smithi018_166993_object41677:head# 2024-02-10T08:39:33.220 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.220 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a94c6a78:::benchmark_data_smithi018_166993_object99086:head# 2024-02-10T08:39:33.221 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.221 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a94c6e5d:::benchmark_data_smithi018_166993_object64767:head# 2024-02-10T08:39:33.221 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.221 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a94d563c:::benchmark_data_smithi018_166993_object68184:head# 2024-02-10T08:39:33.221 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.221 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a94dbd45:::benchmark_data_smithi018_166993_object118522:head# 2024-02-10T08:39:33.221 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.221 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a94e7f3e:::benchmark_data_smithi018_166993_object96129:head# 2024-02-10T08:39:33.221 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.221 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9501b21:::benchmark_data_smithi018_166993_object53237:head# 2024-02-10T08:39:33.221 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.224 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9504872:::benchmark_data_smithi018_166993_object75118:head# 2024-02-10T08:39:33.225 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.225 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a950628c:::benchmark_data_smithi018_166993_object38765:head# 2024-02-10T08:39:33.225 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.225 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9508ade:::benchmark_data_smithi018_166993_object92059:head# 2024-02-10T08:39:33.225 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.225 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9509592:::benchmark_data_smithi018_166993_object68465:head# 2024-02-10T08:39:33.225 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.225 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a952c564:::benchmark_data_smithi018_166993_object102146:head# 2024-02-10T08:39:33.225 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.225 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a952f8b2:::benchmark_data_smithi018_166993_object65283:head# 2024-02-10T08:39:33.225 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.225 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9534ae3:::benchmark_data_smithi018_166993_object81774:head# 2024-02-10T08:39:33.225 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.225 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a953cb9a:::benchmark_data_smithi018_166993_object117330:head# 2024-02-10T08:39:33.225 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.226 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a953f7e8:::benchmark_data_smithi018_166993_object103311:head# 2024-02-10T08:39:33.226 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.226 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9540aab:::benchmark_data_smithi018_166993_object22609:head# 2024-02-10T08:39:33.226 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.226 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9545a2c:::benchmark_data_smithi018_166993_object54376:head# 2024-02-10T08:39:33.226 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.226 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9548ad3:::benchmark_data_smithi018_166993_object22417:head# 2024-02-10T08:39:33.226 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.226 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a954b4d4:::benchmark_data_smithi018_166993_object78687:head# 2024-02-10T08:39:33.226 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.226 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9573551:::benchmark_data_smithi018_166993_object48641:head# 2024-02-10T08:39:33.226 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.226 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9578c53:::benchmark_data_smithi018_166993_object74066:head# 2024-02-10T08:39:33.226 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.227 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9582bcd:::benchmark_data_smithi018_166993_object117632:head# 2024-02-10T08:39:33.227 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.227 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a958ff1c:::benchmark_data_smithi018_166993_object84143:head# 2024-02-10T08:39:33.227 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.227 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9591bde:::benchmark_data_smithi018_166993_object69635:head# 2024-02-10T08:39:33.227 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.228 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9593b63:::benchmark_data_smithi018_166993_object107695:head# 2024-02-10T08:39:33.228 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.228 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a959d562:::benchmark_data_smithi018_166993_object113193:head# 2024-02-10T08:39:33.228 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.228 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a959da3d:::benchmark_data_smithi018_166993_object38217:head# 2024-02-10T08:39:33.228 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.228 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a95a408a:::benchmark_data_smithi018_166993_object64778:head# 2024-02-10T08:39:33.229 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.229 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a95a53c5:::benchmark_data_smithi018_166993_object48743:head# 2024-02-10T08:39:33.229 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.229 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a95ad30e:::benchmark_data_smithi018_166993_object61022:head# 2024-02-10T08:39:33.229 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.229 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a95bf09f:::benchmark_data_smithi018_166993_object42725:head# 2024-02-10T08:39:33.229 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.233 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a95cfc4d:::benchmark_data_smithi018_166993_object115177:head# 2024-02-10T08:39:33.233 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.236 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a95f01a7:::benchmark_data_smithi018_166993_object95747:head# 2024-02-10T08:39:33.236 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.236 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a95f01e9:::benchmark_data_smithi018_166993_object88944:head# 2024-02-10T08:39:33.236 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.237 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9616d31:::benchmark_data_smithi018_166993_object31256:head# 2024-02-10T08:39:33.237 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.237 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a96187fb:::benchmark_data_smithi018_166993_object36970:head# 2024-02-10T08:39:33.237 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.238 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9628ede:::benchmark_data_smithi018_166993_object92188:head# 2024-02-10T08:39:33.238 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.238 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9642ec0:::benchmark_data_smithi018_166993_object34098:head# 2024-02-10T08:39:33.239 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.239 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a964c107:::benchmark_data_smithi018_166993_object117890:head# 2024-02-10T08:39:33.239 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.239 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9650f0e:::benchmark_data_smithi018_166993_object115383:head# 2024-02-10T08:39:33.239 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.239 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9655e07:::benchmark_data_smithi018_166993_object86548:head# 2024-02-10T08:39:33.239 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.239 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a96589d2:::benchmark_data_smithi018_166993_object56052:head# 2024-02-10T08:39:33.239 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.239 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a96610eb:::benchmark_data_smithi018_166993_object103179:head# 2024-02-10T08:39:33.239 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.243 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9662186:::benchmark_data_smithi018_166993_object28922:head# 2024-02-10T08:39:33.243 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.243 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9669242:::benchmark_data_smithi018_166993_object100959:head# 2024-02-10T08:39:33.243 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.243 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a96823f2:::benchmark_data_smithi018_166993_object83134:head# 2024-02-10T08:39:33.243 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.243 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9685468:::benchmark_data_smithi018_166993_object73019:head# 2024-02-10T08:39:33.243 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.243 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a968f19d:::benchmark_data_smithi018_166993_object89384:head# 2024-02-10T08:39:33.244 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.244 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a96971a7:::benchmark_data_smithi018_166993_object89353:head# 2024-02-10T08:39:33.244 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.244 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a96a2fb1:::benchmark_data_smithi018_166993_object110519:head# 2024-02-10T08:39:33.244 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.244 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a96a858a:::benchmark_data_smithi018_166993_object30107:head# 2024-02-10T08:39:33.244 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.244 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a96b6ec7:::benchmark_data_smithi018_166993_object108761:head# 2024-02-10T08:39:33.244 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.245 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a96f3096:::benchmark_data_smithi018_166993_object88192:head# 2024-02-10T08:39:33.245 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.245 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a96ff1ea:::benchmark_data_smithi018_166993_object76919:head# 2024-02-10T08:39:33.245 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.245 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9703a80:::benchmark_data_smithi018_166993_object112434:head# 2024-02-10T08:39:33.246 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.246 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a97071ee:::benchmark_data_smithi018_166993_object54827:head# 2024-02-10T08:39:33.246 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.246 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a971ce40:::benchmark_data_smithi018_166993_object32306:head# 2024-02-10T08:39:33.246 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.246 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a972a573:::benchmark_data_smithi018_166993_object45704:head# 2024-02-10T08:39:33.246 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.246 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a974f5ad:::benchmark_data_smithi018_166993_object47737:head# 2024-02-10T08:39:33.246 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.247 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a976b6eb:::benchmark_data_smithi018_166993_object98549:head# 2024-02-10T08:39:33.247 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.247 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a978161a:::benchmark_data_smithi018_166993_object108427:head# 2024-02-10T08:39:33.247 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.247 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9787d50:::benchmark_data_smithi018_166993_object75793:head# 2024-02-10T08:39:33.247 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.247 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a978e17a:::benchmark_data_smithi018_166993_object41905:head# 2024-02-10T08:39:33.247 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.247 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a978e938:::benchmark_data_smithi018_166993_object72493:head# 2024-02-10T08:39:33.247 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.247 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9794fea:::benchmark_data_smithi018_166993_object51848:head# 2024-02-10T08:39:33.248 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.248 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9797e6e:::benchmark_data_smithi018_166993_object100998:head# 2024-02-10T08:39:33.248 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.252 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a97a7632:::benchmark_data_smithi018_166993_object30356:head# 2024-02-10T08:39:33.252 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.254 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a97a8bdc:::benchmark_data_smithi018_166993_object64095:head# 2024-02-10T08:39:33.254 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.258 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a97b474a:::benchmark_data_smithi018_166993_object85608:head# 2024-02-10T08:39:33.258 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.259 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a97b74d4:::benchmark_data_smithi018_166993_object45259:head# 2024-02-10T08:39:33.259 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.259 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a97bfef4:::benchmark_data_smithi018_166993_object96547:head# 2024-02-10T08:39:33.259 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.260 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a97c7622:::benchmark_data_smithi018_166993_object97180:head# 2024-02-10T08:39:33.260 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.260 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a97c9f52:::benchmark_data_smithi018_166993_object85953:head# 2024-02-10T08:39:33.260 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.260 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a97cd3a5:::benchmark_data_smithi018_166993_object99790:head# 2024-02-10T08:39:33.260 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.262 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a97e13ef:::benchmark_data_smithi018_166993_object67401:head# 2024-02-10T08:39:33.262 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.262 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a97e6c41:::benchmark_data_smithi018_166993_object93859:head# 2024-02-10T08:39:33.262 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.263 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a97fd3c5:::benchmark_data_smithi018_166993_object22794:head# 2024-02-10T08:39:33.263 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.263 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9804f37:::benchmark_data_smithi018_166993_object90741:head# 2024-02-10T08:39:33.263 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.263 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a980ccb0:::benchmark_data_smithi018_166993_object63305:head# 2024-02-10T08:39:33.263 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.263 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a981ae78:::benchmark_data_smithi018_166993_object69631:head# 2024-02-10T08:39:33.263 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.263 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a981efa2:::benchmark_data_smithi018_166993_object61955:head# 2024-02-10T08:39:33.264 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.264 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a981f2de:::benchmark_data_smithi018_166993_object70544:head# 2024-02-10T08:39:33.265 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.265 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9827f47:::benchmark_data_smithi018_166993_object52729:head# 2024-02-10T08:39:33.265 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.265 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a982c2db:::benchmark_data_smithi018_166993_object92393:head# 2024-02-10T08:39:33.265 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.265 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a98386f6:::benchmark_data_smithi018_166993_object51002:head# 2024-02-10T08:39:33.265 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.267 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9839121:::benchmark_data_smithi018_166993_object65241:head# 2024-02-10T08:39:33.267 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.268 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a983a425:::benchmark_data_smithi018_166993_object85236:head# 2024-02-10T08:39:33.268 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.268 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a983afa5:::benchmark_data_smithi018_166993_object34397:head# 2024-02-10T08:39:33.268 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.270 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9842cf2:::benchmark_data_smithi018_166993_object103649:head# 2024-02-10T08:39:33.271 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.271 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a984dbd9:::benchmark_data_smithi018_166993_object35516:head# 2024-02-10T08:39:33.272 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.272 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9851989:::benchmark_data_smithi018_166993_object87286:head# 2024-02-10T08:39:33.272 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.272 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a98639ed:::benchmark_data_smithi018_166993_object45140:head# 2024-02-10T08:39:33.272 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.272 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a986bb98:::benchmark_data_smithi018_166993_object32479:head# 2024-02-10T08:39:33.272 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.273 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a986c3fe:::benchmark_data_smithi018_166993_object99690:head# 2024-02-10T08:39:33.273 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.274 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9871ef8:::benchmark_data_smithi018_166993_object27652:head# 2024-02-10T08:39:33.274 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.274 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9895e54:::benchmark_data_smithi018_166993_object109848:head# 2024-02-10T08:39:33.274 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.274 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9899236:::benchmark_data_smithi018_166993_object74253:head# 2024-02-10T08:39:33.274 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.274 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a98ab80e:::benchmark_data_smithi018_166993_object56027:head# 2024-02-10T08:39:33.274 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.274 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a98ad9c3:::benchmark_data_smithi018_166993_object32731:head# 2024-02-10T08:39:33.274 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.274 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a98b9287:::benchmark_data_smithi018_166993_object116789:head# 2024-02-10T08:39:33.274 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.275 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a98ba9c1:::benchmark_data_smithi018_166993_object34888:head# 2024-02-10T08:39:33.275 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.275 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a98bf2c8:::benchmark_data_smithi018_166993_object51505:head# 2024-02-10T08:39:33.275 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.277 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a98c4efd:::benchmark_data_smithi018_166993_object37415:head# 2024-02-10T08:39:33.277 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.277 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a98d0f4e:::benchmark_data_smithi018_166993_object40200:head# 2024-02-10T08:39:33.277 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.277 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a98f38bd:::benchmark_data_smithi018_166993_object21913:head# 2024-02-10T08:39:33.277 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.277 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a98fa65b:::benchmark_data_smithi018_166993_object19239:head# 2024-02-10T08:39:33.277 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.277 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a98fb1ba:::benchmark_data_smithi018_166993_object107323:head# 2024-02-10T08:39:33.277 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.277 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a98fe235:::benchmark_data_smithi018_166993_object89691:head# 2024-02-10T08:39:33.277 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.277 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a990d0b3:::benchmark_data_smithi018_166993_object55335:head# 2024-02-10T08:39:33.277 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.278 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a992f1b4:::benchmark_data_smithi018_166993_object36475:head# 2024-02-10T08:39:33.278 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.278 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9939023:::benchmark_data_smithi018_166993_object73661:head# 2024-02-10T08:39:33.278 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.278 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a993e23a:::benchmark_data_smithi018_166993_object115313:head# 2024-02-10T08:39:33.278 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.280 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9962d07:::benchmark_data_smithi018_166993_object60136:head# 2024-02-10T08:39:33.280 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.280 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9967386:::benchmark_data_smithi018_166993_object91088:head# 2024-02-10T08:39:33.280 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.280 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9973674:::benchmark_data_smithi018_166993_object85505:head# 2024-02-10T08:39:33.280 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.280 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9973ca4:::benchmark_data_smithi018_166993_object97135:head# 2024-02-10T08:39:33.280 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.280 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a998869b:::benchmark_data_smithi018_166993_object79287:head# 2024-02-10T08:39:33.280 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.280 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a998c71a:::benchmark_data_smithi018_166993_object73117:head# 2024-02-10T08:39:33.280 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.280 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a998c98b:::benchmark_data_smithi018_166993_object116315:head# 2024-02-10T08:39:33.281 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.281 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a999e1df:::benchmark_data_smithi018_166993_object43133:head# 2024-02-10T08:39:33.281 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.281 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a99b233a:::benchmark_data_smithi018_166993_object103054:head# 2024-02-10T08:39:33.281 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.281 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a99ba70d:::benchmark_data_smithi018_166993_object89583:head# 2024-02-10T08:39:33.281 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.281 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a99be3ae:::benchmark_data_smithi018_166993_object32550:head# 2024-02-10T08:39:33.281 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.282 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a99c1e72:::benchmark_data_smithi018_166993_object30264:head# 2024-02-10T08:39:33.282 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.282 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a99d178e:::benchmark_data_smithi018_166993_object55936:head# 2024-02-10T08:39:33.282 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.282 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a99e1c4b:::benchmark_data_smithi018_166993_object61420:head# 2024-02-10T08:39:33.282 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.282 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a99ea048:::benchmark_data_smithi018_166993_object63143:head# 2024-02-10T08:39:33.283 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.283 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a99ead2f:::benchmark_data_smithi018_166993_object80785:head# 2024-02-10T08:39:33.283 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.283 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a99eda19:::benchmark_data_smithi018_166993_object32873:head# 2024-02-10T08:39:33.283 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.283 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a99f23cd:::benchmark_data_smithi018_166993_object85783:head# 2024-02-10T08:39:33.283 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.283 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9a0c18d:::benchmark_data_smithi018_166993_object65303:head# 2024-02-10T08:39:33.283 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.283 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9a0da72:::benchmark_data_smithi018_166993_object27629:head# 2024-02-10T08:39:33.283 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.284 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9a1bafe:::benchmark_data_smithi018_166993_object102071:head# 2024-02-10T08:39:33.284 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.286 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9a21f06:::benchmark_data_smithi018_166993_object58657:head# 2024-02-10T08:39:33.286 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.286 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9a21f9e:::benchmark_data_smithi018_166993_object41573:head# 2024-02-10T08:39:33.286 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.288 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9a243d9:::benchmark_data_smithi018_166993_object58977:head# 2024-02-10T08:39:33.288 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.288 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9a4e17c:::benchmark_data_smithi018_166993_object20235:head# 2024-02-10T08:39:33.289 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.289 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9a51f51:::benchmark_data_smithi018_166993_object31731:head# 2024-02-10T08:39:33.289 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.289 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9a58755:::benchmark_data_smithi018_166993_object59931:head# 2024-02-10T08:39:33.290 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.292 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9a58cb1:::benchmark_data_smithi018_166993_object17922:head# 2024-02-10T08:39:33.292 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.294 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9a67399:::benchmark_data_smithi018_166993_object87328:head# 2024-02-10T08:39:33.295 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.295 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9a6c8a9:::benchmark_data_smithi018_166993_object88045:head# 2024-02-10T08:39:33.295 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.295 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9a738d2:::benchmark_data_smithi018_166993_object74879:head# 2024-02-10T08:39:33.295 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.295 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9a7a9d7:::benchmark_data_smithi018_166993_object87074:head# 2024-02-10T08:39:33.295 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.295 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9a9dd63:::benchmark_data_smithi018_166993_object66904:head# 2024-02-10T08:39:33.295 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.295 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9aa6fa7:::benchmark_data_smithi018_166993_object78455:head# 2024-02-10T08:39:33.295 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.296 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9ad3fc4:::benchmark_data_smithi018_166993_object98281:head# 2024-02-10T08:39:33.296 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.296 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9ada2f9:::benchmark_data_smithi018_166993_object90934:head# 2024-02-10T08:39:33.296 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.297 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9af258d:::benchmark_data_smithi018_166993_object83777:head# 2024-02-10T08:39:33.297 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.297 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9afbdbf:::benchmark_data_smithi018_166993_object111864:head# 2024-02-10T08:39:33.297 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.297 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9afc3b5:::benchmark_data_smithi018_166993_object78550:head# 2024-02-10T08:39:33.297 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.297 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9b02111:::benchmark_data_smithi018_166993_object110864:head# 2024-02-10T08:39:33.297 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.298 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9b17d87:::benchmark_data_smithi018_166993_object104603:head# 2024-02-10T08:39:33.298 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.298 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9b33702:::benchmark_data_smithi018_166993_object103641:head# 2024-02-10T08:39:33.298 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.300 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9b378c4:::benchmark_data_smithi018_166993_object34889:head# 2024-02-10T08:39:33.300 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.300 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9b3ffd5:::benchmark_data_smithi018_166993_object60794:head# 2024-02-10T08:39:33.300 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.300 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9b48635:::benchmark_data_smithi018_166993_object89931:head# 2024-02-10T08:39:33.300 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.301 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9b4d16f:::benchmark_data_smithi018_166993_object84483:head# 2024-02-10T08:39:33.301 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.301 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9b57e5f:::benchmark_data_smithi018_166993_object111202:head# 2024-02-10T08:39:33.301 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.302 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9b62e1b:::benchmark_data_smithi018_166993_object76914:head# 2024-02-10T08:39:33.302 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.305 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9b67c3a:::benchmark_data_smithi018_166993_object32113:head# 2024-02-10T08:39:33.305 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.305 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9b68564:::benchmark_data_smithi018_166993_object107646:head# 2024-02-10T08:39:33.305 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.305 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9b7a026:::benchmark_data_smithi018_166993_object114279:head# 2024-02-10T08:39:33.305 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.305 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9b7d88e:::benchmark_data_smithi018_166993_object47064:head# 2024-02-10T08:39:33.305 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.305 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9b8269e:::benchmark_data_smithi018_166993_object45473:head# 2024-02-10T08:39:33.306 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.306 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9b85d01:::benchmark_data_smithi018_166993_object113321:head# 2024-02-10T08:39:33.306 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.306 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9b9b9e1:::benchmark_data_smithi018_166993_object58051:head# 2024-02-10T08:39:33.306 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.306 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9b9c5d1:::benchmark_data_smithi018_166993_object93044:head# 2024-02-10T08:39:33.306 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.306 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9bb0f69:::benchmark_data_smithi018_166993_object97535:head# 2024-02-10T08:39:33.306 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.306 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9bb872f:::benchmark_data_smithi018_166993_object55932:head# 2024-02-10T08:39:33.306 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.307 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9bc31f2:::benchmark_data_smithi018_166993_object68676:head# 2024-02-10T08:39:33.307 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.307 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9bcce9a:::benchmark_data_smithi018_166993_object35113:head# 2024-02-10T08:39:33.307 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.308 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9be362e:::benchmark_data_smithi018_166993_object60791:head# 2024-02-10T08:39:33.308 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.308 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9be3edb:::benchmark_data_smithi018_166993_object115872:head# 2024-02-10T08:39:33.308 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.308 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9be4215:::benchmark_data_smithi018_166993_object114333:head# 2024-02-10T08:39:33.308 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.308 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9bf27f1:::benchmark_data_smithi018_166993_object104586:head# 2024-02-10T08:39:33.308 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.308 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9c0e8f9:::benchmark_data_smithi018_166993_object35644:head# 2024-02-10T08:39:33.309 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.310 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9c13eb0:::benchmark_data_smithi018_166993_object54918:head# 2024-02-10T08:39:33.310 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.313 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9c2c2d8:::benchmark_data_smithi018_166993_object107482:head# 2024-02-10T08:39:33.313 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.313 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9c3aa68:::benchmark_data_smithi018_166993_object65927:head# 2024-02-10T08:39:33.313 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.313 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9c43e34:::benchmark_data_smithi018_166993_object37962:head# 2024-02-10T08:39:33.313 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.313 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9c52903:::benchmark_data_smithi018_166993_object74122:head# 2024-02-10T08:39:33.313 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.313 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9c5480b:::benchmark_data_smithi018_166993_object58432:head# 2024-02-10T08:39:33.313 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.313 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9c5962c:::benchmark_data_smithi018_166993_object38891:head# 2024-02-10T08:39:33.313 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.313 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9c5e1df:::benchmark_data_smithi018_166993_object103393:head# 2024-02-10T08:39:33.313 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.314 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9c61339:::benchmark_data_smithi018_166993_object39544:head# 2024-02-10T08:39:33.314 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.314 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9c6d697:::benchmark_data_smithi018_166993_object76848:head# 2024-02-10T08:39:33.314 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.314 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9c76d1b:::benchmark_data_smithi018_166993_object39558:head# 2024-02-10T08:39:33.314 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.315 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9c77ca8:::benchmark_data_smithi018_166993_object69401:head# 2024-02-10T08:39:33.315 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.315 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9c8b6ab:::benchmark_data_smithi018_166993_object59666:head# 2024-02-10T08:39:33.315 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.315 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9c9be74:::benchmark_data_smithi018_166993_object68843:head# 2024-02-10T08:39:33.316 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.316 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9ca9980:::benchmark_data_smithi018_166993_object18500:head# 2024-02-10T08:39:33.316 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.316 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9cae703:::benchmark_data_smithi018_166993_object68111:head# 2024-02-10T08:39:33.316 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.316 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9cb1051:::benchmark_data_smithi018_166993_object97277:head# 2024-02-10T08:39:33.316 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.316 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9cb1af5:::benchmark_data_smithi018_166993_object93401:head# 2024-02-10T08:39:33.316 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.317 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9cb9708:::benchmark_data_smithi018_166993_object86808:head# 2024-02-10T08:39:33.317 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.317 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9cd7c99:::benchmark_data_smithi018_166993_object36626:head# 2024-02-10T08:39:33.317 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.317 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9cea8d1:::benchmark_data_smithi018_166993_object56762:head# 2024-02-10T08:39:33.317 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.317 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9ceae03:::benchmark_data_smithi018_166993_object85840:head# 2024-02-10T08:39:33.317 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.317 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9d0d8c7:::benchmark_data_smithi018_166993_object83626:head# 2024-02-10T08:39:33.317 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.318 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9d0e1ca:::benchmark_data_smithi018_166993_object108201:head# 2024-02-10T08:39:33.318 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.318 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9d15f6c:::benchmark_data_smithi018_166993_object99657:head# 2024-02-10T08:39:33.318 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.319 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9d1df4e:::benchmark_data_smithi018_166993_object46898:head# 2024-02-10T08:39:33.319 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.319 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9d1f17f:::benchmark_data_smithi018_166993_object26697:head# 2024-02-10T08:39:33.319 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.319 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9d21db2:::benchmark_data_smithi018_166993_object116444:head# 2024-02-10T08:39:33.320 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.320 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9d2b550:::benchmark_data_smithi018_166993_object87732:head# 2024-02-10T08:39:33.320 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.320 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9d3546f:::benchmark_data_smithi018_166993_object25908:head# 2024-02-10T08:39:33.320 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.320 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9d3a367:::benchmark_data_smithi018_166993_object111925:head# 2024-02-10T08:39:33.320 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.320 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9d3fe05:::benchmark_data_smithi018_166993_object72064:head# 2024-02-10T08:39:33.320 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.320 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9d44480:::benchmark_data_smithi018_166993_object97833:head# 2024-02-10T08:39:33.320 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.320 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9d4fd89:::benchmark_data_smithi018_166993_object94001:head# 2024-02-10T08:39:33.320 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.322 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9d5744b:::benchmark_data_smithi018_166993_object33096:head# 2024-02-10T08:39:33.322 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.322 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9d5a2e2:::benchmark_data_smithi018_166993_object42744:head# 2024-02-10T08:39:33.322 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.322 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9d61b8a:::benchmark_data_smithi018_166993_object83611:head# 2024-02-10T08:39:33.322 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.322 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9d6cbb2:::benchmark_data_smithi018_166993_object51433:head# 2024-02-10T08:39:33.323 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.323 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9d6e9c9:::benchmark_data_smithi018_166993_object83356:head# 2024-02-10T08:39:33.323 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.323 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9d9293d:::benchmark_data_smithi018_166993_object47712:head# 2024-02-10T08:39:33.323 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.323 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9d9bd52:::benchmark_data_smithi018_166993_object35398:head# 2024-02-10T08:39:33.323 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.323 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9da8674:::benchmark_data_smithi018_166993_object65054:head# 2024-02-10T08:39:33.323 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.323 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9dac983:::benchmark_data_smithi018_166993_object118663:head# 2024-02-10T08:39:33.323 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.323 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9dbcc60:::benchmark_data_smithi018_166993_object20500:head# 2024-02-10T08:39:33.323 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.324 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9dbedfe:::benchmark_data_smithi018_166993_object42185:head# 2024-02-10T08:39:33.324 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.324 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9dc00c2:::benchmark_data_smithi018_166993_object57868:head# 2024-02-10T08:39:33.324 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.324 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9dc4ebf:::benchmark_data_smithi018_166993_object75326:head# 2024-02-10T08:39:33.324 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.325 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9dccea2:::benchmark_data_smithi018_166993_object88270:head# 2024-02-10T08:39:33.325 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.326 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9dcee60:::benchmark_data_smithi018_166993_object52232:head# 2024-02-10T08:39:33.326 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.326 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9ddae98:::benchmark_data_smithi018_166993_object111677:head# 2024-02-10T08:39:33.327 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.327 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9de39d8:::benchmark_data_smithi018_166993_object116236:head# 2024-02-10T08:39:33.327 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.327 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9dfe1cb:::benchmark_data_smithi018_166993_object95063:head# 2024-02-10T08:39:33.327 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.328 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9e0022b:::benchmark_data_smithi018_166993_object78168:head# 2024-02-10T08:39:33.328 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.328 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9e18fdb:::benchmark_data_smithi018_166993_object57618:head# 2024-02-10T08:39:33.328 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.328 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9e1924d:::benchmark_data_smithi018_166993_object20157:head# 2024-02-10T08:39:33.328 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.330 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9e1ac86:::benchmark_data_smithi018_166993_object89383:head# 2024-02-10T08:39:33.330 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.330 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9e2bf4f:::benchmark_data_smithi018_166993_object107550:head# 2024-02-10T08:39:33.330 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.331 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9e398fd:::benchmark_data_smithi018_166993_object100961:head# 2024-02-10T08:39:33.331 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.334 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9e43e7c:::benchmark_data_smithi018_166993_object80045:head# 2024-02-10T08:39:33.334 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.334 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9e53dd3:::benchmark_data_smithi018_166993_object84430:head# 2024-02-10T08:39:33.334 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.334 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9e5df2b:::benchmark_data_smithi018_166993_object90986:head# 2024-02-10T08:39:33.334 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.334 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9e62b11:::benchmark_data_smithi018_166993_object46160:head# 2024-02-10T08:39:33.334 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.334 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9e674bd:::benchmark_data_smithi018_166993_object22985:head# 2024-02-10T08:39:33.334 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.334 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9e6c355:::benchmark_data_smithi018_166993_object90009:head# 2024-02-10T08:39:33.334 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.335 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9e6d296:::benchmark_data_smithi018_166993_object43542:head# 2024-02-10T08:39:33.335 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.335 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9e6fbc8:::benchmark_data_smithi018_166993_object71862:head# 2024-02-10T08:39:33.335 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.335 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9e77449:::benchmark_data_smithi018_166993_object35631:head# 2024-02-10T08:39:33.335 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.335 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9e8723d:::benchmark_data_smithi018_166993_object113032:head# 2024-02-10T08:39:33.335 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.337 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9e8aafe:::benchmark_data_smithi018_166993_object79781:head# 2024-02-10T08:39:33.337 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.337 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9eaa80b:::benchmark_data_smithi018_166993_object32394:head# 2024-02-10T08:39:33.337 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.337 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9eab218:::benchmark_data_smithi018_166993_object60510:head# 2024-02-10T08:39:33.337 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.337 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9eb90b9:::benchmark_data_smithi018_166993_object79984:head# 2024-02-10T08:39:33.337 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.338 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9eba004:::benchmark_data_smithi018_166993_object26076:head# 2024-02-10T08:39:33.338 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.338 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9eba50b:::benchmark_data_smithi018_166993_object94841:head# 2024-02-10T08:39:33.338 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.338 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9ec0b34:::benchmark_data_smithi018_166993_object52478:head# 2024-02-10T08:39:33.338 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.338 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9eed4e6:::benchmark_data_smithi018_166993_object108259:head# 2024-02-10T08:39:33.338 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.338 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9ef6b3c:::benchmark_data_smithi018_166993_object80614:head# 2024-02-10T08:39:33.338 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.338 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9f03030:::benchmark_data_smithi018_166993_object75240:head# 2024-02-10T08:39:33.338 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.338 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9f258e5:::benchmark_data_smithi018_166993_object84847:head# 2024-02-10T08:39:33.338 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.339 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9f27a26:::benchmark_data_smithi018_166993_object65254:head# 2024-02-10T08:39:33.339 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.340 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9f31949:::benchmark_data_smithi018_166993_object41535:head# 2024-02-10T08:39:33.340 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.340 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9f49890:::benchmark_data_smithi018_166993_object116947:head# 2024-02-10T08:39:33.340 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.340 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9f5053f:::benchmark_data_smithi018_166993_object46527:head# 2024-02-10T08:39:33.340 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.341 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9f5af58:::benchmark_data_smithi018_166993_object78094:head# 2024-02-10T08:39:33.341 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.341 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9f5d2c8:::benchmark_data_smithi018_166993_object43381:head# 2024-02-10T08:39:33.341 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.341 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9f7c50d:::benchmark_data_smithi018_166993_object108331:head# 2024-02-10T08:39:33.341 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.342 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9f7f3ac:::benchmark_data_smithi018_166993_object94407:head# 2024-02-10T08:39:33.342 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.342 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9f8103a:::benchmark_data_smithi018_166993_object101689:head# 2024-02-10T08:39:33.342 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.342 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9f86b07:::benchmark_data_smithi018_166993_object96220:head# 2024-02-10T08:39:33.342 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.343 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9f86d71:::benchmark_data_smithi018_166993_object92303:head# 2024-02-10T08:39:33.343 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.343 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9f920d6:::benchmark_data_smithi018_166993_object92930:head# 2024-02-10T08:39:33.343 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.344 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9facbe1:::benchmark_data_smithi018_166993_object42487:head# 2024-02-10T08:39:33.344 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.344 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9fafac0:::benchmark_data_smithi018_166993_object99875:head# 2024-02-10T08:39:33.344 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.344 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9fb03dd:::benchmark_data_smithi018_166993_object76115:head# 2024-02-10T08:39:33.344 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.344 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9fc72ba:::benchmark_data_smithi018_166993_object27325:head# 2024-02-10T08:39:33.344 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.344 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9fc78f5:::benchmark_data_smithi018_166993_object74678:head# 2024-02-10T08:39:33.344 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.345 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9fcf302:::benchmark_data_smithi018_166993_object22183:head# 2024-02-10T08:39:33.345 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.345 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9fdaa52:::benchmark_data_smithi018_166993_object84526:head# 2024-02-10T08:39:33.345 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.346 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:a9fe635a:::benchmark_data_smithi018_166993_object110809:head# 2024-02-10T08:39:33.347 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.349 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa01be89:::benchmark_data_smithi018_166993_object60474:head# 2024-02-10T08:39:33.349 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.349 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa035c1f:::benchmark_data_smithi018_166993_object100002:head# 2024-02-10T08:39:33.349 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.350 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa03bd26:::benchmark_data_smithi018_166993_object28096:head# 2024-02-10T08:39:33.350 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.351 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa045628:::benchmark_data_smithi018_166993_object35828:head# 2024-02-10T08:39:33.351 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.351 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa045f0c:::benchmark_data_smithi018_166993_object86880:head# 2024-02-10T08:39:33.351 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.351 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa046b37:::benchmark_data_smithi018_166993_object75955:head# 2024-02-10T08:39:33.351 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.351 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa05f2c8:::benchmark_data_smithi018_166993_object106118:head# 2024-02-10T08:39:33.351 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.352 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa0667ab:::benchmark_data_smithi018_166993_object103377:head# 2024-02-10T08:39:33.353 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.353 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa077772:::benchmark_data_smithi018_166993_object45741:head# 2024-02-10T08:39:33.353 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.353 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa079bf7:::benchmark_data_smithi018_166993_object108559:head# 2024-02-10T08:39:33.353 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.353 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa088762:::benchmark_data_smithi018_166993_object34122:head# 2024-02-10T08:39:33.353 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.353 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa0a3288:::benchmark_data_smithi018_166993_object88850:head# 2024-02-10T08:39:33.353 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.353 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa0a385e:::benchmark_data_smithi018_166993_object47545:head# 2024-02-10T08:39:33.353 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.353 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa0aeae9:::benchmark_data_smithi018_166993_object91087:head# 2024-02-10T08:39:33.353 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.354 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa0b3545:::benchmark_data_smithi018_166993_object75265:head# 2024-02-10T08:39:33.354 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.355 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa0befae:::benchmark_data_smithi018_166993_object66771:head# 2024-02-10T08:39:33.355 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.355 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa0c23b1:::benchmark_data_smithi018_166993_object32829:head# 2024-02-10T08:39:33.355 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.355 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa0c362e:::benchmark_data_smithi018_166993_object29503:head# 2024-02-10T08:39:33.355 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.355 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa0d4f58:::benchmark_data_smithi018_166993_object50579:head# 2024-02-10T08:39:33.355 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.355 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa0df995:::benchmark_data_smithi018_166993_object91897:head# 2024-02-10T08:39:33.355 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.356 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa0f2e2c:::benchmark_data_smithi018_166993_object77665:head# 2024-02-10T08:39:33.356 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.356 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa0f4a5e:::benchmark_data_smithi018_166993_object60813:head# 2024-02-10T08:39:33.356 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.356 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa0ffe1b:::benchmark_data_smithi018_166993_object109397:head# 2024-02-10T08:39:33.356 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.357 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa107694:::benchmark_data_smithi018_166993_object49866:head# 2024-02-10T08:39:33.357 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.358 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa118da2:::benchmark_data_smithi018_166993_object20725:head# 2024-02-10T08:39:33.358 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.358 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa126bc6:::benchmark_data_smithi018_166993_object88355:head# 2024-02-10T08:39:33.358 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.358 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa13ff4f:::benchmark_data_smithi018_166993_object94912:head# 2024-02-10T08:39:33.358 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.359 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa1405b8:::benchmark_data_smithi018_166993_object19993:head# 2024-02-10T08:39:33.360 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.360 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa1441ea:::benchmark_data_smithi018_166993_object78609:head# 2024-02-10T08:39:33.360 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.360 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa16891b:::benchmark_data_smithi018_166993_object116904:head# 2024-02-10T08:39:33.360 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.360 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa17a7b9:::benchmark_data_smithi018_166993_object20617:head# 2024-02-10T08:39:33.360 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.360 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa17e97e:::benchmark_data_smithi018_166993_object78860:head# 2024-02-10T08:39:33.360 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.360 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa187d38:::benchmark_data_smithi018_166993_object80619:head# 2024-02-10T08:39:33.360 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.361 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa187f1c:::benchmark_data_smithi018_166993_object36150:head# 2024-02-10T08:39:33.361 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.361 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa18c380:::benchmark_data_smithi018_166993_object51091:head# 2024-02-10T08:39:33.361 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.361 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa1a0575:::benchmark_data_smithi018_166993_object17505:head# 2024-02-10T08:39:33.362 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.362 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa1a2b57:::benchmark_data_smithi018_166993_object21178:head# 2024-02-10T08:39:33.362 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.362 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa1aabcf:::benchmark_data_smithi018_166993_object100965:head# 2024-02-10T08:39:33.362 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.363 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa1ac32d:::benchmark_data_smithi018_166993_object76605:head# 2024-02-10T08:39:33.363 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.363 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa1c63f7:::benchmark_data_smithi018_166993_object67197:head# 2024-02-10T08:39:33.363 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.363 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa1da48c:::benchmark_data_smithi018_166993_object21011:head# 2024-02-10T08:39:33.363 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.363 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa1da723:::benchmark_data_smithi018_166993_object79859:head# 2024-02-10T08:39:33.363 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.365 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa1dc0f3:::benchmark_data_smithi018_166993_object46047:head# 2024-02-10T08:39:33.365 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.365 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa1e25c7:::benchmark_data_smithi018_166993_object88779:head# 2024-02-10T08:39:33.365 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.365 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa1e3e4f:::benchmark_data_smithi018_166993_object66383:head# 2024-02-10T08:39:33.365 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.365 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa1e7f5e:::benchmark_data_smithi018_166993_object27640:head# 2024-02-10T08:39:33.366 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.366 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa1e8f06:::benchmark_data_smithi018_166993_object39581:head# 2024-02-10T08:39:33.366 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.366 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa1f6a70:::benchmark_data_smithi018_166993_object41289:head# 2024-02-10T08:39:33.366 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.366 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa1fd247:::benchmark_data_smithi018_166993_object53085:head# 2024-02-10T08:39:33.366 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.366 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa2038cf:::benchmark_data_smithi018_166993_object18728:head# 2024-02-10T08:39:33.366 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.366 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa208598:::benchmark_data_smithi018_166993_object46505:head# 2024-02-10T08:39:33.366 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.367 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa210668:::benchmark_data_smithi018_166993_object38569:head# 2024-02-10T08:39:33.367 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.367 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa21b588:::benchmark_data_smithi018_166993_object87780:head# 2024-02-10T08:39:33.367 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.367 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa234555:::benchmark_data_smithi018_166993_object62000:head# 2024-02-10T08:39:33.367 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.367 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa239db5:::benchmark_data_smithi018_166993_object31659:head# 2024-02-10T08:39:33.367 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.368 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa2432b2:::benchmark_data_smithi018_166993_object24867:head# 2024-02-10T08:39:33.368 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.368 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa249076:::benchmark_data_smithi018_166993_object59380:head# 2024-02-10T08:39:33.368 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.368 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa25efa0:::benchmark_data_smithi018_166993_object107075:head# 2024-02-10T08:39:33.368 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.368 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa264186:::benchmark_data_smithi018_166993_object67162:head# 2024-02-10T08:39:33.368 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.368 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa26a824:::benchmark_data_smithi018_166993_object41550:head# 2024-02-10T08:39:33.369 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.370 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa27677d:::benchmark_data_smithi018_166993_object105905:head# 2024-02-10T08:39:33.370 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.370 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa288eb0:::benchmark_data_smithi018_166993_object81099:head# 2024-02-10T08:39:33.370 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.370 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa293b30:::benchmark_data_smithi018_166993_object112031:head# 2024-02-10T08:39:33.370 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.370 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa2c5b79:::benchmark_data_smithi018_166993_object41320:head# 2024-02-10T08:39:33.370 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.370 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa2e0187:::benchmark_data_smithi018_166993_object83925:head# 2024-02-10T08:39:33.371 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.371 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa2e65e4:::benchmark_data_smithi018_166993_object41222:head# 2024-02-10T08:39:33.371 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.371 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa2effc8:::benchmark_data_smithi018_166993_object66062:head# 2024-02-10T08:39:33.371 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.371 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa2f2ce2:::benchmark_data_smithi018_166993_object44138:head# 2024-02-10T08:39:33.371 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.372 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa2f61a3:::benchmark_data_smithi018_166993_object82639:head# 2024-02-10T08:39:33.372 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.373 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa304ba5:::benchmark_data_smithi018_166993_object86443:head# 2024-02-10T08:39:33.373 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.373 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa30613e:::benchmark_data_smithi018_166993_object29707:head# 2024-02-10T08:39:33.373 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.374 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa30c8bc:::benchmark_data_smithi018_166993_object21503:head# 2024-02-10T08:39:33.375 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.375 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa30c9b1:::benchmark_data_smithi018_166993_object46922:head# 2024-02-10T08:39:33.375 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.375 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa31500f:::benchmark_data_smithi018_166993_object111673:head# 2024-02-10T08:39:33.375 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.375 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa31f211:::benchmark_data_smithi018_166993_object73681:head# 2024-02-10T08:39:33.375 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.375 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa321243:::benchmark_data_smithi018_166993_object45026:head# 2024-02-10T08:39:33.375 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.377 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa324730:::benchmark_data_smithi018_166993_object45642:head# 2024-02-10T08:39:33.377 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.377 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa33523b:::benchmark_data_smithi018_166993_object104627:head# 2024-02-10T08:39:33.377 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.377 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa339c5f:::benchmark_data_smithi018_166993_object42153:head# 2024-02-10T08:39:33.377 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.377 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa34c00a:::benchmark_data_smithi018_166993_object76199:head# 2024-02-10T08:39:33.377 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.377 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa365fbe:::benchmark_data_smithi018_166993_object87383:head# 2024-02-10T08:39:33.377 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.377 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa36984e:::benchmark_data_smithi018_166993_object81680:head# 2024-02-10T08:39:33.377 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.377 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa36d09b:::benchmark_data_smithi018_166993_object53137:head# 2024-02-10T08:39:33.378 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.378 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa37eb82:::benchmark_data_smithi018_166993_object113176:head# 2024-02-10T08:39:33.378 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.378 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa381b54:::benchmark_data_smithi018_166993_object47484:head# 2024-02-10T08:39:33.378 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.379 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa38bc37:::benchmark_data_smithi018_166993_object72078:head# 2024-02-10T08:39:33.379 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.379 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa39159c:::benchmark_data_smithi018_166993_object70381:head# 2024-02-10T08:39:33.379 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.379 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa397589:::benchmark_data_smithi018_166993_object86864:head# 2024-02-10T08:39:33.379 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.379 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa39e03a:::benchmark_data_smithi018_166993_object106788:head# 2024-02-10T08:39:33.380 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.380 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa3a423b:::benchmark_data_smithi018_166993_object21349:head# 2024-02-10T08:39:33.380 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.384 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa3aa59e:::benchmark_data_smithi018_166993_object36530:head# 2024-02-10T08:39:33.384 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.388 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa3bbba3:::benchmark_data_smithi018_166993_object95514:head# 2024-02-10T08:39:33.388 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.388 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa3e2eb2:::benchmark_data_smithi018_166993_object107956:head# 2024-02-10T08:39:33.388 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.388 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa3ef3a4:::benchmark_data_smithi018_166993_object90854:head# 2024-02-10T08:39:33.389 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.389 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa3f571b:::benchmark_data_smithi018_166993_object19006:head# 2024-02-10T08:39:33.389 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.390 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa407609:::benchmark_data_smithi018_166993_object43295:head# 2024-02-10T08:39:33.390 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.390 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa407e8b:::benchmark_data_smithi018_166993_object42120:head# 2024-02-10T08:39:33.390 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.390 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa40cadd:::benchmark_data_smithi018_166993_object57091:head# 2024-02-10T08:39:33.390 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.391 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa40f663:::benchmark_data_smithi018_166993_object35990:head# 2024-02-10T08:39:33.391 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.391 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa4165e9:::benchmark_data_smithi018_166993_object72915:head# 2024-02-10T08:39:33.391 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.391 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa43586d:::benchmark_data_smithi018_166993_object64728:head# 2024-02-10T08:39:33.391 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.391 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa443d0c:::benchmark_data_smithi018_166993_object26597:head# 2024-02-10T08:39:33.391 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.391 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa44f121:::benchmark_data_smithi018_166993_object42574:head# 2024-02-10T08:39:33.392 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.392 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa45d07f:::benchmark_data_smithi018_166993_object51316:head# 2024-02-10T08:39:33.392 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.393 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa461904:::benchmark_data_smithi018_166993_object95334:head# 2024-02-10T08:39:33.394 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.394 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa48081c:::benchmark_data_smithi018_166993_object67294:head# 2024-02-10T08:39:33.394 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.394 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa4b3c3d:::benchmark_data_smithi018_166993_object37234:head# 2024-02-10T08:39:33.394 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.395 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa4b47da:::benchmark_data_smithi018_166993_object32112:head# 2024-02-10T08:39:33.396 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.396 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa4b4e4d:::benchmark_data_smithi018_166993_object35101:head# 2024-02-10T08:39:33.396 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.396 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa500064:::benchmark_data_smithi018_166993_object39107:head# 2024-02-10T08:39:33.396 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.396 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa502b5c:::benchmark_data_smithi018_166993_object48069:head# 2024-02-10T08:39:33.396 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.396 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa50b731:::benchmark_data_smithi018_166993_object54671:head# 2024-02-10T08:39:33.396 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.396 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa513707:::benchmark_data_smithi018_166993_object56184:head# 2024-02-10T08:39:33.396 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.397 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa5139dc:::benchmark_data_smithi018_166993_object59691:head# 2024-02-10T08:39:33.397 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.400 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa51874f:::benchmark_data_smithi018_166993_object70879:head# 2024-02-10T08:39:33.400 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.400 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa520170:::benchmark_data_smithi018_166993_object54643:head# 2024-02-10T08:39:33.400 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.400 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa531d01:::benchmark_data_smithi018_166993_object95979:head# 2024-02-10T08:39:33.400 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.400 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa53570b:::benchmark_data_smithi018_166993_object88991:head# 2024-02-10T08:39:33.400 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.401 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa53c3b9:::benchmark_data_smithi018_166993_object54429:head# 2024-02-10T08:39:33.401 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.401 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa548c9c:::benchmark_data_smithi018_166993_object89696:head# 2024-02-10T08:39:33.401 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.401 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa58b580:::benchmark_data_smithi018_166993_object47122:head# 2024-02-10T08:39:33.401 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.402 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa58fd20:::benchmark_data_smithi018_166993_object58837:head# 2024-02-10T08:39:33.402 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.402 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa595c43:::benchmark_data_smithi018_166993_object38953:head# 2024-02-10T08:39:33.402 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.402 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa59a365:::benchmark_data_smithi018_166993_object34731:head# 2024-02-10T08:39:33.402 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.403 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa5a3fcc:::benchmark_data_smithi018_166993_object56048:head# 2024-02-10T08:39:33.403 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.403 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa5a95e1:::benchmark_data_smithi018_166993_object80318:head# 2024-02-10T08:39:33.403 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.405 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa5b4148:::benchmark_data_smithi018_166993_object57796:head# 2024-02-10T08:39:33.405 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.405 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa5b8264:::benchmark_data_smithi018_166993_object22165:head# 2024-02-10T08:39:33.405 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.407 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa5bf3a8:::benchmark_data_smithi018_166993_object95987:head# 2024-02-10T08:39:33.407 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.407 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa5c7bdf:::benchmark_data_smithi018_166993_object73873:head# 2024-02-10T08:39:33.408 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.408 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa5d1366:::benchmark_data_smithi018_166993_object85158:head# 2024-02-10T08:39:33.408 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.408 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa5d1e77:::benchmark_data_smithi018_166993_object96592:head# 2024-02-10T08:39:33.408 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.409 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa5d4ec4:::benchmark_data_smithi018_166993_object17917:head# 2024-02-10T08:39:33.409 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.409 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa5d7d01:::benchmark_data_smithi018_166993_object81012:head# 2024-02-10T08:39:33.410 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.410 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa5d9310:::benchmark_data_smithi018_166993_object105749:head# 2024-02-10T08:39:33.410 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.410 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa5eb535:::benchmark_data_smithi018_166993_object40400:head# 2024-02-10T08:39:33.410 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.410 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa601ff2:::benchmark_data_smithi018_166993_object86290:head# 2024-02-10T08:39:33.410 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.410 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa60c54d:::benchmark_data_smithi018_166993_object95999:head# 2024-02-10T08:39:33.410 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.411 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa60f63a:::benchmark_data_smithi018_166993_object61520:head# 2024-02-10T08:39:33.412 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.412 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa60f824:::benchmark_data_smithi018_166993_object21428:head# 2024-02-10T08:39:33.412 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.412 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa615ada:::benchmark_data_smithi018_166993_object46061:head# 2024-02-10T08:39:33.412 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.412 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa618bd8:::benchmark_data_smithi018_166993_object112995:head# 2024-02-10T08:39:33.412 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.412 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa6274c7:::benchmark_data_smithi018_166993_object32707:head# 2024-02-10T08:39:33.412 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.412 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa628284:::benchmark_data_smithi018_166993_object71619:head# 2024-02-10T08:39:33.412 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.412 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa62f0d3:::benchmark_data_smithi018_166993_object102332:head# 2024-02-10T08:39:33.413 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.414 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa63ed19:::benchmark_data_smithi018_166993_object108939:head# 2024-02-10T08:39:33.414 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.414 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa65843a:::benchmark_data_smithi018_166993_object118452:head# 2024-02-10T08:39:33.414 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.414 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa6586f1:::benchmark_data_smithi018_166993_object52972:head# 2024-02-10T08:39:33.414 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.414 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa660532:::benchmark_data_smithi018_166993_object29742:head# 2024-02-10T08:39:33.414 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.414 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa662996:::benchmark_data_smithi018_166993_object111980:head# 2024-02-10T08:39:33.414 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.414 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa66ea82:::benchmark_data_smithi018_166993_object77489:head# 2024-02-10T08:39:33.415 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.415 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa67f6e4:::benchmark_data_smithi018_166993_object38928:head# 2024-02-10T08:39:33.415 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.415 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa67ffc5:::benchmark_data_smithi018_166993_object33532:head# 2024-02-10T08:39:33.415 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.416 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa681c7d:::benchmark_data_smithi018_166993_object116970:head# 2024-02-10T08:39:33.416 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.416 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa683c20:::benchmark_data_smithi018_166993_object24988:head# 2024-02-10T08:39:33.416 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.416 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa686e1a:::benchmark_data_smithi018_166993_object107483:head# 2024-02-10T08:39:33.416 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.417 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa6baad0:::benchmark_data_smithi018_166993_object90409:head# 2024-02-10T08:39:33.417 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.417 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa6c320d:::benchmark_data_smithi018_166993_object38042:head# 2024-02-10T08:39:33.417 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.417 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa6cecd8:::benchmark_data_smithi018_166993_object95518:head# 2024-02-10T08:39:33.417 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.417 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa6d3005:::benchmark_data_smithi018_166993_object49815:head# 2024-02-10T08:39:33.417 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.417 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa6d4674:::benchmark_data_smithi018_166993_object52057:head# 2024-02-10T08:39:33.417 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.421 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa6e5cba:::benchmark_data_smithi018_166993_object55218:head# 2024-02-10T08:39:33.421 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.422 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa6e723a:::benchmark_data_smithi018_166993_object38681:head# 2024-02-10T08:39:33.422 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.423 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa6fe2fa:::benchmark_data_smithi018_166993_object62945:head# 2024-02-10T08:39:33.423 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.424 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa705714:::benchmark_data_smithi018_166993_object36552:head# 2024-02-10T08:39:33.424 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.424 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa7057ba:::benchmark_data_smithi018_166993_object34826:head# 2024-02-10T08:39:33.424 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.424 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa70adf4:::benchmark_data_smithi018_166993_object35156:head# 2024-02-10T08:39:33.425 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.426 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa710b61:::benchmark_data_smithi018_166993_object28628:head# 2024-02-10T08:39:33.426 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.426 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa7135b9:::benchmark_data_smithi018_166993_object92291:head# 2024-02-10T08:39:33.426 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.426 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa7240a5:::benchmark_data_smithi018_166993_object64988:head# 2024-02-10T08:39:33.426 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.426 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa724133:::benchmark_data_smithi018_166993_object29512:head# 2024-02-10T08:39:33.426 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.426 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa724f80:::benchmark_data_smithi018_166993_object70692:head# 2024-02-10T08:39:33.426 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.426 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa725db1:::benchmark_data_smithi018_166993_object32431:head# 2024-02-10T08:39:33.427 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.428 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa731dec:::benchmark_data_smithi018_166993_object46719:head# 2024-02-10T08:39:33.428 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.428 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa7336ee:::benchmark_data_smithi018_166993_object56444:head# 2024-02-10T08:39:33.428 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.428 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa733be7:::benchmark_data_smithi018_166993_object47526:head# 2024-02-10T08:39:33.428 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.428 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa734065:::benchmark_data_smithi018_166993_object115924:head# 2024-02-10T08:39:33.428 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.428 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa73b7b4:::benchmark_data_smithi018_166993_object102995:head# 2024-02-10T08:39:33.428 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.428 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa73e681:::benchmark_data_smithi018_166993_object88251:head# 2024-02-10T08:39:33.428 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.428 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa7450b8:::benchmark_data_smithi018_166993_object90562:head# 2024-02-10T08:39:33.429 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.429 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa74d82d:::benchmark_data_smithi018_166993_object118693:head# 2024-02-10T08:39:33.429 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.429 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa756f93:::benchmark_data_smithi018_166993_object35261:head# 2024-02-10T08:39:33.430 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.430 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa765611:::benchmark_data_smithi018_166993_object94748:head# 2024-02-10T08:39:33.430 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.430 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa765bd5:::benchmark_data_smithi018_166993_object88803:head# 2024-02-10T08:39:33.430 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.431 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa777265:::benchmark_data_smithi018_166993_object41461:head# 2024-02-10T08:39:33.431 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.431 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa79f478:::benchmark_data_smithi018_166993_object27861:head# 2024-02-10T08:39:33.431 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.431 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa7af430:::benchmark_data_smithi018_166993_object110961:head# 2024-02-10T08:39:33.431 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.431 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa7b902f:::benchmark_data_smithi018_166993_object105207:head# 2024-02-10T08:39:33.431 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.431 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa7c207c:::benchmark_data_smithi018_166993_object91279:head# 2024-02-10T08:39:33.432 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.432 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa7d17f2:::benchmark_data_smithi018_166993_object108650:head# 2024-02-10T08:39:33.432 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.432 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa7f2b57:::benchmark_data_smithi018_166993_object20468:head# 2024-02-10T08:39:33.432 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.432 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa7f64c0:::benchmark_data_smithi018_166993_object30316:head# 2024-02-10T08:39:33.432 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.433 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa80022e:::benchmark_data_smithi018_166993_object36317:head# 2024-02-10T08:39:33.433 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.433 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa80c378:::benchmark_data_smithi018_166993_object31685:head# 2024-02-10T08:39:33.433 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.437 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa81c5b6:::benchmark_data_smithi018_166993_object67412:head# 2024-02-10T08:39:33.437 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.437 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa82ff0d:::benchmark_data_smithi018_166993_object86255:head# 2024-02-10T08:39:33.438 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.443 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa838a18:::benchmark_data_smithi018_166993_object76111:head# 2024-02-10T08:39:33.443 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.443 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa83f6b0:::benchmark_data_smithi018_166993_object97416:head# 2024-02-10T08:39:33.443 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.449 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa848e4c:::benchmark_data_smithi018_166993_object30155:head# 2024-02-10T08:39:33.449 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.449 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa85b192:::benchmark_data_smithi018_166993_object58022:head# 2024-02-10T08:39:33.450 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.450 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa86d554:::benchmark_data_smithi018_166993_object34953:head# 2024-02-10T08:39:33.450 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.450 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa87bae2:::benchmark_data_smithi018_166993_object114386:head# 2024-02-10T08:39:33.450 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.450 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa8a758f:::benchmark_data_smithi018_166993_object119063:head# 2024-02-10T08:39:33.450 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.450 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa8b53db:::benchmark_data_smithi018_166993_object97916:head# 2024-02-10T08:39:33.450 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.450 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa8be363:::benchmark_data_smithi018_166993_object45456:head# 2024-02-10T08:39:33.450 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.450 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa8d5496:::benchmark_data_smithi018_166993_object114413:head# 2024-02-10T08:39:33.450 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.450 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa8d76dd:::benchmark_data_smithi018_166993_object49400:head# 2024-02-10T08:39:33.450 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.451 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa921338:::benchmark_data_smithi018_166993_object115941:head# 2024-02-10T08:39:33.451 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.451 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa92770c:::benchmark_data_smithi018_166993_object70216:head# 2024-02-10T08:39:33.451 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.451 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa93b16b:::benchmark_data_smithi018_166993_object77927:head# 2024-02-10T08:39:33.451 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.451 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa942d2d:::benchmark_data_smithi018_166993_object40495:head# 2024-02-10T08:39:33.451 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.451 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa94bdf5:::benchmark_data_smithi018_166993_object31015:head# 2024-02-10T08:39:33.451 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.451 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa95660a:::benchmark_data_smithi018_166993_object39397:head# 2024-02-10T08:39:33.451 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.451 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa959f74:::benchmark_data_smithi018_166993_object67936:head# 2024-02-10T08:39:33.451 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.451 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa95b83c:::benchmark_data_smithi018_166993_object66749:head# 2024-02-10T08:39:33.452 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.453 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa95f249:::benchmark_data_smithi018_166993_object111522:head# 2024-02-10T08:39:33.453 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.453 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa96e2a0:::benchmark_data_smithi018_166993_object66578:head# 2024-02-10T08:39:33.453 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.453 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa97375e:::benchmark_data_smithi018_166993_object92581:head# 2024-02-10T08:39:33.453 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.453 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa9773d6:::benchmark_data_smithi018_166993_object105066:head# 2024-02-10T08:39:33.453 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.453 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa984d17:::benchmark_data_smithi018_166993_object46016:head# 2024-02-10T08:39:33.453 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.454 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa989211:::benchmark_data_smithi018_166993_object55617:head# 2024-02-10T08:39:33.454 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.454 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa9943e2:::benchmark_data_smithi018_166993_object87138:head# 2024-02-10T08:39:33.454 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.454 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa99d487:::benchmark_data_smithi018_166993_object52263:head# 2024-02-10T08:39:33.454 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.454 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa99e7d3:::benchmark_data_smithi018_166993_object75295:head# 2024-02-10T08:39:33.454 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.454 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa9ab36d:::benchmark_data_smithi018_166993_object23490:head# 2024-02-10T08:39:33.454 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.454 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa9ac24c:::benchmark_data_smithi018_166993_object81255:head# 2024-02-10T08:39:33.454 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.454 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa9b20d5:::benchmark_data_smithi018_166993_object27881:head# 2024-02-10T08:39:33.454 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.455 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa9cbb51:::benchmark_data_smithi018_166993_object76409:head# 2024-02-10T08:39:33.455 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.455 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa9cbf68:::benchmark_data_smithi018_166993_object109844:head# 2024-02-10T08:39:33.455 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.457 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa9dcd62:::benchmark_data_smithi018_166993_object65507:head# 2024-02-10T08:39:33.457 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.457 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa9e2465:::benchmark_data_smithi018_166993_object87956:head# 2024-02-10T08:39:33.457 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.457 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa9e4de2:::benchmark_data_smithi018_166993_object43233:head# 2024-02-10T08:39:33.457 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.458 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa9ed701:::benchmark_data_smithi018_166993_object35094:head# 2024-02-10T08:39:33.458 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.458 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aa9f1c45:::benchmark_data_smithi018_166993_object32763:head# 2024-02-10T08:39:33.458 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.458 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aaa2b189:::benchmark_data_smithi018_166993_object71414:head# 2024-02-10T08:39:33.458 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.458 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aaa2b332:::benchmark_data_smithi018_166993_object48598:head# 2024-02-10T08:39:33.458 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.458 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aaa304f4:::benchmark_data_smithi018_166993_object88380:head# 2024-02-10T08:39:33.458 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.458 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aaa3598e:::benchmark_data_smithi018_166993_object116119:head# 2024-02-10T08:39:33.458 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.458 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aaa38602:::benchmark_data_smithi018_166993_object111113:head# 2024-02-10T08:39:33.458 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.459 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aaa4c83f:::benchmark_data_smithi018_166993_object43249:head# 2024-02-10T08:39:33.459 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.459 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aaa53295:::benchmark_data_smithi018_166993_object106767:head# 2024-02-10T08:39:33.459 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.459 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aaa575c1:::benchmark_data_smithi018_166993_object82640:head# 2024-02-10T08:39:33.459 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.459 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aaa619d1:::benchmark_data_smithi018_166993_object57551:head# 2024-02-10T08:39:33.459 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.459 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aaa6e428:::benchmark_data_smithi018_166993_object80553:head# 2024-02-10T08:39:33.459 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.464 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aaa6ebc4:::benchmark_data_smithi018_166993_object82141:head# 2024-02-10T08:39:33.465 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.465 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aaa74fa3:::benchmark_data_smithi018_166993_object35162:head# 2024-02-10T08:39:33.465 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.465 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aaa76509:::benchmark_data_smithi018_166993_object25764:head# 2024-02-10T08:39:33.465 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.465 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aaa7a8cb:::benchmark_data_smithi018_166993_object99483:head# 2024-02-10T08:39:33.465 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.465 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aaa8ea2a:::benchmark_data_smithi018_166993_object85383:head# 2024-02-10T08:39:33.465 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.465 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aaa96046:::benchmark_data_smithi018_166993_object23891:head# 2024-02-10T08:39:33.465 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.465 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aaa9bea9:::benchmark_data_smithi018_166993_object82978:head# 2024-02-10T08:39:33.465 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.465 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aaaad634:::benchmark_data_smithi018_166993_object89107:head# 2024-02-10T08:39:33.465 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.466 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aaab3f4f:::benchmark_data_smithi018_166993_object62261:head# 2024-02-10T08:39:33.466 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.466 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aaac8779:::benchmark_data_smithi018_166993_object46945:head# 2024-02-10T08:39:33.466 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.466 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aaad4545:::benchmark_data_smithi018_166993_object28507:head# 2024-02-10T08:39:33.466 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.466 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aaae2c90:::benchmark_data_smithi018_166993_object40188:head# 2024-02-10T08:39:33.466 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.466 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aaaf90ec:::benchmark_data_smithi018_166993_object68925:head# 2024-02-10T08:39:33.466 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.466 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aab08949:::benchmark_data_smithi018_166993_object113249:head# 2024-02-10T08:39:33.466 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.466 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aab0b29c:::benchmark_data_smithi018_166993_object95736:head# 2024-02-10T08:39:33.466 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.466 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aab10f29:::benchmark_data_smithi018_166993_object99254:head# 2024-02-10T08:39:33.466 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.467 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aab112da:::benchmark_data_smithi018_166993_object49770:head# 2024-02-10T08:39:33.467 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.467 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aab20ff7:::benchmark_data_smithi018_166993_object104933:head# 2024-02-10T08:39:33.467 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.467 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aab216a0:::benchmark_data_smithi018_166993_object64084:head# 2024-02-10T08:39:33.467 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.467 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aab2dcb4:::benchmark_data_smithi018_166993_object96742:head# 2024-02-10T08:39:33.467 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.467 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aab47445:::benchmark_data_smithi018_166993_object49409:head# 2024-02-10T08:39:33.467 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.467 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aab59d55:::benchmark_data_smithi018_166993_object28566:head# 2024-02-10T08:39:33.467 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.467 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aab5a54c:::benchmark_data_smithi018_166993_object92848:head# 2024-02-10T08:39:33.467 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.467 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aab5b981:::benchmark_data_smithi018_166993_object64794:head# 2024-02-10T08:39:33.468 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.468 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aab5f1fc:::benchmark_data_smithi018_166993_object46589:head# 2024-02-10T08:39:33.468 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.468 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aab5f5c4:::benchmark_data_smithi018_166993_object60372:head# 2024-02-10T08:39:33.468 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.468 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aab61116:::benchmark_data_smithi018_166993_object87028:head# 2024-02-10T08:39:33.468 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.468 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aab6ce21:::benchmark_data_smithi018_166993_object64494:head# 2024-02-10T08:39:33.468 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.468 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aab72946:::benchmark_data_smithi018_166993_object70153:head# 2024-02-10T08:39:33.468 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.469 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aab7aef6:::benchmark_data_smithi018_166993_object67837:head# 2024-02-10T08:39:33.469 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.469 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aab7da18:::benchmark_data_smithi018_166993_object98053:head# 2024-02-10T08:39:33.469 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.469 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aab8c524:::benchmark_data_smithi018_166993_object35218:head# 2024-02-10T08:39:33.469 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.470 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aab9e682:::benchmark_data_smithi018_166993_object44387:head# 2024-02-10T08:39:33.470 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.470 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aaba6cea:::benchmark_data_smithi018_166993_object97906:head# 2024-02-10T08:39:33.470 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.471 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aabb09ae:::benchmark_data_smithi018_166993_object37226:head# 2024-02-10T08:39:33.471 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.479 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aabb62a2:::benchmark_data_smithi018_166993_object64517:head# 2024-02-10T08:39:33.480 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.480 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aabd1013:::benchmark_data_smithi018_166993_object40647:head# 2024-02-10T08:39:33.480 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.480 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aabdb159:::benchmark_data_smithi018_166993_object27614:head# 2024-02-10T08:39:33.480 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.480 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aabdca53:::benchmark_data_smithi018_166993_object33736:head# 2024-02-10T08:39:33.480 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.480 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aabe2c27:::benchmark_data_smithi018_166993_object53987:head# 2024-02-10T08:39:33.480 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.480 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aabe3fb2:::benchmark_data_smithi018_166993_object46278:head# 2024-02-10T08:39:33.480 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.482 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aabe8341:::benchmark_data_smithi018_166993_object36872:head# 2024-02-10T08:39:33.482 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.487 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aabe8bc3:::benchmark_data_smithi018_166993_object73925:head# 2024-02-10T08:39:33.488 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.488 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aac0df21:::benchmark_data_smithi018_166993_object100015:head# 2024-02-10T08:39:33.488 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.488 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aac0e47b:::benchmark_data_smithi018_166993_object59310:head# 2024-02-10T08:39:33.488 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.488 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aac10133:::benchmark_data_smithi018_166993_object68006:head# 2024-02-10T08:39:33.488 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.488 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aac19197:::benchmark_data_smithi018_166993_object101732:head# 2024-02-10T08:39:33.488 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.488 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aac19bdf:::benchmark_data_smithi018_166993_object95646:head# 2024-02-10T08:39:33.488 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.488 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aac1b399:::benchmark_data_smithi018_166993_object74488:head# 2024-02-10T08:39:33.488 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.489 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aac1c7dc:::benchmark_data_smithi018_166993_object23120:head# 2024-02-10T08:39:33.489 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.489 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aac32808:::benchmark_data_smithi018_166993_object112491:head# 2024-02-10T08:39:33.489 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.489 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aac3cf84:::benchmark_data_smithi018_166993_object107836:head# 2024-02-10T08:39:33.489 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.489 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aac44cc0:::benchmark_data_smithi018_166993_object106536:head# 2024-02-10T08:39:33.489 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.489 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aac4707c:::benchmark_data_smithi018_166993_object19201:head# 2024-02-10T08:39:33.489 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.489 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aac5ad8f:::benchmark_data_smithi018_166993_object58180:head# 2024-02-10T08:39:33.489 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.489 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aac6aa0b:::benchmark_data_smithi018_166993_object97487:head# 2024-02-10T08:39:33.489 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.489 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aac7bcfc:::benchmark_data_smithi018_166993_object77332:head# 2024-02-10T08:39:33.490 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.490 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aac83c5f:::benchmark_data_smithi018_166993_object100278:head# 2024-02-10T08:39:33.490 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.490 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aac8ab89:::benchmark_data_smithi018_166993_object44517:head# 2024-02-10T08:39:33.490 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.491 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aaca1e2b:::benchmark_data_smithi018_166993_object53669:head# 2024-02-10T08:39:33.491 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.491 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aacdd187:::benchmark_data_smithi018_166993_object109201:head# 2024-02-10T08:39:33.492 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.492 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aace39f0:::benchmark_data_smithi018_166993_object45309:head# 2024-02-10T08:39:33.492 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.492 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aacf38d3:::benchmark_data_smithi018_166993_object84469:head# 2024-02-10T08:39:33.492 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.492 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aacf5aac:::benchmark_data_smithi018_166993_object77551:head# 2024-02-10T08:39:33.492 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.492 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aad03a25:::benchmark_data_smithi018_166993_object100050:head# 2024-02-10T08:39:33.492 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.492 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aad083c3:::benchmark_data_smithi018_166993_object39842:head# 2024-02-10T08:39:33.492 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.492 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aad08628:::benchmark_data_smithi018_166993_object49975:head# 2024-02-10T08:39:33.492 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.492 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aad2db10:::benchmark_data_smithi018_166993_object88474:head# 2024-02-10T08:39:33.492 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.496 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aad33442:::benchmark_data_smithi018_166993_object34927:head# 2024-02-10T08:39:33.496 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.496 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aad3dbba:::benchmark_data_smithi018_166993_object36632:head# 2024-02-10T08:39:33.496 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.496 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aad4f824:::benchmark_data_smithi018_166993_object28808:head# 2024-02-10T08:39:33.497 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.497 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aad5163c:::benchmark_data_smithi018_166993_object92341:head# 2024-02-10T08:39:33.497 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.497 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aad51c4e:::benchmark_data_smithi018_166993_object78825:head# 2024-02-10T08:39:33.497 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.512 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aad581f1:::benchmark_data_smithi018_166993_object108184:head# 2024-02-10T08:39:33.512 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.513 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aad5bcf6:::benchmark_data_smithi018_166993_object36667:head# 2024-02-10T08:39:33.513 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.513 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aad70d5e:::benchmark_data_smithi018_166993_object55521:head# 2024-02-10T08:39:33.513 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.513 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aad77eea:::benchmark_data_smithi018_166993_object58262:head# 2024-02-10T08:39:33.513 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.513 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aad7c564:::benchmark_data_smithi018_166993_object44793:head# 2024-02-10T08:39:33.513 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.513 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aad86082:::benchmark_data_smithi018_166993_object110886:head# 2024-02-10T08:39:33.513 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.513 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aad877bb:::benchmark_data_smithi018_166993_object78113:head# 2024-02-10T08:39:33.513 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.513 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aad9408a:::benchmark_data_smithi018_166993_object95248:head# 2024-02-10T08:39:33.513 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.514 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aada0740:::benchmark_data_smithi018_166993_object30986:head# 2024-02-10T08:39:33.514 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.514 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aadb2b9c:::benchmark_data_smithi018_166993_object60875:head# 2024-02-10T08:39:33.514 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.514 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aadb8faf:::benchmark_data_smithi018_166993_object55408:head# 2024-02-10T08:39:33.514 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.514 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aadce308:::benchmark_data_smithi018_166993_object73236:head# 2024-02-10T08:39:33.514 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.514 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aaddc4d7:::benchmark_data_smithi018_166993_object32013:head# 2024-02-10T08:39:33.514 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.514 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aadebf1d:::benchmark_data_smithi018_166993_object66807:head# 2024-02-10T08:39:33.514 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.514 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aadeeff5:::benchmark_data_smithi018_166993_object70495:head# 2024-02-10T08:39:33.514 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.516 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aadf2c3e:::benchmark_data_smithi018_166993_object71596:head# 2024-02-10T08:39:33.516 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.516 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aae034b5:::benchmark_data_smithi018_166993_object63027:head# 2024-02-10T08:39:33.516 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.516 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aae0f282:::benchmark_data_smithi018_166993_object54831:head# 2024-02-10T08:39:33.516 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.516 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aae0f857:::benchmark_data_smithi018_166993_object29344:head# 2024-02-10T08:39:33.516 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.516 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aae1d703:::benchmark_data_smithi018_166993_object104062:head# 2024-02-10T08:39:33.516 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.517 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aae2147d:::benchmark_data_smithi018_166993_object68000:head# 2024-02-10T08:39:33.517 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.517 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aae27c36:::benchmark_data_smithi018_166993_object91739:head# 2024-02-10T08:39:33.517 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.517 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aae29cc7:::benchmark_data_smithi018_166993_object85728:head# 2024-02-10T08:39:33.517 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.517 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aae351b6:::benchmark_data_smithi018_166993_object23849:head# 2024-02-10T08:39:33.517 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.517 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aae4ffda:::benchmark_data_smithi018_166993_object52877:head# 2024-02-10T08:39:33.517 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.517 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aae533d6:::benchmark_data_smithi018_166993_object53385:head# 2024-02-10T08:39:33.517 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.517 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aae5be52:::benchmark_data_smithi018_166993_object70382:head# 2024-02-10T08:39:33.517 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.517 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aae76de0:::benchmark_data_smithi018_166993_object66460:head# 2024-02-10T08:39:33.518 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.518 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aae7c3fa:::benchmark_data_smithi018_166993_object48824:head# 2024-02-10T08:39:33.518 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.518 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aae8d195:::benchmark_data_smithi018_166993_object59193:head# 2024-02-10T08:39:33.518 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.518 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aae8e794:::benchmark_data_smithi018_166993_object72734:head# 2024-02-10T08:39:33.518 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.518 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aaeb087e:::benchmark_data_smithi018_166993_object102244:head# 2024-02-10T08:39:33.518 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.518 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aaeb2a71:::benchmark_data_smithi018_166993_object80100:head# 2024-02-10T08:39:33.518 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.521 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aaeb5757:::benchmark_data_smithi018_166993_object17960:head# 2024-02-10T08:39:33.521 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.521 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aaeb7f59:::benchmark_data_smithi018_166993_object83207:head# 2024-02-10T08:39:33.521 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.521 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aaed4795:::benchmark_data_smithi018_166993_object85408:head# 2024-02-10T08:39:33.521 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.521 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aaf0a57a:::benchmark_data_smithi018_166993_object40046:head# 2024-02-10T08:39:33.521 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.521 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aaf0cbe6:::benchmark_data_smithi018_166993_object78921:head# 2024-02-10T08:39:33.521 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.521 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aaf0f09c:::benchmark_data_smithi018_166993_object27421:head# 2024-02-10T08:39:33.521 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.522 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aaf13a92:::benchmark_data_smithi018_166993_object75713:head# 2024-02-10T08:39:33.522 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.522 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aaf19ed3:::benchmark_data_smithi018_166993_object33671:head# 2024-02-10T08:39:33.522 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.522 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aaf36e8a:::benchmark_data_smithi018_166993_object101619:head# 2024-02-10T08:39:33.522 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.522 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aaf44776:::benchmark_data_smithi018_166993_object53997:head# 2024-02-10T08:39:33.522 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.522 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aaf6aa7e:::benchmark_data_smithi018_166993_object49495:head# 2024-02-10T08:39:33.522 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.522 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aaf6c354:::benchmark_data_smithi018_166993_object45734:head# 2024-02-10T08:39:33.522 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.522 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aaf84bf7:::benchmark_data_smithi018_166993_object44627:head# 2024-02-10T08:39:33.522 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.522 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aaf88544:::benchmark_data_smithi018_166993_object33878:head# 2024-02-10T08:39:33.523 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.523 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aaf9be00:::benchmark_data_smithi018_166993_object40305:head# 2024-02-10T08:39:33.523 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.523 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aafb9ef8:::benchmark_data_smithi018_166993_object81933:head# 2024-02-10T08:39:33.523 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.524 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aafc8f2e:::benchmark_data_smithi018_166993_object60383:head# 2024-02-10T08:39:33.524 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.524 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aafc9c67:::benchmark_data_smithi018_166993_object97018:head# 2024-02-10T08:39:33.524 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.524 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aafcbf23:::benchmark_data_smithi018_166993_object101100:head# 2024-02-10T08:39:33.524 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.524 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aafd1425:::benchmark_data_smithi018_166993_object90680:head# 2024-02-10T08:39:33.524 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.524 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aaffd94c:::benchmark_data_smithi018_166993_object101270:head# 2024-02-10T08:39:33.524 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.524 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab01506e:::benchmark_data_smithi018_166993_object51038:head# 2024-02-10T08:39:33.524 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.524 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab016ade:::benchmark_data_smithi018_166993_object96442:head# 2024-02-10T08:39:33.525 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.525 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab039167:::benchmark_data_smithi018_166993_object28885:head# 2024-02-10T08:39:33.525 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.525 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab03f5b4:::benchmark_data_smithi018_166993_object38988:head# 2024-02-10T08:39:33.525 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.525 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab0451af:::benchmark_data_smithi018_166993_object100154:head# 2024-02-10T08:39:33.525 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.526 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab04edf2:::benchmark_data_smithi018_166993_object72176:head# 2024-02-10T08:39:33.526 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.526 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab05c766:::benchmark_data_smithi018_166993_object79533:head# 2024-02-10T08:39:33.526 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.527 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab07b261:::benchmark_data_smithi018_166993_object61138:head# 2024-02-10T08:39:33.527 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.527 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab0858d0:::benchmark_data_smithi018_166993_object78842:head# 2024-02-10T08:39:33.527 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.529 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab0925ae:::benchmark_data_smithi018_166993_object84297:head# 2024-02-10T08:39:33.530 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.530 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab098317:::benchmark_data_smithi018_166993_object63387:head# 2024-02-10T08:39:33.530 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.530 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab0a3fb8:::benchmark_data_smithi018_166993_object50251:head# 2024-02-10T08:39:33.530 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.530 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab0a9443:::benchmark_data_smithi018_166993_object107552:head# 2024-02-10T08:39:33.530 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.530 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab0b9bed:::benchmark_data_smithi018_166993_object75744:head# 2024-02-10T08:39:33.530 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.530 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab0bafda:::benchmark_data_smithi018_166993_object58190:head# 2024-02-10T08:39:33.530 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.530 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab0c04c7:::benchmark_data_smithi018_166993_object76295:head# 2024-02-10T08:39:33.530 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.531 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab0c5624:::benchmark_data_smithi018_166993_object76082:head# 2024-02-10T08:39:33.531 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.531 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab0dcbf6:::benchmark_data_smithi018_166993_object102336:head# 2024-02-10T08:39:33.531 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.533 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab0e18f7:::benchmark_data_smithi018_166993_object63362:head# 2024-02-10T08:39:33.533 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.533 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab100e1b:::benchmark_data_smithi018_166993_object88913:head# 2024-02-10T08:39:33.533 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.533 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab101137:::benchmark_data_smithi018_166993_object80314:head# 2024-02-10T08:39:33.533 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.533 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab11a872:::benchmark_data_smithi018_166993_object83028:head# 2024-02-10T08:39:33.533 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.533 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab11c2bd:::benchmark_data_smithi018_166993_object83999:head# 2024-02-10T08:39:33.533 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.533 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab12fa38:::benchmark_data_smithi018_166993_object90910:head# 2024-02-10T08:39:33.533 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.534 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab136e77:::benchmark_data_smithi018_166993_object77529:head# 2024-02-10T08:39:33.534 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.534 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab145189:::benchmark_data_smithi018_166993_object36652:head# 2024-02-10T08:39:33.534 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.534 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab154064:::benchmark_data_smithi018_166993_object73888:head# 2024-02-10T08:39:33.534 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.534 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab1613e5:::benchmark_data_smithi018_166993_object26835:head# 2024-02-10T08:39:33.534 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.534 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab16db64:::benchmark_data_smithi018_166993_object42902:head# 2024-02-10T08:39:33.534 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.546 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab18137f:::benchmark_data_smithi018_166993_object53768:head# 2024-02-10T08:39:33.546 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.546 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab181e05:::benchmark_data_smithi018_166993_object60576:head# 2024-02-10T08:39:33.546 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.547 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab186402:::benchmark_data_smithi018_166993_object32092:head# 2024-02-10T08:39:33.547 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.547 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab1891c3:::benchmark_data_smithi018_166993_object30656:head# 2024-02-10T08:39:33.547 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.547 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab18b91a:::benchmark_data_smithi018_166993_object29746:head# 2024-02-10T08:39:33.547 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.547 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab18fda5:::benchmark_data_smithi018_166993_object110415:head# 2024-02-10T08:39:33.547 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.547 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab19b4ba:::benchmark_data_smithi018_166993_object91672:head# 2024-02-10T08:39:33.547 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.547 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab1a1a83:::benchmark_data_smithi018_166993_object114750:head# 2024-02-10T08:39:33.547 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.547 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab1a9a09:::benchmark_data_smithi018_166993_object22306:head# 2024-02-10T08:39:33.547 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.547 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab1af090:::benchmark_data_smithi018_166993_object45274:head# 2024-02-10T08:39:33.548 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.553 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab1b436a:::benchmark_data_smithi018_166993_object95918:head# 2024-02-10T08:39:33.553 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.554 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab1c8a65:::benchmark_data_smithi018_166993_object67565:head# 2024-02-10T08:39:33.554 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.554 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab1d1ec1:::benchmark_data_smithi018_166993_object45417:head# 2024-02-10T08:39:33.554 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.554 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab1d988b:::benchmark_data_smithi018_166993_object106781:head# 2024-02-10T08:39:33.555 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.555 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab1da637:::benchmark_data_smithi018_166993_object34785:head# 2024-02-10T08:39:33.555 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.555 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab1dde24:::benchmark_data_smithi018_166993_object20382:head# 2024-02-10T08:39:33.555 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.555 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab1e4f49:::benchmark_data_smithi018_166993_object45710:head# 2024-02-10T08:39:33.555 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.562 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab1e4feb:::benchmark_data_smithi018_166993_object28308:head# 2024-02-10T08:39:33.562 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.563 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab1f9324:::benchmark_data_smithi018_166993_object50416:head# 2024-02-10T08:39:33.563 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.564 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab20685f:::benchmark_data_smithi018_166993_object25853:head# 2024-02-10T08:39:33.564 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.565 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab217edc:::benchmark_data_smithi018_166993_object75875:head# 2024-02-10T08:39:33.565 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.565 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab223f22:::benchmark_data_smithi018_166993_object106734:head# 2024-02-10T08:39:33.565 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.566 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab2265cf:::benchmark_data_smithi018_166993_object36595:head# 2024-02-10T08:39:33.566 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.566 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab22f125:::benchmark_data_smithi018_166993_object69717:head# 2024-02-10T08:39:33.566 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.567 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab232a86:::benchmark_data_smithi018_166993_object33145:head# 2024-02-10T08:39:33.567 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.567 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab234b72:::benchmark_data_smithi018_166993_object98606:head# 2024-02-10T08:39:33.568 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.568 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab237a9b:::benchmark_data_smithi018_166993_object78238:head# 2024-02-10T08:39:33.568 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.568 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab23b930:::benchmark_data_smithi018_166993_object72143:head# 2024-02-10T08:39:33.568 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.568 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab23d132:::benchmark_data_smithi018_166993_object107102:head# 2024-02-10T08:39:33.568 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.568 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab242222:::benchmark_data_smithi018_166993_object59047:head# 2024-02-10T08:39:33.568 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.568 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab257263:::benchmark_data_smithi018_166993_object62327:head# 2024-02-10T08:39:33.568 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.568 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab259dcd:::benchmark_data_smithi018_166993_object45415:head# 2024-02-10T08:39:33.568 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.570 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab26dcf1:::benchmark_data_smithi018_166993_object100704:head# 2024-02-10T08:39:33.570 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.570 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab26fc3f:::benchmark_data_smithi018_166993_object90424:head# 2024-02-10T08:39:33.570 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.570 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab275bde:::benchmark_data_smithi018_166993_object95862:head# 2024-02-10T08:39:33.570 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.570 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab29d97d:::benchmark_data_smithi018_166993_object118355:head# 2024-02-10T08:39:33.570 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.571 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab29fb6e:::benchmark_data_smithi018_166993_object66675:head# 2024-02-10T08:39:33.571 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.571 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab2a0075:::benchmark_data_smithi018_166993_object100018:head# 2024-02-10T08:39:33.571 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.571 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab2b647f:::benchmark_data_smithi018_166993_object28858:head# 2024-02-10T08:39:33.571 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.571 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab2c04d5:::benchmark_data_smithi018_166993_object20044:head# 2024-02-10T08:39:33.571 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.571 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab2c2975:::benchmark_data_smithi018_166993_object116832:head# 2024-02-10T08:39:33.571 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.572 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab2d46bd:::benchmark_data_smithi018_166993_object66470:head# 2024-02-10T08:39:33.572 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.572 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab2d6dfe:::benchmark_data_smithi018_166993_object28359:head# 2024-02-10T08:39:33.572 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.572 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab2e809d:::benchmark_data_smithi018_166993_object19436:head# 2024-02-10T08:39:33.572 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.572 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab2eac56:::benchmark_data_smithi018_166993_object29429:head# 2024-02-10T08:39:33.572 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.573 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab315a1c:::benchmark_data_smithi018_166993_object103479:head# 2024-02-10T08:39:33.573 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.573 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab31c678:::benchmark_data_smithi018_166993_object64546:head# 2024-02-10T08:39:33.573 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.573 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab31ce46:::benchmark_data_smithi018_166993_object75805:head# 2024-02-10T08:39:33.573 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.573 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab32283d:::benchmark_data_smithi018_166993_object37569:head# 2024-02-10T08:39:33.573 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.575 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab3386ab:::benchmark_data_smithi018_166993_object98877:head# 2024-02-10T08:39:33.575 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.575 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab34528f:::benchmark_data_smithi018_166993_object83905:head# 2024-02-10T08:39:33.575 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.576 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab3616c8:::benchmark_data_smithi018_166993_object27658:head# 2024-02-10T08:39:33.576 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.576 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab361b5e:::benchmark_data_smithi018_166993_object58591:head# 2024-02-10T08:39:33.576 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.578 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab375377:::benchmark_data_smithi018_166993_object95389:head# 2024-02-10T08:39:33.578 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.578 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab38522f:::benchmark_data_smithi018_166993_object45925:head# 2024-02-10T08:39:33.578 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.578 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab394a42:::benchmark_data_smithi018_166993_object79377:head# 2024-02-10T08:39:33.578 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.578 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab39ca49:::benchmark_data_smithi018_166993_object83814:head# 2024-02-10T08:39:33.578 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.578 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab39efc4:::benchmark_data_smithi018_166993_object58687:head# 2024-02-10T08:39:33.578 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.578 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab3b033c:::benchmark_data_smithi018_166993_object96983:head# 2024-02-10T08:39:33.578 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.579 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab3b3b4a:::benchmark_data_smithi018_166993_object118219:head# 2024-02-10T08:39:33.579 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.579 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab3c4417:::benchmark_data_smithi018_166993_object116220:head# 2024-02-10T08:39:33.579 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.582 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab3c9185:::benchmark_data_smithi018_166993_object105513:head# 2024-02-10T08:39:33.582 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.584 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab3c98f0:::benchmark_data_smithi018_166993_object68081:head# 2024-02-10T08:39:33.584 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.585 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab3cf5a0:::benchmark_data_smithi018_166993_object95553:head# 2024-02-10T08:39:33.585 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.585 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab3dc98f:::benchmark_data_smithi018_166993_object40648:head# 2024-02-10T08:39:33.586 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.588 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab3e4d6f:::benchmark_data_smithi018_166993_object21308:head# 2024-02-10T08:39:33.588 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.590 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab3f609f:::benchmark_data_smithi018_166993_object45481:head# 2024-02-10T08:39:33.590 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.597 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab406844:::benchmark_data_smithi018_166993_object61128:head# 2024-02-10T08:39:33.597 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.597 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab41273f:::benchmark_data_smithi018_166993_object106179:head# 2024-02-10T08:39:33.597 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.597 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab4129ab:::benchmark_data_smithi018_166993_object50092:head# 2024-02-10T08:39:33.597 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.597 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab42d073:::benchmark_data_smithi018_166993_object73024:head# 2024-02-10T08:39:33.597 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.598 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab435b63:::benchmark_data_smithi018_166993_object87432:head# 2024-02-10T08:39:33.598 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.598 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab43c71b:::benchmark_data_smithi018_166993_object94647:head# 2024-02-10T08:39:33.598 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.598 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab43fe32:::benchmark_data_smithi018_166993_object28460:head# 2024-02-10T08:39:33.599 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.599 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab443beb:::benchmark_data_smithi018_166993_object74338:head# 2024-02-10T08:39:33.599 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.599 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab44a12d:::benchmark_data_smithi018_166993_object35306:head# 2024-02-10T08:39:33.599 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.600 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab44fb06:::benchmark_data_smithi018_166993_object50165:head# 2024-02-10T08:39:33.600 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.600 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab45d94a:::benchmark_data_smithi018_166993_object75099:head# 2024-02-10T08:39:33.600 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.600 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab467442:::benchmark_data_smithi018_166993_object37027:head# 2024-02-10T08:39:33.600 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.601 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab475d4a:::benchmark_data_smithi018_166993_object29565:head# 2024-02-10T08:39:33.601 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.601 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab49a5f8:::benchmark_data_smithi018_166993_object97622:head# 2024-02-10T08:39:33.601 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.601 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab4ed5b6:::benchmark_data_smithi018_166993_object100903:head# 2024-02-10T08:39:33.601 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.601 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab5031fc:::benchmark_data_smithi018_166993_object68277:head# 2024-02-10T08:39:33.601 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.602 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab509650:::benchmark_data_smithi018_166993_object72040:head# 2024-02-10T08:39:33.602 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.602 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab50e6fd:::benchmark_data_smithi018_166993_object100216:head# 2024-02-10T08:39:33.602 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.603 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab510118:::benchmark_data_smithi018_166993_object27199:head# 2024-02-10T08:39:33.603 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.603 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab511325:::benchmark_data_smithi018_166993_object57996:head# 2024-02-10T08:39:33.603 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.603 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab534adb:::benchmark_data_smithi018_166993_object37707:head# 2024-02-10T08:39:33.603 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.603 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab534b4f:::benchmark_data_smithi018_166993_object50522:head# 2024-02-10T08:39:33.603 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.604 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab536340:::benchmark_data_smithi018_166993_object55784:head# 2024-02-10T08:39:33.604 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.604 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab5387e6:::benchmark_data_smithi018_166993_object41988:head# 2024-02-10T08:39:33.604 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.606 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab53e9d1:::benchmark_data_smithi018_166993_object103055:head# 2024-02-10T08:39:33.606 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.606 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab5433b4:::benchmark_data_smithi018_166993_object74442:head# 2024-02-10T08:39:33.606 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.606 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab54f880:::benchmark_data_smithi018_166993_object115690:head# 2024-02-10T08:39:33.606 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.606 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab55b0d3:::benchmark_data_smithi018_166993_object65411:head# 2024-02-10T08:39:33.606 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.606 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab56c9fe:::benchmark_data_smithi018_166993_object91955:head# 2024-02-10T08:39:33.606 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.606 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab5872ba:::benchmark_data_smithi018_166993_object116666:head# 2024-02-10T08:39:33.606 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.606 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab58e44d:::benchmark_data_smithi018_166993_object59101:head# 2024-02-10T08:39:33.607 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.607 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab59c4b6:::benchmark_data_smithi018_166993_object30043:head# 2024-02-10T08:39:33.607 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.607 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab59ee57:::benchmark_data_smithi018_166993_object103520:head# 2024-02-10T08:39:33.607 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.608 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab5c6e2d:::benchmark_data_smithi018_166993_object109663:head# 2024-02-10T08:39:33.608 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.608 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab5d9961:::benchmark_data_smithi018_166993_object102536:head# 2024-02-10T08:39:33.608 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.609 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab5f509c:::benchmark_data_smithi018_166993_object82087:head# 2024-02-10T08:39:33.609 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.609 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab6031bf:::benchmark_data_smithi018_166993_object98165:head# 2024-02-10T08:39:33.609 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.609 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab61a5d0:::benchmark_data_smithi018_166993_object109222:head# 2024-02-10T08:39:33.609 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.609 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab61bb90:::benchmark_data_smithi018_166993_object61527:head# 2024-02-10T08:39:33.609 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.609 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab62d0b4:::benchmark_data_smithi018_166993_object17628:head# 2024-02-10T08:39:33.609 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.613 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab62f4af:::benchmark_data_smithi018_166993_object113194:head# 2024-02-10T08:39:33.613 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.613 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab64b326:::benchmark_data_smithi018_166993_object21842:head# 2024-02-10T08:39:33.613 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.613 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab64baf0:::benchmark_data_smithi018_166993_object70477:head# 2024-02-10T08:39:33.613 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.614 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab64eccf:::benchmark_data_smithi018_166993_object55098:head# 2024-02-10T08:39:33.614 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.615 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab6699d6:::benchmark_data_smithi018_166993_object84793:head# 2024-02-10T08:39:33.615 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.615 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab670231:::benchmark_data_smithi018_166993_object107247:head# 2024-02-10T08:39:33.615 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.616 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab683e51:::benchmark_data_smithi018_166993_object33770:head# 2024-02-10T08:39:33.616 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.616 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab69c06d:::benchmark_data_smithi018_166993_object112328:head# 2024-02-10T08:39:33.616 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.616 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab6ac6ab:::benchmark_data_smithi018_166993_object105901:head# 2024-02-10T08:39:33.616 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.617 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab6af969:::benchmark_data_smithi018_166993_object99572:head# 2024-02-10T08:39:33.617 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.617 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab6bb639:::benchmark_data_smithi018_166993_object78370:head# 2024-02-10T08:39:33.617 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.617 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab6bbffd:::benchmark_data_smithi018_166993_object25611:head# 2024-02-10T08:39:33.617 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.617 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab6c7c36:::benchmark_data_smithi018_166993_object94012:head# 2024-02-10T08:39:33.617 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.619 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab6e55c2:::benchmark_data_smithi018_166993_object104853:head# 2024-02-10T08:39:33.619 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.620 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab6fca72:::benchmark_data_smithi018_166993_object41796:head# 2024-02-10T08:39:33.620 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.620 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab6fde8c:::benchmark_data_smithi018_166993_object52887:head# 2024-02-10T08:39:33.620 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.620 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab717b31:::benchmark_data_smithi018_166993_object119035:head# 2024-02-10T08:39:33.620 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.620 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab72fe55:::benchmark_data_smithi018_166993_object37217:head# 2024-02-10T08:39:33.620 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.620 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab737794:::benchmark_data_smithi018_166993_object77108:head# 2024-02-10T08:39:33.620 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.620 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab75862f:::benchmark_data_smithi018_166993_object78086:head# 2024-02-10T08:39:33.620 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.620 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab7637c0:::benchmark_data_smithi018_166993_object21867:head# 2024-02-10T08:39:33.620 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.620 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab768e3e:::benchmark_data_smithi018_166993_object59524:head# 2024-02-10T08:39:33.621 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.621 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab76a636:::benchmark_data_smithi018_166993_object35707:head# 2024-02-10T08:39:33.621 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.621 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab76c5c3:::benchmark_data_smithi018_166993_object26869:head# 2024-02-10T08:39:33.621 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.621 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab7703d7:::benchmark_data_smithi018_166993_object34500:head# 2024-02-10T08:39:33.621 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.621 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab77a7e6:::benchmark_data_smithi018_166993_object41792:head# 2024-02-10T08:39:33.621 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.625 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab77e650:::benchmark_data_smithi018_166993_object79199:head# 2024-02-10T08:39:33.625 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.625 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab7b41f5:::benchmark_data_smithi018_166993_object92274:head# 2024-02-10T08:39:33.625 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.625 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab7ba093:::benchmark_data_smithi018_166993_object79889:head# 2024-02-10T08:39:33.625 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.625 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab7c1efe:::benchmark_data_smithi018_166993_object49125:head# 2024-02-10T08:39:33.625 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.625 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab7c4771:::benchmark_data_smithi018_166993_object107966:head# 2024-02-10T08:39:33.625 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.625 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab7c739a:::benchmark_data_smithi018_166993_object37806:head# 2024-02-10T08:39:33.625 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.625 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab7cef64:::benchmark_data_smithi018_166993_object109804:head# 2024-02-10T08:39:33.626 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.626 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab7dbe44:::benchmark_data_smithi018_166993_object37476:head# 2024-02-10T08:39:33.626 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.626 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab7dd2aa:::benchmark_data_smithi018_166993_object92480:head# 2024-02-10T08:39:33.626 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.626 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab7eec0d:::benchmark_data_smithi018_166993_object35226:head# 2024-02-10T08:39:33.626 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.626 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab7ef3c0:::benchmark_data_smithi018_166993_object104731:head# 2024-02-10T08:39:33.626 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.626 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab7f0d1b:::benchmark_data_smithi018_166993_object101810:head# 2024-02-10T08:39:33.626 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.626 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab7f7793:::benchmark_data_smithi018_166993_object22915:head# 2024-02-10T08:39:33.626 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.626 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab7faca8:::benchmark_data_smithi018_166993_object51383:head# 2024-02-10T08:39:33.626 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.627 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab809baf:::benchmark_data_smithi018_166993_object99651:head# 2024-02-10T08:39:33.627 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.627 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab816f39:::benchmark_data_smithi018_166993_object78480:head# 2024-02-10T08:39:33.627 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.627 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab821add:::benchmark_data_smithi018_166993_object76358:head# 2024-02-10T08:39:33.627 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.627 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab82c296:::benchmark_data_smithi018_166993_object90512:head# 2024-02-10T08:39:33.627 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.627 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab82f42c:::benchmark_data_smithi018_166993_object104039:head# 2024-02-10T08:39:33.627 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.627 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab85af1a:::benchmark_data_smithi018_166993_object37833:head# 2024-02-10T08:39:33.627 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.627 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab866f88:::benchmark_data_smithi018_166993_object66004:head# 2024-02-10T08:39:33.627 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.629 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab86aaa5:::benchmark_data_smithi018_166993_object21615:head# 2024-02-10T08:39:33.629 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.629 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab873df3:::benchmark_data_smithi018_166993_object91414:head# 2024-02-10T08:39:33.629 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.629 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab87a36a:::benchmark_data_smithi018_166993_object54167:head# 2024-02-10T08:39:33.629 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.629 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab88878f:::benchmark_data_smithi018_166993_object70755:head# 2024-02-10T08:39:33.629 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.629 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab89a09c:::benchmark_data_smithi018_166993_object91584:head# 2024-02-10T08:39:33.629 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.629 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab89e8b1:::benchmark_data_smithi018_166993_object52061:head# 2024-02-10T08:39:33.629 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.629 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab8a2543:::benchmark_data_smithi018_166993_object20845:head# 2024-02-10T08:39:33.629 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.629 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab8b520f:::benchmark_data_smithi018_166993_object72398:head# 2024-02-10T08:39:33.630 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.630 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab8bbd3c:::benchmark_data_smithi018_166993_object106157:head# 2024-02-10T08:39:33.630 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.632 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab8c0f5e:::benchmark_data_smithi018_166993_object70784:head# 2024-02-10T08:39:33.632 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.632 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab8c3315:::benchmark_data_smithi018_166993_object34295:head# 2024-02-10T08:39:33.632 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.632 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab8c9932:::benchmark_data_smithi018_166993_object57293:head# 2024-02-10T08:39:33.633 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.633 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab8df167:::benchmark_data_smithi018_166993_object61321:head# 2024-02-10T08:39:33.633 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.633 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab8e020d:::benchmark_data_smithi018_166993_object25415:head# 2024-02-10T08:39:33.633 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.633 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab8f129d:::benchmark_data_smithi018_166993_object70417:head# 2024-02-10T08:39:33.633 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.633 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab8f74e6:::benchmark_data_smithi018_166993_object71233:head# 2024-02-10T08:39:33.633 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.638 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab8faf1a:::benchmark_data_smithi018_166993_object94373:head# 2024-02-10T08:39:33.638 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.641 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab8feec5:::benchmark_data_smithi018_166993_object64460:head# 2024-02-10T08:39:33.641 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.641 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab90c72f:::benchmark_data_smithi018_166993_object111716:head# 2024-02-10T08:39:33.641 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.641 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab919c37:::benchmark_data_smithi018_166993_object58408:head# 2024-02-10T08:39:33.641 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.641 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab9371fa:::benchmark_data_smithi018_166993_object55019:head# 2024-02-10T08:39:33.641 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.641 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab944f2e:::benchmark_data_smithi018_166993_object55178:head# 2024-02-10T08:39:33.641 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.641 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab94f499:::benchmark_data_smithi018_166993_object74261:head# 2024-02-10T08:39:33.641 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.641 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab96976d:::benchmark_data_smithi018_166993_object34427:head# 2024-02-10T08:39:33.642 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.642 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab96a9e9:::benchmark_data_smithi018_166993_object87995:head# 2024-02-10T08:39:33.642 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.642 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab96b019:::benchmark_data_smithi018_166993_object57467:head# 2024-02-10T08:39:33.642 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.642 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab97554b:::benchmark_data_smithi018_166993_object20460:head# 2024-02-10T08:39:33.642 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.642 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab978c5f:::benchmark_data_smithi018_166993_object48044:head# 2024-02-10T08:39:33.642 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.643 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab97f2a3:::benchmark_data_smithi018_166993_object85030:head# 2024-02-10T08:39:33.643 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.643 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab981562:::benchmark_data_smithi018_166993_object41322:head# 2024-02-10T08:39:33.643 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.644 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab98489c:::benchmark_data_smithi018_166993_object69026:head# 2024-02-10T08:39:33.644 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.644 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab986dd4:::benchmark_data_smithi018_166993_object47932:head# 2024-02-10T08:39:33.644 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.644 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab98f5a2:::benchmark_data_smithi018_166993_object104454:head# 2024-02-10T08:39:33.644 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.645 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab99011e:::benchmark_data_smithi018_166993_object30539:head# 2024-02-10T08:39:33.645 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.645 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab990932:::benchmark_data_smithi018_166993_object91561:head# 2024-02-10T08:39:33.645 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.645 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab99112c:::benchmark_data_smithi018_166993_object34224:head# 2024-02-10T08:39:33.645 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.648 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab991e82:::benchmark_data_smithi018_166993_object70789:head# 2024-02-10T08:39:33.648 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.648 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab992a14:::benchmark_data_smithi018_166993_object34788:head# 2024-02-10T08:39:33.651 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.651 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab9a4a19:::benchmark_data_smithi018_166993_object80970:head# 2024-02-10T08:39:33.651 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.651 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab9a64c0:::benchmark_data_smithi018_166993_object69770:head# 2024-02-10T08:39:33.652 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.652 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab9ac35f:::benchmark_data_smithi018_166993_object65391:head# 2024-02-10T08:39:33.652 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.652 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab9af3dc:::benchmark_data_smithi018_166993_object42764:head# 2024-02-10T08:39:33.652 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.653 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab9c0e16:::benchmark_data_smithi018_166993_object41510:head# 2024-02-10T08:39:33.653 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.653 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab9c23a0:::benchmark_data_smithi018_166993_object70218:head# 2024-02-10T08:39:33.653 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.653 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab9cb8db:::benchmark_data_smithi018_166993_object106468:head# 2024-02-10T08:39:33.653 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.653 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab9cdb8d:::benchmark_data_smithi018_166993_object33157:head# 2024-02-10T08:39:33.653 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.653 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab9d4976:::benchmark_data_smithi018_166993_object20209:head# 2024-02-10T08:39:33.654 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.654 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab9d72b9:::benchmark_data_smithi018_166993_object80104:head# 2024-02-10T08:39:33.654 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.656 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab9db24b:::benchmark_data_smithi018_166993_object57888:head# 2024-02-10T08:39:33.656 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.656 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab9e26dd:::benchmark_data_smithi018_166993_object50671:head# 2024-02-10T08:39:33.656 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.657 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ab9e91ba:::benchmark_data_smithi018_166993_object34147:head# 2024-02-10T08:39:33.657 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.657 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aba15c19:::benchmark_data_smithi018_166993_object78706:head# 2024-02-10T08:39:33.657 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.657 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aba19f36:::benchmark_data_smithi018_166993_object81864:head# 2024-02-10T08:39:33.658 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.658 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aba2067f:::benchmark_data_smithi018_166993_object40824:head# 2024-02-10T08:39:33.658 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.658 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aba23054:::benchmark_data_smithi018_166993_object92593:head# 2024-02-10T08:39:33.658 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.658 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aba4c450:::benchmark_data_smithi018_166993_object80807:head# 2024-02-10T08:39:33.658 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.659 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aba4c5ab:::benchmark_data_smithi018_166993_object37095:head# 2024-02-10T08:39:33.659 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.659 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aba51dc7:::benchmark_data_smithi018_166993_object41790:head# 2024-02-10T08:39:33.659 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.659 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aba56cff:::benchmark_data_smithi018_166993_object24756:head# 2024-02-10T08:39:33.659 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.659 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aba5758b:::benchmark_data_smithi018_166993_object64871:head# 2024-02-10T08:39:33.659 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.663 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aba59eaf:::benchmark_data_smithi018_166993_object99851:head# 2024-02-10T08:39:33.663 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.665 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:39:33.668 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aba5e079:::benchmark_data_smithi018_166993_object116384:head# 2024-02-10T08:39:33.668 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.668 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aba7344b:::benchmark_data_smithi018_166993_object43702:head# 2024-02-10T08:39:33.668 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.669 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:33.670 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aba73fb0:::benchmark_data_smithi018_166993_object112686:head# 2024-02-10T08:39:33.670 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.670 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aba7491b:::benchmark_data_smithi018_166993_object47359:head# 2024-02-10T08:39:33.670 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.670 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aba800a0:::benchmark_data_smithi018_166993_object117275:head# 2024-02-10T08:39:33.670 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.670 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aba96d89:::benchmark_data_smithi018_166993_object59263:head# 2024-02-10T08:39:33.670 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.670 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:39:33.672 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aba98262:::benchmark_data_smithi018_166993_object92457:head# 2024-02-10T08:39:33.672 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.672 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abaa20e1:::benchmark_data_smithi018_166993_object109664:head# 2024-02-10T08:39:33.672 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.673 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ababee75:::benchmark_data_smithi018_166993_object97289:head# 2024-02-10T08:39:33.673 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.675 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abac0cbd:::benchmark_data_smithi018_166993_object105786:head# 2024-02-10T08:39:33.675 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.675 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abac4160:::benchmark_data_smithi018_166993_object118930:head# 2024-02-10T08:39:33.675 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.675 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abac7792:::benchmark_data_smithi018_166993_object77197:head# 2024-02-10T08:39:33.676 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.676 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abacb8a7:::benchmark_data_smithi018_166993_object32595:head# 2024-02-10T08:39:33.676 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.679 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abad88da:::benchmark_data_smithi018_166993_object31078:head# 2024-02-10T08:39:33.679 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.682 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abae5dca:::benchmark_data_smithi018_166993_object67582:head# 2024-02-10T08:39:33.682 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.682 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abaf66ef:::benchmark_data_smithi018_166993_object37358:head# 2024-02-10T08:39:33.682 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.685 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abafbc44:::benchmark_data_smithi018_166993_object46225:head# 2024-02-10T08:39:33.685 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.687 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abb0498a:::benchmark_data_smithi018_166993_object21395:head# 2024-02-10T08:39:33.687 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.688 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abb0803e:::benchmark_data_smithi018_166993_object59790:head# 2024-02-10T08:39:33.689 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.689 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abb0c533:::benchmark_data_smithi018_166993_object110228:head# 2024-02-10T08:39:33.689 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.689 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abb1e568:::benchmark_data_smithi018_166993_object56033:head# 2024-02-10T08:39:33.689 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.692 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abb206c0:::benchmark_data_smithi018_166993_object70310:head# 2024-02-10T08:39:33.692 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.693 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abb24a52:::benchmark_data_smithi018_166993_object58526:head# 2024-02-10T08:39:33.693 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.693 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abb2c64a:::benchmark_data_smithi018_166993_object92024:head# 2024-02-10T08:39:33.693 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.694 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abb3e7e8:::benchmark_data_smithi018_166993_object114170:head# 2024-02-10T08:39:33.694 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.694 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abb440b1:::benchmark_data_smithi018_166993_object28453:head# 2024-02-10T08:39:33.694 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.694 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abb47559:::benchmark_data_smithi018_166993_object82309:head# 2024-02-10T08:39:33.694 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.695 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abb4cc1b:::benchmark_data_smithi018_166993_object34208:head# 2024-02-10T08:39:33.695 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.695 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abb4d777:::benchmark_data_smithi018_166993_object75292:head# 2024-02-10T08:39:33.695 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.695 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abb512b9:::benchmark_data_smithi018_166993_object28986:head# 2024-02-10T08:39:33.696 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.696 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abb58996:::benchmark_data_smithi018_166993_object44079:head# 2024-02-10T08:39:33.696 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.696 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abb74e45:::benchmark_data_smithi018_166993_object83296:head# 2024-02-10T08:39:33.696 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.697 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abba1a96:::benchmark_data_smithi018_166993_object39287:head# 2024-02-10T08:39:33.697 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.697 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abbbc43d:::benchmark_data_smithi018_166993_object35003:head# 2024-02-10T08:39:33.697 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.697 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abbd829d:::benchmark_data_smithi018_166993_object80468:head# 2024-02-10T08:39:33.697 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.697 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abbdc008:::benchmark_data_smithi018_166993_object67977:head# 2024-02-10T08:39:33.698 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.698 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abbde940:::benchmark_data_smithi018_166993_object76618:head# 2024-02-10T08:39:33.698 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.701 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abbeb0d0:::benchmark_data_smithi018_166993_object69930:head# 2024-02-10T08:39:33.701 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.704 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abbf69c2:::benchmark_data_smithi018_166993_object97523:head# 2024-02-10T08:39:33.704 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.704 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abc1353b:::benchmark_data_smithi018_166993_object111401:head# 2024-02-10T08:39:33.704 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.704 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abc18066:::benchmark_data_smithi018_166993_object90404:head# 2024-02-10T08:39:33.704 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.704 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abc21ea3:::benchmark_data_smithi018_166993_object103369:head# 2024-02-10T08:39:33.705 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.705 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abc2dac1:::benchmark_data_smithi018_166993_object95773:head# 2024-02-10T08:39:33.705 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.705 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abc327e2:::benchmark_data_smithi018_166993_object25963:head# 2024-02-10T08:39:33.705 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.705 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abc3d0d6:::benchmark_data_smithi018_166993_object17703:head# 2024-02-10T08:39:33.705 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.706 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abc3db09:::benchmark_data_smithi018_166993_object34693:head# 2024-02-10T08:39:33.706 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.706 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abc472bc:::benchmark_data_smithi018_166993_object87089:head# 2024-02-10T08:39:33.706 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.707 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abc4e65e:::benchmark_data_smithi018_166993_object40275:head# 2024-02-10T08:39:33.707 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.707 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abc4eb27:::benchmark_data_smithi018_166993_object53774:head# 2024-02-10T08:39:33.707 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.707 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abc51bb5:::benchmark_data_smithi018_166993_object37133:head# 2024-02-10T08:39:33.707 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.707 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abc7286e:::benchmark_data_smithi018_166993_object75427:head# 2024-02-10T08:39:33.707 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.707 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abc7add3:::benchmark_data_smithi018_166993_object36818:head# 2024-02-10T08:39:33.707 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.707 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abc8d0b3:::benchmark_data_smithi018_166993_object24416:head# 2024-02-10T08:39:33.707 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.709 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abca7f1c:::benchmark_data_smithi018_166993_object25982:head# 2024-02-10T08:39:33.709 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.709 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abca7fdd:::benchmark_data_smithi018_166993_object81333:head# 2024-02-10T08:39:33.709 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.709 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abcafa65:::benchmark_data_smithi018_166993_object39769:head# 2024-02-10T08:39:33.710 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.710 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abcb0e09:::benchmark_data_smithi018_166993_object21460:head# 2024-02-10T08:39:33.710 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.710 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abcc50a8:::benchmark_data_smithi018_166993_object47760:head# 2024-02-10T08:39:33.710 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.710 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abceae44:::benchmark_data_smithi018_166993_object20389:head# 2024-02-10T08:39:33.710 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.710 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abcf0525:::benchmark_data_smithi018_166993_object61018:head# 2024-02-10T08:39:33.710 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.710 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abd0631d:::benchmark_data_smithi018_166993_object93062:head# 2024-02-10T08:39:33.710 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.710 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abd0e882:::benchmark_data_smithi018_166993_object22437:head# 2024-02-10T08:39:33.710 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.710 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abd19145:::benchmark_data_smithi018_166993_object51511:head# 2024-02-10T08:39:33.710 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.710 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abd25764:::benchmark_data_smithi018_166993_object75682:head# 2024-02-10T08:39:33.711 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.712 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abd49f88:::benchmark_data_smithi018_166993_object93021:head# 2024-02-10T08:39:33.712 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.712 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abd5b54c:::benchmark_data_smithi018_166993_object98641:head# 2024-02-10T08:39:33.713 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.713 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abd5d26f:::benchmark_data_smithi018_166993_object91792:head# 2024-02-10T08:39:33.713 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.713 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abd68e58:::benchmark_data_smithi018_166993_object104232:head# 2024-02-10T08:39:33.713 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.714 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abd696f0:::benchmark_data_smithi018_166993_object91464:head# 2024-02-10T08:39:33.714 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.715 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abd98167:::benchmark_data_smithi018_166993_object86907:head# 2024-02-10T08:39:33.715 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.715 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abda9bc9:::benchmark_data_smithi018_166993_object111419:head# 2024-02-10T08:39:33.715 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.715 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abdabc14:::benchmark_data_smithi018_166993_object28165:head# 2024-02-10T08:39:33.715 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.715 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abdac154:::benchmark_data_smithi018_166993_object117151:head# 2024-02-10T08:39:33.715 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.715 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abdb1efa:::benchmark_data_smithi018_166993_object80124:head# 2024-02-10T08:39:33.715 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.716 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abdb99d5:::benchmark_data_smithi018_166993_object98863:head# 2024-02-10T08:39:33.716 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.717 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abdbc40c:::benchmark_data_smithi018_166993_object102878:head# 2024-02-10T08:39:33.717 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.717 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abdc14d5:::benchmark_data_smithi018_166993_object85554:head# 2024-02-10T08:39:33.717 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.717 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abdc7de1:::benchmark_data_smithi018_166993_object23677:head# 2024-02-10T08:39:33.717 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.717 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abdd15d9:::benchmark_data_smithi018_166993_object84444:head# 2024-02-10T08:39:33.717 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.717 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abdf0652:::benchmark_data_smithi018_166993_object104857:head# 2024-02-10T08:39:33.717 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.717 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abdf63db:::benchmark_data_smithi018_166993_object57367:head# 2024-02-10T08:39:33.717 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.718 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abe0cc7e:::benchmark_data_smithi018_166993_object69646:head# 2024-02-10T08:39:33.718 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.719 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abe1b0c6:::benchmark_data_smithi018_166993_object36253:head# 2024-02-10T08:39:33.719 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.723 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abe2caf6:::benchmark_data_smithi018_166993_object102533:head# 2024-02-10T08:39:33.724 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.724 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abe56e74:::benchmark_data_smithi018_166993_object36752:head# 2024-02-10T08:39:33.724 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.725 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abe62167:::benchmark_data_smithi018_166993_object48551:head# 2024-02-10T08:39:33.725 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.725 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abe72ae0:::benchmark_data_smithi018_166993_object44912:head# 2024-02-10T08:39:33.725 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.725 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abe77ef9:::benchmark_data_smithi018_166993_object114259:head# 2024-02-10T08:39:33.725 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.725 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abe79ef3:::benchmark_data_smithi018_166993_object60951:head# 2024-02-10T08:39:33.725 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.725 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abe802c6:::benchmark_data_smithi018_166993_object20194:head# 2024-02-10T08:39:33.725 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.726 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abe9b039:::benchmark_data_smithi018_166993_object93477:head# 2024-02-10T08:39:33.726 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.726 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abea09c1:::benchmark_data_smithi018_166993_object46474:head# 2024-02-10T08:39:33.726 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.726 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abeac497:::benchmark_data_smithi018_166993_object61073:head# 2024-02-10T08:39:33.727 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.727 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abeb0b43:::benchmark_data_smithi018_166993_object72884:head# 2024-02-10T08:39:33.727 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.727 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abec6db9:::benchmark_data_smithi018_166993_object17673:head# 2024-02-10T08:39:33.727 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.727 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abee4584:::benchmark_data_smithi018_166993_object97485:head# 2024-02-10T08:39:33.727 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.730 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abee7aa2:::benchmark_data_smithi018_166993_object38984:head# 2024-02-10T08:39:33.730 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.730 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abee8083:::benchmark_data_smithi018_166993_object74009:head# 2024-02-10T08:39:33.730 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.730 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abefcb49:::benchmark_data_smithi018_166993_object63540:head# 2024-02-10T08:39:33.730 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.730 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abf1210a:::benchmark_data_smithi018_166993_object61568:head# 2024-02-10T08:39:33.730 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.730 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abf252a0:::benchmark_data_smithi018_166993_object86723:head# 2024-02-10T08:39:33.730 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.731 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abf2a98e:::benchmark_data_smithi018_166993_object48629:head# 2024-02-10T08:39:33.731 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.731 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abf2bb34:::benchmark_data_smithi018_166993_object81508:head# 2024-02-10T08:39:33.731 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.731 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abf36143:::benchmark_data_smithi018_166993_object102688:head# 2024-02-10T08:39:33.731 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.731 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abf40985:::benchmark_data_smithi018_166993_object57053:head# 2024-02-10T08:39:33.731 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.731 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abf58373:::benchmark_data_smithi018_166993_object60941:head# 2024-02-10T08:39:33.731 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.731 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abf65d89:::benchmark_data_smithi018_166993_object106330:head# 2024-02-10T08:39:33.731 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.731 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abf75049:::benchmark_data_smithi018_166993_object69196:head# 2024-02-10T08:39:33.731 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.731 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abf7c126:::benchmark_data_smithi018_166993_object101759:head# 2024-02-10T08:39:33.732 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.732 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abf8ff25:::benchmark_data_smithi018_166993_object92517:head# 2024-02-10T08:39:33.732 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.732 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abfc1dba:::benchmark_data_smithi018_166993_object96714:head# 2024-02-10T08:39:33.732 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.734 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abfc3d6e:::benchmark_data_smithi018_166993_object48057:head# 2024-02-10T08:39:33.734 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.734 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abfda440:::benchmark_data_smithi018_166993_object96068:head# 2024-02-10T08:39:33.734 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.734 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abfed172:::benchmark_data_smithi018_166993_object49257:head# 2024-02-10T08:39:33.734 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.734 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abff1e12:::benchmark_data_smithi018_166993_object113734:head# 2024-02-10T08:39:33.734 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.734 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:abffa8f3:::benchmark_data_smithi018_166993_object51450:head# 2024-02-10T08:39:33.734 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.734 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac0095a0:::benchmark_data_smithi018_166993_object111066:head# 2024-02-10T08:39:33.734 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.735 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac010581:::benchmark_data_smithi018_166993_object49883:head# 2024-02-10T08:39:33.735 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.735 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac018e5e:::benchmark_data_smithi018_166993_object44141:head# 2024-02-10T08:39:33.735 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.735 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac024805:::benchmark_data_smithi018_166993_object47890:head# 2024-02-10T08:39:33.735 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.735 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac03a715:::benchmark_data_smithi018_166993_object110409:head# 2024-02-10T08:39:33.735 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.735 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac03d537:::benchmark_data_smithi018_166993_object75129:head# 2024-02-10T08:39:33.735 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.736 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac0402d2:::benchmark_data_smithi018_166993_object105233:head# 2024-02-10T08:39:33.736 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.740 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac0533c5:::benchmark_data_smithi018_166993_object107065:head# 2024-02-10T08:39:33.740 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.740 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac0557fb:::benchmark_data_smithi018_166993_object105671:head# 2024-02-10T08:39:33.740 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.740 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac05fe04:::benchmark_data_smithi018_166993_object84728:head# 2024-02-10T08:39:33.741 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.741 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac064857:::benchmark_data_smithi018_166993_object82279:head# 2024-02-10T08:39:33.741 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.741 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac075f9e:::benchmark_data_smithi018_166993_object101701:head# 2024-02-10T08:39:33.741 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.741 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac087982:::benchmark_data_smithi018_166993_object72784:head# 2024-02-10T08:39:33.741 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.742 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac0887d3:::benchmark_data_smithi018_166993_object84230:head# 2024-02-10T08:39:33.742 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.742 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac08ea65:::benchmark_data_smithi018_166993_object62042:head# 2024-02-10T08:39:33.742 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.742 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac0925e9:::benchmark_data_smithi018_166993_object51530:head# 2024-02-10T08:39:33.742 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.742 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac0964b2:::benchmark_data_smithi018_166993_object32614:head# 2024-02-10T08:39:33.742 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.742 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac0a0621:::benchmark_data_smithi018_166993_object83546:head# 2024-02-10T08:39:33.743 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.743 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac0a3c89:::benchmark_data_smithi018_166993_object91296:head# 2024-02-10T08:39:33.744 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.744 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac0b1625:::benchmark_data_smithi018_166993_object59391:head# 2024-02-10T08:39:33.744 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.744 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac0b3464:::benchmark_data_smithi018_166993_object24645:head# 2024-02-10T08:39:33.744 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.744 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac0c07d2:::benchmark_data_smithi018_166993_object101386:head# 2024-02-10T08:39:33.744 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.744 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac0c8ba7:::benchmark_data_smithi018_166993_object57403:head# 2024-02-10T08:39:33.744 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.745 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:39:33.745 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac0d4598:::benchmark_data_smithi018_166993_object22028:head# 2024-02-10T08:39:33.746 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.746 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac0dad2e:::benchmark_data_smithi018_166993_object89565:head# 2024-02-10T08:39:33.746 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.746 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac0e11e6:::benchmark_data_smithi018_166993_object56103:head# 2024-02-10T08:39:33.746 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.746 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac0f20e5:::benchmark_data_smithi018_166993_object40722:head# 2024-02-10T08:39:33.746 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.746 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac0fd77d:::benchmark_data_smithi018_166993_object45982:head# 2024-02-10T08:39:33.746 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.746 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac11bdc4:::benchmark_data_smithi018_166993_object66608:head# 2024-02-10T08:39:33.746 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.746 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac11e3cc:::benchmark_data_smithi018_166993_object23293:head# 2024-02-10T08:39:33.746 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.746 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac128014:::benchmark_data_smithi018_166993_object85679:head# 2024-02-10T08:39:33.747 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.747 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac149c80:::benchmark_data_smithi018_166993_object95208:head# 2024-02-10T08:39:33.747 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.747 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac14c72c:::benchmark_data_smithi018_166993_object54369:head# 2024-02-10T08:39:33.747 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.747 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac15d059:::benchmark_data_smithi018_166993_object61246:head# 2024-02-10T08:39:33.747 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.748 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac16c15e:::benchmark_data_smithi018_166993_object29393:head# 2024-02-10T08:39:33.748 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.748 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac16ff1a:::benchmark_data_smithi018_166993_object76855:head# 2024-02-10T08:39:33.748 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.748 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac177357:::benchmark_data_smithi018_166993_object80720:head# 2024-02-10T08:39:33.748 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.749 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac18597d:::benchmark_data_smithi018_166993_object58782:head# 2024-02-10T08:39:33.749 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.749 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac185ee1:::benchmark_data_smithi018_166993_object19873:head# 2024-02-10T08:39:33.749 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.751 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac186df8:::benchmark_data_smithi018_166993_object95975:head# 2024-02-10T08:39:33.751 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.751 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac1939ca:::benchmark_data_smithi018_166993_object73407:head# 2024-02-10T08:39:33.751 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.751 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac19b51f:::benchmark_data_smithi018_166993_object62153:head# 2024-02-10T08:39:33.752 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.752 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac19bc9f:::benchmark_data_smithi018_166993_object64450:head# 2024-02-10T08:39:33.752 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.752 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac1a925d:::benchmark_data_smithi018_166993_object86237:head# 2024-02-10T08:39:33.752 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.752 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac1b6b41:::benchmark_data_smithi018_166993_object87275:head# 2024-02-10T08:39:33.752 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.752 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac1cb582:::benchmark_data_smithi018_166993_object66179:head# 2024-02-10T08:39:33.752 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.752 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac1cfad4:::benchmark_data_smithi018_166993_object66747:head# 2024-02-10T08:39:33.753 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.755 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac1d1391:::benchmark_data_smithi018_166993_object95532:head# 2024-02-10T08:39:33.755 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.755 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac1d5350:::benchmark_data_smithi018_166993_object87616:head# 2024-02-10T08:39:33.755 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.755 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac1d58c7:::benchmark_data_smithi018_166993_object52627:head# 2024-02-10T08:39:33.755 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.755 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac1dd754:::benchmark_data_smithi018_166993_object88966:head# 2024-02-10T08:39:33.755 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.755 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac1e18b6:::benchmark_data_smithi018_166993_object48567:head# 2024-02-10T08:39:33.755 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.755 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac1ebafe:::benchmark_data_smithi018_166993_object65755:head# 2024-02-10T08:39:33.756 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.756 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac1ec21b:::benchmark_data_smithi018_166993_object104929:head# 2024-02-10T08:39:33.756 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.756 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac1fe101:::benchmark_data_smithi018_166993_object54593:head# 2024-02-10T08:39:33.756 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.756 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac1ff0ee:::benchmark_data_smithi018_166993_object29190:head# 2024-02-10T08:39:33.756 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.756 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac208da2:::benchmark_data_smithi018_166993_object24196:head# 2024-02-10T08:39:33.756 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.756 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac20a733:::benchmark_data_smithi018_166993_object49663:head# 2024-02-10T08:39:33.756 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.756 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac20edcd:::benchmark_data_smithi018_166993_object99297:head# 2024-02-10T08:39:33.756 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.756 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac2190f6:::benchmark_data_smithi018_166993_object64779:head# 2024-02-10T08:39:33.757 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.757 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac22fef2:::benchmark_data_smithi018_166993_object47249:head# 2024-02-10T08:39:33.757 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.757 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac249c2a:::benchmark_data_smithi018_166993_object90753:head# 2024-02-10T08:39:33.757 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.757 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac27a826:::benchmark_data_smithi018_166993_object48411:head# 2024-02-10T08:39:33.757 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.757 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac27b311:::benchmark_data_smithi018_166993_object48884:head# 2024-02-10T08:39:33.758 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.758 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac27ffa3:::benchmark_data_smithi018_166993_object34698:head# 2024-02-10T08:39:33.758 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.758 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac28882f:::benchmark_data_smithi018_166993_object77535:head# 2024-02-10T08:39:33.759 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.759 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac28b7bb:::benchmark_data_smithi018_166993_object41431:head# 2024-02-10T08:39:33.759 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.759 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac28ff57:::benchmark_data_smithi018_166993_object38592:head# 2024-02-10T08:39:33.759 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.759 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac2a3a71:::benchmark_data_smithi018_166993_object87465:head# 2024-02-10T08:39:33.759 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.759 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac2c49cc:::benchmark_data_smithi018_166993_object56083:head# 2024-02-10T08:39:33.759 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.759 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac2c8fbf:::benchmark_data_smithi018_166993_object94913:head# 2024-02-10T08:39:33.759 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.759 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac2d72f0:::benchmark_data_smithi018_166993_object98418:head# 2024-02-10T08:39:33.759 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.760 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac2f8b04:::benchmark_data_smithi018_166993_object117016:head# 2024-02-10T08:39:33.760 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.760 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac3045be:::benchmark_data_smithi018_166993_object95949:head# 2024-02-10T08:39:33.760 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.760 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac32bff5:::benchmark_data_smithi018_166993_object99041:head# 2024-02-10T08:39:33.760 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.765 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac32d505:::benchmark_data_smithi018_166993_object52888:head# 2024-02-10T08:39:33.765 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.765 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac3334b6:::benchmark_data_smithi018_166993_object78777:head# 2024-02-10T08:39:33.765 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.765 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac336747:::benchmark_data_smithi018_166993_object54027:head# 2024-02-10T08:39:33.765 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.766 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac337187:::benchmark_data_smithi018_166993_object84118:head# 2024-02-10T08:39:33.766 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.766 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac353b52:::benchmark_data_smithi018_166993_object102338:head# 2024-02-10T08:39:33.766 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.766 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac35a241:::benchmark_data_smithi018_166993_object111128:head# 2024-02-10T08:39:33.766 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.767 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac35d82b:::benchmark_data_smithi018_166993_object44443:head# 2024-02-10T08:39:33.767 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.767 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac3667a4:::benchmark_data_smithi018_166993_object96354:head# 2024-02-10T08:39:33.767 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.767 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac375d72:::benchmark_data_smithi018_166993_object104888:head# 2024-02-10T08:39:33.767 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.767 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac37abe4:::benchmark_data_smithi018_166993_object62201:head# 2024-02-10T08:39:33.767 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.770 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac37e243:::benchmark_data_smithi018_166993_object61353:head# 2024-02-10T08:39:33.770 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.770 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac3853a9:::benchmark_data_smithi018_166993_object84170:head# 2024-02-10T08:39:33.770 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.771 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac394e64:::benchmark_data_smithi018_166993_object100152:head# 2024-02-10T08:39:33.771 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.771 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac39902f:::benchmark_data_smithi018_166993_object40032:head# 2024-02-10T08:39:33.771 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.771 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac3a6151:::benchmark_data_smithi018_166993_object81726:head# 2024-02-10T08:39:33.771 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.771 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac3be358:::benchmark_data_smithi018_166993_object30005:head# 2024-02-10T08:39:33.771 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.772 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:39:33.774 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac3d03be:::benchmark_data_smithi018_166993_object55615:head# 2024-02-10T08:39:33.774 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.774 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac3f0773:::benchmark_data_smithi018_166993_object74064:head# 2024-02-10T08:39:33.774 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.774 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac3fad6c:::benchmark_data_smithi018_166993_object83228:head# 2024-02-10T08:39:33.774 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.774 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac3fec94:::benchmark_data_smithi018_166993_object37858:head# 2024-02-10T08:39:33.775 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.775 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac400026:::benchmark_data_smithi018_166993_object71634:head# 2024-02-10T08:39:33.775 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.775 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac40dbb5:::benchmark_data_smithi018_166993_object109566:head# 2024-02-10T08:39:33.775 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.775 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac41ffa5:::benchmark_data_smithi018_166993_object118554:head# 2024-02-10T08:39:33.775 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.775 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac4347aa:::benchmark_data_smithi018_166993_object92713:head# 2024-02-10T08:39:33.775 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.775 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac436947:::benchmark_data_smithi018_166993_object101629:head# 2024-02-10T08:39:33.775 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.775 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac43ac9d:::benchmark_data_smithi018_166993_object37197:head# 2024-02-10T08:39:33.775 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.775 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac440ca1:::benchmark_data_smithi018_166993_object41471:head# 2024-02-10T08:39:33.776 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.776 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac447c1f:::benchmark_data_smithi018_166993_object35187:head# 2024-02-10T08:39:33.776 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.777 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac45c810:::benchmark_data_smithi018_166993_object18818:head# 2024-02-10T08:39:33.777 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.777 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac46112f:::benchmark_data_smithi018_166993_object60528:head# 2024-02-10T08:39:33.777 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.777 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac46c340:::benchmark_data_smithi018_166993_object37740:head# 2024-02-10T08:39:33.777 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.777 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac46e500:::benchmark_data_smithi018_166993_object34087:head# 2024-02-10T08:39:33.778 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.778 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac474b9f:::benchmark_data_smithi018_166993_object79527:head# 2024-02-10T08:39:33.778 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.778 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac48e993:::benchmark_data_smithi018_166993_object45072:head# 2024-02-10T08:39:33.778 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.778 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac49b58b:::benchmark_data_smithi018_166993_object22637:head# 2024-02-10T08:39:33.778 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.778 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac4a553f:::benchmark_data_smithi018_166993_object81767:head# 2024-02-10T08:39:33.778 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.778 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac4a9279:::benchmark_data_smithi018_166993_object75183:head# 2024-02-10T08:39:33.778 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.778 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac4aa224:::benchmark_data_smithi018_166993_object48357:head# 2024-02-10T08:39:33.778 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.779 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac4d01f4:::benchmark_data_smithi018_166993_object82080:head# 2024-02-10T08:39:33.779 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.780 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac4e43a3:::benchmark_data_smithi018_166993_object78998:head# 2024-02-10T08:39:33.780 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.780 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac4fc1eb:::benchmark_data_smithi018_166993_object112771:head# 2024-02-10T08:39:33.780 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.780 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac510743:::benchmark_data_smithi018_166993_object74715:head# 2024-02-10T08:39:33.780 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.780 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac5179bb:::benchmark_data_smithi018_166993_object64439:head# 2024-02-10T08:39:33.780 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.781 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac52c67f:::benchmark_data_smithi018_166993_object37076:head# 2024-02-10T08:39:33.781 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.784 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac53ac7f:::benchmark_data_smithi018_166993_object63142:head# 2024-02-10T08:39:33.784 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.785 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac553991:::benchmark_data_smithi018_166993_object112930:head# 2024-02-10T08:39:33.785 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.785 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac55a3f5:::benchmark_data_smithi018_166993_object103539:head# 2024-02-10T08:39:33.785 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.785 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac577fcb:::benchmark_data_smithi018_166993_object27604:head# 2024-02-10T08:39:33.785 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.786 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac594662:::benchmark_data_smithi018_166993_object106632:head# 2024-02-10T08:39:33.786 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.786 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac59504f:::benchmark_data_smithi018_166993_object22502:head# 2024-02-10T08:39:33.786 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.786 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac59798c:::benchmark_data_smithi018_166993_object36871:head# 2024-02-10T08:39:33.786 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.787 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac598853:::benchmark_data_smithi018_166993_object82022:head# 2024-02-10T08:39:33.787 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.788 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac5990b5:::benchmark_data_smithi018_166993_object72665:head# 2024-02-10T08:39:33.788 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.788 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac59aa8c:::benchmark_data_smithi018_166993_object60325:head# 2024-02-10T08:39:33.788 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.788 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac5a2db4:::benchmark_data_smithi018_166993_object68024:head# 2024-02-10T08:39:33.788 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.789 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac5a4c29:::benchmark_data_smithi018_166993_object107685:head# 2024-02-10T08:39:33.789 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.789 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac5bbfab:::benchmark_data_smithi018_166993_object84741:head# 2024-02-10T08:39:33.789 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.789 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac5e0f76:::benchmark_data_smithi018_166993_object72569:head# 2024-02-10T08:39:33.789 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.789 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac609e26:::benchmark_data_smithi018_166993_object77620:head# 2024-02-10T08:39:33.790 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.790 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac60ff4d:::benchmark_data_smithi018_166993_object80262:head# 2024-02-10T08:39:33.790 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.791 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac61832e:::benchmark_data_smithi018_166993_object56429:head# 2024-02-10T08:39:33.791 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.792 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac61ba72:::benchmark_data_smithi018_166993_object105389:head# 2024-02-10T08:39:33.792 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.792 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac62995d:::benchmark_data_smithi018_166993_object73005:head# 2024-02-10T08:39:33.792 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.792 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac63331c:::benchmark_data_smithi018_166993_object119084:head# 2024-02-10T08:39:33.792 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.792 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac645d8a:::benchmark_data_smithi018_166993_object27108:head# 2024-02-10T08:39:33.792 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.792 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac672e51:::benchmark_data_smithi018_166993_object107889:head# 2024-02-10T08:39:33.792 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.792 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac677bf1:::benchmark_data_smithi018_166993_object90240:head# 2024-02-10T08:39:33.792 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.792 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac67a686:::benchmark_data_smithi018_166993_object50871:head# 2024-02-10T08:39:33.792 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.793 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac67b239:::benchmark_data_smithi018_166993_object18569:head# 2024-02-10T08:39:33.793 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.794 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac684b00:::benchmark_data_smithi018_166993_object82938:head# 2024-02-10T08:39:33.794 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.794 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac68d565:::benchmark_data_smithi018_166993_object35988:head# 2024-02-10T08:39:33.794 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.794 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac68e367:::benchmark_data_smithi018_166993_object110925:head# 2024-02-10T08:39:33.794 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.794 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac6b3123:::benchmark_data_smithi018_166993_object94938:head# 2024-02-10T08:39:33.795 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.795 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac6b6146:::benchmark_data_smithi018_166993_object70858:head# 2024-02-10T08:39:33.795 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.795 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac6d6ae5:::benchmark_data_smithi018_166993_object106910:head# 2024-02-10T08:39:33.795 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.795 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac6dc93c:::benchmark_data_smithi018_166993_object45390:head# 2024-02-10T08:39:33.795 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.795 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac6e2721:::benchmark_data_smithi018_166993_object26515:head# 2024-02-10T08:39:33.795 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.795 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac6eb4bc:::benchmark_data_smithi018_166993_object100635:head# 2024-02-10T08:39:33.795 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.795 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac7013ed:::benchmark_data_smithi018_166993_object117958:head# 2024-02-10T08:39:33.795 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.797 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac70a130:::benchmark_data_smithi018_166993_object23156:head# 2024-02-10T08:39:33.797 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.797 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac750bc1:::benchmark_data_smithi018_166993_object114332:head# 2024-02-10T08:39:33.797 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.797 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac7533a6:::benchmark_data_smithi018_166993_object48751:head# 2024-02-10T08:39:33.797 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.797 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac753ad0:::benchmark_data_smithi018_166993_object102654:head# 2024-02-10T08:39:33.797 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.797 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac75602e:::benchmark_data_smithi018_166993_object98132:head# 2024-02-10T08:39:33.797 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.797 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac778d5b:::benchmark_data_smithi018_166993_object59098:head# 2024-02-10T08:39:33.797 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.797 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac77aa5b:::benchmark_data_smithi018_166993_object64380:head# 2024-02-10T08:39:33.797 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.798 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac786ee5:::benchmark_data_smithi018_166993_object90563:head# 2024-02-10T08:39:33.798 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.798 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac793544:::benchmark_data_smithi018_166993_object116938:head# 2024-02-10T08:39:33.798 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.798 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac79c44d:::benchmark_data_smithi018_166993_object96096:head# 2024-02-10T08:39:33.798 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.798 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac7a206e:::benchmark_data_smithi018_166993_object117228:head# 2024-02-10T08:39:33.798 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.800 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac7a75bd:::benchmark_data_smithi018_166993_object97390:head# 2024-02-10T08:39:33.800 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.800 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac7aa329:::benchmark_data_smithi018_166993_object65704:head# 2024-02-10T08:39:33.800 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.800 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac7aa82c:::benchmark_data_smithi018_166993_object94187:head# 2024-02-10T08:39:33.800 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.800 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac7ac7dc:::benchmark_data_smithi018_166993_object99800:head# 2024-02-10T08:39:33.800 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.800 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac7ad61f:::benchmark_data_smithi018_166993_object61842:head# 2024-02-10T08:39:33.800 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.800 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac7c3b60:::benchmark_data_smithi018_166993_object41087:head# 2024-02-10T08:39:33.800 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.800 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac7c40a5:::benchmark_data_smithi018_166993_object85275:head# 2024-02-10T08:39:33.801 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.801 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac812614:::benchmark_data_smithi018_166993_object85896:head# 2024-02-10T08:39:33.801 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.801 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:39:33.801 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac8131c7:::benchmark_data_smithi018_166993_object103480:head# 2024-02-10T08:39:33.801 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.801 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac81355b:::benchmark_data_smithi018_166993_object54807:head# 2024-02-10T08:39:33.801 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.802 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac81378d:::benchmark_data_smithi018_166993_object90061:head# 2024-02-10T08:39:33.802 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.802 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac82600a:::benchmark_data_smithi018_166993_object80653:head# 2024-02-10T08:39:33.802 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.802 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac835f3f:::benchmark_data_smithi018_166993_object32313:head# 2024-02-10T08:39:33.802 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.802 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac841155:::benchmark_data_smithi018_166993_object44284:head# 2024-02-10T08:39:33.802 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.802 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac844225:::benchmark_data_smithi018_166993_object49677:head# 2024-02-10T08:39:33.802 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.802 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac86f8c7:::benchmark_data_smithi018_166993_object97617:head# 2024-02-10T08:39:33.802 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.803 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac871ccc:::benchmark_data_smithi018_166993_object63167:head# 2024-02-10T08:39:33.803 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.803 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac8737bd:::benchmark_data_smithi018_166993_object73404:head# 2024-02-10T08:39:33.803 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.803 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac873dd2:::benchmark_data_smithi018_166993_object98091:head# 2024-02-10T08:39:33.803 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.804 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac87cc29:::benchmark_data_smithi018_166993_object38387:head# 2024-02-10T08:39:33.804 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.804 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac8845ab:::benchmark_data_smithi018_166993_object36377:head# 2024-02-10T08:39:33.804 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.804 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac892ce5:::benchmark_data_smithi018_166993_object85416:head# 2024-02-10T08:39:33.804 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.805 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac8c23e7:::benchmark_data_smithi018_166993_object31489:head# 2024-02-10T08:39:33.805 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.806 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac8c4a35:::benchmark_data_smithi018_166993_object89675:head# 2024-02-10T08:39:33.806 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.806 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac8ca8c0:::benchmark_data_smithi018_166993_object39944:head# 2024-02-10T08:39:33.806 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.807 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac8d075f:::benchmark_data_smithi018_166993_object60697:head# 2024-02-10T08:39:33.807 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.807 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac8d6d93:::benchmark_data_smithi018_166993_object74070:head# 2024-02-10T08:39:33.807 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.808 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac8dab08:::benchmark_data_smithi018_166993_object54850:head# 2024-02-10T08:39:33.808 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.808 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac8dd8da:::benchmark_data_smithi018_166993_object35797:head# 2024-02-10T08:39:33.808 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.809 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac8e3b7b:::benchmark_data_smithi018_166993_object44658:head# 2024-02-10T08:39:33.809 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.809 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac8ee83d:::benchmark_data_smithi018_166993_object20084:head# 2024-02-10T08:39:33.810 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.810 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac8f7e90:::benchmark_data_smithi018_166993_object57651:head# 2024-02-10T08:39:33.810 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.810 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac8f8a4f:::benchmark_data_smithi018_166993_object38512:head# 2024-02-10T08:39:33.810 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.810 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac8ffc38:::benchmark_data_smithi018_166993_object42754:head# 2024-02-10T08:39:33.810 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.810 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac904491:::benchmark_data_smithi018_166993_object102908:head# 2024-02-10T08:39:33.811 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.813 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac92a12f:::benchmark_data_smithi018_166993_object21593:head# 2024-02-10T08:39:33.813 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.815 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac92ce9c:::benchmark_data_smithi018_166993_object54898:head# 2024-02-10T08:39:33.815 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.817 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac92d276:::benchmark_data_smithi018_166993_object24686:head# 2024-02-10T08:39:33.817 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.818 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac939cd5:::benchmark_data_smithi018_166993_object40965:head# 2024-02-10T08:39:33.818 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.818 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac93b599:::benchmark_data_smithi018_166993_object70801:head# 2024-02-10T08:39:33.818 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.819 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac94ef0c:::benchmark_data_smithi018_166993_object43448:head# 2024-02-10T08:39:33.819 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.819 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac956c78:::benchmark_data_smithi018_166993_object18676:head# 2024-02-10T08:39:33.819 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.819 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac957324:::benchmark_data_smithi018_166993_object54145:head# 2024-02-10T08:39:33.819 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.819 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac95b950:::benchmark_data_smithi018_166993_object116441:head# 2024-02-10T08:39:33.820 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.820 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac95f8e0:::benchmark_data_smithi018_166993_object80345:head# 2024-02-10T08:39:33.820 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.821 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac974e0b:::benchmark_data_smithi018_166993_object95713:head# 2024-02-10T08:39:33.821 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.821 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac97b09f:::benchmark_data_smithi018_166993_object20898:head# 2024-02-10T08:39:33.821 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.821 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac97b8fb:::benchmark_data_smithi018_166993_object106254:head# 2024-02-10T08:39:33.821 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.821 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac985292:::benchmark_data_smithi018_166993_object33654:head# 2024-02-10T08:39:33.821 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.822 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac99a874:::benchmark_data_smithi018_166993_object82249:head# 2024-02-10T08:39:33.822 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.822 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac9b4069:::benchmark_data_smithi018_166993_object84908:head# 2024-02-10T08:39:33.822 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.822 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac9bd040:::benchmark_data_smithi018_166993_object22237:head# 2024-02-10T08:39:33.822 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.823 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac9c4820:::benchmark_data_smithi018_166993_object63493:head# 2024-02-10T08:39:33.823 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.823 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac9c7cd3:::benchmark_data_smithi018_166993_object77144:head# 2024-02-10T08:39:33.823 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.823 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac9ca38c:::benchmark_data_smithi018_166993_object69033:head# 2024-02-10T08:39:33.823 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.826 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac9e5c24:::benchmark_data_smithi018_166993_object90078:head# 2024-02-10T08:39:33.826 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.826 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac9e9a67:::benchmark_data_smithi018_166993_object112806:head# 2024-02-10T08:39:33.826 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.826 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ac9ec197:::benchmark_data_smithi018_166993_object78071:head# 2024-02-10T08:39:33.826 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.827 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aca0aff4:::benchmark_data_smithi018_166993_object98256:head# 2024-02-10T08:39:33.827 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.828 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aca14c9b:::benchmark_data_smithi018_166993_object71648:head# 2024-02-10T08:39:33.828 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.829 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aca28863:::benchmark_data_smithi018_166993_object95231:head# 2024-02-10T08:39:33.829 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.829 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aca3075c:::benchmark_data_smithi018_166993_object39523:head# 2024-02-10T08:39:33.829 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.829 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aca344d2:::benchmark_data_smithi018_166993_object69627:head# 2024-02-10T08:39:33.829 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.829 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aca4e601:::benchmark_data_smithi018_166993_object63018:head# 2024-02-10T08:39:33.829 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.830 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aca6d219:::benchmark_data_smithi018_166993_object24749:head# 2024-02-10T08:39:33.830 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.830 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aca71d8f:::benchmark_data_smithi018_166993_object40298:head# 2024-02-10T08:39:33.830 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.830 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aca72ad0:::benchmark_data_smithi018_166993_object84043:head# 2024-02-10T08:39:33.830 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.830 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aca78810:::benchmark_data_smithi018_166993_object107672:head# 2024-02-10T08:39:33.830 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.831 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aca7b881:::benchmark_data_smithi018_166993_object82513:head# 2024-02-10T08:39:33.831 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.831 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aca95c1e:::benchmark_data_smithi018_166993_object113975:head# 2024-02-10T08:39:33.831 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.832 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acab2a64:::benchmark_data_smithi018_166993_object30736:head# 2024-02-10T08:39:33.832 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.832 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acab38db:::benchmark_data_smithi018_166993_object55757:head# 2024-02-10T08:39:33.832 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.832 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acabb230:::benchmark_data_smithi018_166993_object109604:head# 2024-02-10T08:39:33.832 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.832 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acae4c4f:::benchmark_data_smithi018_166993_object34614:head# 2024-02-10T08:39:33.832 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.832 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acaed272:::benchmark_data_smithi018_166993_object118025:head# 2024-02-10T08:39:33.832 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.835 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acafc311:::benchmark_data_smithi018_166993_object108484:head# 2024-02-10T08:39:33.835 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.835 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acaff6d1:::benchmark_data_smithi018_166993_object19118:head# 2024-02-10T08:39:33.835 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.835 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acb0774c:::benchmark_data_smithi018_166993_object26038:head# 2024-02-10T08:39:33.835 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.837 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acb0bd5f:::benchmark_data_smithi018_166993_object71697:head# 2024-02-10T08:39:33.837 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.837 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acb17e93:::benchmark_data_smithi018_166993_object69044:head# 2024-02-10T08:39:33.837 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.838 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acb1dec8:::benchmark_data_smithi018_166993_object22800:head# 2024-02-10T08:39:33.838 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.838 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acb1ec15:::benchmark_data_smithi018_166993_object114867:head# 2024-02-10T08:39:33.838 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.838 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acb244a6:::benchmark_data_smithi018_166993_object116612:head# 2024-02-10T08:39:33.838 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.838 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acb2b039:::benchmark_data_smithi018_166993_object112084:head# 2024-02-10T08:39:33.838 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.838 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acb2e19b:::benchmark_data_smithi018_166993_object76502:head# 2024-02-10T08:39:33.838 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.838 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acb3058a:::benchmark_data_smithi018_166993_object51271:head# 2024-02-10T08:39:33.838 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.838 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acb30e0f:::benchmark_data_smithi018_166993_object92322:head# 2024-02-10T08:39:33.838 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.842 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acb31f56:::benchmark_data_smithi018_166993_object101137:head# 2024-02-10T08:39:33.842 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.842 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acb54e79:::benchmark_data_smithi018_166993_object42673:head# 2024-02-10T08:39:33.842 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.842 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acb7b36d:::benchmark_data_smithi018_166993_object59248:head# 2024-02-10T08:39:33.842 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.842 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acb838f8:::benchmark_data_smithi018_166993_object29598:head# 2024-02-10T08:39:33.842 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.842 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acb86eb0:::benchmark_data_smithi018_166993_object96434:head# 2024-02-10T08:39:33.842 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.842 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acb9a53f:::benchmark_data_smithi018_166993_object66658:head# 2024-02-10T08:39:33.842 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.843 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acba9338:::benchmark_data_smithi018_166993_object29577:head# 2024-02-10T08:39:33.843 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.843 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acbaa912:::benchmark_data_smithi018_166993_object22881:head# 2024-02-10T08:39:33.843 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.843 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acbb1b5b:::benchmark_data_smithi018_166993_object77518:head# 2024-02-10T08:39:33.843 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.843 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acbd26c2:::benchmark_data_smithi018_166993_object76877:head# 2024-02-10T08:39:33.843 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.843 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acbea462:::benchmark_data_smithi018_166993_object38672:head# 2024-02-10T08:39:33.843 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.843 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acbf2048:::benchmark_data_smithi018_166993_object25737:head# 2024-02-10T08:39:33.843 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.843 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acc002c3:::benchmark_data_smithi018_166993_object71925:head# 2024-02-10T08:39:33.843 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.843 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acc08ae2:::benchmark_data_smithi018_166993_object45708:head# 2024-02-10T08:39:33.844 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.844 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acc17b89:::benchmark_data_smithi018_166993_object111312:head# 2024-02-10T08:39:33.844 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.844 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acc18c4e:::benchmark_data_smithi018_166993_object21161:head# 2024-02-10T08:39:33.844 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.844 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acc291c4:::benchmark_data_smithi018_166993_object31664:head# 2024-02-10T08:39:33.844 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.844 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acc3460d:::benchmark_data_smithi018_166993_object114504:head# 2024-02-10T08:39:33.844 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.848 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acc3788d:::benchmark_data_smithi018_166993_object52984:head# 2024-02-10T08:39:33.848 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.848 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acc524da:::benchmark_data_smithi018_166993_object96443:head# 2024-02-10T08:39:33.848 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.848 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acc57839:::benchmark_data_smithi018_166993_object29019:head# 2024-02-10T08:39:33.848 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.849 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acc643bd:::benchmark_data_smithi018_166993_object102501:head# 2024-02-10T08:39:33.849 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.849 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acc67f7d:::benchmark_data_smithi018_166993_object22851:head# 2024-02-10T08:39:33.849 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.849 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acc74088:::benchmark_data_smithi018_166993_object98593:head# 2024-02-10T08:39:33.849 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.849 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acc7a7bc:::benchmark_data_smithi018_166993_object71776:head# 2024-02-10T08:39:33.849 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.849 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acc7d572:::benchmark_data_smithi018_166993_object35847:head# 2024-02-10T08:39:33.849 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.849 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acc8c507:::benchmark_data_smithi018_166993_object31983:head# 2024-02-10T08:39:33.849 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.849 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acc94e9b:::benchmark_data_smithi018_166993_object80814:head# 2024-02-10T08:39:33.849 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.849 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acc99d6e:::benchmark_data_smithi018_166993_object52576:head# 2024-02-10T08:39:33.850 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.850 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acca0a62:::benchmark_data_smithi018_166993_object81921:head# 2024-02-10T08:39:33.850 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.850 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acca2c1b:::benchmark_data_smithi018_166993_object95516:head# 2024-02-10T08:39:33.850 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.850 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:accbaad6:::benchmark_data_smithi018_166993_object65766:head# 2024-02-10T08:39:33.850 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.850 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:accd20e4:::benchmark_data_smithi018_166993_object83063:head# 2024-02-10T08:39:33.850 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.850 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:accd3ee1:::benchmark_data_smithi018_166993_object48433:head# 2024-02-10T08:39:33.850 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.850 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:accd4391:::benchmark_data_smithi018_166993_object52337:head# 2024-02-10T08:39:33.850 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.850 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:accd7266:::benchmark_data_smithi018_166993_object108615:head# 2024-02-10T08:39:33.850 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.851 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:accdf441:::benchmark_data_smithi018_166993_object90960:head# 2024-02-10T08:39:33.851 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.851 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acce7d46:::benchmark_data_smithi018_166993_object29705:head# 2024-02-10T08:39:33.851 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.851 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acced59e:::benchmark_data_smithi018_166993_object93930:head# 2024-02-10T08:39:33.851 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.851 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acd02851:::benchmark_data_smithi018_166993_object46708:head# 2024-02-10T08:39:33.851 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.852 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acd1de14:::benchmark_data_smithi018_166993_object90129:head# 2024-02-10T08:39:33.852 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.852 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acd23f6f:::benchmark_data_smithi018_166993_object71952:head# 2024-02-10T08:39:33.852 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.852 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acd33c45:::benchmark_data_smithi018_166993_object22596:head# 2024-02-10T08:39:33.852 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.852 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acd36cd8:::benchmark_data_smithi018_166993_object54304:head# 2024-02-10T08:39:33.852 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.855 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:33.856 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acd5b499:::benchmark_data_smithi018_166993_object117553:head# 2024-02-10T08:39:33.856 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.857 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acd694a1:::benchmark_data_smithi018_166993_object116432:head# 2024-02-10T08:39:33.857 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.857 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acd6c168:::benchmark_data_smithi018_166993_object37588:head# 2024-02-10T08:39:33.857 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.860 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acd7245a:::benchmark_data_smithi018_166993_object42442:head# 2024-02-10T08:39:33.860 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.860 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acd84f92:::benchmark_data_smithi018_166993_object47232:head# 2024-02-10T08:39:33.861 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.861 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acd853a3:::benchmark_data_smithi018_166993_object32682:head# 2024-02-10T08:39:33.861 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.861 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acd92a09:::benchmark_data_smithi018_166993_object94310:head# 2024-02-10T08:39:33.861 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.861 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acd961f2:::benchmark_data_smithi018_166993_object40981:head# 2024-02-10T08:39:33.862 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.862 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acd9875a:::benchmark_data_smithi018_166993_object88021:head# 2024-02-10T08:39:33.862 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.862 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acd9e721:::benchmark_data_smithi018_166993_object21516:head# 2024-02-10T08:39:33.862 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.864 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acdb8a6f:::benchmark_data_smithi018_166993_object84881:head# 2024-02-10T08:39:33.864 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.870 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acde5c10:::benchmark_data_smithi018_166993_object118516:head# 2024-02-10T08:39:33.871 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.871 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acdfbd4c:::benchmark_data_smithi018_166993_object87678:head# 2024-02-10T08:39:33.871 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.871 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acdfe035:::benchmark_data_smithi018_166993_object51617:head# 2024-02-10T08:39:33.871 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.871 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ace0b0a6:::benchmark_data_smithi018_166993_object74802:head# 2024-02-10T08:39:33.871 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.871 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ace10adf:::benchmark_data_smithi018_166993_object108236:head# 2024-02-10T08:39:33.871 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.871 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ace1395c:::benchmark_data_smithi018_166993_object18480:head# 2024-02-10T08:39:33.871 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.871 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ace1a52f:::benchmark_data_smithi018_166993_object51148:head# 2024-02-10T08:39:33.871 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.872 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ace1bdff:::benchmark_data_smithi018_166993_object52029:head# 2024-02-10T08:39:33.872 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.872 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ace23c96:::benchmark_data_smithi018_166993_object88210:head# 2024-02-10T08:39:33.872 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.872 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ace400dd:::benchmark_data_smithi018_166993_object102556:head# 2024-02-10T08:39:33.872 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.873 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ace45b9e:::benchmark_data_smithi018_166993_object100618:head# 2024-02-10T08:39:33.873 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.873 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ace490a9:::benchmark_data_smithi018_166993_object58151:head# 2024-02-10T08:39:33.874 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.874 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ace5e786:::benchmark_data_smithi018_166993_object85096:head# 2024-02-10T08:39:33.874 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.874 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ace5fbcd:::benchmark_data_smithi018_166993_object64568:head# 2024-02-10T08:39:33.874 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.874 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ace6012c:::benchmark_data_smithi018_166993_object84688:head# 2024-02-10T08:39:33.874 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.874 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ace65ff2:::benchmark_data_smithi018_166993_object40509:head# 2024-02-10T08:39:33.874 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.874 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ace6f1f1:::benchmark_data_smithi018_166993_object35314:head# 2024-02-10T08:39:33.874 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.874 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ace6ffe6:::benchmark_data_smithi018_166993_object95426:head# 2024-02-10T08:39:33.874 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.874 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ace86155:::benchmark_data_smithi018_166993_object83466:head# 2024-02-10T08:39:33.874 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.878 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ace9b977:::benchmark_data_smithi018_166993_object54088:head# 2024-02-10T08:39:33.878 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.878 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acea7339:::benchmark_data_smithi018_166993_object103722:head# 2024-02-10T08:39:33.878 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.878 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acea7ee2:::benchmark_data_smithi018_166993_object33324:head# 2024-02-10T08:39:33.878 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.878 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aceb0c64:::benchmark_data_smithi018_166993_object118636:head# 2024-02-10T08:39:33.878 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.878 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aceb0e5d:::benchmark_data_smithi018_166993_object48694:head# 2024-02-10T08:39:33.878 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.879 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aced282a:::benchmark_data_smithi018_166993_object91526:head# 2024-02-10T08:39:33.879 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.879 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aced437b:::benchmark_data_smithi018_166993_object112125:head# 2024-02-10T08:39:33.879 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.879 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acedea65:::benchmark_data_smithi018_166993_object78638:head# 2024-02-10T08:39:33.879 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.882 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acef8408:::benchmark_data_smithi018_166993_object76274:head# 2024-02-10T08:39:33.882 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.882 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acf09edc:::benchmark_data_smithi018_166993_object18949:head# 2024-02-10T08:39:33.882 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.882 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acf0e5ad:::benchmark_data_smithi018_166993_object25344:head# 2024-02-10T08:39:33.882 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.882 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acf19ae6:::benchmark_data_smithi018_166993_object62292:head# 2024-02-10T08:39:33.882 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.882 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acf43b0a:::benchmark_data_smithi018_166993_object85606:head# 2024-02-10T08:39:33.882 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.883 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acf5ff01:::benchmark_data_smithi018_166993_object117612:head# 2024-02-10T08:39:33.883 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.883 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acf7376c:::benchmark_data_smithi018_166993_object71968:head# 2024-02-10T08:39:33.883 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.883 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acf8025b:::benchmark_data_smithi018_166993_object57124:head# 2024-02-10T08:39:33.883 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.883 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acf96c83:::benchmark_data_smithi018_166993_object51250:head# 2024-02-10T08:39:33.883 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.883 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acf97f4c:::benchmark_data_smithi018_166993_object28410:head# 2024-02-10T08:39:33.883 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.883 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acfa412e:::benchmark_data_smithi018_166993_object88890:head# 2024-02-10T08:39:33.883 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.883 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acfb18f6:::benchmark_data_smithi018_166993_object68656:head# 2024-02-10T08:39:33.883 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.883 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acfb7bca:::benchmark_data_smithi018_166993_object101196:head# 2024-02-10T08:39:33.884 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.884 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acfc1531:::benchmark_data_smithi018_166993_object38905:head# 2024-02-10T08:39:33.884 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.884 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acfd6fee:::benchmark_data_smithi018_166993_object104605:head# 2024-02-10T08:39:33.884 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.884 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acfd99f8:::benchmark_data_smithi018_166993_object90626:head# 2024-02-10T08:39:33.884 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.884 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acfe1cee:::benchmark_data_smithi018_166993_object105662:head# 2024-02-10T08:39:33.884 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.887 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:acfe3dc6:::benchmark_data_smithi018_166993_object71555:head# 2024-02-10T08:39:33.887 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.887 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad000897:::benchmark_data_smithi018_166993_object91119:head# 2024-02-10T08:39:33.888 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.888 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad010345:::benchmark_data_smithi018_166993_object58882:head# 2024-02-10T08:39:33.888 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.888 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad01158d:::benchmark_data_smithi018_166993_object51291:head# 2024-02-10T08:39:33.888 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.888 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad01c8ff:::benchmark_data_smithi018_166993_object90810:head# 2024-02-10T08:39:33.888 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.888 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad01d0db:::benchmark_data_smithi018_166993_object50933:head# 2024-02-10T08:39:33.888 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.888 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad01f0e3:::benchmark_data_smithi018_166993_object36801:head# 2024-02-10T08:39:33.888 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.888 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad027037:::benchmark_data_smithi018_166993_object107636:head# 2024-02-10T08:39:33.888 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.889 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad0394e4:::benchmark_data_smithi018_166993_object101966:head# 2024-02-10T08:39:33.889 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.889 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad04191e:::benchmark_data_smithi018_166993_object30623:head# 2024-02-10T08:39:33.889 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.889 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad045683:::benchmark_data_smithi018_166993_object84112:head# 2024-02-10T08:39:33.889 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.889 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad049193:::benchmark_data_smithi018_166993_object33280:head# 2024-02-10T08:39:33.889 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.889 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad04e854:::benchmark_data_smithi018_166993_object30866:head# 2024-02-10T08:39:33.889 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.889 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad04f609:::benchmark_data_smithi018_166993_object65645:head# 2024-02-10T08:39:33.889 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.889 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad05a58b:::benchmark_data_smithi018_166993_object34079:head# 2024-02-10T08:39:33.889 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.889 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad07aaf8:::benchmark_data_smithi018_166993_object34162:head# 2024-02-10T08:39:33.890 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.890 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad07aed8:::benchmark_data_smithi018_166993_object44392:head# 2024-02-10T08:39:33.890 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.890 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad08551b:::benchmark_data_smithi018_166993_object86366:head# 2024-02-10T08:39:33.890 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.890 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad08da7c:::benchmark_data_smithi018_166993_object25683:head# 2024-02-10T08:39:33.890 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.890 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad09c3b0:::benchmark_data_smithi018_166993_object28152:head# 2024-02-10T08:39:33.890 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.892 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad0addd5:::benchmark_data_smithi018_166993_object36520:head# 2024-02-10T08:39:33.892 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.892 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad0b6193:::benchmark_data_smithi018_166993_object110857:head# 2024-02-10T08:39:33.892 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.892 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad0bb428:::benchmark_data_smithi018_166993_object49772:head# 2024-02-10T08:39:33.892 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.892 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad0c6c27:::benchmark_data_smithi018_166993_object78625:head# 2024-02-10T08:39:33.892 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.892 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad0d1711:::benchmark_data_smithi018_166993_object28558:head# 2024-02-10T08:39:33.892 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.892 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad0e8f42:::benchmark_data_smithi018_166993_object88593:head# 2024-02-10T08:39:33.892 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.893 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad0f93b1:::benchmark_data_smithi018_166993_object99422:head# 2024-02-10T08:39:33.893 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.893 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad0fbce2:::benchmark_data_smithi018_166993_object42692:head# 2024-02-10T08:39:33.893 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.893 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad108605:::benchmark_data_smithi018_166993_object88600:head# 2024-02-10T08:39:33.893 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.893 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad113d65:::benchmark_data_smithi018_166993_object117614:head# 2024-02-10T08:39:33.893 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.893 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad12495b:::benchmark_data_smithi018_166993_object48408:head# 2024-02-10T08:39:33.893 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.894 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad141ce9:::benchmark_data_smithi018_166993_object33653:head# 2024-02-10T08:39:33.894 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.895 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad14a729:::benchmark_data_smithi018_166993_object53372:head# 2024-02-10T08:39:33.895 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.895 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad14d2fb:::benchmark_data_smithi018_166993_object28646:head# 2024-02-10T08:39:33.895 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.895 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad1503fa:::benchmark_data_smithi018_166993_object100036:head# 2024-02-10T08:39:33.896 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.896 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad15a70f:::benchmark_data_smithi018_166993_object19552:head# 2024-02-10T08:39:33.896 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.900 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad15baf2:::benchmark_data_smithi018_166993_object62626:head# 2024-02-10T08:39:33.900 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.900 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad15d3b8:::benchmark_data_smithi018_166993_object82086:head# 2024-02-10T08:39:33.900 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.900 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad15f381:::benchmark_data_smithi018_166993_object50558:head# 2024-02-10T08:39:33.900 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.901 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad17f192:::benchmark_data_smithi018_166993_object95365:head# 2024-02-10T08:39:33.901 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.901 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad18cc92:::benchmark_data_smithi018_166993_object35637:head# 2024-02-10T08:39:33.901 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.901 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad18d37c:::benchmark_data_smithi018_166993_object64581:head# 2024-02-10T08:39:33.901 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.901 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad19f591:::benchmark_data_smithi018_166993_object69218:head# 2024-02-10T08:39:33.902 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:39:33.160804+0000 mgr.y (mgr.14505) 854 : cluster [DBG] pgmap v1048: 178 pgs: 5 active+undersized+degraded+remapped+backfilling, 173 active+clean; 3.8 GiB data, 16 GiB used, 609 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 904 op/s; 17474/186435 objects degraded (9.373%); 3.5 MiB/s, 55 objects/s recovering 2024-02-10T08:39:33.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:39:33.160804+0000 mgr.y (mgr.14505) 854 : cluster [DBG] pgmap v1048: 178 pgs: 5 active+undersized+degraded+remapped+backfilling, 173 active+clean; 3.8 GiB data, 16 GiB used, 609 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 904 op/s; 17474/186435 objects degraded (9.373%); 3.5 MiB/s, 55 objects/s recovering 2024-02-10T08:39:33.906 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad1b41a0:::benchmark_data_smithi018_166993_object90733:head# 2024-02-10T08:39:33.906 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.907 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad1bc6dc:::benchmark_data_smithi018_166993_object33217:head# 2024-02-10T08:39:33.907 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.907 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad1d10f1:::benchmark_data_smithi018_166993_object28744:head# 2024-02-10T08:39:33.907 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.913 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad1d755a:::benchmark_data_smithi018_166993_object87975:head# 2024-02-10T08:39:33.913 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.914 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad1d825b:::benchmark_data_smithi018_166993_object66192:head# 2024-02-10T08:39:33.915 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.915 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad1df33e:::benchmark_data_smithi018_166993_object50034:head# 2024-02-10T08:39:33.915 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.915 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad1ec165:::benchmark_data_smithi018_166993_object59830:head# 2024-02-10T08:39:33.915 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.917 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad1f20ae:::benchmark_data_smithi018_166993_object24859:head# 2024-02-10T08:39:33.917 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.917 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad1f2bd3:::benchmark_data_smithi018_166993_object101562:head# 2024-02-10T08:39:33.917 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.917 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad1f6ec1:::benchmark_data_smithi018_166993_object74895:head# 2024-02-10T08:39:33.917 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.917 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad1f9ee5:::benchmark_data_smithi018_166993_object112601:head# 2024-02-10T08:39:33.917 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.917 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad209ee6:::benchmark_data_smithi018_166993_object82139:head# 2024-02-10T08:39:33.917 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.917 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad2137fc:::benchmark_data_smithi018_166993_object55929:head# 2024-02-10T08:39:33.917 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.919 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad224978:::benchmark_data_smithi018_166993_object91142:head# 2024-02-10T08:39:33.919 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.919 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad2267a6:::benchmark_data_smithi018_166993_object117459:head# 2024-02-10T08:39:33.919 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.919 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad228ec9:::benchmark_data_smithi018_166993_object97595:head# 2024-02-10T08:39:33.919 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.920 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad22948f:::benchmark_data_smithi018_166993_object65027:head# 2024-02-10T08:39:33.920 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.920 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad237dcf:::benchmark_data_smithi018_166993_object89427:head# 2024-02-10T08:39:33.920 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.920 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad265355:::benchmark_data_smithi018_166993_object63800:head# 2024-02-10T08:39:33.920 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.920 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad26752f:::benchmark_data_smithi018_166993_object85917:head# 2024-02-10T08:39:33.920 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.920 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad26daf9:::benchmark_data_smithi018_166993_object118024:head# 2024-02-10T08:39:33.920 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.920 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad26e9a2:::benchmark_data_smithi018_166993_object114550:head# 2024-02-10T08:39:33.920 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.921 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad270075:::benchmark_data_smithi018_166993_object52731:head# 2024-02-10T08:39:33.921 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.921 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad27bef9:::benchmark_data_smithi018_166993_object68909:head# 2024-02-10T08:39:33.922 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.922 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad287046:::benchmark_data_smithi018_166993_object24747:head# 2024-02-10T08:39:33.922 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.922 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad289b0d:::benchmark_data_smithi018_166993_object34242:head# 2024-02-10T08:39:33.922 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.922 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad290700:::benchmark_data_smithi018_166993_object76893:head# 2024-02-10T08:39:33.922 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.922 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad2992fb:::benchmark_data_smithi018_166993_object53533:head# 2024-02-10T08:39:33.922 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.925 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad2a137e:::benchmark_data_smithi018_166993_object38254:head# 2024-02-10T08:39:33.925 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.927 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad2cfe92:::benchmark_data_smithi018_166993_object27730:head# 2024-02-10T08:39:33.927 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.932 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad2da25c:::benchmark_data_smithi018_166993_object85179:head# 2024-02-10T08:39:33.932 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.932 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad2e172a:::benchmark_data_smithi018_166993_object62997:head# 2024-02-10T08:39:33.933 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.933 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad2eb5c2:::benchmark_data_smithi018_166993_object25680:head# 2024-02-10T08:39:33.933 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.933 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad2ec3a2:::benchmark_data_smithi018_166993_object21249:head# 2024-02-10T08:39:33.933 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.933 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad2f04fa:::benchmark_data_smithi018_166993_object49846:head# 2024-02-10T08:39:33.933 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.933 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad2f288d:::benchmark_data_smithi018_166993_object95298:head# 2024-02-10T08:39:33.933 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.938 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad30fe9a:::benchmark_data_smithi018_166993_object37001:head# 2024-02-10T08:39:33.938 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.938 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad3108a2:::benchmark_data_smithi018_166993_object83111:head# 2024-02-10T08:39:33.939 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.939 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad31d35d:::benchmark_data_smithi018_166993_object48502:head# 2024-02-10T08:39:33.939 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.939 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad32c176:::benchmark_data_smithi018_166993_object29270:head# 2024-02-10T08:39:33.939 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.939 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad32d922:::benchmark_data_smithi018_166993_object83475:head# 2024-02-10T08:39:33.939 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.939 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad3324d7:::benchmark_data_smithi018_166993_object108225:head# 2024-02-10T08:39:33.939 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.942 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad336fc1:::benchmark_data_smithi018_166993_object69881:head# 2024-02-10T08:39:33.942 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.946 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad33f2df:::benchmark_data_smithi018_166993_object58250:head# 2024-02-10T08:39:33.946 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.946 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad34236e:::benchmark_data_smithi018_166993_object100655:head# 2024-02-10T08:39:33.946 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.949 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad348222:::benchmark_data_smithi018_166993_object88093:head# 2024-02-10T08:39:33.949 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.949 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad34b760:::benchmark_data_smithi018_166993_object50829:head# 2024-02-10T08:39:33.949 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.949 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad359f82:::benchmark_data_smithi018_166993_object52169:head# 2024-02-10T08:39:33.949 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.949 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad363f85:::benchmark_data_smithi018_166993_object91981:head# 2024-02-10T08:39:33.949 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.949 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad36e078:::benchmark_data_smithi018_166993_object99031:head# 2024-02-10T08:39:33.949 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.949 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad37184b:::benchmark_data_smithi018_166993_object86715:head# 2024-02-10T08:39:33.949 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.949 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad37353c:::benchmark_data_smithi018_166993_object18413:head# 2024-02-10T08:39:33.950 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.950 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad37555e:::benchmark_data_smithi018_166993_object25869:head# 2024-02-10T08:39:33.950 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.950 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad3a75e0:::benchmark_data_smithi018_166993_object90744:head# 2024-02-10T08:39:33.950 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.950 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad3aca93:::benchmark_data_smithi018_166993_object60209:head# 2024-02-10T08:39:33.950 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.950 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad3aee5f:::benchmark_data_smithi018_166993_object97309:head# 2024-02-10T08:39:33.951 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.952 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad3b799d:::benchmark_data_smithi018_166993_object44245:head# 2024-02-10T08:39:33.952 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.952 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad3bd1df:::benchmark_data_smithi018_166993_object110231:head# 2024-02-10T08:39:33.952 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.952 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad3d16c0:::benchmark_data_smithi018_166993_object112455:head# 2024-02-10T08:39:33.953 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.953 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad3d1e9e:::benchmark_data_smithi018_166993_object52974:head# 2024-02-10T08:39:33.953 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.953 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad3e3aea:::benchmark_data_smithi018_166993_object105402:head# 2024-02-10T08:39:33.953 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.954 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad4007e8:::benchmark_data_smithi018_166993_object52895:head# 2024-02-10T08:39:33.954 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.959 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad402206:::benchmark_data_smithi018_166993_object38106:head# 2024-02-10T08:39:33.959 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.959 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad405014:::benchmark_data_smithi018_166993_object116921:head# 2024-02-10T08:39:33.959 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.959 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad41087e:::benchmark_data_smithi018_166993_object117700:head# 2024-02-10T08:39:33.959 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.959 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad42a7f8:::benchmark_data_smithi018_166993_object49395:head# 2024-02-10T08:39:33.959 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.960 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad436b13:::benchmark_data_smithi018_166993_object61080:head# 2024-02-10T08:39:33.960 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.960 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad43c45e:::benchmark_data_smithi018_166993_object28277:head# 2024-02-10T08:39:33.960 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.960 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad448098:::benchmark_data_smithi018_166993_object116914:head# 2024-02-10T08:39:33.960 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.960 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad448bd4:::benchmark_data_smithi018_166993_object102243:head# 2024-02-10T08:39:33.960 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.960 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad44e114:::benchmark_data_smithi018_166993_object70266:head# 2024-02-10T08:39:33.960 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.960 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad44f04c:::benchmark_data_smithi018_166993_object76343:head# 2024-02-10T08:39:33.960 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.961 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad45e3bd:::benchmark_data_smithi018_166993_object23587:head# 2024-02-10T08:39:33.961 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.961 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad461ba9:::benchmark_data_smithi018_166993_object104213:head# 2024-02-10T08:39:33.961 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.961 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad4717c8:::benchmark_data_smithi018_166993_object56688:head# 2024-02-10T08:39:33.961 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.962 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad47d281:::benchmark_data_smithi018_166993_object63828:head# 2024-02-10T08:39:33.962 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.962 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad47f2db:::benchmark_data_smithi018_166993_object53842:head# 2024-02-10T08:39:33.962 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.962 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad487768:::benchmark_data_smithi018_166993_object18102:head# 2024-02-10T08:39:33.962 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.962 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad48e6c4:::benchmark_data_smithi018_166993_object112013:head# 2024-02-10T08:39:33.962 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.963 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad496216:::benchmark_data_smithi018_166993_object110380:head# 2024-02-10T08:39:33.963 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.963 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad4afedf:::benchmark_data_smithi018_166993_object65518:head# 2024-02-10T08:39:33.963 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.964 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad4b5736:::benchmark_data_smithi018_166993_object104366:head# 2024-02-10T08:39:33.965 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.965 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad4c4c8c:::benchmark_data_smithi018_166993_object30310:head# 2024-02-10T08:39:33.965 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.965 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad4c98e0:::benchmark_data_smithi018_166993_object97587:head# 2024-02-10T08:39:33.965 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.970 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad4cab6d:::benchmark_data_smithi018_166993_object27815:head# 2024-02-10T08:39:33.970 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.970 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad4cd851:::benchmark_data_smithi018_166993_object98427:head# 2024-02-10T08:39:33.970 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.970 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad4d38d8:::benchmark_data_smithi018_166993_object72479:head# 2024-02-10T08:39:33.970 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.977 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad4d5269:::benchmark_data_smithi018_166993_object32333:head# 2024-02-10T08:39:33.977 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.978 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad4df648:::benchmark_data_smithi018_166993_object71103:head# 2024-02-10T08:39:33.978 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.978 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad4e1111:::benchmark_data_smithi018_166993_object66818:head# 2024-02-10T08:39:33.978 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.978 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad4f9226:::benchmark_data_smithi018_166993_object56172:head# 2024-02-10T08:39:33.978 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.978 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad5152a4:::benchmark_data_smithi018_166993_object101089:head# 2024-02-10T08:39:33.978 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.978 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad519d94:::benchmark_data_smithi018_166993_object48383:head# 2024-02-10T08:39:33.978 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.978 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad5418bd:::benchmark_data_smithi018_166993_object44303:head# 2024-02-10T08:39:33.978 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.978 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad543890:::benchmark_data_smithi018_166993_object66161:head# 2024-02-10T08:39:33.979 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.979 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad549440:::benchmark_data_smithi018_166993_object56743:head# 2024-02-10T08:39:33.979 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.979 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad54e4c5:::benchmark_data_smithi018_166993_object80594:head# 2024-02-10T08:39:33.979 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.979 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad550d19:::benchmark_data_smithi018_166993_object110695:head# 2024-02-10T08:39:33.979 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.979 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad557a44:::benchmark_data_smithi018_166993_object40272:head# 2024-02-10T08:39:33.979 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.979 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad55b280:::benchmark_data_smithi018_166993_object31600:head# 2024-02-10T08:39:33.979 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.979 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad578fe7:::benchmark_data_smithi018_166993_object86799:head# 2024-02-10T08:39:33.979 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.979 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad57e535:::benchmark_data_smithi018_166993_object92171:head# 2024-02-10T08:39:33.980 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.980 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad589d87:::benchmark_data_smithi018_166993_object81332:head# 2024-02-10T08:39:33.980 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.980 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad5a7737:::benchmark_data_smithi018_166993_object57938:head# 2024-02-10T08:39:33.980 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.980 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad5ab98f:::benchmark_data_smithi018_166993_object95127:head# 2024-02-10T08:39:33.980 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.980 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad5b1d46:::benchmark_data_smithi018_166993_object22931:head# 2024-02-10T08:39:33.980 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.981 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad5cf28d:::benchmark_data_smithi018_166993_object53887:head# 2024-02-10T08:39:33.981 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.985 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad5d20cf:::benchmark_data_smithi018_166993_object92644:head# 2024-02-10T08:39:33.985 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.986 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad5d5b29:::benchmark_data_smithi018_166993_object60735:head# 2024-02-10T08:39:33.986 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.986 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad5dd8ab:::benchmark_data_smithi018_166993_object65690:head# 2024-02-10T08:39:33.986 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.986 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad5e7bd2:::benchmark_data_smithi018_166993_object110345:head# 2024-02-10T08:39:33.986 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.986 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad5ea332:::benchmark_data_smithi018_166993_object39697:head# 2024-02-10T08:39:33.986 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.986 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad5eaabc:::benchmark_data_smithi018_166993_object106320:head# 2024-02-10T08:39:33.986 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.986 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad5ef1a7:::benchmark_data_smithi018_166993_object27978:head# 2024-02-10T08:39:33.986 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.987 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad5f385b:::benchmark_data_smithi018_166993_object44526:head# 2024-02-10T08:39:33.988 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.988 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad604164:::benchmark_data_smithi018_166993_object18421:head# 2024-02-10T08:39:33.988 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.988 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad6199d8:::benchmark_data_smithi018_166993_object81994:head# 2024-02-10T08:39:33.988 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.988 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad622bff:::benchmark_data_smithi018_166993_object117309:head# 2024-02-10T08:39:33.988 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.988 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad667364:::benchmark_data_smithi018_166993_object114834:head# 2024-02-10T08:39:33.988 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.988 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad66e59f:::benchmark_data_smithi018_166993_object112284:head# 2024-02-10T08:39:33.988 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.988 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad673675:::benchmark_data_smithi018_166993_object50951:head# 2024-02-10T08:39:33.988 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.989 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad6893a3:::benchmark_data_smithi018_166993_object83840:head# 2024-02-10T08:39:33.989 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.989 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad69b0db:::benchmark_data_smithi018_166993_object103535:head# 2024-02-10T08:39:33.989 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.989 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad6a0d8e:::benchmark_data_smithi018_166993_object28086:head# 2024-02-10T08:39:33.990 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.990 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad6b1e57:::benchmark_data_smithi018_166993_object102520:head# 2024-02-10T08:39:33.990 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.990 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad6be2f4:::benchmark_data_smithi018_166993_object111610:head# 2024-02-10T08:39:33.990 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.991 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad6c65b2:::benchmark_data_smithi018_166993_object73068:head# 2024-02-10T08:39:33.991 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.991 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad6d7147:::benchmark_data_smithi018_166993_object60240:head# 2024-02-10T08:39:33.991 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:33.991 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad6db8e1:::benchmark_data_smithi018_166993_object60507:head# 2024-02-10T08:39:33.991 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.000 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad701fa3:::benchmark_data_smithi018_166993_object42191:head# 2024-02-10T08:39:34.001 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.003 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad70b00e:::benchmark_data_smithi018_166993_object25026:head# 2024-02-10T08:39:34.003 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.003 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad70b245:::benchmark_data_smithi018_166993_object79690:head# 2024-02-10T08:39:34.003 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.004 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad721ebc:::benchmark_data_smithi018_166993_object30629:head# 2024-02-10T08:39:34.004 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.004 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad727a31:::benchmark_data_smithi018_166993_object117140:head# 2024-02-10T08:39:34.004 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.004 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad72a825:::benchmark_data_smithi018_166993_object103515:head# 2024-02-10T08:39:34.004 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.005 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad73b5d8:::benchmark_data_smithi018_166993_object105920:head# 2024-02-10T08:39:34.005 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.005 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad73b812:::benchmark_data_smithi018_166993_object39487:head# 2024-02-10T08:39:34.006 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.006 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad73d7d6:::benchmark_data_smithi018_166993_object35206:head# 2024-02-10T08:39:34.006 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.006 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad746f98:::benchmark_data_smithi018_166993_object33460:head# 2024-02-10T08:39:34.006 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.006 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad770356:::benchmark_data_smithi018_166993_object42399:head# 2024-02-10T08:39:34.006 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.007 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad7784dd:::benchmark_data_smithi018_166993_object59162:head# 2024-02-10T08:39:34.007 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.007 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad77dfe2:::benchmark_data_smithi018_166993_object52666:head# 2024-02-10T08:39:34.007 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.007 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad77ef48:::benchmark_data_smithi018_166993_object85060:head# 2024-02-10T08:39:34.007 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.007 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad78b095:::benchmark_data_smithi018_166993_object84756:head# 2024-02-10T08:39:34.008 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.008 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad792ffd:::benchmark_data_smithi018_166993_object40105:head# 2024-02-10T08:39:34.008 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.008 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad795c37:::benchmark_data_smithi018_166993_object64834:head# 2024-02-10T08:39:34.008 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.010 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad79c977:::benchmark_data_smithi018_166993_object21859:head# 2024-02-10T08:39:34.010 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.013 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad7a23cd:::benchmark_data_smithi018_166993_object99989:head# 2024-02-10T08:39:34.013 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.014 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad7b4915:::benchmark_data_smithi018_166993_object63342:head# 2024-02-10T08:39:34.014 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.014 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad7b89e2:::benchmark_data_smithi018_166993_object78021:head# 2024-02-10T08:39:34.014 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.014 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad7c523c:::benchmark_data_smithi018_166993_object61998:head# 2024-02-10T08:39:34.015 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.015 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:39:34.016 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad7f6726:::benchmark_data_smithi018_166993_object77970:head# 2024-02-10T08:39:34.016 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.016 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad7f7daa:::benchmark_data_smithi018_166993_object40868:head# 2024-02-10T08:39:34.017 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.017 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad801252:::benchmark_data_smithi018_166993_object74513:head# 2024-02-10T08:39:34.017 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.017 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad80f1bb:::benchmark_data_smithi018_166993_object31638:head# 2024-02-10T08:39:34.017 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.017 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad820df3:::benchmark_data_smithi018_166993_object86184:head# 2024-02-10T08:39:34.017 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.017 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad82414b:::benchmark_data_smithi018_166993_object50788:head# 2024-02-10T08:39:34.017 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.017 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad8296af:::benchmark_data_smithi018_166993_object96564:head# 2024-02-10T08:39:34.017 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.018 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad830edf:::benchmark_data_smithi018_166993_object42670:head# 2024-02-10T08:39:34.018 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.018 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad83797a:::benchmark_data_smithi018_166993_object61256:head# 2024-02-10T08:39:34.019 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.019 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad83e901:::benchmark_data_smithi018_166993_object42360:head# 2024-02-10T08:39:34.019 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.019 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad84a141:::benchmark_data_smithi018_166993_object69039:head# 2024-02-10T08:39:34.020 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.020 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad84c4b3:::benchmark_data_smithi018_166993_object66471:head# 2024-02-10T08:39:34.020 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.020 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad854743:::benchmark_data_smithi018_166993_object21949:head# 2024-02-10T08:39:34.020 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.021 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:34.022 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:39:34.023 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad86fcae:::benchmark_data_smithi018_166993_object43580:head# 2024-02-10T08:39:34.023 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.023 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad874618:::benchmark_data_smithi018_166993_object115239:head# 2024-02-10T08:39:34.023 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.023 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad874edd:::benchmark_data_smithi018_166993_object63999:head# 2024-02-10T08:39:34.023 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.023 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad887627:::benchmark_data_smithi018_166993_object47993:head# 2024-02-10T08:39:34.023 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.024 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad899c3f:::benchmark_data_smithi018_166993_object117173:head# 2024-02-10T08:39:34.024 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.024 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad8b7185:::benchmark_data_smithi018_166993_object24284:head# 2024-02-10T08:39:34.024 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.024 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad8bb6c6:::benchmark_data_smithi018_166993_object23791:head# 2024-02-10T08:39:34.024 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.024 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad8be744:::benchmark_data_smithi018_166993_object108986:head# 2024-02-10T08:39:34.024 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.024 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad8e2943:::benchmark_data_smithi018_166993_object80084:head# 2024-02-10T08:39:34.024 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.024 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad8e7ecb:::benchmark_data_smithi018_166993_object82420:head# 2024-02-10T08:39:34.024 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.024 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad8f2dfc:::benchmark_data_smithi018_166993_object29542:head# 2024-02-10T08:39:34.024 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.025 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad9016ca:::benchmark_data_smithi018_166993_object77237:head# 2024-02-10T08:39:34.025 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.025 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad91e659:::benchmark_data_smithi018_166993_object57278:head# 2024-02-10T08:39:34.025 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.029 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad920ba8:::benchmark_data_smithi018_166993_object98796:head# 2024-02-10T08:39:34.029 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.029 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad944168:::benchmark_data_smithi018_166993_object87863:head# 2024-02-10T08:39:34.029 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.029 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad9674ef:::benchmark_data_smithi018_166993_object43162:head# 2024-02-10T08:39:34.029 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.029 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad98668a:::benchmark_data_smithi018_166993_object89210:head# 2024-02-10T08:39:34.029 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.029 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad989c5d:::benchmark_data_smithi018_166993_object31053:head# 2024-02-10T08:39:34.029 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.029 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad995813:::benchmark_data_smithi018_166993_object34833:head# 2024-02-10T08:39:34.029 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.029 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad9a126d:::benchmark_data_smithi018_166993_object80760:head# 2024-02-10T08:39:34.029 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.030 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad9afa7f:::benchmark_data_smithi018_166993_object106239:head# 2024-02-10T08:39:34.030 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.030 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad9bad5b:::benchmark_data_smithi018_166993_object114019:head# 2024-02-10T08:39:34.030 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.030 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad9bc7ff:::benchmark_data_smithi018_166993_object89430:head# 2024-02-10T08:39:34.030 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.030 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad9c4dde:::benchmark_data_smithi018_166993_object83232:head# 2024-02-10T08:39:34.030 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.030 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad9c5cca:::benchmark_data_smithi018_166993_object25487:head# 2024-02-10T08:39:34.030 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.030 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad9c5d43:::benchmark_data_smithi018_166993_object21937:head# 2024-02-10T08:39:34.030 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.030 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad9cef53:::benchmark_data_smithi018_166993_object76146:head# 2024-02-10T08:39:34.030 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.030 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad9d15ce:::benchmark_data_smithi018_166993_object96230:head# 2024-02-10T08:39:34.031 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.031 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad9d361a:::benchmark_data_smithi018_166993_object61441:head# 2024-02-10T08:39:34.031 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.031 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad9d3ddb:::benchmark_data_smithi018_166993_object98229:head# 2024-02-10T08:39:34.031 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.031 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad9f0447:::benchmark_data_smithi018_166993_object63884:head# 2024-02-10T08:39:34.031 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.031 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ad9fa853:::benchmark_data_smithi018_166993_object17561:head# 2024-02-10T08:39:34.031 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.031 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ada0a60f:::benchmark_data_smithi018_166993_object38641:head# 2024-02-10T08:39:34.031 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.031 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ada19816:::benchmark_data_smithi018_166993_object79259:head# 2024-02-10T08:39:34.031 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.031 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ada1a54b:::benchmark_data_smithi018_166993_object106371:head# 2024-02-10T08:39:34.031 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.032 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ada1c349:::benchmark_data_smithi018_166993_object20600:head# 2024-02-10T08:39:34.032 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.032 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ada3a994:::benchmark_data_smithi018_166993_object60855:head# 2024-02-10T08:39:34.032 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.032 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ada3ae6a:::benchmark_data_smithi018_166993_object31075:head# 2024-02-10T08:39:34.032 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.032 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ada3c496:::benchmark_data_smithi018_166993_object107692:head# 2024-02-10T08:39:34.033 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.033 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ada4760d:::benchmark_data_smithi018_166993_object99111:head# 2024-02-10T08:39:34.033 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.033 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ada534a0:::benchmark_data_smithi018_166993_object116646:head# 2024-02-10T08:39:34.033 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.033 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ada590f9:::benchmark_data_smithi018_166993_object64075:head# 2024-02-10T08:39:34.033 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.033 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ada5c2c2:::benchmark_data_smithi018_166993_object84553:head# 2024-02-10T08:39:34.033 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.033 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ada719d4:::benchmark_data_smithi018_166993_object113419:head# 2024-02-10T08:39:34.033 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.034 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ada75fb8:::benchmark_data_smithi018_166993_object45330:head# 2024-02-10T08:39:34.034 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.034 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ada81582:::benchmark_data_smithi018_166993_object110136:head# 2024-02-10T08:39:34.035 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.035 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ada8711a:::benchmark_data_smithi018_166993_object30974:head# 2024-02-10T08:39:34.035 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.035 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ada8e62c:::benchmark_data_smithi018_166993_object100858:head# 2024-02-10T08:39:34.035 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.035 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adaa93eb:::benchmark_data_smithi018_166993_object92726:head# 2024-02-10T08:39:34.035 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.035 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adaaa6d5:::benchmark_data_smithi018_166993_object28267:head# 2024-02-10T08:39:34.035 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.035 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adacfa1e:::benchmark_data_smithi018_166993_object31236:head# 2024-02-10T08:39:34.036 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.036 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adadc978:::benchmark_data_smithi018_166993_object44452:head# 2024-02-10T08:39:34.036 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.036 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adae4162:::benchmark_data_smithi018_166993_object19665:head# 2024-02-10T08:39:34.036 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.037 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adae514c:::benchmark_data_smithi018_166993_object29295:head# 2024-02-10T08:39:34.037 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.037 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adae6fb5:::benchmark_data_smithi018_166993_object36376:head# 2024-02-10T08:39:34.037 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.037 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adaea92c:::benchmark_data_smithi018_166993_object30379:head# 2024-02-10T08:39:34.037 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.038 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adaeaa6f:::benchmark_data_smithi018_166993_object84877:head# 2024-02-10T08:39:34.038 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.038 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adb2a36e:::benchmark_data_smithi018_166993_object116030:head# 2024-02-10T08:39:34.038 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.039 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adb3023a:::benchmark_data_smithi018_166993_object108874:head# 2024-02-10T08:39:34.039 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.039 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adb51129:::benchmark_data_smithi018_166993_object81182:head# 2024-02-10T08:39:34.039 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.039 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adb545ce:::benchmark_data_smithi018_166993_object73354:head# 2024-02-10T08:39:34.039 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:39:33.160804+0000 mgr.y (mgr.14505) 854 : cluster [DBG] pgmap v1048: 178 pgs: 5 active+undersized+degraded+remapped+backfilling, 173 active+clean; 3.8 GiB data, 16 GiB used, 609 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 904 op/s; 17474/186435 objects degraded (9.373%); 3.5 MiB/s, 55 objects/s recovering 2024-02-10T08:39:34.040 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adb5a937:::benchmark_data_smithi018_166993_object94093:head# 2024-02-10T08:39:34.040 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.040 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adb5b4b5:::benchmark_data_smithi018_166993_object70957:head# 2024-02-10T08:39:34.040 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.040 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adb62405:::benchmark_data_smithi018_166993_object37451:head# 2024-02-10T08:39:34.041 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.041 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adb7a627:::benchmark_data_smithi018_166993_object114044:head# 2024-02-10T08:39:34.041 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.044 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adb82dd0:::benchmark_data_smithi018_166993_object26174:head# 2024-02-10T08:39:34.044 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.044 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adb9da32:::benchmark_data_smithi018_166993_object30661:head# 2024-02-10T08:39:34.044 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.044 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adba5f2c:::benchmark_data_smithi018_166993_object91907:head# 2024-02-10T08:39:34.044 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.044 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adba821b:::benchmark_data_smithi018_166993_object24760:head# 2024-02-10T08:39:34.044 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.044 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adbb337c:::benchmark_data_smithi018_166993_object58858:head# 2024-02-10T08:39:34.045 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.045 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adbbd052:::benchmark_data_smithi018_166993_object61971:head# 2024-02-10T08:39:34.045 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.045 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adbc4803:::benchmark_data_smithi018_166993_object36594:head# 2024-02-10T08:39:34.045 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.045 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adbc49ca:::benchmark_data_smithi018_166993_object17572:head# 2024-02-10T08:39:34.046 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.046 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adbc74a9:::benchmark_data_smithi018_166993_object112359:head# 2024-02-10T08:39:34.046 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.046 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adbcdbc7:::benchmark_data_smithi018_166993_object65910:head# 2024-02-10T08:39:34.046 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.046 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adbd5a27:::benchmark_data_smithi018_166993_object31297:head# 2024-02-10T08:39:34.046 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.046 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adbd80fc:::benchmark_data_smithi018_166993_object21147:head# 2024-02-10T08:39:34.047 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.047 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adbe059a:::benchmark_data_smithi018_166993_object85402:head# 2024-02-10T08:39:34.047 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.047 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adbe3449:::benchmark_data_smithi018_166993_object63253:head# 2024-02-10T08:39:34.047 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.047 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adbe3cd0:::benchmark_data_smithi018_166993_object91376:head# 2024-02-10T08:39:34.047 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.047 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adbe55de:::benchmark_data_smithi018_166993_object82653:head# 2024-02-10T08:39:34.047 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.047 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adbe6e05:::benchmark_data_smithi018_166993_object60987:head# 2024-02-10T08:39:34.047 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.048 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adbe7cde:::benchmark_data_smithi018_166993_object72343:head# 2024-02-10T08:39:34.048 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.049 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adbf3956:::benchmark_data_smithi018_166993_object64483:head# 2024-02-10T08:39:34.049 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.049 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adc1f226:::benchmark_data_smithi018_166993_object116002:head# 2024-02-10T08:39:34.049 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.049 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adc2066f:::benchmark_data_smithi018_166993_object113371:head# 2024-02-10T08:39:34.049 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.049 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adc2bde7:::benchmark_data_smithi018_166993_object30352:head# 2024-02-10T08:39:34.049 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.049 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adc32db0:::benchmark_data_smithi018_166993_object19975:head# 2024-02-10T08:39:34.049 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.049 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adc3caa4:::benchmark_data_smithi018_166993_object76700:head# 2024-02-10T08:39:34.049 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.049 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adc4b0d9:::benchmark_data_smithi018_166993_object106128:head# 2024-02-10T08:39:34.049 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.053 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adc4bcd9:::benchmark_data_smithi018_166993_object100580:head# 2024-02-10T08:39:34.053 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.053 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adc520e1:::benchmark_data_smithi018_166993_object109438:head# 2024-02-10T08:39:34.053 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.053 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adc57afc:::benchmark_data_smithi018_166993_object33206:head# 2024-02-10T08:39:34.053 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.053 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adc6331d:::benchmark_data_smithi018_166993_object95327:head# 2024-02-10T08:39:34.053 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.053 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adc7df6b:::benchmark_data_smithi018_166993_object38294:head# 2024-02-10T08:39:34.053 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.053 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adc83edd:::benchmark_data_smithi018_166993_object32427:head# 2024-02-10T08:39:34.053 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.053 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adc94e23:::benchmark_data_smithi018_166993_object21485:head# 2024-02-10T08:39:34.054 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.054 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adca319f:::benchmark_data_smithi018_166993_object62676:head# 2024-02-10T08:39:34.054 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.054 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adca8a15:::benchmark_data_smithi018_166993_object57190:head# 2024-02-10T08:39:34.054 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.054 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adca9ad2:::benchmark_data_smithi018_166993_object106217:head# 2024-02-10T08:39:34.054 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.054 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adcae31e:::benchmark_data_smithi018_166993_object29392:head# 2024-02-10T08:39:34.054 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.054 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adcb0bfd:::benchmark_data_smithi018_166993_object65116:head# 2024-02-10T08:39:34.054 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.054 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adcb128c:::benchmark_data_smithi018_166993_object108233:head# 2024-02-10T08:39:34.054 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.054 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adcb2c48:::benchmark_data_smithi018_166993_object95181:head# 2024-02-10T08:39:34.054 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.055 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adcc8714:::benchmark_data_smithi018_166993_object101856:head# 2024-02-10T08:39:34.055 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.055 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adce85a5:::benchmark_data_smithi018_166993_object116035:head# 2024-02-10T08:39:34.055 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.055 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adcef313:::benchmark_data_smithi018_166993_object83896:head# 2024-02-10T08:39:34.055 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.055 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adcf75dd:::benchmark_data_smithi018_166993_object79161:head# 2024-02-10T08:39:34.055 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.057 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adcfba8b:::benchmark_data_smithi018_166993_object92238:head# 2024-02-10T08:39:34.057 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.057 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adcfd397:::benchmark_data_smithi018_166993_object83843:head# 2024-02-10T08:39:34.057 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.057 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:add0032d:::benchmark_data_smithi018_166993_object107008:head# 2024-02-10T08:39:34.057 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.057 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:add0437c:::benchmark_data_smithi018_166993_object81579:head# 2024-02-10T08:39:34.057 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.057 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:add05d12:::benchmark_data_smithi018_166993_object62994:head# 2024-02-10T08:39:34.057 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.057 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:add08461:::benchmark_data_smithi018_166993_object96190:head# 2024-02-10T08:39:34.059 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.059 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:add1c0bc:::benchmark_data_smithi018_166993_object38497:head# 2024-02-10T08:39:34.059 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.059 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:add22b29:::benchmark_data_smithi018_166993_object92183:head# 2024-02-10T08:39:34.059 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.059 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:add2453e:::benchmark_data_smithi018_166993_object26892:head# 2024-02-10T08:39:34.059 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.059 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:add41687:::benchmark_data_smithi018_166993_object52038:head# 2024-02-10T08:39:34.059 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.060 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:add42127:::benchmark_data_smithi018_166993_object98104:head# 2024-02-10T08:39:34.060 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.065 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:add805bb:::benchmark_data_smithi018_166993_object26348:head# 2024-02-10T08:39:34.065 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.066 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:add80ee6:::benchmark_data_smithi018_166993_object53248:head# 2024-02-10T08:39:34.066 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.067 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:add8153d:::benchmark_data_smithi018_166993_object80683:head# 2024-02-10T08:39:34.067 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.067 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:add8674e:::benchmark_data_smithi018_166993_object30068:head# 2024-02-10T08:39:34.067 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.067 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:add8e8c4:::benchmark_data_smithi018_166993_object108310:head# 2024-02-10T08:39:34.067 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.068 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adda640b:::benchmark_data_smithi018_166993_object62537:head# 2024-02-10T08:39:34.068 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.068 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adda9e67:::benchmark_data_smithi018_166993_object21260:head# 2024-02-10T08:39:34.068 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.070 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:addac7e6:::benchmark_data_smithi018_166993_object73665:head# 2024-02-10T08:39:34.070 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.071 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:addafc40:::benchmark_data_smithi018_166993_object67748:head# 2024-02-10T08:39:34.071 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.071 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:addafeaf:::benchmark_data_smithi018_166993_object55465:head# 2024-02-10T08:39:34.071 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.071 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:addb2d69:::benchmark_data_smithi018_166993_object90234:head# 2024-02-10T08:39:34.071 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.073 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:addb80e7:::benchmark_data_smithi018_166993_object88587:head# 2024-02-10T08:39:34.073 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.073 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:addc07d0:::benchmark_data_smithi018_166993_object86667:head# 2024-02-10T08:39:34.073 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.073 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:addc4d88:::benchmark_data_smithi018_166993_object20394:head# 2024-02-10T08:39:34.073 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.073 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:addc907c:::benchmark_data_smithi018_166993_object25882:head# 2024-02-10T08:39:34.073 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.073 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:addc9ef4:::benchmark_data_smithi018_166993_object94982:head# 2024-02-10T08:39:34.073 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.073 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:addef815:::benchmark_data_smithi018_166993_object106101:head# 2024-02-10T08:39:34.073 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.073 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:addf2a04:::benchmark_data_smithi018_166993_object22564:head# 2024-02-10T08:39:34.073 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.075 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:addf3fcc:::benchmark_data_smithi018_166993_object116919:head# 2024-02-10T08:39:34.075 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.075 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ade03ad9:::benchmark_data_smithi018_166993_object79563:head# 2024-02-10T08:39:34.075 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.075 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ade2809c:::benchmark_data_smithi018_166993_object52100:head# 2024-02-10T08:39:34.075 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.075 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ade3233f:::benchmark_data_smithi018_166993_object113019:head# 2024-02-10T08:39:34.076 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.076 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ade54dd4:::benchmark_data_smithi018_166993_object53193:head# 2024-02-10T08:39:34.076 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.076 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ade573a6:::benchmark_data_smithi018_166993_object51612:head# 2024-02-10T08:39:34.076 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.076 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ade5c3bd:::benchmark_data_smithi018_166993_object117220:head# 2024-02-10T08:39:34.076 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.076 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ade5e229:::benchmark_data_smithi018_166993_object70037:head# 2024-02-10T08:39:34.076 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.077 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ade890e5:::benchmark_data_smithi018_166993_object96722:head# 2024-02-10T08:39:34.077 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.077 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adea111d:::benchmark_data_smithi018_166993_object29323:head# 2024-02-10T08:39:34.077 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.077 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adeb072d:::benchmark_data_smithi018_166993_object79805:head# 2024-02-10T08:39:34.077 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.077 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adec7afb:::benchmark_data_smithi018_166993_object45211:head# 2024-02-10T08:39:34.077 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.079 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aded6bdc:::benchmark_data_smithi018_166993_object104290:head# 2024-02-10T08:39:34.079 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.080 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adee0412:::benchmark_data_smithi018_166993_object22685:head# 2024-02-10T08:39:34.080 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.080 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adee8633:::benchmark_data_smithi018_166993_object41645:head# 2024-02-10T08:39:34.080 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.080 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adefa131:::benchmark_data_smithi018_166993_object36300:head# 2024-02-10T08:39:34.080 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.081 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adf0b88f:::benchmark_data_smithi018_166993_object64447:head# 2024-02-10T08:39:34.082 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.082 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adf12847:::benchmark_data_smithi018_166993_object55852:head# 2024-02-10T08:39:34.082 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.082 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adf1337c:::benchmark_data_smithi018_166993_object98431:head# 2024-02-10T08:39:34.082 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.082 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adf16d8d:::benchmark_data_smithi018_166993_object105070:head# 2024-02-10T08:39:34.082 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.082 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adf199ed:::benchmark_data_smithi018_166993_object28168:head# 2024-02-10T08:39:34.082 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.082 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adf19f70:::benchmark_data_smithi018_166993_object86451:head# 2024-02-10T08:39:34.082 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.082 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adf1ccbd:::benchmark_data_smithi018_166993_object82311:head# 2024-02-10T08:39:34.082 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.084 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adf29ba1:::benchmark_data_smithi018_166993_object55314:head# 2024-02-10T08:39:34.084 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.084 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adf2b7d5:::benchmark_data_smithi018_166993_object46375:head# 2024-02-10T08:39:34.084 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.084 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adf2e4ec:::benchmark_data_smithi018_166993_object60769:head# 2024-02-10T08:39:34.084 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.084 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adf4dc0b:::benchmark_data_smithi018_166993_object60851:head# 2024-02-10T08:39:34.084 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.084 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adf5230e:::benchmark_data_smithi018_166993_object41420:head# 2024-02-10T08:39:34.084 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.084 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adf5283b:::benchmark_data_smithi018_166993_object76164:head# 2024-02-10T08:39:34.085 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.085 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adf80593:::benchmark_data_smithi018_166993_object99014:head# 2024-02-10T08:39:34.085 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.085 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adf87fb0:::benchmark_data_smithi018_166993_object26862:head# 2024-02-10T08:39:34.085 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.086 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adfa2b40:::benchmark_data_smithi018_166993_object112534:head# 2024-02-10T08:39:34.086 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.086 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adfa3d08:::benchmark_data_smithi018_166993_object20979:head# 2024-02-10T08:39:34.086 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.087 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adfa9acf:::benchmark_data_smithi018_166993_object106117:head# 2024-02-10T08:39:34.087 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.087 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adfd6446:::benchmark_data_smithi018_166993_object112901:head# 2024-02-10T08:39:34.087 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.087 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adfd7543:::benchmark_data_smithi018_166993_object84890:head# 2024-02-10T08:39:34.087 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.088 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adfe245f:::benchmark_data_smithi018_166993_object74816:head# 2024-02-10T08:39:34.088 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.088 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adfe5a18:::benchmark_data_smithi018_166993_object87791:head# 2024-02-10T08:39:34.088 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.089 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:adffdcf0:::benchmark_data_smithi018_166993_object70744:head# 2024-02-10T08:39:34.089 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.089 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae003889:::benchmark_data_smithi018_166993_object49864:head# 2024-02-10T08:39:34.089 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.089 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae020580:::benchmark_data_smithi018_166993_object28319:head# 2024-02-10T08:39:34.089 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.089 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae02a536:::benchmark_data_smithi018_166993_object17482:head# 2024-02-10T08:39:34.089 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.091 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae033079:::benchmark_data_smithi018_166993_object22952:head# 2024-02-10T08:39:34.091 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.091 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae04d847:::benchmark_data_smithi018_166993_object66805:head# 2024-02-10T08:39:34.091 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.091 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae058357:::benchmark_data_smithi018_166993_object73034:head# 2024-02-10T08:39:34.091 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.091 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae05881c:::benchmark_data_smithi018_166993_object26049:head# 2024-02-10T08:39:34.091 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.091 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae06e69b:::benchmark_data_smithi018_166993_object67642:head# 2024-02-10T08:39:34.091 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.091 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae07cea9:::benchmark_data_smithi018_166993_object99895:head# 2024-02-10T08:39:34.092 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.092 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae0810cd:::benchmark_data_smithi018_166993_object111908:head# 2024-02-10T08:39:34.092 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.092 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae08664c:::benchmark_data_smithi018_166993_object105578:head# 2024-02-10T08:39:34.092 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.092 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae097834:::benchmark_data_smithi018_166993_object73766:head# 2024-02-10T08:39:34.092 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.092 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae098c74:::benchmark_data_smithi018_166993_object41518:head# 2024-02-10T08:39:34.092 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.092 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae09a57f:::benchmark_data_smithi018_166993_object90647:head# 2024-02-10T08:39:34.092 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.094 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae09c16e:::benchmark_data_smithi018_166993_object82937:head# 2024-02-10T08:39:34.094 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.094 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae0a8377:::benchmark_data_smithi018_166993_object52758:head# 2024-02-10T08:39:34.094 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.094 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae0a9fa5:::benchmark_data_smithi018_166993_object98644:head# 2024-02-10T08:39:34.094 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.094 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae0ac052:::benchmark_data_smithi018_166993_object32407:head# 2024-02-10T08:39:34.094 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.095 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae0d6044:::benchmark_data_smithi018_166993_object99555:head# 2024-02-10T08:39:34.095 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.095 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae0d7268:::benchmark_data_smithi018_166993_object103049:head# 2024-02-10T08:39:34.095 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.095 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae0db75f:::benchmark_data_smithi018_166993_object42654:head# 2024-02-10T08:39:34.095 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.095 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae0f901a:::benchmark_data_smithi018_166993_object50324:head# 2024-02-10T08:39:34.095 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.095 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae107942:::benchmark_data_smithi018_166993_object109193:head# 2024-02-10T08:39:34.095 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.101 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae115572:::benchmark_data_smithi018_166993_object26045:head# 2024-02-10T08:39:34.101 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.111 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae11ee92:::benchmark_data_smithi018_166993_object117570:head# 2024-02-10T08:39:34.112 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.112 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae1241e7:::benchmark_data_smithi018_166993_object84465:head# 2024-02-10T08:39:34.112 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.112 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae127be6:::benchmark_data_smithi018_166993_object37850:head# 2024-02-10T08:39:34.112 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.112 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae129b29:::benchmark_data_smithi018_166993_object50976:head# 2024-02-10T08:39:34.112 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.112 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae13b497:::benchmark_data_smithi018_166993_object49607:head# 2024-02-10T08:39:34.112 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.112 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae1577d9:::benchmark_data_smithi018_166993_object84492:head# 2024-02-10T08:39:34.112 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.112 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae162db0:::benchmark_data_smithi018_166993_object103636:head# 2024-02-10T08:39:34.112 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.113 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae16cefb:::benchmark_data_smithi018_166993_object103461:head# 2024-02-10T08:39:34.113 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.113 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae173ee8:::benchmark_data_smithi018_166993_object68057:head# 2024-02-10T08:39:34.113 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.113 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae184f66:::benchmark_data_smithi018_166993_object53825:head# 2024-02-10T08:39:34.113 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.113 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae1a33e1:::benchmark_data_smithi018_166993_object31314:head# 2024-02-10T08:39:34.113 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.113 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae1a5157:::benchmark_data_smithi018_166993_object32495:head# 2024-02-10T08:39:34.113 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.113 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae1a67bd:::benchmark_data_smithi018_166993_object58722:head# 2024-02-10T08:39:34.114 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.114 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae1a8c98:::benchmark_data_smithi018_166993_object64783:head# 2024-02-10T08:39:34.114 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.114 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae1add0b:::benchmark_data_smithi018_166993_object89394:head# 2024-02-10T08:39:34.114 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.116 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae1b0794:::benchmark_data_smithi018_166993_object90268:head# 2024-02-10T08:39:34.116 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.116 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae1bb0c4:::benchmark_data_smithi018_166993_object103099:head# 2024-02-10T08:39:34.116 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.116 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae1bcf6f:::benchmark_data_smithi018_166993_object118518:head# 2024-02-10T08:39:34.116 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.116 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae1bfd85:::benchmark_data_smithi018_166993_object43660:head# 2024-02-10T08:39:34.116 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.116 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae1c6a44:::benchmark_data_smithi018_166993_object92539:head# 2024-02-10T08:39:34.116 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.116 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae1cdc29:::benchmark_data_smithi018_166993_object44285:head# 2024-02-10T08:39:34.116 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.117 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae1d3b99:::benchmark_data_smithi018_166993_object84073:head# 2024-02-10T08:39:34.117 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.117 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae1e3f9d:::benchmark_data_smithi018_166993_object42962:head# 2024-02-10T08:39:34.117 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.117 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae1f0294:::benchmark_data_smithi018_166993_object25063:head# 2024-02-10T08:39:34.117 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.118 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae1f67a3:::benchmark_data_smithi018_166993_object108556:head# 2024-02-10T08:39:34.118 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.118 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae20344a:::benchmark_data_smithi018_166993_object80421:head# 2024-02-10T08:39:34.118 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.118 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae208a7d:::benchmark_data_smithi018_166993_object62348:head# 2024-02-10T08:39:34.118 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.118 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae20d8d7:::benchmark_data_smithi018_166993_object103407:head# 2024-02-10T08:39:34.118 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.119 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae218698:::benchmark_data_smithi018_166993_object34235:head# 2024-02-10T08:39:34.119 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.119 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae21de89:::benchmark_data_smithi018_166993_object20936:head# 2024-02-10T08:39:34.119 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.119 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae220b36:::benchmark_data_smithi018_166993_object109712:head# 2024-02-10T08:39:34.119 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.119 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae22b960:::benchmark_data_smithi018_166993_object35326:head# 2024-02-10T08:39:34.119 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.119 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae2424d6:::benchmark_data_smithi018_166993_object20923:head# 2024-02-10T08:39:34.120 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.120 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae244a75:::benchmark_data_smithi018_166993_object67867:head# 2024-02-10T08:39:34.120 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.122 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae246353:::benchmark_data_smithi018_166993_object85122:head# 2024-02-10T08:39:34.122 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.122 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:39:34.124 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae251de3:::benchmark_data_smithi018_166993_object109618:head# 2024-02-10T08:39:34.124 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.125 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae25a566:::benchmark_data_smithi018_166993_object35059:head# 2024-02-10T08:39:34.125 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.125 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae25dab6:::benchmark_data_smithi018_166993_object23396:head# 2024-02-10T08:39:34.125 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.125 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae25fdf8:::benchmark_data_smithi018_166993_object103611:head# 2024-02-10T08:39:34.125 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.125 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae263bc0:::benchmark_data_smithi018_166993_object62545:head# 2024-02-10T08:39:34.125 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.125 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae268af7:::benchmark_data_smithi018_166993_object84290:head# 2024-02-10T08:39:34.125 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.125 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae26964f:::benchmark_data_smithi018_166993_object107177:head# 2024-02-10T08:39:34.125 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.125 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae27130e:::benchmark_data_smithi018_166993_object86033:head# 2024-02-10T08:39:34.125 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.126 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae272511:::benchmark_data_smithi018_166993_object37081:head# 2024-02-10T08:39:34.126 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.130 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae272b32:::benchmark_data_smithi018_166993_object32283:head# 2024-02-10T08:39:34.130 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.130 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae2836b8:::benchmark_data_smithi018_166993_object26227:head# 2024-02-10T08:39:34.130 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.130 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae28b0d7:::benchmark_data_smithi018_166993_object32017:head# 2024-02-10T08:39:34.130 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.130 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae29daff:::benchmark_data_smithi018_166993_object82708:head# 2024-02-10T08:39:34.130 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.130 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae29f87e:::benchmark_data_smithi018_166993_object21351:head# 2024-02-10T08:39:34.130 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.135 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae2d7b88:::benchmark_data_smithi018_166993_object63134:head# 2024-02-10T08:39:34.135 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.142 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae2eda43:::benchmark_data_smithi018_166993_object103661:head# 2024-02-10T08:39:34.142 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.143 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae300bd8:::benchmark_data_smithi018_166993_object117310:head# 2024-02-10T08:39:34.143 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.143 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae301d63:::benchmark_data_smithi018_166993_object17690:head# 2024-02-10T08:39:34.143 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.143 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae309ac8:::benchmark_data_smithi018_166993_object85585:head# 2024-02-10T08:39:34.143 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.145 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae30da50:::benchmark_data_smithi018_166993_object97976:head# 2024-02-10T08:39:34.145 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.146 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae311d36:::benchmark_data_smithi018_166993_object105247:head# 2024-02-10T08:39:34.146 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.146 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae31a6b5:::benchmark_data_smithi018_166993_object85788:head# 2024-02-10T08:39:34.146 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.146 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae31a8d6:::benchmark_data_smithi018_166993_object49284:head# 2024-02-10T08:39:34.146 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.146 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae31da72:::benchmark_data_smithi018_166993_object60424:head# 2024-02-10T08:39:34.146 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.146 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae31f5ad:::benchmark_data_smithi018_166993_object37331:head# 2024-02-10T08:39:34.146 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.146 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae327d4f:::benchmark_data_smithi018_166993_object115089:head# 2024-02-10T08:39:34.146 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.147 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae340095:::benchmark_data_smithi018_166993_object52399:head# 2024-02-10T08:39:34.147 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.147 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae350eda:::benchmark_data_smithi018_166993_object115526:head# 2024-02-10T08:39:34.147 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.147 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae35c9b0:::benchmark_data_smithi018_166993_object57159:head# 2024-02-10T08:39:34.147 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.147 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae36d469:::benchmark_data_smithi018_166993_object25477:head# 2024-02-10T08:39:34.147 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.149 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae370828:::benchmark_data_smithi018_166993_object36307:head# 2024-02-10T08:39:34.150 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.157 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae3931cc:::benchmark_data_smithi018_166993_object22896:head# 2024-02-10T08:39:34.157 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.157 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae394c34:::benchmark_data_smithi018_166993_object73433:head# 2024-02-10T08:39:34.158 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.158 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae39fa75:::benchmark_data_smithi018_166993_object60544:head# 2024-02-10T08:39:34.158 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.158 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae3a3a7b:::benchmark_data_smithi018_166993_object100736:head# 2024-02-10T08:39:34.158 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.158 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae3a7750:::benchmark_data_smithi018_166993_object83372:head# 2024-02-10T08:39:34.158 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.158 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae3a7f9d:::benchmark_data_smithi018_166993_object106639:head# 2024-02-10T08:39:34.158 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.158 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae3aeba2:::benchmark_data_smithi018_166993_object28324:head# 2024-02-10T08:39:34.158 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.158 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae3b7c39:::benchmark_data_smithi018_166993_object88636:head# 2024-02-10T08:39:34.158 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.159 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae3bffed:::benchmark_data_smithi018_166993_object113182:head# 2024-02-10T08:39:34.159 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.159 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae3ccce3:::benchmark_data_smithi018_166993_object46519:head# 2024-02-10T08:39:34.159 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.159 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae3d2e13:::benchmark_data_smithi018_166993_object90149:head# 2024-02-10T08:39:34.159 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.159 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae3d687c:::benchmark_data_smithi018_166993_object103886:head# 2024-02-10T08:39:34.159 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.159 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae3d9278:::benchmark_data_smithi018_166993_object30336:head# 2024-02-10T08:39:34.159 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.160 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae3ec92f:::benchmark_data_smithi018_166993_object26053:head# 2024-02-10T08:39:34.160 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.160 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae3f3f16:::benchmark_data_smithi018_166993_object30581:head# 2024-02-10T08:39:34.160 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.160 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae40a6f1:::benchmark_data_smithi018_166993_object44105:head# 2024-02-10T08:39:34.160 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.160 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae40ad92:::benchmark_data_smithi018_166993_object75149:head# 2024-02-10T08:39:34.160 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.162 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae40b201:::benchmark_data_smithi018_166993_object98585:head# 2024-02-10T08:39:34.162 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.162 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae40d33d:::benchmark_data_smithi018_166993_object105921:head# 2024-02-10T08:39:34.162 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.162 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae414ca9:::benchmark_data_smithi018_166993_object77496:head# 2024-02-10T08:39:34.162 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.162 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae41de69:::benchmark_data_smithi018_166993_object85962:head# 2024-02-10T08:39:34.162 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.162 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae448b89:::benchmark_data_smithi018_166993_object71157:head# 2024-02-10T08:39:34.162 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.163 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae451548:::benchmark_data_smithi018_166993_object37252:head# 2024-02-10T08:39:34.163 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.163 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae452132:::benchmark_data_smithi018_166993_object30524:head# 2024-02-10T08:39:34.163 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.163 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae45c9a3:::benchmark_data_smithi018_166993_object77377:head# 2024-02-10T08:39:34.164 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.173 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae45ef5c:::benchmark_data_smithi018_166993_object56724:head# 2024-02-10T08:39:34.173 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.179 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae46084b:::benchmark_data_smithi018_166993_object38721:head# 2024-02-10T08:39:34.179 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.180 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae467cd7:::benchmark_data_smithi018_166993_object109680:head# 2024-02-10T08:39:34.180 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.180 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae46df95:::benchmark_data_smithi018_166993_object66574:head# 2024-02-10T08:39:34.180 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.188 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae476d01:::benchmark_data_smithi018_166993_object113772:head# 2024-02-10T08:39:34.188 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.188 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae479143:::benchmark_data_smithi018_166993_object91134:head# 2024-02-10T08:39:34.188 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.188 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae47b31e:::benchmark_data_smithi018_166993_object83893:head# 2024-02-10T08:39:34.188 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.188 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae47f930:::benchmark_data_smithi018_166993_object64472:head# 2024-02-10T08:39:34.188 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.188 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae485799:::benchmark_data_smithi018_166993_object45451:head# 2024-02-10T08:39:34.188 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.189 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae4a2c5f:::benchmark_data_smithi018_166993_object67790:head# 2024-02-10T08:39:34.189 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.189 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae4ae68f:::benchmark_data_smithi018_166993_object52960:head# 2024-02-10T08:39:34.189 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.189 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae4b195e:::benchmark_data_smithi018_166993_object57585:head# 2024-02-10T08:39:34.189 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.189 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae4b8a26:::benchmark_data_smithi018_166993_object94793:head# 2024-02-10T08:39:34.189 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.189 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae4bc390:::benchmark_data_smithi018_166993_object54417:head# 2024-02-10T08:39:34.189 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.189 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae4c1408:::benchmark_data_smithi018_166993_object95489:head# 2024-02-10T08:39:34.189 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.189 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae4d1cde:::benchmark_data_smithi018_166993_object53516:head# 2024-02-10T08:39:34.189 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.190 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:34.190 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae4d9673:::benchmark_data_smithi018_166993_object44496:head# 2024-02-10T08:39:34.190 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.190 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae4df0e7:::benchmark_data_smithi018_166993_object52289:head# 2024-02-10T08:39:34.190 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.191 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae4f9631:::benchmark_data_smithi018_166993_object42521:head# 2024-02-10T08:39:34.191 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.194 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae5018d3:::benchmark_data_smithi018_166993_object65522:head# 2024-02-10T08:39:34.194 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.194 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae516502:::benchmark_data_smithi018_166993_object88505:head# 2024-02-10T08:39:34.194 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.201 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae519342:::benchmark_data_smithi018_166993_object56780:head# 2024-02-10T08:39:34.201 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.201 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae51df8d:::benchmark_data_smithi018_166993_object29815:head# 2024-02-10T08:39:34.202 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.202 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae53b4bc:::benchmark_data_smithi018_166993_object115491:head# 2024-02-10T08:39:34.202 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.202 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae53cfd5:::benchmark_data_smithi018_166993_object39431:head# 2024-02-10T08:39:34.202 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.202 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae546c14:::benchmark_data_smithi018_166993_object95059:head# 2024-02-10T08:39:34.202 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.202 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae54a5dc:::benchmark_data_smithi018_166993_object100312:head# 2024-02-10T08:39:34.202 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.202 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae54b38b:::benchmark_data_smithi018_166993_object22293:head# 2024-02-10T08:39:34.202 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.202 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae550667:::benchmark_data_smithi018_166993_object51928:head# 2024-02-10T08:39:34.202 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.202 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae558dac:::benchmark_data_smithi018_166993_object105115:head# 2024-02-10T08:39:34.202 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.202 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae567549:::benchmark_data_smithi018_166993_object39138:head# 2024-02-10T08:39:34.202 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.203 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae56c15c:::benchmark_data_smithi018_166993_object36101:head# 2024-02-10T08:39:34.203 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.203 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae57393e:::benchmark_data_smithi018_166993_object116287:head# 2024-02-10T08:39:34.203 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.203 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae584030:::benchmark_data_smithi018_166993_object102941:head# 2024-02-10T08:39:34.203 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.203 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae584c43:::benchmark_data_smithi018_166993_object111474:head# 2024-02-10T08:39:34.203 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.203 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae58b2d0:::benchmark_data_smithi018_166993_object35364:head# 2024-02-10T08:39:34.203 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.203 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae591881:::benchmark_data_smithi018_166993_object36261:head# 2024-02-10T08:39:34.203 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.203 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae594fb7:::benchmark_data_smithi018_166993_object94138:head# 2024-02-10T08:39:34.203 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.203 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae596223:::benchmark_data_smithi018_166993_object113078:head# 2024-02-10T08:39:34.203 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.204 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae596aee:::benchmark_data_smithi018_166993_object19969:head# 2024-02-10T08:39:34.204 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.204 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae59f763:::benchmark_data_smithi018_166993_object33742:head# 2024-02-10T08:39:34.204 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.204 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae5a3205:::benchmark_data_smithi018_166993_object95382:head# 2024-02-10T08:39:34.204 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.205 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae5a3aa4:::benchmark_data_smithi018_166993_object40265:head# 2024-02-10T08:39:34.205 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.205 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae5ba84b:::benchmark_data_smithi018_166993_object35618:head# 2024-02-10T08:39:34.205 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.205 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae5d827d:::benchmark_data_smithi018_166993_object84945:head# 2024-02-10T08:39:34.205 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.208 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae5e16f1:::benchmark_data_smithi018_166993_object26149:head# 2024-02-10T08:39:34.208 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.208 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae5ed2d5:::benchmark_data_smithi018_166993_object61888:head# 2024-02-10T08:39:34.208 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.212 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae5f5b68:::benchmark_data_smithi018_166993_object69680:head# 2024-02-10T08:39:34.212 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.212 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae5f6673:::benchmark_data_smithi018_166993_object42448:head# 2024-02-10T08:39:34.213 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.213 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae601f04:::benchmark_data_smithi018_166993_object42511:head# 2024-02-10T08:39:34.213 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.213 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae60b901:::benchmark_data_smithi018_166993_object116559:head# 2024-02-10T08:39:34.213 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.213 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae6117c7:::benchmark_data_smithi018_166993_object55382:head# 2024-02-10T08:39:34.213 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.213 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae612890:::benchmark_data_smithi018_166993_object76179:head# 2024-02-10T08:39:34.213 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.213 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae616648:::benchmark_data_smithi018_166993_object51221:head# 2024-02-10T08:39:34.213 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.213 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae61c2fb:::benchmark_data_smithi018_166993_object118748:head# 2024-02-10T08:39:34.213 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.213 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae622e1f:::benchmark_data_smithi018_166993_object51267:head# 2024-02-10T08:39:34.213 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.213 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae6380db:::benchmark_data_smithi018_166993_object84752:head# 2024-02-10T08:39:34.214 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.214 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae64210b:::benchmark_data_smithi018_166993_object114149:head# 2024-02-10T08:39:34.214 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.214 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae643cf1:::benchmark_data_smithi018_166993_object100750:head# 2024-02-10T08:39:34.214 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.217 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae65428e:::benchmark_data_smithi018_166993_object73358:head# 2024-02-10T08:39:34.217 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.217 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae66b4e9:::benchmark_data_smithi018_166993_object75917:head# 2024-02-10T08:39:34.217 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.217 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae678bff:::benchmark_data_smithi018_166993_object71672:head# 2024-02-10T08:39:34.217 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.217 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae679886:::benchmark_data_smithi018_166993_object44313:head# 2024-02-10T08:39:34.217 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.218 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae68281c:::benchmark_data_smithi018_166993_object58993:head# 2024-02-10T08:39:34.218 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.218 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae6873ab:::benchmark_data_smithi018_166993_object106250:head# 2024-02-10T08:39:34.218 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.219 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae68a0a2:::benchmark_data_smithi018_166993_object24844:head# 2024-02-10T08:39:34.219 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.219 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae6987ca:::benchmark_data_smithi018_166993_object62151:head# 2024-02-10T08:39:34.219 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.219 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae6a4dee:::benchmark_data_smithi018_166993_object79973:head# 2024-02-10T08:39:34.219 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.220 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:39:34.223 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae6ab925:::benchmark_data_smithi018_166993_object103345:head# 2024-02-10T08:39:34.223 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.224 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae6bc7cf:::benchmark_data_smithi018_166993_object101380:head# 2024-02-10T08:39:34.224 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.225 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:34.226 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:39:34.228 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae6cb6bb:::benchmark_data_smithi018_166993_object60873:head# 2024-02-10T08:39:34.228 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.228 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae6d0ecb:::benchmark_data_smithi018_166993_object18051:head# 2024-02-10T08:39:34.228 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.228 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae6db19e:::benchmark_data_smithi018_166993_object33305:head# 2024-02-10T08:39:34.228 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.228 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae6f30be:::benchmark_data_smithi018_166993_object29498:head# 2024-02-10T08:39:34.228 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.228 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae6feb5f:::benchmark_data_smithi018_166993_object82454:head# 2024-02-10T08:39:34.228 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.228 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae713c66:::benchmark_data_smithi018_166993_object57195:head# 2024-02-10T08:39:34.229 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.229 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae71572b:::benchmark_data_smithi018_166993_object35270:head# 2024-02-10T08:39:34.229 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.229 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae71b7cf:::benchmark_data_smithi018_166993_object66539:head# 2024-02-10T08:39:34.229 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.229 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae7490a4:::benchmark_data_smithi018_166993_object35786:head# 2024-02-10T08:39:34.229 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.229 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae750fec:::benchmark_data_smithi018_166993_object58583:head# 2024-02-10T08:39:34.229 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.229 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae75dc0c:::benchmark_data_smithi018_166993_object68053:head# 2024-02-10T08:39:34.229 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.230 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae76365d:::benchmark_data_smithi018_166993_object105606:head# 2024-02-10T08:39:34.230 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.230 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae76dbc8:::benchmark_data_smithi018_166993_object115123:head# 2024-02-10T08:39:34.230 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.234 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae771dc2:::benchmark_data_smithi018_166993_object80734:head# 2024-02-10T08:39:34.234 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.244 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae7817c3:::benchmark_data_smithi018_166993_object42052:head# 2024-02-10T08:39:34.245 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.245 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae78776b:::benchmark_data_smithi018_166993_object62352:head# 2024-02-10T08:39:34.245 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.245 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae78b7bf:::benchmark_data_smithi018_166993_object52633:head# 2024-02-10T08:39:34.245 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.245 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae796e4d:::benchmark_data_smithi018_166993_object58347:head# 2024-02-10T08:39:34.245 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.245 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae7a5022:::benchmark_data_smithi018_166993_object101672:head# 2024-02-10T08:39:34.246 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.248 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae7ad87f:::benchmark_data_smithi018_166993_object81993:head# 2024-02-10T08:39:34.248 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.254 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae7c1ef2:::benchmark_data_smithi018_166993_object45775:head# 2024-02-10T08:39:34.254 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.254 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae7d27dc:::benchmark_data_smithi018_166993_object99600:head# 2024-02-10T08:39:34.254 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.254 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae7d8f40:::benchmark_data_smithi018_166993_object29649:head# 2024-02-10T08:39:34.254 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.255 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae7df9c7:::benchmark_data_smithi018_166993_object46435:head# 2024-02-10T08:39:34.255 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.256 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae7e22a3:::benchmark_data_smithi018_166993_object24784:head# 2024-02-10T08:39:34.256 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.256 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae7f04bf:::benchmark_data_smithi018_166993_object100760:head# 2024-02-10T08:39:34.256 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.256 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae80714b:::benchmark_data_smithi018_166993_object91763:head# 2024-02-10T08:39:34.256 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.256 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae80c08e:::benchmark_data_smithi018_166993_object77624:head# 2024-02-10T08:39:34.256 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.256 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae811442:::benchmark_data_smithi018_166993_object105319:head# 2024-02-10T08:39:34.257 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.257 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae81f756:::benchmark_data_smithi018_166993_object113511:head# 2024-02-10T08:39:34.257 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.260 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae822067:::benchmark_data_smithi018_166993_object53117:head# 2024-02-10T08:39:34.260 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.260 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae8277b8:::benchmark_data_smithi018_166993_object38296:head# 2024-02-10T08:39:34.260 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.261 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae82e606:::benchmark_data_smithi018_166993_object36522:head# 2024-02-10T08:39:34.261 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.261 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae83060e:::benchmark_data_smithi018_166993_object34943:head# 2024-02-10T08:39:34.261 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.261 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae8314fe:::benchmark_data_smithi018_166993_object34483:head# 2024-02-10T08:39:34.261 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.264 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae8385fb:::benchmark_data_smithi018_166993_object111030:head# 2024-02-10T08:39:34.264 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.268 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae848d2f:::benchmark_data_smithi018_166993_object112435:head# 2024-02-10T08:39:34.269 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.269 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae849e52:::benchmark_data_smithi018_166993_object80677:head# 2024-02-10T08:39:34.269 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.270 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae84b1aa:::benchmark_data_smithi018_166993_object118606:head# 2024-02-10T08:39:34.270 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.270 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae84c30d:::benchmark_data_smithi018_166993_object94907:head# 2024-02-10T08:39:34.270 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.271 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae84f0f2:::benchmark_data_smithi018_166993_object117505:head# 2024-02-10T08:39:34.271 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.271 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae8595c3:::benchmark_data_smithi018_166993_object41253:head# 2024-02-10T08:39:34.271 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.272 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae864be1:::benchmark_data_smithi018_166993_object59594:head# 2024-02-10T08:39:34.272 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.272 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae864ede:::benchmark_data_smithi018_166993_object79925:head# 2024-02-10T08:39:34.272 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.272 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae866c52:::benchmark_data_smithi018_166993_object33821:head# 2024-02-10T08:39:34.272 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.272 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae86e7fc:::benchmark_data_smithi018_166993_object55902:head# 2024-02-10T08:39:34.273 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.273 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae885441:::benchmark_data_smithi018_166993_object38056:head# 2024-02-10T08:39:34.273 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.275 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae8af451:::benchmark_data_smithi018_166993_object55048:head# 2024-02-10T08:39:34.275 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.275 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae8bfa82:::benchmark_data_smithi018_166993_object69902:head# 2024-02-10T08:39:34.275 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.295 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae8c73d8:::benchmark_data_smithi018_166993_object17622:head# 2024-02-10T08:39:34.295 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.302 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae8fdf1a:::benchmark_data_smithi018_166993_object17936:head# 2024-02-10T08:39:34.302 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.302 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae90c853:::benchmark_data_smithi018_166993_object48172:head# 2024-02-10T08:39:34.302 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.302 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae912c05:::benchmark_data_smithi018_166993_object82014:head# 2024-02-10T08:39:34.302 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.302 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae919f00:::benchmark_data_smithi018_166993_object112409:head# 2024-02-10T08:39:34.302 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.302 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae91c33a:::benchmark_data_smithi018_166993_object74658:head# 2024-02-10T08:39:34.302 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.302 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae92b092:::benchmark_data_smithi018_166993_object38603:head# 2024-02-10T08:39:34.302 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.303 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae932506:::benchmark_data_smithi018_166993_object72382:head# 2024-02-10T08:39:34.303 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.303 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae953506:::benchmark_data_smithi018_166993_object102739:head# 2024-02-10T08:39:34.303 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.304 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae973814:::benchmark_data_smithi018_166993_object72580:head# 2024-02-10T08:39:34.304 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.304 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae974854:::benchmark_data_smithi018_166993_object84657:head# 2024-02-10T08:39:34.304 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.304 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae98549d:::benchmark_data_smithi018_166993_object107221:head# 2024-02-10T08:39:34.304 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.305 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae996ea3:::benchmark_data_smithi018_166993_object60005:head# 2024-02-10T08:39:34.305 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.305 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae99abec:::benchmark_data_smithi018_166993_object71279:head# 2024-02-10T08:39:34.305 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.305 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae9a323e:::benchmark_data_smithi018_166993_object59053:head# 2024-02-10T08:39:34.305 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.306 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae9aea10:::benchmark_data_smithi018_166993_object56163:head# 2024-02-10T08:39:34.307 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.307 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae9b988c:::benchmark_data_smithi018_166993_object91010:head# 2024-02-10T08:39:34.307 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.307 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae9c714a:::benchmark_data_smithi018_166993_object82487:head# 2024-02-10T08:39:34.307 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.307 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae9c9696:::benchmark_data_smithi018_166993_object42590:head# 2024-02-10T08:39:34.307 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.307 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae9d3334:::benchmark_data_smithi018_166993_object82090:head# 2024-02-10T08:39:34.307 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.308 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae9d8530:::benchmark_data_smithi018_166993_object44522:head# 2024-02-10T08:39:34.308 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.308 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae9ea11e:::benchmark_data_smithi018_166993_object27210:head# 2024-02-10T08:39:34.308 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.308 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:ae9ebb1a:::benchmark_data_smithi018_166993_object55071:head# 2024-02-10T08:39:34.308 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.308 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aea0c92a:::benchmark_data_smithi018_166993_object70670:head# 2024-02-10T08:39:34.308 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.309 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aea194ad:::benchmark_data_smithi018_166993_object89077:head# 2024-02-10T08:39:34.310 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.310 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aea19eb0:::benchmark_data_smithi018_166993_object113447:head# 2024-02-10T08:39:34.310 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.310 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aea2909d:::benchmark_data_smithi018_166993_object24782:head# 2024-02-10T08:39:34.310 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.310 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aea441c8:::benchmark_data_smithi018_166993_object45476:head# 2024-02-10T08:39:34.310 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.310 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aea5a2bd:::benchmark_data_smithi018_166993_object51555:head# 2024-02-10T08:39:34.310 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.310 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aea647fa:::benchmark_data_smithi018_166993_object49494:head# 2024-02-10T08:39:34.310 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.310 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aea74586:::benchmark_data_smithi018_166993_object89695:head# 2024-02-10T08:39:34.310 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.311 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aea75708:::benchmark_data_smithi018_166993_object116855:head# 2024-02-10T08:39:34.311 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.315 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aea85591:::benchmark_data_smithi018_166993_object39607:head# 2024-02-10T08:39:34.315 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.320 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aea9a0b4:::benchmark_data_smithi018_166993_object28434:head# 2024-02-10T08:39:34.320 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.320 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aea9b985:::benchmark_data_smithi018_166993_object86488:head# 2024-02-10T08:39:34.321 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.321 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aeaa7579:::benchmark_data_smithi018_166993_object65831:head# 2024-02-10T08:39:34.321 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.321 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aeaa8422:::benchmark_data_smithi018_166993_object25431:head# 2024-02-10T08:39:34.322 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.322 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aeab0f2a:::benchmark_data_smithi018_166993_object54416:head# 2024-02-10T08:39:34.322 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.322 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aeabee9b:::benchmark_data_smithi018_166993_object47991:head# 2024-02-10T08:39:34.322 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.322 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aeabf0d1:::benchmark_data_smithi018_166993_object87889:head# 2024-02-10T08:39:34.322 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.322 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aeac7aa5:::benchmark_data_smithi018_166993_object83939:head# 2024-02-10T08:39:34.322 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.323 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aeacb495:::benchmark_data_smithi018_166993_object24421:head# 2024-02-10T08:39:34.323 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.323 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aead41c4:::benchmark_data_smithi018_166993_object103278:head# 2024-02-10T08:39:34.323 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.324 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aead5e69:::benchmark_data_smithi018_166993_object92137:head# 2024-02-10T08:39:34.324 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.325 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aeaedf90:::benchmark_data_smithi018_166993_object67629:head# 2024-02-10T08:39:34.325 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.325 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aeaf458e:::benchmark_data_smithi018_166993_object75358:head# 2024-02-10T08:39:34.325 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.325 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aeaf941a:::benchmark_data_smithi018_166993_object68725:head# 2024-02-10T08:39:34.326 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.326 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aeb1b023:::benchmark_data_smithi018_166993_object57045:head# 2024-02-10T08:39:34.326 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.326 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aeb1e44f:::benchmark_data_smithi018_166993_object96531:head# 2024-02-10T08:39:34.326 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.326 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aeb261a0:::benchmark_data_smithi018_166993_object56059:head# 2024-02-10T08:39:34.326 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.326 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:39:34.329 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aeb2aed1:::benchmark_data_smithi018_166993_object81757:head# 2024-02-10T08:39:34.329 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.329 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aeb360b3:::benchmark_data_smithi018_166993_object44232:head# 2024-02-10T08:39:34.329 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.330 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aeb4e19d:::benchmark_data_smithi018_166993_object25078:head# 2024-02-10T08:39:34.331 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.331 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aeb50dda:::benchmark_data_smithi018_166993_object98316:head# 2024-02-10T08:39:34.331 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.331 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aeb59e39:::benchmark_data_smithi018_166993_object82379:head# 2024-02-10T08:39:34.331 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.331 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aeb5c47f:::benchmark_data_smithi018_166993_object55562:head# 2024-02-10T08:39:34.331 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.331 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aeb6b4c0:::benchmark_data_smithi018_166993_object66739:head# 2024-02-10T08:39:34.331 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.332 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aeb6dd5b:::benchmark_data_smithi018_166993_object43656:head# 2024-02-10T08:39:34.332 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.332 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aeb7714e:::benchmark_data_smithi018_166993_object83780:head# 2024-02-10T08:39:34.332 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.332 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aeb7d208:::benchmark_data_smithi018_166993_object42213:head# 2024-02-10T08:39:34.332 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.333 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aeb7f475:::benchmark_data_smithi018_166993_object75766:head# 2024-02-10T08:39:34.333 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.333 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aeb829b4:::benchmark_data_smithi018_166993_object62308:head# 2024-02-10T08:39:34.333 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.333 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aeb90d50:::benchmark_data_smithi018_166993_object114921:head# 2024-02-10T08:39:34.333 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.333 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aeb94679:::benchmark_data_smithi018_166993_object105823:head# 2024-02-10T08:39:34.333 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.333 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aeb95e0b:::benchmark_data_smithi018_166993_object70054:head# 2024-02-10T08:39:34.333 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.334 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aebae893:::benchmark_data_smithi018_166993_object100264:head# 2024-02-10T08:39:34.334 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.336 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aebb7581:::benchmark_data_smithi018_166993_object19664:head# 2024-02-10T08:39:34.336 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.336 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aebb83f8:::benchmark_data_smithi018_166993_object43132:head# 2024-02-10T08:39:34.336 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.337 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aebbc4ba:::benchmark_data_smithi018_166993_object35497:head# 2024-02-10T08:39:34.337 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.337 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aebdc910:::benchmark_data_smithi018_166993_object111612:head# 2024-02-10T08:39:34.337 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.338 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aebf4893:::benchmark_data_smithi018_166993_object70073:head# 2024-02-10T08:39:34.338 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.338 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aebf6ad5:::benchmark_data_smithi018_166993_object34439:head# 2024-02-10T08:39:34.338 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.347 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aebf7d8e:::benchmark_data_smithi018_166993_object18867:head# 2024-02-10T08:39:34.347 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.347 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aebfc4e7:::benchmark_data_smithi018_166993_object85731:head# 2024-02-10T08:39:34.347 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.347 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aec27357:::benchmark_data_smithi018_166993_object102199:head# 2024-02-10T08:39:34.347 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.347 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aec2a8dc:::benchmark_data_smithi018_166993_object58047:head# 2024-02-10T08:39:34.347 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.348 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aec30971:::benchmark_data_smithi018_166993_object39640:head# 2024-02-10T08:39:34.348 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.348 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aec32f52:::benchmark_data_smithi018_166993_object102492:head# 2024-02-10T08:39:34.349 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.349 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aec37665:::benchmark_data_smithi018_166993_object96128:head# 2024-02-10T08:39:34.349 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.349 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aec3b54b:::benchmark_data_smithi018_166993_object97597:head# 2024-02-10T08:39:34.349 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.349 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aec474f6:::benchmark_data_smithi018_166993_object73002:head# 2024-02-10T08:39:34.349 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.354 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aec6e950:::benchmark_data_smithi018_166993_object53886:head# 2024-02-10T08:39:34.355 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.359 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aec7408c:::benchmark_data_smithi018_166993_object88195:head# 2024-02-10T08:39:34.359 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.360 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aeca6fe2:::benchmark_data_smithi018_166993_object33391:head# 2024-02-10T08:39:34.360 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.360 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aecb6c08:::benchmark_data_smithi018_166993_object92073:head# 2024-02-10T08:39:34.360 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.360 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aecc6eac:::benchmark_data_smithi018_166993_object82923:head# 2024-02-10T08:39:34.360 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.371 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aeccdb8a:::benchmark_data_smithi018_166993_object111560:head# 2024-02-10T08:39:34.372 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.380 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aece2604:::benchmark_data_smithi018_166993_object77890:head# 2024-02-10T08:39:34.381 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.381 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aecf0d8d:::benchmark_data_smithi018_166993_object85664:head# 2024-02-10T08:39:34.381 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.381 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aecff4a9:::benchmark_data_smithi018_166993_object91638:head# 2024-02-10T08:39:34.381 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.381 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aed06f35:::benchmark_data_smithi018_166993_object105434:head# 2024-02-10T08:39:34.381 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.381 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aed07f55:::benchmark_data_smithi018_166993_object39467:head# 2024-02-10T08:39:34.381 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.381 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aed0fd41:::benchmark_data_smithi018_166993_object114537:head# 2024-02-10T08:39:34.381 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.381 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aed1a112:::benchmark_data_smithi018_166993_object101752:head# 2024-02-10T08:39:34.381 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.381 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aed1c6e3:::benchmark_data_smithi018_166993_object19017:head# 2024-02-10T08:39:34.382 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.382 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aed258d3:::benchmark_data_smithi018_166993_object91696:head# 2024-02-10T08:39:34.382 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.382 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aed31a6f:::benchmark_data_smithi018_166993_object21586:head# 2024-02-10T08:39:34.382 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.382 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aed3dc90:::benchmark_data_smithi018_166993_object42709:head# 2024-02-10T08:39:34.382 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.382 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aed47afd:::benchmark_data_smithi018_166993_object76347:head# 2024-02-10T08:39:34.382 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.382 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aed4819e:::benchmark_data_smithi018_166993_object40353:head# 2024-02-10T08:39:34.382 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.382 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aed49f54:::benchmark_data_smithi018_166993_object33017:head# 2024-02-10T08:39:34.382 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.382 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aed4a5b5:::benchmark_data_smithi018_166993_object108216:head# 2024-02-10T08:39:34.383 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.383 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aed53919:::benchmark_data_smithi018_166993_object65627:head# 2024-02-10T08:39:34.383 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.383 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aed7f840:::benchmark_data_smithi018_166993_object94498:head# 2024-02-10T08:39:34.383 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.383 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aed95f68:::benchmark_data_smithi018_166993_object39129:head# 2024-02-10T08:39:34.383 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.383 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aed9d6e7:::benchmark_data_smithi018_166993_object76445:head# 2024-02-10T08:39:34.383 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.383 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aedab5b8:::benchmark_data_smithi018_166993_object91442:head# 2024-02-10T08:39:34.383 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.384 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aedb43a1:::benchmark_data_smithi018_166993_object28131:head# 2024-02-10T08:39:34.384 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.391 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aedc0776:::benchmark_data_smithi018_166993_object52827:head# 2024-02-10T08:39:34.391 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.391 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:34.392 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aedc57cb:::benchmark_data_smithi018_166993_object85320:head# 2024-02-10T08:39:34.392 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.394 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aedc5ba7:::benchmark_data_smithi018_166993_object85333:head# 2024-02-10T08:39:34.394 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.395 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aedcb2c8:::benchmark_data_smithi018_166993_object68964:head# 2024-02-10T08:39:34.395 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.395 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aedd5a6a:::benchmark_data_smithi018_166993_object116356:head# 2024-02-10T08:39:34.395 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.395 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aede1f48:::benchmark_data_smithi018_166993_object49355:head# 2024-02-10T08:39:34.395 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.397 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aede8331:::benchmark_data_smithi018_166993_object24540:head# 2024-02-10T08:39:34.397 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.397 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aedeea84:::benchmark_data_smithi018_166993_object43227:head# 2024-02-10T08:39:34.397 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.397 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aee13a28:::benchmark_data_smithi018_166993_object109166:head# 2024-02-10T08:39:34.397 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.397 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aee1432d:::benchmark_data_smithi018_166993_object32235:head# 2024-02-10T08:39:34.397 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.397 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aee14845:::benchmark_data_smithi018_166993_object73627:head# 2024-02-10T08:39:34.397 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.397 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aee1b7b2:::benchmark_data_smithi018_166993_object39488:head# 2024-02-10T08:39:34.397 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.397 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aee1c23a:::benchmark_data_smithi018_166993_object116023:head# 2024-02-10T08:39:34.398 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.398 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aee2de6e:::benchmark_data_smithi018_166993_object75159:head# 2024-02-10T08:39:34.398 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.398 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aee30f10:::benchmark_data_smithi018_166993_object25308:head# 2024-02-10T08:39:34.398 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.399 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aee31d62:::benchmark_data_smithi018_166993_object52241:head# 2024-02-10T08:39:34.399 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.399 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aee37370:::benchmark_data_smithi018_166993_object32671:head# 2024-02-10T08:39:34.399 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.399 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aee42a3b:::benchmark_data_smithi018_166993_object106500:head# 2024-02-10T08:39:34.399 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.399 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aee5b1fe:::benchmark_data_smithi018_166993_object54659:head# 2024-02-10T08:39:34.400 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.400 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aee6f815:::benchmark_data_smithi018_166993_object77362:head# 2024-02-10T08:39:34.400 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.400 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aee7aa42:::benchmark_data_smithi018_166993_object46784:head# 2024-02-10T08:39:34.400 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.400 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aee7b9c2:::benchmark_data_smithi018_166993_object76288:head# 2024-02-10T08:39:34.400 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.400 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aee7cd0e:::benchmark_data_smithi018_166993_object105414:head# 2024-02-10T08:39:34.400 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.402 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aee9f0e0:::benchmark_data_smithi018_166993_object85125:head# 2024-02-10T08:39:34.402 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.402 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aeea0257:::benchmark_data_smithi018_166993_object28755:head# 2024-02-10T08:39:34.402 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.402 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aeea3f12:::benchmark_data_smithi018_166993_object65923:head# 2024-02-10T08:39:34.403 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.403 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aeeaa53d:::benchmark_data_smithi018_166993_object68016:head# 2024-02-10T08:39:34.403 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.403 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aeecd7be:::benchmark_data_smithi018_166993_object18862:head# 2024-02-10T08:39:34.403 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.403 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aeef7f24:::benchmark_data_smithi018_166993_object25893:head# 2024-02-10T08:39:34.403 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.403 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aef0d160:::benchmark_data_smithi018_166993_object92087:head# 2024-02-10T08:39:34.403 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.404 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aef131ea:::benchmark_data_smithi018_166993_object26796:head# 2024-02-10T08:39:34.404 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.413 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aef1758e:::benchmark_data_smithi018_166993_object112570:head# 2024-02-10T08:39:34.414 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.414 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aef23979:::benchmark_data_smithi018_166993_object58328:head# 2024-02-10T08:39:34.414 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.414 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aef3ce25:::benchmark_data_smithi018_166993_object67261:head# 2024-02-10T08:39:34.414 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.414 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aef3e909:::benchmark_data_smithi018_166993_object47153:head# 2024-02-10T08:39:34.414 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.414 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aef48293:::benchmark_data_smithi018_166993_object22458:head# 2024-02-10T08:39:34.414 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.414 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aef4a939:::benchmark_data_smithi018_166993_object62672:head# 2024-02-10T08:39:34.414 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.414 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aef5e619:::benchmark_data_smithi018_166993_object57297:head# 2024-02-10T08:39:34.414 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.414 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aef6d8a3:::benchmark_data_smithi018_166993_object89581:head# 2024-02-10T08:39:34.415 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.415 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aef76c26:::benchmark_data_smithi018_166993_object31222:head# 2024-02-10T08:39:34.415 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.415 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aef7a018:::benchmark_data_smithi018_166993_object60740:head# 2024-02-10T08:39:34.415 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.415 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aef7f124:::benchmark_data_smithi018_166993_object19173:head# 2024-02-10T08:39:34.415 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.415 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aef88617:::benchmark_data_smithi018_166993_object35402:head# 2024-02-10T08:39:34.415 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.415 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aef893db:::benchmark_data_smithi018_166993_object117066:head# 2024-02-10T08:39:34.415 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.415 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aef8bb33:::benchmark_data_smithi018_166993_object54022:head# 2024-02-10T08:39:34.415 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.416 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:39:34.421 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:34.421 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aefbfbf5:::benchmark_data_smithi018_166993_object75293:head# 2024-02-10T08:39:34.422 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.422 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aefc3adf:::benchmark_data_smithi018_166993_object103382:head# 2024-02-10T08:39:34.422 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.422 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:39:34.430 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aefcbcf3:::benchmark_data_smithi018_166993_object80172:head# 2024-02-10T08:39:34.431 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.431 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aefced5a:::benchmark_data_smithi018_166993_object115303:head# 2024-02-10T08:39:34.431 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.431 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aefd3b98:::benchmark_data_smithi018_166993_object111937:head# 2024-02-10T08:39:34.431 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.431 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aefdf74d:::benchmark_data_smithi018_166993_object76352:head# 2024-02-10T08:39:34.431 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.431 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aefe000f:::benchmark_data_smithi018_166993_object49274:head# 2024-02-10T08:39:34.431 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.436 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aefeba3d:::benchmark_data_smithi018_166993_object94022:head# 2024-02-10T08:39:34.436 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.436 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aefeeba6:::benchmark_data_smithi018_166993_object94756:head# 2024-02-10T08:39:34.436 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.436 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aeff0075:::benchmark_data_smithi018_166993_object113587:head# 2024-02-10T08:39:34.436 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.436 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aeff255d:::benchmark_data_smithi018_166993_object50912:head# 2024-02-10T08:39:34.436 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.437 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aeff6151:::benchmark_data_smithi018_166993_object71114:head# 2024-02-10T08:39:34.437 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.437 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af008f0f:::benchmark_data_smithi018_166993_object100240:head# 2024-02-10T08:39:34.437 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.437 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af00a600:::benchmark_data_smithi018_166993_object98597:head# 2024-02-10T08:39:34.437 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.437 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af023f60:::benchmark_data_smithi018_166993_object114548:head# 2024-02-10T08:39:34.437 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.437 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af032361:::benchmark_data_smithi018_166993_object103829:head# 2024-02-10T08:39:34.437 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.437 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af032f04:::benchmark_data_smithi018_166993_object19391:head# 2024-02-10T08:39:34.437 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.437 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af03801e:::benchmark_data_smithi018_166993_object114200:head# 2024-02-10T08:39:34.437 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.437 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af03bbcf:::benchmark_data_smithi018_166993_object112510:head# 2024-02-10T08:39:34.438 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.438 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af03fcc3:::benchmark_data_smithi018_166993_object52088:head# 2024-02-10T08:39:34.438 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.438 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af0432fa:::benchmark_data_smithi018_166993_object95506:head# 2024-02-10T08:39:34.438 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.438 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af052cba:::benchmark_data_smithi018_166993_object34168:head# 2024-02-10T08:39:34.438 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.438 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af05db6e:::benchmark_data_smithi018_166993_object37477:head# 2024-02-10T08:39:34.438 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.438 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af05f51e:::benchmark_data_smithi018_166993_object60966:head# 2024-02-10T08:39:34.438 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.438 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af0621e5:::benchmark_data_smithi018_166993_object63957:head# 2024-02-10T08:39:34.438 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.438 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af069d28:::benchmark_data_smithi018_166993_object65041:head# 2024-02-10T08:39:34.439 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.439 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af06aa79:::benchmark_data_smithi018_166993_object40373:head# 2024-02-10T08:39:34.439 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.439 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af078265:::benchmark_data_smithi018_166993_object53600:head# 2024-02-10T08:39:34.439 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.440 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af07c00d:::benchmark_data_smithi018_166993_object116502:head# 2024-02-10T08:39:34.440 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.446 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af08270e:::benchmark_data_smithi018_166993_object29935:head# 2024-02-10T08:39:34.446 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.446 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af084ead:::benchmark_data_smithi018_166993_object42867:head# 2024-02-10T08:39:34.447 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.447 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af08c378:::benchmark_data_smithi018_166993_object109671:head# 2024-02-10T08:39:34.447 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.447 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af08cd9d:::benchmark_data_smithi018_166993_object108181:head# 2024-02-10T08:39:34.447 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.449 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af0995db:::benchmark_data_smithi018_166993_object69583:head# 2024-02-10T08:39:34.449 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.449 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af09e288:::benchmark_data_smithi018_166993_object19461:head# 2024-02-10T08:39:34.449 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.449 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af0abbfb:::benchmark_data_smithi018_166993_object70341:head# 2024-02-10T08:39:34.449 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.449 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af0c0fc9:::benchmark_data_smithi018_166993_object102922:head# 2024-02-10T08:39:34.449 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.449 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af1009d3:::benchmark_data_smithi018_166993_object95075:head# 2024-02-10T08:39:34.449 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.450 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af1057f4:::benchmark_data_smithi018_166993_object89253:head# 2024-02-10T08:39:34.450 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.450 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af10c810:::benchmark_data_smithi018_166993_object17853:head# 2024-02-10T08:39:34.450 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.450 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af10d0be:::benchmark_data_smithi018_166993_object21455:head# 2024-02-10T08:39:34.450 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.450 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af110822:::benchmark_data_smithi018_166993_object59151:head# 2024-02-10T08:39:34.450 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.453 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af1122a5:::benchmark_data_smithi018_166993_object83836:head# 2024-02-10T08:39:34.453 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.453 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af119aff:::benchmark_data_smithi018_166993_object50537:head# 2024-02-10T08:39:34.453 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.453 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af124f13:::benchmark_data_smithi018_166993_object90437:head# 2024-02-10T08:39:34.453 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.453 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af127e3a:::benchmark_data_smithi018_166993_object76952:head# 2024-02-10T08:39:34.453 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.453 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af1385a9:::benchmark_data_smithi018_166993_object42600:head# 2024-02-10T08:39:34.454 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.454 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af145567:::benchmark_data_smithi018_166993_object62606:head# 2024-02-10T08:39:34.454 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.454 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af14557b:::benchmark_data_smithi018_166993_object47925:head# 2024-02-10T08:39:34.454 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.454 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af18e33d:::benchmark_data_smithi018_166993_object38036:head# 2024-02-10T08:39:34.454 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.454 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af193ea1:::benchmark_data_smithi018_166993_object43615:head# 2024-02-10T08:39:34.454 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.455 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af194401:::benchmark_data_smithi018_166993_object64482:head# 2024-02-10T08:39:34.455 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.455 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af19b7f9:::benchmark_data_smithi018_166993_object65828:head# 2024-02-10T08:39:34.455 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.455 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af1aa705:::benchmark_data_smithi018_166993_object52026:head# 2024-02-10T08:39:34.455 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.456 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af1ab9f6:::benchmark_data_smithi018_166993_object116165:head# 2024-02-10T08:39:34.456 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.457 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af1b80f7:::benchmark_data_smithi018_166993_object82795:head# 2024-02-10T08:39:34.457 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.457 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af1b8250:::benchmark_data_smithi018_166993_object65199:head# 2024-02-10T08:39:34.458 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.458 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af1be0f7:::benchmark_data_smithi018_166993_object44396:head# 2024-02-10T08:39:34.458 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.459 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af1bfdbd:::benchmark_data_smithi018_166993_object108783:head# 2024-02-10T08:39:34.459 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.459 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af1d4cee:::benchmark_data_smithi018_166993_object99748:head# 2024-02-10T08:39:34.459 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.459 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af1dfe4d:::benchmark_data_smithi018_166993_object79729:head# 2024-02-10T08:39:34.459 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.459 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af1e0ccd:::benchmark_data_smithi018_166993_object59878:head# 2024-02-10T08:39:34.459 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.459 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af1ed92b:::benchmark_data_smithi018_166993_object79588:head# 2024-02-10T08:39:34.459 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.460 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af205b13:::benchmark_data_smithi018_166993_object41085:head# 2024-02-10T08:39:34.460 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.461 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af20e43b:::benchmark_data_smithi018_166993_object75147:head# 2024-02-10T08:39:34.461 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.461 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af21c39c:::benchmark_data_smithi018_166993_object53771:head# 2024-02-10T08:39:34.461 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.461 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af223374:::benchmark_data_smithi018_166993_object35755:head# 2024-02-10T08:39:34.461 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.461 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af226baa:::benchmark_data_smithi018_166993_object23472:head# 2024-02-10T08:39:34.461 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.461 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af22b7e2:::benchmark_data_smithi018_166993_object116606:head# 2024-02-10T08:39:34.461 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.462 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af22d7b7:::benchmark_data_smithi018_166993_object35460:head# 2024-02-10T08:39:34.462 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.463 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af230c19:::benchmark_data_smithi018_166993_object73918:head# 2024-02-10T08:39:34.463 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.463 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af2421e7:::benchmark_data_smithi018_166993_object96510:head# 2024-02-10T08:39:34.463 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.465 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af2458fc:::benchmark_data_smithi018_166993_object18570:head# 2024-02-10T08:39:34.465 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.465 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af24ed24:::benchmark_data_smithi018_166993_object73429:head# 2024-02-10T08:39:34.465 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.465 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af25ea4e:::benchmark_data_smithi018_166993_object56442:head# 2024-02-10T08:39:34.465 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.467 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af26cb3b:::benchmark_data_smithi018_166993_object60773:head# 2024-02-10T08:39:34.467 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.467 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af26ddf0:::benchmark_data_smithi018_166993_object17406:head# 2024-02-10T08:39:34.468 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.468 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af27abf9:::benchmark_data_smithi018_166993_object101706:head# 2024-02-10T08:39:34.468 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.468 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af280765:::benchmark_data_smithi018_166993_object98880:head# 2024-02-10T08:39:34.468 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.468 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af28df72:::benchmark_data_smithi018_166993_object23693:head# 2024-02-10T08:39:34.468 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.468 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af294e82:::benchmark_data_smithi018_166993_object76383:head# 2024-02-10T08:39:34.468 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.468 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af294eda:::benchmark_data_smithi018_166993_object82880:head# 2024-02-10T08:39:34.468 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.469 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af295965:::benchmark_data_smithi018_166993_object70905:head# 2024-02-10T08:39:34.469 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.476 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af2a3e0a:::benchmark_data_smithi018_166993_object75589:head# 2024-02-10T08:39:34.477 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.477 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af2a4308:::benchmark_data_smithi018_166993_object103975:head# 2024-02-10T08:39:34.477 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.477 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af2b39eb:::benchmark_data_smithi018_166993_object19805:head# 2024-02-10T08:39:34.477 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.478 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af2ba623:::benchmark_data_smithi018_166993_object87320:head# 2024-02-10T08:39:34.478 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.478 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af2c90d4:::benchmark_data_smithi018_166993_object91248:head# 2024-02-10T08:39:34.478 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.478 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af2d2e80:::benchmark_data_smithi018_166993_object102019:head# 2024-02-10T08:39:34.478 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.480 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af2f829e:::benchmark_data_smithi018_166993_object62344:head# 2024-02-10T08:39:34.480 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.480 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af30c9e1:::benchmark_data_smithi018_166993_object97944:head# 2024-02-10T08:39:34.481 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.481 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af30e83d:::benchmark_data_smithi018_166993_object30846:head# 2024-02-10T08:39:34.481 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.481 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af30f6eb:::benchmark_data_smithi018_166993_object53261:head# 2024-02-10T08:39:34.481 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.481 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af3295b9:::benchmark_data_smithi018_166993_object40327:head# 2024-02-10T08:39:34.481 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.481 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af330261:::benchmark_data_smithi018_166993_object70225:head# 2024-02-10T08:39:34.481 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.481 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af332a8c:::benchmark_data_smithi018_166993_object38980:head# 2024-02-10T08:39:34.481 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.481 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af33e9ab:::benchmark_data_smithi018_166993_object31495:head# 2024-02-10T08:39:34.481 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.481 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af34cc3e:::benchmark_data_smithi018_166993_object109485:head# 2024-02-10T08:39:34.481 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.483 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af3664d8:::benchmark_data_smithi018_166993_object66265:head# 2024-02-10T08:39:34.483 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.483 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af368b72:::benchmark_data_smithi018_166993_object106833:head# 2024-02-10T08:39:34.483 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.483 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af36c468:::benchmark_data_smithi018_166993_object106400:head# 2024-02-10T08:39:34.483 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.483 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af3765d9:::benchmark_data_smithi018_166993_object87147:head# 2024-02-10T08:39:34.483 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.483 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af381be4:::benchmark_data_smithi018_166993_object26109:head# 2024-02-10T08:39:34.484 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.484 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af3836e1:::benchmark_data_smithi018_166993_object21862:head# 2024-02-10T08:39:34.484 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.484 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af3a46eb:::benchmark_data_smithi018_166993_object63198:head# 2024-02-10T08:39:34.484 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.484 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af3aa672:::benchmark_data_smithi018_166993_object36564:head# 2024-02-10T08:39:34.484 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.484 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af3b5c99:::benchmark_data_smithi018_166993_object36330:head# 2024-02-10T08:39:34.484 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.484 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af3c681a:::benchmark_data_smithi018_166993_object40913:head# 2024-02-10T08:39:34.485 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.486 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af3d2198:::benchmark_data_smithi018_166993_object76778:head# 2024-02-10T08:39:34.487 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.487 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af3d4fdc:::benchmark_data_smithi018_166993_object82847:head# 2024-02-10T08:39:34.487 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.487 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af3ea6c8:::benchmark_data_smithi018_166993_object96245:head# 2024-02-10T08:39:34.487 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.487 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af3ef1be:::benchmark_data_smithi018_166993_object68858:head# 2024-02-10T08:39:34.487 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.487 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af3fbe2e:::benchmark_data_smithi018_166993_object110537:head# 2024-02-10T08:39:34.487 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.487 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af3fc6a6:::benchmark_data_smithi018_166993_object51195:head# 2024-02-10T08:39:34.487 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.487 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af41bc5e:::benchmark_data_smithi018_166993_object34680:head# 2024-02-10T08:39:34.487 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.487 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af4347bc:::benchmark_data_smithi018_166993_object34189:head# 2024-02-10T08:39:34.488 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.488 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af436891:::benchmark_data_smithi018_166993_object98510:head# 2024-02-10T08:39:34.488 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.488 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af44a760:::benchmark_data_smithi018_166993_object73478:head# 2024-02-10T08:39:34.488 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.488 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af450750:::benchmark_data_smithi018_166993_object52850:head# 2024-02-10T08:39:34.488 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.489 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af453a54:::benchmark_data_smithi018_166993_object30362:head# 2024-02-10T08:39:34.489 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.489 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af45ec2a:::benchmark_data_smithi018_166993_object79566:head# 2024-02-10T08:39:34.489 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.489 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af493a3c:::benchmark_data_smithi018_166993_object95094:head# 2024-02-10T08:39:34.489 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.489 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af4aa3cf:::benchmark_data_smithi018_166993_object50220:head# 2024-02-10T08:39:34.489 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.490 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af4b6a8d:::benchmark_data_smithi018_166993_object115022:head# 2024-02-10T08:39:34.490 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.490 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af4bdfa3:::benchmark_data_smithi018_166993_object87425:head# 2024-02-10T08:39:34.490 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.490 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af4c1b99:::benchmark_data_smithi018_166993_object47568:head# 2024-02-10T08:39:34.490 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.490 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af4d4dc7:::benchmark_data_smithi018_166993_object93259:head# 2024-02-10T08:39:34.490 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.491 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af4d77b3:::benchmark_data_smithi018_166993_object58144:head# 2024-02-10T08:39:34.491 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.499 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af4f0f23:::benchmark_data_smithi018_166993_object17632:head# 2024-02-10T08:39:34.499 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.505 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af512039:::benchmark_data_smithi018_166993_object87438:head# 2024-02-10T08:39:34.505 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.511 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af524708:::benchmark_data_smithi018_166993_object105693:head# 2024-02-10T08:39:34.511 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.514 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af52a83a:::benchmark_data_smithi018_166993_object52192:head# 2024-02-10T08:39:34.514 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.515 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af52c6c5:::benchmark_data_smithi018_166993_object82412:head# 2024-02-10T08:39:34.515 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.515 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af53a167:::benchmark_data_smithi018_166993_object23010:head# 2024-02-10T08:39:34.515 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.516 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af542772:::benchmark_data_smithi018_166993_object82230:head# 2024-02-10T08:39:34.516 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.516 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af550e52:::benchmark_data_smithi018_166993_object103304:head# 2024-02-10T08:39:34.516 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.518 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af566e7f:::benchmark_data_smithi018_166993_object42428:head# 2024-02-10T08:39:34.518 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.519 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af5671dc:::benchmark_data_smithi018_166993_object86505:head# 2024-02-10T08:39:34.519 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.520 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af577a0a:::benchmark_data_smithi018_166993_object56431:head# 2024-02-10T08:39:34.520 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.521 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af5a7995:::benchmark_data_smithi018_166993_object94785:head# 2024-02-10T08:39:34.521 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.521 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af5a8abc:::benchmark_data_smithi018_166993_object28120:head# 2024-02-10T08:39:34.521 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.521 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af5b1d51:::benchmark_data_smithi018_166993_object65758:head# 2024-02-10T08:39:34.521 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.521 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af5b4d02:::benchmark_data_smithi018_166993_object118797:head# 2024-02-10T08:39:34.521 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.521 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af5b67da:::benchmark_data_smithi018_166993_object25530:head# 2024-02-10T08:39:34.521 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.521 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af5b846a:::benchmark_data_smithi018_166993_object71177:head# 2024-02-10T08:39:34.521 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.521 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af5d9326:::benchmark_data_smithi018_166993_object43850:head# 2024-02-10T08:39:34.521 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.524 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af5e38a8:::benchmark_data_smithi018_166993_object88614:head# 2024-02-10T08:39:34.524 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.524 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af5e6f1f:::benchmark_data_smithi018_166993_object70148:head# 2024-02-10T08:39:34.524 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.524 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af5ff9b6:::benchmark_data_smithi018_166993_object39484:head# 2024-02-10T08:39:34.524 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.524 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af603cf1:::benchmark_data_smithi018_166993_object63287:head# 2024-02-10T08:39:34.524 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.524 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af6115e5:::benchmark_data_smithi018_166993_object82700:head# 2024-02-10T08:39:34.525 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.525 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af638096:::benchmark_data_smithi018_166993_object32134:head# 2024-02-10T08:39:34.525 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.525 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af639b52:::benchmark_data_smithi018_166993_object110235:head# 2024-02-10T08:39:34.525 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.525 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af642e46:::benchmark_data_smithi018_166993_object93721:head# 2024-02-10T08:39:34.525 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.525 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af66fd26:::benchmark_data_smithi018_166993_object78149:head# 2024-02-10T08:39:34.525 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.525 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af6785bb:::benchmark_data_smithi018_166993_object111363:head# 2024-02-10T08:39:34.525 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.525 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af67bf80:::benchmark_data_smithi018_166993_object82991:head# 2024-02-10T08:39:34.525 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.525 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af68dd79:::benchmark_data_smithi018_166993_object110764:head# 2024-02-10T08:39:34.525 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.525 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af6add71:::benchmark_data_smithi018_166993_object63460:head# 2024-02-10T08:39:34.526 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.526 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:39:34.527 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af6ae3bb:::benchmark_data_smithi018_166993_object118295:head# 2024-02-10T08:39:34.527 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.527 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af6c35b0:::benchmark_data_smithi018_166993_object102381:head# 2024-02-10T08:39:34.527 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.527 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af6c492f:::benchmark_data_smithi018_166993_object61411:head# 2024-02-10T08:39:34.527 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.527 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af6d8797:::benchmark_data_smithi018_166993_object43827:head# 2024-02-10T08:39:34.527 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.529 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af6db90b:::benchmark_data_smithi018_166993_object26962:head# 2024-02-10T08:39:34.529 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.529 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af6fa317:::benchmark_data_smithi018_166993_object97043:head# 2024-02-10T08:39:34.529 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.529 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af700c23:::benchmark_data_smithi018_166993_object55254:head# 2024-02-10T08:39:34.529 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.529 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af70f9fd:::benchmark_data_smithi018_166993_object44444:head# 2024-02-10T08:39:34.529 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.529 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af7140bb:::benchmark_data_smithi018_166993_object114549:head# 2024-02-10T08:39:34.529 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.530 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af716a92:::benchmark_data_smithi018_166993_object42580:head# 2024-02-10T08:39:34.530 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.531 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af71bd05:::benchmark_data_smithi018_166993_object73952:head# 2024-02-10T08:39:34.531 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.531 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af723981:::benchmark_data_smithi018_166993_object32505:head# 2024-02-10T08:39:34.532 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.532 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af7248e4:::benchmark_data_smithi018_166993_object87586:head# 2024-02-10T08:39:34.532 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.532 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af7387a5:::benchmark_data_smithi018_166993_object90429:head# 2024-02-10T08:39:34.532 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.532 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af73f087:::benchmark_data_smithi018_166993_object46198:head# 2024-02-10T08:39:34.532 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.534 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af742964:::benchmark_data_smithi018_166993_object111892:head# 2024-02-10T08:39:34.534 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.534 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af74bd02:::benchmark_data_smithi018_166993_object34323:head# 2024-02-10T08:39:34.535 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.535 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af74fa0e:::benchmark_data_smithi018_166993_object64982:head# 2024-02-10T08:39:34.535 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.535 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af756c6b:::benchmark_data_smithi018_166993_object105176:head# 2024-02-10T08:39:34.535 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.535 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af75825f:::benchmark_data_smithi018_166993_object25629:head# 2024-02-10T08:39:34.535 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.536 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af759c85:::benchmark_data_smithi018_166993_object109876:head# 2024-02-10T08:39:34.536 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.538 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af75a023:::benchmark_data_smithi018_166993_object69490:head# 2024-02-10T08:39:34.538 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.538 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af75ad4d:::benchmark_data_smithi018_166993_object20559:head# 2024-02-10T08:39:34.538 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.538 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af7662a7:::benchmark_data_smithi018_166993_object94204:head# 2024-02-10T08:39:34.538 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.539 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af769963:::benchmark_data_smithi018_166993_object42425:head# 2024-02-10T08:39:34.539 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.539 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af7722c1:::benchmark_data_smithi018_166993_object99767:head# 2024-02-10T08:39:34.539 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.539 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af77b7bd:::benchmark_data_smithi018_166993_object33222:head# 2024-02-10T08:39:34.539 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.540 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af796bbc:::benchmark_data_smithi018_166993_object83809:head# 2024-02-10T08:39:34.540 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.542 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af7a510f:::benchmark_data_smithi018_166993_object71314:head# 2024-02-10T08:39:34.542 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.542 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af7b7348:::benchmark_data_smithi018_166993_object106868:head# 2024-02-10T08:39:34.542 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.542 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af7b9b36:::benchmark_data_smithi018_166993_object98604:head# 2024-02-10T08:39:34.542 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.542 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af7bd8a6:::benchmark_data_smithi018_166993_object92567:head# 2024-02-10T08:39:34.542 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.542 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af7dc160:::benchmark_data_smithi018_166993_object75005:head# 2024-02-10T08:39:34.542 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.542 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af7df124:::benchmark_data_smithi018_166993_object31825:head# 2024-02-10T08:39:34.542 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.542 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af7e1132:::benchmark_data_smithi018_166993_object51634:head# 2024-02-10T08:39:34.543 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.543 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af7e1d23:::benchmark_data_smithi018_166993_object51523:head# 2024-02-10T08:39:34.543 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.543 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af7e34b2:::benchmark_data_smithi018_166993_object113260:head# 2024-02-10T08:39:34.543 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.543 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af7e675e:::benchmark_data_smithi018_166993_object96743:head# 2024-02-10T08:39:34.543 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.545 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af7faa2d:::benchmark_data_smithi018_166993_object35802:head# 2024-02-10T08:39:34.545 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.545 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af7fb3b6:::benchmark_data_smithi018_166993_object62371:head# 2024-02-10T08:39:34.545 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.545 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af7fbe7c:::benchmark_data_smithi018_166993_object60038:head# 2024-02-10T08:39:34.545 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.545 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af7fe0a7:::benchmark_data_smithi018_166993_object86846:head# 2024-02-10T08:39:34.545 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.545 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af8081a6:::benchmark_data_smithi018_166993_object109845:head# 2024-02-10T08:39:34.545 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.545 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af811cd0:::benchmark_data_smithi018_166993_object31179:head# 2024-02-10T08:39:34.546 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.546 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af81b618:::benchmark_data_smithi018_166993_object98613:head# 2024-02-10T08:39:34.546 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.546 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af82303a:::benchmark_data_smithi018_166993_object43834:head# 2024-02-10T08:39:34.546 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.546 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af823ec5:::benchmark_data_smithi018_166993_object64160:head# 2024-02-10T08:39:34.546 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.547 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af826d04:::benchmark_data_smithi018_166993_object47564:head# 2024-02-10T08:39:34.547 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.547 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af831dc8:::benchmark_data_smithi018_166993_object79179:head# 2024-02-10T08:39:34.547 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.547 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af852bf4:::benchmark_data_smithi018_166993_object86595:head# 2024-02-10T08:39:34.547 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.547 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af8644a7:::benchmark_data_smithi018_166993_object64192:head# 2024-02-10T08:39:34.547 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.547 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af86cb6d:::benchmark_data_smithi018_166993_object17376:head# 2024-02-10T08:39:34.547 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.547 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af86de6c:::benchmark_data_smithi018_166993_object114347:head# 2024-02-10T08:39:34.548 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.548 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af87be40:::benchmark_data_smithi018_166993_object28061:head# 2024-02-10T08:39:34.548 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.548 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af89e149:::benchmark_data_smithi018_166993_object80986:head# 2024-02-10T08:39:34.548 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.548 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af8ad996:::benchmark_data_smithi018_166993_object29665:head# 2024-02-10T08:39:34.548 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.548 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af8ae9e2:::benchmark_data_smithi018_166993_object77464:head# 2024-02-10T08:39:34.548 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.549 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af8c30ac:::benchmark_data_smithi018_166993_object76292:head# 2024-02-10T08:39:34.549 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.549 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af8c3748:::benchmark_data_smithi018_166993_object59863:head# 2024-02-10T08:39:34.549 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.549 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af8c57ba:::benchmark_data_smithi018_166993_object23577:head# 2024-02-10T08:39:34.549 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.549 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af8c6dc6:::benchmark_data_smithi018_166993_object31432:head# 2024-02-10T08:39:34.549 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.550 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af8d87c2:::benchmark_data_smithi018_166993_object79439:head# 2024-02-10T08:39:34.550 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.550 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af8da4b6:::benchmark_data_smithi018_166993_object102577:head# 2024-02-10T08:39:34.550 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.554 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af8f8fcf:::benchmark_data_smithi018_166993_object71110:head# 2024-02-10T08:39:34.554 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.554 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af8fb6a3:::benchmark_data_smithi018_166993_object87109:head# 2024-02-10T08:39:34.555 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.555 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af9028ba:::benchmark_data_smithi018_166993_object89837:head# 2024-02-10T08:39:34.555 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.555 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af91e051:::benchmark_data_smithi018_166993_object92915:head# 2024-02-10T08:39:34.555 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.555 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af91f4cf:::benchmark_data_smithi018_166993_object48423:head# 2024-02-10T08:39:34.555 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.555 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af9217dc:::benchmark_data_smithi018_166993_object49290:head# 2024-02-10T08:39:34.555 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.556 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af924acf:::benchmark_data_smithi018_166993_object33367:head# 2024-02-10T08:39:34.556 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.556 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af925167:::benchmark_data_smithi018_166993_object23133:head# 2024-02-10T08:39:34.557 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.557 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af936aef:::benchmark_data_smithi018_166993_object21518:head# 2024-02-10T08:39:34.557 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.557 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af93b5e3:::benchmark_data_smithi018_166993_object68489:head# 2024-02-10T08:39:34.557 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.557 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af93bdfe:::benchmark_data_smithi018_166993_object70372:head# 2024-02-10T08:39:34.557 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.557 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af95bdb3:::benchmark_data_smithi018_166993_object23936:head# 2024-02-10T08:39:34.557 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.557 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af960235:::benchmark_data_smithi018_166993_object73997:head# 2024-02-10T08:39:34.557 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.558 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af966c86:::benchmark_data_smithi018_166993_object54512:head# 2024-02-10T08:39:34.559 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.559 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af96d4f4:::benchmark_data_smithi018_166993_object82679:head# 2024-02-10T08:39:34.559 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.559 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af96e2c5:::benchmark_data_smithi018_166993_object109837:head# 2024-02-10T08:39:34.559 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.559 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af9738c3:::benchmark_data_smithi018_166993_object44338:head# 2024-02-10T08:39:34.559 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.559 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af97ab9f:::benchmark_data_smithi018_166993_object90858:head# 2024-02-10T08:39:34.559 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.559 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af980b86:::benchmark_data_smithi018_166993_object92841:head# 2024-02-10T08:39:34.559 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.559 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af9a4cd6:::benchmark_data_smithi018_166993_object18918:head# 2024-02-10T08:39:34.559 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.559 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af9aad3f:::benchmark_data_smithi018_166993_object44169:head# 2024-02-10T08:39:34.560 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.561 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af9bb5f2:::benchmark_data_smithi018_166993_object70242:head# 2024-02-10T08:39:34.561 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.561 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af9bdc5f:::benchmark_data_smithi018_166993_object29926:head# 2024-02-10T08:39:34.561 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.561 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af9c5460:::benchmark_data_smithi018_166993_object99833:head# 2024-02-10T08:39:34.561 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.561 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af9cd79e:::benchmark_data_smithi018_166993_object107643:head# 2024-02-10T08:39:34.562 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.562 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af9da3a3:::benchmark_data_smithi018_166993_object68594:head# 2024-02-10T08:39:34.562 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.562 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af9eb9c9:::benchmark_data_smithi018_166993_object71554:head# 2024-02-10T08:39:34.562 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.562 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:af9fac4b:::benchmark_data_smithi018_166993_object108741:head# 2024-02-10T08:39:34.562 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.562 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afa1ec9d:::benchmark_data_smithi018_166993_object66190:head# 2024-02-10T08:39:34.562 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.562 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afa23a59:::benchmark_data_smithi018_166993_object91249:head# 2024-02-10T08:39:34.562 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.562 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afa31ac7:::benchmark_data_smithi018_166993_object30631:head# 2024-02-10T08:39:34.562 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.564 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afa39240:::benchmark_data_smithi018_166993_object117755:head# 2024-02-10T08:39:34.564 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.564 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afa3bf2b:::benchmark_data_smithi018_166993_object95345:head# 2024-02-10T08:39:34.564 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.564 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afa43415:::benchmark_data_smithi018_166993_object54599:head# 2024-02-10T08:39:34.564 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.564 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afa45c2b:::benchmark_data_smithi018_166993_object53881:head# 2024-02-10T08:39:34.564 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.564 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afa78129:::benchmark_data_smithi018_166993_object64925:head# 2024-02-10T08:39:34.565 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.565 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afa79266:::benchmark_data_smithi018_166993_object50135:head# 2024-02-10T08:39:34.565 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.565 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afa82105:::benchmark_data_smithi018_166993_object93770:head# 2024-02-10T08:39:34.565 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.565 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afa89667:::benchmark_data_smithi018_166993_object61461:head# 2024-02-10T08:39:34.565 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.565 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afa9dec3:::benchmark_data_smithi018_166993_object28686:head# 2024-02-10T08:39:34.565 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.566 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afaa5f04:::benchmark_data_smithi018_166993_object106353:head# 2024-02-10T08:39:34.566 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.566 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afabaa77:::benchmark_data_smithi018_166993_object55860:head# 2024-02-10T08:39:34.566 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.566 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afabadbe:::benchmark_data_smithi018_166993_object38516:head# 2024-02-10T08:39:34.566 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.567 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afabc88d:::benchmark_data_smithi018_166993_object97724:head# 2024-02-10T08:39:34.567 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.567 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afac3c87:::benchmark_data_smithi018_166993_object91721:head# 2024-02-10T08:39:34.567 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.569 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afac6000:::benchmark_data_smithi018_166993_object52334:head# 2024-02-10T08:39:34.569 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.569 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afacb828:::benchmark_data_smithi018_166993_object116082:head# 2024-02-10T08:39:34.569 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.571 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afacddab:::benchmark_data_smithi018_166993_object77829:head# 2024-02-10T08:39:34.571 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.571 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afad94a5:::benchmark_data_smithi018_166993_object36206:head# 2024-02-10T08:39:34.571 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.571 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afae9187:::benchmark_data_smithi018_166993_object52714:head# 2024-02-10T08:39:34.571 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.571 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afaebf9a:::benchmark_data_smithi018_166993_object60550:head# 2024-02-10T08:39:34.571 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.571 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afaf53b7:::benchmark_data_smithi018_166993_object48669:head# 2024-02-10T08:39:34.571 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.571 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afafd5e4:::benchmark_data_smithi018_166993_object105365:head# 2024-02-10T08:39:34.571 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.571 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afb02526:::benchmark_data_smithi018_166993_object46181:head# 2024-02-10T08:39:34.572 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.573 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afb1be45:::benchmark_data_smithi018_166993_object108213:head# 2024-02-10T08:39:34.573 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.573 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afb2f485:::benchmark_data_smithi018_166993_object59003:head# 2024-02-10T08:39:34.573 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.574 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afb3d499:::benchmark_data_smithi018_166993_object87283:head# 2024-02-10T08:39:34.574 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.574 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afb4473e:::benchmark_data_smithi018_166993_object95649:head# 2024-02-10T08:39:34.574 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.574 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afb51c45:::benchmark_data_smithi018_166993_object109341:head# 2024-02-10T08:39:34.574 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.574 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afb5d417:::benchmark_data_smithi018_166993_object61379:head# 2024-02-10T08:39:34.574 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.574 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afb5f9fd:::benchmark_data_smithi018_166993_object114196:head# 2024-02-10T08:39:34.574 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.574 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afb63653:::benchmark_data_smithi018_166993_object93466:head# 2024-02-10T08:39:34.574 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.574 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afb66b71:::benchmark_data_smithi018_166993_object112583:head# 2024-02-10T08:39:34.574 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.574 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afb79823:::benchmark_data_smithi018_166993_object68814:head# 2024-02-10T08:39:34.575 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.576 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afb89947:::benchmark_data_smithi018_166993_object33666:head# 2024-02-10T08:39:34.577 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.577 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afb8d50f:::benchmark_data_smithi018_166993_object100364:head# 2024-02-10T08:39:34.577 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.577 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afb946be:::benchmark_data_smithi018_166993_object56282:head# 2024-02-10T08:39:34.577 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.577 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afba586c:::benchmark_data_smithi018_166993_object95970:head# 2024-02-10T08:39:34.577 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.577 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afbb55c2:::benchmark_data_smithi018_166993_object61203:head# 2024-02-10T08:39:34.577 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.577 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afbc004b:::benchmark_data_smithi018_166993_object57400:head# 2024-02-10T08:39:34.577 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.577 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afbd9dad:::benchmark_data_smithi018_166993_object62791:head# 2024-02-10T08:39:34.577 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.578 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afbda9b5:::benchmark_data_smithi018_166993_object28218:head# 2024-02-10T08:39:34.578 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.578 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afbdaaf8:::benchmark_data_smithi018_166993_object48772:head# 2024-02-10T08:39:34.578 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.578 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afbdb6a2:::benchmark_data_smithi018_166993_object25608:head# 2024-02-10T08:39:34.578 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.578 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afbe51a6:::benchmark_data_smithi018_166993_object32507:head# 2024-02-10T08:39:34.578 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.578 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afbe5d16:::benchmark_data_smithi018_166993_object111214:head# 2024-02-10T08:39:34.578 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.578 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afbeb16b:::benchmark_data_smithi018_166993_object94029:head# 2024-02-10T08:39:34.578 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.578 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afbec645:::benchmark_data_smithi018_166993_object55161:head# 2024-02-10T08:39:34.578 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.581 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afbfac87:::benchmark_data_smithi018_166993_object30369:head# 2024-02-10T08:39:34.581 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.581 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afbfc6a2:::benchmark_data_smithi018_166993_object74006:head# 2024-02-10T08:39:34.581 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.581 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afc152dc:::benchmark_data_smithi018_166993_object45490:head# 2024-02-10T08:39:34.581 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.581 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afc175b6:::benchmark_data_smithi018_166993_object34176:head# 2024-02-10T08:39:34.581 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.581 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afc24641:::benchmark_data_smithi018_166993_object71944:head# 2024-02-10T08:39:34.581 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.581 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afc2885e:::benchmark_data_smithi018_166993_object18572:head# 2024-02-10T08:39:34.581 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.582 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afc33817:::benchmark_data_smithi018_166993_object72364:head# 2024-02-10T08:39:34.582 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.582 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afc4999b:::benchmark_data_smithi018_166993_object88027:head# 2024-02-10T08:39:34.582 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.582 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afc4f2fc:::benchmark_data_smithi018_166993_object111167:head# 2024-02-10T08:39:34.582 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.582 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afc6cc5f:::benchmark_data_smithi018_166993_object28565:head# 2024-02-10T08:39:34.582 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.582 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afc87d88:::benchmark_data_smithi018_166993_object35563:head# 2024-02-10T08:39:34.582 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.582 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afc9ace9:::benchmark_data_smithi018_166993_object49394:head# 2024-02-10T08:39:34.582 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.582 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afc9c449:::benchmark_data_smithi018_166993_object98301:head# 2024-02-10T08:39:34.582 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.583 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afcb1337:::benchmark_data_smithi018_166993_object58908:head# 2024-02-10T08:39:34.583 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.583 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afcb5b81:::benchmark_data_smithi018_166993_object105591:head# 2024-02-10T08:39:34.583 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.584 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afcbc2da:::benchmark_data_smithi018_166993_object72522:head# 2024-02-10T08:39:34.584 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.584 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afcc3849:::benchmark_data_smithi018_166993_object102248:head# 2024-02-10T08:39:34.584 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.584 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afcc3d71:::benchmark_data_smithi018_166993_object18646:head# 2024-02-10T08:39:34.584 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.585 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afcd400e:::benchmark_data_smithi018_166993_object20243:head# 2024-02-10T08:39:34.585 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.585 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afcd8c7b:::benchmark_data_smithi018_166993_object115396:head# 2024-02-10T08:39:34.585 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.585 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afceb1b4:::benchmark_data_smithi018_166993_object105619:head# 2024-02-10T08:39:34.585 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.585 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afceb6ed:::benchmark_data_smithi018_166993_object118348:head# 2024-02-10T08:39:34.585 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.586 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afcf2357:::benchmark_data_smithi018_166993_object65736:head# 2024-02-10T08:39:34.586 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.587 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afcfc68d:::benchmark_data_smithi018_166993_object62557:head# 2024-02-10T08:39:34.587 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.587 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afd3e0c1:::benchmark_data_smithi018_166993_object20859:head# 2024-02-10T08:39:34.587 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.587 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afd593a3:::benchmark_data_smithi018_166993_object73173:head# 2024-02-10T08:39:34.587 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.587 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afd6553a:::benchmark_data_smithi018_166993_object46547:head# 2024-02-10T08:39:34.587 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.587 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afd6567e:::benchmark_data_smithi018_166993_object109251:head# 2024-02-10T08:39:34.587 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.587 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afd7f98e:::benchmark_data_smithi018_166993_object65315:head# 2024-02-10T08:39:34.587 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.588 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afd83657:::benchmark_data_smithi018_166993_object73178:head# 2024-02-10T08:39:34.588 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.588 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:34.589 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afd98e89:::benchmark_data_smithi018_166993_object110367:head# 2024-02-10T08:39:34.589 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.589 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afd9faf5:::benchmark_data_smithi018_166993_object102748:head# 2024-02-10T08:39:34.590 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.590 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afdb3873:::benchmark_data_smithi018_166993_object82226:head# 2024-02-10T08:39:34.590 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.590 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afdba1ae:::benchmark_data_smithi018_166993_object100797:head# 2024-02-10T08:39:34.590 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.592 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afdc4a27:::benchmark_data_smithi018_166993_object75881:head# 2024-02-10T08:39:34.592 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.592 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afdccc76:::benchmark_data_smithi018_166993_object109379:head# 2024-02-10T08:39:34.592 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.592 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afddc4a7:::benchmark_data_smithi018_166993_object91023:head# 2024-02-10T08:39:34.592 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.592 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afde1b92:::benchmark_data_smithi018_166993_object95828:head# 2024-02-10T08:39:34.592 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.592 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afdebf5a:::benchmark_data_smithi018_166993_object90602:head# 2024-02-10T08:39:34.592 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.592 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afded160:::benchmark_data_smithi018_166993_object110438:head# 2024-02-10T08:39:34.592 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.592 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afdf4616:::benchmark_data_smithi018_166993_object97582:head# 2024-02-10T08:39:34.593 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.593 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afdf6002:::benchmark_data_smithi018_166993_object72812:head# 2024-02-10T08:39:34.593 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.593 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afdf6154:::benchmark_data_smithi018_166993_object17540:head# 2024-02-10T08:39:34.593 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.595 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afe0cd6e:::benchmark_data_smithi018_166993_object87663:head# 2024-02-10T08:39:34.595 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.595 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afe0f63f:::benchmark_data_smithi018_166993_object105755:head# 2024-02-10T08:39:34.595 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.595 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afe31e94:::benchmark_data_smithi018_166993_object84437:head# 2024-02-10T08:39:34.595 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.595 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afe360e6:::benchmark_data_smithi018_166993_object38314:head# 2024-02-10T08:39:34.595 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.595 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afe547a4:::benchmark_data_smithi018_166993_object112081:head# 2024-02-10T08:39:34.595 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.595 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afe5c265:::benchmark_data_smithi018_166993_object78930:head# 2024-02-10T08:39:34.596 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.596 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afe6de18:::benchmark_data_smithi018_166993_object52193:head# 2024-02-10T08:39:34.596 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.596 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afe6f314:::benchmark_data_smithi018_166993_object68348:head# 2024-02-10T08:39:34.596 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.596 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afe71435:::benchmark_data_smithi018_166993_object83187:head# 2024-02-10T08:39:34.596 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.596 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afe735ac:::benchmark_data_smithi018_166993_object73509:head# 2024-02-10T08:39:34.596 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.596 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afe75143:::benchmark_data_smithi018_166993_object99698:head# 2024-02-10T08:39:34.596 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.596 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afe763a9:::benchmark_data_smithi018_166993_object108212:head# 2024-02-10T08:39:34.596 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.597 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afe81d0a:::benchmark_data_smithi018_166993_object103898:head# 2024-02-10T08:39:34.597 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.597 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afe929ae:::benchmark_data_smithi018_166993_object34228:head# 2024-02-10T08:39:34.597 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.597 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afe9f606:::benchmark_data_smithi018_166993_object53127:head# 2024-02-10T08:39:34.597 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.598 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afea7b76:::benchmark_data_smithi018_166993_object43032:head# 2024-02-10T08:39:34.598 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.599 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afeaed4e:::benchmark_data_smithi018_166993_object38533:head# 2024-02-10T08:39:34.599 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.599 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afeb4d03:::benchmark_data_smithi018_166993_object86791:head# 2024-02-10T08:39:34.599 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.600 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afeb60be:::benchmark_data_smithi018_166993_object18062:head# 2024-02-10T08:39:34.600 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.600 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afec92f6:::benchmark_data_smithi018_166993_object106325:head# 2024-02-10T08:39:34.600 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.600 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afecb4b2:::benchmark_data_smithi018_166993_object29749:head# 2024-02-10T08:39:34.600 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.601 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afed3e53:::benchmark_data_smithi018_166993_object70597:head# 2024-02-10T08:39:34.601 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.601 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afed943e:::benchmark_data_smithi018_166993_object44360:head# 2024-02-10T08:39:34.601 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.601 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afee19e6:::benchmark_data_smithi018_166993_object65143:head# 2024-02-10T08:39:34.601 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.602 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afee2346:::benchmark_data_smithi018_166993_object58998:head# 2024-02-10T08:39:34.602 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.602 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afee894c:::benchmark_data_smithi018_166993_object23809:head# 2024-02-10T08:39:34.602 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.602 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afef51bf:::benchmark_data_smithi018_166993_object25849:head# 2024-02-10T08:39:34.602 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.603 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afef5bca:::benchmark_data_smithi018_166993_object116555:head# 2024-02-10T08:39:34.603 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.603 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aff072d3:::benchmark_data_smithi018_166993_object83657:head# 2024-02-10T08:39:34.603 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.603 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aff0978c:::benchmark_data_smithi018_166993_object46376:head# 2024-02-10T08:39:34.603 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.603 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aff20d31:::benchmark_data_smithi018_166993_object49199:head# 2024-02-10T08:39:34.603 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.603 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aff30e5b:::benchmark_data_smithi018_166993_object117145:head# 2024-02-10T08:39:34.603 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.605 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aff31080:::benchmark_data_smithi018_166993_object49264:head# 2024-02-10T08:39:34.605 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.605 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aff33895:::benchmark_data_smithi018_166993_object48329:head# 2024-02-10T08:39:34.605 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.606 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aff39ab7:::benchmark_data_smithi018_166993_object94419:head# 2024-02-10T08:39:34.606 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.606 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aff3fc36:::benchmark_data_smithi018_166993_object107886:head# 2024-02-10T08:39:34.606 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.606 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aff5d58f:::benchmark_data_smithi018_166993_object34946:head# 2024-02-10T08:39:34.606 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.607 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aff6a482:::benchmark_data_smithi018_166993_object77687:head# 2024-02-10T08:39:34.607 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.607 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aff6f841:::benchmark_data_smithi018_166993_object35934:head# 2024-02-10T08:39:34.607 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.607 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aff70371:::benchmark_data_smithi018_166993_object60516:head# 2024-02-10T08:39:34.607 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.607 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aff796f5:::benchmark_data_smithi018_166993_object34490:head# 2024-02-10T08:39:34.607 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.611 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aff82472:::benchmark_data_smithi018_166993_object73891:head# 2024-02-10T08:39:34.611 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.611 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aff834fe:::benchmark_data_smithi018_166993_object60217:head# 2024-02-10T08:39:34.611 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.616 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aff8a7d5:::benchmark_data_smithi018_166993_object55206:head# 2024-02-10T08:39:34.616 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.616 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aff984cf:::benchmark_data_smithi018_166993_object31330:head# 2024-02-10T08:39:34.616 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.616 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aff9a97e:::benchmark_data_smithi018_166993_object85960:head# 2024-02-10T08:39:34.616 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.617 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:aff9fcf2:::benchmark_data_smithi018_166993_object62490:head# 2024-02-10T08:39:34.617 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.617 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:affa2250:::benchmark_data_smithi018_166993_object107619:head# 2024-02-10T08:39:34.617 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.617 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:affa7fd2:::benchmark_data_smithi018_166993_object18050:head# 2024-02-10T08:39:34.617 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.617 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:affc7ccb:::benchmark_data_smithi018_166993_object63953:head# 2024-02-10T08:39:34.617 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.618 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:affd52a7:::benchmark_data_smithi018_166993_object36900:head# 2024-02-10T08:39:34.618 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.618 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:affe0442:::benchmark_data_smithi018_166993_object39104:head# 2024-02-10T08:39:34.618 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.618 INFO:teuthology.orchestra.run.smithi071.stdout:Write #11:afffa6b8:::benchmark_data_smithi018_166993_object17930:head# 2024-02-10T08:39:34.618 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 0=[]:{} 2024-02-10T08:39:34.621 INFO:teuthology.orchestra.run.smithi071.stdout:write_pg epoch 432 info 11.5( v 432'8388 (407'4224,432'8388] local-lis/les=429/430 n=6224 ec=398/398 lis/c=429/398 les/c/f=430/399/0 sis=429) 2024-02-10T08:39:34.645 INFO:teuthology.orchestra.run.smithi071.stdout:Import successful 2024-02-10T08:39:35.638 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd unset noscrub 2024-02-10T08:39:35.982 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f /var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/exp.11.5.7 2024-02-10T08:39:36.185 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:39:36.220 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:36.220 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:39:36.242 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:39:35.164677+0000 mgr.y (mgr.14505) 855 : cluster [DBG] pgmap v1049: 178 pgs: 5 active+undersized+degraded+remapped+backfilling, 173 active+clean; 3.7 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 906 op/s; 17195/184059 objects degraded (9.342%); 3.5 MiB/s, 55 objects/s recovering 2024-02-10T08:39:36.242 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:39:36.049388+0000 mon.a (mon.0) 1798 : cluster [WRN] Health check update: Degraded data redundancy: 17195/184059 objects degraded (9.342%), 5 pgs degraded (PG_DEGRADED) 2024-02-10T08:39:36.321 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:39:36.368 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:36.399 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:39:36.402 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:36.402 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:39:36.503 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:39:36.554 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:36.597 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:39:36.603 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:36.604 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:39:36.657 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:39:35.164677+0000 mgr.y (mgr.14505) 855 : cluster [DBG] pgmap v1049: 178 pgs: 5 active+undersized+degraded+remapped+backfilling, 173 active+clean; 3.7 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 906 op/s; 17195/184059 objects degraded (9.342%); 3.5 MiB/s, 55 objects/s recovering 2024-02-10T08:39:36.657 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:39:36.049388+0000 mon.a (mon.0) 1798 : cluster [WRN] Health check update: Degraded data redundancy: 17195/184059 objects degraded (9.342%), 5 pgs degraded (PG_DEGRADED) 2024-02-10T08:39:36.657 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:39:35.164677+0000 mgr.y (mgr.14505) 855 : cluster [DBG] pgmap v1049: 178 pgs: 5 active+undersized+degraded+remapped+backfilling, 173 active+clean; 3.7 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 906 op/s; 17195/184059 objects degraded (9.342%); 3.5 MiB/s, 55 objects/s recovering 2024-02-10T08:39:36.657 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:39:36.049388+0000 mon.a (mon.0) 1798 : cluster [WRN] Health check update: Degraded data redundancy: 17195/184059 objects degraded (9.342%), 5 pgs degraded (PG_DEGRADED) 2024-02-10T08:39:36.704 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:39:36.752 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:36.789 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:39:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:39:36] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:39:37.654 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:39:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:39:37] "GET /metrics HTTP/1.1" 200 166355 "" "Prometheus/2.33.4" 2024-02-10T08:39:37.739 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:39:37.750 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:37.750 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:39:37.853 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:39:37.898 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:37.929 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:39:37.932 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:37.932 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:39:38.033 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:39:38.101 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:38.137 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:39:38.141 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:38.142 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:39:38.243 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:39:38.249 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:39:38.258 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:39:37.165373+0000 mgr.y (mgr.14505) 856 : cluster [DBG] pgmap v1050: 178 pgs: 5 active+undersized+degraded+remapped+backfilling, 173 active+clean; 3.7 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 906 op/s; 17195/184059 objects degraded (9.342%); 3.5 MiB/s, 55 objects/s recovering 2024-02-10T08:39:38.258 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:39:38.197814+0000 mon.b (mon.1) 97 : audit [DBG] from='client.? 172.21.15.18:0/4211904874' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:39:38.303 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:38.333 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:39:38.376 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:39:38.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:39:37.165373+0000 mgr.y (mgr.14505) 856 : cluster [DBG] pgmap v1050: 178 pgs: 5 active+undersized+degraded+remapped+backfilling, 173 active+clean; 3.7 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 906 op/s; 17195/184059 objects degraded (9.342%); 3.5 MiB/s, 55 objects/s recovering 2024-02-10T08:39:38.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:39:38.197814+0000 mon.b (mon.1) 97 : audit [DBG] from='client.? 172.21.15.18:0/4211904874' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:39:38.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:39:37.165373+0000 mgr.y (mgr.14505) 856 : cluster [DBG] pgmap v1050: 178 pgs: 5 active+undersized+degraded+remapped+backfilling, 173 active+clean; 3.7 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 906 op/s; 17195/184059 objects degraded (9.342%); 3.5 MiB/s, 55 objects/s recovering 2024-02-10T08:39:38.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:39:38.197814+0000 mon.b (mon.1) 97 : audit [DBG] from='client.? 172.21.15.18:0/4211904874' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:39:38.419 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:39:38.454 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:39:38.500 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:39:38.564 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:39:38.564 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-10T08:39:38.564 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-10T08:39:38.564 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-10T08:39:38.564 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-10T08:39:38.564 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-10T08:39:38.564 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-10T08:39:38.564 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-10T08:39:38.564 INFO:teuthology.orchestra.run.smithi018.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-02-10T08:39:39.284 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:39:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:39:39.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:39:38.957907+0000 osd.6 (osd.6) 284 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:39:39.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:39:38.957953+0000 osd.6 (osd.6) 285 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:39:39.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:39:38.957907+0000 osd.6 (osd.6) 284 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:39:39.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:39:38.957953+0000 osd.6 (osd.6) 285 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:39:39.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:39:38.957907+0000 osd.6 (osd.6) 284 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:39:39.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:39:38.957953+0000 osd.6 (osd.6) 285 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:39:39.684 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:39:39.690 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:39.690 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:39:39.791 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:39:39.857 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:39.914 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:39:39.927 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:39.928 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:39:40.029 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:39:40.086 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:40.124 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:39:40.129 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:40.130 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:39:40.231 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:39:40.322 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:40.485 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:39:40.491 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:39:40.499 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:40.500 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:39:40.511 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-02-10T08:39:40.511 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-02-10T08:39:40.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:39:38.975156+0000 mgr.y (mgr.14505) 857 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:39:40.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:39:39.143105+0000 osd.5 (osd.5) 287 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:39:40.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:39:39.143154+0000 osd.5 (osd.5) 288 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:39:40.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:39:39.168682+0000 mgr.y (mgr.14505) 858 : cluster [DBG] pgmap v1051: 178 pgs: 5 active+undersized+degraded+remapped+backfilling, 173 active+clean; 3.5 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 895 op/s; 15911/171105 objects degraded (9.299%); 3.5 MiB/s, 55 objects/s recovering 2024-02-10T08:39:40.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:39:39.284754+0000 mon.a (mon.0) 1799 : cluster [DBG] osdmap e442: 8 total, 7 up, 7 in 2024-02-10T08:39:40.601 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:39:40.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:39:38.975156+0000 mgr.y (mgr.14505) 857 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:39:40.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:39:39.143105+0000 osd.5 (osd.5) 287 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:39:40.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:39:39.143154+0000 osd.5 (osd.5) 288 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:39:40.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:39:39.168682+0000 mgr.y (mgr.14505) 858 : cluster [DBG] pgmap v1051: 178 pgs: 5 active+undersized+degraded+remapped+backfilling, 173 active+clean; 3.5 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 895 op/s; 15911/171105 objects degraded (9.299%); 3.5 MiB/s, 55 objects/s recovering 2024-02-10T08:39:40.657 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:39:39.284754+0000 mon.a (mon.0) 1799 : cluster [DBG] osdmap e442: 8 total, 7 up, 7 in 2024-02-10T08:39:40.657 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:39:38.975156+0000 mgr.y (mgr.14505) 857 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:39:40.657 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:39:39.143105+0000 osd.5 (osd.5) 287 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:39:40.657 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:39:39.143154+0000 osd.5 (osd.5) 288 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:39:40.657 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:39:39.168682+0000 mgr.y (mgr.14505) 858 : cluster [DBG] pgmap v1051: 178 pgs: 5 active+undersized+degraded+remapped+backfilling, 173 active+clean; 3.5 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 895 op/s; 15911/171105 objects degraded (9.299%); 3.5 MiB/s, 55 objects/s recovering 2024-02-10T08:39:40.657 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:39:39.284754+0000 mon.a (mon.0) 1799 : cluster [DBG] osdmap e442: 8 total, 7 up, 7 in 2024-02-10T08:39:40.661 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:40.809 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:39:40.812 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:40.813 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:39:40.914 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:39:40.964 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:41.158 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 3, 4, 5, 6, 0] out_osds: [7] dead_osds: [7] live_osds: [0, 1, 2, 3, 5, 6, 4] 2024-02-10T08:39:41.158 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-10T08:39:41.158 INFO:tasks.thrashosds.thrasher:Reviving osd 7 2024-02-10T08:39:41.158 INFO:tasks.cephadm.osd.7:Restarting osd.7 (starting--it wasn't running)... 2024-02-10T08:39:41.158 DEBUG:teuthology.orchestra.run.smithi071:osd.7> sudo journalctl -f -n 0 -u ceph-d46257c8-c7eb-11ee-95b8-87774f69a715@osd.7.service 2024-02-10T08:39:41.161 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl start ceph-d46257c8-c7eb-11ee-95b8-87774f69a715@osd.7 2024-02-10T08:39:41.175 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:41.175 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:39:41.175 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:39:41.215 INFO:journalctl@ceph.osd.7.smithi071.stdout:-- Logs begin at Sat 2024-02-10 07:59:38 UTC. -- 2024-02-10T08:39:41.276 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:39:41.318 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:39:41.050463+0000 mon.a (mon.0) 1800 : cluster [WRN] Health check update: Degraded data redundancy: 15911/171105 objects degraded (9.299%), 5 pgs degraded (PG_DEGRADED) 2024-02-10T08:39:41.341 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:41.373 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-02-10T08:39:41.373 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-02-10T08:39:41.373 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-02-10T08:39:41.374 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-02-10T08:39:41.374 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.374 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.25369.0:210176 10.2 10:4db46248:::benchmark_data_smithi018_146618_object86373:head [delete] snapc 0=[] ondisk+write+known_if_redirected e383)", 2024-02-10T08:39:41.374 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:35:40.826622+0000", 2024-02-10T08:39:41.374 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 240.54466855000001, 2024-02-10T08:39:41.374 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.13923788500000001, 2024-02-10T08:39:41.374 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:39:41.374 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:39:41.374 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:39:41.374 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.25369", 2024-02-10T08:39:41.374 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/3974730810", 2024-02-10T08:39:41.374 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 210176 2024-02-10T08:39:41.374 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.374 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:39:41.375 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.375 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:39:41.375 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.826622+0000", 2024-02-10T08:39:41.375 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:39:41.375 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.375 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.375 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:39:41.375 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.826622+0000", 2024-02-10T08:39:41.375 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:39:41.375 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.375 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.375 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:39:41.375 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.826620+0000", 2024-02-10T08:39:41.375 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1239999999999999e-06 2024-02-10T08:39:41.375 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.375 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.376 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:39:41.376 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.826627+0000", 2024-02-10T08:39:41.376 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1576000000000001e-05 2024-02-10T08:39:41.376 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.376 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.376 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:39:41.376 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.826639+0000", 2024-02-10T08:39:41.376 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4459999999999998e-06 2024-02-10T08:39:41.376 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.376 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.376 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:39:41.376 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.826645+0000", 2024-02-10T08:39:41.376 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0890000000000003e-05 2024-02-10T08:39:41.376 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.376 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.376 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:39:41.377 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.826686+0000", 2024-02-10T08:39:41.377 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7396000000000001e-05 2024-02-10T08:39:41.377 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.377 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.377 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:39:41.377 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.826773+0000", 2024-02-10T08:39:41.377 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6243999999999996e-05 2024-02-10T08:39:41.377 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.377 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.377 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0,4", 2024-02-10T08:39:41.377 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.826860+0000", 2024-02-10T08:39:41.377 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00200607 2024-02-10T08:39:41.377 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.377 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.377 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:39:41.377 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.828866+0000", 2024-02-10T08:39:41.378 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000119045 2024-02-10T08:39:41.378 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.378 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.378 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:39:41.378 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.828985+0000", 2024-02-10T08:39:41.378 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.136786091 2024-02-10T08:39:41.378 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.378 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.378 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:39:41.378 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.965771+0000", 2024-02-10T08:39:41.378 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9153000000000002e-05 2024-02-10T08:39:41.378 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.378 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.378 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:39:41.378 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.965820+0000", 2024-02-10T08:39:41.379 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9406999999999997e-05 2024-02-10T08:39:41.379 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.379 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.379 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:39:41.379 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.965859+0000", 2024-02-10T08:39:41.379 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.13923788500000001 2024-02-10T08:39:41.379 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:39:41.379 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:39:41.379 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:39:41.379 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.379 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.379 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.25664.0:132852 11.0 11:028d9af2:::benchmark_data_smithi018_166993_object13727:head [delete] snapc 0=[] ondisk+write+known_if_redirected e430)", 2024-02-10T08:39:41.379 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:38:44.205116+0000", 2024-02-10T08:39:41.379 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 57.166173833999999, 2024-02-10T08:39:41.380 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.14499097399999999, 2024-02-10T08:39:41.380 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:39:41.380 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:39:41.380 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:39:41.380 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.25664", 2024-02-10T08:39:41.380 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/1087272222", 2024-02-10T08:39:41.380 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 132852 2024-02-10T08:39:41.380 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.380 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:39:41.380 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.380 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:39:41.380 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.205116+0000", 2024-02-10T08:39:41.380 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:39:41.380 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.381 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.381 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:39:41.381 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.205116+0000", 2024-02-10T08:39:41.381 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:39:41.381 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.381 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.381 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:39:41.381 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.205115+0000", 2024-02-10T08:39:41.381 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6620000000000002e-06 2024-02-10T08:39:41.381 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.381 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.381 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:39:41.381 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.205121+0000", 2024-02-10T08:39:41.381 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0363000000000001e-05 2024-02-10T08:39:41.381 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.381 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.382 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:39:41.382 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.205131+0000", 2024-02-10T08:39:41.382 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8419999999999999e-06 2024-02-10T08:39:41.382 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.382 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.382 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:39:41.382 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.205138+0000", 2024-02-10T08:39:41.382 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000107797 2024-02-10T08:39:41.382 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.382 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.382 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:39:41.382 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.205246+0000", 2024-02-10T08:39:41.382 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000130433 2024-02-10T08:39:41.382 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.382 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.383 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:39:41.383 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.205376+0000", 2024-02-10T08:39:41.383 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015640900000000001 2024-02-10T08:39:41.383 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.383 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.383 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,6,7", 2024-02-10T08:39:41.383 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.205533+0000", 2024-02-10T08:39:41.383 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0020929920000000001 2024-02-10T08:39:41.383 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.383 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.383 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:39:41.383 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.207626+0000", 2024-02-10T08:39:41.383 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00050243300000000005 2024-02-10T08:39:41.383 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.383 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.383 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:39:41.384 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.208128+0000", 2024-02-10T08:39:41.384 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001996271 2024-02-10T08:39:41.384 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.384 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.384 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:39:41.384 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.210124+0000", 2024-02-10T08:39:41.384 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0123027 2024-02-10T08:39:41.384 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.384 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.384 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:39:41.384 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.222427+0000", 2024-02-10T08:39:41.384 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4823e-05 2024-02-10T08:39:41.384 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.384 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.385 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:39:41.385 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.222482+0000", 2024-02-10T08:39:41.385 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.12762554500000001 2024-02-10T08:39:41.385 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.385 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.385 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:39:41.385 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.350107+0000", 2024-02-10T08:39:41.385 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.14499097399999999 2024-02-10T08:39:41.385 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:39:41.385 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:39:41.385 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:39:41.385 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.385 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.385 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.25664.0:132859 11.6 e430/398 11:6df71746:::benchmark_data_smithi018_166993_object13734:head v 430'8369, mlcod=430'8367)", 2024-02-10T08:39:41.385 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:38:44.211071+0000", 2024-02-10T08:39:41.385 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 57.160219312000002, 2024-02-10T08:39:41.386 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.138975241, 2024-02-10T08:39:41.386 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:39:41.386 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:39:41.386 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:39:41.386 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.386 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:39:41.387 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.211071+0000", 2024-02-10T08:39:41.387 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:39:41.387 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.387 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.387 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:39:41.387 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.211071+0000", 2024-02-10T08:39:41.387 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:39:41.388 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.388 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.388 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:39:41.388 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.211070+0000", 2024-02-10T08:39:41.388 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2080000000000003e-06 2024-02-10T08:39:41.388 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.388 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.388 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:39:41.388 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.211077+0000", 2024-02-10T08:39:41.388 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1309999999999995e-06 2024-02-10T08:39:41.388 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.388 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.388 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:39:41.388 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.211086+0000", 2024-02-10T08:39:41.389 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2699999999999998e-06 2024-02-10T08:39:41.389 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.389 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.389 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:39:41.389 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.211090+0000", 2024-02-10T08:39:41.389 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0182999999999998e-05 2024-02-10T08:39:41.389 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.389 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.389 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:39:41.389 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.211131+0000", 2024-02-10T08:39:41.389 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.376e-05 2024-02-10T08:39:41.389 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.389 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.389 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:39:41.389 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.211154+0000", 2024-02-10T08:39:41.390 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011394479000000001 2024-02-10T08:39:41.390 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.390 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.390 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:39:41.390 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.222549+0000", 2024-02-10T08:39:41.390 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.12749732699999999 2024-02-10T08:39:41.390 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.390 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.390 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:39:41.390 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.350046+0000", 2024-02-10T08:39:41.390 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.138975241 2024-02-10T08:39:41.390 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:39:41.390 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:39:41.390 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:39:41.390 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.391 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.391 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.25664.0:132861 11.0 11:00f18558:::benchmark_data_smithi018_166993_object13736:head [delete] snapc 0=[] ondisk+write+known_if_redirected e430)", 2024-02-10T08:39:41.391 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:38:44.211127+0000", 2024-02-10T08:39:41.391 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 57.160162968999998, 2024-02-10T08:39:41.391 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.139201879, 2024-02-10T08:39:41.391 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:39:41.391 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:39:41.391 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:39:41.391 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.25664", 2024-02-10T08:39:41.391 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/1087272222", 2024-02-10T08:39:41.391 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 132861 2024-02-10T08:39:41.391 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.391 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:39:41.391 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.392 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:39:41.392 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.211127+0000", 2024-02-10T08:39:41.392 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:39:41.392 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.392 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.392 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:39:41.392 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.211127+0000", 2024-02-10T08:39:41.392 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:39:41.392 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.392 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.392 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:39:41.392 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.211126+0000", 2024-02-10T08:39:41.392 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0100000000000003e-06 2024-02-10T08:39:41.392 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.393 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.393 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:39:41.393 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.211131+0000", 2024-02-10T08:39:41.393 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.858e-06 2024-02-10T08:39:41.393 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.393 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.393 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:39:41.393 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.211139+0000", 2024-02-10T08:39:41.393 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3510000000000001e-06 2024-02-10T08:39:41.393 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.393 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.393 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:39:41.393 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.211144+0000", 2024-02-10T08:39:41.393 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6718000000000002e-05 2024-02-10T08:39:41.393 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.394 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.394 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:39:41.394 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.211191+0000", 2024-02-10T08:39:41.394 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000120672 2024-02-10T08:39:41.394 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.394 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.394 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:39:41.394 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.211312+0000", 2024-02-10T08:39:41.394 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000148004 2024-02-10T08:39:41.394 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.394 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.394 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,6,7", 2024-02-10T08:39:41.394 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.211460+0000", 2024-02-10T08:39:41.394 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0064361610000000001 2024-02-10T08:39:41.394 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.394 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.395 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:39:41.395 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.217896+0000", 2024-02-10T08:39:41.395 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00024549499999999998 2024-02-10T08:39:41.395 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.395 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.395 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:39:41.395 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.218141+0000", 2024-02-10T08:39:41.395 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001709157 2024-02-10T08:39:41.395 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.395 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.395 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:39:41.395 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.219850+0000", 2024-02-10T08:39:41.395 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.130308599 2024-02-10T08:39:41.395 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.395 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.395 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:39:41.395 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.350159+0000", 2024-02-10T08:39:41.396 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9990999999999997e-05 2024-02-10T08:39:41.396 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.396 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.396 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:39:41.396 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.350199+0000", 2024-02-10T08:39:41.396 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000130071 2024-02-10T08:39:41.396 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.396 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.396 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:39:41.396 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.350329+0000", 2024-02-10T08:39:41.396 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.139201879 2024-02-10T08:39:41.396 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:39:41.396 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:39:41.397 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:39:41.397 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.397 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.397 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.25664.0:132862 11.b 11:d0d12429:::benchmark_data_smithi018_166993_object13737:head [delete] snapc 0=[] ondisk+write+known_if_redirected e430)", 2024-02-10T08:39:41.397 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:38:44.213421+0000", 2024-02-10T08:39:41.397 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 57.157869394000002, 2024-02-10T08:39:41.397 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.13680400400000001, 2024-02-10T08:39:41.397 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:39:41.397 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:39:41.397 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:39:41.397 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.25664", 2024-02-10T08:39:41.397 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/1087272222", 2024-02-10T08:39:41.397 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 132862 2024-02-10T08:39:41.397 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.398 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:39:41.398 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.398 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:39:41.398 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.213421+0000", 2024-02-10T08:39:41.398 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:39:41.398 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.398 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.398 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:39:41.398 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.213421+0000", 2024-02-10T08:39:41.398 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:39:41.398 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.398 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.398 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:39:41.398 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.213419+0000", 2024-02-10T08:39:41.399 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7039999999999997e-06 2024-02-10T08:39:41.399 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.399 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.399 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:39:41.399 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.213426+0000", 2024-02-10T08:39:41.399 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0932e-05 2024-02-10T08:39:41.399 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.399 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.399 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:39:41.399 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.213437+0000", 2024-02-10T08:39:41.399 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.212e-06 2024-02-10T08:39:41.399 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.399 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.399 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:39:41.399 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.213443+0000", 2024-02-10T08:39:41.400 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3788000000000001e-05 2024-02-10T08:39:41.400 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.400 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.400 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:39:41.400 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.213497+0000", 2024-02-10T08:39:41.400 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010652799999999999 2024-02-10T08:39:41.400 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.400 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.400 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:39:41.400 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.213604+0000", 2024-02-10T08:39:41.400 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012071200000000001 2024-02-10T08:39:41.400 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.400 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.400 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0,3", 2024-02-10T08:39:41.401 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.213724+0000", 2024-02-10T08:39:41.401 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.004445025 2024-02-10T08:39:41.401 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.401 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.401 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:39:41.401 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.218169+0000", 2024-02-10T08:39:41.401 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.131917486 2024-02-10T08:39:41.401 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.401 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.401 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:39:41.401 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.350087+0000", 2024-02-10T08:39:41.401 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3532999999999998e-05 2024-02-10T08:39:41.401 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.401 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.401 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:39:41.401 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.350130+0000", 2024-02-10T08:39:41.402 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9060000000000001e-05 2024-02-10T08:39:41.402 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.402 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.402 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:39:41.402 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.350179+0000", 2024-02-10T08:39:41.402 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5289e-05 2024-02-10T08:39:41.402 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.402 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.402 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:39:41.402 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.350225+0000", 2024-02-10T08:39:41.402 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.13680400400000001 2024-02-10T08:39:41.402 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:39:41.402 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:39:41.402 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:39:41.402 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.402 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.403 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.25664.0:132863 11.0 11:0c3a0f6f:::benchmark_data_smithi018_166993_object13738:head [delete] snapc 0=[] ondisk+write+known_if_redirected e430)", 2024-02-10T08:39:41.403 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:38:44.213462+0000", 2024-02-10T08:39:41.403 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 57.157828639000002, 2024-02-10T08:39:41.403 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.13714844300000001, 2024-02-10T08:39:41.403 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:39:41.403 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:39:41.403 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:39:41.403 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.25664", 2024-02-10T08:39:41.403 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/1087272222", 2024-02-10T08:39:41.403 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 132863 2024-02-10T08:39:41.403 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.403 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:39:41.403 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.403 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:39:41.404 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.213462+0000", 2024-02-10T08:39:41.404 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:39:41.404 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.404 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.404 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:39:41.404 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.213462+0000", 2024-02-10T08:39:41.404 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999962 2024-02-10T08:39:41.404 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.404 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.404 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:39:41.404 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.213458+0000", 2024-02-10T08:39:41.404 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3400000000000003e-06 2024-02-10T08:39:41.404 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.405 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.405 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:39:41.405 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.213464+0000", 2024-02-10T08:39:41.405 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.733e-06 2024-02-10T08:39:41.405 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.405 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.405 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:39:41.405 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.213470+0000", 2024-02-10T08:39:41.405 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0690000000000003e-06 2024-02-10T08:39:41.405 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.405 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.405 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:39:41.405 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.213474+0000", 2024-02-10T08:39:41.405 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9348999999999997e-05 2024-02-10T08:39:41.405 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.406 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.406 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:39:41.406 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.213533+0000", 2024-02-10T08:39:41.406 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000125086 2024-02-10T08:39:41.406 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.406 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.406 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:39:41.406 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.213658+0000", 2024-02-10T08:39:41.406 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000157415 2024-02-10T08:39:41.406 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.406 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.406 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,6,7", 2024-02-10T08:39:41.406 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.213816+0000", 2024-02-10T08:39:41.406 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.004334638 2024-02-10T08:39:41.406 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.407 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.407 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:39:41.407 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.218150+0000", 2024-02-10T08:39:41.407 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0017326310000000001 2024-02-10T08:39:41.407 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.407 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.407 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:39:41.407 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.219883+0000", 2024-02-10T08:39:41.407 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.130490101 2024-02-10T08:39:41.407 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.407 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.407 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:39:41.407 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.350373+0000", 2024-02-10T08:39:41.407 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0678000000000003e-05 2024-02-10T08:39:41.407 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.408 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.408 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:39:41.408 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.350444+0000", 2024-02-10T08:39:41.408 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7876e-05 2024-02-10T08:39:41.408 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.408 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.408 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:39:41.408 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.350492+0000", 2024-02-10T08:39:41.408 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000118242 2024-02-10T08:39:41.408 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.408 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.408 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:39:41.408 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.350610+0000", 2024-02-10T08:39:41.408 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.13714844300000001 2024-02-10T08:39:41.408 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:39:41.409 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:39:41.409 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:39:41.409 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.409 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.409 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.25664.0:132864 11.0 11:011c21a6:::benchmark_data_smithi018_166993_object13739:head [delete] snapc 0=[] ondisk+write+known_if_redirected e430)", 2024-02-10T08:39:41.409 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:38:44.213487+0000", 2024-02-10T08:39:41.409 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 57.157803295999997, 2024-02-10T08:39:41.409 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.137325635, 2024-02-10T08:39:41.409 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:39:41.409 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:39:41.409 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:39:41.409 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.25664", 2024-02-10T08:39:41.409 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/1087272222", 2024-02-10T08:39:41.409 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 132864 2024-02-10T08:39:41.410 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.410 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:39:41.410 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.410 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:39:41.410 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.213487+0000", 2024-02-10T08:39:41.410 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:39:41.410 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.410 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.410 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:39:41.410 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.213487+0000", 2024-02-10T08:39:41.410 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:39:41.410 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.410 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.410 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:39:41.410 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.213486+0000", 2024-02-10T08:39:41.411 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0520000000000002e-06 2024-02-10T08:39:41.411 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.411 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.411 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:39:41.411 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.213489+0000", 2024-02-10T08:39:41.411 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0349999999999998e-06 2024-02-10T08:39:41.411 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.411 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.411 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:39:41.411 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.213495+0000", 2024-02-10T08:39:41.411 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2590000000000002e-06 2024-02-10T08:39:41.411 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.411 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.411 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:39:41.411 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.213500+0000", 2024-02-10T08:39:41.412 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002208705 2024-02-10T08:39:41.412 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.412 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.412 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:39:41.412 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.215708+0000", 2024-02-10T08:39:41.412 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012519300000000001 2024-02-10T08:39:41.412 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.412 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.412 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:39:41.412 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.215834+0000", 2024-02-10T08:39:41.412 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014861200000000001 2024-02-10T08:39:41.412 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.412 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.412 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,6,7", 2024-02-10T08:39:41.413 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.215982+0000", 2024-02-10T08:39:41.413 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0021754719999999999 2024-02-10T08:39:41.413 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.413 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.413 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:39:41.413 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.218158+0000", 2024-02-10T08:39:41.413 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0017545340000000001 2024-02-10T08:39:41.413 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.413 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.413 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:39:41.413 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.219912+0000", 2024-02-10T08:39:41.413 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.13049555800000001 2024-02-10T08:39:41.413 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.413 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.414 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:39:41.414 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.350408+0000", 2024-02-10T08:39:41.414 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000244298 2024-02-10T08:39:41.414 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.414 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.414 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:39:41.414 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.350652+0000", 2024-02-10T08:39:41.414 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5609000000000003e-05 2024-02-10T08:39:41.414 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.414 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.414 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:39:41.414 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.350698+0000", 2024-02-10T08:39:41.414 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000114808 2024-02-10T08:39:41.414 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.415 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.415 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:39:41.415 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.350812+0000", 2024-02-10T08:39:41.415 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.137325635 2024-02-10T08:39:41.415 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:39:41.415 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:39:41.415 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:39:41.415 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.415 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.415 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.25664.0:132866 11.f 11:f0ceb418:::benchmark_data_smithi018_166993_object13741:head [delete] snapc 0=[] ondisk+write+known_if_redirected e430)", 2024-02-10T08:39:41.415 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:38:44.217789+0000", 2024-02-10T08:39:41.415 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 57.153500694000002, 2024-02-10T08:39:41.415 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.13280282600000001, 2024-02-10T08:39:41.415 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:39:41.415 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:39:41.416 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:39:41.416 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.25664", 2024-02-10T08:39:41.416 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/1087272222", 2024-02-10T08:39:41.416 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 132866 2024-02-10T08:39:41.416 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.416 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:39:41.416 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.416 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:39:41.416 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.217789+0000", 2024-02-10T08:39:41.416 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:39:41.416 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.416 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.416 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:39:41.416 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.217789+0000", 2024-02-10T08:39:41.417 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:39:41.417 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.417 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.417 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:39:41.417 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.217788+0000", 2024-02-10T08:39:41.417 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3010000000000001e-06 2024-02-10T08:39:41.417 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.417 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.417 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:39:41.417 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.217795+0000", 2024-02-10T08:39:41.417 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8400000000000007e-06 2024-02-10T08:39:41.417 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.417 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.417 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:39:41.417 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.217805+0000", 2024-02-10T08:39:41.418 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2709999999999998e-06 2024-02-10T08:39:41.418 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.418 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.418 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:39:41.418 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.217811+0000", 2024-02-10T08:39:41.418 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000114051 2024-02-10T08:39:41.418 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.418 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.418 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:39:41.418 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.217925+0000", 2024-02-10T08:39:41.418 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000135396 2024-02-10T08:39:41.418 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.418 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.418 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:39:41.418 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.218061+0000", 2024-02-10T08:39:41.418 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014537999999999999 2024-02-10T08:39:41.419 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.419 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.419 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0,2,7", 2024-02-10T08:39:41.419 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.218206+0000", 2024-02-10T08:39:41.419 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0042747569999999997 2024-02-10T08:39:41.419 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.419 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.419 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:39:41.419 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.222481+0000", 2024-02-10T08:39:41.419 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.127525738 2024-02-10T08:39:41.419 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.419 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.419 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:39:41.419 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.350007+0000", 2024-02-10T08:39:41.420 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00033104400000000001 2024-02-10T08:39:41.420 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.420 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.420 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:39:41.420 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.350338+0000", 2024-02-10T08:39:41.420 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9534000000000002e-05 2024-02-10T08:39:41.420 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.420 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.420 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:39:41.420 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.350407+0000", 2024-02-10T08:39:41.420 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5268e-05 2024-02-10T08:39:41.420 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.420 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.420 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:39:41.421 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.350463+0000", 2024-02-10T08:39:41.421 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012968699999999999 2024-02-10T08:39:41.421 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.421 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.421 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:39:41.421 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.350592+0000", 2024-02-10T08:39:41.421 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.13280282600000001 2024-02-10T08:39:41.421 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:39:41.421 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:39:41.421 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:39:41.421 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.421 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.421 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop_reply(client.25664.0:132862 11.b e430/398 ondisk, result = 0)", 2024-02-10T08:39:41.421 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:38:44.220753+0000", 2024-02-10T08:39:41.421 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 57.150537147999998, 2024-02-10T08:39:41.423 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.12933833, 2024-02-10T08:39:41.423 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:39:41.423 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-02-10T08:39:41.423 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:39:41.423 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.423 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:39:41.423 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.220753+0000", 2024-02-10T08:39:41.423 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:39:41.423 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.423 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.423 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:39:41.424 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.220753+0000", 2024-02-10T08:39:41.424 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:39:41.424 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.424 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.424 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:39:41.424 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.220753+0000", 2024-02-10T08:39:41.424 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0199999999999999e-06 2024-02-10T08:39:41.424 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.424 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.424 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:39:41.424 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.220756+0000", 2024-02-10T08:39:41.424 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3090000000000003e-06 2024-02-10T08:39:41.424 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.424 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.424 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:39:41.425 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.220761+0000", 2024-02-10T08:39:41.425 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.546e-06 2024-02-10T08:39:41.425 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.425 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.425 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:39:41.425 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.220764+0000", 2024-02-10T08:39:41.425 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.129305216 2024-02-10T08:39:41.425 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.425 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.425 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:39:41.425 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.350070+0000", 2024-02-10T08:39:41.425 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0489999999999993e-06 2024-02-10T08:39:41.425 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.425 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.425 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:39:41.425 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.350079+0000", 2024-02-10T08:39:41.426 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2665e-05 2024-02-10T08:39:41.426 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.426 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.426 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:39:41.426 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.350091+0000", 2024-02-10T08:39:41.426 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.12933833 2024-02-10T08:39:41.426 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:39:41.426 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:39:41.426 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:39:41.426 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.426 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.426 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop_reply(client.25664.0:132863 11.0 e430/429 ondisk, result = 0)", 2024-02-10T08:39:41.426 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:38:44.222403+0000", 2024-02-10T08:39:41.426 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 57.148886957999999, 2024-02-10T08:39:41.426 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.127971427, 2024-02-10T08:39:41.426 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:39:41.426 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-02-10T08:39:41.426 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:39:41.427 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.427 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:39:41.427 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.222403+0000", 2024-02-10T08:39:41.427 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:39:41.427 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.427 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.427 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:39:41.427 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.222403+0000", 2024-02-10T08:39:41.427 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:39:41.427 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.427 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.427 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:39:41.427 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.222403+0000", 2024-02-10T08:39:41.427 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.695e-06 2024-02-10T08:39:41.427 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.427 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.428 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:39:41.428 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.222405+0000", 2024-02-10T08:39:41.428 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7450000000000003e-06 2024-02-10T08:39:41.428 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.428 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.428 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:39:41.428 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.222410+0000", 2024-02-10T08:39:41.428 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3359999999999999e-06 2024-02-10T08:39:41.428 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.428 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.428 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:39:41.428 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.222413+0000", 2024-02-10T08:39:41.428 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.127945103 2024-02-10T08:39:41.428 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.429 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.429 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:39:41.429 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.350359+0000", 2024-02-10T08:39:41.429 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8250000000000005e-06 2024-02-10T08:39:41.429 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.429 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.429 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:39:41.429 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.350366+0000", 2024-02-10T08:39:41.429 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2099999999999993e-06 2024-02-10T08:39:41.429 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.429 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.429 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:39:41.429 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.350375+0000", 2024-02-10T08:39:41.429 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.127971427 2024-02-10T08:39:41.429 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:39:41.430 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:39:41.430 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:39:41.430 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.430 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.430 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop_reply(client.25664.0:132864 11.0 e430/429 ondisk, result = 0)", 2024-02-10T08:39:41.430 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:38:44.222416+0000", 2024-02-10T08:39:41.430 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 57.148874239000001, 2024-02-10T08:39:41.430 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.12799740800000001, 2024-02-10T08:39:41.430 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:39:41.430 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-02-10T08:39:41.430 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:39:41.430 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.430 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:39:41.430 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.222416+0000", 2024-02-10T08:39:41.430 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:39:41.431 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.431 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.431 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:39:41.431 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.222416+0000", 2024-02-10T08:39:41.431 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:39:41.431 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.431 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.431 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:39:41.431 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.222416+0000", 2024-02-10T08:39:41.431 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.564e-06 2024-02-10T08:39:41.431 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.431 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.431 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:39:41.431 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.222417+0000", 2024-02-10T08:39:41.431 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0949999999999998e-06 2024-02-10T08:39:41.432 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.432 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.432 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:39:41.432 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.222421+0000", 2024-02-10T08:39:41.432 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.405e-06 2024-02-10T08:39:41.432 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.432 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.432 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:39:41.432 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.222425+0000", 2024-02-10T08:39:41.432 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.12796959899999999 2024-02-10T08:39:41.432 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.432 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.432 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:39:41.432 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.350394+0000", 2024-02-10T08:39:41.432 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7229999999999998e-06 2024-02-10T08:39:41.433 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.433 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.433 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:39:41.433 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.350401+0000", 2024-02-10T08:39:41.433 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2261e-05 2024-02-10T08:39:41.433 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.433 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.433 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:39:41.433 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.350413+0000", 2024-02-10T08:39:41.433 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.12799740800000001 2024-02-10T08:39:41.433 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:39:41.433 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:39:41.433 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:39:41.433 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.433 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.433 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.25664.0:132869 11.6 e430/398 11:6f23cc33:::benchmark_data_smithi018_166993_object13744:head v 430'8370, mlcod=430'8367)", 2024-02-10T08:39:41.433 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:38:44.222950+0000", 2024-02-10T08:39:41.434 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 57.148340089000001, 2024-02-10T08:39:41.434 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.132752652, 2024-02-10T08:39:41.434 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:39:41.434 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:39:41.434 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:39:41.434 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.434 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:39:41.434 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.222950+0000", 2024-02-10T08:39:41.434 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:39:41.434 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.434 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.434 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:39:41.434 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.222950+0000", 2024-02-10T08:39:41.434 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:39:41.434 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.435 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.435 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:39:41.435 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.222949+0000", 2024-02-10T08:39:41.435 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8099999999999998e-06 2024-02-10T08:39:41.435 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.435 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.435 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:39:41.435 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.222957+0000", 2024-02-10T08:39:41.435 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.127047822 2024-02-10T08:39:41.435 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.435 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.435 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:39:41.435 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.350005+0000", 2024-02-10T08:39:41.435 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3298999999999999e-05 2024-02-10T08:39:41.435 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.435 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.435 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:39:41.435 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.350058+0000", 2024-02-10T08:39:41.436 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00038833699999999999 2024-02-10T08:39:41.436 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.436 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.436 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:39:41.436 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.350447+0000", 2024-02-10T08:39:41.436 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0262e-05 2024-02-10T08:39:41.436 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.436 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.436 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:39:41.436 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.350467+0000", 2024-02-10T08:39:41.436 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.005210587 2024-02-10T08:39:41.436 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.436 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.436 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:39:41.436 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.355677+0000", 2024-02-10T08:39:41.437 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5299999999999998e-05 2024-02-10T08:39:41.437 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.437 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.437 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:39:41.437 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:44.355703+0000", 2024-02-10T08:39:41.437 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.132752652 2024-02-10T08:39:41.437 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:39:41.437 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:39:41.437 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:39:41.437 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.437 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.437 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.25664.0:136481 11.f 11:f7da6447:::benchmark_data_smithi018_166993_object17356:head [delete] snapc 0=[] ondisk+write+known_if_redirected e432)", 2024-02-10T08:39:41.437 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:38:48.416204+0000", 2024-02-10T08:39:41.437 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 52.955086193, 2024-02-10T08:39:41.437 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0231714599999999, 2024-02-10T08:39:41.437 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:39:41.437 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-02-10T08:39:41.438 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:39:41.438 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.25664", 2024-02-10T08:39:41.438 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/1087272222", 2024-02-10T08:39:41.438 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 136481 2024-02-10T08:39:41.438 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.438 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:39:41.438 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.438 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:39:41.438 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:48.416204+0000", 2024-02-10T08:39:41.438 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:39:41.438 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.438 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.438 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:39:41.438 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:48.416204+0000", 2024-02-10T08:39:41.438 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:39:41.438 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.439 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.439 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:39:41.439 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:48.416203+0000", 2024-02-10T08:39:41.439 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8210000000000004e-06 2024-02-10T08:39:41.439 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.439 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.439 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:39:41.439 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:48.416210+0000", 2024-02-10T08:39:41.439 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.523e-05 2024-02-10T08:39:41.439 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.439 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.439 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:39:41.439 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:48.416225+0000", 2024-02-10T08:39:41.439 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.567e-06 2024-02-10T08:39:41.439 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.440 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.440 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:39:41.440 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:48.416231+0000", 2024-02-10T08:39:41.440 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0207000000000001e-05 2024-02-10T08:39:41.440 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.440 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.440 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:39:41.440 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:48.416292+0000", 2024-02-10T08:39:41.440 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000133848 2024-02-10T08:39:41.440 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.440 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.440 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:39:41.440 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:48.416425+0000", 2024-02-10T08:39:41.441 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016532299999999999 2024-02-10T08:39:41.441 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.441 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.441 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0,2,7", 2024-02-10T08:39:41.441 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:48.416591+0000", 2024-02-10T08:39:41.441 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.004040348 2024-02-10T08:39:41.441 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.441 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.441 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:39:41.441 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:48.420631+0000", 2024-02-10T08:39:41.441 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0059494889999999996 2024-02-10T08:39:41.441 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.441 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.441 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:39:41.442 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:48.426581+0000", 2024-02-10T08:39:41.442 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0020899769999999998 2024-02-10T08:39:41.442 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.442 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.442 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:39:41.442 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:48.428671+0000", 2024-02-10T08:39:41.442 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9719999999999992e-06 2024-02-10T08:39:41.442 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.442 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.442 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:39:41.442 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:48.428679+0000", 2024-02-10T08:39:41.442 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.010634102 2024-02-10T08:39:41.442 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.442 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.442 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:39:41.442 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:49.439313+0000", 2024-02-10T08:39:41.443 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2718000000000005e-05 2024-02-10T08:39:41.443 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.443 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.443 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:39:41.443 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:49.439375+0000", 2024-02-10T08:39:41.443 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0231714599999999 2024-02-10T08:39:41.443 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:39:41.443 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:39:41.443 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:39:41.443 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.443 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.443 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.25664.0:136484 11.f 11:f12976ba:::benchmark_data_smithi018_166993_object17359:head [delete] snapc 0=[] ondisk+write+known_if_redirected e432)", 2024-02-10T08:39:41.443 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:38:48.416322+0000", 2024-02-10T08:39:41.443 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 52.954968186999999, 2024-02-10T08:39:41.443 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0231302630000001, 2024-02-10T08:39:41.443 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:39:41.444 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-02-10T08:39:41.444 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:39:41.444 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.25664", 2024-02-10T08:39:41.444 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/1087272222", 2024-02-10T08:39:41.444 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 136484 2024-02-10T08:39:41.444 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.444 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:39:41.444 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.444 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:39:41.444 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:48.416322+0000", 2024-02-10T08:39:41.444 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:39:41.444 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.444 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.444 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:39:41.445 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:48.416322+0000", 2024-02-10T08:39:41.445 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:39:41.445 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.445 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.445 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:39:41.445 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:48.416321+0000", 2024-02-10T08:39:41.445 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0900000000000004e-06 2024-02-10T08:39:41.445 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.445 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.445 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:39:41.445 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:48.416326+0000", 2024-02-10T08:39:41.445 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3429999999999996e-06 2024-02-10T08:39:41.445 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.445 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.445 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:39:41.445 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:48.416335+0000", 2024-02-10T08:39:41.446 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4840000000000003e-06 2024-02-10T08:39:41.446 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.446 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.446 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:39:41.446 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:48.416340+0000", 2024-02-10T08:39:41.446 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.005424669 2024-02-10T08:39:41.446 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.446 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.446 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:39:41.446 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:48.421765+0000", 2024-02-10T08:39:41.446 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011927899999999999 2024-02-10T08:39:41.446 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.446 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.446 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:39:41.446 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:48.421884+0000", 2024-02-10T08:39:41.446 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014660300000000001 2024-02-10T08:39:41.447 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.447 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.447 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0,2,7", 2024-02-10T08:39:41.447 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:48.422031+0000", 2024-02-10T08:39:41.447 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0045079880000000001 2024-02-10T08:39:41.447 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.447 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.447 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:39:41.447 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:48.426539+0000", 2024-02-10T08:39:41.447 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0021629290000000001 2024-02-10T08:39:41.447 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.447 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.447 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:39:41.447 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:48.428702+0000", 2024-02-10T08:39:41.447 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9490000000000001e-06 2024-02-10T08:39:41.447 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.448 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.448 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:39:41.448 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:48.428707+0000", 2024-02-10T08:39:41.448 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0106948330000001 2024-02-10T08:39:41.448 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.448 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.448 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:39:41.448 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:49.439402+0000", 2024-02-10T08:39:41.448 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9917000000000003e-05 2024-02-10T08:39:41.448 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.448 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.448 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:39:41.448 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:49.439452+0000", 2024-02-10T08:39:41.448 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0231302630000001 2024-02-10T08:39:41.449 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:39:41.449 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:39:41.449 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:39:41.449 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.449 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.449 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.25664.0:136492 11.f 11:f355ae94:::benchmark_data_smithi018_166993_object17367:head [delete] snapc 0=[] ondisk+write+known_if_redirected e432)", 2024-02-10T08:39:41.449 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:38:48.431239+0000", 2024-02-10T08:39:41.449 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 52.940050917000001, 2024-02-10T08:39:41.449 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.019509585, 2024-02-10T08:39:41.449 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:39:41.449 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:39:41.449 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:39:41.449 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.25664", 2024-02-10T08:39:41.449 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/1087272222", 2024-02-10T08:39:41.449 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 136492 2024-02-10T08:39:41.450 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.450 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:39:41.450 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.450 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:39:41.450 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:48.431239+0000", 2024-02-10T08:39:41.450 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:39:41.450 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.450 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.450 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:39:41.450 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:48.431239+0000", 2024-02-10T08:39:41.450 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:39:41.450 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.450 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.450 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:39:41.450 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:48.431239+0000", 2024-02-10T08:39:41.450 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3629999999999998e-06 2024-02-10T08:39:41.451 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.451 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.451 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:39:41.451 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:48.431242+0000", 2024-02-10T08:39:41.451 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7470000000000002e-06 2024-02-10T08:39:41.451 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.451 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.451 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:39:41.451 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:48.431248+0000", 2024-02-10T08:39:41.451 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.839e-06 2024-02-10T08:39:41.451 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.451 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.451 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:39:41.451 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:48.431252+0000", 2024-02-10T08:39:41.451 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0018286520000000001 2024-02-10T08:39:41.451 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.451 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.451 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:39:41.452 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:48.433080+0000", 2024-02-10T08:39:41.452 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0320000000000003e-06 2024-02-10T08:39:41.452 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.452 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.452 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:39:41.452 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:48.433085+0000", 2024-02-10T08:39:41.452 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.006392022 2024-02-10T08:39:41.452 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.452 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.452 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:39:41.452 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:49.439477+0000", 2024-02-10T08:39:41.452 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000101229 2024-02-10T08:39:41.452 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.452 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.452 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:39:41.453 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:49.439579+0000", 2024-02-10T08:39:41.453 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013316000000000001 2024-02-10T08:39:41.453 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.453 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.453 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0,2", 2024-02-10T08:39:41.453 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:49.439712+0000", 2024-02-10T08:39:41.453 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0087609539999999996 2024-02-10T08:39:41.453 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.453 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.453 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:39:41.453 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:49.448473+0000", 2024-02-10T08:39:41.453 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0020679320000000002 2024-02-10T08:39:41.453 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.453 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.453 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:39:41.453 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:49.450541+0000", 2024-02-10T08:39:41.453 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0059000000000001e-05 2024-02-10T08:39:41.454 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.454 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.454 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:39:41.454 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:49.450611+0000", 2024-02-10T08:39:41.454 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4109000000000002e-05 2024-02-10T08:39:41.454 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.454 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.454 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:39:41.454 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:49.450645+0000", 2024-02-10T08:39:41.454 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000104067 2024-02-10T08:39:41.454 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.454 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.454 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:39:41.454 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:49.450749+0000", 2024-02-10T08:39:41.454 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.019509585 2024-02-10T08:39:41.454 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:39:41.455 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:39:41.455 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:39:41.455 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.455 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.455 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.25664.0:136503 11.f 11:f5de52af:::benchmark_data_smithi018_166993_object17378:head [delete] snapc 0=[] ondisk+write+known_if_redirected e433)", 2024-02-10T08:39:41.455 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:38:48.447123+0000", 2024-02-10T08:39:41.455 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 52.924167044000001, 2024-02-10T08:39:41.455 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0040704869999999, 2024-02-10T08:39:41.455 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:39:41.455 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:39:41.455 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:39:41.455 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.25664", 2024-02-10T08:39:41.455 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/1087272222", 2024-02-10T08:39:41.455 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 136503 2024-02-10T08:39:41.455 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.456 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:39:41.456 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.456 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:39:41.456 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:48.447123+0000", 2024-02-10T08:39:41.456 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:39:41.456 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.456 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.456 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:39:41.456 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:48.447123+0000", 2024-02-10T08:39:41.456 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:39:41.456 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.456 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.456 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:39:41.456 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:48.447122+0000", 2024-02-10T08:39:41.457 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6149999999999999e-06 2024-02-10T08:39:41.457 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.457 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.457 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:39:41.457 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:48.447129+0000", 2024-02-10T08:39:41.457 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1345000000000001e-05 2024-02-10T08:39:41.457 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.457 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.457 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:39:41.457 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:48.447141+0000", 2024-02-10T08:39:41.457 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1669999999999998e-06 2024-02-10T08:39:41.457 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.457 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.457 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:39:41.457 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:48.447146+0000", 2024-02-10T08:39:41.458 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00051521599999999998 2024-02-10T08:39:41.458 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.458 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.458 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:39:41.458 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:48.447661+0000", 2024-02-10T08:39:41.458 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2599999999999994e-06 2024-02-10T08:39:41.458 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.458 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.458 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:39:41.458 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:48.447670+0000", 2024-02-10T08:39:41.458 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.99409030200000004 2024-02-10T08:39:41.458 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.458 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.458 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:39:41.459 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:49.441761+0000", 2024-02-10T08:39:41.459 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011780199999999999 2024-02-10T08:39:41.459 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.459 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.459 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:39:41.459 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:49.441879+0000", 2024-02-10T08:39:41.459 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018211799999999999 2024-02-10T08:39:41.459 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.459 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.459 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0,2", 2024-02-10T08:39:41.459 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:49.442061+0000", 2024-02-10T08:39:41.459 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0085218350000000002 2024-02-10T08:39:41.459 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.459 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.459 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:39:41.460 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:49.450582+0000", 2024-02-10T08:39:41.460 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00044329599999999998 2024-02-10T08:39:41.460 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.460 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.460 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:39:41.460 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:49.451026+0000", 2024-02-10T08:39:41.460 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0061e-05 2024-02-10T08:39:41.460 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.460 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.460 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:39:41.460 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:49.451046+0000", 2024-02-10T08:39:41.460 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4657999999999998e-05 2024-02-10T08:39:41.460 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.460 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.461 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:39:41.461 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:49.451090+0000", 2024-02-10T08:39:41.461 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000103108 2024-02-10T08:39:41.461 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.461 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.461 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:39:41.461 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:49.451194+0000", 2024-02-10T08:39:41.461 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0040704869999999 2024-02-10T08:39:41.461 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:39:41.461 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:39:41.461 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:39:41.461 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.461 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.461 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.25664.0:136506 11.0 11:0def049c:::benchmark_data_smithi018_166993_object17381:head [delete] snapc 0=[] ondisk+write+known_if_redirected e433)", 2024-02-10T08:39:41.461 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:38:48.450590+0000", 2024-02-10T08:39:41.461 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 52.920699675000002, 2024-02-10T08:39:41.462 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.99555204100000005, 2024-02-10T08:39:41.462 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:39:41.462 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:39:41.462 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:39:41.462 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.25664", 2024-02-10T08:39:41.462 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/1087272222", 2024-02-10T08:39:41.462 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 136506 2024-02-10T08:39:41.462 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.462 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:39:41.462 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.462 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:39:41.462 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:48.450590+0000", 2024-02-10T08:39:41.462 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:39:41.462 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.462 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.463 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:39:41.463 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:48.450590+0000", 2024-02-10T08:39:41.463 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:39:41.463 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.463 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.463 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:39:41.463 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:48.450589+0000", 2024-02-10T08:39:41.463 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8199999999999997e-06 2024-02-10T08:39:41.463 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.463 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.463 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:39:41.463 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:48.450597+0000", 2024-02-10T08:39:41.463 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5172e-05 2024-02-10T08:39:41.463 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.463 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.464 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:39:41.464 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:48.450612+0000", 2024-02-10T08:39:41.464 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5000000000000002e-06 2024-02-10T08:39:41.464 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.464 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.464 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:39:41.464 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:48.450619+0000", 2024-02-10T08:39:41.464 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7484000000000001e-05 2024-02-10T08:39:41.464 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.464 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.464 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:39:41.464 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:48.450677+0000", 2024-02-10T08:39:41.464 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2136999999999999e-05 2024-02-10T08:39:41.464 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.464 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.465 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:39:41.465 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:48.450689+0000", 2024-02-10T08:39:41.465 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.988677845 2024-02-10T08:39:41.465 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.465 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.465 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:39:41.465 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:49.439367+0000", 2024-02-10T08:39:41.465 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8144000000000003e-05 2024-02-10T08:39:41.465 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.465 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.465 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:39:41.465 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:49.439445+0000", 2024-02-10T08:39:41.465 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000128207 2024-02-10T08:39:41.465 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.465 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.466 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,6", 2024-02-10T08:39:41.466 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:49.439573+0000", 2024-02-10T08:39:41.466 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0042072100000000003 2024-02-10T08:39:41.466 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.466 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.466 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:39:41.466 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:49.443780+0000", 2024-02-10T08:39:41.466 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7221999999999997e-05 2024-02-10T08:39:41.466 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.466 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.466 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:39:41.466 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:49.443818+0000", 2024-02-10T08:39:41.466 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0021530299999999998 2024-02-10T08:39:41.466 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.467 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.467 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:39:41.467 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:49.445971+0000", 2024-02-10T08:39:41.467 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0111999999999997e-05 2024-02-10T08:39:41.467 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.467 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.467 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:39:41.467 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:49.446021+0000", 2024-02-10T08:39:41.467 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012176900000000001 2024-02-10T08:39:41.467 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.467 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.467 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:39:41.467 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:49.446143+0000", 2024-02-10T08:39:41.467 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.99555204100000005 2024-02-10T08:39:41.467 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:39:41.468 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:39:41.468 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:39:41.468 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.468 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.468 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.25664.0:136514 11.f 11:ff69c0b2:::benchmark_data_smithi018_166993_object17389:head [delete] snapc 0=[] ondisk+write+known_if_redirected e433)", 2024-02-10T08:39:41.468 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:38:48.457375+0000", 2024-02-10T08:39:41.468 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 52.913915330999998, 2024-02-10T08:39:41.468 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0068889430000001, 2024-02-10T08:39:41.468 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:39:41.468 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:39:41.468 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:39:41.468 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.25664", 2024-02-10T08:39:41.468 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/1087272222", 2024-02-10T08:39:41.468 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 136514 2024-02-10T08:39:41.468 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.469 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:39:41.469 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.469 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:39:41.469 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:48.457375+0000", 2024-02-10T08:39:41.469 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:39:41.469 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.469 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.469 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:39:41.469 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:48.457375+0000", 2024-02-10T08:39:41.469 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999981 2024-02-10T08:39:41.469 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.469 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.469 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:39:41.469 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:48.457373+0000", 2024-02-10T08:39:41.469 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5979999999999997e-06 2024-02-10T08:39:41.470 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.470 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.470 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:39:41.470 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:48.457382+0000", 2024-02-10T08:39:41.470 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4912000000000001e-05 2024-02-10T08:39:41.470 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.470 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.470 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:39:41.470 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:48.457396+0000", 2024-02-10T08:39:41.470 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7640000000000005e-06 2024-02-10T08:39:41.470 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.470 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.470 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:39:41.470 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:48.457404+0000", 2024-02-10T08:39:41.471 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8058999999999993e-05 2024-02-10T08:39:41.471 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.471 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.471 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:39:41.471 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:48.457472+0000", 2024-02-10T08:39:41.471 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0107e-05 2024-02-10T08:39:41.471 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.471 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.471 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:39:41.471 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:48.457482+0000", 2024-02-10T08:39:41.471 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.98653107799999995 2024-02-10T08:39:41.471 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.471 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.471 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:39:41.471 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:49.444013+0000", 2024-02-10T08:39:41.471 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012624399999999999 2024-02-10T08:39:41.472 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.472 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.472 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:39:41.472 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:49.444140+0000", 2024-02-10T08:39:41.472 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016116200000000001 2024-02-10T08:39:41.472 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.472 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.472 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0,2", 2024-02-10T08:39:41.472 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:49.444301+0000", 2024-02-10T08:39:41.472 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0064930650000000001 2024-02-10T08:39:41.472 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.472 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.472 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:39:41.472 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:49.450794+0000", 2024-02-10T08:39:41.473 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00041449999999999999 2024-02-10T08:39:41.473 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.473 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.473 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:39:41.473 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:49.451208+0000", 2024-02-10T08:39:41.473 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.012875673000000001 2024-02-10T08:39:41.473 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.473 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.473 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:39:41.473 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:49.464084+0000", 2024-02-10T08:39:41.473 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3044999999999998e-05 2024-02-10T08:39:41.473 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.473 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.473 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:39:41.473 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:49.464137+0000", 2024-02-10T08:39:41.473 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000126587 2024-02-10T08:39:41.474 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.474 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.474 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:39:41.474 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:49.464264+0000", 2024-02-10T08:39:41.474 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0068889430000001 2024-02-10T08:39:41.474 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:39:41.474 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:39:41.474 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:39:41.474 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.474 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.474 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.25664.0:136518 11.f 11:fe604c5a:::benchmark_data_smithi018_166993_object17393:head [delete] snapc 0=[] ondisk+write+known_if_redirected e433)", 2024-02-10T08:39:41.474 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:38:48.464496+0000", 2024-02-10T08:39:41.474 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 52.906794269000002, 2024-02-10T08:39:41.474 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.99998676500000006, 2024-02-10T08:39:41.474 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:39:41.474 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:39:41.475 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:39:41.475 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.25664", 2024-02-10T08:39:41.475 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/1087272222", 2024-02-10T08:39:41.475 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 136518 2024-02-10T08:39:41.475 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.475 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:39:41.475 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.475 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:39:41.475 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:48.464496+0000", 2024-02-10T08:39:41.475 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:39:41.475 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.475 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.475 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:39:41.475 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:48.464496+0000", 2024-02-10T08:39:41.475 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999981 2024-02-10T08:39:41.475 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.475 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.476 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:39:41.476 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:48.464494+0000", 2024-02-10T08:39:41.476 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0149999999999992e-06 2024-02-10T08:39:41.476 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.476 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.476 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:39:41.476 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:48.464503+0000", 2024-02-10T08:39:41.476 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3760999999999999e-05 2024-02-10T08:39:41.476 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.476 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.476 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:39:41.476 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:48.464517+0000", 2024-02-10T08:39:41.476 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8129999999999998e-06 2024-02-10T08:39:41.476 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.476 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.477 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:39:41.477 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:48.464524+0000", 2024-02-10T08:39:41.477 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1059e-05 2024-02-10T08:39:41.477 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.477 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.477 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:39:41.477 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:48.464575+0000", 2024-02-10T08:39:41.477 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2299e-05 2024-02-10T08:39:41.477 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.477 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.477 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:39:41.477 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:48.464587+0000", 2024-02-10T08:39:41.477 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.98168856000000004 2024-02-10T08:39:41.477 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.477 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.477 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:39:41.478 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:49.446276+0000", 2024-02-10T08:39:41.478 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011165199999999999 2024-02-10T08:39:41.478 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.478 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.478 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:39:41.478 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:49.446387+0000", 2024-02-10T08:39:41.478 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014231000000000001 2024-02-10T08:39:41.478 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.478 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.478 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0,2", 2024-02-10T08:39:41.478 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:49.446530+0000", 2024-02-10T08:39:41.478 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0068952950000000001 2024-02-10T08:39:41.478 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.478 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.478 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:39:41.478 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:49.453425+0000", 2024-02-10T08:39:41.479 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3257000000000003e-05 2024-02-10T08:39:41.479 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.479 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.479 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:39:41.479 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:49.453468+0000", 2024-02-10T08:39:41.479 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.010854397999999999 2024-02-10T08:39:41.479 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.479 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.479 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:39:41.479 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:49.464323+0000", 2024-02-10T08:39:41.479 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6326000000000003e-05 2024-02-10T08:39:41.479 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.479 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.479 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:39:41.479 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:49.464369+0000", 2024-02-10T08:39:41.480 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000113768 2024-02-10T08:39:41.480 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.480 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.480 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:39:41.480 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:49.464483+0000", 2024-02-10T08:39:41.480 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.99998676500000006 2024-02-10T08:39:41.480 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:39:41.480 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:39:41.480 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:39:41.480 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.480 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.480 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.25664.0:136522 11.f 11:fb1b854d:::benchmark_data_smithi018_166993_object17397:head [delete] snapc 0=[] ondisk+write+known_if_redirected e433)", 2024-02-10T08:39:41.480 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:38:48.478348+0000", 2024-02-10T08:39:41.480 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 52.892942331, 2024-02-10T08:39:41.481 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.98644714700000002, 2024-02-10T08:39:41.481 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:39:41.481 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:39:41.481 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:39:41.481 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.25664", 2024-02-10T08:39:41.481 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/1087272222", 2024-02-10T08:39:41.481 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 136522 2024-02-10T08:39:41.481 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.481 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:39:41.481 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.481 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:39:41.481 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:48.478348+0000", 2024-02-10T08:39:41.481 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:39:41.481 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.481 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.481 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:39:41.482 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:48.478348+0000", 2024-02-10T08:39:41.482 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:39:41.482 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.482 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.482 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:39:41.482 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:48.478346+0000", 2024-02-10T08:39:41.482 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7440000000000007e-06 2024-02-10T08:39:41.482 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.482 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.482 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:39:41.482 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:48.478354+0000", 2024-02-10T08:39:41.482 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6099999999999995e-06 2024-02-10T08:39:41.482 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.482 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.482 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:39:41.483 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:48.478364+0000", 2024-02-10T08:39:41.483 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9590000000000003e-06 2024-02-10T08:39:41.483 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.483 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.483 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:39:41.483 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:48.478369+0000", 2024-02-10T08:39:41.483 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6557999999999998e-05 2024-02-10T08:39:41.483 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.483 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.483 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:39:41.483 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:48.478405+0000", 2024-02-10T08:39:41.483 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.058e-06 2024-02-10T08:39:41.483 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.483 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.483 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-02-10T08:39:41.483 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:48.478412+0000", 2024-02-10T08:39:41.484 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.97009999300000005 2024-02-10T08:39:41.484 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.484 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.484 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:39:41.484 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:49.448512+0000", 2024-02-10T08:39:41.484 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9485000000000001e-05 2024-02-10T08:39:41.484 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.484 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.484 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:39:41.484 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:49.448602+0000", 2024-02-10T08:39:41.484 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5032999999999997e-05 2024-02-10T08:39:41.484 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.484 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.484 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0,2", 2024-02-10T08:39:41.484 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:49.448687+0000", 2024-02-10T08:39:41.485 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0047448910000000002 2024-02-10T08:39:41.485 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.485 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.485 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:39:41.485 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:49.453432+0000", 2024-02-10T08:39:41.485 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00021384299999999999 2024-02-10T08:39:41.485 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.485 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.485 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:39:41.485 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:49.453645+0000", 2024-02-10T08:39:41.485 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.010975449 2024-02-10T08:39:41.485 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.485 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.485 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:39:41.485 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:49.464621+0000", 2024-02-10T08:39:41.485 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3190999999999999e-05 2024-02-10T08:39:41.486 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.486 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.486 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:39:41.486 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:49.464674+0000", 2024-02-10T08:39:41.486 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000120906 2024-02-10T08:39:41.486 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:39:41.486 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:39:41.486 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:39:41.486 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:49.464795+0000", 2024-02-10T08:39:41.486 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.98644714700000002 2024-02-10T08:39:41.486 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:39:41.486 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:39:41.486 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:39:41.486 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:39:41.486 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:39:41.486 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-02-10T08:39:41.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:41 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:39:41.050463+0000 mon.a (mon.0) 1800 : cluster [WRN] Health check update: Degraded data redundancy: 15911/171105 objects degraded (9.299%), 5 pgs degraded (PG_DEGRADED) 2024-02-10T08:39:41.539 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:39:41 smithi071 systemd[1]: Starting Ceph osd.7 for d46257c8-c7eb-11ee-95b8-87774f69a715... 2024-02-10T08:39:41.625 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:39:41.050463+0000 mon.a (mon.0) 1800 : cluster [WRN] Health check update: Degraded data redundancy: 15911/171105 objects degraded (9.299%), 5 pgs degraded (PG_DEGRADED) 2024-02-10T08:39:42.316 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:39:41.171257+0000 mgr.y (mgr.14505) 859 : cluster [DBG] pgmap v1053: 178 pgs: 5 active+undersized+degraded+remapped+backfilling, 173 active+clean; 3.5 GiB data, 15 GiB used, 610 GiB / 626 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 990 op/s; 15612/170259 objects degraded (9.170%); 3.9 MiB/s, 61 objects/s recovering 2024-02-10T08:39:42.513 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-10T08:39:42.582 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:39:41.171257+0000 mgr.y (mgr.14505) 859 : cluster [DBG] pgmap v1053: 178 pgs: 5 active+undersized+degraded+remapped+backfilling, 173 active+clean; 3.5 GiB data, 15 GiB used, 610 GiB / 626 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 990 op/s; 15612/170259 objects degraded (9.170%); 3.9 MiB/s, 61 objects/s recovering 2024-02-10T08:39:42.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:39:41.171257+0000 mgr.y (mgr.14505) 859 : cluster [DBG] pgmap v1053: 178 pgs: 5 active+undersized+degraded+remapped+backfilling, 173 active+clean; 3.5 GiB data, 15 GiB used, 610 GiB / 626 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 990 op/s; 15612/170259 objects degraded (9.170%); 3.9 MiB/s, 61 objects/s recovering 2024-02-10T08:39:42.791 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:39:42 smithi071 bash[126328]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-02-10T08:39:42.791 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:39:42 smithi071 bash[126328]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-02-10T08:39:42.791 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:39:42 smithi071 bash[126328]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_1 --path /var/lib/ceph/osd/ceph-7 --no-mon-config 2024-02-10T08:39:42.792 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:39:42 smithi071 bash[126328]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-7/block 2024-02-10T08:39:42.792 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:39:42 smithi071 bash[126328]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-7/block 2024-02-10T08:39:42.792 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:39:42 smithi071 bash[126328]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2024-02-10T08:39:42.792 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:39:42 smithi071 bash[126328]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-02-10T08:39:42.792 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:39:42 smithi071 bash[126328]: --> ceph-volume lvm activate successful for osd ID: 7 2024-02-10T08:39:44.096 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.7 dump_ops_in_flight 2024-02-10T08:39:44.248 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:39:44.256 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:44.257 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:39:44.258 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.2 dump_ops_in_flight 2024-02-10T08:39:44.358 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:39:44.391 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:44 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:39:43.172822+0000 mgr.y (mgr.14505) 860 : cluster [DBG] pgmap v1054: 178 pgs: 5 active+undersized+degraded+remapped+backfilling, 173 active+clean; 3.2 GiB data, 15 GiB used, 611 GiB / 626 GiB avail; 1022 B/s rd, 0 B/s wr, 907 op/s; 14371/159198 objects degraded (9.027%); 3.5 MiB/s, 56 objects/s recovering 2024-02-10T08:39:44.391 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:39:44 smithi071 bash[126566]: 1f24fe784401e99c702ccb61bb72dea19a7909609308b5c0c205af8eb5ab18f0 2024-02-10T08:39:44.391 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:39:44 smithi071 systemd[1]: Started Ceph osd.7 for d46257c8-c7eb-11ee-95b8-87774f69a715. 2024-02-10T08:39:44.391 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:39:44 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:39:44.301+0000 7fb959a06380 -1 Falling back to public interface 2024-02-10T08:39:44.395 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:44.458 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:39:44.465 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:44.465 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:39:44.543 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:39:44.567 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:39:44.623 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:39:43.172822+0000 mgr.y (mgr.14505) 860 : cluster [DBG] pgmap v1054: 178 pgs: 5 active+undersized+degraded+remapped+backfilling, 173 active+clean; 3.2 GiB data, 15 GiB used, 611 GiB / 626 GiB avail; 1022 B/s rd, 0 B/s wr, 907 op/s; 14371/159198 objects degraded (9.027%); 3.5 MiB/s, 56 objects/s recovering 2024-02-10T08:39:44.623 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:39:43.172822+0000 mgr.y (mgr.14505) 860 : cluster [DBG] pgmap v1054: 178 pgs: 5 active+undersized+degraded+remapped+backfilling, 173 active+clean; 3.2 GiB data, 15 GiB used, 611 GiB / 626 GiB avail; 1022 B/s rd, 0 B/s wr, 907 op/s; 14371/159198 objects degraded (9.027%); 3.5 MiB/s, 56 objects/s recovering 2024-02-10T08:39:44.625 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:45.293 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:39:45.311 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:45.312 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:39:45.413 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:39:45.484 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:45.633 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:39:45.639 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:45.639 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:39:45.740 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:39:45.813 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:45.906 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:39:45.916 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:45.917 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:39:46.017 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:39:46.084 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:39:46.110 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:39:46.117 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:46.142 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:39:46.145 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:46.145 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:39:46.246 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:39:46.291 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:46.318 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:39:46.338 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:46.338 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:39:46.339 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:39:45.173506+0000 mgr.y (mgr.14505) 861 : cluster [DBG] pgmap v1055: 178 pgs: 5 active+undersized+degraded+remapped+backfilling, 173 active+clean; 3.2 GiB data, 15 GiB used, 611 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 915 op/s; 14077/156588 objects degraded (8.990%); 3.5 MiB/s, 56 objects/s recovering 2024-02-10T08:39:46.340 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:39:45.576094+0000 osd.2 (osd.2) 269 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:39:46.340 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:39:45.576148+0000 osd.2 (osd.2) 270 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:39:46.340 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:39:46.051871+0000 mon.a (mon.0) 1801 : cluster [WRN] Health check update: Degraded data redundancy: 14077/156588 objects degraded (8.990%), 5 pgs degraded (PG_DEGRADED) 2024-02-10T08:39:46.439 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:39:46.540 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:39:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:39:46] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:39:46.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:39:45.173506+0000 mgr.y (mgr.14505) 861 : cluster [DBG] pgmap v1055: 178 pgs: 5 active+undersized+degraded+remapped+backfilling, 173 active+clean; 3.2 GiB data, 15 GiB used, 611 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 915 op/s; 14077/156588 objects degraded (8.990%); 3.5 MiB/s, 56 objects/s recovering 2024-02-10T08:39:46.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:39:45.576094+0000 osd.2 (osd.2) 269 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:39:46.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:39:45.576148+0000 osd.2 (osd.2) 270 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:39:46.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:39:46.051871+0000 mon.a (mon.0) 1801 : cluster [WRN] Health check update: Degraded data redundancy: 14077/156588 objects degraded (8.990%), 5 pgs degraded (PG_DEGRADED) 2024-02-10T08:39:46.587 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:46.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:39:45.173506+0000 mgr.y (mgr.14505) 861 : cluster [DBG] pgmap v1055: 178 pgs: 5 active+undersized+degraded+remapped+backfilling, 173 active+clean; 3.2 GiB data, 15 GiB used, 611 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 915 op/s; 14077/156588 objects degraded (8.990%); 3.5 MiB/s, 56 objects/s recovering 2024-02-10T08:39:46.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:39:45.576094+0000 osd.2 (osd.2) 269 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:39:46.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:39:45.576148+0000 osd.2 (osd.2) 270 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:39:46.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:39:46.051871+0000 mon.a (mon.0) 1801 : cluster [WRN] Health check update: Degraded data redundancy: 14077/156588 objects degraded (8.990%), 5 pgs degraded (PG_DEGRADED) 2024-02-10T08:39:46.697 INFO:teuthology.orchestra.run.smithi071.stderr:no valid command found; 10 closest matches: 2024-02-10T08:39:46.697 INFO:teuthology.orchestra.run.smithi071.stderr:0 2024-02-10T08:39:46.697 INFO:teuthology.orchestra.run.smithi071.stderr:1 2024-02-10T08:39:46.697 INFO:teuthology.orchestra.run.smithi071.stderr:2 2024-02-10T08:39:46.697 INFO:teuthology.orchestra.run.smithi071.stderr:abort 2024-02-10T08:39:46.697 INFO:teuthology.orchestra.run.smithi071.stderr:assert 2024-02-10T08:39:46.697 INFO:teuthology.orchestra.run.smithi071.stderr:bluefs debug_inject_read_zeros 2024-02-10T08:39:46.697 INFO:teuthology.orchestra.run.smithi071.stderr:bluefs files list 2024-02-10T08:39:46.697 INFO:teuthology.orchestra.run.smithi071.stderr:bluefs stats 2024-02-10T08:39:46.698 INFO:teuthology.orchestra.run.smithi071.stderr:bluestore bluefs device info [] 2024-02-10T08:39:46.698 INFO:teuthology.orchestra.run.smithi071.stderr:config diff 2024-02-10T08:39:46.698 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: invalid command 2024-02-10T08:39:47.154 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:39:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:39:46.696+0000 7f52ba297700 -1 mgr get_metadata_python Requested missing service osd.7 2024-02-10T08:39:47.381 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is unset 2024-02-10T08:39:47.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:39:46.331518+0000 mon.a (mon.0) 1802 : cluster [DBG] osdmap e443: 8 total, 7 up, 7 in 2024-02-10T08:39:47.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:39:46.445413+0000 mon.c (mon.2) 102 : audit [INF] from='client.? 172.21.15.18:0/1531852036' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:39:47.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:39:46.445973+0000 mon.a (mon.0) 1803 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:39:47.406 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:39:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:39:47] "GET /metrics HTTP/1.1" 200 166359 "" "Prometheus/2.33.4" 2024-02-10T08:39:47.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:39:46.331518+0000 mon.a (mon.0) 1802 : cluster [DBG] osdmap e443: 8 total, 7 up, 7 in 2024-02-10T08:39:47.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:39:46.445413+0000 mon.c (mon.2) 102 : audit [INF] from='client.? 172.21.15.18:0/1531852036' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:39:47.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:39:46.445973+0000 mon.a (mon.0) 1803 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:39:47.598 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:39:47.609 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:47.610 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:39:47.711 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:39:47.777 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:47.795 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:39:46.331518+0000 mon.a (mon.0) 1802 : cluster [DBG] osdmap e443: 8 total, 7 up, 7 in 2024-02-10T08:39:47.795 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:39:46.445413+0000 mon.c (mon.2) 102 : audit [INF] from='client.? 172.21.15.18:0/1531852036' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:39:47.795 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:39:46.445973+0000 mon.a (mon.0) 1803 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:39:47.803 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-02-10T08:39:47.804 INFO:tasks.cephadm.ceph_manager.ceph:waiting on admin_socket for osd-7, ['dump_ops_in_flight'] 2024-02-10T08:39:48.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:39:47.174464+0000 mgr.y (mgr.14505) 862 : cluster [DBG] pgmap v1057: 178 pgs: 5 active+undersized+degraded+remapped+backfilling, 173 active+clean; 3.2 GiB data, 15 GiB used, 611 GiB / 626 GiB avail; 639 B/s rd, 0 B/s wr, 605 op/s; 14077/156588 objects degraded (8.990%); 2.6 MiB/s, 41 objects/s recovering 2024-02-10T08:39:48.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:39:47.337074+0000 mon.a (mon.0) 1804 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:39:48.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:39:47.354451+0000 mon.a (mon.0) 1805 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-10T08:39:48.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:39:47.354519+0000 mon.a (mon.0) 1806 : cluster [DBG] osdmap e444: 8 total, 7 up, 7 in 2024-02-10T08:39:48.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:39:47.174464+0000 mgr.y (mgr.14505) 862 : cluster [DBG] pgmap v1057: 178 pgs: 5 active+undersized+degraded+remapped+backfilling, 173 active+clean; 3.2 GiB data, 15 GiB used, 611 GiB / 626 GiB avail; 639 B/s rd, 0 B/s wr, 605 op/s; 14077/156588 objects degraded (8.990%); 2.6 MiB/s, 41 objects/s recovering 2024-02-10T08:39:48.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:39:47.337074+0000 mon.a (mon.0) 1804 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:39:48.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:39:47.354451+0000 mon.a (mon.0) 1805 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-10T08:39:48.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:39:47.354519+0000 mon.a (mon.0) 1806 : cluster [DBG] osdmap e444: 8 total, 7 up, 7 in 2024-02-10T08:39:48.791 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:39:47.174464+0000 mgr.y (mgr.14505) 862 : cluster [DBG] pgmap v1057: 178 pgs: 5 active+undersized+degraded+remapped+backfilling, 173 active+clean; 3.2 GiB data, 15 GiB used, 611 GiB / 626 GiB avail; 639 B/s rd, 0 B/s wr, 605 op/s; 14077/156588 objects degraded (8.990%); 2.6 MiB/s, 41 objects/s recovering 2024-02-10T08:39:48.791 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:39:47.337074+0000 mon.a (mon.0) 1804 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:39:48.791 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:39:47.354451+0000 mon.a (mon.0) 1805 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-10T08:39:48.791 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:39:47.354519+0000 mon.a (mon.0) 1806 : cluster [DBG] osdmap e444: 8 total, 7 up, 7 in 2024-02-10T08:39:49.289 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:39:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:39:49.789 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:39:49 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:39:49.421+0000 7fb959a06380 -1 osd.7 432 log_to_monitors {default=true} 2024-02-10T08:39:50.152 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:39:50.155 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:50.155 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:39:50.256 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:39:50.306 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:50.345 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:39:50.349 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:50.350 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:39:50.451 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:39:50.508 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:39:48.987844+0000 mgr.y (mgr.14505) 863 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:39:50.508 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:39:49.177901+0000 mgr.y (mgr.14505) 864 : cluster [DBG] pgmap v1059: 178 pgs: 5 active+undersized+degraded+remapped+backfilling, 173 active+clean; 2.9 GiB data, 14 GiB used, 612 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.08k op/s; 12922/144384 objects degraded (8.950%); 3.9 MiB/s, 63 objects/s recovering 2024-02-10T08:39:50.508 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:39:49.432260+0000 mon.b (mon.1) 98 : audit [INF] from='osd.7 v2:172.21.15.71:6812/3959966129' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-10T08:39:50.508 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:39:49.433002+0000 mon.a (mon.0) 1807 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-10T08:39:50.508 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:39:48.987844+0000 mgr.y (mgr.14505) 863 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:39:50.508 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:39:49.177901+0000 mgr.y (mgr.14505) 864 : cluster [DBG] pgmap v1059: 178 pgs: 5 active+undersized+degraded+remapped+backfilling, 173 active+clean; 2.9 GiB data, 14 GiB used, 612 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.08k op/s; 12922/144384 objects degraded (8.950%); 3.9 MiB/s, 63 objects/s recovering 2024-02-10T08:39:50.509 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:39:49.432260+0000 mon.b (mon.1) 98 : audit [INF] from='osd.7 v2:172.21.15.71:6812/3959966129' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-10T08:39:50.509 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:39:49.433002+0000 mon.a (mon.0) 1807 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-10T08:39:50.516 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:50.789 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:39:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:39:50.399+0000 7fb94c6f0700 -1 osd.7 445 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-10T08:39:50.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:39:48.987844+0000 mgr.y (mgr.14505) 863 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:39:50.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:39:49.177901+0000 mgr.y (mgr.14505) 864 : cluster [DBG] pgmap v1059: 178 pgs: 5 active+undersized+degraded+remapped+backfilling, 173 active+clean; 2.9 GiB data, 14 GiB used, 612 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.08k op/s; 12922/144384 objects degraded (8.950%); 3.9 MiB/s, 63 objects/s recovering 2024-02-10T08:39:50.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:39:49.432260+0000 mon.b (mon.1) 98 : audit [INF] from='osd.7 v2:172.21.15.71:6812/3959966129' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-10T08:39:50.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:39:49.433002+0000 mon.a (mon.0) 1807 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-10T08:39:51.657 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:39:50.366336+0000 mon.a (mon.0) 1808 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-02-10T08:39:51.658 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:39:50.366406+0000 mon.a (mon.0) 1809 : cluster [DBG] osdmap e445: 8 total, 7 up, 7 in 2024-02-10T08:39:51.658 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:39:50.370382+0000 mon.b (mon.1) 99 : audit [INF] from='osd.7 v2:172.21.15.71:6812/3959966129' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-02-10T08:39:51.658 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:39:50.384357+0000 mon.a (mon.0) 1810 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-02-10T08:39:51.658 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:39:50.397218+0000 mon.a (mon.0) 1811 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-10T08:39:51.658 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:39:51.057195+0000 mon.a (mon.0) 1812 : cluster [WRN] Health check update: Degraded data redundancy: 12922/144384 objects degraded (8.950%), 5 pgs degraded (PG_DEGRADED) 2024-02-10T08:39:51.658 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:39:50.366336+0000 mon.a (mon.0) 1808 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-02-10T08:39:51.658 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:39:50.366406+0000 mon.a (mon.0) 1809 : cluster [DBG] osdmap e445: 8 total, 7 up, 7 in 2024-02-10T08:39:51.658 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:39:50.370382+0000 mon.b (mon.1) 99 : audit [INF] from='osd.7 v2:172.21.15.71:6812/3959966129' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-02-10T08:39:51.658 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:39:50.384357+0000 mon.a (mon.0) 1810 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-02-10T08:39:51.659 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:39:50.397218+0000 mon.a (mon.0) 1811 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-10T08:39:51.659 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:39:51.057195+0000 mon.a (mon.0) 1812 : cluster [WRN] Health check update: Degraded data redundancy: 12922/144384 objects degraded (8.950%), 5 pgs degraded (PG_DEGRADED) 2024-02-10T08:39:51.787 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:39:51.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:51 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:39:50.366336+0000 mon.a (mon.0) 1808 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-02-10T08:39:51.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:51 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:39:50.366406+0000 mon.a (mon.0) 1809 : cluster [DBG] osdmap e445: 8 total, 7 up, 7 in 2024-02-10T08:39:51.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:51 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:39:50.370382+0000 mon.b (mon.1) 99 : audit [INF] from='osd.7 v2:172.21.15.71:6812/3959966129' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-02-10T08:39:51.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:51 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:39:50.384357+0000 mon.a (mon.0) 1810 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-02-10T08:39:51.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:51 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:39:50.397218+0000 mon.a (mon.0) 1811 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-10T08:39:51.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:51 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:39:51.057195+0000 mon.a (mon.0) 1812 : cluster [WRN] Health check update: Degraded data redundancy: 12922/144384 objects degraded (8.950%), 5 pgs degraded (PG_DEGRADED) 2024-02-10T08:39:51.794 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:51.794 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:39:51.895 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:39:51.959 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:52.426 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:39:52.443 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:52.444 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:39:52.446 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:39:51.178434+0000 mgr.y (mgr.14505) 865 : cluster [DBG] pgmap v1061: 178 pgs: 5 active+undersized+degraded+remapped+backfilling, 173 active+clean; 2.9 GiB data, 14 GiB used, 612 GiB / 626 GiB avail; 852 B/s rd, 0 B/s wr, 721 op/s; 12652/143601 objects degraded (8.811%); 2.9 MiB/s, 46 objects/s recovering 2024-02-10T08:39:52.447 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:39:51.381535+0000 mon.a (mon.0) 1813 : cluster [INF] osd.7 v2:172.21.15.71:6812/3959966129 boot 2024-02-10T08:39:52.447 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:39:51.381589+0000 mon.a (mon.0) 1814 : cluster [DBG] osdmap e446: 8 total, 8 up, 7 in 2024-02-10T08:39:52.447 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:39:51.382687+0000 mon.a (mon.0) 1815 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-10T08:39:52.447 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:39:51.178434+0000 mgr.y (mgr.14505) 865 : cluster [DBG] pgmap v1061: 178 pgs: 5 active+undersized+degraded+remapped+backfilling, 173 active+clean; 2.9 GiB data, 14 GiB used, 612 GiB / 626 GiB avail; 852 B/s rd, 0 B/s wr, 721 op/s; 12652/143601 objects degraded (8.811%); 2.9 MiB/s, 46 objects/s recovering 2024-02-10T08:39:52.447 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:39:51.381535+0000 mon.a (mon.0) 1813 : cluster [INF] osd.7 v2:172.21.15.71:6812/3959966129 boot 2024-02-10T08:39:52.447 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:39:51.381589+0000 mon.a (mon.0) 1814 : cluster [DBG] osdmap e446: 8 total, 8 up, 7 in 2024-02-10T08:39:52.447 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:39:51.382687+0000 mon.a (mon.0) 1815 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-10T08:39:52.545 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:39:52.562 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:39:52.571 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:52.594 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:39:52.610 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:39:52.620 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:39:52.627 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:39:52.631 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:52.632 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:39:52.645 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:39:52.663 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:39:52.681 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:39:52.698 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:39:52.699 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-10T08:39:52.700 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-10T08:39:52.700 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-10T08:39:52.700 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-10T08:39:52.700 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-10T08:39:52.700 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-10T08:39:52.700 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-10T08:39:52.700 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-10T08:39:52.730 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-02-10T08:39:52.730 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-02-10T08:39:52.730 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-02-10T08:39:52.730 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-02-10T08:39:52.732 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:39:52.757 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:52 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:39:51.178434+0000 mgr.y (mgr.14505) 865 : cluster [DBG] pgmap v1061: 178 pgs: 5 active+undersized+degraded+remapped+backfilling, 173 active+clean; 2.9 GiB data, 14 GiB used, 612 GiB / 626 GiB avail; 852 B/s rd, 0 B/s wr, 721 op/s; 12652/143601 objects degraded (8.811%); 2.9 MiB/s, 46 objects/s recovering 2024-02-10T08:39:52.757 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:52 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:39:51.381535+0000 mon.a (mon.0) 1813 : cluster [INF] osd.7 v2:172.21.15.71:6812/3959966129 boot 2024-02-10T08:39:52.757 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:52 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:39:51.381589+0000 mon.a (mon.0) 1814 : cluster [DBG] osdmap e446: 8 total, 8 up, 7 in 2024-02-10T08:39:52.757 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:52 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:39:51.382687+0000 mon.a (mon.0) 1815 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-10T08:39:52.759 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:52.778 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:39:52.780 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:52.781 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:39:52.805 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.7 dump_ops_in_flight 2024-02-10T08:39:52.882 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:39:52.908 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:52.927 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:39:52.930 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:52.931 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:39:53.031 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:39:53.062 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:53.126 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:39:53.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:39:50.434464+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:39:53.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:39:50.434545+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:39:53.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:39:52.407988+0000 mon.a (mon.0) 1816 : cluster [DBG] osdmap e447: 8 total, 8 up, 7 in 2024-02-10T08:39:53.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:39:52.545406+0000 mon.a (mon.0) 1817 : audit [DBG] from='client.? 172.21.15.18:0/954095687' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:39:53.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:39:50.434464+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:39:53.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:39:50.434545+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:39:53.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:39:52.407988+0000 mon.a (mon.0) 1816 : cluster [DBG] osdmap e447: 8 total, 8 up, 7 in 2024-02-10T08:39:53.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:39:52.545406+0000 mon.a (mon.0) 1817 : audit [DBG] from='client.? 172.21.15.18:0/954095687' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:39:53.792 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:53 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:39:50.434464+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:39:53.792 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:53 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:39:50.434545+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:39:53.792 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:53 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:39:52.407988+0000 mon.a (mon.0) 1816 : cluster [DBG] osdmap e447: 8 total, 8 up, 7 in 2024-02-10T08:39:53.792 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:53 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:39:52.545406+0000 mon.a (mon.0) 1817 : audit [DBG] from='client.? 172.21.15.18:0/954095687' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:39:54.416 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:39:54.425 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:54.426 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:39:54.436 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.2 dump_blocked_ops 2024-02-10T08:39:54.527 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:39:54.648 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:54.791 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:54 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:39:53.179163+0000 mgr.y (mgr.14505) 866 : cluster [DBG] pgmap v1064: 178 pgs: 4 remapped+peering, 1 active+undersized+degraded+remapped+backfilling, 173 active+clean; 2.7 GiB data, 13 GiB used, 612 GiB / 626 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 1.32k op/s; 2413/133623 objects degraded (1.806%); 5.1 MiB/s, 81 objects/s recovering 2024-02-10T08:39:54.791 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:54 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:39:53.284354+0000 osd.6 (osd.6) 286 : cluster [DBG] 11.3 scrub starts 2024-02-10T08:39:54.791 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:54 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:39:53.411657+0000 osd.6 (osd.6) 287 : cluster [INF] 11.4 continuing backfill to osd.1 from (430'8284,446'12217] 11:22eb4499:::benchmark_data_smithi018_166993_object81143:head to 446'12217 2024-02-10T08:39:54.791 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:54 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:39:53.412003+0000 mon.a (mon.0) 1818 : cluster [DBG] osdmap e448: 8 total, 8 up, 7 in 2024-02-10T08:39:54.791 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:54 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:39:53.413009+0000 osd.1 (osd.1) 314 : cluster [INF] 11.f continuing backfill to osd.0 from (432'8462,446'12126] 11:f2b90e82:::benchmark_data_smithi018_166993_object109629:head to 446'12126 2024-02-10T08:39:54.791 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:54 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:39:53.413485+0000 osd.5 (osd.5) 289 : cluster [INF] 11.5 continuing backfill to osd.3 from (426'7724,446'11918] 11:a2f743fd:::benchmark_data_smithi018_166993_object76194:head to 446'11918 2024-02-10T08:39:54.791 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:54 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:39:53.416511+0000 osd.4 (osd.4) 216 : cluster [INF] 11.e continuing backfill to osd.0 from (425'7755,446'12004] 11:72abf0c3:::benchmark_data_smithi018_166993_object110278:head to 446'12004 2024-02-10T08:39:54.791 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:54 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:39:53.712317+0000 osd.6 (osd.6) 288 : cluster [DBG] 11.3 scrub ok 2024-02-10T08:39:54.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:39:53.179163+0000 mgr.y (mgr.14505) 866 : cluster [DBG] pgmap v1064: 178 pgs: 4 remapped+peering, 1 active+undersized+degraded+remapped+backfilling, 173 active+clean; 2.7 GiB data, 13 GiB used, 612 GiB / 626 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 1.32k op/s; 2413/133623 objects degraded (1.806%); 5.1 MiB/s, 81 objects/s recovering 2024-02-10T08:39:54.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:39:53.284354+0000 osd.6 (osd.6) 286 : cluster [DBG] 11.3 scrub starts 2024-02-10T08:39:54.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:39:53.411657+0000 osd.6 (osd.6) 287 : cluster [INF] 11.4 continuing backfill to osd.1 from (430'8284,446'12217] 11:22eb4499:::benchmark_data_smithi018_166993_object81143:head to 446'12217 2024-02-10T08:39:54.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:39:53.412003+0000 mon.a (mon.0) 1818 : cluster [DBG] osdmap e448: 8 total, 8 up, 7 in 2024-02-10T08:39:54.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:39:53.413009+0000 osd.1 (osd.1) 314 : cluster [INF] 11.f continuing backfill to osd.0 from (432'8462,446'12126] 11:f2b90e82:::benchmark_data_smithi018_166993_object109629:head to 446'12126 2024-02-10T08:39:54.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:39:53.413485+0000 osd.5 (osd.5) 289 : cluster [INF] 11.5 continuing backfill to osd.3 from (426'7724,446'11918] 11:a2f743fd:::benchmark_data_smithi018_166993_object76194:head to 446'11918 2024-02-10T08:39:54.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:39:53.416511+0000 osd.4 (osd.4) 216 : cluster [INF] 11.e continuing backfill to osd.0 from (425'7755,446'12004] 11:72abf0c3:::benchmark_data_smithi018_166993_object110278:head to 446'12004 2024-02-10T08:39:54.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:39:53.712317+0000 osd.6 (osd.6) 288 : cluster [DBG] 11.3 scrub ok 2024-02-10T08:39:54.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:39:53.179163+0000 mgr.y (mgr.14505) 866 : cluster [DBG] pgmap v1064: 178 pgs: 4 remapped+peering, 1 active+undersized+degraded+remapped+backfilling, 173 active+clean; 2.7 GiB data, 13 GiB used, 612 GiB / 626 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 1.32k op/s; 2413/133623 objects degraded (1.806%); 5.1 MiB/s, 81 objects/s recovering 2024-02-10T08:39:54.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:39:53.284354+0000 osd.6 (osd.6) 286 : cluster [DBG] 11.3 scrub starts 2024-02-10T08:39:54.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:39:53.411657+0000 osd.6 (osd.6) 287 : cluster [INF] 11.4 continuing backfill to osd.1 from (430'8284,446'12217] 11:22eb4499:::benchmark_data_smithi018_166993_object81143:head to 446'12217 2024-02-10T08:39:54.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:39:53.412003+0000 mon.a (mon.0) 1818 : cluster [DBG] osdmap e448: 8 total, 8 up, 7 in 2024-02-10T08:39:54.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:39:53.413009+0000 osd.1 (osd.1) 314 : cluster [INF] 11.f continuing backfill to osd.0 from (432'8462,446'12126] 11:f2b90e82:::benchmark_data_smithi018_166993_object109629:head to 446'12126 2024-02-10T08:39:54.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:39:53.413485+0000 osd.5 (osd.5) 289 : cluster [INF] 11.5 continuing backfill to osd.3 from (426'7724,446'11918] 11:a2f743fd:::benchmark_data_smithi018_166993_object76194:head to 446'11918 2024-02-10T08:39:54.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:39:53.416511+0000 osd.4 (osd.4) 216 : cluster [INF] 11.e continuing backfill to osd.0 from (425'7755,446'12004] 11:72abf0c3:::benchmark_data_smithi018_166993_object110278:head to 446'12004 2024-02-10T08:39:54.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:39:53.712317+0000 osd.6 (osd.6) 288 : cluster [DBG] 11.3 scrub ok 2024-02-10T08:39:55.127 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:39:55.646 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:39:55.651 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:55.652 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:39:55.720 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:39:54.411842+0000 osd.1 (osd.1) 315 : cluster [INF] 11.0 continuing backfill to osd.6 from (434'8652,446'12225] 11:01c84c2d:::benchmark_data_smithi018_166993_object104515:head to 446'12225 2024-02-10T08:39:55.720 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:39:54.413075+0000 mon.a (mon.0) 1819 : cluster [DBG] osdmap e449: 8 total, 8 up, 7 in 2024-02-10T08:39:55.753 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:39:55.796 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:39:54.411842+0000 osd.1 (osd.1) 315 : cluster [INF] 11.0 continuing backfill to osd.6 from (434'8652,446'12225] 11:01c84c2d:::benchmark_data_smithi018_166993_object104515:head to 446'12225 2024-02-10T08:39:55.796 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:39:54.413075+0000 mon.a (mon.0) 1819 : cluster [DBG] osdmap e449: 8 total, 8 up, 7 in 2024-02-10T08:39:55.800 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:39:54.411842+0000 osd.1 (osd.1) 315 : cluster [INF] 11.0 continuing backfill to osd.6 from (434'8652,446'12225] 11:01c84c2d:::benchmark_data_smithi018_166993_object104515:head to 446'12225 2024-02-10T08:39:55.800 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:39:54.413075+0000 mon.a (mon.0) 1819 : cluster [DBG] osdmap e449: 8 total, 8 up, 7 in 2024-02-10T08:39:55.805 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:55.878 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-10T08:39:56.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:39:55.179689+0000 mgr.y (mgr.14505) 867 : cluster [DBG] pgmap v1067: 178 pgs: 4 remapped+peering, 1 active+recovery_wait+degraded+remapped, 173 active+clean; 2.7 GiB data, 13 GiB used, 613 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 995 op/s; 2256/131670 objects degraded (1.713%); 3.5 MiB/s, 56 objects/s recovering 2024-02-10T08:39:56.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:39:56.061790+0000 mon.a (mon.0) 1820 : cluster [WRN] Health check update: Degraded data redundancy: 2256/131670 objects degraded (1.713%), 1 pg degraded (PG_DEGRADED) 2024-02-10T08:39:56.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:39:55.179689+0000 mgr.y (mgr.14505) 867 : cluster [DBG] pgmap v1067: 178 pgs: 4 remapped+peering, 1 active+recovery_wait+degraded+remapped, 173 active+clean; 2.7 GiB data, 13 GiB used, 613 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 995 op/s; 2256/131670 objects degraded (1.713%); 3.5 MiB/s, 56 objects/s recovering 2024-02-10T08:39:56.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:39:56.061790+0000 mon.a (mon.0) 1820 : cluster [WRN] Health check update: Degraded data redundancy: 2256/131670 objects degraded (1.713%), 1 pg degraded (PG_DEGRADED) 2024-02-10T08:39:56.791 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:39:55.179689+0000 mgr.y (mgr.14505) 867 : cluster [DBG] pgmap v1067: 178 pgs: 4 remapped+peering, 1 active+recovery_wait+degraded+remapped, 173 active+clean; 2.7 GiB data, 13 GiB used, 613 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 995 op/s; 2256/131670 objects degraded (1.713%); 3.5 MiB/s, 56 objects/s recovering 2024-02-10T08:39:56.792 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:39:56.061790+0000 mon.a (mon.0) 1820 : cluster [WRN] Health check update: Degraded data redundancy: 2256/131670 objects degraded (1.713%), 1 pg degraded (PG_DEGRADED) 2024-02-10T08:39:56.792 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:39:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:39:56] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:39:56.867 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:39:56.876 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:56.876 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:39:56.951 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:39:56.977 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:39:57.021 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:57.077 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd unset nodeep-scrub 2024-02-10T08:39:57.291 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:39:57.294 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:57.294 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:39:57.380 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:39:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:39:57] "GET /metrics HTTP/1.1" 200 166359 "" "Prometheus/2.33.4" 2024-02-10T08:39:57.396 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:39:57.455 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:57.565 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-02-10T08:39:57.565 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:39:57.921 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:39:57.926 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:39:57.927 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:39:58.028 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:39:58.088 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:39:58.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:39:57.180155+0000 mgr.y (mgr.14505) 868 : cluster [DBG] pgmap v1068: 178 pgs: 4 remapped+peering, 1 active+recovery_wait+degraded+remapped, 173 active+clean; 2.7 GiB data, 13 GiB used, 613 GiB / 626 GiB avail; 882 B/s rd, 0 B/s wr, 686 op/s; 2256/131670 objects degraded (1.713%); 2.4 MiB/s, 38 objects/s recovering 2024-02-10T08:39:58.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:39:57.180155+0000 mgr.y (mgr.14505) 868 : cluster [DBG] pgmap v1068: 178 pgs: 4 remapped+peering, 1 active+recovery_wait+degraded+remapped, 173 active+clean; 2.7 GiB data, 13 GiB used, 613 GiB / 626 GiB avail; 882 B/s rd, 0 B/s wr, 686 op/s; 2256/131670 objects degraded (1.713%); 2.4 MiB/s, 38 objects/s recovering 2024-02-10T08:39:58.791 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:39:57.180155+0000 mgr.y (mgr.14505) 868 : cluster [DBG] pgmap v1068: 178 pgs: 4 remapped+peering, 1 active+recovery_wait+degraded+remapped, 173 active+clean; 2.7 GiB data, 13 GiB used, 613 GiB / 626 GiB avail; 882 B/s rd, 0 B/s wr, 686 op/s; 2256/131670 objects degraded (1.713%); 2.4 MiB/s, 38 objects/s recovering 2024-02-10T08:39:59.290 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:39:59 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:39:59.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:39:59 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:39:59.459486+0000 mon.a (mon.0) 1821 : cluster [WRN] Health check failed: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull (PG_BACKFILL_FULL) 2024-02-10T08:39:59.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:39:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:39:59.459486+0000 mon.a (mon.0) 1821 : cluster [WRN] Health check failed: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull (PG_BACKFILL_FULL) 2024-02-10T08:39:59.906 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:39:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:39:59.459486+0000 mon.a (mon.0) 1821 : cluster [WRN] Health check failed: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull (PG_BACKFILL_FULL) 2024-02-10T08:40:00.228 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-02-10T08:40:00.229 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:40:00.470 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:40:00.476 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:40:00.476 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:40:00.531 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:39:59.001537+0000 mgr.y (mgr.14505) 869 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:40:00.531 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:39:59.181097+0000 mgr.y (mgr.14505) 870 : cluster [DBG] pgmap v1069: 178 pgs: 3 active+recovering+remapped, 1 active+undersized+degraded+remapped+backfill_toofull, 1 active+recovery_wait+degraded+remapped, 173 active+clean; 2.5 GiB data, 13 GiB used, 613 GiB / 626 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1.07k op/s; 4471/121806 objects degraded (3.671%); 2.1 MiB/s, 55 objects/s recovering 2024-02-10T08:40:00.531 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:40:00.000097+0000 mon.a (mon.0) 1822 : cluster [WRN] Health detail: HEALTH_WARN nodeep-scrub flag(s) set; Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull; Degraded data redundancy: 4471/121806 objects degraded (3.671%), 2 pgs degraded 2024-02-10T08:40:00.531 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:40:00.000128+0000 mon.a (mon.0) 1823 : cluster [WRN] [WRN] OSDMAP_FLAGS: nodeep-scrub flag(s) set 2024-02-10T08:40:00.532 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:40:00.000149+0000 mon.a (mon.0) 1824 : cluster [WRN] [WRN] PG_BACKFILL_FULL: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull 2024-02-10T08:40:00.532 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:40:00.000164+0000 mon.a (mon.0) 1825 : cluster [WRN] pg 11.0 is active+undersized+degraded+remapped+backfill_toofull, acting [1,3] 2024-02-10T08:40:00.532 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:40:00.000180+0000 mon.a (mon.0) 1826 : cluster [WRN] [WRN] PG_DEGRADED: Degraded data redundancy: 4471/121806 objects degraded (3.671%), 2 pgs degraded 2024-02-10T08:40:00.532 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:40:00.000215+0000 mon.a (mon.0) 1827 : cluster [WRN] pg 11.0 is active+undersized+degraded+remapped+backfill_toofull, acting [1,3] 2024-02-10T08:40:00.532 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:40:00.000229+0000 mon.a (mon.0) 1828 : cluster [WRN] pg 11.e is active+recovery_wait+degraded+remapped, acting [4,1,7] 2024-02-10T08:40:00.577 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:40:00.677 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:40:00.726 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:40:00.733 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:40:00.733 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:40:00.834 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:40:00.842 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:39:59.001537+0000 mgr.y (mgr.14505) 869 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:40:00.843 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:39:59.181097+0000 mgr.y (mgr.14505) 870 : cluster [DBG] pgmap v1069: 178 pgs: 3 active+recovering+remapped, 1 active+undersized+degraded+remapped+backfill_toofull, 1 active+recovery_wait+degraded+remapped, 173 active+clean; 2.5 GiB data, 13 GiB used, 613 GiB / 626 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1.07k op/s; 4471/121806 objects degraded (3.671%); 2.1 MiB/s, 55 objects/s recovering 2024-02-10T08:40:00.843 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:40:00.000097+0000 mon.a (mon.0) 1822 : cluster [WRN] Health detail: HEALTH_WARN nodeep-scrub flag(s) set; Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull; Degraded data redundancy: 4471/121806 objects degraded (3.671%), 2 pgs degraded 2024-02-10T08:40:00.843 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:40:00.000128+0000 mon.a (mon.0) 1823 : cluster [WRN] [WRN] OSDMAP_FLAGS: nodeep-scrub flag(s) set 2024-02-10T08:40:00.843 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:40:00.000149+0000 mon.a (mon.0) 1824 : cluster [WRN] [WRN] PG_BACKFILL_FULL: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull 2024-02-10T08:40:00.843 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:40:00.000164+0000 mon.a (mon.0) 1825 : cluster [WRN] pg 11.0 is active+undersized+degraded+remapped+backfill_toofull, acting [1,3] 2024-02-10T08:40:00.843 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:40:00.000180+0000 mon.a (mon.0) 1826 : cluster [WRN] [WRN] PG_DEGRADED: Degraded data redundancy: 4471/121806 objects degraded (3.671%), 2 pgs degraded 2024-02-10T08:40:00.843 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:40:00.000215+0000 mon.a (mon.0) 1827 : cluster [WRN] pg 11.0 is active+undersized+degraded+remapped+backfill_toofull, acting [1,3] 2024-02-10T08:40:00.843 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:40:00.000229+0000 mon.a (mon.0) 1828 : cluster [WRN] pg 11.e is active+recovery_wait+degraded+remapped, acting [4,1,7] 2024-02-10T08:40:00.843 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:39:59.001537+0000 mgr.y (mgr.14505) 869 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:40:00.843 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:39:59.181097+0000 mgr.y (mgr.14505) 870 : cluster [DBG] pgmap v1069: 178 pgs: 3 active+recovering+remapped, 1 active+undersized+degraded+remapped+backfill_toofull, 1 active+recovery_wait+degraded+remapped, 173 active+clean; 2.5 GiB data, 13 GiB used, 613 GiB / 626 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1.07k op/s; 4471/121806 objects degraded (3.671%); 2.1 MiB/s, 55 objects/s recovering 2024-02-10T08:40:00.843 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:40:00.000097+0000 mon.a (mon.0) 1822 : cluster [WRN] Health detail: HEALTH_WARN nodeep-scrub flag(s) set; Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull; Degraded data redundancy: 4471/121806 objects degraded (3.671%), 2 pgs degraded 2024-02-10T08:40:00.844 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:40:00.000128+0000 mon.a (mon.0) 1823 : cluster [WRN] [WRN] OSDMAP_FLAGS: nodeep-scrub flag(s) set 2024-02-10T08:40:00.844 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:40:00.000149+0000 mon.a (mon.0) 1824 : cluster [WRN] [WRN] PG_BACKFILL_FULL: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull 2024-02-10T08:40:00.844 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:40:00.000164+0000 mon.a (mon.0) 1825 : cluster [WRN] pg 11.0 is active+undersized+degraded+remapped+backfill_toofull, acting [1,3] 2024-02-10T08:40:00.844 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:40:00.000180+0000 mon.a (mon.0) 1826 : cluster [WRN] [WRN] PG_DEGRADED: Degraded data redundancy: 4471/121806 objects degraded (3.671%), 2 pgs degraded 2024-02-10T08:40:00.844 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:40:00.000215+0000 mon.a (mon.0) 1827 : cluster [WRN] pg 11.0 is active+undersized+degraded+remapped+backfill_toofull, acting [1,3] 2024-02-10T08:40:00.844 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:40:00.000229+0000 mon.a (mon.0) 1828 : cluster [WRN] pg 11.e is active+recovery_wait+degraded+remapped, acting [4,1,7] 2024-02-10T08:40:00.880 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:40:00.912 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:40:00.918 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:40:00.918 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:40:01.019 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:40:01.091 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:40:01.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:40:01.062757+0000 mon.a (mon.0) 1829 : cluster [WRN] Health check update: Degraded data redundancy: 4471/121806 objects degraded (3.671%), 2 pgs degraded (PG_DEGRADED) 2024-02-10T08:40:01.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:40:01.062757+0000 mon.a (mon.0) 1829 : cluster [WRN] Health check update: Degraded data redundancy: 4471/121806 objects degraded (3.671%), 2 pgs degraded (PG_DEGRADED) 2024-02-10T08:40:02.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:40:01.062757+0000 mon.a (mon.0) 1829 : cluster [WRN] Health check update: Degraded data redundancy: 4471/121806 objects degraded (3.671%), 2 pgs degraded (PG_DEGRADED) 2024-02-10T08:40:02.888 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:40:02.899 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:40:02.900 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:40:02.908 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.2 dump_historic_ops 2024-02-10T08:40:02.991 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:40:01.183705+0000 mgr.y (mgr.14505) 871 : cluster [DBG] pgmap v1070: 178 pgs: 3 active+recovering+remapped, 1 active+undersized+degraded+remapped+backfill_toofull, 1 active+recovery_wait+degraded+remapped, 173 active+clean; 2.4 GiB data, 13 GiB used, 613 GiB / 626 GiB avail; 639 B/s rd, 0 B/s wr, 526 op/s; 4245/120984 objects degraded (3.509%); 224 KiB/s, 22 objects/s recovering 2024-02-10T08:40:02.991 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:40:01.700892+0000 mon.a (mon.0) 1830 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:40:02.992 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:40:01.183705+0000 mgr.y (mgr.14505) 871 : cluster [DBG] pgmap v1070: 178 pgs: 3 active+recovering+remapped, 1 active+undersized+degraded+remapped+backfill_toofull, 1 active+recovery_wait+degraded+remapped, 173 active+clean; 2.4 GiB data, 13 GiB used, 613 GiB / 626 GiB avail; 639 B/s rd, 0 B/s wr, 526 op/s; 4245/120984 objects degraded (3.509%); 224 KiB/s, 22 objects/s recovering 2024-02-10T08:40:02.992 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:40:01.700892+0000 mon.a (mon.0) 1830 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:40:03.000 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:40:03.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:40:01.183705+0000 mgr.y (mgr.14505) 871 : cluster [DBG] pgmap v1070: 178 pgs: 3 active+recovering+remapped, 1 active+undersized+degraded+remapped+backfill_toofull, 1 active+recovery_wait+degraded+remapped, 173 active+clean; 2.4 GiB data, 13 GiB used, 613 GiB / 626 GiB avail; 639 B/s rd, 0 B/s wr, 526 op/s; 4245/120984 objects degraded (3.509%); 224 KiB/s, 22 objects/s recovering 2024-02-10T08:40:03.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:40:01.700892+0000 mon.a (mon.0) 1830 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:40:03.089 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:40:03.129 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:40:03.134 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:40:03.135 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:40:03.236 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:40:03.324 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:40:03.481 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:40:03.487 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:40:03.488 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:40:03.589 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:40:03.623 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:40:03.631 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:40:03.660 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:40:03.669 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:40:03.670 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:40:03.711 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:40:03.743 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:40:03.770 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:40:03.774 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:40:03.811 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:40:03.831 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:40:03.855 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:40:03.877 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:40:03.886 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:40:03.887 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:40:03.666855+0000 mon.a (mon.0) 1831 : audit [DBG] from='client.? 172.21.15.18:0/122133667' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:40:03.887 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:40:03.896 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:40:03.938 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:40:03.975 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:40:03.988 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:40:04.006 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-10T08:40:04.006 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-10T08:40:04.006 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-10T08:40:04.006 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-10T08:40:04.006 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-10T08:40:04.006 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-10T08:40:04.006 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-10T08:40:04.006 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-10T08:40:04.025 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:40:04.033 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:40:03.666855+0000 mon.a (mon.0) 1831 : audit [DBG] from='client.? 172.21.15.18:0/122133667' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:40:04.035 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:40:03.666855+0000 mon.a (mon.0) 1831 : audit [DBG] from='client.? 172.21.15.18:0/122133667' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:40:04.060 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:40:04.071 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:40:04.072 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:40:04.173 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:40:04.242 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:40:05.009 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:40:05.017 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:40:03.186770+0000 mgr.y (mgr.14505) 872 : cluster [DBG] pgmap v1071: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+remapped, 1 active+recovery_wait+degraded+remapped, 173 active+clean; 2.2 GiB data, 12 GiB used, 614 GiB / 626 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 821 op/s; 3932/109560 objects degraded (3.589%); 183 KiB/s, 36 objects/s recovering 2024-02-10T08:40:05.018 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:40:03.186770+0000 mgr.y (mgr.14505) 872 : cluster [DBG] pgmap v1071: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+remapped, 1 active+recovery_wait+degraded+remapped, 173 active+clean; 2.2 GiB data, 12 GiB used, 614 GiB / 626 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 821 op/s; 3932/109560 objects degraded (3.589%); 183 KiB/s, 36 objects/s recovering 2024-02-10T08:40:05.018 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:40:05.019 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:40:05.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:40:03.186770+0000 mgr.y (mgr.14505) 872 : cluster [DBG] pgmap v1071: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+remapped, 1 active+recovery_wait+degraded+remapped, 173 active+clean; 2.2 GiB data, 12 GiB used, 614 GiB / 626 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 821 op/s; 3932/109560 objects degraded (3.589%); 183 KiB/s, 36 objects/s recovering 2024-02-10T08:40:05.120 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:40:05.185 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:40:05.209 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 3, 4, 5, 6, 0] out_osds: [7] dead_osds: [] live_osds: [0, 1, 2, 3, 5, 6, 4, 7] 2024-02-10T08:40:05.209 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-10T08:40:05.209 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-02-10T08:40:05.209 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd dump -f json-pretty 2024-02-10T08:40:05.277 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:40:05.280 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:40:05.280 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:40:05.381 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:40:05.456 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:40:05.924 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:40:05.928 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:40:05.930 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:40:06.031 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:40:06.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:40:04.746901+0000 osd.1 (osd.1) 316 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:40:06.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:40:04.746941+0000 osd.1 (osd.1) 317 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:40:06.114 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:40:06.152 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:40:06.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:40:04.746901+0000 osd.1 (osd.1) 316 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:40:06.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:40:04.746941+0000 osd.1 (osd.1) 317 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:40:06.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:40:04.746901+0000 osd.1 (osd.1) 316 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:40:06.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:40:04.746941+0000 osd.1 (osd.1) 317 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:40:06.158 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:40:06.159 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:40:06.260 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:40:06.309 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:40:06.351 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:40:06.355 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:40:06.355 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:40:06.371 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:40:06.456 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:40:06.519 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:40:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:40:06] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:40:06.545 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:40:06.794 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:40:05.187677+0000 mgr.y (mgr.14505) 873 : cluster [DBG] pgmap v1072: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+remapped, 1 active+recovery_wait+degraded+remapped, 173 active+clean; 2.2 GiB data, 12 GiB used, 614 GiB / 626 GiB avail; 950 B/s rd, 0 B/s wr, 779 op/s; 3687/106995 objects degraded (3.446%); 166 KiB/s, 32 objects/s recovering 2024-02-10T08:40:06.794 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:40:05.298268+0000 osd.4 (osd.4) 217 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:40:06.794 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:40:05.298311+0000 osd.4 (osd.4) 218 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:40:06.794 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:40:05.747948+0000 mon.a (mon.0) 1832 : cluster [DBG] osdmap e450: 8 total, 8 up, 7 in 2024-02-10T08:40:06.795 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:40:06.067628+0000 mon.a (mon.0) 1833 : cluster [WRN] Health check update: Degraded data redundancy: 3687/106995 objects degraded (3.446%), 2 pgs degraded (PG_DEGRADED) 2024-02-10T08:40:06.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:40:05.187677+0000 mgr.y (mgr.14505) 873 : cluster [DBG] pgmap v1072: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+remapped, 1 active+recovery_wait+degraded+remapped, 173 active+clean; 2.2 GiB data, 12 GiB used, 614 GiB / 626 GiB avail; 950 B/s rd, 0 B/s wr, 779 op/s; 3687/106995 objects degraded (3.446%); 166 KiB/s, 32 objects/s recovering 2024-02-10T08:40:06.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:40:05.298268+0000 osd.4 (osd.4) 217 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:40:06.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:40:05.298311+0000 osd.4 (osd.4) 218 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:40:06.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:40:05.747948+0000 mon.a (mon.0) 1832 : cluster [DBG] osdmap e450: 8 total, 8 up, 7 in 2024-02-10T08:40:06.906 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:40:06.067628+0000 mon.a (mon.0) 1833 : cluster [WRN] Health check update: Degraded data redundancy: 3687/106995 objects degraded (3.446%), 2 pgs degraded (PG_DEGRADED) 2024-02-10T08:40:06.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:40:05.187677+0000 mgr.y (mgr.14505) 873 : cluster [DBG] pgmap v1072: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+remapped, 1 active+recovery_wait+degraded+remapped, 173 active+clean; 2.2 GiB data, 12 GiB used, 614 GiB / 626 GiB avail; 950 B/s rd, 0 B/s wr, 779 op/s; 3687/106995 objects degraded (3.446%); 166 KiB/s, 32 objects/s recovering 2024-02-10T08:40:06.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:40:05.298268+0000 osd.4 (osd.4) 217 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:40:06.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:40:05.298311+0000 osd.4 (osd.4) 218 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:40:06.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:40:05.747948+0000 mon.a (mon.0) 1832 : cluster [DBG] osdmap e450: 8 total, 8 up, 7 in 2024-02-10T08:40:06.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:40:06.067628+0000 mon.a (mon.0) 1833 : cluster [WRN] Health check update: Degraded data redundancy: 3687/106995 objects degraded (3.446%), 2 pgs degraded (PG_DEGRADED) 2024-02-10T08:40:07.004 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:40:07.018 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:40:07.019 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:40:07.119 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:40:07.201 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:40:07.239 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:40:07.239 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:40:07.239 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:40:07.340 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:40:07.388 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:40:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:40:07] "GET /metrics HTTP/1.1" 200 176546 "" "Prometheus/2.33.4" 2024-02-10T08:40:07.388 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:40:07.615 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:40:07.624 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:40:07.624 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:40:07.725 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:40:07.774 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:40:07.819 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:40:07.821 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:40:07.822 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:40:07.923 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:40:07.968 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:40:08.013 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:40:08.018 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:40:08.018 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:40:08.023 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:40:07.188173+0000 mgr.y (mgr.14505) 874 : cluster [DBG] pgmap v1074: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+remapped, 1 active+recovery_wait+degraded+remapped, 173 active+clean; 2.2 GiB data, 12 GiB used, 614 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 822 op/s; 3687/106995 objects degraded (3.446%); 0 B/s, 32 objects/s recovering 2024-02-10T08:40:08.024 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:40:07.188173+0000 mgr.y (mgr.14505) 874 : cluster [DBG] pgmap v1074: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+remapped, 1 active+recovery_wait+degraded+remapped, 173 active+clean; 2.2 GiB data, 12 GiB used, 614 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 822 op/s; 3687/106995 objects degraded (3.446%); 0 B/s, 32 objects/s recovering 2024-02-10T08:40:08.043 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:40:07.188173+0000 mgr.y (mgr.14505) 874 : cluster [DBG] pgmap v1074: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+remapped, 1 active+recovery_wait+degraded+remapped, 173 active+clean; 2.2 GiB data, 12 GiB used, 614 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 822 op/s; 3687/106995 objects degraded (3.446%); 0 B/s, 32 objects/s recovering 2024-02-10T08:40:08.119 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:40:08.177 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:40:08.204 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:40:08.208 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:40:08.208 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:40:08.309 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:40:08.365 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:40:08.392 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:40:08.397 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:40:08.398 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:40:08.499 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:40:08.572 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:40:08.623 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:40:08.625 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:40:08.626 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:40:08.726 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:40:08.779 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:40:08.820 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:40:08.831 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:40:08.832 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:40:08.932 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:40:08.983 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:40:09.022 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-10T08:40:09.039 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:40:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:40:09.039 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:40:09.043 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:40:09.044 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:40:09.145 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:40:09.233 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:40:09.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:40:09.094954+0000 mon.a (mon.0) 1834 : audit [INF] from='client.? 172.21.15.18:0/4089281388' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:40:09.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:40:09.094954+0000 mon.a (mon.0) 1834 : audit [INF] from='client.? 172.21.15.18:0/4089281388' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:40:09.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:40:09.094954+0000 mon.a (mon.0) 1834 : audit [INF] from='client.? 172.21.15.18:0/4089281388' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:40:10.115 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:40:10.119 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:40:10.119 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:40:10.220 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:40:10.273 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:40:10.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:40:09.017147+0000 mgr.y (mgr.14505) 875 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:40:10.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:40:09.146557+0000 mon.a (mon.0) 1835 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-10T08:40:10.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:40:09.167314+0000 mon.a (mon.0) 1836 : audit [INF] from='client.? 172.21.15.18:0/4089281388' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-10T08:40:10.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:40:09.167377+0000 mon.a (mon.0) 1837 : cluster [DBG] osdmap e451: 8 total, 8 up, 7 in 2024-02-10T08:40:10.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:40:09.188670+0000 mgr.y (mgr.14505) 876 : cluster [DBG] pgmap v1076: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+remapped, 1 active+recovery_wait+degraded+remapped, 173 active+clean; 1.9 GiB data, 11 GiB used, 615 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.13k op/s; 3429/93816 objects degraded (3.655%); 0 B/s, 43 objects/s recovering 2024-02-10T08:40:10.407 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:40:09.017147+0000 mgr.y (mgr.14505) 875 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:40:10.407 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:40:09.146557+0000 mon.a (mon.0) 1835 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-10T08:40:10.407 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:40:09.167314+0000 mon.a (mon.0) 1836 : audit [INF] from='client.? 172.21.15.18:0/4089281388' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-10T08:40:10.407 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:40:09.167377+0000 mon.a (mon.0) 1837 : cluster [DBG] osdmap e451: 8 total, 8 up, 7 in 2024-02-10T08:40:10.407 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:40:09.188670+0000 mgr.y (mgr.14505) 876 : cluster [DBG] pgmap v1076: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+remapped, 1 active+recovery_wait+degraded+remapped, 173 active+clean; 1.9 GiB data, 11 GiB used, 615 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.13k op/s; 3429/93816 objects degraded (3.655%); 0 B/s, 43 objects/s recovering 2024-02-10T08:40:10.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:40:09.017147+0000 mgr.y (mgr.14505) 875 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:40:10.542 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:40:09.146557+0000 mon.a (mon.0) 1835 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-10T08:40:10.542 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:40:09.167314+0000 mon.a (mon.0) 1836 : audit [INF] from='client.? 172.21.15.18:0/4089281388' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-10T08:40:10.542 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:40:09.167377+0000 mon.a (mon.0) 1837 : cluster [DBG] osdmap e451: 8 total, 8 up, 7 in 2024-02-10T08:40:10.542 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:40:09.188670+0000 mgr.y (mgr.14505) 876 : cluster [DBG] pgmap v1076: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+remapped, 1 active+recovery_wait+degraded+remapped, 173 active+clean; 1.9 GiB data, 11 GiB used, 615 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.13k op/s; 3429/93816 objects degraded (3.655%); 0 B/s, 43 objects/s recovering 2024-02-10T08:40:10.747 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:40:10.753 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:40:10.754 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:40:10.855 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:40:10.910 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is unset 2024-02-10T08:40:10.918 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:40:10.958 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:40:10.964 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:40:10.965 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:40:11.065 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:40:11.117 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:40:11.157 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:40:11.163 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:40:11.163 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:40:11.197 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:40:11.072667+0000 mon.a (mon.0) 1838 : cluster [WRN] Health check update: Degraded data redundancy: 3429/93816 objects degraded (3.655%), 2 pgs degraded (PG_DEGRADED) 2024-02-10T08:40:11.264 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:40:11.308 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:40:11.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:40:11.072667+0000 mon.a (mon.0) 1838 : cluster [WRN] Health check update: Degraded data redundancy: 3429/93816 objects degraded (3.655%), 2 pgs degraded (PG_DEGRADED) 2024-02-10T08:40:11.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:40:11.072667+0000 mon.a (mon.0) 1838 : cluster [WRN] Health check update: Degraded data redundancy: 3429/93816 objects degraded (3.655%), 2 pgs degraded (PG_DEGRADED) 2024-02-10T08:40:11.723 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:40:11.727 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:40:11.727 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:40:11.828 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:40:11.876 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:40:11.904 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:40:11.909 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:40:11.909 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:40:12.010 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:40:12.011 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:40:12.077 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:40:12.199 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:40:11.189432+0000 mgr.y (mgr.14505) 877 : cluster [DBG] pgmap v1077: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+remapped, 1 active+recovery_wait+degraded+remapped, 173 active+clean; 1.9 GiB data, 11 GiB used, 615 GiB / 626 GiB avail; 639 B/s rd, 0 B/s wr, 691 op/s; 3188/92970 objects degraded (3.429%); 0 B/s, 21 objects/s recovering 2024-02-10T08:40:12.255 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:40:12.259 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:40:12.259 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:40:12.360 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:40:12.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:40:11.189432+0000 mgr.y (mgr.14505) 877 : cluster [DBG] pgmap v1077: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+remapped, 1 active+recovery_wait+degraded+remapped, 173 active+clean; 1.9 GiB data, 11 GiB used, 615 GiB / 626 GiB avail; 639 B/s rd, 0 B/s wr, 691 op/s; 3188/92970 objects degraded (3.429%); 0 B/s, 21 objects/s recovering 2024-02-10T08:40:12.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:40:11.189432+0000 mgr.y (mgr.14505) 877 : cluster [DBG] pgmap v1077: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+remapped, 1 active+recovery_wait+degraded+remapped, 173 active+clean; 1.9 GiB data, 11 GiB used, 615 GiB / 626 GiB avail; 639 B/s rd, 0 B/s wr, 691 op/s; 3188/92970 objects degraded (3.429%); 0 B/s, 21 objects/s recovering 2024-02-10T08:40:12.436 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:40:12.474 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-02-10T08:40:12.474 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-02-10T08:40:12.474 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-02-10T08:40:12.474 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-02-10T08:40:12.474 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.474 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.25369.0:98194 10.5 10:ae321b63:::benchmark_data_smithi018_146618_object98193:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e363)", 2024-02-10T08:40:12.474 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:33:51.624617+0000", 2024-02-10T08:40:12.474 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 380.84399951699999, 2024-02-10T08:40:12.474 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.142835147, 2024-02-10T08:40:12.474 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:40:12.475 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:40:12.475 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:40:12.475 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.25369", 2024-02-10T08:40:12.475 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/3974730810", 2024-02-10T08:40:12.475 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 98194 2024-02-10T08:40:12.475 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.475 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:40:12.475 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.475 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:40:12.475 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.624617+0000", 2024-02-10T08:40:12.475 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:40:12.475 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.475 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.475 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:40:12.475 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.624617+0000", 2024-02-10T08:40:12.475 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:40:12.476 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.476 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.476 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:40:12.476 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.624616+0000", 2024-02-10T08:40:12.476 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3824000000000001e-05 2024-02-10T08:40:12.476 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.476 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.476 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:40:12.476 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.624640+0000", 2024-02-10T08:40:12.476 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0859999999999999e-05 2024-02-10T08:40:12.476 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.478 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.479 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:40:12.479 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.624651+0000", 2024-02-10T08:40:12.479 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2720000000000003e-06 2024-02-10T08:40:12.479 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.479 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.479 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:40:12.479 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.624657+0000", 2024-02-10T08:40:12.479 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5073e-05 2024-02-10T08:40:12.479 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.479 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.479 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:40:12.479 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.624702+0000", 2024-02-10T08:40:12.479 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000121135 2024-02-10T08:40:12.479 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.480 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.480 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:40:12.480 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.624824+0000", 2024-02-10T08:40:12.480 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000155993 2024-02-10T08:40:12.480 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.480 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.480 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0,3", 2024-02-10T08:40:12.480 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.624980+0000", 2024-02-10T08:40:12.480 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.13839509899999999 2024-02-10T08:40:12.480 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.480 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.480 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:40:12.480 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.763375+0000", 2024-02-10T08:40:12.480 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00034386799999999999 2024-02-10T08:40:12.480 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.481 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.481 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:40:12.481 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.763719+0000", 2024-02-10T08:40:12.481 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.003632925 2024-02-10T08:40:12.481 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.481 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.481 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:40:12.481 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.767351+0000", 2024-02-10T08:40:12.481 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4347e-05 2024-02-10T08:40:12.481 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.481 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.481 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:40:12.481 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.767406+0000", 2024-02-10T08:40:12.481 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6742000000000001e-05 2024-02-10T08:40:12.481 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.481 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.482 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:40:12.482 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.767453+0000", 2024-02-10T08:40:12.482 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.142835147 2024-02-10T08:40:12.482 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:12.482 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:12.482 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:12.482 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.482 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.482 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.25369.0:98193 10.8 e363/335 10:16b8e223:::benchmark_data_smithi018_146618_object98192:head v 363'6099, mlcod=363'6097)", 2024-02-10T08:40:12.482 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:33:51.627859+0000", 2024-02-10T08:40:12.482 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 380.84075773199999, 2024-02-10T08:40:12.482 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.14622695399999999, 2024-02-10T08:40:12.482 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:40:12.482 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:40:12.482 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:40:12.482 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.482 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:40:12.483 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.627859+0000", 2024-02-10T08:40:12.483 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:40:12.483 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.483 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.483 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:40:12.483 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.627859+0000", 2024-02-10T08:40:12.483 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:40:12.483 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.483 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.483 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:40:12.483 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.627858+0000", 2024-02-10T08:40:12.483 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9071e-05 2024-02-10T08:40:12.483 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.483 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.483 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:40:12.483 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.627887+0000", 2024-02-10T08:40:12.483 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8879999999999992e-06 2024-02-10T08:40:12.484 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.484 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.484 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:40:12.484 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.627897+0000", 2024-02-10T08:40:12.484 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1796e-05 2024-02-10T08:40:12.484 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.484 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.485 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:40:12.485 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.627909+0000", 2024-02-10T08:40:12.485 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8588e-05 2024-02-10T08:40:12.485 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.485 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.485 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:40:12.485 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.627987+0000", 2024-02-10T08:40:12.486 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8821000000000002e-05 2024-02-10T08:40:12.486 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.486 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.486 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:40:12.486 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.628006+0000", 2024-02-10T08:40:12.486 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.14604022 2024-02-10T08:40:12.486 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.486 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.486 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:40:12.486 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.774046+0000", 2024-02-10T08:40:12.486 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9685999999999999e-05 2024-02-10T08:40:12.486 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.486 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.486 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:40:12.487 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:33:51.774086+0000", 2024-02-10T08:40:12.487 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.14622695399999999 2024-02-10T08:40:12.487 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:12.487 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:12.487 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:12.487 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.487 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.488 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.25369.0:159385 10.5 10:a2cbe603:::benchmark_data_smithi018_146618_object35582:head [delete] snapc 0=[] ondisk+write+known_if_redirected e374)", 2024-02-10T08:40:12.488 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:34:51.041259+0000", 2024-02-10T08:40:12.488 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 321.42735766499999, 2024-02-10T08:40:12.488 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.22392409799999999, 2024-02-10T08:40:12.488 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:40:12.488 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:40:12.488 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:40:12.488 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.25369", 2024-02-10T08:40:12.488 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/3974730810", 2024-02-10T08:40:12.488 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 159385 2024-02-10T08:40:12.488 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.488 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:40:12.488 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.489 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:40:12.489 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.041259+0000", 2024-02-10T08:40:12.489 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:40:12.489 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.489 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.489 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:40:12.489 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.041259+0000", 2024-02-10T08:40:12.489 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:40:12.489 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.489 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.489 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:40:12.489 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.041258+0000", 2024-02-10T08:40:12.489 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9159999999999998e-06 2024-02-10T08:40:12.489 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.489 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.490 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:40:12.490 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.041264+0000", 2024-02-10T08:40:12.490 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9410000000000007e-06 2024-02-10T08:40:12.490 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.490 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.490 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:40:12.490 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.041272+0000", 2024-02-10T08:40:12.490 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3759999999999996e-06 2024-02-10T08:40:12.490 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.490 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.490 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:40:12.490 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.041278+0000", 2024-02-10T08:40:12.490 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8306000000000002e-05 2024-02-10T08:40:12.490 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.490 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.490 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:40:12.491 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.041316+0000", 2024-02-10T08:40:12.491 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000102484 2024-02-10T08:40:12.491 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.491 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.491 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:40:12.491 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.041419+0000", 2024-02-10T08:40:12.491 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.016113729 2024-02-10T08:40:12.491 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.491 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.491 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0,3", 2024-02-10T08:40:12.491 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.057533+0000", 2024-02-10T08:40:12.491 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011165703000000001 2024-02-10T08:40:12.491 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.491 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.491 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:40:12.491 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.068698+0000", 2024-02-10T08:40:12.492 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010052699999999999 2024-02-10T08:40:12.492 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.492 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.492 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:40:12.492 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.068799+0000", 2024-02-10T08:40:12.492 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.19630336300000001 2024-02-10T08:40:12.492 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.492 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.492 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:40:12.492 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.265102+0000", 2024-02-10T08:40:12.492 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3983000000000002e-05 2024-02-10T08:40:12.492 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.492 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.492 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:40:12.493 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.265146+0000", 2024-02-10T08:40:12.493 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7228000000000003e-05 2024-02-10T08:40:12.493 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.493 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.493 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:40:12.493 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.265183+0000", 2024-02-10T08:40:12.493 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.22392409799999999 2024-02-10T08:40:12.493 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:12.493 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:12.493 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:12.493 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.493 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.493 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.25369.0:159389 10.5 10:addcce24:::benchmark_data_smithi018_146618_object35586:head [delete] snapc 0=[] ondisk+write+known_if_redirected e374)", 2024-02-10T08:40:12.494 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:34:51.062475+0000", 2024-02-10T08:40:12.494 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 321.40614193900001, 2024-02-10T08:40:12.494 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.20824722000000001, 2024-02-10T08:40:12.494 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:40:12.494 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:40:12.494 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:40:12.495 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.25369", 2024-02-10T08:40:12.495 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/3974730810", 2024-02-10T08:40:12.495 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 159389 2024-02-10T08:40:12.495 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.495 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:40:12.495 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.495 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:40:12.495 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.062475+0000", 2024-02-10T08:40:12.495 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:40:12.495 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.495 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.496 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:40:12.496 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.062475+0000", 2024-02-10T08:40:12.496 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999976 2024-02-10T08:40:12.496 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.496 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.496 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:40:12.496 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.062473+0000", 2024-02-10T08:40:12.496 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1759999999999993e-06 2024-02-10T08:40:12.496 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.496 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.496 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:40:12.496 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.062481+0000", 2024-02-10T08:40:12.496 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1355999999999999e-05 2024-02-10T08:40:12.496 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.496 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.497 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:40:12.497 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.062492+0000", 2024-02-10T08:40:12.497 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5670000000000002e-06 2024-02-10T08:40:12.497 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.497 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.497 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:40:12.497 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.062498+0000", 2024-02-10T08:40:12.497 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0399000000000002e-05 2024-02-10T08:40:12.497 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.497 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.497 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:40:12.497 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.062528+0000", 2024-02-10T08:40:12.497 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013248200000000001 2024-02-10T08:40:12.497 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.497 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.498 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:40:12.498 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.062661+0000", 2024-02-10T08:40:12.498 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014097400000000001 2024-02-10T08:40:12.498 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.498 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.498 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0,3", 2024-02-10T08:40:12.498 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.062802+0000", 2024-02-10T08:40:12.498 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0060328220000000002 2024-02-10T08:40:12.498 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.498 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.498 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:40:12.498 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.068835+0000", 2024-02-10T08:40:12.498 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3549999999999999e-06 2024-02-10T08:40:12.498 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.498 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.499 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:40:12.499 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.068842+0000", 2024-02-10T08:40:12.499 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.20179942300000001 2024-02-10T08:40:12.499 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.499 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.499 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:40:12.499 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.270641+0000", 2024-02-10T08:40:12.499 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3789999999999999e-05 2024-02-10T08:40:12.499 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.499 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.499 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:40:12.499 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.270685+0000", 2024-02-10T08:40:12.499 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7147000000000002e-05 2024-02-10T08:40:12.499 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.499 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.499 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:40:12.499 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.270722+0000", 2024-02-10T08:40:12.500 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.20824722000000001 2024-02-10T08:40:12.500 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:12.500 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:12.500 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:12.500 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.500 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.500 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.25369.0:159395 10.3 10:c53fa4f4:::benchmark_data_smithi018_146618_object35592:head [delete] snapc 0=[] ondisk+write+known_if_redirected e374)", 2024-02-10T08:40:12.500 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:34:51.062505+0000", 2024-02-10T08:40:12.500 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 321.40611203100002, 2024-02-10T08:40:12.500 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.19791047, 2024-02-10T08:40:12.500 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:40:12.500 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:40:12.500 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:40:12.501 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.25369", 2024-02-10T08:40:12.501 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/3974730810", 2024-02-10T08:40:12.501 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 159395 2024-02-10T08:40:12.501 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.501 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:40:12.501 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.501 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:40:12.501 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.062505+0000", 2024-02-10T08:40:12.501 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:40:12.501 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.501 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.501 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:40:12.501 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.062505+0000", 2024-02-10T08:40:12.501 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:40:12.501 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.502 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.502 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:40:12.502 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.062504+0000", 2024-02-10T08:40:12.502 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1499999999999999e-06 2024-02-10T08:40:12.502 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.502 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.502 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:40:12.502 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.062507+0000", 2024-02-10T08:40:12.502 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4990000000000002e-06 2024-02-10T08:40:12.502 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.502 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.502 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:40:12.502 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.062513+0000", 2024-02-10T08:40:12.502 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2190000000000003e-06 2024-02-10T08:40:12.502 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.502 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.503 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:40:12.503 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.062518+0000", 2024-02-10T08:40:12.503 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00074390399999999998 2024-02-10T08:40:12.503 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.503 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.503 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:40:12.503 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.063262+0000", 2024-02-10T08:40:12.503 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000108213 2024-02-10T08:40:12.503 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.503 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.503 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:40:12.503 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.063370+0000", 2024-02-10T08:40:12.503 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8227999999999996e-05 2024-02-10T08:40:12.503 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.503 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.503 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,5", 2024-02-10T08:40:12.504 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.063459+0000", 2024-02-10T08:40:12.504 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0044854179999999997 2024-02-10T08:40:12.504 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.504 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.504 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:40:12.504 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.067944+0000", 2024-02-10T08:40:12.504 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0027382679999999999 2024-02-10T08:40:12.504 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.504 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.504 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:40:12.504 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.070682+0000", 2024-02-10T08:40:12.504 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.18963943 2024-02-10T08:40:12.504 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.505 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.505 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:40:12.505 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.260322+0000", 2024-02-10T08:40:12.505 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1817999999999998e-05 2024-02-10T08:40:12.505 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.505 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.505 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:40:12.505 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.260373+0000", 2024-02-10T08:40:12.505 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1931999999999998e-05 2024-02-10T08:40:12.505 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.505 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.505 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:40:12.505 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.260415+0000", 2024-02-10T08:40:12.505 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.19791047 2024-02-10T08:40:12.505 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:12.505 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:12.505 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:12.506 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.506 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.506 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.25369.0:159396 10.5 10:ad393fc2:::benchmark_data_smithi018_146618_object35593:head [delete] snapc 0=[] ondisk+write+known_if_redirected e374)", 2024-02-10T08:40:12.506 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:34:51.062530+0000", 2024-02-10T08:40:12.506 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 321.40608696200002, 2024-02-10T08:40:12.506 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.20831692900000001, 2024-02-10T08:40:12.506 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:40:12.506 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:40:12.506 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:40:12.506 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.25369", 2024-02-10T08:40:12.506 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/3974730810", 2024-02-10T08:40:12.506 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 159396 2024-02-10T08:40:12.507 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.507 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:40:12.507 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.507 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:40:12.507 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.062530+0000", 2024-02-10T08:40:12.507 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:40:12.507 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.507 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.507 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:40:12.507 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.062530+0000", 2024-02-10T08:40:12.507 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:40:12.507 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.507 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.507 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:40:12.507 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.062529+0000", 2024-02-10T08:40:12.507 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0790000000000001e-06 2024-02-10T08:40:12.508 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.508 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.508 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:40:12.508 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.062533+0000", 2024-02-10T08:40:12.508 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4500000000000003e-06 2024-02-10T08:40:12.508 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.508 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.508 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:40:12.508 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.062538+0000", 2024-02-10T08:40:12.508 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.07e-06 2024-02-10T08:40:12.508 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.508 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.508 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:40:12.508 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.062542+0000", 2024-02-10T08:40:12.508 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0030672009999999999 2024-02-10T08:40:12.509 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.509 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.509 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:40:12.509 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.065609+0000", 2024-02-10T08:40:12.509 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012694099999999999 2024-02-10T08:40:12.509 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.509 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.509 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:40:12.509 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.065736+0000", 2024-02-10T08:40:12.509 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000127675 2024-02-10T08:40:12.509 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.509 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.509 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0,3", 2024-02-10T08:40:12.509 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.065864+0000", 2024-02-10T08:40:12.509 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.007432831 2024-02-10T08:40:12.509 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.510 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.510 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:40:12.510 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.073297+0000", 2024-02-10T08:40:12.510 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9299999999999998e-06 2024-02-10T08:40:12.510 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.510 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.510 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:40:12.510 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.073307+0000", 2024-02-10T08:40:12.510 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.19745786700000001 2024-02-10T08:40:12.510 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.510 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.510 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:40:12.510 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.270765+0000", 2024-02-10T08:40:12.510 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5736999999999999e-05 2024-02-10T08:40:12.510 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.510 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.511 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:40:12.511 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.270810+0000", 2024-02-10T08:40:12.511 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6656999999999998e-05 2024-02-10T08:40:12.511 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.511 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.511 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:40:12.511 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.270847+0000", 2024-02-10T08:40:12.511 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.20831692900000001 2024-02-10T08:40:12.511 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:12.511 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:12.511 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:12.511 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.511 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.511 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.25369.0:159401 10.3 10:c583050a:::benchmark_data_smithi018_146618_object35598:head [delete] snapc 0=[] ondisk+write+known_if_redirected e374)", 2024-02-10T08:40:12.511 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:34:51.067952+0000", 2024-02-10T08:40:12.511 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 321.40066543400002, 2024-02-10T08:40:12.511 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.196700496, 2024-02-10T08:40:12.512 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:40:12.512 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:40:12.512 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:40:12.512 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.25369", 2024-02-10T08:40:12.512 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/3974730810", 2024-02-10T08:40:12.512 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 159401 2024-02-10T08:40:12.512 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.512 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:40:12.512 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.512 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:40:12.512 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.067952+0000", 2024-02-10T08:40:12.512 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:40:12.512 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.512 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.512 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:40:12.513 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.067952+0000", 2024-02-10T08:40:12.513 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999981 2024-02-10T08:40:12.513 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.513 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.513 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:40:12.513 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.067950+0000", 2024-02-10T08:40:12.513 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4229999999999999e-06 2024-02-10T08:40:12.513 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.513 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.513 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:40:12.513 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.067957+0000", 2024-02-10T08:40:12.513 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5140000000000001e-05 2024-02-10T08:40:12.513 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.513 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.513 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:40:12.513 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.067972+0000", 2024-02-10T08:40:12.514 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2010000000000002e-06 2024-02-10T08:40:12.514 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.514 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.514 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:40:12.514 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.067979+0000", 2024-02-10T08:40:12.514 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3863999999999995e-05 2024-02-10T08:40:12.514 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.514 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.514 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:40:12.514 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.068063+0000", 2024-02-10T08:40:12.514 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010341299999999999 2024-02-10T08:40:12.514 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.514 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.514 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:40:12.514 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.068167+0000", 2024-02-10T08:40:12.514 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5728000000000002e-05 2024-02-10T08:40:12.514 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.515 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.515 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,5", 2024-02-10T08:40:12.515 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.068262+0000", 2024-02-10T08:40:12.515 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.003091781 2024-02-10T08:40:12.515 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.515 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.515 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:40:12.515 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.071354+0000", 2024-02-10T08:40:12.515 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001799529 2024-02-10T08:40:12.515 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.515 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.515 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:40:12.515 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.073154+0000", 2024-02-10T08:40:12.515 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.191411998 2024-02-10T08:40:12.515 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.515 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.515 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:40:12.516 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.264566+0000", 2024-02-10T08:40:12.516 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6258000000000003e-05 2024-02-10T08:40:12.516 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.516 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.516 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:40:12.516 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.264612+0000", 2024-02-10T08:40:12.516 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0051e-05 2024-02-10T08:40:12.516 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.516 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.516 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:40:12.516 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.264652+0000", 2024-02-10T08:40:12.516 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.196700496 2024-02-10T08:40:12.516 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:12.517 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:12.517 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:12.517 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.517 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.517 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.25369.0:159403 10.5 10:a27a8cdd:::benchmark_data_smithi018_146618_object35600:head [delete] snapc 0=[] ondisk+write+known_if_redirected e374)", 2024-02-10T08:40:12.517 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:34:51.070598+0000", 2024-02-10T08:40:12.517 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 321.39801892000003, 2024-02-10T08:40:12.517 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.20086579299999999, 2024-02-10T08:40:12.517 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:40:12.517 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:40:12.517 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:40:12.517 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.25369", 2024-02-10T08:40:12.517 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/3974730810", 2024-02-10T08:40:12.517 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 159403 2024-02-10T08:40:12.517 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.517 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:40:12.517 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.518 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:40:12.518 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.070598+0000", 2024-02-10T08:40:12.518 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:40:12.518 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.518 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.518 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:40:12.518 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.070598+0000", 2024-02-10T08:40:12.518 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:40:12.518 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.518 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.518 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:40:12.518 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.070596+0000", 2024-02-10T08:40:12.518 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5849999999999996e-06 2024-02-10T08:40:12.518 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.518 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.518 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:40:12.519 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.070603+0000", 2024-02-10T08:40:12.519 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.253e-05 2024-02-10T08:40:12.519 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.519 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.519 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:40:12.519 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.070616+0000", 2024-02-10T08:40:12.519 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4960000000000001e-06 2024-02-10T08:40:12.519 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.519 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.519 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:40:12.519 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.070622+0000", 2024-02-10T08:40:12.519 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4104999999999999e-05 2024-02-10T08:40:12.519 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.519 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.519 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:40:12.520 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.070666+0000", 2024-02-10T08:40:12.520 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000105185 2024-02-10T08:40:12.520 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.520 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.520 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:40:12.520 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.070771+0000", 2024-02-10T08:40:12.520 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6322999999999994e-05 2024-02-10T08:40:12.520 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.520 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.520 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0,3", 2024-02-10T08:40:12.520 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.070848+0000", 2024-02-10T08:40:12.520 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0034301000000000002 2024-02-10T08:40:12.520 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.520 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.520 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:40:12.520 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.074278+0000", 2024-02-10T08:40:12.521 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00095841399999999999 2024-02-10T08:40:12.521 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.521 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.521 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:40:12.521 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.075236+0000", 2024-02-10T08:40:12.521 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.19614928200000001 2024-02-10T08:40:12.521 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.521 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.521 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:40:12.521 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.271385+0000", 2024-02-10T08:40:12.521 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2982999999999998e-05 2024-02-10T08:40:12.521 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.521 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.521 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:40:12.521 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.271428+0000", 2024-02-10T08:40:12.521 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5336999999999997e-05 2024-02-10T08:40:12.522 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.522 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.522 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:40:12.522 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.271464+0000", 2024-02-10T08:40:12.522 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.20086579299999999 2024-02-10T08:40:12.522 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:12.522 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:12.522 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:12.522 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.522 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.522 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.25369.0:159409 10.3 10:c5acbac2:::benchmark_data_smithi018_146618_object35606:head [delete] snapc 0=[] ondisk+write+known_if_redirected e374)", 2024-02-10T08:40:12.522 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:34:51.079439+0000", 2024-02-10T08:40:12.522 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 321.38917806400002, 2024-02-10T08:40:12.522 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.185380241, 2024-02-10T08:40:12.522 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:40:12.522 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:40:12.522 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:40:12.523 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.25369", 2024-02-10T08:40:12.523 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/3974730810", 2024-02-10T08:40:12.523 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 159409 2024-02-10T08:40:12.523 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.523 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:40:12.523 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.523 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:40:12.523 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.079439+0000", 2024-02-10T08:40:12.523 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:40:12.523 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.523 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.523 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:40:12.523 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.079439+0000", 2024-02-10T08:40:12.523 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999981 2024-02-10T08:40:12.523 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.523 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.523 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:40:12.524 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.079437+0000", 2024-02-10T08:40:12.524 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1899999999999995e-06 2024-02-10T08:40:12.524 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.524 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.524 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:40:12.524 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.079445+0000", 2024-02-10T08:40:12.524 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3393999999999999e-05 2024-02-10T08:40:12.524 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.524 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.524 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:40:12.524 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.079458+0000", 2024-02-10T08:40:12.524 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0589999999999997e-06 2024-02-10T08:40:12.524 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.524 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.524 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:40:12.524 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.079466+0000", 2024-02-10T08:40:12.525 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6405e-05 2024-02-10T08:40:12.525 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.525 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.525 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:40:12.525 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.079512+0000", 2024-02-10T08:40:12.525 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013328400000000001 2024-02-10T08:40:12.525 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.525 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.525 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:40:12.525 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.079645+0000", 2024-02-10T08:40:12.525 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017655200000000001 2024-02-10T08:40:12.525 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.525 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.525 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3,5", 2024-02-10T08:40:12.525 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.079822+0000", 2024-02-10T08:40:12.526 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0029728129999999999 2024-02-10T08:40:12.526 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.526 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.526 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:40:12.526 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.082795+0000", 2024-02-10T08:40:12.526 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8001000000000001e-05 2024-02-10T08:40:12.526 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.526 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.526 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:40:12.526 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.082873+0000", 2024-02-10T08:40:12.526 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.18186460500000001 2024-02-10T08:40:12.526 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.526 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.526 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:40:12.526 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.264737+0000", 2024-02-10T08:40:12.526 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7101000000000002e-05 2024-02-10T08:40:12.527 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.527 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.527 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:40:12.527 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.264784+0000", 2024-02-10T08:40:12.527 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4807000000000001e-05 2024-02-10T08:40:12.527 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.527 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.527 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:40:12.527 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.264819+0000", 2024-02-10T08:40:12.527 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.185380241 2024-02-10T08:40:12.527 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:12.527 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:12.527 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:12.527 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.527 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.527 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.25369.0:159410 10.5 10:a31571f9:::benchmark_data_smithi018_146618_object35607:head [delete] snapc 0=[] ondisk+write+known_if_redirected e374)", 2024-02-10T08:40:12.528 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:34:51.079970+0000", 2024-02-10T08:40:12.528 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 321.38864734800001, 2024-02-10T08:40:12.528 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.191590491, 2024-02-10T08:40:12.528 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:40:12.528 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:40:12.528 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:40:12.528 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.25369", 2024-02-10T08:40:12.528 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/3974730810", 2024-02-10T08:40:12.528 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 159410 2024-02-10T08:40:12.528 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.528 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:40:12.528 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.528 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:40:12.528 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.079970+0000", 2024-02-10T08:40:12.529 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:40:12.529 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.529 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.529 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:40:12.529 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.079970+0000", 2024-02-10T08:40:12.529 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:40:12.529 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.529 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.529 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:40:12.529 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.079969+0000", 2024-02-10T08:40:12.529 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9209999999999992e-06 2024-02-10T08:40:12.529 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.529 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.529 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:40:12.529 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.079977+0000", 2024-02-10T08:40:12.530 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6800000000000005e-06 2024-02-10T08:40:12.530 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.530 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.530 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:40:12.530 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.079986+0000", 2024-02-10T08:40:12.530 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7790000000000001e-06 2024-02-10T08:40:12.530 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.530 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.530 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:40:12.530 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.079992+0000", 2024-02-10T08:40:12.530 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4402e-05 2024-02-10T08:40:12.530 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.530 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.530 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:40:12.530 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.080026+0000", 2024-02-10T08:40:12.530 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3907999999999997e-05 2024-02-10T08:40:12.531 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.531 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.531 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:40:12.531 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.080110+0000", 2024-02-10T08:40:12.531 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5482999999999995e-05 2024-02-10T08:40:12.531 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.531 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.531 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0,3", 2024-02-10T08:40:12.531 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.080186+0000", 2024-02-10T08:40:12.531 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0023495569999999999 2024-02-10T08:40:12.531 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.531 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.531 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:40:12.532 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.082535+0000", 2024-02-10T08:40:12.532 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00092569400000000002 2024-02-10T08:40:12.532 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.532 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.532 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:40:12.532 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.083461+0000", 2024-02-10T08:40:12.532 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.18803426500000001 2024-02-10T08:40:12.532 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.532 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.532 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:40:12.532 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.271495+0000", 2024-02-10T08:40:12.532 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3413e-05 2024-02-10T08:40:12.532 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.532 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.532 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:40:12.533 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.271529+0000", 2024-02-10T08:40:12.533 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1303000000000002e-05 2024-02-10T08:40:12.533 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.533 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.533 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:40:12.533 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.271560+0000", 2024-02-10T08:40:12.533 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.191590491 2024-02-10T08:40:12.533 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:12.533 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:12.533 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:12.533 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.533 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.533 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.25369.0:210164 10.5 10:ad1f5a41:::benchmark_data_smithi018_146618_object86361:head [delete] snapc 0=[] ondisk+write+known_if_redirected e383)", 2024-02-10T08:40:12.533 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:35:40.811569+0000", 2024-02-10T08:40:12.533 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 271.65704761400002, 2024-02-10T08:40:12.533 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.14547702500000001, 2024-02-10T08:40:12.534 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:40:12.534 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:40:12.534 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:40:12.534 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.25369", 2024-02-10T08:40:12.534 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/3974730810", 2024-02-10T08:40:12.534 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 210164 2024-02-10T08:40:12.534 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.534 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:40:12.534 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.534 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:40:12.534 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.811569+0000", 2024-02-10T08:40:12.534 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:40:12.534 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.534 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.534 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:40:12.534 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.811569+0000", 2024-02-10T08:40:12.534 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:40:12.535 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.535 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.535 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:40:12.535 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.811568+0000", 2024-02-10T08:40:12.535 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5039999999999996e-06 2024-02-10T08:40:12.535 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.535 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.535 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:40:12.535 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.811575+0000", 2024-02-10T08:40:12.535 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5648999999999999e-05 2024-02-10T08:40:12.535 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.535 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.535 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:40:12.535 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.811591+0000", 2024-02-10T08:40:12.536 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1790000000000002e-06 2024-02-10T08:40:12.536 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.536 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.536 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:40:12.536 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.811598+0000", 2024-02-10T08:40:12.536 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0774e-05 2024-02-10T08:40:12.536 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.536 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.536 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:40:12.536 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.811639+0000", 2024-02-10T08:40:12.536 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0539999999999998e-05 2024-02-10T08:40:12.536 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.537 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.537 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:40:12.537 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.811719+0000", 2024-02-10T08:40:12.537 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7304000000000004e-05 2024-02-10T08:40:12.537 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.537 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.537 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0,3", 2024-02-10T08:40:12.537 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.811797+0000", 2024-02-10T08:40:12.537 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.005776354 2024-02-10T08:40:12.537 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.538 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.538 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:40:12.538 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.817573+0000", 2024-02-10T08:40:12.538 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010818049999999999 2024-02-10T08:40:12.538 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.538 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.538 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:40:12.538 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.818655+0000", 2024-02-10T08:40:12.538 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.13826644799999999 2024-02-10T08:40:12.538 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.538 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.538 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:40:12.539 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.956921+0000", 2024-02-10T08:40:12.539 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9298e-05 2024-02-10T08:40:12.539 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.539 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.539 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:40:12.539 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.956991+0000", 2024-02-10T08:40:12.539 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5683999999999997e-05 2024-02-10T08:40:12.540 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.540 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.540 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:40:12.540 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:35:40.957046+0000", 2024-02-10T08:40:12.540 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.14547702500000001 2024-02-10T08:40:12.540 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:12.540 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:12.540 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:12.540 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.540 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.540 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.25664.0:74727 11.d 11:b0c0d8b8:::benchmark_data_smithi018_166993_object74726:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e409)", 2024-02-10T08:40:12.540 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:37:43.946994+0000", 2024-02-10T08:40:12.540 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 148.521622971, 2024-02-10T08:40:12.540 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.069097274, 2024-02-10T08:40:12.540 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:40:12.541 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:40:12.541 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:40:12.541 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.25664", 2024-02-10T08:40:12.541 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/1087272222", 2024-02-10T08:40:12.541 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 74727 2024-02-10T08:40:12.541 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.541 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:40:12.541 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.541 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:40:12.541 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:37:43.946994+0000", 2024-02-10T08:40:12.541 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:40:12.541 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.541 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.541 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:40:12.541 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:37:43.946994+0000", 2024-02-10T08:40:12.542 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:40:12.542 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.542 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.542 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:40:12.542 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:37:43.946993+0000", 2024-02-10T08:40:12.542 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6456e-05 2024-02-10T08:40:12.542 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.542 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.542 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:40:12.542 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:37:43.947010+0000", 2024-02-10T08:40:12.542 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9780000000000005e-06 2024-02-10T08:40:12.542 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.542 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.542 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:40:12.542 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:37:43.947018+0000", 2024-02-10T08:40:12.543 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0010000000000003e-06 2024-02-10T08:40:12.543 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.543 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.543 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:40:12.543 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:37:43.947022+0000", 2024-02-10T08:40:12.543 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6849999999999999e-05 2024-02-10T08:40:12.543 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.543 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.543 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:40:12.543 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:37:43.947078+0000", 2024-02-10T08:40:12.544 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000139009 2024-02-10T08:40:12.544 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.544 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.544 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:40:12.544 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:37:43.947217+0000", 2024-02-10T08:40:12.545 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000151576 2024-02-10T08:40:12.545 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.545 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.545 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4,6", 2024-02-10T08:40:12.545 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:37:43.947369+0000", 2024-02-10T08:40:12.546 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0052166809999999999 2024-02-10T08:40:12.546 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.546 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.546 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:40:12.546 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:37:43.952586+0000", 2024-02-10T08:40:12.546 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0032925089999999999 2024-02-10T08:40:12.547 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.547 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.547 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:40:12.547 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:37:43.955878+0000", 2024-02-10T08:40:12.547 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.060100398999999999 2024-02-10T08:40:12.547 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.547 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.547 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:40:12.547 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:37:44.015979+0000", 2024-02-10T08:40:12.547 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5679000000000006e-05 2024-02-10T08:40:12.547 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.547 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.547 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:40:12.547 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:37:44.016044+0000", 2024-02-10T08:40:12.548 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6909000000000001e-05 2024-02-10T08:40:12.548 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.548 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.548 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:40:12.548 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:37:44.016091+0000", 2024-02-10T08:40:12.548 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.069097274 2024-02-10T08:40:12.548 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:12.548 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:12.548 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:12.548 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.548 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.548 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.25664.0:113315 11.d 11:b180cd24:::benchmark_data_smithi018_166993_object113314:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e421)", 2024-02-10T08:40:12.548 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:38:20.902222+0000", 2024-02-10T08:40:12.548 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 111.566394641, 2024-02-10T08:40:12.548 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.114289242, 2024-02-10T08:40:12.549 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:40:12.549 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:40:12.549 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:40:12.549 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.25664", 2024-02-10T08:40:12.549 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/1087272222", 2024-02-10T08:40:12.549 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 113315 2024-02-10T08:40:12.549 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.549 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:40:12.549 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.549 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:40:12.549 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:20.902222+0000", 2024-02-10T08:40:12.549 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:40:12.549 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.549 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.549 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:40:12.550 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:20.902222+0000", 2024-02-10T08:40:12.550 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999976 2024-02-10T08:40:12.550 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.550 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.550 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:40:12.550 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:20.902220+0000", 2024-02-10T08:40:12.550 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5706000000000001e-05 2024-02-10T08:40:12.550 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.550 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.550 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:40:12.550 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:20.902246+0000", 2024-02-10T08:40:12.550 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0845999999999999e-05 2024-02-10T08:40:12.550 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.550 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.551 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:40:12.551 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:20.902257+0000", 2024-02-10T08:40:12.551 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1460000000000001e-06 2024-02-10T08:40:12.551 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.551 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.551 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:40:12.551 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:20.902263+0000", 2024-02-10T08:40:12.551 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00085804100000000003 2024-02-10T08:40:12.551 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.551 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.551 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:40:12.551 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:20.903121+0000", 2024-02-10T08:40:12.551 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011558299999999999 2024-02-10T08:40:12.551 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.551 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.551 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:40:12.552 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:20.903236+0000", 2024-02-10T08:40:12.552 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000101275 2024-02-10T08:40:12.552 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.552 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.552 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4,6", 2024-02-10T08:40:12.552 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:20.903338+0000", 2024-02-10T08:40:12.552 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0054255019999999996 2024-02-10T08:40:12.552 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.552 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.552 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:40:12.552 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:20.908763+0000", 2024-02-10T08:40:12.552 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0074387560000000004 2024-02-10T08:40:12.552 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.552 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.553 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:40:12.553 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:20.916202+0000", 2024-02-10T08:40:12.553 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.10020463 2024-02-10T08:40:12.553 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.553 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.553 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:40:12.553 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:21.016407+0000", 2024-02-10T08:40:12.553 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8870999999999999e-05 2024-02-10T08:40:12.553 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.553 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.553 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:40:12.553 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:21.016465+0000", 2024-02-10T08:40:12.553 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6087000000000001e-05 2024-02-10T08:40:12.553 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.553 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.554 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:40:12.554 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:21.016512+0000", 2024-02-10T08:40:12.554 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.114289242 2024-02-10T08:40:12.554 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:12.554 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:12.554 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:12.554 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.554 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.554 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.25664.0:115118 11.2 11:431ca95e:::benchmark_data_smithi018_166993_object115117:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e422)", 2024-02-10T08:40:12.554 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:38:22.953797+0000", 2024-02-10T08:40:12.554 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 109.51481963499999, 2024-02-10T08:40:12.554 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.097479404000000006, 2024-02-10T08:40:12.554 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:40:12.554 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:40:12.554 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:40:12.555 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.25664", 2024-02-10T08:40:12.555 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/1087272222", 2024-02-10T08:40:12.555 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 115118 2024-02-10T08:40:12.555 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.555 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:40:12.555 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.555 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:40:12.555 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:22.953797+0000", 2024-02-10T08:40:12.555 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:40:12.555 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.555 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.555 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:40:12.555 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:22.953797+0000", 2024-02-10T08:40:12.555 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999981 2024-02-10T08:40:12.555 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.555 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.556 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:40:12.556 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:22.953795+0000", 2024-02-10T08:40:12.556 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.6843e-05 2024-02-10T08:40:12.556 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.556 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.556 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:40:12.556 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:22.953822+0000", 2024-02-10T08:40:12.556 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1127e-05 2024-02-10T08:40:12.556 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.556 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.556 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:40:12.556 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:22.953833+0000", 2024-02-10T08:40:12.556 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.972e-06 2024-02-10T08:40:12.556 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.556 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.556 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:40:12.557 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:22.953838+0000", 2024-02-10T08:40:12.557 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0875000000000003e-05 2024-02-10T08:40:12.557 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.557 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.557 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:40:12.557 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:22.953889+0000", 2024-02-10T08:40:12.557 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015624000000000001 2024-02-10T08:40:12.557 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.557 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.557 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:40:12.557 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:22.954045+0000", 2024-02-10T08:40:12.557 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016461700000000001 2024-02-10T08:40:12.557 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.557 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.558 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0,3", 2024-02-10T08:40:12.558 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:22.954210+0000", 2024-02-10T08:40:12.558 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.003106831 2024-02-10T08:40:12.558 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.558 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.558 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:40:12.558 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:22.957317+0000", 2024-02-10T08:40:12.558 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017678 2024-02-10T08:40:12.558 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.558 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.558 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:40:12.558 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:22.957494+0000", 2024-02-10T08:40:12.558 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.093683311000000005 2024-02-10T08:40:12.558 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.558 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.559 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:40:12.559 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:23.051177+0000", 2024-02-10T08:40:12.559 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8307000000000003e-05 2024-02-10T08:40:12.559 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.559 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.559 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:40:12.559 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:23.051235+0000", 2024-02-10T08:40:12.559 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1399000000000001e-05 2024-02-10T08:40:12.559 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.559 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.559 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:40:12.559 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:23.051277+0000", 2024-02-10T08:40:12.559 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.097479404000000006 2024-02-10T08:40:12.559 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:12.559 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:12.560 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:12.560 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.560 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.560 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.25664.0:117374 11.d 11:b9d33876:::benchmark_data_smithi018_166993_object117373:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e423)", 2024-02-10T08:40:12.560 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:38:25.535109+0000", 2024-02-10T08:40:12.560 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 106.933508217, 2024-02-10T08:40:12.560 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.054275029000000002, 2024-02-10T08:40:12.560 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:40:12.560 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:40:12.560 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:40:12.560 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.25664", 2024-02-10T08:40:12.560 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/1087272222", 2024-02-10T08:40:12.560 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 117374 2024-02-10T08:40:12.560 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.560 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:40:12.561 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.561 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:40:12.561 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:25.535109+0000", 2024-02-10T08:40:12.561 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:40:12.561 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.561 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.561 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:40:12.561 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:25.535109+0000", 2024-02-10T08:40:12.561 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999981 2024-02-10T08:40:12.561 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.561 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.561 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:40:12.561 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:25.535107+0000", 2024-02-10T08:40:12.561 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1046000000000001e-05 2024-02-10T08:40:12.561 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.561 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.562 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:40:12.562 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:25.535138+0000", 2024-02-10T08:40:12.562 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5973000000000001e-05 2024-02-10T08:40:12.562 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.562 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.562 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:40:12.562 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:25.535154+0000", 2024-02-10T08:40:12.562 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4490000000000002e-06 2024-02-10T08:40:12.562 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.562 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.562 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:40:12.562 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:25.535161+0000", 2024-02-10T08:40:12.562 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3921999999999997e-05 2024-02-10T08:40:12.562 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.562 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.563 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:40:12.563 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:25.535205+0000", 2024-02-10T08:40:12.563 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015254600000000001 2024-02-10T08:40:12.563 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.563 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.563 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:40:12.563 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:25.535358+0000", 2024-02-10T08:40:12.563 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000168911 2024-02-10T08:40:12.563 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.563 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.563 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4,6", 2024-02-10T08:40:12.563 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:25.535527+0000", 2024-02-10T08:40:12.563 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0056312929999999999 2024-02-10T08:40:12.563 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.563 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.564 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:40:12.564 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:25.541158+0000", 2024-02-10T08:40:12.564 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00038406699999999998 2024-02-10T08:40:12.564 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.564 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.564 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:40:12.564 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:25.541542+0000", 2024-02-10T08:40:12.564 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.047743485000000002 2024-02-10T08:40:12.564 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.564 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.564 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:40:12.564 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:25.589286+0000", 2024-02-10T08:40:12.564 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4490000000000002e-05 2024-02-10T08:40:12.564 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.565 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.565 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:40:12.565 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:25.589340+0000", 2024-02-10T08:40:12.565 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3699000000000003e-05 2024-02-10T08:40:12.565 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.565 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.565 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:40:12.565 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:38:25.589384+0000", 2024-02-10T08:40:12.565 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.054275029000000002 2024-02-10T08:40:12.565 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:12.565 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:12.565 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:12.565 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.565 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.565 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.25664.0:163456 11.2 11:42eb5305:::benchmark_data_smithi018_166993_object44331:head [delete] snapc 0=[] ondisk+write+known_if_redirected e439)", 2024-02-10T08:40:12.565 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:39:17.942952+0000", 2024-02-10T08:40:12.566 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 54.525664732000003, 2024-02-10T08:40:12.566 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058850982000000003, 2024-02-10T08:40:12.566 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:40:12.566 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:40:12.566 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:40:12.566 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.25664", 2024-02-10T08:40:12.566 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/1087272222", 2024-02-10T08:40:12.566 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 163456 2024-02-10T08:40:12.566 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.566 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:40:12.566 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.566 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:40:12.566 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:17.942952+0000", 2024-02-10T08:40:12.566 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:40:12.566 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.566 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.566 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:40:12.567 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:17.942952+0000", 2024-02-10T08:40:12.567 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:40:12.567 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.567 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.567 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:40:12.567 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:17.942952+0000", 2024-02-10T08:40:12.567 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.926e-06 2024-02-10T08:40:12.567 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.567 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.567 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:40:12.567 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:17.942955+0000", 2024-02-10T08:40:12.567 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3099999999999997e-06 2024-02-10T08:40:12.567 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.567 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.567 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:40:12.568 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:17.942961+0000", 2024-02-10T08:40:12.568 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9139999999999999e-06 2024-02-10T08:40:12.568 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.568 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.568 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:40:12.568 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:17.942966+0000", 2024-02-10T08:40:12.568 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1375999999999998e-05 2024-02-10T08:40:12.568 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.568 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.568 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:40:12.568 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:17.943007+0000", 2024-02-10T08:40:12.568 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00023772499999999999 2024-02-10T08:40:12.568 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.568 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.568 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:40:12.569 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:17.943245+0000", 2024-02-10T08:40:12.569 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012935 2024-02-10T08:40:12.569 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.569 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.569 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0,3", 2024-02-10T08:40:12.569 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:17.943374+0000", 2024-02-10T08:40:12.569 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0024719130000000001 2024-02-10T08:40:12.569 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.569 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.569 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:40:12.569 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:17.945846+0000", 2024-02-10T08:40:12.569 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0033319399999999998 2024-02-10T08:40:12.569 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.569 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.570 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:40:12.570 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:17.949178+0000", 2024-02-10T08:40:12.570 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.052566667999999997 2024-02-10T08:40:12.570 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.570 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.570 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:40:12.570 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:18.001745+0000", 2024-02-10T08:40:12.570 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2665e-05 2024-02-10T08:40:12.570 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.570 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.570 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:40:12.570 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:18.001778+0000", 2024-02-10T08:40:12.570 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5681999999999999e-05 2024-02-10T08:40:12.570 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.570 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.570 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:40:12.571 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:18.001803+0000", 2024-02-10T08:40:12.571 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058850982000000003 2024-02-10T08:40:12.571 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:12.571 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:12.571 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:12.571 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.571 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.571 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.25664.0:163461 11.2 11:45bf7e48:::benchmark_data_smithi018_166993_object44336:head [delete] snapc 0=[] ondisk+write+known_if_redirected e439)", 2024-02-10T08:40:12.571 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:39:17.950113+0000", 2024-02-10T08:40:12.571 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 54.518503793999997, 2024-02-10T08:40:12.571 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.052066086999999997, 2024-02-10T08:40:12.571 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:40:12.571 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:40:12.571 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:40:12.571 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.25664", 2024-02-10T08:40:12.571 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/1087272222", 2024-02-10T08:40:12.572 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 163461 2024-02-10T08:40:12.572 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.572 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:40:12.572 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.572 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:40:12.572 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:17.950113+0000", 2024-02-10T08:40:12.572 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:40:12.572 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.572 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.572 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:40:12.572 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:17.950113+0000", 2024-02-10T08:40:12.572 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:40:12.572 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.572 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.573 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:40:12.573 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:17.950112+0000", 2024-02-10T08:40:12.573 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0550000000000005e-06 2024-02-10T08:40:12.573 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.573 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.573 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:40:12.573 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:17.950121+0000", 2024-02-10T08:40:12.573 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1564e-05 2024-02-10T08:40:12.573 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.573 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.573 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:40:12.573 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:17.950133+0000", 2024-02-10T08:40:12.573 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9009999999999994e-06 2024-02-10T08:40:12.573 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.573 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.574 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:40:12.574 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:17.950140+0000", 2024-02-10T08:40:12.574 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0275000000000003e-05 2024-02-10T08:40:12.574 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.574 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.574 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:40:12.574 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:17.950181+0000", 2024-02-10T08:40:12.574 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000115578 2024-02-10T08:40:12.574 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.574 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.574 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:40:12.574 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:17.950296+0000", 2024-02-10T08:40:12.574 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000127537 2024-02-10T08:40:12.574 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.574 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.574 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0,3", 2024-02-10T08:40:12.575 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:17.950424+0000", 2024-02-10T08:40:12.575 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0022600049999999998 2024-02-10T08:40:12.575 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.575 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.575 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:40:12.575 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:17.952684+0000", 2024-02-10T08:40:12.575 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015458900000000001 2024-02-10T08:40:12.575 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.575 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.575 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:40:12.575 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:17.952838+0000", 2024-02-10T08:40:12.575 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.049252797000000001 2024-02-10T08:40:12.575 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.575 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.575 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:40:12.575 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:18.002091+0000", 2024-02-10T08:40:12.576 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9033999999999998e-05 2024-02-10T08:40:12.576 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.576 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.576 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:40:12.576 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:18.002140+0000", 2024-02-10T08:40:12.576 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8924999999999997e-05 2024-02-10T08:40:12.576 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.576 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.576 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:40:12.576 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:18.002179+0000", 2024-02-10T08:40:12.576 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.052066086999999997 2024-02-10T08:40:12.576 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:12.576 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:12.576 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:12.576 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.576 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.577 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.25664.0:185976 11.2 11:4a771b2c:::benchmark_data_smithi018_166993_object66851:head [delete] snapc 0=[] ondisk+write+known_if_redirected e442)", 2024-02-10T08:40:12.577 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:39:42.911159+0000", 2024-02-10T08:40:12.577 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 29.557458332, 2024-02-10T08:40:12.577 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.062609054999999997, 2024-02-10T08:40:12.577 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:40:12.577 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:40:12.577 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:40:12.577 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.25664", 2024-02-10T08:40:12.577 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/1087272222", 2024-02-10T08:40:12.577 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 185976 2024-02-10T08:40:12.577 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.577 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:40:12.577 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.577 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:40:12.577 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:42.911159+0000", 2024-02-10T08:40:12.577 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:40:12.577 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.578 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.578 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:40:12.578 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:42.911159+0000", 2024-02-10T08:40:12.578 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:40:12.578 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.578 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.578 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:40:12.578 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:42.911158+0000", 2024-02-10T08:40:12.578 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.886e-06 2024-02-10T08:40:12.578 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.578 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.578 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:40:12.578 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:42.911161+0000", 2024-02-10T08:40:12.578 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3299999999999998e-06 2024-02-10T08:40:12.578 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.579 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.579 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:40:12.579 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:42.911166+0000", 2024-02-10T08:40:12.579 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5029999999999999e-06 2024-02-10T08:40:12.579 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.579 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.579 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:40:12.579 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:42.911171+0000", 2024-02-10T08:40:12.579 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0015208000000000001 2024-02-10T08:40:12.579 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.579 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.579 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:40:12.579 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:42.912692+0000", 2024-02-10T08:40:12.579 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012267100000000001 2024-02-10T08:40:12.579 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.579 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.580 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:40:12.580 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:42.912814+0000", 2024-02-10T08:40:12.580 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014845200000000001 2024-02-10T08:40:12.580 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.580 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.580 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0,3", 2024-02-10T08:40:12.580 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:42.912963+0000", 2024-02-10T08:40:12.580 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0052065039999999998 2024-02-10T08:40:12.580 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.580 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.580 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:40:12.580 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:42.918169+0000", 2024-02-10T08:40:12.580 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0092808930000000001 2024-02-10T08:40:12.580 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.581 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.581 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:40:12.581 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:42.927450+0000", 2024-02-10T08:40:12.581 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.046223836999999997 2024-02-10T08:40:12.581 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.581 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.581 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:40:12.581 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:42.973674+0000", 2024-02-10T08:40:12.581 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1662000000000001e-05 2024-02-10T08:40:12.581 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.581 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.581 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:40:12.581 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:42.973726+0000", 2024-02-10T08:40:12.581 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1993000000000003e-05 2024-02-10T08:40:12.581 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.581 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.582 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:40:12.582 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:42.973768+0000", 2024-02-10T08:40:12.582 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.062609054999999997 2024-02-10T08:40:12.582 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:12.582 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:12.582 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:12.582 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.582 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.582 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.25664.0:185977 11.2 11:43fdd4c7:::benchmark_data_smithi018_166993_object66852:head [delete] snapc 0=[] ondisk+write+known_if_redirected e442)", 2024-02-10T08:40:12.582 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:39:42.911175+0000", 2024-02-10T08:40:12.582 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 29.55744189, 2024-02-10T08:40:12.582 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.070025689000000002, 2024-02-10T08:40:12.582 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:40:12.582 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:40:12.583 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:40:12.583 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.25664", 2024-02-10T08:40:12.583 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/1087272222", 2024-02-10T08:40:12.583 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 185977 2024-02-10T08:40:12.583 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.583 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:40:12.583 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.583 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:40:12.583 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:42.911175+0000", 2024-02-10T08:40:12.583 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:40:12.583 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.583 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.583 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:40:12.583 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:42.911175+0000", 2024-02-10T08:40:12.583 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:40:12.583 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.584 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.584 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:40:12.584 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:42.911175+0000", 2024-02-10T08:40:12.584 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.39e-06 2024-02-10T08:40:12.584 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.584 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.584 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:40:12.584 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:42.911177+0000", 2024-02-10T08:40:12.584 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4870000000000004e-06 2024-02-10T08:40:12.584 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.584 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.584 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:40:12.584 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:42.911182+0000", 2024-02-10T08:40:12.584 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6399999999999999e-06 2024-02-10T08:40:12.584 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.584 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.585 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:40:12.585 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:42.911185+0000", 2024-02-10T08:40:12.585 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0044726310000000003 2024-02-10T08:40:12.585 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.585 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.585 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:40:12.585 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:42.915658+0000", 2024-02-10T08:40:12.585 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9414999999999996e-05 2024-02-10T08:40:12.585 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.585 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.586 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:40:12.586 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:42.915757+0000", 2024-02-10T08:40:12.586 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000118955 2024-02-10T08:40:12.586 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.586 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.586 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0,3", 2024-02-10T08:40:12.586 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:42.915876+0000", 2024-02-10T08:40:12.586 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0066525270000000001 2024-02-10T08:40:12.586 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.586 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.586 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:40:12.586 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:42.922529+0000", 2024-02-10T08:40:12.587 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0049549260000000001 2024-02-10T08:40:12.587 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.587 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.587 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:40:12.587 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:42.927484+0000", 2024-02-10T08:40:12.587 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.053630296000000001 2024-02-10T08:40:12.587 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.587 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.588 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:40:12.588 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:42.981114+0000", 2024-02-10T08:40:12.588 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.888e-05 2024-02-10T08:40:12.588 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.588 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.588 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:40:12.588 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:42.981163+0000", 2024-02-10T08:40:12.588 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7864999999999997e-05 2024-02-10T08:40:12.588 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.588 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.588 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:40:12.588 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:42.981201+0000", 2024-02-10T08:40:12.588 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.070025689000000002 2024-02-10T08:40:12.588 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:12.589 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:12.589 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:12.589 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.589 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.589 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.25664.0:185983 11.2 11:4084aeab:::benchmark_data_smithi018_166993_object66858:head [delete] snapc 0=[] ondisk+write+known_if_redirected e442)", 2024-02-10T08:40:12.589 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:39:42.913897+0000", 2024-02-10T08:40:12.589 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 29.554719532, 2024-02-10T08:40:12.589 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.068156417999999996, 2024-02-10T08:40:12.589 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:40:12.589 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:40:12.589 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-02-10T08:40:12.589 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.25664", 2024-02-10T08:40:12.589 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/1087272222", 2024-02-10T08:40:12.589 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 185983 2024-02-10T08:40:12.589 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.590 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:40:12.590 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.590 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:40:12.590 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:42.913897+0000", 2024-02-10T08:40:12.590 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:40:12.590 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.590 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.590 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:40:12.590 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:42.913897+0000", 2024-02-10T08:40:12.590 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:40:12.590 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.590 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.590 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:40:12.590 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:42.913896+0000", 2024-02-10T08:40:12.590 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6649999999999997e-06 2024-02-10T08:40:12.590 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.590 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.591 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:40:12.591 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:42.913903+0000", 2024-02-10T08:40:12.591 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2302e-05 2024-02-10T08:40:12.591 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.591 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.591 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:40:12.591 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:42.913915+0000", 2024-02-10T08:40:12.591 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8680000000000004e-06 2024-02-10T08:40:12.591 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.591 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.591 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:40:12.591 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:42.913921+0000", 2024-02-10T08:40:12.591 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0061016079999999997 2024-02-10T08:40:12.591 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.591 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.591 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:40:12.592 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:42.920022+0000", 2024-02-10T08:40:12.592 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000133759 2024-02-10T08:40:12.592 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.592 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.592 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:40:12.592 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:42.920156+0000", 2024-02-10T08:40:12.592 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000148064 2024-02-10T08:40:12.592 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.592 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.592 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0,3", 2024-02-10T08:40:12.592 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:42.920304+0000", 2024-02-10T08:40:12.592 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0022977240000000001 2024-02-10T08:40:12.592 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.592 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.593 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-02-10T08:40:12.593 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:42.922602+0000", 2024-02-10T08:40:12.593 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00511028 2024-02-10T08:40:12.593 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.593 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.593 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:40:12.593 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:42.927712+0000", 2024-02-10T08:40:12.593 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.054249057000000003 2024-02-10T08:40:12.593 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.593 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.593 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-02-10T08:40:12.593 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:42.981961+0000", 2024-02-10T08:40:12.593 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3334999999999998e-05 2024-02-10T08:40:12.593 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.593 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.593 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:40:12.594 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:42.982005+0000", 2024-02-10T08:40:12.594 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9156000000000002e-05 2024-02-10T08:40:12.594 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:12.594 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:12.594 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:40:12.594 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:42.982054+0000", 2024-02-10T08:40:12.594 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.068156417999999996 2024-02-10T08:40:12.594 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:12.594 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:12.594 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:12.594 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:12.594 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:12.594 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-02-10T08:40:13.749 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd set noscrub 2024-02-10T08:40:14.058 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:40:14.525 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:40:14.529 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:40:13.190277+0000 mgr.y (mgr.14505) 878 : cluster [DBG] pgmap v1078: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+remapped, 1 active+recovery_wait+degraded+remapped, 173 active+clean; 1.6 GiB data, 11 GiB used, 615 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.07k op/s; 2915/81363 objects degraded (3.583%); 0 B/s, 43 objects/s recovering 2024-02-10T08:40:14.529 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:40:13.190277+0000 mgr.y (mgr.14505) 878 : cluster [DBG] pgmap v1078: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+remapped, 1 active+recovery_wait+degraded+remapped, 173 active+clean; 1.6 GiB data, 11 GiB used, 615 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.07k op/s; 2915/81363 objects degraded (3.583%); 0 B/s, 43 objects/s recovering 2024-02-10T08:40:14.530 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:40:14.531 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:40:14.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:40:13.190277+0000 mgr.y (mgr.14505) 878 : cluster [DBG] pgmap v1078: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+remapped, 1 active+recovery_wait+degraded+remapped, 173 active+clean; 1.6 GiB data, 11 GiB used, 615 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.07k op/s; 2915/81363 objects degraded (3.583%); 0 B/s, 43 objects/s recovering 2024-02-10T08:40:14.632 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:40:14.700 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:40:14.735 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:40:14.739 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:40:14.740 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:40:14.841 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:40:14.921 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:40:14.965 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:40:14.971 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:40:14.972 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:40:15.073 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:40:15.139 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:40:15.170 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:40:15.180 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:40:15.180 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:40:15.281 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:40:15.345 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:40:16.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:40:15.190972+0000 mgr.y (mgr.14505) 879 : cluster [DBG] pgmap v1079: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+remapped, 1 active+recovery_wait+degraded+remapped, 173 active+clean; 1.6 GiB data, 10 GiB used, 615 GiB / 626 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 998 op/s; 2686/78744 objects degraded (3.411%); 0 B/s, 37 objects/s recovering 2024-02-10T08:40:16.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:40:16.074428+0000 mon.a (mon.0) 1839 : cluster [WRN] Health check update: Degraded data redundancy: 2686/78744 objects degraded (3.411%), 2 pgs degraded (PG_DEGRADED) 2024-02-10T08:40:16.518 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:40:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:40:16] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:40:16.657 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:40:15.190972+0000 mgr.y (mgr.14505) 879 : cluster [DBG] pgmap v1079: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+remapped, 1 active+recovery_wait+degraded+remapped, 173 active+clean; 1.6 GiB data, 10 GiB used, 615 GiB / 626 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 998 op/s; 2686/78744 objects degraded (3.411%); 0 B/s, 37 objects/s recovering 2024-02-10T08:40:16.657 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:40:16.074428+0000 mon.a (mon.0) 1839 : cluster [WRN] Health check update: Degraded data redundancy: 2686/78744 objects degraded (3.411%), 2 pgs degraded (PG_DEGRADED) 2024-02-10T08:40:16.657 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:40:15.190972+0000 mgr.y (mgr.14505) 879 : cluster [DBG] pgmap v1079: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+remapped, 1 active+recovery_wait+degraded+remapped, 173 active+clean; 1.6 GiB data, 10 GiB used, 615 GiB / 626 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 998 op/s; 2686/78744 objects degraded (3.411%); 0 B/s, 37 objects/s recovering 2024-02-10T08:40:16.657 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:40:16.074428+0000 mon.a (mon.0) 1839 : cluster [WRN] Health check update: Degraded data redundancy: 2686/78744 objects degraded (3.411%), 2 pgs degraded (PG_DEGRADED) 2024-02-10T08:40:16.985 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.3 dump_ops_in_flight 2024-02-10T08:40:17.411 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:40:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:40:17] "GET /metrics HTTP/1.1" 200 176536 "" "Prometheus/2.33.4" 2024-02-10T08:40:18.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:40:16.703336+0000 mon.a (mon.0) 1840 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:40:18.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:40:16.703336+0000 mon.a (mon.0) 1840 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:40:18.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:40:16.703336+0000 mon.a (mon.0) 1840 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:40:18.214 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:40:18.220 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:40:18.221 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:40:18.321 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:40:18.380 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:40:18.424 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:40:18.430 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:40:18.431 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:40:18.531 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:40:18.590 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:40:18.729 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:40:17.192419+0000 mgr.y (mgr.14505) 880 : cluster [DBG] pgmap v1080: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+remapped, 1 active+recovery_wait+degraded+remapped, 173 active+clean; 1.6 GiB data, 10 GiB used, 615 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 942 op/s; 2686/78744 objects degraded (3.411%); 0 B/s, 34 objects/s recovering 2024-02-10T08:40:18.876 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:40:17.192419+0000 mgr.y (mgr.14505) 880 : cluster [DBG] pgmap v1080: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+remapped, 1 active+recovery_wait+degraded+remapped, 173 active+clean; 1.6 GiB data, 10 GiB used, 615 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 942 op/s; 2686/78744 objects degraded (3.411%); 0 B/s, 34 objects/s recovering 2024-02-10T08:40:18.876 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:40:17.192419+0000 mgr.y (mgr.14505) 880 : cluster [DBG] pgmap v1080: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+remapped, 1 active+recovery_wait+degraded+remapped, 173 active+clean; 1.6 GiB data, 10 GiB used, 615 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 942 op/s; 2686/78744 objects degraded (3.411%); 0 B/s, 34 objects/s recovering 2024-02-10T08:40:18.927 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:40:19.034 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:40:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:40:19.097 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:40:19.560 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:40:19.567 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:40:19.567 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:40:19.668 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:40:19.743 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:40:19.771 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:40:19.777 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:40:19.777 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:40:19.878 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4 2024-02-10T08:40:19.916 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:40:19.944 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:40:19.949 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:40:19.949 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4' 2024-02-10T08:40:20.050 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:40:20.131 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:40:20.729 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:40:20.730 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:40:20.730 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:40:20.730 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:40:20.730 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-02-10T08:40:20.730 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:40:20.730 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:40:20.730 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:40:20.730 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-10T08:40:20.730 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-10T08:40:20.730 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-10T08:40:20.730 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-10T08:40:20.730 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-10T08:40:20.731 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-10T08:40:20.731 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-10T08:40:20.731 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-10T08:40:21.041 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:40:19.032012+0000 mgr.y (mgr.14505) 881 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:40:21.041 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:40:19.194488+0000 mgr.y (mgr.14505) 882 : cluster [DBG] pgmap v1081: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+remapped, 1 active+recovery_wait+degraded+remapped, 173 active+clean; 1.3 GiB data, 9.7 GiB used, 616 GiB / 626 GiB avail; 1021 B/s rd, 0 B/s wr, 955 op/s; 2426/65106 objects degraded (3.726%); 0 B/s, 34 objects/s recovering 2024-02-10T08:40:21.041 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:40:20.281851+0000 mon.c (mon.2) 103 : audit [DBG] from='client.? 172.21.15.18:0/1064863566' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:40:21.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:40:19.032012+0000 mgr.y (mgr.14505) 881 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:40:21.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:40:19.194488+0000 mgr.y (mgr.14505) 882 : cluster [DBG] pgmap v1081: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+remapped, 1 active+recovery_wait+degraded+remapped, 173 active+clean; 1.3 GiB data, 9.7 GiB used, 616 GiB / 626 GiB avail; 1021 B/s rd, 0 B/s wr, 955 op/s; 2426/65106 objects degraded (3.726%); 0 B/s, 34 objects/s recovering 2024-02-10T08:40:21.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:40:20.281851+0000 mon.c (mon.2) 103 : audit [DBG] from='client.? 172.21.15.18:0/1064863566' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:40:21.159 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:40:19.032012+0000 mgr.y (mgr.14505) 881 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:40:21.160 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:40:19.194488+0000 mgr.y (mgr.14505) 882 : cluster [DBG] pgmap v1081: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+remapped, 1 active+recovery_wait+degraded+remapped, 173 active+clean; 1.3 GiB data, 9.7 GiB used, 616 GiB / 626 GiB avail; 1021 B/s rd, 0 B/s wr, 955 op/s; 2426/65106 objects degraded (3.726%); 0 B/s, 34 objects/s recovering 2024-02-10T08:40:21.160 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:40:20.281851+0000 mon.c (mon.2) 103 : audit [DBG] from='client.? 172.21.15.18:0/1064863566' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:40:21.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:40:21.075739+0000 mon.a (mon.0) 1841 : cluster [WRN] Health check update: Degraded data redundancy: 2426/65106 objects degraded (3.726%), 2 pgs degraded (PG_DEGRADED) 2024-02-10T08:40:21.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:40:21.075739+0000 mon.a (mon.0) 1841 : cluster [WRN] Health check update: Degraded data redundancy: 2426/65106 objects degraded (3.726%), 2 pgs degraded (PG_DEGRADED) 2024-02-10T08:40:22.041 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:40:21.075739+0000 mon.a (mon.0) 1841 : cluster [WRN] Health check update: Degraded data redundancy: 2426/65106 objects degraded (3.726%), 2 pgs degraded (PG_DEGRADED) 2024-02-10T08:40:22.233 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:40:22.233 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-02-10T08:40:22.233 INFO:teuthology.orchestra.run.smithi018.stdout: "epoch": 451, 2024-02-10T08:40:22.233 INFO:teuthology.orchestra.run.smithi018.stdout: "fsid": "d46257c8-c7eb-11ee-95b8-87774f69a715", 2024-02-10T08:40:22.233 INFO:teuthology.orchestra.run.smithi018.stdout: "created": "2024-02-10T08:10:57.425061+0000", 2024-02-10T08:40:22.233 INFO:teuthology.orchestra.run.smithi018.stdout: "modified": "2024-02-10T08:40:09.146286+0000", 2024-02-10T08:40:22.233 INFO:teuthology.orchestra.run.smithi018.stdout: "last_up_change": "2024-02-10T08:39:51.374098+0000", 2024-02-10T08:40:22.234 INFO:teuthology.orchestra.run.smithi018.stdout: "last_in_change": "2024-02-10T08:38:39.230106+0000", 2024-02-10T08:40:22.234 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-02-10T08:40:22.234 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_num": 5799936, 2024-02-10T08:40:22.234 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_set": [ 2024-02-10T08:40:22.234 INFO:teuthology.orchestra.run.smithi018.stdout: "pglog_hardlimit", 2024-02-10T08:40:22.234 INFO:teuthology.orchestra.run.smithi018.stdout: "purged_snapdirs", 2024-02-10T08:40:22.234 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_deletes", 2024-02-10T08:40:22.234 INFO:teuthology.orchestra.run.smithi018.stdout: "sortbitwise" 2024-02-10T08:40:22.234 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-02-10T08:40:22.234 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_version": 20, 2024-02-10T08:40:22.234 INFO:teuthology.orchestra.run.smithi018.stdout: "full_ratio": 0.94999998807907104, 2024-02-10T08:40:22.234 INFO:teuthology.orchestra.run.smithi018.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-02-10T08:40:22.234 INFO:teuthology.orchestra.run.smithi018.stdout: "nearfull_ratio": 0.85000002384185791, 2024-02-10T08:40:22.234 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_snapshot": "", 2024-02-10T08:40:22.235 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_max": 11, 2024-02-10T08:40:22.235 INFO:teuthology.orchestra.run.smithi018.stdout: "max_osd": 8, 2024-02-10T08:40:22.235 INFO:teuthology.orchestra.run.smithi018.stdout: "require_min_compat_client": "luminous", 2024-02-10T08:40:22.235 INFO:teuthology.orchestra.run.smithi018.stdout: "min_compat_client": "luminous", 2024-02-10T08:40:22.235 INFO:teuthology.orchestra.run.smithi018.stdout: "require_osd_release": "pacific", 2024-02-10T08:40:22.235 INFO:teuthology.orchestra.run.smithi018.stdout: "pools": [ 2024-02-10T08:40:22.235 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.235 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 1, 2024-02-10T08:40:22.235 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "device_health_metrics", 2024-02-10T08:40:22.235 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-02-10T08:14:44.034966+0000", 2024-02-10T08:40:22.235 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-02-10T08:40:22.235 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-02-10T08:40:22.235 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-02-10T08:40:22.235 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 3, 2024-02-10T08:40:22.235 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 2, 2024-02-10T08:40:22.236 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-02-10T08:40:22.236 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-02-10T08:40:22.236 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-02-10T08:40:22.236 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-02-10T08:40:22.236 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-10T08:40:22.236 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-02-10T08:40:22.236 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-02-10T08:40:22.236 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 11, 2024-02-10T08:40:22.236 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 11, 2024-02-10T08:40:22.236 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 11, 2024-02-10T08:40:22.236 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 11, 2024-02-10T08:40:22.236 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 11, 2024-02-10T08:40:22.236 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-02-10T08:40:22.237 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-02-10T08:40:22.237 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-02-10T08:40:22.237 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-02-10T08:40:22.237 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-02-10T08:40:22.237 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-02-10T08:40:22.237 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-02-10T08:40:22.237 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.237 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "411", 2024-02-10T08:40:22.237 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-02-10T08:40:22.237 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-10T08:40:22.237 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "409", 2024-02-10T08:40:22.237 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-02-10T08:40:22.237 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-02-10T08:40:22.237 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-02-10T08:40:22.237 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-02-10T08:40:22.238 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-02-10T08:40:22.238 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-02-10T08:40:22.238 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-02-10T08:40:22.238 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-02-10T08:40:22.238 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-02-10T08:40:22.238 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-02-10T08:40:22.238 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-02-10T08:40:22.238 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-02-10T08:40:22.238 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-02-10T08:40:22.238 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-02-10T08:40:22.238 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-02-10T08:40:22.238 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-10T08:40:22.238 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-10T08:40:22.239 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-10T08:40:22.239 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-02-10T08:40:22.239 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-02-10T08:40:22.239 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-02-10T08:40:22.239 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-02-10T08:40:22.239 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-02-10T08:40:22.239 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.239 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-02-10T08:40:22.239 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-02-10T08:40:22.239 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-02-10T08:40:22.239 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-02-10T08:40:22.239 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-02-10T08:40:22.239 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-02-10T08:40:22.239 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-02-10T08:40:22.240 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-02-10T08:40:22.240 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-02-10T08:40:22.240 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-02-10T08:40:22.240 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-02-10T08:40:22.240 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-02-10T08:40:22.240 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_max": 32, 2024-02-10T08:40:22.240 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 1 2024-02-10T08:40:22.240 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.240 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-02-10T08:40:22.240 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_devicehealth": {} 2024-02-10T08:40:22.240 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:22.240 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.240 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.241 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 2, 2024-02-10T08:40:22.241 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": ".rgw.root", 2024-02-10T08:40:22.241 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-02-10T08:16:51.334631+0000", 2024-02-10T08:40:22.241 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-02-10T08:40:22.241 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-02-10T08:40:22.241 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-02-10T08:40:22.241 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 3, 2024-02-10T08:40:22.241 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 2, 2024-02-10T08:40:22.241 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-02-10T08:40:22.241 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-02-10T08:40:22.241 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-02-10T08:40:22.241 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-02-10T08:40:22.241 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-10T08:40:22.241 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-02-10T08:40:22.242 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-02-10T08:40:22.242 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 32, 2024-02-10T08:40:22.242 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 32, 2024-02-10T08:40:22.242 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 32, 2024-02-10T08:40:22.242 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 32, 2024-02-10T08:40:22.242 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 32, 2024-02-10T08:40:22.242 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-02-10T08:40:22.242 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-02-10T08:40:22.242 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-02-10T08:40:22.242 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-02-10T08:40:22.242 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-02-10T08:40:22.242 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-02-10T08:40:22.242 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-02-10T08:40:22.242 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.242 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "56", 2024-02-10T08:40:22.243 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-02-10T08:40:22.243 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-10T08:40:22.243 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-02-10T08:40:22.243 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-02-10T08:40:22.243 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-02-10T08:40:22.243 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-02-10T08:40:22.243 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-02-10T08:40:22.243 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-02-10T08:40:22.243 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-02-10T08:40:22.243 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-02-10T08:40:22.243 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-02-10T08:40:22.243 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-02-10T08:40:22.243 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-02-10T08:40:22.243 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-02-10T08:40:22.243 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-02-10T08:40:22.244 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-02-10T08:40:22.244 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-02-10T08:40:22.244 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-02-10T08:40:22.244 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-10T08:40:22.244 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-10T08:40:22.244 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-10T08:40:22.244 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-02-10T08:40:22.244 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-02-10T08:40:22.244 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-02-10T08:40:22.244 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-02-10T08:40:22.244 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-02-10T08:40:22.244 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.244 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-02-10T08:40:22.244 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-02-10T08:40:22.245 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-02-10T08:40:22.245 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-02-10T08:40:22.245 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-02-10T08:40:22.245 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-02-10T08:40:22.245 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-02-10T08:40:22.245 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-02-10T08:40:22.245 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-02-10T08:40:22.245 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-02-10T08:40:22.245 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-02-10T08:40:22.245 INFO:teuthology.orchestra.run.smithi018.stdout: "options": {}, 2024-02-10T08:40:22.245 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-02-10T08:40:22.245 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw": {} 2024-02-10T08:40:22.245 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:22.245 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.245 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.246 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 3, 2024-02-10T08:40:22.246 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "iscsi", 2024-02-10T08:40:22.246 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-02-10T08:16:51.762963+0000", 2024-02-10T08:40:22.246 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-02-10T08:40:22.246 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-02-10T08:40:22.246 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-02-10T08:40:22.246 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 3, 2024-02-10T08:40:22.246 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 2, 2024-02-10T08:40:22.246 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-02-10T08:40:22.246 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-02-10T08:40:22.246 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-02-10T08:40:22.246 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-02-10T08:40:22.246 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-10T08:40:22.246 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-02-10T08:40:22.246 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-02-10T08:40:22.247 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 3, 2024-02-10T08:40:22.247 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 3, 2024-02-10T08:40:22.247 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 3, 2024-02-10T08:40:22.247 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 3, 2024-02-10T08:40:22.247 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 3, 2024-02-10T08:40:22.247 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-02-10T08:40:22.247 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-02-10T08:40:22.247 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-02-10T08:40:22.247 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-02-10T08:40:22.247 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-02-10T08:40:22.247 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-02-10T08:40:22.247 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-02-10T08:40:22.247 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.247 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "424", 2024-02-10T08:40:22.247 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-02-10T08:40:22.248 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-10T08:40:22.248 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-02-10T08:40:22.248 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-02-10T08:40:22.248 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-02-10T08:40:22.248 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-02-10T08:40:22.248 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-02-10T08:40:22.248 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-02-10T08:40:22.248 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-02-10T08:40:22.248 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-02-10T08:40:22.248 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-02-10T08:40:22.248 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-02-10T08:40:22.248 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-02-10T08:40:22.248 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-02-10T08:40:22.248 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-02-10T08:40:22.249 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-02-10T08:40:22.249 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-02-10T08:40:22.249 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-02-10T08:40:22.249 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-10T08:40:22.249 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-10T08:40:22.249 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-10T08:40:22.249 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-02-10T08:40:22.249 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-02-10T08:40:22.249 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-02-10T08:40:22.249 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-02-10T08:40:22.249 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-02-10T08:40:22.249 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.249 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-02-10T08:40:22.250 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-02-10T08:40:22.250 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-02-10T08:40:22.250 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-02-10T08:40:22.250 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-02-10T08:40:22.250 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-02-10T08:40:22.251 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-02-10T08:40:22.251 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-02-10T08:40:22.251 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-02-10T08:40:22.251 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-02-10T08:40:22.251 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-02-10T08:40:22.251 INFO:teuthology.orchestra.run.smithi018.stdout: "options": {}, 2024-02-10T08:40:22.251 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-02-10T08:40:22.251 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd": {} 2024-02-10T08:40:22.251 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:22.251 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.251 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.251 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 4, 2024-02-10T08:40:22.251 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "default.rgw.log", 2024-02-10T08:40:22.251 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-02-10T08:16:53.258098+0000", 2024-02-10T08:40:22.252 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-02-10T08:40:22.252 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-02-10T08:40:22.252 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-02-10T08:40:22.252 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 3, 2024-02-10T08:40:22.252 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 2, 2024-02-10T08:40:22.252 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-02-10T08:40:22.252 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-02-10T08:40:22.252 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-02-10T08:40:22.252 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-02-10T08:40:22.252 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-10T08:40:22.252 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-02-10T08:40:22.252 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-02-10T08:40:22.252 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 32, 2024-02-10T08:40:22.252 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 32, 2024-02-10T08:40:22.253 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 32, 2024-02-10T08:40:22.253 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 32, 2024-02-10T08:40:22.253 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 32, 2024-02-10T08:40:22.253 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-02-10T08:40:22.253 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-02-10T08:40:22.253 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-02-10T08:40:22.253 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-02-10T08:40:22.253 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-02-10T08:40:22.253 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-02-10T08:40:22.253 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-02-10T08:40:22.253 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.253 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "205", 2024-02-10T08:40:22.253 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-02-10T08:40:22.253 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-10T08:40:22.254 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-02-10T08:40:22.254 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-02-10T08:40:22.254 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-02-10T08:40:22.254 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-02-10T08:40:22.254 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-02-10T08:40:22.254 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-02-10T08:40:22.254 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-02-10T08:40:22.254 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-02-10T08:40:22.254 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-02-10T08:40:22.254 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-02-10T08:40:22.254 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-02-10T08:40:22.254 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-02-10T08:40:22.254 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-02-10T08:40:22.254 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-02-10T08:40:22.254 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-02-10T08:40:22.255 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-02-10T08:40:22.255 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-10T08:40:22.255 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-10T08:40:22.255 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-10T08:40:22.255 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-02-10T08:40:22.255 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-02-10T08:40:22.255 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-02-10T08:40:22.255 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-02-10T08:40:22.255 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-02-10T08:40:22.255 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.255 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-02-10T08:40:22.255 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-02-10T08:40:22.255 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-02-10T08:40:22.255 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-02-10T08:40:22.255 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-02-10T08:40:22.256 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-02-10T08:40:22.256 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-02-10T08:40:22.256 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-02-10T08:40:22.256 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-02-10T08:40:22.256 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-02-10T08:40:22.256 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-02-10T08:40:22.256 INFO:teuthology.orchestra.run.smithi018.stdout: "options": {}, 2024-02-10T08:40:22.256 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-02-10T08:40:22.256 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw": {} 2024-02-10T08:40:22.256 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:22.256 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.256 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.256 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 5, 2024-02-10T08:40:22.257 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "default.rgw.control", 2024-02-10T08:40:22.257 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-02-10T08:16:55.289300+0000", 2024-02-10T08:40:22.257 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-02-10T08:40:22.257 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-02-10T08:40:22.257 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-02-10T08:40:22.257 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 3, 2024-02-10T08:40:22.257 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 2, 2024-02-10T08:40:22.257 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-02-10T08:40:22.257 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-02-10T08:40:22.257 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-02-10T08:40:22.257 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-02-10T08:40:22.257 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-10T08:40:22.257 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-02-10T08:40:22.257 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-02-10T08:40:22.257 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 32, 2024-02-10T08:40:22.258 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 32, 2024-02-10T08:40:22.258 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 32, 2024-02-10T08:40:22.258 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 32, 2024-02-10T08:40:22.258 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 32, 2024-02-10T08:40:22.258 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-02-10T08:40:22.258 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-02-10T08:40:22.258 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-02-10T08:40:22.258 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-02-10T08:40:22.258 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-02-10T08:40:22.258 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-02-10T08:40:22.258 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-02-10T08:40:22.258 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.258 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "60", 2024-02-10T08:40:22.258 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-02-10T08:40:22.259 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-10T08:40:22.259 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-02-10T08:40:22.259 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-02-10T08:40:22.259 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-02-10T08:40:22.259 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-02-10T08:40:22.259 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-02-10T08:40:22.259 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-02-10T08:40:22.259 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-02-10T08:40:22.259 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-02-10T08:40:22.259 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-02-10T08:40:22.259 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-02-10T08:40:22.259 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-02-10T08:40:22.259 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-02-10T08:40:22.259 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-02-10T08:40:22.259 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-02-10T08:40:22.260 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-02-10T08:40:22.260 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-02-10T08:40:22.260 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-10T08:40:22.260 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-10T08:40:22.260 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-10T08:40:22.260 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-02-10T08:40:22.260 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-02-10T08:40:22.260 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-02-10T08:40:22.260 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-02-10T08:40:22.260 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-02-10T08:40:22.260 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.260 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-02-10T08:40:22.260 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-02-10T08:40:22.260 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-02-10T08:40:22.261 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-02-10T08:40:22.261 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-02-10T08:40:22.261 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-02-10T08:40:22.261 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-02-10T08:40:22.261 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-02-10T08:40:22.261 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-02-10T08:40:22.261 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-02-10T08:40:22.261 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-02-10T08:40:22.261 INFO:teuthology.orchestra.run.smithi018.stdout: "options": {}, 2024-02-10T08:40:22.261 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-02-10T08:40:22.261 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw": {} 2024-02-10T08:40:22.261 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:22.261 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.261 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.261 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 6, 2024-02-10T08:40:22.262 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "default.rgw.meta", 2024-02-10T08:40:22.262 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-02-10T08:16:57.354868+0000", 2024-02-10T08:40:22.262 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-02-10T08:40:22.262 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-02-10T08:40:22.262 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-02-10T08:40:22.262 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 3, 2024-02-10T08:40:22.262 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 2, 2024-02-10T08:40:22.262 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-02-10T08:40:22.262 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-02-10T08:40:22.262 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-02-10T08:40:22.262 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-02-10T08:40:22.262 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-10T08:40:22.262 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-02-10T08:40:22.262 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-02-10T08:40:22.262 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 52, 2024-02-10T08:40:22.263 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 52, 2024-02-10T08:40:22.263 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 52, 2024-02-10T08:40:22.263 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 52, 2024-02-10T08:40:22.263 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 52, 2024-02-10T08:40:22.263 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-02-10T08:40:22.263 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-02-10T08:40:22.263 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-02-10T08:40:22.263 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-02-10T08:40:22.263 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-02-10T08:40:22.263 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-02-10T08:40:22.263 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-02-10T08:40:22.263 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.263 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "289", 2024-02-10T08:40:22.263 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-02-10T08:40:22.263 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-10T08:40:22.264 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "287", 2024-02-10T08:40:22.264 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-02-10T08:40:22.264 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-02-10T08:40:22.264 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-02-10T08:40:22.264 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-02-10T08:40:22.264 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-02-10T08:40:22.264 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-02-10T08:40:22.264 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-02-10T08:40:22.264 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-02-10T08:40:22.264 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-02-10T08:40:22.264 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-02-10T08:40:22.264 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-02-10T08:40:22.264 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-02-10T08:40:22.264 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-02-10T08:40:22.265 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-02-10T08:40:22.265 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-02-10T08:40:22.265 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-10T08:40:22.265 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-10T08:40:22.265 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-10T08:40:22.265 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-02-10T08:40:22.265 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-02-10T08:40:22.265 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-02-10T08:40:22.265 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-02-10T08:40:22.265 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-02-10T08:40:22.265 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.265 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-02-10T08:40:22.265 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-02-10T08:40:22.265 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-02-10T08:40:22.265 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-02-10T08:40:22.266 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-02-10T08:40:22.266 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-02-10T08:40:22.266 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-02-10T08:40:22.266 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-02-10T08:40:22.266 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-02-10T08:40:22.266 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-02-10T08:40:22.266 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-02-10T08:40:22.266 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-02-10T08:40:22.266 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_bias": 4 2024-02-10T08:40:22.266 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.266 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-02-10T08:40:22.266 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw": {} 2024-02-10T08:40:22.266 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:22.266 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.267 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.267 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 11, 2024-02-10T08:40:22.267 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "unique_pool_4", 2024-02-10T08:40:22.267 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-02-10T08:36:44.069268+0000", 2024-02-10T08:40:22.267 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-02-10T08:40:22.267 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-02-10T08:40:22.267 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-02-10T08:40:22.267 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 3, 2024-02-10T08:40:22.267 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 2, 2024-02-10T08:40:22.267 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-02-10T08:40:22.267 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-02-10T08:40:22.267 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-02-10T08:40:22.267 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-02-10T08:40:22.267 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-10T08:40:22.267 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-02-10T08:40:22.268 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-02-10T08:40:22.268 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 16, 2024-02-10T08:40:22.268 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 16, 2024-02-10T08:40:22.268 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 16, 2024-02-10T08:40:22.268 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 16, 2024-02-10T08:40:22.268 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 16, 2024-02-10T08:40:22.268 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-02-10T08:40:22.268 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-02-10T08:40:22.268 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-02-10T08:40:22.268 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-02-10T08:40:22.268 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-02-10T08:40:22.268 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-02-10T08:40:22.268 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-02-10T08:40:22.268 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.269 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "401", 2024-02-10T08:40:22.269 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-02-10T08:40:22.269 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-10T08:40:22.269 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-02-10T08:40:22.269 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-02-10T08:40:22.269 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-02-10T08:40:22.269 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-02-10T08:40:22.269 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-02-10T08:40:22.269 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-02-10T08:40:22.269 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-02-10T08:40:22.269 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-02-10T08:40:22.269 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-02-10T08:40:22.269 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-02-10T08:40:22.269 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-02-10T08:40:22.270 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-02-10T08:40:22.270 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-02-10T08:40:22.270 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-02-10T08:40:22.270 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-02-10T08:40:22.270 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-02-10T08:40:22.270 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-10T08:40:22.270 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-10T08:40:22.270 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-10T08:40:22.270 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-02-10T08:40:22.270 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-02-10T08:40:22.270 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-02-10T08:40:22.270 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-02-10T08:40:22.270 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-02-10T08:40:22.270 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.270 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-02-10T08:40:22.271 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-02-10T08:40:22.271 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-02-10T08:40:22.271 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-02-10T08:40:22.271 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-02-10T08:40:22.271 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-02-10T08:40:22.271 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-02-10T08:40:22.271 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-02-10T08:40:22.271 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-02-10T08:40:22.271 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-02-10T08:40:22.271 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-02-10T08:40:22.271 INFO:teuthology.orchestra.run.smithi018.stdout: "options": {}, 2024-02-10T08:40:22.271 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-02-10T08:40:22.271 INFO:teuthology.orchestra.run.smithi018.stdout: "rados": {} 2024-02-10T08:40:22.271 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:22.271 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:22.272 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-02-10T08:40:22.272 INFO:teuthology.orchestra.run.smithi018.stdout: "osds": [ 2024-02-10T08:40:22.272 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.272 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-02-10T08:40:22.272 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "f9043fee-a3ed-4e16-921d-bb86756d0c48", 2024-02-10T08:40:22.272 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-02-10T08:40:22.272 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-02-10T08:40:22.272 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-02-10T08:40:22.272 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-02-10T08:40:22.272 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-02-10T08:40:22.272 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-02-10T08:40:22.272 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 8, 2024-02-10T08:40:22.272 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 428, 2024-02-10T08:40:22.272 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-02-10T08:40:22.273 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-02-10T08:40:22.273 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-02-10T08:40:22.273 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:40:22.273 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.273 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:40:22.273 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6801", 2024-02-10T08:40:22.273 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 276034406 2024-02-10T08:40:22.273 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:22.273 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:22.273 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.273 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-02-10T08:40:22.273 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:40:22.273 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.273 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:40:22.273 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6802", 2024-02-10T08:40:22.274 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 276034406 2024-02-10T08:40:22.274 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:22.274 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:22.274 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.274 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-02-10T08:40:22.274 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:40:22.274 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.274 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:40:22.274 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6804", 2024-02-10T08:40:22.274 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 276034406 2024-02-10T08:40:22.274 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:22.274 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:22.274 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.274 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-02-10T08:40:22.275 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:40:22.275 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.275 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:40:22.275 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6803", 2024-02-10T08:40:22.275 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 276034406 2024-02-10T08:40:22.275 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:22.275 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:22.275 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.275 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6801/276034406", 2024-02-10T08:40:22.275 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6802/276034406", 2024-02-10T08:40:22.275 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6804/276034406", 2024-02-10T08:40:22.275 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6803/276034406", 2024-02-10T08:40:22.275 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-02-10T08:40:22.275 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-02-10T08:40:22.276 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-02-10T08:40:22.276 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:22.276 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.276 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.276 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-02-10T08:40:22.276 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "ff958272-ce6b-4162-959a-6da9729e537b", 2024-02-10T08:40:22.276 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-02-10T08:40:22.276 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-02-10T08:40:22.276 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-02-10T08:40:22.276 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-02-10T08:40:22.276 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-02-10T08:40:22.276 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-02-10T08:40:22.276 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-02-10T08:40:22.276 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 448, 2024-02-10T08:40:22.277 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-02-10T08:40:22.277 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-02-10T08:40:22.277 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-02-10T08:40:22.277 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:40:22.277 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.277 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:40:22.277 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6805", 2024-02-10T08:40:22.277 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1941014296 2024-02-10T08:40:22.277 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:22.277 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:22.277 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.277 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-02-10T08:40:22.277 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:40:22.278 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.278 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:40:22.278 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6806", 2024-02-10T08:40:22.278 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1941014296 2024-02-10T08:40:22.278 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:22.278 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:22.278 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.278 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-02-10T08:40:22.278 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:40:22.278 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.278 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:40:22.278 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6808", 2024-02-10T08:40:22.278 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1941014296 2024-02-10T08:40:22.278 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:22.278 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:22.279 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.279 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-02-10T08:40:22.279 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:40:22.279 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.279 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:40:22.279 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6807", 2024-02-10T08:40:22.279 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1941014296 2024-02-10T08:40:22.279 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:22.279 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:22.279 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.279 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6805/1941014296", 2024-02-10T08:40:22.279 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6806/1941014296", 2024-02-10T08:40:22.279 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6808/1941014296", 2024-02-10T08:40:22.279 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6807/1941014296", 2024-02-10T08:40:22.280 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-02-10T08:40:22.280 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-02-10T08:40:22.280 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-02-10T08:40:22.280 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:22.280 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.280 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.280 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-02-10T08:40:22.280 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "29bb47e2-5c81-4ae8-bb9f-d1b02ea01d3f", 2024-02-10T08:40:22.280 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-02-10T08:40:22.280 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-02-10T08:40:22.280 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-02-10T08:40:22.280 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-02-10T08:40:22.280 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-02-10T08:40:22.280 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-02-10T08:40:22.281 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 18, 2024-02-10T08:40:22.281 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 428, 2024-02-10T08:40:22.281 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-02-10T08:40:22.281 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-02-10T08:40:22.281 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-02-10T08:40:22.281 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:40:22.281 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.281 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:40:22.281 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6809", 2024-02-10T08:40:22.281 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3122474567 2024-02-10T08:40:22.281 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:22.281 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:22.281 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.281 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-02-10T08:40:22.281 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:40:22.282 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.282 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:40:22.282 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6810", 2024-02-10T08:40:22.282 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3122474567 2024-02-10T08:40:22.282 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:22.282 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:22.282 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.282 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-02-10T08:40:22.282 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:40:22.282 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.282 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:40:22.282 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6812", 2024-02-10T08:40:22.282 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3122474567 2024-02-10T08:40:22.282 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:22.282 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:22.283 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.283 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-02-10T08:40:22.283 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:40:22.283 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.283 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:40:22.283 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6811", 2024-02-10T08:40:22.283 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3122474567 2024-02-10T08:40:22.283 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:22.283 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:22.283 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.283 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6809/3122474567", 2024-02-10T08:40:22.283 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6810/3122474567", 2024-02-10T08:40:22.283 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6812/3122474567", 2024-02-10T08:40:22.283 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6811/3122474567", 2024-02-10T08:40:22.284 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-02-10T08:40:22.284 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-02-10T08:40:22.284 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-02-10T08:40:22.284 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:22.284 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.284 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.284 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-02-10T08:40:22.284 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "87ad37de-5f49-4e5b-9683-3bb9c3e33907", 2024-02-10T08:40:22.284 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-02-10T08:40:22.284 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-02-10T08:40:22.284 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-02-10T08:40:22.284 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 0, 2024-02-10T08:40:22.284 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-02-10T08:40:22.284 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-02-10T08:40:22.284 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 25, 2024-02-10T08:40:22.285 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 175, 2024-02-10T08:40:22.285 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-02-10T08:40:22.285 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-02-10T08:40:22.285 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-02-10T08:40:22.285 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:40:22.285 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.285 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:40:22.285 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6813", 2024-02-10T08:40:22.285 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3484706437 2024-02-10T08:40:22.285 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:22.285 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:22.285 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.285 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-02-10T08:40:22.285 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:40:22.286 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.286 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:40:22.286 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6814", 2024-02-10T08:40:22.286 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3484706437 2024-02-10T08:40:22.286 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:22.286 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:22.286 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.286 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-02-10T08:40:22.286 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:40:22.286 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.286 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:40:22.286 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6816", 2024-02-10T08:40:22.286 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3484706437 2024-02-10T08:40:22.286 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:22.287 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:22.288 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.288 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-02-10T08:40:22.288 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:40:22.288 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.288 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:40:22.289 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6815", 2024-02-10T08:40:22.289 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3484706437 2024-02-10T08:40:22.289 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:22.289 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:22.289 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.289 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6813/3484706437", 2024-02-10T08:40:22.290 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6814/3484706437", 2024-02-10T08:40:22.290 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6816/3484706437", 2024-02-10T08:40:22.290 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6815/3484706437", 2024-02-10T08:40:22.290 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-02-10T08:40:22.290 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-02-10T08:40:22.290 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-02-10T08:40:22.290 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:22.291 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.291 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.291 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-02-10T08:40:22.291 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "f5708f20-f98d-4d12-b8ae-71a5049a14cc", 2024-02-10T08:40:22.291 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-02-10T08:40:22.291 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-02-10T08:40:22.292 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-02-10T08:40:22.292 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-02-10T08:40:22.292 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 30, 2024-02-10T08:40:22.292 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 87, 2024-02-10T08:40:22.292 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 110, 2024-02-10T08:40:22.292 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 447, 2024-02-10T08:40:22.293 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 88, 2024-02-10T08:40:22.293 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-02-10T08:40:22.293 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-02-10T08:40:22.293 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:40:22.293 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.293 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:40:22.293 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6800", 2024-02-10T08:40:22.294 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3888817642 2024-02-10T08:40:22.294 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:22.294 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:22.294 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.294 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-02-10T08:40:22.294 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:40:22.294 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.295 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:40:22.295 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6801", 2024-02-10T08:40:22.295 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3888817642 2024-02-10T08:40:22.295 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:22.295 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:22.295 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.296 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-02-10T08:40:22.296 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:40:22.296 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.296 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:40:22.296 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6803", 2024-02-10T08:40:22.297 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3888817642 2024-02-10T08:40:22.297 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:22.297 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:22.297 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.297 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-02-10T08:40:22.297 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:40:22.297 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.298 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:40:22.298 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6802", 2024-02-10T08:40:22.298 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3888817642 2024-02-10T08:40:22.298 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:22.298 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:22.298 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.299 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.71:6800/3888817642", 2024-02-10T08:40:22.299 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.71:6801/3888817642", 2024-02-10T08:40:22.299 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.71:6803/3888817642", 2024-02-10T08:40:22.299 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.71:6802/3888817642", 2024-02-10T08:40:22.299 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-02-10T08:40:22.299 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-02-10T08:40:22.300 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-02-10T08:40:22.300 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:22.300 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.300 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.300 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-02-10T08:40:22.300 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "e36a71dd-5088-4bff-965e-7dc8708ef7e3", 2024-02-10T08:40:22.301 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-02-10T08:40:22.301 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-02-10T08:40:22.301 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-02-10T08:40:22.301 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-02-10T08:40:22.301 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-02-10T08:40:22.301 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-02-10T08:40:22.301 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 37, 2024-02-10T08:40:22.302 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 447, 2024-02-10T08:40:22.302 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-02-10T08:40:22.302 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-02-10T08:40:22.302 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-02-10T08:40:22.302 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:40:22.302 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.303 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:40:22.303 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6804", 2024-02-10T08:40:22.303 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1932648316 2024-02-10T08:40:22.303 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:22.303 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:22.303 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.303 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-02-10T08:40:22.304 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:40:22.304 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.304 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:40:22.304 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6805", 2024-02-10T08:40:22.304 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1932648316 2024-02-10T08:40:22.305 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:22.305 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:22.305 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.305 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-02-10T08:40:22.305 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:40:22.305 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.305 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:40:22.306 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6807", 2024-02-10T08:40:22.306 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1932648316 2024-02-10T08:40:22.306 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:22.306 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:22.306 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.306 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-02-10T08:40:22.307 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:40:22.307 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.307 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:40:22.307 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6806", 2024-02-10T08:40:22.307 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1932648316 2024-02-10T08:40:22.307 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:22.307 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:22.308 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.308 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.71:6804/1932648316", 2024-02-10T08:40:22.308 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.71:6805/1932648316", 2024-02-10T08:40:22.308 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.71:6807/1932648316", 2024-02-10T08:40:22.308 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.71:6806/1932648316", 2024-02-10T08:40:22.308 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-02-10T08:40:22.309 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-02-10T08:40:22.309 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-02-10T08:40:22.309 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:22.309 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.309 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.309 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-02-10T08:40:22.310 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "210a8790-78b6-4efa-a969-17efb17e9c0b", 2024-02-10T08:40:22.310 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-02-10T08:40:22.310 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-02-10T08:40:22.310 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-02-10T08:40:22.310 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 0.66424560546875, 2024-02-10T08:40:22.310 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-02-10T08:40:22.310 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-02-10T08:40:22.310 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 43, 2024-02-10T08:40:22.310 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 447, 2024-02-10T08:40:22.310 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-02-10T08:40:22.311 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-02-10T08:40:22.311 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-02-10T08:40:22.311 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:40:22.311 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.311 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:40:22.311 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6808", 2024-02-10T08:40:22.311 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3724399458 2024-02-10T08:40:22.312 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:22.312 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:22.312 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.312 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-02-10T08:40:22.312 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:40:22.312 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.312 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:40:22.312 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6809", 2024-02-10T08:40:22.312 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3724399458 2024-02-10T08:40:22.313 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:22.313 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:22.313 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.313 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-02-10T08:40:22.313 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:40:22.313 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.313 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:40:22.313 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6811", 2024-02-10T08:40:22.313 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3724399458 2024-02-10T08:40:22.313 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:22.313 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:22.314 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.314 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-02-10T08:40:22.314 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:40:22.314 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.314 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:40:22.314 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6810", 2024-02-10T08:40:22.314 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3724399458 2024-02-10T08:40:22.314 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:22.314 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:22.314 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.314 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.71:6808/3724399458", 2024-02-10T08:40:22.315 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.71:6809/3724399458", 2024-02-10T08:40:22.315 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.71:6811/3724399458", 2024-02-10T08:40:22.315 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.71:6810/3724399458", 2024-02-10T08:40:22.315 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-02-10T08:40:22.315 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-02-10T08:40:22.315 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-02-10T08:40:22.315 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:22.315 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.315 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.316 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-02-10T08:40:22.316 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "9778a0e9-2ff3-4700-bf2a-675edaba630b", 2024-02-10T08:40:22.316 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-02-10T08:40:22.316 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 0, 2024-02-10T08:40:22.316 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 0, 2024-02-10T08:40:22.316 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-02-10T08:40:22.316 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 50, 2024-02-10T08:40:22.316 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 432, 2024-02-10T08:40:22.316 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 446, 2024-02-10T08:40:22.316 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 411, 2024-02-10T08:40:22.317 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 433, 2024-02-10T08:40:22.317 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-02-10T08:40:22.317 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-02-10T08:40:22.317 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:40:22.317 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.317 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:40:22.317 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6812", 2024-02-10T08:40:22.317 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3959966129 2024-02-10T08:40:22.317 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:22.317 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:22.318 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.318 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-02-10T08:40:22.318 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:40:22.318 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.318 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:40:22.318 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6813", 2024-02-10T08:40:22.318 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3959966129 2024-02-10T08:40:22.318 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:22.318 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:22.318 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.319 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-02-10T08:40:22.319 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:40:22.319 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.319 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:40:22.319 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6815", 2024-02-10T08:40:22.319 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3959966129 2024-02-10T08:40:22.319 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:22.319 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:22.319 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.319 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-02-10T08:40:22.320 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-02-10T08:40:22.320 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.320 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-02-10T08:40:22.320 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.71:6814", 2024-02-10T08:40:22.320 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3959966129 2024-02-10T08:40:22.320 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:22.320 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:22.320 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.320 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.71:6812/3959966129", 2024-02-10T08:40:22.320 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.71:6813/3959966129", 2024-02-10T08:40:22.321 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.71:6815/3959966129", 2024-02-10T08:40:22.321 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.71:6814/3959966129", 2024-02-10T08:40:22.321 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-02-10T08:40:22.321 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-02-10T08:40:22.321 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-02-10T08:40:22.321 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:22.321 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:22.322 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-02-10T08:40:22.322 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_xinfo": [ 2024-02-10T08:40:22.322 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.322 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-02-10T08:40:22.322 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-02-10T08:40:22.322 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-02-10T08:40:22.323 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-02-10T08:40:22.323 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540138314316775423, 2024-02-10T08:40:22.323 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-02-10T08:40:22.323 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-02-10T08:39:20.334921+0000", 2024-02-10T08:40:22.323 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-02-10T08:40:22.324 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.324 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.324 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-02-10T08:40:22.324 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-02-10T08:40:22.325 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-02-10T08:40:22.325 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-02-10T08:40:22.325 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540138314316775423, 2024-02-10T08:40:22.325 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-02-10T08:40:22.325 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-02-10T08:40:04.746943+0000", 2024-02-10T08:40:22.326 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-02-10T08:40:22.326 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.326 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.326 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-02-10T08:40:22.326 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-02-10T08:40:22.326 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-02-10T08:40:22.327 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-02-10T08:40:22.327 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540138314316775423, 2024-02-10T08:40:22.327 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-02-10T08:40:22.327 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-02-10T08:39:45.576150+0000", 2024-02-10T08:40:22.327 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-02-10T08:40:22.327 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.328 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.328 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-02-10T08:40:22.328 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-02-10T08:40:22.328 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-02-10T08:40:22.328 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-02-10T08:40:22.329 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540138314316775423, 2024-02-10T08:40:22.329 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-02-10T08:40:22.329 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-02-10T08:39:14.477186+0000", 2024-02-10T08:40:22.329 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-02-10T08:40:22.329 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.329 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.329 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-02-10T08:40:22.330 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-02-10T08:40:22.330 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-02-10T08:40:22.330 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-02-10T08:40:22.330 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540138314316775423, 2024-02-10T08:40:22.330 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-02-10T08:40:22.330 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-02-10T08:40:05.298314+0000", 2024-02-10T08:40:22.331 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 87 2024-02-10T08:40:22.331 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.331 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.331 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-02-10T08:40:22.331 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-02-10T08:40:22.331 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-02-10T08:40:22.332 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-02-10T08:40:22.332 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540138314316775423, 2024-02-10T08:40:22.332 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-02-10T08:40:22.332 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-02-10T08:39:39.143156+0000", 2024-02-10T08:40:22.332 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-02-10T08:40:22.332 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.333 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.333 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-02-10T08:40:22.333 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-02-10T08:40:22.333 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-02-10T08:40:22.333 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-02-10T08:40:22.333 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540138314316775423, 2024-02-10T08:40:22.334 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-02-10T08:40:22.334 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-02-10T08:39:38.957957+0000", 2024-02-10T08:40:22.334 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-02-10T08:40:22.334 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.334 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.334 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-02-10T08:40:22.335 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-02-10T08:40:22.335 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-02-10T08:40:22.335 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-02-10T08:40:22.335 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540138314316775423, 2024-02-10T08:40:22.335 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 65536, 2024-02-10T08:40:22.335 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-02-10T08:39:50.434548+0000", 2024-02-10T08:40:22.336 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 432 2024-02-10T08:40:22.336 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:22.336 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-02-10T08:40:22.336 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap": [], 2024-02-10T08:40:22.336 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_items": [ 2024-02-10T08:40:22.336 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.337 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "4.d", 2024-02-10T08:40:22.337 INFO:teuthology.orchestra.run.smithi018.stdout: "mappings": [ 2024-02-10T08:40:22.337 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.337 INFO:teuthology.orchestra.run.smithi018.stdout: "from": 1, 2024-02-10T08:40:22.337 INFO:teuthology.orchestra.run.smithi018.stdout: "to": 5 2024-02-10T08:40:22.337 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:22.338 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:22.338 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.338 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.338 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "4.f", 2024-02-10T08:40:22.338 INFO:teuthology.orchestra.run.smithi018.stdout: "mappings": [ 2024-02-10T08:40:22.338 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.339 INFO:teuthology.orchestra.run.smithi018.stdout: "from": 1, 2024-02-10T08:40:22.339 INFO:teuthology.orchestra.run.smithi018.stdout: "to": 2 2024-02-10T08:40:22.339 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:22.339 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:22.339 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.339 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.339 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "4.12", 2024-02-10T08:40:22.340 INFO:teuthology.orchestra.run.smithi018.stdout: "mappings": [ 2024-02-10T08:40:22.340 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.340 INFO:teuthology.orchestra.run.smithi018.stdout: "from": 1, 2024-02-10T08:40:22.340 INFO:teuthology.orchestra.run.smithi018.stdout: "to": 0 2024-02-10T08:40:22.340 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:22.340 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:22.340 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.340 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.341 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "4.13", 2024-02-10T08:40:22.341 INFO:teuthology.orchestra.run.smithi018.stdout: "mappings": [ 2024-02-10T08:40:22.341 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.341 INFO:teuthology.orchestra.run.smithi018.stdout: "from": 1, 2024-02-10T08:40:22.341 INFO:teuthology.orchestra.run.smithi018.stdout: "to": 2 2024-02-10T08:40:22.341 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:22.341 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:22.341 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.341 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.342 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "5.1b", 2024-02-10T08:40:22.342 INFO:teuthology.orchestra.run.smithi018.stdout: "mappings": [ 2024-02-10T08:40:22.342 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.342 INFO:teuthology.orchestra.run.smithi018.stdout: "from": 0, 2024-02-10T08:40:22.342 INFO:teuthology.orchestra.run.smithi018.stdout: "to": 6 2024-02-10T08:40:22.342 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:22.342 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:22.342 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.342 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.342 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "6.0", 2024-02-10T08:40:22.342 INFO:teuthology.orchestra.run.smithi018.stdout: "mappings": [ 2024-02-10T08:40:22.342 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.342 INFO:teuthology.orchestra.run.smithi018.stdout: "from": 2, 2024-02-10T08:40:22.342 INFO:teuthology.orchestra.run.smithi018.stdout: "to": 1 2024-02-10T08:40:22.342 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:22.343 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:22.343 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.343 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.343 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "6.7", 2024-02-10T08:40:22.343 INFO:teuthology.orchestra.run.smithi018.stdout: "mappings": [ 2024-02-10T08:40:22.343 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.343 INFO:teuthology.orchestra.run.smithi018.stdout: "from": 5, 2024-02-10T08:40:22.343 INFO:teuthology.orchestra.run.smithi018.stdout: "to": 0 2024-02-10T08:40:22.343 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:22.343 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:22.343 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.343 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.343 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "6.8", 2024-02-10T08:40:22.343 INFO:teuthology.orchestra.run.smithi018.stdout: "mappings": [ 2024-02-10T08:40:22.343 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.344 INFO:teuthology.orchestra.run.smithi018.stdout: "from": 2, 2024-02-10T08:40:22.344 INFO:teuthology.orchestra.run.smithi018.stdout: "to": 4 2024-02-10T08:40:22.344 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:22.344 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:22.344 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.344 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.344 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "6.f", 2024-02-10T08:40:22.344 INFO:teuthology.orchestra.run.smithi018.stdout: "mappings": [ 2024-02-10T08:40:22.344 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.344 INFO:teuthology.orchestra.run.smithi018.stdout: "from": 2, 2024-02-10T08:40:22.344 INFO:teuthology.orchestra.run.smithi018.stdout: "to": 0 2024-02-10T08:40:22.344 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:22.344 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:22.344 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.344 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.345 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "6.14", 2024-02-10T08:40:22.345 INFO:teuthology.orchestra.run.smithi018.stdout: "mappings": [ 2024-02-10T08:40:22.345 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.345 INFO:teuthology.orchestra.run.smithi018.stdout: "from": 2, 2024-02-10T08:40:22.345 INFO:teuthology.orchestra.run.smithi018.stdout: "to": 0 2024-02-10T08:40:22.345 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:22.345 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:22.345 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.345 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.345 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "6.23", 2024-02-10T08:40:22.345 INFO:teuthology.orchestra.run.smithi018.stdout: "mappings": [ 2024-02-10T08:40:22.345 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.345 INFO:teuthology.orchestra.run.smithi018.stdout: "from": 6, 2024-02-10T08:40:22.345 INFO:teuthology.orchestra.run.smithi018.stdout: "to": 0 2024-02-10T08:40:22.345 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:22.346 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:22.346 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:22.346 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-02-10T08:40:22.346 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_temp": [ 2024-02-10T08:40:22.346 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.346 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "11.0", 2024-02-10T08:40:22.346 INFO:teuthology.orchestra.run.smithi018.stdout: "osds": [ 2024-02-10T08:40:22.346 INFO:teuthology.orchestra.run.smithi018.stdout: 1, 2024-02-10T08:40:22.346 INFO:teuthology.orchestra.run.smithi018.stdout: 3 2024-02-10T08:40:22.346 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:22.346 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.346 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.346 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "11.4", 2024-02-10T08:40:22.346 INFO:teuthology.orchestra.run.smithi018.stdout: "osds": [ 2024-02-10T08:40:22.346 INFO:teuthology.orchestra.run.smithi018.stdout: 6, 2024-02-10T08:40:22.346 INFO:teuthology.orchestra.run.smithi018.stdout: 2, 2024-02-10T08:40:22.347 INFO:teuthology.orchestra.run.smithi018.stdout: 7 2024-02-10T08:40:22.347 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:22.347 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.347 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.347 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "11.5", 2024-02-10T08:40:22.347 INFO:teuthology.orchestra.run.smithi018.stdout: "osds": [ 2024-02-10T08:40:22.347 INFO:teuthology.orchestra.run.smithi018.stdout: 5, 2024-02-10T08:40:22.347 INFO:teuthology.orchestra.run.smithi018.stdout: 6, 2024-02-10T08:40:22.347 INFO:teuthology.orchestra.run.smithi018.stdout: 7 2024-02-10T08:40:22.347 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:22.347 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.347 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.347 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "11.e", 2024-02-10T08:40:22.347 INFO:teuthology.orchestra.run.smithi018.stdout: "osds": [ 2024-02-10T08:40:22.347 INFO:teuthology.orchestra.run.smithi018.stdout: 4, 2024-02-10T08:40:22.348 INFO:teuthology.orchestra.run.smithi018.stdout: 1, 2024-02-10T08:40:22.348 INFO:teuthology.orchestra.run.smithi018.stdout: 7 2024-02-10T08:40:22.348 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:22.348 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.348 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:22.348 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "11.f", 2024-02-10T08:40:22.348 INFO:teuthology.orchestra.run.smithi018.stdout: "osds": [ 2024-02-10T08:40:22.348 INFO:teuthology.orchestra.run.smithi018.stdout: 1, 2024-02-10T08:40:22.348 INFO:teuthology.orchestra.run.smithi018.stdout: 2, 2024-02-10T08:40:22.348 INFO:teuthology.orchestra.run.smithi018.stdout: 7 2024-02-10T08:40:22.348 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:22.348 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:22.348 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-02-10T08:40:22.348 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_temp": [], 2024-02-10T08:40:22.349 INFO:teuthology.orchestra.run.smithi018.stdout: "blocklist": { 2024-02-10T08:40:22.349 INFO:teuthology.orchestra.run.smithi018.stdout: "172.21.15.18:6800/542054629": "2024-02-11T08:17:16.433947+0000", 2024-02-10T08:40:22.349 INFO:teuthology.orchestra.run.smithi018.stdout: "172.21.15.18:0/491217791": "2024-02-11T08:17:16.433947+0000", 2024-02-10T08:40:22.349 INFO:teuthology.orchestra.run.smithi018.stdout: "172.21.15.18:0/781076548": "2024-02-11T08:17:16.433947+0000", 2024-02-10T08:40:22.349 INFO:teuthology.orchestra.run.smithi018.stdout: "172.21.15.18:0/957318754": "2024-02-11T08:17:16.433947+0000", 2024-02-10T08:40:22.349 INFO:teuthology.orchestra.run.smithi018.stdout: "172.21.15.18:0/2662732452": "2024-02-11T08:11:55.105124+0000", 2024-02-10T08:40:22.349 INFO:teuthology.orchestra.run.smithi018.stdout: "172.21.15.18:0/1407788916": "2024-02-11T08:11:55.105124+0000", 2024-02-10T08:40:22.349 INFO:teuthology.orchestra.run.smithi018.stdout: "172.21.15.18:6800/3798687064": "2024-02-11T08:11:55.105124+0000", 2024-02-10T08:40:22.349 INFO:teuthology.orchestra.run.smithi018.stdout: "172.21.15.18:6800/3570839557": "2024-02-11T08:11:31.445897+0000", 2024-02-10T08:40:22.349 INFO:teuthology.orchestra.run.smithi018.stdout: "172.21.15.18:0/541168116": "2024-02-11T08:11:31.445897+0000", 2024-02-10T08:40:22.349 INFO:teuthology.orchestra.run.smithi018.stdout: "172.21.15.18:0/806236095": "2024-02-11T08:11:31.445897+0000" 2024-02-10T08:40:22.349 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.349 INFO:teuthology.orchestra.run.smithi018.stdout: "range_blocklist": {}, 2024-02-10T08:40:22.349 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profiles": { 2024-02-10T08:40:22.350 INFO:teuthology.orchestra.run.smithi018.stdout: "default": { 2024-02-10T08:40:22.350 INFO:teuthology.orchestra.run.smithi018.stdout: "crush-failure-domain": "osd", 2024-02-10T08:40:22.350 INFO:teuthology.orchestra.run.smithi018.stdout: "k": "2", 2024-02-10T08:40:22.350 INFO:teuthology.orchestra.run.smithi018.stdout: "m": "1", 2024-02-10T08:40:22.350 INFO:teuthology.orchestra.run.smithi018.stdout: "plugin": "jerasure", 2024-02-10T08:40:22.350 INFO:teuthology.orchestra.run.smithi018.stdout: "ruleset-failure-domain": "osd", 2024-02-10T08:40:22.350 INFO:teuthology.orchestra.run.smithi018.stdout: "technique": "reed_sol_van" 2024-02-10T08:40:22.350 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:22.350 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:22.350 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps_queue": [], 2024-02-10T08:40:22.350 INFO:teuthology.orchestra.run.smithi018.stdout: "new_removed_snaps": [], 2024-02-10T08:40:22.350 INFO:teuthology.orchestra.run.smithi018.stdout: "new_purged_snaps": [], 2024-02-10T08:40:22.350 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_node_flags": {}, 2024-02-10T08:40:22.350 INFO:teuthology.orchestra.run.smithi018.stdout: "device_class_flags": {}, 2024-02-10T08:40:22.350 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode": { 2024-02-10T08:40:22.350 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_enabled": false, 2024-02-10T08:40:22.351 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_bucket_count": 0, 2024-02-10T08:40:22.351 INFO:teuthology.orchestra.run.smithi018.stdout: "degraded_stretch_mode": 0, 2024-02-10T08:40:22.351 INFO:teuthology.orchestra.run.smithi018.stdout: "recovering_stretch_mode": 0, 2024-02-10T08:40:22.351 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_bucket": 0 2024-02-10T08:40:22.351 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:22.351 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-02-10T08:40:23.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:40:21.194996+0000 mgr.y (mgr.14505) 883 : cluster [DBG] pgmap v1082: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+remapped, 1 active+recovery_wait+degraded+remapped, 173 active+clean; 1.3 GiB data, 9.6 GiB used, 616 GiB / 626 GiB avail; 852 B/s rd, 0 B/s wr, 822 op/s; 2174/64236 objects degraded (3.384%); 0 B/s, 29 objects/s recovering 2024-02-10T08:40:23.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:40:22.228572+0000 mon.c (mon.2) 104 : audit [DBG] from='client.? 172.21.15.18:0/1707607701' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2024-02-10T08:40:23.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:40:21.194996+0000 mgr.y (mgr.14505) 883 : cluster [DBG] pgmap v1082: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+remapped, 1 active+recovery_wait+degraded+remapped, 173 active+clean; 1.3 GiB data, 9.6 GiB used, 616 GiB / 626 GiB avail; 852 B/s rd, 0 B/s wr, 822 op/s; 2174/64236 objects degraded (3.384%); 0 B/s, 29 objects/s recovering 2024-02-10T08:40:23.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:40:22.228572+0000 mon.c (mon.2) 104 : audit [DBG] from='client.? 172.21.15.18:0/1707607701' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2024-02-10T08:40:23.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:40:21.194996+0000 mgr.y (mgr.14505) 883 : cluster [DBG] pgmap v1082: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+remapped, 1 active+recovery_wait+degraded+remapped, 173 active+clean; 1.3 GiB data, 9.6 GiB used, 616 GiB / 626 GiB avail; 852 B/s rd, 0 B/s wr, 822 op/s; 2174/64236 objects degraded (3.384%); 0 B/s, 29 objects/s recovering 2024-02-10T08:40:23.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:40:22.228572+0000 mon.c (mon.2) 104 : audit [DBG] from='client.? 172.21.15.18:0/1707607701' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2024-02-10T08:40:24.044 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:40:22.390136+0000 osd.0 (osd.0) 280 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:40:24.044 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:40:22.390187+0000 osd.0 (osd.0) 281 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:40:24.044 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:40:23.104816+0000 mon.a (mon.0) 1842 : cluster [DBG] osdmap e452: 8 total, 8 up, 7 in 2024-02-10T08:40:24.054 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:40:22.390136+0000 osd.0 (osd.0) 280 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:40:24.054 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:40:22.390187+0000 osd.0 (osd.0) 281 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:40:24.054 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:40:23.104816+0000 mon.a (mon.0) 1842 : cluster [DBG] osdmap e452: 8 total, 8 up, 7 in 2024-02-10T08:40:24.054 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:40:22.390136+0000 osd.0 (osd.0) 280 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:40:24.054 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:40:22.390187+0000 osd.0 (osd.0) 281 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:40:24.054 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:40:23.104816+0000 mon.a (mon.0) 1842 : cluster [DBG] osdmap e452: 8 total, 8 up, 7 in 2024-02-10T08:40:24.437 INFO:tasks.thrashosds.thrasher:j is {'epoch': 451, 'fsid': 'd46257c8-c7eb-11ee-95b8-87774f69a715', 'created': '2024-02-10T08:10:57.425061+0000', 'modified': '2024-02-10T08:40:09.146286+0000', 'last_up_change': '2024-02-10T08:39:51.374098+0000', 'last_in_change': '2024-02-10T08:38:39.230106+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 20, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 11, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'pacific', 'pools': [{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-02-10T08:14:44.034966+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 11, 'pg_placement_num': 11, 'pg_placement_num_target': 11, 'pg_num_target': 11, 'pg_num_pending': 11, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '411', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '409', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': '.rgw.root', 'create_time': '2024-02-10T08:16:51.334631+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 3, 'pool_name': 'iscsi', 'create_time': '2024-02-10T08:16:51.762963+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 3, 'pg_placement_num': 3, 'pg_placement_num_target': 3, 'pg_num_target': 3, 'pg_num_pending': 3, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '424', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 4, 'pool_name': 'default.rgw.log', 'create_time': '2024-02-10T08:16:53.258098+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '205', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 5, 'pool_name': 'default.rgw.control', 'create_time': '2024-02-10T08:16:55.289300+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 6, 'pool_name': 'default.rgw.meta', 'create_time': '2024-02-10T08:16:57.354868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 52, 'pg_placement_num': 52, 'pg_placement_num_target': 52, 'pg_num_target': 52, 'pg_num_pending': 52, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '289', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '287', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4}, 'application_metadata': {'rgw': {}}}, {'pool': 11, 'pool_name': 'unique_pool_4', 'create_time': '2024-02-10T08:36:44.069268+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '401', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}], 'osds': [{'osd': 0, 'uuid': 'f9043fee-a3ed-4e16-921d-bb86756d0c48', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 428, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6801', 'nonce': 276034406}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6802', 'nonce': 276034406}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6804', 'nonce': 276034406}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6803', 'nonce': 276034406}]}, 'public_addr': '172.21.15.18:6801/276034406', 'cluster_addr': '172.21.15.18:6802/276034406', 'heartbeat_back_addr': '172.21.15.18:6804/276034406', 'heartbeat_front_addr': '172.21.15.18:6803/276034406', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'ff958272-ce6b-4162-959a-6da9729e537b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 448, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6805', 'nonce': 1941014296}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6806', 'nonce': 1941014296}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6808', 'nonce': 1941014296}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6807', 'nonce': 1941014296}]}, 'public_addr': '172.21.15.18:6805/1941014296', 'cluster_addr': '172.21.15.18:6806/1941014296', 'heartbeat_back_addr': '172.21.15.18:6808/1941014296', 'heartbeat_front_addr': '172.21.15.18:6807/1941014296', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '29bb47e2-5c81-4ae8-bb9f-d1b02ea01d3f', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 18, 'up_thru': 428, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6809', 'nonce': 3122474567}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6810', 'nonce': 3122474567}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6812', 'nonce': 3122474567}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6811', 'nonce': 3122474567}]}, 'public_addr': '172.21.15.18:6809/3122474567', 'cluster_addr': '172.21.15.18:6810/3122474567', 'heartbeat_back_addr': '172.21.15.18:6812/3122474567', 'heartbeat_front_addr': '172.21.15.18:6811/3122474567', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '87ad37de-5f49-4e5b-9683-3bb9c3e33907', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 25, 'up_thru': 175, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6813', 'nonce': 3484706437}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6814', 'nonce': 3484706437}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6816', 'nonce': 3484706437}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6815', 'nonce': 3484706437}]}, 'public_addr': '172.21.15.18:6813/3484706437', 'cluster_addr': '172.21.15.18:6814/3484706437', 'heartbeat_back_addr': '172.21.15.18:6816/3484706437', 'heartbeat_front_addr': '172.21.15.18:6815/3484706437', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': 'f5708f20-f98d-4d12-b8ae-71a5049a14cc', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 30, 'last_clean_end': 87, 'up_from': 110, 'up_thru': 447, 'down_at': 88, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6800', 'nonce': 3888817642}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6801', 'nonce': 3888817642}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6803', 'nonce': 3888817642}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6802', 'nonce': 3888817642}]}, 'public_addr': '172.21.15.71:6800/3888817642', 'cluster_addr': '172.21.15.71:6801/3888817642', 'heartbeat_back_addr': '172.21.15.71:6803/3888817642', 'heartbeat_front_addr': '172.21.15.71:6802/3888817642', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'e36a71dd-5088-4bff-965e-7dc8708ef7e3', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 37, 'up_thru': 447, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6804', 'nonce': 1932648316}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6805', 'nonce': 1932648316}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6807', 'nonce': 1932648316}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6806', 'nonce': 1932648316}]}, 'public_addr': '172.21.15.71:6804/1932648316', 'cluster_addr': '172.21.15.71:6805/1932648316', 'heartbeat_back_addr': '172.21.15.71:6807/1932648316', 'heartbeat_front_addr': '172.21.15.71:6806/1932648316', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '210a8790-78b6-4efa-a969-17efb17e9c0b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.66424560546875, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 43, 'up_thru': 447, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6808', 'nonce': 3724399458}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6809', 'nonce': 3724399458}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6811', 'nonce': 3724399458}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6810', 'nonce': 3724399458}]}, 'public_addr': '172.21.15.71:6808/3724399458', 'cluster_addr': '172.21.15.71:6809/3724399458', 'heartbeat_back_addr': '172.21.15.71:6811/3724399458', 'heartbeat_front_addr': '172.21.15.71:6810/3724399458', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '9778a0e9-2ff3-4700-bf2a-675edaba630b', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 50, 'last_clean_end': 432, 'up_from': 446, 'up_thru': 411, 'down_at': 433, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6812', 'nonce': 3959966129}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6813', 'nonce': 3959966129}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6815', 'nonce': 3959966129}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6814', 'nonce': 3959966129}]}, 'public_addr': '172.21.15.71:6812/3959966129', 'cluster_addr': '172.21.15.71:6813/3959966129', 'heartbeat_back_addr': '172.21.15.71:6815/3959966129', 'heartbeat_front_addr': '172.21.15.71:6814/3959966129', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-10T08:39:20.334921+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-10T08:40:04.746943+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-10T08:39:45.576150+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-10T08:39:14.477186+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-10T08:40:05.298314+0000', 'dead_epoch': 87}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-10T08:39:39.143156+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-10T08:39:38.957957+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-02-10T08:39:50.434548+0000', 'dead_epoch': 432}], 'pg_upmap': [], 'pg_upmap_items': [{'pgid': '4.d', 'mappings': [{'from': 1, 'to': 5}]}, {'pgid': '4.f', 'mappings': [{'from': 1, 'to': 2}]}, {'pgid': '4.12', 'mappings': [{'from': 1, 'to': 0}]}, {'pgid': '4.13', 'mappings': [{'from': 1, 'to': 2}]}, {'pgid': '5.1b', 'mappings': [{'from': 0, 'to': 6}]}, {'pgid': '6.0', 'mappings': [{'from': 2, 'to': 1}]}, {'pgid': '6.7', 'mappings': [{'from': 5, 'to': 0}]}, {'pgid': '6.8', 'mappings': [{'from': 2, 'to': 4}]}, {'pgid': '6.f', 'mappings': [{'from': 2, 'to': 0}]}, {'pgid': '6.14', 'mappings': [{'from': 2, 'to': 0}]}, {'pgid': '6.23', 'mappings': [{'from': 6, 'to': 0}]}], 'pg_temp': [{'pgid': '11.0', 'osds': [1, 3]}, {'pgid': '11.4', 'osds': [6, 2, 7]}, {'pgid': '11.5', 'osds': [5, 6, 7]}, {'pgid': '11.e', 'osds': [4, 1, 7]}, {'pgid': '11.f', 'osds': [1, 2, 7]}], 'primary_temp': [], 'blocklist': {'172.21.15.18:6800/542054629': '2024-02-11T08:17:16.433947+0000', '172.21.15.18:0/491217791': '2024-02-11T08:17:16.433947+0000', '172.21.15.18:0/781076548': '2024-02-11T08:17:16.433947+0000', '172.21.15.18:0/957318754': '2024-02-11T08:17:16.433947+0000', '172.21.15.18:0/2662732452': '2024-02-11T08:11:55.105124+0000', '172.21.15.18:0/1407788916': '2024-02-11T08:11:55.105124+0000', '172.21.15.18:6800/3798687064': '2024-02-11T08:11:55.105124+0000', '172.21.15.18:6800/3570839557': '2024-02-11T08:11:31.445897+0000', '172.21.15.18:0/541168116': '2024-02-11T08:11:31.445897+0000', '172.21.15.18:0/806236095': '2024-02-11T08:11:31.445897+0000'}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'ruleset-failure-domain': 'osd', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-02-10T08:40:24.437 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2024-02-10T08:40:24.759 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:40:23.195667+0000 mgr.y (mgr.14505) 884 : cluster [DBG] pgmap v1084: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+remapped, 1 active+recovery_wait+degraded+remapped, 173 active+clean; 1.1 GiB data, 9.0 GiB used, 617 GiB / 626 GiB avail; 921 B/s rd, 0 B/s wr, 949 op/s; 1932/52884 objects degraded (3.653%); 0 B/s, 34 objects/s recovering 2024-02-10T08:40:25.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:40:23.195667+0000 mgr.y (mgr.14505) 884 : cluster [DBG] pgmap v1084: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+remapped, 1 active+recovery_wait+degraded+remapped, 173 active+clean; 1.1 GiB data, 9.0 GiB used, 617 GiB / 626 GiB avail; 921 B/s rd, 0 B/s wr, 949 op/s; 1932/52884 objects degraded (3.653%); 0 B/s, 34 objects/s recovering 2024-02-10T08:40:25.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:40:23.195667+0000 mgr.y (mgr.14505) 884 : cluster [DBG] pgmap v1084: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+remapped, 1 active+recovery_wait+degraded+remapped, 173 active+clean; 1.1 GiB data, 9.0 GiB used, 617 GiB / 626 GiB avail; 921 B/s rd, 0 B/s wr, 949 op/s; 1932/52884 objects degraded (3.653%); 0 B/s, 34 objects/s recovering 2024-02-10T08:40:25.470 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:40:25.474 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:40:25.475 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:40:25.575 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:40:25.636 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:40:25.686 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:40:25.690 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:40:25.691 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:40:25.792 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:40:25.843 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:40:25.872 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-10T08:40:26.307 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:40:26.318 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:40:26.319 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:40:26.419 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:40:26.481 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:40:26.547 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:40:26.558 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:40:26.558 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:40:26.659 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:40:26.725 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:40:26.769 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:40:25.196355+0000 mgr.y (mgr.14505) 885 : cluster [DBG] pgmap v1085: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+remapped, 1 active+recovery_wait+degraded+remapped, 173 active+clean; 1.0 GiB data, 8.8 GiB used, 617 GiB / 626 GiB avail; 921 B/s rd, 0 B/s wr, 953 op/s; 1677/50151 objects degraded (3.344%); 0 B/s, 34 objects/s recovering 2024-02-10T08:40:26.770 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:40:26.077088+0000 mon.a (mon.0) 1843 : cluster [WRN] Health check update: Degraded data redundancy: 1677/50151 objects degraded (3.344%), 2 pgs degraded (PG_DEGRADED) 2024-02-10T08:40:26.771 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:40:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:40:26] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:40:27.147 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:40:25.196355+0000 mgr.y (mgr.14505) 885 : cluster [DBG] pgmap v1085: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+remapped, 1 active+recovery_wait+degraded+remapped, 173 active+clean; 1.0 GiB data, 8.8 GiB used, 617 GiB / 626 GiB avail; 921 B/s rd, 0 B/s wr, 953 op/s; 1677/50151 objects degraded (3.344%); 0 B/s, 34 objects/s recovering 2024-02-10T08:40:27.147 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:40:26.077088+0000 mon.a (mon.0) 1843 : cluster [WRN] Health check update: Degraded data redundancy: 1677/50151 objects degraded (3.344%), 2 pgs degraded (PG_DEGRADED) 2024-02-10T08:40:27.148 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:40:25.196355+0000 mgr.y (mgr.14505) 885 : cluster [DBG] pgmap v1085: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+remapped, 1 active+recovery_wait+degraded+remapped, 173 active+clean; 1.0 GiB data, 8.8 GiB used, 617 GiB / 626 GiB avail; 921 B/s rd, 0 B/s wr, 953 op/s; 1677/50151 objects degraded (3.344%); 0 B/s, 34 objects/s recovering 2024-02-10T08:40:27.148 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:40:26.077088+0000 mon.a (mon.0) 1843 : cluster [WRN] Health check update: Degraded data redundancy: 1677/50151 objects degraded (3.344%), 2 pgs degraded (PG_DEGRADED) 2024-02-10T08:40:27.404 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:40:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:40:27] "GET /metrics HTTP/1.1" 200 176536 "" "Prometheus/2.33.4" 2024-02-10T08:40:27.807 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is set 2024-02-10T08:40:27.823 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:40:27.830 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:40:27.830 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:40:27.931 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:40:27.968 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:40:28.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:40:27.015702+0000 mon.c (mon.2) 105 : audit [INF] from='client.? 172.21.15.18:0/2363006775' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:40:28.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:40:27.016213+0000 mon.a (mon.0) 1844 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:40:28.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:40:27.198806+0000 mgr.y (mgr.14505) 886 : cluster [DBG] pgmap v1086: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+remapped, 1 active+recovery_wait+degraded+remapped, 173 active+clean; 1.0 GiB data, 8.8 GiB used, 617 GiB / 626 GiB avail; 921 B/s rd, 0 B/s wr, 953 op/s; 1677/50151 objects degraded (3.344%); 0 B/s, 34 objects/s recovering 2024-02-10T08:40:28.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:40:27.015702+0000 mon.c (mon.2) 105 : audit [INF] from='client.? 172.21.15.18:0/2363006775' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:40:28.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:40:27.016213+0000 mon.a (mon.0) 1844 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:40:28.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:40:27.198806+0000 mgr.y (mgr.14505) 886 : cluster [DBG] pgmap v1086: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+remapped, 1 active+recovery_wait+degraded+remapped, 173 active+clean; 1.0 GiB data, 8.8 GiB used, 617 GiB / 626 GiB avail; 921 B/s rd, 0 B/s wr, 953 op/s; 1677/50151 objects degraded (3.344%); 0 B/s, 34 objects/s recovering 2024-02-10T08:40:28.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:40:27.015702+0000 mon.c (mon.2) 105 : audit [INF] from='client.? 172.21.15.18:0/2363006775' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:40:28.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:40:27.016213+0000 mon.a (mon.0) 1844 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-10T08:40:28.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:40:27.198806+0000 mgr.y (mgr.14505) 886 : cluster [DBG] pgmap v1086: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+remapped, 1 active+recovery_wait+degraded+remapped, 173 active+clean; 1.0 GiB data, 8.8 GiB used, 617 GiB / 626 GiB avail; 921 B/s rd, 0 B/s wr, 953 op/s; 1677/50151 objects degraded (3.344%); 0 B/s, 34 objects/s recovering 2024-02-10T08:40:29.045 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:40:27.766892+0000 mon.a (mon.0) 1845 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:40:29.045 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:40:27.770570+0000 mon.a (mon.0) 1846 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-10T08:40:29.045 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:40:27.770644+0000 mon.a (mon.0) 1847 : cluster [DBG] osdmap e453: 8 total, 8 up, 7 in 2024-02-10T08:40:29.158 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:40:27.766892+0000 mon.a (mon.0) 1845 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:40:29.158 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:40:27.770570+0000 mon.a (mon.0) 1846 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-10T08:40:29.158 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:40:27.770644+0000 mon.a (mon.0) 1847 : cluster [DBG] osdmap e453: 8 total, 8 up, 7 in 2024-02-10T08:40:29.158 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:40:27.766892+0000 mon.a (mon.0) 1845 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:40:29.158 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:40:27.770570+0000 mon.a (mon.0) 1846 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-10T08:40:29.159 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:40:27.770644+0000 mon.a (mon.0) 1847 : cluster [DBG] osdmap e453: 8 total, 8 up, 7 in 2024-02-10T08:40:29.438 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 3, 4, 5, 6, 0] out_osds: [7] dead_osds: [] live_osds: [0, 1, 2, 3, 5, 6, 4, 7] 2024-02-10T08:40:29.438 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-10T08:40:29.438 INFO:tasks.thrashosds.thrasher:Killing osd 4, live_osds are [0, 1, 2, 3, 5, 6, 4, 7] 2024-02-10T08:40:29.438 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-02-10T08:40:29.438 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ceph-d46257c8-c7eb-11ee-95b8-87774f69a715@osd.4 2024-02-10T08:40:29.479 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:40:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:40:29.790 INFO:journalctl@ceph.osd.4.smithi071.stdout:Feb 10 08:40:29 smithi071 systemd[1]: Stopping Ceph osd.4 for d46257c8-c7eb-11ee-95b8-87774f69a715... 2024-02-10T08:40:29.790 INFO:journalctl@ceph.osd.4.smithi071.stdout:Feb 10 08:40:29 smithi071 bash[128458]: Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:40:30.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:40:28.962485+0000 mon.a (mon.0) 1848 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:40:30.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:40:29.042691+0000 mgr.y (mgr.14505) 887 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:40:30.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:40:29.200891+0000 mgr.y (mgr.14505) 888 : cluster [DBG] pgmap v1088: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+remapped, 1 active+recovery_wait+degraded+remapped, 173 active+clean; 750 MiB data, 8.1 GiB used, 618 GiB / 626 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1.15k op/s; 1436/36573 objects degraded (3.926%); 0 B/s, 43 objects/s recovering 2024-02-10T08:40:30.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:40:28.962485+0000 mon.a (mon.0) 1848 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:40:30.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:40:29.042691+0000 mgr.y (mgr.14505) 887 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:40:30.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:40:29.200891+0000 mgr.y (mgr.14505) 888 : cluster [DBG] pgmap v1088: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+remapped, 1 active+recovery_wait+degraded+remapped, 173 active+clean; 750 MiB data, 8.1 GiB used, 618 GiB / 626 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1.15k op/s; 1436/36573 objects degraded (3.926%); 0 B/s, 43 objects/s recovering 2024-02-10T08:40:30.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:40:28.962485+0000 mon.a (mon.0) 1848 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:40:30.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:40:29.042691+0000 mgr.y (mgr.14505) 887 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:40:30.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:40:29.200891+0000 mgr.y (mgr.14505) 888 : cluster [DBG] pgmap v1088: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+remapped, 1 active+recovery_wait+degraded+remapped, 173 active+clean; 750 MiB data, 8.1 GiB used, 618 GiB / 626 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1.15k op/s; 1436/36573 objects degraded (3.926%); 0 B/s, 43 objects/s recovering 2024-02-10T08:40:30.570 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-02-10T08:40:30.570 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:40:30.850 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:40:30.851 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:40:30.853 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:40:30.854 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:40:30.955 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:40:31.054 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:40:31.090 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:40:31.095 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:40:31.096 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:40:31.197 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:40:31.236 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:40:31.380 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:40:31.084400+0000 mon.a (mon.0) 1849 : cluster [WRN] Health check update: Degraded data redundancy: 1436/36573 objects degraded (3.926%), 2 pgs degraded (PG_DEGRADED) 2024-02-10T08:40:31.380 INFO:journalctl@ceph.osd.4.smithi071.stdout:Feb 10 08:40:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-4[71322]: debug 2024-02-10T08:40:31.379+0000 7fc2c004c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-10T08:40:31.381 INFO:journalctl@ceph.osd.4.smithi071.stdout:Feb 10 08:40:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-4[71322]: debug 2024-02-10T08:40:31.379+0000 7fc2c004c700 -1 osd.4 453 *** Got signal Terminated *** 2024-02-10T08:40:31.381 INFO:journalctl@ceph.osd.4.smithi071.stdout:Feb 10 08:40:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-4[71322]: debug 2024-02-10T08:40:31.379+0000 7fc2c004c700 -1 osd.4 453 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-10T08:40:31.489 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:40:31.084400+0000 mon.a (mon.0) 1849 : cluster [WRN] Health check update: Degraded data redundancy: 1436/36573 objects degraded (3.926%), 2 pgs degraded (PG_DEGRADED) 2024-02-10T08:40:31.489 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:40:31.084400+0000 mon.a (mon.0) 1849 : cluster [WRN] Health check update: Degraded data redundancy: 1436/36573 objects degraded (3.926%), 2 pgs degraded (PG_DEGRADED) 2024-02-10T08:40:31.490 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:40:31.496 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:40:31.496 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:40:31.517 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.3 dump_blocked_ops 2024-02-10T08:40:31.597 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:40:31.668 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:40:31.813 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:40:31.817 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:40:31.818 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:40:31.918 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:40:31.989 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:40:32.484 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:40:31.201403+0000 mgr.y (mgr.14505) 889 : cluster [DBG] pgmap v1089: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+remapped, 1 active+recovery_wait+degraded+remapped, 173 active+clean; 731 MiB data, 8.0 GiB used, 618 GiB / 626 GiB avail; 632 B/s rd, 0 B/s wr, 923 op/s; 1177/35661 objects degraded (3.301%); 0 B/s, 28 objects/s recovering 2024-02-10T08:40:32.484 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:40:31.382686+0000 mon.a (mon.0) 1850 : cluster [INF] osd.4 marked itself down and dead 2024-02-10T08:40:32.484 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:40:31.717991+0000 mon.a (mon.0) 1851 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:40:32.484 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:40:31.201403+0000 mgr.y (mgr.14505) 889 : cluster [DBG] pgmap v1089: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+remapped, 1 active+recovery_wait+degraded+remapped, 173 active+clean; 731 MiB data, 8.0 GiB used, 618 GiB / 626 GiB avail; 632 B/s rd, 0 B/s wr, 923 op/s; 1177/35661 objects degraded (3.301%); 0 B/s, 28 objects/s recovering 2024-02-10T08:40:32.484 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:40:31.382686+0000 mon.a (mon.0) 1850 : cluster [INF] osd.4 marked itself down and dead 2024-02-10T08:40:32.484 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:40:31.717991+0000 mon.a (mon.0) 1851 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:40:32.490 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd set nodeep-scrub 2024-02-10T08:40:32.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:40:31.201403+0000 mgr.y (mgr.14505) 889 : cluster [DBG] pgmap v1089: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 3 active+recovering+remapped, 1 active+recovery_wait+degraded+remapped, 173 active+clean; 731 MiB data, 8.0 GiB used, 618 GiB / 626 GiB avail; 632 B/s rd, 0 B/s wr, 923 op/s; 1177/35661 objects degraded (3.301%); 0 B/s, 28 objects/s recovering 2024-02-10T08:40:32.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:40:31.382686+0000 mon.a (mon.0) 1850 : cluster [INF] osd.4 marked itself down and dead 2024-02-10T08:40:32.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:40:31.717991+0000 mon.a (mon.0) 1851 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:40:33.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:40:32.157748+0000 mon.a (mon.0) 1852 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-10T08:40:33.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:40:32.185103+0000 mon.a (mon.0) 1853 : cluster [DBG] osdmap e454: 8 total, 7 up, 7 in 2024-02-10T08:40:33.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:40:32.157748+0000 mon.a (mon.0) 1852 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-10T08:40:33.656 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:40:32.185103+0000 mon.a (mon.0) 1853 : cluster [DBG] osdmap e454: 8 total, 7 up, 7 in 2024-02-10T08:40:33.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:40:32.157748+0000 mon.a (mon.0) 1852 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-10T08:40:33.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:40:32.185103+0000 mon.a (mon.0) 1853 : cluster [DBG] osdmap e454: 8 total, 7 up, 7 in 2024-02-10T08:40:34.423 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:40:34.426 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:40:34.426 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:40:34.455 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:40:34.528 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:40:34.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:40:33.185447+0000 mon.a (mon.0) 1854 : cluster [DBG] osdmap e455: 8 total, 7 up, 7 in 2024-02-10T08:40:34.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:40:33.187154+0000 osd.1 (osd.1) 318 : cluster [INF] 11.e continuing backfill to osd.0 from (436'9955,453'14177] 11:72abf0c3:::benchmark_data_smithi018_166993_object110278:head to 453'14177 2024-02-10T08:40:34.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:40:33.202108+0000 mgr.y (mgr.14505) 890 : cluster [DBG] pgmap v1092: 178 pgs: 1 remapped+peering, 1 active+undersized+degraded+remapped+backfill_toofull, 55 peering, 4 stale+active+clean, 3 active+recovering+remapped, 114 active+clean; 532 MiB data, 7.4 GiB used, 618 GiB / 626 GiB avail; 341 B/s rd, 0 B/s wr, 1.33k op/s; 412/26115 objects degraded (1.578%); 0 B/s, 57 objects/s recovering 2024-02-10T08:40:34.564 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:40:33.185447+0000 mon.a (mon.0) 1854 : cluster [DBG] osdmap e455: 8 total, 7 up, 7 in 2024-02-10T08:40:34.564 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:40:33.187154+0000 osd.1 (osd.1) 318 : cluster [INF] 11.e continuing backfill to osd.0 from (436'9955,453'14177] 11:72abf0c3:::benchmark_data_smithi018_166993_object110278:head to 453'14177 2024-02-10T08:40:34.565 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:40:33.202108+0000 mgr.y (mgr.14505) 890 : cluster [DBG] pgmap v1092: 178 pgs: 1 remapped+peering, 1 active+undersized+degraded+remapped+backfill_toofull, 55 peering, 4 stale+active+clean, 3 active+recovering+remapped, 114 active+clean; 532 MiB data, 7.4 GiB used, 618 GiB / 626 GiB avail; 341 B/s rd, 0 B/s wr, 1.33k op/s; 412/26115 objects degraded (1.578%); 0 B/s, 57 objects/s recovering 2024-02-10T08:40:34.565 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:40:33.185447+0000 mon.a (mon.0) 1854 : cluster [DBG] osdmap e455: 8 total, 7 up, 7 in 2024-02-10T08:40:34.565 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:40:33.187154+0000 osd.1 (osd.1) 318 : cluster [INF] 11.e continuing backfill to osd.0 from (436'9955,453'14177] 11:72abf0c3:::benchmark_data_smithi018_166993_object110278:head to 453'14177 2024-02-10T08:40:34.565 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:40:33.202108+0000 mgr.y (mgr.14505) 890 : cluster [DBG] pgmap v1092: 178 pgs: 1 remapped+peering, 1 active+undersized+degraded+remapped+backfill_toofull, 55 peering, 4 stale+active+clean, 3 active+recovering+remapped, 114 active+clean; 532 MiB data, 7.4 GiB used, 618 GiB / 626 GiB avail; 341 B/s rd, 0 B/s wr, 1.33k op/s; 412/26115 objects degraded (1.578%); 0 B/s, 57 objects/s recovering 2024-02-10T08:40:34.575 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:40:35.039 INFO:journalctl@ceph.osd.4.smithi071.stdout:Feb 10 08:40:34 smithi071 bash[128485]: ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-4 2024-02-10T08:40:35.407 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:40:34.182794+0000 mon.a (mon.0) 1855 : cluster [WRN] Health check failed: Reduced data availability: 18 pgs inactive, 27 pgs peering (PG_AVAILABILITY) 2024-02-10T08:40:35.407 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:40:34.182794+0000 mon.a (mon.0) 1855 : cluster [WRN] Health check failed: Reduced data availability: 18 pgs inactive, 27 pgs peering (PG_AVAILABILITY) 2024-02-10T08:40:35.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:40:34.182794+0000 mon.a (mon.0) 1855 : cluster [WRN] Health check failed: Reduced data availability: 18 pgs inactive, 27 pgs peering (PG_AVAILABILITY) 2024-02-10T08:40:35.654 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:40:35.663 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:40:35.664 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:40:35.664 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:40:35.765 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:40:35.846 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:40:36.227 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:40:36.244 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:40:36.244 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:40:36.272 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:40:35.204252+0000 mgr.y (mgr.14505) 891 : cluster [DBG] pgmap v1093: 178 pgs: 3 active+undersized+degraded, 13 active+undersized, 1 remapped+peering, 1 active+undersized+degraded+remapped+backfill_toofull, 55 peering, 3 active+recovering+remapped, 102 active+clean; 503 MiB data, 7.3 GiB used, 618 GiB / 626 GiB avail; 137 B/s rd, 0 B/s wr, 1.14k op/s; 422/24741 objects degraded (1.706%); 0 B/s, 46 objects/s recovering 2024-02-10T08:40:36.272 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:40:36.085970+0000 mon.a (mon.0) 1856 : cluster [WRN] Health check update: Degraded data redundancy: 422/24741 objects degraded (1.706%), 4 pgs degraded (PG_DEGRADED) 2024-02-10T08:40:36.345 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:40:36.430 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:40:36.540 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:40:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:40:36] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:40:36.642 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:40:35.204252+0000 mgr.y (mgr.14505) 891 : cluster [DBG] pgmap v1093: 178 pgs: 3 active+undersized+degraded, 13 active+undersized, 1 remapped+peering, 1 active+undersized+degraded+remapped+backfill_toofull, 55 peering, 3 active+recovering+remapped, 102 active+clean; 503 MiB data, 7.3 GiB used, 618 GiB / 626 GiB avail; 137 B/s rd, 0 B/s wr, 1.14k op/s; 422/24741 objects degraded (1.706%); 0 B/s, 46 objects/s recovering 2024-02-10T08:40:36.642 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:40:36.085970+0000 mon.a (mon.0) 1856 : cluster [WRN] Health check update: Degraded data redundancy: 422/24741 objects degraded (1.706%), 4 pgs degraded (PG_DEGRADED) 2024-02-10T08:40:36.643 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:40:35.204252+0000 mgr.y (mgr.14505) 891 : cluster [DBG] pgmap v1093: 178 pgs: 3 active+undersized+degraded, 13 active+undersized, 1 remapped+peering, 1 active+undersized+degraded+remapped+backfill_toofull, 55 peering, 3 active+recovering+remapped, 102 active+clean; 503 MiB data, 7.3 GiB used, 618 GiB / 626 GiB avail; 137 B/s rd, 0 B/s wr, 1.14k op/s; 422/24741 objects degraded (1.706%); 0 B/s, 46 objects/s recovering 2024-02-10T08:40:36.643 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:40:36.085970+0000 mon.a (mon.0) 1856 : cluster [WRN] Health check update: Degraded data redundancy: 422/24741 objects degraded (1.706%), 4 pgs degraded (PG_DEGRADED) 2024-02-10T08:40:37.071 DEBUG:teuthology.orchestra.run.smithi071:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d46257c8-c7eb-11ee-95b8-87774f69a715@osd.4.service' 2024-02-10T08:40:37.135 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-10T08:40:37.135 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-02-10T08:40:37.135 INFO:tasks.thrashosds.thrasher:Testing ceph-objectstore-tool on down osd.4 2024-02-10T08:40:37.135 INFO:tasks.thrashosds.thrasher:remote for osd 4 is ubuntu@smithi071.front.sepia.ceph.com 2024-02-10T08:40:37.135 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -n osd.4 --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph-objectstore-tool --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-4 --journal-path /var/lib/ceph/osd/ceph-4/journal --op list-pgs 2024-02-10T08:40:37.249 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:40:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:40:37] "GET /metrics HTTP/1.1" 200 176546 "" "Prometheus/2.33.4" 2024-02-10T08:40:37.436 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/osd.4/config 2024-02-10T08:40:38.162 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:40:38.196 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:40:38.244 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:40:38.286 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:40:38.354 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:40:38.400 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:40:38.459 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:40:38.459 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-10T08:40:38.459 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-10T08:40:38.459 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-10T08:40:38.459 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-10T08:40:38.459 INFO:teuthology.orchestra.run.smithi018.stderr:Error ENXIO: problem getting command descriptions from osd.4 2024-02-10T08:40:38.460 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-10T08:40:38.460 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-10T08:40:38.460 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-10T08:40:38.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:40:37.205031+0000 mgr.y (mgr.14505) 892 : cluster [DBG] pgmap v1094: 178 pgs: 3 active+undersized+degraded, 13 active+undersized, 1 remapped+peering, 1 active+undersized+degraded+remapped+backfill_toofull, 55 peering, 3 active+recovering+remapped, 102 active+clean; 503 MiB data, 7.3 GiB used, 618 GiB / 626 GiB avail; 0 B/s wr, 492 op/s; 422/24741 objects degraded (1.706%); 0 B/s, 21 objects/s recovering 2024-02-10T08:40:38.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:40:38.110888+0000 mon.a (mon.0) 1857 : audit [DBG] from='client.? 172.21.15.18:0/1663196158' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:40:38.662 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:40:37.205031+0000 mgr.y (mgr.14505) 892 : cluster [DBG] pgmap v1094: 178 pgs: 3 active+undersized+degraded, 13 active+undersized, 1 remapped+peering, 1 active+undersized+degraded+remapped+backfill_toofull, 55 peering, 3 active+recovering+remapped, 102 active+clean; 503 MiB data, 7.3 GiB used, 618 GiB / 626 GiB avail; 0 B/s wr, 492 op/s; 422/24741 objects degraded (1.706%); 0 B/s, 21 objects/s recovering 2024-02-10T08:40:38.662 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:40:38.110888+0000 mon.a (mon.0) 1857 : audit [DBG] from='client.? 172.21.15.18:0/1663196158' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:40:38.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:40:37.205031+0000 mgr.y (mgr.14505) 892 : cluster [DBG] pgmap v1094: 178 pgs: 3 active+undersized+degraded, 13 active+undersized, 1 remapped+peering, 1 active+undersized+degraded+remapped+backfill_toofull, 55 peering, 3 active+recovering+remapped, 102 active+clean; 503 MiB data, 7.3 GiB used, 618 GiB / 626 GiB avail; 0 B/s wr, 492 op/s; 422/24741 objects degraded (1.706%); 0 B/s, 21 objects/s recovering 2024-02-10T08:40:38.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:40:38.110888+0000 mon.a (mon.0) 1857 : audit [DBG] from='client.? 172.21.15.18:0/1663196158' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:40:39.223 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:40:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:40:39.542 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:40:38.145438+0000 osd.3 (osd.3) 119 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:40:39.543 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:40:38.145496+0000 osd.3 (osd.3) 120 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:40:39.543 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:40:38.312634+0000 mon.a (mon.0) 1858 : cluster [DBG] osdmap e456: 8 total, 7 up, 7 in 2024-02-10T08:40:39.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:40:38.145438+0000 osd.3 (osd.3) 119 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:40:39.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:40:38.145496+0000 osd.3 (osd.3) 120 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:40:39.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:40:38.312634+0000 mon.a (mon.0) 1858 : cluster [DBG] osdmap e456: 8 total, 7 up, 7 in 2024-02-10T08:40:39.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:40:38.145438+0000 osd.3 (osd.3) 119 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:40:39.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:40:38.145496+0000 osd.3 (osd.3) 120 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:40:39.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:40:38.312634+0000 mon.a (mon.0) 1858 : cluster [DBG] osdmap e456: 8 total, 7 up, 7 in 2024-02-10T08:40:39.677 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:40:39.683 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:40:39.684 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:40:39.784 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:40:39.853 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:40:39.899 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:40:39.908 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:40:39.909 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:40:40.009 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:40:40.065 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:40:40.095 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:40:40.098 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:40:40.099 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:40:40.199 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:40:40.247 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:40:40.279 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:40:40.291 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:40:40.291 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:40:40.392 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:40:40.444 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:40:39.056903+0000 mgr.y (mgr.14505) 893 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:40:40.444 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:40:39.205767+0000 mgr.y (mgr.14505) 894 : cluster [DBG] pgmap v1096: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 1 active+recovering+undersized+degraded+remapped, 23 active+undersized+degraded, 48 active+undersized, 2 active+recovering+remapped, 1 active+recovery_wait+degraded+remapped, 102 active+clean; 229 MiB data, 6.8 GiB used, 619 GiB / 626 GiB avail; 145 B/s rd, 0 B/s wr, 1.14k op/s; 1396/11556 objects degraded (12.080%); 0 B/s, 48 objects/s recovering 2024-02-10T08:40:40.444 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:40:39.310179+0000 mon.a (mon.0) 1859 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 18 pgs inactive, 27 pgs peering) 2024-02-10T08:40:40.451 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:40:40.490 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:40:40.494 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:40:40.494 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:40:40.595 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:40:40.604 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:40:39.056903+0000 mgr.y (mgr.14505) 893 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:40:40.604 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:40:39.205767+0000 mgr.y (mgr.14505) 894 : cluster [DBG] pgmap v1096: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 1 active+recovering+undersized+degraded+remapped, 23 active+undersized+degraded, 48 active+undersized, 2 active+recovering+remapped, 1 active+recovery_wait+degraded+remapped, 102 active+clean; 229 MiB data, 6.8 GiB used, 619 GiB / 626 GiB avail; 145 B/s rd, 0 B/s wr, 1.14k op/s; 1396/11556 objects degraded (12.080%); 0 B/s, 48 objects/s recovering 2024-02-10T08:40:40.604 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:40:39.310179+0000 mon.a (mon.0) 1859 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 18 pgs inactive, 27 pgs peering) 2024-02-10T08:40:40.604 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:40:39.056903+0000 mgr.y (mgr.14505) 893 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:40:40.605 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:40:39.205767+0000 mgr.y (mgr.14505) 894 : cluster [DBG] pgmap v1096: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 1 active+recovering+undersized+degraded+remapped, 23 active+undersized+degraded, 48 active+undersized, 2 active+recovering+remapped, 1 active+recovery_wait+degraded+remapped, 102 active+clean; 229 MiB data, 6.8 GiB used, 619 GiB / 626 GiB avail; 145 B/s rd, 0 B/s wr, 1.14k op/s; 1396/11556 objects degraded (12.080%); 0 B/s, 48 objects/s recovering 2024-02-10T08:40:40.605 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:40:39.310179+0000 mon.a (mon.0) 1859 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 18 pgs inactive, 27 pgs peering) 2024-02-10T08:40:40.697 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:40:41.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:40:41.087073+0000 mon.a (mon.0) 1860 : cluster [WRN] Health check update: Degraded data redundancy: 1396/11556 objects degraded (12.080%), 26 pgs degraded (PG_DEGRADED) 2024-02-10T08:40:41.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:40:41.087073+0000 mon.a (mon.0) 1860 : cluster [WRN] Health check update: Degraded data redundancy: 1396/11556 objects degraded (12.080%), 26 pgs degraded (PG_DEGRADED) 2024-02-10T08:40:41.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:41 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:40:41.087073+0000 mon.a (mon.0) 1860 : cluster [WRN] Health check update: Degraded data redundancy: 1396/11556 objects degraded (12.080%), 26 pgs degraded (PG_DEGRADED) 2024-02-10T08:40:42.203 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Removed 119122 objects 2024-02-10T08:40:42.203 INFO:tasks.radosbench.radosbench.0.smithi018.stdout:Clean up completed and total clean up time :134.654 2024-02-10T08:40:42.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:40:41.206361+0000 mgr.y (mgr.14505) 895 : cluster [DBG] pgmap v1097: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 1 active+recovering+undersized+degraded+remapped, 23 active+undersized+degraded, 48 active+undersized, 2 active+recovering+remapped, 1 active+recovery_wait+degraded+remapped, 102 active+clean; 229 MiB data, 6.8 GiB used, 619 GiB / 626 GiB avail; 510 B/s rd, 0 B/s wr, 605 op/s; 1396/11556 objects degraded (12.080%); 0 B/s, 21 objects/s recovering 2024-02-10T08:40:42.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:40:41.206361+0000 mgr.y (mgr.14505) 895 : cluster [DBG] pgmap v1097: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 1 active+recovering+undersized+degraded+remapped, 23 active+undersized+degraded, 48 active+undersized, 2 active+recovering+remapped, 1 active+recovery_wait+degraded+remapped, 102 active+clean; 229 MiB data, 6.8 GiB used, 619 GiB / 626 GiB avail; 510 B/s rd, 0 B/s wr, 605 op/s; 1396/11556 objects degraded (12.080%); 0 B/s, 21 objects/s recovering 2024-02-10T08:40:42.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:40:41.206361+0000 mgr.y (mgr.14505) 895 : cluster [DBG] pgmap v1097: 178 pgs: 1 active+undersized+degraded+remapped+backfill_toofull, 1 active+recovering+undersized+degraded+remapped, 23 active+undersized+degraded, 48 active+undersized, 2 active+recovering+remapped, 1 active+recovery_wait+degraded+remapped, 102 active+clean; 229 MiB data, 6.8 GiB used, 619 GiB / 626 GiB avail; 510 B/s rd, 0 B/s wr, 605 op/s; 1396/11556 objects degraded (12.080%); 0 B/s, 21 objects/s recovering 2024-02-10T08:40:43.119 INFO:tasks.cephadm.ceph_manager.ceph:removing pool_name unique_pool_4 2024-02-10T08:40:43.120 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd pool rm unique_pool_4 unique_pool_4 --yes-i-really-really-mean-it 2024-02-10T08:40:43.166 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:40:43.169 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:40:43.170 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:40:43.271 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3 2024-02-10T08:40:43.301 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:40:43.435 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:40:43.439 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:40:43.440 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3' 2024-02-10T08:40:43.540 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:40:43.541 INFO:teuthology.orchestra.run.smithi071.stdout:6.6 2024-02-10T08:40:43.541 INFO:teuthology.orchestra.run.smithi071.stdout:6.2e 2024-02-10T08:40:43.542 INFO:teuthology.orchestra.run.smithi071.stdout:6.e 2024-02-10T08:40:43.542 INFO:teuthology.orchestra.run.smithi071.stdout:6.23 2024-02-10T08:40:43.542 INFO:teuthology.orchestra.run.smithi071.stdout:6.1e 2024-02-10T08:40:43.542 INFO:teuthology.orchestra.run.smithi071.stdout:6.1d 2024-02-10T08:40:43.542 INFO:teuthology.orchestra.run.smithi071.stdout:6.16 2024-02-10T08:40:43.542 INFO:teuthology.orchestra.run.smithi071.stdout:6.21 2024-02-10T08:40:43.542 INFO:teuthology.orchestra.run.smithi071.stdout:6.15 2024-02-10T08:40:43.542 INFO:teuthology.orchestra.run.smithi071.stdout:6.12 2024-02-10T08:40:43.542 INFO:teuthology.orchestra.run.smithi071.stdout:5.9 2024-02-10T08:40:43.542 INFO:teuthology.orchestra.run.smithi071.stdout:6.f 2024-02-10T08:40:43.542 INFO:teuthology.orchestra.run.smithi071.stdout:6.2 2024-02-10T08:40:43.542 INFO:teuthology.orchestra.run.smithi071.stdout:5.1d 2024-02-10T08:40:43.542 INFO:teuthology.orchestra.run.smithi071.stdout:5.1c 2024-02-10T08:40:43.542 INFO:teuthology.orchestra.run.smithi071.stdout:5.1b 2024-02-10T08:40:43.542 INFO:teuthology.orchestra.run.smithi071.stdout:6.8 2024-02-10T08:40:43.543 INFO:teuthology.orchestra.run.smithi071.stdout:5.1a 2024-02-10T08:40:43.543 INFO:teuthology.orchestra.run.smithi071.stdout:5.1 2024-02-10T08:40:43.543 INFO:teuthology.orchestra.run.smithi071.stdout:5.18 2024-02-10T08:40:43.543 INFO:teuthology.orchestra.run.smithi071.stdout:5.11 2024-02-10T08:40:43.543 INFO:teuthology.orchestra.run.smithi071.stdout:5.5 2024-02-10T08:40:43.543 INFO:teuthology.orchestra.run.smithi071.stdout:2.8 2024-02-10T08:40:43.543 INFO:teuthology.orchestra.run.smithi071.stdout:5.a 2024-02-10T08:40:43.543 INFO:teuthology.orchestra.run.smithi071.stdout:2.6 2024-02-10T08:40:43.543 INFO:teuthology.orchestra.run.smithi071.stdout:5.e 2024-02-10T08:40:43.543 INFO:teuthology.orchestra.run.smithi071.stdout:11.d 2024-02-10T08:40:43.543 INFO:teuthology.orchestra.run.smithi071.stdout:2.5 2024-02-10T08:40:43.543 INFO:teuthology.orchestra.run.smithi071.stdout:2.1f 2024-02-10T08:40:43.543 INFO:teuthology.orchestra.run.smithi071.stdout:5.f 2024-02-10T08:40:43.543 INFO:teuthology.orchestra.run.smithi071.stdout:2.1b 2024-02-10T08:40:43.543 INFO:teuthology.orchestra.run.smithi071.stdout:6.7 2024-02-10T08:40:43.543 INFO:teuthology.orchestra.run.smithi071.stdout:1.3 2024-02-10T08:40:43.544 INFO:teuthology.orchestra.run.smithi071.stdout:2.b 2024-02-10T08:40:43.544 INFO:teuthology.orchestra.run.smithi071.stdout:5.10 2024-02-10T08:40:43.544 INFO:teuthology.orchestra.run.smithi071.stdout:4.c 2024-02-10T08:40:43.544 INFO:teuthology.orchestra.run.smithi071.stdout:6.2a 2024-02-10T08:40:43.544 INFO:teuthology.orchestra.run.smithi071.stdout:2.13 2024-02-10T08:40:43.544 INFO:teuthology.orchestra.run.smithi071.stdout:6.2c 2024-02-10T08:40:43.544 INFO:teuthology.orchestra.run.smithi071.stdout:11.e 2024-02-10T08:40:43.544 INFO:teuthology.orchestra.run.smithi071.stdout:4.1a 2024-02-10T08:40:43.544 INFO:teuthology.orchestra.run.smithi071.stdout:5.6 2024-02-10T08:40:43.544 INFO:teuthology.orchestra.run.smithi071.stdout:4.2 2024-02-10T08:40:43.544 INFO:teuthology.orchestra.run.smithi071.stdout:6.1a 2024-02-10T08:40:43.544 INFO:teuthology.orchestra.run.smithi071.stdout:2.18 2024-02-10T08:40:43.544 INFO:teuthology.orchestra.run.smithi071.stdout:5.c 2024-02-10T08:40:43.544 INFO:teuthology.orchestra.run.smithi071.stdout:4.8 2024-02-10T08:40:43.545 INFO:teuthology.orchestra.run.smithi071.stdout:2.d 2024-02-10T08:40:43.545 INFO:teuthology.orchestra.run.smithi071.stdout:1.5 2024-02-10T08:40:43.545 INFO:teuthology.orchestra.run.smithi071.stdout:4.f 2024-02-10T08:40:43.545 INFO:teuthology.orchestra.run.smithi071.stdout:2.f 2024-02-10T08:40:43.545 INFO:teuthology.orchestra.run.smithi071.stdout:6.32 2024-02-10T08:40:43.545 INFO:teuthology.orchestra.run.smithi071.stdout:11.7 2024-02-10T08:40:43.545 INFO:teuthology.orchestra.run.smithi071.stdout:4.13 2024-02-10T08:40:43.545 INFO:teuthology.orchestra.run.smithi071.stdout:3.1 2024-02-10T08:40:43.545 INFO:teuthology.orchestra.run.smithi071.stdout:4.e 2024-02-10T08:40:43.545 INFO:teuthology.orchestra.run.smithi071.stdout:6.14 2024-02-10T08:40:43.545 INFO:teuthology.orchestra.run.smithi071.stdout:1.2 2024-02-10T08:40:43.545 INFO:teuthology.orchestra.run.smithi071.stdout:4.18 2024-02-10T08:40:43.545 INFO:teuthology.orchestra.run.smithi071.stdout:6.17 2024-02-10T08:40:43.545 INFO:teuthology.orchestra.run.smithi071.stdout:5.1f 2024-02-10T08:40:43.545 INFO:teuthology.orchestra.run.smithi071.stdout:4.5 2024-02-10T08:40:43.546 INFO:teuthology.orchestra.run.smithi071.stdout:4.1b 2024-02-10T08:40:43.546 INFO:teuthology.orchestra.run.smithi071.stdout:11.c 2024-02-10T08:40:43.546 INFO:teuthology.orchestra.run.smithi071.stdout:4.1d 2024-02-10T08:40:43.546 INFO:teuthology.orchestra.run.smithi071.stdout:4.9 2024-02-10T08:40:43.546 INFO:teuthology.orchestra.run.smithi071.stdout:2.11 2024-02-10T08:40:43.546 INFO:teuthology.orchestra.run.smithi071.stdout:4.1 2024-02-10T08:40:43.546 INFO:teuthology.orchestra.run.smithi071.stdout:4.b 2024-02-10T08:40:43.546 INFO:teuthology.orchestra.run.smithi071.stdout:4.d 2024-02-10T08:40:43.546 INFO:teuthology.orchestra.run.smithi071.stdout:2.1a 2024-02-10T08:40:43.546 INFO:teuthology.orchestra.run.smithi071.stdout:5.0 2024-02-10T08:40:43.573 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:40:43.595 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:40:43.598 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:40:43.598 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:40:43.639 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-02-10T08:40:43.639 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-02-10T08:40:43.700 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:40:43.726 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:40:43.744 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:40:43.747 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:40:43.747 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:40:43.848 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:40:43.876 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:40:43.899 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:40:43.902 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:40:43.903 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:40:44.003 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:40:44.032 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:40:44.108 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:40:44.111 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:40:44.111 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:40:44.212 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:40:44.238 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-02-10T08:40:44.238 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-02-10T08:40:44.238 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-02-10T08:40:44.238 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-02-10T08:40:44.238 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-02-10T08:40:44.241 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:40:44.266 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:40:44.272 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:40:44.273 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:40:44.282 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:40:44.373 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:40:44.402 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:44 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:40:43.207381+0000 mgr.y (mgr.14505) 896 : cluster [DBG] pgmap v1098: 178 pgs: 1 active+undersized+remapped+backfill_toofull, 22 active+undersized+degraded, 1 active+recovering+undersized+remapped, 49 active+undersized, 2 active+recovering+remapped, 1 active+recovery_wait+degraded+remapped, 102 active+clean; 28 MiB data, 6.2 GiB used, 620 GiB / 626 GiB avail; 921 B/s rd, 0 B/s wr, 806 op/s; 86/1932 objects degraded (4.451%); 0 B/s, 34 objects/s recovering 2024-02-10T08:40:44.402 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:44 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:40:43.661004+0000 mon.a (mon.0) 1861 : audit [INF] from='client.? 172.21.15.18:0/746077143' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:40:44.415 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:40:44.429 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is set 2024-02-10T08:40:44.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:40:43.207381+0000 mgr.y (mgr.14505) 896 : cluster [DBG] pgmap v1098: 178 pgs: 1 active+undersized+remapped+backfill_toofull, 22 active+undersized+degraded, 1 active+recovering+undersized+remapped, 49 active+undersized, 2 active+recovering+remapped, 1 active+recovery_wait+degraded+remapped, 102 active+clean; 28 MiB data, 6.2 GiB used, 620 GiB / 626 GiB avail; 921 B/s rd, 0 B/s wr, 806 op/s; 86/1932 objects degraded (4.451%); 0 B/s, 34 objects/s recovering 2024-02-10T08:40:44.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:40:43.661004+0000 mon.a (mon.0) 1861 : audit [INF] from='client.? 172.21.15.18:0/746077143' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:40:44.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:40:43.207381+0000 mgr.y (mgr.14505) 896 : cluster [DBG] pgmap v1098: 178 pgs: 1 active+undersized+remapped+backfill_toofull, 22 active+undersized+degraded, 1 active+recovering+undersized+remapped, 49 active+undersized, 2 active+recovering+remapped, 1 active+recovery_wait+degraded+remapped, 102 active+clean; 28 MiB data, 6.2 GiB used, 620 GiB / 626 GiB avail; 921 B/s rd, 0 B/s wr, 806 op/s; 86/1932 objects degraded (4.451%); 0 B/s, 34 objects/s recovering 2024-02-10T08:40:44.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:40:43.661004+0000 mon.a (mon.0) 1861 : audit [INF] from='client.? 172.21.15.18:0/746077143' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:40:44.729 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -n osd.4 --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph-objectstore-tool --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-4 --journal-path /var/lib/ceph/osd/ceph-4/journal --op export --pgid 1.2 --file /var/log/ceph/exp.1.2.4 2024-02-10T08:40:44.773 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:40:44.777 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:40:44.777 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:40:44.878 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:40:44.904 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:40:44.924 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:40:44.927 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:40:44.928 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:40:44.981 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/osd.4/config 2024-02-10T08:40:45.029 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:40:45.054 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:40:45.302 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:40:45.304 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:40:45.305 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:40:45.342 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:40:44.339710+0000 mon.a (mon.0) 1862 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:40:45.342 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:40:44.346740+0000 mon.a (mon.0) 1863 : audit [INF] from='client.? 172.21.15.18:0/746077143' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-10T08:40:45.342 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:40:44.346798+0000 mon.a (mon.0) 1864 : cluster [DBG] osdmap e457: 8 total, 7 up, 7 in 2024-02-10T08:40:45.342 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:40:44.339710+0000 mon.a (mon.0) 1862 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:40:45.342 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:40:44.346740+0000 mon.a (mon.0) 1863 : audit [INF] from='client.? 172.21.15.18:0/746077143' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-10T08:40:45.343 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:40:44.346798+0000 mon.a (mon.0) 1864 : cluster [DBG] osdmap e457: 8 total, 7 up, 7 in 2024-02-10T08:40:45.406 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:40:45.435 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:40:45.462 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:40:45.466 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:40:45.466 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:40:45.568 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7 2024-02-10T08:40:45.594 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:40:44.339710+0000 mon.a (mon.0) 1862 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:40:45.594 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:40:44.346740+0000 mon.a (mon.0) 1863 : audit [INF] from='client.? 172.21.15.18:0/746077143' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-10T08:40:45.594 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:40:44.346798+0000 mon.a (mon.0) 1864 : cluster [DBG] osdmap e457: 8 total, 7 up, 7 in 2024-02-10T08:40:45.597 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:40:45.640 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-10T08:40:46.152 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:40:46.155 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:40:46.155 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7' 2024-02-10T08:40:46.256 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:40:46.283 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:40:46.336 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:40:46.340 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:40:46.341 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:40:46.441 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:40:46.467 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:40:45.207941+0000 mgr.y (mgr.14505) 897 : cluster [DBG] pgmap v1100: 178 pgs: 1 active+undersized+remapped+backfill_toofull, 22 active+undersized+degraded, 1 active+recovering+undersized+remapped, 49 active+undersized, 2 active+recovering+remapped, 1 active+recovery_wait+degraded+remapped, 102 active+clean; 5.7 KiB data, 6.1 GiB used, 620 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.01k op/s; 86/576 objects degraded (14.931%); 0 B/s, 43 objects/s recovering 2024-02-10T08:40:46.467 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:40:46.088512+0000 mon.a (mon.0) 1865 : cluster [WRN] Health check update: Degraded data redundancy: 86/576 objects degraded (14.931%), 23 pgs degraded (PG_DEGRADED) 2024-02-10T08:40:46.474 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:40:46.495 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:40:46.497 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:40:46.498 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:40:46.598 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2 2024-02-10T08:40:46.629 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:40:45.207941+0000 mgr.y (mgr.14505) 897 : cluster [DBG] pgmap v1100: 178 pgs: 1 active+undersized+remapped+backfill_toofull, 22 active+undersized+degraded, 1 active+recovering+undersized+remapped, 49 active+undersized, 2 active+recovering+remapped, 1 active+recovery_wait+degraded+remapped, 102 active+clean; 5.7 KiB data, 6.1 GiB used, 620 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.01k op/s; 86/576 objects degraded (14.931%); 0 B/s, 43 objects/s recovering 2024-02-10T08:40:46.629 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:40:46.088512+0000 mon.a (mon.0) 1865 : cluster [WRN] Health check update: Degraded data redundancy: 86/576 objects degraded (14.931%), 23 pgs degraded (PG_DEGRADED) 2024-02-10T08:40:46.629 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:40:45.207941+0000 mgr.y (mgr.14505) 897 : cluster [DBG] pgmap v1100: 178 pgs: 1 active+undersized+remapped+backfill_toofull, 22 active+undersized+degraded, 1 active+recovering+undersized+remapped, 49 active+undersized, 2 active+recovering+remapped, 1 active+recovery_wait+degraded+remapped, 102 active+clean; 5.7 KiB data, 6.1 GiB used, 620 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.01k op/s; 86/576 objects degraded (14.931%); 0 B/s, 43 objects/s recovering 2024-02-10T08:40:46.630 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:40:46.088512+0000 mon.a (mon.0) 1865 : cluster [WRN] Health check update: Degraded data redundancy: 86/576 objects degraded (14.931%), 23 pgs degraded (PG_DEGRADED) 2024-02-10T08:40:46.632 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:40:46.789 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:40:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:40:46] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:40:46.923 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:40:46.926 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:40:46.926 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2' 2024-02-10T08:40:46.939 INFO:teuthology.orchestra.run.smithi071.stderr:Exporting 1.2 info 1.2( empty local-lis/les=428/429 n=0 ec=409/19 lis/c=428/428 les/c/f=429/429/0 sis=428) 2024-02-10T08:40:46.940 INFO:teuthology.orchestra.run.smithi071.stderr:Export successful 2024-02-10T08:40:47.026 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:40:47.055 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:40:47.404 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:40:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:40:47] "GET /metrics HTTP/1.1" 200 176544 "" "Prometheus/2.33.4" 2024-02-10T08:40:47.475 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd unset noscrub 2024-02-10T08:40:47.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:40:46.698306+0000 mon.a (mon.0) 1866 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:40:47.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:40:46.698306+0000 mon.a (mon.0) 1866 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:40:47.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:40:46.698306+0000 mon.a (mon.0) 1866 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:40:48.157 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -n osd.4 --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph-objectstore-tool --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-4 --journal-path /var/lib/ceph/osd/ceph-4/journal --force --op remove --pgid 1.2 2024-02-10T08:40:48.381 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/osd.4/config 2024-02-10T08:40:48.765 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.3 dump_historic_ops 2024-02-10T08:40:48.891 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:40:47.208374+0000 mgr.y (mgr.14505) 898 : cluster [DBG] pgmap v1101: 178 pgs: 1 active+undersized+remapped+backfill_toofull, 22 active+undersized+degraded, 1 active+recovering+undersized+remapped, 49 active+undersized, 2 active+recovering+remapped, 1 active+recovery_wait+degraded+remapped, 102 active+clean; 5.7 KiB data, 6.1 GiB used, 620 GiB / 626 GiB avail; 575 B/s rd, 0 B/s wr, 474 op/s; 86/576 objects degraded (14.931%); 0 B/s, 19 objects/s recovering 2024-02-10T08:40:49.006 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:40:49.008 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:40:47.208374+0000 mgr.y (mgr.14505) 898 : cluster [DBG] pgmap v1101: 178 pgs: 1 active+undersized+remapped+backfill_toofull, 22 active+undersized+degraded, 1 active+recovering+undersized+remapped, 49 active+undersized, 2 active+recovering+remapped, 1 active+recovery_wait+degraded+remapped, 102 active+clean; 5.7 KiB data, 6.1 GiB used, 620 GiB / 626 GiB avail; 575 B/s rd, 0 B/s wr, 474 op/s; 86/576 objects degraded (14.931%); 0 B/s, 19 objects/s recovering 2024-02-10T08:40:49.009 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:40:49.010 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:40:49.010 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:40:47.208374+0000 mgr.y (mgr.14505) 898 : cluster [DBG] pgmap v1101: 178 pgs: 1 active+undersized+remapped+backfill_toofull, 22 active+undersized+degraded, 1 active+recovering+undersized+remapped, 49 active+undersized, 2 active+recovering+remapped, 1 active+recovery_wait+degraded+remapped, 102 active+clean; 5.7 KiB data, 6.1 GiB used, 620 GiB / 626 GiB avail; 575 B/s rd, 0 B/s wr, 474 op/s; 86/576 objects degraded (14.931%); 0 B/s, 19 objects/s recovering 2024-02-10T08:40:49.111 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:40:49.140 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:40:49.289 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:40:49 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:40:49.296 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:40:49.300 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:40:49.300 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:40:49.403 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:40:49.430 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:40:49.679 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:40:49.682 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:40:49.683 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:40:49.784 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5 2024-02-10T08:40:49.813 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:40:49.965 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:40:49.968 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:40:49.969 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5' 2024-02-10T08:40:50.070 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1 2024-02-10T08:40:50.100 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:40:50.446 INFO:teuthology.orchestra.run.smithi071.stdout: marking collection for removal 2024-02-10T08:40:50.446 INFO:teuthology.orchestra.run.smithi071.stdout:setting '_remove' omap key 2024-02-10T08:40:50.446 INFO:teuthology.orchestra.run.smithi071.stdout:finish_remove_pgs 1.2_head removing 1.2 2024-02-10T08:40:50.448 INFO:teuthology.orchestra.run.smithi071.stdout:Remove successful 2024-02-10T08:40:50.754 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:40:50.754 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:40:50.758 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:40:50.766 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:40:50.767 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1' 2024-02-10T08:40:50.771 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:40:50.868 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:40:50.896 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:40:50.916 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:40:50.919 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:40:50.919 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:40:50.995 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:40:49.067566+0000 mgr.y (mgr.14505) 899 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:40:50.995 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:40:49.212948+0000 mgr.y (mgr.14505) 900 : cluster [DBG] pgmap v1102: 178 pgs: 1 active+undersized+remapped+backfill_toofull, 20 active+undersized+degraded, 1 active+recovering+undersized+remapped, 51 active+undersized, 1 active+recovery_wait+remapped, 2 active+recovering+remapped, 102 active+clean; 5.7 KiB data, 6.1 GiB used, 620 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 366 op/s; 86/576 objects degraded (14.931%); 0 B/s, 34 objects/s recovering 2024-02-10T08:40:50.995 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:40:50.404635+0000 mon.a (mon.0) 1867 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:40:51.021 DEBUG:teuthology.orchestra.run.smithi071:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6 2024-02-10T08:40:51.050 INFO:teuthology.orchestra.run.smithi071.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:40:51.092 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:40:49.067566+0000 mgr.y (mgr.14505) 899 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:40:51.093 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:40:49.212948+0000 mgr.y (mgr.14505) 900 : cluster [DBG] pgmap v1102: 178 pgs: 1 active+undersized+remapped+backfill_toofull, 20 active+undersized+degraded, 1 active+recovering+undersized+remapped, 51 active+undersized, 1 active+recovery_wait+remapped, 2 active+recovering+remapped, 102 active+clean; 5.7 KiB data, 6.1 GiB used, 620 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 366 op/s; 86/576 objects degraded (14.931%); 0 B/s, 34 objects/s recovering 2024-02-10T08:40:51.093 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:40:50.404635+0000 mon.a (mon.0) 1867 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:40:51.099 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:40:49.067566+0000 mgr.y (mgr.14505) 899 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:40:51.099 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:40:49.212948+0000 mgr.y (mgr.14505) 900 : cluster [DBG] pgmap v1102: 178 pgs: 1 active+undersized+remapped+backfill_toofull, 20 active+undersized+degraded, 1 active+recovering+undersized+remapped, 51 active+undersized, 1 active+recovery_wait+remapped, 2 active+recovering+remapped, 102 active+clean; 5.7 KiB data, 6.1 GiB used, 620 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 366 op/s; 86/576 objects degraded (14.931%); 0 B/s, 34 objects/s recovering 2024-02-10T08:40:51.100 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:40:50.404635+0000 mon.a (mon.0) 1867 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:40:51.164 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'unique_pool_4' removed 2024-02-10T08:40:51.632 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -n osd.4 --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph-objectstore-tool --data-path /var/lib/ceph/osd/ceph-4 --journal-path /var/lib/ceph/osd/ceph-4/journal '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --op import --file /var/log/ceph/exp.1.2.4 2024-02-10T08:40:51.699 INFO:teuthology.orchestra.run.smithi071.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:40:51.701 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:40:51.701 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi071 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6' 2024-02-10T08:40:51.802 DEBUG:teuthology.orchestra.run.smithi018:> sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0 2024-02-10T08:40:51.838 INFO:teuthology.orchestra.run.smithi018.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-10T08:40:51.875 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/osd.4/config 2024-02-10T08:40:52.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:51 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:40:50.740602+0000 mon.a (mon.0) 1868 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:40:52.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:51 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:40:50.742761+0000 mon.a (mon.0) 1869 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:40:52.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:51 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:40:50.748759+0000 mon.a (mon.0) 1870 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:40:52.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:51 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:40:50.989459+0000 mon.c (mon.2) 106 : audit [INF] from='client.? 172.21.15.18:0/1772787836' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_4", "pool2": "unique_pool_4", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-10T08:40:52.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:51 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:40:50.989806+0000 mon.a (mon.0) 1871 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_4", "pool2": "unique_pool_4", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-10T08:40:52.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:51 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:40:51.089858+0000 mon.a (mon.0) 1872 : cluster [WRN] Health check update: Degraded data redundancy: 86/576 objects degraded (14.931%), 20 pgs degraded (PG_DEGRADED) 2024-02-10T08:40:52.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:51 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:40:51.094835+0000 mon.a (mon.0) 1873 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_4", "pool2": "unique_pool_4", "yes_i_really_really_mean_it": true}]': finished 2024-02-10T08:40:52.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:51 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:40:51.094916+0000 mon.a (mon.0) 1874 : cluster [DBG] osdmap e458: 8 total, 7 up, 7 in 2024-02-10T08:40:52.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:40:50.740602+0000 mon.a (mon.0) 1868 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:40:52.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:40:50.742761+0000 mon.a (mon.0) 1869 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:40:52.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:40:50.748759+0000 mon.a (mon.0) 1870 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:40:52.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:40:50.989459+0000 mon.c (mon.2) 106 : audit [INF] from='client.? 172.21.15.18:0/1772787836' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_4", "pool2": "unique_pool_4", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-10T08:40:52.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:40:50.989806+0000 mon.a (mon.0) 1871 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_4", "pool2": "unique_pool_4", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-10T08:40:52.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:40:51.089858+0000 mon.a (mon.0) 1872 : cluster [WRN] Health check update: Degraded data redundancy: 86/576 objects degraded (14.931%), 20 pgs degraded (PG_DEGRADED) 2024-02-10T08:40:52.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:40:51.094835+0000 mon.a (mon.0) 1873 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_4", "pool2": "unique_pool_4", "yes_i_really_really_mean_it": true}]': finished 2024-02-10T08:40:52.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:40:51.094916+0000 mon.a (mon.0) 1874 : cluster [DBG] osdmap e458: 8 total, 7 up, 7 in 2024-02-10T08:40:52.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:40:50.740602+0000 mon.a (mon.0) 1868 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:40:52.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:40:50.742761+0000 mon.a (mon.0) 1869 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:40:52.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:40:50.748759+0000 mon.a (mon.0) 1870 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:40:52.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:40:50.989459+0000 mon.c (mon.2) 106 : audit [INF] from='client.? 172.21.15.18:0/1772787836' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_4", "pool2": "unique_pool_4", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-10T08:40:52.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:40:50.989806+0000 mon.a (mon.0) 1871 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_4", "pool2": "unique_pool_4", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-10T08:40:52.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:40:51.089858+0000 mon.a (mon.0) 1872 : cluster [WRN] Health check update: Degraded data redundancy: 86/576 objects degraded (14.931%), 20 pgs degraded (PG_DEGRADED) 2024-02-10T08:40:52.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:40:51.094835+0000 mon.a (mon.0) 1873 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_4", "pool2": "unique_pool_4", "yes_i_really_really_mean_it": true}]': finished 2024-02-10T08:40:52.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:40:51.094916+0000 mon.a (mon.0) 1874 : cluster [DBG] osdmap e458: 8 total, 7 up, 7 in 2024-02-10T08:40:53.011 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:40:51.218466+0000 mgr.y (mgr.14505) 901 : cluster [DBG] pgmap v1104: 162 pgs: 20 active+undersized+degraded, 48 active+undersized, 94 active+clean; 5.7 KiB data, 6.1 GiB used, 620 GiB / 626 GiB avail; 511 B/s rd, 0 op/s; 86/576 objects degraded (14.931%) 2024-02-10T08:40:53.011 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:40:52.096775+0000 mon.a (mon.0) 1875 : cluster [INF] Health check cleared: PG_BACKFILL_FULL (was: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull) 2024-02-10T08:40:53.011 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:40:51.218466+0000 mgr.y (mgr.14505) 901 : cluster [DBG] pgmap v1104: 162 pgs: 20 active+undersized+degraded, 48 active+undersized, 94 active+clean; 5.7 KiB data, 6.1 GiB used, 620 GiB / 626 GiB avail; 511 B/s rd, 0 op/s; 86/576 objects degraded (14.931%) 2024-02-10T08:40:53.011 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:40:52.096775+0000 mon.a (mon.0) 1875 : cluster [INF] Health check cleared: PG_BACKFILL_FULL (was: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull) 2024-02-10T08:40:53.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:52 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:40:51.218466+0000 mgr.y (mgr.14505) 901 : cluster [DBG] pgmap v1104: 162 pgs: 20 active+undersized+degraded, 48 active+undersized, 94 active+clean; 5.7 KiB data, 6.1 GiB used, 620 GiB / 626 GiB avail; 511 B/s rd, 0 op/s; 86/576 objects degraded (14.931%) 2024-02-10T08:40:53.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:52 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:40:52.096775+0000 mon.a (mon.0) 1875 : cluster [INF] Health check cleared: PG_BACKFILL_FULL (was: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull) 2024-02-10T08:40:53.556 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-02-10T08:40:53.577 INFO:tasks.thrashosds:joining thrashosds 2024-02-10T08:40:53.873 INFO:teuthology.orchestra.run.smithi071.stdout:get_pg_num_history pg_num_history pg_num_history(e453 pg_nums {1={19=1,409=11},2={54=32},3={54=3},4={56=32},5={58=32},6={287=52},10={335=16},11={398=16}} deleted_pools 395,10) 2024-02-10T08:40:53.873 INFO:teuthology.orchestra.run.smithi071.stdout:Importing pgid 1.2 2024-02-10T08:40:53.874 INFO:teuthology.orchestra.run.smithi071.stdout:write_pg epoch 429 info 1.2( empty local-lis/les=428/429 n=0 ec=409/19 lis/c=428/428 les/c/f=429/429/0 sis=428) 2024-02-10T08:40:53.874 INFO:teuthology.orchestra.run.smithi071.stdout:Import successful 2024-02-10T08:40:53.889 INFO:teuthology.orchestra.run.smithi018.stderr:Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:40:53.892 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-10T08:40:53.893 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi018 with status 125: 'sudo docker kill -s 1 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0' 2024-02-10T08:40:54.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:40:53.219392+0000 mgr.y (mgr.14505) 902 : cluster [DBG] pgmap v1105: 162 pgs: 20 active+undersized+degraded, 48 active+undersized, 94 active+clean; 5.7 KiB data, 6.1 GiB used, 620 GiB / 626 GiB avail; 1.0 KiB/s rd, 1 op/s; 86/576 objects degraded (14.931%) 2024-02-10T08:40:54.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:40:53.219392+0000 mgr.y (mgr.14505) 902 : cluster [DBG] pgmap v1105: 162 pgs: 20 active+undersized+degraded, 48 active+undersized, 94 active+clean; 5.7 KiB data, 6.1 GiB used, 620 GiB / 626 GiB avail; 1.0 KiB/s rd, 1 op/s; 86/576 objects degraded (14.931%) 2024-02-10T08:40:55.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:54 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:40:53.219392+0000 mgr.y (mgr.14505) 902 : cluster [DBG] pgmap v1105: 162 pgs: 20 active+undersized+degraded, 48 active+undersized, 94 active+clean; 5.7 KiB data, 6.1 GiB used, 620 GiB / 626 GiB avail; 1.0 KiB/s rd, 1 op/s; 86/576 objects degraded (14.931%) 2024-02-10T08:40:55.185 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f /var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/exp.1.2.4 2024-02-10T08:40:56.311 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-02-10T08:40:56.312 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-02-10T08:40:56.312 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-02-10T08:40:56.312 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-02-10T08:40:56.312 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.312 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(osd.6.0:157873 10.f e374/335 10:f648bbee:::benchmark_data_smithi018_146618_object75325:head v 374'12255, mlcod=374'12249)", 2024-02-10T08:40:56.312 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:34:49.980209+0000", 2024-02-10T08:40:56.312 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 366.32932004499997, 2024-02-10T08:40:56.312 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.077802790999999996, 2024-02-10T08:40:56.312 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:40:56.312 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:40:56.312 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:40:56.312 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.313 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:40:56.313 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.980209+0000", 2024-02-10T08:40:56.313 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:40:56.313 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.313 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.313 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:40:56.313 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.980209+0000", 2024-02-10T08:40:56.313 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:40:56.313 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.313 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.313 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:40:56.313 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.980208+0000", 2024-02-10T08:40:56.313 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9840000000000007e-06 2024-02-10T08:40:56.313 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.313 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.314 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:40:56.314 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.980217+0000", 2024-02-10T08:40:56.314 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2398000000000001e-05 2024-02-10T08:40:56.314 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.314 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.314 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:40:56.314 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.980229+0000", 2024-02-10T08:40:56.314 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7510000000000002e-06 2024-02-10T08:40:56.314 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.314 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.314 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:40:56.314 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.980236+0000", 2024-02-10T08:40:56.314 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0078384059999999992 2024-02-10T08:40:56.314 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.315 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.315 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:40:56.315 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.988074+0000", 2024-02-10T08:40:56.315 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8607999999999999e-05 2024-02-10T08:40:56.315 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.315 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.315 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:40:56.315 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.988093+0000", 2024-02-10T08:40:56.315 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.069887828999999999 2024-02-10T08:40:56.315 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.315 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.315 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:40:56.315 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:50.057981+0000", 2024-02-10T08:40:56.315 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0749e-05 2024-02-10T08:40:56.315 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.315 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.316 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:40:56.316 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:50.058011+0000", 2024-02-10T08:40:56.316 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.077802790999999996 2024-02-10T08:40:56.316 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:56.316 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:56.316 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:56.316 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.316 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.316 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(osd.6.0:157874 10.f e374/335 10:f6494ad0:::benchmark_data_smithi018_146618_object60698:head v 374'12256, mlcod=374'12249)", 2024-02-10T08:40:56.316 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:34:49.983992+0000", 2024-02-10T08:40:56.316 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 366.32553695199999, 2024-02-10T08:40:56.316 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.074046534999999997, 2024-02-10T08:40:56.316 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:40:56.316 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:40:56.316 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:40:56.317 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.317 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:40:56.317 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.983992+0000", 2024-02-10T08:40:56.317 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:40:56.317 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.317 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.317 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:40:56.317 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.983992+0000", 2024-02-10T08:40:56.317 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:40:56.317 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.317 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.317 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:40:56.317 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.983991+0000", 2024-02-10T08:40:56.317 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1379999999999996e-06 2024-02-10T08:40:56.317 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.318 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.318 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:40:56.318 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.984000+0000", 2024-02-10T08:40:56.318 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9789999999999999e-06 2024-02-10T08:40:56.318 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.318 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.318 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:40:56.318 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.984009+0000", 2024-02-10T08:40:56.318 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8459999999999996e-06 2024-02-10T08:40:56.318 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.318 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.318 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:40:56.318 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.984015+0000", 2024-02-10T08:40:56.318 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0065910550000000002 2024-02-10T08:40:56.318 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.319 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.319 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:40:56.319 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.990606+0000", 2024-02-10T08:40:56.319 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9528999999999999e-05 2024-02-10T08:40:56.319 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.319 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.319 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:40:56.319 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.990625+0000", 2024-02-10T08:40:56.319 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.067391164000000003 2024-02-10T08:40:56.319 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.319 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.319 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:40:56.320 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:50.058017+0000", 2024-02-10T08:40:56.320 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1784999999999999e-05 2024-02-10T08:40:56.320 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.320 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.320 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:40:56.320 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:50.058038+0000", 2024-02-10T08:40:56.320 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.074046534999999997 2024-02-10T08:40:56.320 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:56.320 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:56.320 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:56.320 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.320 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.320 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(osd.6.0:157876 10.f e374/335 10:f6496769:::benchmark_data_smithi018_146618_object80757:head v 374'12257, mlcod=374'12249)", 2024-02-10T08:40:56.321 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:34:49.984021+0000", 2024-02-10T08:40:56.321 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 366.32550755199998, 2024-02-10T08:40:56.321 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.074034845000000002, 2024-02-10T08:40:56.321 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:40:56.321 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:40:56.321 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:40:56.321 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.321 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:40:56.321 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.984021+0000", 2024-02-10T08:40:56.321 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:40:56.321 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.321 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.321 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:40:56.321 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.984021+0000", 2024-02-10T08:40:56.321 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:40:56.322 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.322 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.322 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:40:56.322 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.984021+0000", 2024-02-10T08:40:56.322 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7850000000000002e-06 2024-02-10T08:40:56.322 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.322 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.322 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:40:56.322 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.984025+0000", 2024-02-10T08:40:56.322 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2300000000000002e-06 2024-02-10T08:40:56.322 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.322 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.322 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:40:56.322 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.984029+0000", 2024-02-10T08:40:56.322 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6819999999999992e-06 2024-02-10T08:40:56.322 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.323 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.323 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:40:56.323 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.984038+0000", 2024-02-10T08:40:56.323 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0086964590000000001 2024-02-10T08:40:56.323 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.323 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.323 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:40:56.323 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.992734+0000", 2024-02-10T08:40:56.323 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2128e-05 2024-02-10T08:40:56.323 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.323 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.323 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:40:56.323 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.992746+0000", 2024-02-10T08:40:56.323 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.065294454000000002 2024-02-10T08:40:56.323 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.323 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.324 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:40:56.324 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:50.058041+0000", 2024-02-10T08:40:56.324 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5384999999999999e-05 2024-02-10T08:40:56.324 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.324 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.324 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:40:56.324 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:50.058056+0000", 2024-02-10T08:40:56.324 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.074034845000000002 2024-02-10T08:40:56.324 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:56.324 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:56.324 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:56.324 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.324 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.324 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(osd.6.0:157877 10.f e374/335 10:f64a4c41:::benchmark_data_smithi018_146618_object39621:head v 374'12258, mlcod=374'12249)", 2024-02-10T08:40:56.325 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:34:49.985989+0000", 2024-02-10T08:40:56.325 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 366.323539901, 2024-02-10T08:40:56.325 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.072086775000000006, 2024-02-10T08:40:56.325 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:40:56.325 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:40:56.325 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:40:56.325 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.325 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:40:56.325 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.985989+0000", 2024-02-10T08:40:56.325 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:40:56.325 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.325 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.325 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:40:56.325 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.985989+0000", 2024-02-10T08:40:56.325 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:40:56.326 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.326 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.326 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:40:56.326 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.985988+0000", 2024-02-10T08:40:56.326 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3690000000000007e-06 2024-02-10T08:40:56.326 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.326 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.326 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:40:56.326 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.985996+0000", 2024-02-10T08:40:56.326 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0688e-05 2024-02-10T08:40:56.326 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.326 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.326 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:40:56.326 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.986007+0000", 2024-02-10T08:40:56.327 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5170000000000001e-06 2024-02-10T08:40:56.327 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.327 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.327 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:40:56.327 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.986011+0000", 2024-02-10T08:40:56.327 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0087163959999999995 2024-02-10T08:40:56.327 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.327 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.327 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:40:56.327 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.994728+0000", 2024-02-10T08:40:56.327 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9874e-05 2024-02-10T08:40:56.327 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.327 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.327 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:40:56.328 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.994748+0000", 2024-02-10T08:40:56.328 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.063313261999999995 2024-02-10T08:40:56.328 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.328 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.328 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:40:56.328 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:50.058061+0000", 2024-02-10T08:40:56.328 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4610000000000001e-05 2024-02-10T08:40:56.328 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.328 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.328 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:40:56.328 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:50.058076+0000", 2024-02-10T08:40:56.328 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.072086775000000006 2024-02-10T08:40:56.328 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:56.328 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:56.329 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:56.329 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.329 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.329 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(osd.6.0:157878 10.f e374/335 10:f64c574a:::benchmark_data_smithi018_146618_object98147:head v 374'12259, mlcod=374'12249)", 2024-02-10T08:40:56.329 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:34:49.987601+0000", 2024-02-10T08:40:56.329 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 366.32192788600003, 2024-02-10T08:40:56.329 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.070489711999999996, 2024-02-10T08:40:56.329 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:40:56.329 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:40:56.329 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:40:56.329 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.329 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:40:56.329 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.987601+0000", 2024-02-10T08:40:56.329 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:40:56.330 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.330 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.330 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:40:56.330 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.987601+0000", 2024-02-10T08:40:56.330 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:40:56.330 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.330 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.330 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:40:56.330 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.987600+0000", 2024-02-10T08:40:56.330 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7409999999999998e-06 2024-02-10T08:40:56.330 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.330 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.330 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:40:56.330 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.987609+0000", 2024-02-10T08:40:56.331 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1130000000000007e-06 2024-02-10T08:40:56.331 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.331 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.331 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:40:56.331 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.987618+0000", 2024-02-10T08:40:56.331 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3480000000000003e-06 2024-02-10T08:40:56.331 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.331 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.331 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:40:56.331 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.987623+0000", 2024-02-10T08:40:56.331 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0095962809999999999 2024-02-10T08:40:56.331 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.331 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.331 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:40:56.331 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.997219+0000", 2024-02-10T08:40:56.331 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7978999999999998e-05 2024-02-10T08:40:56.332 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.332 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.332 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:40:56.332 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.997237+0000", 2024-02-10T08:40:56.332 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.060840666000000002 2024-02-10T08:40:56.332 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.332 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.332 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:40:56.332 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:50.058078+0000", 2024-02-10T08:40:56.332 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2408999999999999e-05 2024-02-10T08:40:56.332 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.332 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.332 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:40:56.333 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:50.058091+0000", 2024-02-10T08:40:56.333 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.070489711999999996 2024-02-10T08:40:56.333 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:56.333 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:56.333 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:56.333 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.333 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.333 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(osd.6.0:157879 10.f e374/335 10:f64cb999:::benchmark_data_smithi018_146618_object93995:head v 374'12260, mlcod=374'12249)", 2024-02-10T08:40:56.333 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:34:49.989206+0000", 2024-02-10T08:40:56.333 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 366.32032269400003, 2024-02-10T08:40:56.333 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.068904799000000003, 2024-02-10T08:40:56.333 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:40:56.333 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:40:56.333 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:40:56.333 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.333 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:40:56.334 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.989206+0000", 2024-02-10T08:40:56.334 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:40:56.334 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.334 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.334 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:40:56.334 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.989206+0000", 2024-02-10T08:40:56.334 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:40:56.334 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.334 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.334 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:40:56.335 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.989205+0000", 2024-02-10T08:40:56.335 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9630000000000001e-06 2024-02-10T08:40:56.335 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.335 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.335 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:40:56.335 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.989212+0000", 2024-02-10T08:40:56.335 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6680000000000007e-06 2024-02-10T08:40:56.335 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.335 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.335 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:40:56.335 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.989221+0000", 2024-02-10T08:40:56.335 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2580000000000003e-06 2024-02-10T08:40:56.335 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.336 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.336 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:40:56.336 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.989226+0000", 2024-02-10T08:40:56.336 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.010509114 2024-02-10T08:40:56.336 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.336 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.336 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:40:56.336 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.999735+0000", 2024-02-10T08:40:56.336 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7907e-05 2024-02-10T08:40:56.336 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.336 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.336 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:40:56.336 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.999753+0000", 2024-02-10T08:40:56.337 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058339308999999999 2024-02-10T08:40:56.337 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.337 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.337 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:40:56.337 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:50.058093+0000", 2024-02-10T08:40:56.337 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.827e-05 2024-02-10T08:40:56.337 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.337 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.337 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:40:56.337 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:50.058111+0000", 2024-02-10T08:40:56.337 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.068904799000000003 2024-02-10T08:40:56.337 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:56.337 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:56.337 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:56.337 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.338 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.338 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(osd.6.0:157880 10.f e374/335 10:f64d2abb:::benchmark_data_smithi018_146618_object98460:head v 374'12261, mlcod=374'12249)", 2024-02-10T08:40:56.338 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:34:49.991070+0000", 2024-02-10T08:40:56.338 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 366.31845902800001, 2024-02-10T08:40:56.338 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.067057134000000004, 2024-02-10T08:40:56.338 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:40:56.338 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:40:56.338 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:40:56.338 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.338 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:40:56.338 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.991070+0000", 2024-02-10T08:40:56.338 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:40:56.338 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.338 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.339 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:40:56.339 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.991070+0000", 2024-02-10T08:40:56.339 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:40:56.339 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.339 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.339 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:40:56.339 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.991069+0000", 2024-02-10T08:40:56.339 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1174e-05 2024-02-10T08:40:56.339 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.339 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.339 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:40:56.339 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.991080+0000", 2024-02-10T08:40:56.339 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1589999999999999e-06 2024-02-10T08:40:56.340 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.340 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.340 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:40:56.340 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.991089+0000", 2024-02-10T08:40:56.340 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6999999999999996e-06 2024-02-10T08:40:56.340 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.340 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.340 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:40:56.340 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.991095+0000", 2024-02-10T08:40:56.340 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011150571 2024-02-10T08:40:56.340 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.340 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.340 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:40:56.340 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:50.002245+0000", 2024-02-10T08:40:56.341 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6753999999999999e-05 2024-02-10T08:40:56.341 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.341 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.341 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:40:56.341 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:50.002262+0000", 2024-02-10T08:40:56.341 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.055850669999999998 2024-02-10T08:40:56.341 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.341 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.341 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:40:56.341 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:50.058113+0000", 2024-02-10T08:40:56.341 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4161999999999999e-05 2024-02-10T08:40:56.341 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.341 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.341 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:40:56.342 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:50.058127+0000", 2024-02-10T08:40:56.342 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.067057134000000004 2024-02-10T08:40:56.342 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:56.342 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:56.342 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:56.342 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.342 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.342 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(osd.6.0:157881 10.f e374/335 10:f64dd919:::benchmark_data_smithi018_146618_object72900:head v 374'12262, mlcod=374'12249)", 2024-02-10T08:40:56.342 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:34:49.992220+0000", 2024-02-10T08:40:56.342 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 366.317309002, 2024-02-10T08:40:56.342 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.065943105000000002, 2024-02-10T08:40:56.343 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:40:56.343 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:40:56.343 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:40:56.343 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.343 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:40:56.343 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.992220+0000", 2024-02-10T08:40:56.343 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:40:56.343 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.343 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.343 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:40:56.343 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.992220+0000", 2024-02-10T08:40:56.343 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:40:56.343 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.343 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.343 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:40:56.344 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.992219+0000", 2024-02-10T08:40:56.344 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2299999999999997e-06 2024-02-10T08:40:56.344 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.344 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.344 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:40:56.344 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.992228+0000", 2024-02-10T08:40:56.344 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8939999999999999e-06 2024-02-10T08:40:56.344 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.344 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.344 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:40:56.344 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.992237+0000", 2024-02-10T08:40:56.344 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0069999999999997e-06 2024-02-10T08:40:56.344 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.344 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.345 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:40:56.345 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.992245+0000", 2024-02-10T08:40:56.345 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.014917869 2024-02-10T08:40:56.345 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.345 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.345 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:40:56.345 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:50.007163+0000", 2024-02-10T08:40:56.345 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7785e-05 2024-02-10T08:40:56.345 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.345 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.345 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:40:56.345 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:50.007181+0000", 2024-02-10T08:40:56.345 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.050967862000000003 2024-02-10T08:40:56.345 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.345 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.346 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:40:56.346 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:50.058149+0000", 2024-02-10T08:40:56.346 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4178e-05 2024-02-10T08:40:56.346 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.346 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.346 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:40:56.346 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:50.058163+0000", 2024-02-10T08:40:56.346 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.065943105000000002 2024-02-10T08:40:56.346 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:56.347 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:56.347 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:56.347 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.347 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.347 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(osd.6.0:157882 10.f e374/335 10:f6504417:::benchmark_data_smithi018_146618_object88948:head v 374'12263, mlcod=374'12249)", 2024-02-10T08:40:56.347 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:34:49.993628+0000", 2024-02-10T08:40:56.347 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 366.31590094199998, 2024-02-10T08:40:56.347 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.064548817999999994, 2024-02-10T08:40:56.347 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:40:56.348 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:40:56.348 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:40:56.348 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.348 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:40:56.348 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.993628+0000", 2024-02-10T08:40:56.348 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:40:56.348 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.348 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.348 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:40:56.348 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.993628+0000", 2024-02-10T08:40:56.348 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:40:56.348 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.349 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.349 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:40:56.349 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.993627+0000", 2024-02-10T08:40:56.349 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1878999999999999e-05 2024-02-10T08:40:56.349 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.349 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.349 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:40:56.349 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.993639+0000", 2024-02-10T08:40:56.349 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.064e-06 2024-02-10T08:40:56.349 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.349 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.349 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:40:56.349 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.993648+0000", 2024-02-10T08:40:56.349 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5790000000000003e-06 2024-02-10T08:40:56.349 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.350 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.350 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:40:56.350 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:49.993654+0000", 2024-02-10T08:40:56.350 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.016123373999999999 2024-02-10T08:40:56.350 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.350 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.350 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:40:56.350 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:50.009777+0000", 2024-02-10T08:40:56.350 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0339999999999998e-05 2024-02-10T08:40:56.350 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.350 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.350 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:40:56.350 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:50.009797+0000", 2024-02-10T08:40:56.350 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048367201999999998 2024-02-10T08:40:56.350 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.351 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.351 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:40:56.351 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:50.058165+0000", 2024-02-10T08:40:56.351 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2092999999999999e-05 2024-02-10T08:40:56.351 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.351 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.351 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:40:56.351 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:50.058177+0000", 2024-02-10T08:40:56.351 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.064548817999999994 2024-02-10T08:40:56.351 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:56.351 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:56.351 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:56.351 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.351 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.351 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(osd.6.0:158327 10.f e374/335 10:f6f4549f:::benchmark_data_smithi018_146618_object49471:head v 374'12540, mlcod=374'12512)", 2024-02-10T08:40:56.352 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:34:51.042826+0000", 2024-02-10T08:40:56.352 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 365.26670291800002, 2024-02-10T08:40:56.352 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.21192914400000001, 2024-02-10T08:40:56.352 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:40:56.352 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:40:56.352 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:40:56.352 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.352 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:40:56.352 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.042826+0000", 2024-02-10T08:40:56.352 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:40:56.352 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.352 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.352 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:40:56.352 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.042826+0000", 2024-02-10T08:40:56.353 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:40:56.353 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.353 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.353 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:40:56.353 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.042825+0000", 2024-02-10T08:40:56.353 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9719999999999997e-06 2024-02-10T08:40:56.353 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.353 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.353 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:40:56.353 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.042831+0000", 2024-02-10T08:40:56.353 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5619999999999998e-06 2024-02-10T08:40:56.353 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.353 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.353 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:40:56.353 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.042839+0000", 2024-02-10T08:40:56.354 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9840000000000003e-06 2024-02-10T08:40:56.354 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.354 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.354 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:40:56.354 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.042843+0000", 2024-02-10T08:40:56.354 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011244656 2024-02-10T08:40:56.354 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.354 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.354 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:40:56.354 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.054087+0000", 2024-02-10T08:40:56.354 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0909e-05 2024-02-10T08:40:56.354 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.354 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.354 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:40:56.355 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.054098+0000", 2024-02-10T08:40:56.355 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0042649810000000002 2024-02-10T08:40:56.355 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.355 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.355 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:40:56.355 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.058363+0000", 2024-02-10T08:40:56.355 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.19639174100000001 2024-02-10T08:40:56.355 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.355 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.355 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:40:56.355 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.254755+0000", 2024-02-10T08:40:56.355 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.21192914400000001 2024-02-10T08:40:56.355 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:56.355 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:56.355 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:56.356 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.356 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.356 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(osd.6.0:158329 10.f e374/335 10:f6f5d737:::benchmark_data_smithi018_146618_object92740:head v 374'12541, mlcod=374'12512)", 2024-02-10T08:40:56.356 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:34:51.046988+0000", 2024-02-10T08:40:56.356 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 365.26254109500002, 2024-02-10T08:40:56.356 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.21040182900000001, 2024-02-10T08:40:56.356 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:40:56.356 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:40:56.356 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:40:56.356 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.356 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:40:56.356 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.046988+0000", 2024-02-10T08:40:56.357 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:40:56.357 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.357 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.357 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:40:56.357 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.046988+0000", 2024-02-10T08:40:56.357 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:40:56.357 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.357 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.357 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:40:56.357 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.046987+0000", 2024-02-10T08:40:56.357 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9580000000000007e-06 2024-02-10T08:40:56.357 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.357 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.358 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:40:56.358 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.046995+0000", 2024-02-10T08:40:56.358 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6709999999999994e-06 2024-02-10T08:40:56.358 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.358 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.358 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:40:56.358 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.047004+0000", 2024-02-10T08:40:56.358 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9499999999999998e-06 2024-02-10T08:40:56.358 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.358 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.358 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:40:56.358 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.047010+0000", 2024-02-10T08:40:56.358 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0081189929999999997 2024-02-10T08:40:56.358 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.359 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.359 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:40:56.359 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.055129+0000", 2024-02-10T08:40:56.359 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7062999999999999e-05 2024-02-10T08:40:56.359 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.359 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.359 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:40:56.359 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.055146+0000", 2024-02-10T08:40:56.359 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.20221127699999999 2024-02-10T08:40:56.359 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.359 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.359 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:40:56.359 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.257358+0000", 2024-02-10T08:40:56.360 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1860000000000003e-05 2024-02-10T08:40:56.360 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.360 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.360 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:40:56.360 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.257389+0000", 2024-02-10T08:40:56.360 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.21040182900000001 2024-02-10T08:40:56.360 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:56.360 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:56.360 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:56.360 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.361 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.361 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.25369.0:159347 10.f e374/335 10:f73c317e:::benchmark_data_smithi018_146618_object35544:head v 374'12542, mlcod=374'12512)", 2024-02-10T08:40:56.361 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:34:51.049938+0000", 2024-02-10T08:40:56.361 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 365.25959051400002, 2024-02-10T08:40:56.361 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.207469867, 2024-02-10T08:40:56.361 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:40:56.361 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:40:56.361 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:40:56.361 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.361 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:40:56.361 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.049938+0000", 2024-02-10T08:40:56.361 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:40:56.362 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.362 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.362 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:40:56.362 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.049938+0000", 2024-02-10T08:40:56.362 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:40:56.362 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.362 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.362 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:40:56.362 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.049937+0000", 2024-02-10T08:40:56.362 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1179999999999992e-06 2024-02-10T08:40:56.362 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.362 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.362 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:40:56.362 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.049945+0000", 2024-02-10T08:40:56.363 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0251000000000001e-05 2024-02-10T08:40:56.363 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.363 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.363 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:40:56.363 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.049956+0000", 2024-02-10T08:40:56.363 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3759999999999996e-06 2024-02-10T08:40:56.363 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.363 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.363 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:40:56.363 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.049962+0000", 2024-02-10T08:40:56.363 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0062557200000000002 2024-02-10T08:40:56.363 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.363 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.363 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:40:56.364 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.056218+0000", 2024-02-10T08:40:56.364 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0801e-05 2024-02-10T08:40:56.364 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.364 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.364 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:40:56.364 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.056229+0000", 2024-02-10T08:40:56.364 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.201163748 2024-02-10T08:40:56.364 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.364 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.364 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:40:56.364 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.257392+0000", 2024-02-10T08:40:56.364 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5702e-05 2024-02-10T08:40:56.364 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.365 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.365 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:40:56.365 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.257408+0000", 2024-02-10T08:40:56.365 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.207469867 2024-02-10T08:40:56.365 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:56.365 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:56.365 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:56.365 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.365 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.365 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.25369.0:159390 10.7 e374/364 10:e0a23cc4:::benchmark_data_smithi018_146618_object35587:head v 374'10080, mlcod=374'10076)", 2024-02-10T08:40:56.365 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:34:51.055068+0000", 2024-02-10T08:40:56.365 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 365.25446038299998, 2024-02-10T08:40:56.365 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.20236198399999999, 2024-02-10T08:40:56.365 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:40:56.365 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:40:56.366 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:40:56.366 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.366 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:40:56.366 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.055068+0000", 2024-02-10T08:40:56.366 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:40:56.366 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.366 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.366 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:40:56.366 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.055068+0000", 2024-02-10T08:40:56.366 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999986 2024-02-10T08:40:56.366 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.366 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.367 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:40:56.367 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.055067+0000", 2024-02-10T08:40:56.367 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2711000000000001e-05 2024-02-10T08:40:56.367 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.367 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.367 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:40:56.367 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.055080+0000", 2024-02-10T08:40:56.367 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7580000000000004e-06 2024-02-10T08:40:56.367 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.367 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.367 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:40:56.367 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.055089+0000", 2024-02-10T08:40:56.367 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0269999999999997e-06 2024-02-10T08:40:56.367 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.368 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.368 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:40:56.368 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.055093+0000", 2024-02-10T08:40:56.368 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010822099999999999 2024-02-10T08:40:56.368 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.368 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.368 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:40:56.368 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.056176+0000", 2024-02-10T08:40:56.368 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0899e-05 2024-02-10T08:40:56.368 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.368 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.368 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:40:56.369 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.056187+0000", 2024-02-10T08:40:56.369 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.201223438 2024-02-10T08:40:56.369 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.369 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.369 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:40:56.371 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.257410+0000", 2024-02-10T08:40:56.371 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0316e-05 2024-02-10T08:40:56.371 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.371 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.371 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:40:56.371 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.257430+0000", 2024-02-10T08:40:56.372 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.20236198399999999 2024-02-10T08:40:56.372 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:56.372 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:56.372 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:56.372 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.372 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.372 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.25369.0:159368 10.f e374/335 10:f0241dc0:::benchmark_data_smithi018_146618_object35565:head v 374'12543, mlcod=374'12524)", 2024-02-10T08:40:56.372 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:34:51.060562+0000", 2024-02-10T08:40:56.372 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 365.24896718000002, 2024-02-10T08:40:56.372 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.19941993999999999, 2024-02-10T08:40:56.372 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:40:56.372 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:40:56.373 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:40:56.373 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.373 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:40:56.373 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.060562+0000", 2024-02-10T08:40:56.373 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:40:56.373 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.373 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.373 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:40:56.373 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.060562+0000", 2024-02-10T08:40:56.373 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:40:56.373 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.373 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.373 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:40:56.373 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.060560+0000", 2024-02-10T08:40:56.373 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3298999999999999e-05 2024-02-10T08:40:56.374 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.374 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.374 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:40:56.374 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.060574+0000", 2024-02-10T08:40:56.374 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.194171652 2024-02-10T08:40:56.374 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.374 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.374 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:40:56.374 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.254745+0000", 2024-02-10T08:40:56.374 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.098e-05 2024-02-10T08:40:56.374 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.374 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.374 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:40:56.374 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.254756+0000", 2024-02-10T08:40:56.375 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2692999999999999e-05 2024-02-10T08:40:56.375 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.375 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.375 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:40:56.375 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.254799+0000", 2024-02-10T08:40:56.375 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.4176e-05 2024-02-10T08:40:56.375 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.375 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.375 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:40:56.375 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.254823+0000", 2024-02-10T08:40:56.375 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0051329469999999997 2024-02-10T08:40:56.375 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.375 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.375 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:40:56.375 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.259956+0000", 2024-02-10T08:40:56.376 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5333e-05 2024-02-10T08:40:56.376 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.376 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.376 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:40:56.376 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.259981+0000", 2024-02-10T08:40:56.376 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.19941993999999999 2024-02-10T08:40:56.376 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:56.376 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:56.376 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:56.376 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.376 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.376 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.25369.0:159385 10.5 e374/335 10:a2cbe603:::benchmark_data_smithi018_146618_object35582:head v 374'9807, mlcod=374'9805)", 2024-02-10T08:40:56.376 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:34:51.061990+0000", 2024-02-10T08:40:56.377 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 365.24753893500002, 2024-02-10T08:40:56.377 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.20089375700000001, 2024-02-10T08:40:56.377 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:40:56.377 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:40:56.377 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:40:56.377 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.377 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:40:56.377 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.061990+0000", 2024-02-10T08:40:56.377 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:40:56.377 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.377 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.377 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:40:56.377 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.061990+0000", 2024-02-10T08:40:56.377 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:40:56.378 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.378 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.378 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:40:56.378 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.061989+0000", 2024-02-10T08:40:56.378 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6489999999999997e-06 2024-02-10T08:40:56.378 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.378 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.378 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:40:56.378 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.061997+0000", 2024-02-10T08:40:56.378 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.192749482 2024-02-10T08:40:56.378 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.378 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.378 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:40:56.378 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.254747+0000", 2024-02-10T08:40:56.379 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0424e-05 2024-02-10T08:40:56.379 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.379 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.379 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:40:56.379 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.254757+0000", 2024-02-10T08:40:56.379 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6709000000000003e-05 2024-02-10T08:40:56.379 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.379 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.379 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:40:56.379 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.254804+0000", 2024-02-10T08:40:56.379 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.6973000000000001e-05 2024-02-10T08:40:56.379 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.379 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.379 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:40:56.380 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.254831+0000", 2024-02-10T08:40:56.380 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0080223359999999997 2024-02-10T08:40:56.380 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.380 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.380 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:40:56.380 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.262853+0000", 2024-02-10T08:40:56.380 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0209000000000002e-05 2024-02-10T08:40:56.380 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.380 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.380 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:40:56.380 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:51.262884+0000", 2024-02-10T08:40:56.380 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.20089375700000001 2024-02-10T08:40:56.380 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:56.380 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:56.381 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:56.381 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.381 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.381 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(osd.6.0:159440 10.f e375/335 10:f89948aa:::benchmark_data_smithi018_146618_object46104:head v 375'13243, mlcod=375'13223)", 2024-02-10T08:40:56.381 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:34:53.836362+0000", 2024-02-10T08:40:56.381 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 362.473166908, 2024-02-10T08:40:56.381 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.065421075999999995, 2024-02-10T08:40:56.381 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:40:56.381 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:40:56.381 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:40:56.381 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.381 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:40:56.381 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:53.836362+0000", 2024-02-10T08:40:56.382 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:40:56.382 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.382 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.382 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:40:56.382 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:53.836362+0000", 2024-02-10T08:40:56.382 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967296 2024-02-10T08:40:56.382 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.383 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.383 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:40:56.383 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:53.836362+0000", 2024-02-10T08:40:56.383 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5720000000000002e-06 2024-02-10T08:40:56.383 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.383 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.383 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:40:56.384 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:53.836367+0000", 2024-02-10T08:40:56.384 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6190000000000002e-06 2024-02-10T08:40:56.384 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.384 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.384 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:40:56.384 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:53.836372+0000", 2024-02-10T08:40:56.385 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.569e-06 2024-02-10T08:40:56.385 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.385 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.385 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:40:56.385 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:53.836375+0000", 2024-02-10T08:40:56.385 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011861541999999999 2024-02-10T08:40:56.385 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.385 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.385 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:40:56.385 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:53.848237+0000", 2024-02-10T08:40:56.385 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5038999999999999e-05 2024-02-10T08:40:56.385 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.385 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.386 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:40:56.386 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:53.848252+0000", 2024-02-10T08:40:56.386 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.053501711 2024-02-10T08:40:56.386 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.386 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.386 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:40:56.386 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:53.901754+0000", 2024-02-10T08:40:56.386 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9204e-05 2024-02-10T08:40:56.386 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.386 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.386 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:40:56.387 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:53.901783+0000", 2024-02-10T08:40:56.387 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.065421075999999995 2024-02-10T08:40:56.387 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:56.387 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:56.387 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:56.387 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.387 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.387 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(osd.6.0:159676 10.f e375/335 10:f8e3aa90:::benchmark_data_smithi018_146618_object118426:head v 375'13391, mlcod=375'13374)", 2024-02-10T08:40:56.387 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:34:54.417636+0000", 2024-02-10T08:40:56.387 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 361.89189305299999, 2024-02-10T08:40:56.387 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.064006720000000003, 2024-02-10T08:40:56.387 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:40:56.387 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:40:56.387 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:40:56.387 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.388 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:40:56.388 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:54.417636+0000", 2024-02-10T08:40:56.388 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:40:56.388 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.388 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.388 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:40:56.388 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:54.417636+0000", 2024-02-10T08:40:56.388 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:40:56.388 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.388 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.388 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:40:56.388 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:54.417635+0000", 2024-02-10T08:40:56.388 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.85e-06 2024-02-10T08:40:56.389 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.389 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.389 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:40:56.389 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:54.417644+0000", 2024-02-10T08:40:56.389 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0577000000000001e-05 2024-02-10T08:40:56.389 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.389 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.389 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:40:56.389 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:54.417654+0000", 2024-02-10T08:40:56.389 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2539999999999998e-06 2024-02-10T08:40:56.389 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.389 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.389 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:40:56.389 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:54.417660+0000", 2024-02-10T08:40:56.390 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.012529507 2024-02-10T08:40:56.390 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.390 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.390 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:40:56.390 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:54.430190+0000", 2024-02-10T08:40:56.390 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8542999999999998e-05 2024-02-10T08:40:56.390 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.390 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.390 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:40:56.391 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:54.430208+0000", 2024-02-10T08:40:56.391 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.051405525000000001 2024-02-10T08:40:56.391 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.391 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.391 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:40:56.391 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:54.481614+0000", 2024-02-10T08:40:56.391 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8447000000000001e-05 2024-02-10T08:40:56.391 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.391 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.391 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:40:56.391 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:34:54.481642+0000", 2024-02-10T08:40:56.391 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.064006720000000003 2024-02-10T08:40:56.391 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:56.391 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:56.392 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:56.392 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.392 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.392 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.25664.0:185971 11.8 e442/398 11:1763c313:::benchmark_data_smithi018_166993_object66846:head v 442'14778, mlcod=442'14776)", 2024-02-10T08:40:56.392 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:39:42.911298+0000", 2024-02-10T08:40:56.392 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 73.398231190999994, 2024-02-10T08:40:56.392 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.067210462999999998, 2024-02-10T08:40:56.392 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:40:56.392 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:40:56.392 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:40:56.392 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.392 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:40:56.393 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:42.911298+0000", 2024-02-10T08:40:56.393 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:40:56.393 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.393 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.393 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:40:56.393 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:42.911298+0000", 2024-02-10T08:40:56.393 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:40:56.393 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.393 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.393 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:40:56.393 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:42.911297+0000", 2024-02-10T08:40:56.393 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1888999999999999e-05 2024-02-10T08:40:56.393 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.393 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.394 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:40:56.394 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:42.911308+0000", 2024-02-10T08:40:56.394 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1117e-05 2024-02-10T08:40:56.394 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.394 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.394 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:40:56.394 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:42.911320+0000", 2024-02-10T08:40:56.394 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5060000000000001e-06 2024-02-10T08:40:56.394 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.394 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.394 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:40:56.394 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:42.911326+0000", 2024-02-10T08:40:56.394 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2474e-05 2024-02-10T08:40:56.394 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.395 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.395 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:40:56.395 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:42.911369+0000", 2024-02-10T08:40:56.395 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0562000000000001e-05 2024-02-10T08:40:56.395 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.395 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.395 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:40:56.395 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:42.911389+0000", 2024-02-10T08:40:56.395 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.067087442999999997 2024-02-10T08:40:56.396 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.396 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.396 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:40:56.396 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:42.978477+0000", 2024-02-10T08:40:56.396 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1439000000000002e-05 2024-02-10T08:40:56.396 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.396 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.396 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:40:56.396 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:42.978508+0000", 2024-02-10T08:40:56.396 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.067210462999999998 2024-02-10T08:40:56.396 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:56.397 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:56.397 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:56.397 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.397 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.397 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.25664.0:185974 11.9 e442/398 11:9e7d0c97:::benchmark_data_smithi018_166993_object66849:head v 442'11593, mlcod=442'11591)", 2024-02-10T08:40:56.397 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:39:42.911359+0000", 2024-02-10T08:40:56.397 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 73.398169816000006, 2024-02-10T08:40:56.397 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.065130769000000005, 2024-02-10T08:40:56.397 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:40:56.397 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:40:56.397 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:40:56.397 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.397 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:40:56.397 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:42.911359+0000", 2024-02-10T08:40:56.397 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:40:56.398 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.398 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.398 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:40:56.398 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:42.911359+0000", 2024-02-10T08:40:56.398 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.9999995 2024-02-10T08:40:56.398 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.398 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.398 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:40:56.398 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:42.911358+0000", 2024-02-10T08:40:56.398 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7140000000000001e-06 2024-02-10T08:40:56.398 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.398 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.398 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:40:56.398 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:42.911363+0000", 2024-02-10T08:40:56.398 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6930000000000001e-06 2024-02-10T08:40:56.399 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.399 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.399 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:40:56.399 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:42.911370+0000", 2024-02-10T08:40:56.399 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5199999999999999e-06 2024-02-10T08:40:56.399 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.399 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.399 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:40:56.399 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:42.911374+0000", 2024-02-10T08:40:56.399 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.061191810999999999 2024-02-10T08:40:56.399 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.399 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.399 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:40:56.399 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:42.972566+0000", 2024-02-10T08:40:56.400 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.4400999999999999e-05 2024-02-10T08:40:56.400 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.400 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.400 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:40:56.400 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:42.972591+0000", 2024-02-10T08:40:56.400 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0038714050000000001 2024-02-10T08:40:56.400 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.400 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.400 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:40:56.400 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:42.976462+0000", 2024-02-10T08:40:56.400 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7645e-05 2024-02-10T08:40:56.400 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.401 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.401 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:40:56.401 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:42.976490+0000", 2024-02-10T08:40:56.401 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.065130769000000005 2024-02-10T08:40:56.401 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:56.401 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:56.401 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:56.401 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.401 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.401 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.25664.0:185978 11.8 e442/398 11:14a69949:::benchmark_data_smithi018_166993_object66853:head v 442'14779, mlcod=442'14776)", 2024-02-10T08:40:56.401 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-02-10T08:39:42.912375+0000", 2024-02-10T08:40:56.401 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 73.397154098000001, 2024-02-10T08:40:56.401 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.067908613000000007, 2024-02-10T08:40:56.401 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-02-10T08:40:56.401 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-10T08:40:56.401 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-02-10T08:40:56.402 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.402 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-02-10T08:40:56.402 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:42.912375+0000", 2024-02-10T08:40:56.402 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-02-10T08:40:56.402 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.402 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.402 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-02-10T08:40:56.402 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:42.912375+0000", 2024-02-10T08:40:56.402 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4294967295.999999 2024-02-10T08:40:56.402 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.402 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.402 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-02-10T08:40:56.402 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:42.912374+0000", 2024-02-10T08:40:56.402 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3799e-05 2024-02-10T08:40:56.402 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.403 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.403 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-02-10T08:40:56.403 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:42.912388+0000", 2024-02-10T08:40:56.403 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6909999999999992e-06 2024-02-10T08:40:56.403 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.403 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.403 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-02-10T08:40:56.403 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:42.912397+0000", 2024-02-10T08:40:56.403 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1929999999999998e-06 2024-02-10T08:40:56.403 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.403 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.403 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-02-10T08:40:56.403 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:42.912403+0000", 2024-02-10T08:40:56.403 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010705739999999999 2024-02-10T08:40:56.403 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.403 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.404 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-02-10T08:40:56.404 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:42.913474+0000", 2024-02-10T08:40:56.404 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8253999999999998e-05 2024-02-10T08:40:56.404 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.404 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.404 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-02-10T08:40:56.404 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:42.913492+0000", 2024-02-10T08:40:56.404 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.066765319000000004 2024-02-10T08:40:56.404 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.404 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.404 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-02-10T08:40:56.404 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:42.980258+0000", 2024-02-10T08:40:56.404 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5626000000000002e-05 2024-02-10T08:40:56.404 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-02-10T08:40:56.404 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-02-10T08:40:56.405 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-02-10T08:40:56.405 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-02-10T08:39:42.980283+0000", 2024-02-10T08:40:56.405 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.067908613000000007 2024-02-10T08:40:56.405 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:56.405 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:56.405 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:56.405 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-02-10T08:40:56.405 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-02-10T08:40:56.405 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-02-10T08:40:56.789 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:40:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:40:56] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:40:56.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:40:55.220119+0000 mgr.y (mgr.14505) 903 : cluster [DBG] pgmap v1106: 162 pgs: 20 active+undersized+degraded, 48 active+undersized, 94 active+clean; 5.7 KiB data, 6.1 GiB used, 620 GiB / 626 GiB avail; 920 B/s rd, 0 op/s; 86/576 objects degraded (14.931%) 2024-02-10T08:40:56.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:40:56.548466+0000 mon.a (mon.0) 1876 : audit [DBG] from='client.? 172.21.15.18:0/3345791875' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:40:56.814 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-02-10T08:40:56.815 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-02-10T08:40:56.815 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-02-10T08:40:56.815 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-02-10T08:40:56.815 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-02-10T08:40:56.815 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-02-10T08:40:56.815 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-02-10T08:40:56.815 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-10T08:40:56.815 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-10T08:40:56.815 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-10T08:40:56.815 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-10T08:40:56.815 INFO:teuthology.orchestra.run.smithi018.stderr:Error ENXIO: problem getting command descriptions from osd.4 2024-02-10T08:40:56.815 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-10T08:40:56.815 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-10T08:40:56.816 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-10T08:40:57.133 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:40:55.220119+0000 mgr.y (mgr.14505) 903 : cluster [DBG] pgmap v1106: 162 pgs: 20 active+undersized+degraded, 48 active+undersized, 94 active+clean; 5.7 KiB data, 6.1 GiB used, 620 GiB / 626 GiB avail; 920 B/s rd, 0 op/s; 86/576 objects degraded (14.931%) 2024-02-10T08:40:57.134 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:40:56.548466+0000 mon.a (mon.0) 1876 : audit [DBG] from='client.? 172.21.15.18:0/3345791875' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:40:57.134 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:40:55.220119+0000 mgr.y (mgr.14505) 903 : cluster [DBG] pgmap v1106: 162 pgs: 20 active+undersized+degraded, 48 active+undersized, 94 active+clean; 5.7 KiB data, 6.1 GiB used, 620 GiB / 626 GiB avail; 920 B/s rd, 0 op/s; 86/576 objects degraded (14.931%) 2024-02-10T08:40:57.134 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:40:56.548466+0000 mon.a (mon.0) 1876 : audit [DBG] from='client.? 172.21.15.18:0/3345791875' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-10T08:40:57.404 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:40:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:40:57] "GET /metrics HTTP/1.1" 200 176544 "" "Prometheus/2.33.4" 2024-02-10T08:40:57.618 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-02-10T08:40:57.619 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-02-10T08:40:58.360 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.5 dump_ops_in_flight 2024-02-10T08:40:58.636 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:40:59.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:40:57.220578+0000 mgr.y (mgr.14505) 904 : cluster [DBG] pgmap v1107: 162 pgs: 20 active+undersized+degraded, 48 active+undersized, 94 active+clean; 5.7 KiB data, 6.1 GiB used, 620 GiB / 626 GiB avail; 920 B/s rd, 0 op/s; 86/576 objects degraded (14.931%) 2024-02-10T08:40:59.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:40:57.220578+0000 mgr.y (mgr.14505) 904 : cluster [DBG] pgmap v1107: 162 pgs: 20 active+undersized+degraded, 48 active+undersized, 94 active+clean; 5.7 KiB data, 6.1 GiB used, 620 GiB / 626 GiB avail; 920 B/s rd, 0 op/s; 86/576 objects degraded (14.931%) 2024-02-10T08:40:59.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:40:57.220578+0000 mgr.y (mgr.14505) 904 : cluster [DBG] pgmap v1107: 162 pgs: 20 active+undersized+degraded, 48 active+undersized, 94 active+clean; 5.7 KiB data, 6.1 GiB used, 620 GiB / 626 GiB avail; 920 B/s rd, 0 op/s; 86/576 objects degraded (14.931%) 2024-02-10T08:40:59.511 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:40:59 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:40:59.738 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is unset 2024-02-10T08:40:59.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:59 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:40:58.842133+0000 mon.c (mon.2) 107 : audit [INF] from='client.? 172.21.15.18:0/2081649204' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:40:59.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:40:59 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:40:58.842505+0000 mon.a (mon.0) 1877 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:41:00.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:40:58.842133+0000 mon.c (mon.2) 107 : audit [INF] from='client.? 172.21.15.18:0/2081649204' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:41:00.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:40:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:40:58.842505+0000 mon.a (mon.0) 1877 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:41:00.136 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:40:58.842133+0000 mon.c (mon.2) 107 : audit [INF] from='client.? 172.21.15.18:0/2081649204' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:41:00.136 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:40:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:40:58.842505+0000 mon.a (mon.0) 1877 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:41:00.220 INFO:tasks.thrashosds.thrasher:reviving osd 2024-02-10T08:41:00.220 INFO:tasks.thrashosds.thrasher:Reviving osd 4 2024-02-10T08:41:00.220 INFO:tasks.cephadm.osd.4:Restarting osd.4 (starting--it wasn't running)... 2024-02-10T08:41:00.220 DEBUG:teuthology.orchestra.run.smithi071:osd.4> sudo journalctl -f -n 0 -u ceph-d46257c8-c7eb-11ee-95b8-87774f69a715@osd.4.service 2024-02-10T08:41:00.224 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl start ceph-d46257c8-c7eb-11ee-95b8-87774f69a715@osd.4 2024-02-10T08:41:00.259 INFO:journalctl@ceph.osd.4.smithi071.stdout:-- Logs begin at Sat 2024-02-10 07:59:38 UTC. -- 2024-02-10T08:41:00.402 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-02-10T08:41:00.403 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:41:00.421 INFO:journalctl@ceph.osd.4.smithi071.stdout:Feb 10 08:41:00 smithi071 systemd[1]: Starting Ceph osd.4 for d46257c8-c7eb-11ee-95b8-87774f69a715... 2024-02-10T08:41:00.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:40:59.068546+0000 mgr.y (mgr.14505) 905 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:41:00.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:40:59.221502+0000 mgr.y (mgr.14505) 906 : cluster [DBG] pgmap v1108: 162 pgs: 20 active+undersized+degraded, 48 active+undersized, 94 active+clean; 5.7 KiB data, 6.1 GiB used, 620 GiB / 626 GiB avail; 920 B/s rd, 0 op/s; 86/576 objects degraded (14.931%) 2024-02-10T08:41:00.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:40:59.549012+0000 osd.2 (osd.2) 271 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:41:00.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:40:59.549090+0000 osd.2 (osd.2) 272 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:41:00.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:40:59.722844+0000 mon.a (mon.0) 1878 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:41:00.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:40:59.731293+0000 mon.a (mon.0) 1879 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-10T08:41:00.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:40:59.731402+0000 mon.a (mon.0) 1880 : cluster [DBG] osdmap e459: 8 total, 7 up, 7 in 2024-02-10T08:41:00.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:40:59.068546+0000 mgr.y (mgr.14505) 905 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:41:00.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:40:59.221502+0000 mgr.y (mgr.14505) 906 : cluster [DBG] pgmap v1108: 162 pgs: 20 active+undersized+degraded, 48 active+undersized, 94 active+clean; 5.7 KiB data, 6.1 GiB used, 620 GiB / 626 GiB avail; 920 B/s rd, 0 op/s; 86/576 objects degraded (14.931%) 2024-02-10T08:41:00.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:40:59.549012+0000 osd.2 (osd.2) 271 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:41:00.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:40:59.549090+0000 osd.2 (osd.2) 272 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:41:00.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:40:59.722844+0000 mon.a (mon.0) 1878 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:41:00.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:40:59.731293+0000 mon.a (mon.0) 1879 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-10T08:41:00.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:40:59.731402+0000 mon.a (mon.0) 1880 : cluster [DBG] osdmap e459: 8 total, 7 up, 7 in 2024-02-10T08:41:01.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:40:59.068546+0000 mgr.y (mgr.14505) 905 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:41:01.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:40:59.221502+0000 mgr.y (mgr.14505) 906 : cluster [DBG] pgmap v1108: 162 pgs: 20 active+undersized+degraded, 48 active+undersized, 94 active+clean; 5.7 KiB data, 6.1 GiB used, 620 GiB / 626 GiB avail; 920 B/s rd, 0 op/s; 86/576 objects degraded (14.931%) 2024-02-10T08:41:01.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:40:59.549012+0000 osd.2 (osd.2) 271 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:41:01.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:40:59.549090+0000 osd.2 (osd.2) 272 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:41:01.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:40:59.722844+0000 mon.a (mon.0) 1878 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-10T08:41:01.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:40:59.731293+0000 mon.a (mon.0) 1879 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-10T08:41:01.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:40:59.731402+0000 mon.a (mon.0) 1880 : cluster [DBG] osdmap e459: 8 total, 7 up, 7 in 2024-02-10T08:41:01.986 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:00.068900+0000 osd.2 (osd.2) 273 : cluster [DBG] 2.10 scrub starts 2024-02-10T08:41:01.986 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:00.071811+0000 osd.2 (osd.2) 274 : cluster [DBG] 2.10 scrub ok 2024-02-10T08:41:01.987 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:00.386270+0000 osd.6 (osd.6) 289 : cluster [DBG] 6.22 scrub starts 2024-02-10T08:41:01.987 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:00.387127+0000 osd.6 (osd.6) 290 : cluster [DBG] 6.22 scrub ok 2024-02-10T08:41:01.987 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:00.615222+0000 osd.1 (osd.1) 319 : cluster [DBG] 6.26 scrub starts 2024-02-10T08:41:01.987 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:00.618350+0000 osd.1 (osd.1) 320 : cluster [DBG] 6.26 scrub ok 2024-02-10T08:41:01.987 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:00.642552+0000 osd.0 (osd.0) 282 : cluster [DBG] 5.3 scrub starts 2024-02-10T08:41:01.987 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:00.644065+0000 osd.0 (osd.0) 283 : cluster [DBG] 5.3 scrub ok 2024-02-10T08:41:01.987 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:41:01.696810+0000 mon.a (mon.0) 1881 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:41:01.987 INFO:journalctl@ceph.osd.4.smithi071.stdout:Feb 10 08:41:01 smithi071 bash[131713]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-02-10T08:41:01.987 INFO:journalctl@ceph.osd.4.smithi071.stdout:Feb 10 08:41:01 smithi071 bash[131713]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-02-10T08:41:01.987 INFO:journalctl@ceph.osd.4.smithi071.stdout:Feb 10 08:41:01 smithi071 bash[131713]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-4 --no-mon-config 2024-02-10T08:41:01.987 INFO:journalctl@ceph.osd.4.smithi071.stdout:Feb 10 08:41:01 smithi071 bash[131713]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-4/block 2024-02-10T08:41:01.987 INFO:journalctl@ceph.osd.4.smithi071.stdout:Feb 10 08:41:01 smithi071 bash[131713]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-4/block 2024-02-10T08:41:01.988 INFO:journalctl@ceph.osd.4.smithi071.stdout:Feb 10 08:41:01 smithi071 bash[131713]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-02-10T08:41:01.988 INFO:journalctl@ceph.osd.4.smithi071.stdout:Feb 10 08:41:01 smithi071 bash[131713]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-02-10T08:41:01.988 INFO:journalctl@ceph.osd.4.smithi071.stdout:Feb 10 08:41:01 smithi071 bash[131713]: --> ceph-volume lvm activate successful for osd ID: 4 2024-02-10T08:41:02.004 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.5 dump_blocked_ops 2024-02-10T08:41:02.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:00.068900+0000 osd.2 (osd.2) 273 : cluster [DBG] 2.10 scrub starts 2024-02-10T08:41:02.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:00.071811+0000 osd.2 (osd.2) 274 : cluster [DBG] 2.10 scrub ok 2024-02-10T08:41:02.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:00.386270+0000 osd.6 (osd.6) 289 : cluster [DBG] 6.22 scrub starts 2024-02-10T08:41:02.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:00.387127+0000 osd.6 (osd.6) 290 : cluster [DBG] 6.22 scrub ok 2024-02-10T08:41:02.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:00.615222+0000 osd.1 (osd.1) 319 : cluster [DBG] 6.26 scrub starts 2024-02-10T08:41:02.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:00.618350+0000 osd.1 (osd.1) 320 : cluster [DBG] 6.26 scrub ok 2024-02-10T08:41:02.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:00.642552+0000 osd.0 (osd.0) 282 : cluster [DBG] 5.3 scrub starts 2024-02-10T08:41:02.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:00.644065+0000 osd.0 (osd.0) 283 : cluster [DBG] 5.3 scrub ok 2024-02-10T08:41:02.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:41:01.696810+0000 mon.a (mon.0) 1881 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:41:02.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:00.068900+0000 osd.2 (osd.2) 273 : cluster [DBG] 2.10 scrub starts 2024-02-10T08:41:02.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:00.071811+0000 osd.2 (osd.2) 274 : cluster [DBG] 2.10 scrub ok 2024-02-10T08:41:02.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:00.386270+0000 osd.6 (osd.6) 289 : cluster [DBG] 6.22 scrub starts 2024-02-10T08:41:02.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:00.387127+0000 osd.6 (osd.6) 290 : cluster [DBG] 6.22 scrub ok 2024-02-10T08:41:02.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:00.615222+0000 osd.1 (osd.1) 319 : cluster [DBG] 6.26 scrub starts 2024-02-10T08:41:02.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:00.618350+0000 osd.1 (osd.1) 320 : cluster [DBG] 6.26 scrub ok 2024-02-10T08:41:02.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:00.642552+0000 osd.0 (osd.0) 282 : cluster [DBG] 5.3 scrub starts 2024-02-10T08:41:02.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:00.644065+0000 osd.0 (osd.0) 283 : cluster [DBG] 5.3 scrub ok 2024-02-10T08:41:02.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:41:01.696810+0000 mon.a (mon.0) 1881 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:41:02.594 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd unset noscrub 2024-02-10T08:41:02.692 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:41:02.889 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:41:02.903 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:01.032867+0000 osd.2 (osd.2) 275 : cluster [DBG] 6.2d scrub starts 2024-02-10T08:41:02.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:01.125288+0000 osd.2 (osd.2) 276 : cluster [DBG] 6.2d scrub ok 2024-02-10T08:41:02.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:01.222010+0000 mgr.y (mgr.14505) 907 : cluster [DBG] pgmap v1110: 162 pgs: 20 active+undersized+degraded, 48 active+undersized, 94 active+clean; 5.7 KiB data, 6.1 GiB used, 620 GiB / 626 GiB avail; 1023 B/s rd, 0 op/s; 86/576 objects degraded (14.931%) 2024-02-10T08:41:02.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:01.032867+0000 osd.2 (osd.2) 275 : cluster [DBG] 6.2d scrub starts 2024-02-10T08:41:02.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:01.125288+0000 osd.2 (osd.2) 276 : cluster [DBG] 6.2d scrub ok 2024-02-10T08:41:02.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:01.222010+0000 mgr.y (mgr.14505) 907 : cluster [DBG] pgmap v1110: 162 pgs: 20 active+undersized+degraded, 48 active+undersized, 94 active+clean; 5.7 KiB data, 6.1 GiB used, 620 GiB / 626 GiB avail; 1023 B/s rd, 0 op/s; 86/576 objects degraded (14.931%) 2024-02-10T08:41:02.995 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:01.032867+0000 osd.2 (osd.2) 275 : cluster [DBG] 6.2d scrub starts 2024-02-10T08:41:02.995 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:01.125288+0000 osd.2 (osd.2) 276 : cluster [DBG] 6.2d scrub ok 2024-02-10T08:41:02.995 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:01.222010+0000 mgr.y (mgr.14505) 907 : cluster [DBG] pgmap v1110: 162 pgs: 20 active+undersized+degraded, 48 active+undersized, 94 active+clean; 5.7 KiB data, 6.1 GiB used, 620 GiB / 626 GiB avail; 1023 B/s rd, 0 op/s; 86/576 objects degraded (14.931%) 2024-02-10T08:41:03.603 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.4 dump_ops_in_flight 2024-02-10T08:41:03.735 INFO:journalctl@ceph.osd.4.smithi071.stdout:Feb 10 08:41:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-4[132092]: debug 2024-02-10T08:41:03.513+0000 7f0cd7b16700 1 -- 172.21.15.71:0/3384513648 <== mon.1 v2:172.21.15.71:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5567ece2a680 con 0x5567ecdf1800 2024-02-10T08:41:03.736 INFO:journalctl@ceph.osd.4.smithi071.stdout:Feb 10 08:41:03 smithi071 bash[132067]: ef884774ac7e3978f47f33cbef08079fae78adfc13823a1938b19ca7f214dd02 2024-02-10T08:41:03.736 INFO:journalctl@ceph.osd.4.smithi071.stdout:Feb 10 08:41:03 smithi071 systemd[1]: Started Ceph osd.4 for d46257c8-c7eb-11ee-95b8-87774f69a715. 2024-02-10T08:41:04.002 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:02.058315+0000 osd.2 (osd.2) 277 : cluster [DBG] 2.e scrub starts 2024-02-10T08:41:04.002 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:02.059300+0000 osd.2 (osd.2) 278 : cluster [DBG] 2.e scrub ok 2024-02-10T08:41:04.002 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:02.708376+0000 osd.1 (osd.1) 321 : cluster [DBG] 2.0 scrub starts 2024-02-10T08:41:04.002 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:02.711278+0000 osd.1 (osd.1) 322 : cluster [DBG] 2.0 scrub ok 2024-02-10T08:41:04.002 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:02.058315+0000 osd.2 (osd.2) 277 : cluster [DBG] 2.e scrub starts 2024-02-10T08:41:04.002 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:02.059300+0000 osd.2 (osd.2) 278 : cluster [DBG] 2.e scrub ok 2024-02-10T08:41:04.002 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:02.708376+0000 osd.1 (osd.1) 321 : cluster [DBG] 2.0 scrub starts 2024-02-10T08:41:04.002 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:02.711278+0000 osd.1 (osd.1) 322 : cluster [DBG] 2.0 scrub ok 2024-02-10T08:41:04.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:02.058315+0000 osd.2 (osd.2) 277 : cluster [DBG] 2.e scrub starts 2024-02-10T08:41:04.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:02.059300+0000 osd.2 (osd.2) 278 : cluster [DBG] 2.e scrub ok 2024-02-10T08:41:04.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:02.708376+0000 osd.1 (osd.1) 321 : cluster [DBG] 2.0 scrub starts 2024-02-10T08:41:04.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:02.711278+0000 osd.1 (osd.1) 322 : cluster [DBG] 2.0 scrub ok 2024-02-10T08:41:04.289 INFO:journalctl@ceph.osd.4.smithi071.stdout:Feb 10 08:41:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-4[132092]: debug 2024-02-10T08:41:04.042+0000 7f0cdf5a4380 -1 Falling back to public interface 2024-02-10T08:41:04.420 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:41:05.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:03.107045+0000 osd.2 (osd.2) 279 : cluster [DBG] 5.b scrub starts 2024-02-10T08:41:05.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:03.107856+0000 osd.2 (osd.2) 280 : cluster [DBG] 5.b scrub ok 2024-02-10T08:41:05.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:03.222747+0000 mgr.y (mgr.14505) 908 : cluster [DBG] pgmap v1111: 162 pgs: 20 active+undersized+degraded, 48 active+undersized, 94 active+clean; 5.7 KiB data, 6.1 GiB used, 620 GiB / 626 GiB avail; 1023 B/s rd, 0 op/s; 86/576 objects degraded (14.931%) 2024-02-10T08:41:05.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:03.267373+0000 osd.5 (osd.5) 290 : cluster [DBG] 5.15 scrub starts 2024-02-10T08:41:05.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:03.270842+0000 osd.5 (osd.5) 291 : cluster [DBG] 5.15 scrub ok 2024-02-10T08:41:05.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:03.289232+0000 osd.6 (osd.6) 291 : cluster [DBG] 6.27 scrub starts 2024-02-10T08:41:05.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:03.395470+0000 osd.6 (osd.6) 292 : cluster [DBG] 6.27 scrub ok 2024-02-10T08:41:05.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:03.540813+0000 osd.0 (osd.0) 284 : cluster [DBG] 5.1e scrub starts 2024-02-10T08:41:05.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:03.543701+0000 osd.0 (osd.0) 285 : cluster [DBG] 5.1e scrub ok 2024-02-10T08:41:05.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:03.672788+0000 osd.1 (osd.1) 323 : cluster [DBG] 4.4 scrub starts 2024-02-10T08:41:05.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:03.676261+0000 osd.1 (osd.1) 324 : cluster [DBG] 4.4 scrub ok 2024-02-10T08:41:05.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:03.107045+0000 osd.2 (osd.2) 279 : cluster [DBG] 5.b scrub starts 2024-02-10T08:41:05.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:03.107856+0000 osd.2 (osd.2) 280 : cluster [DBG] 5.b scrub ok 2024-02-10T08:41:05.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:03.222747+0000 mgr.y (mgr.14505) 908 : cluster [DBG] pgmap v1111: 162 pgs: 20 active+undersized+degraded, 48 active+undersized, 94 active+clean; 5.7 KiB data, 6.1 GiB used, 620 GiB / 626 GiB avail; 1023 B/s rd, 0 op/s; 86/576 objects degraded (14.931%) 2024-02-10T08:41:05.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:03.267373+0000 osd.5 (osd.5) 290 : cluster [DBG] 5.15 scrub starts 2024-02-10T08:41:05.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:03.270842+0000 osd.5 (osd.5) 291 : cluster [DBG] 5.15 scrub ok 2024-02-10T08:41:05.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:03.289232+0000 osd.6 (osd.6) 291 : cluster [DBG] 6.27 scrub starts 2024-02-10T08:41:05.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:03.395470+0000 osd.6 (osd.6) 292 : cluster [DBG] 6.27 scrub ok 2024-02-10T08:41:05.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:03.540813+0000 osd.0 (osd.0) 284 : cluster [DBG] 5.1e scrub starts 2024-02-10T08:41:05.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:03.543701+0000 osd.0 (osd.0) 285 : cluster [DBG] 5.1e scrub ok 2024-02-10T08:41:05.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:03.672788+0000 osd.1 (osd.1) 323 : cluster [DBG] 4.4 scrub starts 2024-02-10T08:41:05.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:03.676261+0000 osd.1 (osd.1) 324 : cluster [DBG] 4.4 scrub ok 2024-02-10T08:41:05.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:03.107045+0000 osd.2 (osd.2) 279 : cluster [DBG] 5.b scrub starts 2024-02-10T08:41:05.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:03.107856+0000 osd.2 (osd.2) 280 : cluster [DBG] 5.b scrub ok 2024-02-10T08:41:05.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:03.222747+0000 mgr.y (mgr.14505) 908 : cluster [DBG] pgmap v1111: 162 pgs: 20 active+undersized+degraded, 48 active+undersized, 94 active+clean; 5.7 KiB data, 6.1 GiB used, 620 GiB / 626 GiB avail; 1023 B/s rd, 0 op/s; 86/576 objects degraded (14.931%) 2024-02-10T08:41:05.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:03.267373+0000 osd.5 (osd.5) 290 : cluster [DBG] 5.15 scrub starts 2024-02-10T08:41:05.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:03.270842+0000 osd.5 (osd.5) 291 : cluster [DBG] 5.15 scrub ok 2024-02-10T08:41:05.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:03.289232+0000 osd.6 (osd.6) 291 : cluster [DBG] 6.27 scrub starts 2024-02-10T08:41:05.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:03.395470+0000 osd.6 (osd.6) 292 : cluster [DBG] 6.27 scrub ok 2024-02-10T08:41:05.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:03.540813+0000 osd.0 (osd.0) 284 : cluster [DBG] 5.1e scrub starts 2024-02-10T08:41:05.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:03.543701+0000 osd.0 (osd.0) 285 : cluster [DBG] 5.1e scrub ok 2024-02-10T08:41:05.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:03.672788+0000 osd.1 (osd.1) 323 : cluster [DBG] 4.4 scrub starts 2024-02-10T08:41:05.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:03.676261+0000 osd.1 (osd.1) 324 : cluster [DBG] 4.4 scrub ok 2024-02-10T08:41:05.199 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-02-10T08:41:05.199 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:41:05.831 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is unset 2024-02-10T08:41:06.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:04.580992+0000 osd.0 (osd.0) 286 : cluster [DBG] 1.6 scrub starts 2024-02-10T08:41:06.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:04.583901+0000 osd.0 (osd.0) 287 : cluster [DBG] 1.6 scrub ok 2024-02-10T08:41:06.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:04.694206+0000 osd.1 (osd.1) 325 : cluster [DBG] 5.17 scrub starts 2024-02-10T08:41:06.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:04.697095+0000 osd.1 (osd.1) 326 : cluster [DBG] 5.17 scrub ok 2024-02-10T08:41:06.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:41:05.168920+0000 mon.c (mon.2) 108 : audit [INF] from='client.? 172.21.15.18:0/3894018418' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:41:06.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:41:05.169181+0000 mon.a (mon.0) 1882 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:41:06.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:04.580992+0000 osd.0 (osd.0) 286 : cluster [DBG] 1.6 scrub starts 2024-02-10T08:41:06.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:04.583901+0000 osd.0 (osd.0) 287 : cluster [DBG] 1.6 scrub ok 2024-02-10T08:41:06.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:04.694206+0000 osd.1 (osd.1) 325 : cluster [DBG] 5.17 scrub starts 2024-02-10T08:41:06.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:04.697095+0000 osd.1 (osd.1) 326 : cluster [DBG] 5.17 scrub ok 2024-02-10T08:41:06.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:41:05.168920+0000 mon.c (mon.2) 108 : audit [INF] from='client.? 172.21.15.18:0/3894018418' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:41:06.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:41:05.169181+0000 mon.a (mon.0) 1882 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:41:06.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:04.580992+0000 osd.0 (osd.0) 286 : cluster [DBG] 1.6 scrub starts 2024-02-10T08:41:06.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:04.583901+0000 osd.0 (osd.0) 287 : cluster [DBG] 1.6 scrub ok 2024-02-10T08:41:06.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:04.694206+0000 osd.1 (osd.1) 325 : cluster [DBG] 5.17 scrub starts 2024-02-10T08:41:06.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:04.697095+0000 osd.1 (osd.1) 326 : cluster [DBG] 5.17 scrub ok 2024-02-10T08:41:06.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:41:05.168920+0000 mon.c (mon.2) 108 : audit [INF] from='client.? 172.21.15.18:0/3894018418' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:41:06.156 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:41:05.169181+0000 mon.a (mon.0) 1882 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-10T08:41:06.753 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd unset nodeep-scrub 2024-02-10T08:41:06.789 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:41:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:41:06] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:41:06.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:05.223519+0000 mgr.y (mgr.14505) 909 : cluster [DBG] pgmap v1112: 162 pgs: 20 active+undersized+degraded, 48 active+undersized, 94 active+clean; 5.7 KiB data, 6.1 GiB used, 620 GiB / 626 GiB avail; 1023 B/s rd, 0 op/s; 86/576 objects degraded (14.931%) 2024-02-10T08:41:06.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:05.676111+0000 osd.1 (osd.1) 327 : cluster [DBG] 3.0 scrub starts 2024-02-10T08:41:06.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:05.679565+0000 osd.1 (osd.1) 328 : cluster [DBG] 3.0 scrub ok 2024-02-10T08:41:06.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:41:05.744997+0000 mon.a (mon.0) 1883 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-10T08:41:06.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:05.745091+0000 mon.a (mon.0) 1884 : cluster [DBG] osdmap e460: 8 total, 7 up, 7 in 2024-02-10T08:41:06.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:05.776413+0000 osd.5 (osd.5) 292 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:41:06.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:05.776457+0000 osd.5 (osd.5) 293 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:41:06.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:05.901671+0000 osd.6 (osd.6) 293 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:41:06.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:05.901713+0000 osd.6 (osd.6) 294 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:41:06.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:06.098418+0000 mon.a (mon.0) 1885 : cluster [DBG] osdmap e461: 8 total, 7 up, 7 in 2024-02-10T08:41:07.034 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:41:07.152 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:05.223519+0000 mgr.y (mgr.14505) 909 : cluster [DBG] pgmap v1112: 162 pgs: 20 active+undersized+degraded, 48 active+undersized, 94 active+clean; 5.7 KiB data, 6.1 GiB used, 620 GiB / 626 GiB avail; 1023 B/s rd, 0 op/s; 86/576 objects degraded (14.931%) 2024-02-10T08:41:07.153 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:05.676111+0000 osd.1 (osd.1) 327 : cluster [DBG] 3.0 scrub starts 2024-02-10T08:41:07.153 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:05.679565+0000 osd.1 (osd.1) 328 : cluster [DBG] 3.0 scrub ok 2024-02-10T08:41:07.153 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:41:05.744997+0000 mon.a (mon.0) 1883 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-10T08:41:07.153 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:05.745091+0000 mon.a (mon.0) 1884 : cluster [DBG] osdmap e460: 8 total, 7 up, 7 in 2024-02-10T08:41:07.153 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:05.776413+0000 osd.5 (osd.5) 292 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:41:07.153 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:05.776457+0000 osd.5 (osd.5) 293 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:41:07.153 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:05.901671+0000 osd.6 (osd.6) 293 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:41:07.153 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:05.901713+0000 osd.6 (osd.6) 294 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:41:07.153 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:06.098418+0000 mon.a (mon.0) 1885 : cluster [DBG] osdmap e461: 8 total, 7 up, 7 in 2024-02-10T08:41:07.153 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:05.223519+0000 mgr.y (mgr.14505) 909 : cluster [DBG] pgmap v1112: 162 pgs: 20 active+undersized+degraded, 48 active+undersized, 94 active+clean; 5.7 KiB data, 6.1 GiB used, 620 GiB / 626 GiB avail; 1023 B/s rd, 0 op/s; 86/576 objects degraded (14.931%) 2024-02-10T08:41:07.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:05.676111+0000 osd.1 (osd.1) 327 : cluster [DBG] 3.0 scrub starts 2024-02-10T08:41:07.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:05.679565+0000 osd.1 (osd.1) 328 : cluster [DBG] 3.0 scrub ok 2024-02-10T08:41:07.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:41:05.744997+0000 mon.a (mon.0) 1883 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-10T08:41:07.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:05.745091+0000 mon.a (mon.0) 1884 : cluster [DBG] osdmap e460: 8 total, 7 up, 7 in 2024-02-10T08:41:07.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:05.776413+0000 osd.5 (osd.5) 292 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:41:07.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:05.776457+0000 osd.5 (osd.5) 293 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:41:07.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:05.901671+0000 osd.6 (osd.6) 293 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:41:07.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:05.901713+0000 osd.6 (osd.6) 294 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:41:07.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:06.098418+0000 mon.a (mon.0) 1885 : cluster [DBG] osdmap e461: 8 total, 7 up, 7 in 2024-02-10T08:41:07.403 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:41:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:41:07] "GET /metrics HTTP/1.1" 200 174160 "" "Prometheus/2.33.4" 2024-02-10T08:41:07.539 INFO:journalctl@ceph.osd.4.smithi071.stdout:Feb 10 08:41:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-4[132092]: debug 2024-02-10T08:41:07.135+0000 7f0cdf5a4380 -1 osd.4 453 log_to_monitors {default=true} 2024-02-10T08:41:07.820 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.5 dump_historic_ops 2024-02-10T08:41:07.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:06.041079+0000 osd.2 (osd.2) 281 : cluster [DBG] 2.c scrub starts 2024-02-10T08:41:07.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:06.042057+0000 osd.2 (osd.2) 282 : cluster [DBG] 2.c scrub ok 2024-02-10T08:41:07.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:06.336173+0000 osd.6 (osd.6) 295 : cluster [DBG] 6.1f scrub starts 2024-02-10T08:41:07.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:06.459633+0000 osd.6 (osd.6) 296 : cluster [DBG] 6.1f scrub ok 2024-02-10T08:41:07.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:06.695027+0000 osd.1 (osd.1) 329 : cluster [DBG] 2.9 scrub starts 2024-02-10T08:41:07.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:06.697918+0000 osd.1 (osd.1) 330 : cluster [DBG] 2.9 scrub ok 2024-02-10T08:41:07.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:41:07.139893+0000 mon.b (mon.1) 100 : audit [INF] from='osd.4 v2:172.21.15.71:6800/1915668731' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-10T08:41:07.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:41:07.140213+0000 mon.a (mon.0) 1886 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-10T08:41:07.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:06.041079+0000 osd.2 (osd.2) 281 : cluster [DBG] 2.c scrub starts 2024-02-10T08:41:07.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:06.042057+0000 osd.2 (osd.2) 282 : cluster [DBG] 2.c scrub ok 2024-02-10T08:41:07.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:06.336173+0000 osd.6 (osd.6) 295 : cluster [DBG] 6.1f scrub starts 2024-02-10T08:41:07.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:06.459633+0000 osd.6 (osd.6) 296 : cluster [DBG] 6.1f scrub ok 2024-02-10T08:41:07.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:06.695027+0000 osd.1 (osd.1) 329 : cluster [DBG] 2.9 scrub starts 2024-02-10T08:41:07.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:06.697918+0000 osd.1 (osd.1) 330 : cluster [DBG] 2.9 scrub ok 2024-02-10T08:41:07.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:41:07.139893+0000 mon.b (mon.1) 100 : audit [INF] from='osd.4 v2:172.21.15.71:6800/1915668731' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-10T08:41:07.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:41:07.140213+0000 mon.a (mon.0) 1886 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-10T08:41:08.039 INFO:journalctl@ceph.osd.4.smithi071.stdout:Feb 10 08:41:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-4[132092]: debug 2024-02-10T08:41:07.807+0000 7f0ccf288700 -1 osd.4 462 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-10T08:41:08.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:06.041079+0000 osd.2 (osd.2) 281 : cluster [DBG] 2.c scrub starts 2024-02-10T08:41:08.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:06.042057+0000 osd.2 (osd.2) 282 : cluster [DBG] 2.c scrub ok 2024-02-10T08:41:08.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:06.336173+0000 osd.6 (osd.6) 295 : cluster [DBG] 6.1f scrub starts 2024-02-10T08:41:08.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:06.459633+0000 osd.6 (osd.6) 296 : cluster [DBG] 6.1f scrub ok 2024-02-10T08:41:08.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:06.695027+0000 osd.1 (osd.1) 329 : cluster [DBG] 2.9 scrub starts 2024-02-10T08:41:08.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:06.697918+0000 osd.1 (osd.1) 330 : cluster [DBG] 2.9 scrub ok 2024-02-10T08:41:08.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:41:07.139893+0000 mon.b (mon.1) 100 : audit [INF] from='osd.4 v2:172.21.15.71:6800/1915668731' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-10T08:41:08.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:41:07.140213+0000 mon.a (mon.0) 1886 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-10T08:41:08.888 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:07.223894+0000 mgr.y (mgr.14505) 910 : cluster [DBG] pgmap v1115: 162 pgs: 20 active+undersized+degraded, 48 active+undersized, 94 active+clean; 5.7 KiB data, 6.1 GiB used, 620 GiB / 626 GiB avail; 682 B/s rd, 0 op/s; 86/576 objects degraded (14.931%) 2024-02-10T08:41:08.888 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:41:07.751186+0000 mon.a (mon.0) 1887 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-10T08:41:08.888 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:07.751260+0000 mon.a (mon.0) 1888 : cluster [DBG] osdmap e462: 8 total, 7 up, 7 in 2024-02-10T08:41:08.888 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:41:07.753702+0000 mon.b (mon.1) 101 : audit [INF] from='osd.4 v2:172.21.15.71:6800/1915668731' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-02-10T08:41:08.889 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:41:07.754114+0000 mon.a (mon.0) 1889 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-02-10T08:41:08.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:07.223894+0000 mgr.y (mgr.14505) 910 : cluster [DBG] pgmap v1115: 162 pgs: 20 active+undersized+degraded, 48 active+undersized, 94 active+clean; 5.7 KiB data, 6.1 GiB used, 620 GiB / 626 GiB avail; 682 B/s rd, 0 op/s; 86/576 objects degraded (14.931%) 2024-02-10T08:41:08.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:41:07.751186+0000 mon.a (mon.0) 1887 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-10T08:41:08.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:07.751260+0000 mon.a (mon.0) 1888 : cluster [DBG] osdmap e462: 8 total, 7 up, 7 in 2024-02-10T08:41:08.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:41:07.753702+0000 mon.b (mon.1) 101 : audit [INF] from='osd.4 v2:172.21.15.71:6800/1915668731' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-02-10T08:41:08.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:41:07.754114+0000 mon.a (mon.0) 1889 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-02-10T08:41:08.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:07.223894+0000 mgr.y (mgr.14505) 910 : cluster [DBG] pgmap v1115: 162 pgs: 20 active+undersized+degraded, 48 active+undersized, 94 active+clean; 5.7 KiB data, 6.1 GiB used, 620 GiB / 626 GiB avail; 682 B/s rd, 0 op/s; 86/576 objects degraded (14.931%) 2024-02-10T08:41:08.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:41:07.751186+0000 mon.a (mon.0) 1887 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-10T08:41:08.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:07.751260+0000 mon.a (mon.0) 1888 : cluster [DBG] osdmap e462: 8 total, 7 up, 7 in 2024-02-10T08:41:08.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:41:07.753702+0000 mon.b (mon.1) 101 : audit [INF] from='osd.4 v2:172.21.15.71:6800/1915668731' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-02-10T08:41:08.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:41:07.754114+0000 mon.a (mon.0) 1889 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-02-10T08:41:09.157 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-02-10T08:41:09.157 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-02-10T08:41:09.157 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-02-10T08:41:09.157 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-02-10T08:41:09.180 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:41:09.182 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:41:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:41:09.769 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is unset 2024-02-10T08:41:10.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:08.265050+0000 osd.6 (osd.6) 297 : cluster [DBG] 2.7 scrub starts 2024-02-10T08:41:10.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:08.268294+0000 osd.6 (osd.6) 298 : cluster [DBG] 2.7 scrub ok 2024-02-10T08:41:10.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:08.545514+0000 osd.7 (osd.7) 3 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:41:10.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:08.545603+0000 osd.7 (osd.7) 4 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:41:10.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:08.558481+0000 osd.0 (osd.0) 288 : cluster [DBG] 6.10 scrub starts 2024-02-10T08:41:10.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:08.561405+0000 osd.0 (osd.0) 289 : cluster [DBG] 6.10 scrub ok 2024-02-10T08:41:10.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:08.748215+0000 mon.a (mon.0) 1890 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-10T08:41:10.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:08.752228+0000 mon.a (mon.0) 1891 : cluster [INF] osd.4 v2:172.21.15.71:6800/1915668731 boot 2024-02-10T08:41:10.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:08.752278+0000 mon.a (mon.0) 1892 : cluster [DBG] osdmap e463: 8 total, 8 up, 7 in 2024-02-10T08:41:10.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:41:08.754073+0000 mon.a (mon.0) 1893 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-10T08:41:10.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:41:09.416115+0000 mon.a (mon.0) 1894 : audit [INF] from='client.? 172.21.15.18:0/31356187' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:41:10.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:09.749384+0000 mon.a (mon.0) 1895 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-10T08:41:10.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:41:09.753900+0000 mon.a (mon.0) 1896 : audit [INF] from='client.? 172.21.15.18:0/31356187' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-10T08:41:10.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:09.753965+0000 mon.a (mon.0) 1897 : cluster [DBG] osdmap e464: 8 total, 8 up, 7 in 2024-02-10T08:41:10.090 INFO:tasks.thrashosds.thrasher:inning osd 2024-02-10T08:41:10.091 INFO:tasks.thrashosds.thrasher:Adding osd 7 2024-02-10T08:41:10.091 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd in 7 2024-02-10T08:41:10.122 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:08.265050+0000 osd.6 (osd.6) 297 : cluster [DBG] 2.7 scrub starts 2024-02-10T08:41:10.122 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:08.268294+0000 osd.6 (osd.6) 298 : cluster [DBG] 2.7 scrub ok 2024-02-10T08:41:10.122 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:08.545514+0000 osd.7 (osd.7) 3 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:41:10.122 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:08.545603+0000 osd.7 (osd.7) 4 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:41:10.122 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:08.558481+0000 osd.0 (osd.0) 288 : cluster [DBG] 6.10 scrub starts 2024-02-10T08:41:10.122 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:08.561405+0000 osd.0 (osd.0) 289 : cluster [DBG] 6.10 scrub ok 2024-02-10T08:41:10.122 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:08.748215+0000 mon.a (mon.0) 1890 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-10T08:41:10.123 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:08.752228+0000 mon.a (mon.0) 1891 : cluster [INF] osd.4 v2:172.21.15.71:6800/1915668731 boot 2024-02-10T08:41:10.123 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:08.752278+0000 mon.a (mon.0) 1892 : cluster [DBG] osdmap e463: 8 total, 8 up, 7 in 2024-02-10T08:41:10.123 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:41:08.754073+0000 mon.a (mon.0) 1893 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-10T08:41:10.123 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:41:09.416115+0000 mon.a (mon.0) 1894 : audit [INF] from='client.? 172.21.15.18:0/31356187' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:41:10.123 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:09.749384+0000 mon.a (mon.0) 1895 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-10T08:41:10.123 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:41:09.753900+0000 mon.a (mon.0) 1896 : audit [INF] from='client.? 172.21.15.18:0/31356187' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-10T08:41:10.123 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:09.753965+0000 mon.a (mon.0) 1897 : cluster [DBG] osdmap e464: 8 total, 8 up, 7 in 2024-02-10T08:41:10.123 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:08.265050+0000 osd.6 (osd.6) 297 : cluster [DBG] 2.7 scrub starts 2024-02-10T08:41:10.123 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:08.268294+0000 osd.6 (osd.6) 298 : cluster [DBG] 2.7 scrub ok 2024-02-10T08:41:10.123 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:08.545514+0000 osd.7 (osd.7) 3 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:41:10.123 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:08.545603+0000 osd.7 (osd.7) 4 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:41:10.123 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:08.558481+0000 osd.0 (osd.0) 288 : cluster [DBG] 6.10 scrub starts 2024-02-10T08:41:10.123 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:08.561405+0000 osd.0 (osd.0) 289 : cluster [DBG] 6.10 scrub ok 2024-02-10T08:41:10.123 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:08.748215+0000 mon.a (mon.0) 1890 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-10T08:41:10.124 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:08.752228+0000 mon.a (mon.0) 1891 : cluster [INF] osd.4 v2:172.21.15.71:6800/1915668731 boot 2024-02-10T08:41:10.124 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:08.752278+0000 mon.a (mon.0) 1892 : cluster [DBG] osdmap e463: 8 total, 8 up, 7 in 2024-02-10T08:41:10.124 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:41:08.754073+0000 mon.a (mon.0) 1893 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-10T08:41:10.124 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:41:09.416115+0000 mon.a (mon.0) 1894 : audit [INF] from='client.? 172.21.15.18:0/31356187' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-10T08:41:10.124 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:09.749384+0000 mon.a (mon.0) 1895 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-10T08:41:10.124 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:41:09.753900+0000 mon.a (mon.0) 1896 : audit [INF] from='client.? 172.21.15.18:0/31356187' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-10T08:41:10.124 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:09.753965+0000 mon.a (mon.0) 1897 : cluster [DBG] osdmap e464: 8 total, 8 up, 7 in 2024-02-10T08:41:10.715 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:41:10.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:41:09.079300+0000 mgr.y (mgr.14505) 911 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:41:10.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:09.224341+0000 mgr.y (mgr.14505) 912 : cluster [DBG] pgmap v1118: 162 pgs: 20 active+undersized+degraded, 48 active+undersized, 94 active+clean; 5.7 KiB data, 5.6 GiB used, 620 GiB / 626 GiB avail; 1.2 KiB/s rd, 1 op/s; 86/576 objects degraded (14.931%) 2024-02-10T08:41:10.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:09.640479+0000 osd.1 (osd.1) 331 : cluster [DBG] 4.14 scrub starts 2024-02-10T08:41:10.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:09.643975+0000 osd.1 (osd.1) 332 : cluster [DBG] 4.14 scrub ok 2024-02-10T08:41:10.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:41:09.079300+0000 mgr.y (mgr.14505) 911 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:41:10.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:09.224341+0000 mgr.y (mgr.14505) 912 : cluster [DBG] pgmap v1118: 162 pgs: 20 active+undersized+degraded, 48 active+undersized, 94 active+clean; 5.7 KiB data, 5.6 GiB used, 620 GiB / 626 GiB avail; 1.2 KiB/s rd, 1 op/s; 86/576 objects degraded (14.931%) 2024-02-10T08:41:10.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:09.640479+0000 osd.1 (osd.1) 331 : cluster [DBG] 4.14 scrub starts 2024-02-10T08:41:10.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:09.643975+0000 osd.1 (osd.1) 332 : cluster [DBG] 4.14 scrub ok 2024-02-10T08:41:10.985 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:41:09.079300+0000 mgr.y (mgr.14505) 911 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:41:10.986 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:09.224341+0000 mgr.y (mgr.14505) 912 : cluster [DBG] pgmap v1118: 162 pgs: 20 active+undersized+degraded, 48 active+undersized, 94 active+clean; 5.7 KiB data, 5.6 GiB used, 620 GiB / 626 GiB avail; 1.2 KiB/s rd, 1 op/s; 86/576 objects degraded (14.931%) 2024-02-10T08:41:10.986 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:09.640479+0000 osd.1 (osd.1) 331 : cluster [DBG] 4.14 scrub starts 2024-02-10T08:41:10.986 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:09.643975+0000 osd.1 (osd.1) 332 : cluster [DBG] 4.14 scrub ok 2024-02-10T08:41:11.501 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-02-10T08:41:11.502 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:41:12.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:10.222320+0000 osd.4 (osd.4) 1 : cluster [DBG] 6.1e deep-scrub starts 2024-02-10T08:41:12.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:10.223112+0000 osd.4 (osd.4) 2 : cluster [DBG] 6.1e deep-scrub ok 2024-02-10T08:41:12.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:11.100686+0000 mon.a (mon.0) 1898 : cluster [DBG] osdmap e465: 8 total, 8 up, 7 in 2024-02-10T08:41:12.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:11.224725+0000 mgr.y (mgr.14505) 913 : cluster [DBG] pgmap v1121: 162 pgs: 20 active+undersized+degraded, 48 active+undersized, 94 active+clean; 5.7 KiB data, 5.6 GiB used, 620 GiB / 626 GiB avail; 1.2 KiB/s rd, 1 op/s; 86/576 objects degraded (14.931%) 2024-02-10T08:41:12.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:11.271347+0000 osd.5 (osd.5) 294 : cluster [DBG] 6.d deep-scrub starts 2024-02-10T08:41:12.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:11.291636+0000 osd.5 (osd.5) 295 : cluster [DBG] 6.d deep-scrub ok 2024-02-10T08:41:12.328 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.6 dump_ops_in_flight 2024-02-10T08:41:12.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:10.222320+0000 osd.4 (osd.4) 1 : cluster [DBG] 6.1e deep-scrub starts 2024-02-10T08:41:12.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:10.223112+0000 osd.4 (osd.4) 2 : cluster [DBG] 6.1e deep-scrub ok 2024-02-10T08:41:12.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:11.100686+0000 mon.a (mon.0) 1898 : cluster [DBG] osdmap e465: 8 total, 8 up, 7 in 2024-02-10T08:41:12.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:11.224725+0000 mgr.y (mgr.14505) 913 : cluster [DBG] pgmap v1121: 162 pgs: 20 active+undersized+degraded, 48 active+undersized, 94 active+clean; 5.7 KiB data, 5.6 GiB used, 620 GiB / 626 GiB avail; 1.2 KiB/s rd, 1 op/s; 86/576 objects degraded (14.931%) 2024-02-10T08:41:12.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:11.271347+0000 osd.5 (osd.5) 294 : cluster [DBG] 6.d deep-scrub starts 2024-02-10T08:41:12.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:11.291636+0000 osd.5 (osd.5) 295 : cluster [DBG] 6.d deep-scrub ok 2024-02-10T08:41:12.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:10.222320+0000 osd.4 (osd.4) 1 : cluster [DBG] 6.1e deep-scrub starts 2024-02-10T08:41:12.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:10.223112+0000 osd.4 (osd.4) 2 : cluster [DBG] 6.1e deep-scrub ok 2024-02-10T08:41:12.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:11.100686+0000 mon.a (mon.0) 1898 : cluster [DBG] osdmap e465: 8 total, 8 up, 7 in 2024-02-10T08:41:12.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:11.224725+0000 mgr.y (mgr.14505) 913 : cluster [DBG] pgmap v1121: 162 pgs: 20 active+undersized+degraded, 48 active+undersized, 94 active+clean; 5.7 KiB data, 5.6 GiB used, 620 GiB / 626 GiB avail; 1.2 KiB/s rd, 1 op/s; 86/576 objects degraded (14.931%) 2024-02-10T08:41:12.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:11.271347+0000 osd.5 (osd.5) 294 : cluster [DBG] 6.d deep-scrub starts 2024-02-10T08:41:12.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:11.291636+0000 osd.5 (osd.5) 295 : cluster [DBG] 6.d deep-scrub ok 2024-02-10T08:41:12.596 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:41:13.130 INFO:teuthology.orchestra.run.smithi018.stderr:marked in osd.7. 2024-02-10T08:41:13.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:41:12.970+0000 7f97240ed700 -1 mon.a@0(leader).osd e465 definitely_dead 0 2024-02-10T08:41:13.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:11.594795+0000 osd.1 (osd.1) 333 : cluster [DBG] 2.6 scrub starts 2024-02-10T08:41:13.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:11.597685+0000 osd.1 (osd.1) 334 : cluster [DBG] 2.6 scrub ok 2024-02-10T08:41:13.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:12.219585+0000 osd.6 (osd.6) 299 : cluster [DBG] 2.11 scrub starts 2024-02-10T08:41:13.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:12.220430+0000 osd.6 (osd.6) 300 : cluster [DBG] 2.11 scrub ok 2024-02-10T08:41:13.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:12.650742+0000 osd.0 (osd.0) 290 : cluster [DBG] 2.13 scrub starts 2024-02-10T08:41:13.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:12.651743+0000 osd.0 (osd.0) 291 : cluster [DBG] 2.13 scrub ok 2024-02-10T08:41:13.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:41:12.971267+0000 mon.c (mon.2) 109 : audit [DBG] from='client.? 172.21.15.18:0/709586164' entity='client.admin' cmd=[{"prefix": "osd in", "ids": ["7"]}]: dispatch 2024-02-10T08:41:13.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:41:12.971564+0000 mon.a (mon.0) 1899 : audit [DBG] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd in", "ids": ["7"]}]: dispatch 2024-02-10T08:41:13.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:11.594795+0000 osd.1 (osd.1) 333 : cluster [DBG] 2.6 scrub starts 2024-02-10T08:41:13.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:11.597685+0000 osd.1 (osd.1) 334 : cluster [DBG] 2.6 scrub ok 2024-02-10T08:41:13.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:12.219585+0000 osd.6 (osd.6) 299 : cluster [DBG] 2.11 scrub starts 2024-02-10T08:41:13.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:12.220430+0000 osd.6 (osd.6) 300 : cluster [DBG] 2.11 scrub ok 2024-02-10T08:41:13.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:12.650742+0000 osd.0 (osd.0) 290 : cluster [DBG] 2.13 scrub starts 2024-02-10T08:41:13.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:12.651743+0000 osd.0 (osd.0) 291 : cluster [DBG] 2.13 scrub ok 2024-02-10T08:41:13.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:41:12.971267+0000 mon.c (mon.2) 109 : audit [DBG] from='client.? 172.21.15.18:0/709586164' entity='client.admin' cmd=[{"prefix": "osd in", "ids": ["7"]}]: dispatch 2024-02-10T08:41:13.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:41:12.971564+0000 mon.a (mon.0) 1899 : audit [DBG] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd in", "ids": ["7"]}]: dispatch 2024-02-10T08:41:13.485 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:11.594795+0000 osd.1 (osd.1) 333 : cluster [DBG] 2.6 scrub starts 2024-02-10T08:41:13.485 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:11.597685+0000 osd.1 (osd.1) 334 : cluster [DBG] 2.6 scrub ok 2024-02-10T08:41:13.485 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:12.219585+0000 osd.6 (osd.6) 299 : cluster [DBG] 2.11 scrub starts 2024-02-10T08:41:13.485 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:12.220430+0000 osd.6 (osd.6) 300 : cluster [DBG] 2.11 scrub ok 2024-02-10T08:41:13.485 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:12.650742+0000 osd.0 (osd.0) 290 : cluster [DBG] 2.13 scrub starts 2024-02-10T08:41:13.485 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:12.651743+0000 osd.0 (osd.0) 291 : cluster [DBG] 2.13 scrub ok 2024-02-10T08:41:13.485 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:41:12.971267+0000 mon.c (mon.2) 109 : audit [DBG] from='client.? 172.21.15.18:0/709586164' entity='client.admin' cmd=[{"prefix": "osd in", "ids": ["7"]}]: dispatch 2024-02-10T08:41:13.485 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:41:12.971564+0000 mon.a (mon.0) 1899 : audit [DBG] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd in", "ids": ["7"]}]: dispatch 2024-02-10T08:41:14.047 INFO:tasks.thrashosds.thrasher:Added osd 7 2024-02-10T08:41:14.047 INFO:tasks.thrashosds.thrasher:fixing pg num pool device_health_metrics 2024-02-10T08:41:14.047 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd pool set device_health_metrics pgp_num 11 2024-02-10T08:41:14.326 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-02-10T08:41:14.326 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:41:14.353 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:13.012763+0000 osd.2 (osd.2) 283 : cluster [DBG] 6.21 scrub starts 2024-02-10T08:41:14.353 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:13.013756+0000 osd.2 (osd.2) 284 : cluster [DBG] 6.21 scrub ok 2024-02-10T08:41:14.354 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:41:13.109934+0000 mon.a (mon.0) 1900 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd in", "ids": ["7"]}]': finished 2024-02-10T08:41:14.354 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:13.110010+0000 mon.a (mon.0) 1901 : cluster [DBG] osdmap e466: 8 total, 8 up, 8 in 2024-02-10T08:41:14.354 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:13.225405+0000 mgr.y (mgr.14505) 914 : cluster [DBG] pgmap v1123: 162 pgs: 11 peering, 1 active+undersized+degraded, 14 active+undersized, 136 active+clean; 5.7 KiB data, 5.5 GiB used, 620 GiB / 626 GiB avail; 1.1 KiB/s rd, 1 op/s; 4/576 objects degraded (0.694%) 2024-02-10T08:41:14.354 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:13.238227+0000 osd.5 (osd.5) 296 : cluster [DBG] 5.f scrub starts 2024-02-10T08:41:14.354 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:13.241112+0000 osd.5 (osd.5) 297 : cluster [DBG] 5.f scrub ok 2024-02-10T08:41:14.354 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:13.265649+0000 osd.6 (osd.6) 301 : cluster [DBG] 6.c scrub starts 2024-02-10T08:41:14.354 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:13.268557+0000 osd.6 (osd.6) 302 : cluster [DBG] 6.c scrub ok 2024-02-10T08:41:14.354 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:14.111531+0000 mon.a (mon.0) 1902 : cluster [DBG] osdmap e467: 8 total, 8 up, 8 in 2024-02-10T08:41:14.362 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:41:14.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:13.012763+0000 osd.2 (osd.2) 283 : cluster [DBG] 6.21 scrub starts 2024-02-10T08:41:14.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:13.013756+0000 osd.2 (osd.2) 284 : cluster [DBG] 6.21 scrub ok 2024-02-10T08:41:14.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:41:13.109934+0000 mon.a (mon.0) 1900 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd in", "ids": ["7"]}]': finished 2024-02-10T08:41:14.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:13.110010+0000 mon.a (mon.0) 1901 : cluster [DBG] osdmap e466: 8 total, 8 up, 8 in 2024-02-10T08:41:14.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:13.225405+0000 mgr.y (mgr.14505) 914 : cluster [DBG] pgmap v1123: 162 pgs: 11 peering, 1 active+undersized+degraded, 14 active+undersized, 136 active+clean; 5.7 KiB data, 5.5 GiB used, 620 GiB / 626 GiB avail; 1.1 KiB/s rd, 1 op/s; 4/576 objects degraded (0.694%) 2024-02-10T08:41:14.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:13.238227+0000 osd.5 (osd.5) 296 : cluster [DBG] 5.f scrub starts 2024-02-10T08:41:14.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:13.241112+0000 osd.5 (osd.5) 297 : cluster [DBG] 5.f scrub ok 2024-02-10T08:41:14.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:13.265649+0000 osd.6 (osd.6) 301 : cluster [DBG] 6.c scrub starts 2024-02-10T08:41:14.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:13.268557+0000 osd.6 (osd.6) 302 : cluster [DBG] 6.c scrub ok 2024-02-10T08:41:14.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:14.111531+0000 mon.a (mon.0) 1902 : cluster [DBG] osdmap e467: 8 total, 8 up, 8 in 2024-02-10T08:41:14.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:13.012763+0000 osd.2 (osd.2) 283 : cluster [DBG] 6.21 scrub starts 2024-02-10T08:41:14.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:13.013756+0000 osd.2 (osd.2) 284 : cluster [DBG] 6.21 scrub ok 2024-02-10T08:41:14.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:41:13.109934+0000 mon.a (mon.0) 1900 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd in", "ids": ["7"]}]': finished 2024-02-10T08:41:14.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:13.110010+0000 mon.a (mon.0) 1901 : cluster [DBG] osdmap e466: 8 total, 8 up, 8 in 2024-02-10T08:41:14.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:13.225405+0000 mgr.y (mgr.14505) 914 : cluster [DBG] pgmap v1123: 162 pgs: 11 peering, 1 active+undersized+degraded, 14 active+undersized, 136 active+clean; 5.7 KiB data, 5.5 GiB used, 620 GiB / 626 GiB avail; 1.1 KiB/s rd, 1 op/s; 4/576 objects degraded (0.694%) 2024-02-10T08:41:14.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:13.238227+0000 osd.5 (osd.5) 296 : cluster [DBG] 5.f scrub starts 2024-02-10T08:41:14.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:13.241112+0000 osd.5 (osd.5) 297 : cluster [DBG] 5.f scrub ok 2024-02-10T08:41:14.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:13.265649+0000 osd.6 (osd.6) 301 : cluster [DBG] 6.c scrub starts 2024-02-10T08:41:14.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:13.268557+0000 osd.6 (osd.6) 302 : cluster [DBG] 6.c scrub ok 2024-02-10T08:41:14.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:14.111531+0000 mon.a (mon.0) 1902 : cluster [DBG] osdmap e467: 8 total, 8 up, 8 in 2024-02-10T08:41:15.024 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.6 dump_blocked_ops 2024-02-10T08:41:15.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:13.214348+0000 osd.4 (osd.4) 3 : cluster [DBG] 5.18 scrub starts 2024-02-10T08:41:15.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:13.217230+0000 osd.4 (osd.4) 4 : cluster [DBG] 5.18 scrub ok 2024-02-10T08:41:15.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:13.591178+0000 osd.1 (osd.1) 335 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:41:15.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:13.591232+0000 osd.1 (osd.1) 336 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:41:15.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:14.055397+0000 osd.2 (osd.2) 285 : cluster [DBG] 4.1c scrub starts 2024-02-10T08:41:15.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:14.057478+0000 osd.2 (osd.2) 286 : cluster [DBG] 4.1c scrub ok 2024-02-10T08:41:15.290 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:14.125242+0000 mon.a (mon.0) 1903 : cluster [WRN] Health check update: Degraded data redundancy: 4/576 objects degraded (0.694%), 1 pg degraded (PG_DEGRADED) 2024-02-10T08:41:15.305 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:41:15.372 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:13.214348+0000 osd.4 (osd.4) 3 : cluster [DBG] 5.18 scrub starts 2024-02-10T08:41:15.373 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:13.217230+0000 osd.4 (osd.4) 4 : cluster [DBG] 5.18 scrub ok 2024-02-10T08:41:15.373 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:13.591178+0000 osd.1 (osd.1) 335 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:41:15.373 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:13.591232+0000 osd.1 (osd.1) 336 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:41:15.373 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:14.055397+0000 osd.2 (osd.2) 285 : cluster [DBG] 4.1c scrub starts 2024-02-10T08:41:15.373 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:14.057478+0000 osd.2 (osd.2) 286 : cluster [DBG] 4.1c scrub ok 2024-02-10T08:41:15.373 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:14.125242+0000 mon.a (mon.0) 1903 : cluster [WRN] Health check update: Degraded data redundancy: 4/576 objects degraded (0.694%), 1 pg degraded (PG_DEGRADED) 2024-02-10T08:41:15.373 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:13.214348+0000 osd.4 (osd.4) 3 : cluster [DBG] 5.18 scrub starts 2024-02-10T08:41:15.373 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:13.217230+0000 osd.4 (osd.4) 4 : cluster [DBG] 5.18 scrub ok 2024-02-10T08:41:15.373 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:13.591178+0000 osd.1 (osd.1) 335 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:41:15.373 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:13.591232+0000 osd.1 (osd.1) 336 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:41:15.373 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:14.055397+0000 osd.2 (osd.2) 285 : cluster [DBG] 4.1c scrub starts 2024-02-10T08:41:15.374 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:14.057478+0000 osd.2 (osd.2) 286 : cluster [DBG] 4.1c scrub ok 2024-02-10T08:41:15.374 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:14.125242+0000 mon.a (mon.0) 1903 : cluster [WRN] Health check update: Degraded data redundancy: 4/576 objects degraded (0.694%), 1 pg degraded (PG_DEGRADED) 2024-02-10T08:41:16.139 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:15.225858+0000 mgr.y (mgr.14505) 915 : cluster [DBG] pgmap v1125: 162 pgs: 20 peering, 5 active+undersized, 137 active+clean; 5.7 KiB data, 5.5 GiB used, 620 GiB / 626 GiB avail; 935 B/s rd, 0 op/s 2024-02-10T08:41:16.139 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:15.604942+0000 osd.0 (osd.0) 292 : cluster [DBG] 2.1f scrub starts 2024-02-10T08:41:16.140 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:15.607839+0000 osd.0 (osd.0) 293 : cluster [DBG] 2.1f scrub ok 2024-02-10T08:41:16.140 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:16.102683+0000 mon.a (mon.0) 1904 : cluster [DBG] osdmap e468: 8 total, 8 up, 8 in 2024-02-10T08:41:16.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:15.225858+0000 mgr.y (mgr.14505) 915 : cluster [DBG] pgmap v1125: 162 pgs: 20 peering, 5 active+undersized, 137 active+clean; 5.7 KiB data, 5.5 GiB used, 620 GiB / 626 GiB avail; 935 B/s rd, 0 op/s 2024-02-10T08:41:16.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:15.604942+0000 osd.0 (osd.0) 292 : cluster [DBG] 2.1f scrub starts 2024-02-10T08:41:16.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:15.607839+0000 osd.0 (osd.0) 293 : cluster [DBG] 2.1f scrub ok 2024-02-10T08:41:16.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:16.102683+0000 mon.a (mon.0) 1904 : cluster [DBG] osdmap e468: 8 total, 8 up, 8 in 2024-02-10T08:41:16.504 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:15.225858+0000 mgr.y (mgr.14505) 915 : cluster [DBG] pgmap v1125: 162 pgs: 20 peering, 5 active+undersized, 137 active+clean; 5.7 KiB data, 5.5 GiB used, 620 GiB / 626 GiB avail; 935 B/s rd, 0 op/s 2024-02-10T08:41:16.504 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:15.604942+0000 osd.0 (osd.0) 292 : cluster [DBG] 2.1f scrub starts 2024-02-10T08:41:16.504 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:15.607839+0000 osd.0 (osd.0) 293 : cluster [DBG] 2.1f scrub ok 2024-02-10T08:41:16.504 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:16.102683+0000 mon.a (mon.0) 1904 : cluster [DBG] osdmap e468: 8 total, 8 up, 8 in 2024-02-10T08:41:16.776 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:41:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:41:16] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:41:17.035 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-02-10T08:41:17.035 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:41:17.149 INFO:teuthology.orchestra.run.smithi018.stderr:set pool 1 pgp_num to 11 2024-02-10T08:41:17.347 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:16.134307+0000 mon.a (mon.0) 1905 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 4/576 objects degraded (0.694%), 1 pg degraded) 2024-02-10T08:41:17.347 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:16.134361+0000 mon.a (mon.0) 1906 : cluster [INF] Cluster is now healthy 2024-02-10T08:41:17.347 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:16.353933+0000 osd.7 (osd.7) 5 : cluster [DBG] 2.1b scrub starts 2024-02-10T08:41:17.347 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:16.354666+0000 osd.7 (osd.7) 6 : cluster [DBG] 2.1b scrub ok 2024-02-10T08:41:17.347 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:41:16.620884+0000 mon.c (mon.2) 110 : audit [INF] from='client.? 172.21.15.18:0/298901888' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "device_health_metrics", "var": "pgp_num", "val": "11"}]: dispatch 2024-02-10T08:41:17.347 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:41:16.621238+0000 mon.a (mon.0) 1907 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "device_health_metrics", "var": "pgp_num", "val": "11"}]: dispatch 2024-02-10T08:41:17.347 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:41:16.695863+0000 mon.a (mon.0) 1908 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:41:17.404 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:41:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:41:17] "GET /metrics HTTP/1.1" 200 173939 "" "Prometheus/2.33.4" 2024-02-10T08:41:17.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:16.134307+0000 mon.a (mon.0) 1905 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 4/576 objects degraded (0.694%), 1 pg degraded) 2024-02-10T08:41:17.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:16.134361+0000 mon.a (mon.0) 1906 : cluster [INF] Cluster is now healthy 2024-02-10T08:41:17.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:16.353933+0000 osd.7 (osd.7) 5 : cluster [DBG] 2.1b scrub starts 2024-02-10T08:41:17.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:16.354666+0000 osd.7 (osd.7) 6 : cluster [DBG] 2.1b scrub ok 2024-02-10T08:41:17.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:41:16.620884+0000 mon.c (mon.2) 110 : audit [INF] from='client.? 172.21.15.18:0/298901888' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "device_health_metrics", "var": "pgp_num", "val": "11"}]: dispatch 2024-02-10T08:41:17.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:41:16.621238+0000 mon.a (mon.0) 1907 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "device_health_metrics", "var": "pgp_num", "val": "11"}]: dispatch 2024-02-10T08:41:17.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:41:16.695863+0000 mon.a (mon.0) 1908 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:41:17.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:16.134307+0000 mon.a (mon.0) 1905 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 4/576 objects degraded (0.694%), 1 pg degraded) 2024-02-10T08:41:17.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:16.134361+0000 mon.a (mon.0) 1906 : cluster [INF] Cluster is now healthy 2024-02-10T08:41:17.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:16.353933+0000 osd.7 (osd.7) 5 : cluster [DBG] 2.1b scrub starts 2024-02-10T08:41:17.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:16.354666+0000 osd.7 (osd.7) 6 : cluster [DBG] 2.1b scrub ok 2024-02-10T08:41:17.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:41:16.620884+0000 mon.c (mon.2) 110 : audit [INF] from='client.? 172.21.15.18:0/298901888' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "device_health_metrics", "var": "pgp_num", "val": "11"}]: dispatch 2024-02-10T08:41:17.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:41:16.621238+0000 mon.a (mon.0) 1907 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "device_health_metrics", "var": "pgp_num", "val": "11"}]: dispatch 2024-02-10T08:41:17.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:41:16.695863+0000 mon.a (mon.0) 1908 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:41:17.629 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.6 dump_historic_ops 2024-02-10T08:41:17.902 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:41:18.112 INFO:tasks.thrashosds.thrasher:fixing pg num pool default.rgw.meta 2024-02-10T08:41:18.113 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd pool set default.rgw.meta pgp_num 52 2024-02-10T08:41:18.401 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:41:18.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:16.222289+0000 osd.4 (osd.4) 5 : cluster [DBG] 5.e scrub starts 2024-02-10T08:41:18.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:16.223767+0000 osd.4 (osd.4) 6 : cluster [DBG] 5.e scrub ok 2024-02-10T08:41:18.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:16.969788+0000 osd.4 (osd.4) 7 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:41:18.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:16.969871+0000 osd.4 (osd.4) 8 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:41:18.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:41:17.145820+0000 mon.a (mon.0) 1909 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "device_health_metrics", "var": "pgp_num", "val": "11"}]': finished 2024-02-10T08:41:18.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:17.145890+0000 mon.a (mon.0) 1910 : cluster [DBG] osdmap e469: 8 total, 8 up, 8 in 2024-02-10T08:41:18.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:17.226221+0000 mgr.y (mgr.14505) 916 : cluster [DBG] pgmap v1128: 162 pgs: 20 peering, 142 active+clean; 5.7 KiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s; 268 B/s, 3 objects/s recovering 2024-02-10T08:41:18.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:17.252148+0000 osd.4 (osd.4) 9 : cluster [DBG] 2.f scrub starts 2024-02-10T08:41:18.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:17.253665+0000 osd.4 (osd.4) 10 : cluster [DBG] 2.f scrub ok 2024-02-10T08:41:18.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:17.260303+0000 osd.5 (osd.5) 298 : cluster [DBG] 2.12 deep-scrub starts 2024-02-10T08:41:18.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:17.263207+0000 osd.5 (osd.5) 299 : cluster [DBG] 2.12 deep-scrub ok 2024-02-10T08:41:18.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:16.222289+0000 osd.4 (osd.4) 5 : cluster [DBG] 5.e scrub starts 2024-02-10T08:41:18.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:16.223767+0000 osd.4 (osd.4) 6 : cluster [DBG] 5.e scrub ok 2024-02-10T08:41:18.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:16.969788+0000 osd.4 (osd.4) 7 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:41:18.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:16.969871+0000 osd.4 (osd.4) 8 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:41:18.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:41:17.145820+0000 mon.a (mon.0) 1909 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "device_health_metrics", "var": "pgp_num", "val": "11"}]': finished 2024-02-10T08:41:18.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:17.145890+0000 mon.a (mon.0) 1910 : cluster [DBG] osdmap e469: 8 total, 8 up, 8 in 2024-02-10T08:41:18.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:17.226221+0000 mgr.y (mgr.14505) 916 : cluster [DBG] pgmap v1128: 162 pgs: 20 peering, 142 active+clean; 5.7 KiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s; 268 B/s, 3 objects/s recovering 2024-02-10T08:41:18.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:17.252148+0000 osd.4 (osd.4) 9 : cluster [DBG] 2.f scrub starts 2024-02-10T08:41:18.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:17.253665+0000 osd.4 (osd.4) 10 : cluster [DBG] 2.f scrub ok 2024-02-10T08:41:18.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:17.260303+0000 osd.5 (osd.5) 298 : cluster [DBG] 2.12 deep-scrub starts 2024-02-10T08:41:18.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:17.263207+0000 osd.5 (osd.5) 299 : cluster [DBG] 2.12 deep-scrub ok 2024-02-10T08:41:18.441 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:16.222289+0000 osd.4 (osd.4) 5 : cluster [DBG] 5.e scrub starts 2024-02-10T08:41:18.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:16.223767+0000 osd.4 (osd.4) 6 : cluster [DBG] 5.e scrub ok 2024-02-10T08:41:18.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:16.969788+0000 osd.4 (osd.4) 7 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:41:18.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:16.969871+0000 osd.4 (osd.4) 8 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:41:18.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:41:17.145820+0000 mon.a (mon.0) 1909 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "device_health_metrics", "var": "pgp_num", "val": "11"}]': finished 2024-02-10T08:41:18.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:17.145890+0000 mon.a (mon.0) 1910 : cluster [DBG] osdmap e469: 8 total, 8 up, 8 in 2024-02-10T08:41:18.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:17.226221+0000 mgr.y (mgr.14505) 916 : cluster [DBG] pgmap v1128: 162 pgs: 20 peering, 142 active+clean; 5.7 KiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s; 268 B/s, 3 objects/s recovering 2024-02-10T08:41:18.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:17.252148+0000 osd.4 (osd.4) 9 : cluster [DBG] 2.f scrub starts 2024-02-10T08:41:18.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:17.253665+0000 osd.4 (osd.4) 10 : cluster [DBG] 2.f scrub ok 2024-02-10T08:41:18.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:17.260303+0000 osd.5 (osd.5) 298 : cluster [DBG] 2.12 deep-scrub starts 2024-02-10T08:41:18.442 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:17.263207+0000 osd.5 (osd.5) 299 : cluster [DBG] 2.12 deep-scrub ok 2024-02-10T08:41:19.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:17.659098+0000 osd.1 (osd.1) 337 : cluster [DBG] 5.c scrub starts 2024-02-10T08:41:19.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:17.661916+0000 osd.1 (osd.1) 338 : cluster [DBG] 5.c scrub ok 2024-02-10T08:41:19.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:17.659098+0000 osd.1 (osd.1) 337 : cluster [DBG] 5.c scrub starts 2024-02-10T08:41:19.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:17.661916+0000 osd.1 (osd.1) 338 : cluster [DBG] 5.c scrub ok 2024-02-10T08:41:19.431 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:17.659098+0000 osd.1 (osd.1) 337 : cluster [DBG] 5.c scrub starts 2024-02-10T08:41:19.431 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:17.661916+0000 osd.1 (osd.1) 338 : cluster [DBG] 5.c scrub ok 2024-02-10T08:41:19.431 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:41:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:41:19.666 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-02-10T08:41:19.666 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:41:20.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:41:19.090812+0000 mgr.y (mgr.14505) 917 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:41:20.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:19.224027+0000 osd.5 (osd.5) 300 : cluster [DBG] 3.2 scrub starts 2024-02-10T08:41:20.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:19.226829+0000 mgr.y (mgr.14505) 918 : cluster [DBG] pgmap v1129: 162 pgs: 162 active+clean; 5.7 KiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 1.8 KiB/s rd, 1 op/s; 353 B/s, 11 objects/s recovering 2024-02-10T08:41:20.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:19.226918+0000 osd.5 (osd.5) 301 : cluster [DBG] 3.2 scrub ok 2024-02-10T08:41:20.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:19.261428+0000 osd.7 (osd.7) 7 : cluster [DBG] 2.b scrub starts 2024-02-10T08:41:20.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:19.262157+0000 osd.7 (osd.7) 8 : cluster [DBG] 2.b scrub ok 2024-02-10T08:41:20.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:19.323508+0000 osd.6 (osd.6) 303 : cluster [DBG] 5.11 scrub starts 2024-02-10T08:41:20.289 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:19.326614+0000 osd.6 (osd.6) 304 : cluster [DBG] 5.11 scrub ok 2024-02-10T08:41:20.324 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.7 dump_ops_in_flight 2024-02-10T08:41:20.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:41:19.090812+0000 mgr.y (mgr.14505) 917 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:41:20.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:19.224027+0000 osd.5 (osd.5) 300 : cluster [DBG] 3.2 scrub starts 2024-02-10T08:41:20.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:19.226829+0000 mgr.y (mgr.14505) 918 : cluster [DBG] pgmap v1129: 162 pgs: 162 active+clean; 5.7 KiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 1.8 KiB/s rd, 1 op/s; 353 B/s, 11 objects/s recovering 2024-02-10T08:41:20.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:19.226918+0000 osd.5 (osd.5) 301 : cluster [DBG] 3.2 scrub ok 2024-02-10T08:41:20.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:19.261428+0000 osd.7 (osd.7) 7 : cluster [DBG] 2.b scrub starts 2024-02-10T08:41:20.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:19.262157+0000 osd.7 (osd.7) 8 : cluster [DBG] 2.b scrub ok 2024-02-10T08:41:20.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:19.323508+0000 osd.6 (osd.6) 303 : cluster [DBG] 5.11 scrub starts 2024-02-10T08:41:20.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:19.326614+0000 osd.6 (osd.6) 304 : cluster [DBG] 5.11 scrub ok 2024-02-10T08:41:20.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:41:19.090812+0000 mgr.y (mgr.14505) 917 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:41:20.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:19.224027+0000 osd.5 (osd.5) 300 : cluster [DBG] 3.2 scrub starts 2024-02-10T08:41:20.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:19.226829+0000 mgr.y (mgr.14505) 918 : cluster [DBG] pgmap v1129: 162 pgs: 162 active+clean; 5.7 KiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 1.8 KiB/s rd, 1 op/s; 353 B/s, 11 objects/s recovering 2024-02-10T08:41:20.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:19.226918+0000 osd.5 (osd.5) 301 : cluster [DBG] 3.2 scrub ok 2024-02-10T08:41:20.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:19.261428+0000 osd.7 (osd.7) 7 : cluster [DBG] 2.b scrub starts 2024-02-10T08:41:20.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:19.262157+0000 osd.7 (osd.7) 8 : cluster [DBG] 2.b scrub ok 2024-02-10T08:41:20.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:19.323508+0000 osd.6 (osd.6) 303 : cluster [DBG] 5.11 scrub starts 2024-02-10T08:41:20.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:19.326614+0000 osd.6 (osd.6) 304 : cluster [DBG] 5.11 scrub ok 2024-02-10T08:41:20.590 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:41:21.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:20.205643+0000 osd.5 (osd.5) 302 : cluster [DBG] 1.1 scrub starts 2024-02-10T08:41:21.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:20.208939+0000 osd.5 (osd.5) 303 : cluster [DBG] 1.1 scrub ok 2024-02-10T08:41:21.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:21.104312+0000 mon.a (mon.0) 1911 : cluster [DBG] osdmap e470: 8 total, 8 up, 8 in 2024-02-10T08:41:21.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:20.205643+0000 osd.5 (osd.5) 302 : cluster [DBG] 1.1 scrub starts 2024-02-10T08:41:21.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:20.208939+0000 osd.5 (osd.5) 303 : cluster [DBG] 1.1 scrub ok 2024-02-10T08:41:21.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:21.104312+0000 mon.a (mon.0) 1911 : cluster [DBG] osdmap e470: 8 total, 8 up, 8 in 2024-02-10T08:41:21.524 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:20.205643+0000 osd.5 (osd.5) 302 : cluster [DBG] 1.1 scrub starts 2024-02-10T08:41:21.525 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:20.208939+0000 osd.5 (osd.5) 303 : cluster [DBG] 1.1 scrub ok 2024-02-10T08:41:21.525 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:21.104312+0000 mon.a (mon.0) 1911 : cluster [DBG] osdmap e470: 8 total, 8 up, 8 in 2024-02-10T08:41:22.177 INFO:teuthology.orchestra.run.smithi018.stderr:set pool 6 pgp_num to 52 2024-02-10T08:41:22.436 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-02-10T08:41:22.436 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:41:22.456 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:21.218204+0000 osd.4 (osd.4) 11 : cluster [DBG] 6.1a deep-scrub starts 2024-02-10T08:41:22.456 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:21.221085+0000 osd.4 (osd.4) 12 : cluster [DBG] 6.1a deep-scrub ok 2024-02-10T08:41:22.456 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:21.227166+0000 mgr.y (mgr.14505) 919 : cluster [DBG] pgmap v1131: 162 pgs: 162 active+clean; 5.7 KiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 1.8 KiB/s rd, 1 op/s; 353 B/s, 11 objects/s recovering 2024-02-10T08:41:22.456 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:41:21.514624+0000 mon.c (mon.2) 111 : audit [INF] from='client.? 172.21.15.18:0/1837099144' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pgp_num", "val": "52"}]: dispatch 2024-02-10T08:41:22.456 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:41:21.514962+0000 mon.a (mon.0) 1912 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pgp_num", "val": "52"}]: dispatch 2024-02-10T08:41:22.623 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:21.218204+0000 osd.4 (osd.4) 11 : cluster [DBG] 6.1a deep-scrub starts 2024-02-10T08:41:22.623 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:21.221085+0000 osd.4 (osd.4) 12 : cluster [DBG] 6.1a deep-scrub ok 2024-02-10T08:41:22.623 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:21.227166+0000 mgr.y (mgr.14505) 919 : cluster [DBG] pgmap v1131: 162 pgs: 162 active+clean; 5.7 KiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 1.8 KiB/s rd, 1 op/s; 353 B/s, 11 objects/s recovering 2024-02-10T08:41:22.623 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:41:21.514624+0000 mon.c (mon.2) 111 : audit [INF] from='client.? 172.21.15.18:0/1837099144' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pgp_num", "val": "52"}]: dispatch 2024-02-10T08:41:22.623 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:41:21.514962+0000 mon.a (mon.0) 1912 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pgp_num", "val": "52"}]: dispatch 2024-02-10T08:41:22.623 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:21.218204+0000 osd.4 (osd.4) 11 : cluster [DBG] 6.1a deep-scrub starts 2024-02-10T08:41:22.624 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:21.221085+0000 osd.4 (osd.4) 12 : cluster [DBG] 6.1a deep-scrub ok 2024-02-10T08:41:22.624 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:21.227166+0000 mgr.y (mgr.14505) 919 : cluster [DBG] pgmap v1131: 162 pgs: 162 active+clean; 5.7 KiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 1.8 KiB/s rd, 1 op/s; 353 B/s, 11 objects/s recovering 2024-02-10T08:41:22.624 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:41:21.514624+0000 mon.c (mon.2) 111 : audit [INF] from='client.? 172.21.15.18:0/1837099144' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pgp_num", "val": "52"}]: dispatch 2024-02-10T08:41:22.624 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:41:21.514962+0000 mon.a (mon.0) 1912 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pgp_num", "val": "52"}]: dispatch 2024-02-10T08:41:23.087 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-02-10T08:41:23.106 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.7 dump_blocked_ops 2024-02-10T08:41:23.374 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:41:23.379 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:41:23.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:41:22.172848+0000 mon.a (mon.0) 1913 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pgp_num", "val": "52"}]': finished 2024-02-10T08:41:23.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:22.172902+0000 mon.a (mon.0) 1914 : cluster [DBG] osdmap e471: 8 total, 8 up, 8 in 2024-02-10T08:41:23.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:22.305206+0000 osd.7 (osd.7) 9 : cluster [DBG] 5.1a scrub starts 2024-02-10T08:41:23.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:22.307020+0000 osd.7 (osd.7) 10 : cluster [DBG] 5.1a scrub ok 2024-02-10T08:41:23.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:22.671837+0000 osd.0 (osd.0) 294 : cluster [DBG] 6.23 scrub starts 2024-02-10T08:41:23.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:22.727799+0000 osd.0 (osd.0) 295 : cluster [DBG] 6.23 scrub ok 2024-02-10T08:41:23.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:41:22.172848+0000 mon.a (mon.0) 1913 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pgp_num", "val": "52"}]': finished 2024-02-10T08:41:23.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:22.172902+0000 mon.a (mon.0) 1914 : cluster [DBG] osdmap e471: 8 total, 8 up, 8 in 2024-02-10T08:41:23.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:22.305206+0000 osd.7 (osd.7) 9 : cluster [DBG] 5.1a scrub starts 2024-02-10T08:41:23.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:22.307020+0000 osd.7 (osd.7) 10 : cluster [DBG] 5.1a scrub ok 2024-02-10T08:41:23.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:22.671837+0000 osd.0 (osd.0) 294 : cluster [DBG] 6.23 scrub starts 2024-02-10T08:41:23.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:22.727799+0000 osd.0 (osd.0) 295 : cluster [DBG] 6.23 scrub ok 2024-02-10T08:41:23.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:41:22.172848+0000 mon.a (mon.0) 1913 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pgp_num", "val": "52"}]': finished 2024-02-10T08:41:23.569 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:22.172902+0000 mon.a (mon.0) 1914 : cluster [DBG] osdmap e471: 8 total, 8 up, 8 in 2024-02-10T08:41:23.569 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:22.305206+0000 osd.7 (osd.7) 9 : cluster [DBG] 5.1a scrub starts 2024-02-10T08:41:23.569 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:22.307020+0000 osd.7 (osd.7) 10 : cluster [DBG] 5.1a scrub ok 2024-02-10T08:41:23.569 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:22.671837+0000 osd.0 (osd.0) 294 : cluster [DBG] 6.23 scrub starts 2024-02-10T08:41:23.569 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:22.727799+0000 osd.0 (osd.0) 295 : cluster [DBG] 6.23 scrub ok 2024-02-10T08:41:24.431 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:23.191344+0000 osd.4 (osd.4) 13 : cluster [DBG] 5.1 scrub starts 2024-02-10T08:41:24.431 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:23.194231+0000 osd.4 (osd.4) 14 : cluster [DBG] 5.1 scrub ok 2024-02-10T08:41:24.431 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:23.227746+0000 mgr.y (mgr.14505) 920 : cluster [DBG] pgmap v1133: 162 pgs: 162 active+clean; 5.7 KiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s; 166 B/s, 8 objects/s recovering 2024-02-10T08:41:24.431 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:23.269052+0000 osd.7 (osd.7) 11 : cluster [DBG] 4.0 scrub starts 2024-02-10T08:41:24.431 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:23.270992+0000 osd.7 (osd.7) 12 : cluster [DBG] 4.0 scrub ok 2024-02-10T08:41:24.431 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:23.191344+0000 osd.4 (osd.4) 13 : cluster [DBG] 5.1 scrub starts 2024-02-10T08:41:24.431 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:23.194231+0000 osd.4 (osd.4) 14 : cluster [DBG] 5.1 scrub ok 2024-02-10T08:41:24.432 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:23.227746+0000 mgr.y (mgr.14505) 920 : cluster [DBG] pgmap v1133: 162 pgs: 162 active+clean; 5.7 KiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s; 166 B/s, 8 objects/s recovering 2024-02-10T08:41:24.432 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:23.269052+0000 osd.7 (osd.7) 11 : cluster [DBG] 4.0 scrub starts 2024-02-10T08:41:24.432 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:23.270992+0000 osd.7 (osd.7) 12 : cluster [DBG] 4.0 scrub ok 2024-02-10T08:41:24.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:23.191344+0000 osd.4 (osd.4) 13 : cluster [DBG] 5.1 scrub starts 2024-02-10T08:41:24.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:23.194231+0000 osd.4 (osd.4) 14 : cluster [DBG] 5.1 scrub ok 2024-02-10T08:41:24.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:23.227746+0000 mgr.y (mgr.14505) 920 : cluster [DBG] pgmap v1133: 162 pgs: 162 active+clean; 5.7 KiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s; 166 B/s, 8 objects/s recovering 2024-02-10T08:41:24.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:23.269052+0000 osd.7 (osd.7) 11 : cluster [DBG] 4.0 scrub starts 2024-02-10T08:41:24.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:23.270992+0000 osd.7 (osd.7) 12 : cluster [DBG] 4.0 scrub ok 2024-02-10T08:41:25.030 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-02-10T08:41:25.030 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:41:25.440 INFO:teuthology.orchestra.run.smithi018.stdout:mon.a: {} 2024-02-10T08:41:25.444 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:24.213088+0000 osd.4 (osd.4) 15 : cluster [DBG] 6.17 scrub starts 2024-02-10T08:41:25.444 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:24.284469+0000 osd.4 (osd.4) 16 : cluster [DBG] 6.17 scrub ok 2024-02-10T08:41:25.451 INFO:teuthology.orchestra.run.smithi018.stdout:mon.b: {} 2024-02-10T08:41:25.459 INFO:teuthology.orchestra.run.smithi018.stdout:mon.c: {} 2024-02-10T08:41:25.460 INFO:teuthology.orchestra.run.smithi018.stderr:mon.a: mon_osd_down_out_interval = '600' (not observed, change may require restart) 2024-02-10T08:41:25.460 INFO:teuthology.orchestra.run.smithi018.stderr:mon.b: mon_osd_down_out_interval = '600' (not observed, change may require restart) 2024-02-10T08:41:25.460 INFO:teuthology.orchestra.run.smithi018.stderr:mon.c: mon_osd_down_out_interval = '600' (not observed, change may require restart) 2024-02-10T08:41:25.482 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:24.213088+0000 osd.4 (osd.4) 15 : cluster [DBG] 6.17 scrub starts 2024-02-10T08:41:25.483 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:24.284469+0000 osd.4 (osd.4) 16 : cluster [DBG] 6.17 scrub ok 2024-02-10T08:41:25.483 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:24.213088+0000 osd.4 (osd.4) 15 : cluster [DBG] 6.17 scrub starts 2024-02-10T08:41:25.483 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:24.284469+0000 osd.4 (osd.4) 16 : cluster [DBG] 6.17 scrub ok 2024-02-10T08:41:25.754 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.7 dump_historic_ops 2024-02-10T08:41:26.023 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:41:26.406 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd reweight 0 1 2024-02-10T08:41:26.434 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:24.679732+0000 osd.1 (osd.1) 339 : cluster [DBG] 4.2 scrub starts 2024-02-10T08:41:26.434 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:24.683386+0000 osd.1 (osd.1) 340 : cluster [DBG] 4.2 scrub ok 2024-02-10T08:41:26.434 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:25.228282+0000 mgr.y (mgr.14505) 921 : cluster [DBG] pgmap v1134: 162 pgs: 162 active+clean; 5.7 KiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 126 B/s, 6 objects/s recovering 2024-02-10T08:41:26.435 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:25.261725+0000 osd.5 (osd.5) 304 : cluster [DBG] 1.8 deep-scrub starts 2024-02-10T08:41:26.435 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:25.264733+0000 osd.5 (osd.5) 305 : cluster [DBG] 1.8 deep-scrub ok 2024-02-10T08:41:26.435 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:25.272358+0000 osd.7 (osd.7) 13 : cluster [DBG] 6.15 scrub starts 2024-02-10T08:41:26.435 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:25.290427+0000 osd.7 (osd.7) 14 : cluster [DBG] 6.15 scrub ok 2024-02-10T08:41:26.435 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:41:25.430608+0000 mon.c (mon.2) 112 : audit [DBG] from='client.? 172.21.15.18:0/289500396' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-10T08:41:26.435 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:26.106071+0000 mon.a (mon.0) 1915 : cluster [DBG] osdmap e472: 8 total, 8 up, 8 in 2024-02-10T08:41:26.435 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:24.679732+0000 osd.1 (osd.1) 339 : cluster [DBG] 4.2 scrub starts 2024-02-10T08:41:26.435 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:24.683386+0000 osd.1 (osd.1) 340 : cluster [DBG] 4.2 scrub ok 2024-02-10T08:41:26.435 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:25.228282+0000 mgr.y (mgr.14505) 921 : cluster [DBG] pgmap v1134: 162 pgs: 162 active+clean; 5.7 KiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 126 B/s, 6 objects/s recovering 2024-02-10T08:41:26.435 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:25.261725+0000 osd.5 (osd.5) 304 : cluster [DBG] 1.8 deep-scrub starts 2024-02-10T08:41:26.435 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:25.264733+0000 osd.5 (osd.5) 305 : cluster [DBG] 1.8 deep-scrub ok 2024-02-10T08:41:26.436 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:25.272358+0000 osd.7 (osd.7) 13 : cluster [DBG] 6.15 scrub starts 2024-02-10T08:41:26.436 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:25.290427+0000 osd.7 (osd.7) 14 : cluster [DBG] 6.15 scrub ok 2024-02-10T08:41:26.436 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:41:25.430608+0000 mon.c (mon.2) 112 : audit [DBG] from='client.? 172.21.15.18:0/289500396' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-10T08:41:26.436 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:26.106071+0000 mon.a (mon.0) 1915 : cluster [DBG] osdmap e472: 8 total, 8 up, 8 in 2024-02-10T08:41:26.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:24.679732+0000 osd.1 (osd.1) 339 : cluster [DBG] 4.2 scrub starts 2024-02-10T08:41:26.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:24.683386+0000 osd.1 (osd.1) 340 : cluster [DBG] 4.2 scrub ok 2024-02-10T08:41:26.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:25.228282+0000 mgr.y (mgr.14505) 921 : cluster [DBG] pgmap v1134: 162 pgs: 162 active+clean; 5.7 KiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 126 B/s, 6 objects/s recovering 2024-02-10T08:41:26.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:25.261725+0000 osd.5 (osd.5) 304 : cluster [DBG] 1.8 deep-scrub starts 2024-02-10T08:41:26.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:25.264733+0000 osd.5 (osd.5) 305 : cluster [DBG] 1.8 deep-scrub ok 2024-02-10T08:41:26.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:25.272358+0000 osd.7 (osd.7) 13 : cluster [DBG] 6.15 scrub starts 2024-02-10T08:41:26.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:25.290427+0000 osd.7 (osd.7) 14 : cluster [DBG] 6.15 scrub ok 2024-02-10T08:41:26.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:41:25.430608+0000 mon.c (mon.2) 112 : audit [DBG] from='client.? 172.21.15.18:0/289500396' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-10T08:41:26.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:26.106071+0000 mon.a (mon.0) 1915 : cluster [DBG] osdmap e472: 8 total, 8 up, 8 in 2024-02-10T08:41:26.689 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:41:26.789 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:41:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:41:26] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:41:27.181 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:41:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:41:27] "GET /metrics HTTP/1.1" 200 173939 "" "Prometheus/2.33.4" 2024-02-10T08:41:27.256 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:26.003470+0000 osd.2 (osd.2) 287 : cluster [DBG] 5.a deep-scrub starts 2024-02-10T08:41:27.256 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:26.004332+0000 osd.2 (osd.2) 288 : cluster [DBG] 5.a deep-scrub ok 2024-02-10T08:41:27.256 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:26.220315+0000 osd.4 (osd.4) 17 : cluster [DBG] 5.1c scrub starts 2024-02-10T08:41:27.256 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:26.223220+0000 osd.4 (osd.4) 18 : cluster [DBG] 5.1c scrub ok 2024-02-10T08:41:27.257 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:26.223952+0000 osd.5 (osd.5) 306 : cluster [DBG] 1.a scrub starts 2024-02-10T08:41:27.257 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:26.227043+0000 osd.5 (osd.5) 307 : cluster [DBG] 1.a scrub ok 2024-02-10T08:41:27.257 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:26.321033+0000 osd.7 (osd.7) 15 : cluster [DBG] 2.1d scrub starts 2024-02-10T08:41:27.257 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:26.323125+0000 osd.7 (osd.7) 16 : cluster [DBG] 2.1d scrub ok 2024-02-10T08:41:27.257 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:26.613689+0000 osd.0 (osd.0) 296 : cluster [DBG] 5.2 scrub starts 2024-02-10T08:41:27.257 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:26.615089+0000 osd.0 (osd.0) 297 : cluster [DBG] 5.2 scrub ok 2024-02-10T08:41:27.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:26.003470+0000 osd.2 (osd.2) 287 : cluster [DBG] 5.a deep-scrub starts 2024-02-10T08:41:27.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:26.004332+0000 osd.2 (osd.2) 288 : cluster [DBG] 5.a deep-scrub ok 2024-02-10T08:41:27.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:26.220315+0000 osd.4 (osd.4) 17 : cluster [DBG] 5.1c scrub starts 2024-02-10T08:41:27.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:26.223220+0000 osd.4 (osd.4) 18 : cluster [DBG] 5.1c scrub ok 2024-02-10T08:41:27.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:26.223952+0000 osd.5 (osd.5) 306 : cluster [DBG] 1.a scrub starts 2024-02-10T08:41:27.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:26.227043+0000 osd.5 (osd.5) 307 : cluster [DBG] 1.a scrub ok 2024-02-10T08:41:27.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:26.321033+0000 osd.7 (osd.7) 15 : cluster [DBG] 2.1d scrub starts 2024-02-10T08:41:27.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:26.323125+0000 osd.7 (osd.7) 16 : cluster [DBG] 2.1d scrub ok 2024-02-10T08:41:27.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:26.613689+0000 osd.0 (osd.0) 296 : cluster [DBG] 5.2 scrub starts 2024-02-10T08:41:27.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:26.615089+0000 osd.0 (osd.0) 297 : cluster [DBG] 5.2 scrub ok 2024-02-10T08:41:27.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:26.003470+0000 osd.2 (osd.2) 287 : cluster [DBG] 5.a deep-scrub starts 2024-02-10T08:41:27.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:26.004332+0000 osd.2 (osd.2) 288 : cluster [DBG] 5.a deep-scrub ok 2024-02-10T08:41:27.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:26.220315+0000 osd.4 (osd.4) 17 : cluster [DBG] 5.1c scrub starts 2024-02-10T08:41:27.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:26.223220+0000 osd.4 (osd.4) 18 : cluster [DBG] 5.1c scrub ok 2024-02-10T08:41:27.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:26.223952+0000 osd.5 (osd.5) 306 : cluster [DBG] 1.a scrub starts 2024-02-10T08:41:27.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:26.227043+0000 osd.5 (osd.5) 307 : cluster [DBG] 1.a scrub ok 2024-02-10T08:41:27.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:26.321033+0000 osd.7 (osd.7) 15 : cluster [DBG] 2.1d scrub starts 2024-02-10T08:41:27.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:26.323125+0000 osd.7 (osd.7) 16 : cluster [DBG] 2.1d scrub ok 2024-02-10T08:41:27.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:26.613689+0000 osd.0 (osd.0) 296 : cluster [DBG] 5.2 scrub starts 2024-02-10T08:41:27.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:26.615089+0000 osd.0 (osd.0) 297 : cluster [DBG] 5.2 scrub ok 2024-02-10T08:41:27.763 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-02-10T08:41:27.763 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-10T08:41:28.425 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.4 dump_ops_in_flight 2024-02-10T08:41:28.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:27.174892+0000 osd.5 (osd.5) 308 : cluster [DBG] 4.15 scrub starts 2024-02-10T08:41:28.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:27.178360+0000 osd.5 (osd.5) 309 : cluster [DBG] 4.15 scrub ok 2024-02-10T08:41:28.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:27.204388+0000 osd.4 (osd.4) 19 : cluster [DBG] 4.18 scrub starts 2024-02-10T08:41:28.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:27.207858+0000 osd.4 (osd.4) 20 : cluster [DBG] 4.18 scrub ok 2024-02-10T08:41:28.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:27.228727+0000 mgr.y (mgr.14505) 922 : cluster [DBG] pgmap v1136: 162 pgs: 162 active+clean; 5.7 KiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 835 B/s rd, 0 op/s 2024-02-10T08:41:28.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:27.374103+0000 osd.6 (osd.6) 305 : cluster [DBG] 2.17 scrub starts 2024-02-10T08:41:28.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:27.376991+0000 osd.6 (osd.6) 306 : cluster [DBG] 2.17 scrub ok 2024-02-10T08:41:28.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:41:27.539224+0000 mon.a (mon.0) 1916 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:41:28.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:28.305502+0000 osd.7 (osd.7) 17 : cluster [DBG] 6.1c scrub starts 2024-02-10T08:41:28.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:28.306942+0000 osd.7 (osd.7) 18 : cluster [DBG] 6.1c scrub ok 2024-02-10T08:41:28.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:27.174892+0000 osd.5 (osd.5) 308 : cluster [DBG] 4.15 scrub starts 2024-02-10T08:41:28.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:27.178360+0000 osd.5 (osd.5) 309 : cluster [DBG] 4.15 scrub ok 2024-02-10T08:41:28.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:27.204388+0000 osd.4 (osd.4) 19 : cluster [DBG] 4.18 scrub starts 2024-02-10T08:41:28.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:27.207858+0000 osd.4 (osd.4) 20 : cluster [DBG] 4.18 scrub ok 2024-02-10T08:41:28.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:27.228727+0000 mgr.y (mgr.14505) 922 : cluster [DBG] pgmap v1136: 162 pgs: 162 active+clean; 5.7 KiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 835 B/s rd, 0 op/s 2024-02-10T08:41:28.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:27.374103+0000 osd.6 (osd.6) 305 : cluster [DBG] 2.17 scrub starts 2024-02-10T08:41:28.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:27.376991+0000 osd.6 (osd.6) 306 : cluster [DBG] 2.17 scrub ok 2024-02-10T08:41:28.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:41:27.539224+0000 mon.a (mon.0) 1916 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:41:28.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:28.305502+0000 osd.7 (osd.7) 17 : cluster [DBG] 6.1c scrub starts 2024-02-10T08:41:28.656 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:28.306942+0000 osd.7 (osd.7) 18 : cluster [DBG] 6.1c scrub ok 2024-02-10T08:41:28.694 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:41:28.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:27.174892+0000 osd.5 (osd.5) 308 : cluster [DBG] 4.15 scrub starts 2024-02-10T08:41:28.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:27.178360+0000 osd.5 (osd.5) 309 : cluster [DBG] 4.15 scrub ok 2024-02-10T08:41:28.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:27.204388+0000 osd.4 (osd.4) 19 : cluster [DBG] 4.18 scrub starts 2024-02-10T08:41:28.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:27.207858+0000 osd.4 (osd.4) 20 : cluster [DBG] 4.18 scrub ok 2024-02-10T08:41:28.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:27.228727+0000 mgr.y (mgr.14505) 922 : cluster [DBG] pgmap v1136: 162 pgs: 162 active+clean; 5.7 KiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 835 B/s rd, 0 op/s 2024-02-10T08:41:28.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:27.374103+0000 osd.6 (osd.6) 305 : cluster [DBG] 2.17 scrub starts 2024-02-10T08:41:28.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:27.376991+0000 osd.6 (osd.6) 306 : cluster [DBG] 2.17 scrub ok 2024-02-10T08:41:28.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:41:27.539224+0000 mon.a (mon.0) 1916 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:41:28.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:28.305502+0000 osd.7 (osd.7) 17 : cluster [DBG] 6.1c scrub starts 2024-02-10T08:41:28.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:28.306942+0000 osd.7 (osd.7) 18 : cluster [DBG] 6.1c scrub ok 2024-02-10T08:41:29.289 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:41:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:41:29.549 INFO:teuthology.orchestra.run.smithi018.stderr:reweighted osd.0 to 1 (10000) 2024-02-10T08:41:29.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:41:28.857842+0000 mon.c (mon.2) 113 : audit [INF] from='client.? 172.21.15.18:0/78301051' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2024-02-10T08:41:29.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:41:28.858153+0000 mon.a (mon.0) 1917 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2024-02-10T08:41:29.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:41:28.857842+0000 mon.c (mon.2) 113 : audit [INF] from='client.? 172.21.15.18:0/78301051' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2024-02-10T08:41:29.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:41:28.858153+0000 mon.a (mon.0) 1917 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2024-02-10T08:41:29.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:41:28.857842+0000 mon.c (mon.2) 113 : audit [INF] from='client.? 172.21.15.18:0/78301051' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2024-02-10T08:41:29.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:41:28.858153+0000 mon.a (mon.0) 1917 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2024-02-10T08:41:30.398 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-02-10T08:41:30.399 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-02-10T08:41:30.399 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-02-10T08:41:30.399 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-02-10T08:41:30.470 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd primary-affinity 0 1 2024-02-10T08:41:30.772 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:41:29.101651+0000 mgr.y (mgr.14505) 923 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:41:30.772 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:29.182957+0000 osd.4 (osd.4) 21 : cluster [DBG] 4.c scrub starts 2024-02-10T08:41:30.772 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:29.186429+0000 osd.4 (osd.4) 22 : cluster [DBG] 4.c scrub ok 2024-02-10T08:41:30.772 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:29.229540+0000 mgr.y (mgr.14505) 924 : cluster [DBG] pgmap v1137: 162 pgs: 162 active+clean; 5.7 KiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:41:30.772 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:29.445527+0000 osd.6 (osd.6) 307 : cluster [DBG] 4.1f scrub starts 2024-02-10T08:41:30.772 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:29.449178+0000 osd.6 (osd.6) 308 : cluster [DBG] 4.1f scrub ok 2024-02-10T08:41:30.772 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:41:29.543913+0000 mon.a (mon.0) 1918 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2024-02-10T08:41:30.772 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:29.544011+0000 mon.a (mon.0) 1919 : cluster [DBG] osdmap e473: 8 total, 8 up, 8 in 2024-02-10T08:41:30.772 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:30.339248+0000 osd.7 (osd.7) 19 : cluster [DBG] 5.4 scrub starts 2024-02-10T08:41:30.772 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:30.340104+0000 osd.7 (osd.7) 20 : cluster [DBG] 5.4 scrub ok 2024-02-10T08:41:30.798 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:41:30.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:41:29.101651+0000 mgr.y (mgr.14505) 923 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:41:30.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:29.182957+0000 osd.4 (osd.4) 21 : cluster [DBG] 4.c scrub starts 2024-02-10T08:41:30.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:29.186429+0000 osd.4 (osd.4) 22 : cluster [DBG] 4.c scrub ok 2024-02-10T08:41:30.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:29.229540+0000 mgr.y (mgr.14505) 924 : cluster [DBG] pgmap v1137: 162 pgs: 162 active+clean; 5.7 KiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:41:30.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:29.445527+0000 osd.6 (osd.6) 307 : cluster [DBG] 4.1f scrub starts 2024-02-10T08:41:30.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:29.449178+0000 osd.6 (osd.6) 308 : cluster [DBG] 4.1f scrub ok 2024-02-10T08:41:30.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:41:29.543913+0000 mon.a (mon.0) 1918 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2024-02-10T08:41:30.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:29.544011+0000 mon.a (mon.0) 1919 : cluster [DBG] osdmap e473: 8 total, 8 up, 8 in 2024-02-10T08:41:30.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:30.339248+0000 osd.7 (osd.7) 19 : cluster [DBG] 5.4 scrub starts 2024-02-10T08:41:30.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:30.340104+0000 osd.7 (osd.7) 20 : cluster [DBG] 5.4 scrub ok 2024-02-10T08:41:30.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:41:29.101651+0000 mgr.y (mgr.14505) 923 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:41:30.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:29.182957+0000 osd.4 (osd.4) 21 : cluster [DBG] 4.c scrub starts 2024-02-10T08:41:30.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:29.186429+0000 osd.4 (osd.4) 22 : cluster [DBG] 4.c scrub ok 2024-02-10T08:41:30.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:29.229540+0000 mgr.y (mgr.14505) 924 : cluster [DBG] pgmap v1137: 162 pgs: 162 active+clean; 5.7 KiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:41:30.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:29.445527+0000 osd.6 (osd.6) 307 : cluster [DBG] 4.1f scrub starts 2024-02-10T08:41:30.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:29.449178+0000 osd.6 (osd.6) 308 : cluster [DBG] 4.1f scrub ok 2024-02-10T08:41:30.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:41:29.543913+0000 mon.a (mon.0) 1918 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2024-02-10T08:41:30.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:29.544011+0000 mon.a (mon.0) 1919 : cluster [DBG] osdmap e473: 8 total, 8 up, 8 in 2024-02-10T08:41:30.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:30.339248+0000 osd.7 (osd.7) 19 : cluster [DBG] 5.4 scrub starts 2024-02-10T08:41:30.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:30.340104+0000 osd.7 (osd.7) 20 : cluster [DBG] 5.4 scrub ok 2024-02-10T08:41:31.131 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.4 dump_blocked_ops 2024-02-10T08:41:31.402 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:41:31.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:30.438379+0000 osd.6 (osd.6) 309 : cluster [DBG] 2.1a scrub starts 2024-02-10T08:41:31.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:30.439327+0000 osd.6 (osd.6) 310 : cluster [DBG] 2.1a scrub ok 2024-02-10T08:41:31.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:30.652995+0000 osd.0 (osd.0) 298 : cluster [DBG] 6.16 scrub starts 2024-02-10T08:41:31.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:30.655951+0000 osd.0 (osd.0) 299 : cluster [DBG] 6.16 scrub ok 2024-02-10T08:41:31.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:31.106893+0000 mon.a (mon.0) 1920 : cluster [DBG] osdmap e474: 8 total, 8 up, 8 in 2024-02-10T08:41:31.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:30.438379+0000 osd.6 (osd.6) 309 : cluster [DBG] 2.1a scrub starts 2024-02-10T08:41:31.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:30.439327+0000 osd.6 (osd.6) 310 : cluster [DBG] 2.1a scrub ok 2024-02-10T08:41:31.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:30.652995+0000 osd.0 (osd.0) 298 : cluster [DBG] 6.16 scrub starts 2024-02-10T08:41:31.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:30.655951+0000 osd.0 (osd.0) 299 : cluster [DBG] 6.16 scrub ok 2024-02-10T08:41:31.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:31.106893+0000 mon.a (mon.0) 1920 : cluster [DBG] osdmap e474: 8 total, 8 up, 8 in 2024-02-10T08:41:31.893 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:30.438379+0000 osd.6 (osd.6) 309 : cluster [DBG] 2.1a scrub starts 2024-02-10T08:41:31.894 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:30.439327+0000 osd.6 (osd.6) 310 : cluster [DBG] 2.1a scrub ok 2024-02-10T08:41:31.894 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:30.652995+0000 osd.0 (osd.0) 298 : cluster [DBG] 6.16 scrub starts 2024-02-10T08:41:31.894 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:30.655951+0000 osd.0 (osd.0) 299 : cluster [DBG] 6.16 scrub ok 2024-02-10T08:41:31.894 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:31.106893+0000 mon.a (mon.0) 1920 : cluster [DBG] osdmap e474: 8 total, 8 up, 8 in 2024-02-10T08:41:32.683 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:31.115619+0000 osd.2 (osd.2) 289 : cluster [DBG] 6.28 scrub starts 2024-02-10T08:41:32.684 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:31.116768+0000 osd.2 (osd.2) 290 : cluster [DBG] 6.28 scrub ok 2024-02-10T08:41:32.684 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:31.171023+0000 osd.5 (osd.5) 310 : cluster [DBG] 2.2 scrub starts 2024-02-10T08:41:32.684 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:31.173926+0000 osd.5 (osd.5) 311 : cluster [DBG] 2.2 scrub ok 2024-02-10T08:41:32.684 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:31.229927+0000 mgr.y (mgr.14505) 925 : cluster [DBG] pgmap v1140: 162 pgs: 162 active+clean; 5.7 KiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:41:32.684 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:31.631732+0000 osd.0 (osd.0) 300 : cluster [DBG] 4.16 scrub starts 2024-02-10T08:41:32.684 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:31.635208+0000 osd.0 (osd.0) 301 : cluster [DBG] 4.16 scrub ok 2024-02-10T08:41:32.684 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:31.714906+0000 osd.1 (osd.1) 341 : cluster [DBG] 5.1d scrub starts 2024-02-10T08:41:32.684 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:31.717856+0000 osd.1 (osd.1) 342 : cluster [DBG] 5.1d scrub ok 2024-02-10T08:41:32.684 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:41:32.545697+0000 mon.a (mon.0) 1921 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:41:32.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:31.115619+0000 osd.2 (osd.2) 289 : cluster [DBG] 6.28 scrub starts 2024-02-10T08:41:32.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:31.116768+0000 osd.2 (osd.2) 290 : cluster [DBG] 6.28 scrub ok 2024-02-10T08:41:32.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:31.171023+0000 osd.5 (osd.5) 310 : cluster [DBG] 2.2 scrub starts 2024-02-10T08:41:32.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:31.173926+0000 osd.5 (osd.5) 311 : cluster [DBG] 2.2 scrub ok 2024-02-10T08:41:32.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:31.229927+0000 mgr.y (mgr.14505) 925 : cluster [DBG] pgmap v1140: 162 pgs: 162 active+clean; 5.7 KiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:41:32.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:31.631732+0000 osd.0 (osd.0) 300 : cluster [DBG] 4.16 scrub starts 2024-02-10T08:41:32.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:31.635208+0000 osd.0 (osd.0) 301 : cluster [DBG] 4.16 scrub ok 2024-02-10T08:41:32.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:31.714906+0000 osd.1 (osd.1) 341 : cluster [DBG] 5.1d scrub starts 2024-02-10T08:41:32.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:31.717856+0000 osd.1 (osd.1) 342 : cluster [DBG] 5.1d scrub ok 2024-02-10T08:41:32.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:41:32.545697+0000 mon.a (mon.0) 1921 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:41:32.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:31.115619+0000 osd.2 (osd.2) 289 : cluster [DBG] 6.28 scrub starts 2024-02-10T08:41:32.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:31.116768+0000 osd.2 (osd.2) 290 : cluster [DBG] 6.28 scrub ok 2024-02-10T08:41:32.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:31.171023+0000 osd.5 (osd.5) 310 : cluster [DBG] 2.2 scrub starts 2024-02-10T08:41:32.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:31.173926+0000 osd.5 (osd.5) 311 : cluster [DBG] 2.2 scrub ok 2024-02-10T08:41:32.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:31.229927+0000 mgr.y (mgr.14505) 925 : cluster [DBG] pgmap v1140: 162 pgs: 162 active+clean; 5.7 KiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:41:32.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:31.631732+0000 osd.0 (osd.0) 300 : cluster [DBG] 4.16 scrub starts 2024-02-10T08:41:32.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:31.635208+0000 osd.0 (osd.0) 301 : cluster [DBG] 4.16 scrub ok 2024-02-10T08:41:32.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:31.714906+0000 osd.1 (osd.1) 341 : cluster [DBG] 5.1d scrub starts 2024-02-10T08:41:32.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:31.717856+0000 osd.1 (osd.1) 342 : cluster [DBG] 5.1d scrub ok 2024-02-10T08:41:32.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:41:32.545697+0000 mon.a (mon.0) 1921 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:41:33.235 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-02-10T08:41:33.235 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-02-10T08:41:33.235 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-02-10T08:41:33.236 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-02-10T08:41:33.236 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-02-10T08:41:33.560 INFO:teuthology.orchestra.run.smithi018.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-02-10T08:41:33.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:32.127341+0000 osd.5 (osd.5) 312 : cluster [DBG] 2.3 deep-scrub starts 2024-02-10T08:41:33.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:32.130269+0000 osd.5 (osd.5) 313 : cluster [DBG] 2.3 deep-scrub ok 2024-02-10T08:41:33.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:41:32.969191+0000 mon.a (mon.0) 1922 : audit [INF] from='client.? 172.21.15.18:0/2415579974' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 0, "weight": 1.0}]: dispatch 2024-02-10T08:41:33.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:33.132094+0000 osd.4 (osd.4) 23 : cluster [DBG] 4.1 scrub starts 2024-02-10T08:41:33.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:33.135566+0000 osd.4 (osd.4) 24 : cluster [DBG] 4.1 scrub ok 2024-02-10T08:41:33.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:33.297685+0000 osd.7 (osd.7) 21 : cluster [DBG] 5.9 scrub starts 2024-02-10T08:41:33.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:33.299176+0000 osd.7 (osd.7) 22 : cluster [DBG] 5.9 scrub ok 2024-02-10T08:41:33.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:32.127341+0000 osd.5 (osd.5) 312 : cluster [DBG] 2.3 deep-scrub starts 2024-02-10T08:41:33.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:32.130269+0000 osd.5 (osd.5) 313 : cluster [DBG] 2.3 deep-scrub ok 2024-02-10T08:41:33.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:41:32.969191+0000 mon.a (mon.0) 1922 : audit [INF] from='client.? 172.21.15.18:0/2415579974' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 0, "weight": 1.0}]: dispatch 2024-02-10T08:41:33.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:33.132094+0000 osd.4 (osd.4) 23 : cluster [DBG] 4.1 scrub starts 2024-02-10T08:41:33.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:33.135566+0000 osd.4 (osd.4) 24 : cluster [DBG] 4.1 scrub ok 2024-02-10T08:41:33.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:33.297685+0000 osd.7 (osd.7) 21 : cluster [DBG] 5.9 scrub starts 2024-02-10T08:41:33.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:33.299176+0000 osd.7 (osd.7) 22 : cluster [DBG] 5.9 scrub ok 2024-02-10T08:41:34.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:32.127341+0000 osd.5 (osd.5) 312 : cluster [DBG] 2.3 deep-scrub starts 2024-02-10T08:41:34.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:32.130269+0000 osd.5 (osd.5) 313 : cluster [DBG] 2.3 deep-scrub ok 2024-02-10T08:41:34.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:41:32.969191+0000 mon.a (mon.0) 1922 : audit [INF] from='client.? 172.21.15.18:0/2415579974' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 0, "weight": 1.0}]: dispatch 2024-02-10T08:41:34.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:33.132094+0000 osd.4 (osd.4) 23 : cluster [DBG] 4.1 scrub starts 2024-02-10T08:41:34.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:33.135566+0000 osd.4 (osd.4) 24 : cluster [DBG] 4.1 scrub ok 2024-02-10T08:41:34.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:33.297685+0000 osd.7 (osd.7) 21 : cluster [DBG] 5.9 scrub starts 2024-02-10T08:41:34.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:33.299176+0000 osd.7 (osd.7) 22 : cluster [DBG] 5.9 scrub ok 2024-02-10T08:41:34.391 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd reweight 1 1 2024-02-10T08:41:34.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:33.230755+0000 mgr.y (mgr.14505) 926 : cluster [DBG] pgmap v1141: 162 pgs: 162 active+clean; 5.7 KiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-02-10T08:41:34.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:41:33.554590+0000 mon.a (mon.0) 1923 : audit [INF] from='client.? 172.21.15.18:0/2415579974' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 0, "weight": 1.0}]': finished 2024-02-10T08:41:34.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:33.554685+0000 mon.a (mon.0) 1924 : cluster [DBG] osdmap e475: 8 total, 8 up, 8 in 2024-02-10T08:41:34.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:34.088565+0000 osd.4 (osd.4) 25 : cluster [DBG] 4.1a scrub starts 2024-02-10T08:41:34.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:34.092323+0000 osd.4 (osd.4) 26 : cluster [DBG] 4.1a scrub ok 2024-02-10T08:41:34.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:33.230755+0000 mgr.y (mgr.14505) 926 : cluster [DBG] pgmap v1141: 162 pgs: 162 active+clean; 5.7 KiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-02-10T08:41:34.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:41:33.554590+0000 mon.a (mon.0) 1923 : audit [INF] from='client.? 172.21.15.18:0/2415579974' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 0, "weight": 1.0}]': finished 2024-02-10T08:41:34.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:33.554685+0000 mon.a (mon.0) 1924 : cluster [DBG] osdmap e475: 8 total, 8 up, 8 in 2024-02-10T08:41:34.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:34.088565+0000 osd.4 (osd.4) 25 : cluster [DBG] 4.1a scrub starts 2024-02-10T08:41:34.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:34.092323+0000 osd.4 (osd.4) 26 : cluster [DBG] 4.1a scrub ok 2024-02-10T08:41:34.665 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph daemon osd.4 dump_historic_ops 2024-02-10T08:41:34.675 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:41:34.937 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.b/config 2024-02-10T08:41:35.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:33.230755+0000 mgr.y (mgr.14505) 926 : cluster [DBG] pgmap v1141: 162 pgs: 162 active+clean; 5.7 KiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-02-10T08:41:35.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:41:33.554590+0000 mon.a (mon.0) 1923 : audit [INF] from='client.? 172.21.15.18:0/2415579974' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 0, "weight": 1.0}]': finished 2024-02-10T08:41:35.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:33.554685+0000 mon.a (mon.0) 1924 : cluster [DBG] osdmap e475: 8 total, 8 up, 8 in 2024-02-10T08:41:35.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:34.088565+0000 osd.4 (osd.4) 25 : cluster [DBG] 4.1a scrub starts 2024-02-10T08:41:35.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:34.092323+0000 osd.4 (osd.4) 26 : cluster [DBG] 4.1a scrub ok 2024-02-10T08:41:35.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:34.103080+0000 osd.5 (osd.5) 314 : cluster [DBG] 6.24 scrub starts 2024-02-10T08:41:35.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:34.106024+0000 osd.5 (osd.5) 315 : cluster [DBG] 6.24 scrub ok 2024-02-10T08:41:35.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:34.682066+0000 osd.0 (osd.0) 302 : cluster [DBG] 3.1 deep-scrub starts 2024-02-10T08:41:35.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:34.684951+0000 osd.0 (osd.0) 303 : cluster [DBG] 3.1 deep-scrub ok 2024-02-10T08:41:35.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:35.091340+0000 osd.4 (osd.4) 27 : cluster [DBG] 4.9 deep-scrub starts 2024-02-10T08:41:35.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:35.095228+0000 osd.4 (osd.4) 28 : cluster [DBG] 4.9 deep-scrub ok 2024-02-10T08:41:35.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:34.103080+0000 osd.5 (osd.5) 314 : cluster [DBG] 6.24 scrub starts 2024-02-10T08:41:35.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:34.106024+0000 osd.5 (osd.5) 315 : cluster [DBG] 6.24 scrub ok 2024-02-10T08:41:35.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:34.682066+0000 osd.0 (osd.0) 302 : cluster [DBG] 3.1 deep-scrub starts 2024-02-10T08:41:35.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:34.684951+0000 osd.0 (osd.0) 303 : cluster [DBG] 3.1 deep-scrub ok 2024-02-10T08:41:35.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:35.091340+0000 osd.4 (osd.4) 27 : cluster [DBG] 4.9 deep-scrub starts 2024-02-10T08:41:35.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:35.095228+0000 osd.4 (osd.4) 28 : cluster [DBG] 4.9 deep-scrub ok 2024-02-10T08:41:35.925 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:34.103080+0000 osd.5 (osd.5) 314 : cluster [DBG] 6.24 scrub starts 2024-02-10T08:41:35.925 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:34.106024+0000 osd.5 (osd.5) 315 : cluster [DBG] 6.24 scrub ok 2024-02-10T08:41:35.925 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:34.682066+0000 osd.0 (osd.0) 302 : cluster [DBG] 3.1 deep-scrub starts 2024-02-10T08:41:35.925 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:34.684951+0000 osd.0 (osd.0) 303 : cluster [DBG] 3.1 deep-scrub ok 2024-02-10T08:41:35.925 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:35.091340+0000 osd.4 (osd.4) 27 : cluster [DBG] 4.9 deep-scrub starts 2024-02-10T08:41:35.925 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:35.095228+0000 osd.4 (osd.4) 28 : cluster [DBG] 4.9 deep-scrub ok 2024-02-10T08:41:36.546 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:41:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:41:36] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:41:36.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:35.215927+0000 osd.2 (osd.2) 291 : cluster [DBG] 5.6 scrub starts 2024-02-10T08:41:36.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:35.216802+0000 osd.2 (osd.2) 292 : cluster [DBG] 5.6 scrub ok 2024-02-10T08:41:36.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:35.231141+0000 mgr.y (mgr.14505) 927 : cluster [DBG] pgmap v1143: 162 pgs: 162 active+clean; 5.7 KiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:41:36.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:35.431369+0000 osd.6 (osd.6) 311 : cluster [DBG] 2.14 scrub starts 2024-02-10T08:41:36.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:35.434251+0000 osd.6 (osd.6) 312 : cluster [DBG] 2.14 scrub ok 2024-02-10T08:41:36.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:35.636470+0000 osd.0 (osd.0) 304 : cluster [DBG] 5.5 scrub starts 2024-02-10T08:41:36.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:35.637308+0000 osd.0 (osd.0) 305 : cluster [DBG] 5.5 scrub ok 2024-02-10T08:41:36.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:36.108666+0000 mon.a (mon.0) 1925 : cluster [DBG] osdmap e476: 8 total, 8 up, 8 in 2024-02-10T08:41:36.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:35.215927+0000 osd.2 (osd.2) 291 : cluster [DBG] 5.6 scrub starts 2024-02-10T08:41:36.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:35.216802+0000 osd.2 (osd.2) 292 : cluster [DBG] 5.6 scrub ok 2024-02-10T08:41:36.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:35.231141+0000 mgr.y (mgr.14505) 927 : cluster [DBG] pgmap v1143: 162 pgs: 162 active+clean; 5.7 KiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:41:36.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:35.431369+0000 osd.6 (osd.6) 311 : cluster [DBG] 2.14 scrub starts 2024-02-10T08:41:36.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:35.434251+0000 osd.6 (osd.6) 312 : cluster [DBG] 2.14 scrub ok 2024-02-10T08:41:36.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:35.636470+0000 osd.0 (osd.0) 304 : cluster [DBG] 5.5 scrub starts 2024-02-10T08:41:36.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:35.637308+0000 osd.0 (osd.0) 305 : cluster [DBG] 5.5 scrub ok 2024-02-10T08:41:36.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:36.108666+0000 mon.a (mon.0) 1925 : cluster [DBG] osdmap e476: 8 total, 8 up, 8 in 2024-02-10T08:41:36.809 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-02-10T08:41:36.809 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-02-10T08:41:36.809 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-02-10T08:41:36.809 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-02-10T08:41:36.809 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.809 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "pg_update_log_missing(5.0 epoch 465/463 rep_tid 192829 entries 465'16 (0'0) error 5:5bf5b680:::notify.1:head by client.24299.0:3310 0.000000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-02-10T08:41:36.809 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:41:11.337317+0000", 2024-02-10T08:41:36.809 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 25.469834012, 2024-02-10T08:41:36.810 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00037620399999999999, 2024-02-10T08:41:36.810 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:41:36.810 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-02-10T08:41:36.810 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:41:36.810 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.810 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:41:36.810 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:11.337317+0000", 2024-02-10T08:41:36.810 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:41:36.810 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.810 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.810 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:41:36.810 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:11.337317+0000", 2024-02-10T08:41:36.810 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967296 2024-02-10T08:41:36.810 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.811 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.811 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:41:36.811 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:11.337317+0000", 2024-02-10T08:41:36.811 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3479999999999998e-06 2024-02-10T08:41:36.811 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.811 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.811 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:41:36.811 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:11.337324+0000", 2024-02-10T08:41:36.811 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.275e-05 2024-02-10T08:41:36.811 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.811 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.811 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:41:36.811 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:11.337337+0000", 2024-02-10T08:41:36.812 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8151e-05 2024-02-10T08:41:36.812 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.812 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.812 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:41:36.812 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:11.337355+0000", 2024-02-10T08:41:36.812 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1772000000000004e-05 2024-02-10T08:41:36.812 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.812 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.812 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:41:36.812 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:11.337417+0000", 2024-02-10T08:41:36.812 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00027638499999999998 2024-02-10T08:41:36.812 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.813 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.813 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:41:36.813 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:11.337693+0000", 2024-02-10T08:41:36.813 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00037620399999999999 2024-02-10T08:41:36.813 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:41:36.813 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:41:36.813 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:41:36.813 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.813 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.813 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.24299.0:3311 5.9 5:93e5b521:::notify.7:head [watch reconnect cookie 94587203968896 gen 5] snapc 0=[] ondisk+write+known_if_redirected e465)", 2024-02-10T08:41:36.813 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:41:11.337466+0000", 2024-02-10T08:41:36.813 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 25.46968532, 2024-02-10T08:41:36.813 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020692039999999998, 2024-02-10T08:41:36.813 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:41:36.814 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-02-10T08:41:36.814 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:41:36.814 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.24299", 2024-02-10T08:41:36.814 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/871408063", 2024-02-10T08:41:36.814 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3311 2024-02-10T08:41:36.814 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.814 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:41:36.814 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.814 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:41:36.814 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:11.337466+0000", 2024-02-10T08:41:36.814 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:41:36.814 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.814 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.814 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:41:36.815 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:11.337466+0000", 2024-02-10T08:41:36.815 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999981 2024-02-10T08:41:36.815 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.815 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.815 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:41:36.815 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:11.337464+0000", 2024-02-10T08:41:36.815 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8680000000000001e-06 2024-02-10T08:41:36.815 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.815 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.815 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:41:36.815 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:11.337471+0000", 2024-02-10T08:41:36.815 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0299999999999994e-06 2024-02-10T08:41:36.815 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.815 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.816 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:41:36.816 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:11.337479+0000", 2024-02-10T08:41:36.816 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5759999999999996e-06 2024-02-10T08:41:36.816 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.816 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.816 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:41:36.816 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:11.337484+0000", 2024-02-10T08:41:36.816 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4608000000000001e-05 2024-02-10T08:41:36.816 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.816 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.816 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:41:36.816 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:11.337559+0000", 2024-02-10T08:41:36.816 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.884e-06 2024-02-10T08:41:36.816 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.816 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.817 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-02-10T08:41:36.817 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:11.337568+0000", 2024-02-10T08:41:36.817 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00096650100000000004 2024-02-10T08:41:36.817 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.817 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.817 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:41:36.817 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:11.338534+0000", 2024-02-10T08:41:36.817 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9613999999999999e-05 2024-02-10T08:41:36.817 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.817 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.817 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:41:36.817 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:11.338634+0000", 2024-02-10T08:41:36.817 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00090115699999999998 2024-02-10T08:41:36.817 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.817 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.817 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:41:36.818 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:11.339535+0000", 2024-02-10T08:41:36.818 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020692039999999998 2024-02-10T08:41:36.818 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:41:36.818 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:41:36.818 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:41:36.818 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.818 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.818 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.24299.0:3312 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 94587203964288 gen 8] snapc 0=[] ondisk+write+known_if_redirected e465)", 2024-02-10T08:41:36.818 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:41:11.337497+0000", 2024-02-10T08:41:36.818 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 25.469654026000001, 2024-02-10T08:41:36.818 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0038826160000000002, 2024-02-10T08:41:36.818 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:41:36.818 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-02-10T08:41:36.818 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:41:36.818 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.24299", 2024-02-10T08:41:36.819 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/871408063", 2024-02-10T08:41:36.819 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3312 2024-02-10T08:41:36.819 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.819 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:41:36.819 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.819 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:41:36.819 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:11.337497+0000", 2024-02-10T08:41:36.819 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:41:36.819 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.819 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.819 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:41:36.819 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:11.337497+0000", 2024-02-10T08:41:36.819 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-02-10T08:41:36.819 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.819 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.819 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:41:36.820 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:11.337497+0000", 2024-02-10T08:41:36.820 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3440000000000001e-06 2024-02-10T08:41:36.820 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.820 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.820 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:41:36.820 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:11.337500+0000", 2024-02-10T08:41:36.820 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2675e-05 2024-02-10T08:41:36.820 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.820 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.820 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:41:36.820 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:11.337513+0000", 2024-02-10T08:41:36.820 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6670000000000004e-06 2024-02-10T08:41:36.820 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.820 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.821 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:41:36.821 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:11.337517+0000", 2024-02-10T08:41:36.821 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5167000000000003e-05 2024-02-10T08:41:36.821 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.821 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.821 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:41:36.821 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:11.337562+0000", 2024-02-10T08:41:36.821 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4560000000000002e-06 2024-02-10T08:41:36.821 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.821 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.821 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-02-10T08:41:36.821 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:11.337567+0000", 2024-02-10T08:41:36.821 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0021131380000000001 2024-02-10T08:41:36.821 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.821 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.821 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:41:36.821 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:11.339680+0000", 2024-02-10T08:41:36.822 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000119902 2024-02-10T08:41:36.822 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.822 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.822 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:41:36.822 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:11.339800+0000", 2024-02-10T08:41:36.822 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001579837 2024-02-10T08:41:36.822 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.822 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.822 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:41:36.822 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:11.341380+0000", 2024-02-10T08:41:36.822 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0038826160000000002 2024-02-10T08:41:36.822 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:41:36.822 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:41:36.822 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:41:36.822 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.822 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.823 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "pg_update_log_missing(5.1f epoch 465/463 rep_tid 235603 entries 465'14 (0'0) error 5:f95f44c2:::notify.0:head by client.24299.0:3313 0.000000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-02-10T08:41:36.823 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:41:11.341160+0000", 2024-02-10T08:41:36.823 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 25.465991362, 2024-02-10T08:41:36.823 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00033314199999999998, 2024-02-10T08:41:36.823 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:41:36.823 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-02-10T08:41:36.823 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:41:36.823 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.823 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:41:36.823 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:11.341160+0000", 2024-02-10T08:41:36.823 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:41:36.823 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.823 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.823 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:41:36.823 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:11.341160+0000", 2024-02-10T08:41:36.823 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-02-10T08:41:36.824 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.824 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.824 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:41:36.824 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:11.341159+0000", 2024-02-10T08:41:36.824 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.025e-05 2024-02-10T08:41:36.824 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.824 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.824 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:41:36.824 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:11.341169+0000", 2024-02-10T08:41:36.824 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7379999999999999e-05 2024-02-10T08:41:36.824 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.824 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.824 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:41:36.824 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:11.341197+0000", 2024-02-10T08:41:36.825 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7210000000000006e-06 2024-02-10T08:41:36.825 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.825 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.825 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:41:36.825 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:11.341206+0000", 2024-02-10T08:41:36.825 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5327999999999997e-05 2024-02-10T08:41:36.825 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.825 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.825 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:41:36.825 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:11.341252+0000", 2024-02-10T08:41:36.825 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00024120700000000001 2024-02-10T08:41:36.825 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.825 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.825 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:41:36.825 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:11.341493+0000", 2024-02-10T08:41:36.826 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00033314199999999998 2024-02-10T08:41:36.826 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:41:36.826 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:41:36.826 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:41:36.826 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.826 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.826 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDPGPushReply(2.f 467/466 [PushReplyOp(2:f43b6ece:::zone_names.default:head)])", 2024-02-10T08:41:36.826 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:41:14.159421+0000", 2024-02-10T08:41:36.826 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 22.647729962, 2024-02-10T08:41:36.826 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00028461900000000001, 2024-02-10T08:41:36.826 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:41:36.826 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-02-10T08:41:36.826 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:41:36.826 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.826 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:41:36.826 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:14.159421+0000", 2024-02-10T08:41:36.826 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:41:36.827 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.827 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.827 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:41:36.827 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:14.159421+0000", 2024-02-10T08:41:36.827 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-02-10T08:41:36.827 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.827 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.827 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:41:36.827 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:14.159420+0000", 2024-02-10T08:41:36.827 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4e-06 2024-02-10T08:41:36.827 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.827 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.827 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:41:36.827 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:14.159426+0000", 2024-02-10T08:41:36.828 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9450000000000005e-06 2024-02-10T08:41:36.828 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.828 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.828 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:41:36.828 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:14.159436+0000", 2024-02-10T08:41:36.828 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2619999999999998e-06 2024-02-10T08:41:36.828 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.828 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.828 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:41:36.828 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:14.159441+0000", 2024-02-10T08:41:36.828 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3770000000000003e-05 2024-02-10T08:41:36.828 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.828 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.828 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:41:36.829 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:14.159485+0000", 2024-02-10T08:41:36.829 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000221046 2024-02-10T08:41:36.829 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.829 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.829 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:41:36.829 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:14.159706+0000", 2024-02-10T08:41:36.829 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00028461900000000001 2024-02-10T08:41:36.829 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:41:36.829 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:41:36.829 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:41:36.829 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.829 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.829 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDPGPushReply(2.f 467/466 [PushReplyOp(2:f4c53578:::zonegroups_names.default:head)])", 2024-02-10T08:41:36.829 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:41:14.160498+0000", 2024-02-10T08:41:36.830 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 22.646653385, 2024-02-10T08:41:36.830 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00027829200000000003, 2024-02-10T08:41:36.830 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:41:36.830 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-02-10T08:41:36.830 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:41:36.830 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.830 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:41:36.830 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:14.160498+0000", 2024-02-10T08:41:36.830 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:41:36.830 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.830 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.830 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:41:36.830 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:14.160498+0000", 2024-02-10T08:41:36.830 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-02-10T08:41:36.830 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.830 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.831 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:41:36.831 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:14.160498+0000", 2024-02-10T08:41:36.831 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7599999999999998e-06 2024-02-10T08:41:36.831 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.831 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.831 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:41:36.831 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:14.160500+0000", 2024-02-10T08:41:36.831 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8700000000000002e-06 2024-02-10T08:41:36.831 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.831 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.831 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:41:36.831 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:14.160504+0000", 2024-02-10T08:41:36.831 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6200000000000001e-06 2024-02-10T08:41:36.831 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.831 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.831 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:41:36.831 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:14.160508+0000", 2024-02-10T08:41:36.832 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1909000000000001e-05 2024-02-10T08:41:36.832 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.832 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.832 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:41:36.832 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:14.160550+0000", 2024-02-10T08:41:36.832 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022640299999999999 2024-02-10T08:41:36.832 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.832 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.832 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:41:36.832 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:14.160776+0000", 2024-02-10T08:41:36.832 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00027829200000000003 2024-02-10T08:41:36.832 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:41:36.832 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:41:36.832 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:41:36.832 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.832 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.833 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.24299.0:3319 5.e 5:7759931f:::notify.3:head [watch ping cookie 94587203964288 gen 8] snapc 0=[] ondisk+write+known_if_redirected e465)", 2024-02-10T08:41:36.833 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:41:16.337277+0000", 2024-02-10T08:41:36.833 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 20.469874139000002, 2024-02-10T08:41:36.833 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00032250399999999999, 2024-02-10T08:41:36.833 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:41:36.833 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-02-10T08:41:36.833 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:41:36.833 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.24299", 2024-02-10T08:41:36.833 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/871408063", 2024-02-10T08:41:36.833 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3319 2024-02-10T08:41:36.833 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.833 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:41:36.833 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.833 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:41:36.833 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:16.337277+0000", 2024-02-10T08:41:36.833 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:41:36.834 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.834 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.834 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:41:36.834 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:16.337277+0000", 2024-02-10T08:41:36.834 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-02-10T08:41:36.834 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.834 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.834 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:41:36.834 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:16.337275+0000", 2024-02-10T08:41:36.834 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9e-06 2024-02-10T08:41:36.834 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.834 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.834 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:41:36.834 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:16.337282+0000", 2024-02-10T08:41:36.834 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5999999999999999e-05 2024-02-10T08:41:36.834 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.834 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.835 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:41:36.835 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:16.337298+0000", 2024-02-10T08:41:36.835 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1969999999999996e-06 2024-02-10T08:41:36.835 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.835 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.835 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:41:36.835 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:16.337307+0000", 2024-02-10T08:41:36.835 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6947999999999996e-05 2024-02-10T08:41:36.835 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.835 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.835 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:41:36.835 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:16.337383+0000", 2024-02-10T08:41:36.835 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000117872 2024-02-10T08:41:36.835 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.835 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.835 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:41:36.836 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:16.337501+0000", 2024-02-10T08:41:36.836 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8171999999999995e-05 2024-02-10T08:41:36.836 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.836 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.836 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:41:36.836 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:16.337600+0000", 2024-02-10T08:41:36.836 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00032250399999999999 2024-02-10T08:41:36.836 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:41:36.836 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:41:36.836 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:41:36.836 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.836 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.836 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "pg_update_log_missing(5.9 epoch 468/466 rep_tid 0 entries 468'14 (0'0) error 5:93e5b521:::notify.7:head by client.24299.0:3325 0.000000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-02-10T08:41:36.836 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:41:16.340883+0000", 2024-02-10T08:41:36.836 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 20.466268181, 2024-02-10T08:41:36.837 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00043785100000000001, 2024-02-10T08:41:36.837 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:41:36.837 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-02-10T08:41:36.837 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:41:36.837 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.837 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:41:36.837 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:16.340883+0000", 2024-02-10T08:41:36.837 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:41:36.837 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.837 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.837 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:41:36.837 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:16.340883+0000", 2024-02-10T08:41:36.837 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-02-10T08:41:36.837 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.837 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.837 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:41:36.837 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:16.340883+0000", 2024-02-10T08:41:36.838 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5849999999999996e-06 2024-02-10T08:41:36.838 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.838 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.838 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:41:36.838 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:16.340889+0000", 2024-02-10T08:41:36.838 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8476999999999999e-05 2024-02-10T08:41:36.838 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.838 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.838 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:41:36.838 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:16.340908+0000", 2024-02-10T08:41:36.838 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1687e-05 2024-02-10T08:41:36.838 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.838 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.838 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:41:36.838 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:16.340919+0000", 2024-02-10T08:41:36.838 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0277e-05 2024-02-10T08:41:36.839 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.839 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.839 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:41:36.839 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:16.340970+0000", 2024-02-10T08:41:36.839 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00035118299999999997 2024-02-10T08:41:36.839 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.839 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.839 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:41:36.839 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:16.341321+0000", 2024-02-10T08:41:36.839 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00043785100000000001 2024-02-10T08:41:36.839 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:41:36.839 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:41:36.839 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:41:36.839 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.839 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.839 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "pg_update_log_missing(5.1f epoch 468/466 rep_tid 235604 entries 468'15 (0'0) error 5:f95f44c2:::notify.0:head by client.24299.0:3326 0.000000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-02-10T08:41:36.840 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:41:16.341517+0000", 2024-02-10T08:41:36.840 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 20.465634142999999, 2024-02-10T08:41:36.840 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00030151599999999999, 2024-02-10T08:41:36.840 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:41:36.840 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-02-10T08:41:36.840 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:41:36.840 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.840 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:41:36.840 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:16.341517+0000", 2024-02-10T08:41:36.840 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:41:36.840 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.840 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.840 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:41:36.840 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:16.341517+0000", 2024-02-10T08:41:36.840 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967296 2024-02-10T08:41:36.841 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.841 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.841 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:41:36.841 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:16.341517+0000", 2024-02-10T08:41:36.841 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3060000000000003e-06 2024-02-10T08:41:36.841 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.841 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.841 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:41:36.841 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:16.341523+0000", 2024-02-10T08:41:36.841 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3040999999999999e-05 2024-02-10T08:41:36.841 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.841 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.841 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:41:36.841 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:16.341536+0000", 2024-02-10T08:41:36.841 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1168999999999999e-05 2024-02-10T08:41:36.841 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.841 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.842 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:41:36.842 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:16.341547+0000", 2024-02-10T08:41:36.842 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8769000000000005e-05 2024-02-10T08:41:36.842 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.842 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.842 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:41:36.842 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:16.341616+0000", 2024-02-10T08:41:36.842 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00020246899999999999 2024-02-10T08:41:36.842 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.842 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.842 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:41:36.842 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:16.341819+0000", 2024-02-10T08:41:36.842 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00030151599999999999 2024-02-10T08:41:36.842 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:41:36.842 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:41:36.842 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:41:36.843 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.843 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.843 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDScrubReserve(5.c REQUEST e469)", 2024-02-10T08:41:36.843 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:41:17.657110+0000", 2024-02-10T08:41:36.843 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 19.150041300000002, 2024-02-10T08:41:36.843 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001531101, 2024-02-10T08:41:36.843 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:41:36.843 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-02-10T08:41:36.843 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:41:36.843 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.843 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:41:36.843 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:17.657110+0000", 2024-02-10T08:41:36.843 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:41:36.843 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.843 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.844 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:41:36.844 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:17.657110+0000", 2024-02-10T08:41:36.844 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967296 2024-02-10T08:41:36.844 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.844 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.844 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:41:36.844 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:17.657110+0000", 2024-02-10T08:41:36.844 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.841e-06 2024-02-10T08:41:36.844 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.844 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.844 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:41:36.844 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:17.657113+0000", 2024-02-10T08:41:36.844 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7005000000000001e-05 2024-02-10T08:41:36.845 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.845 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.845 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:41:36.845 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:17.657130+0000", 2024-02-10T08:41:36.845 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9850000000000001e-06 2024-02-10T08:41:36.845 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.845 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.845 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:41:36.845 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:17.657140+0000", 2024-02-10T08:41:36.845 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2717999999999999e-05 2024-02-10T08:41:36.845 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.845 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.845 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:41:36.846 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:17.657192+0000", 2024-02-10T08:41:36.846 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2859999999999996e-06 2024-02-10T08:41:36.846 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.846 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.846 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-02-10T08:41:36.846 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:17.657199+0000", 2024-02-10T08:41:36.846 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00139306 2024-02-10T08:41:36.846 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.846 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.846 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:41:36.846 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:17.658592+0000", 2024-02-10T08:41:36.846 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6677e-05 2024-02-10T08:41:36.846 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.847 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.847 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:41:36.847 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:17.658608+0000", 2024-02-10T08:41:36.847 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2685999999999998e-05 2024-02-10T08:41:36.847 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.847 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.847 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:41:36.847 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:17.658641+0000", 2024-02-10T08:41:36.847 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001531101 2024-02-10T08:41:36.847 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:41:36.847 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:41:36.847 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:41:36.847 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.847 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.848 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "replica_scrub(pg: 5.11,from:0'0,to:0'0,epoch:469/466,start:5:88000000::::0,end:MAX,chunky:1,deep:0,version:9,allow_preemption:1,priority=5)", 2024-02-10T08:41:36.848 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:41:19.323806+0000", 2024-02-10T08:41:36.848 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 17.483345091, 2024-02-10T08:41:36.848 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0023560109999999999, 2024-02-10T08:41:36.848 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:41:36.848 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-02-10T08:41:36.848 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:41:36.848 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.848 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:41:36.848 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:19.323806+0000", 2024-02-10T08:41:36.848 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:41:36.848 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.848 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.848 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:41:36.849 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:19.323806+0000", 2024-02-10T08:41:36.849 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-02-10T08:41:36.849 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.849 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.849 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:41:36.849 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:19.323805+0000", 2024-02-10T08:41:36.849 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5019999999999998e-06 2024-02-10T08:41:36.849 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.849 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.849 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:41:36.849 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:19.323812+0000", 2024-02-10T08:41:36.849 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3016999999999999e-05 2024-02-10T08:41:36.849 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.850 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.850 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:41:36.850 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:19.323825+0000", 2024-02-10T08:41:36.850 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2579999999999998e-06 2024-02-10T08:41:36.850 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.850 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.850 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:41:36.850 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:19.323832+0000", 2024-02-10T08:41:36.850 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0023062489999999998 2024-02-10T08:41:36.850 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.850 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.850 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:41:36.850 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:19.326138+0000", 2024-02-10T08:41:36.851 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7780000000000004e-06 2024-02-10T08:41:36.851 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.851 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.851 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:41:36.851 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:19.326144+0000", 2024-02-10T08:41:36.851 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8009e-05 2024-02-10T08:41:36.851 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.851 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.851 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:41:36.851 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:19.326162+0000", 2024-02-10T08:41:36.851 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0023560109999999999 2024-02-10T08:41:36.851 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:41:36.851 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:41:36.851 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:41:36.851 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.851 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.851 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.24299.0:3331 5.e 5:7759931f:::notify.3:head [watch ping cookie 94587203964288 gen 8] snapc 0=[] ondisk+write+known_if_redirected e468)", 2024-02-10T08:41:36.852 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:41:21.338243+0000", 2024-02-10T08:41:36.852 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 15.468908608, 2024-02-10T08:41:36.852 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00033450899999999998, 2024-02-10T08:41:36.852 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:41:36.852 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-02-10T08:41:36.852 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:41:36.852 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.24299", 2024-02-10T08:41:36.852 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/871408063", 2024-02-10T08:41:36.852 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3331 2024-02-10T08:41:36.852 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.852 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:41:36.852 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.853 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:41:36.853 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:21.338243+0000", 2024-02-10T08:41:36.853 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:41:36.853 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.853 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.853 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:41:36.853 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:21.338243+0000", 2024-02-10T08:41:36.853 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999981 2024-02-10T08:41:36.853 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.853 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.853 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:41:36.853 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:21.338241+0000", 2024-02-10T08:41:36.853 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7299999999999994e-06 2024-02-10T08:41:36.853 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.853 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.853 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:41:36.854 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:21.338249+0000", 2024-02-10T08:41:36.854 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5577999999999999e-05 2024-02-10T08:41:36.854 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.854 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.854 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:41:36.854 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:21.338265+0000", 2024-02-10T08:41:36.854 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.613e-06 2024-02-10T08:41:36.854 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.854 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.854 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:41:36.854 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:21.338272+0000", 2024-02-10T08:41:36.854 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3628999999999994e-05 2024-02-10T08:41:36.854 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.854 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.854 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:41:36.854 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:21.338365+0000", 2024-02-10T08:41:36.855 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9772999999999995e-05 2024-02-10T08:41:36.855 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.855 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.855 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:41:36.855 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:21.338465+0000", 2024-02-10T08:41:36.855 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011213300000000001 2024-02-10T08:41:36.855 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.855 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.855 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:41:36.855 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:21.338577+0000", 2024-02-10T08:41:36.855 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00033450899999999998 2024-02-10T08:41:36.855 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:41:36.855 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:41:36.855 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:41:36.855 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.856 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.856 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDScrubReserve(4.2 REQUEST e471)", 2024-02-10T08:41:36.856 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:41:24.679328+0000", 2024-02-10T08:41:36.856 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 12.127823294000001, 2024-02-10T08:41:36.856 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019215399999999999, 2024-02-10T08:41:36.856 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:41:36.856 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-02-10T08:41:36.856 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:41:36.856 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.856 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:41:36.856 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:24.679328+0000", 2024-02-10T08:41:36.856 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:41:36.856 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.856 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.857 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:41:36.857 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:24.679328+0000", 2024-02-10T08:41:36.857 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999976 2024-02-10T08:41:36.857 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.857 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.857 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:41:36.857 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:24.679325+0000", 2024-02-10T08:41:36.857 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5636000000000001e-05 2024-02-10T08:41:36.857 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.857 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.857 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:41:36.857 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:24.679341+0000", 2024-02-10T08:41:36.857 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9799999999999999e-05 2024-02-10T08:41:36.857 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.857 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.857 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:41:36.858 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:24.679371+0000", 2024-02-10T08:41:36.858 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5126000000000001e-05 2024-02-10T08:41:36.858 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.858 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.858 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:41:36.858 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:24.679386+0000", 2024-02-10T08:41:36.858 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8456999999999998e-05 2024-02-10T08:41:36.858 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.858 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.858 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:41:36.858 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:24.679464+0000", 2024-02-10T08:41:36.858 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3830999999999999e-05 2024-02-10T08:41:36.858 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.858 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.858 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:41:36.858 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:24.679488+0000", 2024-02-10T08:41:36.859 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1906999999999998e-05 2024-02-10T08:41:36.859 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.859 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.859 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:41:36.859 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:24.679520+0000", 2024-02-10T08:41:36.859 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019215399999999999 2024-02-10T08:41:36.859 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:41:36.859 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:41:36.859 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:41:36.859 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.859 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.859 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDScrubReserve(4.2 RELEASE e471)", 2024-02-10T08:41:36.859 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:41:24.683637+0000", 2024-02-10T08:41:36.859 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 12.123513998, 2024-02-10T08:41:36.859 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00024781, 2024-02-10T08:41:36.860 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:41:36.860 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-02-10T08:41:36.860 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:41:36.860 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.860 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:41:36.860 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:24.683637+0000", 2024-02-10T08:41:36.860 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:41:36.860 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.860 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.860 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:41:36.860 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:24.683637+0000", 2024-02-10T08:41:36.860 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999981 2024-02-10T08:41:36.860 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.860 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.860 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:41:36.861 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:24.683635+0000", 2024-02-10T08:41:36.861 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1167e-05 2024-02-10T08:41:36.861 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.861 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.861 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:41:36.861 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:24.683646+0000", 2024-02-10T08:41:36.861 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2022999999999999e-05 2024-02-10T08:41:36.861 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.861 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.861 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:41:36.861 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:24.683668+0000", 2024-02-10T08:41:36.861 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.11e-05 2024-02-10T08:41:36.861 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.861 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.861 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:41:36.861 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:24.683680+0000", 2024-02-10T08:41:36.862 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3871999999999998e-05 2024-02-10T08:41:36.862 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.862 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.862 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:41:36.862 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:24.683773+0000", 2024-02-10T08:41:36.862 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2095999999999998e-05 2024-02-10T08:41:36.862 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.862 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.862 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:41:36.862 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:24.683816+0000", 2024-02-10T08:41:36.862 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9422e-05 2024-02-10T08:41:36.862 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.862 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.862 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:41:36.862 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:24.683885+0000", 2024-02-10T08:41:36.862 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00024781 2024-02-10T08:41:36.863 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:41:36.863 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:41:36.863 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:41:36.863 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.863 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.863 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDScrubReserve(5.1c GRANT e472)", 2024-02-10T08:41:36.863 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:41:26.220099+0000", 2024-02-10T08:41:36.863 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 10.587051996, 2024-02-10T08:41:36.863 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000192258, 2024-02-10T08:41:36.863 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:41:36.863 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-02-10T08:41:36.863 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:41:36.863 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.863 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:41:36.863 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:26.220099+0000", 2024-02-10T08:41:36.863 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:41:36.864 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.864 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.864 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:41:36.864 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:26.220099+0000", 2024-02-10T08:41:36.864 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999981 2024-02-10T08:41:36.864 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.864 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.864 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:41:36.864 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:26.220097+0000", 2024-02-10T08:41:36.864 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1156e-05 2024-02-10T08:41:36.864 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.864 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.864 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:41:36.864 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:26.220108+0000", 2024-02-10T08:41:36.864 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.213e-05 2024-02-10T08:41:36.865 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.865 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.865 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:41:36.865 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:26.220131+0000", 2024-02-10T08:41:36.865 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1039999999999999e-05 2024-02-10T08:41:36.865 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.865 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.865 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:41:36.865 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:26.220142+0000", 2024-02-10T08:41:36.865 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000105315 2024-02-10T08:41:36.865 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.865 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.865 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:41:36.865 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:26.220247+0000", 2024-02-10T08:41:36.865 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3821e-05 2024-02-10T08:41:36.865 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.866 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.866 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:41:36.866 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:26.220281+0000", 2024-02-10T08:41:36.866 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5880000000000001e-06 2024-02-10T08:41:36.866 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.866 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.866 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:41:36.866 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:26.220282+0000", 2024-02-10T08:41:36.866 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0240000000000003e-06 2024-02-10T08:41:36.866 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.866 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.866 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:41:36.866 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:26.220291+0000", 2024-02-10T08:41:36.866 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000192258 2024-02-10T08:41:36.866 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:41:36.866 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:41:36.866 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:41:36.867 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.867 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.867 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.24299.0:3340 5.e 5:7759931f:::notify.3:head [watch ping cookie 94587203964288 gen 8] snapc 0=[] ondisk+write+known_if_redirected e470)", 2024-02-10T08:41:36.867 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:41:26.339270+0000", 2024-02-10T08:41:36.867 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 10.467881022, 2024-02-10T08:41:36.867 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000317244, 2024-02-10T08:41:36.867 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:41:36.867 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-02-10T08:41:36.867 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:41:36.867 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.24299", 2024-02-10T08:41:36.867 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/871408063", 2024-02-10T08:41:36.867 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3340 2024-02-10T08:41:36.867 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.867 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:41:36.867 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.868 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:41:36.868 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:26.339270+0000", 2024-02-10T08:41:36.868 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:41:36.868 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.868 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.868 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:41:36.868 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:26.339270+0000", 2024-02-10T08:41:36.868 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999981 2024-02-10T08:41:36.868 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.868 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.868 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:41:36.868 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:26.339268+0000", 2024-02-10T08:41:36.868 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3810000000000005e-06 2024-02-10T08:41:36.868 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.869 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.869 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:41:36.869 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:26.339278+0000", 2024-02-10T08:41:36.869 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5078e-05 2024-02-10T08:41:36.869 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.869 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.869 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:41:36.869 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:26.339293+0000", 2024-02-10T08:41:36.869 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8669999999999996e-06 2024-02-10T08:41:36.869 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.869 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.869 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:41:36.869 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:26.339299+0000", 2024-02-10T08:41:36.869 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6039999999999997e-05 2024-02-10T08:41:36.869 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.869 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.870 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:41:36.870 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:26.339376+0000", 2024-02-10T08:41:36.870 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8043999999999998e-05 2024-02-10T08:41:36.870 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.870 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.870 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:41:36.870 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:26.339474+0000", 2024-02-10T08:41:36.870 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000113794 2024-02-10T08:41:36.870 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.870 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.870 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:41:36.870 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:26.339587+0000", 2024-02-10T08:41:36.870 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000317244 2024-02-10T08:41:36.871 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:41:36.871 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:41:36.871 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:41:36.871 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.871 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.871 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.24299.0:3349 5.e 5:7759931f:::notify.3:head [watch ping cookie 94587203964288 gen 8] snapc 0=[] ondisk+write+known_if_redirected e472)", 2024-02-10T08:41:36.871 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:41:31.340310+0000", 2024-02-10T08:41:36.871 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.4668409120000003, 2024-02-10T08:41:36.871 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00032329100000000002, 2024-02-10T08:41:36.871 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:41:36.871 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-02-10T08:41:36.871 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:41:36.871 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.24299", 2024-02-10T08:41:36.871 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/871408063", 2024-02-10T08:41:36.871 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3349 2024-02-10T08:41:36.872 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.872 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:41:36.872 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.872 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:41:36.872 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:31.340310+0000", 2024-02-10T08:41:36.872 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:41:36.872 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.872 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.872 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:41:36.872 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:31.340310+0000", 2024-02-10T08:41:36.872 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999943 2024-02-10T08:41:36.872 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.872 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.872 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:41:36.873 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:31.340305+0000", 2024-02-10T08:41:36.873 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8315999999999999e-05 2024-02-10T08:41:36.873 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.873 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.873 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:41:36.873 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:31.340323+0000", 2024-02-10T08:41:36.873 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9836000000000001e-05 2024-02-10T08:41:36.873 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.873 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.873 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:41:36.873 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:31.340343+0000", 2024-02-10T08:41:36.873 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9310000000000003e-06 2024-02-10T08:41:36.873 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.873 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.873 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:41:36.874 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:31.340353+0000", 2024-02-10T08:41:36.874 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3838000000000005e-05 2024-02-10T08:41:36.874 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.874 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.874 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:41:36.874 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:31.340447+0000", 2024-02-10T08:41:36.874 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9239000000000004e-05 2024-02-10T08:41:36.874 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.874 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.874 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:41:36.874 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:31.340536+0000", 2024-02-10T08:41:36.874 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7768000000000003e-05 2024-02-10T08:41:36.874 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.874 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.875 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:41:36.875 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:31.340634+0000", 2024-02-10T08:41:36.875 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00032329100000000002 2024-02-10T08:41:36.875 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:41:36.875 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:41:36.875 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:41:36.875 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.875 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.875 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDScrubReserve(5.1d REQUEST e474)", 2024-02-10T08:41:36.875 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:41:31.714571+0000", 2024-02-10T08:41:36.875 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.0925803890000001, 2024-02-10T08:41:36.875 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00020801399999999999, 2024-02-10T08:41:36.875 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:41:36.876 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-02-10T08:41:36.876 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:41:36.876 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.876 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:41:36.876 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:31.714571+0000", 2024-02-10T08:41:36.876 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:41:36.876 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.876 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.876 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:41:36.876 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:31.714571+0000", 2024-02-10T08:41:36.876 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-02-10T08:41:36.876 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.876 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.877 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:41:36.877 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:31.714570+0000", 2024-02-10T08:41:36.877 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2299999999999999e-06 2024-02-10T08:41:36.877 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.877 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.877 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:41:36.877 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:31.714576+0000", 2024-02-10T08:41:36.877 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5925999999999999e-05 2024-02-10T08:41:36.877 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.877 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.877 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:41:36.877 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:31.714602+0000", 2024-02-10T08:41:36.877 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5645999999999999e-05 2024-02-10T08:41:36.877 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.878 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.878 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:41:36.878 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:31.714617+0000", 2024-02-10T08:41:36.878 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0045999999999998e-05 2024-02-10T08:41:36.878 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.878 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.878 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:41:36.878 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:31.714707+0000", 2024-02-10T08:41:36.878 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7268999999999999e-05 2024-02-10T08:41:36.878 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.878 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.878 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:41:36.878 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:31.714734+0000", 2024-02-10T08:41:36.878 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4299999999999999e-05 2024-02-10T08:41:36.879 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.879 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.879 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:41:36.879 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:31.714779+0000", 2024-02-10T08:41:36.879 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00020801399999999999 2024-02-10T08:41:36.879 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:41:36.879 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:41:36.879 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:41:36.879 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.879 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.879 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDScrubReserve(5.5 REQUEST e475)", 2024-02-10T08:41:36.879 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:41:35.636175+0000", 2024-02-10T08:41:36.879 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 1.170976314, 2024-02-10T08:41:36.879 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017711800000000001, 2024-02-10T08:41:36.880 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:41:36.880 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-02-10T08:41:36.880 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:41:36.880 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.880 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:41:36.880 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:35.636175+0000", 2024-02-10T08:41:36.880 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:41:36.880 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.880 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.880 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:41:36.880 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:35.636175+0000", 2024-02-10T08:41:36.880 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999981 2024-02-10T08:41:36.880 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.881 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.881 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:41:36.881 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:35.636173+0000", 2024-02-10T08:41:36.881 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5182000000000003e-05 2024-02-10T08:41:36.881 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.881 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.881 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:41:36.881 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:35.636208+0000", 2024-02-10T08:41:36.881 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.402e-05 2024-02-10T08:41:36.881 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.881 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.881 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:41:36.881 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:35.636232+0000", 2024-02-10T08:41:36.881 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7940000000000001e-05 2024-02-10T08:41:36.881 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.882 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.882 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:41:36.882 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:35.636250+0000", 2024-02-10T08:41:36.882 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1981000000000002e-05 2024-02-10T08:41:36.882 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.882 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.882 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:41:36.882 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:35.636312+0000", 2024-02-10T08:41:36.882 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8474999999999998e-05 2024-02-10T08:41:36.882 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.882 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.882 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:41:36.882 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:35.636330+0000", 2024-02-10T08:41:36.882 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.156e-05 2024-02-10T08:41:36.882 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.883 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.883 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:41:36.883 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:35.636352+0000", 2024-02-10T08:41:36.883 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017711800000000001 2024-02-10T08:41:36.883 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:41:36.883 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:41:36.883 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:41:36.883 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.883 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.883 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.24299.0:3358 5.e 5:7759931f:::notify.3:head [watch ping cookie 94587203964288 gen 8] snapc 0=[] ondisk+write+known_if_redirected e474)", 2024-02-10T08:41:36.883 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-02-10T08:41:36.341261+0000", 2024-02-10T08:41:36.883 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.46588994500000003, 2024-02-10T08:41:36.883 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00039305699999999999, 2024-02-10T08:41:36.883 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-02-10T08:41:36.883 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-02-10T08:41:36.883 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-02-10T08:41:36.884 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.24299", 2024-02-10T08:41:36.884 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.18:0/871408063", 2024-02-10T08:41:36.884 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3358 2024-02-10T08:41:36.884 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.884 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-02-10T08:41:36.884 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.884 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-02-10T08:41:36.884 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:36.341261+0000", 2024-02-10T08:41:36.884 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-02-10T08:41:36.884 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.884 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.884 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-02-10T08:41:36.884 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:36.341261+0000", 2024-02-10T08:41:36.884 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999943 2024-02-10T08:41:36.885 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.885 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.885 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-02-10T08:41:36.885 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:36.341255+0000", 2024-02-10T08:41:36.885 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5520999999999999e-05 2024-02-10T08:41:36.885 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.885 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.885 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-02-10T08:41:36.885 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:36.341271+0000", 2024-02-10T08:41:36.885 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0925e-05 2024-02-10T08:41:36.885 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.885 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.885 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-02-10T08:41:36.885 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:36.341292+0000", 2024-02-10T08:41:36.885 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5860000000000005e-06 2024-02-10T08:41:36.885 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.886 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.886 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-02-10T08:41:36.886 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:36.341300+0000", 2024-02-10T08:41:36.886 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013352000000000001 2024-02-10T08:41:36.886 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.886 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.886 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-02-10T08:41:36.886 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:36.341434+0000", 2024-02-10T08:41:36.886 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000112106 2024-02-10T08:41:36.886 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.886 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.886 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-02-10T08:41:36.886 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:36.341546+0000", 2024-02-10T08:41:36.886 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000108182 2024-02-10T08:41:36.886 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-02-10T08:41:36.886 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-02-10T08:41:36.887 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-02-10T08:41:36.887 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-02-10T08:41:36.341654+0000", 2024-02-10T08:41:36.887 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00039305699999999999 2024-02-10T08:41:36.887 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:41:36.887 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:41:36.887 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:41:36.887 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-02-10T08:41:36.887 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-02-10T08:41:36.887 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-02-10T08:41:36.887 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:35.215927+0000 osd.2 (osd.2) 291 : cluster [DBG] 5.6 scrub starts 2024-02-10T08:41:36.888 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:35.216802+0000 osd.2 (osd.2) 292 : cluster [DBG] 5.6 scrub ok 2024-02-10T08:41:36.888 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:35.231141+0000 mgr.y (mgr.14505) 927 : cluster [DBG] pgmap v1143: 162 pgs: 162 active+clean; 5.7 KiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:41:36.888 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:35.431369+0000 osd.6 (osd.6) 311 : cluster [DBG] 2.14 scrub starts 2024-02-10T08:41:36.888 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:35.434251+0000 osd.6 (osd.6) 312 : cluster [DBG] 2.14 scrub ok 2024-02-10T08:41:36.888 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:35.636470+0000 osd.0 (osd.0) 304 : cluster [DBG] 5.5 scrub starts 2024-02-10T08:41:36.888 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:35.637308+0000 osd.0 (osd.0) 305 : cluster [DBG] 5.5 scrub ok 2024-02-10T08:41:36.888 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:36.108666+0000 mon.a (mon.0) 1925 : cluster [DBG] osdmap e476: 8 total, 8 up, 8 in 2024-02-10T08:41:37.404 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:41:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:41:37] "GET /metrics HTTP/1.1" 200 174025 "" "Prometheus/2.33.4" 2024-02-10T08:41:37.574 INFO:teuthology.orchestra.run.smithi018.stderr:reweighted osd.1 to 1 (10000) 2024-02-10T08:41:37.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:36.766663+0000 osd.1 (osd.1) 343 : cluster [DBG] 6.1d scrub starts 2024-02-10T08:41:37.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:36.818879+0000 osd.1 (osd.1) 344 : cluster [DBG] 6.1d scrub ok 2024-02-10T08:41:37.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:41:36.879814+0000 mon.a (mon.0) 1926 : audit [INF] from='client.? 172.21.15.18:0/289286661' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]: dispatch 2024-02-10T08:41:37.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:36.766663+0000 osd.1 (osd.1) 343 : cluster [DBG] 6.1d scrub starts 2024-02-10T08:41:37.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:36.818879+0000 osd.1 (osd.1) 344 : cluster [DBG] 6.1d scrub ok 2024-02-10T08:41:37.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:41:36.879814+0000 mon.a (mon.0) 1926 : audit [INF] from='client.? 172.21.15.18:0/289286661' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]: dispatch 2024-02-10T08:41:37.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:36.766663+0000 osd.1 (osd.1) 343 : cluster [DBG] 6.1d scrub starts 2024-02-10T08:41:37.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:36.818879+0000 osd.1 (osd.1) 344 : cluster [DBG] 6.1d scrub ok 2024-02-10T08:41:37.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:41:36.879814+0000 mon.a (mon.0) 1926 : audit [INF] from='client.? 172.21.15.18:0/289286661' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]: dispatch 2024-02-10T08:41:38.466 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd primary-affinity 1 1 2024-02-10T08:41:38.755 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:41:38.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:37.038598+0000 osd.5 (osd.5) 316 : cluster [DBG] 4.8 scrub starts 2024-02-10T08:41:38.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:37.042085+0000 osd.5 (osd.5) 317 : cluster [DBG] 4.8 scrub ok 2024-02-10T08:41:38.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:37.231807+0000 mgr.y (mgr.14505) 928 : cluster [DBG] pgmap v1145: 162 pgs: 162 active+clean; 5.7 KiB data, 6.7 GiB used, 709 GiB / 715 GiB avail; 835 B/s rd, 0 op/s 2024-02-10T08:41:38.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:41:37.568352+0000 mon.a (mon.0) 1927 : audit [INF] from='client.? 172.21.15.18:0/289286661' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2024-02-10T08:41:38.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:37.568445+0000 mon.a (mon.0) 1928 : cluster [DBG] osdmap e477: 8 total, 8 up, 8 in 2024-02-10T08:41:38.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:37.757360+0000 osd.1 (osd.1) 345 : cluster [DBG] 5.0 scrub starts 2024-02-10T08:41:38.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:37.761214+0000 osd.1 (osd.1) 346 : cluster [DBG] 5.0 scrub ok 2024-02-10T08:41:38.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:38.100976+0000 osd.4 (osd.4) 29 : cluster [DBG] 6.6 scrub starts 2024-02-10T08:41:38.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:38.102770+0000 osd.4 (osd.4) 30 : cluster [DBG] 6.6 scrub ok 2024-02-10T08:41:38.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:37.038598+0000 osd.5 (osd.5) 316 : cluster [DBG] 4.8 scrub starts 2024-02-10T08:41:38.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:37.042085+0000 osd.5 (osd.5) 317 : cluster [DBG] 4.8 scrub ok 2024-02-10T08:41:38.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:37.231807+0000 mgr.y (mgr.14505) 928 : cluster [DBG] pgmap v1145: 162 pgs: 162 active+clean; 5.7 KiB data, 6.7 GiB used, 709 GiB / 715 GiB avail; 835 B/s rd, 0 op/s 2024-02-10T08:41:38.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:41:37.568352+0000 mon.a (mon.0) 1927 : audit [INF] from='client.? 172.21.15.18:0/289286661' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2024-02-10T08:41:38.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:37.568445+0000 mon.a (mon.0) 1928 : cluster [DBG] osdmap e477: 8 total, 8 up, 8 in 2024-02-10T08:41:38.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:37.757360+0000 osd.1 (osd.1) 345 : cluster [DBG] 5.0 scrub starts 2024-02-10T08:41:38.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:37.761214+0000 osd.1 (osd.1) 346 : cluster [DBG] 5.0 scrub ok 2024-02-10T08:41:38.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:38.100976+0000 osd.4 (osd.4) 29 : cluster [DBG] 6.6 scrub starts 2024-02-10T08:41:38.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:38.102770+0000 osd.4 (osd.4) 30 : cluster [DBG] 6.6 scrub ok 2024-02-10T08:41:39.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:37.038598+0000 osd.5 (osd.5) 316 : cluster [DBG] 4.8 scrub starts 2024-02-10T08:41:39.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:37.042085+0000 osd.5 (osd.5) 317 : cluster [DBG] 4.8 scrub ok 2024-02-10T08:41:39.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:37.231807+0000 mgr.y (mgr.14505) 928 : cluster [DBG] pgmap v1145: 162 pgs: 162 active+clean; 5.7 KiB data, 6.7 GiB used, 709 GiB / 715 GiB avail; 835 B/s rd, 0 op/s 2024-02-10T08:41:39.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:41:37.568352+0000 mon.a (mon.0) 1927 : audit [INF] from='client.? 172.21.15.18:0/289286661' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2024-02-10T08:41:39.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:37.568445+0000 mon.a (mon.0) 1928 : cluster [DBG] osdmap e477: 8 total, 8 up, 8 in 2024-02-10T08:41:39.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:37.757360+0000 osd.1 (osd.1) 345 : cluster [DBG] 5.0 scrub starts 2024-02-10T08:41:39.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:37.761214+0000 osd.1 (osd.1) 346 : cluster [DBG] 5.0 scrub ok 2024-02-10T08:41:39.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:38.100976+0000 osd.4 (osd.4) 29 : cluster [DBG] 6.6 scrub starts 2024-02-10T08:41:39.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:38.102770+0000 osd.4 (osd.4) 30 : cluster [DBG] 6.6 scrub ok 2024-02-10T08:41:39.539 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:41:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:41:39.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:38.246012+0000 osd.2 (osd.2) 293 : cluster [DBG] 4.19 scrub starts 2024-02-10T08:41:39.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:38.248091+0000 osd.2 (osd.2) 294 : cluster [DBG] 4.19 scrub ok 2024-02-10T08:41:39.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:38.748717+0000 osd.1 (osd.1) 347 : cluster [DBG] 2.d deep-scrub starts 2024-02-10T08:41:39.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:38.751939+0000 osd.1 (osd.1) 348 : cluster [DBG] 2.d deep-scrub ok 2024-02-10T08:41:39.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:38.246012+0000 osd.2 (osd.2) 293 : cluster [DBG] 4.19 scrub starts 2024-02-10T08:41:39.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:38.248091+0000 osd.2 (osd.2) 294 : cluster [DBG] 4.19 scrub ok 2024-02-10T08:41:39.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:38.748717+0000 osd.1 (osd.1) 347 : cluster [DBG] 2.d deep-scrub starts 2024-02-10T08:41:39.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:38.751939+0000 osd.1 (osd.1) 348 : cluster [DBG] 2.d deep-scrub ok 2024-02-10T08:41:40.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:38.246012+0000 osd.2 (osd.2) 293 : cluster [DBG] 4.19 scrub starts 2024-02-10T08:41:40.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:38.248091+0000 osd.2 (osd.2) 294 : cluster [DBG] 4.19 scrub ok 2024-02-10T08:41:40.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:38.748717+0000 osd.1 (osd.1) 347 : cluster [DBG] 2.d deep-scrub starts 2024-02-10T08:41:40.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:38.751939+0000 osd.1 (osd.1) 348 : cluster [DBG] 2.d deep-scrub ok 2024-02-10T08:41:40.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:39.034235+0000 osd.5 (osd.5) 318 : cluster [DBG] 5.7 scrub starts 2024-02-10T08:41:40.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:39.037116+0000 osd.5 (osd.5) 319 : cluster [DBG] 5.7 scrub ok 2024-02-10T08:41:40.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:41:39.109701+0000 mgr.y (mgr.14505) 929 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:41:40.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:39.232541+0000 mgr.y (mgr.14505) 930 : cluster [DBG] pgmap v1147: 162 pgs: 162 active+clean; 5.7 KiB data, 6.7 GiB used, 709 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:41:40.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:39.034235+0000 osd.5 (osd.5) 318 : cluster [DBG] 5.7 scrub starts 2024-02-10T08:41:40.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:39.037116+0000 osd.5 (osd.5) 319 : cluster [DBG] 5.7 scrub ok 2024-02-10T08:41:40.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:41:39.109701+0000 mgr.y (mgr.14505) 929 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:41:40.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:39.232541+0000 mgr.y (mgr.14505) 930 : cluster [DBG] pgmap v1147: 162 pgs: 162 active+clean; 5.7 KiB data, 6.7 GiB used, 709 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:41:41.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:39.034235+0000 osd.5 (osd.5) 318 : cluster [DBG] 5.7 scrub starts 2024-02-10T08:41:41.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:39.037116+0000 osd.5 (osd.5) 319 : cluster [DBG] 5.7 scrub ok 2024-02-10T08:41:41.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:41:39.109701+0000 mgr.y (mgr.14505) 929 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:41:41.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:39.232541+0000 mgr.y (mgr.14505) 930 : cluster [DBG] pgmap v1147: 162 pgs: 162 active+clean; 5.7 KiB data, 6.7 GiB used, 709 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:41:41.115 INFO:teuthology.orchestra.run.smithi018.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-02-10T08:41:41.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:40.070566+0000 osd.5 (osd.5) 320 : cluster [DBG] 2.16 scrub starts 2024-02-10T08:41:41.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:40.073521+0000 osd.5 (osd.5) 321 : cluster [DBG] 2.16 scrub ok 2024-02-10T08:41:41.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:40.266645+0000 osd.2 (osd.2) 295 : cluster [DBG] 4.f scrub starts 2024-02-10T08:41:41.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:40.268689+0000 osd.2 (osd.2) 296 : cluster [DBG] 4.f scrub ok 2024-02-10T08:41:41.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:40.671138+0000 osd.0 (osd.0) 306 : cluster [DBG] 6.0 scrub starts 2024-02-10T08:41:41.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:40.674096+0000 osd.0 (osd.0) 307 : cluster [DBG] 6.0 scrub ok 2024-02-10T08:41:41.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:40.717924+0000 osd.1 (osd.1) 349 : cluster [DBG] 4.10 scrub starts 2024-02-10T08:41:41.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:40.721392+0000 osd.1 (osd.1) 350 : cluster [DBG] 4.10 scrub ok 2024-02-10T08:41:41.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:41:40.839456+0000 mon.c (mon.2) 114 : audit [INF] from='client.? 172.21.15.18:0/3268625115' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 1, "weight": 1.0}]: dispatch 2024-02-10T08:41:41.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:41:40.839753+0000 mon.a (mon.0) 1929 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 1, "weight": 1.0}]: dispatch 2024-02-10T08:41:41.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:41:41.110418+0000 mon.a (mon.0) 1930 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 1, "weight": 1.0}]': finished 2024-02-10T08:41:41.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:41.110557+0000 mon.a (mon.0) 1931 : cluster [DBG] osdmap e478: 8 total, 8 up, 8 in 2024-02-10T08:41:41.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:40.070566+0000 osd.5 (osd.5) 320 : cluster [DBG] 2.16 scrub starts 2024-02-10T08:41:41.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:40.073521+0000 osd.5 (osd.5) 321 : cluster [DBG] 2.16 scrub ok 2024-02-10T08:41:41.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:40.266645+0000 osd.2 (osd.2) 295 : cluster [DBG] 4.f scrub starts 2024-02-10T08:41:41.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:40.268689+0000 osd.2 (osd.2) 296 : cluster [DBG] 4.f scrub ok 2024-02-10T08:41:41.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:40.671138+0000 osd.0 (osd.0) 306 : cluster [DBG] 6.0 scrub starts 2024-02-10T08:41:41.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:40.674096+0000 osd.0 (osd.0) 307 : cluster [DBG] 6.0 scrub ok 2024-02-10T08:41:41.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:40.717924+0000 osd.1 (osd.1) 349 : cluster [DBG] 4.10 scrub starts 2024-02-10T08:41:41.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:40.721392+0000 osd.1 (osd.1) 350 : cluster [DBG] 4.10 scrub ok 2024-02-10T08:41:41.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:41:40.839456+0000 mon.c (mon.2) 114 : audit [INF] from='client.? 172.21.15.18:0/3268625115' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 1, "weight": 1.0}]: dispatch 2024-02-10T08:41:41.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:41:40.839753+0000 mon.a (mon.0) 1929 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 1, "weight": 1.0}]: dispatch 2024-02-10T08:41:41.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:41:41.110418+0000 mon.a (mon.0) 1930 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 1, "weight": 1.0}]': finished 2024-02-10T08:41:41.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:41.110557+0000 mon.a (mon.0) 1931 : cluster [DBG] osdmap e478: 8 total, 8 up, 8 in 2024-02-10T08:41:42.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:41 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:40.070566+0000 osd.5 (osd.5) 320 : cluster [DBG] 2.16 scrub starts 2024-02-10T08:41:42.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:41 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:40.073521+0000 osd.5 (osd.5) 321 : cluster [DBG] 2.16 scrub ok 2024-02-10T08:41:42.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:41 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:40.266645+0000 osd.2 (osd.2) 295 : cluster [DBG] 4.f scrub starts 2024-02-10T08:41:42.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:41 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:40.268689+0000 osd.2 (osd.2) 296 : cluster [DBG] 4.f scrub ok 2024-02-10T08:41:42.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:41 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:40.671138+0000 osd.0 (osd.0) 306 : cluster [DBG] 6.0 scrub starts 2024-02-10T08:41:42.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:41 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:40.674096+0000 osd.0 (osd.0) 307 : cluster [DBG] 6.0 scrub ok 2024-02-10T08:41:42.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:41 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:40.717924+0000 osd.1 (osd.1) 349 : cluster [DBG] 4.10 scrub starts 2024-02-10T08:41:42.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:41 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:40.721392+0000 osd.1 (osd.1) 350 : cluster [DBG] 4.10 scrub ok 2024-02-10T08:41:42.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:41 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:41:40.839456+0000 mon.c (mon.2) 114 : audit [INF] from='client.? 172.21.15.18:0/3268625115' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 1, "weight": 1.0}]: dispatch 2024-02-10T08:41:42.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:41 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:41:40.839753+0000 mon.a (mon.0) 1929 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 1, "weight": 1.0}]: dispatch 2024-02-10T08:41:42.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:41 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:41:41.110418+0000 mon.a (mon.0) 1930 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 1, "weight": 1.0}]': finished 2024-02-10T08:41:42.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:41 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:41.110557+0000 mon.a (mon.0) 1931 : cluster [DBG] osdmap e478: 8 total, 8 up, 8 in 2024-02-10T08:41:42.047 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd reweight 2 1 2024-02-10T08:41:42.336 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:41:42.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:41.232884+0000 mgr.y (mgr.14505) 931 : cluster [DBG] pgmap v1149: 162 pgs: 162 active+clean; 5.7 KiB data, 6.7 GiB used, 709 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:41:42.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:42.064977+0000 osd.3 (osd.3) 121 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:41:42.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:42.065076+0000 osd.3 (osd.3) 122 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:41:42.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:42.297030+0000 osd.7 (osd.7) 23 : cluster [DBG] 6.1b scrub starts 2024-02-10T08:41:42.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:42.382358+0000 osd.7 (osd.7) 24 : cluster [DBG] 6.1b scrub ok 2024-02-10T08:41:42.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:41.232884+0000 mgr.y (mgr.14505) 931 : cluster [DBG] pgmap v1149: 162 pgs: 162 active+clean; 5.7 KiB data, 6.7 GiB used, 709 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:41:42.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:42.064977+0000 osd.3 (osd.3) 121 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:41:42.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:42.065076+0000 osd.3 (osd.3) 122 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:41:42.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:42.297030+0000 osd.7 (osd.7) 23 : cluster [DBG] 6.1b scrub starts 2024-02-10T08:41:42.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:42.382358+0000 osd.7 (osd.7) 24 : cluster [DBG] 6.1b scrub ok 2024-02-10T08:41:43.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:41.232884+0000 mgr.y (mgr.14505) 931 : cluster [DBG] pgmap v1149: 162 pgs: 162 active+clean; 5.7 KiB data, 6.7 GiB used, 709 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:41:43.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:42.064977+0000 osd.3 (osd.3) 121 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:41:43.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:42.065076+0000 osd.3 (osd.3) 122 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:41:43.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:42.297030+0000 osd.7 (osd.7) 23 : cluster [DBG] 6.1b scrub starts 2024-02-10T08:41:43.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:42.382358+0000 osd.7 (osd.7) 24 : cluster [DBG] 6.1b scrub ok 2024-02-10T08:41:43.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:42.108900+0000 osd.5 (osd.5) 322 : cluster [DBG] 6.33 scrub starts 2024-02-10T08:41:43.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:42.200316+0000 osd.5 (osd.5) 323 : cluster [DBG] 6.33 scrub ok 2024-02-10T08:41:43.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:42.487099+0000 osd.6 (osd.6) 313 : cluster [DBG] 6.2e scrub starts 2024-02-10T08:41:43.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:42.490295+0000 osd.6 (osd.6) 314 : cluster [DBG] 6.2e scrub ok 2024-02-10T08:41:43.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:42.587117+0000 mon.a (mon.0) 1932 : cluster [DBG] osdmap e479: 8 total, 8 up, 8 in 2024-02-10T08:41:43.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:42.672832+0000 osd.0 (osd.0) 308 : cluster [DBG] 4.3 scrub starts 2024-02-10T08:41:43.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:42.674888+0000 osd.0 (osd.0) 309 : cluster [DBG] 4.3 scrub ok 2024-02-10T08:41:43.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:43.316352+0000 osd.7 (osd.7) 25 : cluster [DBG] 2.5 scrub starts 2024-02-10T08:41:43.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:43.317301+0000 osd.7 (osd.7) 26 : cluster [DBG] 2.5 scrub ok 2024-02-10T08:41:43.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:42.108900+0000 osd.5 (osd.5) 322 : cluster [DBG] 6.33 scrub starts 2024-02-10T08:41:43.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:42.200316+0000 osd.5 (osd.5) 323 : cluster [DBG] 6.33 scrub ok 2024-02-10T08:41:43.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:42.487099+0000 osd.6 (osd.6) 313 : cluster [DBG] 6.2e scrub starts 2024-02-10T08:41:43.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:42.490295+0000 osd.6 (osd.6) 314 : cluster [DBG] 6.2e scrub ok 2024-02-10T08:41:43.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:42.587117+0000 mon.a (mon.0) 1932 : cluster [DBG] osdmap e479: 8 total, 8 up, 8 in 2024-02-10T08:41:43.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:42.672832+0000 osd.0 (osd.0) 308 : cluster [DBG] 4.3 scrub starts 2024-02-10T08:41:43.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:42.674888+0000 osd.0 (osd.0) 309 : cluster [DBG] 4.3 scrub ok 2024-02-10T08:41:43.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:43.316352+0000 osd.7 (osd.7) 25 : cluster [DBG] 2.5 scrub starts 2024-02-10T08:41:43.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:43.317301+0000 osd.7 (osd.7) 26 : cluster [DBG] 2.5 scrub ok 2024-02-10T08:41:44.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:43 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:42.108900+0000 osd.5 (osd.5) 322 : cluster [DBG] 6.33 scrub starts 2024-02-10T08:41:44.047 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:43 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:42.200316+0000 osd.5 (osd.5) 323 : cluster [DBG] 6.33 scrub ok 2024-02-10T08:41:44.047 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:43 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:42.487099+0000 osd.6 (osd.6) 313 : cluster [DBG] 6.2e scrub starts 2024-02-10T08:41:44.048 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:43 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:42.490295+0000 osd.6 (osd.6) 314 : cluster [DBG] 6.2e scrub ok 2024-02-10T08:41:44.048 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:43 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:42.587117+0000 mon.a (mon.0) 1932 : cluster [DBG] osdmap e479: 8 total, 8 up, 8 in 2024-02-10T08:41:44.048 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:43 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:42.672832+0000 osd.0 (osd.0) 308 : cluster [DBG] 4.3 scrub starts 2024-02-10T08:41:44.048 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:43 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:42.674888+0000 osd.0 (osd.0) 309 : cluster [DBG] 4.3 scrub ok 2024-02-10T08:41:44.048 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:43 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:43.316352+0000 osd.7 (osd.7) 25 : cluster [DBG] 2.5 scrub starts 2024-02-10T08:41:44.048 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:43 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:43.317301+0000 osd.7 (osd.7) 26 : cluster [DBG] 2.5 scrub ok 2024-02-10T08:41:44.603 INFO:teuthology.orchestra.run.smithi018.stderr:reweighted osd.2 to 1 (10000) 2024-02-10T08:41:44.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:43.127467+0000 osd.5 (osd.5) 324 : cluster [DBG] 5.16 scrub starts 2024-02-10T08:41:44.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:43.130392+0000 osd.5 (osd.5) 325 : cluster [DBG] 5.16 scrub ok 2024-02-10T08:41:44.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:43.233495+0000 mgr.y (mgr.14505) 932 : cluster [DBG] pgmap v1151: 162 pgs: 162 active+clean; 5.7 KiB data, 6.7 GiB used, 709 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-02-10T08:41:44.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:43.246171+0000 osd.2 (osd.2) 297 : cluster [DBG] 5.8 scrub starts 2024-02-10T08:41:44.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:43.246993+0000 osd.2 (osd.2) 298 : cluster [DBG] 5.8 scrub ok 2024-02-10T08:41:44.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:43.400156+0000 osd.0 (osd.0) 310 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:41:44.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:43.400198+0000 osd.0 (osd.0) 311 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:41:44.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:43.594881+0000 mon.a (mon.0) 1933 : cluster [DBG] osdmap e480: 8 total, 8 up, 8 in 2024-02-10T08:41:44.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:44.100472+0000 osd.4 (osd.4) 31 : cluster [DBG] 4.1b scrub starts 2024-02-10T08:41:44.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:44.104241+0000 osd.4 (osd.4) 32 : cluster [DBG] 4.1b scrub ok 2024-02-10T08:41:44.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:41:44.504819+0000 mon.a (mon.0) 1934 : audit [INF] from='client.? 172.21.15.18:0/3281778883' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2024-02-10T08:41:44.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:43.127467+0000 osd.5 (osd.5) 324 : cluster [DBG] 5.16 scrub starts 2024-02-10T08:41:44.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:43.130392+0000 osd.5 (osd.5) 325 : cluster [DBG] 5.16 scrub ok 2024-02-10T08:41:44.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:43.233495+0000 mgr.y (mgr.14505) 932 : cluster [DBG] pgmap v1151: 162 pgs: 162 active+clean; 5.7 KiB data, 6.7 GiB used, 709 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-02-10T08:41:44.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:43.246171+0000 osd.2 (osd.2) 297 : cluster [DBG] 5.8 scrub starts 2024-02-10T08:41:44.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:43.246993+0000 osd.2 (osd.2) 298 : cluster [DBG] 5.8 scrub ok 2024-02-10T08:41:44.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:43.400156+0000 osd.0 (osd.0) 310 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:41:44.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:43.400198+0000 osd.0 (osd.0) 311 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:41:44.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:43.594881+0000 mon.a (mon.0) 1933 : cluster [DBG] osdmap e480: 8 total, 8 up, 8 in 2024-02-10T08:41:44.906 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:44.100472+0000 osd.4 (osd.4) 31 : cluster [DBG] 4.1b scrub starts 2024-02-10T08:41:44.906 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:44.104241+0000 osd.4 (osd.4) 32 : cluster [DBG] 4.1b scrub ok 2024-02-10T08:41:44.906 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:41:44.504819+0000 mon.a (mon.0) 1934 : audit [INF] from='client.? 172.21.15.18:0/3281778883' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2024-02-10T08:41:45.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:44 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:43.127467+0000 osd.5 (osd.5) 324 : cluster [DBG] 5.16 scrub starts 2024-02-10T08:41:45.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:44 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:43.130392+0000 osd.5 (osd.5) 325 : cluster [DBG] 5.16 scrub ok 2024-02-10T08:41:45.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:44 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:43.233495+0000 mgr.y (mgr.14505) 932 : cluster [DBG] pgmap v1151: 162 pgs: 162 active+clean; 5.7 KiB data, 6.7 GiB used, 709 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-02-10T08:41:45.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:44 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:43.246171+0000 osd.2 (osd.2) 297 : cluster [DBG] 5.8 scrub starts 2024-02-10T08:41:45.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:44 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:43.246993+0000 osd.2 (osd.2) 298 : cluster [DBG] 5.8 scrub ok 2024-02-10T08:41:45.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:44 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:43.400156+0000 osd.0 (osd.0) 310 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:41:45.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:44 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:43.400198+0000 osd.0 (osd.0) 311 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:41:45.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:44 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:43.594881+0000 mon.a (mon.0) 1933 : cluster [DBG] osdmap e480: 8 total, 8 up, 8 in 2024-02-10T08:41:45.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:44 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:44.100472+0000 osd.4 (osd.4) 31 : cluster [DBG] 4.1b scrub starts 2024-02-10T08:41:45.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:44 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:44.104241+0000 osd.4 (osd.4) 32 : cluster [DBG] 4.1b scrub ok 2024-02-10T08:41:45.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:44 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:41:44.504819+0000 mon.a (mon.0) 1934 : audit [INF] from='client.? 172.21.15.18:0/3281778883' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2024-02-10T08:41:45.475 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd primary-affinity 2 1 2024-02-10T08:41:45.760 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:41:45.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:41:44.594333+0000 mon.a (mon.0) 1935 : audit [INF] from='client.? 172.21.15.18:0/3281778883' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2024-02-10T08:41:45.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:44.594410+0000 mon.a (mon.0) 1936 : cluster [DBG] osdmap e481: 8 total, 8 up, 8 in 2024-02-10T08:41:45.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:45.296683+0000 osd.7 (osd.7) 27 : cluster [DBG] 2.1c scrub starts 2024-02-10T08:41:45.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:45.297703+0000 osd.7 (osd.7) 28 : cluster [DBG] 2.1c scrub ok 2024-02-10T08:41:45.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:41:44.594333+0000 mon.a (mon.0) 1935 : audit [INF] from='client.? 172.21.15.18:0/3281778883' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2024-02-10T08:41:45.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:44.594410+0000 mon.a (mon.0) 1936 : cluster [DBG] osdmap e481: 8 total, 8 up, 8 in 2024-02-10T08:41:45.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:45.296683+0000 osd.7 (osd.7) 27 : cluster [DBG] 2.1c scrub starts 2024-02-10T08:41:45.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:45 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:45.297703+0000 osd.7 (osd.7) 28 : cluster [DBG] 2.1c scrub ok 2024-02-10T08:41:46.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:41:44.594333+0000 mon.a (mon.0) 1935 : audit [INF] from='client.? 172.21.15.18:0/3281778883' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2024-02-10T08:41:46.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:44.594410+0000 mon.a (mon.0) 1936 : cluster [DBG] osdmap e481: 8 total, 8 up, 8 in 2024-02-10T08:41:46.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:45.296683+0000 osd.7 (osd.7) 27 : cluster [DBG] 2.1c scrub starts 2024-02-10T08:41:46.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:45.297703+0000 osd.7 (osd.7) 28 : cluster [DBG] 2.1c scrub ok 2024-02-10T08:41:46.789 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:41:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:41:46] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:41:46.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:45.167655+0000 osd.5 (osd.5) 326 : cluster [DBG] 6.19 scrub starts 2024-02-10T08:41:46.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:45.192061+0000 osd.5 (osd.5) 327 : cluster [DBG] 6.19 scrub ok 2024-02-10T08:41:46.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:45.234062+0000 mgr.y (mgr.14505) 933 : cluster [DBG] pgmap v1154: 162 pgs: 162 active+clean; 5.7 KiB data, 6.7 GiB used, 709 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:41:46.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:45.485071+0000 osd.6 (osd.6) 315 : cluster [DBG] 4.5 deep-scrub starts 2024-02-10T08:41:46.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:45.488899+0000 osd.6 (osd.6) 316 : cluster [DBG] 4.5 deep-scrub ok 2024-02-10T08:41:46.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:45.734868+0000 osd.1 (osd.1) 351 : cluster [DBG] 2.4 scrub starts 2024-02-10T08:41:46.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:45.737782+0000 osd.1 (osd.1) 352 : cluster [DBG] 2.4 scrub ok 2024-02-10T08:41:46.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:46.111985+0000 mon.a (mon.0) 1937 : cluster [DBG] osdmap e482: 8 total, 8 up, 8 in 2024-02-10T08:41:46.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:46.326421+0000 osd.7 (osd.7) 29 : cluster [DBG] 2.8 scrub starts 2024-02-10T08:41:46.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:46.328495+0000 osd.7 (osd.7) 30 : cluster [DBG] 2.8 scrub ok 2024-02-10T08:41:46.876 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:45.167655+0000 osd.5 (osd.5) 326 : cluster [DBG] 6.19 scrub starts 2024-02-10T08:41:46.876 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:45.192061+0000 osd.5 (osd.5) 327 : cluster [DBG] 6.19 scrub ok 2024-02-10T08:41:46.876 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:45.234062+0000 mgr.y (mgr.14505) 933 : cluster [DBG] pgmap v1154: 162 pgs: 162 active+clean; 5.7 KiB data, 6.7 GiB used, 709 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:41:46.877 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:45.485071+0000 osd.6 (osd.6) 315 : cluster [DBG] 4.5 deep-scrub starts 2024-02-10T08:41:46.877 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:45.488899+0000 osd.6 (osd.6) 316 : cluster [DBG] 4.5 deep-scrub ok 2024-02-10T08:41:46.877 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:45.734868+0000 osd.1 (osd.1) 351 : cluster [DBG] 2.4 scrub starts 2024-02-10T08:41:46.877 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:45.737782+0000 osd.1 (osd.1) 352 : cluster [DBG] 2.4 scrub ok 2024-02-10T08:41:46.877 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:46.111985+0000 mon.a (mon.0) 1937 : cluster [DBG] osdmap e482: 8 total, 8 up, 8 in 2024-02-10T08:41:46.877 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:46.326421+0000 osd.7 (osd.7) 29 : cluster [DBG] 2.8 scrub starts 2024-02-10T08:41:46.877 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:46.328495+0000 osd.7 (osd.7) 30 : cluster [DBG] 2.8 scrub ok 2024-02-10T08:41:46.877 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:45.167655+0000 osd.5 (osd.5) 326 : cluster [DBG] 6.19 scrub starts 2024-02-10T08:41:46.877 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:45.192061+0000 osd.5 (osd.5) 327 : cluster [DBG] 6.19 scrub ok 2024-02-10T08:41:46.877 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:45.234062+0000 mgr.y (mgr.14505) 933 : cluster [DBG] pgmap v1154: 162 pgs: 162 active+clean; 5.7 KiB data, 6.7 GiB used, 709 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:41:46.877 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:45.485071+0000 osd.6 (osd.6) 315 : cluster [DBG] 4.5 deep-scrub starts 2024-02-10T08:41:46.877 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:45.488899+0000 osd.6 (osd.6) 316 : cluster [DBG] 4.5 deep-scrub ok 2024-02-10T08:41:46.877 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:45.734868+0000 osd.1 (osd.1) 351 : cluster [DBG] 2.4 scrub starts 2024-02-10T08:41:46.878 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:45.737782+0000 osd.1 (osd.1) 352 : cluster [DBG] 2.4 scrub ok 2024-02-10T08:41:46.878 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:46.111985+0000 mon.a (mon.0) 1937 : cluster [DBG] osdmap e482: 8 total, 8 up, 8 in 2024-02-10T08:41:46.878 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:46.326421+0000 osd.7 (osd.7) 29 : cluster [DBG] 2.8 scrub starts 2024-02-10T08:41:46.878 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:46.328495+0000 osd.7 (osd.7) 30 : cluster [DBG] 2.8 scrub ok 2024-02-10T08:41:47.404 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:41:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:41:47] "GET /metrics HTTP/1.1" 200 174034 "" "Prometheus/2.33.4" 2024-02-10T08:41:47.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:46.650119+0000 osd.0 (osd.0) 312 : cluster [DBG] 5.13 scrub starts 2024-02-10T08:41:47.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:46.650957+0000 osd.0 (osd.0) 313 : cluster [DBG] 5.13 scrub ok 2024-02-10T08:41:47.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:46.763388+0000 osd.1 (osd.1) 353 : cluster [DBG] 2.15 scrub starts 2024-02-10T08:41:47.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:46.766416+0000 osd.1 (osd.1) 354 : cluster [DBG] 2.15 scrub ok 2024-02-10T08:41:47.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:46.650119+0000 osd.0 (osd.0) 312 : cluster [DBG] 5.13 scrub starts 2024-02-10T08:41:47.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:46.650957+0000 osd.0 (osd.0) 313 : cluster [DBG] 5.13 scrub ok 2024-02-10T08:41:47.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:46.763388+0000 osd.1 (osd.1) 353 : cluster [DBG] 2.15 scrub starts 2024-02-10T08:41:47.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:46.766416+0000 osd.1 (osd.1) 354 : cluster [DBG] 2.15 scrub ok 2024-02-10T08:41:48.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:46.650119+0000 osd.0 (osd.0) 312 : cluster [DBG] 5.13 scrub starts 2024-02-10T08:41:48.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:46.650957+0000 osd.0 (osd.0) 313 : cluster [DBG] 5.13 scrub ok 2024-02-10T08:41:48.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:46.763388+0000 osd.1 (osd.1) 353 : cluster [DBG] 2.15 scrub starts 2024-02-10T08:41:48.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:47 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:46.766416+0000 osd.1 (osd.1) 354 : cluster [DBG] 2.15 scrub ok 2024-02-10T08:41:48.618 INFO:teuthology.orchestra.run.smithi018.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-02-10T08:41:48.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:47.225748+0000 osd.2 (osd.2) 299 : cluster [DBG] 5.d scrub starts 2024-02-10T08:41:48.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:47.227522+0000 osd.2 (osd.2) 300 : cluster [DBG] 5.d scrub ok 2024-02-10T08:41:48.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:47.234657+0000 mgr.y (mgr.14505) 934 : cluster [DBG] pgmap v1156: 162 pgs: 162 active+clean; 5.7 KiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-02-10T08:41:48.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:47.410777+0000 osd.6 (osd.6) 317 : cluster [DBG] 2.19 scrub starts 2024-02-10T08:41:48.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:47.411761+0000 osd.6 (osd.6) 318 : cluster [DBG] 2.19 scrub ok 2024-02-10T08:41:48.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:47.630911+0000 osd.0 (osd.0) 314 : cluster [DBG] 6.f scrub starts 2024-02-10T08:41:48.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:47.765263+0000 osd.0 (osd.0) 315 : cluster [DBG] 6.f scrub ok 2024-02-10T08:41:48.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:41:48.199753+0000 mon.a (mon.0) 1938 : audit [INF] from='client.? 172.21.15.18:0/3903829529' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 2, "weight": 1.0}]: dispatch 2024-02-10T08:41:48.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:47.225748+0000 osd.2 (osd.2) 299 : cluster [DBG] 5.d scrub starts 2024-02-10T08:41:48.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:47.227522+0000 osd.2 (osd.2) 300 : cluster [DBG] 5.d scrub ok 2024-02-10T08:41:48.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:47.234657+0000 mgr.y (mgr.14505) 934 : cluster [DBG] pgmap v1156: 162 pgs: 162 active+clean; 5.7 KiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-02-10T08:41:48.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:47.410777+0000 osd.6 (osd.6) 317 : cluster [DBG] 2.19 scrub starts 2024-02-10T08:41:48.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:47.411761+0000 osd.6 (osd.6) 318 : cluster [DBG] 2.19 scrub ok 2024-02-10T08:41:48.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:47.630911+0000 osd.0 (osd.0) 314 : cluster [DBG] 6.f scrub starts 2024-02-10T08:41:48.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:47.765263+0000 osd.0 (osd.0) 315 : cluster [DBG] 6.f scrub ok 2024-02-10T08:41:48.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:41:48.199753+0000 mon.a (mon.0) 1938 : audit [INF] from='client.? 172.21.15.18:0/3903829529' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 2, "weight": 1.0}]: dispatch 2024-02-10T08:41:49.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:47.225748+0000 osd.2 (osd.2) 299 : cluster [DBG] 5.d scrub starts 2024-02-10T08:41:49.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:47.227522+0000 osd.2 (osd.2) 300 : cluster [DBG] 5.d scrub ok 2024-02-10T08:41:49.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:47.234657+0000 mgr.y (mgr.14505) 934 : cluster [DBG] pgmap v1156: 162 pgs: 162 active+clean; 5.7 KiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-02-10T08:41:49.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:47.410777+0000 osd.6 (osd.6) 317 : cluster [DBG] 2.19 scrub starts 2024-02-10T08:41:49.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:47.411761+0000 osd.6 (osd.6) 318 : cluster [DBG] 2.19 scrub ok 2024-02-10T08:41:49.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:47.630911+0000 osd.0 (osd.0) 314 : cluster [DBG] 6.f scrub starts 2024-02-10T08:41:49.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:47.765263+0000 osd.0 (osd.0) 315 : cluster [DBG] 6.f scrub ok 2024-02-10T08:41:49.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:41:48.199753+0000 mon.a (mon.0) 1938 : audit [INF] from='client.? 172.21.15.18:0/3903829529' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 2, "weight": 1.0}]: dispatch 2024-02-10T08:41:49.400 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd reweight 3 1 2024-02-10T08:41:49.539 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:41:49 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:41:49.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:48.453327+0000 osd.6 (osd.6) 319 : cluster [DBG] 5.1f scrub starts 2024-02-10T08:41:49.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:48.456796+0000 osd.6 (osd.6) 320 : cluster [DBG] 5.1f scrub ok 2024-02-10T08:41:49.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:41:48.612423+0000 mon.a (mon.0) 1939 : audit [INF] from='client.? 172.21.15.18:0/3903829529' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 2, "weight": 1.0}]': finished 2024-02-10T08:41:49.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:48.612499+0000 mon.a (mon.0) 1940 : cluster [DBG] osdmap e483: 8 total, 8 up, 8 in 2024-02-10T08:41:49.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:48.810785+0000 osd.1 (osd.1) 355 : cluster [DBG] 6.1 scrub starts 2024-02-10T08:41:49.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:48.835350+0000 osd.1 (osd.1) 356 : cluster [DBG] 6.1 scrub ok 2024-02-10T08:41:49.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:48.453327+0000 osd.6 (osd.6) 319 : cluster [DBG] 5.1f scrub starts 2024-02-10T08:41:49.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:48.456796+0000 osd.6 (osd.6) 320 : cluster [DBG] 5.1f scrub ok 2024-02-10T08:41:49.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:41:48.612423+0000 mon.a (mon.0) 1939 : audit [INF] from='client.? 172.21.15.18:0/3903829529' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 2, "weight": 1.0}]': finished 2024-02-10T08:41:49.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:48.612499+0000 mon.a (mon.0) 1940 : cluster [DBG] osdmap e483: 8 total, 8 up, 8 in 2024-02-10T08:41:49.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:48.810785+0000 osd.1 (osd.1) 355 : cluster [DBG] 6.1 scrub starts 2024-02-10T08:41:49.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:48.835350+0000 osd.1 (osd.1) 356 : cluster [DBG] 6.1 scrub ok 2024-02-10T08:41:49.690 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:41:50.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:49 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:48.453327+0000 osd.6 (osd.6) 319 : cluster [DBG] 5.1f scrub starts 2024-02-10T08:41:50.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:49 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:48.456796+0000 osd.6 (osd.6) 320 : cluster [DBG] 5.1f scrub ok 2024-02-10T08:41:50.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:49 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:41:48.612423+0000 mon.a (mon.0) 1939 : audit [INF] from='client.? 172.21.15.18:0/3903829529' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 2, "weight": 1.0}]': finished 2024-02-10T08:41:50.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:49 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:48.612499+0000 mon.a (mon.0) 1940 : cluster [DBG] osdmap e483: 8 total, 8 up, 8 in 2024-02-10T08:41:50.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:49 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:48.810785+0000 osd.1 (osd.1) 355 : cluster [DBG] 6.1 scrub starts 2024-02-10T08:41:50.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:49 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:48.835350+0000 osd.1 (osd.1) 356 : cluster [DBG] 6.1 scrub ok 2024-02-10T08:41:50.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:41:49.120707+0000 mgr.y (mgr.14505) 935 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:41:50.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:49.235216+0000 mgr.y (mgr.14505) 936 : cluster [DBG] pgmap v1158: 162 pgs: 162 active+clean; 5.7 KiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 907 B/s rd, 0 op/s 2024-02-10T08:41:50.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:49.236686+0000 osd.2 (osd.2) 301 : cluster [DBG] 2.1 scrub starts 2024-02-10T08:41:50.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:49.237775+0000 osd.2 (osd.2) 302 : cluster [DBG] 2.1 scrub ok 2024-02-10T08:41:50.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:49.407698+0000 osd.6 (osd.6) 321 : cluster [DBG] 6.25 scrub starts 2024-02-10T08:41:50.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:49.472693+0000 osd.6 (osd.6) 322 : cluster [DBG] 6.25 scrub ok 2024-02-10T08:41:50.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:50.011918+0000 osd.4 (osd.4) 33 : cluster [DBG] 6.2 scrub starts 2024-02-10T08:41:50.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:50.014937+0000 osd.4 (osd.4) 34 : cluster [DBG] 6.2 scrub ok 2024-02-10T08:41:50.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:41:49.120707+0000 mgr.y (mgr.14505) 935 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:41:50.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:49.235216+0000 mgr.y (mgr.14505) 936 : cluster [DBG] pgmap v1158: 162 pgs: 162 active+clean; 5.7 KiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 907 B/s rd, 0 op/s 2024-02-10T08:41:50.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:49.236686+0000 osd.2 (osd.2) 301 : cluster [DBG] 2.1 scrub starts 2024-02-10T08:41:50.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:49.237775+0000 osd.2 (osd.2) 302 : cluster [DBG] 2.1 scrub ok 2024-02-10T08:41:50.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:49.407698+0000 osd.6 (osd.6) 321 : cluster [DBG] 6.25 scrub starts 2024-02-10T08:41:50.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:49.472693+0000 osd.6 (osd.6) 322 : cluster [DBG] 6.25 scrub ok 2024-02-10T08:41:50.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:50.011918+0000 osd.4 (osd.4) 33 : cluster [DBG] 6.2 scrub starts 2024-02-10T08:41:50.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:50.014937+0000 osd.4 (osd.4) 34 : cluster [DBG] 6.2 scrub ok 2024-02-10T08:41:51.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:41:49.120707+0000 mgr.y (mgr.14505) 935 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:41:51.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:49.235216+0000 mgr.y (mgr.14505) 936 : cluster [DBG] pgmap v1158: 162 pgs: 162 active+clean; 5.7 KiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 907 B/s rd, 0 op/s 2024-02-10T08:41:51.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:49.236686+0000 osd.2 (osd.2) 301 : cluster [DBG] 2.1 scrub starts 2024-02-10T08:41:51.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:49.237775+0000 osd.2 (osd.2) 302 : cluster [DBG] 2.1 scrub ok 2024-02-10T08:41:51.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:49.407698+0000 osd.6 (osd.6) 321 : cluster [DBG] 6.25 scrub starts 2024-02-10T08:41:51.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:49.472693+0000 osd.6 (osd.6) 322 : cluster [DBG] 6.25 scrub ok 2024-02-10T08:41:51.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:50.011918+0000 osd.4 (osd.4) 33 : cluster [DBG] 6.2 scrub starts 2024-02-10T08:41:51.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:50.014937+0000 osd.4 (osd.4) 34 : cluster [DBG] 6.2 scrub ok 2024-02-10T08:41:51.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:50.192682+0000 osd.5 (osd.5) 328 : cluster [DBG] 6.a scrub starts 2024-02-10T08:41:51.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:50.195648+0000 osd.5 (osd.5) 329 : cluster [DBG] 6.a scrub ok 2024-02-10T08:41:51.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:41:50.756777+0000 mon.a (mon.0) 1941 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:41:51.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:51.113723+0000 mon.a (mon.0) 1942 : cluster [DBG] osdmap e484: 8 total, 8 up, 8 in 2024-02-10T08:41:51.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:41:51.599185+0000 mon.a (mon.0) 1943 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:41:51.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:41:51.599881+0000 mon.a (mon.0) 1944 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:41:51.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:41:51.604401+0000 mon.a (mon.0) 1945 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:41:51.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:50.192682+0000 osd.5 (osd.5) 328 : cluster [DBG] 6.a scrub starts 2024-02-10T08:41:51.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:50.195648+0000 osd.5 (osd.5) 329 : cluster [DBG] 6.a scrub ok 2024-02-10T08:41:51.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:41:50.756777+0000 mon.a (mon.0) 1941 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:41:51.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:51.113723+0000 mon.a (mon.0) 1942 : cluster [DBG] osdmap e484: 8 total, 8 up, 8 in 2024-02-10T08:41:51.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:41:51.599185+0000 mon.a (mon.0) 1943 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:41:51.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:41:51.599881+0000 mon.a (mon.0) 1944 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:41:51.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:41:51.604401+0000 mon.a (mon.0) 1945 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:41:52.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:51 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:50.192682+0000 osd.5 (osd.5) 328 : cluster [DBG] 6.a scrub starts 2024-02-10T08:41:52.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:51 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:50.195648+0000 osd.5 (osd.5) 329 : cluster [DBG] 6.a scrub ok 2024-02-10T08:41:52.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:51 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:41:50.756777+0000 mon.a (mon.0) 1941 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:41:52.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:51 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:51.113723+0000 mon.a (mon.0) 1942 : cluster [DBG] osdmap e484: 8 total, 8 up, 8 in 2024-02-10T08:41:52.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:51 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:41:51.599185+0000 mon.a (mon.0) 1943 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:41:52.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:51 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:41:51.599881+0000 mon.a (mon.0) 1944 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:41:52.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:51 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:41:51.604401+0000 mon.a (mon.0) 1945 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:41:52.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:51.235749+0000 mgr.y (mgr.14505) 937 : cluster [DBG] pgmap v1160: 162 pgs: 162 active+clean; 5.7 KiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:41:52.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:51.718048+0000 osd.0 (osd.0) 316 : cluster [DBG] 4.6 scrub starts 2024-02-10T08:41:52.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:51.721502+0000 osd.0 (osd.0) 317 : cluster [DBG] 4.6 scrub ok 2024-02-10T08:41:52.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:52.219424+0000 osd.7 (osd.7) 31 : cluster [DBG] 5.10 scrub starts 2024-02-10T08:41:52.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:52.220539+0000 osd.7 (osd.7) 32 : cluster [DBG] 5.10 scrub ok 2024-02-10T08:41:52.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:41:52.406147+0000 mon.a (mon.0) 1946 : audit [INF] from='client.? 172.21.15.18:0/269188641' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]: dispatch 2024-02-10T08:41:52.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:51.235749+0000 mgr.y (mgr.14505) 937 : cluster [DBG] pgmap v1160: 162 pgs: 162 active+clean; 5.7 KiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:41:52.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:51.718048+0000 osd.0 (osd.0) 316 : cluster [DBG] 4.6 scrub starts 2024-02-10T08:41:52.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:51.721502+0000 osd.0 (osd.0) 317 : cluster [DBG] 4.6 scrub ok 2024-02-10T08:41:52.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:52.219424+0000 osd.7 (osd.7) 31 : cluster [DBG] 5.10 scrub starts 2024-02-10T08:41:52.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:52.220539+0000 osd.7 (osd.7) 32 : cluster [DBG] 5.10 scrub ok 2024-02-10T08:41:52.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:41:52.406147+0000 mon.a (mon.0) 1946 : audit [INF] from='client.? 172.21.15.18:0/269188641' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]: dispatch 2024-02-10T08:41:53.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:52 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:51.235749+0000 mgr.y (mgr.14505) 937 : cluster [DBG] pgmap v1160: 162 pgs: 162 active+clean; 5.7 KiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:41:53.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:52 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:51.718048+0000 osd.0 (osd.0) 316 : cluster [DBG] 4.6 scrub starts 2024-02-10T08:41:53.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:52 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:51.721502+0000 osd.0 (osd.0) 317 : cluster [DBG] 4.6 scrub ok 2024-02-10T08:41:53.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:52 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:52.219424+0000 osd.7 (osd.7) 31 : cluster [DBG] 5.10 scrub starts 2024-02-10T08:41:53.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:52 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:52.220539+0000 osd.7 (osd.7) 32 : cluster [DBG] 5.10 scrub ok 2024-02-10T08:41:53.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:52 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:41:52.406147+0000 mon.a (mon.0) 1946 : audit [INF] from='client.? 172.21.15.18:0/269188641' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]: dispatch 2024-02-10T08:41:53.130 INFO:teuthology.orchestra.run.smithi018.stderr:reweighted osd.3 to 1 (10000) 2024-02-10T08:41:53.888 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd primary-affinity 3 1 2024-02-10T08:41:54.128 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:41:53.125163+0000 mon.a (mon.0) 1947 : audit [INF] from='client.? 172.21.15.18:0/269188641' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2024-02-10T08:41:54.128 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:53.125270+0000 mon.a (mon.0) 1948 : cluster [DBG] osdmap e485: 8 total, 8 up, 8 in 2024-02-10T08:41:54.128 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:53.236359+0000 mgr.y (mgr.14505) 938 : cluster [DBG] pgmap v1162: 162 pgs: 162 active+clean; 5.7 KiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-02-10T08:41:54.128 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:53.391613+0000 osd.6 (osd.6) 323 : cluster [DBG] 4.a scrub starts 2024-02-10T08:41:54.128 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:53.394780+0000 osd.6 (osd.6) 324 : cluster [DBG] 4.a scrub ok 2024-02-10T08:41:54.177 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:41:54.403 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:41:53.125163+0000 mon.a (mon.0) 1947 : audit [INF] from='client.? 172.21.15.18:0/269188641' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2024-02-10T08:41:54.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:53.125270+0000 mon.a (mon.0) 1948 : cluster [DBG] osdmap e485: 8 total, 8 up, 8 in 2024-02-10T08:41:54.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:53.236359+0000 mgr.y (mgr.14505) 938 : cluster [DBG] pgmap v1162: 162 pgs: 162 active+clean; 5.7 KiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-02-10T08:41:54.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:53.391613+0000 osd.6 (osd.6) 323 : cluster [DBG] 4.a scrub starts 2024-02-10T08:41:54.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:53.394780+0000 osd.6 (osd.6) 324 : cluster [DBG] 4.a scrub ok 2024-02-10T08:41:54.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:54 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:41:53.125163+0000 mon.a (mon.0) 1947 : audit [INF] from='client.? 172.21.15.18:0/269188641' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2024-02-10T08:41:54.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:54 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:53.125270+0000 mon.a (mon.0) 1948 : cluster [DBG] osdmap e485: 8 total, 8 up, 8 in 2024-02-10T08:41:54.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:54 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:53.236359+0000 mgr.y (mgr.14505) 938 : cluster [DBG] pgmap v1162: 162 pgs: 162 active+clean; 5.7 KiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-02-10T08:41:54.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:54 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:53.391613+0000 osd.6 (osd.6) 323 : cluster [DBG] 4.a scrub starts 2024-02-10T08:41:54.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:54 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:53.394780+0000 osd.6 (osd.6) 324 : cluster [DBG] 4.a scrub ok 2024-02-10T08:41:55.129 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:54.205851+0000 osd.7 (osd.7) 33 : cluster [DBG] 5.14 scrub starts 2024-02-10T08:41:55.129 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:54.207251+0000 osd.7 (osd.7) 34 : cluster [DBG] 5.14 scrub ok 2024-02-10T08:41:55.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:54.205851+0000 osd.7 (osd.7) 33 : cluster [DBG] 5.14 scrub starts 2024-02-10T08:41:55.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:54.207251+0000 osd.7 (osd.7) 34 : cluster [DBG] 5.14 scrub ok 2024-02-10T08:41:55.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:54.205851+0000 osd.7 (osd.7) 33 : cluster [DBG] 5.14 scrub starts 2024-02-10T08:41:55.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:54.207251+0000 osd.7 (osd.7) 34 : cluster [DBG] 5.14 scrub ok 2024-02-10T08:41:56.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:54.866571+0000 osd.1 (osd.1) 357 : cluster [DBG] 5.19 scrub starts 2024-02-10T08:41:56.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:54.869557+0000 osd.1 (osd.1) 358 : cluster [DBG] 5.19 scrub ok 2024-02-10T08:41:56.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:55.088994+0000 osd.4 (osd.4) 35 : cluster [DBG] 4.d scrub starts 2024-02-10T08:41:56.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:55.092664+0000 osd.4 (osd.4) 36 : cluster [DBG] 4.d scrub ok 2024-02-10T08:41:56.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:55.236795+0000 mgr.y (mgr.14505) 939 : cluster [DBG] pgmap v1163: 162 pgs: 162 active+clean; 5.7 KiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 772 B/s rd, 0 op/s 2024-02-10T08:41:56.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:56.116555+0000 mon.a (mon.0) 1949 : cluster [DBG] osdmap e486: 8 total, 8 up, 8 in 2024-02-10T08:41:56.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:54.866571+0000 osd.1 (osd.1) 357 : cluster [DBG] 5.19 scrub starts 2024-02-10T08:41:56.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:54.869557+0000 osd.1 (osd.1) 358 : cluster [DBG] 5.19 scrub ok 2024-02-10T08:41:56.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:55.088994+0000 osd.4 (osd.4) 35 : cluster [DBG] 4.d scrub starts 2024-02-10T08:41:56.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:55.092664+0000 osd.4 (osd.4) 36 : cluster [DBG] 4.d scrub ok 2024-02-10T08:41:56.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:55.236795+0000 mgr.y (mgr.14505) 939 : cluster [DBG] pgmap v1163: 162 pgs: 162 active+clean; 5.7 KiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 772 B/s rd, 0 op/s 2024-02-10T08:41:56.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:56.116555+0000 mon.a (mon.0) 1949 : cluster [DBG] osdmap e486: 8 total, 8 up, 8 in 2024-02-10T08:41:56.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:54.866571+0000 osd.1 (osd.1) 357 : cluster [DBG] 5.19 scrub starts 2024-02-10T08:41:56.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:54.869557+0000 osd.1 (osd.1) 358 : cluster [DBG] 5.19 scrub ok 2024-02-10T08:41:56.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:55.088994+0000 osd.4 (osd.4) 35 : cluster [DBG] 4.d scrub starts 2024-02-10T08:41:56.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:55.092664+0000 osd.4 (osd.4) 36 : cluster [DBG] 4.d scrub ok 2024-02-10T08:41:56.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:55.236795+0000 mgr.y (mgr.14505) 939 : cluster [DBG] pgmap v1163: 162 pgs: 162 active+clean; 5.7 KiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 772 B/s rd, 0 op/s 2024-02-10T08:41:56.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:56.116555+0000 mon.a (mon.0) 1949 : cluster [DBG] osdmap e486: 8 total, 8 up, 8 in 2024-02-10T08:41:56.789 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:41:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:41:56] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:41:57.155 INFO:teuthology.orchestra.run.smithi018.stderr:set osd.3 primary-affinity to 1 (8655362) 2024-02-10T08:41:57.404 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:41:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:41:57] "GET /metrics HTTP/1.1" 200 174034 "" "Prometheus/2.33.4" 2024-02-10T08:41:57.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:56.071260+0000 osd.4 (osd.4) 37 : cluster [DBG] 4.e scrub starts 2024-02-10T08:41:57.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:56.073369+0000 osd.4 (osd.4) 38 : cluster [DBG] 4.e scrub ok 2024-02-10T08:41:57.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:41:56.423834+0000 mon.c (mon.2) 115 : audit [INF] from='client.? 172.21.15.18:0/2087781577' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 3, "weight": 1.0}]: dispatch 2024-02-10T08:41:57.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:41:56.424220+0000 mon.a (mon.0) 1950 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 3, "weight": 1.0}]: dispatch 2024-02-10T08:41:57.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:56.071260+0000 osd.4 (osd.4) 37 : cluster [DBG] 4.e scrub starts 2024-02-10T08:41:57.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:56.073369+0000 osd.4 (osd.4) 38 : cluster [DBG] 4.e scrub ok 2024-02-10T08:41:57.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:41:56.423834+0000 mon.c (mon.2) 115 : audit [INF] from='client.? 172.21.15.18:0/2087781577' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 3, "weight": 1.0}]: dispatch 2024-02-10T08:41:57.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:41:56.424220+0000 mon.a (mon.0) 1950 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 3, "weight": 1.0}]: dispatch 2024-02-10T08:41:57.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:56.071260+0000 osd.4 (osd.4) 37 : cluster [DBG] 4.e scrub starts 2024-02-10T08:41:57.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:56.073369+0000 osd.4 (osd.4) 38 : cluster [DBG] 4.e scrub ok 2024-02-10T08:41:57.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:41:56.423834+0000 mon.c (mon.2) 115 : audit [INF] from='client.? 172.21.15.18:0/2087781577' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 3, "weight": 1.0}]: dispatch 2024-02-10T08:41:57.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:41:56.424220+0000 mon.a (mon.0) 1950 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 3, "weight": 1.0}]: dispatch 2024-02-10T08:41:58.027 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd reweight 5 1 2024-02-10T08:41:58.318 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:41:58.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:57.082752+0000 osd.5 (osd.5) 330 : cluster [DBG] 6.31 scrub starts 2024-02-10T08:41:58.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:57.085686+0000 osd.5 (osd.5) 331 : cluster [DBG] 6.31 scrub ok 2024-02-10T08:41:58.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:41:57.138633+0000 mon.a (mon.0) 1951 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 3, "weight": 1.0}]': finished 2024-02-10T08:41:58.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:57.138742+0000 mon.a (mon.0) 1952 : cluster [DBG] osdmap e487: 8 total, 8 up, 8 in 2024-02-10T08:41:58.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:57.237197+0000 mgr.y (mgr.14505) 940 : cluster [DBG] pgmap v1166: 162 pgs: 162 active+clean; 5.7 KiB data, 6.5 GiB used, 709 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:41:58.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:57.082752+0000 osd.5 (osd.5) 330 : cluster [DBG] 6.31 scrub starts 2024-02-10T08:41:58.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:57.085686+0000 osd.5 (osd.5) 331 : cluster [DBG] 6.31 scrub ok 2024-02-10T08:41:58.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:41:57.138633+0000 mon.a (mon.0) 1951 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 3, "weight": 1.0}]': finished 2024-02-10T08:41:58.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:57.138742+0000 mon.a (mon.0) 1952 : cluster [DBG] osdmap e487: 8 total, 8 up, 8 in 2024-02-10T08:41:58.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:57.237197+0000 mgr.y (mgr.14505) 940 : cluster [DBG] pgmap v1166: 162 pgs: 162 active+clean; 5.7 KiB data, 6.5 GiB used, 709 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:41:58.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:57.082752+0000 osd.5 (osd.5) 330 : cluster [DBG] 6.31 scrub starts 2024-02-10T08:41:58.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:57.085686+0000 osd.5 (osd.5) 331 : cluster [DBG] 6.31 scrub ok 2024-02-10T08:41:58.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:41:57.138633+0000 mon.a (mon.0) 1951 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 3, "weight": 1.0}]': finished 2024-02-10T08:41:58.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:57.138742+0000 mon.a (mon.0) 1952 : cluster [DBG] osdmap e487: 8 total, 8 up, 8 in 2024-02-10T08:41:58.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:57.237197+0000 mgr.y (mgr.14505) 940 : cluster [DBG] pgmap v1166: 162 pgs: 162 active+clean; 5.7 KiB data, 6.5 GiB used, 709 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:41:59.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:41:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:58.149565+0000 mon.a (mon.0) 1953 : cluster [DBG] osdmap e488: 8 total, 8 up, 8 in 2024-02-10T08:41:59.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:41:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:58.149565+0000 mon.a (mon.0) 1953 : cluster [DBG] osdmap e488: 8 total, 8 up, 8 in 2024-02-10T08:41:59.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:41:59 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:58.149565+0000 mon.a (mon.0) 1953 : cluster [DBG] osdmap e488: 8 total, 8 up, 8 in 2024-02-10T08:41:59.539 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:41:59 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:42:00.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:58.481883+0000 osd.3 (osd.3) 123 : cluster [DBG] 2.1e scrub starts 2024-02-10T08:42:00.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:58.482815+0000 osd.3 (osd.3) 124 : cluster [DBG] 2.1e scrub ok 2024-02-10T08:42:00.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:41:59.131804+0000 mgr.y (mgr.14505) 941 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:42:00.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:41:59.237744+0000 mgr.y (mgr.14505) 942 : cluster [DBG] pgmap v1168: 162 pgs: 24 peering, 138 active+clean; 5.7 KiB data, 6.5 GiB used, 709 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2024-02-10T08:42:00.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:58.481883+0000 osd.3 (osd.3) 123 : cluster [DBG] 2.1e scrub starts 2024-02-10T08:42:00.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:58.482815+0000 osd.3 (osd.3) 124 : cluster [DBG] 2.1e scrub ok 2024-02-10T08:42:00.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:41:59.131804+0000 mgr.y (mgr.14505) 941 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:42:00.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:41:59.237744+0000 mgr.y (mgr.14505) 942 : cluster [DBG] pgmap v1168: 162 pgs: 24 peering, 138 active+clean; 5.7 KiB data, 6.5 GiB used, 709 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2024-02-10T08:42:00.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:58.481883+0000 osd.3 (osd.3) 123 : cluster [DBG] 2.1e scrub starts 2024-02-10T08:42:00.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:58.482815+0000 osd.3 (osd.3) 124 : cluster [DBG] 2.1e scrub ok 2024-02-10T08:42:00.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:41:59.131804+0000 mgr.y (mgr.14505) 941 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:42:00.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:41:59.237744+0000 mgr.y (mgr.14505) 942 : cluster [DBG] pgmap v1168: 162 pgs: 24 peering, 138 active+clean; 5.7 KiB data, 6.5 GiB used, 709 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2024-02-10T08:42:01.179 INFO:teuthology.orchestra.run.smithi018.stderr:reweighted osd.5 to 1 (10000) 2024-02-10T08:42:01.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:00.013921+0000 osd.4 (osd.4) 39 : cluster [DBG] 4.13 scrub starts 2024-02-10T08:42:01.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:00.017402+0000 osd.4 (osd.4) 40 : cluster [DBG] 4.13 scrub ok 2024-02-10T08:42:01.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:00.057452+0000 osd.5 (osd.5) 332 : cluster [DBG] 5.1b scrub starts 2024-02-10T08:42:01.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:00.060343+0000 osd.5 (osd.5) 333 : cluster [DBG] 5.1b scrub ok 2024-02-10T08:42:01.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:00.146982+0000 mon.a (mon.0) 1954 : cluster [WRN] Health check failed: Reduced data availability: 12 pgs inactive, 19 pgs peering (PG_AVAILABILITY) 2024-02-10T08:42:01.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:00.227191+0000 osd.7 (osd.7) 35 : cluster [DBG] 1.9 deep-scrub starts 2024-02-10T08:42:01.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:00.228307+0000 osd.7 (osd.7) 36 : cluster [DBG] 1.9 deep-scrub ok 2024-02-10T08:42:01.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:42:00.563589+0000 mon.c (mon.2) 116 : audit [INF] from='client.? 172.21.15.18:0/657860869' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2024-02-10T08:42:01.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:42:00.563929+0000 mon.a (mon.0) 1955 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2024-02-10T08:42:01.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:00.981564+0000 osd.4 (osd.4) 41 : cluster [DBG] 1.5 scrub starts 2024-02-10T08:42:01.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:00.984838+0000 osd.4 (osd.4) 42 : cluster [DBG] 1.5 scrub ok 2024-02-10T08:42:01.648 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:00.013921+0000 osd.4 (osd.4) 39 : cluster [DBG] 4.13 scrub starts 2024-02-10T08:42:01.648 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:00.017402+0000 osd.4 (osd.4) 40 : cluster [DBG] 4.13 scrub ok 2024-02-10T08:42:01.648 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:00.057452+0000 osd.5 (osd.5) 332 : cluster [DBG] 5.1b scrub starts 2024-02-10T08:42:01.648 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:00.060343+0000 osd.5 (osd.5) 333 : cluster [DBG] 5.1b scrub ok 2024-02-10T08:42:01.648 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:00.146982+0000 mon.a (mon.0) 1954 : cluster [WRN] Health check failed: Reduced data availability: 12 pgs inactive, 19 pgs peering (PG_AVAILABILITY) 2024-02-10T08:42:01.648 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:00.227191+0000 osd.7 (osd.7) 35 : cluster [DBG] 1.9 deep-scrub starts 2024-02-10T08:42:01.648 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:00.228307+0000 osd.7 (osd.7) 36 : cluster [DBG] 1.9 deep-scrub ok 2024-02-10T08:42:01.648 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:42:00.563589+0000 mon.c (mon.2) 116 : audit [INF] from='client.? 172.21.15.18:0/657860869' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2024-02-10T08:42:01.648 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:42:00.563929+0000 mon.a (mon.0) 1955 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2024-02-10T08:42:01.648 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:00.981564+0000 osd.4 (osd.4) 41 : cluster [DBG] 1.5 scrub starts 2024-02-10T08:42:01.649 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:00.984838+0000 osd.4 (osd.4) 42 : cluster [DBG] 1.5 scrub ok 2024-02-10T08:42:01.649 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:00.013921+0000 osd.4 (osd.4) 39 : cluster [DBG] 4.13 scrub starts 2024-02-10T08:42:01.649 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:00.017402+0000 osd.4 (osd.4) 40 : cluster [DBG] 4.13 scrub ok 2024-02-10T08:42:01.649 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:00.057452+0000 osd.5 (osd.5) 332 : cluster [DBG] 5.1b scrub starts 2024-02-10T08:42:01.649 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:00.060343+0000 osd.5 (osd.5) 333 : cluster [DBG] 5.1b scrub ok 2024-02-10T08:42:01.649 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:00.146982+0000 mon.a (mon.0) 1954 : cluster [WRN] Health check failed: Reduced data availability: 12 pgs inactive, 19 pgs peering (PG_AVAILABILITY) 2024-02-10T08:42:01.649 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:00.227191+0000 osd.7 (osd.7) 35 : cluster [DBG] 1.9 deep-scrub starts 2024-02-10T08:42:01.649 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:00.228307+0000 osd.7 (osd.7) 36 : cluster [DBG] 1.9 deep-scrub ok 2024-02-10T08:42:01.649 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:42:00.563589+0000 mon.c (mon.2) 116 : audit [INF] from='client.? 172.21.15.18:0/657860869' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2024-02-10T08:42:01.649 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:42:00.563929+0000 mon.a (mon.0) 1955 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2024-02-10T08:42:01.649 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:00.981564+0000 osd.4 (osd.4) 41 : cluster [DBG] 1.5 scrub starts 2024-02-10T08:42:01.649 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:00.984838+0000 osd.4 (osd.4) 42 : cluster [DBG] 1.5 scrub ok 2024-02-10T08:42:02.099 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd primary-affinity 5 1 2024-02-10T08:42:02.387 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:42:02.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:01.059960+0000 osd.5 (osd.5) 334 : cluster [DBG] 6.2b scrub starts 2024-02-10T08:42:02.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:42:01.170398+0000 mon.a (mon.0) 1956 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]': finished 2024-02-10T08:42:02.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:01.170480+0000 mon.a (mon.0) 1957 : cluster [DBG] osdmap e489: 8 total, 8 up, 8 in 2024-02-10T08:42:02.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:01.170989+0000 osd.5 (osd.5) 335 : cluster [DBG] 6.2b scrub ok 2024-02-10T08:42:02.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:01.238459+0000 mgr.y (mgr.14505) 943 : cluster [DBG] pgmap v1170: 162 pgs: 24 peering, 138 active+clean; 5.7 KiB data, 6.5 GiB used, 709 GiB / 715 GiB avail; 199 B/s rd, 0 op/s 2024-02-10T08:42:02.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:42:01.697874+0000 mon.a (mon.0) 1958 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:42:02.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:01.059960+0000 osd.5 (osd.5) 334 : cluster [DBG] 6.2b scrub starts 2024-02-10T08:42:02.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:42:01.170398+0000 mon.a (mon.0) 1956 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]': finished 2024-02-10T08:42:02.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:01.170480+0000 mon.a (mon.0) 1957 : cluster [DBG] osdmap e489: 8 total, 8 up, 8 in 2024-02-10T08:42:02.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:01.170989+0000 osd.5 (osd.5) 335 : cluster [DBG] 6.2b scrub ok 2024-02-10T08:42:02.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:01.238459+0000 mgr.y (mgr.14505) 943 : cluster [DBG] pgmap v1170: 162 pgs: 24 peering, 138 active+clean; 5.7 KiB data, 6.5 GiB used, 709 GiB / 715 GiB avail; 199 B/s rd, 0 op/s 2024-02-10T08:42:02.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:42:01.697874+0000 mon.a (mon.0) 1958 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:42:02.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:01.059960+0000 osd.5 (osd.5) 334 : cluster [DBG] 6.2b scrub starts 2024-02-10T08:42:02.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:42:01.170398+0000 mon.a (mon.0) 1956 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]': finished 2024-02-10T08:42:02.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:01.170480+0000 mon.a (mon.0) 1957 : cluster [DBG] osdmap e489: 8 total, 8 up, 8 in 2024-02-10T08:42:02.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:01.170989+0000 osd.5 (osd.5) 335 : cluster [DBG] 6.2b scrub ok 2024-02-10T08:42:02.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:01.238459+0000 mgr.y (mgr.14505) 943 : cluster [DBG] pgmap v1170: 162 pgs: 24 peering, 138 active+clean; 5.7 KiB data, 6.5 GiB used, 709 GiB / 715 GiB avail; 199 B/s rd, 0 op/s 2024-02-10T08:42:02.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:42:01.697874+0000 mon.a (mon.0) 1958 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:42:03.184 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:01.504206+0000 osd.3 (osd.3) 125 : cluster [DBG] 4.1d scrub starts 2024-02-10T08:42:03.184 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:01.506253+0000 osd.3 (osd.3) 126 : cluster [DBG] 4.1d scrub ok 2024-02-10T08:42:03.184 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:01.879672+0000 osd.1 (osd.1) 359 : cluster [DBG] 4.7 scrub starts 2024-02-10T08:42:03.184 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:01.883274+0000 osd.1 (osd.1) 360 : cluster [DBG] 4.7 scrub ok 2024-02-10T08:42:03.184 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:02.713914+0000 osd.0 (osd.0) 318 : cluster [DBG] 6.7 scrub starts 2024-02-10T08:42:03.185 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:02.777213+0000 osd.0 (osd.0) 319 : cluster [DBG] 6.7 scrub ok 2024-02-10T08:42:03.435 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:01.504206+0000 osd.3 (osd.3) 125 : cluster [DBG] 4.1d scrub starts 2024-02-10T08:42:03.436 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:01.506253+0000 osd.3 (osd.3) 126 : cluster [DBG] 4.1d scrub ok 2024-02-10T08:42:03.436 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:01.879672+0000 osd.1 (osd.1) 359 : cluster [DBG] 4.7 scrub starts 2024-02-10T08:42:03.436 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:01.883274+0000 osd.1 (osd.1) 360 : cluster [DBG] 4.7 scrub ok 2024-02-10T08:42:03.436 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:02.713914+0000 osd.0 (osd.0) 318 : cluster [DBG] 6.7 scrub starts 2024-02-10T08:42:03.436 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:02.777213+0000 osd.0 (osd.0) 319 : cluster [DBG] 6.7 scrub ok 2024-02-10T08:42:03.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:01.504206+0000 osd.3 (osd.3) 125 : cluster [DBG] 4.1d scrub starts 2024-02-10T08:42:03.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:01.506253+0000 osd.3 (osd.3) 126 : cluster [DBG] 4.1d scrub ok 2024-02-10T08:42:03.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:01.879672+0000 osd.1 (osd.1) 359 : cluster [DBG] 4.7 scrub starts 2024-02-10T08:42:03.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:01.883274+0000 osd.1 (osd.1) 360 : cluster [DBG] 4.7 scrub ok 2024-02-10T08:42:03.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:02.713914+0000 osd.0 (osd.0) 318 : cluster [DBG] 6.7 scrub starts 2024-02-10T08:42:03.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:02.777213+0000 osd.0 (osd.0) 319 : cluster [DBG] 6.7 scrub ok 2024-02-10T08:42:04.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:03.083352+0000 osd.5 (osd.5) 336 : cluster [DBG] 2.18 scrub starts 2024-02-10T08:42:04.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:03.086284+0000 osd.5 (osd.5) 337 : cluster [DBG] 2.18 scrub ok 2024-02-10T08:42:04.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:03.239278+0000 mgr.y (mgr.14505) 944 : cluster [DBG] pgmap v1171: 162 pgs: 162 active+clean; 5.7 KiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 1006 B/s rd, 0 op/s 2024-02-10T08:42:04.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:03.695162+0000 osd.0 (osd.0) 320 : cluster [DBG] 6.14 scrub starts 2024-02-10T08:42:04.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:03.696314+0000 osd.0 (osd.0) 321 : cluster [DBG] 6.14 scrub ok 2024-02-10T08:42:04.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:04.001536+0000 osd.4 (osd.4) 43 : cluster [DBG] 6.2c scrub starts 2024-02-10T08:42:04.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:04.004572+0000 osd.4 (osd.4) 44 : cluster [DBG] 6.2c scrub ok 2024-02-10T08:42:04.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:03.083352+0000 osd.5 (osd.5) 336 : cluster [DBG] 2.18 scrub starts 2024-02-10T08:42:04.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:03.086284+0000 osd.5 (osd.5) 337 : cluster [DBG] 2.18 scrub ok 2024-02-10T08:42:04.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:03.239278+0000 mgr.y (mgr.14505) 944 : cluster [DBG] pgmap v1171: 162 pgs: 162 active+clean; 5.7 KiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 1006 B/s rd, 0 op/s 2024-02-10T08:42:04.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:03.695162+0000 osd.0 (osd.0) 320 : cluster [DBG] 6.14 scrub starts 2024-02-10T08:42:04.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:03.696314+0000 osd.0 (osd.0) 321 : cluster [DBG] 6.14 scrub ok 2024-02-10T08:42:04.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:04.001536+0000 osd.4 (osd.4) 43 : cluster [DBG] 6.2c scrub starts 2024-02-10T08:42:04.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:04.004572+0000 osd.4 (osd.4) 44 : cluster [DBG] 6.2c scrub ok 2024-02-10T08:42:04.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:03.083352+0000 osd.5 (osd.5) 336 : cluster [DBG] 2.18 scrub starts 2024-02-10T08:42:04.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:03.086284+0000 osd.5 (osd.5) 337 : cluster [DBG] 2.18 scrub ok 2024-02-10T08:42:04.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:03.239278+0000 mgr.y (mgr.14505) 944 : cluster [DBG] pgmap v1171: 162 pgs: 162 active+clean; 5.7 KiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 1006 B/s rd, 0 op/s 2024-02-10T08:42:04.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:03.695162+0000 osd.0 (osd.0) 320 : cluster [DBG] 6.14 scrub starts 2024-02-10T08:42:04.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:03.696314+0000 osd.0 (osd.0) 321 : cluster [DBG] 6.14 scrub ok 2024-02-10T08:42:04.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:04.001536+0000 osd.4 (osd.4) 43 : cluster [DBG] 6.2c scrub starts 2024-02-10T08:42:04.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:04.004572+0000 osd.4 (osd.4) 44 : cluster [DBG] 6.2c scrub ok 2024-02-10T08:42:05.197 INFO:teuthology.orchestra.run.smithi018.stderr:set osd.5 primary-affinity to 1 (8655362) 2024-02-10T08:42:05.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:03.901275+0000 osd.1 (osd.1) 361 : cluster [DBG] 2.a scrub starts 2024-02-10T08:42:05.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:03.904457+0000 osd.1 (osd.1) 362 : cluster [DBG] 2.a scrub ok 2024-02-10T08:42:05.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:04.182106+0000 mon.a (mon.0) 1959 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 12 pgs inactive, 19 pgs peering) 2024-02-10T08:42:05.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:04.182154+0000 mon.a (mon.0) 1960 : cluster [INF] Cluster is now healthy 2024-02-10T08:42:05.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:42:04.642120+0000 mon.a (mon.0) 1961 : audit [INF] from='client.? 172.21.15.18:0/4118480866' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 5, "weight": 1.0}]: dispatch 2024-02-10T08:42:05.634 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:03.901275+0000 osd.1 (osd.1) 361 : cluster [DBG] 2.a scrub starts 2024-02-10T08:42:05.634 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:03.904457+0000 osd.1 (osd.1) 362 : cluster [DBG] 2.a scrub ok 2024-02-10T08:42:05.634 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:04.182106+0000 mon.a (mon.0) 1959 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 12 pgs inactive, 19 pgs peering) 2024-02-10T08:42:05.634 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:04.182154+0000 mon.a (mon.0) 1960 : cluster [INF] Cluster is now healthy 2024-02-10T08:42:05.634 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:42:04.642120+0000 mon.a (mon.0) 1961 : audit [INF] from='client.? 172.21.15.18:0/4118480866' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 5, "weight": 1.0}]: dispatch 2024-02-10T08:42:05.634 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:03.901275+0000 osd.1 (osd.1) 361 : cluster [DBG] 2.a scrub starts 2024-02-10T08:42:05.634 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:03.904457+0000 osd.1 (osd.1) 362 : cluster [DBG] 2.a scrub ok 2024-02-10T08:42:05.635 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:04.182106+0000 mon.a (mon.0) 1959 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 12 pgs inactive, 19 pgs peering) 2024-02-10T08:42:05.635 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:04.182154+0000 mon.a (mon.0) 1960 : cluster [INF] Cluster is now healthy 2024-02-10T08:42:05.635 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:42:04.642120+0000 mon.a (mon.0) 1961 : audit [INF] from='client.? 172.21.15.18:0/4118480866' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 5, "weight": 1.0}]: dispatch 2024-02-10T08:42:06.089 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd reweight 6 1 2024-02-10T08:42:06.380 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:42:06.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:04.454386+0000 osd.3 (osd.3) 127 : cluster [DBG] 4.17 deep-scrub starts 2024-02-10T08:42:06.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:04.456107+0000 osd.3 (osd.3) 128 : cluster [DBG] 4.17 deep-scrub ok 2024-02-10T08:42:06.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:04.866075+0000 osd.1 (osd.1) 363 : cluster [DBG] 6.4 scrub starts 2024-02-10T08:42:06.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:04.869039+0000 osd.1 (osd.1) 364 : cluster [DBG] 6.4 scrub ok 2024-02-10T08:42:06.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:42:05.192251+0000 mon.a (mon.0) 1962 : audit [INF] from='client.? 172.21.15.18:0/4118480866' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 5, "weight": 1.0}]': finished 2024-02-10T08:42:06.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:05.192344+0000 mon.a (mon.0) 1963 : cluster [DBG] osdmap e490: 8 total, 8 up, 8 in 2024-02-10T08:42:06.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:05.239625+0000 mgr.y (mgr.14505) 945 : cluster [DBG] pgmap v1173: 162 pgs: 162 active+clean; 5.7 KiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 721 B/s rd, 0 op/s 2024-02-10T08:42:06.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:05.296762+0000 osd.7 (osd.7) 37 : cluster [DBG] 6.12 scrub starts 2024-02-10T08:42:06.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:05.297786+0000 osd.7 (osd.7) 38 : cluster [DBG] 6.12 scrub ok 2024-02-10T08:42:06.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:05.672448+0000 osd.0 (osd.0) 322 : cluster [DBG] 4.b scrub starts 2024-02-10T08:42:06.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:05.674492+0000 osd.0 (osd.0) 323 : cluster [DBG] 4.b scrub ok 2024-02-10T08:42:06.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:04.454386+0000 osd.3 (osd.3) 127 : cluster [DBG] 4.17 deep-scrub starts 2024-02-10T08:42:06.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:04.456107+0000 osd.3 (osd.3) 128 : cluster [DBG] 4.17 deep-scrub ok 2024-02-10T08:42:06.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:04.866075+0000 osd.1 (osd.1) 363 : cluster [DBG] 6.4 scrub starts 2024-02-10T08:42:06.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:04.869039+0000 osd.1 (osd.1) 364 : cluster [DBG] 6.4 scrub ok 2024-02-10T08:42:06.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:42:05.192251+0000 mon.a (mon.0) 1962 : audit [INF] from='client.? 172.21.15.18:0/4118480866' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 5, "weight": 1.0}]': finished 2024-02-10T08:42:06.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:05.192344+0000 mon.a (mon.0) 1963 : cluster [DBG] osdmap e490: 8 total, 8 up, 8 in 2024-02-10T08:42:06.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:05.239625+0000 mgr.y (mgr.14505) 945 : cluster [DBG] pgmap v1173: 162 pgs: 162 active+clean; 5.7 KiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 721 B/s rd, 0 op/s 2024-02-10T08:42:06.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:05.296762+0000 osd.7 (osd.7) 37 : cluster [DBG] 6.12 scrub starts 2024-02-10T08:42:06.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:05.297786+0000 osd.7 (osd.7) 38 : cluster [DBG] 6.12 scrub ok 2024-02-10T08:42:06.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:05.672448+0000 osd.0 (osd.0) 322 : cluster [DBG] 4.b scrub starts 2024-02-10T08:42:06.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:05.674492+0000 osd.0 (osd.0) 323 : cluster [DBG] 4.b scrub ok 2024-02-10T08:42:06.516 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:04.454386+0000 osd.3 (osd.3) 127 : cluster [DBG] 4.17 deep-scrub starts 2024-02-10T08:42:06.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:04.456107+0000 osd.3 (osd.3) 128 : cluster [DBG] 4.17 deep-scrub ok 2024-02-10T08:42:06.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:04.866075+0000 osd.1 (osd.1) 363 : cluster [DBG] 6.4 scrub starts 2024-02-10T08:42:06.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:04.869039+0000 osd.1 (osd.1) 364 : cluster [DBG] 6.4 scrub ok 2024-02-10T08:42:06.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:42:05.192251+0000 mon.a (mon.0) 1962 : audit [INF] from='client.? 172.21.15.18:0/4118480866' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 5, "weight": 1.0}]': finished 2024-02-10T08:42:06.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:05.192344+0000 mon.a (mon.0) 1963 : cluster [DBG] osdmap e490: 8 total, 8 up, 8 in 2024-02-10T08:42:06.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:05.239625+0000 mgr.y (mgr.14505) 945 : cluster [DBG] pgmap v1173: 162 pgs: 162 active+clean; 5.7 KiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 721 B/s rd, 0 op/s 2024-02-10T08:42:06.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:05.296762+0000 osd.7 (osd.7) 37 : cluster [DBG] 6.12 scrub starts 2024-02-10T08:42:06.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:05.297786+0000 osd.7 (osd.7) 38 : cluster [DBG] 6.12 scrub ok 2024-02-10T08:42:06.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:05.672448+0000 osd.0 (osd.0) 322 : cluster [DBG] 4.b scrub starts 2024-02-10T08:42:06.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:05.674492+0000 osd.0 (osd.0) 323 : cluster [DBG] 4.b scrub ok 2024-02-10T08:42:06.789 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:42:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:42:06] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:42:07.404 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:42:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:42:07] "GET /metrics HTTP/1.1" 200 174099 "" "Prometheus/2.33.4" 2024-02-10T08:42:08.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:06.804199+0000 osd.1 (osd.1) 365 : cluster [DBG] 5.12 scrub starts 2024-02-10T08:42:08.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:06.807118+0000 osd.1 (osd.1) 366 : cluster [DBG] 5.12 scrub ok 2024-02-10T08:42:08.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:07.240309+0000 mgr.y (mgr.14505) 946 : cluster [DBG] pgmap v1174: 162 pgs: 162 active+clean; 5.7 KiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-10T08:42:08.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:07.246664+0000 osd.7 (osd.7) 39 : cluster [DBG] 6.5 scrub starts 2024-02-10T08:42:08.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:07.269926+0000 osd.7 (osd.7) 40 : cluster [DBG] 6.5 scrub ok 2024-02-10T08:42:08.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:07.741809+0000 osd.0 (osd.0) 324 : cluster [DBG] 6.18 scrub starts 2024-02-10T08:42:08.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:07.745085+0000 osd.0 (osd.0) 325 : cluster [DBG] 6.18 scrub ok 2024-02-10T08:42:08.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:07.985768+0000 osd.4 (osd.4) 45 : cluster [DBG] 6.2a deep-scrub starts 2024-02-10T08:42:08.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:07.989262+0000 osd.4 (osd.4) 46 : cluster [DBG] 6.2a deep-scrub ok 2024-02-10T08:42:08.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:06.804199+0000 osd.1 (osd.1) 365 : cluster [DBG] 5.12 scrub starts 2024-02-10T08:42:08.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:06.807118+0000 osd.1 (osd.1) 366 : cluster [DBG] 5.12 scrub ok 2024-02-10T08:42:08.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:07.240309+0000 mgr.y (mgr.14505) 946 : cluster [DBG] pgmap v1174: 162 pgs: 162 active+clean; 5.7 KiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-10T08:42:08.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:07.246664+0000 osd.7 (osd.7) 39 : cluster [DBG] 6.5 scrub starts 2024-02-10T08:42:08.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:07.269926+0000 osd.7 (osd.7) 40 : cluster [DBG] 6.5 scrub ok 2024-02-10T08:42:08.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:07.741809+0000 osd.0 (osd.0) 324 : cluster [DBG] 6.18 scrub starts 2024-02-10T08:42:08.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:07.745085+0000 osd.0 (osd.0) 325 : cluster [DBG] 6.18 scrub ok 2024-02-10T08:42:08.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:07.985768+0000 osd.4 (osd.4) 45 : cluster [DBG] 6.2a deep-scrub starts 2024-02-10T08:42:08.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:07.989262+0000 osd.4 (osd.4) 46 : cluster [DBG] 6.2a deep-scrub ok 2024-02-10T08:42:08.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:06.804199+0000 osd.1 (osd.1) 365 : cluster [DBG] 5.12 scrub starts 2024-02-10T08:42:08.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:06.807118+0000 osd.1 (osd.1) 366 : cluster [DBG] 5.12 scrub ok 2024-02-10T08:42:08.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:07.240309+0000 mgr.y (mgr.14505) 946 : cluster [DBG] pgmap v1174: 162 pgs: 162 active+clean; 5.7 KiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-10T08:42:08.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:07.246664+0000 osd.7 (osd.7) 39 : cluster [DBG] 6.5 scrub starts 2024-02-10T08:42:08.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:07.269926+0000 osd.7 (osd.7) 40 : cluster [DBG] 6.5 scrub ok 2024-02-10T08:42:08.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:07.741809+0000 osd.0 (osd.0) 324 : cluster [DBG] 6.18 scrub starts 2024-02-10T08:42:08.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:07.745085+0000 osd.0 (osd.0) 325 : cluster [DBG] 6.18 scrub ok 2024-02-10T08:42:08.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:07.985768+0000 osd.4 (osd.4) 45 : cluster [DBG] 6.2a deep-scrub starts 2024-02-10T08:42:08.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:07.989262+0000 osd.4 (osd.4) 46 : cluster [DBG] 6.2a deep-scrub ok 2024-02-10T08:42:09.304 INFO:teuthology.orchestra.run.smithi018.stderr:reweighted osd.6 to 1 (10000) 2024-02-10T08:42:09.539 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:42:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:42:09.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:07.442525+0000 osd.3 (osd.3) 129 : cluster [DBG] 4.11 scrub starts 2024-02-10T08:42:09.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:07.445987+0000 osd.3 (osd.3) 130 : cluster [DBG] 4.11 scrub ok 2024-02-10T08:42:09.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:07.772741+0000 osd.1 (osd.1) 367 : cluster [DBG] 6.20 scrub starts 2024-02-10T08:42:09.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:07.775724+0000 osd.1 (osd.1) 368 : cluster [DBG] 6.20 scrub ok 2024-02-10T08:42:09.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:08.241614+0000 osd.7 (osd.7) 41 : cluster [DBG] 6.8 scrub starts 2024-02-10T08:42:09.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:08.243013+0000 osd.7 (osd.7) 42 : cluster [DBG] 6.8 scrub ok 2024-02-10T08:42:09.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:08.480510+0000 osd.2 (osd.2) 303 : cluster [DBG] 2.10 scrub starts 2024-02-10T08:42:09.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:08.482089+0000 osd.2 (osd.2) 304 : cluster [DBG] 2.10 scrub ok 2024-02-10T08:42:09.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:42:08.552525+0000 mon.a (mon.0) 1964 : audit [INF] from='client.? 172.21.15.18:0/1148459070' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]: dispatch 2024-02-10T08:42:09.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:08.744534+0000 osd.0 (osd.0) 326 : cluster [DBG] 6.9 scrub starts 2024-02-10T08:42:09.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:08.766298+0000 osd.0 (osd.0) 327 : cluster [DBG] 6.9 scrub ok 2024-02-10T08:42:09.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:07.442525+0000 osd.3 (osd.3) 129 : cluster [DBG] 4.11 scrub starts 2024-02-10T08:42:09.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:07.445987+0000 osd.3 (osd.3) 130 : cluster [DBG] 4.11 scrub ok 2024-02-10T08:42:09.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:07.772741+0000 osd.1 (osd.1) 367 : cluster [DBG] 6.20 scrub starts 2024-02-10T08:42:09.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:07.775724+0000 osd.1 (osd.1) 368 : cluster [DBG] 6.20 scrub ok 2024-02-10T08:42:09.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:08.241614+0000 osd.7 (osd.7) 41 : cluster [DBG] 6.8 scrub starts 2024-02-10T08:42:09.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:08.243013+0000 osd.7 (osd.7) 42 : cluster [DBG] 6.8 scrub ok 2024-02-10T08:42:09.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:08.480510+0000 osd.2 (osd.2) 303 : cluster [DBG] 2.10 scrub starts 2024-02-10T08:42:09.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:08.482089+0000 osd.2 (osd.2) 304 : cluster [DBG] 2.10 scrub ok 2024-02-10T08:42:09.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:42:08.552525+0000 mon.a (mon.0) 1964 : audit [INF] from='client.? 172.21.15.18:0/1148459070' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]: dispatch 2024-02-10T08:42:09.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:08.744534+0000 osd.0 (osd.0) 326 : cluster [DBG] 6.9 scrub starts 2024-02-10T08:42:09.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:08.766298+0000 osd.0 (osd.0) 327 : cluster [DBG] 6.9 scrub ok 2024-02-10T08:42:09.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:07.442525+0000 osd.3 (osd.3) 129 : cluster [DBG] 4.11 scrub starts 2024-02-10T08:42:09.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:07.445987+0000 osd.3 (osd.3) 130 : cluster [DBG] 4.11 scrub ok 2024-02-10T08:42:09.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:07.772741+0000 osd.1 (osd.1) 367 : cluster [DBG] 6.20 scrub starts 2024-02-10T08:42:09.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:07.775724+0000 osd.1 (osd.1) 368 : cluster [DBG] 6.20 scrub ok 2024-02-10T08:42:09.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:08.241614+0000 osd.7 (osd.7) 41 : cluster [DBG] 6.8 scrub starts 2024-02-10T08:42:09.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:08.243013+0000 osd.7 (osd.7) 42 : cluster [DBG] 6.8 scrub ok 2024-02-10T08:42:09.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:08.480510+0000 osd.2 (osd.2) 303 : cluster [DBG] 2.10 scrub starts 2024-02-10T08:42:09.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:08.482089+0000 osd.2 (osd.2) 304 : cluster [DBG] 2.10 scrub ok 2024-02-10T08:42:09.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:42:08.552525+0000 mon.a (mon.0) 1964 : audit [INF] from='client.? 172.21.15.18:0/1148459070' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]: dispatch 2024-02-10T08:42:09.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:08.744534+0000 osd.0 (osd.0) 326 : cluster [DBG] 6.9 scrub starts 2024-02-10T08:42:09.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:08.766298+0000 osd.0 (osd.0) 327 : cluster [DBG] 6.9 scrub ok 2024-02-10T08:42:10.064 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd primary-affinity 6 1 2024-02-10T08:42:10.306 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:08.806498+0000 osd.1 (osd.1) 369 : cluster [DBG] 1.3 scrub starts 2024-02-10T08:42:10.307 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:08.809603+0000 osd.1 (osd.1) 370 : cluster [DBG] 1.3 scrub ok 2024-02-10T08:42:10.307 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:42:09.142706+0000 mgr.y (mgr.14505) 947 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:42:10.307 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:09.241131+0000 mgr.y (mgr.14505) 948 : cluster [DBG] pgmap v1175: 162 pgs: 162 active+clean; 5.7 KiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:42:10.307 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:42:09.299502+0000 mon.a (mon.0) 1965 : audit [INF] from='client.? 172.21.15.18:0/1148459070' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]': finished 2024-02-10T08:42:10.307 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:09.299624+0000 mon.a (mon.0) 1966 : cluster [DBG] osdmap e491: 8 total, 8 up, 8 in 2024-02-10T08:42:10.307 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:09.529656+0000 osd.2 (osd.2) 305 : cluster [DBG] 5.b scrub starts 2024-02-10T08:42:10.307 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:09.530799+0000 osd.2 (osd.2) 306 : cluster [DBG] 5.b scrub ok 2024-02-10T08:42:10.353 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:42:10.617 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:08.806498+0000 osd.1 (osd.1) 369 : cluster [DBG] 1.3 scrub starts 2024-02-10T08:42:10.617 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:08.809603+0000 osd.1 (osd.1) 370 : cluster [DBG] 1.3 scrub ok 2024-02-10T08:42:10.617 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:42:09.142706+0000 mgr.y (mgr.14505) 947 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:42:10.617 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:09.241131+0000 mgr.y (mgr.14505) 948 : cluster [DBG] pgmap v1175: 162 pgs: 162 active+clean; 5.7 KiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:42:10.618 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:42:09.299502+0000 mon.a (mon.0) 1965 : audit [INF] from='client.? 172.21.15.18:0/1148459070' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]': finished 2024-02-10T08:42:10.618 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:09.299624+0000 mon.a (mon.0) 1966 : cluster [DBG] osdmap e491: 8 total, 8 up, 8 in 2024-02-10T08:42:10.618 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:09.529656+0000 osd.2 (osd.2) 305 : cluster [DBG] 5.b scrub starts 2024-02-10T08:42:10.618 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:09.530799+0000 osd.2 (osd.2) 306 : cluster [DBG] 5.b scrub ok 2024-02-10T08:42:10.618 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:09.699557+0000 osd.0 (osd.0) 328 : cluster [DBG] 4.12 scrub starts 2024-02-10T08:42:10.618 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:09.700797+0000 osd.0 (osd.0) 329 : cluster [DBG] 4.12 scrub ok 2024-02-10T08:42:10.618 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:09.997126+0000 osd.4 (osd.4) 47 : cluster [DBG] 6.32 deep-scrub starts 2024-02-10T08:42:10.618 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:10.000145+0000 osd.4 (osd.4) 48 : cluster [DBG] 6.32 deep-scrub ok 2024-02-10T08:42:10.618 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:09.699557+0000 osd.0 (osd.0) 328 : cluster [DBG] 4.12 scrub starts 2024-02-10T08:42:10.619 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:09.700797+0000 osd.0 (osd.0) 329 : cluster [DBG] 4.12 scrub ok 2024-02-10T08:42:10.619 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:09.997126+0000 osd.4 (osd.4) 47 : cluster [DBG] 6.32 deep-scrub starts 2024-02-10T08:42:10.619 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:10.000145+0000 osd.4 (osd.4) 48 : cluster [DBG] 6.32 deep-scrub ok 2024-02-10T08:42:10.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:08.806498+0000 osd.1 (osd.1) 369 : cluster [DBG] 1.3 scrub starts 2024-02-10T08:42:10.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:08.809603+0000 osd.1 (osd.1) 370 : cluster [DBG] 1.3 scrub ok 2024-02-10T08:42:10.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:42:09.142706+0000 mgr.y (mgr.14505) 947 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:42:10.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:09.241131+0000 mgr.y (mgr.14505) 948 : cluster [DBG] pgmap v1175: 162 pgs: 162 active+clean; 5.7 KiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:42:10.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:42:09.299502+0000 mon.a (mon.0) 1965 : audit [INF] from='client.? 172.21.15.18:0/1148459070' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]': finished 2024-02-10T08:42:10.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:09.299624+0000 mon.a (mon.0) 1966 : cluster [DBG] osdmap e491: 8 total, 8 up, 8 in 2024-02-10T08:42:10.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:09.529656+0000 osd.2 (osd.2) 305 : cluster [DBG] 5.b scrub starts 2024-02-10T08:42:10.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:09.530799+0000 osd.2 (osd.2) 306 : cluster [DBG] 5.b scrub ok 2024-02-10T08:42:10.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:09.699557+0000 osd.0 (osd.0) 328 : cluster [DBG] 4.12 scrub starts 2024-02-10T08:42:10.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:09.700797+0000 osd.0 (osd.0) 329 : cluster [DBG] 4.12 scrub ok 2024-02-10T08:42:10.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:09.997126+0000 osd.4 (osd.4) 47 : cluster [DBG] 6.32 deep-scrub starts 2024-02-10T08:42:10.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:10.000145+0000 osd.4 (osd.4) 48 : cluster [DBG] 6.32 deep-scrub ok 2024-02-10T08:42:11.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:09.479013+0000 osd.3 (osd.3) 131 : cluster [DBG] 6.b scrub starts 2024-02-10T08:42:11.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:09.579251+0000 osd.3 (osd.3) 132 : cluster [DBG] 6.b scrub ok 2024-02-10T08:42:11.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:10.194876+0000 osd.7 (osd.7) 43 : cluster [DBG] 1.2 scrub starts 2024-02-10T08:42:11.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:10.195901+0000 osd.7 (osd.7) 44 : cluster [DBG] 1.2 scrub ok 2024-02-10T08:42:11.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:10.728651+0000 osd.0 (osd.0) 330 : cluster [DBG] 4.1e scrub starts 2024-02-10T08:42:11.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:10.732117+0000 osd.0 (osd.0) 331 : cluster [DBG] 4.1e scrub ok 2024-02-10T08:42:11.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:11.011469+0000 osd.4 (osd.4) 49 : cluster [DBG] 6.e scrub starts 2024-02-10T08:42:11.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:11.012751+0000 osd.4 (osd.4) 50 : cluster [DBG] 6.e scrub ok 2024-02-10T08:42:11.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:11.120370+0000 mon.a (mon.0) 1967 : cluster [DBG] osdmap e492: 8 total, 8 up, 8 in 2024-02-10T08:42:11.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:09.479013+0000 osd.3 (osd.3) 131 : cluster [DBG] 6.b scrub starts 2024-02-10T08:42:11.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:09.579251+0000 osd.3 (osd.3) 132 : cluster [DBG] 6.b scrub ok 2024-02-10T08:42:11.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:10.194876+0000 osd.7 (osd.7) 43 : cluster [DBG] 1.2 scrub starts 2024-02-10T08:42:11.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:10.195901+0000 osd.7 (osd.7) 44 : cluster [DBG] 1.2 scrub ok 2024-02-10T08:42:11.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:10.728651+0000 osd.0 (osd.0) 330 : cluster [DBG] 4.1e scrub starts 2024-02-10T08:42:11.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:10.732117+0000 osd.0 (osd.0) 331 : cluster [DBG] 4.1e scrub ok 2024-02-10T08:42:11.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:11.011469+0000 osd.4 (osd.4) 49 : cluster [DBG] 6.e scrub starts 2024-02-10T08:42:11.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:11.012751+0000 osd.4 (osd.4) 50 : cluster [DBG] 6.e scrub ok 2024-02-10T08:42:11.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:11.120370+0000 mon.a (mon.0) 1967 : cluster [DBG] osdmap e492: 8 total, 8 up, 8 in 2024-02-10T08:42:11.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:09.479013+0000 osd.3 (osd.3) 131 : cluster [DBG] 6.b scrub starts 2024-02-10T08:42:11.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:09.579251+0000 osd.3 (osd.3) 132 : cluster [DBG] 6.b scrub ok 2024-02-10T08:42:11.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:10.194876+0000 osd.7 (osd.7) 43 : cluster [DBG] 1.2 scrub starts 2024-02-10T08:42:11.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:10.195901+0000 osd.7 (osd.7) 44 : cluster [DBG] 1.2 scrub ok 2024-02-10T08:42:11.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:10.728651+0000 osd.0 (osd.0) 330 : cluster [DBG] 4.1e scrub starts 2024-02-10T08:42:11.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:10.732117+0000 osd.0 (osd.0) 331 : cluster [DBG] 4.1e scrub ok 2024-02-10T08:42:11.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:11.011469+0000 osd.4 (osd.4) 49 : cluster [DBG] 6.e scrub starts 2024-02-10T08:42:11.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:11.012751+0000 osd.4 (osd.4) 50 : cluster [DBG] 6.e scrub ok 2024-02-10T08:42:11.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:11.120370+0000 mon.a (mon.0) 1967 : cluster [DBG] osdmap e492: 8 total, 8 up, 8 in 2024-02-10T08:42:12.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:11.241528+0000 mgr.y (mgr.14505) 949 : cluster [DBG] pgmap v1178: 162 pgs: 162 active+clean; 5.7 KiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 845 B/s rd, 0 op/s 2024-02-10T08:42:12.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:11.576175+0000 osd.2 (osd.2) 307 : cluster [DBG] 2.e scrub starts 2024-02-10T08:42:12.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:11.577879+0000 osd.2 (osd.2) 308 : cluster [DBG] 2.e scrub ok 2024-02-10T08:42:12.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:11.761210+0000 osd.0 (osd.0) 332 : cluster [DBG] 5.3 scrub starts 2024-02-10T08:42:12.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:11.763158+0000 osd.0 (osd.0) 333 : cluster [DBG] 5.3 scrub ok 2024-02-10T08:42:12.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:11.241528+0000 mgr.y (mgr.14505) 949 : cluster [DBG] pgmap v1178: 162 pgs: 162 active+clean; 5.7 KiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 845 B/s rd, 0 op/s 2024-02-10T08:42:12.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:11.576175+0000 osd.2 (osd.2) 307 : cluster [DBG] 2.e scrub starts 2024-02-10T08:42:12.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:11.577879+0000 osd.2 (osd.2) 308 : cluster [DBG] 2.e scrub ok 2024-02-10T08:42:12.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:11.761210+0000 osd.0 (osd.0) 332 : cluster [DBG] 5.3 scrub starts 2024-02-10T08:42:12.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:11.763158+0000 osd.0 (osd.0) 333 : cluster [DBG] 5.3 scrub ok 2024-02-10T08:42:12.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:11.241528+0000 mgr.y (mgr.14505) 949 : cluster [DBG] pgmap v1178: 162 pgs: 162 active+clean; 5.7 KiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 845 B/s rd, 0 op/s 2024-02-10T08:42:12.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:11.576175+0000 osd.2 (osd.2) 307 : cluster [DBG] 2.e scrub starts 2024-02-10T08:42:12.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:11.577879+0000 osd.2 (osd.2) 308 : cluster [DBG] 2.e scrub ok 2024-02-10T08:42:12.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:11.761210+0000 osd.0 (osd.0) 332 : cluster [DBG] 5.3 scrub starts 2024-02-10T08:42:12.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:11.763158+0000 osd.0 (osd.0) 333 : cluster [DBG] 5.3 scrub ok 2024-02-10T08:42:13.325 INFO:teuthology.orchestra.run.smithi018.stderr:set osd.6 primary-affinity to 1 (8655362) 2024-02-10T08:42:13.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:11.935143+0000 osd.7 (osd.7) 45 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:42:13.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:11.935289+0000 osd.7 (osd.7) 46 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:42:13.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:12.132566+0000 osd.6 (osd.6) 325 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:42:13.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:12.132658+0000 osd.6 (osd.6) 326 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:42:13.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:12.314291+0000 mon.a (mon.0) 1968 : cluster [DBG] osdmap e493: 8 total, 8 up, 8 in 2024-02-10T08:42:13.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:42:12.561730+0000 mon.a (mon.0) 1969 : audit [INF] from='client.? 172.21.15.18:0/670947406' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 6, "weight": 1.0}]: dispatch 2024-02-10T08:42:13.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:11.935143+0000 osd.7 (osd.7) 45 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:42:13.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:11.935289+0000 osd.7 (osd.7) 46 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:42:13.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:12.132566+0000 osd.6 (osd.6) 325 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:42:13.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:12.132658+0000 osd.6 (osd.6) 326 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:42:13.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:12.314291+0000 mon.a (mon.0) 1968 : cluster [DBG] osdmap e493: 8 total, 8 up, 8 in 2024-02-10T08:42:13.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:42:12.561730+0000 mon.a (mon.0) 1969 : audit [INF] from='client.? 172.21.15.18:0/670947406' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 6, "weight": 1.0}]: dispatch 2024-02-10T08:42:13.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:11.935143+0000 osd.7 (osd.7) 45 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:42:13.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:11.935289+0000 osd.7 (osd.7) 46 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:42:13.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:12.132566+0000 osd.6 (osd.6) 325 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:42:13.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:12.132658+0000 osd.6 (osd.6) 326 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:42:13.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:12.314291+0000 mon.a (mon.0) 1968 : cluster [DBG] osdmap e493: 8 total, 8 up, 8 in 2024-02-10T08:42:13.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:42:12.561730+0000 mon.a (mon.0) 1969 : audit [INF] from='client.? 172.21.15.18:0/670947406' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 6, "weight": 1.0}]: dispatch 2024-02-10T08:42:14.180 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd reweight 7 1 2024-02-10T08:42:14.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:13.242323+0000 mgr.y (mgr.14505) 950 : cluster [DBG] pgmap v1180: 162 pgs: 162 active+clean; 5.7 KiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-02-10T08:42:14.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:13.263681+0000 osd.7 (osd.7) 47 : cluster [DBG] 6.29 deep-scrub starts 2024-02-10T08:42:14.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:13.289088+0000 osd.7 (osd.7) 48 : cluster [DBG] 6.29 deep-scrub ok 2024-02-10T08:42:14.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:42:13.320087+0000 mon.a (mon.0) 1970 : audit [INF] from='client.? 172.21.15.18:0/670947406' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 6, "weight": 1.0}]': finished 2024-02-10T08:42:14.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:13.320176+0000 mon.a (mon.0) 1971 : cluster [DBG] osdmap e494: 8 total, 8 up, 8 in 2024-02-10T08:42:14.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:13.414505+0000 osd.6 (osd.6) 327 : cluster [DBG] 2.7 deep-scrub starts 2024-02-10T08:42:14.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:13.417472+0000 osd.6 (osd.6) 328 : cluster [DBG] 2.7 deep-scrub ok 2024-02-10T08:42:14.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:13.242323+0000 mgr.y (mgr.14505) 950 : cluster [DBG] pgmap v1180: 162 pgs: 162 active+clean; 5.7 KiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-02-10T08:42:14.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:13.263681+0000 osd.7 (osd.7) 47 : cluster [DBG] 6.29 deep-scrub starts 2024-02-10T08:42:14.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:13.289088+0000 osd.7 (osd.7) 48 : cluster [DBG] 6.29 deep-scrub ok 2024-02-10T08:42:14.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:42:13.320087+0000 mon.a (mon.0) 1970 : audit [INF] from='client.? 172.21.15.18:0/670947406' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 6, "weight": 1.0}]': finished 2024-02-10T08:42:14.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:13.320176+0000 mon.a (mon.0) 1971 : cluster [DBG] osdmap e494: 8 total, 8 up, 8 in 2024-02-10T08:42:14.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:13.414505+0000 osd.6 (osd.6) 327 : cluster [DBG] 2.7 deep-scrub starts 2024-02-10T08:42:14.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:13.417472+0000 osd.6 (osd.6) 328 : cluster [DBG] 2.7 deep-scrub ok 2024-02-10T08:42:14.476 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:42:14.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:13.242323+0000 mgr.y (mgr.14505) 950 : cluster [DBG] pgmap v1180: 162 pgs: 162 active+clean; 5.7 KiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-02-10T08:42:14.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:13.263681+0000 osd.7 (osd.7) 47 : cluster [DBG] 6.29 deep-scrub starts 2024-02-10T08:42:14.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:13.289088+0000 osd.7 (osd.7) 48 : cluster [DBG] 6.29 deep-scrub ok 2024-02-10T08:42:14.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:42:13.320087+0000 mon.a (mon.0) 1970 : audit [INF] from='client.? 172.21.15.18:0/670947406' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 6, "weight": 1.0}]': finished 2024-02-10T08:42:14.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:13.320176+0000 mon.a (mon.0) 1971 : cluster [DBG] osdmap e494: 8 total, 8 up, 8 in 2024-02-10T08:42:14.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:13.414505+0000 osd.6 (osd.6) 327 : cluster [DBG] 2.7 deep-scrub starts 2024-02-10T08:42:14.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:13.417472+0000 osd.6 (osd.6) 328 : cluster [DBG] 2.7 deep-scrub ok 2024-02-10T08:42:15.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:14.320107+0000 mon.a (mon.0) 1972 : cluster [DBG] osdmap e495: 8 total, 8 up, 8 in 2024-02-10T08:42:15.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:14.372975+0000 osd.6 (osd.6) 329 : cluster [DBG] 6.27 scrub starts 2024-02-10T08:42:15.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:14.513231+0000 osd.6 (osd.6) 330 : cluster [DBG] 6.27 scrub ok 2024-02-10T08:42:15.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:14.320107+0000 mon.a (mon.0) 1972 : cluster [DBG] osdmap e495: 8 total, 8 up, 8 in 2024-02-10T08:42:15.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:14.372975+0000 osd.6 (osd.6) 329 : cluster [DBG] 6.27 scrub starts 2024-02-10T08:42:15.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:14.513231+0000 osd.6 (osd.6) 330 : cluster [DBG] 6.27 scrub ok 2024-02-10T08:42:15.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:14.320107+0000 mon.a (mon.0) 1972 : cluster [DBG] osdmap e495: 8 total, 8 up, 8 in 2024-02-10T08:42:15.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:14.372975+0000 osd.6 (osd.6) 329 : cluster [DBG] 6.27 scrub starts 2024-02-10T08:42:15.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:14.513231+0000 osd.6 (osd.6) 330 : cluster [DBG] 6.27 scrub ok 2024-02-10T08:42:16.331 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:15.242688+0000 mgr.y (mgr.14505) 951 : cluster [DBG] pgmap v1183: 162 pgs: 162 active+clean; 5.7 KiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:42:16.331 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:15.430141+0000 osd.3 (osd.3) 133 : cluster [DBG] 6.13 scrub starts 2024-02-10T08:42:16.331 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:15.463795+0000 osd.1 (osd.1) 371 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:42:16.331 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:15.463854+0000 osd.1 (osd.1) 372 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:42:16.331 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:15.500706+0000 osd.3 (osd.3) 134 : cluster [DBG] 6.13 scrub ok 2024-02-10T08:42:16.331 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:16.122231+0000 mon.a (mon.0) 1973 : cluster [DBG] osdmap e496: 8 total, 8 up, 8 in 2024-02-10T08:42:16.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:15.242688+0000 mgr.y (mgr.14505) 951 : cluster [DBG] pgmap v1183: 162 pgs: 162 active+clean; 5.7 KiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:42:16.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:15.430141+0000 osd.3 (osd.3) 133 : cluster [DBG] 6.13 scrub starts 2024-02-10T08:42:16.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:15.463795+0000 osd.1 (osd.1) 371 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:42:16.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:15.463854+0000 osd.1 (osd.1) 372 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:42:16.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:15.500706+0000 osd.3 (osd.3) 134 : cluster [DBG] 6.13 scrub ok 2024-02-10T08:42:16.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:16.122231+0000 mon.a (mon.0) 1973 : cluster [DBG] osdmap e496: 8 total, 8 up, 8 in 2024-02-10T08:42:16.789 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:42:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:42:16] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:42:16.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:15.242688+0000 mgr.y (mgr.14505) 951 : cluster [DBG] pgmap v1183: 162 pgs: 162 active+clean; 5.7 KiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:42:16.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:15.430141+0000 osd.3 (osd.3) 133 : cluster [DBG] 6.13 scrub starts 2024-02-10T08:42:16.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:15.463795+0000 osd.1 (osd.1) 371 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:42:16.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:15.463854+0000 osd.1 (osd.1) 372 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:42:16.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:15.500706+0000 osd.3 (osd.3) 134 : cluster [DBG] 6.13 scrub ok 2024-02-10T08:42:16.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:16.122231+0000 mon.a (mon.0) 1973 : cluster [DBG] osdmap e496: 8 total, 8 up, 8 in 2024-02-10T08:42:17.404 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:42:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:42:17] "GET /metrics HTTP/1.1" 200 174123 "" "Prometheus/2.33.4" 2024-02-10T08:42:17.706 INFO:teuthology.orchestra.run.smithi018.stderr:reweighted osd.7 to 1 (10000) 2024-02-10T08:42:18.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:42:16.698151+0000 mon.a (mon.0) 1974 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:42:18.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:16.829517+0000 osd.0 (osd.0) 334 : cluster [DBG] 5.1e scrub starts 2024-02-10T08:42:18.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:16.832689+0000 osd.0 (osd.0) 335 : cluster [DBG] 5.1e scrub ok 2024-02-10T08:42:18.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:42:16.846274+0000 mon.c (mon.2) 117 : audit [INF] from='client.? 172.21.15.18:0/1213001294' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]: dispatch 2024-02-10T08:42:18.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:42:16.846601+0000 mon.a (mon.0) 1975 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]: dispatch 2024-02-10T08:42:18.109 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:42:16.698151+0000 mon.a (mon.0) 1974 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:42:18.109 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:16.829517+0000 osd.0 (osd.0) 334 : cluster [DBG] 5.1e scrub starts 2024-02-10T08:42:18.109 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:16.832689+0000 osd.0 (osd.0) 335 : cluster [DBG] 5.1e scrub ok 2024-02-10T08:42:18.109 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:42:16.846274+0000 mon.c (mon.2) 117 : audit [INF] from='client.? 172.21.15.18:0/1213001294' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]: dispatch 2024-02-10T08:42:18.109 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:42:16.846601+0000 mon.a (mon.0) 1975 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]: dispatch 2024-02-10T08:42:18.109 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:42:16.698151+0000 mon.a (mon.0) 1974 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:42:18.110 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:16.829517+0000 osd.0 (osd.0) 334 : cluster [DBG] 5.1e scrub starts 2024-02-10T08:42:18.110 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:16.832689+0000 osd.0 (osd.0) 335 : cluster [DBG] 5.1e scrub ok 2024-02-10T08:42:18.110 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:42:16.846274+0000 mon.c (mon.2) 117 : audit [INF] from='client.? 172.21.15.18:0/1213001294' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]: dispatch 2024-02-10T08:42:18.110 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:42:16.846601+0000 mon.a (mon.0) 1975 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]: dispatch 2024-02-10T08:42:18.590 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd primary-affinity 7 1 2024-02-10T08:42:18.876 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:42:18.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:17.243295+0000 mgr.y (mgr.14505) 952 : cluster [DBG] pgmap v1185: 162 pgs: 162 active+clean; 5.7 KiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-02-10T08:42:18.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:17.356717+0000 osd.6 (osd.6) 331 : cluster [DBG] 1.7 scrub starts 2024-02-10T08:42:18.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:17.359861+0000 osd.6 (osd.6) 332 : cluster [DBG] 1.7 scrub ok 2024-02-10T08:42:18.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:42:17.700244+0000 mon.a (mon.0) 1976 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]': finished 2024-02-10T08:42:18.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:17.700313+0000 mon.a (mon.0) 1977 : cluster [DBG] osdmap e497: 8 total, 8 up, 8 in 2024-02-10T08:42:18.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:17.243295+0000 mgr.y (mgr.14505) 952 : cluster [DBG] pgmap v1185: 162 pgs: 162 active+clean; 5.7 KiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-02-10T08:42:18.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:17.356717+0000 osd.6 (osd.6) 331 : cluster [DBG] 1.7 scrub starts 2024-02-10T08:42:18.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:17.359861+0000 osd.6 (osd.6) 332 : cluster [DBG] 1.7 scrub ok 2024-02-10T08:42:18.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:42:17.700244+0000 mon.a (mon.0) 1976 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]': finished 2024-02-10T08:42:18.906 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:17.700313+0000 mon.a (mon.0) 1977 : cluster [DBG] osdmap e497: 8 total, 8 up, 8 in 2024-02-10T08:42:19.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:17.243295+0000 mgr.y (mgr.14505) 952 : cluster [DBG] pgmap v1185: 162 pgs: 162 active+clean; 5.7 KiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-02-10T08:42:19.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:17.356717+0000 osd.6 (osd.6) 331 : cluster [DBG] 1.7 scrub starts 2024-02-10T08:42:19.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:17.359861+0000 osd.6 (osd.6) 332 : cluster [DBG] 1.7 scrub ok 2024-02-10T08:42:19.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:42:17.700244+0000 mon.a (mon.0) 1976 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]': finished 2024-02-10T08:42:19.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:17.700313+0000 mon.a (mon.0) 1977 : cluster [DBG] osdmap e497: 8 total, 8 up, 8 in 2024-02-10T08:42:19.539 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:42:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:42:20.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:42:18.945531+0000 mon.a (mon.0) 1978 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2024-02-10T08:42:20.130 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:42:18.945531+0000 mon.a (mon.0) 1978 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2024-02-10T08:42:20.130 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:42:18.945531+0000 mon.a (mon.0) 1978 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2024-02-10T08:42:20.719 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:42:19.152739+0000 mgr.y (mgr.14505) 953 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:42:20.719 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:19.244056+0000 mgr.y (mgr.14505) 954 : cluster [DBG] pgmap v1187: 162 pgs: 162 active+clean; 5.7 KiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 863 B/s rd, 0 op/s 2024-02-10T08:42:20.720 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:19.440637+0000 osd.3 (osd.3) 135 : cluster [DBG] 1.4 scrub starts 2024-02-10T08:42:20.720 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:19.441624+0000 osd.3 (osd.3) 136 : cluster [DBG] 1.4 scrub ok 2024-02-10T08:42:20.720 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:42:19.713335+0000 mon.a (mon.0) 1979 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]': finished 2024-02-10T08:42:20.720 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:19.713390+0000 mon.a (mon.0) 1980 : cluster [DBG] osdmap e498: 8 total, 8 up, 8 in 2024-02-10T08:42:20.720 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:20.254733+0000 osd.7 (osd.7) 49 : cluster [DBG] 6.30 scrub starts 2024-02-10T08:42:20.720 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:20.256165+0000 osd.7 (osd.7) 50 : cluster [DBG] 6.30 scrub ok 2024-02-10T08:42:21.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:42:19.152739+0000 mgr.y (mgr.14505) 953 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:42:21.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:19.244056+0000 mgr.y (mgr.14505) 954 : cluster [DBG] pgmap v1187: 162 pgs: 162 active+clean; 5.7 KiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 863 B/s rd, 0 op/s 2024-02-10T08:42:21.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:19.440637+0000 osd.3 (osd.3) 135 : cluster [DBG] 1.4 scrub starts 2024-02-10T08:42:21.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:19.441624+0000 osd.3 (osd.3) 136 : cluster [DBG] 1.4 scrub ok 2024-02-10T08:42:21.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:42:19.713335+0000 mon.a (mon.0) 1979 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]': finished 2024-02-10T08:42:21.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:19.713390+0000 mon.a (mon.0) 1980 : cluster [DBG] osdmap e498: 8 total, 8 up, 8 in 2024-02-10T08:42:21.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:20.254733+0000 osd.7 (osd.7) 49 : cluster [DBG] 6.30 scrub starts 2024-02-10T08:42:21.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:20.256165+0000 osd.7 (osd.7) 50 : cluster [DBG] 6.30 scrub ok 2024-02-10T08:42:21.128 INFO:teuthology.orchestra.run.smithi018.stderr:set osd.7 primary-affinity to 1 (8655362) 2024-02-10T08:42:21.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:42:19.152739+0000 mgr.y (mgr.14505) 953 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:42:21.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:19.244056+0000 mgr.y (mgr.14505) 954 : cluster [DBG] pgmap v1187: 162 pgs: 162 active+clean; 5.7 KiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 863 B/s rd, 0 op/s 2024-02-10T08:42:21.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:19.440637+0000 osd.3 (osd.3) 135 : cluster [DBG] 1.4 scrub starts 2024-02-10T08:42:21.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:19.441624+0000 osd.3 (osd.3) 136 : cluster [DBG] 1.4 scrub ok 2024-02-10T08:42:21.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:42:19.713335+0000 mon.a (mon.0) 1979 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]': finished 2024-02-10T08:42:21.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:19.713390+0000 mon.a (mon.0) 1980 : cluster [DBG] osdmap e498: 8 total, 8 up, 8 in 2024-02-10T08:42:21.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:20.254733+0000 osd.7 (osd.7) 49 : cluster [DBG] 6.30 scrub starts 2024-02-10T08:42:21.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:20.256165+0000 osd.7 (osd.7) 50 : cluster [DBG] 6.30 scrub ok 2024-02-10T08:42:21.982 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:20.301238+0000 osd.6 (osd.6) 333 : cluster [DBG] 1.6 scrub starts 2024-02-10T08:42:21.982 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:20.304518+0000 osd.6 (osd.6) 334 : cluster [DBG] 1.6 scrub ok 2024-02-10T08:42:21.982 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:20.712557+0000 mon.a (mon.0) 1981 : cluster [DBG] osdmap e499: 8 total, 8 up, 8 in 2024-02-10T08:42:21.982 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:42:20.915078+0000 mon.a (mon.0) 1982 : audit [INF] from='client.? 172.21.15.18:0/1904199340' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 7, "weight": 1.0}]: dispatch 2024-02-10T08:42:21.983 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:21.006272+0000 osd.1 (osd.1) 373 : cluster [DBG] 2.6 scrub starts 2024-02-10T08:42:21.983 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:21.009453+0000 osd.1 (osd.1) 374 : cluster [DBG] 2.6 scrub ok 2024-02-10T08:42:21.983 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:42:21.123583+0000 mon.a (mon.0) 1983 : audit [INF] from='client.? 172.21.15.18:0/1904199340' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 7, "weight": 1.0}]': finished 2024-02-10T08:42:21.983 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:21.123667+0000 mon.a (mon.0) 1984 : cluster [DBG] osdmap e500: 8 total, 8 up, 8 in 2024-02-10T08:42:21.983 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:20.301238+0000 osd.6 (osd.6) 333 : cluster [DBG] 1.6 scrub starts 2024-02-10T08:42:21.983 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:20.304518+0000 osd.6 (osd.6) 334 : cluster [DBG] 1.6 scrub ok 2024-02-10T08:42:21.983 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:20.712557+0000 mon.a (mon.0) 1981 : cluster [DBG] osdmap e499: 8 total, 8 up, 8 in 2024-02-10T08:42:21.983 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:42:20.915078+0000 mon.a (mon.0) 1982 : audit [INF] from='client.? 172.21.15.18:0/1904199340' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 7, "weight": 1.0}]: dispatch 2024-02-10T08:42:21.983 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:21.006272+0000 osd.1 (osd.1) 373 : cluster [DBG] 2.6 scrub starts 2024-02-10T08:42:21.983 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:21.009453+0000 osd.1 (osd.1) 374 : cluster [DBG] 2.6 scrub ok 2024-02-10T08:42:21.983 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:42:21.123583+0000 mon.a (mon.0) 1983 : audit [INF] from='client.? 172.21.15.18:0/1904199340' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 7, "weight": 1.0}]': finished 2024-02-10T08:42:21.983 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:21.123667+0000 mon.a (mon.0) 1984 : cluster [DBG] osdmap e500: 8 total, 8 up, 8 in 2024-02-10T08:42:22.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:20.301238+0000 osd.6 (osd.6) 333 : cluster [DBG] 1.6 scrub starts 2024-02-10T08:42:22.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:20.304518+0000 osd.6 (osd.6) 334 : cluster [DBG] 1.6 scrub ok 2024-02-10T08:42:22.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:20.712557+0000 mon.a (mon.0) 1981 : cluster [DBG] osdmap e499: 8 total, 8 up, 8 in 2024-02-10T08:42:22.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:42:20.915078+0000 mon.a (mon.0) 1982 : audit [INF] from='client.? 172.21.15.18:0/1904199340' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 7, "weight": 1.0}]: dispatch 2024-02-10T08:42:22.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:21.006272+0000 osd.1 (osd.1) 373 : cluster [DBG] 2.6 scrub starts 2024-02-10T08:42:22.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:21.009453+0000 osd.1 (osd.1) 374 : cluster [DBG] 2.6 scrub ok 2024-02-10T08:42:22.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:42:21.123583+0000 mon.a (mon.0) 1983 : audit [INF] from='client.? 172.21.15.18:0/1904199340' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 7, "weight": 1.0}]': finished 2024-02-10T08:42:22.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:21.123667+0000 mon.a (mon.0) 1984 : cluster [DBG] osdmap e500: 8 total, 8 up, 8 in 2024-02-10T08:42:22.477 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd reweight 4 1 2024-02-10T08:42:22.765 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:42:22.985 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:21.244360+0000 mgr.y (mgr.14505) 955 : cluster [DBG] pgmap v1191: 162 pgs: 162 active+clean; 5.7 KiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:42:22.985 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:21.849607+0000 osd.0 (osd.0) 336 : cluster [DBG] 2.13 scrub starts 2024-02-10T08:42:22.985 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:21.850969+0000 osd.0 (osd.0) 337 : cluster [DBG] 2.13 scrub ok 2024-02-10T08:42:22.985 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:22.031130+0000 osd.1 (osd.1) 375 : cluster [DBG] 3.0 scrub starts 2024-02-10T08:42:22.985 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:22.034593+0000 osd.1 (osd.1) 376 : cluster [DBG] 3.0 scrub ok 2024-02-10T08:42:22.986 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:22.231939+0000 osd.7 (osd.7) 51 : cluster [DBG] 6.2f scrub starts 2024-02-10T08:42:22.986 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:22.329596+0000 osd.7 (osd.7) 52 : cluster [DBG] 6.2f scrub ok 2024-02-10T08:42:22.986 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:21.244360+0000 mgr.y (mgr.14505) 955 : cluster [DBG] pgmap v1191: 162 pgs: 162 active+clean; 5.7 KiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:42:22.986 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:21.849607+0000 osd.0 (osd.0) 336 : cluster [DBG] 2.13 scrub starts 2024-02-10T08:42:22.986 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:21.850969+0000 osd.0 (osd.0) 337 : cluster [DBG] 2.13 scrub ok 2024-02-10T08:42:22.986 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:22.031130+0000 osd.1 (osd.1) 375 : cluster [DBG] 3.0 scrub starts 2024-02-10T08:42:22.986 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:22.034593+0000 osd.1 (osd.1) 376 : cluster [DBG] 3.0 scrub ok 2024-02-10T08:42:22.986 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:22.231939+0000 osd.7 (osd.7) 51 : cluster [DBG] 6.2f scrub starts 2024-02-10T08:42:22.986 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:22.329596+0000 osd.7 (osd.7) 52 : cluster [DBG] 6.2f scrub ok 2024-02-10T08:42:23.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:21.244360+0000 mgr.y (mgr.14505) 955 : cluster [DBG] pgmap v1191: 162 pgs: 162 active+clean; 5.7 KiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:42:23.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:21.849607+0000 osd.0 (osd.0) 336 : cluster [DBG] 2.13 scrub starts 2024-02-10T08:42:23.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:21.850969+0000 osd.0 (osd.0) 337 : cluster [DBG] 2.13 scrub ok 2024-02-10T08:42:23.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:22.031130+0000 osd.1 (osd.1) 375 : cluster [DBG] 3.0 scrub starts 2024-02-10T08:42:23.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:22.034593+0000 osd.1 (osd.1) 376 : cluster [DBG] 3.0 scrub ok 2024-02-10T08:42:23.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:22.231939+0000 osd.7 (osd.7) 51 : cluster [DBG] 6.2f scrub starts 2024-02-10T08:42:23.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:22.329596+0000 osd.7 (osd.7) 52 : cluster [DBG] 6.2f scrub ok 2024-02-10T08:42:24.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:22.545395+0000 osd.2 (osd.2) 309 : cluster [DBG] 2.0 deep-scrub starts 2024-02-10T08:42:24.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:22.546248+0000 osd.2 (osd.2) 310 : cluster [DBG] 2.0 deep-scrub ok 2024-02-10T08:42:24.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:22.867176+0000 osd.0 (osd.0) 338 : cluster [DBG] 6.10 scrub starts 2024-02-10T08:42:24.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:23.077821+0000 osd.4 (osd.4) 51 : cluster [DBG] 5.18 scrub starts 2024-02-10T08:42:24.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:23.080712+0000 osd.4 (osd.4) 52 : cluster [DBG] 5.18 scrub ok 2024-02-10T08:42:24.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:22.545395+0000 osd.2 (osd.2) 309 : cluster [DBG] 2.0 deep-scrub starts 2024-02-10T08:42:24.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:22.546248+0000 osd.2 (osd.2) 310 : cluster [DBG] 2.0 deep-scrub ok 2024-02-10T08:42:24.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:22.867176+0000 osd.0 (osd.0) 338 : cluster [DBG] 6.10 scrub starts 2024-02-10T08:42:24.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:23.077821+0000 osd.4 (osd.4) 51 : cluster [DBG] 5.18 scrub starts 2024-02-10T08:42:24.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:23.080712+0000 osd.4 (osd.4) 52 : cluster [DBG] 5.18 scrub ok 2024-02-10T08:42:24.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:22.545395+0000 osd.2 (osd.2) 309 : cluster [DBG] 2.0 deep-scrub starts 2024-02-10T08:42:24.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:22.546248+0000 osd.2 (osd.2) 310 : cluster [DBG] 2.0 deep-scrub ok 2024-02-10T08:42:24.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:22.867176+0000 osd.0 (osd.0) 338 : cluster [DBG] 6.10 scrub starts 2024-02-10T08:42:24.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:23.077821+0000 osd.4 (osd.4) 51 : cluster [DBG] 5.18 scrub starts 2024-02-10T08:42:24.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:23.080712+0000 osd.4 (osd.4) 52 : cluster [DBG] 5.18 scrub ok 2024-02-10T08:42:24.729 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:22.870237+0000 osd.0 (osd.0) 339 : cluster [DBG] 6.10 scrub ok 2024-02-10T08:42:24.730 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:22.966471+0000 osd.5 (osd.5) 338 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:42:24.730 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:22.966515+0000 osd.5 (osd.5) 339 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:42:24.730 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:23.029788+0000 osd.5 (osd.5) 340 : cluster [DBG] 5.f scrub starts 2024-02-10T08:42:24.730 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:23.032731+0000 osd.5 (osd.5) 341 : cluster [DBG] 5.f scrub ok 2024-02-10T08:42:24.730 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:23.245012+0000 mgr.y (mgr.14505) 956 : cluster [DBG] pgmap v1192: 162 pgs: 162 active+clean; 5.7 KiB data, 6.2 GiB used, 709 GiB / 715 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-02-10T08:42:24.730 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:23.301095+0000 osd.6 (osd.6) 335 : cluster [DBG] 6.2c scrub starts 2024-02-10T08:42:24.730 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:23.304033+0000 osd.6 (osd.6) 336 : cluster [DBG] 6.2c scrub ok 2024-02-10T08:42:24.730 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:23.728616+0000 mon.a (mon.0) 1985 : cluster [DBG] osdmap e501: 8 total, 8 up, 8 in 2024-02-10T08:42:25.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:22.870237+0000 osd.0 (osd.0) 339 : cluster [DBG] 6.10 scrub ok 2024-02-10T08:42:25.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:22.966471+0000 osd.5 (osd.5) 338 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:42:25.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:22.966515+0000 osd.5 (osd.5) 339 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:42:25.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:23.029788+0000 osd.5 (osd.5) 340 : cluster [DBG] 5.f scrub starts 2024-02-10T08:42:25.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:23.032731+0000 osd.5 (osd.5) 341 : cluster [DBG] 5.f scrub ok 2024-02-10T08:42:25.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:23.245012+0000 mgr.y (mgr.14505) 956 : cluster [DBG] pgmap v1192: 162 pgs: 162 active+clean; 5.7 KiB data, 6.2 GiB used, 709 GiB / 715 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-02-10T08:42:25.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:23.301095+0000 osd.6 (osd.6) 335 : cluster [DBG] 6.2c scrub starts 2024-02-10T08:42:25.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:23.304033+0000 osd.6 (osd.6) 336 : cluster [DBG] 6.2c scrub ok 2024-02-10T08:42:25.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:23.728616+0000 mon.a (mon.0) 1985 : cluster [DBG] osdmap e501: 8 total, 8 up, 8 in 2024-02-10T08:42:25.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:22.870237+0000 osd.0 (osd.0) 339 : cluster [DBG] 6.10 scrub ok 2024-02-10T08:42:25.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:22.966471+0000 osd.5 (osd.5) 338 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:42:25.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:22.966515+0000 osd.5 (osd.5) 339 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:42:25.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:23.029788+0000 osd.5 (osd.5) 340 : cluster [DBG] 5.f scrub starts 2024-02-10T08:42:25.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:23.032731+0000 osd.5 (osd.5) 341 : cluster [DBG] 5.f scrub ok 2024-02-10T08:42:25.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:23.245012+0000 mgr.y (mgr.14505) 956 : cluster [DBG] pgmap v1192: 162 pgs: 162 active+clean; 5.7 KiB data, 6.2 GiB used, 709 GiB / 715 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-02-10T08:42:25.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:23.301095+0000 osd.6 (osd.6) 335 : cluster [DBG] 6.2c scrub starts 2024-02-10T08:42:25.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:23.304033+0000 osd.6 (osd.6) 336 : cluster [DBG] 6.2c scrub ok 2024-02-10T08:42:25.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:23.728616+0000 mon.a (mon.0) 1985 : cluster [DBG] osdmap e501: 8 total, 8 up, 8 in 2024-02-10T08:42:25.745 INFO:teuthology.orchestra.run.smithi018.stderr:reweighted osd.4 to 1 (10000) 2024-02-10T08:42:26.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:23.994814+0000 osd.5 (osd.5) 342 : cluster [DBG] 1.1 deep-scrub starts 2024-02-10T08:42:26.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:23.998077+0000 osd.5 (osd.5) 343 : cluster [DBG] 1.1 deep-scrub ok 2024-02-10T08:42:26.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:23.999427+0000 osd.2 (osd.2) 311 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:42:26.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:23.999483+0000 osd.2 (osd.2) 312 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:42:26.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:24.350532+0000 osd.6 (osd.6) 337 : cluster [DBG] 6.22 scrub starts 2024-02-10T08:42:26.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:24.352295+0000 osd.6 (osd.6) 338 : cluster [DBG] 6.22 scrub ok 2024-02-10T08:42:26.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:24.554245+0000 osd.4 (osd.4) 53 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:42:26.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:24.554340+0000 osd.4 (osd.4) 54 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:42:26.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:24.734021+0000 mon.a (mon.0) 1986 : cluster [DBG] osdmap e502: 8 total, 8 up, 8 in 2024-02-10T08:42:26.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:42:24.975426+0000 mon.a (mon.0) 1987 : audit [INF] from='client.? 172.21.15.18:0/845682242' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]: dispatch 2024-02-10T08:42:26.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:23.994814+0000 osd.5 (osd.5) 342 : cluster [DBG] 1.1 deep-scrub starts 2024-02-10T08:42:26.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:23.998077+0000 osd.5 (osd.5) 343 : cluster [DBG] 1.1 deep-scrub ok 2024-02-10T08:42:26.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:23.999427+0000 osd.2 (osd.2) 311 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:42:26.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:23.999483+0000 osd.2 (osd.2) 312 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:42:26.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:24.350532+0000 osd.6 (osd.6) 337 : cluster [DBG] 6.22 scrub starts 2024-02-10T08:42:26.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:24.352295+0000 osd.6 (osd.6) 338 : cluster [DBG] 6.22 scrub ok 2024-02-10T08:42:26.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:24.554245+0000 osd.4 (osd.4) 53 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:42:26.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:24.554340+0000 osd.4 (osd.4) 54 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:42:26.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:24.734021+0000 mon.a (mon.0) 1986 : cluster [DBG] osdmap e502: 8 total, 8 up, 8 in 2024-02-10T08:42:26.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:42:24.975426+0000 mon.a (mon.0) 1987 : audit [INF] from='client.? 172.21.15.18:0/845682242' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]: dispatch 2024-02-10T08:42:26.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:23.994814+0000 osd.5 (osd.5) 342 : cluster [DBG] 1.1 deep-scrub starts 2024-02-10T08:42:26.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:23.998077+0000 osd.5 (osd.5) 343 : cluster [DBG] 1.1 deep-scrub ok 2024-02-10T08:42:26.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:23.999427+0000 osd.2 (osd.2) 311 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:42:26.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:23.999483+0000 osd.2 (osd.2) 312 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:42:26.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:24.350532+0000 osd.6 (osd.6) 337 : cluster [DBG] 6.22 scrub starts 2024-02-10T08:42:26.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:24.352295+0000 osd.6 (osd.6) 338 : cluster [DBG] 6.22 scrub ok 2024-02-10T08:42:26.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:24.554245+0000 osd.4 (osd.4) 53 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:42:26.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:24.554340+0000 osd.4 (osd.4) 54 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:42:26.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:24.734021+0000 mon.a (mon.0) 1986 : cluster [DBG] osdmap e502: 8 total, 8 up, 8 in 2024-02-10T08:42:26.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:42:24.975426+0000 mon.a (mon.0) 1987 : audit [INF] from='client.? 172.21.15.18:0/845682242' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]: dispatch 2024-02-10T08:42:26.636 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd primary-affinity 4 1 2024-02-10T08:42:26.789 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:42:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:42:26] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:42:26.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:25.245358+0000 mgr.y (mgr.14505) 957 : cluster [DBG] pgmap v1195: 162 pgs: 162 active+clean; 5.7 KiB data, 6.2 GiB used, 709 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-02-10T08:42:26.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:42:25.741531+0000 mon.a (mon.0) 1988 : audit [INF] from='client.? 172.21.15.18:0/845682242' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]': finished 2024-02-10T08:42:26.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:25.741622+0000 mon.a (mon.0) 1989 : cluster [DBG] osdmap e503: 8 total, 8 up, 8 in 2024-02-10T08:42:26.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:26.125906+0000 mon.a (mon.0) 1990 : cluster [DBG] osdmap e504: 8 total, 8 up, 8 in 2024-02-10T08:42:26.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:26.248357+0000 osd.7 (osd.7) 53 : cluster [DBG] 6.3 deep-scrub starts 2024-02-10T08:42:26.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:26.290529+0000 osd.7 (osd.7) 54 : cluster [DBG] 6.3 deep-scrub ok 2024-02-10T08:42:26.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:25.245358+0000 mgr.y (mgr.14505) 957 : cluster [DBG] pgmap v1195: 162 pgs: 162 active+clean; 5.7 KiB data, 6.2 GiB used, 709 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-02-10T08:42:26.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:42:25.741531+0000 mon.a (mon.0) 1988 : audit [INF] from='client.? 172.21.15.18:0/845682242' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]': finished 2024-02-10T08:42:26.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:25.741622+0000 mon.a (mon.0) 1989 : cluster [DBG] osdmap e503: 8 total, 8 up, 8 in 2024-02-10T08:42:26.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:26.125906+0000 mon.a (mon.0) 1990 : cluster [DBG] osdmap e504: 8 total, 8 up, 8 in 2024-02-10T08:42:26.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:26.248357+0000 osd.7 (osd.7) 53 : cluster [DBG] 6.3 deep-scrub starts 2024-02-10T08:42:26.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:26.290529+0000 osd.7 (osd.7) 54 : cluster [DBG] 6.3 deep-scrub ok 2024-02-10T08:42:26.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:25.245358+0000 mgr.y (mgr.14505) 957 : cluster [DBG] pgmap v1195: 162 pgs: 162 active+clean; 5.7 KiB data, 6.2 GiB used, 709 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-02-10T08:42:26.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:42:25.741531+0000 mon.a (mon.0) 1988 : audit [INF] from='client.? 172.21.15.18:0/845682242' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]': finished 2024-02-10T08:42:26.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:25.741622+0000 mon.a (mon.0) 1989 : cluster [DBG] osdmap e503: 8 total, 8 up, 8 in 2024-02-10T08:42:26.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:26.125906+0000 mon.a (mon.0) 1990 : cluster [DBG] osdmap e504: 8 total, 8 up, 8 in 2024-02-10T08:42:26.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:26.248357+0000 osd.7 (osd.7) 53 : cluster [DBG] 6.3 deep-scrub starts 2024-02-10T08:42:26.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:26.290529+0000 osd.7 (osd.7) 54 : cluster [DBG] 6.3 deep-scrub ok 2024-02-10T08:42:26.924 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:42:27.404 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:42:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:42:27] "GET /metrics HTTP/1.1" 200 174123 "" "Prometheus/2.33.4" 2024-02-10T08:42:28.003 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:26.391717+0000 osd.3 (osd.3) 137 : cluster [DBG] 6.c deep-scrub starts 2024-02-10T08:42:28.003 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:26.392676+0000 osd.3 (osd.3) 138 : cluster [DBG] 6.c deep-scrub ok 2024-02-10T08:42:28.003 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:26.391717+0000 osd.3 (osd.3) 137 : cluster [DBG] 6.c deep-scrub starts 2024-02-10T08:42:28.004 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:26.392676+0000 osd.3 (osd.3) 138 : cluster [DBG] 6.c deep-scrub ok 2024-02-10T08:42:28.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:26.391717+0000 osd.3 (osd.3) 137 : cluster [DBG] 6.c deep-scrub starts 2024-02-10T08:42:28.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:26.392676+0000 osd.3 (osd.3) 138 : cluster [DBG] 6.c deep-scrub ok 2024-02-10T08:42:29.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:27.165696+0000 osd.4 (osd.4) 55 : cluster [DBG] 2.f scrub starts 2024-02-10T08:42:29.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:27.167323+0000 osd.4 (osd.4) 56 : cluster [DBG] 2.f scrub ok 2024-02-10T08:42:29.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:27.245824+0000 mgr.y (mgr.14505) 958 : cluster [DBG] pgmap v1198: 162 pgs: 162 active+clean; 5.7 KiB data, 6.1 GiB used, 709 GiB / 715 GiB avail 2024-02-10T08:42:29.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:27.755890+0000 osd.0 (osd.0) 340 : cluster [DBG] 2.1f scrub starts 2024-02-10T08:42:29.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:27.758840+0000 osd.0 (osd.0) 341 : cluster [DBG] 2.1f scrub ok 2024-02-10T08:42:29.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:28.009003+0000 osd.1 (osd.1) 377 : cluster [DBG] 5.c scrub starts 2024-02-10T08:42:29.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:28.011953+0000 osd.1 (osd.1) 378 : cluster [DBG] 5.c scrub ok 2024-02-10T08:42:29.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:28.326193+0000 osd.7 (osd.7) 55 : cluster [DBG] 1.0 scrub starts 2024-02-10T08:42:29.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:28.327271+0000 osd.7 (osd.7) 56 : cluster [DBG] 1.0 scrub ok 2024-02-10T08:42:29.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:27.165696+0000 osd.4 (osd.4) 55 : cluster [DBG] 2.f scrub starts 2024-02-10T08:42:29.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:27.167323+0000 osd.4 (osd.4) 56 : cluster [DBG] 2.f scrub ok 2024-02-10T08:42:29.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:27.245824+0000 mgr.y (mgr.14505) 958 : cluster [DBG] pgmap v1198: 162 pgs: 162 active+clean; 5.7 KiB data, 6.1 GiB used, 709 GiB / 715 GiB avail 2024-02-10T08:42:29.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:27.755890+0000 osd.0 (osd.0) 340 : cluster [DBG] 2.1f scrub starts 2024-02-10T08:42:29.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:27.758840+0000 osd.0 (osd.0) 341 : cluster [DBG] 2.1f scrub ok 2024-02-10T08:42:29.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:28.009003+0000 osd.1 (osd.1) 377 : cluster [DBG] 5.c scrub starts 2024-02-10T08:42:29.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:28.011953+0000 osd.1 (osd.1) 378 : cluster [DBG] 5.c scrub ok 2024-02-10T08:42:29.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:28.326193+0000 osd.7 (osd.7) 55 : cluster [DBG] 1.0 scrub starts 2024-02-10T08:42:29.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:28.327271+0000 osd.7 (osd.7) 56 : cluster [DBG] 1.0 scrub ok 2024-02-10T08:42:29.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:27.165696+0000 osd.4 (osd.4) 55 : cluster [DBG] 2.f scrub starts 2024-02-10T08:42:29.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:27.167323+0000 osd.4 (osd.4) 56 : cluster [DBG] 2.f scrub ok 2024-02-10T08:42:29.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:27.245824+0000 mgr.y (mgr.14505) 958 : cluster [DBG] pgmap v1198: 162 pgs: 162 active+clean; 5.7 KiB data, 6.1 GiB used, 709 GiB / 715 GiB avail 2024-02-10T08:42:29.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:27.755890+0000 osd.0 (osd.0) 340 : cluster [DBG] 2.1f scrub starts 2024-02-10T08:42:29.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:27.758840+0000 osd.0 (osd.0) 341 : cluster [DBG] 2.1f scrub ok 2024-02-10T08:42:29.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:28.009003+0000 osd.1 (osd.1) 377 : cluster [DBG] 5.c scrub starts 2024-02-10T08:42:29.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:28.011953+0000 osd.1 (osd.1) 378 : cluster [DBG] 5.c scrub ok 2024-02-10T08:42:29.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:28.326193+0000 osd.7 (osd.7) 55 : cluster [DBG] 1.0 scrub starts 2024-02-10T08:42:29.155 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:28.327271+0000 osd.7 (osd.7) 56 : cluster [DBG] 1.0 scrub ok 2024-02-10T08:42:29.539 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:42:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:42:29.754 INFO:teuthology.orchestra.run.smithi018.stderr:set osd.4 primary-affinity to 1 (8655362) 2024-02-10T08:42:30.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:28.620523+0000 osd.2 (osd.2) 313 : cluster [DBG] 2.c deep-scrub starts 2024-02-10T08:42:30.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:28.621755+0000 osd.2 (osd.2) 314 : cluster [DBG] 2.c deep-scrub ok 2024-02-10T08:42:30.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:42:29.249586+0000 mon.a (mon.0) 1991 : audit [INF] from='client.? 172.21.15.18:0/3383000819' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 4, "weight": 1.0}]: dispatch 2024-02-10T08:42:30.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:28.620523+0000 osd.2 (osd.2) 313 : cluster [DBG] 2.c deep-scrub starts 2024-02-10T08:42:30.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:28.621755+0000 osd.2 (osd.2) 314 : cluster [DBG] 2.c deep-scrub ok 2024-02-10T08:42:30.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:42:29.249586+0000 mon.a (mon.0) 1991 : audit [INF] from='client.? 172.21.15.18:0/3383000819' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 4, "weight": 1.0}]: dispatch 2024-02-10T08:42:30.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:28.620523+0000 osd.2 (osd.2) 313 : cluster [DBG] 2.c deep-scrub starts 2024-02-10T08:42:30.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:28.621755+0000 osd.2 (osd.2) 314 : cluster [DBG] 2.c deep-scrub ok 2024-02-10T08:42:30.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:42:29.249586+0000 mon.a (mon.0) 1991 : audit [INF] from='client.? 172.21.15.18:0/3383000819' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 4, "weight": 1.0}]: dispatch 2024-02-10T08:42:30.758 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:29.156624+0000 osd.4 (osd.4) 57 : cluster [DBG] 5.e scrub starts 2024-02-10T08:42:30.758 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:29.158343+0000 osd.4 (osd.4) 58 : cluster [DBG] 5.e scrub ok 2024-02-10T08:42:30.758 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:42:29.163698+0000 mgr.y (mgr.14505) 959 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:42:30.758 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:29.246461+0000 mgr.y (mgr.14505) 960 : cluster [DBG] pgmap v1199: 162 pgs: 162 active+clean; 5.7 KiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 927 B/s rd, 0 op/s 2024-02-10T08:42:30.758 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:42:29.750146+0000 mon.a (mon.0) 1992 : audit [INF] from='client.? 172.21.15.18:0/3383000819' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 4, "weight": 1.0}]': finished 2024-02-10T08:42:30.758 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:29.750240+0000 mon.a (mon.0) 1993 : cluster [DBG] osdmap e505: 8 total, 8 up, 8 in 2024-02-10T08:42:30.758 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:30.083093+0000 osd.1 (osd.1) 379 : cluster [DBG] 6.26 scrub starts 2024-02-10T08:42:30.758 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:30.087829+0000 osd.1 (osd.1) 380 : cluster [DBG] 6.26 scrub ok 2024-02-10T08:42:30.759 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:30.282765+0000 osd.7 (osd.7) 57 : cluster [DBG] 6.21 scrub starts 2024-02-10T08:42:30.759 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:30.284244+0000 osd.7 (osd.7) 58 : cluster [DBG] 6.21 scrub ok 2024-02-10T08:42:30.759 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:29.156624+0000 osd.4 (osd.4) 57 : cluster [DBG] 5.e scrub starts 2024-02-10T08:42:30.759 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:29.158343+0000 osd.4 (osd.4) 58 : cluster [DBG] 5.e scrub ok 2024-02-10T08:42:30.759 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:42:29.163698+0000 mgr.y (mgr.14505) 959 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:42:30.759 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:29.246461+0000 mgr.y (mgr.14505) 960 : cluster [DBG] pgmap v1199: 162 pgs: 162 active+clean; 5.7 KiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 927 B/s rd, 0 op/s 2024-02-10T08:42:30.759 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:42:29.750146+0000 mon.a (mon.0) 1992 : audit [INF] from='client.? 172.21.15.18:0/3383000819' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 4, "weight": 1.0}]': finished 2024-02-10T08:42:30.759 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:29.750240+0000 mon.a (mon.0) 1993 : cluster [DBG] osdmap e505: 8 total, 8 up, 8 in 2024-02-10T08:42:30.759 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:30.083093+0000 osd.1 (osd.1) 379 : cluster [DBG] 6.26 scrub starts 2024-02-10T08:42:30.759 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:30.087829+0000 osd.1 (osd.1) 380 : cluster [DBG] 6.26 scrub ok 2024-02-10T08:42:30.759 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:30.282765+0000 osd.7 (osd.7) 57 : cluster [DBG] 6.21 scrub starts 2024-02-10T08:42:30.759 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:30.284244+0000 osd.7 (osd.7) 58 : cluster [DBG] 6.21 scrub ok 2024-02-10T08:42:30.831 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-02-10T08:42:30.831 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-02-10T08:42:30.831 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-02-10T08:42:30.832 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-02-10T08:42:30.832 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-02-10T08:42:30.832 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd dump --format=json 2024-02-10T08:42:31.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:29.156624+0000 osd.4 (osd.4) 57 : cluster [DBG] 5.e scrub starts 2024-02-10T08:42:31.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:29.158343+0000 osd.4 (osd.4) 58 : cluster [DBG] 5.e scrub ok 2024-02-10T08:42:31.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:42:29.163698+0000 mgr.y (mgr.14505) 959 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:42:31.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:29.246461+0000 mgr.y (mgr.14505) 960 : cluster [DBG] pgmap v1199: 162 pgs: 162 active+clean; 5.7 KiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 927 B/s rd, 0 op/s 2024-02-10T08:42:31.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:42:29.750146+0000 mon.a (mon.0) 1992 : audit [INF] from='client.? 172.21.15.18:0/3383000819' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 4, "weight": 1.0}]': finished 2024-02-10T08:42:31.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:29.750240+0000 mon.a (mon.0) 1993 : cluster [DBG] osdmap e505: 8 total, 8 up, 8 in 2024-02-10T08:42:31.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:30.083093+0000 osd.1 (osd.1) 379 : cluster [DBG] 6.26 scrub starts 2024-02-10T08:42:31.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:30.087829+0000 osd.1 (osd.1) 380 : cluster [DBG] 6.26 scrub ok 2024-02-10T08:42:31.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:30.282765+0000 osd.7 (osd.7) 57 : cluster [DBG] 6.21 scrub starts 2024-02-10T08:42:31.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:30.284244+0000 osd.7 (osd.7) 58 : cluster [DBG] 6.21 scrub ok 2024-02-10T08:42:31.117 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:42:32.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:30.254442+0000 osd.6 (osd.6) 339 : cluster [DBG] 2.11 scrub starts 2024-02-10T08:42:32.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:30.255412+0000 osd.6 (osd.6) 340 : cluster [DBG] 2.11 scrub ok 2024-02-10T08:42:32.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:30.438115+0000 osd.3 (osd.3) 139 : cluster [DBG] 6.11 scrub starts 2024-02-10T08:42:32.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:30.441174+0000 osd.3 (osd.3) 140 : cluster [DBG] 6.11 scrub ok 2024-02-10T08:42:32.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:30.578230+0000 osd.2 (osd.2) 315 : cluster [DBG] 6.2d scrub starts 2024-02-10T08:42:32.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:30.664360+0000 osd.2 (osd.2) 316 : cluster [DBG] 6.2d scrub ok 2024-02-10T08:42:32.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:31.127241+0000 mon.a (mon.0) 1994 : cluster [DBG] osdmap e506: 8 total, 8 up, 8 in 2024-02-10T08:42:32.141 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:30.254442+0000 osd.6 (osd.6) 339 : cluster [DBG] 2.11 scrub starts 2024-02-10T08:42:32.141 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:30.255412+0000 osd.6 (osd.6) 340 : cluster [DBG] 2.11 scrub ok 2024-02-10T08:42:32.141 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:30.438115+0000 osd.3 (osd.3) 139 : cluster [DBG] 6.11 scrub starts 2024-02-10T08:42:32.141 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:30.441174+0000 osd.3 (osd.3) 140 : cluster [DBG] 6.11 scrub ok 2024-02-10T08:42:32.141 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:30.578230+0000 osd.2 (osd.2) 315 : cluster [DBG] 6.2d scrub starts 2024-02-10T08:42:32.141 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:30.664360+0000 osd.2 (osd.2) 316 : cluster [DBG] 6.2d scrub ok 2024-02-10T08:42:32.141 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:31.127241+0000 mon.a (mon.0) 1994 : cluster [DBG] osdmap e506: 8 total, 8 up, 8 in 2024-02-10T08:42:32.142 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:30.254442+0000 osd.6 (osd.6) 339 : cluster [DBG] 2.11 scrub starts 2024-02-10T08:42:32.142 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:30.255412+0000 osd.6 (osd.6) 340 : cluster [DBG] 2.11 scrub ok 2024-02-10T08:42:32.142 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:30.438115+0000 osd.3 (osd.3) 139 : cluster [DBG] 6.11 scrub starts 2024-02-10T08:42:32.142 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:30.441174+0000 osd.3 (osd.3) 140 : cluster [DBG] 6.11 scrub ok 2024-02-10T08:42:32.142 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:30.578230+0000 osd.2 (osd.2) 315 : cluster [DBG] 6.2d scrub starts 2024-02-10T08:42:32.142 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:30.664360+0000 osd.2 (osd.2) 316 : cluster [DBG] 6.2d scrub ok 2024-02-10T08:42:32.142 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:31.127241+0000 mon.a (mon.0) 1994 : cluster [DBG] osdmap e506: 8 total, 8 up, 8 in 2024-02-10T08:42:32.791 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:31.246810+0000 mgr.y (mgr.14505) 961 : cluster [DBG] pgmap v1202: 162 pgs: 162 active+clean; 5.7 KiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 929 B/s rd, 0 op/s 2024-02-10T08:42:32.791 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:31.705718+0000 osd.0 (osd.0) 342 : cluster [DBG] 6.23 scrub starts 2024-02-10T08:42:32.791 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:31.751007+0000 osd.0 (osd.0) 343 : cluster [DBG] 6.23 scrub ok 2024-02-10T08:42:32.791 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:32.065327+0000 osd.1 (osd.1) 381 : cluster [DBG] 4.2 scrub starts 2024-02-10T08:42:32.791 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:32.069002+0000 osd.1 (osd.1) 382 : cluster [DBG] 4.2 scrub ok 2024-02-10T08:42:32.792 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:31.246810+0000 mgr.y (mgr.14505) 961 : cluster [DBG] pgmap v1202: 162 pgs: 162 active+clean; 5.7 KiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 929 B/s rd, 0 op/s 2024-02-10T08:42:32.792 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:31.705718+0000 osd.0 (osd.0) 342 : cluster [DBG] 6.23 scrub starts 2024-02-10T08:42:32.792 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:31.751007+0000 osd.0 (osd.0) 343 : cluster [DBG] 6.23 scrub ok 2024-02-10T08:42:32.792 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:32.065327+0000 osd.1 (osd.1) 381 : cluster [DBG] 4.2 scrub starts 2024-02-10T08:42:32.792 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:32.069002+0000 osd.1 (osd.1) 382 : cluster [DBG] 4.2 scrub ok 2024-02-10T08:42:33.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:31.246810+0000 mgr.y (mgr.14505) 961 : cluster [DBG] pgmap v1202: 162 pgs: 162 active+clean; 5.7 KiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 929 B/s rd, 0 op/s 2024-02-10T08:42:33.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:31.705718+0000 osd.0 (osd.0) 342 : cluster [DBG] 6.23 scrub starts 2024-02-10T08:42:33.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:31.751007+0000 osd.0 (osd.0) 343 : cluster [DBG] 6.23 scrub ok 2024-02-10T08:42:33.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:32.065327+0000 osd.1 (osd.1) 381 : cluster [DBG] 4.2 scrub starts 2024-02-10T08:42:33.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:32.069002+0000 osd.1 (osd.1) 382 : cluster [DBG] 4.2 scrub ok 2024-02-10T08:42:33.285 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:42:33.285 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":506,"fsid":"d46257c8-c7eb-11ee-95b8-87774f69a715","created":"2024-02-10T08:10:57.425061+0000","modified":"2024-02-10T08:42:31.122531+0000","last_up_change":"2024-02-10T08:41:08.747778+0000","last_in_change":"2024-02-10T08:41:13.105431+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":21,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-02-10T08:14:44.034966+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":11,"pg_placement_num":11,"pg_placement_num_target":11,"pg_num_target":11,"pg_num_pending":11,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"469","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"409","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":".rgw.root","create_time":"2024-02-10T08:16:51.334631+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":3,"pool_name":"iscsi","create_time":"2024-02-10T08:16:51.762963+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":3,"pg_placement_num":3,"pg_placement_num_target":3,"pg_num_target":3,"pg_num_pending":3,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"424","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":4,"pool_name":"default.rgw.log","create_time":"2024-02-10T08:16:53.258098+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"205","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":5,"pool_name":"default.rgw.control","create_time":"2024-02-10T08:16:55.289300+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":6,"pool_name":"default.rgw.meta","create_time":"2024-02-10T08:16:57.354868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":52,"pg_placement_num":52,"pg_placement_num_target":52,"pg_num_target":52,"pg_num_pending":52,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"471","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"287","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}}}],"osds":[{"osd":0,"uuid":"f9043fee-a3ed-4e16-921d-bb86756d0c48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":466,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6801","nonce":276034406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":276034406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":276034406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6803","nonce":276034406}]},"public_addr":"172.21.15.18:6801/276034406","cluster_addr":"172.21.15.18:6802/276034406","heartbeat_back_addr":"172.21.15.18:6804/276034406","heartbeat_front_addr":"172.21.15.18:6803/276034406","state":["exists","up"]},{"osd":1,"uuid":"ff958272-ce6b-4162-959a-6da9729e537b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":466,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6805","nonce":1941014296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1941014296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1941014296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6807","nonce":1941014296}]},"public_addr":"172.21.15.18:6805/1941014296","cluster_addr":"172.21.15.18:6806/1941014296","heartbeat_back_addr":"172.21.15.18:6808/1941014296","heartbeat_front_addr":"172.21.15.18:6807/1941014296","state":["exists","up"]},{"osd":2,"uuid":"29bb47e2-5c81-4ae8-bb9f-d1b02ea01d3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":498,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6809","nonce":3122474567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":3122474567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":3122474567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6811","nonce":3122474567}]},"public_addr":"172.21.15.18:6809/3122474567","cluster_addr":"172.21.15.18:6810/3122474567","heartbeat_back_addr":"172.21.15.18:6812/3122474567","heartbeat_front_addr":"172.21.15.18:6811/3122474567","state":["exists","up"]},{"osd":3,"uuid":"87ad37de-5f49-4e5b-9683-3bb9c3e33907","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":487,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6813","nonce":3484706437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":3484706437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3484706437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6815","nonce":3484706437}]},"public_addr":"172.21.15.18:6813/3484706437","cluster_addr":"172.21.15.18:6814/3484706437","heartbeat_back_addr":"172.21.15.18:6816/3484706437","heartbeat_front_addr":"172.21.15.18:6815/3484706437","state":["exists","up"]},{"osd":4,"uuid":"f5708f20-f98d-4d12-b8ae-71a5049a14cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":110,"last_clean_end":453,"up_from":463,"up_thru":466,"down_at":454,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":1915668731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6801","nonce":1915668731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6803","nonce":1915668731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":1915668731}]},"public_addr":"172.21.15.71:6800/1915668731","cluster_addr":"172.21.15.71:6801/1915668731","heartbeat_back_addr":"172.21.15.71:6803/1915668731","heartbeat_front_addr":"172.21.15.71:6802/1915668731","state":["exists","up"]},{"osd":5,"uuid":"e36a71dd-5088-4bff-965e-7dc8708ef7e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":466,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":1932648316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6805","nonce":1932648316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6807","nonce":1932648316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":1932648316}]},"public_addr":"172.21.15.71:6804/1932648316","cluster_addr":"172.21.15.71:6805/1932648316","heartbeat_back_addr":"172.21.15.71:6807/1932648316","heartbeat_front_addr":"172.21.15.71:6806/1932648316","state":["exists","up"]},{"osd":6,"uuid":"210a8790-78b6-4efa-a969-17efb17e9c0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":494,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":3724399458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6809","nonce":3724399458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6811","nonce":3724399458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":3724399458}]},"public_addr":"172.21.15.71:6808/3724399458","cluster_addr":"172.21.15.71:6809/3724399458","heartbeat_back_addr":"172.21.15.71:6811/3724399458","heartbeat_front_addr":"172.21.15.71:6810/3724399458","state":["exists","up"]},{"osd":7,"uuid":"9778a0e9-2ff3-4700-bf2a-675edaba630b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":50,"last_clean_end":432,"up_from":446,"up_thru":466,"down_at":433,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":3959966129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6813","nonce":3959966129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6815","nonce":3959966129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":3959966129}]},"public_addr":"172.21.15.71:6812/3959966129","cluster_addr":"172.21.15.71:6813/3959966129","heartbeat_back_addr":"172.21.15.71:6815/3959966129","heartbeat_front_addr":"172.21.15.71:6814/3959966129","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-10T08:41:43.400200+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-10T08:42:15.463857+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-10T08:42:23.999487+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-10T08:41:42.065080+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-10T08:42:24.554346+0000","dead_epoch":453},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-10T08:42:22.966518+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-10T08:42:12.132660+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-10T08:42:11.935291+0000","dead_epoch":432}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":0}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"5.1b","mappings":[{"from":0,"to":6}]},{"pgid":"6.0","mappings":[{"from":2,"to":1}]},{"pgid":"6.7","mappings":[{"from":5,"to":0}]},{"pgid":"6.8","mappings":[{"from":2,"to":4}]},{"pgid":"6.f","mappings":[{"from":2,"to":0}]},{"pgid":"6.14","mappings":[{"from":2,"to":0}]},{"pgid":"6.23","mappings":[{"from":6,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:6800/542054629":"2024-02-11T08:17:16.433947+0000","172.21.15.18:0/491217791":"2024-02-11T08:17:16.433947+0000","172.21.15.18:0/781076548":"2024-02-11T08:17:16.433947+0000","172.21.15.18:0/957318754":"2024-02-11T08:17:16.433947+0000","172.21.15.18:0/2662732452":"2024-02-11T08:11:55.105124+0000","172.21.15.18:0/1407788916":"2024-02-11T08:11:55.105124+0000","172.21.15.18:6800/3798687064":"2024-02-11T08:11:55.105124+0000","172.21.15.18:6800/3570839557":"2024-02-11T08:11:31.445897+0000","172.21.15.18:0/541168116":"2024-02-11T08:11:31.445897+0000","172.21.15.18:0/806236095":"2024-02-11T08:11:31.445897+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-10T08:42:33.998 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:32.431227+0000 osd.3 (osd.3) 141 : cluster [DBG] 5.17 scrub starts 2024-02-10T08:42:33.998 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:32.433357+0000 osd.3 (osd.3) 142 : cluster [DBG] 5.17 scrub ok 2024-02-10T08:42:33.999 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:42:33.283844+0000 mon.c (mon.2) 118 : audit [DBG] from='client.? 172.21.15.18:0/2327153516' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-10T08:42:33.999 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:32.431227+0000 osd.3 (osd.3) 141 : cluster [DBG] 5.17 scrub starts 2024-02-10T08:42:33.999 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:32.433357+0000 osd.3 (osd.3) 142 : cluster [DBG] 5.17 scrub ok 2024-02-10T08:42:33.999 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:42:33.283844+0000 mon.c (mon.2) 118 : audit [DBG] from='client.? 172.21.15.18:0/2327153516' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-10T08:42:34.025 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-02-10T08:42:34.026 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd dump --format=json 2024-02-10T08:42:34.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:32.431227+0000 osd.3 (osd.3) 141 : cluster [DBG] 5.17 scrub starts 2024-02-10T08:42:34.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:32.433357+0000 osd.3 (osd.3) 142 : cluster [DBG] 5.17 scrub ok 2024-02-10T08:42:34.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:42:33.283844+0000 mon.c (mon.2) 118 : audit [DBG] from='client.? 172.21.15.18:0/2327153516' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-10T08:42:34.313 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:42:34.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:33.223990+0000 osd.4 (osd.4) 59 : cluster [DBG] 6.17 scrub starts 2024-02-10T08:42:34.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:33.247663+0000 mgr.y (mgr.14505) 962 : cluster [DBG] pgmap v1203: 162 pgs: 162 active+clean; 5.7 KiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-02-10T08:42:34.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:33.292735+0000 osd.4 (osd.4) 60 : cluster [DBG] 6.17 scrub ok 2024-02-10T08:42:34.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:33.223990+0000 osd.4 (osd.4) 59 : cluster [DBG] 6.17 scrub starts 2024-02-10T08:42:34.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:33.247663+0000 mgr.y (mgr.14505) 962 : cluster [DBG] pgmap v1203: 162 pgs: 162 active+clean; 5.7 KiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-02-10T08:42:34.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:33.292735+0000 osd.4 (osd.4) 60 : cluster [DBG] 6.17 scrub ok 2024-02-10T08:42:35.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:33.223990+0000 osd.4 (osd.4) 59 : cluster [DBG] 6.17 scrub starts 2024-02-10T08:42:35.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:33.247663+0000 mgr.y (mgr.14505) 962 : cluster [DBG] pgmap v1203: 162 pgs: 162 active+clean; 5.7 KiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-02-10T08:42:35.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:33.292735+0000 osd.4 (osd.4) 60 : cluster [DBG] 6.17 scrub ok 2024-02-10T08:42:36.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:34.249780+0000 osd.4 (osd.4) 61 : cluster [DBG] 5.1 deep-scrub starts 2024-02-10T08:42:36.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:34.252740+0000 osd.4 (osd.4) 62 : cluster [DBG] 5.1 deep-scrub ok 2024-02-10T08:42:36.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:34.336846+0000 osd.6 (osd.6) 341 : cluster [DBG] 2.17 scrub starts 2024-02-10T08:42:36.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:34.339747+0000 osd.6 (osd.6) 342 : cluster [DBG] 2.17 scrub ok 2024-02-10T08:42:36.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:34.763352+0000 osd.5 (osd.5) 344 : cluster [DBG] 5.15 scrub starts 2024-02-10T08:42:36.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:34.766862+0000 osd.5 (osd.5) 345 : cluster [DBG] 5.15 scrub ok 2024-02-10T08:42:36.087 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:34.249780+0000 osd.4 (osd.4) 61 : cluster [DBG] 5.1 deep-scrub starts 2024-02-10T08:42:36.087 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:34.252740+0000 osd.4 (osd.4) 62 : cluster [DBG] 5.1 deep-scrub ok 2024-02-10T08:42:36.087 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:34.336846+0000 osd.6 (osd.6) 341 : cluster [DBG] 2.17 scrub starts 2024-02-10T08:42:36.087 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:34.339747+0000 osd.6 (osd.6) 342 : cluster [DBG] 2.17 scrub ok 2024-02-10T08:42:36.087 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:34.763352+0000 osd.5 (osd.5) 344 : cluster [DBG] 5.15 scrub starts 2024-02-10T08:42:36.087 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:34.766862+0000 osd.5 (osd.5) 345 : cluster [DBG] 5.15 scrub ok 2024-02-10T08:42:36.087 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:34.249780+0000 osd.4 (osd.4) 61 : cluster [DBG] 5.1 deep-scrub starts 2024-02-10T08:42:36.087 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:34.252740+0000 osd.4 (osd.4) 62 : cluster [DBG] 5.1 deep-scrub ok 2024-02-10T08:42:36.087 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:34.336846+0000 osd.6 (osd.6) 341 : cluster [DBG] 2.17 scrub starts 2024-02-10T08:42:36.088 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:34.339747+0000 osd.6 (osd.6) 342 : cluster [DBG] 2.17 scrub ok 2024-02-10T08:42:36.088 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:34.763352+0000 osd.5 (osd.5) 344 : cluster [DBG] 5.15 scrub starts 2024-02-10T08:42:36.088 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:34.766862+0000 osd.5 (osd.5) 345 : cluster [DBG] 5.15 scrub ok 2024-02-10T08:42:36.568 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:42:36.568 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":506,"fsid":"d46257c8-c7eb-11ee-95b8-87774f69a715","created":"2024-02-10T08:10:57.425061+0000","modified":"2024-02-10T08:42:31.122531+0000","last_up_change":"2024-02-10T08:41:08.747778+0000","last_in_change":"2024-02-10T08:41:13.105431+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":21,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-02-10T08:14:44.034966+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":11,"pg_placement_num":11,"pg_placement_num_target":11,"pg_num_target":11,"pg_num_pending":11,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"469","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"409","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":".rgw.root","create_time":"2024-02-10T08:16:51.334631+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":3,"pool_name":"iscsi","create_time":"2024-02-10T08:16:51.762963+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":3,"pg_placement_num":3,"pg_placement_num_target":3,"pg_num_target":3,"pg_num_pending":3,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"424","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":4,"pool_name":"default.rgw.log","create_time":"2024-02-10T08:16:53.258098+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"205","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":5,"pool_name":"default.rgw.control","create_time":"2024-02-10T08:16:55.289300+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":6,"pool_name":"default.rgw.meta","create_time":"2024-02-10T08:16:57.354868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":52,"pg_placement_num":52,"pg_placement_num_target":52,"pg_num_target":52,"pg_num_pending":52,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"471","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"287","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}}}],"osds":[{"osd":0,"uuid":"f9043fee-a3ed-4e16-921d-bb86756d0c48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":466,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6801","nonce":276034406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":276034406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":276034406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6803","nonce":276034406}]},"public_addr":"172.21.15.18:6801/276034406","cluster_addr":"172.21.15.18:6802/276034406","heartbeat_back_addr":"172.21.15.18:6804/276034406","heartbeat_front_addr":"172.21.15.18:6803/276034406","state":["exists","up"]},{"osd":1,"uuid":"ff958272-ce6b-4162-959a-6da9729e537b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":466,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6805","nonce":1941014296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1941014296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1941014296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6807","nonce":1941014296}]},"public_addr":"172.21.15.18:6805/1941014296","cluster_addr":"172.21.15.18:6806/1941014296","heartbeat_back_addr":"172.21.15.18:6808/1941014296","heartbeat_front_addr":"172.21.15.18:6807/1941014296","state":["exists","up"]},{"osd":2,"uuid":"29bb47e2-5c81-4ae8-bb9f-d1b02ea01d3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":498,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6809","nonce":3122474567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":3122474567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":3122474567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6811","nonce":3122474567}]},"public_addr":"172.21.15.18:6809/3122474567","cluster_addr":"172.21.15.18:6810/3122474567","heartbeat_back_addr":"172.21.15.18:6812/3122474567","heartbeat_front_addr":"172.21.15.18:6811/3122474567","state":["exists","up"]},{"osd":3,"uuid":"87ad37de-5f49-4e5b-9683-3bb9c3e33907","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":487,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6813","nonce":3484706437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":3484706437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3484706437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6815","nonce":3484706437}]},"public_addr":"172.21.15.18:6813/3484706437","cluster_addr":"172.21.15.18:6814/3484706437","heartbeat_back_addr":"172.21.15.18:6816/3484706437","heartbeat_front_addr":"172.21.15.18:6815/3484706437","state":["exists","up"]},{"osd":4,"uuid":"f5708f20-f98d-4d12-b8ae-71a5049a14cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":110,"last_clean_end":453,"up_from":463,"up_thru":466,"down_at":454,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":1915668731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6801","nonce":1915668731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6803","nonce":1915668731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":1915668731}]},"public_addr":"172.21.15.71:6800/1915668731","cluster_addr":"172.21.15.71:6801/1915668731","heartbeat_back_addr":"172.21.15.71:6803/1915668731","heartbeat_front_addr":"172.21.15.71:6802/1915668731","state":["exists","up"]},{"osd":5,"uuid":"e36a71dd-5088-4bff-965e-7dc8708ef7e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":466,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":1932648316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6805","nonce":1932648316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6807","nonce":1932648316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":1932648316}]},"public_addr":"172.21.15.71:6804/1932648316","cluster_addr":"172.21.15.71:6805/1932648316","heartbeat_back_addr":"172.21.15.71:6807/1932648316","heartbeat_front_addr":"172.21.15.71:6806/1932648316","state":["exists","up"]},{"osd":6,"uuid":"210a8790-78b6-4efa-a969-17efb17e9c0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":494,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":3724399458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6809","nonce":3724399458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6811","nonce":3724399458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":3724399458}]},"public_addr":"172.21.15.71:6808/3724399458","cluster_addr":"172.21.15.71:6809/3724399458","heartbeat_back_addr":"172.21.15.71:6811/3724399458","heartbeat_front_addr":"172.21.15.71:6810/3724399458","state":["exists","up"]},{"osd":7,"uuid":"9778a0e9-2ff3-4700-bf2a-675edaba630b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":50,"last_clean_end":432,"up_from":446,"up_thru":466,"down_at":433,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":3959966129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6813","nonce":3959966129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6815","nonce":3959966129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":3959966129}]},"public_addr":"172.21.15.71:6812/3959966129","cluster_addr":"172.21.15.71:6813/3959966129","heartbeat_back_addr":"172.21.15.71:6815/3959966129","heartbeat_front_addr":"172.21.15.71:6814/3959966129","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-10T08:41:43.400200+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-10T08:42:15.463857+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-10T08:42:23.999487+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-10T08:41:42.065080+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-10T08:42:24.554346+0000","dead_epoch":453},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-10T08:42:22.966518+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-10T08:42:12.132660+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-10T08:42:11.935291+0000","dead_epoch":432}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":0}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"5.1b","mappings":[{"from":0,"to":6}]},{"pgid":"6.0","mappings":[{"from":2,"to":1}]},{"pgid":"6.7","mappings":[{"from":5,"to":0}]},{"pgid":"6.8","mappings":[{"from":2,"to":4}]},{"pgid":"6.f","mappings":[{"from":2,"to":0}]},{"pgid":"6.14","mappings":[{"from":2,"to":0}]},{"pgid":"6.23","mappings":[{"from":6,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:6800/542054629":"2024-02-11T08:17:16.433947+0000","172.21.15.18:0/491217791":"2024-02-11T08:17:16.433947+0000","172.21.15.18:0/781076548":"2024-02-11T08:17:16.433947+0000","172.21.15.18:0/957318754":"2024-02-11T08:17:16.433947+0000","172.21.15.18:0/2662732452":"2024-02-11T08:11:55.105124+0000","172.21.15.18:0/1407788916":"2024-02-11T08:11:55.105124+0000","172.21.15.18:6800/3798687064":"2024-02-11T08:11:55.105124+0000","172.21.15.18:6800/3570839557":"2024-02-11T08:11:31.445897+0000","172.21.15.18:0/541168116":"2024-02-11T08:11:31.445897+0000","172.21.15.18:0/806236095":"2024-02-11T08:11:31.445897+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-10T08:42:36.771 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:42:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:42:36] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:42:36.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:35.248186+0000 mgr.y (mgr.14505) 963 : cluster [DBG] pgmap v1204: 162 pgs: 162 active+clean; 5.7 KiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:42:36.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:35.286253+0000 osd.4 (osd.4) 63 : cluster [DBG] 6.1e scrub starts 2024-02-10T08:42:36.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:35.287732+0000 osd.4 (osd.4) 64 : cluster [DBG] 6.1e scrub ok 2024-02-10T08:42:36.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:42:36.566891+0000 mon.a (mon.0) 1995 : audit [DBG] from='client.? 172.21.15.18:0/825471336' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-10T08:42:36.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:35.248186+0000 mgr.y (mgr.14505) 963 : cluster [DBG] pgmap v1204: 162 pgs: 162 active+clean; 5.7 KiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:42:36.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:35.286253+0000 osd.4 (osd.4) 63 : cluster [DBG] 6.1e scrub starts 2024-02-10T08:42:36.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:35.287732+0000 osd.4 (osd.4) 64 : cluster [DBG] 6.1e scrub ok 2024-02-10T08:42:36.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:42:36.566891+0000 mon.a (mon.0) 1995 : audit [DBG] from='client.? 172.21.15.18:0/825471336' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-10T08:42:37.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:35.248186+0000 mgr.y (mgr.14505) 963 : cluster [DBG] pgmap v1204: 162 pgs: 162 active+clean; 5.7 KiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:42:37.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:35.286253+0000 osd.4 (osd.4) 63 : cluster [DBG] 6.1e scrub starts 2024-02-10T08:42:37.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:35.287732+0000 osd.4 (osd.4) 64 : cluster [DBG] 6.1e scrub ok 2024-02-10T08:42:37.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:42:36.566891+0000 mon.a (mon.0) 1995 : audit [DBG] from='client.? 172.21.15.18:0/825471336' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-10T08:42:37.371 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:42:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:42:37] "GET /metrics HTTP/1.1" 200 174120 "" "Prometheus/2.33.4" 2024-02-10T08:42:37.391 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph tell osd.0 flush_pg_stats 2024-02-10T08:42:37.674 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:42:38.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:36.754122+0000 osd.5 (osd.5) 346 : cluster [DBG] 4.15 scrub starts 2024-02-10T08:42:38.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:36.757624+0000 osd.5 (osd.5) 347 : cluster [DBG] 4.15 scrub ok 2024-02-10T08:42:38.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:36.754122+0000 osd.5 (osd.5) 346 : cluster [DBG] 4.15 scrub starts 2024-02-10T08:42:38.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:36.757624+0000 osd.5 (osd.5) 347 : cluster [DBG] 4.15 scrub ok 2024-02-10T08:42:38.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:36.754122+0000 osd.5 (osd.5) 346 : cluster [DBG] 4.15 scrub starts 2024-02-10T08:42:38.154 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:36.757624+0000 osd.5 (osd.5) 347 : cluster [DBG] 4.15 scrub ok 2024-02-10T08:42:38.995 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:37.248626+0000 mgr.y (mgr.14505) 964 : cluster [DBG] pgmap v1205: 162 pgs: 162 active+clean; 5.7 KiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-10T08:42:38.995 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:37.594436+0000 osd.0 (osd.0) 344 : cluster [DBG] 4.16 scrub starts 2024-02-10T08:42:38.996 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:37.597911+0000 osd.0 (osd.0) 345 : cluster [DBG] 4.16 scrub ok 2024-02-10T08:42:38.996 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:38.001861+0000 osd.1 (osd.1) 383 : cluster [DBG] 4.4 deep-scrub starts 2024-02-10T08:42:38.996 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:38.010918+0000 osd.1 (osd.1) 384 : cluster [DBG] 4.4 deep-scrub ok 2024-02-10T08:42:38.996 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:37.248626+0000 mgr.y (mgr.14505) 964 : cluster [DBG] pgmap v1205: 162 pgs: 162 active+clean; 5.7 KiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-10T08:42:38.996 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:37.594436+0000 osd.0 (osd.0) 344 : cluster [DBG] 4.16 scrub starts 2024-02-10T08:42:38.996 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:37.597911+0000 osd.0 (osd.0) 345 : cluster [DBG] 4.16 scrub ok 2024-02-10T08:42:38.996 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:38.001861+0000 osd.1 (osd.1) 383 : cluster [DBG] 4.4 deep-scrub starts 2024-02-10T08:42:38.996 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:38.010918+0000 osd.1 (osd.1) 384 : cluster [DBG] 4.4 deep-scrub ok 2024-02-10T08:42:39.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:37.248626+0000 mgr.y (mgr.14505) 964 : cluster [DBG] pgmap v1205: 162 pgs: 162 active+clean; 5.7 KiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-10T08:42:39.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:37.594436+0000 osd.0 (osd.0) 344 : cluster [DBG] 4.16 scrub starts 2024-02-10T08:42:39.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:37.597911+0000 osd.0 (osd.0) 345 : cluster [DBG] 4.16 scrub ok 2024-02-10T08:42:39.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:38.001861+0000 osd.1 (osd.1) 383 : cluster [DBG] 4.4 deep-scrub starts 2024-02-10T08:42:39.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:38.010918+0000 osd.1 (osd.1) 384 : cluster [DBG] 4.4 deep-scrub ok 2024-02-10T08:42:39.539 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:42:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:42:39.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:38.562592+0000 osd.3 (osd.3) 143 : cluster [DBG] 6.1f scrub starts 2024-02-10T08:42:39.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:38.587373+0000 osd.0 (osd.0) 346 : cluster [DBG] 5.5 deep-scrub starts 2024-02-10T08:42:39.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:38.588369+0000 osd.0 (osd.0) 347 : cluster [DBG] 5.5 deep-scrub ok 2024-02-10T08:42:39.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:38.699562+0000 osd.3 (osd.3) 144 : cluster [DBG] 6.1f scrub ok 2024-02-10T08:42:39.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:38.562592+0000 osd.3 (osd.3) 143 : cluster [DBG] 6.1f scrub starts 2024-02-10T08:42:39.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:38.587373+0000 osd.0 (osd.0) 346 : cluster [DBG] 5.5 deep-scrub starts 2024-02-10T08:42:39.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:38.588369+0000 osd.0 (osd.0) 347 : cluster [DBG] 5.5 deep-scrub ok 2024-02-10T08:42:39.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:38.699562+0000 osd.3 (osd.3) 144 : cluster [DBG] 6.1f scrub ok 2024-02-10T08:42:40.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:38.562592+0000 osd.3 (osd.3) 143 : cluster [DBG] 6.1f scrub starts 2024-02-10T08:42:40.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:38.587373+0000 osd.0 (osd.0) 346 : cluster [DBG] 5.5 deep-scrub starts 2024-02-10T08:42:40.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:38.588369+0000 osd.0 (osd.0) 347 : cluster [DBG] 5.5 deep-scrub ok 2024-02-10T08:42:40.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:38.699562+0000 osd.3 (osd.3) 144 : cluster [DBG] 6.1f scrub ok 2024-02-10T08:42:40.581 INFO:teuthology.orchestra.run.smithi018.stdout:34359738715 2024-02-10T08:42:40.582 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph tell osd.1 flush_pg_stats 2024-02-10T08:42:40.866 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:42:40.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:42:39.173336+0000 mgr.y (mgr.14505) 965 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:42:40.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:39.249286+0000 mgr.y (mgr.14505) 966 : cluster [DBG] pgmap v1206: 162 pgs: 162 active+clean; 5.7 KiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-02-10T08:42:40.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:40.299997+0000 osd.7 (osd.7) 59 : cluster [DBG] 5.9 deep-scrub starts 2024-02-10T08:42:40.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:40.302549+0000 osd.7 (osd.7) 60 : cluster [DBG] 5.9 deep-scrub ok 2024-02-10T08:42:40.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:42:39.173336+0000 mgr.y (mgr.14505) 965 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:42:40.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:39.249286+0000 mgr.y (mgr.14505) 966 : cluster [DBG] pgmap v1206: 162 pgs: 162 active+clean; 5.7 KiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-02-10T08:42:40.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:40.299997+0000 osd.7 (osd.7) 59 : cluster [DBG] 5.9 deep-scrub starts 2024-02-10T08:42:40.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:40.302549+0000 osd.7 (osd.7) 60 : cluster [DBG] 5.9 deep-scrub ok 2024-02-10T08:42:41.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:42:39.173336+0000 mgr.y (mgr.14505) 965 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:42:41.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:39.249286+0000 mgr.y (mgr.14505) 966 : cluster [DBG] pgmap v1206: 162 pgs: 162 active+clean; 5.7 KiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-02-10T08:42:41.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:40.299997+0000 osd.7 (osd.7) 59 : cluster [DBG] 5.9 deep-scrub starts 2024-02-10T08:42:41.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:40.302549+0000 osd.7 (osd.7) 60 : cluster [DBG] 5.9 deep-scrub ok 2024-02-10T08:42:42.314 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:40.951405+0000 osd.1 (osd.1) 385 : cluster [DBG] 2.9 deep-scrub starts 2024-02-10T08:42:42.314 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:40.954509+0000 osd.1 (osd.1) 386 : cluster [DBG] 2.9 deep-scrub ok 2024-02-10T08:42:42.314 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:41.249666+0000 mgr.y (mgr.14505) 967 : cluster [DBG] pgmap v1207: 162 pgs: 162 active+clean; 5.7 KiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 1011 B/s rd, 0 op/s 2024-02-10T08:42:42.315 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:41.687528+0000 osd.5 (osd.5) 348 : cluster [DBG] 1.8 scrub starts 2024-02-10T08:42:42.315 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:41.690741+0000 osd.5 (osd.5) 349 : cluster [DBG] 1.8 scrub ok 2024-02-10T08:42:42.315 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:40.951405+0000 osd.1 (osd.1) 385 : cluster [DBG] 2.9 deep-scrub starts 2024-02-10T08:42:42.315 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:40.954509+0000 osd.1 (osd.1) 386 : cluster [DBG] 2.9 deep-scrub ok 2024-02-10T08:42:42.315 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:41.249666+0000 mgr.y (mgr.14505) 967 : cluster [DBG] pgmap v1207: 162 pgs: 162 active+clean; 5.7 KiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 1011 B/s rd, 0 op/s 2024-02-10T08:42:42.315 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:41.687528+0000 osd.5 (osd.5) 348 : cluster [DBG] 1.8 scrub starts 2024-02-10T08:42:42.315 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:42 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:41.690741+0000 osd.5 (osd.5) 349 : cluster [DBG] 1.8 scrub ok 2024-02-10T08:42:42.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:40.951405+0000 osd.1 (osd.1) 385 : cluster [DBG] 2.9 deep-scrub starts 2024-02-10T08:42:42.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:40.954509+0000 osd.1 (osd.1) 386 : cluster [DBG] 2.9 deep-scrub ok 2024-02-10T08:42:42.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:41.249666+0000 mgr.y (mgr.14505) 967 : cluster [DBG] pgmap v1207: 162 pgs: 162 active+clean; 5.7 KiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 1011 B/s rd, 0 op/s 2024-02-10T08:42:42.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:41.687528+0000 osd.5 (osd.5) 348 : cluster [DBG] 1.8 scrub starts 2024-02-10T08:42:42.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:41.690741+0000 osd.5 (osd.5) 349 : cluster [DBG] 1.8 scrub ok 2024-02-10T08:42:43.397 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:41.985475+0000 osd.1 (osd.1) 387 : cluster [DBG] 5.1d scrub starts 2024-02-10T08:42:43.397 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:41.988543+0000 osd.1 (osd.1) 388 : cluster [DBG] 5.1d scrub ok 2024-02-10T08:42:43.397 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:42.337694+0000 osd.7 (osd.7) 61 : cluster [DBG] 2.1d scrub starts 2024-02-10T08:42:43.397 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:42.339270+0000 osd.7 (osd.7) 62 : cluster [DBG] 2.1d scrub ok 2024-02-10T08:42:43.397 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:42.702475+0000 osd.5 (osd.5) 350 : cluster [DBG] 6.d scrub starts 2024-02-10T08:42:43.397 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:42.723701+0000 osd.5 (osd.5) 351 : cluster [DBG] 6.d scrub ok 2024-02-10T08:42:43.398 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:41.985475+0000 osd.1 (osd.1) 387 : cluster [DBG] 5.1d scrub starts 2024-02-10T08:42:43.398 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:41.988543+0000 osd.1 (osd.1) 388 : cluster [DBG] 5.1d scrub ok 2024-02-10T08:42:43.398 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:42.337694+0000 osd.7 (osd.7) 61 : cluster [DBG] 2.1d scrub starts 2024-02-10T08:42:43.398 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:42.339270+0000 osd.7 (osd.7) 62 : cluster [DBG] 2.1d scrub ok 2024-02-10T08:42:43.398 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:42.702475+0000 osd.5 (osd.5) 350 : cluster [DBG] 6.d scrub starts 2024-02-10T08:42:43.398 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:43 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:42.723701+0000 osd.5 (osd.5) 351 : cluster [DBG] 6.d scrub ok 2024-02-10T08:42:43.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:43 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:41.985475+0000 osd.1 (osd.1) 387 : cluster [DBG] 5.1d scrub starts 2024-02-10T08:42:43.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:43 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:41.988543+0000 osd.1 (osd.1) 388 : cluster [DBG] 5.1d scrub ok 2024-02-10T08:42:43.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:43 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:42.337694+0000 osd.7 (osd.7) 61 : cluster [DBG] 2.1d scrub starts 2024-02-10T08:42:43.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:43 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:42.339270+0000 osd.7 (osd.7) 62 : cluster [DBG] 2.1d scrub ok 2024-02-10T08:42:43.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:43 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:42.702475+0000 osd.5 (osd.5) 350 : cluster [DBG] 6.d scrub starts 2024-02-10T08:42:43.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:43 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:42.723701+0000 osd.5 (osd.5) 351 : cluster [DBG] 6.d scrub ok 2024-02-10T08:42:43.785 INFO:teuthology.orchestra.run.smithi018.stdout:55834575190 2024-02-10T08:42:43.786 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph tell osd.2 flush_pg_stats 2024-02-10T08:42:44.069 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:42:44.141 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:42.281107+0000 osd.4 (osd.4) 65 : cluster [DBG] 4.9 scrub starts 2024-02-10T08:42:44.142 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:42.285006+0000 osd.4 (osd.4) 66 : cluster [DBG] 4.9 scrub ok 2024-02-10T08:42:44.142 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:43.250315+0000 mgr.y (mgr.14505) 968 : cluster [DBG] pgmap v1208: 162 pgs: 162 active+clean; 5.7 KiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:42:44.142 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:43.363692+0000 osd.7 (osd.7) 63 : cluster [DBG] 6.15 scrub starts 2024-02-10T08:42:44.142 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:43.386594+0000 osd.7 (osd.7) 64 : cluster [DBG] 6.15 scrub ok 2024-02-10T08:42:44.398 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:42.281107+0000 osd.4 (osd.4) 65 : cluster [DBG] 4.9 scrub starts 2024-02-10T08:42:44.399 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:42.285006+0000 osd.4 (osd.4) 66 : cluster [DBG] 4.9 scrub ok 2024-02-10T08:42:44.399 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:43.250315+0000 mgr.y (mgr.14505) 968 : cluster [DBG] pgmap v1208: 162 pgs: 162 active+clean; 5.7 KiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:42:44.399 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:43.363692+0000 osd.7 (osd.7) 63 : cluster [DBG] 6.15 scrub starts 2024-02-10T08:42:44.399 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:43.386594+0000 osd.7 (osd.7) 64 : cluster [DBG] 6.15 scrub ok 2024-02-10T08:42:44.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:44 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:42.281107+0000 osd.4 (osd.4) 65 : cluster [DBG] 4.9 scrub starts 2024-02-10T08:42:44.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:44 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:42.285006+0000 osd.4 (osd.4) 66 : cluster [DBG] 4.9 scrub ok 2024-02-10T08:42:44.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:44 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:43.250315+0000 mgr.y (mgr.14505) 968 : cluster [DBG] pgmap v1208: 162 pgs: 162 active+clean; 5.7 KiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:42:44.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:44 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:43.363692+0000 osd.7 (osd.7) 63 : cluster [DBG] 6.15 scrub starts 2024-02-10T08:42:44.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:44 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:43.386594+0000 osd.7 (osd.7) 64 : cluster [DBG] 6.15 scrub ok 2024-02-10T08:42:46.626 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:44.538025+0000 osd.3 (osd.3) 145 : cluster [DBG] 4.0 scrub starts 2024-02-10T08:42:46.626 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:44.541492+0000 osd.3 (osd.3) 146 : cluster [DBG] 4.0 scrub ok 2024-02-10T08:42:46.627 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:45.250962+0000 mgr.y (mgr.14505) 969 : cluster [DBG] pgmap v1209: 162 pgs: 162 active+clean; 5.7 KiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:42:46.627 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:45.475665+0000 osd.2 (osd.2) 317 : cluster [DBG] 4.1c deep-scrub starts 2024-02-10T08:42:46.627 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:45.477890+0000 osd.2 (osd.2) 318 : cluster [DBG] 4.1c deep-scrub ok 2024-02-10T08:42:46.627 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:44.538025+0000 osd.3 (osd.3) 145 : cluster [DBG] 4.0 scrub starts 2024-02-10T08:42:46.627 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:44.541492+0000 osd.3 (osd.3) 146 : cluster [DBG] 4.0 scrub ok 2024-02-10T08:42:46.627 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:45.250962+0000 mgr.y (mgr.14505) 969 : cluster [DBG] pgmap v1209: 162 pgs: 162 active+clean; 5.7 KiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:42:46.627 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:45.475665+0000 osd.2 (osd.2) 317 : cluster [DBG] 4.1c deep-scrub starts 2024-02-10T08:42:46.627 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:46 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:45.477890+0000 osd.2 (osd.2) 318 : cluster [DBG] 4.1c deep-scrub ok 2024-02-10T08:42:46.789 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:42:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:42:46] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:42:46.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:44.538025+0000 osd.3 (osd.3) 145 : cluster [DBG] 4.0 scrub starts 2024-02-10T08:42:46.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:44.541492+0000 osd.3 (osd.3) 146 : cluster [DBG] 4.0 scrub ok 2024-02-10T08:42:46.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:45.250962+0000 mgr.y (mgr.14505) 969 : cluster [DBG] pgmap v1209: 162 pgs: 162 active+clean; 5.7 KiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:42:46.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:45.475665+0000 osd.2 (osd.2) 317 : cluster [DBG] 4.1c deep-scrub starts 2024-02-10T08:42:46.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:45.477890+0000 osd.2 (osd.2) 318 : cluster [DBG] 4.1c deep-scrub ok 2024-02-10T08:42:46.976 INFO:teuthology.orchestra.run.smithi018.stdout:77309411667 2024-02-10T08:42:46.977 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph tell osd.3 flush_pg_stats 2024-02-10T08:42:47.255 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:42:47.404 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:42:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:42:47] "GET /metrics HTTP/1.1" 200 174129 "" "Prometheus/2.33.4" 2024-02-10T08:42:48.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:47.251415+0000 mgr.y (mgr.14505) 970 : cluster [DBG] pgmap v1210: 162 pgs: 162 active+clean; 5.7 KiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:42:48.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:47.371517+0000 osd.7 (osd.7) 65 : cluster [DBG] 5.1a deep-scrub starts 2024-02-10T08:42:48.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:47.372615+0000 osd.7 (osd.7) 66 : cluster [DBG] 5.1a deep-scrub ok 2024-02-10T08:42:48.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:47.473597+0000 osd.6 (osd.6) 343 : cluster [DBG] 5.11 scrub starts 2024-02-10T08:42:48.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:47.474611+0000 osd.6 (osd.6) 344 : cluster [DBG] 5.11 scrub ok 2024-02-10T08:42:48.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:47.251415+0000 mgr.y (mgr.14505) 970 : cluster [DBG] pgmap v1210: 162 pgs: 162 active+clean; 5.7 KiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:42:48.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:47.371517+0000 osd.7 (osd.7) 65 : cluster [DBG] 5.1a deep-scrub starts 2024-02-10T08:42:48.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:47.372615+0000 osd.7 (osd.7) 66 : cluster [DBG] 5.1a deep-scrub ok 2024-02-10T08:42:48.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:47.473597+0000 osd.6 (osd.6) 343 : cluster [DBG] 5.11 scrub starts 2024-02-10T08:42:48.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:48 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:47.474611+0000 osd.6 (osd.6) 344 : cluster [DBG] 5.11 scrub ok 2024-02-10T08:42:48.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:47.251415+0000 mgr.y (mgr.14505) 970 : cluster [DBG] pgmap v1210: 162 pgs: 162 active+clean; 5.7 KiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:42:48.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:47.371517+0000 osd.7 (osd.7) 65 : cluster [DBG] 5.1a deep-scrub starts 2024-02-10T08:42:48.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:47.372615+0000 osd.7 (osd.7) 66 : cluster [DBG] 5.1a deep-scrub ok 2024-02-10T08:42:48.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:47.473597+0000 osd.6 (osd.6) 343 : cluster [DBG] 5.11 scrub starts 2024-02-10T08:42:48.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:48 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:47.474611+0000 osd.6 (osd.6) 344 : cluster [DBG] 5.11 scrub ok 2024-02-10T08:42:49.391 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:47.482355+0000 osd.3 (osd.3) 147 : cluster [DBG] 3.2 scrub starts 2024-02-10T08:42:49.391 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:47.485332+0000 osd.3 (osd.3) 148 : cluster [DBG] 3.2 scrub ok 2024-02-10T08:42:49.391 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:48.584183+0000 osd.0 (osd.0) 348 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:42:49.391 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:48.584224+0000 osd.0 (osd.0) 349 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:42:49.391 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:47.482355+0000 osd.3 (osd.3) 147 : cluster [DBG] 3.2 scrub starts 2024-02-10T08:42:49.391 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:47.485332+0000 osd.3 (osd.3) 148 : cluster [DBG] 3.2 scrub ok 2024-02-10T08:42:49.392 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:48.584183+0000 osd.0 (osd.0) 348 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:42:49.392 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:48.584224+0000 osd.0 (osd.0) 349 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:42:49.539 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:42:49 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:42:49.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:49 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:47.482355+0000 osd.3 (osd.3) 147 : cluster [DBG] 3.2 scrub starts 2024-02-10T08:42:49.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:49 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:47.485332+0000 osd.3 (osd.3) 148 : cluster [DBG] 3.2 scrub ok 2024-02-10T08:42:49.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:49 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:48.584183+0000 osd.0 (osd.0) 348 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:42:49.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:49 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:48.584224+0000 osd.0 (osd.0) 349 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:42:50.157 INFO:teuthology.orchestra.run.smithi018.stdout:107374182735 2024-02-10T08:42:50.158 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph tell osd.4 flush_pg_stats 2024-02-10T08:42:50.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:48.514243+0000 osd.3 (osd.3) 149 : cluster [DBG] 4.14 scrub starts 2024-02-10T08:42:50.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:48.516058+0000 osd.3 (osd.3) 150 : cluster [DBG] 4.14 scrub ok 2024-02-10T08:42:50.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:42:49.177740+0000 mgr.y (mgr.14505) 971 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:42:50.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:49.252154+0000 mgr.y (mgr.14505) 972 : cluster [DBG] pgmap v1211: 162 pgs: 162 active+clean; 5.7 KiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:42:50.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:49.315421+0000 mon.a (mon.0) 1996 : cluster [DBG] osdmap e507: 8 total, 8 up, 8 in 2024-02-10T08:42:50.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:49.385801+0000 osd.0 (osd.0) 350 : cluster [DBG] 6.16 scrub starts 2024-02-10T08:42:50.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:49.389098+0000 osd.0 (osd.0) 351 : cluster [DBG] 6.16 scrub ok 2024-02-10T08:42:50.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:49.638322+0000 osd.5 (osd.5) 352 : cluster [DBG] 2.12 deep-scrub starts 2024-02-10T08:42:50.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:49.641254+0000 osd.5 (osd.5) 353 : cluster [DBG] 2.12 deep-scrub ok 2024-02-10T08:42:50.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:48.514243+0000 osd.3 (osd.3) 149 : cluster [DBG] 4.14 scrub starts 2024-02-10T08:42:50.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:48.516058+0000 osd.3 (osd.3) 150 : cluster [DBG] 4.14 scrub ok 2024-02-10T08:42:50.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:42:49.177740+0000 mgr.y (mgr.14505) 971 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:42:50.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:49.252154+0000 mgr.y (mgr.14505) 972 : cluster [DBG] pgmap v1211: 162 pgs: 162 active+clean; 5.7 KiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:42:50.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:49.315421+0000 mon.a (mon.0) 1996 : cluster [DBG] osdmap e507: 8 total, 8 up, 8 in 2024-02-10T08:42:50.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:49.385801+0000 osd.0 (osd.0) 350 : cluster [DBG] 6.16 scrub starts 2024-02-10T08:42:50.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:49.389098+0000 osd.0 (osd.0) 351 : cluster [DBG] 6.16 scrub ok 2024-02-10T08:42:50.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:49.638322+0000 osd.5 (osd.5) 352 : cluster [DBG] 2.12 deep-scrub starts 2024-02-10T08:42:50.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:50 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:49.641254+0000 osd.5 (osd.5) 353 : cluster [DBG] 2.12 deep-scrub ok 2024-02-10T08:42:50.444 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:42:50.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:48.514243+0000 osd.3 (osd.3) 149 : cluster [DBG] 4.14 scrub starts 2024-02-10T08:42:50.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:48.516058+0000 osd.3 (osd.3) 150 : cluster [DBG] 4.14 scrub ok 2024-02-10T08:42:50.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:42:49.177740+0000 mgr.y (mgr.14505) 971 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:42:50.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:49.252154+0000 mgr.y (mgr.14505) 972 : cluster [DBG] pgmap v1211: 162 pgs: 162 active+clean; 5.7 KiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:42:50.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:49.315421+0000 mon.a (mon.0) 1996 : cluster [DBG] osdmap e507: 8 total, 8 up, 8 in 2024-02-10T08:42:50.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:49.385801+0000 osd.0 (osd.0) 350 : cluster [DBG] 6.16 scrub starts 2024-02-10T08:42:50.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:49.389098+0000 osd.0 (osd.0) 351 : cluster [DBG] 6.16 scrub ok 2024-02-10T08:42:50.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:49.638322+0000 osd.5 (osd.5) 352 : cluster [DBG] 2.12 deep-scrub starts 2024-02-10T08:42:50.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:50 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:49.641254+0000 osd.5 (osd.5) 353 : cluster [DBG] 2.12 deep-scrub ok 2024-02-10T08:42:51.324 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:50.071298+0000 osd.3 (osd.3) 151 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:42:51.324 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:50.071363+0000 osd.3 (osd.3) 152 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:42:51.324 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:50.205648+0000 osd.4 (osd.4) 67 : cluster [DBG] 4.1 scrub starts 2024-02-10T08:42:51.324 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:50.209191+0000 osd.4 (osd.4) 68 : cluster [DBG] 4.1 scrub ok 2024-02-10T08:42:51.324 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:50.316265+0000 mon.a (mon.0) 1997 : cluster [DBG] osdmap e508: 8 total, 8 up, 8 in 2024-02-10T08:42:51.324 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:50.382335+0000 osd.7 (osd.7) 67 : cluster [DBG] 2.1c scrub starts 2024-02-10T08:42:51.324 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:50.383228+0000 osd.7 (osd.7) 68 : cluster [DBG] 2.1c scrub ok 2024-02-10T08:42:51.324 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:50.421213+0000 osd.0 (osd.0) 352 : cluster [DBG] 6.0 scrub starts 2024-02-10T08:42:51.324 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:50.424106+0000 osd.0 (osd.0) 353 : cluster [DBG] 6.0 scrub ok 2024-02-10T08:42:51.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:50.071298+0000 osd.3 (osd.3) 151 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:42:51.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:50.071363+0000 osd.3 (osd.3) 152 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:42:51.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:50.205648+0000 osd.4 (osd.4) 67 : cluster [DBG] 4.1 scrub starts 2024-02-10T08:42:51.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:50.209191+0000 osd.4 (osd.4) 68 : cluster [DBG] 4.1 scrub ok 2024-02-10T08:42:51.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:50.316265+0000 mon.a (mon.0) 1997 : cluster [DBG] osdmap e508: 8 total, 8 up, 8 in 2024-02-10T08:42:51.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:50.382335+0000 osd.7 (osd.7) 67 : cluster [DBG] 2.1c scrub starts 2024-02-10T08:42:51.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:50.383228+0000 osd.7 (osd.7) 68 : cluster [DBG] 2.1c scrub ok 2024-02-10T08:42:51.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:50.421213+0000 osd.0 (osd.0) 352 : cluster [DBG] 6.0 scrub starts 2024-02-10T08:42:51.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:51 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:50.424106+0000 osd.0 (osd.0) 353 : cluster [DBG] 6.0 scrub ok 2024-02-10T08:42:51.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:51 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:50.071298+0000 osd.3 (osd.3) 151 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:42:51.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:51 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:50.071363+0000 osd.3 (osd.3) 152 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:42:51.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:51 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:50.205648+0000 osd.4 (osd.4) 67 : cluster [DBG] 4.1 scrub starts 2024-02-10T08:42:51.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:51 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:50.209191+0000 osd.4 (osd.4) 68 : cluster [DBG] 4.1 scrub ok 2024-02-10T08:42:51.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:51 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:50.316265+0000 mon.a (mon.0) 1997 : cluster [DBG] osdmap e508: 8 total, 8 up, 8 in 2024-02-10T08:42:51.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:51 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:50.382335+0000 osd.7 (osd.7) 67 : cluster [DBG] 2.1c scrub starts 2024-02-10T08:42:51.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:51 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:50.383228+0000 osd.7 (osd.7) 68 : cluster [DBG] 2.1c scrub ok 2024-02-10T08:42:51.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:51 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:50.421213+0000 osd.0 (osd.0) 352 : cluster [DBG] 6.0 scrub starts 2024-02-10T08:42:51.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:51 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:50.424106+0000 osd.0 (osd.0) 353 : cluster [DBG] 6.0 scrub ok 2024-02-10T08:42:52.523 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:51.252566+0000 mgr.y (mgr.14505) 973 : cluster [DBG] pgmap v1214: 162 pgs: 162 active+clean; 5.7 KiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-10T08:42:52.523 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:51.376145+0000 osd.7 (osd.7) 69 : cluster [DBG] 2.b scrub starts 2024-02-10T08:42:52.523 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:51.377175+0000 osd.7 (osd.7) 70 : cluster [DBG] 2.b scrub ok 2024-02-10T08:42:52.523 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:51.592542+0000 osd.5 (osd.5) 354 : cluster [DBG] 4.8 scrub starts 2024-02-10T08:42:52.523 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:51.596005+0000 osd.5 (osd.5) 355 : cluster [DBG] 4.8 scrub ok 2024-02-10T08:42:52.523 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:42:51.608797+0000 mon.a (mon.0) 1998 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:42:52.524 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:42:52.029562+0000 mon.a (mon.0) 1999 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:42:52.524 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:42:52.030257+0000 mon.a (mon.0) 2000 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:42:52.524 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:42:52.034373+0000 mon.a (mon.0) 2001 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:42:52.524 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:51.252566+0000 mgr.y (mgr.14505) 973 : cluster [DBG] pgmap v1214: 162 pgs: 162 active+clean; 5.7 KiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-10T08:42:52.524 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:51.376145+0000 osd.7 (osd.7) 69 : cluster [DBG] 2.b scrub starts 2024-02-10T08:42:52.524 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:51.377175+0000 osd.7 (osd.7) 70 : cluster [DBG] 2.b scrub ok 2024-02-10T08:42:52.524 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:51.592542+0000 osd.5 (osd.5) 354 : cluster [DBG] 4.8 scrub starts 2024-02-10T08:42:52.524 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:51.596005+0000 osd.5 (osd.5) 355 : cluster [DBG] 4.8 scrub ok 2024-02-10T08:42:52.524 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:42:51.608797+0000 mon.a (mon.0) 1998 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:42:52.524 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:42:52.029562+0000 mon.a (mon.0) 1999 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:42:52.524 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:42:52.030257+0000 mon.a (mon.0) 2000 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:42:52.524 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:52 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:42:52.034373+0000 mon.a (mon.0) 2001 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:42:52.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:52 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:51.252566+0000 mgr.y (mgr.14505) 973 : cluster [DBG] pgmap v1214: 162 pgs: 162 active+clean; 5.7 KiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-10T08:42:52.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:52 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:51.376145+0000 osd.7 (osd.7) 69 : cluster [DBG] 2.b scrub starts 2024-02-10T08:42:52.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:52 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:51.377175+0000 osd.7 (osd.7) 70 : cluster [DBG] 2.b scrub ok 2024-02-10T08:42:52.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:52 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:51.592542+0000 osd.5 (osd.5) 354 : cluster [DBG] 4.8 scrub starts 2024-02-10T08:42:52.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:52 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:51.596005+0000 osd.5 (osd.5) 355 : cluster [DBG] 4.8 scrub ok 2024-02-10T08:42:52.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:52 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:42:51.608797+0000 mon.a (mon.0) 1998 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:42:52.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:52 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:42:52.029562+0000 mon.a (mon.0) 1999 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:42:52.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:52 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:42:52.030257+0000 mon.a (mon.0) 2000 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:42:52.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:52 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:42:52.034373+0000 mon.a (mon.0) 2001 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:42:53.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:52.078100+0000 osd.1 (osd.1) 389 : cluster [DBG] 2.15 scrub starts 2024-02-10T08:42:53.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:52.081138+0000 osd.1 (osd.1) 390 : cluster [DBG] 2.15 scrub ok 2024-02-10T08:42:53.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:52.419061+0000 osd.2 (osd.2) 319 : cluster [DBG] 6.28 scrub starts 2024-02-10T08:42:53.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:52.419989+0000 osd.2 (osd.2) 320 : cluster [DBG] 6.28 scrub ok 2024-02-10T08:42:53.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:52.078100+0000 osd.1 (osd.1) 389 : cluster [DBG] 2.15 scrub starts 2024-02-10T08:42:53.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:52.081138+0000 osd.1 (osd.1) 390 : cluster [DBG] 2.15 scrub ok 2024-02-10T08:42:53.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:52.419061+0000 osd.2 (osd.2) 319 : cluster [DBG] 6.28 scrub starts 2024-02-10T08:42:53.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:53 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:52.419989+0000 osd.2 (osd.2) 320 : cluster [DBG] 6.28 scrub ok 2024-02-10T08:42:53.712 INFO:teuthology.orchestra.run.smithi018.stdout:1988569858070 2024-02-10T08:42:53.713 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph tell osd.5 flush_pg_stats 2024-02-10T08:42:53.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:53 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:52.078100+0000 osd.1 (osd.1) 389 : cluster [DBG] 2.15 scrub starts 2024-02-10T08:42:53.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:53 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:52.081138+0000 osd.1 (osd.1) 390 : cluster [DBG] 2.15 scrub ok 2024-02-10T08:42:53.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:53 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:52.419061+0000 osd.2 (osd.2) 319 : cluster [DBG] 6.28 scrub starts 2024-02-10T08:42:53.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:53 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:52.419989+0000 osd.2 (osd.2) 320 : cluster [DBG] 6.28 scrub ok 2024-02-10T08:42:53.999 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:42:54.563 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:52.514537+0000 osd.3 (osd.3) 153 : cluster [DBG] 5.0 deep-scrub starts 2024-02-10T08:42:54.563 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:52.518089+0000 osd.3 (osd.3) 154 : cluster [DBG] 5.0 deep-scrub ok 2024-02-10T08:42:54.563 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:53.253520+0000 mgr.y (mgr.14505) 974 : cluster [DBG] pgmap v1215: 162 pgs: 162 active+clean; 5.7 KiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:42:54.563 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:53.422798+0000 osd.6 (osd.6) 345 : cluster [DBG] 6.2e scrub starts 2024-02-10T08:42:54.563 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:53.426158+0000 osd.6 (osd.6) 346 : cluster [DBG] 6.2e scrub ok 2024-02-10T08:42:54.564 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:53.445257+0000 osd.2 (osd.2) 321 : cluster [DBG] 4.f deep-scrub starts 2024-02-10T08:42:54.564 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:53.450695+0000 osd.2 (osd.2) 322 : cluster [DBG] 4.f deep-scrub ok 2024-02-10T08:42:54.564 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:52.514537+0000 osd.3 (osd.3) 153 : cluster [DBG] 5.0 deep-scrub starts 2024-02-10T08:42:54.564 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:52.518089+0000 osd.3 (osd.3) 154 : cluster [DBG] 5.0 deep-scrub ok 2024-02-10T08:42:54.564 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:53.253520+0000 mgr.y (mgr.14505) 974 : cluster [DBG] pgmap v1215: 162 pgs: 162 active+clean; 5.7 KiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:42:54.564 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:53.422798+0000 osd.6 (osd.6) 345 : cluster [DBG] 6.2e scrub starts 2024-02-10T08:42:54.564 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:53.426158+0000 osd.6 (osd.6) 346 : cluster [DBG] 6.2e scrub ok 2024-02-10T08:42:54.564 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:53.445257+0000 osd.2 (osd.2) 321 : cluster [DBG] 4.f deep-scrub starts 2024-02-10T08:42:54.564 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:54 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:53.450695+0000 osd.2 (osd.2) 322 : cluster [DBG] 4.f deep-scrub ok 2024-02-10T08:42:54.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:54 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:52.514537+0000 osd.3 (osd.3) 153 : cluster [DBG] 5.0 deep-scrub starts 2024-02-10T08:42:54.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:54 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:52.518089+0000 osd.3 (osd.3) 154 : cluster [DBG] 5.0 deep-scrub ok 2024-02-10T08:42:54.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:54 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:53.253520+0000 mgr.y (mgr.14505) 974 : cluster [DBG] pgmap v1215: 162 pgs: 162 active+clean; 5.7 KiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:42:54.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:54 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:53.422798+0000 osd.6 (osd.6) 345 : cluster [DBG] 6.2e scrub starts 2024-02-10T08:42:54.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:54 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:53.426158+0000 osd.6 (osd.6) 346 : cluster [DBG] 6.2e scrub ok 2024-02-10T08:42:54.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:54 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:53.445257+0000 osd.2 (osd.2) 321 : cluster [DBG] 4.f deep-scrub starts 2024-02-10T08:42:54.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:54 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:53.450695+0000 osd.2 (osd.2) 322 : cluster [DBG] 4.f deep-scrub ok 2024-02-10T08:42:55.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:53.486188+0000 osd.3 (osd.3) 155 : cluster [DBG] 6.6 scrub starts 2024-02-10T08:42:55.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:53.487492+0000 osd.3 (osd.3) 156 : cluster [DBG] 6.6 scrub ok 2024-02-10T08:42:55.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:54.448680+0000 osd.6 (osd.6) 347 : cluster [DBG] 2.1a scrub starts 2024-02-10T08:42:55.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:54.449727+0000 osd.6 (osd.6) 348 : cluster [DBG] 2.1a scrub ok 2024-02-10T08:42:55.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:53.486188+0000 osd.3 (osd.3) 155 : cluster [DBG] 6.6 scrub starts 2024-02-10T08:42:55.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:53.487492+0000 osd.3 (osd.3) 156 : cluster [DBG] 6.6 scrub ok 2024-02-10T08:42:55.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:54.448680+0000 osd.6 (osd.6) 347 : cluster [DBG] 2.1a scrub starts 2024-02-10T08:42:55.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:54.449727+0000 osd.6 (osd.6) 348 : cluster [DBG] 2.1a scrub ok 2024-02-10T08:42:55.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:53.486188+0000 osd.3 (osd.3) 155 : cluster [DBG] 6.6 scrub starts 2024-02-10T08:42:55.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:53.487492+0000 osd.3 (osd.3) 156 : cluster [DBG] 6.6 scrub ok 2024-02-10T08:42:55.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:54.448680+0000 osd.6 (osd.6) 347 : cluster [DBG] 2.1a scrub starts 2024-02-10T08:42:55.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:55 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:54.449727+0000 osd.6 (osd.6) 348 : cluster [DBG] 2.1a scrub ok 2024-02-10T08:42:56.336 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:54.461427+0000 osd.3 (osd.3) 157 : cluster [DBG] 2.1b scrub starts 2024-02-10T08:42:56.336 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:54.464300+0000 osd.3 (osd.3) 158 : cluster [DBG] 2.1b scrub ok 2024-02-10T08:42:56.336 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:55.254209+0000 mgr.y (mgr.14505) 975 : cluster [DBG] pgmap v1216: 162 pgs: 162 active+clean; 5.7 KiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:42:56.336 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:55.452779+0000 osd.3 (osd.3) 159 : cluster [DBG] 4.10 scrub starts 2024-02-10T08:42:56.337 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:55.456255+0000 osd.3 (osd.3) 160 : cluster [DBG] 4.10 scrub ok 2024-02-10T08:42:56.337 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:54.461427+0000 osd.3 (osd.3) 157 : cluster [DBG] 2.1b scrub starts 2024-02-10T08:42:56.337 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:54.464300+0000 osd.3 (osd.3) 158 : cluster [DBG] 2.1b scrub ok 2024-02-10T08:42:56.337 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:55.254209+0000 mgr.y (mgr.14505) 975 : cluster [DBG] pgmap v1216: 162 pgs: 162 active+clean; 5.7 KiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:42:56.337 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:55.452779+0000 osd.3 (osd.3) 159 : cluster [DBG] 4.10 scrub starts 2024-02-10T08:42:56.337 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:56 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:55.456255+0000 osd.3 (osd.3) 160 : cluster [DBG] 4.10 scrub ok 2024-02-10T08:42:56.789 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:42:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:42:56] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:42:56.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:54.461427+0000 osd.3 (osd.3) 157 : cluster [DBG] 2.1b scrub starts 2024-02-10T08:42:56.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:54.464300+0000 osd.3 (osd.3) 158 : cluster [DBG] 2.1b scrub ok 2024-02-10T08:42:56.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:55.254209+0000 mgr.y (mgr.14505) 975 : cluster [DBG] pgmap v1216: 162 pgs: 162 active+clean; 5.7 KiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:42:56.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:55.452779+0000 osd.3 (osd.3) 159 : cluster [DBG] 4.10 scrub starts 2024-02-10T08:42:56.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:56 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:55.456255+0000 osd.3 (osd.3) 160 : cluster [DBG] 4.10 scrub ok 2024-02-10T08:42:56.898 INFO:teuthology.orchestra.run.smithi018.stdout:158913790279 2024-02-10T08:42:56.899 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph tell osd.6 flush_pg_stats 2024-02-10T08:42:57.182 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:42:57.404 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:42:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:42:57] "GET /metrics HTTP/1.1" 200 174129 "" "Prometheus/2.33.4" 2024-02-10T08:42:57.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:56.029257+0000 osd.1 (osd.1) 391 : cluster [DBG] 6.1d scrub starts 2024-02-10T08:42:57.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:56.083410+0000 osd.1 (osd.1) 392 : cluster [DBG] 6.1d scrub ok 2024-02-10T08:42:57.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:56.201086+0000 osd.4 (osd.4) 69 : cluster [DBG] 4.1a scrub starts 2024-02-10T08:42:57.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:56.204910+0000 osd.4 (osd.4) 70 : cluster [DBG] 4.1a scrub ok 2024-02-10T08:42:57.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:56.410059+0000 osd.7 (osd.7) 71 : cluster [DBG] 5.4 scrub starts 2024-02-10T08:42:57.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:56.411027+0000 osd.7 (osd.7) 72 : cluster [DBG] 5.4 scrub ok 2024-02-10T08:42:57.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:56.029257+0000 osd.1 (osd.1) 391 : cluster [DBG] 6.1d scrub starts 2024-02-10T08:42:57.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:56.083410+0000 osd.1 (osd.1) 392 : cluster [DBG] 6.1d scrub ok 2024-02-10T08:42:57.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:56.201086+0000 osd.4 (osd.4) 69 : cluster [DBG] 4.1a scrub starts 2024-02-10T08:42:57.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:56.204910+0000 osd.4 (osd.4) 70 : cluster [DBG] 4.1a scrub ok 2024-02-10T08:42:57.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:56.410059+0000 osd.7 (osd.7) 71 : cluster [DBG] 5.4 scrub starts 2024-02-10T08:42:57.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:57 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:56.411027+0000 osd.7 (osd.7) 72 : cluster [DBG] 5.4 scrub ok 2024-02-10T08:42:57.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:56.029257+0000 osd.1 (osd.1) 391 : cluster [DBG] 6.1d scrub starts 2024-02-10T08:42:57.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:56.083410+0000 osd.1 (osd.1) 392 : cluster [DBG] 6.1d scrub ok 2024-02-10T08:42:57.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:56.201086+0000 osd.4 (osd.4) 69 : cluster [DBG] 4.1a scrub starts 2024-02-10T08:42:57.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:56.204910+0000 osd.4 (osd.4) 70 : cluster [DBG] 4.1a scrub ok 2024-02-10T08:42:57.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:56.410059+0000 osd.7 (osd.7) 71 : cluster [DBG] 5.4 scrub starts 2024-02-10T08:42:57.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:57 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:56.411027+0000 osd.7 (osd.7) 72 : cluster [DBG] 5.4 scrub ok 2024-02-10T08:42:58.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:57.254889+0000 mgr.y (mgr.14505) 976 : cluster [DBG] pgmap v1217: 162 pgs: 162 active+clean; 5.7 KiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-10T08:42:58.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:57.492091+0000 osd.2 (osd.2) 323 : cluster [DBG] 5.a scrub starts 2024-02-10T08:42:58.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:57.493897+0000 osd.2 (osd.2) 324 : cluster [DBG] 5.a scrub ok 2024-02-10T08:42:58.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:57.526937+0000 osd.0 (osd.0) 354 : cluster [DBG] 4.3 scrub starts 2024-02-10T08:42:58.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:57.528940+0000 osd.0 (osd.0) 355 : cluster [DBG] 4.3 scrub ok 2024-02-10T08:42:58.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:57.600930+0000 osd.5 (osd.5) 356 : cluster [DBG] 5.7 scrub starts 2024-02-10T08:42:58.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:57.603910+0000 osd.5 (osd.5) 357 : cluster [DBG] 5.7 scrub ok 2024-02-10T08:42:58.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:57.254889+0000 mgr.y (mgr.14505) 976 : cluster [DBG] pgmap v1217: 162 pgs: 162 active+clean; 5.7 KiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-10T08:42:58.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:57.492091+0000 osd.2 (osd.2) 323 : cluster [DBG] 5.a scrub starts 2024-02-10T08:42:58.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:57.493897+0000 osd.2 (osd.2) 324 : cluster [DBG] 5.a scrub ok 2024-02-10T08:42:58.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:57.526937+0000 osd.0 (osd.0) 354 : cluster [DBG] 4.3 scrub starts 2024-02-10T08:42:58.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:57.528940+0000 osd.0 (osd.0) 355 : cluster [DBG] 4.3 scrub ok 2024-02-10T08:42:58.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:57.600930+0000 osd.5 (osd.5) 356 : cluster [DBG] 5.7 scrub starts 2024-02-10T08:42:58.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:58 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:57.603910+0000 osd.5 (osd.5) 357 : cluster [DBG] 5.7 scrub ok 2024-02-10T08:42:58.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:57.254889+0000 mgr.y (mgr.14505) 976 : cluster [DBG] pgmap v1217: 162 pgs: 162 active+clean; 5.7 KiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-10T08:42:58.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:57.492091+0000 osd.2 (osd.2) 323 : cluster [DBG] 5.a scrub starts 2024-02-10T08:42:58.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:57.493897+0000 osd.2 (osd.2) 324 : cluster [DBG] 5.a scrub ok 2024-02-10T08:42:58.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:57.526937+0000 osd.0 (osd.0) 354 : cluster [DBG] 4.3 scrub starts 2024-02-10T08:42:58.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:57.528940+0000 osd.0 (osd.0) 355 : cluster [DBG] 4.3 scrub ok 2024-02-10T08:42:58.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:57.600930+0000 osd.5 (osd.5) 356 : cluster [DBG] 5.7 scrub starts 2024-02-10T08:42:58.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:58 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:57.603910+0000 osd.5 (osd.5) 357 : cluster [DBG] 5.7 scrub ok 2024-02-10T08:42:59.539 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:42:59 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:42:59.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:59 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:58.185886+0000 osd.4 (osd.4) 71 : cluster [DBG] 5.1c scrub starts 2024-02-10T08:42:59.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:59 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:58.188854+0000 osd.4 (osd.4) 72 : cluster [DBG] 5.1c scrub ok 2024-02-10T08:42:59.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:59 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:58.454123+0000 osd.7 (osd.7) 73 : cluster [DBG] 2.8 scrub starts 2024-02-10T08:42:59.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:42:59 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:58.455321+0000 osd.7 (osd.7) 74 : cluster [DBG] 2.8 scrub ok 2024-02-10T08:42:59.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:58.185886+0000 osd.4 (osd.4) 71 : cluster [DBG] 5.1c scrub starts 2024-02-10T08:42:59.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:58.188854+0000 osd.4 (osd.4) 72 : cluster [DBG] 5.1c scrub ok 2024-02-10T08:42:59.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:58.454123+0000 osd.7 (osd.7) 73 : cluster [DBG] 2.8 scrub starts 2024-02-10T08:42:59.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:42:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:58.455321+0000 osd.7 (osd.7) 74 : cluster [DBG] 2.8 scrub ok 2024-02-10T08:42:59.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:58.185886+0000 osd.4 (osd.4) 71 : cluster [DBG] 5.1c scrub starts 2024-02-10T08:42:59.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:58.188854+0000 osd.4 (osd.4) 72 : cluster [DBG] 5.1c scrub ok 2024-02-10T08:42:59.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:58.454123+0000 osd.7 (osd.7) 73 : cluster [DBG] 2.8 scrub starts 2024-02-10T08:42:59.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:42:59 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:58.455321+0000 osd.7 (osd.7) 74 : cluster [DBG] 2.8 scrub ok 2024-02-10T08:43:00.048 INFO:teuthology.orchestra.run.smithi018.stdout:184683594051 2024-02-10T08:43:00.048 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph tell osd.7 flush_pg_stats 2024-02-10T08:43:00.331 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:43:00.348 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:42:59.181838+0000 mgr.y (mgr.14505) 977 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:43:00.348 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:59.255523+0000 mgr.y (mgr.14505) 978 : cluster [DBG] pgmap v1218: 162 pgs: 162 active+clean; 5.7 KiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-02-10T08:43:00.348 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:59.431348+0000 osd.7 (osd.7) 75 : cluster [DBG] 6.1c scrub starts 2024-02-10T08:43:00.348 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:59.433058+0000 osd.7 (osd.7) 76 : cluster [DBG] 6.1c scrub ok 2024-02-10T08:43:00.348 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:59.560107+0000 osd.0 (osd.0) 356 : cluster [DBG] 4.6 scrub starts 2024-02-10T08:43:00.348 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:42:59.563590+0000 osd.0 (osd.0) 357 : cluster [DBG] 4.6 scrub ok 2024-02-10T08:43:00.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:42:59.181838+0000 mgr.y (mgr.14505) 977 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:43:00.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:59.255523+0000 mgr.y (mgr.14505) 978 : cluster [DBG] pgmap v1218: 162 pgs: 162 active+clean; 5.7 KiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-02-10T08:43:00.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:59.431348+0000 osd.7 (osd.7) 75 : cluster [DBG] 6.1c scrub starts 2024-02-10T08:43:00.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:59.433058+0000 osd.7 (osd.7) 76 : cluster [DBG] 6.1c scrub ok 2024-02-10T08:43:00.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:59.560107+0000 osd.0 (osd.0) 356 : cluster [DBG] 4.6 scrub starts 2024-02-10T08:43:00.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:00 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:42:59.563590+0000 osd.0 (osd.0) 357 : cluster [DBG] 4.6 scrub ok 2024-02-10T08:43:00.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:42:59.181838+0000 mgr.y (mgr.14505) 977 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:43:00.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:59.255523+0000 mgr.y (mgr.14505) 978 : cluster [DBG] pgmap v1218: 162 pgs: 162 active+clean; 5.7 KiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-02-10T08:43:00.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:59.431348+0000 osd.7 (osd.7) 75 : cluster [DBG] 6.1c scrub starts 2024-02-10T08:43:00.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:59.433058+0000 osd.7 (osd.7) 76 : cluster [DBG] 6.1c scrub ok 2024-02-10T08:43:00.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:59.560107+0000 osd.0 (osd.0) 356 : cluster [DBG] 4.6 scrub starts 2024-02-10T08:43:00.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:00 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:42:59.563590+0000 osd.0 (osd.0) 357 : cluster [DBG] 4.6 scrub ok 2024-02-10T08:43:01.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:00.445732+0000 osd.3 (osd.3) 161 : cluster [DBG] 4.19 scrub starts 2024-02-10T08:43:01.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:00.449253+0000 osd.3 (osd.3) 162 : cluster [DBG] 4.19 scrub ok 2024-02-10T08:43:01.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:00.556725+0000 osd.0 (osd.0) 358 : cluster [DBG] 3.1 deep-scrub starts 2024-02-10T08:43:01.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:00.559785+0000 osd.0 (osd.0) 359 : cluster [DBG] 3.1 deep-scrub ok 2024-02-10T08:43:01.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:00.574240+0000 osd.5 (osd.5) 358 : cluster [DBG] 2.3 scrub starts 2024-02-10T08:43:01.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:00.577129+0000 osd.5 (osd.5) 359 : cluster [DBG] 2.3 scrub ok 2024-02-10T08:43:01.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:00.445732+0000 osd.3 (osd.3) 161 : cluster [DBG] 4.19 scrub starts 2024-02-10T08:43:01.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:00.449253+0000 osd.3 (osd.3) 162 : cluster [DBG] 4.19 scrub ok 2024-02-10T08:43:01.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:00.556725+0000 osd.0 (osd.0) 358 : cluster [DBG] 3.1 deep-scrub starts 2024-02-10T08:43:01.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:00.559785+0000 osd.0 (osd.0) 359 : cluster [DBG] 3.1 deep-scrub ok 2024-02-10T08:43:01.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:00.574240+0000 osd.5 (osd.5) 358 : cluster [DBG] 2.3 scrub starts 2024-02-10T08:43:01.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:00.577129+0000 osd.5 (osd.5) 359 : cluster [DBG] 2.3 scrub ok 2024-02-10T08:43:01.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:00.445732+0000 osd.3 (osd.3) 161 : cluster [DBG] 4.19 scrub starts 2024-02-10T08:43:01.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:00.449253+0000 osd.3 (osd.3) 162 : cluster [DBG] 4.19 scrub ok 2024-02-10T08:43:01.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:00.556725+0000 osd.0 (osd.0) 358 : cluster [DBG] 3.1 deep-scrub starts 2024-02-10T08:43:01.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:00.559785+0000 osd.0 (osd.0) 359 : cluster [DBG] 3.1 deep-scrub ok 2024-02-10T08:43:01.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:00.574240+0000 osd.5 (osd.5) 358 : cluster [DBG] 2.3 scrub starts 2024-02-10T08:43:01.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:00.577129+0000 osd.5 (osd.5) 359 : cluster [DBG] 2.3 scrub ok 2024-02-10T08:43:02.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:01.256132+0000 mgr.y (mgr.14505) 979 : cluster [DBG] pgmap v1219: 162 pgs: 162 active+clean; 5.7 KiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 935 B/s rd, 0 op/s 2024-02-10T08:43:02.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:01.414437+0000 osd.6 (osd.6) 349 : cluster [DBG] 2.14 scrub starts 2024-02-10T08:43:02.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:01.417326+0000 osd.6 (osd.6) 350 : cluster [DBG] 2.14 scrub ok 2024-02-10T08:43:02.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:01.435797+0000 osd.7 (osd.7) 77 : cluster [DBG] 2.5 deep-scrub starts 2024-02-10T08:43:02.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:01.436652+0000 osd.7 (osd.7) 78 : cluster [DBG] 2.5 deep-scrub ok 2024-02-10T08:43:02.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:01.256132+0000 mgr.y (mgr.14505) 979 : cluster [DBG] pgmap v1219: 162 pgs: 162 active+clean; 5.7 KiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 935 B/s rd, 0 op/s 2024-02-10T08:43:02.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:01.414437+0000 osd.6 (osd.6) 349 : cluster [DBG] 2.14 scrub starts 2024-02-10T08:43:02.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:01.417326+0000 osd.6 (osd.6) 350 : cluster [DBG] 2.14 scrub ok 2024-02-10T08:43:02.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:01.435797+0000 osd.7 (osd.7) 77 : cluster [DBG] 2.5 deep-scrub starts 2024-02-10T08:43:02.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:02 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:01.436652+0000 osd.7 (osd.7) 78 : cluster [DBG] 2.5 deep-scrub ok 2024-02-10T08:43:02.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:01.256132+0000 mgr.y (mgr.14505) 979 : cluster [DBG] pgmap v1219: 162 pgs: 162 active+clean; 5.7 KiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 935 B/s rd, 0 op/s 2024-02-10T08:43:02.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:01.414437+0000 osd.6 (osd.6) 349 : cluster [DBG] 2.14 scrub starts 2024-02-10T08:43:02.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:01.417326+0000 osd.6 (osd.6) 350 : cluster [DBG] 2.14 scrub ok 2024-02-10T08:43:02.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:01.435797+0000 osd.7 (osd.7) 77 : cluster [DBG] 2.5 deep-scrub starts 2024-02-10T08:43:02.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:02 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:01.436652+0000 osd.7 (osd.7) 78 : cluster [DBG] 2.5 deep-scrub ok 2024-02-10T08:43:03.169 INFO:teuthology.orchestra.run.smithi018.stdout:1915555414056 2024-02-10T08:43:03.169 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd last-stat-seq osd.0 2024-02-10T08:43:03.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:02.398179+0000 osd.6 (osd.6) 351 : cluster [DBG] 4.1f scrub starts 2024-02-10T08:43:03.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:02.401799+0000 osd.6 (osd.6) 352 : cluster [DBG] 4.1f scrub ok 2024-02-10T08:43:03.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:02.398179+0000 osd.6 (osd.6) 351 : cluster [DBG] 4.1f scrub starts 2024-02-10T08:43:03.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:02.401799+0000 osd.6 (osd.6) 352 : cluster [DBG] 4.1f scrub ok 2024-02-10T08:43:03.456 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:43:03.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:02.398179+0000 osd.6 (osd.6) 351 : cluster [DBG] 4.1f scrub starts 2024-02-10T08:43:03.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:03 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:02.401799+0000 osd.6 (osd.6) 352 : cluster [DBG] 4.1f scrub ok 2024-02-10T08:43:04.357 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:03.256810+0000 mgr.y (mgr.14505) 980 : cluster [DBG] pgmap v1220: 162 pgs: 162 active+clean; 5.7 KiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:43:04.357 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:03.456211+0000 osd.0 (osd.0) 360 : cluster [DBG] 6.f scrub starts 2024-02-10T08:43:04.357 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:03.490777+0000 osd.2 (osd.2) 325 : cluster [DBG] 5.d scrub starts 2024-02-10T08:43:04.357 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:03.492641+0000 osd.2 (osd.2) 326 : cluster [DBG] 5.d scrub ok 2024-02-10T08:43:04.357 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:03.580733+0000 osd.0 (osd.0) 361 : cluster [DBG] 6.f scrub ok 2024-02-10T08:43:04.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:03.256810+0000 mgr.y (mgr.14505) 980 : cluster [DBG] pgmap v1220: 162 pgs: 162 active+clean; 5.7 KiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:43:04.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:03.456211+0000 osd.0 (osd.0) 360 : cluster [DBG] 6.f scrub starts 2024-02-10T08:43:04.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:03.490777+0000 osd.2 (osd.2) 325 : cluster [DBG] 5.d scrub starts 2024-02-10T08:43:04.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:03.492641+0000 osd.2 (osd.2) 326 : cluster [DBG] 5.d scrub ok 2024-02-10T08:43:04.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:04 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:03.580733+0000 osd.0 (osd.0) 361 : cluster [DBG] 6.f scrub ok 2024-02-10T08:43:04.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:03.256810+0000 mgr.y (mgr.14505) 980 : cluster [DBG] pgmap v1220: 162 pgs: 162 active+clean; 5.7 KiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:43:04.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:03.456211+0000 osd.0 (osd.0) 360 : cluster [DBG] 6.f scrub starts 2024-02-10T08:43:04.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:03.490777+0000 osd.2 (osd.2) 325 : cluster [DBG] 5.d scrub starts 2024-02-10T08:43:04.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:03.492641+0000 osd.2 (osd.2) 326 : cluster [DBG] 5.d scrub ok 2024-02-10T08:43:04.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:04 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:03.580733+0000 osd.0 (osd.0) 361 : cluster [DBG] 6.f scrub ok 2024-02-10T08:43:05.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:04.172772+0000 osd.4 (osd.4) 73 : cluster [DBG] 6.1a scrub starts 2024-02-10T08:43:05.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:04.175677+0000 osd.4 (osd.4) 74 : cluster [DBG] 6.1a scrub ok 2024-02-10T08:43:05.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:04.527447+0000 osd.5 (osd.5) 360 : cluster [DBG] 6.a scrub starts 2024-02-10T08:43:05.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:04.530362+0000 osd.5 (osd.5) 361 : cluster [DBG] 6.a scrub ok 2024-02-10T08:43:05.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:04.172772+0000 osd.4 (osd.4) 73 : cluster [DBG] 6.1a scrub starts 2024-02-10T08:43:05.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:04.175677+0000 osd.4 (osd.4) 74 : cluster [DBG] 6.1a scrub ok 2024-02-10T08:43:05.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:04.527447+0000 osd.5 (osd.5) 360 : cluster [DBG] 6.a scrub starts 2024-02-10T08:43:05.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:05 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:04.530362+0000 osd.5 (osd.5) 361 : cluster [DBG] 6.a scrub ok 2024-02-10T08:43:05.696 INFO:teuthology.orchestra.run.smithi018.stdout:34359738720 2024-02-10T08:43:05.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:04.172772+0000 osd.4 (osd.4) 73 : cluster [DBG] 6.1a scrub starts 2024-02-10T08:43:05.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:04.175677+0000 osd.4 (osd.4) 74 : cluster [DBG] 6.1a scrub ok 2024-02-10T08:43:05.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:04.527447+0000 osd.5 (osd.5) 360 : cluster [DBG] 6.a scrub starts 2024-02-10T08:43:05.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:05 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:04.530362+0000 osd.5 (osd.5) 361 : cluster [DBG] 6.a scrub ok 2024-02-10T08:43:06.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:05.210147+0000 osd.4 (osd.4) 75 : cluster [DBG] 4.c scrub starts 2024-02-10T08:43:06.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:05.213732+0000 osd.4 (osd.4) 76 : cluster [DBG] 4.c scrub ok 2024-02-10T08:43:06.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:05.257461+0000 mgr.y (mgr.14505) 981 : cluster [DBG] pgmap v1221: 162 pgs: 1 active+clean+scrubbing, 161 active+clean; 5.7 KiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:43:06.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:05.376634+0000 osd.6 (osd.6) 353 : cluster [DBG] 5.2 scrub starts 2024-02-10T08:43:06.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:05.377611+0000 osd.6 (osd.6) 354 : cluster [DBG] 5.2 scrub ok 2024-02-10T08:43:06.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:05.467953+0000 osd.2 (osd.2) 327 : cluster [DBG] 5.6 deep-scrub starts 2024-02-10T08:43:06.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:05.469052+0000 osd.2 (osd.2) 328 : cluster [DBG] 5.6 deep-scrub ok 2024-02-10T08:43:06.405 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:43:05.696834+0000 mon.c (mon.2) 119 : audit [DBG] from='client.? 172.21.15.18:0/59414943' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-02-10T08:43:06.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:05.210147+0000 osd.4 (osd.4) 75 : cluster [DBG] 4.c scrub starts 2024-02-10T08:43:06.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:05.213732+0000 osd.4 (osd.4) 76 : cluster [DBG] 4.c scrub ok 2024-02-10T08:43:06.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:05.257461+0000 mgr.y (mgr.14505) 981 : cluster [DBG] pgmap v1221: 162 pgs: 1 active+clean+scrubbing, 161 active+clean; 5.7 KiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:43:06.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:05.376634+0000 osd.6 (osd.6) 353 : cluster [DBG] 5.2 scrub starts 2024-02-10T08:43:06.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:05.377611+0000 osd.6 (osd.6) 354 : cluster [DBG] 5.2 scrub ok 2024-02-10T08:43:06.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:05.467953+0000 osd.2 (osd.2) 327 : cluster [DBG] 5.6 deep-scrub starts 2024-02-10T08:43:06.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:05.469052+0000 osd.2 (osd.2) 328 : cluster [DBG] 5.6 deep-scrub ok 2024-02-10T08:43:06.406 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:06 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:43:05.696834+0000 mon.c (mon.2) 119 : audit [DBG] from='client.? 172.21.15.18:0/59414943' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-02-10T08:43:06.521 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738715 got 34359738720 for osd.0 2024-02-10T08:43:06.521 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd last-stat-seq osd.1 2024-02-10T08:43:06.789 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:43:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:43:06] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:43:06.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:05.210147+0000 osd.4 (osd.4) 75 : cluster [DBG] 4.c scrub starts 2024-02-10T08:43:06.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:05.213732+0000 osd.4 (osd.4) 76 : cluster [DBG] 4.c scrub ok 2024-02-10T08:43:06.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:05.257461+0000 mgr.y (mgr.14505) 981 : cluster [DBG] pgmap v1221: 162 pgs: 1 active+clean+scrubbing, 161 active+clean; 5.7 KiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:43:06.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:05.376634+0000 osd.6 (osd.6) 353 : cluster [DBG] 5.2 scrub starts 2024-02-10T08:43:06.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:05.377611+0000 osd.6 (osd.6) 354 : cluster [DBG] 5.2 scrub ok 2024-02-10T08:43:06.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:05.467953+0000 osd.2 (osd.2) 327 : cluster [DBG] 5.6 deep-scrub starts 2024-02-10T08:43:06.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:05.469052+0000 osd.2 (osd.2) 328 : cluster [DBG] 5.6 deep-scrub ok 2024-02-10T08:43:06.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:06 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:43:05.696834+0000 mon.c (mon.2) 119 : audit [DBG] from='client.? 172.21.15.18:0/59414943' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-02-10T08:43:06.805 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:43:07.334 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:43:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:43:07] "GET /metrics HTTP/1.1" 200 174127 "" "Prometheus/2.33.4" 2024-02-10T08:43:07.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:06.091576+0000 osd.1 (osd.1) 393 : cluster [DBG] 2.d scrub starts 2024-02-10T08:43:07.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:06.094467+0000 osd.1 (osd.1) 394 : cluster [DBG] 2.d scrub ok 2024-02-10T08:43:07.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:06.091576+0000 osd.1 (osd.1) 393 : cluster [DBG] 2.d scrub starts 2024-02-10T08:43:07.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:07 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:06.094467+0000 osd.1 (osd.1) 394 : cluster [DBG] 2.d scrub ok 2024-02-10T08:43:07.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:06.091576+0000 osd.1 (osd.1) 393 : cluster [DBG] 2.d scrub starts 2024-02-10T08:43:07.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:06.094467+0000 osd.1 (osd.1) 394 : cluster [DBG] 2.d scrub ok 2024-02-10T08:43:08.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:07.258006+0000 mgr.y (mgr.14505) 982 : cluster [DBG] pgmap v1222: 162 pgs: 1 active+clean+scrubbing, 161 active+clean; 5.7 KiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:43:08.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:07.527327+0000 osd.2 (osd.2) 329 : cluster [DBG] 5.8 scrub starts 2024-02-10T08:43:08.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:07.528140+0000 osd.2 (osd.2) 330 : cluster [DBG] 5.8 scrub ok 2024-02-10T08:43:08.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:07.544227+0000 osd.5 (osd.5) 362 : cluster [DBG] 6.24 scrub starts 2024-02-10T08:43:08.404 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:07.547109+0000 osd.5 (osd.5) 363 : cluster [DBG] 6.24 scrub ok 2024-02-10T08:43:08.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:07.258006+0000 mgr.y (mgr.14505) 982 : cluster [DBG] pgmap v1222: 162 pgs: 1 active+clean+scrubbing, 161 active+clean; 5.7 KiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:43:08.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:07.527327+0000 osd.2 (osd.2) 329 : cluster [DBG] 5.8 scrub starts 2024-02-10T08:43:08.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:07.528140+0000 osd.2 (osd.2) 330 : cluster [DBG] 5.8 scrub ok 2024-02-10T08:43:08.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:07.544227+0000 osd.5 (osd.5) 362 : cluster [DBG] 6.24 scrub starts 2024-02-10T08:43:08.405 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:08 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:07.547109+0000 osd.5 (osd.5) 363 : cluster [DBG] 6.24 scrub ok 2024-02-10T08:43:08.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:07.258006+0000 mgr.y (mgr.14505) 982 : cluster [DBG] pgmap v1222: 162 pgs: 1 active+clean+scrubbing, 161 active+clean; 5.7 KiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:43:08.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:07.527327+0000 osd.2 (osd.2) 329 : cluster [DBG] 5.8 scrub starts 2024-02-10T08:43:08.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:07.528140+0000 osd.2 (osd.2) 330 : cluster [DBG] 5.8 scrub ok 2024-02-10T08:43:08.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:07.544227+0000 osd.5 (osd.5) 362 : cluster [DBG] 6.24 scrub starts 2024-02-10T08:43:08.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:08 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:07.547109+0000 osd.5 (osd.5) 363 : cluster [DBG] 6.24 scrub ok 2024-02-10T08:43:08.841 INFO:teuthology.orchestra.run.smithi018.stdout:55834575195 2024-02-10T08:43:09.539 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:43:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:43:09.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:08.197710+0000 osd.4 (osd.4) 77 : cluster [DBG] 4.18 scrub starts 2024-02-10T08:43:09.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:08.201245+0000 osd.4 (osd.4) 78 : cluster [DBG] 4.18 scrub ok 2024-02-10T08:43:09.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:08.520193+0000 osd.0 (osd.0) 362 : cluster [DBG] 6.7 scrub starts 2024-02-10T08:43:09.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:08.591185+0000 osd.0 (osd.0) 363 : cluster [DBG] 6.7 scrub ok 2024-02-10T08:43:09.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:09 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:43:08.841692+0000 mon.a (mon.0) 2002 : audit [DBG] from='client.? 172.21.15.18:0/1917699731' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-02-10T08:43:09.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:08.197710+0000 osd.4 (osd.4) 77 : cluster [DBG] 4.18 scrub starts 2024-02-10T08:43:09.637 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:08.201245+0000 osd.4 (osd.4) 78 : cluster [DBG] 4.18 scrub ok 2024-02-10T08:43:09.637 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:08.520193+0000 osd.0 (osd.0) 362 : cluster [DBG] 6.7 scrub starts 2024-02-10T08:43:09.637 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:08.591185+0000 osd.0 (osd.0) 363 : cluster [DBG] 6.7 scrub ok 2024-02-10T08:43:09.637 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:43:08.841692+0000 mon.a (mon.0) 2002 : audit [DBG] from='client.? 172.21.15.18:0/1917699731' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-02-10T08:43:09.637 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:08.197710+0000 osd.4 (osd.4) 77 : cluster [DBG] 4.18 scrub starts 2024-02-10T08:43:09.637 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:08.201245+0000 osd.4 (osd.4) 78 : cluster [DBG] 4.18 scrub ok 2024-02-10T08:43:09.637 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:08.520193+0000 osd.0 (osd.0) 362 : cluster [DBG] 6.7 scrub starts 2024-02-10T08:43:09.637 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:08.591185+0000 osd.0 (osd.0) 363 : cluster [DBG] 6.7 scrub ok 2024-02-10T08:43:09.637 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:09 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:43:08.841692+0000 mon.a (mon.0) 2002 : audit [DBG] from='client.? 172.21.15.18:0/1917699731' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-02-10T08:43:09.656 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834575190 got 55834575195 for osd.1 2024-02-10T08:43:09.657 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd last-stat-seq osd.2 2024-02-10T08:43:09.937 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:43:10.448 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:43:09.192972+0000 mgr.y (mgr.14505) 983 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:43:10.448 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:09.246035+0000 osd.4 (osd.4) 79 : cluster [DBG] 6.2 scrub starts 2024-02-10T08:43:10.448 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:09.249092+0000 osd.4 (osd.4) 80 : cluster [DBG] 6.2 scrub ok 2024-02-10T08:43:10.448 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:09.258877+0000 mgr.y (mgr.14505) 984 : cluster [DBG] pgmap v1223: 162 pgs: 162 active+clean; 5.7 KiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:43:10.448 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:09.410567+0000 osd.3 (osd.3) 163 : cluster [DBG] 6.1b scrub starts 2024-02-10T08:43:10.448 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:09.514950+0000 osd.3 (osd.3) 164 : cluster [DBG] 6.1b scrub ok 2024-02-10T08:43:10.449 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:43:09.192972+0000 mgr.y (mgr.14505) 983 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:43:10.449 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:09.246035+0000 osd.4 (osd.4) 79 : cluster [DBG] 6.2 scrub starts 2024-02-10T08:43:10.449 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:09.249092+0000 osd.4 (osd.4) 80 : cluster [DBG] 6.2 scrub ok 2024-02-10T08:43:10.449 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:09.258877+0000 mgr.y (mgr.14505) 984 : cluster [DBG] pgmap v1223: 162 pgs: 162 active+clean; 5.7 KiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:43:10.449 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:09.410567+0000 osd.3 (osd.3) 163 : cluster [DBG] 6.1b scrub starts 2024-02-10T08:43:10.449 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:10 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:09.514950+0000 osd.3 (osd.3) 164 : cluster [DBG] 6.1b scrub ok 2024-02-10T08:43:10.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:43:09.192972+0000 mgr.y (mgr.14505) 983 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:43:10.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:09.246035+0000 osd.4 (osd.4) 79 : cluster [DBG] 6.2 scrub starts 2024-02-10T08:43:10.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:09.249092+0000 osd.4 (osd.4) 80 : cluster [DBG] 6.2 scrub ok 2024-02-10T08:43:10.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:09.258877+0000 mgr.y (mgr.14505) 984 : cluster [DBG] pgmap v1223: 162 pgs: 162 active+clean; 5.7 KiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:43:10.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:09.410567+0000 osd.3 (osd.3) 163 : cluster [DBG] 6.1b scrub starts 2024-02-10T08:43:10.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:10 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:09.514950+0000 osd.3 (osd.3) 164 : cluster [DBG] 6.1b scrub ok 2024-02-10T08:43:11.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:10.512177+0000 osd.5 (osd.5) 364 : cluster [DBG] 1.a scrub starts 2024-02-10T08:43:11.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:10.515083+0000 osd.5 (osd.5) 365 : cluster [DBG] 1.a scrub ok 2024-02-10T08:43:11.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:10.561876+0000 osd.2 (osd.2) 331 : cluster [DBG] 5.b scrub starts 2024-02-10T08:43:11.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:10.562722+0000 osd.2 (osd.2) 332 : cluster [DBG] 5.b scrub ok 2024-02-10T08:43:11.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:10.512177+0000 osd.5 (osd.5) 364 : cluster [DBG] 1.a scrub starts 2024-02-10T08:43:11.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:10.515083+0000 osd.5 (osd.5) 365 : cluster [DBG] 1.a scrub ok 2024-02-10T08:43:11.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:10.561876+0000 osd.2 (osd.2) 331 : cluster [DBG] 5.b scrub starts 2024-02-10T08:43:11.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:10.562722+0000 osd.2 (osd.2) 332 : cluster [DBG] 5.b scrub ok 2024-02-10T08:43:11.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:10.512177+0000 osd.5 (osd.5) 364 : cluster [DBG] 1.a scrub starts 2024-02-10T08:43:11.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:10.515083+0000 osd.5 (osd.5) 365 : cluster [DBG] 1.a scrub ok 2024-02-10T08:43:11.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:10.561876+0000 osd.2 (osd.2) 331 : cluster [DBG] 5.b scrub starts 2024-02-10T08:43:11.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:11 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:10.562722+0000 osd.2 (osd.2) 332 : cluster [DBG] 5.b scrub ok 2024-02-10T08:43:12.104 INFO:teuthology.orchestra.run.smithi018.stdout:77309411672 2024-02-10T08:43:12.377 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:11.259258+0000 mgr.y (mgr.14505) 985 : cluster [DBG] pgmap v1224: 162 pgs: 162 active+clean; 5.7 KiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:43:12.378 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:11.264572+0000 osd.4 (osd.4) 81 : cluster [DBG] 1.5 scrub starts 2024-02-10T08:43:12.378 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:11.267447+0000 osd.4 (osd.4) 82 : cluster [DBG] 1.5 scrub ok 2024-02-10T08:43:12.378 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:43:12.104430+0000 mon.a (mon.0) 2003 : audit [DBG] from='client.? 172.21.15.18:0/308896590' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-02-10T08:43:12.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:11.259258+0000 mgr.y (mgr.14505) 985 : cluster [DBG] pgmap v1224: 162 pgs: 162 active+clean; 5.7 KiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:43:12.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:11.264572+0000 osd.4 (osd.4) 81 : cluster [DBG] 1.5 scrub starts 2024-02-10T08:43:12.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:11.267447+0000 osd.4 (osd.4) 82 : cluster [DBG] 1.5 scrub ok 2024-02-10T08:43:12.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:43:12.104430+0000 mon.a (mon.0) 2003 : audit [DBG] from='client.? 172.21.15.18:0/308896590' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-02-10T08:43:12.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:11.259258+0000 mgr.y (mgr.14505) 985 : cluster [DBG] pgmap v1224: 162 pgs: 162 active+clean; 5.7 KiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:43:12.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:11.264572+0000 osd.4 (osd.4) 81 : cluster [DBG] 1.5 scrub starts 2024-02-10T08:43:12.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:11.267447+0000 osd.4 (osd.4) 82 : cluster [DBG] 1.5 scrub ok 2024-02-10T08:43:12.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:43:12.104430+0000 mon.a (mon.0) 2003 : audit [DBG] from='client.? 172.21.15.18:0/308896590' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-02-10T08:43:12.848 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411667 got 77309411672 for osd.2 2024-02-10T08:43:12.849 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd last-stat-seq osd.3 2024-02-10T08:43:13.129 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:43:13.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:11.559402+0000 osd.7 (osd.7) 79 : cluster [DBG] 1.9 deep-scrub starts 2024-02-10T08:43:13.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:11.560308+0000 osd.7 (osd.7) 80 : cluster [DBG] 1.9 deep-scrub ok 2024-02-10T08:43:13.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:12.468932+0000 osd.6 (osd.6) 355 : cluster [DBG] 4.5 scrub starts 2024-02-10T08:43:13.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:12.472528+0000 osd.6 (osd.6) 356 : cluster [DBG] 4.5 scrub ok 2024-02-10T08:43:13.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:11.559402+0000 osd.7 (osd.7) 79 : cluster [DBG] 1.9 deep-scrub starts 2024-02-10T08:43:13.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:11.560308+0000 osd.7 (osd.7) 80 : cluster [DBG] 1.9 deep-scrub ok 2024-02-10T08:43:13.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:12.468932+0000 osd.6 (osd.6) 355 : cluster [DBG] 4.5 scrub starts 2024-02-10T08:43:13.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:12.472528+0000 osd.6 (osd.6) 356 : cluster [DBG] 4.5 scrub ok 2024-02-10T08:43:13.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:11.559402+0000 osd.7 (osd.7) 79 : cluster [DBG] 1.9 deep-scrub starts 2024-02-10T08:43:13.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:11.560308+0000 osd.7 (osd.7) 80 : cluster [DBG] 1.9 deep-scrub ok 2024-02-10T08:43:13.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:12.468932+0000 osd.6 (osd.6) 355 : cluster [DBG] 4.5 scrub starts 2024-02-10T08:43:13.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:12.472528+0000 osd.6 (osd.6) 356 : cluster [DBG] 4.5 scrub ok 2024-02-10T08:43:14.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:13.259885+0000 mgr.y (mgr.14505) 986 : cluster [DBG] pgmap v1225: 162 pgs: 162 active+clean; 5.7 KiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:43:14.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:13.472316+0000 osd.2 (osd.2) 333 : cluster [DBG] 2.1 scrub starts 2024-02-10T08:43:14.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:13.473254+0000 osd.2 (osd.2) 334 : cluster [DBG] 2.1 scrub ok 2024-02-10T08:43:14.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:13.259885+0000 mgr.y (mgr.14505) 986 : cluster [DBG] pgmap v1225: 162 pgs: 162 active+clean; 5.7 KiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:43:14.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:13.472316+0000 osd.2 (osd.2) 333 : cluster [DBG] 2.1 scrub starts 2024-02-10T08:43:14.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:13.473254+0000 osd.2 (osd.2) 334 : cluster [DBG] 2.1 scrub ok 2024-02-10T08:43:14.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:13.259885+0000 mgr.y (mgr.14505) 986 : cluster [DBG] pgmap v1225: 162 pgs: 162 active+clean; 5.7 KiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:43:14.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:13.472316+0000 osd.2 (osd.2) 333 : cluster [DBG] 2.1 scrub starts 2024-02-10T08:43:14.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:13.473254+0000 osd.2 (osd.2) 334 : cluster [DBG] 2.1 scrub ok 2024-02-10T08:43:15.371 INFO:teuthology.orchestra.run.smithi018.stdout:107374182740 2024-02-10T08:43:15.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:13.556593+0000 osd.7 (osd.7) 81 : cluster [DBG] 5.10 scrub starts 2024-02-10T08:43:15.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:13.557611+0000 osd.7 (osd.7) 82 : cluster [DBG] 5.10 scrub ok 2024-02-10T08:43:15.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:14.450578+0000 osd.0 (osd.0) 364 : cluster [DBG] 4.b scrub starts 2024-02-10T08:43:15.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:14.452642+0000 osd.0 (osd.0) 365 : cluster [DBG] 4.b scrub ok 2024-02-10T08:43:15.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:43:15.371649+0000 mon.c (mon.2) 120 : audit [DBG] from='client.? 172.21.15.18:0/71188768' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-02-10T08:43:15.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:13.556593+0000 osd.7 (osd.7) 81 : cluster [DBG] 5.10 scrub starts 2024-02-10T08:43:15.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:13.557611+0000 osd.7 (osd.7) 82 : cluster [DBG] 5.10 scrub ok 2024-02-10T08:43:15.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:14.450578+0000 osd.0 (osd.0) 364 : cluster [DBG] 4.b scrub starts 2024-02-10T08:43:15.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:14.452642+0000 osd.0 (osd.0) 365 : cluster [DBG] 4.b scrub ok 2024-02-10T08:43:15.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:43:15.371649+0000 mon.c (mon.2) 120 : audit [DBG] from='client.? 172.21.15.18:0/71188768' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-02-10T08:43:15.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:13.556593+0000 osd.7 (osd.7) 81 : cluster [DBG] 5.10 scrub starts 2024-02-10T08:43:15.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:13.557611+0000 osd.7 (osd.7) 82 : cluster [DBG] 5.10 scrub ok 2024-02-10T08:43:15.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:14.450578+0000 osd.0 (osd.0) 364 : cluster [DBG] 4.b scrub starts 2024-02-10T08:43:15.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:14.452642+0000 osd.0 (osd.0) 365 : cluster [DBG] 4.b scrub ok 2024-02-10T08:43:15.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:43:15.371649+0000 mon.c (mon.2) 120 : audit [DBG] from='client.? 172.21.15.18:0/71188768' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-02-10T08:43:16.150 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182735 got 107374182740 for osd.3 2024-02-10T08:43:16.150 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd last-stat-seq osd.4 2024-02-10T08:43:16.438 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:43:16.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:14.510983+0000 osd.7 (osd.7) 83 : cluster [DBG] 6.12 scrub starts 2024-02-10T08:43:16.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:14.511993+0000 osd.7 (osd.7) 84 : cluster [DBG] 6.12 scrub ok 2024-02-10T08:43:16.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:15.050029+0000 osd.1 (osd.1) 395 : cluster [DBG] 6.1 deep-scrub starts 2024-02-10T08:43:16.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:15.076444+0000 osd.1 (osd.1) 396 : cluster [DBG] 6.1 deep-scrub ok 2024-02-10T08:43:16.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:15.260273+0000 mgr.y (mgr.14505) 987 : cluster [DBG] pgmap v1226: 162 pgs: 162 active+clean; 5.7 KiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:43:16.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:15.416331+0000 osd.0 (osd.0) 366 : cluster [DBG] 4.12 scrub starts 2024-02-10T08:43:16.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:15.417590+0000 osd.0 (osd.0) 367 : cluster [DBG] 4.12 scrub ok 2024-02-10T08:43:16.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:15.454256+0000 osd.5 (osd.5) 366 : cluster [DBG] 2.2 scrub starts 2024-02-10T08:43:16.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:15.457244+0000 osd.5 (osd.5) 367 : cluster [DBG] 2.2 scrub ok 2024-02-10T08:43:16.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:14.510983+0000 osd.7 (osd.7) 83 : cluster [DBG] 6.12 scrub starts 2024-02-10T08:43:16.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:14.511993+0000 osd.7 (osd.7) 84 : cluster [DBG] 6.12 scrub ok 2024-02-10T08:43:16.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:15.050029+0000 osd.1 (osd.1) 395 : cluster [DBG] 6.1 deep-scrub starts 2024-02-10T08:43:16.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:15.076444+0000 osd.1 (osd.1) 396 : cluster [DBG] 6.1 deep-scrub ok 2024-02-10T08:43:16.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:15.260273+0000 mgr.y (mgr.14505) 987 : cluster [DBG] pgmap v1226: 162 pgs: 162 active+clean; 5.7 KiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:43:16.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:15.416331+0000 osd.0 (osd.0) 366 : cluster [DBG] 4.12 scrub starts 2024-02-10T08:43:16.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:15.417590+0000 osd.0 (osd.0) 367 : cluster [DBG] 4.12 scrub ok 2024-02-10T08:43:16.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:15.454256+0000 osd.5 (osd.5) 366 : cluster [DBG] 2.2 scrub starts 2024-02-10T08:43:16.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:16 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:15.457244+0000 osd.5 (osd.5) 367 : cluster [DBG] 2.2 scrub ok 2024-02-10T08:43:16.789 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:43:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:43:16] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:43:16.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:14.510983+0000 osd.7 (osd.7) 83 : cluster [DBG] 6.12 scrub starts 2024-02-10T08:43:16.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:14.511993+0000 osd.7 (osd.7) 84 : cluster [DBG] 6.12 scrub ok 2024-02-10T08:43:16.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:15.050029+0000 osd.1 (osd.1) 395 : cluster [DBG] 6.1 deep-scrub starts 2024-02-10T08:43:16.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:15.076444+0000 osd.1 (osd.1) 396 : cluster [DBG] 6.1 deep-scrub ok 2024-02-10T08:43:16.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:15.260273+0000 mgr.y (mgr.14505) 987 : cluster [DBG] pgmap v1226: 162 pgs: 162 active+clean; 5.7 KiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:43:16.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:15.416331+0000 osd.0 (osd.0) 366 : cluster [DBG] 4.12 scrub starts 2024-02-10T08:43:16.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:15.417590+0000 osd.0 (osd.0) 367 : cluster [DBG] 4.12 scrub ok 2024-02-10T08:43:16.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:15.454256+0000 osd.5 (osd.5) 366 : cluster [DBG] 2.2 scrub starts 2024-02-10T08:43:16.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:15.457244+0000 osd.5 (osd.5) 367 : cluster [DBG] 2.2 scrub ok 2024-02-10T08:43:17.442 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:16.331334+0000 osd.4 (osd.4) 83 : cluster [DBG] 4.d deep-scrub starts 2024-02-10T08:43:17.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:16.338464+0000 osd.4 (osd.4) 84 : cluster [DBG] 4.d deep-scrub ok 2024-02-10T08:43:17.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:16.416406+0000 osd.2 (osd.2) 335 : cluster [DBG] 2.10 scrub starts 2024-02-10T08:43:17.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:16.417936+0000 osd.2 (osd.2) 336 : cluster [DBG] 2.10 scrub ok 2024-02-10T08:43:17.443 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:43:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:43:17] "GET /metrics HTTP/1.1" 200 174132 "" "Prometheus/2.33.4" 2024-02-10T08:43:17.443 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:16.331334+0000 osd.4 (osd.4) 83 : cluster [DBG] 4.d deep-scrub starts 2024-02-10T08:43:17.443 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:16.338464+0000 osd.4 (osd.4) 84 : cluster [DBG] 4.d deep-scrub ok 2024-02-10T08:43:17.443 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:16.416406+0000 osd.2 (osd.2) 335 : cluster [DBG] 2.10 scrub starts 2024-02-10T08:43:17.444 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:17 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:16.417936+0000 osd.2 (osd.2) 336 : cluster [DBG] 2.10 scrub ok 2024-02-10T08:43:17.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:16.331334+0000 osd.4 (osd.4) 83 : cluster [DBG] 4.d deep-scrub starts 2024-02-10T08:43:17.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:16.338464+0000 osd.4 (osd.4) 84 : cluster [DBG] 4.d deep-scrub ok 2024-02-10T08:43:17.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:16.416406+0000 osd.2 (osd.2) 335 : cluster [DBG] 2.10 scrub starts 2024-02-10T08:43:17.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:16.417936+0000 osd.2 (osd.2) 336 : cluster [DBG] 2.10 scrub ok 2024-02-10T08:43:18.594 INFO:teuthology.orchestra.run.smithi018.stdout:1988569858075 2024-02-10T08:43:18.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:16.503097+0000 osd.7 (osd.7) 85 : cluster [DBG] 6.29 scrub starts 2024-02-10T08:43:18.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:16.523471+0000 osd.7 (osd.7) 86 : cluster [DBG] 6.29 scrub ok 2024-02-10T08:43:18.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:17.260715+0000 mgr.y (mgr.14505) 988 : cluster [DBG] pgmap v1227: 162 pgs: 162 active+clean; 5.7 KiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:43:18.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:16.503097+0000 osd.7 (osd.7) 85 : cluster [DBG] 6.29 scrub starts 2024-02-10T08:43:18.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:16.523471+0000 osd.7 (osd.7) 86 : cluster [DBG] 6.29 scrub ok 2024-02-10T08:43:18.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:18 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:17.260715+0000 mgr.y (mgr.14505) 988 : cluster [DBG] pgmap v1227: 162 pgs: 162 active+clean; 5.7 KiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:43:18.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:16.503097+0000 osd.7 (osd.7) 85 : cluster [DBG] 6.29 scrub starts 2024-02-10T08:43:18.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:16.523471+0000 osd.7 (osd.7) 86 : cluster [DBG] 6.29 scrub ok 2024-02-10T08:43:18.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:17.260715+0000 mgr.y (mgr.14505) 988 : cluster [DBG] pgmap v1227: 162 pgs: 162 active+clean; 5.7 KiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:43:19.238 INFO:tasks.cephadm.ceph_manager.ceph:need seq 1988569858070 got 1988569858075 for osd.4 2024-02-10T08:43:19.238 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd last-stat-seq osd.5 2024-02-10T08:43:19.523 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:43:19.539 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:43:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:43:19.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:17.543376+0000 osd.7 (osd.7) 87 : cluster [DBG] 6.5 scrub starts 2024-02-10T08:43:19.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:17.565960+0000 osd.7 (osd.7) 88 : cluster [DBG] 6.5 scrub ok 2024-02-10T08:43:19.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:18.301892+0000 osd.4 (osd.4) 85 : cluster [DBG] 4.1b scrub starts 2024-02-10T08:43:19.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:18.305424+0000 osd.4 (osd.4) 86 : cluster [DBG] 4.1b scrub ok 2024-02-10T08:43:19.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:18.406943+0000 osd.2 (osd.2) 337 : cluster [DBG] 2.e deep-scrub starts 2024-02-10T08:43:19.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:18.407912+0000 osd.2 (osd.2) 338 : cluster [DBG] 2.e deep-scrub ok 2024-02-10T08:43:19.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:18.455518+0000 osd.6 (osd.6) 357 : cluster [DBG] 6.25 scrub starts 2024-02-10T08:43:19.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:18.515747+0000 osd.6 (osd.6) 358 : cluster [DBG] 6.25 scrub ok 2024-02-10T08:43:19.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:43:18.594396+0000 mon.a (mon.0) 2004 : audit [DBG] from='client.? 172.21.15.18:0/3356557792' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-02-10T08:43:19.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:17.543376+0000 osd.7 (osd.7) 87 : cluster [DBG] 6.5 scrub starts 2024-02-10T08:43:19.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:17.565960+0000 osd.7 (osd.7) 88 : cluster [DBG] 6.5 scrub ok 2024-02-10T08:43:19.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:18.301892+0000 osd.4 (osd.4) 85 : cluster [DBG] 4.1b scrub starts 2024-02-10T08:43:19.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:18.305424+0000 osd.4 (osd.4) 86 : cluster [DBG] 4.1b scrub ok 2024-02-10T08:43:19.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:18.406943+0000 osd.2 (osd.2) 337 : cluster [DBG] 2.e deep-scrub starts 2024-02-10T08:43:19.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:18.407912+0000 osd.2 (osd.2) 338 : cluster [DBG] 2.e deep-scrub ok 2024-02-10T08:43:19.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:18.455518+0000 osd.6 (osd.6) 357 : cluster [DBG] 6.25 scrub starts 2024-02-10T08:43:19.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:18.515747+0000 osd.6 (osd.6) 358 : cluster [DBG] 6.25 scrub ok 2024-02-10T08:43:19.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:43:18.594396+0000 mon.a (mon.0) 2004 : audit [DBG] from='client.? 172.21.15.18:0/3356557792' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-02-10T08:43:19.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:17.543376+0000 osd.7 (osd.7) 87 : cluster [DBG] 6.5 scrub starts 2024-02-10T08:43:19.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:17.565960+0000 osd.7 (osd.7) 88 : cluster [DBG] 6.5 scrub ok 2024-02-10T08:43:19.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:18.301892+0000 osd.4 (osd.4) 85 : cluster [DBG] 4.1b scrub starts 2024-02-10T08:43:19.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:18.305424+0000 osd.4 (osd.4) 86 : cluster [DBG] 4.1b scrub ok 2024-02-10T08:43:19.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:18.406943+0000 osd.2 (osd.2) 337 : cluster [DBG] 2.e deep-scrub starts 2024-02-10T08:43:19.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:18.407912+0000 osd.2 (osd.2) 338 : cluster [DBG] 2.e deep-scrub ok 2024-02-10T08:43:19.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:18.455518+0000 osd.6 (osd.6) 357 : cluster [DBG] 6.25 scrub starts 2024-02-10T08:43:19.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:18.515747+0000 osd.6 (osd.6) 358 : cluster [DBG] 6.25 scrub ok 2024-02-10T08:43:19.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:19 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:43:18.594396+0000 mon.a (mon.0) 2004 : audit [DBG] from='client.? 172.21.15.18:0/3356557792' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-02-10T08:43:20.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:43:19.201234+0000 mgr.y (mgr.14505) 989 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:43:20.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:19.261429+0000 mgr.y (mgr.14505) 990 : cluster [DBG] pgmap v1228: 162 pgs: 162 active+clean; 5.7 KiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:43:20.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:19.452030+0000 osd.0 (osd.0) 368 : cluster [DBG] 5.1e scrub starts 2024-02-10T08:43:20.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:19.454923+0000 osd.0 (osd.0) 369 : cluster [DBG] 5.1e scrub ok 2024-02-10T08:43:20.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:19.456090+0000 osd.5 (osd.5) 368 : cluster [DBG] 2.16 scrub starts 2024-02-10T08:43:20.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:19.458975+0000 osd.5 (osd.5) 369 : cluster [DBG] 2.16 scrub ok 2024-02-10T08:43:20.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:43:19.201234+0000 mgr.y (mgr.14505) 989 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:43:20.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:19.261429+0000 mgr.y (mgr.14505) 990 : cluster [DBG] pgmap v1228: 162 pgs: 162 active+clean; 5.7 KiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:43:20.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:19.452030+0000 osd.0 (osd.0) 368 : cluster [DBG] 5.1e scrub starts 2024-02-10T08:43:20.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:19.454923+0000 osd.0 (osd.0) 369 : cluster [DBG] 5.1e scrub ok 2024-02-10T08:43:20.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:19.456090+0000 osd.5 (osd.5) 368 : cluster [DBG] 2.16 scrub starts 2024-02-10T08:43:20.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:20 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:19.458975+0000 osd.5 (osd.5) 369 : cluster [DBG] 2.16 scrub ok 2024-02-10T08:43:20.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:43:19.201234+0000 mgr.y (mgr.14505) 989 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:43:20.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:19.261429+0000 mgr.y (mgr.14505) 990 : cluster [DBG] pgmap v1228: 162 pgs: 162 active+clean; 5.7 KiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:43:20.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:19.452030+0000 osd.0 (osd.0) 368 : cluster [DBG] 5.1e scrub starts 2024-02-10T08:43:20.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:19.454923+0000 osd.0 (osd.0) 369 : cluster [DBG] 5.1e scrub ok 2024-02-10T08:43:20.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:19.456090+0000 osd.5 (osd.5) 368 : cluster [DBG] 2.16 scrub starts 2024-02-10T08:43:20.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:19.458975+0000 osd.5 (osd.5) 369 : cluster [DBG] 2.16 scrub ok 2024-02-10T08:43:21.629 INFO:teuthology.orchestra.run.smithi018.stdout:158913790284 2024-02-10T08:43:21.653 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:20.475460+0000 osd.0 (osd.0) 370 : cluster [DBG] 4.1e scrub starts 2024-02-10T08:43:21.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:20.478922+0000 osd.0 (osd.0) 371 : cluster [DBG] 4.1e scrub ok 2024-02-10T08:43:21.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:20.475460+0000 osd.0 (osd.0) 370 : cluster [DBG] 4.1e scrub starts 2024-02-10T08:43:21.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:21 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:20.478922+0000 osd.0 (osd.0) 371 : cluster [DBG] 4.1e scrub ok 2024-02-10T08:43:21.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:20.475460+0000 osd.0 (osd.0) 370 : cluster [DBG] 4.1e scrub starts 2024-02-10T08:43:21.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:20.478922+0000 osd.0 (osd.0) 371 : cluster [DBG] 4.1e scrub ok 2024-02-10T08:43:22.495 INFO:tasks.cephadm.ceph_manager.ceph:need seq 158913790279 got 158913790284 for osd.5 2024-02-10T08:43:22.495 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd last-stat-seq osd.6 2024-02-10T08:43:22.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:21.261865+0000 mgr.y (mgr.14505) 991 : cluster [DBG] pgmap v1229: 162 pgs: 162 active+clean; 5.7 KiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:43:22.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:21.267382+0000 osd.4 (osd.4) 87 : cluster [DBG] 4.e scrub starts 2024-02-10T08:43:22.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:21.269300+0000 osd.4 (osd.4) 88 : cluster [DBG] 4.e scrub ok 2024-02-10T08:43:22.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:43:21.628752+0000 mon.c (mon.2) 121 : audit [DBG] from='client.? 172.21.15.18:0/926550466' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-02-10T08:43:22.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:21.261865+0000 mgr.y (mgr.14505) 991 : cluster [DBG] pgmap v1229: 162 pgs: 162 active+clean; 5.7 KiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:43:22.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:21.267382+0000 osd.4 (osd.4) 87 : cluster [DBG] 4.e scrub starts 2024-02-10T08:43:22.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:21.269300+0000 osd.4 (osd.4) 88 : cluster [DBG] 4.e scrub ok 2024-02-10T08:43:22.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:22 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:43:21.628752+0000 mon.c (mon.2) 121 : audit [DBG] from='client.? 172.21.15.18:0/926550466' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-02-10T08:43:22.781 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:43:22.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:21.261865+0000 mgr.y (mgr.14505) 991 : cluster [DBG] pgmap v1229: 162 pgs: 162 active+clean; 5.7 KiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:43:22.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:21.267382+0000 osd.4 (osd.4) 87 : cluster [DBG] 4.e scrub starts 2024-02-10T08:43:22.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:21.269300+0000 osd.4 (osd.4) 88 : cluster [DBG] 4.e scrub ok 2024-02-10T08:43:22.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:43:21.628752+0000 mon.c (mon.2) 121 : audit [DBG] from='client.? 172.21.15.18:0/926550466' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-02-10T08:43:23.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:22.495453+0000 osd.6 (osd.6) 359 : cluster [DBG] 4.a scrub starts 2024-02-10T08:43:23.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:22.497562+0000 osd.6 (osd.6) 360 : cluster [DBG] 4.a scrub ok 2024-02-10T08:43:23.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:22.495453+0000 osd.6 (osd.6) 359 : cluster [DBG] 4.a scrub starts 2024-02-10T08:43:23.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:23 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:22.497562+0000 osd.6 (osd.6) 360 : cluster [DBG] 4.a scrub ok 2024-02-10T08:43:23.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:22.495453+0000 osd.6 (osd.6) 359 : cluster [DBG] 4.a scrub starts 2024-02-10T08:43:23.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:22.497562+0000 osd.6 (osd.6) 360 : cluster [DBG] 4.a scrub ok 2024-02-10T08:43:24.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:23.262525+0000 mgr.y (mgr.14505) 992 : cluster [DBG] pgmap v1230: 162 pgs: 162 active+clean; 5.7 KiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:43:24.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:23.389609+0000 osd.3 (osd.3) 165 : cluster [DBG] 5.14 scrub starts 2024-02-10T08:43:24.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:23.390846+0000 osd.3 (osd.3) 166 : cluster [DBG] 5.14 scrub ok 2024-02-10T08:43:24.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:23.475567+0000 osd.6 (osd.6) 361 : cluster [DBG] 2.7 scrub starts 2024-02-10T08:43:24.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:23.478758+0000 osd.6 (osd.6) 362 : cluster [DBG] 2.7 scrub ok 2024-02-10T08:43:24.867 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:23.262525+0000 mgr.y (mgr.14505) 992 : cluster [DBG] pgmap v1230: 162 pgs: 162 active+clean; 5.7 KiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:43:24.867 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:23.389609+0000 osd.3 (osd.3) 165 : cluster [DBG] 5.14 scrub starts 2024-02-10T08:43:24.867 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:23.390846+0000 osd.3 (osd.3) 166 : cluster [DBG] 5.14 scrub ok 2024-02-10T08:43:24.867 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:23.475567+0000 osd.6 (osd.6) 361 : cluster [DBG] 2.7 scrub starts 2024-02-10T08:43:24.867 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:23.478758+0000 osd.6 (osd.6) 362 : cluster [DBG] 2.7 scrub ok 2024-02-10T08:43:24.867 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:23.262525+0000 mgr.y (mgr.14505) 992 : cluster [DBG] pgmap v1230: 162 pgs: 162 active+clean; 5.7 KiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:43:24.867 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:23.389609+0000 osd.3 (osd.3) 165 : cluster [DBG] 5.14 scrub starts 2024-02-10T08:43:24.867 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:23.390846+0000 osd.3 (osd.3) 166 : cluster [DBG] 5.14 scrub ok 2024-02-10T08:43:24.867 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:23.475567+0000 osd.6 (osd.6) 361 : cluster [DBG] 2.7 scrub starts 2024-02-10T08:43:24.867 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:24 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:23.478758+0000 osd.6 (osd.6) 362 : cluster [DBG] 2.7 scrub ok 2024-02-10T08:43:25.304 INFO:teuthology.orchestra.run.smithi018.stdout:184683594056 2024-02-10T08:43:25.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:24.501474+0000 osd.0 (osd.0) 372 : cluster [DBG] 6.18 scrub starts 2024-02-10T08:43:25.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:24.504733+0000 osd.0 (osd.0) 373 : cluster [DBG] 6.18 scrub ok 2024-02-10T08:43:25.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:24.522766+0000 osd.5 (osd.5) 370 : cluster [DBG] 5.16 scrub starts 2024-02-10T08:43:25.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:24.525742+0000 osd.5 (osd.5) 371 : cluster [DBG] 5.16 scrub ok 2024-02-10T08:43:25.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:43:25.304288+0000 mon.a (mon.0) 2005 : audit [DBG] from='client.? 172.21.15.18:0/3565061165' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-02-10T08:43:25.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:24.501474+0000 osd.0 (osd.0) 372 : cluster [DBG] 6.18 scrub starts 2024-02-10T08:43:25.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:24.504733+0000 osd.0 (osd.0) 373 : cluster [DBG] 6.18 scrub ok 2024-02-10T08:43:25.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:24.522766+0000 osd.5 (osd.5) 370 : cluster [DBG] 5.16 scrub starts 2024-02-10T08:43:25.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:24.525742+0000 osd.5 (osd.5) 371 : cluster [DBG] 5.16 scrub ok 2024-02-10T08:43:25.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:25 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:43:25.304288+0000 mon.a (mon.0) 2005 : audit [DBG] from='client.? 172.21.15.18:0/3565061165' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-02-10T08:43:25.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:24.501474+0000 osd.0 (osd.0) 372 : cluster [DBG] 6.18 scrub starts 2024-02-10T08:43:25.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:24.504733+0000 osd.0 (osd.0) 373 : cluster [DBG] 6.18 scrub ok 2024-02-10T08:43:25.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:24.522766+0000 osd.5 (osd.5) 370 : cluster [DBG] 5.16 scrub starts 2024-02-10T08:43:25.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:24.525742+0000 osd.5 (osd.5) 371 : cluster [DBG] 5.16 scrub ok 2024-02-10T08:43:25.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:43:25.304288+0000 mon.a (mon.0) 2005 : audit [DBG] from='client.? 172.21.15.18:0/3565061165' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-02-10T08:43:26.028 INFO:tasks.cephadm.ceph_manager.ceph:need seq 184683594051 got 184683594056 for osd.6 2024-02-10T08:43:26.028 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph osd last-stat-seq osd.7 2024-02-10T08:43:26.312 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:43:26.789 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:43:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:43:26] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:43:26.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:25.262958+0000 mgr.y (mgr.14505) 993 : cluster [DBG] pgmap v1231: 162 pgs: 162 active+clean; 5.7 KiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:43:26.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:25.431573+0000 osd.3 (osd.3) 167 : cluster [DBG] 2.19 scrub starts 2024-02-10T08:43:26.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:25.434580+0000 osd.3 (osd.3) 168 : cluster [DBG] 2.19 scrub ok 2024-02-10T08:43:26.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:25.490656+0000 osd.5 (osd.5) 372 : cluster [DBG] 6.33 scrub starts 2024-02-10T08:43:26.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:25.581427+0000 osd.5 (osd.5) 373 : cluster [DBG] 6.33 scrub ok 2024-02-10T08:43:26.859 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:25.262958+0000 mgr.y (mgr.14505) 993 : cluster [DBG] pgmap v1231: 162 pgs: 162 active+clean; 5.7 KiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:43:26.859 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:25.431573+0000 osd.3 (osd.3) 167 : cluster [DBG] 2.19 scrub starts 2024-02-10T08:43:26.859 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:25.434580+0000 osd.3 (osd.3) 168 : cluster [DBG] 2.19 scrub ok 2024-02-10T08:43:26.859 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:25.490656+0000 osd.5 (osd.5) 372 : cluster [DBG] 6.33 scrub starts 2024-02-10T08:43:26.859 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:25.581427+0000 osd.5 (osd.5) 373 : cluster [DBG] 6.33 scrub ok 2024-02-10T08:43:26.860 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:25.262958+0000 mgr.y (mgr.14505) 993 : cluster [DBG] pgmap v1231: 162 pgs: 162 active+clean; 5.7 KiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:43:26.860 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:25.431573+0000 osd.3 (osd.3) 167 : cluster [DBG] 2.19 scrub starts 2024-02-10T08:43:26.860 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:25.434580+0000 osd.3 (osd.3) 168 : cluster [DBG] 2.19 scrub ok 2024-02-10T08:43:26.860 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:25.490656+0000 osd.5 (osd.5) 372 : cluster [DBG] 6.33 scrub starts 2024-02-10T08:43:26.860 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:26 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:25.581427+0000 osd.5 (osd.5) 373 : cluster [DBG] 6.33 scrub ok 2024-02-10T08:43:27.403 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:43:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:43:27] "GET /metrics HTTP/1.1" 200 174132 "" "Prometheus/2.33.4" 2024-02-10T08:43:27.705 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:26.038170+0000 osd.1 (osd.1) 397 : cluster [DBG] 2.4 scrub starts 2024-02-10T08:43:27.706 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:26.041215+0000 osd.1 (osd.1) 398 : cluster [DBG] 2.4 scrub ok 2024-02-10T08:43:27.706 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:26.290969+0000 osd.4 (osd.4) 89 : cluster [DBG] 6.2a scrub starts 2024-02-10T08:43:27.706 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:26.294081+0000 osd.4 (osd.4) 90 : cluster [DBG] 6.2a scrub ok 2024-02-10T08:43:27.706 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:26.450250+0000 osd.0 (osd.0) 374 : cluster [DBG] 6.10 scrub starts 2024-02-10T08:43:27.706 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:26.453302+0000 osd.0 (osd.0) 375 : cluster [DBG] 6.10 scrub ok 2024-02-10T08:43:27.707 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:26.038170+0000 osd.1 (osd.1) 397 : cluster [DBG] 2.4 scrub starts 2024-02-10T08:43:27.707 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:26.041215+0000 osd.1 (osd.1) 398 : cluster [DBG] 2.4 scrub ok 2024-02-10T08:43:27.707 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:26.290969+0000 osd.4 (osd.4) 89 : cluster [DBG] 6.2a scrub starts 2024-02-10T08:43:27.707 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:26.294081+0000 osd.4 (osd.4) 90 : cluster [DBG] 6.2a scrub ok 2024-02-10T08:43:27.707 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:26.450250+0000 osd.0 (osd.0) 374 : cluster [DBG] 6.10 scrub starts 2024-02-10T08:43:27.707 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:27 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:26.453302+0000 osd.0 (osd.0) 375 : cluster [DBG] 6.10 scrub ok 2024-02-10T08:43:27.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:26.038170+0000 osd.1 (osd.1) 397 : cluster [DBG] 2.4 scrub starts 2024-02-10T08:43:27.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:26.041215+0000 osd.1 (osd.1) 398 : cluster [DBG] 2.4 scrub ok 2024-02-10T08:43:27.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:26.290969+0000 osd.4 (osd.4) 89 : cluster [DBG] 6.2a scrub starts 2024-02-10T08:43:27.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:26.294081+0000 osd.4 (osd.4) 90 : cluster [DBG] 6.2a scrub ok 2024-02-10T08:43:27.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:26.450250+0000 osd.0 (osd.0) 374 : cluster [DBG] 6.10 scrub starts 2024-02-10T08:43:27.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:26.453302+0000 osd.0 (osd.0) 375 : cluster [DBG] 6.10 scrub ok 2024-02-10T08:43:28.482 INFO:teuthology.orchestra.run.smithi018.stdout:1915555414061 2024-02-10T08:43:28.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:27.087817+0000 osd.1 (osd.1) 399 : cluster [DBG] 6.4 scrub starts 2024-02-10T08:43:28.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:27.090957+0000 osd.1 (osd.1) 400 : cluster [DBG] 6.4 scrub ok 2024-02-10T08:43:28.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:27.263413+0000 mgr.y (mgr.14505) 994 : cluster [DBG] pgmap v1232: 162 pgs: 162 active+clean; 5.7 KiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:43:28.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:27.277084+0000 osd.4 (osd.4) 91 : cluster [DBG] 4.13 deep-scrub starts 2024-02-10T08:43:28.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:27.280548+0000 osd.4 (osd.4) 92 : cluster [DBG] 4.13 deep-scrub ok 2024-02-10T08:43:28.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:27.403128+0000 osd.0 (osd.0) 376 : cluster [DBG] 6.9 deep-scrub starts 2024-02-10T08:43:28.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:27.426544+0000 osd.0 (osd.0) 377 : cluster [DBG] 6.9 deep-scrub ok 2024-02-10T08:43:28.889 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:27.087817+0000 osd.1 (osd.1) 399 : cluster [DBG] 6.4 scrub starts 2024-02-10T08:43:28.890 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:27.090957+0000 osd.1 (osd.1) 400 : cluster [DBG] 6.4 scrub ok 2024-02-10T08:43:28.890 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:27.263413+0000 mgr.y (mgr.14505) 994 : cluster [DBG] pgmap v1232: 162 pgs: 162 active+clean; 5.7 KiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:43:28.890 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:27.277084+0000 osd.4 (osd.4) 91 : cluster [DBG] 4.13 deep-scrub starts 2024-02-10T08:43:28.890 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:27.280548+0000 osd.4 (osd.4) 92 : cluster [DBG] 4.13 deep-scrub ok 2024-02-10T08:43:28.890 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:27.403128+0000 osd.0 (osd.0) 376 : cluster [DBG] 6.9 deep-scrub starts 2024-02-10T08:43:28.890 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:27.426544+0000 osd.0 (osd.0) 377 : cluster [DBG] 6.9 deep-scrub ok 2024-02-10T08:43:28.891 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:27.087817+0000 osd.1 (osd.1) 399 : cluster [DBG] 6.4 scrub starts 2024-02-10T08:43:28.891 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:27.090957+0000 osd.1 (osd.1) 400 : cluster [DBG] 6.4 scrub ok 2024-02-10T08:43:28.891 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:27.263413+0000 mgr.y (mgr.14505) 994 : cluster [DBG] pgmap v1232: 162 pgs: 162 active+clean; 5.7 KiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-10T08:43:28.891 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:27.277084+0000 osd.4 (osd.4) 91 : cluster [DBG] 4.13 deep-scrub starts 2024-02-10T08:43:28.891 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:27.280548+0000 osd.4 (osd.4) 92 : cluster [DBG] 4.13 deep-scrub ok 2024-02-10T08:43:28.891 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:27.403128+0000 osd.0 (osd.0) 376 : cluster [DBG] 6.9 deep-scrub starts 2024-02-10T08:43:28.892 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:28 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:27.426544+0000 osd.0 (osd.0) 377 : cluster [DBG] 6.9 deep-scrub ok 2024-02-10T08:43:29.270 INFO:tasks.cephadm.ceph_manager.ceph:need seq 1915555414056 got 1915555414061 for osd.7 2024-02-10T08:43:29.271 INFO:tasks.cephadm.ceph_manager.ceph:waiting for recovery to complete 2024-02-10T08:43:29.271 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph pg dump --format=json 2024-02-10T08:43:29.539 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:43:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:43:29.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:28.126539+0000 osd.1 (osd.1) 401 : cluster [DBG] 5.12 scrub starts 2024-02-10T08:43:29.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:28.129642+0000 osd.1 (osd.1) 402 : cluster [DBG] 5.12 scrub ok 2024-02-10T08:43:29.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:28.447536+0000 osd.0 (osd.0) 378 : cluster [DBG] 6.14 scrub starts 2024-02-10T08:43:29.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:28.448443+0000 osd.0 (osd.0) 379 : cluster [DBG] 6.14 scrub ok 2024-02-10T08:43:29.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:43:28.482575+0000 mon.a (mon.0) 2006 : audit [DBG] from='client.? 172.21.15.18:0/3514920587' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-02-10T08:43:29.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:28.529111+0000 osd.5 (osd.5) 374 : cluster [DBG] 5.1b scrub starts 2024-02-10T08:43:29.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:28.532006+0000 osd.5 (osd.5) 375 : cluster [DBG] 5.1b scrub ok 2024-02-10T08:43:29.556 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:43:29.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:28.126539+0000 osd.1 (osd.1) 401 : cluster [DBG] 5.12 scrub starts 2024-02-10T08:43:29.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:28.129642+0000 osd.1 (osd.1) 402 : cluster [DBG] 5.12 scrub ok 2024-02-10T08:43:29.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:28.447536+0000 osd.0 (osd.0) 378 : cluster [DBG] 6.14 scrub starts 2024-02-10T08:43:29.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:28.448443+0000 osd.0 (osd.0) 379 : cluster [DBG] 6.14 scrub ok 2024-02-10T08:43:29.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:43:28.482575+0000 mon.a (mon.0) 2006 : audit [DBG] from='client.? 172.21.15.18:0/3514920587' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-02-10T08:43:29.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:28.529111+0000 osd.5 (osd.5) 374 : cluster [DBG] 5.1b scrub starts 2024-02-10T08:43:29.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:28.532006+0000 osd.5 (osd.5) 375 : cluster [DBG] 5.1b scrub ok 2024-02-10T08:43:29.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:28.126539+0000 osd.1 (osd.1) 401 : cluster [DBG] 5.12 scrub starts 2024-02-10T08:43:29.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:28.129642+0000 osd.1 (osd.1) 402 : cluster [DBG] 5.12 scrub ok 2024-02-10T08:43:29.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:28.447536+0000 osd.0 (osd.0) 378 : cluster [DBG] 6.14 scrub starts 2024-02-10T08:43:29.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:28.448443+0000 osd.0 (osd.0) 379 : cluster [DBG] 6.14 scrub ok 2024-02-10T08:43:29.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:43:28.482575+0000 mon.a (mon.0) 2006 : audit [DBG] from='client.? 172.21.15.18:0/3514920587' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-02-10T08:43:29.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:28.529111+0000 osd.5 (osd.5) 374 : cluster [DBG] 5.1b scrub starts 2024-02-10T08:43:29.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:29 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:28.532006+0000 osd.5 (osd.5) 375 : cluster [DBG] 5.1b scrub ok 2024-02-10T08:43:30.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:43:29.208820+0000 mgr.y (mgr.14505) 995 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:43:30.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:29.264126+0000 mgr.y (mgr.14505) 996 : cluster [DBG] pgmap v1233: 162 pgs: 162 active+clean; 5.7 KiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:43:30.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:29.511103+0000 osd.5 (osd.5) 376 : cluster [DBG] 6.2b scrub starts 2024-02-10T08:43:30.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:29.607806+0000 osd.5 (osd.5) 377 : cluster [DBG] 6.2b scrub ok 2024-02-10T08:43:30.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:29.867273+0000 osd.6 (osd.6) 363 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:43:30.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:29.867353+0000 osd.6 (osd.6) 364 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:43:30.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:43:29.208820+0000 mgr.y (mgr.14505) 995 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:43:30.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:29.264126+0000 mgr.y (mgr.14505) 996 : cluster [DBG] pgmap v1233: 162 pgs: 162 active+clean; 5.7 KiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:43:30.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:29.511103+0000 osd.5 (osd.5) 376 : cluster [DBG] 6.2b scrub starts 2024-02-10T08:43:30.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:29.607806+0000 osd.5 (osd.5) 377 : cluster [DBG] 6.2b scrub ok 2024-02-10T08:43:30.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:29.867273+0000 osd.6 (osd.6) 363 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:43:30.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:29.867353+0000 osd.6 (osd.6) 364 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:43:30.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:43:29.208820+0000 mgr.y (mgr.14505) 995 : audit [DBG] from='client.24421 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-10T08:43:30.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:29.264126+0000 mgr.y (mgr.14505) 996 : cluster [DBG] pgmap v1233: 162 pgs: 162 active+clean; 5.7 KiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:43:30.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:29.511103+0000 osd.5 (osd.5) 376 : cluster [DBG] 6.2b scrub starts 2024-02-10T08:43:30.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:29.607806+0000 osd.5 (osd.5) 377 : cluster [DBG] 6.2b scrub ok 2024-02-10T08:43:30.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:29.867273+0000 osd.6 (osd.6) 363 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:43:30.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:30 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:29.867353+0000 osd.6 (osd.6) 364 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:43:31.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:30.272469+0000 osd.4 (osd.4) 93 : cluster [DBG] 6.32 scrub starts 2024-02-10T08:43:31.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:30.275355+0000 osd.4 (osd.4) 94 : cluster [DBG] 6.32 scrub ok 2024-02-10T08:43:31.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:30.350586+0000 osd.7 (osd.7) 89 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:43:31.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:30.350687+0000 osd.7 (osd.7) 90 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:43:31.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:30.433778+0000 mon.a (mon.0) 2007 : cluster [DBG] osdmap e509: 8 total, 8 up, 8 in 2024-02-10T08:43:31.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:30.557327+0000 osd.5 (osd.5) 378 : cluster [DBG] 6.19 scrub starts 2024-02-10T08:43:31.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:30.581136+0000 osd.5 (osd.5) 379 : cluster [DBG] 6.19 scrub ok 2024-02-10T08:43:31.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:31.143586+0000 mon.a (mon.0) 2008 : cluster [DBG] osdmap e510: 8 total, 8 up, 8 in 2024-02-10T08:43:31.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:30.272469+0000 osd.4 (osd.4) 93 : cluster [DBG] 6.32 scrub starts 2024-02-10T08:43:31.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:30.275355+0000 osd.4 (osd.4) 94 : cluster [DBG] 6.32 scrub ok 2024-02-10T08:43:31.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:30.350586+0000 osd.7 (osd.7) 89 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:43:31.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:30.350687+0000 osd.7 (osd.7) 90 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:43:31.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:30.433778+0000 mon.a (mon.0) 2007 : cluster [DBG] osdmap e509: 8 total, 8 up, 8 in 2024-02-10T08:43:31.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:30.557327+0000 osd.5 (osd.5) 378 : cluster [DBG] 6.19 scrub starts 2024-02-10T08:43:31.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:30.581136+0000 osd.5 (osd.5) 379 : cluster [DBG] 6.19 scrub ok 2024-02-10T08:43:31.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:31 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:31.143586+0000 mon.a (mon.0) 2008 : cluster [DBG] osdmap e510: 8 total, 8 up, 8 in 2024-02-10T08:43:31.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:30.272469+0000 osd.4 (osd.4) 93 : cluster [DBG] 6.32 scrub starts 2024-02-10T08:43:31.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:30.275355+0000 osd.4 (osd.4) 94 : cluster [DBG] 6.32 scrub ok 2024-02-10T08:43:31.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:30.350586+0000 osd.7 (osd.7) 89 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:43:31.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:30.350687+0000 osd.7 (osd.7) 90 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:43:31.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:30.433778+0000 mon.a (mon.0) 2007 : cluster [DBG] osdmap e509: 8 total, 8 up, 8 in 2024-02-10T08:43:31.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:30.557327+0000 osd.5 (osd.5) 378 : cluster [DBG] 6.19 scrub starts 2024-02-10T08:43:31.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:30.581136+0000 osd.5 (osd.5) 379 : cluster [DBG] 6.19 scrub ok 2024-02-10T08:43:31.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:31.143586+0000 mon.a (mon.0) 2008 : cluster [DBG] osdmap e510: 8 total, 8 up, 8 in 2024-02-10T08:43:31.870 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:43:31.873 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-02-10T08:43:32.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:30.585152+0000 osd.7 (osd.7) 91 : cluster [DBG] 1.0 scrub starts 2024-02-10T08:43:32.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:30.586164+0000 osd.7 (osd.7) 92 : cluster [DBG] 1.0 scrub ok 2024-02-10T08:43:32.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:31.111802+0000 osd.1 (osd.1) 403 : cluster [DBG] 6.20 scrub starts 2024-02-10T08:43:32.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:31.114794+0000 osd.1 (osd.1) 404 : cluster [DBG] 6.20 scrub ok 2024-02-10T08:43:32.637 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:31.264658+0000 mgr.y (mgr.14505) 997 : cluster [DBG] pgmap v1236: 162 pgs: 162 active+clean; 5.7 KiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-10T08:43:32.637 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:31.536919+0000 osd.5 (osd.5) 380 : cluster [DBG] 6.31 scrub starts 2024-02-10T08:43:32.637 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:31.539856+0000 osd.5 (osd.5) 381 : cluster [DBG] 6.31 scrub ok 2024-02-10T08:43:32.637 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:31.662777+0000 osd.6 (osd.6) 365 : cluster [DBG] 5.1f scrub starts 2024-02-10T08:43:32.637 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:31.666245+0000 osd.6 (osd.6) 366 : cluster [DBG] 5.1f scrub ok 2024-02-10T08:43:32.637 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:30.585152+0000 osd.7 (osd.7) 91 : cluster [DBG] 1.0 scrub starts 2024-02-10T08:43:32.637 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:30.586164+0000 osd.7 (osd.7) 92 : cluster [DBG] 1.0 scrub ok 2024-02-10T08:43:32.637 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:31.111802+0000 osd.1 (osd.1) 403 : cluster [DBG] 6.20 scrub starts 2024-02-10T08:43:32.637 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:31.114794+0000 osd.1 (osd.1) 404 : cluster [DBG] 6.20 scrub ok 2024-02-10T08:43:32.637 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:31.264658+0000 mgr.y (mgr.14505) 997 : cluster [DBG] pgmap v1236: 162 pgs: 162 active+clean; 5.7 KiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-10T08:43:32.637 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:31.536919+0000 osd.5 (osd.5) 380 : cluster [DBG] 6.31 scrub starts 2024-02-10T08:43:32.637 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:31.539856+0000 osd.5 (osd.5) 381 : cluster [DBG] 6.31 scrub ok 2024-02-10T08:43:32.638 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:31.662777+0000 osd.6 (osd.6) 365 : cluster [DBG] 5.1f scrub starts 2024-02-10T08:43:32.638 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:32 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:31.666245+0000 osd.6 (osd.6) 366 : cluster [DBG] 5.1f scrub ok 2024-02-10T08:43:32.660 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":1236,"stamp":"2024-02-10T08:43:31.264325+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":5796,"num_objects":192,"num_object_clones":0,"num_object_copies":576,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":192,"num_whiteouts":0,"num_read":3111,"num_read_kb":2863,"num_write":999,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":326,"num_bytes_recovered":10419,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1187,"ondisk_log_size":1187,"up":486,"acting":486,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":488,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":6163948,"kb_used_data":122028,"kb_used_omap":265,"kb_used_meta":6041590,"kb_avail":743797268,"statfs":{"total":767960285184,"available":761648402432,"internally_reserved":0,"allocated":124956672,"data_stored":120389540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":271806,"internal_metadata":6186588738},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002270"},"pg_stats":[{"pgid":"6.33","version":"0'0","reported_seq":434,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:25.581526+0000","last_change":"2024-02-10T08:43:25.581526+0000","last_active":"2024-02-10T08:43:25.581526+0000","last_peered":"2024-02-10T08:43:25.581526+0000","last_clean":"2024-02-10T08:43:25.581526+0000","last_became_active":"2024-02-10T08:41:14.135273+0000","last_became_peered":"2024-02-10T08:41:14.135273+0000","last_unstale":"2024-02-10T08:43:25.581526+0000","last_undegraded":"2024-02-10T08:43:25.581526+0000","last_fullsized":"2024-02-10T08:43:25.581526+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:25.581432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:43:25.581432+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2],"acting":[5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":505,"reported_epoch":507,"state":"active+clean","last_fresh":"2024-02-10T08:42:49.315158+0000","last_change":"2024-02-10T08:42:10.000244+0000","last_active":"2024-02-10T08:42:49.315158+0000","last_peered":"2024-02-10T08:42:49.315158+0000","last_clean":"2024-02-10T08:42:49.315158+0000","last_became_active":"2024-02-10T08:41:09.774663+0000","last_became_peered":"2024-02-10T08:41:09.774663+0000","last_unstale":"2024-02-10T08:42:49.315158+0000","last_undegraded":"2024-02-10T08:42:49.315158+0000","last_fullsized":"2024-02-10T08:42:49.315158+0000","mapping_epoch":463,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":464,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:10.000149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:42:10.000149+0000","last_clean_scrub_stamp":"2024-02-10T08:42:10.000149+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"506'15","reported_seq":90,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:21.361540+0000","last_change":"2024-02-10T08:42:40.302632+0000","last_active":"2024-02-10T08:43:21.361540+0000","last_peered":"2024-02-10T08:43:21.361540+0000","last_clean":"2024-02-10T08:43:21.361540+0000","last_became_active":"2024-02-10T08:41:14.149970+0000","last_became_peered":"2024-02-10T08:41:14.149970+0000","last_unstale":"2024-02-10T08:43:21.361540+0000","last_undegraded":"2024-02-10T08:43:21.361540+0000","last_fullsized":"2024-02-10T08:43:21.361540+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"506'15","last_scrub_stamp":"2024-02-10T08:42:40.302555+0000","last_deep_scrub":"506'15","last_deep_scrub_stamp":"2024-02-10T08:42:40.302555+0000","last_clean_scrub_stamp":"2024-02-10T08:42:40.302555+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"402'39","reported_seq":625,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:42:51.596092+0000","last_change":"2024-02-10T08:42:51.596092+0000","last_active":"2024-02-10T08:42:51.596092+0000","last_peered":"2024-02-10T08:42:51.596092+0000","last_clean":"2024-02-10T08:42:51.596092+0000","last_became_active":"2024-02-10T08:41:14.145261+0000","last_became_peered":"2024-02-10T08:41:14.145261+0000","last_unstale":"2024-02-10T08:42:51.596092+0000","last_undegraded":"2024-02-10T08:42:51.596092+0000","last_fullsized":"2024-02-10T08:42:51.596092+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'39","last_scrub_stamp":"2024-02-10T08:42:51.596011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:42:51.596011+0000","log_size":39,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":62,"num_read_kb":53,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":563,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:18.407979+0000","last_change":"2024-02-10T08:43:18.407979+0000","last_active":"2024-02-10T08:43:18.407979+0000","last_peered":"2024-02-10T08:43:18.407979+0000","last_clean":"2024-02-10T08:43:18.407979+0000","last_became_active":"2024-02-10T08:41:14.126836+0000","last_became_peered":"2024-02-10T08:41:14.126836+0000","last_unstale":"2024-02-10T08:43:18.407979+0000","last_undegraded":"2024-02-10T08:43:18.407979+0000","last_fullsized":"2024-02-10T08:43:18.407979+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:18.407916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:43:18.407916+0000","last_clean_scrub_stamp":"2024-02-10T08:43:18.407916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":522,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:04.530439+0000","last_change":"2024-02-10T08:43:04.530439+0000","last_active":"2024-02-10T08:43:04.530439+0000","last_peered":"2024-02-10T08:43:04.530439+0000","last_clean":"2024-02-10T08:43:04.530439+0000","last_became_active":"2024-02-10T08:30:24.062795+0000","last_became_peered":"2024-02-10T08:30:24.062795+0000","last_unstale":"2024-02-10T08:43:04.530439+0000","last_undegraded":"2024-02-10T08:43:04.530439+0000","last_fullsized":"2024-02-10T08:43:04.530439+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:04.530366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:20.392249+0000","last_clean_scrub_stamp":"2024-02-10T08:43:04.530366+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"419'25","reported_seq":342,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:14.452730+0000","last_change":"2024-02-10T08:43:14.452730+0000","last_active":"2024-02-10T08:43:14.452730+0000","last_peered":"2024-02-10T08:43:14.452730+0000","last_clean":"2024-02-10T08:43:14.452730+0000","last_became_active":"2024-02-10T08:41:09.785066+0000","last_became_peered":"2024-02-10T08:41:09.785066+0000","last_unstale":"2024-02-10T08:43:14.452730+0000","last_undegraded":"2024-02-10T08:43:14.452730+0000","last_fullsized":"2024-02-10T08:43:14.452730+0000","mapping_epoch":463,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":464,"parent":"0.0","parent_split_bits":0,"last_scrub":"419'25","last_scrub_stamp":"2024-02-10T08:43:14.452648+0000","last_deep_scrub":"419'25","last_deep_scrub_stamp":"2024-02-10T08:38:11.355898+0000","last_clean_scrub_stamp":"2024-02-10T08:43:14.452648+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":34,"num_read_kb":28,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":532,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:06.094538+0000","last_change":"2024-02-10T08:43:06.094538+0000","last_active":"2024-02-10T08:43:06.094538+0000","last_peered":"2024-02-10T08:43:06.094538+0000","last_clean":"2024-02-10T08:43:06.094538+0000","last_became_active":"2024-02-10T08:41:09.772080+0000","last_became_peered":"2024-02-10T08:41:09.772080+0000","last_unstale":"2024-02-10T08:43:06.094538+0000","last_undegraded":"2024-02-10T08:43:06.094538+0000","last_fullsized":"2024-02-10T08:43:06.094538+0000","mapping_epoch":463,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":464,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:06.094471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:41:38.751945+0000","last_clean_scrub_stamp":"2024-02-10T08:43:06.094471+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":570,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:42:57.493971+0000","last_change":"2024-02-10T08:42:57.493971+0000","last_active":"2024-02-10T08:42:57.493971+0000","last_peered":"2024-02-10T08:42:57.493971+0000","last_clean":"2024-02-10T08:42:57.493971+0000","last_became_active":"2024-02-10T08:41:09.761875+0000","last_became_peered":"2024-02-10T08:41:09.761875+0000","last_unstale":"2024-02-10T08:42:57.493971+0000","last_undegraded":"2024-02-10T08:42:57.493971+0000","last_fullsized":"2024-02-10T08:42:57.493971+0000","mapping_epoch":463,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":464,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:57.493901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:41:26.004336+0000","last_clean_scrub_stamp":"2024-02-10T08:42:57.493901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"76'2","reported_seq":216,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:27.426701+0000","last_change":"2024-02-10T08:43:27.426701+0000","last_active":"2024-02-10T08:43:27.426701+0000","last_peered":"2024-02-10T08:43:27.426701+0000","last_clean":"2024-02-10T08:43:27.426701+0000","last_became_active":"2024-02-10T08:41:14.144466+0000","last_became_peered":"2024-02-10T08:41:14.144466+0000","last_unstale":"2024-02-10T08:43:27.426701+0000","last_undegraded":"2024-02-10T08:43:27.426701+0000","last_fullsized":"2024-02-10T08:43:27.426701+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'2","last_scrub_stamp":"2024-02-10T08:43:27.426556+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2024-02-10T08:43:27.426556+0000","last_clean_scrub_stamp":"2024-02-10T08:43:27.426556+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"402'60","reported_seq":648,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:22.497652+0000","last_change":"2024-02-10T08:43:22.497652+0000","last_active":"2024-02-10T08:43:22.497652+0000","last_peered":"2024-02-10T08:43:22.497652+0000","last_clean":"2024-02-10T08:43:22.497652+0000","last_became_active":"2024-02-10T08:41:14.140211+0000","last_became_peered":"2024-02-10T08:41:14.140211+0000","last_unstale":"2024-02-10T08:43:22.497652+0000","last_undegraded":"2024-02-10T08:43:22.497652+0000","last_fullsized":"2024-02-10T08:43:22.497652+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'60","last_scrub_stamp":"2024-02-10T08:43:22.497567+0000","last_deep_scrub":"391'44","last_deep_scrub_stamp":"2024-02-10T08:36:15.980533+0000","last_clean_scrub_stamp":"2024-02-10T08:43:22.497567+0000","log_size":60,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":80,"num_read_kb":69,"num_write":52,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":529,"reported_epoch":507,"state":"active+clean","last_fresh":"2024-02-10T08:42:49.317347+0000","last_change":"2024-02-10T08:42:28.621848+0000","last_active":"2024-02-10T08:42:49.317347+0000","last_peered":"2024-02-10T08:42:49.317347+0000","last_clean":"2024-02-10T08:42:49.317347+0000","last_became_active":"2024-02-10T08:28:02.781029+0000","last_became_peered":"2024-02-10T08:28:02.781029+0000","last_unstale":"2024-02-10T08:42:49.317347+0000","last_undegraded":"2024-02-10T08:42:49.317347+0000","last_fullsized":"2024-02-10T08:42:49.317347+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:28.621760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:42:28.621760+0000","last_clean_scrub_stamp":"2024-02-10T08:42:28.621760+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":525,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:10.562799+0000","last_change":"2024-02-10T08:43:10.562799+0000","last_active":"2024-02-10T08:43:10.562799+0000","last_peered":"2024-02-10T08:43:10.562799+0000","last_clean":"2024-02-10T08:43:10.562799+0000","last_became_active":"2024-02-10T08:28:02.779438+0000","last_became_peered":"2024-02-10T08:28:02.779438+0000","last_unstale":"2024-02-10T08:43:10.562799+0000","last_undegraded":"2024-02-10T08:43:10.562799+0000","last_fullsized":"2024-02-10T08:43:10.562799+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:10.562726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.593849+0000","last_clean_scrub_stamp":"2024-02-10T08:43:10.562726+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":53,"reported_epoch":507,"state":"active+clean","last_fresh":"2024-02-10T08:42:49.389142+0000","last_change":"2024-02-10T08:42:08.243105+0000","last_active":"2024-02-10T08:42:49.389142+0000","last_peered":"2024-02-10T08:42:49.389142+0000","last_clean":"2024-02-10T08:42:49.389142+0000","last_became_active":"2024-02-10T08:41:14.144499+0000","last_became_peered":"2024-02-10T08:41:14.144499+0000","last_unstale":"2024-02-10T08:42:49.389142+0000","last_undegraded":"2024-02-10T08:42:49.389142+0000","last_fullsized":"2024-02-10T08:42:49.389142+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:08.243018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:42:08.243018+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,3],"acting":[7,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.8","version":"0'0","reported_seq":116,"reported_epoch":507,"state":"active+clean","last_fresh":"2024-02-10T08:42:49.601210+0000","last_change":"2024-02-10T08:42:41.690842+0000","last_active":"2024-02-10T08:42:49.601210+0000","last_peered":"2024-02-10T08:42:49.601210+0000","last_clean":"2024-02-10T08:42:49.601210+0000","last_became_active":"2024-02-10T08:37:45.981258+0000","last_became_peered":"2024-02-10T08:37:45.981258+0000","last_unstale":"2024-02-10T08:42:49.601210+0000","last_undegraded":"2024-02-10T08:42:49.601210+0000","last_fullsized":"2024-02-10T08:42:49.601210+0000","mapping_epoch":411,"log_start":"0'0","ondisk_log_start":"0'0","created":409,"last_epoch_clean":412,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:41.690745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:41:25.264737+0000","last_clean_scrub_stamp":"2024-02-10T08:42:41.690745+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"508'53","reported_seq":234,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:16.338542+0000","last_change":"2024-02-10T08:43:16.338542+0000","last_active":"2024-02-10T08:43:16.338542+0000","last_peered":"2024-02-10T08:43:16.338542+0000","last_clean":"2024-02-10T08:43:16.338542+0000","last_became_active":"2024-02-10T08:41:09.770353+0000","last_became_peered":"2024-02-10T08:41:09.770353+0000","last_unstale":"2024-02-10T08:43:16.338542+0000","last_undegraded":"2024-02-10T08:43:16.338542+0000","last_fullsized":"2024-02-10T08:43:16.338542+0000","mapping_epoch":463,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":464,"parent":"0.0","parent_split_bits":0,"last_scrub":"508'53","last_scrub_stamp":"2024-02-10T08:43:16.338469+0000","last_deep_scrub":"508'53","last_deep_scrub_stamp":"2024-02-10T08:43:16.338469+0000","last_clean_scrub_stamp":"2024-02-10T08:43:16.338469+0000","log_size":53,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":68,"num_read_kb":58,"num_write":46,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":58,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:42:51.377300+0000","last_change":"2024-02-10T08:42:51.377300+0000","last_active":"2024-02-10T08:42:51.377300+0000","last_peered":"2024-02-10T08:42:51.377300+0000","last_clean":"2024-02-10T08:42:51.377300+0000","last_became_active":"2024-02-10T08:41:14.135767+0000","last_became_peered":"2024-02-10T08:41:14.135767+0000","last_unstale":"2024-02-10T08:42:51.377300+0000","last_undegraded":"2024-02-10T08:42:51.377300+0000","last_fullsized":"2024-02-10T08:42:51.377300+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:51.377188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:42:51.377188+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":541,"reported_epoch":507,"state":"active+clean","last_fresh":"2024-02-10T08:42:49.315593+0000","last_change":"2024-02-10T08:42:28.012122+0000","last_active":"2024-02-10T08:42:49.315593+0000","last_peered":"2024-02-10T08:42:49.315593+0000","last_clean":"2024-02-10T08:42:49.315593+0000","last_became_active":"2024-02-10T08:41:09.777938+0000","last_became_peered":"2024-02-10T08:41:09.777938+0000","last_unstale":"2024-02-10T08:42:49.315593+0000","last_undegraded":"2024-02-10T08:42:49.315593+0000","last_fullsized":"2024-02-10T08:42:49.315593+0000","mapping_epoch":463,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":464,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:28.011957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:42:28.011957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":488,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:03.580824+0000","last_change":"2024-02-10T08:43:03.580824+0000","last_active":"2024-02-10T08:43:03.580824+0000","last_peered":"2024-02-10T08:43:03.580824+0000","last_clean":"2024-02-10T08:43:03.580824+0000","last_became_active":"2024-02-10T08:41:09.777127+0000","last_became_peered":"2024-02-10T08:41:09.777127+0000","last_unstale":"2024-02-10T08:43:03.580824+0000","last_undegraded":"2024-02-10T08:43:03.580824+0000","last_fullsized":"2024-02-10T08:43:03.580824+0000","mapping_epoch":463,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":464,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:03.580737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:34.215363+0000","last_clean_scrub_stamp":"2024-02-10T08:43:03.580737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.9","version":"0'0","reported_seq":58,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:11.560389+0000","last_change":"2024-02-10T08:43:11.560389+0000","last_active":"2024-02-10T08:43:11.560389+0000","last_peered":"2024-02-10T08:43:11.560389+0000","last_clean":"2024-02-10T08:43:11.560389+0000","last_became_active":"2024-02-10T08:41:14.139027+0000","last_became_peered":"2024-02-10T08:41:14.139027+0000","last_unstale":"2024-02-10T08:43:11.560389+0000","last_undegraded":"2024-02-10T08:43:11.560389+0000","last_fullsized":"2024-02-10T08:43:11.560389+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":409,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:11.560313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:43:11.560313+0000","last_clean_scrub_stamp":"2024-02-10T08:43:11.560313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"402'30","reported_seq":525,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:05.213853+0000","last_change":"2024-02-10T08:43:05.213853+0000","last_active":"2024-02-10T08:43:05.213853+0000","last_peered":"2024-02-10T08:43:05.213853+0000","last_clean":"2024-02-10T08:43:05.213853+0000","last_became_active":"2024-02-10T08:41:09.768065+0000","last_became_peered":"2024-02-10T08:41:09.768065+0000","last_unstale":"2024-02-10T08:43:05.213853+0000","last_undegraded":"2024-02-10T08:43:05.213853+0000","last_fullsized":"2024-02-10T08:43:05.213853+0000","mapping_epoch":463,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":464,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'30","last_scrub_stamp":"2024-02-10T08:43:05.213742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:43:05.213742+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":38,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":517,"reported_epoch":507,"state":"active+clean","last_fresh":"2024-02-10T08:42:49.315149+0000","last_change":"2024-02-10T08:42:03.904601+0000","last_active":"2024-02-10T08:42:49.315149+0000","last_peered":"2024-02-10T08:42:49.315149+0000","last_clean":"2024-02-10T08:42:49.315149+0000","last_became_active":"2024-02-10T08:41:14.135215+0000","last_became_peered":"2024-02-10T08:41:14.135215+0000","last_unstale":"2024-02-10T08:42:49.315149+0000","last_undegraded":"2024-02-10T08:42:49.315149+0000","last_fullsized":"2024-02-10T08:42:49.315149+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:03.904461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:42:03.904461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"468'10","reported_seq":860,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:21.361474+0000","last_change":"2024-02-10T08:43:03.492712+0000","last_active":"2024-02-10T08:43:21.361474+0000","last_peered":"2024-02-10T08:43:21.361474+0000","last_clean":"2024-02-10T08:43:21.361474+0000","last_became_active":"2024-02-10T08:41:14.135852+0000","last_became_peered":"2024-02-10T08:41:14.135852+0000","last_unstale":"2024-02-10T08:43:21.361474+0000","last_undegraded":"2024-02-10T08:43:21.361474+0000","last_fullsized":"2024-02-10T08:43:21.361474+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"468'10","last_scrub_stamp":"2024-02-10T08:43:03.492645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:43:03.492645+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":453,"reported_epoch":507,"state":"active+clean","last_fresh":"2024-02-10T08:42:49.315957+0000","last_change":"2024-02-10T08:42:11.012824+0000","last_active":"2024-02-10T08:42:49.315957+0000","last_peered":"2024-02-10T08:42:49.315957+0000","last_clean":"2024-02-10T08:42:49.315957+0000","last_became_active":"2024-02-10T08:41:09.780770+0000","last_became_peered":"2024-02-10T08:41:09.780770+0000","last_unstale":"2024-02-10T08:42:49.315957+0000","last_undegraded":"2024-02-10T08:42:49.315957+0000","last_fullsized":"2024-02-10T08:42:49.315957+0000","mapping_epoch":463,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":464,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:11.012756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:33:29.477480+0000","last_clean_scrub_stamp":"2024-02-10T08:42:11.012756+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.a","version":"0'0","reported_seq":116,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:10.515167+0000","last_change":"2024-02-10T08:43:10.515167+0000","last_active":"2024-02-10T08:43:10.515167+0000","last_peered":"2024-02-10T08:43:10.515167+0000","last_clean":"2024-02-10T08:43:10.515167+0000","last_became_active":"2024-02-10T08:37:45.980492+0000","last_became_peered":"2024-02-10T08:37:45.980492+0000","last_unstale":"2024-02-10T08:43:10.515167+0000","last_undegraded":"2024-02-10T08:43:10.515167+0000","last_fullsized":"2024-02-10T08:43:10.515167+0000","mapping_epoch":411,"log_start":"0'0","ondisk_log_start":"0'0","created":409,"last_epoch_clean":412,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:10.515089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:14:44.584370+0000","last_clean_scrub_stamp":"2024-02-10T08:43:10.515089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.f","version":"508'46","reported_seq":569,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:42:53.450779+0000","last_change":"2024-02-10T08:42:53.450779+0000","last_active":"2024-02-10T08:42:53.450779+0000","last_peered":"2024-02-10T08:42:53.450779+0000","last_clean":"2024-02-10T08:42:53.450779+0000","last_became_active":"2024-02-10T08:41:09.761871+0000","last_became_peered":"2024-02-10T08:41:09.761871+0000","last_unstale":"2024-02-10T08:42:53.450779+0000","last_undegraded":"2024-02-10T08:42:53.450779+0000","last_fullsized":"2024-02-10T08:42:53.450779+0000","mapping_epoch":463,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":464,"parent":"0.0","parent_split_bits":0,"last_scrub":"508'46","last_scrub_stamp":"2024-02-10T08:42:53.450701+0000","last_deep_scrub":"508'46","last_deep_scrub_stamp":"2024-02-10T08:42:53.450701+0000","last_clean_scrub_stamp":"2024-02-10T08:42:53.450701+0000","log_size":46,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":62,"num_read_kb":53,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":520,"reported_epoch":507,"state":"active+clean","last_fresh":"2024-02-10T08:42:49.315247+0000","last_change":"2024-02-10T08:42:40.954634+0000","last_active":"2024-02-10T08:42:49.315247+0000","last_peered":"2024-02-10T08:42:49.315247+0000","last_clean":"2024-02-10T08:42:49.315247+0000","last_became_active":"2024-02-10T08:41:14.145391+0000","last_became_peered":"2024-02-10T08:41:14.145391+0000","last_unstale":"2024-02-10T08:42:49.315247+0000","last_undegraded":"2024-02-10T08:42:49.315247+0000","last_fullsized":"2024-02-10T08:42:49.315247+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:40.954513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:42:40.954513+0000","last_clean_scrub_stamp":"2024-02-10T08:42:40.954513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"465'16","reported_seq":338,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:21.361558+0000","last_change":"2024-02-10T08:42:29.158432+0000","last_active":"2024-02-10T08:43:21.361558+0000","last_peered":"2024-02-10T08:43:21.361558+0000","last_clean":"2024-02-10T08:43:21.361558+0000","last_became_active":"2024-02-10T08:41:09.778666+0000","last_became_peered":"2024-02-10T08:41:09.778666+0000","last_unstale":"2024-02-10T08:43:21.361558+0000","last_undegraded":"2024-02-10T08:43:21.361558+0000","last_fullsized":"2024-02-10T08:43:21.361558+0000","mapping_epoch":463,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":464,"parent":"0.0","parent_split_bits":0,"last_scrub":"465'16","last_scrub_stamp":"2024-02-10T08:42:29.158351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:42:29.158351+0000","log_size":16,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":517,"reported_epoch":507,"state":"active+clean","last_fresh":"2024-02-10T08:42:49.602723+0000","last_change":"2024-02-10T08:42:42.723797+0000","last_active":"2024-02-10T08:42:49.602723+0000","last_peered":"2024-02-10T08:42:49.602723+0000","last_clean":"2024-02-10T08:42:49.602723+0000","last_became_active":"2024-02-10T08:32:36.978932+0000","last_became_peered":"2024-02-10T08:32:36.978932+0000","last_unstale":"2024-02-10T08:42:49.602723+0000","last_undegraded":"2024-02-10T08:42:49.602723+0000","last_fullsized":"2024-02-10T08:42:49.602723+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:42.723705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:41:11.291643+0000","last_clean_scrub_stamp":"2024-02-10T08:42:42.723705+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"402'32","reported_seq":501,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:21.269374+0000","last_change":"2024-02-10T08:43:21.269374+0000","last_active":"2024-02-10T08:43:21.269374+0000","last_peered":"2024-02-10T08:43:21.269374+0000","last_clean":"2024-02-10T08:43:21.269374+0000","last_became_active":"2024-02-10T08:41:09.765668+0000","last_became_peered":"2024-02-10T08:41:09.765668+0000","last_unstale":"2024-02-10T08:43:21.269374+0000","last_undegraded":"2024-02-10T08:43:21.269374+0000","last_fullsized":"2024-02-10T08:43:21.269374+0000","mapping_epoch":463,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":464,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'32","last_scrub_stamp":"2024-02-10T08:43:21.269305+0000","last_deep_scrub":"76'16","last_deep_scrub_stamp":"2024-02-10T08:18:07.909782+0000","last_clean_scrub_stamp":"2024-02-10T08:43:21.269305+0000","log_size":32,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":36,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":58,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:42:58.455400+0000","last_change":"2024-02-10T08:42:58.455400+0000","last_active":"2024-02-10T08:42:58.455400+0000","last_peered":"2024-02-10T08:42:58.455400+0000","last_clean":"2024-02-10T08:42:58.455400+0000","last_became_active":"2024-02-10T08:41:14.136692+0000","last_became_peered":"2024-02-10T08:41:14.136692+0000","last_unstale":"2024-02-10T08:42:58.455400+0000","last_undegraded":"2024-02-10T08:42:58.455400+0000","last_fullsized":"2024-02-10T08:42:58.455400+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:58.455325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:42:58.455325+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":576,"reported_epoch":507,"state":"active+clean","last_fresh":"2024-02-10T08:42:49.602867+0000","last_change":"2024-02-10T08:42:23.032815+0000","last_active":"2024-02-10T08:42:49.602867+0000","last_peered":"2024-02-10T08:42:49.602867+0000","last_clean":"2024-02-10T08:42:49.602867+0000","last_became_active":"2024-02-10T08:41:09.777142+0000","last_became_peered":"2024-02-10T08:41:09.777142+0000","last_unstale":"2024-02-10T08:42:49.602867+0000","last_undegraded":"2024-02-10T08:42:49.602867+0000","last_fullsized":"2024-02-10T08:42:49.602867+0000","mapping_epoch":463,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":464,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:23.032735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:42:23.032735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":247,"reported_epoch":507,"state":"active+clean","last_fresh":"2024-02-10T08:42:49.362217+0000","last_change":"2024-02-10T08:42:26.392746+0000","last_active":"2024-02-10T08:42:49.362217+0000","last_peered":"2024-02-10T08:42:49.362217+0000","last_clean":"2024-02-10T08:42:49.362217+0000","last_became_active":"2024-02-10T08:41:58.348494+0000","last_became_peered":"2024-02-10T08:41:58.348494+0000","last_unstale":"2024-02-10T08:42:49.362217+0000","last_undegraded":"2024-02-10T08:42:49.362217+0000","last_fullsized":"2024-02-10T08:42:49.362217+0000","mapping_epoch":487,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":488,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:26.392681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:42:26.392681+0000","last_clean_scrub_stamp":"2024-02-10T08:42:26.392681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":110,"reported_epoch":507,"state":"active+clean","last_fresh":"2024-02-10T08:42:49.362435+0000","last_change":"2024-02-10T08:42:19.441688+0000","last_active":"2024-02-10T08:42:49.362435+0000","last_peered":"2024-02-10T08:42:49.362435+0000","last_clean":"2024-02-10T08:42:49.362435+0000","last_became_active":"2024-02-10T08:41:58.348496+0000","last_became_peered":"2024-02-10T08:41:58.348496+0000","last_unstale":"2024-02-10T08:42:49.362435+0000","last_undegraded":"2024-02-10T08:42:49.362435+0000","last_fullsized":"2024-02-10T08:42:49.362435+0000","mapping_epoch":487,"log_start":"0'0","ondisk_log_start":"0'0","created":409,"last_epoch_clean":488,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:19.441627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:14:44.584370+0000","last_clean_scrub_stamp":"2024-02-10T08:42:19.441627+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"489'17","reported_seq":390,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:21.361486+0000","last_change":"2024-02-10T08:42:52.518214+0000","last_active":"2024-02-10T08:43:21.361486+0000","last_peered":"2024-02-10T08:43:21.361486+0000","last_clean":"2024-02-10T08:43:21.361486+0000","last_became_active":"2024-02-10T08:41:58.159981+0000","last_became_peered":"2024-02-10T08:41:58.159981+0000","last_unstale":"2024-02-10T08:43:21.361486+0000","last_undegraded":"2024-02-10T08:43:21.361486+0000","last_fullsized":"2024-02-10T08:43:21.361486+0000","mapping_epoch":487,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":488,"parent":"0.0","parent_split_bits":0,"last_scrub":"489'17","last_scrub_stamp":"2024-02-10T08:42:52.518099+0000","last_deep_scrub":"489'17","last_deep_scrub_stamp":"2024-02-10T08:42:52.518099+0000","last_clean_scrub_stamp":"2024-02-10T08:42:52.518099+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"402'42","reported_seq":529,"reported_epoch":507,"state":"active+clean","last_fresh":"2024-02-10T08:42:50.209312+0000","last_change":"2024-02-10T08:42:50.209282+0000","last_active":"2024-02-10T08:42:50.209312+0000","last_peered":"2024-02-10T08:42:50.209312+0000","last_clean":"2024-02-10T08:42:50.209312+0000","last_became_active":"2024-02-10T08:41:09.767320+0000","last_became_peered":"2024-02-10T08:41:09.767320+0000","last_unstale":"2024-02-10T08:42:50.209312+0000","last_undegraded":"2024-02-10T08:42:50.209312+0000","last_fullsized":"2024-02-10T08:42:50.209312+0000","mapping_epoch":463,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":464,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'42","last_scrub_stamp":"2024-02-10T08:42:50.209197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:42:50.209197+0000","log_size":42,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":61,"num_read_kb":54,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":527,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:23.478859+0000","last_change":"2024-02-10T08:43:23.478859+0000","last_active":"2024-02-10T08:43:23.478859+0000","last_peered":"2024-02-10T08:43:23.478859+0000","last_clean":"2024-02-10T08:43:23.478859+0000","last_became_active":"2024-02-10T08:41:14.139943+0000","last_became_peered":"2024-02-10T08:41:14.139943+0000","last_unstale":"2024-02-10T08:43:23.478859+0000","last_undegraded":"2024-02-10T08:43:23.478859+0000","last_fullsized":"2024-02-10T08:43:23.478859+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:23.478763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:42:13.417477+0000","last_clean_scrub_stamp":"2024-02-10T08:43:23.478763+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":53,"reported_epoch":507,"state":"active+clean","last_fresh":"2024-02-10T08:42:49.389807+0000","last_change":"2024-02-10T08:42:26.290612+0000","last_active":"2024-02-10T08:42:49.389807+0000","last_peered":"2024-02-10T08:42:49.389807+0000","last_clean":"2024-02-10T08:42:49.389807+0000","last_became_active":"2024-02-10T08:41:14.138960+0000","last_became_peered":"2024-02-10T08:41:14.138960+0000","last_unstale":"2024-02-10T08:42:49.389807+0000","last_undegraded":"2024-02-10T08:42:49.389807+0000","last_fullsized":"2024-02-10T08:42:49.389807+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:26.290534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:42:26.290534+0000","last_clean_scrub_stamp":"2024-02-10T08:42:26.290534+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":117,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:11.267525+0000","last_change":"2024-02-10T08:43:11.267525+0000","last_active":"2024-02-10T08:43:11.267525+0000","last_peered":"2024-02-10T08:43:11.267525+0000","last_clean":"2024-02-10T08:43:11.267525+0000","last_became_active":"2024-02-10T08:41:09.774274+0000","last_became_peered":"2024-02-10T08:41:09.774274+0000","last_unstale":"2024-02-10T08:43:11.267525+0000","last_undegraded":"2024-02-10T08:43:11.267525+0000","last_fullsized":"2024-02-10T08:43:11.267525+0000","mapping_epoch":463,"log_start":"0'0","ondisk_log_start":"0'0","created":409,"last_epoch_clean":464,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:11.267453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:14:44.584370+0000","last_clean_scrub_stamp":"2024-02-10T08:43:11.267453+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":487,"reported_epoch":507,"state":"active+clean","last_fresh":"2024-02-10T08:42:49.315107+0000","last_change":"2024-02-10T08:42:34.252837+0000","last_active":"2024-02-10T08:42:49.315107+0000","last_peered":"2024-02-10T08:42:49.315107+0000","last_clean":"2024-02-10T08:42:49.315107+0000","last_became_active":"2024-02-10T08:41:14.136599+0000","last_became_peered":"2024-02-10T08:41:14.136599+0000","last_unstale":"2024-02-10T08:42:49.315107+0000","last_undegraded":"2024-02-10T08:42:49.315107+0000","last_fullsized":"2024-02-10T08:42:49.315107+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:34.252745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:42:34.252745+0000","last_clean_scrub_stamp":"2024-02-10T08:42:34.252745+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"402'42","reported_seq":489,"reported_epoch":507,"state":"active+clean","last_fresh":"2024-02-10T08:42:49.361651+0000","last_change":"2024-02-10T08:42:44.541584+0000","last_active":"2024-02-10T08:42:49.361651+0000","last_peered":"2024-02-10T08:42:49.361651+0000","last_clean":"2024-02-10T08:42:49.361651+0000","last_became_active":"2024-02-10T08:41:58.160422+0000","last_became_peered":"2024-02-10T08:41:58.160422+0000","last_unstale":"2024-02-10T08:42:49.361651+0000","last_undegraded":"2024-02-10T08:42:49.361651+0000","last_fullsized":"2024-02-10T08:42:49.361651+0000","mapping_epoch":487,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":488,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'42","last_scrub_stamp":"2024-02-10T08:42:44.541496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:42:44.541496+0000","log_size":42,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":68,"num_read_kb":56,"num_write":44,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":527,"reported_epoch":507,"state":"active+clean","last_fresh":"2024-02-10T08:42:49.314440+0000","last_change":"2024-02-10T08:42:21.009527+0000","last_active":"2024-02-10T08:42:49.314440+0000","last_peered":"2024-02-10T08:42:49.314440+0000","last_clean":"2024-02-10T08:42:49.314440+0000","last_became_active":"2024-02-10T08:41:09.771168+0000","last_became_peered":"2024-02-10T08:41:09.771168+0000","last_unstale":"2024-02-10T08:42:49.314440+0000","last_undegraded":"2024-02-10T08:42:49.314440+0000","last_fullsized":"2024-02-10T08:42:49.314440+0000","mapping_epoch":463,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":464,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:21.009457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:42:21.009457+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":479,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:09.249200+0000","last_change":"2024-02-10T08:43:09.249200+0000","last_active":"2024-02-10T08:43:09.249200+0000","last_peered":"2024-02-10T08:43:09.249200+0000","last_clean":"2024-02-10T08:43:09.249200+0000","last_became_active":"2024-02-10T08:41:09.768271+0000","last_became_peered":"2024-02-10T08:41:09.768271+0000","last_unstale":"2024-02-10T08:43:09.249200+0000","last_undegraded":"2024-02-10T08:43:09.249200+0000","last_fullsized":"2024-02-10T08:43:09.249200+0000","mapping_epoch":463,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":464,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:09.249096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:25.358315+0000","last_clean_scrub_stamp":"2024-02-10T08:43:09.249096+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":448,"reported_epoch":507,"state":"active+clean","last_fresh":"2024-02-10T08:42:49.602986+0000","last_change":"2024-02-10T08:42:20.304590+0000","last_active":"2024-02-10T08:42:49.602986+0000","last_peered":"2024-02-10T08:42:49.602986+0000","last_clean":"2024-02-10T08:42:49.602986+0000","last_became_active":"2024-02-10T08:42:14.422403+0000","last_became_peered":"2024-02-10T08:42:14.422403+0000","last_unstale":"2024-02-10T08:42:49.602986+0000","last_undegraded":"2024-02-10T08:42:49.602986+0000","last_fullsized":"2024-02-10T08:42:49.602986+0000","mapping_epoch":494,"log_start":"0'0","ondisk_log_start":"0'0","created":409,"last_epoch_clean":495,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:20.304521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:14:44.584370+0000","last_clean_scrub_stamp":"2024-02-10T08:42:20.304521+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,3],"acting":[6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":383,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:05.377699+0000","last_change":"2024-02-10T08:43:05.377699+0000","last_active":"2024-02-10T08:43:05.377699+0000","last_peered":"2024-02-10T08:43:05.377699+0000","last_clean":"2024-02-10T08:43:05.377699+0000","last_became_active":"2024-02-10T08:42:14.492820+0000","last_became_peered":"2024-02-10T08:42:14.492820+0000","last_unstale":"2024-02-10T08:43:05.377699+0000","last_undegraded":"2024-02-10T08:43:05.377699+0000","last_fullsized":"2024-02-10T08:43:05.377699+0000","mapping_epoch":494,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":495,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:05.377615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:43:05.377615+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"402'47","reported_seq":662,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:42:57.529080+0000","last_change":"2024-02-10T08:42:57.529080+0000","last_active":"2024-02-10T08:42:57.529080+0000","last_peered":"2024-02-10T08:42:57.529080+0000","last_clean":"2024-02-10T08:42:57.529080+0000","last_became_active":"2024-02-10T08:41:14.144113+0000","last_became_peered":"2024-02-10T08:41:14.144113+0000","last_unstale":"2024-02-10T08:42:57.529080+0000","last_undegraded":"2024-02-10T08:42:57.529080+0000","last_fullsized":"2024-02-10T08:42:57.529080+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'47","last_scrub_stamp":"2024-02-10T08:42:57.528950+0000","last_deep_scrub":"199'27","last_deep_scrub_stamp":"2024-02-10T08:24:42.826442+0000","last_clean_scrub_stamp":"2024-02-10T08:42:57.528950+0000","log_size":47,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":68,"num_read_kb":54,"num_write":42,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":990,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":58,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:01.436727+0000","last_change":"2024-02-10T08:43:01.436727+0000","last_active":"2024-02-10T08:43:01.436727+0000","last_peered":"2024-02-10T08:43:01.436727+0000","last_clean":"2024-02-10T08:43:01.436727+0000","last_became_active":"2024-02-10T08:41:14.147110+0000","last_became_peered":"2024-02-10T08:41:14.147110+0000","last_unstale":"2024-02-10T08:43:01.436727+0000","last_undegraded":"2024-02-10T08:43:01.436727+0000","last_fullsized":"2024-02-10T08:43:01.436727+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:01.436656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:43:01.436656+0000","last_clean_scrub_stamp":"2024-02-10T08:43:01.436656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":505,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:15.076590+0000","last_change":"2024-02-10T08:43:15.076590+0000","last_active":"2024-02-10T08:43:15.076590+0000","last_peered":"2024-02-10T08:43:15.076590+0000","last_clean":"2024-02-10T08:43:15.076590+0000","last_became_active":"2024-02-10T08:21:58.553966+0000","last_became_peered":"2024-02-10T08:21:58.553966+0000","last_unstale":"2024-02-10T08:43:15.076590+0000","last_undegraded":"2024-02-10T08:43:15.076590+0000","last_fullsized":"2024-02-10T08:43:15.076590+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:15.076448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:43:15.076448+0000","last_clean_scrub_stamp":"2024-02-10T08:43:15.076448+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":126,"reported_epoch":507,"state":"active+clean","last_fresh":"2024-02-10T08:42:49.313898+0000","last_change":"2024-02-10T08:42:08.809670+0000","last_active":"2024-02-10T08:42:49.313898+0000","last_peered":"2024-02-10T08:42:49.313898+0000","last_clean":"2024-02-10T08:42:49.313898+0000","last_became_active":"2024-02-10T08:41:09.777520+0000","last_became_peered":"2024-02-10T08:41:09.777520+0000","last_unstale":"2024-02-10T08:42:49.313898+0000","last_undegraded":"2024-02-10T08:42:49.313898+0000","last_fullsized":"2024-02-10T08:42:49.313898+0000","mapping_epoch":463,"log_start":"0'0","ondisk_log_start":"0'0","created":409,"last_epoch_clean":464,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:08.809607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:14:44.584370+0000","last_clean_scrub_stamp":"2024-02-10T08:42:08.809607+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":519,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:42:57.604002+0000","last_change":"2024-02-10T08:42:57.604002+0000","last_active":"2024-02-10T08:42:57.604002+0000","last_peered":"2024-02-10T08:42:57.604002+0000","last_clean":"2024-02-10T08:42:57.604002+0000","last_became_active":"2024-02-10T08:28:02.772585+0000","last_became_peered":"2024-02-10T08:28:02.772585+0000","last_unstale":"2024-02-10T08:42:57.604002+0000","last_undegraded":"2024-02-10T08:42:57.604002+0000","last_fullsized":"2024-02-10T08:42:57.604002+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:57.603915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:41.360241+0000","last_clean_scrub_stamp":"2024-02-10T08:42:57.603915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"402'36","reported_seq":230,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:42:59.563664+0000","last_change":"2024-02-10T08:42:59.563664+0000","last_active":"2024-02-10T08:42:59.563664+0000","last_peered":"2024-02-10T08:42:59.563664+0000","last_clean":"2024-02-10T08:42:59.563664+0000","last_became_active":"2024-02-10T08:32:36.975366+0000","last_became_peered":"2024-02-10T08:32:36.975366+0000","last_unstale":"2024-02-10T08:42:59.563664+0000","last_undegraded":"2024-02-10T08:42:59.563664+0000","last_fullsized":"2024-02-10T08:42:59.563664+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'36","last_scrub_stamp":"2024-02-10T08:42:59.563595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:42:59.563595+0000","log_size":36,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":47,"num_write":36,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":507,"state":"active+clean","last_fresh":"2024-02-10T08:42:49.316725+0000","last_change":"2024-02-10T08:42:22.546334+0000","last_active":"2024-02-10T08:42:49.316725+0000","last_peered":"2024-02-10T08:42:49.316725+0000","last_clean":"2024-02-10T08:42:49.316725+0000","last_became_active":"2024-02-10T08:42:20.718238+0000","last_became_peered":"2024-02-10T08:42:20.718238+0000","last_unstale":"2024-02-10T08:42:49.316725+0000","last_undegraded":"2024-02-10T08:42:49.316725+0000","last_fullsized":"2024-02-10T08:42:49.316725+0000","mapping_epoch":498,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":499,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:22.546253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:42:22.546253+0000","last_clean_scrub_stamp":"2024-02-10T08:42:22.546253+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":508,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:00.559928+0000","last_change":"2024-02-10T08:43:00.559928+0000","last_active":"2024-02-10T08:43:00.559928+0000","last_peered":"2024-02-10T08:43:00.559928+0000","last_clean":"2024-02-10T08:43:00.559928+0000","last_became_active":"2024-02-10T08:41:09.776890+0000","last_became_peered":"2024-02-10T08:41:09.776890+0000","last_unstale":"2024-02-10T08:43:00.559928+0000","last_undegraded":"2024-02-10T08:43:00.559928+0000","last_fullsized":"2024-02-10T08:43:00.559928+0000","mapping_epoch":463,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":464,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:00.559793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:43:00.559793+0000","last_clean_scrub_stamp":"2024-02-10T08:43:00.559793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":518,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:27.091029+0000","last_change":"2024-02-10T08:43:27.091029+0000","last_active":"2024-02-10T08:43:27.091029+0000","last_peered":"2024-02-10T08:43:27.091029+0000","last_clean":"2024-02-10T08:43:27.091029+0000","last_became_active":"2024-02-10T08:28:19.022399+0000","last_became_peered":"2024-02-10T08:28:19.022399+0000","last_unstale":"2024-02-10T08:43:27.091029+0000","last_undegraded":"2024-02-10T08:43:27.091029+0000","last_fullsized":"2024-02-10T08:43:27.091029+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:27.090961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:43:27.090961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":58,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:42:56.411110+0000","last_change":"2024-02-10T08:42:56.411110+0000","last_active":"2024-02-10T08:42:56.411110+0000","last_peered":"2024-02-10T08:42:56.411110+0000","last_clean":"2024-02-10T08:42:56.411110+0000","last_became_active":"2024-02-10T08:41:14.145403+0000","last_became_peered":"2024-02-10T08:41:14.145403+0000","last_unstale":"2024-02-10T08:42:56.411110+0000","last_undegraded":"2024-02-10T08:42:56.411110+0000","last_fullsized":"2024-02-10T08:42:56.411110+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:56.411031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:04.766780+0000","last_clean_scrub_stamp":"2024-02-10T08:42:56.411031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"402'45","reported_seq":647,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:12.472657+0000","last_change":"2024-02-10T08:43:12.472657+0000","last_active":"2024-02-10T08:43:12.472657+0000","last_peered":"2024-02-10T08:43:12.472657+0000","last_clean":"2024-02-10T08:43:12.472657+0000","last_became_active":"2024-02-10T08:41:14.141932+0000","last_became_peered":"2024-02-10T08:41:14.141932+0000","last_unstale":"2024-02-10T08:43:12.472657+0000","last_undegraded":"2024-02-10T08:43:12.472657+0000","last_fullsized":"2024-02-10T08:43:12.472657+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'45","last_scrub_stamp":"2024-02-10T08:43:12.472536+0000","last_deep_scrub":"402'45","last_deep_scrub_stamp":"2024-02-10T08:41:45.488905+0000","last_clean_scrub_stamp":"2024-02-10T08:43:12.472536+0000","log_size":45,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":61,"num_read_kb":51,"num_write":37,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":308,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":53,"reported_epoch":507,"state":"active+clean","last_fresh":"2024-02-10T08:42:49.389216+0000","last_change":"2024-02-10T08:42:28.327343+0000","last_active":"2024-02-10T08:42:49.389216+0000","last_peered":"2024-02-10T08:42:49.389216+0000","last_clean":"2024-02-10T08:42:49.389216+0000","last_became_active":"2024-02-10T08:41:14.152599+0000","last_became_peered":"2024-02-10T08:41:14.152599+0000","last_unstale":"2024-02-10T08:42:49.389216+0000","last_undegraded":"2024-02-10T08:42:49.389216+0000","last_fullsized":"2024-02-10T08:42:49.389216+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:28.327275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:14:44.584370+0000","last_clean_scrub_stamp":"2024-02-10T08:42:28.327275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":519,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:00.577212+0000","last_change":"2024-02-10T08:43:00.577212+0000","last_active":"2024-02-10T08:43:00.577212+0000","last_peered":"2024-02-10T08:43:00.577212+0000","last_clean":"2024-02-10T08:43:00.577212+0000","last_became_active":"2024-02-10T08:41:14.135690+0000","last_became_peered":"2024-02-10T08:41:14.135690+0000","last_unstale":"2024-02-10T08:43:00.577212+0000","last_undegraded":"2024-02-10T08:43:00.577212+0000","last_fullsized":"2024-02-10T08:43:00.577212+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:00.577133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:41:32.130273+0000","last_clean_scrub_stamp":"2024-02-10T08:43:00.577133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":238,"reported_epoch":507,"state":"active+clean","last_fresh":"2024-02-10T08:42:49.361851+0000","last_change":"2024-02-10T08:42:47.485400+0000","last_active":"2024-02-10T08:42:49.361851+0000","last_peered":"2024-02-10T08:42:49.361851+0000","last_clean":"2024-02-10T08:42:49.361851+0000","last_became_active":"2024-02-10T08:41:58.348671+0000","last_became_peered":"2024-02-10T08:41:58.348671+0000","last_unstale":"2024-02-10T08:42:49.361851+0000","last_undegraded":"2024-02-10T08:42:49.361851+0000","last_fullsized":"2024-02-10T08:42:49.361851+0000","mapping_epoch":487,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":488,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:47.485335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.019819+0000","last_clean_scrub_stamp":"2024-02-10T08:42:47.485335+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":244,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:08.591286+0000","last_change":"2024-02-10T08:43:08.591286+0000","last_active":"2024-02-10T08:43:08.591286+0000","last_peered":"2024-02-10T08:43:08.591286+0000","last_clean":"2024-02-10T08:43:08.591286+0000","last_became_active":"2024-02-10T08:41:09.776782+0000","last_became_peered":"2024-02-10T08:41:09.776782+0000","last_unstale":"2024-02-10T08:43:08.591286+0000","last_undegraded":"2024-02-10T08:43:08.591286+0000","last_fullsized":"2024-02-10T08:43:08.591286+0000","mapping_epoch":463,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":464,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:08.591190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:26:29.921562+0000","last_clean_scrub_stamp":"2024-02-10T08:43:08.591190+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":53,"reported_epoch":507,"state":"active+clean","last_fresh":"2024-02-10T08:42:49.389494+0000","last_change":"2024-02-10T08:42:10.195978+0000","last_active":"2024-02-10T08:42:49.389494+0000","last_peered":"2024-02-10T08:42:49.389494+0000","last_clean":"2024-02-10T08:42:49.389494+0000","last_became_active":"2024-02-10T08:41:14.143868+0000","last_became_peered":"2024-02-10T08:41:14.143868+0000","last_unstale":"2024-02-10T08:42:49.389494+0000","last_undegraded":"2024-02-10T08:42:49.389494+0000","last_fullsized":"2024-02-10T08:42:49.389494+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":409,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:10.195905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:14:44.584370+0000","last_clean_scrub_stamp":"2024-02-10T08:42:10.195905+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":535,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:05.469132+0000","last_change":"2024-02-10T08:43:05.469132+0000","last_active":"2024-02-10T08:43:05.469132+0000","last_peered":"2024-02-10T08:43:05.469132+0000","last_clean":"2024-02-10T08:43:05.469132+0000","last_became_active":"2024-02-10T08:41:14.127199+0000","last_became_peered":"2024-02-10T08:41:14.127199+0000","last_unstale":"2024-02-10T08:43:05.469132+0000","last_undegraded":"2024-02-10T08:43:05.469132+0000","last_fullsized":"2024-02-10T08:43:05.469132+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:05.469056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:43:05.469056+0000","last_clean_scrub_stamp":"2024-02-10T08:43:05.469056+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"402'21","reported_seq":106,"reported_epoch":507,"state":"active+clean","last_fresh":"2024-02-10T08:42:49.314235+0000","last_change":"2024-02-10T08:42:01.883420+0000","last_active":"2024-02-10T08:42:49.314235+0000","last_peered":"2024-02-10T08:42:49.314235+0000","last_clean":"2024-02-10T08:42:49.314235+0000","last_became_active":"2024-02-10T08:38:40.279148+0000","last_became_peered":"2024-02-10T08:38:40.279148+0000","last_unstale":"2024-02-10T08:42:49.314235+0000","last_undegraded":"2024-02-10T08:42:49.314235+0000","last_fullsized":"2024-02-10T08:42:49.314235+0000","mapping_epoch":428,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":430,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'21","last_scrub_stamp":"2024-02-10T08:42:01.883279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:42:01.883279+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":39,"num_read_kb":28,"num_write":24,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":990,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":547,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:13.473375+0000","last_change":"2024-02-10T08:43:13.473375+0000","last_active":"2024-02-10T08:43:13.473375+0000","last_peered":"2024-02-10T08:43:13.473375+0000","last_clean":"2024-02-10T08:43:13.473375+0000","last_became_active":"2024-02-10T08:31:33.884021+0000","last_became_peered":"2024-02-10T08:31:33.884021+0000","last_unstale":"2024-02-10T08:43:13.473375+0000","last_undegraded":"2024-02-10T08:43:13.473375+0000","last_fullsized":"2024-02-10T08:43:13.473375+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:13.473263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:11.681169+0000","last_clean_scrub_stamp":"2024-02-10T08:43:13.473263+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"63'5","reported_seq":2092,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:26.450511+0000","last_change":"2024-02-10T08:42:22.034760+0000","last_active":"2024-02-10T08:43:26.450511+0000","last_peered":"2024-02-10T08:43:26.450511+0000","last_clean":"2024-02-10T08:43:26.450511+0000","last_became_active":"2024-02-10T08:16:52.780989+0000","last_became_peered":"2024-02-10T08:16:52.780989+0000","last_unstale":"2024-02-10T08:43:26.450511+0000","last_undegraded":"2024-02-10T08:43:26.450511+0000","last_fullsized":"2024-02-10T08:43:26.450511+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'5","last_scrub_stamp":"2024-02-10T08:42:22.034599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:42:22.034599+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1583,"num_read_kb":1578,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":58,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:17.566068+0000","last_change":"2024-02-10T08:43:17.566068+0000","last_active":"2024-02-10T08:43:17.566068+0000","last_peered":"2024-02-10T08:43:17.566068+0000","last_clean":"2024-02-10T08:43:17.566068+0000","last_became_active":"2024-02-10T08:41:14.152451+0000","last_became_peered":"2024-02-10T08:41:14.152451+0000","last_unstale":"2024-02-10T08:43:17.566068+0000","last_undegraded":"2024-02-10T08:43:17.566068+0000","last_fullsized":"2024-02-10T08:43:17.566068+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:17.565965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:11.750537+0000","last_clean_scrub_stamp":"2024-02-10T08:43:17.565965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":116,"reported_epoch":507,"state":"active+clean","last_fresh":"2024-02-10T08:42:49.601476+0000","last_change":"2024-02-10T08:42:23.998163+0000","last_active":"2024-02-10T08:42:49.601476+0000","last_peered":"2024-02-10T08:42:49.601476+0000","last_clean":"2024-02-10T08:42:49.601476+0000","last_became_active":"2024-02-10T08:37:45.994472+0000","last_became_peered":"2024-02-10T08:37:45.994472+0000","last_unstale":"2024-02-10T08:42:49.601476+0000","last_undegraded":"2024-02-10T08:42:49.601476+0000","last_fullsized":"2024-02-10T08:42:49.601476+0000","mapping_epoch":411,"log_start":"0'0","ondisk_log_start":"0'0","created":409,"last_epoch_clean":412,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:23.998081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:42:23.998081+0000","last_clean_scrub_stamp":"2024-02-10T08:42:23.998081+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,2],"acting":[5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":213,"reported_epoch":507,"state":"active+clean","last_fresh":"2024-02-10T08:42:49.386985+0000","last_change":"2024-02-10T08:42:38.588489+0000","last_active":"2024-02-10T08:42:49.386985+0000","last_peered":"2024-02-10T08:42:49.386985+0000","last_clean":"2024-02-10T08:42:49.386985+0000","last_became_active":"2024-02-10T08:41:09.780970+0000","last_became_peered":"2024-02-10T08:41:09.780970+0000","last_unstale":"2024-02-10T08:42:49.386985+0000","last_undegraded":"2024-02-10T08:42:49.386985+0000","last_fullsized":"2024-02-10T08:42:49.386985+0000","mapping_epoch":463,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":464,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:38.588377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:42:38.588377+0000","last_clean_scrub_stamp":"2024-02-10T08:42:38.588377+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"506'64","reported_seq":976,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:21.361469+0000","last_change":"2024-02-10T08:42:38.010991+0000","last_active":"2024-02-10T08:43:21.361469+0000","last_peered":"2024-02-10T08:43:21.361469+0000","last_clean":"2024-02-10T08:43:21.361469+0000","last_became_active":"2024-02-10T08:31:33.904487+0000","last_became_peered":"2024-02-10T08:31:33.904487+0000","last_unstale":"2024-02-10T08:43:21.361469+0000","last_undegraded":"2024-02-10T08:43:21.361469+0000","last_fullsized":"2024-02-10T08:43:21.361469+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":315,"parent":"0.0","parent_split_bits":0,"last_scrub":"506'64","last_scrub_stamp":"2024-02-10T08:42:38.010924+0000","last_deep_scrub":"506'64","last_deep_scrub_stamp":"2024-02-10T08:42:38.010924+0000","last_clean_scrub_stamp":"2024-02-10T08:42:38.010924+0000","log_size":64,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":84,"num_read_kb":69,"num_write":50,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":716,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":501,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:15.457331+0000","last_change":"2024-02-10T08:43:15.457331+0000","last_active":"2024-02-10T08:43:15.457331+0000","last_peered":"2024-02-10T08:43:15.457331+0000","last_clean":"2024-02-10T08:43:15.457331+0000","last_became_active":"2024-02-10T08:16:52.791027+0000","last_became_peered":"2024-02-10T08:16:52.791027+0000","last_unstale":"2024-02-10T08:43:15.457331+0000","last_undegraded":"2024-02-10T08:43:15.457331+0000","last_fullsized":"2024-02-10T08:43:15.457331+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:15.457249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:43:15.457249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":497,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:42:53.487582+0000","last_change":"2024-02-10T08:42:53.487582+0000","last_active":"2024-02-10T08:42:53.487582+0000","last_peered":"2024-02-10T08:42:53.487582+0000","last_clean":"2024-02-10T08:42:53.487582+0000","last_became_active":"2024-02-10T08:41:58.158283+0000","last_became_peered":"2024-02-10T08:41:58.158283+0000","last_unstale":"2024-02-10T08:42:53.487582+0000","last_undegraded":"2024-02-10T08:42:53.487582+0000","last_fullsized":"2024-02-10T08:42:53.487582+0000","mapping_epoch":487,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":488,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:53.487498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:42:53.487498+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":459,"reported_epoch":507,"state":"active+clean","last_fresh":"2024-02-10T08:42:49.602944+0000","last_change":"2024-02-10T08:42:17.359992+0000","last_active":"2024-02-10T08:42:49.602944+0000","last_peered":"2024-02-10T08:42:49.602944+0000","last_clean":"2024-02-10T08:42:49.602944+0000","last_became_active":"2024-02-10T08:42:14.493616+0000","last_became_peered":"2024-02-10T08:42:14.493616+0000","last_unstale":"2024-02-10T08:42:49.602944+0000","last_undegraded":"2024-02-10T08:42:49.602944+0000","last_fullsized":"2024-02-10T08:42:49.602944+0000","mapping_epoch":494,"log_start":"0'0","ondisk_log_start":"0'0","created":409,"last_epoch_clean":495,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:17.359872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:14:44.584370+0000","last_clean_scrub_stamp":"2024-02-10T08:42:17.359872+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"255'12","reported_seq":540,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:21.361472+0000","last_change":"2024-02-10T08:42:11.763247+0000","last_active":"2024-02-10T08:43:21.361472+0000","last_peered":"2024-02-10T08:43:21.361472+0000","last_clean":"2024-02-10T08:43:21.361472+0000","last_became_active":"2024-02-10T08:28:25.952468+0000","last_became_peered":"2024-02-10T08:28:25.952468+0000","last_unstale":"2024-02-10T08:43:21.361472+0000","last_undegraded":"2024-02-10T08:43:21.361472+0000","last_fullsized":"2024-02-10T08:43:21.361472+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'12","last_scrub_stamp":"2024-02-10T08:42:11.763162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:42:11.763162+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"402'30","reported_seq":570,"reported_epoch":507,"state":"active+clean","last_fresh":"2024-02-10T08:42:49.315262+0000","last_change":"2024-02-10T08:42:32.069085+0000","last_active":"2024-02-10T08:42:49.315262+0000","last_peered":"2024-02-10T08:42:49.315262+0000","last_clean":"2024-02-10T08:42:49.315262+0000","last_became_active":"2024-02-10T08:41:09.780194+0000","last_became_peered":"2024-02-10T08:41:09.780194+0000","last_unstale":"2024-02-10T08:42:49.315262+0000","last_undegraded":"2024-02-10T08:42:49.315262+0000","last_fullsized":"2024-02-10T08:42:49.315262+0000","mapping_epoch":463,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":464,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'30","last_scrub_stamp":"2024-02-10T08:42:32.069005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:42:32.069005+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":45,"num_read_kb":40,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":538,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:26.041398+0000","last_change":"2024-02-10T08:43:26.041398+0000","last_active":"2024-02-10T08:43:26.041398+0000","last_peered":"2024-02-10T08:43:26.041398+0000","last_clean":"2024-02-10T08:43:26.041398+0000","last_became_active":"2024-02-10T08:41:14.146149+0000","last_became_peered":"2024-02-10T08:41:14.146149+0000","last_unstale":"2024-02-10T08:43:26.041398+0000","last_undegraded":"2024-02-10T08:43:26.041398+0000","last_fullsized":"2024-02-10T08:43:26.041398+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:26.041225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:43:26.041225+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":421,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:42:50.424182+0000","last_change":"2024-02-10T08:42:50.424182+0000","last_active":"2024-02-10T08:42:50.424182+0000","last_peered":"2024-02-10T08:42:50.424182+0000","last_clean":"2024-02-10T08:42:50.424182+0000","last_became_active":"2024-02-10T08:28:25.950240+0000","last_became_peered":"2024-02-10T08:28:25.950240+0000","last_unstale":"2024-02-10T08:42:50.424182+0000","last_undegraded":"2024-02-10T08:42:50.424182+0000","last_fullsized":"2024-02-10T08:42:50.424182+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:50.424110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:42:50.424110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":520,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:07.528213+0000","last_change":"2024-02-10T08:43:07.528213+0000","last_active":"2024-02-10T08:43:07.528213+0000","last_peered":"2024-02-10T08:43:07.528213+0000","last_clean":"2024-02-10T08:43:07.528213+0000","last_became_active":"2024-02-10T08:28:02.777637+0000","last_became_peered":"2024-02-10T08:28:02.777637+0000","last_unstale":"2024-02-10T08:43:07.528213+0000","last_undegraded":"2024-02-10T08:43:07.528213+0000","last_fullsized":"2024-02-10T08:43:07.528213+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:07.528145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:43:07.528145+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"402'29","reported_seq":562,"reported_epoch":507,"state":"active+clean","last_fresh":"2024-02-10T08:42:49.315472+0000","last_change":"2024-02-10T08:42:42.285129+0000","last_active":"2024-02-10T08:42:49.315472+0000","last_peered":"2024-02-10T08:42:49.315472+0000","last_clean":"2024-02-10T08:42:49.315472+0000","last_became_active":"2024-02-10T08:41:09.768760+0000","last_became_peered":"2024-02-10T08:41:09.768760+0000","last_unstale":"2024-02-10T08:42:49.315472+0000","last_undegraded":"2024-02-10T08:42:49.315472+0000","last_fullsized":"2024-02-10T08:42:49.315472+0000","mapping_epoch":463,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":464,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'29","last_scrub_stamp":"2024-02-10T08:42:42.285015+0000","last_deep_scrub":"402'29","last_deep_scrub_stamp":"2024-02-10T08:41:35.095232+0000","last_clean_scrub_stamp":"2024-02-10T08:42:42.285015+0000","log_size":29,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":33,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"55'2","reported_seq":524,"reported_epoch":507,"state":"active+clean","last_fresh":"2024-02-10T08:42:49.316034+0000","last_change":"2024-02-10T08:42:27.167411+0000","last_active":"2024-02-10T08:42:49.316034+0000","last_peered":"2024-02-10T08:42:49.316034+0000","last_clean":"2024-02-10T08:42:49.316034+0000","last_became_active":"2024-02-10T08:41:14.138235+0000","last_became_peered":"2024-02-10T08:41:14.138235+0000","last_unstale":"2024-02-10T08:42:49.316034+0000","last_undegraded":"2024-02-10T08:42:49.316034+0000","last_fullsized":"2024-02-10T08:42:49.316034+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'2","last_scrub_stamp":"2024-02-10T08:42:27.167327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:42:27.167327+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":184,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":201,"reported_epoch":507,"state":"active+clean","last_fresh":"2024-02-10T08:42:49.362194+0000","last_change":"2024-02-10T08:42:09.579380+0000","last_active":"2024-02-10T08:42:49.362194+0000","last_peered":"2024-02-10T08:42:49.362194+0000","last_clean":"2024-02-10T08:42:49.362194+0000","last_became_active":"2024-02-10T08:41:58.159533+0000","last_became_peered":"2024-02-10T08:41:58.159533+0000","last_unstale":"2024-02-10T08:42:49.362194+0000","last_undegraded":"2024-02-10T08:42:49.362194+0000","last_fullsized":"2024-02-10T08:42:49.362194+0000","mapping_epoch":487,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":488,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:09.579262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:42:09.579262+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"402'21","reported_seq":255,"reported_epoch":507,"state":"active+clean","last_fresh":"2024-02-10T08:42:49.386997+0000","last_change":"2024-02-10T08:42:37.598014+0000","last_active":"2024-02-10T08:42:49.386997+0000","last_peered":"2024-02-10T08:42:49.386997+0000","last_clean":"2024-02-10T08:42:49.386997+0000","last_became_active":"2024-02-10T08:41:14.144203+0000","last_became_peered":"2024-02-10T08:41:14.144203+0000","last_unstale":"2024-02-10T08:42:49.386997+0000","last_undegraded":"2024-02-10T08:42:49.386997+0000","last_fullsized":"2024-02-10T08:42:49.386997+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'21","last_scrub_stamp":"2024-02-10T08:42:37.597915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:42:37.597915+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":33,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"55'1","reported_seq":581,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:16.418025+0000","last_change":"2024-02-10T08:43:16.418025+0000","last_active":"2024-02-10T08:43:16.418025+0000","last_peered":"2024-02-10T08:43:16.418025+0000","last_clean":"2024-02-10T08:43:16.418025+0000","last_became_active":"2024-02-10T08:28:02.778857+0000","last_became_peered":"2024-02-10T08:28:02.778857+0000","last_unstale":"2024-02-10T08:43:16.418025+0000","last_undegraded":"2024-02-10T08:43:16.418025+0000","last_fullsized":"2024-02-10T08:43:16.418025+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'1","last_scrub_stamp":"2024-02-10T08:43:16.417940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:43:16.417940+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":716,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":444,"reported_epoch":507,"state":"active+clean","last_fresh":"2024-02-10T08:42:49.362780+0000","last_change":"2024-02-10T08:42:32.433444+0000","last_active":"2024-02-10T08:42:49.362780+0000","last_peered":"2024-02-10T08:42:49.362780+0000","last_clean":"2024-02-10T08:42:49.362780+0000","last_became_active":"2024-02-10T08:41:58.158549+0000","last_became_peered":"2024-02-10T08:41:58.158549+0000","last_unstale":"2024-02-10T08:42:49.362780+0000","last_undegraded":"2024-02-10T08:42:49.362780+0000","last_fullsized":"2024-02-10T08:42:49.362780+0000","mapping_epoch":487,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":488,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:32.433362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:42:32.433362+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":336,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:28.448514+0000","last_change":"2024-02-10T08:43:28.448514+0000","last_active":"2024-02-10T08:43:28.448514+0000","last_peered":"2024-02-10T08:43:28.448514+0000","last_clean":"2024-02-10T08:43:28.448514+0000","last_became_active":"2024-02-10T08:41:14.138244+0000","last_became_peered":"2024-02-10T08:41:14.138244+0000","last_unstale":"2024-02-10T08:43:28.448514+0000","last_undegraded":"2024-02-10T08:43:28.448514+0000","last_fullsized":"2024-02-10T08:43:28.448514+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:28.448448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:43:28.448448+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"402'21","reported_seq":396,"reported_epoch":507,"state":"active+clean","last_fresh":"2024-02-10T08:42:49.362684+0000","last_change":"2024-02-10T08:42:04.456184+0000","last_active":"2024-02-10T08:42:49.362684+0000","last_peered":"2024-02-10T08:42:49.362684+0000","last_clean":"2024-02-10T08:42:49.362684+0000","last_became_active":"2024-02-10T08:41:58.158617+0000","last_became_peered":"2024-02-10T08:41:58.158617+0000","last_unstale":"2024-02-10T08:42:49.362684+0000","last_undegraded":"2024-02-10T08:42:49.362684+0000","last_fullsized":"2024-02-10T08:42:49.362684+0000","mapping_epoch":487,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":488,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'21","last_scrub_stamp":"2024-02-10T08:42:04.456112+0000","last_deep_scrub":"402'21","last_deep_scrub_stamp":"2024-02-10T08:42:04.456112+0000","last_clean_scrub_stamp":"2024-02-10T08:42:04.456112+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":25,"num_read_kb":22,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":581,"reported_epoch":507,"state":"active+clean","last_fresh":"2024-02-10T08:42:49.601347+0000","last_change":"2024-02-10T08:42:30.255494+0000","last_active":"2024-02-10T08:42:49.601347+0000","last_peered":"2024-02-10T08:42:49.601347+0000","last_clean":"2024-02-10T08:42:49.601347+0000","last_became_active":"2024-02-10T08:41:09.770380+0000","last_became_peered":"2024-02-10T08:41:09.770380+0000","last_unstale":"2024-02-10T08:42:49.601347+0000","last_undegraded":"2024-02-10T08:42:49.601347+0000","last_fullsized":"2024-02-10T08:42:49.601347+0000","mapping_epoch":463,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":464,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:30.255417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:42:30.255417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":497,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:24.525829+0000","last_change":"2024-02-10T08:43:24.525829+0000","last_active":"2024-02-10T08:43:24.525829+0000","last_peered":"2024-02-10T08:43:24.525829+0000","last_clean":"2024-02-10T08:43:24.525829+0000","last_became_active":"2024-02-10T08:16:56.863948+0000","last_became_peered":"2024-02-10T08:16:56.863948+0000","last_unstale":"2024-02-10T08:43:24.525829+0000","last_undegraded":"2024-02-10T08:43:24.525829+0000","last_fullsized":"2024-02-10T08:43:24.525829+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:24.525746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:34:28.320524+0000","last_clean_scrub_stamp":"2024-02-10T08:43:24.525746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":58,"reported_epoch":507,"state":"active+clean","last_fresh":"2024-02-10T08:42:49.390100+0000","last_change":"2024-02-10T08:42:43.386696+0000","last_active":"2024-02-10T08:42:49.390100+0000","last_peered":"2024-02-10T08:42:49.390100+0000","last_clean":"2024-02-10T08:42:49.390100+0000","last_became_active":"2024-02-10T08:41:14.146825+0000","last_became_peered":"2024-02-10T08:41:14.146825+0000","last_unstale":"2024-02-10T08:42:49.390100+0000","last_undegraded":"2024-02-10T08:42:49.390100+0000","last_fullsized":"2024-02-10T08:42:49.390100+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:43.386599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:42:43.386599+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"402'30","reported_seq":377,"reported_epoch":507,"state":"active+clean","last_fresh":"2024-02-10T08:42:49.362434+0000","last_change":"2024-02-10T08:42:48.516195+0000","last_active":"2024-02-10T08:42:49.362434+0000","last_peered":"2024-02-10T08:42:49.362434+0000","last_clean":"2024-02-10T08:42:49.362434+0000","last_became_active":"2024-02-10T08:41:58.158898+0000","last_became_peered":"2024-02-10T08:41:58.158898+0000","last_unstale":"2024-02-10T08:42:49.362434+0000","last_undegraded":"2024-02-10T08:42:49.362434+0000","last_fullsized":"2024-02-10T08:42:49.362434+0000","mapping_epoch":487,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":488,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'30","last_scrub_stamp":"2024-02-10T08:42:48.516070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:42:48.516070+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":38,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":521,"reported_epoch":507,"state":"active+clean","last_fresh":"2024-02-10T08:42:49.641412+0000","last_change":"2024-02-10T08:42:49.641372+0000","last_active":"2024-02-10T08:42:49.641412+0000","last_peered":"2024-02-10T08:42:49.641412+0000","last_clean":"2024-02-10T08:42:49.641412+0000","last_became_active":"2024-02-10T08:41:14.134210+0000","last_became_peered":"2024-02-10T08:41:14.134210+0000","last_unstale":"2024-02-10T08:42:49.641412+0000","last_undegraded":"2024-02-10T08:42:49.641412+0000","last_fullsized":"2024-02-10T08:42:49.641412+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:49.641262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:42:49.641262+0000","last_clean_scrub_stamp":"2024-02-10T08:42:49.641262+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"244'12","reported_seq":865,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:21.361568+0000","last_change":"2024-02-10T08:42:34.767002+0000","last_active":"2024-02-10T08:43:21.361568+0000","last_peered":"2024-02-10T08:43:21.361568+0000","last_clean":"2024-02-10T08:43:21.361568+0000","last_became_active":"2024-02-10T08:28:02.776097+0000","last_became_peered":"2024-02-10T08:28:02.776097+0000","last_unstale":"2024-02-10T08:43:21.361568+0000","last_undegraded":"2024-02-10T08:43:21.361568+0000","last_fullsized":"2024-02-10T08:43:21.361568+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"244'12","last_scrub_stamp":"2024-02-10T08:42:34.766873+0000","last_deep_scrub":"244'12","last_deep_scrub_stamp":"2024-02-10T08:35:24.069224+0000","last_clean_scrub_stamp":"2024-02-10T08:42:34.766873+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":231,"reported_epoch":507,"state":"active+clean","last_fresh":"2024-02-10T08:42:49.389191+0000","last_change":"2024-02-10T08:42:49.389169+0000","last_active":"2024-02-10T08:42:49.389191+0000","last_peered":"2024-02-10T08:42:49.389191+0000","last_clean":"2024-02-10T08:42:49.389191+0000","last_became_active":"2024-02-10T08:41:14.139422+0000","last_became_peered":"2024-02-10T08:41:14.139422+0000","last_unstale":"2024-02-10T08:42:49.389191+0000","last_undegraded":"2024-02-10T08:42:49.389191+0000","last_fullsized":"2024-02-10T08:42:49.389191+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:49.389103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:05.662947+0000","last_clean_scrub_stamp":"2024-02-10T08:42:49.389103+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"402'25","reported_seq":575,"reported_epoch":507,"state":"active+clean","last_fresh":"2024-02-10T08:42:49.602455+0000","last_change":"2024-02-10T08:42:36.757748+0000","last_active":"2024-02-10T08:42:49.602455+0000","last_peered":"2024-02-10T08:42:49.602455+0000","last_clean":"2024-02-10T08:42:49.602455+0000","last_became_active":"2024-02-10T08:41:14.134235+0000","last_became_peered":"2024-02-10T08:41:14.134235+0000","last_unstale":"2024-02-10T08:42:49.602455+0000","last_undegraded":"2024-02-10T08:42:49.602455+0000","last_fullsized":"2024-02-10T08:42:49.602455+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'25","last_scrub_stamp":"2024-02-10T08:42:36.757633+0000","last_deep_scrub":"213'13","last_deep_scrub_stamp":"2024-02-10T08:25:43.713333+0000","last_clean_scrub_stamp":"2024-02-10T08:42:36.757633+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":208,"reported_epoch":507,"state":"active+clean","last_fresh":"2024-02-10T08:42:49.386625+0000","last_change":"2024-02-10T08:42:21.851068+0000","last_active":"2024-02-10T08:42:49.386625+0000","last_peered":"2024-02-10T08:42:49.386625+0000","last_clean":"2024-02-10T08:42:49.386625+0000","last_became_active":"2024-02-10T08:41:09.780363+0000","last_became_peered":"2024-02-10T08:41:09.780363+0000","last_unstale":"2024-02-10T08:42:49.386625+0000","last_undegraded":"2024-02-10T08:42:49.386625+0000","last_fullsized":"2024-02-10T08:42:49.386625+0000","mapping_epoch":463,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":464,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:21.850973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:42:21.850973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"489'14","reported_seq":384,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:23.391012+0000","last_change":"2024-02-10T08:43:23.390971+0000","last_active":"2024-02-10T08:43:23.391012+0000","last_peered":"2024-02-10T08:43:23.391012+0000","last_clean":"2024-02-10T08:43:23.391012+0000","last_became_active":"2024-02-10T08:41:58.158783+0000","last_became_peered":"2024-02-10T08:41:58.158783+0000","last_unstale":"2024-02-10T08:43:23.391012+0000","last_undegraded":"2024-02-10T08:43:23.391012+0000","last_fullsized":"2024-02-10T08:43:23.391012+0000","mapping_epoch":487,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":488,"parent":"0.0","parent_split_bits":0,"last_scrub":"489'14","last_scrub_stamp":"2024-02-10T08:43:23.390855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:43:23.390855+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":477,"reported_epoch":507,"state":"active+clean","last_fresh":"2024-02-10T08:42:49.315802+0000","last_change":"2024-02-10T08:42:33.292863+0000","last_active":"2024-02-10T08:42:49.315802+0000","last_peered":"2024-02-10T08:42:49.315802+0000","last_clean":"2024-02-10T08:42:49.315802+0000","last_became_active":"2024-02-10T08:41:09.768885+0000","last_became_peered":"2024-02-10T08:41:09.768885+0000","last_unstale":"2024-02-10T08:42:49.315802+0000","last_undegraded":"2024-02-10T08:42:49.315802+0000","last_fullsized":"2024-02-10T08:42:49.315802+0000","mapping_epoch":463,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":464,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:33.292739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:42:33.292739+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"402'21","reported_seq":521,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:15.417663+0000","last_change":"2024-02-10T08:43:15.417663+0000","last_active":"2024-02-10T08:43:15.417663+0000","last_peered":"2024-02-10T08:43:15.417663+0000","last_clean":"2024-02-10T08:43:15.417663+0000","last_became_active":"2024-02-10T08:28:25.952354+0000","last_became_peered":"2024-02-10T08:28:25.952354+0000","last_unstale":"2024-02-10T08:43:15.417663+0000","last_undegraded":"2024-02-10T08:43:15.417663+0000","last_fullsized":"2024-02-10T08:43:15.417663+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'21","last_scrub_stamp":"2024-02-10T08:43:15.417595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:43:15.417595+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":34,"num_read_kb":28,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":511,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:01.417405+0000","last_change":"2024-02-10T08:43:01.417405+0000","last_active":"2024-02-10T08:43:01.417405+0000","last_peered":"2024-02-10T08:43:01.417405+0000","last_clean":"2024-02-10T08:43:01.417405+0000","last_became_active":"2024-02-10T08:16:52.786213+0000","last_became_peered":"2024-02-10T08:16:52.786213+0000","last_unstale":"2024-02-10T08:43:01.417405+0000","last_undegraded":"2024-02-10T08:43:01.417405+0000","last_fullsized":"2024-02-10T08:43:01.417405+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:01.417330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:43:01.417330+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":133,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:27.416388+0000","last_change":"2024-02-10T08:43:27.417072+0000","last_active":"2024-02-10T08:43:27.416388+0000","last_peered":"2024-02-10T08:43:27.416388+0000","last_clean":"2024-02-10T08:43:27.416388+0000","last_became_active":"2024-02-10T08:41:58.160164+0000","last_became_peered":"2024-02-10T08:41:58.160164+0000","last_unstale":"2024-02-10T08:43:27.416388+0000","last_undegraded":"2024-02-10T08:43:27.416388+0000","last_fullsized":"2024-02-10T08:43:27.416388+0000","mapping_epoch":487,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":488,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:41:46.650962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:33:28.821928+0000","last_clean_scrub_stamp":"2024-02-10T08:41:46.650962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":341,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:26.453379+0000","last_change":"2024-02-10T08:43:26.453379+0000","last_active":"2024-02-10T08:43:26.453379+0000","last_peered":"2024-02-10T08:43:26.453379+0000","last_clean":"2024-02-10T08:43:26.453379+0000","last_became_active":"2024-02-10T08:30:24.070440+0000","last_became_peered":"2024-02-10T08:30:24.070440+0000","last_unstale":"2024-02-10T08:43:26.453379+0000","last_undegraded":"2024-02-10T08:43:26.453379+0000","last_fullsized":"2024-02-10T08:43:26.453379+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:26.453308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:43:26.453308+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"402'32","reported_seq":521,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:27.280626+0000","last_change":"2024-02-10T08:43:27.280626+0000","last_active":"2024-02-10T08:43:27.280626+0000","last_peered":"2024-02-10T08:43:27.280626+0000","last_clean":"2024-02-10T08:43:27.280626+0000","last_became_active":"2024-02-10T08:41:09.764609+0000","last_became_peered":"2024-02-10T08:41:09.764609+0000","last_unstale":"2024-02-10T08:43:27.280626+0000","last_undegraded":"2024-02-10T08:43:27.280626+0000","last_fullsized":"2024-02-10T08:43:27.280626+0000","mapping_epoch":463,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":464,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'32","last_scrub_stamp":"2024-02-10T08:43:27.280553+0000","last_deep_scrub":"402'32","last_deep_scrub_stamp":"2024-02-10T08:43:27.280553+0000","last_clean_scrub_stamp":"2024-02-10T08:43:27.280553+0000","log_size":32,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":36,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":524,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:42:52.081264+0000","last_change":"2024-02-10T08:42:52.081264+0000","last_active":"2024-02-10T08:42:52.081264+0000","last_peered":"2024-02-10T08:42:52.081264+0000","last_clean":"2024-02-10T08:42:52.081264+0000","last_became_active":"2024-02-10T08:32:36.974379+0000","last_became_peered":"2024-02-10T08:32:36.974379+0000","last_unstale":"2024-02-10T08:42:52.081264+0000","last_undegraded":"2024-02-10T08:42:52.081264+0000","last_fullsized":"2024-02-10T08:42:52.081264+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:52.081142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:42:52.081142+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":513,"reported_epoch":507,"state":"active+clean","last_fresh":"2024-02-10T08:42:49.315364+0000","last_change":"2024-02-10T08:42:06.807186+0000","last_active":"2024-02-10T08:42:49.315364+0000","last_peered":"2024-02-10T08:42:49.315364+0000","last_clean":"2024-02-10T08:42:49.315364+0000","last_became_active":"2024-02-10T08:31:33.893973+0000","last_became_peered":"2024-02-10T08:31:33.893973+0000","last_unstale":"2024-02-10T08:42:49.315364+0000","last_undegraded":"2024-02-10T08:42:49.315364+0000","last_fullsized":"2024-02-10T08:42:49.315364+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:06.807121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:42:06.807121+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":242,"reported_epoch":507,"state":"active+clean","last_fresh":"2024-02-10T08:42:49.361766+0000","last_change":"2024-02-10T08:42:30.441263+0000","last_active":"2024-02-10T08:42:49.361766+0000","last_peered":"2024-02-10T08:42:49.361766+0000","last_clean":"2024-02-10T08:42:49.361766+0000","last_became_active":"2024-02-10T08:41:58.349030+0000","last_became_peered":"2024-02-10T08:41:58.349030+0000","last_unstale":"2024-02-10T08:42:49.361766+0000","last_undegraded":"2024-02-10T08:42:49.361766+0000","last_fullsized":"2024-02-10T08:42:49.361766+0000","mapping_epoch":487,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":488,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:30.441183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:42:30.441183+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"402'12","reported_seq":350,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:42:55.456358+0000","last_change":"2024-02-10T08:42:55.456358+0000","last_active":"2024-02-10T08:42:55.456358+0000","last_peered":"2024-02-10T08:42:55.456358+0000","last_clean":"2024-02-10T08:42:55.456358+0000","last_became_active":"2024-02-10T08:41:58.162919+0000","last_became_peered":"2024-02-10T08:41:58.162919+0000","last_unstale":"2024-02-10T08:42:55.456358+0000","last_undegraded":"2024-02-10T08:42:55.456358+0000","last_fullsized":"2024-02-10T08:42:55.456358+0000","mapping_epoch":487,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":488,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'12","last_scrub_stamp":"2024-02-10T08:42:55.456260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:42:55.456260+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":508,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:19.459052+0000","last_change":"2024-02-10T08:43:19.459052+0000","last_active":"2024-02-10T08:43:19.459052+0000","last_peered":"2024-02-10T08:43:19.459052+0000","last_clean":"2024-02-10T08:43:19.459052+0000","last_became_active":"2024-02-10T08:16:52.788704+0000","last_became_peered":"2024-02-10T08:16:52.788704+0000","last_unstale":"2024-02-10T08:43:19.459052+0000","last_undegraded":"2024-02-10T08:43:19.459052+0000","last_fullsized":"2024-02-10T08:43:19.459052+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:19.458979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:43:19.458979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":545,"reported_epoch":507,"state":"active+clean","last_fresh":"2024-02-10T08:42:49.601152+0000","last_change":"2024-02-10T08:42:47.474699+0000","last_active":"2024-02-10T08:42:49.601152+0000","last_peered":"2024-02-10T08:42:49.601152+0000","last_clean":"2024-02-10T08:42:49.601152+0000","last_became_active":"2024-02-10T08:41:14.140304+0000","last_became_peered":"2024-02-10T08:41:14.140304+0000","last_unstale":"2024-02-10T08:42:49.601152+0000","last_undegraded":"2024-02-10T08:42:49.601152+0000","last_fullsized":"2024-02-10T08:42:49.601152+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:47.474615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:42:47.474615+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":58,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:14.512070+0000","last_change":"2024-02-10T08:43:14.512070+0000","last_active":"2024-02-10T08:43:14.512070+0000","last_peered":"2024-02-10T08:43:14.512070+0000","last_clean":"2024-02-10T08:43:14.512070+0000","last_became_active":"2024-02-10T08:41:14.143650+0000","last_became_peered":"2024-02-10T08:41:14.143650+0000","last_unstale":"2024-02-10T08:43:14.512070+0000","last_undegraded":"2024-02-10T08:43:14.512070+0000","last_fullsized":"2024-02-10T08:43:14.512070+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:14.511998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:27.276490+0000","last_clean_scrub_stamp":"2024-02-10T08:43:14.511998+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"402'27","reported_seq":375,"reported_epoch":507,"state":"active+clean","last_fresh":"2024-02-10T08:42:49.362093+0000","last_change":"2024-02-10T08:42:07.446086+0000","last_active":"2024-02-10T08:42:49.362093+0000","last_peered":"2024-02-10T08:42:49.362093+0000","last_clean":"2024-02-10T08:42:49.362093+0000","last_became_active":"2024-02-10T08:41:58.162479+0000","last_became_peered":"2024-02-10T08:41:58.162479+0000","last_unstale":"2024-02-10T08:42:49.362093+0000","last_undegraded":"2024-02-10T08:42:49.362093+0000","last_fullsized":"2024-02-10T08:42:49.362093+0000","mapping_epoch":487,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":488,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'27","last_scrub_stamp":"2024-02-10T08:42:07.445993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:42:07.445993+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":504,"reported_epoch":507,"state":"active+clean","last_fresh":"2024-02-10T08:42:49.603116+0000","last_change":"2024-02-10T08:42:34.339844+0000","last_active":"2024-02-10T08:42:49.603116+0000","last_peered":"2024-02-10T08:42:49.603116+0000","last_clean":"2024-02-10T08:42:49.603116+0000","last_became_active":"2024-02-10T08:16:52.788629+0000","last_became_peered":"2024-02-10T08:16:52.788629+0000","last_unstale":"2024-02-10T08:42:49.603116+0000","last_undegraded":"2024-02-10T08:42:49.603116+0000","last_fullsized":"2024-02-10T08:42:49.603116+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:34.339751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:38.360929+0000","last_clean_scrub_stamp":"2024-02-10T08:42:34.339751+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":58,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:13.557697+0000","last_change":"2024-02-10T08:43:13.557697+0000","last_active":"2024-02-10T08:43:13.557697+0000","last_peered":"2024-02-10T08:43:13.557697+0000","last_clean":"2024-02-10T08:43:13.557697+0000","last_became_active":"2024-02-10T08:41:14.143787+0000","last_became_peered":"2024-02-10T08:41:14.143787+0000","last_unstale":"2024-02-10T08:43:13.557697+0000","last_undegraded":"2024-02-10T08:43:13.557697+0000","last_fullsized":"2024-02-10T08:43:13.557697+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:13.557615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:43:13.557615+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":240,"reported_epoch":507,"state":"active+clean","last_fresh":"2024-02-10T08:42:49.362018+0000","last_change":"2024-02-10T08:42:15.500798+0000","last_active":"2024-02-10T08:42:49.362018+0000","last_peered":"2024-02-10T08:42:49.362018+0000","last_clean":"2024-02-10T08:42:49.362018+0000","last_became_active":"2024-02-10T08:41:58.162417+0000","last_became_peered":"2024-02-10T08:41:58.162417+0000","last_unstale":"2024-02-10T08:42:49.362018+0000","last_undegraded":"2024-02-10T08:42:49.362018+0000","last_fullsized":"2024-02-10T08:42:49.362018+0000","mapping_epoch":487,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":488,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:15.500710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:34:30.191790+0000","last_clean_scrub_stamp":"2024-02-10T08:42:15.500710+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"402'35","reported_seq":669,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:20.479007+0000","last_change":"2024-02-10T08:43:20.479007+0000","last_active":"2024-02-10T08:43:20.479007+0000","last_peered":"2024-02-10T08:43:20.479007+0000","last_clean":"2024-02-10T08:43:20.479007+0000","last_became_active":"2024-02-10T08:41:14.139949+0000","last_became_peered":"2024-02-10T08:41:14.139949+0000","last_unstale":"2024-02-10T08:43:20.479007+0000","last_undegraded":"2024-02-10T08:43:20.479007+0000","last_fullsized":"2024-02-10T08:43:20.479007+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'35","last_scrub_stamp":"2024-02-10T08:43:20.478928+0000","last_deep_scrub":"225'25","last_deep_scrub_stamp":"2024-02-10T08:36:22.029278+0000","last_clean_scrub_stamp":"2024-02-10T08:43:20.478928+0000","log_size":35,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":39,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":544,"reported_epoch":507,"state":"active+clean","last_fresh":"2024-02-10T08:42:49.601216+0000","last_change":"2024-02-10T08:42:03.086378+0000","last_active":"2024-02-10T08:42:49.601216+0000","last_peered":"2024-02-10T08:42:49.601216+0000","last_clean":"2024-02-10T08:42:49.601216+0000","last_became_active":"2024-02-10T08:41:14.144732+0000","last_became_peered":"2024-02-10T08:41:14.144732+0000","last_unstale":"2024-02-10T08:42:49.601216+0000","last_undegraded":"2024-02-10T08:42:49.601216+0000","last_fullsized":"2024-02-10T08:42:49.601216+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:03.086289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:38:19.137643+0000","last_clean_scrub_stamp":"2024-02-10T08:42:03.086289+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1f","version":"468'15","reported_seq":889,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:21.361568+0000","last_change":"2024-02-10T08:41:48.456884+0000","last_active":"2024-02-10T08:43:21.361568+0000","last_peered":"2024-02-10T08:43:21.361568+0000","last_clean":"2024-02-10T08:43:21.361568+0000","last_became_active":"2024-02-10T08:41:14.139916+0000","last_became_peered":"2024-02-10T08:41:14.139916+0000","last_unstale":"2024-02-10T08:43:21.361568+0000","last_undegraded":"2024-02-10T08:43:21.361568+0000","last_fullsized":"2024-02-10T08:43:21.361568+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"468'15","last_scrub_stamp":"2024-02-10T08:41:48.456800+0000","last_deep_scrub":"111'11","last_deep_scrub_stamp":"2024-02-10T08:36:26.882513+0000","last_clean_scrub_stamp":"2024-02-10T08:41:48.456800+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"87'2","reported_seq":62,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:42:59.433146+0000","last_change":"2024-02-10T08:42:59.433146+0000","last_active":"2024-02-10T08:42:59.433146+0000","last_peered":"2024-02-10T08:42:59.433146+0000","last_clean":"2024-02-10T08:42:59.433146+0000","last_became_active":"2024-02-10T08:41:14.144294+0000","last_became_peered":"2024-02-10T08:41:14.144294+0000","last_unstale":"2024-02-10T08:42:59.433146+0000","last_undegraded":"2024-02-10T08:42:59.433146+0000","last_fullsized":"2024-02-10T08:42:59.433146+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'2","last_scrub_stamp":"2024-02-10T08:42:59.433064+0000","last_deep_scrub":"87'2","last_deep_scrub_stamp":"2024-02-10T08:19:29.207531+0000","last_clean_scrub_stamp":"2024-02-10T08:42:59.433064+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":369,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"402'27","reported_seq":548,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:02.401941+0000","last_change":"2024-02-10T08:43:02.401941+0000","last_active":"2024-02-10T08:43:02.401941+0000","last_peered":"2024-02-10T08:43:02.401941+0000","last_clean":"2024-02-10T08:43:02.401941+0000","last_became_active":"2024-02-10T08:16:54.852665+0000","last_became_peered":"2024-02-10T08:16:54.852665+0000","last_unstale":"2024-02-10T08:43:02.401941+0000","last_undegraded":"2024-02-10T08:43:02.401941+0000","last_fullsized":"2024-02-10T08:43:02.401941+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'27","last_scrub_stamp":"2024-02-10T08:43:02.401807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:43:02.401807+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":256,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:25.434648+0000","last_change":"2024-02-10T08:43:25.434648+0000","last_active":"2024-02-10T08:43:25.434648+0000","last_peered":"2024-02-10T08:43:25.434648+0000","last_clean":"2024-02-10T08:43:25.434648+0000","last_became_active":"2024-02-10T08:41:58.161541+0000","last_became_peered":"2024-02-10T08:41:58.161541+0000","last_unstale":"2024-02-10T08:43:25.434648+0000","last_undegraded":"2024-02-10T08:43:25.434648+0000","last_fullsized":"2024-02-10T08:43:25.434648+0000","mapping_epoch":487,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":488,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:25.434584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:38:17.208888+0000","last_clean_scrub_stamp":"2024-02-10T08:43:25.434584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":350,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:19.455002+0000","last_change":"2024-02-10T08:43:19.455002+0000","last_active":"2024-02-10T08:43:19.455002+0000","last_peered":"2024-02-10T08:43:19.455002+0000","last_clean":"2024-02-10T08:43:19.455002+0000","last_became_active":"2024-02-10T08:41:14.138937+0000","last_became_peered":"2024-02-10T08:41:14.138937+0000","last_unstale":"2024-02-10T08:43:19.455002+0000","last_undegraded":"2024-02-10T08:43:19.455002+0000","last_fullsized":"2024-02-10T08:43:19.455002+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:19.454926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:43:19.454926+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":521,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:42:56.083593+0000","last_change":"2024-02-10T08:42:56.083593+0000","last_active":"2024-02-10T08:42:56.083593+0000","last_peered":"2024-02-10T08:42:56.083593+0000","last_clean":"2024-02-10T08:42:56.083593+0000","last_became_active":"2024-02-10T08:41:09.772464+0000","last_became_peered":"2024-02-10T08:41:09.772464+0000","last_unstale":"2024-02-10T08:42:56.083593+0000","last_undegraded":"2024-02-10T08:42:56.083593+0000","last_fullsized":"2024-02-10T08:42:56.083593+0000","mapping_epoch":463,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":464,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:56.083414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:22.104988+0000","last_clean_scrub_stamp":"2024-02-10T08:42:56.083414+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"402'46","reported_seq":627,"reported_epoch":507,"state":"active+clean","last_fresh":"2024-02-10T08:42:49.317433+0000","last_change":"2024-02-10T08:42:45.477977+0000","last_active":"2024-02-10T08:42:49.317433+0000","last_peered":"2024-02-10T08:42:49.317433+0000","last_clean":"2024-02-10T08:42:49.317433+0000","last_became_active":"2024-02-10T08:31:33.894960+0000","last_became_peered":"2024-02-10T08:31:33.894960+0000","last_unstale":"2024-02-10T08:42:49.317433+0000","last_undegraded":"2024-02-10T08:42:49.317433+0000","last_fullsized":"2024-02-10T08:42:49.317433+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'46","last_scrub_stamp":"2024-02-10T08:42:45.477897+0000","last_deep_scrub":"402'46","last_deep_scrub_stamp":"2024-02-10T08:42:45.477897+0000","last_clean_scrub_stamp":"2024-02-10T08:42:45.477897+0000","log_size":46,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":62,"num_read_kb":53,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":552,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:42:54.449812+0000","last_change":"2024-02-10T08:42:54.449812+0000","last_active":"2024-02-10T08:42:54.449812+0000","last_peered":"2024-02-10T08:42:54.449812+0000","last_clean":"2024-02-10T08:42:54.449812+0000","last_became_active":"2024-02-10T08:41:14.139702+0000","last_became_peered":"2024-02-10T08:41:14.139702+0000","last_unstale":"2024-02-10T08:42:54.449812+0000","last_undegraded":"2024-02-10T08:42:54.449812+0000","last_fullsized":"2024-02-10T08:42:54.449812+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:54.449731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:10.370746+0000","last_clean_scrub_stamp":"2024-02-10T08:42:54.449731+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":541,"reported_epoch":507,"state":"active+clean","last_fresh":"2024-02-10T08:42:49.314883+0000","last_change":"2024-02-10T08:42:41.988675+0000","last_active":"2024-02-10T08:42:49.314883+0000","last_peered":"2024-02-10T08:42:49.314883+0000","last_clean":"2024-02-10T08:42:49.314883+0000","last_became_active":"2024-02-10T08:41:09.778738+0000","last_became_peered":"2024-02-10T08:41:09.778738+0000","last_unstale":"2024-02-10T08:42:49.314883+0000","last_undegraded":"2024-02-10T08:42:49.314883+0000","last_fullsized":"2024-02-10T08:42:49.314883+0000","mapping_epoch":463,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":464,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:41.988547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:42:41.988547+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":457,"reported_epoch":507,"state":"active+clean","last_fresh":"2024-02-10T08:42:49.315974+0000","last_change":"2024-02-10T08:42:35.287823+0000","last_active":"2024-02-10T08:42:49.315974+0000","last_peered":"2024-02-10T08:42:49.315974+0000","last_clean":"2024-02-10T08:42:49.315974+0000","last_became_active":"2024-02-10T08:41:09.778599+0000","last_became_peered":"2024-02-10T08:41:09.778599+0000","last_unstale":"2024-02-10T08:42:49.315974+0000","last_undegraded":"2024-02-10T08:42:49.315974+0000","last_fullsized":"2024-02-10T08:42:49.315974+0000","mapping_epoch":463,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":464,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:35.287737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:41:10.223116+0000","last_clean_scrub_stamp":"2024-02-10T08:42:35.287737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"402'29","reported_seq":435,"reported_epoch":507,"state":"active+clean","last_fresh":"2024-02-10T08:42:49.362311+0000","last_change":"2024-02-10T08:42:01.506341+0000","last_active":"2024-02-10T08:42:49.362311+0000","last_peered":"2024-02-10T08:42:49.362311+0000","last_clean":"2024-02-10T08:42:49.362311+0000","last_became_active":"2024-02-10T08:41:58.159269+0000","last_became_peered":"2024-02-10T08:41:58.159269+0000","last_unstale":"2024-02-10T08:42:49.362311+0000","last_undegraded":"2024-02-10T08:42:49.362311+0000","last_fullsized":"2024-02-10T08:42:49.362311+0000","mapping_epoch":487,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":488,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'29","last_scrub_stamp":"2024-02-10T08:42:01.506258+0000","last_deep_scrub":"402'29","last_deep_scrub_stamp":"2024-02-10T08:38:18.298261+0000","last_clean_scrub_stamp":"2024-02-10T08:42:01.506258+0000","log_size":29,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":33,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":248,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:42:54.464370+0000","last_change":"2024-02-10T08:42:54.464370+0000","last_active":"2024-02-10T08:42:54.464370+0000","last_peered":"2024-02-10T08:42:54.464370+0000","last_clean":"2024-02-10T08:42:54.464370+0000","last_became_active":"2024-02-10T08:41:58.162916+0000","last_became_peered":"2024-02-10T08:41:58.162916+0000","last_unstale":"2024-02-10T08:42:54.464370+0000","last_undegraded":"2024-02-10T08:42:54.464370+0000","last_fullsized":"2024-02-10T08:42:54.464370+0000","mapping_epoch":487,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":488,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:54.464304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:42:54.464304+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":469,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:42:58.188949+0000","last_change":"2024-02-10T08:42:58.188949+0000","last_active":"2024-02-10T08:42:58.188949+0000","last_peered":"2024-02-10T08:42:58.188949+0000","last_clean":"2024-02-10T08:42:58.188949+0000","last_became_active":"2024-02-10T08:41:09.768049+0000","last_became_peered":"2024-02-10T08:41:09.768049+0000","last_unstale":"2024-02-10T08:42:58.188949+0000","last_undegraded":"2024-02-10T08:42:58.188949+0000","last_fullsized":"2024-02-10T08:42:58.188949+0000","mapping_epoch":463,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":464,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:58.188859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:37:17.819656+0000","last_clean_scrub_stamp":"2024-02-10T08:42:58.188859+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":129,"reported_epoch":507,"state":"active+clean","last_fresh":"2024-02-10T08:42:49.362795+0000","last_change":"2024-02-10T08:42:38.699658+0000","last_active":"2024-02-10T08:42:49.362795+0000","last_peered":"2024-02-10T08:42:49.362795+0000","last_clean":"2024-02-10T08:42:49.362795+0000","last_became_active":"2024-02-10T08:41:58.349411+0000","last_became_peered":"2024-02-10T08:41:58.349411+0000","last_unstale":"2024-02-10T08:42:49.362795+0000","last_undegraded":"2024-02-10T08:42:49.362795+0000","last_fullsized":"2024-02-10T08:42:49.362795+0000","mapping_epoch":487,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":488,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:38.699567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:42:38.699567+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"402'21","reported_seq":231,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:42:56.205042+0000","last_change":"2024-02-10T08:42:56.205042+0000","last_active":"2024-02-10T08:42:56.205042+0000","last_peered":"2024-02-10T08:42:56.205042+0000","last_clean":"2024-02-10T08:42:56.205042+0000","last_became_active":"2024-02-10T08:41:09.774607+0000","last_became_peered":"2024-02-10T08:41:09.774607+0000","last_unstale":"2024-02-10T08:42:56.205042+0000","last_undegraded":"2024-02-10T08:42:56.205042+0000","last_fullsized":"2024-02-10T08:42:56.205042+0000","mapping_epoch":463,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":464,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'21","last_scrub_stamp":"2024-02-10T08:42:56.204920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:42:56.204920+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":33,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":58,"reported_epoch":507,"state":"active+clean","last_fresh":"2024-02-10T08:42:50.383365+0000","last_change":"2024-02-10T08:42:50.383316+0000","last_active":"2024-02-10T08:42:50.383365+0000","last_peered":"2024-02-10T08:42:50.383365+0000","last_clean":"2024-02-10T08:42:50.383365+0000","last_became_active":"2024-02-10T08:41:14.145688+0000","last_became_peered":"2024-02-10T08:41:14.145688+0000","last_unstale":"2024-02-10T08:42:50.383365+0000","last_undegraded":"2024-02-10T08:42:50.383365+0000","last_fullsized":"2024-02-10T08:42:50.383365+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:50.383232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:28.028556+0000","last_clean_scrub_stamp":"2024-02-10T08:42:50.383232+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":563,"reported_epoch":507,"state":"active+clean","last_fresh":"2024-02-10T08:42:49.601973+0000","last_change":"2024-02-10T08:42:00.060421+0000","last_active":"2024-02-10T08:42:49.601973+0000","last_peered":"2024-02-10T08:42:49.601973+0000","last_clean":"2024-02-10T08:42:49.601973+0000","last_became_active":"2024-02-10T08:41:14.134827+0000","last_became_peered":"2024-02-10T08:41:14.134827+0000","last_unstale":"2024-02-10T08:42:49.601973+0000","last_undegraded":"2024-02-10T08:42:49.601973+0000","last_fullsized":"2024-02-10T08:42:49.601973+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:00.060347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:38:18.192551+0000","last_clean_scrub_stamp":"2024-02-10T08:42:00.060347+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,7],"acting":[5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":221,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:24.504818+0000","last_change":"2024-02-10T08:43:24.504818+0000","last_active":"2024-02-10T08:43:24.504818+0000","last_peered":"2024-02-10T08:43:24.504818+0000","last_clean":"2024-02-10T08:43:24.504818+0000","last_became_active":"2024-02-10T08:41:14.144501+0000","last_became_peered":"2024-02-10T08:41:14.144501+0000","last_unstale":"2024-02-10T08:43:24.504818+0000","last_undegraded":"2024-02-10T08:43:24.504818+0000","last_fullsized":"2024-02-10T08:43:24.504818+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:24.504737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:38:19.438174+0000","last_clean_scrub_stamp":"2024-02-10T08:43:24.504737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"402'9","reported_seq":527,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:18.305509+0000","last_change":"2024-02-10T08:43:18.305509+0000","last_active":"2024-02-10T08:43:18.305509+0000","last_peered":"2024-02-10T08:43:18.305509+0000","last_clean":"2024-02-10T08:43:18.305509+0000","last_became_active":"2024-02-10T08:41:09.769130+0000","last_became_peered":"2024-02-10T08:41:09.769130+0000","last_unstale":"2024-02-10T08:43:18.305509+0000","last_undegraded":"2024-02-10T08:43:18.305509+0000","last_fullsized":"2024-02-10T08:43:18.305509+0000","mapping_epoch":463,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":464,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'9","last_scrub_stamp":"2024-02-10T08:43:18.305429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:43:18.305429+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"55'1","reported_seq":62,"reported_epoch":507,"state":"active+clean","last_fresh":"2024-02-10T08:42:49.390084+0000","last_change":"2024-02-10T08:42:42.339353+0000","last_active":"2024-02-10T08:42:49.390084+0000","last_peered":"2024-02-10T08:42:49.390084+0000","last_clean":"2024-02-10T08:42:49.390084+0000","last_became_active":"2024-02-10T08:41:14.153116+0000","last_became_peered":"2024-02-10T08:41:14.153116+0000","last_unstale":"2024-02-10T08:42:49.390084+0000","last_undegraded":"2024-02-10T08:42:49.390084+0000","last_fullsized":"2024-02-10T08:42:49.390084+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'1","last_scrub_stamp":"2024-02-10T08:42:42.339274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:42:42.339274+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1746,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":58,"reported_epoch":507,"state":"active+clean","last_fresh":"2024-02-10T08:42:49.389242+0000","last_change":"2024-02-10T08:42:47.372696+0000","last_active":"2024-02-10T08:42:49.389242+0000","last_peered":"2024-02-10T08:42:49.389242+0000","last_clean":"2024-02-10T08:42:49.389242+0000","last_became_active":"2024-02-10T08:41:14.144814+0000","last_became_peered":"2024-02-10T08:41:14.144814+0000","last_unstale":"2024-02-10T08:42:49.389242+0000","last_undegraded":"2024-02-10T08:42:49.389242+0000","last_fullsized":"2024-02-10T08:42:49.389242+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:47.372619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:42:47.372619+0000","last_clean_scrub_stamp":"2024-02-10T08:42:47.372619+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":508,"reported_epoch":507,"state":"active+clean","last_fresh":"2024-02-10T08:42:49.601678+0000","last_change":"2024-02-10T08:41:45.192154+0000","last_active":"2024-02-10T08:42:49.601678+0000","last_peered":"2024-02-10T08:42:49.601678+0000","last_clean":"2024-02-10T08:42:49.601678+0000","last_became_active":"2024-02-10T08:31:33.886617+0000","last_became_peered":"2024-02-10T08:31:33.886617+0000","last_unstale":"2024-02-10T08:42:49.601678+0000","last_undegraded":"2024-02-10T08:42:49.601678+0000","last_fullsized":"2024-02-10T08:42:49.601678+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:41:45.192066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:34:34.307158+0000","last_clean_scrub_stamp":"2024-02-10T08:41:45.192066+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"401'25","reported_seq":502,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:08.201329+0000","last_change":"2024-02-10T08:43:08.201329+0000","last_active":"2024-02-10T08:43:08.201329+0000","last_peered":"2024-02-10T08:43:08.201329+0000","last_clean":"2024-02-10T08:43:08.201329+0000","last_became_active":"2024-02-10T08:41:09.766209+0000","last_became_peered":"2024-02-10T08:41:09.766209+0000","last_unstale":"2024-02-10T08:43:08.201329+0000","last_undegraded":"2024-02-10T08:43:08.201329+0000","last_fullsized":"2024-02-10T08:43:08.201329+0000","mapping_epoch":463,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":464,"parent":"0.0","parent_split_bits":0,"last_scrub":"401'25","last_scrub_stamp":"2024-02-10T08:43:08.201250+0000","last_deep_scrub":"358'19","last_deep_scrub_stamp":"2024-02-10T08:33:34.450897+0000","last_clean_scrub_stamp":"2024-02-10T08:43:08.201250+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":33,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":140,"reported_epoch":507,"state":"active+clean","last_fresh":"2024-02-10T08:42:49.362744+0000","last_change":"2024-02-10T08:41:58.482893+0000","last_active":"2024-02-10T08:42:49.362744+0000","last_peered":"2024-02-10T08:42:49.362744+0000","last_clean":"2024-02-10T08:42:49.362744+0000","last_became_active":"2024-02-10T08:41:58.348553+0000","last_became_peered":"2024-02-10T08:41:58.348553+0000","last_unstale":"2024-02-10T08:42:49.362744+0000","last_undegraded":"2024-02-10T08:42:49.362744+0000","last_fullsized":"2024-02-10T08:42:49.362744+0000","mapping_epoch":487,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":488,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:41:58.482819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:38:08.296391+0000","last_clean_scrub_stamp":"2024-02-10T08:41:58.482819+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":511,"reported_epoch":507,"state":"active+clean","last_fresh":"2024-02-10T08:42:49.315323+0000","last_change":"2024-02-10T08:41:54.869626+0000","last_active":"2024-02-10T08:42:49.315323+0000","last_peered":"2024-02-10T08:42:49.315323+0000","last_clean":"2024-02-10T08:42:49.315323+0000","last_became_active":"2024-02-10T08:41:14.138755+0000","last_became_peered":"2024-02-10T08:41:14.138755+0000","last_unstale":"2024-02-10T08:42:49.315323+0000","last_undegraded":"2024-02-10T08:42:49.315323+0000","last_fullsized":"2024-02-10T08:42:49.315323+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:41:54.869561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:41:54.869561+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":472,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:04.175762+0000","last_change":"2024-02-10T08:43:04.175762+0000","last_active":"2024-02-10T08:43:04.175762+0000","last_peered":"2024-02-10T08:43:04.175762+0000","last_clean":"2024-02-10T08:43:04.175762+0000","last_became_active":"2024-02-10T08:41:09.768675+0000","last_became_peered":"2024-02-10T08:41:09.768675+0000","last_unstale":"2024-02-10T08:43:04.175762+0000","last_undegraded":"2024-02-10T08:43:04.175762+0000","last_fullsized":"2024-02-10T08:43:04.175762+0000","mapping_epoch":463,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":464,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:04.175683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:41:21.221088+0000","last_clean_scrub_stamp":"2024-02-10T08:43:04.175683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"402'39","reported_seq":498,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:00.449330+0000","last_change":"2024-02-10T08:43:00.449330+0000","last_active":"2024-02-10T08:43:00.449330+0000","last_peered":"2024-02-10T08:43:00.449330+0000","last_clean":"2024-02-10T08:43:00.449330+0000","last_became_active":"2024-02-10T08:41:58.161122+0000","last_became_peered":"2024-02-10T08:41:58.161122+0000","last_unstale":"2024-02-10T08:43:00.449330+0000","last_undegraded":"2024-02-10T08:43:00.449330+0000","last_fullsized":"2024-02-10T08:43:00.449330+0000","mapping_epoch":487,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":488,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'39","last_scrub_stamp":"2024-02-10T08:43:00.449258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:43:00.449258+0000","log_size":39,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":60,"num_read_kb":51,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":231,"reported_epoch":507,"state":"active+clean","last_fresh":"2024-02-10T08:42:49.387182+0000","last_change":"2024-02-10T08:42:27.758913+0000","last_active":"2024-02-10T08:42:49.387182+0000","last_peered":"2024-02-10T08:42:49.387182+0000","last_clean":"2024-02-10T08:42:49.387182+0000","last_became_active":"2024-02-10T08:41:14.137598+0000","last_became_peered":"2024-02-10T08:41:14.137598+0000","last_unstale":"2024-02-10T08:42:49.387182+0000","last_undegraded":"2024-02-10T08:42:49.387182+0000","last_fullsized":"2024-02-10T08:42:49.387182+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:27.758844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:42:27.758844+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":202,"reported_epoch":507,"state":"active+clean","last_fresh":"2024-02-10T08:42:49.315036+0000","last_change":"2024-02-10T08:42:23.080794+0000","last_active":"2024-02-10T08:42:49.315036+0000","last_peered":"2024-02-10T08:42:49.315036+0000","last_clean":"2024-02-10T08:42:49.315036+0000","last_became_active":"2024-02-10T08:41:09.765898+0000","last_became_peered":"2024-02-10T08:41:09.765898+0000","last_unstale":"2024-02-10T08:42:49.315036+0000","last_undegraded":"2024-02-10T08:42:49.315036+0000","last_fullsized":"2024-02-10T08:42:49.315036+0000","mapping_epoch":463,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":464,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:23.080716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:36:24.205221+0000","last_clean_scrub_stamp":"2024-02-10T08:42:23.080716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":241,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:09.515056+0000","last_change":"2024-02-10T08:43:09.515056+0000","last_active":"2024-02-10T08:43:09.515056+0000","last_peered":"2024-02-10T08:43:09.515056+0000","last_clean":"2024-02-10T08:43:09.515056+0000","last_became_active":"2024-02-10T08:41:58.163294+0000","last_became_peered":"2024-02-10T08:41:58.163294+0000","last_unstale":"2024-02-10T08:43:09.515056+0000","last_undegraded":"2024-02-10T08:43:09.515056+0000","last_fullsized":"2024-02-10T08:43:09.515056+0000","mapping_epoch":487,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":488,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:09.514954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:35:19.525667+0000","last_clean_scrub_stamp":"2024-02-10T08:43:09.514954+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":427,"reported_epoch":507,"state":"active+clean","last_fresh":"2024-02-10T08:42:49.314028+0000","last_change":"2024-02-10T08:42:07.775881+0000","last_active":"2024-02-10T08:42:49.314028+0000","last_peered":"2024-02-10T08:42:49.314028+0000","last_clean":"2024-02-10T08:42:49.314028+0000","last_became_active":"2024-02-10T08:41:14.147171+0000","last_became_peered":"2024-02-10T08:41:14.147171+0000","last_unstale":"2024-02-10T08:42:49.314028+0000","last_undegraded":"2024-02-10T08:42:49.314028+0000","last_fullsized":"2024-02-10T08:42:49.314028+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:07.775729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:36:19.772116+0000","last_clean_scrub_stamp":"2024-02-10T08:42:07.775729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,7],"acting":[1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":53,"reported_epoch":507,"state":"active+clean","last_fresh":"2024-02-10T08:42:49.389277+0000","last_change":"2024-02-10T08:42:30.284330+0000","last_active":"2024-02-10T08:42:49.389277+0000","last_peered":"2024-02-10T08:42:49.389277+0000","last_clean":"2024-02-10T08:42:49.389277+0000","last_became_active":"2024-02-10T08:41:14.138576+0000","last_became_peered":"2024-02-10T08:41:14.138576+0000","last_unstale":"2024-02-10T08:42:49.389277+0000","last_undegraded":"2024-02-10T08:42:49.389277+0000","last_fullsized":"2024-02-10T08:42:49.389277+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:30.284251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:42:30.284251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":414,"reported_epoch":507,"state":"active+clean","last_fresh":"2024-02-10T08:42:49.601285+0000","last_change":"2024-02-10T08:42:24.352424+0000","last_active":"2024-02-10T08:42:49.601285+0000","last_peered":"2024-02-10T08:42:49.601285+0000","last_clean":"2024-02-10T08:42:49.601285+0000","last_became_active":"2024-02-10T08:22:00.600200+0000","last_became_peered":"2024-02-10T08:22:00.600200+0000","last_unstale":"2024-02-10T08:42:49.601285+0000","last_undegraded":"2024-02-10T08:42:49.601285+0000","last_fullsized":"2024-02-10T08:42:49.601285+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:24.352300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:42:24.352300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1],"acting":[6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":416,"reported_epoch":507,"state":"active+clean","last_fresh":"2024-02-10T08:42:49.386734+0000","last_change":"2024-02-10T08:42:31.751106+0000","last_active":"2024-02-10T08:42:49.386734+0000","last_peered":"2024-02-10T08:42:49.386734+0000","last_clean":"2024-02-10T08:42:49.386734+0000","last_became_active":"2024-02-10T08:41:09.785026+0000","last_became_peered":"2024-02-10T08:41:09.785026+0000","last_unstale":"2024-02-10T08:42:49.386734+0000","last_undegraded":"2024-02-10T08:42:49.386734+0000","last_fullsized":"2024-02-10T08:42:49.386734+0000","mapping_epoch":463,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":464,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:31.751012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:42:31.751012+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":523,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:07.547211+0000","last_change":"2024-02-10T08:43:07.547211+0000","last_active":"2024-02-10T08:43:07.547211+0000","last_peered":"2024-02-10T08:43:07.547211+0000","last_clean":"2024-02-10T08:43:07.547211+0000","last_became_active":"2024-02-10T08:31:33.879440+0000","last_became_peered":"2024-02-10T08:31:33.879440+0000","last_unstale":"2024-02-10T08:43:07.547211+0000","last_undegraded":"2024-02-10T08:43:07.547211+0000","last_fullsized":"2024-02-10T08:43:07.547211+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:07.547113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:43:07.547113+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":527,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:18.515856+0000","last_change":"2024-02-10T08:43:18.515856+0000","last_active":"2024-02-10T08:43:18.515856+0000","last_peered":"2024-02-10T08:43:18.515856+0000","last_clean":"2024-02-10T08:43:18.515856+0000","last_became_active":"2024-02-10T08:27:27.710587+0000","last_became_peered":"2024-02-10T08:27:27.710587+0000","last_unstale":"2024-02-10T08:43:18.515856+0000","last_undegraded":"2024-02-10T08:43:18.515856+0000","last_fullsized":"2024-02-10T08:43:18.515856+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:18.515751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:11.750537+0000","last_clean_scrub_stamp":"2024-02-10T08:43:18.515751+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,1],"acting":[6,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":427,"reported_epoch":507,"state":"active+clean","last_fresh":"2024-02-10T08:42:49.314503+0000","last_change":"2024-02-10T08:42:30.088064+0000","last_active":"2024-02-10T08:42:49.314503+0000","last_peered":"2024-02-10T08:42:49.314503+0000","last_clean":"2024-02-10T08:42:49.314503+0000","last_became_active":"2024-02-10T08:32:36.974142+0000","last_became_peered":"2024-02-10T08:32:36.974142+0000","last_unstale":"2024-02-10T08:42:49.314503+0000","last_undegraded":"2024-02-10T08:42:49.314503+0000","last_fullsized":"2024-02-10T08:42:49.314503+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:30.087838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:36:22.783769+0000","last_clean_scrub_stamp":"2024-02-10T08:42:30.087838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":430,"reported_epoch":507,"state":"active+clean","last_fresh":"2024-02-10T08:42:49.603012+0000","last_change":"2024-02-10T08:42:14.513300+0000","last_active":"2024-02-10T08:42:49.603012+0000","last_peered":"2024-02-10T08:42:49.603012+0000","last_clean":"2024-02-10T08:42:49.603012+0000","last_became_active":"2024-02-10T08:32:36.979412+0000","last_became_peered":"2024-02-10T08:32:36.979412+0000","last_unstale":"2024-02-10T08:42:49.603012+0000","last_undegraded":"2024-02-10T08:42:49.603012+0000","last_fullsized":"2024-02-10T08:42:49.603012+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:14.513235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:42:14.513235+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1],"acting":[6,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":526,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:42:52.420077+0000","last_change":"2024-02-10T08:42:52.420077+0000","last_active":"2024-02-10T08:42:52.420077+0000","last_peered":"2024-02-10T08:42:52.420077+0000","last_clean":"2024-02-10T08:42:52.420077+0000","last_became_active":"2024-02-10T08:41:14.149774+0000","last_became_peered":"2024-02-10T08:41:14.149774+0000","last_unstale":"2024-02-10T08:42:52.420077+0000","last_undegraded":"2024-02-10T08:42:52.420077+0000","last_fullsized":"2024-02-10T08:42:52.420077+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:52.419992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:42:52.419992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,6],"acting":[2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.29","version":"76'2","reported_seq":62,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:16.523557+0000","last_change":"2024-02-10T08:43:16.523557+0000","last_active":"2024-02-10T08:43:16.523557+0000","last_peered":"2024-02-10T08:43:16.523557+0000","last_clean":"2024-02-10T08:43:16.523557+0000","last_became_active":"2024-02-10T08:41:14.144310+0000","last_became_peered":"2024-02-10T08:41:14.144310+0000","last_unstale":"2024-02-10T08:43:16.523557+0000","last_undegraded":"2024-02-10T08:43:16.523557+0000","last_fullsized":"2024-02-10T08:43:16.523557+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":6,"last_scrub":"76'2","last_scrub_stamp":"2024-02-10T08:43:16.523476+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2024-02-10T08:42:13.289093+0000","last_clean_scrub_stamp":"2024-02-10T08:43:16.523476+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,0],"acting":[7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":225,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:26.294163+0000","last_change":"2024-02-10T08:43:26.294163+0000","last_active":"2024-02-10T08:43:26.294163+0000","last_peered":"2024-02-10T08:43:26.294163+0000","last_clean":"2024-02-10T08:43:26.294163+0000","last_became_active":"2024-02-10T08:41:09.775029+0000","last_became_peered":"2024-02-10T08:41:09.775029+0000","last_unstale":"2024-02-10T08:43:26.294163+0000","last_undegraded":"2024-02-10T08:43:26.294163+0000","last_fullsized":"2024-02-10T08:43:26.294163+0000","mapping_epoch":463,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":464,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:26.294085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:42:07.989266+0000","last_clean_scrub_stamp":"2024-02-10T08:43:26.294085+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0],"acting":[4,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":261,"reported_epoch":507,"state":"active+clean","last_fresh":"2024-02-10T08:42:49.601839+0000","last_change":"2024-02-10T08:42:01.171142+0000","last_active":"2024-02-10T08:42:49.601839+0000","last_peered":"2024-02-10T08:42:49.601839+0000","last_clean":"2024-02-10T08:42:49.601839+0000","last_became_active":"2024-02-10T08:41:14.136120+0000","last_became_peered":"2024-02-10T08:41:14.136120+0000","last_unstale":"2024-02-10T08:42:49.601839+0000","last_undegraded":"2024-02-10T08:42:49.601839+0000","last_fullsized":"2024-02-10T08:42:49.601839+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:01.170999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:42:01.170999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":301,"reported_epoch":507,"state":"active+clean","last_fresh":"2024-02-10T08:42:49.602311+0000","last_change":"2024-02-10T08:42:23.304112+0000","last_active":"2024-02-10T08:42:49.602311+0000","last_peered":"2024-02-10T08:42:49.602311+0000","last_clean":"2024-02-10T08:42:49.602311+0000","last_became_active":"2024-02-10T08:42:14.492602+0000","last_became_peered":"2024-02-10T08:42:14.492602+0000","last_unstale":"2024-02-10T08:42:49.602311+0000","last_undegraded":"2024-02-10T08:42:49.602311+0000","last_fullsized":"2024-02-10T08:42:49.602311+0000","mapping_epoch":494,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":495,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:23.304038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:20:30.227375+0000","last_clean_scrub_stamp":"2024-02-10T08:42:23.304038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,5],"acting":[6,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":519,"reported_epoch":507,"state":"active+clean","last_fresh":"2024-02-10T08:42:49.317479+0000","last_change":"2024-02-10T08:42:30.664465+0000","last_active":"2024-02-10T08:42:49.317479+0000","last_peered":"2024-02-10T08:42:49.317479+0000","last_clean":"2024-02-10T08:42:49.317479+0000","last_became_active":"2024-02-10T08:30:26.085360+0000","last_became_peered":"2024-02-10T08:30:26.085360+0000","last_unstale":"2024-02-10T08:42:49.317479+0000","last_undegraded":"2024-02-10T08:42:49.317479+0000","last_fullsized":"2024-02-10T08:42:49.317479+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:30.664364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:42:30.664364+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,5],"acting":[2,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":284,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:42:53.426254+0000","last_change":"2024-02-10T08:42:53.426254+0000","last_active":"2024-02-10T08:42:53.426254+0000","last_peered":"2024-02-10T08:42:53.426254+0000","last_clean":"2024-02-10T08:42:53.426254+0000","last_became_active":"2024-02-10T08:41:14.140334+0000","last_became_peered":"2024-02-10T08:41:14.140334+0000","last_unstale":"2024-02-10T08:42:53.426254+0000","last_undegraded":"2024-02-10T08:42:53.426254+0000","last_fullsized":"2024-02-10T08:42:53.426254+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:53.426162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:38:11.227477+0000","last_clean_scrub_stamp":"2024-02-10T08:42:53.426162+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":53,"reported_epoch":507,"state":"active+clean","last_fresh":"2024-02-10T08:42:49.390148+0000","last_change":"2024-02-10T08:42:22.329683+0000","last_active":"2024-02-10T08:42:49.390148+0000","last_peered":"2024-02-10T08:42:49.390148+0000","last_clean":"2024-02-10T08:42:49.390148+0000","last_became_active":"2024-02-10T08:41:14.144098+0000","last_became_peered":"2024-02-10T08:41:14.144098+0000","last_unstale":"2024-02-10T08:42:49.390148+0000","last_undegraded":"2024-02-10T08:42:49.390148+0000","last_fullsized":"2024-02-10T08:42:49.390148+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:22.329600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:38:08.045526+0000","last_clean_scrub_stamp":"2024-02-10T08:42:22.329600+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":53,"reported_epoch":507,"state":"active+clean","last_fresh":"2024-02-10T08:42:49.389670+0000","last_change":"2024-02-10T08:42:20.256259+0000","last_active":"2024-02-10T08:42:49.389670+0000","last_peered":"2024-02-10T08:42:49.389670+0000","last_clean":"2024-02-10T08:42:49.389670+0000","last_became_active":"2024-02-10T08:41:14.150890+0000","last_became_peered":"2024-02-10T08:41:14.150890+0000","last_unstale":"2024-02-10T08:42:49.389670+0000","last_undegraded":"2024-02-10T08:42:49.389670+0000","last_fullsized":"2024-02-10T08:42:49.389670+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:20.256170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:36:14.408305+0000","last_clean_scrub_stamp":"2024-02-10T08:42:20.256170+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1],"acting":[7,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":443,"reported_epoch":507,"state":"active+clean","last_fresh":"2024-02-10T08:42:49.601495+0000","last_change":"2024-02-10T08:41:57.085767+0000","last_active":"2024-02-10T08:42:49.601495+0000","last_peered":"2024-02-10T08:42:49.601495+0000","last_clean":"2024-02-10T08:42:49.601495+0000","last_became_active":"2024-02-10T08:41:14.133669+0000","last_became_peered":"2024-02-10T08:41:14.133669+0000","last_unstale":"2024-02-10T08:42:49.601495+0000","last_undegraded":"2024-02-10T08:42:49.601495+0000","last_fullsized":"2024-02-10T08:42:49.601495+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:41:57.085690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:41:57.085690+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2646,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":11,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":33,"acting":33,"num_store_stats":8},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1583,"num_read_kb":1578,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":9,"acting":9,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":1517,"num_read_kb":1274,"num_write":989,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":305,"num_bytes_recovered":7404,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1061,"ondisk_log_size":1061,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":96,"acting":96,"num_store_stats":8},{"poolid":6,"num_pg":52,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":369,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":156,"acting":156,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":446,"seq":1915555414061,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":470760,"kb_used_data":113760,"kb_used_omap":264,"kb_used_meta":356727,"kb_avail":93274392,"statfs":{"total":95995035648,"available":95512977408,"internally_reserved":0,"allocated":116490240,"data_stored":115917216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":270834,"internal_metadata":365288974},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:43:02 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":1.1279999999999999,"15min":1.3959999999999999},"min":{"1min":0.30199999999999999,"5min":0.245,"15min":0.245},"max":{"1min":0.70299999999999996,"5min":10.378,"15min":10.378},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.53700000000000003,"5min":1.581,"15min":2.0409999999999999},"min":{"1min":0.434,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.69899999999999995,"5min":5.6319999999999997,"15min":5.6319999999999997},"last":0.56899999999999995}]},{"osd":1,"last update":"Sat Feb 10 08:43:02 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":2.0209999999999999,"15min":2.6709999999999998},"min":{"1min":0.41899999999999998,"5min":0.245,"15min":0.245},"max":{"1min":0.64500000000000002,"5min":17.931000000000001,"15min":17.931000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.53100000000000003,"5min":1.732,"15min":2.2629999999999999},"min":{"1min":0.32100000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.73899999999999999,"5min":17.721,"15min":17.721},"last":0.64700000000000002}]},{"osd":2,"last update":"Sat Feb 10 08:43:02 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":1.6579999999999999,"15min":2.1560000000000001},"min":{"1min":0.38400000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.67400000000000004,"5min":7.5800000000000001,"15min":7.5800000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.54900000000000004,"5min":1.359,"15min":1.708},"min":{"1min":0.375,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.68700000000000006,"5min":10.412000000000001,"15min":10.412000000000001},"last":0.53700000000000003}]},{"osd":3,"last update":"Sat Feb 10 08:43:02 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":2.1899999999999999,"15min":2.9199999999999999},"min":{"1min":0.40000000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.71399999999999997,"5min":10.811999999999999,"15min":10.811999999999999},"last":0.495},{"interface":"front","average":{"1min":0.56799999999999995,"5min":1.9199999999999999,"15min":2.52},"min":{"1min":0.38500000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.71099999999999997,"5min":10.709,"15min":10.709},"last":0.60999999999999999}]},{"osd":4,"last update":"Sat Feb 10 08:43:13 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.45200000000000001,"15min":0.44700000000000001},"min":{"1min":0.32500000000000001,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.47899999999999998,"15min":0.47799999999999998},"min":{"1min":0.374,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.623,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.59899999999999998}]},{"osd":5,"last update":"Sat Feb 10 08:43:02 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":1.5129999999999999,"15min":1.9670000000000001},"min":{"1min":0.38200000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.68500000000000005,"5min":14.82,"15min":14.82},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":1.4239999999999999,"15min":1.8240000000000001},"min":{"1min":0.46300000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.74299999999999999,"5min":11.414999999999999,"15min":11.414999999999999},"last":0.621}]},{"osd":6,"last update":"Sat Feb 10 08:43:02 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":1.613,"15min":2.0899999999999999},"min":{"1min":0.45600000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.72599999999999998,"5min":11.442,"15min":11.442},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.56699999999999995,"5min":1.835,"15min":2.4129999999999998},"min":{"1min":0.434,"5min":0.251,"15min":0.251},"max":{"1min":0.755,"5min":8.3680000000000003,"15min":8.3680000000000003},"last":0.65800000000000003}]}]},{"osd":6,"up_from":43,"seq":184683594057,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":898452,"kb_used_data":1164,"kb_used_omap":0,"kb_used_meta":897280,"kb_avail":92846700,"statfs":{"total":95995035648,"available":95075020800,"internally_reserved":0,"allocated":1191936,"data_stored":639087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":918814720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:43:08 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":1.51,"15min":1.591},"min":{"1min":0.41899999999999998,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.87,"5min":8.9160000000000004,"15min":8.9160000000000004},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.53700000000000003,"5min":1.4330000000000001,"15min":1.4630000000000001},"min":{"1min":0.39900000000000002,"5min":0.221,"15min":0.20899999999999999},"max":{"1min":0.69499999999999995,"5min":10.349,"15min":10.349},"last":0.44800000000000001}]},{"osd":1,"last update":"Sat Feb 10 08:43:08 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":1.3759999999999999,"15min":1.496},"min":{"1min":0.41499999999999998,"5min":0.22700000000000001,"15min":0.223},"max":{"1min":0.73599999999999999,"5min":8.5050000000000008,"15min":8.5050000000000008},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.56399999999999995,"5min":1.821,"15min":1.861},"min":{"1min":0.44,"5min":0.28299999999999997,"15min":0.215},"max":{"1min":0.75800000000000001,"5min":14.632,"15min":14.632},"last":0.46800000000000003}]},{"osd":2,"last update":"Sat Feb 10 08:43:08 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":1.494,"15min":1.7490000000000001},"min":{"1min":0.36499999999999999,"5min":0.255,"15min":0.255},"max":{"1min":0.72899999999999998,"5min":11.68,"15min":25.146999999999998},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.56799999999999995,"5min":1.3260000000000001,"15min":1.5269999999999999},"min":{"1min":0.44900000000000001,"5min":0.25900000000000001,"15min":0.23100000000000001},"max":{"1min":0.73999999999999999,"5min":10.391999999999999,"15min":25.135999999999999},"last":0.56299999999999994}]},{"osd":3,"last update":"Sat Feb 10 08:43:08 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":1.619,"15min":2.0699999999999998},"min":{"1min":0.46800000000000003,"5min":0.25,"15min":0.25},"max":{"1min":0.82799999999999996,"5min":8.5250000000000004,"15min":103.94199999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":1.6899999999999999,"15min":2.194},"min":{"1min":0.438,"5min":0.26800000000000002,"15min":0.26300000000000001},"max":{"1min":0.78900000000000003,"5min":11.640000000000001,"15min":103.79600000000001},"last":0.52100000000000002}]},{"osd":4,"last update":"Sat Feb 10 08:43:10 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.46200000000000002,"15min":0.45800000000000002},"min":{"1min":0.32000000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55000000000000004,"15min":0.54900000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.67600000000000005}]},{"osd":5,"last update":"Sat Feb 10 08:43:08 2024","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":1.3009999999999999,"15min":1.615},"min":{"1min":0.35299999999999998,"5min":0.25700000000000001,"15min":0.24099999999999999},"max":{"1min":0.67900000000000005,"5min":14.864000000000001,"15min":29.631},"last":0.497},{"interface":"front","average":{"1min":0.56599999999999995,"5min":1.419,"15min":1.571},"min":{"1min":0.40000000000000002,"5min":0.27900000000000003,"15min":0.23699999999999999},"max":{"1min":0.77000000000000002,"5min":15.109999999999999,"15min":29.419},"last":0.65700000000000003}]},{"osd":7,"last update":"Sat Feb 10 08:42:56 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":1.4410000000000001,"15min":1.851},"min":{"1min":0.39800000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.745,"5min":8.9849999999999994,"15min":8.9849999999999994},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.63600000000000001,"5min":2.2850000000000001,"15min":3.0390000000000001},"min":{"1min":0.48199999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.80500000000000005,"5min":25.84,"15min":25.84},"last":0.63800000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575200,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":895352,"kb_used_data":1200,"kb_used_omap":0,"kb_used_meta":894144,"kb_avail":92849800,"statfs":{"total":95995035648,"available":95078195200,"internally_reserved":0,"allocated":1228800,"data_stored":639436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":915603456},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:43:02 2024","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":1.8149999999999999,"15min":1.8},"min":{"1min":0.23599999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.53100000000000003,"5min":20.315000000000001,"15min":20.315000000000001},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.38300000000000001,"5min":1.712,"15min":1.778},"min":{"1min":0.24399999999999999,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.52100000000000002,"5min":14.757999999999999,"15min":19.928999999999998},"last":0.56299999999999994}]},{"osd":2,"last update":"Sat Feb 10 08:42:41 2024","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":2,"15min":1.8140000000000001},"min":{"1min":0.23999999999999999,"5min":0.224,"15min":0.22},"max":{"1min":0.55800000000000005,"5min":10.523,"15min":15.347},"last":1.5229999999999999},{"interface":"front","average":{"1min":0.38200000000000001,"5min":2.246,"15min":2.0110000000000001},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.184},"max":{"1min":0.58199999999999996,"5min":24.114999999999998,"15min":24.114999999999998},"last":0.434}]},{"osd":3,"last update":"Sat Feb 10 08:42:53 2024","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":1.6100000000000001,"15min":1.7789999999999999},"min":{"1min":0.29899999999999999,"5min":0.28899999999999998,"15min":0.23400000000000001},"max":{"1min":0.66200000000000003,"5min":11.268000000000001,"15min":12.369999999999999},"last":0.377},{"interface":"front","average":{"1min":0.41599999999999998,"5min":2.222,"15min":2},"min":{"1min":0.26000000000000001,"5min":0.248,"15min":0.19600000000000001},"max":{"1min":0.63300000000000001,"5min":27.797000000000001,"15min":27.797000000000001},"last":0.49099999999999999}]},{"osd":4,"last update":"Sat Feb 10 08:43:13 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.59599999999999997,"15min":0.59499999999999997},"min":{"1min":0.40200000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.58699999999999997,"15min":0.58299999999999996},"min":{"1min":0.442,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.68000000000000005}]},{"osd":5,"last update":"Sat Feb 10 08:42:41 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":1.855,"15min":1.851},"min":{"1min":0.41299999999999998,"5min":0.28199999999999997,"15min":0.27900000000000003},"max":{"1min":0.80300000000000005,"5min":8.5950000000000006,"15min":21.751000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.59799999999999998,"5min":1.7909999999999999,"15min":1.968},"min":{"1min":0.45500000000000002,"5min":0.33500000000000002,"15min":0.30099999999999999},"max":{"1min":0.88700000000000001,"5min":9.0129999999999999,"15min":16.324000000000002},"last":0.627}]},{"osd":6,"last update":"Sat Feb 10 08:43:02 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":1.552,"15min":2.0419999999999998},"min":{"1min":0.47899999999999998,"5min":0.36299999999999999,"15min":0.30199999999999999},"max":{"1min":0.85399999999999998,"5min":9.0489999999999995,"15min":60.279000000000003},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.67400000000000004,"5min":1.8089999999999999,"15min":2},"min":{"1min":0.42199999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.86899999999999999,"5min":20.216999999999999,"15min":60.286000000000001},"last":0.71899999999999997}]},{"osd":7,"last update":"Sat Feb 10 08:42:57 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":1.5840000000000001,"15min":2.0209999999999999},"min":{"1min":0.434,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.91800000000000004,"5min":5.6269999999999998,"15min":5.6269999999999998},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.66400000000000003,"5min":1.3340000000000001,"15min":1.6499999999999999},"min":{"1min":0.45600000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.875,"5min":6.3010000000000002,"15min":6.3010000000000002},"last":0.747}]}]},{"osd":0,"up_from":8,"seq":34359738725,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":899824,"kb_used_data":1192,"kb_used_omap":0,"kb_used_meta":898624,"kb_avail":92845328,"statfs":{"total":95995035648,"available":95073615872,"internally_reserved":0,"allocated":1220608,"data_stored":639557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":920190976},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 10 08:43:21 2024","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":2.3039999999999998,"15min":1.7310000000000001},"min":{"1min":0.223,"5min":0.193,"15min":0.16300000000000001},"max":{"1min":0.53600000000000003,"5min":32.671999999999997,"15min":32.671999999999997},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.375,"5min":1.696,"15min":1.7150000000000001},"min":{"1min":0.26400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.63200000000000001,"5min":31.539000000000001,"15min":31.539000000000001},"last":0.36299999999999999}]},{"osd":2,"last update":"Sat Feb 10 08:42:37 2024","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":1.8839999999999999,"15min":2.048},"min":{"1min":0.253,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.55100000000000005,"5min":12.555,"15min":21.331},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.41699999999999998,"5min":1.8660000000000001,"15min":1.6419999999999999},"min":{"1min":0.253,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.626,"5min":15.189,"15min":15.189},"last":0.34200000000000003}]},{"osd":3,"last update":"Sat Feb 10 08:42:55 2024","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":1.1359999999999999,"15min":1.4990000000000001},"min":{"1min":0.28299999999999997,"5min":0.218,"15min":0.218},"max":{"1min":0.71199999999999997,"5min":9.8209999999999997,"15min":15.585000000000001},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.44400000000000001,"5min":1.5960000000000001,"15min":1.919},"min":{"1min":0.34999999999999998,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.72099999999999997,"5min":14.843,"15min":19.504000000000001},"last":0.316}]},{"osd":4,"last update":"Sat Feb 10 08:43:11 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.60699999999999998,"15min":0.60899999999999999},"min":{"1min":0.47599999999999998,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.72099999999999997,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.60099999999999998,"15min":0.60299999999999998},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.78300000000000003,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.56100000000000005}]},{"osd":5,"last update":"Sat Feb 10 08:42:44 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":1.913,"15min":1.8799999999999999},"min":{"1min":0.45200000000000001,"5min":0.33300000000000002,"15min":0.28000000000000003},"max":{"1min":1.1879999999999999,"5min":9.5570000000000004,"15min":28.123999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.61199999999999999,"5min":1.375,"15min":1.6819999999999999},"min":{"1min":0.42399999999999999,"5min":0.29299999999999998,"15min":0.28599999999999998},"max":{"1min":0.81200000000000006,"5min":11.135999999999999,"15min":28.350000000000001},"last":0.46300000000000002}]},{"osd":6,"last update":"Sat Feb 10 08:43:21 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":1.8740000000000001,"15min":1.744},"min":{"1min":0.48599999999999999,"5min":0.318,"15min":0.25900000000000001},"max":{"1min":0.83999999999999997,"5min":9.7759999999999998,"15min":9.7759999999999998},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.63200000000000001,"5min":1.474,"15min":1.6240000000000001},"min":{"1min":0.45600000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.91000000000000003,"5min":9.8960000000000008,"15min":15.359},"last":0.57499999999999996}]},{"osd":7,"last update":"Sat Feb 10 08:42:55 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":1.5940000000000001,"15min":2.0249999999999999},"min":{"1min":0.47999999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.84399999999999997,"5min":7.5609999999999999,"15min":7.5609999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.63500000000000001,"5min":1.9239999999999999,"15min":2.4940000000000002},"min":{"1min":0.48699999999999999,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.86699999999999999,"5min":9.9269999999999996,"15min":9.9269999999999996},"last":0.53900000000000003}]}]},{"osd":2,"up_from":18,"seq":77309411676,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":887392,"kb_used_data":1176,"kb_used_omap":0,"kb_used_meta":886208,"kb_avail":92857760,"statfs":{"total":95995035648,"available":95086346240,"internally_reserved":0,"allocated":1204224,"data_stored":638938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":907476992},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:42:36 2024","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":1.6259999999999999,"15min":1.452},"min":{"1min":0.223,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.63400000000000001,"5min":22.050999999999998,"15min":27.934999999999999},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.371,"5min":1.669,"15min":1.9019999999999999},"min":{"1min":0.23300000000000001,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.57499999999999996,"5min":20.158000000000001,"15min":20.158000000000001},"last":0.30299999999999999}]},{"osd":1,"last update":"Sat Feb 10 08:42:36 2024","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":2.242,"15min":2.0030000000000001},"min":{"1min":0.23699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.628,"5min":24.324999999999999,"15min":24.324999999999999},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.41099999999999998,"5min":1.7,"15min":1.462},"min":{"1min":0.26500000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.58999999999999997,"5min":29.376999999999999,"15min":29.376999999999999},"last":0.316}]},{"osd":3,"last update":"Sat Feb 10 08:42:59 2024","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":1.407,"15min":1.5700000000000001},"min":{"1min":0.33600000000000002,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.60999999999999999,"5min":9.1039999999999992,"15min":9.7870000000000008},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.41399999999999998,"5min":1.1890000000000001,"15min":1.2509999999999999},"min":{"1min":0.30399999999999999,"5min":0.26300000000000001,"15min":0.20999999999999999},"max":{"1min":0.56599999999999995,"5min":11.478,"15min":11.478},"last":0.36499999999999999}]},{"osd":4,"last update":"Sat Feb 10 08:43:16 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.61399999999999999,"15min":0.60599999999999998},"min":{"1min":0.48699999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.80400000000000005,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.623,"15min":0.61499999999999999},"min":{"1min":0.46999999999999997,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.81100000000000005,"5min":0.872,"15min":0.872},"last":0.57099999999999995}]},{"osd":5,"last update":"Sat Feb 10 08:42:43 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":1.7769999999999999,"15min":1.9790000000000001},"min":{"1min":0.45600000000000002,"5min":0.31900000000000001,"15min":0.28999999999999998},"max":{"1min":0.84099999999999997,"5min":19.765999999999998,"15min":19.765999999999998},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.61499999999999999,"5min":1.655,"15min":1.8100000000000001},"min":{"1min":0.371,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.97499999999999998,"5min":7.3129999999999997,"15min":9.5709999999999997},"last":0.49099999999999999}]},{"osd":6,"last update":"Sat Feb 10 08:43:27 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":3.714,"15min":2.665},"min":{"1min":0.40600000000000003,"5min":0.33800000000000002,"15min":0.27300000000000002},"max":{"1min":0.83099999999999996,"5min":235.446,"15min":235.446},"last":0.505},{"interface":"front","average":{"1min":0.59699999999999998,"5min":3.681,"15min":2.6440000000000001},"min":{"1min":0.441,"5min":0.33500000000000002,"15min":0.32200000000000001},"max":{"1min":0.85199999999999998,"5min":234.95500000000001,"15min":234.95500000000001},"last":0.441}]},{"osd":7,"last update":"Sat Feb 10 08:42:59 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":1.4139999999999999,"15min":1.7789999999999999},"min":{"1min":0.48899999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.84199999999999997,"5min":8.0150000000000006,"15min":8.0150000000000006},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.64100000000000001,"5min":1.478,"15min":1.865},"min":{"1min":0.42799999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.95199999999999996,"5min":6.7489999999999997,"15min":6.7489999999999997},"last":0.46999999999999997}]}]},{"osd":3,"up_from":25,"seq":107374182743,"num_pgs":62,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":887152,"kb_used_data":1192,"kb_used_omap":0,"kb_used_meta":885952,"kb_avail":92858000,"statfs":{"total":95995035648,"available":95086592000,"internally_reserved":0,"allocated":1220608,"data_stored":638689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":907214848},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:42:54 2024","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":1.3540000000000001,"15min":1.788},"min":{"1min":0.21199999999999999,"5min":0.187,"15min":0.17699999999999999},"max":{"1min":0.94999999999999996,"5min":8.7880000000000003,"15min":66.605000000000004},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.38100000000000001,"5min":1.4099999999999999,"15min":1.782},"min":{"1min":0.26000000000000001,"5min":0.218,"15min":0.184},"max":{"1min":0.69799999999999995,"5min":14.781000000000001,"15min":66.828000000000003},"last":0.499}]},{"osd":1,"last update":"Sat Feb 10 08:42:54 2024","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":3.1629999999999998,"15min":2.2330000000000001},"min":{"1min":0.27800000000000002,"5min":0.20399999999999999,"15min":0.187},"max":{"1min":1.1299999999999999,"5min":84.375,"15min":84.375},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.47099999999999997,"5min":3.218,"15min":2.3570000000000002},"min":{"1min":0.28000000000000003,"5min":0.25600000000000001,"15min":0.20599999999999999},"max":{"1min":1.901,"5min":84.113,"15min":84.113},"last":0.54000000000000004}]},{"osd":2,"last update":"Sat Feb 10 08:42:54 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":1.496,"15min":2.0590000000000002},"min":{"1min":0.253,"5min":0.23699999999999999,"15min":0.20799999999999999},"max":{"1min":2.1800000000000002,"5min":9.0220000000000002,"15min":65.998999999999995},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.44700000000000001,"5min":1.2230000000000001,"15min":1.7629999999999999},"min":{"1min":0.32200000000000001,"5min":0.248,"15min":0.23400000000000001},"max":{"1min":0.79300000000000004,"5min":6.5300000000000002,"15min":68.721000000000004},"last":0.45600000000000002}]},{"osd":4,"last update":"Sat Feb 10 08:43:15 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.60499999999999998,"15min":0.60899999999999999},"min":{"1min":0.35499999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.879},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.61599999999999999,"15min":0.61899999999999999},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.81299999999999994}]},{"osd":5,"last update":"Sat Feb 10 08:42:54 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":1.399,"15min":1.7170000000000001},"min":{"1min":0.42999999999999999,"5min":0.28000000000000003,"15min":0.27500000000000002},"max":{"1min":0.97799999999999998,"5min":8.6349999999999998,"15min":19.832000000000001},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.60399999999999998,"5min":1.4870000000000001,"15min":1.728},"min":{"1min":0.41099999999999998,"5min":0.34699999999999998,"15min":0.27800000000000002},"max":{"1min":1.091,"5min":7.2249999999999996,"15min":19.712},"last":0.84099999999999997}]},{"osd":6,"last update":"Sat Feb 10 08:43:15 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":1.6890000000000001,"15min":1.782},"min":{"1min":0.378,"5min":0.36599999999999999,"15min":0.31},"max":{"1min":0.97699999999999998,"5min":12.404,"15min":16.423999999999999},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.57599999999999996,"5min":1.379,"15min":1.6080000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.91000000000000003,"5min":8.7289999999999992,"15min":11.127000000000001},"last":0.85099999999999998}]},{"osd":7,"last update":"Sat Feb 10 08:42:54 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":1.3759999999999999,"15min":1.6739999999999999},"min":{"1min":0.40500000000000003,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.0049999999999999,"5min":8.9789999999999992,"15min":8.9789999999999992},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.63800000000000001,"5min":1.782,"15min":2.2160000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.0820000000000001,"5min":7.5990000000000002,"15min":7.5990000000000002},"last":0.91300000000000003}]}]},{"osd":4,"up_from":463,"seq":1988569858078,"num_pgs":62,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":332836,"kb_used_data":1180,"kb_used_omap":0,"kb_used_meta":331647,"kb_avail":93412316,"statfs":{"total":95995035648,"available":95654211584,"internally_reserved":0,"allocated":1208320,"data_stored":638357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":972,"internal_metadata":339606580},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:43:11 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.54900000000000004}]},{"osd":1,"last update":"Sat Feb 10 08:43:11 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.50600000000000001,"15min":0.502},"min":{"1min":0.41999999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.66400000000000003,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.54700000000000004,"15min":0.54400000000000004},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.67000000000000004,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.66600000000000004}]},{"osd":2,"last update":"Sat Feb 10 08:43:11 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.54500000000000004,"15min":0.54200000000000004},"min":{"1min":0.39300000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.72099999999999997,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.42299999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.73299999999999998,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.70399999999999996}]},{"osd":3,"last update":"Sat Feb 10 08:43:11 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.54600000000000004,"15min":0.54100000000000004},"min":{"1min":0.46000000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.70099999999999996,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.58099999999999996,"15min":0.57899999999999996},"min":{"1min":0.47899999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.68999999999999995,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.73999999999999999}]},{"osd":5,"last update":"Sat Feb 10 08:43:11 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.5,"15min":0.49299999999999999},"min":{"1min":0.34499999999999997,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.63},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.46899999999999997,"15min":0.46600000000000003},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.64000000000000001}]},{"osd":6,"last update":"Sat Feb 10 08:43:11 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.48899999999999999,"15min":0.48099999999999998},"min":{"1min":0.39100000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.51500000000000001,"15min":0.50900000000000001},"min":{"1min":0.32800000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.69099999999999995}]},{"osd":7,"last update":"Sat Feb 10 08:43:11 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.52900000000000003,"15min":0.52700000000000002},"min":{"1min":0.36199999999999999,"5min":0.307,"15min":0.307},"max":{"1min":0.69299999999999995,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.54800000000000004,"15min":0.54400000000000004},"min":{"1min":0.38,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.65900000000000003}]}]},{"osd":5,"up_from":37,"seq":158913790286,"num_pgs":61,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":892180,"kb_used_data":1164,"kb_used_omap":0,"kb_used_meta":891008,"kb_avail":92852972,"statfs":{"total":95995035648,"available":95081443328,"internally_reserved":0,"allocated":1191936,"data_stored":638260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":912392192},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:42:45 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":2.1520000000000001,"15min":1.655},"min":{"1min":0.34899999999999998,"5min":0.219,"15min":0.21099999999999999},"max":{"1min":0.79700000000000004,"5min":33.384,"15min":33.384},"last":0.438},{"interface":"front","average":{"1min":0.51600000000000001,"5min":1.7889999999999999,"15min":1.6839999999999999},"min":{"1min":0.32400000000000001,"5min":0.192,"15min":0.192},"max":{"1min":0.70599999999999996,"5min":27.681000000000001,"15min":27.681000000000001},"last":0.40899999999999997}]},{"osd":1,"last update":"Sat Feb 10 08:42:45 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":2.2879999999999998,"15min":1.819},"min":{"1min":0.33200000000000002,"5min":0.23000000000000001,"15min":0.222},"max":{"1min":0.77200000000000002,"5min":16.341999999999999,"15min":16.341999999999999},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":1.853,"15min":1.6080000000000001},"min":{"1min":0.32200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.77400000000000002,"5min":16.225999999999999,"15min":16.225999999999999},"last":0.54800000000000004}]},{"osd":2,"last update":"Sat Feb 10 08:42:45 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":1.284,"15min":1.5029999999999999},"min":{"1min":0.36399999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.74399999999999999,"5min":10.811999999999999,"15min":20.254999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":1.8540000000000001,"15min":1.639},"min":{"1min":0.34300000000000003,"5min":0.26800000000000002,"15min":0.26400000000000001},"max":{"1min":0.76100000000000001,"5min":15.369999999999999,"15min":15.369999999999999},"last":2.7029999999999998}]},{"osd":3,"last update":"Sat Feb 10 08:42:45 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":1.218,"15min":1.3080000000000001},"min":{"1min":0.39700000000000002,"5min":0.27600000000000002,"15min":0.26100000000000001},"max":{"1min":0.72199999999999998,"5min":6.7409999999999997,"15min":8.0079999999999991},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.55200000000000005,"5min":2.069,"15min":1.7},"min":{"1min":0.40999999999999998,"5min":0.28799999999999998,"15min":0.27300000000000002},"max":{"1min":0.72099999999999997,"5min":15.391999999999999,"15min":15.391999999999999},"last":0.53200000000000003}]},{"osd":4,"last update":"Sat Feb 10 08:43:13 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.442,"15min":0.432},"min":{"1min":0.32100000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.47899999999999998,"15min":0.46400000000000002},"min":{"1min":0.42799999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.66700000000000004}]},{"osd":6,"last update":"Sat Feb 10 08:43:17 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":1.3620000000000001,"15min":1.363},"min":{"1min":0.34799999999999998,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.73199999999999998,"5min":50.213000000000001,"15min":50.213000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":1.3540000000000001,"15min":1.276},"min":{"1min":0.45700000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.69399999999999995,"5min":49.872999999999998,"15min":49.872999999999998},"last":0.60899999999999999}]},{"osd":7,"last update":"Sat Feb 10 08:42:58 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.78900000000000003,"15min":0.92700000000000005},"min":{"1min":0.38800000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.70699999999999996,"5min":4.7960000000000003,"15min":4.7960000000000003},"last":0.747},{"interface":"front","average":{"1min":0.55500000000000005,"5min":1.018,"15min":1.2549999999999999},"min":{"1min":0.36099999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.80000000000000004,"5min":7.093,"15min":7.093},"last":0.70399999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-10T08:43:32.668 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph pg dump --format=json 2024-02-10T08:43:32.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:30.585152+0000 osd.7 (osd.7) 91 : cluster [DBG] 1.0 scrub starts 2024-02-10T08:43:32.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:30.586164+0000 osd.7 (osd.7) 92 : cluster [DBG] 1.0 scrub ok 2024-02-10T08:43:32.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:31.111802+0000 osd.1 (osd.1) 403 : cluster [DBG] 6.20 scrub starts 2024-02-10T08:43:32.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:31.114794+0000 osd.1 (osd.1) 404 : cluster [DBG] 6.20 scrub ok 2024-02-10T08:43:32.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:31.264658+0000 mgr.y (mgr.14505) 997 : cluster [DBG] pgmap v1236: 162 pgs: 162 active+clean; 5.7 KiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-10T08:43:32.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:31.536919+0000 osd.5 (osd.5) 380 : cluster [DBG] 6.31 scrub starts 2024-02-10T08:43:32.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:31.539856+0000 osd.5 (osd.5) 381 : cluster [DBG] 6.31 scrub ok 2024-02-10T08:43:32.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:31.662777+0000 osd.6 (osd.6) 365 : cluster [DBG] 5.1f scrub starts 2024-02-10T08:43:32.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:31.666245+0000 osd.6 (osd.6) 366 : cluster [DBG] 5.1f scrub ok 2024-02-10T08:43:32.951 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:43:33.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:43:31.851939+0000 mgr.y (mgr.14505) 998 : audit [DBG] from='client.16137 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-10T08:43:33.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:32.145557+0000 osd.1 (osd.1) 405 : cluster [DBG] 5.19 scrub starts 2024-02-10T08:43:33.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:32.148460+0000 osd.1 (osd.1) 406 : cluster [DBG] 5.19 scrub ok 2024-02-10T08:43:33.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:32.302136+0000 osd.4 (osd.4) 95 : cluster [DBG] 6.e scrub starts 2024-02-10T08:43:33.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:32.303558+0000 osd.4 (osd.4) 96 : cluster [DBG] 6.e scrub ok 2024-02-10T08:43:33.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:43:31.851939+0000 mgr.y (mgr.14505) 998 : audit [DBG] from='client.16137 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-10T08:43:33.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:32.145557+0000 osd.1 (osd.1) 405 : cluster [DBG] 5.19 scrub starts 2024-02-10T08:43:33.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:32.148460+0000 osd.1 (osd.1) 406 : cluster [DBG] 5.19 scrub ok 2024-02-10T08:43:33.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:32.302136+0000 osd.4 (osd.4) 95 : cluster [DBG] 6.e scrub starts 2024-02-10T08:43:33.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:33 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:32.303558+0000 osd.4 (osd.4) 96 : cluster [DBG] 6.e scrub ok 2024-02-10T08:43:33.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:43:31.851939+0000 mgr.y (mgr.14505) 998 : audit [DBG] from='client.16137 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-10T08:43:33.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:32.145557+0000 osd.1 (osd.1) 405 : cluster [DBG] 5.19 scrub starts 2024-02-10T08:43:33.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:32.148460+0000 osd.1 (osd.1) 406 : cluster [DBG] 5.19 scrub ok 2024-02-10T08:43:33.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:32.302136+0000 osd.4 (osd.4) 95 : cluster [DBG] 6.e scrub starts 2024-02-10T08:43:33.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:32.303558+0000 osd.4 (osd.4) 96 : cluster [DBG] 6.e scrub ok 2024-02-10T08:43:34.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:33.189853+0000 osd.1 (osd.1) 407 : cluster [DBG] 4.7 scrub starts 2024-02-10T08:43:34.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:33.193447+0000 osd.1 (osd.1) 408 : cluster [DBG] 4.7 scrub ok 2024-02-10T08:43:34.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:33.265375+0000 mgr.y (mgr.14505) 999 : cluster [DBG] pgmap v1237: 162 pgs: 162 active+clean; 5.7 KiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:43:34.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:33.500838+0000 osd.5 (osd.5) 382 : cluster [DBG] 2.18 scrub starts 2024-02-10T08:43:34.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:33.503836+0000 osd.5 (osd.5) 383 : cluster [DBG] 2.18 scrub ok 2024-02-10T08:43:34.793 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:33.189853+0000 osd.1 (osd.1) 407 : cluster [DBG] 4.7 scrub starts 2024-02-10T08:43:34.793 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:33.193447+0000 osd.1 (osd.1) 408 : cluster [DBG] 4.7 scrub ok 2024-02-10T08:43:34.793 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:33.265375+0000 mgr.y (mgr.14505) 999 : cluster [DBG] pgmap v1237: 162 pgs: 162 active+clean; 5.7 KiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:43:34.793 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:33.500838+0000 osd.5 (osd.5) 382 : cluster [DBG] 2.18 scrub starts 2024-02-10T08:43:34.793 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:33.503836+0000 osd.5 (osd.5) 383 : cluster [DBG] 2.18 scrub ok 2024-02-10T08:43:34.794 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:33.189853+0000 osd.1 (osd.1) 407 : cluster [DBG] 4.7 scrub starts 2024-02-10T08:43:34.794 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:33.193447+0000 osd.1 (osd.1) 408 : cluster [DBG] 4.7 scrub ok 2024-02-10T08:43:34.794 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:33.265375+0000 mgr.y (mgr.14505) 999 : cluster [DBG] pgmap v1237: 162 pgs: 162 active+clean; 5.7 KiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:43:34.794 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:33.500838+0000 osd.5 (osd.5) 382 : cluster [DBG] 2.18 scrub starts 2024-02-10T08:43:34.794 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:34 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:33.503836+0000 osd.5 (osd.5) 383 : cluster [DBG] 2.18 scrub ok 2024-02-10T08:43:35.274 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-02-10T08:43:35.277 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-02-10T08:43:35.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:34.657851+0000 osd.6 (osd.6) 367 : cluster [DBG] 6.2c scrub starts 2024-02-10T08:43:35.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:34.660780+0000 osd.6 (osd.6) 368 : cluster [DBG] 6.2c scrub ok 2024-02-10T08:43:35.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:34.657851+0000 osd.6 (osd.6) 367 : cluster [DBG] 6.2c scrub starts 2024-02-10T08:43:35.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:35 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:34.660780+0000 osd.6 (osd.6) 368 : cluster [DBG] 6.2c scrub ok 2024-02-10T08:43:35.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:34.657851+0000 osd.6 (osd.6) 367 : cluster [DBG] 6.2c scrub starts 2024-02-10T08:43:35.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:34.660780+0000 osd.6 (osd.6) 368 : cluster [DBG] 6.2c scrub ok 2024-02-10T08:43:36.296 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":1237,"stamp":"2024-02-10T08:43:33.264879+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":5796,"num_objects":192,"num_object_clones":0,"num_object_copies":576,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":192,"num_whiteouts":0,"num_read":3116,"num_read_kb":2868,"num_write":999,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":326,"num_bytes_recovered":10419,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1187,"ondisk_log_size":1187,"up":486,"acting":486,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":487,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":6154504,"kb_used_data":112584,"kb_used_omap":265,"kb_used_meta":6041590,"kb_avail":743806712,"statfs":{"total":767960285184,"available":761658073088,"internally_reserved":0,"allocated":115286016,"data_stored":110646004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":271806,"internal_metadata":6186588738},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002192"},"pg_stats":[{"pgid":"6.33","version":"0'0","reported_seq":436,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.558807+0000","last_change":"2024-02-10T08:43:25.581526+0000","last_active":"2024-02-10T08:43:30.558807+0000","last_peered":"2024-02-10T08:43:30.558807+0000","last_clean":"2024-02-10T08:43:30.558807+0000","last_became_active":"2024-02-10T08:41:14.135273+0000","last_became_peered":"2024-02-10T08:41:14.135273+0000","last_unstale":"2024-02-10T08:43:30.558807+0000","last_undegraded":"2024-02-10T08:43:30.558807+0000","last_fullsized":"2024-02-10T08:43:30.558807+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:25.581432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:43:25.581432+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2],"acting":[5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":512,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.460328+0000","last_change":"2024-02-10T08:43:30.275440+0000","last_active":"2024-02-10T08:43:30.460328+0000","last_peered":"2024-02-10T08:43:30.460328+0000","last_clean":"2024-02-10T08:43:30.460328+0000","last_became_active":"2024-02-10T08:41:09.774663+0000","last_became_peered":"2024-02-10T08:41:09.774663+0000","last_unstale":"2024-02-10T08:43:30.460328+0000","last_undegraded":"2024-02-10T08:43:30.460328+0000","last_fullsized":"2024-02-10T08:43:30.460328+0000","mapping_epoch":463,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":464,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:30.275359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:42:10.000149+0000","last_clean_scrub_stamp":"2024-02-10T08:43:30.275359+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"506'15","reported_seq":92,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.568710+0000","last_change":"2024-02-10T08:42:40.302632+0000","last_active":"2024-02-10T08:43:30.568710+0000","last_peered":"2024-02-10T08:43:30.568710+0000","last_clean":"2024-02-10T08:43:30.568710+0000","last_became_active":"2024-02-10T08:41:14.149970+0000","last_became_peered":"2024-02-10T08:41:14.149970+0000","last_unstale":"2024-02-10T08:43:30.568710+0000","last_undegraded":"2024-02-10T08:43:30.568710+0000","last_fullsized":"2024-02-10T08:43:30.568710+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"506'15","last_scrub_stamp":"2024-02-10T08:42:40.302555+0000","last_deep_scrub":"506'15","last_deep_scrub_stamp":"2024-02-10T08:42:40.302555+0000","last_clean_scrub_stamp":"2024-02-10T08:42:40.302555+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"402'39","reported_seq":627,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.558408+0000","last_change":"2024-02-10T08:42:51.596092+0000","last_active":"2024-02-10T08:43:30.558408+0000","last_peered":"2024-02-10T08:43:30.558408+0000","last_clean":"2024-02-10T08:43:30.558408+0000","last_became_active":"2024-02-10T08:41:14.145261+0000","last_became_peered":"2024-02-10T08:41:14.145261+0000","last_unstale":"2024-02-10T08:43:30.558408+0000","last_undegraded":"2024-02-10T08:43:30.558408+0000","last_fullsized":"2024-02-10T08:43:30.558408+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'39","last_scrub_stamp":"2024-02-10T08:42:51.596011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:42:51.596011+0000","log_size":39,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":62,"num_read_kb":53,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":565,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.625108+0000","last_change":"2024-02-10T08:43:18.407979+0000","last_active":"2024-02-10T08:43:30.625108+0000","last_peered":"2024-02-10T08:43:30.625108+0000","last_clean":"2024-02-10T08:43:30.625108+0000","last_became_active":"2024-02-10T08:41:14.126836+0000","last_became_peered":"2024-02-10T08:41:14.126836+0000","last_unstale":"2024-02-10T08:43:30.625108+0000","last_undegraded":"2024-02-10T08:43:30.625108+0000","last_fullsized":"2024-02-10T08:43:30.625108+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:18.407916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:43:18.407916+0000","last_clean_scrub_stamp":"2024-02-10T08:43:18.407916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":524,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.558723+0000","last_change":"2024-02-10T08:43:04.530439+0000","last_active":"2024-02-10T08:43:30.558723+0000","last_peered":"2024-02-10T08:43:30.558723+0000","last_clean":"2024-02-10T08:43:30.558723+0000","last_became_active":"2024-02-10T08:30:24.062795+0000","last_became_peered":"2024-02-10T08:30:24.062795+0000","last_unstale":"2024-02-10T08:43:30.558723+0000","last_undegraded":"2024-02-10T08:43:30.558723+0000","last_fullsized":"2024-02-10T08:43:30.558723+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:04.530366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:20.392249+0000","last_clean_scrub_stamp":"2024-02-10T08:43:04.530366+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"419'25","reported_seq":342,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:14.452730+0000","last_change":"2024-02-10T08:43:14.452730+0000","last_active":"2024-02-10T08:43:14.452730+0000","last_peered":"2024-02-10T08:43:14.452730+0000","last_clean":"2024-02-10T08:43:14.452730+0000","last_became_active":"2024-02-10T08:41:09.785066+0000","last_became_peered":"2024-02-10T08:41:09.785066+0000","last_unstale":"2024-02-10T08:43:14.452730+0000","last_undegraded":"2024-02-10T08:43:14.452730+0000","last_fullsized":"2024-02-10T08:43:14.452730+0000","mapping_epoch":463,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":464,"parent":"0.0","parent_split_bits":0,"last_scrub":"419'25","last_scrub_stamp":"2024-02-10T08:43:14.452648+0000","last_deep_scrub":"419'25","last_deep_scrub_stamp":"2024-02-10T08:38:11.355898+0000","last_clean_scrub_stamp":"2024-02-10T08:43:14.452648+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":34,"num_read_kb":28,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":534,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.561242+0000","last_change":"2024-02-10T08:43:06.094538+0000","last_active":"2024-02-10T08:43:30.561242+0000","last_peered":"2024-02-10T08:43:30.561242+0000","last_clean":"2024-02-10T08:43:30.561242+0000","last_became_active":"2024-02-10T08:41:09.772080+0000","last_became_peered":"2024-02-10T08:41:09.772080+0000","last_unstale":"2024-02-10T08:43:30.561242+0000","last_undegraded":"2024-02-10T08:43:30.561242+0000","last_fullsized":"2024-02-10T08:43:30.561242+0000","mapping_epoch":463,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":464,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:06.094471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:41:38.751945+0000","last_clean_scrub_stamp":"2024-02-10T08:43:06.094471+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":572,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.624958+0000","last_change":"2024-02-10T08:42:57.493971+0000","last_active":"2024-02-10T08:43:30.624958+0000","last_peered":"2024-02-10T08:43:30.624958+0000","last_clean":"2024-02-10T08:43:30.624958+0000","last_became_active":"2024-02-10T08:41:09.761875+0000","last_became_peered":"2024-02-10T08:41:09.761875+0000","last_unstale":"2024-02-10T08:43:30.624958+0000","last_undegraded":"2024-02-10T08:43:30.624958+0000","last_fullsized":"2024-02-10T08:43:30.624958+0000","mapping_epoch":463,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":464,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:57.493901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:41:26.004336+0000","last_clean_scrub_stamp":"2024-02-10T08:42:57.493901+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"76'2","reported_seq":216,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:27.426701+0000","last_change":"2024-02-10T08:43:27.426701+0000","last_active":"2024-02-10T08:43:27.426701+0000","last_peered":"2024-02-10T08:43:27.426701+0000","last_clean":"2024-02-10T08:43:27.426701+0000","last_became_active":"2024-02-10T08:41:14.144466+0000","last_became_peered":"2024-02-10T08:41:14.144466+0000","last_unstale":"2024-02-10T08:43:27.426701+0000","last_undegraded":"2024-02-10T08:43:27.426701+0000","last_fullsized":"2024-02-10T08:43:27.426701+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'2","last_scrub_stamp":"2024-02-10T08:43:27.426556+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2024-02-10T08:43:27.426556+0000","last_clean_scrub_stamp":"2024-02-10T08:43:27.426556+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"402'60","reported_seq":650,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.433763+0000","last_change":"2024-02-10T08:43:22.497652+0000","last_active":"2024-02-10T08:43:30.433763+0000","last_peered":"2024-02-10T08:43:30.433763+0000","last_clean":"2024-02-10T08:43:30.433763+0000","last_became_active":"2024-02-10T08:41:14.140211+0000","last_became_peered":"2024-02-10T08:41:14.140211+0000","last_unstale":"2024-02-10T08:43:30.433763+0000","last_undegraded":"2024-02-10T08:43:30.433763+0000","last_fullsized":"2024-02-10T08:43:30.433763+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'60","last_scrub_stamp":"2024-02-10T08:43:22.497567+0000","last_deep_scrub":"391'44","last_deep_scrub_stamp":"2024-02-10T08:36:15.980533+0000","last_clean_scrub_stamp":"2024-02-10T08:43:22.497567+0000","log_size":60,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":80,"num_read_kb":69,"num_write":52,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":531,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.625340+0000","last_change":"2024-02-10T08:42:28.621848+0000","last_active":"2024-02-10T08:43:30.625340+0000","last_peered":"2024-02-10T08:43:30.625340+0000","last_clean":"2024-02-10T08:43:30.625340+0000","last_became_active":"2024-02-10T08:28:02.781029+0000","last_became_peered":"2024-02-10T08:28:02.781029+0000","last_unstale":"2024-02-10T08:43:30.625340+0000","last_undegraded":"2024-02-10T08:43:30.625340+0000","last_fullsized":"2024-02-10T08:43:30.625340+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:28.621760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:42:28.621760+0000","last_clean_scrub_stamp":"2024-02-10T08:42:28.621760+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":527,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.624936+0000","last_change":"2024-02-10T08:43:10.562799+0000","last_active":"2024-02-10T08:43:30.624936+0000","last_peered":"2024-02-10T08:43:30.624936+0000","last_clean":"2024-02-10T08:43:30.624936+0000","last_became_active":"2024-02-10T08:28:02.779438+0000","last_became_peered":"2024-02-10T08:28:02.779438+0000","last_unstale":"2024-02-10T08:43:30.624936+0000","last_undegraded":"2024-02-10T08:43:30.624936+0000","last_fullsized":"2024-02-10T08:43:30.624936+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:10.562726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.593849+0000","last_clean_scrub_stamp":"2024-02-10T08:43:10.562726+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":54,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:42:50.596637+0000","last_change":"2024-02-10T08:42:08.243105+0000","last_active":"2024-02-10T08:42:50.596637+0000","last_peered":"2024-02-10T08:42:50.596637+0000","last_clean":"2024-02-10T08:42:50.596637+0000","last_became_active":"2024-02-10T08:41:14.144499+0000","last_became_peered":"2024-02-10T08:41:14.144499+0000","last_unstale":"2024-02-10T08:42:50.596637+0000","last_undegraded":"2024-02-10T08:42:50.596637+0000","last_fullsized":"2024-02-10T08:42:50.596637+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:08.243018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:42:08.243018+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,3],"acting":[7,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.8","version":"0'0","reported_seq":118,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.558490+0000","last_change":"2024-02-10T08:42:41.690842+0000","last_active":"2024-02-10T08:43:30.558490+0000","last_peered":"2024-02-10T08:43:30.558490+0000","last_clean":"2024-02-10T08:43:30.558490+0000","last_became_active":"2024-02-10T08:37:45.981258+0000","last_became_peered":"2024-02-10T08:37:45.981258+0000","last_unstale":"2024-02-10T08:43:30.558490+0000","last_undegraded":"2024-02-10T08:43:30.558490+0000","last_fullsized":"2024-02-10T08:43:30.558490+0000","mapping_epoch":411,"log_start":"0'0","ondisk_log_start":"0'0","created":409,"last_epoch_clean":412,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:41.690745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:41:25.264737+0000","last_clean_scrub_stamp":"2024-02-10T08:42:41.690745+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"508'53","reported_seq":236,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.460595+0000","last_change":"2024-02-10T08:43:16.338542+0000","last_active":"2024-02-10T08:43:30.460595+0000","last_peered":"2024-02-10T08:43:30.460595+0000","last_clean":"2024-02-10T08:43:30.460595+0000","last_became_active":"2024-02-10T08:41:09.770353+0000","last_became_peered":"2024-02-10T08:41:09.770353+0000","last_unstale":"2024-02-10T08:43:30.460595+0000","last_undegraded":"2024-02-10T08:43:30.460595+0000","last_fullsized":"2024-02-10T08:43:30.460595+0000","mapping_epoch":463,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":464,"parent":"0.0","parent_split_bits":0,"last_scrub":"508'53","last_scrub_stamp":"2024-02-10T08:43:16.338469+0000","last_deep_scrub":"508'53","last_deep_scrub_stamp":"2024-02-10T08:43:16.338469+0000","last_clean_scrub_stamp":"2024-02-10T08:43:16.338469+0000","log_size":53,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":68,"num_read_kb":58,"num_write":46,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":59,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:42:51.377330+0000","last_change":"2024-02-10T08:42:51.377300+0000","last_active":"2024-02-10T08:42:51.377330+0000","last_peered":"2024-02-10T08:42:51.377330+0000","last_clean":"2024-02-10T08:42:51.377330+0000","last_became_active":"2024-02-10T08:41:14.135767+0000","last_became_peered":"2024-02-10T08:41:14.135767+0000","last_unstale":"2024-02-10T08:42:51.377330+0000","last_undegraded":"2024-02-10T08:42:51.377330+0000","last_fullsized":"2024-02-10T08:42:51.377330+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:51.377188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:42:51.377188+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":543,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.560900+0000","last_change":"2024-02-10T08:42:28.012122+0000","last_active":"2024-02-10T08:43:30.560900+0000","last_peered":"2024-02-10T08:43:30.560900+0000","last_clean":"2024-02-10T08:43:30.560900+0000","last_became_active":"2024-02-10T08:41:09.777938+0000","last_became_peered":"2024-02-10T08:41:09.777938+0000","last_unstale":"2024-02-10T08:43:30.560900+0000","last_undegraded":"2024-02-10T08:43:30.560900+0000","last_fullsized":"2024-02-10T08:43:30.560900+0000","mapping_epoch":463,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":464,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:28.011957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:42:28.011957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":488,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:03.580824+0000","last_change":"2024-02-10T08:43:03.580824+0000","last_active":"2024-02-10T08:43:03.580824+0000","last_peered":"2024-02-10T08:43:03.580824+0000","last_clean":"2024-02-10T08:43:03.580824+0000","last_became_active":"2024-02-10T08:41:09.777127+0000","last_became_peered":"2024-02-10T08:41:09.777127+0000","last_unstale":"2024-02-10T08:43:03.580824+0000","last_undegraded":"2024-02-10T08:43:03.580824+0000","last_fullsized":"2024-02-10T08:43:03.580824+0000","mapping_epoch":463,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":464,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:03.580737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:34.215363+0000","last_clean_scrub_stamp":"2024-02-10T08:43:03.580737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.9","version":"0'0","reported_seq":59,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:11.560419+0000","last_change":"2024-02-10T08:43:11.560389+0000","last_active":"2024-02-10T08:43:11.560419+0000","last_peered":"2024-02-10T08:43:11.560419+0000","last_clean":"2024-02-10T08:43:11.560419+0000","last_became_active":"2024-02-10T08:41:14.139027+0000","last_became_peered":"2024-02-10T08:41:14.139027+0000","last_unstale":"2024-02-10T08:43:11.560419+0000","last_undegraded":"2024-02-10T08:43:11.560419+0000","last_fullsized":"2024-02-10T08:43:11.560419+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":409,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:11.560313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:43:11.560313+0000","last_clean_scrub_stamp":"2024-02-10T08:43:11.560313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"402'30","reported_seq":527,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.460964+0000","last_change":"2024-02-10T08:43:05.213853+0000","last_active":"2024-02-10T08:43:30.460964+0000","last_peered":"2024-02-10T08:43:30.460964+0000","last_clean":"2024-02-10T08:43:30.460964+0000","last_became_active":"2024-02-10T08:41:09.768065+0000","last_became_peered":"2024-02-10T08:41:09.768065+0000","last_unstale":"2024-02-10T08:43:30.460964+0000","last_undegraded":"2024-02-10T08:43:30.460964+0000","last_fullsized":"2024-02-10T08:43:30.460964+0000","mapping_epoch":463,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":464,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'30","last_scrub_stamp":"2024-02-10T08:43:05.213742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:43:05.213742+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":38,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":519,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.560645+0000","last_change":"2024-02-10T08:42:03.904601+0000","last_active":"2024-02-10T08:43:30.560645+0000","last_peered":"2024-02-10T08:43:30.560645+0000","last_clean":"2024-02-10T08:43:30.560645+0000","last_became_active":"2024-02-10T08:41:14.135215+0000","last_became_peered":"2024-02-10T08:41:14.135215+0000","last_unstale":"2024-02-10T08:43:30.560645+0000","last_undegraded":"2024-02-10T08:43:30.560645+0000","last_fullsized":"2024-02-10T08:43:30.560645+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:03.904461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:42:03.904461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"468'10","reported_seq":863,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:31.363500+0000","last_change":"2024-02-10T08:43:03.492712+0000","last_active":"2024-02-10T08:43:31.363500+0000","last_peered":"2024-02-10T08:43:31.363500+0000","last_clean":"2024-02-10T08:43:31.363500+0000","last_became_active":"2024-02-10T08:41:14.135852+0000","last_became_peered":"2024-02-10T08:41:14.135852+0000","last_unstale":"2024-02-10T08:43:31.363500+0000","last_undegraded":"2024-02-10T08:43:31.363500+0000","last_fullsized":"2024-02-10T08:43:31.363500+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"468'10","last_scrub_stamp":"2024-02-10T08:43:03.492645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:43:03.492645+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":460,"reported_epoch":510,"state":"active+clean","last_fresh":"2024-02-10T08:43:32.303632+0000","last_change":"2024-02-10T08:43:32.303632+0000","last_active":"2024-02-10T08:43:32.303632+0000","last_peered":"2024-02-10T08:43:32.303632+0000","last_clean":"2024-02-10T08:43:32.303632+0000","last_became_active":"2024-02-10T08:41:09.780770+0000","last_became_peered":"2024-02-10T08:41:09.780770+0000","last_unstale":"2024-02-10T08:43:32.303632+0000","last_undegraded":"2024-02-10T08:43:32.303632+0000","last_fullsized":"2024-02-10T08:43:32.303632+0000","mapping_epoch":463,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":464,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:32.303563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:33:29.477480+0000","last_clean_scrub_stamp":"2024-02-10T08:43:32.303563+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.a","version":"0'0","reported_seq":118,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.558714+0000","last_change":"2024-02-10T08:43:10.515167+0000","last_active":"2024-02-10T08:43:30.558714+0000","last_peered":"2024-02-10T08:43:30.558714+0000","last_clean":"2024-02-10T08:43:30.558714+0000","last_became_active":"2024-02-10T08:37:45.980492+0000","last_became_peered":"2024-02-10T08:37:45.980492+0000","last_unstale":"2024-02-10T08:43:30.558714+0000","last_undegraded":"2024-02-10T08:43:30.558714+0000","last_fullsized":"2024-02-10T08:43:30.558714+0000","mapping_epoch":411,"log_start":"0'0","ondisk_log_start":"0'0","created":409,"last_epoch_clean":412,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:10.515089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:14:44.584370+0000","last_clean_scrub_stamp":"2024-02-10T08:43:10.515089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.f","version":"508'46","reported_seq":571,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.625306+0000","last_change":"2024-02-10T08:42:53.450779+0000","last_active":"2024-02-10T08:43:30.625306+0000","last_peered":"2024-02-10T08:43:30.625306+0000","last_clean":"2024-02-10T08:43:30.625306+0000","last_became_active":"2024-02-10T08:41:09.761871+0000","last_became_peered":"2024-02-10T08:41:09.761871+0000","last_unstale":"2024-02-10T08:43:30.625306+0000","last_undegraded":"2024-02-10T08:43:30.625306+0000","last_fullsized":"2024-02-10T08:43:30.625306+0000","mapping_epoch":463,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":464,"parent":"0.0","parent_split_bits":0,"last_scrub":"508'46","last_scrub_stamp":"2024-02-10T08:42:53.450701+0000","last_deep_scrub":"508'46","last_deep_scrub_stamp":"2024-02-10T08:42:53.450701+0000","last_clean_scrub_stamp":"2024-02-10T08:42:53.450701+0000","log_size":46,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":62,"num_read_kb":53,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":522,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.560360+0000","last_change":"2024-02-10T08:42:40.954634+0000","last_active":"2024-02-10T08:43:30.560360+0000","last_peered":"2024-02-10T08:43:30.560360+0000","last_clean":"2024-02-10T08:43:30.560360+0000","last_became_active":"2024-02-10T08:41:14.145391+0000","last_became_peered":"2024-02-10T08:41:14.145391+0000","last_unstale":"2024-02-10T08:43:30.560360+0000","last_undegraded":"2024-02-10T08:43:30.560360+0000","last_fullsized":"2024-02-10T08:43:30.560360+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:40.954513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:42:40.954513+0000","last_clean_scrub_stamp":"2024-02-10T08:42:40.954513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"465'16","reported_seq":341,"reported_epoch":510,"state":"active+clean","last_fresh":"2024-02-10T08:43:31.143895+0000","last_change":"2024-02-10T08:42:29.158432+0000","last_active":"2024-02-10T08:43:31.143895+0000","last_peered":"2024-02-10T08:43:31.143895+0000","last_clean":"2024-02-10T08:43:31.143895+0000","last_became_active":"2024-02-10T08:41:09.778666+0000","last_became_peered":"2024-02-10T08:41:09.778666+0000","last_unstale":"2024-02-10T08:43:31.143895+0000","last_undegraded":"2024-02-10T08:43:31.143895+0000","last_fullsized":"2024-02-10T08:43:31.143895+0000","mapping_epoch":463,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":464,"parent":"0.0","parent_split_bits":0,"last_scrub":"465'16","last_scrub_stamp":"2024-02-10T08:42:29.158351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:42:29.158351+0000","log_size":16,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":519,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.559496+0000","last_change":"2024-02-10T08:42:42.723797+0000","last_active":"2024-02-10T08:43:30.559496+0000","last_peered":"2024-02-10T08:43:30.559496+0000","last_clean":"2024-02-10T08:43:30.559496+0000","last_became_active":"2024-02-10T08:32:36.978932+0000","last_became_peered":"2024-02-10T08:32:36.978932+0000","last_unstale":"2024-02-10T08:43:30.559496+0000","last_undegraded":"2024-02-10T08:43:30.559496+0000","last_fullsized":"2024-02-10T08:43:30.559496+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:42.723705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:41:11.291643+0000","last_clean_scrub_stamp":"2024-02-10T08:42:42.723705+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"402'32","reported_seq":503,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.460721+0000","last_change":"2024-02-10T08:43:21.269374+0000","last_active":"2024-02-10T08:43:30.460721+0000","last_peered":"2024-02-10T08:43:30.460721+0000","last_clean":"2024-02-10T08:43:30.460721+0000","last_became_active":"2024-02-10T08:41:09.765668+0000","last_became_peered":"2024-02-10T08:41:09.765668+0000","last_unstale":"2024-02-10T08:43:30.460721+0000","last_undegraded":"2024-02-10T08:43:30.460721+0000","last_fullsized":"2024-02-10T08:43:30.460721+0000","mapping_epoch":463,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":464,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'32","last_scrub_stamp":"2024-02-10T08:43:21.269305+0000","last_deep_scrub":"76'16","last_deep_scrub_stamp":"2024-02-10T08:18:07.909782+0000","last_clean_scrub_stamp":"2024-02-10T08:43:21.269305+0000","log_size":32,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":36,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":59,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:42:58.455429+0000","last_change":"2024-02-10T08:42:58.455400+0000","last_active":"2024-02-10T08:42:58.455429+0000","last_peered":"2024-02-10T08:42:58.455429+0000","last_clean":"2024-02-10T08:42:58.455429+0000","last_became_active":"2024-02-10T08:41:14.136692+0000","last_became_peered":"2024-02-10T08:41:14.136692+0000","last_unstale":"2024-02-10T08:42:58.455429+0000","last_undegraded":"2024-02-10T08:42:58.455429+0000","last_fullsized":"2024-02-10T08:42:58.455429+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:58.455325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:42:58.455325+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":578,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.559574+0000","last_change":"2024-02-10T08:42:23.032815+0000","last_active":"2024-02-10T08:43:30.559574+0000","last_peered":"2024-02-10T08:43:30.559574+0000","last_clean":"2024-02-10T08:43:30.559574+0000","last_became_active":"2024-02-10T08:41:09.777142+0000","last_became_peered":"2024-02-10T08:41:09.777142+0000","last_unstale":"2024-02-10T08:43:30.559574+0000","last_undegraded":"2024-02-10T08:43:30.559574+0000","last_fullsized":"2024-02-10T08:43:30.559574+0000","mapping_epoch":463,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":464,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:23.032735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:42:23.032735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":249,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.435254+0000","last_change":"2024-02-10T08:42:26.392746+0000","last_active":"2024-02-10T08:43:30.435254+0000","last_peered":"2024-02-10T08:43:30.435254+0000","last_clean":"2024-02-10T08:43:30.435254+0000","last_became_active":"2024-02-10T08:41:58.348494+0000","last_became_peered":"2024-02-10T08:41:58.348494+0000","last_unstale":"2024-02-10T08:43:30.435254+0000","last_undegraded":"2024-02-10T08:43:30.435254+0000","last_fullsized":"2024-02-10T08:43:30.435254+0000","mapping_epoch":487,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":488,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:26.392681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:42:26.392681+0000","last_clean_scrub_stamp":"2024-02-10T08:42:26.392681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":112,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.435683+0000","last_change":"2024-02-10T08:42:19.441688+0000","last_active":"2024-02-10T08:43:30.435683+0000","last_peered":"2024-02-10T08:43:30.435683+0000","last_clean":"2024-02-10T08:43:30.435683+0000","last_became_active":"2024-02-10T08:41:58.348496+0000","last_became_peered":"2024-02-10T08:41:58.348496+0000","last_unstale":"2024-02-10T08:43:30.435683+0000","last_undegraded":"2024-02-10T08:43:30.435683+0000","last_fullsized":"2024-02-10T08:43:30.435683+0000","mapping_epoch":487,"log_start":"0'0","ondisk_log_start":"0'0","created":409,"last_epoch_clean":488,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:19.441627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:14:44.584370+0000","last_clean_scrub_stamp":"2024-02-10T08:42:19.441627+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"489'17","reported_seq":393,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:31.363506+0000","last_change":"2024-02-10T08:42:52.518214+0000","last_active":"2024-02-10T08:43:31.363506+0000","last_peered":"2024-02-10T08:43:31.363506+0000","last_clean":"2024-02-10T08:43:31.363506+0000","last_became_active":"2024-02-10T08:41:58.159981+0000","last_became_peered":"2024-02-10T08:41:58.159981+0000","last_unstale":"2024-02-10T08:43:31.363506+0000","last_undegraded":"2024-02-10T08:43:31.363506+0000","last_fullsized":"2024-02-10T08:43:31.363506+0000","mapping_epoch":487,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":488,"parent":"0.0","parent_split_bits":0,"last_scrub":"489'17","last_scrub_stamp":"2024-02-10T08:42:52.518099+0000","last_deep_scrub":"489'17","last_deep_scrub_stamp":"2024-02-10T08:42:52.518099+0000","last_clean_scrub_stamp":"2024-02-10T08:42:52.518099+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"402'42","reported_seq":531,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.460163+0000","last_change":"2024-02-10T08:42:50.209282+0000","last_active":"2024-02-10T08:43:30.460163+0000","last_peered":"2024-02-10T08:43:30.460163+0000","last_clean":"2024-02-10T08:43:30.460163+0000","last_became_active":"2024-02-10T08:41:09.767320+0000","last_became_peered":"2024-02-10T08:41:09.767320+0000","last_unstale":"2024-02-10T08:43:30.460163+0000","last_undegraded":"2024-02-10T08:43:30.460163+0000","last_fullsized":"2024-02-10T08:43:30.460163+0000","mapping_epoch":463,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":464,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'42","last_scrub_stamp":"2024-02-10T08:42:50.209197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:42:50.209197+0000","log_size":42,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":61,"num_read_kb":54,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":529,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.434264+0000","last_change":"2024-02-10T08:43:23.478859+0000","last_active":"2024-02-10T08:43:30.434264+0000","last_peered":"2024-02-10T08:43:30.434264+0000","last_clean":"2024-02-10T08:43:30.434264+0000","last_became_active":"2024-02-10T08:41:14.139943+0000","last_became_peered":"2024-02-10T08:41:14.139943+0000","last_unstale":"2024-02-10T08:43:30.434264+0000","last_undegraded":"2024-02-10T08:43:30.434264+0000","last_fullsized":"2024-02-10T08:43:30.434264+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:23.478763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:42:13.417477+0000","last_clean_scrub_stamp":"2024-02-10T08:43:23.478763+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":54,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:42:50.596917+0000","last_change":"2024-02-10T08:42:26.290612+0000","last_active":"2024-02-10T08:42:50.596917+0000","last_peered":"2024-02-10T08:42:50.596917+0000","last_clean":"2024-02-10T08:42:50.596917+0000","last_became_active":"2024-02-10T08:41:14.138960+0000","last_became_peered":"2024-02-10T08:41:14.138960+0000","last_unstale":"2024-02-10T08:42:50.596917+0000","last_undegraded":"2024-02-10T08:42:50.596917+0000","last_fullsized":"2024-02-10T08:42:50.596917+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:26.290534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:42:26.290534+0000","last_clean_scrub_stamp":"2024-02-10T08:42:26.290534+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":119,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.460882+0000","last_change":"2024-02-10T08:43:11.267525+0000","last_active":"2024-02-10T08:43:30.460882+0000","last_peered":"2024-02-10T08:43:30.460882+0000","last_clean":"2024-02-10T08:43:30.460882+0000","last_became_active":"2024-02-10T08:41:09.774274+0000","last_became_peered":"2024-02-10T08:41:09.774274+0000","last_unstale":"2024-02-10T08:43:30.460882+0000","last_undegraded":"2024-02-10T08:43:30.460882+0000","last_fullsized":"2024-02-10T08:43:30.460882+0000","mapping_epoch":463,"log_start":"0'0","ondisk_log_start":"0'0","created":409,"last_epoch_clean":464,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:11.267453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:14:44.584370+0000","last_clean_scrub_stamp":"2024-02-10T08:43:11.267453+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":489,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.460294+0000","last_change":"2024-02-10T08:42:34.252837+0000","last_active":"2024-02-10T08:43:30.460294+0000","last_peered":"2024-02-10T08:43:30.460294+0000","last_clean":"2024-02-10T08:43:30.460294+0000","last_became_active":"2024-02-10T08:41:14.136599+0000","last_became_peered":"2024-02-10T08:41:14.136599+0000","last_unstale":"2024-02-10T08:43:30.460294+0000","last_undegraded":"2024-02-10T08:43:30.460294+0000","last_fullsized":"2024-02-10T08:43:30.460294+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:34.252745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:42:34.252745+0000","last_clean_scrub_stamp":"2024-02-10T08:42:34.252745+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"402'42","reported_seq":491,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.434905+0000","last_change":"2024-02-10T08:42:44.541584+0000","last_active":"2024-02-10T08:43:30.434905+0000","last_peered":"2024-02-10T08:43:30.434905+0000","last_clean":"2024-02-10T08:43:30.434905+0000","last_became_active":"2024-02-10T08:41:58.160422+0000","last_became_peered":"2024-02-10T08:41:58.160422+0000","last_unstale":"2024-02-10T08:43:30.434905+0000","last_undegraded":"2024-02-10T08:43:30.434905+0000","last_fullsized":"2024-02-10T08:43:30.434905+0000","mapping_epoch":487,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":488,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'42","last_scrub_stamp":"2024-02-10T08:42:44.541496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:42:44.541496+0000","log_size":42,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":68,"num_read_kb":56,"num_write":44,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":529,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.560990+0000","last_change":"2024-02-10T08:42:21.009527+0000","last_active":"2024-02-10T08:43:30.560990+0000","last_peered":"2024-02-10T08:43:30.560990+0000","last_clean":"2024-02-10T08:43:30.560990+0000","last_became_active":"2024-02-10T08:41:09.771168+0000","last_became_peered":"2024-02-10T08:41:09.771168+0000","last_unstale":"2024-02-10T08:43:30.560990+0000","last_undegraded":"2024-02-10T08:43:30.560990+0000","last_fullsized":"2024-02-10T08:43:30.560990+0000","mapping_epoch":463,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":464,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:21.009457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:42:21.009457+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":481,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.460490+0000","last_change":"2024-02-10T08:43:09.249200+0000","last_active":"2024-02-10T08:43:30.460490+0000","last_peered":"2024-02-10T08:43:30.460490+0000","last_clean":"2024-02-10T08:43:30.460490+0000","last_became_active":"2024-02-10T08:41:09.768271+0000","last_became_peered":"2024-02-10T08:41:09.768271+0000","last_unstale":"2024-02-10T08:43:30.460490+0000","last_undegraded":"2024-02-10T08:43:30.460490+0000","last_fullsized":"2024-02-10T08:43:30.460490+0000","mapping_epoch":463,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":464,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:09.249096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:25.358315+0000","last_clean_scrub_stamp":"2024-02-10T08:43:09.249096+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":450,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.434129+0000","last_change":"2024-02-10T08:42:20.304590+0000","last_active":"2024-02-10T08:43:30.434129+0000","last_peered":"2024-02-10T08:43:30.434129+0000","last_clean":"2024-02-10T08:43:30.434129+0000","last_became_active":"2024-02-10T08:42:14.422403+0000","last_became_peered":"2024-02-10T08:42:14.422403+0000","last_unstale":"2024-02-10T08:43:30.434129+0000","last_undegraded":"2024-02-10T08:43:30.434129+0000","last_fullsized":"2024-02-10T08:43:30.434129+0000","mapping_epoch":494,"log_start":"0'0","ondisk_log_start":"0'0","created":409,"last_epoch_clean":495,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:20.304521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:14:44.584370+0000","last_clean_scrub_stamp":"2024-02-10T08:42:20.304521+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,3],"acting":[6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":385,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.433891+0000","last_change":"2024-02-10T08:43:05.377699+0000","last_active":"2024-02-10T08:43:30.433891+0000","last_peered":"2024-02-10T08:43:30.433891+0000","last_clean":"2024-02-10T08:43:30.433891+0000","last_became_active":"2024-02-10T08:42:14.492820+0000","last_became_peered":"2024-02-10T08:42:14.492820+0000","last_unstale":"2024-02-10T08:43:30.433891+0000","last_undegraded":"2024-02-10T08:43:30.433891+0000","last_fullsized":"2024-02-10T08:43:30.433891+0000","mapping_epoch":494,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":495,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:05.377615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:43:05.377615+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"402'47","reported_seq":662,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:42:57.529080+0000","last_change":"2024-02-10T08:42:57.529080+0000","last_active":"2024-02-10T08:42:57.529080+0000","last_peered":"2024-02-10T08:42:57.529080+0000","last_clean":"2024-02-10T08:42:57.529080+0000","last_became_active":"2024-02-10T08:41:14.144113+0000","last_became_peered":"2024-02-10T08:41:14.144113+0000","last_unstale":"2024-02-10T08:42:57.529080+0000","last_undegraded":"2024-02-10T08:42:57.529080+0000","last_fullsized":"2024-02-10T08:42:57.529080+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'47","last_scrub_stamp":"2024-02-10T08:42:57.528950+0000","last_deep_scrub":"199'27","last_deep_scrub_stamp":"2024-02-10T08:24:42.826442+0000","last_clean_scrub_stamp":"2024-02-10T08:42:57.528950+0000","log_size":47,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":68,"num_read_kb":54,"num_write":42,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":990,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":59,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:01.436760+0000","last_change":"2024-02-10T08:43:01.436727+0000","last_active":"2024-02-10T08:43:01.436760+0000","last_peered":"2024-02-10T08:43:01.436760+0000","last_clean":"2024-02-10T08:43:01.436760+0000","last_became_active":"2024-02-10T08:41:14.147110+0000","last_became_peered":"2024-02-10T08:41:14.147110+0000","last_unstale":"2024-02-10T08:43:01.436760+0000","last_undegraded":"2024-02-10T08:43:01.436760+0000","last_fullsized":"2024-02-10T08:43:01.436760+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:01.436656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:43:01.436656+0000","last_clean_scrub_stamp":"2024-02-10T08:43:01.436656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":507,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.560492+0000","last_change":"2024-02-10T08:43:15.076590+0000","last_active":"2024-02-10T08:43:30.560492+0000","last_peered":"2024-02-10T08:43:30.560492+0000","last_clean":"2024-02-10T08:43:30.560492+0000","last_became_active":"2024-02-10T08:21:58.553966+0000","last_became_peered":"2024-02-10T08:21:58.553966+0000","last_unstale":"2024-02-10T08:43:30.560492+0000","last_undegraded":"2024-02-10T08:43:30.560492+0000","last_fullsized":"2024-02-10T08:43:30.560492+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:15.076448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:43:15.076448+0000","last_clean_scrub_stamp":"2024-02-10T08:43:15.076448+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":128,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.560431+0000","last_change":"2024-02-10T08:42:08.809670+0000","last_active":"2024-02-10T08:43:30.560431+0000","last_peered":"2024-02-10T08:43:30.560431+0000","last_clean":"2024-02-10T08:43:30.560431+0000","last_became_active":"2024-02-10T08:41:09.777520+0000","last_became_peered":"2024-02-10T08:41:09.777520+0000","last_unstale":"2024-02-10T08:43:30.560431+0000","last_undegraded":"2024-02-10T08:43:30.560431+0000","last_fullsized":"2024-02-10T08:43:30.560431+0000","mapping_epoch":463,"log_start":"0'0","ondisk_log_start":"0'0","created":409,"last_epoch_clean":464,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:08.809607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:14:44.584370+0000","last_clean_scrub_stamp":"2024-02-10T08:42:08.809607+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":521,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.559583+0000","last_change":"2024-02-10T08:42:57.604002+0000","last_active":"2024-02-10T08:43:30.559583+0000","last_peered":"2024-02-10T08:43:30.559583+0000","last_clean":"2024-02-10T08:43:30.559583+0000","last_became_active":"2024-02-10T08:28:02.772585+0000","last_became_peered":"2024-02-10T08:28:02.772585+0000","last_unstale":"2024-02-10T08:43:30.559583+0000","last_undegraded":"2024-02-10T08:43:30.559583+0000","last_fullsized":"2024-02-10T08:43:30.559583+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:57.603915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:41.360241+0000","last_clean_scrub_stamp":"2024-02-10T08:42:57.603915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"402'36","reported_seq":230,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:42:59.563664+0000","last_change":"2024-02-10T08:42:59.563664+0000","last_active":"2024-02-10T08:42:59.563664+0000","last_peered":"2024-02-10T08:42:59.563664+0000","last_clean":"2024-02-10T08:42:59.563664+0000","last_became_active":"2024-02-10T08:32:36.975366+0000","last_became_peered":"2024-02-10T08:32:36.975366+0000","last_unstale":"2024-02-10T08:42:59.563664+0000","last_undegraded":"2024-02-10T08:42:59.563664+0000","last_fullsized":"2024-02-10T08:42:59.563664+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'36","last_scrub_stamp":"2024-02-10T08:42:59.563595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:42:59.563595+0000","log_size":36,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":47,"num_write":36,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.624622+0000","last_change":"2024-02-10T08:42:22.546334+0000","last_active":"2024-02-10T08:43:30.624622+0000","last_peered":"2024-02-10T08:43:30.624622+0000","last_clean":"2024-02-10T08:43:30.624622+0000","last_became_active":"2024-02-10T08:42:20.718238+0000","last_became_peered":"2024-02-10T08:42:20.718238+0000","last_unstale":"2024-02-10T08:43:30.624622+0000","last_undegraded":"2024-02-10T08:43:30.624622+0000","last_fullsized":"2024-02-10T08:43:30.624622+0000","mapping_epoch":498,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":499,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:22.546253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:42:22.546253+0000","last_clean_scrub_stamp":"2024-02-10T08:42:22.546253+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":508,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:00.559928+0000","last_change":"2024-02-10T08:43:00.559928+0000","last_active":"2024-02-10T08:43:00.559928+0000","last_peered":"2024-02-10T08:43:00.559928+0000","last_clean":"2024-02-10T08:43:00.559928+0000","last_became_active":"2024-02-10T08:41:09.776890+0000","last_became_peered":"2024-02-10T08:41:09.776890+0000","last_unstale":"2024-02-10T08:43:00.559928+0000","last_undegraded":"2024-02-10T08:43:00.559928+0000","last_fullsized":"2024-02-10T08:43:00.559928+0000","mapping_epoch":463,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":464,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:00.559793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:43:00.559793+0000","last_clean_scrub_stamp":"2024-02-10T08:43:00.559793+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":520,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.560990+0000","last_change":"2024-02-10T08:43:27.091029+0000","last_active":"2024-02-10T08:43:30.560990+0000","last_peered":"2024-02-10T08:43:30.560990+0000","last_clean":"2024-02-10T08:43:30.560990+0000","last_became_active":"2024-02-10T08:28:19.022399+0000","last_became_peered":"2024-02-10T08:28:19.022399+0000","last_unstale":"2024-02-10T08:43:30.560990+0000","last_undegraded":"2024-02-10T08:43:30.560990+0000","last_fullsized":"2024-02-10T08:43:30.560990+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:27.090961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:43:27.090961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":59,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:42:56.411139+0000","last_change":"2024-02-10T08:42:56.411110+0000","last_active":"2024-02-10T08:42:56.411139+0000","last_peered":"2024-02-10T08:42:56.411139+0000","last_clean":"2024-02-10T08:42:56.411139+0000","last_became_active":"2024-02-10T08:41:14.145403+0000","last_became_peered":"2024-02-10T08:41:14.145403+0000","last_unstale":"2024-02-10T08:42:56.411139+0000","last_undegraded":"2024-02-10T08:42:56.411139+0000","last_fullsized":"2024-02-10T08:42:56.411139+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:56.411031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:04.766780+0000","last_clean_scrub_stamp":"2024-02-10T08:42:56.411031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"402'45","reported_seq":649,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.433997+0000","last_change":"2024-02-10T08:43:12.472657+0000","last_active":"2024-02-10T08:43:30.433997+0000","last_peered":"2024-02-10T08:43:30.433997+0000","last_clean":"2024-02-10T08:43:30.433997+0000","last_became_active":"2024-02-10T08:41:14.141932+0000","last_became_peered":"2024-02-10T08:41:14.141932+0000","last_unstale":"2024-02-10T08:43:30.433997+0000","last_undegraded":"2024-02-10T08:43:30.433997+0000","last_fullsized":"2024-02-10T08:43:30.433997+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'45","last_scrub_stamp":"2024-02-10T08:43:12.472536+0000","last_deep_scrub":"402'45","last_deep_scrub_stamp":"2024-02-10T08:41:45.488905+0000","last_clean_scrub_stamp":"2024-02-10T08:43:12.472536+0000","log_size":45,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":61,"num_read_kb":51,"num_write":37,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":308,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":59,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.586257+0000","last_change":"2024-02-10T08:43:30.586257+0000","last_active":"2024-02-10T08:43:30.586257+0000","last_peered":"2024-02-10T08:43:30.586257+0000","last_clean":"2024-02-10T08:43:30.586257+0000","last_became_active":"2024-02-10T08:41:14.152599+0000","last_became_peered":"2024-02-10T08:41:14.152599+0000","last_unstale":"2024-02-10T08:43:30.586257+0000","last_undegraded":"2024-02-10T08:43:30.586257+0000","last_fullsized":"2024-02-10T08:43:30.586257+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:30.586170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:14:44.584370+0000","last_clean_scrub_stamp":"2024-02-10T08:43:30.586170+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":521,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.558954+0000","last_change":"2024-02-10T08:43:00.577212+0000","last_active":"2024-02-10T08:43:30.558954+0000","last_peered":"2024-02-10T08:43:30.558954+0000","last_clean":"2024-02-10T08:43:30.558954+0000","last_became_active":"2024-02-10T08:41:14.135690+0000","last_became_peered":"2024-02-10T08:41:14.135690+0000","last_unstale":"2024-02-10T08:43:30.558954+0000","last_undegraded":"2024-02-10T08:43:30.558954+0000","last_fullsized":"2024-02-10T08:43:30.558954+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:00.577133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:41:32.130273+0000","last_clean_scrub_stamp":"2024-02-10T08:43:00.577133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":240,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.435159+0000","last_change":"2024-02-10T08:42:47.485400+0000","last_active":"2024-02-10T08:43:30.435159+0000","last_peered":"2024-02-10T08:43:30.435159+0000","last_clean":"2024-02-10T08:43:30.435159+0000","last_became_active":"2024-02-10T08:41:58.348671+0000","last_became_peered":"2024-02-10T08:41:58.348671+0000","last_unstale":"2024-02-10T08:43:30.435159+0000","last_undegraded":"2024-02-10T08:43:30.435159+0000","last_fullsized":"2024-02-10T08:43:30.435159+0000","mapping_epoch":487,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":488,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:47.485335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:32:29.019819+0000","last_clean_scrub_stamp":"2024-02-10T08:42:47.485335+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":244,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:08.591286+0000","last_change":"2024-02-10T08:43:08.591286+0000","last_active":"2024-02-10T08:43:08.591286+0000","last_peered":"2024-02-10T08:43:08.591286+0000","last_clean":"2024-02-10T08:43:08.591286+0000","last_became_active":"2024-02-10T08:41:09.776782+0000","last_became_peered":"2024-02-10T08:41:09.776782+0000","last_unstale":"2024-02-10T08:43:08.591286+0000","last_undegraded":"2024-02-10T08:43:08.591286+0000","last_fullsized":"2024-02-10T08:43:08.591286+0000","mapping_epoch":463,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":464,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:08.591190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:26:29.921562+0000","last_clean_scrub_stamp":"2024-02-10T08:43:08.591190+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":54,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:42:50.597256+0000","last_change":"2024-02-10T08:42:10.195978+0000","last_active":"2024-02-10T08:42:50.597256+0000","last_peered":"2024-02-10T08:42:50.597256+0000","last_clean":"2024-02-10T08:42:50.597256+0000","last_became_active":"2024-02-10T08:41:14.143868+0000","last_became_peered":"2024-02-10T08:41:14.143868+0000","last_unstale":"2024-02-10T08:42:50.597256+0000","last_undegraded":"2024-02-10T08:42:50.597256+0000","last_fullsized":"2024-02-10T08:42:50.597256+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":409,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:10.195905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:14:44.584370+0000","last_clean_scrub_stamp":"2024-02-10T08:42:10.195905+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":537,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.625307+0000","last_change":"2024-02-10T08:43:05.469132+0000","last_active":"2024-02-10T08:43:30.625307+0000","last_peered":"2024-02-10T08:43:30.625307+0000","last_clean":"2024-02-10T08:43:30.625307+0000","last_became_active":"2024-02-10T08:41:14.127199+0000","last_became_peered":"2024-02-10T08:41:14.127199+0000","last_unstale":"2024-02-10T08:43:30.625307+0000","last_undegraded":"2024-02-10T08:43:30.625307+0000","last_fullsized":"2024-02-10T08:43:30.625307+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:05.469056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:43:05.469056+0000","last_clean_scrub_stamp":"2024-02-10T08:43:05.469056+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"402'21","reported_seq":108,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.561084+0000","last_change":"2024-02-10T08:42:01.883420+0000","last_active":"2024-02-10T08:43:30.561084+0000","last_peered":"2024-02-10T08:43:30.561084+0000","last_clean":"2024-02-10T08:43:30.561084+0000","last_became_active":"2024-02-10T08:38:40.279148+0000","last_became_peered":"2024-02-10T08:38:40.279148+0000","last_unstale":"2024-02-10T08:43:30.561084+0000","last_undegraded":"2024-02-10T08:43:30.561084+0000","last_fullsized":"2024-02-10T08:43:30.561084+0000","mapping_epoch":428,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":430,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'21","last_scrub_stamp":"2024-02-10T08:42:01.883279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:42:01.883279+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":39,"num_read_kb":28,"num_write":24,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":990,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":549,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.624911+0000","last_change":"2024-02-10T08:43:13.473375+0000","last_active":"2024-02-10T08:43:30.624911+0000","last_peered":"2024-02-10T08:43:30.624911+0000","last_clean":"2024-02-10T08:43:30.624911+0000","last_became_active":"2024-02-10T08:31:33.884021+0000","last_became_peered":"2024-02-10T08:31:33.884021+0000","last_unstale":"2024-02-10T08:43:30.624911+0000","last_undegraded":"2024-02-10T08:43:30.624911+0000","last_fullsized":"2024-02-10T08:43:30.624911+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:13.473263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:11.681169+0000","last_clean_scrub_stamp":"2024-02-10T08:43:13.473263+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"63'5","reported_seq":2099,"reported_epoch":510,"state":"active+clean","last_fresh":"2024-02-10T08:43:31.459315+0000","last_change":"2024-02-10T08:42:22.034760+0000","last_active":"2024-02-10T08:43:31.459315+0000","last_peered":"2024-02-10T08:43:31.459315+0000","last_clean":"2024-02-10T08:43:31.459315+0000","last_became_active":"2024-02-10T08:16:52.780989+0000","last_became_peered":"2024-02-10T08:16:52.780989+0000","last_unstale":"2024-02-10T08:43:31.459315+0000","last_undegraded":"2024-02-10T08:43:31.459315+0000","last_fullsized":"2024-02-10T08:43:31.459315+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'5","last_scrub_stamp":"2024-02-10T08:42:22.034599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:42:22.034599+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1588,"num_read_kb":1583,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":59,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:17.566099+0000","last_change":"2024-02-10T08:43:17.566068+0000","last_active":"2024-02-10T08:43:17.566099+0000","last_peered":"2024-02-10T08:43:17.566099+0000","last_clean":"2024-02-10T08:43:17.566099+0000","last_became_active":"2024-02-10T08:41:14.152451+0000","last_became_peered":"2024-02-10T08:41:14.152451+0000","last_unstale":"2024-02-10T08:43:17.566099+0000","last_undegraded":"2024-02-10T08:43:17.566099+0000","last_fullsized":"2024-02-10T08:43:17.566099+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:17.565965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:11.750537+0000","last_clean_scrub_stamp":"2024-02-10T08:43:17.565965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":118,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.558454+0000","last_change":"2024-02-10T08:42:23.998163+0000","last_active":"2024-02-10T08:43:30.558454+0000","last_peered":"2024-02-10T08:43:30.558454+0000","last_clean":"2024-02-10T08:43:30.558454+0000","last_became_active":"2024-02-10T08:37:45.994472+0000","last_became_peered":"2024-02-10T08:37:45.994472+0000","last_unstale":"2024-02-10T08:43:30.558454+0000","last_undegraded":"2024-02-10T08:43:30.558454+0000","last_fullsized":"2024-02-10T08:43:30.558454+0000","mapping_epoch":411,"log_start":"0'0","ondisk_log_start":"0'0","created":409,"last_epoch_clean":412,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:23.998081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:42:23.998081+0000","last_clean_scrub_stamp":"2024-02-10T08:42:23.998081+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,2],"acting":[5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":213,"reported_epoch":507,"state":"active+clean","last_fresh":"2024-02-10T08:42:49.386985+0000","last_change":"2024-02-10T08:42:38.588489+0000","last_active":"2024-02-10T08:42:49.386985+0000","last_peered":"2024-02-10T08:42:49.386985+0000","last_clean":"2024-02-10T08:42:49.386985+0000","last_became_active":"2024-02-10T08:41:09.780970+0000","last_became_peered":"2024-02-10T08:41:09.780970+0000","last_unstale":"2024-02-10T08:42:49.386985+0000","last_undegraded":"2024-02-10T08:42:49.386985+0000","last_fullsized":"2024-02-10T08:42:49.386985+0000","mapping_epoch":463,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":464,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:38.588377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:42:38.588377+0000","last_clean_scrub_stamp":"2024-02-10T08:42:38.588377+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"506'64","reported_seq":979,"reported_epoch":510,"state":"active+clean","last_fresh":"2024-02-10T08:43:31.142380+0000","last_change":"2024-02-10T08:42:38.010991+0000","last_active":"2024-02-10T08:43:31.142380+0000","last_peered":"2024-02-10T08:43:31.142380+0000","last_clean":"2024-02-10T08:43:31.142380+0000","last_became_active":"2024-02-10T08:31:33.904487+0000","last_became_peered":"2024-02-10T08:31:33.904487+0000","last_unstale":"2024-02-10T08:43:31.142380+0000","last_undegraded":"2024-02-10T08:43:31.142380+0000","last_fullsized":"2024-02-10T08:43:31.142380+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":315,"parent":"0.0","parent_split_bits":0,"last_scrub":"506'64","last_scrub_stamp":"2024-02-10T08:42:38.010924+0000","last_deep_scrub":"506'64","last_deep_scrub_stamp":"2024-02-10T08:42:38.010924+0000","last_clean_scrub_stamp":"2024-02-10T08:42:38.010924+0000","log_size":64,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":84,"num_read_kb":69,"num_write":50,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":716,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":503,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.558960+0000","last_change":"2024-02-10T08:43:15.457331+0000","last_active":"2024-02-10T08:43:30.558960+0000","last_peered":"2024-02-10T08:43:30.558960+0000","last_clean":"2024-02-10T08:43:30.558960+0000","last_became_active":"2024-02-10T08:16:52.791027+0000","last_became_peered":"2024-02-10T08:16:52.791027+0000","last_unstale":"2024-02-10T08:43:30.558960+0000","last_undegraded":"2024-02-10T08:43:30.558960+0000","last_fullsized":"2024-02-10T08:43:30.558960+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:15.457249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:43:15.457249+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":499,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.435511+0000","last_change":"2024-02-10T08:42:53.487582+0000","last_active":"2024-02-10T08:43:30.435511+0000","last_peered":"2024-02-10T08:43:30.435511+0000","last_clean":"2024-02-10T08:43:30.435511+0000","last_became_active":"2024-02-10T08:41:58.158283+0000","last_became_peered":"2024-02-10T08:41:58.158283+0000","last_unstale":"2024-02-10T08:43:30.435511+0000","last_undegraded":"2024-02-10T08:43:30.435511+0000","last_fullsized":"2024-02-10T08:43:30.435511+0000","mapping_epoch":487,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":488,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:53.487498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:42:53.487498+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":461,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.434128+0000","last_change":"2024-02-10T08:42:17.359992+0000","last_active":"2024-02-10T08:43:30.434128+0000","last_peered":"2024-02-10T08:43:30.434128+0000","last_clean":"2024-02-10T08:43:30.434128+0000","last_became_active":"2024-02-10T08:42:14.493616+0000","last_became_peered":"2024-02-10T08:42:14.493616+0000","last_unstale":"2024-02-10T08:43:30.434128+0000","last_undegraded":"2024-02-10T08:43:30.434128+0000","last_fullsized":"2024-02-10T08:43:30.434128+0000","mapping_epoch":494,"log_start":"0'0","ondisk_log_start":"0'0","created":409,"last_epoch_clean":495,"parent":"0.0","parent_split_bits":3,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:17.359872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:14:44.584370+0000","last_clean_scrub_stamp":"2024-02-10T08:42:17.359872+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"255'12","reported_seq":540,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:21.361472+0000","last_change":"2024-02-10T08:42:11.763247+0000","last_active":"2024-02-10T08:43:21.361472+0000","last_peered":"2024-02-10T08:43:21.361472+0000","last_clean":"2024-02-10T08:43:21.361472+0000","last_became_active":"2024-02-10T08:28:25.952468+0000","last_became_peered":"2024-02-10T08:28:25.952468+0000","last_unstale":"2024-02-10T08:43:21.361472+0000","last_undegraded":"2024-02-10T08:43:21.361472+0000","last_fullsized":"2024-02-10T08:43:21.361472+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'12","last_scrub_stamp":"2024-02-10T08:42:11.763162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:42:11.763162+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"402'30","reported_seq":572,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.560728+0000","last_change":"2024-02-10T08:42:32.069085+0000","last_active":"2024-02-10T08:43:30.560728+0000","last_peered":"2024-02-10T08:43:30.560728+0000","last_clean":"2024-02-10T08:43:30.560728+0000","last_became_active":"2024-02-10T08:41:09.780194+0000","last_became_peered":"2024-02-10T08:41:09.780194+0000","last_unstale":"2024-02-10T08:43:30.560728+0000","last_undegraded":"2024-02-10T08:43:30.560728+0000","last_fullsized":"2024-02-10T08:43:30.560728+0000","mapping_epoch":463,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":464,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'30","last_scrub_stamp":"2024-02-10T08:42:32.069005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:42:32.069005+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":45,"num_read_kb":40,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":540,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.560816+0000","last_change":"2024-02-10T08:43:26.041398+0000","last_active":"2024-02-10T08:43:30.560816+0000","last_peered":"2024-02-10T08:43:30.560816+0000","last_clean":"2024-02-10T08:43:30.560816+0000","last_became_active":"2024-02-10T08:41:14.146149+0000","last_became_peered":"2024-02-10T08:41:14.146149+0000","last_unstale":"2024-02-10T08:43:30.560816+0000","last_undegraded":"2024-02-10T08:43:30.560816+0000","last_fullsized":"2024-02-10T08:43:30.560816+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:26.041225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:43:26.041225+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":421,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:42:50.424182+0000","last_change":"2024-02-10T08:42:50.424182+0000","last_active":"2024-02-10T08:42:50.424182+0000","last_peered":"2024-02-10T08:42:50.424182+0000","last_clean":"2024-02-10T08:42:50.424182+0000","last_became_active":"2024-02-10T08:28:25.950240+0000","last_became_peered":"2024-02-10T08:28:25.950240+0000","last_unstale":"2024-02-10T08:42:50.424182+0000","last_undegraded":"2024-02-10T08:42:50.424182+0000","last_fullsized":"2024-02-10T08:42:50.424182+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:50.424110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:42:50.424110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":522,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.624899+0000","last_change":"2024-02-10T08:43:07.528213+0000","last_active":"2024-02-10T08:43:30.624899+0000","last_peered":"2024-02-10T08:43:30.624899+0000","last_clean":"2024-02-10T08:43:30.624899+0000","last_became_active":"2024-02-10T08:28:02.777637+0000","last_became_peered":"2024-02-10T08:28:02.777637+0000","last_unstale":"2024-02-10T08:43:30.624899+0000","last_undegraded":"2024-02-10T08:43:30.624899+0000","last_fullsized":"2024-02-10T08:43:30.624899+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:07.528145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:43:07.528145+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"402'29","reported_seq":564,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.460377+0000","last_change":"2024-02-10T08:42:42.285129+0000","last_active":"2024-02-10T08:43:30.460377+0000","last_peered":"2024-02-10T08:43:30.460377+0000","last_clean":"2024-02-10T08:43:30.460377+0000","last_became_active":"2024-02-10T08:41:09.768760+0000","last_became_peered":"2024-02-10T08:41:09.768760+0000","last_unstale":"2024-02-10T08:43:30.460377+0000","last_undegraded":"2024-02-10T08:43:30.460377+0000","last_fullsized":"2024-02-10T08:43:30.460377+0000","mapping_epoch":463,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":464,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'29","last_scrub_stamp":"2024-02-10T08:42:42.285015+0000","last_deep_scrub":"402'29","last_deep_scrub_stamp":"2024-02-10T08:41:35.095232+0000","last_clean_scrub_stamp":"2024-02-10T08:42:42.285015+0000","log_size":29,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":33,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"55'2","reported_seq":526,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.461158+0000","last_change":"2024-02-10T08:42:27.167411+0000","last_active":"2024-02-10T08:43:30.461158+0000","last_peered":"2024-02-10T08:43:30.461158+0000","last_clean":"2024-02-10T08:43:30.461158+0000","last_became_active":"2024-02-10T08:41:14.138235+0000","last_became_peered":"2024-02-10T08:41:14.138235+0000","last_unstale":"2024-02-10T08:43:30.461158+0000","last_undegraded":"2024-02-10T08:43:30.461158+0000","last_fullsized":"2024-02-10T08:43:30.461158+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'2","last_scrub_stamp":"2024-02-10T08:42:27.167327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:42:27.167327+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":184,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":203,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.435748+0000","last_change":"2024-02-10T08:42:09.579380+0000","last_active":"2024-02-10T08:43:30.435748+0000","last_peered":"2024-02-10T08:43:30.435748+0000","last_clean":"2024-02-10T08:43:30.435748+0000","last_became_active":"2024-02-10T08:41:58.159533+0000","last_became_peered":"2024-02-10T08:41:58.159533+0000","last_unstale":"2024-02-10T08:43:30.435748+0000","last_undegraded":"2024-02-10T08:43:30.435748+0000","last_fullsized":"2024-02-10T08:43:30.435748+0000","mapping_epoch":487,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":488,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:09.579262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:42:09.579262+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"402'21","reported_seq":255,"reported_epoch":507,"state":"active+clean","last_fresh":"2024-02-10T08:42:49.386997+0000","last_change":"2024-02-10T08:42:37.598014+0000","last_active":"2024-02-10T08:42:49.386997+0000","last_peered":"2024-02-10T08:42:49.386997+0000","last_clean":"2024-02-10T08:42:49.386997+0000","last_became_active":"2024-02-10T08:41:14.144203+0000","last_became_peered":"2024-02-10T08:41:14.144203+0000","last_unstale":"2024-02-10T08:42:49.386997+0000","last_undegraded":"2024-02-10T08:42:49.386997+0000","last_fullsized":"2024-02-10T08:42:49.386997+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'21","last_scrub_stamp":"2024-02-10T08:42:37.597915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:42:37.597915+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":33,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"55'1","reported_seq":583,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.624844+0000","last_change":"2024-02-10T08:43:16.418025+0000","last_active":"2024-02-10T08:43:30.624844+0000","last_peered":"2024-02-10T08:43:30.624844+0000","last_clean":"2024-02-10T08:43:30.624844+0000","last_became_active":"2024-02-10T08:28:02.778857+0000","last_became_peered":"2024-02-10T08:28:02.778857+0000","last_unstale":"2024-02-10T08:43:30.624844+0000","last_undegraded":"2024-02-10T08:43:30.624844+0000","last_fullsized":"2024-02-10T08:43:30.624844+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'1","last_scrub_stamp":"2024-02-10T08:43:16.417940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:43:16.417940+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":716,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":446,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.435707+0000","last_change":"2024-02-10T08:42:32.433444+0000","last_active":"2024-02-10T08:43:30.435707+0000","last_peered":"2024-02-10T08:43:30.435707+0000","last_clean":"2024-02-10T08:43:30.435707+0000","last_became_active":"2024-02-10T08:41:58.158549+0000","last_became_peered":"2024-02-10T08:41:58.158549+0000","last_unstale":"2024-02-10T08:43:30.435707+0000","last_undegraded":"2024-02-10T08:43:30.435707+0000","last_fullsized":"2024-02-10T08:43:30.435707+0000","mapping_epoch":487,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":488,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:32.433362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:42:32.433362+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":336,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:28.448514+0000","last_change":"2024-02-10T08:43:28.448514+0000","last_active":"2024-02-10T08:43:28.448514+0000","last_peered":"2024-02-10T08:43:28.448514+0000","last_clean":"2024-02-10T08:43:28.448514+0000","last_became_active":"2024-02-10T08:41:14.138244+0000","last_became_peered":"2024-02-10T08:41:14.138244+0000","last_unstale":"2024-02-10T08:43:28.448514+0000","last_undegraded":"2024-02-10T08:43:28.448514+0000","last_fullsized":"2024-02-10T08:43:28.448514+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:28.448448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:43:28.448448+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"402'21","reported_seq":398,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.435539+0000","last_change":"2024-02-10T08:42:04.456184+0000","last_active":"2024-02-10T08:43:30.435539+0000","last_peered":"2024-02-10T08:43:30.435539+0000","last_clean":"2024-02-10T08:43:30.435539+0000","last_became_active":"2024-02-10T08:41:58.158617+0000","last_became_peered":"2024-02-10T08:41:58.158617+0000","last_unstale":"2024-02-10T08:43:30.435539+0000","last_undegraded":"2024-02-10T08:43:30.435539+0000","last_fullsized":"2024-02-10T08:43:30.435539+0000","mapping_epoch":487,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":488,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'21","last_scrub_stamp":"2024-02-10T08:42:04.456112+0000","last_deep_scrub":"402'21","last_deep_scrub_stamp":"2024-02-10T08:42:04.456112+0000","last_clean_scrub_stamp":"2024-02-10T08:42:04.456112+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":25,"num_read_kb":22,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":583,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.433375+0000","last_change":"2024-02-10T08:42:30.255494+0000","last_active":"2024-02-10T08:43:30.433375+0000","last_peered":"2024-02-10T08:43:30.433375+0000","last_clean":"2024-02-10T08:43:30.433375+0000","last_became_active":"2024-02-10T08:41:09.770380+0000","last_became_peered":"2024-02-10T08:41:09.770380+0000","last_unstale":"2024-02-10T08:43:30.433375+0000","last_undegraded":"2024-02-10T08:43:30.433375+0000","last_fullsized":"2024-02-10T08:43:30.433375+0000","mapping_epoch":463,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":464,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:30.255417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:42:30.255417+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":499,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.559392+0000","last_change":"2024-02-10T08:43:24.525829+0000","last_active":"2024-02-10T08:43:30.559392+0000","last_peered":"2024-02-10T08:43:30.559392+0000","last_clean":"2024-02-10T08:43:30.559392+0000","last_became_active":"2024-02-10T08:16:56.863948+0000","last_became_peered":"2024-02-10T08:16:56.863948+0000","last_unstale":"2024-02-10T08:43:30.559392+0000","last_undegraded":"2024-02-10T08:43:30.559392+0000","last_fullsized":"2024-02-10T08:43:30.559392+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:24.525746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:34:28.320524+0000","last_clean_scrub_stamp":"2024-02-10T08:43:24.525746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":59,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:42:50.597786+0000","last_change":"2024-02-10T08:42:43.386696+0000","last_active":"2024-02-10T08:42:50.597786+0000","last_peered":"2024-02-10T08:42:50.597786+0000","last_clean":"2024-02-10T08:42:50.597786+0000","last_became_active":"2024-02-10T08:41:14.146825+0000","last_became_peered":"2024-02-10T08:41:14.146825+0000","last_unstale":"2024-02-10T08:42:50.597786+0000","last_undegraded":"2024-02-10T08:42:50.597786+0000","last_fullsized":"2024-02-10T08:42:50.597786+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:43.386599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:42:43.386599+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"402'30","reported_seq":379,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.435656+0000","last_change":"2024-02-10T08:42:48.516195+0000","last_active":"2024-02-10T08:43:30.435656+0000","last_peered":"2024-02-10T08:43:30.435656+0000","last_clean":"2024-02-10T08:43:30.435656+0000","last_became_active":"2024-02-10T08:41:58.158898+0000","last_became_peered":"2024-02-10T08:41:58.158898+0000","last_unstale":"2024-02-10T08:43:30.435656+0000","last_undegraded":"2024-02-10T08:43:30.435656+0000","last_fullsized":"2024-02-10T08:43:30.435656+0000","mapping_epoch":487,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":488,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'30","last_scrub_stamp":"2024-02-10T08:42:48.516070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:42:48.516070+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":38,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":523,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.558888+0000","last_change":"2024-02-10T08:42:49.641372+0000","last_active":"2024-02-10T08:43:30.558888+0000","last_peered":"2024-02-10T08:43:30.558888+0000","last_clean":"2024-02-10T08:43:30.558888+0000","last_became_active":"2024-02-10T08:41:14.134210+0000","last_became_peered":"2024-02-10T08:41:14.134210+0000","last_unstale":"2024-02-10T08:43:30.558888+0000","last_undegraded":"2024-02-10T08:43:30.558888+0000","last_fullsized":"2024-02-10T08:43:30.558888+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:49.641262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:42:49.641262+0000","last_clean_scrub_stamp":"2024-02-10T08:42:49.641262+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"244'12","reported_seq":868,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:31.363967+0000","last_change":"2024-02-10T08:42:34.767002+0000","last_active":"2024-02-10T08:43:31.363967+0000","last_peered":"2024-02-10T08:43:31.363967+0000","last_clean":"2024-02-10T08:43:31.363967+0000","last_became_active":"2024-02-10T08:28:02.776097+0000","last_became_peered":"2024-02-10T08:28:02.776097+0000","last_unstale":"2024-02-10T08:43:31.363967+0000","last_undegraded":"2024-02-10T08:43:31.363967+0000","last_fullsized":"2024-02-10T08:43:31.363967+0000","mapping_epoch":243,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"244'12","last_scrub_stamp":"2024-02-10T08:42:34.766873+0000","last_deep_scrub":"244'12","last_deep_scrub_stamp":"2024-02-10T08:35:24.069224+0000","last_clean_scrub_stamp":"2024-02-10T08:42:34.766873+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":231,"reported_epoch":507,"state":"active+clean","last_fresh":"2024-02-10T08:42:49.389191+0000","last_change":"2024-02-10T08:42:49.389169+0000","last_active":"2024-02-10T08:42:49.389191+0000","last_peered":"2024-02-10T08:42:49.389191+0000","last_clean":"2024-02-10T08:42:49.389191+0000","last_became_active":"2024-02-10T08:41:14.139422+0000","last_became_peered":"2024-02-10T08:41:14.139422+0000","last_unstale":"2024-02-10T08:42:49.389191+0000","last_undegraded":"2024-02-10T08:42:49.389191+0000","last_fullsized":"2024-02-10T08:42:49.389191+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:49.389103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:05.662947+0000","last_clean_scrub_stamp":"2024-02-10T08:42:49.389103+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"402'25","reported_seq":577,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.559046+0000","last_change":"2024-02-10T08:42:36.757748+0000","last_active":"2024-02-10T08:43:30.559046+0000","last_peered":"2024-02-10T08:43:30.559046+0000","last_clean":"2024-02-10T08:43:30.559046+0000","last_became_active":"2024-02-10T08:41:14.134235+0000","last_became_peered":"2024-02-10T08:41:14.134235+0000","last_unstale":"2024-02-10T08:43:30.559046+0000","last_undegraded":"2024-02-10T08:43:30.559046+0000","last_fullsized":"2024-02-10T08:43:30.559046+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'25","last_scrub_stamp":"2024-02-10T08:42:36.757633+0000","last_deep_scrub":"213'13","last_deep_scrub_stamp":"2024-02-10T08:25:43.713333+0000","last_clean_scrub_stamp":"2024-02-10T08:42:36.757633+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":208,"reported_epoch":507,"state":"active+clean","last_fresh":"2024-02-10T08:42:49.386625+0000","last_change":"2024-02-10T08:42:21.851068+0000","last_active":"2024-02-10T08:42:49.386625+0000","last_peered":"2024-02-10T08:42:49.386625+0000","last_clean":"2024-02-10T08:42:49.386625+0000","last_became_active":"2024-02-10T08:41:09.780363+0000","last_became_peered":"2024-02-10T08:41:09.780363+0000","last_unstale":"2024-02-10T08:42:49.386625+0000","last_undegraded":"2024-02-10T08:42:49.386625+0000","last_fullsized":"2024-02-10T08:42:49.386625+0000","mapping_epoch":463,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":464,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:21.850973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:42:21.850973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"489'14","reported_seq":387,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:31.363492+0000","last_change":"2024-02-10T08:43:23.390971+0000","last_active":"2024-02-10T08:43:31.363492+0000","last_peered":"2024-02-10T08:43:31.363492+0000","last_clean":"2024-02-10T08:43:31.363492+0000","last_became_active":"2024-02-10T08:41:58.158783+0000","last_became_peered":"2024-02-10T08:41:58.158783+0000","last_unstale":"2024-02-10T08:43:31.363492+0000","last_undegraded":"2024-02-10T08:43:31.363492+0000","last_fullsized":"2024-02-10T08:43:31.363492+0000","mapping_epoch":487,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":488,"parent":"0.0","parent_split_bits":0,"last_scrub":"489'14","last_scrub_stamp":"2024-02-10T08:43:23.390855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:43:23.390855+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":479,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.460834+0000","last_change":"2024-02-10T08:42:33.292863+0000","last_active":"2024-02-10T08:43:30.460834+0000","last_peered":"2024-02-10T08:43:30.460834+0000","last_clean":"2024-02-10T08:43:30.460834+0000","last_became_active":"2024-02-10T08:41:09.768885+0000","last_became_peered":"2024-02-10T08:41:09.768885+0000","last_unstale":"2024-02-10T08:43:30.460834+0000","last_undegraded":"2024-02-10T08:43:30.460834+0000","last_fullsized":"2024-02-10T08:43:30.460834+0000","mapping_epoch":463,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":464,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:33.292739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:42:33.292739+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"402'21","reported_seq":521,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:15.417663+0000","last_change":"2024-02-10T08:43:15.417663+0000","last_active":"2024-02-10T08:43:15.417663+0000","last_peered":"2024-02-10T08:43:15.417663+0000","last_clean":"2024-02-10T08:43:15.417663+0000","last_became_active":"2024-02-10T08:28:25.952354+0000","last_became_peered":"2024-02-10T08:28:25.952354+0000","last_unstale":"2024-02-10T08:43:15.417663+0000","last_undegraded":"2024-02-10T08:43:15.417663+0000","last_fullsized":"2024-02-10T08:43:15.417663+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'21","last_scrub_stamp":"2024-02-10T08:43:15.417595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:43:15.417595+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":34,"num_read_kb":28,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":513,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.433845+0000","last_change":"2024-02-10T08:43:01.417405+0000","last_active":"2024-02-10T08:43:30.433845+0000","last_peered":"2024-02-10T08:43:30.433845+0000","last_clean":"2024-02-10T08:43:30.433845+0000","last_became_active":"2024-02-10T08:16:52.786213+0000","last_became_peered":"2024-02-10T08:16:52.786213+0000","last_unstale":"2024-02-10T08:43:30.433845+0000","last_undegraded":"2024-02-10T08:43:30.433845+0000","last_fullsized":"2024-02-10T08:43:30.433845+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:01.417330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:43:01.417330+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":135,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.435650+0000","last_change":"2024-02-10T08:43:27.417072+0000","last_active":"2024-02-10T08:43:30.435650+0000","last_peered":"2024-02-10T08:43:30.435650+0000","last_clean":"2024-02-10T08:43:30.435650+0000","last_became_active":"2024-02-10T08:41:58.160164+0000","last_became_peered":"2024-02-10T08:41:58.160164+0000","last_unstale":"2024-02-10T08:43:30.435650+0000","last_undegraded":"2024-02-10T08:43:30.435650+0000","last_fullsized":"2024-02-10T08:43:30.435650+0000","mapping_epoch":487,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":488,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:41:46.650962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:33:28.821928+0000","last_clean_scrub_stamp":"2024-02-10T08:41:46.650962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":341,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:26.453379+0000","last_change":"2024-02-10T08:43:26.453379+0000","last_active":"2024-02-10T08:43:26.453379+0000","last_peered":"2024-02-10T08:43:26.453379+0000","last_clean":"2024-02-10T08:43:26.453379+0000","last_became_active":"2024-02-10T08:30:24.070440+0000","last_became_peered":"2024-02-10T08:30:24.070440+0000","last_unstale":"2024-02-10T08:43:26.453379+0000","last_undegraded":"2024-02-10T08:43:26.453379+0000","last_fullsized":"2024-02-10T08:43:26.453379+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:26.453308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:43:26.453308+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"402'32","reported_seq":523,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.460892+0000","last_change":"2024-02-10T08:43:27.280626+0000","last_active":"2024-02-10T08:43:30.460892+0000","last_peered":"2024-02-10T08:43:30.460892+0000","last_clean":"2024-02-10T08:43:30.460892+0000","last_became_active":"2024-02-10T08:41:09.764609+0000","last_became_peered":"2024-02-10T08:41:09.764609+0000","last_unstale":"2024-02-10T08:43:30.460892+0000","last_undegraded":"2024-02-10T08:43:30.460892+0000","last_fullsized":"2024-02-10T08:43:30.460892+0000","mapping_epoch":463,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":464,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'32","last_scrub_stamp":"2024-02-10T08:43:27.280553+0000","last_deep_scrub":"402'32","last_deep_scrub_stamp":"2024-02-10T08:43:27.280553+0000","last_clean_scrub_stamp":"2024-02-10T08:43:27.280553+0000","log_size":32,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":36,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":526,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.561196+0000","last_change":"2024-02-10T08:42:52.081264+0000","last_active":"2024-02-10T08:43:30.561196+0000","last_peered":"2024-02-10T08:43:30.561196+0000","last_clean":"2024-02-10T08:43:30.561196+0000","last_became_active":"2024-02-10T08:32:36.974379+0000","last_became_peered":"2024-02-10T08:32:36.974379+0000","last_unstale":"2024-02-10T08:43:30.561196+0000","last_undegraded":"2024-02-10T08:43:30.561196+0000","last_fullsized":"2024-02-10T08:43:30.561196+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:52.081142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:42:52.081142+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":520,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.560801+0000","last_change":"2024-02-10T08:43:28.129774+0000","last_active":"2024-02-10T08:43:30.560801+0000","last_peered":"2024-02-10T08:43:30.560801+0000","last_clean":"2024-02-10T08:43:30.560801+0000","last_became_active":"2024-02-10T08:31:33.893973+0000","last_became_peered":"2024-02-10T08:31:33.893973+0000","last_unstale":"2024-02-10T08:43:30.560801+0000","last_undegraded":"2024-02-10T08:43:30.560801+0000","last_fullsized":"2024-02-10T08:43:30.560801+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:28.129656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:43:28.129656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":244,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.434966+0000","last_change":"2024-02-10T08:42:30.441263+0000","last_active":"2024-02-10T08:43:30.434966+0000","last_peered":"2024-02-10T08:43:30.434966+0000","last_clean":"2024-02-10T08:43:30.434966+0000","last_became_active":"2024-02-10T08:41:58.349030+0000","last_became_peered":"2024-02-10T08:41:58.349030+0000","last_unstale":"2024-02-10T08:43:30.434966+0000","last_undegraded":"2024-02-10T08:43:30.434966+0000","last_fullsized":"2024-02-10T08:43:30.434966+0000","mapping_epoch":487,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":488,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:30.441183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:42:30.441183+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"402'12","reported_seq":352,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.434972+0000","last_change":"2024-02-10T08:42:55.456358+0000","last_active":"2024-02-10T08:43:30.434972+0000","last_peered":"2024-02-10T08:43:30.434972+0000","last_clean":"2024-02-10T08:43:30.434972+0000","last_became_active":"2024-02-10T08:41:58.162919+0000","last_became_peered":"2024-02-10T08:41:58.162919+0000","last_unstale":"2024-02-10T08:43:30.434972+0000","last_undegraded":"2024-02-10T08:43:30.434972+0000","last_fullsized":"2024-02-10T08:43:30.434972+0000","mapping_epoch":487,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":488,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'12","last_scrub_stamp":"2024-02-10T08:42:55.456260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:42:55.456260+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":510,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.559101+0000","last_change":"2024-02-10T08:43:19.459052+0000","last_active":"2024-02-10T08:43:30.559101+0000","last_peered":"2024-02-10T08:43:30.559101+0000","last_clean":"2024-02-10T08:43:30.559101+0000","last_became_active":"2024-02-10T08:16:52.788704+0000","last_became_peered":"2024-02-10T08:16:52.788704+0000","last_unstale":"2024-02-10T08:43:30.559101+0000","last_undegraded":"2024-02-10T08:43:30.559101+0000","last_fullsized":"2024-02-10T08:43:30.559101+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:19.458979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:43:19.458979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":547,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.433430+0000","last_change":"2024-02-10T08:42:47.474699+0000","last_active":"2024-02-10T08:43:30.433430+0000","last_peered":"2024-02-10T08:43:30.433430+0000","last_clean":"2024-02-10T08:43:30.433430+0000","last_became_active":"2024-02-10T08:41:14.140304+0000","last_became_peered":"2024-02-10T08:41:14.140304+0000","last_unstale":"2024-02-10T08:43:30.433430+0000","last_undegraded":"2024-02-10T08:43:30.433430+0000","last_fullsized":"2024-02-10T08:43:30.433430+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:47.474615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:42:47.474615+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":59,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:14.512102+0000","last_change":"2024-02-10T08:43:14.512070+0000","last_active":"2024-02-10T08:43:14.512102+0000","last_peered":"2024-02-10T08:43:14.512102+0000","last_clean":"2024-02-10T08:43:14.512102+0000","last_became_active":"2024-02-10T08:41:14.143650+0000","last_became_peered":"2024-02-10T08:41:14.143650+0000","last_unstale":"2024-02-10T08:43:14.512102+0000","last_undegraded":"2024-02-10T08:43:14.512102+0000","last_fullsized":"2024-02-10T08:43:14.512102+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:14.511998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:27.276490+0000","last_clean_scrub_stamp":"2024-02-10T08:43:14.511998+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"402'27","reported_seq":377,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.435408+0000","last_change":"2024-02-10T08:42:07.446086+0000","last_active":"2024-02-10T08:43:30.435408+0000","last_peered":"2024-02-10T08:43:30.435408+0000","last_clean":"2024-02-10T08:43:30.435408+0000","last_became_active":"2024-02-10T08:41:58.162479+0000","last_became_peered":"2024-02-10T08:41:58.162479+0000","last_unstale":"2024-02-10T08:43:30.435408+0000","last_undegraded":"2024-02-10T08:43:30.435408+0000","last_fullsized":"2024-02-10T08:43:30.435408+0000","mapping_epoch":487,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":488,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'27","last_scrub_stamp":"2024-02-10T08:42:07.445993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:42:07.445993+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":506,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.434208+0000","last_change":"2024-02-10T08:42:34.339844+0000","last_active":"2024-02-10T08:43:30.434208+0000","last_peered":"2024-02-10T08:43:30.434208+0000","last_clean":"2024-02-10T08:43:30.434208+0000","last_became_active":"2024-02-10T08:16:52.788629+0000","last_became_peered":"2024-02-10T08:16:52.788629+0000","last_unstale":"2024-02-10T08:43:30.434208+0000","last_undegraded":"2024-02-10T08:43:30.434208+0000","last_fullsized":"2024-02-10T08:43:30.434208+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:34.339751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:28:38.360929+0000","last_clean_scrub_stamp":"2024-02-10T08:42:34.339751+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":59,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:13.557723+0000","last_change":"2024-02-10T08:43:13.557697+0000","last_active":"2024-02-10T08:43:13.557723+0000","last_peered":"2024-02-10T08:43:13.557723+0000","last_clean":"2024-02-10T08:43:13.557723+0000","last_became_active":"2024-02-10T08:41:14.143787+0000","last_became_peered":"2024-02-10T08:41:14.143787+0000","last_unstale":"2024-02-10T08:43:13.557723+0000","last_undegraded":"2024-02-10T08:43:13.557723+0000","last_fullsized":"2024-02-10T08:43:13.557723+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:13.557615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:43:13.557615+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":242,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.435398+0000","last_change":"2024-02-10T08:42:15.500798+0000","last_active":"2024-02-10T08:43:30.435398+0000","last_peered":"2024-02-10T08:43:30.435398+0000","last_clean":"2024-02-10T08:43:30.435398+0000","last_became_active":"2024-02-10T08:41:58.162417+0000","last_became_peered":"2024-02-10T08:41:58.162417+0000","last_unstale":"2024-02-10T08:43:30.435398+0000","last_undegraded":"2024-02-10T08:43:30.435398+0000","last_fullsized":"2024-02-10T08:43:30.435398+0000","mapping_epoch":487,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":488,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:15.500710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:34:30.191790+0000","last_clean_scrub_stamp":"2024-02-10T08:42:15.500710+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"402'35","reported_seq":669,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:20.479007+0000","last_change":"2024-02-10T08:43:20.479007+0000","last_active":"2024-02-10T08:43:20.479007+0000","last_peered":"2024-02-10T08:43:20.479007+0000","last_clean":"2024-02-10T08:43:20.479007+0000","last_became_active":"2024-02-10T08:41:14.139949+0000","last_became_peered":"2024-02-10T08:41:14.139949+0000","last_unstale":"2024-02-10T08:43:20.479007+0000","last_undegraded":"2024-02-10T08:43:20.479007+0000","last_fullsized":"2024-02-10T08:43:20.479007+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'35","last_scrub_stamp":"2024-02-10T08:43:20.478928+0000","last_deep_scrub":"225'25","last_deep_scrub_stamp":"2024-02-10T08:36:22.029278+0000","last_clean_scrub_stamp":"2024-02-10T08:43:20.478928+0000","log_size":35,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":39,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":546,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.558555+0000","last_change":"2024-02-10T08:42:03.086378+0000","last_active":"2024-02-10T08:43:30.558555+0000","last_peered":"2024-02-10T08:43:30.558555+0000","last_clean":"2024-02-10T08:43:30.558555+0000","last_became_active":"2024-02-10T08:41:14.144732+0000","last_became_peered":"2024-02-10T08:41:14.144732+0000","last_unstale":"2024-02-10T08:43:30.558555+0000","last_undegraded":"2024-02-10T08:43:30.558555+0000","last_fullsized":"2024-02-10T08:43:30.558555+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:03.086289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:38:19.137643+0000","last_clean_scrub_stamp":"2024-02-10T08:42:03.086289+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1f","version":"468'15","reported_seq":897,"reported_epoch":510,"state":"active+clean","last_fresh":"2024-02-10T08:43:31.666326+0000","last_change":"2024-02-10T08:43:31.666326+0000","last_active":"2024-02-10T08:43:31.666326+0000","last_peered":"2024-02-10T08:43:31.666326+0000","last_clean":"2024-02-10T08:43:31.666326+0000","last_became_active":"2024-02-10T08:41:14.139916+0000","last_became_peered":"2024-02-10T08:41:14.139916+0000","last_unstale":"2024-02-10T08:43:31.666326+0000","last_undegraded":"2024-02-10T08:43:31.666326+0000","last_fullsized":"2024-02-10T08:43:31.666326+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"468'15","last_scrub_stamp":"2024-02-10T08:43:31.666252+0000","last_deep_scrub":"111'11","last_deep_scrub_stamp":"2024-02-10T08:36:26.882513+0000","last_clean_scrub_stamp":"2024-02-10T08:43:31.666252+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"87'2","reported_seq":63,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:42:59.433177+0000","last_change":"2024-02-10T08:42:59.433146+0000","last_active":"2024-02-10T08:42:59.433177+0000","last_peered":"2024-02-10T08:42:59.433177+0000","last_clean":"2024-02-10T08:42:59.433177+0000","last_became_active":"2024-02-10T08:41:14.144294+0000","last_became_peered":"2024-02-10T08:41:14.144294+0000","last_unstale":"2024-02-10T08:42:59.433177+0000","last_undegraded":"2024-02-10T08:42:59.433177+0000","last_fullsized":"2024-02-10T08:42:59.433177+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'2","last_scrub_stamp":"2024-02-10T08:42:59.433064+0000","last_deep_scrub":"87'2","last_deep_scrub_stamp":"2024-02-10T08:19:29.207531+0000","last_clean_scrub_stamp":"2024-02-10T08:42:59.433064+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":369,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"402'27","reported_seq":550,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.434334+0000","last_change":"2024-02-10T08:43:02.401941+0000","last_active":"2024-02-10T08:43:30.434334+0000","last_peered":"2024-02-10T08:43:30.434334+0000","last_clean":"2024-02-10T08:43:30.434334+0000","last_became_active":"2024-02-10T08:16:54.852665+0000","last_became_peered":"2024-02-10T08:16:54.852665+0000","last_unstale":"2024-02-10T08:43:30.434334+0000","last_undegraded":"2024-02-10T08:43:30.434334+0000","last_fullsized":"2024-02-10T08:43:30.434334+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'27","last_scrub_stamp":"2024-02-10T08:43:02.401807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:43:02.401807+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":258,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.435209+0000","last_change":"2024-02-10T08:43:25.434648+0000","last_active":"2024-02-10T08:43:30.435209+0000","last_peered":"2024-02-10T08:43:30.435209+0000","last_clean":"2024-02-10T08:43:30.435209+0000","last_became_active":"2024-02-10T08:41:58.161541+0000","last_became_peered":"2024-02-10T08:41:58.161541+0000","last_unstale":"2024-02-10T08:43:30.435209+0000","last_undegraded":"2024-02-10T08:43:30.435209+0000","last_fullsized":"2024-02-10T08:43:30.435209+0000","mapping_epoch":487,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":488,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:25.434584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:38:17.208888+0000","last_clean_scrub_stamp":"2024-02-10T08:43:25.434584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":350,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:19.455002+0000","last_change":"2024-02-10T08:43:19.455002+0000","last_active":"2024-02-10T08:43:19.455002+0000","last_peered":"2024-02-10T08:43:19.455002+0000","last_clean":"2024-02-10T08:43:19.455002+0000","last_became_active":"2024-02-10T08:41:14.138937+0000","last_became_peered":"2024-02-10T08:41:14.138937+0000","last_unstale":"2024-02-10T08:43:19.455002+0000","last_undegraded":"2024-02-10T08:43:19.455002+0000","last_fullsized":"2024-02-10T08:43:19.455002+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:19.454926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:43:19.454926+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":523,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.560991+0000","last_change":"2024-02-10T08:42:56.083593+0000","last_active":"2024-02-10T08:43:30.560991+0000","last_peered":"2024-02-10T08:43:30.560991+0000","last_clean":"2024-02-10T08:43:30.560991+0000","last_became_active":"2024-02-10T08:41:09.772464+0000","last_became_peered":"2024-02-10T08:41:09.772464+0000","last_unstale":"2024-02-10T08:43:30.560991+0000","last_undegraded":"2024-02-10T08:43:30.560991+0000","last_fullsized":"2024-02-10T08:43:30.560991+0000","mapping_epoch":463,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":464,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:56.083414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:22.104988+0000","last_clean_scrub_stamp":"2024-02-10T08:42:56.083414+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"402'46","reported_seq":629,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.625381+0000","last_change":"2024-02-10T08:42:45.477977+0000","last_active":"2024-02-10T08:43:30.625381+0000","last_peered":"2024-02-10T08:43:30.625381+0000","last_clean":"2024-02-10T08:43:30.625381+0000","last_became_active":"2024-02-10T08:31:33.894960+0000","last_became_peered":"2024-02-10T08:31:33.894960+0000","last_unstale":"2024-02-10T08:43:30.625381+0000","last_undegraded":"2024-02-10T08:43:30.625381+0000","last_fullsized":"2024-02-10T08:43:30.625381+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'46","last_scrub_stamp":"2024-02-10T08:42:45.477897+0000","last_deep_scrub":"402'46","last_deep_scrub_stamp":"2024-02-10T08:42:45.477897+0000","last_clean_scrub_stamp":"2024-02-10T08:42:45.477897+0000","log_size":46,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":62,"num_read_kb":53,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":554,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.433771+0000","last_change":"2024-02-10T08:42:54.449812+0000","last_active":"2024-02-10T08:43:30.433771+0000","last_peered":"2024-02-10T08:43:30.433771+0000","last_clean":"2024-02-10T08:43:30.433771+0000","last_became_active":"2024-02-10T08:41:14.139702+0000","last_became_peered":"2024-02-10T08:41:14.139702+0000","last_unstale":"2024-02-10T08:43:30.433771+0000","last_undegraded":"2024-02-10T08:43:30.433771+0000","last_fullsized":"2024-02-10T08:43:30.433771+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:54.449731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:19:10.370746+0000","last_clean_scrub_stamp":"2024-02-10T08:42:54.449731+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":543,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.561315+0000","last_change":"2024-02-10T08:42:41.988675+0000","last_active":"2024-02-10T08:43:30.561315+0000","last_peered":"2024-02-10T08:43:30.561315+0000","last_clean":"2024-02-10T08:43:30.561315+0000","last_became_active":"2024-02-10T08:41:09.778738+0000","last_became_peered":"2024-02-10T08:41:09.778738+0000","last_unstale":"2024-02-10T08:43:30.561315+0000","last_undegraded":"2024-02-10T08:43:30.561315+0000","last_fullsized":"2024-02-10T08:43:30.561315+0000","mapping_epoch":463,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":464,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:41.988547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:42:41.988547+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":459,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.461049+0000","last_change":"2024-02-10T08:42:35.287823+0000","last_active":"2024-02-10T08:43:30.461049+0000","last_peered":"2024-02-10T08:43:30.461049+0000","last_clean":"2024-02-10T08:43:30.461049+0000","last_became_active":"2024-02-10T08:41:09.778599+0000","last_became_peered":"2024-02-10T08:41:09.778599+0000","last_unstale":"2024-02-10T08:43:30.461049+0000","last_undegraded":"2024-02-10T08:43:30.461049+0000","last_fullsized":"2024-02-10T08:43:30.461049+0000","mapping_epoch":463,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":464,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:35.287737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:41:10.223116+0000","last_clean_scrub_stamp":"2024-02-10T08:42:35.287737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"402'29","reported_seq":437,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.435879+0000","last_change":"2024-02-10T08:42:01.506341+0000","last_active":"2024-02-10T08:43:30.435879+0000","last_peered":"2024-02-10T08:43:30.435879+0000","last_clean":"2024-02-10T08:43:30.435879+0000","last_became_active":"2024-02-10T08:41:58.159269+0000","last_became_peered":"2024-02-10T08:41:58.159269+0000","last_unstale":"2024-02-10T08:43:30.435879+0000","last_undegraded":"2024-02-10T08:43:30.435879+0000","last_fullsized":"2024-02-10T08:43:30.435879+0000","mapping_epoch":487,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":488,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'29","last_scrub_stamp":"2024-02-10T08:42:01.506258+0000","last_deep_scrub":"402'29","last_deep_scrub_stamp":"2024-02-10T08:38:18.298261+0000","last_clean_scrub_stamp":"2024-02-10T08:42:01.506258+0000","log_size":29,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":33,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":250,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.435279+0000","last_change":"2024-02-10T08:42:54.464370+0000","last_active":"2024-02-10T08:43:30.435279+0000","last_peered":"2024-02-10T08:43:30.435279+0000","last_clean":"2024-02-10T08:43:30.435279+0000","last_became_active":"2024-02-10T08:41:58.162916+0000","last_became_peered":"2024-02-10T08:41:58.162916+0000","last_unstale":"2024-02-10T08:43:30.435279+0000","last_undegraded":"2024-02-10T08:43:30.435279+0000","last_fullsized":"2024-02-10T08:43:30.435279+0000","mapping_epoch":487,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":488,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:54.464304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:42:54.464304+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":471,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.460739+0000","last_change":"2024-02-10T08:42:58.188949+0000","last_active":"2024-02-10T08:43:30.460739+0000","last_peered":"2024-02-10T08:43:30.460739+0000","last_clean":"2024-02-10T08:43:30.460739+0000","last_became_active":"2024-02-10T08:41:09.768049+0000","last_became_peered":"2024-02-10T08:41:09.768049+0000","last_unstale":"2024-02-10T08:43:30.460739+0000","last_undegraded":"2024-02-10T08:43:30.460739+0000","last_fullsized":"2024-02-10T08:43:30.460739+0000","mapping_epoch":463,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":464,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:58.188859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:37:17.819656+0000","last_clean_scrub_stamp":"2024-02-10T08:42:58.188859+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":131,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.435683+0000","last_change":"2024-02-10T08:42:38.699658+0000","last_active":"2024-02-10T08:43:30.435683+0000","last_peered":"2024-02-10T08:43:30.435683+0000","last_clean":"2024-02-10T08:43:30.435683+0000","last_became_active":"2024-02-10T08:41:58.349411+0000","last_became_peered":"2024-02-10T08:41:58.349411+0000","last_unstale":"2024-02-10T08:43:30.435683+0000","last_undegraded":"2024-02-10T08:43:30.435683+0000","last_fullsized":"2024-02-10T08:43:30.435683+0000","mapping_epoch":487,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":488,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:38.699567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:42:38.699567+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"402'21","reported_seq":233,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.460801+0000","last_change":"2024-02-10T08:42:56.205042+0000","last_active":"2024-02-10T08:43:30.460801+0000","last_peered":"2024-02-10T08:43:30.460801+0000","last_clean":"2024-02-10T08:43:30.460801+0000","last_became_active":"2024-02-10T08:41:09.774607+0000","last_became_peered":"2024-02-10T08:41:09.774607+0000","last_unstale":"2024-02-10T08:43:30.460801+0000","last_undegraded":"2024-02-10T08:43:30.460801+0000","last_fullsized":"2024-02-10T08:43:30.460801+0000","mapping_epoch":463,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":464,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'21","last_scrub_stamp":"2024-02-10T08:42:56.204920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:42:56.204920+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":33,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":59,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:42:50.597594+0000","last_change":"2024-02-10T08:42:50.383316+0000","last_active":"2024-02-10T08:42:50.597594+0000","last_peered":"2024-02-10T08:42:50.597594+0000","last_clean":"2024-02-10T08:42:50.597594+0000","last_became_active":"2024-02-10T08:41:14.145688+0000","last_became_peered":"2024-02-10T08:41:14.145688+0000","last_unstale":"2024-02-10T08:42:50.597594+0000","last_undegraded":"2024-02-10T08:42:50.597594+0000","last_fullsized":"2024-02-10T08:42:50.597594+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:50.383232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:28.028556+0000","last_clean_scrub_stamp":"2024-02-10T08:42:50.383232+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":570,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.559097+0000","last_change":"2024-02-10T08:43:28.532083+0000","last_active":"2024-02-10T08:43:30.559097+0000","last_peered":"2024-02-10T08:43:30.559097+0000","last_clean":"2024-02-10T08:43:30.559097+0000","last_became_active":"2024-02-10T08:41:14.134827+0000","last_became_peered":"2024-02-10T08:41:14.134827+0000","last_unstale":"2024-02-10T08:43:30.559097+0000","last_undegraded":"2024-02-10T08:43:30.559097+0000","last_fullsized":"2024-02-10T08:43:30.559097+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:28.532010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:38:18.192551+0000","last_clean_scrub_stamp":"2024-02-10T08:43:28.532010+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,7],"acting":[5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":221,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:24.504818+0000","last_change":"2024-02-10T08:43:24.504818+0000","last_active":"2024-02-10T08:43:24.504818+0000","last_peered":"2024-02-10T08:43:24.504818+0000","last_clean":"2024-02-10T08:43:24.504818+0000","last_became_active":"2024-02-10T08:41:14.144501+0000","last_became_peered":"2024-02-10T08:41:14.144501+0000","last_unstale":"2024-02-10T08:43:24.504818+0000","last_undegraded":"2024-02-10T08:43:24.504818+0000","last_fullsized":"2024-02-10T08:43:24.504818+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:24.504737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:38:19.438174+0000","last_clean_scrub_stamp":"2024-02-10T08:43:24.504737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"402'9","reported_seq":529,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.460464+0000","last_change":"2024-02-10T08:43:18.305509+0000","last_active":"2024-02-10T08:43:30.460464+0000","last_peered":"2024-02-10T08:43:30.460464+0000","last_clean":"2024-02-10T08:43:30.460464+0000","last_became_active":"2024-02-10T08:41:09.769130+0000","last_became_peered":"2024-02-10T08:41:09.769130+0000","last_unstale":"2024-02-10T08:43:30.460464+0000","last_undegraded":"2024-02-10T08:43:30.460464+0000","last_fullsized":"2024-02-10T08:43:30.460464+0000","mapping_epoch":463,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":464,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'9","last_scrub_stamp":"2024-02-10T08:43:18.305429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:43:18.305429+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"55'1","reported_seq":63,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:42:50.597758+0000","last_change":"2024-02-10T08:42:42.339353+0000","last_active":"2024-02-10T08:42:50.597758+0000","last_peered":"2024-02-10T08:42:50.597758+0000","last_clean":"2024-02-10T08:42:50.597758+0000","last_became_active":"2024-02-10T08:41:14.153116+0000","last_became_peered":"2024-02-10T08:41:14.153116+0000","last_unstale":"2024-02-10T08:42:50.597758+0000","last_undegraded":"2024-02-10T08:42:50.597758+0000","last_fullsized":"2024-02-10T08:42:50.597758+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'1","last_scrub_stamp":"2024-02-10T08:42:42.339274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:42:42.339274+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1746,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":59,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:42:50.597199+0000","last_change":"2024-02-10T08:42:47.372696+0000","last_active":"2024-02-10T08:42:50.597199+0000","last_peered":"2024-02-10T08:42:50.597199+0000","last_clean":"2024-02-10T08:42:50.597199+0000","last_became_active":"2024-02-10T08:41:14.144814+0000","last_became_peered":"2024-02-10T08:41:14.144814+0000","last_unstale":"2024-02-10T08:42:50.597199+0000","last_undegraded":"2024-02-10T08:42:50.597199+0000","last_fullsized":"2024-02-10T08:42:50.597199+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:47.372619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:42:47.372619+0000","last_clean_scrub_stamp":"2024-02-10T08:42:47.372619+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":515,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.581272+0000","last_change":"2024-02-10T08:43:30.581245+0000","last_active":"2024-02-10T08:43:30.581272+0000","last_peered":"2024-02-10T08:43:30.581272+0000","last_clean":"2024-02-10T08:43:30.581272+0000","last_became_active":"2024-02-10T08:31:33.886617+0000","last_became_peered":"2024-02-10T08:31:33.886617+0000","last_unstale":"2024-02-10T08:43:30.581272+0000","last_undegraded":"2024-02-10T08:43:30.581272+0000","last_fullsized":"2024-02-10T08:43:30.581272+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:30.581140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:34:34.307158+0000","last_clean_scrub_stamp":"2024-02-10T08:43:30.581140+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"401'25","reported_seq":504,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.460098+0000","last_change":"2024-02-10T08:43:08.201329+0000","last_active":"2024-02-10T08:43:30.460098+0000","last_peered":"2024-02-10T08:43:30.460098+0000","last_clean":"2024-02-10T08:43:30.460098+0000","last_became_active":"2024-02-10T08:41:09.766209+0000","last_became_peered":"2024-02-10T08:41:09.766209+0000","last_unstale":"2024-02-10T08:43:30.460098+0000","last_undegraded":"2024-02-10T08:43:30.460098+0000","last_fullsized":"2024-02-10T08:43:30.460098+0000","mapping_epoch":463,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":464,"parent":"0.0","parent_split_bits":0,"last_scrub":"401'25","last_scrub_stamp":"2024-02-10T08:43:08.201250+0000","last_deep_scrub":"358'19","last_deep_scrub_stamp":"2024-02-10T08:33:34.450897+0000","last_clean_scrub_stamp":"2024-02-10T08:43:08.201250+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":33,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":142,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.435802+0000","last_change":"2024-02-10T08:41:58.482893+0000","last_active":"2024-02-10T08:43:30.435802+0000","last_peered":"2024-02-10T08:43:30.435802+0000","last_clean":"2024-02-10T08:43:30.435802+0000","last_became_active":"2024-02-10T08:41:58.348553+0000","last_became_peered":"2024-02-10T08:41:58.348553+0000","last_unstale":"2024-02-10T08:43:30.435802+0000","last_undegraded":"2024-02-10T08:43:30.435802+0000","last_fullsized":"2024-02-10T08:43:30.435802+0000","mapping_epoch":487,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":488,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:41:58.482819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:38:08.296391+0000","last_clean_scrub_stamp":"2024-02-10T08:41:58.482819+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":518,"reported_epoch":510,"state":"active+clean","last_fresh":"2024-02-10T08:43:32.148571+0000","last_change":"2024-02-10T08:43:32.148571+0000","last_active":"2024-02-10T08:43:32.148571+0000","last_peered":"2024-02-10T08:43:32.148571+0000","last_clean":"2024-02-10T08:43:32.148571+0000","last_became_active":"2024-02-10T08:41:14.138755+0000","last_became_peered":"2024-02-10T08:41:14.138755+0000","last_unstale":"2024-02-10T08:43:32.148571+0000","last_undegraded":"2024-02-10T08:43:32.148571+0000","last_fullsized":"2024-02-10T08:43:32.148571+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:32.148465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:55.840727+0000","last_clean_scrub_stamp":"2024-02-10T08:43:32.148465+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":474,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.460360+0000","last_change":"2024-02-10T08:43:04.175762+0000","last_active":"2024-02-10T08:43:30.460360+0000","last_peered":"2024-02-10T08:43:30.460360+0000","last_clean":"2024-02-10T08:43:30.460360+0000","last_became_active":"2024-02-10T08:41:09.768675+0000","last_became_peered":"2024-02-10T08:41:09.768675+0000","last_unstale":"2024-02-10T08:43:30.460360+0000","last_undegraded":"2024-02-10T08:43:30.460360+0000","last_fullsized":"2024-02-10T08:43:30.460360+0000","mapping_epoch":463,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":464,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:04.175683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:41:21.221088+0000","last_clean_scrub_stamp":"2024-02-10T08:43:04.175683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"402'39","reported_seq":500,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.435183+0000","last_change":"2024-02-10T08:43:00.449330+0000","last_active":"2024-02-10T08:43:30.435183+0000","last_peered":"2024-02-10T08:43:30.435183+0000","last_clean":"2024-02-10T08:43:30.435183+0000","last_became_active":"2024-02-10T08:41:58.161122+0000","last_became_peered":"2024-02-10T08:41:58.161122+0000","last_unstale":"2024-02-10T08:43:30.435183+0000","last_undegraded":"2024-02-10T08:43:30.435183+0000","last_fullsized":"2024-02-10T08:43:30.435183+0000","mapping_epoch":487,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":488,"parent":"0.0","parent_split_bits":0,"last_scrub":"402'39","last_scrub_stamp":"2024-02-10T08:43:00.449258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:53.828612+0000","last_clean_scrub_stamp":"2024-02-10T08:43:00.449258+0000","log_size":39,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":60,"num_read_kb":51,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":231,"reported_epoch":507,"state":"active+clean","last_fresh":"2024-02-10T08:42:49.387182+0000","last_change":"2024-02-10T08:42:27.758913+0000","last_active":"2024-02-10T08:42:49.387182+0000","last_peered":"2024-02-10T08:42:49.387182+0000","last_clean":"2024-02-10T08:42:49.387182+0000","last_became_active":"2024-02-10T08:41:14.137598+0000","last_became_peered":"2024-02-10T08:41:14.137598+0000","last_unstale":"2024-02-10T08:42:49.387182+0000","last_undegraded":"2024-02-10T08:42:49.387182+0000","last_fullsized":"2024-02-10T08:42:49.387182+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:27.758844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:51.763243+0000","last_clean_scrub_stamp":"2024-02-10T08:42:27.758844+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":204,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.460306+0000","last_change":"2024-02-10T08:42:23.080794+0000","last_active":"2024-02-10T08:43:30.460306+0000","last_peered":"2024-02-10T08:43:30.460306+0000","last_clean":"2024-02-10T08:43:30.460306+0000","last_became_active":"2024-02-10T08:41:09.765898+0000","last_became_peered":"2024-02-10T08:41:09.765898+0000","last_unstale":"2024-02-10T08:43:30.460306+0000","last_undegraded":"2024-02-10T08:43:30.460306+0000","last_fullsized":"2024-02-10T08:43:30.460306+0000","mapping_epoch":463,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":464,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:23.080716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:36:24.205221+0000","last_clean_scrub_stamp":"2024-02-10T08:42:23.080716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":243,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.435176+0000","last_change":"2024-02-10T08:43:09.515056+0000","last_active":"2024-02-10T08:43:30.435176+0000","last_peered":"2024-02-10T08:43:30.435176+0000","last_clean":"2024-02-10T08:43:30.435176+0000","last_became_active":"2024-02-10T08:41:58.163294+0000","last_became_peered":"2024-02-10T08:41:58.163294+0000","last_unstale":"2024-02-10T08:43:30.435176+0000","last_undegraded":"2024-02-10T08:43:30.435176+0000","last_fullsized":"2024-02-10T08:43:30.435176+0000","mapping_epoch":487,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":488,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:09.514954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:35:19.525667+0000","last_clean_scrub_stamp":"2024-02-10T08:43:09.514954+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":434,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:31.114961+0000","last_change":"2024-02-10T08:43:31.114932+0000","last_active":"2024-02-10T08:43:31.114961+0000","last_peered":"2024-02-10T08:43:31.114961+0000","last_clean":"2024-02-10T08:43:31.114961+0000","last_became_active":"2024-02-10T08:41:14.147171+0000","last_became_peered":"2024-02-10T08:41:14.147171+0000","last_unstale":"2024-02-10T08:43:31.114961+0000","last_undegraded":"2024-02-10T08:43:31.114961+0000","last_fullsized":"2024-02-10T08:43:31.114961+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:31.114798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:36:19.772116+0000","last_clean_scrub_stamp":"2024-02-10T08:43:31.114798+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,7],"acting":[1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":54,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:42:50.596650+0000","last_change":"2024-02-10T08:42:30.284330+0000","last_active":"2024-02-10T08:42:50.596650+0000","last_peered":"2024-02-10T08:42:50.596650+0000","last_clean":"2024-02-10T08:42:50.596650+0000","last_became_active":"2024-02-10T08:41:14.138576+0000","last_became_peered":"2024-02-10T08:41:14.138576+0000","last_unstale":"2024-02-10T08:42:50.596650+0000","last_undegraded":"2024-02-10T08:42:50.596650+0000","last_fullsized":"2024-02-10T08:42:50.596650+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:30.284251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:42:30.284251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":416,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.433481+0000","last_change":"2024-02-10T08:42:24.352424+0000","last_active":"2024-02-10T08:43:30.433481+0000","last_peered":"2024-02-10T08:43:30.433481+0000","last_clean":"2024-02-10T08:43:30.433481+0000","last_became_active":"2024-02-10T08:22:00.600200+0000","last_became_peered":"2024-02-10T08:22:00.600200+0000","last_unstale":"2024-02-10T08:43:30.433481+0000","last_undegraded":"2024-02-10T08:43:30.433481+0000","last_fullsized":"2024-02-10T08:43:30.433481+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:24.352300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:42:24.352300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1],"acting":[6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":416,"reported_epoch":507,"state":"active+clean","last_fresh":"2024-02-10T08:42:49.386734+0000","last_change":"2024-02-10T08:42:31.751106+0000","last_active":"2024-02-10T08:42:49.386734+0000","last_peered":"2024-02-10T08:42:49.386734+0000","last_clean":"2024-02-10T08:42:49.386734+0000","last_became_active":"2024-02-10T08:41:09.785026+0000","last_became_peered":"2024-02-10T08:41:09.785026+0000","last_unstale":"2024-02-10T08:42:49.386734+0000","last_undegraded":"2024-02-10T08:42:49.386734+0000","last_fullsized":"2024-02-10T08:42:49.386734+0000","mapping_epoch":463,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":464,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:31.751012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:42:31.751012+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":525,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.558767+0000","last_change":"2024-02-10T08:43:07.547211+0000","last_active":"2024-02-10T08:43:30.558767+0000","last_peered":"2024-02-10T08:43:30.558767+0000","last_clean":"2024-02-10T08:43:30.558767+0000","last_became_active":"2024-02-10T08:31:33.879440+0000","last_became_peered":"2024-02-10T08:31:33.879440+0000","last_unstale":"2024-02-10T08:43:30.558767+0000","last_undegraded":"2024-02-10T08:43:30.558767+0000","last_fullsized":"2024-02-10T08:43:30.558767+0000","mapping_epoch":313,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":314,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:07.547113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:43:07.547113+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":529,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.434043+0000","last_change":"2024-02-10T08:43:18.515856+0000","last_active":"2024-02-10T08:43:30.434043+0000","last_peered":"2024-02-10T08:43:30.434043+0000","last_clean":"2024-02-10T08:43:30.434043+0000","last_became_active":"2024-02-10T08:27:27.710587+0000","last_became_peered":"2024-02-10T08:27:27.710587+0000","last_unstale":"2024-02-10T08:43:30.434043+0000","last_undegraded":"2024-02-10T08:43:30.434043+0000","last_fullsized":"2024-02-10T08:43:30.434043+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:18.515751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:18:11.750537+0000","last_clean_scrub_stamp":"2024-02-10T08:43:18.515751+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,1],"acting":[6,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":429,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.560982+0000","last_change":"2024-02-10T08:42:30.088064+0000","last_active":"2024-02-10T08:43:30.560982+0000","last_peered":"2024-02-10T08:43:30.560982+0000","last_clean":"2024-02-10T08:43:30.560982+0000","last_became_active":"2024-02-10T08:32:36.974142+0000","last_became_peered":"2024-02-10T08:32:36.974142+0000","last_unstale":"2024-02-10T08:43:30.560982+0000","last_undegraded":"2024-02-10T08:43:30.560982+0000","last_fullsized":"2024-02-10T08:43:30.560982+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:30.087838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:36:22.783769+0000","last_clean_scrub_stamp":"2024-02-10T08:42:30.087838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":432,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.434156+0000","last_change":"2024-02-10T08:42:14.513300+0000","last_active":"2024-02-10T08:43:30.434156+0000","last_peered":"2024-02-10T08:43:30.434156+0000","last_clean":"2024-02-10T08:43:30.434156+0000","last_became_active":"2024-02-10T08:32:36.979412+0000","last_became_peered":"2024-02-10T08:32:36.979412+0000","last_unstale":"2024-02-10T08:43:30.434156+0000","last_undegraded":"2024-02-10T08:43:30.434156+0000","last_fullsized":"2024-02-10T08:43:30.434156+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:14.513235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:42:14.513235+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1],"acting":[6,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":528,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.624730+0000","last_change":"2024-02-10T08:42:52.420077+0000","last_active":"2024-02-10T08:43:30.624730+0000","last_peered":"2024-02-10T08:43:30.624730+0000","last_clean":"2024-02-10T08:43:30.624730+0000","last_became_active":"2024-02-10T08:41:14.149774+0000","last_became_peered":"2024-02-10T08:41:14.149774+0000","last_unstale":"2024-02-10T08:43:30.624730+0000","last_undegraded":"2024-02-10T08:43:30.624730+0000","last_fullsized":"2024-02-10T08:43:30.624730+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:52.419992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:42:52.419992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,6],"acting":[2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.29","version":"76'2","reported_seq":63,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:43:16.523603+0000","last_change":"2024-02-10T08:43:16.523557+0000","last_active":"2024-02-10T08:43:16.523603+0000","last_peered":"2024-02-10T08:43:16.523603+0000","last_clean":"2024-02-10T08:43:16.523603+0000","last_became_active":"2024-02-10T08:41:14.144310+0000","last_became_peered":"2024-02-10T08:41:14.144310+0000","last_unstale":"2024-02-10T08:43:16.523603+0000","last_undegraded":"2024-02-10T08:43:16.523603+0000","last_fullsized":"2024-02-10T08:43:16.523603+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":6,"last_scrub":"76'2","last_scrub_stamp":"2024-02-10T08:43:16.523476+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2024-02-10T08:42:13.289093+0000","last_clean_scrub_stamp":"2024-02-10T08:43:16.523476+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,0],"acting":[7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":227,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.460724+0000","last_change":"2024-02-10T08:43:26.294163+0000","last_active":"2024-02-10T08:43:30.460724+0000","last_peered":"2024-02-10T08:43:30.460724+0000","last_clean":"2024-02-10T08:43:30.460724+0000","last_became_active":"2024-02-10T08:41:09.775029+0000","last_became_peered":"2024-02-10T08:41:09.775029+0000","last_unstale":"2024-02-10T08:43:30.460724+0000","last_undegraded":"2024-02-10T08:43:30.460724+0000","last_fullsized":"2024-02-10T08:43:30.460724+0000","mapping_epoch":463,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":464,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:26.294085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:42:07.989266+0000","last_clean_scrub_stamp":"2024-02-10T08:43:26.294085+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0],"acting":[4,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":268,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.558677+0000","last_change":"2024-02-10T08:43:29.607898+0000","last_active":"2024-02-10T08:43:30.558677+0000","last_peered":"2024-02-10T08:43:30.558677+0000","last_clean":"2024-02-10T08:43:30.558677+0000","last_became_active":"2024-02-10T08:41:14.136120+0000","last_became_peered":"2024-02-10T08:41:14.136120+0000","last_unstale":"2024-02-10T08:43:30.558677+0000","last_undegraded":"2024-02-10T08:43:30.558677+0000","last_fullsized":"2024-02-10T08:43:30.558677+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:29.607811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:43:29.607811+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":303,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.433614+0000","last_change":"2024-02-10T08:42:23.304112+0000","last_active":"2024-02-10T08:43:30.433614+0000","last_peered":"2024-02-10T08:43:30.433614+0000","last_clean":"2024-02-10T08:43:30.433614+0000","last_became_active":"2024-02-10T08:42:14.492602+0000","last_became_peered":"2024-02-10T08:42:14.492602+0000","last_unstale":"2024-02-10T08:43:30.433614+0000","last_undegraded":"2024-02-10T08:43:30.433614+0000","last_fullsized":"2024-02-10T08:43:30.433614+0000","mapping_epoch":494,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":495,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:23.304038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:20:30.227375+0000","last_clean_scrub_stamp":"2024-02-10T08:42:23.304038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,5],"acting":[6,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":521,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.625222+0000","last_change":"2024-02-10T08:42:30.664465+0000","last_active":"2024-02-10T08:43:30.625222+0000","last_peered":"2024-02-10T08:43:30.625222+0000","last_clean":"2024-02-10T08:43:30.625222+0000","last_became_active":"2024-02-10T08:30:26.085360+0000","last_became_peered":"2024-02-10T08:30:26.085360+0000","last_unstale":"2024-02-10T08:43:30.625222+0000","last_undegraded":"2024-02-10T08:43:30.625222+0000","last_fullsized":"2024-02-10T08:43:30.625222+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:30.664364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:42:30.664364+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,5],"acting":[2,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":286,"reported_epoch":509,"state":"active+clean","last_fresh":"2024-02-10T08:43:30.433890+0000","last_change":"2024-02-10T08:42:53.426254+0000","last_active":"2024-02-10T08:43:30.433890+0000","last_peered":"2024-02-10T08:43:30.433890+0000","last_clean":"2024-02-10T08:43:30.433890+0000","last_became_active":"2024-02-10T08:41:14.140334+0000","last_became_peered":"2024-02-10T08:41:14.140334+0000","last_unstale":"2024-02-10T08:43:30.433890+0000","last_undegraded":"2024-02-10T08:43:30.433890+0000","last_fullsized":"2024-02-10T08:43:30.433890+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:53.426162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:38:11.227477+0000","last_clean_scrub_stamp":"2024-02-10T08:42:53.426162+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":54,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:42:50.598088+0000","last_change":"2024-02-10T08:42:22.329683+0000","last_active":"2024-02-10T08:42:50.598088+0000","last_peered":"2024-02-10T08:42:50.598088+0000","last_clean":"2024-02-10T08:42:50.598088+0000","last_became_active":"2024-02-10T08:41:14.144098+0000","last_became_peered":"2024-02-10T08:41:14.144098+0000","last_unstale":"2024-02-10T08:42:50.598088+0000","last_undegraded":"2024-02-10T08:42:50.598088+0000","last_fullsized":"2024-02-10T08:42:50.598088+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:22.329600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:38:08.045526+0000","last_clean_scrub_stamp":"2024-02-10T08:42:22.329600+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":54,"reported_epoch":508,"state":"active+clean","last_fresh":"2024-02-10T08:42:50.597007+0000","last_change":"2024-02-10T08:42:20.256259+0000","last_active":"2024-02-10T08:42:50.597007+0000","last_peered":"2024-02-10T08:42:50.597007+0000","last_clean":"2024-02-10T08:42:50.597007+0000","last_became_active":"2024-02-10T08:41:14.150890+0000","last_became_peered":"2024-02-10T08:41:14.150890+0000","last_unstale":"2024-02-10T08:42:50.597007+0000","last_undegraded":"2024-02-10T08:42:50.597007+0000","last_fullsized":"2024-02-10T08:42:50.597007+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:42:20.256170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:36:14.408305+0000","last_clean_scrub_stamp":"2024-02-10T08:42:20.256170+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1],"acting":[7,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":450,"reported_epoch":510,"state":"active+clean","last_fresh":"2024-02-10T08:43:31.539957+0000","last_change":"2024-02-10T08:43:31.539957+0000","last_active":"2024-02-10T08:43:31.539957+0000","last_peered":"2024-02-10T08:43:31.539957+0000","last_clean":"2024-02-10T08:43:31.539957+0000","last_became_active":"2024-02-10T08:41:14.133669+0000","last_became_peered":"2024-02-10T08:41:14.133669+0000","last_unstale":"2024-02-10T08:43:31.539957+0000","last_undegraded":"2024-02-10T08:43:31.539957+0000","last_fullsized":"2024-02-10T08:43:31.539957+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":287,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":6,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:43:31.539860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:16:57.845780+0000","last_clean_scrub_stamp":"2024-02-10T08:43:31.539860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2646,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":11,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":33,"acting":33,"num_store_stats":8},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1588,"num_read_kb":1583,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":9,"acting":9,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":1517,"num_read_kb":1274,"num_write":989,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":305,"num_bytes_recovered":7404,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1061,"ondisk_log_size":1061,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":96,"acting":96,"num_store_stats":8},{"poolid":6,"num_pg":52,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":369,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":156,"acting":156,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":446,"seq":1915555414062,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":461172,"kb_used_data":104172,"kb_used_omap":264,"kb_used_meta":356727,"kb_avail":93283980,"statfs":{"total":95995035648,"available":95522795520,"internally_reserved":0,"allocated":106672128,"data_stored":106093544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":270834,"internal_metadata":365288974},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:43:02 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":1.1279999999999999,"15min":1.3959999999999999},"min":{"1min":0.30199999999999999,"5min":0.245,"15min":0.245},"max":{"1min":0.70299999999999996,"5min":10.378,"15min":10.378},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.53700000000000003,"5min":1.581,"15min":2.0409999999999999},"min":{"1min":0.434,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.69899999999999995,"5min":5.6319999999999997,"15min":5.6319999999999997},"last":0.624}]},{"osd":1,"last update":"Sat Feb 10 08:43:02 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":2.0209999999999999,"15min":2.6709999999999998},"min":{"1min":0.41899999999999998,"5min":0.245,"15min":0.245},"max":{"1min":0.64500000000000002,"5min":17.931000000000001,"15min":17.931000000000001},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.53100000000000003,"5min":1.732,"15min":2.2629999999999999},"min":{"1min":0.32100000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.73899999999999999,"5min":17.721,"15min":17.721},"last":0.51100000000000001}]},{"osd":2,"last update":"Sat Feb 10 08:43:02 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":1.6579999999999999,"15min":2.1560000000000001},"min":{"1min":0.38400000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.67400000000000004,"5min":7.5800000000000001,"15min":7.5800000000000001},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":1.359,"15min":1.708},"min":{"1min":0.375,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.68700000000000006,"5min":10.412000000000001,"15min":10.412000000000001},"last":0.69999999999999996}]},{"osd":3,"last update":"Sat Feb 10 08:43:02 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":2.1899999999999999,"15min":2.9199999999999999},"min":{"1min":0.40000000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.71399999999999997,"5min":10.811999999999999,"15min":10.811999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":1.9199999999999999,"15min":2.52},"min":{"1min":0.38500000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.71099999999999997,"5min":10.709,"15min":10.709},"last":0.65400000000000003}]},{"osd":4,"last update":"Sat Feb 10 08:43:13 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.45200000000000001,"15min":0.44700000000000001},"min":{"1min":0.32500000000000001,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.47899999999999998,"15min":0.47799999999999998},"min":{"1min":0.374,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.623,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.55900000000000005}]},{"osd":5,"last update":"Sat Feb 10 08:43:02 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":1.5129999999999999,"15min":1.9670000000000001},"min":{"1min":0.38200000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.68500000000000005,"5min":14.82,"15min":14.82},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":1.4239999999999999,"15min":1.8240000000000001},"min":{"1min":0.46300000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.74299999999999999,"5min":11.414999999999999,"15min":11.414999999999999},"last":0.66500000000000004}]},{"osd":6,"last update":"Sat Feb 10 08:43:02 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":1.613,"15min":2.0899999999999999},"min":{"1min":0.45600000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.72599999999999998,"5min":11.442,"15min":11.442},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.56699999999999995,"5min":1.835,"15min":2.4129999999999998},"min":{"1min":0.434,"5min":0.251,"15min":0.251},"max":{"1min":0.755,"5min":8.3680000000000003,"15min":8.3680000000000003},"last":0.71899999999999997}]}]},{"osd":6,"up_from":43,"seq":184683594058,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":898476,"kb_used_data":1188,"kb_used_omap":0,"kb_used_meta":897280,"kb_avail":92846676,"statfs":{"total":95995035648,"available":95074996224,"internally_reserved":0,"allocated":1216512,"data_stored":652443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":918814720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:43:08 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":1.51,"15min":1.591},"min":{"1min":0.41899999999999998,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.87,"5min":8.9160000000000004,"15min":8.9160000000000004},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.53700000000000003,"5min":1.4330000000000001,"15min":1.4630000000000001},"min":{"1min":0.39900000000000002,"5min":0.221,"15min":0.20899999999999999},"max":{"1min":0.69499999999999995,"5min":10.349,"15min":10.349},"last":0.48599999999999999}]},{"osd":1,"last update":"Sat Feb 10 08:43:08 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":1.3759999999999999,"15min":1.496},"min":{"1min":0.41499999999999998,"5min":0.22700000000000001,"15min":0.223},"max":{"1min":0.73599999999999999,"5min":8.5050000000000008,"15min":8.5050000000000008},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.56399999999999995,"5min":1.821,"15min":1.861},"min":{"1min":0.44,"5min":0.28299999999999997,"15min":0.215},"max":{"1min":0.75800000000000001,"5min":14.632,"15min":14.632},"last":0.53100000000000003}]},{"osd":2,"last update":"Sat Feb 10 08:43:08 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":1.494,"15min":1.7490000000000001},"min":{"1min":0.36499999999999999,"5min":0.255,"15min":0.255},"max":{"1min":0.72899999999999998,"5min":11.68,"15min":25.146999999999998},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":1.3260000000000001,"15min":1.5269999999999999},"min":{"1min":0.44900000000000001,"5min":0.25900000000000001,"15min":0.23100000000000001},"max":{"1min":0.73999999999999999,"5min":10.391999999999999,"15min":25.135999999999999},"last":0.55200000000000005}]},{"osd":3,"last update":"Sat Feb 10 08:43:08 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":1.619,"15min":2.0699999999999998},"min":{"1min":0.46800000000000003,"5min":0.25,"15min":0.25},"max":{"1min":0.82799999999999996,"5min":8.5250000000000004,"15min":103.94199999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.58899999999999997,"5min":1.6899999999999999,"15min":2.194},"min":{"1min":0.438,"5min":0.26800000000000002,"15min":0.26300000000000001},"max":{"1min":0.78900000000000003,"5min":11.640000000000001,"15min":103.79600000000001},"last":0.57199999999999995}]},{"osd":4,"last update":"Sat Feb 10 08:43:10 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.46200000000000002,"15min":0.45800000000000002},"min":{"1min":0.32000000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55000000000000004,"15min":0.54900000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.63800000000000001}]},{"osd":5,"last update":"Sat Feb 10 08:43:08 2024","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":1.3009999999999999,"15min":1.615},"min":{"1min":0.35299999999999998,"5min":0.25700000000000001,"15min":0.24099999999999999},"max":{"1min":0.67900000000000005,"5min":14.864000000000001,"15min":29.631},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.56599999999999995,"5min":1.419,"15min":1.571},"min":{"1min":0.40000000000000002,"5min":0.27900000000000003,"15min":0.23699999999999999},"max":{"1min":0.77000000000000002,"5min":15.109999999999999,"15min":29.419},"last":0.65700000000000003}]},{"osd":7,"last update":"Sat Feb 10 08:42:56 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":1.4410000000000001,"15min":1.851},"min":{"1min":0.39800000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.745,"5min":8.9849999999999994,"15min":8.9849999999999994},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.63600000000000001,"5min":2.2850000000000001,"15min":3.0390000000000001},"min":{"1min":0.48199999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.80500000000000005,"5min":25.84,"15min":25.84},"last":0.67600000000000005}]}]},{"osd":1,"up_from":13,"seq":55834575201,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":895376,"kb_used_data":1224,"kb_used_omap":0,"kb_used_meta":894144,"kb_avail":92849776,"statfs":{"total":95995035648,"available":95078170624,"internally_reserved":0,"allocated":1253376,"data_stored":652792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":915603456},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:43:02 2024","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":1.8149999999999999,"15min":1.8},"min":{"1min":0.23599999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.53100000000000003,"5min":20.315000000000001,"15min":20.315000000000001},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.38300000000000001,"5min":1.712,"15min":1.778},"min":{"1min":0.24399999999999999,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.52100000000000002,"5min":14.757999999999999,"15min":19.928999999999998},"last":0.56299999999999994}]},{"osd":2,"last update":"Sat Feb 10 08:42:41 2024","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":2,"15min":1.8140000000000001},"min":{"1min":0.23999999999999999,"5min":0.224,"15min":0.22},"max":{"1min":0.55800000000000005,"5min":10.523,"15min":15.347},"last":1.5229999999999999},{"interface":"front","average":{"1min":0.38200000000000001,"5min":2.246,"15min":2.0110000000000001},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.184},"max":{"1min":0.58199999999999996,"5min":24.114999999999998,"15min":24.114999999999998},"last":0.434}]},{"osd":3,"last update":"Sat Feb 10 08:42:53 2024","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":1.6100000000000001,"15min":1.7789999999999999},"min":{"1min":0.29899999999999999,"5min":0.28899999999999998,"15min":0.23400000000000001},"max":{"1min":0.66200000000000003,"5min":11.268000000000001,"15min":12.369999999999999},"last":0.377},{"interface":"front","average":{"1min":0.41599999999999998,"5min":2.222,"15min":2},"min":{"1min":0.26000000000000001,"5min":0.248,"15min":0.19600000000000001},"max":{"1min":0.63300000000000001,"5min":27.797000000000001,"15min":27.797000000000001},"last":0.49099999999999999}]},{"osd":4,"last update":"Sat Feb 10 08:43:13 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.59599999999999997,"15min":0.59499999999999997},"min":{"1min":0.40200000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.58699999999999997,"15min":0.58299999999999996},"min":{"1min":0.442,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.68000000000000005}]},{"osd":5,"last update":"Sat Feb 10 08:42:41 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":1.855,"15min":1.851},"min":{"1min":0.41299999999999998,"5min":0.28199999999999997,"15min":0.27900000000000003},"max":{"1min":0.80300000000000005,"5min":8.5950000000000006,"15min":21.751000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.59799999999999998,"5min":1.7909999999999999,"15min":1.968},"min":{"1min":0.45500000000000002,"5min":0.33500000000000002,"15min":0.30099999999999999},"max":{"1min":0.88700000000000001,"5min":9.0129999999999999,"15min":16.324000000000002},"last":0.627}]},{"osd":6,"last update":"Sat Feb 10 08:43:02 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":1.552,"15min":2.0419999999999998},"min":{"1min":0.47899999999999998,"5min":0.36299999999999999,"15min":0.30199999999999999},"max":{"1min":0.85399999999999998,"5min":9.0489999999999995,"15min":60.279000000000003},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.67400000000000004,"5min":1.8089999999999999,"15min":2},"min":{"1min":0.42199999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.86899999999999999,"5min":20.216999999999999,"15min":60.286000000000001},"last":0.71899999999999997}]},{"osd":7,"last update":"Sat Feb 10 08:42:57 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":1.5840000000000001,"15min":2.0209999999999999},"min":{"1min":0.434,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.91800000000000004,"5min":5.6269999999999998,"15min":5.6269999999999998},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.66400000000000003,"5min":1.3340000000000001,"15min":1.6499999999999999},"min":{"1min":0.45600000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.875,"5min":6.3010000000000002,"15min":6.3010000000000002},"last":0.747}]}]},{"osd":0,"up_from":8,"seq":34359738725,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":899824,"kb_used_data":1192,"kb_used_omap":0,"kb_used_meta":898624,"kb_avail":92845328,"statfs":{"total":95995035648,"available":95073615872,"internally_reserved":0,"allocated":1220608,"data_stored":639557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":920190976},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 10 08:43:21 2024","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":2.3039999999999998,"15min":1.7310000000000001},"min":{"1min":0.223,"5min":0.193,"15min":0.16300000000000001},"max":{"1min":0.53600000000000003,"5min":32.671999999999997,"15min":32.671999999999997},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.375,"5min":1.696,"15min":1.7150000000000001},"min":{"1min":0.26400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.63200000000000001,"5min":31.539000000000001,"15min":31.539000000000001},"last":0.36299999999999999}]},{"osd":2,"last update":"Sat Feb 10 08:42:37 2024","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":1.8839999999999999,"15min":2.048},"min":{"1min":0.253,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.55100000000000005,"5min":12.555,"15min":21.331},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.41699999999999998,"5min":1.8660000000000001,"15min":1.6419999999999999},"min":{"1min":0.253,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.626,"5min":15.189,"15min":15.189},"last":0.34200000000000003}]},{"osd":3,"last update":"Sat Feb 10 08:42:55 2024","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":1.1359999999999999,"15min":1.4990000000000001},"min":{"1min":0.28299999999999997,"5min":0.218,"15min":0.218},"max":{"1min":0.71199999999999997,"5min":9.8209999999999997,"15min":15.585000000000001},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.44400000000000001,"5min":1.5960000000000001,"15min":1.919},"min":{"1min":0.34999999999999998,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.72099999999999997,"5min":14.843,"15min":19.504000000000001},"last":0.316}]},{"osd":4,"last update":"Sat Feb 10 08:43:11 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.60699999999999998,"15min":0.60899999999999999},"min":{"1min":0.47599999999999998,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.72099999999999997,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.60099999999999998,"15min":0.60299999999999998},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.78300000000000003,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.56100000000000005}]},{"osd":5,"last update":"Sat Feb 10 08:42:44 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":1.913,"15min":1.8799999999999999},"min":{"1min":0.45200000000000001,"5min":0.33300000000000002,"15min":0.28000000000000003},"max":{"1min":1.1879999999999999,"5min":9.5570000000000004,"15min":28.123999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.61199999999999999,"5min":1.375,"15min":1.6819999999999999},"min":{"1min":0.42399999999999999,"5min":0.29299999999999998,"15min":0.28599999999999998},"max":{"1min":0.81200000000000006,"5min":11.135999999999999,"15min":28.350000000000001},"last":0.46300000000000002}]},{"osd":6,"last update":"Sat Feb 10 08:43:21 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":1.8740000000000001,"15min":1.744},"min":{"1min":0.48599999999999999,"5min":0.318,"15min":0.25900000000000001},"max":{"1min":0.83999999999999997,"5min":9.7759999999999998,"15min":9.7759999999999998},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.63200000000000001,"5min":1.474,"15min":1.6240000000000001},"min":{"1min":0.45600000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.91000000000000003,"5min":9.8960000000000008,"15min":15.359},"last":0.57499999999999996}]},{"osd":7,"last update":"Sat Feb 10 08:42:55 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":1.5940000000000001,"15min":2.0249999999999999},"min":{"1min":0.47999999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.84399999999999997,"5min":7.5609999999999999,"15min":7.5609999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.63500000000000001,"5min":1.9239999999999999,"15min":2.4940000000000002},"min":{"1min":0.48699999999999999,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.86699999999999999,"5min":9.9269999999999996,"15min":9.9269999999999996},"last":0.53900000000000003}]}]},{"osd":2,"up_from":18,"seq":77309411677,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":887416,"kb_used_data":1200,"kb_used_omap":0,"kb_used_meta":886208,"kb_avail":92857736,"statfs":{"total":95995035648,"available":95086321664,"internally_reserved":0,"allocated":1228800,"data_stored":652294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":907476992},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:42:36 2024","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":1.6259999999999999,"15min":1.452},"min":{"1min":0.223,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.63400000000000001,"5min":22.050999999999998,"15min":27.934999999999999},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.371,"5min":1.669,"15min":1.9019999999999999},"min":{"1min":0.23300000000000001,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.57499999999999996,"5min":20.158000000000001,"15min":20.158000000000001},"last":0.29399999999999998}]},{"osd":1,"last update":"Sat Feb 10 08:42:36 2024","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":2.242,"15min":2.0030000000000001},"min":{"1min":0.23699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.628,"5min":24.324999999999999,"15min":24.324999999999999},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.41099999999999998,"5min":1.7,"15min":1.462},"min":{"1min":0.26500000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.58999999999999997,"5min":29.376999999999999,"15min":29.376999999999999},"last":0.32400000000000001}]},{"osd":3,"last update":"Sat Feb 10 08:42:59 2024","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":1.407,"15min":1.5700000000000001},"min":{"1min":0.33600000000000002,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.60999999999999999,"5min":9.1039999999999992,"15min":9.7870000000000008},"last":0.313},{"interface":"front","average":{"1min":0.41399999999999998,"5min":1.1890000000000001,"15min":1.2509999999999999},"min":{"1min":0.30399999999999999,"5min":0.26300000000000001,"15min":0.20999999999999999},"max":{"1min":0.56599999999999995,"5min":11.478,"15min":11.478},"last":0.39500000000000002}]},{"osd":4,"last update":"Sat Feb 10 08:43:16 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.61399999999999999,"15min":0.60599999999999998},"min":{"1min":0.48699999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.80400000000000005,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.623,"15min":0.61499999999999999},"min":{"1min":0.46999999999999997,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.81100000000000005,"5min":0.872,"15min":0.872},"last":0.79400000000000004}]},{"osd":5,"last update":"Sat Feb 10 08:42:43 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":1.7769999999999999,"15min":1.9790000000000001},"min":{"1min":0.45600000000000002,"5min":0.31900000000000001,"15min":0.28999999999999998},"max":{"1min":0.84099999999999997,"5min":19.765999999999998,"15min":19.765999999999998},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.61499999999999999,"5min":1.655,"15min":1.8100000000000001},"min":{"1min":0.371,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.97499999999999998,"5min":7.3129999999999997,"15min":9.5709999999999997},"last":0.85599999999999998}]},{"osd":6,"last update":"Sat Feb 10 08:43:27 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":3.714,"15min":2.665},"min":{"1min":0.40600000000000003,"5min":0.33800000000000002,"15min":0.27300000000000002},"max":{"1min":0.83099999999999996,"5min":235.446,"15min":235.446},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.59699999999999998,"5min":3.681,"15min":2.6440000000000001},"min":{"1min":0.441,"5min":0.33500000000000002,"15min":0.32200000000000001},"max":{"1min":0.85199999999999998,"5min":234.95500000000001,"15min":234.95500000000001},"last":0.73699999999999999}]},{"osd":7,"last update":"Sat Feb 10 08:42:59 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":1.4139999999999999,"15min":1.7789999999999999},"min":{"1min":0.48899999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.84199999999999997,"5min":8.0150000000000006,"15min":8.0150000000000006},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.64100000000000001,"5min":1.478,"15min":1.865},"min":{"1min":0.42799999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.95199999999999996,"5min":6.7489999999999997,"15min":6.7489999999999997},"last":0.83899999999999997}]}]},{"osd":3,"up_from":25,"seq":107374182744,"num_pgs":62,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":887176,"kb_used_data":1216,"kb_used_omap":0,"kb_used_meta":885952,"kb_avail":92857976,"statfs":{"total":95995035648,"available":95086567424,"internally_reserved":0,"allocated":1245184,"data_stored":652045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":907214848},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:42:54 2024","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":1.3540000000000001,"15min":1.788},"min":{"1min":0.21199999999999999,"5min":0.187,"15min":0.17699999999999999},"max":{"1min":0.94999999999999996,"5min":8.7880000000000003,"15min":66.605000000000004},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.38100000000000001,"5min":1.4099999999999999,"15min":1.782},"min":{"1min":0.26000000000000001,"5min":0.218,"15min":0.184},"max":{"1min":0.69799999999999995,"5min":14.781000000000001,"15min":66.828000000000003},"last":0.441}]},{"osd":1,"last update":"Sat Feb 10 08:42:54 2024","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":3.1629999999999998,"15min":2.2330000000000001},"min":{"1min":0.27800000000000002,"5min":0.20399999999999999,"15min":0.187},"max":{"1min":1.1299999999999999,"5min":84.375,"15min":84.375},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.47099999999999997,"5min":3.218,"15min":2.3570000000000002},"min":{"1min":0.28000000000000003,"5min":0.25600000000000001,"15min":0.20599999999999999},"max":{"1min":1.901,"5min":84.113,"15min":84.113},"last":0.45700000000000002}]},{"osd":2,"last update":"Sat Feb 10 08:42:54 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":1.496,"15min":2.0590000000000002},"min":{"1min":0.253,"5min":0.23699999999999999,"15min":0.20799999999999999},"max":{"1min":2.1800000000000002,"5min":9.0220000000000002,"15min":65.998999999999995},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.44700000000000001,"5min":1.2230000000000001,"15min":1.7629999999999999},"min":{"1min":0.32200000000000001,"5min":0.248,"15min":0.23400000000000001},"max":{"1min":0.79300000000000004,"5min":6.5300000000000002,"15min":68.721000000000004},"last":0.48699999999999999}]},{"osd":4,"last update":"Sat Feb 10 08:43:15 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.60499999999999998,"15min":0.60899999999999999},"min":{"1min":0.35499999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.61599999999999999,"15min":0.61899999999999999},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.77000000000000002}]},{"osd":5,"last update":"Sat Feb 10 08:42:54 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":1.399,"15min":1.7170000000000001},"min":{"1min":0.42999999999999999,"5min":0.28000000000000003,"15min":0.27500000000000002},"max":{"1min":0.97799999999999998,"5min":8.6349999999999998,"15min":19.832000000000001},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":1.4870000000000001,"15min":1.728},"min":{"1min":0.41099999999999998,"5min":0.34699999999999998,"15min":0.27800000000000002},"max":{"1min":1.091,"5min":7.2249999999999996,"15min":19.712},"last":0.95899999999999996}]},{"osd":6,"last update":"Sat Feb 10 08:43:15 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":1.6890000000000001,"15min":1.782},"min":{"1min":0.378,"5min":0.36599999999999999,"15min":0.31},"max":{"1min":0.97699999999999998,"5min":12.404,"15min":16.423999999999999},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.57599999999999996,"5min":1.379,"15min":1.6080000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.91000000000000003,"5min":8.7289999999999992,"15min":11.127000000000001},"last":0.71499999999999997}]},{"osd":7,"last update":"Sat Feb 10 08:42:54 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":1.3759999999999999,"15min":1.6739999999999999},"min":{"1min":0.40500000000000003,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.0049999999999999,"5min":8.9789999999999992,"15min":8.9789999999999992},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.63800000000000001,"5min":1.782,"15min":2.2160000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.0820000000000001,"5min":7.5990000000000002,"15min":7.5990000000000002},"last":0.90100000000000002}]}]},{"osd":4,"up_from":463,"seq":1988569858079,"num_pgs":62,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":332860,"kb_used_data":1204,"kb_used_omap":0,"kb_used_meta":331647,"kb_avail":93412292,"statfs":{"total":95995035648,"available":95654187008,"internally_reserved":0,"allocated":1232896,"data_stored":651713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":972,"internal_metadata":339606580},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:43:11 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.38600000000000001}]},{"osd":1,"last update":"Sat Feb 10 08:43:11 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.50600000000000001,"15min":0.502},"min":{"1min":0.41999999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.66400000000000003,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.54700000000000004,"15min":0.54400000000000004},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.67000000000000004,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.36499999999999999}]},{"osd":2,"last update":"Sat Feb 10 08:43:11 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.54500000000000004,"15min":0.54200000000000004},"min":{"1min":0.39300000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.72099999999999997,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.42299999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.73299999999999998,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.45000000000000001}]},{"osd":3,"last update":"Sat Feb 10 08:43:11 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.54600000000000004,"15min":0.54100000000000004},"min":{"1min":0.46000000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.70099999999999996,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.58099999999999996,"15min":0.57899999999999996},"min":{"1min":0.47899999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.68999999999999995,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.59899999999999998}]},{"osd":5,"last update":"Sat Feb 10 08:43:11 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.5,"15min":0.49299999999999999},"min":{"1min":0.34499999999999997,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.46899999999999997,"15min":0.46600000000000003},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.46200000000000002}]},{"osd":6,"last update":"Sat Feb 10 08:43:11 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.48899999999999999,"15min":0.48099999999999998},"min":{"1min":0.39100000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.51500000000000001,"15min":0.50900000000000001},"min":{"1min":0.32800000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.58899999999999997}]},{"osd":7,"last update":"Sat Feb 10 08:43:11 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.52900000000000003,"15min":0.52700000000000002},"min":{"1min":0.36199999999999999,"5min":0.307,"15min":0.307},"max":{"1min":0.69299999999999995,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.54800000000000004,"15min":0.54400000000000004},"min":{"1min":0.38,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.438}]}]},{"osd":5,"up_from":37,"seq":158913790287,"num_pgs":61,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":892204,"kb_used_data":1188,"kb_used_omap":0,"kb_used_meta":891008,"kb_avail":92852948,"statfs":{"total":95995035648,"available":95081418752,"internally_reserved":0,"allocated":1216512,"data_stored":651616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":912392192},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:42:45 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":2.1520000000000001,"15min":1.655},"min":{"1min":0.34899999999999998,"5min":0.219,"15min":0.21099999999999999},"max":{"1min":0.79700000000000004,"5min":33.384,"15min":33.384},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.51600000000000001,"5min":1.7889999999999999,"15min":1.6839999999999999},"min":{"1min":0.32400000000000001,"5min":0.192,"15min":0.192},"max":{"1min":0.70599999999999996,"5min":27.681000000000001,"15min":27.681000000000001},"last":0.42399999999999999}]},{"osd":1,"last update":"Sat Feb 10 08:42:45 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":2.2879999999999998,"15min":1.819},"min":{"1min":0.33200000000000002,"5min":0.23000000000000001,"15min":0.222},"max":{"1min":0.77200000000000002,"5min":16.341999999999999,"15min":16.341999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":1.853,"15min":1.6080000000000001},"min":{"1min":0.32200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.77400000000000002,"5min":16.225999999999999,"15min":16.225999999999999},"last":0.54400000000000004}]},{"osd":2,"last update":"Sat Feb 10 08:42:45 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":1.284,"15min":1.5029999999999999},"min":{"1min":0.36399999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.74399999999999999,"5min":10.811999999999999,"15min":20.254999999999999},"last":0.622},{"interface":"front","average":{"1min":0.57199999999999995,"5min":1.8540000000000001,"15min":1.639},"min":{"1min":0.34300000000000003,"5min":0.26800000000000002,"15min":0.26400000000000001},"max":{"1min":0.76100000000000001,"5min":15.369999999999999,"15min":15.369999999999999},"last":0.59399999999999997}]},{"osd":3,"last update":"Sat Feb 10 08:42:45 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":1.218,"15min":1.3080000000000001},"min":{"1min":0.39700000000000002,"5min":0.27600000000000002,"15min":0.26100000000000001},"max":{"1min":0.72199999999999998,"5min":6.7409999999999997,"15min":8.0079999999999991},"last":0.505},{"interface":"front","average":{"1min":0.55200000000000005,"5min":2.069,"15min":1.7},"min":{"1min":0.40999999999999998,"5min":0.28799999999999998,"15min":0.27300000000000002},"max":{"1min":0.72099999999999997,"5min":15.391999999999999,"15min":15.391999999999999},"last":0.52100000000000002}]},{"osd":4,"last update":"Sat Feb 10 08:43:13 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.442,"15min":0.432},"min":{"1min":0.32100000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.47899999999999998,"15min":0.46400000000000002},"min":{"1min":0.42799999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.53200000000000003}]},{"osd":6,"last update":"Sat Feb 10 08:43:17 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":1.3620000000000001,"15min":1.363},"min":{"1min":0.34799999999999998,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.73199999999999998,"5min":50.213000000000001,"15min":50.213000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.58899999999999997,"5min":1.3540000000000001,"15min":1.276},"min":{"1min":0.45700000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.69399999999999995,"5min":49.872999999999998,"15min":49.872999999999998},"last":0.56799999999999995}]},{"osd":7,"last update":"Sat Feb 10 08:42:58 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.78900000000000003,"15min":0.92700000000000005},"min":{"1min":0.38800000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.70699999999999996,"5min":4.7960000000000003,"15min":4.7960000000000003},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.55500000000000005,"5min":1.018,"15min":1.2549999999999999},"min":{"1min":0.36099999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.80000000000000004,"5min":7.093,"15min":7.093},"last":0.48599999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-10T08:43:36.303 INFO:tasks.cephadm.ceph_manager.ceph:recovered! 2024-02-10T08:43:36.303 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 -- ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-02-10T08:43:36.587 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/mon.a/config 2024-02-10T08:43:36.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:43:35.257263+0000 mgr.y (mgr.14505) 1000 : audit [DBG] from='client.16143 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-10T08:43:36.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:35.268878+0000 mgr.y (mgr.14505) 1001 : cluster [DBG] pgmap v1238: 162 pgs: 162 active+clean; 5.7 KiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:43:36.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:35.344798+0000 osd.3 (osd.3) 169 : cluster [DBG] 5.13 scrub starts 2024-02-10T08:43:36.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:35.347689+0000 osd.3 (osd.3) 170 : cluster [DBG] 5.13 scrub ok 2024-02-10T08:43:36.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:35.491351+0000 osd.5 (osd.5) 384 : cluster [DBG] 5.f scrub starts 2024-02-10T08:43:36.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:35.494317+0000 osd.5 (osd.5) 385 : cluster [DBG] 5.f scrub ok 2024-02-10T08:43:36.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:35.652510+0000 osd.6 (osd.6) 369 : cluster [DBG] 6.27 scrub starts 2024-02-10T08:43:36.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:35.751738+0000 osd.4 (osd.4) 97 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:43:36.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:35.751800+0000 osd.4 (osd.4) 98 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:43:36.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:35.788919+0000 osd.6 (osd.6) 370 : cluster [DBG] 6.27 scrub ok 2024-02-10T08:43:36.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:43:35.257263+0000 mgr.y (mgr.14505) 1000 : audit [DBG] from='client.16143 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-10T08:43:36.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:35.268878+0000 mgr.y (mgr.14505) 1001 : cluster [DBG] pgmap v1238: 162 pgs: 162 active+clean; 5.7 KiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:43:36.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:35.344798+0000 osd.3 (osd.3) 169 : cluster [DBG] 5.13 scrub starts 2024-02-10T08:43:36.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:35.347689+0000 osd.3 (osd.3) 170 : cluster [DBG] 5.13 scrub ok 2024-02-10T08:43:36.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:35.491351+0000 osd.5 (osd.5) 384 : cluster [DBG] 5.f scrub starts 2024-02-10T08:43:36.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:35.494317+0000 osd.5 (osd.5) 385 : cluster [DBG] 5.f scrub ok 2024-02-10T08:43:36.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:35.652510+0000 osd.6 (osd.6) 369 : cluster [DBG] 6.27 scrub starts 2024-02-10T08:43:36.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:35.751738+0000 osd.4 (osd.4) 97 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:43:36.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:35.751800+0000 osd.4 (osd.4) 98 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:43:36.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:36 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:35.788919+0000 osd.6 (osd.6) 370 : cluster [DBG] 6.27 scrub ok 2024-02-10T08:43:36.789 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:43:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x[42256]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:43:36] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-10T08:43:36.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:43:35.257263+0000 mgr.y (mgr.14505) 1000 : audit [DBG] from='client.16143 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-10T08:43:36.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:35.268878+0000 mgr.y (mgr.14505) 1001 : cluster [DBG] pgmap v1238: 162 pgs: 162 active+clean; 5.7 KiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-10T08:43:36.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:35.344798+0000 osd.3 (osd.3) 169 : cluster [DBG] 5.13 scrub starts 2024-02-10T08:43:36.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:35.347689+0000 osd.3 (osd.3) 170 : cluster [DBG] 5.13 scrub ok 2024-02-10T08:43:36.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:35.491351+0000 osd.5 (osd.5) 384 : cluster [DBG] 5.f scrub starts 2024-02-10T08:43:36.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:35.494317+0000 osd.5 (osd.5) 385 : cluster [DBG] 5.f scrub ok 2024-02-10T08:43:36.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:35.652510+0000 osd.6 (osd.6) 369 : cluster [DBG] 6.27 scrub starts 2024-02-10T08:43:36.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:35.751738+0000 osd.4 (osd.4) 97 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:43:36.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:35.751800+0000 osd.4 (osd.4) 98 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:43:36.790 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:35.788919+0000 osd.6 (osd.6) 370 : cluster [DBG] 6.27 scrub ok 2024-02-10T08:43:37.404 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:43:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: ::ffff:172.21.15.71 - - [10/Feb/2024:08:43:37] "GET /metrics HTTP/1.1" 200 174132 "" "Prometheus/2.33.4" 2024-02-10T08:43:37.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:36.351586+0000 osd.3 (osd.3) 171 : cluster [DBG] 4.17 scrub starts 2024-02-10T08:43:37.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:36.353086+0000 osd.3 (osd.3) 172 : cluster [DBG] 4.17 scrub ok 2024-02-10T08:43:37.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:36.455232+0000 mon.a (mon.0) 2009 : cluster [DBG] osdmap e511: 8 total, 8 up, 8 in 2024-02-10T08:43:37.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:36.351586+0000 osd.3 (osd.3) 171 : cluster [DBG] 4.17 scrub starts 2024-02-10T08:43:37.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:36.353086+0000 osd.3 (osd.3) 172 : cluster [DBG] 4.17 scrub ok 2024-02-10T08:43:37.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:36.455232+0000 mon.a (mon.0) 2009 : cluster [DBG] osdmap e511: 8 total, 8 up, 8 in 2024-02-10T08:43:37.904 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:36.351586+0000 osd.3 (osd.3) 171 : cluster [DBG] 4.17 scrub starts 2024-02-10T08:43:37.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:36.353086+0000 osd.3 (osd.3) 172 : cluster [DBG] 4.17 scrub ok 2024-02-10T08:43:37.905 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:37 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:36.455232+0000 mon.a (mon.0) 2009 : cluster [DBG] osdmap e511: 8 total, 8 up, 8 in 2024-02-10T08:43:38.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:37.269485+0000 mgr.y (mgr.14505) 1002 : cluster [DBG] pgmap v1240: 162 pgs: 162 active+clean; 5.7 KiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 748 B/s rd, 0 op/s 2024-02-10T08:43:38.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:37.381073+0000 osd.0 (osd.0) 380 : cluster [DBG] 2.13 scrub starts 2024-02-10T08:43:38.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:37.382060+0000 osd.0 (osd.0) 381 : cluster [DBG] 2.13 scrub ok 2024-02-10T08:43:38.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:37.269485+0000 mgr.y (mgr.14505) 1002 : cluster [DBG] pgmap v1240: 162 pgs: 162 active+clean; 5.7 KiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 748 B/s rd, 0 op/s 2024-02-10T08:43:38.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:37.381073+0000 osd.0 (osd.0) 380 : cluster [DBG] 2.13 scrub starts 2024-02-10T08:43:38.655 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:37.382060+0000 osd.0 (osd.0) 381 : cluster [DBG] 2.13 scrub ok 2024-02-10T08:43:38.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:37.269485+0000 mgr.y (mgr.14505) 1002 : cluster [DBG] pgmap v1240: 162 pgs: 162 active+clean; 5.7 KiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 748 B/s rd, 0 op/s 2024-02-10T08:43:38.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:37.381073+0000 osd.0 (osd.0) 380 : cluster [DBG] 2.13 scrub starts 2024-02-10T08:43:38.789 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:37.382060+0000 osd.0 (osd.0) 381 : cluster [DBG] 2.13 scrub ok 2024-02-10T08:43:39.154 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:43:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: [10/Feb/2024:08:43:38] ENGINE Bus STOPPING 2024-02-10T08:43:39.154 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:43:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: [10/Feb/2024:08:43:38] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-02-10T08:43:39.154 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:43:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: [10/Feb/2024:08:43:38] ENGINE Bus STOPPED 2024-02-10T08:43:39.154 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:43:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: [10/Feb/2024:08:43:38] ENGINE Bus STARTING 2024-02-10T08:43:39.154 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:43:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: [10/Feb/2024:08:43:38] ENGINE Serving on http://:::9283 2024-02-10T08:43:39.154 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:43:38 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: [10/Feb/2024:08:43:38] ENGINE Bus STARTED 2024-02-10T08:43:39.539 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:43:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug there is no tcmu-runner data available 2024-02-10T08:43:39.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:38.131250+0000 osd.5 (osd.5) 386 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:43:39.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:38.131349+0000 osd.5 (osd.5) 387 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:43:39.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:38.136315+0000 osd.1 (osd.1) 409 : cluster [DBG] 5.c scrub starts 2024-02-10T08:43:39.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:38.139246+0000 osd.1 (osd.1) 410 : cluster [DBG] 5.c scrub ok 2024-02-10T08:43:39.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:38.444159+0000 osd.2 (osd.2) 339 : cluster [DBG] 6.2d scrub starts 2024-02-10T08:43:39.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:38.466208+0000 mon.a (mon.0) 2010 : cluster [DBG] osdmap e512: 8 total, 8 up, 8 in 2024-02-10T08:43:39.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:38.537219+0000 osd.2 (osd.2) 340 : cluster [DBG] 6.2d scrub ok 2024-02-10T08:43:39.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:38.665189+0000 osd.6 (osd.6) 371 : cluster [DBG] 2.11 scrub starts 2024-02-10T08:43:39.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: cluster 2024-02-10T08:43:38.666072+0000 osd.6 (osd.6) 372 : cluster [DBG] 2.11 scrub ok 2024-02-10T08:43:39.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:43:38.804469+0000 mon.c (mon.2) 122 : audit [INF] from='client.? 172.21.15.18:0/2733147381' entity='client.admin' cmd=[{"prefix": "config rm", "who": "mgr", "name": "mgr_debug_aggressive_pg_num_changes"}]: dispatch 2024-02-10T08:43:39.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:43:38.804747+0000 mon.a (mon.0) 2011 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "config rm", "who": "mgr", "name": "mgr_debug_aggressive_pg_num_changes"}]: dispatch 2024-02-10T08:43:39.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:43:38.808523+0000 mon.a (mon.0) 2012 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "config rm", "who": "mgr", "name": "mgr_debug_aggressive_pg_num_changes"}]': finished 2024-02-10T08:43:39.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:43:38.849340+0000 mon.a (mon.0) 2013 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:43:39.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:43:39.149732+0000 mon.a (mon.0) 2014 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:43:39.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:43:39.150602+0000 mon.a (mon.0) 2015 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:43:39.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:43:39.151186+0000 mon.a (mon.0) 2016 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:43:39.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: audit 2024-02-10T08:43:39.155072+0000 mon.a (mon.0) 2017 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:43:39.731 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:38.131250+0000 osd.5 (osd.5) 386 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:43:39.731 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:38.131349+0000 osd.5 (osd.5) 387 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:43:39.731 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:38.136315+0000 osd.1 (osd.1) 409 : cluster [DBG] 5.c scrub starts 2024-02-10T08:43:39.731 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:38.139246+0000 osd.1 (osd.1) 410 : cluster [DBG] 5.c scrub ok 2024-02-10T08:43:39.731 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:38.444159+0000 osd.2 (osd.2) 339 : cluster [DBG] 6.2d scrub starts 2024-02-10T08:43:39.732 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:38.466208+0000 mon.a (mon.0) 2010 : cluster [DBG] osdmap e512: 8 total, 8 up, 8 in 2024-02-10T08:43:39.732 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:38.537219+0000 osd.2 (osd.2) 340 : cluster [DBG] 6.2d scrub ok 2024-02-10T08:43:39.732 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:38.665189+0000 osd.6 (osd.6) 371 : cluster [DBG] 2.11 scrub starts 2024-02-10T08:43:39.732 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: cluster 2024-02-10T08:43:38.666072+0000 osd.6 (osd.6) 372 : cluster [DBG] 2.11 scrub ok 2024-02-10T08:43:39.732 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:43:38.804469+0000 mon.c (mon.2) 122 : audit [INF] from='client.? 172.21.15.18:0/2733147381' entity='client.admin' cmd=[{"prefix": "config rm", "who": "mgr", "name": "mgr_debug_aggressive_pg_num_changes"}]: dispatch 2024-02-10T08:43:39.732 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:43:38.804747+0000 mon.a (mon.0) 2011 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "config rm", "who": "mgr", "name": "mgr_debug_aggressive_pg_num_changes"}]: dispatch 2024-02-10T08:43:39.732 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:43:38.808523+0000 mon.a (mon.0) 2012 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "config rm", "who": "mgr", "name": "mgr_debug_aggressive_pg_num_changes"}]': finished 2024-02-10T08:43:39.732 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:43:38.849340+0000 mon.a (mon.0) 2013 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:43:39.732 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:43:39.149732+0000 mon.a (mon.0) 2014 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:43:39.732 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:43:39.150602+0000 mon.a (mon.0) 2015 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:43:39.732 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:43:39.151186+0000 mon.a (mon.0) 2016 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:43:39.732 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: audit 2024-02-10T08:43:39.155072+0000 mon.a (mon.0) 2017 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:43:39.733 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:38.131250+0000 osd.5 (osd.5) 386 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:43:39.733 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:38.131349+0000 osd.5 (osd.5) 387 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:43:39.733 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:38.136315+0000 osd.1 (osd.1) 409 : cluster [DBG] 5.c scrub starts 2024-02-10T08:43:39.733 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:38.139246+0000 osd.1 (osd.1) 410 : cluster [DBG] 5.c scrub ok 2024-02-10T08:43:39.733 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:38.444159+0000 osd.2 (osd.2) 339 : cluster [DBG] 6.2d scrub starts 2024-02-10T08:43:39.733 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:38.466208+0000 mon.a (mon.0) 2010 : cluster [DBG] osdmap e512: 8 total, 8 up, 8 in 2024-02-10T08:43:39.733 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:38.537219+0000 osd.2 (osd.2) 340 : cluster [DBG] 6.2d scrub ok 2024-02-10T08:43:39.733 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:38.665189+0000 osd.6 (osd.6) 371 : cluster [DBG] 2.11 scrub starts 2024-02-10T08:43:39.733 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: cluster 2024-02-10T08:43:38.666072+0000 osd.6 (osd.6) 372 : cluster [DBG] 2.11 scrub ok 2024-02-10T08:43:39.733 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:43:38.804469+0000 mon.c (mon.2) 122 : audit [INF] from='client.? 172.21.15.18:0/2733147381' entity='client.admin' cmd=[{"prefix": "config rm", "who": "mgr", "name": "mgr_debug_aggressive_pg_num_changes"}]: dispatch 2024-02-10T08:43:39.733 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:43:38.804747+0000 mon.a (mon.0) 2011 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "config rm", "who": "mgr", "name": "mgr_debug_aggressive_pg_num_changes"}]: dispatch 2024-02-10T08:43:39.734 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:43:38.808523+0000 mon.a (mon.0) 2012 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "config rm", "who": "mgr", "name": "mgr_debug_aggressive_pg_num_changes"}]': finished 2024-02-10T08:43:39.734 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:43:38.849340+0000 mon.a (mon.0) 2013 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:43:39.734 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:43:39.149732+0000 mon.a (mon.0) 2014 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:43:39.734 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:43:39.150602+0000 mon.a (mon.0) 2015 : audit [DBG] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:43:39.734 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:43:39.151186+0000 mon.a (mon.0) 2016 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-10T08:43:39.734 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:39 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: audit 2024-02-10T08:43:39.155072+0000 mon.a (mon.0) 2017 : audit [INF] from='mgr.14505 172.21.15.18:0/3282557671' entity='mgr.y' 2024-02-10T08:43:39.735 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-02-10T08:43:39.745 INFO:tasks.cephadm:Teardown begin 2024-02-10T08:43:39.746 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-10T08:43:39.793 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-10T08:43:39.832 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-02-10T08:43:39.832 DEBUG:teuthology.orchestra.run.smithi018:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-02-10T08:43:39.852 DEBUG:teuthology.orchestra.run.smithi071:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-02-10T08:43:39.892 INFO:tasks.cephadm:Stopping all daemons... 2024-02-10T08:43:39.892 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-02-10T08:43:39.893 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ceph-d46257c8-c7eb-11ee-95b8-87774f69a715@mon.a 2024-02-10T08:43:40.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:39 smithi018 systemd[1]: Stopping Ceph mon.a for d46257c8-c7eb-11ee-95b8-87774f69a715... 2024-02-10T08:43:40.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:39 smithi018 bash[194623]: Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon.a" found: no such container 2024-02-10T08:43:40.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:43:40.211+0000 7f972a8fa700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-02-10T08:43:40.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a[39522]: debug 2024-02-10T08:43:40.211+0000 7f972a8fa700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-02-10T08:43:40.654 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:43:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: [10/Feb/2024:08:43:40] ENGINE Bus STOPPING 2024-02-10T08:43:40.654 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:43:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: [10/Feb/2024:08:43:40] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-02-10T08:43:40.655 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:43:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: [10/Feb/2024:08:43:40] ENGINE Bus STOPPED 2024-02-10T08:43:40.655 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:43:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: [10/Feb/2024:08:43:40] ENGINE Bus STARTING 2024-02-10T08:43:40.655 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:43:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: [10/Feb/2024:08:43:40] ENGINE Serving on http://:::9283 2024-02-10T08:43:40.655 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:43:40 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: [10/Feb/2024:08:43:40] ENGINE Bus STARTED 2024-02-10T08:43:41.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Feb 10 08:43:40 smithi018 bash[194663]: ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-a 2024-02-10T08:43:41.347 DEBUG:teuthology.orchestra.run.smithi018:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d46257c8-c7eb-11ee-95b8-87774f69a715@mon.a.service' 2024-02-10T08:43:41.409 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-10T08:43:41.410 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-02-10T08:43:41.410 INFO:tasks.cephadm.mon.b:Stopping mon.c... 2024-02-10T08:43:41.410 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ceph-d46257c8-c7eb-11ee-95b8-87774f69a715@mon.c 2024-02-10T08:43:41.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:41 smithi018 systemd[1]: Stopping Ceph mon.c for d46257c8-c7eb-11ee-95b8-87774f69a715... 2024-02-10T08:43:41.654 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:41 smithi018 bash[194792]: Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon.c" found: no such container 2024-02-10T08:43:42.153 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:43:41.701+0000 7fd277cda700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-02-10T08:43:42.153 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:41 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c[46232]: debug 2024-02-10T08:43:41.701+0000 7fd277cda700 -1 mon.c@2(peon) e3 *** Got Signal Terminated *** 2024-02-10T08:43:42.404 INFO:journalctl@ceph.mon.c.smithi018.stdout:Feb 10 08:43:42 smithi018 bash[194831]: ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-c 2024-02-10T08:43:42.644 DEBUG:teuthology.orchestra.run.smithi018:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d46257c8-c7eb-11ee-95b8-87774f69a715@mon.c.service' 2024-02-10T08:43:42.680 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-10T08:43:42.681 INFO:tasks.cephadm.mon.b:Stopped mon.c 2024-02-10T08:43:42.681 INFO:tasks.cephadm.mon.b:Stopping mon.b... 2024-02-10T08:43:42.681 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ceph-d46257c8-c7eb-11ee-95b8-87774f69a715@mon.b 2024-02-10T08:43:43.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:42 smithi071 systemd[1]: Stopping Ceph mon.b for d46257c8-c7eb-11ee-95b8-87774f69a715... 2024-02-10T08:43:43.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:42 smithi071 bash[135046]: Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon.b" found: no such container 2024-02-10T08:43:43.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:43 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:43:43.080+0000 7f9b5d7cd700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-02-10T08:43:43.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:43 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b[40825]: debug 2024-02-10T08:43:43.080+0000 7f9b5d7cd700 -1 mon.b@1(peon) e3 *** Got Signal Terminated *** 2024-02-10T08:43:44.039 INFO:journalctl@ceph.mon.b.smithi071.stdout:Feb 10 08:43:43 smithi071 bash[135086]: ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mon-b 2024-02-10T08:43:44.186 DEBUG:teuthology.orchestra.run.smithi071:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d46257c8-c7eb-11ee-95b8-87774f69a715@mon.b.service' 2024-02-10T08:43:44.225 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-10T08:43:44.225 INFO:tasks.cephadm.mon.b:Stopped mon.b 2024-02-10T08:43:44.225 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-02-10T08:43:44.225 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ceph-d46257c8-c7eb-11ee-95b8-87774f69a715@mgr.y 2024-02-10T08:43:44.573 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:43:44 smithi018 systemd[1]: Stopping Ceph mgr.y for d46257c8-c7eb-11ee-95b8-87774f69a715... 2024-02-10T08:43:44.573 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:43:44 smithi018 bash[194950]: Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr.y" found: no such container 2024-02-10T08:43:44.857 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:43:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:43:44.571+0000 7f5333912700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.y -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-10T08:43:44.857 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:43:44 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y[39796]: debug 2024-02-10T08:43:44.571+0000 7f5333912700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-02-10T08:43:45.153 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Feb 10 08:43:45 smithi018 bash[194987]: ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-y 2024-02-10T08:43:45.593 DEBUG:teuthology.orchestra.run.smithi018:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d46257c8-c7eb-11ee-95b8-87774f69a715@mgr.y.service' 2024-02-10T08:43:45.631 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-10T08:43:45.631 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-02-10T08:43:45.631 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-02-10T08:43:45.631 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ceph-d46257c8-c7eb-11ee-95b8-87774f69a715@mgr.x 2024-02-10T08:43:46.039 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:43:45 smithi071 systemd[1]: Stopping Ceph mgr.x for d46257c8-c7eb-11ee-95b8-87774f69a715... 2024-02-10T08:43:46.039 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:43:45 smithi071 bash[135205]: Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr.x" found: no such container 2024-02-10T08:43:46.539 INFO:journalctl@ceph.mgr.x.smithi071.stdout:Feb 10 08:43:46 smithi071 bash[135245]: ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-mgr-x 2024-02-10T08:43:46.741 DEBUG:teuthology.orchestra.run.smithi071:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d46257c8-c7eb-11ee-95b8-87774f69a715@mgr.x.service' 2024-02-10T08:43:46.778 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-10T08:43:46.778 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-02-10T08:43:46.778 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-02-10T08:43:46.779 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ceph-d46257c8-c7eb-11ee-95b8-87774f69a715@osd.0 2024-02-10T08:43:47.073 INFO:journalctl@ceph.osd.0.smithi018.stdout:Feb 10 08:43:46 smithi018 systemd[1]: Stopping Ceph osd.0 for d46257c8-c7eb-11ee-95b8-87774f69a715... 2024-02-10T08:43:47.073 INFO:journalctl@ceph.osd.0.smithi018.stdout:Feb 10 08:43:46 smithi018 bash[195107]: Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T08:43:47.403 INFO:journalctl@ceph.osd.0.smithi018.stdout:Feb 10 08:43:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-0[49689]: debug 2024-02-10T08:43:47.071+0000 7fb843b2c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-10T08:43:47.404 INFO:journalctl@ceph.osd.0.smithi018.stdout:Feb 10 08:43:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-0[49689]: debug 2024-02-10T08:43:47.071+0000 7fb843b2c700 -1 osd.0 512 *** Got signal Terminated *** 2024-02-10T08:43:47.404 INFO:journalctl@ceph.osd.0.smithi018.stdout:Feb 10 08:43:47 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-0[49689]: debug 2024-02-10T08:43:47.071+0000 7fb843b2c700 -1 osd.0 512 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-10T08:43:52.879 INFO:journalctl@ceph.osd.0.smithi018.stdout:Feb 10 08:43:52 smithi018 bash[195147]: ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-0 2024-02-10T08:43:54.636 DEBUG:teuthology.orchestra.run.smithi018:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d46257c8-c7eb-11ee-95b8-87774f69a715@osd.0.service' 2024-02-10T08:43:54.681 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-10T08:43:54.681 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-02-10T08:43:54.681 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-02-10T08:43:54.681 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ceph-d46257c8-c7eb-11ee-95b8-87774f69a715@osd.1 2024-02-10T08:43:54.904 INFO:journalctl@ceph.osd.1.smithi018.stdout:Feb 10 08:43:54 smithi018 systemd[1]: Stopping Ceph osd.1 for d46257c8-c7eb-11ee-95b8-87774f69a715... 2024-02-10T08:43:54.904 INFO:journalctl@ceph.osd.1.smithi018.stdout:Feb 10 08:43:54 smithi018 bash[195389]: Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T08:43:55.404 INFO:journalctl@ceph.osd.1.smithi018.stdout:Feb 10 08:43:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-1[54297]: debug 2024-02-10T08:43:55.015+0000 7f701bf42700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-10T08:43:55.404 INFO:journalctl@ceph.osd.1.smithi018.stdout:Feb 10 08:43:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-1[54297]: debug 2024-02-10T08:43:55.015+0000 7f701bf42700 -1 osd.1 512 *** Got signal Terminated *** 2024-02-10T08:43:55.404 INFO:journalctl@ceph.osd.1.smithi018.stdout:Feb 10 08:43:55 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-1[54297]: debug 2024-02-10T08:43:55.015+0000 7f701bf42700 -1 osd.1 512 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-10T08:44:00.904 INFO:journalctl@ceph.osd.1.smithi018.stdout:Feb 10 08:44:00 smithi018 bash[195430]: ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-1 2024-02-10T08:44:02.750 DEBUG:teuthology.orchestra.run.smithi018:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d46257c8-c7eb-11ee-95b8-87774f69a715@osd.1.service' 2024-02-10T08:44:02.799 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-10T08:44:02.799 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-02-10T08:44:02.799 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-02-10T08:44:02.799 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ceph-d46257c8-c7eb-11ee-95b8-87774f69a715@osd.2 2024-02-10T08:44:03.154 INFO:journalctl@ceph.osd.2.smithi018.stdout:Feb 10 08:44:02 smithi018 systemd[1]: Stopping Ceph osd.2 for d46257c8-c7eb-11ee-95b8-87774f69a715... 2024-02-10T08:44:03.154 INFO:journalctl@ceph.osd.2.smithi018.stdout:Feb 10 08:44:02 smithi018 bash[195665]: Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T08:44:03.654 INFO:journalctl@ceph.osd.2.smithi018.stdout:Feb 10 08:44:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-2[58841]: debug 2024-02-10T08:44:03.155+0000 7fcf92a37700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-10T08:44:03.654 INFO:journalctl@ceph.osd.2.smithi018.stdout:Feb 10 08:44:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-2[58841]: debug 2024-02-10T08:44:03.155+0000 7fcf92a37700 -1 osd.2 512 *** Got signal Terminated *** 2024-02-10T08:44:03.654 INFO:journalctl@ceph.osd.2.smithi018.stdout:Feb 10 08:44:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-2[58841]: debug 2024-02-10T08:44:03.155+0000 7fcf92a37700 -1 osd.2 512 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-10T08:44:08.904 INFO:journalctl@ceph.osd.2.smithi018.stdout:Feb 10 08:44:08 smithi018 bash[195706]: ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-2 2024-02-10T08:44:10.622 DEBUG:teuthology.orchestra.run.smithi018:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d46257c8-c7eb-11ee-95b8-87774f69a715@osd.2.service' 2024-02-10T08:44:10.670 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-10T08:44:10.670 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-02-10T08:44:10.670 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-02-10T08:44:10.671 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ceph-d46257c8-c7eb-11ee-95b8-87774f69a715@osd.3 2024-02-10T08:44:10.904 INFO:journalctl@ceph.osd.3.smithi018.stdout:Feb 10 08:44:10 smithi018 systemd[1]: Stopping Ceph osd.3 for d46257c8-c7eb-11ee-95b8-87774f69a715... 2024-02-10T08:44:10.904 INFO:journalctl@ceph.osd.3.smithi018.stdout:Feb 10 08:44:10 smithi018 bash[195944]: Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T08:44:11.404 INFO:journalctl@ceph.osd.3.smithi018.stdout:Feb 10 08:44:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-3[63466]: debug 2024-02-10T08:44:11.040+0000 7f2fd69fa700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-10T08:44:11.404 INFO:journalctl@ceph.osd.3.smithi018.stdout:Feb 10 08:44:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-3[63466]: debug 2024-02-10T08:44:11.040+0000 7f2fd69fa700 -1 osd.3 512 *** Got signal Terminated *** 2024-02-10T08:44:11.404 INFO:journalctl@ceph.osd.3.smithi018.stdout:Feb 10 08:44:11 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-3[63466]: debug 2024-02-10T08:44:11.040+0000 7f2fd69fa700 -1 osd.3 512 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-10T08:44:12.654 INFO:journalctl@ceph.osd.3.smithi018.stdout:Feb 10 08:44:12 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-3[63466]: debug 2024-02-10T08:44:12.401+0000 7f2fd1973700 -1 osd.3 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:46.472112+0000 front 2024-02-10T08:43:46.472156+0000 (oldest deadline 2024-02-10T08:44:12.372181+0000) 2024-02-10T08:44:13.289 INFO:journalctl@ceph.osd.6.smithi071.stdout:Feb 10 08:44:12 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-6[53993]: debug 2024-02-10T08:44:12.840+0000 7fd5c11a9700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:49.153442+0000 front 2024-02-10T08:43:49.153401+0000 (oldest deadline 2024-02-10T08:44:12.653313+0000) 2024-02-10T08:44:13.654 INFO:journalctl@ceph.osd.3.smithi018.stdout:Feb 10 08:44:13 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-3[63466]: debug 2024-02-10T08:44:13.359+0000 7f2fd1973700 -1 osd.3 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:46.472112+0000 front 2024-02-10T08:43:46.472156+0000 (oldest deadline 2024-02-10T08:44:12.372181+0000) 2024-02-10T08:44:14.289 INFO:journalctl@ceph.osd.6.smithi071.stdout:Feb 10 08:44:13 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-6[53993]: debug 2024-02-10T08:44:13.842+0000 7fd5c11a9700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:49.153442+0000 front 2024-02-10T08:43:49.153401+0000 (oldest deadline 2024-02-10T08:44:12.653313+0000) 2024-02-10T08:44:14.654 INFO:journalctl@ceph.osd.3.smithi018.stdout:Feb 10 08:44:14 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-3[63466]: debug 2024-02-10T08:44:14.329+0000 7f2fd1973700 -1 osd.3 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:46.472112+0000 front 2024-02-10T08:43:46.472156+0000 (oldest deadline 2024-02-10T08:44:12.372181+0000) 2024-02-10T08:44:15.289 INFO:journalctl@ceph.osd.6.smithi071.stdout:Feb 10 08:44:14 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-6[53993]: debug 2024-02-10T08:44:14.844+0000 7fd5c11a9700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:49.153442+0000 front 2024-02-10T08:43:49.153401+0000 (oldest deadline 2024-02-10T08:44:12.653313+0000) 2024-02-10T08:44:15.574 INFO:journalctl@ceph.osd.4.smithi071.stdout:Feb 10 08:44:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-4[132092]: debug 2024-02-10T08:44:15.315+0000 7f0cd0a8b700 -1 osd.4 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:52.061388+0000 front 2024-02-10T08:43:52.061397+0000 (oldest deadline 2024-02-10T08:44:14.361143+0000) 2024-02-10T08:44:15.654 INFO:journalctl@ceph.osd.3.smithi018.stdout:Feb 10 08:44:15 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-3[63466]: debug 2024-02-10T08:44:15.349+0000 7f2fd1973700 -1 osd.3 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:46.472112+0000 front 2024-02-10T08:43:46.472156+0000 (oldest deadline 2024-02-10T08:44:12.372181+0000) 2024-02-10T08:44:16.039 INFO:journalctl@ceph.osd.6.smithi071.stdout:Feb 10 08:44:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-6[53993]: debug 2024-02-10T08:44:15.809+0000 7fd5c11a9700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:49.153442+0000 front 2024-02-10T08:43:49.153401+0000 (oldest deadline 2024-02-10T08:44:12.653313+0000) 2024-02-10T08:44:16.039 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:15 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:15.573+0000 7fb94def3700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:50.569091+0000 front 2024-02-10T08:43:50.569194+0000 (oldest deadline 2024-02-10T08:44:15.269354+0000) 2024-02-10T08:44:16.531 INFO:journalctl@ceph.osd.4.smithi071.stdout:Feb 10 08:44:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-4[132092]: debug 2024-02-10T08:44:16.280+0000 7f0cd0a8b700 -1 osd.4 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:52.061388+0000 front 2024-02-10T08:43:52.061397+0000 (oldest deadline 2024-02-10T08:44:14.361143+0000) 2024-02-10T08:44:16.789 INFO:journalctl@ceph.osd.6.smithi071.stdout:Feb 10 08:44:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-6[53993]: debug 2024-02-10T08:44:16.768+0000 7fd5c11a9700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:49.153442+0000 front 2024-02-10T08:43:49.153401+0000 (oldest deadline 2024-02-10T08:44:12.653313+0000) 2024-02-10T08:44:16.789 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:16.549+0000 7fb94def3700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:50.569091+0000 front 2024-02-10T08:43:50.569194+0000 (oldest deadline 2024-02-10T08:44:15.269354+0000) 2024-02-10T08:44:16.790 INFO:journalctl@ceph.osd.5.smithi071.stdout:Feb 10 08:44:16 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-5[49534]: debug 2024-02-10T08:44:16.531+0000 7fc080571700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:50.525921+0000 front 2024-02-10T08:43:50.525972+0000 (oldest deadline 2024-02-10T08:44:16.425970+0000) 2024-02-10T08:44:16.904 INFO:journalctl@ceph.osd.3.smithi018.stdout:Feb 10 08:44:16 smithi018 bash[195983]: ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-3 2024-02-10T08:44:17.539 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:17.526+0000 7fb94def3700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:50.569091+0000 front 2024-02-10T08:43:50.569194+0000 (oldest deadline 2024-02-10T08:44:15.269354+0000) 2024-02-10T08:44:17.539 INFO:journalctl@ceph.osd.4.smithi071.stdout:Feb 10 08:44:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-4[132092]: debug 2024-02-10T08:44:17.279+0000 7f0cd0a8b700 -1 osd.4 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:52.061388+0000 front 2024-02-10T08:43:52.061397+0000 (oldest deadline 2024-02-10T08:44:14.361143+0000) 2024-02-10T08:44:18.039 INFO:journalctl@ceph.osd.5.smithi071.stdout:Feb 10 08:44:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-5[49534]: debug 2024-02-10T08:44:17.575+0000 7fc080571700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:50.525921+0000 front 2024-02-10T08:43:50.525972+0000 (oldest deadline 2024-02-10T08:44:16.425970+0000) 2024-02-10T08:44:18.039 INFO:journalctl@ceph.osd.6.smithi071.stdout:Feb 10 08:44:17 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-6[53993]: debug 2024-02-10T08:44:17.767+0000 7fd5c11a9700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:49.153442+0000 front 2024-02-10T08:43:49.153401+0000 (oldest deadline 2024-02-10T08:44:12.653313+0000) 2024-02-10T08:44:18.627 DEBUG:teuthology.orchestra.run.smithi018:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d46257c8-c7eb-11ee-95b8-87774f69a715@osd.3.service' 2024-02-10T08:44:18.671 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-10T08:44:18.672 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-02-10T08:44:18.672 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-02-10T08:44:18.672 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ceph-d46257c8-c7eb-11ee-95b8-87774f69a715@osd.4 2024-02-10T08:44:18.704 INFO:journalctl@ceph.osd.5.smithi071.stdout:Feb 10 08:44:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-5[49534]: debug 2024-02-10T08:44:18.538+0000 7fc080571700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:50.525921+0000 front 2024-02-10T08:43:50.525972+0000 (oldest deadline 2024-02-10T08:44:16.425970+0000) 2024-02-10T08:44:18.705 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:18.537+0000 7fb94def3700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:50.569091+0000 front 2024-02-10T08:43:50.569194+0000 (oldest deadline 2024-02-10T08:44:15.269354+0000) 2024-02-10T08:44:18.705 INFO:journalctl@ceph.osd.4.smithi071.stdout:Feb 10 08:44:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-4[132092]: debug 2024-02-10T08:44:18.324+0000 7f0cd0a8b700 -1 osd.4 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:52.061388+0000 front 2024-02-10T08:43:52.061397+0000 (oldest deadline 2024-02-10T08:44:14.361143+0000) 2024-02-10T08:44:18.969 INFO:journalctl@ceph.osd.6.smithi071.stdout:Feb 10 08:44:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-6[53993]: debug 2024-02-10T08:44:18.748+0000 7fd5c11a9700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:49.153442+0000 front 2024-02-10T08:43:49.153401+0000 (oldest deadline 2024-02-10T08:44:12.653313+0000) 2024-02-10T08:44:18.969 INFO:journalctl@ceph.osd.4.smithi071.stdout:Feb 10 08:44:18 smithi071 systemd[1]: Stopping Ceph osd.4 for d46257c8-c7eb-11ee-95b8-87774f69a715... 2024-02-10T08:44:18.969 INFO:journalctl@ceph.osd.4.smithi071.stdout:Feb 10 08:44:18 smithi071 bash[135379]: Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T08:44:19.288 INFO:journalctl@ceph.osd.4.smithi071.stdout:Feb 10 08:44:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-4[132092]: debug 2024-02-10T08:44:18.968+0000 7f0cd6b14700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-10T08:44:19.288 INFO:journalctl@ceph.osd.4.smithi071.stdout:Feb 10 08:44:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-4[132092]: debug 2024-02-10T08:44:18.968+0000 7f0cd6b14700 -1 osd.4 512 *** Got signal Terminated *** 2024-02-10T08:44:19.288 INFO:journalctl@ceph.osd.4.smithi071.stdout:Feb 10 08:44:18 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-4[132092]: debug 2024-02-10T08:44:18.968+0000 7f0cd6b14700 -1 osd.4 512 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-10T08:44:20.039 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:19.586+0000 7fb94def3700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:50.569091+0000 front 2024-02-10T08:43:50.569194+0000 (oldest deadline 2024-02-10T08:44:15.269354+0000) 2024-02-10T08:44:20.040 INFO:journalctl@ceph.osd.5.smithi071.stdout:Feb 10 08:44:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-5[49534]: debug 2024-02-10T08:44:19.567+0000 7fc080571700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:50.525921+0000 front 2024-02-10T08:43:50.525972+0000 (oldest deadline 2024-02-10T08:44:16.425970+0000) 2024-02-10T08:44:20.040 INFO:journalctl@ceph.osd.4.smithi071.stdout:Feb 10 08:44:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-4[132092]: debug 2024-02-10T08:44:19.288+0000 7f0cd0a8b700 -1 osd.4 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:52.061388+0000 front 2024-02-10T08:43:52.061397+0000 (oldest deadline 2024-02-10T08:44:14.361143+0000) 2024-02-10T08:44:20.041 INFO:journalctl@ceph.osd.6.smithi071.stdout:Feb 10 08:44:19 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-6[53993]: debug 2024-02-10T08:44:19.762+0000 7fd5c11a9700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:49.153442+0000 front 2024-02-10T08:43:49.153401+0000 (oldest deadline 2024-02-10T08:44:12.653313+0000) 2024-02-10T08:44:20.539 INFO:journalctl@ceph.osd.4.smithi071.stdout:Feb 10 08:44:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-4[132092]: debug 2024-02-10T08:44:20.286+0000 7f0cd0a8b700 -1 osd.4 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:52.061388+0000 front 2024-02-10T08:43:52.061397+0000 (oldest deadline 2024-02-10T08:44:14.361143+0000) 2024-02-10T08:44:21.039 INFO:journalctl@ceph.osd.5.smithi071.stdout:Feb 10 08:44:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-5[49534]: debug 2024-02-10T08:44:20.601+0000 7fc080571700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:50.525921+0000 front 2024-02-10T08:43:50.525972+0000 (oldest deadline 2024-02-10T08:44:16.425970+0000) 2024-02-10T08:44:21.039 INFO:journalctl@ceph.osd.6.smithi071.stdout:Feb 10 08:44:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-6[53993]: debug 2024-02-10T08:44:20.778+0000 7fd5c11a9700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:49.153442+0000 front 2024-02-10T08:43:49.153401+0000 (oldest deadline 2024-02-10T08:44:12.653313+0000) 2024-02-10T08:44:21.040 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:20.592+0000 7fb94def3700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:50.569091+0000 front 2024-02-10T08:43:50.569194+0000 (oldest deadline 2024-02-10T08:44:15.269354+0000) 2024-02-10T08:44:21.539 INFO:journalctl@ceph.osd.4.smithi071.stdout:Feb 10 08:44:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-4[132092]: debug 2024-02-10T08:44:21.245+0000 7f0cd0a8b700 -1 osd.4 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:52.061388+0000 front 2024-02-10T08:43:52.061397+0000 (oldest deadline 2024-02-10T08:44:14.361143+0000) 2024-02-10T08:44:22.039 INFO:journalctl@ceph.osd.5.smithi071.stdout:Feb 10 08:44:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-5[49534]: debug 2024-02-10T08:44:21.574+0000 7fc080571700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:50.525921+0000 front 2024-02-10T08:43:50.525972+0000 (oldest deadline 2024-02-10T08:44:16.425970+0000) 2024-02-10T08:44:22.039 INFO:journalctl@ceph.osd.6.smithi071.stdout:Feb 10 08:44:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-6[53993]: debug 2024-02-10T08:44:21.763+0000 7fd5c11a9700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:49.153442+0000 front 2024-02-10T08:43:49.153401+0000 (oldest deadline 2024-02-10T08:44:12.653313+0000) 2024-02-10T08:44:22.040 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:21 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:21.634+0000 7fb94def3700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:50.569091+0000 front 2024-02-10T08:43:50.569194+0000 (oldest deadline 2024-02-10T08:44:15.269354+0000) 2024-02-10T08:44:22.539 INFO:journalctl@ceph.osd.4.smithi071.stdout:Feb 10 08:44:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-4[132092]: debug 2024-02-10T08:44:22.266+0000 7f0cd0a8b700 -1 osd.4 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:52.061388+0000 front 2024-02-10T08:43:52.061397+0000 (oldest deadline 2024-02-10T08:44:14.361143+0000) 2024-02-10T08:44:22.539 INFO:journalctl@ceph.osd.4.smithi071.stdout:Feb 10 08:44:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-4[132092]: debug 2024-02-10T08:44:22.266+0000 7f0cd0a8b700 -1 osd.4 512 heartbeat_check: no reply from 172.21.15.18:6807 osd.1 since back 2024-02-10T08:43:59.062152+0000 front 2024-02-10T08:43:59.062096+0000 (oldest deadline 2024-02-10T08:44:21.961964+0000) 2024-02-10T08:44:23.039 INFO:journalctl@ceph.osd.5.smithi071.stdout:Feb 10 08:44:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-5[49534]: debug 2024-02-10T08:44:22.577+0000 7fc080571700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:50.525921+0000 front 2024-02-10T08:43:50.525972+0000 (oldest deadline 2024-02-10T08:44:16.425970+0000) 2024-02-10T08:44:23.039 INFO:journalctl@ceph.osd.6.smithi071.stdout:Feb 10 08:44:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-6[53993]: debug 2024-02-10T08:44:22.765+0000 7fd5c11a9700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:49.153442+0000 front 2024-02-10T08:43:49.153401+0000 (oldest deadline 2024-02-10T08:44:12.653313+0000) 2024-02-10T08:44:23.039 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:22.662+0000 7fb94def3700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:50.569091+0000 front 2024-02-10T08:43:50.569194+0000 (oldest deadline 2024-02-10T08:44:15.269354+0000) 2024-02-10T08:44:23.040 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:22 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:22.662+0000 7fb94def3700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.18:6807 osd.1 since back 2024-02-10T08:43:59.270934+0000 front 2024-02-10T08:43:59.270953+0000 (oldest deadline 2024-02-10T08:44:22.170849+0000) 2024-02-10T08:44:23.622 INFO:journalctl@ceph.osd.4.smithi071.stdout:Feb 10 08:44:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-4[132092]: debug 2024-02-10T08:44:23.306+0000 7f0cd0a8b700 -1 osd.4 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:52.061388+0000 front 2024-02-10T08:43:52.061397+0000 (oldest deadline 2024-02-10T08:44:14.361143+0000) 2024-02-10T08:44:23.622 INFO:journalctl@ceph.osd.4.smithi071.stdout:Feb 10 08:44:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-4[132092]: debug 2024-02-10T08:44:23.306+0000 7f0cd0a8b700 -1 osd.4 512 heartbeat_check: no reply from 172.21.15.18:6807 osd.1 since back 2024-02-10T08:43:59.062152+0000 front 2024-02-10T08:43:59.062096+0000 (oldest deadline 2024-02-10T08:44:21.961964+0000) 2024-02-10T08:44:24.039 INFO:journalctl@ceph.osd.5.smithi071.stdout:Feb 10 08:44:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-5[49534]: debug 2024-02-10T08:44:23.622+0000 7fc080571700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:50.525921+0000 front 2024-02-10T08:43:50.525972+0000 (oldest deadline 2024-02-10T08:44:16.425970+0000) 2024-02-10T08:44:24.039 INFO:journalctl@ceph.osd.5.smithi071.stdout:Feb 10 08:44:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-5[49534]: debug 2024-02-10T08:44:23.622+0000 7fc080571700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.18:6807 osd.1 since back 2024-02-10T08:43:59.926957+0000 front 2024-02-10T08:43:59.927069+0000 (oldest deadline 2024-02-10T08:44:23.426884+0000) 2024-02-10T08:44:24.039 INFO:journalctl@ceph.osd.6.smithi071.stdout:Feb 10 08:44:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-6[53993]: debug 2024-02-10T08:44:23.762+0000 7fd5c11a9700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:49.153442+0000 front 2024-02-10T08:43:49.153401+0000 (oldest deadline 2024-02-10T08:44:12.653313+0000) 2024-02-10T08:44:24.039 INFO:journalctl@ceph.osd.6.smithi071.stdout:Feb 10 08:44:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-6[53993]: debug 2024-02-10T08:44:23.762+0000 7fd5c11a9700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.18:6807 osd.1 since back 2024-02-10T08:43:58.955260+0000 front 2024-02-10T08:43:58.955243+0000 (oldest deadline 2024-02-10T08:44:23.055145+0000) 2024-02-10T08:44:24.040 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:23.642+0000 7fb94def3700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:50.569091+0000 front 2024-02-10T08:43:50.569194+0000 (oldest deadline 2024-02-10T08:44:15.269354+0000) 2024-02-10T08:44:24.040 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:23 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:23.642+0000 7fb94def3700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.18:6807 osd.1 since back 2024-02-10T08:43:59.270934+0000 front 2024-02-10T08:43:59.270953+0000 (oldest deadline 2024-02-10T08:44:22.170849+0000) 2024-02-10T08:44:24.635 INFO:journalctl@ceph.osd.4.smithi071.stdout:Feb 10 08:44:24 smithi071 bash[135419]: ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-4 2024-02-10T08:44:25.039 INFO:journalctl@ceph.osd.6.smithi071.stdout:Feb 10 08:44:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-6[53993]: debug 2024-02-10T08:44:24.717+0000 7fd5c11a9700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:49.153442+0000 front 2024-02-10T08:43:49.153401+0000 (oldest deadline 2024-02-10T08:44:12.653313+0000) 2024-02-10T08:44:25.039 INFO:journalctl@ceph.osd.6.smithi071.stdout:Feb 10 08:44:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-6[53993]: debug 2024-02-10T08:44:24.717+0000 7fd5c11a9700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.18:6807 osd.1 since back 2024-02-10T08:43:58.955260+0000 front 2024-02-10T08:43:58.955243+0000 (oldest deadline 2024-02-10T08:44:23.055145+0000) 2024-02-10T08:44:25.039 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:24.634+0000 7fb94def3700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:50.569091+0000 front 2024-02-10T08:43:50.569194+0000 (oldest deadline 2024-02-10T08:44:15.269354+0000) 2024-02-10T08:44:25.039 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:24.634+0000 7fb94def3700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.18:6807 osd.1 since back 2024-02-10T08:43:59.270934+0000 front 2024-02-10T08:43:59.270953+0000 (oldest deadline 2024-02-10T08:44:22.170849+0000) 2024-02-10T08:44:25.040 INFO:journalctl@ceph.osd.5.smithi071.stdout:Feb 10 08:44:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-5[49534]: debug 2024-02-10T08:44:24.653+0000 7fc080571700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:50.525921+0000 front 2024-02-10T08:43:50.525972+0000 (oldest deadline 2024-02-10T08:44:16.425970+0000) 2024-02-10T08:44:25.040 INFO:journalctl@ceph.osd.5.smithi071.stdout:Feb 10 08:44:24 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-5[49534]: debug 2024-02-10T08:44:24.653+0000 7fc080571700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.18:6807 osd.1 since back 2024-02-10T08:43:59.926957+0000 front 2024-02-10T08:43:59.927069+0000 (oldest deadline 2024-02-10T08:44:23.426884+0000) 2024-02-10T08:44:25.877 INFO:journalctl@ceph.osd.5.smithi071.stdout:Feb 10 08:44:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-5[49534]: debug 2024-02-10T08:44:25.606+0000 7fc080571700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:50.525921+0000 front 2024-02-10T08:43:50.525972+0000 (oldest deadline 2024-02-10T08:44:16.425970+0000) 2024-02-10T08:44:25.877 INFO:journalctl@ceph.osd.5.smithi071.stdout:Feb 10 08:44:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-5[49534]: debug 2024-02-10T08:44:25.606+0000 7fc080571700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.18:6807 osd.1 since back 2024-02-10T08:43:59.926957+0000 front 2024-02-10T08:43:59.927069+0000 (oldest deadline 2024-02-10T08:44:23.426884+0000) 2024-02-10T08:44:25.877 INFO:journalctl@ceph.osd.6.smithi071.stdout:Feb 10 08:44:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-6[53993]: debug 2024-02-10T08:44:25.718+0000 7fd5c11a9700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:49.153442+0000 front 2024-02-10T08:43:49.153401+0000 (oldest deadline 2024-02-10T08:44:12.653313+0000) 2024-02-10T08:44:25.878 INFO:journalctl@ceph.osd.6.smithi071.stdout:Feb 10 08:44:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-6[53993]: debug 2024-02-10T08:44:25.718+0000 7fd5c11a9700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.18:6807 osd.1 since back 2024-02-10T08:43:58.955260+0000 front 2024-02-10T08:43:58.955243+0000 (oldest deadline 2024-02-10T08:44:23.055145+0000) 2024-02-10T08:44:25.878 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:25.658+0000 7fb94def3700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:50.569091+0000 front 2024-02-10T08:43:50.569194+0000 (oldest deadline 2024-02-10T08:44:15.269354+0000) 2024-02-10T08:44:25.878 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:25 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:25.658+0000 7fb94def3700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.18:6807 osd.1 since back 2024-02-10T08:43:59.270934+0000 front 2024-02-10T08:43:59.270953+0000 (oldest deadline 2024-02-10T08:44:22.170849+0000) 2024-02-10T08:44:26.287 DEBUG:teuthology.orchestra.run.smithi071:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d46257c8-c7eb-11ee-95b8-87774f69a715@osd.4.service' 2024-02-10T08:44:26.367 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-10T08:44:26.368 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-02-10T08:44:26.368 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-02-10T08:44:26.368 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ceph-d46257c8-c7eb-11ee-95b8-87774f69a715@osd.5 2024-02-10T08:44:26.539 INFO:journalctl@ceph.osd.5.smithi071.stdout:Feb 10 08:44:26 smithi071 systemd[1]: Stopping Ceph osd.5 for d46257c8-c7eb-11ee-95b8-87774f69a715... 2024-02-10T08:44:26.539 INFO:journalctl@ceph.osd.5.smithi071.stdout:Feb 10 08:44:26 smithi071 bash[135653]: Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T08:44:27.039 INFO:journalctl@ceph.osd.6.smithi071.stdout:Feb 10 08:44:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-6[53993]: debug 2024-02-10T08:44:26.690+0000 7fd5c11a9700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:49.153442+0000 front 2024-02-10T08:43:49.153401+0000 (oldest deadline 2024-02-10T08:44:12.653313+0000) 2024-02-10T08:44:27.039 INFO:journalctl@ceph.osd.6.smithi071.stdout:Feb 10 08:44:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-6[53993]: debug 2024-02-10T08:44:26.690+0000 7fd5c11a9700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.18:6807 osd.1 since back 2024-02-10T08:43:58.955260+0000 front 2024-02-10T08:43:58.955243+0000 (oldest deadline 2024-02-10T08:44:23.055145+0000) 2024-02-10T08:44:27.039 INFO:journalctl@ceph.osd.5.smithi071.stdout:Feb 10 08:44:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-5[49534]: debug 2024-02-10T08:44:26.604+0000 7fc080571700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:50.525921+0000 front 2024-02-10T08:43:50.525972+0000 (oldest deadline 2024-02-10T08:44:16.425970+0000) 2024-02-10T08:44:27.039 INFO:journalctl@ceph.osd.5.smithi071.stdout:Feb 10 08:44:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-5[49534]: debug 2024-02-10T08:44:26.604+0000 7fc080571700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.18:6807 osd.1 since back 2024-02-10T08:43:59.926957+0000 front 2024-02-10T08:43:59.927069+0000 (oldest deadline 2024-02-10T08:44:23.426884+0000) 2024-02-10T08:44:27.039 INFO:journalctl@ceph.osd.5.smithi071.stdout:Feb 10 08:44:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-5[49534]: debug 2024-02-10T08:44:26.731+0000 7fc0875fc700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-10T08:44:27.040 INFO:journalctl@ceph.osd.5.smithi071.stdout:Feb 10 08:44:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-5[49534]: debug 2024-02-10T08:44:26.731+0000 7fc0875fc700 -1 osd.5 512 *** Got signal Terminated *** 2024-02-10T08:44:27.040 INFO:journalctl@ceph.osd.5.smithi071.stdout:Feb 10 08:44:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-5[49534]: debug 2024-02-10T08:44:26.731+0000 7fc0875fc700 -1 osd.5 512 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-10T08:44:27.040 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:26.654+0000 7fb94def3700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:50.569091+0000 front 2024-02-10T08:43:50.569194+0000 (oldest deadline 2024-02-10T08:44:15.269354+0000) 2024-02-10T08:44:27.040 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:26 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:26.655+0000 7fb94def3700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.18:6807 osd.1 since back 2024-02-10T08:43:59.270934+0000 front 2024-02-10T08:43:59.270953+0000 (oldest deadline 2024-02-10T08:44:22.170849+0000) 2024-02-10T08:44:28.039 INFO:journalctl@ceph.osd.6.smithi071.stdout:Feb 10 08:44:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-6[53993]: debug 2024-02-10T08:44:27.719+0000 7fd5c11a9700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:49.153442+0000 front 2024-02-10T08:43:49.153401+0000 (oldest deadline 2024-02-10T08:44:12.653313+0000) 2024-02-10T08:44:28.039 INFO:journalctl@ceph.osd.6.smithi071.stdout:Feb 10 08:44:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-6[53993]: debug 2024-02-10T08:44:27.719+0000 7fd5c11a9700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.18:6807 osd.1 since back 2024-02-10T08:43:58.955260+0000 front 2024-02-10T08:43:58.955243+0000 (oldest deadline 2024-02-10T08:44:23.055145+0000) 2024-02-10T08:44:28.040 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:27.608+0000 7fb94def3700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:50.569091+0000 front 2024-02-10T08:43:50.569194+0000 (oldest deadline 2024-02-10T08:44:15.269354+0000) 2024-02-10T08:44:28.040 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:27.608+0000 7fb94def3700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.18:6807 osd.1 since back 2024-02-10T08:43:59.270934+0000 front 2024-02-10T08:43:59.270953+0000 (oldest deadline 2024-02-10T08:44:22.170849+0000) 2024-02-10T08:44:28.040 INFO:journalctl@ceph.osd.5.smithi071.stdout:Feb 10 08:44:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-5[49534]: debug 2024-02-10T08:44:27.633+0000 7fc080571700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:50.525921+0000 front 2024-02-10T08:43:50.525972+0000 (oldest deadline 2024-02-10T08:44:16.425970+0000) 2024-02-10T08:44:28.040 INFO:journalctl@ceph.osd.5.smithi071.stdout:Feb 10 08:44:27 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-5[49534]: debug 2024-02-10T08:44:27.633+0000 7fc080571700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.18:6807 osd.1 since back 2024-02-10T08:43:59.926957+0000 front 2024-02-10T08:43:59.927069+0000 (oldest deadline 2024-02-10T08:44:23.426884+0000) 2024-02-10T08:44:29.039 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:28.615+0000 7fb94def3700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:50.569091+0000 front 2024-02-10T08:43:50.569194+0000 (oldest deadline 2024-02-10T08:44:15.269354+0000) 2024-02-10T08:44:29.039 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:28.615+0000 7fb94def3700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.18:6807 osd.1 since back 2024-02-10T08:43:59.270934+0000 front 2024-02-10T08:43:59.270953+0000 (oldest deadline 2024-02-10T08:44:22.170849+0000) 2024-02-10T08:44:29.040 INFO:journalctl@ceph.osd.5.smithi071.stdout:Feb 10 08:44:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-5[49534]: debug 2024-02-10T08:44:28.629+0000 7fc080571700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:50.525921+0000 front 2024-02-10T08:43:50.525972+0000 (oldest deadline 2024-02-10T08:44:16.425970+0000) 2024-02-10T08:44:29.040 INFO:journalctl@ceph.osd.5.smithi071.stdout:Feb 10 08:44:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-5[49534]: debug 2024-02-10T08:44:28.629+0000 7fc080571700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.18:6807 osd.1 since back 2024-02-10T08:43:59.926957+0000 front 2024-02-10T08:43:59.927069+0000 (oldest deadline 2024-02-10T08:44:23.426884+0000) 2024-02-10T08:44:29.040 INFO:journalctl@ceph.osd.6.smithi071.stdout:Feb 10 08:44:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-6[53993]: debug 2024-02-10T08:44:28.694+0000 7fd5c11a9700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:49.153442+0000 front 2024-02-10T08:43:49.153401+0000 (oldest deadline 2024-02-10T08:44:12.653313+0000) 2024-02-10T08:44:29.040 INFO:journalctl@ceph.osd.6.smithi071.stdout:Feb 10 08:44:28 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-6[53993]: debug 2024-02-10T08:44:28.694+0000 7fd5c11a9700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.18:6807 osd.1 since back 2024-02-10T08:43:58.955260+0000 front 2024-02-10T08:43:58.955243+0000 (oldest deadline 2024-02-10T08:44:23.055145+0000) 2024-02-10T08:44:30.039 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:29.659+0000 7fb94def3700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:50.569091+0000 front 2024-02-10T08:43:50.569194+0000 (oldest deadline 2024-02-10T08:44:15.269354+0000) 2024-02-10T08:44:30.039 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:29.659+0000 7fb94def3700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.18:6807 osd.1 since back 2024-02-10T08:43:59.270934+0000 front 2024-02-10T08:43:59.270953+0000 (oldest deadline 2024-02-10T08:44:22.170849+0000) 2024-02-10T08:44:30.040 INFO:journalctl@ceph.osd.5.smithi071.stdout:Feb 10 08:44:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-5[49534]: debug 2024-02-10T08:44:29.581+0000 7fc080571700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:50.525921+0000 front 2024-02-10T08:43:50.525972+0000 (oldest deadline 2024-02-10T08:44:16.425970+0000) 2024-02-10T08:44:30.040 INFO:journalctl@ceph.osd.5.smithi071.stdout:Feb 10 08:44:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-5[49534]: debug 2024-02-10T08:44:29.581+0000 7fc080571700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.18:6807 osd.1 since back 2024-02-10T08:43:59.926957+0000 front 2024-02-10T08:43:59.927069+0000 (oldest deadline 2024-02-10T08:44:23.426884+0000) 2024-02-10T08:44:30.040 INFO:journalctl@ceph.osd.5.smithi071.stdout:Feb 10 08:44:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-5[49534]: debug 2024-02-10T08:44:29.581+0000 7fc080571700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.18:6811 osd.2 since back 2024-02-10T08:44:03.427475+0000 front 2024-02-10T08:44:03.427459+0000 (oldest deadline 2024-02-10T08:44:28.727370+0000) 2024-02-10T08:44:30.040 INFO:journalctl@ceph.osd.6.smithi071.stdout:Feb 10 08:44:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-6[53993]: debug 2024-02-10T08:44:29.686+0000 7fd5c11a9700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:49.153442+0000 front 2024-02-10T08:43:49.153401+0000 (oldest deadline 2024-02-10T08:44:12.653313+0000) 2024-02-10T08:44:30.040 INFO:journalctl@ceph.osd.6.smithi071.stdout:Feb 10 08:44:29 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-6[53993]: debug 2024-02-10T08:44:29.686+0000 7fd5c11a9700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.18:6807 osd.1 since back 2024-02-10T08:43:58.955260+0000 front 2024-02-10T08:43:58.955243+0000 (oldest deadline 2024-02-10T08:44:23.055145+0000) 2024-02-10T08:44:30.789 INFO:journalctl@ceph.osd.5.smithi071.stdout:Feb 10 08:44:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-5[49534]: debug 2024-02-10T08:44:30.536+0000 7fc080571700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:50.525921+0000 front 2024-02-10T08:43:50.525972+0000 (oldest deadline 2024-02-10T08:44:16.425970+0000) 2024-02-10T08:44:30.789 INFO:journalctl@ceph.osd.5.smithi071.stdout:Feb 10 08:44:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-5[49534]: debug 2024-02-10T08:44:30.536+0000 7fc080571700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.18:6807 osd.1 since back 2024-02-10T08:43:59.926957+0000 front 2024-02-10T08:43:59.927069+0000 (oldest deadline 2024-02-10T08:44:23.426884+0000) 2024-02-10T08:44:30.789 INFO:journalctl@ceph.osd.5.smithi071.stdout:Feb 10 08:44:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-5[49534]: debug 2024-02-10T08:44:30.536+0000 7fc080571700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.18:6811 osd.2 since back 2024-02-10T08:44:03.427475+0000 front 2024-02-10T08:44:03.427459+0000 (oldest deadline 2024-02-10T08:44:28.727370+0000) 2024-02-10T08:44:30.789 INFO:journalctl@ceph.osd.6.smithi071.stdout:Feb 10 08:44:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-6[53993]: debug 2024-02-10T08:44:30.677+0000 7fd5c11a9700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:49.153442+0000 front 2024-02-10T08:43:49.153401+0000 (oldest deadline 2024-02-10T08:44:12.653313+0000) 2024-02-10T08:44:30.789 INFO:journalctl@ceph.osd.6.smithi071.stdout:Feb 10 08:44:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-6[53993]: debug 2024-02-10T08:44:30.677+0000 7fd5c11a9700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.18:6807 osd.1 since back 2024-02-10T08:43:58.955260+0000 front 2024-02-10T08:43:58.955243+0000 (oldest deadline 2024-02-10T08:44:23.055145+0000) 2024-02-10T08:44:30.790 INFO:journalctl@ceph.osd.6.smithi071.stdout:Feb 10 08:44:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-6[53993]: debug 2024-02-10T08:44:30.677+0000 7fd5c11a9700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.18:6811 osd.2 since back 2024-02-10T08:44:05.955982+0000 front 2024-02-10T08:44:05.955912+0000 (oldest deadline 2024-02-10T08:44:30.655898+0000) 2024-02-10T08:44:30.790 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:30.611+0000 7fb94def3700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:50.569091+0000 front 2024-02-10T08:43:50.569194+0000 (oldest deadline 2024-02-10T08:44:15.269354+0000) 2024-02-10T08:44:30.790 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:30.611+0000 7fb94def3700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.18:6807 osd.1 since back 2024-02-10T08:43:59.270934+0000 front 2024-02-10T08:43:59.270953+0000 (oldest deadline 2024-02-10T08:44:22.170849+0000) 2024-02-10T08:44:30.790 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:30 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:30.611+0000 7fb94def3700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.18:6811 osd.2 since back 2024-02-10T08:44:04.372060+0000 front 2024-02-10T08:44:04.372150+0000 (oldest deadline 2024-02-10T08:44:29.672016+0000) 2024-02-10T08:44:32.039 INFO:journalctl@ceph.osd.6.smithi071.stdout:Feb 10 08:44:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-6[53993]: debug 2024-02-10T08:44:31.697+0000 7fd5c11a9700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:49.153442+0000 front 2024-02-10T08:43:49.153401+0000 (oldest deadline 2024-02-10T08:44:12.653313+0000) 2024-02-10T08:44:32.039 INFO:journalctl@ceph.osd.6.smithi071.stdout:Feb 10 08:44:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-6[53993]: debug 2024-02-10T08:44:31.697+0000 7fd5c11a9700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.18:6807 osd.1 since back 2024-02-10T08:43:58.955260+0000 front 2024-02-10T08:43:58.955243+0000 (oldest deadline 2024-02-10T08:44:23.055145+0000) 2024-02-10T08:44:32.039 INFO:journalctl@ceph.osd.6.smithi071.stdout:Feb 10 08:44:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-6[53993]: debug 2024-02-10T08:44:31.697+0000 7fd5c11a9700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.18:6811 osd.2 since back 2024-02-10T08:44:05.955982+0000 front 2024-02-10T08:44:05.955912+0000 (oldest deadline 2024-02-10T08:44:30.655898+0000) 2024-02-10T08:44:32.039 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:31.565+0000 7fb94def3700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:50.569091+0000 front 2024-02-10T08:43:50.569194+0000 (oldest deadline 2024-02-10T08:44:15.269354+0000) 2024-02-10T08:44:32.040 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:31.565+0000 7fb94def3700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.18:6807 osd.1 since back 2024-02-10T08:43:59.270934+0000 front 2024-02-10T08:43:59.270953+0000 (oldest deadline 2024-02-10T08:44:22.170849+0000) 2024-02-10T08:44:32.040 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:31.565+0000 7fb94def3700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.18:6811 osd.2 since back 2024-02-10T08:44:04.372060+0000 front 2024-02-10T08:44:04.372150+0000 (oldest deadline 2024-02-10T08:44:29.672016+0000) 2024-02-10T08:44:32.040 INFO:journalctl@ceph.osd.5.smithi071.stdout:Feb 10 08:44:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-5[49534]: debug 2024-02-10T08:44:31.551+0000 7fc080571700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:50.525921+0000 front 2024-02-10T08:43:50.525972+0000 (oldest deadline 2024-02-10T08:44:16.425970+0000) 2024-02-10T08:44:32.040 INFO:journalctl@ceph.osd.5.smithi071.stdout:Feb 10 08:44:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-5[49534]: debug 2024-02-10T08:44:31.551+0000 7fc080571700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.18:6807 osd.1 since back 2024-02-10T08:43:59.926957+0000 front 2024-02-10T08:43:59.927069+0000 (oldest deadline 2024-02-10T08:44:23.426884+0000) 2024-02-10T08:44:32.040 INFO:journalctl@ceph.osd.5.smithi071.stdout:Feb 10 08:44:31 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-5[49534]: debug 2024-02-10T08:44:31.551+0000 7fc080571700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.18:6811 osd.2 since back 2024-02-10T08:44:03.427475+0000 front 2024-02-10T08:44:03.427459+0000 (oldest deadline 2024-02-10T08:44:28.727370+0000) 2024-02-10T08:44:32.539 INFO:journalctl@ceph.osd.5.smithi071.stdout:Feb 10 08:44:32 smithi071 bash[135693]: ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-5 2024-02-10T08:44:33.023 INFO:journalctl@ceph.osd.6.smithi071.stdout:Feb 10 08:44:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-6[53993]: debug 2024-02-10T08:44:32.737+0000 7fd5c11a9700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:49.153442+0000 front 2024-02-10T08:43:49.153401+0000 (oldest deadline 2024-02-10T08:44:12.653313+0000) 2024-02-10T08:44:33.023 INFO:journalctl@ceph.osd.6.smithi071.stdout:Feb 10 08:44:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-6[53993]: debug 2024-02-10T08:44:32.737+0000 7fd5c11a9700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.18:6807 osd.1 since back 2024-02-10T08:43:58.955260+0000 front 2024-02-10T08:43:58.955243+0000 (oldest deadline 2024-02-10T08:44:23.055145+0000) 2024-02-10T08:44:33.024 INFO:journalctl@ceph.osd.6.smithi071.stdout:Feb 10 08:44:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-6[53993]: debug 2024-02-10T08:44:32.737+0000 7fd5c11a9700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.18:6811 osd.2 since back 2024-02-10T08:44:05.955982+0000 front 2024-02-10T08:44:05.955912+0000 (oldest deadline 2024-02-10T08:44:30.655898+0000) 2024-02-10T08:44:33.024 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:32.565+0000 7fb94def3700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:50.569091+0000 front 2024-02-10T08:43:50.569194+0000 (oldest deadline 2024-02-10T08:44:15.269354+0000) 2024-02-10T08:44:33.024 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:32.565+0000 7fb94def3700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.18:6807 osd.1 since back 2024-02-10T08:43:59.270934+0000 front 2024-02-10T08:43:59.270953+0000 (oldest deadline 2024-02-10T08:44:22.170849+0000) 2024-02-10T08:44:33.024 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:32 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:32.565+0000 7fb94def3700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.18:6811 osd.2 since back 2024-02-10T08:44:04.372060+0000 front 2024-02-10T08:44:04.372150+0000 (oldest deadline 2024-02-10T08:44:29.672016+0000) 2024-02-10T08:44:33.787 INFO:journalctl@ceph.osd.6.smithi071.stdout:Feb 10 08:44:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-6[53993]: debug 2024-02-10T08:44:33.719+0000 7fd5c11a9700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:49.153442+0000 front 2024-02-10T08:43:49.153401+0000 (oldest deadline 2024-02-10T08:44:12.653313+0000) 2024-02-10T08:44:33.787 INFO:journalctl@ceph.osd.6.smithi071.stdout:Feb 10 08:44:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-6[53993]: debug 2024-02-10T08:44:33.719+0000 7fd5c11a9700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.18:6807 osd.1 since back 2024-02-10T08:43:58.955260+0000 front 2024-02-10T08:43:58.955243+0000 (oldest deadline 2024-02-10T08:44:23.055145+0000) 2024-02-10T08:44:33.787 INFO:journalctl@ceph.osd.6.smithi071.stdout:Feb 10 08:44:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-6[53993]: debug 2024-02-10T08:44:33.719+0000 7fd5c11a9700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.18:6811 osd.2 since back 2024-02-10T08:44:05.955982+0000 front 2024-02-10T08:44:05.955912+0000 (oldest deadline 2024-02-10T08:44:30.655898+0000) 2024-02-10T08:44:33.787 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:33.538+0000 7fb94def3700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:50.569091+0000 front 2024-02-10T08:43:50.569194+0000 (oldest deadline 2024-02-10T08:44:15.269354+0000) 2024-02-10T08:44:33.788 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:33.538+0000 7fb94def3700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.18:6807 osd.1 since back 2024-02-10T08:43:59.270934+0000 front 2024-02-10T08:43:59.270953+0000 (oldest deadline 2024-02-10T08:44:22.170849+0000) 2024-02-10T08:44:33.788 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:33 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:33.538+0000 7fb94def3700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.18:6811 osd.2 since back 2024-02-10T08:44:04.372060+0000 front 2024-02-10T08:44:04.372150+0000 (oldest deadline 2024-02-10T08:44:29.672016+0000) 2024-02-10T08:44:34.106 DEBUG:teuthology.orchestra.run.smithi071:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d46257c8-c7eb-11ee-95b8-87774f69a715@osd.5.service' 2024-02-10T08:44:34.147 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-10T08:44:34.148 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-02-10T08:44:34.148 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-02-10T08:44:34.148 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ceph-d46257c8-c7eb-11ee-95b8-87774f69a715@osd.6 2024-02-10T08:44:34.521 INFO:journalctl@ceph.osd.6.smithi071.stdout:Feb 10 08:44:34 smithi071 systemd[1]: Stopping Ceph osd.6 for d46257c8-c7eb-11ee-95b8-87774f69a715... 2024-02-10T08:44:34.521 INFO:journalctl@ceph.osd.6.smithi071.stdout:Feb 10 08:44:34 smithi071 bash[135927]: Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T08:44:34.792 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:34.519+0000 7fb94def3700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:50.569091+0000 front 2024-02-10T08:43:50.569194+0000 (oldest deadline 2024-02-10T08:44:15.269354+0000) 2024-02-10T08:44:34.792 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:34.519+0000 7fb94def3700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.18:6807 osd.1 since back 2024-02-10T08:43:59.270934+0000 front 2024-02-10T08:43:59.270953+0000 (oldest deadline 2024-02-10T08:44:22.170849+0000) 2024-02-10T08:44:34.792 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:34.519+0000 7fb94def3700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.18:6811 osd.2 since back 2024-02-10T08:44:04.372060+0000 front 2024-02-10T08:44:04.372150+0000 (oldest deadline 2024-02-10T08:44:29.672016+0000) 2024-02-10T08:44:34.792 INFO:journalctl@ceph.osd.6.smithi071.stdout:Feb 10 08:44:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-6[53993]: debug 2024-02-10T08:44:34.659+0000 7fd5c6230700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-10T08:44:34.792 INFO:journalctl@ceph.osd.6.smithi071.stdout:Feb 10 08:44:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-6[53993]: debug 2024-02-10T08:44:34.659+0000 7fd5c6230700 -1 osd.6 512 *** Got signal Terminated *** 2024-02-10T08:44:34.792 INFO:journalctl@ceph.osd.6.smithi071.stdout:Feb 10 08:44:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-6[53993]: debug 2024-02-10T08:44:34.659+0000 7fd5c6230700 -1 osd.6 512 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-10T08:44:34.792 INFO:journalctl@ceph.osd.6.smithi071.stdout:Feb 10 08:44:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-6[53993]: debug 2024-02-10T08:44:34.752+0000 7fd5c11a9700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:49.153442+0000 front 2024-02-10T08:43:49.153401+0000 (oldest deadline 2024-02-10T08:44:12.653313+0000) 2024-02-10T08:44:34.792 INFO:journalctl@ceph.osd.6.smithi071.stdout:Feb 10 08:44:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-6[53993]: debug 2024-02-10T08:44:34.752+0000 7fd5c11a9700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.18:6807 osd.1 since back 2024-02-10T08:43:58.955260+0000 front 2024-02-10T08:43:58.955243+0000 (oldest deadline 2024-02-10T08:44:23.055145+0000) 2024-02-10T08:44:34.792 INFO:journalctl@ceph.osd.6.smithi071.stdout:Feb 10 08:44:34 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-6[53993]: debug 2024-02-10T08:44:34.752+0000 7fd5c11a9700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.18:6811 osd.2 since back 2024-02-10T08:44:05.955982+0000 front 2024-02-10T08:44:05.955912+0000 (oldest deadline 2024-02-10T08:44:30.655898+0000) 2024-02-10T08:44:35.756 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:35.471+0000 7fb94def3700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:50.569091+0000 front 2024-02-10T08:43:50.569194+0000 (oldest deadline 2024-02-10T08:44:15.269354+0000) 2024-02-10T08:44:35.756 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:35.471+0000 7fb94def3700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.18:6807 osd.1 since back 2024-02-10T08:43:59.270934+0000 front 2024-02-10T08:43:59.270953+0000 (oldest deadline 2024-02-10T08:44:22.170849+0000) 2024-02-10T08:44:35.756 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:35.471+0000 7fb94def3700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.18:6811 osd.2 since back 2024-02-10T08:44:04.372060+0000 front 2024-02-10T08:44:04.372150+0000 (oldest deadline 2024-02-10T08:44:29.672016+0000) 2024-02-10T08:44:36.039 INFO:journalctl@ceph.osd.6.smithi071.stdout:Feb 10 08:44:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-6[53993]: debug 2024-02-10T08:44:35.754+0000 7fd5c11a9700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:49.153442+0000 front 2024-02-10T08:43:49.153401+0000 (oldest deadline 2024-02-10T08:44:12.653313+0000) 2024-02-10T08:44:36.039 INFO:journalctl@ceph.osd.6.smithi071.stdout:Feb 10 08:44:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-6[53993]: debug 2024-02-10T08:44:35.754+0000 7fd5c11a9700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.18:6807 osd.1 since back 2024-02-10T08:43:58.955260+0000 front 2024-02-10T08:43:58.955243+0000 (oldest deadline 2024-02-10T08:44:23.055145+0000) 2024-02-10T08:44:36.039 INFO:journalctl@ceph.osd.6.smithi071.stdout:Feb 10 08:44:35 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-6[53993]: debug 2024-02-10T08:44:35.754+0000 7fd5c11a9700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.18:6811 osd.2 since back 2024-02-10T08:44:05.955982+0000 front 2024-02-10T08:44:05.955912+0000 (oldest deadline 2024-02-10T08:44:30.655898+0000) 2024-02-10T08:44:36.789 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:36.487+0000 7fb94def3700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:50.569091+0000 front 2024-02-10T08:43:50.569194+0000 (oldest deadline 2024-02-10T08:44:15.269354+0000) 2024-02-10T08:44:36.789 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:36.487+0000 7fb94def3700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.18:6807 osd.1 since back 2024-02-10T08:43:59.270934+0000 front 2024-02-10T08:43:59.270953+0000 (oldest deadline 2024-02-10T08:44:22.170849+0000) 2024-02-10T08:44:36.789 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:36.487+0000 7fb94def3700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.18:6811 osd.2 since back 2024-02-10T08:44:04.372060+0000 front 2024-02-10T08:44:04.372150+0000 (oldest deadline 2024-02-10T08:44:29.672016+0000) 2024-02-10T08:44:36.790 INFO:journalctl@ceph.osd.6.smithi071.stdout:Feb 10 08:44:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-6[53993]: debug 2024-02-10T08:44:36.705+0000 7fd5c11a9700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:49.153442+0000 front 2024-02-10T08:43:49.153401+0000 (oldest deadline 2024-02-10T08:44:12.653313+0000) 2024-02-10T08:44:36.790 INFO:journalctl@ceph.osd.6.smithi071.stdout:Feb 10 08:44:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-6[53993]: debug 2024-02-10T08:44:36.705+0000 7fd5c11a9700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.18:6807 osd.1 since back 2024-02-10T08:43:58.955260+0000 front 2024-02-10T08:43:58.955243+0000 (oldest deadline 2024-02-10T08:44:23.055145+0000) 2024-02-10T08:44:36.790 INFO:journalctl@ceph.osd.6.smithi071.stdout:Feb 10 08:44:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-6[53993]: debug 2024-02-10T08:44:36.705+0000 7fd5c11a9700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.18:6811 osd.2 since back 2024-02-10T08:44:05.955982+0000 front 2024-02-10T08:44:05.955912+0000 (oldest deadline 2024-02-10T08:44:30.655898+0000) 2024-02-10T08:44:36.790 INFO:journalctl@ceph.osd.6.smithi071.stdout:Feb 10 08:44:36 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-6[53993]: debug 2024-02-10T08:44:36.705+0000 7fd5c11a9700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.18:6815 osd.3 since back 2024-02-10T08:44:11.756787+0000 front 2024-02-10T08:44:11.756780+0000 (oldest deadline 2024-02-10T08:44:36.456732+0000) 2024-02-10T08:44:37.702 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:37.438+0000 7fb94def3700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:50.569091+0000 front 2024-02-10T08:43:50.569194+0000 (oldest deadline 2024-02-10T08:44:15.269354+0000) 2024-02-10T08:44:37.703 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:37.438+0000 7fb94def3700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.18:6807 osd.1 since back 2024-02-10T08:43:59.270934+0000 front 2024-02-10T08:43:59.270953+0000 (oldest deadline 2024-02-10T08:44:22.170849+0000) 2024-02-10T08:44:37.703 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:37.438+0000 7fb94def3700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.18:6811 osd.2 since back 2024-02-10T08:44:04.372060+0000 front 2024-02-10T08:44:04.372150+0000 (oldest deadline 2024-02-10T08:44:29.672016+0000) 2024-02-10T08:44:38.039 INFO:journalctl@ceph.osd.6.smithi071.stdout:Feb 10 08:44:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-6[53993]: debug 2024-02-10T08:44:37.702+0000 7fd5c11a9700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:49.153442+0000 front 2024-02-10T08:43:49.153401+0000 (oldest deadline 2024-02-10T08:44:12.653313+0000) 2024-02-10T08:44:38.039 INFO:journalctl@ceph.osd.6.smithi071.stdout:Feb 10 08:44:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-6[53993]: debug 2024-02-10T08:44:37.702+0000 7fd5c11a9700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.18:6807 osd.1 since back 2024-02-10T08:43:58.955260+0000 front 2024-02-10T08:43:58.955243+0000 (oldest deadline 2024-02-10T08:44:23.055145+0000) 2024-02-10T08:44:38.039 INFO:journalctl@ceph.osd.6.smithi071.stdout:Feb 10 08:44:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-6[53993]: debug 2024-02-10T08:44:37.702+0000 7fd5c11a9700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.18:6811 osd.2 since back 2024-02-10T08:44:05.955982+0000 front 2024-02-10T08:44:05.955912+0000 (oldest deadline 2024-02-10T08:44:30.655898+0000) 2024-02-10T08:44:38.039 INFO:journalctl@ceph.osd.6.smithi071.stdout:Feb 10 08:44:37 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-6[53993]: debug 2024-02-10T08:44:37.702+0000 7fd5c11a9700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.18:6815 osd.3 since back 2024-02-10T08:44:11.756787+0000 front 2024-02-10T08:44:11.756780+0000 (oldest deadline 2024-02-10T08:44:36.456732+0000) 2024-02-10T08:44:38.789 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:38.486+0000 7fb94def3700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:50.569091+0000 front 2024-02-10T08:43:50.569194+0000 (oldest deadline 2024-02-10T08:44:15.269354+0000) 2024-02-10T08:44:38.789 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:38.486+0000 7fb94def3700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.18:6807 osd.1 since back 2024-02-10T08:43:59.270934+0000 front 2024-02-10T08:43:59.270953+0000 (oldest deadline 2024-02-10T08:44:22.170849+0000) 2024-02-10T08:44:38.789 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:38.486+0000 7fb94def3700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.18:6811 osd.2 since back 2024-02-10T08:44:04.372060+0000 front 2024-02-10T08:44:04.372150+0000 (oldest deadline 2024-02-10T08:44:29.672016+0000) 2024-02-10T08:44:38.789 INFO:journalctl@ceph.osd.6.smithi071.stdout:Feb 10 08:44:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-6[53993]: debug 2024-02-10T08:44:38.654+0000 7fd5c11a9700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:49.153442+0000 front 2024-02-10T08:43:49.153401+0000 (oldest deadline 2024-02-10T08:44:12.653313+0000) 2024-02-10T08:44:38.790 INFO:journalctl@ceph.osd.6.smithi071.stdout:Feb 10 08:44:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-6[53993]: debug 2024-02-10T08:44:38.654+0000 7fd5c11a9700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.18:6807 osd.1 since back 2024-02-10T08:43:58.955260+0000 front 2024-02-10T08:43:58.955243+0000 (oldest deadline 2024-02-10T08:44:23.055145+0000) 2024-02-10T08:44:38.790 INFO:journalctl@ceph.osd.6.smithi071.stdout:Feb 10 08:44:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-6[53993]: debug 2024-02-10T08:44:38.654+0000 7fd5c11a9700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.18:6811 osd.2 since back 2024-02-10T08:44:05.955982+0000 front 2024-02-10T08:44:05.955912+0000 (oldest deadline 2024-02-10T08:44:30.655898+0000) 2024-02-10T08:44:38.790 INFO:journalctl@ceph.osd.6.smithi071.stdout:Feb 10 08:44:38 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-6[53993]: debug 2024-02-10T08:44:38.654+0000 7fd5c11a9700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.18:6815 osd.3 since back 2024-02-10T08:44:11.756787+0000 front 2024-02-10T08:44:11.756780+0000 (oldest deadline 2024-02-10T08:44:36.456732+0000) 2024-02-10T08:44:39.789 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:39.465+0000 7fb94def3700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:50.569091+0000 front 2024-02-10T08:43:50.569194+0000 (oldest deadline 2024-02-10T08:44:15.269354+0000) 2024-02-10T08:44:39.789 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:39.465+0000 7fb94def3700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.18:6807 osd.1 since back 2024-02-10T08:43:59.270934+0000 front 2024-02-10T08:43:59.270953+0000 (oldest deadline 2024-02-10T08:44:22.170849+0000) 2024-02-10T08:44:39.789 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:39.465+0000 7fb94def3700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.18:6811 osd.2 since back 2024-02-10T08:44:04.372060+0000 front 2024-02-10T08:44:04.372150+0000 (oldest deadline 2024-02-10T08:44:29.672016+0000) 2024-02-10T08:44:39.789 INFO:journalctl@ceph.osd.6.smithi071.stdout:Feb 10 08:44:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-6[53993]: debug 2024-02-10T08:44:39.659+0000 7fd5c11a9700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:49.153442+0000 front 2024-02-10T08:43:49.153401+0000 (oldest deadline 2024-02-10T08:44:12.653313+0000) 2024-02-10T08:44:39.790 INFO:journalctl@ceph.osd.6.smithi071.stdout:Feb 10 08:44:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-6[53993]: debug 2024-02-10T08:44:39.659+0000 7fd5c11a9700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.18:6807 osd.1 since back 2024-02-10T08:43:58.955260+0000 front 2024-02-10T08:43:58.955243+0000 (oldest deadline 2024-02-10T08:44:23.055145+0000) 2024-02-10T08:44:39.790 INFO:journalctl@ceph.osd.6.smithi071.stdout:Feb 10 08:44:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-6[53993]: debug 2024-02-10T08:44:39.659+0000 7fd5c11a9700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.18:6811 osd.2 since back 2024-02-10T08:44:05.955982+0000 front 2024-02-10T08:44:05.955912+0000 (oldest deadline 2024-02-10T08:44:30.655898+0000) 2024-02-10T08:44:39.790 INFO:journalctl@ceph.osd.6.smithi071.stdout:Feb 10 08:44:39 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-6[53993]: debug 2024-02-10T08:44:39.659+0000 7fd5c11a9700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.18:6815 osd.3 since back 2024-02-10T08:44:11.756787+0000 front 2024-02-10T08:44:11.756780+0000 (oldest deadline 2024-02-10T08:44:36.456732+0000) 2024-02-10T08:44:40.492 INFO:journalctl@ceph.osd.6.smithi071.stdout:Feb 10 08:44:40 smithi071 bash[135965]: ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-6 2024-02-10T08:44:40.789 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:40.491+0000 7fb94def3700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:50.569091+0000 front 2024-02-10T08:43:50.569194+0000 (oldest deadline 2024-02-10T08:44:15.269354+0000) 2024-02-10T08:44:40.789 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:40.491+0000 7fb94def3700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.18:6807 osd.1 since back 2024-02-10T08:43:59.270934+0000 front 2024-02-10T08:43:59.270953+0000 (oldest deadline 2024-02-10T08:44:22.170849+0000) 2024-02-10T08:44:40.789 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:40.491+0000 7fb94def3700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.18:6811 osd.2 since back 2024-02-10T08:44:04.372060+0000 front 2024-02-10T08:44:04.372150+0000 (oldest deadline 2024-02-10T08:44:29.672016+0000) 2024-02-10T08:44:40.789 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:40 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:40.491+0000 7fb94def3700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.18:6815 osd.3 since back 2024-02-10T08:44:15.572960+0000 front 2024-02-10T08:44:15.572885+0000 (oldest deadline 2024-02-10T08:44:40.272868+0000) 2024-02-10T08:44:41.721 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:41 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:41.472+0000 7fb94def3700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:50.569091+0000 front 2024-02-10T08:43:50.569194+0000 (oldest deadline 2024-02-10T08:44:15.269354+0000) 2024-02-10T08:44:41.722 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:41 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:41.472+0000 7fb94def3700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.18:6807 osd.1 since back 2024-02-10T08:43:59.270934+0000 front 2024-02-10T08:43:59.270953+0000 (oldest deadline 2024-02-10T08:44:22.170849+0000) 2024-02-10T08:44:41.722 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:41 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:41.472+0000 7fb94def3700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.18:6811 osd.2 since back 2024-02-10T08:44:04.372060+0000 front 2024-02-10T08:44:04.372150+0000 (oldest deadline 2024-02-10T08:44:29.672016+0000) 2024-02-10T08:44:41.722 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:41 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:41.472+0000 7fb94def3700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.18:6815 osd.3 since back 2024-02-10T08:44:15.572960+0000 front 2024-02-10T08:44:15.572885+0000 (oldest deadline 2024-02-10T08:44:40.272868+0000) 2024-02-10T08:44:41.991 DEBUG:teuthology.orchestra.run.smithi071:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d46257c8-c7eb-11ee-95b8-87774f69a715@osd.6.service' 2024-02-10T08:44:42.033 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-10T08:44:42.033 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-02-10T08:44:42.033 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-02-10T08:44:42.033 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ceph-d46257c8-c7eb-11ee-95b8-87774f69a715@osd.7 2024-02-10T08:44:42.289 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:42 smithi071 systemd[1]: Stopping Ceph osd.7 for d46257c8-c7eb-11ee-95b8-87774f69a715... 2024-02-10T08:44:42.289 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:42 smithi071 bash[136201]: Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T08:44:42.789 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:42.373+0000 7fb950f76700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-10T08:44:42.789 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:42.373+0000 7fb950f76700 -1 osd.7 512 *** Got signal Terminated *** 2024-02-10T08:44:42.789 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:42.373+0000 7fb950f76700 -1 osd.7 512 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-10T08:44:42.789 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:42.482+0000 7fb94def3700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:50.569091+0000 front 2024-02-10T08:43:50.569194+0000 (oldest deadline 2024-02-10T08:44:15.269354+0000) 2024-02-10T08:44:42.789 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:42.482+0000 7fb94def3700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.18:6807 osd.1 since back 2024-02-10T08:43:59.270934+0000 front 2024-02-10T08:43:59.270953+0000 (oldest deadline 2024-02-10T08:44:22.170849+0000) 2024-02-10T08:44:42.789 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:42.482+0000 7fb94def3700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.18:6811 osd.2 since back 2024-02-10T08:44:04.372060+0000 front 2024-02-10T08:44:04.372150+0000 (oldest deadline 2024-02-10T08:44:29.672016+0000) 2024-02-10T08:44:42.789 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:42 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:42.482+0000 7fb94def3700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.18:6815 osd.3 since back 2024-02-10T08:44:15.572960+0000 front 2024-02-10T08:44:15.572885+0000 (oldest deadline 2024-02-10T08:44:40.272868+0000) 2024-02-10T08:44:43.789 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:43 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:43.476+0000 7fb94def3700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:50.569091+0000 front 2024-02-10T08:43:50.569194+0000 (oldest deadline 2024-02-10T08:44:15.269354+0000) 2024-02-10T08:44:43.789 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:43 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:43.476+0000 7fb94def3700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.18:6807 osd.1 since back 2024-02-10T08:43:59.270934+0000 front 2024-02-10T08:43:59.270953+0000 (oldest deadline 2024-02-10T08:44:22.170849+0000) 2024-02-10T08:44:43.789 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:43 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:43.476+0000 7fb94def3700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.18:6811 osd.2 since back 2024-02-10T08:44:04.372060+0000 front 2024-02-10T08:44:04.372150+0000 (oldest deadline 2024-02-10T08:44:29.672016+0000) 2024-02-10T08:44:43.789 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:43 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:43.476+0000 7fb94def3700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.18:6815 osd.3 since back 2024-02-10T08:44:15.572960+0000 front 2024-02-10T08:44:15.572885+0000 (oldest deadline 2024-02-10T08:44:40.272868+0000) 2024-02-10T08:44:44.789 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:44 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:44.434+0000 7fb94def3700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:50.569091+0000 front 2024-02-10T08:43:50.569194+0000 (oldest deadline 2024-02-10T08:44:15.269354+0000) 2024-02-10T08:44:44.789 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:44 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:44.434+0000 7fb94def3700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.18:6807 osd.1 since back 2024-02-10T08:43:59.270934+0000 front 2024-02-10T08:43:59.270953+0000 (oldest deadline 2024-02-10T08:44:22.170849+0000) 2024-02-10T08:44:44.789 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:44 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:44.434+0000 7fb94def3700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.18:6811 osd.2 since back 2024-02-10T08:44:04.372060+0000 front 2024-02-10T08:44:04.372150+0000 (oldest deadline 2024-02-10T08:44:29.672016+0000) 2024-02-10T08:44:44.789 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:44 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:44.434+0000 7fb94def3700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.18:6815 osd.3 since back 2024-02-10T08:44:15.572960+0000 front 2024-02-10T08:44:15.572885+0000 (oldest deadline 2024-02-10T08:44:40.272868+0000) 2024-02-10T08:44:45.789 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:45.419+0000 7fb94def3700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:50.569091+0000 front 2024-02-10T08:43:50.569194+0000 (oldest deadline 2024-02-10T08:44:15.269354+0000) 2024-02-10T08:44:45.789 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:45.419+0000 7fb94def3700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.18:6807 osd.1 since back 2024-02-10T08:43:59.270934+0000 front 2024-02-10T08:43:59.270953+0000 (oldest deadline 2024-02-10T08:44:22.170849+0000) 2024-02-10T08:44:45.789 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:45.419+0000 7fb94def3700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.18:6811 osd.2 since back 2024-02-10T08:44:04.372060+0000 front 2024-02-10T08:44:04.372150+0000 (oldest deadline 2024-02-10T08:44:29.672016+0000) 2024-02-10T08:44:45.790 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:45 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:45.419+0000 7fb94def3700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.18:6815 osd.3 since back 2024-02-10T08:44:15.572960+0000 front 2024-02-10T08:44:15.572885+0000 (oldest deadline 2024-02-10T08:44:40.272868+0000) 2024-02-10T08:44:46.789 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:46.417+0000 7fb94def3700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.18:6803 osd.0 since back 2024-02-10T08:43:50.569091+0000 front 2024-02-10T08:43:50.569194+0000 (oldest deadline 2024-02-10T08:44:15.269354+0000) 2024-02-10T08:44:46.789 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:46.417+0000 7fb94def3700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.18:6807 osd.1 since back 2024-02-10T08:43:59.270934+0000 front 2024-02-10T08:43:59.270953+0000 (oldest deadline 2024-02-10T08:44:22.170849+0000) 2024-02-10T08:44:46.789 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:46.417+0000 7fb94def3700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.18:6811 osd.2 since back 2024-02-10T08:44:04.372060+0000 front 2024-02-10T08:44:04.372150+0000 (oldest deadline 2024-02-10T08:44:29.672016+0000) 2024-02-10T08:44:46.789 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:46 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7[126579]: debug 2024-02-10T08:44:46.417+0000 7fb94def3700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.18:6815 osd.3 since back 2024-02-10T08:44:15.572960+0000 front 2024-02-10T08:44:15.572885+0000 (oldest deadline 2024-02-10T08:44:40.272868+0000) 2024-02-10T08:44:48.039 INFO:journalctl@ceph.osd.7.smithi071.stdout:Feb 10 08:44:47 smithi071 bash[136240]: ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-osd-7 2024-02-10T08:44:49.568 DEBUG:teuthology.orchestra.run.smithi071:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d46257c8-c7eb-11ee-95b8-87774f69a715@osd.7.service' 2024-02-10T08:44:49.610 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-10T08:44:49.610 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-02-10T08:44:49.610 INFO:tasks.cephadm.ceph.rgw.foo.a:Stopping rgw.foo.a... 2024-02-10T08:44:49.610 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ceph-d46257c8-c7eb-11ee-95b8-87774f69a715@rgw.foo.a 2024-02-10T08:44:49.904 INFO:journalctl@ceph.rgw.foo.a.smithi018.stdout:Feb 10 08:44:49 smithi018 systemd[1]: Stopping Ceph rgw.foo.a for d46257c8-c7eb-11ee-95b8-87774f69a715... 2024-02-10T08:44:49.904 INFO:journalctl@ceph.rgw.foo.a.smithi018.stdout:Feb 10 08:44:49 smithi018 bash[196223]: Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-rgw.foo.a" found: no such container 2024-02-10T08:44:50.404 INFO:journalctl@ceph.rgw.foo.a.smithi018.stdout:Feb 10 08:44:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-rgw-foo-a[66240]: debug 2024-02-10T08:44:49.979+0000 7fa841100700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/radosgw -n client.rgw.foo.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-10T08:44:50.404 INFO:journalctl@ceph.rgw.foo.a.smithi018.stdout:Feb 10 08:44:49 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-rgw-foo-a[66240]: debug 2024-02-10T08:44:49.979+0000 7fa8581ca880 -1 shutting down 2024-02-10T08:45:00.359 INFO:journalctl@ceph.rgw.foo.a.smithi018.stdout:Feb 10 08:44:59 smithi018 bash[196264]: time="2024-02-10T08:44:59Z" level=warning msg="StopSignal SIGTERM failed to stop container ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-rgw-foo-a in 10 seconds, resorting to SIGKILL" 2024-02-10T08:45:00.654 INFO:journalctl@ceph.rgw.foo.a.smithi018.stdout:Feb 10 08:45:00 smithi018 bash[196264]: ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-rgw-foo-a 2024-02-10T08:45:00.909 DEBUG:teuthology.orchestra.run.smithi018:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d46257c8-c7eb-11ee-95b8-87774f69a715@rgw.foo.a.service' 2024-02-10T08:45:00.946 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-10T08:45:00.946 INFO:tasks.cephadm.ceph.rgw.foo.a:Stopped rgw.foo.a 2024-02-10T08:45:00.947 INFO:tasks.cephadm.prometheus.a:Stopping prometheus.a... 2024-02-10T08:45:00.947 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ceph-d46257c8-c7eb-11ee-95b8-87774f69a715@prometheus.a 2024-02-10T08:45:01.249 INFO:journalctl@ceph.prometheus.a.smithi071.stdout:Feb 10 08:45:00 smithi071 systemd[1]: Stopping Ceph prometheus.a for d46257c8-c7eb-11ee-95b8-87774f69a715... 2024-02-10T08:45:01.250 INFO:journalctl@ceph.prometheus.a.smithi071.stdout:Feb 10 08:45:01 smithi071 bash[136474]: Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-prometheus.a" found: no such container 2024-02-10T08:45:01.524 INFO:journalctl@ceph.prometheus.a.smithi071.stdout:Feb 10 08:45:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-prometheus-a[64383]: ts=2024-02-10T08:45:01.249Z caller=main.go:775 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-02-10T08:45:01.524 INFO:journalctl@ceph.prometheus.a.smithi071.stdout:Feb 10 08:45:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-prometheus-a[64383]: ts=2024-02-10T08:45:01.249Z caller=main.go:798 level=info msg="Stopping scrape discovery manager..." 2024-02-10T08:45:01.524 INFO:journalctl@ceph.prometheus.a.smithi071.stdout:Feb 10 08:45:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-prometheus-a[64383]: ts=2024-02-10T08:45:01.249Z caller=main.go:812 level=info msg="Stopping notify discovery manager..." 2024-02-10T08:45:01.524 INFO:journalctl@ceph.prometheus.a.smithi071.stdout:Feb 10 08:45:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-prometheus-a[64383]: ts=2024-02-10T08:45:01.249Z caller=main.go:834 level=info msg="Stopping scrape manager..." 2024-02-10T08:45:01.524 INFO:journalctl@ceph.prometheus.a.smithi071.stdout:Feb 10 08:45:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-prometheus-a[64383]: ts=2024-02-10T08:45:01.249Z caller=main.go:794 level=info msg="Scrape discovery manager stopped" 2024-02-10T08:45:01.524 INFO:journalctl@ceph.prometheus.a.smithi071.stdout:Feb 10 08:45:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-prometheus-a[64383]: ts=2024-02-10T08:45:01.249Z caller=main.go:808 level=info msg="Notify discovery manager stopped" 2024-02-10T08:45:01.524 INFO:journalctl@ceph.prometheus.a.smithi071.stdout:Feb 10 08:45:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-prometheus-a[64383]: ts=2024-02-10T08:45:01.249Z caller=manager.go:945 level=info component="rule manager" msg="Stopping rule manager..." 2024-02-10T08:45:01.524 INFO:journalctl@ceph.prometheus.a.smithi071.stdout:Feb 10 08:45:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-prometheus-a[64383]: ts=2024-02-10T08:45:01.249Z caller=main.go:828 level=info msg="Scrape manager stopped" 2024-02-10T08:45:01.524 INFO:journalctl@ceph.prometheus.a.smithi071.stdout:Feb 10 08:45:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-prometheus-a[64383]: ts=2024-02-10T08:45:01.249Z caller=manager.go:955 level=info component="rule manager" msg="Rule manager stopped" 2024-02-10T08:45:01.524 INFO:journalctl@ceph.prometheus.a.smithi071.stdout:Feb 10 08:45:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-prometheus-a[64383]: ts=2024-02-10T08:45:01.252Z caller=notifier.go:600 level=info component=notifier msg="Stopping notification manager..." 2024-02-10T08:45:01.525 INFO:journalctl@ceph.prometheus.a.smithi071.stdout:Feb 10 08:45:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-prometheus-a[64383]: ts=2024-02-10T08:45:01.252Z caller=main.go:1054 level=info msg="Notifier manager stopped" 2024-02-10T08:45:01.525 INFO:journalctl@ceph.prometheus.a.smithi071.stdout:Feb 10 08:45:01 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-prometheus-a[64383]: ts=2024-02-10T08:45:01.253Z caller=main.go:1066 level=info msg="See you next time!" 2024-02-10T08:45:01.789 INFO:journalctl@ceph.prometheus.a.smithi071.stdout:Feb 10 08:45:01 smithi071 bash[136515]: ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-prometheus-a 2024-02-10T08:45:01.904 INFO:journalctl@ceph.alertmanager.a.smithi018.stdout:Feb 10 08:45:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-alertmanager-a[72620]: level=warn ts=2024-02-10T08:45:01.627Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi018.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.18:8443: connect: connection refused" 2024-02-10T08:45:01.904 INFO:journalctl@ceph.alertmanager.a.smithi018.stdout:Feb 10 08:45:01 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-alertmanager-a[72620]: level=warn ts=2024-02-10T08:45:01.628Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi071.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.71:8443: connect: connection refused" 2024-02-10T08:45:02.125 DEBUG:teuthology.orchestra.run.smithi071:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d46257c8-c7eb-11ee-95b8-87774f69a715@prometheus.a.service' 2024-02-10T08:45:02.162 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-10T08:45:02.162 INFO:tasks.cephadm.prometheus.a:Stopped prometheus.a 2024-02-10T08:45:02.162 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 --force --keep-logs 2024-02-10T08:45:03.654 INFO:journalctl@ceph.alertmanager.a.smithi018.stdout:Feb 10 08:45:03 smithi018 systemd[1]: Stopping Ceph alertmanager.a for d46257c8-c7eb-11ee-95b8-87774f69a715... 2024-02-10T08:45:03.654 INFO:journalctl@ceph.alertmanager.a.smithi018.stdout:Feb 10 08:45:03 smithi018 bash[196685]: Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-alertmanager.a" found: no such container 2024-02-10T08:45:04.028 INFO:journalctl@ceph.alertmanager.a.smithi018.stdout:Feb 10 08:45:03 smithi018 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-alertmanager-a[72620]: level=info ts=2024-02-10T08:45:03.657Z caller=main.go:557 msg="Received SIGTERM, exiting gracefully..." 2024-02-10T08:45:04.404 INFO:journalctl@ceph.alertmanager.a.smithi018.stdout:Feb 10 08:45:04 smithi018 bash[196725]: ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-alertmanager-a 2024-02-10T08:45:04.904 INFO:journalctl@ceph.alertmanager.a.smithi018.stdout:Feb 10 08:45:04 smithi018 systemd[1]: ceph-d46257c8-c7eb-11ee-95b8-87774f69a715@alertmanager.a.service: Succeeded. 2024-02-10T08:45:04.904 INFO:journalctl@ceph.alertmanager.a.smithi018.stdout:Feb 10 08:45:04 smithi018 systemd[1]: Stopped Ceph alertmanager.a for d46257c8-c7eb-11ee-95b8-87774f69a715. 2024-02-10T08:45:04.904 INFO:journalctl@ceph.node-exporter.a.smithi018.stdout:Feb 10 08:45:04 smithi018 systemd[1]: Stopping Ceph node-exporter.a for d46257c8-c7eb-11ee-95b8-87774f69a715... 2024-02-10T08:45:04.904 INFO:journalctl@ceph.node-exporter.a.smithi018.stdout:Feb 10 08:45:04 smithi018 bash[196828]: Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter.a" found: no such container 2024-02-10T08:45:05.654 INFO:journalctl@ceph.node-exporter.a.smithi018.stdout:Feb 10 08:45:05 smithi018 bash[196867]: ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-a 2024-02-10T08:45:06.107 INFO:journalctl@ceph.node-exporter.a.smithi018.stdout:Feb 10 08:45:05 smithi018 systemd[1]: ceph-d46257c8-c7eb-11ee-95b8-87774f69a715@node-exporter.a.service: Main process exited, code=exited, status=143/n/a 2024-02-10T08:45:06.107 INFO:journalctl@ceph.node-exporter.a.smithi018.stdout:Feb 10 08:45:05 smithi018 systemd[1]: ceph-d46257c8-c7eb-11ee-95b8-87774f69a715@node-exporter.a.service: Failed with result 'exit-code'. 2024-02-10T08:45:06.108 INFO:journalctl@ceph.node-exporter.a.smithi018.stdout:Feb 10 08:45:05 smithi018 systemd[1]: Stopped Ceph node-exporter.a for d46257c8-c7eb-11ee-95b8-87774f69a715. 2024-02-10T08:45:06.454 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 --force --keep-logs 2024-02-10T08:45:07.789 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:45:07 smithi071 systemd[1]: Stopping Ceph iscsi.iscsi.a for d46257c8-c7eb-11ee-95b8-87774f69a715... 2024-02-10T08:45:07.789 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:45:07 smithi071 bash[136874]: Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi.iscsi.a" found: no such container 2024-02-10T08:45:07.789 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:45:07 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a[62293]: debug Shutdown received 2024-02-10T08:45:17.968 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:45:17 smithi071 bash[136914]: time="2024-02-10T08:45:17Z" level=warning msg="StopSignal SIGTERM failed to stop container ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a in 10 seconds, resorting to SIGKILL" 2024-02-10T08:45:18.282 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:45:18 smithi071 bash[136914]: ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a 2024-02-10T08:45:18.539 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:45:18 smithi071 systemd[1]: ceph-d46257c8-c7eb-11ee-95b8-87774f69a715@iscsi.iscsi.a.service: Main process exited, code=exited, status=137/n/a 2024-02-10T08:45:19.219 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:45:18 smithi071 bash[136986]: ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-iscsi-iscsi-a-tcmu 2024-02-10T08:45:19.219 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:45:19 smithi071 systemd[1]: ceph-d46257c8-c7eb-11ee-95b8-87774f69a715@iscsi.iscsi.a.service: Failed with result 'exit-code'. 2024-02-10T08:45:19.219 INFO:journalctl@ceph.iscsi.iscsi.a.smithi071.stdout:Feb 10 08:45:19 smithi071 systemd[1]: Stopped Ceph iscsi.iscsi.a for d46257c8-c7eb-11ee-95b8-87774f69a715. 2024-02-10T08:45:19.219 INFO:journalctl@ceph.node-exporter.b.smithi071.stdout:Feb 10 08:45:19 smithi071 systemd[1]: Stopping Ceph node-exporter.b for d46257c8-c7eb-11ee-95b8-87774f69a715... 2024-02-10T08:45:19.539 INFO:journalctl@ceph.node-exporter.b.smithi071.stdout:Feb 10 08:45:19 smithi071 bash[137062]: Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter.b" found: no such container 2024-02-10T08:45:20.039 INFO:journalctl@ceph.node-exporter.b.smithi071.stdout:Feb 10 08:45:19 smithi071 bash[137102]: ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-node-exporter-b 2024-02-10T08:45:20.422 INFO:journalctl@ceph.node-exporter.b.smithi071.stdout:Feb 10 08:45:20 smithi071 systemd[1]: ceph-d46257c8-c7eb-11ee-95b8-87774f69a715@node-exporter.b.service: Main process exited, code=exited, status=143/n/a 2024-02-10T08:45:20.422 INFO:journalctl@ceph.node-exporter.b.smithi071.stdout:Feb 10 08:45:20 smithi071 systemd[1]: ceph-d46257c8-c7eb-11ee-95b8-87774f69a715@node-exporter.b.service: Failed with result 'exit-code'. 2024-02-10T08:45:20.422 INFO:journalctl@ceph.node-exporter.b.smithi071.stdout:Feb 10 08:45:20 smithi071 systemd[1]: Stopped Ceph node-exporter.b for d46257c8-c7eb-11ee-95b8-87774f69a715. 2024-02-10T08:45:20.789 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:45:20 smithi071 systemd[1]: Stopping Ceph grafana.a for d46257c8-c7eb-11ee-95b8-87774f69a715... 2024-02-10T08:45:20.789 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:45:20 smithi071 bash[137236]: Error: no container with name or ID "ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana.a" found: no such container 2024-02-10T08:45:20.789 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:45:20 smithi071 ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a[64762]: t=2024-02-10T08:45:20+0000 lvl=info msg="Shutdown started" logger=server reason="System signal: terminated" 2024-02-10T08:45:21.289 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:45:21 smithi071 bash[137274]: ceph-d46257c8-c7eb-11ee-95b8-87774f69a715-grafana-a 2024-02-10T08:45:21.657 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:45:21 smithi071 systemd[1]: ceph-d46257c8-c7eb-11ee-95b8-87774f69a715@grafana.a.service: Succeeded. 2024-02-10T08:45:21.657 INFO:journalctl@ceph.grafana.a.smithi071.stdout:Feb 10 08:45:21 smithi071 systemd[1]: Stopped Ceph grafana.a for d46257c8-c7eb-11ee-95b8-87774f69a715. 2024-02-10T08:45:21.802 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-10T08:45:21.842 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-10T08:45:21.872 INFO:tasks.cephadm:Archiving crash dumps... 2024-02-10T08:45:21.874 DEBUG:teuthology.misc:Transferring archived files from smithi018:/var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/crash to /home/teuthworker/archive/yuriw-2024-02-09_21:34:44-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7555285/remote/ubuntu@smithi018.front.sepia.ceph.com/crash 2024-02-10T08:45:21.875 DEBUG:teuthology.orchestra.run.smithi018:> sudo tar c -f - -C /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/crash -- . 2024-02-10T08:45:21.951 INFO:teuthology.orchestra.run.smithi018.stderr:tar: /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/crash: Cannot open: No such file or directory 2024-02-10T08:45:21.952 INFO:teuthology.orchestra.run.smithi018.stderr:tar: Error is not recoverable: exiting now 2024-02-10T08:45:21.953 DEBUG:teuthology.misc:Transferring archived files from smithi071:/var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/crash to /home/teuthworker/archive/yuriw-2024-02-09_21:34:44-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7555285/remote/ubuntu@smithi071.front.sepia.ceph.com/crash 2024-02-10T08:45:21.954 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar c -f - -C /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/crash -- . 2024-02-10T08:45:22.007 INFO:teuthology.orchestra.run.smithi071.stderr:tar: /var/lib/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/crash: Cannot open: No such file or directory 2024-02-10T08:45:22.007 INFO:teuthology.orchestra.run.smithi071.stderr:tar: Error is not recoverable: exiting now 2024-02-10T08:45:22.008 INFO:tasks.cephadm:Checking cluster log for badness... 2024-02-10T08:45:22.009 DEBUG:teuthology.orchestra.run.smithi018:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'but it is still running' | egrep -v 'objects unfound and apparently lost' | egrep -v '\(MON_DOWN\)' | egrep -v '\(OSDMAP_FLAGS\)' | head -n 1 2024-02-10T08:45:22.092 INFO:teuthology.orchestra.run.smithi018.stdout:2024-02-10T08:19:30.793075+0000 mon.a (mon.0) 751 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-10T08:45:22.109 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-02-10T08:45:22.110 DEBUG:teuthology.orchestra.run.smithi018:> sudo egrep '\[SEC\]' /var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'but it is still running' | egrep -v 'objects unfound and apparently lost' | egrep -v '\(MON_DOWN\)' | egrep -v '\(OSDMAP_FLAGS\)' | head -n 1 2024-02-10T08:45:22.143 DEBUG:teuthology.orchestra.run.smithi018:> sudo egrep '\[ERR\]' /var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'but it is still running' | egrep -v 'objects unfound and apparently lost' | egrep -v '\(MON_DOWN\)' | egrep -v '\(OSDMAP_FLAGS\)' | head -n 1 2024-02-10T08:45:22.216 DEBUG:teuthology.orchestra.run.smithi018:> sudo egrep '\[WRN\]' /var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'but it is still running' | egrep -v 'objects unfound and apparently lost' | egrep -v '\(MON_DOWN\)' | egrep -v '\(OSDMAP_FLAGS\)' | head -n 1 2024-02-10T08:45:22.287 INFO:teuthology.orchestra.run.smithi018.stdout:2024-02-10T08:19:30.793075+0000 mon.a (mon.0) 751 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-10T08:45:22.289 INFO:tasks.cephadm:Compressing logs... 2024-02-10T08:45:22.289 DEBUG:teuthology.orchestra.run.smithi018:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-10T08:45:22.332 DEBUG:teuthology.orchestra.run.smithi071:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-10T08:45:22.372 INFO:teuthology.orchestra.run.smithi071.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-02-10T08:45:22.372 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-02-10T08:45:22.375 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/ceph-osd.6.log 2024-02-10T08:45:22.375 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/ceph-volume.log 2024-02-10T08:45:22.375 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/ceph.audit.log 2024-02-10T08:45:22.377 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/ceph.cephadm.log 2024-02-10T08:45:22.377 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/objectstore_tool.6.log 2024-02-10T08:45:22.377 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/ceph-osd.7.log 2024-02-10T08:45:22.377 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/objectstore_tool.6.log: gzip -5 --verbose -- /var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/ceph-mgr.x.log 2024-02-10T08:45:22.379 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/objectstore_tool.7.log 2024-02-10T08:45:22.379 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/ceph-mon.b.log 2024-02-10T08:45:22.379 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/objectstore_tool.7.log: gzip -5 --verbose -- /var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/ceph.log 2024-02-10T08:45:22.379 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/ceph-osd.4.log 2024-02-10T08:45:22.379 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/ceph.log: gzip -5 --verbose -- /var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/ceph-osd.5.log 2024-02-10T08:45:22.379 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/tcmu-runner.log 2024-02-10T08:45:22.379 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/ceph-osd.5.log: /var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/tcmu-runner.log: 67.8% -- replaced with /var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/tcmu-runner.log.gz 2024-02-10T08:45:22.385 INFO:teuthology.orchestra.run.smithi071.stderr: 92.2% -- replaced with /var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/ceph-mgr.x.log.gz 2024-02-10T08:45:22.401 INFO:teuthology.orchestra.run.smithi018.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-02-10T08:45:22.402 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-02-10T08:45:22.410 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/ceph-volume.log 2024-02-10T08:45:22.411 INFO:teuthology.orchestra.run.smithi071.stderr: 81.6% -- replaced with /var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/ceph.cephadm.log.gz 2024-02-10T08:45:22.414 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/ceph-osd.2.log 2024-02-10T08:45:22.414 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/ceph-mgr.y.log 2024-02-10T08:45:22.414 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/ceph-volume.log: /var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/ceph.audit.log 2024-02-10T08:45:22.414 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/ceph.cephadm.log 2024-02-10T08:45:22.414 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/ceph-mgr.y.log: /var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/ceph-osd.3.log 2024-02-10T08:45:22.414 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/ceph-osd.0.log 2024-02-10T08:45:22.415 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/ceph-client.rgw.foo.a.log 2024-02-10T08:45:22.415 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/ceph-mon.a.log 2024-02-10T08:45:22.415 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/ceph-client.rgw.foo.a.log: gzip -5 --verbose -- /var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/ceph-mon.c.log 2024-02-10T08:45:22.415 INFO:teuthology.orchestra.run.smithi018.stderr: 58.2% -- replaced with /var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/ceph-client.rgw.foo.a.log.gz 2024-02-10T08:45:22.415 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/ceph.log 2024-02-10T08:45:22.415 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/ceph-osd.1.log 2024-02-10T08:45:22.425 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/ceph.log: /var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/ceph-osd.1.log: 92.0% -- replaced with /var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/ceph.log.gz 2024-02-10T08:45:22.439 INFO:teuthology.orchestra.run.smithi018.stderr: 89.0% -- replaced with /var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/ceph.cephadm.log.gz 2024-02-10T08:45:22.442 INFO:teuthology.orchestra.run.smithi018.stderr: 92.1% -- replaced with /var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/ceph-volume.log.gz 2024-02-10T08:45:22.468 INFO:teuthology.orchestra.run.smithi071.stderr: 95.1% -- replaced with /var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/objectstore_tool.7.log.gz 2024-02-10T08:45:22.468 INFO:teuthology.orchestra.run.smithi018.stderr: 93.9% -- replaced with /var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/ceph.audit.log.gz 2024-02-10T08:45:22.468 INFO:teuthology.orchestra.run.smithi071.stderr: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-02-10T08:45:22.481 INFO:teuthology.orchestra.run.smithi071.stderr: 91.9% -- replaced with /var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/ceph-volume.log.gz 2024-02-10T08:45:22.483 INFO:teuthology.orchestra.run.smithi071.stderr: 90.0% -- replaced with /var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/ceph.audit.log.gz 2024-02-10T08:45:22.488 INFO:teuthology.orchestra.run.smithi071.stderr: 85.8% -- replaced with /var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/ceph.log.gz 2024-02-10T08:45:22.656 INFO:teuthology.orchestra.run.smithi071.stderr: 95.0% -- replaced with /var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/objectstore_tool.6.log.gz 2024-02-10T08:45:22.809 INFO:teuthology.orchestra.run.smithi018.stderr: 93.3% -- replaced with /var/log/ceph/cephadm.log.gz 2024-02-10T08:45:23.486 INFO:teuthology.orchestra.run.smithi071.stderr: 91.3% -- replaced with /var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/ceph-mon.b.log.gz 2024-02-10T08:45:24.109 INFO:teuthology.orchestra.run.smithi018.stderr: 89.6% -- replaced with /var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/ceph-mgr.y.log.gz 2024-02-10T08:45:25.525 INFO:teuthology.orchestra.run.smithi018.stderr: 91.4% -- replaced with /var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/ceph-mon.c.log.gz 2024-02-10T08:45:26.319 INFO:teuthology.orchestra.run.smithi018.stderr: 90.4% -- replaced with /var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/ceph-mon.a.log.gz 2024-02-10T08:46:35.626 INFO:teuthology.orchestra.run.smithi018.stderr: 94.1% -- replaced with /var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/ceph-osd.3.log.gz 2024-02-10T08:46:46.642 INFO:teuthology.orchestra.run.smithi071.stderr: 93.6% -- replaced with /var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/ceph-osd.4.log.gz 2024-02-10T08:46:56.545 INFO:teuthology.orchestra.run.smithi071.stderr: 93.7% -- replaced with /var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/ceph-osd.7.log.gz 2024-02-10T08:47:27.100 INFO:teuthology.orchestra.run.smithi018.stderr: 92.6% -- replaced with /var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/ceph-osd.2.log.gz 2024-02-10T08:47:27.588 INFO:teuthology.orchestra.run.smithi071.stderr: 93.4% -- replaced with /var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/ceph-osd.5.log.gz 2024-02-10T08:47:38.032 INFO:teuthology.orchestra.run.smithi071.stderr: 93.3% -- replaced with /var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/ceph-osd.6.log.gz 2024-02-10T08:47:38.043 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-02-10T08:47:38.043 INFO:teuthology.orchestra.run.smithi071.stderr:real 2m15.693s 2024-02-10T08:47:38.043 INFO:teuthology.orchestra.run.smithi071.stderr:user 4m4.097s 2024-02-10T08:47:38.044 INFO:teuthology.orchestra.run.smithi071.stderr:sys 0m10.042s 2024-02-10T08:47:49.740 INFO:teuthology.orchestra.run.smithi018.stderr: 93.2% -- replaced with /var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/ceph-osd.1.log.gz 2024-02-10T08:47:56.029 INFO:teuthology.orchestra.run.smithi018.stderr: 92.5% -- replaced with /var/log/ceph/d46257c8-c7eb-11ee-95b8-87774f69a715/ceph-osd.0.log.gz 2024-02-10T08:47:56.048 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-02-10T08:47:56.048 INFO:teuthology.orchestra.run.smithi018.stderr:real 2m33.700s 2024-02-10T08:47:56.048 INFO:teuthology.orchestra.run.smithi018.stderr:user 4m45.280s 2024-02-10T08:47:56.048 INFO:teuthology.orchestra.run.smithi018.stderr:sys 0m10.710s 2024-02-10T08:47:56.048 INFO:tasks.cephadm:Archiving logs... 2024-02-10T08:47:56.049 DEBUG:teuthology.misc:Transferring archived files from smithi018:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-02-09_21:34:44-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7555285/remote/ubuntu@smithi018.front.sepia.ceph.com/log 2024-02-10T08:47:56.050 DEBUG:teuthology.orchestra.run.smithi018:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-10T08:48:41.885 DEBUG:teuthology.misc:Transferring archived files from smithi071:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-02-09_21:34:44-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7555285/remote/ubuntu@smithi071.front.sepia.ceph.com/log 2024-02-10T08:48:41.887 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-10T08:49:21.370 INFO:tasks.cephadm:Removing cluster... 2024-02-10T08:49:21.371 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 --force 2024-02-10T08:49:22.327 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d46257c8-c7eb-11ee-95b8-87774f69a715 --force 2024-02-10T08:49:23.215 INFO:tasks.cephadm:Removing cephadm ... 2024-02-10T08:49:23.215 DEBUG:teuthology.orchestra.run.smithi018:> rm -rf /home/ubuntu/cephtest/cephadm 2024-02-10T08:49:23.237 DEBUG:teuthology.orchestra.run.smithi071:> rm -rf /home/ubuntu/cephtest/cephadm 2024-02-10T08:49:23.255 INFO:tasks.cephadm:Teardown complete 2024-02-10T08:49:23.255 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-02-10T08:49:23.270 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-02-10T08:49:23.270 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-10T08:49:23.280 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-10T08:49:23.432 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-02-10T08:49:23.443 INFO:teuthology.task.clock:Checking final clock skew... 2024-02-10T08:49:23.443 DEBUG:teuthology.orchestra.run.smithi018:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-10T08:49:23.446 DEBUG:teuthology.orchestra.run.smithi071:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-10T08:49:23.463 INFO:teuthology.orchestra.run.smithi071.stderr:bash: ntpq: command not found 2024-02-10T08:49:23.464 INFO:teuthology.orchestra.run.smithi018.stderr:bash: ntpq: command not found 2024-02-10T08:49:23.486 INFO:teuthology.orchestra.run.smithi071.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-10T08:49:23.487 INFO:teuthology.orchestra.run.smithi071.stdout:=============================================================================== 2024-02-10T08:49:23.487 INFO:teuthology.orchestra.run.smithi071.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 56 +165us[ +165us] +/- 78ms 2024-02-10T08:49:23.487 INFO:teuthology.orchestra.run.smithi071.stdout:^* hv02.front.sepia.ceph.com 3 6 377 56 +188us[ +211us] +/- 73ms 2024-02-10T08:49:23.487 INFO:teuthology.orchestra.run.smithi071.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 50 -270us[ -270us] +/- 71ms 2024-02-10T08:49:23.487 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-02-10T08:49:23.488 INFO:teuthology.orchestra.run.smithi018.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-10T08:49:23.488 INFO:teuthology.orchestra.run.smithi018.stdout:=============================================================================== 2024-02-10T08:49:23.488 INFO:teuthology.orchestra.run.smithi018.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 52 +233us[ +258us] +/- 78ms 2024-02-10T08:49:23.488 INFO:teuthology.orchestra.run.smithi018.stdout:^* hv02.front.sepia.ceph.com 3 6 377 51 +214us[ +239us] +/- 73ms 2024-02-10T08:49:23.488 INFO:teuthology.orchestra.run.smithi018.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 50 -250us[ -250us] +/- 71ms 2024-02-10T08:49:23.488 INFO:teuthology.orchestra.run.smithi018.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-02-10T08:49:23.489 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-02-10T08:49:23.499 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-02-10T08:49:23.499 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-02-10T08:49:23.509 DEBUG:teuthology.orchestra.run.smithi018:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-02-10T08:49:23.691 DEBUG:teuthology.orchestra.run.smithi071:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-02-10T08:49:23.834 DEBUG:teuthology.orchestra.run.smithi018:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-10T08:49:23.871 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-10T08:49:23.872 DEBUG:teuthology.orchestra.run.smithi071:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-10T08:49:23.903 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-10T08:49:23.904 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-02-10T08:49:23.915 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-02-10T08:49:23.927 INFO:teuthology.task.internal:Duration was 2951.501546 seconds 2024-02-10T08:49:23.927 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-02-10T08:49:23.939 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-02-10T08:49:23.939 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-10T08:49:23.942 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-10T08:49:24.047 INFO:teuthology.orchestra.run.smithi018.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-10T08:49:24.071 INFO:teuthology.orchestra.run.smithi071.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-10T08:49:24.317 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-02-10T08:49:24.317 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi018.front.sepia.ceph.com 2024-02-10T08:49:24.317 DEBUG:teuthology.orchestra.run.smithi018:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-10T08:49:24.354 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi071.front.sepia.ceph.com 2024-02-10T08:49:24.355 DEBUG:teuthology.orchestra.run.smithi071:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-10T08:49:24.384 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-02-10T08:49:24.384 DEBUG:teuthology.orchestra.run.smithi018:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-10T08:49:24.397 DEBUG:teuthology.orchestra.run.smithi071:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-10T08:49:24.581 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-02-10T08:49:24.581 DEBUG:teuthology.orchestra.run.smithi018:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-10T08:49:24.583 DEBUG:teuthology.orchestra.run.smithi071:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-10T08:49:24.837 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-02-10T08:49:24.849 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-02-10T08:49:24.849 DEBUG:teuthology.orchestra.run.smithi018:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-10T08:49:24.895 DEBUG:teuthology.orchestra.run.smithi071:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-10T08:49:24.955 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-02-10T08:49:24.967 DEBUG:teuthology.orchestra.run.smithi018:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-10T08:49:24.971 DEBUG:teuthology.orchestra.run.smithi071:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-10T08:49:25.000 INFO:teuthology.orchestra.run.smithi018.stdout:kernel.core_pattern = core 2024-02-10T08:49:25.006 INFO:teuthology.orchestra.run.smithi071.stdout:kernel.core_pattern = core 2024-02-10T08:49:25.020 DEBUG:teuthology.orchestra.run.smithi018:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-10T08:49:25.071 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-10T08:49:25.072 DEBUG:teuthology.orchestra.run.smithi071:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-10T08:49:25.089 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-10T08:49:25.090 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-02-10T08:49:25.101 INFO:teuthology.task.internal:Transferring archived files... 2024-02-10T08:49:25.102 DEBUG:teuthology.misc:Transferring archived files from smithi018:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-02-09_21:34:44-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7555285/remote/smithi018 2024-02-10T08:49:25.103 DEBUG:teuthology.orchestra.run.smithi018:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-10T08:49:25.171 DEBUG:teuthology.misc:Transferring archived files from smithi071:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-02-09_21:34:44-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7555285/remote/smithi071 2024-02-10T08:49:25.172 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-10T08:49:25.227 INFO:teuthology.task.internal:Removing archive directory... 2024-02-10T08:49:25.228 DEBUG:teuthology.orchestra.run.smithi018:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-10T08:49:25.232 DEBUG:teuthology.orchestra.run.smithi071:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-10T08:49:25.275 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-02-10T08:49:25.288 INFO:teuthology.task.internal:Not uploading archives. 2024-02-10T08:49:25.288 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-02-10T08:49:25.300 INFO:teuthology.task.internal:Tidying up after the test... 2024-02-10T08:49:25.301 DEBUG:teuthology.orchestra.run.smithi018:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-10T08:49:25.303 DEBUG:teuthology.orchestra.run.smithi071:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-10T08:49:25.320 INFO:teuthology.orchestra.run.smithi018.stdout: 393224 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 10 08:49 /home/ubuntu/cephtest 2024-02-10T08:49:25.333 INFO:teuthology.orchestra.run.smithi071.stdout: 525357 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 10 08:49 /home/ubuntu/cephtest 2024-02-10T08:49:25.335 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-02-10T08:49:25.349 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-02-10T08:49:25.395 INFO:teuthology.nuke:Checking targets against current locks 2024-02-10T08:49:25.423 DEBUG:teuthology.nuke:shortname: smithi018 2024-02-10T08:49:25.423 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-10T08:49:25.466 DEBUG:teuthology.nuke:shortname: smithi071 2024-02-10T08:49:25.467 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-10T08:49:25.472 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi018.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-02-09_21:34:44-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7555285', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-10 07:48:02.094098', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG0mpVhkOzZP8a+rj+nXH7NQTem/uhOG3iCF3DIPrgMp6R7ajxBsiZIiRB+Pl0cJiMePbB3LxLMzNHk9iBvwTJc='} 2024-02-10T08:49:25.504 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi071.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-02-09_21:34:44-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7555285', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-10 07:48:02.092554', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHzE/Bcn5hiz3L/ibUXoqMrkKgs5yEHgRM0LMkZEPP/anf9S+RP+41bDkAUQU7FODYSTZbmUDx/dSR+u6O4MM6A='} 2024-02-10T08:49:25.544 INFO:teuthology.orchestra.console.smithi018:Power off 2024-02-10T08:49:25.544 DEBUG:teuthology.orchestra.console.smithi018:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-10T08:49:25.585 INFO:teuthology.orchestra.console.smithi071:Power off 2024-02-10T08:49:25.585 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-10T08:49:25.595 DEBUG:teuthology.orchestra.console.smithi018:power off output: Chassis Power Control: Down/Off 2024-02-10T08:49:25.595 DEBUG:teuthology.orchestra.console.smithi018:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-10T08:49:25.627 DEBUG:teuthology.orchestra.console.smithi071:power off output: Chassis Power Control: Down/Off 2024-02-10T08:49:25.629 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-10T08:49:25.638 DEBUG:teuthology.orchestra.console.smithi018:check power output: Chassis Power is on 2024-02-10T08:49:25.664 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is on 2024-02-10T08:49:29.639 DEBUG:teuthology.orchestra.console.smithi018:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-10T08:49:29.665 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-10T08:49:29.749 DEBUG:teuthology.orchestra.console.smithi018:check power output: Chassis Power is on 2024-02-10T08:49:29.776 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is on 2024-02-10T08:49:33.752 DEBUG:teuthology.orchestra.console.smithi018:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-10T08:49:33.777 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-10T08:49:33.862 DEBUG:teuthology.orchestra.console.smithi018:check power output: Chassis Power is off 2024-02-10T08:49:33.888 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is on 2024-02-10T08:49:33.963 INFO:teuthology.orchestra.console.smithi018:Power off completed 2024-02-10T08:49:37.892 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-10T08:49:38.001 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is off 2024-02-10T08:49:38.102 INFO:teuthology.orchestra.console.smithi071:Power off completed 2024-02-10T08:49:38.206 INFO:teuthology.run:Summary data: description: rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} duration: 2951.5015461444855 failure_reason: '"2024-02-10T08:19:30.793075+0000 mon.a (mon.0) 751 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log' flavor: default owner: scheduled_yuriw@teuthology success: false 2024-02-10T08:49:38.206 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-10T08:49:38.287 INFO:teuthology.run:FAIL